-- Logs begin at Fri 2022-06-10 16:41:47 UTC, end at Fri 2022-06-10 19:41:08 UTC. -- Jun 10 17:46:57.541681 chdv-master-2 systemd[1]: Starting Devstack devstack@n-api.service... Jun 10 17:46:57.550796 chdv-master-2 devstack@n-api.service[111059]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 10 17:46:57.552656 chdv-master-2 devstack@n-api.service[111059]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 10 17:46:57 2022] *** Jun 10 17:46:57.552656 chdv-master-2 devstack@n-api.service[111059]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 10 17:46:57.552656 chdv-master-2 devstack@n-api.service[111059]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 10 17:46:57.552656 chdv-master-2 devstack@n-api.service[111059]: nodename: chdv-master-2 Jun 10 17:46:57.552656 chdv-master-2 devstack@n-api.service[111059]: machine: x86_64 Jun 10 17:46:57.552656 chdv-master-2 devstack@n-api.service[111059]: clock source: unix Jun 10 17:46:57.552656 chdv-master-2 devstack@n-api.service[111059]: pcre jit disabled Jun 10 17:46:57.552656 chdv-master-2 devstack@n-api.service[111059]: detected number of CPU cores: 4 Jun 10 17:46:57.552656 chdv-master-2 devstack@n-api.service[111059]: current working directory: / Jun 10 17:46:57.552656 chdv-master-2 devstack@n-api.service[111059]: detected binary path: /usr/bin/uwsgi-core Jun 10 17:46:57.553245 chdv-master-2 devstack@n-api.service[111059]: your processes number limit is 47680 Jun 10 17:46:57.553245 chdv-master-2 devstack@n-api.service[111059]: your memory page size is 4096 bytes Jun 10 17:46:57.553245 chdv-master-2 devstack@n-api.service[111059]: detected max file descriptor number: 2048 Jun 10 17:46:57.553245 chdv-master-2 devstack@n-api.service[111059]: lock engine: pthread robust mutexes Jun 10 17:46:57.553245 chdv-master-2 devstack@n-api.service[111059]: thunder lock: enabled Jun 10 17:46:57.553245 chdv-master-2 devstack@n-api.service[111059]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 10 17:46:57.553245 chdv-master-2 devstack@n-api.service[111059]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 10 17:46:57.596701 chdv-master-2 devstack@n-api.service[111059]: Python main interpreter initialized at 0x556281e6d9c0 Jun 10 17:46:57.596701 chdv-master-2 devstack@n-api.service[111059]: python threads support enabled Jun 10 17:46:57.596701 chdv-master-2 devstack@n-api.service[111059]: your server socket listen backlog is limited to 100 connections Jun 10 17:46:57.596701 chdv-master-2 devstack@n-api.service[111059]: your mercy for graceful operations on workers is 90 seconds Jun 10 17:46:57.597020 chdv-master-2 devstack@n-api.service[111059]: mapped 403077 bytes (393 KB) for 2 cores Jun 10 17:46:57.597094 chdv-master-2 devstack@n-api.service[111059]: *** Operational MODE: preforking *** Jun 10 17:46:57.597347 chdv-master-2 devstack@n-api.service[111059]: *** uWSGI is running in multiple interpreter mode *** Jun 10 17:46:57.597347 chdv-master-2 devstack@n-api.service[111059]: spawned uWSGI master process (pid: 111059) Jun 10 17:46:57.597526 chdv-master-2 systemd[1]: Started Devstack devstack@n-api.service. Jun 10 17:46:57.598168 chdv-master-2 devstack@n-api.service[111059]: spawned uWSGI worker 1 (pid: 111060, cores: 1) Jun 10 17:46:57.600336 chdv-master-2 devstack@n-api.service[111059]: spawned uWSGI worker 2 (pid: 111061, cores: 1) Jun 10 17:46:57.600336 chdv-master-2 devstack@n-api.service[111059]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 10 17:46:58.248819 chdv-master-2 devstack@n-api.service[111061]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 10 17:46:58.250487 chdv-master-2 devstack@n-api.service[111060]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 10 17:46:59.427847 chdv-master-2 devstack@n-api.service[111060]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 10 17:46:59.427847 chdv-master-2 devstack@n-api.service[111060]: from cryptography.utils import int_from_bytes Jun 10 17:46:59.428467 chdv-master-2 devstack@n-api.service[111061]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 10 17:46:59.428467 chdv-master-2 devstack@n-api.service[111061]: from cryptography.utils import int_from_bytes Jun 10 17:46:59.428872 chdv-master-2 devstack@n-api.service[111060]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 10 17:46:59.428872 chdv-master-2 devstack@n-api.service[111060]: from cryptography.utils import int_from_bytes Jun 10 17:46:59.429011 chdv-master-2 devstack@n-api.service[111061]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 10 17:46:59.429011 chdv-master-2 devstack@n-api.service[111061]: from cryptography.utils import int_from_bytes Jun 10 17:47:01.977707 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 10 17:47:01.978367 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 10 17:47:01.978715 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 10 17:47:01.978812 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 10 17:47:01.978888 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 10 17:47:01.978954 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 10 17:47:01.979028 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 10 17:47:01.979103 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 10 17:47:01.979169 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 10 17:47:01.979233 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 10 17:47:01.979445 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.979554 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.979770 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.979864 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.980095 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.980185 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.980438 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.980553 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.980770 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.980856 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.981078 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.981177 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.981396 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.981495 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.981712 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.981802 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.982037 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.982134 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.982294 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.982379 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.982605 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.982695 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.982925 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] console_host = chdv-master-2 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.983023 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] console_host = chdv-master-2 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.983247 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.983331 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.983553 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.983645 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.983862 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.983954 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.984177 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.984268 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.984504 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.984590 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.984823 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.984910 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.985132 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.985219 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.985626 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.985775 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.986053 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.986146 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.986358 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.986447 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.986669 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.986769 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.987006 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.987151 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.987314 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.987436 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.987620 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.987756 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.987940 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.988067 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.988249 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.988398 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.988599 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.988736 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.988907 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.989040 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.989836 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] host = chdv-master-2 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.989966 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] host = chdv-master-2 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.990151 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.990275 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.990460 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.990594 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.990771 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.990895 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.991180 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.991319 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.991489 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.991623 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.991797 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.991922 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.992115 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.992241 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.992458 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.992585 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.992765 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.992900 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.993088 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.993214 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.993405 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.993531 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.993720 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.993845 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.994049 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.994172 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.994324 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.994450 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.994630 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.994764 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.994935 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.995062 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.995250 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.995373 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.995579 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.995735 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.995861 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.995990 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.996121 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.996251 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.996426 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.996563 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.996697 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.996821 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.997021 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.997141 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.997358 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.997461 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.997595 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.997681 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.997844 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.997949 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.998160 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.998253 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.998476 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.998567 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.998783 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.998884 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.999092 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.999194 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.999646 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.999733 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:01.999953 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.000045 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.000258 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.000367 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.000590 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.000676 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.000893 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.000978 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.001198 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.001280 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.001513 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.001595 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.001824 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.001908 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.002142 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.002224 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.002448 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.002539 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.002763 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.002852 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.003157 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.35 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.003251 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.35 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.003403 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.35 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.003486 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.35 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.003710 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.003800 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.004044 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.004127 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.004380 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.004484 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.004738 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.004829 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.005024 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.005110 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.005345 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.005437 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.005650 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.005732 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.005953 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.006056 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.006254 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.006346 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.006570 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.006662 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.006900 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.006989 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.007200 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.007296 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.007446 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.007536 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.007744 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.007827 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.008050 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.008160 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.008385 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.008471 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.008692 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.008786 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.008997 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.009105 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.009298 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.009384 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.009593 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.009682 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.009893 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.009977 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.010197 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.010294 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.010500 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.010582 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.010803 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.010887 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.011106 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.011197 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.011406 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.011489 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.011708 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.011797 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.012006 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.012089 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.012336 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.012424 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.012642 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.012727 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.012956 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.013038 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.013258 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.013354 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.013561 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.013645 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.013863 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.013955 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.014167 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.014258 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.014484 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.014572 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.014789 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.014871 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.015092 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.015183 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.015409 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.015493 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.015711 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.015802 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.016015 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.016118 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.016342 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.016431 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.016651 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.016734 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.016955 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.017047 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.017270 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.017354 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.017567 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.017650 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.017870 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.017965 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.018181 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.018263 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.018486 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.018570 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.018787 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.018884 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.019084 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.019167 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.019381 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.019463 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.019679 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.019763 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.019978 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.020060 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.020274 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.020394 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.020626 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.020721 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.020922 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.021011 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.021236 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.021325 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.021552 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.021643 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.021856 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.021938 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.022159 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.022242 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.022459 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.022549 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.022771 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.022854 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:47:02.023101 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.023195 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.023428 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.023510 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.023764 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.023846 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.024074 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.024163 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.024426 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.024524 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.024754 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.024835 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.025067 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.025161 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.025376 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.025459 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.025688 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.025776 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.026009 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.026153 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.026316 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.026398 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.026620 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.026702 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.026927 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.027010 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.027241 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.027323 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.027559 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.027663 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.027886 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.027979 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.028199 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.028280 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.028535 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.028629 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.028851 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.028942 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.029159 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.029242 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.029471 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.029553 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.029797 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.029881 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.030113 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.030204 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.030420 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.030509 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.030755 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.030839 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.031095 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.031178 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.031406 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.031488 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.031724 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.031816 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.032042 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.032124 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.032374 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.032476 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.032686 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.032769 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.032992 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.033083 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.033310 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.033405 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.033638 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.033721 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.033950 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.034032 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.034265 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.034361 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.034575 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.034663 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.034883 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.034966 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.035190 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.035281 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.035497 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.035579 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.035807 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.035897 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.036696 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.036784 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.037013 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.037095 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.037326 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.037417 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.037638 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.037724 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.037950 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.038032 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.038263 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.038347 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.038575 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.038668 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.038884 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.038968 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.039186 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.039277 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.039488 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.039578 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.039789 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.039916 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.040095 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.040178 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.040418 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.040505 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.040737 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.040820 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.041060 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.041160 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.041362 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.041443 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.041689 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.041779 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.041991 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.042086 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.042295 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.042384 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.042601 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.042684 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.042907 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.042999 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.043208 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.043290 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.043516 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.043605 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.043823 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.043984 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.044125 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.044208 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.044466 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.044562 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.044774 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.044859 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.045075 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.045165 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.045396 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.045480 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.045698 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.045788 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.045998 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.046118 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.046308 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.046398 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.046615 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.046769 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.046925 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.047023 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.047233 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.047317 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.047540 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.047675 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.047861 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.047945 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.048174 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.048266 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.048507 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.048593 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.048840 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.048922 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.049169 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.049265 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.049472 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.049555 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.049794 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.049885 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.050119 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.050215 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.050431 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.050514 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.050732 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.050822 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.051038 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.051134 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.051339 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.051430 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.052182 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.052276 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.052520 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.052606 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.052829 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.052911 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.053129 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.053211 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.053433 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.053519 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.053736 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.053832 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.054035 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.054125 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.054334 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.054418 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.054652 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.054742 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.054957 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.055040 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.055257 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.055341 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.055557 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.055639 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.055855 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.055950 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.056196 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.056279 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.056523 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.056608 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.056860 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.056952 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.057193 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.057275 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.057510 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.057600 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.057830 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.057922 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.058140 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.058261 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.058458 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.058570 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.058766 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.058889 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.059078 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.059194 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.059390 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.059515 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.059702 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.059794 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.060022 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.060132 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.060350 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.060438 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.060673 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.060757 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.060981 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.061063 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.061300 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.061383 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.061609 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.061693 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.061927 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.062009 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.062228 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.062318 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.062540 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.062624 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.062875 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.062957 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.063204 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.063296 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.063520 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.063621 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.063836 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.063918 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.064144 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.064236 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.064480 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.064564 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.064786 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.064869 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.065096 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.065195 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.065406 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.065490 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.065715 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.065798 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.066032 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.066123 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.066339 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.066421 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.066651 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.066740 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.066958 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.067055 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.067300 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.067382 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.067607 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.067688 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.067923 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.068007 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.068225 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.068363 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.068560 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.068643 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.068885 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.068972 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.069217 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.069300 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.069525 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.069607 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.069835 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.069918 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.070152 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.070234 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.070457 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.070540 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.070762 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.070846 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.071069 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.071159 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.071371 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.071462 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.071671 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.071754 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.071975 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.072064 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.072284 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.072396 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.072611 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.072696 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.072915 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.073004 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.073216 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.073373 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.073540 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.073670 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.073834 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.073918 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.074134 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.074225 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.074435 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.074519 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.074744 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.074827 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.075064 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.075153 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.075372 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.075456 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.075690 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.075773 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.076009 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.076092 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.076324 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.076464 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.076633 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.076716 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.076952 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.077044 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.077258 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.077342 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.077558 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.077649 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.077860 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.077992 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.078160 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.078243 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.078512 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.078648 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.078804 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.078889 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.079102 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.079191 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.079415 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.079512 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.079729 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.079812 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.080035 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.080119 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.080364 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.080461 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.080670 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.080754 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.080976 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.081058 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.081292 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.081397 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.081600 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.081691 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.081903 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.081986 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.082211 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.082303 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.082519 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.082609 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.082843 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.082933 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.083157 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.083249 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.083473 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.083556 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.083777 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.083860 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.084084 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.084188 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.084414 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.084499 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.084717 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.084800 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.085023 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.085107 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.085337 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.085420 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.085900 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.085992 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.086230 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.086322 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.086547 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.086630 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.086865 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.086956 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.087185 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.087276 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.087503 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.087593 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.087832 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.087928 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.088160 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.088242 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.088521 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.088623 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.088829 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.088923 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.089139 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.089223 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.089443 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.089527 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.089746 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.089832 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.090053 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.090145 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.090356 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.090438 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.090657 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.090741 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.090959 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.091054 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.091264 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.091347 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.091566 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.091649 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.091865 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.091957 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.092164 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.092248 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.092491 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.092588 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.092803 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.092895 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.093107 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.093191 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.093416 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.093499 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.093717 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.093838 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.094037 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.094127 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.094340 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.094422 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.094641 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.094725 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.094941 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.095023 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.095242 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.095332 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.095578 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.095669 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.095878 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.095960 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.096213 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.096322 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.096562 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.096666 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.096902 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.096985 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.097206 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.097364 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.097508 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.097598 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.097828 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.097912 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.098129 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.098221 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.098429 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.099009 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.099252 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.099336 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.099558 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.099649 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.099863 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.099946 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.100164 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.100247 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.100496 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.100582 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.100805 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.100889 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.101112 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.101194 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.101417 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.101501 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.101716 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.101798 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.102021 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.102103 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.102321 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.102405 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.102631 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.102714 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.102937 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.103019 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.103234 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.103317 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.103531 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.103614 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.103838 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.103967 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.104141 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.104224 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.104462 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.104547 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.104767 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.104862 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.105067 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.105149 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.105377 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.105460 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.105676 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.105767 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.105975 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.106057 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.106274 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.106357 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.106580 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.106671 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.106882 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.106965 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.107179 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.107268 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.107501 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.107586 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.107807 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.107890 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.108111 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.108241 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.108436 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.108538 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.108740 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.108825 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.109039 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.109133 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.109337 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.109421 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.109640 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.109724 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.109957 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.110048 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.110269 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.110353 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.110568 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.110651 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.110873 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.110964 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.111174 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.111257 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.111472 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.111562 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.111771 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.111863 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.112074 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.112159 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.112394 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.112481 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.112693 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.112791 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.112993 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.113078 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.113292 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.113374 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.113589 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.113684 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.113904 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.113993 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.114739 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.114829 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.115042 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.115134 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.115343 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.115427 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.115644 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.115726 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.115984 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.116068 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.116284 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.116392 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.116660 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.116756 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.116963 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.117053 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.117274 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.117366 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.117590 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.117678 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.117899 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.117983 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.118208 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.118312 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.118518 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.118613 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.118816 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.118908 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.119126 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.119215 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.119434 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.119530 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.119745 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.119829 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.120046 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.120130 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.120367 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.120465 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.120688 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.120785 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.120999 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.121082 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.121308 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.121440 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.121628 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.121733 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.121951 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.122042 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.122267 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.122359 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.122568 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.122659 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.122871 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.122961 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.123179 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.123263 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.123484 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.123574 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.123787 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.123869 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.124090 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.124218 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.124672 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.124772 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.124983 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.125067 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.125298 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.125402 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.125599 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.125696 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.125904 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.125987 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.126206 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.126290 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.126510 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.126600 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.126814 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.127011 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.127099 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.127176 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.127423 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.127543 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.127727 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.127819 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.128026 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.128109 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.128351 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.128439 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.128659 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.128767 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.128964 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.129051 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.129264 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.129346 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.129680 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.129772 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.130010 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.130102 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.130320 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.130409 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.130622 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.130706 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.130932 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.131017 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.131241 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.131325 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.131554 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.131639 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.131866 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.131950 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.132164 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.132248 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.132601 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.132688 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.132911 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.133002 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.133220 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.133310 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.133528 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.133613 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.133829 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.133911 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.134126 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.134217 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.134435 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.134525 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.134753 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.134836 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.135054 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.135151 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.135355 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.135439 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.135655 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.135738 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.135972 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.136063 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.136272 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.136375 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.136613 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.136696 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.137025 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.137117 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.137335 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.137432 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.137637 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.137721 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.138047 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.138131 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.138355 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.138437 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.138667 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.138776 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.138988 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.139081 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.139309 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.139400 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.139631 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.139730 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.139935 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.140056 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.140248 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.140361 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.140579 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.140663 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.140900 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.140985 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.141219 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.141311 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.141530 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.141614 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.141841 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.141930 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.142144 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.142235 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.142462 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.142546 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.142781 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.142878 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.143091 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.143174 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.143409 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.143492 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.143819 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.143912 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.144140 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.144225 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.144477 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.144562 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.144797 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.144893 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.145122 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.145214 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.145451 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.145542 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.145751 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.145844 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.146056 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.146140 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.146359 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.146449 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.146660 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.146744 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.146978 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.147062 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.147278 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.147361 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.147587 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.147729 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.147896 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.147980 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.148201 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.148285 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.148525 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.148611 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.148826 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.148921 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.149140 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.149231 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.149438 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.149529 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.149756 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.149839 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.150067 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.150160 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.150386 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.150470 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.150704 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.150795 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.151006 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.151102 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.151325 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.151409 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.151629 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.151713 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.151931 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.152022 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.152230 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.152332 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.152563 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.152659 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.152902 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.152999 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.153204 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.153294 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.153520 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.153603 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.153847 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.153938 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.154173 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.154265 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.154481 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.154564 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.154810 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.154895 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.155133 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.155217 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.155446 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.155536 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.155761 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.155852 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.156080 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.156170 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.156401 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.156488 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.156703 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.156788 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.157009 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.157093 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.157308 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.157400 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.157611 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.157694 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.157908 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.157997 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.158212 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.158308 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.158510 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.158593 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.158808 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.158904 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.159110 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.159215 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.159426 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.159522 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.159722 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.159806 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.160042 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.160134 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.160370 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.160456 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.160676 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.160758 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.161487 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.161582 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.161788 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.161873 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.162127 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.162211 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.162425 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.162516 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.162755 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.162845 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.163070 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.163165 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.163388 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.163473 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.163713 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.163804 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.164020 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.164104 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.164360 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.164460 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.164680 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.164765 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.164995 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.165087 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.165307 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.165391 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.165622 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.165706 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.165935 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.166030 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.166251 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.166345 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.166563 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.166653 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.166869 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.167002 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.167183 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.167268 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.167497 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.167581 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.167811 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.167902 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.168345 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.168435 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.168680 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.168773 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.168993 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.169103 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.169306 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.169399 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.169616 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.169701 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.169929 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.170015 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.170241 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.170332 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.170551 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.170645 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.170861 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.170952 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.171168 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.171251 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.171477 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.171574 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.171804 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.171888 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.172123 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.172206 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.172471 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.172572 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.172809 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.172896 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.173123 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.173206 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.173436 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.173527 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.173747 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.173831 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.174060 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.174151 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.174411 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.174500 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.174727 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.174817 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.175033 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.175124 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.175345 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.175428 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.175658 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.175741 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.175969 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.176062 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.176280 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.176424 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.176657 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.177240 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.177471 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.177565 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.177782 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.177873 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.178092 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.178183 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.178401 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.178492 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.178713 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.178806 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.179025 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.179111 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.179348 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.179442 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.179680 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.179764 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.179997 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.180080 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.180350 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.180439 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.180642 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.180726 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.180953 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.181044 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.181469 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.181560 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.181782 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.181867 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.182114 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.182273 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.182438 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.182524 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.182760 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.182844 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.183073 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.183165 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.183388 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.183472 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.183714 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.183804 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.184017 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.184109 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.184334 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.184423 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.184645 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.184730 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.184953 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.185048 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.185253 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.185337 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.185572 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.185658 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.185880 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.185965 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.186183 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.186267 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.186501 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.186584 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.186804 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.186888 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.187331 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.187420 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.187672 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.187756 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.187988 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.188080 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.188323 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.188420 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.188663 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.188747 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.188978 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.189062 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.189283 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.189407 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.189603 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.189697 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.189907 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.189992 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.190210 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.190293 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.190525 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.190618 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.190822 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.190912 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.191125 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.191211 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.191426 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.191518 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.191734 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.191827 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.192041 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.192126 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.192391 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.192491 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.192701 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.192792 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.193004 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.193094 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.193329 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.193414 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.193632 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.193716 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.193933 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.194023 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.194234 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.194321 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.194543 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.194627 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.194846 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.194968 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.195148 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.195234 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.195448 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.195531 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.195747 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.195837 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.196052 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.196136 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.196375 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.196462 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.196685 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.196783 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.196984 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.197075 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.197292 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.197379 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.197595 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.197692 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.197903 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.197994 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.198250 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.198341 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.198572 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.198663 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.198875 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.198958 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.199175 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.199265 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.199485 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.199575 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.199792 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.199876 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.200109 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.200192 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.200443 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.200540 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.200753 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.200843 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.201097 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.201181 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.201409 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.201493 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.201935 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.202019 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.202266 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.202349 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.202585 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.202669 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.202917 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.202999 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.203245 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.203328 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.203549 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.203641 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.203853 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.203942 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.204154 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.204249 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.204500 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.204586 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.204811 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.204894 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.205118 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.205213 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.205428 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.205512 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.205737 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.205821 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.206043 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.206134 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.206350 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.206434 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.206654 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.206745 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.206960 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.207044 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.207265 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.207348 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.207571 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.207654 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.207897 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.207984 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.208235 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.208369 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.208538 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.208623 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.208849 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.208934 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.209184 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.209267 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.209504 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.209635 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.209822 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.209906 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.210133 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.210216 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.210449 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.210541 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.210756 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.210840 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.211062 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.211145 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.211367 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.211526 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.211673 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.211758 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.211988 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.212070 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.212368 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.212470 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.212645 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.212728 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.212948 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.213032 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.213360 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.213445 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.213674 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.213757 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.213991 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.214074 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.214312 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.214396 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.214620 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.214703 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.214939 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.215030 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.215256 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.215346 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.215566 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.215650 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.215883 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.215974 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.216190 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.216273 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.216539 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.216634 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.216878 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.216974 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.217203 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.217285 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.217526 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.217610 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.217829 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.217920 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.218131 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.218215 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.218431 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.218552 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.218738 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.218824 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.219053 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.219135 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.219359 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.219441 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.219659 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.219743 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.219959 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.220051 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.220264 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.220381 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.220590 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.220676 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.220891 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.220974 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.221190 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.221281 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.221491 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.221574 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.221794 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.221878 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.222094 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.222185 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.222391 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.222481 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.222690 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.222774 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.222987 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.223079 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.223287 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.223370 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.224094 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.224181 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.224426 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.224526 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.224729 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.224812 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.225031 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.225113 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.225333 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.225425 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.225634 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.225717 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.225932 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.226016 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.226259 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.226343 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.226588 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.226678 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.226898 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.226980 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.227215 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.227306 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.227521 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.227617 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.227884 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.228032 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.228129 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.228208 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.228470 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.228558 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.228789 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.228885 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.229098 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.229183 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.229403 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.229486 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.229728 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.229820 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.230034 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.230119 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.230343 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.230427 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.230649 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.230741 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.230955 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.231042 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.231258 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.231349 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.231564 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.231658 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.231886 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.231978 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.232209 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.232291 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.232535 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.232627 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.232853 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.232939 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.233169 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.233252 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.233483 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.233567 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.233794 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.233878 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.234104 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.234187 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.234426 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.234511 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.234733 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.234817 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.235040 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.235131 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.235351 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.235434 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.235660 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.235743 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.235967 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.236063 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.236282 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.236412 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.236614 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.236708 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.236937 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.237028 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.237254 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.237338 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.237559 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.237649 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.237881 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.237966 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.238202 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.238286 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.238546 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.238629 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.238858 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.238945 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.239749 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.239839 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.240078 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.240169 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.240419 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.240519 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.240736 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.240820 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.241041 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.241125 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:47:02.241280 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 10 17:47:02.241360 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 10 17:47:02.304022 chdv-master-2 devstack@n-api.service[111060]: INFO dbcounter [None req-46bf92cf-7d0f-4094-906a-4d30357eff0d None None] Registered counter for database nova_api Jun 10 17:47:02.304249 chdv-master-2 devstack@n-api.service[111061]: INFO dbcounter [None req-44524337-7a42-44a5-9e76-db6b61576260 None None] Registered counter for database nova_api Jun 10 17:47:02.324527 chdv-master-2 devstack@n-api.service[111060]: DEBUG oslo_db.sqlalchemy.engines [None req-46bf92cf-7d0f-4094-906a-4d30357eff0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111060) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 10 17:47:02.326128 chdv-master-2 devstack@n-api.service[111061]: DEBUG oslo_db.sqlalchemy.engines [None req-44524337-7a42-44a5-9e76-db6b61576260 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111061) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 10 17:47:02.331059 chdv-master-2 devstack@n-api.service[111060]: DEBUG dbcounter [-] [111060] Writer thread running {{(pid=111060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 10 17:47:02.332626 chdv-master-2 devstack@n-api.service[111061]: DEBUG dbcounter [-] [111061] Writer thread running {{(pid=111061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 10 17:47:02.388261 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.context [None req-46bf92cf-7d0f-4094-906a-4d30357eff0d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0f13ffb7-1a21-4641-8558-8a89dd295960(cell1) {{(pid=111060) load_cells /opt/stack/nova/nova/context.py:464}} Jun 10 17:47:02.389285 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.context [None req-44524337-7a42-44a5-9e76-db6b61576260 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0f13ffb7-1a21-4641-8558-8a89dd295960(cell1) {{(pid=111061) load_cells /opt/stack/nova/nova/context.py:464}} Jun 10 17:47:02.394859 chdv-master-2 devstack@n-api.service[111060]: DEBUG oslo_concurrency.lockutils [None req-46bf92cf-7d0f-4094-906a-4d30357eff0d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:47:02.395009 chdv-master-2 devstack@n-api.service[111061]: DEBUG oslo_concurrency.lockutils [None req-44524337-7a42-44a5-9e76-db6b61576260 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:47:02.395112 chdv-master-2 devstack@n-api.service[111060]: DEBUG oslo_concurrency.lockutils [None req-46bf92cf-7d0f-4094-906a-4d30357eff0d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:47:02.395112 chdv-master-2 devstack@n-api.service[111060]: DEBUG oslo_concurrency.lockutils [None req-46bf92cf-7d0f-4094-906a-4d30357eff0d None None] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:47:02.395240 chdv-master-2 devstack@n-api.service[111061]: DEBUG oslo_concurrency.lockutils [None req-44524337-7a42-44a5-9e76-db6b61576260 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:47:02.396275 chdv-master-2 devstack@n-api.service[111061]: DEBUG oslo_concurrency.lockutils [None req-44524337-7a42-44a5-9e76-db6b61576260 None None] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:47:02.397288 chdv-master-2 devstack@n-api.service[111060]: DEBUG oslo_concurrency.lockutils [None req-46bf92cf-7d0f-4094-906a-4d30357eff0d None None] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:47:02.398248 chdv-master-2 devstack@n-api.service[111061]: DEBUG oslo_concurrency.lockutils [None req-44524337-7a42-44a5-9e76-db6b61576260 None None] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:47:02.399253 chdv-master-2 devstack@n-api.service[111060]: INFO dbcounter [None req-46bf92cf-7d0f-4094-906a-4d30357eff0d None None] Registered counter for database nova_cell0 Jun 10 17:47:02.400211 chdv-master-2 devstack@n-api.service[111061]: INFO dbcounter [None req-44524337-7a42-44a5-9e76-db6b61576260 None None] Registered counter for database nova_cell0 Jun 10 17:47:02.403266 chdv-master-2 devstack@n-api.service[111060]: INFO dbcounter [None req-46bf92cf-7d0f-4094-906a-4d30357eff0d None None] Registered counter for database nova_cell1 Jun 10 17:47:02.404003 chdv-master-2 devstack@n-api.service[111061]: INFO dbcounter [None req-44524337-7a42-44a5-9e76-db6b61576260 None None] Registered counter for database nova_cell1 Jun 10 17:47:02.410531 chdv-master-2 devstack@n-api.service[111060]: DEBUG oslo_db.sqlalchemy.engines [None req-46bf92cf-7d0f-4094-906a-4d30357eff0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111060) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 10 17:47:02.413277 chdv-master-2 devstack@n-api.service[111060]: DEBUG oslo_db.sqlalchemy.engines [None req-46bf92cf-7d0f-4094-906a-4d30357eff0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111060) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 10 17:47:02.414464 chdv-master-2 devstack@n-api.service[111061]: DEBUG oslo_db.sqlalchemy.engines [None req-44524337-7a42-44a5-9e76-db6b61576260 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111061) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 10 17:47:02.417285 chdv-master-2 devstack@n-api.service[111061]: DEBUG oslo_db.sqlalchemy.engines [None req-44524337-7a42-44a5-9e76-db6b61576260 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111061) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 10 17:47:02.420962 chdv-master-2 devstack@n-api.service[111060]: DEBUG dbcounter [-] [111060] Writer thread running {{(pid=111060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 10 17:47:02.421916 chdv-master-2 devstack@n-api.service[111061]: DEBUG dbcounter [-] [111061] Writer thread running {{(pid=111061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 10 17:47:02.423532 chdv-master-2 devstack@n-api.service[111060]: DEBUG dbcounter [-] [111060] Writer thread running {{(pid=111060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 10 17:47:02.427112 chdv-master-2 devstack@n-api.service[111061]: DEBUG dbcounter [-] [111061] Writer thread running {{(pid=111061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 10 17:47:02.567938 chdv-master-2 devstack@n-api.service[111060]: INFO dbcounter [None req-46bf92cf-7d0f-4094-906a-4d30357eff0d None None] Registered counter for database nova_cell0 Jun 10 17:47:02.568369 chdv-master-2 devstack@n-api.service[111061]: INFO dbcounter [None req-44524337-7a42-44a5-9e76-db6b61576260 None None] Registered counter for database nova_cell0 Jun 10 17:47:02.576478 chdv-master-2 devstack@n-api.service[111060]: DEBUG oslo_db.sqlalchemy.engines [None req-46bf92cf-7d0f-4094-906a-4d30357eff0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111060) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 10 17:47:02.580032 chdv-master-2 devstack@n-api.service[111061]: DEBUG oslo_db.sqlalchemy.engines [None req-44524337-7a42-44a5-9e76-db6b61576260 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111061) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 10 17:47:02.580923 chdv-master-2 devstack@n-api.service[111060]: DEBUG dbcounter [-] [111060] Writer thread running {{(pid=111060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 10 17:47:02.584939 chdv-master-2 devstack@n-api.service[111061]: DEBUG dbcounter [-] [111061] Writer thread running {{(pid=111061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 10 17:47:02.982953 chdv-master-2 devstack@n-api.service[111060]: WARNING keystonemiddleware.auth_token [None req-46bf92cf-7d0f-4094-906a-4d30357eff0d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 10 17:47:02.990683 chdv-master-2 devstack@n-api.service[111060]: WARNING keystonemiddleware.auth_token [None req-46bf92cf-7d0f-4094-906a-4d30357eff0d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 10 17:47:02.994010 chdv-master-2 devstack@n-api.service[111061]: WARNING keystonemiddleware.auth_token [None req-44524337-7a42-44a5-9e76-db6b61576260 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 10 17:47:03.001505 chdv-master-2 devstack@n-api.service[111061]: WARNING keystonemiddleware.auth_token [None req-44524337-7a42-44a5-9e76-db6b61576260 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 10 17:47:03.339565 chdv-master-2 devstack@n-api.service[111060]: WARNING keystonemiddleware.auth_token [None req-46bf92cf-7d0f-4094-906a-4d30357eff0d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 10 17:47:03.342314 chdv-master-2 devstack@n-api.service[111061]: WARNING keystonemiddleware.auth_token [None req-44524337-7a42-44a5-9e76-db6b61576260 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 10 17:47:03.345637 chdv-master-2 devstack@n-api.service[111060]: WARNING keystonemiddleware.auth_token [None req-46bf92cf-7d0f-4094-906a-4d30357eff0d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 10 17:47:03.348196 chdv-master-2 devstack@n-api.service[111061]: WARNING keystonemiddleware.auth_token [None req-44524337-7a42-44a5-9e76-db6b61576260 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 10 17:47:03.350762 chdv-master-2 devstack@n-api.service[111060]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556281e6d9c0 pid: 111060 (default app) Jun 10 17:47:03.352842 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi [None req-46bf92cf-7d0f-4094-906a-4d30357eff0d None None] Calling method '>' {{(pid=111060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:47:03.353498 chdv-master-2 devstack@n-api.service[111061]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556281e6d9c0 pid: 111061 (default app) Jun 10 17:47:03.354031 chdv-master-2 devstack@n-api.service[111060]: INFO nova.api.openstack.requestlog [None req-46bf92cf-7d0f-4094-906a-4d30357eff0d None None] 10.222.0.35 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001766 Jun 10 17:47:03.354435 chdv-master-2 devstack@n-api.service[111060]: [pid: 111060|app: 0|req: 1/1] 10.222.0.35 () {50 vars in 788 bytes} [Fri Jun 10 17:47:03 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:48:22.274974 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi [None req-44524337-7a42-44a5-9e76-db6b61576260 None None] Calling method '>' {{(pid=111061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:48:22.277029 chdv-master-2 devstack@n-api.service[111061]: INFO nova.api.openstack.requestlog [None req-44524337-7a42-44a5-9e76-db6b61576260 None None] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002895 Jun 10 17:48:22.277581 chdv-master-2 devstack@n-api.service[111061]: [pid: 111061|app: 0|req: 1/2] 10.222.0.35 () {54 vars in 930 bytes} [Fri Jun 10 17:48:22 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:48:22.293100 chdv-master-2 devstack@n-api.service[111060]: DEBUG dbcounter [-] [111060] Writing DB stats nova_api:SELECT=3 {{(pid=111060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:48:22.293996 chdv-master-2 devstack@n-api.service[111060]: DEBUG dbcounter [-] [111060] Writing DB stats nova_cell1:SELECT=3 {{(pid=111060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:48:22.295074 chdv-master-2 devstack@n-api.service[111060]: DEBUG dbcounter [-] [111060] Writing DB stats nova_cell0:SELECT=3 {{(pid=111060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:48:22.296019 chdv-master-2 devstack@n-api.service[111060]: DEBUG dbcounter [-] [111060] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:48:22.729294 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi [None req-b7956c6b-19b8-4b1f-b6f2-963ce95724a7 admin admin] Calling method '>' {{(pid=111060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:48:22.760567 chdv-master-2 devstack@n-api.service[111060]: INFO nova.api.openstack.requestlog [None req-b7956c6b-19b8-4b1f-b6f2-963ce95724a7 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.476885 Jun 10 17:48:22.769382 chdv-master-2 devstack@n-api.service[111060]: [pid: 111060|app: 0|req: 2/3] 10.222.0.35 () {60 vars in 1291 bytes} [Fri Jun 10 17:48:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:48:24.923023 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi [None req-44524337-7a42-44a5-9e76-db6b61576260 None None] Calling method '>' {{(pid=111061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:48:24.924042 chdv-master-2 devstack@n-api.service[111061]: INFO nova.api.openstack.requestlog [None req-44524337-7a42-44a5-9e76-db6b61576260 None None] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jun 10 17:48:24.924757 chdv-master-2 devstack@n-api.service[111061]: [pid: 111061|app: 0|req: 2/4] 10.222.0.35 () {54 vars in 930 bytes} [Fri Jun 10 17:48:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:48:24.990961 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi [None req-39a183c3-c2b5-4fc2-b68c-14ff28ec52b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "id": "c1", "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "disk": 1, "os-flavor-access:is_public": true, "ram": 256}} {{(pid=111060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:48:25.009696 chdv-master-2 devstack@n-api.service[111060]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:48:25.009696 chdv-master-2 devstack@n-api.service[111060]: warnings.warn(msg) Jun 10 17:48:25.097432 chdv-master-2 devstack@n-api.service[111060]: INFO nova.api.openstack.requestlog [None req-39a183c3-c2b5-4fc2-b68c-14ff28ec52b1 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.165255 Jun 10 17:48:25.098236 chdv-master-2 devstack@n-api.service[111060]: [pid: 111060|app: 0|req: 3/5] 10.222.0.35 () {64 vars in 1282 bytes} [Fri Jun 10 17:48:24 2022] POST /compute/v2.1/flavors => generated 407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 17:48:25.112148 chdv-master-2 devstack@n-api.service[111061]: DEBUG dbcounter [-] [111061] Writing DB stats nova_api:SELECT=3 {{(pid=111061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:48:25.113253 chdv-master-2 devstack@n-api.service[111061]: DEBUG dbcounter [-] [111061] Writing DB stats nova_cell1:SELECT=3 {{(pid=111061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:48:25.114337 chdv-master-2 devstack@n-api.service[111061]: DEBUG dbcounter [-] [111061] Writing DB stats nova_cell0:SELECT=3 {{(pid=111061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:48:25.115908 chdv-master-2 devstack@n-api.service[111061]: DEBUG dbcounter [-] [111061] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:48:25.324548 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi [None req-7927f813-d8c1-4957-b837-db6c1a6a872d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:48:25.327031 chdv-master-2 devstack@n-api.service[111061]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:48:25.327031 chdv-master-2 devstack@n-api.service[111061]: warnings.warn(msg) Jun 10 17:48:25.450221 chdv-master-2 devstack@n-api.service[111061]: INFO nova.api.openstack.requestlog [None req-7927f813-d8c1-4957-b837-db6c1a6a872d admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.343597 Jun 10 17:48:25.451096 chdv-master-2 devstack@n-api.service[111061]: [pid: 111061|app: 0|req: 3/6] 10.222.0.35 () {64 vars in 1335 bytes} [Fri Jun 10 17:48:25 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:48:27.611922 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi [None req-39a183c3-c2b5-4fc2-b68c-14ff28ec52b1 admin admin] Calling method '>' {{(pid=111060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:48:27.612974 chdv-master-2 devstack@n-api.service[111060]: INFO nova.api.openstack.requestlog [None req-39a183c3-c2b5-4fc2-b68c-14ff28ec52b1 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Jun 10 17:48:27.613374 chdv-master-2 devstack@n-api.service[111060]: [pid: 111060|app: 0|req: 4/7] 10.222.0.35 () {54 vars in 930 bytes} [Fri Jun 10 17:48:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:48:27.730999 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi [None req-976cb6ef-b711-486a-8315-a21e0cba719d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "disk": 5, "id": "d1", "vcpus": 1}} {{(pid=111061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:48:27.752664 chdv-master-2 devstack@n-api.service[111061]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:48:27.752664 chdv-master-2 devstack@n-api.service[111061]: warnings.warn(msg) Jun 10 17:48:27.885379 chdv-master-2 devstack@n-api.service[111061]: INFO nova.api.openstack.requestlog [None req-976cb6ef-b711-486a-8315-a21e0cba719d admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.265940 Jun 10 17:48:27.885838 chdv-master-2 devstack@n-api.service[111061]: [pid: 111061|app: 0|req: 4/8] 10.222.0.35 () {64 vars in 1282 bytes} [Fri Jun 10 17:48:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 10 17:48:27.897940 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi [None req-cb6dc0f3-9cdb-476f-b921-f382985e605d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:48:27.899518 chdv-master-2 devstack@n-api.service[111060]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:48:27.899518 chdv-master-2 devstack@n-api.service[111060]: warnings.warn(msg) Jun 10 17:48:27.996565 chdv-master-2 devstack@n-api.service[111060]: INFO nova.api.openstack.requestlog [None req-cb6dc0f3-9cdb-476f-b921-f382985e605d admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102001 Jun 10 17:48:28.016332 chdv-master-2 devstack@n-api.service[111060]: [pid: 111060|app: 0|req: 5/9] 10.222.0.35 () {64 vars in 1335 bytes} [Fri Jun 10 17:48:27 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:48:30.234265 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi [None req-976cb6ef-b711-486a-8315-a21e0cba719d admin admin] Calling method '>' {{(pid=111061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:48:30.235852 chdv-master-2 devstack@n-api.service[111061]: INFO nova.api.openstack.requestlog [None req-976cb6ef-b711-486a-8315-a21e0cba719d admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002861 Jun 10 17:48:30.238010 chdv-master-2 devstack@n-api.service[111061]: [pid: 111061|app: 0|req: 5/10] 10.222.0.35 () {54 vars in 930 bytes} [Fri Jun 10 17:48:30 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:48:30.308980 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi [None req-7b14f599-3cbe-4c3d-a041-4dad661da144 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "name": "ds1G", "id": "d2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024}} {{(pid=111060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:48:30.390535 chdv-master-2 devstack@n-api.service[111060]: INFO nova.api.openstack.requestlog [None req-7b14f599-3cbe-4c3d-a041-4dad661da144 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.146499 Jun 10 17:48:30.391669 chdv-master-2 devstack@n-api.service[111060]: [pid: 111060|app: 0|req: 6/11] 10.222.0.35 () {64 vars in 1282 bytes} [Fri Jun 10 17:48:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 17:48:30.415083 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi [None req-9873b105-d70a-417d-a1fd-5886c78689aa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:48:30.519504 chdv-master-2 devstack@n-api.service[111061]: INFO nova.api.openstack.requestlog [None req-9873b105-d70a-417d-a1fd-5886c78689aa admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.104434 Jun 10 17:48:30.524439 chdv-master-2 devstack@n-api.service[111061]: [pid: 111061|app: 0|req: 6/12] 10.222.0.35 () {64 vars in 1335 bytes} [Fri Jun 10 17:48:30 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:48:32.910681 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi [None req-7b14f599-3cbe-4c3d-a041-4dad661da144 admin admin] Calling method '>' {{(pid=111060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:48:32.911876 chdv-master-2 devstack@n-api.service[111060]: INFO nova.api.openstack.requestlog [None req-7b14f599-3cbe-4c3d-a041-4dad661da144 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001652 Jun 10 17:48:32.912923 chdv-master-2 devstack@n-api.service[111060]: [pid: 111060|app: 0|req: 7/13] 10.222.0.35 () {54 vars in 930 bytes} [Fri Jun 10 17:48:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:48:32.982774 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi [None req-d2fecbf2-f22e-49c5-aede-325762f234ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d3", "disk": 10, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds2G", "vcpus": 2, "rxtx_factor": 1.0}} {{(pid=111061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:48:33.071571 chdv-master-2 devstack@n-api.service[111061]: INFO nova.api.openstack.requestlog [None req-d2fecbf2-f22e-49c5-aede-325762f234ac admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.151577 Jun 10 17:48:33.080988 chdv-master-2 devstack@n-api.service[111061]: [pid: 111061|app: 0|req: 7/14] 10.222.0.35 () {64 vars in 1282 bytes} [Fri Jun 10 17:48:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 17:48:33.086893 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi [None req-5788eaae-0b25-4997-907f-5f2e825b7ad5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:48:33.181245 chdv-master-2 devstack@n-api.service[111060]: INFO nova.api.openstack.requestlog [None req-5788eaae-0b25-4997-907f-5f2e825b7ad5 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098012 Jun 10 17:48:33.182336 chdv-master-2 devstack@n-api.service[111060]: [pid: 111060|app: 0|req: 8/15] 10.222.0.35 () {64 vars in 1335 bytes} [Fri Jun 10 17:48:33 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:48:35.473651 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi [None req-d2fecbf2-f22e-49c5-aede-325762f234ac admin admin] Calling method '>' {{(pid=111061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:48:35.474750 chdv-master-2 devstack@n-api.service[111061]: INFO nova.api.openstack.requestlog [None req-d2fecbf2-f22e-49c5-aede-325762f234ac admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001556 Jun 10 17:48:35.475226 chdv-master-2 devstack@n-api.service[111061]: [pid: 111061|app: 0|req: 8/16] 10.222.0.35 () {54 vars in 930 bytes} [Fri Jun 10 17:48:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:48:35.539305 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi [None req-269840dd-c05d-45e5-ba32-859e7f247b5e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 4, "ram": 4096, "os-flavor-access:is_public": true, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 20, "name": "ds4G"}} {{(pid=111060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:48:35.641011 chdv-master-2 devstack@n-api.service[111060]: INFO nova.api.openstack.requestlog [None req-269840dd-c05d-45e5-ba32-859e7f247b5e admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.159389 Jun 10 17:48:35.649649 chdv-master-2 devstack@n-api.service[111060]: [pid: 111060|app: 0|req: 9/17] 10.222.0.35 () {64 vars in 1282 bytes} [Fri Jun 10 17:48:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 10 17:48:35.654121 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi [None req-eaa72523-046d-4983-ae8b-42f682c58ea5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:48:35.754452 chdv-master-2 devstack@n-api.service[111061]: INFO nova.api.openstack.requestlog [None req-eaa72523-046d-4983-ae8b-42f682c58ea5 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103802 Jun 10 17:48:35.768363 chdv-master-2 devstack@n-api.service[111061]: [pid: 111061|app: 0|req: 9/18] 10.222.0.35 () {64 vars in 1335 bytes} [Fri Jun 10 17:48:35 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:48:37.993820 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi [None req-269840dd-c05d-45e5-ba32-859e7f247b5e admin admin] Calling method '>' {{(pid=111060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:48:37.995442 chdv-master-2 devstack@n-api.service[111060]: INFO nova.api.openstack.requestlog [None req-269840dd-c05d-45e5-ba32-859e7f247b5e admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002028 Jun 10 17:48:37.996580 chdv-master-2 devstack@n-api.service[111060]: [pid: 111060|app: 0|req: 10/19] 10.222.0.35 () {54 vars in 930 bytes} [Fri Jun 10 17:48:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:48:38.054376 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi [None req-ced27e02-bf42-4d22-ba65-43a9bf569fad admin admin] Calling method '>' {{(pid=111061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:48:38.077695 chdv-master-2 devstack@n-api.service[111061]: INFO nova.api.openstack.requestlog [None req-ced27e02-bf42-4d22-ba65-43a9bf569fad admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.075438 Jun 10 17:48:38.078626 chdv-master-2 devstack@n-api.service[111061]: [pid: 111061|app: 0|req: 10/20] 10.222.0.35 () {60 vars in 1291 bytes} [Fri Jun 10 17:48:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 17:48:40.360182 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi [None req-269840dd-c05d-45e5-ba32-859e7f247b5e admin admin] Calling method '>' {{(pid=111060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:48:40.361336 chdv-master-2 devstack@n-api.service[111060]: INFO nova.api.openstack.requestlog [None req-269840dd-c05d-45e5-ba32-859e7f247b5e admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001571 Jun 10 17:48:40.366861 chdv-master-2 devstack@n-api.service[111060]: [pid: 111060|app: 0|req: 11/21] 10.222.0.35 () {54 vars in 930 bytes} [Fri Jun 10 17:48:40 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:48:40.452562 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi [None req-47f61f45-0f4a-436e-9c71-2625239f0570 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "disk": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.tiny", "id": "1", "rxtx_factor": 1.0}} {{(pid=111061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:48:40.546348 chdv-master-2 devstack@n-api.service[111061]: INFO nova.api.openstack.requestlog [None req-47f61f45-0f4a-436e-9c71-2625239f0570 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.178239 Jun 10 17:48:40.549914 chdv-master-2 devstack@n-api.service[111061]: [pid: 111061|app: 0|req: 11/22] 10.222.0.35 () {64 vars in 1282 bytes} [Fri Jun 10 17:48:40 2022] POST /compute/v2.1/flavors => generated 402 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 10 17:48:40.560074 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi [None req-bed4d5f8-aa81-4e56-a7ab-d1431d19e7dd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:48:40.657995 chdv-master-2 devstack@n-api.service[111060]: INFO nova.api.openstack.requestlog [None req-bed4d5f8-aa81-4e56-a7ab-d1431d19e7dd admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101388 Jun 10 17:48:40.678131 chdv-master-2 devstack@n-api.service[111060]: [pid: 111060|app: 0|req: 12/23] 10.222.0.35 () {64 vars in 1332 bytes} [Fri Jun 10 17:48:40 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:48:42.911814 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi [None req-47f61f45-0f4a-436e-9c71-2625239f0570 admin admin] Calling method '>' {{(pid=111061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:48:42.912865 chdv-master-2 devstack@n-api.service[111061]: INFO nova.api.openstack.requestlog [None req-47f61f45-0f4a-436e-9c71-2625239f0570 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 Jun 10 17:48:42.913264 chdv-master-2 devstack@n-api.service[111061]: [pid: 111061|app: 0|req: 12/24] 10.222.0.35 () {54 vars in 930 bytes} [Fri Jun 10 17:48:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:48:42.975936 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi [None req-9b7b1f13-aafb-4aa9-af05-cc7baa5d894e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "vcpus": 1, "ram": 2048, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.small", "disk": 20, "swap": 0}} {{(pid=111060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:48:43.039821 chdv-master-2 devstack@n-api.service[111060]: INFO nova.api.openstack.requestlog [None req-9b7b1f13-aafb-4aa9-af05-cc7baa5d894e admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.120400 Jun 10 17:48:43.040440 chdv-master-2 devstack@n-api.service[111060]: [pid: 111060|app: 0|req: 13/25] 10.222.0.35 () {64 vars in 1282 bytes} [Fri Jun 10 17:48:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 10 17:48:43.052728 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi [None req-aa3d47fd-17f1-4e83-aa21-309763b1e7b4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:48:43.131607 chdv-master-2 devstack@n-api.service[111061]: INFO nova.api.openstack.requestlog [None req-aa3d47fd-17f1-4e83-aa21-309763b1e7b4 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083012 Jun 10 17:48:43.132192 chdv-master-2 devstack@n-api.service[111061]: [pid: 111061|app: 0|req: 13/26] 10.222.0.35 () {64 vars in 1332 bytes} [Fri Jun 10 17:48:43 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:48:45.920000 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi [None req-9b7b1f13-aafb-4aa9-af05-cc7baa5d894e admin admin] Calling method '>' {{(pid=111060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:48:45.921170 chdv-master-2 devstack@n-api.service[111060]: INFO nova.api.openstack.requestlog [None req-9b7b1f13-aafb-4aa9-af05-cc7baa5d894e admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001637 Jun 10 17:48:45.921570 chdv-master-2 devstack@n-api.service[111060]: [pid: 111060|app: 0|req: 14/27] 10.222.0.35 () {54 vars in 930 bytes} [Fri Jun 10 17:48:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:48:45.990537 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi [None req-d5dea122-f308-446f-ba50-45b1b409760f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "name": "m1.medium", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "ram": 4096, "disk": 40, "id": "3"}} {{(pid=111061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:48:46.067762 chdv-master-2 devstack@n-api.service[111061]: INFO nova.api.openstack.requestlog [None req-d5dea122-f308-446f-ba50-45b1b409760f admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.140048 Jun 10 17:48:46.068292 chdv-master-2 devstack@n-api.service[111061]: [pid: 111061|app: 0|req: 14/28] 10.222.0.35 () {64 vars in 1282 bytes} [Fri Jun 10 17:48:45 2022] POST /compute/v2.1/flavors => generated 406 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 10 17:48:46.080712 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi [None req-eeb61216-a240-42f3-b8a7-ec408f12bbce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:48:46.178901 chdv-master-2 devstack@n-api.service[111060]: INFO nova.api.openstack.requestlog [None req-eeb61216-a240-42f3-b8a7-ec408f12bbce admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102350 Jun 10 17:48:46.179490 chdv-master-2 devstack@n-api.service[111060]: [pid: 111060|app: 0|req: 15/29] 10.222.0.35 () {64 vars in 1332 bytes} [Fri Jun 10 17:48:46 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:48:48.403616 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi [None req-d5dea122-f308-446f-ba50-45b1b409760f admin admin] Calling method '>' {{(pid=111061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:48:48.404727 chdv-master-2 devstack@n-api.service[111061]: INFO nova.api.openstack.requestlog [None req-d5dea122-f308-446f-ba50-45b1b409760f admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001892 Jun 10 17:48:48.405169 chdv-master-2 devstack@n-api.service[111061]: [pid: 111061|app: 0|req: 15/30] 10.222.0.35 () {54 vars in 930 bytes} [Fri Jun 10 17:48:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:48:48.472792 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi [None req-76929c28-4b4e-4b87-821b-ec08d134dfcd admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "vcpus": 4, "swap": 0, "os-flavor-access:is_public": true, "disk": 80, "name": "m1.large", "ram": 8192}} {{(pid=111060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:48:48.655777 chdv-master-2 devstack@n-api.service[111060]: INFO nova.api.openstack.requestlog [None req-76929c28-4b4e-4b87-821b-ec08d134dfcd admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.242025 Jun 10 17:48:48.656724 chdv-master-2 devstack@n-api.service[111060]: [pid: 111060|app: 0|req: 16/31] 10.222.0.35 () {64 vars in 1282 bytes} [Fri Jun 10 17:48:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 17:48:48.669900 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi [None req-6b71c838-f54a-47cd-972b-6775846ce51a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:48:48.746846 chdv-master-2 devstack@n-api.service[111061]: INFO nova.api.openstack.requestlog [None req-6b71c838-f54a-47cd-972b-6775846ce51a admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081196 Jun 10 17:48:48.747431 chdv-master-2 devstack@n-api.service[111061]: [pid: 111061|app: 0|req: 16/32] 10.222.0.35 () {64 vars in 1332 bytes} [Fri Jun 10 17:48:48 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:48:50.947493 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi [None req-76929c28-4b4e-4b87-821b-ec08d134dfcd admin admin] Calling method '>' {{(pid=111060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:48:50.948563 chdv-master-2 devstack@n-api.service[111060]: INFO nova.api.openstack.requestlog [None req-76929c28-4b4e-4b87-821b-ec08d134dfcd admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Jun 10 17:48:50.948957 chdv-master-2 devstack@n-api.service[111060]: [pid: 111060|app: 0|req: 17/33] 10.222.0.35 () {54 vars in 930 bytes} [Fri Jun 10 17:48:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:48:51.008750 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi [None req-7985ceb9-f028-4638-b57e-df7e10ace45b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "id": "5", "vcpus": 8, "disk": 160, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=111061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:48:51.084736 chdv-master-2 devstack@n-api.service[111061]: INFO nova.api.openstack.requestlog [None req-7985ceb9-f028-4638-b57e-df7e10ace45b admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.129852 Jun 10 17:48:51.085281 chdv-master-2 devstack@n-api.service[111061]: [pid: 111061|app: 0|req: 17/34] 10.222.0.35 () {64 vars in 1282 bytes} [Fri Jun 10 17:48:50 2022] POST /compute/v2.1/flavors => generated 408 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 17:48:51.097209 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi [None req-0cd3a9f2-7802-415d-aeb8-3a5131ffdc96 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:48:51.172719 chdv-master-2 devstack@n-api.service[111060]: INFO nova.api.openstack.requestlog [None req-0cd3a9f2-7802-415d-aeb8-3a5131ffdc96 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079083 Jun 10 17:48:51.173302 chdv-master-2 devstack@n-api.service[111060]: [pid: 111060|app: 0|req: 18/35] 10.222.0.35 () {64 vars in 1332 bytes} [Fri Jun 10 17:48:51 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:49:18.866641 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi [None req-7985ceb9-f028-4638-b57e-df7e10ace45b admin admin] Calling method '>' {{(pid=111061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:49:18.867712 chdv-master-2 devstack@n-api.service[111061]: INFO nova.api.openstack.requestlog [None req-7985ceb9-f028-4638-b57e-df7e10ace45b admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jun 10 17:49:18.868100 chdv-master-2 devstack@n-api.service[111061]: [pid: 111061|app: 0|req: 18/36] 10.222.0.35 () {54 vars in 930 bytes} [Fri Jun 10 17:49:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:49:18.879471 chdv-master-2 devstack@n-api.service[111060]: DEBUG dbcounter [-] [111060] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=111060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:49:18.927024 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi [None req-191fdaf7-3dd4-47e1-b8e7-a27794f8dfac admin admin] Calling method '>' {{(pid=111060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:49:18.944477 chdv-master-2 devstack@n-api.service[111060]: INFO nova.api.openstack.requestlog [None req-191fdaf7-3dd4-47e1-b8e7-a27794f8dfac admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070246 Jun 10 17:49:18.944994 chdv-master-2 devstack@n-api.service[111060]: [pid: 111060|app: 0|req: 19/37] 10.222.0.35 () {60 vars in 1291 bytes} [Fri Jun 10 17:49:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 17:49:19.915624 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi [None req-7985ceb9-f028-4638-b57e-df7e10ace45b admin admin] Calling method '>' {{(pid=111061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:49:19.916673 chdv-master-2 devstack@n-api.service[111061]: INFO nova.api.openstack.requestlog [None req-7985ceb9-f028-4638-b57e-df7e10ace45b admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jun 10 17:49:19.917069 chdv-master-2 devstack@n-api.service[111061]: [pid: 111061|app: 0|req: 19/38] 10.222.0.35 () {56 vars in 1074 bytes} [Fri Jun 10 17:49:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:49:20.135672 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi [None req-9ccadf14-0c44-4520-8f57-f03cdad7f558 admin admin] Calling method '>' {{(pid=111060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:49:20.141106 chdv-master-2 devstack@n-api.service[111060]: INFO nova.api.openstack.wsgi [None req-9ccadf14-0c44-4520-8f57-f03cdad7f558 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 10 17:49:20.144279 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi [None req-9ccadf14-0c44-4520-8f57-f03cdad7f558 admin admin] Request method failure captured: Jun 10 17:49:20.144279 chdv-master-2 devstack@n-api.service[111060]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 10 17:49:20.144279 chdv-master-2 devstack@n-api.service[111060]: Accept: application/json Jun 10 17:49:20.144279 chdv-master-2 devstack@n-api.service[111060]: Accept-Encoding: gzip, deflate Jun 10 17:49:20.144279 chdv-master-2 devstack@n-api.service[111060]: Connection: keep-alive Jun 10 17:49:20.144279 chdv-master-2 devstack@n-api.service[111060]: Content-Length: 0 Jun 10 17:49:20.144279 chdv-master-2 devstack@n-api.service[111060]: Host: 10.222.0.35 Jun 10 17:49:20.144279 chdv-master-2 devstack@n-api.service[111060]: Openstack-Api-Version: compute 2.90 Jun 10 17:49:20.144279 chdv-master-2 devstack@n-api.service[111060]: Openstack-System-Scope: None Jun 10 17:49:20.144279 chdv-master-2 devstack@n-api.service[111060]: User-Agent: python-novaclient Jun 10 17:49:20.144279 chdv-master-2 devstack@n-api.service[111060]: X-Auth-Token: gAAAAABio4QfHgP5Bfe1A24gT4XnSOYLJqdrNblvgvIuqje6AKbXGjgVY_5lBHxXvTtpWiSMdrjykwq4BoWEqOjM4NP1wI8e8c2eUzo_yKXtFoWFNPPoco3o94V7Aeq_BDvL_fLi_dGjYCL4qbwcdJyZsNGk08dgOF233dWMV1-wmpU6DqdBP1M Jun 10 17:49:20.144279 chdv-master-2 devstack@n-api.service[111060]: X-Domain-Id: None Jun 10 17:49:20.144279 chdv-master-2 devstack@n-api.service[111060]: X-Domain-Name: None Jun 10 17:49:20.144279 chdv-master-2 devstack@n-api.service[111060]: X-Identity-Status: Confirmed Jun 10 17:49:20.144279 chdv-master-2 devstack@n-api.service[111060]: X-Is-Admin-Project: True Jun 10 17:49:20.144279 chdv-master-2 devstack@n-api.service[111060]: X-Openstack-Nova-Api-Version: 2.90 Jun 10 17:49:20.144279 chdv-master-2 devstack@n-api.service[111060]: X-Project-Domain-Id: default Jun 10 17:49:20.144279 chdv-master-2 devstack@n-api.service[111060]: X-Project-Domain-Name: Default Jun 10 17:49:20.144279 chdv-master-2 devstack@n-api.service[111060]: X-Project-Id: 3be246010f0344e6bdb4571b68000a67 Jun 10 17:49:20.144279 chdv-master-2 devstack@n-api.service[111060]: X-Project-Name: admin Jun 10 17:49:20.144279 chdv-master-2 devstack@n-api.service[111060]: X-Role: reader,member,admin Jun 10 17:49:20.144279 chdv-master-2 devstack@n-api.service[111060]: X-Roles: reader,member,admin Jun 10 17:49:20.145926 chdv-master-2 devstack@n-api.service[111060]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/3be246010f0344e6bdb4571b68000a67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3be246010f0344e6bdb4571b68000a67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3be246010f0344e6bdb4571b68000a67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_3be246010f0344e6bdb4571b68000a67", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:49:20.145926 chdv-master-2 devstack@n-api.service[111060]: X-Tenant: admin Jun 10 17:49:20.145926 chdv-master-2 devstack@n-api.service[111060]: X-Tenant-Id: 3be246010f0344e6bdb4571b68000a67 Jun 10 17:49:20.145926 chdv-master-2 devstack@n-api.service[111060]: X-Tenant-Name: admin Jun 10 17:49:20.145926 chdv-master-2 devstack@n-api.service[111060]: X-User: admin Jun 10 17:49:20.145926 chdv-master-2 devstack@n-api.service[111060]: X-User-Domain-Id: default Jun 10 17:49:20.145926 chdv-master-2 devstack@n-api.service[111060]: X-User-Domain-Name: Default Jun 10 17:49:20.145926 chdv-master-2 devstack@n-api.service[111060]: X-User-Id: b170903f7e4e4205be25d20e4c89d990 Jun 10 17:49:20.145926 chdv-master-2 devstack@n-api.service[111060]: X-User-Name: admin Jun 10 17:49:20.145926 chdv-master-2 devstack@n-api.service[111060]: method: > Jun 10 17:49:20.145926 chdv-master-2 devstack@n-api.service[111060]: exception: Flavor 42 could not be found. Jun 10 17:49:20.145926 chdv-master-2 devstack@n-api.service[111060]: action_args: {'id': '42'} Jun 10 17:49:20.145926 chdv-master-2 devstack@n-api.service[111060]: {{(pid=111060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:49:20.145926 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:49:20.147132 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 10 17:49:20.147132 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 10 17:49:20.147132 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 10 17:49:20.147132 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 10 17:49:20.147132 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 17:49:20.147132 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 17:49:20.147132 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 10 17:49:20.147132 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 10 17:49:20.147132 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 10 17:49:20.147132 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:49:20.147132 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 10 17:49:20.147132 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 10 17:49:20.147132 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 10 17:49:20.147132 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi Jun 10 17:49:20.147132 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:49:20.147132 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi Jun 10 17:49:20.147132 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:49:20.147132 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:49:20.147132 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:49:20.148641 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:49:20.148641 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:49:20.148641 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:49:20.148641 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:49:20.148641 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 10 17:49:20.148641 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 10 17:49:20.148641 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 10 17:49:20.148641 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi Jun 10 17:49:20.148641 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:49:20.148641 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi Jun 10 17:49:20.148641 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:49:20.148641 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:49:20.148641 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:49:20.148641 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:49:20.148641 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:49:20.148641 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 10 17:49:20.148641 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi Jun 10 17:49:20.148641 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi [None req-9ccadf14-0c44-4520-8f57-f03cdad7f558 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:49:20.149987 chdv-master-2 devstack@n-api.service[111060]: INFO nova.api.openstack.requestlog [None req-9ccadf14-0c44-4520-8f57-f03cdad7f558 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061938 Jun 10 17:49:20.149987 chdv-master-2 devstack@n-api.service[111060]: [pid: 111060|app: 0|req: 20/39] 10.222.0.35 () {60 vars in 1190 bytes} [Fri Jun 10 17:49:20 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 10 17:49:20.155152 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi [None req-008d8683-52b6-444c-b238-12a18217b0a2 admin admin] Calling method '>' {{(pid=111061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:49:20.158643 chdv-master-2 devstack@n-api.service[111061]: DEBUG dbcounter [-] [111061] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=111061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:49:20.177560 chdv-master-2 devstack@n-api.service[111061]: INFO nova.api.openstack.requestlog [None req-008d8683-52b6-444c-b238-12a18217b0a2 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026026 Jun 10 17:49:20.178102 chdv-master-2 devstack@n-api.service[111061]: [pid: 111061|app: 0|req: 20/40] 10.222.0.35 () {60 vars in 1210 bytes} [Fri Jun 10 17:49:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 17:49:20.187487 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi [None req-b32e825b-7e34-49c3-a337-b87315767f06 admin admin] Calling method '>' {{(pid=111060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:49:20.211200 chdv-master-2 devstack@n-api.service[111060]: INFO nova.api.openstack.requestlog [None req-b32e825b-7e34-49c3-a337-b87315767f06 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027194 Jun 10 17:49:20.211777 chdv-master-2 devstack@n-api.service[111060]: [pid: 111060|app: 0|req: 21/41] 10.222.0.35 () {60 vars in 1210 bytes} [Fri Jun 10 17:49:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 17:49:20.222461 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi [None req-01ea86e0-ea44-4c20-870b-da32d28ad1b7 admin admin] Calling method '>' {{(pid=111061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:49:20.228552 chdv-master-2 devstack@n-api.service[111061]: INFO nova.api.openstack.wsgi [None req-01ea86e0-ea44-4c20-870b-da32d28ad1b7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 10 17:49:20.231729 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi [None req-01ea86e0-ea44-4c20-870b-da32d28ad1b7 admin admin] Request method failure captured: Jun 10 17:49:20.231729 chdv-master-2 devstack@n-api.service[111061]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 10 17:49:20.231729 chdv-master-2 devstack@n-api.service[111061]: Accept: application/json Jun 10 17:49:20.231729 chdv-master-2 devstack@n-api.service[111061]: Accept-Encoding: gzip, deflate Jun 10 17:49:20.231729 chdv-master-2 devstack@n-api.service[111061]: Connection: keep-alive Jun 10 17:49:20.231729 chdv-master-2 devstack@n-api.service[111061]: Content-Length: 0 Jun 10 17:49:20.231729 chdv-master-2 devstack@n-api.service[111061]: Host: 10.222.0.35 Jun 10 17:49:20.231729 chdv-master-2 devstack@n-api.service[111061]: Openstack-Api-Version: compute 2.90 Jun 10 17:49:20.231729 chdv-master-2 devstack@n-api.service[111061]: Openstack-System-Scope: None Jun 10 17:49:20.231729 chdv-master-2 devstack@n-api.service[111061]: User-Agent: python-novaclient Jun 10 17:49:20.231729 chdv-master-2 devstack@n-api.service[111061]: X-Auth-Token: gAAAAABio4QfHgP5Bfe1A24gT4XnSOYLJqdrNblvgvIuqje6AKbXGjgVY_5lBHxXvTtpWiSMdrjykwq4BoWEqOjM4NP1wI8e8c2eUzo_yKXtFoWFNPPoco3o94V7Aeq_BDvL_fLi_dGjYCL4qbwcdJyZsNGk08dgOF233dWMV1-wmpU6DqdBP1M Jun 10 17:49:20.231729 chdv-master-2 devstack@n-api.service[111061]: X-Domain-Id: None Jun 10 17:49:20.231729 chdv-master-2 devstack@n-api.service[111061]: X-Domain-Name: None Jun 10 17:49:20.231729 chdv-master-2 devstack@n-api.service[111061]: X-Identity-Status: Confirmed Jun 10 17:49:20.231729 chdv-master-2 devstack@n-api.service[111061]: X-Is-Admin-Project: True Jun 10 17:49:20.231729 chdv-master-2 devstack@n-api.service[111061]: X-Openstack-Nova-Api-Version: 2.90 Jun 10 17:49:20.231729 chdv-master-2 devstack@n-api.service[111061]: X-Project-Domain-Id: default Jun 10 17:49:20.231729 chdv-master-2 devstack@n-api.service[111061]: X-Project-Domain-Name: Default Jun 10 17:49:20.231729 chdv-master-2 devstack@n-api.service[111061]: X-Project-Id: 3be246010f0344e6bdb4571b68000a67 Jun 10 17:49:20.231729 chdv-master-2 devstack@n-api.service[111061]: X-Project-Name: admin Jun 10 17:49:20.231729 chdv-master-2 devstack@n-api.service[111061]: X-Role: reader,member,admin Jun 10 17:49:20.231729 chdv-master-2 devstack@n-api.service[111061]: X-Roles: reader,member,admin Jun 10 17:49:20.233080 chdv-master-2 devstack@n-api.service[111061]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/3be246010f0344e6bdb4571b68000a67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3be246010f0344e6bdb4571b68000a67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3be246010f0344e6bdb4571b68000a67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_3be246010f0344e6bdb4571b68000a67", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:49:20.233080 chdv-master-2 devstack@n-api.service[111061]: X-Tenant: admin Jun 10 17:49:20.233080 chdv-master-2 devstack@n-api.service[111061]: X-Tenant-Id: 3be246010f0344e6bdb4571b68000a67 Jun 10 17:49:20.233080 chdv-master-2 devstack@n-api.service[111061]: X-Tenant-Name: admin Jun 10 17:49:20.233080 chdv-master-2 devstack@n-api.service[111061]: X-User: admin Jun 10 17:49:20.233080 chdv-master-2 devstack@n-api.service[111061]: X-User-Domain-Id: default Jun 10 17:49:20.233080 chdv-master-2 devstack@n-api.service[111061]: X-User-Domain-Name: Default Jun 10 17:49:20.233080 chdv-master-2 devstack@n-api.service[111061]: X-User-Id: b170903f7e4e4205be25d20e4c89d990 Jun 10 17:49:20.233080 chdv-master-2 devstack@n-api.service[111061]: X-User-Name: admin Jun 10 17:49:20.233080 chdv-master-2 devstack@n-api.service[111061]: method: > Jun 10 17:49:20.233080 chdv-master-2 devstack@n-api.service[111061]: exception: Flavor 42 could not be found. Jun 10 17:49:20.233080 chdv-master-2 devstack@n-api.service[111061]: action_args: {'id': '42'} Jun 10 17:49:20.233080 chdv-master-2 devstack@n-api.service[111061]: {{(pid=111061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:49:20.233080 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:49:20.233900 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 10 17:49:20.233900 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 10 17:49:20.233900 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 10 17:49:20.233900 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 10 17:49:20.233900 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 17:49:20.233900 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 17:49:20.233900 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 10 17:49:20.233900 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 10 17:49:20.233900 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 10 17:49:20.233900 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:49:20.233900 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 10 17:49:20.233900 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 10 17:49:20.233900 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 10 17:49:20.233900 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi Jun 10 17:49:20.233900 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:49:20.233900 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi Jun 10 17:49:20.233900 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:49:20.233900 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:49:20.233900 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:49:20.235472 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:49:20.235472 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:49:20.235472 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:49:20.235472 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:49:20.235472 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 10 17:49:20.235472 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 10 17:49:20.235472 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 10 17:49:20.235472 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi Jun 10 17:49:20.235472 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:49:20.235472 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi Jun 10 17:49:20.235472 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:49:20.235472 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:49:20.235472 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:49:20.235472 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:49:20.235472 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:49:20.235472 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 10 17:49:20.235472 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi Jun 10 17:49:20.235472 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi [None req-01ea86e0-ea44-4c20-870b-da32d28ad1b7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111061) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:49:20.237100 chdv-master-2 devstack@n-api.service[111061]: INFO nova.api.openstack.requestlog [None req-01ea86e0-ea44-4c20-870b-da32d28ad1b7 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015570 Jun 10 17:49:20.237900 chdv-master-2 devstack@n-api.service[111061]: [pid: 111061|app: 0|req: 21/42] 10.222.0.35 () {60 vars in 1190 bytes} [Fri Jun 10 17:49:20 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 10 17:49:21.089525 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi [None req-b32e825b-7e34-49c3-a337-b87315767f06 admin admin] Calling method '>' {{(pid=111060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:49:21.090524 chdv-master-2 devstack@n-api.service[111060]: INFO nova.api.openstack.requestlog [None req-b32e825b-7e34-49c3-a337-b87315767f06 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jun 10 17:49:21.090912 chdv-master-2 devstack@n-api.service[111060]: [pid: 111060|app: 0|req: 22/43] 10.222.0.35 () {56 vars in 1074 bytes} [Fri Jun 10 17:49:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:49:21.282240 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi [None req-92714a7b-cf90-46bd-bddb-bed1de0e125d admin admin] Calling method '>' {{(pid=111061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:49:21.285287 chdv-master-2 devstack@n-api.service[111061]: INFO nova.api.openstack.wsgi [None req-92714a7b-cf90-46bd-bddb-bed1de0e125d admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 10 17:49:21.286775 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi [None req-92714a7b-cf90-46bd-bddb-bed1de0e125d admin admin] Request method failure captured: Jun 10 17:49:21.286775 chdv-master-2 devstack@n-api.service[111061]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 10 17:49:21.286775 chdv-master-2 devstack@n-api.service[111061]: Accept: application/json Jun 10 17:49:21.286775 chdv-master-2 devstack@n-api.service[111061]: Accept-Encoding: gzip, deflate Jun 10 17:49:21.286775 chdv-master-2 devstack@n-api.service[111061]: Connection: keep-alive Jun 10 17:49:21.286775 chdv-master-2 devstack@n-api.service[111061]: Content-Length: 0 Jun 10 17:49:21.286775 chdv-master-2 devstack@n-api.service[111061]: Host: 10.222.0.35 Jun 10 17:49:21.286775 chdv-master-2 devstack@n-api.service[111061]: Openstack-Api-Version: compute 2.90 Jun 10 17:49:21.286775 chdv-master-2 devstack@n-api.service[111061]: Openstack-System-Scope: None Jun 10 17:49:21.286775 chdv-master-2 devstack@n-api.service[111061]: User-Agent: python-novaclient Jun 10 17:49:21.286775 chdv-master-2 devstack@n-api.service[111061]: X-Auth-Token: gAAAAABio4QhiUU7DIssHv8UefAtTX6soebF7Twyr9hMOyz4oZ49s1Ak6hzj9RktJ7a3qGX_EComavp84Ho5QwG7t-ipLaHjULoCGgDUgWARu-WD1GfCeKykVroArE7H8obquHvn1R0K50riiayt87LJU1mqnTbkvukop3TbKa9NY-hWsClNH0c Jun 10 17:49:21.286775 chdv-master-2 devstack@n-api.service[111061]: X-Domain-Id: None Jun 10 17:49:21.286775 chdv-master-2 devstack@n-api.service[111061]: X-Domain-Name: None Jun 10 17:49:21.286775 chdv-master-2 devstack@n-api.service[111061]: X-Identity-Status: Confirmed Jun 10 17:49:21.286775 chdv-master-2 devstack@n-api.service[111061]: X-Is-Admin-Project: True Jun 10 17:49:21.286775 chdv-master-2 devstack@n-api.service[111061]: X-Openstack-Nova-Api-Version: 2.90 Jun 10 17:49:21.286775 chdv-master-2 devstack@n-api.service[111061]: X-Project-Domain-Id: default Jun 10 17:49:21.286775 chdv-master-2 devstack@n-api.service[111061]: X-Project-Domain-Name: Default Jun 10 17:49:21.286775 chdv-master-2 devstack@n-api.service[111061]: X-Project-Id: 3be246010f0344e6bdb4571b68000a67 Jun 10 17:49:21.286775 chdv-master-2 devstack@n-api.service[111061]: X-Project-Name: admin Jun 10 17:49:21.286775 chdv-master-2 devstack@n-api.service[111061]: X-Role: reader,member,admin Jun 10 17:49:21.286775 chdv-master-2 devstack@n-api.service[111061]: X-Roles: reader,member,admin Jun 10 17:49:21.288272 chdv-master-2 devstack@n-api.service[111061]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/3be246010f0344e6bdb4571b68000a67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3be246010f0344e6bdb4571b68000a67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3be246010f0344e6bdb4571b68000a67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_3be246010f0344e6bdb4571b68000a67", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:49:21.288272 chdv-master-2 devstack@n-api.service[111061]: X-Tenant: admin Jun 10 17:49:21.288272 chdv-master-2 devstack@n-api.service[111061]: X-Tenant-Id: 3be246010f0344e6bdb4571b68000a67 Jun 10 17:49:21.288272 chdv-master-2 devstack@n-api.service[111061]: X-Tenant-Name: admin Jun 10 17:49:21.288272 chdv-master-2 devstack@n-api.service[111061]: X-User: admin Jun 10 17:49:21.288272 chdv-master-2 devstack@n-api.service[111061]: X-User-Domain-Id: default Jun 10 17:49:21.288272 chdv-master-2 devstack@n-api.service[111061]: X-User-Domain-Name: Default Jun 10 17:49:21.288272 chdv-master-2 devstack@n-api.service[111061]: X-User-Id: b170903f7e4e4205be25d20e4c89d990 Jun 10 17:49:21.288272 chdv-master-2 devstack@n-api.service[111061]: X-User-Name: admin Jun 10 17:49:21.288272 chdv-master-2 devstack@n-api.service[111061]: method: > Jun 10 17:49:21.288272 chdv-master-2 devstack@n-api.service[111061]: exception: Flavor 84 could not be found. Jun 10 17:49:21.288272 chdv-master-2 devstack@n-api.service[111061]: action_args: {'id': '84'} Jun 10 17:49:21.288272 chdv-master-2 devstack@n-api.service[111061]: {{(pid=111061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:49:21.288272 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:49:21.289147 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 10 17:49:21.289147 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 10 17:49:21.289147 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 10 17:49:21.289147 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 10 17:49:21.289147 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 17:49:21.289147 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 17:49:21.289147 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 10 17:49:21.289147 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 10 17:49:21.289147 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 10 17:49:21.289147 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:49:21.289147 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 10 17:49:21.289147 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 10 17:49:21.289147 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 10 17:49:21.289147 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi Jun 10 17:49:21.289147 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:49:21.289147 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi Jun 10 17:49:21.289147 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:49:21.289147 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:49:21.289147 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:49:21.290195 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:49:21.290195 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:49:21.290195 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:49:21.290195 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:49:21.290195 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 10 17:49:21.290195 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 10 17:49:21.290195 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 10 17:49:21.290195 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi Jun 10 17:49:21.290195 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:49:21.290195 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi Jun 10 17:49:21.290195 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:49:21.290195 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:49:21.290195 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:49:21.290195 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:49:21.290195 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:49:21.290195 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 10 17:49:21.290195 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi Jun 10 17:49:21.290195 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi [None req-92714a7b-cf90-46bd-bddb-bed1de0e125d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111061) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:49:21.291279 chdv-master-2 devstack@n-api.service[111061]: INFO nova.api.openstack.requestlog [None req-92714a7b-cf90-46bd-bddb-bed1de0e125d admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060032 Jun 10 17:49:21.291279 chdv-master-2 devstack@n-api.service[111061]: [pid: 111061|app: 0|req: 22/44] 10.222.0.35 () {60 vars in 1190 bytes} [Fri Jun 10 17:49:21 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 10 17:49:21.298236 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi [None req-ddacc0fe-e925-4ea4-9b35-940ddde24b89 admin admin] Calling method '>' {{(pid=111060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:49:21.311590 chdv-master-2 devstack@n-api.service[111060]: INFO nova.api.openstack.requestlog [None req-ddacc0fe-e925-4ea4-9b35-940ddde24b89 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017486 Jun 10 17:49:21.312106 chdv-master-2 devstack@n-api.service[111060]: [pid: 111060|app: 0|req: 23/45] 10.222.0.35 () {60 vars in 1210 bytes} [Fri Jun 10 17:49:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 17:49:21.321909 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi [None req-355e968d-db2f-4d8c-855c-f30c9e37456c admin admin] Calling method '>' {{(pid=111061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:49:21.335426 chdv-master-2 devstack@n-api.service[111061]: INFO nova.api.openstack.requestlog [None req-355e968d-db2f-4d8c-855c-f30c9e37456c admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017067 Jun 10 17:49:21.335936 chdv-master-2 devstack@n-api.service[111061]: [pid: 111061|app: 0|req: 23/46] 10.222.0.35 () {60 vars in 1210 bytes} [Fri Jun 10 17:49:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 17:49:21.345030 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi [None req-2d73829b-2cbc-4c8c-83d7-ba56c2f91921 admin admin] Calling method '>' {{(pid=111060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:49:21.350260 chdv-master-2 devstack@n-api.service[111060]: INFO nova.api.openstack.wsgi [None req-2d73829b-2cbc-4c8c-83d7-ba56c2f91921 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 10 17:49:21.351737 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi [None req-2d73829b-2cbc-4c8c-83d7-ba56c2f91921 admin admin] Request method failure captured: Jun 10 17:49:21.351737 chdv-master-2 devstack@n-api.service[111060]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 10 17:49:21.351737 chdv-master-2 devstack@n-api.service[111060]: Accept: application/json Jun 10 17:49:21.351737 chdv-master-2 devstack@n-api.service[111060]: Accept-Encoding: gzip, deflate Jun 10 17:49:21.351737 chdv-master-2 devstack@n-api.service[111060]: Connection: keep-alive Jun 10 17:49:21.351737 chdv-master-2 devstack@n-api.service[111060]: Content-Length: 0 Jun 10 17:49:21.351737 chdv-master-2 devstack@n-api.service[111060]: Host: 10.222.0.35 Jun 10 17:49:21.351737 chdv-master-2 devstack@n-api.service[111060]: Openstack-Api-Version: compute 2.90 Jun 10 17:49:21.351737 chdv-master-2 devstack@n-api.service[111060]: Openstack-System-Scope: None Jun 10 17:49:21.351737 chdv-master-2 devstack@n-api.service[111060]: User-Agent: python-novaclient Jun 10 17:49:21.351737 chdv-master-2 devstack@n-api.service[111060]: X-Auth-Token: gAAAAABio4QhiUU7DIssHv8UefAtTX6soebF7Twyr9hMOyz4oZ49s1Ak6hzj9RktJ7a3qGX_EComavp84Ho5QwG7t-ipLaHjULoCGgDUgWARu-WD1GfCeKykVroArE7H8obquHvn1R0K50riiayt87LJU1mqnTbkvukop3TbKa9NY-hWsClNH0c Jun 10 17:49:21.351737 chdv-master-2 devstack@n-api.service[111060]: X-Domain-Id: None Jun 10 17:49:21.351737 chdv-master-2 devstack@n-api.service[111060]: X-Domain-Name: None Jun 10 17:49:21.351737 chdv-master-2 devstack@n-api.service[111060]: X-Identity-Status: Confirmed Jun 10 17:49:21.351737 chdv-master-2 devstack@n-api.service[111060]: X-Is-Admin-Project: True Jun 10 17:49:21.351737 chdv-master-2 devstack@n-api.service[111060]: X-Openstack-Nova-Api-Version: 2.90 Jun 10 17:49:21.351737 chdv-master-2 devstack@n-api.service[111060]: X-Project-Domain-Id: default Jun 10 17:49:21.351737 chdv-master-2 devstack@n-api.service[111060]: X-Project-Domain-Name: Default Jun 10 17:49:21.351737 chdv-master-2 devstack@n-api.service[111060]: X-Project-Id: 3be246010f0344e6bdb4571b68000a67 Jun 10 17:49:21.351737 chdv-master-2 devstack@n-api.service[111060]: X-Project-Name: admin Jun 10 17:49:21.351737 chdv-master-2 devstack@n-api.service[111060]: X-Role: reader,member,admin Jun 10 17:49:21.351737 chdv-master-2 devstack@n-api.service[111060]: X-Roles: reader,member,admin Jun 10 17:49:21.353235 chdv-master-2 devstack@n-api.service[111060]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/3be246010f0344e6bdb4571b68000a67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3be246010f0344e6bdb4571b68000a67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3be246010f0344e6bdb4571b68000a67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_3be246010f0344e6bdb4571b68000a67", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:49:21.353235 chdv-master-2 devstack@n-api.service[111060]: X-Tenant: admin Jun 10 17:49:21.353235 chdv-master-2 devstack@n-api.service[111060]: X-Tenant-Id: 3be246010f0344e6bdb4571b68000a67 Jun 10 17:49:21.353235 chdv-master-2 devstack@n-api.service[111060]: X-Tenant-Name: admin Jun 10 17:49:21.353235 chdv-master-2 devstack@n-api.service[111060]: X-User: admin Jun 10 17:49:21.353235 chdv-master-2 devstack@n-api.service[111060]: X-User-Domain-Id: default Jun 10 17:49:21.353235 chdv-master-2 devstack@n-api.service[111060]: X-User-Domain-Name: Default Jun 10 17:49:21.353235 chdv-master-2 devstack@n-api.service[111060]: X-User-Id: b170903f7e4e4205be25d20e4c89d990 Jun 10 17:49:21.353235 chdv-master-2 devstack@n-api.service[111060]: X-User-Name: admin Jun 10 17:49:21.353235 chdv-master-2 devstack@n-api.service[111060]: method: > Jun 10 17:49:21.353235 chdv-master-2 devstack@n-api.service[111060]: exception: Flavor 84 could not be found. Jun 10 17:49:21.353235 chdv-master-2 devstack@n-api.service[111060]: action_args: {'id': '84'} Jun 10 17:49:21.353235 chdv-master-2 devstack@n-api.service[111060]: {{(pid=111060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:49:21.353235 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:49:21.356930 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 10 17:49:21.356930 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 10 17:49:21.356930 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 10 17:49:21.356930 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 10 17:49:21.356930 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 17:49:21.356930 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 17:49:21.356930 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 10 17:49:21.356930 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 10 17:49:21.356930 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 10 17:49:21.356930 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:49:21.356930 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 10 17:49:21.356930 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 10 17:49:21.356930 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 10 17:49:21.356930 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi Jun 10 17:49:21.356930 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:49:21.356930 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi Jun 10 17:49:21.356930 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:49:21.356930 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:49:21.356930 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:49:21.358103 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:49:21.358103 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:49:21.358103 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:49:21.358103 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:49:21.358103 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 10 17:49:21.358103 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 10 17:49:21.358103 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 10 17:49:21.358103 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi Jun 10 17:49:21.358103 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:49:21.358103 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi Jun 10 17:49:21.358103 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:49:21.358103 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:49:21.358103 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:49:21.358103 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:49:21.358103 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:49:21.358103 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 10 17:49:21.358103 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi Jun 10 17:49:21.358103 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi [None req-2d73829b-2cbc-4c8c-83d7-ba56c2f91921 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:49:21.359085 chdv-master-2 devstack@n-api.service[111060]: INFO nova.api.openstack.requestlog [None req-2d73829b-2cbc-4c8c-83d7-ba56c2f91921 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011966 Jun 10 17:49:21.359085 chdv-master-2 devstack@n-api.service[111060]: [pid: 111060|app: 0|req: 24/47] 10.222.0.35 () {60 vars in 1190 bytes} [Fri Jun 10 17:49:21 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 10 17:49:22.204992 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi [None req-355e968d-db2f-4d8c-855c-f30c9e37456c admin admin] Calling method '>' {{(pid=111061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:49:22.205987 chdv-master-2 devstack@n-api.service[111061]: INFO nova.api.openstack.requestlog [None req-355e968d-db2f-4d8c-855c-f30c9e37456c admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002038 Jun 10 17:49:22.206370 chdv-master-2 devstack@n-api.service[111061]: [pid: 111061|app: 0|req: 24/48] 10.222.0.35 () {56 vars in 1074 bytes} [Fri Jun 10 17:49:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:49:22.390864 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi [None req-545b0790-1d87-4e7d-8aaa-c3be14c21095 admin admin] Calling method '>' {{(pid=111060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:49:22.397004 chdv-master-2 devstack@n-api.service[111060]: INFO nova.api.openstack.wsgi [None req-545b0790-1d87-4e7d-8aaa-c3be14c21095 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 10 17:49:22.398488 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi [None req-545b0790-1d87-4e7d-8aaa-c3be14c21095 admin admin] Request method failure captured: Jun 10 17:49:22.398488 chdv-master-2 devstack@n-api.service[111060]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 10 17:49:22.398488 chdv-master-2 devstack@n-api.service[111060]: Accept: application/json Jun 10 17:49:22.398488 chdv-master-2 devstack@n-api.service[111060]: Accept-Encoding: gzip, deflate Jun 10 17:49:22.398488 chdv-master-2 devstack@n-api.service[111060]: Connection: keep-alive Jun 10 17:49:22.398488 chdv-master-2 devstack@n-api.service[111060]: Content-Length: 0 Jun 10 17:49:22.398488 chdv-master-2 devstack@n-api.service[111060]: Host: 10.222.0.35 Jun 10 17:49:22.398488 chdv-master-2 devstack@n-api.service[111060]: Openstack-Api-Version: compute 2.90 Jun 10 17:49:22.398488 chdv-master-2 devstack@n-api.service[111060]: Openstack-System-Scope: None Jun 10 17:49:22.398488 chdv-master-2 devstack@n-api.service[111060]: User-Agent: python-novaclient Jun 10 17:49:22.398488 chdv-master-2 devstack@n-api.service[111060]: X-Auth-Token: gAAAAABio4QihvAlmTJlHqDtk0r8_F1Ls8j3wpyZX9oOwaqoqpX2N0EEEam7YmQes8UyAA7Lpi-xCMZM8u9S5rnvbXektgV5_P_eyUXn-7xcc3p0BqtCgSYzyjjxaVw_AV4uuJ0zJl433y1hJwsfUZw_MmQ-2p2gRFr8MSNB4gL1J3b5MFWiQEQ Jun 10 17:49:22.398488 chdv-master-2 devstack@n-api.service[111060]: X-Domain-Id: None Jun 10 17:49:22.398488 chdv-master-2 devstack@n-api.service[111060]: X-Domain-Name: None Jun 10 17:49:22.398488 chdv-master-2 devstack@n-api.service[111060]: X-Identity-Status: Confirmed Jun 10 17:49:22.398488 chdv-master-2 devstack@n-api.service[111060]: X-Is-Admin-Project: True Jun 10 17:49:22.398488 chdv-master-2 devstack@n-api.service[111060]: X-Openstack-Nova-Api-Version: 2.90 Jun 10 17:49:22.398488 chdv-master-2 devstack@n-api.service[111060]: X-Project-Domain-Id: default Jun 10 17:49:22.398488 chdv-master-2 devstack@n-api.service[111060]: X-Project-Domain-Name: Default Jun 10 17:49:22.398488 chdv-master-2 devstack@n-api.service[111060]: X-Project-Id: 3be246010f0344e6bdb4571b68000a67 Jun 10 17:49:22.398488 chdv-master-2 devstack@n-api.service[111060]: X-Project-Name: admin Jun 10 17:49:22.398488 chdv-master-2 devstack@n-api.service[111060]: X-Role: reader,member,admin Jun 10 17:49:22.398488 chdv-master-2 devstack@n-api.service[111060]: X-Roles: reader,member,admin Jun 10 17:49:22.399997 chdv-master-2 devstack@n-api.service[111060]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/3be246010f0344e6bdb4571b68000a67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3be246010f0344e6bdb4571b68000a67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3be246010f0344e6bdb4571b68000a67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_3be246010f0344e6bdb4571b68000a67", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:49:22.399997 chdv-master-2 devstack@n-api.service[111060]: X-Tenant: admin Jun 10 17:49:22.399997 chdv-master-2 devstack@n-api.service[111060]: X-Tenant-Id: 3be246010f0344e6bdb4571b68000a67 Jun 10 17:49:22.399997 chdv-master-2 devstack@n-api.service[111060]: X-Tenant-Name: admin Jun 10 17:49:22.399997 chdv-master-2 devstack@n-api.service[111060]: X-User: admin Jun 10 17:49:22.399997 chdv-master-2 devstack@n-api.service[111060]: X-User-Domain-Id: default Jun 10 17:49:22.399997 chdv-master-2 devstack@n-api.service[111060]: X-User-Domain-Name: Default Jun 10 17:49:22.399997 chdv-master-2 devstack@n-api.service[111060]: X-User-Id: b170903f7e4e4205be25d20e4c89d990 Jun 10 17:49:22.399997 chdv-master-2 devstack@n-api.service[111060]: X-User-Name: admin Jun 10 17:49:22.399997 chdv-master-2 devstack@n-api.service[111060]: method: > Jun 10 17:49:22.399997 chdv-master-2 devstack@n-api.service[111060]: exception: Flavor 451 could not be found. Jun 10 17:49:22.399997 chdv-master-2 devstack@n-api.service[111060]: action_args: {'id': '451'} Jun 10 17:49:22.399997 chdv-master-2 devstack@n-api.service[111060]: {{(pid=111060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:49:22.399997 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:49:22.400965 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 10 17:49:22.400965 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 10 17:49:22.400965 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 10 17:49:22.400965 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 10 17:49:22.400965 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 17:49:22.400965 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 17:49:22.400965 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 10 17:49:22.400965 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 10 17:49:22.400965 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 10 17:49:22.400965 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:49:22.400965 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 10 17:49:22.400965 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 10 17:49:22.400965 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 10 17:49:22.400965 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi Jun 10 17:49:22.400965 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:49:22.400965 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi Jun 10 17:49:22.400965 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:49:22.400965 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:49:22.400965 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:49:22.402372 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:49:22.402372 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:49:22.402372 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:49:22.402372 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:49:22.402372 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 10 17:49:22.402372 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 10 17:49:22.402372 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 10 17:49:22.402372 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi Jun 10 17:49:22.402372 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:49:22.402372 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi Jun 10 17:49:22.402372 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:49:22.402372 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:49:22.402372 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:49:22.402372 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:49:22.402372 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:49:22.402372 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 10 17:49:22.402372 chdv-master-2 devstack@n-api.service[111060]: ERROR nova.api.openstack.wsgi Jun 10 17:49:22.402372 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi [None req-545b0790-1d87-4e7d-8aaa-c3be14c21095 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:49:22.403653 chdv-master-2 devstack@n-api.service[111060]: INFO nova.api.openstack.requestlog [None req-545b0790-1d87-4e7d-8aaa-c3be14c21095 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059246 Jun 10 17:49:22.403653 chdv-master-2 devstack@n-api.service[111060]: [pid: 111060|app: 0|req: 25/49] 10.222.0.35 () {60 vars in 1193 bytes} [Fri Jun 10 17:49:22 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 10 17:49:22.409617 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi [None req-99a99f11-a498-426a-8883-07fdaa8116d6 admin admin] Calling method '>' {{(pid=111061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:49:22.423460 chdv-master-2 devstack@n-api.service[111061]: INFO nova.api.openstack.requestlog [None req-99a99f11-a498-426a-8883-07fdaa8116d6 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017388 Jun 10 17:49:22.423994 chdv-master-2 devstack@n-api.service[111061]: [pid: 111061|app: 0|req: 25/50] 10.222.0.35 () {60 vars in 1210 bytes} [Fri Jun 10 17:49:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 17:49:22.435199 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi [None req-93d1498f-7ced-4339-84a3-6afacd124e29 admin admin] Calling method '>' {{(pid=111060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:49:22.448574 chdv-master-2 devstack@n-api.service[111060]: INFO nova.api.openstack.requestlog [None req-93d1498f-7ced-4339-84a3-6afacd124e29 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018782 Jun 10 17:49:22.449087 chdv-master-2 devstack@n-api.service[111060]: [pid: 111060|app: 0|req: 26/51] 10.222.0.35 () {60 vars in 1210 bytes} [Fri Jun 10 17:49:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 17:49:22.458416 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi [None req-fe07dea8-e2d8-4213-b380-deac3b73aa30 admin admin] Calling method '>' {{(pid=111061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:49:22.463560 chdv-master-2 devstack@n-api.service[111061]: INFO nova.api.openstack.wsgi [None req-fe07dea8-e2d8-4213-b380-deac3b73aa30 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 10 17:49:22.465067 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi [None req-fe07dea8-e2d8-4213-b380-deac3b73aa30 admin admin] Request method failure captured: Jun 10 17:49:22.465067 chdv-master-2 devstack@n-api.service[111061]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 10 17:49:22.465067 chdv-master-2 devstack@n-api.service[111061]: Accept: application/json Jun 10 17:49:22.465067 chdv-master-2 devstack@n-api.service[111061]: Accept-Encoding: gzip, deflate Jun 10 17:49:22.465067 chdv-master-2 devstack@n-api.service[111061]: Connection: keep-alive Jun 10 17:49:22.465067 chdv-master-2 devstack@n-api.service[111061]: Content-Length: 0 Jun 10 17:49:22.465067 chdv-master-2 devstack@n-api.service[111061]: Host: 10.222.0.35 Jun 10 17:49:22.465067 chdv-master-2 devstack@n-api.service[111061]: Openstack-Api-Version: compute 2.90 Jun 10 17:49:22.465067 chdv-master-2 devstack@n-api.service[111061]: Openstack-System-Scope: None Jun 10 17:49:22.465067 chdv-master-2 devstack@n-api.service[111061]: User-Agent: python-novaclient Jun 10 17:49:22.465067 chdv-master-2 devstack@n-api.service[111061]: X-Auth-Token: gAAAAABio4QihvAlmTJlHqDtk0r8_F1Ls8j3wpyZX9oOwaqoqpX2N0EEEam7YmQes8UyAA7Lpi-xCMZM8u9S5rnvbXektgV5_P_eyUXn-7xcc3p0BqtCgSYzyjjxaVw_AV4uuJ0zJl433y1hJwsfUZw_MmQ-2p2gRFr8MSNB4gL1J3b5MFWiQEQ Jun 10 17:49:22.465067 chdv-master-2 devstack@n-api.service[111061]: X-Domain-Id: None Jun 10 17:49:22.465067 chdv-master-2 devstack@n-api.service[111061]: X-Domain-Name: None Jun 10 17:49:22.465067 chdv-master-2 devstack@n-api.service[111061]: X-Identity-Status: Confirmed Jun 10 17:49:22.465067 chdv-master-2 devstack@n-api.service[111061]: X-Is-Admin-Project: True Jun 10 17:49:22.465067 chdv-master-2 devstack@n-api.service[111061]: X-Openstack-Nova-Api-Version: 2.90 Jun 10 17:49:22.465067 chdv-master-2 devstack@n-api.service[111061]: X-Project-Domain-Id: default Jun 10 17:49:22.465067 chdv-master-2 devstack@n-api.service[111061]: X-Project-Domain-Name: Default Jun 10 17:49:22.465067 chdv-master-2 devstack@n-api.service[111061]: X-Project-Id: 3be246010f0344e6bdb4571b68000a67 Jun 10 17:49:22.465067 chdv-master-2 devstack@n-api.service[111061]: X-Project-Name: admin Jun 10 17:49:22.465067 chdv-master-2 devstack@n-api.service[111061]: X-Role: reader,member,admin Jun 10 17:49:22.465067 chdv-master-2 devstack@n-api.service[111061]: X-Roles: reader,member,admin Jun 10 17:49:22.466588 chdv-master-2 devstack@n-api.service[111061]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/3be246010f0344e6bdb4571b68000a67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3be246010f0344e6bdb4571b68000a67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3be246010f0344e6bdb4571b68000a67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_3be246010f0344e6bdb4571b68000a67", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:49:22.466588 chdv-master-2 devstack@n-api.service[111061]: X-Tenant: admin Jun 10 17:49:22.466588 chdv-master-2 devstack@n-api.service[111061]: X-Tenant-Id: 3be246010f0344e6bdb4571b68000a67 Jun 10 17:49:22.466588 chdv-master-2 devstack@n-api.service[111061]: X-Tenant-Name: admin Jun 10 17:49:22.466588 chdv-master-2 devstack@n-api.service[111061]: X-User: admin Jun 10 17:49:22.466588 chdv-master-2 devstack@n-api.service[111061]: X-User-Domain-Id: default Jun 10 17:49:22.466588 chdv-master-2 devstack@n-api.service[111061]: X-User-Domain-Name: Default Jun 10 17:49:22.466588 chdv-master-2 devstack@n-api.service[111061]: X-User-Id: b170903f7e4e4205be25d20e4c89d990 Jun 10 17:49:22.466588 chdv-master-2 devstack@n-api.service[111061]: X-User-Name: admin Jun 10 17:49:22.466588 chdv-master-2 devstack@n-api.service[111061]: method: > Jun 10 17:49:22.466588 chdv-master-2 devstack@n-api.service[111061]: exception: Flavor 451 could not be found. Jun 10 17:49:22.466588 chdv-master-2 devstack@n-api.service[111061]: action_args: {'id': '451'} Jun 10 17:49:22.466588 chdv-master-2 devstack@n-api.service[111061]: {{(pid=111061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:49:22.466588 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:49:22.467528 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 10 17:49:22.467528 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 10 17:49:22.467528 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 10 17:49:22.467528 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 10 17:49:22.467528 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 17:49:22.467528 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 17:49:22.467528 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 10 17:49:22.467528 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 10 17:49:22.467528 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 10 17:49:22.467528 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:49:22.467528 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 10 17:49:22.467528 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 10 17:49:22.467528 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 10 17:49:22.467528 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi Jun 10 17:49:22.467528 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:49:22.467528 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi Jun 10 17:49:22.467528 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:49:22.467528 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:49:22.467528 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:49:22.468875 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:49:22.468875 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:49:22.468875 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:49:22.468875 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:49:22.468875 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 10 17:49:22.468875 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 10 17:49:22.468875 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 10 17:49:22.468875 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi Jun 10 17:49:22.468875 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:49:22.468875 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi Jun 10 17:49:22.468875 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:49:22.468875 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:49:22.468875 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:49:22.468875 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:49:22.468875 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:49:22.468875 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 10 17:49:22.468875 chdv-master-2 devstack@n-api.service[111061]: ERROR nova.api.openstack.wsgi Jun 10 17:49:22.468875 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi [None req-fe07dea8-e2d8-4213-b380-deac3b73aa30 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111061) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:49:22.470267 chdv-master-2 devstack@n-api.service[111061]: INFO nova.api.openstack.requestlog [None req-fe07dea8-e2d8-4213-b380-deac3b73aa30 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011509 Jun 10 17:49:22.470267 chdv-master-2 devstack@n-api.service[111061]: [pid: 111061|app: 0|req: 26/52] 10.222.0.35 () {60 vars in 1193 bytes} [Fri Jun 10 17:49:22 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 10 17:49:23.331232 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi [None req-93d1498f-7ced-4339-84a3-6afacd124e29 admin admin] Calling method '>' {{(pid=111060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:49:23.332221 chdv-master-2 devstack@n-api.service[111060]: INFO nova.api.openstack.requestlog [None req-93d1498f-7ced-4339-84a3-6afacd124e29 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Jun 10 17:49:23.332648 chdv-master-2 devstack@n-api.service[111060]: [pid: 111060|app: 0|req: 27/53] 10.222.0.35 () {56 vars in 1074 bytes} [Fri Jun 10 17:49:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:49:23.525360 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi [None req-c1dd884e-8721-462d-bfa8-bb4bdec015a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:49:23.608779 chdv-master-2 devstack@n-api.service[111061]: INFO nova.api.openstack.requestlog [None req-c1dd884e-8721-462d-bfa8-bb4bdec015a5 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.133659 Jun 10 17:49:23.609235 chdv-master-2 devstack@n-api.service[111061]: [pid: 111061|app: 0|req: 27/54] 10.222.0.35 () {64 vars in 1235 bytes} [Fri Jun 10 17:49:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 17:49:24.487728 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi [None req-93d1498f-7ced-4339-84a3-6afacd124e29 admin admin] Calling method '>' {{(pid=111060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:49:24.488756 chdv-master-2 devstack@n-api.service[111060]: INFO nova.api.openstack.requestlog [None req-93d1498f-7ced-4339-84a3-6afacd124e29 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jun 10 17:49:24.489142 chdv-master-2 devstack@n-api.service[111060]: [pid: 111060|app: 0|req: 28/55] 10.222.0.35 () {56 vars in 1074 bytes} [Fri Jun 10 17:49:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:49:24.677592 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi [None req-99a39704-78ab-4d16-ad13-0ef210ab7160 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:49:24.769867 chdv-master-2 devstack@n-api.service[111061]: INFO nova.api.openstack.requestlog [None req-99a39704-78ab-4d16-ad13-0ef210ab7160 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.142685 Jun 10 17:49:24.770415 chdv-master-2 devstack@n-api.service[111061]: [pid: 111061|app: 0|req: 28/56] 10.222.0.35 () {64 vars in 1235 bytes} [Fri Jun 10 17:49:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 17:49:25.624557 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi [None req-93d1498f-7ced-4339-84a3-6afacd124e29 admin admin] Calling method '>' {{(pid=111060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:49:25.625539 chdv-master-2 devstack@n-api.service[111060]: INFO nova.api.openstack.requestlog [None req-93d1498f-7ced-4339-84a3-6afacd124e29 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Jun 10 17:49:25.626466 chdv-master-2 devstack@n-api.service[111060]: [pid: 111060|app: 0|req: 29/57] 10.222.0.35 () {56 vars in 1074 bytes} [Fri Jun 10 17:49:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:49:25.816603 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi [None req-f9ed2c8a-b325-40c2-8bee-df909c48e7f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:49:25.903390 chdv-master-2 devstack@n-api.service[111061]: INFO nova.api.openstack.requestlog [None req-f9ed2c8a-b325-40c2-8bee-df909c48e7f2 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.137709 Jun 10 17:49:25.903914 chdv-master-2 devstack@n-api.service[111061]: [pid: 111061|app: 0|req: 29/58] 10.222.0.35 () {64 vars in 1235 bytes} [Fri Jun 10 17:49:25 2022] POST /compute/v2.1/flavors => generated 407 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 17:49:26.758814 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi [None req-93d1498f-7ced-4339-84a3-6afacd124e29 admin admin] Calling method '>' {{(pid=111060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:49:26.759838 chdv-master-2 devstack@n-api.service[111060]: INFO nova.api.openstack.requestlog [None req-93d1498f-7ced-4339-84a3-6afacd124e29 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jun 10 17:49:26.760219 chdv-master-2 devstack@n-api.service[111060]: [pid: 111060|app: 0|req: 30/59] 10.222.0.35 () {56 vars in 1074 bytes} [Fri Jun 10 17:49:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:49:26.946345 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi [None req-6c0a86e8-fc45-490f-92c2-5aa9021ed882 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:49:27.018314 chdv-master-2 devstack@n-api.service[111061]: INFO nova.api.openstack.requestlog [None req-6c0a86e8-fc45-490f-92c2-5aa9021ed882 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.121554 Jun 10 17:49:27.021376 chdv-master-2 devstack@n-api.service[111061]: [pid: 111061|app: 0|req: 30/60] 10.222.0.35 () {64 vars in 1235 bytes} [Fri Jun 10 17:49:26 2022] POST /compute/v2.1/flavors => generated 409 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 10 17:49:27.880821 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi [None req-93d1498f-7ced-4339-84a3-6afacd124e29 admin admin] Calling method '>' {{(pid=111060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:49:27.881813 chdv-master-2 devstack@n-api.service[111060]: INFO nova.api.openstack.requestlog [None req-93d1498f-7ced-4339-84a3-6afacd124e29 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Jun 10 17:49:27.882199 chdv-master-2 devstack@n-api.service[111060]: [pid: 111060|app: 0|req: 31/61] 10.222.0.35 () {56 vars in 1074 bytes} [Fri Jun 10 17:49:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:49:28.068220 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi [None req-5e836000-5945-4ec5-a26c-90bd09dfb257 admin admin] Calling method '>' {{(pid=111061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:49:28.087084 chdv-master-2 devstack@n-api.service[111061]: INFO nova.api.openstack.requestlog [None req-5e836000-5945-4ec5-a26c-90bd09dfb257 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069416 Jun 10 17:49:28.090282 chdv-master-2 devstack@n-api.service[111061]: [pid: 111061|app: 0|req: 31/62] 10.222.0.35 () {60 vars in 1202 bytes} [Fri Jun 10 17:49:28 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 17:50:16.108966 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi [None req-93d1498f-7ced-4339-84a3-6afacd124e29 admin admin] Calling method '>' {{(pid=111060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:50:16.109924 chdv-master-2 devstack@n-api.service[111060]: INFO nova.api.openstack.requestlog [None req-93d1498f-7ced-4339-84a3-6afacd124e29 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jun 10 17:50:16.110307 chdv-master-2 devstack@n-api.service[111060]: [pid: 111060|app: 0|req: 32/63] 10.222.0.35 () {54 vars in 930 bytes} [Fri Jun 10 17:50:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:50:16.120708 chdv-master-2 devstack@n-api.service[111061]: DEBUG dbcounter [-] [111061] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=111061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:50:16.168663 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi [None req-babe1a67-58a0-45cc-8b50-e3b73ec5a46c admin admin] Calling method '>' {{(pid=111061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:50:16.187877 chdv-master-2 devstack@n-api.service[111061]: INFO nova.api.openstack.requestlog [None req-babe1a67-58a0-45cc-8b50-e3b73ec5a46c admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071802 Jun 10 17:50:16.188435 chdv-master-2 devstack@n-api.service[111061]: [pid: 111061|app: 0|req: 32/64] 10.222.0.35 () {60 vars in 1291 bytes} [Fri Jun 10 17:50:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 17:50:16.211449 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi [None req-3021ec36-0e8a-4d77-ac9b-bb3f60e1b0df admin admin] Calling method '>' {{(pid=111060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:50:16.214857 chdv-master-2 devstack@n-api.service[111060]: DEBUG dbcounter [-] [111060] Writing DB stats nova_api:SELECT=14 {{(pid=111060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:50:16.219821 chdv-master-2 devstack@n-api.service[111060]: INFO nova.api.openstack.requestlog [None req-3021ec36-0e8a-4d77-ac9b-bb3f60e1b0df admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011950 Jun 10 17:50:16.220345 chdv-master-2 devstack@n-api.service[111060]: [pid: 111060|app: 0|req: 33/65] 10.222.0.35 () {60 vars in 1282 bytes} [Fri Jun 10 17:50:16 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:50:16.231609 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi [None req-98203ded-b058-4f46-86a4-6914d4fa4248 admin admin] Calling method '>' {{(pid=111061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:50:16.239218 chdv-master-2 devstack@n-api.service[111061]: INFO nova.api.openstack.requestlog [None req-98203ded-b058-4f46-86a4-6914d4fa4248 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011425 Jun 10 17:50:16.239723 chdv-master-2 devstack@n-api.service[111061]: [pid: 111061|app: 0|req: 33/66] 10.222.0.35 () {60 vars in 1285 bytes} [Fri Jun 10 17:50:16 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:50:16.251939 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi [None req-adcaa92f-08aa-4a45-8162-01a696794052 admin admin] Calling method '>' {{(pid=111060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:50:16.259214 chdv-master-2 devstack@n-api.service[111060]: INFO nova.api.openstack.requestlog [None req-adcaa92f-08aa-4a45-8162-01a696794052 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011588 Jun 10 17:50:16.259724 chdv-master-2 devstack@n-api.service[111060]: [pid: 111060|app: 0|req: 34/67] 10.222.0.35 () {60 vars in 1285 bytes} [Fri Jun 10 17:50:16 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:50:16.271118 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi [None req-6d67b0f5-77ed-4092-8169-507b9cb2a898 admin admin] Calling method '>' {{(pid=111061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:50:16.278526 chdv-master-2 devstack@n-api.service[111061]: INFO nova.api.openstack.requestlog [None req-6d67b0f5-77ed-4092-8169-507b9cb2a898 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010838 Jun 10 17:50:16.279027 chdv-master-2 devstack@n-api.service[111061]: [pid: 111061|app: 0|req: 34/68] 10.222.0.35 () {60 vars in 1282 bytes} [Fri Jun 10 17:50:16 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:55:50.596976 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi [None req-adcaa92f-08aa-4a45-8162-01a696794052 admin admin] Calling method '>' {{(pid=111060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:55:50.597969 chdv-master-2 devstack@n-api.service[111060]: INFO nova.api.openstack.requestlog [None req-adcaa92f-08aa-4a45-8162-01a696794052 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jun 10 17:55:50.598352 chdv-master-2 devstack@n-api.service[111060]: [pid: 111060|app: 0|req: 35/69] 10.222.0.35 () {56 vars in 1074 bytes} [Fri Jun 10 17:55:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:55:50.767313 chdv-master-2 devstack@n-api.service[111061]: DEBUG dbcounter [-] [111061] Writing DB stats nova_api:SELECT=6 {{(pid=111061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:55:50.880579 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi [None req-ac08d55f-82fe-45e1-9fab-906a0be3deec admin admin] Calling method '>' {{(pid=111061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:55:50.881757 chdv-master-2 devstack@n-api.service[111061]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:55:50.881757 chdv-master-2 devstack@n-api.service[111061]: warnings.warn(msg) Jun 10 17:55:50.883514 chdv-master-2 devstack@n-api.service[111061]: DEBUG oslo_concurrency.lockutils [None req-ac08d55f-82fe-45e1-9fab-906a0be3deec admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:55:50.883945 chdv-master-2 devstack@n-api.service[111061]: DEBUG oslo_concurrency.lockutils [None req-ac08d55f-82fe-45e1-9fab-906a0be3deec admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=111061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:55:50.884750 chdv-master-2 devstack@n-api.service[111061]: DEBUG oslo_concurrency.lockutils [None req-ac08d55f-82fe-45e1-9fab-906a0be3deec admin admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:55:50.885175 chdv-master-2 devstack@n-api.service[111061]: DEBUG oslo_concurrency.lockutils [None req-ac08d55f-82fe-45e1-9fab-906a0be3deec admin admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:55:50.925108 chdv-master-2 devstack@n-api.service[111061]: INFO nova.api.openstack.requestlog [None req-ac08d55f-82fe-45e1-9fab-906a0be3deec admin admin] 10.222.0.35 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.159181 Jun 10 17:55:50.925658 chdv-master-2 devstack@n-api.service[111061]: [pid: 111061|app: 0|req: 35/70] 10.222.0.35 () {60 vars in 1193 bytes} [Fri Jun 10 17:55:50 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 17:55:51.792120 chdv-master-2 devstack@n-api.service[111060]: DEBUG nova.api.openstack.wsgi [None req-adcaa92f-08aa-4a45-8162-01a696794052 admin admin] Calling method '>' {{(pid=111060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:55:51.793109 chdv-master-2 devstack@n-api.service[111060]: INFO nova.api.openstack.requestlog [None req-adcaa92f-08aa-4a45-8162-01a696794052 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Jun 10 17:55:51.793496 chdv-master-2 devstack@n-api.service[111060]: [pid: 111060|app: 0|req: 36/71] 10.222.0.35 () {56 vars in 1074 bytes} [Fri Jun 10 17:55:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:55:51.984400 chdv-master-2 devstack@n-api.service[111061]: DEBUG nova.api.openstack.wsgi [None req-1a0228e0-2d74-44e3-8a9d-cb12303872cc admin admin] Calling method '>' {{(pid=111061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:55:51.985601 chdv-master-2 devstack@n-api.service[111061]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:55:51.985601 chdv-master-2 devstack@n-api.service[111061]: warnings.warn(msg) Jun 10 17:55:51.986776 chdv-master-2 devstack@n-api.service[111061]: DEBUG oslo_concurrency.lockutils [None req-1a0228e0-2d74-44e3-8a9d-cb12303872cc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:55:51.987218 chdv-master-2 devstack@n-api.service[111061]: DEBUG oslo_concurrency.lockutils [None req-1a0228e0-2d74-44e3-8a9d-cb12303872cc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:55:51.988040 chdv-master-2 devstack@n-api.service[111061]: DEBUG oslo_concurrency.lockutils [None req-1a0228e0-2d74-44e3-8a9d-cb12303872cc admin admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:55:51.988531 chdv-master-2 devstack@n-api.service[111061]: DEBUG oslo_concurrency.lockutils [None req-1a0228e0-2d74-44e3-8a9d-cb12303872cc admin admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:55:52.010944 chdv-master-2 devstack@n-api.service[111061]: INFO nova.api.openstack.requestlog [None req-1a0228e0-2d74-44e3-8a9d-cb12303872cc admin admin] 10.222.0.35 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.079475 Jun 10 17:55:52.011588 chdv-master-2 devstack@n-api.service[111061]: [pid: 111061|app: 0|req: 36/72] 10.222.0.35 () {60 vars in 1193 bytes} [Fri Jun 10 17:55:51 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 17:56:36.065445 chdv-master-2 systemd[1]: Stopping Devstack devstack@n-api.service... Jun 10 17:56:36.065947 chdv-master-2 devstack@n-api.service[111059]: Fri Jun 10 17:56:36 2022 - graceful shutdown triggered... Jun 10 17:56:36.066363 chdv-master-2 devstack@n-api.service[111060]: Gracefully killing worker 1 (pid: 111060)... Jun 10 17:56:36.066718 chdv-master-2 devstack@n-api.service[111061]: Gracefully killing worker 2 (pid: 111061)... Jun 10 17:56:37.067066 chdv-master-2 devstack@n-api.service[111059]: worker 1 buried after 1 seconds Jun 10 17:56:37.067066 chdv-master-2 devstack@n-api.service[111059]: worker 2 buried after 1 seconds Jun 10 17:56:37.067066 chdv-master-2 devstack@n-api.service[111059]: goodbye to uWSGI. Jun 10 17:56:37.069193 chdv-master-2 systemd[1]: devstack@n-api.service: Succeeded. Jun 10 17:56:37.069819 chdv-master-2 systemd[1]: Stopped Devstack devstack@n-api.service. Jun 10 17:56:37.072605 chdv-master-2 systemd[1]: Starting Devstack devstack@n-api.service... Jun 10 17:56:37.090536 chdv-master-2 devstack@n-api.service[126583]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 10 17:56:37.111836 chdv-master-2 devstack@n-api.service[126583]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 10 17:56:37 2022] *** Jun 10 17:56:37.111836 chdv-master-2 devstack@n-api.service[126583]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 10 17:56:37.111836 chdv-master-2 devstack@n-api.service[126583]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 10 17:56:37.111836 chdv-master-2 devstack@n-api.service[126583]: nodename: chdv-master-2 Jun 10 17:56:37.111836 chdv-master-2 devstack@n-api.service[126583]: machine: x86_64 Jun 10 17:56:37.111836 chdv-master-2 devstack@n-api.service[126583]: clock source: unix Jun 10 17:56:37.111836 chdv-master-2 devstack@n-api.service[126583]: pcre jit disabled Jun 10 17:56:37.111836 chdv-master-2 devstack@n-api.service[126583]: detected number of CPU cores: 4 Jun 10 17:56:37.111836 chdv-master-2 devstack@n-api.service[126583]: current working directory: / Jun 10 17:56:37.111836 chdv-master-2 devstack@n-api.service[126583]: detected binary path: /usr/bin/uwsgi-core Jun 10 17:56:37.111836 chdv-master-2 devstack@n-api.service[126583]: your processes number limit is 47680 Jun 10 17:56:37.111836 chdv-master-2 devstack@n-api.service[126583]: your memory page size is 4096 bytes Jun 10 17:56:37.111836 chdv-master-2 devstack@n-api.service[126583]: detected max file descriptor number: 2048 Jun 10 17:56:37.111836 chdv-master-2 devstack@n-api.service[126583]: lock engine: pthread robust mutexes Jun 10 17:56:37.112981 chdv-master-2 devstack@n-api.service[126583]: thunder lock: enabled Jun 10 17:56:37.112981 chdv-master-2 devstack@n-api.service[126583]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 10 17:56:37.112981 chdv-master-2 devstack@n-api.service[126583]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 10 17:56:37.158650 chdv-master-2 devstack@n-api.service[126583]: Python main interpreter initialized at 0x561fe4b679c0 Jun 10 17:56:37.158650 chdv-master-2 devstack@n-api.service[126583]: python threads support enabled Jun 10 17:56:37.158650 chdv-master-2 devstack@n-api.service[126583]: your server socket listen backlog is limited to 100 connections Jun 10 17:56:37.158650 chdv-master-2 devstack@n-api.service[126583]: your mercy for graceful operations on workers is 90 seconds Jun 10 17:56:37.159119 chdv-master-2 devstack@n-api.service[126583]: mapped 403077 bytes (393 KB) for 2 cores Jun 10 17:56:37.159119 chdv-master-2 devstack@n-api.service[126583]: *** Operational MODE: preforking *** Jun 10 17:56:37.159352 chdv-master-2 devstack@n-api.service[126583]: *** uWSGI is running in multiple interpreter mode *** Jun 10 17:56:37.159352 chdv-master-2 devstack@n-api.service[126583]: spawned uWSGI master process (pid: 126583) Jun 10 17:56:37.159563 chdv-master-2 systemd[1]: Started Devstack devstack@n-api.service. Jun 10 17:56:37.160636 chdv-master-2 devstack@n-api.service[126583]: spawned uWSGI worker 1 (pid: 126594, cores: 1) Jun 10 17:56:37.160636 chdv-master-2 devstack@n-api.service[126583]: spawned uWSGI worker 2 (pid: 126595, cores: 1) Jun 10 17:56:37.160823 chdv-master-2 devstack@n-api.service[126583]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 10 17:56:37.827583 chdv-master-2 devstack@n-api.service[126595]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 10 17:56:37.834218 chdv-master-2 devstack@n-api.service[126594]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 10 17:56:39.096691 chdv-master-2 devstack@n-api.service[126595]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 10 17:56:39.096691 chdv-master-2 devstack@n-api.service[126595]: from cryptography.utils import int_from_bytes Jun 10 17:56:39.096691 chdv-master-2 devstack@n-api.service[126595]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 10 17:56:39.096691 chdv-master-2 devstack@n-api.service[126595]: from cryptography.utils import int_from_bytes Jun 10 17:56:39.102879 chdv-master-2 devstack@n-api.service[126594]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 10 17:56:39.102879 chdv-master-2 devstack@n-api.service[126594]: from cryptography.utils import int_from_bytes Jun 10 17:56:39.103398 chdv-master-2 devstack@n-api.service[126594]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 10 17:56:39.103398 chdv-master-2 devstack@n-api.service[126594]: from cryptography.utils import int_from_bytes Jun 10 17:56:41.499397 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 10 17:56:41.499922 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 10 17:56:41.500219 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 10 17:56:41.500641 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 10 17:56:41.500910 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 10 17:56:41.501307 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.501646 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.501974 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.502300 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.502639 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.502962 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.503286 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.503630 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.503959 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.504217 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.504564 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.504895 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] console_host = chdv-master-2 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.505253 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.505571 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.505893 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.506222 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.506601 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.506936 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.507292 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.507807 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.508267 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.508609 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.509054 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.509290 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.509597 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.509918 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.510253 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.510577 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.510914 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.511233 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.511708 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] host = chdv-master-2 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.512021 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.512366 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.512695 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.513120 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.513442 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.513761 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.514094 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.514437 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.514757 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.515095 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.515422 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.515750 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.515969 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 10 17:56:41.516391 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.516482 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 10 17:56:41.516567 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.516710 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.516802 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 10 17:56:41.517030 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.517150 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 10 17:56:41.517360 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.517459 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 10 17:56:41.517674 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.517828 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.518005 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.518182 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.518297 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.518514 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.518615 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.518845 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.518943 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.519185 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.519293 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.519501 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.519598 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.519765 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.519860 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.520023 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.520124 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.520374 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.520511 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.529282 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.529491 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.529611 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.529713 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.529864 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.530007 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] console_host = chdv-master-2 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.530105 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.530239 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.530343 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.530443 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.530576 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.530672 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.530810 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.530914 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.531007 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.531102 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.531189 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.531361 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.531451 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.531535 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.531629 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.531720 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.531840 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.531935 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.532031 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.532116 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.532212 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.532336 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.532426 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.35 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.532523 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.532615 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.35 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.532705 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.532799 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.532884 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.532976 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.533072 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.533176 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.533287 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.533374 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.533465 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.533561 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.533653 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.533745 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.533745 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.534050 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] host = chdv-master-2 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.534210 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.534355 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.534486 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.534632 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.534761 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.534897 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.535026 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.535169 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.535299 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.535441 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.535579 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.535720 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.535819 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.535911 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.536012 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.536109 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.536201 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.536919 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.537016 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.537102 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.537200 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.537285 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.537369 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.537369 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.537533 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.537624 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.537856 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.537963 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.538050 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.538142 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.538247 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.538339 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.538463 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.538551 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.538649 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.538736 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.538828 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.538931 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.539018 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.539103 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.539186 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.539276 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.539371 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.539465 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.539551 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.539635 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.539723 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.539815 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.539899 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.539899 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.540087 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.540663 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.540773 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.540916 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.541017 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.541111 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.541198 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.541290 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.541382 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.541516 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.541653 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.541753 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.541847 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.541944 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.542075 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.542172 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.542265 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.542364 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.542457 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.542555 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.542642 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.542733 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.542826 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.542911 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.543009 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.543142 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.543231 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.543316 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.543400 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.543538 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.543638 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.543731 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.543822 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.543822 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.543983 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.35 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.543983 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.35 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.544160 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.544246 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.544359 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.544359 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.544516 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.544608 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.544702 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.544788 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.544878 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.544963 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.545046 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.545129 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.545227 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.545312 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.545414 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.545507 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.545599 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.545697 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.545783 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.545867 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.545950 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.546041 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.546137 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.546238 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.546325 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.546410 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.546494 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.546578 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.546662 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.546755 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.546851 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.547072 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.547168 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.547386 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.547487 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.547703 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.547805 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.548019 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.548113 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.548353 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.548474 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.548663 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.548762 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.548977 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.549133 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.549292 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.549394 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.549605 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.549698 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.549919 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.550011 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.550227 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.550557 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.550814 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.550918 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.551056 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.551146 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.551239 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.551344 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.551437 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.551530 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.551764 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.551872 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.552119 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.552223 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.552461 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.552562 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.552777 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.552878 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.553092 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.553192 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.553421 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.553530 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.553736 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.553829 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.554051 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.554152 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.554380 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.554486 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.554697 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.554797 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.555013 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.555117 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.555339 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.555448 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.555654 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.555747 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.555967 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.556069 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.556293 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.556422 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.556632 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.556738 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.556947 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.557040 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.557271 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.557369 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.557585 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.557674 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.557900 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.558000 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.558214 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.558351 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.558528 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.558671 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.558842 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.559017 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.559155 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.559264 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.559470 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.559569 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.559784 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.559876 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.560090 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.560195 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.560454 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.560738 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.560848 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.560936 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.561118 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.561278 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.561376 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.561468 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.561676 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.561770 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.561988 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.562138 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 17:56:41.562325 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.562460 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.562645 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.562736 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.562956 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.563048 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.563289 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.563428 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.563627 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.563726 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.563943 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.564042 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.564276 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.564439 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.564617 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.564716 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.564938 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.565037 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.565257 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.565348 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.565578 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.565689 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.565891 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.565982 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.566210 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.566309 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.566529 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.566628 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.566843 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.566933 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.567174 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.567266 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.567520 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.567624 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.567837 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.567928 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.568171 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.568271 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.568508 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.568617 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.568824 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.568921 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.569145 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.569238 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.569466 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.569559 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.569782 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.569880 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.570101 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.570192 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.570420 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.570512 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.570769 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.570878 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.571070 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.571177 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.571398 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.571510 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.571728 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.571871 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.572052 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.572163 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.572387 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.572530 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.572723 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.572852 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.573059 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.573169 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.573377 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.573520 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.573690 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.573780 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.574030 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.574142 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.574324 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.574423 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.574638 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.574740 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.574950 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.575057 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.575269 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.575369 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.575577 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.575674 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.575892 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.575996 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.576204 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.576297 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.576538 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.576685 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.576853 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.576957 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.577185 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.577284 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.577503 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.577602 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.577816 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.577952 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.578129 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.578229 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.578439 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.578530 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.578750 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.578848 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.579067 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.579160 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.579379 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.579477 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.579706 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.579799 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.580041 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.580132 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.580378 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.580490 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.580842 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.580987 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.581090 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.581179 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.581320 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.581437 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.581649 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.581763 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.581968 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.582104 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.582278 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.582384 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.582598 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.582698 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.582915 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.583006 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.583758 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.583858 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.584088 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.584189 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.584432 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.584527 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.584749 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.584842 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.585074 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.585170 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.585386 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.585486 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.585698 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.585800 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.586019 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.586119 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.586340 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.586438 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.586660 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.586761 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.586978 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.587078 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.587298 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.587402 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.587623 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.587714 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.587942 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.588034 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.588262 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.588453 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.588610 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.588704 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.588933 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.589026 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.589263 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.589364 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.589584 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.589677 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.589912 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.590012 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.590235 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.590334 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.590550 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.590641 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.590895 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.591022 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.591187 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.591313 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.591502 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.591622 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.591817 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.591940 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.592143 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.592254 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.592484 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.592591 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.592802 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.592895 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.593116 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.593209 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.593428 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.593522 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.593740 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.593840 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.594055 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.594147 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.594375 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.594474 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.594686 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.594785 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.594996 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.595088 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.595304 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.595396 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.595625 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.595723 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.595946 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.596040 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.596268 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.596382 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.596605 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.596708 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.596930 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.597080 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.597247 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.597419 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.597561 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.597746 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.597874 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.598329 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.598451 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.598651 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.599337 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.599591 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.599721 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.599922 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.600026 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.600246 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.600402 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.600619 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.600712 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.601010 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.601108 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.601260 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.601395 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.601581 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.601688 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.601901 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.602006 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.602217 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.602344 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.602528 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.602621 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.602847 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.602982 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.603177 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.603283 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.603487 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.603578 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.603814 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.603957 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.604149 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.604289 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.604497 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.604607 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.604821 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.604911 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.605142 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.605233 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.605463 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.605560 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.605785 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.605883 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.606102 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.606192 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.606421 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.606512 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.606739 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.606837 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.607058 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.607156 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.607378 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.607468 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.607694 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.607785 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.608024 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.608122 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.608361 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.608457 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.608683 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.608786 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.609000 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.609092 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.609312 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.609414 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.609631 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.609730 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.609957 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.610055 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.610298 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.610534 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.610625 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.610875 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.610977 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.611201 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.611312 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.611529 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.611624 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.611855 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.611967 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.612178 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.612331 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.612521 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.612653 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.612844 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.612939 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.613169 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.613315 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.613489 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.613647 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.613790 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.613937 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.614104 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.614261 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.614446 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.614596 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.614745 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.614893 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.615049 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.615199 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.615360 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.615508 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.615670 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.615811 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.615990 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.616132 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.616322 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.616420 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.616637 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.616742 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.616952 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.617047 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.617263 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.617371 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.617583 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.617724 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.617905 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.618001 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.618197 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.618291 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.618509 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.618609 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.618819 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.618911 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.619130 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.619235 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.619444 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.619553 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.619757 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.619857 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.620071 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.620170 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.620427 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.620540 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.620747 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.620837 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.621068 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.621159 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.621392 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.621553 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.621759 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.621873 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.622029 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.622151 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.622365 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.622484 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.622700 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.622809 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.622995 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.623088 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.623309 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.623405 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.623621 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.623713 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.623938 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.624038 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.624256 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.624365 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.624612 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.624706 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.624929 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.625021 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.625247 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.625339 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.625562 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.625654 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.625872 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.625975 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.626183 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.626282 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.626504 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.626597 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.626819 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.627073 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.627179 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.627416 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.627519 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.627745 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.627877 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.628052 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.628157 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.628396 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.628501 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.628721 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.628828 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.629034 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.629134 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.629355 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.629463 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.629666 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.629781 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.630508 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.630623 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.630827 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.630941 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.631140 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.631247 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.631453 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.631562 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.631769 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.631928 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.632082 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.632185 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.633043 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.633172 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.633172 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.633399 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.633494 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.633589 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.633677 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.633763 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.633862 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.634005 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.634113 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.634247 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.634348 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.634437 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.634541 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.634636 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.634834 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.634936 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.635154 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.635248 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.635470 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.635571 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.635779 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.635880 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.636098 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.636201 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.636433 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.636531 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.636746 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.636841 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.637054 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.637156 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.637372 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.637465 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.637682 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.637776 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.637994 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.638100 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.638306 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.638407 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.638617 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.638710 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.638927 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.639035 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.639254 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.639348 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.639574 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.639667 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.639884 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.639978 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.640197 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.640290 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.640532 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.640628 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.640872 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.640965 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.641181 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.641272 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.641491 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.641644 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.641817 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.641920 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.642118 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.642221 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.642439 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.642549 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.642768 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.642908 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.643079 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.643234 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.643399 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.643505 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.643709 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.643808 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.644028 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.644162 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.644369 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.644480 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.644686 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.644787 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.644995 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.645086 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.645306 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.645413 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.646160 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.646268 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.646482 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.646576 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.646804 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.646905 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.647116 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.647216 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.647440 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.647544 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.647753 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.647848 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.648064 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.648163 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.648407 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.648544 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.648729 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.648824 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.649046 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.649146 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.649360 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.649460 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.649677 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.649777 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.649997 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.650088 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.650310 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.650403 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.650621 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.650716 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.650939 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.651030 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.651248 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.651338 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.651575 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.651697 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.651883 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.652001 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.652202 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.652340 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.652547 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.652649 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.652865 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.652969 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.653184 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.653293 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.653494 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.653604 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.653801 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.653901 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.654112 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.654261 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.654428 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.654527 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.654734 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.654823 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.655044 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.655168 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.655353 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.655487 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.655665 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.655806 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.655975 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.656121 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.656334 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.656464 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.656647 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.656784 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.656959 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.657109 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.657257 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.657428 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.657568 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.657740 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.657919 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.658253 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.658383 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.658616 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.658721 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.658936 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.659362 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.659628 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.659796 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.660025 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.660189 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.660384 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.660550 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.660702 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.660859 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.661011 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.661161 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.661354 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.661518 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.661694 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.661926 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.662082 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.662232 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.662403 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.662564 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.662716 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.662891 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.663124 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.663290 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.663456 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.663619 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.663811 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.664177 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.664399 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.664576 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.664829 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.664995 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.665197 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.665295 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.665544 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.665693 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.665884 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.665979 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.666218 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.666311 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.666546 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.666660 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.666876 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.666970 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.667202 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.667294 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.667523 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.667626 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.667845 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.667944 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.668173 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.668281 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.668515 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.668618 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.668842 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.668942 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.669157 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.669250 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.669476 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.669570 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.669802 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.669904 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.670121 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.670221 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.670436 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.670537 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.670773 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.670877 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.671099 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.671199 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.671416 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.671519 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.671739 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.671833 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.672060 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.672180 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.672404 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.672503 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.672729 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.672823 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.673065 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.673224 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.673382 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.673518 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.673699 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.673832 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.674031 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.674179 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.674344 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.674437 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.674667 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.674768 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.674987 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.675094 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.675306 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.675410 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.675621 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.675725 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.675936 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.676036 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.676267 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.676389 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.676605 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.676708 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.676967 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.677070 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.677293 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.677386 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.677623 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.677724 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.677941 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.678044 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.678255 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.678361 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.678578 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.678672 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.678893 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.679031 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.679204 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.679304 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.679517 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.679611 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.679829 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.679930 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.680155 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.680258 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.680507 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.680631 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.680840 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.680960 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.681179 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.681291 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.681518 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.681692 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.681840 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.682018 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.682176 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.682343 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.682511 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.682682 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.682836 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.683018 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.683165 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.683358 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.683510 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.683844 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.683969 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.684059 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.684156 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.684334 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.684459 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.684662 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.684771 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.685048 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.685167 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.685318 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.685411 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.685634 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.685737 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.685948 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.686053 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.686263 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.686362 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.686576 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.686674 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.686905 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.687010 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.687213 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.687307 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.687598 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.687707 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.687916 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.688027 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.688291 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.688422 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.688626 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.688720 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.688941 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.689043 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.689292 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.689394 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.689606 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.689697 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.689931 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.690030 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.690248 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.690349 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.690565 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.690665 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.690896 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.690991 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.691207 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.691306 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.691530 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.691623 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.691851 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.691944 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.692246 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.692375 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.693038 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.693291 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.693472 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.693621 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.693792 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.694068 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.694164 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.694283 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.694377 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.694577 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.694686 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.694901 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.695011 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.695229 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.695322 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.695551 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.695650 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.695881 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.695973 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.696199 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.696545 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.696732 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.696888 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.697038 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.697204 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.697356 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.697514 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.697679 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.697830 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.697988 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.698150 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.698297 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.698448 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.698599 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.698750 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.698898 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.699049 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.699218 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.699357 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.699500 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.699684 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.699833 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.700024 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.700169 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.700500 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.700676 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.700853 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.700991 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.701171 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.701278 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.701482 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.701608 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.701805 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.701937 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.702119 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.702264 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.702441 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.702614 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.702750 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.702953 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.703061 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.703279 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.703387 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.703597 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.703701 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.703921 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.704069 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.704289 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.704454 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.704580 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.704865 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.704989 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.705109 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.705249 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.705470 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.705611 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.705718 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.705807 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.705894 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.706124 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.706275 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.706442 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.706537 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.706765 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.706867 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.707127 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.707220 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.707453 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.707556 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.707786 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.707888 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.708691 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.708808 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.709013 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.709126 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.709350 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.709443 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.709678 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.709780 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.710003 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.710208 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.710314 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.710534 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.710626 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.710876 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.710969 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.711211 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.711303 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.711545 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.711636 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.711870 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.711975 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.712193 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.712283 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.712550 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.712656 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.712867 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.712966 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.713179 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.713434 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.713534 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.713778 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.713883 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.714121 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.714239 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.714424 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.714540 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.714738 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.714827 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.715049 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.715157 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.715373 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.715470 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.715691 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.715801 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.716010 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.716226 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.716370 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.716611 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.716711 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.716939 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.717030 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.717273 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.717365 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.717608 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.717701 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.717936 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.718036 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.718252 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.718352 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.718585 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.718677 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.718913 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.719005 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.719215 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.719307 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.719538 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.719637 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.719859 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.719960 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.720174 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.720278 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.720524 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.720632 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.720865 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.721009 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.721166 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.721266 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.721481 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.721579 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.721799 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.721898 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.722108 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.722199 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.722431 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.722521 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.722749 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.722848 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.723316 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.723433 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.723632 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.723785 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.723980 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.724080 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.724298 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.724453 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.724633 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.724752 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.724965 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.725076 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.725271 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.725381 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.725586 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.725693 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.725890 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.726003 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.726209 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.726446 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.726541 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.726775 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.726870 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.727119 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.727214 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.727435 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.727535 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.727776 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.727868 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.728103 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.728197 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.728439 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.728536 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.728754 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.728847 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.729080 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.729175 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.729389 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.729482 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.729711 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.729814 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.730028 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.730125 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.730338 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.730429 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.730672 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.730778 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.730994 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.731094 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.731306 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.731532 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.731638 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.731878 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.731984 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.732212 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.732522 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.732628 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.732884 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.732995 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.733229 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.733329 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.733530 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.733629 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.733843 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.733998 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.734179 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.734288 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.734495 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.734590 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.734840 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.734979 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.735168 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.735484 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.735812 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.735997 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.736162 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.736345 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.736530 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.736690 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.736849 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.737042 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.737202 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.737375 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.737543 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.737702 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.737851 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.738014 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.738166 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.738315 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.738471 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.738642 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.738793 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.738961 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.739122 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.739279 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.739459 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.739610 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.739761 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.739921 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.740072 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.740229 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.740420 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.740582 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.740763 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.740924 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.741075 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.741226 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.741376 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.741526 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.741675 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.741824 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.741919 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.742141 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.742243 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.742459 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.742664 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.742793 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.742883 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.743095 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.743315 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.743441 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.743602 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.743779 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.743966 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.744121 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.744425 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.744617 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.744753 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.744957 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.745059 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.745189 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.745379 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.745510 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.745697 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.745796 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.746017 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.746125 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.746340 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.746517 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.746660 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.746814 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.747035 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.747188 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.747497 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.747667 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.747834 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.747973 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.748183 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.748348 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.748605 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.748972 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.749085 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.749297 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.749441 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.749613 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.749723 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.749929 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.750030 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.750267 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.750360 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.750590 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.750749 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.750914 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.751055 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.751255 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.751393 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.751585 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.751715 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.751906 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.752009 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.752243 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.752428 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.752606 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.752966 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.753076 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.753262 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.753355 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.753631 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.753765 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.753966 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.754127 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.754285 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.754558 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.754665 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.754889 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.755642 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.755794 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.755912 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.756126 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.756232 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.756482 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.756590 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.756814 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.756912 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.757131 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.757244 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.757450 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.757554 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.757764 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.757855 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.758082 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.758189 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.758398 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.758499 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.758713 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.758813 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.759028 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.759128 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.759362 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.759477 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.759676 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.759777 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.760016 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.760109 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.760371 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.760469 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.760696 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.760790 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.761028 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.761122 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.761351 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.761445 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.761683 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.761786 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.762016 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.762119 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.762333 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.762428 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.762653 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.762756 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.762977 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.763113 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.763310 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.763409 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.763633 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.763737 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.763954 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.764046 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.764274 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.764393 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.764625 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.764726 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.764940 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.765068 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.765254 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.765356 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.765621 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.765767 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.765894 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.765996 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.766210 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.766305 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.766522 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.766624 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.766834 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.766936 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.767156 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.767257 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.767468 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.767569 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.767780 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.767874 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.768090 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.768192 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.768436 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.768547 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.768763 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.768866 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.769081 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.769191 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.769392 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.769492 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.769703 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.769797 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.770015 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.770123 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.770328 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.770429 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.771187 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.771292 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.771510 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.771611 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.771824 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.771916 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.772140 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.772251 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.772479 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.772584 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.772794 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.772926 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.773108 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.773244 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.773447 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.773543 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.773797 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.773891 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.774125 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.774257 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.774458 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.774561 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.774708 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 10 17:56:41.774808 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.775096 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.775415 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.775747 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.776074 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.776427 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.776751 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.777092 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.777415 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.777743 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.778073 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.778398 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.779604 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.779604 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.779604 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.779874 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.780149 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.780377 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.780711 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.781046 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.781377 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.781700 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.783011 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.783346 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.783686 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.784225 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.784596 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.784911 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.786065 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.786065 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.786065 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.786481 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.786810 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.787153 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.787495 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.787862 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.788190 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.788577 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.788921 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.789250 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.789577 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.789896 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 17:56:41.790150 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 10 17:56:41.838591 chdv-master-2 devstack@n-api.service[126595]: INFO dbcounter [None req-8fb5805a-52c6-4176-8982-5f34dd9585e6 None None] Registered counter for database nova_api Jun 10 17:56:41.854589 chdv-master-2 devstack@n-api.service[126594]: INFO dbcounter [None req-b6699e71-a1e4-44ae-8384-ae5825c10db2 None None] Registered counter for database nova_api Jun 10 17:56:41.859352 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_db.sqlalchemy.engines [None req-8fb5805a-52c6-4176-8982-5f34dd9585e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126595) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 10 17:56:41.866507 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writer thread running {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 10 17:56:41.873915 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_db.sqlalchemy.engines [None req-b6699e71-a1e4-44ae-8384-ae5825c10db2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126594) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 10 17:56:41.881334 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writer thread running {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 10 17:56:41.925886 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.context [None req-8fb5805a-52c6-4176-8982-5f34dd9585e6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0f13ffb7-1a21-4641-8558-8a89dd295960(cell1) {{(pid=126595) load_cells /opt/stack/nova/nova/context.py:464}} Jun 10 17:56:41.930182 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8fb5805a-52c6-4176-8982-5f34dd9585e6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:56:41.931783 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8fb5805a-52c6-4176-8982-5f34dd9585e6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:56:41.932659 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8fb5805a-52c6-4176-8982-5f34dd9585e6 None None] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:56:41.934682 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8fb5805a-52c6-4176-8982-5f34dd9585e6 None None] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:56:41.936775 chdv-master-2 devstack@n-api.service[126595]: INFO dbcounter [None req-8fb5805a-52c6-4176-8982-5f34dd9585e6 None None] Registered counter for database nova_cell0 Jun 10 17:56:41.939543 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.context [None req-b6699e71-a1e4-44ae-8384-ae5825c10db2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0f13ffb7-1a21-4641-8558-8a89dd295960(cell1) {{(pid=126594) load_cells /opt/stack/nova/nova/context.py:464}} Jun 10 17:56:41.940808 chdv-master-2 devstack@n-api.service[126595]: INFO dbcounter [None req-8fb5805a-52c6-4176-8982-5f34dd9585e6 None None] Registered counter for database nova_cell1 Jun 10 17:56:41.944338 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b6699e71-a1e4-44ae-8384-ae5825c10db2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:56:41.945907 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b6699e71-a1e4-44ae-8384-ae5825c10db2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:56:41.946900 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b6699e71-a1e4-44ae-8384-ae5825c10db2 None None] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:56:41.948837 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_db.sqlalchemy.engines [None req-8fb5805a-52c6-4176-8982-5f34dd9585e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126595) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 10 17:56:41.948963 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b6699e71-a1e4-44ae-8384-ae5825c10db2 None None] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:56:41.951026 chdv-master-2 devstack@n-api.service[126594]: INFO dbcounter [None req-b6699e71-a1e4-44ae-8384-ae5825c10db2 None None] Registered counter for database nova_cell0 Jun 10 17:56:41.953846 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_db.sqlalchemy.engines [None req-8fb5805a-52c6-4176-8982-5f34dd9585e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126595) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 10 17:56:41.955112 chdv-master-2 devstack@n-api.service[126594]: INFO dbcounter [None req-b6699e71-a1e4-44ae-8384-ae5825c10db2 None None] Registered counter for database nova_cell1 Jun 10 17:56:41.959970 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writer thread running {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 10 17:56:41.962543 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_db.sqlalchemy.engines [None req-b6699e71-a1e4-44ae-8384-ae5825c10db2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126594) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 10 17:56:41.969285 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_db.sqlalchemy.engines [None req-b6699e71-a1e4-44ae-8384-ae5825c10db2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126594) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 10 17:56:41.973447 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writer thread running {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 10 17:56:42.108336 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writer thread running {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 10 17:56:42.117955 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writer thread running {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 10 17:56:42.118196 chdv-master-2 devstack@n-api.service[126595]: INFO dbcounter [None req-8fb5805a-52c6-4176-8982-5f34dd9585e6 None None] Registered counter for database nova_cell0 Jun 10 17:56:42.125115 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_db.sqlalchemy.engines [None req-8fb5805a-52c6-4176-8982-5f34dd9585e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126595) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 10 17:56:42.129734 chdv-master-2 devstack@n-api.service[126594]: INFO dbcounter [None req-b6699e71-a1e4-44ae-8384-ae5825c10db2 None None] Registered counter for database nova_cell0 Jun 10 17:56:42.130988 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writer thread running {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 10 17:56:42.137074 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_db.sqlalchemy.engines [None req-b6699e71-a1e4-44ae-8384-ae5825c10db2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126594) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 10 17:56:42.142012 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writer thread running {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 10 17:56:42.453902 chdv-master-2 devstack@n-api.service[126595]: WARNING keystonemiddleware.auth_token [None req-8fb5805a-52c6-4176-8982-5f34dd9585e6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 10 17:56:42.461332 chdv-master-2 devstack@n-api.service[126595]: WARNING keystonemiddleware.auth_token [None req-8fb5805a-52c6-4176-8982-5f34dd9585e6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 10 17:56:42.468725 chdv-master-2 devstack@n-api.service[126594]: WARNING keystonemiddleware.auth_token [None req-b6699e71-a1e4-44ae-8384-ae5825c10db2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 10 17:56:42.476739 chdv-master-2 devstack@n-api.service[126594]: WARNING keystonemiddleware.auth_token [None req-b6699e71-a1e4-44ae-8384-ae5825c10db2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 10 17:56:42.806720 chdv-master-2 devstack@n-api.service[126595]: WARNING keystonemiddleware.auth_token [None req-8fb5805a-52c6-4176-8982-5f34dd9585e6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 10 17:56:42.814644 chdv-master-2 devstack@n-api.service[126595]: WARNING keystonemiddleware.auth_token [None req-8fb5805a-52c6-4176-8982-5f34dd9585e6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 10 17:56:42.816783 chdv-master-2 devstack@n-api.service[126594]: WARNING keystonemiddleware.auth_token [None req-b6699e71-a1e4-44ae-8384-ae5825c10db2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 10 17:56:42.818030 chdv-master-2 devstack@n-api.service[126595]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561fe4b679c0 pid: 126595 (default app) Jun 10 17:56:42.822701 chdv-master-2 devstack@n-api.service[126594]: WARNING keystonemiddleware.auth_token [None req-b6699e71-a1e4-44ae-8384-ae5825c10db2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 10 17:56:42.827944 chdv-master-2 devstack@n-api.service[126594]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561fe4b679c0 pid: 126594 (default app) Jun 10 17:57:28.450057 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:57:28.461285 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:57:28.461285 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:57:28.461285 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:57:28.590039 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=3 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:57:28.591707 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=3 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:57:28.592969 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=3 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:57:28.593928 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=3 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:57:30.121632 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1fb3d629-4962-4373-bbe3-b0daece6b06e tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Calling method '.version_select at 0x7f77c39b43a0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:30.123248 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:57:30.123248 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:57:30.131684 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1fb3d629-4962-4373-bbe3-b0daece6b06e tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0f13ffb7-1a21-4641-8558-8a89dd295960(cell1) {{(pid=126595) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jun 10 17:57:30.136197 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1fb3d629-4962-4373-bbe3-b0daece6b06e tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:30.136791 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1fb3d629-4962-4373-bbe3-b0daece6b06e tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:30.207541 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1fb3d629-4962-4373-bbe3-b0daece6b06e tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:30.211230 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1fb3d629-4962-4373-bbe3-b0daece6b06e tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:30.226477 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1fb3d629-4962-4373-bbe3-b0daece6b06e tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:30.227087 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1fb3d629-4962-4373-bbe3-b0daece6b06e tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:30.234497 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1fb3d629-4962-4373-bbe3-b0daece6b06e tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] 10.222.0.35 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.790195 Jun 10 17:57:30.235393 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1/1] 10.222.0.35 () {58 vars in 1166 bytes} [Fri Jun 10 17:57:28 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:57:30.300901 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8c674e17-5ddb-4c8d-9215-2d41343a2017 tempest-AZAdminV2TestJSON-1823958810 tempest-AZAdminV2TestJSON-1823958810-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:30.302705 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8c674e17-5ddb-4c8d-9215-2d41343a2017 tempest-AZAdminV2TestJSON-1823958810 tempest-AZAdminV2TestJSON-1823958810-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:30.303342 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8c674e17-5ddb-4c8d-9215-2d41343a2017 tempest-AZAdminV2TestJSON-1823958810 tempest-AZAdminV2TestJSON-1823958810-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:30.304327 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8c674e17-5ddb-4c8d-9215-2d41343a2017 tempest-AZAdminV2TestJSON-1823958810 tempest-AZAdminV2TestJSON-1823958810-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:30.304771 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8c674e17-5ddb-4c8d-9215-2d41343a2017 tempest-AZAdminV2TestJSON-1823958810 tempest-AZAdminV2TestJSON-1823958810-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:30.352314 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8c674e17-5ddb-4c8d-9215-2d41343a2017 tempest-AZAdminV2TestJSON-1823958810 tempest-AZAdminV2TestJSON-1823958810-project-admin] 10.222.0.35 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 1.768215 Jun 10 17:57:30.356443 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1/2] 10.222.0.35 () {58 vars in 1163 bytes} [Fri Jun 10 17:57:28 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 10 17:57:30.752400 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-18050728-da88-4566-981f-4deed60f4fdc tempest-AZAdminNegativeTestJSON-1972184743 tempest-AZAdminNegativeTestJSON-1972184743-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:30.752400 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:57:30.752400 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:57:30.752702 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-18050728-da88-4566-981f-4deed60f4fdc tempest-AZAdminNegativeTestJSON-1972184743 tempest-AZAdminNegativeTestJSON-1972184743-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '2cdd4273b4e748289d479381ab0db144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6a6719c69b42bb9e0d3993e8cbb893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:30.755853 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-18050728-da88-4566-981f-4deed60f4fdc tempest-AZAdminNegativeTestJSON-1972184743 tempest-AZAdminNegativeTestJSON-1972184743-project] Request method failure captured: Jun 10 17:57:30.755853 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Jun 10 17:57:30.755853 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 17:57:30.755853 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 17:57:30.755853 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 17:57:30.755853 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 17:57:30.755853 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 17:57:30.755853 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 17:57:30.755853 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 17:57:30.755853 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 17:57:30.755853 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4YGdU6AZMV98m_EtEfr7g1J05kDmOsDthCeZWj1pE3ellDaC9VMHUTUGOnsx_lHv0LSONioypdTLS3pS02JM1M7PvbdDSYimrKztPi6frZzggm1imiLdvbRgJXB2HFno4G0zideqBJ1eTjRbsobQ2aWuLR8ECHHLeuyVhYXGANOcNE Jun 10 17:57:30.755853 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 17:57:30.755853 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 17:57:30.755853 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 17:57:30.755853 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 17:57:30.755853 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 17:57:30.755853 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 17:57:30.755853 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 8e6a6719c69b42bb9e0d3993e8cbb893 Jun 10 17:57:30.755853 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1972184743 Jun 10 17:57:30.755853 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 17:57:30.755853 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 17:57:30.757285 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/8e6a6719c69b42bb9e0d3993e8cbb893"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8e6a6719c69b42bb9e0d3993e8cbb893"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8e6a6719c69b42bb9e0d3993e8cbb893"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_8e6a6719c69b42bb9e0d3993e8cbb893", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:57:30.757285 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-AZAdminNegativeTestJSON-1972184743 Jun 10 17:57:30.757285 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 8e6a6719c69b42bb9e0d3993e8cbb893 Jun 10 17:57:30.757285 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1972184743 Jun 10 17:57:30.757285 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-AZAdminNegativeTestJSON-1972184743-project Jun 10 17:57:30.757285 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 17:57:30.757285 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 17:57:30.757285 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 2cdd4273b4e748289d479381ab0db144 Jun 10 17:57:30.757285 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-AZAdminNegativeTestJSON-1972184743-project Jun 10 17:57:30.757285 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 17:57:30.757285 chdv-master-2 devstack@n-api.service[126595]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jun 10 17:57:30.757285 chdv-master-2 devstack@n-api.service[126595]: action_args: {} Jun 10 17:57:30.762389 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:57:30.762389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:57:30.762389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:57:30.762389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:57:30.762389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:57:30.762389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:57:30.762389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:57:30.762389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:57:30.762389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Jun 10 17:57:30.762389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Jun 10 17:57:30.762389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 10 17:57:30.762389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 10 17:57:30.762389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 10 17:57:30.762389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 10 17:57:30.762389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 17:57:30.762389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 17:57:30.762389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 17:57:30.762389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 17:57:30.762389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 10 17:57:30.763730 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 10 17:57:30.763730 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 10 17:57:30.763730 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 10 17:57:30.763730 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 10 17:57:30.763730 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 10 17:57:30.763730 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jun 10 17:57:30.763730 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:57:30.763730 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:57:30.763730 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:57:30.763730 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:57:30.763730 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:57:30.763730 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:57:30.763730 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 10 17:57:30.763730 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 10 17:57:30.763730 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jun 10 17:57:30.763730 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:57:30.763730 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-18050728-da88-4566-981f-4deed60f4fdc tempest-AZAdminNegativeTestJSON-1972184743 tempest-AZAdminNegativeTestJSON-1972184743-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:57:30.764828 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-18050728-da88-4566-981f-4deed60f4fdc tempest-AZAdminNegativeTestJSON-1972184743 tempest-AZAdminNegativeTestJSON-1972184743-project] 10.222.0.35 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.520366 Jun 10 17:57:30.764828 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2/3] 10.222.0.35 () {58 vars in 1184 bytes} [Fri Jun 10 17:57:30 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 522 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:57:30.766626 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-46db6d2c-0947-46c0-bf40-6bebc327b89f tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1221117119", "name": "tempest-test_aggregate-1805477710"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:57:30.767099 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-742f2fac-bcaa-465b-be3f-842243736808 tempest-AggregatesAdminTestV241-818929427 tempest-AggregatesAdminTestV241-818929427-project-admin] Calling method '.version_select at 0x7f77c39b4700>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:30.771220 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:57:30.771220 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:57:30.779846 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-742f2fac-bcaa-465b-be3f-842243736808 tempest-AggregatesAdminTestV241-818929427 tempest-AggregatesAdminTestV241-818929427-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0f13ffb7-1a21-4641-8558-8a89dd295960(cell1) {{(pid=126594) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jun 10 17:57:30.780887 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-742f2fac-bcaa-465b-be3f-842243736808 tempest-AggregatesAdminTestV241-818929427 tempest-AggregatesAdminTestV241-818929427-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:30.781485 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-742f2fac-bcaa-465b-be3f-842243736808 tempest-AggregatesAdminTestV241-818929427 tempest-AggregatesAdminTestV241-818929427-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:30.818776 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-742f2fac-bcaa-465b-be3f-842243736808 tempest-AggregatesAdminTestV241-818929427 tempest-AggregatesAdminTestV241-818929427-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:30.819230 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-742f2fac-bcaa-465b-be3f-842243736808 tempest-AggregatesAdminTestV241-818929427 tempest-AggregatesAdminTestV241-818929427-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:30.827518 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:57:30.827518 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:57:30.828859 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.aggregate [None req-46db6d2c-0947-46c0-bf40-6bebc327b89f tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Generated uuid bde05ea4-6538-4403-8eb7-f876674bbf86 for aggregate {{(pid=126595) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 10 17:57:30.850139 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-742f2fac-bcaa-465b-be3f-842243736808 tempest-AggregatesAdminTestV241-818929427 tempest-AggregatesAdminTestV241-818929427-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:30.850593 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-742f2fac-bcaa-465b-be3f-842243736808 tempest-AggregatesAdminTestV241-818929427 tempest-AggregatesAdminTestV241-818929427-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:30.866768 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-742f2fac-bcaa-465b-be3f-842243736808 tempest-AggregatesAdminTestV241-818929427 tempest-AggregatesAdminTestV241-818929427-project-admin] 10.222.0.35 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.509703 Jun 10 17:57:30.869776 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2/4] 10.222.0.35 () {60 vars in 1207 bytes} [Fri Jun 10 17:57:30 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 17:57:30.992347 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-46db6d2c-0947-46c0-bf40-6bebc327b89f tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.232996 Jun 10 17:57:30.993202 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3/5] 10.222.0.35 () {60 vars in 1164 bytes} [Fri Jun 10 17:57:30 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:57:30.998245 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-369b345f-b45b-4bb1-bb11-5a601c78672b tempest-AZAdminV2TestJSON-1823958810 tempest-AZAdminV2TestJSON-1823958810-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:30.999003 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:57:30.999003 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:57:31.000700 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-369b345f-b45b-4bb1-bb11-5a601c78672b tempest-AZAdminV2TestJSON-1823958810 tempest-AZAdminV2TestJSON-1823958810-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:31.001157 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-369b345f-b45b-4bb1-bb11-5a601c78672b tempest-AZAdminV2TestJSON-1823958810 tempest-AZAdminV2TestJSON-1823958810-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:31.002033 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-369b345f-b45b-4bb1-bb11-5a601c78672b tempest-AZAdminV2TestJSON-1823958810 tempest-AZAdminV2TestJSON-1823958810-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:31.002502 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-369b345f-b45b-4bb1-bb11-5a601c78672b tempest-AZAdminV2TestJSON-1823958810 tempest-AZAdminV2TestJSON-1823958810-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:31.040474 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a393cb2a-bfea-44b4-847b-eac95bc8a578 tempest-FlavorsExtraSpecsNegativeTestJSON-775920873 tempest-FlavorsExtraSpecsNegativeTestJSON-775920873-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1448986352", "ram": 512, "vcpus": 1, "disk": 10, "id": 211027150, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:57:31.047141 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-369b345f-b45b-4bb1-bb11-5a601c78672b tempest-AZAdminV2TestJSON-1823958810 tempest-AZAdminV2TestJSON-1823958810-project-admin] 10.222.0.35 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.052563 Jun 10 17:57:31.048437 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4/6] 10.222.0.35 () {58 vars in 1184 bytes} [Fri Jun 10 17:57:30 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:57:31.073054 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:57:31.073054 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:57:31.159054 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a393cb2a-bfea-44b4-847b-eac95bc8a578 tempest-FlavorsExtraSpecsNegativeTestJSON-775920873 tempest-FlavorsExtraSpecsNegativeTestJSON-775920873-project-admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.287412 Jun 10 17:57:31.160324 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3/7] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:57:30 2022] POST /compute/v2.1/flavors => generated 413 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:57:31.165382 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3efec9c3-5ab5-4b8e-a765-c74b18884c5b tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:31.167061 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:57:31.167061 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:57:31.182874 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3efec9c3-5ab5-4b8e-a765-c74b18884c5b tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] 10.222.0.35 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.020557 Jun 10 17:57:31.183689 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 4/8] 10.222.0.35 () {58 vars in 1142 bytes} [Fri Jun 10 17:57:31 2022] GET /compute/v2.1/os-aggregates => generated 303 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:57:31.467109 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b054b584-73cd-473a-b7d5-2ed5e8f83f5c tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1597008441", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:57:31.733296 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ba2056c2-4e34-4385-b057-89965c090b85 tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032 tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:31.779685 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-ba2056c2-4e34-4385-b057-89965c090b85 tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032 tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032-project] HTTP exception thrown: Flavor 211027150 has no extra specs with key hw:cpu_thread_policy. Jun 10 17:57:31.782715 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ba2056c2-4e34-4385-b057-89965c090b85 tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032 tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032-project] Request method failure captured: Jun 10 17:57:31.782715 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/flavors/211027150/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jun 10 17:57:31.782715 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 17:57:31.782715 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 17:57:31.782715 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 17:57:31.782715 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 17:57:31.782715 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 17:57:31.782715 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 17:57:31.782715 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 17:57:31.782715 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 17:57:31.782715 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4YH32ZeM2IhuVeBtQuzxKllR5DzUg73L43kJAgiD1DZ3EB5elcdqzdKmXEWwjKFSn3NxFy38OWOGjuhdq0tvHQ5Y8-xzD13ST41JrnwNmgMPJWHqllsng-8zag37Uwjt1yF6-clWhzoMfFo_TV3er-n5zSUdC0zimK-QQOvFIMKzhk Jun 10 17:57:31.782715 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 17:57:31.782715 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 17:57:31.782715 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 17:57:31.782715 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 17:57:31.782715 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 17:57:31.782715 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 17:57:31.782715 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 8f3cf59c32c942f3aaa5b75d701795b2 Jun 10 17:57:31.782715 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032 Jun 10 17:57:31.782715 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 17:57:31.782715 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 17:57:31.784370 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/8f3cf59c32c942f3aaa5b75d701795b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8f3cf59c32c942f3aaa5b75d701795b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8f3cf59c32c942f3aaa5b75d701795b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_8f3cf59c32c942f3aaa5b75d701795b2", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:57:31.784370 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032 Jun 10 17:57:31.784370 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 8f3cf59c32c942f3aaa5b75d701795b2 Jun 10 17:57:31.784370 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032 Jun 10 17:57:31.784370 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032-project Jun 10 17:57:31.784370 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 17:57:31.784370 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 17:57:31.784370 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: c59028a70290441187fb03d7b73c154c Jun 10 17:57:31.784370 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032-project Jun 10 17:57:31.784370 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 17:57:31.784370 chdv-master-2 devstack@n-api.service[126594]: exception: Flavor 211027150 has no extra specs with key hw:cpu_thread_policy. Jun 10 17:57:31.785038 chdv-master-2 devstack@n-api.service[126594]: action_args: {'flavor_id': '211027150', 'id': 'hw:cpu_thread_policy'} Jun 10 17:57:31.785038 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:57:31.785038 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:57:31.785038 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Jun 10 17:57:31.785038 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Jun 10 17:57:31.785038 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jun 10 17:57:31.785038 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:57:31.785038 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:57:31.785038 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:57:31.785038 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:57:31.785038 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:57:31.785038 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:57:31.785038 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:57:31.785038 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:57:31.785038 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:57:31.785038 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:57:31.785038 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Jun 10 17:57:31.785038 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 10 17:57:31.785038 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 211027150 has no extra specs with key hw:cpu_thread_policy. Jun 10 17:57:31.785038 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:57:31.785038 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:57:31.785038 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:57:31.786265 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:57:31.786265 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:57:31.786265 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:57:31.786265 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:57:31.786265 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:57:31.786265 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 211027150 has no extra specs with key hw:cpu_thread_policy. Jun 10 17:57:31.786265 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:57:31.787729 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ba2056c2-4e34-4385-b057-89965c090b85 tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032 tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032-project] Returning 404 to user: Flavor 211027150 has no extra specs with key hw:cpu_thread_policy. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:57:31.788852 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ba2056c2-4e34-4385-b057-89965c090b85 tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032 tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032-project] 10.222.0.35 "GET /compute/v2.1/flavors/211027150/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.603710 Jun 10 17:57:31.790673 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 5/9] 10.222.0.35 () {58 vars in 1262 bytes} [Fri Jun 10 17:57:31 2022] GET /compute/v2.1/flavors/211027150/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 606 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:57:31.803536 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-88fc8607-90f5-4c0c-b060-76fe16845233 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "chh1-master-2"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:57:31.807711 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:57:31.807711 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:57:31.883059 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-88fc8607-90f5-4c0c-b060-76fe16845233 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:31.883803 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-88fc8607-90f5-4c0c-b060-76fe16845233 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:32.814185 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-b054b584-73cd-473a-b7d5-2ed5e8f83f5c tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] validate_networks() for None {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 17:57:33.219697 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-b054b584-73cd-473a-b7d5-2ed5e8f83f5c tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 17:57:33.221138 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-b054b584-73cd-473a-b7d5-2ed5e8f83f5c tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 17:57:33.221613 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-b054b584-73cd-473a-b7d5-2ed5e8f83f5c tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 17:57:33.222240 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-b054b584-73cd-473a-b7d5-2ed5e8f83f5c tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 17:57:33.223178 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-b054b584-73cd-473a-b7d5-2ed5e8f83f5c tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 17:57:33.245531 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b054b584-73cd-473a-b7d5-2ed5e8f83f5c tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:33.246162 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b054b584-73cd-473a-b7d5-2ed5e8f83f5c tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:33.246965 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b054b584-73cd-473a-b7d5-2ed5e8f83f5c tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:33.247413 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b054b584-73cd-473a-b7d5-2ed5e8f83f5c tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:33.300077 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-b054b584-73cd-473a-b7d5-2ed5e8f83f5c tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Getting quotas for project 141d09ed6e1548d996a675ec1f1011b7. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 17:57:33.310220 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-b054b584-73cd-473a-b7d5-2ed5e8f83f5c tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Getting quotas for user 0a75d420afea440fba308b4ed26fd544 and project 141d09ed6e1548d996a675ec1f1011b7. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 17:57:33.326240 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b054b584-73cd-473a-b7d5-2ed5e8f83f5c tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 17:57:33.329574 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b054b584-73cd-473a-b7d5-2ed5e8f83f5c tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: c9b75acf-e4fe-425e-9398-40c4ac1a108b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 17:57:33.486976 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b054b584-73cd-473a-b7d5-2ed5e8f83f5c tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.435045 Jun 10 17:57:33.489960 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 5/10] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:57:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 17:57:33.508075 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c2ffea07-5f5d-4da2-b23a-e3a045951966 tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032 tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:57:33.511073 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:57:33.511073 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:57:33.513097 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c2ffea07-5f5d-4da2-b23a-e3a045951966 tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032 tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'c59028a70290441187fb03d7b73c154c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3cf59c32c942f3aaa5b75d701795b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:33.516160 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c2ffea07-5f5d-4da2-b23a-e3a045951966 tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032 tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032-project] Request method failure captured: Jun 10 17:57:33.516160 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/flavors/211027150/os-extra_specs HTTP/1.1 Jun 10 17:57:33.516160 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 17:57:33.516160 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 17:57:33.516160 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 17:57:33.516160 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 66 Jun 10 17:57:33.516160 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 17:57:33.516160 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 17:57:33.516160 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 17:57:33.516160 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 17:57:33.516160 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4YH32ZeM2IhuVeBtQuzxKllR5DzUg73L43kJAgiD1DZ3EB5elcdqzdKmXEWwjKFSn3NxFy38OWOGjuhdq0tvHQ5Y8-xzD13ST41JrnwNmgMPJWHqllsng-8zag37Uwjt1yF6-clWhzoMfFo_TV3er-n5zSUdC0zimK-QQOvFIMKzhk Jun 10 17:57:33.516160 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 17:57:33.516160 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 17:57:33.516160 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 17:57:33.516160 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 17:57:33.516160 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 17:57:33.516160 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 17:57:33.516160 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 8f3cf59c32c942f3aaa5b75d701795b2 Jun 10 17:57:33.516160 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032 Jun 10 17:57:33.516160 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 17:57:33.516160 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 17:57:33.517580 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/8f3cf59c32c942f3aaa5b75d701795b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8f3cf59c32c942f3aaa5b75d701795b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8f3cf59c32c942f3aaa5b75d701795b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_8f3cf59c32c942f3aaa5b75d701795b2", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:57:33.517580 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032 Jun 10 17:57:33.517580 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 8f3cf59c32c942f3aaa5b75d701795b2 Jun 10 17:57:33.517580 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032 Jun 10 17:57:33.517580 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032-project Jun 10 17:57:33.517580 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 17:57:33.517580 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 17:57:33.517580 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: c59028a70290441187fb03d7b73c154c Jun 10 17:57:33.517580 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032-project Jun 10 17:57:33.517580 chdv-master-2 devstack@n-api.service[126595]: Jun 10 17:57:33.517580 chdv-master-2 devstack@n-api.service[126595]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Jun 10 17:57:33.517580 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 17:57:33.518324 chdv-master-2 devstack@n-api.service[126595]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jun 10 17:57:33.518324 chdv-master-2 devstack@n-api.service[126595]: action_args: {'flavor_id': '211027150', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Jun 10 17:57:33.518324 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:57:33.518324 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:57:33.518324 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:57:33.518324 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:57:33.518324 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:57:33.518324 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:57:33.518324 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:57:33.518324 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:57:33.518324 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 17:57:33.518324 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 17:57:33.518324 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Jun 10 17:57:33.518324 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Jun 10 17:57:33.518324 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 10 17:57:33.518324 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 10 17:57:33.518324 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 10 17:57:33.518324 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 10 17:57:33.518324 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 17:57:33.519446 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 17:57:33.519446 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 17:57:33.519446 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 17:57:33.519446 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 10 17:57:33.519446 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 10 17:57:33.519446 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 10 17:57:33.519446 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 10 17:57:33.519446 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 10 17:57:33.519446 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 10 17:57:33.519446 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jun 10 17:57:33.519446 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:57:33.519446 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:57:33.519446 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:57:33.519446 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:57:33.519446 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:57:33.519446 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:57:33.519446 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 10 17:57:33.519446 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 10 17:57:33.519446 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jun 10 17:57:33.519446 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:57:33.521981 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c2ffea07-5f5d-4da2-b23a-e3a045951966 tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032 tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:57:33.523890 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c2ffea07-5f5d-4da2-b23a-e3a045951966 tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032 tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032-project] 10.222.0.35 "POST /compute/v2.1/flavors/211027150/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.031738 Jun 10 17:57:33.524623 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 6/11] 10.222.0.35 () {60 vars in 1220 bytes} [Fri Jun 10 17:57:33 2022] POST /compute/v2.1/flavors/211027150/os-extra_specs => generated 124 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:57:33.536553 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3f008c74-746b-4bb6-9809-2689f1b89377 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:33.537763 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3f008c74-746b-4bb6-9809-2689f1b89377 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: c9b75acf-e4fe-425e-9398-40c4ac1a108b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:33.657769 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-88fc8607-90f5-4c0c-b060-76fe16845233 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 315 microversion: 2.1 time: 1.864039 Jun 10 17:57:33.663114 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3f008c74-746b-4bb6-9809-2689f1b89377 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:33.670367 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 6/12] 10.222.0.35 () {60 vars in 1190 bytes} [Fri Jun 10 17:57:31 2022] POST /compute/v2.1/os-aggregates/1/action => generated 315 bytes in 1877 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:57:33.678366 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e52d79f6-9d3e-4c65-92d0-9ddfc1f715fd tempest-FlavorsExtraSpecsNegativeTestJSON-775920873 tempest-FlavorsExtraSpecsNegativeTestJSON-775920873-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:57:33.680288 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:57:33.680288 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:57:33.685563 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3f008c74-746b-4bb6-9809-2689f1b89377 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b" status: 200 len: 1222 microversion: 2.1 time: 0.159621 Jun 10 17:57:33.696573 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 7/13] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:33 2022] GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b => generated 1222 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:33.824875 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e52d79f6-9d3e-4c65-92d0-9ddfc1f715fd tempest-FlavorsExtraSpecsNegativeTestJSON-775920873 tempest-FlavorsExtraSpecsNegativeTestJSON-775920873-project-admin] 10.222.0.35 "POST /compute/v2.1/flavors/211027150/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.152845 Jun 10 17:57:33.829929 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 7/14] 10.222.0.35 () {60 vars in 1220 bytes} [Fri Jun 10 17:57:33 2022] POST /compute/v2.1/flavors/211027150/os-extra_specs => generated 66 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 17:57:33.835294 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0dabe674-18cc-4c44-a8a0-525105985055 tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032 tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:33.836057 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:57:33.836057 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:57:33.837161 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0dabe674-18cc-4c44-a8a0-525105985055 tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032 tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'c59028a70290441187fb03d7b73c154c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3cf59c32c942f3aaa5b75d701795b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:33.838766 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0dabe674-18cc-4c44-a8a0-525105985055 tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032 tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032-project] Request method failure captured: Jun 10 17:57:33.838766 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/flavors/211027150/os-extra_specs/hw:numa_nodes HTTP/1.1 Jun 10 17:57:33.838766 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 17:57:33.838766 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 17:57:33.838766 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 17:57:33.838766 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 17:57:33.838766 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 17:57:33.838766 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 17:57:33.838766 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 17:57:33.838766 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 17:57:33.838766 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4YH32ZeM2IhuVeBtQuzxKllR5DzUg73L43kJAgiD1DZ3EB5elcdqzdKmXEWwjKFSn3NxFy38OWOGjuhdq0tvHQ5Y8-xzD13ST41JrnwNmgMPJWHqllsng-8zag37Uwjt1yF6-clWhzoMfFo_TV3er-n5zSUdC0zimK-QQOvFIMKzhk Jun 10 17:57:33.838766 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 17:57:33.838766 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 17:57:33.838766 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 17:57:33.838766 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 17:57:33.838766 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 17:57:33.838766 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 17:57:33.838766 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 8f3cf59c32c942f3aaa5b75d701795b2 Jun 10 17:57:33.838766 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032 Jun 10 17:57:33.838766 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 17:57:33.838766 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 17:57:33.839812 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/8f3cf59c32c942f3aaa5b75d701795b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8f3cf59c32c942f3aaa5b75d701795b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8f3cf59c32c942f3aaa5b75d701795b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_8f3cf59c32c942f3aaa5b75d701795b2", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:57:33.839812 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032 Jun 10 17:57:33.839812 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 8f3cf59c32c942f3aaa5b75d701795b2 Jun 10 17:57:33.839812 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032 Jun 10 17:57:33.839812 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032-project Jun 10 17:57:33.839812 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 17:57:33.839812 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 17:57:33.839812 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: c59028a70290441187fb03d7b73c154c Jun 10 17:57:33.839812 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032-project Jun 10 17:57:33.839812 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 17:57:33.839812 chdv-master-2 devstack@n-api.service[126595]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jun 10 17:57:33.840791 chdv-master-2 devstack@n-api.service[126595]: action_args: {'flavor_id': '211027150', 'id': 'hw:numa_nodes'} Jun 10 17:57:33.840791 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:57:33.840791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:57:33.840791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:57:33.840791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:57:33.840791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:57:33.840791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:57:33.840791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:57:33.840791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:57:33.840791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Jun 10 17:57:33.840791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Jun 10 17:57:33.840791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 10 17:57:33.840791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 10 17:57:33.840791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 10 17:57:33.840791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 10 17:57:33.840791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 17:57:33.840791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 17:57:33.840791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 17:57:33.840791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 17:57:33.840791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 10 17:57:33.841812 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 10 17:57:33.841812 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 10 17:57:33.841812 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 10 17:57:33.841812 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 10 17:57:33.841812 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 10 17:57:33.841812 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jun 10 17:57:33.841812 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:57:33.841812 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:57:33.841812 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:57:33.841812 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:57:33.841812 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:57:33.841812 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:57:33.841812 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 10 17:57:33.841812 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 10 17:57:33.841812 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jun 10 17:57:33.841812 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:57:33.841812 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0dabe674-18cc-4c44-a8a0-525105985055 tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032 tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:57:33.842689 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0dabe674-18cc-4c44-a8a0-525105985055 tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032 tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032-project] 10.222.0.35 "DELETE /compute/v2.1/flavors/211027150/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.008613 Jun 10 17:57:33.842689 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 8/15] 10.222.0.35 () {58 vars in 1244 bytes} [Fri Jun 10 17:57:33 2022] DELETE /compute/v2.1/flavors/211027150/os-extra_specs/hw:numa_nodes => generated 124 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:57:33.850675 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-67bb9268-3aaf-49da-87aa-1f09fdb7a440 tempest-FlavorsExtraSpecsNegativeTestJSON-775920873 tempest-FlavorsExtraSpecsNegativeTestJSON-775920873-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:57:33.872806 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-67bb9268-3aaf-49da-87aa-1f09fdb7a440 tempest-FlavorsExtraSpecsNegativeTestJSON-775920873 tempest-FlavorsExtraSpecsNegativeTestJSON-775920873-project-admin] 10.222.0.35 "POST /compute/v2.1/flavors/211027150/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.025818 Jun 10 17:57:33.873389 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 8/16] 10.222.0.35 () {60 vars in 1220 bytes} [Fri Jun 10 17:57:33 2022] POST /compute/v2.1/flavors/211027150/os-extra_specs => generated 66 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 17:57:33.886161 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0bbd3e65-0545-4807-a232-087bfd683118 tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032 tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:57:33.888275 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:57:33.888275 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:57:33.889462 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0bbd3e65-0545-4807-a232-087bfd683118 tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032 tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'c59028a70290441187fb03d7b73c154c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3cf59c32c942f3aaa5b75d701795b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:33.891905 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0bbd3e65-0545-4807-a232-087bfd683118 tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032 tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032-project] Request method failure captured: Jun 10 17:57:33.891905 chdv-master-2 devstack@n-api.service[126595]: request: PUT /compute/v2.1/flavors/211027150/os-extra_specs/hw:numa_nodes HTTP/1.1 Jun 10 17:57:33.891905 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 17:57:33.891905 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 17:57:33.891905 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 17:57:33.891905 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 22 Jun 10 17:57:33.891905 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 17:57:33.891905 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 17:57:33.891905 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 17:57:33.891905 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 17:57:33.891905 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4YH32ZeM2IhuVeBtQuzxKllR5DzUg73L43kJAgiD1DZ3EB5elcdqzdKmXEWwjKFSn3NxFy38OWOGjuhdq0tvHQ5Y8-xzD13ST41JrnwNmgMPJWHqllsng-8zag37Uwjt1yF6-clWhzoMfFo_TV3er-n5zSUdC0zimK-QQOvFIMKzhk Jun 10 17:57:33.891905 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 17:57:33.891905 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 17:57:33.891905 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 17:57:33.891905 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 17:57:33.891905 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 17:57:33.891905 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 17:57:33.891905 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 8f3cf59c32c942f3aaa5b75d701795b2 Jun 10 17:57:33.891905 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032 Jun 10 17:57:33.891905 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 17:57:33.891905 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 17:57:33.893269 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/8f3cf59c32c942f3aaa5b75d701795b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8f3cf59c32c942f3aaa5b75d701795b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8f3cf59c32c942f3aaa5b75d701795b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_8f3cf59c32c942f3aaa5b75d701795b2", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:57:33.893269 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032 Jun 10 17:57:33.893269 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 8f3cf59c32c942f3aaa5b75d701795b2 Jun 10 17:57:33.893269 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032 Jun 10 17:57:33.893269 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032-project Jun 10 17:57:33.893269 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 17:57:33.893269 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 17:57:33.893269 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: c59028a70290441187fb03d7b73c154c Jun 10 17:57:33.893269 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032-project Jun 10 17:57:33.893269 chdv-master-2 devstack@n-api.service[126595]: Jun 10 17:57:33.893269 chdv-master-2 devstack@n-api.service[126595]: {"hw:numa_nodes": "1"} Jun 10 17:57:33.893269 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 17:57:33.893269 chdv-master-2 devstack@n-api.service[126595]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jun 10 17:57:33.894038 chdv-master-2 devstack@n-api.service[126595]: action_args: {'flavor_id': '211027150', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Jun 10 17:57:33.894038 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:57:33.894038 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:57:33.894038 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:57:33.894038 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:57:33.894038 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:57:33.894038 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:57:33.894038 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:57:33.894038 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:57:33.894038 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 17:57:33.894038 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 17:57:33.894038 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Jun 10 17:57:33.894038 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Jun 10 17:57:33.894038 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 10 17:57:33.894038 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 10 17:57:33.894038 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 10 17:57:33.894038 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 10 17:57:33.894038 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 17:57:33.894038 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 17:57:33.895154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 17:57:33.895154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 17:57:33.895154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 10 17:57:33.895154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 10 17:57:33.895154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 10 17:57:33.895154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 10 17:57:33.895154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 10 17:57:33.895154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 10 17:57:33.895154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jun 10 17:57:33.895154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:57:33.895154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:57:33.895154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:57:33.895154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:57:33.895154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:57:33.895154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:57:33.895154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 10 17:57:33.895154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 10 17:57:33.895154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jun 10 17:57:33.895154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:57:33.897296 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0bbd3e65-0545-4807-a232-087bfd683118 tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032 tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:57:33.901102 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0bbd3e65-0545-4807-a232-087bfd683118 tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032 tempest-FlavorsExtraSpecsNegativeTestJSON-1693965032-project] 10.222.0.35 "PUT /compute/v2.1/flavors/211027150/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.020135 Jun 10 17:57:33.901771 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 9/17] 10.222.0.35 () {60 vars in 1261 bytes} [Fri Jun 10 17:57:33 2022] PUT /compute/v2.1/flavors/211027150/os-extra_specs/hw:numa_nodes => generated 124 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:57:33.914442 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-253a46dc-9bf6-4e1a-8964-b9325828eddf tempest-FlavorsExtraSpecsNegativeTestJSON-775920873 tempest-FlavorsExtraSpecsNegativeTestJSON-775920873-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:33.915582 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:57:33.915582 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:57:33.926987 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-253a46dc-9bf6-4e1a-8964-b9325828eddf tempest-FlavorsExtraSpecsNegativeTestJSON-775920873 tempest-FlavorsExtraSpecsNegativeTestJSON-775920873-project-admin] HTTP exception thrown: Flavor 211027150 has no extra specs with key hw:cpu_thread_policy. Jun 10 17:57:33.930184 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-253a46dc-9bf6-4e1a-8964-b9325828eddf tempest-FlavorsExtraSpecsNegativeTestJSON-775920873 tempest-FlavorsExtraSpecsNegativeTestJSON-775920873-project-admin] Request method failure captured: Jun 10 17:57:33.930184 chdv-master-2 devstack@n-api.service[126594]: request: DELETE /compute/v2.1/flavors/211027150/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jun 10 17:57:33.930184 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 17:57:33.930184 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 17:57:33.930184 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 17:57:33.930184 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 17:57:33.930184 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 17:57:33.930184 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 17:57:33.930184 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 17:57:33.930184 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 17:57:33.930184 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4YKOCTDfiteP0_7MjyRLfLaJGZWE-pkh9nLHzbwHhCCv-wgGLQp8u-wXMtoqfFnwumfc7tPuTfLiUdb1BUo3lYbGigIRyoo-18XABFITApzR4oUm2b_TaLrCN4xg_qVXPse4OQd4NdMwRRi5E6Ioe9GV2SVfjm5-4HPZyG1s_0HuEU Jun 10 17:57:33.930184 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 17:57:33.930184 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 17:57:33.930184 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 17:57:33.930184 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 17:57:33.930184 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 17:57:33.930184 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 17:57:33.930184 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 1491b1558d9c4a22b4b9126644271d12 Jun 10 17:57:33.930184 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-775920873 Jun 10 17:57:33.930184 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member,admin Jun 10 17:57:33.930184 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member,admin Jun 10 17:57:33.932733 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1491b1558d9c4a22b4b9126644271d12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1491b1558d9c4a22b4b9126644271d12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1491b1558d9c4a22b4b9126644271d12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1491b1558d9c4a22b4b9126644271d12", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:57:33.932733 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-775920873 Jun 10 17:57:33.932733 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 1491b1558d9c4a22b4b9126644271d12 Jun 10 17:57:33.932733 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-775920873 Jun 10 17:57:33.932733 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-775920873-project-admin Jun 10 17:57:33.932733 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 17:57:33.932733 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 17:57:33.932733 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 0e61e2621d5a4739a9dff6e413a9996d Jun 10 17:57:33.932733 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-775920873-project-admin Jun 10 17:57:33.932733 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 17:57:33.932733 chdv-master-2 devstack@n-api.service[126594]: exception: Flavor 211027150 has no extra specs with key hw:cpu_thread_policy. Jun 10 17:57:33.933414 chdv-master-2 devstack@n-api.service[126594]: action_args: {'flavor_id': '211027150', 'id': 'hw:cpu_thread_policy'} Jun 10 17:57:33.933414 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:57:33.933414 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:57:33.933414 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Jun 10 17:57:33.933414 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Jun 10 17:57:33.933414 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jun 10 17:57:33.933414 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:57:33.933414 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:57:33.933414 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:57:33.933414 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:57:33.933414 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:57:33.933414 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:57:33.933414 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:57:33.933414 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:57:33.933414 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:57:33.933414 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:57:33.933414 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Jun 10 17:57:33.933414 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 10 17:57:33.933414 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 211027150 has no extra specs with key hw:cpu_thread_policy. Jun 10 17:57:33.933414 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:57:33.933414 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:57:33.933414 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:57:33.934567 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:57:33.934567 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:57:33.934567 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:57:33.934567 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:57:33.934567 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:57:33.934567 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 211027150 has no extra specs with key hw:cpu_thread_policy. Jun 10 17:57:33.934567 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:57:33.935431 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-253a46dc-9bf6-4e1a-8964-b9325828eddf tempest-FlavorsExtraSpecsNegativeTestJSON-775920873 tempest-FlavorsExtraSpecsNegativeTestJSON-775920873-project-admin] Returning 404 to user: Flavor 211027150 has no extra specs with key hw:cpu_thread_policy. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:57:33.936644 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-253a46dc-9bf6-4e1a-8964-b9325828eddf tempest-FlavorsExtraSpecsNegativeTestJSON-775920873 tempest-FlavorsExtraSpecsNegativeTestJSON-775920873-project-admin] 10.222.0.35 "DELETE /compute/v2.1/flavors/211027150/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.028990 Jun 10 17:57:33.937813 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 9/18] 10.222.0.35 () {58 vars in 1265 bytes} [Fri Jun 10 17:57:33 2022] DELETE /compute/v2.1/flavors/211027150/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:57:33.949387 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-06fd324f-dba1-44c3-bb14-94942532ce58 tempest-FlavorsExtraSpecsNegativeTestJSON-775920873 tempest-FlavorsExtraSpecsNegativeTestJSON-775920873-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:57:33.951833 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-06fd324f-dba1-44c3-bb14-94942532ce58 tempest-FlavorsExtraSpecsNegativeTestJSON-775920873 tempest-FlavorsExtraSpecsNegativeTestJSON-775920873-project-admin] HTTP exception thrown: Request body and URI mismatch Jun 10 17:57:33.953827 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-06fd324f-dba1-44c3-bb14-94942532ce58 tempest-FlavorsExtraSpecsNegativeTestJSON-775920873 tempest-FlavorsExtraSpecsNegativeTestJSON-775920873-project-admin] Request method failure captured: Jun 10 17:57:33.953827 chdv-master-2 devstack@n-api.service[126595]: request: PUT /compute/v2.1/flavors/211027150/os-extra_specs/hw:numa_nodes HTTP/1.1 Jun 10 17:57:33.953827 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 17:57:33.953827 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 17:57:33.953827 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 17:57:33.953827 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 27 Jun 10 17:57:33.953827 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 17:57:33.953827 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 17:57:33.953827 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 17:57:33.953827 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 17:57:33.953827 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4YKOCTDfiteP0_7MjyRLfLaJGZWE-pkh9nLHzbwHhCCv-wgGLQp8u-wXMtoqfFnwumfc7tPuTfLiUdb1BUo3lYbGigIRyoo-18XABFITApzR4oUm2b_TaLrCN4xg_qVXPse4OQd4NdMwRRi5E6Ioe9GV2SVfjm5-4HPZyG1s_0HuEU Jun 10 17:57:33.953827 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 17:57:33.953827 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 17:57:33.953827 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 17:57:33.953827 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 17:57:33.953827 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 17:57:33.953827 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 17:57:33.953827 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 1491b1558d9c4a22b4b9126644271d12 Jun 10 17:57:33.953827 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-775920873 Jun 10 17:57:33.953827 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member,admin Jun 10 17:57:33.953827 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member,admin Jun 10 17:57:33.954886 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1491b1558d9c4a22b4b9126644271d12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1491b1558d9c4a22b4b9126644271d12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1491b1558d9c4a22b4b9126644271d12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1491b1558d9c4a22b4b9126644271d12", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:57:33.954886 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-775920873 Jun 10 17:57:33.954886 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 1491b1558d9c4a22b4b9126644271d12 Jun 10 17:57:33.954886 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-775920873 Jun 10 17:57:33.954886 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-775920873-project-admin Jun 10 17:57:33.954886 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 17:57:33.954886 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 17:57:33.954886 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 0e61e2621d5a4739a9dff6e413a9996d Jun 10 17:57:33.954886 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-775920873-project-admin Jun 10 17:57:33.954886 chdv-master-2 devstack@n-api.service[126595]: Jun 10 17:57:33.954886 chdv-master-2 devstack@n-api.service[126595]: {"hw:cpu_policy": "shared"} Jun 10 17:57:33.954886 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 17:57:33.954886 chdv-master-2 devstack@n-api.service[126595]: exception: Request body and URI mismatch Jun 10 17:57:33.955567 chdv-master-2 devstack@n-api.service[126595]: action_args: {'flavor_id': '211027150', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Jun 10 17:57:33.955567 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:57:33.955567 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:57:33.955567 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:57:33.955567 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:57:33.955567 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:57:33.955567 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:57:33.955567 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:57:33.955567 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:57:33.955567 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 17:57:33.955567 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 17:57:33.955567 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Jun 10 17:57:33.955567 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Jun 10 17:57:33.955567 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Jun 10 17:57:33.955567 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:57:33.955567 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:57:33.955567 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:57:33.955567 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:57:33.955567 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:57:33.955567 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:57:33.960870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:57:33.960870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:57:33.960870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Jun 10 17:57:33.960870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:57:33.960870 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-06fd324f-dba1-44c3-bb14-94942532ce58 tempest-FlavorsExtraSpecsNegativeTestJSON-775920873 tempest-FlavorsExtraSpecsNegativeTestJSON-775920873-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:57:33.960870 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-06fd324f-dba1-44c3-bb14-94942532ce58 tempest-FlavorsExtraSpecsNegativeTestJSON-775920873 tempest-FlavorsExtraSpecsNegativeTestJSON-775920873-project-admin] 10.222.0.35 "PUT /compute/v2.1/flavors/211027150/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.012414 Jun 10 17:57:33.960870 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 10/19] 10.222.0.35 () {60 vars in 1261 bytes} [Fri Jun 10 17:57:33 2022] PUT /compute/v2.1/flavors/211027150/os-extra_specs/hw:numa_nodes => generated 73 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 10 17:57:33.973381 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e456d7cd-ce9b-4ada-b679-a084e5c0091f tempest-FlavorsExtraSpecsNegativeTestJSON-775920873 tempest-FlavorsExtraSpecsNegativeTestJSON-775920873-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:57:34.010370 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e456d7cd-ce9b-4ada-b679-a084e5c0091f tempest-FlavorsExtraSpecsNegativeTestJSON-775920873 tempest-FlavorsExtraSpecsNegativeTestJSON-775920873-project-admin] Request method failure captured: Jun 10 17:57:34.010370 chdv-master-2 devstack@n-api.service[126594]: request: PUT /compute/v2.1/flavors/211027150/os-extra_specs/hw:numa_nodes HTTP/1.1 Jun 10 17:57:34.010370 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 17:57:34.010370 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 17:57:34.010370 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 17:57:34.010370 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 49 Jun 10 17:57:34.010370 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 17:57:34.010370 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 17:57:34.010370 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 17:57:34.010370 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 17:57:34.010370 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4YKOCTDfiteP0_7MjyRLfLaJGZWE-pkh9nLHzbwHhCCv-wgGLQp8u-wXMtoqfFnwumfc7tPuTfLiUdb1BUo3lYbGigIRyoo-18XABFITApzR4oUm2b_TaLrCN4xg_qVXPse4OQd4NdMwRRi5E6Ioe9GV2SVfjm5-4HPZyG1s_0HuEU Jun 10 17:57:34.010370 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 17:57:34.010370 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 17:57:34.010370 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 17:57:34.010370 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 17:57:34.010370 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 17:57:34.010370 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 17:57:34.010370 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 1491b1558d9c4a22b4b9126644271d12 Jun 10 17:57:34.010370 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-775920873 Jun 10 17:57:34.010370 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member,admin Jun 10 17:57:34.010370 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member,admin Jun 10 17:57:34.011514 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1491b1558d9c4a22b4b9126644271d12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1491b1558d9c4a22b4b9126644271d12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1491b1558d9c4a22b4b9126644271d12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1491b1558d9c4a22b4b9126644271d12", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:57:34.011514 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-775920873 Jun 10 17:57:34.011514 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 1491b1558d9c4a22b4b9126644271d12 Jun 10 17:57:34.011514 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-775920873 Jun 10 17:57:34.011514 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-775920873-project-admin Jun 10 17:57:34.011514 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 17:57:34.011514 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 17:57:34.011514 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 0e61e2621d5a4739a9dff6e413a9996d Jun 10 17:57:34.011514 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-775920873-project-admin Jun 10 17:57:34.011514 chdv-master-2 devstack@n-api.service[126594]: Jun 10 17:57:34.011514 chdv-master-2 devstack@n-api.service[126594]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Jun 10 17:57:34.011514 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 17:57:34.012109 chdv-master-2 devstack@n-api.service[126594]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jun 10 17:57:34.012109 chdv-master-2 devstack@n-api.service[126594]: action_args: {'flavor_id': '211027150', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Jun 10 17:57:34.012109 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:57:34.012109 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:57:34.012109 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 10 17:57:34.012109 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 10 17:57:34.012109 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 10 17:57:34.012109 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise error Jun 10 17:57:34.012109 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jun 10 17:57:34.012109 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:57:34.012109 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Jun 10 17:57:34.012109 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 10 17:57:34.012109 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Jun 10 17:57:34.012109 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Jun 10 17:57:34.012109 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 10 17:57:34.012109 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi 'type': ['string', Jun 10 17:57:34.012109 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi 'number']}}, Jun 10 17:57:34.012109 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 10 17:57:34.012109 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:57:34.012109 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi On instance: Jun 10 17:57:34.012109 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Jun 10 17:57:34.012109 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:57:34.023384 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:57:34.023384 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:57:34.023384 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:57:34.023384 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:57:34.023384 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:57:34.023384 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:57:34.023384 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:57:34.023384 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:57:34.023384 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:57:34.023384 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 10 17:57:34.023384 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 10 17:57:34.023384 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 10 17:57:34.023384 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 10 17:57:34.023384 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 10 17:57:34.023384 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 10 17:57:34.023384 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jun 10 17:57:34.023384 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:57:34.023384 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:57:34.023384 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:57:34.023384 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:57:34.024395 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:57:34.024395 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:57:34.024395 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 10 17:57:34.024395 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 10 17:57:34.024395 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jun 10 17:57:34.024395 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:57:34.024395 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e456d7cd-ce9b-4ada-b679-a084e5c0091f tempest-FlavorsExtraSpecsNegativeTestJSON-775920873 tempest-FlavorsExtraSpecsNegativeTestJSON-775920873-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:57:34.024395 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e456d7cd-ce9b-4ada-b679-a084e5c0091f tempest-FlavorsExtraSpecsNegativeTestJSON-775920873 tempest-FlavorsExtraSpecsNegativeTestJSON-775920873-project-admin] 10.222.0.35 "PUT /compute/v2.1/flavors/211027150/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.048254 Jun 10 17:57:34.024395 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 10/20] 10.222.0.35 () {60 vars in 1261 bytes} [Fri Jun 10 17:57:33 2022] PUT /compute/v2.1/flavors/211027150/os-extra_specs/hw:numa_nodes => generated 117 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 10 17:57:34.028565 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-152eca8f-f3e3-49db-b55b-5f8910ebc6d5 tempest-FlavorsExtraSpecsNegativeTestJSON-775920873 tempest-FlavorsExtraSpecsNegativeTestJSON-775920873-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:34.029329 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:57:34.029329 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:57:34.179767 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-152eca8f-f3e3-49db-b55b-5f8910ebc6d5 tempest-FlavorsExtraSpecsNegativeTestJSON-775920873 tempest-FlavorsExtraSpecsNegativeTestJSON-775920873-project-admin] 10.222.0.35 "DELETE /compute/v2.1/flavors/211027150" status: 202 len: 0 microversion: 2.1 time: 0.157865 Jun 10 17:57:34.183367 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 11/21] 10.222.0.35 () {58 vars in 1157 bytes} [Fri Jun 10 17:57:34 2022] DELETE /compute/v2.1/flavors/211027150 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 17:57:34.189285 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-df611faa-baaf-4a67-8471-8f83640e4006 tempest-FlavorsExtraSpecsNegativeTestJSON-775920873 tempest-FlavorsExtraSpecsNegativeTestJSON-775920873-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:34.247720 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-df611faa-baaf-4a67-8471-8f83640e4006 tempest-FlavorsExtraSpecsNegativeTestJSON-775920873 tempest-FlavorsExtraSpecsNegativeTestJSON-775920873-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.062926 Jun 10 17:57:34.259338 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 11/22] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 17:57:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:34.708698 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a3e5f7da-a96d-4ba9-99ba-605e00467d04 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:34.709439 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a3e5f7da-a96d-4ba9-99ba-605e00467d04 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: c9b75acf-e4fe-425e-9398-40c4ac1a108b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:34.769648 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-857b2be2-2abd-4779-a75f-4feadd4dfc6d tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1015443380", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "availability_zone": "tempest-test_az-1221117119"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:57:34.791966 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-857b2be2-2abd-4779-a75f-4feadd4dfc6d tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:34.792479 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-857b2be2-2abd-4779-a75f-4feadd4dfc6d tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:34.793348 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-857b2be2-2abd-4779-a75f-4feadd4dfc6d tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:34.797488 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-857b2be2-2abd-4779-a75f-4feadd4dfc6d tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:34.923351 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-857b2be2-2abd-4779-a75f-4feadd4dfc6d tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] validate_networks() for None {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 17:57:35.286300 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-857b2be2-2abd-4779-a75f-4feadd4dfc6d tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 17:57:35.286734 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-857b2be2-2abd-4779-a75f-4feadd4dfc6d tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 17:57:35.287214 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-857b2be2-2abd-4779-a75f-4feadd4dfc6d tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 17:57:35.287623 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-857b2be2-2abd-4779-a75f-4feadd4dfc6d tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 17:57:35.288292 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-857b2be2-2abd-4779-a75f-4feadd4dfc6d tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 17:57:35.305249 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-857b2be2-2abd-4779-a75f-4feadd4dfc6d tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:35.306047 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-857b2be2-2abd-4779-a75f-4feadd4dfc6d tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:35.307256 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-857b2be2-2abd-4779-a75f-4feadd4dfc6d tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:35.307859 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-857b2be2-2abd-4779-a75f-4feadd4dfc6d tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:35.327340 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-857b2be2-2abd-4779-a75f-4feadd4dfc6d tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Getting quotas for project 066ae7d9e1564b91bbbaea7ff17dc789. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 17:57:35.331724 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-857b2be2-2abd-4779-a75f-4feadd4dfc6d tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Getting quotas for user 77dc782a65b645c7a534aabc90d09110 and project 066ae7d9e1564b91bbbaea7ff17dc789. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 17:57:35.344086 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-857b2be2-2abd-4779-a75f-4feadd4dfc6d tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 17:57:35.347337 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-857b2be2-2abd-4779-a75f-4feadd4dfc6d tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] [instance: 6467b83c-72e4-4991-a025-4690618f1115] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 17:57:35.500042 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-857b2be2-2abd-4779-a75f-4feadd4dfc6d tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.186757 Jun 10 17:57:35.501583 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 12/23] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:57:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 17:57:35.511091 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-57152c8f-b19b-4fe4-823d-a9c0fde424d7 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:35.511947 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-57152c8f-b19b-4fe4-823d-a9c0fde424d7 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] [instance: 6467b83c-72e4-4991-a025-4690618f1115] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:35.554784 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a3e5f7da-a96d-4ba9-99ba-605e00467d04 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:35.578912 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a3e5f7da-a96d-4ba9-99ba-605e00467d04 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b" status: 200 len: 1222 microversion: 2.1 time: 0.874655 Jun 10 17:57:35.588587 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 12/24] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:34 2022] GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b => generated 1222 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:57:35.635545 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-57152c8f-b19b-4fe4-823d-a9c0fde424d7 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77dc782a65b645c7a534aabc90d09110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066ae7d9e1564b91bbbaea7ff17dc789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:35.645399 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-57152c8f-b19b-4fe4-823d-a9c0fde424d7 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] 10.222.0.35 "GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115" status: 200 len: 1243 microversion: 2.1 time: 0.138075 Jun 10 17:57:35.647856 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 13/25] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:35 2022] GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115 => generated 1243 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:57:36.008564 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7d959e3f-cfbb-40d0-b008-6c67c58f3b86 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1210696291", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:57:36.124346 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-7d959e3f-cfbb-40d0-b008-6c67c58f3b86 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] validate_networks() for None {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 17:57:36.601734 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6a52a229-8977-40f4-9077-3bc0a2cefa4c tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:36.603889 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6a52a229-8977-40f4-9077-3bc0a2cefa4c tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: c9b75acf-e4fe-425e-9398-40c4ac1a108b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:36.616609 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a52a229-8977-40f4-9077-3bc0a2cefa4c tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:36.617368 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a52a229-8977-40f4-9077-3bc0a2cefa4c tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:36.620357 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a52a229-8977-40f4-9077-3bc0a2cefa4c tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:36.621050 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a52a229-8977-40f4-9077-3bc0a2cefa4c tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:36.713329 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-7d959e3f-cfbb-40d0-b008-6c67c58f3b86 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 17:57:36.713756 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-7d959e3f-cfbb-40d0-b008-6c67c58f3b86 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 17:57:36.714298 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-7d959e3f-cfbb-40d0-b008-6c67c58f3b86 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 17:57:36.714895 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-7d959e3f-cfbb-40d0-b008-6c67c58f3b86 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 17:57:36.715453 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-7d959e3f-cfbb-40d0-b008-6c67c58f3b86 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 17:57:36.730645 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7d959e3f-cfbb-40d0-b008-6c67c58f3b86 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:36.731288 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7d959e3f-cfbb-40d0-b008-6c67c58f3b86 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:36.732241 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7d959e3f-cfbb-40d0-b008-6c67c58f3b86 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:36.732863 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7d959e3f-cfbb-40d0-b008-6c67c58f3b86 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:36.770922 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-7d959e3f-cfbb-40d0-b008-6c67c58f3b86 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Getting quotas for project 175eeed60130438eaf02299dc72b708d. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 17:57:36.778934 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-7d959e3f-cfbb-40d0-b008-6c67c58f3b86 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Getting quotas for user 680f0e3161f74f139dae76fab34293bb and project 175eeed60130438eaf02299dc72b708d. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 17:57:36.812920 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7d959e3f-cfbb-40d0-b008-6c67c58f3b86 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 17:57:36.816459 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7d959e3f-cfbb-40d0-b008-6c67c58f3b86 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 4ef38095-36e0-4792-9516-caf76a5022c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 17:57:36.833850 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6a52a229-8977-40f4-9077-3bc0a2cefa4c tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:36.852672 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6a52a229-8977-40f4-9077-3bc0a2cefa4c tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b" status: 200 len: 1226 microversion: 2.1 time: 0.260216 Jun 10 17:57:36.853983 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 14/26] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:36 2022] GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b => generated 1226 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:57:36.859641 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-96c9717f-a2b7-4ec9-b1fd-212c1a744589 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:36.860459 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-96c9717f-a2b7-4ec9-b1fd-212c1a744589 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] [instance: 6467b83c-72e4-4991-a025-4690618f1115] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:36.924739 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-96c9717f-a2b7-4ec9-b1fd-212c1a744589 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77dc782a65b645c7a534aabc90d09110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066ae7d9e1564b91bbbaea7ff17dc789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:36.936732 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-96c9717f-a2b7-4ec9-b1fd-212c1a744589 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] 10.222.0.35 "GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115" status: 200 len: 1243 microversion: 2.1 time: 0.081383 Jun 10 17:57:36.937738 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 15/27] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:36 2022] GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115 => generated 1243 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:36.985689 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7d959e3f-cfbb-40d0-b008-6c67c58f3b86 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.282048 Jun 10 17:57:36.988295 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 13/28] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:57:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1286 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 17:57:36.998526 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-59b53fc0-6b55-4653-8c65-d55bf00317e3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:36.999428 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-59b53fc0-6b55-4653-8c65-d55bf00317e3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 4ef38095-36e0-4792-9516-caf76a5022c9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:37.105038 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-59b53fc0-6b55-4653-8c65-d55bf00317e3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:37.113862 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-59b53fc0-6b55-4653-8c65-d55bf00317e3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9" status: 200 len: 1220 microversion: 2.1 time: 0.119059 Jun 10 17:57:37.115560 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 16/29] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:36 2022] GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9 => generated 1220 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:37.879129 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f18e88ab-a59c-4cc0-9bc2-a0d585735290 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:37.880650 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f18e88ab-a59c-4cc0-9bc2-a0d585735290 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: c9b75acf-e4fe-425e-9398-40c4ac1a108b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:37.910984 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f18e88ab-a59c-4cc0-9bc2-a0d585735290 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:37.911607 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f18e88ab-a59c-4cc0-9bc2-a0d585735290 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:37.913041 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f18e88ab-a59c-4cc0-9bc2-a0d585735290 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:37.913497 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f18e88ab-a59c-4cc0-9bc2-a0d585735290 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:37.956398 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f979a3da-f84e-4973-ac2d-c71319d96cb0 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:37.957755 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f979a3da-f84e-4973-ac2d-c71319d96cb0 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] [instance: 6467b83c-72e4-4991-a025-4690618f1115] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:37.968205 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f979a3da-f84e-4973-ac2d-c71319d96cb0 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:37.973912 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f979a3da-f84e-4973-ac2d-c71319d96cb0 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:37.981204 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f979a3da-f84e-4973-ac2d-c71319d96cb0 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:37.981204 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f979a3da-f84e-4973-ac2d-c71319d96cb0 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:38.211146 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f979a3da-f84e-4973-ac2d-c71319d96cb0 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77dc782a65b645c7a534aabc90d09110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066ae7d9e1564b91bbbaea7ff17dc789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:38.224276 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f979a3da-f84e-4973-ac2d-c71319d96cb0 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] 10.222.0.35 "GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115" status: 200 len: 1235 microversion: 2.1 time: 0.272594 Jun 10 17:57:38.232817 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 17/30] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:37 2022] GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115 => generated 1235 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:38.250056 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-61fff03f-5091-4219-9cb8-8359f03c8b24 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:38.254569 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-61fff03f-5091-4219-9cb8-8359f03c8b24 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 4ef38095-36e0-4792-9516-caf76a5022c9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:38.344989 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f18e88ab-a59c-4cc0-9bc2-a0d585735290 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:38.358607 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f18e88ab-a59c-4cc0-9bc2-a0d585735290 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b" status: 200 len: 1282 microversion: 2.1 time: 0.488542 Jun 10 17:57:38.359493 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 14/31] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:37 2022] GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b => generated 1282 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:38.400689 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-61fff03f-5091-4219-9cb8-8359f03c8b24 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:38.414825 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-61fff03f-5091-4219-9cb8-8359f03c8b24 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9" status: 200 len: 1220 microversion: 2.1 time: 0.180819 Jun 10 17:57:38.416110 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 18/32] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:38 2022] GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9 => generated 1220 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:39.242144 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1a904781-f6ab-419d-91b3-fa1c11b195a5 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:39.250367 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1a904781-f6ab-419d-91b3-fa1c11b195a5 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] [instance: 6467b83c-72e4-4991-a025-4690618f1115] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:39.250518 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1a904781-f6ab-419d-91b3-fa1c11b195a5 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:39.251200 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1a904781-f6ab-419d-91b3-fa1c11b195a5 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:39.252795 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1a904781-f6ab-419d-91b3-fa1c11b195a5 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:39.253555 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1a904781-f6ab-419d-91b3-fa1c11b195a5 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:39.382723 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e60a10a6-b42e-4e89-84e4-1d7b10f5198b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:39.390294 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e60a10a6-b42e-4e89-84e4-1d7b10f5198b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: c9b75acf-e4fe-425e-9398-40c4ac1a108b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:39.433678 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e60a10a6-b42e-4e89-84e4-1d7b10f5198b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:39.434568 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e60a10a6-b42e-4e89-84e4-1d7b10f5198b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:39.435969 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e60a10a6-b42e-4e89-84e4-1d7b10f5198b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:39.436763 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e60a10a6-b42e-4e89-84e4-1d7b10f5198b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:39.497845 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1a904781-f6ab-419d-91b3-fa1c11b195a5 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77dc782a65b645c7a534aabc90d09110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066ae7d9e1564b91bbbaea7ff17dc789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:39.525748 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1a904781-f6ab-419d-91b3-fa1c11b195a5 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] 10.222.0.35 "GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115" status: 200 len: 1299 microversion: 2.1 time: 0.277727 Jun 10 17:57:39.537585 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 15/33] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:39 2022] GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115 => generated 1299 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:39.542844 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fb18af5c-e7bf-421f-8845-d5690147578c tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:39.547073 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fb18af5c-e7bf-421f-8845-d5690147578c tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 4ef38095-36e0-4792-9516-caf76a5022c9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:39.564079 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fb18af5c-e7bf-421f-8845-d5690147578c tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:39.575836 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fb18af5c-e7bf-421f-8845-d5690147578c tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:39.576955 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fb18af5c-e7bf-421f-8845-d5690147578c tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:39.578622 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fb18af5c-e7bf-421f-8845-d5690147578c tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:39.775781 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fb18af5c-e7bf-421f-8845-d5690147578c tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:39.792332 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e60a10a6-b42e-4e89-84e4-1d7b10f5198b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:39.794612 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fb18af5c-e7bf-421f-8845-d5690147578c tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9" status: 200 len: 1272 microversion: 2.1 time: 0.255493 Jun 10 17:57:39.807639 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e60a10a6-b42e-4e89-84e4-1d7b10f5198b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b" status: 200 len: 1280 microversion: 2.1 time: 0.436048 Jun 10 17:57:39.808199 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 19/34] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:39 2022] GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b => generated 1280 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:39.808820 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 16/35] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:39 2022] GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9 => generated 1272 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:40.543853 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a56ae062-52bc-416c-b797-472bf686a260 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:40.544594 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a56ae062-52bc-416c-b797-472bf686a260 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] [instance: 6467b83c-72e4-4991-a025-4690618f1115] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:40.557313 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a56ae062-52bc-416c-b797-472bf686a260 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:40.557770 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a56ae062-52bc-416c-b797-472bf686a260 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:40.558552 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a56ae062-52bc-416c-b797-472bf686a260 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:40.558991 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a56ae062-52bc-416c-b797-472bf686a260 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:40.827158 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-88d83997-c0e6-42e4-9b0d-da3c09ea1932 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:40.828695 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-88d83997-c0e6-42e4-9b0d-da3c09ea1932 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: c9b75acf-e4fe-425e-9398-40c4ac1a108b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:40.841036 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-88d83997-c0e6-42e4-9b0d-da3c09ea1932 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:40.842086 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-88d83997-c0e6-42e4-9b0d-da3c09ea1932 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:40.864602 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-88d83997-c0e6-42e4-9b0d-da3c09ea1932 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:40.864602 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-88d83997-c0e6-42e4-9b0d-da3c09ea1932 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:40.919566 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a56ae062-52bc-416c-b797-472bf686a260 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77dc782a65b645c7a534aabc90d09110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066ae7d9e1564b91bbbaea7ff17dc789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:40.934399 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a56ae062-52bc-416c-b797-472bf686a260 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] 10.222.0.35 "GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115" status: 200 len: 1297 microversion: 2.1 time: 0.389441 Jun 10 17:57:40.935206 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 17/36] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:40 2022] GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115 => generated 1297 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:40.956236 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-19d56697-1afa-4062-b055-ff8f98eb02ab tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:40.966933 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-19d56697-1afa-4062-b055-ff8f98eb02ab tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 4ef38095-36e0-4792-9516-caf76a5022c9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:41.005970 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-19d56697-1afa-4062-b055-ff8f98eb02ab tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:41.010413 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-19d56697-1afa-4062-b055-ff8f98eb02ab tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:41.010413 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-19d56697-1afa-4062-b055-ff8f98eb02ab tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:41.010413 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-19d56697-1afa-4062-b055-ff8f98eb02ab tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:41.286679 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-19d56697-1afa-4062-b055-ff8f98eb02ab tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:41.295086 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-19d56697-1afa-4062-b055-ff8f98eb02ab tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9" status: 200 len: 1278 microversion: 2.1 time: 0.343779 Jun 10 17:57:41.295734 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 18/37] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:40 2022] GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9 => generated 1278 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:41.477680 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-88d83997-c0e6-42e4-9b0d-da3c09ea1932 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:41.483845 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-88d83997-c0e6-42e4-9b0d-da3c09ea1932 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b" status: 200 len: 1322 microversion: 2.1 time: 0.662064 Jun 10 17:57:41.486817 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 20/38] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:40 2022] GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b => generated 1322 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:42.018740 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8bfec017-85c8-4841-81c6-2b59b17cae39 tempest-FlavorsAccessTestJSON-1988454270 tempest-FlavorsAccessTestJSON-1988454270-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-102226253", "id": 780498142, "os-flavor-access:is_public": "False"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:57:42.018740 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:57:42.018740 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:57:42.088653 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8bfec017-85c8-4841-81c6-2b59b17cae39 tempest-FlavorsAccessTestJSON-1988454270 tempest-FlavorsAccessTestJSON-1988454270-project-admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.531919 Jun 10 17:57:42.089546 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 19/39] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:57:41 2022] POST /compute/v2.1/flavors => generated 427 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:57:42.097787 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-05bf3b6a-56d6-4c2d-a506-e220456bd2fc tempest-FlavorMetadataValidation-1350135133 tempest-FlavorMetadataValidation-1350135133-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-2145267800", "id": 1584031445, "os-flavor-access:is_public": "True"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:57:42.099313 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:57:42.099313 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:57:42.118884 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-953d8ef3-01dc-487c-8c4e-0bd8494c84af tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:42.126857 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-953d8ef3-01dc-487c-8c4e-0bd8494c84af tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] [instance: 6467b83c-72e4-4991-a025-4690618f1115] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:42.146321 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-953d8ef3-01dc-487c-8c4e-0bd8494c84af tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:42.147082 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-953d8ef3-01dc-487c-8c4e-0bd8494c84af tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:42.149937 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-953d8ef3-01dc-487c-8c4e-0bd8494c84af tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:42.159592 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-953d8ef3-01dc-487c-8c4e-0bd8494c84af tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:42.217568 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-05bf3b6a-56d6-4c2d-a506-e220456bd2fc tempest-FlavorMetadataValidation-1350135133 tempest-FlavorMetadataValidation-1350135133-project-admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.453637 Jun 10 17:57:42.221108 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 21/40] 10.222.0.35 () {62 vars in 1187 bytes} [Fri Jun 10 17:57:41 2022] POST /compute/v2.1/flavors => generated 471 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 10 17:57:42.232173 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c7747c36-0e79-4013-8463-d3906dee0c70 tempest-FlavorsAccessTestJSON-1988454270 tempest-FlavorsAccessTestJSON-1988454270-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0c6b88e62e234dc5978a4162ae1c286b"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:57:42.233593 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:57:42.233593 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:57:42.446156 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-953d8ef3-01dc-487c-8c4e-0bd8494c84af tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77dc782a65b645c7a534aabc90d09110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066ae7d9e1564b91bbbaea7ff17dc789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:42.467994 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-953d8ef3-01dc-487c-8c4e-0bd8494c84af tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] 10.222.0.35 "GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115" status: 200 len: 1297 microversion: 2.1 time: 0.359541 Jun 10 17:57:42.472459 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 20/41] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:42 2022] GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115 => generated 1297 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:42.481348 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-694ed049-a4a2-4b70-bb0b-6170d7a3d872 tempest-FlavorMetadataValidation-1350135133 tempest-FlavorMetadataValidation-1350135133-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:57:42.487688 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:57:42.487688 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:57:42.661462 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c7747c36-0e79-4013-8463-d3906dee0c70 tempest-FlavorsAccessTestJSON-1988454270 tempest-FlavorsAccessTestJSON-1988454270-project-admin] 10.222.0.35 "POST /compute/v2.1/flavors/780498142/action" status: 200 len: 96 microversion: 2.1 time: 0.438982 Jun 10 17:57:42.662083 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 22/42] 10.222.0.35 () {60 vars in 1196 bytes} [Fri Jun 10 17:57:42 2022] POST /compute/v2.1/flavors/780498142/action => generated 96 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 17:57:42.671266 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-98e7451c-fbaf-4be7-b78b-20e735935cd7 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:42.679082 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-98e7451c-fbaf-4be7-b78b-20e735935cd7 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 4ef38095-36e0-4792-9516-caf76a5022c9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:42.694031 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=10,nova_api:DELETE=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:57:42.703404 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-98e7451c-fbaf-4be7-b78b-20e735935cd7 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:42.703881 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-98e7451c-fbaf-4be7-b78b-20e735935cd7 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:42.709123 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-98e7451c-fbaf-4be7-b78b-20e735935cd7 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:42.712568 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-98e7451c-fbaf-4be7-b78b-20e735935cd7 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:42.862300 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=10,nova_api:SAVEPOINT=6,nova_api:RELEASE=5 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:57:42.940864 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-98e7451c-fbaf-4be7-b78b-20e735935cd7 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:42.955205 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-98e7451c-fbaf-4be7-b78b-20e735935cd7 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9" status: 200 len: 1278 microversion: 2.1 time: 0.289849 Jun 10 17:57:42.957577 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 23/43] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:42 2022] GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9 => generated 1278 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:42.973290 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-694ed049-a4a2-4b70-bb0b-6170d7a3d872 tempest-FlavorMetadataValidation-1350135133 tempest-FlavorMetadataValidation-1350135133-project-admin] 10.222.0.35 "POST /compute/v2.1/flavors/1584031445/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.498940 Jun 10 17:57:42.974437 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 21/44] 10.222.0.35 () {62 vars in 1264 bytes} [Fri Jun 10 17:57:42 2022] POST /compute/v2.1/flavors/1584031445/os-extra_specs => generated 62 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:42.976808 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b92bc7b1-95d8-4a74-b551-b150f17bba73 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:42.978459 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b92bc7b1-95d8-4a74-b551-b150f17bba73 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: c9b75acf-e4fe-425e-9398-40c4ac1a108b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:42.991297 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b92bc7b1-95d8-4a74-b551-b150f17bba73 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:42.991978 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b92bc7b1-95d8-4a74-b551-b150f17bba73 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:42.992956 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b92bc7b1-95d8-4a74-b551-b150f17bba73 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:42.993681 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b92bc7b1-95d8-4a74-b551-b150f17bba73 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:43.395212 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b92bc7b1-95d8-4a74-b551-b150f17bba73 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:43.412069 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b92bc7b1-95d8-4a74-b551-b150f17bba73 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b" status: 200 len: 1322 microversion: 2.1 time: 0.449824 Jun 10 17:57:43.413622 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 24/45] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:42 2022] GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b => generated 1322 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:43.427242 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ba23382e-3d71-4b46-a720-16a74e562bdd tempest-FlavorMetadataValidation-1350135133 tempest-FlavorMetadataValidation-1350135133-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:43.430586 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:57:43.430586 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:57:43.458442 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5ef80a46-02f7-4f90-8cd4-ed532d8b0a74 tempest-FlavorsAccessTestJSON-568464589 tempest-FlavorsAccessTestJSON-568464589-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:43.548024 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5ef80a46-02f7-4f90-8cd4-ed532d8b0a74 tempest-FlavorsAccessTestJSON-568464589 tempest-FlavorsAccessTestJSON-568464589-project] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 5830 microversion: 2.1 time: 0.571051 Jun 10 17:57:43.551697 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 22/46] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 17:57:42 2022] GET /compute/v2.1/flavors/detail => generated 5830 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:43.564582 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7ce50283-0e25-4b43-a19d-b14f6da0e23c tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:43.567684 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7ce50283-0e25-4b43-a19d-b14f6da0e23c tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] [instance: 6467b83c-72e4-4991-a025-4690618f1115] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:43.568184 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ba23382e-3d71-4b46-a720-16a74e562bdd tempest-FlavorMetadataValidation-1350135133 tempest-FlavorMetadataValidation-1350135133-project-admin] 10.222.0.35 "DELETE /compute/v2.1/flavors/1584031445" status: 202 len: 0 microversion: 2.86 time: 0.152970 Jun 10 17:57:43.570121 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 25/47] 10.222.0.35 () {60 vars in 1201 bytes} [Fri Jun 10 17:57:43 2022] DELETE /compute/v2.1/flavors/1584031445 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 10 17:57:43.578284 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7496863f-d1e2-419d-9a1f-22767fe69c84 tempest-FlavorsAccessTestJSON-1988454270 tempest-FlavorsAccessTestJSON-1988454270-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "0c6b88e62e234dc5978a4162ae1c286b"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:57:43.583092 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:57:43.583092 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:57:43.586665 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ce50283-0e25-4b43-a19d-b14f6da0e23c tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:43.589589 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ce50283-0e25-4b43-a19d-b14f6da0e23c tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:43.592195 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ce50283-0e25-4b43-a19d-b14f6da0e23c tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:43.592849 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ce50283-0e25-4b43-a19d-b14f6da0e23c tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:44.218314 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7496863f-d1e2-419d-9a1f-22767fe69c84 tempest-FlavorsAccessTestJSON-1988454270 tempest-FlavorsAccessTestJSON-1988454270-project-admin] 10.222.0.35 "POST /compute/v2.1/flavors/780498142/action" status: 200 len: 21 microversion: 2.1 time: 0.646651 Jun 10 17:57:44.227591 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 26/48] 10.222.0.35 () {60 vars in 1196 bytes} [Fri Jun 10 17:57:43 2022] POST /compute/v2.1/flavors/780498142/action => generated 21 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 17:57:44.237986 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-beeb3868-01e1-4799-9841-8fa9a2f8ff90 tempest-FlavorMetadataValidation-1350135133 tempest-FlavorMetadataValidation-1350135133-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:44.325635 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-beeb3868-01e1-4799-9841-8fa9a2f8ff90 tempest-FlavorMetadataValidation-1350135133 tempest-FlavorMetadataValidation-1350135133-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.099964 Jun 10 17:57:44.330356 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 27/49] 10.222.0.35 () {60 vars in 1186 bytes} [Fri Jun 10 17:57:44 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 17:57:44.342761 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b640642e-d121-4297-9109-a192a0729a76 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:44.344682 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b640642e-d121-4297-9109-a192a0729a76 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 4ef38095-36e0-4792-9516-caf76a5022c9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:44.384032 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b640642e-d121-4297-9109-a192a0729a76 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:44.385525 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b640642e-d121-4297-9109-a192a0729a76 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:44.390034 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b640642e-d121-4297-9109-a192a0729a76 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:44.390601 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b640642e-d121-4297-9109-a192a0729a76 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:44.576606 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7ce50283-0e25-4b43-a19d-b14f6da0e23c tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77dc782a65b645c7a534aabc90d09110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066ae7d9e1564b91bbbaea7ff17dc789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:44.591565 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7ce50283-0e25-4b43-a19d-b14f6da0e23c tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] 10.222.0.35 "GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115" status: 200 len: 1339 microversion: 2.1 time: 1.037553 Jun 10 17:57:44.597737 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 23/50] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:43 2022] GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115 => generated 1339 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:44.608836 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ff8553a4-c250-4304-9c7c-6812ea68fd15 tempest-FlavorsAccessTestJSON-568464589 tempest-FlavorsAccessTestJSON-568464589-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:44.665797 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ff8553a4-c250-4304-9c7c-6812ea68fd15 tempest-FlavorsAccessTestJSON-568464589 tempest-FlavorsAccessTestJSON-568464589-project] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064468 Jun 10 17:57:44.669014 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 24/51] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 17:57:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:44.677651 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ab9760c4-3f08-42be-bb5d-3bca6b40abf4 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:44.678611 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ab9760c4-3f08-42be-bb5d-3bca6b40abf4 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: c9b75acf-e4fe-425e-9398-40c4ac1a108b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:44.686520 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ab9760c4-3f08-42be-bb5d-3bca6b40abf4 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:44.687298 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ab9760c4-3f08-42be-bb5d-3bca6b40abf4 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:44.688272 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ab9760c4-3f08-42be-bb5d-3bca6b40abf4 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:44.690631 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ab9760c4-3f08-42be-bb5d-3bca6b40abf4 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:45.210624 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b640642e-d121-4297-9109-a192a0729a76 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:45.210624 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b640642e-d121-4297-9109-a192a0729a76 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9" status: 200 len: 1320 microversion: 2.1 time: 0.862347 Jun 10 17:57:45.210624 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 28/52] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:44 2022] GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9 => generated 1320 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:45.317255 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=8 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:57:45.969357 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ab9760c4-3f08-42be-bb5d-3bca6b40abf4 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:45.980017 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ab9760c4-3f08-42be-bb5d-3bca6b40abf4 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b" status: 200 len: 1322 microversion: 2.1 time: 1.309399 Jun 10 17:57:45.981866 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8dc0cbef-5761-461e-8995-203dc1e0d221 tempest-HypervisorAdminUnderV252Test-1256019855 tempest-HypervisorAdminUnderV252Test-1256019855-project-admin] Calling method '.version_select at 0x7f77c1ec1430>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:45.983027 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:57:45.983027 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:57:45.984276 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8dc0cbef-5761-461e-8995-203dc1e0d221 tempest-HypervisorAdminUnderV252Test-1256019855 tempest-HypervisorAdminUnderV252Test-1256019855-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:45.984691 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8dc0cbef-5761-461e-8995-203dc1e0d221 tempest-HypervisorAdminUnderV252Test-1256019855 tempest-HypervisorAdminUnderV252Test-1256019855-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:45.995110 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 25/53] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:44 2022] GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b => generated 1322 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:46.008976 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-814ea911-e2ff-4915-99f4-6b13016ef26e tempest-FlavorsAccessTestJSON-1988454270 tempest-FlavorsAccessTestJSON-1988454270-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:46.009832 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:57:46.009832 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:57:46.034734 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8dc0cbef-5761-461e-8995-203dc1e0d221 tempest-HypervisorAdminUnderV252Test-1256019855 tempest-HypervisorAdminUnderV252Test-1256019855-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:46.035883 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8dc0cbef-5761-461e-8995-203dc1e0d221 tempest-HypervisorAdminUnderV252Test-1256019855 tempest-HypervisorAdminUnderV252Test-1256019855-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:46.066469 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8dc0cbef-5761-461e-8995-203dc1e0d221 tempest-HypervisorAdminUnderV252Test-1256019855 tempest-HypervisorAdminUnderV252Test-1256019855-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:46.066962 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8dc0cbef-5761-461e-8995-203dc1e0d221 tempest-HypervisorAdminUnderV252Test-1256019855 tempest-HypervisorAdminUnderV252Test-1256019855-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:46.077826 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8dc0cbef-5761-461e-8995-203dc1e0d221 tempest-HypervisorAdminUnderV252Test-1256019855 tempest-HypervisorAdminUnderV252Test-1256019855-project-admin] 10.222.0.35 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.876309 Jun 10 17:57:46.078800 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 29/54] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 17:57:45 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:57:46.084214 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-997055c9-a6c6-46b0-9192-c85ac18da528 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:46.084926 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-997055c9-a6c6-46b0-9192-c85ac18da528 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] [instance: 6467b83c-72e4-4991-a025-4690618f1115] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:46.092987 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-997055c9-a6c6-46b0-9192-c85ac18da528 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:46.095789 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-997055c9-a6c6-46b0-9192-c85ac18da528 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:46.095789 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-997055c9-a6c6-46b0-9192-c85ac18da528 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:46.095789 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-997055c9-a6c6-46b0-9192-c85ac18da528 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:46.202368 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-814ea911-e2ff-4915-99f4-6b13016ef26e tempest-FlavorsAccessTestJSON-1988454270 tempest-FlavorsAccessTestJSON-1988454270-project-admin] 10.222.0.35 "DELETE /compute/v2.1/flavors/780498142" status: 202 len: 0 microversion: 2.1 time: 0.208029 Jun 10 17:57:46.206948 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 26/55] 10.222.0.35 () {58 vars in 1157 bytes} [Fri Jun 10 17:57:45 2022] DELETE /compute/v2.1/flavors/780498142 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 17:57:46.213802 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f45e6184-7094-4338-9060-38b7f9f4a5fe tempest-HypervisorAdminUnderV252Test-1256019855 tempest-HypervisorAdminUnderV252Test-1256019855-project-admin] Calling method '.version_select at 0x7f77c1d6bca0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:46.221618 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:57:46.221618 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:57:46.221618 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f45e6184-7094-4338-9060-38b7f9f4a5fe tempest-HypervisorAdminUnderV252Test-1256019855 tempest-HypervisorAdminUnderV252Test-1256019855-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:46.221618 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f45e6184-7094-4338-9060-38b7f9f4a5fe tempest-HypervisorAdminUnderV252Test-1256019855 tempest-HypervisorAdminUnderV252Test-1256019855-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:46.260589 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f45e6184-7094-4338-9060-38b7f9f4a5fe tempest-HypervisorAdminUnderV252Test-1256019855 tempest-HypervisorAdminUnderV252Test-1256019855-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:46.261443 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f45e6184-7094-4338-9060-38b7f9f4a5fe tempest-HypervisorAdminUnderV252Test-1256019855 tempest-HypervisorAdminUnderV252Test-1256019855-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:46.336435 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f45e6184-7094-4338-9060-38b7f9f4a5fe tempest-HypervisorAdminUnderV252Test-1256019855 tempest-HypervisorAdminUnderV252Test-1256019855-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:46.336980 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f45e6184-7094-4338-9060-38b7f9f4a5fe tempest-HypervisorAdminUnderV252Test-1256019855 tempest-HypervisorAdminUnderV252Test-1256019855-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:46.354408 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f45e6184-7094-4338-9060-38b7f9f4a5fe tempest-HypervisorAdminUnderV252Test-1256019855 tempest-HypervisorAdminUnderV252Test-1256019855-project-admin] 10.222.0.35 "GET /compute/v2.1/os-hypervisors/chh1-master-2/servers" status: 200 len: 196 microversion: 2.1 time: 0.145772 Jun 10 17:57:46.356080 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 27/56] 10.222.0.35 () {58 vars in 1211 bytes} [Fri Jun 10 17:57:46 2022] GET /compute/v2.1/os-hypervisors/chh1-master-2/servers => generated 196 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:57:46.467534 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-9ed33c6f-a4d3-44e3-826e-b516f57a83d2 req-b22a1013-4063-4145-a322-cd7fc56132d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9b75acf-e4fe-425e-9398-40c4ac1a108b", "tag": "7d50bd88-4d71-4153-a03a-78aa249d08c5"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:57:46.502541 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-9ed33c6f-a4d3-44e3-826e-b516f57a83d2 req-b22a1013-4063-4145-a322-cd7fc56132d0 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:46.503152 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-9ed33c6f-a4d3-44e3-826e-b516f57a83d2 req-b22a1013-4063-4145-a322-cd7fc56132d0 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:46.551260 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-9ed33c6f-a4d3-44e3-826e-b516f57a83d2 req-b22a1013-4063-4145-a322-cd7fc56132d0 service nova] Creating event network-changed:7d50bd88-4d71-4153-a03a-78aa249d08c5 for instance c9b75acf-e4fe-425e-9398-40c4ac1a108b on chh2-master-2 Jun 10 17:57:46.553377 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-9ed33c6f-a4d3-44e3-826e-b516f57a83d2 req-b22a1013-4063-4145-a322-cd7fc56132d0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=126594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 10 17:57:46.565172 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5490b09-1cce-4f1b-b82f-cdb1584003ae None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:46.565172 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5490b09-1cce-4f1b-b82f-cdb1584003ae None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:46.569645 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5490b09-1cce-4f1b-b82f-cdb1584003ae None None] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:46.571827 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5490b09-1cce-4f1b-b82f-cdb1584003ae None None] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:46.591497 chdv-master-2 devstack@n-api.service[126594]: INFO nova.compute.rpcapi [None req-b5490b09-1cce-4f1b-b82f-cdb1584003ae None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 10 17:57:46.595443 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5490b09-1cce-4f1b-b82f-cdb1584003ae None None] Releasing lock "compute-rpcapi-router" {{(pid=126594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 10 17:57:46.615189 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b5490b09-1cce-4f1b-b82f-cdb1584003ae None None] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.257490 Jun 10 17:57:46.616602 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 28/57] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:57:46.622171 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ca8a698b-73ac-4134-ae32-62a7e03444b0 tempest-FlavorsAccessTestJSON-1988454270 tempest-FlavorsAccessTestJSON-1988454270-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:46.645092 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ca8a698b-73ac-4134-ae32-62a7e03444b0 tempest-FlavorsAccessTestJSON-1988454270 tempest-FlavorsAccessTestJSON-1988454270-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026793 Jun 10 17:57:46.646462 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 29/58] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 17:57:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:46.651722 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-889f821d-4a96-4858-af4c-0c337544a1b9 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:46.652953 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-889f821d-4a96-4858-af4c-0c337544a1b9 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 4ef38095-36e0-4792-9516-caf76a5022c9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:46.663177 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-889f821d-4a96-4858-af4c-0c337544a1b9 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:46.663975 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-889f821d-4a96-4858-af4c-0c337544a1b9 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:46.665590 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-889f821d-4a96-4858-af4c-0c337544a1b9 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:46.666314 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-889f821d-4a96-4858-af4c-0c337544a1b9 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:46.789337 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=8 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:57:46.982736 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-889f821d-4a96-4858-af4c-0c337544a1b9 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:46.993130 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-889f821d-4a96-4858-af4c-0c337544a1b9 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9" status: 200 len: 1320 microversion: 2.1 time: 0.345259 Jun 10 17:57:47.006250 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 30/59] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:46 2022] GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9 => generated 1320 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:47.009379 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e2aa7676-66a3-4031-9163-b1acd5da6b35 tempest-HypervisorAdminUnderV252Test-1256019855 tempest-HypervisorAdminUnderV252Test-1256019855-project-admin] Calling method '.version_select at 0x7f77c1c649d0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:47.010978 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:57:47.010978 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:57:47.013760 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e2aa7676-66a3-4031-9163-b1acd5da6b35 tempest-HypervisorAdminUnderV252Test-1256019855 tempest-HypervisorAdminUnderV252Test-1256019855-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:47.015826 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e2aa7676-66a3-4031-9163-b1acd5da6b35 tempest-HypervisorAdminUnderV252Test-1256019855 tempest-HypervisorAdminUnderV252Test-1256019855-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:47.075614 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e2aa7676-66a3-4031-9163-b1acd5da6b35 tempest-HypervisorAdminUnderV252Test-1256019855 tempest-HypervisorAdminUnderV252Test-1256019855-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:47.079976 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e2aa7676-66a3-4031-9163-b1acd5da6b35 tempest-HypervisorAdminUnderV252Test-1256019855 tempest-HypervisorAdminUnderV252Test-1256019855-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:47.123272 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e2aa7676-66a3-4031-9163-b1acd5da6b35 tempest-HypervisorAdminUnderV252Test-1256019855 tempest-HypervisorAdminUnderV252Test-1256019855-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:47.123272 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e2aa7676-66a3-4031-9163-b1acd5da6b35 tempest-HypervisorAdminUnderV252Test-1256019855 tempest-HypervisorAdminUnderV252Test-1256019855-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:47.129778 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e2aa7676-66a3-4031-9163-b1acd5da6b35 tempest-HypervisorAdminUnderV252Test-1256019855 tempest-HypervisorAdminUnderV252Test-1256019855-project-admin] 10.222.0.35 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.128546 Jun 10 17:57:47.132120 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 31/60] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 17:57:46 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:57:47.145596 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-277d5d8c-9407-4819-8eca-9411a7e0ce3f tempest-FlavorsAccessTestJSON-1988454270 tempest-FlavorsAccessTestJSON-1988454270-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1512094598", "id": 1117389413, "os-flavor-access:is_public": "False"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:57:47.181533 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:57:47.181533 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:57:47.270596 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-277d5d8c-9407-4819-8eca-9411a7e0ce3f tempest-FlavorsAccessTestJSON-1988454270 tempest-FlavorsAccessTestJSON-1988454270-project-admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.137155 Jun 10 17:57:47.274239 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 32/61] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:57:47 2022] POST /compute/v2.1/flavors => generated 431 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:57:47.306462 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c5feba35-eb04-4bb2-b190-62af067fca5b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:47.308036 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c5feba35-eb04-4bb2-b190-62af067fca5b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: c9b75acf-e4fe-425e-9398-40c4ac1a108b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:47.349841 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5feba35-eb04-4bb2-b190-62af067fca5b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:47.354157 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5feba35-eb04-4bb2-b190-62af067fca5b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:47.355770 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5feba35-eb04-4bb2-b190-62af067fca5b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:47.360236 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5feba35-eb04-4bb2-b190-62af067fca5b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:47.450559 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-997055c9-a6c6-46b0-9192-c85ac18da528 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77dc782a65b645c7a534aabc90d09110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066ae7d9e1564b91bbbaea7ff17dc789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:47.472226 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-997055c9-a6c6-46b0-9192-c85ac18da528 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] 10.222.0.35 "GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115" status: 200 len: 1339 microversion: 2.1 time: 1.389357 Jun 10 17:57:47.474238 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 30/62] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:46 2022] GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115 => generated 1339 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:47.488438 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5dc7f1f4-38c7-4e31-9634-c2dc3eebbfd1 tempest-HypervisorAdminUnderV252Test-1256019855 tempest-HypervisorAdminUnderV252Test-1256019855-project-admin] Calling method '.version_select at 0x7f77c1e471f0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:47.491260 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:57:47.491260 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:57:47.511363 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5dc7f1f4-38c7-4e31-9634-c2dc3eebbfd1 tempest-HypervisorAdminUnderV252Test-1256019855 tempest-HypervisorAdminUnderV252Test-1256019855-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:47.512967 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5dc7f1f4-38c7-4e31-9634-c2dc3eebbfd1 tempest-HypervisorAdminUnderV252Test-1256019855 tempest-HypervisorAdminUnderV252Test-1256019855-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:47.573589 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5dc7f1f4-38c7-4e31-9634-c2dc3eebbfd1 tempest-HypervisorAdminUnderV252Test-1256019855 tempest-HypervisorAdminUnderV252Test-1256019855-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:47.574107 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5dc7f1f4-38c7-4e31-9634-c2dc3eebbfd1 tempest-HypervisorAdminUnderV252Test-1256019855 tempest-HypervisorAdminUnderV252Test-1256019855-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:47.590032 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5dc7f1f4-38c7-4e31-9634-c2dc3eebbfd1 tempest-HypervisorAdminUnderV252Test-1256019855 tempest-HypervisorAdminUnderV252Test-1256019855-project-admin] 10.222.0.35 "GET /compute/v2.1/os-hypervisors/chh1-master-2/search" status: 200 len: 104 microversion: 2.1 time: 0.112339 Jun 10 17:57:47.598941 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 31/63] 10.222.0.35 () {58 vars in 1208 bytes} [Fri Jun 10 17:57:47 2022] GET /compute/v2.1/os-hypervisors/chh1-master-2/search => generated 104 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:57:47.608135 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-12648f83-c965-44ec-81c7-031397c0141c tempest-FlavorsAccessTestJSON-1988454270 tempest-FlavorsAccessTestJSON-1988454270-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:47.609039 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:57:47.609039 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:57:47.649087 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-12648f83-c965-44ec-81c7-031397c0141c tempest-FlavorsAccessTestJSON-1988454270 tempest-FlavorsAccessTestJSON-1988454270-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/1117389413/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.052727 Jun 10 17:57:47.656087 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 32/64] 10.222.0.35 () {58 vars in 1208 bytes} [Fri Jun 10 17:57:47 2022] GET /compute/v2.1/flavors/1117389413/os-flavor-access => generated 21 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 17:57:47.672101 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-639f4f71-679e-4c55-b0a3-9ef4a8003902 tempest-FlavorsAccessTestJSON-1988454270 tempest-FlavorsAccessTestJSON-1988454270-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:47.676626 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:57:47.676626 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:57:47.780589 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-639f4f71-679e-4c55-b0a3-9ef4a8003902 tempest-FlavorsAccessTestJSON-1988454270 tempest-FlavorsAccessTestJSON-1988454270-project-admin] 10.222.0.35 "DELETE /compute/v2.1/flavors/1117389413" status: 202 len: 0 microversion: 2.1 time: 0.118906 Jun 10 17:57:47.785065 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 33/65] 10.222.0.35 () {58 vars in 1160 bytes} [Fri Jun 10 17:57:47 2022] DELETE /compute/v2.1/flavors/1117389413 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 17:57:47.794355 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8b0e3e07-0e0c-4f6f-85e6-a5e06b9002c5 tempest-FlavorsAccessTestJSON-1988454270 tempest-FlavorsAccessTestJSON-1988454270-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:47.863280 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8b0e3e07-0e0c-4f6f-85e6-a5e06b9002c5 tempest-FlavorsAccessTestJSON-1988454270 tempest-FlavorsAccessTestJSON-1988454270-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.075171 Jun 10 17:57:47.863879 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 34/66] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 17:57:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:48.020070 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-699c55ad-e970-474b-98ee-95c6f039a083 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:48.020431 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-699c55ad-e970-474b-98ee-95c6f039a083 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 4ef38095-36e0-4792-9516-caf76a5022c9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:48.046100 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-699c55ad-e970-474b-98ee-95c6f039a083 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:48.049981 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-699c55ad-e970-474b-98ee-95c6f039a083 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:48.050906 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-699c55ad-e970-474b-98ee-95c6f039a083 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:48.052884 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-699c55ad-e970-474b-98ee-95c6f039a083 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:48.264846 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c5feba35-eb04-4bb2-b190-62af067fca5b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:48.279878 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c5feba35-eb04-4bb2-b190-62af067fca5b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b" status: 200 len: 1322 microversion: 2.1 time: 0.996915 Jun 10 17:57:48.285525 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 33/67] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:47 2022] GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b => generated 1322 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:48.404776 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=22 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:57:48.488936 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a24d5bdb-20cd-495a-b68a-903d06d9f960 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:48.489894 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a24d5bdb-20cd-495a-b68a-903d06d9f960 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] [instance: 6467b83c-72e4-4991-a025-4690618f1115] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:48.499255 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a24d5bdb-20cd-495a-b68a-903d06d9f960 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:48.500890 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a24d5bdb-20cd-495a-b68a-903d06d9f960 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:48.503899 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a24d5bdb-20cd-495a-b68a-903d06d9f960 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:48.505644 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a24d5bdb-20cd-495a-b68a-903d06d9f960 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:49.151425 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-699c55ad-e970-474b-98ee-95c6f039a083 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:49.169222 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-699c55ad-e970-474b-98ee-95c6f039a083 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9" status: 200 len: 1320 microversion: 2.1 time: 1.157785 Jun 10 17:57:49.182566 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 35/68] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:48 2022] GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9 => generated 1320 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:49.240253 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a24d5bdb-20cd-495a-b68a-903d06d9f960 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77dc782a65b645c7a534aabc90d09110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066ae7d9e1564b91bbbaea7ff17dc789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:49.253623 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a24d5bdb-20cd-495a-b68a-903d06d9f960 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] 10.222.0.35 "GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115" status: 200 len: 1339 microversion: 2.1 time: 0.770411 Jun 10 17:57:49.256527 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 34/69] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:48 2022] GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115 => generated 1339 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:57:49.302297 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8fe4a31e-22f5-4edd-ab35-f73598efe27a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:49.303461 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8fe4a31e-22f5-4edd-ab35-f73598efe27a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: c9b75acf-e4fe-425e-9398-40c4ac1a108b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:49.316710 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8fe4a31e-22f5-4edd-ab35-f73598efe27a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:49.317177 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8fe4a31e-22f5-4edd-ab35-f73598efe27a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:49.321210 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8fe4a31e-22f5-4edd-ab35-f73598efe27a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:49.323176 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8fe4a31e-22f5-4edd-ab35-f73598efe27a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:49.681233 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-090bd6fa-1716-44fe-8759-013bddb54361 req-3d31d1c7-2e5e-4886-9bd6-7956b0072c94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6467b83c-72e4-4991-a025-4690618f1115", "tag": "f25b2fab-dcfe-4c76-94a6-d6033e93124d"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:57:49.701274 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-090bd6fa-1716-44fe-8759-013bddb54361 req-3d31d1c7-2e5e-4886-9bd6-7956b0072c94 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:49.708292 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-090bd6fa-1716-44fe-8759-013bddb54361 req-3d31d1c7-2e5e-4886-9bd6-7956b0072c94 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:49.720644 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:57:49.739587 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8fe4a31e-22f5-4edd-ab35-f73598efe27a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:49.739790 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-090bd6fa-1716-44fe-8759-013bddb54361 req-3d31d1c7-2e5e-4886-9bd6-7956b0072c94 service nova] Creating event network-changed:f25b2fab-dcfe-4c76-94a6-d6033e93124d for instance 6467b83c-72e4-4991-a025-4690618f1115 on chh1-master-2 Jun 10 17:57:49.746219 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-090bd6fa-1716-44fe-8759-013bddb54361 req-3d31d1c7-2e5e-4886-9bd6-7956b0072c94 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.282159 Jun 10 17:57:49.749258 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8fe4a31e-22f5-4edd-ab35-f73598efe27a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b" status: 200 len: 1322 microversion: 2.1 time: 0.451407 Jun 10 17:57:49.751243 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 35/70] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:57:49.768445 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 36/71] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:49 2022] GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b => generated 1322 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:50.187662 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0ecf7f91-d430-4862-bd4b-74188b9d8929 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:50.188813 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0ecf7f91-d430-4862-bd4b-74188b9d8929 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 4ef38095-36e0-4792-9516-caf76a5022c9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:50.208737 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0ecf7f91-d430-4862-bd4b-74188b9d8929 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:50.209552 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0ecf7f91-d430-4862-bd4b-74188b9d8929 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:50.210620 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0ecf7f91-d430-4862-bd4b-74188b9d8929 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:50.212344 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0ecf7f91-d430-4862-bd4b-74188b9d8929 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:50.274306 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-56167a93-766a-41fe-a74d-ff4c5a8c8c15 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:50.274792 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-56167a93-766a-41fe-a74d-ff4c5a8c8c15 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] [instance: 6467b83c-72e4-4991-a025-4690618f1115] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:50.302838 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-56167a93-766a-41fe-a74d-ff4c5a8c8c15 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:50.307465 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-56167a93-766a-41fe-a74d-ff4c5a8c8c15 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:50.312488 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-56167a93-766a-41fe-a74d-ff4c5a8c8c15 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:50.314553 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-56167a93-766a-41fe-a74d-ff4c5a8c8c15 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:50.997592 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-56167a93-766a-41fe-a74d-ff4c5a8c8c15 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77dc782a65b645c7a534aabc90d09110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066ae7d9e1564b91bbbaea7ff17dc789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:51.009469 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-56167a93-766a-41fe-a74d-ff4c5a8c8c15 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] 10.222.0.35 "GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115" status: 200 len: 1339 microversion: 2.1 time: 0.737275 Jun 10 17:57:51.009469 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 37/72] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:50 2022] GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115 => generated 1339 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:57:51.026174 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-749e1870-ca12-4acc-a55c-75f000409728 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:51.026891 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-749e1870-ca12-4acc-a55c-75f000409728 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: c9b75acf-e4fe-425e-9398-40c4ac1a108b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:51.042902 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-749e1870-ca12-4acc-a55c-75f000409728 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:51.047796 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-749e1870-ca12-4acc-a55c-75f000409728 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:51.051064 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-749e1870-ca12-4acc-a55c-75f000409728 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:51.051720 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-749e1870-ca12-4acc-a55c-75f000409728 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:51.333913 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0ecf7f91-d430-4862-bd4b-74188b9d8929 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:51.362532 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0ecf7f91-d430-4862-bd4b-74188b9d8929 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9" status: 200 len: 1320 microversion: 2.1 time: 1.179041 Jun 10 17:57:51.371259 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 36/73] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:50 2022] GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9 => generated 1320 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:51.767002 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-749e1870-ca12-4acc-a55c-75f000409728 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:51.786789 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-749e1870-ca12-4acc-a55c-75f000409728 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b" status: 200 len: 1322 microversion: 2.1 time: 0.773842 Jun 10 17:57:51.800218 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 38/74] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:51 2022] GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b => generated 1322 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:52.001762 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-e0970cdd-8f8b-4a30-aba1-4dfd53f1782a req-8daa660a-4745-4ceb-ba6d-2f385c0f72ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ef38095-36e0-4792-9516-caf76a5022c9", "tag": "9b60d347-65df-4aa7-85ac-1c504203cdea"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:57:52.018802 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-e0970cdd-8f8b-4a30-aba1-4dfd53f1782a req-8daa660a-4745-4ceb-ba6d-2f385c0f72ac service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:52.021619 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-e0970cdd-8f8b-4a30-aba1-4dfd53f1782a req-8daa660a-4745-4ceb-ba6d-2f385c0f72ac service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:52.024339 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-24b3d92d-393b-4519-8047-d89eabe63525 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:52.025191 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-24b3d92d-393b-4519-8047-d89eabe63525 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] [instance: 6467b83c-72e4-4991-a025-4690618f1115] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:52.035350 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-24b3d92d-393b-4519-8047-d89eabe63525 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:52.037331 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-24b3d92d-393b-4519-8047-d89eabe63525 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:52.040016 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-24b3d92d-393b-4519-8047-d89eabe63525 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:52.041100 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-24b3d92d-393b-4519-8047-d89eabe63525 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:52.061648 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-e0970cdd-8f8b-4a30-aba1-4dfd53f1782a req-8daa660a-4745-4ceb-ba6d-2f385c0f72ac service nova] Creating event network-changed:9b60d347-65df-4aa7-85ac-1c504203cdea for instance 4ef38095-36e0-4792-9516-caf76a5022c9 on chh2-master-2 Jun 10 17:57:52.074253 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-e0970cdd-8f8b-4a30-aba1-4dfd53f1782a req-8daa660a-4745-4ceb-ba6d-2f385c0f72ac service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075702 Jun 10 17:57:52.078015 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 37/75] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:57:52.120887 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:57:52.389979 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-421b30e6-ac92-4691-b4bc-0426a55ffbce tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:52.390750 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-421b30e6-ac92-4691-b4bc-0426a55ffbce tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 4ef38095-36e0-4792-9516-caf76a5022c9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:52.411201 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-421b30e6-ac92-4691-b4bc-0426a55ffbce tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:52.412257 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-421b30e6-ac92-4691-b4bc-0426a55ffbce tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:52.414387 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-421b30e6-ac92-4691-b4bc-0426a55ffbce tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:52.419095 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-421b30e6-ac92-4691-b4bc-0426a55ffbce tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:52.616122 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-24b3d92d-393b-4519-8047-d89eabe63525 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77dc782a65b645c7a534aabc90d09110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066ae7d9e1564b91bbbaea7ff17dc789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:52.628145 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-24b3d92d-393b-4519-8047-d89eabe63525 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] 10.222.0.35 "GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115" status: 200 len: 1339 microversion: 2.1 time: 0.607536 Jun 10 17:57:52.642065 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 39/76] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:52 2022] GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115 => generated 1339 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:52.809754 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-93da6f6b-3975-4f67-8273-deedd4308ce2 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:52.810521 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-93da6f6b-3975-4f67-8273-deedd4308ce2 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: c9b75acf-e4fe-425e-9398-40c4ac1a108b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:52.825962 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93da6f6b-3975-4f67-8273-deedd4308ce2 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:52.826883 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93da6f6b-3975-4f67-8273-deedd4308ce2 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:52.827622 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93da6f6b-3975-4f67-8273-deedd4308ce2 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:52.829479 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93da6f6b-3975-4f67-8273-deedd4308ce2 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:53.189461 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-421b30e6-ac92-4691-b4bc-0426a55ffbce tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:53.200360 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-421b30e6-ac92-4691-b4bc-0426a55ffbce tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9" status: 200 len: 1320 microversion: 2.1 time: 0.815070 Jun 10 17:57:53.200920 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 38/77] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:52 2022] GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9 => generated 1320 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:53.286814 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-93da6f6b-3975-4f67-8273-deedd4308ce2 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:53.296427 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-93da6f6b-3975-4f67-8273-deedd4308ce2 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b" status: 200 len: 1322 microversion: 2.1 time: 0.490389 Jun 10 17:57:53.318766 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 40/78] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:52 2022] GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b => generated 1322 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:53.659025 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fa96d2c8-90f4-433d-aa8d-a636aa88550b tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:53.659604 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fa96d2c8-90f4-433d-aa8d-a636aa88550b tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] [instance: 6467b83c-72e4-4991-a025-4690618f1115] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:53.679547 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fa96d2c8-90f4-433d-aa8d-a636aa88550b tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:53.680013 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fa96d2c8-90f4-433d-aa8d-a636aa88550b tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:53.680851 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fa96d2c8-90f4-433d-aa8d-a636aa88550b tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:53.681311 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fa96d2c8-90f4-433d-aa8d-a636aa88550b tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:54.157862 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fa96d2c8-90f4-433d-aa8d-a636aa88550b tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77dc782a65b645c7a534aabc90d09110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066ae7d9e1564b91bbbaea7ff17dc789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:54.167433 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fa96d2c8-90f4-433d-aa8d-a636aa88550b tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] 10.222.0.35 "GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115" status: 200 len: 1339 microversion: 2.1 time: 0.512839 Jun 10 17:57:54.171573 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 39/79] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:53 2022] GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115 => generated 1339 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:54.219872 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4636a3b9-15af-43ba-95f8-219875ffa102 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:54.219872 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4636a3b9-15af-43ba-95f8-219875ffa102 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 4ef38095-36e0-4792-9516-caf76a5022c9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:54.229184 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4636a3b9-15af-43ba-95f8-219875ffa102 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:54.234959 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4636a3b9-15af-43ba-95f8-219875ffa102 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:54.235823 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4636a3b9-15af-43ba-95f8-219875ffa102 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:54.236282 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4636a3b9-15af-43ba-95f8-219875ffa102 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:54.341250 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-af43fc3e-48f9-4835-b95e-b5a0f71810a5 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:54.341892 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-af43fc3e-48f9-4835-b95e-b5a0f71810a5 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: c9b75acf-e4fe-425e-9398-40c4ac1a108b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:54.353669 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-af43fc3e-48f9-4835-b95e-b5a0f71810a5 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:54.354252 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-af43fc3e-48f9-4835-b95e-b5a0f71810a5 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:54.355102 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-af43fc3e-48f9-4835-b95e-b5a0f71810a5 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:54.355549 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-af43fc3e-48f9-4835-b95e-b5a0f71810a5 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:54.663735 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4636a3b9-15af-43ba-95f8-219875ffa102 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:54.677545 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4636a3b9-15af-43ba-95f8-219875ffa102 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9" status: 200 len: 1320 microversion: 2.1 time: 0.463207 Jun 10 17:57:54.680664 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 41/80] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:54 2022] GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9 => generated 1320 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:54.869699 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-af43fc3e-48f9-4835-b95e-b5a0f71810a5 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:54.882863 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-af43fc3e-48f9-4835-b95e-b5a0f71810a5 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b" status: 200 len: 1322 microversion: 2.1 time: 0.550339 Jun 10 17:57:54.886012 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 40/81] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:54 2022] GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b => generated 1322 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:55.188691 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c72d1627-cbaa-47c0-aa14-df080d7e3d2e tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:55.189698 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c72d1627-cbaa-47c0-aa14-df080d7e3d2e tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] [instance: 6467b83c-72e4-4991-a025-4690618f1115] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:55.199713 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c72d1627-cbaa-47c0-aa14-df080d7e3d2e tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:55.202922 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c72d1627-cbaa-47c0-aa14-df080d7e3d2e tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:55.204797 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c72d1627-cbaa-47c0-aa14-df080d7e3d2e tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:55.205569 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c72d1627-cbaa-47c0-aa14-df080d7e3d2e tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:55.452742 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c72d1627-cbaa-47c0-aa14-df080d7e3d2e tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77dc782a65b645c7a534aabc90d09110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066ae7d9e1564b91bbbaea7ff17dc789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:55.465313 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c72d1627-cbaa-47c0-aa14-df080d7e3d2e tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] 10.222.0.35 "GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115" status: 200 len: 1339 microversion: 2.1 time: 0.280788 Jun 10 17:57:55.468129 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 42/82] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:55 2022] GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115 => generated 1339 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:55.697992 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3c4ccf9c-c9d2-4973-9232-4258323945cb tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:55.698701 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3c4ccf9c-c9d2-4973-9232-4258323945cb tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 4ef38095-36e0-4792-9516-caf76a5022c9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:55.712357 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3c4ccf9c-c9d2-4973-9232-4258323945cb tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:55.712915 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3c4ccf9c-c9d2-4973-9232-4258323945cb tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:55.713780 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3c4ccf9c-c9d2-4973-9232-4258323945cb tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:55.718280 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3c4ccf9c-c9d2-4973-9232-4258323945cb tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:55.751350 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-52e499f0-7a9e-4fde-8837-5aef239ff36c tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:55.763280 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-52e499f0-7a9e-4fde-8837-5aef239ff36c tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.486045 Jun 10 17:57:55.781948 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 41/83] 10.222.0.35 () {58 vars in 1136 bytes} [Fri Jun 10 17:57:55 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:57:56.007816 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3c4ccf9c-c9d2-4973-9232-4258323945cb tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:56.023613 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3c4ccf9c-c9d2-4973-9232-4258323945cb tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9" status: 200 len: 1320 microversion: 2.1 time: 0.329397 Jun 10 17:57:56.035896 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 43/84] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:55 2022] GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9 => generated 1320 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:57:56.035896 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7744a310-9ffa-41ec-b3d2-2def9db0593a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:56.035896 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7744a310-9ffa-41ec-b3d2-2def9db0593a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: c9b75acf-e4fe-425e-9398-40c4ac1a108b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:56.044995 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7744a310-9ffa-41ec-b3d2-2def9db0593a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:56.045788 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7744a310-9ffa-41ec-b3d2-2def9db0593a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:56.047084 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7744a310-9ffa-41ec-b3d2-2def9db0593a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:56.048605 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7744a310-9ffa-41ec-b3d2-2def9db0593a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:56.274457 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7744a310-9ffa-41ec-b3d2-2def9db0593a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:56.287608 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7744a310-9ffa-41ec-b3d2-2def9db0593a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b" status: 200 len: 1322 microversion: 2.1 time: 0.261582 Jun 10 17:57:56.289663 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 44/85] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:56 2022] GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b => generated 1322 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:56.447531 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2d4673e7-c781-4cfa-a52b-68bb667fa47f tempest-ServersWithSpecificFlavorTestJSON-2002976239 tempest-ServersWithSpecificFlavorTestJSON-2002976239-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1257851986", "id": 1778109647, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:57:56.449926 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:57:56.449926 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:57:56.488138 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-630df07a-ac88-4127-b979-2a108d221fc5 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:56.489184 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-630df07a-ac88-4127-b979-2a108d221fc5 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] [instance: 6467b83c-72e4-4991-a025-4690618f1115] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:56.503099 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-630df07a-ac88-4127-b979-2a108d221fc5 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:56.503859 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-630df07a-ac88-4127-b979-2a108d221fc5 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:56.504869 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-630df07a-ac88-4127-b979-2a108d221fc5 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:56.507020 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-630df07a-ac88-4127-b979-2a108d221fc5 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:56.511974 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2d4673e7-c781-4cfa-a52b-68bb667fa47f tempest-ServersWithSpecificFlavorTestJSON-2002976239 tempest-ServersWithSpecificFlavorTestJSON-2002976239-project-admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.736250 Jun 10 17:57:56.519866 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 42/86] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:57:55 2022] POST /compute/v2.1/flavors => generated 425 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:57:56.525649 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7aa6151d-0f21-46e9-b0a4-35299079dddf tempest-ServersWithSpecificFlavorTestJSON-2002976239 tempest-ServersWithSpecificFlavorTestJSON-2002976239-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:56.552618 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7aa6151d-0f21-46e9-b0a4-35299079dddf tempest-ServersWithSpecificFlavorTestJSON-2002976239 tempest-ServersWithSpecificFlavorTestJSON-2002976239-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.031557 Jun 10 17:57:56.561518 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 43/87] 10.222.0.35 () {58 vars in 1181 bytes} [Fri Jun 10 17:57:56 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 17:57:56.592938 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=6 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:57:56.722707 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-72378765-f005-4554-9f0f-cec5930e8d9b tempest-InstanceUsageAuditLogTestJSON-2141420689 tempest-InstanceUsageAuditLogTestJSON-2141420689-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:56.724644 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:57:56.724644 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:57:56.756677 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-72378765-f005-4554-9f0f-cec5930e8d9b tempest-InstanceUsageAuditLogTestJSON-2141420689 tempest-InstanceUsageAuditLogTestJSON-2141420689-project-admin] 10.222.0.35 "GET /compute/v2.1/os-instance_usage_audit_log/2022-06-10 17:57:56" status: 200 len: 318 microversion: 2.1 time: 0.192611 Jun 10 17:57:56.757791 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 44/88] 10.222.0.35 () {58 vars in 1250 bytes} [Fri Jun 10 17:57:56 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-06-10%2017%3A57%3A56 => generated 318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:57:56.761781 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-630df07a-ac88-4127-b979-2a108d221fc5 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77dc782a65b645c7a534aabc90d09110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066ae7d9e1564b91bbbaea7ff17dc789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:56.776872 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-630df07a-ac88-4127-b979-2a108d221fc5 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] 10.222.0.35 "GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115" status: 200 len: 1339 microversion: 2.1 time: 0.293702 Jun 10 17:57:56.777912 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 45/89] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:56 2022] GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115 => generated 1339 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:56.779632 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-95225a44-61fa-47be-94eb-b306e4742479 tempest-ServersWithSpecificFlavorTestJSON-2002976239 tempest-ServersWithSpecificFlavorTestJSON-2002976239-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-911788528", "id": 86660298, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:57:56.783578 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:57:56.783578 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:57:56.793410 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c8ee7e82-57c0-4a2d-b07d-fda6616d2f09 tempest-InstanceUsageAuditLogTestJSON-2141420689 tempest-InstanceUsageAuditLogTestJSON-2141420689-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:56.796146 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:57:56.796146 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:57:56.840825 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c8ee7e82-57c0-4a2d-b07d-fda6616d2f09 tempest-InstanceUsageAuditLogTestJSON-2141420689 tempest-InstanceUsageAuditLogTestJSON-2141420689-project-admin] 10.222.0.35 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.058789 Jun 10 17:57:56.843163 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 46/90] 10.222.0.35 () {58 vars in 1184 bytes} [Fri Jun 10 17:57:56 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:57:56.877371 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-95225a44-61fa-47be-94eb-b306e4742479 tempest-ServersWithSpecificFlavorTestJSON-2002976239 tempest-ServersWithSpecificFlavorTestJSON-2002976239-project-admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 418 microversion: 2.1 time: 0.109034 Jun 10 17:57:56.889016 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7e99ef37-3d46-40ef-8226-1f8ce2db2181 tempest-ServersWithSpecificFlavorTestJSON-2002976239 tempest-ServersWithSpecificFlavorTestJSON-2002976239-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:56.895633 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 45/91] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:57:56 2022] POST /compute/v2.1/flavors => generated 418 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:57:56.899528 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7e99ef37-3d46-40ef-8226-1f8ce2db2181 tempest-ServersWithSpecificFlavorTestJSON-2002976239 tempest-ServersWithSpecificFlavorTestJSON-2002976239-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.014040 Jun 10 17:57:56.915770 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-94bdc13e-feb3-46ee-ab8a-572c2316146a tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Action: 'create', calling method: .version_select at 0x7f77c1c44790>, body: {"keypair": {"name": "tempest-keypair-723378704", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfr6dTQg71pHuGCtNg97BIKIfjwjPfRxS7uagY4Hf7LYBV9/ha8IgoOmVYBDa8fPXTjEjlGy2Pz6d4YkRnoMuP8vICYVFASHNSet7s1/Bl8urGkgyIJiuuYbF+HrAjXEw=="}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:57:56.920853 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 47/92] 10.222.0.35 () {58 vars in 1181 bytes} [Fri Jun 10 17:57:56 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 10 17:57:56.953295 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-94bdc13e-feb3-46ee-ab8a-572c2316146a tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Getting quotas for project ef9d5dac7c8243aeaa207c5a1ecb399a. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 17:57:56.965718 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-94bdc13e-feb3-46ee-ab8a-572c2316146a tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Getting quotas for user 329e5bd8a55d42cdb7879fbead65627a and project ef9d5dac7c8243aeaa207c5a1ecb399a. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 17:57:57.045199 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-428374c2-ae8c-4072-a5cf-0bae0e8215a3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:57.046069 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-428374c2-ae8c-4072-a5cf-0bae0e8215a3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 4ef38095-36e0-4792-9516-caf76a5022c9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:57.060210 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-428374c2-ae8c-4072-a5cf-0bae0e8215a3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:57.060917 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-428374c2-ae8c-4072-a5cf-0bae0e8215a3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:57.065656 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-428374c2-ae8c-4072-a5cf-0bae0e8215a3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:57.066788 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-428374c2-ae8c-4072-a5cf-0bae0e8215a3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:57.076848 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-94bdc13e-feb3-46ee-ab8a-572c2316146a tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.163926 Jun 10 17:57:57.083235 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 46/93] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 17:57:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:57:57.311179 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f5a2ab2a-d4d4-4c90-83f6-237f37a3d8ae tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:57.312517 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f5a2ab2a-d4d4-4c90-83f6-237f37a3d8ae tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: c9b75acf-e4fe-425e-9398-40c4ac1a108b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:57.324250 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-428374c2-ae8c-4072-a5cf-0bae0e8215a3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:57.333246 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-428374c2-ae8c-4072-a5cf-0bae0e8215a3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9" status: 200 len: 1320 microversion: 2.1 time: 0.293756 Jun 10 17:57:57.343783 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 48/94] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:57 2022] GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9 => generated 1320 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:57.356109 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f5a2ab2a-d4d4-4c90-83f6-237f37a3d8ae tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:57.356784 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f5a2ab2a-d4d4-4c90-83f6-237f37a3d8ae tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:57.358189 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f5a2ab2a-d4d4-4c90-83f6-237f37a3d8ae tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:57.358636 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f5a2ab2a-d4d4-4c90-83f6-237f37a3d8ae tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:57.641967 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f5a2ab2a-d4d4-4c90-83f6-237f37a3d8ae tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:57.650624 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f5a2ab2a-d4d4-4c90-83f6-237f37a3d8ae tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b" status: 200 len: 1322 microversion: 2.1 time: 0.346905 Jun 10 17:57:57.651194 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 47/95] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:57 2022] GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b => generated 1322 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:57.801884 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8055c5e5-4131-4213-ae82-056b22015cba tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:57.805194 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8055c5e5-4131-4213-ae82-056b22015cba tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] [instance: 6467b83c-72e4-4991-a025-4690618f1115] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:57.821569 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8055c5e5-4131-4213-ae82-056b22015cba tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:57.823220 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8055c5e5-4131-4213-ae82-056b22015cba tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:57.824197 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8055c5e5-4131-4213-ae82-056b22015cba tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:57.828598 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8055c5e5-4131-4213-ae82-056b22015cba tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:58.250592 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8055c5e5-4131-4213-ae82-056b22015cba tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77dc782a65b645c7a534aabc90d09110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066ae7d9e1564b91bbbaea7ff17dc789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:58.263561 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8055c5e5-4131-4213-ae82-056b22015cba tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] 10.222.0.35 "GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115" status: 200 len: 1339 microversion: 2.1 time: 0.466100 Jun 10 17:57:58.264152 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 49/96] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:57 2022] GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115 => generated 1339 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:57:58.351649 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b3adde3d-8d33-481e-b9ec-06b74c16d3e7 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:58.352274 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b3adde3d-8d33-481e-b9ec-06b74c16d3e7 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 4ef38095-36e0-4792-9516-caf76a5022c9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:58.371714 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b3adde3d-8d33-481e-b9ec-06b74c16d3e7 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:58.372237 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b3adde3d-8d33-481e-b9ec-06b74c16d3e7 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:58.376949 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b3adde3d-8d33-481e-b9ec-06b74c16d3e7 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:58.377418 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b3adde3d-8d33-481e-b9ec-06b74c16d3e7 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:58.669654 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-079f5ef9-94e1-431c-b909-d5c8b9f0e937 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:58.669654 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-079f5ef9-94e1-431c-b909-d5c8b9f0e937 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: c9b75acf-e4fe-425e-9398-40c4ac1a108b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:58.672191 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b3adde3d-8d33-481e-b9ec-06b74c16d3e7 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:58.681256 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-079f5ef9-94e1-431c-b909-d5c8b9f0e937 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:58.681757 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-079f5ef9-94e1-431c-b909-d5c8b9f0e937 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:58.682479 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-079f5ef9-94e1-431c-b909-d5c8b9f0e937 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:58.682931 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-079f5ef9-94e1-431c-b909-d5c8b9f0e937 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:58.690321 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b3adde3d-8d33-481e-b9ec-06b74c16d3e7 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9" status: 200 len: 1320 microversion: 2.1 time: 0.339257 Jun 10 17:57:58.692877 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 48/97] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:58 2022] GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9 => generated 1320 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:59.150555 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-079f5ef9-94e1-431c-b909-d5c8b9f0e937 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:59.170061 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-079f5ef9-94e1-431c-b909-d5c8b9f0e937 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b" status: 200 len: 1322 microversion: 2.1 time: 0.506253 Jun 10 17:57:59.189002 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 50/98] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:58 2022] GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b => generated 1322 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:57:59.282656 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6bbcc15f-6332-47e5-a899-b20fcc59d902 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:59.283740 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6bbcc15f-6332-47e5-a899-b20fcc59d902 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] [instance: 6467b83c-72e4-4991-a025-4690618f1115] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:59.298412 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6bbcc15f-6332-47e5-a899-b20fcc59d902 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:59.298870 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6bbcc15f-6332-47e5-a899-b20fcc59d902 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:59.299738 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6bbcc15f-6332-47e5-a899-b20fcc59d902 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:59.300251 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6bbcc15f-6332-47e5-a899-b20fcc59d902 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:59.634641 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6bbcc15f-6332-47e5-a899-b20fcc59d902 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77dc782a65b645c7a534aabc90d09110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066ae7d9e1564b91bbbaea7ff17dc789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:57:59.649639 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6bbcc15f-6332-47e5-a899-b20fcc59d902 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] 10.222.0.35 "GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115" status: 200 len: 1339 microversion: 2.1 time: 0.370204 Jun 10 17:57:59.652330 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 49/99] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:59 2022] GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115 => generated 1339 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:57:59.707968 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fbf4ed8c-1a08-4f90-8f7f-bd4ad242861c tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:57:59.709014 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fbf4ed8c-1a08-4f90-8f7f-bd4ad242861c tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 4ef38095-36e0-4792-9516-caf76a5022c9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:57:59.728877 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fbf4ed8c-1a08-4f90-8f7f-bd4ad242861c tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:59.733941 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fbf4ed8c-1a08-4f90-8f7f-bd4ad242861c tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:57:59.733941 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fbf4ed8c-1a08-4f90-8f7f-bd4ad242861c tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:57:59.733941 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fbf4ed8c-1a08-4f90-8f7f-bd4ad242861c tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:00.126324 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fbf4ed8c-1a08-4f90-8f7f-bd4ad242861c tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:00.134598 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fbf4ed8c-1a08-4f90-8f7f-bd4ad242861c tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9" status: 200 len: 1320 microversion: 2.1 time: 0.430907 Jun 10 17:58:00.149077 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 51/100] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:57:59 2022] GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9 => generated 1320 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:00.188780 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3831e102-aee6-4316-9875-2ab98648a32a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:00.189591 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3831e102-aee6-4316-9875-2ab98648a32a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: c9b75acf-e4fe-425e-9398-40c4ac1a108b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:00.208708 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3831e102-aee6-4316-9875-2ab98648a32a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:00.209257 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3831e102-aee6-4316-9875-2ab98648a32a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:00.210166 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3831e102-aee6-4316-9875-2ab98648a32a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:00.210721 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3831e102-aee6-4316-9875-2ab98648a32a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:00.446598 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3831e102-aee6-4316-9875-2ab98648a32a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:00.456566 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3831e102-aee6-4316-9875-2ab98648a32a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b" status: 200 len: 1322 microversion: 2.1 time: 0.271705 Jun 10 17:58:00.469988 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 50/101] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:00 2022] GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b => generated 1322 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:00.787850 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ca057aee-6b62-4fc0-9e7e-f9b144a12415 tempest-HypervisorAdminNegativeTestJSON-2028855098 tempest-HypervisorAdminNegativeTestJSON-2028855098-project] Calling method '.version_select at 0x7f77c1e56670>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:00.788753 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:00.788753 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:00.789984 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ca057aee-6b62-4fc0-9e7e-f9b144a12415 tempest-HypervisorAdminNegativeTestJSON-2028855098 tempest-HypervisorAdminNegativeTestJSON-2028855098-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '7b618b63ed1644a19e0b553af4db9b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1625decf872c4b2a9e3ccab53f49454a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:00.791916 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ca057aee-6b62-4fc0-9e7e-f9b144a12415 tempest-HypervisorAdminNegativeTestJSON-2028855098 tempest-HypervisorAdminNegativeTestJSON-2028855098-project] Request method failure captured: Jun 10 17:58:00.791916 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Jun 10 17:58:00.791916 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 17:58:00.791916 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 17:58:00.791916 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 17:58:00.791916 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 17:58:00.791916 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 17:58:00.791916 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 17:58:00.791916 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 17:58:00.791916 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:00.791916 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4YmjTPnfli0JCy670GxwZxWfz7nmPZ391tjeu5Hx4ix1mTlIbvBBavB80DuIwygN58aiKznB8wVNwkYnhaDedXD91eaPeYD3toJJzp0p2AolRa48O_Mfo9qGlmVyTdOCXKI69XRdP4AkEh5jW517aDnKUjGeJwy7myRJRyZdQmWAK0 Jun 10 17:58:00.791916 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 17:58:00.791916 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 17:58:00.791916 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 17:58:00.791916 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 17:58:00.791916 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 17:58:00.791916 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 17:58:00.791916 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 1625decf872c4b2a9e3ccab53f49454a Jun 10 17:58:00.791916 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2028855098 Jun 10 17:58:00.791916 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 17:58:00.791916 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 17:58:00.793303 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1625decf872c4b2a9e3ccab53f49454a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1625decf872c4b2a9e3ccab53f49454a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1625decf872c4b2a9e3ccab53f49454a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1625decf872c4b2a9e3ccab53f49454a", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:00.793303 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2028855098 Jun 10 17:58:00.793303 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 1625decf872c4b2a9e3ccab53f49454a Jun 10 17:58:00.793303 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2028855098 Jun 10 17:58:00.793303 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-HypervisorAdminNegativeTestJSON-2028855098-project Jun 10 17:58:00.793303 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 17:58:00.793303 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 17:58:00.793303 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 7b618b63ed1644a19e0b553af4db9b0f Jun 10 17:58:00.793303 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2028855098-project Jun 10 17:58:00.793303 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 17:58:00.793303 chdv-master-2 devstack@n-api.service[126595]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jun 10 17:58:00.793303 chdv-master-2 devstack@n-api.service[126595]: action_args: {} Jun 10 17:58:00.793303 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:00.794188 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:00.794188 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:00.794188 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:00.794188 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:00.794188 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:00.794188 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 17:58:00.794188 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 17:58:00.794188 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:00.794188 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:00.794188 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Jun 10 17:58:00.794188 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._detail(req) Jun 10 17:58:00.794188 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Jun 10 17:58:00.794188 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Jun 10 17:58:00.794188 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 10 17:58:00.794188 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 10 17:58:00.794188 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 10 17:58:00.794188 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 10 17:58:00.794188 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 17:58:00.794188 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 17:58:00.795334 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 17:58:00.795334 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 17:58:00.795334 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 10 17:58:00.795334 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 10 17:58:00.795334 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 10 17:58:00.795334 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 10 17:58:00.795334 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 10 17:58:00.795334 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 10 17:58:00.795334 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jun 10 17:58:00.795334 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:00.795334 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:00.795334 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:00.795334 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:00.795334 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:00.795334 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:00.795334 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 10 17:58:00.795334 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 10 17:58:00.795334 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jun 10 17:58:00.795334 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:00.796577 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ca057aee-6b62-4fc0-9e7e-f9b144a12415 tempest-HypervisorAdminNegativeTestJSON-2028855098 tempest-HypervisorAdminNegativeTestJSON-2028855098-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:00.796577 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ca057aee-6b62-4fc0-9e7e-f9b144a12415 tempest-HypervisorAdminNegativeTestJSON-2028855098 tempest-HypervisorAdminNegativeTestJSON-2028855098-project] 10.222.0.35 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.305402 Jun 10 17:58:00.796577 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 52/102] 10.222.0.35 () {58 vars in 1166 bytes} [Fri Jun 10 17:58:00 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 306 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:58:00.801755 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dd733e49-092a-43b9-8036-f835cca1377b tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:00.802405 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dd733e49-092a-43b9-8036-f835cca1377b tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] [instance: 6467b83c-72e4-4991-a025-4690618f1115] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:00.809830 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd733e49-092a-43b9-8036-f835cca1377b tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:00.810277 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd733e49-092a-43b9-8036-f835cca1377b tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:00.811044 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd733e49-092a-43b9-8036-f835cca1377b tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:00.811480 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd733e49-092a-43b9-8036-f835cca1377b tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:00.837545 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5f227c41-7a3d-46df-897f-75a2737d32a8 tempest-HypervisorAdminNegativeUnderV252Test-165782720 tempest-HypervisorAdminNegativeUnderV252Test-165782720-project-admin] Calling method '.version_select at 0x7f77c1c44ee0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:00.838545 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:00.838545 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:00.839727 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f227c41-7a3d-46df-897f-75a2737d32a8 tempest-HypervisorAdminNegativeUnderV252Test-165782720 tempest-HypervisorAdminNegativeUnderV252Test-165782720-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:00.840188 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f227c41-7a3d-46df-897f-75a2737d32a8 tempest-HypervisorAdminNegativeUnderV252Test-165782720 tempest-HypervisorAdminNegativeUnderV252Test-165782720-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:00.854889 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f227c41-7a3d-46df-897f-75a2737d32a8 tempest-HypervisorAdminNegativeUnderV252Test-165782720 tempest-HypervisorAdminNegativeUnderV252Test-165782720-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:00.855370 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f227c41-7a3d-46df-897f-75a2737d32a8 tempest-HypervisorAdminNegativeUnderV252Test-165782720 tempest-HypervisorAdminNegativeUnderV252Test-165782720-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:00.866084 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f227c41-7a3d-46df-897f-75a2737d32a8 tempest-HypervisorAdminNegativeUnderV252Test-165782720 tempest-HypervisorAdminNegativeUnderV252Test-165782720-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:00.866535 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f227c41-7a3d-46df-897f-75a2737d32a8 tempest-HypervisorAdminNegativeUnderV252Test-165782720 tempest-HypervisorAdminNegativeUnderV252Test-165782720-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:00.872289 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5f227c41-7a3d-46df-897f-75a2737d32a8 tempest-HypervisorAdminNegativeUnderV252Test-165782720 tempest-HypervisorAdminNegativeUnderV252Test-165782720-project-admin] 10.222.0.35 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.267126 Jun 10 17:58:00.872955 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 51/103] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 17:58:00 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:00.877495 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-98d9a0d4-0a1c-40e8-8e47-e85799025f87 tempest-HypervisorAdminNegativeTestJSON-2028855098 tempest-HypervisorAdminNegativeTestJSON-2028855098-project] Calling method '.version_select at 0x7f77c1bf9af0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:00.878648 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:00.878648 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:00.879752 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-98d9a0d4-0a1c-40e8-8e47-e85799025f87 tempest-HypervisorAdminNegativeTestJSON-2028855098 tempest-HypervisorAdminNegativeTestJSON-2028855098-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '7b618b63ed1644a19e0b553af4db9b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1625decf872c4b2a9e3ccab53f49454a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:00.882556 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-98d9a0d4-0a1c-40e8-8e47-e85799025f87 tempest-HypervisorAdminNegativeTestJSON-2028855098 tempest-HypervisorAdminNegativeTestJSON-2028855098-project] Request method failure captured: Jun 10 17:58:00.882556 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Jun 10 17:58:00.882556 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 17:58:00.882556 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 17:58:00.882556 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 17:58:00.882556 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 17:58:00.882556 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 17:58:00.882556 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 17:58:00.882556 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 17:58:00.882556 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:00.882556 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4YmjTPnfli0JCy670GxwZxWfz7nmPZ391tjeu5Hx4ix1mTlIbvBBavB80DuIwygN58aiKznB8wVNwkYnhaDedXD91eaPeYD3toJJzp0p2AolRa48O_Mfo9qGlmVyTdOCXKI69XRdP4AkEh5jW517aDnKUjGeJwy7myRJRyZdQmWAK0 Jun 10 17:58:00.882556 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 17:58:00.882556 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 17:58:00.882556 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 17:58:00.882556 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 17:58:00.882556 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 17:58:00.882556 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 17:58:00.882556 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 1625decf872c4b2a9e3ccab53f49454a Jun 10 17:58:00.882556 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2028855098 Jun 10 17:58:00.882556 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 17:58:00.882556 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 17:58:00.883854 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1625decf872c4b2a9e3ccab53f49454a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1625decf872c4b2a9e3ccab53f49454a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1625decf872c4b2a9e3ccab53f49454a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1625decf872c4b2a9e3ccab53f49454a", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:00.883854 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2028855098 Jun 10 17:58:00.883854 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 1625decf872c4b2a9e3ccab53f49454a Jun 10 17:58:00.883854 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2028855098 Jun 10 17:58:00.883854 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-HypervisorAdminNegativeTestJSON-2028855098-project Jun 10 17:58:00.883854 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 17:58:00.883854 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 17:58:00.883854 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 7b618b63ed1644a19e0b553af4db9b0f Jun 10 17:58:00.883854 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2028855098-project Jun 10 17:58:00.883854 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 17:58:00.883854 chdv-master-2 devstack@n-api.service[126594]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jun 10 17:58:00.883854 chdv-master-2 devstack@n-api.service[126594]: action_args: {} Jun 10 17:58:00.883854 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:00.884634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:00.884634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:00.884634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:00.884634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:00.884634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:00.884634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 17:58:00.884634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 17:58:00.884634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:00.884634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:00.884634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Jun 10 17:58:00.884634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self._index(req) Jun 10 17:58:00.884634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Jun 10 17:58:00.884634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Jun 10 17:58:00.884634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 10 17:58:00.884634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 10 17:58:00.884634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 10 17:58:00.884634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 10 17:58:00.884634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 17:58:00.884634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 17:58:00.885587 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 17:58:00.885587 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 17:58:00.885587 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 10 17:58:00.885587 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 10 17:58:00.885587 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 10 17:58:00.885587 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 10 17:58:00.885587 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 10 17:58:00.885587 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 10 17:58:00.885587 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jun 10 17:58:00.885587 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:00.885587 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:00.885587 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:00.885587 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:00.885587 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:00.885587 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:00.885587 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 10 17:58:00.885587 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 10 17:58:00.885587 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jun 10 17:58:00.885587 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:00.886717 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-98d9a0d4-0a1c-40e8-8e47-e85799025f87 tempest-HypervisorAdminNegativeTestJSON-2028855098 tempest-HypervisorAdminNegativeTestJSON-2028855098-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:00.886717 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-98d9a0d4-0a1c-40e8-8e47-e85799025f87 tempest-HypervisorAdminNegativeTestJSON-2028855098 tempest-HypervisorAdminNegativeTestJSON-2028855098-project] 10.222.0.35 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.010077 Jun 10 17:58:00.886717 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 52/104] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 17:58:00 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:58:00.976836 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-dd733e49-092a-43b9-8036-f835cca1377b tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77dc782a65b645c7a534aabc90d09110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066ae7d9e1564b91bbbaea7ff17dc789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:00.990223 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dd733e49-092a-43b9-8036-f835cca1377b tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] 10.222.0.35 "GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115" status: 200 len: 1339 microversion: 2.1 time: 0.194971 Jun 10 17:58:00.991426 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 53/105] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:00 2022] GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115 => generated 1339 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:00.996590 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2ba62af0-d9f9-4ab4-a121-b67ad3796163 tempest-HypervisorAdminNegativeTestJSON-2028855098 tempest-HypervisorAdminNegativeTestJSON-2028855098-project] Calling method '.version_select at 0x7f77c1e47430>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:00.998225 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:00.998225 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:01.000497 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2ba62af0-d9f9-4ab4-a121-b67ad3796163 tempest-HypervisorAdminNegativeTestJSON-2028855098 tempest-HypervisorAdminNegativeTestJSON-2028855098-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '7b618b63ed1644a19e0b553af4db9b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1625decf872c4b2a9e3ccab53f49454a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:01.002418 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2ba62af0-d9f9-4ab4-a121-b67ad3796163 tempest-HypervisorAdminNegativeTestJSON-2028855098 tempest-HypervisorAdminNegativeTestJSON-2028855098-project] Request method failure captured: Jun 10 17:58:01.002418 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Jun 10 17:58:01.002418 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 17:58:01.002418 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 17:58:01.002418 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 17:58:01.002418 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 17:58:01.002418 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 17:58:01.002418 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 17:58:01.002418 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 17:58:01.002418 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:01.002418 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4YmjTPnfli0JCy670GxwZxWfz7nmPZ391tjeu5Hx4ix1mTlIbvBBavB80DuIwygN58aiKznB8wVNwkYnhaDedXD91eaPeYD3toJJzp0p2AolRa48O_Mfo9qGlmVyTdOCXKI69XRdP4AkEh5jW517aDnKUjGeJwy7myRJRyZdQmWAK0 Jun 10 17:58:01.002418 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 17:58:01.002418 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 17:58:01.002418 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 17:58:01.002418 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 17:58:01.002418 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 17:58:01.002418 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 17:58:01.002418 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 1625decf872c4b2a9e3ccab53f49454a Jun 10 17:58:01.002418 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2028855098 Jun 10 17:58:01.002418 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 17:58:01.002418 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 17:58:01.003575 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1625decf872c4b2a9e3ccab53f49454a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1625decf872c4b2a9e3ccab53f49454a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1625decf872c4b2a9e3ccab53f49454a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1625decf872c4b2a9e3ccab53f49454a", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:01.003575 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2028855098 Jun 10 17:58:01.003575 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 1625decf872c4b2a9e3ccab53f49454a Jun 10 17:58:01.003575 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2028855098 Jun 10 17:58:01.003575 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-HypervisorAdminNegativeTestJSON-2028855098-project Jun 10 17:58:01.003575 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 17:58:01.003575 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 17:58:01.003575 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 7b618b63ed1644a19e0b553af4db9b0f Jun 10 17:58:01.003575 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2028855098-project Jun 10 17:58:01.003575 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 17:58:01.003575 chdv-master-2 devstack@n-api.service[126595]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jun 10 17:58:01.003575 chdv-master-2 devstack@n-api.service[126595]: action_args: {} Jun 10 17:58:01.003575 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:01.005898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:01.005898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:01.005898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:01.005898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:01.005898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:01.005898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 17:58:01.005898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 17:58:01.005898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:01.005898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:01.005898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Jun 10 17:58:01.005898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Jun 10 17:58:01.005898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 10 17:58:01.005898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 10 17:58:01.005898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 10 17:58:01.005898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 10 17:58:01.005898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 17:58:01.005898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 17:58:01.005898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 17:58:01.005898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 17:58:01.008406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 10 17:58:01.008406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 10 17:58:01.008406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 10 17:58:01.008406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 10 17:58:01.008406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 10 17:58:01.008406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 10 17:58:01.008406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jun 10 17:58:01.008406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:01.008406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:01.008406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:01.008406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:01.008406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:01.008406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:01.008406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 10 17:58:01.008406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 10 17:58:01.008406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jun 10 17:58:01.008406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:01.010416 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2ba62af0-d9f9-4ab4-a121-b67ad3796163 tempest-HypervisorAdminNegativeTestJSON-2028855098 tempest-HypervisorAdminNegativeTestJSON-2028855098-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:01.011424 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2ba62af0-d9f9-4ab4-a121-b67ad3796163 tempest-HypervisorAdminNegativeTestJSON-2028855098 tempest-HypervisorAdminNegativeTestJSON-2028855098-project] 10.222.0.35 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.018727 Jun 10 17:58:01.012605 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 54/106] 10.222.0.35 () {58 vars in 1178 bytes} [Fri Jun 10 17:58:00 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:58:01.038486 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-eca851c9-b4ed-4f67-87c7-7b6e241329c7 tempest-HypervisorAdminNegativeUnderV252Test-1967524418 tempest-HypervisorAdminNegativeUnderV252Test-1967524418-project] Calling method '.version_select at 0x7f77c1bdbb80>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:01.039588 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:01.039588 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:01.040572 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-eca851c9-b4ed-4f67-87c7-7b6e241329c7 tempest-HypervisorAdminNegativeUnderV252Test-1967524418 tempest-HypervisorAdminNegativeUnderV252Test-1967524418-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '5d1db6ad638b4687bb602094e4ab5f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93bca75abdb46859dc83e8ec03fd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:01.042428 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-eca851c9-b4ed-4f67-87c7-7b6e241329c7 tempest-HypervisorAdminNegativeUnderV252Test-1967524418 tempest-HypervisorAdminNegativeUnderV252Test-1967524418-project] Request method failure captured: Jun 10 17:58:01.042428 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/os-hypervisors/chh1-master-2/search HTTP/1.1 Jun 10 17:58:01.042428 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 17:58:01.042428 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 17:58:01.042428 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 17:58:01.042428 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 17:58:01.042428 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 17:58:01.042428 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 17:58:01.042428 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 17:58:01.042428 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:01.042428 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4YmpwNZKuC2G-5yMDOnHDaNhee0mXK4iKXlmlFOg6DWdL7fCrbJYd-w_pBGezd30lu6Uh63_1p0PmwApUWwgCWVI6Ffn9QeSghIasTGLx5xWW_k4cLoVSssHIAIxPV1heydhl31nIema-TUNftj680z85ZoFjHKmnuIZEvEhT20nHk Jun 10 17:58:01.042428 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 17:58:01.042428 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 17:58:01.042428 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 17:58:01.042428 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 17:58:01.042428 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 17:58:01.042428 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 17:58:01.042428 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: f93bca75abdb46859dc83e8ec03fd09b Jun 10 17:58:01.042428 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1967524418 Jun 10 17:58:01.042428 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 17:58:01.042428 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 17:58:01.043773 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/f93bca75abdb46859dc83e8ec03fd09b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/f93bca75abdb46859dc83e8ec03fd09b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/f93bca75abdb46859dc83e8ec03fd09b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_f93bca75abdb46859dc83e8ec03fd09b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:01.043773 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1967524418 Jun 10 17:58:01.043773 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: f93bca75abdb46859dc83e8ec03fd09b Jun 10 17:58:01.043773 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1967524418 Jun 10 17:58:01.043773 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1967524418-project Jun 10 17:58:01.043773 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 17:58:01.043773 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 17:58:01.043773 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 5d1db6ad638b4687bb602094e4ab5f18 Jun 10 17:58:01.043773 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1967524418-project Jun 10 17:58:01.043773 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 17:58:01.043773 chdv-master-2 devstack@n-api.service[126594]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jun 10 17:58:01.043773 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'chh1-master-2'} Jun 10 17:58:01.048122 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:01.048122 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:01.048122 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:01.048122 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:01.048122 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:01.048122 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:01.048122 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 17:58:01.048122 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 17:58:01.048122 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:01.048122 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:01.048122 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Jun 10 17:58:01.048122 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Jun 10 17:58:01.048122 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 10 17:58:01.048122 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 10 17:58:01.048122 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 10 17:58:01.048122 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 10 17:58:01.048122 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 17:58:01.048122 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 17:58:01.048122 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 17:58:01.049241 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 17:58:01.049241 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 10 17:58:01.049241 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 10 17:58:01.049241 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 10 17:58:01.049241 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 10 17:58:01.049241 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 10 17:58:01.049241 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 10 17:58:01.049241 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jun 10 17:58:01.049241 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:01.049241 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:01.049241 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:01.049241 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:01.049241 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:01.049241 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:01.049241 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 10 17:58:01.049241 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 10 17:58:01.049241 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jun 10 17:58:01.049241 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:01.050251 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-eca851c9-b4ed-4f67-87c7-7b6e241329c7 tempest-HypervisorAdminNegativeUnderV252Test-1967524418 tempest-HypervisorAdminNegativeUnderV252Test-1967524418-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:01.050251 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-eca851c9-b4ed-4f67-87c7-7b6e241329c7 tempest-HypervisorAdminNegativeUnderV252Test-1967524418 tempest-HypervisorAdminNegativeUnderV252Test-1967524418-project] 10.222.0.35 "GET /compute/v2.1/os-hypervisors/chh1-master-2/search" status: 403 len: 117 microversion: 2.1 time: 0.158328 Jun 10 17:58:01.050251 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 53/107] 10.222.0.35 () {58 vars in 1208 bytes} [Fri Jun 10 17:58:00 2022] GET /compute/v2.1/os-hypervisors/chh1-master-2/search => generated 117 bytes in 159 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:58:01.061718 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4d9a915a-eed5-430f-a319-2043bf22a7a1 tempest-HypervisorAdminNegativeUnderV252Test-165782720 tempest-HypervisorAdminNegativeUnderV252Test-165782720-project-admin] Calling method '.version_select at 0x7f77c1bdb670>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:01.065193 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4d9a915a-eed5-430f-a319-2043bf22a7a1 tempest-HypervisorAdminNegativeUnderV252Test-165782720 tempest-HypervisorAdminNegativeUnderV252Test-165782720-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:01.066395 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4d9a915a-eed5-430f-a319-2043bf22a7a1 tempest-HypervisorAdminNegativeUnderV252Test-165782720 tempest-HypervisorAdminNegativeUnderV252Test-165782720-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:01.073029 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-4d9a915a-eed5-430f-a319-2043bf22a7a1 tempest-HypervisorAdminNegativeUnderV252Test-165782720 tempest-HypervisorAdminNegativeUnderV252Test-165782720-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jun 10 17:58:01.074721 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4d9a915a-eed5-430f-a319-2043bf22a7a1 tempest-HypervisorAdminNegativeUnderV252Test-165782720 tempest-HypervisorAdminNegativeUnderV252Test-165782720-project-admin] Request method failure captured: Jun 10 17:58:01.074721 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Jun 10 17:58:01.074721 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 17:58:01.074721 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 17:58:01.074721 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 17:58:01.074721 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 17:58:01.074721 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 17:58:01.074721 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 17:58:01.074721 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 17:58:01.074721 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:01.074721 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4YosJCZ01602N-JA63wU9eI-WjQ1raUPJP0yctHgE-aPn-JqetmdD-WkEWi6Yxls9gom6P0VtRZhbLMRhEvw6yaCV_RWRLdPNW8DnO-OHY45c90gPukpRAKOf-0Wvec559JH5KboBUkF8hTlGKmjqkwH578Wc1n6PuL0mBvbgWbezk Jun 10 17:58:01.074721 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 17:58:01.074721 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 17:58:01.074721 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 17:58:01.074721 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 17:58:01.074721 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 17:58:01.074721 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 17:58:01.074721 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 3d8cc474ac2a4af78d80f0ad6caca119 Jun 10 17:58:01.074721 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-165782720 Jun 10 17:58:01.074721 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member,admin Jun 10 17:58:01.074721 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member,admin Jun 10 17:58:01.076133 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/3d8cc474ac2a4af78d80f0ad6caca119"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3d8cc474ac2a4af78d80f0ad6caca119"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3d8cc474ac2a4af78d80f0ad6caca119"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_3d8cc474ac2a4af78d80f0ad6caca119", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:01.076133 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-165782720 Jun 10 17:58:01.076133 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 3d8cc474ac2a4af78d80f0ad6caca119 Jun 10 17:58:01.076133 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-165782720 Jun 10 17:58:01.076133 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-165782720-project-admin Jun 10 17:58:01.076133 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 17:58:01.076133 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 17:58:01.076133 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 6183a9f452d84314bc9e48a59de5961d Jun 10 17:58:01.076133 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-165782720-project-admin Jun 10 17:58:01.076133 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 17:58:01.076133 chdv-master-2 devstack@n-api.service[126594]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jun 10 17:58:01.076133 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'nonexistent_hypervisor_name'} Jun 10 17:58:01.076977 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:01.076977 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:01.076977 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:01.076977 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:01.076977 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:01.076977 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:01.076977 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 17:58:01.076977 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 17:58:01.076977 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:01.076977 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:01.076977 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Jun 10 17:58:01.076977 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jun 10 17:58:01.076977 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jun 10 17:58:01.076977 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 10 17:58:01.076977 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jun 10 17:58:01.076977 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:01.076977 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:01.076977 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:01.076977 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:01.076977 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:01.078184 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:01.078184 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:58:01.078184 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:58:01.078184 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jun 10 17:58:01.078184 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:01.079404 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4d9a915a-eed5-430f-a319-2043bf22a7a1 tempest-HypervisorAdminNegativeUnderV252Test-165782720 tempest-HypervisorAdminNegativeUnderV252Test-165782720-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:01.080540 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4d9a915a-eed5-430f-a319-2043bf22a7a1 tempest-HypervisorAdminNegativeUnderV252Test-165782720 tempest-HypervisorAdminNegativeUnderV252Test-165782720-project-admin] 10.222.0.35 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.026937 Jun 10 17:58:01.081891 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 54/108] 10.222.0.35 () {58 vars in 1250 bytes} [Fri Jun 10 17:58:01 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:58:01.094612 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-27139aee-33c3-4173-bc86-bc8e5ec73934 tempest-HypervisorAdminNegativeUnderV252Test-165782720 tempest-HypervisorAdminNegativeUnderV252Test-165782720-project-admin] Calling method '.version_select at 0x7f77c1bdbca0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:01.094759 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27139aee-33c3-4173-bc86-bc8e5ec73934 tempest-HypervisorAdminNegativeUnderV252Test-165782720 tempest-HypervisorAdminNegativeUnderV252Test-165782720-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:01.095417 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27139aee-33c3-4173-bc86-bc8e5ec73934 tempest-HypervisorAdminNegativeUnderV252Test-165782720 tempest-HypervisorAdminNegativeUnderV252Test-165782720-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:01.140499 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5b0cafe7-35ae-40c5-9883-ec1eb9a9c85c tempest-HypervisorAdminNegativeTestJSON-1312457403 tempest-HypervisorAdminNegativeTestJSON-1312457403-project-admin] Calling method '.version_select at 0x7f77c1d3b4c0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:01.142727 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:01.142727 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:01.144961 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5b0cafe7-35ae-40c5-9883-ec1eb9a9c85c tempest-HypervisorAdminNegativeTestJSON-1312457403 tempest-HypervisorAdminNegativeTestJSON-1312457403-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:01.146384 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5b0cafe7-35ae-40c5-9883-ec1eb9a9c85c tempest-HypervisorAdminNegativeTestJSON-1312457403 tempest-HypervisorAdminNegativeTestJSON-1312457403-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:01.152787 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27139aee-33c3-4173-bc86-bc8e5ec73934 tempest-HypervisorAdminNegativeUnderV252Test-165782720 tempest-HypervisorAdminNegativeUnderV252Test-165782720-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:01.157289 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27139aee-33c3-4173-bc86-bc8e5ec73934 tempest-HypervisorAdminNegativeUnderV252Test-165782720 tempest-HypervisorAdminNegativeUnderV252Test-165782720-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:01.196701 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27139aee-33c3-4173-bc86-bc8e5ec73934 tempest-HypervisorAdminNegativeUnderV252Test-165782720 tempest-HypervisorAdminNegativeUnderV252Test-165782720-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:01.203215 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5b0cafe7-35ae-40c5-9883-ec1eb9a9c85c tempest-HypervisorAdminNegativeTestJSON-1312457403 tempest-HypervisorAdminNegativeTestJSON-1312457403-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:01.204565 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27139aee-33c3-4173-bc86-bc8e5ec73934 tempest-HypervisorAdminNegativeUnderV252Test-165782720 tempest-HypervisorAdminNegativeUnderV252Test-165782720-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:01.206331 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5b0cafe7-35ae-40c5-9883-ec1eb9a9c85c tempest-HypervisorAdminNegativeTestJSON-1312457403 tempest-HypervisorAdminNegativeTestJSON-1312457403-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:01.214446 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-27139aee-33c3-4173-bc86-bc8e5ec73934 tempest-HypervisorAdminNegativeUnderV252Test-165782720 tempest-HypervisorAdminNegativeUnderV252Test-165782720-project-admin] 10.222.0.35 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.127568 Jun 10 17:58:01.220128 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 55/109] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 17:58:01 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 17:58:01.232156 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a791db98-1ecc-4997-9fe1-b80e8cdb7d5f tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:01.232731 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a791db98-1ecc-4997-9fe1-b80e8cdb7d5f tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 4ef38095-36e0-4792-9516-caf76a5022c9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:01.245177 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a791db98-1ecc-4997-9fe1-b80e8cdb7d5f tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:01.247103 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a791db98-1ecc-4997-9fe1-b80e8cdb7d5f tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:01.247220 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5b0cafe7-35ae-40c5-9883-ec1eb9a9c85c tempest-HypervisorAdminNegativeTestJSON-1312457403 tempest-HypervisorAdminNegativeTestJSON-1312457403-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:01.247344 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a791db98-1ecc-4997-9fe1-b80e8cdb7d5f tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:01.248077 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5b0cafe7-35ae-40c5-9883-ec1eb9a9c85c tempest-HypervisorAdminNegativeTestJSON-1312457403 tempest-HypervisorAdminNegativeTestJSON-1312457403-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:01.256564 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a791db98-1ecc-4997-9fe1-b80e8cdb7d5f tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:01.269439 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5b0cafe7-35ae-40c5-9883-ec1eb9a9c85c tempest-HypervisorAdminNegativeTestJSON-1312457403 tempest-HypervisorAdminNegativeTestJSON-1312457403-project-admin] 10.222.0.35 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.248314 Jun 10 17:58:01.271789 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 55/110] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 17:58:01 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:01.287111 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8ae76a65-e1ea-48a4-b3a1-a5eddb2b4488 tempest-HypervisorAdminNegativeUnderV252Test-1967524418 tempest-HypervisorAdminNegativeUnderV252Test-1967524418-project] Calling method '.version_select at 0x7f77c1e47310>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:01.290506 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:01.290506 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:01.293358 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8ae76a65-e1ea-48a4-b3a1-a5eddb2b4488 tempest-HypervisorAdminNegativeUnderV252Test-1967524418 tempest-HypervisorAdminNegativeUnderV252Test-1967524418-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '5d1db6ad638b4687bb602094e4ab5f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93bca75abdb46859dc83e8ec03fd09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:01.300684 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8ae76a65-e1ea-48a4-b3a1-a5eddb2b4488 tempest-HypervisorAdminNegativeUnderV252Test-1967524418 tempest-HypervisorAdminNegativeUnderV252Test-1967524418-project] Request method failure captured: Jun 10 17:58:01.300684 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Jun 10 17:58:01.300684 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 17:58:01.300684 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 17:58:01.300684 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 17:58:01.300684 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 17:58:01.300684 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 17:58:01.300684 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 17:58:01.300684 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 17:58:01.300684 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:01.300684 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4YmpwNZKuC2G-5yMDOnHDaNhee0mXK4iKXlmlFOg6DWdL7fCrbJYd-w_pBGezd30lu6Uh63_1p0PmwApUWwgCWVI6Ffn9QeSghIasTGLx5xWW_k4cLoVSssHIAIxPV1heydhl31nIema-TUNftj680z85ZoFjHKmnuIZEvEhT20nHk Jun 10 17:58:01.300684 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 17:58:01.300684 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 17:58:01.300684 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 17:58:01.300684 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 17:58:01.300684 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 17:58:01.300684 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 17:58:01.300684 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: f93bca75abdb46859dc83e8ec03fd09b Jun 10 17:58:01.300684 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1967524418 Jun 10 17:58:01.300684 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 17:58:01.300684 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 17:58:01.302186 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/f93bca75abdb46859dc83e8ec03fd09b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/f93bca75abdb46859dc83e8ec03fd09b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/f93bca75abdb46859dc83e8ec03fd09b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_f93bca75abdb46859dc83e8ec03fd09b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:01.302186 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1967524418 Jun 10 17:58:01.302186 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: f93bca75abdb46859dc83e8ec03fd09b Jun 10 17:58:01.302186 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1967524418 Jun 10 17:58:01.302186 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1967524418-project Jun 10 17:58:01.302186 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 17:58:01.302186 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 17:58:01.302186 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 5d1db6ad638b4687bb602094e4ab5f18 Jun 10 17:58:01.302186 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1967524418-project Jun 10 17:58:01.302186 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 17:58:01.302186 chdv-master-2 devstack@n-api.service[126595]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jun 10 17:58:01.302186 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '1'} Jun 10 17:58:01.303164 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:01.303164 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:01.303164 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:01.303164 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:01.303164 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:01.303164 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:01.303164 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 17:58:01.303164 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 17:58:01.303164 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:01.303164 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:01.303164 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Jun 10 17:58:01.303164 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Jun 10 17:58:01.303164 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 10 17:58:01.303164 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 10 17:58:01.303164 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 10 17:58:01.303164 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 10 17:58:01.303164 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 17:58:01.303164 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 17:58:01.303164 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 17:58:01.304297 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 17:58:01.304297 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 10 17:58:01.304297 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 10 17:58:01.304297 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 10 17:58:01.304297 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 10 17:58:01.304297 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 10 17:58:01.304297 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 10 17:58:01.304297 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jun 10 17:58:01.304297 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:01.304297 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:01.304297 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:01.304297 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:01.304297 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:01.304297 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:01.304297 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 10 17:58:01.304297 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 10 17:58:01.304297 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jun 10 17:58:01.304297 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:01.308157 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8ae76a65-e1ea-48a4-b3a1-a5eddb2b4488 tempest-HypervisorAdminNegativeUnderV252Test-1967524418 tempest-HypervisorAdminNegativeUnderV252Test-1967524418-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:01.316003 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8ae76a65-e1ea-48a4-b3a1-a5eddb2b4488 tempest-HypervisorAdminNegativeUnderV252Test-1967524418 tempest-HypervisorAdminNegativeUnderV252Test-1967524418-project] 10.222.0.35 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.035965 Jun 10 17:58:01.316003 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 56/111] 10.222.0.35 () {58 vars in 1175 bytes} [Fri Jun 10 17:58:01 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:58:01.332533 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d40bca42-059f-468b-b573-3bcb751c7ae7 tempest-HypervisorAdminNegativeTestJSON-2028855098 tempest-HypervisorAdminNegativeTestJSON-2028855098-project] Calling method '.version_select at 0x7f77c1d3b430>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:01.334715 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:01.334715 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:01.336039 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d40bca42-059f-468b-b573-3bcb751c7ae7 tempest-HypervisorAdminNegativeTestJSON-2028855098 tempest-HypervisorAdminNegativeTestJSON-2028855098-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '7b618b63ed1644a19e0b553af4db9b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1625decf872c4b2a9e3ccab53f49454a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:01.338919 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d40bca42-059f-468b-b573-3bcb751c7ae7 tempest-HypervisorAdminNegativeTestJSON-2028855098 tempest-HypervisorAdminNegativeTestJSON-2028855098-project] Request method failure captured: Jun 10 17:58:01.338919 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Jun 10 17:58:01.338919 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 17:58:01.338919 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 17:58:01.338919 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 17:58:01.338919 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 17:58:01.338919 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 17:58:01.338919 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 17:58:01.338919 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 17:58:01.338919 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:01.338919 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4YmjTPnfli0JCy670GxwZxWfz7nmPZ391tjeu5Hx4ix1mTlIbvBBavB80DuIwygN58aiKznB8wVNwkYnhaDedXD91eaPeYD3toJJzp0p2AolRa48O_Mfo9qGlmVyTdOCXKI69XRdP4AkEh5jW517aDnKUjGeJwy7myRJRyZdQmWAK0 Jun 10 17:58:01.338919 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 17:58:01.338919 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 17:58:01.338919 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 17:58:01.338919 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 17:58:01.338919 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 17:58:01.338919 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 17:58:01.338919 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 1625decf872c4b2a9e3ccab53f49454a Jun 10 17:58:01.338919 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2028855098 Jun 10 17:58:01.338919 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 17:58:01.338919 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 17:58:01.346874 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1625decf872c4b2a9e3ccab53f49454a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1625decf872c4b2a9e3ccab53f49454a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1625decf872c4b2a9e3ccab53f49454a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1625decf872c4b2a9e3ccab53f49454a", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:01.346874 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2028855098 Jun 10 17:58:01.346874 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 1625decf872c4b2a9e3ccab53f49454a Jun 10 17:58:01.346874 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2028855098 Jun 10 17:58:01.346874 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-HypervisorAdminNegativeTestJSON-2028855098-project Jun 10 17:58:01.346874 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 17:58:01.346874 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 17:58:01.346874 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 7b618b63ed1644a19e0b553af4db9b0f Jun 10 17:58:01.346874 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2028855098-project Jun 10 17:58:01.346874 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 17:58:01.346874 chdv-master-2 devstack@n-api.service[126595]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jun 10 17:58:01.346874 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '1'} Jun 10 17:58:01.346874 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:01.348251 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:01.348251 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:01.348251 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:01.348251 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:01.348251 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:01.348251 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 17:58:01.348251 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 17:58:01.348251 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:01.348251 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:01.348251 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Jun 10 17:58:01.348251 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Jun 10 17:58:01.348251 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 10 17:58:01.348251 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 10 17:58:01.348251 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 10 17:58:01.348251 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 10 17:58:01.348251 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 17:58:01.348251 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 17:58:01.348251 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 17:58:01.348251 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 17:58:01.349427 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 10 17:58:01.349427 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 10 17:58:01.349427 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 10 17:58:01.349427 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 10 17:58:01.349427 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 10 17:58:01.349427 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 10 17:58:01.349427 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jun 10 17:58:01.349427 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:01.349427 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:01.349427 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:01.349427 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:01.349427 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:01.349427 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:01.349427 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 10 17:58:01.349427 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 10 17:58:01.349427 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jun 10 17:58:01.349427 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:01.350308 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d40bca42-059f-468b-b573-3bcb751c7ae7 tempest-HypervisorAdminNegativeTestJSON-2028855098 tempest-HypervisorAdminNegativeTestJSON-2028855098-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:01.350308 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d40bca42-059f-468b-b573-3bcb751c7ae7 tempest-HypervisorAdminNegativeTestJSON-2028855098 tempest-HypervisorAdminNegativeTestJSON-2028855098-project] 10.222.0.35 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.024616 Jun 10 17:58:01.350308 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 57/112] 10.222.0.35 () {58 vars in 1172 bytes} [Fri Jun 10 17:58:01 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:58:01.374718 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-17395b77-8ca3-4018-8aa9-cf8992feb479 tempest-HypervisorAdminNegativeUnderV252Test-165782720 tempest-HypervisorAdminNegativeUnderV252Test-165782720-project-admin] Calling method '.version_select at 0x7f77c1e569d0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:01.376817 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-17395b77-8ca3-4018-8aa9-cf8992feb479 tempest-HypervisorAdminNegativeUnderV252Test-165782720 tempest-HypervisorAdminNegativeUnderV252Test-165782720-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:01.377272 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-17395b77-8ca3-4018-8aa9-cf8992feb479 tempest-HypervisorAdminNegativeUnderV252Test-165782720 tempest-HypervisorAdminNegativeUnderV252Test-165782720-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:01.386051 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-17395b77-8ca3-4018-8aa9-cf8992feb479 tempest-HypervisorAdminNegativeUnderV252Test-165782720 tempest-HypervisorAdminNegativeUnderV252Test-165782720-project-admin] HTTP exception thrown: No hypervisor matching '0eb3876b-3e3b-4259-85b3-7230b293f725' could be found. Jun 10 17:58:01.387671 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-17395b77-8ca3-4018-8aa9-cf8992feb479 tempest-HypervisorAdminNegativeUnderV252Test-165782720 tempest-HypervisorAdminNegativeUnderV252Test-165782720-project-admin] Request method failure captured: Jun 10 17:58:01.387671 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/os-hypervisors/0eb3876b-3e3b-4259-85b3-7230b293f725/servers HTTP/1.1 Jun 10 17:58:01.387671 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 17:58:01.387671 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 17:58:01.387671 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 17:58:01.387671 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 17:58:01.387671 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 17:58:01.387671 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 17:58:01.387671 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 17:58:01.387671 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:01.387671 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4YosJCZ01602N-JA63wU9eI-WjQ1raUPJP0yctHgE-aPn-JqetmdD-WkEWi6Yxls9gom6P0VtRZhbLMRhEvw6yaCV_RWRLdPNW8DnO-OHY45c90gPukpRAKOf-0Wvec559JH5KboBUkF8hTlGKmjqkwH578Wc1n6PuL0mBvbgWbezk Jun 10 17:58:01.387671 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 17:58:01.387671 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 17:58:01.387671 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 17:58:01.387671 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 17:58:01.387671 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 17:58:01.387671 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 17:58:01.387671 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 3d8cc474ac2a4af78d80f0ad6caca119 Jun 10 17:58:01.387671 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-165782720 Jun 10 17:58:01.387671 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member,admin Jun 10 17:58:01.387671 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member,admin Jun 10 17:58:01.389088 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/3d8cc474ac2a4af78d80f0ad6caca119"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3d8cc474ac2a4af78d80f0ad6caca119"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3d8cc474ac2a4af78d80f0ad6caca119"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_3d8cc474ac2a4af78d80f0ad6caca119", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:01.389088 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-165782720 Jun 10 17:58:01.389088 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 3d8cc474ac2a4af78d80f0ad6caca119 Jun 10 17:58:01.389088 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-165782720 Jun 10 17:58:01.389088 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-165782720-project-admin Jun 10 17:58:01.389088 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 17:58:01.389088 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 17:58:01.389088 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 6183a9f452d84314bc9e48a59de5961d Jun 10 17:58:01.389088 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-165782720-project-admin Jun 10 17:58:01.389088 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 17:58:01.389088 chdv-master-2 devstack@n-api.service[126595]: exception: No hypervisor matching '0eb3876b-3e3b-4259-85b3-7230b293f725' could be found. Jun 10 17:58:01.389088 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '0eb3876b-3e3b-4259-85b3-7230b293f725'} Jun 10 17:58:01.389897 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:01.389897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:01.389897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:01.389897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:01.389897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:01.389897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:01.389897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 17:58:01.389897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 17:58:01.389897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:01.389897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:01.389897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Jun 10 17:58:01.389897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jun 10 17:58:01.389897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jun 10 17:58:01.389897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 10 17:58:01.389897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '0eb3876b-3e3b-4259-85b3-7230b293f725' could be found. Jun 10 17:58:01.389897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:01.389897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:01.389897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:01.389897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:01.391663 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:01.391663 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:01.391663 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:58:01.391663 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:58:01.391663 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '0eb3876b-3e3b-4259-85b3-7230b293f725' could be found. Jun 10 17:58:01.391663 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:01.394686 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-17395b77-8ca3-4018-8aa9-cf8992feb479 tempest-HypervisorAdminNegativeUnderV252Test-165782720 tempest-HypervisorAdminNegativeUnderV252Test-165782720-project-admin] Returning 404 to user: No hypervisor matching '0eb3876b-3e3b-4259-85b3-7230b293f725' could be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:01.395795 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-17395b77-8ca3-4018-8aa9-cf8992feb479 tempest-HypervisorAdminNegativeUnderV252Test-165782720 tempest-HypervisorAdminNegativeUnderV252Test-165782720-project-admin] 10.222.0.35 "GET /compute/v2.1/os-hypervisors/0eb3876b-3e3b-4259-85b3-7230b293f725/servers" status: 404 len: 123 microversion: 2.1 time: 0.045887 Jun 10 17:58:01.407089 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 58/113] 10.222.0.35 () {58 vars in 1280 bytes} [Fri Jun 10 17:58:01 2022] GET /compute/v2.1/os-hypervisors/0eb3876b-3e3b-4259-85b3-7230b293f725/servers => generated 123 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:58:01.413016 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2c0b5d33-0ba5-47af-9146-8e82ee97f9a5 tempest-HypervisorAdminNegativeTestJSON-1312457403 tempest-HypervisorAdminNegativeTestJSON-1312457403-project-admin] Calling method '.version_select at 0x7f77c1d3b700>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:01.415320 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-2c0b5d33-0ba5-47af-9146-8e82ee97f9a5 tempest-HypervisorAdminNegativeTestJSON-1312457403 tempest-HypervisorAdminNegativeTestJSON-1312457403-project-admin] HTTP exception thrown: Hypervisor with ID '5138bc43-2ee5-415b-a9e1-269d453c70bf' could not be found. Jun 10 17:58:01.427959 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2c0b5d33-0ba5-47af-9146-8e82ee97f9a5 tempest-HypervisorAdminNegativeTestJSON-1312457403 tempest-HypervisorAdminNegativeTestJSON-1312457403-project-admin] Request method failure captured: Jun 10 17:58:01.427959 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/os-hypervisors/5138bc43-2ee5-415b-a9e1-269d453c70bf/uptime HTTP/1.1 Jun 10 17:58:01.427959 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 17:58:01.427959 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 17:58:01.427959 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 17:58:01.427959 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 17:58:01.427959 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 17:58:01.427959 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 17:58:01.427959 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 17:58:01.427959 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:01.427959 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4YoefQdB1zZkVgoXRQAA62wzKDGOH397HKben4sJWo-mYXU2WS3pqdPLtNa09hTZ-yON8RvufprF4uBI4GrDfnbD4CSsPbGvzCiGOt1ZOzddfj3pbCFLIUmvsCp1-OYm8_hv0Phma1CBzcv1rmR0XUkTXfAyldPRnl0sREFASoDixw Jun 10 17:58:01.427959 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 17:58:01.427959 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 17:58:01.427959 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 17:58:01.427959 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 17:58:01.427959 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 17:58:01.427959 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 17:58:01.427959 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 23fc17c6528048cb8308174220bc5eac Jun 10 17:58:01.427959 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1312457403 Jun 10 17:58:01.427959 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member,admin Jun 10 17:58:01.427959 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member,admin Jun 10 17:58:01.429271 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/23fc17c6528048cb8308174220bc5eac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/23fc17c6528048cb8308174220bc5eac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/23fc17c6528048cb8308174220bc5eac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_23fc17c6528048cb8308174220bc5eac", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:01.429271 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1312457403 Jun 10 17:58:01.429271 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 23fc17c6528048cb8308174220bc5eac Jun 10 17:58:01.429271 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1312457403 Jun 10 17:58:01.429271 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-HypervisorAdminNegativeTestJSON-1312457403-project-admin Jun 10 17:58:01.429271 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 17:58:01.429271 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 17:58:01.429271 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: ce0f31143a034fafba9eb688d269336b Jun 10 17:58:01.429271 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1312457403-project-admin Jun 10 17:58:01.429271 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 17:58:01.429271 chdv-master-2 devstack@n-api.service[126595]: exception: Hypervisor with ID '5138bc43-2ee5-415b-a9e1-269d453c70bf' could not be found. Jun 10 17:58:01.429271 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '5138bc43-2ee5-415b-a9e1-269d453c70bf'} Jun 10 17:58:01.429975 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:01.429975 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:01.429975 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jun 10 17:58:01.429975 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jun 10 17:58:01.429975 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '5138bc43-2ee5-415b-a9e1-269d453c70bf' Jun 10 17:58:01.429975 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:01.429975 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:01.429975 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:01.429975 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:01.429975 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jun 10 17:58:01.429975 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jun 10 17:58:01.429975 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 509, in validate_integer Jun 10 17:58:01.429975 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jun 10 17:58:01.429975 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jun 10 17:58:01.429975 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:01.429975 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:01.429975 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:01.429975 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:01.429975 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jun 10 17:58:01.429975 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jun 10 17:58:01.429975 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jun 10 17:58:01.429975 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jun 10 17:58:01.433821 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jun 10 17:58:01.433821 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:01.433821 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:01.433821 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:01.433821 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:01.433821 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:01.433821 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:01.433821 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:01.433821 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:01.433821 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 17:58:01.433821 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 17:58:01.433821 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:01.433821 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:01.433821 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Jun 10 17:58:01.433821 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jun 10 17:58:01.433821 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jun 10 17:58:01.433821 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 10 17:58:01.433821 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '5138bc43-2ee5-415b-a9e1-269d453c70bf' could not be found. Jun 10 17:58:01.433821 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:01.433821 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:01.433821 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:01.442113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:01.442113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:01.442113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:01.442113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:58:01.442113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:58:01.442113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '5138bc43-2ee5-415b-a9e1-269d453c70bf' could not be found. Jun 10 17:58:01.442113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:01.447856 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2c0b5d33-0ba5-47af-9146-8e82ee97f9a5 tempest-HypervisorAdminNegativeTestJSON-1312457403 tempest-HypervisorAdminNegativeTestJSON-1312457403-project-admin] Returning 404 to user: Hypervisor with ID '5138bc43-2ee5-415b-a9e1-269d453c70bf' could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:01.449003 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2c0b5d33-0ba5-47af-9146-8e82ee97f9a5 tempest-HypervisorAdminNegativeTestJSON-1312457403 tempest-HypervisorAdminNegativeTestJSON-1312457403-project-admin] 10.222.0.35 "GET /compute/v2.1/os-hypervisors/5138bc43-2ee5-415b-a9e1-269d453c70bf/uptime" status: 404 len: 123 microversion: 2.1 time: 0.040701 Jun 10 17:58:01.450681 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 59/114] 10.222.0.35 () {58 vars in 1277 bytes} [Fri Jun 10 17:58:01 2022] GET /compute/v2.1/os-hypervisors/5138bc43-2ee5-415b-a9e1-269d453c70bf/uptime => generated 123 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:58:01.460957 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ca2ebab1-2ed1-481b-9854-90abfca6a2a3 tempest-HypervisorAdminNegativeTestJSON-1312457403 tempest-HypervisorAdminNegativeTestJSON-1312457403-project-admin] Calling method '.version_select at 0x7f77c1f3ef70>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:01.465589 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:01.465589 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:01.465589 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ca2ebab1-2ed1-481b-9854-90abfca6a2a3 tempest-HypervisorAdminNegativeTestJSON-1312457403 tempest-HypervisorAdminNegativeTestJSON-1312457403-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:01.465589 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ca2ebab1-2ed1-481b-9854-90abfca6a2a3 tempest-HypervisorAdminNegativeTestJSON-1312457403 tempest-HypervisorAdminNegativeTestJSON-1312457403-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:01.510420 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ca2ebab1-2ed1-481b-9854-90abfca6a2a3 tempest-HypervisorAdminNegativeTestJSON-1312457403 tempest-HypervisorAdminNegativeTestJSON-1312457403-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:01.510420 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ca2ebab1-2ed1-481b-9854-90abfca6a2a3 tempest-HypervisorAdminNegativeTestJSON-1312457403 tempest-HypervisorAdminNegativeTestJSON-1312457403-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:01.533125 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ca2ebab1-2ed1-481b-9854-90abfca6a2a3 tempest-HypervisorAdminNegativeTestJSON-1312457403 tempest-HypervisorAdminNegativeTestJSON-1312457403-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:01.533771 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ca2ebab1-2ed1-481b-9854-90abfca6a2a3 tempest-HypervisorAdminNegativeTestJSON-1312457403 tempest-HypervisorAdminNegativeTestJSON-1312457403-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:01.543882 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ca2ebab1-2ed1-481b-9854-90abfca6a2a3 tempest-HypervisorAdminNegativeTestJSON-1312457403 tempest-HypervisorAdminNegativeTestJSON-1312457403-project-admin] 10.222.0.35 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.088113 Jun 10 17:58:01.556057 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 60/115] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 17:58:01 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:01.561820 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fa5d6431-ee65-4ce7-ad68-c1c49d5fb268 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:01.562524 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fa5d6431-ee65-4ce7-ad68-c1c49d5fb268 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: c9b75acf-e4fe-425e-9398-40c4ac1a108b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:01.571766 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa5d6431-ee65-4ce7-ad68-c1c49d5fb268 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:01.572225 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa5d6431-ee65-4ce7-ad68-c1c49d5fb268 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:01.573157 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa5d6431-ee65-4ce7-ad68-c1c49d5fb268 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:01.573626 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa5d6431-ee65-4ce7-ad68-c1c49d5fb268 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:01.725531 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a791db98-1ecc-4997-9fe1-b80e8cdb7d5f tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:01.739492 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a791db98-1ecc-4997-9fe1-b80e8cdb7d5f tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9" status: 200 len: 1320 microversion: 2.1 time: 0.522974 Jun 10 17:58:01.740400 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 56/116] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:01 2022] GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9 => generated 1320 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:01.748891 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c5951ebb-e706-40b4-9c9b-05e8db69bad3 tempest-HypervisorAdminNegativeTestJSON-2028855098 tempest-HypervisorAdminNegativeTestJSON-2028855098-project] Calling method '.version_select at 0x7f77c1c44af0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:01.749915 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:01.749915 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:01.751857 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c5951ebb-e706-40b4-9c9b-05e8db69bad3 tempest-HypervisorAdminNegativeTestJSON-2028855098 tempest-HypervisorAdminNegativeTestJSON-2028855098-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '7b618b63ed1644a19e0b553af4db9b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1625decf872c4b2a9e3ccab53f49454a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:01.752387 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fa5d6431-ee65-4ce7-ad68-c1c49d5fb268 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:01.754895 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c5951ebb-e706-40b4-9c9b-05e8db69bad3 tempest-HypervisorAdminNegativeTestJSON-2028855098 tempest-HypervisorAdminNegativeTestJSON-2028855098-project] Request method failure captured: Jun 10 17:58:01.754895 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Jun 10 17:58:01.754895 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 17:58:01.754895 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 17:58:01.754895 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 17:58:01.754895 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 17:58:01.754895 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 17:58:01.754895 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 17:58:01.754895 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 17:58:01.754895 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:01.754895 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4YmjTPnfli0JCy670GxwZxWfz7nmPZ391tjeu5Hx4ix1mTlIbvBBavB80DuIwygN58aiKznB8wVNwkYnhaDedXD91eaPeYD3toJJzp0p2AolRa48O_Mfo9qGlmVyTdOCXKI69XRdP4AkEh5jW517aDnKUjGeJwy7myRJRyZdQmWAK0 Jun 10 17:58:01.754895 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 17:58:01.754895 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 17:58:01.754895 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 17:58:01.754895 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 17:58:01.754895 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 17:58:01.754895 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 17:58:01.754895 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 1625decf872c4b2a9e3ccab53f49454a Jun 10 17:58:01.754895 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2028855098 Jun 10 17:58:01.754895 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 17:58:01.754895 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 17:58:01.756389 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1625decf872c4b2a9e3ccab53f49454a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1625decf872c4b2a9e3ccab53f49454a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1625decf872c4b2a9e3ccab53f49454a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1625decf872c4b2a9e3ccab53f49454a", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:01.756389 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2028855098 Jun 10 17:58:01.756389 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 1625decf872c4b2a9e3ccab53f49454a Jun 10 17:58:01.756389 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2028855098 Jun 10 17:58:01.756389 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-HypervisorAdminNegativeTestJSON-2028855098-project Jun 10 17:58:01.756389 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 17:58:01.756389 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 17:58:01.756389 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 7b618b63ed1644a19e0b553af4db9b0f Jun 10 17:58:01.756389 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2028855098-project Jun 10 17:58:01.756389 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 17:58:01.756389 chdv-master-2 devstack@n-api.service[126594]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jun 10 17:58:01.756389 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '1'} Jun 10 17:58:01.756389 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:01.757107 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:01.757107 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:01.757107 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:01.757107 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:01.757107 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:01.757107 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 17:58:01.757107 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 17:58:01.757107 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:01.757107 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:01.757107 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jun 10 17:58:01.757107 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jun 10 17:58:01.757107 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Jun 10 17:58:01.757107 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Jun 10 17:58:01.757107 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 10 17:58:01.757107 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 10 17:58:01.757107 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 10 17:58:01.757107 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 10 17:58:01.757107 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 17:58:01.757107 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 17:58:01.758181 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 17:58:01.758181 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 17:58:01.758181 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 10 17:58:01.758181 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 10 17:58:01.758181 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 10 17:58:01.758181 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 10 17:58:01.758181 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 10 17:58:01.758181 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 10 17:58:01.758181 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jun 10 17:58:01.758181 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:01.758181 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:01.758181 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:01.758181 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:01.758181 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:01.758181 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:01.758181 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 10 17:58:01.758181 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 10 17:58:01.758181 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jun 10 17:58:01.758181 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:01.760055 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c5951ebb-e706-40b4-9c9b-05e8db69bad3 tempest-HypervisorAdminNegativeTestJSON-2028855098 tempest-HypervisorAdminNegativeTestJSON-2028855098-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:01.761182 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c5951ebb-e706-40b4-9c9b-05e8db69bad3 tempest-HypervisorAdminNegativeTestJSON-2028855098 tempest-HypervisorAdminNegativeTestJSON-2028855098-project] 10.222.0.35 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.019564 Jun 10 17:58:01.766416 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 57/117] 10.222.0.35 () {58 vars in 1151 bytes} [Fri Jun 10 17:58:01 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:58:01.772540 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fa5d6431-ee65-4ce7-ad68-c1c49d5fb268 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b" status: 200 len: 1322 microversion: 2.1 time: 0.214938 Jun 10 17:58:01.774614 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 61/118] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:01 2022] GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:01.775603 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b8379ff4-d965-431f-8703-eb4c38cd0eb1 tempest-HypervisorAdminNegativeTestJSON-1312457403 tempest-HypervisorAdminNegativeTestJSON-1312457403-project-admin] Calling method '.version_select at 0x7f77c1bdbdc0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:01.777655 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-b8379ff4-d965-431f-8703-eb4c38cd0eb1 tempest-HypervisorAdminNegativeTestJSON-1312457403 tempest-HypervisorAdminNegativeTestJSON-1312457403-project-admin] HTTP exception thrown: Hypervisor with ID 'c0ca9eed-e3ff-4cc0-95c6-939604bc6c49' could not be found. Jun 10 17:58:01.780425 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b8379ff4-d965-431f-8703-eb4c38cd0eb1 tempest-HypervisorAdminNegativeTestJSON-1312457403 tempest-HypervisorAdminNegativeTestJSON-1312457403-project-admin] Request method failure captured: Jun 10 17:58:01.780425 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/os-hypervisors/c0ca9eed-e3ff-4cc0-95c6-939604bc6c49 HTTP/1.1 Jun 10 17:58:01.780425 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 17:58:01.780425 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 17:58:01.780425 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 17:58:01.780425 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 17:58:01.780425 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 17:58:01.780425 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 17:58:01.780425 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 17:58:01.780425 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:01.780425 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4YoefQdB1zZkVgoXRQAA62wzKDGOH397HKben4sJWo-mYXU2WS3pqdPLtNa09hTZ-yON8RvufprF4uBI4GrDfnbD4CSsPbGvzCiGOt1ZOzddfj3pbCFLIUmvsCp1-OYm8_hv0Phma1CBzcv1rmR0XUkTXfAyldPRnl0sREFASoDixw Jun 10 17:58:01.780425 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 17:58:01.780425 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 17:58:01.780425 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 17:58:01.780425 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 17:58:01.780425 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 17:58:01.780425 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 17:58:01.780425 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 23fc17c6528048cb8308174220bc5eac Jun 10 17:58:01.780425 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1312457403 Jun 10 17:58:01.780425 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member,admin Jun 10 17:58:01.780425 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member,admin Jun 10 17:58:01.782146 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/23fc17c6528048cb8308174220bc5eac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/23fc17c6528048cb8308174220bc5eac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/23fc17c6528048cb8308174220bc5eac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_23fc17c6528048cb8308174220bc5eac", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:01.782146 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1312457403 Jun 10 17:58:01.782146 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 23fc17c6528048cb8308174220bc5eac Jun 10 17:58:01.782146 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1312457403 Jun 10 17:58:01.782146 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-HypervisorAdminNegativeTestJSON-1312457403-project-admin Jun 10 17:58:01.782146 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 17:58:01.782146 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 17:58:01.782146 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: ce0f31143a034fafba9eb688d269336b Jun 10 17:58:01.782146 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1312457403-project-admin Jun 10 17:58:01.782146 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 17:58:01.782146 chdv-master-2 devstack@n-api.service[126594]: exception: Hypervisor with ID 'c0ca9eed-e3ff-4cc0-95c6-939604bc6c49' could not be found. Jun 10 17:58:01.782146 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'c0ca9eed-e3ff-4cc0-95c6-939604bc6c49'} Jun 10 17:58:01.783039 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:01.783039 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:01.783039 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jun 10 17:58:01.783039 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jun 10 17:58:01.783039 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'c0ca9eed-e3ff-4cc0-95c6-939604bc6c49' Jun 10 17:58:01.783039 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:01.783039 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:01.783039 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:01.783039 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:01.783039 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jun 10 17:58:01.783039 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jun 10 17:58:01.783039 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 509, in validate_integer Jun 10 17:58:01.783039 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jun 10 17:58:01.783039 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jun 10 17:58:01.783039 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:01.783039 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:01.783039 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:01.783039 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:01.783039 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jun 10 17:58:01.783039 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jun 10 17:58:01.783039 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jun 10 17:58:01.783039 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jun 10 17:58:01.784464 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jun 10 17:58:01.784464 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:01.784464 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:01.784464 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:01.784464 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:01.784464 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:01.784464 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:01.784464 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:01.784464 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:01.784464 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 17:58:01.784464 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 17:58:01.784464 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:01.784464 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:01.784464 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jun 10 17:58:01.784464 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jun 10 17:58:01.784464 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Jun 10 17:58:01.784464 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jun 10 17:58:01.784464 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jun 10 17:58:01.784464 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 10 17:58:01.784464 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'c0ca9eed-e3ff-4cc0-95c6-939604bc6c49' could not be found. Jun 10 17:58:01.788420 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:01.788420 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:01.788420 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:01.788420 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:01.788420 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:01.788420 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:01.788420 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:58:01.788420 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:58:01.788420 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'c0ca9eed-e3ff-4cc0-95c6-939604bc6c49' could not be found. Jun 10 17:58:01.788420 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:01.790627 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b8379ff4-d965-431f-8703-eb4c38cd0eb1 tempest-HypervisorAdminNegativeTestJSON-1312457403 tempest-HypervisorAdminNegativeTestJSON-1312457403-project-admin] Returning 404 to user: Hypervisor with ID 'c0ca9eed-e3ff-4cc0-95c6-939604bc6c49' could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:01.792420 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b8379ff4-d965-431f-8703-eb4c38cd0eb1 tempest-HypervisorAdminNegativeTestJSON-1312457403 tempest-HypervisorAdminNegativeTestJSON-1312457403-project-admin] 10.222.0.35 "GET /compute/v2.1/os-hypervisors/c0ca9eed-e3ff-4cc0-95c6-939604bc6c49" status: 404 len: 123 microversion: 2.1 time: 0.021287 Jun 10 17:58:01.793121 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 58/119] 10.222.0.35 () {58 vars in 1256 bytes} [Fri Jun 10 17:58:01 2022] GET /compute/v2.1/os-hypervisors/c0ca9eed-e3ff-4cc0-95c6-939604bc6c49 => generated 123 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 17:58:02.015378 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1eedbcd2-b01f-417e-bcae-cb5265f3bda0 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:02.016836 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1eedbcd2-b01f-417e-bcae-cb5265f3bda0 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] [instance: 6467b83c-72e4-4991-a025-4690618f1115] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:02.024954 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1eedbcd2-b01f-417e-bcae-cb5265f3bda0 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:02.025725 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1eedbcd2-b01f-417e-bcae-cb5265f3bda0 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:02.026820 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1eedbcd2-b01f-417e-bcae-cb5265f3bda0 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:02.027436 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1eedbcd2-b01f-417e-bcae-cb5265f3bda0 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:02.178494 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-af24c8b0-9d44-4d7b-b670-2099e0825ba1 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-331384833", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "86660298", "adminPass": "***", "networks": [{"uuid": "776e9bc3-bafc-4b0d-95a2-00c1440a80e2"}], "security_groups": [{"name": "tempest-securitygroup--156882094"}], "key_name": "tempest-keypair-723378704", "user_data": "}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:02.224640 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1eedbcd2-b01f-417e-bcae-cb5265f3bda0 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77dc782a65b645c7a534aabc90d09110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066ae7d9e1564b91bbbaea7ff17dc789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:02.232204 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1eedbcd2-b01f-417e-bcae-cb5265f3bda0 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] 10.222.0.35 "GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115" status: 200 len: 1339 microversion: 2.1 time: 0.223221 Jun 10 17:58:02.242362 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 62/120] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:02 2022] GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115 => generated 1339 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:02.367013 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-af24c8b0-9d44-4d7b-b670-2099e0825ba1 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] validate_networks() for [('776e9bc3-bafc-4b0d-95a2-00c1440a80e2', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 17:58:02.715886 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-9bb3c009-4c10-408a-8471-82a6121d4fdb req-10b95815-3cf7-45c3-ab63-8901b4665ee1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6467b83c-72e4-4991-a025-4690618f1115", "name": "network-vif-plugged", "status": "completed", "tag": "f25b2fab-dcfe-4c76-94a6-d6033e93124d"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:02.743557 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-9bb3c009-4c10-408a-8471-82a6121d4fdb req-10b95815-3cf7-45c3-ab63-8901b4665ee1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:02.744080 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-9bb3c009-4c10-408a-8471-82a6121d4fdb req-10b95815-3cf7-45c3-ab63-8901b4665ee1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:02.793207 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-9bb3c009-4c10-408a-8471-82a6121d4fdb req-10b95815-3cf7-45c3-ab63-8901b4665ee1 service nova] Creating event network-vif-plugged:f25b2fab-dcfe-4c76-94a6-d6033e93124d for instance 6467b83c-72e4-4991-a025-4690618f1115 on chh1-master-2 Jun 10 17:58:02.793920 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-9bb3c009-4c10-408a-8471-82a6121d4fdb req-10b95815-3cf7-45c3-ab63-8901b4665ee1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=126595) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 10 17:58:02.795578 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3a88ff56-dab9-40b5-ad16-1f4325521f07 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:02.796163 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3a88ff56-dab9-40b5-ad16-1f4325521f07 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:02.797151 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3a88ff56-dab9-40b5-ad16-1f4325521f07 None None] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:02.797751 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3a88ff56-dab9-40b5-ad16-1f4325521f07 None None] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:02.808129 chdv-master-2 devstack@n-api.service[126595]: INFO nova.compute.rpcapi [None req-3a88ff56-dab9-40b5-ad16-1f4325521f07 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 10 17:58:02.809057 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3a88ff56-dab9-40b5-ad16-1f4325521f07 None None] Releasing lock "compute-rpcapi-router" {{(pid=126595) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 10 17:58:02.839679 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3a88ff56-dab9-40b5-ad16-1f4325521f07 None None] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.356870 Jun 10 17:58:02.842634 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 63/121] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 17:58:02.854430 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8deb23d4-5820-4780-ab7e-c5ddb847a66b tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:02.861806 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8deb23d4-5820-4780-ab7e-c5ddb847a66b tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 4ef38095-36e0-4792-9516-caf76a5022c9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:02.876771 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8deb23d4-5820-4780-ab7e-c5ddb847a66b tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:02.877275 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8deb23d4-5820-4780-ab7e-c5ddb847a66b tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:02.878124 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8deb23d4-5820-4780-ab7e-c5ddb847a66b tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:02.893631 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8deb23d4-5820-4780-ab7e-c5ddb847a66b tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:02.912089 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:58:03.136009 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8deb23d4-5820-4780-ab7e-c5ddb847a66b tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:03.149885 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8deb23d4-5820-4780-ab7e-c5ddb847a66b tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9" status: 200 len: 1320 microversion: 2.1 time: 0.303576 Jun 10 17:58:03.152989 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 64/122] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:02 2022] GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9 => generated 1320 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:03.161155 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7d805a55-645a-4fde-8a6e-285a24760641 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:03.161840 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7d805a55-645a-4fde-8a6e-285a24760641 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: c9b75acf-e4fe-425e-9398-40c4ac1a108b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:03.167894 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7d805a55-645a-4fde-8a6e-285a24760641 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:03.168382 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7d805a55-645a-4fde-8a6e-285a24760641 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:03.169158 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7d805a55-645a-4fde-8a6e-285a24760641 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:03.170679 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7d805a55-645a-4fde-8a6e-285a24760641 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:03.409952 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7d805a55-645a-4fde-8a6e-285a24760641 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:03.419370 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7d805a55-645a-4fde-8a6e-285a24760641 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b" status: 200 len: 1322 microversion: 2.1 time: 0.265047 Jun 10 17:58:03.420919 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 65/123] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:03 2022] GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b => generated 1322 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:03.432258 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-59b44156-e31b-44fa-be92-4c27decabd63 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:03.432971 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-59b44156-e31b-44fa-be92-4c27decabd63 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] [instance: 6467b83c-72e4-4991-a025-4690618f1115] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:03.453176 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-59b44156-e31b-44fa-be92-4c27decabd63 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:03.454090 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-59b44156-e31b-44fa-be92-4c27decabd63 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:03.455046 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-59b44156-e31b-44fa-be92-4c27decabd63 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:03.455659 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-59b44156-e31b-44fa-be92-4c27decabd63 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:03.764898 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-af24c8b0-9d44-4d7b-b670-2099e0825ba1 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 17:58:03.765580 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-af24c8b0-9d44-4d7b-b670-2099e0825ba1 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 17:58:03.766216 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-af24c8b0-9d44-4d7b-b670-2099e0825ba1 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 17:58:03.767054 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-af24c8b0-9d44-4d7b-b670-2099e0825ba1 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 17:58:03.767852 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-af24c8b0-9d44-4d7b-b670-2099e0825ba1 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 17:58:03.772047 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:RELEASE=1,nova_api:SELECT=92,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:58:03.774261 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-59b44156-e31b-44fa-be92-4c27decabd63 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77dc782a65b645c7a534aabc90d09110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066ae7d9e1564b91bbbaea7ff17dc789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:03.783698 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-af24c8b0-9d44-4d7b-b670-2099e0825ba1 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:03.783698 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-af24c8b0-9d44-4d7b-b670-2099e0825ba1 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:03.783698 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-af24c8b0-9d44-4d7b-b670-2099e0825ba1 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:03.784018 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-59b44156-e31b-44fa-be92-4c27decabd63 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] 10.222.0.35 "GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115" status: 200 len: 1339 microversion: 2.1 time: 0.361395 Jun 10 17:58:03.784111 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-af24c8b0-9d44-4d7b-b670-2099e0825ba1 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:03.784414 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 66/124] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:03 2022] GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115 => generated 1339 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:03.824683 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-af24c8b0-9d44-4d7b-b670-2099e0825ba1 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Getting quotas for project ef9d5dac7c8243aeaa207c5a1ecb399a. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 17:58:03.826020 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-af24c8b0-9d44-4d7b-b670-2099e0825ba1 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Getting quotas for user 329e5bd8a55d42cdb7879fbead65627a and project ef9d5dac7c8243aeaa207c5a1ecb399a. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 17:58:03.843707 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-af24c8b0-9d44-4d7b-b670-2099e0825ba1 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 17:58:03.847916 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-af24c8b0-9d44-4d7b-b670-2099e0825ba1 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 17:58:03.961820 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-af24c8b0-9d44-4d7b-b670-2099e0825ba1 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.792040 Jun 10 17:58:03.962460 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 59/125] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:58:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 1793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 10 17:58:03.977151 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-aa1a131c-380c-4fae-b6ed-49b428443837 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:03.977151 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-aa1a131c-380c-4fae-b6ed-49b428443837 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:04.088114 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-aa1a131c-380c-4fae-b6ed-49b428443837 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e5bd8a55d42cdb7879fbead65627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9d5dac7c8243aeaa207c5a1ecb399a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:04.100090 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-aa1a131c-380c-4fae-b6ed-49b428443837 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "GET /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2" status: 200 len: 1259 microversion: 2.1 time: 0.130753 Jun 10 17:58:04.110522 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 67/126] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:03 2022] GET /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 => generated 1259 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:04.166606 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3f1bb2ea-d1fd-4dca-ab52-a8164c649a1b tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:04.173314 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3f1bb2ea-d1fd-4dca-ab52-a8164c649a1b tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 4ef38095-36e0-4792-9516-caf76a5022c9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:04.180224 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f1bb2ea-d1fd-4dca-ab52-a8164c649a1b tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:04.180771 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f1bb2ea-d1fd-4dca-ab52-a8164c649a1b tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:04.181646 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f1bb2ea-d1fd-4dca-ab52-a8164c649a1b tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:04.182225 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f1bb2ea-d1fd-4dca-ab52-a8164c649a1b tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:04.330796 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3f1bb2ea-d1fd-4dca-ab52-a8164c649a1b tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:04.338172 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3f1bb2ea-d1fd-4dca-ab52-a8164c649a1b tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9" status: 200 len: 1320 microversion: 2.1 time: 0.175922 Jun 10 17:58:04.338735 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 60/127] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:04 2022] GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9 => generated 1320 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:04.439121 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4e30eb70-ccfb-449e-a782-d8e5c635f65b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:04.439875 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4e30eb70-ccfb-449e-a782-d8e5c635f65b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: c9b75acf-e4fe-425e-9398-40c4ac1a108b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:04.445332 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=7 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:58:04.447166 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e30eb70-ccfb-449e-a782-d8e5c635f65b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:04.447859 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e30eb70-ccfb-449e-a782-d8e5c635f65b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:04.449017 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e30eb70-ccfb-449e-a782-d8e5c635f65b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:04.451422 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e30eb70-ccfb-449e-a782-d8e5c635f65b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:04.590597 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4e30eb70-ccfb-449e-a782-d8e5c635f65b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:04.598379 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4e30eb70-ccfb-449e-a782-d8e5c635f65b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b" status: 200 len: 1322 microversion: 2.1 time: 0.163277 Jun 10 17:58:04.598950 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 68/128] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:04 2022] GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:04.800278 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-be94e907-ee25-4cb4-9ab6-a8c54bb7b87e tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:04.801060 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-be94e907-ee25-4cb4-9ab6-a8c54bb7b87e tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] [instance: 6467b83c-72e4-4991-a025-4690618f1115] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:04.807841 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be94e907-ee25-4cb4-9ab6-a8c54bb7b87e tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:04.808329 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be94e907-ee25-4cb4-9ab6-a8c54bb7b87e tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:04.809100 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be94e907-ee25-4cb4-9ab6-a8c54bb7b87e tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:04.809544 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be94e907-ee25-4cb4-9ab6-a8c54bb7b87e tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:05.011895 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-be94e907-ee25-4cb4-9ab6-a8c54bb7b87e tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77dc782a65b645c7a534aabc90d09110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066ae7d9e1564b91bbbaea7ff17dc789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:05.025613 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-be94e907-ee25-4cb4-9ab6-a8c54bb7b87e tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] 10.222.0.35 "GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115" status: 200 len: 1339 microversion: 2.1 time: 0.228779 Jun 10 17:58:05.029186 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 61/129] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:04 2022] GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115 => generated 1339 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:05.127105 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-628912c5-7ce8-4399-9b71-86b0f44de4d8 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:05.127805 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-628912c5-7ce8-4399-9b71-86b0f44de4d8 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:05.135004 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-628912c5-7ce8-4399-9b71-86b0f44de4d8 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:05.135460 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-628912c5-7ce8-4399-9b71-86b0f44de4d8 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:05.138681 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-628912c5-7ce8-4399-9b71-86b0f44de4d8 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:05.138681 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-628912c5-7ce8-4399-9b71-86b0f44de4d8 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:05.217535 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-628912c5-7ce8-4399-9b71-86b0f44de4d8 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e5bd8a55d42cdb7879fbead65627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9d5dac7c8243aeaa207c5a1ecb399a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:05.226911 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-628912c5-7ce8-4399-9b71-86b0f44de4d8 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "GET /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2" status: 200 len: 1285 microversion: 2.1 time: 0.104613 Jun 10 17:58:05.227529 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 69/130] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:05 2022] GET /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 => generated 1285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:05.355956 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f102bcba-4053-41d5-b6ec-233966b6647b tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:05.356619 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f102bcba-4053-41d5-b6ec-233966b6647b tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 4ef38095-36e0-4792-9516-caf76a5022c9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:05.363467 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f102bcba-4053-41d5-b6ec-233966b6647b tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:05.363971 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f102bcba-4053-41d5-b6ec-233966b6647b tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:05.364791 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f102bcba-4053-41d5-b6ec-233966b6647b tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:05.365235 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f102bcba-4053-41d5-b6ec-233966b6647b tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:05.539341 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f102bcba-4053-41d5-b6ec-233966b6647b tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:05.549074 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f102bcba-4053-41d5-b6ec-233966b6647b tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9" status: 200 len: 1320 microversion: 2.1 time: 0.196544 Jun 10 17:58:05.558423 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 62/131] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:05 2022] GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9 => generated 1320 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:05.616277 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ad3b8a82-68e5-4eab-bcf9-602419d30d2b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:05.617090 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ad3b8a82-68e5-4eab-bcf9-602419d30d2b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: c9b75acf-e4fe-425e-9398-40c4ac1a108b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:05.623460 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad3b8a82-68e5-4eab-bcf9-602419d30d2b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:05.623916 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad3b8a82-68e5-4eab-bcf9-602419d30d2b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:05.624721 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad3b8a82-68e5-4eab-bcf9-602419d30d2b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:05.625198 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad3b8a82-68e5-4eab-bcf9-602419d30d2b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:05.774349 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ad3b8a82-68e5-4eab-bcf9-602419d30d2b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:05.783342 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ad3b8a82-68e5-4eab-bcf9-602419d30d2b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b" status: 200 len: 1322 microversion: 2.1 time: 0.170656 Jun 10 17:58:05.784549 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 70/132] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:05 2022] GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:06.042030 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-35f55e34-2e18-4d8a-8407-d2b43f3511dd tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:06.042676 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-35f55e34-2e18-4d8a-8407-d2b43f3511dd tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] [instance: 6467b83c-72e4-4991-a025-4690618f1115] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:06.048629 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-35f55e34-2e18-4d8a-8407-d2b43f3511dd tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:06.049083 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-35f55e34-2e18-4d8a-8407-d2b43f3511dd tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:06.049850 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-35f55e34-2e18-4d8a-8407-d2b43f3511dd tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:06.050359 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-35f55e34-2e18-4d8a-8407-d2b43f3511dd tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:06.203971 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-35f55e34-2e18-4d8a-8407-d2b43f3511dd tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77dc782a65b645c7a534aabc90d09110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066ae7d9e1564b91bbbaea7ff17dc789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:06.216045 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-35f55e34-2e18-4d8a-8407-d2b43f3511dd tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] 10.222.0.35 "GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115" status: 200 len: 1489 microversion: 2.1 time: 0.177664 Jun 10 17:58:06.228327 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 71/133] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:06 2022] GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115 => generated 1489 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:58:06.233378 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6d3c5f61-56f5-4a40-b973-a17748d520da tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:06.238777 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6d3c5f61-56f5-4a40-b973-a17748d520da tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] [instance: 6467b83c-72e4-4991-a025-4690618f1115] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:06.240743 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d3c5f61-56f5-4a40-b973-a17748d520da tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:06.241264 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d3c5f61-56f5-4a40-b973-a17748d520da tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:06.242105 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d3c5f61-56f5-4a40-b973-a17748d520da tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:06.242634 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d3c5f61-56f5-4a40-b973-a17748d520da tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:06.286746 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0b21aff1-2913-4e3c-b77b-e43fda5ef585 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1572531091", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:06.348500 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-0b21aff1-2913-4e3c-b77b-e43fda5ef585 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] validate_networks() for None {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 17:58:06.680846 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-0b21aff1-2913-4e3c-b77b-e43fda5ef585 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 17:58:06.680846 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-0b21aff1-2913-4e3c-b77b-e43fda5ef585 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 17:58:06.680846 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-0b21aff1-2913-4e3c-b77b-e43fda5ef585 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 17:58:06.680846 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-0b21aff1-2913-4e3c-b77b-e43fda5ef585 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 17:58:06.680846 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-0b21aff1-2913-4e3c-b77b-e43fda5ef585 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 17:58:06.683645 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6d3c5f61-56f5-4a40-b973-a17748d520da tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115" status: 200 len: 1640 microversion: 2.1 time: 0.453741 Jun 10 17:58:06.685245 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0b21aff1-2913-4e3c-b77b-e43fda5ef585 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:06.686508 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0b21aff1-2913-4e3c-b77b-e43fda5ef585 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:06.688134 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0b21aff1-2913-4e3c-b77b-e43fda5ef585 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:06.688905 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0b21aff1-2913-4e3c-b77b-e43fda5ef585 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:06.690185 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 72/134] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:06 2022] GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115 => generated 1640 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:06.707461 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7c4e3b90-d8a1-4fbd-8356-c70a4a598136 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:06.708066 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7c4e3b90-d8a1-4fbd-8356-c70a4a598136 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:06.715779 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7c4e3b90-d8a1-4fbd-8356-c70a4a598136 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:06.716531 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7c4e3b90-d8a1-4fbd-8356-c70a4a598136 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:06.717459 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7c4e3b90-d8a1-4fbd-8356-c70a4a598136 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:06.718130 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7c4e3b90-d8a1-4fbd-8356-c70a4a598136 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:06.727658 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-0b21aff1-2913-4e3c-b77b-e43fda5ef585 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Getting quotas for project e1fd6bd677ff4b17bafee8fad1d720a6. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 17:58:06.740075 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-0b21aff1-2913-4e3c-b77b-e43fda5ef585 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Getting quotas for user c19776e5adf942c6a20e4dea1aa10cdd and project e1fd6bd677ff4b17bafee8fad1d720a6. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 17:58:06.754182 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0b21aff1-2913-4e3c-b77b-e43fda5ef585 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 17:58:06.756763 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0b21aff1-2913-4e3c-b77b-e43fda5ef585 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: ec39479e-5a78-42b6-b385-ceed608f0129] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 17:58:06.843163 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7c4e3b90-d8a1-4fbd-8356-c70a4a598136 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e5bd8a55d42cdb7879fbead65627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9d5dac7c8243aeaa207c5a1ecb399a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:06.853997 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7c4e3b90-d8a1-4fbd-8356-c70a4a598136 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "GET /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2" status: 200 len: 1351 microversion: 2.1 time: 0.162587 Jun 10 17:58:06.854792 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 73/135] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:06 2022] GET /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 => generated 1351 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:06.861939 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-949895fd-fee5-44d0-ad83-804d1a5c5677 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:06.862417 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-949895fd-fee5-44d0-ad83-804d1a5c5677 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 4ef38095-36e0-4792-9516-caf76a5022c9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:06.869130 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-949895fd-fee5-44d0-ad83-804d1a5c5677 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:06.869787 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-949895fd-fee5-44d0-ad83-804d1a5c5677 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:06.870785 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-949895fd-fee5-44d0-ad83-804d1a5c5677 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:06.871178 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-949895fd-fee5-44d0-ad83-804d1a5c5677 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:06.922642 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0b21aff1-2913-4e3c-b77b-e43fda5ef585 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.927577 Jun 10 17:58:06.923372 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 63/136] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:58:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 17:58:06.929118 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d482f330-5ceb-44e9-9bb7-fbf214015e81 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:06.929610 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d482f330-5ceb-44e9-9bb7-fbf214015e81 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] [instance: 6467b83c-72e4-4991-a025-4690618f1115] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:06.937717 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d482f330-5ceb-44e9-9bb7-fbf214015e81 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:06.938228 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d482f330-5ceb-44e9-9bb7-fbf214015e81 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:06.938999 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d482f330-5ceb-44e9-9bb7-fbf214015e81 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:06.939440 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d482f330-5ceb-44e9-9bb7-fbf214015e81 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:07.089683 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-949895fd-fee5-44d0-ad83-804d1a5c5677 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:07.099709 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-949895fd-fee5-44d0-ad83-804d1a5c5677 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9" status: 200 len: 1320 microversion: 2.1 time: 0.243594 Jun 10 17:58:07.102513 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 74/137] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:06 2022] GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9 => generated 1320 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:07.108465 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-19b9dc52-8f55-48e5-93ad-a71b7c989cd6 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:07.110154 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-19b9dc52-8f55-48e5-93ad-a71b7c989cd6 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: c9b75acf-e4fe-425e-9398-40c4ac1a108b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:07.120828 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-19b9dc52-8f55-48e5-93ad-a71b7c989cd6 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:07.126705 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-19b9dc52-8f55-48e5-93ad-a71b7c989cd6 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:07.126705 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-19b9dc52-8f55-48e5-93ad-a71b7c989cd6 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:07.126705 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-19b9dc52-8f55-48e5-93ad-a71b7c989cd6 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:07.213029 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d482f330-5ceb-44e9-9bb7-fbf214015e81 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] [instance: 6467b83c-72e4-4991-a025-4690618f1115] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 17:58:07.266608 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:58:07.317670 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-19b9dc52-8f55-48e5-93ad-a71b7c989cd6 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:07.325368 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-19b9dc52-8f55-48e5-93ad-a71b7c989cd6 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b" status: 200 len: 1322 microversion: 2.1 time: 0.221396 Jun 10 17:58:07.327142 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 75/138] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:07 2022] GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:07.333434 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f802e1fa-bdc1-4586-9399-e08f14462fd0 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:07.334219 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f802e1fa-bdc1-4586-9399-e08f14462fd0 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: ec39479e-5a78-42b6-b385-ceed608f0129] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:07.389038 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f802e1fa-bdc1-4586-9399-e08f14462fd0 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19776e5adf942c6a20e4dea1aa10cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1fd6bd677ff4b17bafee8fad1d720a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:07.396663 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f802e1fa-bdc1-4586-9399-e08f14462fd0 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "GET /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129" status: 200 len: 1219 microversion: 2.1 time: 0.067434 Jun 10 17:58:07.398356 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 76/139] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:07 2022] GET /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:07.589735 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d482f330-5ceb-44e9-9bb7-fbf214015e81 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] 10.222.0.35 "DELETE /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115" status: 204 len: 0 microversion: 2.1 time: 0.664292 Jun 10 17:58:07.591941 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 64/140] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 17:58:06 2022] DELETE /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 17:58:07.603249 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-472f46bf-2770-4e5f-81ca-361db8cbb761 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:07.604122 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-472f46bf-2770-4e5f-81ca-361db8cbb761 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] [instance: 6467b83c-72e4-4991-a025-4690618f1115] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:07.637182 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-472f46bf-2770-4e5f-81ca-361db8cbb761 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:07.637384 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-472f46bf-2770-4e5f-81ca-361db8cbb761 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:07.638241 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-472f46bf-2770-4e5f-81ca-361db8cbb761 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:07.642366 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-472f46bf-2770-4e5f-81ca-361db8cbb761 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:07.835426 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-472f46bf-2770-4e5f-81ca-361db8cbb761 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77dc782a65b645c7a534aabc90d09110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066ae7d9e1564b91bbbaea7ff17dc789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:07.844436 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-472f46bf-2770-4e5f-81ca-361db8cbb761 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] 10.222.0.35 "GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115" status: 200 len: 1495 microversion: 2.1 time: 0.247602 Jun 10 17:58:07.845323 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 77/141] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:07 2022] GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115 => generated 1495 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:58:07.879264 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c93b80cd-78a3-422f-ad3d-b2eea23ffb1b tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:07.880246 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c93b80cd-78a3-422f-ad3d-b2eea23ffb1b tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:07.889926 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c93b80cd-78a3-422f-ad3d-b2eea23ffb1b tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:07.890608 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c93b80cd-78a3-422f-ad3d-b2eea23ffb1b tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:07.891727 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c93b80cd-78a3-422f-ad3d-b2eea23ffb1b tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:07.892174 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c93b80cd-78a3-422f-ad3d-b2eea23ffb1b tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:07.975659 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a9a69f12-77db-48f3-bea8-67e3363e5ff8 tempest-QuotaClassesAdminTestJSON-130211038 tempest-QuotaClassesAdminTestJSON-130211038-project-admin] Calling method '.version_select at 0x7f77c1c5ee50>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:07.976746 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:07.976746 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:07.994086 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a9a69f12-77db-48f3-bea8-67e3363e5ff8 tempest-QuotaClassesAdminTestJSON-130211038 tempest-QuotaClassesAdminTestJSON-130211038-project-admin] 10.222.0.35 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.159520 Jun 10 17:58:07.994985 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 65/142] 10.222.0.35 () {58 vars in 1184 bytes} [Fri Jun 10 17:58:07 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:08.007864 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-331271c6-ba45-4ba8-b0ee-3d66accc7807 tempest-QuotaClassesAdminTestJSON-130211038 tempest-QuotaClassesAdminTestJSON-130211038-project-admin] Action: 'update', calling method: .version_select at 0x7f77c1cae310>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:08.010471 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:08.010471 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:08.048045 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c93b80cd-78a3-422f-ad3d-b2eea23ffb1b tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e5bd8a55d42cdb7879fbead65627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9d5dac7c8243aeaa207c5a1ecb399a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:08.061760 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c93b80cd-78a3-422f-ad3d-b2eea23ffb1b tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "GET /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2" status: 200 len: 1406 microversion: 2.1 time: 0.188348 Jun 10 17:58:08.072040 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 78/143] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:07 2022] GET /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 => generated 1406 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:58:08.119174 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2078fb74-1522-41d5-8c95-ccafcb61bb3a tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:08.120034 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2078fb74-1522-41d5-8c95-ccafcb61bb3a tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 4ef38095-36e0-4792-9516-caf76a5022c9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:08.127229 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2078fb74-1522-41d5-8c95-ccafcb61bb3a tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:08.127688 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2078fb74-1522-41d5-8c95-ccafcb61bb3a tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:08.129253 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2078fb74-1522-41d5-8c95-ccafcb61bb3a tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:08.130060 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2078fb74-1522-41d5-8c95-ccafcb61bb3a tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:08.340903 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2078fb74-1522-41d5-8c95-ccafcb61bb3a tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:08.351684 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2078fb74-1522-41d5-8c95-ccafcb61bb3a tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9" status: 200 len: 1320 microversion: 2.1 time: 0.236448 Jun 10 17:58:08.361819 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 79/144] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:08 2022] GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9 => generated 1320 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:58:08.366945 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-578a9030-90a0-4213-9016-b792d637d8fb tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:08.367558 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-578a9030-90a0-4213-9016-b792d637d8fb tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: c9b75acf-e4fe-425e-9398-40c4ac1a108b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:08.373866 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-578a9030-90a0-4213-9016-b792d637d8fb tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:08.374614 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-578a9030-90a0-4213-9016-b792d637d8fb tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:08.375404 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-578a9030-90a0-4213-9016-b792d637d8fb tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:08.376248 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-578a9030-90a0-4213-9016-b792d637d8fb tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:08.532265 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-578a9030-90a0-4213-9016-b792d637d8fb tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:08.539729 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-578a9030-90a0-4213-9016-b792d637d8fb tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b" status: 200 len: 1322 microversion: 2.1 time: 0.176640 Jun 10 17:58:08.540295 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 80/145] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:08 2022] GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:08.544752 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d36a66c4-3559-4307-ade2-796a916dfd84 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:08.545356 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d36a66c4-3559-4307-ade2-796a916dfd84 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: ec39479e-5a78-42b6-b385-ceed608f0129] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:08.551751 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d36a66c4-3559-4307-ade2-796a916dfd84 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:08.552202 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d36a66c4-3559-4307-ade2-796a916dfd84 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:08.553076 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d36a66c4-3559-4307-ade2-796a916dfd84 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:08.553515 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d36a66c4-3559-4307-ade2-796a916dfd84 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:08.638146 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d36a66c4-3559-4307-ade2-796a916dfd84 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19776e5adf942c6a20e4dea1aa10cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1fd6bd677ff4b17bafee8fad1d720a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:08.647370 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d36a66c4-3559-4307-ade2-796a916dfd84 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "GET /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129" status: 200 len: 1223 microversion: 2.1 time: 0.105886 Jun 10 17:58:08.647991 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 81/146] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:08 2022] GET /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129 => generated 1223 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:08.863551 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ec0a4a6d-c011-4d35-a9f5-32f3d9fd7630 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:08.866918 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ec0a4a6d-c011-4d35-a9f5-32f3d9fd7630 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] [instance: 6467b83c-72e4-4991-a025-4690618f1115] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:08.876906 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ec0a4a6d-c011-4d35-a9f5-32f3d9fd7630 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:08.877951 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ec0a4a6d-c011-4d35-a9f5-32f3d9fd7630 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:08.878797 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ec0a4a6d-c011-4d35-a9f5-32f3d9fd7630 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:08.879238 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ec0a4a6d-c011-4d35-a9f5-32f3d9fd7630 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:09.060324 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ec0a4a6d-c011-4d35-a9f5-32f3d9fd7630 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77dc782a65b645c7a534aabc90d09110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066ae7d9e1564b91bbbaea7ff17dc789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:09.069356 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:58:09.072048 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ec0a4a6d-c011-4d35-a9f5-32f3d9fd7630 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] 10.222.0.35 "GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115" status: 200 len: 1495 microversion: 2.1 time: 0.215030 Jun 10 17:58:09.073041 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 82/147] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:08 2022] GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115 => generated 1495 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:09.088355 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7ea89f3f-cbc2-4b12-8996-6d5ae2535755 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:09.090639 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7ea89f3f-cbc2-4b12-8996-6d5ae2535755 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:09.100535 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7ea89f3f-cbc2-4b12-8996-6d5ae2535755 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:09.101123 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7ea89f3f-cbc2-4b12-8996-6d5ae2535755 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:09.102033 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7ea89f3f-cbc2-4b12-8996-6d5ae2535755 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:09.102684 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7ea89f3f-cbc2-4b12-8996-6d5ae2535755 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:09.213369 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=17,nova_api:UPDATE=12 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:58:09.265417 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7ea89f3f-cbc2-4b12-8996-6d5ae2535755 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e5bd8a55d42cdb7879fbead65627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9d5dac7c8243aeaa207c5a1ecb399a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:09.274331 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7ea89f3f-cbc2-4b12-8996-6d5ae2535755 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "GET /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2" status: 200 len: 1406 microversion: 2.1 time: 0.194539 Jun 10 17:58:09.275024 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 83/148] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:09 2022] GET /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 => generated 1406 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:09.349828 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-331271c6-ba45-4ba8-b0ee-3d66accc7807 tempest-QuotaClassesAdminTestJSON-130211038 tempest-QuotaClassesAdminTestJSON-130211038-project-admin] 10.222.0.35 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 1.346670 Jun 10 17:58:09.350803 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 66/149] 10.222.0.35 () {60 vars in 1205 bytes} [Fri Jun 10 17:58:08 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:09.364899 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1aa572d1-8a5a-4ab4-b543-16929c1074aa tempest-QuotaClassesAdminTestJSON-130211038 tempest-QuotaClassesAdminTestJSON-130211038-project-admin] Calling method '.version_select at 0x7f77c1e568b0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:09.369681 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7a60990a-c039-4825-88ab-4dd3b1dec9c2 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:09.370600 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7a60990a-c039-4825-88ab-4dd3b1dec9c2 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 4ef38095-36e0-4792-9516-caf76a5022c9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:09.373198 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:09.373198 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:09.379020 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7a60990a-c039-4825-88ab-4dd3b1dec9c2 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:09.380066 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7a60990a-c039-4825-88ab-4dd3b1dec9c2 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:09.381347 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7a60990a-c039-4825-88ab-4dd3b1dec9c2 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:09.381979 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7a60990a-c039-4825-88ab-4dd3b1dec9c2 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:09.409689 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1aa572d1-8a5a-4ab4-b543-16929c1074aa tempest-QuotaClassesAdminTestJSON-130211038 tempest-QuotaClassesAdminTestJSON-130211038-project-admin] 10.222.0.35 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.052476 Jun 10 17:58:09.419791 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 84/150] 10.222.0.35 () {58 vars in 1184 bytes} [Fri Jun 10 17:58:09 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:09.431512 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d96716c5-0482-4b1d-8a25-4226ecf744e5 tempest-QuotaClassesAdminTestJSON-130211038 tempest-QuotaClassesAdminTestJSON-130211038-project-admin] Action: 'update', calling method: .version_select at 0x7f77c1d19040>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:09.434231 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:09.434231 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:09.748359 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7a60990a-c039-4825-88ab-4dd3b1dec9c2 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:09.756845 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7a60990a-c039-4825-88ab-4dd3b1dec9c2 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9" status: 200 len: 1320 microversion: 2.1 time: 0.391016 Jun 10 17:58:09.757420 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 67/151] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:09 2022] GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9 => generated 1320 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:09.762463 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6d21bdf0-144b-4006-be6a-4ee8794d6fd6 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:09.763263 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6d21bdf0-144b-4006-be6a-4ee8794d6fd6 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: c9b75acf-e4fe-425e-9398-40c4ac1a108b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:09.770888 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6d21bdf0-144b-4006-be6a-4ee8794d6fd6 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:09.771341 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6d21bdf0-144b-4006-be6a-4ee8794d6fd6 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:09.772112 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6d21bdf0-144b-4006-be6a-4ee8794d6fd6 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:09.772629 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6d21bdf0-144b-4006-be6a-4ee8794d6fd6 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:10.245287 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6d21bdf0-144b-4006-be6a-4ee8794d6fd6 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:10.260194 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6d21bdf0-144b-4006-be6a-4ee8794d6fd6 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b" status: 200 len: 1322 microversion: 2.1 time: 0.501495 Jun 10 17:58:10.270331 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 68/152] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:09 2022] GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b => generated 1322 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:10.277937 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-93a4c4be-5117-44bc-99a2-8c15ceac5457 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:10.278955 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-93a4c4be-5117-44bc-99a2-8c15ceac5457 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: ec39479e-5a78-42b6-b385-ceed608f0129] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:10.286435 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-93a4c4be-5117-44bc-99a2-8c15ceac5457 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:10.286904 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-93a4c4be-5117-44bc-99a2-8c15ceac5457 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:10.287674 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-93a4c4be-5117-44bc-99a2-8c15ceac5457 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:10.288111 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-93a4c4be-5117-44bc-99a2-8c15ceac5457 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:10.468193 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-93a4c4be-5117-44bc-99a2-8c15ceac5457 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19776e5adf942c6a20e4dea1aa10cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1fd6bd677ff4b17bafee8fad1d720a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:10.495765 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-93a4c4be-5117-44bc-99a2-8c15ceac5457 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "GET /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129" status: 200 len: 1271 microversion: 2.1 time: 0.227408 Jun 10 17:58:10.495765 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 69/153] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:10 2022] GET /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129 => generated 1271 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:10.504610 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ef44115d-cb27-46c9-8c2f-9f922d0e25b8 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:10.505305 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ef44115d-cb27-46c9-8c2f-9f922d0e25b8 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] [instance: 6467b83c-72e4-4991-a025-4690618f1115] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:10.511434 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ef44115d-cb27-46c9-8c2f-9f922d0e25b8 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:10.512085 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ef44115d-cb27-46c9-8c2f-9f922d0e25b8 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:10.513293 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ef44115d-cb27-46c9-8c2f-9f922d0e25b8 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:10.513888 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ef44115d-cb27-46c9-8c2f-9f922d0e25b8 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:10.579543 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d96716c5-0482-4b1d-8a25-4226ecf744e5 tempest-QuotaClassesAdminTestJSON-130211038 tempest-QuotaClassesAdminTestJSON-130211038-project-admin] 10.222.0.35 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 1.153102 Jun 10 17:58:10.582181 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 85/154] 10.222.0.35 () {60 vars in 1205 bytes} [Fri Jun 10 17:58:09 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:10.594731 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-f45f7fd0-ee6f-40d7-8f82-c34b916d38b0 req-f19bce76-d603-434e-9142-95fc5c49aafc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2", "tag": "855ea6e2-3ff5-40bf-8166-8de14ae27ad9"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:10.607784 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-f45f7fd0-ee6f-40d7-8f82-c34b916d38b0 req-f19bce76-d603-434e-9142-95fc5c49aafc service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:10.608461 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-f45f7fd0-ee6f-40d7-8f82-c34b916d38b0 req-f19bce76-d603-434e-9142-95fc5c49aafc service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:10.623413 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-f45f7fd0-ee6f-40d7-8f82-c34b916d38b0 req-f19bce76-d603-434e-9142-95fc5c49aafc service nova] Creating event network-changed:855ea6e2-3ff5-40bf-8166-8de14ae27ad9 for instance cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 on chh1-master-2 Jun 10 17:58:10.629859 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-f45f7fd0-ee6f-40d7-8f82-c34b916d38b0 req-f19bce76-d603-434e-9142-95fc5c49aafc service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046494 Jun 10 17:58:10.631139 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 86/155] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:10.637660 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8f22345c-ce87-4990-ab61-1fcda8269802 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:10.638930 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8f22345c-ce87-4990-ab61-1fcda8269802 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:10.665610 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8f22345c-ce87-4990-ab61-1fcda8269802 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:10.668143 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8f22345c-ce87-4990-ab61-1fcda8269802 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:10.670757 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8f22345c-ce87-4990-ab61-1fcda8269802 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:10.673145 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8f22345c-ce87-4990-ab61-1fcda8269802 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:10.697133 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ef44115d-cb27-46c9-8c2f-9f922d0e25b8 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77dc782a65b645c7a534aabc90d09110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066ae7d9e1564b91bbbaea7ff17dc789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:10.717843 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ef44115d-cb27-46c9-8c2f-9f922d0e25b8 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] 10.222.0.35 "GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115" status: 200 len: 1453 microversion: 2.1 time: 0.218849 Jun 10 17:58:10.720595 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 70/156] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:10 2022] GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115 => generated 1453 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:10.774416 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2f1b2d98-3922-4eb1-94a7-4cc6b9514843 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:10.775357 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2f1b2d98-3922-4eb1-94a7-4cc6b9514843 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 4ef38095-36e0-4792-9516-caf76a5022c9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:10.786793 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2f1b2d98-3922-4eb1-94a7-4cc6b9514843 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:10.787471 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2f1b2d98-3922-4eb1-94a7-4cc6b9514843 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:10.788614 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2f1b2d98-3922-4eb1-94a7-4cc6b9514843 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:10.794417 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2f1b2d98-3922-4eb1-94a7-4cc6b9514843 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:10.928995 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8f22345c-ce87-4990-ab61-1fcda8269802 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e5bd8a55d42cdb7879fbead65627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9d5dac7c8243aeaa207c5a1ecb399a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:10.937012 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8f22345c-ce87-4990-ab61-1fcda8269802 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "GET /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2" status: 200 len: 1406 microversion: 2.1 time: 0.303907 Jun 10 17:58:10.938418 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 87/157] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:10 2022] GET /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 => generated 1406 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:11.058916 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2f1b2d98-3922-4eb1-94a7-4cc6b9514843 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:11.071317 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2f1b2d98-3922-4eb1-94a7-4cc6b9514843 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9" status: 200 len: 1320 microversion: 2.1 time: 0.301762 Jun 10 17:58:11.088520 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 71/158] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:10 2022] GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9 => generated 1320 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:58:11.282838 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cf375ff2-0a6a-4c4c-b229-e2a92318a671 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:11.283697 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cf375ff2-0a6a-4c4c-b229-e2a92318a671 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: c9b75acf-e4fe-425e-9398-40c4ac1a108b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:11.291387 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cf375ff2-0a6a-4c4c-b229-e2a92318a671 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:11.292752 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cf375ff2-0a6a-4c4c-b229-e2a92318a671 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:11.293688 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cf375ff2-0a6a-4c4c-b229-e2a92318a671 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:11.295390 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cf375ff2-0a6a-4c4c-b229-e2a92318a671 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:11.510597 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-43d32102-6ff7-4585-83b6-07aa3b5cb578 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:11.512657 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-43d32102-6ff7-4585-83b6-07aa3b5cb578 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: ec39479e-5a78-42b6-b385-ceed608f0129] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:11.520744 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-43d32102-6ff7-4585-83b6-07aa3b5cb578 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:11.521511 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-43d32102-6ff7-4585-83b6-07aa3b5cb578 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:11.523093 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-43d32102-6ff7-4585-83b6-07aa3b5cb578 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:11.523741 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-43d32102-6ff7-4585-83b6-07aa3b5cb578 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:11.635913 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-43d32102-6ff7-4585-83b6-07aa3b5cb578 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19776e5adf942c6a20e4dea1aa10cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1fd6bd677ff4b17bafee8fad1d720a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:11.651868 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-43d32102-6ff7-4585-83b6-07aa3b5cb578 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "GET /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129" status: 200 len: 1277 microversion: 2.1 time: 0.145504 Jun 10 17:58:11.653115 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 72/159] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:11 2022] GET /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129 => generated 1277 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:58:11.699726 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cf375ff2-0a6a-4c4c-b229-e2a92318a671 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:11.710037 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cf375ff2-0a6a-4c4c-b229-e2a92318a671 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b" status: 200 len: 1322 microversion: 2.1 time: 0.434434 Jun 10 17:58:11.710749 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 88/160] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:11 2022] GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b => generated 1322 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:11.743273 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-79143fff-017e-46f1-aacc-f5367b54c430 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:11.744027 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-79143fff-017e-46f1-aacc-f5367b54c430 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] [instance: 6467b83c-72e4-4991-a025-4690618f1115] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:11.759171 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-79143fff-017e-46f1-aacc-f5367b54c430 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:11.762510 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-79143fff-017e-46f1-aacc-f5367b54c430 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:11.763332 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-79143fff-017e-46f1-aacc-f5367b54c430 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:11.763792 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-79143fff-017e-46f1-aacc-f5367b54c430 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:11.802838 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-79143fff-017e-46f1-aacc-f5367b54c430 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:11.804364 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-79143fff-017e-46f1-aacc-f5367b54c430 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:11.805500 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-79143fff-017e-46f1-aacc-f5367b54c430 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lazy-loading 'fault' on Instance uuid 6467b83c-72e4-4991-a025-4690618f1115 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 17:58:11.911101 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-79143fff-017e-46f1-aacc-f5367b54c430 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77dc782a65b645c7a534aabc90d09110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066ae7d9e1564b91bbbaea7ff17dc789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:11.927793 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-79143fff-017e-46f1-aacc-f5367b54c430 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] 10.222.0.35 "GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115" status: 200 len: 1329 microversion: 2.1 time: 0.193074 Jun 10 17:58:11.929432 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-5b9afc0b-ddd8-4bbe-b8cb-535b16b6c36a req-7eb14302-42ac-4b91-b7a1-93ab0d2214b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9b75acf-e4fe-425e-9398-40c4ac1a108b", "name": "network-vif-plugged", "status": "completed", "tag": "7d50bd88-4d71-4153-a03a-78aa249d08c5"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:11.934350 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 73/161] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:11 2022] GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115 => generated 1329 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:11.945538 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-5b9afc0b-ddd8-4bbe-b8cb-535b16b6c36a req-7eb14302-42ac-4b91-b7a1-93ab0d2214b8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:11.945538 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-5b9afc0b-ddd8-4bbe-b8cb-535b16b6c36a req-7eb14302-42ac-4b91-b7a1-93ab0d2214b8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:11.963511 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-5b9afc0b-ddd8-4bbe-b8cb-535b16b6c36a req-7eb14302-42ac-4b91-b7a1-93ab0d2214b8 service nova] Creating event network-vif-plugged:7d50bd88-4d71-4153-a03a-78aa249d08c5 for instance c9b75acf-e4fe-425e-9398-40c4ac1a108b on chh2-master-2 Jun 10 17:58:11.969227 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-5b9afc0b-ddd8-4bbe-b8cb-535b16b6c36a req-7eb14302-42ac-4b91-b7a1-93ab0d2214b8 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042545 Jun 10 17:58:11.969346 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8520509e-5fad-42fe-bb9a-1967aad1d8d6 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:11.974010 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 89/162] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:11.975302 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8520509e-5fad-42fe-bb9a-1967aad1d8d6 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:11.991898 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8520509e-5fad-42fe-bb9a-1967aad1d8d6 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:11.992382 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8520509e-5fad-42fe-bb9a-1967aad1d8d6 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:12.002841 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8520509e-5fad-42fe-bb9a-1967aad1d8d6 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:12.002841 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8520509e-5fad-42fe-bb9a-1967aad1d8d6 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:12.097089 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d59fc452-1754-492f-83a8-1d2dad91074a tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:12.098113 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d59fc452-1754-492f-83a8-1d2dad91074a tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 4ef38095-36e0-4792-9516-caf76a5022c9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:12.104886 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d59fc452-1754-492f-83a8-1d2dad91074a tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:12.105783 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d59fc452-1754-492f-83a8-1d2dad91074a tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:12.106728 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d59fc452-1754-492f-83a8-1d2dad91074a tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:12.107357 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d59fc452-1754-492f-83a8-1d2dad91074a tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:12.286136 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8520509e-5fad-42fe-bb9a-1967aad1d8d6 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e5bd8a55d42cdb7879fbead65627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9d5dac7c8243aeaa207c5a1ecb399a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:12.294265 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8520509e-5fad-42fe-bb9a-1967aad1d8d6 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "GET /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2" status: 200 len: 1406 microversion: 2.1 time: 0.343048 Jun 10 17:58:12.303844 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 74/163] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:11 2022] GET /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 => generated 1406 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:58:12.554352 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d59fc452-1754-492f-83a8-1d2dad91074a tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:12.563998 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d59fc452-1754-492f-83a8-1d2dad91074a tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9" status: 200 len: 1320 microversion: 2.1 time: 0.472360 Jun 10 17:58:12.564697 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 90/164] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:12 2022] GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9 => generated 1320 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:58:12.670897 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8050c521-2677-4dec-ad5d-2c6ade2403f9 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:12.673114 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8050c521-2677-4dec-ad5d-2c6ade2403f9 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: ec39479e-5a78-42b6-b385-ceed608f0129] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:12.684752 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-5ea111aa-a9f6-45aa-88ed-1a7f3ec997f9 req-353f132f-ef9b-43b8-91fd-a9ca0a957d64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6467b83c-72e4-4991-a025-4690618f1115", "name": "network-vif-deleted", "tag": "f25b2fab-dcfe-4c76-94a6-d6033e93124d"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:12.696690 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8050c521-2677-4dec-ad5d-2c6ade2403f9 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:12.697021 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8050c521-2677-4dec-ad5d-2c6ade2403f9 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:12.697825 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8050c521-2677-4dec-ad5d-2c6ade2403f9 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:12.698274 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8050c521-2677-4dec-ad5d-2c6ade2403f9 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:12.698863 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-5ea111aa-a9f6-45aa-88ed-1a7f3ec997f9 req-353f132f-ef9b-43b8-91fd-a9ca0a957d64 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:12.699196 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-5ea111aa-a9f6-45aa-88ed-1a7f3ec997f9 req-353f132f-ef9b-43b8-91fd-a9ca0a957d64 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:12.716587 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-5ea111aa-a9f6-45aa-88ed-1a7f3ec997f9 req-353f132f-ef9b-43b8-91fd-a9ca0a957d64 service nova] Creating event network-vif-deleted:f25b2fab-dcfe-4c76-94a6-d6033e93124d for instance 6467b83c-72e4-4991-a025-4690618f1115 on chh1-master-2 Jun 10 17:58:12.722839 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-5ea111aa-a9f6-45aa-88ed-1a7f3ec997f9 req-353f132f-ef9b-43b8-91fd-a9ca0a957d64 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042138 Jun 10 17:58:12.724241 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 91/165] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 17:58:12.745259 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3ab39248-56f3-49bd-8532-cd94392fd76e tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:12.746044 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3ab39248-56f3-49bd-8532-cd94392fd76e tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: c9b75acf-e4fe-425e-9398-40c4ac1a108b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:12.755783 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3ab39248-56f3-49bd-8532-cd94392fd76e tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:12.756236 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3ab39248-56f3-49bd-8532-cd94392fd76e tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:12.757470 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3ab39248-56f3-49bd-8532-cd94392fd76e tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:12.757934 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3ab39248-56f3-49bd-8532-cd94392fd76e tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:12.804934 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:58:12.904776 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3ab39248-56f3-49bd-8532-cd94392fd76e tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:12.912850 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3ab39248-56f3-49bd-8532-cd94392fd76e tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b" status: 200 len: 1322 microversion: 2.1 time: 0.186809 Jun 10 17:58:12.913439 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 92/166] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:12 2022] GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:12.946309 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1d2725ff-e3dd-4599-8731-76f8cfd1e010 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:12.947003 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1d2725ff-e3dd-4599-8731-76f8cfd1e010 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] [instance: 6467b83c-72e4-4991-a025-4690618f1115] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:12.953545 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d2725ff-e3dd-4599-8731-76f8cfd1e010 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:12.954096 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d2725ff-e3dd-4599-8731-76f8cfd1e010 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:12.954920 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d2725ff-e3dd-4599-8731-76f8cfd1e010 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:12.955357 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d2725ff-e3dd-4599-8731-76f8cfd1e010 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:12.975122 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-1d2725ff-e3dd-4599-8731-76f8cfd1e010 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] HTTP exception thrown: Instance 6467b83c-72e4-4991-a025-4690618f1115 could not be found. Jun 10 17:58:12.975434 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1d2725ff-e3dd-4599-8731-76f8cfd1e010 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Request method failure captured: Jun 10 17:58:12.975434 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115 HTTP/1.1 Jun 10 17:58:12.975434 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 17:58:12.975434 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 17:58:12.975434 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 17:58:12.975434 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 17:58:12.975434 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 17:58:12.975434 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 17:58:12.975434 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 17:58:12.975434 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:12.975434 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4YFd94gi5EPxOq7HPjLKqIeLNxRHzV9KGgbDaDPc7DW00XdHGzBHJOZuDZTgXfYr_Z7PFrf04CZFQCTgptha6NaBhXvm5BSx4IjkgVZ1y4W4V8EDxYO_xk15uJqYEwiUL_BLRE_Dkq5yhJbMk8Wavx1Mmtc9CqFoOuwMYjR5Po4CnQ Jun 10 17:58:12.975434 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 17:58:12.975434 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 17:58:12.975434 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 17:58:12.975434 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 17:58:12.975434 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 17:58:12.975434 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 17:58:12.975434 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 066ae7d9e1564b91bbbaea7ff17dc789 Jun 10 17:58:12.975434 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-AggregatesAdminTestJSON-2014712996 Jun 10 17:58:12.975434 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 17:58:12.975434 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 17:58:12.976756 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/066ae7d9e1564b91bbbaea7ff17dc789"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/066ae7d9e1564b91bbbaea7ff17dc789"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/066ae7d9e1564b91bbbaea7ff17dc789"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_066ae7d9e1564b91bbbaea7ff17dc789", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:12.976756 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-AggregatesAdminTestJSON-2014712996 Jun 10 17:58:12.976756 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 066ae7d9e1564b91bbbaea7ff17dc789 Jun 10 17:58:12.976756 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2014712996 Jun 10 17:58:12.976756 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-AggregatesAdminTestJSON-2014712996-project Jun 10 17:58:12.976756 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 17:58:12.976756 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 17:58:12.976756 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 77dc782a65b645c7a534aabc90d09110 Jun 10 17:58:12.976756 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-AggregatesAdminTestJSON-2014712996-project Jun 10 17:58:12.976756 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 17:58:12.976756 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 6467b83c-72e4-4991-a025-4690618f1115 could not be found. Jun 10 17:58:12.976756 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '6467b83c-72e4-4991-a025-4690618f1115'} Jun 10 17:58:12.977437 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:12.977437 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:12.977437 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 17:58:12.977437 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 17:58:12.977437 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 17:58:12.977437 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 17:58:12.977437 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 17:58:12.977437 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 17:58:12.977437 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 17:58:12.977437 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 17:58:12.977437 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6467b83c-72e4-4991-a025-4690618f1115 could not be found. Jun 10 17:58:12.977437 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:12.977437 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:12.977437 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:12.977437 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:12.977437 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:12.977437 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:12.977437 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:12.977437 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:12.977437 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:12.978485 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:12.978485 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 17:58:12.978485 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 17:58:12.978485 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 17:58:12.978485 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 17:58:12.978485 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 17:58:12.978485 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 17:58:12.978485 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6467b83c-72e4-4991-a025-4690618f1115 could not be found. Jun 10 17:58:12.978485 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:12.978485 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:12.978485 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:12.978485 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:12.978485 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:12.978485 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:12.978485 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:58:12.978485 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:58:12.978485 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6467b83c-72e4-4991-a025-4690618f1115 could not be found. Jun 10 17:58:12.978485 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:12.979415 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1d2725ff-e3dd-4599-8731-76f8cfd1e010 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Returning 404 to user: Instance 6467b83c-72e4-4991-a025-4690618f1115 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:12.979415 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1d2725ff-e3dd-4599-8731-76f8cfd1e010 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] 10.222.0.35 "GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115" status: 404 len: 111 microversion: 2.1 time: 0.035199 Jun 10 17:58:12.979415 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 93/167] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:12 2022] GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 17:58:12.985854 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-db47c163-9d4d-444d-9feb-618341601e5e tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "chh1-master-2"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:12.987386 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:12.987386 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:12.995469 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-db47c163-9d4d-444d-9feb-618341601e5e tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:12.997788 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-db47c163-9d4d-444d-9feb-618341601e5e tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:13.333496 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8050c521-2677-4dec-ad5d-2c6ade2403f9 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19776e5adf942c6a20e4dea1aa10cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1fd6bd677ff4b17bafee8fad1d720a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:13.358140 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8050c521-2677-4dec-ad5d-2c6ade2403f9 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "GET /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129" status: 200 len: 1319 microversion: 2.1 time: 0.691886 Jun 10 17:58:13.364203 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 75/168] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:12 2022] GET /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129 => generated 1319 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:13.377865 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d6ae3768-5764-4c5c-afd5-062c9e7e1f5a tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:13.380562 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d6ae3768-5764-4c5c-afd5-062c9e7e1f5a tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:13.405655 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d6ae3768-5764-4c5c-afd5-062c9e7e1f5a tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:13.408127 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d6ae3768-5764-4c5c-afd5-062c9e7e1f5a tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:13.409497 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d6ae3768-5764-4c5c-afd5-062c9e7e1f5a tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:13.410577 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d6ae3768-5764-4c5c-afd5-062c9e7e1f5a tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:13.683021 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-db47c163-9d4d-444d-9feb-618341601e5e tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 300 microversion: 2.1 time: 0.700932 Jun 10 17:58:13.685277 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 94/169] 10.222.0.35 () {60 vars in 1190 bytes} [Fri Jun 10 17:58:12 2022] POST /compute/v2.1/os-aggregates/1/action => generated 300 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 17:58:13.696382 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-752aacc3-b3ab-4370-84c9-f65126694cdf tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:13.697087 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-752aacc3-b3ab-4370-84c9-f65126694cdf tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 4ef38095-36e0-4792-9516-caf76a5022c9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:13.704746 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-752aacc3-b3ab-4370-84c9-f65126694cdf tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:13.705408 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-752aacc3-b3ab-4370-84c9-f65126694cdf tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:13.712292 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-752aacc3-b3ab-4370-84c9-f65126694cdf tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:13.712292 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-752aacc3-b3ab-4370-84c9-f65126694cdf tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:13.979898 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d6ae3768-5764-4c5c-afd5-062c9e7e1f5a tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e5bd8a55d42cdb7879fbead65627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9d5dac7c8243aeaa207c5a1ecb399a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:13.994823 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d6ae3768-5764-4c5c-afd5-062c9e7e1f5a tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "GET /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2" status: 200 len: 1406 microversion: 2.1 time: 0.627236 Jun 10 17:58:13.997452 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 76/170] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:13 2022] GET /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 => generated 1406 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:14.003307 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0d055401-d1d6-417f-800a-855d0f72cc95 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:14.004626 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:14.004626 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:14.023656 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-752aacc3-b3ab-4370-84c9-f65126694cdf tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:14.033168 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-752aacc3-b3ab-4370-84c9-f65126694cdf tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9" status: 200 len: 1320 microversion: 2.1 time: 0.346372 Jun 10 17:58:14.043246 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 95/171] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:13 2022] GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9 => generated 1320 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:14.061598 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6eea66ed-7621-483c-8c1e-2d8aead08044 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:14.062680 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6eea66ed-7621-483c-8c1e-2d8aead08044 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: c9b75acf-e4fe-425e-9398-40c4ac1a108b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:14.069352 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6eea66ed-7621-483c-8c1e-2d8aead08044 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:14.069990 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6eea66ed-7621-483c-8c1e-2d8aead08044 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:14.071088 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6eea66ed-7621-483c-8c1e-2d8aead08044 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:14.071531 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6eea66ed-7621-483c-8c1e-2d8aead08044 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:14.168337 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0d055401-d1d6-417f-800a-855d0f72cc95 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] 10.222.0.35 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.169076 Jun 10 17:58:14.168871 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 77/172] 10.222.0.35 () {58 vars in 1151 bytes} [Fri Jun 10 17:58:13 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 10 17:58:14.189266 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-8aa797a4-60ea-4728-9d6e-6930b8937276 req-86ab5cdc-7588-4827-835f-9e6e14f65480 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ef38095-36e0-4792-9516-caf76a5022c9", "name": "network-vif-plugged", "status": "completed", "tag": "9b60d347-65df-4aa7-85ac-1c504203cdea"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:14.198572 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-8aa797a4-60ea-4728-9d6e-6930b8937276 req-86ab5cdc-7588-4827-835f-9e6e14f65480 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:14.199031 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-8aa797a4-60ea-4728-9d6e-6930b8937276 req-86ab5cdc-7588-4827-835f-9e6e14f65480 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:14.210037 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-8aa797a4-60ea-4728-9d6e-6930b8937276 req-86ab5cdc-7588-4827-835f-9e6e14f65480 service nova] Creating event network-vif-plugged:9b60d347-65df-4aa7-85ac-1c504203cdea for instance 4ef38095-36e0-4792-9516-caf76a5022c9 on chh2-master-2 Jun 10 17:58:14.217527 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-8aa797a4-60ea-4728-9d6e-6930b8937276 req-86ab5cdc-7588-4827-835f-9e6e14f65480 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044181 Jun 10 17:58:14.217527 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 78/173] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:14.221530 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d48007ba-0788-450f-b423-c87db4de0593 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-189878535"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:14.222910 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:14.222910 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:14.223811 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.aggregate [None req-d48007ba-0788-450f-b423-c87db4de0593 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Generated uuid 9eb77991-a6cc-4fe4-9bcc-4582985a2865 for aggregate {{(pid=126594) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 10 17:58:14.277395 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6eea66ed-7621-483c-8c1e-2d8aead08044 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:14.285784 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6eea66ed-7621-483c-8c1e-2d8aead08044 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b" status: 200 len: 1322 microversion: 2.1 time: 0.241254 Jun 10 17:58:14.286482 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 96/174] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:14 2022] GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:14.302934 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d48007ba-0788-450f-b423-c87db4de0593 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.085627 Jun 10 17:58:14.310198 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 79/175] 10.222.0.35 () {60 vars in 1163 bytes} [Fri Jun 10 17:58:14 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:14.316523 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8a91a237-4cf7-4a70-9e2a-2551feaa9c12 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "chh1-master-2"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:14.317283 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:14.317283 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:14.327291 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8a91a237-4cf7-4a70-9e2a-2551feaa9c12 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:14.328124 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8a91a237-4cf7-4a70-9e2a-2551feaa9c12 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:14.383570 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5c8148e5-82a2-493f-bdc4-2b87b061e328 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:14.384611 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5c8148e5-82a2-493f-bdc4-2b87b061e328 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: ec39479e-5a78-42b6-b385-ceed608f0129] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:14.395729 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5c8148e5-82a2-493f-bdc4-2b87b061e328 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:14.396455 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5c8148e5-82a2-493f-bdc4-2b87b061e328 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:14.397770 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5c8148e5-82a2-493f-bdc4-2b87b061e328 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:14.398417 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5c8148e5-82a2-493f-bdc4-2b87b061e328 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:14.617444 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8a91a237-4cf7-4a70-9e2a-2551feaa9c12 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 241 microversion: 2.1 time: 0.305833 Jun 10 17:58:14.624230 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 97/176] 10.222.0.35 () {60 vars in 1190 bytes} [Fri Jun 10 17:58:14 2022] POST /compute/v2.1/os-aggregates/2/action => generated 241 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:14.629913 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5b9d9414-3dfa-4252-a793-bed53eca6caf tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:14.630953 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:14.630953 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:14.641127 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5b9d9414-3dfa-4252-a793-bed53eca6caf tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] 10.222.0.35 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 241 microversion: 2.1 time: 0.014844 Jun 10 17:58:14.641990 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 98/177] 10.222.0.35 () {58 vars in 1148 bytes} [Fri Jun 10 17:58:14 2022] GET /compute/v2.1/os-aggregates/2 => generated 241 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:14.653148 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fbd83cfb-a453-4cc1-a573-9505cc8bd88c tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "chh1-master-2"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:14.656641 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:14.656641 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:14.662155 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=12,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:58:14.667655 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fbd83cfb-a453-4cc1-a573-9505cc8bd88c tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:14.668518 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fbd83cfb-a453-4cc1-a573-9505cc8bd88c tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:14.829255 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5c8148e5-82a2-493f-bdc4-2b87b061e328 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19776e5adf942c6a20e4dea1aa10cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1fd6bd677ff4b17bafee8fad1d720a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:14.839696 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5c8148e5-82a2-493f-bdc4-2b87b061e328 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "GET /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129" status: 200 len: 1319 microversion: 2.1 time: 0.462404 Jun 10 17:58:14.840513 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 80/178] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:14 2022] GET /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129 => generated 1319 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:58:15.012724 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fe9f59db-a4d7-4522-95a7-5d6affac9068 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:15.013389 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fe9f59db-a4d7-4522-95a7-5d6affac9068 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:15.020887 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fe9f59db-a4d7-4522-95a7-5d6affac9068 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:15.021346 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fe9f59db-a4d7-4522-95a7-5d6affac9068 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:15.022167 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fe9f59db-a4d7-4522-95a7-5d6affac9068 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:15.022726 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fe9f59db-a4d7-4522-95a7-5d6affac9068 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:15.057383 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fbd83cfb-a453-4cc1-a573-9505cc8bd88c tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.408451 Jun 10 17:58:15.059226 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 99/179] 10.222.0.35 () {60 vars in 1190 bytes} [Fri Jun 10 17:58:14 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:15.071142 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-827af5af-f51f-48b6-b909-145e98415e4e req-b6d15ac1-08b9-451a-9960-9c626a8ef36e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec39479e-5a78-42b6-b385-ceed608f0129", "tag": "5df70e87-2212-413e-87f5-9f827ec2ab67"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:15.084490 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-827af5af-f51f-48b6-b909-145e98415e4e req-b6d15ac1-08b9-451a-9960-9c626a8ef36e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:15.085545 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-827af5af-f51f-48b6-b909-145e98415e4e req-b6d15ac1-08b9-451a-9960-9c626a8ef36e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:15.110761 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-827af5af-f51f-48b6-b909-145e98415e4e req-b6d15ac1-08b9-451a-9960-9c626a8ef36e service nova] Creating event network-changed:5df70e87-2212-413e-87f5-9f827ec2ab67 for instance ec39479e-5a78-42b6-b385-ceed608f0129 on chh2-master-2 Jun 10 17:58:15.118264 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-827af5af-f51f-48b6-b909-145e98415e4e req-b6d15ac1-08b9-451a-9960-9c626a8ef36e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057574 Jun 10 17:58:15.119444 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 100/180] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:15.126279 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cc924872-aa41-489f-b183-452d4e9be70a tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:15.131233 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cc924872-aa41-489f-b183-452d4e9be70a tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 4ef38095-36e0-4792-9516-caf76a5022c9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:15.134942 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc924872-aa41-489f-b183-452d4e9be70a tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:15.135628 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc924872-aa41-489f-b183-452d4e9be70a tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:15.136483 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc924872-aa41-489f-b183-452d4e9be70a tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:15.136918 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc924872-aa41-489f-b183-452d4e9be70a tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:15.331662 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fe9f59db-a4d7-4522-95a7-5d6affac9068 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e5bd8a55d42cdb7879fbead65627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9d5dac7c8243aeaa207c5a1ecb399a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:15.351017 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fe9f59db-a4d7-4522-95a7-5d6affac9068 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "GET /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2" status: 200 len: 1384 microversion: 2.1 time: 0.342170 Jun 10 17:58:15.352091 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 81/181] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:15 2022] GET /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 => generated 1384 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:58:15.366630 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-50bd4d5b-15e8-4957-9573-85303b399d60 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:15.369143 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:15.369143 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:15.426016 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cc924872-aa41-489f-b183-452d4e9be70a tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:15.439630 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cc924872-aa41-489f-b183-452d4e9be70a tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9" status: 200 len: 1320 microversion: 2.1 time: 0.318984 Jun 10 17:58:15.443615 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 101/182] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:15 2022] GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9 => generated 1320 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:15.449070 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1d0551ec-f0fe-4617-86d2-2ed1850191b5 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:15.449734 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1d0551ec-f0fe-4617-86d2-2ed1850191b5 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: c9b75acf-e4fe-425e-9398-40c4ac1a108b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:15.456166 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d0551ec-f0fe-4617-86d2-2ed1850191b5 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:15.456652 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d0551ec-f0fe-4617-86d2-2ed1850191b5 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:15.457434 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d0551ec-f0fe-4617-86d2-2ed1850191b5 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:15.457877 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d0551ec-f0fe-4617-86d2-2ed1850191b5 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:15.477860 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-50bd4d5b-15e8-4957-9573-85303b399d60 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] 10.222.0.35 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.123916 Jun 10 17:58:15.478755 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 82/183] 10.222.0.35 () {58 vars in 1151 bytes} [Fri Jun 10 17:58:15 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 10 17:58:15.490254 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-42e2f78e-9e10-4549-9428-0b6e36136940 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1102890109"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:15.491863 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:15.491863 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:15.492964 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.aggregate [None req-42e2f78e-9e10-4549-9428-0b6e36136940 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Generated uuid 27f467c7-f895-414c-b31e-30962e100430 for aggregate {{(pid=126594) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 10 17:58:15.597182 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-42e2f78e-9e10-4549-9428-0b6e36136940 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.110407 Jun 10 17:58:15.598084 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 83/184] 10.222.0.35 () {60 vars in 1163 bytes} [Fri Jun 10 17:58:15 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 17:58:15.612016 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-76ee2826-45dd-4c75-afc5-7f0e421fe315 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "chh1-master-2"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:15.617425 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:15.617425 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:15.640672 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-76ee2826-45dd-4c75-afc5-7f0e421fe315 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:15.641135 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-76ee2826-45dd-4c75-afc5-7f0e421fe315 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:15.720788 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1d0551ec-f0fe-4617-86d2-2ed1850191b5 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:15.732372 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1d0551ec-f0fe-4617-86d2-2ed1850191b5 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b" status: 200 len: 1472 microversion: 2.1 time: 0.287458 Jun 10 17:58:15.733180 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 102/185] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:15 2022] GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b => generated 1472 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:15.909823 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-76ee2826-45dd-4c75-afc5-7f0e421fe315 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.303826 Jun 10 17:58:15.911083 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 84/186] 10.222.0.35 () {60 vars in 1190 bytes} [Fri Jun 10 17:58:15 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:15.917396 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f8e78228-8a90-4839-a1ba-414211378ace tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:15.920556 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f8e78228-8a90-4839-a1ba-414211378ace tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: ec39479e-5a78-42b6-b385-ceed608f0129] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:15.935789 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f8e78228-8a90-4839-a1ba-414211378ace tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:15.940221 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f8e78228-8a90-4839-a1ba-414211378ace tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:15.941271 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f8e78228-8a90-4839-a1ba-414211378ace tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:15.941723 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f8e78228-8a90-4839-a1ba-414211378ace tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:16.129233 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f8e78228-8a90-4839-a1ba-414211378ace tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19776e5adf942c6a20e4dea1aa10cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1fd6bd677ff4b17bafee8fad1d720a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:16.136735 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f8e78228-8a90-4839-a1ba-414211378ace tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "GET /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129" status: 200 len: 1319 microversion: 2.1 time: 0.223053 Jun 10 17:58:16.137296 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 85/187] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:15 2022] GET /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:16.142454 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1164e0a3-7b9b-4b72-8650-f27b4c367241 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:16.143337 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:16.143337 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:16.154834 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a1402b09-f310-4437-840e-a9674419b1ca tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:16.155472 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a1402b09-f310-4437-840e-a9674419b1ca tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] [instance: 87b7b6d6-8d8b-4b3a-a8b1-f72df82acbdd] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:16.161802 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-a1402b09-f310-4437-840e-a9674419b1ca tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] HTTP exception thrown: Instance 87b7b6d6-8d8b-4b3a-a8b1-f72df82acbdd could not be found. Jun 10 17:58:16.163763 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a1402b09-f310-4437-840e-a9674419b1ca tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] Request method failure captured: Jun 10 17:58:16.163763 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers/87b7b6d6-8d8b-4b3a-a8b1-f72df82acbdd/action HTTP/1.1 Jun 10 17:58:16.163763 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 17:58:16.163763 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 17:58:16.163763 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 17:58:16.163763 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 15 Jun 10 17:58:16.163763 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 17:58:16.163763 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 17:58:16.163763 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 17:58:16.163763 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:16.163763 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4YKuqC9TPdOwba3_U-DlKaD_Tm-ihGW8grI5lIHxmym7uoFeB5qbOKhqOOc-9WI7TUnA6n-svah13iRmntShUpUU7Ib7eBSHN0eeNRYcPCXmbt0Adg_N5IrD8Bml-KbTUb2mgMFU1hOuTfkt482IM6GO78GY4atbPF7EuUxiQKdtoo Jun 10 17:58:16.163763 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 17:58:16.163763 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 17:58:16.163763 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 17:58:16.163763 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 17:58:16.163763 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 17:58:16.163763 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 17:58:16.163763 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: f92204f48d1a43cdb934f3ca14a24023 Jun 10 17:58:16.163763 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2078648386 Jun 10 17:58:16.163763 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member,admin Jun 10 17:58:16.163763 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member,admin Jun 10 17:58:16.165120 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/f92204f48d1a43cdb934f3ca14a24023"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/f92204f48d1a43cdb934f3ca14a24023"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/f92204f48d1a43cdb934f3ca14a24023"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_f92204f48d1a43cdb934f3ca14a24023", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:16.165120 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2078648386 Jun 10 17:58:16.165120 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: f92204f48d1a43cdb934f3ca14a24023 Jun 10 17:58:16.165120 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2078648386 Jun 10 17:58:16.165120 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersAdminNegativeTestJSON-2078648386-project-admin Jun 10 17:58:16.165120 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 17:58:16.165120 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 17:58:16.165120 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: cffa6dbd68044b73a5cf289b6110dd35 Jun 10 17:58:16.165120 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2078648386-project-admin Jun 10 17:58:16.165120 chdv-master-2 devstack@n-api.service[126595]: Jun 10 17:58:16.165120 chdv-master-2 devstack@n-api.service[126595]: {"migrate": {}} Jun 10 17:58:16.165120 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 17:58:16.165120 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 87b7b6d6-8d8b-4b3a-a8b1-f72df82acbdd could not be found. Jun 10 17:58:16.175391 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '87b7b6d6-8d8b-4b3a-a8b1-f72df82acbdd', 'body': {'migrate': {}}} Jun 10 17:58:16.175391 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:16.175391 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:16.175391 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 17:58:16.175391 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 17:58:16.175391 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 17:58:16.175391 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 17:58:16.175391 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 10 17:58:16.175391 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 10 17:58:16.175391 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87b7b6d6-8d8b-4b3a-a8b1-f72df82acbdd could not be found. Jun 10 17:58:16.175391 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:16.175391 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:16.175391 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:16.175391 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:16.175391 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:16.175391 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:16.175391 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:16.175391 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:16.175391 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:16.175391 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:16.177016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 17:58:16.177016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 17:58:16.177016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Jun 10 17:58:16.177016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Jun 10 17:58:16.177016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 17:58:16.177016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 17:58:16.177016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87b7b6d6-8d8b-4b3a-a8b1-f72df82acbdd could not be found. Jun 10 17:58:16.177016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:16.177016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:16.177016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:16.177016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:16.177016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:16.177016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:16.177016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:58:16.177016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:58:16.177016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87b7b6d6-8d8b-4b3a-a8b1-f72df82acbdd could not be found. Jun 10 17:58:16.177016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:16.178231 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a1402b09-f310-4437-840e-a9674419b1ca tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] Returning 404 to user: Instance 87b7b6d6-8d8b-4b3a-a8b1-f72df82acbdd could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:16.178231 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a1402b09-f310-4437-840e-a9674419b1ca tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] 10.222.0.35 "POST /compute/v2.1/servers/87b7b6d6-8d8b-4b3a-a8b1-f72df82acbdd/action" status: 404 len: 111 microversion: 2.1 time: 0.417976 Jun 10 17:58:16.178231 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 103/188] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 17:58:15 2022] POST /compute/v2.1/servers/87b7b6d6-8d8b-4b3a-a8b1-f72df82acbdd/action => generated 111 bytes in 419 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 17:58:16.178450 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1164e0a3-7b9b-4b72-8650-f27b4c367241 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] 10.222.0.35 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.037611 Jun 10 17:58:16.178450 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 86/189] 10.222.0.35 () {58 vars in 1142 bytes} [Fri Jun 10 17:58:16 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:16.188380 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ba3915fc-eee4-49a0-9888-27613a25a7d7 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "chh1-master-2"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:16.189766 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:16.189766 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:16.219141 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ba3915fc-eee4-49a0-9888-27613a25a7d7 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:16.219516 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ba3915fc-eee4-49a0-9888-27613a25a7d7 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:16.289223 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5fa4bdb6-8ca1-4c57-b09d-09b35aa97bbd tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1770311056", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:16.382465 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-5fa4bdb6-8ca1-4c57-b09d-09b35aa97bbd tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] validate_networks() for None {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 17:58:16.543995 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ba3915fc-eee4-49a0-9888-27613a25a7d7 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.359478 Jun 10 17:58:16.544655 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 104/190] 10.222.0.35 () {60 vars in 1190 bytes} [Fri Jun 10 17:58:16 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:16.550426 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2033c9ea-b068-442c-b715-5ed3c6d08b65 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:16.551142 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2033c9ea-b068-442c-b715-5ed3c6d08b65 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:16.558582 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2033c9ea-b068-442c-b715-5ed3c6d08b65 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:16.559032 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2033c9ea-b068-442c-b715-5ed3c6d08b65 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:16.559807 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2033c9ea-b068-442c-b715-5ed3c6d08b65 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:16.560242 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2033c9ea-b068-442c-b715-5ed3c6d08b65 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:16.698958 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=4 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:58:16.711096 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2033c9ea-b068-442c-b715-5ed3c6d08b65 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e5bd8a55d42cdb7879fbead65627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9d5dac7c8243aeaa207c5a1ecb399a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:16.724766 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2033c9ea-b068-442c-b715-5ed3c6d08b65 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "GET /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2" status: 200 len: 1384 microversion: 2.1 time: 0.178517 Jun 10 17:58:16.725349 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 105/191] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:16 2022] GET /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 => generated 1384 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:16.732432 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-55408c66-3025-4c09-b15c-d340c7dcdcd7 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:16.732432 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-55408c66-3025-4c09-b15c-d340c7dcdcd7 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 4ef38095-36e0-4792-9516-caf76a5022c9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:16.736848 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-55408c66-3025-4c09-b15c-d340c7dcdcd7 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:16.737230 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-55408c66-3025-4c09-b15c-d340c7dcdcd7 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:16.738181 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-55408c66-3025-4c09-b15c-d340c7dcdcd7 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:16.738765 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-55408c66-3025-4c09-b15c-d340c7dcdcd7 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:16.752959 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-5fa4bdb6-8ca1-4c57-b09d-09b35aa97bbd tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 17:58:16.753381 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-5fa4bdb6-8ca1-4c57-b09d-09b35aa97bbd tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 17:58:16.753846 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-5fa4bdb6-8ca1-4c57-b09d-09b35aa97bbd tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 17:58:16.754248 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-5fa4bdb6-8ca1-4c57-b09d-09b35aa97bbd tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 17:58:16.754833 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-5fa4bdb6-8ca1-4c57-b09d-09b35aa97bbd tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 17:58:16.764432 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5fa4bdb6-8ca1-4c57-b09d-09b35aa97bbd tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:16.765063 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5fa4bdb6-8ca1-4c57-b09d-09b35aa97bbd tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:16.766382 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5fa4bdb6-8ca1-4c57-b09d-09b35aa97bbd tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:16.766817 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5fa4bdb6-8ca1-4c57-b09d-09b35aa97bbd tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:16.784569 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-5fa4bdb6-8ca1-4c57-b09d-09b35aa97bbd tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Getting quotas for project 141d09ed6e1548d996a675ec1f1011b7. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 17:58:16.790133 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-5fa4bdb6-8ca1-4c57-b09d-09b35aa97bbd tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Getting quotas for user 0a75d420afea440fba308b4ed26fd544 and project 141d09ed6e1548d996a675ec1f1011b7. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 17:58:16.802934 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5fa4bdb6-8ca1-4c57-b09d-09b35aa97bbd tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 17:58:16.805243 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5fa4bdb6-8ca1-4c57-b09d-09b35aa97bbd tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: 2814abaf-90ac-4439-b500-df1bd532b1bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 17:58:16.910318 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-55408c66-3025-4c09-b15c-d340c7dcdcd7 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:16.918488 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-55408c66-3025-4c09-b15c-d340c7dcdcd7 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9" status: 200 len: 1470 microversion: 2.1 time: 0.192138 Jun 10 17:58:16.919060 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 106/192] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:16 2022] GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9 => generated 1470 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:16.925262 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c8f10774-6366-47d1-b06b-95a04bdb02f2 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:16.926199 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:16.926199 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:16.944333 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5fa4bdb6-8ca1-4c57-b09d-09b35aa97bbd tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.659467 Jun 10 17:58:16.951807 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 87/193] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:58:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 17:58:17.032735 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c8f10774-6366-47d1-b06b-95a04bdb02f2 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] 10.222.0.35 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.111155 Jun 10 17:58:17.033620 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 107/194] 10.222.0.35 () {58 vars in 1151 bytes} [Fri Jun 10 17:58:16 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 10 17:58:17.042117 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a61df53d-092f-4c6d-82ed-b5ddd86d9071 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:17.042737 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a61df53d-092f-4c6d-82ed-b5ddd86d9071 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: 2814abaf-90ac-4439-b500-df1bd532b1bd] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:17.140274 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a61df53d-092f-4c6d-82ed-b5ddd86d9071 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:17.147479 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a61df53d-092f-4c6d-82ed-b5ddd86d9071 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd" status: 200 len: 1222 microversion: 2.1 time: 0.112728 Jun 10 17:58:17.148602 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 108/195] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:17 2022] GET /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd => generated 1222 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:17.154177 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b9edba49-2c75-48b7-b383-cde5dbda626f tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1967481746"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:17.156273 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:17.156273 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:17.157921 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.aggregate [None req-b9edba49-2c75-48b7-b383-cde5dbda626f tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Generated uuid 4f9b1190-3d79-480b-b452-28ce43c34afe for aggregate {{(pid=126595) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 10 17:58:17.244335 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a3acf928-13cb-4668-a22e-3a9085cb53ae tempest-DeleteServersAdminTestJSON-1379838124 tempest-DeleteServersAdminTestJSON-1379838124-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:17.244867 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a3acf928-13cb-4668-a22e-3a9085cb53ae tempest-DeleteServersAdminTestJSON-1379838124 tempest-DeleteServersAdminTestJSON-1379838124-project-admin] [instance: 4ef38095-36e0-4792-9516-caf76a5022c9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:17.251977 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b9edba49-2c75-48b7-b383-cde5dbda626f tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.102078 Jun 10 17:58:17.259600 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 109/196] 10.222.0.35 () {60 vars in 1163 bytes} [Fri Jun 10 17:58:17 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:17.276606 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-30f3bfaf-005d-4697-a68e-82533118171b tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:17.279761 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-30f3bfaf-005d-4697-a68e-82533118171b tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: ec39479e-5a78-42b6-b385-ceed608f0129] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:17.286938 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3acf928-13cb-4668-a22e-3a9085cb53ae tempest-DeleteServersAdminTestJSON-1379838124 tempest-DeleteServersAdminTestJSON-1379838124-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:17.287394 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3acf928-13cb-4668-a22e-3a9085cb53ae tempest-DeleteServersAdminTestJSON-1379838124 tempest-DeleteServersAdminTestJSON-1379838124-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:17.297293 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3acf928-13cb-4668-a22e-3a9085cb53ae tempest-DeleteServersAdminTestJSON-1379838124 tempest-DeleteServersAdminTestJSON-1379838124-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:17.298839 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3acf928-13cb-4668-a22e-3a9085cb53ae tempest-DeleteServersAdminTestJSON-1379838124 tempest-DeleteServersAdminTestJSON-1379838124-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:17.299668 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30f3bfaf-005d-4697-a68e-82533118171b tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:17.300176 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30f3bfaf-005d-4697-a68e-82533118171b tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:17.301038 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30f3bfaf-005d-4697-a68e-82533118171b tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:17.301465 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30f3bfaf-005d-4697-a68e-82533118171b tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:17.389378 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:58:17.398558 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a3acf928-13cb-4668-a22e-3a9085cb53ae tempest-DeleteServersAdminTestJSON-1379838124 tempest-DeleteServersAdminTestJSON-1379838124-project-admin] [instance: 4ef38095-36e0-4792-9516-caf76a5022c9] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 17:58:17.472899 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-30f3bfaf-005d-4697-a68e-82533118171b tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19776e5adf942c6a20e4dea1aa10cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1fd6bd677ff4b17bafee8fad1d720a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:17.481122 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-30f3bfaf-005d-4697-a68e-82533118171b tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "GET /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129" status: 200 len: 1319 microversion: 2.1 time: 0.220158 Jun 10 17:58:17.481695 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 110/197] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:17 2022] GET /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:17.487075 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-02d09f76-5839-4f50-a7a9-eca33aaa1748 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "chh1-master-2"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:17.488613 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:17.488613 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:17.497319 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02d09f76-5839-4f50-a7a9-eca33aaa1748 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:17.497768 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02d09f76-5839-4f50-a7a9-eca33aaa1748 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:17.500931 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:58:17.813829 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-02d09f76-5839-4f50-a7a9-eca33aaa1748 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.330517 Jun 10 17:58:17.814602 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 111/198] 10.222.0.35 () {60 vars in 1190 bytes} [Fri Jun 10 17:58:17 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:17.826672 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-0aace2df-3070-4f8e-abac-08ed9801681b req-4676dd49-1b25-4a57-9439-5de1f4dca764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2", "name": "network-vif-plugged", "status": "completed", "tag": "855ea6e2-3ff5-40bf-8166-8de14ae27ad9"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:17.836079 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-0aace2df-3070-4f8e-abac-08ed9801681b req-4676dd49-1b25-4a57-9439-5de1f4dca764 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:17.836244 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a3acf928-13cb-4668-a22e-3a9085cb53ae tempest-DeleteServersAdminTestJSON-1379838124 tempest-DeleteServersAdminTestJSON-1379838124-project-admin] 10.222.0.35 "DELETE /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9" status: 204 len: 0 microversion: 2.1 time: 0.882523 Jun 10 17:58:17.836856 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-0aace2df-3070-4f8e-abac-08ed9801681b req-4676dd49-1b25-4a57-9439-5de1f4dca764 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:17.837064 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 88/199] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 17:58:16 2022] DELETE /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9 => generated 0 bytes in 884 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 17:58:17.845700 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-78f46f7f-f405-4632-aca9-64b01852e9be tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:17.847383 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-78f46f7f-f405-4632-aca9-64b01852e9be tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:17.852749 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-0aace2df-3070-4f8e-abac-08ed9801681b req-4676dd49-1b25-4a57-9439-5de1f4dca764 service nova] Creating event network-vif-plugged:855ea6e2-3ff5-40bf-8166-8de14ae27ad9 for instance cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 on chh1-master-2 Jun 10 17:58:17.859689 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-78f46f7f-f405-4632-aca9-64b01852e9be tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:17.860033 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-0aace2df-3070-4f8e-abac-08ed9801681b req-4676dd49-1b25-4a57-9439-5de1f4dca764 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042097 Jun 10 17:58:17.860163 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-78f46f7f-f405-4632-aca9-64b01852e9be tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:17.861059 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 112/200] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:17.863621 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-78f46f7f-f405-4632-aca9-64b01852e9be tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:17.865436 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-78f46f7f-f405-4632-aca9-64b01852e9be tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:17.867560 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a6310fc9-a31e-40b0-b023-0c1b1fdcbc2f tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "chh1-master-2"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:17.869095 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:17.869095 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:17.879180 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a6310fc9-a31e-40b0-b023-0c1b1fdcbc2f tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:17.879630 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a6310fc9-a31e-40b0-b023-0c1b1fdcbc2f tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:18.110945 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-78f46f7f-f405-4632-aca9-64b01852e9be tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e5bd8a55d42cdb7879fbead65627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9d5dac7c8243aeaa207c5a1ecb399a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:18.118300 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-78f46f7f-f405-4632-aca9-64b01852e9be tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "GET /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2" status: 200 len: 1384 microversion: 2.1 time: 0.280015 Jun 10 17:58:18.118870 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 89/201] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:17 2022] GET /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 => generated 1384 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:18.123290 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1766d02f-23db-4343-bcc7-c1715aafe3e4 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:18.123896 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1766d02f-23db-4343-bcc7-c1715aafe3e4 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 4ef38095-36e0-4792-9516-caf76a5022c9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:18.133210 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1766d02f-23db-4343-bcc7-c1715aafe3e4 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:18.133677 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1766d02f-23db-4343-bcc7-c1715aafe3e4 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:18.134442 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1766d02f-23db-4343-bcc7-c1715aafe3e4 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:18.134882 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1766d02f-23db-4343-bcc7-c1715aafe3e4 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:18.171310 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a6310fc9-a31e-40b0-b023-0c1b1fdcbc2f tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.308596 Jun 10 17:58:18.176439 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 113/202] 10.222.0.35 () {60 vars in 1190 bytes} [Fri Jun 10 17:58:17 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:18.181387 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d8e92c65-8f9e-4d99-b5f1-d028e9c57b5a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:18.182320 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d8e92c65-8f9e-4d99-b5f1-d028e9c57b5a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: 2814abaf-90ac-4439-b500-df1bd532b1bd] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:18.189056 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d8e92c65-8f9e-4d99-b5f1-d028e9c57b5a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:18.189499 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d8e92c65-8f9e-4d99-b5f1-d028e9c57b5a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:18.190255 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d8e92c65-8f9e-4d99-b5f1-d028e9c57b5a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:18.190875 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d8e92c65-8f9e-4d99-b5f1-d028e9c57b5a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:18.259069 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d8e92c65-8f9e-4d99-b5f1-d028e9c57b5a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:18.268874 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d8e92c65-8f9e-4d99-b5f1-d028e9c57b5a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd" status: 200 len: 1226 microversion: 2.1 time: 0.090625 Jun 10 17:58:18.269384 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 114/203] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:18 2022] GET /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:18.273986 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5d9d2969-7eb8-405a-b3d2-9cb281b2c9f1 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:18.274749 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:18.274749 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:18.294569 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1766d02f-23db-4343-bcc7-c1715aafe3e4 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:18.305168 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1766d02f-23db-4343-bcc7-c1715aafe3e4 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9" status: 200 len: 1476 microversion: 2.1 time: 0.185268 Jun 10 17:58:18.305743 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 90/204] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:18 2022] GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9 => generated 1476 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:18.358169 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5d9d2969-7eb8-405a-b3d2-9cb281b2c9f1 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] 10.222.0.35 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.087611 Jun 10 17:58:18.359295 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 115/205] 10.222.0.35 () {58 vars in 1151 bytes} [Fri Jun 10 17:58:18 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 10 17:58:18.368802 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0efc0449-1bed-46a9-af94-f0abf9a5dbc2 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-486480707"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:18.370392 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:18.370392 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:18.371250 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.aggregate [None req-0efc0449-1bed-46a9-af94-f0abf9a5dbc2 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Generated uuid 338af16a-4e6c-4a20-a6c1-1354af79b902 for aggregate {{(pid=126594) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 10 17:58:18.378659 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=86,nova_api:INSERT=8,nova_api:DELETE=4 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:58:18.446640 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f9e7a672-4e1f-4960-9b30-357c03b08c52 tempest-AggregatesAdminTestV241-818929427 tempest-AggregatesAdminTestV241-818929427-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-36646531"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:18.448052 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:18.448052 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:18.449133 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.aggregate [None req-f9e7a672-4e1f-4960-9b30-357c03b08c52 tempest-AggregatesAdminTestV241-818929427 tempest-AggregatesAdminTestV241-818929427-project-admin] Generated uuid c82334b9-ecb1-4e97-a5df-5d4f7599c6e3 for aggregate {{(pid=126595) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 10 17:58:18.485536 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0efc0449-1bed-46a9-af94-f0abf9a5dbc2 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.120351 Jun 10 17:58:18.486716 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 91/206] 10.222.0.35 () {60 vars in 1163 bytes} [Fri Jun 10 17:58:18 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:18.496911 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-dd02acb5-2373-4130-be09-19815cfc88b5 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:18.497757 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:18.497757 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:18.568028 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f9e7a672-4e1f-4960-9b30-357c03b08c52 tempest-AggregatesAdminTestV241-818929427 tempest-AggregatesAdminTestV241-818929427-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.41 time: 0.126400 Jun 10 17:58:18.568660 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 116/207] 10.222.0.35 () {62 vars in 1204 bytes} [Fri Jun 10 17:58:18 2022] POST /compute/v2.1/os-aggregates => generated 244 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 17:58:18.573098 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-de24ab85-db02-4247-b18b-0ba0ea0b739e tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:18.573703 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-de24ab85-db02-4247-b18b-0ba0ea0b739e tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: ec39479e-5a78-42b6-b385-ceed608f0129] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:18.579927 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de24ab85-db02-4247-b18b-0ba0ea0b739e tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:18.580485 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de24ab85-db02-4247-b18b-0ba0ea0b739e tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:18.581249 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de24ab85-db02-4247-b18b-0ba0ea0b739e tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:18.581691 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de24ab85-db02-4247-b18b-0ba0ea0b739e tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:18.605054 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-dd02acb5-2373-4130-be09-19815cfc88b5 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] 10.222.0.35 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.112540 Jun 10 17:58:18.609943 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 92/208] 10.222.0.35 () {58 vars in 1151 bytes} [Fri Jun 10 17:58:18 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jun 10 17:58:18.621844 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9373d1f5-9804-4c48-99df-600ab3ba9cc0 tempest-AggregatesAdminTestV241-818929427 tempest-AggregatesAdminTestV241-818929427-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2137515411"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:18.715801 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:18.715801 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:18.740425 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-de24ab85-db02-4247-b18b-0ba0ea0b739e tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19776e5adf942c6a20e4dea1aa10cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1fd6bd677ff4b17bafee8fad1d720a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:18.750398 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-de24ab85-db02-4247-b18b-0ba0ea0b739e tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "GET /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129" status: 200 len: 1319 microversion: 2.1 time: 0.179620 Jun 10 17:58:18.751356 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 117/209] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:18 2022] GET /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:18.756119 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8742f3f1-c2af-4bca-8941-0d0c6a8c3b1a tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:18.757306 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:18.757306 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:18.763536 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-8742f3f1-c2af-4bca-8941-0d0c6a8c3b1a tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Jun 10 17:58:18.766937 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8742f3f1-c2af-4bca-8941-0d0c6a8c3b1a tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Request method failure captured: Jun 10 17:58:18.766937 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Jun 10 17:58:18.766937 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 17:58:18.766937 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 17:58:18.766937 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 17:58:18.766937 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 17:58:18.766937 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 17:58:18.766937 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 17:58:18.766937 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 17:58:18.766937 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:18.766937 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4YIliUfGoskwQrKLWH_xARBaDTVKMUxcbAsY27hJzKxRNDc8g_ntqhmB6nzS2-wlYFEHBckSPr8UdaKd8fHvRU3EhnDfiII4RVWnoPPJ44lK3KZXKGLEKTPz6JD0Z4IqqT3WE1lgc4PNd3MjFWs8rCirGC5SWhipUMPvLOjP-8aSLw Jun 10 17:58:18.766937 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 17:58:18.766937 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 17:58:18.766937 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 17:58:18.766937 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 17:58:18.766937 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 17:58:18.766937 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 17:58:18.766937 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 221da9069bd845018972992a95fa7925 Jun 10 17:58:18.766937 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-AggregatesAdminTestJSON-2078244761 Jun 10 17:58:18.766937 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member,admin Jun 10 17:58:18.766937 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member,admin Jun 10 17:58:18.768378 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/221da9069bd845018972992a95fa7925"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/221da9069bd845018972992a95fa7925"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/221da9069bd845018972992a95fa7925"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_221da9069bd845018972992a95fa7925", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:18.768378 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-AggregatesAdminTestJSON-2078244761 Jun 10 17:58:18.768378 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 221da9069bd845018972992a95fa7925 Jun 10 17:58:18.768378 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2078244761 Jun 10 17:58:18.768378 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-AggregatesAdminTestJSON-2078244761-project-admin Jun 10 17:58:18.768378 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 17:58:18.768378 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 17:58:18.768378 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: f98c758aa92a483abb48a2927c9ad757 Jun 10 17:58:18.768378 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-AggregatesAdminTestJSON-2078244761-project-admin Jun 10 17:58:18.768378 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 17:58:18.768378 chdv-master-2 devstack@n-api.service[126595]: exception: Aggregate 5 could not be found. Jun 10 17:58:18.768378 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '5'} Jun 10 17:58:18.768378 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:18.769284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:18.769284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jun 10 17:58:18.769284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jun 10 17:58:18.769284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jun 10 17:58:18.769284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jun 10 17:58:18.769284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 17:58:18.769284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 17:58:18.769284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 10 17:58:18.769284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 10 17:58:18.769284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 10 17:58:18.769284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 10 17:58:18.769284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 10 17:58:18.769284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 10 17:58:18.769284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Jun 10 17:58:18.769284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:18.769284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:18.769284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:18.769284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:18.769284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:18.770492 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:18.770492 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:18.770492 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:18.770492 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:18.770492 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:18.770492 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jun 10 17:58:18.770492 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 17:58:18.770492 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Jun 10 17:58:18.770492 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:18.770492 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:18.770492 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:18.770492 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:18.770492 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:18.770492 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:18.770492 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:58:18.770492 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:58:18.770492 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Jun 10 17:58:18.770492 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:18.772405 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8742f3f1-c2af-4bca-8941-0d0c6a8c3b1a tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:18.772405 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8742f3f1-c2af-4bca-8941-0d0c6a8c3b1a tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] 10.222.0.35 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.016988 Jun 10 17:58:18.772405 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 118/210] 10.222.0.35 () {58 vars in 1148 bytes} [Fri Jun 10 17:58:18 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 10 17:58:18.777928 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-35eb239a-4852-432d-bbcb-b9771c003be9 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:18.778667 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:18.778667 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:18.795511 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-35eb239a-4852-432d-bbcb-b9771c003be9 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Jun 10 17:58:18.797998 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-35eb239a-4852-432d-bbcb-b9771c003be9 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Request method failure captured: Jun 10 17:58:18.797998 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Jun 10 17:58:18.797998 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 17:58:18.797998 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 17:58:18.797998 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 17:58:18.797998 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 17:58:18.797998 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 17:58:18.797998 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 17:58:18.797998 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 17:58:18.797998 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:18.797998 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4YIliUfGoskwQrKLWH_xARBaDTVKMUxcbAsY27hJzKxRNDc8g_ntqhmB6nzS2-wlYFEHBckSPr8UdaKd8fHvRU3EhnDfiII4RVWnoPPJ44lK3KZXKGLEKTPz6JD0Z4IqqT3WE1lgc4PNd3MjFWs8rCirGC5SWhipUMPvLOjP-8aSLw Jun 10 17:58:18.797998 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 17:58:18.797998 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 17:58:18.797998 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 17:58:18.797998 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 17:58:18.797998 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 17:58:18.797998 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 17:58:18.797998 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 221da9069bd845018972992a95fa7925 Jun 10 17:58:18.797998 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-AggregatesAdminTestJSON-2078244761 Jun 10 17:58:18.797998 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member,admin Jun 10 17:58:18.797998 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member,admin Jun 10 17:58:18.799351 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/221da9069bd845018972992a95fa7925"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/221da9069bd845018972992a95fa7925"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/221da9069bd845018972992a95fa7925"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_221da9069bd845018972992a95fa7925", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:18.799351 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-AggregatesAdminTestJSON-2078244761 Jun 10 17:58:18.799351 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 221da9069bd845018972992a95fa7925 Jun 10 17:58:18.799351 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2078244761 Jun 10 17:58:18.799351 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-AggregatesAdminTestJSON-2078244761-project-admin Jun 10 17:58:18.799351 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 17:58:18.799351 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 17:58:18.799351 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: f98c758aa92a483abb48a2927c9ad757 Jun 10 17:58:18.799351 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-AggregatesAdminTestJSON-2078244761-project-admin Jun 10 17:58:18.799351 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 17:58:18.799351 chdv-master-2 devstack@n-api.service[126595]: exception: Aggregate 5 could not be found. Jun 10 17:58:18.799351 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '5'} Jun 10 17:58:18.799351 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:18.800152 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:18.800152 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jun 10 17:58:18.800152 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jun 10 17:58:18.800152 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 10 17:58:18.800152 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 10 17:58:18.800152 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 17:58:18.800152 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 17:58:18.800152 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 17:58:18.800152 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 17:58:18.800152 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 10 17:58:18.800152 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 10 17:58:18.800152 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jun 10 17:58:18.800152 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jun 10 17:58:18.800152 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 17:58:18.800152 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 17:58:18.800152 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 10 17:58:18.800152 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 10 17:58:18.800152 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 10 17:58:18.800152 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 10 17:58:18.801274 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 10 17:58:18.801274 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 10 17:58:18.801274 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Jun 10 17:58:18.801274 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:18.801274 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:18.801274 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:18.801274 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:18.801274 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:18.801274 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:18.801274 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:18.801274 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:18.801274 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:18.801274 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:18.801274 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jun 10 17:58:18.801274 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 17:58:18.801274 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Jun 10 17:58:18.801274 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:18.801274 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:18.801274 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:18.801274 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:18.801274 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:18.803861 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:18.803861 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:58:18.803861 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:58:18.803861 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Jun 10 17:58:18.803861 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:18.803861 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-35eb239a-4852-432d-bbcb-b9771c003be9 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:18.803861 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-35eb239a-4852-432d-bbcb-b9771c003be9 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] 10.222.0.35 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.025136 Jun 10 17:58:18.803861 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 119/211] 10.222.0.35 () {58 vars in 1151 bytes} [Fri Jun 10 17:58:18 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 10 17:58:18.812511 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bd937da9-6e18-4c59-92e9-b73e51192c82 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1408104569", "name": "tempest-test_aggregate-1477752458"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:18.818822 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9373d1f5-9804-4c48-99df-600ab3ba9cc0 tempest-AggregatesAdminTestV241-818929427 tempest-AggregatesAdminTestV241-818929427-project-admin] 10.222.0.35 "PUT /compute/v2.1/os-aggregates/6" status: 200 len: 299 microversion: 2.41 time: 0.200948 Jun 10 17:58:18.818822 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 93/212] 10.222.0.35 () {62 vars in 1209 bytes} [Fri Jun 10 17:58:18 2022] PUT /compute/v2.1/os-aggregates/6 => generated 299 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 17:58:18.819036 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:18.819036 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:18.819036 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.aggregate [None req-bd937da9-6e18-4c59-92e9-b73e51192c82 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Generated uuid ddb9117a-9de5-42f4-a5c7-aa9fcba39dac for aggregate {{(pid=126595) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 10 17:58:18.825259 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b9844b18-26f5-4bca-8898-1283b6349ae5 tempest-AggregatesAdminTestV241-818929427 tempest-AggregatesAdminTestV241-818929427-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:18.826140 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:18.826140 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:18.835198 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b9844b18-26f5-4bca-8898-1283b6349ae5 tempest-AggregatesAdminTestV241-818929427 tempest-AggregatesAdminTestV241-818929427-project-admin] 10.222.0.35 "GET /compute/v2.1/os-aggregates/6" status: 200 len: 299 microversion: 2.41 time: 0.015262 Jun 10 17:58:18.836136 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 94/213] 10.222.0.35 () {60 vars in 1189 bytes} [Fri Jun 10 17:58:18 2022] GET /compute/v2.1/os-aggregates/6 => generated 299 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 10 17:58:18.849403 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5f7ca40d-79c6-4dbf-87e5-c4766c95a270 tempest-AggregatesAdminTestV241-818929427 tempest-AggregatesAdminTestV241-818929427-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "chh1-master-2"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:18.850648 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:18.850648 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:18.860562 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f7ca40d-79c6-4dbf-87e5-c4766c95a270 tempest-AggregatesAdminTestV241-818929427 tempest-AggregatesAdminTestV241-818929427-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:18.863823 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f7ca40d-79c6-4dbf-87e5-c4766c95a270 tempest-AggregatesAdminTestV241-818929427 tempest-AggregatesAdminTestV241-818929427-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:18.920218 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bd937da9-6e18-4c59-92e9-b73e51192c82 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.112274 Jun 10 17:58:18.921190 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 120/214] 10.222.0.35 () {60 vars in 1164 bytes} [Fri Jun 10 17:58:18 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:18.931304 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-49ad81d6-1957-47e5-8875-d38bf11afc35 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:18.932206 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:18.932206 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:19.057187 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-49ad81d6-1957-47e5-8875-d38bf11afc35 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] 10.222.0.35 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.129505 Jun 10 17:58:19.057986 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 121/215] 10.222.0.35 () {58 vars in 1151 bytes} [Fri Jun 10 17:58:18 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jun 10 17:58:19.065966 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3ba38df9-8e14-4d32-9c75-bdbbdf38fbd5 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:19.066850 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:19.066850 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:19.073054 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-3ba38df9-8e14-4d32-9c75-bdbbdf38fbd5 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Jun 10 17:58:19.078260 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3ba38df9-8e14-4d32-9c75-bdbbdf38fbd5 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Request method failure captured: Jun 10 17:58:19.078260 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Jun 10 17:58:19.078260 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 17:58:19.078260 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 17:58:19.078260 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 17:58:19.078260 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 17:58:19.078260 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 17:58:19.078260 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 17:58:19.078260 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 17:58:19.078260 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:19.078260 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4YIliUfGoskwQrKLWH_xARBaDTVKMUxcbAsY27hJzKxRNDc8g_ntqhmB6nzS2-wlYFEHBckSPr8UdaKd8fHvRU3EhnDfiII4RVWnoPPJ44lK3KZXKGLEKTPz6JD0Z4IqqT3WE1lgc4PNd3MjFWs8rCirGC5SWhipUMPvLOjP-8aSLw Jun 10 17:58:19.078260 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 17:58:19.078260 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 17:58:19.078260 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 17:58:19.078260 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 17:58:19.078260 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 17:58:19.078260 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 17:58:19.078260 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 221da9069bd845018972992a95fa7925 Jun 10 17:58:19.078260 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-AggregatesAdminTestJSON-2078244761 Jun 10 17:58:19.078260 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member,admin Jun 10 17:58:19.078260 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member,admin Jun 10 17:58:19.079600 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/221da9069bd845018972992a95fa7925"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/221da9069bd845018972992a95fa7925"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/221da9069bd845018972992a95fa7925"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_221da9069bd845018972992a95fa7925", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:19.079600 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-AggregatesAdminTestJSON-2078244761 Jun 10 17:58:19.079600 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 221da9069bd845018972992a95fa7925 Jun 10 17:58:19.079600 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2078244761 Jun 10 17:58:19.079600 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-AggregatesAdminTestJSON-2078244761-project-admin Jun 10 17:58:19.079600 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 17:58:19.079600 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 17:58:19.079600 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: f98c758aa92a483abb48a2927c9ad757 Jun 10 17:58:19.079600 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-AggregatesAdminTestJSON-2078244761-project-admin Jun 10 17:58:19.079600 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 17:58:19.079600 chdv-master-2 devstack@n-api.service[126595]: exception: Aggregate 7 could not be found. Jun 10 17:58:19.079600 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '7'} Jun 10 17:58:19.079600 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:19.080392 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:19.080392 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jun 10 17:58:19.080392 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jun 10 17:58:19.080392 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jun 10 17:58:19.080392 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jun 10 17:58:19.080392 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 17:58:19.080392 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 17:58:19.080392 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 10 17:58:19.080392 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 10 17:58:19.080392 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 10 17:58:19.080392 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 10 17:58:19.080392 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 10 17:58:19.080392 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 10 17:58:19.080392 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Jun 10 17:58:19.080392 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:19.080392 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:19.080392 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:19.080392 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:19.080392 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:19.081444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:19.081444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:19.081444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:19.081444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:19.081444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:19.081444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jun 10 17:58:19.081444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 17:58:19.081444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Jun 10 17:58:19.081444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:19.081444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:19.081444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:19.081444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:19.081444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:19.081444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:19.081444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:58:19.081444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:58:19.081444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Jun 10 17:58:19.081444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:19.082431 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3ba38df9-8e14-4d32-9c75-bdbbdf38fbd5 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:19.082431 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3ba38df9-8e14-4d32-9c75-bdbbdf38fbd5 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] 10.222.0.35 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.013720 Jun 10 17:58:19.082431 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 122/216] 10.222.0.35 () {58 vars in 1148 bytes} [Fri Jun 10 17:58:19 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 10 17:58:19.087844 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a399fbf1-01a0-4d5a-a91e-bb996e7cffa5 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:19.088647 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:19.088647 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:19.099589 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-a399fbf1-01a0-4d5a-a91e-bb996e7cffa5 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Jun 10 17:58:19.104823 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a399fbf1-01a0-4d5a-a91e-bb996e7cffa5 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Request method failure captured: Jun 10 17:58:19.104823 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Jun 10 17:58:19.104823 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 17:58:19.104823 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 17:58:19.104823 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 17:58:19.104823 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 17:58:19.104823 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 17:58:19.104823 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 17:58:19.104823 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 17:58:19.104823 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:19.104823 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4YIliUfGoskwQrKLWH_xARBaDTVKMUxcbAsY27hJzKxRNDc8g_ntqhmB6nzS2-wlYFEHBckSPr8UdaKd8fHvRU3EhnDfiII4RVWnoPPJ44lK3KZXKGLEKTPz6JD0Z4IqqT3WE1lgc4PNd3MjFWs8rCirGC5SWhipUMPvLOjP-8aSLw Jun 10 17:58:19.104823 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 17:58:19.104823 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 17:58:19.104823 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 17:58:19.104823 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 17:58:19.104823 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 17:58:19.104823 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 17:58:19.104823 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 221da9069bd845018972992a95fa7925 Jun 10 17:58:19.104823 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-AggregatesAdminTestJSON-2078244761 Jun 10 17:58:19.104823 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member,admin Jun 10 17:58:19.104823 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member,admin Jun 10 17:58:19.106174 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/221da9069bd845018972992a95fa7925"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/221da9069bd845018972992a95fa7925"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/221da9069bd845018972992a95fa7925"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_221da9069bd845018972992a95fa7925", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:19.106174 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-AggregatesAdminTestJSON-2078244761 Jun 10 17:58:19.106174 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 221da9069bd845018972992a95fa7925 Jun 10 17:58:19.106174 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2078244761 Jun 10 17:58:19.106174 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-AggregatesAdminTestJSON-2078244761-project-admin Jun 10 17:58:19.106174 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 17:58:19.106174 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 17:58:19.106174 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: f98c758aa92a483abb48a2927c9ad757 Jun 10 17:58:19.106174 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-AggregatesAdminTestJSON-2078244761-project-admin Jun 10 17:58:19.106174 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 17:58:19.106174 chdv-master-2 devstack@n-api.service[126595]: exception: Aggregate 7 could not be found. Jun 10 17:58:19.106174 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '7'} Jun 10 17:58:19.106174 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:19.107082 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:19.107082 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jun 10 17:58:19.107082 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jun 10 17:58:19.107082 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 10 17:58:19.107082 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 10 17:58:19.107082 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 17:58:19.107082 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 17:58:19.107082 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 17:58:19.107082 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 17:58:19.107082 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 10 17:58:19.107082 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 10 17:58:19.107082 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jun 10 17:58:19.107082 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jun 10 17:58:19.107082 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 17:58:19.107082 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 17:58:19.107082 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 10 17:58:19.107082 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 10 17:58:19.107082 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 10 17:58:19.107082 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 10 17:58:19.108289 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 10 17:58:19.108289 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 10 17:58:19.108289 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Jun 10 17:58:19.108289 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:19.108289 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:19.108289 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:19.108289 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:19.108289 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:19.108289 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:19.108289 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:19.108289 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:19.108289 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:19.108289 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:19.108289 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jun 10 17:58:19.108289 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 17:58:19.108289 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Jun 10 17:58:19.108289 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:19.108289 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:19.108289 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:19.108289 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:19.108289 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:19.110211 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:19.110211 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:58:19.110211 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:58:19.110211 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Jun 10 17:58:19.110211 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:19.110211 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a399fbf1-01a0-4d5a-a91e-bb996e7cffa5 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:19.110211 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a399fbf1-01a0-4d5a-a91e-bb996e7cffa5 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] 10.222.0.35 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.018378 Jun 10 17:58:19.110211 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 123/217] 10.222.0.35 () {58 vars in 1151 bytes} [Fri Jun 10 17:58:19 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 10 17:58:19.114984 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4b7db3c5-46af-41b2-9d96-48578c56a3d8 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1477405343"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:19.116268 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:19.116268 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:19.117194 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.aggregate [None req-4b7db3c5-46af-41b2-9d96-48578c56a3d8 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Generated uuid 2ecc961d-455d-474b-8ff4-5ede9c52d579 for aggregate {{(pid=126595) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 10 17:58:19.189571 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5f7ca40d-79c6-4dbf-87e5-c4766c95a270 tempest-AggregatesAdminTestV241-818929427 tempest-AggregatesAdminTestV241-818929427-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 314 microversion: 2.41 time: 0.345764 Jun 10 17:58:19.189965 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 95/218] 10.222.0.35 () {62 vars in 1231 bytes} [Fri Jun 10 17:58:18 2022] POST /compute/v2.1/os-aggregates/6/action => generated 314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 17:58:19.195950 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-24fff245-29a4-4acc-acdd-a286e2ea469c tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:19.196820 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-24fff245-29a4-4acc-acdd-a286e2ea469c tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:19.204370 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-24fff245-29a4-4acc-acdd-a286e2ea469c tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:19.204839 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-24fff245-29a4-4acc-acdd-a286e2ea469c tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:19.206184 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-24fff245-29a4-4acc-acdd-a286e2ea469c tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:19.206651 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-24fff245-29a4-4acc-acdd-a286e2ea469c tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:19.216535 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4b7db3c5-46af-41b2-9d96-48578c56a3d8 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.104850 Jun 10 17:58:19.218819 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 124/219] 10.222.0.35 () {60 vars in 1163 bytes} [Fri Jun 10 17:58:19 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 17:58:19.225385 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9658c4f7-60ec-4c95-b45f-51c1df5790fe tempest-AggregatesAdminTestV241-818929427 tempest-AggregatesAdminTestV241-818929427-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "chh1-master-2"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:19.226884 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:19.226884 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:19.233462 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=9,nova_api:INSERT=6 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:58:19.243134 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9658c4f7-60ec-4c95-b45f-51c1df5790fe tempest-AggregatesAdminTestV241-818929427 tempest-AggregatesAdminTestV241-818929427-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:19.243920 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9658c4f7-60ec-4c95-b45f-51c1df5790fe tempest-AggregatesAdminTestV241-818929427 tempest-AggregatesAdminTestV241-818929427-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:19.375417 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-24fff245-29a4-4acc-acdd-a286e2ea469c tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e5bd8a55d42cdb7879fbead65627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9d5dac7c8243aeaa207c5a1ecb399a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:19.383659 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-24fff245-29a4-4acc-acdd-a286e2ea469c tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "GET /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2" status: 200 len: 1384 microversion: 2.1 time: 0.192694 Jun 10 17:58:19.384861 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 96/220] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:19 2022] GET /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 => generated 1384 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:19.388728 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-99616c10-6376-4fd3-8f1e-46192eac0d33 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:19.389906 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:19.389906 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:19.398171 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-99616c10-6376-4fd3-8f1e-46192eac0d33 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] 10.222.0.35 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 227 microversion: 2.1 time: 0.012799 Jun 10 17:58:19.399088 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 97/221] 10.222.0.35 () {58 vars in 1148 bytes} [Fri Jun 10 17:58:19 2022] GET /compute/v2.1/os-aggregates/8 => generated 227 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:19.404424 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-57148181-c7f0-4672-bb5f-ee759b775315 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:19.405213 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-57148181-c7f0-4672-bb5f-ee759b775315 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: 2814abaf-90ac-4439-b500-df1bd532b1bd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:19.412004 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-57148181-c7f0-4672-bb5f-ee759b775315 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:19.412552 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-57148181-c7f0-4672-bb5f-ee759b775315 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:19.413488 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-57148181-c7f0-4672-bb5f-ee759b775315 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:19.413934 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-57148181-c7f0-4672-bb5f-ee759b775315 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:19.485990 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-57148181-c7f0-4672-bb5f-ee759b775315 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:19.494441 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-57148181-c7f0-4672-bb5f-ee759b775315 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd" status: 200 len: 1274 microversion: 2.1 time: 0.093776 Jun 10 17:58:19.495145 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 98/222] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:19 2022] GET /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd => generated 1274 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:19.509846 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c1ac0c4a-c035-4647-937a-a09832a0170f tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:19.510630 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c1ac0c4a-c035-4647-937a-a09832a0170f tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 4ef38095-36e0-4792-9516-caf76a5022c9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:19.511969 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9658c4f7-60ec-4c95-b45f-51c1df5790fe tempest-AggregatesAdminTestV241-818929427 tempest-AggregatesAdminTestV241-818929427-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 299 microversion: 2.41 time: 0.289126 Jun 10 17:58:19.516867 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 125/223] 10.222.0.35 () {62 vars in 1231 bytes} [Fri Jun 10 17:58:19 2022] POST /compute/v2.1/os-aggregates/6/action => generated 299 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 17:58:19.522733 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c1ac0c4a-c035-4647-937a-a09832a0170f tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:19.523184 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c1ac0c4a-c035-4647-937a-a09832a0170f tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:19.523963 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c1ac0c4a-c035-4647-937a-a09832a0170f tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:19.524427 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c1ac0c4a-c035-4647-937a-a09832a0170f tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:19.532997 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-99f84351-6e89-458b-ab6a-98f607ba1308 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:19.542190 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:19.542190 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:19.652190 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-99f84351-6e89-458b-ab6a-98f607ba1308 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 265 microversion: 2.1 time: 0.134227 Jun 10 17:58:19.662408 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 126/224] 10.222.0.35 () {60 vars in 1190 bytes} [Fri Jun 10 17:58:19 2022] POST /compute/v2.1/os-aggregates/8/action => generated 265 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:19.671283 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6990804c-284c-4712-a29c-8ef453d07d27 tempest-AggregatesAdminTestV241-818929427 tempest-AggregatesAdminTestV241-818929427-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:19.680516 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:19.680516 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:19.699598 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c1ac0c4a-c035-4647-937a-a09832a0170f tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:19.708549 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c1ac0c4a-c035-4647-937a-a09832a0170f tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9" status: 200 len: 1476 microversion: 2.1 time: 0.212244 Jun 10 17:58:19.709133 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 99/225] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:19 2022] GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9 => generated 1476 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:19.713363 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-74d3923c-37ce-4b68-b8b8-c1750aa011ce tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:19.714256 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:19.714256 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:19.722513 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-74d3923c-37ce-4b68-b8b8-c1750aa011ce tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] 10.222.0.35 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.012415 Jun 10 17:58:19.723269 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 100/226] 10.222.0.35 () {58 vars in 1148 bytes} [Fri Jun 10 17:58:19 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:19.737895 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-49fb8da4-8d78-4c08-a8dd-ec30df380ceb tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:19.738655 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:19.738655 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:19.814173 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6990804c-284c-4712-a29c-8ef453d07d27 tempest-AggregatesAdminTestV241-818929427 tempest-AggregatesAdminTestV241-818929427-project-admin] 10.222.0.35 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.41 time: 0.149990 Jun 10 17:58:19.815007 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 127/227] 10.222.0.35 () {60 vars in 1192 bytes} [Fri Jun 10 17:58:19 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:19.820227 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-db9f710d-9b34-49f8-9726-384fb7e3d169 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:19.820876 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-db9f710d-9b34-49f8-9726-384fb7e3d169 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: ec39479e-5a78-42b6-b385-ceed608f0129] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:19.829206 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-db9f710d-9b34-49f8-9726-384fb7e3d169 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:19.829668 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-db9f710d-9b34-49f8-9726-384fb7e3d169 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:19.830631 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-db9f710d-9b34-49f8-9726-384fb7e3d169 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:19.831079 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-db9f710d-9b34-49f8-9726-384fb7e3d169 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:19.838381 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-49fb8da4-8d78-4c08-a8dd-ec30df380ceb tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] 10.222.0.35 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.103986 Jun 10 17:58:19.838994 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 101/228] 10.222.0.35 () {58 vars in 1151 bytes} [Fri Jun 10 17:58:19 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jun 10 17:58:19.862211 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a84c96fc-57b4-41db-84c1-b0af3b4c1bde tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1071308785", "availability_zone": "tempest-test_az-367246874"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:19.893820 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:19.893820 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:19.895620 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.aggregate [None req-a84c96fc-57b4-41db-84c1-b0af3b4c1bde tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Generated uuid 2ff3d19f-f96e-4ea4-860a-70c78064a117 for aggregate {{(pid=126594) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 10 17:58:20.009673 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-db9f710d-9b34-49f8-9726-384fb7e3d169 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19776e5adf942c6a20e4dea1aa10cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1fd6bd677ff4b17bafee8fad1d720a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:20.019583 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-db9f710d-9b34-49f8-9726-384fb7e3d169 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "GET /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129" status: 200 len: 1319 microversion: 2.1 time: 0.203176 Jun 10 17:58:20.020120 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 128/229] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:19 2022] GET /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129 => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:20.035978 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a84c96fc-57b4-41db-84c1-b0af3b4c1bde tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.178604 Jun 10 17:58:20.036596 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 102/230] 10.222.0.35 () {60 vars in 1164 bytes} [Fri Jun 10 17:58:19 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 17:58:20.046138 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d117b26d-ce22-4c97-b792-7624daf74d07 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1071308785_new", "availability_zone": "tempest-test_az-367246874_new"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:20.052991 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:20.052991 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:20.153954 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d117b26d-ce22-4c97-b792-7624daf74d07 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:20.154502 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d117b26d-ce22-4c97-b792-7624daf74d07 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:20.291598 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d117b26d-ce22-4c97-b792-7624daf74d07 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] 10.222.0.35 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 334 microversion: 2.1 time: 0.248533 Jun 10 17:58:20.292632 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 103/231] 10.222.0.35 () {60 vars in 1169 bytes} [Fri Jun 10 17:58:20 2022] PUT /compute/v2.1/os-aggregates/9 => generated 334 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 17:58:20.304439 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-808a1a27-95fe-485a-a613-d40d521a3b84 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:20.305284 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:20.305284 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:20.314421 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-808a1a27-95fe-485a-a613-d40d521a3b84 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] 10.222.0.35 "GET /compute/v2.1/os-aggregates" status: 200 len: 337 microversion: 2.1 time: 0.013467 Jun 10 17:58:20.324154 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 104/232] 10.222.0.35 () {58 vars in 1142 bytes} [Fri Jun 10 17:58:20 2022] GET /compute/v2.1/os-aggregates => generated 337 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:20.331910 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b0d2ca7e-d0eb-4c8b-8d9e-ce637d9111af tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:20.332723 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:20.332723 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:20.429982 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e091b76f-13a9-4d00-9f87-5a5871e82990 tempest-QuotasAdminTestV236-632984903 tempest-QuotasAdminTestV236-632984903-project-admin] Action: 'update', calling method: .version_select at 0x7f77c1b6ae50>, body: {"quota_set": {"ram": "5120"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:20.438966 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b0d2ca7e-d0eb-4c8b-8d9e-ce637d9111af tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] 10.222.0.35 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.110627 Jun 10 17:58:20.439843 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 105/233] 10.222.0.35 () {58 vars in 1151 bytes} [Fri Jun 10 17:58:20 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 10 17:58:20.446295 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-18e31139-bae0-4308-a6ea-77772e75b5dc tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:20.453457 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-18e31139-bae0-4308-a6ea-77772e75b5dc tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:20.463025 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-18e31139-bae0-4308-a6ea-77772e75b5dc tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:20.463632 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-18e31139-bae0-4308-a6ea-77772e75b5dc tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:20.464998 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-18e31139-bae0-4308-a6ea-77772e75b5dc tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:20.465450 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-18e31139-bae0-4308-a6ea-77772e75b5dc tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:20.705436 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-18e31139-bae0-4308-a6ea-77772e75b5dc tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e5bd8a55d42cdb7879fbead65627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9d5dac7c8243aeaa207c5a1ecb399a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:20.714669 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-18e31139-bae0-4308-a6ea-77772e75b5dc tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "GET /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2" status: 200 len: 1582 microversion: 2.1 time: 0.273680 Jun 10 17:58:20.715256 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 106/234] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:20 2022] GET /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 => generated 1582 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:20.721984 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d6de3400-c13c-4915-9016-678038817862 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-575571505"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:20.723438 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:20.723438 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:20.724653 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.aggregate [None req-d6de3400-c13c-4915-9016-678038817862 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Generated uuid 90d9fd3a-e1cf-4d5c-9754-776d56b64b9b for aggregate {{(pid=126594) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 10 17:58:20.761403 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=15 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:58:20.762963 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e091b76f-13a9-4d00-9f87-5a5871e82990 tempest-QuotasAdminTestV236-632984903 tempest-QuotasAdminTestV236-632984903-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:20.765637 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e091b76f-13a9-4d00-9f87-5a5871e82990 tempest-QuotasAdminTestV236-632984903 tempest-QuotasAdminTestV236-632984903-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:20.765637 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e091b76f-13a9-4d00-9f87-5a5871e82990 tempest-QuotasAdminTestV236-632984903 tempest-QuotasAdminTestV236-632984903-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:20.765637 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e091b76f-13a9-4d00-9f87-5a5871e82990 tempest-QuotasAdminTestV236-632984903 tempest-QuotasAdminTestV236-632984903-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:20.878117 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d6de3400-c13c-4915-9016-678038817862 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.159524 Jun 10 17:58:20.878907 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 107/235] 10.222.0.35 () {60 vars in 1163 bytes} [Fri Jun 10 17:58:20 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:20.885514 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1f514522-1f7f-4627-904e-bc8bd09d936a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:20.886467 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1f514522-1f7f-4627-904e-bc8bd09d936a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: 2814abaf-90ac-4439-b500-df1bd532b1bd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:20.905269 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1f514522-1f7f-4627-904e-bc8bd09d936a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:20.907355 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1f514522-1f7f-4627-904e-bc8bd09d936a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:20.910047 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1f514522-1f7f-4627-904e-bc8bd09d936a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:20.915056 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1f514522-1f7f-4627-904e-bc8bd09d936a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:20.918413 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e091b76f-13a9-4d00-9f87-5a5871e82990 tempest-QuotasAdminTestV236-632984903 tempest-QuotasAdminTestV236-632984903-project-admin] 10.222.0.35 "PUT /compute/v2.1/os-quota-sets/bfd2fe614f2f4590bf96c0d51621e544" status: 200 len: 240 microversion: 2.36 time: 0.870800 Jun 10 17:58:20.919045 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 129/236] 10.222.0.35 () {62 vars in 1302 bytes} [Fri Jun 10 17:58:20 2022] PUT /compute/v2.1/os-quota-sets/bfd2fe614f2f4590bf96c0d51621e544 => generated 240 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 17:58:20.925132 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a3833666-7224-4acf-8ee5-3b1e251f55dc tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:20.925701 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a3833666-7224-4acf-8ee5-3b1e251f55dc tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:20.933143 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a3833666-7224-4acf-8ee5-3b1e251f55dc tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:20.933516 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a3833666-7224-4acf-8ee5-3b1e251f55dc tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:20.934300 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a3833666-7224-4acf-8ee5-3b1e251f55dc tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:20.934731 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a3833666-7224-4acf-8ee5-3b1e251f55dc tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:21.115408 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a3833666-7224-4acf-8ee5-3b1e251f55dc tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "GET /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.195088 Jun 10 17:58:21.116245 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 130/237] 10.222.0.35 () {58 vars in 1274 bytes} [Fri Jun 10 17:58:20 2022] GET /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2/os-interface => generated 284 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:21.122351 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-76a606c0-f8e0-4f5a-963c-aea953564720 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:21.126357 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-76a606c0-f8e0-4f5a-963c-aea953564720 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 4ef38095-36e0-4792-9516-caf76a5022c9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:21.130639 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-76a606c0-f8e0-4f5a-963c-aea953564720 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:21.131150 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-76a606c0-f8e0-4f5a-963c-aea953564720 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:21.131989 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-76a606c0-f8e0-4f5a-963c-aea953564720 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:21.132524 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-76a606c0-f8e0-4f5a-963c-aea953564720 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:21.446126 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1f514522-1f7f-4627-904e-bc8bd09d936a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:21.459027 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1f514522-1f7f-4627-904e-bc8bd09d936a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd" status: 200 len: 1322 microversion: 2.1 time: 0.578864 Jun 10 17:58:21.460374 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 108/238] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:20 2022] GET /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd => generated 1322 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:21.478715 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-19ff695a-517d-4d43-b99e-ff2e7f1cb5c3 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:21.479578 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:21.479578 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:21.500188 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-19ff695a-517d-4d43-b99e-ff2e7f1cb5c3 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] 10.222.0.35 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.037951 Jun 10 17:58:21.506553 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 109/239] 10.222.0.35 () {58 vars in 1142 bytes} [Fri Jun 10 17:58:21 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:21.512206 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-dd7e5f17-be28-4c40-83aa-81967a0667b4 tempest-QuotasAdminTestV236-632984903 tempest-QuotasAdminTestV236-632984903-project-admin] Calling method '.version_select at 0x7f77c1bf9280>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:21.704041 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-76a606c0-f8e0-4f5a-963c-aea953564720 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:21.721128 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-76a606c0-f8e0-4f5a-963c-aea953564720 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9" status: 200 len: 1476 microversion: 2.1 time: 0.603410 Jun 10 17:58:21.721902 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 131/240] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:21 2022] GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9 => generated 1476 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:21.726253 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-51f4f69c-3c4a-48f0-83cc-ed65754c3454 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:21.726853 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-51f4f69c-3c4a-48f0-83cc-ed65754c3454 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: ec39479e-5a78-42b6-b385-ceed608f0129] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:21.741376 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-51f4f69c-3c4a-48f0-83cc-ed65754c3454 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:21.741575 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-51f4f69c-3c4a-48f0-83cc-ed65754c3454 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:21.742351 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-51f4f69c-3c4a-48f0-83cc-ed65754c3454 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:21.742827 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-51f4f69c-3c4a-48f0-83cc-ed65754c3454 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:21.948490 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=67,nova_cell0:UPDATE=12 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:58:21.953808 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dd7e5f17-be28-4c40-83aa-81967a0667b4 tempest-QuotasAdminTestV236-632984903 tempest-QuotasAdminTestV236-632984903-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:21.956154 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dd7e5f17-be28-4c40-83aa-81967a0667b4 tempest-QuotasAdminTestV236-632984903 tempest-QuotasAdminTestV236-632984903-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:21.957048 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dd7e5f17-be28-4c40-83aa-81967a0667b4 tempest-QuotasAdminTestV236-632984903 tempest-QuotasAdminTestV236-632984903-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:21.957491 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dd7e5f17-be28-4c40-83aa-81967a0667b4 tempest-QuotasAdminTestV236-632984903 tempest-QuotasAdminTestV236-632984903-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:22.023203 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-dd7e5f17-be28-4c40-83aa-81967a0667b4 tempest-QuotasAdminTestV236-632984903 tempest-QuotasAdminTestV236-632984903-project-admin] 10.222.0.35 "GET /compute/v2.1/os-quota-sets/bfd2fe614f2f4590bf96c0d51621e544/detail" status: 200 len: 672 microversion: 2.36 time: 0.514980 Jun 10 17:58:22.026750 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 110/241] 10.222.0.35 () {60 vars in 1303 bytes} [Fri Jun 10 17:58:21 2022] GET /compute/v2.1/os-quota-sets/bfd2fe614f2f4590bf96c0d51621e544/detail => generated 672 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 17:58:22.037800 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cfd2e943-f569-4717-8f3d-4a55b96f95b8 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:22.038782 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:22.038782 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:22.156884 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cfd2e943-f569-4717-8f3d-4a55b96f95b8 tempest-AggregatesAdminTestJSON-2078244761 tempest-AggregatesAdminTestJSON-2078244761-project-admin] 10.222.0.35 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.130968 Jun 10 17:58:22.159443 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 111/242] 10.222.0.35 () {58 vars in 1154 bytes} [Fri Jun 10 17:58:22 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 10 17:58:22.171720 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-1e525a2f-1e3c-436a-9e1f-44b945eda6a5 req-7c5e7ec1-4ce7-427e-bf07-524de88709fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ef38095-36e0-4792-9516-caf76a5022c9", "name": "network-vif-deleted", "tag": "9b60d347-65df-4aa7-85ac-1c504203cdea"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:22.187911 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-1e525a2f-1e3c-436a-9e1f-44b945eda6a5 req-7c5e7ec1-4ce7-427e-bf07-524de88709fd service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:22.188400 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-1e525a2f-1e3c-436a-9e1f-44b945eda6a5 req-7c5e7ec1-4ce7-427e-bf07-524de88709fd service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:22.201726 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-1e525a2f-1e3c-436a-9e1f-44b945eda6a5 req-7c5e7ec1-4ce7-427e-bf07-524de88709fd service nova] Creating event network-vif-deleted:9b60d347-65df-4aa7-85ac-1c504203cdea for instance 4ef38095-36e0-4792-9516-caf76a5022c9 on chh2-master-2 Jun 10 17:58:22.207703 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-1e525a2f-1e3c-436a-9e1f-44b945eda6a5 req-7c5e7ec1-4ce7-427e-bf07-524de88709fd service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047764 Jun 10 17:58:22.212786 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 112/243] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:22.219472 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-53d7b360-090b-4964-82ca-2ef9c3e361ca tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:22.220138 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-53d7b360-090b-4964-82ca-2ef9c3e361ca tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] [instance: 6467b83c-72e4-4991-a025-4690618f1115] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:22.227148 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-53d7b360-090b-4964-82ca-2ef9c3e361ca tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:22.227644 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-53d7b360-090b-4964-82ca-2ef9c3e361ca tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:22.228540 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-53d7b360-090b-4964-82ca-2ef9c3e361ca tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:22.229070 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-53d7b360-090b-4964-82ca-2ef9c3e361ca tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:22.244485 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-53d7b360-090b-4964-82ca-2ef9c3e361ca tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] HTTP exception thrown: Instance 6467b83c-72e4-4991-a025-4690618f1115 could not be found. Jun 10 17:58:22.249563 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-53d7b360-090b-4964-82ca-2ef9c3e361ca tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Request method failure captured: Jun 10 17:58:22.249563 chdv-master-2 devstack@n-api.service[126594]: request: DELETE /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115 HTTP/1.1 Jun 10 17:58:22.249563 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 17:58:22.249563 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 17:58:22.249563 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 17:58:22.249563 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 17:58:22.249563 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 17:58:22.249563 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 17:58:22.249563 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 17:58:22.249563 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:22.249563 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4YFd94gi5EPxOq7HPjLKqIeLNxRHzV9KGgbDaDPc7DW00XdHGzBHJOZuDZTgXfYr_Z7PFrf04CZFQCTgptha6NaBhXvm5BSx4IjkgVZ1y4W4V8EDxYO_xk15uJqYEwiUL_BLRE_Dkq5yhJbMk8Wavx1Mmtc9CqFoOuwMYjR5Po4CnQ Jun 10 17:58:22.249563 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 17:58:22.249563 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 17:58:22.249563 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 17:58:22.249563 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 17:58:22.249563 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 17:58:22.249563 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 17:58:22.249563 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 066ae7d9e1564b91bbbaea7ff17dc789 Jun 10 17:58:22.249563 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-AggregatesAdminTestJSON-2014712996 Jun 10 17:58:22.249563 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 17:58:22.249563 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 17:58:22.250799 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/066ae7d9e1564b91bbbaea7ff17dc789"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/066ae7d9e1564b91bbbaea7ff17dc789"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/066ae7d9e1564b91bbbaea7ff17dc789"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_066ae7d9e1564b91bbbaea7ff17dc789", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:22.250799 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-AggregatesAdminTestJSON-2014712996 Jun 10 17:58:22.250799 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 066ae7d9e1564b91bbbaea7ff17dc789 Jun 10 17:58:22.250799 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2014712996 Jun 10 17:58:22.250799 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-AggregatesAdminTestJSON-2014712996-project Jun 10 17:58:22.250799 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 17:58:22.250799 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 17:58:22.250799 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 77dc782a65b645c7a534aabc90d09110 Jun 10 17:58:22.250799 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-AggregatesAdminTestJSON-2014712996-project Jun 10 17:58:22.250799 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 17:58:22.250799 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 6467b83c-72e4-4991-a025-4690618f1115 could not be found. Jun 10 17:58:22.250799 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '6467b83c-72e4-4991-a025-4690618f1115'} Jun 10 17:58:22.251445 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:22.251445 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:22.251445 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 17:58:22.251445 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 17:58:22.251445 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 17:58:22.251445 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 17:58:22.251445 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 17:58:22.251445 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 17:58:22.251445 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 17:58:22.251445 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 17:58:22.251445 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6467b83c-72e4-4991-a025-4690618f1115 could not be found. Jun 10 17:58:22.251445 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:22.251445 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:22.251445 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:22.251445 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:22.251445 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:22.251445 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:22.251445 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:22.251445 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:22.251445 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:22.252835 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:22.252835 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 17:58:22.252835 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 17:58:22.252835 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 17:58:22.252835 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 17:58:22.252835 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 17:58:22.252835 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 17:58:22.252835 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 17:58:22.252835 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 17:58:22.252835 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6467b83c-72e4-4991-a025-4690618f1115 could not be found. Jun 10 17:58:22.252835 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:22.252835 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:22.252835 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:22.252835 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:22.252835 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:22.252835 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:22.252835 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:58:22.252835 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:58:22.252835 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6467b83c-72e4-4991-a025-4690618f1115 could not be found. Jun 10 17:58:22.252835 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:22.253861 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-53d7b360-090b-4964-82ca-2ef9c3e361ca tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Returning 404 to user: Instance 6467b83c-72e4-4991-a025-4690618f1115 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:22.253861 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-53d7b360-090b-4964-82ca-2ef9c3e361ca tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] 10.222.0.35 "DELETE /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115" status: 404 len: 111 microversion: 2.1 time: 0.036988 Jun 10 17:58:22.253861 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 113/244] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 17:58:22 2022] DELETE /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:58:22.260850 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e4e6feee-0a92-403a-bdee-8b29c5747ee8 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:22.261679 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e4e6feee-0a92-403a-bdee-8b29c5747ee8 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] [instance: 6467b83c-72e4-4991-a025-4690618f1115] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:22.268850 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e4e6feee-0a92-403a-bdee-8b29c5747ee8 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:22.269386 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e4e6feee-0a92-403a-bdee-8b29c5747ee8 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:22.270290 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e4e6feee-0a92-403a-bdee-8b29c5747ee8 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:22.270800 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e4e6feee-0a92-403a-bdee-8b29c5747ee8 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:22.286954 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-e4e6feee-0a92-403a-bdee-8b29c5747ee8 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] HTTP exception thrown: Instance 6467b83c-72e4-4991-a025-4690618f1115 could not be found. Jun 10 17:58:22.288640 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e4e6feee-0a92-403a-bdee-8b29c5747ee8 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Request method failure captured: Jun 10 17:58:22.288640 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115 HTTP/1.1 Jun 10 17:58:22.288640 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 17:58:22.288640 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 17:58:22.288640 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 17:58:22.288640 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 17:58:22.288640 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 17:58:22.288640 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 17:58:22.288640 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 17:58:22.288640 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:22.288640 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4YFd94gi5EPxOq7HPjLKqIeLNxRHzV9KGgbDaDPc7DW00XdHGzBHJOZuDZTgXfYr_Z7PFrf04CZFQCTgptha6NaBhXvm5BSx4IjkgVZ1y4W4V8EDxYO_xk15uJqYEwiUL_BLRE_Dkq5yhJbMk8Wavx1Mmtc9CqFoOuwMYjR5Po4CnQ Jun 10 17:58:22.288640 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 17:58:22.288640 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 17:58:22.288640 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 17:58:22.288640 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 17:58:22.288640 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 17:58:22.288640 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 17:58:22.288640 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 066ae7d9e1564b91bbbaea7ff17dc789 Jun 10 17:58:22.288640 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-AggregatesAdminTestJSON-2014712996 Jun 10 17:58:22.288640 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 17:58:22.288640 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 17:58:22.290113 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/066ae7d9e1564b91bbbaea7ff17dc789"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/066ae7d9e1564b91bbbaea7ff17dc789"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/066ae7d9e1564b91bbbaea7ff17dc789"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_066ae7d9e1564b91bbbaea7ff17dc789", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:22.290113 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-AggregatesAdminTestJSON-2014712996 Jun 10 17:58:22.290113 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 066ae7d9e1564b91bbbaea7ff17dc789 Jun 10 17:58:22.290113 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2014712996 Jun 10 17:58:22.290113 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-AggregatesAdminTestJSON-2014712996-project Jun 10 17:58:22.290113 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 17:58:22.290113 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 17:58:22.290113 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 77dc782a65b645c7a534aabc90d09110 Jun 10 17:58:22.290113 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-AggregatesAdminTestJSON-2014712996-project Jun 10 17:58:22.290113 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 17:58:22.290113 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 6467b83c-72e4-4991-a025-4690618f1115 could not be found. Jun 10 17:58:22.290113 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '6467b83c-72e4-4991-a025-4690618f1115'} Jun 10 17:58:22.290919 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:22.290919 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:22.290919 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 17:58:22.290919 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 17:58:22.290919 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 17:58:22.290919 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 17:58:22.290919 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 17:58:22.290919 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 17:58:22.290919 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 17:58:22.290919 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 17:58:22.290919 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6467b83c-72e4-4991-a025-4690618f1115 could not be found. Jun 10 17:58:22.290919 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:22.290919 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:22.290919 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:22.290919 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:22.290919 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:22.290919 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:22.290919 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:22.290919 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:22.290919 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:22.292219 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:22.292219 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 17:58:22.292219 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 17:58:22.292219 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 17:58:22.292219 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 17:58:22.292219 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 17:58:22.292219 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 17:58:22.292219 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6467b83c-72e4-4991-a025-4690618f1115 could not be found. Jun 10 17:58:22.292219 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:22.292219 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:22.292219 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:22.292219 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:22.292219 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:22.292219 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:22.292219 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:58:22.292219 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:58:22.292219 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6467b83c-72e4-4991-a025-4690618f1115 could not be found. Jun 10 17:58:22.292219 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:22.293428 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e4e6feee-0a92-403a-bdee-8b29c5747ee8 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] Returning 404 to user: Instance 6467b83c-72e4-4991-a025-4690618f1115 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:22.293428 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e4e6feee-0a92-403a-bdee-8b29c5747ee8 tempest-AggregatesAdminTestJSON-2014712996 tempest-AggregatesAdminTestJSON-2014712996-project] 10.222.0.35 "GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115" status: 404 len: 111 microversion: 2.1 time: 0.035497 Jun 10 17:58:22.294511 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 114/245] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:22 2022] GET /compute/v2.1/servers/6467b83c-72e4-4991-a025-4690618f1115 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:58:22.478444 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-67bcfb15-d09b-4da2-8194-7b1ec83b753b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:22.480739 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-67bcfb15-d09b-4da2-8194-7b1ec83b753b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: 2814abaf-90ac-4439-b500-df1bd532b1bd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:22.506865 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-67bcfb15-d09b-4da2-8194-7b1ec83b753b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:22.511971 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-67bcfb15-d09b-4da2-8194-7b1ec83b753b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:22.513176 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-67bcfb15-d09b-4da2-8194-7b1ec83b753b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:22.514339 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-67bcfb15-d09b-4da2-8194-7b1ec83b753b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:22.525056 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-51f4f69c-3c4a-48f0-83cc-ed65754c3454 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19776e5adf942c6a20e4dea1aa10cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1fd6bd677ff4b17bafee8fad1d720a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:22.533398 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-51f4f69c-3c4a-48f0-83cc-ed65754c3454 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "GET /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129" status: 200 len: 1319 microversion: 2.1 time: 0.810630 Jun 10 17:58:22.533986 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 132/246] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:21 2022] GET /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129 => generated 1319 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:22.738281 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-17b43754-fe71-48a7-8bca-fcc198c769ff tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:22.739607 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-17b43754-fe71-48a7-8bca-fcc198c769ff tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 4ef38095-36e0-4792-9516-caf76a5022c9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:22.750315 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-17b43754-fe71-48a7-8bca-fcc198c769ff tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:22.757722 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-17b43754-fe71-48a7-8bca-fcc198c769ff tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:22.758589 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-17b43754-fe71-48a7-8bca-fcc198c769ff tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:22.759120 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-17b43754-fe71-48a7-8bca-fcc198c769ff tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:22.845221 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-17b43754-fe71-48a7-8bca-fcc198c769ff tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:22.847212 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-17b43754-fe71-48a7-8bca-fcc198c769ff tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:22.847633 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-17b43754-fe71-48a7-8bca-fcc198c769ff tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lazy-loading 'fault' on Instance uuid 4ef38095-36e0-4792-9516-caf76a5022c9 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 17:58:22.989721 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-17b43754-fe71-48a7-8bca-fcc198c769ff tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:23.001660 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-17b43754-fe71-48a7-8bca-fcc198c769ff tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9" status: 200 len: 1310 microversion: 2.1 time: 0.264721 Jun 10 17:58:23.002633 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 133/247] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:22 2022] GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9 => generated 1310 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:58:23.011101 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6627a714-b5f5-4f35-97b5-ea0d02f9e37b tempest-QuotasAdminTestV236-632984903 tempest-QuotasAdminTestV236-632984903-project-admin] Action: 'update', calling method: .version_select at 0x7f77c1af45e0>, body: {"quota_set": {"ram": "2048"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:23.111638 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-67bcfb15-d09b-4da2-8194-7b1ec83b753b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:23.120041 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-67bcfb15-d09b-4da2-8194-7b1ec83b753b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd" status: 200 len: 1322 microversion: 2.1 time: 0.646925 Jun 10 17:58:23.140701 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 115/248] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:22 2022] GET /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd => generated 1322 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:23.382741 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6627a714-b5f5-4f35-97b5-ea0d02f9e37b tempest-QuotasAdminTestV236-632984903 tempest-QuotasAdminTestV236-632984903-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:23.383437 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6627a714-b5f5-4f35-97b5-ea0d02f9e37b tempest-QuotasAdminTestV236-632984903 tempest-QuotasAdminTestV236-632984903-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:23.384510 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6627a714-b5f5-4f35-97b5-ea0d02f9e37b tempest-QuotasAdminTestV236-632984903 tempest-QuotasAdminTestV236-632984903-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:23.385158 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6627a714-b5f5-4f35-97b5-ea0d02f9e37b tempest-QuotasAdminTestV236-632984903 tempest-QuotasAdminTestV236-632984903-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:23.432022 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6627a714-b5f5-4f35-97b5-ea0d02f9e37b tempest-QuotasAdminTestV236-632984903 tempest-QuotasAdminTestV236-632984903-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:23.432585 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6627a714-b5f5-4f35-97b5-ea0d02f9e37b tempest-QuotasAdminTestV236-632984903 tempest-QuotasAdminTestV236-632984903-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:23.433426 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6627a714-b5f5-4f35-97b5-ea0d02f9e37b tempest-QuotasAdminTestV236-632984903 tempest-QuotasAdminTestV236-632984903-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:23.434142 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6627a714-b5f5-4f35-97b5-ea0d02f9e37b tempest-QuotasAdminTestV236-632984903 tempest-QuotasAdminTestV236-632984903-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:23.558130 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ac1c1701-9c07-4bd3-91da-b1ae52d5fb4f tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:23.558735 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ac1c1701-9c07-4bd3-91da-b1ae52d5fb4f tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: ec39479e-5a78-42b6-b385-ceed608f0129] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:23.566807 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6627a714-b5f5-4f35-97b5-ea0d02f9e37b tempest-QuotasAdminTestV236-632984903 tempest-QuotasAdminTestV236-632984903-project-admin] 10.222.0.35 "PUT /compute/v2.1/os-quota-sets/bfd2fe614f2f4590bf96c0d51621e544?user_id=7657e5472feb4600aad154e05f3faa80" status: 200 len: 240 microversion: 2.36 time: 0.559143 Jun 10 17:58:23.569001 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ac1c1701-9c07-4bd3-91da-b1ae52d5fb4f tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:23.572575 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ac1c1701-9c07-4bd3-91da-b1ae52d5fb4f tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:23.575227 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ac1c1701-9c07-4bd3-91da-b1ae52d5fb4f tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:23.577059 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 134/249] 10.222.0.35 () {62 vars in 1383 bytes} [Fri Jun 10 17:58:23 2022] PUT /compute/v2.1/os-quota-sets/bfd2fe614f2f4590bf96c0d51621e544?user_id=7657e5472feb4600aad154e05f3faa80 => generated 240 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 17:58:23.577243 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ac1c1701-9c07-4bd3-91da-b1ae52d5fb4f tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:23.595016 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d3c0caf6-93cb-49f4-99e8-dceef0bbcbf8 tempest-QuotasAdminTestV236-632984903 tempest-QuotasAdminTestV236-632984903-project-admin] Calling method '.version_select at 0x7f77c1af4790>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:23.841032 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d3c0caf6-93cb-49f4-99e8-dceef0bbcbf8 tempest-QuotasAdminTestV236-632984903 tempest-QuotasAdminTestV236-632984903-project-admin] 10.222.0.35 "GET /compute/v2.1/os-quota-sets/bfd2fe614f2f4590bf96c0d51621e544?user_id=7657e5472feb4600aad154e05f3faa80" status: 200 len: 282 microversion: 2.36 time: 0.257771 Jun 10 17:58:23.859466 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 135/250] 10.222.0.35 () {60 vars in 1363 bytes} [Fri Jun 10 17:58:23 2022] GET /compute/v2.1/os-quota-sets/bfd2fe614f2f4590bf96c0d51621e544?user_id=7657e5472feb4600aad154e05f3faa80 => generated 282 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 17:58:23.864398 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1086959d-9028-4632-99db-a92e6e69a49d tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:23.865012 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1086959d-9028-4632-99db-a92e6e69a49d tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:23.884859 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1086959d-9028-4632-99db-a92e6e69a49d tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:23.894845 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1086959d-9028-4632-99db-a92e6e69a49d tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:23.900032 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1086959d-9028-4632-99db-a92e6e69a49d tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:23.900798 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1086959d-9028-4632-99db-a92e6e69a49d tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:23.948560 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ac1c1701-9c07-4bd3-91da-b1ae52d5fb4f tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19776e5adf942c6a20e4dea1aa10cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1fd6bd677ff4b17bafee8fad1d720a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:23.958751 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ac1c1701-9c07-4bd3-91da-b1ae52d5fb4f tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "GET /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129" status: 200 len: 1319 microversion: 2.1 time: 0.407450 Jun 10 17:58:23.960890 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 116/251] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:23 2022] GET /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129 => generated 1319 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:58:23.976447 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-aca0655e-6c42-446e-a15a-3532dcb323c2 req-599ab52c-d11d-421c-b7b5-4c9710c7afc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2", "tag": "855ea6e2-3ff5-40bf-8166-8de14ae27ad9"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:24.001728 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=8,nova_api:UPDATE=3,nova_api:INSERT=4 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:58:24.006400 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-aca0655e-6c42-446e-a15a-3532dcb323c2 req-599ab52c-d11d-421c-b7b5-4c9710c7afc8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:24.007515 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-aca0655e-6c42-446e-a15a-3532dcb323c2 req-599ab52c-d11d-421c-b7b5-4c9710c7afc8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:24.041067 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-aca0655e-6c42-446e-a15a-3532dcb323c2 req-599ab52c-d11d-421c-b7b5-4c9710c7afc8 service nova] Creating event network-changed:855ea6e2-3ff5-40bf-8166-8de14ae27ad9 for instance cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 on chh1-master-2 Jun 10 17:58:24.059125 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-aca0655e-6c42-446e-a15a-3532dcb323c2 req-599ab52c-d11d-421c-b7b5-4c9710c7afc8 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095625 Jun 10 17:58:24.063948 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 117/252] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:24.073619 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c2adcd84-615f-4a14-935b-eb5e973a99ec tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:24.077765 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c2adcd84-615f-4a14-935b-eb5e973a99ec tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 4ef38095-36e0-4792-9516-caf76a5022c9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:24.090713 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c2adcd84-615f-4a14-935b-eb5e973a99ec tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:24.092861 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c2adcd84-615f-4a14-935b-eb5e973a99ec tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:24.096421 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c2adcd84-615f-4a14-935b-eb5e973a99ec tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:24.096993 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c2adcd84-615f-4a14-935b-eb5e973a99ec tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:24.120034 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-c2adcd84-615f-4a14-935b-eb5e973a99ec tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] HTTP exception thrown: Instance 4ef38095-36e0-4792-9516-caf76a5022c9 could not be found. Jun 10 17:58:24.122391 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c2adcd84-615f-4a14-935b-eb5e973a99ec tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Request method failure captured: Jun 10 17:58:24.122391 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9 HTTP/1.1 Jun 10 17:58:24.122391 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 17:58:24.122391 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 17:58:24.122391 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 17:58:24.122391 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 17:58:24.122391 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 17:58:24.122391 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 17:58:24.122391 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 17:58:24.122391 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:24.122391 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4YMziWCTAU0ECivXoRxTAmNyX7m5R2ybjAG4_pkm4uGzetr0UivZNtFpFqllUCykYtsNoP13IOG7RwH60UYZ0ry6CCO_ht7yXG6Jn4pVasvKK8YtIJealFaS43MeShKArcTJ1-SWv0E6Et_2sP5P22_Ndb-ggAg2fGG71kKTkDHg60 Jun 10 17:58:24.122391 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 17:58:24.122391 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 17:58:24.122391 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 17:58:24.122391 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 17:58:24.122391 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 17:58:24.122391 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 17:58:24.122391 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 175eeed60130438eaf02299dc72b708d Jun 10 17:58:24.122391 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-DeleteServersAdminTestJSON-765056364 Jun 10 17:58:24.122391 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 17:58:24.122391 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 17:58:24.123528 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/175eeed60130438eaf02299dc72b708d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/175eeed60130438eaf02299dc72b708d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/175eeed60130438eaf02299dc72b708d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_175eeed60130438eaf02299dc72b708d", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:24.123528 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-DeleteServersAdminTestJSON-765056364 Jun 10 17:58:24.123528 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 175eeed60130438eaf02299dc72b708d Jun 10 17:58:24.123528 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-765056364 Jun 10 17:58:24.123528 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-DeleteServersAdminTestJSON-765056364-project Jun 10 17:58:24.123528 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 17:58:24.123528 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 17:58:24.123528 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 680f0e3161f74f139dae76fab34293bb Jun 10 17:58:24.123528 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-DeleteServersAdminTestJSON-765056364-project Jun 10 17:58:24.123528 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 17:58:24.123528 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 4ef38095-36e0-4792-9516-caf76a5022c9 could not be found. Jun 10 17:58:24.123528 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '4ef38095-36e0-4792-9516-caf76a5022c9'} Jun 10 17:58:24.124240 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:24.124240 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:24.124240 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 17:58:24.124240 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 17:58:24.124240 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 17:58:24.124240 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 17:58:24.124240 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 17:58:24.124240 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 17:58:24.124240 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 17:58:24.124240 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 17:58:24.124240 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ef38095-36e0-4792-9516-caf76a5022c9 could not be found. Jun 10 17:58:24.124240 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:24.124240 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:24.124240 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:24.124240 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:24.124240 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:24.124240 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:24.124240 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:24.124240 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:24.124240 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:24.125335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:24.125335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 17:58:24.125335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 17:58:24.125335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 17:58:24.125335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 17:58:24.125335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 17:58:24.125335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 17:58:24.125335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ef38095-36e0-4792-9516-caf76a5022c9 could not be found. Jun 10 17:58:24.125335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:24.125335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:24.125335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:24.125335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:24.125335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:24.125335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:24.125335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:58:24.125335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:58:24.125335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ef38095-36e0-4792-9516-caf76a5022c9 could not be found. Jun 10 17:58:24.125335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:24.129579 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c2adcd84-615f-4a14-935b-eb5e973a99ec tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Returning 404 to user: Instance 4ef38095-36e0-4792-9516-caf76a5022c9 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:24.130742 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c2adcd84-615f-4a14-935b-eb5e973a99ec tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9" status: 404 len: 111 microversion: 2.1 time: 0.065208 Jun 10 17:58:24.131841 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 118/253] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:24 2022] GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:58:24.144053 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-9ea8ce7b-0f3e-4d65-bdfb-c997415e35cd req-7170bafe-45eb-46ce-b296-2d515f85c9b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec39479e-5a78-42b6-b385-ceed608f0129", "name": "network-vif-plugged", "status": "completed", "tag": "5df70e87-2212-413e-87f5-9f827ec2ab67"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:24.165994 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-9ea8ce7b-0f3e-4d65-bdfb-c997415e35cd req-7170bafe-45eb-46ce-b296-2d515f85c9b9 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:24.168530 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-9ea8ce7b-0f3e-4d65-bdfb-c997415e35cd req-7170bafe-45eb-46ce-b296-2d515f85c9b9 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:24.207802 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-9ea8ce7b-0f3e-4d65-bdfb-c997415e35cd req-7170bafe-45eb-46ce-b296-2d515f85c9b9 service nova] Creating event network-vif-plugged:5df70e87-2212-413e-87f5-9f827ec2ab67 for instance ec39479e-5a78-42b6-b385-ceed608f0129 on chh2-master-2 Jun 10 17:58:24.222769 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-9ea8ce7b-0f3e-4d65-bdfb-c997415e35cd req-7170bafe-45eb-46ce-b296-2d515f85c9b9 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089475 Jun 10 17:58:24.223379 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 119/254] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:24.238181 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-23938493-fce1-4354-acac-c643946c8f2d tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:24.238882 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-23938493-fce1-4354-acac-c643946c8f2d tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: 2814abaf-90ac-4439-b500-df1bd532b1bd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:24.263728 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-23938493-fce1-4354-acac-c643946c8f2d tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:24.263728 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-23938493-fce1-4354-acac-c643946c8f2d tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:24.264440 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-23938493-fce1-4354-acac-c643946c8f2d tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:24.264887 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-23938493-fce1-4354-acac-c643946c8f2d tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:24.411980 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1086959d-9028-4632-99db-a92e6e69a49d tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e5bd8a55d42cdb7879fbead65627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9d5dac7c8243aeaa207c5a1ecb399a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:24.422551 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1086959d-9028-4632-99db-a92e6e69a49d tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "GET /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2" status: 200 len: 1582 microversion: 2.1 time: 0.559875 Jun 10 17:58:24.436187 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 136/255] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:23 2022] GET /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 => generated 1582 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:24.444446 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-ff59cd16-4f8d-4995-a437-2c1b50d53b4f req-fe4cd0f7-463c-4fa3-99c6-49b00b36ec1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2814abaf-90ac-4439-b500-df1bd532b1bd", "tag": "4aa7695e-b4b6-496c-9f4a-5dfdb701aebc"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:24.458917 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-ff59cd16-4f8d-4995-a437-2c1b50d53b4f req-fe4cd0f7-463c-4fa3-99c6-49b00b36ec1a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:24.460072 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-ff59cd16-4f8d-4995-a437-2c1b50d53b4f req-fe4cd0f7-463c-4fa3-99c6-49b00b36ec1a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:24.477559 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-ff59cd16-4f8d-4995-a437-2c1b50d53b4f req-fe4cd0f7-463c-4fa3-99c6-49b00b36ec1a service nova] Creating event network-changed:4aa7695e-b4b6-496c-9f4a-5dfdb701aebc for instance 2814abaf-90ac-4439-b500-df1bd532b1bd on chh1-master-2 Jun 10 17:58:24.488623 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-ff59cd16-4f8d-4995-a437-2c1b50d53b4f req-fe4cd0f7-463c-4fa3-99c6-49b00b36ec1a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048283 Jun 10 17:58:24.489490 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 137/256] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:24.635906 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3b26677c-ab11-400e-a5d0-83e7b397aed3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-2076949796", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:24.727990 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-3b26677c-ab11-400e-a5d0-83e7b397aed3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] validate_networks() for None {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 17:58:24.979237 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-3b26677c-ab11-400e-a5d0-83e7b397aed3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 17:58:24.980609 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-3b26677c-ab11-400e-a5d0-83e7b397aed3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 17:58:24.981248 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-3b26677c-ab11-400e-a5d0-83e7b397aed3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 17:58:24.991107 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-3b26677c-ab11-400e-a5d0-83e7b397aed3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 17:58:24.991107 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-3b26677c-ab11-400e-a5d0-83e7b397aed3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 17:58:24.997721 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3b26677c-ab11-400e-a5d0-83e7b397aed3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:24.998883 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3b26677c-ab11-400e-a5d0-83e7b397aed3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:25.003354 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3b26677c-ab11-400e-a5d0-83e7b397aed3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:25.003809 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3b26677c-ab11-400e-a5d0-83e7b397aed3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:25.009932 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-23938493-fce1-4354-acac-c643946c8f2d tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:25.027566 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-23938493-fce1-4354-acac-c643946c8f2d tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd" status: 200 len: 1322 microversion: 2.1 time: 0.795163 Jun 10 17:58:25.038395 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 120/257] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:24 2022] GET /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd => generated 1322 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:25.044246 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3a8fcfd9-09cf-467a-9281-d7250e5b89a3 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:25.045523 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3a8fcfd9-09cf-467a-9281-d7250e5b89a3 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: ec39479e-5a78-42b6-b385-ceed608f0129] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:25.050254 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-3b26677c-ab11-400e-a5d0-83e7b397aed3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Getting quotas for project 175eeed60130438eaf02299dc72b708d. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 17:58:25.055000 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3a8fcfd9-09cf-467a-9281-d7250e5b89a3 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:25.055665 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3a8fcfd9-09cf-467a-9281-d7250e5b89a3 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:25.056632 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3a8fcfd9-09cf-467a-9281-d7250e5b89a3 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:25.057248 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3a8fcfd9-09cf-467a-9281-d7250e5b89a3 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:25.065465 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-3b26677c-ab11-400e-a5d0-83e7b397aed3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Getting quotas for user 680f0e3161f74f139dae76fab34293bb and project 175eeed60130438eaf02299dc72b708d. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 17:58:25.094990 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3b26677c-ab11-400e-a5d0-83e7b397aed3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 17:58:25.098667 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3b26677c-ab11-400e-a5d0-83e7b397aed3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 1fcc6103-9ecc-42f4-9df8-ac2251f06eed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 17:58:25.305328 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3a8fcfd9-09cf-467a-9281-d7250e5b89a3 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19776e5adf942c6a20e4dea1aa10cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1fd6bd677ff4b17bafee8fad1d720a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:25.316127 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3b26677c-ab11-400e-a5d0-83e7b397aed3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.689025 Jun 10 17:58:25.316820 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 138/258] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:58:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 17:58:25.317777 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3a8fcfd9-09cf-467a-9281-d7250e5b89a3 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "GET /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129" status: 200 len: 1319 microversion: 2.1 time: 0.277470 Jun 10 17:58:25.319090 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 121/259] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:25 2022] GET /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129 => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:25.338818 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dadd0f4d-e8c1-4f11-8528-3fa2b53b28bb tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:25.339436 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dadd0f4d-e8c1-4f11-8528-3fa2b53b28bb tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 1fcc6103-9ecc-42f4-9df8-ac2251f06eed] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:25.500865 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-dadd0f4d-e8c1-4f11-8528-3fa2b53b28bb tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:25.514954 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dadd0f4d-e8c1-4f11-8528-3fa2b53b28bb tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed" status: 200 len: 1220 microversion: 2.1 time: 0.183409 Jun 10 17:58:25.516846 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 139/260] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:25 2022] GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed => generated 1220 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:26.046095 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5d22148b-01bc-44d8-9b0b-083aea418d21 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:26.046741 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5d22148b-01bc-44d8-9b0b-083aea418d21 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: 2814abaf-90ac-4439-b500-df1bd532b1bd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:26.071734 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5d22148b-01bc-44d8-9b0b-083aea418d21 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:26.072211 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5d22148b-01bc-44d8-9b0b-083aea418d21 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:26.078341 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5d22148b-01bc-44d8-9b0b-083aea418d21 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:26.079820 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5d22148b-01bc-44d8-9b0b-083aea418d21 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:26.089663 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:58:26.350927 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-400061f2-2844-4cb3-972d-892308d313a1 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:26.365615 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-400061f2-2844-4cb3-972d-892308d313a1 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: ec39479e-5a78-42b6-b385-ceed608f0129] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:26.386452 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-400061f2-2844-4cb3-972d-892308d313a1 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:26.387109 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-400061f2-2844-4cb3-972d-892308d313a1 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:26.390236 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-400061f2-2844-4cb3-972d-892308d313a1 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:26.390697 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-400061f2-2844-4cb3-972d-892308d313a1 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:26.817397 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5d22148b-01bc-44d8-9b0b-083aea418d21 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:26.827107 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5d22148b-01bc-44d8-9b0b-083aea418d21 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd" status: 200 len: 1322 microversion: 2.1 time: 0.784355 Jun 10 17:58:26.830848 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 122/261] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:26 2022] GET /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd => generated 1322 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:26.842584 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f6bea1b6-db44-4654-ab2c-565f355b2ef9 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:26.847788 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f6bea1b6-db44-4654-ab2c-565f355b2ef9 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 1fcc6103-9ecc-42f4-9df8-ac2251f06eed] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:26.850572 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-400061f2-2844-4cb3-972d-892308d313a1 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19776e5adf942c6a20e4dea1aa10cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1fd6bd677ff4b17bafee8fad1d720a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:26.857351 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f6bea1b6-db44-4654-ab2c-565f355b2ef9 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:26.857802 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f6bea1b6-db44-4654-ab2c-565f355b2ef9 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:26.862357 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-400061f2-2844-4cb3-972d-892308d313a1 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "GET /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129" status: 200 len: 1319 microversion: 2.1 time: 0.527220 Jun 10 17:58:26.862501 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f6bea1b6-db44-4654-ab2c-565f355b2ef9 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:26.862692 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 140/262] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:26 2022] GET /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129 => generated 1319 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:26.862800 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f6bea1b6-db44-4654-ab2c-565f355b2ef9 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:26.988731 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f6bea1b6-db44-4654-ab2c-565f355b2ef9 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:26.998464 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f6bea1b6-db44-4654-ab2c-565f355b2ef9 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed" status: 200 len: 1224 microversion: 2.1 time: 0.165003 Jun 10 17:58:27.047000 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 123/263] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:26 2022] GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed => generated 1224 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:27.852244 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4d89afb5-e7cc-4462-96a7-6d38106eb5d5 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:27.853691 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4d89afb5-e7cc-4462-96a7-6d38106eb5d5 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: 2814abaf-90ac-4439-b500-df1bd532b1bd] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:27.857816 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=3,nova_api:INSERT=6 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:58:27.866149 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d89afb5-e7cc-4462-96a7-6d38106eb5d5 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:27.866781 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d89afb5-e7cc-4462-96a7-6d38106eb5d5 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:27.867817 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d89afb5-e7cc-4462-96a7-6d38106eb5d5 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:27.868264 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d89afb5-e7cc-4462-96a7-6d38106eb5d5 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:27.879996 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-10817dc0-e4fb-452a-864e-a6f7df75c811 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:27.881444 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-10817dc0-e4fb-452a-864e-a6f7df75c811 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: ec39479e-5a78-42b6-b385-ceed608f0129] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:27.888690 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-10817dc0-e4fb-452a-864e-a6f7df75c811 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:27.889401 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-10817dc0-e4fb-452a-864e-a6f7df75c811 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:27.890433 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-10817dc0-e4fb-452a-864e-a6f7df75c811 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:27.891237 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-10817dc0-e4fb-452a-864e-a6f7df75c811 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:28.092262 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4d89afb5-e7cc-4462-96a7-6d38106eb5d5 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:28.110268 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4d89afb5-e7cc-4462-96a7-6d38106eb5d5 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd" status: 200 len: 1322 microversion: 2.1 time: 0.264444 Jun 10 17:58:28.111264 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 141/264] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:27 2022] GET /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:28.122358 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cd922d88-5257-4180-aba8-2df268f5cffd tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:28.124944 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cd922d88-5257-4180-aba8-2df268f5cffd tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 1fcc6103-9ecc-42f4-9df8-ac2251f06eed] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:28.148353 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd922d88-5257-4180-aba8-2df268f5cffd tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:28.148353 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd922d88-5257-4180-aba8-2df268f5cffd tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:28.148353 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd922d88-5257-4180-aba8-2df268f5cffd tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:28.155237 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd922d88-5257-4180-aba8-2df268f5cffd tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:28.301991 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-10817dc0-e4fb-452a-864e-a6f7df75c811 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19776e5adf942c6a20e4dea1aa10cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1fd6bd677ff4b17bafee8fad1d720a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:28.342236 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-10817dc0-e4fb-452a-864e-a6f7df75c811 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "GET /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129" status: 200 len: 1469 microversion: 2.1 time: 0.468453 Jun 10 17:58:28.346456 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 124/265] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:27 2022] GET /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129 => generated 1469 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:28.621816 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cd922d88-5257-4180-aba8-2df268f5cffd tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:28.633297 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cd922d88-5257-4180-aba8-2df268f5cffd tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed" status: 200 len: 1272 microversion: 2.1 time: 0.519530 Jun 10 17:58:28.635877 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 142/266] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:28 2022] GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed => generated 1272 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:28.873944 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2a77482b-b935-4742-989f-ed690a6ddcbf tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1591098000", "block_migration": true, "disk_over_commit": false}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:28.876892 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2a77482b-b935-4742-989f-ed690a6ddcbf tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] [instance: ec39479e-5a78-42b6-b385-ceed608f0129] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:28.889726 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2a77482b-b935-4742-989f-ed690a6ddcbf tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:28.894190 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2a77482b-b935-4742-989f-ed690a6ddcbf tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:28.894190 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2a77482b-b935-4742-989f-ed690a6ddcbf tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:28.894764 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2a77482b-b935-4742-989f-ed690a6ddcbf tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:29.110599 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7642ef68-6604-4bbf-8bdb-a6f1b7d9420a tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1035377115", "id": 1645374522, "os-flavor-access:is_public": "True"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:29.112731 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:29.112731 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:29.187081 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-2a77482b-b935-4742-989f-ed690a6ddcbf tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] Lazy-loading 'flavor' on Instance uuid ec39479e-5a78-42b6-b385-ceed608f0129 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 17:58:29.201513 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7642ef68-6604-4bbf-8bdb-a6f1b7d9420a tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.549737 Jun 10 17:58:29.202959 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 143/267] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:58:28 2022] POST /compute/v2.1/flavors => generated 430 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:29.209401 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4b39ad7b-0da9-42c8-837b-92b7742c29e4 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:29.210514 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4b39ad7b-0da9-42c8-837b-92b7742c29e4 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: 2814abaf-90ac-4439-b500-df1bd532b1bd] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:29.217819 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4b39ad7b-0da9-42c8-837b-92b7742c29e4 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:29.218993 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4b39ad7b-0da9-42c8-837b-92b7742c29e4 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:29.220045 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4b39ad7b-0da9-42c8-837b-92b7742c29e4 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:29.221398 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4b39ad7b-0da9-42c8-837b-92b7742c29e4 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:29.335792 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2a77482b-b935-4742-989f-ed690a6ddcbf tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] [instance: ec39479e-5a78-42b6-b385-ceed608f0129] Going to try to live migrate instance to tempest-host-1591098000 {{(pid=126594) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 10 17:58:29.354404 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-2a77482b-b935-4742-989f-ed690a6ddcbf tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] HTTP exception thrown: Compute host tempest-host-1591098000 could not be found. Jun 10 17:58:29.364195 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2a77482b-b935-4742-989f-ed690a6ddcbf tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] Request method failure captured: Jun 10 17:58:29.364195 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129/action HTTP/1.1 Jun 10 17:58:29.364195 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 17:58:29.364195 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 17:58:29.364195 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 17:58:29.364195 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 107 Jun 10 17:58:29.364195 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 17:58:29.364195 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 17:58:29.364195 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 17:58:29.364195 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:29.364195 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4YtgqKm-7jt1LM2ijRFtRklcxcsEYPxTz3G5Cl1lUt1kWbqZMN2-XTOqzNgxGL-KKa8Ry4hhAQvnkg8wFezSGtk5q1py_YN_AhKuKf9ETaKM-SMbatdqLZvUqlVT0YEtGbIvEqXJEPfTsVfBZfwQb1W43tW4CtXr-QjJKTUf50mr4E Jun 10 17:58:29.364195 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 17:58:29.364195 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 17:58:29.364195 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 17:58:29.364195 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 17:58:29.364195 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 17:58:29.364195 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 17:58:29.364195 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 3c42f9f1f3444a95a8a07f8465e0b618 Jun 10 17:58:29.364195 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-LiveMigrationNegativeTest-1937937126 Jun 10 17:58:29.364195 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member,admin Jun 10 17:58:29.364195 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member,admin Jun 10 17:58:29.367007 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/3c42f9f1f3444a95a8a07f8465e0b618"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3c42f9f1f3444a95a8a07f8465e0b618"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3c42f9f1f3444a95a8a07f8465e0b618"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_3c42f9f1f3444a95a8a07f8465e0b618", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:29.367007 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-LiveMigrationNegativeTest-1937937126 Jun 10 17:58:29.367007 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 3c42f9f1f3444a95a8a07f8465e0b618 Jun 10 17:58:29.367007 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1937937126 Jun 10 17:58:29.367007 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-LiveMigrationNegativeTest-1937937126-project-admin Jun 10 17:58:29.367007 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 17:58:29.367007 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 17:58:29.367007 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 321486887a244fd8bd75e1ec9ca07853 Jun 10 17:58:29.367007 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-LiveMigrationNegativeTest-1937937126-project-admin Jun 10 17:58:29.367007 chdv-master-2 devstack@n-api.service[126594]: Jun 10 17:58:29.367007 chdv-master-2 devstack@n-api.service[126594]: {"os-migrateLive": {"host": "tempest-host-1591098000", "block_migration": true, "disk_over_commit": false}} Jun 10 17:58:29.367007 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 17:58:29.367815 chdv-master-2 devstack@n-api.service[126594]: exception: Compute host tempest-host-1591098000 could not be found. Jun 10 17:58:29.367815 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'ec39479e-5a78-42b6-b385-ceed608f0129', 'body': {'os-migrateLive': {'host': 'tempest-host-1591098000', 'block_migration': True, 'disk_over_commit': False}}} Jun 10 17:58:29.367815 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:29.367815 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:29.367815 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jun 10 17:58:29.367815 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jun 10 17:58:29.367815 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 10 17:58:29.367815 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 10 17:58:29.367815 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 10 17:58:29.367815 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 10 17:58:29.367815 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 10 17:58:29.367815 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 10 17:58:29.367815 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 10 17:58:29.367815 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 10 17:58:29.367815 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jun 10 17:58:29.367815 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 10 17:58:29.367815 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jun 10 17:58:29.367815 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 10 17:58:29.367815 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 10 17:58:29.369064 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 10 17:58:29.369064 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 10 17:58:29.369064 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 10 17:58:29.369064 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5355, in live_migrate Jun 10 17:58:29.369064 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Jun 10 17:58:29.369064 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 17:58:29.369064 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 17:58:29.369064 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Jun 10 17:58:29.369064 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Jun 10 17:58:29.369064 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Jun 10 17:58:29.369064 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:29.369064 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Jun 10 17:58:29.369064 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Jun 10 17:58:29.369064 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Jun 10 17:58:29.369064 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Jun 10 17:58:29.369064 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Jun 10 17:58:29.369064 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Jun 10 17:58:29.369064 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1591098000 could not be found. Jun 10 17:58:29.369064 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:29.370388 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:29.370388 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:29.370388 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:29.370388 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:29.370388 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:29.370388 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:29.370388 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:29.370388 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:29.370388 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:29.370388 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 17:58:29.370388 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 17:58:29.370388 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 17:58:29.370388 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 17:58:29.370388 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 17:58:29.370388 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 17:58:29.370388 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 10 17:58:29.370388 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Jun 10 17:58:29.370388 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 10 17:58:29.370388 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1591098000 could not be found. Jun 10 17:58:29.370388 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:29.371515 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:29.371515 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:29.371515 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:29.371515 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:29.371515 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:29.371515 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:58:29.371515 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:58:29.371515 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1591098000 could not be found. Jun 10 17:58:29.371515 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:29.371515 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2a77482b-b935-4742-989f-ed690a6ddcbf tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] Returning 400 to user: Compute host tempest-host-1591098000 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:29.375754 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2a77482b-b935-4742-989f-ed690a6ddcbf tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] 10.222.0.35 "POST /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129/action" status: 400 len: 100 microversion: 2.1 time: 1.005404 Jun 10 17:58:29.379390 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 125/268] 10.222.0.35 () {60 vars in 1278 bytes} [Fri Jun 10 17:58:28 2022] POST /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129/action => generated 100 bytes in 1019 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 10 17:58:29.391946 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6d40ac88-628b-440b-8227-9f5eb0492a9d tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:29.394774 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:29.394774 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:29.506009 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4b39ad7b-0da9-42c8-837b-92b7742c29e4 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:29.516791 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4b39ad7b-0da9-42c8-837b-92b7742c29e4 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd" status: 200 len: 1322 microversion: 2.1 time: 0.312306 Jun 10 17:58:29.520233 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 144/269] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:29 2022] GET /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd => generated 1322 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:29.532908 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d2e0a2a9-977a-4742-b0f2-0ea585bed05f tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:29.533528 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d2e0a2a9-977a-4742-b0f2-0ea585bed05f tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: ec39479e-5a78-42b6-b385-ceed608f0129] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:29.541474 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d2e0a2a9-977a-4742-b0f2-0ea585bed05f tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:29.541985 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d2e0a2a9-977a-4742-b0f2-0ea585bed05f tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:29.542764 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d2e0a2a9-977a-4742-b0f2-0ea585bed05f tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:29.543202 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d2e0a2a9-977a-4742-b0f2-0ea585bed05f tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:29.557585 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6d40ac88-628b-440b-8227-9f5eb0492a9d tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "DELETE /compute/v2.1/flavors/1645374522" status: 202 len: 0 microversion: 2.1 time: 0.176852 Jun 10 17:58:29.558343 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 126/270] 10.222.0.35 () {58 vars in 1160 bytes} [Fri Jun 10 17:58:29 2022] DELETE /compute/v2.1/flavors/1645374522 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 17:58:29.566989 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-84a725d0-53d2-4324-9498-3ce3dac3f714 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:29.601727 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-84a725d0-53d2-4324-9498-3ce3dac3f714 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.037471 Jun 10 17:58:29.624018 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 127/271] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 17:58:29 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:58:29.630240 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5af43879-6248-40ff-b29c-5cedaf1738f6 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1600699686", "id": 229668656, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:29.635756 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:29.635756 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:29.739022 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5af43879-6248-40ff-b29c-5cedaf1738f6 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.113527 Jun 10 17:58:29.739783 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 128/272] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:58:29 2022] POST /compute/v2.1/flavors => generated 414 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:29.750766 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3d95f09b-c231-461b-8986-c4e9c6dbb665 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:29.751545 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3d95f09b-c231-461b-8986-c4e9c6dbb665 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 1fcc6103-9ecc-42f4-9df8-ac2251f06eed] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:29.758435 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3d95f09b-c231-461b-8986-c4e9c6dbb665 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:29.759219 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3d95f09b-c231-461b-8986-c4e9c6dbb665 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:29.760517 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3d95f09b-c231-461b-8986-c4e9c6dbb665 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:29.761195 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3d95f09b-c231-461b-8986-c4e9c6dbb665 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:29.773038 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d2e0a2a9-977a-4742-b0f2-0ea585bed05f tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19776e5adf942c6a20e4dea1aa10cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1fd6bd677ff4b17bafee8fad1d720a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:29.782251 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:58:29.788353 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d2e0a2a9-977a-4742-b0f2-0ea585bed05f tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "GET /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129" status: 200 len: 1469 microversion: 2.1 time: 0.263492 Jun 10 17:58:29.788353 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 145/273] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:29 2022] GET /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129 => generated 1469 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:29.869833 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3d95f09b-c231-461b-8986-c4e9c6dbb665 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:29.879859 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3d95f09b-c231-461b-8986-c4e9c6dbb665 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed" status: 200 len: 1278 microversion: 2.1 time: 0.133517 Jun 10 17:58:29.881667 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 129/274] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:29 2022] GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed => generated 1278 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:29.902850 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bed006cd-f41c-4db4-84a0-973e33f8b9b6 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:29.964173 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bed006cd-f41c-4db4-84a0-973e33f8b9b6 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 6218 microversion: 2.1 time: 0.079493 Jun 10 17:58:29.967162 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 130/275] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 17:58:29 2022] GET /compute/v2.1/flavors/detail => generated 6218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:29.981494 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ea45bf63-d716-4e05-a950-edb0228bb505 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:29.982850 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:29.982850 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:30.098976 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-db63d5d0-4de6-42cd-ae17-07f5f3783a91 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:30.100772 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:30.100772 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:30.102096 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-db63d5d0-4de6-42cd-ae17-07f5f3783a91 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:30.102544 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-db63d5d0-4de6-42cd-ae17-07f5f3783a91 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:30.103426 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-db63d5d0-4de6-42cd-ae17-07f5f3783a91 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:30.103862 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-db63d5d0-4de6-42cd-ae17-07f5f3783a91 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:30.131424 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-db63d5d0-4de6-42cd-ae17-07f5f3783a91 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] 10.222.0.35 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.344781 Jun 10 17:58:30.132092 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 146/276] 10.222.0.35 () {58 vars in 1175 bytes} [Fri Jun 10 17:58:29 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:30.140710 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3a1dc084-cb07-43cc-b683-c132c62c74a2 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-905945451", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:30.171751 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ea45bf63-d716-4e05-a950-edb0228bb505 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "DELETE /compute/v2.1/flavors/229668656" status: 202 len: 0 microversion: 2.1 time: 0.194878 Jun 10 17:58:30.175493 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 131/277] 10.222.0.35 () {58 vars in 1157 bytes} [Fri Jun 10 17:58:29 2022] DELETE /compute/v2.1/flavors/229668656 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 17:58:30.179534 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f9b6e19a-f5f1-42ff-ab27-9cb58b4222a0 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-167353669"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:30.180855 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:30.180855 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:30.181958 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.aggregate [None req-f9b6e19a-f5f1-42ff-ab27-9cb58b4222a0 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Generated uuid c2c914be-92b8-402a-b3ec-06a2ce081e64 for aggregate {{(pid=126594) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 10 17:58:30.198159 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-3a1dc084-cb07-43cc-b683-c132c62c74a2 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] validate_networks() for None {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 17:58:30.302329 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f9b6e19a-f5f1-42ff-ab27-9cb58b4222a0 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.128419 Jun 10 17:58:30.303692 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 132/278] 10.222.0.35 () {60 vars in 1163 bytes} [Fri Jun 10 17:58:30 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:30.309177 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cb889769-acfc-45e3-a45f-d53721e9e587 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:30.352677 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cb889769-acfc-45e3-a45f-d53721e9e587 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.047289 Jun 10 17:58:30.370894 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 133/279] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 17:58:30 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:30.381802 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b8bd7145-508a-4625-ad1e-63c84d3254e7 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "chh1-master-2"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:30.385706 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:30.385706 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:30.402085 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b8bd7145-508a-4625-ad1e-63c84d3254e7 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:30.406050 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b8bd7145-508a-4625-ad1e-63c84d3254e7 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:30.610585 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-3a1dc084-cb07-43cc-b683-c132c62c74a2 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 17:58:30.616333 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-3a1dc084-cb07-43cc-b683-c132c62c74a2 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 17:58:30.617294 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-3a1dc084-cb07-43cc-b683-c132c62c74a2 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 17:58:30.617867 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-3a1dc084-cb07-43cc-b683-c132c62c74a2 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 17:58:30.618439 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-3a1dc084-cb07-43cc-b683-c132c62c74a2 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 17:58:30.649627 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3a1dc084-cb07-43cc-b683-c132c62c74a2 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:30.650273 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3a1dc084-cb07-43cc-b683-c132c62c74a2 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:30.651987 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3a1dc084-cb07-43cc-b683-c132c62c74a2 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:30.655840 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3a1dc084-cb07-43cc-b683-c132c62c74a2 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:30.679537 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-3a1dc084-cb07-43cc-b683-c132c62c74a2 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Getting quotas for project e1fd6bd677ff4b17bafee8fad1d720a6. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 17:58:30.693228 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-3a1dc084-cb07-43cc-b683-c132c62c74a2 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Getting quotas for user c19776e5adf942c6a20e4dea1aa10cdd and project e1fd6bd677ff4b17bafee8fad1d720a6. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 17:58:30.710699 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3a1dc084-cb07-43cc-b683-c132c62c74a2 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 17:58:30.713931 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3a1dc084-cb07-43cc-b683-c132c62c74a2 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: 95e3fefa-48f8-42be-95a1-a58e3980db9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 17:58:30.829472 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b8bd7145-508a-4625-ad1e-63c84d3254e7 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 242 microversion: 2.1 time: 0.456940 Jun 10 17:58:30.833527 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 134/280] 10.222.0.35 () {60 vars in 1193 bytes} [Fri Jun 10 17:58:30 2022] POST /compute/v2.1/os-aggregates/11/action => generated 242 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:30.834675 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bbe690b4-605c-4a04-9ff3-a837c54ff8df tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-39277000", "id": 193463252, "os-flavor-access:is_public": "True"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:30.836225 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:30.836225 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:30.875777 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3a1dc084-cb07-43cc-b683-c132c62c74a2 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.739277 Jun 10 17:58:30.876807 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 147/281] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:58:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 17:58:30.882075 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e9bf3311-7d9b-4d35-bcbb-dc7bf60d4604 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:30.889565 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e9bf3311-7d9b-4d35-bcbb-dc7bf60d4604 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: 2814abaf-90ac-4439-b500-df1bd532b1bd] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:30.890225 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e9bf3311-7d9b-4d35-bcbb-dc7bf60d4604 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:30.891827 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e9bf3311-7d9b-4d35-bcbb-dc7bf60d4604 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:30.893243 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e9bf3311-7d9b-4d35-bcbb-dc7bf60d4604 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:30.894043 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e9bf3311-7d9b-4d35-bcbb-dc7bf60d4604 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:30.952617 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bbe690b4-605c-4a04-9ff3-a837c54ff8df tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.120163 Jun 10 17:58:30.956157 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 135/282] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:58:30 2022] POST /compute/v2.1/flavors => generated 424 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:30.975293 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-09d72a65-4fd2-4924-83cf-30539d1d712f tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "chh1-master-2"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:30.976929 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:30.976929 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:31.002116 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-09d72a65-4fd2-4924-83cf-30539d1d712f tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:31.002574 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-09d72a65-4fd2-4924-83cf-30539d1d712f tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:31.133509 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-09d72a65-4fd2-4924-83cf-30539d1d712f tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] HTTP exception thrown: Aggregate 11 already has host chh1-master-2. Jun 10 17:58:31.192464 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-09d72a65-4fd2-4924-83cf-30539d1d712f tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Request method failure captured: Jun 10 17:58:31.192464 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Jun 10 17:58:31.192464 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 17:58:31.192464 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 17:58:31.192464 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 17:58:31.192464 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 39 Jun 10 17:58:31.192464 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 17:58:31.192464 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 17:58:31.192464 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 17:58:31.192464 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:31.192464 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4ZFz0KdVnU1lcsDgo7J7PulfDhlfFCGBade5DzcMDutpV6FqhJYlPbPs_6qX_VdmuZG1a4iBKDkZJe9m2UCDR4JW-ewpd3IgNZWlW18KPhJzNyqaz2Ql-B0FdRoYWMo5rsVLpu5R7Qszt44Be7Xdf2U5ZMw145OJsXH2oBakItvRq0 Jun 10 17:58:31.192464 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 17:58:31.192464 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 17:58:31.192464 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 17:58:31.192464 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 17:58:31.192464 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 17:58:31.192464 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 17:58:31.192464 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 7e0674a64c9c4427900f9ef11f4e4573 Jun 10 17:58:31.192464 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1915501983 Jun 10 17:58:31.192464 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member,admin Jun 10 17:58:31.192464 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member,admin Jun 10 17:58:31.193693 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/7e0674a64c9c4427900f9ef11f4e4573"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e0674a64c9c4427900f9ef11f4e4573"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e0674a64c9c4427900f9ef11f4e4573"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_7e0674a64c9c4427900f9ef11f4e4573", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:31.193693 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1915501983 Jun 10 17:58:31.193693 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 7e0674a64c9c4427900f9ef11f4e4573 Jun 10 17:58:31.193693 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1915501983 Jun 10 17:58:31.193693 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin Jun 10 17:58:31.193693 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 17:58:31.193693 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 17:58:31.193693 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 597438863f814f7faf9f9df5784e2341 Jun 10 17:58:31.193693 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin Jun 10 17:58:31.193693 chdv-master-2 devstack@n-api.service[126594]: Jun 10 17:58:31.193693 chdv-master-2 devstack@n-api.service[126594]: {"add_host": {"host": "chh1-master-2"}} Jun 10 17:58:31.193693 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 17:58:31.193693 chdv-master-2 devstack@n-api.service[126594]: exception: Aggregate 11 already has host chh1-master-2. Jun 10 17:58:31.194437 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '11', 'body': {'add_host': {'host': 'chh1-master-2'}}} Jun 10 17:58:31.194437 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:31.194437 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:31.194437 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 10 17:58:31.194437 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 10 17:58:31.194437 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 10 17:58:31.194437 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 10 17:58:31.194437 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 10 17:58:31.194437 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 10 17:58:31.194437 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 10 17:58:31.194437 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 10 17:58:31.194437 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 10 17:58:31.194437 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 10 17:58:31.194437 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 10 17:58:31.194437 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result.read() Jun 10 17:58:31.194437 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 10 17:58:31.194437 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 10 17:58:31.194437 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 10 17:58:31.194437 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 10 17:58:31.195517 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 10 17:58:31.195517 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 10 17:58:31.195517 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 10 17:58:31.195517 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 10 17:58:31.195517 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'chh1-master-2-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jun 10 17:58:31.195517 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:31.195517 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jun 10 17:58:31.195517 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:31.195517 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:31.195517 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Jun 10 17:58:31.195517 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Jun 10 17:58:31.195517 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jun 10 17:58:31.195517 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi session.flush() Jun 10 17:58:31.195517 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 10 17:58:31.195517 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._flush(objects) Jun 10 17:58:31.195517 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 10 17:58:31.195517 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jun 10 17:58:31.195517 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 10 17:58:31.195517 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi compat.raise_( Jun 10 17:58:31.197695 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 10 17:58:31.197695 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception Jun 10 17:58:31.197695 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 10 17:58:31.197695 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi flush_context.execute() Jun 10 17:58:31.197695 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 10 17:58:31.197695 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi rec.execute(self) Jun 10 17:58:31.197695 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 10 17:58:31.197695 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jun 10 17:58:31.197695 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 10 17:58:31.197695 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jun 10 17:58:31.197695 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 10 17:58:31.197695 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jun 10 17:58:31.197695 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 10 17:58:31.197695 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jun 10 17:58:31.197695 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 10 17:58:31.197695 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jun 10 17:58:31.197695 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 10 17:58:31.197695 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jun 10 17:58:31.200121 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 10 17:58:31.200121 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jun 10 17:58:31.200121 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 10 17:58:31.200121 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 10 17:58:31.200121 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 10 17:58:31.200121 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception Jun 10 17:58:31.200121 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 10 17:58:31.200121 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 10 17:58:31.200121 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 10 17:58:31.200121 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 10 17:58:31.200121 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 10 17:58:31.200121 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 10 17:58:31.200121 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 10 17:58:31.200121 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 10 17:58:31.200121 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 10 17:58:31.200121 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 10 17:58:31.200121 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 10 17:58:31.200121 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result.read() Jun 10 17:58:31.205105 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 10 17:58:31.205105 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 10 17:58:31.205105 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 10 17:58:31.205105 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 10 17:58:31.205105 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 10 17:58:31.205105 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 10 17:58:31.205105 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 10 17:58:31.205105 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 10 17:58:31.205105 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'chh1-master-2-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jun 10 17:58:31.205105 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Jun 10 17:58:31.205105 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 6, 10, 17, 58, 31, 45238), 'updated_at': None, 'host': 'chh1-master-2', 'aggregate_id': 11}] Jun 10 17:58:31.205105 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 10 17:58:31.205105 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:31.205105 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:31.205105 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:31.205105 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:31.205105 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jun 10 17:58:31.208006 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jun 10 17:58:31.208006 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 10 17:58:31.208006 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 10 17:58:31.208006 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 17:58:31.208006 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 17:58:31.208006 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 17:58:31.208006 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 17:58:31.208006 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 10 17:58:31.208006 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 10 17:58:31.208006 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6513, in add_host_to_aggregate Jun 10 17:58:31.208006 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Jun 10 17:58:31.208006 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 10 17:58:31.208006 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 10 17:58:31.208006 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Jun 10 17:58:31.208006 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Jun 10 17:58:31.208006 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Jun 10 17:58:31.208006 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Jun 10 17:58:31.208006 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 11 already has host chh1-master-2. Jun 10 17:58:31.208006 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:31.208006 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:31.211397 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:31.211397 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:31.211397 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:31.211397 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:31.211397 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:31.211397 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:31.211397 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:31.211397 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:31.211397 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 17:58:31.211397 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 17:58:31.211397 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Jun 10 17:58:31.211397 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jun 10 17:58:31.211397 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 11 already has host chh1-master-2. Jun 10 17:58:31.211397 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:31.211397 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:31.211397 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:31.211397 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:31.211397 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:31.211397 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:31.211397 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:58:31.211397 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:58:31.215686 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 already has host chh1-master-2. Jun 10 17:58:31.215686 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:31.215686 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-09d72a65-4fd2-4924-83cf-30539d1d712f tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Returning 409 to user: Aggregate 11 already has host chh1-master-2. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:31.222402 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e9bf3311-7d9b-4d35-bcbb-dc7bf60d4604 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:31.222842 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-09d72a65-4fd2-4924-83cf-30539d1d712f tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 96 microversion: 2.1 time: 0.236636 Jun 10 17:58:31.222842 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 136/283] 10.222.0.35 () {60 vars in 1193 bytes} [Fri Jun 10 17:58:30 2022] POST /compute/v2.1/os-aggregates/11/action => generated 96 bytes in 252 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Jun 10 17:58:31.222997 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e9bf3311-7d9b-4d35-bcbb-dc7bf60d4604 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd" status: 200 len: 1322 microversion: 2.1 time: 0.334385 Jun 10 17:58:31.222997 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 148/284] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:30 2022] GET /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd => generated 1322 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:31.224780 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-df8147a2-545c-4eeb-a201-3800f9d8e9d5 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:31.230156 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-df8147a2-545c-4eeb-a201-3800f9d8e9d5 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: 95e3fefa-48f8-42be-95a1-a58e3980db9b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:31.231220 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-19a62e31-c094-41c7-9ffa-320ea14a4513 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:31.231839 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-19a62e31-c094-41c7-9ffa-320ea14a4513 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 1fcc6103-9ecc-42f4-9df8-ac2251f06eed] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:31.245320 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-19a62e31-c094-41c7-9ffa-320ea14a4513 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:31.248238 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-19a62e31-c094-41c7-9ffa-320ea14a4513 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:31.252278 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-19a62e31-c094-41c7-9ffa-320ea14a4513 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:31.252278 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-19a62e31-c094-41c7-9ffa-320ea14a4513 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:31.426401 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-df8147a2-545c-4eeb-a201-3800f9d8e9d5 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19776e5adf942c6a20e4dea1aa10cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1fd6bd677ff4b17bafee8fad1d720a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:31.436509 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-df8147a2-545c-4eeb-a201-3800f9d8e9d5 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b" status: 200 len: 1218 microversion: 2.1 time: 0.225118 Jun 10 17:58:31.439562 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 137/285] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:31 2022] GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b => generated 1218 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:31.458860 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a9065ff2-48ea-4048-ae0f-53da8e8eddd1 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:31.458860 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:31.458860 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:31.515782 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-19a62e31-c094-41c7-9ffa-320ea14a4513 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:31.524969 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-19a62e31-c094-41c7-9ffa-320ea14a4513 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed" status: 200 len: 1320 microversion: 2.1 time: 0.304173 Jun 10 17:58:31.526511 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 149/286] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:31 2022] GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed => generated 1320 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:31.531856 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a7161721-b81e-4b21-a0d4-666161e46573 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "chh1-master-2"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:31.533419 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:31.533419 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:31.546069 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a7161721-b81e-4b21-a0d4-666161e46573 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:31.548425 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a7161721-b81e-4b21-a0d4-666161e46573 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:31.550421 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a9065ff2-48ea-4048-ae0f-53da8e8eddd1 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "DELETE /compute/v2.1/flavors/193463252" status: 202 len: 0 microversion: 2.1 time: 0.108672 Jun 10 17:58:31.554472 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 138/287] 10.222.0.35 () {58 vars in 1157 bytes} [Fri Jun 10 17:58:31 2022] DELETE /compute/v2.1/flavors/193463252 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 17:58:31.564866 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-60d3f431-1f0d-4d8c-9b37-fb25b2a2f05c tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:31.610126 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-60d3f431-1f0d-4d8c-9b37-fb25b2a2f05c tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.051216 Jun 10 17:58:31.614932 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 139/288] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 17:58:31 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:58:31.648837 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-21f490c7-21d8-44b1-9140-c6da08ec036d tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1937341401", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:31.651871 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:31.651871 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:31.976914 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=4 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:58:32.309646 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-21f490c7-21d8-44b1-9140-c6da08ec036d tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.672453 Jun 10 17:58:32.316605 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 140/289] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:58:31 2022] POST /compute/v2.1/flavors => generated 507 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:32.325482 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-e80987a3-a4a9-4b23-bc3e-853e273b7be6 req-df9c65e7-46eb-4010-bec7-75ec0f6a3339 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2814abaf-90ac-4439-b500-df1bd532b1bd", "name": "network-vif-plugged", "status": "completed", "tag": "4aa7695e-b4b6-496c-9f4a-5dfdb701aebc"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:32.351024 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-e80987a3-a4a9-4b23-bc3e-853e273b7be6 req-df9c65e7-46eb-4010-bec7-75ec0f6a3339 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:32.351402 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-e80987a3-a4a9-4b23-bc3e-853e273b7be6 req-df9c65e7-46eb-4010-bec7-75ec0f6a3339 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:32.382060 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-e80987a3-a4a9-4b23-bc3e-853e273b7be6 req-df9c65e7-46eb-4010-bec7-75ec0f6a3339 service nova] Creating event network-vif-plugged:4aa7695e-b4b6-496c-9f4a-5dfdb701aebc for instance 2814abaf-90ac-4439-b500-df1bd532b1bd on chh1-master-2 Jun 10 17:58:32.403155 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-e80987a3-a4a9-4b23-bc3e-853e273b7be6 req-df9c65e7-46eb-4010-bec7-75ec0f6a3339 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086286 Jun 10 17:58:32.406364 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 141/290] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:32.415903 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-639548ee-7bc3-4dc7-b02b-d95fe48a2a7c tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:32.422611 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-639548ee-7bc3-4dc7-b02b-d95fe48a2a7c tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: 2814abaf-90ac-4439-b500-df1bd532b1bd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:32.435971 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a7161721-b81e-4b21-a0d4-666161e46573 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.906064 Jun 10 17:58:32.442804 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 150/291] 10.222.0.35 () {60 vars in 1193 bytes} [Fri Jun 10 17:58:31 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:32.446283 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-639548ee-7bc3-4dc7-b02b-d95fe48a2a7c tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:32.451806 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-639548ee-7bc3-4dc7-b02b-d95fe48a2a7c tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:32.460614 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cb5c4712-3260-4fc5-87b3-e38223ceb790 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:32.465418 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-639548ee-7bc3-4dc7-b02b-d95fe48a2a7c tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:32.465418 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-639548ee-7bc3-4dc7-b02b-d95fe48a2a7c tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:32.465622 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:32.465622 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:32.659019 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cb5c4712-3260-4fc5-87b3-e38223ceb790 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "DELETE /compute/v2.1/flavors/768025d4-9074-44ac-b7cb-41b99f519695" status: 202 len: 0 microversion: 2.1 time: 0.212801 Jun 10 17:58:32.660415 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 151/292] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 17:58:32 2022] DELETE /compute/v2.1/flavors/768025d4-9074-44ac-b7cb-41b99f519695 => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 17:58:32.665371 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2ebcf6f9-6b64-4baf-9056-06b75c2c8039 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:32.668109 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:32.668109 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:32.808516 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2ebcf6f9-6b64-4baf-9056-06b75c2c8039 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] 10.222.0.35 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.146567 Jun 10 17:58:32.815590 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 152/293] 10.222.0.35 () {58 vars in 1154 bytes} [Fri Jun 10 17:58:32 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 10 17:58:32.821753 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6e1a63f3-e9c8-40c1-84eb-32608039039d tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:32.828271 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6e1a63f3-e9c8-40c1-84eb-32608039039d tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: 95e3fefa-48f8-42be-95a1-a58e3980db9b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:32.841754 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6e1a63f3-e9c8-40c1-84eb-32608039039d tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:32.842486 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6e1a63f3-e9c8-40c1-84eb-32608039039d tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:32.843956 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6e1a63f3-e9c8-40c1-84eb-32608039039d tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:32.844964 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6e1a63f3-e9c8-40c1-84eb-32608039039d tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:32.919261 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6e1a63f3-e9c8-40c1-84eb-32608039039d tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19776e5adf942c6a20e4dea1aa10cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1fd6bd677ff4b17bafee8fad1d720a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:32.926993 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6e1a63f3-e9c8-40c1-84eb-32608039039d tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b" status: 200 len: 1222 microversion: 2.1 time: 0.110029 Jun 10 17:58:32.931095 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 153/294] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:32 2022] GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b => generated 1222 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:32.932421 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-10e6ce04-f701-4ba0-b411-a20003e569d4 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:32.933362 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-10e6ce04-f701-4ba0-b411-a20003e569d4 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 1fcc6103-9ecc-42f4-9df8-ac2251f06eed] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:32.941545 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10e6ce04-f701-4ba0-b411-a20003e569d4 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:32.941954 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10e6ce04-f701-4ba0-b411-a20003e569d4 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:32.942736 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10e6ce04-f701-4ba0-b411-a20003e569d4 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:32.943178 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10e6ce04-f701-4ba0-b411-a20003e569d4 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:32.950373 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-639548ee-7bc3-4dc7-b02b-d95fe48a2a7c tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:32.958755 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-639548ee-7bc3-4dc7-b02b-d95fe48a2a7c tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd" status: 200 len: 1322 microversion: 2.1 time: 0.550958 Jun 10 17:58:32.959855 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 142/295] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:32 2022] GET /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd => generated 1322 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:32.970206 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f28c6a72-6201-4e38-806d-a1e4bfab7d4f tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:33.006938 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f28c6a72-6201-4e38-806d-a1e4bfab7d4f tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.045784 Jun 10 17:58:33.021380 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 143/296] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 17:58:32 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:33.021380 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-35569892-8a4f-470d-9978-82af20f7a375 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-233308435"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:33.021380 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:33.021380 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:33.021380 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.aggregate [None req-35569892-8a4f-470d-9978-82af20f7a375 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Generated uuid 1151f419-f1c4-4d3b-b473-881e3b28ffa9 for aggregate {{(pid=126594) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 10 17:58:33.107364 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-10e6ce04-f701-4ba0-b411-a20003e569d4 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:33.116727 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-10e6ce04-f701-4ba0-b411-a20003e569d4 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed" status: 200 len: 1320 microversion: 2.1 time: 0.188030 Jun 10 17:58:33.121869 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 154/297] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:32 2022] GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed => generated 1320 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:33.122003 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-35569892-8a4f-470d-9978-82af20f7a375 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.109200 Jun 10 17:58:33.122530 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 144/298] 10.222.0.35 () {60 vars in 1163 bytes} [Fri Jun 10 17:58:33 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:33.128924 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-355a40ab-14d5-4e31-bec0-8d37e59fa4ad tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-921242751", "id": "a7b48bba-5c37-470c-b8df-e854f7ea8a57", "os-flavor-access:is_public": "True"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:33.129427 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:33.129427 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:33.228504 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-355a40ab-14d5-4e31-bec0-8d37e59fa4ad tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.103340 Jun 10 17:58:33.228504 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 145/299] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:58:33 2022] POST /compute/v2.1/flavors => generated 506 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:33.278168 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e2197163-0319-4c4a-8b9a-c480f398d4df tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-2059923334", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:33.360562 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-e2197163-0319-4c4a-8b9a-c480f398d4df tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] validate_networks() for None {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 17:58:33.392943 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3404d2cf-44f8-4f39-89ce-680bc9854158 tempest-AggregatesAdminNegativeTestJSON-374046379 tempest-AggregatesAdminNegativeTestJSON-374046379-project] Action: 'action', calling method: >, body: {"add_host": {"host": "chh1-master-2"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:33.394383 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:33.394383 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:33.395130 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3404d2cf-44f8-4f39-89ce-680bc9854158 tempest-AggregatesAdminNegativeTestJSON-374046379 tempest-AggregatesAdminNegativeTestJSON-374046379-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '5f15d7454e7343eb842eb9f393eb9a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73c029e758484288932a08a3606d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:33.397107 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3404d2cf-44f8-4f39-89ce-680bc9854158 tempest-AggregatesAdminNegativeTestJSON-374046379 tempest-AggregatesAdminNegativeTestJSON-374046379-project] Request method failure captured: Jun 10 17:58:33.397107 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Jun 10 17:58:33.397107 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 17:58:33.397107 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 17:58:33.397107 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 17:58:33.397107 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 39 Jun 10 17:58:33.397107 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 17:58:33.397107 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 17:58:33.397107 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 17:58:33.397107 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:33.397107 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4ZEqqeOuRzqK-tM05zf-Eq6izyVU8i9uhgSPfHbQjozlsiS2dTzB29hDlvUfT_0m41PxQdpaqaweFqTPdMp_uQ4YtxL9ezkP4uqschU7d8BV4xPtrGxmhIHxHhJNz9__sP5CjBqttcP2t4sqHulMjIVe5FbmdLLeGJTgLduStBUwgY Jun 10 17:58:33.397107 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 17:58:33.397107 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 17:58:33.397107 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 17:58:33.397107 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 17:58:33.397107 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 17:58:33.397107 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 17:58:33.397107 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 1a73c029e758484288932a08a3606d5f Jun 10 17:58:33.397107 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-374046379 Jun 10 17:58:33.397107 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 17:58:33.397107 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 17:58:33.398345 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1a73c029e758484288932a08a3606d5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1a73c029e758484288932a08a3606d5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1a73c029e758484288932a08a3606d5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1a73c029e758484288932a08a3606d5f", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:33.398345 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-374046379 Jun 10 17:58:33.398345 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 1a73c029e758484288932a08a3606d5f Jun 10 17:58:33.398345 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-374046379 Jun 10 17:58:33.398345 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-AggregatesAdminNegativeTestJSON-374046379-project Jun 10 17:58:33.398345 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 17:58:33.398345 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 17:58:33.398345 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 5f15d7454e7343eb842eb9f393eb9a0c Jun 10 17:58:33.398345 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-374046379-project Jun 10 17:58:33.398345 chdv-master-2 devstack@n-api.service[126594]: Jun 10 17:58:33.398345 chdv-master-2 devstack@n-api.service[126594]: {"add_host": {"host": "chh1-master-2"}} Jun 10 17:58:33.398345 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 17:58:33.398345 chdv-master-2 devstack@n-api.service[126594]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jun 10 17:58:33.399185 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '12', 'body': {'add_host': {'host': 'chh1-master-2'}}} Jun 10 17:58:33.399185 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:33.399185 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:33.399185 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:33.399185 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:33.399185 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:33.399185 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:33.399185 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:33.399185 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:33.399185 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 17:58:33.399185 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 17:58:33.399185 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Jun 10 17:58:33.399185 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Jun 10 17:58:33.399185 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 10 17:58:33.399185 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 10 17:58:33.399185 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 10 17:58:33.399185 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 10 17:58:33.399185 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 17:58:33.399185 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 17:58:33.400244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 17:58:33.400244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 17:58:33.400244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 10 17:58:33.400244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 10 17:58:33.400244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 10 17:58:33.400244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 10 17:58:33.400244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 10 17:58:33.400244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 10 17:58:33.400244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jun 10 17:58:33.400244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:33.400244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:33.400244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:33.400244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:33.400244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:33.400244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:33.400244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 10 17:58:33.400244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 10 17:58:33.400244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jun 10 17:58:33.400244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:33.401443 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3404d2cf-44f8-4f39-89ce-680bc9854158 tempest-AggregatesAdminNegativeTestJSON-374046379 tempest-AggregatesAdminNegativeTestJSON-374046379-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:33.401443 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3404d2cf-44f8-4f39-89ce-680bc9854158 tempest-AggregatesAdminNegativeTestJSON-374046379 tempest-AggregatesAdminNegativeTestJSON-374046379-project] 10.222.0.35 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.169956 Jun 10 17:58:33.403452 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 146/300] 10.222.0.35 () {60 vars in 1193 bytes} [Fri Jun 10 17:58:33 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 175 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:58:33.413107 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-eafd9c28-9839-438f-ac1e-45e61449d15d tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:33.415357 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:33.415357 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:33.418319 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=9,nova_api:INSERT=8 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:58:33.516699 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-eafd9c28-9839-438f-ac1e-45e61449d15d tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "DELETE /compute/v2.1/flavors/a7b48bba-5c37-470c-b8df-e854f7ea8a57" status: 202 len: 0 microversion: 2.1 time: 0.107476 Jun 10 17:58:33.517722 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 147/301] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 17:58:33 2022] DELETE /compute/v2.1/flavors/a7b48bba-5c37-470c-b8df-e854f7ea8a57 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 17:58:33.524551 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-29643789-942c-4953-b753-1bb52c50f14f req-ff0867de-6e0a-4a01-a251-cca8ee9925bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fcc6103-9ecc-42f4-9df8-ac2251f06eed", "tag": "4b121ede-995c-48cf-bc4f-79b98d59e314"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:33.542371 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-29643789-942c-4953-b753-1bb52c50f14f req-ff0867de-6e0a-4a01-a251-cca8ee9925bb service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:33.542832 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-29643789-942c-4953-b753-1bb52c50f14f req-ff0867de-6e0a-4a01-a251-cca8ee9925bb service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:33.565763 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-29643789-942c-4953-b753-1bb52c50f14f req-ff0867de-6e0a-4a01-a251-cca8ee9925bb service nova] Creating event network-changed:4b121ede-995c-48cf-bc4f-79b98d59e314 for instance 1fcc6103-9ecc-42f4-9df8-ac2251f06eed on chh2-master-2 Jun 10 17:58:33.571843 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-29643789-942c-4953-b753-1bb52c50f14f req-ff0867de-6e0a-4a01-a251-cca8ee9925bb service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052701 Jun 10 17:58:33.576470 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 148/302] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:33.579846 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8ad6d5cb-859e-4419-a2ba-4b08f7ee13b7 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:33.580954 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:33.580954 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:33.630926 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-e2197163-0319-4c4a-8b9a-c480f398d4df tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 17:58:33.631455 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-e2197163-0319-4c4a-8b9a-c480f398d4df tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 17:58:33.631799 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-e2197163-0319-4c4a-8b9a-c480f398d4df tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 17:58:33.632204 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-e2197163-0319-4c4a-8b9a-c480f398d4df tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 17:58:33.632675 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-e2197163-0319-4c4a-8b9a-c480f398d4df tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 17:58:33.643969 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e2197163-0319-4c4a-8b9a-c480f398d4df tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:33.645175 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e2197163-0319-4c4a-8b9a-c480f398d4df tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:33.647551 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e2197163-0319-4c4a-8b9a-c480f398d4df tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:33.648260 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e2197163-0319-4c4a-8b9a-c480f398d4df tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:33.672280 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-e2197163-0319-4c4a-8b9a-c480f398d4df tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Getting quotas for project a5cef3679b5a47e48376197d17220e36. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 17:58:33.678434 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-e2197163-0319-4c4a-8b9a-c480f398d4df tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Getting quotas for user d6942ee76c6e4b16a9ea45d595084df2 and project a5cef3679b5a47e48376197d17220e36. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 17:58:33.679918 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8ad6d5cb-859e-4419-a2ba-4b08f7ee13b7 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] 10.222.0.35 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.105321 Jun 10 17:58:33.682123 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 149/303] 10.222.0.35 () {58 vars in 1154 bytes} [Fri Jun 10 17:58:33 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 10 17:58:33.694845 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4000e99a-6d98-45cd-9bdf-bb2e5e710b3a tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:33.695753 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e2197163-0319-4c4a-8b9a-c480f398d4df tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 17:58:33.698215 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e2197163-0319-4c4a-8b9a-c480f398d4df tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] [instance: 2b47ecdd-b178-49f2-a28f-bdedb4771918] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 17:58:33.720562 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4000e99a-6d98-45cd-9bdf-bb2e5e710b3a tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.035990 Jun 10 17:58:33.731829 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 150/304] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 17:58:33 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:33.731829 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-36dd606c-5aa5-4d8a-840c-e57228e0b690 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-751330560"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:33.733302 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:33.733302 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:33.735111 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.aggregate [None req-36dd606c-5aa5-4d8a-840c-e57228e0b690 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Generated uuid 3088c5b2-9951-4bb2-9e65-d3c6b43611a4 for aggregate {{(pid=126594) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 10 17:58:33.882672 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-36dd606c-5aa5-4d8a-840c-e57228e0b690 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.159794 Jun 10 17:58:33.885385 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 151/305] 10.222.0.35 () {60 vars in 1163 bytes} [Fri Jun 10 17:58:33 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:33.892267 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e2197163-0319-4c4a-8b9a-c480f398d4df tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.771590 Jun 10 17:58:33.892267 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 155/306] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:58:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 17:58:33.897397 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b09f2c65-4d07-4b74-aeac-189dc82491f8 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-13825582"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:33.898728 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:33.898728 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:33.899335 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6a088043-f384-49d5-b2aa-dd3ce8cf72f2 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1815618897", "id": 1726630250, "os-flavor-access:is_public": "True"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:33.901131 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:33.901131 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:33.923852 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b09f2c65-4d07-4b74-aeac-189dc82491f8 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:33.925335 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b09f2c65-4d07-4b74-aeac-189dc82491f8 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:33.936048 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b09f2c65-4d07-4b74-aeac-189dc82491f8 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:33.936671 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b09f2c65-4d07-4b74-aeac-189dc82491f8 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:33.950693 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-b09f2c65-4d07-4b74-aeac-189dc82491f8 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-13825582 could not be found. Jun 10 17:58:33.953126 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b09f2c65-4d07-4b74-aeac-189dc82491f8 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Request method failure captured: Jun 10 17:58:33.953126 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Jun 10 17:58:33.953126 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 17:58:33.953126 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 17:58:33.953126 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 17:58:33.953126 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 56 Jun 10 17:58:33.953126 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 17:58:33.953126 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 17:58:33.953126 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 17:58:33.953126 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:33.953126 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4ZFz0KdVnU1lcsDgo7J7PulfDhlfFCGBade5DzcMDutpV6FqhJYlPbPs_6qX_VdmuZG1a4iBKDkZJe9m2UCDR4JW-ewpd3IgNZWlW18KPhJzNyqaz2Ql-B0FdRoYWMo5rsVLpu5R7Qszt44Be7Xdf2U5ZMw145OJsXH2oBakItvRq0 Jun 10 17:58:33.953126 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 17:58:33.953126 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 17:58:33.953126 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 17:58:33.953126 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 17:58:33.953126 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 17:58:33.953126 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 17:58:33.953126 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 7e0674a64c9c4427900f9ef11f4e4573 Jun 10 17:58:33.953126 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1915501983 Jun 10 17:58:33.953126 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member,admin Jun 10 17:58:33.953126 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member,admin Jun 10 17:58:33.954447 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/7e0674a64c9c4427900f9ef11f4e4573"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e0674a64c9c4427900f9ef11f4e4573"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e0674a64c9c4427900f9ef11f4e4573"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_7e0674a64c9c4427900f9ef11f4e4573", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:33.954447 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1915501983 Jun 10 17:58:33.954447 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 7e0674a64c9c4427900f9ef11f4e4573 Jun 10 17:58:33.954447 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1915501983 Jun 10 17:58:33.954447 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin Jun 10 17:58:33.954447 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 17:58:33.954447 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 17:58:33.954447 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 597438863f814f7faf9f9df5784e2341 Jun 10 17:58:33.954447 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin Jun 10 17:58:33.954447 chdv-master-2 devstack@n-api.service[126595]: Jun 10 17:58:33.954447 chdv-master-2 devstack@n-api.service[126595]: {"add_host": {"host": "tempest-nonexist_host-13825582"}} Jun 10 17:58:33.954447 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 17:58:33.954447 chdv-master-2 devstack@n-api.service[126595]: exception: Compute host tempest-nonexist_host-13825582 could not be found. Jun 10 17:58:33.955337 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-13825582'}}} Jun 10 17:58:33.955337 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:33.955337 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:33.955337 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jun 10 17:58:33.955337 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jun 10 17:58:33.955337 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 17:58:33.955337 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 17:58:33.955337 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 10 17:58:33.955337 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 10 17:58:33.955337 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 10 17:58:33.955337 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 10 17:58:33.955337 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 10 17:58:33.955337 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 10 17:58:33.955337 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-13825582' is not mapped to any cell Jun 10 17:58:33.955337 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:33.955337 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:33.955337 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:33.955337 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:33.955337 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jun 10 17:58:33.956502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jun 10 17:58:33.956502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jun 10 17:58:33.956502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jun 10 17:58:33.956502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jun 10 17:58:33.956502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:33.956502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:33.956502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:33.956502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:33.956502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jun 10 17:58:33.956502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jun 10 17:58:33.956502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 10 17:58:33.956502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 10 17:58:33.956502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 17:58:33.956502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 17:58:33.956502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 17:58:33.956502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 17:58:33.956502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 10 17:58:33.956502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 10 17:58:33.956502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6493, in add_host_to_aggregate Jun 10 17:58:33.956502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Jun 10 17:58:33.958543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jun 10 17:58:33.958543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jun 10 17:58:33.958543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-13825582 could not be found. Jun 10 17:58:33.958543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:33.958543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:33.958543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:33.958543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:33.958543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:33.958543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:33.958543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:33.958543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:33.958543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:33.958543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:33.958543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 17:58:33.958543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 17:58:33.958543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Jun 10 17:58:33.958543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 17:58:33.958543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-13825582 could not be found. Jun 10 17:58:33.958543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:33.958543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:33.958543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:33.960952 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:33.960952 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:33.960952 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:33.960952 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:58:33.960952 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:58:33.960952 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-13825582 could not be found. Jun 10 17:58:33.960952 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:33.960952 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b09f2c65-4d07-4b74-aeac-189dc82491f8 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-13825582 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:33.960952 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b09f2c65-4d07-4b74-aeac-189dc82491f8 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 109 microversion: 2.1 time: 0.061131 Jun 10 17:58:33.965284 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 156/307] 10.222.0.35 () {60 vars in 1193 bytes} [Fri Jun 10 17:58:33 2022] POST /compute/v2.1/os-aggregates/13/action => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 17:58:33.970426 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2c352ab0-a06d-42ba-8804-5e71d53fe9e7 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:33.970426 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2c352ab0-a06d-42ba-8804-5e71d53fe9e7 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] [instance: 2b47ecdd-b178-49f2-a28f-bdedb4771918] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:34.006132 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6a088043-f384-49d5-b2aa-dd3ce8cf72f2 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.119541 Jun 10 17:58:34.009989 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 152/308] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:58:33 2022] POST /compute/v2.1/flavors => generated 414 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:34.019114 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1be2d2d4-4545-43f3-a01e-9ed681ad2910 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:34.027604 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1be2d2d4-4545-43f3-a01e-9ed681ad2910 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: 95e3fefa-48f8-42be-95a1-a58e3980db9b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:34.030297 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2c352ab0-a06d-42ba-8804-5e71d53fe9e7 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6942ee76c6e4b16a9ea45d595084df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cef3679b5a47e48376197d17220e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:34.038706 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2c352ab0-a06d-42ba-8804-5e71d53fe9e7 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] 10.222.0.35 "GET /compute/v2.1/servers/2b47ecdd-b178-49f2-a28f-bdedb4771918" status: 200 len: 1223 microversion: 2.1 time: 0.076133 Jun 10 17:58:34.041852 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 157/309] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:33 2022] GET /compute/v2.1/servers/2b47ecdd-b178-49f2-a28f-bdedb4771918 => generated 1223 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:34.046878 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1be2d2d4-4545-43f3-a01e-9ed681ad2910 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:34.047349 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1be2d2d4-4545-43f3-a01e-9ed681ad2910 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:34.048431 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1be2d2d4-4545-43f3-a01e-9ed681ad2910 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:34.049116 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1be2d2d4-4545-43f3-a01e-9ed681ad2910 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:34.049441 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-57c272eb-1f7a-4a71-a0a3-2da00c4cc401 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:34.050425 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:34.050425 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:34.164918 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-57c272eb-1f7a-4a71-a0a3-2da00c4cc401 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] 10.222.0.35 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.121167 Jun 10 17:58:34.165153 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1be2d2d4-4545-43f3-a01e-9ed681ad2910 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19776e5adf942c6a20e4dea1aa10cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1fd6bd677ff4b17bafee8fad1d720a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:34.172095 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 158/310] 10.222.0.35 () {58 vars in 1154 bytes} [Fri Jun 10 17:58:34 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 10 17:58:34.182185 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-259f4da3-241e-464b-8512-44a1123ec002 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:34.182185 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-259f4da3-241e-464b-8512-44a1123ec002 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: 2814abaf-90ac-4439-b500-df1bd532b1bd] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:34.190595 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1be2d2d4-4545-43f3-a01e-9ed681ad2910 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b" status: 200 len: 1270 microversion: 2.1 time: 0.179187 Jun 10 17:58:34.191174 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 153/311] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:34 2022] GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b => generated 1270 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:34.204393 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-259f4da3-241e-464b-8512-44a1123ec002 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:34.205176 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-259f4da3-241e-464b-8512-44a1123ec002 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:34.205324 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-23e6b57a-2eb2-4744-871f-e61a47a9fff6 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:34.206638 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-259f4da3-241e-464b-8512-44a1123ec002 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:34.207234 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-259f4da3-241e-464b-8512-44a1123ec002 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:34.226534 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-23e6b57a-2eb2-4744-871f-e61a47a9fff6 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/1726630250" status: 200 len: 414 microversion: 2.1 time: 0.030122 Jun 10 17:58:34.241925 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 154/312] 10.222.0.35 () {58 vars in 1157 bytes} [Fri Jun 10 17:58:34 2022] GET /compute/v2.1/flavors/1726630250 => generated 414 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:34.251003 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f3d6972f-8e02-4c00-9fc8-b9e4bdc7d9ee tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:34.251003 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f3d6972f-8e02-4c00-9fc8-b9e4bdc7d9ee tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 1fcc6103-9ecc-42f4-9df8-ac2251f06eed] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:34.272638 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f3d6972f-8e02-4c00-9fc8-b9e4bdc7d9ee tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:34.273099 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f3d6972f-8e02-4c00-9fc8-b9e4bdc7d9ee tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:34.273886 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f3d6972f-8e02-4c00-9fc8-b9e4bdc7d9ee tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:34.274335 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f3d6972f-8e02-4c00-9fc8-b9e4bdc7d9ee tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:34.539625 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-259f4da3-241e-464b-8512-44a1123ec002 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:34.547909 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f3d6972f-8e02-4c00-9fc8-b9e4bdc7d9ee tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:34.559833 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f3d6972f-8e02-4c00-9fc8-b9e4bdc7d9ee tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed" status: 200 len: 1320 microversion: 2.1 time: 0.316774 Jun 10 17:58:34.563702 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-259f4da3-241e-464b-8512-44a1123ec002 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd" status: 200 len: 1322 microversion: 2.1 time: 0.389898 Jun 10 17:58:34.574606 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 155/313] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:34 2022] GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed => generated 1320 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:34.580238 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 159/314] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:34 2022] GET /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd => generated 1322 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:34.587482 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-de7a2191-d6f4-4d5d-b8d5-e86b90731636 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:34.593204 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-de7a2191-d6f4-4d5d-b8d5-e86b90731636 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Request method failure captured: Jun 10 17:58:34.593204 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jun 10 17:58:34.593204 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 17:58:34.593204 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 17:58:34.593204 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 17:58:34.593204 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 283 Jun 10 17:58:34.593204 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 17:58:34.593204 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 17:58:34.593204 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 17:58:34.593204 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:34.593204 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4ZFz0KdVnU1lcsDgo7J7PulfDhlfFCGBade5DzcMDutpV6FqhJYlPbPs_6qX_VdmuZG1a4iBKDkZJe9m2UCDR4JW-ewpd3IgNZWlW18KPhJzNyqaz2Ql-B0FdRoYWMo5rsVLpu5R7Qszt44Be7Xdf2U5ZMw145OJsXH2oBakItvRq0 Jun 10 17:58:34.593204 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 17:58:34.593204 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 17:58:34.593204 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 17:58:34.593204 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 17:58:34.593204 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 17:58:34.593204 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 17:58:34.593204 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 7e0674a64c9c4427900f9ef11f4e4573 Jun 10 17:58:34.593204 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1915501983 Jun 10 17:58:34.593204 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member,admin Jun 10 17:58:34.593204 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member,admin Jun 10 17:58:34.594968 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/7e0674a64c9c4427900f9ef11f4e4573"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e0674a64c9c4427900f9ef11f4e4573"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e0674a64c9c4427900f9ef11f4e4573"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_7e0674a64c9c4427900f9ef11f4e4573", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:34.594968 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1915501983 Jun 10 17:58:34.594968 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 7e0674a64c9c4427900f9ef11f4e4573 Jun 10 17:58:34.594968 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1915501983 Jun 10 17:58:34.594968 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin Jun 10 17:58:34.594968 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 17:58:34.594968 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 17:58:34.594968 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 597438863f814f7faf9f9df5784e2341 Jun 10 17:58:34.594968 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin Jun 10 17:58:34.594968 chdv-master-2 devstack@n-api.service[126595]: Jun 10 17:58:34.594968 chdv-master-2 devstack@n-api.service[126595]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jun 10 17:58:34.595722 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 17:58:34.595722 chdv-master-2 devstack@n-api.service[126595]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 10 17:58:34.595722 chdv-master-2 devstack@n-api.service[126595]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jun 10 17:58:34.595722 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:34.595722 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:34.595722 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 10 17:58:34.595722 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 10 17:58:34.595722 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 10 17:58:34.595722 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise error Jun 10 17:58:34.595722 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 10 17:58:34.595722 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:34.596547 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Jun 10 17:58:34.596547 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 10 17:58:34.596547 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:34.596547 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jun 10 17:58:34.596547 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 10 17:58:34.596547 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:34.596547 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:34.596547 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:34.596547 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:34.596547 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:34.596547 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:34.596547 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:34.596547 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:34.596547 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:34.596547 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:34.596547 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 17:58:34.596547 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 17:58:34.596547 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 10 17:58:34.596547 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 10 17:58:34.597828 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 10 17:58:34.597828 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 10 17:58:34.597828 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 10 17:58:34.597828 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 10 17:58:34.597828 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 10 17:58:34.597828 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:34.597828 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:34.597828 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:34.597828 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:34.597828 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:34.597828 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:34.597828 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 10 17:58:34.597828 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 10 17:58:34.599654 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 10 17:58:34.599654 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:34.600934 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-de7a2191-d6f4-4d5d-b8d5-e86b90731636 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:34.603149 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-de7a2191-d6f4-4d5d-b8d5-e86b90731636 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.021911 Jun 10 17:58:34.603886 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 160/315] 10.222.0.35 () {60 vars in 1164 bytes} [Fri Jun 10 17:58:34 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 10 17:58:34.656990 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-22e5b38d-65ba-44e6-b5b5-28295c5886e1 tempest-FloatingIPsNegativeTestJSON-388393493 tempest-FloatingIPsNegativeTestJSON-388393493-project] Calling method '.version_select at 0x7f77c156f670>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:34.733737 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-22e5b38d-65ba-44e6-b5b5-28295c5886e1 tempest-FloatingIPsNegativeTestJSON-388393493 tempest-FloatingIPsNegativeTestJSON-388393493-project] 10.222.0.35 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.156893 Jun 10 17:58:34.749102 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 156/316] 10.222.0.35 () {58 vars in 1148 bytes} [Fri Jun 10 17:58:34 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 17:58:34.752730 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4791484f-1bb1-45b3-9346-52ff45de1986 tempest-FlavorsAdminTestJSON-1486277192 tempest-FlavorsAdminTestJSON-1486277192-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:34.757800 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4adbbad4-4261-43a4-9450-1f476eac8900 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:34.762069 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4adbbad4-4261-43a4-9450-1f476eac8900 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Request method failure captured: Jun 10 17:58:34.762069 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jun 10 17:58:34.762069 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 17:58:34.762069 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 17:58:34.762069 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 17:58:34.762069 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 27 Jun 10 17:58:34.762069 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 17:58:34.762069 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 17:58:34.762069 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 17:58:34.762069 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:34.762069 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4ZFz0KdVnU1lcsDgo7J7PulfDhlfFCGBade5DzcMDutpV6FqhJYlPbPs_6qX_VdmuZG1a4iBKDkZJe9m2UCDR4JW-ewpd3IgNZWlW18KPhJzNyqaz2Ql-B0FdRoYWMo5rsVLpu5R7Qszt44Be7Xdf2U5ZMw145OJsXH2oBakItvRq0 Jun 10 17:58:34.762069 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 17:58:34.762069 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 17:58:34.762069 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 17:58:34.762069 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 17:58:34.762069 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 17:58:34.762069 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 17:58:34.762069 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 7e0674a64c9c4427900f9ef11f4e4573 Jun 10 17:58:34.762069 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1915501983 Jun 10 17:58:34.762069 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member,admin Jun 10 17:58:34.762069 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member,admin Jun 10 17:58:34.763298 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/7e0674a64c9c4427900f9ef11f4e4573"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e0674a64c9c4427900f9ef11f4e4573"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e0674a64c9c4427900f9ef11f4e4573"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_7e0674a64c9c4427900f9ef11f4e4573", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:34.763298 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1915501983 Jun 10 17:58:34.763298 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 7e0674a64c9c4427900f9ef11f4e4573 Jun 10 17:58:34.763298 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1915501983 Jun 10 17:58:34.763298 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin Jun 10 17:58:34.763298 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 17:58:34.763298 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 17:58:34.763298 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 597438863f814f7faf9f9df5784e2341 Jun 10 17:58:34.763298 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin Jun 10 17:58:34.763298 chdv-master-2 devstack@n-api.service[126594]: Jun 10 17:58:34.763298 chdv-master-2 devstack@n-api.service[126594]: {"aggregate": {"name": ""}} Jun 10 17:58:34.763298 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 17:58:34.763298 chdv-master-2 devstack@n-api.service[126594]: exception: Invalid input for field/attribute name. Value: . '' is too short Jun 10 17:58:34.764016 chdv-master-2 devstack@n-api.service[126594]: action_args: {'body': {'aggregate': {'name': ''}}} Jun 10 17:58:34.764016 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:34.764016 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:34.764016 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 10 17:58:34.764016 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 10 17:58:34.764016 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 10 17:58:34.764016 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise error Jun 10 17:58:34.764016 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jun 10 17:58:34.764016 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:34.764016 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Jun 10 17:58:34.764016 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 10 17:58:34.764016 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:34.764016 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jun 10 17:58:34.764016 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi '' Jun 10 17:58:34.764016 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:34.764016 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:34.764016 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:34.764016 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:34.764016 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:34.764016 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:34.764016 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:34.764016 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:34.764016 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:34.765910 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:34.765910 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 17:58:34.765910 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 17:58:34.765910 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 10 17:58:34.765910 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 10 17:58:34.765910 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 10 17:58:34.765910 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 10 17:58:34.765910 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 10 17:58:34.765910 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 10 17:58:34.765910 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jun 10 17:58:34.765910 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:34.765910 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:34.765910 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:34.765910 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:34.765910 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:34.765910 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:34.765910 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 10 17:58:34.765910 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 10 17:58:34.765910 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jun 10 17:58:34.765910 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:34.769026 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4adbbad4-4261-43a4-9450-1f476eac8900 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:34.770706 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4adbbad4-4261-43a4-9450-1f476eac8900 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.021303 Jun 10 17:58:34.771773 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 157/317] 10.222.0.35 () {60 vars in 1163 bytes} [Fri Jun 10 17:58:34 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 10 17:58:34.777661 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5a1d198e-d45b-46a6-b403-56ecbcee5cf1 tempest-FloatingIPsNegativeTestJSON-388393493 tempest-FloatingIPsNegativeTestJSON-388393493-project] Action: 'create', calling method: .version_select at 0x7f77c158b670>, body: {"pool": "non_exist_pool"} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:34.807977 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4791484f-1bb1-45b3-9346-52ff45de1986 tempest-FlavorsAdminTestJSON-1486277192 tempest-FlavorsAdminTestJSON-1486277192-project] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 6218 microversion: 2.1 time: 0.202813 Jun 10 17:58:34.809015 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 161/318] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 17:58:34 2022] GET /compute/v2.1/flavors/detail => generated 6218 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:34.823901 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-5a1d198e-d45b-46a6-b403-56ecbcee5cf1 tempest-FloatingIPsNegativeTestJSON-388393493 tempest-FloatingIPsNegativeTestJSON-388393493-project] HTTP exception thrown: Floating IP pool not found. Jun 10 17:58:34.826911 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fcedd116-459e-4ebb-839f-0918fda48baa tempest-AggregatesAdminNegativeTestJSON-374046379 tempest-AggregatesAdminNegativeTestJSON-374046379-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-217548417"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:34.827132 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5a1d198e-d45b-46a6-b403-56ecbcee5cf1 tempest-FloatingIPsNegativeTestJSON-388393493 tempest-FloatingIPsNegativeTestJSON-388393493-project] Request method failure captured: Jun 10 17:58:34.827132 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Jun 10 17:58:34.827132 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 17:58:34.827132 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 17:58:34.827132 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 17:58:34.827132 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 26 Jun 10 17:58:34.827132 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 17:58:34.827132 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 17:58:34.827132 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 17:58:34.827132 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:34.827132 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4ZJhdyZq4UU-4XGDRB1tT15yis0NCZrLPKjHMOb9gz_ddBdR93QzsZGK_nq1R-5sep93O0sphEwpGWHxVNJ5dy2nft6p5_OptD2zk0ZPMwb9TRY_Jk7dZDvdvAmEL9bO_W2qulR8Dy9O7h39k6iaZySir6G3a0xFfrRSpTIsO7Kgik Jun 10 17:58:34.827132 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 17:58:34.827132 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 17:58:34.827132 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 17:58:34.827132 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 17:58:34.827132 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 17:58:34.827132 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 17:58:34.827132 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 3ad786ddc4184f1dbd9b258e3afe7dcd Jun 10 17:58:34.827132 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-388393493 Jun 10 17:58:34.827132 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 17:58:34.827132 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 17:58:34.829234 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/3ad786ddc4184f1dbd9b258e3afe7dcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3ad786ddc4184f1dbd9b258e3afe7dcd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3ad786ddc4184f1dbd9b258e3afe7dcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_3ad786ddc4184f1dbd9b258e3afe7dcd", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:34.829234 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-388393493 Jun 10 17:58:34.829234 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 3ad786ddc4184f1dbd9b258e3afe7dcd Jun 10 17:58:34.829234 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-388393493 Jun 10 17:58:34.829234 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-FloatingIPsNegativeTestJSON-388393493-project Jun 10 17:58:34.829234 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 17:58:34.829234 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 17:58:34.829234 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 9fb128f0698c48acb8afab3c52c0eba3 Jun 10 17:58:34.829234 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-388393493-project Jun 10 17:58:34.829234 chdv-master-2 devstack@n-api.service[126594]: Jun 10 17:58:34.829234 chdv-master-2 devstack@n-api.service[126594]: {"pool": "non_exist_pool"} Jun 10 17:58:34.829234 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 17:58:34.829234 chdv-master-2 devstack@n-api.service[126594]: exception: Floating IP pool not found. Jun 10 17:58:34.829234 chdv-master-2 devstack@n-api.service[126594]: action_args: {'body': {'pool': 'non_exist_pool'}} Jun 10 17:58:34.829234 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:34.830383 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:34.830383 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Jun 10 17:58:34.830383 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Jun 10 17:58:34.830383 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2958, in allocate_floating_ip Jun 10 17:58:34.830383 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Jun 10 17:58:34.830383 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2948, in _get_floating_ip_pool_id_by_name_or_id Jun 10 17:58:34.830383 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Jun 10 17:58:34.830383 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Jun 10 17:58:34.830383 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:34.830383 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:34.830383 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:34.830383 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:34.830383 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:34.830383 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:34.830383 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:34.830383 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:34.830383 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 17:58:34.830383 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 17:58:34.830383 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:34.830383 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:34.831612 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Jun 10 17:58:34.831612 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 10 17:58:34.831612 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Jun 10 17:58:34.831612 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:34.831612 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:34.831612 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:34.831612 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:34.831612 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:34.831612 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:34.831612 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:58:34.831612 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:58:34.831612 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Jun 10 17:58:34.831612 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:34.831612 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5a1d198e-d45b-46a6-b403-56ecbcee5cf1 tempest-FloatingIPsNegativeTestJSON-388393493 tempest-FloatingIPsNegativeTestJSON-388393493-project] Returning 404 to user: Floating IP pool not found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:34.831612 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5a1d198e-d45b-46a6-b403-56ecbcee5cf1 tempest-FloatingIPsNegativeTestJSON-388393493 tempest-FloatingIPsNegativeTestJSON-388393493-project] 10.222.0.35 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.056277 Jun 10 17:58:34.832544 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 158/319] 10.222.0.35 () {60 vars in 1169 bytes} [Fri Jun 10 17:58:34 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 10 17:58:34.835984 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:34.835984 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:34.837616 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-92658107-2d24-4612-9cbc-d23f85ee2e6d tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:34.837799 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fcedd116-459e-4ebb-839f-0918fda48baa tempest-AggregatesAdminNegativeTestJSON-374046379 tempest-AggregatesAdminNegativeTestJSON-374046379-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '5f15d7454e7343eb842eb9f393eb9a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73c029e758484288932a08a3606d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:34.838436 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:34.838436 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:34.840147 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fcedd116-459e-4ebb-839f-0918fda48baa tempest-AggregatesAdminNegativeTestJSON-374046379 tempest-AggregatesAdminNegativeTestJSON-374046379-project] Request method failure captured: Jun 10 17:58:34.840147 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jun 10 17:58:34.840147 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 17:58:34.840147 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 17:58:34.840147 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 17:58:34.840147 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 59 Jun 10 17:58:34.840147 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 17:58:34.840147 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 17:58:34.840147 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 17:58:34.840147 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:34.840147 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4ZEqqeOuRzqK-tM05zf-Eq6izyVU8i9uhgSPfHbQjozlsiS2dTzB29hDlvUfT_0m41PxQdpaqaweFqTPdMp_uQ4YtxL9ezkP4uqschU7d8BV4xPtrGxmhIHxHhJNz9__sP5CjBqttcP2t4sqHulMjIVe5FbmdLLeGJTgLduStBUwgY Jun 10 17:58:34.840147 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 17:58:34.840147 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 17:58:34.840147 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 17:58:34.840147 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 17:58:34.840147 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 17:58:34.840147 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 17:58:34.840147 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 1a73c029e758484288932a08a3606d5f Jun 10 17:58:34.840147 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-374046379 Jun 10 17:58:34.840147 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 17:58:34.840147 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 17:58:34.841638 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1a73c029e758484288932a08a3606d5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1a73c029e758484288932a08a3606d5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1a73c029e758484288932a08a3606d5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1a73c029e758484288932a08a3606d5f", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:34.841638 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-374046379 Jun 10 17:58:34.841638 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 1a73c029e758484288932a08a3606d5f Jun 10 17:58:34.841638 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-374046379 Jun 10 17:58:34.841638 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-AggregatesAdminNegativeTestJSON-374046379-project Jun 10 17:58:34.841638 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 17:58:34.841638 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 17:58:34.841638 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 5f15d7454e7343eb842eb9f393eb9a0c Jun 10 17:58:34.841638 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-374046379-project Jun 10 17:58:34.841638 chdv-master-2 devstack@n-api.service[126595]: Jun 10 17:58:34.841638 chdv-master-2 devstack@n-api.service[126595]: {"aggregate": {"name": "tempest-test_aggregate-217548417"}} Jun 10 17:58:34.841638 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 17:58:34.841638 chdv-master-2 devstack@n-api.service[126595]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jun 10 17:58:34.842629 chdv-master-2 devstack@n-api.service[126595]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-217548417'}}} Jun 10 17:58:34.842629 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:34.842629 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:34.842629 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:34.842629 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:34.842629 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:34.842629 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:34.842629 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:34.842629 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:34.842629 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 17:58:34.842629 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 17:58:34.842629 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 17:58:34.842629 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 17:58:34.842629 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Jun 10 17:58:34.842629 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Jun 10 17:58:34.842629 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 10 17:58:34.842629 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 10 17:58:34.842629 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 10 17:58:34.842629 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 10 17:58:34.844346 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 17:58:34.844346 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 17:58:34.844346 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 17:58:34.844346 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 17:58:34.844346 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 10 17:58:34.844346 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 10 17:58:34.844346 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 10 17:58:34.844346 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 10 17:58:34.844346 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 10 17:58:34.844346 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 10 17:58:34.844346 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jun 10 17:58:34.844346 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:34.844346 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:34.844346 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:34.844346 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:34.844346 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:34.844346 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:34.844346 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 10 17:58:34.844346 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 10 17:58:34.844346 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jun 10 17:58:34.847584 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:34.847584 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fcedd116-459e-4ebb-839f-0918fda48baa tempest-AggregatesAdminNegativeTestJSON-374046379 tempest-AggregatesAdminNegativeTestJSON-374046379-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:34.848383 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fcedd116-459e-4ebb-839f-0918fda48baa tempest-AggregatesAdminNegativeTestJSON-374046379 tempest-AggregatesAdminNegativeTestJSON-374046379-project] 10.222.0.35 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.029151 Jun 10 17:58:34.849463 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 162/320] 10.222.0.35 () {60 vars in 1163 bytes} [Fri Jun 10 17:58:34 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:58:34.857555 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-50080abc-04e5-44ea-9ac5-852b2f5d6306 tempest-FloatingIPsNegativeTestJSON-388393493 tempest-FloatingIPsNegativeTestJSON-388393493-project] Calling method '.version_select at 0x7f77c19e6f70>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:34.930112 chdv-master-2 devstack@n-api.service[126595]: DEBUG neutronclient.v2_0.client [None req-50080abc-04e5-44ea-9ac5-852b2f5d6306 tempest-FloatingIPsNegativeTestJSON-388393493 tempest-FloatingIPsNegativeTestJSON-388393493-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP fd7884a6-09d9-45e3-bc0a-5940229983f1 could not be found", "detail": ""}} {{(pid=126595) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 10 17:58:34.933132 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-50080abc-04e5-44ea-9ac5-852b2f5d6306 tempest-FloatingIPsNegativeTestJSON-388393493 tempest-FloatingIPsNegativeTestJSON-388393493-project] HTTP exception thrown: Floating IP not found for ID fd7884a6-09d9-45e3-bc0a-5940229983f1 Jun 10 17:58:34.951470 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-50080abc-04e5-44ea-9ac5-852b2f5d6306 tempest-FloatingIPsNegativeTestJSON-388393493 tempest-FloatingIPsNegativeTestJSON-388393493-project] Request method failure captured: Jun 10 17:58:34.951470 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/os-floating-ips/fd7884a6-09d9-45e3-bc0a-5940229983f1 HTTP/1.1 Jun 10 17:58:34.951470 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 17:58:34.951470 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 17:58:34.951470 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 17:58:34.951470 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 17:58:34.951470 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 17:58:34.951470 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 17:58:34.951470 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 17:58:34.951470 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:34.951470 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4ZJhdyZq4UU-4XGDRB1tT15yis0NCZrLPKjHMOb9gz_ddBdR93QzsZGK_nq1R-5sep93O0sphEwpGWHxVNJ5dy2nft6p5_OptD2zk0ZPMwb9TRY_Jk7dZDvdvAmEL9bO_W2qulR8Dy9O7h39k6iaZySir6G3a0xFfrRSpTIsO7Kgik Jun 10 17:58:34.951470 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 17:58:34.951470 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 17:58:34.951470 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 17:58:34.951470 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 17:58:34.951470 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 17:58:34.951470 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 17:58:34.951470 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 3ad786ddc4184f1dbd9b258e3afe7dcd Jun 10 17:58:34.951470 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-388393493 Jun 10 17:58:34.951470 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 17:58:34.951470 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 17:58:34.956009 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/3ad786ddc4184f1dbd9b258e3afe7dcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3ad786ddc4184f1dbd9b258e3afe7dcd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3ad786ddc4184f1dbd9b258e3afe7dcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_3ad786ddc4184f1dbd9b258e3afe7dcd", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:34.956009 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-388393493 Jun 10 17:58:34.956009 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 3ad786ddc4184f1dbd9b258e3afe7dcd Jun 10 17:58:34.956009 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-388393493 Jun 10 17:58:34.956009 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-FloatingIPsNegativeTestJSON-388393493-project Jun 10 17:58:34.956009 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 17:58:34.956009 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 17:58:34.956009 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 9fb128f0698c48acb8afab3c52c0eba3 Jun 10 17:58:34.956009 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-388393493-project Jun 10 17:58:34.956009 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 17:58:34.956009 chdv-master-2 devstack@n-api.service[126595]: exception: Floating IP not found for ID fd7884a6-09d9-45e3-bc0a-5940229983f1 Jun 10 17:58:34.956009 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'fd7884a6-09d9-45e3-bc0a-5940229983f1'} Jun 10 17:58:34.956009 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:34.957215 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:34.957215 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2810, in get_floating_ip Jun 10 17:58:34.957215 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jun 10 17:58:34.957215 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 17:58:34.957215 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 17:58:34.957215 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jun 10 17:58:34.957215 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jun 10 17:58:34.957215 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 17:58:34.957215 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 17:58:34.957215 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 10 17:58:34.957215 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 10 17:58:34.957215 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 17:58:34.957215 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 17:58:34.957215 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 10 17:58:34.957215 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 10 17:58:34.957215 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 17:58:34.957215 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 17:58:34.957215 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 10 17:58:34.957215 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 10 17:58:34.959232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 17:58:34.959232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 17:58:34.959232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 10 17:58:34.959232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 10 17:58:34.959232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 10 17:58:34.959232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 10 17:58:34.959232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP fd7884a6-09d9-45e3-bc0a-5940229983f1 could not be found Jun 10 17:58:34.959232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bdd0b2cf-8de3-4be7-a2cd-725c99140e45'] Jun 10 17:58:34.959232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:34.959232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:34.959232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:34.959232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:34.959232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jun 10 17:58:34.959232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jun 10 17:58:34.959232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2813, in get_floating_ip Jun 10 17:58:34.959232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jun 10 17:58:34.959232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID fd7884a6-09d9-45e3-bc0a-5940229983f1. Jun 10 17:58:34.959232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:34.959232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:34.959232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:34.960415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:34.960415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:34.960415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:34.960415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:34.960415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:34.960415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 17:58:34.960415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 17:58:34.960415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:34.960415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:34.960415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jun 10 17:58:34.960415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 10 17:58:34.960415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID fd7884a6-09d9-45e3-bc0a-5940229983f1 Jun 10 17:58:34.960415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:34.960415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:34.960415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:34.960415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:34.960415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:34.960415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:34.960415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:58:34.960415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:58:34.962322 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID fd7884a6-09d9-45e3-bc0a-5940229983f1 Jun 10 17:58:34.962322 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:34.962322 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-50080abc-04e5-44ea-9ac5-852b2f5d6306 tempest-FloatingIPsNegativeTestJSON-388393493 tempest-FloatingIPsNegativeTestJSON-388393493-project] Returning 404 to user: Floating IP not found for ID fd7884a6-09d9-45e3-bc0a-5940229983f1 {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:34.962680 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-92658107-2d24-4612-9cbc-d23f85ee2e6d tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "DELETE /compute/v2.1/flavors/1726630250" status: 202 len: 0 microversion: 2.1 time: 0.122960 Jun 10 17:58:34.962827 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-50080abc-04e5-44ea-9ac5-852b2f5d6306 tempest-FloatingIPsNegativeTestJSON-388393493 tempest-FloatingIPsNegativeTestJSON-388393493-project] 10.222.0.35 "DELETE /compute/v2.1/os-floating-ips/fd7884a6-09d9-45e3-bc0a-5940229983f1" status: 404 len: 111 microversion: 2.1 time: 0.103039 Jun 10 17:58:34.962957 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 159/321] 10.222.0.35 () {58 vars in 1160 bytes} [Fri Jun 10 17:58:34 2022] DELETE /compute/v2.1/flavors/1726630250 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 17:58:34.962957 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-26271e00-3ed1-4f6c-a5cc-726a61fa3521 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1643068851"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:34.964915 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:34.964915 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:34.964915 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.aggregate [None req-26271e00-3ed1-4f6c-a5cc-726a61fa3521 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Generated uuid 4d264cba-fd33-449d-9a79-67a662ccb5db for aggregate {{(pid=126594) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 10 17:58:34.967953 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 163/322] 10.222.0.35 () {58 vars in 1262 bytes} [Fri Jun 10 17:58:34 2022] DELETE /compute/v2.1/os-floating-ips/fd7884a6-09d9-45e3-bc0a-5940229983f1 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:58:34.976517 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0bf5bd1d-197d-4524-8046-900d23d81a9c tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:35.002259 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0bf5bd1d-197d-4524-8046-900d23d81a9c tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.031835 Jun 10 17:58:35.002920 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 164/323] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 17:58:34 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:35.022308 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0e847806-7b89-4b14-8b58-716efe8449af tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-736264864", "id": 1359955837, "os-flavor-access:is_public": "False"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:35.024897 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:35.024897 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:35.071531 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-26271e00-3ed1-4f6c-a5cc-726a61fa3521 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.112339 Jun 10 17:58:35.075800 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 160/324] 10.222.0.35 () {60 vars in 1163 bytes} [Fri Jun 10 17:58:34 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:35.083207 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-12eb73cd-fe5b-40b2-883c-cf1366cdf3d1 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:35.083835 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-12eb73cd-fe5b-40b2-883c-cf1366cdf3d1 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] [instance: 2b47ecdd-b178-49f2-a28f-bdedb4771918] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:35.102772 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0e847806-7b89-4b14-8b58-716efe8449af tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.084437 Jun 10 17:58:35.104483 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 165/325] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:58:35 2022] POST /compute/v2.1/flavors => generated 429 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:35.114975 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-840d30ce-b107-4d9a-92b6-43ffe6663c8e tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1643068851"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:35.118627 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.aggregate [None req-840d30ce-b107-4d9a-92b6-43ffe6663c8e tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Generated uuid f34705c1-c941-4809-9196-0b012b2a1238 for aggregate {{(pid=126595) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 10 17:58:35.133670 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-840d30ce-b107-4d9a-92b6-43ffe6663c8e tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1643068851 already exists. Jun 10 17:58:35.135915 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-840d30ce-b107-4d9a-92b6-43ffe6663c8e tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Request method failure captured: Jun 10 17:58:35.135915 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jun 10 17:58:35.135915 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 17:58:35.135915 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 17:58:35.135915 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 17:58:35.135915 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 60 Jun 10 17:58:35.135915 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 17:58:35.135915 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 17:58:35.135915 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 17:58:35.135915 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:35.135915 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4ZFz0KdVnU1lcsDgo7J7PulfDhlfFCGBade5DzcMDutpV6FqhJYlPbPs_6qX_VdmuZG1a4iBKDkZJe9m2UCDR4JW-ewpd3IgNZWlW18KPhJzNyqaz2Ql-B0FdRoYWMo5rsVLpu5R7Qszt44Be7Xdf2U5ZMw145OJsXH2oBakItvRq0 Jun 10 17:58:35.135915 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 17:58:35.135915 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 17:58:35.135915 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 17:58:35.135915 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 17:58:35.135915 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 17:58:35.135915 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 17:58:35.135915 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 7e0674a64c9c4427900f9ef11f4e4573 Jun 10 17:58:35.135915 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1915501983 Jun 10 17:58:35.135915 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member,admin Jun 10 17:58:35.135915 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member,admin Jun 10 17:58:35.137203 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/7e0674a64c9c4427900f9ef11f4e4573"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e0674a64c9c4427900f9ef11f4e4573"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e0674a64c9c4427900f9ef11f4e4573"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_7e0674a64c9c4427900f9ef11f4e4573", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:35.137203 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1915501983 Jun 10 17:58:35.137203 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 7e0674a64c9c4427900f9ef11f4e4573 Jun 10 17:58:35.137203 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1915501983 Jun 10 17:58:35.137203 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin Jun 10 17:58:35.137203 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 17:58:35.137203 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 17:58:35.137203 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 597438863f814f7faf9f9df5784e2341 Jun 10 17:58:35.137203 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin Jun 10 17:58:35.137203 chdv-master-2 devstack@n-api.service[126595]: Jun 10 17:58:35.137203 chdv-master-2 devstack@n-api.service[126595]: {"aggregate": {"name": "tempest-test_aggregate-1643068851"}} Jun 10 17:58:35.137203 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 17:58:35.137203 chdv-master-2 devstack@n-api.service[126595]: exception: Aggregate tempest-test_aggregate-1643068851 already exists. Jun 10 17:58:35.137905 chdv-master-2 devstack@n-api.service[126595]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1643068851'}}} Jun 10 17:58:35.137905 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:35.137905 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:35.137905 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Jun 10 17:58:35.137905 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Jun 10 17:58:35.137905 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 10 17:58:35.137905 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 10 17:58:35.137905 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 17:58:35.137905 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 17:58:35.137905 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 17:58:35.137905 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 17:58:35.137905 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 10 17:58:35.137905 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 10 17:58:35.137905 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6330, in create_aggregate Jun 10 17:58:35.137905 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi aggregate.create() Jun 10 17:58:35.137905 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 10 17:58:35.137905 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 10 17:58:35.137905 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Jun 10 17:58:35.137905 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Jun 10 17:58:35.138916 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 10 17:58:35.138916 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 10 17:58:35.138916 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Jun 10 17:58:35.138916 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Jun 10 17:58:35.138916 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1643068851 already exists. Jun 10 17:58:35.138916 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:35.138916 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:35.138916 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:35.138916 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:35.138916 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:35.138916 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:35.138916 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:35.138916 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:35.138916 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:35.138916 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:35.138916 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 17:58:35.138916 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 17:58:35.138916 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 17:58:35.138916 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 17:58:35.138916 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Jun 10 17:58:35.140031 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jun 10 17:58:35.140031 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1643068851 already exists. Jun 10 17:58:35.140031 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:35.140031 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:35.140031 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:35.140031 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:35.140031 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:35.140031 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:35.140031 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:58:35.140031 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:58:35.140031 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1643068851 already exists. Jun 10 17:58:35.140031 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:35.144748 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-840d30ce-b107-4d9a-92b6-43ffe6663c8e tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1643068851 already exists. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:35.151816 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-840d30ce-b107-4d9a-92b6-43ffe6663c8e tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.041458 Jun 10 17:58:35.151816 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 166/326] 10.222.0.35 () {60 vars in 1163 bytes} [Fri Jun 10 17:58:35 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 10 17:58:35.155291 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f8b1e93b-b78a-4019-979f-321bc2ac3479 tempest-FlavorsAdminTestJSON-1486277192 tempest-FlavorsAdminTestJSON-1486277192-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "1359955837"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:35.167108 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-f8b1e93b-b78a-4019-979f-321bc2ac3479 tempest-FlavorsAdminTestJSON-1486277192 tempest-FlavorsAdminTestJSON-1486277192-project] HTTP exception thrown: Flavor 1359955837 could not be found. Jun 10 17:58:35.170952 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f8b1e93b-b78a-4019-979f-321bc2ac3479 tempest-FlavorsAdminTestJSON-1486277192 tempest-FlavorsAdminTestJSON-1486277192-project] Request method failure captured: Jun 10 17:58:35.170952 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 10 17:58:35.170952 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 17:58:35.170952 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 17:58:35.170952 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 17:58:35.170952 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 107 Jun 10 17:58:35.170952 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 17:58:35.170952 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 17:58:35.170952 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 17:58:35.170952 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:35.170952 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4ZC7YcFP0yLAi9pwKDZEIm6AmsHpsuqs0S9sbEvZ51q-A9-CF8qwXf3ij9BLQb5t4mzFsy8o2N91HVB6HPJ-UinF8mkx2WF3XToJJ91ayb9zRYW8XhUQAhjgcTVzYyw-TZai5D_YDjFnYBctdqxhrGa2rJrdCTb-fK6TpViSj6AD7Q Jun 10 17:58:35.170952 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 17:58:35.170952 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 17:58:35.170952 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 17:58:35.170952 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 17:58:35.170952 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 17:58:35.170952 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 17:58:35.170952 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 4ccff0c4df6247d68c649a705f94aad2 Jun 10 17:58:35.170952 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-FlavorsAdminTestJSON-1486277192 Jun 10 17:58:35.170952 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 17:58:35.170952 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 17:58:35.172732 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/4ccff0c4df6247d68c649a705f94aad2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/4ccff0c4df6247d68c649a705f94aad2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/4ccff0c4df6247d68c649a705f94aad2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_4ccff0c4df6247d68c649a705f94aad2", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:35.172732 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-FlavorsAdminTestJSON-1486277192 Jun 10 17:58:35.172732 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 4ccff0c4df6247d68c649a705f94aad2 Jun 10 17:58:35.172732 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1486277192 Jun 10 17:58:35.172732 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-FlavorsAdminTestJSON-1486277192-project Jun 10 17:58:35.172732 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 17:58:35.172732 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 17:58:35.172732 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 9db5edfd173f4a10a6f93ea65d8a1050 Jun 10 17:58:35.172732 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-FlavorsAdminTestJSON-1486277192-project Jun 10 17:58:35.172732 chdv-master-2 devstack@n-api.service[126595]: Jun 10 17:58:35.172732 chdv-master-2 devstack@n-api.service[126595]: {"server": {"name": "test", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "1359955837"}} Jun 10 17:58:35.172732 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 17:58:35.172732 chdv-master-2 devstack@n-api.service[126595]: exception: Flavor 1359955837 could not be found. Jun 10 17:58:35.173622 chdv-master-2 devstack@n-api.service[126595]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8', 'flavorRef': '1359955837'}}} Jun 10 17:58:35.173622 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:35.173622 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:35.173622 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jun 10 17:58:35.173622 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jun 10 17:58:35.173622 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 10 17:58:35.173622 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 10 17:58:35.173622 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 17:58:35.173622 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 17:58:35.173622 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 10 17:58:35.173622 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 10 17:58:35.173622 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 10 17:58:35.173622 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:35.173622 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 10 17:58:35.173622 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 10 17:58:35.173622 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1359955837 could not be found. Jun 10 17:58:35.173622 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:35.173622 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:35.173622 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:35.173622 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:35.174830 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:35.174830 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:35.174830 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:35.174830 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:35.174830 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:35.174830 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:35.174830 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 17:58:35.174830 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 17:58:35.174830 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 17:58:35.174830 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 17:58:35.174830 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 17:58:35.174830 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 17:58:35.174830 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 10 17:58:35.174830 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jun 10 17:58:35.174830 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jun 10 17:58:35.174830 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1359955837 could not be found. Jun 10 17:58:35.174830 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:35.174830 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:35.174830 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:35.174830 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:35.174830 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:35.176083 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:35.176083 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:58:35.176083 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:58:35.176083 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1359955837 could not be found. Jun 10 17:58:35.176083 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:35.185574 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f8b1e93b-b78a-4019-979f-321bc2ac3479 tempest-FlavorsAdminTestJSON-1486277192 tempest-FlavorsAdminTestJSON-1486277192-project] Returning 400 to user: Flavor 1359955837 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:35.185574 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f8b1e93b-b78a-4019-979f-321bc2ac3479 tempest-FlavorsAdminTestJSON-1486277192 tempest-FlavorsAdminTestJSON-1486277192-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.034122 Jun 10 17:58:35.185574 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 167/327] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:58:35 2022] POST /compute/v2.1/servers => generated 81 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 10 17:58:35.194123 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5cf40c23-0579-4d5a-b178-4240d88acd03 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:35.196289 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:35.196289 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:35.202171 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=8,nova_api:DELETE=8 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:58:35.291022 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5cf40c23-0579-4d5a-b178-4240d88acd03 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] 10.222.0.35 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.103862 Jun 10 17:58:35.291766 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 168/328] 10.222.0.35 () {58 vars in 1154 bytes} [Fri Jun 10 17:58:35 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 10 17:58:35.297690 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-949111bd-5e19-4802-92c5-424dce77e915 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:35.298640 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:35.298640 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:35.368477 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-949111bd-5e19-4802-92c5-424dce77e915 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "DELETE /compute/v2.1/flavors/1359955837" status: 202 len: 0 microversion: 2.1 time: 0.074700 Jun 10 17:58:35.371804 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 169/329] 10.222.0.35 () {58 vars in 1160 bytes} [Fri Jun 10 17:58:35 2022] DELETE /compute/v2.1/flavors/1359955837 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 17:58:35.372365 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-12eb73cd-fe5b-40b2-883c-cf1366cdf3d1 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6942ee76c6e4b16a9ea45d595084df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cef3679b5a47e48376197d17220e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:35.389484 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-467de2c2-a2c4-4c22-b20e-b75e02a23a1b tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:35.389954 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-12eb73cd-fe5b-40b2-883c-cf1366cdf3d1 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] 10.222.0.35 "GET /compute/v2.1/servers/2b47ecdd-b178-49f2-a28f-bdedb4771918" status: 200 len: 1223 microversion: 2.1 time: 0.303595 Jun 10 17:58:35.389954 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 161/330] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:35 2022] GET /compute/v2.1/servers/2b47ecdd-b178-49f2-a28f-bdedb4771918 => generated 1223 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:35.390105 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-467de2c2-a2c4-4c22-b20e-b75e02a23a1b tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: 95e3fefa-48f8-42be-95a1-a58e3980db9b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:35.390178 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-39a3023e-57e9-4cca-b87f-7cdfc40716b9 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-557015284"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:35.390178 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:35.390178 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:35.390178 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.aggregate [None req-39a3023e-57e9-4cca-b87f-7cdfc40716b9 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Generated uuid aed69639-f06c-4e03-bdbf-dbdfee1abb63 for aggregate {{(pid=126594) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 10 17:58:35.403010 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-467de2c2-a2c4-4c22-b20e-b75e02a23a1b tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:35.403557 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-467de2c2-a2c4-4c22-b20e-b75e02a23a1b tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:35.405125 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-467de2c2-a2c4-4c22-b20e-b75e02a23a1b tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:35.406296 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-467de2c2-a2c4-4c22-b20e-b75e02a23a1b tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:35.519436 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-39a3023e-57e9-4cca-b87f-7cdfc40716b9 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.135711 Jun 10 17:58:35.525213 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 162/331] 10.222.0.35 () {60 vars in 1163 bytes} [Fri Jun 10 17:58:35 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:35.525366 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7763490b-c9ea-47a5-8d25-a7033fb9c119 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:35.571238 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7763490b-c9ea-47a5-8d25-a7033fb9c119 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.049202 Jun 10 17:58:35.577501 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 163/332] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 17:58:35 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:35.588041 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6ca273b7-41f2-4f9e-bab0-3f8330c2a98d tempest-AggregatesAdminNegativeTestJSON-374046379 tempest-AggregatesAdminNegativeTestJSON-374046379-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:35.588846 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:35.588846 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:35.589685 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6ca273b7-41f2-4f9e-bab0-3f8330c2a98d tempest-AggregatesAdminNegativeTestJSON-374046379 tempest-AggregatesAdminNegativeTestJSON-374046379-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '5f15d7454e7343eb842eb9f393eb9a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73c029e758484288932a08a3606d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:35.591460 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6ca273b7-41f2-4f9e-bab0-3f8330c2a98d tempest-AggregatesAdminNegativeTestJSON-374046379 tempest-AggregatesAdminNegativeTestJSON-374046379-project] Request method failure captured: Jun 10 17:58:35.591460 chdv-master-2 devstack@n-api.service[126594]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Jun 10 17:58:35.591460 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 17:58:35.591460 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 17:58:35.591460 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 17:58:35.591460 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 17:58:35.591460 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 17:58:35.591460 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 17:58:35.591460 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 17:58:35.591460 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:35.591460 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4ZEqqeOuRzqK-tM05zf-Eq6izyVU8i9uhgSPfHbQjozlsiS2dTzB29hDlvUfT_0m41PxQdpaqaweFqTPdMp_uQ4YtxL9ezkP4uqschU7d8BV4xPtrGxmhIHxHhJNz9__sP5CjBqttcP2t4sqHulMjIVe5FbmdLLeGJTgLduStBUwgY Jun 10 17:58:35.591460 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 17:58:35.591460 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 17:58:35.591460 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 17:58:35.591460 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 17:58:35.591460 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 17:58:35.591460 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 17:58:35.591460 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 1a73c029e758484288932a08a3606d5f Jun 10 17:58:35.591460 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-374046379 Jun 10 17:58:35.591460 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 17:58:35.591460 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 17:58:35.592698 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1a73c029e758484288932a08a3606d5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1a73c029e758484288932a08a3606d5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1a73c029e758484288932a08a3606d5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1a73c029e758484288932a08a3606d5f", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:35.592698 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-374046379 Jun 10 17:58:35.592698 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 1a73c029e758484288932a08a3606d5f Jun 10 17:58:35.592698 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-374046379 Jun 10 17:58:35.592698 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-AggregatesAdminNegativeTestJSON-374046379-project Jun 10 17:58:35.592698 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 17:58:35.592698 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 17:58:35.592698 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 5f15d7454e7343eb842eb9f393eb9a0c Jun 10 17:58:35.592698 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-374046379-project Jun 10 17:58:35.592698 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 17:58:35.592698 chdv-master-2 devstack@n-api.service[126594]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jun 10 17:58:35.592698 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '15'} Jun 10 17:58:35.594142 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:35.594142 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:35.594142 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:35.594142 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:35.594142 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:35.594142 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:35.594142 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:35.594142 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:35.594142 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Jun 10 17:58:35.594142 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Jun 10 17:58:35.594142 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 10 17:58:35.594142 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 10 17:58:35.594142 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 10 17:58:35.594142 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 10 17:58:35.594142 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 17:58:35.594142 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 17:58:35.594142 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 17:58:35.594142 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 17:58:35.594142 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 10 17:58:35.595202 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 10 17:58:35.595202 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 10 17:58:35.595202 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 10 17:58:35.595202 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 10 17:58:35.595202 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 10 17:58:35.595202 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jun 10 17:58:35.595202 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:35.595202 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:35.595202 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:35.595202 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:35.595202 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:35.595202 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:35.595202 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 10 17:58:35.595202 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 10 17:58:35.595202 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jun 10 17:58:35.595202 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:35.609802 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6ca273b7-41f2-4f9e-bab0-3f8330c2a98d tempest-AggregatesAdminNegativeTestJSON-374046379 tempest-AggregatesAdminNegativeTestJSON-374046379-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:35.610767 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6ca273b7-41f2-4f9e-bab0-3f8330c2a98d tempest-AggregatesAdminNegativeTestJSON-374046379 tempest-AggregatesAdminNegativeTestJSON-374046379-project] 10.222.0.35 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.032227 Jun 10 17:58:35.616492 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 164/333] 10.222.0.35 () {58 vars in 1154 bytes} [Fri Jun 10 17:58:35 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:58:35.616492 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5f9ef5f4-69b1-473d-a3ef-926cc38ebd4e tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:35.617490 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5f9ef5f4-69b1-473d-a3ef-926cc38ebd4e tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 1fcc6103-9ecc-42f4-9df8-ac2251f06eed] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:35.631994 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f9ef5f4-69b1-473d-a3ef-926cc38ebd4e tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:35.632492 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f9ef5f4-69b1-473d-a3ef-926cc38ebd4e tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:35.633280 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f9ef5f4-69b1-473d-a3ef-926cc38ebd4e tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:35.633723 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f9ef5f4-69b1-473d-a3ef-926cc38ebd4e tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:35.671766 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-467de2c2-a2c4-4c22-b20e-b75e02a23a1b tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19776e5adf942c6a20e4dea1aa10cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1fd6bd677ff4b17bafee8fad1d720a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:35.682382 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-467de2c2-a2c4-4c22-b20e-b75e02a23a1b tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b" status: 200 len: 1318 microversion: 2.1 time: 0.309802 Jun 10 17:58:35.683439 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 170/334] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:35 2022] GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b => generated 1318 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:35.688673 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e85a9772-d610-4f64-bc67-3bdcff584b71 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1249121483", "id": 690583439, "os-flavor-access:is_public": "False"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:35.690824 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:35.690824 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:35.786418 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e85a9772-d610-4f64-bc67-3bdcff584b71 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.101526 Jun 10 17:58:35.787500 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 171/335] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:58:35 2022] POST /compute/v2.1/flavors => generated 412 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:35.796896 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a27400c5-79d8-4e8a-920f-a0c1c29a9d7e tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:35.800296 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a27400c5-79d8-4e8a-920f-a0c1c29a9d7e tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: 2814abaf-90ac-4439-b500-df1bd532b1bd] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:35.811735 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a27400c5-79d8-4e8a-920f-a0c1c29a9d7e tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:35.812485 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a27400c5-79d8-4e8a-920f-a0c1c29a9d7e tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:35.813379 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a27400c5-79d8-4e8a-920f-a0c1c29a9d7e tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:35.814062 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a27400c5-79d8-4e8a-920f-a0c1c29a9d7e tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:36.010639 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a27400c5-79d8-4e8a-920f-a0c1c29a9d7e tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:36.026707 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a27400c5-79d8-4e8a-920f-a0c1c29a9d7e tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd" status: 200 len: 1472 microversion: 2.1 time: 0.238031 Jun 10 17:58:36.029401 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 172/336] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:35 2022] GET /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd => generated 1472 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:36.031821 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5f9ef5f4-69b1-473d-a3ef-926cc38ebd4e tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:36.042172 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5f9ef5f4-69b1-473d-a3ef-926cc38ebd4e tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed" status: 200 len: 1320 microversion: 2.1 time: 0.429810 Jun 10 17:58:36.043883 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 165/337] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:35 2022] GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed => generated 1320 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:36.044444 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-73f46893-6a97-4ecc-a735-71d2b1b5fe52 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:36.045222 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:36.045222 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:36.050991 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-671f1a4c-33ee-4925-bfad-80a129aa771d tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-300688695", "id": 1286057994, "os-flavor-access:is_public": "True"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:36.053855 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:36.053855 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:36.150187 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-671f1a4c-33ee-4925-bfad-80a129aa771d tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.104506 Jun 10 17:58:36.151151 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 166/338] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:58:36 2022] POST /compute/v2.1/flavors => generated 413 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:36.155851 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0bb558d4-a7e1-4cea-8991-ad67a111ed02 tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:36.156954 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0bb558d4-a7e1-4cea-8991-ad67a111ed02 tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] [instance: 2814abaf-90ac-4439-b500-df1bd532b1bd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:36.163429 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0bb558d4-a7e1-4cea-8991-ad67a111ed02 tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:36.164162 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0bb558d4-a7e1-4cea-8991-ad67a111ed02 tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:36.164990 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0bb558d4-a7e1-4cea-8991-ad67a111ed02 tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:36.165429 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0bb558d4-a7e1-4cea-8991-ad67a111ed02 tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:36.182360 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-73f46893-6a97-4ecc-a735-71d2b1b5fe52 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] 10.222.0.35 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.151623 Jun 10 17:58:36.183177 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 173/339] 10.222.0.35 () {58 vars in 1154 bytes} [Fri Jun 10 17:58:36 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 10 17:58:36.198558 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b888c60d-e15d-4f48-9ce5-6a0d4579d107 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:36.198648 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-0bb558d4-a7e1-4cea-8991-ad67a111ed02 tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] Lazy-loading 'flavor' on Instance uuid 2814abaf-90ac-4439-b500-df1bd532b1bd {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 17:58:36.209353 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b888c60d-e15d-4f48-9ce5-6a0d4579d107 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.025101 Jun 10 17:58:36.210543 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 174/340] 10.222.0.35 () {58 vars in 1168 bytes} [Fri Jun 10 17:58:36 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:36.220611 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e2debb17-453d-497a-8992-4ec4830281ce tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:36.221713 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:36.221713 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:36.232706 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-e2debb17-453d-497a-8992-4ec4830281ce tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jun 10 17:58:36.234844 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e2debb17-453d-497a-8992-4ec4830281ce tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Request method failure captured: Jun 10 17:58:36.234844 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jun 10 17:58:36.234844 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 17:58:36.234844 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 17:58:36.234844 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 17:58:36.234844 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 17:58:36.234844 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 17:58:36.234844 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 17:58:36.234844 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 17:58:36.234844 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:36.234844 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4ZFz0KdVnU1lcsDgo7J7PulfDhlfFCGBade5DzcMDutpV6FqhJYlPbPs_6qX_VdmuZG1a4iBKDkZJe9m2UCDR4JW-ewpd3IgNZWlW18KPhJzNyqaz2Ql-B0FdRoYWMo5rsVLpu5R7Qszt44Be7Xdf2U5ZMw145OJsXH2oBakItvRq0 Jun 10 17:58:36.234844 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 17:58:36.234844 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 17:58:36.234844 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 17:58:36.234844 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 17:58:36.234844 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 17:58:36.234844 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 17:58:36.234844 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 7e0674a64c9c4427900f9ef11f4e4573 Jun 10 17:58:36.234844 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1915501983 Jun 10 17:58:36.234844 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member,admin Jun 10 17:58:36.234844 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member,admin Jun 10 17:58:36.236033 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/7e0674a64c9c4427900f9ef11f4e4573"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e0674a64c9c4427900f9ef11f4e4573"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e0674a64c9c4427900f9ef11f4e4573"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_7e0674a64c9c4427900f9ef11f4e4573", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:36.236033 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1915501983 Jun 10 17:58:36.236033 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 7e0674a64c9c4427900f9ef11f4e4573 Jun 10 17:58:36.236033 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1915501983 Jun 10 17:58:36.236033 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin Jun 10 17:58:36.236033 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 17:58:36.236033 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 17:58:36.236033 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 597438863f814f7faf9f9df5784e2341 Jun 10 17:58:36.236033 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin Jun 10 17:58:36.236033 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 17:58:36.236033 chdv-master-2 devstack@n-api.service[126595]: exception: Aggregate -1 could not be found. Jun 10 17:58:36.236033 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '-1'} Jun 10 17:58:36.236774 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:36.236774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:36.236774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jun 10 17:58:36.236774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jun 10 17:58:36.236774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 10 17:58:36.236774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 10 17:58:36.236774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 17:58:36.236774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 17:58:36.236774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 17:58:36.236774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 17:58:36.236774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 10 17:58:36.236774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 10 17:58:36.236774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jun 10 17:58:36.236774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jun 10 17:58:36.236774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 17:58:36.236774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 17:58:36.236774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 10 17:58:36.236774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 10 17:58:36.236774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 10 17:58:36.237790 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 10 17:58:36.237790 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 10 17:58:36.237790 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 10 17:58:36.237790 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jun 10 17:58:36.237790 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:36.237790 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:36.237790 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:36.237790 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:36.237790 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:36.237790 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:36.237790 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:36.237790 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:36.237790 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:36.237790 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:36.237790 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jun 10 17:58:36.237790 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 17:58:36.237790 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jun 10 17:58:36.237790 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:36.237790 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:36.237790 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:36.237790 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:36.241946 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:36.241946 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:36.241946 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:58:36.241946 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:58:36.241946 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jun 10 17:58:36.241946 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:36.241946 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e2debb17-453d-497a-8992-4ec4830281ce tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:36.241946 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e2debb17-453d-497a-8992-4ec4830281ce tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] 10.222.0.35 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.024556 Jun 10 17:58:36.244120 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 175/341] 10.222.0.35 () {58 vars in 1154 bytes} [Fri Jun 10 17:58:36 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 10 17:58:36.248081 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-74a77604-ab86-4cd7-bfb7-95a49af802d5 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:36.260909 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-74a77604-ab86-4cd7-bfb7-95a49af802d5 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.016886 Jun 10 17:58:36.261551 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 176/342] 10.222.0.35 () {58 vars in 1176 bytes} [Fri Jun 10 17:58:36 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:36.269376 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ef55e662-dbe8-4069-ba88-2dd3651529e9 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-159597800"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:36.270786 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:36.270786 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:36.271732 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.aggregate [None req-ef55e662-dbe8-4069-ba88-2dd3651529e9 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Generated uuid 3dfae4be-9066-4dae-950a-b1a1b0cc41a9 for aggregate {{(pid=126595) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 10 17:58:36.384972 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ef55e662-dbe8-4069-ba88-2dd3651529e9 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.122035 Jun 10 17:58:36.385952 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 177/343] 10.222.0.35 () {60 vars in 1163 bytes} [Fri Jun 10 17:58:36 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:36.398931 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0c4b337a-71e6-42e1-abc6-4b48f5c3644e tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:36.430046 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0c4b337a-71e6-42e1-abc6-4b48f5c3644e tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.042991 Jun 10 17:58:36.446794 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 178/344] 10.222.0.35 () {58 vars in 1170 bytes} [Fri Jun 10 17:58:36 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:36.447468 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b3939353-c730-46b7-a584-06ca4333d54a tempest-AggregatesAdminNegativeTestJSON-374046379 tempest-AggregatesAdminNegativeTestJSON-374046379-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:36.449121 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:36.449121 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:36.450308 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b3939353-c730-46b7-a584-06ca4333d54a tempest-AggregatesAdminNegativeTestJSON-374046379 tempest-AggregatesAdminNegativeTestJSON-374046379-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '5f15d7454e7343eb842eb9f393eb9a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73c029e758484288932a08a3606d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:36.452093 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b3939353-c730-46b7-a584-06ca4333d54a tempest-AggregatesAdminNegativeTestJSON-374046379 tempest-AggregatesAdminNegativeTestJSON-374046379-project] Request method failure captured: Jun 10 17:58:36.452093 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Jun 10 17:58:36.452093 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 17:58:36.452093 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 17:58:36.452093 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 17:58:36.452093 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 17:58:36.452093 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 17:58:36.452093 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 17:58:36.452093 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 17:58:36.452093 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:36.452093 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4ZEqqeOuRzqK-tM05zf-Eq6izyVU8i9uhgSPfHbQjozlsiS2dTzB29hDlvUfT_0m41PxQdpaqaweFqTPdMp_uQ4YtxL9ezkP4uqschU7d8BV4xPtrGxmhIHxHhJNz9__sP5CjBqttcP2t4sqHulMjIVe5FbmdLLeGJTgLduStBUwgY Jun 10 17:58:36.452093 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 17:58:36.452093 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 17:58:36.452093 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 17:58:36.452093 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 17:58:36.452093 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 17:58:36.452093 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 17:58:36.452093 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 1a73c029e758484288932a08a3606d5f Jun 10 17:58:36.452093 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-374046379 Jun 10 17:58:36.452093 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 17:58:36.452093 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 17:58:36.453347 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1a73c029e758484288932a08a3606d5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1a73c029e758484288932a08a3606d5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1a73c029e758484288932a08a3606d5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1a73c029e758484288932a08a3606d5f", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:36.453347 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-374046379 Jun 10 17:58:36.453347 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 1a73c029e758484288932a08a3606d5f Jun 10 17:58:36.453347 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-374046379 Jun 10 17:58:36.453347 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-AggregatesAdminNegativeTestJSON-374046379-project Jun 10 17:58:36.453347 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 17:58:36.453347 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 17:58:36.453347 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 5f15d7454e7343eb842eb9f393eb9a0c Jun 10 17:58:36.453347 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-374046379-project Jun 10 17:58:36.453347 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 17:58:36.453347 chdv-master-2 devstack@n-api.service[126595]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jun 10 17:58:36.453347 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '16'} Jun 10 17:58:36.453998 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:36.453998 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:36.453998 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:36.453998 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:36.453998 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:36.453998 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:36.453998 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:36.453998 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:36.453998 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Jun 10 17:58:36.453998 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Jun 10 17:58:36.453998 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 10 17:58:36.453998 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 10 17:58:36.453998 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 10 17:58:36.453998 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 10 17:58:36.453998 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 17:58:36.453998 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 17:58:36.453998 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 17:58:36.453998 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 17:58:36.453998 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 10 17:58:36.454998 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 10 17:58:36.454998 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 10 17:58:36.454998 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 10 17:58:36.454998 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 10 17:58:36.454998 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 10 17:58:36.454998 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jun 10 17:58:36.454998 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:36.454998 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:36.454998 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:36.454998 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:36.454998 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:36.454998 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:36.454998 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 10 17:58:36.454998 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 10 17:58:36.454998 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jun 10 17:58:36.454998 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:36.457174 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b3939353-c730-46b7-a584-06ca4333d54a tempest-AggregatesAdminNegativeTestJSON-374046379 tempest-AggregatesAdminNegativeTestJSON-374046379-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:36.458248 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b3939353-c730-46b7-a584-06ca4333d54a tempest-AggregatesAdminNegativeTestJSON-374046379 tempest-AggregatesAdminNegativeTestJSON-374046379-project] 10.222.0.35 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.015480 Jun 10 17:58:36.462240 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 179/345] 10.222.0.35 () {58 vars in 1151 bytes} [Fri Jun 10 17:58:36 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:58:36.468165 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-44978334-73af-40b8-950d-59f2d7a18767 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:36.469465 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-44978334-73af-40b8-950d-59f2d7a18767 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] [instance: 2b47ecdd-b178-49f2-a28f-bdedb4771918] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:36.485933 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44978334-73af-40b8-950d-59f2d7a18767 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:36.486436 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44978334-73af-40b8-950d-59f2d7a18767 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:36.487259 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44978334-73af-40b8-950d-59f2d7a18767 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:36.488288 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44978334-73af-40b8-950d-59f2d7a18767 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:36.538938 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0bb558d4-a7e1-4cea-8991-ad67a111ed02 tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] 10.222.0.35 "POST /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd/action" status: 202 len: 0 microversion: 2.1 time: 0.386094 Jun 10 17:58:36.544520 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 167/346] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 17:58:36 2022] POST /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 17:58:36.547328 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6e84a6f3-5366-4e33-a0bb-ee752a8d0ec9 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:36.581756 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-44978334-73af-40b8-950d-59f2d7a18767 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6942ee76c6e4b16a9ea45d595084df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cef3679b5a47e48376197d17220e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:36.582012 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6e84a6f3-5366-4e33-a0bb-ee752a8d0ec9 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 415 microversion: 2.1 time: 0.041095 Jun 10 17:58:36.582660 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 168/347] 10.222.0.35 () {58 vars in 1168 bytes} [Fri Jun 10 17:58:36 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 415 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:36.590545 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-44978334-73af-40b8-950d-59f2d7a18767 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] 10.222.0.35 "GET /compute/v2.1/servers/2b47ecdd-b178-49f2-a28f-bdedb4771918" status: 200 len: 1275 microversion: 2.1 time: 0.127192 Jun 10 17:58:36.590764 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d318fbec-db2a-4244-921f-e517eb5b05e3 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:36.591129 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 180/348] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:36 2022] GET /compute/v2.1/servers/2b47ecdd-b178-49f2-a28f-bdedb4771918 => generated 1275 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:36.599135 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0ac66b9d-b82b-4be0-8b48-18c4d6040809 tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:36.599746 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0ac66b9d-b82b-4be0-8b48-18c4d6040809 tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] [instance: 2814abaf-90ac-4439-b500-df1bd532b1bd] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:36.601812 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:36.601812 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:36.612942 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0ac66b9d-b82b-4be0-8b48-18c4d6040809 tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:36.616257 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0ac66b9d-b82b-4be0-8b48-18c4d6040809 tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:36.616257 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0ac66b9d-b82b-4be0-8b48-18c4d6040809 tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:36.616257 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0ac66b9d-b82b-4be0-8b48-18c4d6040809 tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:36.710885 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d318fbec-db2a-4244-921f-e517eb5b05e3 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] 10.222.0.35 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.126484 Jun 10 17:58:36.712718 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 169/349] 10.222.0.35 () {58 vars in 1154 bytes} [Fri Jun 10 17:58:36 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 10 17:58:36.720864 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-557a9cc3-4bc8-47da-991b-42cfd4f6ef92 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:36.749842 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-557a9cc3-4bc8-47da-991b-42cfd4f6ef92 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6217 microversion: 2.1 time: 0.033836 Jun 10 17:58:36.750619 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 170/350] 10.222.0.35 () {58 vars in 1168 bytes} [Fri Jun 10 17:58:36 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6217 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:36.756018 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-487f1b65-8b46-494e-b8fb-d0416c09aeaa tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:36.756963 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-487f1b65-8b46-494e-b8fb-d0416c09aeaa tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: 95e3fefa-48f8-42be-95a1-a58e3980db9b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:36.764731 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-487f1b65-8b46-494e-b8fb-d0416c09aeaa tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:36.765515 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-487f1b65-8b46-494e-b8fb-d0416c09aeaa tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:36.766463 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-487f1b65-8b46-494e-b8fb-d0416c09aeaa tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:36.767055 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-487f1b65-8b46-494e-b8fb-d0416c09aeaa tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:37.145188 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0ac66b9d-b82b-4be0-8b48-18c4d6040809 tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd" status: 200 len: 1631 microversion: 2.1 time: 0.552969 Jun 10 17:58:37.147526 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 181/351] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:36 2022] GET /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd => generated 1631 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:37.154195 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-554e2137-507a-4bd2-bd77-dff4d2db85a1 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:37.155195 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:37.155195 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:37.166251 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-554e2137-507a-4bd2-bd77-dff4d2db85a1 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jun 10 17:58:37.168114 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-554e2137-507a-4bd2-bd77-dff4d2db85a1 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Request method failure captured: Jun 10 17:58:37.168114 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jun 10 17:58:37.168114 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 17:58:37.168114 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 17:58:37.168114 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 17:58:37.168114 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 17:58:37.168114 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 17:58:37.168114 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 17:58:37.168114 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 17:58:37.168114 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:37.168114 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4ZFz0KdVnU1lcsDgo7J7PulfDhlfFCGBade5DzcMDutpV6FqhJYlPbPs_6qX_VdmuZG1a4iBKDkZJe9m2UCDR4JW-ewpd3IgNZWlW18KPhJzNyqaz2Ql-B0FdRoYWMo5rsVLpu5R7Qszt44Be7Xdf2U5ZMw145OJsXH2oBakItvRq0 Jun 10 17:58:37.168114 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 17:58:37.168114 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 17:58:37.168114 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 17:58:37.168114 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 17:58:37.168114 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 17:58:37.168114 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 17:58:37.168114 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 7e0674a64c9c4427900f9ef11f4e4573 Jun 10 17:58:37.168114 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1915501983 Jun 10 17:58:37.168114 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member,admin Jun 10 17:58:37.168114 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member,admin Jun 10 17:58:37.169406 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/7e0674a64c9c4427900f9ef11f4e4573"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e0674a64c9c4427900f9ef11f4e4573"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e0674a64c9c4427900f9ef11f4e4573"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_7e0674a64c9c4427900f9ef11f4e4573", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:37.169406 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1915501983 Jun 10 17:58:37.169406 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 7e0674a64c9c4427900f9ef11f4e4573 Jun 10 17:58:37.169406 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1915501983 Jun 10 17:58:37.169406 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin Jun 10 17:58:37.169406 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 17:58:37.169406 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 17:58:37.169406 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 597438863f814f7faf9f9df5784e2341 Jun 10 17:58:37.169406 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin Jun 10 17:58:37.169406 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 17:58:37.169406 chdv-master-2 devstack@n-api.service[126595]: exception: Aggregate -1 could not be found. Jun 10 17:58:37.169406 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '-1'} Jun 10 17:58:37.170152 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:37.170152 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:37.170152 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jun 10 17:58:37.170152 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jun 10 17:58:37.170152 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jun 10 17:58:37.170152 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jun 10 17:58:37.170152 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 17:58:37.170152 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 17:58:37.170152 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 10 17:58:37.170152 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 10 17:58:37.170152 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 10 17:58:37.170152 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 10 17:58:37.170152 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 10 17:58:37.170152 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 10 17:58:37.170152 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jun 10 17:58:37.170152 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:37.170152 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:37.170152 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:37.170152 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:37.170152 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:37.171258 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:37.171258 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:37.171258 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:37.171258 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:37.171258 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:37.171258 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jun 10 17:58:37.171258 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 17:58:37.171258 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jun 10 17:58:37.171258 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:37.171258 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:37.171258 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:37.171258 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:37.171258 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:37.171258 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:37.171258 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:58:37.171258 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:58:37.171258 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jun 10 17:58:37.171258 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:37.173824 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-554e2137-507a-4bd2-bd77-dff4d2db85a1 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:37.174883 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-554e2137-507a-4bd2-bd77-dff4d2db85a1 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] 10.222.0.35 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.026176 Jun 10 17:58:37.176135 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 182/352] 10.222.0.35 () {58 vars in 1151 bytes} [Fri Jun 10 17:58:37 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 10 17:58:37.189814 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d827034c-8127-490c-9e73-d5c6bf498150 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:37.200155 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-487f1b65-8b46-494e-b8fb-d0416c09aeaa tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19776e5adf942c6a20e4dea1aa10cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1fd6bd677ff4b17bafee8fad1d720a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:37.210233 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-487f1b65-8b46-494e-b8fb-d0416c09aeaa tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b" status: 200 len: 1318 microversion: 2.1 time: 0.458314 Jun 10 17:58:37.210801 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 171/353] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:36 2022] GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b => generated 1318 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:37.217120 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d827034c-8127-490c-9e73-d5c6bf498150 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6217 microversion: 2.1 time: 0.039600 Jun 10 17:58:37.218040 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 183/354] 10.222.0.35 () {58 vars in 1174 bytes} [Fri Jun 10 17:58:37 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6217 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:37.220515 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9775eceb-66c2-4874-862e-07ab031a8ae5 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:37.223417 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4a3a0c54-4231-424e-a019-bf6cb4097e0c tempest-AggregatesAdminNegativeTestJSON-374046379 tempest-AggregatesAdminNegativeTestJSON-374046379-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:37.224209 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9775eceb-66c2-4874-862e-07ab031a8ae5 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 1fcc6103-9ecc-42f4-9df8-ac2251f06eed] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:37.224577 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:37.224577 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:37.226930 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4a3a0c54-4231-424e-a019-bf6cb4097e0c tempest-AggregatesAdminNegativeTestJSON-374046379 tempest-AggregatesAdminNegativeTestJSON-374046379-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '5f15d7454e7343eb842eb9f393eb9a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73c029e758484288932a08a3606d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:37.234281 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4a3a0c54-4231-424e-a019-bf6cb4097e0c tempest-AggregatesAdminNegativeTestJSON-374046379 tempest-AggregatesAdminNegativeTestJSON-374046379-project] Request method failure captured: Jun 10 17:58:37.234281 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Jun 10 17:58:37.234281 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 17:58:37.234281 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 17:58:37.234281 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 17:58:37.234281 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 17:58:37.234281 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 17:58:37.234281 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 17:58:37.234281 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 17:58:37.234281 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:37.234281 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4ZEqqeOuRzqK-tM05zf-Eq6izyVU8i9uhgSPfHbQjozlsiS2dTzB29hDlvUfT_0m41PxQdpaqaweFqTPdMp_uQ4YtxL9ezkP4uqschU7d8BV4xPtrGxmhIHxHhJNz9__sP5CjBqttcP2t4sqHulMjIVe5FbmdLLeGJTgLduStBUwgY Jun 10 17:58:37.234281 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 17:58:37.234281 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 17:58:37.234281 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 17:58:37.234281 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 17:58:37.234281 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 17:58:37.234281 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 17:58:37.234281 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 1a73c029e758484288932a08a3606d5f Jun 10 17:58:37.234281 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-374046379 Jun 10 17:58:37.234281 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 17:58:37.234281 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 17:58:37.235605 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1a73c029e758484288932a08a3606d5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1a73c029e758484288932a08a3606d5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1a73c029e758484288932a08a3606d5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1a73c029e758484288932a08a3606d5f", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:37.235605 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-374046379 Jun 10 17:58:37.235605 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 1a73c029e758484288932a08a3606d5f Jun 10 17:58:37.235605 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-374046379 Jun 10 17:58:37.235605 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-AggregatesAdminNegativeTestJSON-374046379-project Jun 10 17:58:37.235605 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 17:58:37.235605 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 17:58:37.235605 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 5f15d7454e7343eb842eb9f393eb9a0c Jun 10 17:58:37.235605 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-374046379-project Jun 10 17:58:37.235605 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 17:58:37.235605 chdv-master-2 devstack@n-api.service[126595]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jun 10 17:58:37.235605 chdv-master-2 devstack@n-api.service[126595]: action_args: {} Jun 10 17:58:37.236250 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:37.236250 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:37.236250 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:37.236250 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:37.236250 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:37.236250 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:37.236250 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:37.236250 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:37.236250 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Jun 10 17:58:37.236250 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Jun 10 17:58:37.236250 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 10 17:58:37.236250 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 10 17:58:37.236250 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 10 17:58:37.236250 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 10 17:58:37.236250 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 17:58:37.236250 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 17:58:37.236250 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 17:58:37.236250 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 17:58:37.236250 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 10 17:58:37.238047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 10 17:58:37.238047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 10 17:58:37.238047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 10 17:58:37.238047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 10 17:58:37.238047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 10 17:58:37.238047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jun 10 17:58:37.238047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:37.238047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:37.238047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:37.238047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:37.238047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:37.238047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:37.238047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 10 17:58:37.238047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 10 17:58:37.238047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jun 10 17:58:37.238047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:37.238047 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4a3a0c54-4231-424e-a019-bf6cb4097e0c tempest-AggregatesAdminNegativeTestJSON-374046379 tempest-AggregatesAdminNegativeTestJSON-374046379-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:37.241922 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4a3a0c54-4231-424e-a019-bf6cb4097e0c tempest-AggregatesAdminNegativeTestJSON-374046379 tempest-AggregatesAdminNegativeTestJSON-374046379-project] 10.222.0.35 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.016143 Jun 10 17:58:37.247340 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9775eceb-66c2-4874-862e-07ab031a8ae5 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:37.247787 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9775eceb-66c2-4874-862e-07ab031a8ae5 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:37.248603 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9775eceb-66c2-4874-862e-07ab031a8ae5 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:37.249044 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9775eceb-66c2-4874-862e-07ab031a8ae5 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:37.250468 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 184/355] 10.222.0.35 () {58 vars in 1142 bytes} [Fri Jun 10 17:58:37 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:58:37.255045 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5c0b315e-5ae9-434e-9893-2542e3f5643a tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:37.299080 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5c0b315e-5ae9-434e-9893-2542e3f5643a tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6217 microversion: 2.1 time: 0.047431 Jun 10 17:58:37.306756 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 185/356] 10.222.0.35 () {58 vars in 1172 bytes} [Fri Jun 10 17:58:37 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6217 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:37.316945 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-80614f50-d6f5-4141-9a0c-d4311628c996 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1932252766"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:37.318535 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:37.318535 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:37.319499 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.aggregate [None req-80614f50-d6f5-4141-9a0c-d4311628c996 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Generated uuid 4bda60d5-e436-4a0f-ae8e-e5a8c7ba8916 for aggregate {{(pid=126595) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 10 17:58:37.434076 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-80614f50-d6f5-4141-9a0c-d4311628c996 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.125944 Jun 10 17:58:37.436881 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 186/357] 10.222.0.35 () {60 vars in 1163 bytes} [Fri Jun 10 17:58:37 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:37.450063 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a0091a33-da6a-4ceb-b2d7-e31f50080ee2 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:37.490574 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a0091a33-da6a-4ceb-b2d7-e31f50080ee2 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6217 microversion: 2.1 time: 0.052533 Jun 10 17:58:37.491451 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 187/358] 10.222.0.35 () {58 vars in 1168 bytes} [Fri Jun 10 17:58:37 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6217 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:37.502661 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-12244c17-cf0f-42b5-97df-ae8518cd2303 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "chh1-master-2"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:37.506302 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:37.506302 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:37.520037 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-12244c17-cf0f-42b5-97df-ae8518cd2303 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:37.520555 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-12244c17-cf0f-42b5-97df-ae8518cd2303 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:37.818987 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-12244c17-cf0f-42b5-97df-ae8518cd2303 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.325494 Jun 10 17:58:37.819588 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 188/359] 10.222.0.35 () {60 vars in 1193 bytes} [Fri Jun 10 17:58:37 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:37.824365 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-928b7ef2-1e22-46c8-955a-e1ab631077ae tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:37.826686 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:37.826686 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:37.882198 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9775eceb-66c2-4874-862e-07ab031a8ae5 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:37.898968 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9775eceb-66c2-4874-862e-07ab031a8ae5 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed" status: 200 len: 1320 microversion: 2.1 time: 0.685796 Jun 10 17:58:37.900946 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 172/360] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:37 2022] GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed => generated 1320 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:37.905817 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c808a304-ae88-4f57-b7f2-3f77e5971800 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:37.909226 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c808a304-ae88-4f57-b7f2-3f77e5971800 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] [instance: 2b47ecdd-b178-49f2-a28f-bdedb4771918] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:37.918725 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-928b7ef2-1e22-46c8-955a-e1ab631077ae tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "DELETE /compute/v2.1/flavors/1286057994" status: 202 len: 0 microversion: 2.1 time: 0.097794 Jun 10 17:58:37.923001 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 189/361] 10.222.0.35 () {58 vars in 1160 bytes} [Fri Jun 10 17:58:37 2022] DELETE /compute/v2.1/flavors/1286057994 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 17:58:37.936367 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5c60cea6-7189-43eb-b1d4-2d5f39a1c220 tempest-AggregatesAdminNegativeTestJSON-374046379 tempest-AggregatesAdminNegativeTestJSON-374046379-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "chh1-master-2"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:37.939085 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:37.939085 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:37.940248 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5c60cea6-7189-43eb-b1d4-2d5f39a1c220 tempest-AggregatesAdminNegativeTestJSON-374046379 tempest-AggregatesAdminNegativeTestJSON-374046379-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '5f15d7454e7343eb842eb9f393eb9a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73c029e758484288932a08a3606d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:37.949670 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c808a304-ae88-4f57-b7f2-3f77e5971800 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:37.953951 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c808a304-ae88-4f57-b7f2-3f77e5971800 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:37.953951 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c808a304-ae88-4f57-b7f2-3f77e5971800 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:37.955090 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5c60cea6-7189-43eb-b1d4-2d5f39a1c220 tempest-AggregatesAdminNegativeTestJSON-374046379 tempest-AggregatesAdminNegativeTestJSON-374046379-project] Request method failure captured: Jun 10 17:58:37.955090 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Jun 10 17:58:37.955090 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 17:58:37.955090 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 17:58:37.955090 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 17:58:37.955090 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 42 Jun 10 17:58:37.955090 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 17:58:37.955090 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 17:58:37.955090 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 17:58:37.955090 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:37.955090 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4ZEqqeOuRzqK-tM05zf-Eq6izyVU8i9uhgSPfHbQjozlsiS2dTzB29hDlvUfT_0m41PxQdpaqaweFqTPdMp_uQ4YtxL9ezkP4uqschU7d8BV4xPtrGxmhIHxHhJNz9__sP5CjBqttcP2t4sqHulMjIVe5FbmdLLeGJTgLduStBUwgY Jun 10 17:58:37.955090 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 17:58:37.955090 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 17:58:37.955090 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 17:58:37.955090 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 17:58:37.955090 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 17:58:37.955090 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 17:58:37.955090 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 1a73c029e758484288932a08a3606d5f Jun 10 17:58:37.955090 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-374046379 Jun 10 17:58:37.955090 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 17:58:37.955090 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 17:58:37.956514 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1a73c029e758484288932a08a3606d5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1a73c029e758484288932a08a3606d5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1a73c029e758484288932a08a3606d5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1a73c029e758484288932a08a3606d5f", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:37.956514 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-374046379 Jun 10 17:58:37.956514 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 1a73c029e758484288932a08a3606d5f Jun 10 17:58:37.956514 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-374046379 Jun 10 17:58:37.956514 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-AggregatesAdminNegativeTestJSON-374046379-project Jun 10 17:58:37.956514 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 17:58:37.956514 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 17:58:37.956514 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 5f15d7454e7343eb842eb9f393eb9a0c Jun 10 17:58:37.956514 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-374046379-project Jun 10 17:58:37.956514 chdv-master-2 devstack@n-api.service[126595]: Jun 10 17:58:37.956514 chdv-master-2 devstack@n-api.service[126595]: {"remove_host": {"host": "chh1-master-2"}} Jun 10 17:58:37.956514 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 17:58:37.956514 chdv-master-2 devstack@n-api.service[126595]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jun 10 17:58:37.957270 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'chh1-master-2'}}} Jun 10 17:58:37.957270 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:37.957270 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:37.957270 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:37.957270 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:37.957270 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:37.957270 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:37.957270 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:37.957270 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:37.957270 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 17:58:37.957270 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 17:58:37.957270 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Jun 10 17:58:37.957270 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Jun 10 17:58:37.957270 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 10 17:58:37.957270 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 10 17:58:37.957270 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 10 17:58:37.957270 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 10 17:58:37.957270 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 17:58:37.957270 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 17:58:37.958659 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 17:58:37.958659 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 17:58:37.958659 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 10 17:58:37.958659 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 10 17:58:37.958659 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 10 17:58:37.958659 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 10 17:58:37.958659 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 10 17:58:37.958659 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 10 17:58:37.958659 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jun 10 17:58:37.958659 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:37.958659 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:37.958659 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:37.958659 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:37.958659 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:37.958659 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:37.958659 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 10 17:58:37.958659 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 10 17:58:37.958659 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jun 10 17:58:37.958659 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:37.960914 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5c60cea6-7189-43eb-b1d4-2d5f39a1c220 tempest-AggregatesAdminNegativeTestJSON-374046379 tempest-AggregatesAdminNegativeTestJSON-374046379-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:37.964661 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5c60cea6-7189-43eb-b1d4-2d5f39a1c220 tempest-AggregatesAdminNegativeTestJSON-374046379 tempest-AggregatesAdminNegativeTestJSON-374046379-project] 10.222.0.35 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.044181 Jun 10 17:58:37.967360 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c808a304-ae88-4f57-b7f2-3f77e5971800 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:37.967792 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 190/362] 10.222.0.35 () {60 vars in 1193 bytes} [Fri Jun 10 17:58:37 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 48 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:58:37.974382 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b4aff032-a16f-48d5-905b-070db84967de tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:38.004649 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b4aff032-a16f-48d5-905b-070db84967de tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.034010 Jun 10 17:58:38.016460 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 191/363] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 17:58:37 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:38.022933 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-86ef3116-4a4c-4e5b-84b9-a20e87dfc6e6 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "chh1-master-2"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:38.035422 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86ef3116-4a4c-4e5b-84b9-a20e87dfc6e6 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:38.036559 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86ef3116-4a4c-4e5b-84b9-a20e87dfc6e6 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:38.344299 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-86ef3116-4a4c-4e5b-84b9-a20e87dfc6e6 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.325014 Jun 10 17:58:38.345194 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 192/364] 10.222.0.35 () {60 vars in 1193 bytes} [Fri Jun 10 17:58:38 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:38.349754 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7eec11a3-ae64-4b34-b325-e638d6965dfa tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:38.355081 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:38.355081 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:38.410402 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c808a304-ae88-4f57-b7f2-3f77e5971800 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6942ee76c6e4b16a9ea45d595084df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cef3679b5a47e48376197d17220e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:38.419819 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c808a304-ae88-4f57-b7f2-3f77e5971800 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] 10.222.0.35 "GET /compute/v2.1/servers/2b47ecdd-b178-49f2-a28f-bdedb4771918" status: 200 len: 1281 microversion: 2.1 time: 0.517593 Jun 10 17:58:38.420881 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 173/365] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:37 2022] GET /compute/v2.1/servers/2b47ecdd-b178-49f2-a28f-bdedb4771918 => generated 1281 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:38.431470 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-bbf9376b-87f0-4700-90a1-29b5c974f8b6 req-c9f7cdbd-8a06-4271-b042-61cfe4bb8182 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95e3fefa-48f8-42be-95a1-a58e3980db9b", "tag": "527428be-3731-4772-b256-ff477210a6f7"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:38.440483 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-bbf9376b-87f0-4700-90a1-29b5c974f8b6 req-c9f7cdbd-8a06-4271-b042-61cfe4bb8182 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:38.440949 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-bbf9376b-87f0-4700-90a1-29b5c974f8b6 req-c9f7cdbd-8a06-4271-b042-61cfe4bb8182 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:38.451455 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:58:38.453615 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-bbf9376b-87f0-4700-90a1-29b5c974f8b6 req-c9f7cdbd-8a06-4271-b042-61cfe4bb8182 service nova] Creating event network-changed:527428be-3731-4772-b256-ff477210a6f7 for instance 95e3fefa-48f8-42be-95a1-a58e3980db9b on chh2-master-2 Jun 10 17:58:38.458905 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-bbf9376b-87f0-4700-90a1-29b5c974f8b6 req-c9f7cdbd-8a06-4271-b042-61cfe4bb8182 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036082 Jun 10 17:58:38.459955 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 174/366] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:38.464993 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d7b655ff-f970-4af4-823b-dfd2bcb91d80 tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:38.465847 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d7b655ff-f970-4af4-823b-dfd2bcb91d80 tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] [instance: 2814abaf-90ac-4439-b500-df1bd532b1bd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:38.474762 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d7b655ff-f970-4af4-823b-dfd2bcb91d80 tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:38.475318 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d7b655ff-f970-4af4-823b-dfd2bcb91d80 tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:38.476172 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d7b655ff-f970-4af4-823b-dfd2bcb91d80 tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:38.476717 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d7b655ff-f970-4af4-823b-dfd2bcb91d80 tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:38.527126 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7eec11a3-ae64-4b34-b325-e638d6965dfa tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "DELETE /compute/v2.1/flavors/690583439" status: 202 len: 0 microversion: 2.1 time: 0.180840 Jun 10 17:58:38.528610 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 193/367] 10.222.0.35 () {58 vars in 1157 bytes} [Fri Jun 10 17:58:38 2022] DELETE /compute/v2.1/flavors/690583439 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 17:58:38.535505 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-17b7a0d2-836c-4fc8-83a6-12708be5458c tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:38.537736 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-17b7a0d2-836c-4fc8-83a6-12708be5458c tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: 95e3fefa-48f8-42be-95a1-a58e3980db9b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:38.551632 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-17b7a0d2-836c-4fc8-83a6-12708be5458c tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:38.552284 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-17b7a0d2-836c-4fc8-83a6-12708be5458c tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:38.555577 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-17b7a0d2-836c-4fc8-83a6-12708be5458c tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:38.555577 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-17b7a0d2-836c-4fc8-83a6-12708be5458c tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:38.797848 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-17b7a0d2-836c-4fc8-83a6-12708be5458c tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19776e5adf942c6a20e4dea1aa10cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1fd6bd677ff4b17bafee8fad1d720a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:38.805695 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-17b7a0d2-836c-4fc8-83a6-12708be5458c tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b" status: 200 len: 1318 microversion: 2.1 time: 0.275825 Jun 10 17:58:38.806269 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 194/368] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:38 2022] GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:38.820918 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f704db99-550a-4d14-992d-fa538e1d1fd0 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:38.822425 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:38.822425 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:38.829659 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d7b655ff-f970-4af4-823b-dfd2bcb91d80 tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd" status: 200 len: 1614 microversion: 2.1 time: 0.368292 Jun 10 17:58:38.831600 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 175/369] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:38 2022] GET /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd => generated 1614 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:38.836762 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-dbed8924-724e-465d-8d88-ce161068926f tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:38.857773 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-dbed8924-724e-465d-8d88-ce161068926f tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.025744 Jun 10 17:58:38.858166 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 176/370] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 17:58:38 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:38.862934 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ade59050-c70a-4c1d-a8c5-388bc99270bc tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:38.863527 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ade59050-c70a-4c1d-a8c5-388bc99270bc tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] [instance: 2814abaf-90ac-4439-b500-df1bd532b1bd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:38.871413 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ade59050-c70a-4c1d-a8c5-388bc99270bc tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:38.871877 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ade59050-c70a-4c1d-a8c5-388bc99270bc tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:38.872722 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ade59050-c70a-4c1d-a8c5-388bc99270bc tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:38.873164 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ade59050-c70a-4c1d-a8c5-388bc99270bc tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:38.921281 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f704db99-550a-4d14-992d-fa538e1d1fd0 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] 10.222.0.35 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.106095 Jun 10 17:58:38.922563 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 195/371] 10.222.0.35 () {58 vars in 1154 bytes} [Fri Jun 10 17:58:38 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 10 17:58:38.931577 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-033e9df4-2bc9-49a1-b1c1-0d9860ffc279 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1037733805", "id": 1738436262, "os-flavor-access:is_public": "False"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:38.934534 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:38.934534 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:38.950321 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-ade59050-c70a-4c1d-a8c5-388bc99270bc tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] HTTP exception thrown: Cannot 'migrate' instance 2814abaf-90ac-4439-b500-df1bd532b1bd while it is in vm_state suspended Jun 10 17:58:38.952060 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ade59050-c70a-4c1d-a8c5-388bc99270bc tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] Request method failure captured: Jun 10 17:58:38.952060 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd/action HTTP/1.1 Jun 10 17:58:38.952060 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 17:58:38.952060 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 17:58:38.952060 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 17:58:38.952060 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 15 Jun 10 17:58:38.952060 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 17:58:38.952060 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 17:58:38.952060 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 17:58:38.952060 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:38.952060 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4YKuqC9TPdOwba3_U-DlKaD_Tm-ihGW8grI5lIHxmym7uoFeB5qbOKhqOOc-9WI7TUnA6n-svah13iRmntShUpUU7Ib7eBSHN0eeNRYcPCXmbt0Adg_N5IrD8Bml-KbTUb2mgMFU1hOuTfkt482IM6GO78GY4atbPF7EuUxiQKdtoo Jun 10 17:58:38.952060 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 17:58:38.952060 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 17:58:38.952060 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 17:58:38.952060 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 17:58:38.952060 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 17:58:38.952060 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 17:58:38.952060 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: f92204f48d1a43cdb934f3ca14a24023 Jun 10 17:58:38.952060 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2078648386 Jun 10 17:58:38.952060 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member,admin Jun 10 17:58:38.952060 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member,admin Jun 10 17:58:38.954095 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/f92204f48d1a43cdb934f3ca14a24023"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/f92204f48d1a43cdb934f3ca14a24023"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/f92204f48d1a43cdb934f3ca14a24023"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_f92204f48d1a43cdb934f3ca14a24023", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:38.954095 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2078648386 Jun 10 17:58:38.954095 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: f92204f48d1a43cdb934f3ca14a24023 Jun 10 17:58:38.954095 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2078648386 Jun 10 17:58:38.954095 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersAdminNegativeTestJSON-2078648386-project-admin Jun 10 17:58:38.954095 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 17:58:38.954095 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 17:58:38.954095 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: cffa6dbd68044b73a5cf289b6110dd35 Jun 10 17:58:38.954095 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2078648386-project-admin Jun 10 17:58:38.954095 chdv-master-2 devstack@n-api.service[126594]: Jun 10 17:58:38.954095 chdv-master-2 devstack@n-api.service[126594]: {"migrate": {}} Jun 10 17:58:38.954095 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 17:58:38.954095 chdv-master-2 devstack@n-api.service[126594]: exception: Cannot 'migrate' instance 2814abaf-90ac-4439-b500-df1bd532b1bd while it is in vm_state suspended Jun 10 17:58:38.955277 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '2814abaf-90ac-4439-b500-df1bd532b1bd', 'body': {'migrate': {}}} Jun 10 17:58:38.955277 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:38.955277 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:38.955277 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Jun 10 17:58:38.955277 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Jun 10 17:58:38.955277 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 10 17:58:38.955277 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 10 17:58:38.955277 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 10 17:58:38.955277 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 10 17:58:38.955277 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 10 17:58:38.955277 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 10 17:58:38.955277 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 10 17:58:38.955277 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 10 17:58:38.955277 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 10 17:58:38.955277 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 10 17:58:38.955277 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 10 17:58:38.955277 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 10 17:58:38.955277 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2814abaf-90ac-4439-b500-df1bd532b1bd in vm_state suspended. Cannot resize while the instance is in this state. Jun 10 17:58:38.955277 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:38.956571 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:38.956571 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:38.956571 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:38.956571 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:38.956571 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:38.956571 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:38.956571 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:38.956571 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:38.956571 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:38.956571 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 17:58:38.956571 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 17:58:38.956571 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Jun 10 17:58:38.956571 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 10 17:58:38.956571 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 10 17:58:38.956571 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 10 17:58:38.956571 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 2814abaf-90ac-4439-b500-df1bd532b1bd while it is in vm_state suspended Jun 10 17:58:38.956571 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:38.956571 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:38.956571 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:38.956571 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:38.959323 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:38.959323 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:38.959323 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:58:38.959323 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:58:38.959323 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 2814abaf-90ac-4439-b500-df1bd532b1bd while it is in vm_state suspended Jun 10 17:58:38.959323 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:38.959323 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ade59050-c70a-4c1d-a8c5-388bc99270bc tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] Returning 409 to user: Cannot 'migrate' instance 2814abaf-90ac-4439-b500-df1bd532b1bd while it is in vm_state suspended {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:38.959323 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ade59050-c70a-4c1d-a8c5-388bc99270bc tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] 10.222.0.35 "POST /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd/action" status: 409 len: 148 microversion: 2.1 time: 0.094780 Jun 10 17:58:38.959323 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 177/372] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 17:58:38 2022] POST /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd/action => generated 148 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 10 17:58:38.964123 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ed77729b-dccd-440f-abc8-200ee58952ca tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:38.964845 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ed77729b-dccd-440f-abc8-200ee58952ca tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 1fcc6103-9ecc-42f4-9df8-ac2251f06eed] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:38.973022 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ed77729b-dccd-440f-abc8-200ee58952ca tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:38.973480 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ed77729b-dccd-440f-abc8-200ee58952ca tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:38.974252 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ed77729b-dccd-440f-abc8-200ee58952ca tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:38.974686 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ed77729b-dccd-440f-abc8-200ee58952ca tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:39.031582 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-033e9df4-2bc9-49a1-b1c1-0d9860ffc279 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.107054 Jun 10 17:58:39.032162 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 196/373] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:58:38 2022] POST /compute/v2.1/flavors => generated 415 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:39.045570 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8d7b0ea0-7d9a-46b0-9c99-83c06883a5b9 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1235030877"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:39.046923 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:39.046923 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:39.047783 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.aggregate [None req-8d7b0ea0-7d9a-46b0-9c99-83c06883a5b9 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Generated uuid f432617e-c86d-40ba-bf03-dd72a48f2385 for aggregate {{(pid=126595) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 10 17:58:39.067907 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=16,nova_api:INSERT=6 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:58:39.147825 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8d7b0ea0-7d9a-46b0-9c99-83c06883a5b9 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.110847 Jun 10 17:58:39.149751 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 197/374] 10.222.0.35 () {60 vars in 1163 bytes} [Fri Jun 10 17:58:39 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:39.156727 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6987109c-8d4b-4bc5-bc6b-a1a09d6f6e57 tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:39.159876 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6987109c-8d4b-4bc5-bc6b-a1a09d6f6e57 tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] Request method failure captured: Jun 10 17:58:39.159876 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b/action HTTP/1.1 Jun 10 17:58:39.159876 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 17:58:39.159876 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 17:58:39.159876 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 17:58:39.159876 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 39 Jun 10 17:58:39.159876 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 17:58:39.159876 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 17:58:39.159876 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 17:58:39.159876 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:39.159876 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4YKuqC9TPdOwba3_U-DlKaD_Tm-ihGW8grI5lIHxmym7uoFeB5qbOKhqOOc-9WI7TUnA6n-svah13iRmntShUpUU7Ib7eBSHN0eeNRYcPCXmbt0Adg_N5IrD8Bml-KbTUb2mgMFU1hOuTfkt482IM6GO78GY4atbPF7EuUxiQKdtoo Jun 10 17:58:39.159876 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 17:58:39.159876 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 17:58:39.159876 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 17:58:39.159876 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 17:58:39.159876 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 17:58:39.159876 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 17:58:39.159876 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: f92204f48d1a43cdb934f3ca14a24023 Jun 10 17:58:39.159876 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2078648386 Jun 10 17:58:39.159876 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member,admin Jun 10 17:58:39.159876 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member,admin Jun 10 17:58:39.161427 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/f92204f48d1a43cdb934f3ca14a24023"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/f92204f48d1a43cdb934f3ca14a24023"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/f92204f48d1a43cdb934f3ca14a24023"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_f92204f48d1a43cdb934f3ca14a24023", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:39.161427 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2078648386 Jun 10 17:58:39.161427 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: f92204f48d1a43cdb934f3ca14a24023 Jun 10 17:58:39.161427 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2078648386 Jun 10 17:58:39.161427 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersAdminNegativeTestJSON-2078648386-project-admin Jun 10 17:58:39.161427 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 17:58:39.161427 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 17:58:39.161427 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: cffa6dbd68044b73a5cf289b6110dd35 Jun 10 17:58:39.161427 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2078648386-project-admin Jun 10 17:58:39.161427 chdv-master-2 devstack@n-api.service[126595]: Jun 10 17:58:39.161427 chdv-master-2 devstack@n-api.service[126595]: {"os-resetState": {"state": "invalid"}} Jun 10 17:58:39.161427 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 17:58:39.162221 chdv-master-2 devstack@n-api.service[126595]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jun 10 17:58:39.162221 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'c9b75acf-e4fe-425e-9398-40c4ac1a108b', 'body': {'os-resetState': {'state': 'invalid'}}} Jun 10 17:58:39.162221 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:39.162221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:39.162221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 10 17:58:39.162221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 10 17:58:39.162221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 10 17:58:39.162221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise error Jun 10 17:58:39.162221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Jun 10 17:58:39.162221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:39.162221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Jun 10 17:58:39.162221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jun 10 17:58:39.162221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:39.162221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jun 10 17:58:39.162221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 'invalid' Jun 10 17:58:39.162221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:39.162221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:39.162221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:39.162221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:39.162221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:39.162221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:39.162221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:39.164061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:39.164061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:39.164061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:39.164061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 10 17:58:39.164061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 10 17:58:39.164061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 10 17:58:39.164061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 10 17:58:39.164061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 10 17:58:39.164061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 10 17:58:39.164061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jun 10 17:58:39.164061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:39.164061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:39.164061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:39.164061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:39.164061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:39.164061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:39.164061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 10 17:58:39.164061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 10 17:58:39.164061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jun 10 17:58:39.166738 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:39.172450 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6987109c-8d4b-4bc5-bc6b-a1a09d6f6e57 tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:39.173615 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6987109c-8d4b-4bc5-bc6b-a1a09d6f6e57 tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] 10.222.0.35 "POST /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b/action" status: 400 len: 144 microversion: 2.1 time: 0.022464 Jun 10 17:58:39.175190 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 198/375] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 17:58:39 2022] POST /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b/action => generated 144 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 10 17:58:39.182165 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bfaa9860-7133-4ca0-b8fd-723863501906 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:39.194148 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ed77729b-dccd-440f-abc8-200ee58952ca tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:39.201800 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ed77729b-dccd-440f-abc8-200ee58952ca tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed" status: 200 len: 1320 microversion: 2.1 time: 0.245836 Jun 10 17:58:39.202943 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 178/376] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:38 2022] GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed => generated 1320 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:39.216007 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bfaa9860-7133-4ca0-b8fd-723863501906 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.038971 Jun 10 17:58:39.216220 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8ef96b88-1a38-4299-976d-ed7f8db2ab25 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:39.217512 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:39.217512 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:39.217749 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 199/377] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 17:58:39 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:39.224985 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f187c8fd-9ece-4517-a555-1b35311bcb01 tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:39.227696 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f187c8fd-9ece-4517-a555-1b35311bcb01 tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] Request method failure captured: Jun 10 17:58:39.227696 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b/action HTTP/1.1 Jun 10 17:58:39.227696 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 17:58:39.227696 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 17:58:39.227696 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 17:58:39.227696 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 31 Jun 10 17:58:39.227696 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 17:58:39.227696 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 17:58:39.227696 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 17:58:39.227696 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:39.227696 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4YKuqC9TPdOwba3_U-DlKaD_Tm-ihGW8grI5lIHxmym7uoFeB5qbOKhqOOc-9WI7TUnA6n-svah13iRmntShUpUU7Ib7eBSHN0eeNRYcPCXmbt0Adg_N5IrD8Bml-KbTUb2mgMFU1hOuTfkt482IM6GO78GY4atbPF7EuUxiQKdtoo Jun 10 17:58:39.227696 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 17:58:39.227696 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 17:58:39.227696 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 17:58:39.227696 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 17:58:39.227696 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 17:58:39.227696 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 17:58:39.227696 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: f92204f48d1a43cdb934f3ca14a24023 Jun 10 17:58:39.227696 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2078648386 Jun 10 17:58:39.227696 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member,admin Jun 10 17:58:39.227696 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member,admin Jun 10 17:58:39.229226 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/f92204f48d1a43cdb934f3ca14a24023"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/f92204f48d1a43cdb934f3ca14a24023"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/f92204f48d1a43cdb934f3ca14a24023"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_f92204f48d1a43cdb934f3ca14a24023", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:39.229226 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2078648386 Jun 10 17:58:39.229226 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: f92204f48d1a43cdb934f3ca14a24023 Jun 10 17:58:39.229226 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2078648386 Jun 10 17:58:39.229226 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersAdminNegativeTestJSON-2078648386-project-admin Jun 10 17:58:39.229226 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 17:58:39.229226 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 17:58:39.229226 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: cffa6dbd68044b73a5cf289b6110dd35 Jun 10 17:58:39.229226 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2078648386-project-admin Jun 10 17:58:39.229226 chdv-master-2 devstack@n-api.service[126595]: Jun 10 17:58:39.229226 chdv-master-2 devstack@n-api.service[126595]: {"os-resetState": {"state": 1}} Jun 10 17:58:39.229226 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 17:58:39.229226 chdv-master-2 devstack@n-api.service[126595]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jun 10 17:58:39.230074 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'c9b75acf-e4fe-425e-9398-40c4ac1a108b', 'body': {'os-resetState': {'state': 1}}} Jun 10 17:58:39.230074 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:39.230074 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:39.230074 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 10 17:58:39.230074 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 10 17:58:39.230074 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 10 17:58:39.230074 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise error Jun 10 17:58:39.230074 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Jun 10 17:58:39.230074 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:39.230074 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Jun 10 17:58:39.230074 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jun 10 17:58:39.230074 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:39.230074 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jun 10 17:58:39.230074 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 1 Jun 10 17:58:39.230074 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:39.230074 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:39.230074 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:39.230074 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:39.230074 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:39.230074 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:39.230074 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:39.230074 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:39.231607 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:39.231607 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:39.231607 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 10 17:58:39.231607 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 10 17:58:39.231607 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 10 17:58:39.231607 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 10 17:58:39.231607 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 10 17:58:39.231607 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 10 17:58:39.231607 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jun 10 17:58:39.231607 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:39.231607 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:39.231607 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:39.231607 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:39.231607 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:39.231607 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:39.231607 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 10 17:58:39.231607 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 10 17:58:39.231607 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jun 10 17:58:39.231607 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:39.232841 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f187c8fd-9ece-4517-a555-1b35311bcb01 tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:39.232841 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f187c8fd-9ece-4517-a555-1b35311bcb01 tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] 10.222.0.35 "POST /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b/action" status: 400 len: 120 microversion: 2.1 time: 0.008986 Jun 10 17:58:39.232841 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 200/378] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 17:58:39 2022] POST /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b/action => generated 120 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 10 17:58:39.235995 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-53070f98-6447-4810-82c8-43453ed6e0a8 tempest-FlavorsAdminTestJSON-1486277192 tempest-FlavorsAdminTestJSON-1486277192-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:39.243715 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8ef96b88-1a38-4299-976d-ed7f8db2ab25 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:39.244663 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8ef96b88-1a38-4299-976d-ed7f8db2ab25 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:39.255076 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8ef96b88-1a38-4299-976d-ed7f8db2ab25 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:39.255761 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8ef96b88-1a38-4299-976d-ed7f8db2ab25 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:39.260957 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-53070f98-6447-4810-82c8-43453ed6e0a8 tempest-FlavorsAdminTestJSON-1486277192 tempest-FlavorsAdminTestJSON-1486277192-project] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.028405 Jun 10 17:58:39.272388 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 201/379] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 17:58:39 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:39.272388 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ce2d7fcb-b05a-4773-b6a8-4d118dad5da8 tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:39.272388 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ce2d7fcb-b05a-4773-b6a8-4d118dad5da8 tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] Failed to fetch instance by id 999 {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 10 17:58:39.272388 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-ce2d7fcb-b05a-4773-b6a8-4d118dad5da8 tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] HTTP exception thrown: Instance 999 could not be found. Jun 10 17:58:39.272388 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ce2d7fcb-b05a-4773-b6a8-4d118dad5da8 tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] Request method failure captured: Jun 10 17:58:39.272388 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Jun 10 17:58:39.272388 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 17:58:39.272388 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 17:58:39.272388 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 17:58:39.272388 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 37 Jun 10 17:58:39.272388 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 17:58:39.272388 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 17:58:39.272388 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 17:58:39.272388 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:39.273725 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4YKuqC9TPdOwba3_U-DlKaD_Tm-ihGW8grI5lIHxmym7uoFeB5qbOKhqOOc-9WI7TUnA6n-svah13iRmntShUpUU7Ib7eBSHN0eeNRYcPCXmbt0Adg_N5IrD8Bml-KbTUb2mgMFU1hOuTfkt482IM6GO78GY4atbPF7EuUxiQKdtoo Jun 10 17:58:39.273725 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 17:58:39.273725 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 17:58:39.273725 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 17:58:39.273725 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 17:58:39.273725 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 17:58:39.273725 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 17:58:39.273725 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: f92204f48d1a43cdb934f3ca14a24023 Jun 10 17:58:39.273725 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2078648386 Jun 10 17:58:39.273725 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member,admin Jun 10 17:58:39.273725 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member,admin Jun 10 17:58:39.273725 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/f92204f48d1a43cdb934f3ca14a24023"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/f92204f48d1a43cdb934f3ca14a24023"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/f92204f48d1a43cdb934f3ca14a24023"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_f92204f48d1a43cdb934f3ca14a24023", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:39.273725 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2078648386 Jun 10 17:58:39.273725 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: f92204f48d1a43cdb934f3ca14a24023 Jun 10 17:58:39.273725 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2078648386 Jun 10 17:58:39.274699 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersAdminNegativeTestJSON-2078648386-project-admin Jun 10 17:58:39.274699 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 17:58:39.274699 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 17:58:39.274699 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: cffa6dbd68044b73a5cf289b6110dd35 Jun 10 17:58:39.274699 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2078648386-project-admin Jun 10 17:58:39.274699 chdv-master-2 devstack@n-api.service[126595]: Jun 10 17:58:39.274699 chdv-master-2 devstack@n-api.service[126595]: {"os-resetState": {"state": "error"}} Jun 10 17:58:39.274699 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 17:58:39.274699 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 999 could not be found. Jun 10 17:58:39.274699 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Jun 10 17:58:39.274699 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:39.274699 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:39.274699 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 17:58:39.274699 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 17:58:39.274699 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 10 17:58:39.274699 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 10 17:58:39.274699 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jun 10 17:58:39.274699 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:39.274699 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:39.274699 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:39.274699 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:39.274699 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:39.274699 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:39.274699 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:39.274699 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:39.276288 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:39.276288 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:39.276288 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 17:58:39.276288 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 17:58:39.276288 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Jun 10 17:58:39.276288 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 10 17:58:39.276288 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 17:58:39.276288 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 17:58:39.276288 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jun 10 17:58:39.276288 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:39.276288 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:39.276288 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:39.276288 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:39.276288 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:39.276288 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:39.276288 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:58:39.276288 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:58:39.276288 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jun 10 17:58:39.276288 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:39.282932 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ce2d7fcb-b05a-4773-b6a8-4d118dad5da8 tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:39.282932 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ce2d7fcb-b05a-4773-b6a8-4d118dad5da8 tempest-ServersAdminNegativeTestJSON-2078648386 tempest-ServersAdminNegativeTestJSON-2078648386-project-admin] 10.222.0.35 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.009448 Jun 10 17:58:39.282932 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 202/380] 10.222.0.35 () {60 vars in 1178 bytes} [Fri Jun 10 17:58:39 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 10 17:58:39.283149 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.compute.aggregates [None req-8ef96b88-1a38-4299-976d-ed7f8db2ab25 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jun 10 17:58:39.283149 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-8ef96b88-1a38-4299-976d-ed7f8db2ab25 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Jun 10 17:58:39.283321 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8d4881a5-360c-4853-a523-13dc9d12d633 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:39.283321 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:39.283321 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:39.284534 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8ef96b88-1a38-4299-976d-ed7f8db2ab25 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Request method failure captured: Jun 10 17:58:39.284534 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Jun 10 17:58:39.284534 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 17:58:39.284534 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 17:58:39.284534 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 17:58:39.284534 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 42 Jun 10 17:58:39.284534 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 17:58:39.284534 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 17:58:39.284534 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 17:58:39.284534 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:39.284534 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4ZFz0KdVnU1lcsDgo7J7PulfDhlfFCGBade5DzcMDutpV6FqhJYlPbPs_6qX_VdmuZG1a4iBKDkZJe9m2UCDR4JW-ewpd3IgNZWlW18KPhJzNyqaz2Ql-B0FdRoYWMo5rsVLpu5R7Qszt44Be7Xdf2U5ZMw145OJsXH2oBakItvRq0 Jun 10 17:58:39.284534 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 17:58:39.284534 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 17:58:39.284534 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 17:58:39.284534 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 17:58:39.284534 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 17:58:39.284534 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 17:58:39.284534 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 7e0674a64c9c4427900f9ef11f4e4573 Jun 10 17:58:39.284534 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1915501983 Jun 10 17:58:39.284534 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member,admin Jun 10 17:58:39.284534 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member,admin Jun 10 17:58:39.295705 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/7e0674a64c9c4427900f9ef11f4e4573"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e0674a64c9c4427900f9ef11f4e4573"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e0674a64c9c4427900f9ef11f4e4573"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_7e0674a64c9c4427900f9ef11f4e4573", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:39.295705 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1915501983 Jun 10 17:58:39.295705 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 7e0674a64c9c4427900f9ef11f4e4573 Jun 10 17:58:39.295705 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1915501983 Jun 10 17:58:39.295705 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin Jun 10 17:58:39.295705 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 17:58:39.295705 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 17:58:39.295705 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 597438863f814f7faf9f9df5784e2341 Jun 10 17:58:39.295705 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin Jun 10 17:58:39.295705 chdv-master-2 devstack@n-api.service[126594]: Jun 10 17:58:39.295705 chdv-master-2 devstack@n-api.service[126594]: {"remove_host": {"host": "nonexist_host"}} Jun 10 17:58:39.295705 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 17:58:39.295705 chdv-master-2 devstack@n-api.service[126594]: exception: Cannot remove host nonexist_host in aggregate 18 Jun 10 17:58:39.296760 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Jun 10 17:58:39.296760 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:39.296760 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:39.296760 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jun 10 17:58:39.296760 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jun 10 17:58:39.296760 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 17:58:39.296760 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 17:58:39.296760 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 10 17:58:39.296760 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 10 17:58:39.296760 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 10 17:58:39.296760 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 10 17:58:39.296760 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 10 17:58:39.296760 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 10 17:58:39.296760 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Jun 10 17:58:39.296760 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:39.296760 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:39.296760 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:39.296760 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:39.296760 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jun 10 17:58:39.296760 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jun 10 17:58:39.299316 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jun 10 17:58:39.299316 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jun 10 17:58:39.299316 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jun 10 17:58:39.299316 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:39.299316 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:39.299316 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:39.299316 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:39.299316 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Jun 10 17:58:39.299316 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Jun 10 17:58:39.299316 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 10 17:58:39.299316 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 10 17:58:39.299316 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 17:58:39.299316 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 17:58:39.299316 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 17:58:39.299316 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 17:58:39.299316 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 10 17:58:39.299316 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 10 17:58:39.299316 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6555, in remove_host_from_aggregate Jun 10 17:58:39.299316 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Jun 10 17:58:39.299316 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jun 10 17:58:39.302627 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jun 10 17:58:39.302627 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jun 10 17:58:39.302627 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:39.302627 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:39.302627 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:39.302627 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:39.302627 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:39.302627 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:39.302627 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:39.302627 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:39.302627 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:39.302627 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:39.302627 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 17:58:39.302627 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 17:58:39.302627 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Jun 10 17:58:39.302627 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 10 17:58:39.302627 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Jun 10 17:58:39.302627 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:39.302627 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:39.302627 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:39.302627 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:39.305885 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:39.305885 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:39.305885 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:58:39.305885 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:58:39.305885 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Jun 10 17:58:39.305885 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:39.305885 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8ef96b88-1a38-4299-976d-ed7f8db2ab25 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:39.305885 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8ef96b88-1a38-4299-976d-ed7f8db2ab25 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.073638 Jun 10 17:58:39.305885 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 179/381] 10.222.0.35 () {60 vars in 1193 bytes} [Fri Jun 10 17:58:39 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 10 17:58:39.307216 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-42454fba-48f9-4ef2-9c2d-e0fd3140d989 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:39.307216 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-42454fba-48f9-4ef2-9c2d-e0fd3140d989 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: 2814abaf-90ac-4439-b500-df1bd532b1bd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:39.309500 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-42454fba-48f9-4ef2-9c2d-e0fd3140d989 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:39.309962 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-42454fba-48f9-4ef2-9c2d-e0fd3140d989 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:39.311276 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-42454fba-48f9-4ef2-9c2d-e0fd3140d989 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:39.311514 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-42454fba-48f9-4ef2-9c2d-e0fd3140d989 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:39.338537 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-42454fba-48f9-4ef2-9c2d-e0fd3140d989 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: 2814abaf-90ac-4439-b500-df1bd532b1bd] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 17:58:39.408006 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8d4881a5-360c-4853-a523-13dc9d12d633 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "DELETE /compute/v2.1/flavors/1738436262" status: 202 len: 0 microversion: 2.1 time: 0.131793 Jun 10 17:58:39.408634 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 203/382] 10.222.0.35 () {58 vars in 1160 bytes} [Fri Jun 10 17:58:39 2022] DELETE /compute/v2.1/flavors/1738436262 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 17:58:39.417292 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c5e9663e-6118-41ec-9fb9-8a52f10aed35 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:39.417292 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:39.417292 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:39.627788 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c5e9663e-6118-41ec-9fb9-8a52f10aed35 tempest-AggregatesAdminNegativeTestJSON-1915501983 tempest-AggregatesAdminNegativeTestJSON-1915501983-project-admin] 10.222.0.35 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.217536 Jun 10 17:58:39.628973 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 204/383] 10.222.0.35 () {58 vars in 1154 bytes} [Fri Jun 10 17:58:39 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 10 17:58:39.633689 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6f359e60-8824-49d0-a298-77a14c62c350 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:39.664209 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6f359e60-8824-49d0-a298-77a14c62c350 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.033785 Jun 10 17:58:39.672005 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 205/384] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 17:58:39 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:39.672005 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9b5e3a90-fb81-46d6-a738-d8d4667bcb80 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:39.672005 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9b5e3a90-fb81-46d6-a738-d8d4667bcb80 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] [instance: 2b47ecdd-b178-49f2-a28f-bdedb4771918] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:39.686141 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b5e3a90-fb81-46d6-a738-d8d4667bcb80 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:39.689822 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b5e3a90-fb81-46d6-a738-d8d4667bcb80 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:39.691507 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b5e3a90-fb81-46d6-a738-d8d4667bcb80 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:39.692169 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b5e3a90-fb81-46d6-a738-d8d4667bcb80 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:39.743781 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-42454fba-48f9-4ef2-9c2d-e0fd3140d989 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "DELETE /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd" status: 204 len: 0 microversion: 2.1 time: 0.455645 Jun 10 17:58:39.744517 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 180/385] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 17:58:39 2022] DELETE /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 17:58:39.751877 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d33c0f9d-6dc1-4ae3-bbeb-8e5ead0515a6 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1271769236", "id": 1328649395, "os-flavor-access:is_public": "True"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:39.753592 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:39.753592 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:39.825442 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d33c0f9d-6dc1-4ae3-bbeb-8e5ead0515a6 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.079492 Jun 10 17:58:39.826439 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 181/386] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:58:39 2022] POST /compute/v2.1/flavors => generated 414 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:39.835593 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-24b4fd44-8be3-46c6-acfa-7599465edc4b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:39.836341 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-24b4fd44-8be3-46c6-acfa-7599465edc4b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: 2814abaf-90ac-4439-b500-df1bd532b1bd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:39.839646 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:DELETE=10,nova_api:SELECT=83,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:58:39.843971 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-24b4fd44-8be3-46c6-acfa-7599465edc4b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:39.844781 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-24b4fd44-8be3-46c6-acfa-7599465edc4b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:39.845750 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-24b4fd44-8be3-46c6-acfa-7599465edc4b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:39.846195 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-24b4fd44-8be3-46c6-acfa-7599465edc4b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:39.982923 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9b5e3a90-fb81-46d6-a738-d8d4667bcb80 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6942ee76c6e4b16a9ea45d595084df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cef3679b5a47e48376197d17220e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:40.007583 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9b5e3a90-fb81-46d6-a738-d8d4667bcb80 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] 10.222.0.35 "GET /compute/v2.1/servers/2b47ecdd-b178-49f2-a28f-bdedb4771918" status: 200 len: 1323 microversion: 2.1 time: 0.331757 Jun 10 17:58:40.046007 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 206/387] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:39 2022] GET /compute/v2.1/servers/2b47ecdd-b178-49f2-a28f-bdedb4771918 => generated 1323 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:40.063843 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e8c87719-c877-47d2-8811-506a2d8cf8f0 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:40.069205 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e8c87719-c877-47d2-8811-506a2d8cf8f0 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: 95e3fefa-48f8-42be-95a1-a58e3980db9b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:40.089416 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e8c87719-c877-47d2-8811-506a2d8cf8f0 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:40.090135 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e8c87719-c877-47d2-8811-506a2d8cf8f0 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:40.090930 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e8c87719-c877-47d2-8811-506a2d8cf8f0 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:40.091371 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e8c87719-c877-47d2-8811-506a2d8cf8f0 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:40.201571 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-24b4fd44-8be3-46c6-acfa-7599465edc4b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:40.230878 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-24b4fd44-8be3-46c6-acfa-7599465edc4b tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd" status: 200 len: 1469 microversion: 2.1 time: 0.402960 Jun 10 17:58:40.241507 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 182/388] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:39 2022] GET /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd => generated 1469 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:40.262996 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e50d4548-4a71-4241-a43f-e55c550505e7 tempest-FlavorsAdminTestJSON-1486277192 tempest-FlavorsAdminTestJSON-1486277192-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:40.320707 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e50d4548-4a71-4241-a43f-e55c550505e7 tempest-FlavorsAdminTestJSON-1486277192 tempest-FlavorsAdminTestJSON-1486277192-project] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 6218 microversion: 2.1 time: 0.077829 Jun 10 17:58:40.345350 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 183/389] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 17:58:40 2022] GET /compute/v2.1/flavors/detail => generated 6218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:40.354963 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-6c4bda96-4eb2-435f-bb44-edb8f1beb6fc req-bf2db5d4-bfb7-41e5-9b24-4dfa65081217 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fcc6103-9ecc-42f4-9df8-ac2251f06eed", "name": "network-vif-plugged", "status": "completed", "tag": "4b121ede-995c-48cf-bc4f-79b98d59e314"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:40.357372 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e8c87719-c877-47d2-8811-506a2d8cf8f0 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19776e5adf942c6a20e4dea1aa10cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1fd6bd677ff4b17bafee8fad1d720a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:40.367003 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e8c87719-c877-47d2-8811-506a2d8cf8f0 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b" status: 200 len: 1318 microversion: 2.1 time: 0.318042 Jun 10 17:58:40.367135 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-6c4bda96-4eb2-435f-bb44-edb8f1beb6fc req-bf2db5d4-bfb7-41e5-9b24-4dfa65081217 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:40.367235 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 207/390] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:40 2022] GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b => generated 1318 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:40.367805 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-6c4bda96-4eb2-435f-bb44-edb8f1beb6fc req-bf2db5d4-bfb7-41e5-9b24-4dfa65081217 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:40.378347 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b58e17be-4516-4fe9-b5ad-aca80ec64ce3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:40.380526 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b58e17be-4516-4fe9-b5ad-aca80ec64ce3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 1fcc6103-9ecc-42f4-9df8-ac2251f06eed] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:40.385138 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-6c4bda96-4eb2-435f-bb44-edb8f1beb6fc req-bf2db5d4-bfb7-41e5-9b24-4dfa65081217 service nova] Creating event network-vif-plugged:4b121ede-995c-48cf-bc4f-79b98d59e314 for instance 1fcc6103-9ecc-42f4-9df8-ac2251f06eed on chh2-master-2 Jun 10 17:58:40.392589 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-6c4bda96-4eb2-435f-bb44-edb8f1beb6fc req-bf2db5d4-bfb7-41e5-9b24-4dfa65081217 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045291 Jun 10 17:58:40.394462 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 184/391] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:40.395846 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b58e17be-4516-4fe9-b5ad-aca80ec64ce3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:40.396391 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b58e17be-4516-4fe9-b5ad-aca80ec64ce3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:40.397235 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b58e17be-4516-4fe9-b5ad-aca80ec64ce3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:40.397738 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b58e17be-4516-4fe9-b5ad-aca80ec64ce3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:40.401351 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8cc42723-05dc-4e7e-9e4a-b5b50141122b tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:40.402367 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:40.402367 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:40.513153 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8cc42723-05dc-4e7e-9e4a-b5b50141122b tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "DELETE /compute/v2.1/flavors/1328649395" status: 202 len: 0 microversion: 2.1 time: 0.117248 Jun 10 17:58:40.514305 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 185/392] 10.222.0.35 () {58 vars in 1160 bytes} [Fri Jun 10 17:58:40 2022] DELETE /compute/v2.1/flavors/1328649395 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 17:58:40.524561 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5ad677cf-b00a-440f-82bb-34920a8e6e32 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:40.555641 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5ad677cf-b00a-440f-82bb-34920a8e6e32 tempest-FlavorsAdminTestJSON-1412980721 tempest-FlavorsAdminTestJSON-1412980721-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.036556 Jun 10 17:58:40.557562 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 186/393] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 17:58:40 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:58:40.670323 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b58e17be-4516-4fe9-b5ad-aca80ec64ce3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:40.681173 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b58e17be-4516-4fe9-b5ad-aca80ec64ce3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed" status: 200 len: 1320 microversion: 2.1 time: 0.309659 Jun 10 17:58:40.682427 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 208/394] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:40 2022] GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed => generated 1320 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:41.025931 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3092d981-73e9-4d2c-aaf3-2a8deb66d978 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:41.026660 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3092d981-73e9-4d2c-aaf3-2a8deb66d978 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] [instance: 2b47ecdd-b178-49f2-a28f-bdedb4771918] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:41.034661 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3092d981-73e9-4d2c-aaf3-2a8deb66d978 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:41.036010 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3092d981-73e9-4d2c-aaf3-2a8deb66d978 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:41.036838 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3092d981-73e9-4d2c-aaf3-2a8deb66d978 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:41.037438 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3092d981-73e9-4d2c-aaf3-2a8deb66d978 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:41.081576 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-6c34934a-fe0f-4dda-be85-df6f4208e2d1 req-6c00e890-f4a2-424c-b25f-f5b1dad23246 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b47ecdd-b178-49f2-a28f-bdedb4771918", "tag": "9943d602-d3c6-4e99-a0ca-ddc9ea5df28b"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:41.098174 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-6c34934a-fe0f-4dda-be85-df6f4208e2d1 req-6c00e890-f4a2-424c-b25f-f5b1dad23246 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:41.098960 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-6c34934a-fe0f-4dda-be85-df6f4208e2d1 req-6c00e890-f4a2-424c-b25f-f5b1dad23246 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:41.103247 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:58:41.144957 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-6c34934a-fe0f-4dda-be85-df6f4208e2d1 req-6c00e890-f4a2-424c-b25f-f5b1dad23246 service nova] Creating event network-changed:9943d602-d3c6-4e99-a0ca-ddc9ea5df28b for instance 2b47ecdd-b178-49f2-a28f-bdedb4771918 on chh1-master-2 Jun 10 17:58:41.168645 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-6c34934a-fe0f-4dda-be85-df6f4208e2d1 req-6c00e890-f4a2-424c-b25f-f5b1dad23246 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083505 Jun 10 17:58:41.170632 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 209/395] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 17:58:41.251829 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-10fc730f-a52b-4faa-a2f6-9f57757df323 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:41.252602 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-10fc730f-a52b-4faa-a2f6-9f57757df323 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: 2814abaf-90ac-4439-b500-df1bd532b1bd] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:41.268128 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10fc730f-a52b-4faa-a2f6-9f57757df323 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:41.268691 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10fc730f-a52b-4faa-a2f6-9f57757df323 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:41.269532 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10fc730f-a52b-4faa-a2f6-9f57757df323 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:41.271144 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10fc730f-a52b-4faa-a2f6-9f57757df323 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:41.691738 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-10fc730f-a52b-4faa-a2f6-9f57757df323 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:41.707019 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-10fc730f-a52b-4faa-a2f6-9f57757df323 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd" status: 200 len: 1469 microversion: 2.1 time: 0.459956 Jun 10 17:58:41.716724 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 210/396] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:41 2022] GET /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd => generated 1469 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:41.726051 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8bb4d7f3-7d48-4cff-b62d-e07c123de52b tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:41.726874 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8bb4d7f3-7d48-4cff-b62d-e07c123de52b tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: 95e3fefa-48f8-42be-95a1-a58e3980db9b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:41.737101 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8bb4d7f3-7d48-4cff-b62d-e07c123de52b tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:41.740517 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8bb4d7f3-7d48-4cff-b62d-e07c123de52b tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:41.742516 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8bb4d7f3-7d48-4cff-b62d-e07c123de52b tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:41.744095 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8bb4d7f3-7d48-4cff-b62d-e07c123de52b tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:41.756293 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3092d981-73e9-4d2c-aaf3-2a8deb66d978 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6942ee76c6e4b16a9ea45d595084df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cef3679b5a47e48376197d17220e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:41.777439 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3092d981-73e9-4d2c-aaf3-2a8deb66d978 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] 10.222.0.35 "GET /compute/v2.1/servers/2b47ecdd-b178-49f2-a28f-bdedb4771918" status: 200 len: 1323 microversion: 2.1 time: 0.752838 Jun 10 17:58:41.779572 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 187/397] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:41 2022] GET /compute/v2.1/servers/2b47ecdd-b178-49f2-a28f-bdedb4771918 => generated 1323 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:41.795225 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1412fc9e-7a1c-4efd-997b-6dbc5613f3ec tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:41.797493 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1412fc9e-7a1c-4efd-997b-6dbc5613f3ec tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 1fcc6103-9ecc-42f4-9df8-ac2251f06eed] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:41.805066 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1412fc9e-7a1c-4efd-997b-6dbc5613f3ec tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:41.806166 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1412fc9e-7a1c-4efd-997b-6dbc5613f3ec tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:41.807589 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1412fc9e-7a1c-4efd-997b-6dbc5613f3ec tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:41.808425 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1412fc9e-7a1c-4efd-997b-6dbc5613f3ec tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:42.010919 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8bb4d7f3-7d48-4cff-b62d-e07c123de52b tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19776e5adf942c6a20e4dea1aa10cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1fd6bd677ff4b17bafee8fad1d720a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:42.024375 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8bb4d7f3-7d48-4cff-b62d-e07c123de52b tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b" status: 200 len: 1318 microversion: 2.1 time: 0.306086 Jun 10 17:58:42.025630 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 211/398] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:41 2022] GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b => generated 1318 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:42.229072 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1412fc9e-7a1c-4efd-997b-6dbc5613f3ec tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:42.241092 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1412fc9e-7a1c-4efd-997b-6dbc5613f3ec tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed" status: 200 len: 1320 microversion: 2.1 time: 0.458548 Jun 10 17:58:42.241860 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 188/399] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:41 2022] GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed => generated 1320 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:42.724888 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3441b977-2c77-4fcf-bbac-cad7e771d83a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:42.725500 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3441b977-2c77-4fcf-bbac-cad7e771d83a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: 2814abaf-90ac-4439-b500-df1bd532b1bd] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:42.737605 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3441b977-2c77-4fcf-bbac-cad7e771d83a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:42.738158 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3441b977-2c77-4fcf-bbac-cad7e771d83a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:42.739170 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3441b977-2c77-4fcf-bbac-cad7e771d83a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:42.739619 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3441b977-2c77-4fcf-bbac-cad7e771d83a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:42.796792 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3a6579b3-6de0-40e5-857a-030b1c64ee7e tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:42.797412 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3a6579b3-6de0-40e5-857a-030b1c64ee7e tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] [instance: 2b47ecdd-b178-49f2-a28f-bdedb4771918] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:42.811557 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3a6579b3-6de0-40e5-857a-030b1c64ee7e tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:42.826706 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3a6579b3-6de0-40e5-857a-030b1c64ee7e tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:42.828462 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3a6579b3-6de0-40e5-857a-030b1c64ee7e tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:42.828928 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3a6579b3-6de0-40e5-857a-030b1c64ee7e tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:42.954405 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3441b977-2c77-4fcf-bbac-cad7e771d83a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:42.985532 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3441b977-2c77-4fcf-bbac-cad7e771d83a tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd" status: 200 len: 1427 microversion: 2.1 time: 0.264333 Jun 10 17:58:42.990902 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 212/400] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:42 2022] GET /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd => generated 1427 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:43.044954 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f8c72305-5854-4612-b96e-b4ec360f75bb tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:43.048982 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f8c72305-5854-4612-b96e-b4ec360f75bb tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: 95e3fefa-48f8-42be-95a1-a58e3980db9b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:43.057627 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8c72305-5854-4612-b96e-b4ec360f75bb tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:43.060368 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8c72305-5854-4612-b96e-b4ec360f75bb tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:43.061179 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8c72305-5854-4612-b96e-b4ec360f75bb tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:43.063511 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8c72305-5854-4612-b96e-b4ec360f75bb tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:43.113703 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3a6579b3-6de0-40e5-857a-030b1c64ee7e tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6942ee76c6e4b16a9ea45d595084df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cef3679b5a47e48376197d17220e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:43.121604 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3a6579b3-6de0-40e5-857a-030b1c64ee7e tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] 10.222.0.35 "GET /compute/v2.1/servers/2b47ecdd-b178-49f2-a28f-bdedb4771918" status: 200 len: 1323 microversion: 2.1 time: 0.330645 Jun 10 17:58:43.122328 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 189/401] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:42 2022] GET /compute/v2.1/servers/2b47ecdd-b178-49f2-a28f-bdedb4771918 => generated 1323 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:43.204801 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-14be27e7-886a-405e-8e0d-485f7a8aa14b req-e01e915a-ce62-43da-bf5b-25b509b81f56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2814abaf-90ac-4439-b500-df1bd532b1bd", "name": "network-vif-deleted", "tag": "4aa7695e-b4b6-496c-9f4a-5dfdb701aebc"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:43.214259 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-14be27e7-886a-405e-8e0d-485f7a8aa14b req-e01e915a-ce62-43da-bf5b-25b509b81f56 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:43.214702 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-14be27e7-886a-405e-8e0d-485f7a8aa14b req-e01e915a-ce62-43da-bf5b-25b509b81f56 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:43.227148 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-14be27e7-886a-405e-8e0d-485f7a8aa14b req-e01e915a-ce62-43da-bf5b-25b509b81f56 service nova] Creating event network-vif-deleted:4aa7695e-b4b6-496c-9f4a-5dfdb701aebc for instance 2814abaf-90ac-4439-b500-df1bd532b1bd on chh1-master-2 Jun 10 17:58:43.233400 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-14be27e7-886a-405e-8e0d-485f7a8aa14b req-e01e915a-ce62-43da-bf5b-25b509b81f56 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032264 Jun 10 17:58:43.237378 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 190/402] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 17:58:43.258847 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6c34c228-a9c0-4ed3-b743-9160cf0b636e tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:43.259912 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6c34c228-a9c0-4ed3-b743-9160cf0b636e tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 1fcc6103-9ecc-42f4-9df8-ac2251f06eed] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:43.268287 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6c34c228-a9c0-4ed3-b743-9160cf0b636e tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:43.269213 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6c34c228-a9c0-4ed3-b743-9160cf0b636e tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:43.271935 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6c34c228-a9c0-4ed3-b743-9160cf0b636e tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:43.271935 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6c34c228-a9c0-4ed3-b743-9160cf0b636e tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:43.453687 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6c34c228-a9c0-4ed3-b743-9160cf0b636e tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:43.461731 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6c34c228-a9c0-4ed3-b743-9160cf0b636e tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed" status: 200 len: 1320 microversion: 2.1 time: 0.207599 Jun 10 17:58:43.462491 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 191/403] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:43 2022] GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed => generated 1320 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:43.534528 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f8c72305-5854-4612-b96e-b4ec360f75bb tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19776e5adf942c6a20e4dea1aa10cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1fd6bd677ff4b17bafee8fad1d720a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:43.542780 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f8c72305-5854-4612-b96e-b4ec360f75bb tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b" status: 200 len: 1318 microversion: 2.1 time: 0.504329 Jun 10 17:58:43.553606 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 213/404] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:43 2022] GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b => generated 1318 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:44.007049 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e9480185-0c45-43fa-be2b-8d3efdd103eb tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:44.007660 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e9480185-0c45-43fa-be2b-8d3efdd103eb tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: 2814abaf-90ac-4439-b500-df1bd532b1bd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:44.016026 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e9480185-0c45-43fa-be2b-8d3efdd103eb tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:44.016765 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e9480185-0c45-43fa-be2b-8d3efdd103eb tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:44.017706 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e9480185-0c45-43fa-be2b-8d3efdd103eb tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:44.018366 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e9480185-0c45-43fa-be2b-8d3efdd103eb tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:44.106805 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e9480185-0c45-43fa-be2b-8d3efdd103eb tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:44.116146 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e9480185-0c45-43fa-be2b-8d3efdd103eb tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd" status: 200 len: 1427 microversion: 2.1 time: 0.112972 Jun 10 17:58:44.123659 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 192/405] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:44 2022] GET /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd => generated 1427 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:44.139173 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f5451f6b-f7e8-4d90-92f2-9d4bd0473e5d tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:44.141090 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f5451f6b-f7e8-4d90-92f2-9d4bd0473e5d tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] [instance: 2b47ecdd-b178-49f2-a28f-bdedb4771918] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:44.143317 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=17 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:58:44.144014 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=45 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:58:44.158040 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f5451f6b-f7e8-4d90-92f2-9d4bd0473e5d tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:44.158498 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f5451f6b-f7e8-4d90-92f2-9d4bd0473e5d tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:44.159346 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f5451f6b-f7e8-4d90-92f2-9d4bd0473e5d tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:44.159813 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f5451f6b-f7e8-4d90-92f2-9d4bd0473e5d tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:44.315252 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f5451f6b-f7e8-4d90-92f2-9d4bd0473e5d tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6942ee76c6e4b16a9ea45d595084df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cef3679b5a47e48376197d17220e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:44.323197 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f5451f6b-f7e8-4d90-92f2-9d4bd0473e5d tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] 10.222.0.35 "GET /compute/v2.1/servers/2b47ecdd-b178-49f2-a28f-bdedb4771918" status: 200 len: 1323 microversion: 2.1 time: 0.188010 Jun 10 17:58:44.323703 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 214/406] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:44 2022] GET /compute/v2.1/servers/2b47ecdd-b178-49f2-a28f-bdedb4771918 => generated 1323 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:44.480273 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c7f8f3e5-ec5a-4a16-bfdf-4c970c28daf3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:44.481334 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c7f8f3e5-ec5a-4a16-bfdf-4c970c28daf3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 1fcc6103-9ecc-42f4-9df8-ac2251f06eed] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:44.488373 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c7f8f3e5-ec5a-4a16-bfdf-4c970c28daf3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:44.489085 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c7f8f3e5-ec5a-4a16-bfdf-4c970c28daf3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:44.489981 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c7f8f3e5-ec5a-4a16-bfdf-4c970c28daf3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:44.490759 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c7f8f3e5-ec5a-4a16-bfdf-4c970c28daf3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:44.569357 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-89ab4cb0-1e40-4b0f-bcac-1ce4a5fb348e tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:44.571052 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-89ab4cb0-1e40-4b0f-bcac-1ce4a5fb348e tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: 95e3fefa-48f8-42be-95a1-a58e3980db9b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:44.585465 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-89ab4cb0-1e40-4b0f-bcac-1ce4a5fb348e tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:44.585465 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-89ab4cb0-1e40-4b0f-bcac-1ce4a5fb348e tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:44.585465 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-89ab4cb0-1e40-4b0f-bcac-1ce4a5fb348e tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:44.586661 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-89ab4cb0-1e40-4b0f-bcac-1ce4a5fb348e tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:44.656675 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c7f8f3e5-ec5a-4a16-bfdf-4c970c28daf3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:44.668016 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c7f8f3e5-ec5a-4a16-bfdf-4c970c28daf3 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed" status: 200 len: 1470 microversion: 2.1 time: 0.190373 Jun 10 17:58:44.668016 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 193/407] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:44 2022] GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed => generated 1470 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:44.693042 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ff8eaa97-b74f-4440-9d4f-1e9449c269b3 tempest-DeleteServersAdminTestJSON-1379838124 tempest-DeleteServersAdminTestJSON-1379838124-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:44.694115 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ff8eaa97-b74f-4440-9d4f-1e9449c269b3 tempest-DeleteServersAdminTestJSON-1379838124 tempest-DeleteServersAdminTestJSON-1379838124-project-admin] [instance: 1fcc6103-9ecc-42f4-9df8-ac2251f06eed] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:44.702599 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ff8eaa97-b74f-4440-9d4f-1e9449c269b3 tempest-DeleteServersAdminTestJSON-1379838124 tempest-DeleteServersAdminTestJSON-1379838124-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:44.703055 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ff8eaa97-b74f-4440-9d4f-1e9449c269b3 tempest-DeleteServersAdminTestJSON-1379838124 tempest-DeleteServersAdminTestJSON-1379838124-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:44.703825 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ff8eaa97-b74f-4440-9d4f-1e9449c269b3 tempest-DeleteServersAdminTestJSON-1379838124 tempest-DeleteServersAdminTestJSON-1379838124-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:44.705006 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ff8eaa97-b74f-4440-9d4f-1e9449c269b3 tempest-DeleteServersAdminTestJSON-1379838124 tempest-DeleteServersAdminTestJSON-1379838124-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:44.757644 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-89ab4cb0-1e40-4b0f-bcac-1ce4a5fb348e tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19776e5adf942c6a20e4dea1aa10cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1fd6bd677ff4b17bafee8fad1d720a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:44.765993 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-89ab4cb0-1e40-4b0f-bcac-1ce4a5fb348e tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b" status: 200 len: 1318 microversion: 2.1 time: 0.208894 Jun 10 17:58:44.766566 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 215/408] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:44 2022] GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:45.024607 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ff8eaa97-b74f-4440-9d4f-1e9449c269b3 tempest-DeleteServersAdminTestJSON-1379838124 tempest-DeleteServersAdminTestJSON-1379838124-project-admin] 10.222.0.35 "POST /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed/action" status: 202 len: 0 microversion: 2.1 time: 0.345177 Jun 10 17:58:45.031109 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 194/409] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 17:58:44 2022] POST /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 17:58:45.040588 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-45067df0-abe5-44d7-980d-8d9d2476abfe tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:45.041470 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-45067df0-abe5-44d7-980d-8d9d2476abfe tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 1fcc6103-9ecc-42f4-9df8-ac2251f06eed] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:45.048792 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45067df0-abe5-44d7-980d-8d9d2476abfe tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:45.049220 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45067df0-abe5-44d7-980d-8d9d2476abfe tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:45.049996 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45067df0-abe5-44d7-980d-8d9d2476abfe tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:45.050429 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45067df0-abe5-44d7-980d-8d9d2476abfe tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:45.082593 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45067df0-abe5-44d7-980d-8d9d2476abfe tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:45.083245 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45067df0-abe5-44d7-980d-8d9d2476abfe tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:45.083697 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-45067df0-abe5-44d7-980d-8d9d2476abfe tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lazy-loading 'fault' on Instance uuid 1fcc6103-9ecc-42f4-9df8-ac2251f06eed {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 17:58:45.140551 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c8948834-819f-4e2d-a4f9-23b0f10a38c9 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:45.141168 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c8948834-819f-4e2d-a4f9-23b0f10a38c9 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: 2814abaf-90ac-4439-b500-df1bd532b1bd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:45.147181 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c8948834-819f-4e2d-a4f9-23b0f10a38c9 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:45.147623 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c8948834-819f-4e2d-a4f9-23b0f10a38c9 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:45.148541 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c8948834-819f-4e2d-a4f9-23b0f10a38c9 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:45.149153 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c8948834-819f-4e2d-a4f9-23b0f10a38c9 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:45.163998 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-c8948834-819f-4e2d-a4f9-23b0f10a38c9 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] HTTP exception thrown: Instance 2814abaf-90ac-4439-b500-df1bd532b1bd could not be found. Jun 10 17:58:45.165849 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c8948834-819f-4e2d-a4f9-23b0f10a38c9 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Request method failure captured: Jun 10 17:58:45.165849 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd HTTP/1.1 Jun 10 17:58:45.165849 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 17:58:45.165849 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 17:58:45.165849 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 17:58:45.165849 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 17:58:45.165849 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 17:58:45.165849 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 17:58:45.165849 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 17:58:45.165849 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:45.165849 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4YGEZD5boKKHpcl1a20bjbS6lQYO7AqpKAd9v-d1nMuTXtyQUeBH3XgkmBh1nPboKIHzN2xZti1tQDLoWAnMnxYPAJBzzBgmj44w7EhGheBHNa-o1GmH5VqiSfjuRCE1jg8rRmEmbqbZzs1FxTIxs_GQXP1taJlN0dzqdusw7pB0UU Jun 10 17:58:45.165849 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 17:58:45.165849 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 17:58:45.165849 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 17:58:45.165849 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 17:58:45.165849 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 17:58:45.165849 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 17:58:45.165849 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 141d09ed6e1548d996a675ec1f1011b7 Jun 10 17:58:45.165849 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1230602466 Jun 10 17:58:45.165849 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 17:58:45.165849 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 17:58:45.167285 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/141d09ed6e1548d996a675ec1f1011b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/141d09ed6e1548d996a675ec1f1011b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/141d09ed6e1548d996a675ec1f1011b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_141d09ed6e1548d996a675ec1f1011b7", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:45.167285 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1230602466 Jun 10 17:58:45.167285 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 141d09ed6e1548d996a675ec1f1011b7 Jun 10 17:58:45.167285 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1230602466 Jun 10 17:58:45.167285 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersAdminNegativeTestJSON-1230602466-project Jun 10 17:58:45.167285 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 17:58:45.167285 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 17:58:45.167285 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 0a75d420afea440fba308b4ed26fd544 Jun 10 17:58:45.167285 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1230602466-project Jun 10 17:58:45.167285 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 17:58:45.167285 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 2814abaf-90ac-4439-b500-df1bd532b1bd could not be found. Jun 10 17:58:45.167285 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '2814abaf-90ac-4439-b500-df1bd532b1bd'} Jun 10 17:58:45.168095 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:45.168095 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:45.168095 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 17:58:45.168095 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 17:58:45.168095 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 17:58:45.168095 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 17:58:45.168095 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 17:58:45.168095 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 17:58:45.168095 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 17:58:45.168095 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 17:58:45.168095 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2814abaf-90ac-4439-b500-df1bd532b1bd could not be found. Jun 10 17:58:45.168095 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:45.168095 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:45.168095 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:45.168095 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:45.168095 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:45.168095 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:45.168095 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:45.168095 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:45.168095 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:45.169455 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:45.169455 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 17:58:45.169455 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 17:58:45.169455 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 17:58:45.169455 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 17:58:45.169455 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 17:58:45.169455 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 17:58:45.169455 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2814abaf-90ac-4439-b500-df1bd532b1bd could not be found. Jun 10 17:58:45.169455 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:45.169455 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:45.169455 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:45.169455 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:45.169455 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:45.169455 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:45.169455 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:58:45.169455 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:58:45.169455 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2814abaf-90ac-4439-b500-df1bd532b1bd could not be found. Jun 10 17:58:45.169455 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:45.172604 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c8948834-819f-4e2d-a4f9-23b0f10a38c9 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Returning 404 to user: Instance 2814abaf-90ac-4439-b500-df1bd532b1bd could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:45.173630 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c8948834-819f-4e2d-a4f9-23b0f10a38c9 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd" status: 404 len: 111 microversion: 2.1 time: 0.036958 Jun 10 17:58:45.177739 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 195/410] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:45 2022] GET /compute/v2.1/servers/2814abaf-90ac-4439-b500-df1bd532b1bd => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:58:45.184846 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e1dd4fb5-0796-4a75-8f32-9cce776d50bd tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:45.185228 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e1dd4fb5-0796-4a75-8f32-9cce776d50bd tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: c9b75acf-e4fe-425e-9398-40c4ac1a108b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:45.191352 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e1dd4fb5-0796-4a75-8f32-9cce776d50bd tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:45.191804 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e1dd4fb5-0796-4a75-8f32-9cce776d50bd tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:45.192802 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e1dd4fb5-0796-4a75-8f32-9cce776d50bd tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:45.195386 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e1dd4fb5-0796-4a75-8f32-9cce776d50bd tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:45.209585 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:58:45.217490 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-45067df0-abe5-44d7-980d-8d9d2476abfe tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:45.220745 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e1dd4fb5-0796-4a75-8f32-9cce776d50bd tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: c9b75acf-e4fe-425e-9398-40c4ac1a108b] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 17:58:45.226019 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-45067df0-abe5-44d7-980d-8d9d2476abfe tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed" status: 200 len: 1453 microversion: 2.1 time: 0.189604 Jun 10 17:58:45.226700 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 216/411] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:45 2022] GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed => generated 1453 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:45.242987 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cfe5d3c6-a1c0-4d7c-bc3e-e7e84d991873 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:45.243482 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cfe5d3c6-a1c0-4d7c-bc3e-e7e84d991873 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 1fcc6103-9ecc-42f4-9df8-ac2251f06eed] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:45.249689 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cfe5d3c6-a1c0-4d7c-bc3e-e7e84d991873 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:45.250245 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cfe5d3c6-a1c0-4d7c-bc3e-e7e84d991873 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:45.250896 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cfe5d3c6-a1c0-4d7c-bc3e-e7e84d991873 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:45.251551 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cfe5d3c6-a1c0-4d7c-bc3e-e7e84d991873 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:45.283936 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cfe5d3c6-a1c0-4d7c-bc3e-e7e84d991873 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 1fcc6103-9ecc-42f4-9df8-ac2251f06eed] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 17:58:45.377064 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=5 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:58:45.526960 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e1dd4fb5-0796-4a75-8f32-9cce776d50bd tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "DELETE /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b" status: 204 len: 0 microversion: 2.1 time: 0.348006 Jun 10 17:58:45.527714 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 196/412] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 17:58:45 2022] DELETE /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 17:58:45.533372 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-dc3c3123-accf-42dc-a9cf-efa82a44000f tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:45.535235 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-dc3c3123-accf-42dc-a9cf-efa82a44000f tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] [instance: 2b47ecdd-b178-49f2-a28f-bdedb4771918] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:45.541357 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dc3c3123-accf-42dc-a9cf-efa82a44000f tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:45.541813 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dc3c3123-accf-42dc-a9cf-efa82a44000f tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:45.542587 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dc3c3123-accf-42dc-a9cf-efa82a44000f tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:45.543037 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dc3c3123-accf-42dc-a9cf-efa82a44000f tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:45.641525 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cfe5d3c6-a1c0-4d7c-bc3e-e7e84d991873 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "DELETE /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed" status: 204 len: 0 microversion: 2.1 time: 0.401960 Jun 10 17:58:45.642693 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 217/413] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 17:58:45 2022] DELETE /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 17:58:45.647649 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-535b03d7-7f27-4dc4-a31d-aaedf3eeb420 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:45.648574 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-535b03d7-7f27-4dc4-a31d-aaedf3eeb420 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: c9b75acf-e4fe-425e-9398-40c4ac1a108b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:45.656201 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-535b03d7-7f27-4dc4-a31d-aaedf3eeb420 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:45.656779 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-535b03d7-7f27-4dc4-a31d-aaedf3eeb420 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:45.657559 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-535b03d7-7f27-4dc4-a31d-aaedf3eeb420 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:45.658001 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-535b03d7-7f27-4dc4-a31d-aaedf3eeb420 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:45.720713 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-dc3c3123-accf-42dc-a9cf-efa82a44000f tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6942ee76c6e4b16a9ea45d595084df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cef3679b5a47e48376197d17220e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:45.728603 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-dc3c3123-accf-42dc-a9cf-efa82a44000f tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] 10.222.0.35 "GET /compute/v2.1/servers/2b47ecdd-b178-49f2-a28f-bdedb4771918" status: 200 len: 1323 microversion: 2.1 time: 0.199874 Jun 10 17:58:45.729364 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 197/414] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:45 2022] GET /compute/v2.1/servers/2b47ecdd-b178-49f2-a28f-bdedb4771918 => generated 1323 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:45.741583 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-90f95bde-71f9-4824-bdcf-a72376b53921 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:45.742190 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-90f95bde-71f9-4824-bdcf-a72376b53921 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 1fcc6103-9ecc-42f4-9df8-ac2251f06eed] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:45.753955 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90f95bde-71f9-4824-bdcf-a72376b53921 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:45.754973 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90f95bde-71f9-4824-bdcf-a72376b53921 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:45.755920 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90f95bde-71f9-4824-bdcf-a72376b53921 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:45.756544 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90f95bde-71f9-4824-bdcf-a72376b53921 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:45.800511 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90f95bde-71f9-4824-bdcf-a72376b53921 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:45.801078 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90f95bde-71f9-4824-bdcf-a72376b53921 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:45.801637 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-90f95bde-71f9-4824-bdcf-a72376b53921 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lazy-loading 'fault' on Instance uuid 1fcc6103-9ecc-42f4-9df8-ac2251f06eed {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 17:58:45.851029 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-535b03d7-7f27-4dc4-a31d-aaedf3eeb420 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:45.859203 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-535b03d7-7f27-4dc4-a31d-aaedf3eeb420 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b" status: 200 len: 1478 microversion: 2.1 time: 0.215830 Jun 10 17:58:45.859862 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 218/415] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:45 2022] GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b => generated 1478 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:45.864460 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f9b0f185-08eb-4d81-8395-c672e2223b47 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:45.865228 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f9b0f185-08eb-4d81-8395-c672e2223b47 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: 95e3fefa-48f8-42be-95a1-a58e3980db9b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:45.871393 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f9b0f185-08eb-4d81-8395-c672e2223b47 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:45.871999 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f9b0f185-08eb-4d81-8395-c672e2223b47 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:45.873065 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f9b0f185-08eb-4d81-8395-c672e2223b47 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:45.873397 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f9b0f185-08eb-4d81-8395-c672e2223b47 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:45.972622 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-90f95bde-71f9-4824-bdcf-a72376b53921 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:45.980343 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-90f95bde-71f9-4824-bdcf-a72376b53921 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed" status: 200 len: 1459 microversion: 2.1 time: 0.250053 Jun 10 17:58:45.983360 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 198/416] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:45 2022] GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed => generated 1459 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:45.991291 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-6a4473fe-94c9-42c1-aebc-c23867a26b81 req-0a219015-aa55-4942-a2f7-92e2dc890830 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e3fefa-48f8-42be-95a1-a58e3980db9b", "name": "network-vif-plugged", "status": "completed", "tag": "527428be-3731-4772-b256-ff477210a6f7"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:46.017346 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-6a4473fe-94c9-42c1-aebc-c23867a26b81 req-0a219015-aa55-4942-a2f7-92e2dc890830 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:46.018659 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-6a4473fe-94c9-42c1-aebc-c23867a26b81 req-0a219015-aa55-4942-a2f7-92e2dc890830 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:46.048874 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-6a4473fe-94c9-42c1-aebc-c23867a26b81 req-0a219015-aa55-4942-a2f7-92e2dc890830 service nova] Creating event network-vif-plugged:527428be-3731-4772-b256-ff477210a6f7 for instance 95e3fefa-48f8-42be-95a1-a58e3980db9b on chh2-master-2 Jun 10 17:58:46.055257 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-6a4473fe-94c9-42c1-aebc-c23867a26b81 req-0a219015-aa55-4942-a2f7-92e2dc890830 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067504 Jun 10 17:58:46.056167 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 199/417] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 17:58:46.075388 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f9b0f185-08eb-4d81-8395-c672e2223b47 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19776e5adf942c6a20e4dea1aa10cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1fd6bd677ff4b17bafee8fad1d720a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:46.085569 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f9b0f185-08eb-4d81-8395-c672e2223b47 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b" status: 200 len: 1318 microversion: 2.1 time: 0.224392 Jun 10 17:58:46.086208 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 219/418] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:45 2022] GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:46.755877 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4da2131d-a84b-4929-96d6-45fce37561e1 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:46.756834 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4da2131d-a84b-4929-96d6-45fce37561e1 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] [instance: 2b47ecdd-b178-49f2-a28f-bdedb4771918] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:46.765493 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4da2131d-a84b-4929-96d6-45fce37561e1 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:46.765493 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4da2131d-a84b-4929-96d6-45fce37561e1 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:46.765493 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4da2131d-a84b-4929-96d6-45fce37561e1 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:46.765493 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4da2131d-a84b-4929-96d6-45fce37561e1 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:46.822377 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-22b622e1-284a-46fb-a37f-d7e5e2a96ea1 tempest-FlavorsV261TestJSON-622184373 tempest-FlavorsV261TestJSON-622184373-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1633873737", "id": 87488092, "os-flavor-access:is_public": "True"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:46.824561 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:46.824561 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:46.904527 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4da2131d-a84b-4929-96d6-45fce37561e1 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6942ee76c6e4b16a9ea45d595084df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cef3679b5a47e48376197d17220e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:46.913022 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4da2131d-a84b-4929-96d6-45fce37561e1 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] 10.222.0.35 "GET /compute/v2.1/servers/2b47ecdd-b178-49f2-a28f-bdedb4771918" status: 200 len: 1323 microversion: 2.1 time: 0.163082 Jun 10 17:58:46.913736 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 220/419] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:46 2022] GET /compute/v2.1/servers/2b47ecdd-b178-49f2-a28f-bdedb4771918 => generated 1323 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:46.926079 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-25a2a129-72c4-49f1-94ad-b8ad8635f6f4 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:46.928477 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-25a2a129-72c4-49f1-94ad-b8ad8635f6f4 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: c9b75acf-e4fe-425e-9398-40c4ac1a108b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:46.936705 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-22b622e1-284a-46fb-a37f-d7e5e2a96ea1 tempest-FlavorsV261TestJSON-622184373 tempest-FlavorsV261TestJSON-622184373-project-admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 462 microversion: 2.61 time: 0.243894 Jun 10 17:58:46.936705 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 200/420] 10.222.0.35 () {62 vars in 1187 bytes} [Fri Jun 10 17:58:46 2022] POST /compute/v2.1/flavors => generated 462 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 17:58:46.940882 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-25a2a129-72c4-49f1-94ad-b8ad8635f6f4 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:46.941784 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-25a2a129-72c4-49f1-94ad-b8ad8635f6f4 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:46.942593 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-25a2a129-72c4-49f1-94ad-b8ad8635f6f4 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:46.943088 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-25a2a129-72c4-49f1-94ad-b8ad8635f6f4 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:47.095907 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-25a2a129-72c4-49f1-94ad-b8ad8635f6f4 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:47.105500 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-25a2a129-72c4-49f1-94ad-b8ad8635f6f4 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b" status: 200 len: 1478 microversion: 2.1 time: 0.183539 Jun 10 17:58:47.106070 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 221/421] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:46 2022] GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b => generated 1478 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:47.110601 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2e792e5d-3448-425c-85ad-6946d175cb95 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:47.111507 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2e792e5d-3448-425c-85ad-6946d175cb95 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 1fcc6103-9ecc-42f4-9df8-ac2251f06eed] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:47.117746 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e792e5d-3448-425c-85ad-6946d175cb95 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:47.118188 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e792e5d-3448-425c-85ad-6946d175cb95 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:47.118947 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e792e5d-3448-425c-85ad-6946d175cb95 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:47.119405 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e792e5d-3448-425c-85ad-6946d175cb95 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:47.122024 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3c233526-0221-4be8-ac8e-c6e9802c1da6 tempest-FlavorsV261TestJSON-1952117982 tempest-FlavorsV261TestJSON-1952117982-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:47.131147 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3c233526-0221-4be8-ac8e-c6e9802c1da6 tempest-FlavorsV261TestJSON-1952117982 tempest-FlavorsV261TestJSON-1952117982-project] 10.222.0.35 "GET /compute/v2.1/flavors/87488092" status: 200 len: 462 microversion: 2.61 time: 0.188562 Jun 10 17:58:47.131693 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 201/422] 10.222.0.35 () {60 vars in 1192 bytes} [Fri Jun 10 17:58:46 2022] GET /compute/v2.1/flavors/87488092 => generated 462 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 17:58:47.159272 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e792e5d-3448-425c-85ad-6946d175cb95 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:47.159908 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e792e5d-3448-425c-85ad-6946d175cb95 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:47.160718 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-2e792e5d-3448-425c-85ad-6946d175cb95 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lazy-loading 'fault' on Instance uuid 1fcc6103-9ecc-42f4-9df8-ac2251f06eed {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 17:58:47.260936 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6747fe64-8859-406b-b845-7417b284269d tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1196511487", "id": 615238304, "os-flavor-access:is_public": "False"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:47.294319 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2e792e5d-3448-425c-85ad-6946d175cb95 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:47.302553 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2e792e5d-3448-425c-85ad-6946d175cb95 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed" status: 200 len: 1459 microversion: 2.1 time: 0.195336 Jun 10 17:58:47.303267 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 222/423] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:47 2022] GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed => generated 1459 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:47.308269 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5f1b2e2c-d4a5-4a84-8061-87a5037323b2 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:47.309176 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5f1b2e2c-d4a5-4a84-8061-87a5037323b2 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: 95e3fefa-48f8-42be-95a1-a58e3980db9b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:47.317414 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5f1b2e2c-d4a5-4a84-8061-87a5037323b2 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:47.317971 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5f1b2e2c-d4a5-4a84-8061-87a5037323b2 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:47.318850 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5f1b2e2c-d4a5-4a84-8061-87a5037323b2 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:47.319396 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5f1b2e2c-d4a5-4a84-8061-87a5037323b2 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:47.364007 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6747fe64-8859-406b-b845-7417b284269d tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.230778 Jun 10 17:58:47.370331 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 202/424] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:58:47 2022] POST /compute/v2.1/flavors => generated 436 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:47.377220 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4a44ca15-1591-466c-b819-5a57feea9c4b tempest-FlavorsV261TestJSON-622184373 tempest-FlavorsV261TestJSON-622184373-project-admin] Action: 'update', calling method: .version_select at 0x7f77c3d74af0>, body: {"flavor": {"description": "new"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:47.388062 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:47.388062 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:47.477181 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4a44ca15-1591-466c-b819-5a57feea9c4b tempest-FlavorsV261TestJSON-622184373 tempest-FlavorsV261TestJSON-622184373-project-admin] 10.222.0.35 "PUT /compute/v2.1/flavors/87488092" status: 200 len: 463 microversion: 2.61 time: 0.110889 Jun 10 17:58:47.478063 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 203/425] 10.222.0.35 () {62 vars in 1212 bytes} [Fri Jun 10 17:58:47 2022] PUT /compute/v2.1/flavors/87488092 => generated 463 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 17:58:47.482902 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-54f363f2-c123-4376-b618-a302884018d9 tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "bc7dd1888b1b48d3946b46620361a7b2"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:47.484176 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:47.484176 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:47.487397 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5f1b2e2c-d4a5-4a84-8061-87a5037323b2 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19776e5adf942c6a20e4dea1aa10cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1fd6bd677ff4b17bafee8fad1d720a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:47.497916 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5f1b2e2c-d4a5-4a84-8061-87a5037323b2 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b" status: 200 len: 1318 microversion: 2.1 time: 0.193314 Jun 10 17:58:47.499847 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 223/426] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:47 2022] GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:47.562581 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4eb61343-d736-4954-bf0b-7d4e06f5f444 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-851719500", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "7de6f16e-8732-420c-9f26-0f6001482cf3"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:47.614426 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-4eb61343-d736-4954-bf0b-7d4e06f5f444 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] validate_networks() for [('7de6f16e-8732-420c-9f26-0f6001482cf3', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 17:58:47.640612 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-54f363f2-c123-4376-b618-a302884018d9 tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] 10.222.0.35 "POST /compute/v2.1/flavors/615238304/action" status: 200 len: 96 microversion: 2.1 time: 0.161100 Jun 10 17:58:47.641645 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 204/427] 10.222.0.35 () {60 vars in 1196 bytes} [Fri Jun 10 17:58:47 2022] POST /compute/v2.1/flavors/615238304/action => generated 96 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 17:58:47.647622 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7366ec13-df7e-4775-9da2-062223074785 tempest-FlavorsV261TestJSON-1952117982 tempest-FlavorsV261TestJSON-1952117982-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:47.671939 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7366ec13-df7e-4775-9da2-062223074785 tempest-FlavorsV261TestJSON-1952117982 tempest-FlavorsV261TestJSON-1952117982-project] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 7147 microversion: 2.61 time: 0.028392 Jun 10 17:58:47.672434 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 205/428] 10.222.0.35 () {60 vars in 1186 bytes} [Fri Jun 10 17:58:47 2022] GET /compute/v2.1/flavors/detail => generated 7147 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 17:58:47.676700 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3d75e9d0-4854-479f-9825-37eaef983d39 tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "bc7dd1888b1b48d3946b46620361a7b2"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:47.771931 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-3d75e9d0-4854-479f-9825-37eaef983d39 tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] HTTP exception thrown: Flavor access already exists for flavor 33 and project bc7dd1888b1b48d3946b46620361a7b2 combination. Jun 10 17:58:47.775420 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3d75e9d0-4854-479f-9825-37eaef983d39 tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] Request method failure captured: Jun 10 17:58:47.775420 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/flavors/615238304/action HTTP/1.1 Jun 10 17:58:47.775420 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 17:58:47.775420 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 17:58:47.775420 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 17:58:47.775420 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 67 Jun 10 17:58:47.775420 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 17:58:47.775420 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 17:58:47.775420 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 17:58:47.775420 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:47.775420 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4ZW6I7UwV-75PwjSI1cnCIGAxcPu2meql0TcLZeM3nfNJmPYJJE-vC8PAzps6lF5VipXmGEquhJoxBCactKXf3E1tfDJVeC08Ste820uTgVKgW7FgUf6c76S5nY__4QtXWB5ESceqjPA9zCRrW9TWrVn2638uCA7xKIAqML0LndYE4 Jun 10 17:58:47.775420 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 17:58:47.775420 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 17:58:47.775420 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 17:58:47.775420 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 17:58:47.775420 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 17:58:47.775420 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 17:58:47.775420 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 3eb2b9661f3d45168220c2f6a022843f Jun 10 17:58:47.775420 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-215435388 Jun 10 17:58:47.775420 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member,admin Jun 10 17:58:47.775420 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member,admin Jun 10 17:58:47.776894 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/3eb2b9661f3d45168220c2f6a022843f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3eb2b9661f3d45168220c2f6a022843f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3eb2b9661f3d45168220c2f6a022843f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_3eb2b9661f3d45168220c2f6a022843f", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:47.776894 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-215435388 Jun 10 17:58:47.776894 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 3eb2b9661f3d45168220c2f6a022843f Jun 10 17:58:47.776894 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-215435388 Jun 10 17:58:47.776894 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin Jun 10 17:58:47.776894 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 17:58:47.776894 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 17:58:47.776894 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: dac7e1c4754e42358928773462489b28 Jun 10 17:58:47.776894 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin Jun 10 17:58:47.776894 chdv-master-2 devstack@n-api.service[126594]: Jun 10 17:58:47.776894 chdv-master-2 devstack@n-api.service[126594]: {"addTenantAccess": {"tenant": "bc7dd1888b1b48d3946b46620361a7b2"}} Jun 10 17:58:47.776894 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 17:58:47.777802 chdv-master-2 devstack@n-api.service[126594]: exception: Flavor access already exists for flavor 33 and project bc7dd1888b1b48d3946b46620361a7b2 combination. Jun 10 17:58:47.777802 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '615238304', 'body': {'addTenantAccess': {'tenant': 'bc7dd1888b1b48d3946b46620361a7b2'}}} Jun 10 17:58:47.777802 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:47.777802 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:47.777802 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 10 17:58:47.777802 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 10 17:58:47.777802 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 10 17:58:47.777802 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 10 17:58:47.777802 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 10 17:58:47.777802 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 10 17:58:47.777802 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 10 17:58:47.777802 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 10 17:58:47.777802 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 10 17:58:47.777802 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 10 17:58:47.777802 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 10 17:58:47.777802 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result.read() Jun 10 17:58:47.777802 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 10 17:58:47.777802 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 10 17:58:47.779098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 10 17:58:47.779098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 10 17:58:47.779098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 10 17:58:47.779098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 10 17:58:47.779098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 10 17:58:47.779098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 10 17:58:47.779098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '33-bc7dd1888b1b48d3946b46620361a7b2' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jun 10 17:58:47.779098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:47.779098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jun 10 17:58:47.779098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:47.779098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:47.779098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Jun 10 17:58:47.779098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi project.save(context.session) Jun 10 17:58:47.779098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jun 10 17:58:47.779098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi session.flush() Jun 10 17:58:47.779098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 10 17:58:47.779098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._flush(objects) Jun 10 17:58:47.779098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 10 17:58:47.779098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jun 10 17:58:47.783354 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 10 17:58:47.783354 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi compat.raise_( Jun 10 17:58:47.783354 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 10 17:58:47.783354 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception Jun 10 17:58:47.783354 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 10 17:58:47.783354 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi flush_context.execute() Jun 10 17:58:47.783354 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 10 17:58:47.783354 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi rec.execute(self) Jun 10 17:58:47.783354 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 10 17:58:47.783354 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jun 10 17:58:47.783354 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 10 17:58:47.783354 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jun 10 17:58:47.783354 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 10 17:58:47.783354 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jun 10 17:58:47.783354 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 10 17:58:47.783354 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jun 10 17:58:47.783354 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 10 17:58:47.783354 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jun 10 17:58:47.784665 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 10 17:58:47.784665 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jun 10 17:58:47.784665 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 10 17:58:47.784665 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jun 10 17:58:47.784665 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 10 17:58:47.784665 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 10 17:58:47.784665 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 10 17:58:47.784665 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception Jun 10 17:58:47.784665 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 10 17:58:47.784665 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 10 17:58:47.784665 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 10 17:58:47.784665 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 10 17:58:47.784665 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 10 17:58:47.784665 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 10 17:58:47.784665 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 10 17:58:47.784665 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 10 17:58:47.784665 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 10 17:58:47.784665 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 10 17:58:47.785876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 10 17:58:47.785876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result.read() Jun 10 17:58:47.785876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 10 17:58:47.785876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 10 17:58:47.785876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 10 17:58:47.785876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 10 17:58:47.785876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 10 17:58:47.785876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 10 17:58:47.785876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 10 17:58:47.785876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 10 17:58:47.785876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '33-bc7dd1888b1b48d3946b46620361a7b2' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jun 10 17:58:47.785876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Jun 10 17:58:47.785876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 6, 10, 17, 58, 47, 737567), 'updated_at': None, 'flavor_id': 33, 'project_id': 'bc7dd1888b1b48d3946b46620361a7b2'}] Jun 10 17:58:47.785876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 10 17:58:47.785876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:47.785876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:47.785876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:47.786990 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:47.786990 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Jun 10 17:58:47.786990 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Jun 10 17:58:47.786990 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 10 17:58:47.786990 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 10 17:58:47.786990 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Jun 10 17:58:47.786990 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Jun 10 17:58:47.786990 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Jun 10 17:58:47.786990 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Jun 10 17:58:47.786990 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Jun 10 17:58:47.786990 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Jun 10 17:58:47.786990 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 10 17:58:47.786990 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 10 17:58:47.786990 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Jun 10 17:58:47.786990 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Jun 10 17:58:47.786990 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 33 and project bc7dd1888b1b48d3946b46620361a7b2 combination. Jun 10 17:58:47.786990 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:47.786990 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:47.786990 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:47.788244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:47.788244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:47.788244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:47.788244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:47.788244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:47.788244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:47.788244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:47.788244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 17:58:47.788244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 17:58:47.788244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Jun 10 17:58:47.788244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Jun 10 17:58:47.788244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 33 and project bc7dd1888b1b48d3946b46620361a7b2 combination. Jun 10 17:58:47.788244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:47.788244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:47.788244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:47.788244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:47.788244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:47.788244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:47.788244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:58:47.788244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:58:47.790498 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 33 and project bc7dd1888b1b48d3946b46620361a7b2 combination. Jun 10 17:58:47.790498 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:47.790498 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3d75e9d0-4854-479f-9825-37eaef983d39 tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] Returning 409 to user: Flavor access already exists for flavor 33 and project bc7dd1888b1b48d3946b46620361a7b2 combination. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:47.790498 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3d75e9d0-4854-479f-9825-37eaef983d39 tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] 10.222.0.35 "POST /compute/v2.1/flavors/615238304/action" status: 409 len: 152 microversion: 2.1 time: 0.103512 Jun 10 17:58:47.790498 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 206/429] 10.222.0.35 () {60 vars in 1196 bytes} [Fri Jun 10 17:58:47 2022] POST /compute/v2.1/flavors/615238304/action => generated 152 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 10 17:58:47.790498 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-37ec6ddf-5177-4fe0-a832-52448e004ffe tempest-FlavorsV261TestJSON-1952117982 tempest-FlavorsV261TestJSON-1952117982-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:47.813459 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-37ec6ddf-5177-4fe0-a832-52448e004ffe tempest-FlavorsV261TestJSON-1952117982 tempest-FlavorsV261TestJSON-1952117982-project] 10.222.0.35 "GET /compute/v2.1/flavors" status: 200 len: 3674 microversion: 2.61 time: 0.034615 Jun 10 17:58:47.814256 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 207/430] 10.222.0.35 () {60 vars in 1165 bytes} [Fri Jun 10 17:58:47 2022] GET /compute/v2.1/flavors => generated 3674 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 17:58:47.818916 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-131d3a63-6772-41ea-9411-ce723c307bf9 tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "bc7dd1888b1b48d3946b46620361a7b2"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:47.819900 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:47.819900 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:47.990006 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-131d3a63-6772-41ea-9411-ce723c307bf9 tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] 10.222.0.35 "POST /compute/v2.1/flavors/615238304/action" status: 200 len: 21 microversion: 2.1 time: 0.174790 Jun 10 17:58:47.990620 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 208/431] 10.222.0.35 () {60 vars in 1196 bytes} [Fri Jun 10 17:58:47 2022] POST /compute/v2.1/flavors/615238304/action => generated 21 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 17:58:47.995063 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c2809656-6018-434f-a6cc-4baa5aa53a80 tempest-FlavorsV261TestJSON-622184373 tempest-FlavorsV261TestJSON-622184373-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:47.996107 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:47.996107 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:48.111287 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c2809656-6018-434f-a6cc-4baa5aa53a80 tempest-FlavorsV261TestJSON-622184373 tempest-FlavorsV261TestJSON-622184373-project-admin] 10.222.0.35 "DELETE /compute/v2.1/flavors/87488092" status: 202 len: 0 microversion: 2.61 time: 0.119438 Jun 10 17:58:48.111929 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 209/432] 10.222.0.35 () {60 vars in 1195 bytes} [Fri Jun 10 17:58:47 2022] DELETE /compute/v2.1/flavors/87488092 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 10 17:58:48.116686 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7ec7b278-c25c-4a4d-9f48-9fffb0f7e8cf tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:48.118418 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7ec7b278-c25c-4a4d-9f48-9fffb0f7e8cf tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] [instance: 2b47ecdd-b178-49f2-a28f-bdedb4771918] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:48.125054 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ec7b278-c25c-4a4d-9f48-9fffb0f7e8cf tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:48.125694 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ec7b278-c25c-4a4d-9f48-9fffb0f7e8cf tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:48.126327 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ec7b278-c25c-4a4d-9f48-9fffb0f7e8cf tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:48.126763 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ec7b278-c25c-4a4d-9f48-9fffb0f7e8cf tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:48.230092 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-4eb61343-d736-4954-bf0b-7d4e06f5f444 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 17:58:48.230573 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-4eb61343-d736-4954-bf0b-7d4e06f5f444 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 17:58:48.230985 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-4eb61343-d736-4954-bf0b-7d4e06f5f444 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 17:58:48.231396 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-4eb61343-d736-4954-bf0b-7d4e06f5f444 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 17:58:48.231833 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-4eb61343-d736-4954-bf0b-7d4e06f5f444 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 17:58:48.241223 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4eb61343-d736-4954-bf0b-7d4e06f5f444 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:48.241676 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4eb61343-d736-4954-bf0b-7d4e06f5f444 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:48.242482 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4eb61343-d736-4954-bf0b-7d4e06f5f444 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:48.242922 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4eb61343-d736-4954-bf0b-7d4e06f5f444 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:48.250295 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:58:48.261056 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-4eb61343-d736-4954-bf0b-7d4e06f5f444 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Getting quotas for project 56cb46777a914dbaa7c64c5047cc65e4. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 17:58:48.266226 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-4eb61343-d736-4954-bf0b-7d4e06f5f444 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Getting quotas for user c64251f22f844077b4d9ce2617c11082 and project 56cb46777a914dbaa7c64c5047cc65e4. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 17:58:48.269245 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7ec7b278-c25c-4a4d-9f48-9fffb0f7e8cf tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6942ee76c6e4b16a9ea45d595084df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cef3679b5a47e48376197d17220e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:48.277119 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7ec7b278-c25c-4a4d-9f48-9fffb0f7e8cf tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] 10.222.0.35 "GET /compute/v2.1/servers/2b47ecdd-b178-49f2-a28f-bdedb4771918" status: 200 len: 1323 microversion: 2.1 time: 0.164102 Jun 10 17:58:48.277755 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 210/433] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:48 2022] GET /compute/v2.1/servers/2b47ecdd-b178-49f2-a28f-bdedb4771918 => generated 1323 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:48.279795 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4eb61343-d736-4954-bf0b-7d4e06f5f444 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 17:58:48.282765 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4eb61343-d736-4954-bf0b-7d4e06f5f444 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] [instance: e6e43799-860e-4ae1-91cf-da1495ff9f64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 17:58:48.292029 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5f29a198-8363-4524-88b8-e5eff0af17ef tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:48.292843 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:48.292843 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:48.303863 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=9,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:58:48.407861 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5f29a198-8363-4524-88b8-e5eff0af17ef tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] 10.222.0.35 "DELETE /compute/v2.1/flavors/615238304" status: 202 len: 0 microversion: 2.1 time: 0.128944 Jun 10 17:58:48.408762 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 211/434] 10.222.0.35 () {58 vars in 1157 bytes} [Fri Jun 10 17:58:48 2022] DELETE /compute/v2.1/flavors/615238304 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 17:58:48.414614 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-acfab85a-dfdc-4547-a7d3-7c6f406cf91a tempest-FlavorsV261TestJSON-622184373 tempest-FlavorsV261TestJSON-622184373-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:48.422718 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4eb61343-d736-4954-bf0b-7d4e06f5f444 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.921775 Jun 10 17:58:48.423362 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 224/435] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:58:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 17:58:48.428510 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-75bd6ee7-759c-48aa-8774-c9764958a782 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:48.429111 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-75bd6ee7-759c-48aa-8774-c9764958a782 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: c9b75acf-e4fe-425e-9398-40c4ac1a108b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:48.435637 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-75bd6ee7-759c-48aa-8774-c9764958a782 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:48.441872 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-75bd6ee7-759c-48aa-8774-c9764958a782 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:48.441872 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-75bd6ee7-759c-48aa-8774-c9764958a782 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:48.441872 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-75bd6ee7-759c-48aa-8774-c9764958a782 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:48.443724 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-acfab85a-dfdc-4547-a7d3-7c6f406cf91a tempest-FlavorsV261TestJSON-622184373 tempest-FlavorsV261TestJSON-622184373-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 6694 microversion: 2.61 time: 0.033705 Jun 10 17:58:48.444295 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 212/436] 10.222.0.35 () {60 vars in 1186 bytes} [Fri Jun 10 17:58:48 2022] GET /compute/v2.1/flavors/detail => generated 6694 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 17:58:48.456850 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0818936a-c766-4f45-ab54-05003bd8832e tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:48.457648 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0818936a-c766-4f45-ab54-05003bd8832e tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 1fcc6103-9ecc-42f4-9df8-ac2251f06eed] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:48.464487 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0818936a-c766-4f45-ab54-05003bd8832e tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:48.465120 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0818936a-c766-4f45-ab54-05003bd8832e tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:48.466056 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0818936a-c766-4f45-ab54-05003bd8832e tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:48.466546 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0818936a-c766-4f45-ab54-05003bd8832e tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:48.499169 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0818936a-c766-4f45-ab54-05003bd8832e tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:48.499624 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0818936a-c766-4f45-ab54-05003bd8832e tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:48.500086 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-0818936a-c766-4f45-ab54-05003bd8832e tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lazy-loading 'fault' on Instance uuid 1fcc6103-9ecc-42f4-9df8-ac2251f06eed {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 17:58:48.638183 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0818936a-c766-4f45-ab54-05003bd8832e tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:48.638384 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-75bd6ee7-759c-48aa-8774-c9764958a782 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:48.647872 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0818936a-c766-4f45-ab54-05003bd8832e tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed" status: 200 len: 1459 microversion: 2.1 time: 0.202376 Jun 10 17:58:48.648491 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-75bd6ee7-759c-48aa-8774-c9764958a782 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b" status: 200 len: 1478 microversion: 2.1 time: 0.223711 Jun 10 17:58:48.652887 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 225/437] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:48 2022] GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b => generated 1478 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:48.658191 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1f52c885-55f7-4b0f-a32e-1b9e96ae7824 tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:48.658350 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 213/438] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:48 2022] GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed => generated 1459 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:48.663265 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2dc78414-e2f1-4045-b735-b12779ba23a4 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:48.664007 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2dc78414-e2f1-4045-b735-b12779ba23a4 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] [instance: e6e43799-860e-4ae1-91cf-da1495ff9f64] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:48.681112 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1f52c885-55f7-4b0f-a32e-1b9e96ae7824 tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.026997 Jun 10 17:58:48.683082 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 226/439] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 17:58:48 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:48.686874 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c89e471b-dca6-4579-8172-859ccf1841bd tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:48.687478 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c89e471b-dca6-4579-8172-859ccf1841bd tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: 95e3fefa-48f8-42be-95a1-a58e3980db9b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:48.694576 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c89e471b-dca6-4579-8172-859ccf1841bd tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:48.695111 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c89e471b-dca6-4579-8172-859ccf1841bd tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:48.696828 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c89e471b-dca6-4579-8172-859ccf1841bd tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:48.697276 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c89e471b-dca6-4579-8172-859ccf1841bd tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:48.726117 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2dc78414-e2f1-4045-b735-b12779ba23a4 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c64251f22f844077b4d9ce2617c11082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cb46777a914dbaa7c64c5047cc65e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:48.733494 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2dc78414-e2f1-4045-b735-b12779ba23a4 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] 10.222.0.35 "GET /compute/v2.1/servers/e6e43799-860e-4ae1-91cf-da1495ff9f64" status: 200 len: 1224 microversion: 2.1 time: 0.073951 Jun 10 17:58:48.734181 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 214/440] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:48 2022] GET /compute/v2.1/servers/e6e43799-860e-4ae1-91cf-da1495ff9f64 => generated 1224 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:48.739910 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-60fbc43c-e678-485a-a0f0-b11a1fb7fefb tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-340400922", "id": 277885600, "os-flavor-access:is_public": "True"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:48.741719 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:48.741719 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:48.830536 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-60fbc43c-e678-485a-a0f0-b11a1fb7fefb tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.094901 Jun 10 17:58:48.832335 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 215/441] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:58:48 2022] POST /compute/v2.1/flavors => generated 434 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:48.842531 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-15051ad4-9b99-4765-ae0c-0f0b0c5254fc tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:48.844130 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:48.844130 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:48.849973 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c89e471b-dca6-4579-8172-859ccf1841bd tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19776e5adf942c6a20e4dea1aa10cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1fd6bd677ff4b17bafee8fad1d720a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:48.851800 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-15051ad4-9b99-4765-ae0c-0f0b0c5254fc tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] HTTP exception thrown: Access list not available for public flavors. Jun 10 17:58:48.853488 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-15051ad4-9b99-4765-ae0c-0f0b0c5254fc tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] Request method failure captured: Jun 10 17:58:48.853488 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/flavors/277885600/os-flavor-access HTTP/1.1 Jun 10 17:58:48.853488 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 17:58:48.853488 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 17:58:48.853488 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 17:58:48.853488 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 17:58:48.853488 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 17:58:48.853488 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 17:58:48.853488 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 17:58:48.853488 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:48.853488 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4ZW6I7UwV-75PwjSI1cnCIGAxcPu2meql0TcLZeM3nfNJmPYJJE-vC8PAzps6lF5VipXmGEquhJoxBCactKXf3E1tfDJVeC08Ste820uTgVKgW7FgUf6c76S5nY__4QtXWB5ESceqjPA9zCRrW9TWrVn2638uCA7xKIAqML0LndYE4 Jun 10 17:58:48.853488 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 17:58:48.853488 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 17:58:48.853488 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 17:58:48.853488 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 17:58:48.853488 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 17:58:48.853488 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 17:58:48.853488 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 3eb2b9661f3d45168220c2f6a022843f Jun 10 17:58:48.853488 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-215435388 Jun 10 17:58:48.853488 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member,admin Jun 10 17:58:48.853488 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member,admin Jun 10 17:58:48.854689 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/3eb2b9661f3d45168220c2f6a022843f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3eb2b9661f3d45168220c2f6a022843f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3eb2b9661f3d45168220c2f6a022843f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_3eb2b9661f3d45168220c2f6a022843f", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:48.854689 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-215435388 Jun 10 17:58:48.854689 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 3eb2b9661f3d45168220c2f6a022843f Jun 10 17:58:48.854689 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-215435388 Jun 10 17:58:48.854689 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin Jun 10 17:58:48.854689 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 17:58:48.854689 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 17:58:48.854689 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: dac7e1c4754e42358928773462489b28 Jun 10 17:58:48.854689 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin Jun 10 17:58:48.854689 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 17:58:48.854689 chdv-master-2 devstack@n-api.service[126594]: exception: Access list not available for public flavors. Jun 10 17:58:48.854689 chdv-master-2 devstack@n-api.service[126594]: action_args: {'flavor_id': '277885600'} Jun 10 17:58:48.855337 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:48.855337 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:48.855337 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:48.855337 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:48.855337 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:48.855337 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:48.855337 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:48.855337 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:48.855337 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Jun 10 17:58:48.855337 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 10 17:58:48.855337 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Jun 10 17:58:48.855337 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:48.855337 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:48.855337 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:48.855337 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:48.855337 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:48.855337 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:48.855337 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:58:48.855337 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:58:48.855337 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Jun 10 17:58:48.855337 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:48.857769 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-15051ad4-9b99-4765-ae0c-0f0b0c5254fc tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:48.858796 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-15051ad4-9b99-4765-ae0c-0f0b0c5254fc tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/277885600/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.020421 Jun 10 17:58:48.859413 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c89e471b-dca6-4579-8172-859ccf1841bd tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b" status: 200 len: 1318 microversion: 2.1 time: 0.176596 Jun 10 17:58:48.860178 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 227/442] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:48 2022] GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:48.862862 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 216/443] 10.222.0.35 () {58 vars in 1205 bytes} [Fri Jun 10 17:58:48 2022] GET /compute/v2.1/flavors/277885600/os-flavor-access => generated 91 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 10 17:58:48.867920 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f641f829-c21a-4ff2-a561-075c610f57dc tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:48.868842 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:48.868842 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:48.984191 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f641f829-c21a-4ff2-a561-075c610f57dc tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] 10.222.0.35 "DELETE /compute/v2.1/flavors/277885600" status: 202 len: 0 microversion: 2.1 time: 0.120003 Jun 10 17:58:48.985000 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 228/444] 10.222.0.35 () {58 vars in 1157 bytes} [Fri Jun 10 17:58:48 2022] DELETE /compute/v2.1/flavors/277885600 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 17:58:48.993020 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ac5e0ab2-e8d1-4296-b65b-2bc19717bb97 tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:49.013853 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ac5e0ab2-e8d1-4296-b65b-2bc19717bb97 tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.024704 Jun 10 17:58:49.014438 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 217/445] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 17:58:48 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:49.030916 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4cca3197-458a-4cf6-92fe-dc644a8d7ccf tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-580680607", "id": 920164100, "os-flavor-access:is_public": "False"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:49.034239 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:49.034239 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:49.116791 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4cca3197-458a-4cf6-92fe-dc644a8d7ccf tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.089696 Jun 10 17:58:49.117447 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 229/446] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:58:49 2022] POST /compute/v2.1/flavors => generated 435 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:49.252073 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:58:49.303568 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bf1d479c-ae78-4670-b460-28cea723ce88 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:49.306639 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bf1d479c-ae78-4670-b460-28cea723ce88 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] [instance: 2b47ecdd-b178-49f2-a28f-bdedb4771918] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:49.313045 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8bfb219e-6291-422b-aea6-d99264c711cb tempest-FlavorsAccessNegativeTestJSON-1536060213 tempest-FlavorsAccessNegativeTestJSON-1536060213-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "bc7dd1888b1b48d3946b46620361a7b2"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:49.317524 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:49.317524 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:49.319857 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8bfb219e-6291-422b-aea6-d99264c711cb tempest-FlavorsAccessNegativeTestJSON-1536060213 tempest-FlavorsAccessNegativeTestJSON-1536060213-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '34481172a7c74b659c51283ea103bb98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7dd1888b1b48d3946b46620361a7b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:49.324545 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8bfb219e-6291-422b-aea6-d99264c711cb tempest-FlavorsAccessNegativeTestJSON-1536060213 tempest-FlavorsAccessNegativeTestJSON-1536060213-project] Request method failure captured: Jun 10 17:58:49.324545 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/flavors/920164100/action HTTP/1.1 Jun 10 17:58:49.324545 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 17:58:49.324545 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 17:58:49.324545 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 17:58:49.324545 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 67 Jun 10 17:58:49.324545 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 17:58:49.324545 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 17:58:49.324545 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 17:58:49.324545 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:49.324545 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4ZVFaLXPjt2HWCgiQcVYFq0Szqk8TNI4EtCb2cJ5lrSoSr_pyOwYD_zf07HwC8HlsdHTkvMbR-zcdSAFACvSyOF7NmwIqL3cPkE1cxOLJj1o7Gvho72M-fKr9w1mm1lBbINOVd5SqftzUNoeerCbMl_SRDaC1SkytvvGhBUH29E2IA Jun 10 17:58:49.324545 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 17:58:49.324545 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 17:58:49.324545 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 17:58:49.324545 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 17:58:49.324545 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 17:58:49.324545 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 17:58:49.324545 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: bc7dd1888b1b48d3946b46620361a7b2 Jun 10 17:58:49.324545 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1536060213 Jun 10 17:58:49.324545 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 17:58:49.324545 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 17:58:49.325741 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/bc7dd1888b1b48d3946b46620361a7b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bc7dd1888b1b48d3946b46620361a7b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bc7dd1888b1b48d3946b46620361a7b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_bc7dd1888b1b48d3946b46620361a7b2", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:49.325741 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1536060213 Jun 10 17:58:49.325741 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: bc7dd1888b1b48d3946b46620361a7b2 Jun 10 17:58:49.325741 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1536060213 Jun 10 17:58:49.325741 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-FlavorsAccessNegativeTestJSON-1536060213-project Jun 10 17:58:49.325741 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 17:58:49.325741 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 17:58:49.325741 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 34481172a7c74b659c51283ea103bb98 Jun 10 17:58:49.325741 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1536060213-project Jun 10 17:58:49.325741 chdv-master-2 devstack@n-api.service[126594]: Jun 10 17:58:49.325741 chdv-master-2 devstack@n-api.service[126594]: {"addTenantAccess": {"tenant": "bc7dd1888b1b48d3946b46620361a7b2"}} Jun 10 17:58:49.325741 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 17:58:49.326405 chdv-master-2 devstack@n-api.service[126594]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jun 10 17:58:49.326405 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '920164100', 'body': {'addTenantAccess': {'tenant': 'bc7dd1888b1b48d3946b46620361a7b2'}}} Jun 10 17:58:49.326405 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:49.326405 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:49.326405 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:49.326405 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:49.326405 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:49.326405 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:49.326405 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:49.326405 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:49.326405 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 17:58:49.326405 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 17:58:49.326405 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Jun 10 17:58:49.326405 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Jun 10 17:58:49.326405 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 10 17:58:49.326405 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 10 17:58:49.326405 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 10 17:58:49.326405 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 10 17:58:49.326405 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 17:58:49.327453 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 17:58:49.327453 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 17:58:49.327453 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 17:58:49.327453 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 10 17:58:49.327453 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 10 17:58:49.327453 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 10 17:58:49.327453 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 10 17:58:49.327453 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 10 17:58:49.327453 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 10 17:58:49.327453 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jun 10 17:58:49.327453 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:49.327453 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:49.327453 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:49.327453 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:49.327453 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:49.327453 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:49.327453 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 10 17:58:49.327453 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 10 17:58:49.327453 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jun 10 17:58:49.327453 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:49.328586 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8bfb219e-6291-422b-aea6-d99264c711cb tempest-FlavorsAccessNegativeTestJSON-1536060213 tempest-FlavorsAccessNegativeTestJSON-1536060213-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:49.328658 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bf1d479c-ae78-4670-b460-28cea723ce88 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:49.328658 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bf1d479c-ae78-4670-b460-28cea723ce88 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:49.329164 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8bfb219e-6291-422b-aea6-d99264c711cb tempest-FlavorsAccessNegativeTestJSON-1536060213 tempest-FlavorsAccessNegativeTestJSON-1536060213-project] 10.222.0.35 "POST /compute/v2.1/flavors/920164100/action" status: 403 len: 130 microversion: 2.1 time: 0.203451 Jun 10 17:58:49.329899 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 218/447] 10.222.0.35 () {60 vars in 1196 bytes} [Fri Jun 10 17:58:49 2022] POST /compute/v2.1/flavors/920164100/action => generated 130 bytes in 206 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jun 10 17:58:49.330722 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bf1d479c-ae78-4670-b460-28cea723ce88 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:49.331437 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bf1d479c-ae78-4670-b460-28cea723ce88 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:49.344608 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-490b05f6-7dde-4888-ab99-297ac0e12e05 tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:49.345468 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:49.345468 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:49.463019 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-490b05f6-7dde-4888-ab99-297ac0e12e05 tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] 10.222.0.35 "DELETE /compute/v2.1/flavors/920164100" status: 202 len: 0 microversion: 2.1 time: 0.128446 Jun 10 17:58:49.463610 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 219/448] 10.222.0.35 () {58 vars in 1157 bytes} [Fri Jun 10 17:58:49 2022] DELETE /compute/v2.1/flavors/920164100 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 17:58:49.471820 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9ac4eba8-9f26-40f3-82d8-e2cef39b5a86 tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:49.497672 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9ac4eba8-9f26-40f3-82d8-e2cef39b5a86 tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.023722 Jun 10 17:58:49.497672 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 220/449] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 17:58:49 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:49.513899 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bf1d479c-ae78-4670-b460-28cea723ce88 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6942ee76c6e4b16a9ea45d595084df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cef3679b5a47e48376197d17220e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:49.514117 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-05f9933d-5464-41b0-a3a9-622930dba87b req-e7f52490-90a7-44f4-b56e-7dcd2ac4792b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b47ecdd-b178-49f2-a28f-bdedb4771918", "name": "network-vif-plugged", "status": "completed", "tag": "9943d602-d3c6-4e99-a0ca-ddc9ea5df28b"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:49.523096 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-05f9933d-5464-41b0-a3a9-622930dba87b req-e7f52490-90a7-44f4-b56e-7dcd2ac4792b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:49.523544 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-05f9933d-5464-41b0-a3a9-622930dba87b req-e7f52490-90a7-44f4-b56e-7dcd2ac4792b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:49.525402 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bf1d479c-ae78-4670-b460-28cea723ce88 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] 10.222.0.35 "GET /compute/v2.1/servers/2b47ecdd-b178-49f2-a28f-bdedb4771918" status: 200 len: 1323 microversion: 2.1 time: 0.231336 Jun 10 17:58:49.526800 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 230/450] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:49 2022] GET /compute/v2.1/servers/2b47ecdd-b178-49f2-a28f-bdedb4771918 => generated 1323 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:49.532746 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-62aec2ae-dc80-46f9-bf79-7bf0d649cfdb tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1221462575", "id": 625582349, "os-flavor-access:is_public": "False"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:49.534991 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:49.534991 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:49.540355 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-05f9933d-5464-41b0-a3a9-622930dba87b req-e7f52490-90a7-44f4-b56e-7dcd2ac4792b service nova] Creating event network-vif-plugged:9943d602-d3c6-4e99-a0ca-ddc9ea5df28b for instance 2b47ecdd-b178-49f2-a28f-bdedb4771918 on chh1-master-2 Jun 10 17:58:49.541066 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=8,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:58:49.546550 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-05f9933d-5464-41b0-a3a9-622930dba87b req-e7f52490-90a7-44f4-b56e-7dcd2ac4792b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036330 Jun 10 17:58:49.547857 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 221/451] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:49.632386 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-62aec2ae-dc80-46f9-bf79-7bf0d649cfdb tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.104284 Jun 10 17:58:49.632983 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 231/452] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:58:49 2022] POST /compute/v2.1/flavors => generated 436 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:49.644705 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8fd674a8-8746-42ff-9b52-1b8670f33227 tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "bc7dd1888b1b48d3946b46620361a7b2"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:49.646371 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:49.646371 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:49.670343 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-37153b41-88c9-4396-bb47-09bf1f91c536 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:49.671873 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-37153b41-88c9-4396-bb47-09bf1f91c536 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 1fcc6103-9ecc-42f4-9df8-ac2251f06eed] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:49.680739 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-37153b41-88c9-4396-bb47-09bf1f91c536 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:49.681543 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-37153b41-88c9-4396-bb47-09bf1f91c536 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:49.682618 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-37153b41-88c9-4396-bb47-09bf1f91c536 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:49.683477 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-37153b41-88c9-4396-bb47-09bf1f91c536 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:49.755034 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-37153b41-88c9-4396-bb47-09bf1f91c536 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:49.755487 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-37153b41-88c9-4396-bb47-09bf1f91c536 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:49.760674 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-37153b41-88c9-4396-bb47-09bf1f91c536 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lazy-loading 'fault' on Instance uuid 1fcc6103-9ecc-42f4-9df8-ac2251f06eed {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 17:58:49.848331 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-37153b41-88c9-4396-bb47-09bf1f91c536 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:49.857325 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-37153b41-88c9-4396-bb47-09bf1f91c536 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed" status: 200 len: 1417 microversion: 2.1 time: 0.195508 Jun 10 17:58:49.860880 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 232/453] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:49 2022] GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed => generated 1417 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:49.863572 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bba5a7d7-b4ee-4e7d-afb5-d2035237fe38 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:49.864594 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bba5a7d7-b4ee-4e7d-afb5-d2035237fe38 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: c9b75acf-e4fe-425e-9398-40c4ac1a108b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:49.876363 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bba5a7d7-b4ee-4e7d-afb5-d2035237fe38 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:49.877019 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bba5a7d7-b4ee-4e7d-afb5-d2035237fe38 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:49.877794 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bba5a7d7-b4ee-4e7d-afb5-d2035237fe38 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:49.878409 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bba5a7d7-b4ee-4e7d-afb5-d2035237fe38 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:49.955904 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8fd674a8-8746-42ff-9b52-1b8670f33227 tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] 10.222.0.35 "POST /compute/v2.1/flavors/625582349/action" status: 200 len: 96 microversion: 2.1 time: 0.315686 Jun 10 17:58:49.956619 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 222/454] 10.222.0.35 () {60 vars in 1196 bytes} [Fri Jun 10 17:58:49 2022] POST /compute/v2.1/flavors/625582349/action => generated 96 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 17:58:49.977488 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bba5a7d7-b4ee-4e7d-afb5-d2035237fe38 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:49.986256 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-60167a09-2681-4750-832a-cf059cf2e575 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:49.986761 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bba5a7d7-b4ee-4e7d-afb5-d2035237fe38 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b" status: 200 len: 1436 microversion: 2.1 time: 0.126529 Jun 10 17:58:49.987487 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 233/455] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:49 2022] GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b => generated 1436 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:49.989223 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-60167a09-2681-4750-832a-cf059cf2e575 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] [instance: e6e43799-860e-4ae1-91cf-da1495ff9f64] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:49.992719 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-053a511d-9e6e-4589-9cb6-90c14ce1865d tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:50.003161 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-053a511d-9e6e-4589-9cb6-90c14ce1865d tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: 95e3fefa-48f8-42be-95a1-a58e3980db9b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:50.003580 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-60167a09-2681-4750-832a-cf059cf2e575 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:50.003580 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-60167a09-2681-4750-832a-cf059cf2e575 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:50.003580 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-60167a09-2681-4750-832a-cf059cf2e575 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:50.003792 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-60167a09-2681-4750-832a-cf059cf2e575 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:50.003876 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-053a511d-9e6e-4589-9cb6-90c14ce1865d tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:50.003876 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-053a511d-9e6e-4589-9cb6-90c14ce1865d tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:50.003876 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-053a511d-9e6e-4589-9cb6-90c14ce1865d tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:50.003876 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-053a511d-9e6e-4589-9cb6-90c14ce1865d tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:50.085266 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-60167a09-2681-4750-832a-cf059cf2e575 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c64251f22f844077b4d9ce2617c11082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cb46777a914dbaa7c64c5047cc65e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:50.094811 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-60167a09-2681-4750-832a-cf059cf2e575 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] 10.222.0.35 "GET /compute/v2.1/servers/e6e43799-860e-4ae1-91cf-da1495ff9f64" status: 200 len: 1228 microversion: 2.1 time: 0.135430 Jun 10 17:58:50.095606 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 223/456] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:49 2022] GET /compute/v2.1/servers/e6e43799-860e-4ae1-91cf-da1495ff9f64 => generated 1228 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:50.120091 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-53090fc8-6cff-459a-9e44-d65bcf9f6aed req-93153aac-fc0c-4a21-b7b3-381ceca880a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fcc6103-9ecc-42f4-9df8-ac2251f06eed", "name": "network-vif-deleted", "tag": "4b121ede-995c-48cf-bc4f-79b98d59e314"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:50.140904 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-53090fc8-6cff-459a-9e44-d65bcf9f6aed req-93153aac-fc0c-4a21-b7b3-381ceca880a2 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:50.141641 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-53090fc8-6cff-459a-9e44-d65bcf9f6aed req-93153aac-fc0c-4a21-b7b3-381ceca880a2 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:50.158041 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-53090fc8-6cff-459a-9e44-d65bcf9f6aed req-93153aac-fc0c-4a21-b7b3-381ceca880a2 service nova] Creating event network-vif-deleted:4b121ede-995c-48cf-bc4f-79b98d59e314 for instance 1fcc6103-9ecc-42f4-9df8-ac2251f06eed on chh2-master-2 Jun 10 17:58:50.164742 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-53090fc8-6cff-459a-9e44-d65bcf9f6aed req-93153aac-fc0c-4a21-b7b3-381ceca880a2 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060979 Jun 10 17:58:50.165514 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 224/457] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:50.169577 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-053a511d-9e6e-4589-9cb6-90c14ce1865d tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19776e5adf942c6a20e4dea1aa10cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1fd6bd677ff4b17bafee8fad1d720a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:50.174577 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3f0394e7-c5ee-4d1e-b2af-6b2ff95b63e1 tempest-FlavorsAccessNegativeTestJSON-1536060213 tempest-FlavorsAccessNegativeTestJSON-1536060213-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "bc7dd1888b1b48d3946b46620361a7b2"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:50.184158 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:50.184158 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:50.184158 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3f0394e7-c5ee-4d1e-b2af-6b2ff95b63e1 tempest-FlavorsAccessNegativeTestJSON-1536060213 tempest-FlavorsAccessNegativeTestJSON-1536060213-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '34481172a7c74b659c51283ea103bb98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7dd1888b1b48d3946b46620361a7b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:50.184158 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3f0394e7-c5ee-4d1e-b2af-6b2ff95b63e1 tempest-FlavorsAccessNegativeTestJSON-1536060213 tempest-FlavorsAccessNegativeTestJSON-1536060213-project] Request method failure captured: Jun 10 17:58:50.184158 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/flavors/625582349/action HTTP/1.1 Jun 10 17:58:50.184158 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 17:58:50.184158 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 17:58:50.184158 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 17:58:50.184158 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 70 Jun 10 17:58:50.184158 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 17:58:50.184158 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 17:58:50.184158 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 17:58:50.184158 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:50.184158 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4ZVFaLXPjt2HWCgiQcVYFq0Szqk8TNI4EtCb2cJ5lrSoSr_pyOwYD_zf07HwC8HlsdHTkvMbR-zcdSAFACvSyOF7NmwIqL3cPkE1cxOLJj1o7Gvho72M-fKr9w1mm1lBbINOVd5SqftzUNoeerCbMl_SRDaC1SkytvvGhBUH29E2IA Jun 10 17:58:50.184158 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 17:58:50.184158 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 17:58:50.184158 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 17:58:50.184158 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 17:58:50.185172 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 17:58:50.185172 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 17:58:50.185172 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: bc7dd1888b1b48d3946b46620361a7b2 Jun 10 17:58:50.185172 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1536060213 Jun 10 17:58:50.185172 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 17:58:50.185172 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 17:58:50.185172 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/bc7dd1888b1b48d3946b46620361a7b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bc7dd1888b1b48d3946b46620361a7b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bc7dd1888b1b48d3946b46620361a7b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_bc7dd1888b1b48d3946b46620361a7b2", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:50.185172 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1536060213 Jun 10 17:58:50.185172 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: bc7dd1888b1b48d3946b46620361a7b2 Jun 10 17:58:50.185172 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1536060213 Jun 10 17:58:50.185172 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-FlavorsAccessNegativeTestJSON-1536060213-project Jun 10 17:58:50.185172 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 17:58:50.185172 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 17:58:50.185172 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 34481172a7c74b659c51283ea103bb98 Jun 10 17:58:50.185172 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1536060213-project Jun 10 17:58:50.185172 chdv-master-2 devstack@n-api.service[126594]: Jun 10 17:58:50.185172 chdv-master-2 devstack@n-api.service[126594]: {"removeTenantAccess": {"tenant": "bc7dd1888b1b48d3946b46620361a7b2"}} Jun 10 17:58:50.186073 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 17:58:50.186073 chdv-master-2 devstack@n-api.service[126594]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jun 10 17:58:50.186073 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '625582349', 'body': {'removeTenantAccess': {'tenant': 'bc7dd1888b1b48d3946b46620361a7b2'}}} Jun 10 17:58:50.186073 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:50.186073 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:50.186073 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:50.186073 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:50.186073 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:50.186073 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:50.186073 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:50.186073 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:50.186073 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 17:58:50.186073 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 17:58:50.186073 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Jun 10 17:58:50.186073 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi context.can( Jun 10 17:58:50.186073 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 10 17:58:50.186073 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 10 17:58:50.186073 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 10 17:58:50.186073 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 10 17:58:50.187129 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 17:58:50.187129 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 17:58:50.187129 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 17:58:50.187129 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 17:58:50.187129 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 10 17:58:50.187129 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 10 17:58:50.187129 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 10 17:58:50.187129 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 10 17:58:50.187129 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 10 17:58:50.187129 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 10 17:58:50.187129 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jun 10 17:58:50.187129 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:50.187129 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:50.187129 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:50.187129 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:50.187129 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:50.187129 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:50.187129 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 10 17:58:50.187129 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 10 17:58:50.188570 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jun 10 17:58:50.188570 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:50.188704 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-053a511d-9e6e-4589-9cb6-90c14ce1865d tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b" status: 200 len: 1318 microversion: 2.1 time: 0.190593 Jun 10 17:58:50.188781 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3f0394e7-c5ee-4d1e-b2af-6b2ff95b63e1 tempest-FlavorsAccessNegativeTestJSON-1536060213 tempest-FlavorsAccessNegativeTestJSON-1536060213-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:50.188860 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 234/458] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:49 2022] GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:50.188929 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3f0394e7-c5ee-4d1e-b2af-6b2ff95b63e1 tempest-FlavorsAccessNegativeTestJSON-1536060213 tempest-FlavorsAccessNegativeTestJSON-1536060213-project] 10.222.0.35 "POST /compute/v2.1/flavors/625582349/action" status: 403 len: 133 microversion: 2.1 time: 0.013376 Jun 10 17:58:50.188929 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 225/459] 10.222.0.35 () {60 vars in 1196 bytes} [Fri Jun 10 17:58:50 2022] POST /compute/v2.1/flavors/625582349/action => generated 133 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:58:50.192828 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0f7fb6d1-7f01-4690-94b1-ed5e06c973d7 tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "bc7dd1888b1b48d3946b46620361a7b2"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:50.194799 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:50.194799 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:50.378241 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0f7fb6d1-7f01-4690-94b1-ed5e06c973d7 tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] 10.222.0.35 "POST /compute/v2.1/flavors/625582349/action" status: 200 len: 21 microversion: 2.1 time: 0.193093 Jun 10 17:58:50.379868 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 235/460] 10.222.0.35 () {60 vars in 1196 bytes} [Fri Jun 10 17:58:50 2022] POST /compute/v2.1/flavors/625582349/action => generated 21 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 17:58:50.392435 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d9f180a7-9341-4187-af5f-9c6d207a9015 tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:50.393204 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:50.393204 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:50.509920 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d9f180a7-9341-4187-af5f-9c6d207a9015 tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] 10.222.0.35 "DELETE /compute/v2.1/flavors/625582349" status: 202 len: 0 microversion: 2.1 time: 0.121956 Jun 10 17:58:50.510603 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 226/461] 10.222.0.35 () {58 vars in 1157 bytes} [Fri Jun 10 17:58:50 2022] DELETE /compute/v2.1/flavors/625582349 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 17:58:50.520202 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-693afd7e-6fab-4218-a91c-d2a2900a0663 tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:50.539909 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-693afd7e-6fab-4218-a91c-d2a2900a0663 tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.023815 Jun 10 17:58:50.540487 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 236/462] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 17:58:50 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:50.548468 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ea45c217-a7fe-463a-ac8d-f2648ea8a111 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:50.549279 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ea45c217-a7fe-463a-ac8d-f2648ea8a111 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] [instance: 2b47ecdd-b178-49f2-a28f-bdedb4771918] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:50.556050 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ea45c217-a7fe-463a-ac8d-f2648ea8a111 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:50.556606 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ea45c217-a7fe-463a-ac8d-f2648ea8a111 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:50.557523 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ea45c217-a7fe-463a-ac8d-f2648ea8a111 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:50.558047 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ea45c217-a7fe-463a-ac8d-f2648ea8a111 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:50.562571 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3bf4d44a-39c1-4e9b-ab33-fd54f7e8028c tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-583643716", "id": 933092628, "os-flavor-access:is_public": "False"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:50.564062 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:50.564062 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:50.618656 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3bf4d44a-39c1-4e9b-ab33-fd54f7e8028c tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.060052 Jun 10 17:58:50.619267 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 237/463] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:58:50 2022] POST /compute/v2.1/flavors => generated 435 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 17:58:50.630686 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d38293e1-06f6-4dc1-9574-acd226829b98 tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "c47ce06f67ab4976b325b6c7fc940a78"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:50.706151 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ea45c217-a7fe-463a-ac8d-f2648ea8a111 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6942ee76c6e4b16a9ea45d595084df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cef3679b5a47e48376197d17220e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:50.713577 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ea45c217-a7fe-463a-ac8d-f2648ea8a111 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] 10.222.0.35 "GET /compute/v2.1/servers/2b47ecdd-b178-49f2-a28f-bdedb4771918" status: 200 len: 1323 microversion: 2.1 time: 0.169510 Jun 10 17:58:50.714136 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 227/464] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:50 2022] GET /compute/v2.1/servers/2b47ecdd-b178-49f2-a28f-bdedb4771918 => generated 1323 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:50.869460 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-d38293e1-06f6-4dc1-9574-acd226829b98 tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] HTTP exception thrown: Flavor access not found for 37 / c47ce06f67ab4976b325b6c7fc940a78 combination. Jun 10 17:58:50.871794 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d38293e1-06f6-4dc1-9574-acd226829b98 tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] Request method failure captured: Jun 10 17:58:50.871794 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/flavors/933092628/action HTTP/1.1 Jun 10 17:58:50.871794 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 17:58:50.871794 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 17:58:50.871794 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 17:58:50.871794 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 70 Jun 10 17:58:50.871794 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 17:58:50.871794 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 17:58:50.871794 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 17:58:50.871794 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:50.871794 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4ZW6I7UwV-75PwjSI1cnCIGAxcPu2meql0TcLZeM3nfNJmPYJJE-vC8PAzps6lF5VipXmGEquhJoxBCactKXf3E1tfDJVeC08Ste820uTgVKgW7FgUf6c76S5nY__4QtXWB5ESceqjPA9zCRrW9TWrVn2638uCA7xKIAqML0LndYE4 Jun 10 17:58:50.871794 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 17:58:50.871794 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 17:58:50.871794 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 17:58:50.871794 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 17:58:50.871794 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 17:58:50.871794 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 17:58:50.871794 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 3eb2b9661f3d45168220c2f6a022843f Jun 10 17:58:50.871794 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-215435388 Jun 10 17:58:50.871794 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member,admin Jun 10 17:58:50.871794 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member,admin Jun 10 17:58:50.873142 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/3eb2b9661f3d45168220c2f6a022843f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3eb2b9661f3d45168220c2f6a022843f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3eb2b9661f3d45168220c2f6a022843f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_3eb2b9661f3d45168220c2f6a022843f", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:50.873142 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-215435388 Jun 10 17:58:50.873142 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 3eb2b9661f3d45168220c2f6a022843f Jun 10 17:58:50.873142 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-215435388 Jun 10 17:58:50.873142 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin Jun 10 17:58:50.873142 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 17:58:50.873142 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 17:58:50.873142 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: dac7e1c4754e42358928773462489b28 Jun 10 17:58:50.873142 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin Jun 10 17:58:50.873142 chdv-master-2 devstack@n-api.service[126595]: Jun 10 17:58:50.873142 chdv-master-2 devstack@n-api.service[126595]: {"removeTenantAccess": {"tenant": "c47ce06f67ab4976b325b6c7fc940a78"}} Jun 10 17:58:50.873142 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 17:58:50.873826 chdv-master-2 devstack@n-api.service[126595]: exception: Flavor access not found for 37 / c47ce06f67ab4976b325b6c7fc940a78 combination. Jun 10 17:58:50.873826 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '933092628', 'body': {'removeTenantAccess': {'tenant': 'c47ce06f67ab4976b325b6c7fc940a78'}}} Jun 10 17:58:50.873826 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:50.873826 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:50.873826 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Jun 10 17:58:50.873826 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Jun 10 17:58:50.873826 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 10 17:58:50.873826 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 10 17:58:50.873826 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Jun 10 17:58:50.873826 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Jun 10 17:58:50.873826 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Jun 10 17:58:50.873826 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Jun 10 17:58:50.873826 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Jun 10 17:58:50.873826 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Jun 10 17:58:50.873826 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 10 17:58:50.873826 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 10 17:58:50.873826 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Jun 10 17:58:50.873826 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Jun 10 17:58:50.875350 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 37 / c47ce06f67ab4976b325b6c7fc940a78 combination. Jun 10 17:58:50.875350 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:50.875350 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:50.875350 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:50.875350 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:50.875350 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:50.875350 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:50.875350 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:50.875350 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:50.875350 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:50.875350 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:50.875350 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 17:58:50.875350 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 17:58:50.875350 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Jun 10 17:58:50.875350 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 10 17:58:50.875350 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 37 / c47ce06f67ab4976b325b6c7fc940a78 combination. Jun 10 17:58:50.875350 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:50.875350 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:50.875350 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:50.875350 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:50.877180 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:50.877180 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:50.877180 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:58:50.877180 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:58:50.877180 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 37 / c47ce06f67ab4976b325b6c7fc940a78 combination. Jun 10 17:58:50.877180 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:50.877180 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d38293e1-06f6-4dc1-9574-acd226829b98 tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] Returning 404 to user: Flavor access not found for 37 / c47ce06f67ab4976b325b6c7fc940a78 combination. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:50.877180 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d38293e1-06f6-4dc1-9574-acd226829b98 tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] 10.222.0.35 "POST /compute/v2.1/flavors/933092628/action" status: 404 len: 124 microversion: 2.1 time: 0.246526 Jun 10 17:58:50.877180 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 238/465] 10.222.0.35 () {60 vars in 1196 bytes} [Fri Jun 10 17:58:50 2022] POST /compute/v2.1/flavors/933092628/action => generated 124 bytes in 248 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:58:50.877835 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e5d7e6b6-d9e4-4292-a433-77dc39b04671 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:50.877835 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e5d7e6b6-d9e4-4292-a433-77dc39b04671 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 1fcc6103-9ecc-42f4-9df8-ac2251f06eed] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:50.882305 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5310164c-1f0d-472d-b931-b5ed10bec815 tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:50.882931 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e5d7e6b6-d9e4-4292-a433-77dc39b04671 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:50.883029 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:50.883029 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:58:50.883389 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e5d7e6b6-d9e4-4292-a433-77dc39b04671 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:50.884161 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e5d7e6b6-d9e4-4292-a433-77dc39b04671 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:50.884730 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e5d7e6b6-d9e4-4292-a433-77dc39b04671 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:50.915194 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e5d7e6b6-d9e4-4292-a433-77dc39b04671 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:50.915693 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e5d7e6b6-d9e4-4292-a433-77dc39b04671 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:50.916140 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-e5d7e6b6-d9e4-4292-a433-77dc39b04671 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lazy-loading 'fault' on Instance uuid 1fcc6103-9ecc-42f4-9df8-ac2251f06eed {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 17:58:50.956353 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e5d7e6b6-d9e4-4292-a433-77dc39b04671 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '680f0e3161f74f139dae76fab34293bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175eeed60130438eaf02299dc72b708d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:50.960672 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5310164c-1f0d-472d-b931-b5ed10bec815 tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] 10.222.0.35 "DELETE /compute/v2.1/flavors/933092628" status: 202 len: 0 microversion: 2.1 time: 0.081829 Jun 10 17:58:50.961389 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 239/466] 10.222.0.35 () {58 vars in 1157 bytes} [Fri Jun 10 17:58:50 2022] DELETE /compute/v2.1/flavors/933092628 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 17:58:50.969250 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-65e1b569-be7a-4ac5-b171-51e3c879e262 tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:50.970112 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e5d7e6b6-d9e4-4292-a433-77dc39b04671 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed" status: 200 len: 1310 microversion: 2.1 time: 0.099160 Jun 10 17:58:50.971390 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 228/467] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:50 2022] GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed => generated 1310 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:58:51.006341 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-65e1b569-be7a-4ac5-b171-51e3c879e262 tempest-FlavorsAccessNegativeTestJSON-215435388 tempest-FlavorsAccessNegativeTestJSON-215435388-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.040452 Jun 10 17:58:51.007785 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 240/468] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 17:58:50 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:51.026207 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a33d6a3c-8df7-4211-9e02-757ec5cec8ec tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:51.027078 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a33d6a3c-8df7-4211-9e02-757ec5cec8ec tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: c9b75acf-e4fe-425e-9398-40c4ac1a108b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:51.035138 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a33d6a3c-8df7-4211-9e02-757ec5cec8ec tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:51.035599 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a33d6a3c-8df7-4211-9e02-757ec5cec8ec tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:51.036579 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a33d6a3c-8df7-4211-9e02-757ec5cec8ec tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:51.037447 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a33d6a3c-8df7-4211-9e02-757ec5cec8ec tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:51.103389 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a33d6a3c-8df7-4211-9e02-757ec5cec8ec tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:51.104368 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a33d6a3c-8df7-4211-9e02-757ec5cec8ec tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:51.105014 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-a33d6a3c-8df7-4211-9e02-757ec5cec8ec tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lazy-loading 'fault' on Instance uuid c9b75acf-e4fe-425e-9398-40c4ac1a108b {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 17:58:51.112129 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-807ed2a0-6262-4f79-98b5-7452f44f2a8d tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:51.112800 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-807ed2a0-6262-4f79-98b5-7452f44f2a8d tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] [instance: e6e43799-860e-4ae1-91cf-da1495ff9f64] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:51.123470 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-807ed2a0-6262-4f79-98b5-7452f44f2a8d tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:51.124098 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-807ed2a0-6262-4f79-98b5-7452f44f2a8d tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:51.125280 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-807ed2a0-6262-4f79-98b5-7452f44f2a8d tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:51.125905 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-807ed2a0-6262-4f79-98b5-7452f44f2a8d tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:51.155931 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a33d6a3c-8df7-4211-9e02-757ec5cec8ec tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a75d420afea440fba308b4ed26fd544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141d09ed6e1548d996a675ec1f1011b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:51.164943 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a33d6a3c-8df7-4211-9e02-757ec5cec8ec tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b" status: 200 len: 1312 microversion: 2.1 time: 0.143193 Jun 10 17:58:51.165522 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 229/469] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:51 2022] GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b => generated 1312 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:51.202035 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7f101e35-9365-48a9-9dbf-913732bcdad7 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:51.202792 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7f101e35-9365-48a9-9dbf-913732bcdad7 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: 95e3fefa-48f8-42be-95a1-a58e3980db9b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:51.203893 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-807ed2a0-6262-4f79-98b5-7452f44f2a8d tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c64251f22f844077b4d9ce2617c11082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cb46777a914dbaa7c64c5047cc65e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:51.209104 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7f101e35-9365-48a9-9dbf-913732bcdad7 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:51.209560 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7f101e35-9365-48a9-9dbf-913732bcdad7 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:51.210329 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7f101e35-9365-48a9-9dbf-913732bcdad7 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:51.210768 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7f101e35-9365-48a9-9dbf-913732bcdad7 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:51.211358 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-807ed2a0-6262-4f79-98b5-7452f44f2a8d tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] 10.222.0.35 "GET /compute/v2.1/servers/e6e43799-860e-4ae1-91cf-da1495ff9f64" status: 200 len: 1276 microversion: 2.1 time: 0.103643 Jun 10 17:58:51.211932 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 241/470] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:51 2022] GET /compute/v2.1/servers/e6e43799-860e-4ae1-91cf-da1495ff9f64 => generated 1276 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:58:51.419392 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7f101e35-9365-48a9-9dbf-913732bcdad7 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19776e5adf942c6a20e4dea1aa10cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1fd6bd677ff4b17bafee8fad1d720a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:51.433142 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7f101e35-9365-48a9-9dbf-913732bcdad7 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b" status: 200 len: 1468 microversion: 2.1 time: 0.234999 Jun 10 17:58:51.434149 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 230/471] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:51 2022] GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b => generated 1468 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:58:51.451775 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0ed6ecca-6ef8-44f0-ac70-124147ccc343 tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:51.453213 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0ed6ecca-6ef8-44f0-ac70-124147ccc343 tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] [instance: 95e3fefa-48f8-42be-95a1-a58e3980db9b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:51.459414 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0ed6ecca-6ef8-44f0-ac70-124147ccc343 tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:51.459946 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0ed6ecca-6ef8-44f0-ac70-124147ccc343 tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:51.460745 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0ed6ecca-6ef8-44f0-ac70-124147ccc343 tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:51.461195 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0ed6ecca-6ef8-44f0-ac70-124147ccc343 tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:51.536886 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-0ed6ecca-6ef8-44f0-ac70-124147ccc343 tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] Lazy-loading 'flavor' on Instance uuid 95e3fefa-48f8-42be-95a1-a58e3980db9b {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 17:58:51.731438 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d063952f-5068-429f-afa3-c33f44d73ec5 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:51.732227 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d063952f-5068-429f-afa3-c33f44d73ec5 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] [instance: 2b47ecdd-b178-49f2-a28f-bdedb4771918] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:51.740823 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d063952f-5068-429f-afa3-c33f44d73ec5 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:51.740823 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d063952f-5068-429f-afa3-c33f44d73ec5 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:51.741289 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d063952f-5068-429f-afa3-c33f44d73ec5 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:51.741731 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d063952f-5068-429f-afa3-c33f44d73ec5 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:51.912789 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0ed6ecca-6ef8-44f0-ac70-124147ccc343 tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] 10.222.0.35 "POST /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b/action" status: 202 len: 0 microversion: 2.1 time: 0.466117 Jun 10 17:58:51.914236 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 242/472] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 17:58:51 2022] POST /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b/action => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 17:58:51.933262 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-83f15ca6-eb82-4940-a313-461a0cac3e49 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:51.934923 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-83f15ca6-eb82-4940-a313-461a0cac3e49 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: 95e3fefa-48f8-42be-95a1-a58e3980db9b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:51.944230 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83f15ca6-eb82-4940-a313-461a0cac3e49 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:51.945096 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83f15ca6-eb82-4940-a313-461a0cac3e49 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:51.946159 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83f15ca6-eb82-4940-a313-461a0cac3e49 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:51.946871 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83f15ca6-eb82-4940-a313-461a0cac3e49 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:51.978117 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d063952f-5068-429f-afa3-c33f44d73ec5 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6942ee76c6e4b16a9ea45d595084df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cef3679b5a47e48376197d17220e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:51.989290 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d063952f-5068-429f-afa3-c33f44d73ec5 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] 10.222.0.35 "GET /compute/v2.1/servers/2b47ecdd-b178-49f2-a28f-bdedb4771918" status: 200 len: 1473 microversion: 2.1 time: 0.261827 Jun 10 17:58:51.989874 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 231/473] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:51 2022] GET /compute/v2.1/servers/2b47ecdd-b178-49f2-a28f-bdedb4771918 => generated 1473 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:58:52.001507 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9232b247-b39a-4b5b-a66d-dbede922f89a tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:52.002951 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9232b247-b39a-4b5b-a66d-dbede922f89a tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 1fcc6103-9ecc-42f4-9df8-ac2251f06eed] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:52.009763 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9232b247-b39a-4b5b-a66d-dbede922f89a tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:52.010417 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9232b247-b39a-4b5b-a66d-dbede922f89a tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:52.011352 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9232b247-b39a-4b5b-a66d-dbede922f89a tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:52.011790 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9232b247-b39a-4b5b-a66d-dbede922f89a tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:52.033527 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-9232b247-b39a-4b5b-a66d-dbede922f89a tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] HTTP exception thrown: Instance 1fcc6103-9ecc-42f4-9df8-ac2251f06eed could not be found. Jun 10 17:58:52.036128 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9232b247-b39a-4b5b-a66d-dbede922f89a tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Request method failure captured: Jun 10 17:58:52.036128 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed HTTP/1.1 Jun 10 17:58:52.036128 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 17:58:52.036128 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 17:58:52.036128 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 17:58:52.036128 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 17:58:52.036128 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 17:58:52.036128 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 17:58:52.036128 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 17:58:52.036128 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:52.036128 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4YMziWCTAU0ECivXoRxTAmNyX7m5R2ybjAG4_pkm4uGzetr0UivZNtFpFqllUCykYtsNoP13IOG7RwH60UYZ0ry6CCO_ht7yXG6Jn4pVasvKK8YtIJealFaS43MeShKArcTJ1-SWv0E6Et_2sP5P22_Ndb-ggAg2fGG71kKTkDHg60 Jun 10 17:58:52.036128 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 17:58:52.036128 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 17:58:52.036128 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 17:58:52.036128 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 17:58:52.036128 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 17:58:52.036128 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 17:58:52.036128 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 175eeed60130438eaf02299dc72b708d Jun 10 17:58:52.036128 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-DeleteServersAdminTestJSON-765056364 Jun 10 17:58:52.036128 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 17:58:52.036128 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 17:58:52.037727 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/175eeed60130438eaf02299dc72b708d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/175eeed60130438eaf02299dc72b708d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/175eeed60130438eaf02299dc72b708d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_175eeed60130438eaf02299dc72b708d", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:52.037727 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-DeleteServersAdminTestJSON-765056364 Jun 10 17:58:52.037727 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 175eeed60130438eaf02299dc72b708d Jun 10 17:58:52.037727 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-765056364 Jun 10 17:58:52.037727 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-DeleteServersAdminTestJSON-765056364-project Jun 10 17:58:52.037727 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 17:58:52.037727 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 17:58:52.037727 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 680f0e3161f74f139dae76fab34293bb Jun 10 17:58:52.037727 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-DeleteServersAdminTestJSON-765056364-project Jun 10 17:58:52.037727 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 17:58:52.037727 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 1fcc6103-9ecc-42f4-9df8-ac2251f06eed could not be found. Jun 10 17:58:52.037727 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '1fcc6103-9ecc-42f4-9df8-ac2251f06eed'} Jun 10 17:58:52.038558 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:52.038558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:52.038558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 17:58:52.038558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 17:58:52.038558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 17:58:52.038558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 17:58:52.038558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 17:58:52.038558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 17:58:52.038558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 17:58:52.038558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 17:58:52.038558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fcc6103-9ecc-42f4-9df8-ac2251f06eed could not be found. Jun 10 17:58:52.038558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:52.038558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:52.038558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:52.038558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:52.038558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:52.038558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:52.038558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:52.038558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:52.038558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:52.039854 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:52.039854 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 17:58:52.039854 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 17:58:52.039854 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 17:58:52.039854 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 17:58:52.039854 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 17:58:52.039854 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 17:58:52.039854 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fcc6103-9ecc-42f4-9df8-ac2251f06eed could not be found. Jun 10 17:58:52.039854 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:52.039854 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:52.039854 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:52.039854 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:52.039854 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:52.039854 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:52.039854 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:58:52.039854 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:58:52.039854 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fcc6103-9ecc-42f4-9df8-ac2251f06eed could not be found. Jun 10 17:58:52.039854 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:52.042222 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9232b247-b39a-4b5b-a66d-dbede922f89a tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Returning 404 to user: Instance 1fcc6103-9ecc-42f4-9df8-ac2251f06eed could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:52.043331 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9232b247-b39a-4b5b-a66d-dbede922f89a tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed" status: 404 len: 111 microversion: 2.1 time: 0.052203 Jun 10 17:58:52.049807 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 232/474] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:51 2022] GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:58:52.059722 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d15ac2f9-f693-4128-9a59-4932be7824d9 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:52.060984 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d15ac2f9-f693-4128-9a59-4932be7824d9 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] [instance: 2b47ecdd-b178-49f2-a28f-bdedb4771918] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:52.068935 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d15ac2f9-f693-4128-9a59-4932be7824d9 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:52.069675 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d15ac2f9-f693-4128-9a59-4932be7824d9 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:52.070865 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d15ac2f9-f693-4128-9a59-4932be7824d9 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:52.071599 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d15ac2f9-f693-4128-9a59-4932be7824d9 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:52.098966 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d15ac2f9-f693-4128-9a59-4932be7824d9 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'd6942ee76c6e4b16a9ea45d595084df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cef3679b5a47e48376197d17220e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:52.100913 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d15ac2f9-f693-4128-9a59-4932be7824d9 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Request method failure captured: Jun 10 17:58:52.100913 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/2b47ecdd-b178-49f2-a28f-bdedb4771918/diagnostics HTTP/1.1 Jun 10 17:58:52.100913 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 17:58:52.100913 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 17:58:52.100913 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 17:58:52.100913 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 17:58:52.100913 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 17:58:52.100913 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 17:58:52.100913 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 17:58:52.100913 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:52.100913 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4ZGPY-9ZMEj2JUPLS5KGCLD_wA4gFbDR_nQcg88oIqljPwzvsToueGD0dYsuvwzYJh1psgv7iq1jkilHHdvYz9JR8DgUzsRMxfkaPsakGxtAq_hc-ByyZXiWQUmfeK3FltDfouLw88JffaTZFjIDMMzvDsmVNxwRxvXmSfsFj2WsvA Jun 10 17:58:52.100913 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 17:58:52.100913 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 17:58:52.100913 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 17:58:52.100913 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 17:58:52.100913 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 17:58:52.100913 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 17:58:52.100913 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: a5cef3679b5a47e48376197d17220e36 Jun 10 17:58:52.100913 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-951653344 Jun 10 17:58:52.100913 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 17:58:52.100913 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 17:58:52.102080 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/a5cef3679b5a47e48376197d17220e36"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a5cef3679b5a47e48376197d17220e36"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a5cef3679b5a47e48376197d17220e36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_a5cef3679b5a47e48376197d17220e36", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:52.102080 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-951653344 Jun 10 17:58:52.102080 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: a5cef3679b5a47e48376197d17220e36 Jun 10 17:58:52.102080 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-951653344 Jun 10 17:58:52.102080 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServerDiagnosticsNegativeTest-951653344-project Jun 10 17:58:52.102080 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 17:58:52.102080 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 17:58:52.102080 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: d6942ee76c6e4b16a9ea45d595084df2 Jun 10 17:58:52.102080 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-951653344-project Jun 10 17:58:52.102080 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 17:58:52.102080 chdv-master-2 devstack@n-api.service[126594]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jun 10 17:58:52.102708 chdv-master-2 devstack@n-api.service[126594]: action_args: {'server_id': '2b47ecdd-b178-49f2-a28f-bdedb4771918'} Jun 10 17:58:52.102708 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:52.102708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:52.102708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:52.102708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:52.102708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:52.102708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:52.102708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:52.102708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:52.102708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Jun 10 17:58:52.102708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Jun 10 17:58:52.102708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 10 17:58:52.102708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 10 17:58:52.102708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 10 17:58:52.102708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 10 17:58:52.102708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 17:58:52.102708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 17:58:52.102708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 17:58:52.102708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 17:58:52.102708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 10 17:58:52.109884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 10 17:58:52.109884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 10 17:58:52.109884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 10 17:58:52.109884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 10 17:58:52.109884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 10 17:58:52.109884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jun 10 17:58:52.109884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:52.109884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:52.109884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:52.109884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:52.109884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:52.109884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:52.109884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 10 17:58:52.109884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 10 17:58:52.109884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jun 10 17:58:52.109884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:52.109884 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d15ac2f9-f693-4128-9a59-4932be7824d9 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:52.115796 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d15ac2f9-f693-4128-9a59-4932be7824d9 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] 10.222.0.35 "GET /compute/v2.1/servers/2b47ecdd-b178-49f2-a28f-bdedb4771918/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.051688 Jun 10 17:58:52.115796 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 233/475] 10.222.0.35 () {58 vars in 1271 bytes} [Fri Jun 10 17:58:52 2022] GET /compute/v2.1/servers/2b47ecdd-b178-49f2-a28f-bdedb4771918/diagnostics => generated 117 bytes in 53 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:58:52.115796 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4338dfdf-9591-413d-aada-a962a356638f tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:52.115796 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4338dfdf-9591-413d-aada-a962a356638f tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 1fcc6103-9ecc-42f4-9df8-ac2251f06eed] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:52.116130 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4338dfdf-9591-413d-aada-a962a356638f tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:52.116415 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4338dfdf-9591-413d-aada-a962a356638f tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:52.117100 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4338dfdf-9591-413d-aada-a962a356638f tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:52.117532 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4338dfdf-9591-413d-aada-a962a356638f tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:52.131744 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-4338dfdf-9591-413d-aada-a962a356638f tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] HTTP exception thrown: Instance 1fcc6103-9ecc-42f4-9df8-ac2251f06eed could not be found. Jun 10 17:58:52.133475 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4338dfdf-9591-413d-aada-a962a356638f tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Request method failure captured: Jun 10 17:58:52.133475 chdv-master-2 devstack@n-api.service[126594]: request: DELETE /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed HTTP/1.1 Jun 10 17:58:52.133475 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 17:58:52.133475 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 17:58:52.133475 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 17:58:52.133475 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 17:58:52.133475 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 17:58:52.133475 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 17:58:52.133475 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 17:58:52.133475 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:52.133475 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4YMziWCTAU0ECivXoRxTAmNyX7m5R2ybjAG4_pkm4uGzetr0UivZNtFpFqllUCykYtsNoP13IOG7RwH60UYZ0ry6CCO_ht7yXG6Jn4pVasvKK8YtIJealFaS43MeShKArcTJ1-SWv0E6Et_2sP5P22_Ndb-ggAg2fGG71kKTkDHg60 Jun 10 17:58:52.133475 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 17:58:52.133475 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 17:58:52.133475 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 17:58:52.133475 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 17:58:52.133475 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 17:58:52.133475 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 17:58:52.133475 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 175eeed60130438eaf02299dc72b708d Jun 10 17:58:52.133475 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-DeleteServersAdminTestJSON-765056364 Jun 10 17:58:52.133475 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 17:58:52.133475 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 17:58:52.144195 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/175eeed60130438eaf02299dc72b708d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/175eeed60130438eaf02299dc72b708d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/175eeed60130438eaf02299dc72b708d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_175eeed60130438eaf02299dc72b708d", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:52.144195 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-DeleteServersAdminTestJSON-765056364 Jun 10 17:58:52.144195 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 175eeed60130438eaf02299dc72b708d Jun 10 17:58:52.144195 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-765056364 Jun 10 17:58:52.144195 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-DeleteServersAdminTestJSON-765056364-project Jun 10 17:58:52.144195 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 17:58:52.144195 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 17:58:52.144195 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 680f0e3161f74f139dae76fab34293bb Jun 10 17:58:52.144195 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-DeleteServersAdminTestJSON-765056364-project Jun 10 17:58:52.144195 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 17:58:52.144195 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 1fcc6103-9ecc-42f4-9df8-ac2251f06eed could not be found. Jun 10 17:58:52.144195 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '1fcc6103-9ecc-42f4-9df8-ac2251f06eed'} Jun 10 17:58:52.145056 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:52.145056 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:52.145056 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 17:58:52.145056 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 17:58:52.145056 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 17:58:52.145056 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 17:58:52.145056 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 17:58:52.145056 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 17:58:52.145056 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 17:58:52.145056 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 17:58:52.145056 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fcc6103-9ecc-42f4-9df8-ac2251f06eed could not be found. Jun 10 17:58:52.145056 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:52.145056 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:52.145056 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:52.145056 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:52.145056 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:52.145056 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:52.145056 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:52.145056 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:52.145056 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:52.146225 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:52.146225 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 17:58:52.146225 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 17:58:52.146225 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 17:58:52.146225 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 17:58:52.146225 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 17:58:52.146225 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 17:58:52.146225 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 17:58:52.146225 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 17:58:52.146225 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fcc6103-9ecc-42f4-9df8-ac2251f06eed could not be found. Jun 10 17:58:52.146225 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:52.146225 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:52.146225 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:52.146225 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:52.146225 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:52.146225 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:52.146225 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:58:52.146225 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:58:52.146225 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fcc6103-9ecc-42f4-9df8-ac2251f06eed could not be found. Jun 10 17:58:52.146225 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:52.147294 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4338dfdf-9591-413d-aada-a962a356638f tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Returning 404 to user: Instance 1fcc6103-9ecc-42f4-9df8-ac2251f06eed could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:52.147294 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4338dfdf-9591-413d-aada-a962a356638f tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "DELETE /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed" status: 404 len: 111 microversion: 2.1 time: 0.030618 Jun 10 17:58:52.147294 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 234/476] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 17:58:52 2022] DELETE /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:58:52.147294 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-779ce585-6a1e-4bc8-8d02-78ffd8b22cee tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:52.147294 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-779ce585-6a1e-4bc8-8d02-78ffd8b22cee tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] [instance: 2b47ecdd-b178-49f2-a28f-bdedb4771918] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:52.150948 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-779ce585-6a1e-4bc8-8d02-78ffd8b22cee tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:52.151662 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-779ce585-6a1e-4bc8-8d02-78ffd8b22cee tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:52.152621 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-779ce585-6a1e-4bc8-8d02-78ffd8b22cee tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:52.153056 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-779ce585-6a1e-4bc8-8d02-78ffd8b22cee tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:52.187630 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-779ce585-6a1e-4bc8-8d02-78ffd8b22cee tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] [instance: 2b47ecdd-b178-49f2-a28f-bdedb4771918] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 17:58:52.191046 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:58:52.212350 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-83f15ca6-eb82-4940-a313-461a0cac3e49 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19776e5adf942c6a20e4dea1aa10cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1fd6bd677ff4b17bafee8fad1d720a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:52.223580 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-83f15ca6-eb82-4940-a313-461a0cac3e49 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b" status: 200 len: 1476 microversion: 2.1 time: 0.296686 Jun 10 17:58:52.235203 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 243/477] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:51 2022] GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b => generated 1476 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:52.243652 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4dff8606-9139-4288-91fe-cfe151bb3304 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:52.244699 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4dff8606-9139-4288-91fe-cfe151bb3304 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 1fcc6103-9ecc-42f4-9df8-ac2251f06eed] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:52.252355 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4dff8606-9139-4288-91fe-cfe151bb3304 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:52.252355 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4dff8606-9139-4288-91fe-cfe151bb3304 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:52.253138 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4dff8606-9139-4288-91fe-cfe151bb3304 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:52.253741 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4dff8606-9139-4288-91fe-cfe151bb3304 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:52.268270 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-4dff8606-9139-4288-91fe-cfe151bb3304 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] HTTP exception thrown: Instance 1fcc6103-9ecc-42f4-9df8-ac2251f06eed could not be found. Jun 10 17:58:52.269914 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4dff8606-9139-4288-91fe-cfe151bb3304 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Request method failure captured: Jun 10 17:58:52.269914 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed HTTP/1.1 Jun 10 17:58:52.269914 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 17:58:52.269914 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 17:58:52.269914 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 17:58:52.269914 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 17:58:52.269914 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 17:58:52.269914 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 17:58:52.269914 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 17:58:52.269914 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:52.269914 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4YMziWCTAU0ECivXoRxTAmNyX7m5R2ybjAG4_pkm4uGzetr0UivZNtFpFqllUCykYtsNoP13IOG7RwH60UYZ0ry6CCO_ht7yXG6Jn4pVasvKK8YtIJealFaS43MeShKArcTJ1-SWv0E6Et_2sP5P22_Ndb-ggAg2fGG71kKTkDHg60 Jun 10 17:58:52.269914 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 17:58:52.269914 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 17:58:52.269914 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 17:58:52.269914 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 17:58:52.269914 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 17:58:52.269914 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 17:58:52.269914 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 175eeed60130438eaf02299dc72b708d Jun 10 17:58:52.269914 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-DeleteServersAdminTestJSON-765056364 Jun 10 17:58:52.269914 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 17:58:52.269914 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 17:58:52.271093 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/175eeed60130438eaf02299dc72b708d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/175eeed60130438eaf02299dc72b708d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/175eeed60130438eaf02299dc72b708d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_175eeed60130438eaf02299dc72b708d", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:52.271093 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-DeleteServersAdminTestJSON-765056364 Jun 10 17:58:52.271093 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 175eeed60130438eaf02299dc72b708d Jun 10 17:58:52.271093 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-765056364 Jun 10 17:58:52.271093 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-DeleteServersAdminTestJSON-765056364-project Jun 10 17:58:52.271093 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 17:58:52.271093 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 17:58:52.271093 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 680f0e3161f74f139dae76fab34293bb Jun 10 17:58:52.271093 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-DeleteServersAdminTestJSON-765056364-project Jun 10 17:58:52.271093 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 17:58:52.271093 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 1fcc6103-9ecc-42f4-9df8-ac2251f06eed could not be found. Jun 10 17:58:52.271093 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '1fcc6103-9ecc-42f4-9df8-ac2251f06eed'} Jun 10 17:58:52.272444 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:52.272444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:52.272444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 17:58:52.272444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 17:58:52.272444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 17:58:52.272444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 17:58:52.272444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 17:58:52.272444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 17:58:52.272444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 17:58:52.272444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 17:58:52.272444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fcc6103-9ecc-42f4-9df8-ac2251f06eed could not be found. Jun 10 17:58:52.272444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:52.272444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:52.272444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:52.272444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:52.272444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:52.272444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:52.272444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:52.272444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:52.272444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:52.276904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:52.276904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 17:58:52.276904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 17:58:52.276904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 17:58:52.276904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 17:58:52.276904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 17:58:52.276904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 17:58:52.276904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fcc6103-9ecc-42f4-9df8-ac2251f06eed could not be found. Jun 10 17:58:52.276904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:52.276904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:52.276904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:52.276904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:52.276904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:52.276904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:52.276904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:58:52.276904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:58:52.276904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fcc6103-9ecc-42f4-9df8-ac2251f06eed could not be found. Jun 10 17:58:52.276904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:52.278284 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4dff8606-9139-4288-91fe-cfe151bb3304 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Returning 404 to user: Instance 1fcc6103-9ecc-42f4-9df8-ac2251f06eed could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:52.278284 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4dff8606-9139-4288-91fe-cfe151bb3304 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed" status: 404 len: 111 microversion: 2.1 time: 0.034874 Jun 10 17:58:52.278284 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 244/478] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:52 2022] GET /compute/v2.1/servers/1fcc6103-9ecc-42f4-9df8-ac2251f06eed => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:58:52.278284 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-efb4bef5-d126-4770-bcb4-38413cd58f3f req-efedb87e-3c4a-4f17-88a0-5dfc3783b304 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9b75acf-e4fe-425e-9398-40c4ac1a108b", "name": "network-vif-deleted", "tag": "7d50bd88-4d71-4153-a03a-78aa249d08c5"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:52.285311 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-efb4bef5-d126-4770-bcb4-38413cd58f3f req-efedb87e-3c4a-4f17-88a0-5dfc3783b304 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:52.285821 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-efb4bef5-d126-4770-bcb4-38413cd58f3f req-efedb87e-3c4a-4f17-88a0-5dfc3783b304 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:52.297035 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-efb4bef5-d126-4770-bcb4-38413cd58f3f req-efedb87e-3c4a-4f17-88a0-5dfc3783b304 service nova] Creating event network-vif-deleted:7d50bd88-4d71-4153-a03a-78aa249d08c5 for instance c9b75acf-e4fe-425e-9398-40c4ac1a108b on chh2-master-2 Jun 10 17:58:52.302104 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-efb4bef5-d126-4770-bcb4-38413cd58f3f req-efedb87e-3c4a-4f17-88a0-5dfc3783b304 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029075 Jun 10 17:58:52.302698 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 245/479] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:52.307931 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8011074d-5536-4197-a1e2-b54a9ef60459 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:52.308670 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8011074d-5536-4197-a1e2-b54a9ef60459 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] [instance: c9b75acf-e4fe-425e-9398-40c4ac1a108b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:52.315014 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8011074d-5536-4197-a1e2-b54a9ef60459 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:52.315463 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8011074d-5536-4197-a1e2-b54a9ef60459 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:52.316231 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8011074d-5536-4197-a1e2-b54a9ef60459 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:52.316702 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8011074d-5536-4197-a1e2-b54a9ef60459 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:52.330197 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-8011074d-5536-4197-a1e2-b54a9ef60459 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] HTTP exception thrown: Instance c9b75acf-e4fe-425e-9398-40c4ac1a108b could not be found. Jun 10 17:58:52.331847 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8011074d-5536-4197-a1e2-b54a9ef60459 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Request method failure captured: Jun 10 17:58:52.331847 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b HTTP/1.1 Jun 10 17:58:52.331847 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 17:58:52.331847 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 17:58:52.331847 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 17:58:52.331847 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 17:58:52.331847 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 17:58:52.331847 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 17:58:52.331847 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 17:58:52.331847 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:52.331847 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4YGEZD5boKKHpcl1a20bjbS6lQYO7AqpKAd9v-d1nMuTXtyQUeBH3XgkmBh1nPboKIHzN2xZti1tQDLoWAnMnxYPAJBzzBgmj44w7EhGheBHNa-o1GmH5VqiSfjuRCE1jg8rRmEmbqbZzs1FxTIxs_GQXP1taJlN0dzqdusw7pB0UU Jun 10 17:58:52.331847 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 17:58:52.331847 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 17:58:52.331847 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 17:58:52.331847 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 17:58:52.331847 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 17:58:52.331847 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 17:58:52.331847 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 141d09ed6e1548d996a675ec1f1011b7 Jun 10 17:58:52.331847 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1230602466 Jun 10 17:58:52.331847 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 17:58:52.331847 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 17:58:52.333261 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/141d09ed6e1548d996a675ec1f1011b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/141d09ed6e1548d996a675ec1f1011b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/141d09ed6e1548d996a675ec1f1011b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_141d09ed6e1548d996a675ec1f1011b7", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:52.333261 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1230602466 Jun 10 17:58:52.333261 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 141d09ed6e1548d996a675ec1f1011b7 Jun 10 17:58:52.333261 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1230602466 Jun 10 17:58:52.333261 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersAdminNegativeTestJSON-1230602466-project Jun 10 17:58:52.333261 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 17:58:52.333261 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 17:58:52.333261 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 0a75d420afea440fba308b4ed26fd544 Jun 10 17:58:52.333261 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1230602466-project Jun 10 17:58:52.333261 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 17:58:52.333261 chdv-master-2 devstack@n-api.service[126595]: exception: Instance c9b75acf-e4fe-425e-9398-40c4ac1a108b could not be found. Jun 10 17:58:52.333261 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'c9b75acf-e4fe-425e-9398-40c4ac1a108b'} Jun 10 17:58:52.334098 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:52.334098 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:52.334098 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 17:58:52.334098 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 17:58:52.334098 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 17:58:52.334098 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 17:58:52.334098 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 17:58:52.334098 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 17:58:52.334098 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 17:58:52.334098 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 17:58:52.334098 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9b75acf-e4fe-425e-9398-40c4ac1a108b could not be found. Jun 10 17:58:52.334098 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:52.334098 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:52.334098 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:52.334098 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:52.334098 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:52.334098 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:52.334098 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:52.334098 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:52.334098 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:52.335332 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:52.335332 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 17:58:52.335332 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 17:58:52.335332 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 17:58:52.335332 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 17:58:52.335332 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 17:58:52.335332 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 17:58:52.335332 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9b75acf-e4fe-425e-9398-40c4ac1a108b could not be found. Jun 10 17:58:52.335332 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:52.335332 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:52.335332 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:52.335332 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:52.335332 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:52.335332 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:52.335332 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:58:52.335332 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:58:52.335332 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9b75acf-e4fe-425e-9398-40c4ac1a108b could not be found. Jun 10 17:58:52.335332 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:52.336545 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8011074d-5536-4197-a1e2-b54a9ef60459 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] Returning 404 to user: Instance c9b75acf-e4fe-425e-9398-40c4ac1a108b could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:52.336545 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8011074d-5536-4197-a1e2-b54a9ef60459 tempest-ServersAdminNegativeTestJSON-1230602466 tempest-ServersAdminNegativeTestJSON-1230602466-project] 10.222.0.35 "GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b" status: 404 len: 111 microversion: 2.1 time: 0.029489 Jun 10 17:58:52.336545 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 246/480] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:52 2022] GET /compute/v2.1/servers/c9b75acf-e4fe-425e-9398-40c4ac1a108b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:58:52.338598 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-721d1ebb-d741-4b7e-bd34-0014d828ee18 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:52.339206 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-721d1ebb-d741-4b7e-bd34-0014d828ee18 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] [instance: e6e43799-860e-4ae1-91cf-da1495ff9f64] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:52.352555 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-721d1ebb-d741-4b7e-bd34-0014d828ee18 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:52.353273 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-721d1ebb-d741-4b7e-bd34-0014d828ee18 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:52.354337 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-721d1ebb-d741-4b7e-bd34-0014d828ee18 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:52.354764 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-721d1ebb-d741-4b7e-bd34-0014d828ee18 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:52.537834 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-779ce585-6a1e-4bc8-8d02-78ffd8b22cee tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] 10.222.0.35 "DELETE /compute/v2.1/servers/2b47ecdd-b178-49f2-a28f-bdedb4771918" status: 204 len: 0 microversion: 2.1 time: 0.401163 Jun 10 17:58:52.538994 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 235/481] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 17:58:52 2022] DELETE /compute/v2.1/servers/2b47ecdd-b178-49f2-a28f-bdedb4771918 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 17:58:52.548216 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-de580aa6-b4f8-4568-8100-2d41e648dab6 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:52.549095 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-de580aa6-b4f8-4568-8100-2d41e648dab6 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 4ef38095-36e0-4792-9516-caf76a5022c9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:52.555923 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-de580aa6-b4f8-4568-8100-2d41e648dab6 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:52.556622 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-de580aa6-b4f8-4568-8100-2d41e648dab6 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:52.557561 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-de580aa6-b4f8-4568-8100-2d41e648dab6 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:52.558196 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-de580aa6-b4f8-4568-8100-2d41e648dab6 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:52.571045 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-721d1ebb-d741-4b7e-bd34-0014d828ee18 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c64251f22f844077b4d9ce2617c11082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cb46777a914dbaa7c64c5047cc65e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:52.574991 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-de580aa6-b4f8-4568-8100-2d41e648dab6 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] HTTP exception thrown: Instance 4ef38095-36e0-4792-9516-caf76a5022c9 could not be found. Jun 10 17:58:52.577134 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-de580aa6-b4f8-4568-8100-2d41e648dab6 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Request method failure captured: Jun 10 17:58:52.577134 chdv-master-2 devstack@n-api.service[126594]: request: DELETE /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9 HTTP/1.1 Jun 10 17:58:52.577134 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 17:58:52.577134 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 17:58:52.577134 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 17:58:52.577134 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 17:58:52.577134 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 17:58:52.577134 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 17:58:52.577134 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 17:58:52.577134 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:52.577134 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4YMziWCTAU0ECivXoRxTAmNyX7m5R2ybjAG4_pkm4uGzetr0UivZNtFpFqllUCykYtsNoP13IOG7RwH60UYZ0ry6CCO_ht7yXG6Jn4pVasvKK8YtIJealFaS43MeShKArcTJ1-SWv0E6Et_2sP5P22_Ndb-ggAg2fGG71kKTkDHg60 Jun 10 17:58:52.577134 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 17:58:52.577134 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 17:58:52.577134 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 17:58:52.577134 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 17:58:52.577134 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 17:58:52.577134 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 17:58:52.577134 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 175eeed60130438eaf02299dc72b708d Jun 10 17:58:52.577134 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-DeleteServersAdminTestJSON-765056364 Jun 10 17:58:52.577134 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 17:58:52.577134 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 17:58:52.579085 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/175eeed60130438eaf02299dc72b708d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/175eeed60130438eaf02299dc72b708d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/175eeed60130438eaf02299dc72b708d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_175eeed60130438eaf02299dc72b708d", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:52.579085 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-DeleteServersAdminTestJSON-765056364 Jun 10 17:58:52.579085 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 175eeed60130438eaf02299dc72b708d Jun 10 17:58:52.579085 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-765056364 Jun 10 17:58:52.579085 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-DeleteServersAdminTestJSON-765056364-project Jun 10 17:58:52.579085 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 17:58:52.579085 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 17:58:52.579085 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 680f0e3161f74f139dae76fab34293bb Jun 10 17:58:52.579085 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-DeleteServersAdminTestJSON-765056364-project Jun 10 17:58:52.579085 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 17:58:52.579085 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 4ef38095-36e0-4792-9516-caf76a5022c9 could not be found. Jun 10 17:58:52.579085 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '4ef38095-36e0-4792-9516-caf76a5022c9'} Jun 10 17:58:52.579885 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:52.579885 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:52.579885 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 17:58:52.579885 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 17:58:52.579885 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 17:58:52.579885 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 17:58:52.579885 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 17:58:52.579885 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 17:58:52.579885 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 17:58:52.579885 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 17:58:52.579885 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ef38095-36e0-4792-9516-caf76a5022c9 could not be found. Jun 10 17:58:52.579885 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:52.579885 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:52.579885 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:52.579885 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:52.579885 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:52.579885 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:52.579885 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:52.579885 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:52.579885 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:52.581353 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:52.581353 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 17:58:52.581353 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 17:58:52.581353 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 17:58:52.581353 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 17:58:52.581353 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 17:58:52.581353 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 17:58:52.581353 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 17:58:52.581353 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 17:58:52.581353 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ef38095-36e0-4792-9516-caf76a5022c9 could not be found. Jun 10 17:58:52.581353 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:52.581353 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:52.581353 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:52.581353 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:52.581353 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:52.581353 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:52.581353 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:58:52.581353 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:58:52.581353 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ef38095-36e0-4792-9516-caf76a5022c9 could not be found. Jun 10 17:58:52.581353 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:52.582712 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-721d1ebb-d741-4b7e-bd34-0014d828ee18 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] 10.222.0.35 "GET /compute/v2.1/servers/e6e43799-860e-4ae1-91cf-da1495ff9f64" status: 200 len: 1324 microversion: 2.1 time: 0.244368 Jun 10 17:58:52.585052 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-de580aa6-b4f8-4568-8100-2d41e648dab6 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Returning 404 to user: Instance 4ef38095-36e0-4792-9516-caf76a5022c9 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:52.586087 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-de580aa6-b4f8-4568-8100-2d41e648dab6 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "DELETE /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9" status: 404 len: 111 microversion: 2.1 time: 0.043007 Jun 10 17:58:52.588473 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 247/482] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:52 2022] GET /compute/v2.1/servers/e6e43799-860e-4ae1-91cf-da1495ff9f64 => generated 1324 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:52.589653 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 236/483] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 17:58:52 2022] DELETE /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:58:52.593881 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-10aa3eaa-910f-4670-8326-d6ea1870ae95 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:52.594503 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-10aa3eaa-910f-4670-8326-d6ea1870ae95 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] [instance: 2b47ecdd-b178-49f2-a28f-bdedb4771918] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:52.595157 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c6bfb87d-0e93-46ef-afba-041024c80538 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:52.595779 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c6bfb87d-0e93-46ef-afba-041024c80538 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] [instance: 4ef38095-36e0-4792-9516-caf76a5022c9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:52.600817 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10aa3eaa-910f-4670-8326-d6ea1870ae95 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:52.601252 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10aa3eaa-910f-4670-8326-d6ea1870ae95 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:52.601733 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c6bfb87d-0e93-46ef-afba-041024c80538 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:52.602008 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10aa3eaa-910f-4670-8326-d6ea1870ae95 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:52.602190 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c6bfb87d-0e93-46ef-afba-041024c80538 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:52.602488 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10aa3eaa-910f-4670-8326-d6ea1870ae95 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:52.602957 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c6bfb87d-0e93-46ef-afba-041024c80538 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:52.603431 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c6bfb87d-0e93-46ef-afba-041024c80538 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:52.617939 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-c6bfb87d-0e93-46ef-afba-041024c80538 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] HTTP exception thrown: Instance 4ef38095-36e0-4792-9516-caf76a5022c9 could not be found. Jun 10 17:58:52.619479 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c6bfb87d-0e93-46ef-afba-041024c80538 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Request method failure captured: Jun 10 17:58:52.619479 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9 HTTP/1.1 Jun 10 17:58:52.619479 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 17:58:52.619479 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 17:58:52.619479 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 17:58:52.619479 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 17:58:52.619479 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 17:58:52.619479 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 17:58:52.619479 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 17:58:52.619479 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:52.619479 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4YMziWCTAU0ECivXoRxTAmNyX7m5R2ybjAG4_pkm4uGzetr0UivZNtFpFqllUCykYtsNoP13IOG7RwH60UYZ0ry6CCO_ht7yXG6Jn4pVasvKK8YtIJealFaS43MeShKArcTJ1-SWv0E6Et_2sP5P22_Ndb-ggAg2fGG71kKTkDHg60 Jun 10 17:58:52.619479 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 17:58:52.619479 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 17:58:52.619479 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 17:58:52.619479 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 17:58:52.619479 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 17:58:52.619479 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 17:58:52.619479 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 175eeed60130438eaf02299dc72b708d Jun 10 17:58:52.619479 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-DeleteServersAdminTestJSON-765056364 Jun 10 17:58:52.619479 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 17:58:52.619479 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 17:58:52.620965 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/175eeed60130438eaf02299dc72b708d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/175eeed60130438eaf02299dc72b708d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/175eeed60130438eaf02299dc72b708d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_175eeed60130438eaf02299dc72b708d", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:52.620965 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-DeleteServersAdminTestJSON-765056364 Jun 10 17:58:52.620965 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 175eeed60130438eaf02299dc72b708d Jun 10 17:58:52.620965 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-765056364 Jun 10 17:58:52.620965 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-DeleteServersAdminTestJSON-765056364-project Jun 10 17:58:52.620965 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 17:58:52.620965 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 17:58:52.620965 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 680f0e3161f74f139dae76fab34293bb Jun 10 17:58:52.620965 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-DeleteServersAdminTestJSON-765056364-project Jun 10 17:58:52.620965 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 17:58:52.620965 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 4ef38095-36e0-4792-9516-caf76a5022c9 could not be found. Jun 10 17:58:52.620965 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '4ef38095-36e0-4792-9516-caf76a5022c9'} Jun 10 17:58:52.621798 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:52.621798 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:52.621798 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 17:58:52.621798 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 17:58:52.621798 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 17:58:52.621798 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 17:58:52.621798 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 17:58:52.621798 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 17:58:52.621798 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 17:58:52.621798 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 17:58:52.621798 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ef38095-36e0-4792-9516-caf76a5022c9 could not be found. Jun 10 17:58:52.621798 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:52.621798 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:52.621798 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:52.621798 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:52.621798 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:52.621798 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:52.621798 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:52.621798 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:52.621798 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:52.623041 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:52.623041 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 17:58:52.623041 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 17:58:52.623041 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 17:58:52.623041 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 17:58:52.623041 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 17:58:52.623041 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 17:58:52.623041 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ef38095-36e0-4792-9516-caf76a5022c9 could not be found. Jun 10 17:58:52.623041 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:52.623041 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:52.623041 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:52.623041 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:52.623041 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:52.623041 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:52.623041 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:58:52.623041 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:58:52.623041 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ef38095-36e0-4792-9516-caf76a5022c9 could not be found. Jun 10 17:58:52.623041 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:52.624795 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c6bfb87d-0e93-46ef-afba-041024c80538 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] Returning 404 to user: Instance 4ef38095-36e0-4792-9516-caf76a5022c9 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:52.624795 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c6bfb87d-0e93-46ef-afba-041024c80538 tempest-DeleteServersAdminTestJSON-765056364 tempest-DeleteServersAdminTestJSON-765056364-project] 10.222.0.35 "GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9" status: 404 len: 111 microversion: 2.1 time: 0.030154 Jun 10 17:58:52.629012 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 237/484] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:52 2022] GET /compute/v2.1/servers/4ef38095-36e0-4792-9516-caf76a5022c9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:58:52.745466 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-10aa3eaa-910f-4670-8326-d6ea1870ae95 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6942ee76c6e4b16a9ea45d595084df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cef3679b5a47e48376197d17220e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:52.753488 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-10aa3eaa-910f-4670-8326-d6ea1870ae95 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] 10.222.0.35 "GET /compute/v2.1/servers/2b47ecdd-b178-49f2-a28f-bdedb4771918" status: 200 len: 1479 microversion: 2.1 time: 0.163772 Jun 10 17:58:52.754843 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 248/485] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:52 2022] GET /compute/v2.1/servers/2b47ecdd-b178-49f2-a28f-bdedb4771918 => generated 1479 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:53.241913 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1ce4233d-6bfa-4026-b23e-1c718ceabd4b tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:53.242546 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1ce4233d-6bfa-4026-b23e-1c718ceabd4b tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: 95e3fefa-48f8-42be-95a1-a58e3980db9b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:53.248839 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1ce4233d-6bfa-4026-b23e-1c718ceabd4b tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:53.249923 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1ce4233d-6bfa-4026-b23e-1c718ceabd4b tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:53.253569 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1ce4233d-6bfa-4026-b23e-1c718ceabd4b tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:53.253569 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1ce4233d-6bfa-4026-b23e-1c718ceabd4b tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:53.402341 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1ce4233d-6bfa-4026-b23e-1c718ceabd4b tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19776e5adf942c6a20e4dea1aa10cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1fd6bd677ff4b17bafee8fad1d720a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:53.411049 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1ce4233d-6bfa-4026-b23e-1c718ceabd4b tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b" status: 200 len: 1459 microversion: 2.1 time: 0.173167 Jun 10 17:58:53.422875 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 238/486] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:53 2022] GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b => generated 1459 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:53.428027 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-41a69b92-bf29-4fe2-9a48-c688be54d330 tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:53.428891 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-41a69b92-bf29-4fe2-9a48-c688be54d330 tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] [instance: 95e3fefa-48f8-42be-95a1-a58e3980db9b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:53.437400 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41a69b92-bf29-4fe2-9a48-c688be54d330 tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:53.438253 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41a69b92-bf29-4fe2-9a48-c688be54d330 tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:53.439233 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41a69b92-bf29-4fe2-9a48-c688be54d330 tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:53.439872 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41a69b92-bf29-4fe2-9a48-c688be54d330 tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:53.599614 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1c797f9b-ae6e-4434-80b4-7f71a06b67c6 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:53.600525 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1c797f9b-ae6e-4434-80b4-7f71a06b67c6 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] [instance: e6e43799-860e-4ae1-91cf-da1495ff9f64] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:53.609699 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1c797f9b-ae6e-4434-80b4-7f71a06b67c6 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:53.610164 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1c797f9b-ae6e-4434-80b4-7f71a06b67c6 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:53.611143 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1c797f9b-ae6e-4434-80b4-7f71a06b67c6 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:53.611735 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1c797f9b-ae6e-4434-80b4-7f71a06b67c6 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:53.896180 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-41a69b92-bf29-4fe2-9a48-c688be54d330 tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b" status: 200 len: 1610 microversion: 2.1 time: 0.471003 Jun 10 17:58:53.897255 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 249/487] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:53 2022] GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b => generated 1610 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:58:53.906227 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-253d74c6-91da-4308-8bc4-216cd4cb25e9 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:53.907708 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-253d74c6-91da-4308-8bc4-216cd4cb25e9 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] [instance: 2b47ecdd-b178-49f2-a28f-bdedb4771918] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:53.916111 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-253d74c6-91da-4308-8bc4-216cd4cb25e9 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:53.916631 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-253d74c6-91da-4308-8bc4-216cd4cb25e9 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:53.917761 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-253d74c6-91da-4308-8bc4-216cd4cb25e9 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:53.918269 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-253d74c6-91da-4308-8bc4-216cd4cb25e9 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:53.978692 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1c797f9b-ae6e-4434-80b4-7f71a06b67c6 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c64251f22f844077b4d9ce2617c11082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cb46777a914dbaa7c64c5047cc65e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:53.986522 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1c797f9b-ae6e-4434-80b4-7f71a06b67c6 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] 10.222.0.35 "GET /compute/v2.1/servers/e6e43799-860e-4ae1-91cf-da1495ff9f64" status: 200 len: 1324 microversion: 2.1 time: 0.393708 Jun 10 17:58:53.998097 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 239/488] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:53 2022] GET /compute/v2.1/servers/e6e43799-860e-4ae1-91cf-da1495ff9f64 => generated 1324 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:58:54.013717 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f50139dc-5bf8-4f89-b04b-58dd2eafa463 tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:54.019309 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:58:54.019309 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:58:54.021990 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f50139dc-5bf8-4f89-b04b-58dd2eafa463 tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:54.023982 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f50139dc-5bf8-4f89-b04b-58dd2eafa463 tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:54.025009 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f50139dc-5bf8-4f89-b04b-58dd2eafa463 tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:54.025826 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f50139dc-5bf8-4f89-b04b-58dd2eafa463 tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:54.078764 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f50139dc-5bf8-4f89-b04b-58dd2eafa463 tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] 10.222.0.35 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.079359 Jun 10 17:58:54.080625 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 240/489] 10.222.0.35 () {58 vars in 1175 bytes} [Fri Jun 10 17:58:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:54.090822 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f50139dc-5bf8-4f89-b04b-58dd2eafa463 tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:54.091690 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f50139dc-5bf8-4f89-b04b-58dd2eafa463 tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] 10.222.0.35 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001328 Jun 10 17:58:54.092029 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 241/490] 10.222.0.35 () {56 vars in 885 bytes} [Fri Jun 10 17:58:54 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jun 10 17:58:54.122026 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-af638120-a839-44b5-bfe7-bda3838960f8 tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "chh1-master-2", "block_migration": true, "disk_over_commit": false}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:54.123179 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-af638120-a839-44b5-bfe7-bda3838960f8 tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] [instance: 95e3fefa-48f8-42be-95a1-a58e3980db9b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:54.130212 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-af638120-a839-44b5-bfe7-bda3838960f8 tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:54.130669 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-af638120-a839-44b5-bfe7-bda3838960f8 tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:54.131445 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-af638120-a839-44b5-bfe7-bda3838960f8 tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:54.132058 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-af638120-a839-44b5-bfe7-bda3838960f8 tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:54.172740 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-af638120-a839-44b5-bfe7-bda3838960f8 tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] Lazy-loading 'flavor' on Instance uuid 95e3fefa-48f8-42be-95a1-a58e3980db9b {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 17:58:54.199222 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-253d74c6-91da-4308-8bc4-216cd4cb25e9 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6942ee76c6e4b16a9ea45d595084df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cef3679b5a47e48376197d17220e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:54.200710 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-af638120-a839-44b5-bfe7-bda3838960f8 tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 95e3fefa-48f8-42be-95a1-a58e3980db9b while it is in vm_state suspended Jun 10 17:58:54.206275 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-af638120-a839-44b5-bfe7-bda3838960f8 tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] Request method failure captured: Jun 10 17:58:54.206275 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b/action HTTP/1.1 Jun 10 17:58:54.206275 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 17:58:54.206275 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 17:58:54.206275 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 17:58:54.206275 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 97 Jun 10 17:58:54.206275 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 17:58:54.206275 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 17:58:54.206275 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 17:58:54.206275 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:54.206275 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4YtgqKm-7jt1LM2ijRFtRklcxcsEYPxTz3G5Cl1lUt1kWbqZMN2-XTOqzNgxGL-KKa8Ry4hhAQvnkg8wFezSGtk5q1py_YN_AhKuKf9ETaKM-SMbatdqLZvUqlVT0YEtGbIvEqXJEPfTsVfBZfwQb1W43tW4CtXr-QjJKTUf50mr4E Jun 10 17:58:54.206275 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 17:58:54.206275 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 17:58:54.206275 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 17:58:54.206275 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 17:58:54.206275 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 17:58:54.206275 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 17:58:54.206275 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 3c42f9f1f3444a95a8a07f8465e0b618 Jun 10 17:58:54.206275 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-LiveMigrationNegativeTest-1937937126 Jun 10 17:58:54.206275 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member,admin Jun 10 17:58:54.206275 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member,admin Jun 10 17:58:54.207555 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/3c42f9f1f3444a95a8a07f8465e0b618"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3c42f9f1f3444a95a8a07f8465e0b618"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3c42f9f1f3444a95a8a07f8465e0b618"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_3c42f9f1f3444a95a8a07f8465e0b618", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:54.207555 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-LiveMigrationNegativeTest-1937937126 Jun 10 17:58:54.207555 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 3c42f9f1f3444a95a8a07f8465e0b618 Jun 10 17:58:54.207555 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1937937126 Jun 10 17:58:54.207555 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-LiveMigrationNegativeTest-1937937126-project-admin Jun 10 17:58:54.207555 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 17:58:54.207555 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 17:58:54.207555 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 321486887a244fd8bd75e1ec9ca07853 Jun 10 17:58:54.207555 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-LiveMigrationNegativeTest-1937937126-project-admin Jun 10 17:58:54.207555 chdv-master-2 devstack@n-api.service[126594]: Jun 10 17:58:54.207555 chdv-master-2 devstack@n-api.service[126594]: {"os-migrateLive": {"host": "chh1-master-2", "block_migration": true, "disk_over_commit": false}} Jun 10 17:58:54.207555 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 17:58:54.208249 chdv-master-2 devstack@n-api.service[126594]: exception: Cannot 'os-migrateLive' instance 95e3fefa-48f8-42be-95a1-a58e3980db9b while it is in vm_state suspended Jun 10 17:58:54.208249 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '95e3fefa-48f8-42be-95a1-a58e3980db9b', 'body': {'os-migrateLive': {'host': 'chh1-master-2', 'block_migration': True, 'disk_over_commit': False}}} Jun 10 17:58:54.208249 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:54.208249 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:54.208249 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jun 10 17:58:54.208249 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jun 10 17:58:54.208249 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 10 17:58:54.208249 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 10 17:58:54.208249 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 10 17:58:54.208249 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 10 17:58:54.208249 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 10 17:58:54.208249 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 10 17:58:54.208249 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 10 17:58:54.208249 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 10 17:58:54.208249 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jun 10 17:58:54.208249 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 10 17:58:54.208249 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jun 10 17:58:54.208249 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 10 17:58:54.209312 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 10 17:58:54.209312 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 10 17:58:54.209312 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 10 17:58:54.209312 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 10 17:58:54.209312 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 95e3fefa-48f8-42be-95a1-a58e3980db9b in vm_state suspended. Cannot live_migrate while the instance is in this state. Jun 10 17:58:54.209312 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:54.209312 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:54.209312 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:54.209312 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:54.209312 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:54.209312 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:54.209312 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:54.209312 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:54.209312 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:54.209312 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:54.209312 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 17:58:54.209312 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 17:58:54.209312 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 17:58:54.209312 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 17:58:54.209312 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 17:58:54.210554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 17:58:54.210554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 10 17:58:54.210554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Jun 10 17:58:54.210554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 10 17:58:54.210554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 10 17:58:54.210554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 10 17:58:54.210554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 95e3fefa-48f8-42be-95a1-a58e3980db9b while it is in vm_state suspended Jun 10 17:58:54.210554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:54.210554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:54.210554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:54.210554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:54.210554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:54.210554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:54.210554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:58:54.210554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:58:54.210554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 95e3fefa-48f8-42be-95a1-a58e3980db9b while it is in vm_state suspended Jun 10 17:58:54.210554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:58:54.211525 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-253d74c6-91da-4308-8bc4-216cd4cb25e9 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] 10.222.0.35 "GET /compute/v2.1/servers/2b47ecdd-b178-49f2-a28f-bdedb4771918" status: 200 len: 1479 microversion: 2.1 time: 0.312867 Jun 10 17:58:54.214151 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-af638120-a839-44b5-bfe7-bda3838960f8 tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 95e3fefa-48f8-42be-95a1-a58e3980db9b while it is in vm_state suspended {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:54.215352 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-af638120-a839-44b5-bfe7-bda3838960f8 tempest-LiveMigrationNegativeTest-1937937126 tempest-LiveMigrationNegativeTest-1937937126-project-admin] 10.222.0.35 "POST /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b/action" status: 409 len: 155 microversion: 2.1 time: 0.119989 Jun 10 17:58:54.216636 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 242/491] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 17:58:54 2022] POST /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b/action => generated 155 bytes in 122 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 10 17:58:54.223461 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 250/492] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:53 2022] GET /compute/v2.1/servers/2b47ecdd-b178-49f2-a28f-bdedb4771918 => generated 1479 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:54.229448 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-10f63977-fdc1-40ba-a987-fd29ee12d62d tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:54.230127 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-10f63977-fdc1-40ba-a987-fd29ee12d62d tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: 95e3fefa-48f8-42be-95a1-a58e3980db9b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:54.239237 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-10f63977-fdc1-40ba-a987-fd29ee12d62d tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:54.239982 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-10f63977-fdc1-40ba-a987-fd29ee12d62d tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:54.240789 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-10f63977-fdc1-40ba-a987-fd29ee12d62d tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:54.241692 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-10f63977-fdc1-40ba-a987-fd29ee12d62d tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:54.270651 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-10f63977-fdc1-40ba-a987-fd29ee12d62d tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: 95e3fefa-48f8-42be-95a1-a58e3980db9b] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 17:58:54.549687 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-10f63977-fdc1-40ba-a987-fd29ee12d62d tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "DELETE /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b" status: 204 len: 0 microversion: 2.1 time: 0.324879 Jun 10 17:58:54.550603 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 243/493] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 17:58:54 2022] DELETE /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 17:58:54.558682 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-799ea4ed-083a-4763-b068-1976d9f730ec tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:54.559228 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-799ea4ed-083a-4763-b068-1976d9f730ec tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: 95e3fefa-48f8-42be-95a1-a58e3980db9b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:54.566053 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-799ea4ed-083a-4763-b068-1976d9f730ec tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:54.566499 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-799ea4ed-083a-4763-b068-1976d9f730ec tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:54.567515 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-799ea4ed-083a-4763-b068-1976d9f730ec tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:54.568182 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-799ea4ed-083a-4763-b068-1976d9f730ec tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:54.595258 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:58:54.721558 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-799ea4ed-083a-4763-b068-1976d9f730ec tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19776e5adf942c6a20e4dea1aa10cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1fd6bd677ff4b17bafee8fad1d720a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:54.731992 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-799ea4ed-083a-4763-b068-1976d9f730ec tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b" status: 200 len: 1465 microversion: 2.1 time: 0.177058 Jun 10 17:58:54.736692 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 251/494] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:54 2022] GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b => generated 1465 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:54.961533 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-f7393c7d-daec-43b3-b0dc-3d68967fe8eb req-3567c658-610f-4720-8282-6e169468943b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6e43799-860e-4ae1-91cf-da1495ff9f64", "tag": "7c41d5b5-9e8e-4b88-88a4-5c223d34156c"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:54.970738 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-f7393c7d-daec-43b3-b0dc-3d68967fe8eb req-3567c658-610f-4720-8282-6e169468943b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:54.971189 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-f7393c7d-daec-43b3-b0dc-3d68967fe8eb req-3567c658-610f-4720-8282-6e169468943b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:54.994546 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-f7393c7d-daec-43b3-b0dc-3d68967fe8eb req-3567c658-610f-4720-8282-6e169468943b service nova] Creating event network-changed:7c41d5b5-9e8e-4b88-88a4-5c223d34156c for instance e6e43799-860e-4ae1-91cf-da1495ff9f64 on chh1-master-2 Jun 10 17:58:55.001130 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-f7393c7d-daec-43b3-b0dc-3d68967fe8eb req-3567c658-610f-4720-8282-6e169468943b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044399 Jun 10 17:58:55.001946 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 244/495] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:55.005420 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-84822fcb-ab5e-477b-86dc-f797e8bcc125 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:55.012800 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-84822fcb-ab5e-477b-86dc-f797e8bcc125 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] [instance: e6e43799-860e-4ae1-91cf-da1495ff9f64] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:55.023252 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-84822fcb-ab5e-477b-86dc-f797e8bcc125 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:55.023709 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-84822fcb-ab5e-477b-86dc-f797e8bcc125 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:55.024536 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-84822fcb-ab5e-477b-86dc-f797e8bcc125 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:55.025139 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-84822fcb-ab5e-477b-86dc-f797e8bcc125 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:55.198096 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-84822fcb-ab5e-477b-86dc-f797e8bcc125 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c64251f22f844077b4d9ce2617c11082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cb46777a914dbaa7c64c5047cc65e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:55.209064 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-84822fcb-ab5e-477b-86dc-f797e8bcc125 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] 10.222.0.35 "GET /compute/v2.1/servers/e6e43799-860e-4ae1-91cf-da1495ff9f64" status: 200 len: 1324 microversion: 2.1 time: 0.209398 Jun 10 17:58:55.210083 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 252/496] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:54 2022] GET /compute/v2.1/servers/e6e43799-860e-4ae1-91cf-da1495ff9f64 => generated 1324 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:58:55.231037 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-053720bc-62e5-4152-9521-3557c393ef44 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:55.232267 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-053720bc-62e5-4152-9521-3557c393ef44 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] [instance: 2b47ecdd-b178-49f2-a28f-bdedb4771918] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:55.238591 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:DELETE=7,nova_api:SELECT=89,nova_api:INSERT=2,nova_api:UPDATE=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:58:55.240591 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-053720bc-62e5-4152-9521-3557c393ef44 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:55.241163 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-053720bc-62e5-4152-9521-3557c393ef44 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:55.241982 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-053720bc-62e5-4152-9521-3557c393ef44 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:55.242420 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-053720bc-62e5-4152-9521-3557c393ef44 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:55.508095 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-053720bc-62e5-4152-9521-3557c393ef44 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6942ee76c6e4b16a9ea45d595084df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cef3679b5a47e48376197d17220e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:55.518413 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-053720bc-62e5-4152-9521-3557c393ef44 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] 10.222.0.35 "GET /compute/v2.1/servers/2b47ecdd-b178-49f2-a28f-bdedb4771918" status: 200 len: 1308 microversion: 2.1 time: 0.292275 Jun 10 17:58:55.521844 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 245/497] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:55 2022] GET /compute/v2.1/servers/2b47ecdd-b178-49f2-a28f-bdedb4771918 => generated 1308 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:55.755260 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e6d7e5d8-efdf-41ac-9392-96157ba4b368 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:55.755913 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e6d7e5d8-efdf-41ac-9392-96157ba4b368 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: 95e3fefa-48f8-42be-95a1-a58e3980db9b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:55.770784 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e6d7e5d8-efdf-41ac-9392-96157ba4b368 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:55.772793 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e6d7e5d8-efdf-41ac-9392-96157ba4b368 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:55.776967 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e6d7e5d8-efdf-41ac-9392-96157ba4b368 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:55.777433 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e6d7e5d8-efdf-41ac-9392-96157ba4b368 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:56.094600 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e6d7e5d8-efdf-41ac-9392-96157ba4b368 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19776e5adf942c6a20e4dea1aa10cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1fd6bd677ff4b17bafee8fad1d720a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:56.113040 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e6d7e5d8-efdf-41ac-9392-96157ba4b368 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b" status: 200 len: 1465 microversion: 2.1 time: 0.366700 Jun 10 17:58:56.114307 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 253/498] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:55 2022] GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b => generated 1465 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:56.230677 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0c1be047-ecef-4533-bba5-9b8ac8a1cc07 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:56.231348 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0c1be047-ecef-4533-bba5-9b8ac8a1cc07 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] [instance: e6e43799-860e-4ae1-91cf-da1495ff9f64] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:56.241278 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0c1be047-ecef-4533-bba5-9b8ac8a1cc07 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:56.241732 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0c1be047-ecef-4533-bba5-9b8ac8a1cc07 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:56.243054 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0c1be047-ecef-4533-bba5-9b8ac8a1cc07 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:56.243651 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0c1be047-ecef-4533-bba5-9b8ac8a1cc07 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:56.492980 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0c1be047-ecef-4533-bba5-9b8ac8a1cc07 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c64251f22f844077b4d9ce2617c11082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cb46777a914dbaa7c64c5047cc65e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:56.500576 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0c1be047-ecef-4533-bba5-9b8ac8a1cc07 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] 10.222.0.35 "GET /compute/v2.1/servers/e6e43799-860e-4ae1-91cf-da1495ff9f64" status: 200 len: 1324 microversion: 2.1 time: 0.275168 Jun 10 17:58:56.501231 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 246/499] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:56 2022] GET /compute/v2.1/servers/e6e43799-860e-4ae1-91cf-da1495ff9f64 => generated 1324 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:56.538103 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1b3692f1-5b8f-4607-b804-aeb12d455269 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:56.539040 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1b3692f1-5b8f-4607-b804-aeb12d455269 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] [instance: 2b47ecdd-b178-49f2-a28f-bdedb4771918] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:56.548032 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1b3692f1-5b8f-4607-b804-aeb12d455269 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:56.548412 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1b3692f1-5b8f-4607-b804-aeb12d455269 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:56.551547 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1b3692f1-5b8f-4607-b804-aeb12d455269 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:56.551547 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1b3692f1-5b8f-4607-b804-aeb12d455269 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:56.569369 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-1b3692f1-5b8f-4607-b804-aeb12d455269 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] HTTP exception thrown: Instance 2b47ecdd-b178-49f2-a28f-bdedb4771918 could not be found. Jun 10 17:58:56.571104 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1b3692f1-5b8f-4607-b804-aeb12d455269 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Request method failure captured: Jun 10 17:58:56.571104 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/2b47ecdd-b178-49f2-a28f-bdedb4771918 HTTP/1.1 Jun 10 17:58:56.571104 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 17:58:56.571104 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 17:58:56.571104 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 17:58:56.571104 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 17:58:56.571104 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 17:58:56.571104 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 17:58:56.571104 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 17:58:56.571104 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:56.571104 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4ZGPY-9ZMEj2JUPLS5KGCLD_wA4gFbDR_nQcg88oIqljPwzvsToueGD0dYsuvwzYJh1psgv7iq1jkilHHdvYz9JR8DgUzsRMxfkaPsakGxtAq_hc-ByyZXiWQUmfeK3FltDfouLw88JffaTZFjIDMMzvDsmVNxwRxvXmSfsFj2WsvA Jun 10 17:58:56.571104 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 17:58:56.571104 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 17:58:56.571104 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 17:58:56.571104 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 17:58:56.571104 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 17:58:56.571104 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 17:58:56.571104 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: a5cef3679b5a47e48376197d17220e36 Jun 10 17:58:56.571104 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-951653344 Jun 10 17:58:56.571104 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 17:58:56.571104 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 17:58:56.577621 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/a5cef3679b5a47e48376197d17220e36"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a5cef3679b5a47e48376197d17220e36"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a5cef3679b5a47e48376197d17220e36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_a5cef3679b5a47e48376197d17220e36", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:56.577621 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-951653344 Jun 10 17:58:56.577621 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: a5cef3679b5a47e48376197d17220e36 Jun 10 17:58:56.577621 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-951653344 Jun 10 17:58:56.577621 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServerDiagnosticsNegativeTest-951653344-project Jun 10 17:58:56.577621 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 17:58:56.577621 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 17:58:56.577621 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: d6942ee76c6e4b16a9ea45d595084df2 Jun 10 17:58:56.577621 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-951653344-project Jun 10 17:58:56.577621 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 17:58:56.577621 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 2b47ecdd-b178-49f2-a28f-bdedb4771918 could not be found. Jun 10 17:58:56.577621 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '2b47ecdd-b178-49f2-a28f-bdedb4771918'} Jun 10 17:58:56.578535 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:56.578535 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:56.578535 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 17:58:56.578535 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 17:58:56.578535 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 17:58:56.578535 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 17:58:56.578535 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 17:58:56.578535 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 17:58:56.578535 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 17:58:56.578535 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 17:58:56.578535 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b47ecdd-b178-49f2-a28f-bdedb4771918 could not be found. Jun 10 17:58:56.578535 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:56.578535 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:56.578535 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:56.578535 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:56.578535 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:56.578535 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:56.578535 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:56.578535 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:56.578535 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:56.579686 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:56.579686 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 17:58:56.579686 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 17:58:56.579686 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 17:58:56.579686 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 17:58:56.579686 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 17:58:56.579686 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 17:58:56.579686 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b47ecdd-b178-49f2-a28f-bdedb4771918 could not be found. Jun 10 17:58:56.579686 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:56.579686 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:56.579686 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:56.579686 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:56.579686 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:56.579686 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:56.579686 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:58:56.579686 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:58:56.579686 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b47ecdd-b178-49f2-a28f-bdedb4771918 could not be found. Jun 10 17:58:56.579686 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:56.581994 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1b3692f1-5b8f-4607-b804-aeb12d455269 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] Returning 404 to user: Instance 2b47ecdd-b178-49f2-a28f-bdedb4771918 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:56.581994 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1b3692f1-5b8f-4607-b804-aeb12d455269 tempest-ServerDiagnosticsNegativeTest-951653344 tempest-ServerDiagnosticsNegativeTest-951653344-project] 10.222.0.35 "GET /compute/v2.1/servers/2b47ecdd-b178-49f2-a28f-bdedb4771918" status: 404 len: 111 microversion: 2.1 time: 0.038967 Jun 10 17:58:56.581994 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 254/500] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:56 2022] GET /compute/v2.1/servers/2b47ecdd-b178-49f2-a28f-bdedb4771918 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:58:57.020207 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-f555845f-c1bf-4b4b-b90b-6b957d1b0bbe req-6137b3f5-16ed-42cd-9a49-d975acb95b1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b47ecdd-b178-49f2-a28f-bdedb4771918", "name": "network-vif-deleted", "tag": "9943d602-d3c6-4e99-a0ca-ddc9ea5df28b"}, {"server_uuid": "95e3fefa-48f8-42be-95a1-a58e3980db9b", "name": "network-vif-deleted", "tag": "527428be-3731-4772-b256-ff477210a6f7"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:58:57.032070 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-f555845f-c1bf-4b4b-b90b-6b957d1b0bbe req-6137b3f5-16ed-42cd-9a49-d975acb95b1a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:57.032559 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-f555845f-c1bf-4b4b-b90b-6b957d1b0bbe req-6137b3f5-16ed-42cd-9a49-d975acb95b1a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:57.054959 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-f555845f-c1bf-4b4b-b90b-6b957d1b0bbe req-6137b3f5-16ed-42cd-9a49-d975acb95b1a service nova] Creating event network-vif-deleted:9943d602-d3c6-4e99-a0ca-ddc9ea5df28b for instance 2b47ecdd-b178-49f2-a28f-bdedb4771918 on chh1-master-2 Jun 10 17:58:57.055786 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-f555845f-c1bf-4b4b-b90b-6b957d1b0bbe req-6137b3f5-16ed-42cd-9a49-d975acb95b1a service nova] Creating event network-vif-deleted:527428be-3731-4772-b256-ff477210a6f7 for instance 95e3fefa-48f8-42be-95a1-a58e3980db9b on chh2-master-2 Jun 10 17:58:57.069969 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-f555845f-c1bf-4b4b-b90b-6b957d1b0bbe req-6137b3f5-16ed-42cd-9a49-d975acb95b1a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.054994 Jun 10 17:58:57.071134 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 247/501] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:58:57.138943 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-72615583-94b6-4be3-9799-322ac366a5d1 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:57.140287 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-72615583-94b6-4be3-9799-322ac366a5d1 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: 95e3fefa-48f8-42be-95a1-a58e3980db9b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:57.147270 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72615583-94b6-4be3-9799-322ac366a5d1 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:57.147722 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72615583-94b6-4be3-9799-322ac366a5d1 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:57.148525 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72615583-94b6-4be3-9799-322ac366a5d1 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:57.148965 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72615583-94b6-4be3-9799-322ac366a5d1 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:57.217276 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-72615583-94b6-4be3-9799-322ac366a5d1 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19776e5adf942c6a20e4dea1aa10cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1fd6bd677ff4b17bafee8fad1d720a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:57.225453 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-72615583-94b6-4be3-9799-322ac366a5d1 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b" status: 200 len: 1294 microversion: 2.1 time: 0.090298 Jun 10 17:58:57.232436 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 255/502] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:57 2022] GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b => generated 1294 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:57.518872 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-02892f2b-50b9-4228-85a9-67078c1e3e2b tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:57.519710 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-02892f2b-50b9-4228-85a9-67078c1e3e2b tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] [instance: e6e43799-860e-4ae1-91cf-da1495ff9f64] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:57.527285 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-02892f2b-50b9-4228-85a9-67078c1e3e2b tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:57.527733 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-02892f2b-50b9-4228-85a9-67078c1e3e2b tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:57.528539 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-02892f2b-50b9-4228-85a9-67078c1e3e2b tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:57.528981 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-02892f2b-50b9-4228-85a9-67078c1e3e2b tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:57.719348 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-02892f2b-50b9-4228-85a9-67078c1e3e2b tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c64251f22f844077b4d9ce2617c11082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cb46777a914dbaa7c64c5047cc65e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:57.727027 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-02892f2b-50b9-4228-85a9-67078c1e3e2b tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] 10.222.0.35 "GET /compute/v2.1/servers/e6e43799-860e-4ae1-91cf-da1495ff9f64" status: 200 len: 1324 microversion: 2.1 time: 0.213195 Jun 10 17:58:57.727953 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 248/503] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:57 2022] GET /compute/v2.1/servers/e6e43799-860e-4ae1-91cf-da1495ff9f64 => generated 1324 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:58.243981 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-30f83ca1-3814-4229-895c-68639775f7c2 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:58.244948 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-30f83ca1-3814-4229-895c-68639775f7c2 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: 95e3fefa-48f8-42be-95a1-a58e3980db9b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:58.252425 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:58:58.254191 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30f83ca1-3814-4229-895c-68639775f7c2 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:58.254651 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30f83ca1-3814-4229-895c-68639775f7c2 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:58.255478 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30f83ca1-3814-4229-895c-68639775f7c2 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:58.255923 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30f83ca1-3814-4229-895c-68639775f7c2 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:58.273007 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=6 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:58:58.274968 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-30f83ca1-3814-4229-895c-68639775f7c2 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] HTTP exception thrown: Instance 95e3fefa-48f8-42be-95a1-a58e3980db9b could not be found. Jun 10 17:58:58.276524 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-30f83ca1-3814-4229-895c-68639775f7c2 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Request method failure captured: Jun 10 17:58:58.276524 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b HTTP/1.1 Jun 10 17:58:58.276524 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 17:58:58.276524 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 17:58:58.276524 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 17:58:58.276524 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 17:58:58.276524 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 17:58:58.276524 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 17:58:58.276524 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 17:58:58.276524 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 17:58:58.276524 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4YsG3jf0q71y_FahYsP3ctp-Q2Dc6X5_6ECOnUHPMCjjGGsfTxJEi042buUnd7qPmpFL33hVhyKuw4x9u_1ghPc-g4091IPI1e9Ohto6Nz5YrJC3DMB4udkv184jqu8y4v6CZPXSX89sq2VADGhu1yc-cjYL7aa8aXfsUuJA5x4L5Y Jun 10 17:58:58.276524 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 17:58:58.276524 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 17:58:58.276524 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 17:58:58.276524 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 17:58:58.276524 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 17:58:58.276524 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 17:58:58.276524 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: e1fd6bd677ff4b17bafee8fad1d720a6 Jun 10 17:58:58.276524 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-LiveMigrationNegativeTest-677480241 Jun 10 17:58:58.276524 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 17:58:58.276524 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 17:58:58.277823 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/e1fd6bd677ff4b17bafee8fad1d720a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/e1fd6bd677ff4b17bafee8fad1d720a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/e1fd6bd677ff4b17bafee8fad1d720a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_e1fd6bd677ff4b17bafee8fad1d720a6", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:58:58.277823 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-LiveMigrationNegativeTest-677480241 Jun 10 17:58:58.277823 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: e1fd6bd677ff4b17bafee8fad1d720a6 Jun 10 17:58:58.277823 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-677480241 Jun 10 17:58:58.277823 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-LiveMigrationNegativeTest-677480241-project Jun 10 17:58:58.277823 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 17:58:58.277823 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 17:58:58.277823 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: c19776e5adf942c6a20e4dea1aa10cdd Jun 10 17:58:58.277823 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-LiveMigrationNegativeTest-677480241-project Jun 10 17:58:58.277823 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 17:58:58.277823 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 95e3fefa-48f8-42be-95a1-a58e3980db9b could not be found. Jun 10 17:58:58.277823 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '95e3fefa-48f8-42be-95a1-a58e3980db9b'} Jun 10 17:58:58.278570 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:58:58.278570 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:58.278570 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 17:58:58.278570 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 17:58:58.278570 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 17:58:58.278570 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 17:58:58.278570 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 17:58:58.278570 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 17:58:58.278570 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 17:58:58.278570 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 17:58:58.278570 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95e3fefa-48f8-42be-95a1-a58e3980db9b could not be found. Jun 10 17:58:58.278570 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:58.278570 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:58.278570 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:58.278570 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:58.278570 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:58.278570 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:58.278570 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:58:58.278570 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:58:58.278570 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:58:58.279742 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:58:58.279742 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 17:58:58.279742 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 17:58:58.279742 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 17:58:58.279742 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 17:58:58.279742 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 17:58:58.279742 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 17:58:58.279742 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95e3fefa-48f8-42be-95a1-a58e3980db9b could not be found. Jun 10 17:58:58.279742 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:58.279742 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:58:58.279742 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:58.279742 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:58:58.279742 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:58:58.279742 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:58:58.279742 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:58:58.279742 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:58:58.279742 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95e3fefa-48f8-42be-95a1-a58e3980db9b could not be found. Jun 10 17:58:58.279742 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:58:58.280736 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-30f83ca1-3814-4229-895c-68639775f7c2 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Returning 404 to user: Instance 95e3fefa-48f8-42be-95a1-a58e3980db9b could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:58:58.280736 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-30f83ca1-3814-4229-895c-68639775f7c2 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b" status: 404 len: 111 microversion: 2.1 time: 0.038924 Jun 10 17:58:58.280736 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 256/504] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:58 2022] GET /compute/v2.1/servers/95e3fefa-48f8-42be-95a1-a58e3980db9b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:58:58.286756 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-71a24af3-484b-425e-8626-d811d4e96112 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:58.292984 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-71a24af3-484b-425e-8626-d811d4e96112 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: ec39479e-5a78-42b6-b385-ceed608f0129] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:58.294019 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-71a24af3-484b-425e-8626-d811d4e96112 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:58.294472 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-71a24af3-484b-425e-8626-d811d4e96112 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:58.295239 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-71a24af3-484b-425e-8626-d811d4e96112 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:58.295680 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-71a24af3-484b-425e-8626-d811d4e96112 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:58.321018 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-71a24af3-484b-425e-8626-d811d4e96112 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: ec39479e-5a78-42b6-b385-ceed608f0129] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 17:58:58.686157 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-71a24af3-484b-425e-8626-d811d4e96112 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "DELETE /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129" status: 204 len: 0 microversion: 2.1 time: 0.402877 Jun 10 17:58:58.687829 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 249/505] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 17:58:58 2022] DELETE /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 17:58:58.695807 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-19331660-4478-4fb7-a37d-63dd05adf19c tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:58.700407 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-19331660-4478-4fb7-a37d-63dd05adf19c tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: ec39479e-5a78-42b6-b385-ceed608f0129] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:58.703596 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-19331660-4478-4fb7-a37d-63dd05adf19c tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:58.704124 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-19331660-4478-4fb7-a37d-63dd05adf19c tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:58.704945 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-19331660-4478-4fb7-a37d-63dd05adf19c tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:58.706117 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-19331660-4478-4fb7-a37d-63dd05adf19c tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:58.750147 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0a026f74-0cca-4b77-ad89-7b8132417a7c tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:58.752726 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0a026f74-0cca-4b77-ad89-7b8132417a7c tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] [instance: e6e43799-860e-4ae1-91cf-da1495ff9f64] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:58.759701 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:58:58.761815 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0a026f74-0cca-4b77-ad89-7b8132417a7c tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:58.762532 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0a026f74-0cca-4b77-ad89-7b8132417a7c tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:58.763571 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0a026f74-0cca-4b77-ad89-7b8132417a7c tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:58.764332 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0a026f74-0cca-4b77-ad89-7b8132417a7c tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:58.850633 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-19331660-4478-4fb7-a37d-63dd05adf19c tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19776e5adf942c6a20e4dea1aa10cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1fd6bd677ff4b17bafee8fad1d720a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:58.861252 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-19331660-4478-4fb7-a37d-63dd05adf19c tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "GET /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129" status: 200 len: 1475 microversion: 2.1 time: 0.167649 Jun 10 17:58:58.861252 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 257/506] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:58 2022] GET /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129 => generated 1475 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:58:58.907409 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0a026f74-0cca-4b77-ad89-7b8132417a7c tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c64251f22f844077b4d9ce2617c11082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cb46777a914dbaa7c64c5047cc65e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:58:58.914940 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0a026f74-0cca-4b77-ad89-7b8132417a7c tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] 10.222.0.35 "GET /compute/v2.1/servers/e6e43799-860e-4ae1-91cf-da1495ff9f64" status: 200 len: 1324 microversion: 2.1 time: 0.173164 Jun 10 17:58:58.915540 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 250/507] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:58 2022] GET /compute/v2.1/servers/e6e43799-860e-4ae1-91cf-da1495ff9f64 => generated 1324 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:58:59.876733 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f8ac4537-ab9d-44b4-8e95-aca39b03f43f tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:59.877351 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f8ac4537-ab9d-44b4-8e95-aca39b03f43f tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: ec39479e-5a78-42b6-b385-ceed608f0129] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:59.885139 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8ac4537-ab9d-44b4-8e95-aca39b03f43f tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:59.885673 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8ac4537-ab9d-44b4-8e95-aca39b03f43f tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:59.891191 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8ac4537-ab9d-44b4-8e95-aca39b03f43f tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:59.891191 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8ac4537-ab9d-44b4-8e95-aca39b03f43f tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:59.939456 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7f3968a9-196a-4823-828b-2d80a62d5858 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:58:59.941256 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7f3968a9-196a-4823-828b-2d80a62d5858 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] [instance: e6e43799-860e-4ae1-91cf-da1495ff9f64] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:58:59.947770 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7f3968a9-196a-4823-828b-2d80a62d5858 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:59.948215 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7f3968a9-196a-4823-828b-2d80a62d5858 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:58:59.954469 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7f3968a9-196a-4823-828b-2d80a62d5858 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:58:59.954921 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7f3968a9-196a-4823-828b-2d80a62d5858 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:00.056827 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f8ac4537-ab9d-44b4-8e95-aca39b03f43f tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19776e5adf942c6a20e4dea1aa10cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1fd6bd677ff4b17bafee8fad1d720a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:00.064978 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f8ac4537-ab9d-44b4-8e95-aca39b03f43f tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "GET /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129" status: 200 len: 1475 microversion: 2.1 time: 0.192879 Jun 10 17:59:00.065541 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 258/508] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:59 2022] GET /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129 => generated 1475 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:00.105276 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7f3968a9-196a-4823-828b-2d80a62d5858 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c64251f22f844077b4d9ce2617c11082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cb46777a914dbaa7c64c5047cc65e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:00.107869 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:59:00.113846 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7f3968a9-196a-4823-828b-2d80a62d5858 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] 10.222.0.35 "GET /compute/v2.1/servers/e6e43799-860e-4ae1-91cf-da1495ff9f64" status: 200 len: 1324 microversion: 2.1 time: 0.185669 Jun 10 17:59:00.114766 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 251/509] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:58:59 2022] GET /compute/v2.1/servers/e6e43799-860e-4ae1-91cf-da1495ff9f64 => generated 1324 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:00.508493 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3be6bc11-9933-473d-9ce6-76b6a2cfe6c9 tempest-ServicesAdminTestJSON-2131184864 tempest-ServicesAdminTestJSON-2131184864-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:00.509945 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:59:00.509945 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:59:00.511170 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3be6bc11-9933-473d-9ce6-76b6a2cfe6c9 tempest-ServicesAdminTestJSON-2131184864 tempest-ServicesAdminTestJSON-2131184864-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:00.511988 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3be6bc11-9933-473d-9ce6-76b6a2cfe6c9 tempest-ServicesAdminTestJSON-2131184864 tempest-ServicesAdminTestJSON-2131184864-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:00.513539 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3be6bc11-9933-473d-9ce6-76b6a2cfe6c9 tempest-ServicesAdminTestJSON-2131184864 tempest-ServicesAdminTestJSON-2131184864-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:00.513970 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3be6bc11-9933-473d-9ce6-76b6a2cfe6c9 tempest-ServicesAdminTestJSON-2131184864 tempest-ServicesAdminTestJSON-2131184864-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:00.537924 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3be6bc11-9933-473d-9ce6-76b6a2cfe6c9 tempest-ServicesAdminTestJSON-2131184864 tempest-ServicesAdminTestJSON-2131184864-project-admin] 10.222.0.35 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.334138 Jun 10 17:59:00.538487 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 259/510] 10.222.0.35 () {58 vars in 1136 bytes} [Fri Jun 10 17:59:00 2022] GET /compute/v2.1/os-services => generated 947 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:00.550690 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0035011b-6a93-41ca-81e0-4ac47bb2ace6 tempest-ServicesAdminTestJSON-2131184864 tempest-ServicesAdminTestJSON-2131184864-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:00.550809 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:59:00.550809 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:59:00.551943 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0035011b-6a93-41ca-81e0-4ac47bb2ace6 tempest-ServicesAdminTestJSON-2131184864 tempest-ServicesAdminTestJSON-2131184864-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:00.552415 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0035011b-6a93-41ca-81e0-4ac47bb2ace6 tempest-ServicesAdminTestJSON-2131184864 tempest-ServicesAdminTestJSON-2131184864-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:00.553208 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0035011b-6a93-41ca-81e0-4ac47bb2ace6 tempest-ServicesAdminTestJSON-2131184864 tempest-ServicesAdminTestJSON-2131184864-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:00.553638 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0035011b-6a93-41ca-81e0-4ac47bb2ace6 tempest-ServicesAdminTestJSON-2131184864 tempest-ServicesAdminTestJSON-2131184864-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:00.579720 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0035011b-6a93-41ca-81e0-4ac47bb2ace6 tempest-ServicesAdminTestJSON-2131184864 tempest-ServicesAdminTestJSON-2131184864-project-admin] 10.222.0.35 "GET /compute/v2.1/os-services?host=chdv-master-2" status: 200 len: 581 microversion: 2.1 time: 0.031459 Jun 10 17:59:00.583658 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 252/511] 10.222.0.35 () {58 vars in 1173 bytes} [Fri Jun 10 17:59:00 2022] GET /compute/v2.1/os-services?host=chdv-master-2 => generated 581 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:00.588722 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-382b12a8-9813-497a-b295-480412274874 tempest-ServicesAdminTestJSON-2131184864 tempest-ServicesAdminTestJSON-2131184864-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:00.589958 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:59:00.589958 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:59:00.591349 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-382b12a8-9813-497a-b295-480412274874 tempest-ServicesAdminTestJSON-2131184864 tempest-ServicesAdminTestJSON-2131184864-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:00.591803 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-382b12a8-9813-497a-b295-480412274874 tempest-ServicesAdminTestJSON-2131184864 tempest-ServicesAdminTestJSON-2131184864-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:00.592625 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-382b12a8-9813-497a-b295-480412274874 tempest-ServicesAdminTestJSON-2131184864 tempest-ServicesAdminTestJSON-2131184864-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:00.593703 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-382b12a8-9813-497a-b295-480412274874 tempest-ServicesAdminTestJSON-2131184864 tempest-ServicesAdminTestJSON-2131184864-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:00.618269 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-382b12a8-9813-497a-b295-480412274874 tempest-ServicesAdminTestJSON-2131184864 tempest-ServicesAdminTestJSON-2131184864-project-admin] 10.222.0.35 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.033194 Jun 10 17:59:00.618871 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 260/512] 10.222.0.35 () {58 vars in 1175 bytes} [Fri Jun 10 17:59:00 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:00.631296 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c4965a5f-31d2-45a6-ae7d-88d64c322bd1 tempest-ServicesAdminTestJSON-2131184864 tempest-ServicesAdminTestJSON-2131184864-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:00.632768 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:59:00.632768 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:59:00.634163 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c4965a5f-31d2-45a6-ae7d-88d64c322bd1 tempest-ServicesAdminTestJSON-2131184864 tempest-ServicesAdminTestJSON-2131184864-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:00.634673 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c4965a5f-31d2-45a6-ae7d-88d64c322bd1 tempest-ServicesAdminTestJSON-2131184864 tempest-ServicesAdminTestJSON-2131184864-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:00.635541 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c4965a5f-31d2-45a6-ae7d-88d64c322bd1 tempest-ServicesAdminTestJSON-2131184864 tempest-ServicesAdminTestJSON-2131184864-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:00.636277 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c4965a5f-31d2-45a6-ae7d-88d64c322bd1 tempest-ServicesAdminTestJSON-2131184864 tempest-ServicesAdminTestJSON-2131184864-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:00.664207 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c4965a5f-31d2-45a6-ae7d-88d64c322bd1 tempest-ServicesAdminTestJSON-2131184864 tempest-ServicesAdminTestJSON-2131184864-project-admin] 10.222.0.35 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.036319 Jun 10 17:59:00.673287 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 253/513] 10.222.0.35 () {58 vars in 1136 bytes} [Fri Jun 10 17:59:00 2022] GET /compute/v2.1/os-services => generated 947 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:01.095249 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-91ed3dca-97a5-466a-bd39-ba96f2cefc07 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:01.095796 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-91ed3dca-97a5-466a-bd39-ba96f2cefc07 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: ec39479e-5a78-42b6-b385-ceed608f0129] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:01.102147 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-91ed3dca-97a5-466a-bd39-ba96f2cefc07 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:01.102599 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-91ed3dca-97a5-466a-bd39-ba96f2cefc07 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:01.103359 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-91ed3dca-97a5-466a-bd39-ba96f2cefc07 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:01.103795 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-91ed3dca-97a5-466a-bd39-ba96f2cefc07 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:01.130908 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-670fe1a7-2628-4b57-af52-a7696126f289 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:01.131562 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-670fe1a7-2628-4b57-af52-a7696126f289 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] [instance: e6e43799-860e-4ae1-91cf-da1495ff9f64] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:01.141248 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-670fe1a7-2628-4b57-af52-a7696126f289 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:01.141778 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-670fe1a7-2628-4b57-af52-a7696126f289 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:01.142796 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-670fe1a7-2628-4b57-af52-a7696126f289 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:01.143160 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-670fe1a7-2628-4b57-af52-a7696126f289 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:01.204590 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-91ed3dca-97a5-466a-bd39-ba96f2cefc07 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c19776e5adf942c6a20e4dea1aa10cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1fd6bd677ff4b17bafee8fad1d720a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:01.214395 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-91ed3dca-97a5-466a-bd39-ba96f2cefc07 tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "GET /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129" status: 200 len: 1433 microversion: 2.1 time: 0.123769 Jun 10 17:59:01.215591 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 261/514] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:01 2022] GET /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129 => generated 1433 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:01.224449 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d483236d-b9e8-49c6-b52a-a62c08eed29a tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:01.225140 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d483236d-b9e8-49c6-b52a-a62c08eed29a tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:01.234905 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d483236d-b9e8-49c6-b52a-a62c08eed29a tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:01.236623 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d483236d-b9e8-49c6-b52a-a62c08eed29a tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:01.236623 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d483236d-b9e8-49c6-b52a-a62c08eed29a tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:01.237197 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d483236d-b9e8-49c6-b52a-a62c08eed29a tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:01.315026 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d483236d-b9e8-49c6-b52a-a62c08eed29a tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 17:59:01.439667 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-670fe1a7-2628-4b57-af52-a7696126f289 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c64251f22f844077b4d9ce2617c11082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cb46777a914dbaa7c64c5047cc65e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:01.449699 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-670fe1a7-2628-4b57-af52-a7696126f289 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] 10.222.0.35 "GET /compute/v2.1/servers/e6e43799-860e-4ae1-91cf-da1495ff9f64" status: 200 len: 1324 microversion: 2.1 time: 0.322155 Jun 10 17:59:01.452894 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 254/515] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:01 2022] GET /compute/v2.1/servers/e6e43799-860e-4ae1-91cf-da1495ff9f64 => generated 1324 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:01.470078 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-d55609e2-7695-40ac-a488-ef389ef4e507 req-af7bf689-2d48-4577-a1fc-795a4555a868 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec39479e-5a78-42b6-b385-ceed608f0129", "name": "network-vif-deleted", "tag": "5df70e87-2212-413e-87f5-9f827ec2ab67"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:01.477615 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-d55609e2-7695-40ac-a488-ef389ef4e507 req-af7bf689-2d48-4577-a1fc-795a4555a868 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:01.478069 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-d55609e2-7695-40ac-a488-ef389ef4e507 req-af7bf689-2d48-4577-a1fc-795a4555a868 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:01.491862 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-d55609e2-7695-40ac-a488-ef389ef4e507 req-af7bf689-2d48-4577-a1fc-795a4555a868 service nova] Creating event network-vif-deleted:5df70e87-2212-413e-87f5-9f827ec2ab67 for instance ec39479e-5a78-42b6-b385-ceed608f0129 on chh2-master-2 Jun 10 17:59:01.497347 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-d55609e2-7695-40ac-a488-ef389ef4e507 req-af7bf689-2d48-4577-a1fc-795a4555a868 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041368 Jun 10 17:59:01.502010 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 255/516] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:01.669490 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d483236d-b9e8-49c6-b52a-a62c08eed29a tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "DELETE /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2" status: 204 len: 0 microversion: 2.1 time: 0.451590 Jun 10 17:59:01.673484 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 262/517] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 17:59:01 2022] DELETE /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 17:59:01.678804 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-6c3d3b66-247a-485b-b88b-229dcdb5c0a2 req-48bcc472-da6f-4e0f-90c2-9fad8e86a70e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6e43799-860e-4ae1-91cf-da1495ff9f64", "name": "network-vif-plugged", "status": "completed", "tag": "7c41d5b5-9e8e-4b88-88a4-5c223d34156c"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:01.687718 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-6c3d3b66-247a-485b-b88b-229dcdb5c0a2 req-48bcc472-da6f-4e0f-90c2-9fad8e86a70e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:01.688167 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-6c3d3b66-247a-485b-b88b-229dcdb5c0a2 req-48bcc472-da6f-4e0f-90c2-9fad8e86a70e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:01.704079 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-6c3d3b66-247a-485b-b88b-229dcdb5c0a2 req-48bcc472-da6f-4e0f-90c2-9fad8e86a70e service nova] Creating event network-vif-plugged:7c41d5b5-9e8e-4b88-88a4-5c223d34156c for instance e6e43799-860e-4ae1-91cf-da1495ff9f64 on chh1-master-2 Jun 10 17:59:01.710670 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-6c3d3b66-247a-485b-b88b-229dcdb5c0a2 req-48bcc472-da6f-4e0f-90c2-9fad8e86a70e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035673 Jun 10 17:59:01.711652 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 263/518] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:01.963948 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a883d700-1430-41bc-a406-26d5390af75d tempest-FlavorsExtraSpecsTestJSON-682183489 tempest-FlavorsExtraSpecsTestJSON-682183489-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-33541556", "ram": 512, "vcpus": 1, "disk": 10, "id": 985137129, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:01.966815 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:59:01.966815 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:59:02.077792 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a883d700-1430-41bc-a406-26d5390af75d tempest-FlavorsExtraSpecsTestJSON-682183489 tempest-FlavorsExtraSpecsTestJSON-682183489-project-admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.479014 Jun 10 17:59:02.078396 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 256/519] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:59:01 2022] POST /compute/v2.1/flavors => generated 411 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:02.098629 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bef7c57d-61b6-45bc-a0f1-fb1f8d180b8e tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-736175151", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "1778109647", "adminPass": "***", "networks": [{"uuid": "776e9bc3-bafc-4b0d-95a2-00c1440a80e2"}], "security_groups": [{"name": "tempest-securitygroup--156882094"}], "key_name": "tempest-keypair-723378704", "user_data": "}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:02.127339 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-84d54620-9a30-46f6-bfb2-99649bf8ef96 tempest-FlavorsV255TestJSON-348013084 tempest-FlavorsV255TestJSON-348013084-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-476796673", "id": 1944197844, "os-flavor-access:is_public": "True"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:02.136440 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:59:02.136440 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:59:02.260952 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-bef7c57d-61b6-45bc-a0f1-fb1f8d180b8e tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] validate_networks() for [('776e9bc3-bafc-4b0d-95a2-00c1440a80e2', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 17:59:02.268834 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-84d54620-9a30-46f6-bfb2-99649bf8ef96 tempest-FlavorsV255TestJSON-348013084 tempest-FlavorsV255TestJSON-348013084-project-admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.341618 Jun 10 17:59:02.270374 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 264/520] 10.222.0.35 () {62 vars in 1187 bytes} [Fri Jun 10 17:59:01 2022] POST /compute/v2.1/flavors => generated 448 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 10 17:59:02.275505 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8c55f7c1-5c63-43b6-b833-34e1eb7d12d4 tempest-FlavorsExtraSpecsTestJSON-682183489 tempest-FlavorsExtraSpecsTestJSON-682183489-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:02.276787 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:59:02.276787 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:59:02.287163 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=91,nova_api:DELETE=5,nova_api:UPDATE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:59:02.422757 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8c55f7c1-5c63-43b6-b833-34e1eb7d12d4 tempest-FlavorsExtraSpecsTestJSON-682183489 tempest-FlavorsExtraSpecsTestJSON-682183489-project-admin] 10.222.0.35 "POST /compute/v2.1/flavors/985137129/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.151278 Jun 10 17:59:02.423379 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 265/521] 10.222.0.35 () {60 vars in 1220 bytes} [Fri Jun 10 17:59:02 2022] POST /compute/v2.1/flavors/985137129/os-extra_specs => generated 66 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 17:59:02.428959 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0feabf3a-f46d-421d-8cdd-a4e6eafa1d3d tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:02.429944 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0feabf3a-f46d-421d-8cdd-a4e6eafa1d3d tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] [instance: ec39479e-5a78-42b6-b385-ceed608f0129] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:02.442565 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0feabf3a-f46d-421d-8cdd-a4e6eafa1d3d tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:02.442960 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0feabf3a-f46d-421d-8cdd-a4e6eafa1d3d tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:02.448027 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0feabf3a-f46d-421d-8cdd-a4e6eafa1d3d tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:02.448027 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0feabf3a-f46d-421d-8cdd-a4e6eafa1d3d tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:02.461590 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-0feabf3a-f46d-421d-8cdd-a4e6eafa1d3d tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] HTTP exception thrown: Instance ec39479e-5a78-42b6-b385-ceed608f0129 could not be found. Jun 10 17:59:02.463562 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0feabf3a-f46d-421d-8cdd-a4e6eafa1d3d tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Request method failure captured: Jun 10 17:59:02.463562 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129 HTTP/1.1 Jun 10 17:59:02.463562 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 17:59:02.463562 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 17:59:02.463562 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 17:59:02.463562 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 17:59:02.463562 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 17:59:02.463562 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 17:59:02.463562 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 17:59:02.463562 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 17:59:02.463562 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4YsG3jf0q71y_FahYsP3ctp-Q2Dc6X5_6ECOnUHPMCjjGGsfTxJEi042buUnd7qPmpFL33hVhyKuw4x9u_1ghPc-g4091IPI1e9Ohto6Nz5YrJC3DMB4udkv184jqu8y4v6CZPXSX89sq2VADGhu1yc-cjYL7aa8aXfsUuJA5x4L5Y Jun 10 17:59:02.463562 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 17:59:02.463562 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 17:59:02.463562 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 17:59:02.463562 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 17:59:02.463562 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 17:59:02.463562 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 17:59:02.463562 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: e1fd6bd677ff4b17bafee8fad1d720a6 Jun 10 17:59:02.463562 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-LiveMigrationNegativeTest-677480241 Jun 10 17:59:02.463562 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 17:59:02.463562 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 17:59:02.464885 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/e1fd6bd677ff4b17bafee8fad1d720a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/e1fd6bd677ff4b17bafee8fad1d720a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/e1fd6bd677ff4b17bafee8fad1d720a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_e1fd6bd677ff4b17bafee8fad1d720a6", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:59:02.464885 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-LiveMigrationNegativeTest-677480241 Jun 10 17:59:02.464885 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: e1fd6bd677ff4b17bafee8fad1d720a6 Jun 10 17:59:02.464885 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-677480241 Jun 10 17:59:02.464885 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-LiveMigrationNegativeTest-677480241-project Jun 10 17:59:02.464885 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 17:59:02.464885 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 17:59:02.464885 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: c19776e5adf942c6a20e4dea1aa10cdd Jun 10 17:59:02.464885 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-LiveMigrationNegativeTest-677480241-project Jun 10 17:59:02.464885 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 17:59:02.464885 chdv-master-2 devstack@n-api.service[126595]: exception: Instance ec39479e-5a78-42b6-b385-ceed608f0129 could not be found. Jun 10 17:59:02.464885 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'ec39479e-5a78-42b6-b385-ceed608f0129'} Jun 10 17:59:02.465573 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:59:02.465573 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:59:02.465573 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 17:59:02.465573 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 17:59:02.465573 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 17:59:02.465573 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 17:59:02.465573 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 17:59:02.465573 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 17:59:02.465573 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 17:59:02.465573 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 17:59:02.465573 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec39479e-5a78-42b6-b385-ceed608f0129 could not be found. Jun 10 17:59:02.465573 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:59:02.465573 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:59:02.465573 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:59:02.465573 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:59:02.465573 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:59:02.465573 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:59:02.465573 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:59:02.465573 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:59:02.465573 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:59:02.466670 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:59:02.466670 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 17:59:02.466670 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 17:59:02.466670 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 17:59:02.466670 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 17:59:02.466670 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 17:59:02.466670 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 17:59:02.466670 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec39479e-5a78-42b6-b385-ceed608f0129 could not be found. Jun 10 17:59:02.466670 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:59:02.466670 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:59:02.466670 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:59:02.466670 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:59:02.466670 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:59:02.466670 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:59:02.466670 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:59:02.466670 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:59:02.466670 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec39479e-5a78-42b6-b385-ceed608f0129 could not be found. Jun 10 17:59:02.466670 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:59:02.471131 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0feabf3a-f46d-421d-8cdd-a4e6eafa1d3d tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] Returning 404 to user: Instance ec39479e-5a78-42b6-b385-ceed608f0129 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:59:02.472271 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0feabf3a-f46d-421d-8cdd-a4e6eafa1d3d tempest-LiveMigrationNegativeTest-677480241 tempest-LiveMigrationNegativeTest-677480241-project] 10.222.0.35 "GET /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129" status: 404 len: 111 microversion: 2.1 time: 0.047033 Jun 10 17:59:02.473495 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 266/522] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:02 2022] GET /compute/v2.1/servers/ec39479e-5a78-42b6-b385-ceed608f0129 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:59:02.706317 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-bef7c57d-61b6-45bc-a0f1-fb1f8d180b8e tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 17:59:02.706767 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-bef7c57d-61b6-45bc-a0f1-fb1f8d180b8e tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 17:59:02.707238 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-bef7c57d-61b6-45bc-a0f1-fb1f8d180b8e tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 17:59:02.707861 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-bef7c57d-61b6-45bc-a0f1-fb1f8d180b8e tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 17:59:02.709107 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-bef7c57d-61b6-45bc-a0f1-fb1f8d180b8e tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 17:59:02.718543 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bef7c57d-61b6-45bc-a0f1-fb1f8d180b8e tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:02.719363 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bef7c57d-61b6-45bc-a0f1-fb1f8d180b8e tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:02.719783 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bef7c57d-61b6-45bc-a0f1-fb1f8d180b8e tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:02.720460 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bef7c57d-61b6-45bc-a0f1-fb1f8d180b8e tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:02.738112 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-bef7c57d-61b6-45bc-a0f1-fb1f8d180b8e tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Getting quotas for project ef9d5dac7c8243aeaa207c5a1ecb399a. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 17:59:02.743515 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-bef7c57d-61b6-45bc-a0f1-fb1f8d180b8e tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Getting quotas for user 329e5bd8a55d42cdb7879fbead65627a and project ef9d5dac7c8243aeaa207c5a1ecb399a. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 17:59:02.762742 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bef7c57d-61b6-45bc-a0f1-fb1f8d180b8e tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 17:59:02.765819 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bef7c57d-61b6-45bc-a0f1-fb1f8d180b8e tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: c922bb8c-ba7b-4448-9d8b-a6fb6498b25b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 17:59:02.885038 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-965c65b3-4089-4309-9a8c-5812c975c7a5 tempest-FlavorsV255TestJSON-1797156618 tempest-FlavorsV255TestJSON-1797156618-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:02.930257 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-965c65b3-4089-4309-9a8c-5812c975c7a5 tempest-FlavorsV255TestJSON-1797156618 tempest-FlavorsV255TestJSON-1797156618-project] 10.222.0.35 "GET /compute/v2.1/flavors/1944197844" status: 200 len: 448 microversion: 2.55 time: 0.419459 Jun 10 17:59:02.930257 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 267/523] 10.222.0.35 () {60 vars in 1198 bytes} [Fri Jun 10 17:59:02 2022] GET /compute/v2.1/flavors/1944197844 => generated 448 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 17:59:03.381116 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bef7c57d-61b6-45bc-a0f1-fb1f8d180b8e tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.300549 Jun 10 17:59:03.385482 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 257/524] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:59:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 1306 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 17:59:03.394231 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-acf600f7-b02d-4870-9978-4dc57883653b tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:03.394856 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-acf600f7-b02d-4870-9978-4dc57883653b tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] [instance: e6e43799-860e-4ae1-91cf-da1495ff9f64] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:03.424742 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-acf600f7-b02d-4870-9978-4dc57883653b tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:03.425522 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-acf600f7-b02d-4870-9978-4dc57883653b tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:03.426025 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-acf600f7-b02d-4870-9978-4dc57883653b tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:03.426471 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-acf600f7-b02d-4870-9978-4dc57883653b tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:03.777626 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-acf600f7-b02d-4870-9978-4dc57883653b tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c64251f22f844077b4d9ce2617c11082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cb46777a914dbaa7c64c5047cc65e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:03.786130 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-acf600f7-b02d-4870-9978-4dc57883653b tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] 10.222.0.35 "GET /compute/v2.1/servers/e6e43799-860e-4ae1-91cf-da1495ff9f64" status: 200 len: 1324 microversion: 2.1 time: 0.398920 Jun 10 17:59:03.787963 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 258/525] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:03 2022] GET /compute/v2.1/servers/e6e43799-860e-4ae1-91cf-da1495ff9f64 => generated 1324 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:03.797327 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ede8d7c3-9114-428f-a2d4-756ceb8715d3 tempest-FlavorsV255TestJSON-348013084 tempest-FlavorsV255TestJSON-348013084-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:03.805538 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:59:03.805538 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:59:03.841839 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-42fa4930-536a-462d-997c-4e7d6c468b44 tempest-FlavorsExtraSpecsTestJSON-1342355580 tempest-FlavorsExtraSpecsTestJSON-1342355580-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:03.879094 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-42fa4930-536a-462d-997c-4e7d6c468b44 tempest-FlavorsExtraSpecsTestJSON-1342355580 tempest-FlavorsExtraSpecsTestJSON-1342355580-project] 10.222.0.35 "GET /compute/v2.1/flavors/985137129/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.975660 Jun 10 17:59:03.883145 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 268/526] 10.222.0.35 () {58 vars in 1199 bytes} [Fri Jun 10 17:59:02 2022] GET /compute/v2.1/flavors/985137129/os-extra_specs => generated 66 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 17:59:03.893859 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-08d1f552-d2e0-43a6-8a40-2296829ed3b4 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:03.894933 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-08d1f552-d2e0-43a6-8a40-2296829ed3b4 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: c922bb8c-ba7b-4448-9d8b-a6fb6498b25b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:03.966360 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ede8d7c3-9114-428f-a2d4-756ceb8715d3 tempest-FlavorsV255TestJSON-348013084 tempest-FlavorsV255TestJSON-348013084-project-admin] 10.222.0.35 "PUT /compute/v2.1/flavors/1944197844" status: 200 len: 449 microversion: 2.55 time: 0.175232 Jun 10 17:59:03.967281 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 259/527] 10.222.0.35 () {62 vars in 1218 bytes} [Fri Jun 10 17:59:03 2022] PUT /compute/v2.1/flavors/1944197844 => generated 449 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 17:59:03.977227 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-04b041fb-6127-4f60-a9e2-35610e198936 tempest-FlavorsExtraSpecsTestJSON-682183489 tempest-FlavorsExtraSpecsTestJSON-682183489-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:03.987737 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:59:03.987737 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:59:04.002964 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-08d1f552-d2e0-43a6-8a40-2296829ed3b4 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e5bd8a55d42cdb7879fbead65627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9d5dac7c8243aeaa207c5a1ecb399a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:04.023983 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-08d1f552-d2e0-43a6-8a40-2296829ed3b4 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b" status: 200 len: 1263 microversion: 2.1 time: 0.137331 Jun 10 17:59:04.035811 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 269/528] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:03 2022] GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b => generated 1263 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:04.042056 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f7d840ef-2dc6-4228-a3f0-757e336c90d6 tempest-FlavorsV255TestJSON-1797156618 tempest-FlavorsV255TestJSON-1797156618-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:04.059863 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-04b041fb-6127-4f60-a9e2-35610e198936 tempest-FlavorsExtraSpecsTestJSON-682183489 tempest-FlavorsExtraSpecsTestJSON-682183489-project-admin] 10.222.0.35 "POST /compute/v2.1/flavors/985137129/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.091123 Jun 10 17:59:04.060495 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 260/529] 10.222.0.35 () {60 vars in 1220 bytes} [Fri Jun 10 17:59:03 2022] POST /compute/v2.1/flavors/985137129/os-extra_specs => generated 66 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 17:59:04.084432 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d4384b59-a467-41bc-88f3-6e4a2ad106fe tempest-FlavorsExtraSpecsTestJSON-1342355580 tempest-FlavorsExtraSpecsTestJSON-1342355580-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:04.096209 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d4384b59-a467-41bc-88f3-6e4a2ad106fe tempest-FlavorsExtraSpecsTestJSON-1342355580 tempest-FlavorsExtraSpecsTestJSON-1342355580-project] 10.222.0.35 "GET /compute/v2.1/flavors/985137129/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.029687 Jun 10 17:59:04.097284 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 261/530] 10.222.0.35 () {58 vars in 1241 bytes} [Fri Jun 10 17:59:04 2022] GET /compute/v2.1/flavors/985137129/os-extra_specs/hw:numa_nodes => generated 22 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 17:59:04.108893 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c8ab10ef-97c5-4449-8b19-fa32a511bb20 tempest-FlavorsExtraSpecsTestJSON-682183489 tempest-FlavorsExtraSpecsTestJSON-682183489-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:04.115237 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f7d840ef-2dc6-4228-a3f0-757e336c90d6 tempest-FlavorsV255TestJSON-1797156618 tempest-FlavorsV255TestJSON-1797156618-project] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 7011 microversion: 2.55 time: 0.077726 Jun 10 17:59:04.120220 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 270/531] 10.222.0.35 () {60 vars in 1186 bytes} [Fri Jun 10 17:59:04 2022] GET /compute/v2.1/flavors/detail => generated 7011 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 17:59:04.136815 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c3778d30-c231-4c63-8342-d2c6ab995d76 tempest-FlavorsV255TestJSON-1797156618 tempest-FlavorsV255TestJSON-1797156618-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:04.145528 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c8ab10ef-97c5-4449-8b19-fa32a511bb20 tempest-FlavorsExtraSpecsTestJSON-682183489 tempest-FlavorsExtraSpecsTestJSON-682183489-project-admin] 10.222.0.35 "POST /compute/v2.1/flavors/985137129/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.040891 Jun 10 17:59:04.146124 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 262/532] 10.222.0.35 () {60 vars in 1220 bytes} [Fri Jun 10 17:59:04 2022] POST /compute/v2.1/flavors/985137129/os-extra_specs => generated 66 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 17:59:04.157572 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5a8de276-b28d-47b6-a73b-5a5e0312e3e3 tempest-FlavorsExtraSpecsTestJSON-682183489 tempest-FlavorsExtraSpecsTestJSON-682183489-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:04.166144 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5a8de276-b28d-47b6-a73b-5a5e0312e3e3 tempest-FlavorsExtraSpecsTestJSON-682183489 tempest-FlavorsExtraSpecsTestJSON-682183489-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/985137129/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.013186 Jun 10 17:59:04.166694 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 263/533] 10.222.0.35 () {58 vars in 1199 bytes} [Fri Jun 10 17:59:04 2022] GET /compute/v2.1/flavors/985137129/os-extra_specs => generated 66 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 17:59:04.176664 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5cf8e286-cfd7-44e0-bb6f-a87fedfe057a tempest-FlavorsExtraSpecsTestJSON-682183489 tempest-FlavorsExtraSpecsTestJSON-682183489-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:04.179279 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:59:04.179279 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:59:04.184762 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c3778d30-c231-4c63-8342-d2c6ab995d76 tempest-FlavorsV255TestJSON-1797156618 tempest-FlavorsV255TestJSON-1797156618-project] 10.222.0.35 "GET /compute/v2.1/flavors" status: 200 len: 3927 microversion: 2.55 time: 0.051460 Jun 10 17:59:04.185723 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 271/534] 10.222.0.35 () {60 vars in 1165 bytes} [Fri Jun 10 17:59:04 2022] GET /compute/v2.1/flavors => generated 3927 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 17:59:04.200456 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a9dd3d41-f073-4f6c-af1e-46cf6322c9d3 tempest-FlavorsV255TestJSON-348013084 tempest-FlavorsV255TestJSON-348013084-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:04.201534 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:59:04.201534 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:59:04.299024 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5cf8e286-cfd7-44e0-bb6f-a87fedfe057a tempest-FlavorsExtraSpecsTestJSON-682183489 tempest-FlavorsExtraSpecsTestJSON-682183489-project-admin] 10.222.0.35 "PUT /compute/v2.1/flavors/985137129/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.126143 Jun 10 17:59:04.303506 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 264/535] 10.222.0.35 () {60 vars in 1261 bytes} [Fri Jun 10 17:59:04 2022] PUT /compute/v2.1/flavors/985137129/os-extra_specs/hw:numa_nodes => generated 22 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 17:59:04.313385 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-994483d0-f96f-432f-a865-bdf38ddf0361 tempest-FlavorsExtraSpecsTestJSON-682183489 tempest-FlavorsExtraSpecsTestJSON-682183489-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:04.325381 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a9dd3d41-f073-4f6c-af1e-46cf6322c9d3 tempest-FlavorsV255TestJSON-348013084 tempest-FlavorsV255TestJSON-348013084-project-admin] 10.222.0.35 "DELETE /compute/v2.1/flavors/1944197844" status: 202 len: 0 microversion: 2.55 time: 0.129122 Jun 10 17:59:04.326114 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 272/536] 10.222.0.35 () {60 vars in 1201 bytes} [Fri Jun 10 17:59:04 2022] DELETE /compute/v2.1/flavors/1944197844 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 10 17:59:04.335052 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d1982420-7062-41e5-b7b4-c7ce019cc4eb tempest-FlavorsV255TestJSON-348013084 tempest-FlavorsV255TestJSON-348013084-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:04.336564 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-994483d0-f96f-432f-a865-bdf38ddf0361 tempest-FlavorsExtraSpecsTestJSON-682183489 tempest-FlavorsExtraSpecsTestJSON-682183489-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/985137129/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.031242 Jun 10 17:59:04.337471 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 265/537] 10.222.0.35 () {58 vars in 1199 bytes} [Fri Jun 10 17:59:04 2022] GET /compute/v2.1/flavors/985137129/os-extra_specs => generated 66 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 17:59:04.352949 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a7df0843-30a2-4c3e-aa79-80c3dc69d881 tempest-FlavorsExtraSpecsTestJSON-682183489 tempest-FlavorsExtraSpecsTestJSON-682183489-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:04.355356 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:59:04.355356 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:59:04.360958 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=3,nova_api:INSERT=4,nova_api:SAVEPOINT=6,nova_api:RELEASE=6 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:59:04.381882 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d1982420-7062-41e5-b7b4-c7ce019cc4eb tempest-FlavorsV255TestJSON-348013084 tempest-FlavorsV255TestJSON-348013084-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 6572 microversion: 2.55 time: 0.050771 Jun 10 17:59:04.409279 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 273/538] 10.222.0.35 () {60 vars in 1186 bytes} [Fri Jun 10 17:59:04 2022] GET /compute/v2.1/flavors/detail => generated 6572 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 17:59:04.499467 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a7df0843-30a2-4c3e-aa79-80c3dc69d881 tempest-FlavorsExtraSpecsTestJSON-682183489 tempest-FlavorsExtraSpecsTestJSON-682183489-project-admin] 10.222.0.35 "DELETE /compute/v2.1/flavors/985137129/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.153488 Jun 10 17:59:04.502048 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 266/539] 10.222.0.35 () {58 vars in 1244 bytes} [Fri Jun 10 17:59:04 2022] DELETE /compute/v2.1/flavors/985137129/os-extra_specs/hw:numa_nodes => generated 0 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 10 17:59:04.508668 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-900a7e46-6315-42e8-ab8d-b06bba4bdc08 tempest-FlavorsExtraSpecsTestJSON-682183489 tempest-FlavorsExtraSpecsTestJSON-682183489-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:04.509863 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:59:04.509863 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:59:04.622242 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-900a7e46-6315-42e8-ab8d-b06bba4bdc08 tempest-FlavorsExtraSpecsTestJSON-682183489 tempest-FlavorsExtraSpecsTestJSON-682183489-project-admin] 10.222.0.35 "DELETE /compute/v2.1/flavors/985137129/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.117271 Jun 10 17:59:04.626153 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 274/540] 10.222.0.35 () {58 vars in 1244 bytes} [Fri Jun 10 17:59:04 2022] DELETE /compute/v2.1/flavors/985137129/os-extra_specs/hw:cpu_policy => generated 0 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 10 17:59:04.634126 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ed11dd86-b540-4e39-a388-880514e83a69 tempest-FlavorsExtraSpecsTestJSON-682183489 tempest-FlavorsExtraSpecsTestJSON-682183489-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:04.656396 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ed11dd86-b540-4e39-a388-880514e83a69 tempest-FlavorsExtraSpecsTestJSON-682183489 tempest-FlavorsExtraSpecsTestJSON-682183489-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/985137129/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.025813 Jun 10 17:59:04.657435 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 267/541] 10.222.0.35 () {58 vars in 1199 bytes} [Fri Jun 10 17:59:04 2022] GET /compute/v2.1/flavors/985137129/os-extra_specs => generated 19 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 17:59:04.668698 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-005986eb-24a5-451f-9c89-f92cfe4be5e1 tempest-FlavorsExtraSpecsTestJSON-682183489 tempest-FlavorsExtraSpecsTestJSON-682183489-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:04.802278 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-005986eb-24a5-451f-9c89-f92cfe4be5e1 tempest-FlavorsExtraSpecsTestJSON-682183489 tempest-FlavorsExtraSpecsTestJSON-682183489-project-admin] 10.222.0.35 "DELETE /compute/v2.1/flavors/985137129" status: 202 len: 0 microversion: 2.1 time: 0.137898 Jun 10 17:59:04.802978 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 275/542] 10.222.0.35 () {58 vars in 1157 bytes} [Fri Jun 10 17:59:04 2022] DELETE /compute/v2.1/flavors/985137129 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 17:59:04.809581 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4db1e0b4-a9dd-4035-af57-d8cdf30efd22 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:04.811342 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4db1e0b4-a9dd-4035-af57-d8cdf30efd22 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] [instance: e6e43799-860e-4ae1-91cf-da1495ff9f64] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:04.819539 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4db1e0b4-a9dd-4035-af57-d8cdf30efd22 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:04.823195 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4db1e0b4-a9dd-4035-af57-d8cdf30efd22 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:04.823195 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4db1e0b4-a9dd-4035-af57-d8cdf30efd22 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:04.823195 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4db1e0b4-a9dd-4035-af57-d8cdf30efd22 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:05.162353 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4db1e0b4-a9dd-4035-af57-d8cdf30efd22 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c64251f22f844077b4d9ce2617c11082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cb46777a914dbaa7c64c5047cc65e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:05.174305 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4db1e0b4-a9dd-4035-af57-d8cdf30efd22 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] 10.222.0.35 "GET /compute/v2.1/servers/e6e43799-860e-4ae1-91cf-da1495ff9f64" status: 200 len: 1521 microversion: 2.1 time: 0.370185 Jun 10 17:59:05.177454 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 276/543] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:04 2022] GET /compute/v2.1/servers/e6e43799-860e-4ae1-91cf-da1495ff9f64 => generated 1521 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:05.191415 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6e4cf8f9-065b-4676-8468-61d300be90cf tempest-FlavorsExtraSpecsTestJSON-682183489 tempest-FlavorsExtraSpecsTestJSON-682183489-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:05.227876 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6e4cf8f9-065b-4676-8468-61d300be90cf tempest-FlavorsExtraSpecsTestJSON-682183489 tempest-FlavorsExtraSpecsTestJSON-682183489-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.049157 Jun 10 17:59:05.228507 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 277/544] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 17:59:05 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:05.234751 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-5aa86a9d-3a32-47b7-8a49-cb79c86f965b req-bc86e672-846a-42b1-a4d1-e47fdc339f5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2", "name": "network-vif-deleted", "tag": "855ea6e2-3ff5-40bf-8166-8de14ae27ad9"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:05.243809 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-5aa86a9d-3a32-47b7-8a49-cb79c86f965b req-bc86e672-846a-42b1-a4d1-e47fdc339f5b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:05.244333 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-5aa86a9d-3a32-47b7-8a49-cb79c86f965b req-bc86e672-846a-42b1-a4d1-e47fdc339f5b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:05.268921 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-5aa86a9d-3a32-47b7-8a49-cb79c86f965b req-bc86e672-846a-42b1-a4d1-e47fdc339f5b service nova] Creating event network-vif-deleted:855ea6e2-3ff5-40bf-8166-8de14ae27ad9 for instance cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 on chh1-master-2 Jun 10 17:59:05.278576 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-5aa86a9d-3a32-47b7-8a49-cb79c86f965b req-bc86e672-846a-42b1-a4d1-e47fdc339f5b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046040 Jun 10 17:59:05.278576 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 278/545] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:05.278993 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2a75cbee-26ce-4d35-88d0-de4abe548e76 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Calling method '.version_select at 0x7f77c14724c0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:05.278993 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:59:05.278993 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:59:05.280499 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2a75cbee-26ce-4d35-88d0-de4abe548e76 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:05.281060 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2a75cbee-26ce-4d35-88d0-de4abe548e76 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:05.284498 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-820eca30-56ce-4cbd-959a-ba56582994cf tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:05.285432 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-820eca30-56ce-4cbd-959a-ba56582994cf tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: c922bb8c-ba7b-4448-9d8b-a6fb6498b25b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:05.293058 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-820eca30-56ce-4cbd-959a-ba56582994cf tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:05.293954 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-820eca30-56ce-4cbd-959a-ba56582994cf tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:05.295466 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-820eca30-56ce-4cbd-959a-ba56582994cf tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:05.296284 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-820eca30-56ce-4cbd-959a-ba56582994cf tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:05.313763 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2a75cbee-26ce-4d35-88d0-de4abe548e76 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:05.320682 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2a75cbee-26ce-4d35-88d0-de4abe548e76 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:05.342878 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2a75cbee-26ce-4d35-88d0-de4abe548e76 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:05.348085 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2a75cbee-26ce-4d35-88d0-de4abe548e76 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:05.367070 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2a75cbee-26ce-4d35-88d0-de4abe548e76 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] 10.222.0.35 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.658961 Jun 10 17:59:05.368055 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 268/546] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 17:59:04 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 17:59:05.379133 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-90b2e551-9666-4530-9109-1c492157a211 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:05.382364 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-90b2e551-9666-4530-9109-1c492157a211 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] [instance: e6e43799-860e-4ae1-91cf-da1495ff9f64] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:05.383892 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-820eca30-56ce-4cbd-959a-ba56582994cf tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e5bd8a55d42cdb7879fbead65627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9d5dac7c8243aeaa207c5a1ecb399a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:05.397719 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-820eca30-56ce-4cbd-959a-ba56582994cf tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b" status: 200 len: 1315 microversion: 2.1 time: 0.117321 Jun 10 17:59:05.397719 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 279/547] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:05 2022] GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b => generated 1315 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:05.405071 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f24b7b40-86b1-49d7-9302-10817093ef5b tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Calling method '.version_select at 0x7f77c19051f0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:05.406150 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:59:05.406150 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:59:05.407613 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f24b7b40-86b1-49d7-9302-10817093ef5b tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:05.408073 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f24b7b40-86b1-49d7-9302-10817093ef5b tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:05.409472 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90b2e551-9666-4530-9109-1c492157a211 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:05.411440 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90b2e551-9666-4530-9109-1c492157a211 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:05.414186 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90b2e551-9666-4530-9109-1c492157a211 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:05.415712 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90b2e551-9666-4530-9109-1c492157a211 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:05.433382 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f24b7b40-86b1-49d7-9302-10817093ef5b tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:05.433840 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f24b7b40-86b1-49d7-9302-10817093ef5b tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:05.453233 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f24b7b40-86b1-49d7-9302-10817093ef5b tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:05.453689 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f24b7b40-86b1-49d7-9302-10817093ef5b tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:05.461465 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f24b7b40-86b1-49d7-9302-10817093ef5b tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] 10.222.0.35 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.062862 Jun 10 17:59:05.464470 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 280/548] 10.222.0.35 () {58 vars in 1166 bytes} [Fri Jun 10 17:59:05 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:05.478573 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4ff52bbf-ff71-4485-b4f8-5a677b19b8e3 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Calling method '.version_select at 0x7f77c18a08b0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:05.484686 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-90b2e551-9666-4530-9109-1c492157a211 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] HTTP exception thrown: Action 999 not found Jun 10 17:59:05.485105 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:59:05.485105 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:59:05.485105 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ff52bbf-ff71-4485-b4f8-5a677b19b8e3 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:05.489679 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ff52bbf-ff71-4485-b4f8-5a677b19b8e3 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:05.489817 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-90b2e551-9666-4530-9109-1c492157a211 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Request method failure captured: Jun 10 17:59:05.489817 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/e6e43799-860e-4ae1-91cf-da1495ff9f64/os-instance-actions/999 HTTP/1.1 Jun 10 17:59:05.489817 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 17:59:05.489817 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 17:59:05.489817 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 17:59:05.489817 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 17:59:05.489817 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 17:59:05.489817 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 17:59:05.489817 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 17:59:05.489817 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 17:59:05.489817 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4ZXYQqbwKta6qOTqocTyF4iAHrWbj0ZPAImMAMpJKVSS51L6mk70ljuSAh0-J-CyZ6SWXViUPkBEDS6wj1Bzo5Q1tS1pS3MAnR4NfZJITdDvsBpprBvEgGebmbWzmAE7uw1bxYPYz8PBKmDUjNkzujnQm-WZ6rAeycItiNUakQw3Gk Jun 10 17:59:05.489817 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 17:59:05.489817 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 17:59:05.489817 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 17:59:05.489817 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 17:59:05.489817 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 17:59:05.489817 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 17:59:05.489817 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 56cb46777a914dbaa7c64c5047cc65e4 Jun 10 17:59:05.489817 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1484379872 Jun 10 17:59:05.489817 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 17:59:05.489817 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 17:59:05.491231 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/56cb46777a914dbaa7c64c5047cc65e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/56cb46777a914dbaa7c64c5047cc65e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/56cb46777a914dbaa7c64c5047cc65e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_56cb46777a914dbaa7c64c5047cc65e4", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:59:05.491231 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1484379872 Jun 10 17:59:05.491231 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 56cb46777a914dbaa7c64c5047cc65e4 Jun 10 17:59:05.491231 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1484379872 Jun 10 17:59:05.491231 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-InstanceActionsNegativeTestJSON-1484379872-project Jun 10 17:59:05.491231 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 17:59:05.491231 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 17:59:05.491231 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: c64251f22f844077b4d9ce2617c11082 Jun 10 17:59:05.491231 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1484379872-project Jun 10 17:59:05.491231 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 17:59:05.491231 chdv-master-2 devstack@n-api.service[126594]: exception: Action 999 not found Jun 10 17:59:05.491231 chdv-master-2 devstack@n-api.service[126594]: action_args: {'server_id': 'e6e43799-860e-4ae1-91cf-da1495ff9f64', 'id': '999'} Jun 10 17:59:05.491999 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:59:05.491999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:59:05.491999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:59:05.491999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:59:05.491999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:59:05.491999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:59:05.491999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:59:05.491999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:59:05.491999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Jun 10 17:59:05.491999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 10 17:59:05.491999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Jun 10 17:59:05.491999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:59:05.491999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:59:05.491999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:59:05.491999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:59:05.491999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:59:05.491999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:59:05.491999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:59:05.491999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:59:05.491999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Jun 10 17:59:05.491999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:59:05.494383 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-90b2e551-9666-4530-9109-1c492157a211 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Returning 404 to user: Action 999 not found {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:59:05.494383 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-90b2e551-9666-4530-9109-1c492157a211 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] 10.222.0.35 "GET /compute/v2.1/servers/e6e43799-860e-4ae1-91cf-da1495ff9f64/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.118837 Jun 10 17:59:05.494383 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 269/549] 10.222.0.35 () {58 vars in 1307 bytes} [Fri Jun 10 17:59:05 2022] GET /compute/v2.1/servers/e6e43799-860e-4ae1-91cf-da1495ff9f64/os-instance-actions/999 => generated 66 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 10 17:59:05.505893 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1530efce-2716-4cfc-b22f-0b2cc87b4027 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Calling method '.version_select at 0x7f77c14fb160>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:05.506498 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1530efce-2716-4cfc-b22f-0b2cc87b4027 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] [instance: e29bf4a8-7933-4652-ada3-053d97cffe74] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:05.513152 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ff52bbf-ff71-4485-b4f8-5a677b19b8e3 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:05.513609 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ff52bbf-ff71-4485-b4f8-5a677b19b8e3 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:05.522629 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-1530efce-2716-4cfc-b22f-0b2cc87b4027 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] HTTP exception thrown: Instance e29bf4a8-7933-4652-ada3-053d97cffe74 could not be found. Jun 10 17:59:05.527735 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1530efce-2716-4cfc-b22f-0b2cc87b4027 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Request method failure captured: Jun 10 17:59:05.527735 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/e29bf4a8-7933-4652-ada3-053d97cffe74/os-instance-actions HTTP/1.1 Jun 10 17:59:05.527735 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 17:59:05.527735 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 17:59:05.527735 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 17:59:05.527735 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 17:59:05.527735 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 17:59:05.527735 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 17:59:05.527735 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 17:59:05.527735 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 17:59:05.527735 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4ZXYQqbwKta6qOTqocTyF4iAHrWbj0ZPAImMAMpJKVSS51L6mk70ljuSAh0-J-CyZ6SWXViUPkBEDS6wj1Bzo5Q1tS1pS3MAnR4NfZJITdDvsBpprBvEgGebmbWzmAE7uw1bxYPYz8PBKmDUjNkzujnQm-WZ6rAeycItiNUakQw3Gk Jun 10 17:59:05.527735 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 17:59:05.527735 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 17:59:05.527735 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 17:59:05.527735 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 17:59:05.527735 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 17:59:05.527735 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 17:59:05.527735 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 56cb46777a914dbaa7c64c5047cc65e4 Jun 10 17:59:05.527735 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1484379872 Jun 10 17:59:05.527735 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 17:59:05.527735 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 17:59:05.529151 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/56cb46777a914dbaa7c64c5047cc65e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/56cb46777a914dbaa7c64c5047cc65e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/56cb46777a914dbaa7c64c5047cc65e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_56cb46777a914dbaa7c64c5047cc65e4", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:59:05.529151 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1484379872 Jun 10 17:59:05.529151 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 56cb46777a914dbaa7c64c5047cc65e4 Jun 10 17:59:05.529151 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1484379872 Jun 10 17:59:05.529151 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-InstanceActionsNegativeTestJSON-1484379872-project Jun 10 17:59:05.529151 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 17:59:05.529151 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 17:59:05.529151 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: c64251f22f844077b4d9ce2617c11082 Jun 10 17:59:05.529151 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1484379872-project Jun 10 17:59:05.529151 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 17:59:05.529151 chdv-master-2 devstack@n-api.service[126594]: exception: Instance e29bf4a8-7933-4652-ada3-053d97cffe74 could not be found. Jun 10 17:59:05.529151 chdv-master-2 devstack@n-api.service[126594]: action_args: {'server_id': 'e29bf4a8-7933-4652-ada3-053d97cffe74'} Jun 10 17:59:05.529849 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:59:05.529849 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:59:05.529849 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 17:59:05.529849 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 17:59:05.529849 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 17:59:05.529849 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 17:59:05.529849 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 10 17:59:05.529849 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 10 17:59:05.529849 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e29bf4a8-7933-4652-ada3-053d97cffe74 could not be found. Jun 10 17:59:05.529849 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:59:05.529849 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:59:05.529849 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:59:05.529849 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:59:05.529849 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:59:05.529849 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:59:05.529849 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:59:05.529849 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:59:05.529849 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 17:59:05.529849 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 17:59:05.529849 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:59:05.531065 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:59:05.531065 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Jun 10 17:59:05.531065 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Jun 10 17:59:05.531065 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 17:59:05.531065 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 17:59:05.531065 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Jun 10 17:59:05.531065 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Jun 10 17:59:05.531065 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 17:59:05.531065 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 17:59:05.531065 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e29bf4a8-7933-4652-ada3-053d97cffe74 could not be found. Jun 10 17:59:05.531065 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:59:05.531065 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:59:05.531065 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:59:05.531065 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:59:05.531065 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:59:05.531065 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:59:05.531065 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:59:05.531065 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:59:05.531065 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e29bf4a8-7933-4652-ada3-053d97cffe74 could not be found. Jun 10 17:59:05.531065 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:59:05.533046 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1530efce-2716-4cfc-b22f-0b2cc87b4027 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Returning 404 to user: Instance e29bf4a8-7933-4652-ada3-053d97cffe74 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:59:05.533046 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1530efce-2716-4cfc-b22f-0b2cc87b4027 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] 10.222.0.35 "GET /compute/v2.1/servers/e29bf4a8-7933-4652-ada3-053d97cffe74/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.033559 Jun 10 17:59:05.533046 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 270/550] 10.222.0.35 () {58 vars in 1295 bytes} [Fri Jun 10 17:59:05 2022] GET /compute/v2.1/servers/e29bf4a8-7933-4652-ada3-053d97cffe74/os-instance-actions => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 17:59:05.533251 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ff52bbf-ff71-4485-b4f8-5a677b19b8e3 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:05.533251 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ff52bbf-ff71-4485-b4f8-5a677b19b8e3 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:05.543333 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5966eff5-683c-45b4-9e86-42c48d8581eb tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:05.544702 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5966eff5-683c-45b4-9e86-42c48d8581eb tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] [instance: e6e43799-860e-4ae1-91cf-da1495ff9f64] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:05.547688 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4ff52bbf-ff71-4485-b4f8-5a677b19b8e3 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] 10.222.0.35 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.075085 Jun 10 17:59:05.552537 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 281/551] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 17:59:05 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:05.555936 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5966eff5-683c-45b4-9e86-42c48d8581eb tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:05.557167 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5966eff5-683c-45b4-9e86-42c48d8581eb tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:05.558221 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5966eff5-683c-45b4-9e86-42c48d8581eb tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:05.559001 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5966eff5-683c-45b4-9e86-42c48d8581eb tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:05.560009 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f8ff935a-f27c-4912-84ee-42005e5ea4e8 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Calling method '.version_select at 0x7f77c1905280>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:05.560846 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:59:05.560846 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:59:05.573319 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8ff935a-f27c-4912-84ee-42005e5ea4e8 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:05.574021 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8ff935a-f27c-4912-84ee-42005e5ea4e8 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:05.598496 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8ff935a-f27c-4912-84ee-42005e5ea4e8 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:05.600972 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5966eff5-683c-45b4-9e86-42c48d8581eb tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] [instance: e6e43799-860e-4ae1-91cf-da1495ff9f64] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 17:59:05.603077 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8ff935a-f27c-4912-84ee-42005e5ea4e8 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:05.618634 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f8ff935a-f27c-4912-84ee-42005e5ea4e8 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] 10.222.0.35 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.062117 Jun 10 17:59:05.619433 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 282/552] 10.222.0.35 () {58 vars in 1151 bytes} [Fri Jun 10 17:59:05 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:05.635591 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7579a23a-ea6c-4a06-a877-ecbb2d359ddc tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Calling method '.version_select at 0x7f77c19053a0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:05.636681 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:59:05.636681 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:59:05.638100 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7579a23a-ea6c-4a06-a877-ecbb2d359ddc tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:05.638934 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7579a23a-ea6c-4a06-a877-ecbb2d359ddc tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:05.691156 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7579a23a-ea6c-4a06-a877-ecbb2d359ddc tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] 10.222.0.35 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.059115 Jun 10 17:59:05.695736 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 283/553] 10.222.0.35 () {58 vars in 1178 bytes} [Fri Jun 10 17:59:05 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 17:59:05.708066 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a58da855-ebb3-4add-bf59-8cdc13c1d684 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Calling method '.version_select at 0x7f77c1905790>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:05.709117 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:59:05.709117 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:59:05.710612 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a58da855-ebb3-4add-bf59-8cdc13c1d684 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:05.711272 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a58da855-ebb3-4add-bf59-8cdc13c1d684 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:05.717021 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:59:05.727873 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a58da855-ebb3-4add-bf59-8cdc13c1d684 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:05.728399 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a58da855-ebb3-4add-bf59-8cdc13c1d684 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:05.741329 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a58da855-ebb3-4add-bf59-8cdc13c1d684 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:05.741784 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a58da855-ebb3-4add-bf59-8cdc13c1d684 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:05.748380 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a58da855-ebb3-4add-bf59-8cdc13c1d684 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] 10.222.0.35 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.044856 Jun 10 17:59:05.749863 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 284/554] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 17:59:05 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:05.759525 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-835cf65f-540b-4455-84e8-758cbe02d1c1 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Calling method '.version_select at 0x7f77c18a01f0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:05.767251 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:59:05.767251 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:59:05.767251 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-835cf65f-540b-4455-84e8-758cbe02d1c1 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:05.767251 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-835cf65f-540b-4455-84e8-758cbe02d1c1 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:05.776954 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-835cf65f-540b-4455-84e8-758cbe02d1c1 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:05.777839 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-835cf65f-540b-4455-84e8-758cbe02d1c1 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:05.784682 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-835cf65f-540b-4455-84e8-758cbe02d1c1 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] 10.222.0.35 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.029469 Jun 10 17:59:05.785840 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 285/555] 10.222.0.35 () {58 vars in 1151 bytes} [Fri Jun 10 17:59:05 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 17:59:05.800334 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bf4c4e13-6fda-44b6-8646-0eeb21e0cba0 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Calling method '.version_select at 0x7f77c1a3aee0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:05.801335 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:59:05.801335 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:59:05.802847 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bf4c4e13-6fda-44b6-8646-0eeb21e0cba0 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:05.802980 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bf4c4e13-6fda-44b6-8646-0eeb21e0cba0 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:05.824550 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bf4c4e13-6fda-44b6-8646-0eeb21e0cba0 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:05.824975 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bf4c4e13-6fda-44b6-8646-0eeb21e0cba0 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:05.831703 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bf4c4e13-6fda-44b6-8646-0eeb21e0cba0 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] 10.222.0.35 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.037322 Jun 10 17:59:05.832518 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 286/556] 10.222.0.35 () {58 vars in 1151 bytes} [Fri Jun 10 17:59:05 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:05.844741 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ecef19f6-a087-4257-8f33-05bced939250 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Calling method '.version_select at 0x7f77c1905160>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:05.845717 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:59:05.845717 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:59:05.849310 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ecef19f6-a087-4257-8f33-05bced939250 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:05.853405 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ecef19f6-a087-4257-8f33-05bced939250 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:05.863703 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ecef19f6-a087-4257-8f33-05bced939250 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:05.864260 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ecef19f6-a087-4257-8f33-05bced939250 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:05.889246 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ecef19f6-a087-4257-8f33-05bced939250 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:05.890102 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ecef19f6-a087-4257-8f33-05bced939250 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:05.918946 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ecef19f6-a087-4257-8f33-05bced939250 tempest-HypervisorAdminTestJSON-424391654 tempest-HypervisorAdminTestJSON-424391654-project-admin] 10.222.0.35 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.078601 Jun 10 17:59:05.919874 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 287/557] 10.222.0.35 () {58 vars in 1172 bytes} [Fri Jun 10 17:59:05 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 17:59:05.973900 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5966eff5-683c-45b4-9e86-42c48d8581eb tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] 10.222.0.35 "DELETE /compute/v2.1/servers/e6e43799-860e-4ae1-91cf-da1495ff9f64" status: 204 len: 0 microversion: 2.1 time: 0.433206 Jun 10 17:59:05.978611 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 271/558] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 17:59:05 2022] DELETE /compute/v2.1/servers/e6e43799-860e-4ae1-91cf-da1495ff9f64 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 17:59:05.986540 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-866374bb-0566-4d50-be51-1192f48a86f6 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:05.987733 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-866374bb-0566-4d50-be51-1192f48a86f6 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] [instance: e6e43799-860e-4ae1-91cf-da1495ff9f64] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:06.001582 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-866374bb-0566-4d50-be51-1192f48a86f6 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:06.002042 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-866374bb-0566-4d50-be51-1192f48a86f6 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:06.003059 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-866374bb-0566-4d50-be51-1192f48a86f6 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:06.003810 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-866374bb-0566-4d50-be51-1192f48a86f6 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:06.169857 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-866374bb-0566-4d50-be51-1192f48a86f6 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c64251f22f844077b4d9ce2617c11082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cb46777a914dbaa7c64c5047cc65e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:06.180429 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-866374bb-0566-4d50-be51-1192f48a86f6 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] 10.222.0.35 "GET /compute/v2.1/servers/e6e43799-860e-4ae1-91cf-da1495ff9f64" status: 200 len: 1527 microversion: 2.1 time: 0.199113 Jun 10 17:59:06.181249 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 288/559] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:05 2022] GET /compute/v2.1/servers/e6e43799-860e-4ae1-91cf-da1495ff9f64 => generated 1527 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:06.423442 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c096d095-90e7-453c-bda1-b3aefb45046a tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:06.424223 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c096d095-90e7-453c-bda1-b3aefb45046a tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: c922bb8c-ba7b-4448-9d8b-a6fb6498b25b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:06.440141 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c096d095-90e7-453c-bda1-b3aefb45046a tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:06.440822 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c096d095-90e7-453c-bda1-b3aefb45046a tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:06.441911 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c096d095-90e7-453c-bda1-b3aefb45046a tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:06.442558 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c096d095-90e7-453c-bda1-b3aefb45046a tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:06.584972 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c096d095-90e7-453c-bda1-b3aefb45046a tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e5bd8a55d42cdb7879fbead65627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9d5dac7c8243aeaa207c5a1ecb399a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:06.625686 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c096d095-90e7-453c-bda1-b3aefb45046a tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b" status: 200 len: 1333 microversion: 2.1 time: 0.198083 Jun 10 17:59:06.625686 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 272/560] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:06 2022] GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b => generated 1333 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:07.204400 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e674fefc-01d1-45e5-94e6-d1c1c3eb2466 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:07.205784 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e674fefc-01d1-45e5-94e6-d1c1c3eb2466 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] [instance: e6e43799-860e-4ae1-91cf-da1495ff9f64] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:07.224543 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e674fefc-01d1-45e5-94e6-d1c1c3eb2466 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:07.229871 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e674fefc-01d1-45e5-94e6-d1c1c3eb2466 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:07.233848 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e674fefc-01d1-45e5-94e6-d1c1c3eb2466 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:07.236492 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e674fefc-01d1-45e5-94e6-d1c1c3eb2466 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:07.809266 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e674fefc-01d1-45e5-94e6-d1c1c3eb2466 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c64251f22f844077b4d9ce2617c11082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cb46777a914dbaa7c64c5047cc65e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:07.822672 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e674fefc-01d1-45e5-94e6-d1c1c3eb2466 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] 10.222.0.35 "GET /compute/v2.1/servers/e6e43799-860e-4ae1-91cf-da1495ff9f64" status: 200 len: 1527 microversion: 2.1 time: 0.624835 Jun 10 17:59:07.826053 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 289/561] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:07 2022] GET /compute/v2.1/servers/e6e43799-860e-4ae1-91cf-da1495ff9f64 => generated 1527 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:07.828879 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-572979bd-25dd-420d-af0b-9b737201e386 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:07.832992 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-572979bd-25dd-420d-af0b-9b737201e386 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: c922bb8c-ba7b-4448-9d8b-a6fb6498b25b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:07.848585 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-572979bd-25dd-420d-af0b-9b737201e386 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:07.849185 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-572979bd-25dd-420d-af0b-9b737201e386 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:07.850107 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-572979bd-25dd-420d-af0b-9b737201e386 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:07.850787 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-572979bd-25dd-420d-af0b-9b737201e386 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:08.071231 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-572979bd-25dd-420d-af0b-9b737201e386 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e5bd8a55d42cdb7879fbead65627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9d5dac7c8243aeaa207c5a1ecb399a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:08.080505 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1e814552-9162-435c-ade2-780bfb70c1e3 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-264178186", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:08.096670 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-572979bd-25dd-420d-af0b-9b737201e386 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b" status: 200 len: 1388 microversion: 2.1 time: 0.271530 Jun 10 17:59:08.107462 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 290/562] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:07 2022] GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b => generated 1388 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:08.211355 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-1e814552-9162-435c-ade2-780bfb70c1e3 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] validate_networks() for None {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 17:59:08.725138 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-1e814552-9162-435c-ade2-780bfb70c1e3 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 17:59:08.725566 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-1e814552-9162-435c-ade2-780bfb70c1e3 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 17:59:08.726045 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-1e814552-9162-435c-ade2-780bfb70c1e3 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 17:59:08.726459 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-1e814552-9162-435c-ade2-780bfb70c1e3 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 17:59:08.726876 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-1e814552-9162-435c-ade2-780bfb70c1e3 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 17:59:08.736766 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1e814552-9162-435c-ade2-780bfb70c1e3 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:08.737427 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1e814552-9162-435c-ade2-780bfb70c1e3 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:08.738241 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1e814552-9162-435c-ade2-780bfb70c1e3 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:08.739010 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1e814552-9162-435c-ade2-780bfb70c1e3 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:08.780484 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-1e814552-9162-435c-ade2-780bfb70c1e3 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Getting quotas for project 2f1a7bc463e44066a9da45921fb2043e. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 17:59:08.794510 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-1e814552-9162-435c-ade2-780bfb70c1e3 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Getting quotas for user c1ee010108054f52bd787a25060f7ced and project 2f1a7bc463e44066a9da45921fb2043e. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 17:59:08.810001 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1e814552-9162-435c-ade2-780bfb70c1e3 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 17:59:08.813181 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1e814552-9162-435c-ade2-780bfb70c1e3 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] [instance: d3ce1519-1a65-40bd-bd5b-7bb95d0e136d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 17:59:08.838961 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-ab714f02-1787-4f57-a33c-805ac5c838cb req-0a06f844-6e64-4ea5-a86e-b4e7d575aa06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6e43799-860e-4ae1-91cf-da1495ff9f64", "name": "network-vif-deleted", "tag": "7c41d5b5-9e8e-4b88-88a4-5c223d34156c"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:08.861679 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-ab714f02-1787-4f57-a33c-805ac5c838cb req-0a06f844-6e64-4ea5-a86e-b4e7d575aa06 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:08.861679 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-ab714f02-1787-4f57-a33c-805ac5c838cb req-0a06f844-6e64-4ea5-a86e-b4e7d575aa06 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:08.875275 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-ab714f02-1787-4f57-a33c-805ac5c838cb req-0a06f844-6e64-4ea5-a86e-b4e7d575aa06 service nova] Creating event network-vif-deleted:7c41d5b5-9e8e-4b88-88a4-5c223d34156c for instance e6e43799-860e-4ae1-91cf-da1495ff9f64 on chh1-master-2 Jun 10 17:59:08.880654 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-ab714f02-1787-4f57-a33c-805ac5c838cb req-0a06f844-6e64-4ea5-a86e-b4e7d575aa06 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047559 Jun 10 17:59:08.881402 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 291/563] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 17:59:08.889544 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b7f4e8ae-bac9-460e-842a-9a9262cfeaac tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:08.890255 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b7f4e8ae-bac9-460e-842a-9a9262cfeaac tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] [instance: e6e43799-860e-4ae1-91cf-da1495ff9f64] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:08.896687 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b7f4e8ae-bac9-460e-842a-9a9262cfeaac tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:08.897148 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b7f4e8ae-bac9-460e-842a-9a9262cfeaac tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:08.897933 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b7f4e8ae-bac9-460e-842a-9a9262cfeaac tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:08.898968 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b7f4e8ae-bac9-460e-842a-9a9262cfeaac tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:08.975690 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1e814552-9162-435c-ade2-780bfb70c1e3 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.395348 Jun 10 17:59:08.977660 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b7f4e8ae-bac9-460e-842a-9a9262cfeaac tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c64251f22f844077b4d9ce2617c11082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cb46777a914dbaa7c64c5047cc65e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:08.978221 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 273/564] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:59:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1402 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 17:59:08.985159 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f760fb8a-5931-457b-a855-ad48e13fc1d9 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:08.986233 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f760fb8a-5931-457b-a855-ad48e13fc1d9 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] [instance: d3ce1519-1a65-40bd-bd5b-7bb95d0e136d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:08.993353 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b7f4e8ae-bac9-460e-842a-9a9262cfeaac tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] 10.222.0.35 "GET /compute/v2.1/servers/e6e43799-860e-4ae1-91cf-da1495ff9f64" status: 200 len: 1485 microversion: 2.1 time: 0.107813 Jun 10 17:59:09.015284 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 292/565] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:08 2022] GET /compute/v2.1/servers/e6e43799-860e-4ae1-91cf-da1495ff9f64 => generated 1485 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:09.082597 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f760fb8a-5931-457b-a855-ad48e13fc1d9 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ee010108054f52bd787a25060f7ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a7bc463e44066a9da45921fb2043e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:09.091690 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f760fb8a-5931-457b-a855-ad48e13fc1d9 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] 10.222.0.35 "GET /compute/v2.1/servers/d3ce1519-1a65-40bd-bd5b-7bb95d0e136d" status: 200 len: 1213 microversion: 2.1 time: 0.112087 Jun 10 17:59:09.104756 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 274/566] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:08 2022] GET /compute/v2.1/servers/d3ce1519-1a65-40bd-bd5b-7bb95d0e136d => generated 1213 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:09.119190 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5cc149bb-b3f1-4419-8186-27c7019ec794 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:09.120062 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5cc149bb-b3f1-4419-8186-27c7019ec794 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: c922bb8c-ba7b-4448-9d8b-a6fb6498b25b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:09.133757 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5cc149bb-b3f1-4419-8186-27c7019ec794 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:09.134508 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5cc149bb-b3f1-4419-8186-27c7019ec794 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:09.137603 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5cc149bb-b3f1-4419-8186-27c7019ec794 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:09.138350 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5cc149bb-b3f1-4419-8186-27c7019ec794 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:09.346764 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5cc149bb-b3f1-4419-8186-27c7019ec794 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e5bd8a55d42cdb7879fbead65627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9d5dac7c8243aeaa207c5a1ecb399a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:09.355332 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5cc149bb-b3f1-4419-8186-27c7019ec794 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b" status: 200 len: 1388 microversion: 2.1 time: 0.240207 Jun 10 17:59:09.358758 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 293/567] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:09 2022] GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b => generated 1388 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:10.010806 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c44f1e1d-1798-4e20-8341-41ab487a0891 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:10.011432 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c44f1e1d-1798-4e20-8341-41ab487a0891 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] [instance: e6e43799-860e-4ae1-91cf-da1495ff9f64] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:10.020745 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c44f1e1d-1798-4e20-8341-41ab487a0891 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:10.021214 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c44f1e1d-1798-4e20-8341-41ab487a0891 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:10.024175 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c44f1e1d-1798-4e20-8341-41ab487a0891 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:10.024175 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c44f1e1d-1798-4e20-8341-41ab487a0891 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:10.040876 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-c44f1e1d-1798-4e20-8341-41ab487a0891 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] HTTP exception thrown: Instance e6e43799-860e-4ae1-91cf-da1495ff9f64 could not be found. Jun 10 17:59:10.042549 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c44f1e1d-1798-4e20-8341-41ab487a0891 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Request method failure captured: Jun 10 17:59:10.042549 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/e6e43799-860e-4ae1-91cf-da1495ff9f64 HTTP/1.1 Jun 10 17:59:10.042549 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 17:59:10.042549 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 17:59:10.042549 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 17:59:10.042549 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 17:59:10.042549 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 17:59:10.042549 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 17:59:10.042549 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 17:59:10.042549 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 17:59:10.042549 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4ZXYQqbwKta6qOTqocTyF4iAHrWbj0ZPAImMAMpJKVSS51L6mk70ljuSAh0-J-CyZ6SWXViUPkBEDS6wj1Bzo5Q1tS1pS3MAnR4NfZJITdDvsBpprBvEgGebmbWzmAE7uw1bxYPYz8PBKmDUjNkzujnQm-WZ6rAeycItiNUakQw3Gk Jun 10 17:59:10.042549 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 17:59:10.042549 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 17:59:10.042549 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 17:59:10.042549 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 17:59:10.042549 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 17:59:10.042549 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 17:59:10.042549 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 56cb46777a914dbaa7c64c5047cc65e4 Jun 10 17:59:10.042549 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1484379872 Jun 10 17:59:10.042549 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 17:59:10.042549 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 17:59:10.044477 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/56cb46777a914dbaa7c64c5047cc65e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/56cb46777a914dbaa7c64c5047cc65e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/56cb46777a914dbaa7c64c5047cc65e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_56cb46777a914dbaa7c64c5047cc65e4", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:59:10.044477 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1484379872 Jun 10 17:59:10.044477 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 56cb46777a914dbaa7c64c5047cc65e4 Jun 10 17:59:10.044477 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1484379872 Jun 10 17:59:10.044477 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-InstanceActionsNegativeTestJSON-1484379872-project Jun 10 17:59:10.044477 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 17:59:10.044477 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 17:59:10.044477 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: c64251f22f844077b4d9ce2617c11082 Jun 10 17:59:10.044477 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1484379872-project Jun 10 17:59:10.044477 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 17:59:10.044477 chdv-master-2 devstack@n-api.service[126594]: exception: Instance e6e43799-860e-4ae1-91cf-da1495ff9f64 could not be found. Jun 10 17:59:10.044477 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'e6e43799-860e-4ae1-91cf-da1495ff9f64'} Jun 10 17:59:10.045373 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:59:10.045373 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:59:10.045373 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 17:59:10.045373 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 17:59:10.045373 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 17:59:10.045373 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 17:59:10.045373 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 17:59:10.045373 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 17:59:10.045373 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 17:59:10.045373 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 17:59:10.045373 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6e43799-860e-4ae1-91cf-da1495ff9f64 could not be found. Jun 10 17:59:10.045373 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:59:10.045373 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:59:10.045373 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:59:10.045373 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:59:10.045373 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:59:10.045373 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:59:10.045373 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:59:10.045373 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:59:10.045373 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:59:10.046989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:59:10.046989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 17:59:10.046989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 17:59:10.046989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 17:59:10.046989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 17:59:10.046989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 17:59:10.046989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 17:59:10.046989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6e43799-860e-4ae1-91cf-da1495ff9f64 could not be found. Jun 10 17:59:10.046989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:59:10.046989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:59:10.046989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:59:10.046989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:59:10.046989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:59:10.046989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:59:10.046989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:59:10.046989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:59:10.046989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6e43799-860e-4ae1-91cf-da1495ff9f64 could not be found. Jun 10 17:59:10.046989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:59:10.048276 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c44f1e1d-1798-4e20-8341-41ab487a0891 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] Returning 404 to user: Instance e6e43799-860e-4ae1-91cf-da1495ff9f64 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:59:10.048276 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c44f1e1d-1798-4e20-8341-41ab487a0891 tempest-InstanceActionsNegativeTestJSON-1484379872 tempest-InstanceActionsNegativeTestJSON-1484379872-project] 10.222.0.35 "GET /compute/v2.1/servers/e6e43799-860e-4ae1-91cf-da1495ff9f64" status: 404 len: 111 microversion: 2.1 time: 0.037126 Jun 10 17:59:10.048276 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 275/568] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:10 2022] GET /compute/v2.1/servers/e6e43799-860e-4ae1-91cf-da1495ff9f64 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:59:10.111394 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4a55a187-b1a1-481e-a64a-e5b5a7991f44 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:10.112010 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4a55a187-b1a1-481e-a64a-e5b5a7991f44 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] [instance: d3ce1519-1a65-40bd-bd5b-7bb95d0e136d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:10.182822 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4a55a187-b1a1-481e-a64a-e5b5a7991f44 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ee010108054f52bd787a25060f7ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a7bc463e44066a9da45921fb2043e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:10.190928 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4a55a187-b1a1-481e-a64a-e5b5a7991f44 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] 10.222.0.35 "GET /compute/v2.1/servers/d3ce1519-1a65-40bd-bd5b-7bb95d0e136d" status: 200 len: 1213 microversion: 2.1 time: 0.083813 Jun 10 17:59:10.201236 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 294/569] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:10 2022] GET /compute/v2.1/servers/d3ce1519-1a65-40bd-bd5b-7bb95d0e136d => generated 1213 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:10.377953 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-47ad5cb3-cebe-49a2-ba30-709b99d903a9 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:10.379688 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-47ad5cb3-cebe-49a2-ba30-709b99d903a9 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: c922bb8c-ba7b-4448-9d8b-a6fb6498b25b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:10.387500 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-47ad5cb3-cebe-49a2-ba30-709b99d903a9 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:10.388190 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-47ad5cb3-cebe-49a2-ba30-709b99d903a9 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:10.389163 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-47ad5cb3-cebe-49a2-ba30-709b99d903a9 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:10.389788 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-47ad5cb3-cebe-49a2-ba30-709b99d903a9 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:10.769927 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-47ad5cb3-cebe-49a2-ba30-709b99d903a9 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e5bd8a55d42cdb7879fbead65627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9d5dac7c8243aeaa207c5a1ecb399a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:10.777758 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-47ad5cb3-cebe-49a2-ba30-709b99d903a9 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b" status: 200 len: 1388 microversion: 2.1 time: 0.406833 Jun 10 17:59:10.778306 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 276/570] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:10 2022] GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b => generated 1388 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:10.909912 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-a07ea409-530e-4115-b8dd-06b1d3f5c5f8 req-bb90ae04-bf04-4204-9940-c94181e87474 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c922bb8c-ba7b-4448-9d8b-a6fb6498b25b", "tag": "25b456a2-d3a8-4a42-b69c-ca0dcb1b529a"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:10.914956 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:59:10.923477 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-a07ea409-530e-4115-b8dd-06b1d3f5c5f8 req-bb90ae04-bf04-4204-9940-c94181e87474 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:10.924358 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-a07ea409-530e-4115-b8dd-06b1d3f5c5f8 req-bb90ae04-bf04-4204-9940-c94181e87474 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:10.954958 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-a07ea409-530e-4115-b8dd-06b1d3f5c5f8 req-bb90ae04-bf04-4204-9940-c94181e87474 service nova] Creating event network-changed:25b456a2-d3a8-4a42-b69c-ca0dcb1b529a for instance c922bb8c-ba7b-4448-9d8b-a6fb6498b25b on chh2-master-2 Jun 10 17:59:10.961563 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-a07ea409-530e-4115-b8dd-06b1d3f5c5f8 req-bb90ae04-bf04-4204-9940-c94181e87474 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056300 Jun 10 17:59:10.962937 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 295/571] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:11.208363 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-04d99afc-b779-4184-b257-c8fe9bcec200 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:11.209204 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-04d99afc-b779-4184-b257-c8fe9bcec200 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] [instance: d3ce1519-1a65-40bd-bd5b-7bb95d0e136d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:11.215286 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-04d99afc-b779-4184-b257-c8fe9bcec200 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:11.215726 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-04d99afc-b779-4184-b257-c8fe9bcec200 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:11.216537 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-04d99afc-b779-4184-b257-c8fe9bcec200 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:11.216985 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-04d99afc-b779-4184-b257-c8fe9bcec200 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:11.332574 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-04d99afc-b779-4184-b257-c8fe9bcec200 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ee010108054f52bd787a25060f7ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a7bc463e44066a9da45921fb2043e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:11.344539 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-04d99afc-b779-4184-b257-c8fe9bcec200 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] 10.222.0.35 "GET /compute/v2.1/servers/d3ce1519-1a65-40bd-bd5b-7bb95d0e136d" status: 200 len: 1265 microversion: 2.1 time: 0.137354 Jun 10 17:59:11.344539 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 277/572] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:11 2022] GET /compute/v2.1/servers/d3ce1519-1a65-40bd-bd5b-7bb95d0e136d => generated 1265 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:11.796661 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3aa697a0-5062-4b91-b782-93b3d6a686a5 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:11.797441 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3aa697a0-5062-4b91-b782-93b3d6a686a5 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: c922bb8c-ba7b-4448-9d8b-a6fb6498b25b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:11.804691 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3aa697a0-5062-4b91-b782-93b3d6a686a5 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:11.805689 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3aa697a0-5062-4b91-b782-93b3d6a686a5 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:11.806983 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3aa697a0-5062-4b91-b782-93b3d6a686a5 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:11.807582 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3aa697a0-5062-4b91-b782-93b3d6a686a5 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:12.059367 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3aa697a0-5062-4b91-b782-93b3d6a686a5 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e5bd8a55d42cdb7879fbead65627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9d5dac7c8243aeaa207c5a1ecb399a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:12.071959 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3aa697a0-5062-4b91-b782-93b3d6a686a5 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b" status: 200 len: 1388 microversion: 2.1 time: 0.281173 Jun 10 17:59:12.073714 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 296/573] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:11 2022] GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b => generated 1388 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:12.361457 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b27f8723-73df-444c-984c-7fcef7af067e tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:12.362929 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b27f8723-73df-444c-984c-7fcef7af067e tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] [instance: d3ce1519-1a65-40bd-bd5b-7bb95d0e136d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:12.371586 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b27f8723-73df-444c-984c-7fcef7af067e tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:12.375755 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b27f8723-73df-444c-984c-7fcef7af067e tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:12.376874 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b27f8723-73df-444c-984c-7fcef7af067e tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:12.378722 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b27f8723-73df-444c-984c-7fcef7af067e tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:12.595251 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b27f8723-73df-444c-984c-7fcef7af067e tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ee010108054f52bd787a25060f7ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a7bc463e44066a9da45921fb2043e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:12.603572 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b27f8723-73df-444c-984c-7fcef7af067e tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] 10.222.0.35 "GET /compute/v2.1/servers/d3ce1519-1a65-40bd-bd5b-7bb95d0e136d" status: 200 len: 1271 microversion: 2.1 time: 0.248459 Jun 10 17:59:12.618693 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 278/574] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:12 2022] GET /compute/v2.1/servers/d3ce1519-1a65-40bd-bd5b-7bb95d0e136d => generated 1271 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:13.080468 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-20b29f4e-31e6-4145-a10d-da4e093858fb tempest-QuotasAdminNegativeTest-758649020 tempest-QuotasAdminNegativeTest-758649020-project-admin] Calling method '.version_select at 0x7f77c1a3a8b0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:13.094289 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1e79247a-8eb8-433e-a50f-45d7461e8374 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:13.095105 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1e79247a-8eb8-433e-a50f-45d7461e8374 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: c922bb8c-ba7b-4448-9d8b-a6fb6498b25b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:13.109673 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1e79247a-8eb8-433e-a50f-45d7461e8374 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:13.109673 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1e79247a-8eb8-433e-a50f-45d7461e8374 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:13.109673 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1e79247a-8eb8-433e-a50f-45d7461e8374 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:13.110202 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1e79247a-8eb8-433e-a50f-45d7461e8374 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:13.570073 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1e79247a-8eb8-433e-a50f-45d7461e8374 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e5bd8a55d42cdb7879fbead65627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9d5dac7c8243aeaa207c5a1ecb399a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:13.580940 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1e79247a-8eb8-433e-a50f-45d7461e8374 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b" status: 200 len: 1388 microversion: 2.1 time: 0.490891 Jun 10 17:59:13.582371 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 279/575] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:13 2022] GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b => generated 1388 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:13.619869 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-28ec0b92-eb62-4d1d-9e35-536fca0a6caf tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:13.620628 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-28ec0b92-eb62-4d1d-9e35-536fca0a6caf tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] [instance: d3ce1519-1a65-40bd-bd5b-7bb95d0e136d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:13.629347 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-28ec0b92-eb62-4d1d-9e35-536fca0a6caf tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:13.629827 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-28ec0b92-eb62-4d1d-9e35-536fca0a6caf tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:13.630811 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-28ec0b92-eb62-4d1d-9e35-536fca0a6caf tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:13.634214 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-28ec0b92-eb62-4d1d-9e35-536fca0a6caf tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:13.892246 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-20b29f4e-31e6-4145-a10d-da4e093858fb tempest-QuotasAdminNegativeTest-758649020 tempest-QuotasAdminNegativeTest-758649020-project-admin] 10.222.0.35 "GET /compute/v2.1/os-quota-sets/23a34c17b5f7453f8f29cac11b4a0c0a" status: 200 len: 371 microversion: 2.1 time: 1.355932 Jun 10 17:59:13.893118 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 297/576] 10.222.0.35 () {58 vars in 1241 bytes} [Fri Jun 10 17:59:12 2022] GET /compute/v2.1/os-quota-sets/23a34c17b5f7453f8f29cac11b4a0c0a => generated 371 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 17:59:13.903875 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-99de7590-9568-4f4a-adf7-fd6ddb1a1c22 tempest-QuotasAdminNegativeTest-758649020 tempest-QuotasAdminNegativeTest-758649020-project-admin] Action: 'update', calling method: .version_select at 0x7f77c17fc280>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:14.114872 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-28ec0b92-eb62-4d1d-9e35-536fca0a6caf tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ee010108054f52bd787a25060f7ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a7bc463e44066a9da45921fb2043e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:14.140080 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-28ec0b92-eb62-4d1d-9e35-536fca0a6caf tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] 10.222.0.35 "GET /compute/v2.1/servers/d3ce1519-1a65-40bd-bd5b-7bb95d0e136d" status: 200 len: 1313 microversion: 2.1 time: 0.523923 Jun 10 17:59:14.143894 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 280/577] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:13 2022] GET /compute/v2.1/servers/d3ce1519-1a65-40bd-bd5b-7bb95d0e136d => generated 1313 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:59:14.600041 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-66305aa9-4c3b-4c18-bc54-fe9bb78b352f tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:14.604601 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-66305aa9-4c3b-4c18-bc54-fe9bb78b352f tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: c922bb8c-ba7b-4448-9d8b-a6fb6498b25b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:14.620645 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-66305aa9-4c3b-4c18-bc54-fe9bb78b352f tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:14.622874 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-66305aa9-4c3b-4c18-bc54-fe9bb78b352f tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:14.625266 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-66305aa9-4c3b-4c18-bc54-fe9bb78b352f tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:14.625969 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-66305aa9-4c3b-4c18-bc54-fe9bb78b352f tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:14.833571 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2,nova_api:SELECT=87,nova_api:DELETE=7 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:59:14.847983 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99de7590-9568-4f4a-adf7-fd6ddb1a1c22 tempest-QuotasAdminNegativeTest-758649020 tempest-QuotasAdminNegativeTest-758649020-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:14.847983 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99de7590-9568-4f4a-adf7-fd6ddb1a1c22 tempest-QuotasAdminNegativeTest-758649020 tempest-QuotasAdminNegativeTest-758649020-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:14.847983 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99de7590-9568-4f4a-adf7-fd6ddb1a1c22 tempest-QuotasAdminNegativeTest-758649020 tempest-QuotasAdminNegativeTest-758649020-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:14.847983 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99de7590-9568-4f4a-adf7-fd6ddb1a1c22 tempest-QuotasAdminNegativeTest-758649020 tempest-QuotasAdminNegativeTest-758649020-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:15.021601 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-99de7590-9568-4f4a-adf7-fd6ddb1a1c22 tempest-QuotasAdminNegativeTest-758649020 tempest-QuotasAdminNegativeTest-758649020-project-admin] 10.222.0.35 "PUT /compute/v2.1/os-quota-sets/23a34c17b5f7453f8f29cac11b4a0c0a" status: 200 len: 328 microversion: 2.1 time: 1.122375 Jun 10 17:59:15.024344 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 298/578] 10.222.0.35 () {60 vars in 1261 bytes} [Fri Jun 10 17:59:13 2022] PUT /compute/v2.1/os-quota-sets/23a34c17b5f7453f8f29cac11b4a0c0a => generated 328 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:15.161364 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1e8f8126-c32c-41a5-bc73-33db6b44fa2f tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:15.162254 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1e8f8126-c32c-41a5-bc73-33db6b44fa2f tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] [instance: d3ce1519-1a65-40bd-bd5b-7bb95d0e136d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:15.168856 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1e8f8126-c32c-41a5-bc73-33db6b44fa2f tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:15.169635 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1e8f8126-c32c-41a5-bc73-33db6b44fa2f tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:15.170434 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1e8f8126-c32c-41a5-bc73-33db6b44fa2f tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:15.171242 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1e8f8126-c32c-41a5-bc73-33db6b44fa2f tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:15.348880 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-66305aa9-4c3b-4c18-bc54-fe9bb78b352f tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e5bd8a55d42cdb7879fbead65627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9d5dac7c8243aeaa207c5a1ecb399a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:15.363743 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-66305aa9-4c3b-4c18-bc54-fe9bb78b352f tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b" status: 200 len: 1388 microversion: 2.1 time: 0.768170 Jun 10 17:59:15.364616 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 281/579] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:14 2022] GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b => generated 1388 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:59:15.370170 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1e8f8126-c32c-41a5-bc73-33db6b44fa2f tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ee010108054f52bd787a25060f7ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a7bc463e44066a9da45921fb2043e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:15.381648 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1e8f8126-c32c-41a5-bc73-33db6b44fa2f tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] 10.222.0.35 "GET /compute/v2.1/servers/d3ce1519-1a65-40bd-bd5b-7bb95d0e136d" status: 200 len: 1313 microversion: 2.1 time: 0.225294 Jun 10 17:59:15.387236 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 299/580] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:15 2022] GET /compute/v2.1/servers/d3ce1519-1a65-40bd-bd5b-7bb95d0e136d => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:59:15.723353 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8a540c79-072b-4f6c-864d-3f5f6ddd58ad tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] Calling method '.version_select at 0x7f77c1472b80>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:15.727821 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:59:15.727821 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:59:15.727821 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8a540c79-072b-4f6c-864d-3f5f6ddd58ad tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:15.727821 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8a540c79-072b-4f6c-864d-3f5f6ddd58ad tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:15.728224 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8a540c79-072b-4f6c-864d-3f5f6ddd58ad tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:15.729946 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8a540c79-072b-4f6c-864d-3f5f6ddd58ad tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:15.764210 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8a540c79-072b-4f6c-864d-3f5f6ddd58ad tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] 10.222.0.35 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.394713 Jun 10 17:59:15.765613 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 282/581] 10.222.0.35 () {58 vars in 1127 bytes} [Fri Jun 10 17:59:15 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:15.777329 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-70b4ef3e-2daa-4b0e-a35a-6e219802ce84 tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] Calling method '.version_select at 0x7f77c1560e50>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:15.778811 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:59:15.778811 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:59:15.780860 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-70b4ef3e-2daa-4b0e-a35a-6e219802ce84 tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:15.781563 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-70b4ef3e-2daa-4b0e-a35a-6e219802ce84 tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:15.782595 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-70b4ef3e-2daa-4b0e-a35a-6e219802ce84 tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:15.783276 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-70b4ef3e-2daa-4b0e-a35a-6e219802ce84 tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:15.786204 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0af06b9b-cf1d-4527-8a53-0c7b86a4ba19 tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1934719919", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:15.809671 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-70b4ef3e-2daa-4b0e-a35a-6e219802ce84 tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] 10.222.0.35 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 379 microversion: 2.1 time: 0.035837 Jun 10 17:59:15.817731 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 283/582] 10.222.0.35 () {58 vars in 1138 bytes} [Fri Jun 10 17:59:15 2022] GET /compute/v2.1/os-hosts?zone= => generated 379 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 17:59:15.822821 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c01a3492-a3fb-4b74-a635-12e1b7204ad3 tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] Calling method '.version_select at 0x7f77c13ef4c0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:15.829536 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:59:15.829536 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:59:15.829536 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c01a3492-a3fb-4b74-a635-12e1b7204ad3 tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:15.829536 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c01a3492-a3fb-4b74-a635-12e1b7204ad3 tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:15.829536 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c01a3492-a3fb-4b74-a635-12e1b7204ad3 tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:15.829904 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c01a3492-a3fb-4b74-a635-12e1b7204ad3 tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:15.836583 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:59:15.872435 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c01a3492-a3fb-4b74-a635-12e1b7204ad3 tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] 10.222.0.35 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.052961 Jun 10 17:59:15.881162 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 284/583] 10.222.0.35 () {58 vars in 1144 bytes} [Fri Jun 10 17:59:15 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 17:59:15.890011 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9f5310e6-2024-4b4b-bb92-34bc6a1e7d5e tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] Calling method '.version_select at 0x7f77c15909d0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:15.895243 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:59:15.895243 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:59:15.898829 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9f5310e6-2024-4b4b-bb92-34bc6a1e7d5e tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:15.899302 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9f5310e6-2024-4b4b-bb92-34bc6a1e7d5e tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:15.899420 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-0af06b9b-cf1d-4527-8a53-0c7b86a4ba19 tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] validate_networks() for None {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 17:59:15.900120 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9f5310e6-2024-4b4b-bb92-34bc6a1e7d5e tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:15.900730 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9f5310e6-2024-4b4b-bb92-34bc6a1e7d5e tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:15.931789 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9f5310e6-2024-4b4b-bb92-34bc6a1e7d5e tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] 10.222.0.35 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.048737 Jun 10 17:59:15.933524 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 285/584] 10.222.0.35 () {58 vars in 1127 bytes} [Fri Jun 10 17:59:15 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 17:59:15.944659 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b7cc15f0-8b53-445f-8003-629b84eb670b tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] Calling method '.version_select at 0x7f77c13efd30>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:15.946904 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:59:15.946904 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:59:15.949853 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b7cc15f0-8b53-445f-8003-629b84eb670b tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:15.951507 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b7cc15f0-8b53-445f-8003-629b84eb670b tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:15.953603 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b7cc15f0-8b53-445f-8003-629b84eb670b tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:15.954284 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b7cc15f0-8b53-445f-8003-629b84eb670b tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:15.989696 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b7cc15f0-8b53-445f-8003-629b84eb670b tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] 10.222.0.35 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.049383 Jun 10 17:59:15.991592 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 286/585] 10.222.0.35 () {58 vars in 1154 bytes} [Fri Jun 10 17:59:15 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:16.005599 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-26127390-46ab-41fc-9c40-03e15d96ea18 tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] Calling method '.version_select at 0x7f77c15908b0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:16.008529 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:59:16.008529 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:59:16.010270 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-26127390-46ab-41fc-9c40-03e15d96ea18 tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:16.011030 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-26127390-46ab-41fc-9c40-03e15d96ea18 tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:16.011981 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-26127390-46ab-41fc-9c40-03e15d96ea18 tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:16.012649 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-26127390-46ab-41fc-9c40-03e15d96ea18 tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:16.058668 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-26127390-46ab-41fc-9c40-03e15d96ea18 tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] 10.222.0.35 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.057587 Jun 10 17:59:16.060192 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 287/586] 10.222.0.35 () {58 vars in 1127 bytes} [Fri Jun 10 17:59:15 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:16.078928 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-06f6b39f-d7ac-403a-acb5-391c6c9cbc4e tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] Calling method '.version_select at 0x7f77c13ef430>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:16.087845 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:59:16.087845 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:59:16.112634 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-06f6b39f-d7ac-403a-acb5-391c6c9cbc4e tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:16.114075 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-06f6b39f-d7ac-403a-acb5-391c6c9cbc4e tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:16.164690 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-06f6b39f-d7ac-403a-acb5-391c6c9cbc4e tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:16.165315 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-06f6b39f-d7ac-403a-acb5-391c6c9cbc4e tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:16.210949 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-06f6b39f-d7ac-403a-acb5-391c6c9cbc4e tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] 10.222.0.35 "GET /compute/v2.1/os-hosts/chh1-master-2" status: 200 len: 467 microversion: 2.1 time: 0.135577 Jun 10 17:59:16.214037 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 288/587] 10.222.0.35 () {58 vars in 1169 bytes} [Fri Jun 10 17:59:16 2022] GET /compute/v2.1/os-hosts/chh1-master-2 => generated 467 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:16.230862 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-eed65742-84c1-4b07-981e-bfeca845dfd9 req-e732bc41-4709-44af-b52e-dcbf1f7aa408 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3ce1519-1a65-40bd-bd5b-7bb95d0e136d", "tag": "61074cd7-9ce9-4ba9-8058-8ab0fc3eae24"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:16.250858 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-eed65742-84c1-4b07-981e-bfeca845dfd9 req-e732bc41-4709-44af-b52e-dcbf1f7aa408 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:16.251724 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-eed65742-84c1-4b07-981e-bfeca845dfd9 req-e732bc41-4709-44af-b52e-dcbf1f7aa408 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:16.265326 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-eed65742-84c1-4b07-981e-bfeca845dfd9 req-e732bc41-4709-44af-b52e-dcbf1f7aa408 service nova] Creating event network-changed:61074cd7-9ce9-4ba9-8058-8ab0fc3eae24 for instance d3ce1519-1a65-40bd-bd5b-7bb95d0e136d on chh1-master-2 Jun 10 17:59:16.273124 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-eed65742-84c1-4b07-981e-bfeca845dfd9 req-e732bc41-4709-44af-b52e-dcbf1f7aa408 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055304 Jun 10 17:59:16.274194 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 289/588] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:16.283907 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fdf651af-ddd2-422d-9924-7a42ad397bdf tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] Calling method '.version_select at 0x7f77c138c040>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:16.285016 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:59:16.285016 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:59:16.292689 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fdf651af-ddd2-422d-9924-7a42ad397bdf tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:16.293216 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fdf651af-ddd2-422d-9924-7a42ad397bdf tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:16.324414 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fdf651af-ddd2-422d-9924-7a42ad397bdf tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:16.324886 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fdf651af-ddd2-422d-9924-7a42ad397bdf tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:16.343560 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fdf651af-ddd2-422d-9924-7a42ad397bdf tempest-HostsAdminTestJSON-1752387148 tempest-HostsAdminTestJSON-1752387148-project-admin] 10.222.0.35 "GET /compute/v2.1/os-hosts/chh2-master-2" status: 200 len: 467 microversion: 2.1 time: 0.067498 Jun 10 17:59:16.344326 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 290/589] 10.222.0.35 () {58 vars in 1169 bytes} [Fri Jun 10 17:59:16 2022] GET /compute/v2.1/os-hosts/chh2-master-2 => generated 467 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:16.381422 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a3fc20a0-71bd-4ccd-b60f-0531c109e97d tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:16.382170 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a3fc20a0-71bd-4ccd-b60f-0531c109e97d tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: c922bb8c-ba7b-4448-9d8b-a6fb6498b25b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:16.406952 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3fc20a0-71bd-4ccd-b60f-0531c109e97d tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:16.407471 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3fc20a0-71bd-4ccd-b60f-0531c109e97d tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:16.410386 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3fc20a0-71bd-4ccd-b60f-0531c109e97d tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:16.410868 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3fc20a0-71bd-4ccd-b60f-0531c109e97d tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:16.731384 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-0af06b9b-cf1d-4527-8a53-0c7b86a4ba19 tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 17:59:16.731956 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-0af06b9b-cf1d-4527-8a53-0c7b86a4ba19 tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 17:59:16.732712 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-0af06b9b-cf1d-4527-8a53-0c7b86a4ba19 tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 17:59:16.733431 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-0af06b9b-cf1d-4527-8a53-0c7b86a4ba19 tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 17:59:16.733964 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-0af06b9b-cf1d-4527-8a53-0c7b86a4ba19 tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 17:59:16.746853 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0af06b9b-cf1d-4527-8a53-0c7b86a4ba19 tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:16.747524 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0af06b9b-cf1d-4527-8a53-0c7b86a4ba19 tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:16.749839 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0af06b9b-cf1d-4527-8a53-0c7b86a4ba19 tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:16.749839 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0af06b9b-cf1d-4527-8a53-0c7b86a4ba19 tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:16.778654 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-0af06b9b-cf1d-4527-8a53-0c7b86a4ba19 tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Getting quotas for project 23a34c17b5f7453f8f29cac11b4a0c0a. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 17:59:16.784482 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-0af06b9b-cf1d-4527-8a53-0c7b86a4ba19 tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Getting quotas for user 55970504aaa346a78a07c0ed252890e1 and project 23a34c17b5f7453f8f29cac11b4a0c0a. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 17:59:16.797492 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.utils [None req-0af06b9b-cf1d-4527-8a53-0c7b86a4ba19 tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] cores quota exceeded for 23a34c17b5f7453f8f29cac11b4a0c0a, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=126595) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jun 10 17:59:16.798946 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-0af06b9b-cf1d-4527-8a53-0c7b86a4ba19 tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jun 10 17:59:16.802734 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0af06b9b-cf1d-4527-8a53-0c7b86a4ba19 tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Request method failure captured: Jun 10 17:59:16.802734 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 10 17:59:16.802734 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 17:59:16.802734 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 17:59:16.802734 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 17:59:16.802734 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 145 Jun 10 17:59:16.802734 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 17:59:16.802734 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 17:59:16.802734 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 17:59:16.802734 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 17:59:16.802734 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4ZuHbc8-FJrOONIuHsDFXd1oaOlPGUPQ_r1P2GzumcaOpdmkTr_preXuCA7ajzpFgiD-A5M08-P6be7o_lXH5hxY52UY-CaxNm8-yL5xiZJ6P9OgyDKgFvw0816eVgdJYGDTYXg-E6OEsvHoc3UIcibRiTkxLILxSLlvFmkvfWqMVA Jun 10 17:59:16.802734 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 17:59:16.802734 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 17:59:16.802734 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 17:59:16.802734 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 17:59:16.802734 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 17:59:16.802734 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 17:59:16.802734 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 23a34c17b5f7453f8f29cac11b4a0c0a Jun 10 17:59:16.802734 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-QuotasAdminNegativeTest-1075943840 Jun 10 17:59:16.802734 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 17:59:16.802734 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 17:59:16.808944 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/23a34c17b5f7453f8f29cac11b4a0c0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/23a34c17b5f7453f8f29cac11b4a0c0a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/23a34c17b5f7453f8f29cac11b4a0c0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_23a34c17b5f7453f8f29cac11b4a0c0a", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:59:16.808944 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-QuotasAdminNegativeTest-1075943840 Jun 10 17:59:16.808944 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 23a34c17b5f7453f8f29cac11b4a0c0a Jun 10 17:59:16.808944 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1075943840 Jun 10 17:59:16.808944 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-QuotasAdminNegativeTest-1075943840-project Jun 10 17:59:16.808944 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 17:59:16.808944 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 17:59:16.808944 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 55970504aaa346a78a07c0ed252890e1 Jun 10 17:59:16.808944 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-QuotasAdminNegativeTest-1075943840-project Jun 10 17:59:16.808944 chdv-master-2 devstack@n-api.service[126595]: Jun 10 17:59:16.808944 chdv-master-2 devstack@n-api.service[126595]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1934719919", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452"}} Jun 10 17:59:16.808944 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 17:59:16.809708 chdv-master-2 devstack@n-api.service[126595]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jun 10 17:59:16.809708 chdv-master-2 devstack@n-api.service[126595]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1934719919', 'imageRef': 'efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8', 'flavorRef': '452'}}} Jun 10 17:59:16.809708 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:59:16.809708 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:59:16.809708 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jun 10 17:59:16.809708 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jun 10 17:59:16.809708 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 17:59:16.809708 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 17:59:16.809708 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jun 10 17:59:16.809708 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc Jun 10 17:59:16.809708 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jun 10 17:59:16.809708 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jun 10 17:59:16.809708 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 17:59:16.809708 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 17:59:16.809708 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jun 10 17:59:16.809708 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jun 10 17:59:16.809708 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jun 10 17:59:16.809708 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jun 10 17:59:16.810742 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jun 10 17:59:16.810742 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jun 10 17:59:16.810742 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jun 10 17:59:16.810742 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:59:16.810742 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:59:16.810742 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:59:16.810742 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:59:16.810742 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 10 17:59:16.810742 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 10 17:59:16.810742 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 10 17:59:16.810742 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 10 17:59:16.810742 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jun 10 17:59:16.810742 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jun 10 17:59:16.810742 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jun 10 17:59:16.810742 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jun 10 17:59:16.810742 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jun 10 17:59:16.810742 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jun 10 17:59:16.810742 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jun 10 17:59:16.810742 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:59:16.810742 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:59:16.810742 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:59:16.812525 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:59:16.812525 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:59:16.812525 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:59:16.812525 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:59:16.812525 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:59:16.812525 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:59:16.812525 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:59:16.812525 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 17:59:16.812525 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 17:59:16.812525 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 17:59:16.812525 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 17:59:16.812525 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 17:59:16.812525 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 17:59:16.812525 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 10 17:59:16.812525 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jun 10 17:59:16.812525 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 10 17:59:16.812525 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jun 10 17:59:16.812525 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:59:16.812525 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:59:16.812525 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:59:16.812525 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:59:16.813794 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:59:16.813794 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:59:16.813794 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:59:16.813794 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:59:16.813794 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jun 10 17:59:16.813794 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:59:16.813794 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0af06b9b-cf1d-4527-8a53-0c7b86a4ba19 tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:59:16.813794 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0af06b9b-cf1d-4527-8a53-0c7b86a4ba19 tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.320537 Jun 10 17:59:16.813794 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 300/590] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:59:15 2022] POST /compute/v2.1/servers => generated 111 bytes in 1322 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jun 10 17:59:16.818501 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-15b4e0b0-d416-4378-8b9c-f2830d07cd5d tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:16.819571 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-15b4e0b0-d416-4378-8b9c-f2830d07cd5d tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] [instance: d3ce1519-1a65-40bd-bd5b-7bb95d0e136d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:16.828188 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-15b4e0b0-d416-4378-8b9c-f2830d07cd5d tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:16.828969 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-15b4e0b0-d416-4378-8b9c-f2830d07cd5d tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:16.829980 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-15b4e0b0-d416-4378-8b9c-f2830d07cd5d tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:16.830631 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-15b4e0b0-d416-4378-8b9c-f2830d07cd5d tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:16.837409 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a3fc20a0-71bd-4ccd-b60f-0531c109e97d tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e5bd8a55d42cdb7879fbead65627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9d5dac7c8243aeaa207c5a1ecb399a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:16.847698 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a3fc20a0-71bd-4ccd-b60f-0531c109e97d tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b" status: 200 len: 1388 microversion: 2.1 time: 0.470505 Jun 10 17:59:16.850844 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 291/591] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:16 2022] GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b => generated 1388 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:59:16.857618 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3f261d1b-bf25-40c3-afef-a64624d2671c tempest-QuotasAdminNegativeTest-758649020 tempest-QuotasAdminNegativeTest-758649020-project-admin] Action: 'update', calling method: .version_select at 0x7f77c1472b80>, body: {"quota_set": {"cores": 20}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:17.024145 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-15b4e0b0-d416-4378-8b9c-f2830d07cd5d tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ee010108054f52bd787a25060f7ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a7bc463e44066a9da45921fb2043e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:17.035688 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-15b4e0b0-d416-4378-8b9c-f2830d07cd5d tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] 10.222.0.35 "GET /compute/v2.1/servers/d3ce1519-1a65-40bd-bd5b-7bb95d0e136d" status: 200 len: 1313 microversion: 2.1 time: 0.228941 Jun 10 17:59:17.040415 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 301/592] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:16 2022] GET /compute/v2.1/servers/d3ce1519-1a65-40bd-bd5b-7bb95d0e136d => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:17.135561 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=93,nova_api:SAVEPOINT=1,nova_api:RELEASE=1,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:59:17.144287 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f261d1b-bf25-40c3-afef-a64624d2671c tempest-QuotasAdminNegativeTest-758649020 tempest-QuotasAdminNegativeTest-758649020-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:17.144803 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f261d1b-bf25-40c3-afef-a64624d2671c tempest-QuotasAdminNegativeTest-758649020 tempest-QuotasAdminNegativeTest-758649020-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:17.145572 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f261d1b-bf25-40c3-afef-a64624d2671c tempest-QuotasAdminNegativeTest-758649020 tempest-QuotasAdminNegativeTest-758649020-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:17.146222 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f261d1b-bf25-40c3-afef-a64624d2671c tempest-QuotasAdminNegativeTest-758649020 tempest-QuotasAdminNegativeTest-758649020-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:17.197563 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-63f91521-7fe6-45c4-ad3d-75dd4328dee8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-507912747", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:17.282460 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-63f91521-7fe6-45c4-ad3d-75dd4328dee8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] validate_networks() for None {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 17:59:17.409838 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3f261d1b-bf25-40c3-afef-a64624d2671c tempest-QuotasAdminNegativeTest-758649020 tempest-QuotasAdminNegativeTest-758649020-project-admin] 10.222.0.35 "PUT /compute/v2.1/os-quota-sets/23a34c17b5f7453f8f29cac11b4a0c0a" status: 200 len: 329 microversion: 2.1 time: 0.557659 Jun 10 17:59:17.411526 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 292/593] 10.222.0.35 () {60 vars in 1261 bytes} [Fri Jun 10 17:59:16 2022] PUT /compute/v2.1/os-quota-sets/23a34c17b5f7453f8f29cac11b4a0c0a => generated 329 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:17.427331 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-54e1dde1-31d0-4490-b67c-b712fdf26755 tempest-QuotasAdminNegativeTest-758649020 tempest-QuotasAdminNegativeTest-758649020-project-admin] Calling method '.version_select at 0x7f77c13efd30>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:17.565179 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-54e1dde1-31d0-4490-b67c-b712fdf26755 tempest-QuotasAdminNegativeTest-758649020 tempest-QuotasAdminNegativeTest-758649020-project-admin] 10.222.0.35 "GET /compute/v2.1/os-quota-sets/23a34c17b5f7453f8f29cac11b4a0c0a" status: 200 len: 371 microversion: 2.1 time: 0.143881 Jun 10 17:59:17.567729 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 293/594] 10.222.0.35 () {58 vars in 1241 bytes} [Fri Jun 10 17:59:17 2022] GET /compute/v2.1/os-quota-sets/23a34c17b5f7453f8f29cac11b4a0c0a => generated 371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:17.579446 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-19eaa1a5-5ca6-46d6-80a8-6bb028decbcc tempest-QuotasAdminNegativeTest-758649020 tempest-QuotasAdminNegativeTest-758649020-project-admin] Action: 'update', calling method: .version_select at 0x7f77c13ef700>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:17.706648 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-19eaa1a5-5ca6-46d6-80a8-6bb028decbcc tempest-QuotasAdminNegativeTest-758649020 tempest-QuotasAdminNegativeTest-758649020-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:17.708630 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-19eaa1a5-5ca6-46d6-80a8-6bb028decbcc tempest-QuotasAdminNegativeTest-758649020 tempest-QuotasAdminNegativeTest-758649020-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:17.710961 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-19eaa1a5-5ca6-46d6-80a8-6bb028decbcc tempest-QuotasAdminNegativeTest-758649020 tempest-QuotasAdminNegativeTest-758649020-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:17.713309 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-63f91521-7fe6-45c4-ad3d-75dd4328dee8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 17:59:17.713717 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-63f91521-7fe6-45c4-ad3d-75dd4328dee8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 17:59:17.714196 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-63f91521-7fe6-45c4-ad3d-75dd4328dee8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 17:59:17.714446 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-19eaa1a5-5ca6-46d6-80a8-6bb028decbcc tempest-QuotasAdminNegativeTest-758649020 tempest-QuotasAdminNegativeTest-758649020-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:17.714606 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-63f91521-7fe6-45c4-ad3d-75dd4328dee8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 17:59:17.715244 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-63f91521-7fe6-45c4-ad3d-75dd4328dee8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 17:59:17.732045 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-63f91521-7fe6-45c4-ad3d-75dd4328dee8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:17.733875 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-63f91521-7fe6-45c4-ad3d-75dd4328dee8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:17.735970 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-63f91521-7fe6-45c4-ad3d-75dd4328dee8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:17.736688 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-63f91521-7fe6-45c4-ad3d-75dd4328dee8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:17.779692 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-63f91521-7fe6-45c4-ad3d-75dd4328dee8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Getting quotas for project 66fd5e2ed0b84720849784c94f36d5da. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 17:59:17.786158 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-63f91521-7fe6-45c4-ad3d-75dd4328dee8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Getting quotas for user 1c74f45bf7fd4dea952d771a649519af and project 66fd5e2ed0b84720849784c94f36d5da. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 17:59:17.803357 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-63f91521-7fe6-45c4-ad3d-75dd4328dee8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 17:59:17.816805 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-63f91521-7fe6-45c4-ad3d-75dd4328dee8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 17:59:17.884511 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-19eaa1a5-5ca6-46d6-80a8-6bb028decbcc tempest-QuotasAdminNegativeTest-758649020 tempest-QuotasAdminNegativeTest-758649020-project-admin] 10.222.0.35 "PUT /compute/v2.1/os-quota-sets/23a34c17b5f7453f8f29cac11b4a0c0a" status: 200 len: 328 microversion: 2.1 time: 0.310217 Jun 10 17:59:17.889766 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 294/595] 10.222.0.35 () {60 vars in 1261 bytes} [Fri Jun 10 17:59:17 2022] PUT /compute/v2.1/os-quota-sets/23a34c17b5f7453f8f29cac11b4a0c0a => generated 328 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:17.897421 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-328e353d-2a46-47c0-88b4-02cf4dbce3f8 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:17.898368 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-328e353d-2a46-47c0-88b4-02cf4dbce3f8 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: c922bb8c-ba7b-4448-9d8b-a6fb6498b25b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:17.914920 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-328e353d-2a46-47c0-88b4-02cf4dbce3f8 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:17.915361 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-328e353d-2a46-47c0-88b4-02cf4dbce3f8 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:17.916137 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-328e353d-2a46-47c0-88b4-02cf4dbce3f8 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:17.916605 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-328e353d-2a46-47c0-88b4-02cf4dbce3f8 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:18.019017 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-63f91521-7fe6-45c4-ad3d-75dd4328dee8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.981217 Jun 10 17:59:18.025306 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 302/596] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:59:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 17:59:18.031808 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-640558f2-205c-4dde-a3b2-7caa0bccc501 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:18.033315 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-640558f2-205c-4dde-a3b2-7caa0bccc501 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:18.208246 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-640558f2-205c-4dde-a3b2-7caa0bccc501 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:18.232695 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-640558f2-205c-4dde-a3b2-7caa0bccc501 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1212 microversion: 2.1 time: 0.201292 Jun 10 17:59:18.249997 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 303/597] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:18 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1212 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:18.286673 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9add192b-2a66-463e-a302-de05aaf549ef tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:18.288552 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9add192b-2a66-463e-a302-de05aaf549ef tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] [instance: d3ce1519-1a65-40bd-bd5b-7bb95d0e136d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:18.322735 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-328e353d-2a46-47c0-88b4-02cf4dbce3f8 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e5bd8a55d42cdb7879fbead65627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9d5dac7c8243aeaa207c5a1ecb399a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:18.325588 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9add192b-2a66-463e-a302-de05aaf549ef tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:18.338201 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9add192b-2a66-463e-a302-de05aaf549ef tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:18.338201 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9add192b-2a66-463e-a302-de05aaf549ef tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:18.338201 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9add192b-2a66-463e-a302-de05aaf549ef tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:18.339080 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-328e353d-2a46-47c0-88b4-02cf4dbce3f8 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b" status: 200 len: 1388 microversion: 2.1 time: 0.445835 Jun 10 17:59:18.341142 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 295/598] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:17 2022] GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b => generated 1388 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:18.358613 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e7ab8c87-c131-4800-973f-b5926fe31043 tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1668333504", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:18.458622 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-e7ab8c87-c131-4800-973f-b5926fe31043 tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] validate_networks() for None {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 17:59:18.755338 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9add192b-2a66-463e-a302-de05aaf549ef tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ee010108054f52bd787a25060f7ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a7bc463e44066a9da45921fb2043e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:18.765576 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9add192b-2a66-463e-a302-de05aaf549ef tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] 10.222.0.35 "GET /compute/v2.1/servers/d3ce1519-1a65-40bd-bd5b-7bb95d0e136d" status: 200 len: 1313 microversion: 2.1 time: 0.513323 Jun 10 17:59:18.768422 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 304/599] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:18 2022] GET /compute/v2.1/servers/d3ce1519-1a65-40bd-bd5b-7bb95d0e136d => generated 1313 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:18.837270 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-d7b96842-5792-4e82-a08e-acda3036bb82 req-20a6cee1-f5ec-4980-a80a-c44335cdb100 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c922bb8c-ba7b-4448-9d8b-a6fb6498b25b", "name": "network-vif-plugged", "status": "completed", "tag": "25b456a2-d3a8-4a42-b69c-ca0dcb1b529a"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:18.850941 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-d7b96842-5792-4e82-a08e-acda3036bb82 req-20a6cee1-f5ec-4980-a80a-c44335cdb100 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:18.851999 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-d7b96842-5792-4e82-a08e-acda3036bb82 req-20a6cee1-f5ec-4980-a80a-c44335cdb100 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:18.872186 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-d7b96842-5792-4e82-a08e-acda3036bb82 req-20a6cee1-f5ec-4980-a80a-c44335cdb100 service nova] Creating event network-vif-plugged:25b456a2-d3a8-4a42-b69c-ca0dcb1b529a for instance c922bb8c-ba7b-4448-9d8b-a6fb6498b25b on chh2-master-2 Jun 10 17:59:18.881755 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-d7b96842-5792-4e82-a08e-acda3036bb82 req-20a6cee1-f5ec-4980-a80a-c44335cdb100 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048858 Jun 10 17:59:18.884395 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 305/600] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 17:59:19.119116 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-e7ab8c87-c131-4800-973f-b5926fe31043 tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 17:59:19.120701 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-e7ab8c87-c131-4800-973f-b5926fe31043 tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 17:59:19.122872 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-e7ab8c87-c131-4800-973f-b5926fe31043 tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 17:59:19.127077 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-e7ab8c87-c131-4800-973f-b5926fe31043 tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 17:59:19.128255 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-e7ab8c87-c131-4800-973f-b5926fe31043 tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 17:59:19.173773 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7ab8c87-c131-4800-973f-b5926fe31043 tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:19.180442 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7ab8c87-c131-4800-973f-b5926fe31043 tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:19.182682 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7ab8c87-c131-4800-973f-b5926fe31043 tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:19.188413 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7ab8c87-c131-4800-973f-b5926fe31043 tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:19.246332 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-e7ab8c87-c131-4800-973f-b5926fe31043 tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Getting quotas for project 23a34c17b5f7453f8f29cac11b4a0c0a. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 17:59:19.259130 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-e7ab8c87-c131-4800-973f-b5926fe31043 tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Getting quotas for user 55970504aaa346a78a07c0ed252890e1 and project 23a34c17b5f7453f8f29cac11b4a0c0a. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 17:59:19.259424 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c0e65eff-0aa8-485b-8536-d28c7d09326c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:19.260017 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c0e65eff-0aa8-485b-8536-d28c7d09326c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:19.287620 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.utils [None req-e7ab8c87-c131-4800-973f-b5926fe31043 tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] instances quota exceeded for 23a34c17b5f7453f8f29cac11b4a0c0a, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=126594) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jun 10 17:59:19.289430 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-e7ab8c87-c131-4800-973f-b5926fe31043 tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jun 10 17:59:19.303703 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e7ab8c87-c131-4800-973f-b5926fe31043 tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Request method failure captured: Jun 10 17:59:19.303703 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 10 17:59:19.303703 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 17:59:19.303703 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 17:59:19.303703 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 17:59:19.303703 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 145 Jun 10 17:59:19.303703 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 17:59:19.303703 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 17:59:19.303703 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 17:59:19.303703 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 17:59:19.303703 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4ZuHbc8-FJrOONIuHsDFXd1oaOlPGUPQ_r1P2GzumcaOpdmkTr_preXuCA7ajzpFgiD-A5M08-P6be7o_lXH5hxY52UY-CaxNm8-yL5xiZJ6P9OgyDKgFvw0816eVgdJYGDTYXg-E6OEsvHoc3UIcibRiTkxLILxSLlvFmkvfWqMVA Jun 10 17:59:19.303703 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 17:59:19.303703 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 17:59:19.303703 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 17:59:19.303703 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 17:59:19.303703 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 17:59:19.303703 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 17:59:19.303703 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 23a34c17b5f7453f8f29cac11b4a0c0a Jun 10 17:59:19.303703 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-QuotasAdminNegativeTest-1075943840 Jun 10 17:59:19.303703 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 17:59:19.303703 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 17:59:19.305532 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/23a34c17b5f7453f8f29cac11b4a0c0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/23a34c17b5f7453f8f29cac11b4a0c0a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/23a34c17b5f7453f8f29cac11b4a0c0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_23a34c17b5f7453f8f29cac11b4a0c0a", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:59:19.305532 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-QuotasAdminNegativeTest-1075943840 Jun 10 17:59:19.305532 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 23a34c17b5f7453f8f29cac11b4a0c0a Jun 10 17:59:19.305532 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1075943840 Jun 10 17:59:19.305532 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-QuotasAdminNegativeTest-1075943840-project Jun 10 17:59:19.305532 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 17:59:19.305532 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 17:59:19.305532 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 55970504aaa346a78a07c0ed252890e1 Jun 10 17:59:19.305532 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-QuotasAdminNegativeTest-1075943840-project Jun 10 17:59:19.305532 chdv-master-2 devstack@n-api.service[126594]: Jun 10 17:59:19.305532 chdv-master-2 devstack@n-api.service[126594]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1668333504", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452"}} Jun 10 17:59:19.305532 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 17:59:19.306306 chdv-master-2 devstack@n-api.service[126594]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jun 10 17:59:19.306306 chdv-master-2 devstack@n-api.service[126594]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1668333504', 'imageRef': 'efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8', 'flavorRef': '452'}}} Jun 10 17:59:19.306306 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:59:19.306306 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:59:19.306306 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jun 10 17:59:19.306306 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jun 10 17:59:19.306306 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 17:59:19.306306 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 17:59:19.306306 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jun 10 17:59:19.306306 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc Jun 10 17:59:19.306306 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jun 10 17:59:19.306306 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jun 10 17:59:19.306306 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 17:59:19.306306 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 17:59:19.306306 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jun 10 17:59:19.306306 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jun 10 17:59:19.306306 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jun 10 17:59:19.306306 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jun 10 17:59:19.307934 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jun 10 17:59:19.307934 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jun 10 17:59:19.307934 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Jun 10 17:59:19.307934 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:59:19.307934 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:59:19.307934 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:59:19.307934 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:59:19.307934 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 10 17:59:19.307934 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 10 17:59:19.307934 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 10 17:59:19.307934 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 10 17:59:19.307934 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jun 10 17:59:19.307934 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jun 10 17:59:19.307934 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jun 10 17:59:19.307934 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jun 10 17:59:19.307934 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jun 10 17:59:19.307934 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jun 10 17:59:19.307934 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jun 10 17:59:19.307934 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:59:19.307934 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:59:19.307934 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:59:19.309961 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:59:19.309961 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:59:19.309961 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:59:19.309961 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:59:19.309961 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:59:19.309961 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:59:19.309961 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:59:19.309961 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 17:59:19.309961 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 17:59:19.309961 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 17:59:19.309961 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 17:59:19.309961 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 17:59:19.309961 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 17:59:19.309961 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 10 17:59:19.309961 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jun 10 17:59:19.309961 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 10 17:59:19.309961 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jun 10 17:59:19.309961 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:59:19.309961 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:59:19.309961 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:59:19.309961 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:59:19.313040 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:59:19.313040 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:59:19.313040 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:59:19.313040 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:59:19.313040 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jun 10 17:59:19.313040 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:59:19.313040 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e7ab8c87-c131-4800-973f-b5926fe31043 tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:59:19.313040 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e7ab8c87-c131-4800-973f-b5926fe31043 tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.959677 Jun 10 17:59:19.326353 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 296/601] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:59:18 2022] POST /compute/v2.1/servers => generated 119 bytes in 984 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:59:19.352040 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-69050b24-5bdf-4b99-b800-077fa6d77a4c tempest-QuotasAdminNegativeTest-758649020 tempest-QuotasAdminNegativeTest-758649020-project-admin] Action: 'update', calling method: .version_select at 0x7f77c139bf70>, body: {"quota_set": {"instances": 10}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:19.409813 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c0e65eff-0aa8-485b-8536-d28c7d09326c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:19.427933 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c0e65eff-0aa8-485b-8536-d28c7d09326c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1212 microversion: 2.1 time: 0.172956 Jun 10 17:59:19.428944 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 306/602] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:19 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1212 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:19.433625 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3ef45892-5768-42a3-8762-0a299993dd2e tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:19.434247 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3ef45892-5768-42a3-8762-0a299993dd2e tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: c922bb8c-ba7b-4448-9d8b-a6fb6498b25b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:19.455107 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3ef45892-5768-42a3-8762-0a299993dd2e tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:19.455578 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3ef45892-5768-42a3-8762-0a299993dd2e tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:19.456413 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3ef45892-5768-42a3-8762-0a299993dd2e tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:19.456856 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3ef45892-5768-42a3-8762-0a299993dd2e tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:19.694522 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-69050b24-5bdf-4b99-b800-077fa6d77a4c tempest-QuotasAdminNegativeTest-758649020 tempest-QuotasAdminNegativeTest-758649020-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:19.695692 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-69050b24-5bdf-4b99-b800-077fa6d77a4c tempest-QuotasAdminNegativeTest-758649020 tempest-QuotasAdminNegativeTest-758649020-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:19.696815 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-69050b24-5bdf-4b99-b800-077fa6d77a4c tempest-QuotasAdminNegativeTest-758649020 tempest-QuotasAdminNegativeTest-758649020-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:19.697407 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-69050b24-5bdf-4b99-b800-077fa6d77a4c tempest-QuotasAdminNegativeTest-758649020 tempest-QuotasAdminNegativeTest-758649020-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:19.888703 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3ef45892-5768-42a3-8762-0a299993dd2e tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e5bd8a55d42cdb7879fbead65627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9d5dac7c8243aeaa207c5a1ecb399a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:19.905731 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3ef45892-5768-42a3-8762-0a299993dd2e tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b" status: 200 len: 1388 microversion: 2.1 time: 0.475059 Jun 10 17:59:19.906618 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 307/603] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:19 2022] GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b => generated 1388 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:20.011908 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-69050b24-5bdf-4b99-b800-077fa6d77a4c tempest-QuotasAdminNegativeTest-758649020 tempest-QuotasAdminNegativeTest-758649020-project-admin] 10.222.0.35 "PUT /compute/v2.1/os-quota-sets/23a34c17b5f7453f8f29cac11b4a0c0a" status: 200 len: 329 microversion: 2.1 time: 0.680057 Jun 10 17:59:20.025478 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 297/604] 10.222.0.35 () {60 vars in 1261 bytes} [Fri Jun 10 17:59:19 2022] PUT /compute/v2.1/os-quota-sets/23a34c17b5f7453f8f29cac11b4a0c0a => generated 329 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:20.035332 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f3776cef-dbad-4b4b-ae68-802a253d60ef tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:20.035716 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f3776cef-dbad-4b4b-ae68-802a253d60ef tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] [instance: d3ce1519-1a65-40bd-bd5b-7bb95d0e136d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:20.044354 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f3776cef-dbad-4b4b-ae68-802a253d60ef tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:20.044821 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f3776cef-dbad-4b4b-ae68-802a253d60ef tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:20.045642 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f3776cef-dbad-4b4b-ae68-802a253d60ef tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:20.046083 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f3776cef-dbad-4b4b-ae68-802a253d60ef tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:20.084834 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-532c5110-0219-493f-b12b-61b78f1217c0 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1910831609", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "45fb4e74-7e6e-476e-a201-f09090e50c1c"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:20.140184 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-532c5110-0219-493f-b12b-61b78f1217c0 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] validate_networks() for [('45fb4e74-7e6e-476e-a201-f09090e50c1c', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 17:59:20.347984 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f3776cef-dbad-4b4b-ae68-802a253d60ef tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ee010108054f52bd787a25060f7ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a7bc463e44066a9da45921fb2043e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:20.364773 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f3776cef-dbad-4b4b-ae68-802a253d60ef tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] 10.222.0.35 "GET /compute/v2.1/servers/d3ce1519-1a65-40bd-bd5b-7bb95d0e136d" status: 200 len: 1313 microversion: 2.1 time: 0.338028 Jun 10 17:59:20.375244 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 298/605] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:20 2022] GET /compute/v2.1/servers/d3ce1519-1a65-40bd-bd5b-7bb95d0e136d => generated 1313 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:20.380535 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e621823d-9871-43fb-8f42-1e5fb27995b9 tempest-QuotasAdminNegativeTest-758649020 tempest-QuotasAdminNegativeTest-758649020-project-admin] Calling method '.version_select at 0x7f77c132c5e0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:20.503231 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e621823d-9871-43fb-8f42-1e5fb27995b9 tempest-QuotasAdminNegativeTest-758649020 tempest-QuotasAdminNegativeTest-758649020-project-admin] 10.222.0.35 "GET /compute/v2.1/os-quota-sets/23a34c17b5f7453f8f29cac11b4a0c0a" status: 200 len: 371 microversion: 2.1 time: 0.124179 Jun 10 17:59:20.505681 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 299/606] 10.222.0.35 () {58 vars in 1241 bytes} [Fri Jun 10 17:59:20 2022] GET /compute/v2.1/os-quota-sets/23a34c17b5f7453f8f29cac11b4a0c0a => generated 371 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:20.514058 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4e8845e9-cc92-4422-9968-09701885c9c2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:20.515481 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4e8845e9-cc92-4422-9968-09701885c9c2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:20.523178 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4e8845e9-cc92-4422-9968-09701885c9c2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:20.523939 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4e8845e9-cc92-4422-9968-09701885c9c2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:20.525170 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4e8845e9-cc92-4422-9968-09701885c9c2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:20.526350 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4e8845e9-cc92-4422-9968-09701885c9c2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:20.654001 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4e8845e9-cc92-4422-9968-09701885c9c2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:20.670071 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4e8845e9-cc92-4422-9968-09701885c9c2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1264 microversion: 2.1 time: 0.160639 Jun 10 17:59:20.671155 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 300/607] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:20 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:20.688789 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9c37344c-ef69-4701-93b4-cdbe02e27ffd tempest-QuotasAdminNegativeTest-758649020 tempest-QuotasAdminNegativeTest-758649020-project-admin] Action: 'update', calling method: .version_select at 0x7f77c132c4c0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:21.083389 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9c37344c-ef69-4701-93b4-cdbe02e27ffd tempest-QuotasAdminNegativeTest-758649020 tempest-QuotasAdminNegativeTest-758649020-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:21.086142 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9c37344c-ef69-4701-93b4-cdbe02e27ffd tempest-QuotasAdminNegativeTest-758649020 tempest-QuotasAdminNegativeTest-758649020-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:21.089368 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9c37344c-ef69-4701-93b4-cdbe02e27ffd tempest-QuotasAdminNegativeTest-758649020 tempest-QuotasAdminNegativeTest-758649020-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:21.090351 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9c37344c-ef69-4701-93b4-cdbe02e27ffd tempest-QuotasAdminNegativeTest-758649020 tempest-QuotasAdminNegativeTest-758649020-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:21.118961 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=31 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:59:21.274583 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-532c5110-0219-493f-b12b-61b78f1217c0 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 17:59:21.276640 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-532c5110-0219-493f-b12b-61b78f1217c0 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 17:59:21.279403 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-532c5110-0219-493f-b12b-61b78f1217c0 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 17:59:21.281818 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-532c5110-0219-493f-b12b-61b78f1217c0 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 17:59:21.282978 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-532c5110-0219-493f-b12b-61b78f1217c0 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 17:59:21.305246 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-532c5110-0219-493f-b12b-61b78f1217c0 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:21.307064 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-532c5110-0219-493f-b12b-61b78f1217c0 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:21.314227 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-532c5110-0219-493f-b12b-61b78f1217c0 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:21.314227 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-532c5110-0219-493f-b12b-61b78f1217c0 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:21.325582 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9c37344c-ef69-4701-93b4-cdbe02e27ffd tempest-QuotasAdminNegativeTest-758649020 tempest-QuotasAdminNegativeTest-758649020-project-admin] 10.222.0.35 "PUT /compute/v2.1/os-quota-sets/23a34c17b5f7453f8f29cac11b4a0c0a" status: 200 len: 325 microversion: 2.1 time: 0.653239 Jun 10 17:59:21.336418 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 301/608] 10.222.0.35 () {60 vars in 1261 bytes} [Fri Jun 10 17:59:20 2022] PUT /compute/v2.1/os-quota-sets/23a34c17b5f7453f8f29cac11b4a0c0a => generated 325 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:21.351507 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-001bda62-a147-4b21-a08d-31788eac79c7 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:21.354882 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-001bda62-a147-4b21-a08d-31788eac79c7 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: c922bb8c-ba7b-4448-9d8b-a6fb6498b25b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:21.379267 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-001bda62-a147-4b21-a08d-31788eac79c7 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:21.381046 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-001bda62-a147-4b21-a08d-31788eac79c7 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:21.382998 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-001bda62-a147-4b21-a08d-31788eac79c7 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:21.383141 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-532c5110-0219-493f-b12b-61b78f1217c0 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Getting quotas for project 57b54ed932024f378743fa2d2fc36b53. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 17:59:21.384801 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-001bda62-a147-4b21-a08d-31788eac79c7 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:21.402568 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-532c5110-0219-493f-b12b-61b78f1217c0 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Getting quotas for user bb6eb467842c4b06904eabb338f1d74e and project 57b54ed932024f378743fa2d2fc36b53. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 17:59:21.453277 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-532c5110-0219-493f-b12b-61b78f1217c0 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 17:59:21.458056 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-532c5110-0219-493f-b12b-61b78f1217c0 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: f4f44795-d87b-4032-a9b4-4ce68336f264] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 17:59:21.659965 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-532c5110-0219-493f-b12b-61b78f1217c0 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.752092 Jun 10 17:59:21.663614 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 308/609] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:59:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 17:59:21.672248 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ca4c616a-93a4-49f4-bbed-7e3820a438fe tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:21.718364 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ca4c616a-93a4-49f4-bbed-7e3820a438fe tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] [instance: d3ce1519-1a65-40bd-bd5b-7bb95d0e136d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:21.740028 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ca4c616a-93a4-49f4-bbed-7e3820a438fe tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:21.755250 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ca4c616a-93a4-49f4-bbed-7e3820a438fe tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:21.761424 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ca4c616a-93a4-49f4-bbed-7e3820a438fe tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:21.761986 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ca4c616a-93a4-49f4-bbed-7e3820a438fe tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:22.210823 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ca4c616a-93a4-49f4-bbed-7e3820a438fe tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ee010108054f52bd787a25060f7ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a7bc463e44066a9da45921fb2043e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:22.246126 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ca4c616a-93a4-49f4-bbed-7e3820a438fe tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] 10.222.0.35 "GET /compute/v2.1/servers/d3ce1519-1a65-40bd-bd5b-7bb95d0e136d" status: 200 len: 1313 microversion: 2.1 time: 0.580854 Jun 10 17:59:22.247932 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 309/610] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:21 2022] GET /compute/v2.1/servers/d3ce1519-1a65-40bd-bd5b-7bb95d0e136d => generated 1313 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:22.268421 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-61fd943e-4b25-4203-9ca9-125a58c9048a tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-224891396", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:22.389877 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-61fd943e-4b25-4203-9ca9-125a58c9048a tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] validate_networks() for None {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 17:59:22.425011 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-001bda62-a147-4b21-a08d-31788eac79c7 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e5bd8a55d42cdb7879fbead65627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9d5dac7c8243aeaa207c5a1ecb399a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:22.446116 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-001bda62-a147-4b21-a08d-31788eac79c7 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b" status: 200 len: 1586 microversion: 2.1 time: 1.108519 Jun 10 17:59:22.456396 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 302/611] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:21 2022] GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b => generated 1586 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:22.465124 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-16f836d2-a20b-49c3-925d-3490daa60de9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:22.465749 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-16f836d2-a20b-49c3-925d-3490daa60de9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:22.506195 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-16f836d2-a20b-49c3-925d-3490daa60de9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:22.506578 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-16f836d2-a20b-49c3-925d-3490daa60de9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:22.507369 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-16f836d2-a20b-49c3-925d-3490daa60de9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:22.507812 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-16f836d2-a20b-49c3-925d-3490daa60de9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:22.646079 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-16f836d2-a20b-49c3-925d-3490daa60de9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:22.677211 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-16f836d2-a20b-49c3-925d-3490daa60de9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1270 microversion: 2.1 time: 0.213352 Jun 10 17:59:22.678285 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 303/612] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:22 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1270 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:22.692105 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-61f8487f-939e-4938-a1fd-b4da16e28734 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1020513579", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "45fb4e74-7e6e-476e-a201-f09090e50c1c"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:22.820372 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-61f8487f-939e-4938-a1fd-b4da16e28734 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] validate_networks() for [('45fb4e74-7e6e-476e-a201-f09090e50c1c', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 17:59:22.914290 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-61fd943e-4b25-4203-9ca9-125a58c9048a tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 17:59:22.914968 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-61fd943e-4b25-4203-9ca9-125a58c9048a tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 17:59:22.915581 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-61fd943e-4b25-4203-9ca9-125a58c9048a tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 17:59:22.916166 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-61fd943e-4b25-4203-9ca9-125a58c9048a tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 17:59:22.916764 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-61fd943e-4b25-4203-9ca9-125a58c9048a tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 17:59:22.938162 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-61fd943e-4b25-4203-9ca9-125a58c9048a tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:22.939381 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-61fd943e-4b25-4203-9ca9-125a58c9048a tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:22.940425 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-61fd943e-4b25-4203-9ca9-125a58c9048a tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:22.941012 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-61fd943e-4b25-4203-9ca9-125a58c9048a tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:22.955047 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:59:22.976463 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-61fd943e-4b25-4203-9ca9-125a58c9048a tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Getting quotas for project 23a34c17b5f7453f8f29cac11b4a0c0a. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 17:59:22.991503 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-61fd943e-4b25-4203-9ca9-125a58c9048a tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Getting quotas for user 55970504aaa346a78a07c0ed252890e1 and project 23a34c17b5f7453f8f29cac11b4a0c0a. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 17:59:23.006130 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.utils [None req-61fd943e-4b25-4203-9ca9-125a58c9048a tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] ram quota exceeded for 23a34c17b5f7453f8f29cac11b4a0c0a, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=126595) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jun 10 17:59:23.006930 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-61fd943e-4b25-4203-9ca9-125a58c9048a tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jun 10 17:59:23.009717 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-61fd943e-4b25-4203-9ca9-125a58c9048a tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Request method failure captured: Jun 10 17:59:23.009717 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 10 17:59:23.009717 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 17:59:23.009717 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 17:59:23.009717 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 17:59:23.009717 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 144 Jun 10 17:59:23.009717 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 17:59:23.009717 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 17:59:23.009717 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 17:59:23.009717 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 17:59:23.009717 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4ZuHbc8-FJrOONIuHsDFXd1oaOlPGUPQ_r1P2GzumcaOpdmkTr_preXuCA7ajzpFgiD-A5M08-P6be7o_lXH5hxY52UY-CaxNm8-yL5xiZJ6P9OgyDKgFvw0816eVgdJYGDTYXg-E6OEsvHoc3UIcibRiTkxLILxSLlvFmkvfWqMVA Jun 10 17:59:23.009717 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 17:59:23.009717 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 17:59:23.009717 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 17:59:23.009717 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 17:59:23.009717 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 17:59:23.009717 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 17:59:23.009717 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 23a34c17b5f7453f8f29cac11b4a0c0a Jun 10 17:59:23.009717 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-QuotasAdminNegativeTest-1075943840 Jun 10 17:59:23.009717 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 17:59:23.009717 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 17:59:23.011599 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/23a34c17b5f7453f8f29cac11b4a0c0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/23a34c17b5f7453f8f29cac11b4a0c0a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/23a34c17b5f7453f8f29cac11b4a0c0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_23a34c17b5f7453f8f29cac11b4a0c0a", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:59:23.011599 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-QuotasAdminNegativeTest-1075943840 Jun 10 17:59:23.011599 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 23a34c17b5f7453f8f29cac11b4a0c0a Jun 10 17:59:23.011599 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1075943840 Jun 10 17:59:23.011599 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-QuotasAdminNegativeTest-1075943840-project Jun 10 17:59:23.011599 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 17:59:23.011599 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 17:59:23.011599 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 55970504aaa346a78a07c0ed252890e1 Jun 10 17:59:23.011599 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-QuotasAdminNegativeTest-1075943840-project Jun 10 17:59:23.011599 chdv-master-2 devstack@n-api.service[126595]: Jun 10 17:59:23.011599 chdv-master-2 devstack@n-api.service[126595]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-224891396", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452"}} Jun 10 17:59:23.011599 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 17:59:23.012499 chdv-master-2 devstack@n-api.service[126595]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jun 10 17:59:23.012499 chdv-master-2 devstack@n-api.service[126595]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-224891396', 'imageRef': 'efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8', 'flavorRef': '452'}}} Jun 10 17:59:23.012499 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:59:23.012499 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:59:23.012499 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jun 10 17:59:23.012499 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jun 10 17:59:23.012499 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 17:59:23.012499 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 17:59:23.012499 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jun 10 17:59:23.012499 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc Jun 10 17:59:23.012499 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jun 10 17:59:23.012499 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jun 10 17:59:23.012499 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 17:59:23.012499 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 17:59:23.012499 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jun 10 17:59:23.012499 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jun 10 17:59:23.012499 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jun 10 17:59:23.012499 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jun 10 17:59:23.013750 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jun 10 17:59:23.013750 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jun 10 17:59:23.013750 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jun 10 17:59:23.013750 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:59:23.013750 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:59:23.013750 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:59:23.013750 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:59:23.013750 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 10 17:59:23.013750 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 10 17:59:23.013750 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 10 17:59:23.013750 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 10 17:59:23.013750 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jun 10 17:59:23.013750 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jun 10 17:59:23.013750 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jun 10 17:59:23.013750 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jun 10 17:59:23.013750 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jun 10 17:59:23.013750 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jun 10 17:59:23.013750 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jun 10 17:59:23.013750 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:59:23.013750 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:59:23.013750 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:59:23.016198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:59:23.016198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:59:23.016198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:59:23.016198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:59:23.016198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:59:23.016198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:59:23.016198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:59:23.016198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 17:59:23.016198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 17:59:23.016198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 17:59:23.016198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 17:59:23.016198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 17:59:23.016198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 17:59:23.016198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 10 17:59:23.016198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jun 10 17:59:23.016198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 10 17:59:23.016198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jun 10 17:59:23.016198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:59:23.016198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:59:23.016198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:59:23.016198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:59:23.024094 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:59:23.024094 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:59:23.024094 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:59:23.024094 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:59:23.024094 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jun 10 17:59:23.024094 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:59:23.024094 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-61fd943e-4b25-4203-9ca9-125a58c9048a tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:59:23.029686 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-61fd943e-4b25-4203-9ca9-125a58c9048a tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.777359 Jun 10 17:59:23.031660 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 310/613] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:59:22 2022] POST /compute/v2.1/servers => generated 110 bytes in 782 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:59:23.044990 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2f64bd29-7e0e-40a4-9616-df98d7055e10 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:23.045903 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2f64bd29-7e0e-40a4-9616-df98d7055e10 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: c922bb8c-ba7b-4448-9d8b-a6fb6498b25b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:23.053919 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2f64bd29-7e0e-40a4-9616-df98d7055e10 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:23.056006 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2f64bd29-7e0e-40a4-9616-df98d7055e10 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:23.059225 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2f64bd29-7e0e-40a4-9616-df98d7055e10 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:23.060134 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2f64bd29-7e0e-40a4-9616-df98d7055e10 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:23.294604 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2f64bd29-7e0e-40a4-9616-df98d7055e10 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.261638 Jun 10 17:59:23.295261 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 311/614] 10.222.0.35 () {58 vars in 1274 bytes} [Fri Jun 10 17:59:23 2022] GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b/os-interface => generated 284 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:23.743221 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-35a902c2-d93e-4093-9997-4cdfeb6af553 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-681257239", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "c66faed9-4ff8-42df-b60d-8140becdafb7"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:23.863023 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-35a902c2-d93e-4093-9997-4cdfeb6af553 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] validate_networks() for [('c66faed9-4ff8-42df-b60d-8140becdafb7', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 17:59:24.354713 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-61f8487f-939e-4938-a1fd-b4da16e28734 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 17:59:24.356019 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-61f8487f-939e-4938-a1fd-b4da16e28734 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 17:59:24.356718 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-61f8487f-939e-4938-a1fd-b4da16e28734 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 17:59:24.357284 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-61f8487f-939e-4938-a1fd-b4da16e28734 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 17:59:24.358520 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-61f8487f-939e-4938-a1fd-b4da16e28734 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 17:59:24.378760 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-61f8487f-939e-4938-a1fd-b4da16e28734 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:24.379980 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-61f8487f-939e-4938-a1fd-b4da16e28734 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:24.381300 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-61f8487f-939e-4938-a1fd-b4da16e28734 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:24.382290 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-61f8487f-939e-4938-a1fd-b4da16e28734 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:24.435395 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-61f8487f-939e-4938-a1fd-b4da16e28734 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Getting quotas for project 57b54ed932024f378743fa2d2fc36b53. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 17:59:24.442344 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-61f8487f-939e-4938-a1fd-b4da16e28734 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Getting quotas for user bb6eb467842c4b06904eabb338f1d74e and project 57b54ed932024f378743fa2d2fc36b53. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 17:59:24.457213 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:59:24.460893 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-61f8487f-939e-4938-a1fd-b4da16e28734 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 17:59:24.469566 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-61f8487f-939e-4938-a1fd-b4da16e28734 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: 1951bbc1-82a1-4f7e-abce-09dbed0d71f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 17:59:24.684149 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-61f8487f-939e-4938-a1fd-b4da16e28734 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.002655 Jun 10 17:59:24.686209 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 304/615] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:59:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 17:59:24.691602 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ba10aece-ac80-4fbf-8765-2eefadd11c80 tempest-QuotasAdminNegativeTest-758649020 tempest-QuotasAdminNegativeTest-758649020-project-admin] Action: 'update', calling method: .version_select at 0x7f77c134caf0>, body: {"quota_set": {"ram": 51200}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:25.104673 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ba10aece-ac80-4fbf-8765-2eefadd11c80 tempest-QuotasAdminNegativeTest-758649020 tempest-QuotasAdminNegativeTest-758649020-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:25.108704 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ba10aece-ac80-4fbf-8765-2eefadd11c80 tempest-QuotasAdminNegativeTest-758649020 tempest-QuotasAdminNegativeTest-758649020-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:25.114070 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ba10aece-ac80-4fbf-8765-2eefadd11c80 tempest-QuotasAdminNegativeTest-758649020 tempest-QuotasAdminNegativeTest-758649020-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:25.114070 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ba10aece-ac80-4fbf-8765-2eefadd11c80 tempest-QuotasAdminNegativeTest-758649020 tempest-QuotasAdminNegativeTest-758649020-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:25.337709 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ba10aece-ac80-4fbf-8765-2eefadd11c80 tempest-QuotasAdminNegativeTest-758649020 tempest-QuotasAdminNegativeTest-758649020-project-admin] 10.222.0.35 "PUT /compute/v2.1/os-quota-sets/23a34c17b5f7453f8f29cac11b4a0c0a" status: 200 len: 329 microversion: 2.1 time: 0.648334 Jun 10 17:59:25.338329 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 305/616] 10.222.0.35 () {60 vars in 1261 bytes} [Fri Jun 10 17:59:24 2022] PUT /compute/v2.1/os-quota-sets/23a34c17b5f7453f8f29cac11b4a0c0a => generated 329 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:25.355565 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e3b815e7-b3b0-42ed-a8d5-1bfc9d0ed421 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:25.356240 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e3b815e7-b3b0-42ed-a8d5-1bfc9d0ed421 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] [instance: d3ce1519-1a65-40bd-bd5b-7bb95d0e136d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:25.372889 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e3b815e7-b3b0-42ed-a8d5-1bfc9d0ed421 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:25.374934 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e3b815e7-b3b0-42ed-a8d5-1bfc9d0ed421 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:25.375735 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e3b815e7-b3b0-42ed-a8d5-1bfc9d0ed421 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:25.376183 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e3b815e7-b3b0-42ed-a8d5-1bfc9d0ed421 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:25.440198 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-35a902c2-d93e-4093-9997-4cdfeb6af553 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 17:59:25.440664 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-35a902c2-d93e-4093-9997-4cdfeb6af553 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 17:59:25.441112 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-35a902c2-d93e-4093-9997-4cdfeb6af553 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 17:59:25.441520 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-35a902c2-d93e-4093-9997-4cdfeb6af553 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 17:59:25.442202 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-35a902c2-d93e-4093-9997-4cdfeb6af553 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 17:59:25.457439 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-35a902c2-d93e-4093-9997-4cdfeb6af553 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:25.457894 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-35a902c2-d93e-4093-9997-4cdfeb6af553 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:25.458675 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-35a902c2-d93e-4093-9997-4cdfeb6af553 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:25.460147 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-35a902c2-d93e-4093-9997-4cdfeb6af553 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:25.499287 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-35a902c2-d93e-4093-9997-4cdfeb6af553 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Getting quotas for project c96da7ef0cbc46b594ec327ddf875f7a. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 17:59:25.518444 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-35a902c2-d93e-4093-9997-4cdfeb6af553 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Getting quotas for user d0f741e8506743a8b51251b3019b3ad5 and project c96da7ef0cbc46b594ec327ddf875f7a. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 17:59:25.518691 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:59:25.528846 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-35a902c2-d93e-4093-9997-4cdfeb6af553 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 17:59:25.531564 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-35a902c2-d93e-4093-9997-4cdfeb6af553 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: dea27a27-b11b-445c-b811-e852cd66e197] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 17:59:25.695017 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-35a902c2-d93e-4093-9997-4cdfeb6af553 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.397146 Jun 10 17:59:25.695960 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 312/617] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:59:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2400 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 17:59:25.713224 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5421c228-1232-4126-985f-6d78b3171ad8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:25.713796 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5421c228-1232-4126-985f-6d78b3171ad8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:25.733625 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5421c228-1232-4126-985f-6d78b3171ad8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:25.741098 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5421c228-1232-4126-985f-6d78b3171ad8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:25.741098 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5421c228-1232-4126-985f-6d78b3171ad8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:25.741098 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5421c228-1232-4126-985f-6d78b3171ad8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:25.915675 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e3b815e7-b3b0-42ed-a8d5-1bfc9d0ed421 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ee010108054f52bd787a25060f7ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a7bc463e44066a9da45921fb2043e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:25.939111 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e3b815e7-b3b0-42ed-a8d5-1bfc9d0ed421 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] 10.222.0.35 "GET /compute/v2.1/servers/d3ce1519-1a65-40bd-bd5b-7bb95d0e136d" status: 200 len: 1313 microversion: 2.1 time: 0.593511 Jun 10 17:59:25.939762 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 306/618] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:25 2022] GET /compute/v2.1/servers/d3ce1519-1a65-40bd-bd5b-7bb95d0e136d => generated 1313 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:26.103655 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-be25a695-ac97-4996-83b2-a57ea30155d8 tempest-HypervisorAdminV253TestBase-1100868248 tempest-HypervisorAdminV253TestBase-1100868248-project-admin] Calling method '.version_select at 0x7f77c134cf70>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:26.105195 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:59:26.105195 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:59:26.106986 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be25a695-ac97-4996-83b2-a57ea30155d8 tempest-HypervisorAdminV253TestBase-1100868248 tempest-HypervisorAdminV253TestBase-1100868248-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:26.106986 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be25a695-ac97-4996-83b2-a57ea30155d8 tempest-HypervisorAdminV253TestBase-1100868248 tempest-HypervisorAdminV253TestBase-1100868248-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:26.142124 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be25a695-ac97-4996-83b2-a57ea30155d8 tempest-HypervisorAdminV253TestBase-1100868248 tempest-HypervisorAdminV253TestBase-1100868248-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:26.146580 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be25a695-ac97-4996-83b2-a57ea30155d8 tempest-HypervisorAdminV253TestBase-1100868248 tempest-HypervisorAdminV253TestBase-1100868248-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:26.203103 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be25a695-ac97-4996-83b2-a57ea30155d8 tempest-HypervisorAdminV253TestBase-1100868248 tempest-HypervisorAdminV253TestBase-1100868248-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:26.203593 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be25a695-ac97-4996-83b2-a57ea30155d8 tempest-HypervisorAdminV253TestBase-1100868248 tempest-HypervisorAdminV253TestBase-1100868248-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:26.231671 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be25a695-ac97-4996-83b2-a57ea30155d8 tempest-HypervisorAdminV253TestBase-1100868248 tempest-HypervisorAdminV253TestBase-1100868248-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:26.232602 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be25a695-ac97-4996-83b2-a57ea30155d8 tempest-HypervisorAdminV253TestBase-1100868248 tempest-HypervisorAdminV253TestBase-1100868248-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:26.265048 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be25a695-ac97-4996-83b2-a57ea30155d8 tempest-HypervisorAdminV253TestBase-1100868248 tempest-HypervisorAdminV253TestBase-1100868248-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:26.276628 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be25a695-ac97-4996-83b2-a57ea30155d8 tempest-HypervisorAdminV253TestBase-1100868248 tempest-HypervisorAdminV253TestBase-1100868248-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:26.287274 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-be25a695-ac97-4996-83b2-a57ea30155d8 tempest-HypervisorAdminV253TestBase-1100868248 tempest-HypervisorAdminV253TestBase-1100868248-project-admin] 10.222.0.35 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1915 microversion: 2.53 time: 0.344990 Jun 10 17:59:26.289489 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 307/619] 10.222.0.35 () {60 vars in 1242 bytes} [Fri Jun 10 17:59:25 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1915 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 17:59:26.306292 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6c856c7a-88fb-4c74-8508-c3feaec7de27 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1560081084", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "451", "networks": [{"uuid": "45fb4e74-7e6e-476e-a201-f09090e50c1c"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:26.436975 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-6c856c7a-88fb-4c74-8508-c3feaec7de27 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] validate_networks() for [('45fb4e74-7e6e-476e-a201-f09090e50c1c', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 17:59:26.590846 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5421c228-1232-4126-985f-6d78b3171ad8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:26.609956 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5421c228-1232-4126-985f-6d78b3171ad8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1312 microversion: 2.1 time: 0.911170 Jun 10 17:59:26.611130 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 313/620] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:25 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1312 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:26.616855 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8cc3a28e-2dc8-44aa-a53a-b25c59bc6880 tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Action: 'update', calling method: .version_select at 0x7f77c1a8d550>, body: {"quota_set": {"ram": 0}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:26.620655 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8cc3a28e-2dc8-44aa-a53a-b25c59bc6880 tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '55970504aaa346a78a07c0ed252890e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a34c17b5f7453f8f29cac11b4a0c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:26.622843 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8cc3a28e-2dc8-44aa-a53a-b25c59bc6880 tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Request method failure captured: Jun 10 17:59:26.622843 chdv-master-2 devstack@n-api.service[126595]: request: PUT /compute/v2.1/os-quota-sets/23a34c17b5f7453f8f29cac11b4a0c0a HTTP/1.1 Jun 10 17:59:26.622843 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 17:59:26.622843 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 17:59:26.622843 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 17:59:26.622843 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 25 Jun 10 17:59:26.622843 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 17:59:26.622843 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 17:59:26.622843 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 17:59:26.622843 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 17:59:26.622843 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4ZuHbc8-FJrOONIuHsDFXd1oaOlPGUPQ_r1P2GzumcaOpdmkTr_preXuCA7ajzpFgiD-A5M08-P6be7o_lXH5hxY52UY-CaxNm8-yL5xiZJ6P9OgyDKgFvw0816eVgdJYGDTYXg-E6OEsvHoc3UIcibRiTkxLILxSLlvFmkvfWqMVA Jun 10 17:59:26.622843 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 17:59:26.622843 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 17:59:26.622843 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 17:59:26.622843 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 17:59:26.622843 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 17:59:26.622843 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 17:59:26.622843 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 23a34c17b5f7453f8f29cac11b4a0c0a Jun 10 17:59:26.622843 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-QuotasAdminNegativeTest-1075943840 Jun 10 17:59:26.622843 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 17:59:26.622843 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 17:59:26.625025 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/23a34c17b5f7453f8f29cac11b4a0c0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/23a34c17b5f7453f8f29cac11b4a0c0a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/23a34c17b5f7453f8f29cac11b4a0c0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_23a34c17b5f7453f8f29cac11b4a0c0a", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:59:26.625025 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-QuotasAdminNegativeTest-1075943840 Jun 10 17:59:26.625025 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 23a34c17b5f7453f8f29cac11b4a0c0a Jun 10 17:59:26.625025 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1075943840 Jun 10 17:59:26.625025 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-QuotasAdminNegativeTest-1075943840-project Jun 10 17:59:26.625025 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 17:59:26.625025 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 17:59:26.625025 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 55970504aaa346a78a07c0ed252890e1 Jun 10 17:59:26.625025 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-QuotasAdminNegativeTest-1075943840-project Jun 10 17:59:26.625025 chdv-master-2 devstack@n-api.service[126595]: Jun 10 17:59:26.625025 chdv-master-2 devstack@n-api.service[126595]: {"quota_set": {"ram": 0}} Jun 10 17:59:26.625025 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 17:59:26.625025 chdv-master-2 devstack@n-api.service[126595]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jun 10 17:59:26.625025 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '23a34c17b5f7453f8f29cac11b4a0c0a', 'body': {'quota_set': {'ram': 0}}} Jun 10 17:59:26.626011 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:59:26.626011 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:59:26.626011 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:59:26.626011 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:59:26.626011 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:59:26.626011 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:59:26.626011 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 17:59:26.626011 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 17:59:26.626011 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:59:26.626011 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:59:26.626011 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 17:59:26.626011 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 17:59:26.626011 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Jun 10 17:59:26.626011 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Jun 10 17:59:26.626011 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 10 17:59:26.626011 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 17:59:26.626011 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 10 17:59:26.626011 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 17:59:26.626011 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Jun 10 17:59:26.627317 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Jun 10 17:59:26.627317 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 10 17:59:26.627317 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 10 17:59:26.627317 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 10 17:59:26.627317 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 10 17:59:26.627317 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 17:59:26.627317 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 17:59:26.627317 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 17:59:26.627317 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 17:59:26.627317 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 10 17:59:26.627317 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 10 17:59:26.627317 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 10 17:59:26.627317 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 10 17:59:26.627317 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 10 17:59:26.627317 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 10 17:59:26.627317 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jun 10 17:59:26.627317 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:59:26.627317 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:59:26.627317 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:59:26.627317 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:59:26.628803 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:59:26.628803 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:59:26.628803 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 10 17:59:26.628803 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 10 17:59:26.628803 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jun 10 17:59:26.628803 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 17:59:26.635585 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8cc3a28e-2dc8-44aa-a53a-b25c59bc6880 tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:59:26.636684 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8cc3a28e-2dc8-44aa-a53a-b25c59bc6880 tempest-QuotasAdminNegativeTest-1075943840 tempest-QuotasAdminNegativeTest-1075943840-project] 10.222.0.35 "PUT /compute/v2.1/os-quota-sets/23a34c17b5f7453f8f29cac11b4a0c0a" status: 403 len: 116 microversion: 2.1 time: 0.024373 Jun 10 17:59:26.637641 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 314/621] 10.222.0.35 () {60 vars in 1261 bytes} [Fri Jun 10 17:59:26 2022] PUT /compute/v2.1/os-quota-sets/23a34c17b5f7453f8f29cac11b4a0c0a => generated 116 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:59:26.643034 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2f6183ac-c5a4-4a06-8219-bd22c24bddc6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:26.651042 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2f6183ac-c5a4-4a06-8219-bd22c24bddc6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: dea27a27-b11b-445c-b811-e852cd66e197] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:26.764364 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2f6183ac-c5a4-4a06-8219-bd22c24bddc6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:26.770180 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2f6183ac-c5a4-4a06-8219-bd22c24bddc6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197" status: 200 len: 1210 microversion: 2.1 time: 0.131319 Jun 10 17:59:26.770724 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 315/622] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:26 2022] GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197 => generated 1210 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:26.786474 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-68ffa217-364f-4973-89d1-115ef96a394d req-4554d373-6fb1-473b-a5f5-53b3f13aec3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3ce1519-1a65-40bd-bd5b-7bb95d0e136d", "name": "network-vif-plugged", "status": "completed", "tag": "61074cd7-9ce9-4ba9-8058-8ab0fc3eae24"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:26.810294 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-68ffa217-364f-4973-89d1-115ef96a394d req-4554d373-6fb1-473b-a5f5-53b3f13aec3d service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:26.810855 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-68ffa217-364f-4973-89d1-115ef96a394d req-4554d373-6fb1-473b-a5f5-53b3f13aec3d service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:26.837766 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-68ffa217-364f-4973-89d1-115ef96a394d req-4554d373-6fb1-473b-a5f5-53b3f13aec3d service nova] Creating event network-vif-plugged:61074cd7-9ce9-4ba9-8058-8ab0fc3eae24 for instance d3ce1519-1a65-40bd-bd5b-7bb95d0e136d on chh1-master-2 Jun 10 17:59:26.856734 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-68ffa217-364f-4973-89d1-115ef96a394d req-4554d373-6fb1-473b-a5f5-53b3f13aec3d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078789 Jun 10 17:59:26.858847 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 316/623] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:26.870972 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bb405e60-f386-4166-a106-8849cfa7a779 tempest-HypervisorAdminV253TestBase-1100868248 tempest-HypervisorAdminV253TestBase-1100868248-project-admin] Calling method '.version_select at 0x7f77c1784a60>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:26.876715 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:59:26.876715 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:59:26.878473 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb405e60-f386-4166-a106-8849cfa7a779 tempest-HypervisorAdminV253TestBase-1100868248 tempest-HypervisorAdminV253TestBase-1100868248-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:26.880482 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb405e60-f386-4166-a106-8849cfa7a779 tempest-HypervisorAdminV253TestBase-1100868248 tempest-HypervisorAdminV253TestBase-1100868248-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:26.922003 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb405e60-f386-4166-a106-8849cfa7a779 tempest-HypervisorAdminV253TestBase-1100868248 tempest-HypervisorAdminV253TestBase-1100868248-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:26.922806 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb405e60-f386-4166-a106-8849cfa7a779 tempest-HypervisorAdminV253TestBase-1100868248 tempest-HypervisorAdminV253TestBase-1100868248-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:26.988606 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb405e60-f386-4166-a106-8849cfa7a779 tempest-HypervisorAdminV253TestBase-1100868248 tempest-HypervisorAdminV253TestBase-1100868248-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:26.989413 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb405e60-f386-4166-a106-8849cfa7a779 tempest-HypervisorAdminV253TestBase-1100868248 tempest-HypervisorAdminV253TestBase-1100868248-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:27.005574 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb405e60-f386-4166-a106-8849cfa7a779 tempest-HypervisorAdminV253TestBase-1100868248 tempest-HypervisorAdminV253TestBase-1100868248-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:27.006596 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb405e60-f386-4166-a106-8849cfa7a779 tempest-HypervisorAdminV253TestBase-1100868248 tempest-HypervisorAdminV253TestBase-1100868248-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:27.039645 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb405e60-f386-4166-a106-8849cfa7a779 tempest-HypervisorAdminV253TestBase-1100868248 tempest-HypervisorAdminV253TestBase-1100868248-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:27.039645 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb405e60-f386-4166-a106-8849cfa7a779 tempest-HypervisorAdminV253TestBase-1100868248 tempest-HypervisorAdminV253TestBase-1100868248-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:27.044872 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bb405e60-f386-4166-a106-8849cfa7a779 tempest-HypervisorAdminV253TestBase-1100868248 tempest-HypervisorAdminV253TestBase-1100868248-project-admin] 10.222.0.35 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 686 microversion: 2.53 time: 0.184432 Jun 10 17:59:27.046713 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 317/624] 10.222.0.35 () {60 vars in 1221 bytes} [Fri Jun 10 17:59:26 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 686 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 17:59:27.051700 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d23c1cae-7cc9-4bfc-b4bf-80ff5723d3d5 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:27.052880 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d23c1cae-7cc9-4bfc-b4bf-80ff5723d3d5 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: c922bb8c-ba7b-4448-9d8b-a6fb6498b25b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:27.065792 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d23c1cae-7cc9-4bfc-b4bf-80ff5723d3d5 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:27.065792 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d23c1cae-7cc9-4bfc-b4bf-80ff5723d3d5 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:27.065792 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d23c1cae-7cc9-4bfc-b4bf-80ff5723d3d5 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:27.066138 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d23c1cae-7cc9-4bfc-b4bf-80ff5723d3d5 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:27.230220 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d23c1cae-7cc9-4bfc-b4bf-80ff5723d3d5 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e5bd8a55d42cdb7879fbead65627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9d5dac7c8243aeaa207c5a1ecb399a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:27.242660 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d23c1cae-7cc9-4bfc-b4bf-80ff5723d3d5 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b" status: 200 len: 1586 microversion: 2.1 time: 0.194491 Jun 10 17:59:27.245263 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 318/625] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:27 2022] GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b => generated 1586 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:27.250641 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-3760f6a1-d858-417a-bf93-2dc4bde0ff8f req-b97dbf3d-1c7a-4a7f-9143-9a8613e3e038 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c922bb8c-ba7b-4448-9d8b-a6fb6498b25b", "tag": "25b456a2-d3a8-4a42-b69c-ca0dcb1b529a"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:27.263321 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-3760f6a1-d858-417a-bf93-2dc4bde0ff8f req-b97dbf3d-1c7a-4a7f-9143-9a8613e3e038 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:27.264511 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-3760f6a1-d858-417a-bf93-2dc4bde0ff8f req-b97dbf3d-1c7a-4a7f-9143-9a8613e3e038 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:27.282175 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-3760f6a1-d858-417a-bf93-2dc4bde0ff8f req-b97dbf3d-1c7a-4a7f-9143-9a8613e3e038 service nova] Creating event network-changed:25b456a2-d3a8-4a42-b69c-ca0dcb1b529a for instance c922bb8c-ba7b-4448-9d8b-a6fb6498b25b on chh2-master-2 Jun 10 17:59:27.289103 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-3760f6a1-d858-417a-bf93-2dc4bde0ff8f req-b97dbf3d-1c7a-4a7f-9143-9a8613e3e038 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042037 Jun 10 17:59:27.290022 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 319/626] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:27.298543 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3e4a8a41-f9bd-4556-b43a-b0d6a4604376 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:27.299527 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3e4a8a41-f9bd-4556-b43a-b0d6a4604376 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] [instance: d3ce1519-1a65-40bd-bd5b-7bb95d0e136d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:27.308266 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3e4a8a41-f9bd-4556-b43a-b0d6a4604376 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:27.309074 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3e4a8a41-f9bd-4556-b43a-b0d6a4604376 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:27.310063 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3e4a8a41-f9bd-4556-b43a-b0d6a4604376 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:27.310670 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3e4a8a41-f9bd-4556-b43a-b0d6a4604376 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:27.598066 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3e4a8a41-f9bd-4556-b43a-b0d6a4604376 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ee010108054f52bd787a25060f7ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a7bc463e44066a9da45921fb2043e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:27.634072 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3e4a8a41-f9bd-4556-b43a-b0d6a4604376 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] 10.222.0.35 "GET /compute/v2.1/servers/d3ce1519-1a65-40bd-bd5b-7bb95d0e136d" status: 200 len: 1313 microversion: 2.1 time: 0.342552 Jun 10 17:59:27.636407 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 320/627] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:27 2022] GET /compute/v2.1/servers/d3ce1519-1a65-40bd-bd5b-7bb95d0e136d => generated 1313 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:27.653710 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c70e9743-c16e-49f8-a03f-e0ec6d47650c tempest-HypervisorAdminV253TestBase-1100868248 tempest-HypervisorAdminV253TestBase-1100868248-project-admin] Calling method '.version_select at 0x7f77c17fc280>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:27.661445 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:59:27.661445 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 17:59:27.665320 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c70e9743-c16e-49f8-a03f-e0ec6d47650c tempest-HypervisorAdminV253TestBase-1100868248 tempest-HypervisorAdminV253TestBase-1100868248-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:27.668151 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c70e9743-c16e-49f8-a03f-e0ec6d47650c tempest-HypervisorAdminV253TestBase-1100868248 tempest-HypervisorAdminV253TestBase-1100868248-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:27.705656 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c70e9743-c16e-49f8-a03f-e0ec6d47650c tempest-HypervisorAdminV253TestBase-1100868248 tempest-HypervisorAdminV253TestBase-1100868248-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:27.706404 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c70e9743-c16e-49f8-a03f-e0ec6d47650c tempest-HypervisorAdminV253TestBase-1100868248 tempest-HypervisorAdminV253TestBase-1100868248-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:27.726699 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c70e9743-c16e-49f8-a03f-e0ec6d47650c tempest-HypervisorAdminV253TestBase-1100868248 tempest-HypervisorAdminV253TestBase-1100868248-project-admin] 10.222.0.35 "GET /compute/v2.1/os-hypervisors/13428b63-1602-4ca4-8ca0-594f5af1972c" status: 200 len: 792 microversion: 2.53 time: 0.084320 Jun 10 17:59:27.727634 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 321/628] 10.222.0.35 () {60 vars in 1297 bytes} [Fri Jun 10 17:59:27 2022] GET /compute/v2.1/os-hypervisors/13428b63-1602-4ca4-8ca0-594f5af1972c => generated 792 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 17:59:27.747775 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a563bb85-9905-4cae-9268-4333de53cefd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:27.748428 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a563bb85-9905-4cae-9268-4333de53cefd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:27.777485 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a563bb85-9905-4cae-9268-4333de53cefd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:27.777948 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a563bb85-9905-4cae-9268-4333de53cefd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:27.778736 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a563bb85-9905-4cae-9268-4333de53cefd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:27.784445 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a563bb85-9905-4cae-9268-4333de53cefd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:28.072177 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a563bb85-9905-4cae-9268-4333de53cefd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:28.084110 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a563bb85-9905-4cae-9268-4333de53cefd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1312 microversion: 2.1 time: 0.355404 Jun 10 17:59:28.085224 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 322/629] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:27 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1312 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:28.094381 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-acfe514b-19cc-48b9-aaff-3bcb6632004e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:28.095198 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-acfe514b-19cc-48b9-aaff-3bcb6632004e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: dea27a27-b11b-445c-b811-e852cd66e197] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:28.123209 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-acfe514b-19cc-48b9-aaff-3bcb6632004e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:28.128031 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-acfe514b-19cc-48b9-aaff-3bcb6632004e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:28.129110 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-acfe514b-19cc-48b9-aaff-3bcb6632004e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:28.137795 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-acfe514b-19cc-48b9-aaff-3bcb6632004e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:28.351198 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-acfe514b-19cc-48b9-aaff-3bcb6632004e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:28.365238 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-acfe514b-19cc-48b9-aaff-3bcb6632004e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197" status: 200 len: 1206 microversion: 2.1 time: 0.278696 Jun 10 17:59:28.376715 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 323/630] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:28 2022] GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197 => generated 1206 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:28.654358 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7874bb83-14e3-4e16-aa88-ffdc3b9062f6 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:28.655022 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7874bb83-14e3-4e16-aa88-ffdc3b9062f6 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] [instance: d3ce1519-1a65-40bd-bd5b-7bb95d0e136d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:28.670852 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7874bb83-14e3-4e16-aa88-ffdc3b9062f6 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:28.671307 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7874bb83-14e3-4e16-aa88-ffdc3b9062f6 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:28.672100 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7874bb83-14e3-4e16-aa88-ffdc3b9062f6 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:28.677740 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7874bb83-14e3-4e16-aa88-ffdc3b9062f6 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:29.289772 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-6c856c7a-88fb-4c74-8508-c3feaec7de27 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 17:59:29.291431 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-6c856c7a-88fb-4c74-8508-c3feaec7de27 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 17:59:29.292229 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-6c856c7a-88fb-4c74-8508-c3feaec7de27 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 17:59:29.292931 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-6c856c7a-88fb-4c74-8508-c3feaec7de27 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 17:59:29.293556 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-6c856c7a-88fb-4c74-8508-c3feaec7de27 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 17:59:29.311410 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6c856c7a-88fb-4c74-8508-c3feaec7de27 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:29.312428 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6c856c7a-88fb-4c74-8508-c3feaec7de27 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:29.313502 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6c856c7a-88fb-4c74-8508-c3feaec7de27 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:29.314609 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6c856c7a-88fb-4c74-8508-c3feaec7de27 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:29.344476 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-6c856c7a-88fb-4c74-8508-c3feaec7de27 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Getting quotas for project 57b54ed932024f378743fa2d2fc36b53. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 17:59:29.353142 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-6c856c7a-88fb-4c74-8508-c3feaec7de27 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Getting quotas for user bb6eb467842c4b06904eabb338f1d74e and project 57b54ed932024f378743fa2d2fc36b53. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 17:59:29.370166 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6c856c7a-88fb-4c74-8508-c3feaec7de27 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 17:59:29.372989 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6c856c7a-88fb-4c74-8508-c3feaec7de27 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: 069baf67-eb80-4d09-a40d-fc139212d954] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 17:59:29.463442 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7874bb83-14e3-4e16-aa88-ffdc3b9062f6 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ee010108054f52bd787a25060f7ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a7bc463e44066a9da45921fb2043e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:29.472652 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7874bb83-14e3-4e16-aa88-ffdc3b9062f6 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] 10.222.0.35 "GET /compute/v2.1/servers/d3ce1519-1a65-40bd-bd5b-7bb95d0e136d" status: 200 len: 1313 microversion: 2.1 time: 0.823321 Jun 10 17:59:29.473230 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 324/631] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:28 2022] GET /compute/v2.1/servers/d3ce1519-1a65-40bd-bd5b-7bb95d0e136d => generated 1313 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:29.478951 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-246f83c6-566d-4c5d-b602-b68696932424 req-8b826d41-108e-44a1-a461-8a3f02482415 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f344351-d882-4028-98db-751266b3d74d", "tag": "7a719916-3937-4cb7-b0d4-e5842975b4c3"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:29.503963 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-246f83c6-566d-4c5d-b602-b68696932424 req-8b826d41-108e-44a1-a461-8a3f02482415 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:29.504955 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-246f83c6-566d-4c5d-b602-b68696932424 req-8b826d41-108e-44a1-a461-8a3f02482415 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:29.522768 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-246f83c6-566d-4c5d-b602-b68696932424 req-8b826d41-108e-44a1-a461-8a3f02482415 service nova] Creating event network-changed:7a719916-3937-4cb7-b0d4-e5842975b4c3 for instance 2f344351-d882-4028-98db-751266b3d74d on chh1-master-2 Jun 10 17:59:29.531526 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-246f83c6-566d-4c5d-b602-b68696932424 req-8b826d41-108e-44a1-a461-8a3f02482415 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054060 Jun 10 17:59:29.532646 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 325/632] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:29.540855 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-587ec23e-4687-4395-b0cb-43f2283342ee tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:29.540855 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-587ec23e-4687-4395-b0cb-43f2283342ee tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:29.548337 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-587ec23e-4687-4395-b0cb-43f2283342ee tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:29.549846 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-587ec23e-4687-4395-b0cb-43f2283342ee tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:29.551033 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-587ec23e-4687-4395-b0cb-43f2283342ee tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:29.551637 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-587ec23e-4687-4395-b0cb-43f2283342ee tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:29.578507 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6c856c7a-88fb-4c74-8508-c3feaec7de27 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.287597 Jun 10 17:59:29.581977 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 308/633] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:59:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 3292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 17:59:29.614305 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-36d6e7ab-9389-4e6a-8baf-283ffe8840dc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:29.619864 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-36d6e7ab-9389-4e6a-8baf-283ffe8840dc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: dea27a27-b11b-445c-b811-e852cd66e197] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:29.633950 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-36d6e7ab-9389-4e6a-8baf-283ffe8840dc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:29.634517 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-36d6e7ab-9389-4e6a-8baf-283ffe8840dc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:29.635543 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-36d6e7ab-9389-4e6a-8baf-283ffe8840dc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:29.636093 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-36d6e7ab-9389-4e6a-8baf-283ffe8840dc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:29.969983 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-36d6e7ab-9389-4e6a-8baf-283ffe8840dc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:29.985715 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-36d6e7ab-9389-4e6a-8baf-283ffe8840dc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197" status: 200 len: 1270 microversion: 2.1 time: 0.388680 Jun 10 17:59:29.992449 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 309/634] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:29 2022] GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197 => generated 1270 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:29.997734 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-54750aba-3c18-4fbb-8f73-5ff5665a1b46 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:29.998345 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-54750aba-3c18-4fbb-8f73-5ff5665a1b46 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: 069baf67-eb80-4d09-a40d-fc139212d954] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:30.176291 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-54750aba-3c18-4fbb-8f73-5ff5665a1b46 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:30.177114 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-587ec23e-4687-4395-b0cb-43f2283342ee tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:30.178984 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=77 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:59:30.186893 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-54750aba-3c18-4fbb-8f73-5ff5665a1b46 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954" status: 200 len: 1221 microversion: 2.1 time: 0.192329 Jun 10 17:59:30.191826 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 310/635] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:29 2022] GET /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954 => generated 1221 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:30.197059 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-587ec23e-4687-4395-b0cb-43f2283342ee tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1312 microversion: 2.1 time: 0.662969 Jun 10 17:59:30.203740 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 326/636] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:29 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1312 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:30.489967 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9b68825c-5ad8-47fd-922c-9a51a5d8a744 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:30.490579 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9b68825c-5ad8-47fd-922c-9a51a5d8a744 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] [instance: d3ce1519-1a65-40bd-bd5b-7bb95d0e136d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:30.498301 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9b68825c-5ad8-47fd-922c-9a51a5d8a744 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:30.499716 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9b68825c-5ad8-47fd-922c-9a51a5d8a744 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:30.500804 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9b68825c-5ad8-47fd-922c-9a51a5d8a744 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:30.501399 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9b68825c-5ad8-47fd-922c-9a51a5d8a744 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:30.506485 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:59:30.952767 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9b68825c-5ad8-47fd-922c-9a51a5d8a744 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ee010108054f52bd787a25060f7ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a7bc463e44066a9da45921fb2043e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:30.964903 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9b68825c-5ad8-47fd-922c-9a51a5d8a744 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] 10.222.0.35 "GET /compute/v2.1/servers/d3ce1519-1a65-40bd-bd5b-7bb95d0e136d" status: 200 len: 1462 microversion: 2.1 time: 0.478816 Jun 10 17:59:30.966934 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 311/637] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:30 2022] GET /compute/v2.1/servers/d3ce1519-1a65-40bd-bd5b-7bb95d0e136d => generated 1462 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:31.015648 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8f369d2d-0166-44ce-ae40-3e077a886c05 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:31.016387 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8f369d2d-0166-44ce-ae40-3e077a886c05 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: dea27a27-b11b-445c-b811-e852cd66e197] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:31.026699 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8f369d2d-0166-44ce-ae40-3e077a886c05 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:31.028874 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8f369d2d-0166-44ce-ae40-3e077a886c05 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:31.031783 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8f369d2d-0166-44ce-ae40-3e077a886c05 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:31.033026 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8f369d2d-0166-44ce-ae40-3e077a886c05 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:31.186844 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8f369d2d-0166-44ce-ae40-3e077a886c05 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:31.200545 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8f369d2d-0166-44ce-ae40-3e077a886c05 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197" status: 200 len: 1268 microversion: 2.1 time: 0.199165 Jun 10 17:59:31.203357 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 312/638] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:30 2022] GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197 => generated 1268 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:31.221797 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b14f5c18-2bd1-4574-a968-490dbb02f9da tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:31.223512 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b14f5c18-2bd1-4574-a968-490dbb02f9da tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: 069baf67-eb80-4d09-a40d-fc139212d954] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:31.232955 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b14f5c18-2bd1-4574-a968-490dbb02f9da tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:31.233706 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b14f5c18-2bd1-4574-a968-490dbb02f9da tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:31.234487 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b14f5c18-2bd1-4574-a968-490dbb02f9da tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:31.234930 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b14f5c18-2bd1-4574-a968-490dbb02f9da tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:31.265881 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4d8fbec5-7eeb-4424-89c3-8f50ed47e06a tempest-TenantUsagesTestJSON-302511279 tempest-TenantUsagesTestJSON-302511279-project-admin] Calling method '.version_select at 0x7f77c18c9550>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:31.276215 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d8fbec5-7eeb-4424-89c3-8f50ed47e06a tempest-TenantUsagesTestJSON-302511279 tempest-TenantUsagesTestJSON-302511279-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:31.276694 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d8fbec5-7eeb-4424-89c3-8f50ed47e06a tempest-TenantUsagesTestJSON-302511279 tempest-TenantUsagesTestJSON-302511279-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:31.303132 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d8fbec5-7eeb-4424-89c3-8f50ed47e06a tempest-TenantUsagesTestJSON-302511279 tempest-TenantUsagesTestJSON-302511279-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:31.304236 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d8fbec5-7eeb-4424-89c3-8f50ed47e06a tempest-TenantUsagesTestJSON-302511279 tempest-TenantUsagesTestJSON-302511279-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:31.330959 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4d8fbec5-7eeb-4424-89c3-8f50ed47e06a tempest-TenantUsagesTestJSON-302511279 tempest-TenantUsagesTestJSON-302511279-project-admin] 10.222.0.35 "GET /compute/v2.1/os-simple-tenant-usage/2f1a7bc463e44066a9da45921fb2043e?start=2022-06-09T17%3A59%3A30.977115&end=2022-06-11T17%3A59%3A30.977115" status: 200 len: 690 microversion: 2.1 time: 0.349727 Jun 10 17:59:31.331712 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 327/639] 10.222.0.35 () {58 vars in 1411 bytes} [Fri Jun 10 17:59:30 2022] GET /compute/v2.1/os-simple-tenant-usage/2f1a7bc463e44066a9da45921fb2043e?start=2022-06-09T17%3A59%3A30.977115&end=2022-06-11T17%3A59%3A30.977115 => generated 690 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:31.336911 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4ae3c7cb-4f44-4dc3-af08-65f433dfd4ac tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:31.339139 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4ae3c7cb-4f44-4dc3-af08-65f433dfd4ac tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:31.346659 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ae3c7cb-4f44-4dc3-af08-65f433dfd4ac tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:31.347481 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ae3c7cb-4f44-4dc3-af08-65f433dfd4ac tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:31.348470 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ae3c7cb-4f44-4dc3-af08-65f433dfd4ac tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:31.349211 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ae3c7cb-4f44-4dc3-af08-65f433dfd4ac tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:31.772133 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b14f5c18-2bd1-4574-a968-490dbb02f9da tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:31.783713 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b14f5c18-2bd1-4574-a968-490dbb02f9da tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954" status: 200 len: 1225 microversion: 2.1 time: 0.568314 Jun 10 17:59:31.786296 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 313/640] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:31 2022] GET /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954 => generated 1225 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:31.795903 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-17529b64-5d20-456c-a4f1-4ab88e1bce2f tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Calling method '.version_select at 0x7f77c134cee0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:31.821960 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-17529b64-5d20-456c-a4f1-4ab88e1bce2f tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:31.823196 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-17529b64-5d20-456c-a4f1-4ab88e1bce2f tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:31.876360 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-17529b64-5d20-456c-a4f1-4ab88e1bce2f tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:31.876360 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-17529b64-5d20-456c-a4f1-4ab88e1bce2f tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:31.907368 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-17529b64-5d20-456c-a4f1-4ab88e1bce2f tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] 10.222.0.35 "GET /compute/v2.1/os-simple-tenant-usage/2f1a7bc463e44066a9da45921fb2043e?start=2022-06-09T17%3A59%3A30.977115&end=2022-06-11T17%3A59%3A30.977115" status: 200 len: 694 microversion: 2.1 time: 0.118065 Jun 10 17:59:31.908591 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 314/641] 10.222.0.35 () {58 vars in 1411 bytes} [Fri Jun 10 17:59:31 2022] GET /compute/v2.1/os-simple-tenant-usage/2f1a7bc463e44066a9da45921fb2043e?start=2022-06-09T17%3A59%3A30.977115&end=2022-06-11T17%3A59%3A30.977115 => generated 694 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:31.931453 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7581ded4-9b49-435c-b3be-70b8946b1737 tempest-TenantUsagesTestJSON-302511279 tempest-TenantUsagesTestJSON-302511279-project-admin] Calling method '.version_select at 0x7f77c132c550>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:31.950992 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7581ded4-9b49-435c-b3be-70b8946b1737 tempest-TenantUsagesTestJSON-302511279 tempest-TenantUsagesTestJSON-302511279-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:31.953462 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7581ded4-9b49-435c-b3be-70b8946b1737 tempest-TenantUsagesTestJSON-302511279 tempest-TenantUsagesTestJSON-302511279-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:31.986286 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7581ded4-9b49-435c-b3be-70b8946b1737 tempest-TenantUsagesTestJSON-302511279 tempest-TenantUsagesTestJSON-302511279-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:31.986964 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7581ded4-9b49-435c-b3be-70b8946b1737 tempest-TenantUsagesTestJSON-302511279 tempest-TenantUsagesTestJSON-302511279-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:32.037755 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7581ded4-9b49-435c-b3be-70b8946b1737 tempest-TenantUsagesTestJSON-302511279 tempest-TenantUsagesTestJSON-302511279-project-admin] 10.222.0.35 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-09T17%3A59%3A30.977115&end=2022-06-11T17%3A59%3A30.977115&detailed=1" status: 200 len: 7269 microversion: 2.1 time: 0.118956 Jun 10 17:59:32.039104 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 315/642] 10.222.0.35 () {58 vars in 1334 bytes} [Fri Jun 10 17:59:31 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-09T17%3A59%3A30.977115&end=2022-06-11T17%3A59%3A30.977115&detailed=1 => generated 7269 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:32.056098 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f4043cc7-48b7-4069-a41b-4eeedfbb8b0d tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:32.056833 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f4043cc7-48b7-4069-a41b-4eeedfbb8b0d tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] [instance: d3ce1519-1a65-40bd-bd5b-7bb95d0e136d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:32.066136 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4043cc7-48b7-4069-a41b-4eeedfbb8b0d tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:32.066136 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4043cc7-48b7-4069-a41b-4eeedfbb8b0d tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:32.066136 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4043cc7-48b7-4069-a41b-4eeedfbb8b0d tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:32.067678 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4043cc7-48b7-4069-a41b-4eeedfbb8b0d tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:32.068124 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4ae3c7cb-4f44-4dc3-af08-65f433dfd4ac tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:32.091184 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4ae3c7cb-4f44-4dc3-af08-65f433dfd4ac tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1312 microversion: 2.1 time: 0.754591 Jun 10 17:59:32.091184 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 328/643] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:31 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1312 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:32.099828 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f4043cc7-48b7-4069-a41b-4eeedfbb8b0d tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] [instance: d3ce1519-1a65-40bd-bd5b-7bb95d0e136d] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 17:59:32.219561 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-641a4d8d-5093-4497-998d-8a6e35f3c47a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:32.220538 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-641a4d8d-5093-4497-998d-8a6e35f3c47a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: dea27a27-b11b-445c-b811-e852cd66e197] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:32.226625 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-641a4d8d-5093-4497-998d-8a6e35f3c47a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:32.227394 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-641a4d8d-5093-4497-998d-8a6e35f3c47a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:32.228832 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-641a4d8d-5093-4497-998d-8a6e35f3c47a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:32.229497 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-641a4d8d-5093-4497-998d-8a6e35f3c47a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:32.510668 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f4043cc7-48b7-4069-a41b-4eeedfbb8b0d tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] 10.222.0.35 "DELETE /compute/v2.1/servers/d3ce1519-1a65-40bd-bd5b-7bb95d0e136d" status: 204 len: 0 microversion: 2.1 time: 0.458265 Jun 10 17:59:32.518544 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 316/644] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 17:59:32 2022] DELETE /compute/v2.1/servers/d3ce1519-1a65-40bd-bd5b-7bb95d0e136d => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 17:59:32.542984 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9dbdbf8e-1830-4669-84f2-8ec6da86be4a tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:32.547559 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9dbdbf8e-1830-4669-84f2-8ec6da86be4a tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] [instance: d3ce1519-1a65-40bd-bd5b-7bb95d0e136d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:32.581498 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9dbdbf8e-1830-4669-84f2-8ec6da86be4a tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:32.586799 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9dbdbf8e-1830-4669-84f2-8ec6da86be4a tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:32.587931 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9dbdbf8e-1830-4669-84f2-8ec6da86be4a tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:32.602743 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9dbdbf8e-1830-4669-84f2-8ec6da86be4a tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:32.930759 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-641a4d8d-5093-4497-998d-8a6e35f3c47a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:32.939755 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-641a4d8d-5093-4497-998d-8a6e35f3c47a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197" status: 200 len: 1310 microversion: 2.1 time: 0.724241 Jun 10 17:59:32.941320 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 329/645] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:32 2022] GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197 => generated 1310 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:59:32.951113 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-df4b0eda-97ac-419e-8dc9-ac135af89dea tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:32.952774 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-df4b0eda-97ac-419e-8dc9-ac135af89dea tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: 069baf67-eb80-4d09-a40d-fc139212d954] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:32.970467 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df4b0eda-97ac-419e-8dc9-ac135af89dea tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:32.971086 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df4b0eda-97ac-419e-8dc9-ac135af89dea tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:32.972248 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df4b0eda-97ac-419e-8dc9-ac135af89dea tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:32.972832 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df4b0eda-97ac-419e-8dc9-ac135af89dea tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:33.116860 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-df4b0eda-97ac-419e-8dc9-ac135af89dea tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:33.134082 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-df4b0eda-97ac-419e-8dc9-ac135af89dea tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954" status: 200 len: 1291 microversion: 2.1 time: 0.191377 Jun 10 17:59:33.144594 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 330/646] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:32 2022] GET /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954 => generated 1291 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:33.155698 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1ad1f227-580d-40fe-ad3a-d587f2a46f5c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:33.158574 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1ad1f227-580d-40fe-ad3a-d587f2a46f5c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:33.176695 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1ad1f227-580d-40fe-ad3a-d587f2a46f5c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:33.177601 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1ad1f227-580d-40fe-ad3a-d587f2a46f5c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:33.179477 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1ad1f227-580d-40fe-ad3a-d587f2a46f5c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:33.181357 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1ad1f227-580d-40fe-ad3a-d587f2a46f5c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:33.230701 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9dbdbf8e-1830-4669-84f2-8ec6da86be4a tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ee010108054f52bd787a25060f7ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a7bc463e44066a9da45921fb2043e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:33.244477 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9dbdbf8e-1830-4669-84f2-8ec6da86be4a tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] 10.222.0.35 "GET /compute/v2.1/servers/d3ce1519-1a65-40bd-bd5b-7bb95d0e136d" status: 200 len: 1468 microversion: 2.1 time: 0.721509 Jun 10 17:59:33.245204 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 317/647] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:32 2022] GET /compute/v2.1/servers/d3ce1519-1a65-40bd-bd5b-7bb95d0e136d => generated 1468 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:33.331101 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-4ec246b9-9300-4cad-a100-64ccce4ebc1d req-e9f8214f-464e-40a1-a3d0-b236de3ea688 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4f44795-d87b-4032-a9b4-4ce68336f264", "tag": "d4ea69a1-84bb-4e29-8fa9-3f0eecbe4c34"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:33.343893 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-4ec246b9-9300-4cad-a100-64ccce4ebc1d req-e9f8214f-464e-40a1-a3d0-b236de3ea688 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:33.346387 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-4ec246b9-9300-4cad-a100-64ccce4ebc1d req-e9f8214f-464e-40a1-a3d0-b236de3ea688 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:33.375502 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-4ec246b9-9300-4cad-a100-64ccce4ebc1d req-e9f8214f-464e-40a1-a3d0-b236de3ea688 service nova] Creating event network-changed:d4ea69a1-84bb-4e29-8fa9-3f0eecbe4c34 for instance f4f44795-d87b-4032-a9b4-4ce68336f264 on chh2-master-2 Jun 10 17:59:33.385719 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-4ec246b9-9300-4cad-a100-64ccce4ebc1d req-e9f8214f-464e-40a1-a3d0-b236de3ea688 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063620 Jun 10 17:59:33.389569 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 318/648] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 17:59:33.459078 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-1074474b-dc7f-4294-a72f-2afd04aa5aae req-4b175524-5ad4-442b-b621-2bd1bef17c50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1951bbc1-82a1-4f7e-abce-09dbed0d71f2", "tag": "748e2cf4-7aaa-4c7d-91d8-ea180aaa6e33"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:33.512030 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-1074474b-dc7f-4294-a72f-2afd04aa5aae req-4b175524-5ad4-442b-b621-2bd1bef17c50 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:33.514812 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-1074474b-dc7f-4294-a72f-2afd04aa5aae req-4b175524-5ad4-442b-b621-2bd1bef17c50 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:33.557372 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-1074474b-dc7f-4294-a72f-2afd04aa5aae req-4b175524-5ad4-442b-b621-2bd1bef17c50 service nova] Creating event network-changed:748e2cf4-7aaa-4c7d-91d8-ea180aaa6e33 for instance 1951bbc1-82a1-4f7e-abce-09dbed0d71f2 on chh1-master-2 Jun 10 17:59:33.569844 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-1074474b-dc7f-4294-a72f-2afd04aa5aae req-4b175524-5ad4-442b-b621-2bd1bef17c50 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116697 Jun 10 17:59:33.572630 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 319/649] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:33.679360 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1ad1f227-580d-40fe-ad3a-d587f2a46f5c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:33.689381 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1ad1f227-580d-40fe-ad3a-d587f2a46f5c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1312 microversion: 2.1 time: 0.542487 Jun 10 17:59:33.690111 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 331/650] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:33 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1312 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:34.242582 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7b185037-d62e-4999-81f0-02ac4316cc3b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:34.242582 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7b185037-d62e-4999-81f0-02ac4316cc3b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: dea27a27-b11b-445c-b811-e852cd66e197] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:34.242582 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7b185037-d62e-4999-81f0-02ac4316cc3b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:34.242582 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7b185037-d62e-4999-81f0-02ac4316cc3b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:34.244445 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7b185037-d62e-4999-81f0-02ac4316cc3b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:34.244445 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7b185037-d62e-4999-81f0-02ac4316cc3b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:34.245517 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2bc8726b-0373-4a75-b534-328b8b59fced tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:34.245517 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2bc8726b-0373-4a75-b534-328b8b59fced tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: 069baf67-eb80-4d09-a40d-fc139212d954] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:34.245517 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2bc8726b-0373-4a75-b534-328b8b59fced tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:34.245517 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2bc8726b-0373-4a75-b534-328b8b59fced tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:34.246307 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2bc8726b-0373-4a75-b534-328b8b59fced tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:34.246307 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2bc8726b-0373-4a75-b534-328b8b59fced tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:34.246307 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:59:34.441168 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2bc8726b-0373-4a75-b534-328b8b59fced tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:34.450200 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2bc8726b-0373-4a75-b534-328b8b59fced tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954" status: 200 len: 1279 microversion: 2.1 time: 0.292468 Jun 10 17:59:34.450903 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 332/651] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:34 2022] GET /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954 => generated 1279 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:59:34.477399 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7a0d53fe-1492-403a-be14-92265b368c94 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:34.478265 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7a0d53fe-1492-403a-be14-92265b368c94 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] [instance: d3ce1519-1a65-40bd-bd5b-7bb95d0e136d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:34.487821 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7a0d53fe-1492-403a-be14-92265b368c94 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:34.488268 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7a0d53fe-1492-403a-be14-92265b368c94 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:34.489259 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7a0d53fe-1492-403a-be14-92265b368c94 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:34.490041 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7a0d53fe-1492-403a-be14-92265b368c94 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:34.529202 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7b185037-d62e-4999-81f0-02ac4316cc3b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:34.539664 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7b185037-d62e-4999-81f0-02ac4316cc3b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197" status: 200 len: 1310 microversion: 2.1 time: 0.585998 Jun 10 17:59:34.540678 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 320/652] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:33 2022] GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197 => generated 1310 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:34.714418 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-50a40f45-2818-4dec-a831-82efb9e8d0dd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:34.715496 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-50a40f45-2818-4dec-a831-82efb9e8d0dd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:34.725419 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-50a40f45-2818-4dec-a831-82efb9e8d0dd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:34.726557 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-50a40f45-2818-4dec-a831-82efb9e8d0dd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:34.728458 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-50a40f45-2818-4dec-a831-82efb9e8d0dd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:34.729833 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-50a40f45-2818-4dec-a831-82efb9e8d0dd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:35.178711 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7a0d53fe-1492-403a-be14-92265b368c94 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ee010108054f52bd787a25060f7ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a7bc463e44066a9da45921fb2043e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:35.187535 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7a0d53fe-1492-403a-be14-92265b368c94 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] 10.222.0.35 "GET /compute/v2.1/servers/d3ce1519-1a65-40bd-bd5b-7bb95d0e136d" status: 200 len: 1468 microversion: 2.1 time: 0.727344 Jun 10 17:59:35.196816 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 333/653] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:34 2022] GET /compute/v2.1/servers/d3ce1519-1a65-40bd-bd5b-7bb95d0e136d => generated 1468 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:35.380731 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-50a40f45-2818-4dec-a831-82efb9e8d0dd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:35.400572 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-50a40f45-2818-4dec-a831-82efb9e8d0dd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1312 microversion: 2.1 time: 0.683460 Jun 10 17:59:35.401900 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 321/654] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:34 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1312 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:35.468868 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-63d2861b-1003-4201-8c95-4e25188cf72f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:35.469323 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-63d2861b-1003-4201-8c95-4e25188cf72f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: 069baf67-eb80-4d09-a40d-fc139212d954] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:35.477299 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-63d2861b-1003-4201-8c95-4e25188cf72f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:35.480206 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-63d2861b-1003-4201-8c95-4e25188cf72f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:35.483679 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-63d2861b-1003-4201-8c95-4e25188cf72f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:35.484373 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-63d2861b-1003-4201-8c95-4e25188cf72f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:35.560689 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-996f8ff2-b5e4-47f4-ad2b-b78bdb783350 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:35.561962 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-996f8ff2-b5e4-47f4-ad2b-b78bdb783350 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: dea27a27-b11b-445c-b811-e852cd66e197] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:35.576380 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-996f8ff2-b5e4-47f4-ad2b-b78bdb783350 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:35.579434 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-996f8ff2-b5e4-47f4-ad2b-b78bdb783350 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:35.580834 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-996f8ff2-b5e4-47f4-ad2b-b78bdb783350 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:35.581559 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-996f8ff2-b5e4-47f4-ad2b-b78bdb783350 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:36.057310 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-63d2861b-1003-4201-8c95-4e25188cf72f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:36.072483 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-63d2861b-1003-4201-8c95-4e25188cf72f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954" status: 200 len: 1321 microversion: 2.1 time: 0.606167 Jun 10 17:59:36.073470 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 334/655] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:35 2022] GET /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954 => generated 1321 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:36.087863 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-996f8ff2-b5e4-47f4-ad2b-b78bdb783350 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:36.106035 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-996f8ff2-b5e4-47f4-ad2b-b78bdb783350 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197" status: 200 len: 1310 microversion: 2.1 time: 0.552172 Jun 10 17:59:36.108364 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 322/656] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:35 2022] GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197 => generated 1310 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:36.204990 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a50f7dd8-1dda-494f-a47a-c7f3f3437d7e tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:36.205593 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a50f7dd8-1dda-494f-a47a-c7f3f3437d7e tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] [instance: d3ce1519-1a65-40bd-bd5b-7bb95d0e136d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:36.215771 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a50f7dd8-1dda-494f-a47a-c7f3f3437d7e tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:36.217185 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a50f7dd8-1dda-494f-a47a-c7f3f3437d7e tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:36.220383 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a50f7dd8-1dda-494f-a47a-c7f3f3437d7e tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:36.221404 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a50f7dd8-1dda-494f-a47a-c7f3f3437d7e tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:36.250758 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-9656f12c-002d-4b2e-a886-f74dcecb3f7a req-33d9d0c9-3c3f-4668-b4cd-0792c2a79716 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f344351-d882-4028-98db-751266b3d74d", "name": "network-vif-plugged", "status": "completed", "tag": "7a719916-3937-4cb7-b0d4-e5842975b4c3"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:36.272646 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-9656f12c-002d-4b2e-a886-f74dcecb3f7a req-33d9d0c9-3c3f-4668-b4cd-0792c2a79716 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:36.272646 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-9656f12c-002d-4b2e-a886-f74dcecb3f7a req-33d9d0c9-3c3f-4668-b4cd-0792c2a79716 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:36.293613 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-9656f12c-002d-4b2e-a886-f74dcecb3f7a req-33d9d0c9-3c3f-4668-b4cd-0792c2a79716 service nova] Creating event network-vif-plugged:7a719916-3937-4cb7-b0d4-e5842975b4c3 for instance 2f344351-d882-4028-98db-751266b3d74d on chh1-master-2 Jun 10 17:59:36.306807 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-9656f12c-002d-4b2e-a886-f74dcecb3f7a req-33d9d0c9-3c3f-4668-b4cd-0792c2a79716 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062243 Jun 10 17:59:36.306807 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 323/657] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 17:59:36.367332 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a50f7dd8-1dda-494f-a47a-c7f3f3437d7e tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ee010108054f52bd787a25060f7ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a7bc463e44066a9da45921fb2043e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:36.400408 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a50f7dd8-1dda-494f-a47a-c7f3f3437d7e tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] 10.222.0.35 "GET /compute/v2.1/servers/d3ce1519-1a65-40bd-bd5b-7bb95d0e136d" status: 200 len: 1426 microversion: 2.1 time: 0.199248 Jun 10 17:59:36.405443 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 335/658] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:36 2022] GET /compute/v2.1/servers/d3ce1519-1a65-40bd-bd5b-7bb95d0e136d => generated 1426 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:36.431048 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-cbfcb54a-57e3-47cb-bd91-00ff7ea9d98a req-d0923593-9385-4fbc-9dcc-724414493d42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dea27a27-b11b-445c-b811-e852cd66e197", "tag": "17c3fdaf-8a01-4c8c-ac51-d926bd2c7869"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:36.476467 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-cbfcb54a-57e3-47cb-bd91-00ff7ea9d98a req-d0923593-9385-4fbc-9dcc-724414493d42 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:36.477756 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-cbfcb54a-57e3-47cb-bd91-00ff7ea9d98a req-d0923593-9385-4fbc-9dcc-724414493d42 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:36.501688 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-cbfcb54a-57e3-47cb-bd91-00ff7ea9d98a req-d0923593-9385-4fbc-9dcc-724414493d42 service nova] Creating event network-changed:17c3fdaf-8a01-4c8c-ac51-d926bd2c7869 for instance dea27a27-b11b-445c-b811-e852cd66e197 on chh1-master-2 Jun 10 17:59:36.506898 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-cbfcb54a-57e3-47cb-bd91-00ff7ea9d98a req-d0923593-9385-4fbc-9dcc-724414493d42 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099043 Jun 10 17:59:36.508545 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 336/659] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:36.521702 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d93e9c90-0430-4d49-87d9-64792c7bc537 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:36.521702 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d93e9c90-0430-4d49-87d9-64792c7bc537 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:36.526114 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d93e9c90-0430-4d49-87d9-64792c7bc537 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:36.526770 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d93e9c90-0430-4d49-87d9-64792c7bc537 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:36.527732 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d93e9c90-0430-4d49-87d9-64792c7bc537 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:36.528827 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d93e9c90-0430-4d49-87d9-64792c7bc537 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:36.751201 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b3d974ba-e466-4937-9e5e-bfb8a305a931 tempest-SecurityGroupsTestAdminJSON-327018568 tempest-SecurityGroupsTestAdminJSON-327018568-project] Action: 'create', calling method: .version_select at 0x7f77c139b940>, body: {"security_group": {"name": "tempest-securitygroup-74093504", "description": "tempest-description-1209117889"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:36.770791 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=50 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:59:37.014850 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d93e9c90-0430-4d49-87d9-64792c7bc537 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:37.023827 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d93e9c90-0430-4d49-87d9-64792c7bc537 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1312 microversion: 2.1 time: 0.513854 Jun 10 17:59:37.024435 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 337/660] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:36 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1312 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:37.037371 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-1fcea22e-cf87-42f5-ad7b-2d413ef5778c req-3b8c26c7-f48e-40f9-950e-4fab918939e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3ce1519-1a65-40bd-bd5b-7bb95d0e136d", "name": "network-vif-deleted", "tag": "61074cd7-9ce9-4ba9-8058-8ab0fc3eae24"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:37.070064 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-1fcea22e-cf87-42f5-ad7b-2d413ef5778c req-3b8c26c7-f48e-40f9-950e-4fab918939e7 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:37.076730 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-1fcea22e-cf87-42f5-ad7b-2d413ef5778c req-3b8c26c7-f48e-40f9-950e-4fab918939e7 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:37.092836 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-1fcea22e-cf87-42f5-ad7b-2d413ef5778c req-3b8c26c7-f48e-40f9-950e-4fab918939e7 service nova] Creating event network-vif-deleted:61074cd7-9ce9-4ba9-8058-8ab0fc3eae24 for instance d3ce1519-1a65-40bd-bd5b-7bb95d0e136d on chh1-master-2 Jun 10 17:59:37.098223 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-1fcea22e-cf87-42f5-ad7b-2d413ef5778c req-3b8c26c7-f48e-40f9-950e-4fab918939e7 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069679 Jun 10 17:59:37.098826 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 338/661] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:37.108820 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5065e3ce-76b3-4f69-8885-6c51501514e9 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:37.116256 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5065e3ce-76b3-4f69-8885-6c51501514e9 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: 069baf67-eb80-4d09-a40d-fc139212d954] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:37.128758 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5065e3ce-76b3-4f69-8885-6c51501514e9 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:37.134036 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5065e3ce-76b3-4f69-8885-6c51501514e9 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:37.134036 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5065e3ce-76b3-4f69-8885-6c51501514e9 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:37.144862 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5065e3ce-76b3-4f69-8885-6c51501514e9 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:37.433173 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5065e3ce-76b3-4f69-8885-6c51501514e9 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:37.444004 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5065e3ce-76b3-4f69-8885-6c51501514e9 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954" status: 200 len: 1321 microversion: 2.1 time: 0.339835 Jun 10 17:59:37.444794 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 339/662] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:37 2022] GET /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954 => generated 1321 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:37.459934 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-37dd9942-8f66-4389-a9fa-1e62a5fe7a7c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:37.461224 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-37dd9942-8f66-4389-a9fa-1e62a5fe7a7c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: dea27a27-b11b-445c-b811-e852cd66e197] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:37.466500 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b3d974ba-e466-4937-9e5e-bfb8a305a931 tempest-SecurityGroupsTestAdminJSON-327018568 tempest-SecurityGroupsTestAdminJSON-327018568-project] 10.222.0.35 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.108359 Jun 10 17:59:37.468961 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 324/663] 10.222.0.35 () {60 vars in 1179 bytes} [Fri Jun 10 17:59:36 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:37.493664 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-37dd9942-8f66-4389-a9fa-1e62a5fe7a7c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:37.498252 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-37dd9942-8f66-4389-a9fa-1e62a5fe7a7c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:37.500101 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-37dd9942-8f66-4389-a9fa-1e62a5fe7a7c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:37.502864 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-37dd9942-8f66-4389-a9fa-1e62a5fe7a7c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:37.686600 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-eadee9e2-4813-495f-950b-5765a8750e85 tempest-KeyPairsV210TestJSON-1900952472 tempest-KeyPairsV210TestJSON-1900952472-project-admin] Action: 'create', calling method: .version_select at 0x7f77c139b790>, body: {"keypair": {"name": "tempest-keypair-40292771", "type": "ssh", "user_id": "d40dda9b802a4ea8beb5b268909e27c9", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXdvnywl5iee9IywEPvjnPo5aJj8RoXnNCiw7b2SVnJDBIcNWDKM57ro8QQ2GF8fQi3yapfGqbOjRqRHtB4pMhmq//o5thGl0Fd1hpJHUOyVqtmZI0zQlHzfaV0hDmTdQ=="}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:37.712886 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-eadee9e2-4813-495f-950b-5765a8750e85 tempest-KeyPairsV210TestJSON-1900952472 tempest-KeyPairsV210TestJSON-1900952472-project-admin] Getting quotas for project 466b603d23b44c83b69c8748b029420d. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 17:59:37.719468 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-eadee9e2-4813-495f-950b-5765a8750e85 tempest-KeyPairsV210TestJSON-1900952472 tempest-KeyPairsV210TestJSON-1900952472-project-admin] Getting quotas for user c01a50a9f519495993a8f884257ca6a6 and project 466b603d23b44c83b69c8748b029420d. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 17:59:37.830671 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-eadee9e2-4813-495f-950b-5765a8750e85 tempest-KeyPairsV210TestJSON-1900952472 tempest-KeyPairsV210TestJSON-1900952472-project-admin] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.10 time: 0.359396 Jun 10 17:59:37.834332 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 325/664] 10.222.0.35 () {62 vars in 1199 bytes} [Fri Jun 10 17:59:37 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 365 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 10 17:59:37.841100 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b56939a4-7a9c-4f07-8a6b-ece6b100b7ed tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:37.842203 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b56939a4-7a9c-4f07-8a6b-ece6b100b7ed tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] [instance: d3ce1519-1a65-40bd-bd5b-7bb95d0e136d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:37.855203 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b56939a4-7a9c-4f07-8a6b-ece6b100b7ed tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:37.855984 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b56939a4-7a9c-4f07-8a6b-ece6b100b7ed tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:37.857243 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b56939a4-7a9c-4f07-8a6b-ece6b100b7ed tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:37.858722 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b56939a4-7a9c-4f07-8a6b-ece6b100b7ed tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:37.932364 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=8,nova_api:UPDATE=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:59:37.937639 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b56939a4-7a9c-4f07-8a6b-ece6b100b7ed tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:37.938674 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b56939a4-7a9c-4f07-8a6b-ece6b100b7ed tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:37.939384 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-b56939a4-7a9c-4f07-8a6b-ece6b100b7ed tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lazy-loading 'fault' on Instance uuid d3ce1519-1a65-40bd-bd5b-7bb95d0e136d {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 17:59:38.021216 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-37dd9942-8f66-4389-a9fa-1e62a5fe7a7c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:38.038756 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-37dd9942-8f66-4389-a9fa-1e62a5fe7a7c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197" status: 200 len: 1310 microversion: 2.1 time: 0.592670 Jun 10 17:59:38.044496 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 340/665] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:37 2022] GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197 => generated 1310 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:38.044985 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-93d0d850-3fc6-42ac-801d-37fe0fce7890 tempest-SecurityGroupsTestAdminJSON-327018568 tempest-SecurityGroupsTestAdminJSON-327018568-project] Action: 'create', calling method: .version_select at 0x7f77c17fc700>, body: {"security_group": {"name": "tempest-securitygroup-351199906", "description": "tempest-description-1517212947"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:38.067358 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b56939a4-7a9c-4f07-8a6b-ece6b100b7ed tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ee010108054f52bd787a25060f7ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a7bc463e44066a9da45921fb2043e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:38.081187 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b56939a4-7a9c-4f07-8a6b-ece6b100b7ed tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] 10.222.0.35 "GET /compute/v2.1/servers/d3ce1519-1a65-40bd-bd5b-7bb95d0e136d" status: 200 len: 1303 microversion: 2.1 time: 0.245476 Jun 10 17:59:38.082253 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 326/666] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:37 2022] GET /compute/v2.1/servers/d3ce1519-1a65-40bd-bd5b-7bb95d0e136d => generated 1303 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:38.090224 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3e6869a4-5353-4614-a2f3-8603c408c2bb tempest-KeyPairsV210TestJSON-1900952472 tempest-KeyPairsV210TestJSON-1900952472-project-admin] Action: 'create', calling method: .version_select at 0x7f77c1472b80>, body: {"keypair": {"name": "tempest-keypair-1650174638", "type": "ssh", "user_id": "d40dda9b802a4ea8beb5b268909e27c9", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPoAyjxVUqTiEO908ph4YuOXNWRiTl28uw3Ztek4zvgq2Ac82lCAD1wxohu2KJgQraZ7P3e1TQSAO3diiYF41DkO+XKauSBt46KrXnfpztasUAnoyWY5rJ72XPqEl26v8g=="}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:38.106237 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-3e6869a4-5353-4614-a2f3-8603c408c2bb tempest-KeyPairsV210TestJSON-1900952472 tempest-KeyPairsV210TestJSON-1900952472-project-admin] Getting quotas for project 466b603d23b44c83b69c8748b029420d. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 17:59:38.114941 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-3e6869a4-5353-4614-a2f3-8603c408c2bb tempest-KeyPairsV210TestJSON-1900952472 tempest-KeyPairsV210TestJSON-1900952472-project-admin] Getting quotas for user c01a50a9f519495993a8f884257ca6a6 and project 466b603d23b44c83b69c8748b029420d. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 17:59:38.209387 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3e6869a4-5353-4614-a2f3-8603c408c2bb tempest-KeyPairsV210TestJSON-1900952472 tempest-KeyPairsV210TestJSON-1900952472-project-admin] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.125448 Jun 10 17:59:38.210600 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 327/667] 10.222.0.35 () {62 vars in 1199 bytes} [Fri Jun 10 17:59:38 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 127 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 10 17:59:38.215931 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-81bc3be3-8b46-493f-a984-064258b538fb tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:38.216867 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-81bc3be3-8b46-493f-a984-064258b538fb tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:38.224379 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-81bc3be3-8b46-493f-a984-064258b538fb tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:38.225083 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-81bc3be3-8b46-493f-a984-064258b538fb tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:38.226080 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-81bc3be3-8b46-493f-a984-064258b538fb tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:38.226732 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-81bc3be3-8b46-493f-a984-064258b538fb tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:38.604174 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-81bc3be3-8b46-493f-a984-064258b538fb tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:38.614005 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-81bc3be3-8b46-493f-a984-064258b538fb tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1312 microversion: 2.1 time: 0.402104 Jun 10 17:59:38.624492 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 328/668] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:38 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1312 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:38.642146 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-be9d8d84-6664-44ed-a5fc-8e70e9b2abf6 tempest-KeyPairsV210TestJSON-1900952472 tempest-KeyPairsV210TestJSON-1900952472-project-admin] Calling method '.version_select at 0x7f77c134c820>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:38.662186 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-be9d8d84-6664-44ed-a5fc-8e70e9b2abf6 tempest-KeyPairsV210TestJSON-1900952472 tempest-KeyPairsV210TestJSON-1900952472-project-admin] 10.222.0.35 "GET /compute/v2.1/os-keypairs/tempest-keypair-40292771?user_id=d40dda9b802a4ea8beb5b268909e27c9" status: 200 len: 510 microversion: 2.10 time: 0.035264 Jun 10 17:59:38.663850 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 329/669] 10.222.0.35 () {60 vars in 1333 bytes} [Fri Jun 10 17:59:38 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-40292771?user_id=d40dda9b802a4ea8beb5b268909e27c9 => generated 510 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 17:59:38.671635 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1f6b7cc4-cf60-4bfc-af5d-c24de6da34e6 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:38.671635 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1f6b7cc4-cf60-4bfc-af5d-c24de6da34e6 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: 069baf67-eb80-4d09-a40d-fc139212d954] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:38.677558 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1f6b7cc4-cf60-4bfc-af5d-c24de6da34e6 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:38.678541 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1f6b7cc4-cf60-4bfc-af5d-c24de6da34e6 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:38.679728 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1f6b7cc4-cf60-4bfc-af5d-c24de6da34e6 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:38.680429 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1f6b7cc4-cf60-4bfc-af5d-c24de6da34e6 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:38.703333 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-93d0d850-3fc6-42ac-801d-37fe0fce7890 tempest-SecurityGroupsTestAdminJSON-327018568 tempest-SecurityGroupsTestAdminJSON-327018568-project] 10.222.0.35 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.662656 Jun 10 17:59:38.711942 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 341/670] 10.222.0.35 () {60 vars in 1179 bytes} [Fri Jun 10 17:59:38 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:38.718277 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c56e954c-03f5-4132-8493-ac37a2ba65ca tempest-KeyPairsV210TestJSON-1900952472 tempest-KeyPairsV210TestJSON-1900952472-project-admin] Action: 'create', calling method: .version_select at 0x7f77c17844c0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1583587448", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXKAe5Vln/JQTUvjirvEgMfuk0XSShJrNfbJW6+WY2g7dSBPmyGGaDwSirDAuEe9xamHKk29IVQS+2bNSWvhzR6S3E1CcZ96VbKkNis9vK6KBOzSHkhzGL538RsLHoZEA=="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:38.766236 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-c56e954c-03f5-4132-8493-ac37a2ba65ca tempest-KeyPairsV210TestJSON-1900952472 tempest-KeyPairsV210TestJSON-1900952472-project-admin] Getting quotas for project 466b603d23b44c83b69c8748b029420d. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 17:59:38.777512 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-c56e954c-03f5-4132-8493-ac37a2ba65ca tempest-KeyPairsV210TestJSON-1900952472 tempest-KeyPairsV210TestJSON-1900952472-project-admin] Getting quotas for user c01a50a9f519495993a8f884257ca6a6 and project 466b603d23b44c83b69c8748b029420d. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 17:59:38.912085 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c56e954c-03f5-4132-8493-ac37a2ba65ca tempest-KeyPairsV210TestJSON-1900952472 tempest-KeyPairsV210TestJSON-1900952472-project-admin] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.198782 Jun 10 17:59:38.913454 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 342/671] 10.222.0.35 () {62 vars in 1199 bytes} [Fri Jun 10 17:59:38 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 201 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 10 17:59:38.958711 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1f6b7cc4-cf60-4bfc-af5d-c24de6da34e6 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:38.969373 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1f6b7cc4-cf60-4bfc-af5d-c24de6da34e6 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954" status: 200 len: 1321 microversion: 2.1 time: 0.303793 Jun 10 17:59:38.980178 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 330/672] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:38 2022] GET /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954 => generated 1321 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:38.983854 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-80454c52-ffc8-4715-96f6-b49468d0a968 tempest-KeyPairsV210TestJSON-1900952472 tempest-KeyPairsV210TestJSON-1900952472-project-admin] Calling method '.version_select at 0x7f77c132c670>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:38.986500 chdv-master-2 devstack@n-api.service[126594]: WARNING oslo_db.sqlalchemy.utils [None req-80454c52-ffc8-4715-96f6-b49468d0a968 tempest-KeyPairsV210TestJSON-1900952472 tempest-KeyPairsV210TestJSON-1900952472-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Jun 10 17:59:38.999449 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-80454c52-ffc8-4715-96f6-b49468d0a968 tempest-KeyPairsV210TestJSON-1900952472 tempest-KeyPairsV210TestJSON-1900952472-project-admin] 10.222.0.35 "GET /compute/v2.1/os-keypairs?user_id=d40dda9b802a4ea8beb5b268909e27c9" status: 200 len: 724 microversion: 2.10 time: 0.023165 Jun 10 17:59:39.001264 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 331/673] 10.222.0.35 () {60 vars in 1258 bytes} [Fri Jun 10 17:59:38 2022] GET /compute/v2.1/os-keypairs?user_id=d40dda9b802a4ea8beb5b268909e27c9 => generated 724 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 17:59:39.012332 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cb098ec5-c45c-4964-a39a-5573c3c18eef tempest-KeyPairsV210TestJSON-1900952472 tempest-KeyPairsV210TestJSON-1900952472-project-admin] Calling method '.version_select at 0x7f77c12c4b80>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:39.130141 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cb098ec5-c45c-4964-a39a-5573c3c18eef tempest-KeyPairsV210TestJSON-1900952472 tempest-KeyPairsV210TestJSON-1900952472-project-admin] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1583587448" status: 204 len: 0 microversion: 2.10 time: 0.123176 Jun 10 17:59:39.131546 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 332/674] 10.222.0.35 () {60 vars in 1324 bytes} [Fri Jun 10 17:59:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1583587448 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 10 17:59:39.138360 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-82a3d71e-9941-4dd2-88f7-f2629aa7924d tempest-SecurityGroupsTestAdminJSON-385695014 tempest-SecurityGroupsTestAdminJSON-385695014-project-admin] Action: 'create', calling method: .version_select at 0x7f77c1675d30>, body: {"security_group": {"name": "tempest-securitygroup-1419344951", "description": "tempest-description-207681302"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:39.143193 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bbf1397d-4b35-46d0-8dce-270def8f465c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:39.143897 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bbf1397d-4b35-46d0-8dce-270def8f465c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: dea27a27-b11b-445c-b811-e852cd66e197] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:39.152037 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bbf1397d-4b35-46d0-8dce-270def8f465c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:39.154008 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bbf1397d-4b35-46d0-8dce-270def8f465c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:39.155161 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bbf1397d-4b35-46d0-8dce-270def8f465c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:39.155614 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bbf1397d-4b35-46d0-8dce-270def8f465c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:39.485421 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bbf1397d-4b35-46d0-8dce-270def8f465c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:39.516935 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bbf1397d-4b35-46d0-8dce-270def8f465c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197" status: 200 len: 1310 microversion: 2.1 time: 0.383836 Jun 10 17:59:39.526004 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 333/675] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:39 2022] GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197 => generated 1310 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:39.542180 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-a93def8e-af5a-4ae0-ab19-060367bd8406 req-51c1e50a-595b-478a-b872-fc2226ebc4b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "069baf67-eb80-4d09-a40d-fc139212d954", "tag": "d26f4e7e-befe-405c-afdc-c3794c2d5f84"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:39.558454 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-a93def8e-af5a-4ae0-ab19-060367bd8406 req-51c1e50a-595b-478a-b872-fc2226ebc4b8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:39.559211 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-a93def8e-af5a-4ae0-ab19-060367bd8406 req-51c1e50a-595b-478a-b872-fc2226ebc4b8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:39.573734 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-a93def8e-af5a-4ae0-ab19-060367bd8406 req-51c1e50a-595b-478a-b872-fc2226ebc4b8 service nova] Creating event network-changed:d26f4e7e-befe-405c-afdc-c3794c2d5f84 for instance 069baf67-eb80-4d09-a40d-fc139212d954 on chh2-master-2 Jun 10 17:59:39.580456 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-a93def8e-af5a-4ae0-ab19-060367bd8406 req-51c1e50a-595b-478a-b872-fc2226ebc4b8 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061151 Jun 10 17:59:39.581647 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 334/676] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:39.588479 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-caf0eda7-3b68-418f-a1f8-d0b63ff6c781 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:39.589422 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-caf0eda7-3b68-418f-a1f8-d0b63ff6c781 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] [instance: d3ce1519-1a65-40bd-bd5b-7bb95d0e136d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:39.596403 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-caf0eda7-3b68-418f-a1f8-d0b63ff6c781 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:39.596993 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-caf0eda7-3b68-418f-a1f8-d0b63ff6c781 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:39.598019 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-caf0eda7-3b68-418f-a1f8-d0b63ff6c781 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:39.598536 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-caf0eda7-3b68-418f-a1f8-d0b63ff6c781 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:39.614507 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-caf0eda7-3b68-418f-a1f8-d0b63ff6c781 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] HTTP exception thrown: Instance d3ce1519-1a65-40bd-bd5b-7bb95d0e136d could not be found. Jun 10 17:59:39.616585 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-caf0eda7-3b68-418f-a1f8-d0b63ff6c781 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Request method failure captured: Jun 10 17:59:39.616585 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/d3ce1519-1a65-40bd-bd5b-7bb95d0e136d HTTP/1.1 Jun 10 17:59:39.616585 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 17:59:39.616585 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 17:59:39.616585 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 17:59:39.616585 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 17:59:39.616585 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 17:59:39.616585 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 17:59:39.616585 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 17:59:39.616585 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 17:59:39.616585 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4Zm8ScTPByvdihlM8sgKbZwPwfOp4ZKHckXI4uwLJyKd0cftUkKoq7jwgGT1sx-Uw4Vfv2OXGOrLnlCqlT1ep4Comipk_1hfSQiuwsEBjwOUcjOwwhQjXvQiengaFvKHnhhGPClaijA6KpXMnhh2gVthS4A3QD41vPH862rX8b8Qi8 Jun 10 17:59:39.616585 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 17:59:39.616585 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 17:59:39.616585 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 17:59:39.616585 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 17:59:39.616585 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 17:59:39.616585 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 17:59:39.616585 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 2f1a7bc463e44066a9da45921fb2043e Jun 10 17:59:39.616585 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-TenantUsagesTestJSON-613021962 Jun 10 17:59:39.616585 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 17:59:39.616585 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 17:59:39.624165 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/2f1a7bc463e44066a9da45921fb2043e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2f1a7bc463e44066a9da45921fb2043e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2f1a7bc463e44066a9da45921fb2043e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_2f1a7bc463e44066a9da45921fb2043e", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 17:59:39.624165 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-TenantUsagesTestJSON-613021962 Jun 10 17:59:39.624165 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 2f1a7bc463e44066a9da45921fb2043e Jun 10 17:59:39.624165 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-TenantUsagesTestJSON-613021962 Jun 10 17:59:39.624165 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-TenantUsagesTestJSON-613021962-project Jun 10 17:59:39.624165 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 17:59:39.624165 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 17:59:39.624165 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: c1ee010108054f52bd787a25060f7ced Jun 10 17:59:39.624165 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-TenantUsagesTestJSON-613021962-project Jun 10 17:59:39.624165 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 17:59:39.624165 chdv-master-2 devstack@n-api.service[126594]: exception: Instance d3ce1519-1a65-40bd-bd5b-7bb95d0e136d could not be found. Jun 10 17:59:39.624165 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'd3ce1519-1a65-40bd-bd5b-7bb95d0e136d'} Jun 10 17:59:39.627701 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 17:59:39.627701 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:59:39.627701 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 17:59:39.627701 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 17:59:39.627701 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 17:59:39.627701 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 17:59:39.627701 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 17:59:39.627701 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 17:59:39.627701 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 17:59:39.627701 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 17:59:39.627701 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3ce1519-1a65-40bd-bd5b-7bb95d0e136d could not be found. Jun 10 17:59:39.627701 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:59:39.627701 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:59:39.627701 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:59:39.627701 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:59:39.627701 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:59:39.627701 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:59:39.627701 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 17:59:39.627701 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 17:59:39.627701 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 17:59:39.629439 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 17:59:39.629439 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 17:59:39.629439 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 17:59:39.629439 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 17:59:39.629439 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 17:59:39.629439 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 17:59:39.629439 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 17:59:39.629439 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3ce1519-1a65-40bd-bd5b-7bb95d0e136d could not be found. Jun 10 17:59:39.629439 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:59:39.629439 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 17:59:39.629439 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:59:39.629439 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 17:59:39.629439 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 17:59:39.629439 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 17:59:39.629439 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 17:59:39.629439 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 17:59:39.629439 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3ce1519-1a65-40bd-bd5b-7bb95d0e136d could not be found. Jun 10 17:59:39.629439 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 17:59:39.631466 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-caf0eda7-3b68-418f-a1f8-d0b63ff6c781 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] Returning 404 to user: Instance d3ce1519-1a65-40bd-bd5b-7bb95d0e136d could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 17:59:39.631466 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-caf0eda7-3b68-418f-a1f8-d0b63ff6c781 tempest-TenantUsagesTestJSON-613021962 tempest-TenantUsagesTestJSON-613021962-project] 10.222.0.35 "GET /compute/v2.1/servers/d3ce1519-1a65-40bd-bd5b-7bb95d0e136d" status: 404 len: 111 microversion: 2.1 time: 0.035034 Jun 10 17:59:39.631466 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 335/677] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:39 2022] GET /compute/v2.1/servers/d3ce1519-1a65-40bd-bd5b-7bb95d0e136d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 17:59:39.642933 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d29d673b-9881-4bb8-a2bf-116257192f97 tempest-KeyPairsV210TestJSON-1900952472 tempest-KeyPairsV210TestJSON-1900952472-project-admin] Calling method '.version_select at 0x7f77c13d9280>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:39.755152 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d29d673b-9881-4bb8-a2bf-116257192f97 tempest-KeyPairsV210TestJSON-1900952472 tempest-KeyPairsV210TestJSON-1900952472-project-admin] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1650174638?user_id=d40dda9b802a4ea8beb5b268909e27c9" status: 204 len: 0 microversion: 2.10 time: 0.135138 Jun 10 17:59:39.756187 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 336/678] 10.222.0.35 () {60 vars in 1342 bytes} [Fri Jun 10 17:59:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1650174638?user_id=d40dda9b802a4ea8beb5b268909e27c9 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 10 17:59:39.763149 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b42144bf-ec1a-4f6d-8f50-8541baa34240 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:39.765319 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b42144bf-ec1a-4f6d-8f50-8541baa34240 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:39.777868 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b42144bf-ec1a-4f6d-8f50-8541baa34240 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:39.778694 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b42144bf-ec1a-4f6d-8f50-8541baa34240 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:39.782214 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b42144bf-ec1a-4f6d-8f50-8541baa34240 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:39.782657 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b42144bf-ec1a-4f6d-8f50-8541baa34240 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:39.820098 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:59:40.010250 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-82a3d71e-9941-4dd2-88f7-f2629aa7924d tempest-SecurityGroupsTestAdminJSON-385695014 tempest-SecurityGroupsTestAdminJSON-385695014-project-admin] 10.222.0.35 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.095464 Jun 10 17:59:40.010906 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 343/679] 10.222.0.35 () {60 vars in 1179 bytes} [Fri Jun 10 17:59:38 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:40.015499 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-19e740c9-6b67-4b3f-96ff-ead0c31098e3 tempest-KeyPairsV210TestJSON-1900952472 tempest-KeyPairsV210TestJSON-1900952472-project-admin] Calling method '.version_select at 0x7f77c16ff3a0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:40.025882 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b42144bf-ec1a-4f6d-8f50-8541baa34240 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:40.039119 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b42144bf-ec1a-4f6d-8f50-8541baa34240 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1462 microversion: 2.1 time: 0.281268 Jun 10 17:59:40.039903 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 337/680] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:39 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1462 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:40.109927 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-19e740c9-6b67-4b3f-96ff-ead0c31098e3 tempest-KeyPairsV210TestJSON-1900952472 tempest-KeyPairsV210TestJSON-1900952472-project-admin] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-40292771?user_id=d40dda9b802a4ea8beb5b268909e27c9" status: 204 len: 0 microversion: 2.10 time: 0.097927 Jun 10 17:59:40.111983 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 344/681] 10.222.0.35 () {60 vars in 1336 bytes} [Fri Jun 10 17:59:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-40292771?user_id=d40dda9b802a4ea8beb5b268909e27c9 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 10 17:59:40.117268 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7043ed35-32c4-4257-812b-14226789a862 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:40.117912 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7043ed35-32c4-4257-812b-14226789a862 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: 069baf67-eb80-4d09-a40d-fc139212d954] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:40.125196 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7043ed35-32c4-4257-812b-14226789a862 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:40.125657 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7043ed35-32c4-4257-812b-14226789a862 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:40.126560 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7043ed35-32c4-4257-812b-14226789a862 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:40.127177 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7043ed35-32c4-4257-812b-14226789a862 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:40.194038 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a4c23822-d938-46ea-8fb7-2e806c2e6770 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Action: 'create', calling method: .version_select at 0x7f77c138c550>, body: {"keypair": {"name": "tempest-keypair-1703438657", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOiJO1DxAMQofh8e1jPnM2a+tNvacGn2CyD7FJpOH/3hzVqQAq7OaCIOnwP2zLRk80qdVMPqRM/6PvOEG/JnakVfNzA4PObR4t+UrI37I0qlK7hv4AVKi9N28Y+/isDjDA=="}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:40.224158 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-a4c23822-d938-46ea-8fb7-2e806c2e6770 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Getting quotas for project dce8674b6db3471c8c94e809430651c4. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 17:59:40.231659 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-a4c23822-d938-46ea-8fb7-2e806c2e6770 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Getting quotas for user 63889ce9e75140bd9c730857468b7fd5 and project dce8674b6db3471c8c94e809430651c4. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 17:59:40.334289 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7043ed35-32c4-4257-812b-14226789a862 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:40.347520 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7043ed35-32c4-4257-812b-14226789a862 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954" status: 200 len: 1321 microversion: 2.1 time: 0.234244 Jun 10 17:59:40.348107 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 345/682] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:40 2022] GET /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954 => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:40.360172 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2b4fe5ca-14b4-4687-819d-a0efbc8a020a tempest-SecurityGroupsTestAdminJSON-385695014 tempest-SecurityGroupsTestAdminJSON-385695014-project-admin] Action: 'create', calling method: .version_select at 0x7f77c1675af0>, body: {"security_group": {"name": "tempest-securitygroup-1855274713", "description": "tempest-description-656819666"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:40.378591 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a4c23822-d938-46ea-8fb7-2e806c2e6770 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.337382 Jun 10 17:59:40.379357 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 338/683] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 17:59:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:40.845623 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2b4fe5ca-14b4-4687-819d-a0efbc8a020a tempest-SecurityGroupsTestAdminJSON-385695014 tempest-SecurityGroupsTestAdminJSON-385695014-project-admin] 10.222.0.35 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.496425 Jun 10 17:59:40.846487 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 346/684] 10.222.0.35 () {60 vars in 1179 bytes} [Fri Jun 10 17:59:40 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:40.856792 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-09ef0a44-0f4b-4bf0-8939-eeb381affafe tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:40.858176 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-190be8d4-3be3-4397-85ae-f04bd861b49a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:40.859103 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-190be8d4-3be3-4397-85ae-f04bd861b49a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: dea27a27-b11b-445c-b811-e852cd66e197] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:40.865703 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-09ef0a44-0f4b-4bf0-8939-eeb381affafe tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:40.881568 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-190be8d4-3be3-4397-85ae-f04bd861b49a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:40.881568 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-190be8d4-3be3-4397-85ae-f04bd861b49a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:40.881568 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-190be8d4-3be3-4397-85ae-f04bd861b49a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:40.881568 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-190be8d4-3be3-4397-85ae-f04bd861b49a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:40.886171 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-09ef0a44-0f4b-4bf0-8939-eeb381affafe tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:40.890084 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-09ef0a44-0f4b-4bf0-8939-eeb381affafe tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:40.892802 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-09ef0a44-0f4b-4bf0-8939-eeb381affafe tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:40.894951 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-09ef0a44-0f4b-4bf0-8939-eeb381affafe tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:41.164297 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-190be8d4-3be3-4397-85ae-f04bd861b49a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:41.175603 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-190be8d4-3be3-4397-85ae-f04bd861b49a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197" status: 200 len: 1310 microversion: 2.1 time: 0.327616 Jun 10 17:59:41.187347 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 347/685] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:40 2022] GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197 => generated 1310 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:41.192593 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-89d61695-4acb-495a-9e60-f5bb9ecbbd3d tempest-SecurityGroupsTestAdminJSON-385695014 tempest-SecurityGroupsTestAdminJSON-385695014-project-admin] Calling method '.version_select at 0x7f77c17fcf70>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:41.297194 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=14 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:59:41.408028 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-09ef0a44-0f4b-4bf0-8939-eeb381affafe tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1613 microversion: 2.1 time: 1.027397 Jun 10 17:59:41.409150 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 339/686] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:40 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1613 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:41.437823 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ea8f2160-2cf7-49ea-be62-56642366ebd4 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:41.441955 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ea8f2160-2cf7-49ea-be62-56642366ebd4 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: 069baf67-eb80-4d09-a40d-fc139212d954] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:41.454451 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ea8f2160-2cf7-49ea-be62-56642366ebd4 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:41.456560 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ea8f2160-2cf7-49ea-be62-56642366ebd4 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:41.457558 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ea8f2160-2cf7-49ea-be62-56642366ebd4 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:41.459889 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ea8f2160-2cf7-49ea-be62-56642366ebd4 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:41.720951 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ea8f2160-2cf7-49ea-be62-56642366ebd4 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:41.733914 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ea8f2160-2cf7-49ea-be62-56642366ebd4 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954" status: 200 len: 1321 microversion: 2.1 time: 0.323015 Jun 10 17:59:41.735287 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 340/687] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:41 2022] GET /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954 => generated 1321 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:41.740606 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-70f54284-b403-49e5-a1e9-2f6f61f36cce tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:41.741491 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-70f54284-b403-49e5-a1e9-2f6f61f36cce tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:41.749790 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-70f54284-b403-49e5-a1e9-2f6f61f36cce tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:41.749790 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-70f54284-b403-49e5-a1e9-2f6f61f36cce tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:41.751362 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-70f54284-b403-49e5-a1e9-2f6f61f36cce tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:41.752195 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-70f54284-b403-49e5-a1e9-2f6f61f36cce tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:41.786469 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-70f54284-b403-49e5-a1e9-2f6f61f36cce tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'c994b8591be74d3f8553e412dbd226d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4a0e2335244c26adcc4cdfd10705d6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:41.787383 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-70f54284-b403-49e5-a1e9-2f6f61f36cce tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] [instance: 2f344351-d882-4028-98db-751266b3d74d] flavor_id is None. Assuming migration. {{(pid=126594) resize /opt/stack/nova/nova/compute/api.py:4142}} Jun 10 17:59:41.788212 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-70f54284-b403-49e5-a1e9-2f6f61f36cce tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] [instance: 2f344351-d882-4028-98db-751266b3d74d] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=126594) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 10 17:59:41.979252 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=11 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:59:42.730392 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-70f54284-b403-49e5-a1e9-2f6f61f36cce tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] 10.222.0.35 "POST /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d/action" status: 202 len: 0 microversion: 2.1 time: 0.993439 Jun 10 17:59:42.740200 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 341/688] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 17:59:41 2022] POST /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d/action => generated 0 bytes in 1004 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 17:59:42.788762 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-2685fc67-06fe-4adb-8900-87df669ea8fb req-3955694b-0183-4312-8c98-fe74de22cf5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1951bbc1-82a1-4f7e-abce-09dbed0d71f2", "name": "network-vif-plugged", "status": "completed", "tag": "748e2cf4-7aaa-4c7d-91d8-ea180aaa6e33"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:42.805248 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-2685fc67-06fe-4adb-8900-87df669ea8fb req-3955694b-0183-4312-8c98-fe74de22cf5a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:42.808143 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-2685fc67-06fe-4adb-8900-87df669ea8fb req-3955694b-0183-4312-8c98-fe74de22cf5a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:42.846897 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-2685fc67-06fe-4adb-8900-87df669ea8fb req-3955694b-0183-4312-8c98-fe74de22cf5a service nova] Creating event network-vif-plugged:748e2cf4-7aaa-4c7d-91d8-ea180aaa6e33 for instance 1951bbc1-82a1-4f7e-abce-09dbed0d71f2 on chh1-master-2 Jun 10 17:59:42.854376 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-2685fc67-06fe-4adb-8900-87df669ea8fb req-3955694b-0183-4312-8c98-fe74de22cf5a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104300 Jun 10 17:59:42.859654 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 342/689] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:42.865765 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-96dd7555-bd8a-4b31-8a7d-697719ff8e08 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:42.867070 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-96dd7555-bd8a-4b31-8a7d-697719ff8e08 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: dea27a27-b11b-445c-b811-e852cd66e197] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:42.877135 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-96dd7555-bd8a-4b31-8a7d-697719ff8e08 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:42.877910 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-96dd7555-bd8a-4b31-8a7d-697719ff8e08 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:42.879049 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-96dd7555-bd8a-4b31-8a7d-697719ff8e08 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:42.879737 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-96dd7555-bd8a-4b31-8a7d-697719ff8e08 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:43.819000 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-96dd7555-bd8a-4b31-8a7d-697719ff8e08 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:43.833075 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-96dd7555-bd8a-4b31-8a7d-697719ff8e08 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197" status: 200 len: 1310 microversion: 2.1 time: 0.976542 Jun 10 17:59:43.834162 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 343/690] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:42 2022] GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197 => generated 1310 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:43.843292 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a328a964-e674-4551-a77a-b3f0fc531538 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:43.845084 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a328a964-e674-4551-a77a-b3f0fc531538 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:43.865281 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a328a964-e674-4551-a77a-b3f0fc531538 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:43.873030 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a328a964-e674-4551-a77a-b3f0fc531538 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:43.874947 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a328a964-e674-4551-a77a-b3f0fc531538 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:43.878391 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a328a964-e674-4551-a77a-b3f0fc531538 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:44.342616 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a328a964-e674-4551-a77a-b3f0fc531538 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:44.352507 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a328a964-e674-4551-a77a-b3f0fc531538 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1471 microversion: 2.1 time: 0.517084 Jun 10 17:59:44.363897 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 344/691] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:43 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1471 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:44.370009 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-443d6847-c857-4e99-a096-b8aa47147be7 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:44.370694 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-443d6847-c857-4e99-a096-b8aa47147be7 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: 069baf67-eb80-4d09-a40d-fc139212d954] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:44.377912 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-443d6847-c857-4e99-a096-b8aa47147be7 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:44.378194 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-443d6847-c857-4e99-a096-b8aa47147be7 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:44.379021 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-443d6847-c857-4e99-a096-b8aa47147be7 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:44.379562 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-443d6847-c857-4e99-a096-b8aa47147be7 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:44.598331 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-443d6847-c857-4e99-a096-b8aa47147be7 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:44.608679 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-443d6847-c857-4e99-a096-b8aa47147be7 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954" status: 200 len: 1321 microversion: 2.1 time: 0.242387 Jun 10 17:59:44.614873 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 345/692] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:44 2022] GET /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954 => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:44.771086 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-89d61695-4acb-495a-9e60-f5bb9ecbbd3d tempest-SecurityGroupsTestAdminJSON-385695014 tempest-SecurityGroupsTestAdminJSON-385695014-project-admin] 10.222.0.35 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 10571 microversion: 2.1 time: 3.582299 Jun 10 17:59:44.773283 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 348/693] 10.222.0.35 () {58 vars in 1190 bytes} [Fri Jun 10 17:59:41 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 10571 bytes in 3585 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 17:59:44.797612 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-951f0b75-4d40-479e-bb41-f68cae6682fe tempest-SecurityGroupsTestAdminJSON-327018568 tempest-SecurityGroupsTestAdminJSON-327018568-project] Calling method '.version_select at 0x7f77c129cb80>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:44.851643 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-25ffd445-8a51-4c72-9fea-3da7cc2c3fd1 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:44.852599 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-25ffd445-8a51-4c72-9fea-3da7cc2c3fd1 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: dea27a27-b11b-445c-b811-e852cd66e197] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:44.859807 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-25ffd445-8a51-4c72-9fea-3da7cc2c3fd1 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:44.863348 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-25ffd445-8a51-4c72-9fea-3da7cc2c3fd1 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:44.863348 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-25ffd445-8a51-4c72-9fea-3da7cc2c3fd1 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:44.863348 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-25ffd445-8a51-4c72-9fea-3da7cc2c3fd1 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:45.056762 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-25ffd445-8a51-4c72-9fea-3da7cc2c3fd1 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:45.065407 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-25ffd445-8a51-4c72-9fea-3da7cc2c3fd1 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197" status: 200 len: 1310 microversion: 2.1 time: 0.218451 Jun 10 17:59:45.066040 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 349/694] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:44 2022] GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197 => generated 1310 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:45.083397 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-41fac12a-0b98-4dd4-99c8-8bccb0d1db02 req-51a1a5ab-9594-49f2-b913-d09d3392df03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4f44795-d87b-4032-a9b4-4ce68336f264", "name": "network-vif-plugged", "status": "completed", "tag": "d4ea69a1-84bb-4e29-8fa9-3f0eecbe4c34"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:45.092907 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-41fac12a-0b98-4dd4-99c8-8bccb0d1db02 req-51a1a5ab-9594-49f2-b913-d09d3392df03 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:45.093836 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-41fac12a-0b98-4dd4-99c8-8bccb0d1db02 req-51a1a5ab-9594-49f2-b913-d09d3392df03 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:45.105026 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-41fac12a-0b98-4dd4-99c8-8bccb0d1db02 req-51a1a5ab-9594-49f2-b913-d09d3392df03 service nova] Creating event network-vif-plugged:d4ea69a1-84bb-4e29-8fa9-3f0eecbe4c34 for instance f4f44795-d87b-4032-a9b4-4ce68336f264 on chh2-master-2 Jun 10 17:59:45.110398 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-41fac12a-0b98-4dd4-99c8-8bccb0d1db02 req-51a1a5ab-9594-49f2-b913-d09d3392df03 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042818 Jun 10 17:59:45.111067 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 350/695] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:45.143428 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-951f0b75-4d40-479e-bb41-f68cae6682fe tempest-SecurityGroupsTestAdminJSON-327018568 tempest-SecurityGroupsTestAdminJSON-327018568-project] 10.222.0.35 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 0.349616 Jun 10 17:59:45.144449 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 346/696] 10.222.0.35 () {58 vars in 1190 bytes} [Fri Jun 10 17:59:44 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:45.156394 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a2266fa3-07e0-4599-963a-d5abeca64c0e tempest-SecurityGroupsTestAdminJSON-385695014 tempest-SecurityGroupsTestAdminJSON-385695014-project-admin] Calling method '.version_select at 0x7f77c17fc940>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:45.478039 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a2266fa3-07e0-4599-963a-d5abeca64c0e tempest-SecurityGroupsTestAdminJSON-385695014 tempest-SecurityGroupsTestAdminJSON-385695014-project-admin] 10.222.0.35 "DELETE /compute/v2.1/os-security-groups/339a31da-2db2-4857-b437-eaa0fab61863" status: 202 len: 0 microversion: 2.1 time: 0.325175 Jun 10 17:59:45.481668 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 351/697] 10.222.0.35 () {58 vars in 1271 bytes} [Fri Jun 10 17:59:45 2022] DELETE /compute/v2.1/os-security-groups/339a31da-2db2-4857-b437-eaa0fab61863 => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 17:59:45.486583 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-86a9b8f5-7b63-43bf-8af2-15937685b1b1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:45.489434 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-86a9b8f5-7b63-43bf-8af2-15937685b1b1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:45.489560 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ca9463ed-758e-4fd5-adbc-38c32cf383e9 tempest-FlavorsV2TestJSON-1323387130 tempest-FlavorsV2TestJSON-1323387130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:45.499486 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ca9463ed-758e-4fd5-adbc-38c32cf383e9 tempest-FlavorsV2TestJSON-1323387130 tempest-FlavorsV2TestJSON-1323387130-project] 10.222.0.35 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.175927 Jun 10 17:59:45.500455 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 347/698] 10.222.0.35 () {58 vars in 1136 bytes} [Fri Jun 10 17:59:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:45.503936 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86a9b8f5-7b63-43bf-8af2-15937685b1b1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:45.505236 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-390b5c61-20c4-467e-a445-885892513ef6 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-922855935", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "6b5a9d7c-48fd-4dc5-be64-fc076e8b4d21"}], "security_groups": [{"name": "tempest-securitygroup--726401502"}], "key_name": "tempest-keypair-1703438657", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:45.508612 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86a9b8f5-7b63-43bf-8af2-15937685b1b1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:45.509546 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86a9b8f5-7b63-43bf-8af2-15937685b1b1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:45.512856 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86a9b8f5-7b63-43bf-8af2-15937685b1b1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:45.634057 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-390b5c61-20c4-467e-a445-885892513ef6 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] validate_networks() for [('6b5a9d7c-48fd-4dc5-be64-fc076e8b4d21', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 17:59:45.696775 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-86a9b8f5-7b63-43bf-8af2-15937685b1b1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:45.709170 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-86a9b8f5-7b63-43bf-8af2-15937685b1b1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1471 microversion: 2.1 time: 0.229138 Jun 10 17:59:45.711259 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 352/699] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:45 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1471 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:45.724524 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2dc388d4-97a3-4bbd-be84-a2e832796e11 tempest-SecurityGroupsTestAdminJSON-385695014 tempest-SecurityGroupsTestAdminJSON-385695014-project-admin] Calling method '.version_select at 0x7f77c16ddc10>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:46.065028 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2dc388d4-97a3-4bbd-be84-a2e832796e11 tempest-SecurityGroupsTestAdminJSON-385695014 tempest-SecurityGroupsTestAdminJSON-385695014-project-admin] 10.222.0.35 "DELETE /compute/v2.1/os-security-groups/40169363-a74f-4d56-91d6-145bba5a3eb8" status: 202 len: 0 microversion: 2.1 time: 0.352503 Jun 10 17:59:46.065978 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 353/700] 10.222.0.35 () {58 vars in 1271 bytes} [Fri Jun 10 17:59:45 2022] DELETE /compute/v2.1/os-security-groups/40169363-a74f-4d56-91d6-145bba5a3eb8 => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 17:59:46.070906 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-695b60af-5b4c-470c-a218-8d4851199e95 tempest-FlavorsV2TestJSON-1323387130 tempest-FlavorsV2TestJSON-1323387130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:46.096097 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-695b60af-5b4c-470c-a218-8d4851199e95 tempest-FlavorsV2TestJSON-1323387130 tempest-FlavorsV2TestJSON-1323387130-project] 10.222.0.35 "GET /compute/v2.1/flavors" status: 200 len: 3075 microversion: 2.1 time: 0.029006 Jun 10 17:59:46.097585 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 354/701] 10.222.0.35 () {58 vars in 1124 bytes} [Fri Jun 10 17:59:46 2022] GET /compute/v2.1/flavors => generated 3075 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:46.104478 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bfb8d803-3f5b-44b0-8c11-f4f811358995 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:46.105461 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bfb8d803-3f5b-44b0-8c11-f4f811358995 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: 069baf67-eb80-4d09-a40d-fc139212d954] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:46.114157 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bfb8d803-3f5b-44b0-8c11-f4f811358995 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:46.115476 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bfb8d803-3f5b-44b0-8c11-f4f811358995 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:46.117038 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bfb8d803-3f5b-44b0-8c11-f4f811358995 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:46.118075 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bfb8d803-3f5b-44b0-8c11-f4f811358995 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:46.131852 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-390b5c61-20c4-467e-a445-885892513ef6 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 17:59:46.132661 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-390b5c61-20c4-467e-a445-885892513ef6 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 17:59:46.133324 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-390b5c61-20c4-467e-a445-885892513ef6 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 17:59:46.133893 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-390b5c61-20c4-467e-a445-885892513ef6 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 17:59:46.134602 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-390b5c61-20c4-467e-a445-885892513ef6 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 17:59:46.145664 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-390b5c61-20c4-467e-a445-885892513ef6 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:46.147193 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-390b5c61-20c4-467e-a445-885892513ef6 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:46.148192 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-390b5c61-20c4-467e-a445-885892513ef6 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:46.148831 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-390b5c61-20c4-467e-a445-885892513ef6 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:46.168643 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-390b5c61-20c4-467e-a445-885892513ef6 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Getting quotas for project dce8674b6db3471c8c94e809430651c4. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 17:59:46.172512 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-390b5c61-20c4-467e-a445-885892513ef6 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Getting quotas for user 63889ce9e75140bd9c730857468b7fd5 and project dce8674b6db3471c8c94e809430651c4. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 17:59:46.184810 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-390b5c61-20c4-467e-a445-885892513ef6 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 17:59:46.187212 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-390b5c61-20c4-467e-a445-885892513ef6 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 17:59:46.252071 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bfb8d803-3f5b-44b0-8c11-f4f811358995 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:46.259464 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bfb8d803-3f5b-44b0-8c11-f4f811358995 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954" status: 200 len: 1321 microversion: 2.1 time: 0.160769 Jun 10 17:59:46.260027 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 355/702] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:46 2022] GET /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:46.264851 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0856fdc1-056a-43ae-b674-82590388359c tempest-SecurityGroupsTestAdminJSON-327018568 tempest-SecurityGroupsTestAdminJSON-327018568-project] Calling method '.version_select at 0x7f77c18c9e50>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:46.287487 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-390b5c61-20c4-467e-a445-885892513ef6 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.785971 Jun 10 17:59:46.288429 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 348/703] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:59:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 17:59:46.293237 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3d2c25e9-40bf-442b-b9a1-00a6ab135052 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:46.294024 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3d2c25e9-40bf-442b-b9a1-00a6ab135052 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: dea27a27-b11b-445c-b811-e852cd66e197] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:46.301587 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3d2c25e9-40bf-442b-b9a1-00a6ab135052 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:46.302270 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3d2c25e9-40bf-442b-b9a1-00a6ab135052 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:46.303066 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3d2c25e9-40bf-442b-b9a1-00a6ab135052 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:46.303521 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3d2c25e9-40bf-442b-b9a1-00a6ab135052 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:46.460185 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3d2c25e9-40bf-442b-b9a1-00a6ab135052 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:46.469121 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3d2c25e9-40bf-442b-b9a1-00a6ab135052 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197" status: 200 len: 1310 microversion: 2.1 time: 0.179518 Jun 10 17:59:46.469695 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 349/704] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:46 2022] GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197 => generated 1310 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:46.481735 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-75b0ea36-5d18-4566-808a-07d15e2e4cd9 tempest-FlavorsV2TestJSON-1323387130 tempest-FlavorsV2TestJSON-1323387130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:46.490479 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-75b0ea36-5d18-4566-808a-07d15e2e4cd9 tempest-FlavorsV2TestJSON-1323387130 tempest-FlavorsV2TestJSON-1323387130-project] 10.222.0.35 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012848 Jun 10 17:59:46.491050 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 350/705] 10.222.0.35 () {58 vars in 1136 bytes} [Fri Jun 10 17:59:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:46.495640 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c86f3e85-89af-4682-9bce-679370a0d00b tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:46.496824 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c86f3e85-89af-4682-9bce-679370a0d00b tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:46.556100 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c86f3e85-89af-4682-9bce-679370a0d00b tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63889ce9e75140bd9c730857468b7fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce8674b6db3471c8c94e809430651c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:46.563575 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c86f3e85-89af-4682-9bce-679370a0d00b tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63" status: 200 len: 1241 microversion: 2.1 time: 0.071378 Jun 10 17:59:46.564553 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 351/706] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:46 2022] GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:46.569735 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cbc983d7-61e0-4b89-bbea-f6d2f199b383 tempest-FlavorsV2TestJSON-1323387130 tempest-FlavorsV2TestJSON-1323387130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:46.579373 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cbc983d7-61e0-4b89-bbea-f6d2f199b383 tempest-FlavorsV2TestJSON-1323387130 tempest-FlavorsV2TestJSON-1323387130-project] 10.222.0.35 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013628 Jun 10 17:59:46.580144 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 352/707] 10.222.0.35 () {58 vars in 1136 bytes} [Fri Jun 10 17:59:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:46.596074 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4516ef1c-bba7-4358-bda1-914874cdaad8 tempest-FlavorsV2TestJSON-1323387130 tempest-FlavorsV2TestJSON-1323387130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:46.621371 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4516ef1c-bba7-4358-bda1-914874cdaad8 tempest-FlavorsV2TestJSON-1323387130 tempest-FlavorsV2TestJSON-1323387130-project] 10.222.0.35 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.029259 Jun 10 17:59:46.621980 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 353/708] 10.222.0.35 () {58 vars in 1164 bytes} [Fri Jun 10 17:59:46 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:59:46.639744 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-44c37d79-1b74-49f2-8c13-53e667daa34a tempest-FlavorsV2TestJSON-1323387130 tempest-FlavorsV2TestJSON-1323387130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:46.648760 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-44c37d79-1b74-49f2-8c13-53e667daa34a tempest-FlavorsV2TestJSON-1323387130 tempest-FlavorsV2TestJSON-1323387130-project] 10.222.0.35 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013413 Jun 10 17:59:46.648760 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 354/709] 10.222.0.35 () {58 vars in 1136 bytes} [Fri Jun 10 17:59:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:46.658543 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f75e8484-99cf-41f5-8d54-098f18f55d57 tempest-FlavorsV2TestJSON-1323387130 tempest-FlavorsV2TestJSON-1323387130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:46.663028 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:59:46.683384 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f75e8484-99cf-41f5-8d54-098f18f55d57 tempest-FlavorsV2TestJSON-1323387130 tempest-FlavorsV2TestJSON-1323387130-project] 10.222.0.35 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.028341 Jun 10 17:59:46.683955 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 355/710] 10.222.0.35 () {58 vars in 1168 bytes} [Fri Jun 10 17:59:46 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:59:46.697856 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0bd3137d-4fe2-440f-90b5-6f932a04f47b tempest-FlavorsV2TestJSON-1323387130 tempest-FlavorsV2TestJSON-1323387130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:46.704213 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0856fdc1-056a-43ae-b674-82590388359c tempest-SecurityGroupsTestAdminJSON-327018568 tempest-SecurityGroupsTestAdminJSON-327018568-project] 10.222.0.35 "DELETE /compute/v2.1/os-security-groups/e8982829-9d84-4184-95a0-27fa437af1eb" status: 202 len: 0 microversion: 2.1 time: 0.443068 Jun 10 17:59:46.714015 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 356/711] 10.222.0.35 () {58 vars in 1271 bytes} [Fri Jun 10 17:59:46 2022] DELETE /compute/v2.1/os-security-groups/e8982829-9d84-4184-95a0-27fa437af1eb => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 17:59:46.722383 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-42aab6bf-9b29-463e-a011-0d979f7ff2f9 tempest-SecurityGroupsTestAdminJSON-327018568 tempest-SecurityGroupsTestAdminJSON-327018568-project] Calling method '.version_select at 0x7f77c17fc310>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:46.726352 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0bd3137d-4fe2-440f-90b5-6f932a04f47b tempest-FlavorsV2TestJSON-1323387130 tempest-FlavorsV2TestJSON-1323387130-project] 10.222.0.35 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.032270 Jun 10 17:59:46.727408 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 356/712] 10.222.0.35 () {58 vars in 1160 bytes} [Fri Jun 10 17:59:46 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 17:59:46.732661 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b9fbbec6-db56-4c60-b19e-4dcb7ab7fe48 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:46.733477 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b9fbbec6-db56-4c60-b19e-4dcb7ab7fe48 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:46.749281 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9fbbec6-db56-4c60-b19e-4dcb7ab7fe48 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:46.749281 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9fbbec6-db56-4c60-b19e-4dcb7ab7fe48 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:46.749281 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9fbbec6-db56-4c60-b19e-4dcb7ab7fe48 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:46.749281 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9fbbec6-db56-4c60-b19e-4dcb7ab7fe48 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:46.911525 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b9fbbec6-db56-4c60-b19e-4dcb7ab7fe48 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:46.925935 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b9fbbec6-db56-4c60-b19e-4dcb7ab7fe48 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1471 microversion: 2.1 time: 0.197184 Jun 10 17:59:46.927549 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 357/713] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:46 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1471 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:46.934483 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a077484b-6e11-4be3-93d6-0f73ba5c302c tempest-FlavorsV2TestJSON-1323387130 tempest-FlavorsV2TestJSON-1323387130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:46.951834 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a077484b-6e11-4be3-93d6-0f73ba5c302c tempest-FlavorsV2TestJSON-1323387130 tempest-FlavorsV2TestJSON-1323387130-project] 10.222.0.35 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022272 Jun 10 17:59:46.960132 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 358/714] 10.222.0.35 () {58 vars in 1136 bytes} [Fri Jun 10 17:59:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:46.967428 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a9e614a5-e52d-45cd-9d11-1de5ef6a7f6f tempest-FlavorsV2TestJSON-1323387130 tempest-FlavorsV2TestJSON-1323387130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:47.147561 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-42aab6bf-9b29-463e-a011-0d979f7ff2f9 tempest-SecurityGroupsTestAdminJSON-327018568 tempest-SecurityGroupsTestAdminJSON-327018568-project] 10.222.0.35 "DELETE /compute/v2.1/os-security-groups/c42917ef-ebb1-4b8f-8075-91bad85c5b1e" status: 202 len: 0 microversion: 2.1 time: 0.428439 Jun 10 17:59:47.147561 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 357/715] 10.222.0.35 () {58 vars in 1271 bytes} [Fri Jun 10 17:59:46 2022] DELETE /compute/v2.1/os-security-groups/c42917ef-ebb1-4b8f-8075-91bad85c5b1e => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 17:59:47.152621 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-bffcc974-2627-4d5a-9623-7f8028c28dbd req-5a19d155-f471-4f8c-adad-328b434ca0f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dea27a27-b11b-445c-b811-e852cd66e197", "name": "network-vif-plugged", "status": "completed", "tag": "17c3fdaf-8a01-4c8c-ac51-d926bd2c7869"}, {"server_uuid": "069baf67-eb80-4d09-a40d-fc139212d954", "name": "network-vif-plugged", "status": "completed", "tag": "d26f4e7e-befe-405c-afdc-c3794c2d5f84"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:47.160249 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:59:47.171395 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-bffcc974-2627-4d5a-9623-7f8028c28dbd req-5a19d155-f471-4f8c-adad-328b434ca0f9 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:47.172494 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-bffcc974-2627-4d5a-9623-7f8028c28dbd req-5a19d155-f471-4f8c-adad-328b434ca0f9 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:47.196103 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-bffcc974-2627-4d5a-9623-7f8028c28dbd req-5a19d155-f471-4f8c-adad-328b434ca0f9 service nova] Creating event network-vif-plugged:17c3fdaf-8a01-4c8c-ac51-d926bd2c7869 for instance dea27a27-b11b-445c-b811-e852cd66e197 on chh1-master-2 Jun 10 17:59:47.196852 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-bffcc974-2627-4d5a-9623-7f8028c28dbd req-5a19d155-f471-4f8c-adad-328b434ca0f9 service nova] Creating event network-vif-plugged:d26f4e7e-befe-405c-afdc-c3794c2d5f84 for instance 069baf67-eb80-4d09-a40d-fc139212d954 on chh2-master-2 Jun 10 17:59:47.215847 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-bffcc974-2627-4d5a-9623-7f8028c28dbd req-5a19d155-f471-4f8c-adad-328b434ca0f9 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.068997 Jun 10 17:59:47.222178 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 358/716] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:47.223643 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a9e614a5-e52d-45cd-9d11-1de5ef6a7f6f tempest-FlavorsV2TestJSON-1323387130 tempest-FlavorsV2TestJSON-1323387130-project] 10.222.0.35 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2908 microversion: 2.1 time: 0.261188 Jun 10 17:59:47.224230 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 359/717] 10.222.0.35 () {58 vars in 1166 bytes} [Fri Jun 10 17:59:46 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2908 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:47.239850 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c77cb420-d7df-4438-bc57-2a15a235db69 tempest-FlavorsV2TestJSON-1323387130 tempest-FlavorsV2TestJSON-1323387130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:47.249254 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c77cb420-d7df-4438-bc57-2a15a235db69 tempest-FlavorsV2TestJSON-1323387130 tempest-FlavorsV2TestJSON-1323387130-project] 10.222.0.35 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013045 Jun 10 17:59:47.249824 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 359/718] 10.222.0.35 () {58 vars in 1136 bytes} [Fri Jun 10 17:59:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:47.261195 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3d04fa0d-ed32-4f2f-b9ad-f2d96cd1295b tempest-FlavorsV2TestJSON-1323387130 tempest-FlavorsV2TestJSON-1323387130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:47.280863 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4cac9b10-890d-41cf-8d1b-64e5aff61f39 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:47.284074 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4cac9b10-890d-41cf-8d1b-64e5aff61f39 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: 069baf67-eb80-4d09-a40d-fc139212d954] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:47.298137 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4cac9b10-890d-41cf-8d1b-64e5aff61f39 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:47.300128 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4cac9b10-890d-41cf-8d1b-64e5aff61f39 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:47.303347 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4cac9b10-890d-41cf-8d1b-64e5aff61f39 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:47.303347 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4cac9b10-890d-41cf-8d1b-64e5aff61f39 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:47.303694 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3d04fa0d-ed32-4f2f-b9ad-f2d96cd1295b tempest-FlavorsV2TestJSON-1323387130 tempest-FlavorsV2TestJSON-1323387130-project] 10.222.0.35 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.038078 Jun 10 17:59:47.303694 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 360/719] 10.222.0.35 () {58 vars in 1143 bytes} [Fri Jun 10 17:59:47 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:47.314772 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3cc76c4c-74b3-4a02-9137-3f8df9dbfb4b tempest-FlavorsV2TestJSON-1323387130 tempest-FlavorsV2TestJSON-1323387130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:47.343587 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3cc76c4c-74b3-4a02-9137-3f8df9dbfb4b tempest-FlavorsV2TestJSON-1323387130 tempest-FlavorsV2TestJSON-1323387130-project] 10.222.0.35 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028449 Jun 10 17:59:47.362124 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 361/720] 10.222.0.35 () {58 vars in 1136 bytes} [Fri Jun 10 17:59:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 17:59:47.369686 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a0e3c445-e291-46c5-97b2-a5db8e65e089 tempest-FlavorsV2TestJSON-1323387130 tempest-FlavorsV2TestJSON-1323387130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:47.401433 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a0e3c445-e291-46c5-97b2-a5db8e65e089 tempest-FlavorsV2TestJSON-1323387130 tempest-FlavorsV2TestJSON-1323387130-project] 10.222.0.35 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.037520 Jun 10 17:59:47.402203 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 362/721] 10.222.0.35 () {58 vars in 1147 bytes} [Fri Jun 10 17:59:47 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:47.425004 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a1918f0f-4267-4a73-ad42-d754f543b450 tempest-FlavorsV2TestJSON-1323387130 tempest-FlavorsV2TestJSON-1323387130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:47.438337 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a1918f0f-4267-4a73-ad42-d754f543b450 tempest-FlavorsV2TestJSON-1323387130 tempest-FlavorsV2TestJSON-1323387130-project] 10.222.0.35 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.026823 Jun 10 17:59:47.446406 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 363/722] 10.222.0.35 () {58 vars in 1139 bytes} [Fri Jun 10 17:59:47 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:47.452252 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2acbaab7-12b0-49ad-85cc-8e7158199dac tempest-FlavorsV2TestJSON-1323387130 tempest-FlavorsV2TestJSON-1323387130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:47.461587 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2acbaab7-12b0-49ad-85cc-8e7158199dac tempest-FlavorsV2TestJSON-1323387130 tempest-FlavorsV2TestJSON-1323387130-project] 10.222.0.35 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013865 Jun 10 17:59:47.468992 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 364/723] 10.222.0.35 () {58 vars in 1136 bytes} [Fri Jun 10 17:59:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:47.474316 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1c4a3cef-9611-4ea1-be5f-d8ddc08c72fb tempest-FlavorsV2TestJSON-1323387130 tempest-FlavorsV2TestJSON-1323387130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:47.496592 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1c4a3cef-9611-4ea1-be5f-d8ddc08c72fb tempest-FlavorsV2TestJSON-1323387130 tempest-FlavorsV2TestJSON-1323387130-project] 10.222.0.35 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1537 microversion: 2.1 time: 0.026402 Jun 10 17:59:47.497200 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 365/724] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 17:59:47 2022] GET /compute/v2.1/flavors?marker=452 => generated 1537 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:47.503991 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fc7eb4e3-9a16-4945-8c53-7561e475338e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:47.504827 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fc7eb4e3-9a16-4945-8c53-7561e475338e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: dea27a27-b11b-445c-b811-e852cd66e197] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:47.513200 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fc7eb4e3-9a16-4945-8c53-7561e475338e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:47.513639 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fc7eb4e3-9a16-4945-8c53-7561e475338e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:47.514668 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fc7eb4e3-9a16-4945-8c53-7561e475338e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:47.515121 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fc7eb4e3-9a16-4945-8c53-7561e475338e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:47.571489 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4cac9b10-890d-41cf-8d1b-64e5aff61f39 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:47.579295 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4cac9b10-890d-41cf-8d1b-64e5aff61f39 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954" status: 200 len: 1321 microversion: 2.1 time: 0.306139 Jun 10 17:59:47.579873 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 360/725] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:47 2022] GET /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954 => generated 1321 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:47.588521 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d0ef150d-bc33-4bd6-97f8-bcd28cb50a5d tempest-FlavorsV2TestJSON-1323387130 tempest-FlavorsV2TestJSON-1323387130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:47.616164 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d0ef150d-bc33-4bd6-97f8-bcd28cb50a5d tempest-FlavorsV2TestJSON-1323387130 tempest-FlavorsV2TestJSON-1323387130-project] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.035170 Jun 10 17:59:47.616803 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 361/726] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 17:59:47 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:47.631419 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ee199f56-6abe-4640-bcf6-5092ebe31ab7 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:47.632030 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ee199f56-6abe-4640-bcf6-5092ebe31ab7 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:47.670191 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fc7eb4e3-9a16-4945-8c53-7561e475338e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:47.677793 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fc7eb4e3-9a16-4945-8c53-7561e475338e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197" status: 200 len: 1310 microversion: 2.1 time: 0.177786 Jun 10 17:59:47.678470 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 366/727] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:47 2022] GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197 => generated 1310 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:47.687220 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ee199f56-6abe-4640-bcf6-5092ebe31ab7 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63889ce9e75140bd9c730857468b7fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce8674b6db3471c8c94e809430651c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:47.688952 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a0bb79ed-17f7-4b0a-9143-4a964d8f20e1 tempest-FlavorsV2TestJSON-1323387130 tempest-FlavorsV2TestJSON-1323387130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:47.697320 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ee199f56-6abe-4640-bcf6-5092ebe31ab7 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63" status: 200 len: 1241 microversion: 2.1 time: 0.069571 Jun 10 17:59:47.697892 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 362/728] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:47 2022] GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:47.704429 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a0bb79ed-17f7-4b0a-9143-4a964d8f20e1 tempest-FlavorsV2TestJSON-1323387130 tempest-FlavorsV2TestJSON-1323387130-project] 10.222.0.35 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023669 Jun 10 17:59:47.705921 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 367/729] 10.222.0.35 () {58 vars in 1136 bytes} [Fri Jun 10 17:59:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:47.944584 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-23280303-eb06-4cb0-bc93-78efd739381a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:47.945775 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-23280303-eb06-4cb0-bc93-78efd739381a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:47.958807 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-23280303-eb06-4cb0-bc93-78efd739381a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:47.960915 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-23280303-eb06-4cb0-bc93-78efd739381a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:47.960915 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-23280303-eb06-4cb0-bc93-78efd739381a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:47.962610 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-23280303-eb06-4cb0-bc93-78efd739381a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:48.123908 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-23280303-eb06-4cb0-bc93-78efd739381a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:48.131521 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-23280303-eb06-4cb0-bc93-78efd739381a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1471 microversion: 2.1 time: 0.191911 Jun 10 17:59:48.132089 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 363/730] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:47 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1471 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:48.599196 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ef8173af-7957-4717-973e-743ea3de07b0 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:48.600390 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ef8173af-7957-4717-973e-743ea3de07b0 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: 069baf67-eb80-4d09-a40d-fc139212d954] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:48.610171 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ef8173af-7957-4717-973e-743ea3de07b0 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:48.611377 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ef8173af-7957-4717-973e-743ea3de07b0 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:48.612156 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ef8173af-7957-4717-973e-743ea3de07b0 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:48.614896 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ef8173af-7957-4717-973e-743ea3de07b0 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:48.694527 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-07142767-5579-4f27-a838-3e9c73f3d9af tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:48.695145 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-07142767-5579-4f27-a838-3e9c73f3d9af tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: dea27a27-b11b-445c-b811-e852cd66e197] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:48.701864 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-07142767-5579-4f27-a838-3e9c73f3d9af tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:48.702318 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-07142767-5579-4f27-a838-3e9c73f3d9af tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:48.703087 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-07142767-5579-4f27-a838-3e9c73f3d9af tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:48.703524 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-07142767-5579-4f27-a838-3e9c73f3d9af tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:48.781961 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ef8173af-7957-4717-973e-743ea3de07b0 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:48.791692 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ef8173af-7957-4717-973e-743ea3de07b0 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954" status: 200 len: 1321 microversion: 2.1 time: 0.198578 Jun 10 17:59:48.797053 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 368/731] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:48 2022] GET /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954 => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:48.807850 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f073da69-2447-496e-8093-c343966fb029 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:48.808501 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f073da69-2447-496e-8093-c343966fb029 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:48.816554 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f073da69-2447-496e-8093-c343966fb029 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:48.817011 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f073da69-2447-496e-8093-c343966fb029 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:48.820268 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f073da69-2447-496e-8093-c343966fb029 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:48.821931 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f073da69-2447-496e-8093-c343966fb029 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:48.910247 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f073da69-2447-496e-8093-c343966fb029 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63889ce9e75140bd9c730857468b7fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce8674b6db3471c8c94e809430651c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:48.922833 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f073da69-2447-496e-8093-c343966fb029 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63" status: 200 len: 1245 microversion: 2.1 time: 0.121136 Jun 10 17:59:48.925656 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 369/732] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:48 2022] GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63 => generated 1245 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:49.036525 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-07142767-5579-4f27-a838-3e9c73f3d9af tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:49.050513 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-07142767-5579-4f27-a838-3e9c73f3d9af tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197" status: 200 len: 1310 microversion: 2.1 time: 0.359862 Jun 10 17:59:49.062050 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 364/733] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:48 2022] GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197 => generated 1310 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:59:49.149442 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-21b6226b-692b-4765-a96b-9db17b3da1cc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:49.150262 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-21b6226b-692b-4765-a96b-9db17b3da1cc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:49.156680 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-21b6226b-692b-4765-a96b-9db17b3da1cc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:49.157489 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-21b6226b-692b-4765-a96b-9db17b3da1cc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:49.158513 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-21b6226b-692b-4765-a96b-9db17b3da1cc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:49.159180 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-21b6226b-692b-4765-a96b-9db17b3da1cc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:49.418095 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-21b6226b-692b-4765-a96b-9db17b3da1cc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:49.429125 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-21b6226b-692b-4765-a96b-9db17b3da1cc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1471 microversion: 2.1 time: 0.283562 Jun 10 17:59:49.430138 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 370/734] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:49 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1471 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:49.816767 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b563b29f-b092-4f6e-9383-84d1ed2fd589 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:49.817457 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b563b29f-b092-4f6e-9383-84d1ed2fd589 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: 069baf67-eb80-4d09-a40d-fc139212d954] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:49.825432 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b563b29f-b092-4f6e-9383-84d1ed2fd589 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:49.827786 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b563b29f-b092-4f6e-9383-84d1ed2fd589 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:49.827786 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b563b29f-b092-4f6e-9383-84d1ed2fd589 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:49.827786 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b563b29f-b092-4f6e-9383-84d1ed2fd589 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:49.845657 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:59:49.940097 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4b9a39a9-b45f-4d10-9ae0-66ed517de071 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:49.945263 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4b9a39a9-b45f-4d10-9ae0-66ed517de071 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:49.949681 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4b9a39a9-b45f-4d10-9ae0-66ed517de071 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:49.950494 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4b9a39a9-b45f-4d10-9ae0-66ed517de071 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:49.954271 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4b9a39a9-b45f-4d10-9ae0-66ed517de071 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:49.955055 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4b9a39a9-b45f-4d10-9ae0-66ed517de071 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:50.080214 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b563b29f-b092-4f6e-9383-84d1ed2fd589 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:50.088825 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b563b29f-b092-4f6e-9383-84d1ed2fd589 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954" status: 200 len: 1513 microversion: 2.1 time: 0.279092 Jun 10 17:59:50.094569 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 365/735] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:49 2022] GET /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954 => generated 1513 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:50.105986 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-47545186-da19-4d05-9f7f-cb617e25ba14 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:50.108782 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-47545186-da19-4d05-9f7f-cb617e25ba14 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: dea27a27-b11b-445c-b811-e852cd66e197] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:50.120166 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-47545186-da19-4d05-9f7f-cb617e25ba14 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:50.123458 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-47545186-da19-4d05-9f7f-cb617e25ba14 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:50.123458 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-47545186-da19-4d05-9f7f-cb617e25ba14 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:50.123458 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-47545186-da19-4d05-9f7f-cb617e25ba14 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:50.146133 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4b9a39a9-b45f-4d10-9ae0-66ed517de071 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63889ce9e75140bd9c730857468b7fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce8674b6db3471c8c94e809430651c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:50.157434 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4b9a39a9-b45f-4d10-9ae0-66ed517de071 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63" status: 200 len: 1301 microversion: 2.1 time: 0.222489 Jun 10 17:59:50.159196 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 371/736] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:49 2022] GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63 => generated 1301 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:50.173681 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0c73204a-7b4b-47f2-8513-a8d888a8987c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:50.174293 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0c73204a-7b4b-47f2-8513-a8d888a8987c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: f4f44795-d87b-4032-a9b4-4ce68336f264] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:50.187903 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0c73204a-7b4b-47f2-8513-a8d888a8987c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:50.190542 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0c73204a-7b4b-47f2-8513-a8d888a8987c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:50.191359 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0c73204a-7b4b-47f2-8513-a8d888a8987c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:50.191804 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0c73204a-7b4b-47f2-8513-a8d888a8987c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:50.289827 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-47545186-da19-4d05-9f7f-cb617e25ba14 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:50.298300 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-47545186-da19-4d05-9f7f-cb617e25ba14 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197" status: 200 len: 1492 microversion: 2.1 time: 0.201423 Jun 10 17:59:50.299456 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 366/737] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:50 2022] GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197 => generated 1492 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:50.490776 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0c73204a-7b4b-47f2-8513-a8d888a8987c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:50.492969 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:59:50.499403 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0c73204a-7b4b-47f2-8513-a8d888a8987c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264" status: 200 len: 1512 microversion: 2.1 time: 0.338873 Jun 10 17:59:50.499942 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 372/738] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:50 2022] GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264 => generated 1512 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:50.504605 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-90a6dc00-47e8-470d-b52c-6a20d86fd76e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:50.505212 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-90a6dc00-47e8-470d-b52c-6a20d86fd76e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:50.511524 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90a6dc00-47e8-470d-b52c-6a20d86fd76e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:50.511974 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90a6dc00-47e8-470d-b52c-6a20d86fd76e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:50.512796 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90a6dc00-47e8-470d-b52c-6a20d86fd76e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:50.513277 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90a6dc00-47e8-470d-b52c-6a20d86fd76e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:50.646861 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7584b6a9-0521-4763-acef-4649bffcc64e tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:50.660675 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7584b6a9-0521-4763-acef-4649bffcc64e tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] [instance: dea27a27-b11b-445c-b811-e852cd66e197] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:50.660675 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7584b6a9-0521-4763-acef-4649bffcc64e tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:50.660675 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7584b6a9-0521-4763-acef-4649bffcc64e tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:50.660675 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7584b6a9-0521-4763-acef-4649bffcc64e tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:50.662103 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7584b6a9-0521-4763-acef-4649bffcc64e tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:50.759916 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-90a6dc00-47e8-470d-b52c-6a20d86fd76e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:50.768094 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-90a6dc00-47e8-470d-b52c-6a20d86fd76e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1476 microversion: 2.1 time: 0.266783 Jun 10 17:59:50.769415 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 373/739] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:50 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1476 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:50.774127 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-185b680a-d457-4c67-b2be-d8880079687b tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:50.776266 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-185b680a-d457-4c67-b2be-d8880079687b tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: 1951bbc1-82a1-4f7e-abce-09dbed0d71f2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:50.780719 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-185b680a-d457-4c67-b2be-d8880079687b tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:50.781351 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-185b680a-d457-4c67-b2be-d8880079687b tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:50.782281 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-185b680a-d457-4c67-b2be-d8880079687b tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:50.782884 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-185b680a-d457-4c67-b2be-d8880079687b tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:50.808639 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7584b6a9-0521-4763-acef-4649bffcc64e tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197" status: 200 len: 1643 microversion: 2.1 time: 0.495505 Jun 10 17:59:50.809347 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 367/740] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:50 2022] GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197 => generated 1643 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:59:50.825561 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3b1944ed-dddb-4ea3-816a-e6082dc662f2 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:50.827406 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3b1944ed-dddb-4ea3-816a-e6082dc662f2 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] [instance: dea27a27-b11b-445c-b811-e852cd66e197] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:50.836708 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3b1944ed-dddb-4ea3-816a-e6082dc662f2 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:50.837334 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3b1944ed-dddb-4ea3-816a-e6082dc662f2 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:50.838462 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3b1944ed-dddb-4ea3-816a-e6082dc662f2 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:50.839131 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3b1944ed-dddb-4ea3-816a-e6082dc662f2 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:51.001384 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3b1944ed-dddb-4ea3-816a-e6082dc662f2 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197" status: 200 len: 1643 microversion: 2.1 time: 0.179498 Jun 10 17:59:51.019232 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 368/741] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:50 2022] GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197 => generated 1643 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:51.065892 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-185b680a-d457-4c67-b2be-d8880079687b tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:51.073475 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-185b680a-d457-4c67-b2be-d8880079687b tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/1951bbc1-82a1-4f7e-abce-09dbed0d71f2" status: 200 len: 1513 microversion: 2.1 time: 0.303055 Jun 10 17:59:51.074051 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 374/742] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:50 2022] GET /compute/v2.1/servers/1951bbc1-82a1-4f7e-abce-09dbed0d71f2 => generated 1513 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:51.083344 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2dd8cf4c-45e2-45bd-9ec4-a42f5f7aed3f tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:51.087224 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 17:59:51.087224 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 17:59:51.088842 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2dd8cf4c-45e2-45bd-9ec4-a42f5f7aed3f tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:51.089465 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2dd8cf4c-45e2-45bd-9ec4-a42f5f7aed3f tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:51.090479 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2dd8cf4c-45e2-45bd-9ec4-a42f5f7aed3f tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:51.090923 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2dd8cf4c-45e2-45bd-9ec4-a42f5f7aed3f tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:51.119246 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2dd8cf4c-45e2-45bd-9ec4-a42f5f7aed3f tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] 10.222.0.35 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.041717 Jun 10 17:59:51.119863 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 375/743] 10.222.0.35 () {58 vars in 1175 bytes} [Fri Jun 10 17:59:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:51.124971 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6818df59-7a0a-4e90-9a03-b9d32ed936d0 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:51.128990 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6818df59-7a0a-4e90-9a03-b9d32ed936d0 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:51.129948 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6818df59-7a0a-4e90-9a03-b9d32ed936d0 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '57b54ed932024f378743fa2d2fc36b53'} {{(pid=126594) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 17:59:51.143713 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6818df59-7a0a-4e90-9a03-b9d32ed936d0 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:51.144178 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6818df59-7a0a-4e90-9a03-b9d32ed936d0 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:51.145015 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6818df59-7a0a-4e90-9a03-b9d32ed936d0 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:51.145645 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6818df59-7a0a-4e90-9a03-b9d32ed936d0 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:51.244400 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.multi_cell_list [None req-6818df59-7a0a-4e90-9a03-b9d32ed936d0 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126594) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 10 17:59:51.324841 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a38260f0-b0f5-4cea-b5de-9394a8de743e tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Action: 'create', calling method: .version_select at 0x7f77c16908b0>, body: {"keypair": {"name": "tempest-keypair-720028016", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGuChX1Tdoj8cIYWB5CTlFQ6SAkUuhpWnhxhOsKlDVcHKhPjdZeo47yup/vmPAjJAQIHPcobq7jWzQZF1r2X411YlApKE1vUF90hn2/+Fkh1KPthSj3OF/m6af1TGfhZpA=="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:51.345372 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-a38260f0-b0f5-4cea-b5de-9394a8de743e tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Getting quotas for project 6bef5526162d4deabec66c63bc34ccc9. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 17:59:51.352806 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-a38260f0-b0f5-4cea-b5de-9394a8de743e tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Getting quotas for user 8ea74fea92314388bf4e41674aa9e6c0 and project 6bef5526162d4deabec66c63bc34ccc9. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 17:59:51.364186 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6818df59-7a0a-4e90-9a03-b9d32ed936d0 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:51.370905 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6818df59-7a0a-4e90-9a03-b9d32ed936d0 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:51.371593 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6818df59-7a0a-4e90-9a03-b9d32ed936d0 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:51.455541 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a38260f0-b0f5-4cea-b5de-9394a8de743e tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.434756 Jun 10 17:59:51.457660 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 369/744] 10.222.0.35 () {62 vars in 1198 bytes} [Fri Jun 10 17:59:51 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 438 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jun 10 17:59:51.469858 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-68428cd5-3b79-48f8-a3cf-a9c06f312ff9 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "chh2-master-2", "block_migration": true, "disk_over_commit": false}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:51.471248 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-68428cd5-3b79-48f8-a3cf-a9c06f312ff9 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] [instance: dea27a27-b11b-445c-b811-e852cd66e197] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:51.478247 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-68428cd5-3b79-48f8-a3cf-a9c06f312ff9 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:51.478700 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-68428cd5-3b79-48f8-a3cf-a9c06f312ff9 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:51.480135 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-68428cd5-3b79-48f8-a3cf-a9c06f312ff9 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:51.480772 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-68428cd5-3b79-48f8-a3cf-a9c06f312ff9 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:51.500476 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6818df59-7a0a-4e90-9a03-b9d32ed936d0 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1516 microversion: 2.1 time: 0.379472 Jun 10 17:59:51.501653 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 376/745] 10.222.0.35 () {58 vars in 1166 bytes} [Fri Jun 10 17:59:51 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1516 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:51.506417 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9b69f97c-0f6f-483f-9fce-0f424cbe02dd tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:51.507301 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9b69f97c-0f6f-483f-9fce-0f424cbe02dd tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:51.525961 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9b69f97c-0f6f-483f-9fce-0f424cbe02dd tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:51.526425 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9b69f97c-0f6f-483f-9fce-0f424cbe02dd tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:51.527221 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9b69f97c-0f6f-483f-9fce-0f424cbe02dd tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:51.527808 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9b69f97c-0f6f-483f-9fce-0f424cbe02dd tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:51.569853 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-68428cd5-3b79-48f8-a3cf-a9c06f312ff9 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lazy-loading 'flavor' on Instance uuid dea27a27-b11b-445c-b811-e852cd66e197 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 17:59:51.586903 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-68428cd5-3b79-48f8-a3cf-a9c06f312ff9 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] [instance: dea27a27-b11b-445c-b811-e852cd66e197] Going to try to live migrate instance to chh2-master-2 {{(pid=126595) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 10 17:59:51.729672 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9b69f97c-0f6f-483f-9fce-0f424cbe02dd tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63889ce9e75140bd9c730857468b7fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce8674b6db3471c8c94e809430651c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:51.737433 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9b69f97c-0f6f-483f-9fce-0f424cbe02dd tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63" status: 200 len: 1366 microversion: 2.1 time: 0.234544 Jun 10 17:59:51.742482 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 377/746] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:51 2022] GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63 => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:51.742662 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-75ccd4bb-d4ac-4c1e-bda0-a2caf35cd748 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Calling method '.version_select at 0x7f77c14601f0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:51.750260 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-75ccd4bb-d4ac-4c1e-bda0-a2caf35cd748 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] 10.222.0.35 "GET /compute/v2.1/os-keypairs/tempest-keypair-720028016" status: 200 len: 511 microversion: 2.2 time: 0.011289 Jun 10 17:59:51.751339 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 378/747] 10.222.0.35 () {60 vars in 1254 bytes} [Fri Jun 10 17:59:51 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-720028016 => generated 511 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:51.761015 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c572dcfd-fda6-46d1-bcd5-e7dcb53e0a01 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:51.769190 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c572dcfd-fda6-46d1-bcd5-e7dcb53e0a01 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:51.769976 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c572dcfd-fda6-46d1-bcd5-e7dcb53e0a01 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1910831609', 'deleted': False, 'project_id': '57b54ed932024f378743fa2d2fc36b53'} {{(pid=126594) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 17:59:51.775233 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c572dcfd-fda6-46d1-bcd5-e7dcb53e0a01 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:51.775680 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c572dcfd-fda6-46d1-bcd5-e7dcb53e0a01 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:51.776505 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c572dcfd-fda6-46d1-bcd5-e7dcb53e0a01 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:51.776949 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c572dcfd-fda6-46d1-bcd5-e7dcb53e0a01 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:51.932270 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.multi_cell_list [None req-c572dcfd-fda6-46d1-bcd5-e7dcb53e0a01 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126594) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 10 17:59:52.015860 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c572dcfd-fda6-46d1-bcd5-e7dcb53e0a01 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:52.022486 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c572dcfd-fda6-46d1-bcd5-e7dcb53e0a01 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:52.023012 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c572dcfd-fda6-46d1-bcd5-e7dcb53e0a01 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:52.221387 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c572dcfd-fda6-46d1-bcd5-e7dcb53e0a01 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1910831609" status: 200 len: 1515 microversion: 2.1 time: 0.464505 Jun 10 17:59:52.235726 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 379/748] 10.222.0.35 () {58 vars in 1262 bytes} [Fri Jun 10 17:59:51 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1910831609 => generated 1515 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:52.410065 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3f74488d-4e86-4001-b28a-2d991426d43e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-685017394", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "abaf7ab8-f0d7-4db9-bc12-3e0ab0d7e41a"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:52.486077 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-3f74488d-4e86-4001-b28a-2d991426d43e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] validate_networks() for [('abaf7ab8-f0d7-4db9-bc12-3e0ab0d7e41a', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 17:59:53.005253 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-3f74488d-4e86-4001-b28a-2d991426d43e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 17:59:53.005717 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-3f74488d-4e86-4001-b28a-2d991426d43e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 17:59:53.006198 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-3f74488d-4e86-4001-b28a-2d991426d43e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 17:59:53.006617 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-3f74488d-4e86-4001-b28a-2d991426d43e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 17:59:53.007034 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-3f74488d-4e86-4001-b28a-2d991426d43e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 17:59:53.017176 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f74488d-4e86-4001-b28a-2d991426d43e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:53.017637 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f74488d-4e86-4001-b28a-2d991426d43e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:53.018446 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f74488d-4e86-4001-b28a-2d991426d43e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:53.018888 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f74488d-4e86-4001-b28a-2d991426d43e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:53.039130 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-3f74488d-4e86-4001-b28a-2d991426d43e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Getting quotas for project 01ee7bcfe44746fda89fda904f81e1b9. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 17:59:53.045213 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-3f74488d-4e86-4001-b28a-2d991426d43e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Getting quotas for user d4967895f6f041058ef60cee35a3659c and project 01ee7bcfe44746fda89fda904f81e1b9. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 17:59:53.057849 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3f74488d-4e86-4001-b28a-2d991426d43e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 17:59:53.060266 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3f74488d-4e86-4001-b28a-2d991426d43e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: 42863b6d-5afb-46d7-9ec6-592145bba6e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 17:59:53.265234 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3f74488d-4e86-4001-b28a-2d991426d43e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.041403 Jun 10 17:59:53.271153 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 380/749] 10.222.0.35 () {62 vars in 1187 bytes} [Fri Jun 10 17:59:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1048 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 10 17:59:53.276139 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d9da28fe-6d4c-466b-aeb2-06142275f950 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Calling method '.version_select at 0x7f77c1b19d30>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:53.366524 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d9da28fe-6d4c-466b-aeb2-06142275f950 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-720028016" status: 204 len: 0 microversion: 2.2 time: 0.093677 Jun 10 17:59:53.375049 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 381/750] 10.222.0.35 () {60 vars in 1257 bytes} [Fri Jun 10 17:59:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-720028016 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 17:59:53.375049 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-40b7b995-bcbe-4e06-800b-df11ffdeacd8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:53.377023 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-40b7b995-bcbe-4e06-800b-df11ffdeacd8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:53.384666 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-40b7b995-bcbe-4e06-800b-df11ffdeacd8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:53.385270 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-40b7b995-bcbe-4e06-800b-df11ffdeacd8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:53.386395 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-40b7b995-bcbe-4e06-800b-df11ffdeacd8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:53.388119 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-40b7b995-bcbe-4e06-800b-df11ffdeacd8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:53.856781 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-40b7b995-bcbe-4e06-800b-df11ffdeacd8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:53.865355 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-40b7b995-bcbe-4e06-800b-df11ffdeacd8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1476 microversion: 2.1 time: 0.496381 Jun 10 17:59:53.866115 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 382/751] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:53 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1476 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:53.920440 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b95141ab-f41c-4429-89e8-f565e4593ee3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-197667053", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:53.972908 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-b95141ab-f41c-4429-89e8-f565e4593ee3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] validate_networks() for None {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 17:59:54.165834 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-b95141ab-f41c-4429-89e8-f565e4593ee3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 17:59:54.166245 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-b95141ab-f41c-4429-89e8-f565e4593ee3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 17:59:54.166751 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-b95141ab-f41c-4429-89e8-f565e4593ee3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 17:59:54.167153 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-b95141ab-f41c-4429-89e8-f565e4593ee3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 17:59:54.167663 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-b95141ab-f41c-4429-89e8-f565e4593ee3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 17:59:54.177227 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b95141ab-f41c-4429-89e8-f565e4593ee3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:54.177687 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b95141ab-f41c-4429-89e8-f565e4593ee3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:54.178578 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b95141ab-f41c-4429-89e8-f565e4593ee3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:54.179222 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b95141ab-f41c-4429-89e8-f565e4593ee3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:54.196049 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-b95141ab-f41c-4429-89e8-f565e4593ee3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Getting quotas for project c36d8cd6f58f415a90f042aff9eddd85. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 17:59:54.200920 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-b95141ab-f41c-4429-89e8-f565e4593ee3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Getting quotas for user 7f050bed1312417f886cdad081809aa1 and project c36d8cd6f58f415a90f042aff9eddd85. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 17:59:54.212738 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b95141ab-f41c-4429-89e8-f565e4593ee3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 17:59:54.214859 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b95141ab-f41c-4429-89e8-f565e4593ee3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 17:59:54.356709 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b95141ab-f41c-4429-89e8-f565e4593ee3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.489346 Jun 10 17:59:54.357681 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 383/752] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:59:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 17:59:54.362127 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-70805e21-4ef5-4a3a-944a-48798a8eff9c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:54.365858 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-70805e21-4ef5-4a3a-944a-48798a8eff9c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:54.366673 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-70805e21-4ef5-4a3a-944a-48798a8eff9c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '57b54ed932024f378743fa2d2fc36b53'} {{(pid=126594) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 17:59:54.374836 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-70805e21-4ef5-4a3a-944a-48798a8eff9c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:54.375458 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-70805e21-4ef5-4a3a-944a-48798a8eff9c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:54.376686 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-70805e21-4ef5-4a3a-944a-48798a8eff9c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:54.377270 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-70805e21-4ef5-4a3a-944a-48798a8eff9c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:54.411548 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-68428cd5-3b79-48f8-a3cf-a9c06f312ff9 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] 10.222.0.35 "POST /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197/action" status: 202 len: 0 microversion: 2.1 time: 2.952635 Jun 10 17:59:54.412346 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 370/753] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 17:59:51 2022] POST /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197/action => generated 0 bytes in 2954 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 17:59:54.419262 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f06bf20b-f33c-4656-a3f0-d8d062c80523 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:54.422258 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f06bf20b-f33c-4656-a3f0-d8d062c80523 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:54.429503 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f06bf20b-f33c-4656-a3f0-d8d062c80523 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:54.430614 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f06bf20b-f33c-4656-a3f0-d8d062c80523 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:54.431522 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f06bf20b-f33c-4656-a3f0-d8d062c80523 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:54.432263 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f06bf20b-f33c-4656-a3f0-d8d062c80523 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:54.510650 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.multi_cell_list [None req-70805e21-4ef5-4a3a-944a-48798a8eff9c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126594) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 10 17:59:54.588773 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-70805e21-4ef5-4a3a-944a-48798a8eff9c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:54.592427 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:59:54.599433 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-70805e21-4ef5-4a3a-944a-48798a8eff9c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:54.599899 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-70805e21-4ef5-4a3a-944a-48798a8eff9c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:54.615825 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f06bf20b-f33c-4656-a3f0-d8d062c80523 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63889ce9e75140bd9c730857468b7fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce8674b6db3471c8c94e809430651c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:54.625655 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f06bf20b-f33c-4656-a3f0-d8d062c80523 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63" status: 200 len: 1366 microversion: 2.1 time: 0.211728 Jun 10 17:59:54.628664 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 371/754] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:54 2022] GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:54.633528 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-9ff44788-dbe0-46b4-8baf-c0be307fc9ad req-1edbedae-f82c-4c75-ac2c-993c3c319a33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63", "tag": "9123aa43-baae-4951-a005-f47283092a90"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:54.642856 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-9ff44788-dbe0-46b4-8baf-c0be307fc9ad req-1edbedae-f82c-4c75-ac2c-993c3c319a33 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:54.643309 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-9ff44788-dbe0-46b4-8baf-c0be307fc9ad req-1edbedae-f82c-4c75-ac2c-993c3c319a33 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:54.654767 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-9ff44788-dbe0-46b4-8baf-c0be307fc9ad req-1edbedae-f82c-4c75-ac2c-993c3c319a33 service nova] Creating event network-changed:9123aa43-baae-4951-a005-f47283092a90 for instance ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63 on chh2-master-2 Jun 10 17:59:54.660245 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-9ff44788-dbe0-46b4-8baf-c0be307fc9ad req-1edbedae-f82c-4c75-ac2c-993c3c319a33 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030239 Jun 10 17:59:54.660896 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 372/755] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:54.665939 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-905b76bf-01c1-4d15-b5d9-522966a8264a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:54.666642 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-905b76bf-01c1-4d15-b5d9-522966a8264a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: 42863b6d-5afb-46d7-9ec6-592145bba6e0] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:54.673028 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-905b76bf-01c1-4d15-b5d9-522966a8264a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:54.673404 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-905b76bf-01c1-4d15-b5d9-522966a8264a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:54.674186 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-905b76bf-01c1-4d15-b5d9-522966a8264a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:54.674628 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-905b76bf-01c1-4d15-b5d9-522966a8264a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:54.738232 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-905b76bf-01c1-4d15-b5d9-522966a8264a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:54.748079 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-905b76bf-01c1-4d15-b5d9-522966a8264a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:54.750170 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-905b76bf-01c1-4d15-b5d9-522966a8264a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:54.752881 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-905b76bf-01c1-4d15-b5d9-522966a8264a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0" status: 200 len: 1265 microversion: 2.25 time: 0.089525 Jun 10 17:59:54.753497 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 373/756] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 17:59:54 2022] GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0 => generated 1265 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 17:59:54.758812 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ddf0260d-fb58-4e5c-926d-23b74ab7fccd tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Action: 'create', calling method: .version_select at 0x7f77c162b940>, body: {"keypair": {"name": "tempest-keypair-1160817526", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCU0Ke+WfRxH6zrPYijhJ92lyOgWHo6P9Z7IKxrK1nHTYSPi13GbNXE7I3wghnsEuT6+bLP3Zq+QjDnyyfu8lQEMd7hBYM1jBGOvF6jbnVAE2EsubcaIDT1vSHUpGjWd8Q=="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:54.765563 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-70805e21-4ef5-4a3a-944a-48798a8eff9c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4521 microversion: 2.1 time: 0.406310 Jun 10 17:59:54.766179 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 384/757] 10.222.0.35 () {58 vars in 1172 bytes} [Fri Jun 10 17:59:54 2022] GET /compute/v2.1/servers/detail?status=active => generated 4521 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:54.771210 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5615bfc6-2007-4bdb-b44d-94a799a5d9a6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:54.771831 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5615bfc6-2007-4bdb-b44d-94a799a5d9a6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: dea27a27-b11b-445c-b811-e852cd66e197] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:54.775097 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-ddf0260d-fb58-4e5c-926d-23b74ab7fccd tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Getting quotas for project 6bef5526162d4deabec66c63bc34ccc9. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 17:59:54.778544 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5615bfc6-2007-4bdb-b44d-94a799a5d9a6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:54.779034 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5615bfc6-2007-4bdb-b44d-94a799a5d9a6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:54.779980 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5615bfc6-2007-4bdb-b44d-94a799a5d9a6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:54.780120 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-ddf0260d-fb58-4e5c-926d-23b74ab7fccd tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Getting quotas for user 8ea74fea92314388bf4e41674aa9e6c0 and project 6bef5526162d4deabec66c63bc34ccc9. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 17:59:54.780490 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5615bfc6-2007-4bdb-b44d-94a799a5d9a6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:54.897100 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ddf0260d-fb58-4e5c-926d-23b74ab7fccd tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.142453 Jun 10 17:59:54.902899 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 374/758] 10.222.0.35 () {62 vars in 1198 bytes} [Fri Jun 10 17:59:54 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 144 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jun 10 17:59:54.907401 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3e89b76c-ab81-4646-8bd6-787ebb349e4f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-278625165", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:54.911582 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5615bfc6-2007-4bdb-b44d-94a799a5d9a6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:54.919452 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5615bfc6-2007-4bdb-b44d-94a799a5d9a6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197" status: 200 len: 1502 microversion: 2.1 time: 0.151918 Jun 10 17:59:54.921089 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 385/759] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:54 2022] GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197 => generated 1502 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:54.930660 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b3a34e2c-141b-41fe-aa41-571362c0413a tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:54.930660 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b3a34e2c-141b-41fe-aa41-571362c0413a tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:54.931098 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.compute.servers [None req-b3a34e2c-141b-41fe-aa41-571362c0413a tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Removing options 'limit' from query {{(pid=126594) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jun 10 17:59:54.932008 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b3a34e2c-141b-41fe-aa41-571362c0413a tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Searching by: {'deleted': False, 'project_id': '57b54ed932024f378743fa2d2fc36b53'} {{(pid=126594) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 17:59:54.938158 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b3a34e2c-141b-41fe-aa41-571362c0413a tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:54.938472 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b3a34e2c-141b-41fe-aa41-571362c0413a tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:54.939327 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b3a34e2c-141b-41fe-aa41-571362c0413a tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:54.939940 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b3a34e2c-141b-41fe-aa41-571362c0413a tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:54.975827 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-3e89b76c-ab81-4646-8bd6-787ebb349e4f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] validate_networks() for None {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 17:59:55.040509 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b3a34e2c-141b-41fe-aa41-571362c0413a tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:55.046950 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b3a34e2c-141b-41fe-aa41-571362c0413a tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:55.047684 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b3a34e2c-141b-41fe-aa41-571362c0413a tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:55.168989 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b3a34e2c-141b-41fe-aa41-571362c0413a tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1662 microversion: 2.1 time: 0.246445 Jun 10 17:59:55.169585 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 386/760] 10.222.0.35 () {58 vars in 1160 bytes} [Fri Jun 10 17:59:54 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1662 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:55.175866 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-af1ba7e2-b67c-41be-b2f9-fa16f89e3e99 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:55.176640 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-af1ba7e2-b67c-41be-b2f9-fa16f89e3e99 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:55.182074 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-3e89b76c-ab81-4646-8bd6-787ebb349e4f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 17:59:55.183798 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-3e89b76c-ab81-4646-8bd6-787ebb349e4f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 17:59:55.185767 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-3e89b76c-ab81-4646-8bd6-787ebb349e4f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 17:59:55.187536 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-3e89b76c-ab81-4646-8bd6-787ebb349e4f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 17:59:55.188020 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-3e89b76c-ab81-4646-8bd6-787ebb349e4f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 17:59:55.189836 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-af1ba7e2-b67c-41be-b2f9-fa16f89e3e99 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:55.190295 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-af1ba7e2-b67c-41be-b2f9-fa16f89e3e99 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:55.191130 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-af1ba7e2-b67c-41be-b2f9-fa16f89e3e99 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:55.191584 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-af1ba7e2-b67c-41be-b2f9-fa16f89e3e99 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:55.197249 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3e89b76c-ab81-4646-8bd6-787ebb349e4f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:55.197695 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3e89b76c-ab81-4646-8bd6-787ebb349e4f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:55.198483 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3e89b76c-ab81-4646-8bd6-787ebb349e4f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:55.201212 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3e89b76c-ab81-4646-8bd6-787ebb349e4f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:55.216335 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-3e89b76c-ab81-4646-8bd6-787ebb349e4f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Getting quotas for project c36d8cd6f58f415a90f042aff9eddd85. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 17:59:55.221852 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-3e89b76c-ab81-4646-8bd6-787ebb349e4f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Getting quotas for user 7f050bed1312417f886cdad081809aa1 and project c36d8cd6f58f415a90f042aff9eddd85. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 17:59:55.234867 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3e89b76c-ab81-4646-8bd6-787ebb349e4f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 17:59:55.237308 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3e89b76c-ab81-4646-8bd6-787ebb349e4f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: 96576f7e-6227-41c7-92fd-30b88f961560] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 17:59:55.321455 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-af1ba7e2-b67c-41be-b2f9-fa16f89e3e99 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:55.329240 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-af1ba7e2-b67c-41be-b2f9-fa16f89e3e99 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1476 microversion: 2.1 time: 0.158513 Jun 10 17:59:55.329831 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 387/761] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:55 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1476 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:55.334198 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-864b8d32-9408-4fd1-b4b0-6e8fefd7f90b tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Calling method '.version_select at 0x7f77c1274af0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:55.385350 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3e89b76c-ab81-4646-8bd6-787ebb349e4f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.485781 Jun 10 17:59:55.386387 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 375/762] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 17:59:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 17:59:55.390973 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a882f7f2-0370-4f01-a251-ed014734e93c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:55.395382 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a882f7f2-0370-4f01-a251-ed014734e93c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:55.396987 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a882f7f2-0370-4f01-a251-ed014734e93c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '57b54ed932024f378743fa2d2fc36b53'} {{(pid=126595) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 17:59:55.398447 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-864b8d32-9408-4fd1-b4b0-6e8fefd7f90b tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1160817526" status: 204 len: 0 microversion: 2.2 time: 0.067595 Jun 10 17:59:55.401425 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 388/763] 10.222.0.35 () {60 vars in 1260 bytes} [Fri Jun 10 17:59:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1160817526 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 17:59:55.406275 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9842cfae-966d-4d0d-9ff2-1d29410321cc tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:55.412081 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9842cfae-966d-4d0d-9ff2-1d29410321cc tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: 96576f7e-6227-41c7-92fd-30b88f961560] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:55.412326 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a882f7f2-0370-4f01-a251-ed014734e93c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:55.412326 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a882f7f2-0370-4f01-a251-ed014734e93c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:55.412326 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a882f7f2-0370-4f01-a251-ed014734e93c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:55.412326 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a882f7f2-0370-4f01-a251-ed014734e93c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:55.478145 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9842cfae-966d-4d0d-9ff2-1d29410321cc tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:55.486461 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9842cfae-966d-4d0d-9ff2-1d29410321cc tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560" status: 200 len: 1213 microversion: 2.1 time: 0.084008 Jun 10 17:59:55.487258 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 389/764] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:55 2022] GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:55.501080 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f859f0ab-136e-464d-b0cb-9ecddafe1a9a tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Action: 'create', calling method: .version_select at 0x7f77c11cc040>, body: {"keypair": {"name": "tempest-keypair-107318779", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:55.516071 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-f859f0ab-136e-464d-b0cb-9ecddafe1a9a tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Getting quotas for project 6bef5526162d4deabec66c63bc34ccc9. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 17:59:55.521354 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-f859f0ab-136e-464d-b0cb-9ecddafe1a9a tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Getting quotas for user 8ea74fea92314388bf4e41674aa9e6c0 and project 6bef5526162d4deabec66c63bc34ccc9. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 17:59:55.525757 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.multi_cell_list [None req-a882f7f2-0370-4f01-a251-ed014734e93c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126595) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 10 17:59:55.629091 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a882f7f2-0370-4f01-a251-ed014734e93c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers?status=active" status: 200 len: 1012 microversion: 2.1 time: 0.241550 Jun 10 17:59:55.629674 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 376/765] 10.222.0.35 () {58 vars in 1151 bytes} [Fri Jun 10 17:59:55 2022] GET /compute/v2.1/servers?status=active => generated 1012 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:55.641558 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b8644cd0-00f9-4216-af86-49ec051672d4 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:55.645220 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b8644cd0-00f9-4216-af86-49ec051672d4 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:55.645679 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.compute.servers [None req-b8644cd0-00f9-4216-af86-49ec051672d4 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Removing options 'limit' from query {{(pid=126595) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jun 10 17:59:55.646319 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b8644cd0-00f9-4216-af86-49ec051672d4 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Searching by: {'deleted': False, 'project_id': '57b54ed932024f378743fa2d2fc36b53'} {{(pid=126595) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 17:59:55.651552 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b8644cd0-00f9-4216-af86-49ec051672d4 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:55.652003 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b8644cd0-00f9-4216-af86-49ec051672d4 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:55.652833 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b8644cd0-00f9-4216-af86-49ec051672d4 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:55.653458 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b8644cd0-00f9-4216-af86-49ec051672d4 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:55.677316 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f859f0ab-136e-464d-b0cb-9ecddafe1a9a tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.179108 Jun 10 17:59:55.678390 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 390/766] 10.222.0.35 () {62 vars in 1198 bytes} [Fri Jun 10 17:59:55 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 191 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jun 10 17:59:55.684240 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6d6505e1-e492-4757-a808-1cbfdc5dc491 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:55.684877 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6d6505e1-e492-4757-a808-1cbfdc5dc491 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:55.692470 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6d6505e1-e492-4757-a808-1cbfdc5dc491 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:55.693383 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6d6505e1-e492-4757-a808-1cbfdc5dc491 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:55.694375 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6d6505e1-e492-4757-a808-1cbfdc5dc491 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:55.694961 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6d6505e1-e492-4757-a808-1cbfdc5dc491 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:55.741278 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.multi_cell_list [None req-b8644cd0-00f9-4216-af86-49ec051672d4 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126595) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 10 17:59:55.815683 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b8644cd0-00f9-4216-af86-49ec051672d4 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1012 microversion: 2.1 time: 0.178485 Jun 10 17:59:55.816274 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 377/767] 10.222.0.35 () {58 vars in 1149 bytes} [Fri Jun 10 17:59:55 2022] GET /compute/v2.1/servers?limit=100000 => generated 1012 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 17:59:55.821344 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3aa39cb6-a916-4dda-b6d4-4a320b77e019 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Calling method '.version_select at 0x7f77c1622c10>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:55.883342 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6d6505e1-e492-4757-a808-1cbfdc5dc491 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63889ce9e75140bd9c730857468b7fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce8674b6db3471c8c94e809430651c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:55.893446 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6d6505e1-e492-4757-a808-1cbfdc5dc491 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63" status: 200 len: 1366 microversion: 2.1 time: 0.213815 Jun 10 17:59:55.894041 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 391/768] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:55 2022] GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:55.899511 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-12f69d76-e3d7-47a6-a51b-a172500b7895 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:55.901001 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-12f69d76-e3d7-47a6-a51b-a172500b7895 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: 42863b6d-5afb-46d7-9ec6-592145bba6e0] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:55.905209 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3aa39cb6-a916-4dda-b6d4-4a320b77e019 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-107318779" status: 204 len: 0 microversion: 2.2 time: 0.087291 Jun 10 17:59:55.906923 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 378/769] 10.222.0.35 () {60 vars in 1257 bytes} [Fri Jun 10 17:59:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-107318779 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 17:59:55.910257 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-12f69d76-e3d7-47a6-a51b-a172500b7895 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:55.910810 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-12f69d76-e3d7-47a6-a51b-a172500b7895 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:55.911793 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-12f69d76-e3d7-47a6-a51b-a172500b7895 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:55.912237 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-12f69d76-e3d7-47a6-a51b-a172500b7895 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:55.912617 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6da0ca31-c9ec-4a98-a976-e175c3a8abf4 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:55.916131 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6da0ca31-c9ec-4a98-a976-e175c3a8abf4 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:55.916946 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6da0ca31-c9ec-4a98-a976-e175c3a8abf4 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Searching by: {'deleted': False, 'project_id': '57b54ed932024f378743fa2d2fc36b53'} {{(pid=126595) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 17:59:55.922371 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6da0ca31-c9ec-4a98-a976-e175c3a8abf4 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:55.922929 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6da0ca31-c9ec-4a98-a976-e175c3a8abf4 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:55.923708 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6da0ca31-c9ec-4a98-a976-e175c3a8abf4 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:55.924141 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6da0ca31-c9ec-4a98-a976-e175c3a8abf4 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:55.953033 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.multi_cell_list [None req-6da0ca31-c9ec-4a98-a976-e175c3a8abf4 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126595) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 10 17:59:55.982055 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6da0ca31-c9ec-4a98-a976-e175c3a8abf4 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers" status: 200 len: 1012 microversion: 2.1 time: 0.073872 Jun 10 17:59:55.982635 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 379/770] 10.222.0.35 () {58 vars in 1124 bytes} [Fri Jun 10 17:59:55 2022] GET /compute/v2.1/servers => generated 1012 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:55.987612 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9506a44c-8031-413a-aaef-768b32c6d217 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Action: 'create', calling method: .version_select at 0x7f77c1690550>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1586083109", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMbk8Qzp6HN4xJEJVQ/lpZRDOrzEVgw0vJdG4HYxTJSnFbqQ0ocWl8W0/hetRoD5mDcEz2YPViPU7XJydWTHL+izVEj58nWuOuc6nfIJ1F6ZWJnql2CvXUIiKipnePj1Q=="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:55.991798 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-12f69d76-e3d7-47a6-a51b-a172500b7895 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:56.000548 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-12f69d76-e3d7-47a6-a51b-a172500b7895 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:56.002763 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-9506a44c-8031-413a-aaef-768b32c6d217 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Getting quotas for project 6bef5526162d4deabec66c63bc34ccc9. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 17:59:56.002892 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-12f69d76-e3d7-47a6-a51b-a172500b7895 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:56.003922 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-12f69d76-e3d7-47a6-a51b-a172500b7895 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0" status: 200 len: 1321 microversion: 2.25 time: 0.108378 Jun 10 17:59:56.004694 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 392/771] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 17:59:55 2022] GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0 => generated 1321 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 17:59:56.008913 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ba200629-3fdf-4253-aeb6-7a92b03ee108 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:56.009517 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ba200629-3fdf-4253-aeb6-7a92b03ee108 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: dea27a27-b11b-445c-b811-e852cd66e197] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:56.016087 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-9506a44c-8031-413a-aaef-768b32c6d217 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Getting quotas for user 8ea74fea92314388bf4e41674aa9e6c0 and project 6bef5526162d4deabec66c63bc34ccc9. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 17:59:56.016557 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ba200629-3fdf-4253-aeb6-7a92b03ee108 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:56.017094 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ba200629-3fdf-4253-aeb6-7a92b03ee108 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:56.028513 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ba200629-3fdf-4253-aeb6-7a92b03ee108 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:56.028513 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ba200629-3fdf-4253-aeb6-7a92b03ee108 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:56.112250 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9506a44c-8031-413a-aaef-768b32c6d217 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.128543 Jun 10 17:59:56.114257 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 380/772] 10.222.0.35 () {62 vars in 1198 bytes} [Fri Jun 10 17:59:55 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 131 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jun 10 17:59:56.120109 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b8a1e34f-71b6-4c94-a5e9-3dcf81f0ed32 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:56.125103 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b8a1e34f-71b6-4c94-a5e9-3dcf81f0ed32 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:56.127404 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b8a1e34f-71b6-4c94-a5e9-3dcf81f0ed32 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '57b54ed932024f378743fa2d2fc36b53'} {{(pid=126595) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 17:59:56.143980 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b8a1e34f-71b6-4c94-a5e9-3dcf81f0ed32 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:56.145343 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b8a1e34f-71b6-4c94-a5e9-3dcf81f0ed32 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:56.146095 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b8a1e34f-71b6-4c94-a5e9-3dcf81f0ed32 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:56.147523 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b8a1e34f-71b6-4c94-a5e9-3dcf81f0ed32 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:56.212976 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ba200629-3fdf-4253-aeb6-7a92b03ee108 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:56.222475 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ba200629-3fdf-4253-aeb6-7a92b03ee108 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197" status: 200 len: 1502 microversion: 2.1 time: 0.216888 Jun 10 17:59:56.223689 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 393/773] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:56 2022] GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197 => generated 1502 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:56.236895 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9959b283-a8ae-4937-922f-feae6f596ae4 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Action: 'create', calling method: .version_select at 0x7f77c0ef3c10>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-360180941", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJsTDdZZoigZqfyKRX+C4y9NTJHUGd1G9XsfktQk9qxEbGNP786LiFSOrVOnuXLqjMYr3CKYe4vUNcVv7h83/62fM5yqWbjEbjsVCDctOF8+xsCSwBHN565QwrsAqfOSaA=="}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:56.252682 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-9959b283-a8ae-4937-922f-feae6f596ae4 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Getting quotas for project 6bef5526162d4deabec66c63bc34ccc9. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 17:59:56.261520 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.multi_cell_list [None req-b8a1e34f-71b6-4c94-a5e9-3dcf81f0ed32 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126595) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 10 17:59:56.277979 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-9959b283-a8ae-4937-922f-feae6f596ae4 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Getting quotas for user 8ea74fea92314388bf4e41674aa9e6c0 and project 6bef5526162d4deabec66c63bc34ccc9. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 17:59:56.400703 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9959b283-a8ae-4937-922f-feae6f596ae4 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.175603 Jun 10 17:59:56.404011 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 394/774] 10.222.0.35 () {62 vars in 1198 bytes} [Fri Jun 10 17:59:56 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 180 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jun 10 17:59:56.415636 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a459693e-d8c8-4da1-93cd-2607004ff965 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:56.416711 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a459693e-d8c8-4da1-93cd-2607004ff965 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:56.434222 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a459693e-d8c8-4da1-93cd-2607004ff965 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:56.435013 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a459693e-d8c8-4da1-93cd-2607004ff965 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:56.435831 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a459693e-d8c8-4da1-93cd-2607004ff965 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:56.436247 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a459693e-d8c8-4da1-93cd-2607004ff965 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:56.474504 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:59:56.534177 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b8a1e34f-71b6-4c94-a5e9-3dcf81f0ed32 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.418583 Jun 10 17:59:56.535137 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 381/775] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 17:59:56 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:56.539740 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a95cffaa-ea4e-4cd3-8e1a-9102cf0dbd9b tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Action: 'create', calling method: .version_select at 0x7f77c161daf0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1253198567", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO07zrJjhswEC8392LVdM1NqywRHPfrEHYCIGYma73+juoCBxwNV7cuTAk9REmFZGV2KZVhOiiTDoq3xay9MfvPUrWyoC8p+wxVbIMucjT0eQ1BXEJiAO5rAqeP/xzvDhA=="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:56.545403 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:59:56.555060 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-a95cffaa-ea4e-4cd3-8e1a-9102cf0dbd9b tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Getting quotas for project 6bef5526162d4deabec66c63bc34ccc9. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 17:59:56.559980 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-a95cffaa-ea4e-4cd3-8e1a-9102cf0dbd9b tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Getting quotas for user 8ea74fea92314388bf4e41674aa9e6c0 and project 6bef5526162d4deabec66c63bc34ccc9. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 17:59:56.693503 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a95cffaa-ea4e-4cd3-8e1a-9102cf0dbd9b tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.156829 Jun 10 17:59:56.694227 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 382/776] 10.222.0.35 () {62 vars in 1198 bytes} [Fri Jun 10 17:59:56 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 158 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jun 10 17:59:56.699759 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4fb4035a-00c3-477a-b3f8-8e00114eaaa6 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:56.700420 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4fb4035a-00c3-477a-b3f8-8e00114eaaa6 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: 96576f7e-6227-41c7-92fd-30b88f961560] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:56.710196 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4fb4035a-00c3-477a-b3f8-8e00114eaaa6 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:56.710649 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4fb4035a-00c3-477a-b3f8-8e00114eaaa6 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:56.711435 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4fb4035a-00c3-477a-b3f8-8e00114eaaa6 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:56.711871 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4fb4035a-00c3-477a-b3f8-8e00114eaaa6 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:56.783989 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4fb4035a-00c3-477a-b3f8-8e00114eaaa6 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:56.791799 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4fb4035a-00c3-477a-b3f8-8e00114eaaa6 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560" status: 200 len: 1217 microversion: 2.1 time: 0.096346 Jun 10 17:59:56.801198 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 383/777] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:56 2022] GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560 => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:56.801198 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-25bb67c8-4377-40aa-96f7-e4d7500c9cf3 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:56.801602 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a459693e-d8c8-4da1-93cd-2607004ff965 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:56.801703 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-25bb67c8-4377-40aa-96f7-e4d7500c9cf3 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:56.801703 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.compute.servers [None req-25bb67c8-4377-40aa-96f7-e4d7500c9cf3 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Removing options 'limit' from query {{(pid=126595) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jun 10 17:59:56.802401 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-25bb67c8-4377-40aa-96f7-e4d7500c9cf3 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Searching by: {'deleted': False, 'project_id': '57b54ed932024f378743fa2d2fc36b53'} {{(pid=126595) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 17:59:56.807702 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-25bb67c8-4377-40aa-96f7-e4d7500c9cf3 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:56.808066 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a459693e-d8c8-4da1-93cd-2607004ff965 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1476 microversion: 2.1 time: 0.402549 Jun 10 17:59:56.808178 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-25bb67c8-4377-40aa-96f7-e4d7500c9cf3 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:56.817594 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-25bb67c8-4377-40aa-96f7-e4d7500c9cf3 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:56.817793 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 395/778] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:56 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1476 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:56.817903 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-25bb67c8-4377-40aa-96f7-e4d7500c9cf3 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:56.817984 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5f111afa-4da2-4d3e-8a6e-236cbd1de8f3 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Calling method '.version_select at 0x7f77c1274ee0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:56.819724 chdv-master-2 devstack@n-api.service[126594]: WARNING oslo_db.sqlalchemy.utils [None req-5f111afa-4da2-4d3e-8a6e-236cbd1de8f3 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Unique keys not in sort_keys. The sorting order may be unstable. Jun 10 17:59:56.825535 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5f111afa-4da2-4d3e-8a6e-236cbd1de8f3 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] 10.222.0.35 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.014726 Jun 10 17:59:56.826302 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 396/779] 10.222.0.35 () {60 vars in 1176 bytes} [Fri Jun 10 17:59:56 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:56.837314 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4c90b3c0-d87b-4023-b1fc-f1aed81ad8d9 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Calling method '.version_select at 0x7f77c12c44c0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:56.840060 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-25bb67c8-4377-40aa-96f7-e4d7500c9cf3 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.045932 Jun 10 17:59:56.847777 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 384/780] 10.222.0.35 () {58 vars in 1139 bytes} [Fri Jun 10 17:59:56 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:56.852851 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-11710fee-20df-42b1-979d-c596b4050174 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:56.857023 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-11710fee-20df-42b1-979d-c596b4050174 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:56.857695 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-11710fee-20df-42b1-979d-c596b4050174 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1910831609', 'deleted': False, 'project_id': '57b54ed932024f378743fa2d2fc36b53'} {{(pid=126595) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 17:59:56.863395 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-11710fee-20df-42b1-979d-c596b4050174 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:56.863855 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-11710fee-20df-42b1-979d-c596b4050174 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:56.864692 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-11710fee-20df-42b1-979d-c596b4050174 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:56.865135 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-11710fee-20df-42b1-979d-c596b4050174 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:56.939494 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4c90b3c0-d87b-4023-b1fc-f1aed81ad8d9 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1253198567" status: 204 len: 0 microversion: 2.2 time: 0.106533 Jun 10 17:59:56.942392 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 397/781] 10.222.0.35 () {60 vars in 1320 bytes} [Fri Jun 10 17:59:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1253198567 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 17:59:56.948751 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fa819190-eac8-47e8-87f9-5ede4ebde73c tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:56.949911 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fa819190-eac8-47e8-87f9-5ede4ebde73c tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:56.963785 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.multi_cell_list [None req-11710fee-20df-42b1-979d-c596b4050174 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126595) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 10 17:59:56.978933 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fa819190-eac8-47e8-87f9-5ede4ebde73c tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:56.979511 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fa819190-eac8-47e8-87f9-5ede4ebde73c tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:56.980519 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fa819190-eac8-47e8-87f9-5ede4ebde73c tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:56.983407 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fa819190-eac8-47e8-87f9-5ede4ebde73c tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:57.040006 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:59:57.042194 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-11710fee-20df-42b1-979d-c596b4050174 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1910831609" status: 200 len: 346 microversion: 2.1 time: 0.193287 Jun 10 17:59:57.043177 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 385/782] 10.222.0.35 () {58 vars in 1241 bytes} [Fri Jun 10 17:59:56 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1910831609 => generated 346 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:57.056956 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1c74d3b9-8678-4bd6-aa1f-00ac18a87179 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Calling method '.version_select at 0x7f77c1618e50>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:57.171107 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1c74d3b9-8678-4bd6-aa1f-00ac18a87179 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-360180941" status: 204 len: 0 microversion: 2.2 time: 0.126531 Jun 10 17:59:57.172443 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 386/783] 10.222.0.35 () {60 vars in 1317 bytes} [Fri Jun 10 17:59:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-360180941 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 17:59:57.184006 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f3c00623-2768-452c-ba09-e9f35b7c4878 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:57.186169 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f3c00623-2768-452c-ba09-e9f35b7c4878 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: 42863b6d-5afb-46d7-9ec6-592145bba6e0] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:57.206906 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f3c00623-2768-452c-ba09-e9f35b7c4878 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:57.207490 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f3c00623-2768-452c-ba09-e9f35b7c4878 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:57.208640 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f3c00623-2768-452c-ba09-e9f35b7c4878 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:57.209081 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f3c00623-2768-452c-ba09-e9f35b7c4878 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:57.357115 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fa819190-eac8-47e8-87f9-5ede4ebde73c tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63889ce9e75140bd9c730857468b7fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce8674b6db3471c8c94e809430651c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:57.368144 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fa819190-eac8-47e8-87f9-5ede4ebde73c tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63" status: 200 len: 1366 microversion: 2.1 time: 0.424153 Jun 10 17:59:57.369584 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 398/784] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:56 2022] GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63 => generated 1366 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:57.377306 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-26ad0f23-2178-4bcb-ac43-010ef9fc1e52 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:57.385231 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-26ad0f23-2178-4bcb-ac43-010ef9fc1e52 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:57.386761 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-26ad0f23-2178-4bcb-ac43-010ef9fc1e52 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:57.427901 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f3c00623-2768-452c-ba09-e9f35b7c4878 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:57.438697 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f3c00623-2768-452c-ba09-e9f35b7c4878 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:57.440757 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f3c00623-2768-452c-ba09-e9f35b7c4878 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:57.443825 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f3c00623-2768-452c-ba09-e9f35b7c4878 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0" status: 200 len: 1361 microversion: 2.25 time: 0.269535 Jun 10 17:59:57.444652 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 387/785] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 17:59:57 2022] GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0 => generated 1361 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 17:59:57.449559 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cc53d73b-f5a6-403b-a61a-a9524f172f27 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Calling method '.version_select at 0x7f77c1618a60>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:57.464838 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-26ad0f23-2178-4bcb-ac43-010ef9fc1e52 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: f4f44795-d87b-4032-a9b4-4ce68336f264] Going to try to stop instance {{(pid=126594) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 10 17:59:57.552730 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cc53d73b-f5a6-403b-a61a-a9524f172f27 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1586083109" status: 204 len: 0 microversion: 2.2 time: 0.106705 Jun 10 17:59:57.554049 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 388/786] 10.222.0.35 () {60 vars in 1320 bytes} [Fri Jun 10 17:59:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1586083109 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 17:59:57.564349 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6a7fd05a-daa5-4800-b77a-9d482dc8509b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:57.565080 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6a7fd05a-daa5-4800-b77a-9d482dc8509b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: dea27a27-b11b-445c-b811-e852cd66e197] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:57.572335 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a7fd05a-daa5-4800-b77a-9d482dc8509b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:57.573034 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a7fd05a-daa5-4800-b77a-9d482dc8509b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:57.573907 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a7fd05a-daa5-4800-b77a-9d482dc8509b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:57.574351 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a7fd05a-daa5-4800-b77a-9d482dc8509b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:57.674690 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-26ad0f23-2178-4bcb-ac43-010ef9fc1e52 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "POST /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264/action" status: 202 len: 0 microversion: 2.1 time: 0.303294 Jun 10 17:59:57.675598 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 399/787] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 17:59:57 2022] POST /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 17:59:57.680931 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4ff36c15-7527-4c44-b0b7-38b59730aef9 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Action: 'create', calling method: .version_select at 0x7f77c1472b80>, body: {"keypair": {"name": "tempest-keypair-1832324009", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDnCROU9IjXo9XhEvMhcF3NLHxV/twWMl7geO7fROufFUce54GHft5N43VkI0xRbIlkmfiXiQt0qQpKI+P4T9al5RQtygRd701o0q0GfKO5jzNNwVh/V/e7docNLHwHhQ=="}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:57.695775 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-4ff36c15-7527-4c44-b0b7-38b59730aef9 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Getting quotas for project 6bef5526162d4deabec66c63bc34ccc9. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 17:59:57.701205 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-4ff36c15-7527-4c44-b0b7-38b59730aef9 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Getting quotas for user 8ea74fea92314388bf4e41674aa9e6c0 and project 6bef5526162d4deabec66c63bc34ccc9. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 17:59:57.786448 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6a7fd05a-daa5-4800-b77a-9d482dc8509b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:57.790716 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4ff36c15-7527-4c44-b0b7-38b59730aef9 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.113638 Jun 10 17:59:57.792426 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 400/788] 10.222.0.35 () {62 vars in 1198 bytes} [Fri Jun 10 17:59:57 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 116 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jun 10 17:59:57.798222 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6504bee0-88e2-4589-83f4-15eb1874dfbb tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:57.799370 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6504bee0-88e2-4589-83f4-15eb1874dfbb tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: f4f44795-d87b-4032-a9b4-4ce68336f264] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:57.808723 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6504bee0-88e2-4589-83f4-15eb1874dfbb tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:57.809185 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6504bee0-88e2-4589-83f4-15eb1874dfbb tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:57.810315 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6a7fd05a-daa5-4800-b77a-9d482dc8509b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197" status: 200 len: 1502 microversion: 2.1 time: 0.255296 Jun 10 17:59:57.810438 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6504bee0-88e2-4589-83f4-15eb1874dfbb tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:57.810754 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6504bee0-88e2-4589-83f4-15eb1874dfbb tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:57.820374 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 389/789] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:57 2022] GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197 => generated 1502 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:57.821390 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0335739c-44af-4c21-8f27-2ec24b01c2d5 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Calling method '.version_select at 0x7f77c16dd040>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:57.837494 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0335739c-44af-4c21-8f27-2ec24b01c2d5 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] 10.222.0.35 "GET /compute/v2.1/os-keypairs/tempest-keypair-1832324009" status: 200 len: 513 microversion: 2.2 time: 0.019982 Jun 10 17:59:57.838133 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 390/790] 10.222.0.35 () {60 vars in 1257 bytes} [Fri Jun 10 17:59:57 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1832324009 => generated 513 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:57.848516 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4c9f4687-d275-4a7d-bc22-36189fa3bdde tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:57.849259 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4c9f4687-d275-4a7d-bc22-36189fa3bdde tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: 96576f7e-6227-41c7-92fd-30b88f961560] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:57.855407 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4c9f4687-d275-4a7d-bc22-36189fa3bdde tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:57.856148 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4c9f4687-d275-4a7d-bc22-36189fa3bdde tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:57.856847 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4c9f4687-d275-4a7d-bc22-36189fa3bdde tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:57.857356 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4c9f4687-d275-4a7d-bc22-36189fa3bdde tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:57.960178 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4c9f4687-d275-4a7d-bc22-36189fa3bdde tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:57.969960 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4c9f4687-d275-4a7d-bc22-36189fa3bdde tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560" status: 200 len: 1265 microversion: 2.1 time: 0.124976 Jun 10 17:59:57.971141 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 391/791] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:57 2022] GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560 => generated 1265 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:57.986517 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-487b54da-deeb-4ad3-a919-879dfed4da0f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:57.987449 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-487b54da-deeb-4ad3-a919-879dfed4da0f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:58.007133 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-487b54da-deeb-4ad3-a919-879dfed4da0f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:58.007938 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-487b54da-deeb-4ad3-a919-879dfed4da0f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:58.011817 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-487b54da-deeb-4ad3-a919-879dfed4da0f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:58.011817 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-487b54da-deeb-4ad3-a919-879dfed4da0f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:58.040172 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6504bee0-88e2-4589-83f4-15eb1874dfbb tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:58.051019 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6504bee0-88e2-4589-83f4-15eb1874dfbb tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264" status: 200 len: 1522 microversion: 2.1 time: 0.257894 Jun 10 17:59:58.063340 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 401/792] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:57 2022] GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:58.073050 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-033d7694-4a19-4b7c-9338-52e9dbd43dac tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Calling method '.version_select at 0x7f77c1472160>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:58.077787 chdv-master-2 devstack@n-api.service[126594]: WARNING oslo_db.sqlalchemy.utils [None req-033d7694-4a19-4b7c-9338-52e9dbd43dac tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Unique keys not in sort_keys. The sorting order may be unstable. Jun 10 17:59:58.083207 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-033d7694-4a19-4b7c-9338-52e9dbd43dac tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] 10.222.0.35 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.017320 Jun 10 17:59:58.083848 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 402/793] 10.222.0.35 () {60 vars in 1176 bytes} [Fri Jun 10 17:59:58 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:58.089764 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-2b498189-053a-4651-ab82-5281dca2ef03 req-6abba5a8-7865-46c4-9cf4-4cc1cabf4edb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42863b6d-5afb-46d7-9ec6-592145bba6e0", "tag": "67e4d336-b9e8-43b3-8284-8dc5d8f3355b"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:58.099943 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-2b498189-053a-4651-ab82-5281dca2ef03 req-6abba5a8-7865-46c4-9cf4-4cc1cabf4edb service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:58.100499 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-2b498189-053a-4651-ab82-5281dca2ef03 req-6abba5a8-7865-46c4-9cf4-4cc1cabf4edb service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:58.111804 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-2b498189-053a-4651-ab82-5281dca2ef03 req-6abba5a8-7865-46c4-9cf4-4cc1cabf4edb service nova] Creating event network-changed:67e4d336-b9e8-43b3-8284-8dc5d8f3355b for instance 42863b6d-5afb-46d7-9ec6-592145bba6e0 on chh1-master-2 Jun 10 17:59:58.116756 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-2b498189-053a-4651-ab82-5281dca2ef03 req-6abba5a8-7865-46c4-9cf4-4cc1cabf4edb service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031587 Jun 10 17:59:58.117610 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 403/794] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:58.122958 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b4dce35d-e363-4c11-9a5b-629812d2af3f tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Calling method '.version_select at 0x7f77c1472e50>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:58.250417 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b4dce35d-e363-4c11-9a5b-629812d2af3f tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1832324009" status: 204 len: 0 microversion: 2.2 time: 0.131200 Jun 10 17:59:58.260807 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 404/795] 10.222.0.35 () {60 vars in 1260 bytes} [Fri Jun 10 17:59:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1832324009 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 17:59:58.267603 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2c0fc78a-d580-4ac1-9901-92fda7256e64 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Action: 'create', calling method: .version_select at 0x7f77c0f14dc0>, body: {"keypair": {"name": "tempest-keypair-527949485", "type": "x509"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:58.292194 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-2c0fc78a-d580-4ac1-9901-92fda7256e64 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Getting quotas for project 6bef5526162d4deabec66c63bc34ccc9. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 17:59:58.300447 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-2c0fc78a-d580-4ac1-9901-92fda7256e64 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Getting quotas for user 8ea74fea92314388bf4e41674aa9e6c0 and project 6bef5526162d4deabec66c63bc34ccc9. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 17:59:58.324418 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.processutils [None req-2c0fc78a-d580-4ac1-9901-92fda7256e64 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp1vogql7w/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp1vogql7w/temp.key -subj /CN=8ea74fea92314388bf4e41674aa9e6c0 -extensions v3_req_client {{(pid=126594) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 10 17:59:58.522035 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-487b54da-deeb-4ad3-a919-879dfed4da0f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:58.540698 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-487b54da-deeb-4ad3-a919-879dfed4da0f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1476 microversion: 2.1 time: 0.559351 Jun 10 17:59:58.552716 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 392/796] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:57 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1476 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:58.558099 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.processutils [None req-2c0fc78a-d580-4ac1-9901-92fda7256e64 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp1vogql7w/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp1vogql7w/temp.key -subj /CN=8ea74fea92314388bf4e41674aa9e6c0 -extensions v3_req_client" returned: 0 in 0.233s {{(pid=126594) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 10 17:59:58.558592 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4c3128ff-064e-42db-ab56-0b8ea54be0c2 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:58.559028 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4c3128ff-064e-42db-ab56-0b8ea54be0c2 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:58.559643 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.processutils [None req-2c0fc78a-d580-4ac1-9901-92fda7256e64 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp1vogql7w/temp.key -password pass: {{(pid=126594) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 10 17:59:58.567109 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4c3128ff-064e-42db-ab56-0b8ea54be0c2 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:58.568014 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4c3128ff-064e-42db-ab56-0b8ea54be0c2 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:58.570308 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4c3128ff-064e-42db-ab56-0b8ea54be0c2 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:58.570778 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4c3128ff-064e-42db-ab56-0b8ea54be0c2 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:58.594671 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.processutils [None req-2c0fc78a-d580-4ac1-9901-92fda7256e64 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp1vogql7w/temp.key -password pass:" returned: 0 in 0.034s {{(pid=126594) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 10 17:59:58.765408 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-2c0fc78a-d580-4ac1-9901-92fda7256e64 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Getting quotas for project 6bef5526162d4deabec66c63bc34ccc9. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 17:59:58.771162 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-2c0fc78a-d580-4ac1-9901-92fda7256e64 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Getting quotas for user 8ea74fea92314388bf4e41674aa9e6c0 and project 6bef5526162d4deabec66c63bc34ccc9. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 17:59:58.775047 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 17:59:58.793503 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2c0fc78a-d580-4ac1-9901-92fda7256e64 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.531161 Jun 10 17:59:58.805193 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 405/797] 10.222.0.35 () {62 vars in 1197 bytes} [Fri Jun 10 17:59:58 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 543 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jun 10 17:59:58.811006 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-368c434b-575e-4776-ad72-fba60ec6b5eb tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:58.812296 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-368c434b-575e-4776-ad72-fba60ec6b5eb tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: 42863b6d-5afb-46d7-9ec6-592145bba6e0] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:58.817488 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4c3128ff-064e-42db-ab56-0b8ea54be0c2 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63889ce9e75140bd9c730857468b7fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce8674b6db3471c8c94e809430651c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:58.825493 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4c3128ff-064e-42db-ab56-0b8ea54be0c2 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63" status: 200 len: 1366 microversion: 2.1 time: 0.271196 Jun 10 17:59:58.828449 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 393/798] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:58 2022] GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63 => generated 1366 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:58.839381 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-41627712-82c6-457f-bb1d-4036b9b4b057 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Calling method '.version_select at 0x7f77c16ffee0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:58.840023 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-368c434b-575e-4776-ad72-fba60ec6b5eb tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:58.844476 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-368c434b-575e-4776-ad72-fba60ec6b5eb tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:58.845462 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-368c434b-575e-4776-ad72-fba60ec6b5eb tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:58.845985 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-368c434b-575e-4776-ad72-fba60ec6b5eb tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:58.855349 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-41627712-82c6-457f-bb1d-4036b9b4b057 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] 10.222.0.35 "GET /compute/v2.1/os-keypairs/tempest-keypair-527949485" status: 200 len: 1533 microversion: 2.2 time: 0.025948 Jun 10 17:59:58.864766 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 394/799] 10.222.0.35 () {60 vars in 1254 bytes} [Fri Jun 10 17:59:58 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-527949485 => generated 1533 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:58.885161 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b706e3b1-608c-46cc-ad5a-19090626e73b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:58.885783 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b706e3b1-608c-46cc-ad5a-19090626e73b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: dea27a27-b11b-445c-b811-e852cd66e197] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:58.897521 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b706e3b1-608c-46cc-ad5a-19090626e73b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:58.900968 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b706e3b1-608c-46cc-ad5a-19090626e73b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:58.900968 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b706e3b1-608c-46cc-ad5a-19090626e73b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:58.900968 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b706e3b1-608c-46cc-ad5a-19090626e73b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:59.102499 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b706e3b1-608c-46cc-ad5a-19090626e73b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:59.113092 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b706e3b1-608c-46cc-ad5a-19090626e73b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197" status: 200 len: 1502 microversion: 2.1 time: 0.247058 Jun 10 17:59:59.118928 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 395/800] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:58 2022] GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197 => generated 1502 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:59.119177 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fed73504-cfbe-41be-b746-2fda87a02a46 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Calling method '.version_select at 0x7f77c18c95e0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:59.122716 chdv-master-2 devstack@n-api.service[126595]: WARNING oslo_db.sqlalchemy.utils [None req-fed73504-cfbe-41be-b746-2fda87a02a46 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Unique keys not in sort_keys. The sorting order may be unstable. Jun 10 17:59:59.131319 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fed73504-cfbe-41be-b746-2fda87a02a46 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] 10.222.0.35 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.016319 Jun 10 17:59:59.136684 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 396/801] 10.222.0.35 () {60 vars in 1176 bytes} [Fri Jun 10 17:59:59 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:59.140119 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-93b211e6-1d7a-401f-89a3-02d48ed32cfc tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:59.141328 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-93b211e6-1d7a-401f-89a3-02d48ed32cfc tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: 96576f7e-6227-41c7-92fd-30b88f961560] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:59.150561 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93b211e6-1d7a-401f-89a3-02d48ed32cfc tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:59.150957 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93b211e6-1d7a-401f-89a3-02d48ed32cfc tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:59.151702 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93b211e6-1d7a-401f-89a3-02d48ed32cfc tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:59.152142 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93b211e6-1d7a-401f-89a3-02d48ed32cfc tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:59.217479 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-93b211e6-1d7a-401f-89a3-02d48ed32cfc tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:59.226748 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-93b211e6-1d7a-401f-89a3-02d48ed32cfc tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560" status: 200 len: 1271 microversion: 2.1 time: 0.093721 Jun 10 17:59:59.227472 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 397/802] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:59 2022] GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560 => generated 1271 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:59.232591 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1d90ee4a-ad6e-4f3a-9240-65d26988a7fd tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:59.233357 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1d90ee4a-ad6e-4f3a-9240-65d26988a7fd tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: f4f44795-d87b-4032-a9b4-4ce68336f264] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:59.242064 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d90ee4a-ad6e-4f3a-9240-65d26988a7fd tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:59.242556 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d90ee4a-ad6e-4f3a-9240-65d26988a7fd tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:59.243332 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d90ee4a-ad6e-4f3a-9240-65d26988a7fd tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:59.243769 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d90ee4a-ad6e-4f3a-9240-65d26988a7fd tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:59.396827 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1d90ee4a-ad6e-4f3a-9240-65d26988a7fd tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:59.405457 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1d90ee4a-ad6e-4f3a-9240-65d26988a7fd tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264" status: 200 len: 1522 microversion: 2.1 time: 0.176688 Jun 10 17:59:59.406026 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 398/803] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:59 2022] GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:59.411199 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3add0678-5532-408f-9f71-47abef731337 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] Calling method '.version_select at 0x7f77c16ffc10>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:59.497284 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3add0678-5532-408f-9f71-47abef731337 tempest-KeyPairsV22TestJSON-395190433 tempest-KeyPairsV22TestJSON-395190433-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-527949485" status: 204 len: 0 microversion: 2.2 time: 0.089802 Jun 10 17:59:59.497873 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 399/804] 10.222.0.35 () {60 vars in 1257 bytes} [Fri Jun 10 17:59:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-527949485 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 17:59:59.503894 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-8c1b409c-f034-4d74-b991-0f9838d73a6a req-df799145-2096-4823-b30a-bbda9aabf852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dea27a27-b11b-445c-b811-e852cd66e197", "name": "network-vif-unplugged", "status": "completed", "tag": "17c3fdaf-8a01-4c8c-ac51-d926bd2c7869"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 17:59:59.513067 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-8c1b409c-f034-4d74-b991-0f9838d73a6a req-df799145-2096-4823-b30a-bbda9aabf852 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:59.513649 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-8c1b409c-f034-4d74-b991-0f9838d73a6a req-df799145-2096-4823-b30a-bbda9aabf852 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:59.522087 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-368c434b-575e-4776-ad72-fba60ec6b5eb tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:59.527340 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-8c1b409c-f034-4d74-b991-0f9838d73a6a req-df799145-2096-4823-b30a-bbda9aabf852 service nova] Creating event network-vif-unplugged:17c3fdaf-8a01-4c8c-ac51-d926bd2c7869 for instance dea27a27-b11b-445c-b811-e852cd66e197 on chh1-master-2 Jun 10 17:59:59.532665 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-8c1b409c-f034-4d74-b991-0f9838d73a6a req-df799145-2096-4823-b30a-bbda9aabf852 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033623 Jun 10 17:59:59.533471 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 400/805] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 17:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 17:59:59.535640 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-368c434b-575e-4776-ad72-fba60ec6b5eb tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:59.537322 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-368c434b-575e-4776-ad72-fba60ec6b5eb tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:59.538990 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-368c434b-575e-4776-ad72-fba60ec6b5eb tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0" status: 200 len: 1361 microversion: 2.25 time: 0.732925 Jun 10 17:59:59.539631 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 406/806] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 17:59:58 2022] GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0 => generated 1361 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 17:59:59.559689 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ef936526-e457-40c9-87d2-258d624ea6b0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:59.560602 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ef936526-e457-40c9-87d2-258d624ea6b0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:59.567751 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ef936526-e457-40c9-87d2-258d624ea6b0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:59.568221 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ef936526-e457-40c9-87d2-258d624ea6b0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:59.569604 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ef936526-e457-40c9-87d2-258d624ea6b0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:59.569604 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ef936526-e457-40c9-87d2-258d624ea6b0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:59.706823 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ef936526-e457-40c9-87d2-258d624ea6b0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 17:59:59.724347 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ef936526-e457-40c9-87d2-258d624ea6b0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1476 microversion: 2.1 time: 0.168770 Jun 10 17:59:59.724726 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 401/807] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:59 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1476 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 17:59:59.845737 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bad89338-f9fb-41e6-be51-ca688f2b77c7 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 17:59:59.846442 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bad89338-f9fb-41e6-be51-ca688f2b77c7 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 17:59:59.853130 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bad89338-f9fb-41e6-be51-ca688f2b77c7 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:59.853587 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bad89338-f9fb-41e6-be51-ca688f2b77c7 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 17:59:59.854368 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bad89338-f9fb-41e6-be51-ca688f2b77c7 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 17:59:59.854986 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bad89338-f9fb-41e6-be51-ca688f2b77c7 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:00.114237 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bad89338-f9fb-41e6-be51-ca688f2b77c7 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63889ce9e75140bd9c730857468b7fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce8674b6db3471c8c94e809430651c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:00.131228 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bad89338-f9fb-41e6-be51-ca688f2b77c7 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63" status: 200 len: 1366 microversion: 2.1 time: 0.287039 Jun 10 18:00:00.131228 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 407/808] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 17:59:59 2022] GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63 => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:00.131423 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-817dca94-ef83-4fa9-bb70-0c2281259c70 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:00.132068 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-817dca94-ef83-4fa9-bb70-0c2281259c70 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: dea27a27-b11b-445c-b811-e852cd66e197] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:00.142873 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-817dca94-ef83-4fa9-bb70-0c2281259c70 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:00.143329 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-817dca94-ef83-4fa9-bb70-0c2281259c70 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:00.144485 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-817dca94-ef83-4fa9-bb70-0c2281259c70 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:00.145102 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-817dca94-ef83-4fa9-bb70-0c2281259c70 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:00.249671 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fe35f3a6-4304-4a73-8657-25b23bf078ed tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:00.250837 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fe35f3a6-4304-4a73-8657-25b23bf078ed tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: 96576f7e-6227-41c7-92fd-30b88f961560] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:00.258544 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fe35f3a6-4304-4a73-8657-25b23bf078ed tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:00.261225 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fe35f3a6-4304-4a73-8657-25b23bf078ed tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:00.262301 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fe35f3a6-4304-4a73-8657-25b23bf078ed tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:00.263576 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fe35f3a6-4304-4a73-8657-25b23bf078ed tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:00.486844 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-817dca94-ef83-4fa9-bb70-0c2281259c70 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:00.495498 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-817dca94-ef83-4fa9-bb70-0c2281259c70 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197" status: 200 len: 1502 microversion: 2.1 time: 0.369333 Jun 10 18:00:00.496235 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 402/809] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:00 2022] GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197 => generated 1502 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:00.501003 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-22372842-3589-40c0-a577-860ad4c4c220 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:00.501685 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-22372842-3589-40c0-a577-860ad4c4c220 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: f4f44795-d87b-4032-a9b4-4ce68336f264] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:00.508483 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-22372842-3589-40c0-a577-860ad4c4c220 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:00.509039 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-22372842-3589-40c0-a577-860ad4c4c220 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:00.509890 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-22372842-3589-40c0-a577-860ad4c4c220 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:00.510414 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-22372842-3589-40c0-a577-860ad4c4c220 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:00.659326 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-22372842-3589-40c0-a577-860ad4c4c220 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:00.667896 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-22372842-3589-40c0-a577-860ad4c4c220 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264" status: 200 len: 1522 microversion: 2.1 time: 0.170563 Jun 10 18:00:00.668700 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 403/810] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:00 2022] GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:00.673450 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7b7cb3c2-da89-4e0e-afca-36ca74d3b892 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:00.673678 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7b7cb3c2-da89-4e0e-afca-36ca74d3b892 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: 42863b6d-5afb-46d7-9ec6-592145bba6e0] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:00.679339 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fe35f3a6-4304-4a73-8657-25b23bf078ed tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:00.688063 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b7cb3c2-da89-4e0e-afca-36ca74d3b892 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:00.688545 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b7cb3c2-da89-4e0e-afca-36ca74d3b892 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:00.689327 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b7cb3c2-da89-4e0e-afca-36ca74d3b892 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:00.689617 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fe35f3a6-4304-4a73-8657-25b23bf078ed tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560" status: 200 len: 1313 microversion: 2.1 time: 0.447425 Jun 10 18:00:00.689770 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b7cb3c2-da89-4e0e-afca-36ca74d3b892 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:00.690411 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 408/811] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:00 2022] GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560 => generated 1313 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:00.741660 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7aa6802a-f9f0-4b8b-9da5-7b7f07c65dd0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:00.742289 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7aa6802a-f9f0-4b8b-9da5-7b7f07c65dd0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:00.748238 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7aa6802a-f9f0-4b8b-9da5-7b7f07c65dd0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:00.748738 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7aa6802a-f9f0-4b8b-9da5-7b7f07c65dd0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:00.750318 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7aa6802a-f9f0-4b8b-9da5-7b7f07c65dd0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:00.750846 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7aa6802a-f9f0-4b8b-9da5-7b7f07c65dd0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:00.832052 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7b7cb3c2-da89-4e0e-afca-36ca74d3b892 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:00.840990 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7b7cb3c2-da89-4e0e-afca-36ca74d3b892 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:00.842608 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7b7cb3c2-da89-4e0e-afca-36ca74d3b892 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:00.844265 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7b7cb3c2-da89-4e0e-afca-36ca74d3b892 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0" status: 200 len: 1361 microversion: 2.25 time: 0.174868 Jun 10 18:00:00.854586 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 404/812] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:00 2022] GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0 => generated 1361 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:00:01.036148 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7aa6802a-f9f0-4b8b-9da5-7b7f07c65dd0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:01.042910 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7aa6802a-f9f0-4b8b-9da5-7b7f07c65dd0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1476 microversion: 2.1 time: 0.305350 Jun 10 18:00:01.051563 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-81c2951c-5718-4467-bb65-4aed7a928aa5 req-a284d0b6-7cdd-4dc6-ba14-2cf450220b08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63", "name": "network-vif-plugged", "status": "completed", "tag": "9123aa43-baae-4951-a005-f47283092a90"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:01.053142 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 409/813] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:00 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1476 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:01.063470 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-81c2951c-5718-4467-bb65-4aed7a928aa5 req-a284d0b6-7cdd-4dc6-ba14-2cf450220b08 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:01.064076 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-81c2951c-5718-4467-bb65-4aed7a928aa5 req-a284d0b6-7cdd-4dc6-ba14-2cf450220b08 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:01.075359 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-81c2951c-5718-4467-bb65-4aed7a928aa5 req-a284d0b6-7cdd-4dc6-ba14-2cf450220b08 service nova] Creating event network-vif-plugged:9123aa43-baae-4951-a005-f47283092a90 for instance ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63 on chh2-master-2 Jun 10 18:00:01.081161 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-81c2951c-5718-4467-bb65-4aed7a928aa5 req-a284d0b6-7cdd-4dc6-ba14-2cf450220b08 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033351 Jun 10 18:00:01.081977 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 405/814] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:00:01.146435 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-81546653-b681-4b4d-9e6e-c53536a9d940 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:01.147141 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-81546653-b681-4b4d-9e6e-c53536a9d940 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:01.153582 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-81546653-b681-4b4d-9e6e-c53536a9d940 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:01.154040 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-81546653-b681-4b4d-9e6e-c53536a9d940 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:01.154823 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-81546653-b681-4b4d-9e6e-c53536a9d940 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:01.155308 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-81546653-b681-4b4d-9e6e-c53536a9d940 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:01.523485 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d38f8a6f-21b0-41b5-a629-881cf804f50a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:01.524540 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d38f8a6f-21b0-41b5-a629-881cf804f50a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: dea27a27-b11b-445c-b811-e852cd66e197] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:01.535526 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d38f8a6f-21b0-41b5-a629-881cf804f50a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:01.536354 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d38f8a6f-21b0-41b5-a629-881cf804f50a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:01.538239 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d38f8a6f-21b0-41b5-a629-881cf804f50a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:01.538967 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d38f8a6f-21b0-41b5-a629-881cf804f50a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:01.555902 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-81546653-b681-4b4d-9e6e-c53536a9d940 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63889ce9e75140bd9c730857468b7fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce8674b6db3471c8c94e809430651c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:01.563937 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-81546653-b681-4b4d-9e6e-c53536a9d940 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63" status: 200 len: 1366 microversion: 2.1 time: 0.422108 Jun 10 18:00:01.574830 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 410/815] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:01 2022] GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63 => generated 1366 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:01.580061 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-0605f8f7-a049-4353-be02-1dd4611d5461 req-9f6a8e11-a57b-4208-bbe5-a53724fb8df3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dea27a27-b11b-445c-b811-e852cd66e197", "tag": "17c3fdaf-8a01-4c8c-ac51-d926bd2c7869"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:01.592141 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-0605f8f7-a049-4353-be02-1dd4611d5461 req-9f6a8e11-a57b-4208-bbe5-a53724fb8df3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:01.593530 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-0605f8f7-a049-4353-be02-1dd4611d5461 req-9f6a8e11-a57b-4208-bbe5-a53724fb8df3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:01.608216 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-0605f8f7-a049-4353-be02-1dd4611d5461 req-9f6a8e11-a57b-4208-bbe5-a53724fb8df3 service nova] Creating event network-changed:17c3fdaf-8a01-4c8c-ac51-d926bd2c7869 for instance dea27a27-b11b-445c-b811-e852cd66e197 on chh1-master-2 Jun 10 18:00:01.618944 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-0605f8f7-a049-4353-be02-1dd4611d5461 req-9f6a8e11-a57b-4208-bbe5-a53724fb8df3 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038585 Jun 10 18:00:01.620254 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 411/816] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:00:01.687687 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-15d4057d-6469-4c58-92a4-7523ea11f58c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:01.688688 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-15d4057d-6469-4c58-92a4-7523ea11f58c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: f4f44795-d87b-4032-a9b4-4ce68336f264] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:01.702098 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-15d4057d-6469-4c58-92a4-7523ea11f58c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:01.706370 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-15d4057d-6469-4c58-92a4-7523ea11f58c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:01.709239 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-15d4057d-6469-4c58-92a4-7523ea11f58c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:01.710440 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-15d4057d-6469-4c58-92a4-7523ea11f58c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:01.813954 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d38f8a6f-21b0-41b5-a629-881cf804f50a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:01.828099 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d38f8a6f-21b0-41b5-a629-881cf804f50a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197" status: 200 len: 1502 microversion: 2.1 time: 0.317298 Jun 10 18:00:01.842190 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 406/817] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:01 2022] GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197 => generated 1502 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:01.854477 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b189394d-93f2-453a-bd44-7672f2732238 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:01.858129 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b189394d-93f2-453a-bd44-7672f2732238 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: 96576f7e-6227-41c7-92fd-30b88f961560] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:01.877054 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b189394d-93f2-453a-bd44-7672f2732238 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:01.877549 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b189394d-93f2-453a-bd44-7672f2732238 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:01.882986 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b189394d-93f2-453a-bd44-7672f2732238 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:01.882986 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b189394d-93f2-453a-bd44-7672f2732238 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:02.058101 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-15d4057d-6469-4c58-92a4-7523ea11f58c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:02.073496 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-15d4057d-6469-4c58-92a4-7523ea11f58c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264" status: 200 len: 1522 microversion: 2.1 time: 0.391605 Jun 10 18:00:02.074690 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 412/818] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:01 2022] GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264 => generated 1522 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:02.080975 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-85398998-17fd-40fd-ba58-1a39ddc5aca4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:02.081758 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-85398998-17fd-40fd-ba58-1a39ddc5aca4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: 42863b6d-5afb-46d7-9ec6-592145bba6e0] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:02.101125 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-85398998-17fd-40fd-ba58-1a39ddc5aca4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:02.101966 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-85398998-17fd-40fd-ba58-1a39ddc5aca4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:02.103109 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-85398998-17fd-40fd-ba58-1a39ddc5aca4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:02.103776 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-85398998-17fd-40fd-ba58-1a39ddc5aca4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:02.122867 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b189394d-93f2-453a-bd44-7672f2732238 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:02.136189 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b189394d-93f2-453a-bd44-7672f2732238 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560" status: 200 len: 1313 microversion: 2.1 time: 0.290209 Jun 10 18:00:02.136822 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 407/819] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:01 2022] GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560 => generated 1313 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:02.162758 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-eb0df3ea-f60c-40ff-afbb-c03ed548893b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:02.174157 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-eb0df3ea-f60c-40ff-afbb-c03ed548893b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:02.194653 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eb0df3ea-f60c-40ff-afbb-c03ed548893b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:02.195437 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eb0df3ea-f60c-40ff-afbb-c03ed548893b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:02.199566 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eb0df3ea-f60c-40ff-afbb-c03ed548893b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:02.200290 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eb0df3ea-f60c-40ff-afbb-c03ed548893b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:02.484719 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-85398998-17fd-40fd-ba58-1a39ddc5aca4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:02.500080 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-85398998-17fd-40fd-ba58-1a39ddc5aca4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:02.501689 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-85398998-17fd-40fd-ba58-1a39ddc5aca4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:02.503043 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-85398998-17fd-40fd-ba58-1a39ddc5aca4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0" status: 200 len: 1361 microversion: 2.25 time: 0.426982 Jun 10 18:00:02.503775 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 413/820] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:02 2022] GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0 => generated 1361 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:00:02.518884 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-eb0df3ea-f60c-40ff-afbb-c03ed548893b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:02.539505 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-eb0df3ea-f60c-40ff-afbb-c03ed548893b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1476 microversion: 2.1 time: 0.401416 Jun 10 18:00:02.549487 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 408/821] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:02 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1476 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:02.581923 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e8f70d0a-9ce4-4e01-8ae4-0144cfd718bb tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:02.582920 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e8f70d0a-9ce4-4e01-8ae4-0144cfd718bb tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:02.594242 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e8f70d0a-9ce4-4e01-8ae4-0144cfd718bb tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:02.594802 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e8f70d0a-9ce4-4e01-8ae4-0144cfd718bb tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:02.596020 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e8f70d0a-9ce4-4e01-8ae4-0144cfd718bb tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:02.597409 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e8f70d0a-9ce4-4e01-8ae4-0144cfd718bb tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:02.860081 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b41ea132-5d8c-47f5-8fde-846f2343e688 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:02.861245 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b41ea132-5d8c-47f5-8fde-846f2343e688 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: dea27a27-b11b-445c-b811-e852cd66e197] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:02.866553 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e8f70d0a-9ce4-4e01-8ae4-0144cfd718bb tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63889ce9e75140bd9c730857468b7fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce8674b6db3471c8c94e809430651c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:02.869724 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b41ea132-5d8c-47f5-8fde-846f2343e688 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:02.870285 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b41ea132-5d8c-47f5-8fde-846f2343e688 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:02.871484 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b41ea132-5d8c-47f5-8fde-846f2343e688 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:02.872151 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b41ea132-5d8c-47f5-8fde-846f2343e688 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:02.877368 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:00:02.881666 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e8f70d0a-9ce4-4e01-8ae4-0144cfd718bb tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63" status: 200 len: 1366 microversion: 2.1 time: 0.303996 Jun 10 18:00:02.883416 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 414/822] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:02 2022] GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63 => generated 1366 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:03.095324 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-45170b31-ad3f-4015-b0ee-6e18547d7b18 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:03.097274 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-45170b31-ad3f-4015-b0ee-6e18547d7b18 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: f4f44795-d87b-4032-a9b4-4ce68336f264] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:03.104949 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b41ea132-5d8c-47f5-8fde-846f2343e688 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:03.114964 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b41ea132-5d8c-47f5-8fde-846f2343e688 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197" status: 200 len: 1502 microversion: 2.1 time: 0.272771 Jun 10 18:00:03.117153 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 409/823] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:02 2022] GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197 => generated 1502 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:03.118519 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-45170b31-ad3f-4015-b0ee-6e18547d7b18 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:03.120662 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-45170b31-ad3f-4015-b0ee-6e18547d7b18 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:03.121482 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-45170b31-ad3f-4015-b0ee-6e18547d7b18 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:03.122036 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-45170b31-ad3f-4015-b0ee-6e18547d7b18 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:03.153749 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9b48b81a-31bf-4aaf-b4a9-aa0ad6e3eea9 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:03.154515 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9b48b81a-31bf-4aaf-b4a9-aa0ad6e3eea9 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: 96576f7e-6227-41c7-92fd-30b88f961560] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:03.161374 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b48b81a-31bf-4aaf-b4a9-aa0ad6e3eea9 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:03.161911 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b48b81a-31bf-4aaf-b4a9-aa0ad6e3eea9 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:03.164654 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b48b81a-31bf-4aaf-b4a9-aa0ad6e3eea9 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:03.165360 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b48b81a-31bf-4aaf-b4a9-aa0ad6e3eea9 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:03.399474 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9b48b81a-31bf-4aaf-b4a9-aa0ad6e3eea9 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:03.411599 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9b48b81a-31bf-4aaf-b4a9-aa0ad6e3eea9 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560" status: 200 len: 1313 microversion: 2.1 time: 0.261534 Jun 10 18:00:03.423339 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 410/824] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:03 2022] GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560 => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:03.521956 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4ae3c589-ddad-4e3a-99ca-54737e861642 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:03.523120 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4ae3c589-ddad-4e3a-99ca-54737e861642 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: 42863b6d-5afb-46d7-9ec6-592145bba6e0] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:03.531998 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ae3c589-ddad-4e3a-99ca-54737e861642 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:03.533783 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ae3c589-ddad-4e3a-99ca-54737e861642 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:03.534882 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ae3c589-ddad-4e3a-99ca-54737e861642 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:03.536476 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ae3c589-ddad-4e3a-99ca-54737e861642 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:03.598568 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-45170b31-ad3f-4015-b0ee-6e18547d7b18 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:03.609486 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-45170b31-ad3f-4015-b0ee-6e18547d7b18 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264" status: 200 len: 1522 microversion: 2.1 time: 0.520612 Jun 10 18:00:03.610480 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 415/825] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:03 2022] GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264 => generated 1522 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:03.627413 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7c5a62af-4dbe-4f29-846c-8807fe0873fd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:03.627413 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7c5a62af-4dbe-4f29-846c-8807fe0873fd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:03.630367 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7c5a62af-4dbe-4f29-846c-8807fe0873fd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:03.631006 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7c5a62af-4dbe-4f29-846c-8807fe0873fd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:03.632010 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7c5a62af-4dbe-4f29-846c-8807fe0873fd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:03.632642 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7c5a62af-4dbe-4f29-846c-8807fe0873fd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:03.754059 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4ae3c589-ddad-4e3a-99ca-54737e861642 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:03.763853 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4ae3c589-ddad-4e3a-99ca-54737e861642 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:03.768879 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4ae3c589-ddad-4e3a-99ca-54737e861642 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:03.771459 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4ae3c589-ddad-4e3a-99ca-54737e861642 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0" status: 200 len: 1361 microversion: 2.25 time: 0.253621 Jun 10 18:00:03.775449 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 411/826] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:03 2022] GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0 => generated 1361 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:00:03.780262 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-8c2737c5-fefd-4b55-aac1-081e816498f5 req-e6cd0c51-a558-4238-ab55-75fb4d458831 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab0caf46-568d-4b5a-bd31-458cdc99b06f", "tag": "fe140919-8d1b-4aeb-a134-324a13655f62"}, {"name": "network-changed", "server_uuid": "96576f7e-6227-41c7-92fd-30b88f961560", "tag": "75910fb8-9d43-4249-846f-06aa6225ad07"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:03.805023 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-8c2737c5-fefd-4b55-aac1-081e816498f5 req-e6cd0c51-a558-4238-ab55-75fb4d458831 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:03.805563 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-8c2737c5-fefd-4b55-aac1-081e816498f5 req-e6cd0c51-a558-4238-ab55-75fb4d458831 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:03.823683 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-8c2737c5-fefd-4b55-aac1-081e816498f5 req-e6cd0c51-a558-4238-ab55-75fb4d458831 service nova] Creating event network-changed:fe140919-8d1b-4aeb-a134-324a13655f62 for instance ab0caf46-568d-4b5a-bd31-458cdc99b06f on chh1-master-2 Jun 10 18:00:03.824266 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-8c2737c5-fefd-4b55-aac1-081e816498f5 req-e6cd0c51-a558-4238-ab55-75fb4d458831 service nova] Creating event network-changed:75910fb8-9d43-4249-846f-06aa6225ad07 for instance 96576f7e-6227-41c7-92fd-30b88f961560 on chh2-master-2 Jun 10 18:00:03.835146 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-8c2737c5-fefd-4b55-aac1-081e816498f5 req-e6cd0c51-a558-4238-ab55-75fb4d458831 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.058234 Jun 10 18:00:03.835763 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 412/827] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:00:03.873613 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7c5a62af-4dbe-4f29-846c-8807fe0873fd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:03.885966 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7c5a62af-4dbe-4f29-846c-8807fe0873fd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1476 microversion: 2.1 time: 0.271281 Jun 10 18:00:03.886872 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 416/828] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:03 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1476 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:03.908131 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5a1da0c0-07a8-4a13-9fcd-442375befc88 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:03.908885 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5a1da0c0-07a8-4a13-9fcd-442375befc88 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:03.918419 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5a1da0c0-07a8-4a13-9fcd-442375befc88 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:03.919181 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5a1da0c0-07a8-4a13-9fcd-442375befc88 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:03.920127 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5a1da0c0-07a8-4a13-9fcd-442375befc88 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:03.920773 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5a1da0c0-07a8-4a13-9fcd-442375befc88 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:04.052956 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-705172ee-fc2a-482d-95eb-455a09a51b04 req-8bce4055-809d-4ad3-b4b1-53c869632db7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42863b6d-5afb-46d7-9ec6-592145bba6e0", "name": "network-vif-plugged", "status": "completed", "tag": "67e4d336-b9e8-43b3-8284-8dc5d8f3355b"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:04.061141 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-705172ee-fc2a-482d-95eb-455a09a51b04 req-8bce4055-809d-4ad3-b4b1-53c869632db7 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:04.062339 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-705172ee-fc2a-482d-95eb-455a09a51b04 req-8bce4055-809d-4ad3-b4b1-53c869632db7 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:04.074231 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-705172ee-fc2a-482d-95eb-455a09a51b04 req-8bce4055-809d-4ad3-b4b1-53c869632db7 service nova] Creating event network-vif-plugged:67e4d336-b9e8-43b3-8284-8dc5d8f3355b for instance 42863b6d-5afb-46d7-9ec6-592145bba6e0 on chh1-master-2 Jun 10 18:00:04.089812 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-705172ee-fc2a-482d-95eb-455a09a51b04 req-8bce4055-809d-4ad3-b4b1-53c869632db7 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040435 Jun 10 18:00:04.091008 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 417/829] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:00:04.113817 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5a1da0c0-07a8-4a13-9fcd-442375befc88 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63889ce9e75140bd9c730857468b7fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce8674b6db3471c8c94e809430651c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:04.121832 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5a1da0c0-07a8-4a13-9fcd-442375befc88 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63" status: 200 len: 1366 microversion: 2.1 time: 0.223605 Jun 10 18:00:04.122409 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 413/830] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:03 2022] GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:04.136809 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2837a260-ca9d-4a37-859a-f8a81b2fe57b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:04.137612 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2837a260-ca9d-4a37-859a-f8a81b2fe57b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: dea27a27-b11b-445c-b811-e852cd66e197] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:04.150384 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2837a260-ca9d-4a37-859a-f8a81b2fe57b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:04.154695 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2837a260-ca9d-4a37-859a-f8a81b2fe57b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:04.155739 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2837a260-ca9d-4a37-859a-f8a81b2fe57b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:04.157366 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2837a260-ca9d-4a37-859a-f8a81b2fe57b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:04.404215 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2837a260-ca9d-4a37-859a-f8a81b2fe57b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:04.412377 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2837a260-ca9d-4a37-859a-f8a81b2fe57b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197" status: 200 len: 1502 microversion: 2.1 time: 0.282181 Jun 10 18:00:04.420271 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 418/831] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:04 2022] GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197 => generated 1502 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:04.437775 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-03b4cefc-df4b-47cb-aecf-e76281d22c7b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:04.438380 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-03b4cefc-df4b-47cb-aecf-e76281d22c7b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: 96576f7e-6227-41c7-92fd-30b88f961560] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:04.444519 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03b4cefc-df4b-47cb-aecf-e76281d22c7b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:04.444973 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03b4cefc-df4b-47cb-aecf-e76281d22c7b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:04.445735 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03b4cefc-df4b-47cb-aecf-e76281d22c7b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:04.446170 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03b4cefc-df4b-47cb-aecf-e76281d22c7b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:04.591690 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-03b4cefc-df4b-47cb-aecf-e76281d22c7b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:04.601421 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-03b4cefc-df4b-47cb-aecf-e76281d22c7b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560" status: 200 len: 1313 microversion: 2.1 time: 0.167955 Jun 10 18:00:04.602027 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 414/832] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:04 2022] GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:04.627265 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0231f3a6-22b6-4919-8350-37e1a6f78f5a tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:04.627982 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0231f3a6-22b6-4919-8350-37e1a6f78f5a tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: f4f44795-d87b-4032-a9b4-4ce68336f264] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:04.635440 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0231f3a6-22b6-4919-8350-37e1a6f78f5a tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:04.635974 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0231f3a6-22b6-4919-8350-37e1a6f78f5a tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:04.637122 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0231f3a6-22b6-4919-8350-37e1a6f78f5a tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:04.637630 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0231f3a6-22b6-4919-8350-37e1a6f78f5a tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:04.642432 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:00:04.820617 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0231f3a6-22b6-4919-8350-37e1a6f78f5a tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:04.828666 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0231f3a6-22b6-4919-8350-37e1a6f78f5a tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264" status: 200 len: 1522 microversion: 2.1 time: 0.205650 Jun 10 18:00:04.829246 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 419/833] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:04 2022] GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:04.833921 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7a894bf5-d626-4bc3-9523-6b848b248796 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:04.834673 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7a894bf5-d626-4bc3-9523-6b848b248796 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: 42863b6d-5afb-46d7-9ec6-592145bba6e0] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:04.842544 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7a894bf5-d626-4bc3-9523-6b848b248796 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:04.843858 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7a894bf5-d626-4bc3-9523-6b848b248796 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:04.844722 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7a894bf5-d626-4bc3-9523-6b848b248796 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:04.845165 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7a894bf5-d626-4bc3-9523-6b848b248796 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:04.872640 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-82bce43e-e4a3-4243-8807-db98961ad777 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-417841743", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "c7533710-56da-4765-9437-5446e81c3a43"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:04.926542 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-82bce43e-e4a3-4243-8807-db98961ad777 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] validate_networks() for [('c7533710-56da-4765-9437-5446e81c3a43', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:00:04.971869 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=16 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:00:04.976385 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7a894bf5-d626-4bc3-9523-6b848b248796 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:04.984158 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7a894bf5-d626-4bc3-9523-6b848b248796 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:04.985700 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7a894bf5-d626-4bc3-9523-6b848b248796 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:04.986821 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7a894bf5-d626-4bc3-9523-6b848b248796 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0" status: 200 len: 1361 microversion: 2.25 time: 0.156644 Jun 10 18:00:04.987388 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 420/834] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:04 2022] GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:00:04.991758 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-10afdd4d-f4c0-4ed3-beb3-dd96b8a541c3 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:04.992398 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-10afdd4d-f4c0-4ed3-beb3-dd96b8a541c3 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:04.998399 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-10afdd4d-f4c0-4ed3-beb3-dd96b8a541c3 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:04.998873 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-10afdd4d-f4c0-4ed3-beb3-dd96b8a541c3 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:04.999644 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-10afdd4d-f4c0-4ed3-beb3-dd96b8a541c3 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:05.000088 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-10afdd4d-f4c0-4ed3-beb3-dd96b8a541c3 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:05.162643 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-10afdd4d-f4c0-4ed3-beb3-dd96b8a541c3 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:05.172094 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-10afdd4d-f4c0-4ed3-beb3-dd96b8a541c3 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1476 microversion: 2.1 time: 0.183713 Jun 10 18:00:05.172709 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 421/835] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:04 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1476 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:05.177441 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7f0f5c56-3674-4efa-8602-5244c6e9d296 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:05.178104 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7f0f5c56-3674-4efa-8602-5244c6e9d296 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:05.184145 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7f0f5c56-3674-4efa-8602-5244c6e9d296 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:05.184656 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7f0f5c56-3674-4efa-8602-5244c6e9d296 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:05.185542 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7f0f5c56-3674-4efa-8602-5244c6e9d296 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:05.185989 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7f0f5c56-3674-4efa-8602-5244c6e9d296 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:05.300472 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-82bce43e-e4a3-4243-8807-db98961ad777 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:00:05.300957 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-82bce43e-e4a3-4243-8807-db98961ad777 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:00:05.301410 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-82bce43e-e4a3-4243-8807-db98961ad777 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:00:05.301849 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-82bce43e-e4a3-4243-8807-db98961ad777 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:00:05.302265 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-82bce43e-e4a3-4243-8807-db98961ad777 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:00:05.311965 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-82bce43e-e4a3-4243-8807-db98961ad777 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:05.312455 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-82bce43e-e4a3-4243-8807-db98961ad777 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:05.313268 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-82bce43e-e4a3-4243-8807-db98961ad777 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:05.313709 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-82bce43e-e4a3-4243-8807-db98961ad777 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:05.331640 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-82bce43e-e4a3-4243-8807-db98961ad777 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Getting quotas for project 188f32238c2c4e4f993cd11937715216. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:00:05.336780 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-82bce43e-e4a3-4243-8807-db98961ad777 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Getting quotas for user 6b1d1a0bd05d43368b969a9cc9435366 and project 188f32238c2c4e4f993cd11937715216. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:00:05.349780 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-82bce43e-e4a3-4243-8807-db98961ad777 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:00:05.352893 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-82bce43e-e4a3-4243-8807-db98961ad777 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:00:05.371832 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7f0f5c56-3674-4efa-8602-5244c6e9d296 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63889ce9e75140bd9c730857468b7fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce8674b6db3471c8c94e809430651c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:05.380831 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7f0f5c56-3674-4efa-8602-5244c6e9d296 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63" status: 200 len: 1556 microversion: 2.1 time: 0.207079 Jun 10 18:00:05.381416 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 422/836] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:05 2022] GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63 => generated 1556 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:05.398174 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-dde6e448-d16d-4721-8d0c-5b71f09c71f0 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:05.398674 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-dde6e448-d16d-4721-8d0c-5b71f09c71f0 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:05.405361 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dde6e448-d16d-4721-8d0c-5b71f09c71f0 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:05.405809 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dde6e448-d16d-4721-8d0c-5b71f09c71f0 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:05.406560 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dde6e448-d16d-4721-8d0c-5b71f09c71f0 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:05.406993 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dde6e448-d16d-4721-8d0c-5b71f09c71f0 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:05.462114 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-82bce43e-e4a3-4243-8807-db98961ad777 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.711427 Jun 10 18:00:05.462771 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 415/837] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:00:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 10 18:00:05.468223 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0fdace38-d629-4630-bf6d-4531e963b8fa tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:05.468866 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0fdace38-d629-4630-bf6d-4531e963b8fa tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: dea27a27-b11b-445c-b811-e852cd66e197] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:05.476569 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0fdace38-d629-4630-bf6d-4531e963b8fa tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:05.477009 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0fdace38-d629-4630-bf6d-4531e963b8fa tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:05.477966 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0fdace38-d629-4630-bf6d-4531e963b8fa tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:05.478557 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0fdace38-d629-4630-bf6d-4531e963b8fa tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:05.535028 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-dde6e448-d16d-4721-8d0c-5b71f09c71f0 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.140737 Jun 10 18:00:05.535881 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 423/838] 10.222.0.35 () {58 vars in 1274 bytes} [Fri Jun 10 18:00:05 2022] GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63/os-interface => generated 285 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:00:05.547277 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8bfe1786-2f6b-4e5a-b11a-3f01448d6d63 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:05.547978 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8bfe1786-2f6b-4e5a-b11a-3f01448d6d63 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:05.633819 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8bfe1786-2f6b-4e5a-b11a-3f01448d6d63 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:05.636706 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=64 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:00:05.642739 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8bfe1786-2f6b-4e5a-b11a-3f01448d6d63 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1217 microversion: 2.1 time: 0.099424 Jun 10 18:00:05.643327 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 424/839] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:05 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1217 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:05.644748 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0fdace38-d629-4630-bf6d-4531e963b8fa tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:05.649314 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d819b6ca-c3bb-446d-aa7a-f156b7c51816 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:05.650285 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d819b6ca-c3bb-446d-aa7a-f156b7c51816 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: 96576f7e-6227-41c7-92fd-30b88f961560] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:05.658008 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d819b6ca-c3bb-446d-aa7a-f156b7c51816 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:05.658467 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d819b6ca-c3bb-446d-aa7a-f156b7c51816 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:05.658629 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0fdace38-d629-4630-bf6d-4531e963b8fa tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197" status: 200 len: 1502 microversion: 2.1 time: 0.194636 Jun 10 18:00:05.659190 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 416/840] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:05 2022] GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197 => generated 1502 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:05.660075 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d819b6ca-c3bb-446d-aa7a-f156b7c51816 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:05.665158 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d819b6ca-c3bb-446d-aa7a-f156b7c51816 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:05.847814 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-13dacac4-e0c0-43f6-a06f-186ddd1483ee tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:05.847814 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-13dacac4-e0c0-43f6-a06f-186ddd1483ee tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: f4f44795-d87b-4032-a9b4-4ce68336f264] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:05.849865 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:00:05.853423 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-13dacac4-e0c0-43f6-a06f-186ddd1483ee tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:05.853881 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-13dacac4-e0c0-43f6-a06f-186ddd1483ee tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:05.854665 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-13dacac4-e0c0-43f6-a06f-186ddd1483ee tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:05.855108 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-13dacac4-e0c0-43f6-a06f-186ddd1483ee tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:05.937014 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d819b6ca-c3bb-446d-aa7a-f156b7c51816 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:05.940609 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d819b6ca-c3bb-446d-aa7a-f156b7c51816 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560" status: 200 len: 1313 microversion: 2.1 time: 0.295958 Jun 10 18:00:05.950275 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 425/841] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:05 2022] GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560 => generated 1313 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:06.004852 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ece560eb-8756-40b7-b57c-3954464cbbf6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:06.005635 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ece560eb-8756-40b7-b57c-3954464cbbf6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: 42863b6d-5afb-46d7-9ec6-592145bba6e0] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:06.016012 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ece560eb-8756-40b7-b57c-3954464cbbf6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:06.016562 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ece560eb-8756-40b7-b57c-3954464cbbf6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:06.017468 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ece560eb-8756-40b7-b57c-3954464cbbf6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:06.017922 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ece560eb-8756-40b7-b57c-3954464cbbf6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:06.022202 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-13dacac4-e0c0-43f6-a06f-186ddd1483ee tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:06.034665 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-13dacac4-e0c0-43f6-a06f-186ddd1483ee tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264" status: 200 len: 1522 microversion: 2.1 time: 0.192944 Jun 10 18:00:06.035814 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 417/842] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:05 2022] GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:06.192099 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ac57ff02-292b-4ee7-a283-a89c6a3f6c6c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:06.194096 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ac57ff02-292b-4ee7-a283-a89c6a3f6c6c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:06.210872 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ac57ff02-292b-4ee7-a283-a89c6a3f6c6c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:06.211316 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ac57ff02-292b-4ee7-a283-a89c6a3f6c6c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:06.212733 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ac57ff02-292b-4ee7-a283-a89c6a3f6c6c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:06.213185 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ac57ff02-292b-4ee7-a283-a89c6a3f6c6c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:06.326078 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ece560eb-8756-40b7-b57c-3954464cbbf6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:06.336581 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ece560eb-8756-40b7-b57c-3954464cbbf6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:06.338429 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ece560eb-8756-40b7-b57c-3954464cbbf6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:06.339851 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ece560eb-8756-40b7-b57c-3954464cbbf6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0" status: 200 len: 1558 microversion: 2.25 time: 0.338996 Jun 10 18:00:06.352889 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 426/843] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:05 2022] GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0 => generated 1558 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:00:06.370551 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ac57ff02-292b-4ee7-a283-a89c6a3f6c6c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:06.379883 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ac57ff02-292b-4ee7-a283-a89c6a3f6c6c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1476 microversion: 2.1 time: 0.194355 Jun 10 18:00:06.380677 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 418/844] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:06 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1476 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:06.489993 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d3223404-ff2d-4673-9275-066432084d33 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:06.490671 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d3223404-ff2d-4673-9275-066432084d33 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] [instance: 42863b6d-5afb-46d7-9ec6-592145bba6e0] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:06.497102 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d3223404-ff2d-4673-9275-066432084d33 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:06.497780 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d3223404-ff2d-4673-9275-066432084d33 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:06.498689 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d3223404-ff2d-4673-9275-066432084d33 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:06.499332 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d3223404-ff2d-4673-9275-066432084d33 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:06.659729 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cc5c3d97-a88b-489a-bc6a-964da705775b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:06.660396 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cc5c3d97-a88b-489a-bc6a-964da705775b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:06.713660 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-d3223404-ff2d-4673-9275-066432084d33 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lazy-loading 'services' on Instance uuid 42863b6d-5afb-46d7-9ec6-592145bba6e0 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:00:06.716429 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cc5c3d97-a88b-489a-bc6a-964da705775b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:06.724458 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cc5c3d97-a88b-489a-bc6a-964da705775b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1217 microversion: 2.1 time: 0.069320 Jun 10 18:00:06.726934 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 419/845] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:06 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1217 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:06.729459 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0f47038c-a45c-4ebc-89be-17fe830ed33d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:06.730062 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0f47038c-a45c-4ebc-89be-17fe830ed33d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: dea27a27-b11b-445c-b811-e852cd66e197] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:06.738239 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0f47038c-a45c-4ebc-89be-17fe830ed33d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:06.738684 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0f47038c-a45c-4ebc-89be-17fe830ed33d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:06.739447 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0f47038c-a45c-4ebc-89be-17fe830ed33d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:06.739883 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0f47038c-a45c-4ebc-89be-17fe830ed33d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:06.780837 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d3223404-ff2d-4673-9275-066432084d33 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0" status: 200 len: 2050 microversion: 2.25 time: 0.421991 Jun 10 18:00:06.784397 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 427/846] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:06 2022] GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0 => generated 2050 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:00:06.798757 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-33475c08-9858-4693-a080-2f1942747ca4 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:06.799486 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-33475c08-9858-4693-a080-2f1942747ca4 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] [instance: 42863b6d-5afb-46d7-9ec6-592145bba6e0] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:06.807722 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-33475c08-9858-4693-a080-2f1942747ca4 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:06.808404 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-33475c08-9858-4693-a080-2f1942747ca4 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:06.809321 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-33475c08-9858-4693-a080-2f1942747ca4 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:06.809859 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-33475c08-9858-4693-a080-2f1942747ca4 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:06.887929 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0f47038c-a45c-4ebc-89be-17fe830ed33d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:06.896795 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0f47038c-a45c-4ebc-89be-17fe830ed33d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197" status: 200 len: 1502 microversion: 2.1 time: 0.170630 Jun 10 18:00:06.897303 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 420/847] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:06 2022] GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197 => generated 1502 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:06.958343 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-686fa7c1-f5f7-408f-b058-71ab924acd95 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:06.959054 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-686fa7c1-f5f7-408f-b058-71ab924acd95 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: 96576f7e-6227-41c7-92fd-30b88f961560] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:06.965985 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-686fa7c1-f5f7-408f-b058-71ab924acd95 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:06.966433 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-686fa7c1-f5f7-408f-b058-71ab924acd95 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:06.967193 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-686fa7c1-f5f7-408f-b058-71ab924acd95 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:06.967629 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-686fa7c1-f5f7-408f-b058-71ab924acd95 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:07.098345 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-686fa7c1-f5f7-408f-b058-71ab924acd95 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:07.106058 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-686fa7c1-f5f7-408f-b058-71ab924acd95 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560" status: 200 len: 1313 microversion: 2.1 time: 0.151603 Jun 10 18:00:07.106707 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 421/848] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:06 2022] GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:07.111847 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fcad7358-f2dc-4806-9e79-863ad26604d2 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:07.112478 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fcad7358-f2dc-4806-9e79-863ad26604d2 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: f4f44795-d87b-4032-a9b4-4ce68336f264] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:07.118262 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fcad7358-f2dc-4806-9e79-863ad26604d2 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:07.118713 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fcad7358-f2dc-4806-9e79-863ad26604d2 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:07.119476 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fcad7358-f2dc-4806-9e79-863ad26604d2 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:07.119917 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fcad7358-f2dc-4806-9e79-863ad26604d2 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:07.145566 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-33475c08-9858-4693-a080-2f1942747ca4 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lazy-loading 'services' on Instance uuid 42863b6d-5afb-46d7-9ec6-592145bba6e0 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:00:07.159808 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-33475c08-9858-4693-a080-2f1942747ca4 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0" status: 200 len: 2050 microversion: 2.25 time: 0.364800 Jun 10 18:00:07.162936 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 428/849] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:06 2022] GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0 => generated 2050 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:00:07.179068 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-32ed661e-8f9d-4366-ac7e-413bdea56817 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:07.180707 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:00:07.180707 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 18:00:07.182470 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-32ed661e-8f9d-4366-ac7e-413bdea56817 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:07.182824 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-32ed661e-8f9d-4366-ac7e-413bdea56817 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:07.183666 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-32ed661e-8f9d-4366-ac7e-413bdea56817 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:07.184109 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-32ed661e-8f9d-4366-ac7e-413bdea56817 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:07.210435 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-32ed661e-8f9d-4366-ac7e-413bdea56817 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] 10.222.0.35 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.035121 Jun 10 18:00:07.211059 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 429/850] 10.222.0.35 () {60 vars in 1216 bytes} [Fri Jun 10 18:00:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 10 18:00:07.222137 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-85b29e2b-db00-4c7a-a7d7-98c67ee6c914 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "chh2-master-2", "block_migration": "auto"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:07.223311 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-85b29e2b-db00-4c7a-a7d7-98c67ee6c914 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] [instance: 42863b6d-5afb-46d7-9ec6-592145bba6e0] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:07.229484 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-85b29e2b-db00-4c7a-a7d7-98c67ee6c914 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:07.229940 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-85b29e2b-db00-4c7a-a7d7-98c67ee6c914 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:07.230786 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-85b29e2b-db00-4c7a-a7d7-98c67ee6c914 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:07.231166 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-85b29e2b-db00-4c7a-a7d7-98c67ee6c914 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:07.271747 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fcad7358-f2dc-4806-9e79-863ad26604d2 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:07.271900 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-85b29e2b-db00-4c7a-a7d7-98c67ee6c914 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lazy-loading 'flavor' on Instance uuid 42863b6d-5afb-46d7-9ec6-592145bba6e0 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:00:07.280624 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fcad7358-f2dc-4806-9e79-863ad26604d2 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264" status: 200 len: 1522 microversion: 2.1 time: 0.172827 Jun 10 18:00:07.291794 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 422/851] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:07 2022] GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:07.294808 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-85b29e2b-db00-4c7a-a7d7-98c67ee6c914 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] [instance: 42863b6d-5afb-46d7-9ec6-592145bba6e0] Going to try to live migrate instance to chh2-master-2 {{(pid=126594) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 10 18:00:07.300531 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-6cd8f97f-1cdf-481e-99bc-568dec19cd08 req-d52b5043-aa22-4c36-b460-a138c5d333c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63", "tag": "9123aa43-baae-4951-a005-f47283092a90"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:07.305294 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-6cd8f97f-1cdf-481e-99bc-568dec19cd08 req-d52b5043-aa22-4c36-b460-a138c5d333c6 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:07.305787 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-6cd8f97f-1cdf-481e-99bc-568dec19cd08 req-d52b5043-aa22-4c36-b460-a138c5d333c6 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:07.317955 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-6cd8f97f-1cdf-481e-99bc-568dec19cd08 req-d52b5043-aa22-4c36-b460-a138c5d333c6 service nova] Creating event network-changed:9123aa43-baae-4951-a005-f47283092a90 for instance ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63 on chh2-master-2 Jun 10 18:00:07.323295 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-6cd8f97f-1cdf-481e-99bc-568dec19cd08 req-d52b5043-aa22-4c36-b460-a138c5d333c6 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030166 Jun 10 18:00:07.323879 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 423/852] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:00:07.407787 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8ca804e9-a2cf-4f31-a6d6-704daf68de18 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:07.409147 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8ca804e9-a2cf-4f31-a6d6-704daf68de18 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:07.415366 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8ca804e9-a2cf-4f31-a6d6-704daf68de18 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:07.415751 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8ca804e9-a2cf-4f31-a6d6-704daf68de18 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:07.416577 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8ca804e9-a2cf-4f31-a6d6-704daf68de18 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:07.417018 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8ca804e9-a2cf-4f31-a6d6-704daf68de18 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:07.569002 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8ca804e9-a2cf-4f31-a6d6-704daf68de18 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:07.577890 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8ca804e9-a2cf-4f31-a6d6-704daf68de18 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1476 microversion: 2.1 time: 0.173722 Jun 10 18:00:07.578812 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 424/853] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:07 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1476 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:07.741142 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-96af7fcd-77dd-4c8f-997b-7e14c55247d8 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:07.742058 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-96af7fcd-77dd-4c8f-997b-7e14c55247d8 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:07.756337 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-96af7fcd-77dd-4c8f-997b-7e14c55247d8 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:07.756961 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-96af7fcd-77dd-4c8f-997b-7e14c55247d8 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:07.757868 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-96af7fcd-77dd-4c8f-997b-7e14c55247d8 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:07.758424 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-96af7fcd-77dd-4c8f-997b-7e14c55247d8 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:07.823718 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-96af7fcd-77dd-4c8f-997b-7e14c55247d8 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:07.831889 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-96af7fcd-77dd-4c8f-997b-7e14c55247d8 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1221 microversion: 2.1 time: 0.094662 Jun 10 18:00:07.832477 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 425/854] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:07 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1221 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:07.915215 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a898d8c2-8585-4ae4-9596-5343d61f6667 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:07.916127 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a898d8c2-8585-4ae4-9596-5343d61f6667 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: dea27a27-b11b-445c-b811-e852cd66e197] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:07.923542 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a898d8c2-8585-4ae4-9596-5343d61f6667 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:07.924080 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a898d8c2-8585-4ae4-9596-5343d61f6667 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:07.925360 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a898d8c2-8585-4ae4-9596-5343d61f6667 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:07.926070 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a898d8c2-8585-4ae4-9596-5343d61f6667 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:08.082727 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a898d8c2-8585-4ae4-9596-5343d61f6667 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:08.094422 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a898d8c2-8585-4ae4-9596-5343d61f6667 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197" status: 200 len: 1502 microversion: 2.1 time: 0.184387 Jun 10 18:00:08.095962 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 426/855] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:07 2022] GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197 => generated 1502 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:08.121946 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-e55db363-6cb7-4b08-a75b-29d8e0866be2 req-a86a0dc0-510b-46c3-ba05-3eb1b6156afa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab0caf46-568d-4b5a-bd31-458cdc99b06f", "name": "network-vif-plugged", "status": "completed", "tag": "fe140919-8d1b-4aeb-a134-324a13655f62"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:08.142166 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-e55db363-6cb7-4b08-a75b-29d8e0866be2 req-a86a0dc0-510b-46c3-ba05-3eb1b6156afa service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:08.143398 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-e55db363-6cb7-4b08-a75b-29d8e0866be2 req-a86a0dc0-510b-46c3-ba05-3eb1b6156afa service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:08.157662 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-e55db363-6cb7-4b08-a75b-29d8e0866be2 req-a86a0dc0-510b-46c3-ba05-3eb1b6156afa service nova] Creating event network-vif-plugged:fe140919-8d1b-4aeb-a134-324a13655f62 for instance ab0caf46-568d-4b5a-bd31-458cdc99b06f on chh1-master-2 Jun 10 18:00:08.163769 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-e55db363-6cb7-4b08-a75b-29d8e0866be2 req-a86a0dc0-510b-46c3-ba05-3eb1b6156afa service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047251 Jun 10 18:00:08.164727 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 427/856] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:00:08.171429 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-986d583c-98fc-4455-bdbb-a5a42fd00c1a tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:08.173887 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-986d583c-98fc-4455-bdbb-a5a42fd00c1a tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: 96576f7e-6227-41c7-92fd-30b88f961560] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:08.188109 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-986d583c-98fc-4455-bdbb-a5a42fd00c1a tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:08.188109 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-986d583c-98fc-4455-bdbb-a5a42fd00c1a tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:08.188109 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-986d583c-98fc-4455-bdbb-a5a42fd00c1a tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:08.188109 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-986d583c-98fc-4455-bdbb-a5a42fd00c1a tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:08.485036 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-986d583c-98fc-4455-bdbb-a5a42fd00c1a tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:08.495016 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-986d583c-98fc-4455-bdbb-a5a42fd00c1a tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560" status: 200 len: 1313 microversion: 2.1 time: 0.328627 Jun 10 18:00:08.505212 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 428/857] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:08 2022] GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560 => generated 1313 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:08.505816 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a39eb125-5b36-4cc5-b062-b3f19975e136 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:08.506646 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a39eb125-5b36-4cc5-b062-b3f19975e136 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: f4f44795-d87b-4032-a9b4-4ce68336f264] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:08.513546 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a39eb125-5b36-4cc5-b062-b3f19975e136 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:08.514039 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a39eb125-5b36-4cc5-b062-b3f19975e136 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:08.515413 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a39eb125-5b36-4cc5-b062-b3f19975e136 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:08.515859 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a39eb125-5b36-4cc5-b062-b3f19975e136 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:08.542797 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:00:08.686151 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a39eb125-5b36-4cc5-b062-b3f19975e136 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:08.700856 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a39eb125-5b36-4cc5-b062-b3f19975e136 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264" status: 200 len: 1522 microversion: 2.1 time: 0.198317 Jun 10 18:00:08.700856 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 429/858] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:08 2022] GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:08.709337 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c9a1366f-bb16-4fd7-a5e0-37c90997f9a5 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:08.710102 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c9a1366f-bb16-4fd7-a5e0-37c90997f9a5 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:08.724563 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9a1366f-bb16-4fd7-a5e0-37c90997f9a5 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:08.725255 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9a1366f-bb16-4fd7-a5e0-37c90997f9a5 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:08.725821 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9a1366f-bb16-4fd7-a5e0-37c90997f9a5 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:08.726238 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9a1366f-bb16-4fd7-a5e0-37c90997f9a5 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:08.908818 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c9a1366f-bb16-4fd7-a5e0-37c90997f9a5 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:08.918650 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c9a1366f-bb16-4fd7-a5e0-37c90997f9a5 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1476 microversion: 2.1 time: 0.216755 Jun 10 18:00:08.919550 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 430/859] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:08 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1476 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:08.931624 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b44b37ac-1cc7-470f-a2c4-6bc94f34571f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:08.932521 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b44b37ac-1cc7-470f-a2c4-6bc94f34571f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:08.941277 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b44b37ac-1cc7-470f-a2c4-6bc94f34571f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:08.941962 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b44b37ac-1cc7-470f-a2c4-6bc94f34571f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:08.942756 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b44b37ac-1cc7-470f-a2c4-6bc94f34571f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:08.943195 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b44b37ac-1cc7-470f-a2c4-6bc94f34571f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:09.035114 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b44b37ac-1cc7-470f-a2c4-6bc94f34571f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:09.044336 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b44b37ac-1cc7-470f-a2c4-6bc94f34571f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1269 microversion: 2.1 time: 0.122348 Jun 10 18:00:09.044903 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 431/860] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:08 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1269 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:09.112959 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3988cb9d-6c54-4149-bdd1-0aa99eb0716f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:09.113600 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3988cb9d-6c54-4149-bdd1-0aa99eb0716f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: dea27a27-b11b-445c-b811-e852cd66e197] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:09.119752 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3988cb9d-6c54-4149-bdd1-0aa99eb0716f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:09.127162 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3988cb9d-6c54-4149-bdd1-0aa99eb0716f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:09.127162 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3988cb9d-6c54-4149-bdd1-0aa99eb0716f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:09.127162 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3988cb9d-6c54-4149-bdd1-0aa99eb0716f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:09.300939 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3988cb9d-6c54-4149-bdd1-0aa99eb0716f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:09.310288 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3988cb9d-6c54-4149-bdd1-0aa99eb0716f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197" status: 200 len: 1502 microversion: 2.1 time: 0.201581 Jun 10 18:00:09.311688 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 432/861] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:09 2022] GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197 => generated 1502 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:09.511828 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-70b1a97f-7c23-42c9-9db9-5026279f62db tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:09.512483 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-70b1a97f-7c23-42c9-9db9-5026279f62db tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: 96576f7e-6227-41c7-92fd-30b88f961560] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:09.519269 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70b1a97f-7c23-42c9-9db9-5026279f62db tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:09.519787 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70b1a97f-7c23-42c9-9db9-5026279f62db tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:09.520552 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70b1a97f-7c23-42c9-9db9-5026279f62db tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:09.521190 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70b1a97f-7c23-42c9-9db9-5026279f62db tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:09.671187 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-70b1a97f-7c23-42c9-9db9-5026279f62db tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:09.679344 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-70b1a97f-7c23-42c9-9db9-5026279f62db tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560" status: 200 len: 1313 microversion: 2.1 time: 0.171269 Jun 10 18:00:09.690543 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 433/862] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:09 2022] GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:09.719114 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-622a1747-bd80-4620-9fe0-fe6a8c59bcf2 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:09.720040 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-622a1747-bd80-4620-9fe0-fe6a8c59bcf2 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: f4f44795-d87b-4032-a9b4-4ce68336f264] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:09.726956 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-622a1747-bd80-4620-9fe0-fe6a8c59bcf2 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:09.727424 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-622a1747-bd80-4620-9fe0-fe6a8c59bcf2 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:09.728211 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-622a1747-bd80-4620-9fe0-fe6a8c59bcf2 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:09.728689 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-622a1747-bd80-4620-9fe0-fe6a8c59bcf2 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:09.898698 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-622a1747-bd80-4620-9fe0-fe6a8c59bcf2 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:09.898698 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-622a1747-bd80-4620-9fe0-fe6a8c59bcf2 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264" status: 200 len: 1522 microversion: 2.1 time: 0.184270 Jun 10 18:00:09.907641 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 434/863] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:09 2022] GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:09.936876 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6195a703-5d32-4ad3-afda-9526a29198cc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:09.937709 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6195a703-5d32-4ad3-afda-9526a29198cc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:09.943832 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6195a703-5d32-4ad3-afda-9526a29198cc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:09.944295 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6195a703-5d32-4ad3-afda-9526a29198cc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:09.945106 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6195a703-5d32-4ad3-afda-9526a29198cc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:09.945550 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6195a703-5d32-4ad3-afda-9526a29198cc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:10.083294 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6195a703-5d32-4ad3-afda-9526a29198cc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:10.091222 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6195a703-5d32-4ad3-afda-9526a29198cc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1476 microversion: 2.1 time: 0.158514 Jun 10 18:00:10.091910 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 435/864] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:09 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1476 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:10.097612 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-45603a2b-621d-444c-bcd6-dab9c4ecf56f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:10.097967 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-45603a2b-621d-444c-bcd6-dab9c4ecf56f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:10.103742 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45603a2b-621d-444c-bcd6-dab9c4ecf56f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:10.104201 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45603a2b-621d-444c-bcd6-dab9c4ecf56f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:10.105020 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45603a2b-621d-444c-bcd6-dab9c4ecf56f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:10.106224 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45603a2b-621d-444c-bcd6-dab9c4ecf56f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:10.253169 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-45603a2b-621d-444c-bcd6-dab9c4ecf56f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:10.258249 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-45603a2b-621d-444c-bcd6-dab9c4ecf56f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1317 microversion: 2.1 time: 0.165304 Jun 10 18:00:10.258816 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 436/865] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:10 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:10.327500 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6a5f42b2-a277-4c67-b9b1-aaa6ff5598d6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:10.328249 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6a5f42b2-a277-4c67-b9b1-aaa6ff5598d6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: dea27a27-b11b-445c-b811-e852cd66e197] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:10.334818 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a5f42b2-a277-4c67-b9b1-aaa6ff5598d6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:10.335658 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a5f42b2-a277-4c67-b9b1-aaa6ff5598d6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:10.336435 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a5f42b2-a277-4c67-b9b1-aaa6ff5598d6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:10.336886 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a5f42b2-a277-4c67-b9b1-aaa6ff5598d6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:10.481894 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6a5f42b2-a277-4c67-b9b1-aaa6ff5598d6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:10.489325 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6a5f42b2-a277-4c67-b9b1-aaa6ff5598d6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197" status: 200 len: 1502 microversion: 2.1 time: 0.166222 Jun 10 18:00:10.489914 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 437/866] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:10 2022] GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197 => generated 1502 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:10.697777 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ecb8e9f0-1952-4b66-97a7-fdaf7277bc98 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:10.698579 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ecb8e9f0-1952-4b66-97a7-fdaf7277bc98 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: 96576f7e-6227-41c7-92fd-30b88f961560] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:10.705895 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ecb8e9f0-1952-4b66-97a7-fdaf7277bc98 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:10.706634 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ecb8e9f0-1952-4b66-97a7-fdaf7277bc98 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:10.707499 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ecb8e9f0-1952-4b66-97a7-fdaf7277bc98 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:10.708015 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ecb8e9f0-1952-4b66-97a7-fdaf7277bc98 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:11.068799 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ecb8e9f0-1952-4b66-97a7-fdaf7277bc98 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:11.076289 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ecb8e9f0-1952-4b66-97a7-fdaf7277bc98 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560" status: 200 len: 1313 microversion: 2.1 time: 0.382911 Jun 10 18:00:11.076884 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 438/867] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:10 2022] GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560 => generated 1313 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:11.081234 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b4708f11-d0ec-41c8-9643-fc8efca5e24c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:11.081833 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b4708f11-d0ec-41c8-9643-fc8efca5e24c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: f4f44795-d87b-4032-a9b4-4ce68336f264] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:11.087543 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b4708f11-d0ec-41c8-9643-fc8efca5e24c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:11.087993 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b4708f11-d0ec-41c8-9643-fc8efca5e24c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:11.088812 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b4708f11-d0ec-41c8-9643-fc8efca5e24c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:11.089255 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b4708f11-d0ec-41c8-9643-fc8efca5e24c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:11.226839 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b4708f11-d0ec-41c8-9643-fc8efca5e24c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:11.235364 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b4708f11-d0ec-41c8-9643-fc8efca5e24c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264" status: 200 len: 1522 microversion: 2.1 time: 0.157541 Jun 10 18:00:11.235943 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 439/868] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:11 2022] GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:11.240562 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-13a61e11-15f4-47d1-9f5d-ed354a4d7d82 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:11.241167 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-13a61e11-15f4-47d1-9f5d-ed354a4d7d82 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:11.247257 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-13a61e11-15f4-47d1-9f5d-ed354a4d7d82 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:11.247705 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-13a61e11-15f4-47d1-9f5d-ed354a4d7d82 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:11.248960 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-13a61e11-15f4-47d1-9f5d-ed354a4d7d82 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:11.249100 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-85b29e2b-db00-4c7a-a7d7-98c67ee6c914 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] 10.222.0.35 "POST /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0/action" status: 202 len: 0 microversion: 2.25 time: 4.030876 Jun 10 18:00:11.249528 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-13a61e11-15f4-47d1-9f5d-ed354a4d7d82 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:11.250896 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 430/869] 10.222.0.35 () {62 vars in 1318 bytes} [Fri Jun 10 18:00:07 2022] POST /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0/action => generated 0 bytes in 4033 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 10 18:00:11.259048 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4f89a19e-8426-4660-a20d-577e54936406 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:11.259635 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4f89a19e-8426-4660-a20d-577e54936406 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: 42863b6d-5afb-46d7-9ec6-592145bba6e0] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:11.267046 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4f89a19e-8426-4660-a20d-577e54936406 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:11.267750 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4f89a19e-8426-4660-a20d-577e54936406 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:11.268561 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4f89a19e-8426-4660-a20d-577e54936406 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:11.268999 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4f89a19e-8426-4660-a20d-577e54936406 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:11.394791 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-13a61e11-15f4-47d1-9f5d-ed354a4d7d82 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:11.406851 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-13a61e11-15f4-47d1-9f5d-ed354a4d7d82 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1476 microversion: 2.1 time: 0.167317 Jun 10 18:00:11.406851 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 440/870] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:11 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1476 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:11.412223 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1faa0e76-21c6-4901-8e26-84473d005051 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:11.413294 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1faa0e76-21c6-4901-8e26-84473d005051 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:11.421439 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1faa0e76-21c6-4901-8e26-84473d005051 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:11.422195 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1faa0e76-21c6-4901-8e26-84473d005051 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:11.422996 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1faa0e76-21c6-4901-8e26-84473d005051 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:11.423624 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1faa0e76-21c6-4901-8e26-84473d005051 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:11.460573 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4f89a19e-8426-4660-a20d-577e54936406 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:11.466727 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4f89a19e-8426-4660-a20d-577e54936406 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:11.469334 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4f89a19e-8426-4660-a20d-577e54936406 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:11.470540 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4f89a19e-8426-4660-a20d-577e54936406 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0" status: 200 len: 1568 microversion: 2.25 time: 0.216068 Jun 10 18:00:11.471227 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 431/871] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:11 2022] GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0 => generated 1568 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:00:11.511006 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3b1413ea-355c-4892-a1c5-c5380ea74746 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:11.511006 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3b1413ea-355c-4892-a1c5-c5380ea74746 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: dea27a27-b11b-445c-b811-e852cd66e197] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:11.515848 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3b1413ea-355c-4892-a1c5-c5380ea74746 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:11.516329 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3b1413ea-355c-4892-a1c5-c5380ea74746 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:11.517139 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3b1413ea-355c-4892-a1c5-c5380ea74746 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:11.517588 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3b1413ea-355c-4892-a1c5-c5380ea74746 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:11.574763 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1faa0e76-21c6-4901-8e26-84473d005051 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:11.585697 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1faa0e76-21c6-4901-8e26-84473d005051 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1317 microversion: 2.1 time: 0.178310 Jun 10 18:00:11.586297 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 441/872] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:11 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:11.732710 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3b1413ea-355c-4892-a1c5-c5380ea74746 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:11.741438 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3b1413ea-355c-4892-a1c5-c5380ea74746 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197" status: 200 len: 1502 microversion: 2.1 time: 0.239159 Jun 10 18:00:11.742107 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 432/873] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:11 2022] GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197 => generated 1502 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:11.934270 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-7cfab00a-4bb2-4fd1-bdba-376c827d3585 req-6df4bf32-e0eb-4549-b6de-25f3bdeff469 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e0a785e-3a8a-466c-bcd0-c21ecf5c30be", "tag": "24714ded-ea47-4891-9cd5-75d3ab6c0a9c"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:11.942898 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-7cfab00a-4bb2-4fd1-bdba-376c827d3585 req-6df4bf32-e0eb-4549-b6de-25f3bdeff469 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:11.943499 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-7cfab00a-4bb2-4fd1-bdba-376c827d3585 req-6df4bf32-e0eb-4549-b6de-25f3bdeff469 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:11.955428 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-7cfab00a-4bb2-4fd1-bdba-376c827d3585 req-6df4bf32-e0eb-4549-b6de-25f3bdeff469 service nova] Creating event network-changed:24714ded-ea47-4891-9cd5-75d3ab6c0a9c for instance 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be on chh2-master-2 Jun 10 18:00:11.960358 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-7cfab00a-4bb2-4fd1-bdba-376c827d3585 req-6df4bf32-e0eb-4549-b6de-25f3bdeff469 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030018 Jun 10 18:00:11.961041 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 442/874] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:00:12.093774 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-dfbcbf0e-d8d8-41a7-980f-fe0e63e20955 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:12.094414 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-dfbcbf0e-d8d8-41a7-980f-fe0e63e20955 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: 96576f7e-6227-41c7-92fd-30b88f961560] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:12.100881 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dfbcbf0e-d8d8-41a7-980f-fe0e63e20955 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:12.101334 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dfbcbf0e-d8d8-41a7-980f-fe0e63e20955 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:12.102186 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dfbcbf0e-d8d8-41a7-980f-fe0e63e20955 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:12.102636 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dfbcbf0e-d8d8-41a7-980f-fe0e63e20955 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:12.254476 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8f89681b-0bd1-49ab-8329-6ccaab7a99cc tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:12.255950 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8f89681b-0bd1-49ab-8329-6ccaab7a99cc tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: f4f44795-d87b-4032-a9b4-4ce68336f264] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:12.262057 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8f89681b-0bd1-49ab-8329-6ccaab7a99cc tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:12.262844 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8f89681b-0bd1-49ab-8329-6ccaab7a99cc tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:12.264052 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8f89681b-0bd1-49ab-8329-6ccaab7a99cc tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:12.265420 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8f89681b-0bd1-49ab-8329-6ccaab7a99cc tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:12.339633 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-dfbcbf0e-d8d8-41a7-980f-fe0e63e20955 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:12.353622 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-dfbcbf0e-d8d8-41a7-980f-fe0e63e20955 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560" status: 200 len: 1313 microversion: 2.1 time: 0.263303 Jun 10 18:00:12.354675 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 433/875] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:12 2022] GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560 => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:12.428151 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-282bd57a-bec2-40f1-a8f5-029ff9cbd85a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:12.432800 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-282bd57a-bec2-40f1-a8f5-029ff9cbd85a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:12.437786 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8f89681b-0bd1-49ab-8329-6ccaab7a99cc tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:12.440332 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-282bd57a-bec2-40f1-a8f5-029ff9cbd85a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:12.440927 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-282bd57a-bec2-40f1-a8f5-029ff9cbd85a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:12.441812 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-282bd57a-bec2-40f1-a8f5-029ff9cbd85a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:12.442326 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-282bd57a-bec2-40f1-a8f5-029ff9cbd85a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:12.450201 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8f89681b-0bd1-49ab-8329-6ccaab7a99cc tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264" status: 200 len: 1522 microversion: 2.1 time: 0.201571 Jun 10 18:00:12.451241 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 443/876] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:12 2022] GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:12.492592 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f9ec6e5b-2631-4bda-9ff6-b6c9d15f56ef tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:12.497418 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f9ec6e5b-2631-4bda-9ff6-b6c9d15f56ef tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: 42863b6d-5afb-46d7-9ec6-592145bba6e0] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:12.502032 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f9ec6e5b-2631-4bda-9ff6-b6c9d15f56ef tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:12.502673 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f9ec6e5b-2631-4bda-9ff6-b6c9d15f56ef tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:12.503440 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f9ec6e5b-2631-4bda-9ff6-b6c9d15f56ef tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:12.503874 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f9ec6e5b-2631-4bda-9ff6-b6c9d15f56ef tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:12.616261 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-282bd57a-bec2-40f1-a8f5-029ff9cbd85a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:12.626689 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-282bd57a-bec2-40f1-a8f5-029ff9cbd85a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1476 microversion: 2.1 time: 0.206638 Jun 10 18:00:12.627918 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 434/877] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:12 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1476 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:12.642237 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-afeee2f3-4e89-4a49-a9f3-4ac41389eceb tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:12.643356 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-afeee2f3-4e89-4a49-a9f3-4ac41389eceb tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:12.658233 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-afeee2f3-4e89-4a49-a9f3-4ac41389eceb tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:12.659919 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-afeee2f3-4e89-4a49-a9f3-4ac41389eceb tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:12.662007 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-afeee2f3-4e89-4a49-a9f3-4ac41389eceb tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:12.662614 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-afeee2f3-4e89-4a49-a9f3-4ac41389eceb tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:12.670573 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:00:12.674311 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f9ec6e5b-2631-4bda-9ff6-b6c9d15f56ef tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:12.687215 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f9ec6e5b-2631-4bda-9ff6-b6c9d15f56ef tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:12.689661 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f9ec6e5b-2631-4bda-9ff6-b6c9d15f56ef tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:12.691125 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f9ec6e5b-2631-4bda-9ff6-b6c9d15f56ef tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0" status: 200 len: 1568 microversion: 2.25 time: 0.203778 Jun 10 18:00:12.692345 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 444/878] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:12 2022] GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0 => generated 1568 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:00:12.759763 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-07d878ee-4547-4386-9d67-436e45f0070f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:12.760817 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-07d878ee-4547-4386-9d67-436e45f0070f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: dea27a27-b11b-445c-b811-e852cd66e197] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:12.768726 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-07d878ee-4547-4386-9d67-436e45f0070f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:12.769589 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-07d878ee-4547-4386-9d67-436e45f0070f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:12.770581 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-07d878ee-4547-4386-9d67-436e45f0070f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:12.771287 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-07d878ee-4547-4386-9d67-436e45f0070f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:12.959999 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-07d878ee-4547-4386-9d67-436e45f0070f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:12.968482 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-07d878ee-4547-4386-9d67-436e45f0070f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197" status: 200 len: 1492 microversion: 2.1 time: 0.213145 Jun 10 18:00:12.969148 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 445/879] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:12 2022] GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197 => generated 1492 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:12.972119 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-afeee2f3-4e89-4a49-a9f3-4ac41389eceb tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:12.973698 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-5bff1c89-5062-4384-94b8-ee15f30e425c req-cdc94e8b-9fc5-45dc-84c8-20ec72a8458a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96576f7e-6227-41c7-92fd-30b88f961560", "name": "network-vif-plugged", "status": "completed", "tag": "75910fb8-9d43-4249-846f-06aa6225ad07"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:12.979573 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-afeee2f3-4e89-4a49-a9f3-4ac41389eceb tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1317 microversion: 2.1 time: 0.350360 Jun 10 18:00:12.981118 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 435/880] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:12 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1317 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:12.985892 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-5bff1c89-5062-4384-94b8-ee15f30e425c req-cdc94e8b-9fc5-45dc-84c8-20ec72a8458a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:12.986542 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-5bff1c89-5062-4384-94b8-ee15f30e425c req-cdc94e8b-9fc5-45dc-84c8-20ec72a8458a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:12.987801 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-34e16e46-dd04-4c26-92b0-93c2a08a8263 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Calling method '.version_select at 0x7f77c0dfd5e0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:12.996137 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-34e16e46-dd04-4c26-92b0-93c2a08a8263 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:13.000401 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-34e16e46-dd04-4c26-92b0-93c2a08a8263 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:13.000540 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-5bff1c89-5062-4384-94b8-ee15f30e425c req-cdc94e8b-9fc5-45dc-84c8-20ec72a8458a service nova] Creating event network-vif-plugged:75910fb8-9d43-4249-846f-06aa6225ad07 for instance 96576f7e-6227-41c7-92fd-30b88f961560 on chh2-master-2 Jun 10 18:00:13.004880 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-5bff1c89-5062-4384-94b8-ee15f30e425c req-cdc94e8b-9fc5-45dc-84c8-20ec72a8458a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034553 Jun 10 18:00:13.005687 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 446/881] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:00:13.016585 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-34e16e46-dd04-4c26-92b0-93c2a08a8263 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] 10.222.0.35 "GET /compute/v2.1/os-migrations" status: 200 len: 1177 microversion: 2.1 time: 0.034251 Jun 10 18:00:13.017178 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 436/882] 10.222.0.35 () {58 vars in 1142 bytes} [Fri Jun 10 18:00:12 2022] GET /compute/v2.1/os-migrations => generated 1177 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:13.029836 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-97495677-7e66-4dc1-a02e-10cd9a19d624 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:13.031005 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-97495677-7e66-4dc1-a02e-10cd9a19d624 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] [instance: dea27a27-b11b-445c-b811-e852cd66e197] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:13.038419 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-97495677-7e66-4dc1-a02e-10cd9a19d624 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:13.039146 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-97495677-7e66-4dc1-a02e-10cd9a19d624 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:13.040166 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-97495677-7e66-4dc1-a02e-10cd9a19d624 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:13.041270 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-97495677-7e66-4dc1-a02e-10cd9a19d624 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:13.061130 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:00:13.243064 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-97495677-7e66-4dc1-a02e-10cd9a19d624 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197" status: 200 len: 1643 microversion: 2.1 time: 0.217498 Jun 10 18:00:13.243631 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 447/883] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:13 2022] GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197 => generated 1643 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:13.371260 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8aa6a354-caa2-46ea-a448-218e23346028 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:13.371806 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8aa6a354-caa2-46ea-a448-218e23346028 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: 96576f7e-6227-41c7-92fd-30b88f961560] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:13.380661 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8aa6a354-caa2-46ea-a448-218e23346028 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:13.381625 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8aa6a354-caa2-46ea-a448-218e23346028 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:13.383301 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8aa6a354-caa2-46ea-a448-218e23346028 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:13.383762 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8aa6a354-caa2-46ea-a448-218e23346028 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:13.392353 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b5e494b5-5d95-4292-8103-c9358a0c3a8d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1431177043", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "c66faed9-4ff8-42df-b60d-8140becdafb7"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:13.468604 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-b5e494b5-5d95-4292-8103-c9358a0c3a8d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] validate_networks() for [('c66faed9-4ff8-42df-b60d-8140becdafb7', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:00:13.606158 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8aa6a354-caa2-46ea-a448-218e23346028 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:13.615350 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8aa6a354-caa2-46ea-a448-218e23346028 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560" status: 200 len: 1313 microversion: 2.1 time: 0.246922 Jun 10 18:00:13.615350 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 437/884] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:13 2022] GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560 => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:13.620161 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bcb03157-ed5a-42ae-84c9-18d16910d807 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:13.620970 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bcb03157-ed5a-42ae-84c9-18d16910d807 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: f4f44795-d87b-4032-a9b4-4ce68336f264] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:13.629156 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bcb03157-ed5a-42ae-84c9-18d16910d807 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:13.629814 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bcb03157-ed5a-42ae-84c9-18d16910d807 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:13.630771 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bcb03157-ed5a-42ae-84c9-18d16910d807 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:13.631206 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bcb03157-ed5a-42ae-84c9-18d16910d807 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:13.890107 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bcb03157-ed5a-42ae-84c9-18d16910d807 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:13.894561 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-b5e494b5-5d95-4292-8103-c9358a0c3a8d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:00:13.895072 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-b5e494b5-5d95-4292-8103-c9358a0c3a8d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:00:13.895511 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-b5e494b5-5d95-4292-8103-c9358a0c3a8d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:00:13.895850 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-b5e494b5-5d95-4292-8103-c9358a0c3a8d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:00:13.896572 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-b5e494b5-5d95-4292-8103-c9358a0c3a8d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:00:13.899442 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bcb03157-ed5a-42ae-84c9-18d16910d807 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264" status: 200 len: 1522 microversion: 2.1 time: 0.283238 Jun 10 18:00:13.900576 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 438/885] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:13 2022] GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264 => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:13.903574 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=37 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:00:13.910311 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5f21129e-150b-4835-90a6-a4c6ea54b36f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:13.910930 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5f21129e-150b-4835-90a6-a4c6ea54b36f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:13.912914 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5e494b5-5d95-4292-8103-c9358a0c3a8d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:13.913371 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5e494b5-5d95-4292-8103-c9358a0c3a8d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:13.914183 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5e494b5-5d95-4292-8103-c9358a0c3a8d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:13.914626 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5e494b5-5d95-4292-8103-c9358a0c3a8d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:13.917547 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f21129e-150b-4835-90a6-a4c6ea54b36f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:13.918002 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f21129e-150b-4835-90a6-a4c6ea54b36f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:13.918827 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f21129e-150b-4835-90a6-a4c6ea54b36f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:13.919460 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f21129e-150b-4835-90a6-a4c6ea54b36f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:13.935303 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-b5e494b5-5d95-4292-8103-c9358a0c3a8d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Getting quotas for project c96da7ef0cbc46b594ec327ddf875f7a. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:00:13.942197 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-b5e494b5-5d95-4292-8103-c9358a0c3a8d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Getting quotas for user d0f741e8506743a8b51251b3019b3ad5 and project c96da7ef0cbc46b594ec327ddf875f7a. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:00:13.956529 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b5e494b5-5d95-4292-8103-c9358a0c3a8d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:00:13.958875 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b5e494b5-5d95-4292-8103-c9358a0c3a8d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:00:14.083208 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5f21129e-150b-4835-90a6-a4c6ea54b36f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:14.090831 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5f21129e-150b-4835-90a6-a4c6ea54b36f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1475 microversion: 2.1 time: 0.188793 Jun 10 18:00:14.091416 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 439/886] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:13 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1475 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:14.096218 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1a5d0c8d-8077-4b3a-b158-50ace4a28339 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:14.096950 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1a5d0c8d-8077-4b3a-b158-50ace4a28339 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: 42863b6d-5afb-46d7-9ec6-592145bba6e0] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:14.103195 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1a5d0c8d-8077-4b3a-b158-50ace4a28339 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:14.103663 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1a5d0c8d-8077-4b3a-b158-50ace4a28339 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:14.104472 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1a5d0c8d-8077-4b3a-b158-50ace4a28339 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:14.104922 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1a5d0c8d-8077-4b3a-b158-50ace4a28339 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:14.118067 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b5e494b5-5d95-4292-8103-c9358a0c3a8d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.730348 Jun 10 18:00:14.119057 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 448/887] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:00:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 10 18:00:14.123469 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-154fa893-3338-48a4-a50e-00ef995d48ee req-d8b342c6-28b6-44ec-bd2a-457adf686eea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f344351-d882-4028-98db-751266b3d74d", "name": "network-vif-unplugged", "status": "completed", "tag": "7a719916-3937-4cb7-b0d4-e5842975b4c3"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:14.132584 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-154fa893-3338-48a4-a50e-00ef995d48ee req-d8b342c6-28b6-44ec-bd2a-457adf686eea service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:14.133035 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-154fa893-3338-48a4-a50e-00ef995d48ee req-d8b342c6-28b6-44ec-bd2a-457adf686eea service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:14.157981 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-154fa893-3338-48a4-a50e-00ef995d48ee req-d8b342c6-28b6-44ec-bd2a-457adf686eea service nova] Creating event network-vif-unplugged:7a719916-3937-4cb7-b0d4-e5842975b4c3 for instance 2f344351-d882-4028-98db-751266b3d74d on chh2-master-2 Jun 10 18:00:14.171819 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [req-154fa893-3338-48a4-a50e-00ef995d48ee req-d8b342c6-28b6-44ec-bd2a-457adf686eea service nova] Instance 2f344351-d882-4028-98db-751266b3d74d is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 18:00:14.191091 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-154fa893-3338-48a4-a50e-00ef995d48ee req-d8b342c6-28b6-44ec-bd2a-457adf686eea service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071015 Jun 10 18:00:14.192139 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 449/888] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:00:14.199029 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-324a71e2-39fc-4704-8231-16a7ffb01e68 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:14.200188 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-324a71e2-39fc-4704-8231-16a7ffb01e68 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:14.209097 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-324a71e2-39fc-4704-8231-16a7ffb01e68 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:14.209548 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-324a71e2-39fc-4704-8231-16a7ffb01e68 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:14.212558 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-324a71e2-39fc-4704-8231-16a7ffb01e68 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:14.212558 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-324a71e2-39fc-4704-8231-16a7ffb01e68 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:14.321103 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1a5d0c8d-8077-4b3a-b158-50ace4a28339 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:14.344550 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1a5d0c8d-8077-4b3a-b158-50ace4a28339 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:14.346384 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1a5d0c8d-8077-4b3a-b158-50ace4a28339 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:14.348956 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1a5d0c8d-8077-4b3a-b158-50ace4a28339 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0" status: 200 len: 1568 microversion: 2.25 time: 0.255262 Jun 10 18:00:14.351433 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 440/889] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:14 2022] GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0 => generated 1568 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:00:14.365540 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-91368775-6f10-4bfc-8932-78d471b66ef8 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:14.366151 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-91368775-6f10-4bfc-8932-78d471b66ef8 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:14.397108 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-324a71e2-39fc-4704-8231-16a7ffb01e68 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:14.405639 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-324a71e2-39fc-4704-8231-16a7ffb01e68 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1317 microversion: 2.1 time: 0.211338 Jun 10 18:00:14.407127 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 450/890] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:14 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1317 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:14.420433 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-91368775-6f10-4bfc-8932-78d471b66ef8 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:14.429806 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-91368775-6f10-4bfc-8932-78d471b66ef8 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd" status: 200 len: 1211 microversion: 2.1 time: 0.075935 Jun 10 18:00:14.429806 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 441/891] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:14 2022] GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd => generated 1211 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:14.631082 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4361ceda-c6eb-49ed-8ff2-9872b7e7b6a4 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:14.631691 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4361ceda-c6eb-49ed-8ff2-9872b7e7b6a4 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: 96576f7e-6227-41c7-92fd-30b88f961560] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:14.638745 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4361ceda-c6eb-49ed-8ff2-9872b7e7b6a4 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:14.639198 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4361ceda-c6eb-49ed-8ff2-9872b7e7b6a4 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:14.639963 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4361ceda-c6eb-49ed-8ff2-9872b7e7b6a4 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:14.640439 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4361ceda-c6eb-49ed-8ff2-9872b7e7b6a4 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:14.769631 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4361ceda-c6eb-49ed-8ff2-9872b7e7b6a4 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:14.775178 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4361ceda-c6eb-49ed-8ff2-9872b7e7b6a4 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560" status: 200 len: 1313 microversion: 2.1 time: 0.147959 Jun 10 18:00:14.775745 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 451/892] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:14 2022] GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:14.916926 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bd86538b-6c6d-4b8e-b553-87c4b5b3a408 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:14.917577 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bd86538b-6c6d-4b8e-b553-87c4b5b3a408 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: f4f44795-d87b-4032-a9b4-4ce68336f264] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:14.925367 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bd86538b-6c6d-4b8e-b553-87c4b5b3a408 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:14.925829 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bd86538b-6c6d-4b8e-b553-87c4b5b3a408 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:14.926866 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bd86538b-6c6d-4b8e-b553-87c4b5b3a408 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:14.927067 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bd86538b-6c6d-4b8e-b553-87c4b5b3a408 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:15.020750 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-4b648cde-6fed-4a11-a224-f4123edf7fac req-4759dbf9-9f32-4781-b529-4dd9b87f3c74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dea27a27-b11b-445c-b811-e852cd66e197", "name": "network-vif-plugged", "status": "completed", "tag": "17c3fdaf-8a01-4c8c-ac51-d926bd2c7869"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:15.029441 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-4b648cde-6fed-4a11-a224-f4123edf7fac req-4759dbf9-9f32-4781-b529-4dd9b87f3c74 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:15.029885 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-4b648cde-6fed-4a11-a224-f4123edf7fac req-4759dbf9-9f32-4781-b529-4dd9b87f3c74 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:15.041175 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-4b648cde-6fed-4a11-a224-f4123edf7fac req-4759dbf9-9f32-4781-b529-4dd9b87f3c74 service nova] Creating event network-vif-plugged:17c3fdaf-8a01-4c8c-ac51-d926bd2c7869 for instance dea27a27-b11b-445c-b811-e852cd66e197 on chh2-master-2 Jun 10 18:00:15.045943 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-4b648cde-6fed-4a11-a224-f4123edf7fac req-4759dbf9-9f32-4781-b529-4dd9b87f3c74 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028919 Jun 10 18:00:15.047407 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 452/893] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:00:15.053436 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bd86538b-6c6d-4b8e-b553-87c4b5b3a408 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:15.060967 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bd86538b-6c6d-4b8e-b553-87c4b5b3a408 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264" status: 200 len: 1522 microversion: 2.1 time: 0.147937 Jun 10 18:00:15.061550 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 442/894] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:14 2022] GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:15.109841 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-11a04cd0-56b0-4fbe-979a-4ffd4b5f4d7a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:15.110542 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-11a04cd0-56b0-4fbe-979a-4ffd4b5f4d7a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:15.116902 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-11a04cd0-56b0-4fbe-979a-4ffd4b5f4d7a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:15.117354 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-11a04cd0-56b0-4fbe-979a-4ffd4b5f4d7a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:15.118164 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-11a04cd0-56b0-4fbe-979a-4ffd4b5f4d7a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:15.118609 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-11a04cd0-56b0-4fbe-979a-4ffd4b5f4d7a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:15.252731 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-11a04cd0-56b0-4fbe-979a-4ffd4b5f4d7a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:15.260081 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-11a04cd0-56b0-4fbe-979a-4ffd4b5f4d7a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1475 microversion: 2.1 time: 0.155101 Jun 10 18:00:15.260670 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 453/895] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:15 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1475 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:15.369259 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-41c8a760-3e8a-4be2-9fe0-88208f295f89 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:15.369868 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-41c8a760-3e8a-4be2-9fe0-88208f295f89 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: 42863b6d-5afb-46d7-9ec6-592145bba6e0] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:15.375824 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-41c8a760-3e8a-4be2-9fe0-88208f295f89 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:15.376271 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-41c8a760-3e8a-4be2-9fe0-88208f295f89 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:15.377064 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-41c8a760-3e8a-4be2-9fe0-88208f295f89 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:15.377517 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-41c8a760-3e8a-4be2-9fe0-88208f295f89 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:15.425330 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b1eefd75-f15e-4bc4-b655-5cb6a73dbe9e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:15.425951 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b1eefd75-f15e-4bc4-b655-5cb6a73dbe9e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:15.432862 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b1eefd75-f15e-4bc4-b655-5cb6a73dbe9e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:15.433330 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b1eefd75-f15e-4bc4-b655-5cb6a73dbe9e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:15.434107 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b1eefd75-f15e-4bc4-b655-5cb6a73dbe9e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:15.434731 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b1eefd75-f15e-4bc4-b655-5cb6a73dbe9e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:15.518046 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-41c8a760-3e8a-4be2-9fe0-88208f295f89 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:15.532611 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-41c8a760-3e8a-4be2-9fe0-88208f295f89 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:15.532611 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-41c8a760-3e8a-4be2-9fe0-88208f295f89 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:15.532611 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-41c8a760-3e8a-4be2-9fe0-88208f295f89 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0" status: 200 len: 1568 microversion: 2.25 time: 0.164118 Jun 10 18:00:15.532859 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 443/896] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:15 2022] GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:00:15.535345 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e1484965-e2c5-45d3-97b8-877faec67994 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:15.535979 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e1484965-e2c5-45d3-97b8-877faec67994 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:15.542509 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e1484965-e2c5-45d3-97b8-877faec67994 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:15.542951 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e1484965-e2c5-45d3-97b8-877faec67994 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:15.543717 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e1484965-e2c5-45d3-97b8-877faec67994 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:15.544158 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e1484965-e2c5-45d3-97b8-877faec67994 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:15.575225 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b1eefd75-f15e-4bc4-b655-5cb6a73dbe9e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:15.583994 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b1eefd75-f15e-4bc4-b655-5cb6a73dbe9e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1317 microversion: 2.1 time: 0.162566 Jun 10 18:00:15.584609 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 454/897] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:15 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:15.606535 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e1484965-e2c5-45d3-97b8-877faec67994 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:15.615185 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e1484965-e2c5-45d3-97b8-877faec67994 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd" status: 200 len: 1207 microversion: 2.1 time: 0.084205 Jun 10 18:00:15.615765 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 444/898] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:15 2022] GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd => generated 1207 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:15.791057 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4ee7770a-3071-4694-a603-ed182e62f919 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:15.791668 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4ee7770a-3071-4694-a603-ed182e62f919 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: 96576f7e-6227-41c7-92fd-30b88f961560] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:15.798448 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ee7770a-3071-4694-a603-ed182e62f919 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:15.798889 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ee7770a-3071-4694-a603-ed182e62f919 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:15.799641 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ee7770a-3071-4694-a603-ed182e62f919 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:15.800072 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ee7770a-3071-4694-a603-ed182e62f919 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:15.928592 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4ee7770a-3071-4694-a603-ed182e62f919 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:15.935992 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4ee7770a-3071-4694-a603-ed182e62f919 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560" status: 200 len: 1313 microversion: 2.1 time: 0.148743 Jun 10 18:00:15.936587 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 455/899] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:15 2022] GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:16.078547 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ce7ff764-fbeb-4e6f-8a45-0f9833f3985c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:16.079205 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ce7ff764-fbeb-4e6f-8a45-0f9833f3985c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: f4f44795-d87b-4032-a9b4-4ce68336f264] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:16.085456 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ce7ff764-fbeb-4e6f-8a45-0f9833f3985c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:16.085909 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ce7ff764-fbeb-4e6f-8a45-0f9833f3985c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:16.086688 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ce7ff764-fbeb-4e6f-8a45-0f9833f3985c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:16.087127 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ce7ff764-fbeb-4e6f-8a45-0f9833f3985c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:16.230498 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-3eba7d93-2e30-4e31-bb88-a74563e092d6 req-1af3d1f0-670a-4eb7-a996-b10eea54810b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f344351-d882-4028-98db-751266b3d74d", "tag": "7a719916-3937-4cb7-b0d4-e5842975b4c3"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:16.239296 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-3eba7d93-2e30-4e31-bb88-a74563e092d6 req-1af3d1f0-670a-4eb7-a996-b10eea54810b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:16.239700 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-3eba7d93-2e30-4e31-bb88-a74563e092d6 req-1af3d1f0-670a-4eb7-a996-b10eea54810b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:16.260862 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-3eba7d93-2e30-4e31-bb88-a74563e092d6 req-1af3d1f0-670a-4eb7-a996-b10eea54810b service nova] Creating event network-changed:7a719916-3937-4cb7-b0d4-e5842975b4c3 for instance 2f344351-d882-4028-98db-751266b3d74d on chh2-master-2 Jun 10 18:00:16.268432 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [req-3eba7d93-2e30-4e31-bb88-a74563e092d6 req-1af3d1f0-670a-4eb7-a996-b10eea54810b service nova] Instance 2f344351-d882-4028-98db-751266b3d74d is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 18:00:16.279970 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-3eba7d93-2e30-4e31-bb88-a74563e092d6 req-1af3d1f0-670a-4eb7-a996-b10eea54810b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053198 Jun 10 18:00:16.280942 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 456/900] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:00:16.287155 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4d81b3e0-7735-42e6-86c4-1c072467598b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:16.288077 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4d81b3e0-7735-42e6-86c4-1c072467598b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:16.294517 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ce7ff764-fbeb-4e6f-8a45-0f9833f3985c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:16.295069 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d81b3e0-7735-42e6-86c4-1c072467598b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:16.295704 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d81b3e0-7735-42e6-86c4-1c072467598b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:16.297140 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d81b3e0-7735-42e6-86c4-1c072467598b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:16.297587 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d81b3e0-7735-42e6-86c4-1c072467598b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:16.304701 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ce7ff764-fbeb-4e6f-8a45-0f9833f3985c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264" status: 200 len: 1522 microversion: 2.1 time: 0.230588 Jun 10 18:00:16.316790 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 445/901] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:16 2022] GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:16.535631 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4d81b3e0-7735-42e6-86c4-1c072467598b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:16.543519 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4d81b3e0-7735-42e6-86c4-1c072467598b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1475 microversion: 2.1 time: 0.261120 Jun 10 18:00:16.544169 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 457/902] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:16 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1475 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:16.548282 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e1b72667-3d60-4f65-bc90-e4f9011697e6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:16.548899 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e1b72667-3d60-4f65-bc90-e4f9011697e6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: 42863b6d-5afb-46d7-9ec6-592145bba6e0] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:16.555047 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e1b72667-3d60-4f65-bc90-e4f9011697e6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:16.559652 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e1b72667-3d60-4f65-bc90-e4f9011697e6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:16.559652 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e1b72667-3d60-4f65-bc90-e4f9011697e6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:16.559652 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e1b72667-3d60-4f65-bc90-e4f9011697e6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:16.601552 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4f441991-5a50-4940-ba69-613f36fed1a9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:16.602167 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4f441991-5a50-4940-ba69-613f36fed1a9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:16.608405 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f441991-5a50-4940-ba69-613f36fed1a9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:16.609499 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f441991-5a50-4940-ba69-613f36fed1a9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:16.610822 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f441991-5a50-4940-ba69-613f36fed1a9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:16.610822 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f441991-5a50-4940-ba69-613f36fed1a9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:16.778998 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e1b72667-3d60-4f65-bc90-e4f9011697e6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:16.794116 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e1b72667-3d60-4f65-bc90-e4f9011697e6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:16.795707 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e1b72667-3d60-4f65-bc90-e4f9011697e6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:16.797407 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e1b72667-3d60-4f65-bc90-e4f9011697e6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0" status: 200 len: 1568 microversion: 2.25 time: 0.254167 Jun 10 18:00:16.808174 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 446/903] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:16 2022] GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0 => generated 1568 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:00:16.808174 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2f8b0296-a8ee-4bc7-beac-82ee59a2f774 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:16.808174 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2f8b0296-a8ee-4bc7-beac-82ee59a2f774 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:16.809740 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2f8b0296-a8ee-4bc7-beac-82ee59a2f774 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:16.810051 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2f8b0296-a8ee-4bc7-beac-82ee59a2f774 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:16.810896 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2f8b0296-a8ee-4bc7-beac-82ee59a2f774 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:16.811256 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2f8b0296-a8ee-4bc7-beac-82ee59a2f774 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:16.894032 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2f8b0296-a8ee-4bc7-beac-82ee59a2f774 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:16.905165 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2f8b0296-a8ee-4bc7-beac-82ee59a2f774 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd" status: 200 len: 1269 microversion: 2.1 time: 0.105766 Jun 10 18:00:16.906486 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 447/904] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:16 2022] GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd => generated 1269 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:16.907813 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4f441991-5a50-4940-ba69-613f36fed1a9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:16.915902 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4f441991-5a50-4940-ba69-613f36fed1a9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1317 microversion: 2.1 time: 0.317968 Jun 10 18:00:16.916684 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 458/905] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:16 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1317 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:16.954418 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-72ad5400-857a-4b19-b880-71f217271d34 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:16.955101 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-72ad5400-857a-4b19-b880-71f217271d34 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: 96576f7e-6227-41c7-92fd-30b88f961560] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:16.962090 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-72ad5400-857a-4b19-b880-71f217271d34 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:16.962683 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-72ad5400-857a-4b19-b880-71f217271d34 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:16.963754 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-72ad5400-857a-4b19-b880-71f217271d34 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:16.964251 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-72ad5400-857a-4b19-b880-71f217271d34 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:17.149980 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-72ad5400-857a-4b19-b880-71f217271d34 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:17.158733 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-72ad5400-857a-4b19-b880-71f217271d34 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560" status: 200 len: 1313 microversion: 2.1 time: 0.209275 Jun 10 18:00:17.159544 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 448/906] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:16 2022] GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560 => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:17.322863 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3597840c-b2cd-4050-b464-861dbde4b852 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:17.323398 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3597840c-b2cd-4050-b464-861dbde4b852 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: f4f44795-d87b-4032-a9b4-4ce68336f264] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:17.326459 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:00:17.330553 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3597840c-b2cd-4050-b464-861dbde4b852 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:17.331192 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3597840c-b2cd-4050-b464-861dbde4b852 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:17.331947 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3597840c-b2cd-4050-b464-861dbde4b852 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:17.332421 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3597840c-b2cd-4050-b464-861dbde4b852 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:17.471693 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3597840c-b2cd-4050-b464-861dbde4b852 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:17.480105 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3597840c-b2cd-4050-b464-861dbde4b852 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264" status: 200 len: 1522 microversion: 2.1 time: 0.161177 Jun 10 18:00:17.480726 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 459/907] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:17 2022] GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:17.561225 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-16b98e60-09b7-4ef5-ac51-de0937f2356b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:17.565299 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-16b98e60-09b7-4ef5-ac51-de0937f2356b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:17.568787 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:00:17.572591 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-16b98e60-09b7-4ef5-ac51-de0937f2356b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:17.573106 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-16b98e60-09b7-4ef5-ac51-de0937f2356b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:17.573807 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-16b98e60-09b7-4ef5-ac51-de0937f2356b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:17.574241 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-16b98e60-09b7-4ef5-ac51-de0937f2356b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:17.764693 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-16b98e60-09b7-4ef5-ac51-de0937f2356b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:17.772472 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-16b98e60-09b7-4ef5-ac51-de0937f2356b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1475 microversion: 2.1 time: 0.215398 Jun 10 18:00:17.773785 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 449/908] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:17 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1475 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:17.816724 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d4a0fe3c-6849-4f5c-9d4c-c6c590fb64a1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:17.817339 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d4a0fe3c-6849-4f5c-9d4c-c6c590fb64a1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: 42863b6d-5afb-46d7-9ec6-592145bba6e0] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:17.824349 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d4a0fe3c-6849-4f5c-9d4c-c6c590fb64a1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:17.824761 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d4a0fe3c-6849-4f5c-9d4c-c6c590fb64a1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:17.825739 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d4a0fe3c-6849-4f5c-9d4c-c6c590fb64a1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:17.826171 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d4a0fe3c-6849-4f5c-9d4c-c6c590fb64a1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:17.924915 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2ce5c40f-9a94-4e8c-a3fb-b55d21f5db95 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:17.924915 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2ce5c40f-9a94-4e8c-a3fb-b55d21f5db95 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:17.932023 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2ce5c40f-9a94-4e8c-a3fb-b55d21f5db95 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:17.932512 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2ce5c40f-9a94-4e8c-a3fb-b55d21f5db95 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:17.933289 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2ce5c40f-9a94-4e8c-a3fb-b55d21f5db95 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:17.933793 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2ce5c40f-9a94-4e8c-a3fb-b55d21f5db95 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:17.965306 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d4a0fe3c-6849-4f5c-9d4c-c6c590fb64a1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:17.975777 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d4a0fe3c-6849-4f5c-9d4c-c6c590fb64a1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:17.977459 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d4a0fe3c-6849-4f5c-9d4c-c6c590fb64a1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:17.978731 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d4a0fe3c-6849-4f5c-9d4c-c6c590fb64a1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0" status: 200 len: 1568 microversion: 2.25 time: 0.166837 Jun 10 18:00:17.979311 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 460/909] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:17 2022] GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:00:17.984793 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e3e4db2f-37be-433a-bd6e-faeb5432ce34 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:17.985401 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e3e4db2f-37be-433a-bd6e-faeb5432ce34 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:17.992803 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e3e4db2f-37be-433a-bd6e-faeb5432ce34 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:17.993402 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e3e4db2f-37be-433a-bd6e-faeb5432ce34 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:17.994242 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e3e4db2f-37be-433a-bd6e-faeb5432ce34 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:17.994683 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e3e4db2f-37be-433a-bd6e-faeb5432ce34 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:18.173984 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e3e4db2f-37be-433a-bd6e-faeb5432ce34 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:18.182612 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e3e4db2f-37be-433a-bd6e-faeb5432ce34 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1317 microversion: 2.1 time: 0.201704 Jun 10 18:00:18.184422 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 461/910] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:17 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1317 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:18.188035 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6e573e6d-0702-438c-bd1f-9c51d3042ec5 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:18.188717 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6e573e6d-0702-438c-bd1f-9c51d3042ec5 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: 96576f7e-6227-41c7-92fd-30b88f961560] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:18.194953 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6e573e6d-0702-438c-bd1f-9c51d3042ec5 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:18.195405 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6e573e6d-0702-438c-bd1f-9c51d3042ec5 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:18.196290 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6e573e6d-0702-438c-bd1f-9c51d3042ec5 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:18.196767 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6e573e6d-0702-438c-bd1f-9c51d3042ec5 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:18.352726 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6e573e6d-0702-438c-bd1f-9c51d3042ec5 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:18.361383 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6e573e6d-0702-438c-bd1f-9c51d3042ec5 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560" status: 200 len: 1313 microversion: 2.1 time: 0.177454 Jun 10 18:00:18.362814 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 462/911] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:18 2022] GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:18.499002 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ee202e92-febf-412d-80f2-f39a28c70d63 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:18.499624 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ee202e92-febf-412d-80f2-f39a28c70d63 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: f4f44795-d87b-4032-a9b4-4ce68336f264] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:18.505887 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee202e92-febf-412d-80f2-f39a28c70d63 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:18.509127 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee202e92-febf-412d-80f2-f39a28c70d63 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:18.509127 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee202e92-febf-412d-80f2-f39a28c70d63 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:18.509127 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee202e92-febf-412d-80f2-f39a28c70d63 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:18.538062 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2ce5c40f-9a94-4e8c-a3fb-b55d21f5db95 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:18.546013 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2ce5c40f-9a94-4e8c-a3fb-b55d21f5db95 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd" status: 200 len: 1311 microversion: 2.1 time: 0.626720 Jun 10 18:00:18.555722 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 450/912] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:17 2022] GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd => generated 1311 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:18.644841 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ee202e92-febf-412d-80f2-f39a28c70d63 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:18.655070 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ee202e92-febf-412d-80f2-f39a28c70d63 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264" status: 200 len: 1522 microversion: 2.1 time: 0.159763 Jun 10 18:00:18.657284 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 463/913] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:18 2022] GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:18.683592 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-805a43bc-004e-44da-ada9-74a7be9c4617 req-3bd48436-2f4e-45c0-b786-33aaa930a48d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd", "tag": "64c42e0e-3ccd-469e-bafd-7ce42fa87561"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:18.688843 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:00:18.693155 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-805a43bc-004e-44da-ada9-74a7be9c4617 req-3bd48436-2f4e-45c0-b786-33aaa930a48d service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:18.693600 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-805a43bc-004e-44da-ada9-74a7be9c4617 req-3bd48436-2f4e-45c0-b786-33aaa930a48d service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:18.706184 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-805a43bc-004e-44da-ada9-74a7be9c4617 req-3bd48436-2f4e-45c0-b786-33aaa930a48d service nova] Creating event network-changed:64c42e0e-3ccd-469e-bafd-7ce42fa87561 for instance 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd on chh1-master-2 Jun 10 18:00:18.711361 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-805a43bc-004e-44da-ada9-74a7be9c4617 req-3bd48436-2f4e-45c0-b786-33aaa930a48d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031468 Jun 10 18:00:18.712355 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 451/914] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:00:18.790023 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3a5e0e56-ccb5-4b0b-ab32-9f3a0ebdb2c5 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:18.793078 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3a5e0e56-ccb5-4b0b-ab32-9f3a0ebdb2c5 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:18.797010 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3a5e0e56-ccb5-4b0b-ab32-9f3a0ebdb2c5 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:18.797465 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3a5e0e56-ccb5-4b0b-ab32-9f3a0ebdb2c5 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:18.798246 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3a5e0e56-ccb5-4b0b-ab32-9f3a0ebdb2c5 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:18.798688 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3a5e0e56-ccb5-4b0b-ab32-9f3a0ebdb2c5 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:18.966604 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3a5e0e56-ccb5-4b0b-ab32-9f3a0ebdb2c5 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:18.975444 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3a5e0e56-ccb5-4b0b-ab32-9f3a0ebdb2c5 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1475 microversion: 2.1 time: 0.189790 Jun 10 18:00:18.976536 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 464/915] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:18 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1475 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:19.000608 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1f8535cd-d507-41cc-98d6-be6a323ca8cf tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:19.001323 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1f8535cd-d507-41cc-98d6-be6a323ca8cf tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: 42863b6d-5afb-46d7-9ec6-592145bba6e0] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:19.007661 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1f8535cd-d507-41cc-98d6-be6a323ca8cf tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:19.008121 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1f8535cd-d507-41cc-98d6-be6a323ca8cf tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:19.008938 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1f8535cd-d507-41cc-98d6-be6a323ca8cf tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:19.009384 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1f8535cd-d507-41cc-98d6-be6a323ca8cf tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:19.199251 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-88b5e778-2a4f-4e39-93ed-046991f68a60 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:19.199869 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-88b5e778-2a4f-4e39-93ed-046991f68a60 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:19.206179 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-88b5e778-2a4f-4e39-93ed-046991f68a60 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:19.206635 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-88b5e778-2a4f-4e39-93ed-046991f68a60 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:19.207417 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-88b5e778-2a4f-4e39-93ed-046991f68a60 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:19.207921 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-88b5e778-2a4f-4e39-93ed-046991f68a60 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:19.401276 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-88b5e778-2a4f-4e39-93ed-046991f68a60 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:19.410224 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-88b5e778-2a4f-4e39-93ed-046991f68a60 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1317 microversion: 2.1 time: 0.215012 Jun 10 18:00:19.420690 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 465/916] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:19 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1317 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:19.426899 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b33d00f5-69f3-49f3-95c1-26408cb9f38d tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:19.427062 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1f8535cd-d507-41cc-98d6-be6a323ca8cf tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:19.427861 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b33d00f5-69f3-49f3-95c1-26408cb9f38d tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: 96576f7e-6227-41c7-92fd-30b88f961560] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:19.434661 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b33d00f5-69f3-49f3-95c1-26408cb9f38d tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:19.435522 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b33d00f5-69f3-49f3-95c1-26408cb9f38d tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:19.436485 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b33d00f5-69f3-49f3-95c1-26408cb9f38d tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:19.441554 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b33d00f5-69f3-49f3-95c1-26408cb9f38d tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:19.441676 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1f8535cd-d507-41cc-98d6-be6a323ca8cf tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:19.441676 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1f8535cd-d507-41cc-98d6-be6a323ca8cf tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:19.442576 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:00:19.444729 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1f8535cd-d507-41cc-98d6-be6a323ca8cf tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0" status: 200 len: 1568 microversion: 2.25 time: 0.446703 Jun 10 18:00:19.445886 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 452/917] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:18 2022] GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0 => generated 1568 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:00:19.564338 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1c5cf83a-1783-431e-9399-ebe6ebe9c792 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:19.565523 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1c5cf83a-1783-431e-9399-ebe6ebe9c792 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:19.571802 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1c5cf83a-1783-431e-9399-ebe6ebe9c792 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:19.572262 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1c5cf83a-1783-431e-9399-ebe6ebe9c792 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:19.573080 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1c5cf83a-1783-431e-9399-ebe6ebe9c792 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:19.573523 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1c5cf83a-1783-431e-9399-ebe6ebe9c792 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:19.662576 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b33d00f5-69f3-49f3-95c1-26408cb9f38d tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:19.674341 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b33d00f5-69f3-49f3-95c1-26408cb9f38d tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560" status: 200 len: 1461 microversion: 2.1 time: 0.251690 Jun 10 18:00:19.675709 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 466/918] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:19 2022] GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560 => generated 1461 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:19.695681 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b74acb02-109e-4ad6-81ce-325f25b63202 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:19.700278 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b74acb02-109e-4ad6-81ce-325f25b63202 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: f4f44795-d87b-4032-a9b4-4ce68336f264] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:19.705053 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b74acb02-109e-4ad6-81ce-325f25b63202 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:19.705794 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b74acb02-109e-4ad6-81ce-325f25b63202 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:19.707277 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b74acb02-109e-4ad6-81ce-325f25b63202 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:19.708039 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b74acb02-109e-4ad6-81ce-325f25b63202 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:19.944638 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b74acb02-109e-4ad6-81ce-325f25b63202 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:19.950130 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1c5cf83a-1783-431e-9399-ebe6ebe9c792 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:19.955693 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b74acb02-109e-4ad6-81ce-325f25b63202 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264" status: 200 len: 1499 microversion: 2.1 time: 0.277949 Jun 10 18:00:19.964472 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 467/919] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:19 2022] GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264 => generated 1499 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:19.973021 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1c5cf83a-1783-431e-9399-ebe6ebe9c792 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd" status: 200 len: 1311 microversion: 2.1 time: 0.413824 Jun 10 18:00:19.982279 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 453/920] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:19 2022] GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd => generated 1311 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:19.982441 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-10d54686-478d-41b6-80d0-6355b7da8950 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:19.982441 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-10d54686-478d-41b6-80d0-6355b7da8950 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:19.989028 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-778fc264-31ed-438f-bd20-284cdc71e7b1 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:19.989121 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-778fc264-31ed-438f-bd20-284cdc71e7b1 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:19.990469 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-778fc264-31ed-438f-bd20-284cdc71e7b1 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '57b54ed932024f378743fa2d2fc36b53'} {{(pid=126594) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 18:00:19.991060 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10d54686-478d-41b6-80d0-6355b7da8950 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:19.991783 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10d54686-478d-41b6-80d0-6355b7da8950 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:19.992807 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10d54686-478d-41b6-80d0-6355b7da8950 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:19.993823 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10d54686-478d-41b6-80d0-6355b7da8950 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:19.997459 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-778fc264-31ed-438f-bd20-284cdc71e7b1 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:19.998382 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-778fc264-31ed-438f-bd20-284cdc71e7b1 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:19.999509 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-778fc264-31ed-438f-bd20-284cdc71e7b1 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:20.000125 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-778fc264-31ed-438f-bd20-284cdc71e7b1 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:20.072501 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:00:20.094697 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.multi_cell_list [None req-778fc264-31ed-438f-bd20-284cdc71e7b1 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126594) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 10 18:00:20.160683 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-778fc264-31ed-438f-bd20-284cdc71e7b1 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.182920 Jun 10 18:00:20.160683 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 454/921] 10.222.0.35 () {58 vars in 1153 bytes} [Fri Jun 10 18:00:19 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:00:20.166803 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-20ed370c-dc62-47eb-af29-5102c4d1e9e6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:20.166803 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-20ed370c-dc62-47eb-af29-5102c4d1e9e6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:20.171459 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-20ed370c-dc62-47eb-af29-5102c4d1e9e6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:20.171848 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-20ed370c-dc62-47eb-af29-5102c4d1e9e6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:20.172664 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-20ed370c-dc62-47eb-af29-5102c4d1e9e6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:20.173111 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-20ed370c-dc62-47eb-af29-5102c4d1e9e6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:20.185776 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-10d54686-478d-41b6-80d0-6355b7da8950 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:20.197361 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-10d54686-478d-41b6-80d0-6355b7da8950 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1461 microversion: 2.1 time: 0.231222 Jun 10 18:00:20.198064 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 468/922] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:19 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1461 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:20.204232 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-af35bb21-3e7b-44bd-9835-7c6fd844ebff tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:20.211753 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-af35bb21-3e7b-44bd-9835-7c6fd844ebff tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:20.212202 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-af35bb21-3e7b-44bd-9835-7c6fd844ebff tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:20.291950 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-af35bb21-3e7b-44bd-9835-7c6fd844ebff tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: f4f44795-d87b-4032-a9b4-4ce68336f264] Going to try to start instance {{(pid=126595) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 10 18:00:20.391236 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-20ed370c-dc62-47eb-af29-5102c4d1e9e6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:20.398786 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-20ed370c-dc62-47eb-af29-5102c4d1e9e6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1473 microversion: 2.1 time: 0.238020 Jun 10 18:00:20.399341 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 455/923] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:20 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1473 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:20.403853 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-48373fdd-6166-466c-aa69-667faf694fdc tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1327204134", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "ab0caf46-568d-4b5a-bd31-458cdc99b06f"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:20.455397 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-48373fdd-6166-466c-aa69-667faf694fdc tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] validate_networks() for None {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:00:20.500058 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-af35bb21-3e7b-44bd-9835-7c6fd844ebff tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "POST /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264/action" status: 202 len: 0 microversion: 2.1 time: 0.299738 Jun 10 18:00:20.500935 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 469/924] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:00:20 2022] POST /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:00:20.510062 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-90ed29d4-f2bf-466d-85b8-4c487f6bc324 req-d306bf56-9772-401d-bf73-12dca0ab9bfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e0a785e-3a8a-466c-bcd0-c21ecf5c30be", "name": "network-vif-plugged", "status": "completed", "tag": "24714ded-ea47-4891-9cd5-75d3ab6c0a9c"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:20.519586 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-90ed29d4-f2bf-466d-85b8-4c487f6bc324 req-d306bf56-9772-401d-bf73-12dca0ab9bfd service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:20.520026 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-90ed29d4-f2bf-466d-85b8-4c487f6bc324 req-d306bf56-9772-401d-bf73-12dca0ab9bfd service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:20.534952 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-90ed29d4-f2bf-466d-85b8-4c487f6bc324 req-d306bf56-9772-401d-bf73-12dca0ab9bfd service nova] Creating event network-vif-plugged:24714ded-ea47-4891-9cd5-75d3ab6c0a9c for instance 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be on chh2-master-2 Jun 10 18:00:20.540208 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-90ed29d4-f2bf-466d-85b8-4c487f6bc324 req-d306bf56-9772-401d-bf73-12dca0ab9bfd service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034732 Jun 10 18:00:20.540848 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 470/925] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:00:20.545854 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bdc442dd-c422-4361-a6d3-881162c3357f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:20.546581 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bdc442dd-c422-4361-a6d3-881162c3357f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:20.552900 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bdc442dd-c422-4361-a6d3-881162c3357f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:20.553352 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bdc442dd-c422-4361-a6d3-881162c3357f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:20.554163 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bdc442dd-c422-4361-a6d3-881162c3357f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:20.554603 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bdc442dd-c422-4361-a6d3-881162c3357f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:20.681807 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-48373fdd-6166-466c-aa69-667faf694fdc tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:00:20.682238 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-48373fdd-6166-466c-aa69-667faf694fdc tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:00:20.682875 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-48373fdd-6166-466c-aa69-667faf694fdc tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:00:20.683294 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-48373fdd-6166-466c-aa69-667faf694fdc tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:00:20.683734 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-48373fdd-6166-466c-aa69-667faf694fdc tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:00:20.693937 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-48373fdd-6166-466c-aa69-667faf694fdc tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:20.694396 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-48373fdd-6166-466c-aa69-667faf694fdc tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:20.695211 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-48373fdd-6166-466c-aa69-667faf694fdc tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:20.695742 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-48373fdd-6166-466c-aa69-667faf694fdc tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:20.695969 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bdc442dd-c422-4361-a6d3-881162c3357f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:20.704248 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bdc442dd-c422-4361-a6d3-881162c3357f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1317 microversion: 2.1 time: 0.162256 Jun 10 18:00:20.704993 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 471/926] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:20 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:20.711954 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7900d6bf-a78f-449b-ba42-d6125ef78698 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:20.712576 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7900d6bf-a78f-449b-ba42-d6125ef78698 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: 42863b6d-5afb-46d7-9ec6-592145bba6e0] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:20.713937 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-48373fdd-6166-466c-aa69-667faf694fdc tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Getting quotas for project c36d8cd6f58f415a90f042aff9eddd85. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:00:20.719040 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7900d6bf-a78f-449b-ba42-d6125ef78698 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:20.719564 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7900d6bf-a78f-449b-ba42-d6125ef78698 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:20.719680 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-48373fdd-6166-466c-aa69-667faf694fdc tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Getting quotas for user 7f050bed1312417f886cdad081809aa1 and project c36d8cd6f58f415a90f042aff9eddd85. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:00:20.725768 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7900d6bf-a78f-449b-ba42-d6125ef78698 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:20.725768 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7900d6bf-a78f-449b-ba42-d6125ef78698 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:20.731885 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-48373fdd-6166-466c-aa69-667faf694fdc tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:00:20.734872 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-48373fdd-6166-466c-aa69-667faf694fdc tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: b09b98a7-d89b-42b8-a3c8-809653486d0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:00:20.858189 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7900d6bf-a78f-449b-ba42-d6125ef78698 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:20.864126 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-48373fdd-6166-466c-aa69-667faf694fdc tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.463685 Jun 10 18:00:20.870089 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 456/927] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:00:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 465 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:00:20.870089 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1e622fba-a41b-4dd4-814b-b01e279bb78a tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:20.870477 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1e622fba-a41b-4dd4-814b-b01e279bb78a tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: f4f44795-d87b-4032-a9b4-4ce68336f264] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:20.873356 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7900d6bf-a78f-449b-ba42-d6125ef78698 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:20.876690 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7900d6bf-a78f-449b-ba42-d6125ef78698 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:20.877078 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7900d6bf-a78f-449b-ba42-d6125ef78698 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0" status: 200 len: 1568 microversion: 2.25 time: 0.168808 Jun 10 18:00:20.877651 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 472/928] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:20 2022] GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:00:20.882470 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-31a9f58e-0f45-49c0-a439-3867dbd9cb23 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:20.883085 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-31a9f58e-0f45-49c0-a439-3867dbd9cb23 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: b09b98a7-d89b-42b8-a3c8-809653486d0f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:20.889407 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1e622fba-a41b-4dd4-814b-b01e279bb78a tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:20.889859 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1e622fba-a41b-4dd4-814b-b01e279bb78a tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:20.890647 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1e622fba-a41b-4dd4-814b-b01e279bb78a tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:20.891092 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1e622fba-a41b-4dd4-814b-b01e279bb78a tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:20.940866 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-31a9f58e-0f45-49c0-a439-3867dbd9cb23 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:20.947879 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-31a9f58e-0f45-49c0-a439-3867dbd9cb23 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/b09b98a7-d89b-42b8-a3c8-809653486d0f" status: 200 len: 1214 microversion: 2.1 time: 0.069180 Jun 10 18:00:20.948727 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 473/929] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:20 2022] GET /compute/v2.1/servers/b09b98a7-d89b-42b8-a3c8-809653486d0f => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:20.990057 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-78eb510c-a34b-4e8e-88fc-c785864258d3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:20.995806 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-78eb510c-a34b-4e8e-88fc-c785864258d3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:20.998456 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-78eb510c-a34b-4e8e-88fc-c785864258d3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:20.999568 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-78eb510c-a34b-4e8e-88fc-c785864258d3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:21.000187 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-78eb510c-a34b-4e8e-88fc-c785864258d3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:21.000943 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-78eb510c-a34b-4e8e-88fc-c785864258d3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:21.040827 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1e622fba-a41b-4dd4-814b-b01e279bb78a tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:21.049898 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1e622fba-a41b-4dd4-814b-b01e279bb78a tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264" status: 200 len: 1508 microversion: 2.1 time: 0.183786 Jun 10 18:00:21.059886 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 457/930] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:20 2022] GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264 => generated 1508 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:21.144031 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-78eb510c-a34b-4e8e-88fc-c785864258d3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:21.151663 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-78eb510c-a34b-4e8e-88fc-c785864258d3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd" status: 200 len: 1311 microversion: 2.1 time: 0.165879 Jun 10 18:00:21.152224 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 474/931] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:20 2022] GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd => generated 1311 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:21.415776 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6d039c49-001d-4554-aa40-ccc0a080bde5 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:21.416673 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6d039c49-001d-4554-aa40-ccc0a080bde5 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:21.424118 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6d039c49-001d-4554-aa40-ccc0a080bde5 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:21.424599 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6d039c49-001d-4554-aa40-ccc0a080bde5 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:21.425359 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6d039c49-001d-4554-aa40-ccc0a080bde5 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:21.425794 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6d039c49-001d-4554-aa40-ccc0a080bde5 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:21.552914 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6d039c49-001d-4554-aa40-ccc0a080bde5 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:21.560266 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6d039c49-001d-4554-aa40-ccc0a080bde5 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1473 microversion: 2.1 time: 0.148385 Jun 10 18:00:21.560880 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 458/932] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:21 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1473 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:21.721442 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-22e7a357-a6bb-455e-a8cf-7ae929349f8f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:21.722074 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-22e7a357-a6bb-455e-a8cf-7ae929349f8f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:21.728159 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-22e7a357-a6bb-455e-a8cf-7ae929349f8f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:21.728656 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-22e7a357-a6bb-455e-a8cf-7ae929349f8f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:21.729460 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-22e7a357-a6bb-455e-a8cf-7ae929349f8f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:21.729902 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-22e7a357-a6bb-455e-a8cf-7ae929349f8f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:21.862313 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-22e7a357-a6bb-455e-a8cf-7ae929349f8f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:21.869731 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-22e7a357-a6bb-455e-a8cf-7ae929349f8f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1317 microversion: 2.1 time: 0.152444 Jun 10 18:00:21.870294 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 475/933] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:21 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:21.895352 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e7c44cc2-7246-4abd-a383-962eb4ec24ad tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:21.895969 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e7c44cc2-7246-4abd-a383-962eb4ec24ad tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: 42863b6d-5afb-46d7-9ec6-592145bba6e0] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:21.902028 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7c44cc2-7246-4abd-a383-962eb4ec24ad tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:21.902481 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7c44cc2-7246-4abd-a383-962eb4ec24ad tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:21.903855 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7c44cc2-7246-4abd-a383-962eb4ec24ad tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:21.903855 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7c44cc2-7246-4abd-a383-962eb4ec24ad tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:21.965381 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2af7669a-4a8a-4e8f-90cb-eab2b88392fb tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:21.965994 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2af7669a-4a8a-4e8f-90cb-eab2b88392fb tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: b09b98a7-d89b-42b8-a3c8-809653486d0f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:21.976076 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2af7669a-4a8a-4e8f-90cb-eab2b88392fb tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:21.978700 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2af7669a-4a8a-4e8f-90cb-eab2b88392fb tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:21.978700 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2af7669a-4a8a-4e8f-90cb-eab2b88392fb tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:21.978700 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2af7669a-4a8a-4e8f-90cb-eab2b88392fb tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:22.041969 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2af7669a-4a8a-4e8f-90cb-eab2b88392fb tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:22.044081 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e7c44cc2-7246-4abd-a383-962eb4ec24ad tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:22.049826 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2af7669a-4a8a-4e8f-90cb-eab2b88392fb tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/b09b98a7-d89b-42b8-a3c8-809653486d0f" status: 200 len: 1210 microversion: 2.1 time: 0.088547 Jun 10 18:00:22.050602 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 476/934] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:21 2022] GET /compute/v2.1/servers/b09b98a7-d89b-42b8-a3c8-809653486d0f => generated 1210 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:22.053089 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e7c44cc2-7246-4abd-a383-962eb4ec24ad tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:22.055935 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e7c44cc2-7246-4abd-a383-962eb4ec24ad tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:22.056077 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e7c44cc2-7246-4abd-a383-962eb4ec24ad tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0" status: 200 len: 1568 microversion: 2.25 time: 0.164560 Jun 10 18:00:22.056656 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 459/935] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:21 2022] GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:00:22.067548 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-68c75bcf-6973-4598-a1c5-16eb9ed207ca tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:22.068124 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-68c75bcf-6973-4598-a1c5-16eb9ed207ca tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: f4f44795-d87b-4032-a9b4-4ce68336f264] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:22.074204 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-68c75bcf-6973-4598-a1c5-16eb9ed207ca tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:22.074666 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-68c75bcf-6973-4598-a1c5-16eb9ed207ca tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:22.075461 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-68c75bcf-6973-4598-a1c5-16eb9ed207ca tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:22.075901 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-68c75bcf-6973-4598-a1c5-16eb9ed207ca tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:22.168998 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b0a5a068-25e8-4256-8647-3fe62b3bb732 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:22.169613 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b0a5a068-25e8-4256-8647-3fe62b3bb732 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:22.176430 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b0a5a068-25e8-4256-8647-3fe62b3bb732 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:22.176898 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b0a5a068-25e8-4256-8647-3fe62b3bb732 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:22.177662 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b0a5a068-25e8-4256-8647-3fe62b3bb732 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:22.178288 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b0a5a068-25e8-4256-8647-3fe62b3bb732 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:22.212872 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-68c75bcf-6973-4598-a1c5-16eb9ed207ca tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:22.221012 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-68c75bcf-6973-4598-a1c5-16eb9ed207ca tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264" status: 200 len: 1508 microversion: 2.1 time: 0.157408 Jun 10 18:00:22.221829 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 477/936] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:22 2022] GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:22.313039 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b0a5a068-25e8-4256-8647-3fe62b3bb732 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:22.320526 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b0a5a068-25e8-4256-8647-3fe62b3bb732 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd" status: 200 len: 1311 microversion: 2.1 time: 0.155382 Jun 10 18:00:22.321025 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 460/937] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:22 2022] GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd => generated 1311 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:22.577159 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ffb38188-92d0-4f8d-9cde-6bbab07025ea tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:22.577701 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ffb38188-92d0-4f8d-9cde-6bbab07025ea tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:22.583681 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ffb38188-92d0-4f8d-9cde-6bbab07025ea tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:22.584146 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ffb38188-92d0-4f8d-9cde-6bbab07025ea tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:22.585044 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ffb38188-92d0-4f8d-9cde-6bbab07025ea tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:22.585428 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ffb38188-92d0-4f8d-9cde-6bbab07025ea tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:22.715372 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ffb38188-92d0-4f8d-9cde-6bbab07025ea tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:22.723783 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ffb38188-92d0-4f8d-9cde-6bbab07025ea tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1473 microversion: 2.1 time: 0.150548 Jun 10 18:00:22.724441 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 478/938] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:22 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1473 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:22.887135 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b7f0ae07-bd47-48af-82f3-b2acd22393a8 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:22.887759 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b7f0ae07-bd47-48af-82f3-b2acd22393a8 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:22.894830 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b7f0ae07-bd47-48af-82f3-b2acd22393a8 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:22.895287 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b7f0ae07-bd47-48af-82f3-b2acd22393a8 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:22.896072 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b7f0ae07-bd47-48af-82f3-b2acd22393a8 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:22.896542 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b7f0ae07-bd47-48af-82f3-b2acd22393a8 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:23.066965 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-17903368-c2c5-4116-963f-7c9872c8408c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:23.067573 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-17903368-c2c5-4116-963f-7c9872c8408c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: b09b98a7-d89b-42b8-a3c8-809653486d0f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:23.074660 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-17903368-c2c5-4116-963f-7c9872c8408c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:23.075119 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-17903368-c2c5-4116-963f-7c9872c8408c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:23.076018 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-17903368-c2c5-4116-963f-7c9872c8408c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:23.076453 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-17903368-c2c5-4116-963f-7c9872c8408c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:23.112266 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b7f0ae07-bd47-48af-82f3-b2acd22393a8 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:23.120524 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b7f0ae07-bd47-48af-82f3-b2acd22393a8 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1317 microversion: 2.1 time: 0.237251 Jun 10 18:00:23.121126 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 461/939] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:22 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1317 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:23.125870 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-eb6f4cf9-b7ff-4f93-a95c-6cc292075132 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:23.126468 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-eb6f4cf9-b7ff-4f93-a95c-6cc292075132 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: 42863b6d-5afb-46d7-9ec6-592145bba6e0] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:23.132824 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eb6f4cf9-b7ff-4f93-a95c-6cc292075132 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:23.142525 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eb6f4cf9-b7ff-4f93-a95c-6cc292075132 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:23.142525 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eb6f4cf9-b7ff-4f93-a95c-6cc292075132 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:23.142525 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eb6f4cf9-b7ff-4f93-a95c-6cc292075132 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:23.152729 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-17903368-c2c5-4116-963f-7c9872c8408c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:23.161147 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-17903368-c2c5-4116-963f-7c9872c8408c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/b09b98a7-d89b-42b8-a3c8-809653486d0f" status: 200 len: 1272 microversion: 2.1 time: 0.097955 Jun 10 18:00:23.161722 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 479/940] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:23 2022] GET /compute/v2.1/servers/b09b98a7-d89b-42b8-a3c8-809653486d0f => generated 1272 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:23.237934 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d1ce3897-e17b-45a6-9de3-0b19f8a48cb3 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:23.238636 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d1ce3897-e17b-45a6-9de3-0b19f8a48cb3 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: f4f44795-d87b-4032-a9b4-4ce68336f264] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:23.244816 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d1ce3897-e17b-45a6-9de3-0b19f8a48cb3 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:23.245360 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d1ce3897-e17b-45a6-9de3-0b19f8a48cb3 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:23.246194 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d1ce3897-e17b-45a6-9de3-0b19f8a48cb3 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:23.246644 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d1ce3897-e17b-45a6-9de3-0b19f8a48cb3 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:23.312448 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-eb6f4cf9-b7ff-4f93-a95c-6cc292075132 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:23.320765 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-eb6f4cf9-b7ff-4f93-a95c-6cc292075132 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:23.322491 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-eb6f4cf9-b7ff-4f93-a95c-6cc292075132 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:23.323678 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-eb6f4cf9-b7ff-4f93-a95c-6cc292075132 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0" status: 200 len: 1568 microversion: 2.25 time: 0.201595 Jun 10 18:00:23.324233 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 462/941] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:23 2022] GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0 => generated 1568 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:00:23.336965 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-16a969c0-87f3-486c-9e00-30f75426a15e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:23.337805 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-16a969c0-87f3-486c-9e00-30f75426a15e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:23.344937 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-16a969c0-87f3-486c-9e00-30f75426a15e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:23.345686 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-16a969c0-87f3-486c-9e00-30f75426a15e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:23.348653 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-16a969c0-87f3-486c-9e00-30f75426a15e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:23.349347 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-16a969c0-87f3-486c-9e00-30f75426a15e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:23.383513 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d1ce3897-e17b-45a6-9de3-0b19f8a48cb3 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:23.391802 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d1ce3897-e17b-45a6-9de3-0b19f8a48cb3 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264" status: 200 len: 1508 microversion: 2.1 time: 0.157547 Jun 10 18:00:23.392461 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 480/942] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:23 2022] GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:23.548206 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-16a969c0-87f3-486c-9e00-30f75426a15e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:23.555686 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-16a969c0-87f3-486c-9e00-30f75426a15e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd" status: 200 len: 1311 microversion: 2.1 time: 0.222536 Jun 10 18:00:23.556258 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 463/943] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:23 2022] GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd => generated 1311 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:23.740763 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-76eb4c22-aaa7-4253-a3ca-443a649d7582 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:23.741899 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-76eb4c22-aaa7-4253-a3ca-443a649d7582 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:23.749880 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-76eb4c22-aaa7-4253-a3ca-443a649d7582 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:23.750717 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-76eb4c22-aaa7-4253-a3ca-443a649d7582 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:23.752386 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-76eb4c22-aaa7-4253-a3ca-443a649d7582 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:23.754083 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-76eb4c22-aaa7-4253-a3ca-443a649d7582 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:23.927411 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=18 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:00:23.979582 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-76eb4c22-aaa7-4253-a3ca-443a649d7582 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:23.988987 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-76eb4c22-aaa7-4253-a3ca-443a649d7582 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1473 microversion: 2.1 time: 0.252290 Jun 10 18:00:24.000614 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 481/944] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:23 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1473 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:24.137869 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d75ee6b7-e7db-4ad2-a0fa-ecae850c5885 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:24.139299 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d75ee6b7-e7db-4ad2-a0fa-ecae850c5885 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:24.154340 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d75ee6b7-e7db-4ad2-a0fa-ecae850c5885 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:24.154800 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d75ee6b7-e7db-4ad2-a0fa-ecae850c5885 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:24.158207 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d75ee6b7-e7db-4ad2-a0fa-ecae850c5885 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:24.158673 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d75ee6b7-e7db-4ad2-a0fa-ecae850c5885 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:24.182395 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7fcc3793-171d-41cc-bd6a-90e4a70dcbc6 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:24.183705 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7fcc3793-171d-41cc-bd6a-90e4a70dcbc6 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: b09b98a7-d89b-42b8-a3c8-809653486d0f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:24.196587 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7fcc3793-171d-41cc-bd6a-90e4a70dcbc6 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:24.197297 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7fcc3793-171d-41cc-bd6a-90e4a70dcbc6 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:24.198319 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7fcc3793-171d-41cc-bd6a-90e4a70dcbc6 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:24.198998 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7fcc3793-171d-41cc-bd6a-90e4a70dcbc6 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:24.459734 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7fcc3793-171d-41cc-bd6a-90e4a70dcbc6 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:24.470380 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7fcc3793-171d-41cc-bd6a-90e4a70dcbc6 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/b09b98a7-d89b-42b8-a3c8-809653486d0f" status: 200 len: 1314 microversion: 2.1 time: 0.295826 Jun 10 18:00:24.480009 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 482/945] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:24 2022] GET /compute/v2.1/servers/b09b98a7-d89b-42b8-a3c8-809653486d0f => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:24.490462 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fa7356de-24a1-4deb-a63f-bf434c1f8b2a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:24.491050 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fa7356de-24a1-4deb-a63f-bf434c1f8b2a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: 42863b6d-5afb-46d7-9ec6-592145bba6e0] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:24.497249 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa7356de-24a1-4deb-a63f-bf434c1f8b2a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:24.497694 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa7356de-24a1-4deb-a63f-bf434c1f8b2a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:24.498474 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa7356de-24a1-4deb-a63f-bf434c1f8b2a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:24.498898 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa7356de-24a1-4deb-a63f-bf434c1f8b2a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:24.519325 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:00:24.557024 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d75ee6b7-e7db-4ad2-a0fa-ecae850c5885 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:24.564528 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d75ee6b7-e7db-4ad2-a0fa-ecae850c5885 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1317 microversion: 2.1 time: 0.431417 Jun 10 18:00:24.579437 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 464/946] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:24 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1317 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:24.585182 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-25f08066-7355-4142-8443-a5f3815212ff tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:24.586018 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-25f08066-7355-4142-8443-a5f3815212ff tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: f4f44795-d87b-4032-a9b4-4ce68336f264] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:24.593436 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-25f08066-7355-4142-8443-a5f3815212ff tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:24.594085 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-25f08066-7355-4142-8443-a5f3815212ff tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:24.595176 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-25f08066-7355-4142-8443-a5f3815212ff tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:24.595872 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-25f08066-7355-4142-8443-a5f3815212ff tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:24.773366 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fa7356de-24a1-4deb-a63f-bf434c1f8b2a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:24.787931 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fa7356de-24a1-4deb-a63f-bf434c1f8b2a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:24.790684 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fa7356de-24a1-4deb-a63f-bf434c1f8b2a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:24.793685 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fa7356de-24a1-4deb-a63f-bf434c1f8b2a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0" status: 200 len: 1568 microversion: 2.25 time: 0.319292 Jun 10 18:00:24.794834 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 483/947] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:24 2022] GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0 => generated 1568 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:00:24.801250 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-432ef6ac-f6e0-4397-8418-0034b0206dc0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:24.802090 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-432ef6ac-f6e0-4397-8418-0034b0206dc0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:24.810088 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-432ef6ac-f6e0-4397-8418-0034b0206dc0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:24.810769 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-432ef6ac-f6e0-4397-8418-0034b0206dc0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:24.812120 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-432ef6ac-f6e0-4397-8418-0034b0206dc0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:24.812605 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-432ef6ac-f6e0-4397-8418-0034b0206dc0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:25.220553 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-25f08066-7355-4142-8443-a5f3815212ff tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:25.228944 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-25f08066-7355-4142-8443-a5f3815212ff tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264" status: 200 len: 1508 microversion: 2.1 time: 0.648060 Jun 10 18:00:25.229628 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 465/948] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:24 2022] GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264 => generated 1508 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:25.235275 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-34ac440e-5329-4b17-a5a2-f5a52162f550 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:25.235897 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-34ac440e-5329-4b17-a5a2-f5a52162f550 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:25.244830 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-34ac440e-5329-4b17-a5a2-f5a52162f550 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:25.245539 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-34ac440e-5329-4b17-a5a2-f5a52162f550 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:25.246705 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-34ac440e-5329-4b17-a5a2-f5a52162f550 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:25.247182 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-34ac440e-5329-4b17-a5a2-f5a52162f550 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:25.424588 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-432ef6ac-f6e0-4397-8418-0034b0206dc0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:25.432699 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-432ef6ac-f6e0-4397-8418-0034b0206dc0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd" status: 200 len: 1311 microversion: 2.1 time: 0.635904 Jun 10 18:00:25.433290 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 484/949] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:24 2022] GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd => generated 1311 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:25.488177 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ae51cba4-bf9f-4c61-8598-6e06afe7d356 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:25.488939 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ae51cba4-bf9f-4c61-8598-6e06afe7d356 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: b09b98a7-d89b-42b8-a3c8-809653486d0f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:25.498899 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ae51cba4-bf9f-4c61-8598-6e06afe7d356 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:25.499658 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ae51cba4-bf9f-4c61-8598-6e06afe7d356 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:25.500622 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ae51cba4-bf9f-4c61-8598-6e06afe7d356 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:25.501530 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ae51cba4-bf9f-4c61-8598-6e06afe7d356 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:25.518949 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-34ac440e-5329-4b17-a5a2-f5a52162f550 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:25.527242 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-34ac440e-5329-4b17-a5a2-f5a52162f550 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1470 microversion: 2.1 time: 0.296308 Jun 10 18:00:25.528155 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 466/950] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:25 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1470 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:25.533572 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-b9391792-2142-423a-ba35-29ba6da0c25c req-e7ad015b-3447-465f-b649-82c6dffbddf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42863b6d-5afb-46d7-9ec6-592145bba6e0", "name": "network-vif-unplugged", "status": "completed", "tag": "67e4d336-b9e8-43b3-8284-8dc5d8f3355b"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:25.550651 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-b9391792-2142-423a-ba35-29ba6da0c25c req-e7ad015b-3447-465f-b649-82c6dffbddf2 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:25.551213 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-b9391792-2142-423a-ba35-29ba6da0c25c req-e7ad015b-3447-465f-b649-82c6dffbddf2 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:25.568869 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-b9391792-2142-423a-ba35-29ba6da0c25c req-e7ad015b-3447-465f-b649-82c6dffbddf2 service nova] Creating event network-vif-unplugged:67e4d336-b9e8-43b3-8284-8dc5d8f3355b for instance 42863b6d-5afb-46d7-9ec6-592145bba6e0 on chh1-master-2 Jun 10 18:00:25.575233 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-b9391792-2142-423a-ba35-29ba6da0c25c req-e7ad015b-3447-465f-b649-82c6dffbddf2 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045574 Jun 10 18:00:25.576429 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 467/951] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:00:25.583093 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-da41314a-cc38-42fd-8d53-78c554cde1a8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:25.587124 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-da41314a-cc38-42fd-8d53-78c554cde1a8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:25.597081 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-da41314a-cc38-42fd-8d53-78c554cde1a8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:25.597638 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-da41314a-cc38-42fd-8d53-78c554cde1a8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:25.598553 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-da41314a-cc38-42fd-8d53-78c554cde1a8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:25.599412 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-da41314a-cc38-42fd-8d53-78c554cde1a8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:25.814946 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-da41314a-cc38-42fd-8d53-78c554cde1a8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "POST /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d/action" status: 204 len: 0 microversion: 2.1 time: 0.236515 Jun 10 18:00:25.816297 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 468/952] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:00:25 2022] POST /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d/action => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:00:25.829319 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-37515d1b-2c88-47c3-b1cd-caa7995ca590 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:25.833240 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-37515d1b-2c88-47c3-b1cd-caa7995ca590 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:25.833467 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ae51cba4-bf9f-4c61-8598-6e06afe7d356 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:25.844704 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ae51cba4-bf9f-4c61-8598-6e06afe7d356 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/b09b98a7-d89b-42b8-a3c8-809653486d0f" status: 200 len: 1314 microversion: 2.1 time: 0.360818 Jun 10 18:00:25.846218 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-37515d1b-2c88-47c3-b1cd-caa7995ca590 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:25.849526 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-37515d1b-2c88-47c3-b1cd-caa7995ca590 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:25.850539 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-37515d1b-2c88-47c3-b1cd-caa7995ca590 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:25.854687 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-37515d1b-2c88-47c3-b1cd-caa7995ca590 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:25.854871 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 485/953] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:25 2022] GET /compute/v2.1/servers/b09b98a7-d89b-42b8-a3c8-809653486d0f => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:25.861884 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-27c4c8ec-df31-4a92-b244-9448b450586a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:25.862915 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-27c4c8ec-df31-4a92-b244-9448b450586a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: 42863b6d-5afb-46d7-9ec6-592145bba6e0] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:25.873270 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-27c4c8ec-df31-4a92-b244-9448b450586a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:25.879831 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-27c4c8ec-df31-4a92-b244-9448b450586a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:25.880984 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-27c4c8ec-df31-4a92-b244-9448b450586a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:25.881423 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-27c4c8ec-df31-4a92-b244-9448b450586a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:26.068433 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-27c4c8ec-df31-4a92-b244-9448b450586a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:26.080747 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-27c4c8ec-df31-4a92-b244-9448b450586a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:26.082282 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-27c4c8ec-df31-4a92-b244-9448b450586a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:26.083661 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-27c4c8ec-df31-4a92-b244-9448b450586a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0" status: 200 len: 1568 microversion: 2.25 time: 0.227318 Jun 10 18:00:26.093957 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 486/954] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:25 2022] GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0 => generated 1568 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:00:26.105966 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1f7ed0f8-d232-42e2-897a-1c07c8912fa2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:26.106594 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1f7ed0f8-d232-42e2-897a-1c07c8912fa2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:26.122005 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f7ed0f8-d232-42e2-897a-1c07c8912fa2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:26.122466 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f7ed0f8-d232-42e2-897a-1c07c8912fa2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:26.123251 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f7ed0f8-d232-42e2-897a-1c07c8912fa2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:26.123691 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f7ed0f8-d232-42e2-897a-1c07c8912fa2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:26.161323 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-37515d1b-2c88-47c3-b1cd-caa7995ca590 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:26.172341 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-37515d1b-2c88-47c3-b1cd-caa7995ca590 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1317 microversion: 2.1 time: 0.349916 Jun 10 18:00:26.174127 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 469/955] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:25 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1317 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:26.184220 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-d532d80b-f46d-4444-812f-88867a35d727 req-d4648084-4909-4b5c-a31f-89d0d0c201bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b09b98a7-d89b-42b8-a3c8-809653486d0f", "tag": "69d1c5d0-5db0-4717-b5ec-b211301a6d9c"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:26.198140 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-d532d80b-f46d-4444-812f-88867a35d727 req-d4648084-4909-4b5c-a31f-89d0d0c201bb service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:26.198640 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-d532d80b-f46d-4444-812f-88867a35d727 req-d4648084-4909-4b5c-a31f-89d0d0c201bb service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:26.215009 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-d532d80b-f46d-4444-812f-88867a35d727 req-d4648084-4909-4b5c-a31f-89d0d0c201bb service nova] Creating event network-changed:69d1c5d0-5db0-4717-b5ec-b211301a6d9c for instance b09b98a7-d89b-42b8-a3c8-809653486d0f on chh1-master-2 Jun 10 18:00:26.220211 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-d532d80b-f46d-4444-812f-88867a35d727 req-d4648084-4909-4b5c-a31f-89d0d0c201bb service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044840 Jun 10 18:00:26.221004 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 470/956] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:00:26.227943 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-f4d350b7-c09a-46ad-a9fa-59e25ae1a431 req-bb7531fc-b0ed-47db-9ee3-f55a299d7197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd", "name": "network-vif-plugged", "status": "completed", "tag": "64c42e0e-3ccd-469e-bafd-7ce42fa87561"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:26.237337 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-f4d350b7-c09a-46ad-a9fa-59e25ae1a431 req-bb7531fc-b0ed-47db-9ee3-f55a299d7197 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:26.237703 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-f4d350b7-c09a-46ad-a9fa-59e25ae1a431 req-bb7531fc-b0ed-47db-9ee3-f55a299d7197 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:26.250354 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-f4d350b7-c09a-46ad-a9fa-59e25ae1a431 req-bb7531fc-b0ed-47db-9ee3-f55a299d7197 service nova] Creating event network-vif-plugged:64c42e0e-3ccd-469e-bafd-7ce42fa87561 for instance 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd on chh1-master-2 Jun 10 18:00:26.255695 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-f4d350b7-c09a-46ad-a9fa-59e25ae1a431 req-bb7531fc-b0ed-47db-9ee3-f55a299d7197 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032421 Jun 10 18:00:26.256685 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 471/957] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:00:26.266381 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-44101656-de52-46f8-9c96-5dad6a492a65 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:26.266381 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-44101656-de52-46f8-9c96-5dad6a492a65 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: f4f44795-d87b-4032-a9b4-4ce68336f264] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:26.274508 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-44101656-de52-46f8-9c96-5dad6a492a65 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:26.275725 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-44101656-de52-46f8-9c96-5dad6a492a65 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:26.276156 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-44101656-de52-46f8-9c96-5dad6a492a65 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:26.276638 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-44101656-de52-46f8-9c96-5dad6a492a65 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:26.284235 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:00:26.521965 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1f7ed0f8-d232-42e2-897a-1c07c8912fa2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:26.530772 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1f7ed0f8-d232-42e2-897a-1c07c8912fa2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1470 microversion: 2.1 time: 0.434356 Jun 10 18:00:26.532453 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 487/958] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:26 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1470 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:26.547119 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-be3669f6-a650-4d4e-aaf9-cfd75df682b4 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:26.548028 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-be3669f6-a650-4d4e-aaf9-cfd75df682b4 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:26.557852 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-be3669f6-a650-4d4e-aaf9-cfd75df682b4 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:26.558565 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-be3669f6-a650-4d4e-aaf9-cfd75df682b4 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:26.559662 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-be3669f6-a650-4d4e-aaf9-cfd75df682b4 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:26.560250 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-be3669f6-a650-4d4e-aaf9-cfd75df682b4 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:26.570678 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-44101656-de52-46f8-9c96-5dad6a492a65 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:26.583755 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-44101656-de52-46f8-9c96-5dad6a492a65 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264" status: 200 len: 1508 microversion: 2.1 time: 0.323728 Jun 10 18:00:26.584889 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 472/959] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:26 2022] GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264 => generated 1508 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:26.740513 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-be3669f6-a650-4d4e-aaf9-cfd75df682b4 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:26.748127 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-be3669f6-a650-4d4e-aaf9-cfd75df682b4 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd" status: 200 len: 1311 microversion: 2.1 time: 0.204988 Jun 10 18:00:26.748751 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 488/960] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:26 2022] GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd => generated 1311 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:26.863228 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cb684ab3-61ab-4818-9cd0-9f131a5258d1 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:26.863882 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cb684ab3-61ab-4818-9cd0-9f131a5258d1 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: b09b98a7-d89b-42b8-a3c8-809653486d0f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:26.870615 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cb684ab3-61ab-4818-9cd0-9f131a5258d1 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:26.871068 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cb684ab3-61ab-4818-9cd0-9f131a5258d1 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:26.872018 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cb684ab3-61ab-4818-9cd0-9f131a5258d1 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:26.872503 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cb684ab3-61ab-4818-9cd0-9f131a5258d1 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:27.058671 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cb684ab3-61ab-4818-9cd0-9f131a5258d1 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:27.066908 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cb684ab3-61ab-4818-9cd0-9f131a5258d1 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/b09b98a7-d89b-42b8-a3c8-809653486d0f" status: 200 len: 1314 microversion: 2.1 time: 0.208725 Jun 10 18:00:27.067498 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 473/961] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:26 2022] GET /compute/v2.1/servers/b09b98a7-d89b-42b8-a3c8-809653486d0f => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:27.106628 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1f8170b1-d32f-40c5-9905-056c8174a307 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:27.107283 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1f8170b1-d32f-40c5-9905-056c8174a307 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: 42863b6d-5afb-46d7-9ec6-592145bba6e0] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:27.113609 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f8170b1-d32f-40c5-9905-056c8174a307 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:27.114071 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f8170b1-d32f-40c5-9905-056c8174a307 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:27.118650 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f8170b1-d32f-40c5-9905-056c8174a307 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:27.118650 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f8170b1-d32f-40c5-9905-056c8174a307 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:27.195701 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c22fa886-6e0f-4da9-bf6e-d997052e90ee tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:27.196654 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c22fa886-6e0f-4da9-bf6e-d997052e90ee tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:27.205104 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c22fa886-6e0f-4da9-bf6e-d997052e90ee tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:27.205567 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c22fa886-6e0f-4da9-bf6e-d997052e90ee tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:27.212129 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c22fa886-6e0f-4da9-bf6e-d997052e90ee tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:27.212129 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c22fa886-6e0f-4da9-bf6e-d997052e90ee tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:27.255100 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1f8170b1-d32f-40c5-9905-056c8174a307 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:27.263334 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1f8170b1-d32f-40c5-9905-056c8174a307 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:27.265460 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1f8170b1-d32f-40c5-9905-056c8174a307 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:27.266628 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1f8170b1-d32f-40c5-9905-056c8174a307 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0" status: 200 len: 1568 microversion: 2.25 time: 0.164661 Jun 10 18:00:27.267196 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 489/962] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:27 2022] GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:00:27.340995 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c22fa886-6e0f-4da9-bf6e-d997052e90ee tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:27.348753 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c22fa886-6e0f-4da9-bf6e-d997052e90ee tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1317 microversion: 2.1 time: 0.161252 Jun 10 18:00:27.349323 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 474/963] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:27 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:27.548705 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6b17bc67-aae3-4529-ab38-d438cca27d10 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:27.549324 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6b17bc67-aae3-4529-ab38-d438cca27d10 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:27.555399 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6b17bc67-aae3-4529-ab38-d438cca27d10 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:27.555887 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6b17bc67-aae3-4529-ab38-d438cca27d10 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:27.556689 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6b17bc67-aae3-4529-ab38-d438cca27d10 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:27.557136 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6b17bc67-aae3-4529-ab38-d438cca27d10 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:27.602244 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-c89df404-e611-4127-b281-e3d065d2b6f6 req-be980877-bcde-494e-ae70-cf8bed1094fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42863b6d-5afb-46d7-9ec6-592145bba6e0", "tag": "67e4d336-b9e8-43b3-8284-8dc5d8f3355b"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:27.612464 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-c89df404-e611-4127-b281-e3d065d2b6f6 req-be980877-bcde-494e-ae70-cf8bed1094fb service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:27.620603 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-c89df404-e611-4127-b281-e3d065d2b6f6 req-be980877-bcde-494e-ae70-cf8bed1094fb service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:27.634913 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-c89df404-e611-4127-b281-e3d065d2b6f6 req-be980877-bcde-494e-ae70-cf8bed1094fb service nova] Creating event network-changed:67e4d336-b9e8-43b3-8284-8dc5d8f3355b for instance 42863b6d-5afb-46d7-9ec6-592145bba6e0 on chh1-master-2 Jun 10 18:00:27.639913 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-c89df404-e611-4127-b281-e3d065d2b6f6 req-be980877-bcde-494e-ae70-cf8bed1094fb service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041780 Jun 10 18:00:27.640676 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 475/964] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:00:27.645844 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-573a1345-0814-457d-be2b-2dbbd9a7088d tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:27.646390 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-573a1345-0814-457d-be2b-2dbbd9a7088d tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: f4f44795-d87b-4032-a9b4-4ce68336f264] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:27.655366 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-573a1345-0814-457d-be2b-2dbbd9a7088d tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:27.655366 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-573a1345-0814-457d-be2b-2dbbd9a7088d tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:27.655366 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-573a1345-0814-457d-be2b-2dbbd9a7088d tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:27.655366 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-573a1345-0814-457d-be2b-2dbbd9a7088d tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:27.700830 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6b17bc67-aae3-4529-ab38-d438cca27d10 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:27.708925 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6b17bc67-aae3-4529-ab38-d438cca27d10 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1470 microversion: 2.1 time: 0.164640 Jun 10 18:00:27.709571 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 490/965] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:27 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1470 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:27.765806 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-005b8fa5-b3f1-4108-836f-46165904e9fd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:27.766732 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-005b8fa5-b3f1-4108-836f-46165904e9fd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:27.773404 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-005b8fa5-b3f1-4108-836f-46165904e9fd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:27.773857 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-005b8fa5-b3f1-4108-836f-46165904e9fd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:27.774634 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-005b8fa5-b3f1-4108-836f-46165904e9fd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:27.775343 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-005b8fa5-b3f1-4108-836f-46165904e9fd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:27.802975 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-573a1345-0814-457d-be2b-2dbbd9a7088d tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:27.811677 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-573a1345-0814-457d-be2b-2dbbd9a7088d tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264" status: 200 len: 1508 microversion: 2.1 time: 0.169542 Jun 10 18:00:27.812263 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 476/966] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:27 2022] GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264 => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:27.999726 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-005b8fa5-b3f1-4108-836f-46165904e9fd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:28.007840 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-005b8fa5-b3f1-4108-836f-46165904e9fd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd" status: 200 len: 1311 microversion: 2.1 time: 0.245913 Jun 10 18:00:28.008503 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 491/967] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:27 2022] GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd => generated 1311 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:28.084460 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-131cd9a1-1f31-4efc-8135-7a84f2d3730a tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:28.085054 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-131cd9a1-1f31-4efc-8135-7a84f2d3730a tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: b09b98a7-d89b-42b8-a3c8-809653486d0f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:28.091671 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-131cd9a1-1f31-4efc-8135-7a84f2d3730a tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:28.092115 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-131cd9a1-1f31-4efc-8135-7a84f2d3730a tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:28.093185 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-131cd9a1-1f31-4efc-8135-7a84f2d3730a tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:28.095787 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-131cd9a1-1f31-4efc-8135-7a84f2d3730a tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:28.226561 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-131cd9a1-1f31-4efc-8135-7a84f2d3730a tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:28.234703 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-131cd9a1-1f31-4efc-8135-7a84f2d3730a tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/b09b98a7-d89b-42b8-a3c8-809653486d0f" status: 200 len: 1314 microversion: 2.1 time: 0.154150 Jun 10 18:00:28.235354 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 477/968] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:28 2022] GET /compute/v2.1/servers/b09b98a7-d89b-42b8-a3c8-809653486d0f => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:28.272794 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-7788dda0-4037-4641-a41c-7ca7cecd61d4 req-c5c8e57d-1fb0-49ba-8fbf-4c7d698e86c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f344351-d882-4028-98db-751266b3d74d", "name": "network-vif-plugged", "status": "completed", "tag": "7a719916-3937-4cb7-b0d4-e5842975b4c3"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:28.282304 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-7788dda0-4037-4641-a41c-7ca7cecd61d4 req-c5c8e57d-1fb0-49ba-8fbf-4c7d698e86c3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:28.283011 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-7788dda0-4037-4641-a41c-7ca7cecd61d4 req-c5c8e57d-1fb0-49ba-8fbf-4c7d698e86c3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:28.286667 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4b4f8583-9ac5-45b6-b435-37d7c985e3a6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:28.286667 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4b4f8583-9ac5-45b6-b435-37d7c985e3a6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: 42863b6d-5afb-46d7-9ec6-592145bba6e0] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:28.291447 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4b4f8583-9ac5-45b6-b435-37d7c985e3a6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:28.292109 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4b4f8583-9ac5-45b6-b435-37d7c985e3a6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:28.292954 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4b4f8583-9ac5-45b6-b435-37d7c985e3a6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:28.293619 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4b4f8583-9ac5-45b6-b435-37d7c985e3a6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:28.296352 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-7788dda0-4037-4641-a41c-7ca7cecd61d4 req-c5c8e57d-1fb0-49ba-8fbf-4c7d698e86c3 service nova] Creating event network-vif-plugged:7a719916-3937-4cb7-b0d4-e5842975b4c3 for instance 2f344351-d882-4028-98db-751266b3d74d on chh2-master-2 Jun 10 18:00:28.304034 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [req-7788dda0-4037-4641-a41c-7ca7cecd61d4 req-c5c8e57d-1fb0-49ba-8fbf-4c7d698e86c3 service nova] Instance 2f344351-d882-4028-98db-751266b3d74d is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 18:00:28.317097 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-7788dda0-4037-4641-a41c-7ca7cecd61d4 req-c5c8e57d-1fb0-49ba-8fbf-4c7d698e86c3 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047913 Jun 10 18:00:28.317794 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 492/969] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:00:28.365722 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5e3ed4be-05fd-4e41-9cbb-9aef43158208 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:28.366415 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5e3ed4be-05fd-4e41-9cbb-9aef43158208 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:28.372721 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5e3ed4be-05fd-4e41-9cbb-9aef43158208 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:28.373181 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5e3ed4be-05fd-4e41-9cbb-9aef43158208 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:28.373960 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5e3ed4be-05fd-4e41-9cbb-9aef43158208 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:28.375013 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5e3ed4be-05fd-4e41-9cbb-9aef43158208 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:28.464814 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4b4f8583-9ac5-45b6-b435-37d7c985e3a6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:28.473958 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4b4f8583-9ac5-45b6-b435-37d7c985e3a6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:28.475768 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4b4f8583-9ac5-45b6-b435-37d7c985e3a6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:28.476988 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4b4f8583-9ac5-45b6-b435-37d7c985e3a6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0" status: 200 len: 1568 microversion: 2.25 time: 0.196427 Jun 10 18:00:28.481552 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 478/970] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:28 2022] GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0 => generated 1568 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:00:28.615624 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5e3ed4be-05fd-4e41-9cbb-9aef43158208 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:28.623669 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5e3ed4be-05fd-4e41-9cbb-9aef43158208 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1508 microversion: 2.1 time: 0.262177 Jun 10 18:00:28.624347 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 493/971] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:28 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1508 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:28.640432 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2758e08c-ac0f-43b1-b8a8-d67262e3a1c2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:28.641170 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2758e08c-ac0f-43b1-b8a8-d67262e3a1c2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:28.647364 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2758e08c-ac0f-43b1-b8a8-d67262e3a1c2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:28.647815 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2758e08c-ac0f-43b1-b8a8-d67262e3a1c2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:28.648636 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2758e08c-ac0f-43b1-b8a8-d67262e3a1c2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:28.649058 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2758e08c-ac0f-43b1-b8a8-d67262e3a1c2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:28.727164 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2e99a4d5-364c-46de-97d0-faffdc90c95b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:28.728139 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2e99a4d5-364c-46de-97d0-faffdc90c95b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:28.735973 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e99a4d5-364c-46de-97d0-faffdc90c95b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:28.736461 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e99a4d5-364c-46de-97d0-faffdc90c95b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:28.737232 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e99a4d5-364c-46de-97d0-faffdc90c95b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:28.737868 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e99a4d5-364c-46de-97d0-faffdc90c95b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:28.786026 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2758e08c-ac0f-43b1-b8a8-d67262e3a1c2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:28.793697 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2758e08c-ac0f-43b1-b8a8-d67262e3a1c2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1508 microversion: 2.1 time: 0.157574 Jun 10 18:00:28.794265 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 479/972] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:28 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:28.810124 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b5040013-0e5a-4b73-b506-f4e211749501 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "OS-DCF:diskConfig": "AUTO"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:28.811726 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b5040013-0e5a-4b73-b506-f4e211749501 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:28.817792 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5040013-0e5a-4b73-b506-f4e211749501 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:28.818247 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5040013-0e5a-4b73-b506-f4e211749501 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:28.819021 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5040013-0e5a-4b73-b506-f4e211749501 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:28.819494 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5040013-0e5a-4b73-b506-f4e211749501 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:28.880799 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2e99a4d5-364c-46de-97d0-faffdc90c95b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:28.896878 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2e99a4d5-364c-46de-97d0-faffdc90c95b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1470 microversion: 2.1 time: 0.173556 Jun 10 18:00:28.897466 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 494/973] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:28 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1470 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:28.911937 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-411ea905-7e6f-4490-bee1-66cf3f1cc9ea tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:28.912784 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-411ea905-7e6f-4490-bee1-66cf3f1cc9ea tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: f4f44795-d87b-4032-a9b4-4ce68336f264] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:28.916341 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-b5040013-0e5a-4b73-b506-f4e211749501 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:00:28.919499 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-411ea905-7e6f-4490-bee1-66cf3f1cc9ea tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:28.920073 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-b5040013-0e5a-4b73-b506-f4e211749501 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:00:28.920400 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-411ea905-7e6f-4490-bee1-66cf3f1cc9ea tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:28.921412 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-411ea905-7e6f-4490-bee1-66cf3f1cc9ea tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:28.922017 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-411ea905-7e6f-4490-bee1-66cf3f1cc9ea tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:28.922142 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-b5040013-0e5a-4b73-b506-f4e211749501 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:00:28.922646 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-b5040013-0e5a-4b73-b506-f4e211749501 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:00:28.925833 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-b5040013-0e5a-4b73-b506-f4e211749501 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:00:29.178158 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b5040013-0e5a-4b73-b506-f4e211749501 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:29.185425 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5040013-0e5a-4b73-b506-f4e211749501 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:29.185942 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5040013-0e5a-4b73-b506-f4e211749501 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:29.187918 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5040013-0e5a-4b73-b506-f4e211749501 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:29.188378 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5040013-0e5a-4b73-b506-f4e211749501 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:29.189892 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-411ea905-7e6f-4490-bee1-66cf3f1cc9ea tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:29.198816 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-411ea905-7e6f-4490-bee1-66cf3f1cc9ea tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264" status: 200 len: 1512 microversion: 2.1 time: 0.290560 Jun 10 18:00:29.199648 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 495/974] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:28 2022] GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264 => generated 1512 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:29.205235 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-512c9a71-f3ff-4f7e-ae3e-bcfacd33b263 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:29.206418 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-512c9a71-f3ff-4f7e-ae3e-bcfacd33b263 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:29.224555 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b5040013-0e5a-4b73-b506-f4e211749501 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "POST /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be/action" status: 202 len: 1110 microversion: 2.1 time: 0.418070 Jun 10 18:00:29.234019 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 480/975] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:00:28 2022] POST /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be/action => generated 1110 bytes in 420 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jun 10 18:00:29.234019 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a0df5464-c8cb-4c8f-bed6-381f47cbbcdf tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:29.235409 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-512c9a71-f3ff-4f7e-ae3e-bcfacd33b263 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:29.236623 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a0df5464-c8cb-4c8f-bed6-381f47cbbcdf tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:29.237206 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.compute.servers [None req-a0df5464-c8cb-4c8f-bed6-381f47cbbcdf tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Removing options 'limit' from query {{(pid=126594) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jun 10 18:00:29.238079 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a0df5464-c8cb-4c8f-bed6-381f47cbbcdf tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Searching by: {'deleted': False, 'project_id': '57b54ed932024f378743fa2d2fc36b53'} {{(pid=126594) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 18:00:29.239450 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a0df5464-c8cb-4c8f-bed6-381f47cbbcdf tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:29.240036 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a0df5464-c8cb-4c8f-bed6-381f47cbbcdf tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:29.240202 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-512c9a71-f3ff-4f7e-ae3e-bcfacd33b263 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:29.241041 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a0df5464-c8cb-4c8f-bed6-381f47cbbcdf tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:29.241144 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-512c9a71-f3ff-4f7e-ae3e-bcfacd33b263 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:29.241659 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a0df5464-c8cb-4c8f-bed6-381f47cbbcdf tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:29.241770 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-512c9a71-f3ff-4f7e-ae3e-bcfacd33b263 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:29.243249 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a0df5464-c8cb-4c8f-bed6-381f47cbbcdf tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.016313 Jun 10 18:00:29.244127 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 481/976] 10.222.0.35 () {58 vars in 1139 bytes} [Fri Jun 10 18:00:29 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:00:29.249915 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cf8cb0e9-890c-4f50-9e65-d85ac778d02b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:29.249915 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cf8cb0e9-890c-4f50-9e65-d85ac778d02b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:29.256899 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf8cb0e9-890c-4f50-9e65-d85ac778d02b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:29.257493 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf8cb0e9-890c-4f50-9e65-d85ac778d02b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:29.258405 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf8cb0e9-890c-4f50-9e65-d85ac778d02b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:29.258973 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf8cb0e9-890c-4f50-9e65-d85ac778d02b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:29.445319 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cf8cb0e9-890c-4f50-9e65-d85ac778d02b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:29.455307 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cf8cb0e9-890c-4f50-9e65-d85ac778d02b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1515 microversion: 2.1 time: 0.209855 Jun 10 18:00:29.456216 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 482/977] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:29 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1515 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:29.462342 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3e46097b-d1ff-492c-bd67-aa9ac5d079ec tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:29.463042 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3e46097b-d1ff-492c-bd67-aa9ac5d079ec tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: b09b98a7-d89b-42b8-a3c8-809653486d0f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:29.469539 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3e46097b-d1ff-492c-bd67-aa9ac5d079ec tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:29.470131 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3e46097b-d1ff-492c-bd67-aa9ac5d079ec tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:29.470846 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3e46097b-d1ff-492c-bd67-aa9ac5d079ec tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:29.471283 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3e46097b-d1ff-492c-bd67-aa9ac5d079ec tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:29.598862 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-512c9a71-f3ff-4f7e-ae3e-bcfacd33b263 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:29.618669 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-512c9a71-f3ff-4f7e-ae3e-bcfacd33b263 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd" status: 200 len: 1493 microversion: 2.1 time: 0.418199 Jun 10 18:00:29.630753 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 496/978] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:29 2022] GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd => generated 1493 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:29.636405 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3e46097b-d1ff-492c-bd67-aa9ac5d079ec tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:29.636602 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2ab6d834-b506-4e81-9d2e-0eda74d23695 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:29.636602 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2ab6d834-b506-4e81-9d2e-0eda74d23695 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: f4f44795-d87b-4032-a9b4-4ce68336f264] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:29.636896 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3e46097b-d1ff-492c-bd67-aa9ac5d079ec tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/b09b98a7-d89b-42b8-a3c8-809653486d0f" status: 200 len: 1314 microversion: 2.1 time: 0.172413 Jun 10 18:00:29.636896 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 483/979] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:29 2022] GET /compute/v2.1/servers/b09b98a7-d89b-42b8-a3c8-809653486d0f => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:29.636896 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-649e0ab9-c7a8-409d-8615-8f0020703b78 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:29.637214 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-649e0ab9-c7a8-409d-8615-8f0020703b78 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: 42863b6d-5afb-46d7-9ec6-592145bba6e0] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:29.644138 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-649e0ab9-c7a8-409d-8615-8f0020703b78 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:29.644677 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-649e0ab9-c7a8-409d-8615-8f0020703b78 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:29.646041 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-649e0ab9-c7a8-409d-8615-8f0020703b78 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:29.646711 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-649e0ab9-c7a8-409d-8615-8f0020703b78 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:29.648060 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2ab6d834-b506-4e81-9d2e-0eda74d23695 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:29.648549 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2ab6d834-b506-4e81-9d2e-0eda74d23695 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:29.649332 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2ab6d834-b506-4e81-9d2e-0eda74d23695 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:29.649775 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2ab6d834-b506-4e81-9d2e-0eda74d23695 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:29.785686 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-649e0ab9-c7a8-409d-8615-8f0020703b78 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:29.794260 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-649e0ab9-c7a8-409d-8615-8f0020703b78 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:29.796289 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-649e0ab9-c7a8-409d-8615-8f0020703b78 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:29.797569 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-649e0ab9-c7a8-409d-8615-8f0020703b78 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0" status: 200 len: 1568 microversion: 2.25 time: 0.165714 Jun 10 18:00:29.798360 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 484/980] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:29 2022] GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:00:29.802484 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0e8698ef-757d-4892-ade1-10e774a1523b tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:29.803088 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0e8698ef-757d-4892-ade1-10e774a1523b tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] [instance: 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:29.809453 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0e8698ef-757d-4892-ade1-10e774a1523b tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:29.809913 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0e8698ef-757d-4892-ade1-10e774a1523b tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:29.810701 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0e8698ef-757d-4892-ade1-10e774a1523b tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:29.811301 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0e8698ef-757d-4892-ade1-10e774a1523b tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:29.991915 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0e8698ef-757d-4892-ade1-10e774a1523b tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd" status: 200 len: 1644 microversion: 2.1 time: 0.191425 Jun 10 18:00:29.991915 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 485/981] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:29 2022] GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd => generated 1644 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:29.999260 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d2b277c8-2f90-428d-9ca2-b419f101d092 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:30.000678 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d2b277c8-2f90-428d-9ca2-b419f101d092 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:30.007866 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d2b277c8-2f90-428d-9ca2-b419f101d092 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:30.008925 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d2b277c8-2f90-428d-9ca2-b419f101d092 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:30.009871 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d2b277c8-2f90-428d-9ca2-b419f101d092 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:30.010352 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d2b277c8-2f90-428d-9ca2-b419f101d092 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:30.139980 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2ab6d834-b506-4e81-9d2e-0eda74d23695 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:30.147475 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2ab6d834-b506-4e81-9d2e-0eda74d23695 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264" status: 200 len: 1512 microversion: 2.1 time: 0.526885 Jun 10 18:00:30.159086 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 497/982] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:29 2022] GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264 => generated 1512 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:30.159086 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a016be89-22a9-428f-9e34-e2b61c79ca90 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:30.159086 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a016be89-22a9-428f-9e34-e2b61c79ca90 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] [instance: 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:30.162475 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a016be89-22a9-428f-9e34-e2b61c79ca90 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:30.162938 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a016be89-22a9-428f-9e34-e2b61c79ca90 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:30.163814 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a016be89-22a9-428f-9e34-e2b61c79ca90 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:30.164225 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a016be89-22a9-428f-9e34-e2b61c79ca90 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:30.173131 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d2b277c8-2f90-428d-9ca2-b419f101d092 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:30.181825 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d2b277c8-2f90-428d-9ca2-b419f101d092 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1470 microversion: 2.1 time: 0.187420 Jun 10 18:00:30.184714 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 486/983] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:29 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1470 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:30.191129 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-39f17a2c-d430-4365-b510-c7d4d700d00f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:30.195064 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-39f17a2c-d430-4365-b510-c7d4d700d00f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: 1951bbc1-82a1-4f7e-abce-09dbed0d71f2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:30.203083 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-39f17a2c-d430-4365-b510-c7d4d700d00f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:30.203535 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-39f17a2c-d430-4365-b510-c7d4d700d00f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:30.207288 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-39f17a2c-d430-4365-b510-c7d4d700d00f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:30.207288 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-39f17a2c-d430-4365-b510-c7d4d700d00f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:30.308465 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a016be89-22a9-428f-9e34-e2b61c79ca90 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd" status: 200 len: 1644 microversion: 2.1 time: 0.159294 Jun 10 18:00:30.309054 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 498/984] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:30 2022] GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd => generated 1644 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:30.325604 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a89d41a1-a213-4ebe-b4b1-8bc58ca9614d tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:30.327615 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:00:30.327615 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 18:00:30.328852 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a89d41a1-a213-4ebe-b4b1-8bc58ca9614d tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:30.329305 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a89d41a1-a213-4ebe-b4b1-8bc58ca9614d tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:30.330119 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a89d41a1-a213-4ebe-b4b1-8bc58ca9614d tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:30.330552 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a89d41a1-a213-4ebe-b4b1-8bc58ca9614d tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:30.349965 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-39f17a2c-d430-4365-b510-c7d4d700d00f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:30.354902 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a89d41a1-a213-4ebe-b4b1-8bc58ca9614d tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] 10.222.0.35 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.032988 Jun 10 18:00:30.355534 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 499/985] 10.222.0.35 () {58 vars in 1175 bytes} [Fri Jun 10 18:00:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:00:30.363147 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-39f17a2c-d430-4365-b510-c7d4d700d00f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/1951bbc1-82a1-4f7e-abce-09dbed0d71f2" status: 200 len: 1513 microversion: 2.1 time: 0.176702 Jun 10 18:00:30.363919 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 487/986] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:30 2022] GET /compute/v2.1/servers/1951bbc1-82a1-4f7e-abce-09dbed0d71f2 => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:30.367979 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0f4040b4-e7fe-4391-a2c2-d7a72056f6bf tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:30.367979 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0f4040b4-e7fe-4391-a2c2-d7a72056f6bf tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] [instance: 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:30.372157 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0f4040b4-e7fe-4391-a2c2-d7a72056f6bf tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:30.372649 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0f4040b4-e7fe-4391-a2c2-d7a72056f6bf tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:30.373407 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0f4040b4-e7fe-4391-a2c2-d7a72056f6bf tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:30.373849 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0f4040b4-e7fe-4391-a2c2-d7a72056f6bf tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:30.381589 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6cae76f1-6e89-4899-bcfc-f891a76a4ef5 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:30.382201 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6cae76f1-6e89-4899-bcfc-f891a76a4ef5 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: 069baf67-eb80-4d09-a40d-fc139212d954] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:30.390402 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6cae76f1-6e89-4899-bcfc-f891a76a4ef5 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:30.390861 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6cae76f1-6e89-4899-bcfc-f891a76a4ef5 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:30.391637 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6cae76f1-6e89-4899-bcfc-f891a76a4ef5 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:30.392070 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6cae76f1-6e89-4899-bcfc-f891a76a4ef5 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:30.408275 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:00:30.414001 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:00:30.524909 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6cae76f1-6e89-4899-bcfc-f891a76a4ef5 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:30.536033 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6cae76f1-6e89-4899-bcfc-f891a76a4ef5 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954" status: 200 len: 1513 microversion: 2.1 time: 0.158011 Jun 10 18:00:30.537113 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 488/987] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:30 2022] GET /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:30.544020 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fae995f5-deec-4600-9a3c-24bfc3a85cf9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:30.544882 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fae995f5-deec-4600-9a3c-24bfc3a85cf9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:30.552387 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fae995f5-deec-4600-9a3c-24bfc3a85cf9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:30.553126 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fae995f5-deec-4600-9a3c-24bfc3a85cf9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:30.554093 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fae995f5-deec-4600-9a3c-24bfc3a85cf9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:30.554528 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fae995f5-deec-4600-9a3c-24bfc3a85cf9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:30.625267 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0f4040b4-e7fe-4391-a2c2-d7a72056f6bf tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] 10.222.0.35 "POST /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd/action" status: 202 len: 0 microversion: 2.1 time: 0.262809 Jun 10 18:00:30.626538 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 500/988] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:00:30 2022] POST /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 18:00:30.635414 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d9233799-f90f-4b20-9bc6-5b67345f08fb tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:30.638991 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d9233799-f90f-4b20-9bc6-5b67345f08fb tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:30.640278 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d9233799-f90f-4b20-9bc6-5b67345f08fb tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': '57b54ed932024f378743fa2d2fc36b53'} {{(pid=126595) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 18:00:30.696435 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fae995f5-deec-4600-9a3c-24bfc3a85cf9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:30.705478 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fae995f5-deec-4600-9a3c-24bfc3a85cf9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1515 microversion: 2.1 time: 0.166994 Jun 10 18:00:30.705970 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 489/989] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:30 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:30.710569 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-199c73ae-b5ec-4dd0-a587-f8f1bbbe4d5c tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:30.711175 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-199c73ae-b5ec-4dd0-a587-f8f1bbbe4d5c tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] [instance: 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:30.712962 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=4 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:00:30.718159 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-199c73ae-b5ec-4dd0-a587-f8f1bbbe4d5c tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:30.718607 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-199c73ae-b5ec-4dd0-a587-f8f1bbbe4d5c tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:30.719377 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-199c73ae-b5ec-4dd0-a587-f8f1bbbe4d5c tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:30.719848 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-199c73ae-b5ec-4dd0-a587-f8f1bbbe4d5c tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:30.739123 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=9 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:00:30.748384 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d9233799-f90f-4b20-9bc6-5b67345f08fb tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:30.748838 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d9233799-f90f-4b20-9bc6-5b67345f08fb tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:30.750251 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d9233799-f90f-4b20-9bc6-5b67345f08fb tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:30.750688 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d9233799-f90f-4b20-9bc6-5b67345f08fb tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:30.836517 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.multi_cell_list [None req-d9233799-f90f-4b20-9bc6-5b67345f08fb tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126595) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 10 18:00:30.853132 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-199c73ae-b5ec-4dd0-a587-f8f1bbbe4d5c tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd" status: 200 len: 1649 microversion: 2.1 time: 0.146093 Jun 10 18:00:30.853700 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 490/990] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:30 2022] GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd => generated 1649 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:30.858184 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-36d376b1-7fe5-4175-bfd8-6bf13921eca3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:30.858809 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-36d376b1-7fe5-4175-bfd8-6bf13921eca3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: b09b98a7-d89b-42b8-a3c8-809653486d0f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:30.864695 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-36d376b1-7fe5-4175-bfd8-6bf13921eca3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:30.865200 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-36d376b1-7fe5-4175-bfd8-6bf13921eca3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:30.865965 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-36d376b1-7fe5-4175-bfd8-6bf13921eca3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:30.866397 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-36d376b1-7fe5-4175-bfd8-6bf13921eca3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:30.899118 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d9233799-f90f-4b20-9bc6-5b67345f08fb tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 346 microversion: 2.1 time: 0.267856 Jun 10 18:00:30.899960 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 501/991] 10.222.0.35 () {58 vars in 1153 bytes} [Fri Jun 10 18:00:30 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 346 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:00:30.906077 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-084f0a14-5909-4cf7-80c4-daca69fcd99f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:30.906077 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-084f0a14-5909-4cf7-80c4-daca69fcd99f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: 42863b6d-5afb-46d7-9ec6-592145bba6e0] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:30.914399 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-084f0a14-5909-4cf7-80c4-daca69fcd99f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:30.914852 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-084f0a14-5909-4cf7-80c4-daca69fcd99f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:30.915627 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-084f0a14-5909-4cf7-80c4-daca69fcd99f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:30.916155 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-084f0a14-5909-4cf7-80c4-daca69fcd99f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:30.953927 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=7 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:00:31.031022 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-36d376b1-7fe5-4175-bfd8-6bf13921eca3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:31.041734 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-36d376b1-7fe5-4175-bfd8-6bf13921eca3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/b09b98a7-d89b-42b8-a3c8-809653486d0f" status: 200 len: 1314 microversion: 2.1 time: 0.183825 Jun 10 18:00:31.042614 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 491/992] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:30 2022] GET /compute/v2.1/servers/b09b98a7-d89b-42b8-a3c8-809653486d0f => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:31.047846 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b12c3787-679a-4edb-bb97-a6274aa41990 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:31.048493 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b12c3787-679a-4edb-bb97-a6274aa41990 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: f4f44795-d87b-4032-a9b4-4ce68336f264] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:31.056636 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b12c3787-679a-4edb-bb97-a6274aa41990 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:31.057221 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b12c3787-679a-4edb-bb97-a6274aa41990 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:31.058064 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b12c3787-679a-4edb-bb97-a6274aa41990 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:31.058676 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b12c3787-679a-4edb-bb97-a6274aa41990 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:31.096220 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-084f0a14-5909-4cf7-80c4-daca69fcd99f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:31.104276 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-084f0a14-5909-4cf7-80c4-daca69fcd99f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:31.105799 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-084f0a14-5909-4cf7-80c4-daca69fcd99f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:31.106954 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-084f0a14-5909-4cf7-80c4-daca69fcd99f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0" status: 200 len: 1568 microversion: 2.25 time: 0.206286 Jun 10 18:00:31.107690 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 502/993] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:30 2022] GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0 => generated 1568 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:00:31.198442 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d1d90614-971e-449a-93d0-a85e831b3be3 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:31.199506 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d1d90614-971e-449a-93d0-a85e831b3be3 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:31.200115 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b12c3787-679a-4edb-bb97-a6274aa41990 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:31.205784 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d1d90614-971e-449a-93d0-a85e831b3be3 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:31.206391 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d1d90614-971e-449a-93d0-a85e831b3be3 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:31.207167 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d1d90614-971e-449a-93d0-a85e831b3be3 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:31.207598 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d1d90614-971e-449a-93d0-a85e831b3be3 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:31.208520 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b12c3787-679a-4edb-bb97-a6274aa41990 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264" status: 200 len: 1512 microversion: 2.1 time: 0.164768 Jun 10 18:00:31.209084 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 492/994] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:31 2022] GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264 => generated 1512 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:31.224321 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9f2c1d27-ca59-439a-aac6-d8b0088b2acf tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:31.225007 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9f2c1d27-ca59-439a-aac6-d8b0088b2acf tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: 1951bbc1-82a1-4f7e-abce-09dbed0d71f2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:31.228257 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:00:31.231752 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9f2c1d27-ca59-439a-aac6-d8b0088b2acf tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:31.232218 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9f2c1d27-ca59-439a-aac6-d8b0088b2acf tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:31.233002 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9f2c1d27-ca59-439a-aac6-d8b0088b2acf tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:31.233974 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9f2c1d27-ca59-439a-aac6-d8b0088b2acf tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:31.347340 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d1d90614-971e-449a-93d0-a85e831b3be3 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:31.355502 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d1d90614-971e-449a-93d0-a85e831b3be3 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1462 microversion: 2.1 time: 0.160911 Jun 10 18:00:31.356074 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 503/995] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:31 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1462 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:31.367968 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9f2c1d27-ca59-439a-aac6-d8b0088b2acf tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:31.376211 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ac965974-e642-429f-9d17-bc538a695c9d tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:31.376419 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9f2c1d27-ca59-439a-aac6-d8b0088b2acf tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/1951bbc1-82a1-4f7e-abce-09dbed0d71f2" status: 200 len: 1513 microversion: 2.1 time: 0.155442 Jun 10 18:00:31.377142 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 493/996] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:31 2022] GET /compute/v2.1/servers/1951bbc1-82a1-4f7e-abce-09dbed0d71f2 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:31.377287 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ac965974-e642-429f-9d17-bc538a695c9d tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:31.383630 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ac965974-e642-429f-9d17-bc538a695c9d tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:31.385474 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ac965974-e642-429f-9d17-bc538a695c9d tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:31.385474 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ac965974-e642-429f-9d17-bc538a695c9d tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:31.385474 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ac965974-e642-429f-9d17-bc538a695c9d tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:31.392267 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ca284e62-e4d9-4d07-91f0-3903c93260c4 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:31.393047 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ca284e62-e4d9-4d07-91f0-3903c93260c4 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: 069baf67-eb80-4d09-a40d-fc139212d954] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:31.399207 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ca284e62-e4d9-4d07-91f0-3903c93260c4 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:31.399782 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ca284e62-e4d9-4d07-91f0-3903c93260c4 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:31.400653 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ca284e62-e4d9-4d07-91f0-3903c93260c4 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:31.401099 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ca284e62-e4d9-4d07-91f0-3903c93260c4 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:31.513581 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ac965974-e642-429f-9d17-bc538a695c9d tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1613 microversion: 2.1 time: 0.141415 Jun 10 18:00:31.514155 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 504/997] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:31 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1613 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:31.535972 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ca284e62-e4d9-4d07-91f0-3903c93260c4 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:31.539083 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-787b8083-e6d2-471d-aab7-dab5ee944fca tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Calling method '.version_select at 0x7f77c11d3940>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:31.541539 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-787b8083-e6d2-471d-aab7-dab5ee944fca tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:31.542049 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-787b8083-e6d2-471d-aab7-dab5ee944fca tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:31.543655 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ca284e62-e4d9-4d07-91f0-3903c93260c4 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954" status: 200 len: 1513 microversion: 2.1 time: 0.155143 Jun 10 18:00:31.546670 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 494/998] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:31 2022] GET /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:31.554075 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-787b8083-e6d2-471d-aab7-dab5ee944fca tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] 10.222.0.35 "GET /compute/v2.1/os-migrations" status: 200 len: 1175 microversion: 2.1 time: 0.018863 Jun 10 18:00:31.554636 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 505/999] 10.222.0.35 () {58 vars in 1142 bytes} [Fri Jun 10 18:00:31 2022] GET /compute/v2.1/os-migrations => generated 1175 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:31.561106 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-08a50ba6-dd69-419f-af87-36fb2b37ba0c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:31.564907 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-08a50ba6-dd69-419f-af87-36fb2b37ba0c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:31.565694 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-08a50ba6-dd69-419f-af87-36fb2b37ba0c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Searching by: {'deleted': False, 'project_id': '57b54ed932024f378743fa2d2fc36b53'} {{(pid=126594) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 18:00:31.572107 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-08a50ba6-dd69-419f-af87-36fb2b37ba0c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:31.572107 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-08a50ba6-dd69-419f-af87-36fb2b37ba0c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:31.572328 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-08a50ba6-dd69-419f-af87-36fb2b37ba0c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:31.572746 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-08a50ba6-dd69-419f-af87-36fb2b37ba0c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:31.603606 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.multi_cell_list [None req-08a50ba6-dd69-419f-af87-36fb2b37ba0c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126594) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 10 18:00:31.652199 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c85a118d-9471-49fc-a10c-d3992e13777f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-709892532", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:31.669985 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-08a50ba6-dd69-419f-af87-36fb2b37ba0c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:31.677764 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-08a50ba6-dd69-419f-af87-36fb2b37ba0c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:31.678220 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-08a50ba6-dd69-419f-af87-36fb2b37ba0c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:31.702696 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-c85a118d-9471-49fc-a10c-d3992e13777f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] validate_networks() for None {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:00:31.806894 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-08a50ba6-dd69-419f-af87-36fb2b37ba0c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/detail" status: 200 len: 4521 microversion: 2.1 time: 0.249373 Jun 10 18:00:31.807494 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 495/1000] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 18:00:31 2022] GET /compute/v2.1/servers/detail => generated 4521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:31.812130 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-44f7524a-523f-4677-b150-9cc80402486b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:31.812768 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-44f7524a-523f-4677-b150-9cc80402486b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:31.821461 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-44f7524a-523f-4677-b150-9cc80402486b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:31.821461 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-44f7524a-523f-4677-b150-9cc80402486b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:31.821461 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-44f7524a-523f-4677-b150-9cc80402486b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:31.821461 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-44f7524a-523f-4677-b150-9cc80402486b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:31.918973 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-c85a118d-9471-49fc-a10c-d3992e13777f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:00:31.919455 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-c85a118d-9471-49fc-a10c-d3992e13777f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:00:31.919940 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-c85a118d-9471-49fc-a10c-d3992e13777f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:00:31.922308 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-c85a118d-9471-49fc-a10c-d3992e13777f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:00:31.922308 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-c85a118d-9471-49fc-a10c-d3992e13777f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:00:31.929632 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c85a118d-9471-49fc-a10c-d3992e13777f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:31.930086 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c85a118d-9471-49fc-a10c-d3992e13777f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:31.930892 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c85a118d-9471-49fc-a10c-d3992e13777f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:31.931331 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c85a118d-9471-49fc-a10c-d3992e13777f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:31.948919 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-c85a118d-9471-49fc-a10c-d3992e13777f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Getting quotas for project 66fd5e2ed0b84720849784c94f36d5da. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:00:31.951103 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:00:31.955103 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-c85a118d-9471-49fc-a10c-d3992e13777f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Getting quotas for user 1c74f45bf7fd4dea952d771a649519af and project 66fd5e2ed0b84720849784c94f36d5da. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:00:31.959735 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-44f7524a-523f-4677-b150-9cc80402486b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:31.968701 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c85a118d-9471-49fc-a10c-d3992e13777f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:00:31.970471 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-44f7524a-523f-4677-b150-9cc80402486b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1515 microversion: 2.1 time: 0.161815 Jun 10 18:00:31.970986 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c85a118d-9471-49fc-a10c-d3992e13777f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:00:31.974754 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 496/1001] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:31 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:31.987333 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-81a36d0e-fb6c-415b-83d7-4c0a4575b56e tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:31.991455 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-81a36d0e-fb6c-415b-83d7-4c0a4575b56e tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:31.992275 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-81a36d0e-fb6c-415b-83d7-4c0a4575b56e tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '57b54ed932024f378743fa2d2fc36b53'} {{(pid=126594) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 18:00:32.102811 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-81a36d0e-fb6c-415b-83d7-4c0a4575b56e tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:32.103355 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-81a36d0e-fb6c-415b-83d7-4c0a4575b56e tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:32.104212 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-81a36d0e-fb6c-415b-83d7-4c0a4575b56e tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:32.104738 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-81a36d0e-fb6c-415b-83d7-4c0a4575b56e tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:32.108453 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c85a118d-9471-49fc-a10c-d3992e13777f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.457499 Jun 10 18:00:32.108453 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 506/1002] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:00:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 10 18:00:32.115744 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-33614053-0512-4914-b9ff-49ad84f57452 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:32.116737 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-33614053-0512-4914-b9ff-49ad84f57452 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] [instance: 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:32.123557 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-33614053-0512-4914-b9ff-49ad84f57452 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:32.123866 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-33614053-0512-4914-b9ff-49ad84f57452 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:32.124660 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-33614053-0512-4914-b9ff-49ad84f57452 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:32.125102 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-33614053-0512-4914-b9ff-49ad84f57452 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:32.267784 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.multi_cell_list [None req-81a36d0e-fb6c-415b-83d7-4c0a4575b56e tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126594) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 10 18:00:32.318833 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-33614053-0512-4914-b9ff-49ad84f57452 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd" status: 200 len: 1629 microversion: 2.1 time: 0.206529 Jun 10 18:00:32.319983 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 507/1003] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:32 2022] GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd => generated 1629 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:32.324573 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4806a25a-3c26-463f-b891-3c9e921685c6 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:32.325186 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4806a25a-3c26-463f-b891-3c9e921685c6 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: b09b98a7-d89b-42b8-a3c8-809653486d0f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:32.333251 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4806a25a-3c26-463f-b891-3c9e921685c6 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:32.334215 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4806a25a-3c26-463f-b891-3c9e921685c6 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:32.335303 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4806a25a-3c26-463f-b891-3c9e921685c6 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:32.335757 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4806a25a-3c26-463f-b891-3c9e921685c6 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:32.379698 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-81a36d0e-fb6c-415b-83d7-4c0a4575b56e tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1012 microversion: 2.1 time: 0.403549 Jun 10 18:00:32.380554 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 497/1004] 10.222.0.35 () {58 vars in 1149 bytes} [Fri Jun 10 18:00:31 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1012 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:32.385242 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-068b1af3-dbb0-46b4-a21c-bd6ccf45917a req-62b59d24-fd42-4f83-a074-7028cf272fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b09b98a7-d89b-42b8-a3c8-809653486d0f", "name": "network-vif-plugged", "status": "completed", "tag": "69d1c5d0-5db0-4717-b5ec-b211301a6d9c"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:32.398382 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-068b1af3-dbb0-46b4-a21c-bd6ccf45917a req-62b59d24-fd42-4f83-a074-7028cf272fc2 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:32.411143 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-068b1af3-dbb0-46b4-a21c-bd6ccf45917a req-62b59d24-fd42-4f83-a074-7028cf272fc2 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:32.425995 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-068b1af3-dbb0-46b4-a21c-bd6ccf45917a req-62b59d24-fd42-4f83-a074-7028cf272fc2 service nova] Creating event network-vif-plugged:69d1c5d0-5db0-4717-b5ec-b211301a6d9c for instance b09b98a7-d89b-42b8-a3c8-809653486d0f on chh1-master-2 Jun 10 18:00:32.431588 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-068b1af3-dbb0-46b4-a21c-bd6ccf45917a req-62b59d24-fd42-4f83-a074-7028cf272fc2 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049716 Jun 10 18:00:32.432639 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 498/1005] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:00:32.439335 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4ea39e5e-3619-49bf-854a-600024ea2aca tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:32.440733 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4ea39e5e-3619-49bf-854a-600024ea2aca tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:32.487302 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4806a25a-3c26-463f-b891-3c9e921685c6 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:32.496501 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4806a25a-3c26-463f-b891-3c9e921685c6 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/b09b98a7-d89b-42b8-a3c8-809653486d0f" status: 200 len: 1314 microversion: 2.1 time: 0.175229 Jun 10 18:00:32.497150 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 508/1006] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:32 2022] GET /compute/v2.1/servers/b09b98a7-d89b-42b8-a3c8-809653486d0f => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:32.503241 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-089d7b12-5373-41fd-a346-13f98e51a18d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:32.503406 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4ea39e5e-3619-49bf-854a-600024ea2aca tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:32.504454 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-089d7b12-5373-41fd-a346-13f98e51a18d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: 42863b6d-5afb-46d7-9ec6-592145bba6e0] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:32.511640 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4ea39e5e-3619-49bf-854a-600024ea2aca tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1212 microversion: 2.1 time: 0.078011 Jun 10 18:00:32.511842 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-089d7b12-5373-41fd-a346-13f98e51a18d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:32.512234 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 499/1007] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:32 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1212 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:32.512509 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-089d7b12-5373-41fd-a346-13f98e51a18d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:32.514127 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-089d7b12-5373-41fd-a346-13f98e51a18d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:32.515483 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-089d7b12-5373-41fd-a346-13f98e51a18d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:32.527807 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-25ebb06b-c9bc-42c9-b997-0a8193bc7743 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "chh2-master-2", "block_migration": true, "disk_over_commit": false}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:32.530362 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-25ebb06b-c9bc-42c9-b997-0a8193bc7743 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] [instance: 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:32.541444 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-25ebb06b-c9bc-42c9-b997-0a8193bc7743 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:32.543875 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-25ebb06b-c9bc-42c9-b997-0a8193bc7743 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:32.544734 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-25ebb06b-c9bc-42c9-b997-0a8193bc7743 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:32.545186 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-25ebb06b-c9bc-42c9-b997-0a8193bc7743 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:32.575934 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-25ebb06b-c9bc-42c9-b997-0a8193bc7743 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lazy-loading 'flavor' on Instance uuid 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:00:32.588771 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-25ebb06b-c9bc-42c9-b997-0a8193bc7743 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] [instance: 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd] Going to try to live migrate instance to chh2-master-2 {{(pid=126594) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 10 18:00:32.689815 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-089d7b12-5373-41fd-a346-13f98e51a18d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:32.697831 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-089d7b12-5373-41fd-a346-13f98e51a18d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:32.699347 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-089d7b12-5373-41fd-a346-13f98e51a18d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:32.700527 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-089d7b12-5373-41fd-a346-13f98e51a18d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0" status: 200 len: 1568 microversion: 2.25 time: 0.202239 Jun 10 18:00:32.701084 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 509/1008] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:32 2022] GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0 => generated 1568 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:00:32.705374 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0bb3ec71-c07d-463d-bdb4-cb50c524daf5 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:32.709143 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0bb3ec71-c07d-463d-bdb4-cb50c524daf5 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:32.711363 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0bb3ec71-c07d-463d-bdb4-cb50c524daf5 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '57b54ed932024f378743fa2d2fc36b53'} {{(pid=126595) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 18:00:32.714974 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0bb3ec71-c07d-463d-bdb4-cb50c524daf5 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:32.715419 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0bb3ec71-c07d-463d-bdb4-cb50c524daf5 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:32.716212 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0bb3ec71-c07d-463d-bdb4-cb50c524daf5 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:32.716675 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0bb3ec71-c07d-463d-bdb4-cb50c524daf5 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:32.802584 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.multi_cell_list [None req-0bb3ec71-c07d-463d-bdb4-cb50c524daf5 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126595) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 10 18:00:32.865856 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0bb3ec71-c07d-463d-bdb4-cb50c524daf5 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1012 microversion: 2.1 time: 0.163699 Jun 10 18:00:32.866433 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 510/1009] 10.222.0.35 () {58 vars in 1211 bytes} [Fri Jun 10 18:00:32 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1012 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:32.876836 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2427de98-2f2b-49be-ae20-7e4c460f24f6 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:32.880441 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2427de98-2f2b-49be-ae20-7e4c460f24f6 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:32.881090 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2427de98-2f2b-49be-ae20-7e4c460f24f6 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '57b54ed932024f378743fa2d2fc36b53'} {{(pid=126595) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 18:00:32.886148 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2427de98-2f2b-49be-ae20-7e4c460f24f6 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:32.886596 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2427de98-2f2b-49be-ae20-7e4c460f24f6 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:32.887389 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2427de98-2f2b-49be-ae20-7e4c460f24f6 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:32.887823 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2427de98-2f2b-49be-ae20-7e4c460f24f6 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:32.975410 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.multi_cell_list [None req-2427de98-2f2b-49be-ae20-7e4c460f24f6 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126595) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 10 18:00:33.033089 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2427de98-2f2b-49be-ae20-7e4c460f24f6 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1012 microversion: 2.1 time: 0.160288 Jun 10 18:00:33.033696 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 511/1010] 10.222.0.35 () {58 vars in 1195 bytes} [Fri Jun 10 18:00:32 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1012 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:33.038176 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7684792e-1365-4124-a1f2-859f08989b69 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:33.038784 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7684792e-1365-4124-a1f2-859f08989b69 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:33.044759 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7684792e-1365-4124-a1f2-859f08989b69 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:33.045164 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7684792e-1365-4124-a1f2-859f08989b69 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:33.046541 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7684792e-1365-4124-a1f2-859f08989b69 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:33.046984 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7684792e-1365-4124-a1f2-859f08989b69 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:33.182583 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7684792e-1365-4124-a1f2-859f08989b69 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:33.191206 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7684792e-1365-4124-a1f2-859f08989b69 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1515 microversion: 2.1 time: 0.156147 Jun 10 18:00:33.192061 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 512/1011] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:33 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:33.196697 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-54b2165a-b05d-4b46-9a3b-8a86f7e4c245 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:33.200369 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-54b2165a-b05d-4b46-9a3b-8a86f7e4c245 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:33.201052 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-54b2165a-b05d-4b46-9a3b-8a86f7e4c245 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Searching by: {'name': '1910831609', 'deleted': False, 'project_id': '57b54ed932024f378743fa2d2fc36b53'} {{(pid=126595) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 18:00:33.206507 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-54b2165a-b05d-4b46-9a3b-8a86f7e4c245 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:33.206963 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-54b2165a-b05d-4b46-9a3b-8a86f7e4c245 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:33.207761 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-54b2165a-b05d-4b46-9a3b-8a86f7e4c245 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:33.208199 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-54b2165a-b05d-4b46-9a3b-8a86f7e4c245 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:33.297382 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.multi_cell_list [None req-54b2165a-b05d-4b46-9a3b-8a86f7e4c245 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126595) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 10 18:00:33.356075 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-54b2165a-b05d-4b46-9a3b-8a86f7e4c245 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers?name=1910831609" status: 200 len: 346 microversion: 2.1 time: 0.162905 Jun 10 18:00:33.356702 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 513/1012] 10.222.0.35 () {58 vars in 1155 bytes} [Fri Jun 10 18:00:33 2022] GET /compute/v2.1/servers?name=1910831609 => generated 346 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:00:33.367738 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3034ac85-6f22-4909-a67e-21b54362f68f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:33.371570 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3034ac85-6f22-4909-a67e-21b54362f68f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:33.372221 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3034ac85-6f22-4909-a67e-21b54362f68f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '57b54ed932024f378743fa2d2fc36b53'} {{(pid=126595) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 18:00:33.377633 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3034ac85-6f22-4909-a67e-21b54362f68f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:33.378017 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3034ac85-6f22-4909-a67e-21b54362f68f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:33.378917 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3034ac85-6f22-4909-a67e-21b54362f68f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:33.379352 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3034ac85-6f22-4909-a67e-21b54362f68f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:33.472628 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.multi_cell_list [None req-3034ac85-6f22-4909-a67e-21b54362f68f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126595) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 10 18:00:33.532376 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3034ac85-6f22-4909-a67e-21b54362f68f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1012 microversion: 2.1 time: 0.168111 Jun 10 18:00:33.533579 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 514/1013] 10.222.0.35 () {58 vars in 1153 bytes} [Fri Jun 10 18:00:33 2022] GET /compute/v2.1/servers?name=-instance => generated 1012 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:33.539160 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-75a3d8c4-814c-40f8-b0ca-11c65fb066c0 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:33.539634 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-75a3d8c4-814c-40f8-b0ca-11c65fb066c0 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: b09b98a7-d89b-42b8-a3c8-809653486d0f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:33.545858 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-75a3d8c4-814c-40f8-b0ca-11c65fb066c0 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:33.546308 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-75a3d8c4-814c-40f8-b0ca-11c65fb066c0 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:33.547067 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-75a3d8c4-814c-40f8-b0ca-11c65fb066c0 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:33.547503 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-75a3d8c4-814c-40f8-b0ca-11c65fb066c0 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:33.681190 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-75a3d8c4-814c-40f8-b0ca-11c65fb066c0 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:33.689336 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-75a3d8c4-814c-40f8-b0ca-11c65fb066c0 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/b09b98a7-d89b-42b8-a3c8-809653486d0f" status: 200 len: 1314 microversion: 2.1 time: 0.154802 Jun 10 18:00:33.689904 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 515/1014] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:33 2022] GET /compute/v2.1/servers/b09b98a7-d89b-42b8-a3c8-809653486d0f => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:33.694531 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e2d816db-a353-4040-ae65-c74156148286 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:33.695123 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e2d816db-a353-4040-ae65-c74156148286 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:33.701007 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e2d816db-a353-4040-ae65-c74156148286 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:33.701458 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e2d816db-a353-4040-ae65-c74156148286 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:33.702761 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e2d816db-a353-4040-ae65-c74156148286 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:33.703195 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e2d816db-a353-4040-ae65-c74156148286 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:33.723919 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:00:33.769304 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e2d816db-a353-4040-ae65-c74156148286 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:33.778146 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e2d816db-a353-4040-ae65-c74156148286 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1264 microversion: 2.1 time: 0.087264 Jun 10 18:00:33.778763 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 516/1015] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:33 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1264 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:33.783670 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-990e8912-75e0-48f1-be7b-00db527dc869 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:33.787299 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-990e8912-75e0-48f1-be7b-00db527dc869 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:33.791718 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-990e8912-75e0-48f1-be7b-00db527dc869 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-191083160', 'deleted': False, 'project_id': '57b54ed932024f378743fa2d2fc36b53'} {{(pid=126595) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 18:00:33.796026 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-990e8912-75e0-48f1-be7b-00db527dc869 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:33.796504 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-990e8912-75e0-48f1-be7b-00db527dc869 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:33.797369 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-990e8912-75e0-48f1-be7b-00db527dc869 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:33.797840 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-990e8912-75e0-48f1-be7b-00db527dc869 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:33.883417 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.multi_cell_list [None req-990e8912-75e0-48f1-be7b-00db527dc869 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126595) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 10 18:00:33.940447 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-990e8912-75e0-48f1-be7b-00db527dc869 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-191083160" status: 200 len: 346 microversion: 2.1 time: 0.160532 Jun 10 18:00:33.940959 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 517/1016] 10.222.0.35 () {58 vars in 1227 bytes} [Fri Jun 10 18:00:33 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-191083160 => generated 346 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:00:33.945527 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a29524ff-ee1e-4665-83ba-733893595e4d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:33.946120 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a29524ff-ee1e-4665-83ba-733893595e4d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: 42863b6d-5afb-46d7-9ec6-592145bba6e0] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:33.952731 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a29524ff-ee1e-4665-83ba-733893595e4d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:33.953192 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a29524ff-ee1e-4665-83ba-733893595e4d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:33.953961 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a29524ff-ee1e-4665-83ba-733893595e4d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:33.954398 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a29524ff-ee1e-4665-83ba-733893595e4d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:34.084643 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a29524ff-ee1e-4665-83ba-733893595e4d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:34.092778 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a29524ff-ee1e-4665-83ba-733893595e4d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:34.094284 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a29524ff-ee1e-4665-83ba-733893595e4d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:34.095439 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a29524ff-ee1e-4665-83ba-733893595e4d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0" status: 200 len: 1568 microversion: 2.25 time: 0.153554 Jun 10 18:00:34.095997 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 518/1017] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:33 2022] GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:00:34.109581 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dfb6a3d5-2459-4cbc-b411-69d8b6519eb6 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:34.111406 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dfb6a3d5-2459-4cbc-b411-69d8b6519eb6 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: 069baf67-eb80-4d09-a40d-fc139212d954] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:34.118632 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dfb6a3d5-2459-4cbc-b411-69d8b6519eb6 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:34.119085 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dfb6a3d5-2459-4cbc-b411-69d8b6519eb6 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:34.119922 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dfb6a3d5-2459-4cbc-b411-69d8b6519eb6 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:34.120381 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dfb6a3d5-2459-4cbc-b411-69d8b6519eb6 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:34.146978 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dfb6a3d5-2459-4cbc-b411-69d8b6519eb6 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: 069baf67-eb80-4d09-a40d-fc139212d954] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:00:34.518651 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dfb6a3d5-2459-4cbc-b411-69d8b6519eb6 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "DELETE /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954" status: 204 len: 0 microversion: 2.1 time: 0.421326 Jun 10 18:00:34.519338 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 519/1018] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:00:34 2022] DELETE /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:00:34.524460 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8149f4ee-efcb-484c-b39d-ab436a41b995 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:34.525163 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8149f4ee-efcb-484c-b39d-ab436a41b995 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:34.531709 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8149f4ee-efcb-484c-b39d-ab436a41b995 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:34.532161 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8149f4ee-efcb-484c-b39d-ab436a41b995 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:34.532960 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8149f4ee-efcb-484c-b39d-ab436a41b995 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:34.533405 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8149f4ee-efcb-484c-b39d-ab436a41b995 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:34.663147 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8149f4ee-efcb-484c-b39d-ab436a41b995 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:34.671331 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8149f4ee-efcb-484c-b39d-ab436a41b995 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1515 microversion: 2.1 time: 0.150251 Jun 10 18:00:34.673487 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 520/1019] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:34 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:34.677120 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d6a10e64-0672-49eb-8ca4-045309e00a7d tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:34.677731 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d6a10e64-0672-49eb-8ca4-045309e00a7d tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: 069baf67-eb80-4d09-a40d-fc139212d954] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:34.683539 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d6a10e64-0672-49eb-8ca4-045309e00a7d tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:34.683995 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d6a10e64-0672-49eb-8ca4-045309e00a7d tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:34.684775 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d6a10e64-0672-49eb-8ca4-045309e00a7d tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:34.685212 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d6a10e64-0672-49eb-8ca4-045309e00a7d tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:34.816980 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d6a10e64-0672-49eb-8ca4-045309e00a7d tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:34.824482 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d6a10e64-0672-49eb-8ca4-045309e00a7d tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954" status: 200 len: 1519 microversion: 2.1 time: 0.151545 Jun 10 18:00:34.825052 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 521/1020] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:34 2022] GET /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:34.829849 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3d30cbfe-6e5f-433d-a6bb-693f8c62380f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:34.830452 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3d30cbfe-6e5f-433d-a6bb-693f8c62380f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: b09b98a7-d89b-42b8-a3c8-809653486d0f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:34.836045 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3d30cbfe-6e5f-433d-a6bb-693f8c62380f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:34.836534 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3d30cbfe-6e5f-433d-a6bb-693f8c62380f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:34.837300 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3d30cbfe-6e5f-433d-a6bb-693f8c62380f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:34.837738 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3d30cbfe-6e5f-433d-a6bb-693f8c62380f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:34.963180 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3d30cbfe-6e5f-433d-a6bb-693f8c62380f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:34.971563 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3d30cbfe-6e5f-433d-a6bb-693f8c62380f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/b09b98a7-d89b-42b8-a3c8-809653486d0f" status: 200 len: 1464 microversion: 2.1 time: 0.145569 Jun 10 18:00:34.972228 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 522/1021] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:34 2022] GET /compute/v2.1/servers/b09b98a7-d89b-42b8-a3c8-809653486d0f => generated 1464 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:34.976646 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3567844b-aea1-4f37-9ed9-de17d0f482c9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:34.977255 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3567844b-aea1-4f37-9ed9-de17d0f482c9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:34.982997 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3567844b-aea1-4f37-9ed9-de17d0f482c9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:34.983449 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3567844b-aea1-4f37-9ed9-de17d0f482c9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:34.984443 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3567844b-aea1-4f37-9ed9-de17d0f482c9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:34.984695 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3567844b-aea1-4f37-9ed9-de17d0f482c9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:35.048266 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3567844b-aea1-4f37-9ed9-de17d0f482c9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:35.055743 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3567844b-aea1-4f37-9ed9-de17d0f482c9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1282 microversion: 2.1 time: 0.082484 Jun 10 18:00:35.056311 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 523/1022] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:34 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1282 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:35.163466 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f3c56b53-0fed-4214-ba8f-ca3597be4f90 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:35.167409 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f3c56b53-0fed-4214-ba8f-ca3597be4f90 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Searching by: {'deleted': False, 'project_id': '6dfe9553f4884c558af7b0567ba2a64a'} {{(pid=126595) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 18:00:35.173607 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f3c56b53-0fed-4214-ba8f-ca3597be4f90 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:35.174060 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f3c56b53-0fed-4214-ba8f-ca3597be4f90 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:35.174869 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f3c56b53-0fed-4214-ba8f-ca3597be4f90 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:35.175307 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f3c56b53-0fed-4214-ba8f-ca3597be4f90 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:35.266143 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f3c56b53-0fed-4214-ba8f-ca3597be4f90 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.208755 Jun 10 18:00:35.266709 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 524/1023] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 18:00:35 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:00:35.271085 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-166cd3c8-372b-4722-a1f0-430ab4a989c3 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:35.271729 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-166cd3c8-372b-4722-a1f0-430ab4a989c3 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: 42863b6d-5afb-46d7-9ec6-592145bba6e0] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:35.277593 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-166cd3c8-372b-4722-a1f0-430ab4a989c3 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:35.278060 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-166cd3c8-372b-4722-a1f0-430ab4a989c3 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:35.278825 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-166cd3c8-372b-4722-a1f0-430ab4a989c3 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:35.279268 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-166cd3c8-372b-4722-a1f0-430ab4a989c3 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:35.405392 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-166cd3c8-372b-4722-a1f0-430ab4a989c3 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:35.413414 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-166cd3c8-372b-4722-a1f0-430ab4a989c3 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:35.414935 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-166cd3c8-372b-4722-a1f0-430ab4a989c3 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:35.416107 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-166cd3c8-372b-4722-a1f0-430ab4a989c3 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0" status: 200 len: 1568 microversion: 2.25 time: 0.148468 Jun 10 18:00:35.416701 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 525/1024] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:35 2022] GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:00:35.421188 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fcf22f99-fac0-4001-a3ad-a5da9f76e48c tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:35.425856 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fcf22f99-fac0-4001-a3ad-a5da9f76e48c tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Searching by: {'deleted': False} {{(pid=126595) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 18:00:35.430588 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fcf22f99-fac0-4001-a3ad-a5da9f76e48c tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:35.431041 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fcf22f99-fac0-4001-a3ad-a5da9f76e48c tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:35.431880 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fcf22f99-fac0-4001-a3ad-a5da9f76e48c tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:35.432407 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fcf22f99-fac0-4001-a3ad-a5da9f76e48c tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:35.547279 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.multi_cell_list [None req-fcf22f99-fac0-4001-a3ad-a5da9f76e48c tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Listed batch of 14 results from cell out of 1000 limit. Returned 14 total so far. {{(pid=126595) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 10 18:00:35.630201 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fcf22f99-fac0-4001-a3ad-a5da9f76e48c tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:35.630580 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fcf22f99-fac0-4001-a3ad-a5da9f76e48c tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:36.274997 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fcf22f99-fac0-4001-a3ad-a5da9f76e48c tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 23081 microversion: 2.1 time: 0.857226 Jun 10 18:00:36.275678 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 526/1025] 10.222.0.35 () {58 vars in 1170 bytes} [Fri Jun 10 18:00:35 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 23081 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:00:36.280877 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5fd5bcdc-b2fb-48c6-bc83-18768e00c065 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:36.281492 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5fd5bcdc-b2fb-48c6-bc83-18768e00c065 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:36.287560 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5fd5bcdc-b2fb-48c6-bc83-18768e00c065 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:36.288010 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5fd5bcdc-b2fb-48c6-bc83-18768e00c065 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:36.288805 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5fd5bcdc-b2fb-48c6-bc83-18768e00c065 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:36.289247 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5fd5bcdc-b2fb-48c6-bc83-18768e00c065 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:36.596375 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5fd5bcdc-b2fb-48c6-bc83-18768e00c065 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:36.603750 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5fd5bcdc-b2fb-48c6-bc83-18768e00c065 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1515 microversion: 2.1 time: 0.327032 Jun 10 18:00:36.604398 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 527/1026] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:36 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1515 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:36.609242 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e4969c83-bdec-4833-924e-a1e6f648ff3c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:36.609862 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e4969c83-bdec-4833-924e-a1e6f648ff3c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: 069baf67-eb80-4d09-a40d-fc139212d954] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:36.615775 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e4969c83-bdec-4833-924e-a1e6f648ff3c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:36.616232 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e4969c83-bdec-4833-924e-a1e6f648ff3c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:36.617036 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e4969c83-bdec-4833-924e-a1e6f648ff3c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:36.617483 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e4969c83-bdec-4833-924e-a1e6f648ff3c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:37.282800 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e4969c83-bdec-4833-924e-a1e6f648ff3c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:37.290628 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e4969c83-bdec-4833-924e-a1e6f648ff3c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954" status: 200 len: 1519 microversion: 2.1 time: 0.685184 Jun 10 18:00:37.291426 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 528/1027] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:36 2022] GET /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954 => generated 1519 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:37.305051 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e253f14e-4f91-452d-8f73-c42ce1509552 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:37.305680 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e253f14e-4f91-452d-8f73-c42ce1509552 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:37.314020 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e253f14e-4f91-452d-8f73-c42ce1509552 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:37.314127 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e253f14e-4f91-452d-8f73-c42ce1509552 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:37.314967 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e253f14e-4f91-452d-8f73-c42ce1509552 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:37.315316 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e253f14e-4f91-452d-8f73-c42ce1509552 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:37.950609 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e253f14e-4f91-452d-8f73-c42ce1509552 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:37.959164 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e253f14e-4f91-452d-8f73-c42ce1509552 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1312 microversion: 2.1 time: 0.657710 Jun 10 18:00:37.963659 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 529/1028] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:37 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1312 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:37.964623 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-32ddbde5-8129-47af-8ec0-19e5a3a6bb3e tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:37.969994 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-32ddbde5-8129-47af-8ec0-19e5a3a6bb3e tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Searching by: {'deleted': False, 'project_id': '6dfe9553f4884c558af7b0567ba2a64a'} {{(pid=126595) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 18:00:37.974902 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-32ddbde5-8129-47af-8ec0-19e5a3a6bb3e tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:37.975466 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-32ddbde5-8129-47af-8ec0-19e5a3a6bb3e tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:37.976394 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-32ddbde5-8129-47af-8ec0-19e5a3a6bb3e tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:37.976941 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-32ddbde5-8129-47af-8ec0-19e5a3a6bb3e tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:38.008007 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-32ddbde5-8129-47af-8ec0-19e5a3a6bb3e tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/detail?tenant_id=c36d8cd6f58f415a90f042aff9eddd85" status: 200 len: 15 microversion: 2.1 time: 0.047041 Jun 10 18:00:38.008618 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 530/1029] 10.222.0.35 () {58 vars in 1230 bytes} [Fri Jun 10 18:00:37 2022] GET /compute/v2.1/servers/detail?tenant_id=c36d8cd6f58f415a90f042aff9eddd85 => generated 15 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:00:38.019417 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-95ec16b2-3c3a-451c-bde5-d4f6564546a1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:38.019417 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-95ec16b2-3c3a-451c-bde5-d4f6564546a1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: 42863b6d-5afb-46d7-9ec6-592145bba6e0] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:38.020759 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-95ec16b2-3c3a-451c-bde5-d4f6564546a1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:38.026782 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-95ec16b2-3c3a-451c-bde5-d4f6564546a1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:38.026782 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-95ec16b2-3c3a-451c-bde5-d4f6564546a1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:38.026782 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-95ec16b2-3c3a-451c-bde5-d4f6564546a1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:38.222442 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-25ebb06b-c9bc-42c9-b997-0a8193bc7743 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] 10.222.0.35 "POST /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd/action" status: 202 len: 0 microversion: 2.1 time: 5.705528 Jun 10 18:00:38.227714 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 500/1030] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:00:32 2022] POST /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd/action => generated 0 bytes in 5714 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:00:38.233230 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-60e811e6-70a7-4046-b898-50b6e7979bdc tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:38.234115 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-60e811e6-70a7-4046-b898-50b6e7979bdc tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:38.258843 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-60e811e6-70a7-4046-b898-50b6e7979bdc tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:38.259327 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-60e811e6-70a7-4046-b898-50b6e7979bdc tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:38.260338 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-60e811e6-70a7-4046-b898-50b6e7979bdc tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:38.268782 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-60e811e6-70a7-4046-b898-50b6e7979bdc tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:38.312050 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-95ec16b2-3c3a-451c-bde5-d4f6564546a1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:38.312050 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:00:38.328152 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-95ec16b2-3c3a-451c-bde5-d4f6564546a1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:38.329718 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-95ec16b2-3c3a-451c-bde5-d4f6564546a1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:38.341151 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-95ec16b2-3c3a-451c-bde5-d4f6564546a1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0" status: 200 len: 1568 microversion: 2.25 time: 0.331237 Jun 10 18:00:38.352422 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 531/1031] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:38 2022] GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0 => generated 1568 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:00:38.352422 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-91bf5b8b-e19f-4f14-8473-1198be4f6b37 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:38.353459 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-91bf5b8b-e19f-4f14-8473-1198be4f6b37 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Searching by: {'tenant_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'deleted': False} {{(pid=126595) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 18:00:38.367075 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-91bf5b8b-e19f-4f14-8473-1198be4f6b37 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:38.367314 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-91bf5b8b-e19f-4f14-8473-1198be4f6b37 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:38.368365 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-91bf5b8b-e19f-4f14-8473-1198be4f6b37 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:38.368571 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-91bf5b8b-e19f-4f14-8473-1198be4f6b37 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:38.445002 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.multi_cell_list [None req-91bf5b8b-e19f-4f14-8473-1198be4f6b37 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126595) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 10 18:00:38.560102 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-60e811e6-70a7-4046-b898-50b6e7979bdc tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:38.568832 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-60e811e6-70a7-4046-b898-50b6e7979bdc tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1515 microversion: 2.1 time: 0.339604 Jun 10 18:00:38.588419 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 501/1032] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:38 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1515 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:38.595458 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c7220ed8-2ab2-4898-bcd8-a25b19955e9d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:38.597158 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c7220ed8-2ab2-4898-bcd8-a25b19955e9d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:38.605264 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c7220ed8-2ab2-4898-bcd8-a25b19955e9d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:38.605953 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c7220ed8-2ab2-4898-bcd8-a25b19955e9d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:38.606907 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c7220ed8-2ab2-4898-bcd8-a25b19955e9d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:38.607500 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c7220ed8-2ab2-4898-bcd8-a25b19955e9d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:38.623174 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-91bf5b8b-e19f-4f14-8473-1198be4f6b37 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:38.626882 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-91bf5b8b-e19f-4f14-8473-1198be4f6b37 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:38.750685 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c7220ed8-2ab2-4898-bcd8-a25b19955e9d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:38.758269 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c7220ed8-2ab2-4898-bcd8-a25b19955e9d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd" status: 200 len: 1503 microversion: 2.1 time: 0.168492 Jun 10 18:00:38.759068 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 502/1033] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:38 2022] GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd => generated 1503 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:38.763606 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-898b7f4f-785a-46c5-86fb-f124c0cc0c04 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:38.764396 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-898b7f4f-785a-46c5-86fb-f124c0cc0c04 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: 069baf67-eb80-4d09-a40d-fc139212d954] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:38.770460 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-898b7f4f-785a-46c5-86fb-f124c0cc0c04 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:38.770835 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-898b7f4f-785a-46c5-86fb-f124c0cc0c04 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:38.771634 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-898b7f4f-785a-46c5-86fb-f124c0cc0c04 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:38.772079 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-898b7f4f-785a-46c5-86fb-f124c0cc0c04 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:38.825681 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-91bf5b8b-e19f-4f14-8473-1198be4f6b37 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c36d8cd6f58f415a90f042aff9eddd85" status: 200 len: 4822 microversion: 2.1 time: 0.481376 Jun 10 18:00:38.826536 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 532/1034] 10.222.0.35 () {58 vars in 1256 bytes} [Fri Jun 10 18:00:38 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c36d8cd6f58f415a90f042aff9eddd85 => generated 4822 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:38.832987 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-d028982b-76b5-4a38-8dd9-4bbf3faf90d5 req-49e31d21-7147-432d-9971-a5f237cdae58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "069baf67-eb80-4d09-a40d-fc139212d954", "name": "network-vif-deleted", "tag": "d26f4e7e-befe-405c-afdc-c3794c2d5f84"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:38.843206 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-898b7f4f-785a-46c5-86fb-f124c0cc0c04 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:38.844590 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-d028982b-76b5-4a38-8dd9-4bbf3faf90d5 req-49e31d21-7147-432d-9971-a5f237cdae58 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:38.845047 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-d028982b-76b5-4a38-8dd9-4bbf3faf90d5 req-49e31d21-7147-432d-9971-a5f237cdae58 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:38.845525 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:00:38.852130 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-898b7f4f-785a-46c5-86fb-f124c0cc0c04 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954" status: 200 len: 1477 microversion: 2.1 time: 0.092036 Jun 10 18:00:38.859651 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 503/1035] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:38 2022] GET /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954 => generated 1477 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:38.860168 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-d028982b-76b5-4a38-8dd9-4bbf3faf90d5 req-49e31d21-7147-432d-9971-a5f237cdae58 service nova] Creating event network-vif-deleted:d26f4e7e-befe-405c-afdc-c3794c2d5f84 for instance 069baf67-eb80-4d09-a40d-fc139212d954 on chh2-master-2 Jun 10 18:00:38.864962 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-d028982b-76b5-4a38-8dd9-4bbf3faf90d5 req-49e31d21-7147-432d-9971-a5f237cdae58 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036960 Jun 10 18:00:38.865808 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 533/1036] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:00:38.870190 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e3fcf366-f0df-4a7a-b729-1c7f0d1dfc23 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:38.875715 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e3fcf366-f0df-4a7a-b729-1c7f0d1dfc23 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Searching by: {'tenant_id': '6dfe9553f4884c558af7b0567ba2a64a', 'deleted': False} {{(pid=126594) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 18:00:38.881793 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e3fcf366-f0df-4a7a-b729-1c7f0d1dfc23 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:38.882237 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e3fcf366-f0df-4a7a-b729-1c7f0d1dfc23 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:38.883024 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e3fcf366-f0df-4a7a-b729-1c7f0d1dfc23 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:38.883454 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e3fcf366-f0df-4a7a-b729-1c7f0d1dfc23 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:38.911914 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e3fcf366-f0df-4a7a-b729-1c7f0d1dfc23 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6dfe9553f4884c558af7b0567ba2a64a" status: 200 len: 15 microversion: 2.1 time: 0.045353 Jun 10 18:00:38.912762 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 504/1037] 10.222.0.35 () {58 vars in 1256 bytes} [Fri Jun 10 18:00:38 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6dfe9553f4884c558af7b0567ba2a64a => generated 15 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:00:38.930655 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d72b8216-d905-4ded-806a-ab81b10331cb tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:38.934514 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d72b8216-d905-4ded-806a-ab81b10331cb tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.009227 Jun 10 18:00:38.935323 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 534/1038] 10.222.0.35 () {58 vars in 1188 bytes} [Fri Jun 10 18:00:38 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:00:38.952361 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bce0a8ed-9b37-4ee3-802e-8e7638d1865c tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:38.953274 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bce0a8ed-9b37-4ee3-802e-8e7638d1865c tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:38.959462 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bce0a8ed-9b37-4ee3-802e-8e7638d1865c tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:38.963476 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bce0a8ed-9b37-4ee3-802e-8e7638d1865c tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:38.963476 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bce0a8ed-9b37-4ee3-802e-8e7638d1865c tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:38.963476 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bce0a8ed-9b37-4ee3-802e-8e7638d1865c tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:38.982094 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-12ef7cd2-7027-45d5-a1ac-9c5ebfa441fd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:38.982945 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-12ef7cd2-7027-45d5-a1ac-9c5ebfa441fd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:38.992597 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-12ef7cd2-7027-45d5-a1ac-9c5ebfa441fd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:38.992597 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-12ef7cd2-7027-45d5-a1ac-9c5ebfa441fd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:38.994077 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-12ef7cd2-7027-45d5-a1ac-9c5ebfa441fd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:38.994564 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-12ef7cd2-7027-45d5-a1ac-9c5ebfa441fd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:39.229332 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-12ef7cd2-7027-45d5-a1ac-9c5ebfa441fd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:39.238192 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-12ef7cd2-7027-45d5-a1ac-9c5ebfa441fd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1312 microversion: 2.1 time: 0.263592 Jun 10 18:00:39.238784 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 535/1039] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:38 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1312 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:39.277984 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bce0a8ed-9b37-4ee3-802e-8e7638d1865c tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] 10.222.0.35 "POST /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f/action" status: 202 len: 0 microversion: 2.1 time: 0.329432 Jun 10 18:00:39.282927 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 505/1040] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:00:38 2022] POST /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:00:39.287281 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-16a9fa39-817d-49df-a345-45841e0d058f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:39.290972 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-16a9fa39-817d-49df-a345-45841e0d058f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:39.291690 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-16a9fa39-817d-49df-a345-45841e0d058f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85'} {{(pid=126595) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 18:00:39.297873 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-16a9fa39-817d-49df-a345-45841e0d058f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:39.298323 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-16a9fa39-817d-49df-a345-45841e0d058f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:39.299129 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-16a9fa39-817d-49df-a345-45841e0d058f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:39.299569 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-16a9fa39-817d-49df-a345-45841e0d058f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:39.324873 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.multi_cell_list [None req-16a9fa39-817d-49df-a345-45841e0d058f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126595) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 10 18:00:39.358504 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-16a9fa39-817d-49df-a345-45841e0d058f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.074793 Jun 10 18:00:39.364272 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 536/1041] 10.222.0.35 () {58 vars in 1149 bytes} [Fri Jun 10 18:00:39 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:00:39.366524 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-55d8a38d-b90a-463e-8fad-6ae9715508ad tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:39.367573 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-55d8a38d-b90a-463e-8fad-6ae9715508ad tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: 42863b6d-5afb-46d7-9ec6-592145bba6e0] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:39.369492 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bdb9031d-ab48-4775-8c58-3759f353ca97 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:39.370690 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bdb9031d-ab48-4775-8c58-3759f353ca97 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:39.374501 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-55d8a38d-b90a-463e-8fad-6ae9715508ad tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:39.375165 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-55d8a38d-b90a-463e-8fad-6ae9715508ad tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:39.376133 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-55d8a38d-b90a-463e-8fad-6ae9715508ad tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:39.376825 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-55d8a38d-b90a-463e-8fad-6ae9715508ad tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:39.377947 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bdb9031d-ab48-4775-8c58-3759f353ca97 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:39.378406 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bdb9031d-ab48-4775-8c58-3759f353ca97 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:39.379303 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bdb9031d-ab48-4775-8c58-3759f353ca97 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:39.379715 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bdb9031d-ab48-4775-8c58-3759f353ca97 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:39.530711 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-55d8a38d-b90a-463e-8fad-6ae9715508ad tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:39.537949 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-55d8a38d-b90a-463e-8fad-6ae9715508ad tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:39.539536 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-55d8a38d-b90a-463e-8fad-6ae9715508ad tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:39.540757 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-55d8a38d-b90a-463e-8fad-6ae9715508ad tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0" status: 200 len: 1558 microversion: 2.25 time: 0.185590 Jun 10 18:00:39.541313 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 506/1042] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:39 2022] GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0 => generated 1558 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:00:39.557924 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f95186d9-42b7-441c-bf35-fa162a1c6de5 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Calling method '.version_select at 0x7f77c0c22b80>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:39.567218 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f95186d9-42b7-441c-bf35-fa162a1c6de5 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:39.567218 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f95186d9-42b7-441c-bf35-fa162a1c6de5 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:39.570472 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f95186d9-42b7-441c-bf35-fa162a1c6de5 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] 10.222.0.35 "GET /compute/v2.1/os-migrations" status: 200 len: 2187 microversion: 2.25 time: 0.016172 Jun 10 18:00:39.571299 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 507/1043] 10.222.0.35 () {60 vars in 1183 bytes} [Fri Jun 10 18:00:39 2022] GET /compute/v2.1/os-migrations => generated 2187 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:00:39.584045 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-caebdcb1-32f5-4094-96b9-988e490f20e0 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:39.588083 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-caebdcb1-32f5-4094-96b9-988e490f20e0 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] [instance: 42863b6d-5afb-46d7-9ec6-592145bba6e0] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:39.595320 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-caebdcb1-32f5-4094-96b9-988e490f20e0 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:39.595831 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-caebdcb1-32f5-4094-96b9-988e490f20e0 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:39.596648 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-caebdcb1-32f5-4094-96b9-988e490f20e0 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:39.597095 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-caebdcb1-32f5-4094-96b9-988e490f20e0 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:39.725894 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-caebdcb1-32f5-4094-96b9-988e490f20e0 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lazy-loading 'services' on Instance uuid 42863b6d-5afb-46d7-9ec6-592145bba6e0 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:00:39.738580 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-caebdcb1-32f5-4094-96b9-988e490f20e0 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0" status: 200 len: 2050 microversion: 2.25 time: 0.158245 Jun 10 18:00:39.739147 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 508/1044] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:39 2022] GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0 => generated 2050 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:00:39.740779 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bdb9031d-ab48-4775-8c58-3759f353ca97 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] 10.222.0.35 "POST /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f/action" status: 202 len: 0 microversion: 2.1 time: 0.375055 Jun 10 18:00:39.742769 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 537/1045] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:00:39 2022] POST /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f/action => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 18:00:39.747763 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b22b35e6-1f13-481a-bd76-38159c85da4f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:39.748594 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b22b35e6-1f13-481a-bd76-38159c85da4f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:39.758982 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b22b35e6-1f13-481a-bd76-38159c85da4f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:39.759444 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b22b35e6-1f13-481a-bd76-38159c85da4f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:39.760747 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b22b35e6-1f13-481a-bd76-38159c85da4f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:39.761250 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b22b35e6-1f13-481a-bd76-38159c85da4f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:39.769320 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a0afdc8e-1574-428c-9bd1-ff89e60bd2c6 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:39.770208 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a0afdc8e-1574-428c-9bd1-ff89e60bd2c6 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:39.777603 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a0afdc8e-1574-428c-9bd1-ff89e60bd2c6 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:39.778402 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a0afdc8e-1574-428c-9bd1-ff89e60bd2c6 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:39.779429 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a0afdc8e-1574-428c-9bd1-ff89e60bd2c6 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:39.780095 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a0afdc8e-1574-428c-9bd1-ff89e60bd2c6 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:39.956230 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b22b35e6-1f13-481a-bd76-38159c85da4f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:39.964993 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b22b35e6-1f13-481a-bd76-38159c85da4f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1515 microversion: 2.1 time: 0.221665 Jun 10 18:00:39.965621 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 509/1046] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:39 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1515 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:39.970384 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9cc070d1-643f-4315-8ad8-6c3a6258eaa3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:39.971195 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9cc070d1-643f-4315-8ad8-6c3a6258eaa3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:39.984057 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9cc070d1-643f-4315-8ad8-6c3a6258eaa3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:39.984565 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9cc070d1-643f-4315-8ad8-6c3a6258eaa3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:39.985345 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9cc070d1-643f-4315-8ad8-6c3a6258eaa3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:39.985791 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9cc070d1-643f-4315-8ad8-6c3a6258eaa3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:40.007121 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a0afdc8e-1574-428c-9bd1-ff89e60bd2c6 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1612 microversion: 2.1 time: 0.252909 Jun 10 18:00:40.008671 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 538/1047] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:39 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1612 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:40.013532 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4ef243b6-8a85-43e0-a47b-32fc1521665d tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:40.014418 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4ef243b6-8a85-43e0-a47b-32fc1521665d tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: 069baf67-eb80-4d09-a40d-fc139212d954] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:40.024456 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ef243b6-8a85-43e0-a47b-32fc1521665d tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:40.025077 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ef243b6-8a85-43e0-a47b-32fc1521665d tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:40.026012 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ef243b6-8a85-43e0-a47b-32fc1521665d tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:40.026536 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ef243b6-8a85-43e0-a47b-32fc1521665d tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:40.070000 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ef243b6-8a85-43e0-a47b-32fc1521665d tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:40.070561 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ef243b6-8a85-43e0-a47b-32fc1521665d tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:40.071108 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-4ef243b6-8a85-43e0-a47b-32fc1521665d tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lazy-loading 'fault' on Instance uuid 069baf67-eb80-4d09-a40d-fc139212d954 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:00:40.123606 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4ef243b6-8a85-43e0-a47b-32fc1521665d tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:40.130806 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9cc070d1-643f-4315-8ad8-6c3a6258eaa3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:40.134930 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4ef243b6-8a85-43e0-a47b-32fc1521665d tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954" status: 200 len: 1311 microversion: 2.1 time: 0.124720 Jun 10 18:00:40.136116 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 539/1048] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:40 2022] GET /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954 => generated 1311 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:40.140188 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9cc070d1-643f-4315-8ad8-6c3a6258eaa3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd" status: 200 len: 1503 microversion: 2.1 time: 0.173294 Jun 10 18:00:40.141120 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 510/1049] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:39 2022] GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd => generated 1503 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:40.150993 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-49274561-c955-4384-a7c6-9a2fcdd614b8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1728890162", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "abaf7ab8-f0d7-4db9-bc12-3e0ab0d7e41a"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:40.156939 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8ae8d391-dd8a-47fe-983d-c2b8cfd33cd1 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:40.157850 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8ae8d391-dd8a-47fe-983d-c2b8cfd33cd1 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:40.165539 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8ae8d391-dd8a-47fe-983d-c2b8cfd33cd1 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:40.166366 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8ae8d391-dd8a-47fe-983d-c2b8cfd33cd1 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:40.167438 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8ae8d391-dd8a-47fe-983d-c2b8cfd33cd1 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:40.168173 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8ae8d391-dd8a-47fe-983d-c2b8cfd33cd1 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:40.222048 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-49274561-c955-4384-a7c6-9a2fcdd614b8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] validate_networks() for [('abaf7ab8-f0d7-4db9-bc12-3e0ab0d7e41a', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:00:40.317057 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8ae8d391-dd8a-47fe-983d-c2b8cfd33cd1 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1612 microversion: 2.1 time: 0.163894 Jun 10 18:00:40.317625 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 511/1050] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:40 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1612 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:40.322302 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ae9c4df7-8a2c-459b-a100-76a36c45f9bf tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:40.322911 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ae9c4df7-8a2c-459b-a100-76a36c45f9bf tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:40.334226 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ae9c4df7-8a2c-459b-a100-76a36c45f9bf tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:40.334954 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ae9c4df7-8a2c-459b-a100-76a36c45f9bf tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:40.335923 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ae9c4df7-8a2c-459b-a100-76a36c45f9bf tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:40.336668 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ae9c4df7-8a2c-459b-a100-76a36c45f9bf tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:40.482692 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ae9c4df7-8a2c-459b-a100-76a36c45f9bf tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:40.491076 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ae9c4df7-8a2c-459b-a100-76a36c45f9bf tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1312 microversion: 2.1 time: 0.172281 Jun 10 18:00:40.491802 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 512/1051] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:40 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1312 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:40.505591 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f1a2373e-d410-4129-b80d-2a36c3bf57fb tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:40.510479 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f1a2373e-d410-4129-b80d-2a36c3bf57fb tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Searching by: {'host': 'chh1-master-2', 'deleted': False} {{(pid=126594) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 18:00:40.515456 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f1a2373e-d410-4129-b80d-2a36c3bf57fb tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:40.515909 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f1a2373e-d410-4129-b80d-2a36c3bf57fb tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:40.516761 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f1a2373e-d410-4129-b80d-2a36c3bf57fb tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:40.517203 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f1a2373e-d410-4129-b80d-2a36c3bf57fb tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:40.605117 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.multi_cell_list [None req-f1a2373e-d410-4129-b80d-2a36c3bf57fb tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=126594) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 10 18:00:40.667037 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f1a2373e-d410-4129-b80d-2a36c3bf57fb tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] 10.222.0.35 "GET /compute/v2.1/servers?host=chh1-master-2&all_tenants=1" status: 200 len: 1320 microversion: 2.1 time: 0.165210 Jun 10 18:00:40.668134 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 513/1052] 10.222.0.35 () {58 vars in 1189 bytes} [Fri Jun 10 18:00:40 2022] GET /compute/v2.1/servers?host=chh1-master-2&all_tenants=1 => generated 1320 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:40.678990 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-56d73689-9a51-4950-82eb-4ead628f08b3 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:40.683874 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-56d73689-9a51-4950-82eb-4ead628f08b3 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=126594) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 18:00:40.689028 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-56d73689-9a51-4950-82eb-4ead628f08b3 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:40.689480 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-56d73689-9a51-4950-82eb-4ead628f08b3 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:40.690283 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-56d73689-9a51-4950-82eb-4ead628f08b3 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:40.690718 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-56d73689-9a51-4950-82eb-4ead628f08b3 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:40.696460 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-49274561-c955-4384-a7c6-9a2fcdd614b8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:00:40.696960 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-49274561-c955-4384-a7c6-9a2fcdd614b8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:00:40.698173 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-49274561-c955-4384-a7c6-9a2fcdd614b8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:00:40.698657 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-49274561-c955-4384-a7c6-9a2fcdd614b8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:00:40.699144 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-49274561-c955-4384-a7c6-9a2fcdd614b8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:00:40.712280 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-49274561-c955-4384-a7c6-9a2fcdd614b8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:40.712866 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-49274561-c955-4384-a7c6-9a2fcdd614b8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:40.713692 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-49274561-c955-4384-a7c6-9a2fcdd614b8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:40.713926 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-56d73689-9a51-4950-82eb-4ead628f08b3 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] 10.222.0.35 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.038417 Jun 10 18:00:40.714159 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-49274561-c955-4384-a7c6-9a2fcdd614b8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:40.714657 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 514/1053] 10.222.0.35 () {58 vars in 1195 bytes} [Fri Jun 10 18:00:40 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 10 18:00:40.725696 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a5f65b41-ddde-4689-9d41-2f50c685e4b9 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:40.726867 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a5f65b41-ddde-4689-9d41-2f50c685e4b9 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:40.732765 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-49274561-c955-4384-a7c6-9a2fcdd614b8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Getting quotas for project 01ee7bcfe44746fda89fda904f81e1b9. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:00:40.732988 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a5f65b41-ddde-4689-9d41-2f50c685e4b9 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:40.733543 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a5f65b41-ddde-4689-9d41-2f50c685e4b9 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:40.734383 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a5f65b41-ddde-4689-9d41-2f50c685e4b9 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:40.734897 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a5f65b41-ddde-4689-9d41-2f50c685e4b9 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:40.737910 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-49274561-c955-4384-a7c6-9a2fcdd614b8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Getting quotas for user d4967895f6f041058ef60cee35a3659c and project 01ee7bcfe44746fda89fda904f81e1b9. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:00:40.747139 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:00:40.751264 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-49274561-c955-4384-a7c6-9a2fcdd614b8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:00:40.753556 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-49274561-c955-4384-a7c6-9a2fcdd614b8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f5230492-7afa-4202-82ed-1df1cacd2605] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:00:40.912030 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-49274561-c955-4384-a7c6-9a2fcdd614b8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.774582 Jun 10 18:00:40.912830 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 540/1054] 10.222.0.35 () {62 vars in 1187 bytes} [Fri Jun 10 18:00:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 10 18:00:40.917463 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-5b0ec14d-455d-410a-a6bd-a3f9acc67c69 req-a11e24c8-67b5-4beb-a5ca-dd9ded80dcf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89b2f687-3173-411f-92fa-c2e4dde322f6", "tag": "ee1a855b-cfd0-4246-8752-23c466c46c38"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:40.926156 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-5b0ec14d-455d-410a-a6bd-a3f9acc67c69 req-a11e24c8-67b5-4beb-a5ca-dd9ded80dcf6 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:40.931141 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-5b0ec14d-455d-410a-a6bd-a3f9acc67c69 req-a11e24c8-67b5-4beb-a5ca-dd9ded80dcf6 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:40.938437 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-5b0ec14d-455d-410a-a6bd-a3f9acc67c69 req-a11e24c8-67b5-4beb-a5ca-dd9ded80dcf6 service nova] Creating event network-changed:ee1a855b-cfd0-4246-8752-23c466c46c38 for instance 89b2f687-3173-411f-92fa-c2e4dde322f6 on chh2-master-2 Jun 10 18:00:40.943362 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-5b0ec14d-455d-410a-a6bd-a3f9acc67c69 req-a11e24c8-67b5-4beb-a5ca-dd9ded80dcf6 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029425 Jun 10 18:00:40.943992 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 541/1055] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:00:40.949238 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8e52b372-15f8-4312-8e87-35f03e0bc814 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:40.949818 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8e52b372-15f8-4312-8e87-35f03e0bc814 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f5230492-7afa-4202-82ed-1df1cacd2605] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:41.005449 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8e52b372-15f8-4312-8e87-35f03e0bc814 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:41.018670 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8e52b372-15f8-4312-8e87-35f03e0bc814 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:41.018670 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8e52b372-15f8-4312-8e87-35f03e0bc814 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:41.018670 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8e52b372-15f8-4312-8e87-35f03e0bc814 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605" status: 200 len: 1262 microversion: 2.25 time: 0.071975 Jun 10 18:00:41.018958 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 542/1056] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:40 2022] GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605 => generated 1262 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:00:41.022110 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-68f31b09-82e5-4f9c-a509-02480af9015a tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:41.022714 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-68f31b09-82e5-4f9c-a509-02480af9015a tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:41.028774 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-68f31b09-82e5-4f9c-a509-02480af9015a tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:41.029233 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-68f31b09-82e5-4f9c-a509-02480af9015a tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:41.030005 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-68f31b09-82e5-4f9c-a509-02480af9015a tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:41.030447 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-68f31b09-82e5-4f9c-a509-02480af9015a tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:41.072268 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a5f65b41-ddde-4689-9d41-2f50c685e4b9 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] 10.222.0.35 "POST /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f/action" status: 202 len: 0 microversion: 2.1 time: 0.350052 Jun 10 18:00:41.072977 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 515/1057] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:00:40 2022] POST /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 18:00:41.082452 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-021fb464-87bc-425f-86d2-73d67160176b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:41.084003 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-021fb464-87bc-425f-86d2-73d67160176b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:41.090331 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-021fb464-87bc-425f-86d2-73d67160176b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:41.090786 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-021fb464-87bc-425f-86d2-73d67160176b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:41.091582 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-021fb464-87bc-425f-86d2-73d67160176b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:41.092175 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-021fb464-87bc-425f-86d2-73d67160176b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:41.174952 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-021fb464-87bc-425f-86d2-73d67160176b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:00:41.175497 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-021fb464-87bc-425f-86d2-73d67160176b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:00:41.175976 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-021fb464-87bc-425f-86d2-73d67160176b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:00:41.176408 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-021fb464-87bc-425f-86d2-73d67160176b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:00:41.176816 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-021fb464-87bc-425f-86d2-73d67160176b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:00:41.186119 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-68f31b09-82e5-4f9c-a509-02480af9015a tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:41.195525 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-68f31b09-82e5-4f9c-a509-02480af9015a tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1515 microversion: 2.1 time: 0.176745 Jun 10 18:00:41.196083 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 543/1058] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:41 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1515 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:41.204679 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-25a2e2b1-fda7-4993-bf08-b70cb72b0f27 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:41.205292 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-25a2e2b1-fda7-4993-bf08-b70cb72b0f27 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: 069baf67-eb80-4d09-a40d-fc139212d954] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:41.212714 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-25a2e2b1-fda7-4993-bf08-b70cb72b0f27 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:41.213664 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-25a2e2b1-fda7-4993-bf08-b70cb72b0f27 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:41.213943 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-25a2e2b1-fda7-4993-bf08-b70cb72b0f27 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:41.214421 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-25a2e2b1-fda7-4993-bf08-b70cb72b0f27 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:41.228609 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-25a2e2b1-fda7-4993-bf08-b70cb72b0f27 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] HTTP exception thrown: Instance 069baf67-eb80-4d09-a40d-fc139212d954 could not be found. Jun 10 18:00:41.230270 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-25a2e2b1-fda7-4993-bf08-b70cb72b0f27 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Request method failure captured: Jun 10 18:00:41.230270 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954 HTTP/1.1 Jun 10 18:00:41.230270 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:00:41.230270 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:00:41.230270 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:00:41.230270 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:00:41.230270 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:00:41.230270 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:00:41.230270 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:00:41.230270 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:00:41.230270 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4Z3Zi_Ge9Nxo_7CXrqWQV4jSPLWsfsUvJWjJHyKfSHOO1FEPeplt2_0WH6Z-_3f1ssjgkQIBPNjPF1OSIhrccEyr1E-MhFjaltkeyJvmgkOpl2ZPjQAVhVgS3qwZpQrZuC0Hjy7y8wrmwtAmcZo1RJfpKJGCYTBOtJNYnOkzkYdiao Jun 10 18:00:41.230270 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:00:41.230270 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:00:41.230270 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:00:41.230270 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:00:41.230270 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:00:41.230270 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:00:41.230270 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 57b54ed932024f378743fa2d2fc36b53 Jun 10 18:00:41.230270 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ListServerFiltersTestJSON-1708142629 Jun 10 18:00:41.230270 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:00:41.230270 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:00:41.231962 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/57b54ed932024f378743fa2d2fc36b53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/57b54ed932024f378743fa2d2fc36b53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/57b54ed932024f378743fa2d2fc36b53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_57b54ed932024f378743fa2d2fc36b53", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:00:41.231962 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ListServerFiltersTestJSON-1708142629 Jun 10 18:00:41.231962 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 57b54ed932024f378743fa2d2fc36b53 Jun 10 18:00:41.231962 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1708142629 Jun 10 18:00:41.231962 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ListServerFiltersTestJSON-1708142629-project Jun 10 18:00:41.231962 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:00:41.231962 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:00:41.231962 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: bb6eb467842c4b06904eabb338f1d74e Jun 10 18:00:41.231962 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ListServerFiltersTestJSON-1708142629-project Jun 10 18:00:41.231962 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:00:41.231962 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 069baf67-eb80-4d09-a40d-fc139212d954 could not be found. Jun 10 18:00:41.231962 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '069baf67-eb80-4d09-a40d-fc139212d954'} Jun 10 18:00:41.233028 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:00:41.233028 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:00:41.233028 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:00:41.233028 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:00:41.233028 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:00:41.233028 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:00:41.233028 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:00:41.233028 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:00:41.233028 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:00:41.233028 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:00:41.233028 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 069baf67-eb80-4d09-a40d-fc139212d954 could not be found. Jun 10 18:00:41.233028 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:00:41.233028 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:00:41.233028 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:00:41.233028 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:00:41.233028 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:00:41.233028 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:00:41.233028 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:00:41.233028 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:00:41.233028 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:00:41.235648 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:00:41.235648 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:00:41.235648 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:00:41.235648 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:00:41.235648 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:00:41.235648 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:00:41.235648 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:00:41.235648 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 069baf67-eb80-4d09-a40d-fc139212d954 could not be found. Jun 10 18:00:41.235648 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:00:41.235648 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:00:41.235648 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:00:41.235648 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:00:41.235648 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:00:41.235648 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:00:41.235648 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:00:41.235648 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:00:41.235648 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 069baf67-eb80-4d09-a40d-fc139212d954 could not be found. Jun 10 18:00:41.235648 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:00:41.237283 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-25a2e2b1-fda7-4993-bf08-b70cb72b0f27 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Returning 404 to user: Instance 069baf67-eb80-4d09-a40d-fc139212d954 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:00:41.237283 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-25a2e2b1-fda7-4993-bf08-b70cb72b0f27 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954" status: 404 len: 111 microversion: 2.1 time: 0.031155 Jun 10 18:00:41.237283 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 544/1059] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:41 2022] GET /compute/v2.1/servers/069baf67-eb80-4d09-a40d-fc139212d954 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:00:41.237283 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cfc83f69-bec4-4a16-bd9f-3a9307ef14bc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:41.237828 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cfc83f69-bec4-4a16-bd9f-3a9307ef14bc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:41.243610 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cfc83f69-bec4-4a16-bd9f-3a9307ef14bc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:41.244078 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cfc83f69-bec4-4a16-bd9f-3a9307ef14bc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:41.244864 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cfc83f69-bec4-4a16-bd9f-3a9307ef14bc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:41.245307 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cfc83f69-bec4-4a16-bd9f-3a9307ef14bc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:41.375565 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cfc83f69-bec4-4a16-bd9f-3a9307ef14bc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:41.383424 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cfc83f69-bec4-4a16-bd9f-3a9307ef14bc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd" status: 200 len: 1503 microversion: 2.1 time: 0.150269 Jun 10 18:00:41.384079 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 545/1060] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:41 2022] GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:41.388878 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b0fea713-3301-4630-8931-3e82e6167530 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:41.389829 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b0fea713-3301-4630-8931-3e82e6167530 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: 1951bbc1-82a1-4f7e-abce-09dbed0d71f2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:41.400144 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b0fea713-3301-4630-8931-3e82e6167530 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:41.400651 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b0fea713-3301-4630-8931-3e82e6167530 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:41.401437 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b0fea713-3301-4630-8931-3e82e6167530 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:41.401879 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b0fea713-3301-4630-8931-3e82e6167530 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:41.428518 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b0fea713-3301-4630-8931-3e82e6167530 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: 1951bbc1-82a1-4f7e-abce-09dbed0d71f2] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:00:41.430272 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-021fb464-87bc-425f-86d2-73d67160176b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:41.436824 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-021fb464-87bc-425f-86d2-73d67160176b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:41.437519 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-021fb464-87bc-425f-86d2-73d67160176b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:41.438386 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-021fb464-87bc-425f-86d2-73d67160176b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:41.439042 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-021fb464-87bc-425f-86d2-73d67160176b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:41.456091 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:00:41.466727 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-021fb464-87bc-425f-86d2-73d67160176b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "POST /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f/action" status: 202 len: 1065 microversion: 2.1 time: 0.389372 Jun 10 18:00:41.468203 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 516/1061] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:00:41 2022] POST /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f/action => generated 1065 bytes in 391 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jun 10 18:00:41.482421 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e4b85564-a521-4050-8f60-fef78c6b2925 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:41.483038 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e4b85564-a521-4050-8f60-fef78c6b2925 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:41.489800 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e4b85564-a521-4050-8f60-fef78c6b2925 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:41.490244 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e4b85564-a521-4050-8f60-fef78c6b2925 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:41.491013 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e4b85564-a521-4050-8f60-fef78c6b2925 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:41.491592 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e4b85564-a521-4050-8f60-fef78c6b2925 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:41.625784 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e4b85564-a521-4050-8f60-fef78c6b2925 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:41.634756 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e4b85564-a521-4050-8f60-fef78c6b2925 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1469 microversion: 2.1 time: 0.155979 Jun 10 18:00:41.636373 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 517/1062] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:41 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1469 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:41.641730 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-559772fa-9953-4e77-8fca-82a1c3794240 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:41.642402 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-559772fa-9953-4e77-8fca-82a1c3794240 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:41.649751 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-559772fa-9953-4e77-8fca-82a1c3794240 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:41.650473 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-559772fa-9953-4e77-8fca-82a1c3794240 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:41.651265 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-559772fa-9953-4e77-8fca-82a1c3794240 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:41.651724 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-559772fa-9953-4e77-8fca-82a1c3794240 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:41.701200 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b0fea713-3301-4630-8931-3e82e6167530 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "DELETE /compute/v2.1/servers/1951bbc1-82a1-4f7e-abce-09dbed0d71f2" status: 204 len: 0 microversion: 2.1 time: 0.315759 Jun 10 18:00:41.702757 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 546/1063] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:00:41 2022] DELETE /compute/v2.1/servers/1951bbc1-82a1-4f7e-abce-09dbed0d71f2 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:00:41.711641 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4a7cd1a7-ffbc-4d21-bf6f-f54c205d0b99 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:41.712378 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4a7cd1a7-ffbc-4d21-bf6f-f54c205d0b99 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: 1951bbc1-82a1-4f7e-abce-09dbed0d71f2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:41.719442 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a7cd1a7-ffbc-4d21-bf6f-f54c205d0b99 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:41.719897 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a7cd1a7-ffbc-4d21-bf6f-f54c205d0b99 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:41.720894 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a7cd1a7-ffbc-4d21-bf6f-f54c205d0b99 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:41.721503 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a7cd1a7-ffbc-4d21-bf6f-f54c205d0b99 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:41.789458 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-559772fa-9953-4e77-8fca-82a1c3794240 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:41.797384 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-559772fa-9953-4e77-8fca-82a1c3794240 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1312 microversion: 2.1 time: 0.160169 Jun 10 18:00:41.797951 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 518/1064] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:41 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1312 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:41.856364 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4a7cd1a7-ffbc-4d21-bf6f-f54c205d0b99 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:41.864114 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4a7cd1a7-ffbc-4d21-bf6f-f54c205d0b99 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/1951bbc1-82a1-4f7e-abce-09dbed0d71f2" status: 200 len: 1519 microversion: 2.1 time: 0.157043 Jun 10 18:00:41.864730 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 547/1065] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:41 2022] GET /compute/v2.1/servers/1951bbc1-82a1-4f7e-abce-09dbed0d71f2 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:42.035176 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d6f9e2d3-17a0-4e83-8e6b-bebcde9ad382 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:42.035852 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d6f9e2d3-17a0-4e83-8e6b-bebcde9ad382 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f5230492-7afa-4202-82ed-1df1cacd2605] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:42.041871 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d6f9e2d3-17a0-4e83-8e6b-bebcde9ad382 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:42.042324 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d6f9e2d3-17a0-4e83-8e6b-bebcde9ad382 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:42.043091 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d6f9e2d3-17a0-4e83-8e6b-bebcde9ad382 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:42.043535 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d6f9e2d3-17a0-4e83-8e6b-bebcde9ad382 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:42.103393 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d6f9e2d3-17a0-4e83-8e6b-bebcde9ad382 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:42.111182 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d6f9e2d3-17a0-4e83-8e6b-bebcde9ad382 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:42.112745 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d6f9e2d3-17a0-4e83-8e6b-bebcde9ad382 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:42.113899 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d6f9e2d3-17a0-4e83-8e6b-bebcde9ad382 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605" status: 200 len: 1266 microversion: 2.25 time: 0.082918 Jun 10 18:00:42.114461 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 519/1066] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:42 2022] GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605 => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:00:42.212382 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ff5bcc36-11b5-44d7-b66f-7ebbec8b51d6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:42.212995 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ff5bcc36-11b5-44d7-b66f-7ebbec8b51d6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:42.220296 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ff5bcc36-11b5-44d7-b66f-7ebbec8b51d6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:42.220768 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ff5bcc36-11b5-44d7-b66f-7ebbec8b51d6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:42.221562 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ff5bcc36-11b5-44d7-b66f-7ebbec8b51d6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:42.221999 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ff5bcc36-11b5-44d7-b66f-7ebbec8b51d6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:42.356398 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ff5bcc36-11b5-44d7-b66f-7ebbec8b51d6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:42.359225 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:00:42.365021 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ff5bcc36-11b5-44d7-b66f-7ebbec8b51d6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1515 microversion: 2.1 time: 0.156569 Jun 10 18:00:42.365575 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 548/1067] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:42 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:42.400153 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1eb6063c-a9be-40cc-ad08-6c6d2b743b06 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:42.400803 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1eb6063c-a9be-40cc-ad08-6c6d2b743b06 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:42.407233 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1eb6063c-a9be-40cc-ad08-6c6d2b743b06 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:42.407688 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1eb6063c-a9be-40cc-ad08-6c6d2b743b06 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:42.408497 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1eb6063c-a9be-40cc-ad08-6c6d2b743b06 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:42.409543 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1eb6063c-a9be-40cc-ad08-6c6d2b743b06 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:42.511076 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=4 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:00:42.547013 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1eb6063c-a9be-40cc-ad08-6c6d2b743b06 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:42.554528 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1eb6063c-a9be-40cc-ad08-6c6d2b743b06 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd" status: 200 len: 1503 microversion: 2.1 time: 0.158108 Jun 10 18:00:42.555030 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 520/1068] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:42 2022] GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:42.654114 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e67486eb-91ef-4543-9b6e-c35119c0a219 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:42.654718 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e67486eb-91ef-4543-9b6e-c35119c0a219 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:42.660931 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e67486eb-91ef-4543-9b6e-c35119c0a219 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:42.661378 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e67486eb-91ef-4543-9b6e-c35119c0a219 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:42.662138 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e67486eb-91ef-4543-9b6e-c35119c0a219 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:42.662574 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e67486eb-91ef-4543-9b6e-c35119c0a219 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:42.794189 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e67486eb-91ef-4543-9b6e-c35119c0a219 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:42.803859 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e67486eb-91ef-4543-9b6e-c35119c0a219 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1469 microversion: 2.1 time: 0.154317 Jun 10 18:00:42.813543 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 549/1069] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:42 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1469 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:42.818640 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9b9697dc-61e8-4a5e-8d5e-ab61d4bb3ed8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:42.819248 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9b9697dc-61e8-4a5e-8d5e-ab61d4bb3ed8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:42.825314 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9b9697dc-61e8-4a5e-8d5e-ab61d4bb3ed8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:42.825764 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9b9697dc-61e8-4a5e-8d5e-ab61d4bb3ed8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:42.826519 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9b9697dc-61e8-4a5e-8d5e-ab61d4bb3ed8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:42.826963 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9b9697dc-61e8-4a5e-8d5e-ab61d4bb3ed8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:42.880932 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a89675d7-61e1-4841-b174-aa09897706ed tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:42.881559 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a89675d7-61e1-4841-b174-aa09897706ed tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: 1951bbc1-82a1-4f7e-abce-09dbed0d71f2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:42.887893 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a89675d7-61e1-4841-b174-aa09897706ed tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:42.888371 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a89675d7-61e1-4841-b174-aa09897706ed tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:42.889146 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a89675d7-61e1-4841-b174-aa09897706ed tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:42.889593 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a89675d7-61e1-4841-b174-aa09897706ed tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:42.959285 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9b9697dc-61e8-4a5e-8d5e-ab61d4bb3ed8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:42.967768 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9b9697dc-61e8-4a5e-8d5e-ab61d4bb3ed8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1312 microversion: 2.1 time: 0.152666 Jun 10 18:00:42.977977 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 521/1070] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:42 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1312 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:43.027852 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a89675d7-61e1-4841-b174-aa09897706ed tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:43.036326 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a89675d7-61e1-4841-b174-aa09897706ed tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/1951bbc1-82a1-4f7e-abce-09dbed0d71f2" status: 200 len: 1519 microversion: 2.1 time: 0.159319 Jun 10 18:00:43.036909 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 550/1071] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:42 2022] GET /compute/v2.1/servers/1951bbc1-82a1-4f7e-abce-09dbed0d71f2 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:43.138266 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8a3850e2-83d9-48da-93e6-87a4fff52fab tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:43.139182 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8a3850e2-83d9-48da-93e6-87a4fff52fab tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f5230492-7afa-4202-82ed-1df1cacd2605] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:43.146496 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8a3850e2-83d9-48da-93e6-87a4fff52fab tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:43.146953 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8a3850e2-83d9-48da-93e6-87a4fff52fab tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:43.147779 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8a3850e2-83d9-48da-93e6-87a4fff52fab tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:43.148234 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8a3850e2-83d9-48da-93e6-87a4fff52fab tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:43.210455 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8a3850e2-83d9-48da-93e6-87a4fff52fab tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:43.219420 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8a3850e2-83d9-48da-93e6-87a4fff52fab tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:43.220961 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8a3850e2-83d9-48da-93e6-87a4fff52fab tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:43.222081 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8a3850e2-83d9-48da-93e6-87a4fff52fab tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605" status: 200 len: 1266 microversion: 2.25 time: 0.087881 Jun 10 18:00:43.222633 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 522/1072] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:43 2022] GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:00:43.390566 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a098f35b-4f89-4cc3-988d-b35fb43ee005 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:43.391139 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a098f35b-4f89-4cc3-988d-b35fb43ee005 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:43.398763 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a098f35b-4f89-4cc3-988d-b35fb43ee005 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:43.399221 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a098f35b-4f89-4cc3-988d-b35fb43ee005 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:43.400071 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a098f35b-4f89-4cc3-988d-b35fb43ee005 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:43.400553 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a098f35b-4f89-4cc3-988d-b35fb43ee005 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:43.570852 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2f9bd438-d0a3-434d-a7da-cc2d7a49e8be tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:43.571463 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2f9bd438-d0a3-434d-a7da-cc2d7a49e8be tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:43.576237 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a098f35b-4f89-4cc3-988d-b35fb43ee005 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:43.578709 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2f9bd438-d0a3-434d-a7da-cc2d7a49e8be tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:43.579168 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2f9bd438-d0a3-434d-a7da-cc2d7a49e8be tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:43.579941 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2f9bd438-d0a3-434d-a7da-cc2d7a49e8be tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:43.580410 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2f9bd438-d0a3-434d-a7da-cc2d7a49e8be tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:43.584747 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a098f35b-4f89-4cc3-988d-b35fb43ee005 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1515 microversion: 2.1 time: 0.198668 Jun 10 18:00:43.585330 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 551/1073] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:43 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1515 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:43.685660 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-8595a3dd-2a28-4818-84cc-27c438c914db req-a38f85e1-47d2-4581-962c-5097d1ab5dff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1951bbc1-82a1-4f7e-abce-09dbed0d71f2", "name": "network-vif-deleted", "tag": "748e2cf4-7aaa-4c7d-91d8-ea180aaa6e33"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:43.695095 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-8595a3dd-2a28-4818-84cc-27c438c914db req-a38f85e1-47d2-4581-962c-5097d1ab5dff service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:43.695833 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-8595a3dd-2a28-4818-84cc-27c438c914db req-a38f85e1-47d2-4581-962c-5097d1ab5dff service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:43.712100 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-8595a3dd-2a28-4818-84cc-27c438c914db req-a38f85e1-47d2-4581-962c-5097d1ab5dff service nova] Creating event network-vif-deleted:748e2cf4-7aaa-4c7d-91d8-ea180aaa6e33 for instance 1951bbc1-82a1-4f7e-abce-09dbed0d71f2 on chh1-master-2 Jun 10 18:00:43.717807 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-8595a3dd-2a28-4818-84cc-27c438c914db req-a38f85e1-47d2-4581-962c-5097d1ab5dff service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035491 Jun 10 18:00:43.718778 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 552/1074] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:00:43.730597 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2f9bd438-d0a3-434d-a7da-cc2d7a49e8be tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:43.741277 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2f9bd438-d0a3-434d-a7da-cc2d7a49e8be tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd" status: 200 len: 1503 microversion: 2.1 time: 0.174147 Jun 10 18:00:43.742616 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 523/1075] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:43 2022] GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd => generated 1503 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:43.821787 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ceefa142-d9a8-49bb-8021-8c21db57b0b7 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:43.823222 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ceefa142-d9a8-49bb-8021-8c21db57b0b7 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:43.830015 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ceefa142-d9a8-49bb-8021-8c21db57b0b7 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:43.830767 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ceefa142-d9a8-49bb-8021-8c21db57b0b7 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:43.831748 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ceefa142-d9a8-49bb-8021-8c21db57b0b7 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:43.832626 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ceefa142-d9a8-49bb-8021-8c21db57b0b7 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:43.987237 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-442288a5-088e-469d-aed1-aee94226a525 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:43.987999 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-442288a5-088e-469d-aed1-aee94226a525 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:43.995876 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-442288a5-088e-469d-aed1-aee94226a525 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:43.996613 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-442288a5-088e-469d-aed1-aee94226a525 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:43.997902 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-442288a5-088e-469d-aed1-aee94226a525 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:43.998652 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-442288a5-088e-469d-aed1-aee94226a525 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:44.160978 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-442288a5-088e-469d-aed1-aee94226a525 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:44.179778 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-442288a5-088e-469d-aed1-aee94226a525 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1312 microversion: 2.1 time: 0.198297 Jun 10 18:00:44.180779 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 524/1076] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:43 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1312 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:44.186829 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-391e3455-91ce-49c6-b499-b46ecb5d2920 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:44.188119 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-391e3455-91ce-49c6-b499-b46ecb5d2920 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: 1951bbc1-82a1-4f7e-abce-09dbed0d71f2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:44.194917 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-391e3455-91ce-49c6-b499-b46ecb5d2920 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:44.195507 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-391e3455-91ce-49c6-b499-b46ecb5d2920 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:44.196480 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-391e3455-91ce-49c6-b499-b46ecb5d2920 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:44.197050 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-391e3455-91ce-49c6-b499-b46ecb5d2920 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:44.223585 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ceefa142-d9a8-49bb-8021-8c21db57b0b7 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:44.239470 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ceefa142-d9a8-49bb-8021-8c21db57b0b7 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1469 microversion: 2.1 time: 0.422069 Jun 10 18:00:44.240352 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 553/1077] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:43 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1469 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:44.245486 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-391e3455-91ce-49c6-b499-b46ecb5d2920 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:44.245731 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-db551fce-abf7-4051-a67d-4d0133b55664 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:44.246161 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-391e3455-91ce-49c6-b499-b46ecb5d2920 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:44.246639 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-391e3455-91ce-49c6-b499-b46ecb5d2920 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lazy-loading 'fault' on Instance uuid 1951bbc1-82a1-4f7e-abce-09dbed0d71f2 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:00:44.246748 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-db551fce-abf7-4051-a67d-4d0133b55664 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f5230492-7afa-4202-82ed-1df1cacd2605] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:44.256342 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-db551fce-abf7-4051-a67d-4d0133b55664 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:44.256342 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-db551fce-abf7-4051-a67d-4d0133b55664 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:44.256342 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-db551fce-abf7-4051-a67d-4d0133b55664 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:44.256342 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-db551fce-abf7-4051-a67d-4d0133b55664 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:44.295657 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-391e3455-91ce-49c6-b499-b46ecb5d2920 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:44.304086 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-391e3455-91ce-49c6-b499-b46ecb5d2920 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/1951bbc1-82a1-4f7e-abce-09dbed0d71f2" status: 200 len: 1311 microversion: 2.1 time: 0.122024 Jun 10 18:00:44.305284 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 525/1078] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:44 2022] GET /compute/v2.1/servers/1951bbc1-82a1-4f7e-abce-09dbed0d71f2 => generated 1311 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:44.362203 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-db551fce-abf7-4051-a67d-4d0133b55664 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:44.365243 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-db551fce-abf7-4051-a67d-4d0133b55664 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:44.366758 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-db551fce-abf7-4051-a67d-4d0133b55664 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:44.367872 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-db551fce-abf7-4051-a67d-4d0133b55664 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605" status: 200 len: 1322 microversion: 2.25 time: 0.126009 Jun 10 18:00:44.368457 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 554/1079] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:44 2022] GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605 => generated 1322 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:00:44.603078 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6d119f6b-51fd-451a-a9c7-7fa13968ce14 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:44.603709 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6d119f6b-51fd-451a-a9c7-7fa13968ce14 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:44.610945 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6d119f6b-51fd-451a-a9c7-7fa13968ce14 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:44.611397 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6d119f6b-51fd-451a-a9c7-7fa13968ce14 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:44.612417 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6d119f6b-51fd-451a-a9c7-7fa13968ce14 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:44.613019 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6d119f6b-51fd-451a-a9c7-7fa13968ce14 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:44.757309 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6d119f6b-51fd-451a-a9c7-7fa13968ce14 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:44.759588 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8b334fd0-e845-4830-b6bf-86c37f4f0a3f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:44.760714 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8b334fd0-e845-4830-b6bf-86c37f4f0a3f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:44.767577 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6d119f6b-51fd-451a-a9c7-7fa13968ce14 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1515 microversion: 2.1 time: 0.168361 Jun 10 18:00:44.768808 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 526/1080] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:44 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:44.778179 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8b334fd0-e845-4830-b6bf-86c37f4f0a3f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:44.779410 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8b334fd0-e845-4830-b6bf-86c37f4f0a3f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:44.781133 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8b334fd0-e845-4830-b6bf-86c37f4f0a3f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:44.781682 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8b334fd0-e845-4830-b6bf-86c37f4f0a3f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:45.197563 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-869119c7-5dcf-478d-87e9-05738cf7a746 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:45.198762 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-869119c7-5dcf-478d-87e9-05738cf7a746 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:45.205767 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-869119c7-5dcf-478d-87e9-05738cf7a746 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:45.206391 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-869119c7-5dcf-478d-87e9-05738cf7a746 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:45.207178 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-869119c7-5dcf-478d-87e9-05738cf7a746 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:45.207784 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-869119c7-5dcf-478d-87e9-05738cf7a746 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:45.212633 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8b334fd0-e845-4830-b6bf-86c37f4f0a3f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:45.224772 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8b334fd0-e845-4830-b6bf-86c37f4f0a3f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd" status: 200 len: 1503 microversion: 2.1 time: 0.469033 Jun 10 18:00:45.236522 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 555/1081] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:44 2022] GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd => generated 1503 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:45.257087 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-28ce9546-ddf4-447a-bf0e-88340f2f9df7 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:45.257935 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-28ce9546-ddf4-447a-bf0e-88340f2f9df7 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:45.264744 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-28ce9546-ddf4-447a-bf0e-88340f2f9df7 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:45.266052 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-28ce9546-ddf4-447a-bf0e-88340f2f9df7 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:45.267258 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-28ce9546-ddf4-447a-bf0e-88340f2f9df7 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:45.267863 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-28ce9546-ddf4-447a-bf0e-88340f2f9df7 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:45.366150 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-869119c7-5dcf-478d-87e9-05738cf7a746 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:45.373585 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-869119c7-5dcf-478d-87e9-05738cf7a746 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1312 microversion: 2.1 time: 0.180367 Jun 10 18:00:45.374168 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 527/1082] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:45 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1312 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:45.384471 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-72374f3f-bfa0-46df-8108-4a8ff54a5e78 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:45.385291 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-72374f3f-bfa0-46df-8108-4a8ff54a5e78 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: 1951bbc1-82a1-4f7e-abce-09dbed0d71f2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:45.392341 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-72374f3f-bfa0-46df-8108-4a8ff54a5e78 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:45.393018 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-72374f3f-bfa0-46df-8108-4a8ff54a5e78 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:45.394068 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-72374f3f-bfa0-46df-8108-4a8ff54a5e78 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:45.394578 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-72374f3f-bfa0-46df-8108-4a8ff54a5e78 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:45.410301 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-72374f3f-bfa0-46df-8108-4a8ff54a5e78 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] HTTP exception thrown: Instance 1951bbc1-82a1-4f7e-abce-09dbed0d71f2 could not be found. Jun 10 18:00:45.412102 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-72374f3f-bfa0-46df-8108-4a8ff54a5e78 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Request method failure captured: Jun 10 18:00:45.412102 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/1951bbc1-82a1-4f7e-abce-09dbed0d71f2 HTTP/1.1 Jun 10 18:00:45.412102 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:00:45.412102 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:00:45.412102 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:00:45.412102 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:00:45.412102 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:00:45.412102 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:00:45.412102 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:00:45.412102 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:00:45.412102 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4Z3Zi_Ge9Nxo_7CXrqWQV4jSPLWsfsUvJWjJHyKfSHOO1FEPeplt2_0WH6Z-_3f1ssjgkQIBPNjPF1OSIhrccEyr1E-MhFjaltkeyJvmgkOpl2ZPjQAVhVgS3qwZpQrZuC0Hjy7y8wrmwtAmcZo1RJfpKJGCYTBOtJNYnOkzkYdiao Jun 10 18:00:45.412102 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:00:45.412102 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:00:45.412102 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:00:45.412102 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:00:45.412102 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:00:45.412102 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:00:45.412102 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 57b54ed932024f378743fa2d2fc36b53 Jun 10 18:00:45.412102 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ListServerFiltersTestJSON-1708142629 Jun 10 18:00:45.412102 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:00:45.412102 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:00:45.413794 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/57b54ed932024f378743fa2d2fc36b53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/57b54ed932024f378743fa2d2fc36b53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/57b54ed932024f378743fa2d2fc36b53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_57b54ed932024f378743fa2d2fc36b53", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:00:45.413794 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ListServerFiltersTestJSON-1708142629 Jun 10 18:00:45.413794 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 57b54ed932024f378743fa2d2fc36b53 Jun 10 18:00:45.413794 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1708142629 Jun 10 18:00:45.413794 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ListServerFiltersTestJSON-1708142629-project Jun 10 18:00:45.413794 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:00:45.413794 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:00:45.413794 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: bb6eb467842c4b06904eabb338f1d74e Jun 10 18:00:45.413794 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ListServerFiltersTestJSON-1708142629-project Jun 10 18:00:45.413794 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:00:45.413794 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 1951bbc1-82a1-4f7e-abce-09dbed0d71f2 could not be found. Jun 10 18:00:45.413794 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '1951bbc1-82a1-4f7e-abce-09dbed0d71f2'} Jun 10 18:00:45.414583 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:00:45.414583 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:00:45.414583 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:00:45.414583 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:00:45.414583 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:00:45.414583 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:00:45.414583 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:00:45.414583 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:00:45.414583 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:00:45.414583 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:00:45.414583 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1951bbc1-82a1-4f7e-abce-09dbed0d71f2 could not be found. Jun 10 18:00:45.414583 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:00:45.414583 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:00:45.414583 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:00:45.414583 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:00:45.414583 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:00:45.414583 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:00:45.414583 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:00:45.414583 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:00:45.414583 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:00:45.415728 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:00:45.415728 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:00:45.415728 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:00:45.415728 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:00:45.415728 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:00:45.415728 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:00:45.415728 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:00:45.415728 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1951bbc1-82a1-4f7e-abce-09dbed0d71f2 could not be found. Jun 10 18:00:45.415728 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:00:45.415728 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:00:45.415728 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:00:45.415728 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:00:45.415728 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:00:45.415728 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:00:45.415728 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:00:45.415728 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:00:45.415728 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1951bbc1-82a1-4f7e-abce-09dbed0d71f2 could not be found. Jun 10 18:00:45.415728 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:00:45.416790 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-72374f3f-bfa0-46df-8108-4a8ff54a5e78 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Returning 404 to user: Instance 1951bbc1-82a1-4f7e-abce-09dbed0d71f2 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:00:45.416790 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-72374f3f-bfa0-46df-8108-4a8ff54a5e78 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/1951bbc1-82a1-4f7e-abce-09dbed0d71f2" status: 404 len: 111 microversion: 2.1 time: 0.037999 Jun 10 18:00:45.416790 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 528/1083] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:45 2022] GET /compute/v2.1/servers/1951bbc1-82a1-4f7e-abce-09dbed0d71f2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:00:45.418862 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5bdc6eb3-69d6-4475-90fd-1ba743ed86d7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:45.419706 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5bdc6eb3-69d6-4475-90fd-1ba743ed86d7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f5230492-7afa-4202-82ed-1df1cacd2605] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:45.426867 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5bdc6eb3-69d6-4475-90fd-1ba743ed86d7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:45.427573 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5bdc6eb3-69d6-4475-90fd-1ba743ed86d7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:45.428090 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5bdc6eb3-69d6-4475-90fd-1ba743ed86d7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:45.428564 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5bdc6eb3-69d6-4475-90fd-1ba743ed86d7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:45.497531 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5bdc6eb3-69d6-4475-90fd-1ba743ed86d7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:45.503841 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-28ce9546-ddf4-447a-bf0e-88340f2f9df7 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:45.506232 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5bdc6eb3-69d6-4475-90fd-1ba743ed86d7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:45.507758 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5bdc6eb3-69d6-4475-90fd-1ba743ed86d7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:45.508922 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5bdc6eb3-69d6-4475-90fd-1ba743ed86d7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605" status: 200 len: 1320 microversion: 2.25 time: 0.093794 Jun 10 18:00:45.519252 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 529/1084] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:45 2022] GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605 => generated 1320 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:00:45.519370 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-28ce9546-ddf4-447a-bf0e-88340f2f9df7 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1469 microversion: 2.1 time: 0.258399 Jun 10 18:00:45.519474 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ac969aef-151e-4535-90a2-005791e1457e tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:45.519474 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ac969aef-151e-4535-90a2-005791e1457e tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: f4f44795-d87b-4032-a9b4-4ce68336f264] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:45.520995 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 556/1085] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:45 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1469 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:45.521705 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ac969aef-151e-4535-90a2-005791e1457e tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:45.522702 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ac969aef-151e-4535-90a2-005791e1457e tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:45.522958 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ac969aef-151e-4535-90a2-005791e1457e tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:45.523498 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ac969aef-151e-4535-90a2-005791e1457e tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:45.554135 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ac969aef-151e-4535-90a2-005791e1457e tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: f4f44795-d87b-4032-a9b4-4ce68336f264] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:00:45.791076 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-46ba0156-5156-482a-9e30-f87558e55772 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:45.791859 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-46ba0156-5156-482a-9e30-f87558e55772 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:45.799189 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-46ba0156-5156-482a-9e30-f87558e55772 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:45.799641 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-46ba0156-5156-482a-9e30-f87558e55772 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:45.800516 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-46ba0156-5156-482a-9e30-f87558e55772 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:45.800966 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-46ba0156-5156-482a-9e30-f87558e55772 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:45.855541 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ac969aef-151e-4535-90a2-005791e1457e tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "DELETE /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264" status: 204 len: 0 microversion: 2.1 time: 0.344324 Jun 10 18:00:45.858486 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 530/1086] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:00:45 2022] DELETE /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:00:45.866184 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-50d99a38-2344-49de-beb9-c56827dad8d6 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:45.866987 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-50d99a38-2344-49de-beb9-c56827dad8d6 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: f4f44795-d87b-4032-a9b4-4ce68336f264] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:45.873646 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-50d99a38-2344-49de-beb9-c56827dad8d6 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:45.874110 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-50d99a38-2344-49de-beb9-c56827dad8d6 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:45.874890 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-50d99a38-2344-49de-beb9-c56827dad8d6 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:45.875333 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-50d99a38-2344-49de-beb9-c56827dad8d6 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:46.008216 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-50d99a38-2344-49de-beb9-c56827dad8d6 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:46.016664 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-50d99a38-2344-49de-beb9-c56827dad8d6 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264" status: 200 len: 1518 microversion: 2.1 time: 0.155237 Jun 10 18:00:46.017245 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 531/1087] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:45 2022] GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:46.067037 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-46ba0156-5156-482a-9e30-f87558e55772 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:46.076523 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-46ba0156-5156-482a-9e30-f87558e55772 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1515 microversion: 2.1 time: 0.293666 Jun 10 18:00:46.078970 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 557/1088] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:45 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1515 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:46.091480 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-b50c094f-16ed-4769-a810-e4d000c287f7 req-cafd39a3-d7b3-4dfb-85e9-780446764a42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd", "name": "network-vif-unplugged", "status": "completed", "tag": "64c42e0e-3ccd-469e-bafd-7ce42fa87561"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:46.100146 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-b50c094f-16ed-4769-a810-e4d000c287f7 req-cafd39a3-d7b3-4dfb-85e9-780446764a42 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:46.100605 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-b50c094f-16ed-4769-a810-e4d000c287f7 req-cafd39a3-d7b3-4dfb-85e9-780446764a42 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:46.103367 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:00:46.112949 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-b50c094f-16ed-4769-a810-e4d000c287f7 req-cafd39a3-d7b3-4dfb-85e9-780446764a42 service nova] Creating event network-vif-unplugged:64c42e0e-3ccd-469e-bafd-7ce42fa87561 for instance 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd on chh1-master-2 Jun 10 18:00:46.118817 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-b50c094f-16ed-4769-a810-e4d000c287f7 req-cafd39a3-d7b3-4dfb-85e9-780446764a42 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030927 Jun 10 18:00:46.119411 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 532/1089] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:00:46.242387 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1ebccefd-c262-41e1-97d4-119ea8f55bac tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:46.243001 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1ebccefd-c262-41e1-97d4-119ea8f55bac tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:46.251080 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1ebccefd-c262-41e1-97d4-119ea8f55bac tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:46.251547 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1ebccefd-c262-41e1-97d4-119ea8f55bac tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:46.252358 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1ebccefd-c262-41e1-97d4-119ea8f55bac tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:46.252814 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1ebccefd-c262-41e1-97d4-119ea8f55bac tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:46.392233 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2d402ca5-751b-4cc5-9070-ea06b8092e01 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:46.392868 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2d402ca5-751b-4cc5-9070-ea06b8092e01 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:46.399810 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2d402ca5-751b-4cc5-9070-ea06b8092e01 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:46.400262 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2d402ca5-751b-4cc5-9070-ea06b8092e01 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:46.402133 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2d402ca5-751b-4cc5-9070-ea06b8092e01 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:46.402578 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2d402ca5-751b-4cc5-9070-ea06b8092e01 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:46.544018 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2d402ca5-751b-4cc5-9070-ea06b8092e01 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:46.552150 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2d402ca5-751b-4cc5-9070-ea06b8092e01 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1312 microversion: 2.1 time: 0.164664 Jun 10 18:00:46.552936 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 533/1090] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:46 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1312 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:46.557338 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-968dbe09-f254-4ee8-aaa7-4757366295f7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:46.557938 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-968dbe09-f254-4ee8-aaa7-4757366295f7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f5230492-7afa-4202-82ed-1df1cacd2605] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:46.563766 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-968dbe09-f254-4ee8-aaa7-4757366295f7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:46.564219 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-968dbe09-f254-4ee8-aaa7-4757366295f7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:46.565013 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-968dbe09-f254-4ee8-aaa7-4757366295f7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:46.565457 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-968dbe09-f254-4ee8-aaa7-4757366295f7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:46.591254 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1ebccefd-c262-41e1-97d4-119ea8f55bac tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:46.600134 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1ebccefd-c262-41e1-97d4-119ea8f55bac tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd" status: 200 len: 1503 microversion: 2.1 time: 0.362241 Jun 10 18:00:46.600756 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 558/1091] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:46 2022] GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd => generated 1503 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:46.605518 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f56ee1b5-583a-4abb-95b7-636e8e744c18 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:46.606417 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f56ee1b5-583a-4abb-95b7-636e8e744c18 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:46.616044 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f56ee1b5-583a-4abb-95b7-636e8e744c18 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:46.616787 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f56ee1b5-583a-4abb-95b7-636e8e744c18 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:46.617573 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f56ee1b5-583a-4abb-95b7-636e8e744c18 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:46.618018 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f56ee1b5-583a-4abb-95b7-636e8e744c18 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:46.703754 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-968dbe09-f254-4ee8-aaa7-4757366295f7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:46.711939 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-968dbe09-f254-4ee8-aaa7-4757366295f7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:46.713564 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-968dbe09-f254-4ee8-aaa7-4757366295f7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:46.714678 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-968dbe09-f254-4ee8-aaa7-4757366295f7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605" status: 200 len: 1362 microversion: 2.25 time: 0.160949 Jun 10 18:00:46.715264 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 534/1092] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:46 2022] GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:00:46.865838 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f56ee1b5-583a-4abb-95b7-636e8e744c18 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:46.876256 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f56ee1b5-583a-4abb-95b7-636e8e744c18 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1469 microversion: 2.1 time: 0.272996 Jun 10 18:00:46.876256 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 559/1093] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:46 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1469 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:47.035227 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-39e8c969-ae1c-4233-87ec-eb1e0977a5f5 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:47.036484 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-39e8c969-ae1c-4233-87ec-eb1e0977a5f5 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: f4f44795-d87b-4032-a9b4-4ce68336f264] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:47.038589 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:00:47.043821 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-39e8c969-ae1c-4233-87ec-eb1e0977a5f5 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:47.044292 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-39e8c969-ae1c-4233-87ec-eb1e0977a5f5 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:47.045108 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-39e8c969-ae1c-4233-87ec-eb1e0977a5f5 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:47.045551 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-39e8c969-ae1c-4233-87ec-eb1e0977a5f5 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:47.092774 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1b9c87e0-10df-4482-8ea0-a76d13c5d9d1 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:47.097080 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1b9c87e0-10df-4482-8ea0-a76d13c5d9d1 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:47.107315 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1b9c87e0-10df-4482-8ea0-a76d13c5d9d1 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:47.112375 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1b9c87e0-10df-4482-8ea0-a76d13c5d9d1 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:47.113252 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1b9c87e0-10df-4482-8ea0-a76d13c5d9d1 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:47.113765 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1b9c87e0-10df-4482-8ea0-a76d13c5d9d1 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:47.205404 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-39e8c969-ae1c-4233-87ec-eb1e0977a5f5 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:47.213004 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-39e8c969-ae1c-4233-87ec-eb1e0977a5f5 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264" status: 200 len: 1518 microversion: 2.1 time: 0.182935 Jun 10 18:00:47.213567 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 535/1094] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:47 2022] GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264 => generated 1518 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:47.304246 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1b9c87e0-10df-4482-8ea0-a76d13c5d9d1 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:47.312397 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1b9c87e0-10df-4482-8ea0-a76d13c5d9d1 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1515 microversion: 2.1 time: 0.223236 Jun 10 18:00:47.312972 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 560/1095] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:47 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1515 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:47.568972 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d9184be2-4cca-42ee-9c09-733c41e0c97a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:47.569583 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d9184be2-4cca-42ee-9c09-733c41e0c97a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:47.575614 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d9184be2-4cca-42ee-9c09-733c41e0c97a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:47.576067 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d9184be2-4cca-42ee-9c09-733c41e0c97a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:47.576861 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d9184be2-4cca-42ee-9c09-733c41e0c97a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:47.577332 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d9184be2-4cca-42ee-9c09-733c41e0c97a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:47.618189 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a7845846-e317-41ac-9572-5e7efe597c10 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:47.619329 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a7845846-e317-41ac-9572-5e7efe597c10 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:47.627889 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a7845846-e317-41ac-9572-5e7efe597c10 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:47.628365 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a7845846-e317-41ac-9572-5e7efe597c10 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:47.629197 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a7845846-e317-41ac-9572-5e7efe597c10 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:47.629636 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a7845846-e317-41ac-9572-5e7efe597c10 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:47.838294 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a7845846-e317-41ac-9572-5e7efe597c10 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:47.847321 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a7845846-e317-41ac-9572-5e7efe597c10 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd" status: 200 len: 1503 microversion: 2.1 time: 0.233736 Jun 10 18:00:47.848165 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 561/1096] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:47 2022] GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd => generated 1503 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:47.853139 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-438ac038-0067-42a3-a1b7-74037e895285 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:47.853747 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-438ac038-0067-42a3-a1b7-74037e895285 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f5230492-7afa-4202-82ed-1df1cacd2605] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:47.860546 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-438ac038-0067-42a3-a1b7-74037e895285 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:47.861257 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-438ac038-0067-42a3-a1b7-74037e895285 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:47.862038 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-438ac038-0067-42a3-a1b7-74037e895285 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:47.862660 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-438ac038-0067-42a3-a1b7-74037e895285 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:47.977305 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d9184be2-4cca-42ee-9c09-733c41e0c97a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:47.985565 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d9184be2-4cca-42ee-9c09-733c41e0c97a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1312 microversion: 2.1 time: 0.420429 Jun 10 18:00:47.986224 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 536/1097] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:47 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1312 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:47.990831 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-522f2471-3c09-46a4-9680-80fc72948dc5 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:47.991432 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-522f2471-3c09-46a4-9680-80fc72948dc5 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:47.997749 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-522f2471-3c09-46a4-9680-80fc72948dc5 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:47.998215 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-522f2471-3c09-46a4-9680-80fc72948dc5 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:47.998981 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-522f2471-3c09-46a4-9680-80fc72948dc5 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:47.999448 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-522f2471-3c09-46a4-9680-80fc72948dc5 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:48.007283 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-438ac038-0067-42a3-a1b7-74037e895285 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:48.016543 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-438ac038-0067-42a3-a1b7-74037e895285 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:48.018308 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-438ac038-0067-42a3-a1b7-74037e895285 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:48.019490 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-438ac038-0067-42a3-a1b7-74037e895285 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605" status: 200 len: 1362 microversion: 2.25 time: 0.170018 Jun 10 18:00:48.020048 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 562/1098] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:47 2022] GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:00:48.024708 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-72739fa3-434e-4851-8f15-2cffd6b8077d req-15933a40-75c8-4714-9be5-22482f335a78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89b2f687-3173-411f-92fa-c2e4dde322f6", "name": "network-vif-plugged", "status": "completed", "tag": "ee1a855b-cfd0-4246-8752-23c466c46c38"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:48.033647 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-72739fa3-434e-4851-8f15-2cffd6b8077d req-15933a40-75c8-4714-9be5-22482f335a78 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:48.034101 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-72739fa3-434e-4851-8f15-2cffd6b8077d req-15933a40-75c8-4714-9be5-22482f335a78 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:48.045666 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-72739fa3-434e-4851-8f15-2cffd6b8077d req-15933a40-75c8-4714-9be5-22482f335a78 service nova] Creating event network-vif-plugged:ee1a855b-cfd0-4246-8752-23c466c46c38 for instance 89b2f687-3173-411f-92fa-c2e4dde322f6 on chh2-master-2 Jun 10 18:00:48.052367 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-72739fa3-434e-4851-8f15-2cffd6b8077d req-15933a40-75c8-4714-9be5-22482f335a78 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030892 Jun 10 18:00:48.053005 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 563/1099] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:00:48.133595 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-522f2471-3c09-46a4-9680-80fc72948dc5 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:48.136822 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-8e753dff-666b-454d-9035-06fa3d2482e8 req-76859759-2a8c-4dcc-857e-2138a3c39489 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd", "tag": "64c42e0e-3ccd-469e-bafd-7ce42fa87561"}, {"name": "network-changed", "server_uuid": "f5230492-7afa-4202-82ed-1df1cacd2605", "tag": "12fa01a2-8605-49e5-baff-4c9c0392af50"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:48.141451 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-522f2471-3c09-46a4-9680-80fc72948dc5 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1469 microversion: 2.1 time: 0.154266 Jun 10 18:00:48.142922 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 537/1100] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:47 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1469 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:48.147903 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-8e753dff-666b-454d-9035-06fa3d2482e8 req-76859759-2a8c-4dcc-857e-2138a3c39489 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:48.148396 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-8e753dff-666b-454d-9035-06fa3d2482e8 req-76859759-2a8c-4dcc-857e-2138a3c39489 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:48.160992 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-8e753dff-666b-454d-9035-06fa3d2482e8 req-76859759-2a8c-4dcc-857e-2138a3c39489 service nova] Creating event network-changed:64c42e0e-3ccd-469e-bafd-7ce42fa87561 for instance 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd on chh1-master-2 Jun 10 18:00:48.161500 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-8e753dff-666b-454d-9035-06fa3d2482e8 req-76859759-2a8c-4dcc-857e-2138a3c39489 service nova] Creating event network-changed:12fa01a2-8605-49e5-baff-4c9c0392af50 for instance f5230492-7afa-4202-82ed-1df1cacd2605 on chh1-master-2 Jun 10 18:00:48.168220 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-8e753dff-666b-454d-9035-06fa3d2482e8 req-76859759-2a8c-4dcc-857e-2138a3c39489 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.037801 Jun 10 18:00:48.169483 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 564/1101] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:00:48.229362 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a5ad65d4-fbd8-4718-b25c-84ddf2e9ce9c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:48.229974 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a5ad65d4-fbd8-4718-b25c-84ddf2e9ce9c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: f4f44795-d87b-4032-a9b4-4ce68336f264] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:48.236290 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a5ad65d4-fbd8-4718-b25c-84ddf2e9ce9c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:48.236773 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a5ad65d4-fbd8-4718-b25c-84ddf2e9ce9c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:48.237563 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a5ad65d4-fbd8-4718-b25c-84ddf2e9ce9c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:48.238004 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a5ad65d4-fbd8-4718-b25c-84ddf2e9ce9c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:48.336941 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-efba9191-551f-4ffc-89c0-288f4e295614 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:48.338403 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-efba9191-551f-4ffc-89c0-288f4e295614 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:48.348505 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-efba9191-551f-4ffc-89c0-288f4e295614 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:48.349391 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-efba9191-551f-4ffc-89c0-288f4e295614 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:48.350673 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-efba9191-551f-4ffc-89c0-288f4e295614 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:48.351326 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-efba9191-551f-4ffc-89c0-288f4e295614 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:48.384459 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a5ad65d4-fbd8-4718-b25c-84ddf2e9ce9c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:48.392460 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a5ad65d4-fbd8-4718-b25c-84ddf2e9ce9c tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264" status: 200 len: 1518 microversion: 2.1 time: 0.167027 Jun 10 18:00:48.393224 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 538/1102] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:48 2022] GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264 => generated 1518 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:48.616979 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-efba9191-551f-4ffc-89c0-288f4e295614 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:48.626514 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-efba9191-551f-4ffc-89c0-288f4e295614 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1515 microversion: 2.1 time: 0.300106 Jun 10 18:00:48.627327 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 565/1103] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:48 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1515 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:48.865332 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-90344d77-4741-4ea5-85b2-fe108bfc7ace tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:48.865949 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-90344d77-4741-4ea5-85b2-fe108bfc7ace tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:48.873461 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90344d77-4741-4ea5-85b2-fe108bfc7ace tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:48.873589 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90344d77-4741-4ea5-85b2-fe108bfc7ace tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:48.874977 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90344d77-4741-4ea5-85b2-fe108bfc7ace tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:48.876198 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90344d77-4741-4ea5-85b2-fe108bfc7ace tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:49.003009 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c0924f0d-e7a4-45dc-8552-b73913f7c838 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:49.003943 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c0924f0d-e7a4-45dc-8552-b73913f7c838 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:49.011479 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c0924f0d-e7a4-45dc-8552-b73913f7c838 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:49.012098 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c0924f0d-e7a4-45dc-8552-b73913f7c838 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:49.013096 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c0924f0d-e7a4-45dc-8552-b73913f7c838 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:49.013537 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c0924f0d-e7a4-45dc-8552-b73913f7c838 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:49.031895 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-90344d77-4741-4ea5-85b2-fe108bfc7ace tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:49.040197 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-90344d77-4741-4ea5-85b2-fe108bfc7ace tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd" status: 200 len: 1503 microversion: 2.1 time: 0.178750 Jun 10 18:00:49.050275 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 539/1104] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:48 2022] GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd => generated 1503 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:49.055018 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-898f495b-c202-45dd-8679-d5d3cba40b1f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:49.055632 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-898f495b-c202-45dd-8679-d5d3cba40b1f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f5230492-7afa-4202-82ed-1df1cacd2605] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:49.061640 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-898f495b-c202-45dd-8679-d5d3cba40b1f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:49.062113 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-898f495b-c202-45dd-8679-d5d3cba40b1f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:49.062891 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-898f495b-c202-45dd-8679-d5d3cba40b1f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:49.063341 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-898f495b-c202-45dd-8679-d5d3cba40b1f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:49.144828 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c0924f0d-e7a4-45dc-8552-b73913f7c838 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:49.152783 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c0924f0d-e7a4-45dc-8552-b73913f7c838 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1312 microversion: 2.1 time: 0.153818 Jun 10 18:00:49.153157 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 566/1105] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:48 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1312 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:49.159182 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1fd51bf5-974c-4728-8ff9-7531fcf00376 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:49.159824 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1fd51bf5-974c-4728-8ff9-7531fcf00376 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:49.165903 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1fd51bf5-974c-4728-8ff9-7531fcf00376 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:49.166360 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1fd51bf5-974c-4728-8ff9-7531fcf00376 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:49.167168 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1fd51bf5-974c-4728-8ff9-7531fcf00376 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:49.167615 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1fd51bf5-974c-4728-8ff9-7531fcf00376 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:49.182392 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:00:49.189548 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-898f495b-c202-45dd-8679-d5d3cba40b1f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:49.197738 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-898f495b-c202-45dd-8679-d5d3cba40b1f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:49.199258 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-898f495b-c202-45dd-8679-d5d3cba40b1f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:49.200445 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-898f495b-c202-45dd-8679-d5d3cba40b1f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605" status: 200 len: 1362 microversion: 2.25 time: 0.149111 Jun 10 18:00:49.200997 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 540/1106] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:49 2022] GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:00:49.297953 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1fd51bf5-974c-4728-8ff9-7531fcf00376 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:49.305575 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1fd51bf5-974c-4728-8ff9-7531fcf00376 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1469 microversion: 2.1 time: 0.150905 Jun 10 18:00:49.306142 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 567/1107] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:49 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1469 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:49.410079 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-654e7f93-036e-40aa-9822-f777379f98e4 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:49.410697 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-654e7f93-036e-40aa-9822-f777379f98e4 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: f4f44795-d87b-4032-a9b4-4ce68336f264] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:49.417189 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-654e7f93-036e-40aa-9822-f777379f98e4 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:49.417652 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-654e7f93-036e-40aa-9822-f777379f98e4 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:49.418445 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-654e7f93-036e-40aa-9822-f777379f98e4 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:49.418891 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-654e7f93-036e-40aa-9822-f777379f98e4 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:49.490825 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-654e7f93-036e-40aa-9822-f777379f98e4 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:49.498824 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-654e7f93-036e-40aa-9822-f777379f98e4 tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264" status: 200 len: 1476 microversion: 2.1 time: 0.093212 Jun 10 18:00:49.499934 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 541/1108] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:49 2022] GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264 => generated 1476 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:49.644623 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6d34bc74-4a06-42d2-a1d6-9275d7c60129 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:49.645290 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6d34bc74-4a06-42d2-a1d6-9275d7c60129 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:49.651454 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d34bc74-4a06-42d2-a1d6-9275d7c60129 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:49.651979 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d34bc74-4a06-42d2-a1d6-9275d7c60129 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:49.652789 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d34bc74-4a06-42d2-a1d6-9275d7c60129 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:49.653235 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d34bc74-4a06-42d2-a1d6-9275d7c60129 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:49.846132 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6d34bc74-4a06-42d2-a1d6-9275d7c60129 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:49.853866 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6d34bc74-4a06-42d2-a1d6-9275d7c60129 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1515 microversion: 2.1 time: 0.213831 Jun 10 18:00:49.854435 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 568/1109] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:49 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1515 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:50.057949 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c81e52e0-0023-4ef0-908c-9bd2daba96f0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:50.058627 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c81e52e0-0023-4ef0-908c-9bd2daba96f0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:50.066131 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c81e52e0-0023-4ef0-908c-9bd2daba96f0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:50.066644 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c81e52e0-0023-4ef0-908c-9bd2daba96f0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:50.067632 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c81e52e0-0023-4ef0-908c-9bd2daba96f0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:50.068075 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c81e52e0-0023-4ef0-908c-9bd2daba96f0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:50.169570 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-04681c22-50f8-4cf7-8d7d-d928e856a4fd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:50.170679 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-04681c22-50f8-4cf7-8d7d-d928e856a4fd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:50.178124 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-04681c22-50f8-4cf7-8d7d-d928e856a4fd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:50.178950 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-04681c22-50f8-4cf7-8d7d-d928e856a4fd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:50.179814 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-04681c22-50f8-4cf7-8d7d-d928e856a4fd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:50.180407 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-04681c22-50f8-4cf7-8d7d-d928e856a4fd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:50.198136 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c81e52e0-0023-4ef0-908c-9bd2daba96f0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:50.206608 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c81e52e0-0023-4ef0-908c-9bd2daba96f0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd" status: 200 len: 1503 microversion: 2.1 time: 0.152739 Jun 10 18:00:50.207398 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 542/1110] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:50 2022] GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:50.212254 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-7f8e4f32-49cf-4648-9279-76e195fa7d2a req-12457818-eb51-462c-85e8-420c69c8b568 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4f44795-d87b-4032-a9b4-4ce68336f264", "name": "network-vif-deleted", "tag": "d4ea69a1-84bb-4e29-8fa9-3f0eecbe4c34"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:50.234917 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-7f8e4f32-49cf-4648-9279-76e195fa7d2a req-12457818-eb51-462c-85e8-420c69c8b568 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:50.235282 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-7f8e4f32-49cf-4648-9279-76e195fa7d2a req-12457818-eb51-462c-85e8-420c69c8b568 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:50.247177 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-7f8e4f32-49cf-4648-9279-76e195fa7d2a req-12457818-eb51-462c-85e8-420c69c8b568 service nova] Creating event network-vif-deleted:d4ea69a1-84bb-4e29-8fa9-3f0eecbe4c34 for instance f4f44795-d87b-4032-a9b4-4ce68336f264 on chh2-master-2 Jun 10 18:00:50.252597 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-7f8e4f32-49cf-4648-9279-76e195fa7d2a req-12457818-eb51-462c-85e8-420c69c8b568 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043796 Jun 10 18:00:50.253342 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 543/1111] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:00:50.258878 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-85400edb-f36e-449b-ae86-9ed026ccd3de tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:50.259582 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-85400edb-f36e-449b-ae86-9ed026ccd3de tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f5230492-7afa-4202-82ed-1df1cacd2605] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:50.266190 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-85400edb-f36e-449b-ae86-9ed026ccd3de tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:50.266661 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-85400edb-f36e-449b-ae86-9ed026ccd3de tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:50.267437 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-85400edb-f36e-449b-ae86-9ed026ccd3de tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:50.267881 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-85400edb-f36e-449b-ae86-9ed026ccd3de tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:50.407779 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-85400edb-f36e-449b-ae86-9ed026ccd3de tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:50.423200 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-85400edb-f36e-449b-ae86-9ed026ccd3de tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:50.427317 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-85400edb-f36e-449b-ae86-9ed026ccd3de tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:50.428491 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-85400edb-f36e-449b-ae86-9ed026ccd3de tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605" status: 200 len: 1362 microversion: 2.25 time: 0.174006 Jun 10 18:00:50.429057 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 544/1112] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:50 2022] GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:00:50.433679 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7c5c16a8-afa5-471b-b2a0-a44010373d37 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:50.434283 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7c5c16a8-afa5-471b-b2a0-a44010373d37 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:50.440413 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7c5c16a8-afa5-471b-b2a0-a44010373d37 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:50.440875 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7c5c16a8-afa5-471b-b2a0-a44010373d37 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:50.441828 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7c5c16a8-afa5-471b-b2a0-a44010373d37 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:50.442274 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7c5c16a8-afa5-471b-b2a0-a44010373d37 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:50.581354 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7c5c16a8-afa5-471b-b2a0-a44010373d37 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:50.589783 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7c5c16a8-afa5-471b-b2a0-a44010373d37 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1469 microversion: 2.1 time: 0.159548 Jun 10 18:00:50.590852 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 545/1113] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:50 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1469 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:50.598400 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ea6e42e8-b66f-4d63-8bd2-d3d0e2f8e16f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:50.598797 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ea6e42e8-b66f-4d63-8bd2-d3d0e2f8e16f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: f4f44795-d87b-4032-a9b4-4ce68336f264] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:50.605887 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ea6e42e8-b66f-4d63-8bd2-d3d0e2f8e16f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:50.606833 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ea6e42e8-b66f-4d63-8bd2-d3d0e2f8e16f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:50.607692 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ea6e42e8-b66f-4d63-8bd2-d3d0e2f8e16f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:50.608210 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ea6e42e8-b66f-4d63-8bd2-d3d0e2f8e16f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:50.642026 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-04681c22-50f8-4cf7-8d7d-d928e856a4fd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:50.642599 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ea6e42e8-b66f-4d63-8bd2-d3d0e2f8e16f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:50.643163 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ea6e42e8-b66f-4d63-8bd2-d3d0e2f8e16f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:50.643771 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-ea6e42e8-b66f-4d63-8bd2-d3d0e2f8e16f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lazy-loading 'fault' on Instance uuid f4f44795-d87b-4032-a9b4-4ce68336f264 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:00:50.650006 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-04681c22-50f8-4cf7-8d7d-d928e856a4fd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1312 microversion: 2.1 time: 0.484540 Jun 10 18:00:50.650753 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 569/1114] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:50 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1312 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:50.686279 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ea6e42e8-b66f-4d63-8bd2-d3d0e2f8e16f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb6eb467842c4b06904eabb338f1d74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b54ed932024f378743fa2d2fc36b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:50.694979 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ea6e42e8-b66f-4d63-8bd2-d3d0e2f8e16f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264" status: 200 len: 1311 microversion: 2.1 time: 0.102459 Jun 10 18:00:50.695640 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 546/1115] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:50 2022] GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264 => generated 1311 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:50.871748 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4b65695c-e0fe-41fc-9f7b-b9532dd69c4e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:50.872616 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4b65695c-e0fe-41fc-9f7b-b9532dd69c4e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:50.875144 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=28 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:00:50.880180 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4b65695c-e0fe-41fc-9f7b-b9532dd69c4e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:50.880664 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4b65695c-e0fe-41fc-9f7b-b9532dd69c4e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:50.881437 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4b65695c-e0fe-41fc-9f7b-b9532dd69c4e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:50.881875 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4b65695c-e0fe-41fc-9f7b-b9532dd69c4e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:51.010869 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=18 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:00:51.017243 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4b65695c-e0fe-41fc-9f7b-b9532dd69c4e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:51.022500 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4b65695c-e0fe-41fc-9f7b-b9532dd69c4e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1515 microversion: 2.1 time: 0.155091 Jun 10 18:00:51.023086 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 570/1116] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:50 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:51.224531 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4938cbb1-9633-4ecb-98d9-19afab6d6c02 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:51.225153 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4938cbb1-9633-4ecb-98d9-19afab6d6c02 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:51.227131 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=10 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:00:51.232771 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4938cbb1-9633-4ecb-98d9-19afab6d6c02 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:51.235477 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4938cbb1-9633-4ecb-98d9-19afab6d6c02 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:51.235477 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4938cbb1-9633-4ecb-98d9-19afab6d6c02 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:51.235477 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4938cbb1-9633-4ecb-98d9-19afab6d6c02 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:51.362415 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4938cbb1-9633-4ecb-98d9-19afab6d6c02 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:51.369904 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4938cbb1-9633-4ecb-98d9-19afab6d6c02 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd" status: 200 len: 1503 microversion: 2.1 time: 0.149390 Jun 10 18:00:51.370512 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 547/1117] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:51 2022] GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:51.446124 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-99075a05-95d4-4876-9ff0-075ab90fa134 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:51.446733 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-99075a05-95d4-4876-9ff0-075ab90fa134 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f5230492-7afa-4202-82ed-1df1cacd2605] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:51.455276 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99075a05-95d4-4876-9ff0-075ab90fa134 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:51.455747 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99075a05-95d4-4876-9ff0-075ab90fa134 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:51.456539 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99075a05-95d4-4876-9ff0-075ab90fa134 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:51.456988 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99075a05-95d4-4876-9ff0-075ab90fa134 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:51.583930 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-99075a05-95d4-4876-9ff0-075ab90fa134 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:51.591989 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-99075a05-95d4-4876-9ff0-075ab90fa134 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:51.594425 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-99075a05-95d4-4876-9ff0-075ab90fa134 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:51.595533 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-99075a05-95d4-4876-9ff0-075ab90fa134 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605" status: 200 len: 1362 microversion: 2.25 time: 0.153381 Jun 10 18:00:51.596089 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 571/1118] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:51 2022] GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:00:51.607294 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-84a522a3-f9b4-45ac-8378-04b8843b9314 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:51.608108 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-84a522a3-f9b4-45ac-8378-04b8843b9314 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:51.614328 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-84a522a3-f9b4-45ac-8378-04b8843b9314 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:51.614777 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-84a522a3-f9b4-45ac-8378-04b8843b9314 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:51.615537 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-84a522a3-f9b4-45ac-8378-04b8843b9314 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:51.615976 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-84a522a3-f9b4-45ac-8378-04b8843b9314 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:51.667543 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fde5deb2-89b6-4b79-a1e7-adfa8a8a0728 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:51.668163 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fde5deb2-89b6-4b79-a1e7-adfa8a8a0728 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:51.674853 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fde5deb2-89b6-4b79-a1e7-adfa8a8a0728 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:51.675367 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fde5deb2-89b6-4b79-a1e7-adfa8a8a0728 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:51.676154 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fde5deb2-89b6-4b79-a1e7-adfa8a8a0728 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:51.676625 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fde5deb2-89b6-4b79-a1e7-adfa8a8a0728 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:51.757154 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-84a522a3-f9b4-45ac-8378-04b8843b9314 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:51.767180 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-84a522a3-f9b4-45ac-8378-04b8843b9314 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1469 microversion: 2.1 time: 0.163628 Jun 10 18:00:51.768641 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 548/1119] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:51 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1469 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:51.773582 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b4550fbf-d9d4-4135-af05-9f11408a822f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:51.774473 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b4550fbf-d9d4-4135-af05-9f11408a822f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] [instance: f4f44795-d87b-4032-a9b4-4ce68336f264] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:51.785421 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b4550fbf-d9d4-4135-af05-9f11408a822f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:51.789006 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b4550fbf-d9d4-4135-af05-9f11408a822f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:51.789006 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b4550fbf-d9d4-4135-af05-9f11408a822f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:51.789006 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b4550fbf-d9d4-4135-af05-9f11408a822f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:51.804421 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-b4550fbf-d9d4-4135-af05-9f11408a822f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] HTTP exception thrown: Instance f4f44795-d87b-4032-a9b4-4ce68336f264 could not be found. Jun 10 18:00:51.806127 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b4550fbf-d9d4-4135-af05-9f11408a822f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Request method failure captured: Jun 10 18:00:51.806127 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264 HTTP/1.1 Jun 10 18:00:51.806127 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:00:51.806127 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:00:51.806127 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:00:51.806127 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:00:51.806127 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:00:51.806127 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:00:51.806127 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:00:51.806127 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:00:51.806127 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4Z3Zi_Ge9Nxo_7CXrqWQV4jSPLWsfsUvJWjJHyKfSHOO1FEPeplt2_0WH6Z-_3f1ssjgkQIBPNjPF1OSIhrccEyr1E-MhFjaltkeyJvmgkOpl2ZPjQAVhVgS3qwZpQrZuC0Hjy7y8wrmwtAmcZo1RJfpKJGCYTBOtJNYnOkzkYdiao Jun 10 18:00:51.806127 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:00:51.806127 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:00:51.806127 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:00:51.806127 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:00:51.806127 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:00:51.806127 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:00:51.806127 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 57b54ed932024f378743fa2d2fc36b53 Jun 10 18:00:51.806127 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ListServerFiltersTestJSON-1708142629 Jun 10 18:00:51.806127 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:00:51.806127 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:00:51.807677 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/57b54ed932024f378743fa2d2fc36b53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/57b54ed932024f378743fa2d2fc36b53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/57b54ed932024f378743fa2d2fc36b53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_57b54ed932024f378743fa2d2fc36b53", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:00:51.807677 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ListServerFiltersTestJSON-1708142629 Jun 10 18:00:51.807677 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 57b54ed932024f378743fa2d2fc36b53 Jun 10 18:00:51.807677 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1708142629 Jun 10 18:00:51.807677 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ListServerFiltersTestJSON-1708142629-project Jun 10 18:00:51.807677 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:00:51.807677 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:00:51.807677 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: bb6eb467842c4b06904eabb338f1d74e Jun 10 18:00:51.807677 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ListServerFiltersTestJSON-1708142629-project Jun 10 18:00:51.807677 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:00:51.807677 chdv-master-2 devstack@n-api.service[126594]: exception: Instance f4f44795-d87b-4032-a9b4-4ce68336f264 could not be found. Jun 10 18:00:51.807677 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'f4f44795-d87b-4032-a9b4-4ce68336f264'} Jun 10 18:00:51.808509 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:00:51.808509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:00:51.808509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:00:51.808509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:00:51.808509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:00:51.808509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:00:51.808509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:00:51.808509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:00:51.808509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:00:51.808509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:00:51.808509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4f44795-d87b-4032-a9b4-4ce68336f264 could not be found. Jun 10 18:00:51.808509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:00:51.808509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:00:51.808509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:00:51.808509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:00:51.808509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:00:51.808509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:00:51.808509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:00:51.808509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:00:51.808509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:00:51.809680 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:00:51.809680 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:00:51.809680 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:00:51.809680 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:00:51.809680 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:00:51.809680 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:00:51.809680 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:00:51.809680 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4f44795-d87b-4032-a9b4-4ce68336f264 could not be found. Jun 10 18:00:51.809680 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:00:51.809680 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:00:51.809680 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:00:51.809680 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:00:51.809680 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:00:51.809680 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:00:51.809680 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:00:51.809680 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:00:51.809680 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4f44795-d87b-4032-a9b4-4ce68336f264 could not be found. Jun 10 18:00:51.809680 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:00:51.810834 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b4550fbf-d9d4-4135-af05-9f11408a822f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] Returning 404 to user: Instance f4f44795-d87b-4032-a9b4-4ce68336f264 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:00:51.810834 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b4550fbf-d9d4-4135-af05-9f11408a822f tempest-ListServerFiltersTestJSON-1708142629 tempest-ListServerFiltersTestJSON-1708142629-project] 10.222.0.35 "GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264" status: 404 len: 111 microversion: 2.1 time: 0.037997 Jun 10 18:00:51.810834 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 549/1120] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:51 2022] GET /compute/v2.1/servers/f4f44795-d87b-4032-a9b4-4ce68336f264 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:00:51.822010 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fde5deb2-89b6-4b79-a1e7-adfa8a8a0728 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:51.830425 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fde5deb2-89b6-4b79-a1e7-adfa8a8a0728 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1462 microversion: 2.1 time: 0.166923 Jun 10 18:00:51.830997 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 572/1121] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:51 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1462 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:51.847445 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-783ba90c-f709-4888-9bbe-436257845b27 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:51.848511 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-783ba90c-f709-4888-9bbe-436257845b27 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:51.854693 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-783ba90c-f709-4888-9bbe-436257845b27 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:51.855116 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-783ba90c-f709-4888-9bbe-436257845b27 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:51.855921 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-783ba90c-f709-4888-9bbe-436257845b27 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:51.856464 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-783ba90c-f709-4888-9bbe-436257845b27 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:51.919650 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:00:51.950595 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-783ba90c-f709-4888-9bbe-436257845b27 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:51.967784 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-783ba90c-f709-4888-9bbe-436257845b27 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Old instance type m1.heat2, new instance type m1.heat {{(pid=126594) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 10 18:00:51.974632 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-783ba90c-f709-4888-9bbe-436257845b27 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:00:51.975177 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-783ba90c-f709-4888-9bbe-436257845b27 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:00:51.975760 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-783ba90c-f709-4888-9bbe-436257845b27 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:00:51.976277 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-783ba90c-f709-4888-9bbe-436257845b27 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:00:51.976810 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-783ba90c-f709-4888-9bbe-436257845b27 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:00:52.040422 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0be1cb59-53dc-4ad0-9fab-9796ed4c5aee tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:52.041156 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0be1cb59-53dc-4ad0-9fab-9796ed4c5aee tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:52.048860 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0be1cb59-53dc-4ad0-9fab-9796ed4c5aee tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:52.049661 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0be1cb59-53dc-4ad0-9fab-9796ed4c5aee tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:52.050521 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0be1cb59-53dc-4ad0-9fab-9796ed4c5aee tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:52.051055 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0be1cb59-53dc-4ad0-9fab-9796ed4c5aee tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:52.187431 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0be1cb59-53dc-4ad0-9fab-9796ed4c5aee tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:52.196902 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0be1cb59-53dc-4ad0-9fab-9796ed4c5aee tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1515 microversion: 2.1 time: 0.160227 Jun 10 18:00:52.197535 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 573/1122] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:52 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:52.246748 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-783ba90c-f709-4888-9bbe-436257845b27 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "POST /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6/action" status: 202 len: 0 microversion: 2.1 time: 0.403018 Jun 10 18:00:52.247620 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 550/1123] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:00:51 2022] POST /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6/action => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:00:52.256837 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-490c5740-692c-4385-9f29-233e5bd04bbc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:52.257543 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-490c5740-692c-4385-9f29-233e5bd04bbc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:52.264358 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-490c5740-692c-4385-9f29-233e5bd04bbc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:52.264902 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-490c5740-692c-4385-9f29-233e5bd04bbc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:52.265744 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-490c5740-692c-4385-9f29-233e5bd04bbc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:52.266245 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-490c5740-692c-4385-9f29-233e5bd04bbc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:52.389956 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-697a582c-21e3-43d4-9733-d57092d28bba tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:52.391021 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-697a582c-21e3-43d4-9733-d57092d28bba tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:52.402932 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-697a582c-21e3-43d4-9733-d57092d28bba tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:52.403617 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-697a582c-21e3-43d4-9733-d57092d28bba tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:52.405125 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-697a582c-21e3-43d4-9733-d57092d28bba tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:52.405919 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-697a582c-21e3-43d4-9733-d57092d28bba tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:52.442650 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-490c5740-692c-4385-9f29-233e5bd04bbc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:52.454538 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-490c5740-692c-4385-9f29-233e5bd04bbc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1471 microversion: 2.1 time: 0.201916 Jun 10 18:00:52.455745 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 574/1124] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:52 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1471 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:52.614690 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f7ed98f0-8ca2-42e1-adca-f2228cde74bc tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:52.615571 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f7ed98f0-8ca2-42e1-adca-f2228cde74bc tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f5230492-7afa-4202-82ed-1df1cacd2605] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:52.622719 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f7ed98f0-8ca2-42e1-adca-f2228cde74bc tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:52.623457 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f7ed98f0-8ca2-42e1-adca-f2228cde74bc tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:52.624727 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f7ed98f0-8ca2-42e1-adca-f2228cde74bc tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:52.625367 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f7ed98f0-8ca2-42e1-adca-f2228cde74bc tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:52.790401 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f7ed98f0-8ca2-42e1-adca-f2228cde74bc tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:52.799982 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f7ed98f0-8ca2-42e1-adca-f2228cde74bc tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:52.801548 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f7ed98f0-8ca2-42e1-adca-f2228cde74bc tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:52.803235 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f7ed98f0-8ca2-42e1-adca-f2228cde74bc tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605" status: 200 len: 1362 microversion: 2.25 time: 0.192924 Jun 10 18:00:52.803966 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 575/1125] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:52 2022] GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605 => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:00:52.818961 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-59733ed3-005f-4cc5-85eb-2e5572056932 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:52.819591 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-59733ed3-005f-4cc5-85eb-2e5572056932 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:52.825982 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-59733ed3-005f-4cc5-85eb-2e5572056932 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:52.826478 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-59733ed3-005f-4cc5-85eb-2e5572056932 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:52.827796 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-59733ed3-005f-4cc5-85eb-2e5572056932 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:52.828481 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-59733ed3-005f-4cc5-85eb-2e5572056932 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:52.932287 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-697a582c-21e3-43d4-9733-d57092d28bba tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:52.941816 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-697a582c-21e3-43d4-9733-d57092d28bba tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd" status: 200 len: 1503 microversion: 2.1 time: 0.558558 Jun 10 18:00:52.942937 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 551/1126] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:52 2022] GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd => generated 1503 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:52.984613 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-59733ed3-005f-4cc5-85eb-2e5572056932 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:52.994032 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-59733ed3-005f-4cc5-85eb-2e5572056932 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1469 microversion: 2.1 time: 0.178619 Jun 10 18:00:52.994867 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 576/1127] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:52 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1469 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:53.213879 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-502bb6e4-6f43-44d3-839b-b0904eaa5ece tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:53.214682 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-502bb6e4-6f43-44d3-839b-b0904eaa5ece tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:53.221989 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-502bb6e4-6f43-44d3-839b-b0904eaa5ece tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:53.223180 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-502bb6e4-6f43-44d3-839b-b0904eaa5ece tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:53.224514 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-502bb6e4-6f43-44d3-839b-b0904eaa5ece tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:53.226515 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-502bb6e4-6f43-44d3-839b-b0904eaa5ece tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:53.382892 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-502bb6e4-6f43-44d3-839b-b0904eaa5ece tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:53.391080 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-502bb6e4-6f43-44d3-839b-b0904eaa5ece tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1515 microversion: 2.1 time: 0.181202 Jun 10 18:00:53.391803 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 552/1128] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:53 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:53.472046 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c24feb2c-26d3-4ebf-894d-e1fa5ad043a9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:53.472698 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c24feb2c-26d3-4ebf-894d-e1fa5ad043a9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:53.479781 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c24feb2c-26d3-4ebf-894d-e1fa5ad043a9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:53.480235 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c24feb2c-26d3-4ebf-894d-e1fa5ad043a9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:53.482479 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c24feb2c-26d3-4ebf-894d-e1fa5ad043a9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:53.482479 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c24feb2c-26d3-4ebf-894d-e1fa5ad043a9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:53.618938 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c24feb2c-26d3-4ebf-894d-e1fa5ad043a9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:53.628043 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c24feb2c-26d3-4ebf-894d-e1fa5ad043a9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1471 microversion: 2.1 time: 0.159963 Jun 10 18:00:53.632763 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 577/1129] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:53 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1471 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:53.809371 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c140a526-4ae0-4ff1-ae04-c8971b017355 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:53.809873 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c140a526-4ae0-4ff1-ae04-c8971b017355 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: c922bb8c-ba7b-4448-9d8b-a6fb6498b25b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:53.819188 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c140a526-4ae0-4ff1-ae04-c8971b017355 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:53.819188 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c140a526-4ae0-4ff1-ae04-c8971b017355 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:53.819188 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c140a526-4ae0-4ff1-ae04-c8971b017355 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:53.819665 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c140a526-4ae0-4ff1-ae04-c8971b017355 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:53.821125 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1a86a40e-7688-4787-8226-318c58674f10 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:53.821742 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1a86a40e-7688-4787-8226-318c58674f10 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f5230492-7afa-4202-82ed-1df1cacd2605] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:53.827828 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1a86a40e-7688-4787-8226-318c58674f10 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:53.828289 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1a86a40e-7688-4787-8226-318c58674f10 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:53.829109 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1a86a40e-7688-4787-8226-318c58674f10 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:53.829556 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1a86a40e-7688-4787-8226-318c58674f10 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:53.843382 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c140a526-4ae0-4ff1-ae04-c8971b017355 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: c922bb8c-ba7b-4448-9d8b-a6fb6498b25b] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:00:54.042998 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1a86a40e-7688-4787-8226-318c58674f10 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:54.057332 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1a86a40e-7688-4787-8226-318c58674f10 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:54.058934 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1a86a40e-7688-4787-8226-318c58674f10 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:54.060266 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1a86a40e-7688-4787-8226-318c58674f10 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605" status: 200 len: 1362 microversion: 2.25 time: 0.243096 Jun 10 18:00:54.060855 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 578/1130] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:53 2022] GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605 => generated 1362 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:00:54.066397 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fd3a6daf-75c2-4ea1-aa7b-2d4ded9e55aa tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:54.067228 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fd3a6daf-75c2-4ea1-aa7b-2d4ded9e55aa tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:54.076736 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd3a6daf-75c2-4ea1-aa7b-2d4ded9e55aa tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:54.076736 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd3a6daf-75c2-4ea1-aa7b-2d4ded9e55aa tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:54.076736 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd3a6daf-75c2-4ea1-aa7b-2d4ded9e55aa tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:54.077056 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd3a6daf-75c2-4ea1-aa7b-2d4ded9e55aa tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:54.272000 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c140a526-4ae0-4ff1-ae04-c8971b017355 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "DELETE /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b" status: 204 len: 0 microversion: 2.1 time: 0.466292 Jun 10 18:00:54.275050 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 553/1131] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:00:53 2022] DELETE /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:00:54.286684 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1fe2f78f-f506-4335-bcd3-95e0f232fcb3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:54.287713 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1fe2f78f-f506-4335-bcd3-95e0f232fcb3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:54.299540 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1fe2f78f-f506-4335-bcd3-95e0f232fcb3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:54.300004 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1fe2f78f-f506-4335-bcd3-95e0f232fcb3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:54.300826 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1fe2f78f-f506-4335-bcd3-95e0f232fcb3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:54.301515 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1fe2f78f-f506-4335-bcd3-95e0f232fcb3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:54.305330 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fd3a6daf-75c2-4ea1-aa7b-2d4ded9e55aa tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:54.316825 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fd3a6daf-75c2-4ea1-aa7b-2d4ded9e55aa tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd" status: 200 len: 1503 microversion: 2.1 time: 0.254602 Jun 10 18:00:54.318023 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 579/1132] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:54 2022] GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd => generated 1503 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:54.336392 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-f31b40c1-1f79-4376-b8a7-59ed7884e62b req-5e1b44e0-92c0-4b30-994d-20d772509368 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5230492-7afa-4202-82ed-1df1cacd2605", "name": "network-vif-plugged", "status": "completed", "tag": "12fa01a2-8605-49e5-baff-4c9c0392af50"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:54.346552 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-f31b40c1-1f79-4376-b8a7-59ed7884e62b req-5e1b44e0-92c0-4b30-994d-20d772509368 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:54.347004 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-f31b40c1-1f79-4376-b8a7-59ed7884e62b req-5e1b44e0-92c0-4b30-994d-20d772509368 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:54.360154 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-f31b40c1-1f79-4376-b8a7-59ed7884e62b req-5e1b44e0-92c0-4b30-994d-20d772509368 service nova] Creating event network-vif-plugged:12fa01a2-8605-49e5-baff-4c9c0392af50 for instance f5230492-7afa-4202-82ed-1df1cacd2605 on chh1-master-2 Jun 10 18:00:54.371848 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-f31b40c1-1f79-4376-b8a7-59ed7884e62b req-5e1b44e0-92c0-4b30-994d-20d772509368 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050199 Jun 10 18:00:54.375856 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 580/1133] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:00:54.381578 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7225dfaf-e8c4-42e9-8a73-6e5288616f27 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:54.382300 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7225dfaf-e8c4-42e9-8a73-6e5288616f27 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: c922bb8c-ba7b-4448-9d8b-a6fb6498b25b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:54.403624 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7225dfaf-e8c4-42e9-8a73-6e5288616f27 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:54.404411 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7225dfaf-e8c4-42e9-8a73-6e5288616f27 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:54.405222 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7225dfaf-e8c4-42e9-8a73-6e5288616f27 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:54.406235 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7225dfaf-e8c4-42e9-8a73-6e5288616f27 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:54.487306 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1fe2f78f-f506-4335-bcd3-95e0f232fcb3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:54.495804 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1fe2f78f-f506-4335-bcd3-95e0f232fcb3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1469 microversion: 2.1 time: 0.219455 Jun 10 18:00:54.500641 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 554/1134] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:54 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1469 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:54.513589 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-95b1a715-0a92-40af-a8c8-e16075fb020b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:54.518524 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-95b1a715-0a92-40af-a8c8-e16075fb020b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:54.524819 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-95b1a715-0a92-40af-a8c8-e16075fb020b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:54.525580 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-95b1a715-0a92-40af-a8c8-e16075fb020b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:54.527347 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-95b1a715-0a92-40af-a8c8-e16075fb020b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:54.528037 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-95b1a715-0a92-40af-a8c8-e16075fb020b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:54.675325 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7225dfaf-e8c4-42e9-8a73-6e5288616f27 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e5bd8a55d42cdb7879fbead65627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9d5dac7c8243aeaa207c5a1ecb399a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:54.685224 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7225dfaf-e8c4-42e9-8a73-6e5288616f27 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b" status: 200 len: 1711 microversion: 2.1 time: 0.307844 Jun 10 18:00:54.693862 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-95b1a715-0a92-40af-a8c8-e16075fb020b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:54.699870 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 581/1135] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:54 2022] GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b => generated 1711 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:54.705459 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-95b1a715-0a92-40af-a8c8-e16075fb020b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1515 microversion: 2.1 time: 0.197153 Jun 10 18:00:54.714686 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 555/1136] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:54 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1515 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:54.715483 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bb7004e3-8f07-4595-82c6-22160ffa546e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:54.716141 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bb7004e3-8f07-4595-82c6-22160ffa546e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:54.723105 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb7004e3-8f07-4595-82c6-22160ffa546e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:54.723565 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb7004e3-8f07-4595-82c6-22160ffa546e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:54.725243 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb7004e3-8f07-4595-82c6-22160ffa546e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:54.725243 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb7004e3-8f07-4595-82c6-22160ffa546e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:54.948865 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bb7004e3-8f07-4595-82c6-22160ffa546e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:54.956614 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bb7004e3-8f07-4595-82c6-22160ffa546e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1471 microversion: 2.1 time: 0.255185 Jun 10 18:00:54.957696 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 582/1137] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:54 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1471 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:55.078442 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b1fd6d32-4dc7-48df-a0f6-46b09e119774 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:55.079075 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b1fd6d32-4dc7-48df-a0f6-46b09e119774 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f5230492-7afa-4202-82ed-1df1cacd2605] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:55.085028 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b1fd6d32-4dc7-48df-a0f6-46b09e119774 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:55.085475 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b1fd6d32-4dc7-48df-a0f6-46b09e119774 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:55.086310 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b1fd6d32-4dc7-48df-a0f6-46b09e119774 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:55.086691 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b1fd6d32-4dc7-48df-a0f6-46b09e119774 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:55.224269 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b1fd6d32-4dc7-48df-a0f6-46b09e119774 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:55.232392 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b1fd6d32-4dc7-48df-a0f6-46b09e119774 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:55.234023 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b1fd6d32-4dc7-48df-a0f6-46b09e119774 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:55.235294 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b1fd6d32-4dc7-48df-a0f6-46b09e119774 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605" status: 200 len: 1362 microversion: 2.25 time: 0.161204 Jun 10 18:00:55.235992 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 556/1138] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:55 2022] GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:00:55.334099 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-12de82e6-2ff8-4f23-8016-14930ba357b0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:55.334740 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-12de82e6-2ff8-4f23-8016-14930ba357b0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:55.340878 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-12de82e6-2ff8-4f23-8016-14930ba357b0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:55.341339 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-12de82e6-2ff8-4f23-8016-14930ba357b0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:55.342112 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-12de82e6-2ff8-4f23-8016-14930ba357b0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:55.342871 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-12de82e6-2ff8-4f23-8016-14930ba357b0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:55.465306 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4a90bbd7-2a5f-4d5e-bb9f-5898a0101db5 tempest-MultipleCreateNegativeTestJSON-1912904478 tempest-MultipleCreateNegativeTestJSON-1912904478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1133912418", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:55.467573 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-4a90bbd7-2a5f-4d5e-bb9f-5898a0101db5 tempest-MultipleCreateNegativeTestJSON-1912904478 tempest-MultipleCreateNegativeTestJSON-1912904478-project] HTTP exception thrown: min_count must be <= max_count Jun 10 18:00:55.469482 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4a90bbd7-2a5f-4d5e-bb9f-5898a0101db5 tempest-MultipleCreateNegativeTestJSON-1912904478 tempest-MultipleCreateNegativeTestJSON-1912904478-project] Request method failure captured: Jun 10 18:00:55.469482 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 10 18:00:55.469482 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:00:55.469482 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:00:55.469482 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:00:55.469482 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 184 Jun 10 18:00:55.469482 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:00:55.469482 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:00:55.469482 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:00:55.469482 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:00:55.469482 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4bXICpXg0T11bJdueYonG1eTFzz8yAqaYM680mvmiIaa0cJXqmXnAjsWLNnC2BBYUK3f-2b7mJDggQ0kq8BuF1rQ_4UdzM-JLmJc5j28f2x2RGVNLny7ekOERn41JvSm5xYyZj25htPl1iq7ty0Jl_9Ucr347M9ztYiF2w3zuSmahU Jun 10 18:00:55.469482 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:00:55.469482 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:00:55.469482 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:00:55.469482 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:00:55.469482 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:00:55.469482 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:00:55.469482 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: bb3b54d52c2b442393ff8b4368cfab6f Jun 10 18:00:55.469482 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1912904478 Jun 10 18:00:55.469482 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:00:55.469482 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:00:55.470795 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/bb3b54d52c2b442393ff8b4368cfab6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bb3b54d52c2b442393ff8b4368cfab6f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bb3b54d52c2b442393ff8b4368cfab6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_bb3b54d52c2b442393ff8b4368cfab6f", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:00:55.470795 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1912904478 Jun 10 18:00:55.470795 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: bb3b54d52c2b442393ff8b4368cfab6f Jun 10 18:00:55.470795 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1912904478 Jun 10 18:00:55.470795 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-MultipleCreateNegativeTestJSON-1912904478-project Jun 10 18:00:55.470795 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:00:55.470795 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:00:55.470795 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: b8bd640d9c474c60b7d9139cef6bf456 Jun 10 18:00:55.470795 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1912904478-project Jun 10 18:00:55.470795 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:00:55.470795 chdv-master-2 devstack@n-api.service[126594]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1133912418", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "min_count": 3, "max_count": 2}} Jun 10 18:00:55.471509 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:00:55.471509 chdv-master-2 devstack@n-api.service[126594]: exception: min_count must be <= max_count Jun 10 18:00:55.471509 chdv-master-2 devstack@n-api.service[126594]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1133912418', 'imageRef': 'efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Jun 10 18:00:55.471509 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:00:55.471509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:00:55.471509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:00:55.471509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:00:55.471509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:00:55.471509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:00:55.471509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:00:55.471509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:00:55.471509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:00:55.471509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:00:55.471509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:00:55.471509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:00:55.471509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:00:55.471509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:00:55.471509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 10 18:00:55.471509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Jun 10 18:00:55.481557 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jun 10 18:00:55.481557 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Jun 10 18:00:55.481557 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:00:55.481557 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:00:55.481557 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:00:55.481557 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:00:55.481557 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:00:55.481557 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:00:55.481557 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:00:55.481557 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:00:55.481557 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Jun 10 18:00:55.481557 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:00:55.481557 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4a90bbd7-2a5f-4d5e-bb9f-5898a0101db5 tempest-MultipleCreateNegativeTestJSON-1912904478 tempest-MultipleCreateNegativeTestJSON-1912904478-project] Returning 400 to user: min_count must be <= max_count {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:00:55.481557 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4a90bbd7-2a5f-4d5e-bb9f-5898a0101db5 tempest-MultipleCreateNegativeTestJSON-1912904478 tempest-MultipleCreateNegativeTestJSON-1912904478-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.125913 Jun 10 18:00:55.481557 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 557/1139] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:00:55 2022] POST /compute/v2.1/servers => generated 74 bytes in 127 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jun 10 18:00:55.482647 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-12de82e6-2ff8-4f23-8016-14930ba357b0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:55.482647 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-12de82e6-2ff8-4f23-8016-14930ba357b0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd" status: 200 len: 1503 microversion: 2.1 time: 0.152366 Jun 10 18:00:55.483255 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 583/1140] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:55 2022] GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:55.512835 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9655d5dd-b660-45ff-9aa3-3ee1a23e7691 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:55.513461 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9655d5dd-b660-45ff-9aa3-3ee1a23e7691 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:55.520444 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6d89293b-37e8-427c-99f9-9241ad751761 tempest-MultipleCreateNegativeTestJSON-1912904478 tempest-MultipleCreateNegativeTestJSON-1912904478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1220584704", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "max_count": 0}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:55.520909 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9655d5dd-b660-45ff-9aa3-3ee1a23e7691 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:55.521357 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9655d5dd-b660-45ff-9aa3-3ee1a23e7691 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:55.522127 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9655d5dd-b660-45ff-9aa3-3ee1a23e7691 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:55.522562 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9655d5dd-b660-45ff-9aa3-3ee1a23e7691 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:55.523269 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6d89293b-37e8-427c-99f9-9241ad751761 tempest-MultipleCreateNegativeTestJSON-1912904478 tempest-MultipleCreateNegativeTestJSON-1912904478-project] Request method failure captured: Jun 10 18:00:55.523269 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 10 18:00:55.523269 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:00:55.523269 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:00:55.523269 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:00:55.523269 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 168 Jun 10 18:00:55.523269 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:00:55.523269 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:00:55.523269 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:00:55.523269 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:00:55.523269 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4bXICpXg0T11bJdueYonG1eTFzz8yAqaYM680mvmiIaa0cJXqmXnAjsWLNnC2BBYUK3f-2b7mJDggQ0kq8BuF1rQ_4UdzM-JLmJc5j28f2x2RGVNLny7ekOERn41JvSm5xYyZj25htPl1iq7ty0Jl_9Ucr347M9ztYiF2w3zuSmahU Jun 10 18:00:55.523269 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:00:55.523269 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:00:55.523269 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:00:55.523269 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:00:55.523269 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:00:55.523269 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:00:55.523269 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: bb3b54d52c2b442393ff8b4368cfab6f Jun 10 18:00:55.523269 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1912904478 Jun 10 18:00:55.523269 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:00:55.523269 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:00:55.524774 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/bb3b54d52c2b442393ff8b4368cfab6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bb3b54d52c2b442393ff8b4368cfab6f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bb3b54d52c2b442393ff8b4368cfab6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_bb3b54d52c2b442393ff8b4368cfab6f", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:00:55.524774 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1912904478 Jun 10 18:00:55.524774 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: bb3b54d52c2b442393ff8b4368cfab6f Jun 10 18:00:55.524774 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1912904478 Jun 10 18:00:55.524774 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-MultipleCreateNegativeTestJSON-1912904478-project Jun 10 18:00:55.524774 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:00:55.524774 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:00:55.524774 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: b8bd640d9c474c60b7d9139cef6bf456 Jun 10 18:00:55.524774 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1912904478-project Jun 10 18:00:55.524774 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:00:55.524774 chdv-master-2 devstack@n-api.service[126595]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1220584704", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "max_count": 0}} Jun 10 18:00:55.524774 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:00:55.526028 chdv-master-2 devstack@n-api.service[126595]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jun 10 18:00:55.526028 chdv-master-2 devstack@n-api.service[126595]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1220584704', 'imageRef': 'efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8', 'flavorRef': '452', 'max_count': 0}}} Jun 10 18:00:55.526028 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:00:55.526028 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:00:55.526028 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 10 18:00:55.526028 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 10 18:00:55.526028 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 10 18:00:55.526028 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise error Jun 10 18:00:55.526028 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 10 18:00:55.526028 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:00:55.526028 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Jun 10 18:00:55.526028 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jun 10 18:00:55.526028 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jun 10 18:00:55.526028 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jun 10 18:00:55.526028 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jun 10 18:00:55.526028 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:00:55.526028 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 10 18:00:55.526028 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 0 Jun 10 18:00:55.526028 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:00:55.526028 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:00:55.526028 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:00:55.526028 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:00:55.526028 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:00:55.527406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:00:55.527406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:00:55.527406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:00:55.527406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:00:55.527406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:00:55.527406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:00:55.527406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:00:55.527406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 10 18:00:55.527406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 10 18:00:55.527406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 10 18:00:55.527406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 10 18:00:55.527406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 10 18:00:55.527406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 10 18:00:55.527406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jun 10 18:00:55.527406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:00:55.527406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:00:55.527406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:00:55.527406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:00:55.527406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:00:55.527406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:00:55.529154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 10 18:00:55.529154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 10 18:00:55.529154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jun 10 18:00:55.529154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:00:55.529154 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6d89293b-37e8-427c-99f9-9241ad751761 tempest-MultipleCreateNegativeTestJSON-1912904478 tempest-MultipleCreateNegativeTestJSON-1912904478-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:00:55.529154 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6d89293b-37e8-427c-99f9-9241ad751761 tempest-MultipleCreateNegativeTestJSON-1912904478 tempest-MultipleCreateNegativeTestJSON-1912904478-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.008380 Jun 10 18:00:55.529154 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 584/1141] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:00:55 2022] POST /compute/v2.1/servers => generated 130 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 10 18:00:55.572273 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5c1adaae-7af1-455a-80b5-74fd84dd48d5 tempest-MultipleCreateNegativeTestJSON-1912904478 tempest-MultipleCreateNegativeTestJSON-1912904478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1567030476", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "max_count": 2.5}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:55.575279 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5c1adaae-7af1-455a-80b5-74fd84dd48d5 tempest-MultipleCreateNegativeTestJSON-1912904478 tempest-MultipleCreateNegativeTestJSON-1912904478-project] Request method failure captured: Jun 10 18:00:55.575279 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 10 18:00:55.575279 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:00:55.575279 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:00:55.575279 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:00:55.575279 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 170 Jun 10 18:00:55.575279 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:00:55.575279 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:00:55.575279 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:00:55.575279 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:00:55.575279 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4bXICpXg0T11bJdueYonG1eTFzz8yAqaYM680mvmiIaa0cJXqmXnAjsWLNnC2BBYUK3f-2b7mJDggQ0kq8BuF1rQ_4UdzM-JLmJc5j28f2x2RGVNLny7ekOERn41JvSm5xYyZj25htPl1iq7ty0Jl_9Ucr347M9ztYiF2w3zuSmahU Jun 10 18:00:55.575279 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:00:55.575279 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:00:55.575279 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:00:55.575279 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:00:55.575279 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:00:55.575279 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:00:55.575279 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: bb3b54d52c2b442393ff8b4368cfab6f Jun 10 18:00:55.575279 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1912904478 Jun 10 18:00:55.575279 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:00:55.575279 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:00:55.576851 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/bb3b54d52c2b442393ff8b4368cfab6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bb3b54d52c2b442393ff8b4368cfab6f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bb3b54d52c2b442393ff8b4368cfab6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_bb3b54d52c2b442393ff8b4368cfab6f", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:00:55.576851 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1912904478 Jun 10 18:00:55.576851 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: bb3b54d52c2b442393ff8b4368cfab6f Jun 10 18:00:55.576851 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1912904478 Jun 10 18:00:55.576851 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-MultipleCreateNegativeTestJSON-1912904478-project Jun 10 18:00:55.576851 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:00:55.576851 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:00:55.576851 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: b8bd640d9c474c60b7d9139cef6bf456 Jun 10 18:00:55.576851 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1912904478-project Jun 10 18:00:55.576851 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:00:55.576851 chdv-master-2 devstack@n-api.service[126595]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1567030476", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "max_count": 2.5}} Jun 10 18:00:55.578291 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:00:55.578291 chdv-master-2 devstack@n-api.service[126595]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jun 10 18:00:55.578291 chdv-master-2 devstack@n-api.service[126595]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1567030476', 'imageRef': 'efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8', 'flavorRef': '452', 'max_count': 2.5}}} Jun 10 18:00:55.578291 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:00:55.578291 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:00:55.578291 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 10 18:00:55.578291 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 10 18:00:55.578291 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 10 18:00:55.578291 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise error Jun 10 18:00:55.578291 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jun 10 18:00:55.578291 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:00:55.578291 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Jun 10 18:00:55.578291 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jun 10 18:00:55.578291 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jun 10 18:00:55.578291 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jun 10 18:00:55.578291 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jun 10 18:00:55.578291 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:00:55.578291 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 10 18:00:55.578291 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 2.5 Jun 10 18:00:55.578291 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:00:55.578291 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:00:55.578291 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:00:55.578291 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:00:55.580086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:00:55.580086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:00:55.580086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:00:55.580086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:00:55.580086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:00:55.580086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:00:55.580086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:00:55.580086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:00:55.580086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 10 18:00:55.580086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 10 18:00:55.580086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 10 18:00:55.580086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 10 18:00:55.580086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 10 18:00:55.580086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 10 18:00:55.580086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jun 10 18:00:55.580086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:00:55.580086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:00:55.580086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:00:55.580086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:00:55.581543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:00:55.581543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:00:55.581543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 10 18:00:55.581543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 10 18:00:55.581543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jun 10 18:00:55.581543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:00:55.584559 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5c1adaae-7af1-455a-80b5-74fd84dd48d5 tempest-MultipleCreateNegativeTestJSON-1912904478 tempest-MultipleCreateNegativeTestJSON-1912904478-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:00:55.585406 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5c1adaae-7af1-455a-80b5-74fd84dd48d5 tempest-MultipleCreateNegativeTestJSON-1912904478 tempest-MultipleCreateNegativeTestJSON-1912904478-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.017414 Jun 10 18:00:55.585967 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 585/1142] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:00:55 2022] POST /compute/v2.1/servers => generated 139 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 10 18:00:55.637596 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8d224d3a-7f58-4f66-9520-90925761e22d tempest-MultipleCreateNegativeTestJSON-1912904478 tempest-MultipleCreateNegativeTestJSON-1912904478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1819047542", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "min_count": 0}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:55.641151 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8d224d3a-7f58-4f66-9520-90925761e22d tempest-MultipleCreateNegativeTestJSON-1912904478 tempest-MultipleCreateNegativeTestJSON-1912904478-project] Request method failure captured: Jun 10 18:00:55.641151 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 10 18:00:55.641151 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:00:55.641151 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:00:55.641151 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:00:55.641151 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 168 Jun 10 18:00:55.641151 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:00:55.641151 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:00:55.641151 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:00:55.641151 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:00:55.641151 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4bXICpXg0T11bJdueYonG1eTFzz8yAqaYM680mvmiIaa0cJXqmXnAjsWLNnC2BBYUK3f-2b7mJDggQ0kq8BuF1rQ_4UdzM-JLmJc5j28f2x2RGVNLny7ekOERn41JvSm5xYyZj25htPl1iq7ty0Jl_9Ucr347M9ztYiF2w3zuSmahU Jun 10 18:00:55.641151 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:00:55.641151 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:00:55.641151 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:00:55.641151 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:00:55.641151 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:00:55.641151 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:00:55.641151 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: bb3b54d52c2b442393ff8b4368cfab6f Jun 10 18:00:55.641151 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1912904478 Jun 10 18:00:55.641151 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:00:55.641151 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:00:55.642515 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/bb3b54d52c2b442393ff8b4368cfab6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bb3b54d52c2b442393ff8b4368cfab6f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bb3b54d52c2b442393ff8b4368cfab6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_bb3b54d52c2b442393ff8b4368cfab6f", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:00:55.642515 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1912904478 Jun 10 18:00:55.642515 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: bb3b54d52c2b442393ff8b4368cfab6f Jun 10 18:00:55.642515 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1912904478 Jun 10 18:00:55.642515 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-MultipleCreateNegativeTestJSON-1912904478-project Jun 10 18:00:55.642515 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:00:55.642515 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:00:55.642515 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: b8bd640d9c474c60b7d9139cef6bf456 Jun 10 18:00:55.642515 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1912904478-project Jun 10 18:00:55.642515 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:00:55.642515 chdv-master-2 devstack@n-api.service[126595]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1819047542", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "min_count": 0}} Jun 10 18:00:55.642515 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:00:55.643204 chdv-master-2 devstack@n-api.service[126595]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jun 10 18:00:55.643204 chdv-master-2 devstack@n-api.service[126595]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1819047542', 'imageRef': 'efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8', 'flavorRef': '452', 'min_count': 0}}} Jun 10 18:00:55.643204 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:00:55.643204 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:00:55.643204 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 10 18:00:55.643204 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 10 18:00:55.643204 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 10 18:00:55.643204 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise error Jun 10 18:00:55.643204 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 10 18:00:55.643204 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:00:55.643204 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Jun 10 18:00:55.643204 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jun 10 18:00:55.643204 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jun 10 18:00:55.643204 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jun 10 18:00:55.643204 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jun 10 18:00:55.643204 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:00:55.643204 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 10 18:00:55.643204 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 0 Jun 10 18:00:55.643204 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:00:55.643204 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:00:55.643204 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:00:55.643204 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:00:55.643204 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:00:55.644632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:00:55.644632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:00:55.644632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:00:55.644632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:00:55.644632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:00:55.644632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:00:55.644632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:00:55.644632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 10 18:00:55.644632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 10 18:00:55.644632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 10 18:00:55.644632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 10 18:00:55.644632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 10 18:00:55.644632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 10 18:00:55.644632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jun 10 18:00:55.644632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:00:55.644632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:00:55.644632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:00:55.644632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:00:55.644632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:00:55.644632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:00:55.645765 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 10 18:00:55.645765 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 10 18:00:55.645765 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jun 10 18:00:55.645765 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:00:55.645765 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8d224d3a-7f58-4f66-9520-90925761e22d tempest-MultipleCreateNegativeTestJSON-1912904478 tempest-MultipleCreateNegativeTestJSON-1912904478-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:00:55.645765 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8d224d3a-7f58-4f66-9520-90925761e22d tempest-MultipleCreateNegativeTestJSON-1912904478 tempest-MultipleCreateNegativeTestJSON-1912904478-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.010280 Jun 10 18:00:55.645765 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 586/1143] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:00:55 2022] POST /compute/v2.1/servers => generated 130 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 10 18:00:55.665931 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9655d5dd-b660-45ff-9aa3-3ee1a23e7691 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:55.673513 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9655d5dd-b660-45ff-9aa3-3ee1a23e7691 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1469 microversion: 2.1 time: 0.164523 Jun 10 18:00:55.674078 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 558/1144] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:55 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1469 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:55.691201 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-05afebf3-d48a-481e-84a0-696688411d4d tempest-MultipleCreateNegativeTestJSON-1912904478 tempest-MultipleCreateNegativeTestJSON-1912904478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-661846376", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "min_count": 2.5}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:55.693885 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-05afebf3-d48a-481e-84a0-696688411d4d tempest-MultipleCreateNegativeTestJSON-1912904478 tempest-MultipleCreateNegativeTestJSON-1912904478-project] Request method failure captured: Jun 10 18:00:55.693885 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 10 18:00:55.693885 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:00:55.693885 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:00:55.693885 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:00:55.693885 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 169 Jun 10 18:00:55.693885 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:00:55.693885 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:00:55.693885 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:00:55.693885 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:00:55.693885 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4bXICpXg0T11bJdueYonG1eTFzz8yAqaYM680mvmiIaa0cJXqmXnAjsWLNnC2BBYUK3f-2b7mJDggQ0kq8BuF1rQ_4UdzM-JLmJc5j28f2x2RGVNLny7ekOERn41JvSm5xYyZj25htPl1iq7ty0Jl_9Ucr347M9ztYiF2w3zuSmahU Jun 10 18:00:55.693885 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:00:55.693885 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:00:55.693885 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:00:55.693885 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:00:55.693885 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:00:55.693885 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:00:55.693885 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: bb3b54d52c2b442393ff8b4368cfab6f Jun 10 18:00:55.693885 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1912904478 Jun 10 18:00:55.693885 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:00:55.693885 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:00:55.695291 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/bb3b54d52c2b442393ff8b4368cfab6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bb3b54d52c2b442393ff8b4368cfab6f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bb3b54d52c2b442393ff8b4368cfab6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_bb3b54d52c2b442393ff8b4368cfab6f", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:00:55.695291 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1912904478 Jun 10 18:00:55.695291 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: bb3b54d52c2b442393ff8b4368cfab6f Jun 10 18:00:55.695291 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1912904478 Jun 10 18:00:55.695291 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-MultipleCreateNegativeTestJSON-1912904478-project Jun 10 18:00:55.695291 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:00:55.695291 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:00:55.695291 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: b8bd640d9c474c60b7d9139cef6bf456 Jun 10 18:00:55.695291 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1912904478-project Jun 10 18:00:55.695291 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:00:55.695291 chdv-master-2 devstack@n-api.service[126595]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-661846376", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "min_count": 2.5}} Jun 10 18:00:55.695291 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:00:55.696005 chdv-master-2 devstack@n-api.service[126595]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jun 10 18:00:55.696005 chdv-master-2 devstack@n-api.service[126595]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-661846376', 'imageRef': 'efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8', 'flavorRef': '452', 'min_count': 2.5}}} Jun 10 18:00:55.696005 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:00:55.696005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:00:55.696005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 10 18:00:55.696005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 10 18:00:55.696005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 10 18:00:55.696005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise error Jun 10 18:00:55.696005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jun 10 18:00:55.696005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:00:55.696005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Jun 10 18:00:55.696005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jun 10 18:00:55.696005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jun 10 18:00:55.696005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jun 10 18:00:55.696005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jun 10 18:00:55.696005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:00:55.696005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 10 18:00:55.696005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 2.5 Jun 10 18:00:55.696005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:00:55.696005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:00:55.696005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:00:55.696005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:00:55.696005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:00:55.697371 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:00:55.697371 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:00:55.697371 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:00:55.697371 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:00:55.697371 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:00:55.697371 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:00:55.697371 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:00:55.697371 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 10 18:00:55.697371 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 10 18:00:55.697371 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 10 18:00:55.697371 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 10 18:00:55.697371 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 10 18:00:55.697371 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 10 18:00:55.697371 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jun 10 18:00:55.697371 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:00:55.697371 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:00:55.697371 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:00:55.697371 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:00:55.697371 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:00:55.697371 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:00:55.698518 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 10 18:00:55.698518 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 10 18:00:55.698518 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jun 10 18:00:55.698518 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:00:55.698518 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-05afebf3-d48a-481e-84a0-696688411d4d tempest-MultipleCreateNegativeTestJSON-1912904478 tempest-MultipleCreateNegativeTestJSON-1912904478-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:00:55.698518 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-05afebf3-d48a-481e-84a0-696688411d4d tempest-MultipleCreateNegativeTestJSON-1912904478 tempest-MultipleCreateNegativeTestJSON-1912904478-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.008646 Jun 10 18:00:55.698518 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 587/1145] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:00:55 2022] POST /compute/v2.1/servers => generated 139 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:00:55.708638 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-adfbaaeb-0ce4-4e60-bfb5-0195a068f968 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:55.709348 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-adfbaaeb-0ce4-4e60-bfb5-0195a068f968 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: c922bb8c-ba7b-4448-9d8b-a6fb6498b25b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:55.715364 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-adfbaaeb-0ce4-4e60-bfb5-0195a068f968 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:55.715996 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-adfbaaeb-0ce4-4e60-bfb5-0195a068f968 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:55.717446 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-adfbaaeb-0ce4-4e60-bfb5-0195a068f968 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:55.717906 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-adfbaaeb-0ce4-4e60-bfb5-0195a068f968 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:55.723537 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5ac915e2-42ed-497e-b64a-489a6e90458d tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:55.724248 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5ac915e2-42ed-497e-b64a-489a6e90458d tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:55.729168 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:00:55.733702 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ac915e2-42ed-497e-b64a-489a6e90458d tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:55.734312 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ac915e2-42ed-497e-b64a-489a6e90458d tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:55.735071 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ac915e2-42ed-497e-b64a-489a6e90458d tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:55.735632 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ac915e2-42ed-497e-b64a-489a6e90458d tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:55.869756 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-adfbaaeb-0ce4-4e60-bfb5-0195a068f968 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e5bd8a55d42cdb7879fbead65627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9d5dac7c8243aeaa207c5a1ecb399a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:55.880837 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-adfbaaeb-0ce4-4e60-bfb5-0195a068f968 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b" status: 200 len: 1711 microversion: 2.1 time: 0.175887 Jun 10 18:00:55.883966 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5ac915e2-42ed-497e-b64a-489a6e90458d tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:55.888116 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:00:55.891612 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 559/1146] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:55 2022] GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b => generated 1711 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:55.901311 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5ac915e2-42ed-497e-b64a-489a6e90458d tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1515 microversion: 2.1 time: 0.182969 Jun 10 18:00:55.902167 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 588/1147] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:55 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1515 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:55.974234 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4f29030c-1245-491c-8b34-ff34db632945 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:55.975117 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4f29030c-1245-491c-8b34-ff34db632945 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:55.981366 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4f29030c-1245-491c-8b34-ff34db632945 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:55.981847 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4f29030c-1245-491c-8b34-ff34db632945 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:55.982660 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4f29030c-1245-491c-8b34-ff34db632945 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:55.983104 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4f29030c-1245-491c-8b34-ff34db632945 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:56.118061 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4f29030c-1245-491c-8b34-ff34db632945 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:56.128700 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4f29030c-1245-491c-8b34-ff34db632945 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1471 microversion: 2.1 time: 0.158334 Jun 10 18:00:56.129386 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 560/1148] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:55 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1471 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:56.254435 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-00a7dc1c-1792-4527-806d-7a0fee7ed28c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:56.255794 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-00a7dc1c-1792-4527-806d-7a0fee7ed28c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f5230492-7afa-4202-82ed-1df1cacd2605] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:56.266049 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-00a7dc1c-1792-4527-806d-7a0fee7ed28c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:56.266500 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-00a7dc1c-1792-4527-806d-7a0fee7ed28c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:56.267272 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-00a7dc1c-1792-4527-806d-7a0fee7ed28c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:56.272878 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-00a7dc1c-1792-4527-806d-7a0fee7ed28c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:56.501830 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0098c029-f5a3-4b46-966d-c066d42c06db tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:56.501830 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0098c029-f5a3-4b46-966d-c066d42c06db tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:56.502048 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-00a7dc1c-1792-4527-806d-7a0fee7ed28c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:56.506552 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0098c029-f5a3-4b46-966d-c066d42c06db tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:56.507005 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0098c029-f5a3-4b46-966d-c066d42c06db tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:56.507815 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0098c029-f5a3-4b46-966d-c066d42c06db tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:56.508251 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0098c029-f5a3-4b46-966d-c066d42c06db tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:56.508740 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-00a7dc1c-1792-4527-806d-7a0fee7ed28c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:56.510240 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-00a7dc1c-1792-4527-806d-7a0fee7ed28c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:56.511393 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-00a7dc1c-1792-4527-806d-7a0fee7ed28c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605" status: 200 len: 1558 microversion: 2.25 time: 0.262126 Jun 10 18:00:56.511966 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 589/1149] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:56 2022] GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605 => generated 1558 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:00:56.528459 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b5075515-f738-4fa4-b34a-acd6e2dba6cc tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:56.529079 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b5075515-f738-4fa4-b34a-acd6e2dba6cc tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] [instance: f5230492-7afa-4202-82ed-1df1cacd2605] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:56.535753 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5075515-f738-4fa4-b34a-acd6e2dba6cc tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:56.536263 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5075515-f738-4fa4-b34a-acd6e2dba6cc tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:56.537020 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5075515-f738-4fa4-b34a-acd6e2dba6cc tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:56.537470 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5075515-f738-4fa4-b34a-acd6e2dba6cc tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:56.681482 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0098c029-f5a3-4b46-966d-c066d42c06db tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:56.692903 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0098c029-f5a3-4b46-966d-c066d42c06db tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd" status: 200 len: 1503 microversion: 2.1 time: 0.197599 Jun 10 18:00:56.693913 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 561/1150] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:56 2022] GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd => generated 1503 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:56.699258 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3d3c4535-11e0-4120-9077-31b6f0d5545c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:56.699905 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3d3c4535-11e0-4120-9077-31b6f0d5545c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:56.707122 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3d3c4535-11e0-4120-9077-31b6f0d5545c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:56.707642 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3d3c4535-11e0-4120-9077-31b6f0d5545c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:56.708523 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3d3c4535-11e0-4120-9077-31b6f0d5545c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:56.708971 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3d3c4535-11e0-4120-9077-31b6f0d5545c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:56.819153 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-b5075515-f738-4fa4-b34a-acd6e2dba6cc tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lazy-loading 'services' on Instance uuid f5230492-7afa-4202-82ed-1df1cacd2605 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:00:56.839960 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3d3c4535-11e0-4120-9077-31b6f0d5545c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:56.856449 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3d3c4535-11e0-4120-9077-31b6f0d5545c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1469 microversion: 2.1 time: 0.161125 Jun 10 18:00:56.857101 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 562/1151] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:56 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1469 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:56.885733 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b5075515-f738-4fa4-b34a-acd6e2dba6cc tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605" status: 200 len: 2051 microversion: 2.25 time: 0.360739 Jun 10 18:00:56.886518 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 590/1152] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:56 2022] GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605 => generated 2051 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:00:56.900331 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c5848b56-a362-4f76-9201-3a5ed87558a2 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:56.901208 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c5848b56-a362-4f76-9201-3a5ed87558a2 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: c922bb8c-ba7b-4448-9d8b-a6fb6498b25b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:56.908888 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5848b56-a362-4f76-9201-3a5ed87558a2 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:56.910407 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5848b56-a362-4f76-9201-3a5ed87558a2 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:56.911461 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5848b56-a362-4f76-9201-3a5ed87558a2 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:56.912118 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5848b56-a362-4f76-9201-3a5ed87558a2 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:56.912433 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ed814523-7b82-4470-b873-d11b7791eb01 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:56.913293 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ed814523-7b82-4470-b873-d11b7791eb01 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] [instance: f5230492-7afa-4202-82ed-1df1cacd2605] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:56.933447 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ed814523-7b82-4470-b873-d11b7791eb01 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:56.933949 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ed814523-7b82-4470-b873-d11b7791eb01 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:56.934816 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ed814523-7b82-4470-b873-d11b7791eb01 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:56.935321 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ed814523-7b82-4470-b873-d11b7791eb01 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:57.149914 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c5848b56-a362-4f76-9201-3a5ed87558a2 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e5bd8a55d42cdb7879fbead65627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9d5dac7c8243aeaa207c5a1ecb399a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:57.161909 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c5848b56-a362-4f76-9201-3a5ed87558a2 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b" status: 200 len: 1711 microversion: 2.1 time: 0.266219 Jun 10 18:00:57.175323 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 563/1153] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:56 2022] GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b => generated 1711 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:57.181223 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8765cbb4-a921-4b27-b137-950b48323663 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:57.181867 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8765cbb4-a921-4b27-b137-950b48323663 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:57.190102 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8765cbb4-a921-4b27-b137-950b48323663 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:57.190823 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8765cbb4-a921-4b27-b137-950b48323663 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:57.191797 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8765cbb4-a921-4b27-b137-950b48323663 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:57.192237 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8765cbb4-a921-4b27-b137-950b48323663 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:57.227598 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-ed814523-7b82-4470-b873-d11b7791eb01 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lazy-loading 'services' on Instance uuid f5230492-7afa-4202-82ed-1df1cacd2605 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:00:57.262573 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ed814523-7b82-4470-b873-d11b7791eb01 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605" status: 200 len: 2051 microversion: 2.25 time: 0.356857 Jun 10 18:00:57.265723 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 591/1154] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:56 2022] GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605 => generated 2051 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:00:57.271577 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-48fd7e34-b5b0-4945-904c-9ca4692d8a37 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:57.272599 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-48fd7e34-b5b0-4945-904c-9ca4692d8a37 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:57.280388 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-48fd7e34-b5b0-4945-904c-9ca4692d8a37 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:57.281228 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-48fd7e34-b5b0-4945-904c-9ca4692d8a37 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:57.282507 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-48fd7e34-b5b0-4945-904c-9ca4692d8a37 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:57.283377 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-48fd7e34-b5b0-4945-904c-9ca4692d8a37 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:57.444523 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-48fd7e34-b5b0-4945-904c-9ca4692d8a37 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:57.456341 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-48fd7e34-b5b0-4945-904c-9ca4692d8a37 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1471 microversion: 2.1 time: 0.188198 Jun 10 18:00:57.456970 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 592/1155] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:57 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1471 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:57.461687 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6d294c10-7f31-42a6-8caf-24219a8dcfe4 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:57.463490 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:00:57.463490 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 18:00:57.465084 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d294c10-7f31-42a6-8caf-24219a8dcfe4 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:57.465772 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d294c10-7f31-42a6-8caf-24219a8dcfe4 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:57.466814 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d294c10-7f31-42a6-8caf-24219a8dcfe4 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:57.467718 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d294c10-7f31-42a6-8caf-24219a8dcfe4 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:57.470561 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8765cbb4-a921-4b27-b137-950b48323663 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:57.501986 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6d294c10-7f31-42a6-8caf-24219a8dcfe4 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] 10.222.0.35 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.039329 Jun 10 18:00:57.504516 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 593/1156] 10.222.0.35 () {60 vars in 1216 bytes} [Fri Jun 10 18:00:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:00:57.506511 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8765cbb4-a921-4b27-b137-950b48323663 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1515 microversion: 2.1 time: 0.329465 Jun 10 18:00:57.508433 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 564/1157] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:57 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1515 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:57.519697 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-52c76115-35e7-4c55-a0da-a0d2c92194bc tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:57.520253 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-52c76115-35e7-4c55-a0da-a0d2c92194bc tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] [instance: f5230492-7afa-4202-82ed-1df1cacd2605] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:57.526519 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-52c76115-35e7-4c55-a0da-a0d2c92194bc tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:57.527472 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-52c76115-35e7-4c55-a0da-a0d2c92194bc tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:57.529956 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-52c76115-35e7-4c55-a0da-a0d2c92194bc tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:57.529956 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-52c76115-35e7-4c55-a0da-a0d2c92194bc tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:57.711012 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e662d25a-d86f-40f5-8d98-5d7746129e17 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:57.711683 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e662d25a-d86f-40f5-8d98-5d7746129e17 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:57.721759 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e662d25a-d86f-40f5-8d98-5d7746129e17 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:57.722218 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e662d25a-d86f-40f5-8d98-5d7746129e17 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:57.723023 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e662d25a-d86f-40f5-8d98-5d7746129e17 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:57.723488 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e662d25a-d86f-40f5-8d98-5d7746129e17 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:57.727642 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:00:57.782928 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-52c76115-35e7-4c55-a0da-a0d2c92194bc tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] 10.222.0.35 "POST /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605/action" status: 202 len: 0 microversion: 2.25 time: 0.276827 Jun 10 18:00:57.784128 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 594/1158] 10.222.0.35 () {62 vars in 1318 bytes} [Fri Jun 10 18:00:57 2022] POST /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:00:57.793121 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e29bb8ae-c677-4aa1-a22d-130db86528f2 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:57.793918 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e29bb8ae-c677-4aa1-a22d-130db86528f2 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] [instance: f5230492-7afa-4202-82ed-1df1cacd2605] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:57.813084 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e29bb8ae-c677-4aa1-a22d-130db86528f2 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:57.813633 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e29bb8ae-c677-4aa1-a22d-130db86528f2 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:57.815025 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e29bb8ae-c677-4aa1-a22d-130db86528f2 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:57.815697 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e29bb8ae-c677-4aa1-a22d-130db86528f2 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:57.989906 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e662d25a-d86f-40f5-8d98-5d7746129e17 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:57.999760 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e662d25a-d86f-40f5-8d98-5d7746129e17 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd" status: 200 len: 1503 microversion: 2.1 time: 0.292323 Jun 10 18:00:58.001334 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 565/1159] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:57 2022] GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd => generated 1503 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:58.009832 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-356c4f71-054a-491f-bb70-8311296cb2bb tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:58.010771 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-356c4f71-054a-491f-bb70-8311296cb2bb tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:58.019073 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-356c4f71-054a-491f-bb70-8311296cb2bb tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:58.019846 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-356c4f71-054a-491f-bb70-8311296cb2bb tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:58.021179 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-356c4f71-054a-491f-bb70-8311296cb2bb tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:58.023453 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-356c4f71-054a-491f-bb70-8311296cb2bb tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:58.072559 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-e29bb8ae-c677-4aa1-a22d-130db86528f2 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lazy-loading 'services' on Instance uuid f5230492-7afa-4202-82ed-1df1cacd2605 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:00:58.099921 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e29bb8ae-c677-4aa1-a22d-130db86528f2 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605" status: 200 len: 2056 microversion: 2.25 time: 0.311114 Jun 10 18:00:58.100553 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 595/1160] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:57 2022] GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605 => generated 2056 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:00:58.180761 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-56fe32c2-c9a8-4a4b-a83c-6d3d434c89ff tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:58.181721 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-56fe32c2-c9a8-4a4b-a83c-6d3d434c89ff tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: c922bb8c-ba7b-4448-9d8b-a6fb6498b25b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:58.191492 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-56fe32c2-c9a8-4a4b-a83c-6d3d434c89ff tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:58.194668 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-56fe32c2-c9a8-4a4b-a83c-6d3d434c89ff tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:58.200838 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-56fe32c2-c9a8-4a4b-a83c-6d3d434c89ff tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:58.200838 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-56fe32c2-c9a8-4a4b-a83c-6d3d434c89ff tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:58.227442 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-356c4f71-054a-491f-bb70-8311296cb2bb tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:58.235376 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-356c4f71-054a-491f-bb70-8311296cb2bb tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1469 microversion: 2.1 time: 0.232687 Jun 10 18:00:58.236217 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 566/1161] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:58 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1469 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:58.274818 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-56fe32c2-c9a8-4a4b-a83c-6d3d434c89ff tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e5bd8a55d42cdb7879fbead65627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9d5dac7c8243aeaa207c5a1ecb399a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:58.285663 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-56fe32c2-c9a8-4a4b-a83c-6d3d434c89ff tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b" status: 200 len: 1644 microversion: 2.1 time: 0.108628 Jun 10 18:00:58.286573 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-f97b80da-dcf4-4d37-b42e-81b111cf612d req-e19e34f4-76ad-4bbf-a17e-cff61549ea60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c922bb8c-ba7b-4448-9d8b-a6fb6498b25b", "name": "network-vif-deleted", "tag": "25b456a2-d3a8-4a42-b69c-ca0dcb1b529a"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:58.287029 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 596/1162] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:58 2022] GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b => generated 1644 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:58.297089 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-f97b80da-dcf4-4d37-b42e-81b111cf612d req-e19e34f4-76ad-4bbf-a17e-cff61549ea60 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:58.297550 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-f97b80da-dcf4-4d37-b42e-81b111cf612d req-e19e34f4-76ad-4bbf-a17e-cff61549ea60 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:58.310779 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-f97b80da-dcf4-4d37-b42e-81b111cf612d req-e19e34f4-76ad-4bbf-a17e-cff61549ea60 service nova] Creating event network-vif-deleted:25b456a2-d3a8-4a42-b69c-ca0dcb1b529a for instance c922bb8c-ba7b-4448-9d8b-a6fb6498b25b on chh2-master-2 Jun 10 18:00:58.320694 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-f97b80da-dcf4-4d37-b42e-81b111cf612d req-e19e34f4-76ad-4bbf-a17e-cff61549ea60 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038123 Jun 10 18:00:58.321771 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 567/1163] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:00:58.474818 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9c422dca-877b-4458-88fa-d4899a2c6b50 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:58.475440 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9c422dca-877b-4458-88fa-d4899a2c6b50 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:58.482378 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9c422dca-877b-4458-88fa-d4899a2c6b50 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:58.482836 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9c422dca-877b-4458-88fa-d4899a2c6b50 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:58.483656 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9c422dca-877b-4458-88fa-d4899a2c6b50 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:58.484102 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9c422dca-877b-4458-88fa-d4899a2c6b50 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:58.534951 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a93f86a3-c920-4128-9710-7af6fec49f8f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:58.535682 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a93f86a3-c920-4128-9710-7af6fec49f8f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:58.547504 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a93f86a3-c920-4128-9710-7af6fec49f8f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:58.547964 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a93f86a3-c920-4128-9710-7af6fec49f8f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:58.548792 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a93f86a3-c920-4128-9710-7af6fec49f8f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:58.549275 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a93f86a3-c920-4128-9710-7af6fec49f8f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:58.681511 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9c422dca-877b-4458-88fa-d4899a2c6b50 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:58.685186 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9c422dca-877b-4458-88fa-d4899a2c6b50 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1476 microversion: 2.1 time: 0.214998 Jun 10 18:00:58.697446 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 597/1164] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:58 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1476 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:58.733857 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a93f86a3-c920-4128-9710-7af6fec49f8f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:58.742290 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a93f86a3-c920-4128-9710-7af6fec49f8f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1515 microversion: 2.1 time: 0.221486 Jun 10 18:00:58.744441 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 568/1165] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:58 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1515 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:00:59.021297 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0c368620-621c-42b0-be69-d948c82dc386 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:59.024803 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0c368620-621c-42b0-be69-d948c82dc386 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:59.029502 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0c368620-621c-42b0-be69-d948c82dc386 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:59.030081 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0c368620-621c-42b0-be69-d948c82dc386 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:59.030979 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0c368620-621c-42b0-be69-d948c82dc386 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:59.031502 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0c368620-621c-42b0-be69-d948c82dc386 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:59.117994 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e7abcb56-598a-46f7-8d41-6ec17c07cf9a tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:59.118614 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e7abcb56-598a-46f7-8d41-6ec17c07cf9a tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] [instance: f5230492-7afa-4202-82ed-1df1cacd2605] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:59.125672 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7abcb56-598a-46f7-8d41-6ec17c07cf9a tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:59.126366 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7abcb56-598a-46f7-8d41-6ec17c07cf9a tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:59.127320 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7abcb56-598a-46f7-8d41-6ec17c07cf9a tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:59.127918 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7abcb56-598a-46f7-8d41-6ec17c07cf9a tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:59.229716 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0c368620-621c-42b0-be69-d948c82dc386 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:59.250298 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0c368620-621c-42b0-be69-d948c82dc386 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd" status: 200 len: 1478 microversion: 2.1 time: 0.232164 Jun 10 18:00:59.262739 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 598/1166] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:59 2022] GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd => generated 1478 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:59.262739 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-76b0d9b5-1b30-4497-827e-ba4e4dce3acd tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:59.262739 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-76b0d9b5-1b30-4497-827e-ba4e4dce3acd tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:59.277685 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-76b0d9b5-1b30-4497-827e-ba4e4dce3acd tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:59.279169 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-76b0d9b5-1b30-4497-827e-ba4e4dce3acd tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:59.304653 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-e7abcb56-598a-46f7-8d41-6ec17c07cf9a tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lazy-loading 'services' on Instance uuid f5230492-7afa-4202-82ed-1df1cacd2605 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:00:59.305528 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-76b0d9b5-1b30-4497-827e-ba4e4dce3acd tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:59.306606 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-76b0d9b5-1b30-4497-827e-ba4e4dce3acd tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:59.326098 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e7abcb56-598a-46f7-8d41-6ec17c07cf9a tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605" status: 200 len: 2036 microversion: 2.25 time: 0.211810 Jun 10 18:00:59.327513 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 569/1167] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:00:59 2022] GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605 => generated 2036 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:00:59.339234 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d5e12e62-db63-44ce-a4c7-2df1815a5dc9 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Calling method '.version_select at 0x7f77c0ae0d30>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:59.343806 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d5e12e62-db63-44ce-a4c7-2df1815a5dc9 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:59.344618 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d5e12e62-db63-44ce-a4c7-2df1815a5dc9 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:59.356420 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d5e12e62-db63-44ce-a4c7-2df1815a5dc9 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] 10.222.0.35 "GET /compute/v2.1/os-migrations" status: 200 len: 1952 microversion: 2.1 time: 0.027478 Jun 10 18:00:59.357766 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 570/1168] 10.222.0.35 () {58 vars in 1142 bytes} [Fri Jun 10 18:00:59 2022] GET /compute/v2.1/os-migrations => generated 1952 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:59.364252 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1df60742-0e62-493b-8ead-56ce4c1f2b3b tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:59.365159 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1df60742-0e62-493b-8ead-56ce4c1f2b3b tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: c922bb8c-ba7b-4448-9d8b-a6fb6498b25b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:59.371993 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1df60742-0e62-493b-8ead-56ce4c1f2b3b tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:59.372667 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1df60742-0e62-493b-8ead-56ce4c1f2b3b tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:59.373464 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1df60742-0e62-493b-8ead-56ce4c1f2b3b tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:59.374785 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1df60742-0e62-493b-8ead-56ce4c1f2b3b tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:59.413873 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1df60742-0e62-493b-8ead-56ce4c1f2b3b tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:59.416736 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1df60742-0e62-493b-8ead-56ce4c1f2b3b tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:59.417260 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-1df60742-0e62-493b-8ead-56ce4c1f2b3b tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lazy-loading 'fault' on Instance uuid c922bb8c-ba7b-4448-9d8b-a6fb6498b25b {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:00:59.461625 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1df60742-0e62-493b-8ead-56ce4c1f2b3b tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329e5bd8a55d42cdb7879fbead65627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9d5dac7c8243aeaa207c5a1ecb399a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:59.471642 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1df60742-0e62-493b-8ead-56ce4c1f2b3b tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b" status: 200 len: 1353 microversion: 2.1 time: 0.111635 Jun 10 18:00:59.472581 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 571/1169] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:59 2022] GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b => generated 1353 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:59.477425 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2d8d160a-d9ca-4084-83e4-1cda8ba1157b tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "chh2-master-2", "block_migration": "auto"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:00:59.478656 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2d8d160a-d9ca-4084-83e4-1cda8ba1157b tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] [instance: f5230492-7afa-4202-82ed-1df1cacd2605] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:59.485653 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2d8d160a-d9ca-4084-83e4-1cda8ba1157b tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:59.486162 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2d8d160a-d9ca-4084-83e4-1cda8ba1157b tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:59.486974 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2d8d160a-d9ca-4084-83e4-1cda8ba1157b tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:59.487414 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2d8d160a-d9ca-4084-83e4-1cda8ba1157b tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:59.514833 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-2d8d160a-d9ca-4084-83e4-1cda8ba1157b tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lazy-loading 'flavor' on Instance uuid f5230492-7afa-4202-82ed-1df1cacd2605 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:00:59.533683 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2d8d160a-d9ca-4084-83e4-1cda8ba1157b tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] [instance: f5230492-7afa-4202-82ed-1df1cacd2605] Going to try to live migrate instance to chh2-master-2 {{(pid=126594) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 10 18:00:59.600888 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-76b0d9b5-1b30-4497-827e-ba4e4dce3acd tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:00:59.609771 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-76b0d9b5-1b30-4497-827e-ba4e4dce3acd tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1469 microversion: 2.1 time: 0.356975 Jun 10 18:00:59.618787 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 599/1170] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:59 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1469 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:00:59.618787 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-785f0b9e-dda0-42ad-a1eb-112689d26441 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:00:59.618787 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-785f0b9e-dda0-42ad-a1eb-112689d26441 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] [instance: 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:00:59.624774 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-785f0b9e-dda0-42ad-a1eb-112689d26441 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:59.625262 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-785f0b9e-dda0-42ad-a1eb-112689d26441 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:00:59.626173 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-785f0b9e-dda0-42ad-a1eb-112689d26441 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:00:59.626732 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-785f0b9e-dda0-42ad-a1eb-112689d26441 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:00.005118 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-785f0b9e-dda0-42ad-a1eb-112689d26441 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd" status: 200 len: 1629 microversion: 2.1 time: 0.393501 Jun 10 18:01:00.005689 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 600/1171] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:00:59 2022] GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd => generated 1629 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:00.010080 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-df4a3f19-c709-4200-ae15-657c183180e9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:00.011270 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-df4a3f19-c709-4200-ae15-657c183180e9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:00.017563 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df4a3f19-c709-4200-ae15-657c183180e9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:00.018427 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df4a3f19-c709-4200-ae15-657c183180e9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:00.021172 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df4a3f19-c709-4200-ae15-657c183180e9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:00.021172 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df4a3f19-c709-4200-ae15-657c183180e9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:00.224565 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-df4a3f19-c709-4200-ae15-657c183180e9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:00.232125 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-df4a3f19-c709-4200-ae15-657c183180e9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1476 microversion: 2.1 time: 0.225454 Jun 10 18:01:00.232755 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 601/1172] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:00 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1476 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:00.237813 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-87d30299-a02d-4d19-ad37-5eaab0b103ab tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:00.238414 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-87d30299-a02d-4d19-ad37-5eaab0b103ab tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:00.244250 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-87d30299-a02d-4d19-ad37-5eaab0b103ab tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:00.244736 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-87d30299-a02d-4d19-ad37-5eaab0b103ab tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:00.245505 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-87d30299-a02d-4d19-ad37-5eaab0b103ab tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:00.245940 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-87d30299-a02d-4d19-ad37-5eaab0b103ab tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:00.386296 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-87d30299-a02d-4d19-ad37-5eaab0b103ab tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:00.400924 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-87d30299-a02d-4d19-ad37-5eaab0b103ab tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1515 microversion: 2.1 time: 0.166959 Jun 10 18:01:00.401515 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 602/1173] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:00 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:00.407275 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6dc8db0d-c987-463b-b5fc-711e4d2bfa56 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1905476642", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "c66faed9-4ff8-42df-b60d-8140becdafb7"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:00.464405 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-6dc8db0d-c987-463b-b5fc-711e4d2bfa56 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] validate_networks() for [('c66faed9-4ff8-42df-b60d-8140becdafb7', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:01:00.875748 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-6dc8db0d-c987-463b-b5fc-711e4d2bfa56 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:01:00.876177 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-6dc8db0d-c987-463b-b5fc-711e4d2bfa56 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:01:00.876711 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-6dc8db0d-c987-463b-b5fc-711e4d2bfa56 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:01:00.877126 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-6dc8db0d-c987-463b-b5fc-711e4d2bfa56 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:01:00.877570 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-6dc8db0d-c987-463b-b5fc-711e4d2bfa56 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:01:00.886867 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6dc8db0d-c987-463b-b5fc-711e4d2bfa56 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:00.887316 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6dc8db0d-c987-463b-b5fc-711e4d2bfa56 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:00.888113 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6dc8db0d-c987-463b-b5fc-711e4d2bfa56 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:00.888584 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6dc8db0d-c987-463b-b5fc-711e4d2bfa56 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:00.906084 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-6dc8db0d-c987-463b-b5fc-711e4d2bfa56 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Getting quotas for project c96da7ef0cbc46b594ec327ddf875f7a. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:01:00.911161 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-6dc8db0d-c987-463b-b5fc-711e4d2bfa56 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Getting quotas for user d0f741e8506743a8b51251b3019b3ad5 and project c96da7ef0cbc46b594ec327ddf875f7a. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:01:00.923451 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6dc8db0d-c987-463b-b5fc-711e4d2bfa56 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:01:00.925884 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6dc8db0d-c987-463b-b5fc-711e4d2bfa56 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:01:01.085962 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6dc8db0d-c987-463b-b5fc-711e4d2bfa56 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.683167 Jun 10 18:01:01.092387 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 603/1174] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:01:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:01:01.098829 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4d7f5ec6-1181-4c86-91bb-8606a0de5b21 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:01.102091 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4d7f5ec6-1181-4c86-91bb-8606a0de5b21 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: c922bb8c-ba7b-4448-9d8b-a6fb6498b25b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:01.107006 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d7f5ec6-1181-4c86-91bb-8606a0de5b21 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:01.107726 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d7f5ec6-1181-4c86-91bb-8606a0de5b21 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:01.109317 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d7f5ec6-1181-4c86-91bb-8606a0de5b21 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:01.110267 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d7f5ec6-1181-4c86-91bb-8606a0de5b21 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:01.127767 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-4d7f5ec6-1181-4c86-91bb-8606a0de5b21 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] HTTP exception thrown: Instance c922bb8c-ba7b-4448-9d8b-a6fb6498b25b could not be found. Jun 10 18:01:01.129513 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4d7f5ec6-1181-4c86-91bb-8606a0de5b21 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Request method failure captured: Jun 10 18:01:01.129513 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b HTTP/1.1 Jun 10 18:01:01.129513 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:01:01.129513 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:01:01.129513 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:01:01.129513 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:01:01.129513 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:01:01.129513 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:01:01.129513 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:01:01.129513 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:01:01.129513 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4YQyW0W78EH7IBbqLtFUBIQeB9wqPMjhWB4XheFo7PwAMzF2U0k37h8pMO3TapLOXl2W9JFoLVbudbv4qGra16jl5K_jagepJofnVhk0ur1vkgq3O7aN1dJYfSu8CB7vPxmg9EhxB66x_1valQGgRt9gEAO9MXOfxSoZEfdr-n85_0 Jun 10 18:01:01.129513 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:01:01.129513 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:01:01.129513 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:01:01.129513 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:01:01.129513 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:01:01.129513 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:01:01.129513 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: ef9d5dac7c8243aeaa207c5a1ecb399a Jun 10 18:01:01.129513 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1606954782 Jun 10 18:01:01.129513 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:01:01.129513 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:01:01.131113 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ef9d5dac7c8243aeaa207c5a1ecb399a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ef9d5dac7c8243aeaa207c5a1ecb399a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ef9d5dac7c8243aeaa207c5a1ecb399a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ef9d5dac7c8243aeaa207c5a1ecb399a", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:01:01.131113 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1606954782 Jun 10 18:01:01.131113 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: ef9d5dac7c8243aeaa207c5a1ecb399a Jun 10 18:01:01.131113 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1606954782 Jun 10 18:01:01.131113 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1606954782-project Jun 10 18:01:01.131113 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:01:01.131113 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:01:01.131113 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 329e5bd8a55d42cdb7879fbead65627a Jun 10 18:01:01.131113 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1606954782-project Jun 10 18:01:01.131113 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:01:01.131113 chdv-master-2 devstack@n-api.service[126595]: exception: Instance c922bb8c-ba7b-4448-9d8b-a6fb6498b25b could not be found. Jun 10 18:01:01.131113 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'c922bb8c-ba7b-4448-9d8b-a6fb6498b25b'} Jun 10 18:01:01.131968 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:01:01.131968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:01.131968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:01:01.131968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:01:01.131968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:01:01.131968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:01:01.131968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:01:01.131968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:01:01.131968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:01:01.131968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:01:01.131968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c922bb8c-ba7b-4448-9d8b-a6fb6498b25b could not be found. Jun 10 18:01:01.131968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:01.131968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:01:01.131968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:01.131968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:01.131968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:01.131968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:01.131968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:01:01.131968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:01:01.131968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:01:01.136637 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:01:01.136637 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:01:01.136637 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:01:01.136637 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:01:01.136637 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:01:01.136637 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:01:01.136637 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:01:01.136637 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c922bb8c-ba7b-4448-9d8b-a6fb6498b25b could not be found. Jun 10 18:01:01.136637 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:01.136637 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:01:01.136637 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:01.136637 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:01.136637 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:01.136637 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:01.136637 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:01:01.136637 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:01:01.136637 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c922bb8c-ba7b-4448-9d8b-a6fb6498b25b could not be found. Jun 10 18:01:01.136637 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:01.137918 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4d7f5ec6-1181-4c86-91bb-8606a0de5b21 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Returning 404 to user: Instance c922bb8c-ba7b-4448-9d8b-a6fb6498b25b could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:01:01.137918 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4d7f5ec6-1181-4c86-91bb-8606a0de5b21 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b" status: 404 len: 111 microversion: 2.1 time: 0.037150 Jun 10 18:01:01.137918 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 604/1175] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:01 2022] GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:01:01.139460 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7dc126f6-6371-4fb9-a0d4-175eec7cde72 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:01.140108 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7dc126f6-6371-4fb9-a0d4-175eec7cde72 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:01.148785 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7dc126f6-6371-4fb9-a0d4-175eec7cde72 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:01.150678 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7dc126f6-6371-4fb9-a0d4-175eec7cde72 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:01.151668 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7dc126f6-6371-4fb9-a0d4-175eec7cde72 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:01.152189 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7dc126f6-6371-4fb9-a0d4-175eec7cde72 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:01.168186 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:01:01.316553 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7dc126f6-6371-4fb9-a0d4-175eec7cde72 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:01.329133 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7dc126f6-6371-4fb9-a0d4-175eec7cde72 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1475 microversion: 2.1 time: 0.196286 Jun 10 18:01:01.339719 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 605/1176] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:01 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1475 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:01.348614 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c847ecd2-e4c3-4b4c-a932-d1897fe07659 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:01.349286 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c847ecd2-e4c3-4b4c-a932-d1897fe07659 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:01.435826 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c847ecd2-e4c3-4b4c-a932-d1897fe07659 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:01.444145 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c847ecd2-e4c3-4b4c-a932-d1897fe07659 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1211 microversion: 2.1 time: 0.107195 Jun 10 18:01:01.444757 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 606/1177] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:01 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1211 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:01.449774 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-40e18d0a-35d8-4fb5-a83f-fec18bf294eb tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:01.450280 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-40e18d0a-35d8-4fb5-a83f-fec18bf294eb tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:01.461130 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-40e18d0a-35d8-4fb5-a83f-fec18bf294eb tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:01.461594 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-40e18d0a-35d8-4fb5-a83f-fec18bf294eb tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:01.462395 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-40e18d0a-35d8-4fb5-a83f-fec18bf294eb tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:01.462833 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-40e18d0a-35d8-4fb5-a83f-fec18bf294eb tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:01.480960 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-40e18d0a-35d8-4fb5-a83f-fec18bf294eb tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] HTTP exception thrown: Instance cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 could not be found. Jun 10 18:01:01.482819 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-40e18d0a-35d8-4fb5-a83f-fec18bf294eb tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Request method failure captured: Jun 10 18:01:01.482819 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 HTTP/1.1 Jun 10 18:01:01.482819 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:01:01.482819 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:01:01.482819 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:01:01.482819 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:01:01.482819 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:01:01.482819 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:01:01.482819 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:01:01.482819 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:01:01.482819 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4YQyW0W78EH7IBbqLtFUBIQeB9wqPMjhWB4XheFo7PwAMzF2U0k37h8pMO3TapLOXl2W9JFoLVbudbv4qGra16jl5K_jagepJofnVhk0ur1vkgq3O7aN1dJYfSu8CB7vPxmg9EhxB66x_1valQGgRt9gEAO9MXOfxSoZEfdr-n85_0 Jun 10 18:01:01.482819 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:01:01.482819 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:01:01.482819 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:01:01.482819 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:01:01.482819 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:01:01.482819 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:01:01.482819 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: ef9d5dac7c8243aeaa207c5a1ecb399a Jun 10 18:01:01.482819 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1606954782 Jun 10 18:01:01.482819 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:01:01.482819 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:01:01.485158 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ef9d5dac7c8243aeaa207c5a1ecb399a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ef9d5dac7c8243aeaa207c5a1ecb399a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ef9d5dac7c8243aeaa207c5a1ecb399a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ef9d5dac7c8243aeaa207c5a1ecb399a", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:01:01.485158 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1606954782 Jun 10 18:01:01.485158 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: ef9d5dac7c8243aeaa207c5a1ecb399a Jun 10 18:01:01.485158 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1606954782 Jun 10 18:01:01.485158 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1606954782-project Jun 10 18:01:01.485158 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:01:01.485158 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:01:01.485158 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 329e5bd8a55d42cdb7879fbead65627a Jun 10 18:01:01.485158 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1606954782-project Jun 10 18:01:01.485158 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:01:01.485158 chdv-master-2 devstack@n-api.service[126595]: exception: Instance cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 could not be found. Jun 10 18:01:01.485158 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2'} Jun 10 18:01:01.486029 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:01:01.486029 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:01.486029 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:01:01.486029 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:01:01.486029 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:01:01.486029 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:01:01.486029 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:01:01.486029 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:01:01.486029 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:01:01.486029 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:01:01.486029 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 could not be found. Jun 10 18:01:01.486029 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:01.486029 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:01:01.486029 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:01.486029 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:01.486029 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:01.486029 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:01.486029 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:01:01.486029 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:01:01.486029 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:01:01.487438 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:01:01.487438 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:01:01.487438 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:01:01.487438 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:01:01.487438 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:01:01.487438 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:01:01.487438 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:01:01.487438 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:01:01.487438 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:01:01.487438 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 could not be found. Jun 10 18:01:01.487438 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:01.487438 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:01:01.487438 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:01.487438 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:01.487438 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:01.487438 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:01.487438 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:01:01.487438 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:01:01.487438 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 could not be found. Jun 10 18:01:01.487438 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:01.491273 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-40e18d0a-35d8-4fb5-a83f-fec18bf294eb tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Returning 404 to user: Instance cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:01:01.491741 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-40e18d0a-35d8-4fb5-a83f-fec18bf294eb tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "DELETE /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2" status: 404 len: 111 microversion: 2.1 time: 0.045322 Jun 10 18:01:01.492510 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 607/1178] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:01:01 2022] DELETE /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:01:01.500996 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b678646e-00e3-466f-8ca7-ada0cdc09e0f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:01.501617 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b678646e-00e3-466f-8ca7-ada0cdc09e0f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:01.509886 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b678646e-00e3-466f-8ca7-ada0cdc09e0f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:01.511270 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b678646e-00e3-466f-8ca7-ada0cdc09e0f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:01.512066 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b678646e-00e3-466f-8ca7-ada0cdc09e0f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:01.512596 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b678646e-00e3-466f-8ca7-ada0cdc09e0f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:01.758433 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b678646e-00e3-466f-8ca7-ada0cdc09e0f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:01.767309 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b678646e-00e3-466f-8ca7-ada0cdc09e0f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1476 microversion: 2.1 time: 0.272258 Jun 10 18:01:01.767893 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 608/1179] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:01 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1476 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:01.773401 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-85106a02-56f6-4925-8e5a-a612f537a9a2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:01.774209 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-85106a02-56f6-4925-8e5a-a612f537a9a2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:01.781842 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-85106a02-56f6-4925-8e5a-a612f537a9a2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:01.782296 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-85106a02-56f6-4925-8e5a-a612f537a9a2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:01.783324 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-85106a02-56f6-4925-8e5a-a612f537a9a2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:01.783717 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-85106a02-56f6-4925-8e5a-a612f537a9a2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:01.983103 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-85106a02-56f6-4925-8e5a-a612f537a9a2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:01.991296 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-85106a02-56f6-4925-8e5a-a612f537a9a2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1515 microversion: 2.1 time: 0.222066 Jun 10 18:01:01.995847 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 609/1180] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:01 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1515 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:02.001741 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2c5a0468-1dca-4bae-bf35-3ddd254d3bdb tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:02.002478 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2c5a0468-1dca-4bae-bf35-3ddd254d3bdb tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:02.009001 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c5a0468-1dca-4bae-bf35-3ddd254d3bdb tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:02.009758 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c5a0468-1dca-4bae-bf35-3ddd254d3bdb tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:02.010630 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c5a0468-1dca-4bae-bf35-3ddd254d3bdb tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:02.011163 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c5a0468-1dca-4bae-bf35-3ddd254d3bdb tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:02.026569 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-2c5a0468-1dca-4bae-bf35-3ddd254d3bdb tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] HTTP exception thrown: Instance cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 could not be found. Jun 10 18:01:02.028429 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2c5a0468-1dca-4bae-bf35-3ddd254d3bdb tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Request method failure captured: Jun 10 18:01:02.028429 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 HTTP/1.1 Jun 10 18:01:02.028429 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:01:02.028429 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:01:02.028429 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:01:02.028429 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:01:02.028429 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:01:02.028429 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:01:02.028429 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:01:02.028429 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:01:02.028429 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4YQyW0W78EH7IBbqLtFUBIQeB9wqPMjhWB4XheFo7PwAMzF2U0k37h8pMO3TapLOXl2W9JFoLVbudbv4qGra16jl5K_jagepJofnVhk0ur1vkgq3O7aN1dJYfSu8CB7vPxmg9EhxB66x_1valQGgRt9gEAO9MXOfxSoZEfdr-n85_0 Jun 10 18:01:02.028429 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:01:02.028429 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:01:02.028429 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:01:02.028429 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:01:02.028429 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:01:02.028429 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:01:02.028429 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: ef9d5dac7c8243aeaa207c5a1ecb399a Jun 10 18:01:02.028429 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1606954782 Jun 10 18:01:02.028429 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:01:02.028429 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:01:02.030258 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ef9d5dac7c8243aeaa207c5a1ecb399a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ef9d5dac7c8243aeaa207c5a1ecb399a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ef9d5dac7c8243aeaa207c5a1ecb399a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ef9d5dac7c8243aeaa207c5a1ecb399a", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:01:02.030258 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1606954782 Jun 10 18:01:02.030258 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: ef9d5dac7c8243aeaa207c5a1ecb399a Jun 10 18:01:02.030258 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1606954782 Jun 10 18:01:02.030258 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1606954782-project Jun 10 18:01:02.030258 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:01:02.030258 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:01:02.030258 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 329e5bd8a55d42cdb7879fbead65627a Jun 10 18:01:02.030258 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1606954782-project Jun 10 18:01:02.030258 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:01:02.030258 chdv-master-2 devstack@n-api.service[126595]: exception: Instance cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 could not be found. Jun 10 18:01:02.030258 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2'} Jun 10 18:01:02.031655 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:01:02.031655 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:02.031655 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:01:02.031655 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:01:02.031655 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:01:02.031655 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:01:02.031655 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:01:02.031655 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:01:02.031655 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:01:02.031655 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:01:02.031655 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 could not be found. Jun 10 18:01:02.031655 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:02.031655 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:01:02.031655 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:02.031655 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:02.031655 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:02.031655 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:02.031655 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:01:02.031655 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:01:02.031655 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:01:02.033104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:01:02.033104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:01:02.033104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:01:02.033104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:01:02.033104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:01:02.033104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:01:02.033104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:01:02.033104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 could not be found. Jun 10 18:01:02.033104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:02.033104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:01:02.033104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:02.033104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:02.033104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:02.033104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:02.033104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:01:02.033104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:01:02.033104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 could not be found. Jun 10 18:01:02.033104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:02.034472 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2c5a0468-1dca-4bae-bf35-3ddd254d3bdb tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Returning 404 to user: Instance cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:01:02.034472 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2c5a0468-1dca-4bae-bf35-3ddd254d3bdb tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "GET /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2" status: 404 len: 111 microversion: 2.1 time: 0.032529 Jun 10 18:01:02.034472 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 610/1181] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:01 2022] GET /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:01:02.039795 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a3507963-0563-4f38-8c14-a4b10a066b74 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '.version_select at 0x7f77c116d550>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:02.134113 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a3507963-0563-4f38-8c14-a4b10a066b74 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-723378704" status: 202 len: 0 microversion: 2.1 time: 0.097891 Jun 10 18:01:02.140803 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 611/1182] 10.222.0.35 () {58 vars in 1217 bytes} [Fri Jun 10 18:01:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-723378704 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 18:01:02.348114 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1100d268-b663-4fab-b551-32f1cdbb435c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:02.348881 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1100d268-b663-4fab-b551-32f1cdbb435c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:02.356112 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1100d268-b663-4fab-b551-32f1cdbb435c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:02.356606 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1100d268-b663-4fab-b551-32f1cdbb435c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:02.357400 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1100d268-b663-4fab-b551-32f1cdbb435c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:02.358036 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1100d268-b663-4fab-b551-32f1cdbb435c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:02.367136 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2d8d160a-d9ca-4084-83e4-1cda8ba1157b tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] 10.222.0.35 "POST /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605/action" status: 202 len: 0 microversion: 2.25 time: 2.893395 Jun 10 18:01:02.372345 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 572/1183] 10.222.0.35 () {62 vars in 1318 bytes} [Fri Jun 10 18:00:59 2022] POST /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605/action => generated 0 bytes in 2895 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:01:02.377479 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-77bc1ca2-cbab-465a-8d0e-f0bd8bada136 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:02.378217 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-77bc1ca2-cbab-465a-8d0e-f0bd8bada136 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f5230492-7afa-4202-82ed-1df1cacd2605] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:02.387537 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-77bc1ca2-cbab-465a-8d0e-f0bd8bada136 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:02.388386 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-77bc1ca2-cbab-465a-8d0e-f0bd8bada136 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:02.389369 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-77bc1ca2-cbab-465a-8d0e-f0bd8bada136 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:02.390960 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-77bc1ca2-cbab-465a-8d0e-f0bd8bada136 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:02.631244 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1100d268-b663-4fab-b551-32f1cdbb435c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:02.649679 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1100d268-b663-4fab-b551-32f1cdbb435c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1475 microversion: 2.1 time: 0.305821 Jun 10 18:01:02.675466 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 612/1184] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:02 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1475 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:01:02.681991 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b8231ae1-7fb2-428d-8c81-cf5dde69e292 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:02.682655 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b8231ae1-7fb2-428d-8c81-cf5dde69e292 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:02.694432 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b8231ae1-7fb2-428d-8c81-cf5dde69e292 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:02.696649 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b8231ae1-7fb2-428d-8c81-cf5dde69e292 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:02.707570 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-77bc1ca2-cbab-465a-8d0e-f0bd8bada136 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:02.717671 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b8231ae1-7fb2-428d-8c81-cf5dde69e292 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:02.718139 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b8231ae1-7fb2-428d-8c81-cf5dde69e292 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:02.724417 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-77bc1ca2-cbab-465a-8d0e-f0bd8bada136 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:02.744053 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-77bc1ca2-cbab-465a-8d0e-f0bd8bada136 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:02.748565 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-77bc1ca2-cbab-465a-8d0e-f0bd8bada136 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605" status: 200 len: 1568 microversion: 2.25 time: 0.374639 Jun 10 18:01:02.752140 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 573/1185] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:01:02 2022] GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605 => generated 1568 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:01:02.792037 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-121912c0-5d9d-4452-bcab-e7679315a3c3 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:02.797490 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-121912c0-5d9d-4452-bcab-e7679315a3c3 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:02.808748 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-121912c0-5d9d-4452-bcab-e7679315a3c3 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:02.809219 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-121912c0-5d9d-4452-bcab-e7679315a3c3 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:02.817573 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-121912c0-5d9d-4452-bcab-e7679315a3c3 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:02.818073 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-121912c0-5d9d-4452-bcab-e7679315a3c3 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:02.867073 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b8231ae1-7fb2-428d-8c81-cf5dde69e292 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:02.883409 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b8231ae1-7fb2-428d-8c81-cf5dde69e292 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1207 microversion: 2.1 time: 0.206675 Jun 10 18:01:02.889055 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 613/1186] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:02 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1207 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:03.015439 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6b58dcd5-371e-4747-a01a-1cc5bdc4709e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:03.016291 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6b58dcd5-371e-4747-a01a-1cc5bdc4709e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:03.025334 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6b58dcd5-371e-4747-a01a-1cc5bdc4709e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:03.026008 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6b58dcd5-371e-4747-a01a-1cc5bdc4709e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:03.026817 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6b58dcd5-371e-4747-a01a-1cc5bdc4709e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:03.027264 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6b58dcd5-371e-4747-a01a-1cc5bdc4709e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:03.183138 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-121912c0-5d9d-4452-bcab-e7679315a3c3 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:03.193397 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-121912c0-5d9d-4452-bcab-e7679315a3c3 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1476 microversion: 2.1 time: 0.410847 Jun 10 18:01:03.201118 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 574/1187] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:02 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1476 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:03.488664 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6b58dcd5-371e-4747-a01a-1cc5bdc4709e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:03.500332 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6b58dcd5-371e-4747-a01a-1cc5bdc4709e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1515 microversion: 2.1 time: 0.492080 Jun 10 18:01:03.511709 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 614/1188] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:03 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1515 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:01:03.667949 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c1753420-333d-4460-8659-a64280cc6d4d tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:03.669244 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c1753420-333d-4460-8659-a64280cc6d4d tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:03.687968 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c1753420-333d-4460-8659-a64280cc6d4d tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:03.693015 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c1753420-333d-4460-8659-a64280cc6d4d tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:03.693015 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c1753420-333d-4460-8659-a64280cc6d4d tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:03.693015 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c1753420-333d-4460-8659-a64280cc6d4d tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:03.769422 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-972ccfde-73a8-4591-a68d-a28d685a7c4e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:03.770651 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-972ccfde-73a8-4591-a68d-a28d685a7c4e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f5230492-7afa-4202-82ed-1df1cacd2605] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:03.791717 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-972ccfde-73a8-4591-a68d-a28d685a7c4e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:03.792531 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-972ccfde-73a8-4591-a68d-a28d685a7c4e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:03.793540 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-972ccfde-73a8-4591-a68d-a28d685a7c4e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:03.794135 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-972ccfde-73a8-4591-a68d-a28d685a7c4e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:04.048273 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-972ccfde-73a8-4591-a68d-a28d685a7c4e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:04.067985 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-972ccfde-73a8-4591-a68d-a28d685a7c4e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:04.077079 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-972ccfde-73a8-4591-a68d-a28d685a7c4e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:04.080761 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-972ccfde-73a8-4591-a68d-a28d685a7c4e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605" status: 200 len: 1568 microversion: 2.25 time: 0.315151 Jun 10 18:01:04.084233 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 615/1189] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:01:03 2022] GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605 => generated 1568 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:01:04.097385 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ea1ed797-98fa-413a-bf1d-030ac2f6d158 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:04.098261 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ea1ed797-98fa-413a-bf1d-030ac2f6d158 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:04.110840 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c1753420-333d-4460-8659-a64280cc6d4d tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:04.118529 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c1753420-333d-4460-8659-a64280cc6d4d tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1475 microversion: 2.1 time: 0.455600 Jun 10 18:01:04.127358 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 575/1190] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:03 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1475 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:04.133493 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ea1ed797-98fa-413a-bf1d-030ac2f6d158 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:04.134099 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ea1ed797-98fa-413a-bf1d-030ac2f6d158 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:04.140454 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ea1ed797-98fa-413a-bf1d-030ac2f6d158 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:04.140454 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ea1ed797-98fa-413a-bf1d-030ac2f6d158 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:04.210866 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0da4c256-1218-4ea2-94c7-cead922c1a14 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:04.211492 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0da4c256-1218-4ea2-94c7-cead922c1a14 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:04.219701 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0da4c256-1218-4ea2-94c7-cead922c1a14 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:04.220160 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0da4c256-1218-4ea2-94c7-cead922c1a14 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:04.220983 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0da4c256-1218-4ea2-94c7-cead922c1a14 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:04.221425 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0da4c256-1218-4ea2-94c7-cead922c1a14 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:04.380833 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ea1ed797-98fa-413a-bf1d-030ac2f6d158 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:04.393691 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ea1ed797-98fa-413a-bf1d-030ac2f6d158 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1269 microversion: 2.1 time: 0.304244 Jun 10 18:01:04.403480 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 616/1191] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:04 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1269 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:04.403875 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-0faf129f-4cf5-4d2f-b218-bbbb863cc8df req-76b1b450-cfd2-4fcf-8e6c-a096ab722249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab0caf46-568d-4b5a-bd31-458cdc99b06f", "name": "network-vif-unplugged", "status": "completed", "tag": "fe140919-8d1b-4aeb-a134-324a13655f62"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:04.425885 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-0faf129f-4cf5-4d2f-b218-bbbb863cc8df req-76b1b450-cfd2-4fcf-8e6c-a096ab722249 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:04.426340 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-0faf129f-4cf5-4d2f-b218-bbbb863cc8df req-76b1b450-cfd2-4fcf-8e6c-a096ab722249 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:04.456898 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-0faf129f-4cf5-4d2f-b218-bbbb863cc8df req-76b1b450-cfd2-4fcf-8e6c-a096ab722249 service nova] Creating event network-vif-unplugged:fe140919-8d1b-4aeb-a134-324a13655f62 for instance ab0caf46-568d-4b5a-bd31-458cdc99b06f on chh1-master-2 Jun 10 18:01:04.464209 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-0faf129f-4cf5-4d2f-b218-bbbb863cc8df req-76b1b450-cfd2-4fcf-8e6c-a096ab722249 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067844 Jun 10 18:01:04.466404 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 617/1192] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:01:04.473755 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f4165d1d-65c7-49b7-85ee-a1b0e3e095b7 tempest-ServersWithSpecificFlavorTestJSON-2002976239 tempest-ServersWithSpecificFlavorTestJSON-2002976239-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:04.474814 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:01:04.474814 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 18:01:04.517641 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0da4c256-1218-4ea2-94c7-cead922c1a14 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:04.528029 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0da4c256-1218-4ea2-94c7-cead922c1a14 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1476 microversion: 2.1 time: 0.320537 Jun 10 18:01:04.538088 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 576/1193] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:04 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1476 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:04.538088 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b84c4625-4ac4-444f-b2b1-d62c0b31eff1 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:04.538088 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b84c4625-4ac4-444f-b2b1-d62c0b31eff1 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:04.543828 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b84c4625-4ac4-444f-b2b1-d62c0b31eff1 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:04.544468 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b84c4625-4ac4-444f-b2b1-d62c0b31eff1 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:04.545316 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b84c4625-4ac4-444f-b2b1-d62c0b31eff1 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:04.546497 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b84c4625-4ac4-444f-b2b1-d62c0b31eff1 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:04.566220 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f4165d1d-65c7-49b7-85ee-a1b0e3e095b7 tempest-ServersWithSpecificFlavorTestJSON-2002976239 tempest-ServersWithSpecificFlavorTestJSON-2002976239-project-admin] 10.222.0.35 "DELETE /compute/v2.1/flavors/86660298" status: 202 len: 0 microversion: 2.1 time: 0.096185 Jun 10 18:01:04.568189 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 618/1194] 10.222.0.35 () {58 vars in 1154 bytes} [Fri Jun 10 18:01:04 2022] DELETE /compute/v2.1/flavors/86660298 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:01:04.595739 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-841ab4c7-d587-47cc-81a3-a569316e052d tempest-ServersWithSpecificFlavorTestJSON-2002976239 tempest-ServersWithSpecificFlavorTestJSON-2002976239-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:04.625755 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-841ab4c7-d587-47cc-81a3-a569316e052d tempest-ServersWithSpecificFlavorTestJSON-2002976239 tempest-ServersWithSpecificFlavorTestJSON-2002976239-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.053004 Jun 10 18:01:04.626670 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 619/1195] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 18:01:04 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:01:04.641298 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cc245086-241a-428c-baa9-85593c39d3a9 tempest-ServersWithSpecificFlavorTestJSON-2002976239 tempest-ServersWithSpecificFlavorTestJSON-2002976239-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:04.712191 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cc245086-241a-428c-baa9-85593c39d3a9 tempest-ServersWithSpecificFlavorTestJSON-2002976239 tempest-ServersWithSpecificFlavorTestJSON-2002976239-project-admin] 10.222.0.35 "DELETE /compute/v2.1/flavors/1778109647" status: 202 len: 0 microversion: 2.1 time: 0.074680 Jun 10 18:01:04.715965 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 620/1196] 10.222.0.35 () {58 vars in 1160 bytes} [Fri Jun 10 18:01:04 2022] DELETE /compute/v2.1/flavors/1778109647 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 18:01:04.721438 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e57926e8-9b47-4c85-a42d-3c2ecd649357 tempest-ServersWithSpecificFlavorTestJSON-2002976239 tempest-ServersWithSpecificFlavorTestJSON-2002976239-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:04.749903 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e57926e8-9b47-4c85-a42d-3c2ecd649357 tempest-ServersWithSpecificFlavorTestJSON-2002976239 tempest-ServersWithSpecificFlavorTestJSON-2002976239-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032741 Jun 10 18:01:04.759547 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 621/1197] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 18:01:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:04.778434 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-08acf20e-3df9-4bd8-a632-08448689024b tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:04.779198 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-08acf20e-3df9-4bd8-a632-08448689024b tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: c922bb8c-ba7b-4448-9d8b-a6fb6498b25b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:04.786950 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-08acf20e-3df9-4bd8-a632-08448689024b tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:04.787392 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-08acf20e-3df9-4bd8-a632-08448689024b tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:04.788448 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-08acf20e-3df9-4bd8-a632-08448689024b tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:04.789061 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-08acf20e-3df9-4bd8-a632-08448689024b tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:04.804111 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-08acf20e-3df9-4bd8-a632-08448689024b tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] HTTP exception thrown: Instance c922bb8c-ba7b-4448-9d8b-a6fb6498b25b could not be found. Jun 10 18:01:04.806215 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-08acf20e-3df9-4bd8-a632-08448689024b tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Request method failure captured: Jun 10 18:01:04.806215 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b HTTP/1.1 Jun 10 18:01:04.806215 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:01:04.806215 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:01:04.806215 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:01:04.806215 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:01:04.806215 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:01:04.806215 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:01:04.806215 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:01:04.806215 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:01:04.806215 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4YQyW0W78EH7IBbqLtFUBIQeB9wqPMjhWB4XheFo7PwAMzF2U0k37h8pMO3TapLOXl2W9JFoLVbudbv4qGra16jl5K_jagepJofnVhk0ur1vkgq3O7aN1dJYfSu8CB7vPxmg9EhxB66x_1valQGgRt9gEAO9MXOfxSoZEfdr-n85_0 Jun 10 18:01:04.806215 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:01:04.806215 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:01:04.806215 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:01:04.806215 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:01:04.806215 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:01:04.806215 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:01:04.806215 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: ef9d5dac7c8243aeaa207c5a1ecb399a Jun 10 18:01:04.806215 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1606954782 Jun 10 18:01:04.806215 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:01:04.806215 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:01:04.807586 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ef9d5dac7c8243aeaa207c5a1ecb399a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ef9d5dac7c8243aeaa207c5a1ecb399a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ef9d5dac7c8243aeaa207c5a1ecb399a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ef9d5dac7c8243aeaa207c5a1ecb399a", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:01:04.807586 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1606954782 Jun 10 18:01:04.807586 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: ef9d5dac7c8243aeaa207c5a1ecb399a Jun 10 18:01:04.807586 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1606954782 Jun 10 18:01:04.807586 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1606954782-project Jun 10 18:01:04.807586 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:01:04.807586 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:01:04.807586 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 329e5bd8a55d42cdb7879fbead65627a Jun 10 18:01:04.807586 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1606954782-project Jun 10 18:01:04.807586 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:01:04.807586 chdv-master-2 devstack@n-api.service[126595]: exception: Instance c922bb8c-ba7b-4448-9d8b-a6fb6498b25b could not be found. Jun 10 18:01:04.807586 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'c922bb8c-ba7b-4448-9d8b-a6fb6498b25b'} Jun 10 18:01:04.808359 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:01:04.808359 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:04.808359 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:01:04.808359 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:01:04.808359 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:01:04.808359 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:01:04.808359 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:01:04.808359 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:01:04.808359 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:01:04.808359 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:01:04.808359 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c922bb8c-ba7b-4448-9d8b-a6fb6498b25b could not be found. Jun 10 18:01:04.808359 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:04.808359 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:01:04.808359 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:04.808359 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:04.808359 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:04.808359 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:04.808359 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:01:04.808359 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:01:04.808359 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:01:04.809766 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:01:04.809766 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:01:04.809766 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:01:04.809766 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:01:04.809766 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:01:04.809766 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:01:04.809766 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:01:04.809766 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:01:04.809766 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:01:04.809766 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c922bb8c-ba7b-4448-9d8b-a6fb6498b25b could not be found. Jun 10 18:01:04.809766 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:04.809766 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:01:04.809766 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:04.809766 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:04.809766 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:04.809766 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:04.809766 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:01:04.809766 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:01:04.809766 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c922bb8c-ba7b-4448-9d8b-a6fb6498b25b could not be found. Jun 10 18:01:04.809766 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:04.812119 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-08acf20e-3df9-4bd8-a632-08448689024b tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Returning 404 to user: Instance c922bb8c-ba7b-4448-9d8b-a6fb6498b25b could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:01:04.813178 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-08acf20e-3df9-4bd8-a632-08448689024b tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "DELETE /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b" status: 404 len: 111 microversion: 2.1 time: 0.038577 Jun 10 18:01:04.817461 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 622/1198] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:01:04 2022] DELETE /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:01:04.822439 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5b314339-d9fa-497b-b52c-82fba5638d20 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:04.823301 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5b314339-d9fa-497b-b52c-82fba5638d20 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: c922bb8c-ba7b-4448-9d8b-a6fb6498b25b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:04.826614 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:DELETE=7 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:01:04.831717 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5b314339-d9fa-497b-b52c-82fba5638d20 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:04.832457 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5b314339-d9fa-497b-b52c-82fba5638d20 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:04.833477 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5b314339-d9fa-497b-b52c-82fba5638d20 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:04.834144 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5b314339-d9fa-497b-b52c-82fba5638d20 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:04.850123 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-5b314339-d9fa-497b-b52c-82fba5638d20 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] HTTP exception thrown: Instance c922bb8c-ba7b-4448-9d8b-a6fb6498b25b could not be found. Jun 10 18:01:04.852076 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5b314339-d9fa-497b-b52c-82fba5638d20 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Request method failure captured: Jun 10 18:01:04.852076 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b HTTP/1.1 Jun 10 18:01:04.852076 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:01:04.852076 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:01:04.852076 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:01:04.852076 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:01:04.852076 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:01:04.852076 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:01:04.852076 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:01:04.852076 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:01:04.852076 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4YQyW0W78EH7IBbqLtFUBIQeB9wqPMjhWB4XheFo7PwAMzF2U0k37h8pMO3TapLOXl2W9JFoLVbudbv4qGra16jl5K_jagepJofnVhk0ur1vkgq3O7aN1dJYfSu8CB7vPxmg9EhxB66x_1valQGgRt9gEAO9MXOfxSoZEfdr-n85_0 Jun 10 18:01:04.852076 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:01:04.852076 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:01:04.852076 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:01:04.852076 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:01:04.852076 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:01:04.852076 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:01:04.852076 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: ef9d5dac7c8243aeaa207c5a1ecb399a Jun 10 18:01:04.852076 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1606954782 Jun 10 18:01:04.852076 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:01:04.852076 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:01:04.853403 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ef9d5dac7c8243aeaa207c5a1ecb399a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ef9d5dac7c8243aeaa207c5a1ecb399a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ef9d5dac7c8243aeaa207c5a1ecb399a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ef9d5dac7c8243aeaa207c5a1ecb399a", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:01:04.853403 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1606954782 Jun 10 18:01:04.853403 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: ef9d5dac7c8243aeaa207c5a1ecb399a Jun 10 18:01:04.853403 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1606954782 Jun 10 18:01:04.853403 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1606954782-project Jun 10 18:01:04.853403 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:01:04.853403 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:01:04.853403 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 329e5bd8a55d42cdb7879fbead65627a Jun 10 18:01:04.853403 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1606954782-project Jun 10 18:01:04.853403 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:01:04.853403 chdv-master-2 devstack@n-api.service[126595]: exception: Instance c922bb8c-ba7b-4448-9d8b-a6fb6498b25b could not be found. Jun 10 18:01:04.853403 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'c922bb8c-ba7b-4448-9d8b-a6fb6498b25b'} Jun 10 18:01:04.854115 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:01:04.854115 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:04.854115 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:01:04.854115 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:01:04.854115 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:01:04.854115 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:01:04.854115 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:01:04.854115 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:01:04.854115 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:01:04.854115 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:01:04.854115 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c922bb8c-ba7b-4448-9d8b-a6fb6498b25b could not be found. Jun 10 18:01:04.854115 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:04.854115 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:01:04.854115 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:04.854115 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:04.854115 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:04.854115 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:04.854115 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:01:04.854115 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:01:04.854115 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:01:04.855375 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:01:04.855375 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:01:04.855375 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:01:04.855375 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:01:04.855375 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:01:04.855375 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:01:04.855375 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:01:04.855375 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c922bb8c-ba7b-4448-9d8b-a6fb6498b25b could not be found. Jun 10 18:01:04.855375 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:04.855375 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:01:04.855375 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:04.855375 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:04.855375 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:04.855375 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:04.855375 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:01:04.855375 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:01:04.855375 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c922bb8c-ba7b-4448-9d8b-a6fb6498b25b could not be found. Jun 10 18:01:04.855375 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:04.859375 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5b314339-d9fa-497b-b52c-82fba5638d20 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Returning 404 to user: Instance c922bb8c-ba7b-4448-9d8b-a6fb6498b25b could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:01:04.859375 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5b314339-d9fa-497b-b52c-82fba5638d20 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b" status: 404 len: 111 microversion: 2.1 time: 0.040149 Jun 10 18:01:04.860001 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 623/1199] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:04 2022] GET /compute/v2.1/servers/c922bb8c-ba7b-4448-9d8b-a6fb6498b25b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:01:04.867930 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ceac9ef2-0bef-4da5-8247-8ade7fef8df0 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:04.868949 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ceac9ef2-0bef-4da5-8247-8ade7fef8df0 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:04.875650 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ceac9ef2-0bef-4da5-8247-8ade7fef8df0 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:04.876441 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ceac9ef2-0bef-4da5-8247-8ade7fef8df0 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:04.877482 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ceac9ef2-0bef-4da5-8247-8ade7fef8df0 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:04.878150 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ceac9ef2-0bef-4da5-8247-8ade7fef8df0 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:04.893714 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-ceac9ef2-0bef-4da5-8247-8ade7fef8df0 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] HTTP exception thrown: Instance cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 could not be found. Jun 10 18:01:04.895688 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ceac9ef2-0bef-4da5-8247-8ade7fef8df0 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Request method failure captured: Jun 10 18:01:04.895688 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 HTTP/1.1 Jun 10 18:01:04.895688 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:01:04.895688 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:01:04.895688 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:01:04.895688 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:01:04.895688 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:01:04.895688 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:01:04.895688 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:01:04.895688 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:01:04.895688 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4YQyW0W78EH7IBbqLtFUBIQeB9wqPMjhWB4XheFo7PwAMzF2U0k37h8pMO3TapLOXl2W9JFoLVbudbv4qGra16jl5K_jagepJofnVhk0ur1vkgq3O7aN1dJYfSu8CB7vPxmg9EhxB66x_1valQGgRt9gEAO9MXOfxSoZEfdr-n85_0 Jun 10 18:01:04.895688 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:01:04.895688 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:01:04.895688 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:01:04.895688 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:01:04.895688 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:01:04.895688 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:01:04.895688 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: ef9d5dac7c8243aeaa207c5a1ecb399a Jun 10 18:01:04.895688 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1606954782 Jun 10 18:01:04.895688 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:01:04.895688 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:01:04.897028 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ef9d5dac7c8243aeaa207c5a1ecb399a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ef9d5dac7c8243aeaa207c5a1ecb399a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ef9d5dac7c8243aeaa207c5a1ecb399a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ef9d5dac7c8243aeaa207c5a1ecb399a", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:01:04.897028 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1606954782 Jun 10 18:01:04.897028 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: ef9d5dac7c8243aeaa207c5a1ecb399a Jun 10 18:01:04.897028 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1606954782 Jun 10 18:01:04.897028 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1606954782-project Jun 10 18:01:04.897028 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:01:04.897028 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:01:04.897028 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 329e5bd8a55d42cdb7879fbead65627a Jun 10 18:01:04.897028 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1606954782-project Jun 10 18:01:04.897028 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:01:04.897028 chdv-master-2 devstack@n-api.service[126595]: exception: Instance cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 could not be found. Jun 10 18:01:04.897028 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2'} Jun 10 18:01:04.897756 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:01:04.897756 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:04.897756 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:01:04.897756 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:01:04.897756 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:01:04.897756 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:01:04.897756 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:01:04.897756 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:01:04.897756 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:01:04.897756 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:01:04.897756 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 could not be found. Jun 10 18:01:04.897756 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:04.897756 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:01:04.897756 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:04.897756 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:04.897756 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:04.897756 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:04.897756 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:01:04.897756 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:01:04.897756 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:01:04.898938 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:01:04.898938 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:01:04.898938 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:01:04.898938 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:01:04.898938 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:01:04.898938 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:01:04.898938 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:01:04.898938 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:01:04.898938 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:01:04.898938 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 could not be found. Jun 10 18:01:04.898938 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:04.898938 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:01:04.898938 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:04.898938 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:04.898938 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:04.898938 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:04.898938 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:01:04.898938 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:01:04.898938 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 could not be found. Jun 10 18:01:04.898938 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:04.901971 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ceac9ef2-0bef-4da5-8247-8ade7fef8df0 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Returning 404 to user: Instance cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:01:04.902939 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ceac9ef2-0bef-4da5-8247-8ade7fef8df0 tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "DELETE /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2" status: 404 len: 111 microversion: 2.1 time: 0.038709 Jun 10 18:01:04.904130 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 624/1200] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:01:04 2022] DELETE /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:01:04.912282 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bbb1af0f-c2ff-4ee6-847f-d4d7c110828a tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:04.912973 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bbb1af0f-c2ff-4ee6-847f-d4d7c110828a tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] [instance: cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:04.919966 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bbb1af0f-c2ff-4ee6-847f-d4d7c110828a tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:04.920768 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bbb1af0f-c2ff-4ee6-847f-d4d7c110828a tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:04.921959 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bbb1af0f-c2ff-4ee6-847f-d4d7c110828a tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:04.922629 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bbb1af0f-c2ff-4ee6-847f-d4d7c110828a tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:04.937361 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-bbb1af0f-c2ff-4ee6-847f-d4d7c110828a tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] HTTP exception thrown: Instance cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 could not be found. Jun 10 18:01:04.939384 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bbb1af0f-c2ff-4ee6-847f-d4d7c110828a tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Request method failure captured: Jun 10 18:01:04.939384 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 HTTP/1.1 Jun 10 18:01:04.939384 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:01:04.939384 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:01:04.939384 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:01:04.939384 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:01:04.939384 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:01:04.939384 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:01:04.939384 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:01:04.939384 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:01:04.939384 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4YQyW0W78EH7IBbqLtFUBIQeB9wqPMjhWB4XheFo7PwAMzF2U0k37h8pMO3TapLOXl2W9JFoLVbudbv4qGra16jl5K_jagepJofnVhk0ur1vkgq3O7aN1dJYfSu8CB7vPxmg9EhxB66x_1valQGgRt9gEAO9MXOfxSoZEfdr-n85_0 Jun 10 18:01:04.939384 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:01:04.939384 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:01:04.939384 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:01:04.939384 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:01:04.939384 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:01:04.939384 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:01:04.939384 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: ef9d5dac7c8243aeaa207c5a1ecb399a Jun 10 18:01:04.939384 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1606954782 Jun 10 18:01:04.939384 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:01:04.939384 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:01:04.940690 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ef9d5dac7c8243aeaa207c5a1ecb399a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ef9d5dac7c8243aeaa207c5a1ecb399a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ef9d5dac7c8243aeaa207c5a1ecb399a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ef9d5dac7c8243aeaa207c5a1ecb399a", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:01:04.940690 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1606954782 Jun 10 18:01:04.940690 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: ef9d5dac7c8243aeaa207c5a1ecb399a Jun 10 18:01:04.940690 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1606954782 Jun 10 18:01:04.940690 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1606954782-project Jun 10 18:01:04.940690 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:01:04.940690 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:01:04.940690 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 329e5bd8a55d42cdb7879fbead65627a Jun 10 18:01:04.940690 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1606954782-project Jun 10 18:01:04.940690 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:01:04.940690 chdv-master-2 devstack@n-api.service[126595]: exception: Instance cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 could not be found. Jun 10 18:01:04.940690 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2'} Jun 10 18:01:04.941421 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:01:04.941421 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:04.941421 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:01:04.941421 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:01:04.941421 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:01:04.941421 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:01:04.941421 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:01:04.941421 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:01:04.941421 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:01:04.941421 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:01:04.941421 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 could not be found. Jun 10 18:01:04.941421 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:04.941421 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:01:04.941421 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:04.941421 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:04.941421 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:04.941421 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:04.941421 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:01:04.941421 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:01:04.941421 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:01:04.942973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:01:04.942973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:01:04.942973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:01:04.942973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:01:04.942973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:01:04.942973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:01:04.942973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:01:04.942973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 could not be found. Jun 10 18:01:04.942973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:04.942973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:01:04.942973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:04.942973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:04.942973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:04.942973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:04.942973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:01:04.942973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:01:04.942973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 could not be found. Jun 10 18:01:04.942973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:04.944062 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bbb1af0f-c2ff-4ee6-847f-d4d7c110828a tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] Returning 404 to user: Instance cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:01:04.944062 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bbb1af0f-c2ff-4ee6-847f-d4d7c110828a tempest-ServersWithSpecificFlavorTestJSON-1606954782 tempest-ServersWithSpecificFlavorTestJSON-1606954782-project] 10.222.0.35 "GET /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2" status: 404 len: 111 microversion: 2.1 time: 0.032313 Jun 10 18:01:04.945138 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 625/1201] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:04 2022] GET /compute/v2.1/servers/cb49f9f5-b4b9-4e84-a1f1-4681f2ffb0f2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:01:05.038287 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b84c4625-4ac4-444f-b2b1-d62c0b31eff1 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:05.048205 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b84c4625-4ac4-444f-b2b1-d62c0b31eff1 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1515 microversion: 2.1 time: 0.515969 Jun 10 18:01:05.049376 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 577/1202] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:04 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1515 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:05.100598 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2d7ef813-2b5c-47b1-bf40-5a40801355ac tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:05.105919 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2d7ef813-2b5c-47b1-bf40-5a40801355ac tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f5230492-7afa-4202-82ed-1df1cacd2605] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:05.109261 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2d7ef813-2b5c-47b1-bf40-5a40801355ac tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:05.109995 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2d7ef813-2b5c-47b1-bf40-5a40801355ac tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:05.111025 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2d7ef813-2b5c-47b1-bf40-5a40801355ac tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:05.111715 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2d7ef813-2b5c-47b1-bf40-5a40801355ac tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:05.143644 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-78996364-fcb2-45e5-ab53-067066241329 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:05.144728 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-78996364-fcb2-45e5-ab53-067066241329 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:05.154814 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-78996364-fcb2-45e5-ab53-067066241329 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:05.156172 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-78996364-fcb2-45e5-ab53-067066241329 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:05.157682 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-78996364-fcb2-45e5-ab53-067066241329 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:05.159879 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-78996364-fcb2-45e5-ab53-067066241329 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:05.367654 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-78996364-fcb2-45e5-ab53-067066241329 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:05.387422 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-78996364-fcb2-45e5-ab53-067066241329 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1475 microversion: 2.1 time: 0.247299 Jun 10 18:01:05.390522 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 578/1203] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:05 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1475 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:01:05.403778 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-84063732-e004-42bb-84b7-30fa76ceadf8 req-5f6b3435-5cf0-4140-be71-9d72ae9bed8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5230492-7afa-4202-82ed-1df1cacd2605", "name": "network-vif-unplugged", "status": "completed", "tag": "12fa01a2-8605-49e5-baff-4c9c0392af50"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:05.426949 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:01:05.432786 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-84063732-e004-42bb-84b7-30fa76ceadf8 req-5f6b3435-5cf0-4140-be71-9d72ae9bed8b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:05.433583 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-84063732-e004-42bb-84b7-30fa76ceadf8 req-5f6b3435-5cf0-4140-be71-9d72ae9bed8b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:05.468941 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-84063732-e004-42bb-84b7-30fa76ceadf8 req-5f6b3435-5cf0-4140-be71-9d72ae9bed8b service nova] Creating event network-vif-unplugged:12fa01a2-8605-49e5-baff-4c9c0392af50 for instance f5230492-7afa-4202-82ed-1df1cacd2605 on chh1-master-2 Jun 10 18:01:05.479774 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-84063732-e004-42bb-84b7-30fa76ceadf8 req-5f6b3435-5cf0-4140-be71-9d72ae9bed8b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086531 Jun 10 18:01:05.482040 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 579/1204] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:01:05.493529 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2283090c-f64b-4877-b999-cef4d8c3e5dc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:05.495646 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2d7ef813-2b5c-47b1-bf40-5a40801355ac tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:05.496680 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2283090c-f64b-4877-b999-cef4d8c3e5dc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:05.509404 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2d7ef813-2b5c-47b1-bf40-5a40801355ac tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:05.510586 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2283090c-f64b-4877-b999-cef4d8c3e5dc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:05.511300 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2283090c-f64b-4877-b999-cef4d8c3e5dc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:05.513244 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2d7ef813-2b5c-47b1-bf40-5a40801355ac tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:05.513519 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2283090c-f64b-4877-b999-cef4d8c3e5dc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:05.514277 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2283090c-f64b-4877-b999-cef4d8c3e5dc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:05.514516 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2d7ef813-2b5c-47b1-bf40-5a40801355ac tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605" status: 200 len: 1568 microversion: 2.25 time: 0.418194 Jun 10 18:01:05.523571 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 626/1205] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:01:05 2022] GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605 => generated 1568 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:01:05.547042 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0c990d90-8b92-4fe9-b95d-cf5d9e0a697a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:05.556738 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0c990d90-8b92-4fe9-b95d-cf5d9e0a697a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:05.559553 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0c990d90-8b92-4fe9-b95d-cf5d9e0a697a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:05.560247 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0c990d90-8b92-4fe9-b95d-cf5d9e0a697a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:05.561922 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0c990d90-8b92-4fe9-b95d-cf5d9e0a697a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:05.565418 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0c990d90-8b92-4fe9-b95d-cf5d9e0a697a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:05.791809 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2283090c-f64b-4877-b999-cef4d8c3e5dc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:05.799385 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2283090c-f64b-4877-b999-cef4d8c3e5dc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1311 microversion: 2.1 time: 0.314800 Jun 10 18:01:05.809880 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 580/1206] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:05 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1311 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:06.079156 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5cce5be9-ceae-4522-aa59-fdcb97c3e067 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:06.081503 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5cce5be9-ceae-4522-aa59-fdcb97c3e067 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:06.121177 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5cce5be9-ceae-4522-aa59-fdcb97c3e067 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:06.122602 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5cce5be9-ceae-4522-aa59-fdcb97c3e067 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:06.128035 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5cce5be9-ceae-4522-aa59-fdcb97c3e067 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:06.128644 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5cce5be9-ceae-4522-aa59-fdcb97c3e067 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:06.136223 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:01:06.319025 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0c990d90-8b92-4fe9-b95d-cf5d9e0a697a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:06.337708 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0c990d90-8b92-4fe9-b95d-cf5d9e0a697a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1476 microversion: 2.1 time: 0.795709 Jun 10 18:01:06.345353 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 627/1207] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:05 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1476 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:01:06.406788 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2f382abe-d205-41b6-b046-b457f3181349 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:06.407459 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2f382abe-d205-41b6-b046-b457f3181349 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:06.407598 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5cce5be9-ceae-4522-aa59-fdcb97c3e067 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:06.414692 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2f382abe-d205-41b6-b046-b457f3181349 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:06.415408 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2f382abe-d205-41b6-b046-b457f3181349 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:06.416570 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2f382abe-d205-41b6-b046-b457f3181349 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:06.417166 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2f382abe-d205-41b6-b046-b457f3181349 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:06.426124 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5cce5be9-ceae-4522-aa59-fdcb97c3e067 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1515 microversion: 2.1 time: 0.362557 Jun 10 18:01:06.435785 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 581/1208] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:06 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1515 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:06.542626 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-882ce757-1686-483e-8a51-956c0ac8b300 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:06.543475 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-882ce757-1686-483e-8a51-956c0ac8b300 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f5230492-7afa-4202-82ed-1df1cacd2605] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:06.550170 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-882ce757-1686-483e-8a51-956c0ac8b300 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:06.550883 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-882ce757-1686-483e-8a51-956c0ac8b300 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:06.551868 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-882ce757-1686-483e-8a51-956c0ac8b300 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:06.552537 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-882ce757-1686-483e-8a51-956c0ac8b300 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:06.883561 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-882ce757-1686-483e-8a51-956c0ac8b300 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:06.883561 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-882ce757-1686-483e-8a51-956c0ac8b300 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:06.884184 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-882ce757-1686-483e-8a51-956c0ac8b300 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:06.884184 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-882ce757-1686-483e-8a51-956c0ac8b300 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605" status: 200 len: 1568 microversion: 2.25 time: 0.313162 Jun 10 18:01:06.884184 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 582/1209] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:01:06 2022] GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605 => generated 1568 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:01:06.884184 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d89e60c0-23b7-418d-82a0-d2ccfd1baffd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:06.884567 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d89e60c0-23b7-418d-82a0-d2ccfd1baffd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:06.884567 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d89e60c0-23b7-418d-82a0-d2ccfd1baffd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:06.884567 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d89e60c0-23b7-418d-82a0-d2ccfd1baffd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:06.884567 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d89e60c0-23b7-418d-82a0-d2ccfd1baffd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:06.885003 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d89e60c0-23b7-418d-82a0-d2ccfd1baffd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:06.885099 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2f382abe-d205-41b6-b046-b457f3181349 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:06.885705 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2f382abe-d205-41b6-b046-b457f3181349 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1475 microversion: 2.1 time: 0.483442 Jun 10 18:01:06.886298 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 628/1210] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:06 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1475 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:01:07.362530 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d89e60c0-23b7-418d-82a0-d2ccfd1baffd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:07.366047 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3ec7fba8-cb15-43aa-981c-deb240a92744 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:07.366629 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3ec7fba8-cb15-43aa-981c-deb240a92744 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:07.382769 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d89e60c0-23b7-418d-82a0-d2ccfd1baffd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1311 microversion: 2.1 time: 0.523938 Jun 10 18:01:07.385699 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 583/1211] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:06 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1311 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:07.385898 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3ec7fba8-cb15-43aa-981c-deb240a92744 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:07.386200 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3ec7fba8-cb15-43aa-981c-deb240a92744 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:07.387211 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3ec7fba8-cb15-43aa-981c-deb240a92744 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:07.387845 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3ec7fba8-cb15-43aa-981c-deb240a92744 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:07.447311 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-99ca98a5-7b12-4a02-855f-b29d5894dad9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:07.447311 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-99ca98a5-7b12-4a02-855f-b29d5894dad9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:07.455246 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-99ca98a5-7b12-4a02-855f-b29d5894dad9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:07.455597 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-99ca98a5-7b12-4a02-855f-b29d5894dad9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:07.456428 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-99ca98a5-7b12-4a02-855f-b29d5894dad9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:07.456876 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-99ca98a5-7b12-4a02-855f-b29d5894dad9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:07.723336 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-99ca98a5-7b12-4a02-855f-b29d5894dad9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:07.732296 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-99ca98a5-7b12-4a02-855f-b29d5894dad9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1515 microversion: 2.1 time: 0.291273 Jun 10 18:01:07.732892 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 584/1212] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:07 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1515 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:01:07.742891 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-39bcfb38-a719-4960-a61e-e6af182bb0b5 req-0f9f6757-fff2-45d2-ad74-e6d8b48e4092 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5230492-7afa-4202-82ed-1df1cacd2605", "tag": "12fa01a2-8605-49e5-baff-4c9c0392af50"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:07.755277 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-39bcfb38-a719-4960-a61e-e6af182bb0b5 req-0f9f6757-fff2-45d2-ad74-e6d8b48e4092 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:07.755704 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-39bcfb38-a719-4960-a61e-e6af182bb0b5 req-0f9f6757-fff2-45d2-ad74-e6d8b48e4092 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:07.769645 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-39bcfb38-a719-4960-a61e-e6af182bb0b5 req-0f9f6757-fff2-45d2-ad74-e6d8b48e4092 service nova] Creating event network-changed:12fa01a2-8605-49e5-baff-4c9c0392af50 for instance f5230492-7afa-4202-82ed-1df1cacd2605 on chh1-master-2 Jun 10 18:01:07.775415 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-39bcfb38-a719-4960-a61e-e6af182bb0b5 req-0f9f6757-fff2-45d2-ad74-e6d8b48e4092 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040944 Jun 10 18:01:07.776367 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 585/1213] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:01:07.785153 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-beb7b724-2826-4161-9d8a-97781d418a99 req-2cf4291f-0ab1-4d17-8f7c-c645396bfeb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d", "tag": "f0ba52c3-5bcd-42ef-b82a-a280afc864bc"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:07.795107 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-beb7b724-2826-4161-9d8a-97781d418a99 req-2cf4291f-0ab1-4d17-8f7c-c645396bfeb8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:07.796396 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-beb7b724-2826-4161-9d8a-97781d418a99 req-2cf4291f-0ab1-4d17-8f7c-c645396bfeb8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:07.808269 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-beb7b724-2826-4161-9d8a-97781d418a99 req-2cf4291f-0ab1-4d17-8f7c-c645396bfeb8 service nova] Creating event network-changed:f0ba52c3-5bcd-42ef-b82a-a280afc864bc for instance a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d on chh1-master-2 Jun 10 18:01:07.814278 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3ec7fba8-cb15-43aa-981c-deb240a92744 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:07.815343 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-beb7b724-2826-4161-9d8a-97781d418a99 req-2cf4291f-0ab1-4d17-8f7c-c645396bfeb8 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035026 Jun 10 18:01:07.815956 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 586/1214] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:01:07.823269 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3ec7fba8-cb15-43aa-981c-deb240a92744 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1476 microversion: 2.1 time: 0.466795 Jun 10 18:01:07.823862 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 629/1215] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:07 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1476 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:01:07.890839 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5b411ec4-78ae-4164-9bd5-fb320228dd8a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:07.891597 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5b411ec4-78ae-4164-9bd5-fb320228dd8a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f5230492-7afa-4202-82ed-1df1cacd2605] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:07.898785 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5b411ec4-78ae-4164-9bd5-fb320228dd8a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:07.899380 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5b411ec4-78ae-4164-9bd5-fb320228dd8a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:07.900263 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5b411ec4-78ae-4164-9bd5-fb320228dd8a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:07.900813 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5b411ec4-78ae-4164-9bd5-fb320228dd8a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:08.010774 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-61668060-a43f-4e60-9ed8-5e40059c41b3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Action: 'create', calling method: .version_select at 0x7f77c0cb2d30>, body: {"keypair": {"name": "tempest-keypair-1972248464", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJmwFsLw227wxa+vHjVgI32uQwRm+K1JMu8EPul/Fwh/GtD+7itvymEkeEGzowZNBAcEeKfMwy0blFQ/3Turp3ZDV493NAQJ/bZksK2JbPKDlF2yPSPw91kqBNo1Ngfnw=="}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:08.025734 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-61668060-a43f-4e60-9ed8-5e40059c41b3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Getting quotas for project 2b34cb51c168497088d66fa0e507e364. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:01:08.031387 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-61668060-a43f-4e60-9ed8-5e40059c41b3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Getting quotas for user 352e7f5de76c42da9241721fe0f0bf86 and project 2b34cb51c168497088d66fa0e507e364. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:01:08.102592 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-61668060-a43f-4e60-9ed8-5e40059c41b3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.245661 Jun 10 18:01:08.109137 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 587/1216] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 18:01:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:01:08.109137 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9c392e9f-d77e-48a0-ab25-363e1a7016a7 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:08.110065 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9c392e9f-d77e-48a0-ab25-363e1a7016a7 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:08.116887 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9c392e9f-d77e-48a0-ab25-363e1a7016a7 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:08.117357 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9c392e9f-d77e-48a0-ab25-363e1a7016a7 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:08.118158 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9c392e9f-d77e-48a0-ab25-363e1a7016a7 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:08.118610 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9c392e9f-d77e-48a0-ab25-363e1a7016a7 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:08.320443 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9c392e9f-d77e-48a0-ab25-363e1a7016a7 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:08.321917 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5b411ec4-78ae-4164-9bd5-fb320228dd8a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:08.331142 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9c392e9f-d77e-48a0-ab25-363e1a7016a7 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1475 microversion: 2.1 time: 0.226625 Jun 10 18:01:08.333723 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5b411ec4-78ae-4164-9bd5-fb320228dd8a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:08.335849 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5b411ec4-78ae-4164-9bd5-fb320228dd8a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:08.337247 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5b411ec4-78ae-4164-9bd5-fb320228dd8a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605" status: 200 len: 1568 microversion: 2.25 time: 0.450799 Jun 10 18:01:08.345072 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 588/1217] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:08 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1475 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:08.347839 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-b99b4652-5038-460e-b1b2-c459d998825b req-4f52d2be-6e43-4001-a850-e04f314411fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab0caf46-568d-4b5a-bd31-458cdc99b06f", "name": "network-vif-plugged", "status": "completed", "tag": "fe140919-8d1b-4aeb-a134-324a13655f62"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:08.351559 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 630/1218] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:01:07 2022] GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605 => generated 1568 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:01:08.366749 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-b99b4652-5038-460e-b1b2-c459d998825b req-4f52d2be-6e43-4001-a850-e04f314411fd service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:08.367761 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-b99b4652-5038-460e-b1b2-c459d998825b req-4f52d2be-6e43-4001-a850-e04f314411fd service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:08.387598 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-b99b4652-5038-460e-b1b2-c459d998825b req-4f52d2be-6e43-4001-a850-e04f314411fd service nova] Creating event network-vif-plugged:fe140919-8d1b-4aeb-a134-324a13655f62 for instance ab0caf46-568d-4b5a-bd31-458cdc99b06f on chh1-master-2 Jun 10 18:01:08.394226 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-b99b4652-5038-460e-b1b2-c459d998825b req-4f52d2be-6e43-4001-a850-e04f314411fd service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052113 Jun 10 18:01:08.395035 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 589/1219] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:01:08.402247 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bd61a374-b1f5-407a-9760-b588d154b906 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:08.403176 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bd61a374-b1f5-407a-9760-b588d154b906 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:08.412792 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bd61a374-b1f5-407a-9760-b588d154b906 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:08.413599 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bd61a374-b1f5-407a-9760-b588d154b906 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:08.414635 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bd61a374-b1f5-407a-9760-b588d154b906 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:08.415253 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bd61a374-b1f5-407a-9760-b588d154b906 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:08.752091 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b2f4cbea-9fa9-48e2-84c5-8e4064389dac tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:08.754123 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b2f4cbea-9fa9-48e2-84c5-8e4064389dac tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:08.767930 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b2f4cbea-9fa9-48e2-84c5-8e4064389dac tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:08.772885 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b2f4cbea-9fa9-48e2-84c5-8e4064389dac tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:08.774038 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b2f4cbea-9fa9-48e2-84c5-8e4064389dac tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:08.774904 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b2f4cbea-9fa9-48e2-84c5-8e4064389dac tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:08.995789 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b2f4cbea-9fa9-48e2-84c5-8e4064389dac tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:09.006473 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b2f4cbea-9fa9-48e2-84c5-8e4064389dac tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1515 microversion: 2.1 time: 0.260331 Jun 10 18:01:09.018071 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 590/1220] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:08 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1515 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:01:09.023378 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-784af974-0241-4666-8904-7609f410b5c9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:09.024015 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-784af974-0241-4666-8904-7609f410b5c9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:09.030567 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-784af974-0241-4666-8904-7609f410b5c9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:09.031411 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-784af974-0241-4666-8904-7609f410b5c9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:09.032416 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-784af974-0241-4666-8904-7609f410b5c9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:09.033017 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-784af974-0241-4666-8904-7609f410b5c9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:09.145130 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bd61a374-b1f5-407a-9760-b588d154b906 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:09.163333 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bd61a374-b1f5-407a-9760-b588d154b906 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1311 microversion: 2.1 time: 0.765950 Jun 10 18:01:09.171820 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 631/1221] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:08 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1311 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:01:09.251253 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-784af974-0241-4666-8904-7609f410b5c9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:09.263881 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-784af974-0241-4666-8904-7609f410b5c9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1476 microversion: 2.1 time: 0.244433 Jun 10 18:01:09.274519 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 591/1222] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:09 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1476 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:09.349543 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4113bbc2-bcd6-4550-9546-dd024156dedc tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:09.350782 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4113bbc2-bcd6-4550-9546-dd024156dedc tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:09.356648 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5b8283a8-50e0-4ada-ac86-c6e01f712058 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:09.357740 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5b8283a8-50e0-4ada-ac86-c6e01f712058 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f5230492-7afa-4202-82ed-1df1cacd2605] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:09.359807 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4113bbc2-bcd6-4550-9546-dd024156dedc tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:09.360548 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4113bbc2-bcd6-4550-9546-dd024156dedc tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:09.370404 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5b8283a8-50e0-4ada-ac86-c6e01f712058 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:09.376688 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5b8283a8-50e0-4ada-ac86-c6e01f712058 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:09.376688 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5b8283a8-50e0-4ada-ac86-c6e01f712058 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:09.376929 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4113bbc2-bcd6-4550-9546-dd024156dedc tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:09.376929 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4113bbc2-bcd6-4550-9546-dd024156dedc tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:09.378227 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5b8283a8-50e0-4ada-ac86-c6e01f712058 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:09.648629 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5b8283a8-50e0-4ada-ac86-c6e01f712058 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:09.658838 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5b8283a8-50e0-4ada-ac86-c6e01f712058 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:09.660444 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5b8283a8-50e0-4ada-ac86-c6e01f712058 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:09.661838 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5b8283a8-50e0-4ada-ac86-c6e01f712058 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605" status: 200 len: 1568 microversion: 2.25 time: 0.309882 Jun 10 18:01:09.672634 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 592/1223] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:01:09 2022] GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605 => generated 1568 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:01:09.781317 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4113bbc2-bcd6-4550-9546-dd024156dedc tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:09.784228 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:01:09.791426 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4113bbc2-bcd6-4550-9546-dd024156dedc tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1475 microversion: 2.1 time: 0.446753 Jun 10 18:01:09.792341 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 632/1224] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:09 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1475 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:10.024162 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4aa2d8cd-089c-4e9e-9a02-5b0cc7dadf4e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:10.025097 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4aa2d8cd-089c-4e9e-9a02-5b0cc7dadf4e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:10.038831 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4aa2d8cd-089c-4e9e-9a02-5b0cc7dadf4e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:10.039556 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4aa2d8cd-089c-4e9e-9a02-5b0cc7dadf4e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:10.052155 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4aa2d8cd-089c-4e9e-9a02-5b0cc7dadf4e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:10.052155 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4aa2d8cd-089c-4e9e-9a02-5b0cc7dadf4e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:10.181094 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-af4d4cf3-4dd5-437b-8a5d-4bea9f4191da tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:10.182030 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-af4d4cf3-4dd5-437b-8a5d-4bea9f4191da tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:10.205470 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-af4d4cf3-4dd5-437b-8a5d-4bea9f4191da tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:10.206243 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-af4d4cf3-4dd5-437b-8a5d-4bea9f4191da tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:10.207224 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-af4d4cf3-4dd5-437b-8a5d-4bea9f4191da tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:10.207825 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-af4d4cf3-4dd5-437b-8a5d-4bea9f4191da tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:10.521445 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4aa2d8cd-089c-4e9e-9a02-5b0cc7dadf4e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:10.533428 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4aa2d8cd-089c-4e9e-9a02-5b0cc7dadf4e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1515 microversion: 2.1 time: 0.512892 Jun 10 18:01:10.542309 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-af4d4cf3-4dd5-437b-8a5d-4bea9f4191da tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:10.544336 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 593/1225] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:10 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1515 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:10.549978 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c6ab2568-209e-4a2d-a5f0-1edcb8448520 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:10.550577 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-af4d4cf3-4dd5-437b-8a5d-4bea9f4191da tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1311 microversion: 2.1 time: 0.373368 Jun 10 18:01:10.551055 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c6ab2568-209e-4a2d-a5f0-1edcb8448520 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:10.561069 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 633/1226] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:10 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1311 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:10.562853 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c6ab2568-209e-4a2d-a5f0-1edcb8448520 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:10.563549 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c6ab2568-209e-4a2d-a5f0-1edcb8448520 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:10.565033 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c6ab2568-209e-4a2d-a5f0-1edcb8448520 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:10.565676 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c6ab2568-209e-4a2d-a5f0-1edcb8448520 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:10.680740 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4e7cee2e-ebc4-4d3c-ace9-250b3333e55f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:10.682133 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4e7cee2e-ebc4-4d3c-ace9-250b3333e55f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f5230492-7afa-4202-82ed-1df1cacd2605] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:10.710425 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e7cee2e-ebc4-4d3c-ace9-250b3333e55f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:10.711082 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e7cee2e-ebc4-4d3c-ace9-250b3333e55f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:10.712066 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e7cee2e-ebc4-4d3c-ace9-250b3333e55f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:10.713518 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e7cee2e-ebc4-4d3c-ace9-250b3333e55f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:10.900491 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:01:10.964902 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c6ab2568-209e-4a2d-a5f0-1edcb8448520 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:10.974502 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c6ab2568-209e-4a2d-a5f0-1edcb8448520 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1476 microversion: 2.1 time: 0.428802 Jun 10 18:01:10.975094 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 594/1227] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:10 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1476 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:10.987157 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-490da4bd-3d80-4908-9e3d-9308714fda57 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:10.987828 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-490da4bd-3d80-4908-9e3d-9308714fda57 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:11.004017 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-490da4bd-3d80-4908-9e3d-9308714fda57 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:11.004776 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-490da4bd-3d80-4908-9e3d-9308714fda57 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:11.006622 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-490da4bd-3d80-4908-9e3d-9308714fda57 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:11.007465 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-490da4bd-3d80-4908-9e3d-9308714fda57 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:11.035533 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4e7cee2e-ebc4-4d3c-ace9-250b3333e55f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:11.047343 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4e7cee2e-ebc4-4d3c-ace9-250b3333e55f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:11.049698 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4e7cee2e-ebc4-4d3c-ace9-250b3333e55f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:11.051460 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4e7cee2e-ebc4-4d3c-ace9-250b3333e55f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605" status: 200 len: 1568 microversion: 2.25 time: 0.375057 Jun 10 18:01:11.065981 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 634/1228] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:01:10 2022] GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605 => generated 1568 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:01:11.402169 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-490da4bd-3d80-4908-9e3d-9308714fda57 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:11.412718 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-490da4bd-3d80-4908-9e3d-9308714fda57 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1475 microversion: 2.1 time: 0.436343 Jun 10 18:01:11.424286 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 595/1229] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:10 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1475 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:11.552983 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f3c611f1-9798-464e-bfef-a1e47d82836c tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:11.554164 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f3c611f1-9798-464e-bfef-a1e47d82836c tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:11.567195 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=8 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:01:11.567425 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2650a695-7746-434b-b2c3-8eb21cdfbf6b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:11.568133 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2650a695-7746-434b-b2c3-8eb21cdfbf6b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:11.570202 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f3c611f1-9798-464e-bfef-a1e47d82836c tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:11.571101 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f3c611f1-9798-464e-bfef-a1e47d82836c tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:11.572132 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f3c611f1-9798-464e-bfef-a1e47d82836c tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:11.572815 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f3c611f1-9798-464e-bfef-a1e47d82836c tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:11.583658 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2650a695-7746-434b-b2c3-8eb21cdfbf6b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:11.584124 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2650a695-7746-434b-b2c3-8eb21cdfbf6b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:11.585086 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2650a695-7746-434b-b2c3-8eb21cdfbf6b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:11.585536 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2650a695-7746-434b-b2c3-8eb21cdfbf6b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:11.811809 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2650a695-7746-434b-b2c3-8eb21cdfbf6b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:11.824353 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2650a695-7746-434b-b2c3-8eb21cdfbf6b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1311 microversion: 2.1 time: 0.260657 Jun 10 18:01:11.825580 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f3c611f1-9798-464e-bfef-a1e47d82836c tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:11.834951 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 596/1230] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:11 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1311 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:01:11.837061 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f3c611f1-9798-464e-bfef-a1e47d82836c tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1515 microversion: 2.1 time: 0.289621 Jun 10 18:01:11.849326 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 635/1231] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:11 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1515 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:11.992943 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b275bb3a-8744-42df-bf69-c8f967133db6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:11.993840 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b275bb3a-8744-42df-bf69-c8f967133db6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:12.001314 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b275bb3a-8744-42df-bf69-c8f967133db6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:12.002027 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b275bb3a-8744-42df-bf69-c8f967133db6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:12.002982 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b275bb3a-8744-42df-bf69-c8f967133db6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:12.003584 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b275bb3a-8744-42df-bf69-c8f967133db6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:12.074227 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b23bdbb3-0db2-497c-806d-02ddb83ba234 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:12.075171 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b23bdbb3-0db2-497c-806d-02ddb83ba234 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f5230492-7afa-4202-82ed-1df1cacd2605] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:12.084150 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b23bdbb3-0db2-497c-806d-02ddb83ba234 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:12.084150 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b23bdbb3-0db2-497c-806d-02ddb83ba234 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:12.084150 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b23bdbb3-0db2-497c-806d-02ddb83ba234 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:12.084676 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b23bdbb3-0db2-497c-806d-02ddb83ba234 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:12.237500 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b275bb3a-8744-42df-bf69-c8f967133db6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:12.260537 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b275bb3a-8744-42df-bf69-c8f967133db6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1476 microversion: 2.1 time: 0.271612 Jun 10 18:01:12.262356 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 597/1232] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:11 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1476 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:12.270216 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9ba90392-ebed-4714-93ee-3618bc3e86ed tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-416503214", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "02812646-dd80-4769-8285-9699f6c583d0"}], "security_groups": [{"name": "tempest-securitygroup--212633616"}], "key_name": "tempest-keypair-1972248464", "user_data": "}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:12.406739 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b23bdbb3-0db2-497c-806d-02ddb83ba234 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:12.423022 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b23bdbb3-0db2-497c-806d-02ddb83ba234 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:12.426757 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b23bdbb3-0db2-497c-806d-02ddb83ba234 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:12.437189 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b23bdbb3-0db2-497c-806d-02ddb83ba234 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605" status: 200 len: 1568 microversion: 2.25 time: 0.369660 Jun 10 18:01:12.438085 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 636/1233] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:01:12 2022] GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605 => generated 1568 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:01:12.445837 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e2ad1aff-1a24-46ce-9a9d-20af3c4ff52f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:12.453236 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e2ad1aff-1a24-46ce-9a9d-20af3c4ff52f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:12.462978 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-9ba90392-ebed-4714-93ee-3618bc3e86ed tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] validate_networks() for [('02812646-dd80-4769-8285-9699f6c583d0', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:01:12.467454 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e2ad1aff-1a24-46ce-9a9d-20af3c4ff52f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:12.468633 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e2ad1aff-1a24-46ce-9a9d-20af3c4ff52f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:12.469657 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e2ad1aff-1a24-46ce-9a9d-20af3c4ff52f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:12.471212 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e2ad1aff-1a24-46ce-9a9d-20af3c4ff52f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:12.753711 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e2ad1aff-1a24-46ce-9a9d-20af3c4ff52f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:12.766265 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e2ad1aff-1a24-46ce-9a9d-20af3c4ff52f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1461 microversion: 2.1 time: 0.326620 Jun 10 18:01:12.767703 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 637/1234] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:12 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1461 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:12.787273 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-caf2b78e-451e-4e31-887c-7dedea99584e tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:12.788110 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-caf2b78e-451e-4e31-887c-7dedea99584e tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:12.796748 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-caf2b78e-451e-4e31-887c-7dedea99584e tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:12.797384 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-caf2b78e-451e-4e31-887c-7dedea99584e tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:12.798322 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-caf2b78e-451e-4e31-887c-7dedea99584e tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:12.798863 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-caf2b78e-451e-4e31-887c-7dedea99584e tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:13.011206 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-caf2b78e-451e-4e31-887c-7dedea99584e tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:13.019965 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-caf2b78e-451e-4e31-887c-7dedea99584e tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1461 microversion: 2.1 time: 0.238857 Jun 10 18:01:13.020716 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 638/1235] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:12 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1461 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:13.028546 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b53fc97a-91d5-4866-affb-2011158da247 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:13.033121 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b53fc97a-91d5-4866-affb-2011158da247 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:13.036207 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b53fc97a-91d5-4866-affb-2011158da247 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:13.036691 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b53fc97a-91d5-4866-affb-2011158da247 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:13.037553 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b53fc97a-91d5-4866-affb-2011158da247 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:13.037928 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b53fc97a-91d5-4866-affb-2011158da247 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:13.244011 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-9ba90392-ebed-4714-93ee-3618bc3e86ed tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:01:13.245038 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-9ba90392-ebed-4714-93ee-3618bc3e86ed tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:01:13.245520 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-9ba90392-ebed-4714-93ee-3618bc3e86ed tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:01:13.246098 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-9ba90392-ebed-4714-93ee-3618bc3e86ed tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:01:13.246586 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-9ba90392-ebed-4714-93ee-3618bc3e86ed tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:01:13.258081 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9ba90392-ebed-4714-93ee-3618bc3e86ed tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:13.258809 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9ba90392-ebed-4714-93ee-3618bc3e86ed tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:13.259836 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9ba90392-ebed-4714-93ee-3618bc3e86ed tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:13.260429 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9ba90392-ebed-4714-93ee-3618bc3e86ed tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:13.282912 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-9ba90392-ebed-4714-93ee-3618bc3e86ed tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Getting quotas for project 2b34cb51c168497088d66fa0e507e364. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:01:13.289331 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-9ba90392-ebed-4714-93ee-3618bc3e86ed tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Getting quotas for user 352e7f5de76c42da9241721fe0f0bf86 and project 2b34cb51c168497088d66fa0e507e364. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:01:13.290096 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b53fc97a-91d5-4866-affb-2011158da247 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:13.300798 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b53fc97a-91d5-4866-affb-2011158da247 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1311 microversion: 2.1 time: 0.278672 Jun 10 18:01:13.302422 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 639/1236] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:13 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1311 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:13.303369 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9ba90392-ebed-4714-93ee-3618bc3e86ed tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:01:13.305775 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9ba90392-ebed-4714-93ee-3618bc3e86ed tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:01:13.308192 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9cabaeca-cf53-47fa-907e-bc531360fd2b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:13.311815 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9cabaeca-cf53-47fa-907e-bc531360fd2b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:13.318570 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9cabaeca-cf53-47fa-907e-bc531360fd2b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:13.319029 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9cabaeca-cf53-47fa-907e-bc531360fd2b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:13.319812 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9cabaeca-cf53-47fa-907e-bc531360fd2b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:13.320406 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9cabaeca-cf53-47fa-907e-bc531360fd2b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:13.462788 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9cabaeca-cf53-47fa-907e-bc531360fd2b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:13.474227 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9cabaeca-cf53-47fa-907e-bc531360fd2b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1521 microversion: 2.1 time: 0.170373 Jun 10 18:01:13.475339 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 640/1237] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:13 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:13.481353 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1c5690ba-8d88-440a-94e1-bb779240f19c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:13.483657 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1c5690ba-8d88-440a-94e1-bb779240f19c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:13.491140 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9ba90392-ebed-4714-93ee-3618bc3e86ed tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.227428 Jun 10 18:01:13.496467 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 598/1238] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:01:12 2022] POST /compute/v2.1/servers => generated 408 bytes in 1229 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:01:13.496588 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1c5690ba-8d88-440a-94e1-bb779240f19c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:13.496588 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1c5690ba-8d88-440a-94e1-bb779240f19c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:13.496588 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1c5690ba-8d88-440a-94e1-bb779240f19c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:13.496588 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1c5690ba-8d88-440a-94e1-bb779240f19c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:13.496957 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8af50645-b94b-42bd-81ea-2bb0fbe5ce99 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:13.500864 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8af50645-b94b-42bd-81ea-2bb0fbe5ce99 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:13.507832 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8af50645-b94b-42bd-81ea-2bb0fbe5ce99 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:13.512101 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8af50645-b94b-42bd-81ea-2bb0fbe5ce99 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:13.512101 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8af50645-b94b-42bd-81ea-2bb0fbe5ce99 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:13.512101 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8af50645-b94b-42bd-81ea-2bb0fbe5ce99 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:13.614860 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-1c5690ba-8d88-440a-94e1-bb779240f19c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:01:13.614860 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-1c5690ba-8d88-440a-94e1-bb779240f19c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:01:13.614860 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-1c5690ba-8d88-440a-94e1-bb779240f19c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:01:13.614860 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-1c5690ba-8d88-440a-94e1-bb779240f19c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:01:13.614860 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-1c5690ba-8d88-440a-94e1-bb779240f19c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:01:13.827771 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1c5690ba-8d88-440a-94e1-bb779240f19c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:13.834967 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1c5690ba-8d88-440a-94e1-bb779240f19c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:13.835422 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1c5690ba-8d88-440a-94e1-bb779240f19c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:13.836224 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1c5690ba-8d88-440a-94e1-bb779240f19c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:13.836699 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1c5690ba-8d88-440a-94e1-bb779240f19c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:13.871115 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1c5690ba-8d88-440a-94e1-bb779240f19c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "POST /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f/action" status: 202 len: 1065 microversion: 2.1 time: 0.394311 Jun 10 18:01:13.871766 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 641/1239] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:01:13 2022] POST /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f/action => generated 1065 bytes in 396 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jun 10 18:01:13.877329 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-425f103f-c2eb-4871-a4f1-dad7280e7b73 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:13.877945 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-425f103f-c2eb-4871-a4f1-dad7280e7b73 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f5230492-7afa-4202-82ed-1df1cacd2605] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:13.884633 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-425f103f-c2eb-4871-a4f1-dad7280e7b73 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:13.885089 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-425f103f-c2eb-4871-a4f1-dad7280e7b73 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:13.885898 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-425f103f-c2eb-4871-a4f1-dad7280e7b73 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:13.886345 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-425f103f-c2eb-4871-a4f1-dad7280e7b73 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:14.064399 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8af50645-b94b-42bd-81ea-2bb0fbe5ce99 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:14.070755 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-425f103f-c2eb-4871-a4f1-dad7280e7b73 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:14.078631 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8af50645-b94b-42bd-81ea-2bb0fbe5ce99 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1476 microversion: 2.1 time: 0.585137 Jun 10 18:01:14.082371 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-425f103f-c2eb-4871-a4f1-dad7280e7b73 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:14.086240 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-425f103f-c2eb-4871-a4f1-dad7280e7b73 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:14.091876 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 599/1240] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:13 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1476 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:14.094405 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-425f103f-c2eb-4871-a4f1-dad7280e7b73 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605" status: 200 len: 1568 microversion: 2.25 time: 0.221533 Jun 10 18:01:14.095018 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 642/1241] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:01:13 2022] GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605 => generated 1568 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:01:14.107771 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b339cf38-bb78-43f3-8bb0-f45f1b0d7907 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:14.110395 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-10c61235-1150-468b-a5a2-f93080293969 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:14.110395 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-10c61235-1150-468b-a5a2-f93080293969 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:14.110715 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b339cf38-bb78-43f3-8bb0-f45f1b0d7907 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:14.127610 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b339cf38-bb78-43f3-8bb0-f45f1b0d7907 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:14.128085 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b339cf38-bb78-43f3-8bb0-f45f1b0d7907 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:14.128940 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b339cf38-bb78-43f3-8bb0-f45f1b0d7907 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:14.129443 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b339cf38-bb78-43f3-8bb0-f45f1b0d7907 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:14.188756 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-10c61235-1150-468b-a5a2-f93080293969 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:14.198225 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-10c61235-1150-468b-a5a2-f93080293969 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1238 microversion: 2.1 time: 0.104175 Jun 10 18:01:14.209365 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 600/1242] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:14 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1238 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:14.319035 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d2198561-bc12-428f-a3ed-2ee82f3f73db tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:14.320638 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d2198561-bc12-428f-a3ed-2ee82f3f73db tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:14.327606 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b339cf38-bb78-43f3-8bb0-f45f1b0d7907 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:14.328513 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d2198561-bc12-428f-a3ed-2ee82f3f73db tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:14.329292 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d2198561-bc12-428f-a3ed-2ee82f3f73db tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:14.332102 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d2198561-bc12-428f-a3ed-2ee82f3f73db tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:14.332829 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d2198561-bc12-428f-a3ed-2ee82f3f73db tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:14.336663 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b339cf38-bb78-43f3-8bb0-f45f1b0d7907 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1470 microversion: 2.1 time: 0.235572 Jun 10 18:01:14.357405 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 643/1243] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:14 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1470 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:14.491037 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-269a45db-4f13-4d36-9ded-388cd38c47a6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:14.500444 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-269a45db-4f13-4d36-9ded-388cd38c47a6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:14.507620 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-269a45db-4f13-4d36-9ded-388cd38c47a6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:14.508360 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-269a45db-4f13-4d36-9ded-388cd38c47a6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:14.509779 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-269a45db-4f13-4d36-9ded-388cd38c47a6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:14.510909 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-269a45db-4f13-4d36-9ded-388cd38c47a6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:14.556840 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d2198561-bc12-428f-a3ed-2ee82f3f73db tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:14.567113 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d2198561-bc12-428f-a3ed-2ee82f3f73db tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1311 microversion: 2.1 time: 0.252769 Jun 10 18:01:14.567709 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 601/1244] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:14 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1311 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:01:14.658887 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-269a45db-4f13-4d36-9ded-388cd38c47a6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:14.668349 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-269a45db-4f13-4d36-9ded-388cd38c47a6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1521 microversion: 2.1 time: 0.181237 Jun 10 18:01:14.668906 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 644/1245] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:14 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:01:15.098478 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8060540d-58b9-4bb6-b2ab-82ce85eaa04e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:15.102275 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8060540d-58b9-4bb6-b2ab-82ce85eaa04e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:15.106552 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8060540d-58b9-4bb6-b2ab-82ce85eaa04e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:15.107208 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8060540d-58b9-4bb6-b2ab-82ce85eaa04e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:15.108126 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8060540d-58b9-4bb6-b2ab-82ce85eaa04e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:15.108665 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8060540d-58b9-4bb6-b2ab-82ce85eaa04e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:15.112581 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5dbd6ceb-8673-43b3-8bae-b6a822958962 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:15.113293 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5dbd6ceb-8673-43b3-8bae-b6a822958962 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f5230492-7afa-4202-82ed-1df1cacd2605] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:15.128559 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5dbd6ceb-8673-43b3-8bae-b6a822958962 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:15.128559 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5dbd6ceb-8673-43b3-8bae-b6a822958962 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:15.128559 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5dbd6ceb-8673-43b3-8bae-b6a822958962 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:15.128559 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5dbd6ceb-8673-43b3-8bae-b6a822958962 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:15.140701 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:01:15.268249 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5dbd6ceb-8673-43b3-8bae-b6a822958962 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:15.276633 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5dbd6ceb-8673-43b3-8bae-b6a822958962 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:15.278300 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5dbd6ceb-8673-43b3-8bae-b6a822958962 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:15.281444 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5dbd6ceb-8673-43b3-8bae-b6a822958962 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605" status: 200 len: 1568 microversion: 2.25 time: 0.172940 Jun 10 18:01:15.282280 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 645/1246] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:01:15 2022] GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:01:15.287829 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-854c318e-d7d3-405a-a1e3-e25fc4d80195 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:15.288591 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-854c318e-d7d3-405a-a1e3-e25fc4d80195 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:15.294926 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-854c318e-d7d3-405a-a1e3-e25fc4d80195 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:15.296009 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-854c318e-d7d3-405a-a1e3-e25fc4d80195 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:15.300648 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-854c318e-d7d3-405a-a1e3-e25fc4d80195 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:15.300648 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-854c318e-d7d3-405a-a1e3-e25fc4d80195 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:15.354998 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8060540d-58b9-4bb6-b2ab-82ce85eaa04e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:15.363430 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8060540d-58b9-4bb6-b2ab-82ce85eaa04e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1476 microversion: 2.1 time: 0.269042 Jun 10 18:01:15.364240 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 602/1247] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:15 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1476 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:15.379276 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-86bfb9df-4e01-44ae-88fb-a96e360759de tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:15.380093 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-86bfb9df-4e01-44ae-88fb-a96e360759de tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:15.384274 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-854c318e-d7d3-405a-a1e3-e25fc4d80195 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:15.388913 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-86bfb9df-4e01-44ae-88fb-a96e360759de tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:15.388913 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-86bfb9df-4e01-44ae-88fb-a96e360759de tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:15.389429 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-86bfb9df-4e01-44ae-88fb-a96e360759de tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:15.390030 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-86bfb9df-4e01-44ae-88fb-a96e360759de tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:15.401238 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-854c318e-d7d3-405a-a1e3-e25fc4d80195 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1234 microversion: 2.1 time: 0.117079 Jun 10 18:01:15.403685 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 646/1248] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:15 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1234 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:15.583316 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a417d545-c9cc-4b3c-a0ef-673e1c71535a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:15.584386 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a417d545-c9cc-4b3c-a0ef-673e1c71535a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:15.592220 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a417d545-c9cc-4b3c-a0ef-673e1c71535a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:15.592831 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a417d545-c9cc-4b3c-a0ef-673e1c71535a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:15.595589 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a417d545-c9cc-4b3c-a0ef-673e1c71535a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:15.595589 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a417d545-c9cc-4b3c-a0ef-673e1c71535a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:15.608818 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-86bfb9df-4e01-44ae-88fb-a96e360759de tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:15.612206 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:01:15.618617 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-86bfb9df-4e01-44ae-88fb-a96e360759de tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1470 microversion: 2.1 time: 0.243279 Jun 10 18:01:15.619496 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 603/1249] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:15 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1470 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:15.685201 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3d126121-f9b0-4e6f-b4fb-d371606cff1b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:15.686869 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3d126121-f9b0-4e6f-b4fb-d371606cff1b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:15.694148 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3d126121-f9b0-4e6f-b4fb-d371606cff1b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:15.694923 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3d126121-f9b0-4e6f-b4fb-d371606cff1b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:15.696106 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3d126121-f9b0-4e6f-b4fb-d371606cff1b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:15.696771 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3d126121-f9b0-4e6f-b4fb-d371606cff1b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:15.745833 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a417d545-c9cc-4b3c-a0ef-673e1c71535a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:15.753740 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a417d545-c9cc-4b3c-a0ef-673e1c71535a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1311 microversion: 2.1 time: 0.174565 Jun 10 18:01:15.754318 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 647/1250] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:15 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1311 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:01:15.932910 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3d126121-f9b0-4e6f-b4fb-d371606cff1b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:15.948971 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3d126121-f9b0-4e6f-b4fb-d371606cff1b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1521 microversion: 2.1 time: 0.264497 Jun 10 18:01:15.948971 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 604/1251] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:15 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:01:16.138652 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-e5ef5c0c-3755-4791-b8fe-9070949d2657 req-bb0c1efd-da98-48f3-82d8-29d6e30f33f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e0a785e-3a8a-466c-bcd0-c21ecf5c30be", "name": "network-vif-unplugged", "status": "completed", "tag": "24714ded-ea47-4891-9cd5-75d3ab6c0a9c"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:16.148771 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-e5ef5c0c-3755-4791-b8fe-9070949d2657 req-bb0c1efd-da98-48f3-82d8-29d6e30f33f6 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:16.149599 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-e5ef5c0c-3755-4791-b8fe-9070949d2657 req-bb0c1efd-da98-48f3-82d8-29d6e30f33f6 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:16.163840 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-e5ef5c0c-3755-4791-b8fe-9070949d2657 req-bb0c1efd-da98-48f3-82d8-29d6e30f33f6 service nova] Creating event network-vif-unplugged:24714ded-ea47-4891-9cd5-75d3ab6c0a9c for instance 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be on chh2-master-2 Jun 10 18:01:16.169338 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-e5ef5c0c-3755-4791-b8fe-9070949d2657 req-bb0c1efd-da98-48f3-82d8-29d6e30f33f6 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035532 Jun 10 18:01:16.169952 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 648/1252] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:01:16.304822 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-df12058c-053f-4eaa-bee8-e3a15ca4163c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:16.305752 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-df12058c-053f-4eaa-bee8-e3a15ca4163c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f5230492-7afa-4202-82ed-1df1cacd2605] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:16.323962 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-df12058c-053f-4eaa-bee8-e3a15ca4163c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:16.325900 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-df12058c-053f-4eaa-bee8-e3a15ca4163c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:16.328121 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-df12058c-053f-4eaa-bee8-e3a15ca4163c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:16.328919 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-df12058c-053f-4eaa-bee8-e3a15ca4163c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:16.383605 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c504267c-4232-4fc4-b34b-d18c199794be tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:16.384735 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c504267c-4232-4fc4-b34b-d18c199794be tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:16.395469 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c504267c-4232-4fc4-b34b-d18c199794be tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:16.395935 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c504267c-4232-4fc4-b34b-d18c199794be tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:16.396912 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c504267c-4232-4fc4-b34b-d18c199794be tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:16.397516 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c504267c-4232-4fc4-b34b-d18c199794be tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:16.643966 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-df12058c-053f-4eaa-bee8-e3a15ca4163c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:16.652930 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-df12058c-053f-4eaa-bee8-e3a15ca4163c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:16.654680 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-df12058c-053f-4eaa-bee8-e3a15ca4163c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:16.655988 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-df12058c-053f-4eaa-bee8-e3a15ca4163c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605" status: 200 len: 1568 microversion: 2.25 time: 0.359838 Jun 10 18:01:16.657145 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 605/1253] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:01:16 2022] GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605 => generated 1568 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:01:16.660384 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c504267c-4232-4fc4-b34b-d18c199794be tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:16.664364 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1adfc74b-dbbe-4b20-b221-a9ed44b6b554 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:16.665301 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1adfc74b-dbbe-4b20-b221-a9ed44b6b554 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:16.671865 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1adfc74b-dbbe-4b20-b221-a9ed44b6b554 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:16.672575 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1adfc74b-dbbe-4b20-b221-a9ed44b6b554 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:16.673166 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c504267c-4232-4fc4-b34b-d18c199794be tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1476 microversion: 2.1 time: 0.295878 Jun 10 18:01:16.673758 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 649/1254] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:16 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1476 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:16.674025 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1adfc74b-dbbe-4b20-b221-a9ed44b6b554 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:16.674818 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1adfc74b-dbbe-4b20-b221-a9ed44b6b554 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:16.678375 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-72243506-ecbb-46b7-b7d0-ecd091d5e3ef tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:16.678987 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-72243506-ecbb-46b7-b7d0-ecd091d5e3ef tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:16.692060 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72243506-ecbb-46b7-b7d0-ecd091d5e3ef tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:16.692060 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72243506-ecbb-46b7-b7d0-ecd091d5e3ef tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:16.692060 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72243506-ecbb-46b7-b7d0-ecd091d5e3ef tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:16.692476 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72243506-ecbb-46b7-b7d0-ecd091d5e3ef tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:16.793295 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1adfc74b-dbbe-4b20-b221-a9ed44b6b554 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:16.801830 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1adfc74b-dbbe-4b20-b221-a9ed44b6b554 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1296 microversion: 2.1 time: 0.143116 Jun 10 18:01:16.802776 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 606/1255] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:16 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1296 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:16.807642 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8f1b51d4-0d74-4606-93b6-a6db6c5227b6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:16.808998 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8f1b51d4-0d74-4606-93b6-a6db6c5227b6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:16.821802 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8f1b51d4-0d74-4606-93b6-a6db6c5227b6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:16.822461 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8f1b51d4-0d74-4606-93b6-a6db6c5227b6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:16.823404 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8f1b51d4-0d74-4606-93b6-a6db6c5227b6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:16.823987 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8f1b51d4-0d74-4606-93b6-a6db6c5227b6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:16.934277 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-72243506-ecbb-46b7-b7d0-ecd091d5e3ef tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:16.944196 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-72243506-ecbb-46b7-b7d0-ecd091d5e3ef tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1470 microversion: 2.1 time: 0.269019 Jun 10 18:01:16.951001 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 650/1256] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:16 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1470 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:16.964120 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9fdcd9a0-a130-4752-a407-307e393f45d2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:16.965144 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9fdcd9a0-a130-4752-a407-307e393f45d2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:16.974335 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9fdcd9a0-a130-4752-a407-307e393f45d2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:16.975181 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9fdcd9a0-a130-4752-a407-307e393f45d2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:16.975976 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9fdcd9a0-a130-4752-a407-307e393f45d2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:16.976762 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9fdcd9a0-a130-4752-a407-307e393f45d2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:17.098707 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8f1b51d4-0d74-4606-93b6-a6db6c5227b6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:17.110658 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9fdcd9a0-a130-4752-a407-307e393f45d2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:17.114646 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8f1b51d4-0d74-4606-93b6-a6db6c5227b6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1311 microversion: 2.1 time: 0.303400 Jun 10 18:01:17.114646 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 607/1257] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:16 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1311 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:17.119538 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9fdcd9a0-a130-4752-a407-307e393f45d2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1521 microversion: 2.1 time: 0.160267 Jun 10 18:01:17.124419 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 651/1258] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:16 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:17.675999 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-88fac5e0-7937-4b42-9da5-f96c991b0cd6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:17.676663 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-88fac5e0-7937-4b42-9da5-f96c991b0cd6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f5230492-7afa-4202-82ed-1df1cacd2605] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:17.688643 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-88fac5e0-7937-4b42-9da5-f96c991b0cd6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:17.689127 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-88fac5e0-7937-4b42-9da5-f96c991b0cd6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:17.689955 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-88fac5e0-7937-4b42-9da5-f96c991b0cd6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:17.690681 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-88fac5e0-7937-4b42-9da5-f96c991b0cd6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:17.694617 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9035ebb4-3a7a-4d68-8553-0e5fd56e53cc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:17.695769 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9035ebb4-3a7a-4d68-8553-0e5fd56e53cc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:17.705126 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9035ebb4-3a7a-4d68-8553-0e5fd56e53cc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:17.705819 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9035ebb4-3a7a-4d68-8553-0e5fd56e53cc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:17.706771 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9035ebb4-3a7a-4d68-8553-0e5fd56e53cc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:17.707379 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9035ebb4-3a7a-4d68-8553-0e5fd56e53cc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:17.973936 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9035ebb4-3a7a-4d68-8553-0e5fd56e53cc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:17.983038 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9035ebb4-3a7a-4d68-8553-0e5fd56e53cc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1476 microversion: 2.1 time: 0.294090 Jun 10 18:01:17.993462 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 652/1259] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:17 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1476 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:17.994464 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-88fac5e0-7937-4b42-9da5-f96c991b0cd6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:18.004852 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-eb973560-f53d-48cd-b7be-581a6bdbe2a2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:18.005758 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-88fac5e0-7937-4b42-9da5-f96c991b0cd6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:18.006187 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-eb973560-f53d-48cd-b7be-581a6bdbe2a2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:18.008279 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-88fac5e0-7937-4b42-9da5-f96c991b0cd6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:18.011058 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-88fac5e0-7937-4b42-9da5-f96c991b0cd6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605" status: 200 len: 1568 microversion: 2.25 time: 0.340165 Jun 10 18:01:18.012186 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 608/1260] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:01:17 2022] GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605 => generated 1568 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:01:18.015529 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eb973560-f53d-48cd-b7be-581a6bdbe2a2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:18.015990 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eb973560-f53d-48cd-b7be-581a6bdbe2a2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:18.016837 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eb973560-f53d-48cd-b7be-581a6bdbe2a2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:18.017452 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eb973560-f53d-48cd-b7be-581a6bdbe2a2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:18.019534 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-29a55ef9-6116-4923-bb24-0fd04597447e tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:18.020849 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-29a55ef9-6116-4923-bb24-0fd04597447e tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:18.030149 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-29a55ef9-6116-4923-bb24-0fd04597447e tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:18.030889 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-29a55ef9-6116-4923-bb24-0fd04597447e tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:18.032562 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-29a55ef9-6116-4923-bb24-0fd04597447e tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:18.033441 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-29a55ef9-6116-4923-bb24-0fd04597447e tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:18.197196 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-eb973560-f53d-48cd-b7be-581a6bdbe2a2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:18.207229 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-eb973560-f53d-48cd-b7be-581a6bdbe2a2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1363 microversion: 2.1 time: 0.212272 Jun 10 18:01:18.207724 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 653/1261] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:17 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:18.212214 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f46252c9-c921-4b3d-9b6e-ff44c36b49bd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:18.212845 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f46252c9-c921-4b3d-9b6e-ff44c36b49bd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:18.219822 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f46252c9-c921-4b3d-9b6e-ff44c36b49bd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:18.220331 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f46252c9-c921-4b3d-9b6e-ff44c36b49bd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:18.221114 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f46252c9-c921-4b3d-9b6e-ff44c36b49bd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:18.221555 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f46252c9-c921-4b3d-9b6e-ff44c36b49bd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:18.282325 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-29a55ef9-6116-4923-bb24-0fd04597447e tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:18.291702 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-29a55ef9-6116-4923-bb24-0fd04597447e tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1470 microversion: 2.1 time: 0.277975 Jun 10 18:01:18.302727 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 609/1262] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:18 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1470 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:18.307769 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c5ba5f86-9a79-4a91-b7b9-7970470476fd tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:18.308407 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c5ba5f86-9a79-4a91-b7b9-7970470476fd tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:18.327439 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5ba5f86-9a79-4a91-b7b9-7970470476fd tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:18.336576 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5ba5f86-9a79-4a91-b7b9-7970470476fd tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:18.339996 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5ba5f86-9a79-4a91-b7b9-7970470476fd tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:18.341095 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5ba5f86-9a79-4a91-b7b9-7970470476fd tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:18.520162 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f46252c9-c921-4b3d-9b6e-ff44c36b49bd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:18.530252 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f46252c9-c921-4b3d-9b6e-ff44c36b49bd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1311 microversion: 2.1 time: 0.321423 Jun 10 18:01:18.530850 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 654/1263] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:18 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1311 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:18.545093 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-9d4d1d8e-9879-4d38-89f9-5363b70b3a1b req-61ca50c4-a3fc-46b1-b1de-5e3320e9b837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d", "name": "network-vif-plugged", "status": "completed", "tag": "f0ba52c3-5bcd-42ef-b82a-a280afc864bc"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:18.570402 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-9d4d1d8e-9879-4d38-89f9-5363b70b3a1b req-61ca50c4-a3fc-46b1-b1de-5e3320e9b837 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:18.570855 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-9d4d1d8e-9879-4d38-89f9-5363b70b3a1b req-61ca50c4-a3fc-46b1-b1de-5e3320e9b837 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:18.600721 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-9d4d1d8e-9879-4d38-89f9-5363b70b3a1b req-61ca50c4-a3fc-46b1-b1de-5e3320e9b837 service nova] Creating event network-vif-plugged:f0ba52c3-5bcd-42ef-b82a-a280afc864bc for instance a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d on chh1-master-2 Jun 10 18:01:18.611535 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-9d4d1d8e-9879-4d38-89f9-5363b70b3a1b req-61ca50c4-a3fc-46b1-b1de-5e3320e9b837 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079458 Jun 10 18:01:18.615652 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 655/1264] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:01:18.707166 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c5ba5f86-9a79-4a91-b7b9-7970470476fd tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:18.719602 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c5ba5f86-9a79-4a91-b7b9-7970470476fd tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1521 microversion: 2.1 time: 0.415002 Jun 10 18:01:18.720199 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 610/1265] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:18 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1521 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:18.876104 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-f3f4205b-903f-4f0c-8651-c29da6b055e6 req-5fbbb8e2-d1d3-4c6f-b731-e34170896afc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "186b67b3-3538-4bc2-8528-53b43d701bf1", "tag": "128ee4eb-e784-41c8-acaa-39291810b2a4"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:18.886165 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-f3f4205b-903f-4f0c-8651-c29da6b055e6 req-5fbbb8e2-d1d3-4c6f-b731-e34170896afc service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:18.890828 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-f3f4205b-903f-4f0c-8651-c29da6b055e6 req-5fbbb8e2-d1d3-4c6f-b731-e34170896afc service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:18.898567 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-f3f4205b-903f-4f0c-8651-c29da6b055e6 req-5fbbb8e2-d1d3-4c6f-b731-e34170896afc service nova] Creating event network-changed:128ee4eb-e784-41c8-acaa-39291810b2a4 for instance 186b67b3-3538-4bc2-8528-53b43d701bf1 on chh1-master-2 Jun 10 18:01:18.903551 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-f3f4205b-903f-4f0c-8651-c29da6b055e6 req-5fbbb8e2-d1d3-4c6f-b731-e34170896afc service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032369 Jun 10 18:01:18.904162 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 656/1266] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:01:18.999717 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f13f5096-851b-4c64-a40f-93bbcc4cda1f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:19.000368 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f13f5096-851b-4c64-a40f-93bbcc4cda1f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:19.007470 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f13f5096-851b-4c64-a40f-93bbcc4cda1f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:19.008760 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f13f5096-851b-4c64-a40f-93bbcc4cda1f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:19.009590 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f13f5096-851b-4c64-a40f-93bbcc4cda1f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:19.010046 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f13f5096-851b-4c64-a40f-93bbcc4cda1f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:19.033200 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-02a08701-00ed-44c4-8e88-2ba80fb6ac82 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:19.034373 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-02a08701-00ed-44c4-8e88-2ba80fb6ac82 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f5230492-7afa-4202-82ed-1df1cacd2605] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:19.047904 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02a08701-00ed-44c4-8e88-2ba80fb6ac82 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:19.048884 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02a08701-00ed-44c4-8e88-2ba80fb6ac82 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:19.050078 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02a08701-00ed-44c4-8e88-2ba80fb6ac82 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:19.050711 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02a08701-00ed-44c4-8e88-2ba80fb6ac82 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:19.175920 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f13f5096-851b-4c64-a40f-93bbcc4cda1f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:19.183942 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f13f5096-851b-4c64-a40f-93bbcc4cda1f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1476 microversion: 2.1 time: 0.187882 Jun 10 18:01:19.185230 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 611/1267] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:18 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1476 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:19.224853 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e8ff2f71-4797-45f8-9f77-0ab5a2bc7bda tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:19.225486 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e8ff2f71-4797-45f8-9f77-0ab5a2bc7bda tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:19.231543 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e8ff2f71-4797-45f8-9f77-0ab5a2bc7bda tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:19.231993 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e8ff2f71-4797-45f8-9f77-0ab5a2bc7bda tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:19.232854 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e8ff2f71-4797-45f8-9f77-0ab5a2bc7bda tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:19.233294 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e8ff2f71-4797-45f8-9f77-0ab5a2bc7bda tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:19.274635 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-02a08701-00ed-44c4-8e88-2ba80fb6ac82 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:19.286083 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-02a08701-00ed-44c4-8e88-2ba80fb6ac82 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:19.287916 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-02a08701-00ed-44c4-8e88-2ba80fb6ac82 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:19.289346 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-02a08701-00ed-44c4-8e88-2ba80fb6ac82 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605" status: 200 len: 1543 microversion: 2.25 time: 0.263764 Jun 10 18:01:19.289948 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 657/1268] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:01:19 2022] GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605 => generated 1543 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:01:19.306526 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e5c0bc2d-31d1-4334-8d04-2e64e95f4215 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Calling method '.version_select at 0x7f77c1232280>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:19.308933 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e5c0bc2d-31d1-4334-8d04-2e64e95f4215 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:19.309385 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e5c0bc2d-31d1-4334-8d04-2e64e95f4215 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:19.320000 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e5c0bc2d-31d1-4334-8d04-2e64e95f4215 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] 10.222.0.35 "GET /compute/v2.1/os-migrations" status: 200 len: 2785 microversion: 2.25 time: 0.017231 Jun 10 18:01:19.320855 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 658/1269] 10.222.0.35 () {60 vars in 1183 bytes} [Fri Jun 10 18:01:19 2022] GET /compute/v2.1/os-migrations => generated 2785 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:01:19.327387 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1e5e6097-456f-44fd-8270-6aed9349ca5f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:19.328268 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1e5e6097-456f-44fd-8270-6aed9349ca5f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:19.334531 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1e5e6097-456f-44fd-8270-6aed9349ca5f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:19.337210 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1e5e6097-456f-44fd-8270-6aed9349ca5f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:19.337210 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1e5e6097-456f-44fd-8270-6aed9349ca5f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:19.337210 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1e5e6097-456f-44fd-8270-6aed9349ca5f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:19.372177 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e8ff2f71-4797-45f8-9f77-0ab5a2bc7bda tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:19.379838 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e8ff2f71-4797-45f8-9f77-0ab5a2bc7bda tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1363 microversion: 2.1 time: 0.159110 Jun 10 18:01:19.380429 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 612/1270] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:19 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:01:19.384793 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6545ef5c-4406-48c6-8629-0c5f083480be tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:19.385688 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6545ef5c-4406-48c6-8629-0c5f083480be tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] [instance: f5230492-7afa-4202-82ed-1df1cacd2605] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:19.392052 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6545ef5c-4406-48c6-8629-0c5f083480be tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:19.392788 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6545ef5c-4406-48c6-8629-0c5f083480be tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:19.393640 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6545ef5c-4406-48c6-8629-0c5f083480be tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:19.394148 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6545ef5c-4406-48c6-8629-0c5f083480be tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:19.494958 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1e5e6097-456f-44fd-8270-6aed9349ca5f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:19.503161 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1e5e6097-456f-44fd-8270-6aed9349ca5f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1470 microversion: 2.1 time: 0.181070 Jun 10 18:01:19.503746 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 659/1271] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:19 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1470 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:19.533930 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-6545ef5c-4406-48c6-8629-0c5f083480be tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lazy-loading 'services' on Instance uuid f5230492-7afa-4202-82ed-1df1cacd2605 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:01:19.547118 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-55cd897b-00c4-418d-8c1b-c8207fe089dd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:19.547892 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-55cd897b-00c4-418d-8c1b-c8207fe089dd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:19.556631 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6545ef5c-4406-48c6-8629-0c5f083480be tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605" status: 200 len: 2036 microversion: 2.25 time: 0.175130 Jun 10 18:01:19.557221 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 613/1272] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:01:19 2022] GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605 => generated 2036 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:01:19.569990 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-55cd897b-00c4-418d-8c1b-c8207fe089dd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:19.570754 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-55cd897b-00c4-418d-8c1b-c8207fe089dd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:19.572839 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-55cd897b-00c4-418d-8c1b-c8207fe089dd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:19.574291 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-55cd897b-00c4-418d-8c1b-c8207fe089dd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:19.696072 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a6f70dc5-5db1-40a3-a06d-0bce0742bd91 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-732160755", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "abaf7ab8-f0d7-4db9-bc12-3e0ab0d7e41a"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:19.750176 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-a6f70dc5-5db1-40a3-a06d-0bce0742bd91 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] validate_networks() for [('abaf7ab8-f0d7-4db9-bc12-3e0ab0d7e41a', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:01:19.757419 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-55cd897b-00c4-418d-8c1b-c8207fe089dd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:19.771502 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-55cd897b-00c4-418d-8c1b-c8207fe089dd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1311 microversion: 2.1 time: 0.228298 Jun 10 18:01:19.780625 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 660/1273] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:19 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1311 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:01:19.780625 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-50d17dfc-b8c2-4254-85f0-18287db23eb8 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:19.780625 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-50d17dfc-b8c2-4254-85f0-18287db23eb8 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:19.794546 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-50d17dfc-b8c2-4254-85f0-18287db23eb8 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:19.795271 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-50d17dfc-b8c2-4254-85f0-18287db23eb8 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:19.796936 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-50d17dfc-b8c2-4254-85f0-18287db23eb8 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:19.797560 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-50d17dfc-b8c2-4254-85f0-18287db23eb8 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:20.010308 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-50d17dfc-b8c2-4254-85f0-18287db23eb8 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:20.027648 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-50d17dfc-b8c2-4254-85f0-18287db23eb8 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1521 microversion: 2.1 time: 0.248193 Jun 10 18:01:20.027648 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 661/1274] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:19 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:20.203134 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4033d15a-84ea-4dea-8813-2638a0e0ad47 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:20.203747 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4033d15a-84ea-4dea-8813-2638a0e0ad47 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:20.209840 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4033d15a-84ea-4dea-8813-2638a0e0ad47 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:20.210610 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4033d15a-84ea-4dea-8813-2638a0e0ad47 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:20.211613 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4033d15a-84ea-4dea-8813-2638a0e0ad47 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:20.212286 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4033d15a-84ea-4dea-8813-2638a0e0ad47 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:20.232031 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-a6f70dc5-5db1-40a3-a06d-0bce0742bd91 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:01:20.232506 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-a6f70dc5-5db1-40a3-a06d-0bce0742bd91 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:01:20.233613 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-a6f70dc5-5db1-40a3-a06d-0bce0742bd91 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:01:20.235052 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-a6f70dc5-5db1-40a3-a06d-0bce0742bd91 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:01:20.236079 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-a6f70dc5-5db1-40a3-a06d-0bce0742bd91 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:01:20.241292 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:01:20.248565 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a6f70dc5-5db1-40a3-a06d-0bce0742bd91 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:20.249965 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a6f70dc5-5db1-40a3-a06d-0bce0742bd91 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:20.250368 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a6f70dc5-5db1-40a3-a06d-0bce0742bd91 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:20.250909 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a6f70dc5-5db1-40a3-a06d-0bce0742bd91 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:20.268017 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-a6f70dc5-5db1-40a3-a06d-0bce0742bd91 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Getting quotas for project 01ee7bcfe44746fda89fda904f81e1b9. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:01:20.273384 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-a6f70dc5-5db1-40a3-a06d-0bce0742bd91 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Getting quotas for user d4967895f6f041058ef60cee35a3659c and project 01ee7bcfe44746fda89fda904f81e1b9. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:01:20.286112 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a6f70dc5-5db1-40a3-a06d-0bce0742bd91 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:01:20.288288 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a6f70dc5-5db1-40a3-a06d-0bce0742bd91 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:01:20.352828 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4033d15a-84ea-4dea-8813-2638a0e0ad47 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:20.361249 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4033d15a-84ea-4dea-8813-2638a0e0ad47 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1476 microversion: 2.1 time: 0.162019 Jun 10 18:01:20.361842 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 662/1275] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:20 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1476 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:01:20.396602 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7a2ac4c1-d099-4336-ad20-f192c213067c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:20.397328 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7a2ac4c1-d099-4336-ad20-f192c213067c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:20.403699 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7a2ac4c1-d099-4336-ad20-f192c213067c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:20.404420 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7a2ac4c1-d099-4336-ad20-f192c213067c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:20.405512 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7a2ac4c1-d099-4336-ad20-f192c213067c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:20.405963 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7a2ac4c1-d099-4336-ad20-f192c213067c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:20.439314 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a6f70dc5-5db1-40a3-a06d-0bce0742bd91 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.747058 Jun 10 18:01:20.440570 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 614/1276] 10.222.0.35 () {62 vars in 1187 bytes} [Fri Jun 10 18:01:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 10 18:01:20.451145 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-dd6671cc-bc17-48c8-8ea1-04f7c59b7200 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:20.452121 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-dd6671cc-bc17-48c8-8ea1-04f7c59b7200 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:20.553002 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-dd6671cc-bc17-48c8-8ea1-04f7c59b7200 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:20.562334 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-dd6671cc-bc17-48c8-8ea1-04f7c59b7200 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:20.564918 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-dd6671cc-bc17-48c8-8ea1-04f7c59b7200 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:20.566529 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-dd6671cc-bc17-48c8-8ea1-04f7c59b7200 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1261 microversion: 2.25 time: 0.120271 Jun 10 18:01:20.567638 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 615/1277] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:01:20 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1261 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:01:20.573483 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-de6726e4-1ceb-4b43-84ed-c091e956e5a9 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:20.574344 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-de6726e4-1ceb-4b43-84ed-c091e956e5a9 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:20.586109 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-de6726e4-1ceb-4b43-84ed-c091e956e5a9 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:20.586109 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-de6726e4-1ceb-4b43-84ed-c091e956e5a9 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:20.586109 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-de6726e4-1ceb-4b43-84ed-c091e956e5a9 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:20.586808 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-de6726e4-1ceb-4b43-84ed-c091e956e5a9 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:20.819797 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7a2ac4c1-d099-4336-ad20-f192c213067c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:20.830838 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-de6726e4-1ceb-4b43-84ed-c091e956e5a9 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:20.846578 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7a2ac4c1-d099-4336-ad20-f192c213067c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1363 microversion: 2.1 time: 0.453726 Jun 10 18:01:20.855122 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-de6726e4-1ceb-4b43-84ed-c091e956e5a9 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1470 microversion: 2.1 time: 0.285557 Jun 10 18:01:20.857642 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 663/1278] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:20 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1363 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:01:20.866745 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 616/1279] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:20 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1470 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:20.867776 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c2b5bed2-d4f3-40ac-8f22-102ade87d7a9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:20.868969 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c2b5bed2-d4f3-40ac-8f22-102ade87d7a9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:20.881162 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c2b5bed2-d4f3-40ac-8f22-102ade87d7a9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:20.883247 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c2b5bed2-d4f3-40ac-8f22-102ade87d7a9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:20.883247 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c2b5bed2-d4f3-40ac-8f22-102ade87d7a9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:20.883247 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c2b5bed2-d4f3-40ac-8f22-102ade87d7a9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:21.038833 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a91ab43e-6fa4-4131-962b-6a1d699da4c5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:21.039570 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a91ab43e-6fa4-4131-962b-6a1d699da4c5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:21.046125 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a91ab43e-6fa4-4131-962b-6a1d699da4c5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:21.046668 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a91ab43e-6fa4-4131-962b-6a1d699da4c5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:21.047513 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a91ab43e-6fa4-4131-962b-6a1d699da4c5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:21.048502 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a91ab43e-6fa4-4131-962b-6a1d699da4c5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:21.108011 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c2b5bed2-d4f3-40ac-8f22-102ade87d7a9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:21.125394 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c2b5bed2-d4f3-40ac-8f22-102ade87d7a9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1493 microversion: 2.1 time: 0.266319 Jun 10 18:01:21.126847 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 664/1280] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:20 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1493 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:21.144519 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cd2a830a-fd70-42bc-b6d3-6c69db782a90 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:21.145196 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cd2a830a-fd70-42bc-b6d3-6c69db782a90 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:21.151718 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd2a830a-fd70-42bc-b6d3-6c69db782a90 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:21.152187 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd2a830a-fd70-42bc-b6d3-6c69db782a90 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:21.153026 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd2a830a-fd70-42bc-b6d3-6c69db782a90 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:21.153465 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd2a830a-fd70-42bc-b6d3-6c69db782a90 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:21.289594 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cd2a830a-fd70-42bc-b6d3-6c69db782a90 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1644 microversion: 2.1 time: 0.147445 Jun 10 18:01:21.289594 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 665/1281] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:21 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1644 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:01:21.305800 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2bee5ec5-9a88-4007-b7a7-6b8c49cf1543 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:21.307518 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:01:21.307518 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 18:01:21.309143 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2bee5ec5-9a88-4007-b7a7-6b8c49cf1543 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:21.309775 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2bee5ec5-9a88-4007-b7a7-6b8c49cf1543 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:21.311018 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2bee5ec5-9a88-4007-b7a7-6b8c49cf1543 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:21.312130 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2bee5ec5-9a88-4007-b7a7-6b8c49cf1543 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:21.342901 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2bee5ec5-9a88-4007-b7a7-6b8c49cf1543 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] 10.222.0.35 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.041615 Jun 10 18:01:21.348551 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 666/1282] 10.222.0.35 () {58 vars in 1175 bytes} [Fri Jun 10 18:01:21 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:01:21.381442 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2f6b484c-eb71-479e-9d3d-1c9e97ab1a3e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:21.381949 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2f6b484c-eb71-479e-9d3d-1c9e97ab1a3e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:21.390475 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2f6b484c-eb71-479e-9d3d-1c9e97ab1a3e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:21.391000 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2f6b484c-eb71-479e-9d3d-1c9e97ab1a3e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:21.391866 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2f6b484c-eb71-479e-9d3d-1c9e97ab1a3e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:21.392402 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2f6b484c-eb71-479e-9d3d-1c9e97ab1a3e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:21.416799 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:01:21.530897 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a91ab43e-6fa4-4131-962b-6a1d699da4c5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:21.538858 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a91ab43e-6fa4-4131-962b-6a1d699da4c5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1521 microversion: 2.1 time: 0.504088 Jun 10 18:01:21.539788 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 617/1283] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:21 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1521 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:01:21.576186 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2f6b484c-eb71-479e-9d3d-1c9e97ab1a3e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:21.585148 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2f6b484c-eb71-479e-9d3d-1c9e97ab1a3e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1476 microversion: 2.1 time: 0.209008 Jun 10 18:01:21.585463 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-08790a26-8b73-4fc0-be62-db90c3a7afde tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:21.586487 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 667/1284] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:21 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1476 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:21.586627 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-08790a26-8b73-4fc0-be62-db90c3a7afde tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:21.648076 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-08790a26-8b73-4fc0-be62-db90c3a7afde tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:21.655433 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-08790a26-8b73-4fc0-be62-db90c3a7afde tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:21.657613 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-08790a26-8b73-4fc0-be62-db90c3a7afde tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:21.658737 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-08790a26-8b73-4fc0-be62-db90c3a7afde tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1261 microversion: 2.25 time: 0.077538 Jun 10 18:01:21.659298 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 618/1285] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:01:21 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1261 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:01:21.871314 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-de4dd685-83c7-4af3-9fe0-7f388a08c94c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:21.872164 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-de4dd685-83c7-4af3-9fe0-7f388a08c94c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:21.874644 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3307474e-a792-4ac8-86b3-05f9dbf43cfb tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:21.875631 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3307474e-a792-4ac8-86b3-05f9dbf43cfb tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:21.880619 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de4dd685-83c7-4af3-9fe0-7f388a08c94c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:21.881344 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de4dd685-83c7-4af3-9fe0-7f388a08c94c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:21.882525 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de4dd685-83c7-4af3-9fe0-7f388a08c94c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:21.883755 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3307474e-a792-4ac8-86b3-05f9dbf43cfb tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:21.884003 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de4dd685-83c7-4af3-9fe0-7f388a08c94c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:21.884290 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3307474e-a792-4ac8-86b3-05f9dbf43cfb tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:21.885102 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3307474e-a792-4ac8-86b3-05f9dbf43cfb tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:21.885573 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3307474e-a792-4ac8-86b3-05f9dbf43cfb tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:22.041651 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3307474e-a792-4ac8-86b3-05f9dbf43cfb tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:22.051149 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3307474e-a792-4ac8-86b3-05f9dbf43cfb tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1470 microversion: 2.1 time: 0.182362 Jun 10 18:01:22.051867 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 619/1286] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:21 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1470 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:01:22.069834 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-de4dd685-83c7-4af3-9fe0-7f388a08c94c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:22.078077 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-de4dd685-83c7-4af3-9fe0-7f388a08c94c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1363 microversion: 2.1 time: 0.216937 Jun 10 18:01:22.079018 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 668/1287] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:21 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:22.467896 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-4b2d8393-038f-4b9c-8779-6251c8c19207 req-78739808-f143-4a27-b970-1f6a229bdbd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e0a785e-3a8a-466c-bcd0-c21ecf5c30be", "name": "network-vif-plugged", "status": "completed", "tag": "24714ded-ea47-4891-9cd5-75d3ab6c0a9c"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:22.477037 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-4b2d8393-038f-4b9c-8779-6251c8c19207 req-78739808-f143-4a27-b970-1f6a229bdbd6 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:22.477493 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-4b2d8393-038f-4b9c-8779-6251c8c19207 req-78739808-f143-4a27-b970-1f6a229bdbd6 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:22.489552 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-4b2d8393-038f-4b9c-8779-6251c8c19207 req-78739808-f143-4a27-b970-1f6a229bdbd6 service nova] Creating event network-vif-plugged:24714ded-ea47-4891-9cd5-75d3ab6c0a9c for instance 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be on chh2-master-2 Jun 10 18:01:22.498071 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-4b2d8393-038f-4b9c-8779-6251c8c19207 req-78739808-f143-4a27-b970-1f6a229bdbd6 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034209 Jun 10 18:01:22.499491 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 620/1288] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:01:22.556634 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cd22c267-3ee0-47e0-ba53-a1970d2b5ed4 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:22.557339 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cd22c267-3ee0-47e0-ba53-a1970d2b5ed4 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:22.564834 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd22c267-3ee0-47e0-ba53-a1970d2b5ed4 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:22.565417 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd22c267-3ee0-47e0-ba53-a1970d2b5ed4 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:22.566274 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd22c267-3ee0-47e0-ba53-a1970d2b5ed4 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:22.568753 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd22c267-3ee0-47e0-ba53-a1970d2b5ed4 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:22.606939 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6735b02a-1fac-42a1-8218-9673650e79b5 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:22.608204 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6735b02a-1fac-42a1-8218-9673650e79b5 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:22.615226 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6735b02a-1fac-42a1-8218-9673650e79b5 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:22.615685 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6735b02a-1fac-42a1-8218-9673650e79b5 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:22.616683 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6735b02a-1fac-42a1-8218-9673650e79b5 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:22.617293 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6735b02a-1fac-42a1-8218-9673650e79b5 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:22.749840 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cd22c267-3ee0-47e0-ba53-a1970d2b5ed4 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:22.758533 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cd22c267-3ee0-47e0-ba53-a1970d2b5ed4 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1521 microversion: 2.1 time: 0.206115 Jun 10 18:01:22.761036 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 669/1289] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:22 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:22.775776 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-754aa1eb-2573-44be-b04f-1a4bbb7cea8d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:22.776537 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-754aa1eb-2573-44be-b04f-1a4bbb7cea8d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:22.791402 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-754aa1eb-2573-44be-b04f-1a4bbb7cea8d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:22.791940 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-754aa1eb-2573-44be-b04f-1a4bbb7cea8d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:22.793149 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-754aa1eb-2573-44be-b04f-1a4bbb7cea8d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:22.793689 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-754aa1eb-2573-44be-b04f-1a4bbb7cea8d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:22.851836 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6735b02a-1fac-42a1-8218-9673650e79b5 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:22.869999 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6735b02a-1fac-42a1-8218-9673650e79b5 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1476 microversion: 2.1 time: 0.267057 Jun 10 18:01:22.871106 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 621/1290] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:22 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1476 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:01:22.888464 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-754aa1eb-2573-44be-b04f-1a4bbb7cea8d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:22.897657 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-754aa1eb-2573-44be-b04f-1a4bbb7cea8d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:22.899208 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-754aa1eb-2573-44be-b04f-1a4bbb7cea8d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:22.900359 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-754aa1eb-2573-44be-b04f-1a4bbb7cea8d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1313 microversion: 2.25 time: 0.138082 Jun 10 18:01:22.901127 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 670/1291] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:01:22 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1313 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:01:23.069088 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a2deb6fe-d025-4cdf-84cb-1628d2b29c4b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:23.070007 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a2deb6fe-d025-4cdf-84cb-1628d2b29c4b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:23.074039 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:01:23.077750 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a2deb6fe-d025-4cdf-84cb-1628d2b29c4b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:23.078389 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a2deb6fe-d025-4cdf-84cb-1628d2b29c4b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:23.079535 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a2deb6fe-d025-4cdf-84cb-1628d2b29c4b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:23.080141 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a2deb6fe-d025-4cdf-84cb-1628d2b29c4b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:23.130948 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ddefdd82-7fab-49d1-9db3-004daf8bb23b tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] Calling method '.version_select at 0x7f77c11cc8b0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:23.132926 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:01:23.132926 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 18:01:23.134718 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ddefdd82-7fab-49d1-9db3-004daf8bb23b tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:23.135349 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ddefdd82-7fab-49d1-9db3-004daf8bb23b tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:23.139527 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ddefdd82-7fab-49d1-9db3-004daf8bb23b tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:23.143177 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ddefdd82-7fab-49d1-9db3-004daf8bb23b tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:23.145766 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:01:23.184752 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ddefdd82-7fab-49d1-9db3-004daf8bb23b tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] 10.222.0.35 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.178661 Jun 10 18:01:23.185510 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 622/1292] 10.222.0.35 () {58 vars in 1127 bytes} [Fri Jun 10 18:01:23 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:01:23.202012 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c11057ec-be8a-4123-a147-a6a7c9624e1a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:23.202726 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c11057ec-be8a-4123-a147-a6a7c9624e1a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:23.209273 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c11057ec-be8a-4123-a147-a6a7c9624e1a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:23.209727 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c11057ec-be8a-4123-a147-a6a7c9624e1a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:23.210595 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c11057ec-be8a-4123-a147-a6a7c9624e1a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:23.211019 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c11057ec-be8a-4123-a147-a6a7c9624e1a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:23.358808 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c11057ec-be8a-4123-a147-a6a7c9624e1a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:23.378799 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c11057ec-be8a-4123-a147-a6a7c9624e1a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1363 microversion: 2.1 time: 0.180544 Jun 10 18:01:23.382681 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 623/1293] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:23 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1363 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:23.408178 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a2deb6fe-d025-4cdf-84cb-1628d2b29c4b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:23.417827 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a2deb6fe-d025-4cdf-84cb-1628d2b29c4b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1470 microversion: 2.1 time: 0.352845 Jun 10 18:01:23.419973 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 671/1294] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:23 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1470 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:01:23.515402 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-32a8ffc5-16fc-4cf6-9f4c-a46eb2389092 tempest-HostsAdminNegativeTestJSON-1873061594 tempest-HostsAdminNegativeTestJSON-1873061594-project] Calling method '.version_select at 0x7f77c1274ee0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:23.516615 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:01:23.516615 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 18:01:23.517688 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-32a8ffc5-16fc-4cf6-9f4c-a46eb2389092 tempest-HostsAdminNegativeTestJSON-1873061594 tempest-HostsAdminNegativeTestJSON-1873061594-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'df6ede10bcf44e1f9aa42bd3e9ddf2e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3dba07d05943f88d1ae7a2103405e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:23.519825 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-32a8ffc5-16fc-4cf6-9f4c-a46eb2389092 tempest-HostsAdminNegativeTestJSON-1873061594 tempest-HostsAdminNegativeTestJSON-1873061594-project] Request method failure captured: Jun 10 18:01:23.519825 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Jun 10 18:01:23.519825 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:01:23.519825 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:01:23.519825 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:01:23.519825 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:01:23.519825 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:01:23.519825 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:01:23.519825 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:01:23.519825 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:01:23.519825 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4bx0_IuvdvEjoxnY51OY8iaYKCIcxo6pboxg61ffRKv2ZefYo7SEiDUicTgwayNeXjxDamLvZhrdqOfZpRpU3qwzcyYKG38p1Zf4EaXSRcbnwD4gAWMLfmRdjlbX6wmt0swxbYm4xL4TOVWvnXaLsp4-Eumg8_KvsT1URkLptNzY2k Jun 10 18:01:23.519825 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:01:23.519825 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:01:23.519825 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:01:23.519825 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:01:23.519825 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:01:23.519825 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:01:23.519825 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 5a3dba07d05943f88d1ae7a2103405e8 Jun 10 18:01:23.519825 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1873061594 Jun 10 18:01:23.519825 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:01:23.519825 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:01:23.521611 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/5a3dba07d05943f88d1ae7a2103405e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/5a3dba07d05943f88d1ae7a2103405e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/5a3dba07d05943f88d1ae7a2103405e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_5a3dba07d05943f88d1ae7a2103405e8", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:01:23.521611 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1873061594 Jun 10 18:01:23.521611 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 5a3dba07d05943f88d1ae7a2103405e8 Jun 10 18:01:23.521611 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1873061594 Jun 10 18:01:23.521611 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-HostsAdminNegativeTestJSON-1873061594-project Jun 10 18:01:23.521611 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:01:23.521611 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:01:23.521611 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: df6ede10bcf44e1f9aa42bd3e9ddf2e2 Jun 10 18:01:23.521611 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1873061594-project Jun 10 18:01:23.521611 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 18:01:23.521611 chdv-master-2 devstack@n-api.service[126594]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jun 10 18:01:23.521611 chdv-master-2 devstack@n-api.service[126594]: action_args: {} Jun 10 18:01:23.521611 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:01:23.522717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:23.522717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:23.522717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:23.522717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:01:23.522717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:01:23.522717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:01:23.522717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:01:23.522717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 10 18:01:23.522717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:01:23.522717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:01:23.522717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:01:23.522717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Jun 10 18:01:23.522717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Jun 10 18:01:23.522717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 10 18:01:23.522717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 10 18:01:23.522717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 10 18:01:23.522717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 10 18:01:23.522717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 18:01:23.522717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 18:01:23.524172 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 18:01:23.524172 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 18:01:23.524172 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 10 18:01:23.524172 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 10 18:01:23.524172 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 10 18:01:23.524172 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 10 18:01:23.524172 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 10 18:01:23.524172 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 10 18:01:23.524172 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jun 10 18:01:23.524172 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.524172 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:01:23.524172 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.524172 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:23.524172 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:23.524172 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:23.524172 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 10 18:01:23.524172 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 10 18:01:23.524172 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jun 10 18:01:23.524172 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.525696 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-32a8ffc5-16fc-4cf6-9f4c-a46eb2389092 tempest-HostsAdminNegativeTestJSON-1873061594 tempest-HostsAdminNegativeTestJSON-1873061594-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:01:23.525696 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-32a8ffc5-16fc-4cf6-9f4c-a46eb2389092 tempest-HostsAdminNegativeTestJSON-1873061594 tempest-HostsAdminNegativeTestJSON-1873061594-project] 10.222.0.35 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.134774 Jun 10 18:01:23.525696 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 624/1295] 10.222.0.35 () {58 vars in 1127 bytes} [Fri Jun 10 18:01:23 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 142 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:01:23.531508 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3f439ca6-cab6-4d72-b0fd-a215be05165d tempest-HostsAdminNegativeTestJSON-1873061594 tempest-HostsAdminNegativeTestJSON-1873061594-project] Calling method '.version_select at 0x7f77c16eea60>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:23.536925 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:01:23.536925 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 18:01:23.536925 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3f439ca6-cab6-4d72-b0fd-a215be05165d tempest-HostsAdminNegativeTestJSON-1873061594 tempest-HostsAdminNegativeTestJSON-1873061594-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'df6ede10bcf44e1f9aa42bd3e9ddf2e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3dba07d05943f88d1ae7a2103405e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:23.536925 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3f439ca6-cab6-4d72-b0fd-a215be05165d tempest-HostsAdminNegativeTestJSON-1873061594 tempest-HostsAdminNegativeTestJSON-1873061594-project] Request method failure captured: Jun 10 18:01:23.536925 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/os-hosts/chdv-master-2/reboot HTTP/1.1 Jun 10 18:01:23.536925 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:01:23.536925 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:01:23.536925 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:01:23.536925 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:01:23.536925 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:01:23.536925 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:01:23.536925 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:01:23.536925 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:01:23.536925 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4bx0_IuvdvEjoxnY51OY8iaYKCIcxo6pboxg61ffRKv2ZefYo7SEiDUicTgwayNeXjxDamLvZhrdqOfZpRpU3qwzcyYKG38p1Zf4EaXSRcbnwD4gAWMLfmRdjlbX6wmt0swxbYm4xL4TOVWvnXaLsp4-Eumg8_KvsT1URkLptNzY2k Jun 10 18:01:23.536925 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:01:23.536925 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:01:23.536925 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:01:23.536925 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:01:23.536925 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:01:23.536925 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:01:23.538591 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 5a3dba07d05943f88d1ae7a2103405e8 Jun 10 18:01:23.538591 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1873061594 Jun 10 18:01:23.538591 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:01:23.538591 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:01:23.538591 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/5a3dba07d05943f88d1ae7a2103405e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/5a3dba07d05943f88d1ae7a2103405e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/5a3dba07d05943f88d1ae7a2103405e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_5a3dba07d05943f88d1ae7a2103405e8", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:01:23.538591 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1873061594 Jun 10 18:01:23.538591 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 5a3dba07d05943f88d1ae7a2103405e8 Jun 10 18:01:23.538591 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1873061594 Jun 10 18:01:23.538591 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-HostsAdminNegativeTestJSON-1873061594-project Jun 10 18:01:23.538591 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:01:23.538591 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:01:23.538591 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: df6ede10bcf44e1f9aa42bd3e9ddf2e2 Jun 10 18:01:23.538591 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1873061594-project Jun 10 18:01:23.538591 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:01:23.538591 chdv-master-2 devstack@n-api.service[126595]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jun 10 18:01:23.539596 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'chdv-master-2'} Jun 10 18:01:23.539596 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:01:23.539596 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:23.539596 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:23.539596 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:23.539596 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:01:23.539596 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:01:23.539596 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:01:23.539596 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:01:23.539596 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:01:23.539596 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:01:23.539596 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Jun 10 18:01:23.539596 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Jun 10 18:01:23.539596 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 10 18:01:23.539596 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 10 18:01:23.539596 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 10 18:01:23.539596 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 10 18:01:23.539596 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 18:01:23.539596 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 18:01:23.539596 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 18:01:23.541047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 18:01:23.541047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 10 18:01:23.541047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 10 18:01:23.541047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 10 18:01:23.541047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 10 18:01:23.541047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 10 18:01:23.541047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 10 18:01:23.541047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jun 10 18:01:23.541047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.541047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:01:23.541047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.541047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:23.541047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:23.541047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:23.541047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 10 18:01:23.541047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 10 18:01:23.541047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jun 10 18:01:23.541047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.542421 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3f439ca6-cab6-4d72-b0fd-a215be05165d tempest-HostsAdminNegativeTestJSON-1873061594 tempest-HostsAdminNegativeTestJSON-1873061594-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:01:23.542421 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3f439ca6-cab6-4d72-b0fd-a215be05165d tempest-HostsAdminNegativeTestJSON-1873061594 tempest-HostsAdminNegativeTestJSON-1873061594-project] 10.222.0.35 "GET /compute/v2.1/os-hosts/chdv-master-2/reboot" status: 403 len: 111 microversion: 2.1 time: 0.009698 Jun 10 18:01:23.542421 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 672/1296] 10.222.0.35 () {58 vars in 1190 bytes} [Fri Jun 10 18:01:23 2022] GET /compute/v2.1/os-hosts/chdv-master-2/reboot => generated 111 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:01:23.546947 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1b72f9e6-5cd2-4ec9-8149-2d5ba84cd328 tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] Calling method '.version_select at 0x7f77c0d55430>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:23.547741 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:01:23.547741 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 18:01:23.556915 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-1b72f9e6-5cd2-4ec9-8149-2d5ba84cd328 tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jun 10 18:01:23.558698 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1b72f9e6-5cd2-4ec9-8149-2d5ba84cd328 tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] Request method failure captured: Jun 10 18:01:23.558698 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Jun 10 18:01:23.558698 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:01:23.558698 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:01:23.558698 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:01:23.558698 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:01:23.558698 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:01:23.558698 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:01:23.558698 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:01:23.558698 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:01:23.558698 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4byyRhDxoQE6AG4jztv4IDljSOgvVf4ivsXagXjRYTQ1Bhyl_1nsg6ay1LIzxcp2b7hVyRSzFgI3ET3wFKoH7-V1NoWZaJFklNtUJjdGrLTZeRxelgYO8ezGhslxuWR_CxbOIWA_ENRkf1emGITA6X7PlYZQp3Natp6Sx2UOeaZ09Q Jun 10 18:01:23.558698 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:01:23.558698 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:01:23.558698 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:01:23.558698 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:01:23.558698 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:01:23.558698 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:01:23.558698 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 5f0ba47ac6cf45ae8b8293615f55abc9 Jun 10 18:01:23.558698 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-859518839 Jun 10 18:01:23.558698 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member,admin Jun 10 18:01:23.558698 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member,admin Jun 10 18:01:23.561065 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/5f0ba47ac6cf45ae8b8293615f55abc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/5f0ba47ac6cf45ae8b8293615f55abc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/5f0ba47ac6cf45ae8b8293615f55abc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_5f0ba47ac6cf45ae8b8293615f55abc9", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:01:23.561065 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-HostsAdminNegativeTestJSON-859518839 Jun 10 18:01:23.561065 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 5f0ba47ac6cf45ae8b8293615f55abc9 Jun 10 18:01:23.561065 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-859518839 Jun 10 18:01:23.561065 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-HostsAdminNegativeTestJSON-859518839-project-admin Jun 10 18:01:23.561065 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:01:23.561065 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:01:23.561065 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 60c17d48ad744f2d98088e93c43a2f4a Jun 10 18:01:23.561065 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-HostsAdminNegativeTestJSON-859518839-project-admin Jun 10 18:01:23.561065 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 18:01:23.561065 chdv-master-2 devstack@n-api.service[126594]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jun 10 18:01:23.561065 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'nonexistent_hostname'} Jun 10 18:01:23.561065 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:01:23.562105 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:23.562105 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jun 10 18:01:23.562105 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jun 10 18:01:23.562105 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 10 18:01:23.562105 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 10 18:01:23.562105 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 18:01:23.562105 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 18:01:23.562105 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 18:01:23.562105 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 18:01:23.562105 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 10 18:01:23.562105 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 10 18:01:23.562105 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jun 10 18:01:23.562105 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jun 10 18:01:23.562105 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 18:01:23.562105 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 18:01:23.562105 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 10 18:01:23.562105 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 10 18:01:23.562105 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 10 18:01:23.562105 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 10 18:01:23.563557 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 10 18:01:23.563557 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 10 18:01:23.563557 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 10 18:01:23.563557 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.563557 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:01:23.563557 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.563557 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:23.563557 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:23.563557 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:23.563557 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:01:23.563557 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:01:23.563557 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:01:23.563557 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:01:23.563557 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:01:23.563557 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:01:23.563557 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Jun 10 18:01:23.563557 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Jun 10 18:01:23.563557 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jun 10 18:01:23.563557 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:01:23.565036 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 10 18:01:23.565036 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.565036 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:01:23.565036 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.565036 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:23.565036 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:23.565036 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:23.565036 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:01:23.565036 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:01:23.565036 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jun 10 18:01:23.565036 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.565036 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1b72f9e6-5cd2-4ec9-8149-2d5ba84cd328 tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:01:23.565036 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1b72f9e6-5cd2-4ec9-8149-2d5ba84cd328 tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] 10.222.0.35 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.018016 Jun 10 18:01:23.565036 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 625/1297] 10.222.0.35 () {58 vars in 1211 bytes} [Fri Jun 10 18:01:23 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:01:23.569630 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-62cee115-2317-496d-81f3-efb8ce55ef84 tempest-HostsAdminNegativeTestJSON-1873061594 tempest-HostsAdminNegativeTestJSON-1873061594-project] Calling method '.version_select at 0x7f77c16dd040>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:23.570479 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:01:23.570479 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 18:01:23.571643 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-62cee115-2317-496d-81f3-efb8ce55ef84 tempest-HostsAdminNegativeTestJSON-1873061594 tempest-HostsAdminNegativeTestJSON-1873061594-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'df6ede10bcf44e1f9aa42bd3e9ddf2e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3dba07d05943f88d1ae7a2103405e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:23.573270 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-62cee115-2317-496d-81f3-efb8ce55ef84 tempest-HostsAdminNegativeTestJSON-1873061594 tempest-HostsAdminNegativeTestJSON-1873061594-project] Request method failure captured: Jun 10 18:01:23.573270 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/os-hosts/chdv-master-2 HTTP/1.1 Jun 10 18:01:23.573270 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:01:23.573270 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:01:23.573270 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:01:23.573270 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:01:23.573270 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:01:23.573270 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:01:23.573270 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:01:23.573270 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:01:23.573270 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4bx0_IuvdvEjoxnY51OY8iaYKCIcxo6pboxg61ffRKv2ZefYo7SEiDUicTgwayNeXjxDamLvZhrdqOfZpRpU3qwzcyYKG38p1Zf4EaXSRcbnwD4gAWMLfmRdjlbX6wmt0swxbYm4xL4TOVWvnXaLsp4-Eumg8_KvsT1URkLptNzY2k Jun 10 18:01:23.573270 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:01:23.573270 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:01:23.573270 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:01:23.573270 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:01:23.573270 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:01:23.573270 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:01:23.573270 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 5a3dba07d05943f88d1ae7a2103405e8 Jun 10 18:01:23.573270 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1873061594 Jun 10 18:01:23.573270 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:01:23.573270 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:01:23.574754 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/5a3dba07d05943f88d1ae7a2103405e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/5a3dba07d05943f88d1ae7a2103405e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/5a3dba07d05943f88d1ae7a2103405e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_5a3dba07d05943f88d1ae7a2103405e8", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:01:23.574754 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1873061594 Jun 10 18:01:23.574754 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 5a3dba07d05943f88d1ae7a2103405e8 Jun 10 18:01:23.574754 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1873061594 Jun 10 18:01:23.574754 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-HostsAdminNegativeTestJSON-1873061594-project Jun 10 18:01:23.574754 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:01:23.574754 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:01:23.574754 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: df6ede10bcf44e1f9aa42bd3e9ddf2e2 Jun 10 18:01:23.574754 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1873061594-project Jun 10 18:01:23.574754 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:01:23.574754 chdv-master-2 devstack@n-api.service[126595]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jun 10 18:01:23.574754 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'chdv-master-2'} Jun 10 18:01:23.574754 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:01:23.575863 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:23.575863 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:23.575863 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:23.575863 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:01:23.575863 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:01:23.575863 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:01:23.575863 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:01:23.575863 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:01:23.575863 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:01:23.575863 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Jun 10 18:01:23.575863 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Jun 10 18:01:23.575863 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 10 18:01:23.575863 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 10 18:01:23.575863 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 10 18:01:23.575863 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 10 18:01:23.575863 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 18:01:23.575863 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 18:01:23.575863 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 18:01:23.575863 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 18:01:23.583394 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 10 18:01:23.583394 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 10 18:01:23.583394 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 10 18:01:23.583394 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 10 18:01:23.583394 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 10 18:01:23.583394 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 10 18:01:23.583394 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jun 10 18:01:23.583394 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.583394 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:01:23.583394 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.583394 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:23.583394 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:23.583394 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:23.583394 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 10 18:01:23.583394 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 10 18:01:23.583394 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jun 10 18:01:23.583394 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.584681 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-62cee115-2317-496d-81f3-efb8ce55ef84 tempest-HostsAdminNegativeTestJSON-1873061594 tempest-HostsAdminNegativeTestJSON-1873061594-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:01:23.584681 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-62cee115-2317-496d-81f3-efb8ce55ef84 tempest-HostsAdminNegativeTestJSON-1873061594 tempest-HostsAdminNegativeTestJSON-1873061594-project] 10.222.0.35 "GET /compute/v2.1/os-hosts/chdv-master-2" status: 403 len: 109 microversion: 2.1 time: 0.009091 Jun 10 18:01:23.584681 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 673/1298] 10.222.0.35 () {58 vars in 1169 bytes} [Fri Jun 10 18:01:23 2022] GET /compute/v2.1/os-hosts/chdv-master-2 => generated 109 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:01:23.584910 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-523b7476-b434-4540-8a15-21949a0710d7 tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] Calling method '.version_select at 0x7f77c0b7c430>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:23.585009 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:01:23.585009 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 18:01:23.590523 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-523b7476-b434-4540-8a15-21949a0710d7 tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jun 10 18:01:23.592950 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-523b7476-b434-4540-8a15-21949a0710d7 tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] Request method failure captured: Jun 10 18:01:23.592950 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jun 10 18:01:23.592950 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:01:23.592950 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:01:23.592950 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:01:23.592950 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:01:23.592950 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:01:23.592950 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:01:23.592950 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:01:23.592950 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:01:23.592950 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4byyRhDxoQE6AG4jztv4IDljSOgvVf4ivsXagXjRYTQ1Bhyl_1nsg6ay1LIzxcp2b7hVyRSzFgI3ET3wFKoH7-V1NoWZaJFklNtUJjdGrLTZeRxelgYO8ezGhslxuWR_CxbOIWA_ENRkf1emGITA6X7PlYZQp3Natp6Sx2UOeaZ09Q Jun 10 18:01:23.592950 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:01:23.592950 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:01:23.592950 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:01:23.592950 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:01:23.592950 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:01:23.592950 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:01:23.592950 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 5f0ba47ac6cf45ae8b8293615f55abc9 Jun 10 18:01:23.592950 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-859518839 Jun 10 18:01:23.592950 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member,admin Jun 10 18:01:23.592950 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member,admin Jun 10 18:01:23.594542 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/5f0ba47ac6cf45ae8b8293615f55abc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/5f0ba47ac6cf45ae8b8293615f55abc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/5f0ba47ac6cf45ae8b8293615f55abc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_5f0ba47ac6cf45ae8b8293615f55abc9", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:01:23.594542 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-HostsAdminNegativeTestJSON-859518839 Jun 10 18:01:23.594542 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 5f0ba47ac6cf45ae8b8293615f55abc9 Jun 10 18:01:23.594542 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-859518839 Jun 10 18:01:23.594542 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-HostsAdminNegativeTestJSON-859518839-project-admin Jun 10 18:01:23.594542 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:01:23.594542 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:01:23.594542 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 60c17d48ad744f2d98088e93c43a2f4a Jun 10 18:01:23.594542 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-HostsAdminNegativeTestJSON-859518839-project-admin Jun 10 18:01:23.594542 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 18:01:23.594542 chdv-master-2 devstack@n-api.service[126594]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jun 10 18:01:23.594542 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'nonexistent_hostname'} Jun 10 18:01:23.594542 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:01:23.595601 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:23.595601 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Jun 10 18:01:23.595601 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jun 10 18:01:23.595601 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 18:01:23.595601 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 18:01:23.595601 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 10 18:01:23.595601 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 10 18:01:23.595601 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 10 18:01:23.595601 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 10 18:01:23.595601 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 10 18:01:23.595601 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 10 18:01:23.595601 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 10 18:01:23.595601 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.595601 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:01:23.595601 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.595601 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:23.595601 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:23.595601 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:23.595601 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:01:23.596973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:01:23.596973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:01:23.596973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:01:23.596973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:01:23.596973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:01:23.596973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Jun 10 18:01:23.596973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:01:23.596973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 10 18:01:23.596973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.596973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:01:23.596973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.596973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:23.596973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:23.596973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:23.596973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:01:23.596973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:01:23.596973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jun 10 18:01:23.596973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.598127 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-523b7476-b434-4540-8a15-21949a0710d7 tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:01:23.598127 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-523b7476-b434-4540-8a15-21949a0710d7 tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] 10.222.0.35 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.014241 Jun 10 18:01:23.598127 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 626/1299] 10.222.0.35 () {58 vars in 1190 bytes} [Fri Jun 10 18:01:23 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:01:23.604335 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bdac3585-c5da-420e-bc34-475cb70d1828 tempest-HostsAdminNegativeTestJSON-1873061594 tempest-HostsAdminNegativeTestJSON-1873061594-project] Calling method '.version_select at 0x7f77c17fc3a0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:23.605121 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:01:23.605121 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 18:01:23.606234 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bdac3585-c5da-420e-bc34-475cb70d1828 tempest-HostsAdminNegativeTestJSON-1873061594 tempest-HostsAdminNegativeTestJSON-1873061594-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'df6ede10bcf44e1f9aa42bd3e9ddf2e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3dba07d05943f88d1ae7a2103405e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:23.607976 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bdac3585-c5da-420e-bc34-475cb70d1828 tempest-HostsAdminNegativeTestJSON-1873061594 tempest-HostsAdminNegativeTestJSON-1873061594-project] Request method failure captured: Jun 10 18:01:23.607976 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/os-hosts/chdv-master-2/shutdown HTTP/1.1 Jun 10 18:01:23.607976 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:01:23.607976 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:01:23.607976 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:01:23.607976 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:01:23.607976 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:01:23.607976 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:01:23.607976 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:01:23.607976 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:01:23.607976 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4bx0_IuvdvEjoxnY51OY8iaYKCIcxo6pboxg61ffRKv2ZefYo7SEiDUicTgwayNeXjxDamLvZhrdqOfZpRpU3qwzcyYKG38p1Zf4EaXSRcbnwD4gAWMLfmRdjlbX6wmt0swxbYm4xL4TOVWvnXaLsp4-Eumg8_KvsT1URkLptNzY2k Jun 10 18:01:23.607976 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:01:23.607976 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:01:23.607976 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:01:23.607976 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:01:23.607976 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:01:23.607976 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:01:23.607976 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 5a3dba07d05943f88d1ae7a2103405e8 Jun 10 18:01:23.607976 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1873061594 Jun 10 18:01:23.607976 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:01:23.607976 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:01:23.615938 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/5a3dba07d05943f88d1ae7a2103405e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/5a3dba07d05943f88d1ae7a2103405e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/5a3dba07d05943f88d1ae7a2103405e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_5a3dba07d05943f88d1ae7a2103405e8", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:01:23.615938 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1873061594 Jun 10 18:01:23.615938 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 5a3dba07d05943f88d1ae7a2103405e8 Jun 10 18:01:23.615938 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1873061594 Jun 10 18:01:23.615938 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-HostsAdminNegativeTestJSON-1873061594-project Jun 10 18:01:23.615938 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:01:23.615938 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:01:23.615938 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: df6ede10bcf44e1f9aa42bd3e9ddf2e2 Jun 10 18:01:23.615938 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1873061594-project Jun 10 18:01:23.615938 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:01:23.615938 chdv-master-2 devstack@n-api.service[126595]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jun 10 18:01:23.615938 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'chdv-master-2'} Jun 10 18:01:23.615938 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:01:23.616927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:23.616927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:23.616927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:23.616927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:01:23.616927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:01:23.616927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:01:23.616927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:01:23.616927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:01:23.616927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:01:23.616927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Jun 10 18:01:23.616927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Jun 10 18:01:23.616927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 10 18:01:23.616927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 10 18:01:23.616927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 10 18:01:23.616927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 10 18:01:23.616927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 18:01:23.616927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 18:01:23.616927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 18:01:23.616927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 18:01:23.618257 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 10 18:01:23.618257 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 10 18:01:23.618257 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 10 18:01:23.618257 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 10 18:01:23.618257 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 10 18:01:23.618257 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 10 18:01:23.618257 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jun 10 18:01:23.618257 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.618257 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:01:23.618257 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.618257 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:23.618257 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:23.618257 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:23.618257 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 10 18:01:23.618257 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 10 18:01:23.618257 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jun 10 18:01:23.618257 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.619593 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bdac3585-c5da-420e-bc34-475cb70d1828 tempest-HostsAdminNegativeTestJSON-1873061594 tempest-HostsAdminNegativeTestJSON-1873061594-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:01:23.619593 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bdac3585-c5da-420e-bc34-475cb70d1828 tempest-HostsAdminNegativeTestJSON-1873061594 tempest-HostsAdminNegativeTestJSON-1873061594-project] 10.222.0.35 "GET /compute/v2.1/os-hosts/chdv-master-2/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.009545 Jun 10 18:01:23.619593 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 674/1300] 10.222.0.35 () {58 vars in 1196 bytes} [Fri Jun 10 18:01:23 2022] GET /compute/v2.1/os-hosts/chdv-master-2/shutdown => generated 113 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:01:23.620323 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-720db2c4-8bb0-4def-ae74-64c1ec7272f0 tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] Calling method '.version_select at 0x7f77c0dfc5e0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:23.621154 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:01:23.621154 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 18:01:23.630358 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-720db2c4-8bb0-4def-ae74-64c1ec7272f0 tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jun 10 18:01:23.632143 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-720db2c4-8bb0-4def-ae74-64c1ec7272f0 tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] Request method failure captured: Jun 10 18:01:23.632143 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Jun 10 18:01:23.632143 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:01:23.632143 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:01:23.632143 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:01:23.632143 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:01:23.632143 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:01:23.632143 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:01:23.632143 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:01:23.632143 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:01:23.632143 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4byyRhDxoQE6AG4jztv4IDljSOgvVf4ivsXagXjRYTQ1Bhyl_1nsg6ay1LIzxcp2b7hVyRSzFgI3ET3wFKoH7-V1NoWZaJFklNtUJjdGrLTZeRxelgYO8ezGhslxuWR_CxbOIWA_ENRkf1emGITA6X7PlYZQp3Natp6Sx2UOeaZ09Q Jun 10 18:01:23.632143 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:01:23.632143 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:01:23.632143 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:01:23.632143 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:01:23.632143 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:01:23.632143 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:01:23.632143 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 5f0ba47ac6cf45ae8b8293615f55abc9 Jun 10 18:01:23.632143 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-859518839 Jun 10 18:01:23.632143 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member,admin Jun 10 18:01:23.632143 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member,admin Jun 10 18:01:23.633578 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/5f0ba47ac6cf45ae8b8293615f55abc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/5f0ba47ac6cf45ae8b8293615f55abc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/5f0ba47ac6cf45ae8b8293615f55abc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_5f0ba47ac6cf45ae8b8293615f55abc9", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:01:23.633578 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-HostsAdminNegativeTestJSON-859518839 Jun 10 18:01:23.633578 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 5f0ba47ac6cf45ae8b8293615f55abc9 Jun 10 18:01:23.633578 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-859518839 Jun 10 18:01:23.633578 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-HostsAdminNegativeTestJSON-859518839-project-admin Jun 10 18:01:23.633578 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:01:23.633578 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:01:23.633578 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 60c17d48ad744f2d98088e93c43a2f4a Jun 10 18:01:23.633578 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-HostsAdminNegativeTestJSON-859518839-project-admin Jun 10 18:01:23.633578 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 18:01:23.633578 chdv-master-2 devstack@n-api.service[126594]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jun 10 18:01:23.633578 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'nonexistent_hostname'} Jun 10 18:01:23.633578 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:01:23.634429 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:23.634429 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jun 10 18:01:23.634429 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jun 10 18:01:23.634429 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 10 18:01:23.634429 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 10 18:01:23.634429 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 18:01:23.634429 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 18:01:23.634429 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 18:01:23.634429 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 18:01:23.634429 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 10 18:01:23.634429 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 10 18:01:23.634429 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jun 10 18:01:23.634429 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jun 10 18:01:23.634429 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 18:01:23.634429 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 18:01:23.634429 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 10 18:01:23.634429 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 10 18:01:23.634429 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 10 18:01:23.634429 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 10 18:01:23.636735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 10 18:01:23.636735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 10 18:01:23.636735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 10 18:01:23.636735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.636735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:01:23.636735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.636735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:23.636735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:23.636735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:23.636735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:01:23.636735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:01:23.636735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:01:23.636735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:01:23.636735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:01:23.636735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:01:23.636735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Jun 10 18:01:23.636735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Jun 10 18:01:23.636735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jun 10 18:01:23.636735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:01:23.637928 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 10 18:01:23.637928 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.637928 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:01:23.637928 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.637928 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:23.637928 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:23.637928 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:23.637928 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:01:23.637928 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:01:23.637928 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jun 10 18:01:23.637928 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.637928 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-720db2c4-8bb0-4def-ae74-64c1ec7272f0 tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:01:23.637928 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-720db2c4-8bb0-4def-ae74-64c1ec7272f0 tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] 10.222.0.35 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.017651 Jun 10 18:01:23.637928 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 627/1301] 10.222.0.35 () {58 vars in 1217 bytes} [Fri Jun 10 18:01:23 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:01:23.644272 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4b71fb16-28b9-4f4d-8590-8210c7312a64 tempest-HostsAdminNegativeTestJSON-1873061594 tempest-HostsAdminNegativeTestJSON-1873061594-project] Calling method '.version_select at 0x7f77c16eea60>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:23.645039 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:01:23.645039 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 18:01:23.646121 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4b71fb16-28b9-4f4d-8590-8210c7312a64 tempest-HostsAdminNegativeTestJSON-1873061594 tempest-HostsAdminNegativeTestJSON-1873061594-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'df6ede10bcf44e1f9aa42bd3e9ddf2e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3dba07d05943f88d1ae7a2103405e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:23.647697 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4b71fb16-28b9-4f4d-8590-8210c7312a64 tempest-HostsAdminNegativeTestJSON-1873061594 tempest-HostsAdminNegativeTestJSON-1873061594-project] Request method failure captured: Jun 10 18:01:23.647697 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/os-hosts/chdv-master-2/startup HTTP/1.1 Jun 10 18:01:23.647697 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:01:23.647697 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:01:23.647697 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:01:23.647697 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:01:23.647697 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:01:23.647697 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:01:23.647697 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:01:23.647697 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:01:23.647697 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4bx0_IuvdvEjoxnY51OY8iaYKCIcxo6pboxg61ffRKv2ZefYo7SEiDUicTgwayNeXjxDamLvZhrdqOfZpRpU3qwzcyYKG38p1Zf4EaXSRcbnwD4gAWMLfmRdjlbX6wmt0swxbYm4xL4TOVWvnXaLsp4-Eumg8_KvsT1URkLptNzY2k Jun 10 18:01:23.647697 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:01:23.647697 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:01:23.647697 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:01:23.647697 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:01:23.647697 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:01:23.647697 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:01:23.647697 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 5a3dba07d05943f88d1ae7a2103405e8 Jun 10 18:01:23.647697 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1873061594 Jun 10 18:01:23.647697 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:01:23.647697 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:01:23.649247 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/5a3dba07d05943f88d1ae7a2103405e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/5a3dba07d05943f88d1ae7a2103405e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/5a3dba07d05943f88d1ae7a2103405e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_5a3dba07d05943f88d1ae7a2103405e8", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:01:23.649247 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1873061594 Jun 10 18:01:23.649247 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 5a3dba07d05943f88d1ae7a2103405e8 Jun 10 18:01:23.649247 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1873061594 Jun 10 18:01:23.649247 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-HostsAdminNegativeTestJSON-1873061594-project Jun 10 18:01:23.649247 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:01:23.649247 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:01:23.649247 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: df6ede10bcf44e1f9aa42bd3e9ddf2e2 Jun 10 18:01:23.649247 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1873061594-project Jun 10 18:01:23.649247 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:01:23.649247 chdv-master-2 devstack@n-api.service[126595]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jun 10 18:01:23.649247 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'chdv-master-2'} Jun 10 18:01:23.649247 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:01:23.650105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:23.650105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:23.650105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:23.650105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:01:23.650105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:01:23.650105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:01:23.650105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:01:23.650105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:01:23.650105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:01:23.650105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Jun 10 18:01:23.650105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Jun 10 18:01:23.650105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 10 18:01:23.650105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 10 18:01:23.650105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 10 18:01:23.650105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 10 18:01:23.650105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 18:01:23.650105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 18:01:23.650105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 18:01:23.650105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 18:01:23.651394 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 10 18:01:23.651394 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 10 18:01:23.651394 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 10 18:01:23.651394 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 10 18:01:23.651394 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 10 18:01:23.651394 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 10 18:01:23.651394 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jun 10 18:01:23.651394 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.651394 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:01:23.651394 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.651394 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:23.651394 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:23.651394 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:23.651394 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 10 18:01:23.651394 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 10 18:01:23.651394 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jun 10 18:01:23.651394 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.652632 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4b71fb16-28b9-4f4d-8590-8210c7312a64 tempest-HostsAdminNegativeTestJSON-1873061594 tempest-HostsAdminNegativeTestJSON-1873061594-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:01:23.652632 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4b71fb16-28b9-4f4d-8590-8210c7312a64 tempest-HostsAdminNegativeTestJSON-1873061594 tempest-HostsAdminNegativeTestJSON-1873061594-project] 10.222.0.35 "GET /compute/v2.1/os-hosts/chdv-master-2/startup" status: 403 len: 110 microversion: 2.1 time: 0.008866 Jun 10 18:01:23.652632 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 675/1302] 10.222.0.35 () {58 vars in 1193 bytes} [Fri Jun 10 18:01:23 2022] GET /compute/v2.1/os-hosts/chdv-master-2/startup => generated 110 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:01:23.659186 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-14b01ccb-5e2c-47b7-8256-a1befdd3e839 tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] Calling method '.version_select at 0x7f77c0e17ee0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:23.660740 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:01:23.660740 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 18:01:23.669472 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-14b01ccb-5e2c-47b7-8256-a1befdd3e839 tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jun 10 18:01:23.671202 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-14b01ccb-5e2c-47b7-8256-a1befdd3e839 tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] Request method failure captured: Jun 10 18:01:23.671202 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Jun 10 18:01:23.671202 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:01:23.671202 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:01:23.671202 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:01:23.671202 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:01:23.671202 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:01:23.671202 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:01:23.671202 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:01:23.671202 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:01:23.671202 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4byyRhDxoQE6AG4jztv4IDljSOgvVf4ivsXagXjRYTQ1Bhyl_1nsg6ay1LIzxcp2b7hVyRSzFgI3ET3wFKoH7-V1NoWZaJFklNtUJjdGrLTZeRxelgYO8ezGhslxuWR_CxbOIWA_ENRkf1emGITA6X7PlYZQp3Natp6Sx2UOeaZ09Q Jun 10 18:01:23.671202 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:01:23.671202 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:01:23.671202 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:01:23.671202 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:01:23.671202 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:01:23.671202 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:01:23.671202 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 5f0ba47ac6cf45ae8b8293615f55abc9 Jun 10 18:01:23.671202 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-859518839 Jun 10 18:01:23.671202 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member,admin Jun 10 18:01:23.671202 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member,admin Jun 10 18:01:23.677951 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/5f0ba47ac6cf45ae8b8293615f55abc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/5f0ba47ac6cf45ae8b8293615f55abc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/5f0ba47ac6cf45ae8b8293615f55abc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_5f0ba47ac6cf45ae8b8293615f55abc9", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:01:23.677951 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-HostsAdminNegativeTestJSON-859518839 Jun 10 18:01:23.677951 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 5f0ba47ac6cf45ae8b8293615f55abc9 Jun 10 18:01:23.677951 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-859518839 Jun 10 18:01:23.677951 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-HostsAdminNegativeTestJSON-859518839-project-admin Jun 10 18:01:23.677951 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:01:23.677951 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:01:23.677951 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 60c17d48ad744f2d98088e93c43a2f4a Jun 10 18:01:23.677951 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-HostsAdminNegativeTestJSON-859518839-project-admin Jun 10 18:01:23.677951 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 18:01:23.677951 chdv-master-2 devstack@n-api.service[126594]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jun 10 18:01:23.677951 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'nonexistent_hostname'} Jun 10 18:01:23.677951 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:01:23.678729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:23.678729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jun 10 18:01:23.678729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jun 10 18:01:23.678729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 10 18:01:23.678729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 10 18:01:23.678729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 18:01:23.678729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 18:01:23.678729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 18:01:23.678729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 18:01:23.678729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 10 18:01:23.678729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 10 18:01:23.678729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jun 10 18:01:23.678729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jun 10 18:01:23.678729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 18:01:23.678729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 18:01:23.678729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 10 18:01:23.678729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 10 18:01:23.678729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 10 18:01:23.678729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 10 18:01:23.680456 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 10 18:01:23.680456 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 10 18:01:23.680456 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 10 18:01:23.680456 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.680456 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:01:23.680456 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.680456 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:23.680456 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:23.680456 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:23.680456 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:01:23.680456 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:01:23.680456 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:01:23.680456 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:01:23.680456 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:01:23.680456 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:01:23.680456 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Jun 10 18:01:23.680456 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Jun 10 18:01:23.680456 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jun 10 18:01:23.680456 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:01:23.681572 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 10 18:01:23.681572 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.681572 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:01:23.681572 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.681572 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:23.681572 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:23.681572 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:23.681572 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:01:23.681572 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:01:23.681572 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jun 10 18:01:23.681572 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.681572 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-14b01ccb-5e2c-47b7-8256-a1befdd3e839 tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:01:23.681572 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-14b01ccb-5e2c-47b7-8256-a1befdd3e839 tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] 10.222.0.35 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.017830 Jun 10 18:01:23.681572 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 628/1303] 10.222.0.35 () {58 vars in 1214 bytes} [Fri Jun 10 18:01:23 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 10 18:01:23.684862 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-eb57339c-b538-45c7-8c76-f08b59ffe548 tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] Action: 'update', calling method: .version_select at 0x7f77c6270160>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:23.687434 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-eb57339c-b538-45c7-8c76-f08b59ffe548 tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] Request method failure captured: Jun 10 18:01:23.687434 chdv-master-2 devstack@n-api.service[126595]: request: PUT /compute/v2.1/os-hosts/chdv-master-2 HTTP/1.1 Jun 10 18:01:23.687434 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:01:23.687434 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:01:23.687434 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:01:23.687434 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 51 Jun 10 18:01:23.687434 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:01:23.687434 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:01:23.687434 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:01:23.687434 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:01:23.687434 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4byyRhDxoQE6AG4jztv4IDljSOgvVf4ivsXagXjRYTQ1Bhyl_1nsg6ay1LIzxcp2b7hVyRSzFgI3ET3wFKoH7-V1NoWZaJFklNtUJjdGrLTZeRxelgYO8ezGhslxuWR_CxbOIWA_ENRkf1emGITA6X7PlYZQp3Natp6Sx2UOeaZ09Q Jun 10 18:01:23.687434 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:01:23.687434 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:01:23.687434 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:01:23.687434 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:01:23.687434 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:01:23.687434 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:01:23.687434 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 5f0ba47ac6cf45ae8b8293615f55abc9 Jun 10 18:01:23.687434 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-859518839 Jun 10 18:01:23.687434 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member,admin Jun 10 18:01:23.687434 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member,admin Jun 10 18:01:23.689657 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/5f0ba47ac6cf45ae8b8293615f55abc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/5f0ba47ac6cf45ae8b8293615f55abc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/5f0ba47ac6cf45ae8b8293615f55abc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_5f0ba47ac6cf45ae8b8293615f55abc9", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:01:23.689657 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-HostsAdminNegativeTestJSON-859518839 Jun 10 18:01:23.689657 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 5f0ba47ac6cf45ae8b8293615f55abc9 Jun 10 18:01:23.689657 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-859518839 Jun 10 18:01:23.689657 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-HostsAdminNegativeTestJSON-859518839-project-admin Jun 10 18:01:23.689657 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:01:23.689657 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:01:23.689657 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 60c17d48ad744f2d98088e93c43a2f4a Jun 10 18:01:23.689657 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-HostsAdminNegativeTestJSON-859518839-project-admin Jun 10 18:01:23.689657 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:01:23.689657 chdv-master-2 devstack@n-api.service[126595]: {"status": "enable", "maintenance_mode": "invalid"} Jun 10 18:01:23.689657 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:01:23.689657 chdv-master-2 devstack@n-api.service[126595]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 10 18:01:23.690897 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'chdv-master-2', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Jun 10 18:01:23.690897 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:01:23.690897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:23.690897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 10 18:01:23.690897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 10 18:01:23.690897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 10 18:01:23.690897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise error Jun 10 18:01:23.690897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 10 18:01:23.690897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.690897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Jun 10 18:01:23.690897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jun 10 18:01:23.690897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 'disable', Jun 10 18:01:23.690897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 'Enable', Jun 10 18:01:23.690897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 'Disable', Jun 10 18:01:23.690897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 'ENABLE', Jun 10 18:01:23.690897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jun 10 18:01:23.690897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jun 10 18:01:23.690897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.690897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi On instance: Jun 10 18:01:23.690897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 'invalid' Jun 10 18:01:23.690897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.690897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:01:23.690897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.690897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:23.690897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:23.693275 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:23.693275 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:01:23.693275 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:01:23.693275 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:01:23.693275 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:01:23.693275 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:01:23.693275 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:01:23.693275 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 10 18:01:23.693275 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 10 18:01:23.693275 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 10 18:01:23.693275 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 10 18:01:23.693275 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 10 18:01:23.693275 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 10 18:01:23.693275 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 10 18:01:23.693275 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.693275 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:01:23.693275 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.693275 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:23.693275 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:23.695301 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:23.695301 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 10 18:01:23.695301 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 10 18:01:23.695301 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 10 18:01:23.695301 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.695301 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-eb57339c-b538-45c7-8c76-f08b59ffe548 tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:01:23.695301 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-eb57339c-b538-45c7-8c76-f08b59ffe548 tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] 10.222.0.35 "PUT /compute/v2.1/os-hosts/chdv-master-2" status: 400 len: 199 microversion: 2.1 time: 0.007992 Jun 10 18:01:23.695301 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 676/1304] 10.222.0.35 () {60 vars in 1189 bytes} [Fri Jun 10 18:01:23 2022] PUT /compute/v2.1/os-hosts/chdv-master-2 => generated 199 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 10 18:01:23.699352 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1fbb0c10-c569-49d8-a789-3ff08be28a82 tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] Action: 'update', calling method: .version_select at 0x7f77c1274310>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:23.702348 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1fbb0c10-c569-49d8-a789-3ff08be28a82 tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] Request method failure captured: Jun 10 18:01:23.702348 chdv-master-2 devstack@n-api.service[126594]: request: PUT /compute/v2.1/os-hosts/chdv-master-2 HTTP/1.1 Jun 10 18:01:23.702348 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:01:23.702348 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:01:23.702348 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:01:23.702348 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 51 Jun 10 18:01:23.702348 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:01:23.702348 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:01:23.702348 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:01:23.702348 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:01:23.702348 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4byyRhDxoQE6AG4jztv4IDljSOgvVf4ivsXagXjRYTQ1Bhyl_1nsg6ay1LIzxcp2b7hVyRSzFgI3ET3wFKoH7-V1NoWZaJFklNtUJjdGrLTZeRxelgYO8ezGhslxuWR_CxbOIWA_ENRkf1emGITA6X7PlYZQp3Natp6Sx2UOeaZ09Q Jun 10 18:01:23.702348 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:01:23.702348 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:01:23.702348 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:01:23.702348 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:01:23.702348 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:01:23.702348 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:01:23.702348 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 5f0ba47ac6cf45ae8b8293615f55abc9 Jun 10 18:01:23.702348 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-859518839 Jun 10 18:01:23.702348 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member,admin Jun 10 18:01:23.702348 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member,admin Jun 10 18:01:23.709032 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/5f0ba47ac6cf45ae8b8293615f55abc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/5f0ba47ac6cf45ae8b8293615f55abc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/5f0ba47ac6cf45ae8b8293615f55abc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_5f0ba47ac6cf45ae8b8293615f55abc9", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:01:23.709032 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-HostsAdminNegativeTestJSON-859518839 Jun 10 18:01:23.709032 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 5f0ba47ac6cf45ae8b8293615f55abc9 Jun 10 18:01:23.709032 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-859518839 Jun 10 18:01:23.709032 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-HostsAdminNegativeTestJSON-859518839-project-admin Jun 10 18:01:23.709032 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:01:23.709032 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:01:23.709032 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 60c17d48ad744f2d98088e93c43a2f4a Jun 10 18:01:23.709032 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-HostsAdminNegativeTestJSON-859518839-project-admin Jun 10 18:01:23.709032 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:01:23.709032 chdv-master-2 devstack@n-api.service[126594]: {"status": "invalid", "maintenance_mode": "enable"} Jun 10 18:01:23.709032 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 18:01:23.709032 chdv-master-2 devstack@n-api.service[126594]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 10 18:01:23.709916 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'chdv-master-2', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Jun 10 18:01:23.709916 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:01:23.709916 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:23.709916 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 10 18:01:23.709916 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 10 18:01:23.709916 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 10 18:01:23.709916 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise error Jun 10 18:01:23.709916 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 10 18:01:23.709916 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.709916 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Jun 10 18:01:23.709916 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jun 10 18:01:23.709916 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi 'disable', Jun 10 18:01:23.709916 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi 'Enable', Jun 10 18:01:23.709916 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi 'Disable', Jun 10 18:01:23.709916 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi 'ENABLE', Jun 10 18:01:23.709916 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jun 10 18:01:23.709916 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jun 10 18:01:23.709916 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.709916 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi On instance: Jun 10 18:01:23.709916 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi 'invalid' Jun 10 18:01:23.709916 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.709916 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:01:23.709916 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.709916 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:23.709916 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:23.711586 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:23.711586 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:01:23.711586 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:01:23.711586 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:01:23.711586 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:01:23.711586 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:01:23.711586 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:01:23.711586 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 10 18:01:23.711586 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 10 18:01:23.711586 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 10 18:01:23.711586 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 10 18:01:23.711586 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 10 18:01:23.711586 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 10 18:01:23.711586 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 10 18:01:23.711586 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.711586 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:01:23.711586 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.711586 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:23.711586 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:23.712786 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:23.712786 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 10 18:01:23.712786 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 10 18:01:23.712786 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 10 18:01:23.712786 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.712786 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1fbb0c10-c569-49d8-a789-3ff08be28a82 tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:01:23.712786 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1fbb0c10-c569-49d8-a789-3ff08be28a82 tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] 10.222.0.35 "PUT /compute/v2.1/os-hosts/chdv-master-2" status: 400 len: 189 microversion: 2.1 time: 0.009295 Jun 10 18:01:23.712786 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 629/1305] 10.222.0.35 () {60 vars in 1189 bytes} [Fri Jun 10 18:01:23 2022] PUT /compute/v2.1/os-hosts/chdv-master-2 => generated 189 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 10 18:01:23.717840 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f4107386-cb39-487e-8267-9ed207b59615 tempest-HostsAdminNegativeTestJSON-1873061594 tempest-HostsAdminNegativeTestJSON-1873061594-project] Action: 'update', calling method: .version_select at 0x7f77c1792280>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:23.719151 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:01:23.719151 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 18:01:23.732617 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f4107386-cb39-487e-8267-9ed207b59615 tempest-HostsAdminNegativeTestJSON-1873061594 tempest-HostsAdminNegativeTestJSON-1873061594-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'df6ede10bcf44e1f9aa42bd3e9ddf2e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3dba07d05943f88d1ae7a2103405e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:23.732617 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f4107386-cb39-487e-8267-9ed207b59615 tempest-HostsAdminNegativeTestJSON-1873061594 tempest-HostsAdminNegativeTestJSON-1873061594-project] Request method failure captured: Jun 10 18:01:23.732617 chdv-master-2 devstack@n-api.service[126595]: request: PUT /compute/v2.1/os-hosts/chdv-master-2 HTTP/1.1 Jun 10 18:01:23.732617 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:01:23.732617 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:01:23.732617 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:01:23.732617 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 50 Jun 10 18:01:23.732617 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:01:23.732617 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:01:23.732617 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:01:23.732617 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:01:23.732617 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4bx0_IuvdvEjoxnY51OY8iaYKCIcxo6pboxg61ffRKv2ZefYo7SEiDUicTgwayNeXjxDamLvZhrdqOfZpRpU3qwzcyYKG38p1Zf4EaXSRcbnwD4gAWMLfmRdjlbX6wmt0swxbYm4xL4TOVWvnXaLsp4-Eumg8_KvsT1URkLptNzY2k Jun 10 18:01:23.732617 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:01:23.732617 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:01:23.732617 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:01:23.732617 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:01:23.732617 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:01:23.732617 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:01:23.732617 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 5a3dba07d05943f88d1ae7a2103405e8 Jun 10 18:01:23.732617 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1873061594 Jun 10 18:01:23.732617 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:01:23.732617 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:01:23.734092 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/5a3dba07d05943f88d1ae7a2103405e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/5a3dba07d05943f88d1ae7a2103405e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/5a3dba07d05943f88d1ae7a2103405e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_5a3dba07d05943f88d1ae7a2103405e8", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:01:23.734092 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1873061594 Jun 10 18:01:23.734092 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 5a3dba07d05943f88d1ae7a2103405e8 Jun 10 18:01:23.734092 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1873061594 Jun 10 18:01:23.734092 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-HostsAdminNegativeTestJSON-1873061594-project Jun 10 18:01:23.734092 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:01:23.734092 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:01:23.734092 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: df6ede10bcf44e1f9aa42bd3e9ddf2e2 Jun 10 18:01:23.734092 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1873061594-project Jun 10 18:01:23.734092 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:01:23.734092 chdv-master-2 devstack@n-api.service[126595]: {"status": "enable", "maintenance_mode": "enable"} Jun 10 18:01:23.734092 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:01:23.734092 chdv-master-2 devstack@n-api.service[126595]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jun 10 18:01:23.734092 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'chdv-master-2', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jun 10 18:01:23.734972 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:01:23.734972 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:23.734972 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:23.734972 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:23.734972 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:01:23.734972 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:01:23.734972 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:01:23.734972 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:01:23.734972 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:01:23.734972 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:01:23.734972 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:01:23.734972 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:01:23.734972 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Jun 10 18:01:23.734972 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Jun 10 18:01:23.734972 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 10 18:01:23.734972 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 10 18:01:23.734972 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 10 18:01:23.734972 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 10 18:01:23.734972 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 18:01:23.734972 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 18:01:23.736230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 18:01:23.736230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 18:01:23.736230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 10 18:01:23.736230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 10 18:01:23.736230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 10 18:01:23.736230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 10 18:01:23.736230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 10 18:01:23.736230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 10 18:01:23.736230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jun 10 18:01:23.736230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.736230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:01:23.736230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.736230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:23.736230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:23.736230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:23.736230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 10 18:01:23.736230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 10 18:01:23.736230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jun 10 18:01:23.736230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.737453 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f4107386-cb39-487e-8267-9ed207b59615 tempest-HostsAdminNegativeTestJSON-1873061594 tempest-HostsAdminNegativeTestJSON-1873061594-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:01:23.737453 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f4107386-cb39-487e-8267-9ed207b59615 tempest-HostsAdminNegativeTestJSON-1873061594 tempest-HostsAdminNegativeTestJSON-1873061594-project] 10.222.0.35 "PUT /compute/v2.1/os-hosts/chdv-master-2" status: 403 len: 111 microversion: 2.1 time: 0.011833 Jun 10 18:01:23.737453 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 677/1306] 10.222.0.35 () {60 vars in 1189 bytes} [Fri Jun 10 18:01:23 2022] PUT /compute/v2.1/os-hosts/chdv-master-2 => generated 111 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:01:23.744889 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-36552492-9466-45f7-ad97-49d7f9cb3094 tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] Action: 'update', calling method: .version_select at 0x7f77c1996550>, body: {"status": null, "maintenance_mode": null} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:23.747283 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-36552492-9466-45f7-ad97-49d7f9cb3094 tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] Request method failure captured: Jun 10 18:01:23.747283 chdv-master-2 devstack@n-api.service[126594]: request: PUT /compute/v2.1/os-hosts/chdv-master-2 HTTP/1.1 Jun 10 18:01:23.747283 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:01:23.747283 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:01:23.747283 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:01:23.747283 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 42 Jun 10 18:01:23.747283 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:01:23.747283 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:01:23.747283 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:01:23.747283 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:01:23.747283 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4byyRhDxoQE6AG4jztv4IDljSOgvVf4ivsXagXjRYTQ1Bhyl_1nsg6ay1LIzxcp2b7hVyRSzFgI3ET3wFKoH7-V1NoWZaJFklNtUJjdGrLTZeRxelgYO8ezGhslxuWR_CxbOIWA_ENRkf1emGITA6X7PlYZQp3Natp6Sx2UOeaZ09Q Jun 10 18:01:23.747283 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:01:23.747283 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:01:23.747283 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:01:23.747283 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:01:23.747283 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:01:23.747283 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:01:23.747283 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 5f0ba47ac6cf45ae8b8293615f55abc9 Jun 10 18:01:23.747283 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-859518839 Jun 10 18:01:23.747283 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member,admin Jun 10 18:01:23.747283 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member,admin Jun 10 18:01:23.759381 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/5f0ba47ac6cf45ae8b8293615f55abc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/5f0ba47ac6cf45ae8b8293615f55abc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/5f0ba47ac6cf45ae8b8293615f55abc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_5f0ba47ac6cf45ae8b8293615f55abc9", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:01:23.759381 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-HostsAdminNegativeTestJSON-859518839 Jun 10 18:01:23.759381 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 5f0ba47ac6cf45ae8b8293615f55abc9 Jun 10 18:01:23.759381 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-859518839 Jun 10 18:01:23.759381 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-HostsAdminNegativeTestJSON-859518839-project-admin Jun 10 18:01:23.759381 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:01:23.759381 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:01:23.759381 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 60c17d48ad744f2d98088e93c43a2f4a Jun 10 18:01:23.759381 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-HostsAdminNegativeTestJSON-859518839-project-admin Jun 10 18:01:23.759381 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:01:23.759381 chdv-master-2 devstack@n-api.service[126594]: {"status": null, "maintenance_mode": null} Jun 10 18:01:23.759381 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 18:01:23.759381 chdv-master-2 devstack@n-api.service[126594]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jun 10 18:01:23.759381 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'chdv-master-2', 'body': {'status': None, 'maintenance_mode': None}} Jun 10 18:01:23.760293 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:01:23.760293 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:23.760293 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 10 18:01:23.760293 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 10 18:01:23.760293 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 10 18:01:23.760293 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise error Jun 10 18:01:23.760293 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Jun 10 18:01:23.760293 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.760293 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Jun 10 18:01:23.760293 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jun 10 18:01:23.760293 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi 'disable', Jun 10 18:01:23.760293 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi 'Enable', Jun 10 18:01:23.760293 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi 'Disable', Jun 10 18:01:23.760293 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi 'ENABLE', Jun 10 18:01:23.760293 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jun 10 18:01:23.760293 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jun 10 18:01:23.760293 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.760293 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi On instance: Jun 10 18:01:23.760293 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi None Jun 10 18:01:23.760293 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.760293 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:01:23.760293 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.760293 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:23.760293 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:23.760293 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:23.761775 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:01:23.761775 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:01:23.761775 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:01:23.761775 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:01:23.761775 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:01:23.761775 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:01:23.761775 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 10 18:01:23.761775 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 10 18:01:23.761775 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 10 18:01:23.761775 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 10 18:01:23.761775 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 10 18:01:23.761775 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 10 18:01:23.761775 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jun 10 18:01:23.761775 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.761775 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:01:23.761775 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.761775 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:23.761775 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:23.761775 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:23.762868 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 10 18:01:23.762868 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 10 18:01:23.762868 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jun 10 18:01:23.762868 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.762868 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-36552492-9466-45f7-ad97-49d7f9cb3094 tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:01:23.762868 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-36552492-9466-45f7-ad97-49d7f9cb3094 tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] 10.222.0.35 "PUT /compute/v2.1/os-hosts/chdv-master-2" status: 400 len: 127 microversion: 2.1 time: 0.007378 Jun 10 18:01:23.762868 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 630/1307] 10.222.0.35 () {60 vars in 1189 bytes} [Fri Jun 10 18:01:23 2022] PUT /compute/v2.1/os-hosts/chdv-master-2 => generated 127 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:01:23.769418 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c1f274c8-feb0-4de2-9b76-958cc5d5cbf8 tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] Action: 'update', calling method: .version_select at 0x7f77c16dd4c0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:23.771262 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.hosts [None req-c1f274c8-feb0-4de2-9b76-958cc5d5cbf8 tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] Enabling host nonexistent_hostname. Jun 10 18:01:23.779048 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d52335e6-bac7-40c7-adb7-92648604611f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:23.780384 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d52335e6-bac7-40c7-adb7-92648604611f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:23.783681 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-c1f274c8-feb0-4de2-9b76-958cc5d5cbf8 tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jun 10 18:01:23.786232 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c1f274c8-feb0-4de2-9b76-958cc5d5cbf8 tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] Request method failure captured: Jun 10 18:01:23.786232 chdv-master-2 devstack@n-api.service[126595]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jun 10 18:01:23.786232 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:01:23.786232 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:01:23.786232 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:01:23.786232 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 50 Jun 10 18:01:23.786232 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:01:23.786232 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:01:23.786232 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:01:23.786232 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:01:23.786232 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4byyRhDxoQE6AG4jztv4IDljSOgvVf4ivsXagXjRYTQ1Bhyl_1nsg6ay1LIzxcp2b7hVyRSzFgI3ET3wFKoH7-V1NoWZaJFklNtUJjdGrLTZeRxelgYO8ezGhslxuWR_CxbOIWA_ENRkf1emGITA6X7PlYZQp3Natp6Sx2UOeaZ09Q Jun 10 18:01:23.786232 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:01:23.786232 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:01:23.786232 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:01:23.786232 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:01:23.786232 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:01:23.786232 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:01:23.786232 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 5f0ba47ac6cf45ae8b8293615f55abc9 Jun 10 18:01:23.786232 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-859518839 Jun 10 18:01:23.786232 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member,admin Jun 10 18:01:23.786232 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member,admin Jun 10 18:01:23.787956 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/5f0ba47ac6cf45ae8b8293615f55abc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/5f0ba47ac6cf45ae8b8293615f55abc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/5f0ba47ac6cf45ae8b8293615f55abc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_5f0ba47ac6cf45ae8b8293615f55abc9", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:01:23.787956 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-HostsAdminNegativeTestJSON-859518839 Jun 10 18:01:23.787956 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 5f0ba47ac6cf45ae8b8293615f55abc9 Jun 10 18:01:23.787956 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-859518839 Jun 10 18:01:23.787956 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-HostsAdminNegativeTestJSON-859518839-project-admin Jun 10 18:01:23.787956 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:01:23.787956 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:01:23.787956 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 60c17d48ad744f2d98088e93c43a2f4a Jun 10 18:01:23.787956 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-HostsAdminNegativeTestJSON-859518839-project-admin Jun 10 18:01:23.787956 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:01:23.787956 chdv-master-2 devstack@n-api.service[126595]: {"status": "enable", "maintenance_mode": "enable"} Jun 10 18:01:23.787956 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:01:23.787956 chdv-master-2 devstack@n-api.service[126595]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jun 10 18:01:23.787956 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jun 10 18:01:23.792921 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:01:23.792921 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:23.792921 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Jun 10 18:01:23.792921 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Jun 10 18:01:23.792921 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 10 18:01:23.792921 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 10 18:01:23.792921 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 18:01:23.792921 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 18:01:23.792921 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 18:01:23.792921 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 18:01:23.792921 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 10 18:01:23.792921 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 10 18:01:23.792921 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jun 10 18:01:23.792921 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jun 10 18:01:23.792921 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 18:01:23.792921 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 18:01:23.792921 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 10 18:01:23.792921 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 10 18:01:23.794025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 10 18:01:23.794025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 10 18:01:23.794025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 10 18:01:23.794025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 10 18:01:23.794025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 10 18:01:23.794025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.794025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:01:23.794025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.794025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:23.794025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:23.794025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:23.794025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:01:23.794025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:01:23.794025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:01:23.794025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:01:23.794025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:01:23.794025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:01:23.794025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:01:23.794025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:01:23.794025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Jun 10 18:01:23.795829 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Jun 10 18:01:23.795829 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Jun 10 18:01:23.795829 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:01:23.795829 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 10 18:01:23.795829 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.795829 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:01:23.795829 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.795829 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:23.795829 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:23.795829 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:23.795829 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:01:23.795829 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:01:23.795829 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jun 10 18:01:23.795829 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:01:23.795829 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c1f274c8-feb0-4de2-9b76-958cc5d5cbf8 tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:01:23.797742 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c1f274c8-feb0-4de2-9b76-958cc5d5cbf8 tempest-HostsAdminNegativeTestJSON-859518839 tempest-HostsAdminNegativeTestJSON-859518839-project-admin] 10.222.0.35 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.021965 Jun 10 18:01:23.797742 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 678/1308] 10.222.0.35 () {60 vars in 1210 bytes} [Fri Jun 10 18:01:23 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:01:23.803673 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d52335e6-bac7-40c7-adb7-92648604611f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:23.804131 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d52335e6-bac7-40c7-adb7-92648604611f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:23.805325 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d52335e6-bac7-40c7-adb7-92648604611f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:23.805487 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d52335e6-bac7-40c7-adb7-92648604611f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:23.891357 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5fdb8e6a-9e0d-4422-b4cf-09d651bc22a0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:23.892037 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5fdb8e6a-9e0d-4422-b4cf-09d651bc22a0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:23.903851 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5fdb8e6a-9e0d-4422-b4cf-09d651bc22a0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:23.904537 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5fdb8e6a-9e0d-4422-b4cf-09d651bc22a0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:23.906162 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5fdb8e6a-9e0d-4422-b4cf-09d651bc22a0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:23.908737 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5fdb8e6a-9e0d-4422-b4cf-09d651bc22a0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:24.025832 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d52335e6-bac7-40c7-adb7-92648604611f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:24.039127 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d52335e6-bac7-40c7-adb7-92648604611f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1521 microversion: 2.1 time: 0.263740 Jun 10 18:01:24.039969 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 631/1309] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:23 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:24.046182 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-54739b23-6f6c-4f3d-ad33-42f8565ab2f0 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:24.047329 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-54739b23-6f6c-4f3d-ad33-42f8565ab2f0 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:24.055848 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-54739b23-6f6c-4f3d-ad33-42f8565ab2f0 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:24.057119 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-54739b23-6f6c-4f3d-ad33-42f8565ab2f0 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:24.058414 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-54739b23-6f6c-4f3d-ad33-42f8565ab2f0 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:24.059276 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-54739b23-6f6c-4f3d-ad33-42f8565ab2f0 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:24.096933 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5fdb8e6a-9e0d-4422-b4cf-09d651bc22a0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:24.108224 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5fdb8e6a-9e0d-4422-b4cf-09d651bc22a0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1476 microversion: 2.1 time: 0.224975 Jun 10 18:01:24.119530 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 679/1310] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:23 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1476 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:24.290518 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-54739b23-6f6c-4f3d-ad33-42f8565ab2f0 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:24.316607 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-54739b23-6f6c-4f3d-ad33-42f8565ab2f0 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:24.322059 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-54739b23-6f6c-4f3d-ad33-42f8565ab2f0 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:24.329864 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-54739b23-6f6c-4f3d-ad33-42f8565ab2f0 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1361 microversion: 2.25 time: 0.288310 Jun 10 18:01:24.330743 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 632/1311] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:01:24 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1361 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:01:24.396849 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e593166e-96d8-4098-8c21-a03e1f1f9316 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:24.397731 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e593166e-96d8-4098-8c21-a03e1f1f9316 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:24.410374 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e593166e-96d8-4098-8c21-a03e1f1f9316 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:24.413624 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e593166e-96d8-4098-8c21-a03e1f1f9316 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:24.414655 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e593166e-96d8-4098-8c21-a03e1f1f9316 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:24.415273 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e593166e-96d8-4098-8c21-a03e1f1f9316 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:24.440916 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0842fb41-03b3-4311-acd9-15b49824a3a3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:24.445467 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0842fb41-03b3-4311-acd9-15b49824a3a3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:24.457564 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0842fb41-03b3-4311-acd9-15b49824a3a3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:24.458201 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0842fb41-03b3-4311-acd9-15b49824a3a3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:24.460791 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0842fb41-03b3-4311-acd9-15b49824a3a3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:24.462635 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0842fb41-03b3-4311-acd9-15b49824a3a3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:24.785641 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0842fb41-03b3-4311-acd9-15b49824a3a3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:24.797215 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0842fb41-03b3-4311-acd9-15b49824a3a3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1470 microversion: 2.1 time: 0.359566 Jun 10 18:01:24.798343 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 633/1312] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:24 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1470 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:01:24.869414 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e593166e-96d8-4098-8c21-a03e1f1f9316 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:24.879299 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e593166e-96d8-4098-8c21-a03e1f1f9316 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1363 microversion: 2.1 time: 0.486772 Jun 10 18:01:24.880097 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 680/1313] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:24 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1363 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:25.056425 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7e2efd79-a5b9-4a81-a6c0-57f33a1d6a45 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:25.057270 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7e2efd79-a5b9-4a81-a6c0-57f33a1d6a45 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:25.063595 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7e2efd79-a5b9-4a81-a6c0-57f33a1d6a45 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:25.064048 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7e2efd79-a5b9-4a81-a6c0-57f33a1d6a45 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:25.064870 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7e2efd79-a5b9-4a81-a6c0-57f33a1d6a45 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:25.065289 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7e2efd79-a5b9-4a81-a6c0-57f33a1d6a45 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:25.130393 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-afaade68-4266-46a5-aec8-52907969a85b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:25.131171 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-afaade68-4266-46a5-aec8-52907969a85b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:25.138428 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-afaade68-4266-46a5-aec8-52907969a85b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:25.138886 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-afaade68-4266-46a5-aec8-52907969a85b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:25.140444 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-afaade68-4266-46a5-aec8-52907969a85b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:25.141047 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-afaade68-4266-46a5-aec8-52907969a85b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:25.209808 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7e2efd79-a5b9-4a81-a6c0-57f33a1d6a45 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:25.218508 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7e2efd79-a5b9-4a81-a6c0-57f33a1d6a45 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1521 microversion: 2.1 time: 0.166009 Jun 10 18:01:25.219385 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 634/1314] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:25 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:25.348729 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d58e782e-5c4d-4acf-bf17-9356da410a89 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:25.349409 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d58e782e-5c4d-4acf-bf17-9356da410a89 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:25.355726 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d58e782e-5c4d-4acf-bf17-9356da410a89 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:25.356192 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d58e782e-5c4d-4acf-bf17-9356da410a89 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:25.356998 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d58e782e-5c4d-4acf-bf17-9356da410a89 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:25.357450 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d58e782e-5c4d-4acf-bf17-9356da410a89 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:25.494521 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d58e782e-5c4d-4acf-bf17-9356da410a89 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:25.503113 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d58e782e-5c4d-4acf-bf17-9356da410a89 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:25.504636 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d58e782e-5c4d-4acf-bf17-9356da410a89 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:25.505745 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d58e782e-5c4d-4acf-bf17-9356da410a89 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1361 microversion: 2.25 time: 0.161144 Jun 10 18:01:25.506848 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 635/1315] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:01:25 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:01:25.573569 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-afaade68-4266-46a5-aec8-52907969a85b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:25.582403 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-afaade68-4266-46a5-aec8-52907969a85b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1476 microversion: 2.1 time: 0.456621 Jun 10 18:01:25.584938 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 681/1316] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:25 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1476 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:01:25.627855 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c7d29e4f-ce8f-49e4-b87d-198b33340857 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "142854fd-ae98-4c8f-b0d1-0f7e60ad8f85", "device": "/dev/xvdb"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:25.629551 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c7d29e4f-ce8f-49e4-b87d-198b33340857 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:25.635611 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c7d29e4f-ce8f-49e4-b87d-198b33340857 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:25.636063 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c7d29e4f-ce8f-49e4-b87d-198b33340857 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:25.636866 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c7d29e4f-ce8f-49e4-b87d-198b33340857 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:25.637299 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c7d29e4f-ce8f-49e4-b87d-198b33340857 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:25.817878 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-34013f8c-e7e4-404e-b8f0-40f84cbcf392 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:25.819235 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-34013f8c-e7e4-404e-b8f0-40f84cbcf392 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:25.829688 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-34013f8c-e7e4-404e-b8f0-40f84cbcf392 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:25.830465 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-34013f8c-e7e4-404e-b8f0-40f84cbcf392 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:25.831404 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-34013f8c-e7e4-404e-b8f0-40f84cbcf392 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:25.831951 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-34013f8c-e7e4-404e-b8f0-40f84cbcf392 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:26.044144 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-34013f8c-e7e4-404e-b8f0-40f84cbcf392 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:26.047629 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-34013f8c-e7e4-404e-b8f0-40f84cbcf392 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1470 microversion: 2.1 time: 0.231090 Jun 10 18:01:26.052971 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 682/1317] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:25 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1470 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:26.066602 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e6681c5b-7f64-4631-975d-873e62284ab6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:26.068404 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e6681c5b-7f64-4631-975d-873e62284ab6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:26.076895 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e6681c5b-7f64-4631-975d-873e62284ab6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:26.077349 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e6681c5b-7f64-4631-975d-873e62284ab6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:26.078702 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e6681c5b-7f64-4631-975d-873e62284ab6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:26.079160 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e6681c5b-7f64-4631-975d-873e62284ab6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:26.256281 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e6681c5b-7f64-4631-975d-873e62284ab6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:26.263838 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e6681c5b-7f64-4631-975d-873e62284ab6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1363 microversion: 2.1 time: 0.209405 Jun 10 18:01:26.265099 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 683/1318] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:26 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1363 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:26.269483 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-633639b6-5cac-49bb-be36-aa995f75dca6 req-1ebd62d4-2656-42ef-955a-48bd67fd89fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0864d26-b605-4a49-b099-8144ecfde9bc", "tag": "a5b5e0a1-0a97-4201-97ee-27e27e1763c7"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:26.277562 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-633639b6-5cac-49bb-be36-aa995f75dca6 req-1ebd62d4-2656-42ef-955a-48bd67fd89fe service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:26.278016 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-633639b6-5cac-49bb-be36-aa995f75dca6 req-1ebd62d4-2656-42ef-955a-48bd67fd89fe service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:26.290100 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-633639b6-5cac-49bb-be36-aa995f75dca6 req-1ebd62d4-2656-42ef-955a-48bd67fd89fe service nova] Creating event network-changed:a5b5e0a1-0a97-4201-97ee-27e27e1763c7 for instance a0864d26-b605-4a49-b099-8144ecfde9bc on chh1-master-2 Jun 10 18:01:26.296030 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-633639b6-5cac-49bb-be36-aa995f75dca6 req-1ebd62d4-2656-42ef-955a-48bd67fd89fe service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029154 Jun 10 18:01:26.296680 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 684/1319] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:01:26.303467 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-123df19b-66fd-447b-972d-7d2c7c5c5908 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:26.304984 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-123df19b-66fd-447b-972d-7d2c7c5c5908 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:26.312128 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-123df19b-66fd-447b-972d-7d2c7c5c5908 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:26.312614 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-123df19b-66fd-447b-972d-7d2c7c5c5908 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:26.313396 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-123df19b-66fd-447b-972d-7d2c7c5c5908 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:26.313845 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-123df19b-66fd-447b-972d-7d2c7c5c5908 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:26.545943 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-123df19b-66fd-447b-972d-7d2c7c5c5908 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:26.555755 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-123df19b-66fd-447b-972d-7d2c7c5c5908 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1506 microversion: 2.1 time: 0.257847 Jun 10 18:01:26.556667 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 685/1320] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:26 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1506 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:26.561828 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-7af8b6e6-820b-4053-9481-10cba7e4798f req-886ad602-aa61-456e-9c2e-3834b8242d53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "186b67b3-3538-4bc2-8528-53b43d701bf1", "name": "network-vif-plugged", "status": "completed", "tag": "128ee4eb-e784-41c8-acaa-39291810b2a4"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:26.570903 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-7af8b6e6-820b-4053-9481-10cba7e4798f req-886ad602-aa61-456e-9c2e-3834b8242d53 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:26.571626 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-7af8b6e6-820b-4053-9481-10cba7e4798f req-886ad602-aa61-456e-9c2e-3834b8242d53 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:26.588813 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-7af8b6e6-820b-4053-9481-10cba7e4798f req-886ad602-aa61-456e-9c2e-3834b8242d53 service nova] Creating event network-vif-plugged:128ee4eb-e784-41c8-acaa-39291810b2a4 for instance 186b67b3-3538-4bc2-8528-53b43d701bf1 on chh1-master-2 Jun 10 18:01:26.596351 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-7af8b6e6-820b-4053-9481-10cba7e4798f req-886ad602-aa61-456e-9c2e-3834b8242d53 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038284 Jun 10 18:01:26.597604 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 686/1321] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:01:26.609229 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-44c0413c-97bf-4308-8575-80f35fb953b4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:26.609936 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-44c0413c-97bf-4308-8575-80f35fb953b4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:26.616403 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44c0413c-97bf-4308-8575-80f35fb953b4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:26.616862 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44c0413c-97bf-4308-8575-80f35fb953b4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:26.618126 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44c0413c-97bf-4308-8575-80f35fb953b4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:26.618568 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44c0413c-97bf-4308-8575-80f35fb953b4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:26.702934 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c7d29e4f-ce8f-49e4-b87d-198b33340857 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "POST /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.078522 Jun 10 18:01:26.709527 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 636/1322] 10.222.0.35 () {60 vars in 1322 bytes} [Fri Jun 10 18:01:25 2022] POST /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d/os-volume_attachments => generated 194 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:01:26.719317 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f592ef9b-d6f1-4dcc-902d-d370cb7abc75 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:26.720375 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f592ef9b-d6f1-4dcc-902d-d370cb7abc75 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:26.727300 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f592ef9b-d6f1-4dcc-902d-d370cb7abc75 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:26.731067 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f592ef9b-d6f1-4dcc-902d-d370cb7abc75 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:26.731067 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f592ef9b-d6f1-4dcc-902d-d370cb7abc75 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:26.731067 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f592ef9b-d6f1-4dcc-902d-d370cb7abc75 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:26.898292 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-44c0413c-97bf-4308-8575-80f35fb953b4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:26.909447 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-44c0413c-97bf-4308-8575-80f35fb953b4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:26.911485 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-44c0413c-97bf-4308-8575-80f35fb953b4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:26.913282 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-44c0413c-97bf-4308-8575-80f35fb953b4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1361 microversion: 2.25 time: 0.313488 Jun 10 18:01:26.914672 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 687/1323] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:01:26 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1361 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:01:26.919433 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4e929d87-3d18-45d6-88e5-5c6babbf28e1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:26.920044 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4e929d87-3d18-45d6-88e5-5c6babbf28e1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:26.926377 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e929d87-3d18-45d6-88e5-5c6babbf28e1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:26.926828 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e929d87-3d18-45d6-88e5-5c6babbf28e1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:26.927787 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e929d87-3d18-45d6-88e5-5c6babbf28e1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:26.928231 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e929d87-3d18-45d6-88e5-5c6babbf28e1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:26.977433 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f592ef9b-d6f1-4dcc-902d-d370cb7abc75 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:26.986166 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f592ef9b-d6f1-4dcc-902d-d370cb7abc75 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 200 len: 1506 microversion: 2.1 time: 0.274268 Jun 10 18:01:26.987286 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 637/1324] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:26 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 1506 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:27.010372 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-dd0de377-57d3-4b38-a544-2669a51cb680 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:27.010959 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-dd0de377-57d3-4b38-a544-2669a51cb680 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:27.021729 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dd0de377-57d3-4b38-a544-2669a51cb680 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:27.022479 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dd0de377-57d3-4b38-a544-2669a51cb680 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:27.023521 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dd0de377-57d3-4b38-a544-2669a51cb680 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:27.023915 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dd0de377-57d3-4b38-a544-2669a51cb680 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:27.054019 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-dd0de377-57d3-4b38-a544-2669a51cb680 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:01:27.199221 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4e929d87-3d18-45d6-88e5-5c6babbf28e1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:27.222090 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4e929d87-3d18-45d6-88e5-5c6babbf28e1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1475 microversion: 2.1 time: 0.306229 Jun 10 18:01:27.225655 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 688/1325] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:26 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1475 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:27.233974 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6456eba5-7061-4e11-a04b-1a6180844db0 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:27.236003 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6456eba5-7061-4e11-a04b-1a6180844db0 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:27.254969 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6456eba5-7061-4e11-a04b-1a6180844db0 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:27.258631 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6456eba5-7061-4e11-a04b-1a6180844db0 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:27.260147 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6456eba5-7061-4e11-a04b-1a6180844db0 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:27.260829 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6456eba5-7061-4e11-a04b-1a6180844db0 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:27.433510 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6456eba5-7061-4e11-a04b-1a6180844db0 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:27.436871 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-dd0de377-57d3-4b38-a544-2669a51cb680 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "DELETE /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 204 len: 0 microversion: 2.1 time: 0.433265 Jun 10 18:01:27.437697 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 638/1326] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:01:27 2022] DELETE /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 18:01:27.449712 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6456eba5-7061-4e11-a04b-1a6180844db0 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1470 microversion: 2.1 time: 0.222690 Jun 10 18:01:27.450288 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 689/1327] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:27 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1470 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:27.454481 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-46ce0f7a-e016-4352-af14-81f0ec43fdb7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:27.455898 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-46ce0f7a-e016-4352-af14-81f0ec43fdb7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:27.462084 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-46ce0f7a-e016-4352-af14-81f0ec43fdb7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:27.465429 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-46ce0f7a-e016-4352-af14-81f0ec43fdb7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:27.466461 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-46ce0f7a-e016-4352-af14-81f0ec43fdb7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:27.467186 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-46ce0f7a-e016-4352-af14-81f0ec43fdb7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:27.575378 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1be48926-b1c6-423f-993e-73a4b53afde5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-658661508", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "c7533710-56da-4765-9437-5446e81c3a43"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:27.663600 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-1be48926-b1c6-423f-993e-73a4b53afde5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] validate_networks() for [('c7533710-56da-4765-9437-5446e81c3a43', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:01:27.672935 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-46ce0f7a-e016-4352-af14-81f0ec43fdb7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:27.683280 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-46ce0f7a-e016-4352-af14-81f0ec43fdb7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1363 microversion: 2.1 time: 0.243386 Jun 10 18:01:27.683876 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 639/1328] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:27 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:27.931764 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-048cdaf3-92a9-4253-ab1a-1d64ed781704 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:27.932500 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-048cdaf3-92a9-4253-ab1a-1d64ed781704 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:27.938787 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-048cdaf3-92a9-4253-ab1a-1d64ed781704 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:27.939326 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-048cdaf3-92a9-4253-ab1a-1d64ed781704 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:27.940175 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-048cdaf3-92a9-4253-ab1a-1d64ed781704 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:27.940717 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-048cdaf3-92a9-4253-ab1a-1d64ed781704 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:28.100444 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-048cdaf3-92a9-4253-ab1a-1d64ed781704 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:28.109335 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-048cdaf3-92a9-4253-ab1a-1d64ed781704 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:28.111107 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-048cdaf3-92a9-4253-ab1a-1d64ed781704 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:28.112374 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-048cdaf3-92a9-4253-ab1a-1d64ed781704 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1361 microversion: 2.25 time: 0.184587 Jun 10 18:01:28.112978 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 640/1329] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:01:27 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1361 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:01:28.175846 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-1be48926-b1c6-423f-993e-73a4b53afde5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:01:28.176355 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-1be48926-b1c6-423f-993e-73a4b53afde5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:01:28.177012 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-1be48926-b1c6-423f-993e-73a4b53afde5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:01:28.177763 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-1be48926-b1c6-423f-993e-73a4b53afde5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:01:28.178194 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-1be48926-b1c6-423f-993e-73a4b53afde5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:01:28.190569 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1be48926-b1c6-423f-993e-73a4b53afde5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:28.191030 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1be48926-b1c6-423f-993e-73a4b53afde5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:28.192036 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1be48926-b1c6-423f-993e-73a4b53afde5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:28.192554 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1be48926-b1c6-423f-993e-73a4b53afde5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:28.215272 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-1be48926-b1c6-423f-993e-73a4b53afde5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Getting quotas for project 188f32238c2c4e4f993cd11937715216. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:01:28.221550 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-1be48926-b1c6-423f-993e-73a4b53afde5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Getting quotas for user 6b1d1a0bd05d43368b969a9cc9435366 and project 188f32238c2c4e4f993cd11937715216. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:01:28.235006 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1be48926-b1c6-423f-993e-73a4b53afde5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:01:28.240853 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1be48926-b1c6-423f-993e-73a4b53afde5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:01:28.242023 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5063d3a8-cd9a-4416-b6f9-3c0fe241c8dd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:28.242638 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5063d3a8-cd9a-4416-b6f9-3c0fe241c8dd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:28.248827 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5063d3a8-cd9a-4416-b6f9-3c0fe241c8dd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:28.249287 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5063d3a8-cd9a-4416-b6f9-3c0fe241c8dd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:28.250057 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5063d3a8-cd9a-4416-b6f9-3c0fe241c8dd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:28.250502 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5063d3a8-cd9a-4416-b6f9-3c0fe241c8dd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:28.370384 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1be48926-b1c6-423f-993e-73a4b53afde5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.799705 Jun 10 18:01:28.371047 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 690/1330] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:01:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 10 18:01:28.376096 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-25d7c303-ad13-44d1-8ce6-94cd00049540 req-ea042980-106c-4fb4-9acc-e76ce07ed8ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89b2f687-3173-411f-92fa-c2e4dde322f6", "name": "network-vif-unplugged", "status": "completed", "tag": "ee1a855b-cfd0-4246-8752-23c466c46c38"}, {"name": "network-changed", "server_uuid": "89b2f687-3173-411f-92fa-c2e4dde322f6", "tag": "ee1a855b-cfd0-4246-8752-23c466c46c38"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:28.389407 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-25d7c303-ad13-44d1-8ce6-94cd00049540 req-ea042980-106c-4fb4-9acc-e76ce07ed8ec service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:28.390102 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-25d7c303-ad13-44d1-8ce6-94cd00049540 req-ea042980-106c-4fb4-9acc-e76ce07ed8ec service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:28.396132 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5063d3a8-cd9a-4416-b6f9-3c0fe241c8dd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:28.404376 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5063d3a8-cd9a-4416-b6f9-3c0fe241c8dd tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1475 microversion: 2.1 time: 0.165960 Jun 10 18:01:28.414988 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 641/1331] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:28 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1475 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:01:28.417648 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-25d7c303-ad13-44d1-8ce6-94cd00049540 req-ea042980-106c-4fb4-9acc-e76ce07ed8ec service nova] Creating event network-vif-unplugged:ee1a855b-cfd0-4246-8752-23c466c46c38 for instance 89b2f687-3173-411f-92fa-c2e4dde322f6 on chh1-master-2 Jun 10 18:01:28.423207 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-25d7c303-ad13-44d1-8ce6-94cd00049540 req-ea042980-106c-4fb4-9acc-e76ce07ed8ec service nova] Creating event network-changed:ee1a855b-cfd0-4246-8752-23c466c46c38 for instance 89b2f687-3173-411f-92fa-c2e4dde322f6 on chh1-master-2 Jun 10 18:01:28.424264 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bf3f1647-92fb-42ef-96bb-507223028e47 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:28.425008 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bf3f1647-92fb-42ef-96bb-507223028e47 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:28.427121 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [req-25d7c303-ad13-44d1-8ce6-94cd00049540 req-ea042980-106c-4fb4-9acc-e76ce07ed8ec service nova] Instance 89b2f687-3173-411f-92fa-c2e4dde322f6 is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 18:01:28.441568 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-25d7c303-ad13-44d1-8ce6-94cd00049540 req-ea042980-106c-4fb4-9acc-e76ce07ed8ec service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.069334 Jun 10 18:01:28.442346 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 691/1332] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:01:28.473306 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-104d0a57-52f0-403d-8214-8d741a3053fb tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:28.474127 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-104d0a57-52f0-403d-8214-8d741a3053fb tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:28.481490 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bf3f1647-92fb-42ef-96bb-507223028e47 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:28.483871 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-104d0a57-52f0-403d-8214-8d741a3053fb tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:28.484356 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-104d0a57-52f0-403d-8214-8d741a3053fb tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:28.485634 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-104d0a57-52f0-403d-8214-8d741a3053fb tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:28.486154 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-104d0a57-52f0-403d-8214-8d741a3053fb tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:28.489402 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bf3f1647-92fb-42ef-96bb-507223028e47 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1217 microversion: 2.1 time: 0.072696 Jun 10 18:01:28.490007 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 642/1333] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:28 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1217 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:28.703598 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-53796514-b7a0-40f1-9e5b-49acf48f7244 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:28.704557 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-53796514-b7a0-40f1-9e5b-49acf48f7244 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:28.724403 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-53796514-b7a0-40f1-9e5b-49acf48f7244 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:28.724856 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-53796514-b7a0-40f1-9e5b-49acf48f7244 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:28.725632 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-53796514-b7a0-40f1-9e5b-49acf48f7244 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:28.729651 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-53796514-b7a0-40f1-9e5b-49acf48f7244 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:28.917220 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-104d0a57-52f0-403d-8214-8d741a3053fb tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:28.926184 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-104d0a57-52f0-403d-8214-8d741a3053fb tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1470 microversion: 2.1 time: 0.459840 Jun 10 18:01:28.930285 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 692/1334] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:28 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1470 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:29.012476 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-53796514-b7a0-40f1-9e5b-49acf48f7244 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:29.023223 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-53796514-b7a0-40f1-9e5b-49acf48f7244 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1363 microversion: 2.1 time: 0.326238 Jun 10 18:01:29.033209 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 643/1335] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:28 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1363 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:01:29.130578 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2681be44-1bf1-4c80-8d52-b305db243eed tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:29.131432 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2681be44-1bf1-4c80-8d52-b305db243eed tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:29.151118 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2681be44-1bf1-4c80-8d52-b305db243eed tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:29.151655 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2681be44-1bf1-4c80-8d52-b305db243eed tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:29.152396 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2681be44-1bf1-4c80-8d52-b305db243eed tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:29.152843 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2681be44-1bf1-4c80-8d52-b305db243eed tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:29.184448 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:01:29.424866 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1cd350ec-3bdf-49e9-9ccc-d263e1a9b24a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:29.426228 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1cd350ec-3bdf-49e9-9ccc-d263e1a9b24a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:29.436604 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1cd350ec-3bdf-49e9-9ccc-d263e1a9b24a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:29.441469 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1cd350ec-3bdf-49e9-9ccc-d263e1a9b24a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:29.444982 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1cd350ec-3bdf-49e9-9ccc-d263e1a9b24a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:29.446246 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1cd350ec-3bdf-49e9-9ccc-d263e1a9b24a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:29.474099 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:01:29.708009 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1cd350ec-3bdf-49e9-9ccc-d263e1a9b24a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:29.717931 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1cd350ec-3bdf-49e9-9ccc-d263e1a9b24a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1475 microversion: 2.1 time: 0.298399 Jun 10 18:01:29.718532 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 644/1336] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:29 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1475 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:29.724607 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-00bd50bb-a12a-49b9-a93e-ff827ffecabb tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:29.724737 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-00bd50bb-a12a-49b9-a93e-ff827ffecabb tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:29.731671 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-00bd50bb-a12a-49b9-a93e-ff827ffecabb tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:29.732132 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-00bd50bb-a12a-49b9-a93e-ff827ffecabb tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:29.733827 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-00bd50bb-a12a-49b9-a93e-ff827ffecabb tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:29.734452 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-00bd50bb-a12a-49b9-a93e-ff827ffecabb tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:29.828275 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-00bd50bb-a12a-49b9-a93e-ff827ffecabb tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:29.857517 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-00bd50bb-a12a-49b9-a93e-ff827ffecabb tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1221 microversion: 2.1 time: 0.137749 Jun 10 18:01:29.858066 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 645/1337] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:29 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1221 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:30.023500 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2681be44-1bf1-4c80-8d52-b305db243eed tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:30.034922 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2681be44-1bf1-4c80-8d52-b305db243eed tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:30.048732 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2681be44-1bf1-4c80-8d52-b305db243eed tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:30.050188 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2681be44-1bf1-4c80-8d52-b305db243eed tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1361 microversion: 2.25 time: 0.923500 Jun 10 18:01:30.050902 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 693/1338] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:01:29 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1361 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:01:30.055980 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d0f99353-a0b5-4c3a-9fd0-2b42e2e21cdf tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:30.056744 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d0f99353-a0b5-4c3a-9fd0-2b42e2e21cdf tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:30.066382 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d0f99353-a0b5-4c3a-9fd0-2b42e2e21cdf tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:30.075930 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9e0c17de-085b-4a52-9f8a-b51432971c34 tempest-HypervisorAdminV228Test-1428372333 tempest-HypervisorAdminV228Test-1428372333-project-admin] Calling method '.version_select at 0x7f77c09cdca0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:30.077483 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:01:30.077483 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 18:01:30.077923 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d0f99353-a0b5-4c3a-9fd0-2b42e2e21cdf tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:30.078731 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9e0c17de-085b-4a52-9f8a-b51432971c34 tempest-HypervisorAdminV228Test-1428372333 tempest-HypervisorAdminV228Test-1428372333-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:30.079190 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9e0c17de-085b-4a52-9f8a-b51432971c34 tempest-HypervisorAdminV228Test-1428372333 tempest-HypervisorAdminV228Test-1428372333-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:30.079458 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d0f99353-a0b5-4c3a-9fd0-2b42e2e21cdf tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:30.080117 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d0f99353-a0b5-4c3a-9fd0-2b42e2e21cdf tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:30.116785 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9e0c17de-085b-4a52-9f8a-b51432971c34 tempest-HypervisorAdminV228Test-1428372333 tempest-HypervisorAdminV228Test-1428372333-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:30.117267 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9e0c17de-085b-4a52-9f8a-b51432971c34 tempest-HypervisorAdminV228Test-1428372333 tempest-HypervisorAdminV228Test-1428372333-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:30.147528 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9e0c17de-085b-4a52-9f8a-b51432971c34 tempest-HypervisorAdminV228Test-1428372333 tempest-HypervisorAdminV228Test-1428372333-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:30.148012 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9e0c17de-085b-4a52-9f8a-b51432971c34 tempest-HypervisorAdminV228Test-1428372333 tempest-HypervisorAdminV228Test-1428372333-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:30.168501 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9e0c17de-085b-4a52-9f8a-b51432971c34 tempest-HypervisorAdminV228Test-1428372333 tempest-HypervisorAdminV228Test-1428372333-project-admin] 10.222.0.35 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.309297 Jun 10 18:01:30.169110 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 646/1339] 10.222.0.35 () {60 vars in 1186 bytes} [Fri Jun 10 18:01:29 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:01:30.186639 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a899a2cb-4349-405c-adc2-ef3e2337848d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:30.187604 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a899a2cb-4349-405c-adc2-ef3e2337848d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:30.197299 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a899a2cb-4349-405c-adc2-ef3e2337848d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:30.200004 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a899a2cb-4349-405c-adc2-ef3e2337848d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:30.202853 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a899a2cb-4349-405c-adc2-ef3e2337848d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:30.203486 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a899a2cb-4349-405c-adc2-ef3e2337848d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:30.406680 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a899a2cb-4349-405c-adc2-ef3e2337848d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:30.421937 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a899a2cb-4349-405c-adc2-ef3e2337848d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1549 microversion: 2.1 time: 0.247939 Jun 10 18:01:30.422661 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 647/1340] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:30 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1549 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:30.434054 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-956cfb60-5809-4567-a84e-5a3b5a32546f tempest-HypervisorAdminV228Test-1428372333 tempest-HypervisorAdminV228Test-1428372333-project-admin] Calling method '.version_select at 0x7f77c0979790>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:30.434054 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:01:30.434054 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 18:01:30.434054 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-956cfb60-5809-4567-a84e-5a3b5a32546f tempest-HypervisorAdminV228Test-1428372333 tempest-HypervisorAdminV228Test-1428372333-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:30.434054 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-956cfb60-5809-4567-a84e-5a3b5a32546f tempest-HypervisorAdminV228Test-1428372333 tempest-HypervisorAdminV228Test-1428372333-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:30.455288 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-956cfb60-5809-4567-a84e-5a3b5a32546f tempest-HypervisorAdminV228Test-1428372333 tempest-HypervisorAdminV228Test-1428372333-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:30.456058 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-956cfb60-5809-4567-a84e-5a3b5a32546f tempest-HypervisorAdminV228Test-1428372333 tempest-HypervisorAdminV228Test-1428372333-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:30.465129 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-956cfb60-5809-4567-a84e-5a3b5a32546f tempest-HypervisorAdminV228Test-1428372333 tempest-HypervisorAdminV228Test-1428372333-project-admin] 10.222.0.35 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.041302 Jun 10 18:01:30.465979 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 648/1341] 10.222.0.35 () {60 vars in 1192 bytes} [Fri Jun 10 18:01:30 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:01:30.473760 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-7b2987fe-85e4-4d0c-8f67-e38b6f4f86a3 req-5990b74c-a807-4024-be9c-d97b64412754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e0a785e-3a8a-466c-bcd0-c21ecf5c30be", "name": "network-vif-deleted", "tag": "24714ded-ea47-4891-9cd5-75d3ab6c0a9c"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:30.488802 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-7b2987fe-85e4-4d0c-8f67-e38b6f4f86a3 req-5990b74c-a807-4024-be9c-d97b64412754 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:30.489530 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-7b2987fe-85e4-4d0c-8f67-e38b6f4f86a3 req-5990b74c-a807-4024-be9c-d97b64412754 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:30.507002 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-7b2987fe-85e4-4d0c-8f67-e38b6f4f86a3 req-5990b74c-a807-4024-be9c-d97b64412754 service nova] Creating event network-vif-deleted:24714ded-ea47-4891-9cd5-75d3ab6c0a9c for instance 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be on chh2-master-2 Jun 10 18:01:30.513425 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-7b2987fe-85e4-4d0c-8f67-e38b6f4f86a3 req-5990b74c-a807-4024-be9c-d97b64412754 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044975 Jun 10 18:01:30.515321 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 649/1342] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:01:30.522319 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1be9cb42-abcb-480a-9be1-e250baa8b629 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:30.523117 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1be9cb42-abcb-480a-9be1-e250baa8b629 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:30.557467 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1be9cb42-abcb-480a-9be1-e250baa8b629 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:30.557843 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1be9cb42-abcb-480a-9be1-e250baa8b629 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:30.558641 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1be9cb42-abcb-480a-9be1-e250baa8b629 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:30.559200 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1be9cb42-abcb-480a-9be1-e250baa8b629 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:30.577986 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d0f99353-a0b5-4c3a-9fd0-2b42e2e21cdf tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:30.588687 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d0f99353-a0b5-4c3a-9fd0-2b42e2e21cdf tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1470 microversion: 2.1 time: 0.535056 Jun 10 18:01:30.599000 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 694/1343] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:30 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1470 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:30.679374 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1be9cb42-abcb-480a-9be1-e250baa8b629 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.162504 Jun 10 18:01:30.691156 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 650/1344] 10.222.0.35 () {58 vars in 1274 bytes} [Fri Jun 10 18:01:30 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1/os-interface => generated 284 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:01:30.735365 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0693f382-4bc0-4725-b93f-602f8819b5e2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:30.735989 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0693f382-4bc0-4725-b93f-602f8819b5e2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:30.743437 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0693f382-4bc0-4725-b93f-602f8819b5e2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:30.743900 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0693f382-4bc0-4725-b93f-602f8819b5e2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:30.744803 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0693f382-4bc0-4725-b93f-602f8819b5e2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:30.745501 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0693f382-4bc0-4725-b93f-602f8819b5e2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:30.877528 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f7a56fe6-b54b-4a1f-83ab-612560c32cab tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:30.878529 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f7a56fe6-b54b-4a1f-83ab-612560c32cab tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:30.894065 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f7a56fe6-b54b-4a1f-83ab-612560c32cab tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:30.903449 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f7a56fe6-b54b-4a1f-83ab-612560c32cab tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:30.903449 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f7a56fe6-b54b-4a1f-83ab-612560c32cab tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:30.908121 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f7a56fe6-b54b-4a1f-83ab-612560c32cab tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:31.249566 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f7a56fe6-b54b-4a1f-83ab-612560c32cab tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:31.263749 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f7a56fe6-b54b-4a1f-83ab-612560c32cab tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1269 microversion: 2.1 time: 0.390333 Jun 10 18:01:31.266781 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 651/1345] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:30 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1269 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:31.282326 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c01cf3f2-1ee0-44ea-a8fa-078483d12c0e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:31.283373 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c01cf3f2-1ee0-44ea-a8fa-078483d12c0e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:31.297125 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c01cf3f2-1ee0-44ea-a8fa-078483d12c0e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:31.302337 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c01cf3f2-1ee0-44ea-a8fa-078483d12c0e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:31.303239 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c01cf3f2-1ee0-44ea-a8fa-078483d12c0e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:31.303691 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c01cf3f2-1ee0-44ea-a8fa-078483d12c0e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:31.315274 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0693f382-4bc0-4725-b93f-602f8819b5e2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:31.332999 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0693f382-4bc0-4725-b93f-602f8819b5e2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1475 microversion: 2.1 time: 0.601920 Jun 10 18:01:31.333840 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 695/1346] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:30 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1475 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:31.606138 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d2e8d98d-83c9-4317-a5fa-ce27fe4eadc9 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:31.606692 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d2e8d98d-83c9-4317-a5fa-ce27fe4eadc9 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:31.620107 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d2e8d98d-83c9-4317-a5fa-ce27fe4eadc9 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:31.620546 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d2e8d98d-83c9-4317-a5fa-ce27fe4eadc9 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:31.621696 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d2e8d98d-83c9-4317-a5fa-ce27fe4eadc9 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:31.622401 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d2e8d98d-83c9-4317-a5fa-ce27fe4eadc9 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:31.759582 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c01cf3f2-1ee0-44ea-a8fa-078483d12c0e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:31.773021 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c01cf3f2-1ee0-44ea-a8fa-078483d12c0e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:31.776125 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c01cf3f2-1ee0-44ea-a8fa-078483d12c0e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:31.778608 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c01cf3f2-1ee0-44ea-a8fa-078483d12c0e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1361 microversion: 2.25 time: 0.510094 Jun 10 18:01:31.779434 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 652/1347] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:01:31 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1361 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:01:31.831851 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d2e8d98d-83c9-4317-a5fa-ce27fe4eadc9 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:31.841627 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d2e8d98d-83c9-4317-a5fa-ce27fe4eadc9 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1470 microversion: 2.1 time: 0.239255 Jun 10 18:01:31.843500 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 696/1348] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:31 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1470 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:01:32.283377 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-27f2ab4a-b2c8-4711-a923-9ac9d3b43b53 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:32.285137 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-27f2ab4a-b2c8-4711-a923-9ac9d3b43b53 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:32.296547 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:01:32.298925 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27f2ab4a-b2c8-4711-a923-9ac9d3b43b53 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:32.301381 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27f2ab4a-b2c8-4711-a923-9ac9d3b43b53 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:32.308288 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27f2ab4a-b2c8-4711-a923-9ac9d3b43b53 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:32.309095 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27f2ab4a-b2c8-4711-a923-9ac9d3b43b53 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:32.356599 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fd98b61a-df48-44c2-8c0e-255c5133c38f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:32.358782 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fd98b61a-df48-44c2-8c0e-255c5133c38f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:32.382112 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd98b61a-df48-44c2-8c0e-255c5133c38f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:32.382112 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd98b61a-df48-44c2-8c0e-255c5133c38f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:32.382356 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd98b61a-df48-44c2-8c0e-255c5133c38f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:32.384587 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd98b61a-df48-44c2-8c0e-255c5133c38f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:32.671239 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fd98b61a-df48-44c2-8c0e-255c5133c38f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:32.686891 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fd98b61a-df48-44c2-8c0e-255c5133c38f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1473 microversion: 2.1 time: 0.339221 Jun 10 18:01:32.688095 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 697/1349] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:32 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1473 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:01:32.706872 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-0375d82e-b4af-4a01-a357-9b20f2fcc7b0 req-c753b0ef-3c4b-4b02-8882-aafeef2fddfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0864d26-b605-4a49-b099-8144ecfde9bc", "name": "network-vif-plugged", "status": "completed", "tag": "a5b5e0a1-0a97-4201-97ee-27e27e1763c7"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:32.720331 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-0375d82e-b4af-4a01-a357-9b20f2fcc7b0 req-c753b0ef-3c4b-4b02-8882-aafeef2fddfc service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:32.721033 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-0375d82e-b4af-4a01-a357-9b20f2fcc7b0 req-c753b0ef-3c4b-4b02-8882-aafeef2fddfc service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:32.737153 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-0375d82e-b4af-4a01-a357-9b20f2fcc7b0 req-c753b0ef-3c4b-4b02-8882-aafeef2fddfc service nova] Creating event network-vif-plugged:a5b5e0a1-0a97-4201-97ee-27e27e1763c7 for instance a0864d26-b605-4a49-b099-8144ecfde9bc on chh1-master-2 Jun 10 18:01:32.743523 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-0375d82e-b4af-4a01-a357-9b20f2fcc7b0 req-c753b0ef-3c4b-4b02-8882-aafeef2fddfc service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053850 Jun 10 18:01:32.748824 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 698/1350] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:01:32.807040 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ac276091-de3e-4698-9dbf-a0fe53d1228a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:32.810018 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ac276091-de3e-4698-9dbf-a0fe53d1228a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:32.822033 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-27f2ab4a-b2c8-4711-a923-9ac9d3b43b53 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:32.830152 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ac276091-de3e-4698-9dbf-a0fe53d1228a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:32.830620 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ac276091-de3e-4698-9dbf-a0fe53d1228a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:32.832415 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ac276091-de3e-4698-9dbf-a0fe53d1228a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:32.832876 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ac276091-de3e-4698-9dbf-a0fe53d1228a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:32.843018 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-27f2ab4a-b2c8-4711-a923-9ac9d3b43b53 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1275 microversion: 2.1 time: 0.564001 Jun 10 18:01:32.863975 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 653/1351] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:32 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1275 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:32.880870 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-83bc9340-439d-4515-bf45-ff0241266670 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:32.881920 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-83bc9340-439d-4515-bf45-ff0241266670 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:32.905265 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-83bc9340-439d-4515-bf45-ff0241266670 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:32.906055 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-83bc9340-439d-4515-bf45-ff0241266670 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:32.906934 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-83bc9340-439d-4515-bf45-ff0241266670 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:32.907463 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-83bc9340-439d-4515-bf45-ff0241266670 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:33.121554 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-83bc9340-439d-4515-bf45-ff0241266670 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:33.141373 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-83bc9340-439d-4515-bf45-ff0241266670 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1470 microversion: 2.1 time: 0.275931 Jun 10 18:01:33.144112 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 654/1352] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:32 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1470 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:33.158388 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ae255e12-9108-460d-a27b-4fdba39f6882 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:33.159757 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ae255e12-9108-460d-a27b-4fdba39f6882 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:33.165029 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=6 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:01:33.182064 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ae255e12-9108-460d-a27b-4fdba39f6882 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:33.184935 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ae255e12-9108-460d-a27b-4fdba39f6882 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:33.187138 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ae255e12-9108-460d-a27b-4fdba39f6882 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:33.190687 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ae255e12-9108-460d-a27b-4fdba39f6882 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:33.213502 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ac276091-de3e-4698-9dbf-a0fe53d1228a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:33.235571 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ac276091-de3e-4698-9dbf-a0fe53d1228a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:33.243245 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ac276091-de3e-4698-9dbf-a0fe53d1228a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:33.244613 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ac276091-de3e-4698-9dbf-a0fe53d1228a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1361 microversion: 2.25 time: 0.451313 Jun 10 18:01:33.245442 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 699/1353] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:01:32 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1361 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:01:33.250702 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-19e7e412-ce4f-416a-9ec3-bb825ca044d2 req-2fc60e12-c5e0-438f-84f9-779646f034d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "186b67b3-3538-4bc2-8528-53b43d701bf1", "tag": "128ee4eb-e784-41c8-acaa-39291810b2a4"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:33.281602 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-19e7e412-ce4f-416a-9ec3-bb825ca044d2 req-2fc60e12-c5e0-438f-84f9-779646f034d0 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:33.282060 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-19e7e412-ce4f-416a-9ec3-bb825ca044d2 req-2fc60e12-c5e0-438f-84f9-779646f034d0 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:33.309388 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-19e7e412-ce4f-416a-9ec3-bb825ca044d2 req-2fc60e12-c5e0-438f-84f9-779646f034d0 service nova] Creating event network-changed:128ee4eb-e784-41c8-acaa-39291810b2a4 for instance 186b67b3-3538-4bc2-8528-53b43d701bf1 on chh1-master-2 Jun 10 18:01:33.316367 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-19e7e412-ce4f-416a-9ec3-bb825ca044d2 req-2fc60e12-c5e0-438f-84f9-779646f034d0 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069465 Jun 10 18:01:33.317984 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 700/1354] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:01:33.539070 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ae255e12-9108-460d-a27b-4fdba39f6882 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:33.548985 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ae255e12-9108-460d-a27b-4fdba39f6882 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1549 microversion: 2.1 time: 0.402059 Jun 10 18:01:33.549573 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 655/1355] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:33 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1549 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:33.568372 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-41ad1552-a85b-4b8e-9af1-e3344a1f37f6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:33.569102 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-41ad1552-a85b-4b8e-9af1-e3344a1f37f6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:33.575898 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41ad1552-a85b-4b8e-9af1-e3344a1f37f6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:33.576452 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41ad1552-a85b-4b8e-9af1-e3344a1f37f6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:33.577310 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41ad1552-a85b-4b8e-9af1-e3344a1f37f6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:33.578107 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41ad1552-a85b-4b8e-9af1-e3344a1f37f6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:33.706011 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1c0489c5-6519-4ec9-86f1-183157bf8cbb tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:33.706693 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1c0489c5-6519-4ec9-86f1-183157bf8cbb tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:33.721336 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1c0489c5-6519-4ec9-86f1-183157bf8cbb tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:33.722293 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1c0489c5-6519-4ec9-86f1-183157bf8cbb tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:33.726123 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1c0489c5-6519-4ec9-86f1-183157bf8cbb tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:33.727575 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1c0489c5-6519-4ec9-86f1-183157bf8cbb tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:33.811264 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-41ad1552-a85b-4b8e-9af1-e3344a1f37f6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:33.819426 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-41ad1552-a85b-4b8e-9af1-e3344a1f37f6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1549 microversion: 2.1 time: 0.256575 Jun 10 18:01:33.829543 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 701/1356] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:33 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1549 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:33.869851 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3f076d6f-39ae-4e4a-b80e-9447791e3751 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:33.870471 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3f076d6f-39ae-4e4a-b80e-9447791e3751 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:33.877118 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3f076d6f-39ae-4e4a-b80e-9447791e3751 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:33.877570 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3f076d6f-39ae-4e4a-b80e-9447791e3751 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:33.878346 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3f076d6f-39ae-4e4a-b80e-9447791e3751 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:33.878781 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3f076d6f-39ae-4e4a-b80e-9447791e3751 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:33.989343 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1c0489c5-6519-4ec9-86f1-183157bf8cbb tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:34.000662 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1c0489c5-6519-4ec9-86f1-183157bf8cbb tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1470 microversion: 2.1 time: 0.300040 Jun 10 18:01:34.001255 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 656/1357] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:33 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1470 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:01:34.032750 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a0f2f59c-b4cd-4537-ad7d-50a07f3c0cf8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:34.033445 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a0f2f59c-b4cd-4537-ad7d-50a07f3c0cf8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:34.041060 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a0f2f59c-b4cd-4537-ad7d-50a07f3c0cf8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:34.041060 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a0f2f59c-b4cd-4537-ad7d-50a07f3c0cf8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:34.041800 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a0f2f59c-b4cd-4537-ad7d-50a07f3c0cf8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:34.042243 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a0f2f59c-b4cd-4537-ad7d-50a07f3c0cf8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:34.227886 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3f076d6f-39ae-4e4a-b80e-9447791e3751 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:34.240475 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3f076d6f-39ae-4e4a-b80e-9447791e3751 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1317 microversion: 2.1 time: 0.371477 Jun 10 18:01:34.249975 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 702/1358] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:33 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1317 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:01:34.267135 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-848088dc-91bc-4b3a-8c65-c35d7b42b457 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:34.267135 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-848088dc-91bc-4b3a-8c65-c35d7b42b457 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:34.286513 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-848088dc-91bc-4b3a-8c65-c35d7b42b457 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:34.287545 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-848088dc-91bc-4b3a-8c65-c35d7b42b457 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:34.288608 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-848088dc-91bc-4b3a-8c65-c35d7b42b457 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:34.290052 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-848088dc-91bc-4b3a-8c65-c35d7b42b457 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:34.302257 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a0f2f59c-b4cd-4537-ad7d-50a07f3c0cf8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "POST /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6/action" status: 204 len: 0 microversion: 2.1 time: 0.285388 Jun 10 18:01:34.306041 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 657/1359] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:01:34 2022] POST /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6/action => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:01:34.321819 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c23fa769-a2e8-4829-a2c6-79c8293c3baf tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:34.322558 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c23fa769-a2e8-4829-a2c6-79c8293c3baf tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:34.344142 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c23fa769-a2e8-4829-a2c6-79c8293c3baf tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:34.344632 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c23fa769-a2e8-4829-a2c6-79c8293c3baf tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:34.345511 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c23fa769-a2e8-4829-a2c6-79c8293c3baf tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:34.345849 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c23fa769-a2e8-4829-a2c6-79c8293c3baf tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:34.634377 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-848088dc-91bc-4b3a-8c65-c35d7b42b457 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:34.674987 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-848088dc-91bc-4b3a-8c65-c35d7b42b457 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1470 microversion: 2.1 time: 0.413352 Jun 10 18:01:34.676392 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 703/1360] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:34 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1470 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:34.690595 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5835d14e-4f11-485c-86b2-685c85d86a62 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:34.692605 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5835d14e-4f11-485c-86b2-685c85d86a62 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:34.709897 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5835d14e-4f11-485c-86b2-685c85d86a62 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:34.710623 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5835d14e-4f11-485c-86b2-685c85d86a62 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:34.715287 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5835d14e-4f11-485c-86b2-685c85d86a62 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:34.718567 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5835d14e-4f11-485c-86b2-685c85d86a62 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:34.860105 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c23fa769-a2e8-4829-a2c6-79c8293c3baf tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:34.878385 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c23fa769-a2e8-4829-a2c6-79c8293c3baf tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:34.886546 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c23fa769-a2e8-4829-a2c6-79c8293c3baf tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:34.888247 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c23fa769-a2e8-4829-a2c6-79c8293c3baf tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1361 microversion: 2.25 time: 0.583798 Jun 10 18:01:34.899242 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 658/1361] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:01:34 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1361 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:01:34.906350 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6a60b097-9e0e-4ed9-bf3a-1a5c8f96ef23 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:34.907918 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6a60b097-9e0e-4ed9-bf3a-1a5c8f96ef23 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:34.917263 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6a60b097-9e0e-4ed9-bf3a-1a5c8f96ef23 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:34.918438 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6a60b097-9e0e-4ed9-bf3a-1a5c8f96ef23 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:34.919465 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6a60b097-9e0e-4ed9-bf3a-1a5c8f96ef23 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:34.920800 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6a60b097-9e0e-4ed9-bf3a-1a5c8f96ef23 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:35.216426 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6a60b097-9e0e-4ed9-bf3a-1a5c8f96ef23 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:35.226058 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6a60b097-9e0e-4ed9-bf3a-1a5c8f96ef23 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1549 microversion: 2.1 time: 0.326189 Jun 10 18:01:35.243261 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 659/1362] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:34 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1549 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:35.260712 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4efbbbb4-7694-4133-b720-621965f60561 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:35.261586 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4efbbbb4-7694-4133-b720-621965f60561 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:35.271317 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4efbbbb4-7694-4133-b720-621965f60561 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:35.272038 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4efbbbb4-7694-4133-b720-621965f60561 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:35.273260 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4efbbbb4-7694-4133-b720-621965f60561 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:35.273868 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4efbbbb4-7694-4133-b720-621965f60561 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:35.436152 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5835d14e-4f11-485c-86b2-685c85d86a62 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:35.454184 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5835d14e-4f11-485c-86b2-685c85d86a62 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1470 microversion: 2.1 time: 0.772480 Jun 10 18:01:35.464159 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 704/1363] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:34 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1470 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:35.521770 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-0cbdd1ac-f93b-468b-9258-2dea273f017a req-00c12dc0-a07c-4039-b804-8edd1a9e41ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4", "tag": "d492be44-5990-4f08-b390-1c1031db44f7"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:35.540273 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-0cbdd1ac-f93b-468b-9258-2dea273f017a req-00c12dc0-a07c-4039-b804-8edd1a9e41ff service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:35.540974 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-0cbdd1ac-f93b-468b-9258-2dea273f017a req-00c12dc0-a07c-4039-b804-8edd1a9e41ff service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:35.561356 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-0cbdd1ac-f93b-468b-9258-2dea273f017a req-00c12dc0-a07c-4039-b804-8edd1a9e41ff service nova] Creating event network-changed:d492be44-5990-4f08-b390-1c1031db44f7 for instance ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 on chh2-master-2 Jun 10 18:01:35.573243 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-0cbdd1ac-f93b-468b-9258-2dea273f017a req-00c12dc0-a07c-4039-b804-8edd1a9e41ff service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055598 Jun 10 18:01:35.574163 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 705/1364] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:01:35.629041 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4efbbbb4-7694-4133-b720-621965f60561 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:35.638020 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4efbbbb4-7694-4133-b720-621965f60561 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1317 microversion: 2.1 time: 0.382307 Jun 10 18:01:35.642246 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 660/1365] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:35 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1317 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:01:35.693078 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-372eaf87-35a6-4afd-af65-7735382aa855 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:35.694484 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-372eaf87-35a6-4afd-af65-7735382aa855 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:35.700730 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-372eaf87-35a6-4afd-af65-7735382aa855 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:35.701197 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-372eaf87-35a6-4afd-af65-7735382aa855 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:35.701980 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-372eaf87-35a6-4afd-af65-7735382aa855 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:35.702414 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-372eaf87-35a6-4afd-af65-7735382aa855 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:35.908745 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5e6ff15f-ed48-48e4-8d5a-ce784f731d38 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:35.910907 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5e6ff15f-ed48-48e4-8d5a-ce784f731d38 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:35.918294 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5e6ff15f-ed48-48e4-8d5a-ce784f731d38 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:35.919033 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5e6ff15f-ed48-48e4-8d5a-ce784f731d38 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:35.920468 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5e6ff15f-ed48-48e4-8d5a-ce784f731d38 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:35.921510 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5e6ff15f-ed48-48e4-8d5a-ce784f731d38 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:35.927419 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:01:36.027940 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-372eaf87-35a6-4afd-af65-7735382aa855 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:36.041192 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-372eaf87-35a6-4afd-af65-7735382aa855 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1470 microversion: 2.1 time: 0.351654 Jun 10 18:01:36.043244 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 706/1366] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:35 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1470 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:36.105814 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5e6ff15f-ed48-48e4-8d5a-ce784f731d38 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:36.119362 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5e6ff15f-ed48-48e4-8d5a-ce784f731d38 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:36.144321 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5e6ff15f-ed48-48e4-8d5a-ce784f731d38 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:36.148773 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5e6ff15f-ed48-48e4-8d5a-ce784f731d38 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1557 microversion: 2.25 time: 0.245503 Jun 10 18:01:36.152830 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 661/1367] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:01:35 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1557 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:01:36.170961 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fcb64827-e7ac-42ca-ab53-2c779409f8da tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:36.172225 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fcb64827-e7ac-42ca-ab53-2c779409f8da tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:36.182689 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fcb64827-e7ac-42ca-ab53-2c779409f8da tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:36.183586 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fcb64827-e7ac-42ca-ab53-2c779409f8da tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:36.184885 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fcb64827-e7ac-42ca-ab53-2c779409f8da tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:36.185595 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fcb64827-e7ac-42ca-ab53-2c779409f8da tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:36.261311 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2deeb02d-86af-4016-9eed-7aac8134d385 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:36.261930 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2deeb02d-86af-4016-9eed-7aac8134d385 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:36.276008 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2deeb02d-86af-4016-9eed-7aac8134d385 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:36.276782 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2deeb02d-86af-4016-9eed-7aac8134d385 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:36.284889 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2deeb02d-86af-4016-9eed-7aac8134d385 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:36.285588 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2deeb02d-86af-4016-9eed-7aac8134d385 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:36.392890 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-fcb64827-e7ac-42ca-ab53-2c779409f8da tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lazy-loading 'services' on Instance uuid a0864d26-b605-4a49-b099-8144ecfde9bc {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:01:36.422346 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fcb64827-e7ac-42ca-ab53-2c779409f8da tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 2049 microversion: 2.25 time: 0.254792 Jun 10 18:01:36.423558 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 707/1368] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:01:36 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 2049 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:01:36.443530 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dc54585f-7328-46ab-8b80-4833ad4e38bb tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:36.445333 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:01:36.445333 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 18:01:36.447213 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc54585f-7328-46ab-8b80-4833ad4e38bb tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:36.447877 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc54585f-7328-46ab-8b80-4833ad4e38bb tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:36.448914 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc54585f-7328-46ab-8b80-4833ad4e38bb tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:36.449400 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc54585f-7328-46ab-8b80-4833ad4e38bb tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:36.482296 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dc54585f-7328-46ab-8b80-4833ad4e38bb tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] 10.222.0.35 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.044202 Jun 10 18:01:36.503303 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2deeb02d-86af-4016-9eed-7aac8134d385 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:36.505492 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 708/1369] 10.222.0.35 () {60 vars in 1216 bytes} [Fri Jun 10 18:01:36 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 10 18:01:36.512942 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2deeb02d-86af-4016-9eed-7aac8134d385 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.255027 Jun 10 18:01:36.515006 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 662/1370] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:36 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:01:36.517172 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-38d57b4a-075a-4859-b37d-b83afda02874 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:36.521038 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-38d57b4a-075a-4859-b37d-b83afda02874 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:36.534322 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0ad8e163-abbd-414a-b9b9-2c505679b9ed tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:36.539826 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0ad8e163-abbd-414a-b9b9-2c505679b9ed tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:36.542840 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-38d57b4a-075a-4859-b37d-b83afda02874 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:36.543303 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-38d57b4a-075a-4859-b37d-b83afda02874 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:36.552783 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0ad8e163-abbd-414a-b9b9-2c505679b9ed tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:36.553502 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0ad8e163-abbd-414a-b9b9-2c505679b9ed tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:36.554455 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0ad8e163-abbd-414a-b9b9-2c505679b9ed tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:36.555033 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0ad8e163-abbd-414a-b9b9-2c505679b9ed tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:36.566021 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-38d57b4a-075a-4859-b37d-b83afda02874 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:36.566021 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-38d57b4a-075a-4859-b37d-b83afda02874 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:36.779955 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0ad8e163-abbd-414a-b9b9-2c505679b9ed tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:36.790574 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-38d57b4a-075a-4859-b37d-b83afda02874 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:36.791066 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0ad8e163-abbd-414a-b9b9-2c505679b9ed tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.260043 Jun 10 18:01:36.791884 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 663/1371] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:36 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:36.798732 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-8409c132-4355-4692-8102-30d89d6ff786 req-e225306e-41e7-436c-adaf-b2a35d916d14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89b2f687-3173-411f-92fa-c2e4dde322f6", "name": "network-vif-plugged", "status": "completed", "tag": "ee1a855b-cfd0-4246-8752-23c466c46c38"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:36.799801 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-38d57b4a-075a-4859-b37d-b83afda02874 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1470 microversion: 2.1 time: 0.293153 Jun 10 18:01:36.800876 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 709/1372] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:36 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1470 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:36.806144 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4fdc777e-2161-45de-ac9c-5df63fb957d4 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:36.806979 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4fdc777e-2161-45de-ac9c-5df63fb957d4 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:36.810230 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-8409c132-4355-4692-8102-30d89d6ff786 req-e225306e-41e7-436c-adaf-b2a35d916d14 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:36.811249 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-8409c132-4355-4692-8102-30d89d6ff786 req-e225306e-41e7-436c-adaf-b2a35d916d14 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:36.815661 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4fdc777e-2161-45de-ac9c-5df63fb957d4 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:36.816383 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4fdc777e-2161-45de-ac9c-5df63fb957d4 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:36.817329 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4fdc777e-2161-45de-ac9c-5df63fb957d4 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:36.817963 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4fdc777e-2161-45de-ac9c-5df63fb957d4 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:36.826797 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-8409c132-4355-4692-8102-30d89d6ff786 req-e225306e-41e7-436c-adaf-b2a35d916d14 service nova] Creating event network-vif-plugged:ee1a855b-cfd0-4246-8752-23c466c46c38 for instance 89b2f687-3173-411f-92fa-c2e4dde322f6 on chh1-master-2 Jun 10 18:01:36.840913 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [req-8409c132-4355-4692-8102-30d89d6ff786 req-e225306e-41e7-436c-adaf-b2a35d916d14 service nova] Instance 89b2f687-3173-411f-92fa-c2e4dde322f6 is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126594) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 18:01:36.857129 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-8409c132-4355-4692-8102-30d89d6ff786 req-e225306e-41e7-436c-adaf-b2a35d916d14 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063688 Jun 10 18:01:36.861819 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 664/1373] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:01:36.975178 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4fdc777e-2161-45de-ac9c-5df63fb957d4 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:36.982802 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4fdc777e-2161-45de-ac9c-5df63fb957d4 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1317 microversion: 2.1 time: 0.180597 Jun 10 18:01:36.992262 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 710/1374] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:36 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:36.992262 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-04f79158-b445-4600-8258-2113053e2c4c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-951813295"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:36.992262 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-04f79158-b445-4600-8258-2113053e2c4c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:36.994999 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-04f79158-b445-4600-8258-2113053e2c4c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:36.995462 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-04f79158-b445-4600-8258-2113053e2c4c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:36.996237 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-04f79158-b445-4600-8258-2113053e2c4c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:36.996717 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-04f79158-b445-4600-8258-2113053e2c4c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:37.013632 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d437962e-2efd-42f3-8f50-3d5af43569b4 tempest-InstanceUsageAuditLogNegativeTestJSON-1255081976 tempest-InstanceUsageAuditLogNegativeTestJSON-1255081976-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:37.014679 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:01:37.014679 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 18:01:37.016472 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-d437962e-2efd-42f3-8f50-3d5af43569b4 tempest-InstanceUsageAuditLogNegativeTestJSON-1255081976 tempest-InstanceUsageAuditLogNegativeTestJSON-1255081976-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Jun 10 18:01:37.026938 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d437962e-2efd-42f3-8f50-3d5af43569b4 tempest-InstanceUsageAuditLogNegativeTestJSON-1255081976 tempest-InstanceUsageAuditLogNegativeTestJSON-1255081976-project-admin] Request method failure captured: Jun 10 18:01:37.026938 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Jun 10 18:01:37.026938 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:01:37.026938 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:01:37.026938 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:01:37.026938 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:01:37.026938 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:01:37.026938 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:01:37.026938 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:01:37.026938 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:01:37.026938 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4cA_01K_jw_ugY7roVr0pEZCFdXDkQ7tt-C3b48gVim3Y9RM2yAWYjTytSOM6Go21WCo3r7U_SkoeqD5j0ACanDwtgdOGs8Dr7p6IgfPpxotmcgk9vmFIMpJZABWbVD6Ey62c7ZdSrvN4C1BE7gRCDh7aVJcL0VnmN-zTVH3Q9rn68 Jun 10 18:01:37.026938 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:01:37.026938 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:01:37.026938 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:01:37.026938 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:01:37.026938 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:01:37.026938 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:01:37.026938 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 5e83a490f74843f8b1fa63ee98efa782 Jun 10 18:01:37.026938 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1255081976 Jun 10 18:01:37.026938 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member,admin Jun 10 18:01:37.026938 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member,admin Jun 10 18:01:37.028693 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/5e83a490f74843f8b1fa63ee98efa782"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/5e83a490f74843f8b1fa63ee98efa782"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/5e83a490f74843f8b1fa63ee98efa782"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_5e83a490f74843f8b1fa63ee98efa782", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:01:37.028693 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1255081976 Jun 10 18:01:37.028693 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 5e83a490f74843f8b1fa63ee98efa782 Jun 10 18:01:37.028693 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1255081976 Jun 10 18:01:37.028693 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1255081976-project-admin Jun 10 18:01:37.028693 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:01:37.028693 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:01:37.028693 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 499ca8166e6d43ef849f1b93c5a36b2d Jun 10 18:01:37.028693 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1255081976-project-admin Jun 10 18:01:37.028693 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:01:37.028693 chdv-master-2 devstack@n-api.service[126594]: exception: Invalid timestamp for date invalid_time Jun 10 18:01:37.029555 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'invalid_time'} Jun 10 18:01:37.029555 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:01:37.029555 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:37.029555 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Jun 10 18:01:37.029555 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Jun 10 18:01:37.029555 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Jun 10 18:01:37.029555 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Jun 10 18:01:37.029555 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Jun 10 18:01:37.029555 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Jun 10 18:01:37.029555 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Jun 10 18:01:37.029555 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:37.029555 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:01:37.029555 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:37.029555 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:37.029555 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:37.029555 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:37.029555 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:01:37.029555 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:01:37.029555 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:01:37.029555 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:01:37.030981 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Jun 10 18:01:37.030981 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Jun 10 18:01:37.030981 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Jun 10 18:01:37.030981 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:37.030981 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:01:37.030981 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:37.030981 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:37.030981 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:37.030981 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:37.030981 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:01:37.030981 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:01:37.030981 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Jun 10 18:01:37.030981 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:37.030981 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d437962e-2efd-42f3-8f50-3d5af43569b4 tempest-InstanceUsageAuditLogNegativeTestJSON-1255081976 tempest-InstanceUsageAuditLogNegativeTestJSON-1255081976-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:01:37.035320 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d437962e-2efd-42f3-8f50-3d5af43569b4 tempest-InstanceUsageAuditLogNegativeTestJSON-1255081976 tempest-InstanceUsageAuditLogNegativeTestJSON-1255081976-project-admin] 10.222.0.35 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.164459 Jun 10 18:01:37.035912 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 665/1375] 10.222.0.35 () {58 vars in 1223 bytes} [Fri Jun 10 18:01:36 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 174 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 10 18:01:37.142673 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5cf076dc-8218-4401-b341-6fb366d51375 tempest-InstanceUsageAuditLogNegativeTestJSON-1367799601 tempest-InstanceUsageAuditLogNegativeTestJSON-1367799601-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:37.143418 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:01:37.143418 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 18:01:37.144500 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5cf076dc-8218-4401-b341-6fb366d51375 tempest-InstanceUsageAuditLogNegativeTestJSON-1367799601 tempest-InstanceUsageAuditLogNegativeTestJSON-1367799601-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '60968333771649c4b6dbc997778a31df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea2d9e43ac94268a6fee8ae27f86f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:37.146003 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5cf076dc-8218-4401-b341-6fb366d51375 tempest-InstanceUsageAuditLogNegativeTestJSON-1367799601 tempest-InstanceUsageAuditLogNegativeTestJSON-1367799601-project] Request method failure captured: Jun 10 18:01:37.146003 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Jun 10 18:01:37.146003 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:01:37.146003 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:01:37.146003 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:01:37.146003 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:01:37.146003 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:01:37.146003 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:01:37.146003 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:01:37.146003 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:01:37.146003 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4b_m-eihn24DPr_dO_XTntuNcWjwtbrpRDYcDm8z2Zea1RfAnqbphOWmgKD6_Hp51vymrlcivNK6F_o6ahvZVYz6KG8SdIpeBmgnLR8DubG-d9QXVCac6Y4h1WUo-PeOiA1nFeE-uwaXBkmIcMhN_IQWZfIzKukFcOCm61zkGd-5Ek Jun 10 18:01:37.146003 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:01:37.146003 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:01:37.146003 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:01:37.146003 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:01:37.146003 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:01:37.146003 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:01:37.146003 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 6ea2d9e43ac94268a6fee8ae27f86f2f Jun 10 18:01:37.146003 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1367799601 Jun 10 18:01:37.146003 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:01:37.146003 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:01:37.147651 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/6ea2d9e43ac94268a6fee8ae27f86f2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/6ea2d9e43ac94268a6fee8ae27f86f2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/6ea2d9e43ac94268a6fee8ae27f86f2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_6ea2d9e43ac94268a6fee8ae27f86f2f", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:01:37.147651 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1367799601 Jun 10 18:01:37.147651 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 6ea2d9e43ac94268a6fee8ae27f86f2f Jun 10 18:01:37.147651 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1367799601 Jun 10 18:01:37.147651 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1367799601-project Jun 10 18:01:37.147651 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:01:37.147651 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:01:37.147651 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 60968333771649c4b6dbc997778a31df Jun 10 18:01:37.147651 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1367799601-project Jun 10 18:01:37.147651 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:01:37.147651 chdv-master-2 devstack@n-api.service[126594]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jun 10 18:01:37.149266 chdv-master-2 devstack@n-api.service[126594]: action_args: {} Jun 10 18:01:37.149266 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:01:37.149266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:37.149266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:37.149266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:37.149266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:01:37.149266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:01:37.149266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:01:37.149266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:01:37.149266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Jun 10 18:01:37.149266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Jun 10 18:01:37.149266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 10 18:01:37.149266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 10 18:01:37.149266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 10 18:01:37.149266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 10 18:01:37.149266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 18:01:37.149266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 18:01:37.149266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 18:01:37.149266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 18:01:37.149266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 10 18:01:37.150594 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 10 18:01:37.150594 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 10 18:01:37.150594 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 10 18:01:37.150594 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 10 18:01:37.150594 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 10 18:01:37.150594 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jun 10 18:01:37.150594 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:37.150594 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:01:37.150594 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:37.150594 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:37.150594 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:37.150594 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:37.150594 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 10 18:01:37.150594 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 10 18:01:37.150594 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jun 10 18:01:37.150594 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:37.150594 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5cf076dc-8218-4401-b341-6fb366d51375 tempest-InstanceUsageAuditLogNegativeTestJSON-1367799601 tempest-InstanceUsageAuditLogNegativeTestJSON-1367799601-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:01:37.152068 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5cf076dc-8218-4401-b341-6fb366d51375 tempest-InstanceUsageAuditLogNegativeTestJSON-1367799601 tempest-InstanceUsageAuditLogNegativeTestJSON-1367799601-project] 10.222.0.35 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.104366 Jun 10 18:01:37.152068 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 666/1376] 10.222.0.35 () {58 vars in 1184 bytes} [Fri Jun 10 18:01:37 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 105 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:01:37.152964 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-32af5f21-8657-4fa5-b071-34ce2fc3b5b5 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:37.153686 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-32af5f21-8657-4fa5-b071-34ce2fc3b5b5 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:37.159938 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-32af5f21-8657-4fa5-b071-34ce2fc3b5b5 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:37.160418 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-32af5f21-8657-4fa5-b071-34ce2fc3b5b5 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:37.161198 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-32af5f21-8657-4fa5-b071-34ce2fc3b5b5 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:37.161639 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-32af5f21-8657-4fa5-b071-34ce2fc3b5b5 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:37.295861 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-32af5f21-8657-4fa5-b071-34ce2fc3b5b5 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:37.303791 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-32af5f21-8657-4fa5-b071-34ce2fc3b5b5 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1470 microversion: 2.1 time: 0.155039 Jun 10 18:01:37.313926 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 667/1377] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:37 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:37.313926 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-215e906c-c745-4944-9412-6581216f2c96 tempest-InstanceUsageAuditLogNegativeTestJSON-1367799601 tempest-InstanceUsageAuditLogNegativeTestJSON-1367799601-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:37.313926 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:01:37.313926 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 18:01:37.313926 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-215e906c-c745-4944-9412-6581216f2c96 tempest-InstanceUsageAuditLogNegativeTestJSON-1367799601 tempest-InstanceUsageAuditLogNegativeTestJSON-1367799601-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '60968333771649c4b6dbc997778a31df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea2d9e43ac94268a6fee8ae27f86f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:37.314455 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-215e906c-c745-4944-9412-6581216f2c96 tempest-InstanceUsageAuditLogNegativeTestJSON-1367799601 tempest-InstanceUsageAuditLogNegativeTestJSON-1367799601-project] Request method failure captured: Jun 10 18:01:37.314455 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-06-10%2018:01:37 HTTP/1.1 Jun 10 18:01:37.314455 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:01:37.314455 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:01:37.314455 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:01:37.314455 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:01:37.314455 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:01:37.314455 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:01:37.314455 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:01:37.314455 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:01:37.314455 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4b_m-eihn24DPr_dO_XTntuNcWjwtbrpRDYcDm8z2Zea1RfAnqbphOWmgKD6_Hp51vymrlcivNK6F_o6ahvZVYz6KG8SdIpeBmgnLR8DubG-d9QXVCac6Y4h1WUo-PeOiA1nFeE-uwaXBkmIcMhN_IQWZfIzKukFcOCm61zkGd-5Ek Jun 10 18:01:37.314455 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:01:37.314455 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:01:37.314455 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:01:37.314455 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:01:37.314455 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:01:37.314455 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:01:37.314455 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 6ea2d9e43ac94268a6fee8ae27f86f2f Jun 10 18:01:37.314455 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1367799601 Jun 10 18:01:37.314455 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:01:37.314455 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:01:37.316097 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/6ea2d9e43ac94268a6fee8ae27f86f2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/6ea2d9e43ac94268a6fee8ae27f86f2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/6ea2d9e43ac94268a6fee8ae27f86f2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_6ea2d9e43ac94268a6fee8ae27f86f2f", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:01:37.316097 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1367799601 Jun 10 18:01:37.316097 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 6ea2d9e43ac94268a6fee8ae27f86f2f Jun 10 18:01:37.316097 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1367799601 Jun 10 18:01:37.316097 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1367799601-project Jun 10 18:01:37.316097 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:01:37.316097 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:01:37.316097 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 60968333771649c4b6dbc997778a31df Jun 10 18:01:37.316097 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1367799601-project Jun 10 18:01:37.316097 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:01:37.316097 chdv-master-2 devstack@n-api.service[126594]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jun 10 18:01:37.316866 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '2022-06-10 18:01:37'} Jun 10 18:01:37.316866 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:01:37.316866 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:37.316866 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:37.316866 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:37.316866 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:01:37.316866 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:01:37.316866 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:01:37.316866 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:01:37.316866 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Jun 10 18:01:37.316866 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Jun 10 18:01:37.316866 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 10 18:01:37.316866 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 10 18:01:37.316866 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 10 18:01:37.316866 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 10 18:01:37.316866 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 18:01:37.316866 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 18:01:37.316866 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 18:01:37.316866 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 18:01:37.316866 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 10 18:01:37.318041 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 10 18:01:37.318041 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 10 18:01:37.318041 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 10 18:01:37.318041 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 10 18:01:37.318041 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 10 18:01:37.318041 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jun 10 18:01:37.318041 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:37.318041 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:01:37.318041 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:37.318041 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:01:37.318041 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:01:37.318041 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:01:37.318041 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 10 18:01:37.318041 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 10 18:01:37.318041 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jun 10 18:01:37.318041 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:01:37.318041 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-215e906c-c745-4944-9412-6581216f2c96 tempest-InstanceUsageAuditLogNegativeTestJSON-1367799601 tempest-InstanceUsageAuditLogNegativeTestJSON-1367799601-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:01:37.319581 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-215e906c-c745-4944-9412-6581216f2c96 tempest-InstanceUsageAuditLogNegativeTestJSON-1367799601 tempest-InstanceUsageAuditLogNegativeTestJSON-1367799601-project] 10.222.0.35 "GET /compute/v2.1/os-instance_usage_audit_log/2022-06-10 18:01:37" status: 403 len: 128 microversion: 2.1 time: 0.009034 Jun 10 18:01:37.319581 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 668/1378] 10.222.0.35 () {58 vars in 1250 bytes} [Fri Jun 10 18:01:37 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-06-10%2018%3A01%3A37 => generated 128 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:01:37.380874 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:01:37.574015 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-04f79158-b445-4600-8258-2113053e2c4c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "POST /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1/action" status: 202 len: 0 microversion: 2.1 time: 0.589125 Jun 10 18:01:37.575552 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 711/1379] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:01:36 2022] POST /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1/action => generated 0 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jun 10 18:01:37.838631 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b7eeec3a-b499-44f7-8db0-5d78c9f98586 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:37.838631 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b7eeec3a-b499-44f7-8db0-5d78c9f98586 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:37.838631 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b7eeec3a-b499-44f7-8db0-5d78c9f98586 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:37.838631 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b7eeec3a-b499-44f7-8db0-5d78c9f98586 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:37.839009 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b7eeec3a-b499-44f7-8db0-5d78c9f98586 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:37.839009 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b7eeec3a-b499-44f7-8db0-5d78c9f98586 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:37.971046 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b7eeec3a-b499-44f7-8db0-5d78c9f98586 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:37.978818 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b7eeec3a-b499-44f7-8db0-5d78c9f98586 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1470 microversion: 2.1 time: 0.163833 Jun 10 18:01:37.979391 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 669/1380] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:37 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1470 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:38.000240 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7efa5512-b28b-4445-8530-81ba4738ddbd tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:38.000960 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7efa5512-b28b-4445-8530-81ba4738ddbd tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:38.007174 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7efa5512-b28b-4445-8530-81ba4738ddbd tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:38.007623 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7efa5512-b28b-4445-8530-81ba4738ddbd tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:38.008405 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7efa5512-b28b-4445-8530-81ba4738ddbd tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:38.008842 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7efa5512-b28b-4445-8530-81ba4738ddbd tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:38.164885 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7efa5512-b28b-4445-8530-81ba4738ddbd tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:38.177686 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7efa5512-b28b-4445-8530-81ba4738ddbd tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1317 microversion: 2.1 time: 0.177756 Jun 10 18:01:38.177686 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 712/1381] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:37 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:38.324837 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-dc133ff4-5256-4328-8238-b47caebb4764 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:38.325697 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-dc133ff4-5256-4328-8238-b47caebb4764 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:38.333223 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dc133ff4-5256-4328-8238-b47caebb4764 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:38.333900 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dc133ff4-5256-4328-8238-b47caebb4764 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:38.334687 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dc133ff4-5256-4328-8238-b47caebb4764 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:38.335131 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dc133ff4-5256-4328-8238-b47caebb4764 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:38.487954 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=24 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:01:38.496273 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-dc133ff4-5256-4328-8238-b47caebb4764 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:38.510430 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-dc133ff4-5256-4328-8238-b47caebb4764 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1470 microversion: 2.1 time: 0.191428 Jun 10 18:01:38.511084 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 670/1382] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:38 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1470 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:38.995345 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-97d9212c-7bec-455f-a4e2-0b326ad1ec59 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:38.995981 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-97d9212c-7bec-455f-a4e2-0b326ad1ec59 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:38.998171 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=6 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:01:39.003874 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-97d9212c-7bec-455f-a4e2-0b326ad1ec59 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:39.007123 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-97d9212c-7bec-455f-a4e2-0b326ad1ec59 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:39.007123 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-97d9212c-7bec-455f-a4e2-0b326ad1ec59 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:39.007123 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-97d9212c-7bec-455f-a4e2-0b326ad1ec59 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:39.140284 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-97d9212c-7bec-455f-a4e2-0b326ad1ec59 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:39.148204 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-97d9212c-7bec-455f-a4e2-0b326ad1ec59 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1470 microversion: 2.1 time: 0.156890 Jun 10 18:01:39.148867 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 713/1383] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:38 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:01:39.189531 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-db307c05-0b72-4199-8c4a-f4fe2bde9b2a tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:39.190170 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-db307c05-0b72-4199-8c4a-f4fe2bde9b2a tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:39.197935 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-db307c05-0b72-4199-8c4a-f4fe2bde9b2a tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:39.198325 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-db307c05-0b72-4199-8c4a-f4fe2bde9b2a tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:39.199125 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-db307c05-0b72-4199-8c4a-f4fe2bde9b2a tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:39.199562 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-db307c05-0b72-4199-8c4a-f4fe2bde9b2a tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:39.373420 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-db307c05-0b72-4199-8c4a-f4fe2bde9b2a tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:39.383423 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-db307c05-0b72-4199-8c4a-f4fe2bde9b2a tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1317 microversion: 2.1 time: 0.197830 Jun 10 18:01:39.394947 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 671/1384] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:39 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:39.528897 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4977a65c-b42e-48ec-a0b6-5b273755e10e tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:39.530281 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4977a65c-b42e-48ec-a0b6-5b273755e10e tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:39.536545 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4977a65c-b42e-48ec-a0b6-5b273755e10e tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:39.537005 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4977a65c-b42e-48ec-a0b6-5b273755e10e tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:39.537762 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4977a65c-b42e-48ec-a0b6-5b273755e10e tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:39.538196 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4977a65c-b42e-48ec-a0b6-5b273755e10e tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:39.690695 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4977a65c-b42e-48ec-a0b6-5b273755e10e tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:39.699465 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4977a65c-b42e-48ec-a0b6-5b273755e10e tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1470 microversion: 2.1 time: 0.175052 Jun 10 18:01:39.700059 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 714/1385] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:39 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1470 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:39.744955 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-faed7d92-ccaf-4963-a7af-403244ac94e9 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "416221aa-2986-462a-b30c-e5d67dfe2433", "device": "/dev/xvdb"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:39.746132 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-faed7d92-ccaf-4963-a7af-403244ac94e9 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:39.752733 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-faed7d92-ccaf-4963-a7af-403244ac94e9 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:39.753192 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-faed7d92-ccaf-4963-a7af-403244ac94e9 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:39.753958 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-faed7d92-ccaf-4963-a7af-403244ac94e9 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:39.754403 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-faed7d92-ccaf-4963-a7af-403244ac94e9 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:40.166984 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6a5b2882-fae9-4ab3-81e1-0b87c6fa3fba tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:40.167747 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6a5b2882-fae9-4ab3-81e1-0b87c6fa3fba tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:40.175563 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a5b2882-fae9-4ab3-81e1-0b87c6fa3fba tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:40.176197 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a5b2882-fae9-4ab3-81e1-0b87c6fa3fba tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:40.177133 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a5b2882-fae9-4ab3-81e1-0b87c6fa3fba tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:40.177787 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a5b2882-fae9-4ab3-81e1-0b87c6fa3fba tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:40.319701 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6a5b2882-fae9-4ab3-81e1-0b87c6fa3fba tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:40.327986 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6a5b2882-fae9-4ab3-81e1-0b87c6fa3fba tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1462 microversion: 2.1 time: 0.165047 Jun 10 18:01:40.346728 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 715/1386] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:40 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1462 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:40.351626 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-058796ec-5ef4-40be-82f9-5ced1de65cdf tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:40.352249 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-058796ec-5ef4-40be-82f9-5ced1de65cdf tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:40.360007 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-058796ec-5ef4-40be-82f9-5ced1de65cdf tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:40.360493 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-058796ec-5ef4-40be-82f9-5ced1de65cdf tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:40.361258 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-058796ec-5ef4-40be-82f9-5ced1de65cdf tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:40.361693 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-058796ec-5ef4-40be-82f9-5ced1de65cdf tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:40.458468 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-faed7d92-ccaf-4963-a7af-403244ac94e9 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "POST /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.717318 Jun 10 18:01:40.459126 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 672/1387] 10.222.0.35 () {62 vars in 1363 bytes} [Fri Jun 10 18:01:39 2022] POST /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc/os-volume_attachments => generated 194 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:01:40.467937 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-91e4cd25-8a4d-4475-b432-ad6974476aa5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:40.468798 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-91e4cd25-8a4d-4475-b432-ad6974476aa5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:40.477810 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-91e4cd25-8a4d-4475-b432-ad6974476aa5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:40.478526 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-91e4cd25-8a4d-4475-b432-ad6974476aa5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:40.479318 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-91e4cd25-8a4d-4475-b432-ad6974476aa5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:40.479842 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-91e4cd25-8a4d-4475-b432-ad6974476aa5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:40.507428 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-058796ec-5ef4-40be-82f9-5ced1de65cdf tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:40.514989 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-058796ec-5ef4-40be-82f9-5ced1de65cdf tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1462 microversion: 2.1 time: 0.167143 Jun 10 18:01:40.516182 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 716/1388] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:40 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1462 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:40.534556 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3d461412-5373-42db-a1ef-8d89bc403988 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Action: 'create', calling method: .version_select at 0x7f77c162b160>, body: {"keypair": {"name": "tempest-keypair-998261225", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTC2Af2ZR2ppEguiJeqN+zH3C+kdy4Wdy1Rju07qgtpbZc1df9HmJl9qvn4gQrwYqKD596jMvmIRAo1Dz2XA0CYqmK28yUi3wntZsnSj9Vz1gqJrj4qXj/S0Wg7AMxvNA=="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:40.553452 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-3d461412-5373-42db-a1ef-8d89bc403988 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Getting quotas for project 66fd5e2ed0b84720849784c94f36d5da. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:01:40.556066 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:01:40.559782 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-3d461412-5373-42db-a1ef-8d89bc403988 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Getting quotas for user 1c74f45bf7fd4dea952d771a649519af and project 66fd5e2ed0b84720849784c94f36d5da. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:01:40.639368 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-91e4cd25-8a4d-4475-b432-ad6974476aa5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:40.646807 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-91e4cd25-8a4d-4475-b432-ad6974476aa5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1317 microversion: 2.1 time: 0.184986 Jun 10 18:01:40.647367 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 673/1389] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:40 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:40.690483 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3d461412-5373-42db-a1ef-8d89bc403988 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.159617 Jun 10 18:01:40.691444 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 717/1390] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 18:01:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:01:40.720202 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c8ab56d5-8689-44a6-97d5-e320c894d8d7 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:40.728808 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c8ab56d5-8689-44a6-97d5-e320c894d8d7 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:40.735583 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c8ab56d5-8689-44a6-97d5-e320c894d8d7 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:40.736041 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c8ab56d5-8689-44a6-97d5-e320c894d8d7 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:40.736862 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c8ab56d5-8689-44a6-97d5-e320c894d8d7 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:40.737334 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c8ab56d5-8689-44a6-97d5-e320c894d8d7 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:40.925881 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c8ab56d5-8689-44a6-97d5-e320c894d8d7 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:40.940020 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c8ab56d5-8689-44a6-97d5-e320c894d8d7 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1470 microversion: 2.1 time: 0.225472 Jun 10 18:01:40.940936 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 674/1391] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:40 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1470 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:41.650672 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d7344b5a-6695-4614-8e4b-a97c27fbda43 tempest-QuotaClassesAdmin257Test-534396811 tempest-QuotaClassesAdmin257Test-534396811-project-admin] Calling method '.version_select at 0x7f77c628c5e0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:41.650672 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:01:41.650672 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 18:01:41.650672 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d7344b5a-6695-4614-8e4b-a97c27fbda43 tempest-QuotaClassesAdmin257Test-534396811 tempest-QuotaClassesAdmin257Test-534396811-project-admin] 10.222.0.35 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.143123 Jun 10 18:01:41.650672 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 718/1392] 10.222.0.35 () {60 vars in 1225 bytes} [Fri Jun 10 18:01:41 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:01:41.660543 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5b401242-67cb-49c6-827d-15b8ee342581 tempest-QuotaClassesAdmin257Test-534396811 tempest-QuotaClassesAdmin257Test-534396811-project-admin] Action: 'update', calling method: .version_select at 0x7f77c093d9d0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:41.663371 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:01:41.663371 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 18:01:41.670907 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-eb898cc4-ddb1-4595-9264-30a36b99771f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:41.671546 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-eb898cc4-ddb1-4595-9264-30a36b99771f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:41.678349 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eb898cc4-ddb1-4595-9264-30a36b99771f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:41.679154 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eb898cc4-ddb1-4595-9264-30a36b99771f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:41.680040 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eb898cc4-ddb1-4595-9264-30a36b99771f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:41.680608 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eb898cc4-ddb1-4595-9264-30a36b99771f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:41.832961 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-eb898cc4-ddb1-4595-9264-30a36b99771f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:41.840996 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-eb898cc4-ddb1-4595-9264-30a36b99771f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1317 microversion: 2.1 time: 0.175921 Jun 10 18:01:41.842595 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 719/1393] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:41 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:41.967810 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2e4cd705-4528-4950-9a5a-e76392e46072 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:41.967810 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2e4cd705-4528-4950-9a5a-e76392e46072 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:41.975494 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e4cd705-4528-4950-9a5a-e76392e46072 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:41.977833 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e4cd705-4528-4950-9a5a-e76392e46072 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:41.977833 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e4cd705-4528-4950-9a5a-e76392e46072 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:41.977833 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e4cd705-4528-4950-9a5a-e76392e46072 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:42.121100 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2e4cd705-4528-4950-9a5a-e76392e46072 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:42.130445 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2e4cd705-4528-4950-9a5a-e76392e46072 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1470 microversion: 2.1 time: 0.174680 Jun 10 18:01:42.131271 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 720/1394] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:41 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1470 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:42.477068 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5b401242-67cb-49c6-827d-15b8ee342581 tempest-QuotaClassesAdmin257Test-534396811 tempest-QuotaClassesAdmin257Test-534396811-project-admin] 10.222.0.35 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.823058 Jun 10 18:01:42.478288 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 675/1395] 10.222.0.35 () {62 vars in 1246 bytes} [Fri Jun 10 18:01:41 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:01:42.488151 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6eef014c-068c-444a-8891-aa38c1f8422a tempest-QuotaClassesAdmin257Test-534396811 tempest-QuotaClassesAdmin257Test-534396811-project-admin] Calling method '.version_select at 0x7f77c16ff310>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:42.488992 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:01:42.488992 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 18:01:42.501526 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6eef014c-068c-444a-8891-aa38c1f8422a tempest-QuotaClassesAdmin257Test-534396811 tempest-QuotaClassesAdmin257Test-534396811-project-admin] 10.222.0.35 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.017261 Jun 10 18:01:42.502376 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 721/1396] 10.222.0.35 () {60 vars in 1225 bytes} [Fri Jun 10 18:01:42 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:01:42.517199 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cb38b866-ef28-4686-a4b4-3fccc8e022cb tempest-QuotaClassesAdmin257Test-534396811 tempest-QuotaClassesAdmin257Test-534396811-project-admin] Action: 'update', calling method: .version_select at 0x7f77c09df1f0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:42.860167 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d4d0b33a-6747-49c5-8741-d9ea10398b2e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:42.861710 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d4d0b33a-6747-49c5-8741-d9ea10398b2e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:42.869053 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d4d0b33a-6747-49c5-8741-d9ea10398b2e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:42.869513 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d4d0b33a-6747-49c5-8741-d9ea10398b2e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:42.870521 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d4d0b33a-6747-49c5-8741-d9ea10398b2e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:42.870972 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d4d0b33a-6747-49c5-8741-d9ea10398b2e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:43.102736 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d4d0b33a-6747-49c5-8741-d9ea10398b2e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:43.110440 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d4d0b33a-6747-49c5-8741-d9ea10398b2e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1317 microversion: 2.1 time: 0.256045 Jun 10 18:01:43.111024 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 722/1397] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:42 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:43.135939 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cb38b866-ef28-4686-a4b4-3fccc8e022cb tempest-QuotaClassesAdmin257Test-534396811 tempest-QuotaClassesAdmin257Test-534396811-project-admin] 10.222.0.35 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.626300 Jun 10 18:01:43.136988 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 676/1398] 10.222.0.35 () {62 vars in 1246 bytes} [Fri Jun 10 18:01:42 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 10 18:01:43.149441 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-70e95c24-7fc6-4088-a2af-e16c32f41b2d tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:43.150136 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-70e95c24-7fc6-4088-a2af-e16c32f41b2d tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:43.162205 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70e95c24-7fc6-4088-a2af-e16c32f41b2d tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:43.163872 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70e95c24-7fc6-4088-a2af-e16c32f41b2d tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:43.163999 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70e95c24-7fc6-4088-a2af-e16c32f41b2d tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:43.165193 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70e95c24-7fc6-4088-a2af-e16c32f41b2d tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:43.389959 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-70e95c24-7fc6-4088-a2af-e16c32f41b2d tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:43.407613 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-70e95c24-7fc6-4088-a2af-e16c32f41b2d tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1470 microversion: 2.1 time: 0.262774 Jun 10 18:01:43.408289 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 723/1399] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:43 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1470 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:43.477612 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0857d52d-eb39-49e1-a87c-8c969a06f9fc tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Calling method '.version_select at 0x7f77c09cef70>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:43.480789 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0857d52d-eb39-49e1-a87c-8c969a06f9fc tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:43.487530 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0857d52d-eb39-49e1-a87c-8c969a06f9fc tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:43.494353 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0857d52d-eb39-49e1-a87c-8c969a06f9fc tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] 10.222.0.35 "GET /compute/v2.1/os-migrations" status: 200 len: 2338 microversion: 2.1 time: 0.021064 Jun 10 18:01:43.495373 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 677/1400] 10.222.0.35 () {58 vars in 1142 bytes} [Fri Jun 10 18:01:43 2022] GET /compute/v2.1/os-migrations => generated 2338 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:43.515211 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1dd4544a-e378-467f-8075-9b01dcc4c1a5 tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:43.522330 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1dd4544a-e378-467f-8075-9b01dcc4c1a5 tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011741 Jun 10 18:01:43.522939 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 724/1401] 10.222.0.35 () {58 vars in 1136 bytes} [Fri Jun 10 18:01:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:01:43.533487 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6aaf6b76-84cc-4daf-b005-f98f7a71af76 tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-2012543285", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:43.539432 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:01:43.539432 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 18:01:43.632056 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6aaf6b76-84cc-4daf-b005-f98f7a71af76 tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.102306 Jun 10 18:01:43.638323 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 678/1402] 10.222.0.35 () {60 vars in 1145 bytes} [Fri Jun 10 18:01:43 2022] POST /compute/v2.1/flavors => generated 499 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:01:43.643557 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-041d8bb8-31fe-4432-ab50-510b3064568f tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:43.651806 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-041d8bb8-31fe-4432-ab50-510b3064568f tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.011807 Jun 10 18:01:43.652512 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 725/1403] 10.222.0.35 () {58 vars in 1181 bytes} [Fri Jun 10 18:01:43 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:01:43.790806 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d71a3bf6-67b8-42d9-8e82-5bfb75b2541c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1035904655", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "0808ae9d-5d11-4d53-9cba-46dd87bed7aa"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:43.853730 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-d71a3bf6-67b8-42d9-8e82-5bfb75b2541c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] validate_networks() for None {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:01:44.114226 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-d71a3bf6-67b8-42d9-8e82-5bfb75b2541c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:01:44.122386 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-d71a3bf6-67b8-42d9-8e82-5bfb75b2541c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:01:44.122386 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-d71a3bf6-67b8-42d9-8e82-5bfb75b2541c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:01:44.122386 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-d71a3bf6-67b8-42d9-8e82-5bfb75b2541c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:01:44.122386 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-d71a3bf6-67b8-42d9-8e82-5bfb75b2541c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:01:44.140612 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e59676ee-7281-41d6-80b2-58f5661d67c8 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:44.140612 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e59676ee-7281-41d6-80b2-58f5661d67c8 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:44.146199 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d71a3bf6-67b8-42d9-8e82-5bfb75b2541c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:44.149539 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d71a3bf6-67b8-42d9-8e82-5bfb75b2541c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:44.150451 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d71a3bf6-67b8-42d9-8e82-5bfb75b2541c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:44.150905 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d71a3bf6-67b8-42d9-8e82-5bfb75b2541c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:44.152500 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e59676ee-7281-41d6-80b2-58f5661d67c8 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:44.153562 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e59676ee-7281-41d6-80b2-58f5661d67c8 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:44.157723 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e59676ee-7281-41d6-80b2-58f5661d67c8 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:44.158763 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e59676ee-7281-41d6-80b2-58f5661d67c8 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:44.217663 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-d71a3bf6-67b8-42d9-8e82-5bfb75b2541c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Getting quotas for project 66fd5e2ed0b84720849784c94f36d5da. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:01:44.244652 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-d71a3bf6-67b8-42d9-8e82-5bfb75b2541c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Getting quotas for user 1c74f45bf7fd4dea952d771a649519af and project 66fd5e2ed0b84720849784c94f36d5da. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:01:44.303771 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d71a3bf6-67b8-42d9-8e82-5bfb75b2541c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:01:44.307763 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d71a3bf6-67b8-42d9-8e82-5bfb75b2541c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:01:44.449799 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d71a3bf6-67b8-42d9-8e82-5bfb75b2541c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.663394 Jun 10 18:01:44.456601 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 679/1404] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:01:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:01:44.462183 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-350a3634-6b1f-4499-9d0f-13dffc5c0e31 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:44.469867 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-350a3634-6b1f-4499-9d0f-13dffc5c0e31 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:44.476782 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-350a3634-6b1f-4499-9d0f-13dffc5c0e31 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:44.477335 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-350a3634-6b1f-4499-9d0f-13dffc5c0e31 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:44.478613 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-350a3634-6b1f-4499-9d0f-13dffc5c0e31 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:44.479234 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-350a3634-6b1f-4499-9d0f-13dffc5c0e31 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:44.597252 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e59676ee-7281-41d6-80b2-58f5661d67c8 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:44.607533 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e59676ee-7281-41d6-80b2-58f5661d67c8 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1317 microversion: 2.1 time: 0.482032 Jun 10 18:01:44.608789 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 726/1405] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:44 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1317 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:44.626425 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fa17f630-8367-4850-8b5b-be2f46d2ad66 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:44.640748 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fa17f630-8367-4850-8b5b-be2f46d2ad66 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:44.653876 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa17f630-8367-4850-8b5b-be2f46d2ad66 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:44.654933 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa17f630-8367-4850-8b5b-be2f46d2ad66 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:44.655768 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa17f630-8367-4850-8b5b-be2f46d2ad66 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:44.656274 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa17f630-8367-4850-8b5b-be2f46d2ad66 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:44.773698 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-350a3634-6b1f-4499-9d0f-13dffc5c0e31 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1690 microversion: 2.1 time: 0.320007 Jun 10 18:01:44.774241 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 680/1406] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:44 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1690 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:44.779977 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-cf1e5149-1dc3-45f2-9a21-7c68e87d9bcf req-c2277f84-d802-4226-a51b-b376df929900 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "186b67b3-3538-4bc2-8528-53b43d701bf1", "name": "network-vif-plugged", "status": "completed", "tag": "128ee4eb-e784-41c8-acaa-39291810b2a4"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:44.789776 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-cf1e5149-1dc3-45f2-9a21-7c68e87d9bcf req-c2277f84-d802-4226-a51b-b376df929900 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:44.791056 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-cf1e5149-1dc3-45f2-9a21-7c68e87d9bcf req-c2277f84-d802-4226-a51b-b376df929900 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:44.815937 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-cf1e5149-1dc3-45f2-9a21-7c68e87d9bcf req-c2277f84-d802-4226-a51b-b376df929900 service nova] Creating event network-vif-plugged:128ee4eb-e784-41c8-acaa-39291810b2a4 for instance 186b67b3-3538-4bc2-8528-53b43d701bf1 on chh1-master-2 Jun 10 18:01:44.820558 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-cf1e5149-1dc3-45f2-9a21-7c68e87d9bcf req-c2277f84-d802-4226-a51b-b376df929900 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045025 Jun 10 18:01:44.821335 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 681/1407] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:01:44.830373 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-63ef1bd2-e669-4d2a-b446-1eccbc5d1624 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:44.831347 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-63ef1bd2-e669-4d2a-b446-1eccbc5d1624 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:44.835765 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=14,nova_api:INSERT=6 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:01:44.911512 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-63ef1bd2-e669-4d2a-b446-1eccbc5d1624 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:44.924069 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-63ef1bd2-e669-4d2a-b446-1eccbc5d1624 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1279 microversion: 2.1 time: 0.100614 Jun 10 18:01:44.928344 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 682/1408] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:44 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1279 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:44.930339 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-044d1c53-8a7f-43ed-b071-8b3e1747f520 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "chh2-master-2", "block_migration": true, "disk_over_commit": false}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:44.938293 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-044d1c53-8a7f-43ed-b071-8b3e1747f520 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:44.946144 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-044d1c53-8a7f-43ed-b071-8b3e1747f520 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:44.946907 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-044d1c53-8a7f-43ed-b071-8b3e1747f520 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:44.948043 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-044d1c53-8a7f-43ed-b071-8b3e1747f520 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:44.948547 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-044d1c53-8a7f-43ed-b071-8b3e1747f520 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:44.974139 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fa17f630-8367-4850-8b5b-be2f46d2ad66 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:44.981254 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-044d1c53-8a7f-43ed-b071-8b3e1747f520 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lazy-loading 'flavor' on Instance uuid a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:01:44.991847 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fa17f630-8367-4850-8b5b-be2f46d2ad66 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1470 microversion: 2.1 time: 0.381201 Jun 10 18:01:44.992608 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 727/1409] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:44 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1470 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:44.998408 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-044d1c53-8a7f-43ed-b071-8b3e1747f520 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Going to try to live migrate instance to chh2-master-2 {{(pid=126594) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 10 18:01:45.283373 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:01:45.626220 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5a0eaa78-2fec-4e9c-b411-707d08f0af4d tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:45.626921 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5a0eaa78-2fec-4e9c-b411-707d08f0af4d tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:45.635429 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5a0eaa78-2fec-4e9c-b411-707d08f0af4d tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:45.636170 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5a0eaa78-2fec-4e9c-b411-707d08f0af4d tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:45.637219 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5a0eaa78-2fec-4e9c-b411-707d08f0af4d tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:45.637888 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5a0eaa78-2fec-4e9c-b411-707d08f0af4d tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:45.846675 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5a0eaa78-2fec-4e9c-b411-707d08f0af4d tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:45.860523 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5a0eaa78-2fec-4e9c-b411-707d08f0af4d tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1317 microversion: 2.1 time: 0.238964 Jun 10 18:01:45.862497 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 728/1410] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:45 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:01:45.941299 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-eada502f-00e3-4045-aba8-d524ca4648b6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:45.942264 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-eada502f-00e3-4045-aba8-d524ca4648b6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:45.949141 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eada502f-00e3-4045-aba8-d524ca4648b6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:45.949596 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eada502f-00e3-4045-aba8-d524ca4648b6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:45.950371 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eada502f-00e3-4045-aba8-d524ca4648b6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:45.950814 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eada502f-00e3-4045-aba8-d524ca4648b6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:46.012991 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-eada502f-00e3-4045-aba8-d524ca4648b6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:46.020398 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-eada502f-00e3-4045-aba8-d524ca4648b6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1283 microversion: 2.1 time: 0.083035 Jun 10 18:01:46.020976 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 729/1411] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:45 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1283 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:46.027005 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-658c2bfb-aaa3-4ebf-ac68-9b769c58615a tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:46.027655 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-658c2bfb-aaa3-4ebf-ac68-9b769c58615a tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:46.038814 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-658c2bfb-aaa3-4ebf-ac68-9b769c58615a tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:46.038814 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-658c2bfb-aaa3-4ebf-ac68-9b769c58615a tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:46.038814 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-658c2bfb-aaa3-4ebf-ac68-9b769c58615a tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:46.038814 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-658c2bfb-aaa3-4ebf-ac68-9b769c58615a tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:46.264650 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-658c2bfb-aaa3-4ebf-ac68-9b769c58615a tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:46.272188 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-658c2bfb-aaa3-4ebf-ac68-9b769c58615a tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1470 microversion: 2.1 time: 0.250241 Jun 10 18:01:46.275948 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 730/1412] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:46 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1470 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:46.836768 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-68745227-517c-41bd-9d93-a68cd35c7374 req-4d45819a-718e-4310-bd11-e2073007d1e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4", "name": "network-vif-plugged", "status": "completed", "tag": "d492be44-5990-4f08-b390-1c1031db44f7"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:46.850554 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=6 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:01:46.872462 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-68745227-517c-41bd-9d93-a68cd35c7374 req-4d45819a-718e-4310-bd11-e2073007d1e0 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:46.884747 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-68745227-517c-41bd-9d93-a68cd35c7374 req-4d45819a-718e-4310-bd11-e2073007d1e0 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:46.920287 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-68745227-517c-41bd-9d93-a68cd35c7374 req-4d45819a-718e-4310-bd11-e2073007d1e0 service nova] Creating event network-vif-plugged:d492be44-5990-4f08-b390-1c1031db44f7 for instance ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 on chh2-master-2 Jun 10 18:01:46.927804 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-68745227-517c-41bd-9d93-a68cd35c7374 req-4d45819a-718e-4310-bd11-e2073007d1e0 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096087 Jun 10 18:01:46.928942 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 731/1413] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:01:46.938708 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-02dc2b6e-44ae-4791-918b-bdcf9b72f1e5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:46.939990 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-02dc2b6e-44ae-4791-918b-bdcf9b72f1e5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:46.950310 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02dc2b6e-44ae-4791-918b-bdcf9b72f1e5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:46.951035 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02dc2b6e-44ae-4791-918b-bdcf9b72f1e5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:46.952151 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02dc2b6e-44ae-4791-918b-bdcf9b72f1e5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:46.952922 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02dc2b6e-44ae-4791-918b-bdcf9b72f1e5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:47.311760 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-02dc2b6e-44ae-4791-918b-bdcf9b72f1e5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:47.320585 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-02dc2b6e-44ae-4791-918b-bdcf9b72f1e5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1317 microversion: 2.1 time: 0.389559 Jun 10 18:01:47.321479 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 732/1414] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:46 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1317 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:47.334550 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-21cf1974-2157-43bb-a7e1-0c000bc6eb2d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:47.335457 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-21cf1974-2157-43bb-a7e1-0c000bc6eb2d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:47.342862 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-21cf1974-2157-43bb-a7e1-0c000bc6eb2d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:47.343539 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-21cf1974-2157-43bb-a7e1-0c000bc6eb2d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:47.344664 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-21cf1974-2157-43bb-a7e1-0c000bc6eb2d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:47.345251 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-21cf1974-2157-43bb-a7e1-0c000bc6eb2d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:47.363425 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:01:47.438260 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-21cf1974-2157-43bb-a7e1-0c000bc6eb2d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:47.456855 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-21cf1974-2157-43bb-a7e1-0c000bc6eb2d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1339 microversion: 2.1 time: 0.134024 Jun 10 18:01:47.457439 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 733/1415] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:47 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1339 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:47.462253 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-60448194-05da-4a50-90fd-f5d4da23048b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:47.463049 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-60448194-05da-4a50-90fd-f5d4da23048b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:47.481400 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-60448194-05da-4a50-90fd-f5d4da23048b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:47.482721 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-60448194-05da-4a50-90fd-f5d4da23048b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:47.484726 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-60448194-05da-4a50-90fd-f5d4da23048b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:47.485192 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-60448194-05da-4a50-90fd-f5d4da23048b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:47.652831 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-60448194-05da-4a50-90fd-f5d4da23048b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:47.672478 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-60448194-05da-4a50-90fd-f5d4da23048b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1476 microversion: 2.1 time: 0.213736 Jun 10 18:01:47.673658 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 734/1416] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:47 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1476 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:48.347472 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f62001de-762e-4460-a3fc-94daf7244c58 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:48.348856 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f62001de-762e-4460-a3fc-94daf7244c58 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:48.375766 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f62001de-762e-4460-a3fc-94daf7244c58 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:48.380080 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f62001de-762e-4460-a3fc-94daf7244c58 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:48.381838 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f62001de-762e-4460-a3fc-94daf7244c58 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:48.382466 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f62001de-762e-4460-a3fc-94daf7244c58 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:48.681040 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f62001de-762e-4460-a3fc-94daf7244c58 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:48.691709 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f62001de-762e-4460-a3fc-94daf7244c58 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1317 microversion: 2.1 time: 0.355279 Jun 10 18:01:48.694035 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 735/1417] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:48 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1317 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:48.704939 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bab911d8-6763-471d-b506-7de5788d83ca tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:48.707573 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bab911d8-6763-471d-b506-7de5788d83ca tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:48.723326 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bab911d8-6763-471d-b506-7de5788d83ca tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:48.724436 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bab911d8-6763-471d-b506-7de5788d83ca tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:48.725437 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bab911d8-6763-471d-b506-7de5788d83ca tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:48.728905 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bab911d8-6763-471d-b506-7de5788d83ca tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:48.954373 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bab911d8-6763-471d-b506-7de5788d83ca tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:48.964590 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bab911d8-6763-471d-b506-7de5788d83ca tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1379 microversion: 2.1 time: 0.269243 Jun 10 18:01:48.965517 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 736/1418] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:48 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1379 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:49.198893 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-590b3d01-6bd1-4dfe-b337-28b6f9281140 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1731282574", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": "none"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:49.268091 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-590b3d01-6bd1-4dfe-b337-28b6f9281140 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:01:49.269675 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-590b3d01-6bd1-4dfe-b337-28b6f9281140 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:01:49.270548 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-590b3d01-6bd1-4dfe-b337-28b6f9281140 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:01:49.271181 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-590b3d01-6bd1-4dfe-b337-28b6f9281140 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:01:49.271808 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-590b3d01-6bd1-4dfe-b337-28b6f9281140 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:01:49.284577 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-590b3d01-6bd1-4dfe-b337-28b6f9281140 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:49.285356 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-590b3d01-6bd1-4dfe-b337-28b6f9281140 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:49.286543 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-590b3d01-6bd1-4dfe-b337-28b6f9281140 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:49.288723 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-590b3d01-6bd1-4dfe-b337-28b6f9281140 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:49.313581 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-590b3d01-6bd1-4dfe-b337-28b6f9281140 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Getting quotas for project 5854e6d50bb1440f8a095906bf21dab8. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:01:49.319867 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-590b3d01-6bd1-4dfe-b337-28b6f9281140 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Getting quotas for user 13316e7c8ac44f3886393385da11c9d6 and project 5854e6d50bb1440f8a095906bf21dab8. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:01:49.335955 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-590b3d01-6bd1-4dfe-b337-28b6f9281140 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:01:49.338789 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-590b3d01-6bd1-4dfe-b337-28b6f9281140 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:01:49.531991 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-590b3d01-6bd1-4dfe-b337-28b6f9281140 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.563942 Jun 10 18:01:49.546538 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 737/1419] 10.222.0.35 () {62 vars in 1187 bytes} [Fri Jun 10 18:01:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 10 18:01:49.556988 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-51b88637-3a49-4b04-8eac-98dcc835899c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:49.556988 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-51b88637-3a49-4b04-8eac-98dcc835899c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:49.565735 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-51b88637-3a49-4b04-8eac-98dcc835899c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:49.566494 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-51b88637-3a49-4b04-8eac-98dcc835899c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:49.567277 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-51b88637-3a49-4b04-8eac-98dcc835899c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:49.568059 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-51b88637-3a49-4b04-8eac-98dcc835899c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:49.767530 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-044d1c53-8a7f-43ed-b071-8b3e1747f520 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] 10.222.0.35 "POST /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d/action" status: 202 len: 0 microversion: 2.1 time: 4.840627 Jun 10 18:01:49.768743 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 683/1420] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:01:44 2022] POST /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d/action => generated 0 bytes in 4842 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:01:49.780047 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e491f5de-4fd2-42fa-979f-81781378c076 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:49.783957 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e491f5de-4fd2-42fa-979f-81781378c076 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:49.871364 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-51b88637-3a49-4b04-8eac-98dcc835899c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:49.887016 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-51b88637-3a49-4b04-8eac-98dcc835899c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1476 microversion: 2.1 time: 0.335927 Jun 10 18:01:49.890707 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 738/1421] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:49 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1476 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:49.907265 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-25a004ad-7824-4e86-b724-5236858e10b6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:49.907906 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-25a004ad-7824-4e86-b724-5236858e10b6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:49.915637 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-25a004ad-7824-4e86-b724-5236858e10b6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:49.916091 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-25a004ad-7824-4e86-b724-5236858e10b6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:49.920151 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-25a004ad-7824-4e86-b724-5236858e10b6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:49.920630 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-25a004ad-7824-4e86-b724-5236858e10b6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:49.994528 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e491f5de-4fd2-42fa-979f-81781378c076 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:50.009208 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e491f5de-4fd2-42fa-979f-81781378c076 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:50.019102 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e491f5de-4fd2-42fa-979f-81781378c076 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:50.059749 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e491f5de-4fd2-42fa-979f-81781378c076 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "PUT /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1359 microversion: 2.75 time: 0.286401 Jun 10 18:01:50.061392 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 684/1422] 10.222.0.35 () {62 vars in 1296 bytes} [Fri Jun 10 18:01:49 2022] PUT /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1359 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:01:50.095004 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-08c452d7-6377-4cd8-8ef8-bdc0ed70f999 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:50.096079 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-08c452d7-6377-4cd8-8ef8-bdc0ed70f999 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:50.114180 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-08c452d7-6377-4cd8-8ef8-bdc0ed70f999 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:50.115078 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-08c452d7-6377-4cd8-8ef8-bdc0ed70f999 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:50.117145 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-08c452d7-6377-4cd8-8ef8-bdc0ed70f999 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:50.117825 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-08c452d7-6377-4cd8-8ef8-bdc0ed70f999 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:50.222904 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-25a004ad-7824-4e86-b724-5236858e10b6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:50.231340 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-25a004ad-7824-4e86-b724-5236858e10b6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1508 microversion: 2.1 time: 0.339551 Jun 10 18:01:50.237457 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 739/1423] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:49 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1508 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:50.251920 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-038c8f24-0883-499c-bef4-a25a2990531d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:50.252290 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-038c8f24-0883-499c-bef4-a25a2990531d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:50.279182 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-038c8f24-0883-499c-bef4-a25a2990531d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:50.279902 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-038c8f24-0883-499c-bef4-a25a2990531d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:50.280443 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-038c8f24-0883-499c-bef4-a25a2990531d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:50.281454 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-038c8f24-0883-499c-bef4-a25a2990531d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:50.401327 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-08c452d7-6377-4cd8-8ef8-bdc0ed70f999 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:50.413401 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-08c452d7-6377-4cd8-8ef8-bdc0ed70f999 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1549 microversion: 2.1 time: 0.335511 Jun 10 18:01:50.426084 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 685/1424] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:50 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1549 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:50.432286 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-75cef3ea-70ea-4006-a5e8-74f11b8425bf tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:50.435089 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-75cef3ea-70ea-4006-a5e8-74f11b8425bf tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:50.556836 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-75cef3ea-70ea-4006-a5e8-74f11b8425bf tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:50.573409 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-75cef3ea-70ea-4006-a5e8-74f11b8425bf tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:50.576680 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-75cef3ea-70ea-4006-a5e8-74f11b8425bf tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:50.584393 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-75cef3ea-70ea-4006-a5e8-74f11b8425bf tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1359 microversion: 2.75 time: 0.162313 Jun 10 18:01:50.585234 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 686/1425] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:01:50 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:01:50.613511 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-71cf252d-0d8b-4abb-8ce2-4844a944c5e1 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:50.613511 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-71cf252d-0d8b-4abb-8ce2-4844a944c5e1 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:50.615761 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-71cf252d-0d8b-4abb-8ce2-4844a944c5e1 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:50.615932 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-71cf252d-0d8b-4abb-8ce2-4844a944c5e1 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:50.616631 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-71cf252d-0d8b-4abb-8ce2-4844a944c5e1 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:50.617075 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-71cf252d-0d8b-4abb-8ce2-4844a944c5e1 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:50.723362 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-038c8f24-0883-499c-bef4-a25a2990531d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:50.739720 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-038c8f24-0883-499c-bef4-a25a2990531d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1379 microversion: 2.1 time: 0.500198 Jun 10 18:01:50.744952 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 740/1426] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:50 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1379 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:50.792115 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-1446b624-c2fc-4812-88f6-16a3a21f1625 req-db616d9f-1f6d-4bee-abe6-0c37dbeecfed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbc49fe4-a119-4ed9-9310-45babff4fec4", "tag": "8e46ecde-2a76-4ced-9d12-e08541a4852f"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:50.836134 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-1446b624-c2fc-4812-88f6-16a3a21f1625 req-db616d9f-1f6d-4bee-abe6-0c37dbeecfed service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:50.840983 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-1446b624-c2fc-4812-88f6-16a3a21f1625 req-db616d9f-1f6d-4bee-abe6-0c37dbeecfed service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:50.878024 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-1446b624-c2fc-4812-88f6-16a3a21f1625 req-db616d9f-1f6d-4bee-abe6-0c37dbeecfed service nova] Creating event network-changed:8e46ecde-2a76-4ced-9d12-e08541a4852f for instance fbc49fe4-a119-4ed9-9310-45babff4fec4 on chh2-master-2 Jun 10 18:01:50.890867 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-1446b624-c2fc-4812-88f6-16a3a21f1625 req-db616d9f-1f6d-4bee-abe6-0c37dbeecfed service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119870 Jun 10 18:01:50.898212 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 741/1427] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:01:50.911479 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-434dd371-1b22-4726-a3c0-6c315ac8aa44 req-26fcf15a-0dc8-4c9a-a95d-3df4f7cd3de3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab0caf46-568d-4b5a-bd31-458cdc99b06f", "name": "network-vif-unplugged", "status": "completed", "tag": "fe140919-8d1b-4aeb-a134-324a13655f62"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:50.938572 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-434dd371-1b22-4726-a3c0-6c315ac8aa44 req-26fcf15a-0dc8-4c9a-a95d-3df4f7cd3de3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:50.940976 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-434dd371-1b22-4726-a3c0-6c315ac8aa44 req-26fcf15a-0dc8-4c9a-a95d-3df4f7cd3de3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:50.972535 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-434dd371-1b22-4726-a3c0-6c315ac8aa44 req-26fcf15a-0dc8-4c9a-a95d-3df4f7cd3de3 service nova] Creating event network-vif-unplugged:fe140919-8d1b-4aeb-a134-324a13655f62 for instance ab0caf46-568d-4b5a-bd31-458cdc99b06f on chh1-master-2 Jun 10 18:01:50.980561 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-434dd371-1b22-4726-a3c0-6c315ac8aa44 req-26fcf15a-0dc8-4c9a-a95d-3df4f7cd3de3 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079257 Jun 10 18:01:50.981207 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 742/1428] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:01:50.993380 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cc0b956a-4a55-4f14-8a82-2ec28f061c71 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:50.997782 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cc0b956a-4a55-4f14-8a82-2ec28f061c71 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:51.011380 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc0b956a-4a55-4f14-8a82-2ec28f061c71 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:51.075860 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc0b956a-4a55-4f14-8a82-2ec28f061c71 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:51.075860 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc0b956a-4a55-4f14-8a82-2ec28f061c71 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:51.075860 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc0b956a-4a55-4f14-8a82-2ec28f061c71 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:51.244066 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cc0b956a-4a55-4f14-8a82-2ec28f061c71 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:51.255047 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cc0b956a-4a55-4f14-8a82-2ec28f061c71 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1476 microversion: 2.1 time: 0.267413 Jun 10 18:01:51.255826 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 743/1429] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:50 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1476 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:51.322559 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-71cf252d-0d8b-4abb-8ce2-4844a944c5e1 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:51.336510 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-71cf252d-0d8b-4abb-8ce2-4844a944c5e1 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1508 microversion: 2.1 time: 0.749377 Jun 10 18:01:51.348532 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 687/1430] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:50 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1508 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:51.357678 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6273fb9a-e54d-4dff-858e-01b83c85c65b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:51.357678 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6273fb9a-e54d-4dff-858e-01b83c85c65b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:51.365139 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6273fb9a-e54d-4dff-858e-01b83c85c65b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:51.365740 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6273fb9a-e54d-4dff-858e-01b83c85c65b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:51.366542 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6273fb9a-e54d-4dff-858e-01b83c85c65b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:51.366987 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6273fb9a-e54d-4dff-858e-01b83c85c65b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:51.434314 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4da0c246-200f-4369-9124-2676f3e11ce2 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:51.438500 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4da0c246-200f-4369-9124-2676f3e11ce2 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:51.442887 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4da0c246-200f-4369-9124-2676f3e11ce2 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:51.443680 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4da0c246-200f-4369-9124-2676f3e11ce2 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:51.444890 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4da0c246-200f-4369-9124-2676f3e11ce2 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:51.445569 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4da0c246-200f-4369-9124-2676f3e11ce2 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:51.585273 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6273fb9a-e54d-4dff-858e-01b83c85c65b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "PUT /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1080 microversion: 2.1 time: 0.234619 Jun 10 18:01:51.596169 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 744/1431] 10.222.0.35 () {60 vars in 1255 bytes} [Fri Jun 10 18:01:51 2022] PUT /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1080 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:51.607188 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2eace110-0702-4290-9531-cc9fc85e5b9f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:51.612487 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2eace110-0702-4290-9531-cc9fc85e5b9f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:51.710720 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4da0c246-200f-4369-9124-2676f3e11ce2 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:51.719292 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2eace110-0702-4290-9531-cc9fc85e5b9f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:51.724397 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4da0c246-200f-4369-9124-2676f3e11ce2 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1549 microversion: 2.1 time: 0.294705 Jun 10 18:01:51.736544 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 688/1432] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:51 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1549 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:01:51.740237 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2eace110-0702-4290-9531-cc9fc85e5b9f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:51.740237 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2eace110-0702-4290-9531-cc9fc85e5b9f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:51.745050 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2eace110-0702-4290-9531-cc9fc85e5b9f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1359 microversion: 2.75 time: 0.141789 Jun 10 18:01:51.745532 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2f62c23a-22e2-4f00-814c-d7958e81b026 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:51.745668 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 745/1433] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:01:51 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1359 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:01:51.757762 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2f62c23a-22e2-4f00-814c-d7958e81b026 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:51.767937 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2f62c23a-22e2-4f00-814c-d7958e81b026 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:51.768201 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2f62c23a-22e2-4f00-814c-d7958e81b026 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:51.769324 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2f62c23a-22e2-4f00-814c-d7958e81b026 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:51.769772 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2f62c23a-22e2-4f00-814c-d7958e81b026 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:51.772249 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6a7674c2-940a-41e8-95e6-db2479c4e07d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:51.773889 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6a7674c2-940a-41e8-95e6-db2479c4e07d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:51.801152 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a7674c2-940a-41e8-95e6-db2479c4e07d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:51.801630 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a7674c2-940a-41e8-95e6-db2479c4e07d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:51.802541 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a7674c2-940a-41e8-95e6-db2479c4e07d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:51.802990 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a7674c2-940a-41e8-95e6-db2479c4e07d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:51.990413 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6a7674c2-940a-41e8-95e6-db2479c4e07d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:52.000715 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6a7674c2-940a-41e8-95e6-db2479c4e07d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1379 microversion: 2.1 time: 0.237480 Jun 10 18:01:52.001948 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 746/1434] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:51 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1379 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:52.011752 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2f62c23a-22e2-4f00-814c-d7958e81b026 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:52.021749 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2f62c23a-22e2-4f00-814c-d7958e81b026 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1506 microversion: 2.1 time: 0.291639 Jun 10 18:01:52.022341 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 689/1435] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:51 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1506 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:52.043790 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f3eba52d-3f7e-430c-80c7-477ebdff4f68 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:52.044470 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f3eba52d-3f7e-430c-80c7-477ebdff4f68 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:52.052213 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f3eba52d-3f7e-430c-80c7-477ebdff4f68 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:52.052706 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f3eba52d-3f7e-430c-80c7-477ebdff4f68 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:52.053500 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f3eba52d-3f7e-430c-80c7-477ebdff4f68 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:52.053949 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f3eba52d-3f7e-430c-80c7-477ebdff4f68 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:52.271288 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-22dc2285-695f-4596-a73e-818cabdd95da tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:52.272402 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-22dc2285-695f-4596-a73e-818cabdd95da tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:52.289179 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-22dc2285-695f-4596-a73e-818cabdd95da tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:52.292216 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-22dc2285-695f-4596-a73e-818cabdd95da tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:52.293078 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-22dc2285-695f-4596-a73e-818cabdd95da tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:52.294994 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-22dc2285-695f-4596-a73e-818cabdd95da tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:52.361158 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f3eba52d-3f7e-430c-80c7-477ebdff4f68 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:52.369840 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f3eba52d-3f7e-430c-80c7-477ebdff4f68 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1506 microversion: 2.1 time: 0.330843 Jun 10 18:01:52.371494 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 747/1436] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:52 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1506 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:52.389702 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a10fc96a-b190-401b-8421-011487dfbb02 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:52.391743 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a10fc96a-b190-401b-8421-011487dfbb02 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:52.422706 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a10fc96a-b190-401b-8421-011487dfbb02 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:52.423383 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a10fc96a-b190-401b-8421-011487dfbb02 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:52.424411 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a10fc96a-b190-401b-8421-011487dfbb02 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:52.425200 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a10fc96a-b190-401b-8421-011487dfbb02 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:52.551024 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-22dc2285-695f-4596-a73e-818cabdd95da tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:52.590119 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-22dc2285-695f-4596-a73e-818cabdd95da tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1476 microversion: 2.1 time: 0.322738 Jun 10 18:01:52.596911 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 690/1437] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:52 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1476 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:01:52.690692 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-a10fc96a-b190-401b-8421-011487dfbb02 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:01:52.701877 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-a10fc96a-b190-401b-8421-011487dfbb02 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:01:52.703968 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-a10fc96a-b190-401b-8421-011487dfbb02 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:01:52.704438 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-a10fc96a-b190-401b-8421-011487dfbb02 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:01:52.704866 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-a10fc96a-b190-401b-8421-011487dfbb02 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:01:52.773472 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-266d126a-709c-4ddf-820c-76e04ead115c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:52.773472 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-266d126a-709c-4ddf-820c-76e04ead115c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:52.773472 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-266d126a-709c-4ddf-820c-76e04ead115c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:52.773472 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-266d126a-709c-4ddf-820c-76e04ead115c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:52.774153 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-266d126a-709c-4ddf-820c-76e04ead115c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:52.774153 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-266d126a-709c-4ddf-820c-76e04ead115c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:52.952127 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a10fc96a-b190-401b-8421-011487dfbb02 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:52.973794 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a10fc96a-b190-401b-8421-011487dfbb02 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:52.974245 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a10fc96a-b190-401b-8421-011487dfbb02 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:52.975044 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a10fc96a-b190-401b-8421-011487dfbb02 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:52.975477 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a10fc96a-b190-401b-8421-011487dfbb02 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:52.986041 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-266d126a-709c-4ddf-820c-76e04ead115c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:52.996627 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-266d126a-709c-4ddf-820c-76e04ead115c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1549 microversion: 2.1 time: 0.256230 Jun 10 18:01:53.001488 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 691/1438] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:52 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1549 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:53.019851 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-896bfa5a-0a5d-491f-bb23-7efbb4a5fd6a tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:53.024426 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-896bfa5a-0a5d-491f-bb23-7efbb4a5fd6a tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:53.031711 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a10fc96a-b190-401b-8421-011487dfbb02 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "POST /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4/action" status: 202 len: 1112 microversion: 2.1 time: 0.647171 Jun 10 18:01:53.040524 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 748/1439] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:01:52 2022] POST /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4/action => generated 1112 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jun 10 18:01:53.053146 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-896bfa5a-0a5d-491f-bb23-7efbb4a5fd6a tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:53.053990 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-896bfa5a-0a5d-491f-bb23-7efbb4a5fd6a tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:53.055068 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-896bfa5a-0a5d-491f-bb23-7efbb4a5fd6a tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:53.056142 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a60393ef-22c2-48d6-a4e9-b0d67494b5d9 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:53.057851 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-896bfa5a-0a5d-491f-bb23-7efbb4a5fd6a tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:53.059890 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a60393ef-22c2-48d6-a4e9-b0d67494b5d9 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:53.080472 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a60393ef-22c2-48d6-a4e9-b0d67494b5d9 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:53.081372 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a60393ef-22c2-48d6-a4e9-b0d67494b5d9 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:53.083535 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a60393ef-22c2-48d6-a4e9-b0d67494b5d9 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:53.094815 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a60393ef-22c2-48d6-a4e9-b0d67494b5d9 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:53.289491 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-a60393ef-22c2-48d6-a4e9-b0d67494b5d9 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lazy-loading 'services' on Instance uuid a0864d26-b605-4a49-b099-8144ecfde9bc {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:01:53.309681 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a60393ef-22c2-48d6-a4e9-b0d67494b5d9 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 2127 microversion: 2.25 time: 0.266990 Jun 10 18:01:53.310921 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 749/1440] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:01:53 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 2127 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:01:53.327010 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-df23915b-682b-44b8-ab0f-280dccdd3a99 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:53.330454 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-df23915b-682b-44b8-ab0f-280dccdd3a99 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:53.342618 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df23915b-682b-44b8-ab0f-280dccdd3a99 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:53.346087 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df23915b-682b-44b8-ab0f-280dccdd3a99 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:53.348168 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df23915b-682b-44b8-ab0f-280dccdd3a99 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:53.349133 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df23915b-682b-44b8-ab0f-280dccdd3a99 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:53.354505 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-896bfa5a-0a5d-491f-bb23-7efbb4a5fd6a tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:53.356972 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:01:53.366487 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-896bfa5a-0a5d-491f-bb23-7efbb4a5fd6a tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:53.367975 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-896bfa5a-0a5d-491f-bb23-7efbb4a5fd6a tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:53.384918 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-896bfa5a-0a5d-491f-bb23-7efbb4a5fd6a tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1355 microversion: 2.75 time: 0.380322 Jun 10 18:01:53.385512 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 692/1441] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:01:53 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1355 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:01:53.402354 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4dddb14e-e54d-45df-ad06-8ec53439a25d tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:53.420996 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4dddb14e-e54d-45df-ad06-8ec53439a25d tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:53.437004 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4dddb14e-e54d-45df-ad06-8ec53439a25d tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:53.437737 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4dddb14e-e54d-45df-ad06-8ec53439a25d tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:53.438762 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4dddb14e-e54d-45df-ad06-8ec53439a25d tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:53.439371 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4dddb14e-e54d-45df-ad06-8ec53439a25d tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:53.565435 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-df23915b-682b-44b8-ab0f-280dccdd3a99 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:53.581041 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-df23915b-682b-44b8-ab0f-280dccdd3a99 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1379 microversion: 2.1 time: 0.268764 Jun 10 18:01:53.590261 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 750/1442] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:53 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1379 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:53.590261 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-72745833-c4c8-4e69-ba22-a285fb49f326 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "chh2-master-2", "block_migration": "auto"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:53.590261 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-72745833-c4c8-4e69-ba22-a285fb49f326 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:53.601818 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72745833-c4c8-4e69-ba22-a285fb49f326 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:53.602640 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72745833-c4c8-4e69-ba22-a285fb49f326 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:53.603264 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72745833-c4c8-4e69-ba22-a285fb49f326 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:53.603812 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72745833-c4c8-4e69-ba22-a285fb49f326 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:53.625703 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4dddb14e-e54d-45df-ad06-8ec53439a25d tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:53.636884 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4dddb14e-e54d-45df-ad06-8ec53439a25d tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1517 microversion: 2.1 time: 0.247324 Jun 10 18:01:53.638023 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 693/1443] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:53 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1517 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:53.638847 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-72745833-c4c8-4e69-ba22-a285fb49f326 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lazy-loading 'flavor' on Instance uuid a0864d26-b605-4a49-b099-8144ecfde9bc {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:01:53.646518 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b7305723-900f-4eaf-b47e-61a953079a1b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:53.648673 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b7305723-900f-4eaf-b47e-61a953079a1b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:53.654819 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b7305723-900f-4eaf-b47e-61a953079a1b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:53.655280 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b7305723-900f-4eaf-b47e-61a953079a1b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:53.655612 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-72745833-c4c8-4e69-ba22-a285fb49f326 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Going to try to live migrate instance to chh2-master-2 {{(pid=126595) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 10 18:01:53.656495 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b7305723-900f-4eaf-b47e-61a953079a1b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:53.657101 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b7305723-900f-4eaf-b47e-61a953079a1b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:53.856254 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b7305723-900f-4eaf-b47e-61a953079a1b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:53.866737 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b7305723-900f-4eaf-b47e-61a953079a1b tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1476 microversion: 2.1 time: 0.226613 Jun 10 18:01:53.867346 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 694/1444] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:53 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1476 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:54.018375 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b045f66e-02bf-4b68-80df-f8ceb74f1a72 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:54.019744 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b045f66e-02bf-4b68-80df-f8ceb74f1a72 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:54.029274 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b045f66e-02bf-4b68-80df-f8ceb74f1a72 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:54.036882 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b045f66e-02bf-4b68-80df-f8ceb74f1a72 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:54.038502 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b045f66e-02bf-4b68-80df-f8ceb74f1a72 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:54.043004 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b045f66e-02bf-4b68-80df-f8ceb74f1a72 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:54.184971 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:01:54.331588 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b045f66e-02bf-4b68-80df-f8ceb74f1a72 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:54.353095 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b045f66e-02bf-4b68-80df-f8ceb74f1a72 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1549 microversion: 2.1 time: 0.334228 Jun 10 18:01:54.363121 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 695/1445] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:54 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1549 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:01:54.408501 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-13c71ec5-5bf1-447e-9cd2-e29e2c05af4a tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:54.411908 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-13c71ec5-5bf1-447e-9cd2-e29e2c05af4a tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:54.430307 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-13c71ec5-5bf1-447e-9cd2-e29e2c05af4a tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:54.430778 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-13c71ec5-5bf1-447e-9cd2-e29e2c05af4a tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:54.434080 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-13c71ec5-5bf1-447e-9cd2-e29e2c05af4a tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:54.434527 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-13c71ec5-5bf1-447e-9cd2-e29e2c05af4a tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:54.515574 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-13c71ec5-5bf1-447e-9cd2-e29e2c05af4a tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:54.528238 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-13c71ec5-5bf1-447e-9cd2-e29e2c05af4a tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:54.539236 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-13c71ec5-5bf1-447e-9cd2-e29e2c05af4a tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:54.559754 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-13c71ec5-5bf1-447e-9cd2-e29e2c05af4a tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1355 microversion: 2.75 time: 0.150779 Jun 10 18:01:54.560605 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 696/1446] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:01:54 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1355 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:01:54.580358 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-12f6bd5d-2c50-4f7b-96a0-825acf6e691a tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0445fae8-e2f4-40f7-bcaa-fba5beb9d7b9"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:54.583490 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-12f6bd5d-2c50-4f7b-96a0-825acf6e691a tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:54.593572 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-12f6bd5d-2c50-4f7b-96a0-825acf6e691a tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:54.593572 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-12f6bd5d-2c50-4f7b-96a0-825acf6e691a tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:54.595287 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-12f6bd5d-2c50-4f7b-96a0-825acf6e691a tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:54.595829 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-12f6bd5d-2c50-4f7b-96a0-825acf6e691a tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:56.790584 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-12f6bd5d-2c50-4f7b-96a0-825acf6e691a tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "POST /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.216471 Jun 10 18:01:56.792264 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 697/1447] 10.222.0.35 () {60 vars in 1322 bytes} [Fri Jun 10 18:01:54 2022] POST /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63/os-volume_attachments => generated 194 bytes in 2231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:01:56.809939 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-381a3751-3677-4bfa-9acb-5c7b705433fc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:56.815738 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-381a3751-3677-4bfa-9acb-5c7b705433fc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:56.838951 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-381a3751-3677-4bfa-9acb-5c7b705433fc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:56.847432 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-381a3751-3677-4bfa-9acb-5c7b705433fc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:56.848703 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-381a3751-3677-4bfa-9acb-5c7b705433fc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:56.850093 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-381a3751-3677-4bfa-9acb-5c7b705433fc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:57.082667 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-381a3751-3677-4bfa-9acb-5c7b705433fc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:57.090441 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-381a3751-3677-4bfa-9acb-5c7b705433fc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1379 microversion: 2.1 time: 0.295422 Jun 10 18:01:57.101527 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 698/1448] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:56 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1379 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:57.107832 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-229fbc7b-fc2b-4550-ba7e-ea45f5b8b301 req-516cb9ba-ca26-498c-a2d8-198fc30e87cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab0caf46-568d-4b5a-bd31-458cdc99b06f", "name": "network-vif-plugged", "status": "completed", "tag": "fe140919-8d1b-4aeb-a134-324a13655f62"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:01:57.116602 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-229fbc7b-fc2b-4550-ba7e-ea45f5b8b301 req-516cb9ba-ca26-498c-a2d8-198fc30e87cf service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:57.117414 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-229fbc7b-fc2b-4550-ba7e-ea45f5b8b301 req-516cb9ba-ca26-498c-a2d8-198fc30e87cf service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:57.156236 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-229fbc7b-fc2b-4550-ba7e-ea45f5b8b301 req-516cb9ba-ca26-498c-a2d8-198fc30e87cf service nova] Creating event network-vif-plugged:fe140919-8d1b-4aeb-a134-324a13655f62 for instance ab0caf46-568d-4b5a-bd31-458cdc99b06f on chh1-master-2 Jun 10 18:01:57.166115 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-229fbc7b-fc2b-4550-ba7e-ea45f5b8b301 req-516cb9ba-ca26-498c-a2d8-198fc30e87cf service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060565 Jun 10 18:01:57.168396 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 699/1449] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:01:57.186072 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-20069732-df57-4c46-ac59-6c60abbdb064 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:57.187290 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-20069732-df57-4c46-ac59-6c60abbdb064 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:57.199604 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-20069732-df57-4c46-ac59-6c60abbdb064 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:57.205212 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-20069732-df57-4c46-ac59-6c60abbdb064 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:57.215159 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-20069732-df57-4c46-ac59-6c60abbdb064 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:57.215967 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-20069732-df57-4c46-ac59-6c60abbdb064 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:57.483594 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-20069732-df57-4c46-ac59-6c60abbdb064 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:57.500884 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-20069732-df57-4c46-ac59-6c60abbdb064 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1517 microversion: 2.1 time: 0.328676 Jun 10 18:01:57.510170 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 700/1450] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:57 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1517 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:57.510170 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f474cb0c-23ab-4b5b-913a-e066b1bb28c2 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:57.510170 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f474cb0c-23ab-4b5b-913a-e066b1bb28c2 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:57.516600 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f474cb0c-23ab-4b5b-913a-e066b1bb28c2 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:57.517057 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f474cb0c-23ab-4b5b-913a-e066b1bb28c2 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:57.517841 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f474cb0c-23ab-4b5b-913a-e066b1bb28c2 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:57.518317 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f474cb0c-23ab-4b5b-913a-e066b1bb28c2 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:57.653508 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-72745833-c4c8-4e69-ba22-a285fb49f326 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] 10.222.0.35 "POST /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc/action" status: 202 len: 0 microversion: 2.25 time: 4.069365 Jun 10 18:01:57.660024 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 751/1451] 10.222.0.35 () {62 vars in 1318 bytes} [Fri Jun 10 18:01:53 2022] POST /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc/action => generated 0 bytes in 4077 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:01:57.678632 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3fdbe0ed-6bca-45e1-beac-5fc7d5e83273 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:57.680708 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3fdbe0ed-6bca-45e1-beac-5fc7d5e83273 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:57.691302 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:01:57.694559 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3fdbe0ed-6bca-45e1-beac-5fc7d5e83273 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:57.695714 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3fdbe0ed-6bca-45e1-beac-5fc7d5e83273 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:57.697178 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3fdbe0ed-6bca-45e1-beac-5fc7d5e83273 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:57.698807 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3fdbe0ed-6bca-45e1-beac-5fc7d5e83273 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:57.750709 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f474cb0c-23ab-4b5b-913a-e066b1bb28c2 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:57.757446 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:01:57.760155 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f474cb0c-23ab-4b5b-913a-e066b1bb28c2 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1476 microversion: 2.1 time: 0.256962 Jun 10 18:01:57.764487 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 701/1452] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:57 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1476 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:57.769411 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a680f321-52af-45e1-b81f-befd38f177a5 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:57.770389 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a680f321-52af-45e1-b81f-befd38f177a5 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:57.784850 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a680f321-52af-45e1-b81f-befd38f177a5 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:57.785305 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a680f321-52af-45e1-b81f-befd38f177a5 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:57.786095 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a680f321-52af-45e1-b81f-befd38f177a5 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:57.788912 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a680f321-52af-45e1-b81f-befd38f177a5 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:57.902411 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a680f321-52af-45e1-b81f-befd38f177a5 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:57.911103 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a680f321-52af-45e1-b81f-befd38f177a5 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:57.916821 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a680f321-52af-45e1-b81f-befd38f177a5 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:57.929767 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a680f321-52af-45e1-b81f-befd38f177a5 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1417 microversion: 2.75 time: 0.165440 Jun 10 18:01:57.932070 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 702/1453] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:01:57 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1417 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:01:57.945536 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-87f15c09-93de-4d2a-a349-41aa77bab3a8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:57.946540 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-87f15c09-93de-4d2a-a349-41aa77bab3a8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:57.952600 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3fdbe0ed-6bca-45e1-beac-5fc7d5e83273 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:57.960349 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-87f15c09-93de-4d2a-a349-41aa77bab3a8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:57.961896 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3fdbe0ed-6bca-45e1-beac-5fc7d5e83273 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1549 microversion: 2.1 time: 0.300492 Jun 10 18:01:57.962596 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-87f15c09-93de-4d2a-a349-41aa77bab3a8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:57.963883 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-87f15c09-93de-4d2a-a349-41aa77bab3a8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:57.964410 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 752/1454] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:57 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1549 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:57.967599 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-87f15c09-93de-4d2a-a349-41aa77bab3a8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:58.110096 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e3a732e3-1043-445b-b017-e4a632c39c69 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:58.111581 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e3a732e3-1043-445b-b017-e4a632c39c69 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:58.119289 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e3a732e3-1043-445b-b017-e4a632c39c69 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:58.121773 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e3a732e3-1043-445b-b017-e4a632c39c69 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:58.144964 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e3a732e3-1043-445b-b017-e4a632c39c69 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:58.147711 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e3a732e3-1043-445b-b017-e4a632c39c69 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:58.199088 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-87f15c09-93de-4d2a-a349-41aa77bab3a8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:58.214003 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-87f15c09-93de-4d2a-a349-41aa77bab3a8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:58.215885 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-87f15c09-93de-4d2a-a349-41aa77bab3a8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:58.217535 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-87f15c09-93de-4d2a-a349-41aa77bab3a8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.284297 Jun 10 18:01:58.218093 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 703/1455] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:01:57 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:01:58.411657 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e3a732e3-1043-445b-b017-e4a632c39c69 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:58.427561 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e3a732e3-1043-445b-b017-e4a632c39c69 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1379 microversion: 2.1 time: 0.322115 Jun 10 18:01:58.428354 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 753/1456] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:58 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1379 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:58.517939 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8f21878a-adc7-4d80-8bff-54b586e93bde tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:58.518680 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8f21878a-adc7-4d80-8bff-54b586e93bde tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:58.526025 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8f21878a-adc7-4d80-8bff-54b586e93bde tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:58.526715 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8f21878a-adc7-4d80-8bff-54b586e93bde tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:58.527577 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8f21878a-adc7-4d80-8bff-54b586e93bde tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:58.528093 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8f21878a-adc7-4d80-8bff-54b586e93bde tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:58.727977 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8f21878a-adc7-4d80-8bff-54b586e93bde tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:58.737091 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8f21878a-adc7-4d80-8bff-54b586e93bde tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1517 microversion: 2.1 time: 0.223229 Jun 10 18:01:58.741343 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 704/1457] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:58 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1517 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:58.778698 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2d2e0d25-a4b0-428d-845e-a6336500c057 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:58.780089 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2d2e0d25-a4b0-428d-845e-a6336500c057 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:58.787491 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2d2e0d25-a4b0-428d-845e-a6336500c057 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:58.788257 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2d2e0d25-a4b0-428d-845e-a6336500c057 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:58.789275 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2d2e0d25-a4b0-428d-845e-a6336500c057 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:58.789973 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2d2e0d25-a4b0-428d-845e-a6336500c057 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:58.951425 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-93d7feed-6584-4a7a-ae56-0bca50d10d93 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:58.952676 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-93d7feed-6584-4a7a-ae56-0bca50d10d93 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:58.966168 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-93d7feed-6584-4a7a-ae56-0bca50d10d93 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:58.970703 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-93d7feed-6584-4a7a-ae56-0bca50d10d93 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:58.976487 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-93d7feed-6584-4a7a-ae56-0bca50d10d93 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:58.976988 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-93d7feed-6584-4a7a-ae56-0bca50d10d93 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:58.998533 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2d2e0d25-a4b0-428d-845e-a6336500c057 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:59.008810 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2d2e0d25-a4b0-428d-845e-a6336500c057 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1476 microversion: 2.1 time: 0.233902 Jun 10 18:01:59.016001 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 754/1458] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:58 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1476 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:59.033750 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-34caaf89-ae4a-4820-9e21-9ef7144cfe52 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:59.034688 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-34caaf89-ae4a-4820-9e21-9ef7144cfe52 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:59.045528 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-34caaf89-ae4a-4820-9e21-9ef7144cfe52 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:59.047048 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-34caaf89-ae4a-4820-9e21-9ef7144cfe52 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:59.047688 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-34caaf89-ae4a-4820-9e21-9ef7144cfe52 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:59.048286 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-34caaf89-ae4a-4820-9e21-9ef7144cfe52 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:59.107155 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-93d7feed-6584-4a7a-ae56-0bca50d10d93 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:59.115774 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-93d7feed-6584-4a7a-ae56-0bca50d10d93 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:59.119686 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-93d7feed-6584-4a7a-ae56-0bca50d10d93 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:59.128086 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-93d7feed-6584-4a7a-ae56-0bca50d10d93 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1417 microversion: 2.75 time: 0.181367 Jun 10 18:01:59.140858 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 705/1459] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:01:58 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1417 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:01:59.236564 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7613bbec-c5c7-4423-9d26-3d2b95fd3d3e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:59.237455 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7613bbec-c5c7-4423-9d26-3d2b95fd3d3e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:59.245644 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7613bbec-c5c7-4423-9d26-3d2b95fd3d3e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:59.246017 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-34caaf89-ae4a-4820-9e21-9ef7144cfe52 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:59.246540 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7613bbec-c5c7-4423-9d26-3d2b95fd3d3e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:59.248077 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7613bbec-c5c7-4423-9d26-3d2b95fd3d3e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:59.248699 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7613bbec-c5c7-4423-9d26-3d2b95fd3d3e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:59.259747 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-34caaf89-ae4a-4820-9e21-9ef7144cfe52 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1549 microversion: 2.1 time: 0.239134 Jun 10 18:01:59.260683 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 755/1460] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:59 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1549 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:01:59.448074 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-77fab378-f468-4aff-9a52-dd3fdf529f7d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:59.448681 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-77fab378-f468-4aff-9a52-dd3fdf529f7d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:59.457670 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:01:59.460018 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-77fab378-f468-4aff-9a52-dd3fdf529f7d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:59.460625 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-77fab378-f468-4aff-9a52-dd3fdf529f7d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:59.461528 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-77fab378-f468-4aff-9a52-dd3fdf529f7d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:59.462080 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-77fab378-f468-4aff-9a52-dd3fdf529f7d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:59.479208 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7613bbec-c5c7-4423-9d26-3d2b95fd3d3e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:59.502515 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7613bbec-c5c7-4423-9d26-3d2b95fd3d3e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:59.511262 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7613bbec-c5c7-4423-9d26-3d2b95fd3d3e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:59.516449 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7613bbec-c5c7-4423-9d26-3d2b95fd3d3e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.283990 Jun 10 18:01:59.528472 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 706/1461] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:01:59 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:01:59.640854 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-77fab378-f468-4aff-9a52-dd3fdf529f7d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:01:59.653564 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-77fab378-f468-4aff-9a52-dd3fdf529f7d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1379 microversion: 2.1 time: 0.211535 Jun 10 18:01:59.654675 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 756/1462] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:59 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1379 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:01:59.759166 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-89826efe-e4c0-482e-866f-e1faf4d01817 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:01:59.760968 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-89826efe-e4c0-482e-866f-e1faf4d01817 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:01:59.769216 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-89826efe-e4c0-482e-866f-e1faf4d01817 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:59.769669 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-89826efe-e4c0-482e-866f-e1faf4d01817 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:59.770585 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-89826efe-e4c0-482e-866f-e1faf4d01817 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:01:59.771114 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-89826efe-e4c0-482e-866f-e1faf4d01817 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:01:59.996646 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-89826efe-e4c0-482e-866f-e1faf4d01817 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:00.006843 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-89826efe-e4c0-482e-866f-e1faf4d01817 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1517 microversion: 2.1 time: 0.253371 Jun 10 18:02:00.017089 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 707/1463] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:01:59 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1517 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:00.032923 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b2284853-1e76-40d9-ab4d-1c53cba0aba4 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:00.033641 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b2284853-1e76-40d9-ab4d-1c53cba0aba4 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:00.042147 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b2284853-1e76-40d9-ab4d-1c53cba0aba4 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:00.042698 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b2284853-1e76-40d9-ab4d-1c53cba0aba4 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:00.043562 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b2284853-1e76-40d9-ab4d-1c53cba0aba4 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:00.044078 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b2284853-1e76-40d9-ab4d-1c53cba0aba4 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:00.150588 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d76bcf98-01bc-4309-b9f1-50e64c3edd3e tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:00.151259 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d76bcf98-01bc-4309-b9f1-50e64c3edd3e tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:00.164052 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d76bcf98-01bc-4309-b9f1-50e64c3edd3e tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:00.166306 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d76bcf98-01bc-4309-b9f1-50e64c3edd3e tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:00.170158 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d76bcf98-01bc-4309-b9f1-50e64c3edd3e tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:00.179235 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d76bcf98-01bc-4309-b9f1-50e64c3edd3e tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:00.250174 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b2284853-1e76-40d9-ab4d-1c53cba0aba4 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:00.260130 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b2284853-1e76-40d9-ab4d-1c53cba0aba4 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1461 microversion: 2.1 time: 0.231037 Jun 10 18:02:00.265027 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d76bcf98-01bc-4309-b9f1-50e64c3edd3e tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:00.273024 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 757/1464] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:00 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1461 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:00.290751 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6f65c9c7-8a42-45d7-ad13-cfa0cbced209 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:00.291717 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6f65c9c7-8a42-45d7-ad13-cfa0cbced209 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:00.300282 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6f65c9c7-8a42-45d7-ad13-cfa0cbced209 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:00.301400 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6f65c9c7-8a42-45d7-ad13-cfa0cbced209 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:00.302305 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d76bcf98-01bc-4309-b9f1-50e64c3edd3e tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:00.302747 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6f65c9c7-8a42-45d7-ad13-cfa0cbced209 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:00.303441 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6f65c9c7-8a42-45d7-ad13-cfa0cbced209 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:00.303930 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d76bcf98-01bc-4309-b9f1-50e64c3edd3e tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:00.313048 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d76bcf98-01bc-4309-b9f1-50e64c3edd3e tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1417 microversion: 2.75 time: 0.167667 Jun 10 18:02:00.315044 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 708/1465] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:00 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1417 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:02:00.320172 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fddbacee-2f30-4990-83d0-146ee4ae35b1 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:02:00.321232 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fddbacee-2f30-4990-83d0-146ee4ae35b1 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:00.328675 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fddbacee-2f30-4990-83d0-146ee4ae35b1 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:00.329155 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fddbacee-2f30-4990-83d0-146ee4ae35b1 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:00.330432 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fddbacee-2f30-4990-83d0-146ee4ae35b1 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:00.330893 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fddbacee-2f30-4990-83d0-146ee4ae35b1 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:00.470191 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6f65c9c7-8a42-45d7-ad13-cfa0cbced209 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:00.478830 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6f65c9c7-8a42-45d7-ad13-cfa0cbced209 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1549 microversion: 2.1 time: 0.203431 Jun 10 18:02:00.490601 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 758/1466] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:00 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1549 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:00.546373 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6eadcb4d-d87b-455e-84ff-bc005b9bcb02 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:00.546918 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6eadcb4d-d87b-455e-84ff-bc005b9bcb02 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:00.555897 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6eadcb4d-d87b-455e-84ff-bc005b9bcb02 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:00.556399 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6eadcb4d-d87b-455e-84ff-bc005b9bcb02 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:00.557665 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6eadcb4d-d87b-455e-84ff-bc005b9bcb02 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:00.557774 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6eadcb4d-d87b-455e-84ff-bc005b9bcb02 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:00.563345 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=22,nova_cell0:UPDATE=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:02:00.744996 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fddbacee-2f30-4990-83d0-146ee4ae35b1 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] 10.222.0.35 "POST /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f/action" status: 202 len: 0 microversion: 2.1 time: 0.428714 Jun 10 18:02:00.745852 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 709/1467] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:02:00 2022] POST /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f/action => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:02:00.751709 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-255b9770-b6b2-4bfc-9d88-0c9154f55c02 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:00.761132 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-255b9770-b6b2-4bfc-9d88-0c9154f55c02 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:00.761132 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-255b9770-b6b2-4bfc-9d88-0c9154f55c02 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:00.761132 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-255b9770-b6b2-4bfc-9d88-0c9154f55c02 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:00.761132 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-255b9770-b6b2-4bfc-9d88-0c9154f55c02 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:00.761591 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-255b9770-b6b2-4bfc-9d88-0c9154f55c02 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:00.793853 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6eadcb4d-d87b-455e-84ff-bc005b9bcb02 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:00.803713 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6eadcb4d-d87b-455e-84ff-bc005b9bcb02 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:00.809601 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6eadcb4d-d87b-455e-84ff-bc005b9bcb02 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:00.812197 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6eadcb4d-d87b-455e-84ff-bc005b9bcb02 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.269806 Jun 10 18:02:00.812809 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 759/1468] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:00 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:00.817442 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cc0b0a59-2713-4f9a-99ed-22270aad9234 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:00.818225 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cc0b0a59-2713-4f9a-99ed-22270aad9234 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:00.825142 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc0b0a59-2713-4f9a-99ed-22270aad9234 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:00.875566 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc0b0a59-2713-4f9a-99ed-22270aad9234 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:00.875566 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc0b0a59-2713-4f9a-99ed-22270aad9234 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:00.875566 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc0b0a59-2713-4f9a-99ed-22270aad9234 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:00.875566 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc0b0a59-2713-4f9a-99ed-22270aad9234 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:00.877251 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc0b0a59-2713-4f9a-99ed-22270aad9234 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:00.877251 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-cc0b0a59-2713-4f9a-99ed-22270aad9234 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lazy-loading 'fault' on Instance uuid ab0caf46-568d-4b5a-bd31-458cdc99b06f {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:02:00.925677 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-255b9770-b6b2-4bfc-9d88-0c9154f55c02 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:00.933163 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-255b9770-b6b2-4bfc-9d88-0c9154f55c02 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1379 microversion: 2.1 time: 0.186490 Jun 10 18:02:00.933930 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 710/1469] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:00 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1379 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:00.981350 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cc0b0a59-2713-4f9a-99ed-22270aad9234 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1595 microversion: 2.1 time: 0.167235 Jun 10 18:02:00.982099 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 760/1470] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:00 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1595 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:00.998061 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d830fad9-6a08-4760-9515-eca607e206b7 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:02:01.000647 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d830fad9-6a08-4760-9515-eca607e206b7 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:01.008104 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d830fad9-6a08-4760-9515-eca607e206b7 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:01.008662 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d830fad9-6a08-4760-9515-eca607e206b7 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:01.009517 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d830fad9-6a08-4760-9515-eca607e206b7 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:01.010035 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d830fad9-6a08-4760-9515-eca607e206b7 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:01.024210 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ab26da04-65fa-4e68-9913-93c306797082 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:01.024891 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ab26da04-65fa-4e68-9913-93c306797082 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:01.034635 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ab26da04-65fa-4e68-9913-93c306797082 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:01.035362 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ab26da04-65fa-4e68-9913-93c306797082 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:01.035909 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ab26da04-65fa-4e68-9913-93c306797082 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:01.036370 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ab26da04-65fa-4e68-9913-93c306797082 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:01.203987 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ab26da04-65fa-4e68-9913-93c306797082 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:01.212496 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ab26da04-65fa-4e68-9913-93c306797082 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1517 microversion: 2.1 time: 0.192064 Jun 10 18:02:01.214696 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 761/1471] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:01 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1517 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:02:01.336153 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d7401da3-6fc3-4a93-9388-3c1b34961018 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:01.336817 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d7401da3-6fc3-4a93-9388-3c1b34961018 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:01.360787 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d7401da3-6fc3-4a93-9388-3c1b34961018 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:01.362720 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d7401da3-6fc3-4a93-9388-3c1b34961018 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:01.366028 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d7401da3-6fc3-4a93-9388-3c1b34961018 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:01.366571 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d7401da3-6fc3-4a93-9388-3c1b34961018 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:01.547994 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d7401da3-6fc3-4a93-9388-3c1b34961018 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:01.557328 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d830fad9-6a08-4760-9515-eca607e206b7 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] 10.222.0.35 "POST /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f/action" status: 202 len: 0 microversion: 2.1 time: 0.563360 Jun 10 18:02:01.561434 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 711/1472] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:02:00 2022] POST /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f/action => generated 0 bytes in 565 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:02:01.562763 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d7401da3-6fc3-4a93-9388-3c1b34961018 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:01.564977 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d7401da3-6fc3-4a93-9388-3c1b34961018 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:01.566522 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fe1650ce-f4e3-4c77-8325-6781aa3d6223 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:01.567776 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fe1650ce-f4e3-4c77-8325-6781aa3d6223 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:01.572525 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d7401da3-6fc3-4a93-9388-3c1b34961018 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1417 microversion: 2.75 time: 0.241835 Jun 10 18:02:01.573778 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 762/1473] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:01 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1417 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:02:01.580782 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a9f701ca-d258-44da-b488-1a01a4f7dfb6 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:01.581755 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a9f701ca-d258-44da-b488-1a01a4f7dfb6 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:01.592327 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fe1650ce-f4e3-4c77-8325-6781aa3d6223 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:01.592810 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fe1650ce-f4e3-4c77-8325-6781aa3d6223 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:01.595601 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fe1650ce-f4e3-4c77-8325-6781aa3d6223 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:01.595917 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fe1650ce-f4e3-4c77-8325-6781aa3d6223 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:01.597691 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a9f701ca-d258-44da-b488-1a01a4f7dfb6 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:01.598563 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a9f701ca-d258-44da-b488-1a01a4f7dfb6 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:01.599726 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a9f701ca-d258-44da-b488-1a01a4f7dfb6 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:01.600508 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a9f701ca-d258-44da-b488-1a01a4f7dfb6 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:01.724760 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=16 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:02:01.762556 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a9f701ca-d258-44da-b488-1a01a4f7dfb6 tempest-ServersAdminTestJSON-1499753349 tempest-ServersAdminTestJSON-1499753349-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1612 microversion: 2.1 time: 0.186375 Jun 10 18:02:01.762556 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 763/1474] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:01 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1612 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:01.782819 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5c8dfb29-9852-4320-9321-30ae5ecd5f8a tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:01.783327 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5c8dfb29-9852-4320-9321-30ae5ecd5f8a tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: b09b98a7-d89b-42b8-a3c8-809653486d0f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:01.784734 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fe1650ce-f4e3-4c77-8325-6781aa3d6223 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:01.789953 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5c8dfb29-9852-4320-9321-30ae5ecd5f8a tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:01.790417 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5c8dfb29-9852-4320-9321-30ae5ecd5f8a tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:01.791832 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5c8dfb29-9852-4320-9321-30ae5ecd5f8a tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:01.792295 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5c8dfb29-9852-4320-9321-30ae5ecd5f8a tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:01.799976 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fe1650ce-f4e3-4c77-8325-6781aa3d6223 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1549 microversion: 2.1 time: 0.240222 Jun 10 18:02:01.801395 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 712/1475] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:01 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1549 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:01.809760 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:02:01.822164 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-291604a7-4226-4064-9909-e7c84c9a181c req-3fe248fa-76d2-44fa-af89-db2527515ea8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbc49fe4-a119-4ed9-9310-45babff4fec4", "name": "network-vif-plugged", "status": "completed", "tag": "8e46ecde-2a76-4ced-9d12-e08541a4852f"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:02:01.822416 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5c8dfb29-9852-4320-9321-30ae5ecd5f8a tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: b09b98a7-d89b-42b8-a3c8-809653486d0f] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:02:01.834455 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-291604a7-4226-4064-9909-e7c84c9a181c req-3fe248fa-76d2-44fa-af89-db2527515ea8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:01.835388 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-291604a7-4226-4064-9909-e7c84c9a181c req-3fe248fa-76d2-44fa-af89-db2527515ea8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:01.854208 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-291604a7-4226-4064-9909-e7c84c9a181c req-3fe248fa-76d2-44fa-af89-db2527515ea8 service nova] Creating event network-vif-plugged:8e46ecde-2a76-4ced-9d12-e08541a4852f for instance fbc49fe4-a119-4ed9-9310-45babff4fec4 on chh2-master-2 Jun 10 18:02:01.870752 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-291604a7-4226-4064-9909-e7c84c9a181c req-3fe248fa-76d2-44fa-af89-db2527515ea8 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058276 Jun 10 18:02:01.875244 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 713/1476] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:02:01.881468 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c8be5465-3a7e-489f-b462-430f115abeba tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:01.881820 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c8be5465-3a7e-489f-b462-430f115abeba tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:01.889015 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c8be5465-3a7e-489f-b462-430f115abeba tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:01.889478 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c8be5465-3a7e-489f-b462-430f115abeba tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:01.890466 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c8be5465-3a7e-489f-b462-430f115abeba tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:01.890899 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c8be5465-3a7e-489f-b462-430f115abeba tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:02.058171 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c8be5465-3a7e-489f-b462-430f115abeba tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:02.069494 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c8be5465-3a7e-489f-b462-430f115abeba tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:02.071471 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c8be5465-3a7e-489f-b462-430f115abeba tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:02.073104 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c8be5465-3a7e-489f-b462-430f115abeba tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.196745 Jun 10 18:02:02.081860 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 714/1477] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:01 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:02.087051 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-808637cb-f1d5-4089-a457-8bb3031e7956 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:02.087756 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-808637cb-f1d5-4089-a457-8bb3031e7956 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:02.094948 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-808637cb-f1d5-4089-a457-8bb3031e7956 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:02.095422 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-808637cb-f1d5-4089-a457-8bb3031e7956 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:02.096200 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-808637cb-f1d5-4089-a457-8bb3031e7956 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:02.096682 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-808637cb-f1d5-4089-a457-8bb3031e7956 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:02.237365 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-808637cb-f1d5-4089-a457-8bb3031e7956 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:02.246556 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-808637cb-f1d5-4089-a457-8bb3031e7956 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1379 microversion: 2.1 time: 0.163284 Jun 10 18:02:02.248664 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 715/1478] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:02 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1379 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:02.270880 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7d535af8-7612-43aa-a901-f2df726b0a29 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:02.272870 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7d535af8-7612-43aa-a901-f2df726b0a29 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:02.279549 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7d535af8-7612-43aa-a901-f2df726b0a29 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:02.280082 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7d535af8-7612-43aa-a901-f2df726b0a29 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:02.281784 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7d535af8-7612-43aa-a901-f2df726b0a29 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:02.282599 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7d535af8-7612-43aa-a901-f2df726b0a29 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:02.287299 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:02:02.331871 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5c8dfb29-9852-4320-9321-30ae5ecd5f8a tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "DELETE /compute/v2.1/servers/b09b98a7-d89b-42b8-a3c8-809653486d0f" status: 204 len: 0 microversion: 2.1 time: 0.553264 Jun 10 18:02:02.337859 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 764/1479] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:02:01 2022] DELETE /compute/v2.1/servers/b09b98a7-d89b-42b8-a3c8-809653486d0f => generated 0 bytes in 557 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:02:02.346294 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-90af8856-1be5-4df6-a392-c8d3572df995 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:02.347209 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-90af8856-1be5-4df6-a392-c8d3572df995 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: b09b98a7-d89b-42b8-a3c8-809653486d0f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:02.360059 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-90af8856-1be5-4df6-a392-c8d3572df995 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:02.361083 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-90af8856-1be5-4df6-a392-c8d3572df995 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:02.362424 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-90af8856-1be5-4df6-a392-c8d3572df995 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:02.363172 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-90af8856-1be5-4df6-a392-c8d3572df995 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:02.471873 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7d535af8-7612-43aa-a901-f2df726b0a29 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:02.489666 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7d535af8-7612-43aa-a901-f2df726b0a29 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1517 microversion: 2.1 time: 0.219898 Jun 10 18:02:02.489666 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 716/1480] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:02 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1517 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:02.534854 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-90af8856-1be5-4df6-a392-c8d3572df995 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:02.552083 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-90af8856-1be5-4df6-a392-c8d3572df995 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/b09b98a7-d89b-42b8-a3c8-809653486d0f" status: 200 len: 1470 microversion: 2.1 time: 0.212475 Jun 10 18:02:02.554589 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 765/1481] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:02 2022] GET /compute/v2.1/servers/b09b98a7-d89b-42b8-a3c8-809653486d0f => generated 1470 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:02.593142 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6601345f-1e37-4ee0-a482-db67b5b6dffd tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:02.594229 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6601345f-1e37-4ee0-a482-db67b5b6dffd tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:02.600113 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6601345f-1e37-4ee0-a482-db67b5b6dffd tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:02.600722 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6601345f-1e37-4ee0-a482-db67b5b6dffd tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:02.601711 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6601345f-1e37-4ee0-a482-db67b5b6dffd tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:02.602262 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6601345f-1e37-4ee0-a482-db67b5b6dffd tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:02.670917 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6601345f-1e37-4ee0-a482-db67b5b6dffd tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:02.679027 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6601345f-1e37-4ee0-a482-db67b5b6dffd tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:02.680506 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6601345f-1e37-4ee0-a482-db67b5b6dffd tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:02.686296 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6601345f-1e37-4ee0-a482-db67b5b6dffd tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1417 microversion: 2.75 time: 0.097353 Jun 10 18:02:02.686880 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 717/1482] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:02 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1417 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:02.817836 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-83df7f30-a9d0-4d71-9169-b0e12c82886f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:02.818450 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-83df7f30-a9d0-4d71-9169-b0e12c82886f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:02.824673 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83df7f30-a9d0-4d71-9169-b0e12c82886f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:02.825127 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83df7f30-a9d0-4d71-9169-b0e12c82886f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:02.825922 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83df7f30-a9d0-4d71-9169-b0e12c82886f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:02.826357 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83df7f30-a9d0-4d71-9169-b0e12c82886f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:02.971476 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-83df7f30-a9d0-4d71-9169-b0e12c82886f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:02.981181 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-83df7f30-a9d0-4d71-9169-b0e12c82886f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1549 microversion: 2.1 time: 0.167084 Jun 10 18:02:02.991090 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 766/1483] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:02 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1549 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:03.093263 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8b7554b9-6c22-4679-966b-d118c13b9f29 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:03.094411 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8b7554b9-6c22-4679-966b-d118c13b9f29 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:03.096956 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:02:03.102295 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8b7554b9-6c22-4679-966b-d118c13b9f29 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:03.102791 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8b7554b9-6c22-4679-966b-d118c13b9f29 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:03.103563 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8b7554b9-6c22-4679-966b-d118c13b9f29 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:03.104005 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8b7554b9-6c22-4679-966b-d118c13b9f29 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:03.246485 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8b7554b9-6c22-4679-966b-d118c13b9f29 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:03.255847 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8b7554b9-6c22-4679-966b-d118c13b9f29 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:03.263309 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e06c5033-ec04-40b0-a0db-d4df7d96c0b6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:03.266177 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e06c5033-ec04-40b0-a0db-d4df7d96c0b6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:03.269493 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8b7554b9-6c22-4679-966b-d118c13b9f29 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:03.270709 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8b7554b9-6c22-4679-966b-d118c13b9f29 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.182221 Jun 10 18:02:03.281891 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 718/1484] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:03 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:03.283417 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e06c5033-ec04-40b0-a0db-d4df7d96c0b6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:03.283417 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e06c5033-ec04-40b0-a0db-d4df7d96c0b6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:03.283630 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e06c5033-ec04-40b0-a0db-d4df7d96c0b6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:03.283951 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e06c5033-ec04-40b0-a0db-d4df7d96c0b6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:03.442643 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e06c5033-ec04-40b0-a0db-d4df7d96c0b6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:03.450374 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e06c5033-ec04-40b0-a0db-d4df7d96c0b6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1379 microversion: 2.1 time: 0.191265 Jun 10 18:02:03.451487 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 767/1485] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:03 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1379 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:02:03.503904 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8699fd58-3201-4b1a-943e-fe973b5aa3d3 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:03.504562 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8699fd58-3201-4b1a-943e-fe973b5aa3d3 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:03.511261 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8699fd58-3201-4b1a-943e-fe973b5aa3d3 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:03.511719 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8699fd58-3201-4b1a-943e-fe973b5aa3d3 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:03.512609 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8699fd58-3201-4b1a-943e-fe973b5aa3d3 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:03.513710 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8699fd58-3201-4b1a-943e-fe973b5aa3d3 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:03.572205 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0fbfaff7-6967-4859-bc8c-f083fe22c21f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:03.572861 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0fbfaff7-6967-4859-bc8c-f083fe22c21f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: b09b98a7-d89b-42b8-a3c8-809653486d0f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:03.580017 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0fbfaff7-6967-4859-bc8c-f083fe22c21f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:03.580505 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0fbfaff7-6967-4859-bc8c-f083fe22c21f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:03.581304 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0fbfaff7-6967-4859-bc8c-f083fe22c21f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:03.581736 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0fbfaff7-6967-4859-bc8c-f083fe22c21f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:03.688987 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8699fd58-3201-4b1a-943e-fe973b5aa3d3 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:03.697317 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8699fd58-3201-4b1a-943e-fe973b5aa3d3 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1517 microversion: 2.1 time: 0.197531 Jun 10 18:02:03.707599 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 719/1486] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:03 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1517 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:03.713698 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ba2a75d7-5c52-47f3-9734-14e45dbafc59 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:03.714320 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ba2a75d7-5c52-47f3-9734-14e45dbafc59 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:03.722828 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ba2a75d7-5c52-47f3-9734-14e45dbafc59 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:03.723370 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ba2a75d7-5c52-47f3-9734-14e45dbafc59 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:03.724085 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ba2a75d7-5c52-47f3-9734-14e45dbafc59 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:03.724556 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ba2a75d7-5c52-47f3-9734-14e45dbafc59 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:03.737998 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0fbfaff7-6967-4859-bc8c-f083fe22c21f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:03.762112 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0fbfaff7-6967-4859-bc8c-f083fe22c21f tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/b09b98a7-d89b-42b8-a3c8-809653486d0f" status: 200 len: 1470 microversion: 2.1 time: 0.193807 Jun 10 18:02:03.772287 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 768/1487] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:03 2022] GET /compute/v2.1/servers/b09b98a7-d89b-42b8-a3c8-809653486d0f => generated 1470 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:03.776764 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b9791335-a2cf-4a4c-bfec-b14dc5a52329 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:03.777620 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b9791335-a2cf-4a4c-bfec-b14dc5a52329 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:03.784601 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9791335-a2cf-4a4c-bfec-b14dc5a52329 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:03.785313 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9791335-a2cf-4a4c-bfec-b14dc5a52329 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:03.786267 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9791335-a2cf-4a4c-bfec-b14dc5a52329 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:03.786886 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9791335-a2cf-4a4c-bfec-b14dc5a52329 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:03.858203 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b9791335-a2cf-4a4c-bfec-b14dc5a52329 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:03.867029 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b9791335-a2cf-4a4c-bfec-b14dc5a52329 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:03.868819 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b9791335-a2cf-4a4c-bfec-b14dc5a52329 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:03.875708 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b9791335-a2cf-4a4c-bfec-b14dc5a52329 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1438 microversion: 2.75 time: 0.107590 Jun 10 18:02:03.876529 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 769/1488] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:03 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1438 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:03.888729 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ba2a75d7-5c52-47f3-9734-14e45dbafc59 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:03.896253 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-09969013-7173-4eb1-908e-615481277e1f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:02:03.897124 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ba2a75d7-5c52-47f3-9734-14e45dbafc59 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1681 microversion: 2.1 time: 0.188160 Jun 10 18:02:03.898307 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-09969013-7173-4eb1-908e-615481277e1f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:03.898489 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 720/1489] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:03 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1681 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:03.907916 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-09969013-7173-4eb1-908e-615481277e1f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:03.908400 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-09969013-7173-4eb1-908e-615481277e1f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:03.909183 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-09969013-7173-4eb1-908e-615481277e1f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:03.909625 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-09969013-7173-4eb1-908e-615481277e1f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:03.988914 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-09969013-7173-4eb1-908e-615481277e1f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:02:03.989334 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-09969013-7173-4eb1-908e-615481277e1f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:02:03.989809 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-09969013-7173-4eb1-908e-615481277e1f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:02:03.990216 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-09969013-7173-4eb1-908e-615481277e1f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:02:03.993365 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-09969013-7173-4eb1-908e-615481277e1f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:02:04.000122 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-155118ed-8798-40cb-9cec-9c0e872d99b9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:04.000986 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-155118ed-8798-40cb-9cec-9c0e872d99b9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:04.007500 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-155118ed-8798-40cb-9cec-9c0e872d99b9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:04.008237 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-155118ed-8798-40cb-9cec-9c0e872d99b9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:04.019384 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-155118ed-8798-40cb-9cec-9c0e872d99b9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:04.020378 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-155118ed-8798-40cb-9cec-9c0e872d99b9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:04.217483 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-155118ed-8798-40cb-9cec-9c0e872d99b9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:04.233608 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-09969013-7173-4eb1-908e-615481277e1f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:04.249479 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-09969013-7173-4eb1-908e-615481277e1f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:04.250311 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-09969013-7173-4eb1-908e-615481277e1f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:04.251181 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-09969013-7173-4eb1-908e-615481277e1f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:04.251613 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-09969013-7173-4eb1-908e-615481277e1f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:04.252169 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-155118ed-8798-40cb-9cec-9c0e872d99b9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1549 microversion: 2.1 time: 0.233672 Jun 10 18:02:04.263969 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 721/1490] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:03 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1549 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:04.290060 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a893899e-bee0-4f29-9b0b-556268d5befa tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:04.290822 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a893899e-bee0-4f29-9b0b-556268d5befa tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:04.307604 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a893899e-bee0-4f29-9b0b-556268d5befa tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:04.311388 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a893899e-bee0-4f29-9b0b-556268d5befa tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:04.312507 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a893899e-bee0-4f29-9b0b-556268d5befa tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:04.313191 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a893899e-bee0-4f29-9b0b-556268d5befa tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:04.346499 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-09969013-7173-4eb1-908e-615481277e1f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:04.358403 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-09969013-7173-4eb1-908e-615481277e1f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:04.361425 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-09969013-7173-4eb1-908e-615481277e1f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:04.366262 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-09969013-7173-4eb1-908e-615481277e1f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "POST /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe/action" status: 202 len: 1495 microversion: 2.75 time: 0.474519 Jun 10 18:02:04.367259 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 770/1491] 10.222.0.35 () {62 vars in 1318 bytes} [Fri Jun 10 18:02:03 2022] POST /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe/action => generated 1495 bytes in 476 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Jun 10 18:02:04.388803 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-183cfcd1-8fd9-4249-aabd-df05c49f9e90 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:04.389736 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-183cfcd1-8fd9-4249-aabd-df05c49f9e90 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:04.396464 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-183cfcd1-8fd9-4249-aabd-df05c49f9e90 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:04.397188 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-183cfcd1-8fd9-4249-aabd-df05c49f9e90 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:04.398267 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-183cfcd1-8fd9-4249-aabd-df05c49f9e90 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:04.399056 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-183cfcd1-8fd9-4249-aabd-df05c49f9e90 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:04.512633 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a893899e-bee0-4f29-9b0b-556268d5befa tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:04.521855 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a893899e-bee0-4f29-9b0b-556268d5befa tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:04.523345 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a893899e-bee0-4f29-9b0b-556268d5befa tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:04.524587 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a893899e-bee0-4f29-9b0b-556268d5befa tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.239091 Jun 10 18:02:04.525341 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 722/1492] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:04 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:04.529984 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-36933c13-1c60-44ef-9cb8-de7894f31ab2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:04.530591 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-36933c13-1c60-44ef-9cb8-de7894f31ab2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:04.536572 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-36933c13-1c60-44ef-9cb8-de7894f31ab2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:04.537024 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-36933c13-1c60-44ef-9cb8-de7894f31ab2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:04.537800 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-36933c13-1c60-44ef-9cb8-de7894f31ab2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:04.538228 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-36933c13-1c60-44ef-9cb8-de7894f31ab2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:04.543555 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-183cfcd1-8fd9-4249-aabd-df05c49f9e90 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:04.557405 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-183cfcd1-8fd9-4249-aabd-df05c49f9e90 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:04.559096 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-183cfcd1-8fd9-4249-aabd-df05c49f9e90 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:04.570174 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-183cfcd1-8fd9-4249-aabd-df05c49f9e90 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1447 microversion: 2.75 time: 0.185187 Jun 10 18:02:04.571338 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 771/1493] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:04 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1447 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:04.699491 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-36933c13-1c60-44ef-9cb8-de7894f31ab2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:04.715245 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-36933c13-1c60-44ef-9cb8-de7894f31ab2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1379 microversion: 2.1 time: 0.189049 Jun 10 18:02:04.716011 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cd9108b6-10b4-4c34-855d-2141afe58991 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:04.716743 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 723/1494] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:04 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1379 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:04.721754 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cd9108b6-10b4-4c34-855d-2141afe58991 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:04.728340 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd9108b6-10b4-4c34-855d-2141afe58991 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:04.728910 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd9108b6-10b4-4c34-855d-2141afe58991 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:04.729775 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd9108b6-10b4-4c34-855d-2141afe58991 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:04.730286 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd9108b6-10b4-4c34-855d-2141afe58991 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:04.782090 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3f33ee1c-e505-4392-90ee-279a4afcb475 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:04.782699 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3f33ee1c-e505-4392-90ee-279a4afcb475 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: b09b98a7-d89b-42b8-a3c8-809653486d0f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:04.789750 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f33ee1c-e505-4392-90ee-279a4afcb475 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:04.790278 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f33ee1c-e505-4392-90ee-279a4afcb475 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:04.791057 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f33ee1c-e505-4392-90ee-279a4afcb475 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:04.791599 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f33ee1c-e505-4392-90ee-279a4afcb475 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:04.903084 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cd9108b6-10b4-4c34-855d-2141afe58991 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:04.912514 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cd9108b6-10b4-4c34-855d-2141afe58991 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1517 microversion: 2.1 time: 0.201119 Jun 10 18:02:04.923018 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 772/1495] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:04 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1517 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:02:04.923018 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cf8d0f03-ca91-4809-b32e-b4682414882f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:04.923018 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cf8d0f03-ca91-4809-b32e-b4682414882f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:04.928753 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cf8d0f03-ca91-4809-b32e-b4682414882f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:04.929352 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cf8d0f03-ca91-4809-b32e-b4682414882f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:04.930132 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cf8d0f03-ca91-4809-b32e-b4682414882f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:04.932031 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cf8d0f03-ca91-4809-b32e-b4682414882f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:04.936460 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3f33ee1c-e505-4392-90ee-279a4afcb475 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:04.965865 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3f33ee1c-e505-4392-90ee-279a4afcb475 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/b09b98a7-d89b-42b8-a3c8-809653486d0f" status: 200 len: 1470 microversion: 2.1 time: 0.181675 Jun 10 18:02:04.968170 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 724/1496] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:04 2022] GET /compute/v2.1/servers/b09b98a7-d89b-42b8-a3c8-809653486d0f => generated 1470 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:05.082507 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-13a638c2-7bbf-4134-b895-c7a2ef6cdaab req-1db22065-a217-4490-a5af-443d41891e04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b09b98a7-d89b-42b8-a3c8-809653486d0f", "name": "network-vif-deleted", "tag": "69d1c5d0-5db0-4717-b5ec-b211301a6d9c"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:02:05.093241 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-13a638c2-7bbf-4134-b895-c7a2ef6cdaab req-1db22065-a217-4490-a5af-443d41891e04 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:05.093693 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-13a638c2-7bbf-4134-b895-c7a2ef6cdaab req-1db22065-a217-4490-a5af-443d41891e04 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:05.112260 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-13a638c2-7bbf-4134-b895-c7a2ef6cdaab req-1db22065-a217-4490-a5af-443d41891e04 service nova] Creating event network-vif-deleted:69d1c5d0-5db0-4717-b5ec-b211301a6d9c for instance b09b98a7-d89b-42b8-a3c8-809653486d0f on chh1-master-2 Jun 10 18:02:05.117603 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-13a638c2-7bbf-4134-b895-c7a2ef6cdaab req-1db22065-a217-4490-a5af-443d41891e04 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039514 Jun 10 18:02:05.118580 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 725/1497] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:02:05.163715 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cf8d0f03-ca91-4809-b32e-b4682414882f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:05.172791 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cf8d0f03-ca91-4809-b32e-b4682414882f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.258423 Jun 10 18:02:05.173375 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 773/1498] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:04 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:05.192349 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-355e801f-b01d-4974-a9f6-fe376bd10795 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-734508264"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:02:05.194099 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-355e801f-b01d-4974-a9f6-fe376bd10795 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:05.201718 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-355e801f-b01d-4974-a9f6-fe376bd10795 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:05.204058 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-355e801f-b01d-4974-a9f6-fe376bd10795 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:05.204058 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-355e801f-b01d-4974-a9f6-fe376bd10795 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:05.204058 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-355e801f-b01d-4974-a9f6-fe376bd10795 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:05.271286 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f4b67ed9-d5f1-410c-aee0-849dd907aeb4 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:05.272062 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f4b67ed9-d5f1-410c-aee0-849dd907aeb4 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:05.279902 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f4b67ed9-d5f1-410c-aee0-849dd907aeb4 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:05.280467 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f4b67ed9-d5f1-410c-aee0-849dd907aeb4 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:05.281400 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f4b67ed9-d5f1-410c-aee0-849dd907aeb4 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:05.282074 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f4b67ed9-d5f1-410c-aee0-849dd907aeb4 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:05.492953 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f4b67ed9-d5f1-410c-aee0-849dd907aeb4 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:05.503948 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f4b67ed9-d5f1-410c-aee0-849dd907aeb4 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1549 microversion: 2.1 time: 0.237314 Jun 10 18:02:05.504869 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 774/1499] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:05 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1549 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:02:05.543707 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cd73d8d4-66e8-41fb-b9e0-c46a3eb543f6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:05.545130 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cd73d8d4-66e8-41fb-b9e0-c46a3eb543f6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:05.552259 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd73d8d4-66e8-41fb-b9e0-c46a3eb543f6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:05.552747 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd73d8d4-66e8-41fb-b9e0-c46a3eb543f6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:05.553522 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd73d8d4-66e8-41fb-b9e0-c46a3eb543f6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:05.554017 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd73d8d4-66e8-41fb-b9e0-c46a3eb543f6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:05.692139 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cd73d8d4-66e8-41fb-b9e0-c46a3eb543f6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:05.700679 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cd73d8d4-66e8-41fb-b9e0-c46a3eb543f6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:05.702238 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cd73d8d4-66e8-41fb-b9e0-c46a3eb543f6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:05.703831 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cd73d8d4-66e8-41fb-b9e0-c46a3eb543f6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.164268 Jun 10 18:02:05.704690 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 775/1500] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:05 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:02:05.710992 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f2d51abc-bbeb-4fb3-9b0f-d8e4659b6ad2 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:05.711594 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f2d51abc-bbeb-4fb3-9b0f-d8e4659b6ad2 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:05.717981 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f2d51abc-bbeb-4fb3-9b0f-d8e4659b6ad2 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:05.718429 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f2d51abc-bbeb-4fb3-9b0f-d8e4659b6ad2 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:05.719197 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f2d51abc-bbeb-4fb3-9b0f-d8e4659b6ad2 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:05.721673 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f2d51abc-bbeb-4fb3-9b0f-d8e4659b6ad2 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:05.789006 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-355e801f-b01d-4974-a9f6-fe376bd10795 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "POST /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1/action" status: 202 len: 0 microversion: 2.1 time: 0.602390 Jun 10 18:02:05.792826 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 726/1501] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:02:05 2022] POST /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1/action => generated 0 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jun 10 18:02:05.797735 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f2d51abc-bbeb-4fb3-9b0f-d8e4659b6ad2 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:05.798027 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1ee21da3-e81f-4db2-8cdb-b3ed61903b24 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:05.798733 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1ee21da3-e81f-4db2-8cdb-b3ed61903b24 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:05.805347 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1ee21da3-e81f-4db2-8cdb-b3ed61903b24 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:05.805813 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1ee21da3-e81f-4db2-8cdb-b3ed61903b24 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:05.806627 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1ee21da3-e81f-4db2-8cdb-b3ed61903b24 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:05.807159 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1ee21da3-e81f-4db2-8cdb-b3ed61903b24 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:05.807274 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f2d51abc-bbeb-4fb3-9b0f-d8e4659b6ad2 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:05.808594 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f2d51abc-bbeb-4fb3-9b0f-d8e4659b6ad2 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:05.815536 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f2d51abc-bbeb-4fb3-9b0f-d8e4659b6ad2 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1447 microversion: 2.75 time: 0.109643 Jun 10 18:02:05.824470 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 776/1502] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:05 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1447 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:05.932836 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dd29171d-83ef-468d-bf3d-13a6317750d7 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:05.933475 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dd29171d-83ef-468d-bf3d-13a6317750d7 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:05.940587 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd29171d-83ef-468d-bf3d-13a6317750d7 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:05.940978 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd29171d-83ef-468d-bf3d-13a6317750d7 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:05.941766 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd29171d-83ef-468d-bf3d-13a6317750d7 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:05.942231 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd29171d-83ef-468d-bf3d-13a6317750d7 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:05.943684 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1ee21da3-e81f-4db2-8cdb-b3ed61903b24 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:05.945231 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:02:05.951317 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1ee21da3-e81f-4db2-8cdb-b3ed61903b24 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1528 microversion: 2.1 time: 0.160499 Jun 10 18:02:05.951883 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 727/1503] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:05 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1528 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:05.968213 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-89580f24-9cd7-4579-941d-f02b11a07e79 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:05.968857 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-89580f24-9cd7-4579-941d-f02b11a07e79 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:05.975011 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-89580f24-9cd7-4579-941d-f02b11a07e79 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:05.976427 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-89580f24-9cd7-4579-941d-f02b11a07e79 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:05.976427 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-89580f24-9cd7-4579-941d-f02b11a07e79 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:05.976734 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-89580f24-9cd7-4579-941d-f02b11a07e79 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:06.080449 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-dd29171d-83ef-468d-bf3d-13a6317750d7 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:06.090825 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dd29171d-83ef-468d-bf3d-13a6317750d7 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1517 microversion: 2.1 time: 0.163907 Jun 10 18:02:06.092527 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 777/1504] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:05 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:06.098143 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a743f64d-7f66-48d6-b0e6-74a837336037 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:06.098762 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a743f64d-7f66-48d6-b0e6-74a837336037 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: b09b98a7-d89b-42b8-a3c8-809653486d0f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:06.106340 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a743f64d-7f66-48d6-b0e6-74a837336037 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:06.107461 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a743f64d-7f66-48d6-b0e6-74a837336037 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:06.108251 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a743f64d-7f66-48d6-b0e6-74a837336037 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:06.108792 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a743f64d-7f66-48d6-b0e6-74a837336037 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:06.130711 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-89580f24-9cd7-4579-941d-f02b11a07e79 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:06.138629 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-89580f24-9cd7-4579-941d-f02b11a07e79 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1528 microversion: 2.1 time: 0.174657 Jun 10 18:02:06.139202 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 728/1505] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:05 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1528 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:02:06.141298 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a743f64d-7f66-48d6-b0e6-74a837336037 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:06.141809 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a743f64d-7f66-48d6-b0e6-74a837336037 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:06.142263 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-a743f64d-7f66-48d6-b0e6-74a837336037 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lazy-loading 'fault' on Instance uuid b09b98a7-d89b-42b8-a3c8-809653486d0f {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:02:06.154446 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-75adc62a-4f6b-424f-9458-a56e40b1a5af tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:06.155549 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:02:06.155549 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 18:02:06.186790 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a743f64d-7f66-48d6-b0e6-74a837336037 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:06.195554 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a743f64d-7f66-48d6-b0e6-74a837336037 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/b09b98a7-d89b-42b8-a3c8-809653486d0f" status: 200 len: 1304 microversion: 2.1 time: 0.101870 Jun 10 18:02:06.196089 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 778/1506] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:06 2022] GET /compute/v2.1/servers/b09b98a7-d89b-42b8-a3c8-809653486d0f => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:06.231045 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-75adc62a-4f6b-424f-9458-a56e40b1a5af tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] 10.222.0.35 "DELETE /compute/v2.1/flavors/0808ae9d-5d11-4d53-9cba-46dd87bed7aa" status: 202 len: 0 microversion: 2.1 time: 0.080611 Jun 10 18:02:06.232364 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 729/1507] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:02:06 2022] DELETE /compute/v2.1/flavors/0808ae9d-5d11-4d53-9cba-46dd87bed7aa => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 18:02:06.240419 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9ec0782b-6739-4d78-815c-e7eaaa1204b2 tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:06.258892 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9ec0782b-6739-4d78-815c-e7eaaa1204b2 tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022391 Jun 10 18:02:06.259452 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 779/1508] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 18:02:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:06.273380 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-afa174fb-5bc6-4a61-8b9e-09e0e47e17b6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:02:06.274456 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-afa174fb-5bc6-4a61-8b9e-09e0e47e17b6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:06.280912 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-afa174fb-5bc6-4a61-8b9e-09e0e47e17b6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:06.281357 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-afa174fb-5bc6-4a61-8b9e-09e0e47e17b6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:06.282112 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-afa174fb-5bc6-4a61-8b9e-09e0e47e17b6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:06.282543 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-afa174fb-5bc6-4a61-8b9e-09e0e47e17b6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:06.310840 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-afa174fb-5bc6-4a61-8b9e-09e0e47e17b6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:06.316613 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-afa174fb-5bc6-4a61-8b9e-09e0e47e17b6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Old instance type tempest-test_resize_flavor_-2012543285, new instance type m1.heat {{(pid=126594) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 10 18:02:06.323458 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-afa174fb-5bc6-4a61-8b9e-09e0e47e17b6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:02:06.323884 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-afa174fb-5bc6-4a61-8b9e-09e0e47e17b6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:02:06.324386 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-afa174fb-5bc6-4a61-8b9e-09e0e47e17b6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:02:06.324820 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-afa174fb-5bc6-4a61-8b9e-09e0e47e17b6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:02:06.325233 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-afa174fb-5bc6-4a61-8b9e-09e0e47e17b6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:02:06.521505 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-018279aa-9278-499b-ba5b-62018a0b0047 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:06.522112 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-018279aa-9278-499b-ba5b-62018a0b0047 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:06.525048 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-afa174fb-5bc6-4a61-8b9e-09e0e47e17b6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "POST /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4/action" status: 202 len: 0 microversion: 2.1 time: 0.255398 Jun 10 18:02:06.525761 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 730/1509] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:02:06 2022] POST /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:02:06.529992 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-018279aa-9278-499b-ba5b-62018a0b0047 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:06.530436 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-018279aa-9278-499b-ba5b-62018a0b0047 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:06.531209 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-018279aa-9278-499b-ba5b-62018a0b0047 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:06.531649 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-018279aa-9278-499b-ba5b-62018a0b0047 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:06.534751 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-dee36df1-f3c1-452a-b043-02e57f469e23 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:06.536899 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-dee36df1-f3c1-452a-b043-02e57f469e23 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:06.543560 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dee36df1-f3c1-452a-b043-02e57f469e23 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:06.543560 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dee36df1-f3c1-452a-b043-02e57f469e23 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:06.544053 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dee36df1-f3c1-452a-b043-02e57f469e23 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:06.544525 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dee36df1-f3c1-452a-b043-02e57f469e23 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:06.674880 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-018279aa-9278-499b-ba5b-62018a0b0047 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:06.682921 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-018279aa-9278-499b-ba5b-62018a0b0047 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1549 microversion: 2.1 time: 0.165249 Jun 10 18:02:06.683510 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 780/1510] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:06 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1549 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:02:06.684091 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-dee36df1-f3c1-452a-b043-02e57f469e23 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:06.688515 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:02:06.692871 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-dee36df1-f3c1-452a-b043-02e57f469e23 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1537 microversion: 2.1 time: 0.162589 Jun 10 18:02:06.693424 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 731/1511] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:06 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1537 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:02:06.722372 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bb38e9fe-214d-4263-9b80-80097cc4da5a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:06.723126 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bb38e9fe-214d-4263-9b80-80097cc4da5a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:06.729274 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb38e9fe-214d-4263-9b80-80097cc4da5a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:06.729996 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb38e9fe-214d-4263-9b80-80097cc4da5a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:06.730788 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb38e9fe-214d-4263-9b80-80097cc4da5a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:06.731246 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb38e9fe-214d-4263-9b80-80097cc4da5a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:06.835103 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ffeea293-5a27-4771-927e-5b7c51a1bbc8 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:06.835972 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ffeea293-5a27-4771-927e-5b7c51a1bbc8 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:06.843353 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ffeea293-5a27-4771-927e-5b7c51a1bbc8 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:06.843801 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ffeea293-5a27-4771-927e-5b7c51a1bbc8 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:06.844614 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ffeea293-5a27-4771-927e-5b7c51a1bbc8 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:06.845240 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ffeea293-5a27-4771-927e-5b7c51a1bbc8 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:06.870835 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bb38e9fe-214d-4263-9b80-80097cc4da5a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:06.879783 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bb38e9fe-214d-4263-9b80-80097cc4da5a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:06.881295 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bb38e9fe-214d-4263-9b80-80097cc4da5a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:06.882450 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bb38e9fe-214d-4263-9b80-80097cc4da5a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.163963 Jun 10 18:02:06.883007 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 781/1512] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:06 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:02:06.912792 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ffeea293-5a27-4771-927e-5b7c51a1bbc8 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:06.920984 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ffeea293-5a27-4771-927e-5b7c51a1bbc8 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:06.922928 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ffeea293-5a27-4771-927e-5b7c51a1bbc8 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:06.927789 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ffeea293-5a27-4771-927e-5b7c51a1bbc8 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1447 microversion: 2.75 time: 0.096714 Jun 10 18:02:06.928471 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 732/1513] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:06 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1447 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:07.107822 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d10f9f8a-b18c-40e8-b0a0-e0f8c96d7521 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:07.108469 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d10f9f8a-b18c-40e8-b0a0-e0f8c96d7521 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:07.115239 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d10f9f8a-b18c-40e8-b0a0-e0f8c96d7521 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:07.120095 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d10f9f8a-b18c-40e8-b0a0-e0f8c96d7521 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:07.120095 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d10f9f8a-b18c-40e8-b0a0-e0f8c96d7521 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:07.120095 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d10f9f8a-b18c-40e8-b0a0-e0f8c96d7521 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:07.212244 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-79c397d7-fe1c-42bc-aab7-4d665367ce49 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:07.212919 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-79c397d7-fe1c-42bc-aab7-4d665367ce49 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: b09b98a7-d89b-42b8-a3c8-809653486d0f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:07.221222 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-79c397d7-fe1c-42bc-aab7-4d665367ce49 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:07.221682 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-79c397d7-fe1c-42bc-aab7-4d665367ce49 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:07.222461 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-79c397d7-fe1c-42bc-aab7-4d665367ce49 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:07.222901 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-79c397d7-fe1c-42bc-aab7-4d665367ce49 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:07.237291 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-79c397d7-fe1c-42bc-aab7-4d665367ce49 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] HTTP exception thrown: Instance b09b98a7-d89b-42b8-a3c8-809653486d0f could not be found. Jun 10 18:02:07.238972 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-79c397d7-fe1c-42bc-aab7-4d665367ce49 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Request method failure captured: Jun 10 18:02:07.238972 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/b09b98a7-d89b-42b8-a3c8-809653486d0f HTTP/1.1 Jun 10 18:02:07.238972 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:02:07.238972 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:02:07.238972 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:02:07.238972 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:02:07.238972 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:02:07.238972 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:02:07.238972 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:02:07.238972 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:02:07.238972 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4aWBamDI7P_G053EWdOp1-fDAE91xuVNeLMkwOScygzZsGEYn-C5CxNxq93Kd1vJ4D3dBObQboVm4uUVfDJa6nAklJ67_G7Dmeo4S1QaLoBOymY2bYLUuvT8MwCz3_BD3O2C8K33Pv1fs3hWi7RCi-RZY0otTZArtFQ5R5eVrzoKs0 Jun 10 18:02:07.238972 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:02:07.238972 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:02:07.238972 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:02:07.238972 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:02:07.238972 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:02:07.238972 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:02:07.238972 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: c36d8cd6f58f415a90f042aff9eddd85 Jun 10 18:02:07.238972 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersAdminTestJSON-427951095 Jun 10 18:02:07.238972 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:02:07.238972 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:02:07.242190 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/c36d8cd6f58f415a90f042aff9eddd85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c36d8cd6f58f415a90f042aff9eddd85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c36d8cd6f58f415a90f042aff9eddd85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_c36d8cd6f58f415a90f042aff9eddd85", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:02:07.242190 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersAdminTestJSON-427951095 Jun 10 18:02:07.242190 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: c36d8cd6f58f415a90f042aff9eddd85 Jun 10 18:02:07.242190 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersAdminTestJSON-427951095 Jun 10 18:02:07.242190 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersAdminTestJSON-427951095-project Jun 10 18:02:07.242190 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:02:07.242190 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:02:07.242190 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 7f050bed1312417f886cdad081809aa1 Jun 10 18:02:07.242190 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersAdminTestJSON-427951095-project Jun 10 18:02:07.242190 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:02:07.242190 chdv-master-2 devstack@n-api.service[126594]: exception: Instance b09b98a7-d89b-42b8-a3c8-809653486d0f could not be found. Jun 10 18:02:07.242190 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'b09b98a7-d89b-42b8-a3c8-809653486d0f'} Jun 10 18:02:07.243104 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:02:07.243104 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:02:07.243104 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:02:07.243104 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:02:07.243104 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:02:07.243104 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:02:07.243104 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:02:07.243104 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:02:07.243104 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:02:07.243104 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:02:07.243104 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b09b98a7-d89b-42b8-a3c8-809653486d0f could not be found. Jun 10 18:02:07.243104 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:02:07.243104 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:02:07.243104 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:02:07.243104 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:02:07.243104 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:02:07.243104 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:02:07.243104 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:02:07.243104 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:02:07.243104 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:02:07.244936 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:02:07.244936 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:02:07.244936 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:02:07.244936 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:02:07.244936 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:02:07.244936 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:02:07.244936 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:02:07.244936 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b09b98a7-d89b-42b8-a3c8-809653486d0f could not be found. Jun 10 18:02:07.244936 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:02:07.244936 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:02:07.244936 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:02:07.244936 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:02:07.244936 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:02:07.244936 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:02:07.244936 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:02:07.244936 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:02:07.244936 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b09b98a7-d89b-42b8-a3c8-809653486d0f could not be found. Jun 10 18:02:07.244936 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:02:07.246386 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-79c397d7-fe1c-42bc-aab7-4d665367ce49 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Returning 404 to user: Instance b09b98a7-d89b-42b8-a3c8-809653486d0f could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:02:07.246386 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-79c397d7-fe1c-42bc-aab7-4d665367ce49 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/b09b98a7-d89b-42b8-a3c8-809653486d0f" status: 404 len: 111 microversion: 2.1 time: 0.032164 Jun 10 18:02:07.246386 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 733/1514] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:07 2022] GET /compute/v2.1/servers/b09b98a7-d89b-42b8-a3c8-809653486d0f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:02:07.248121 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d10f9f8a-b18c-40e8-b0a0-e0f8c96d7521 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:07.253155 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-34b76858-80cd-4847-a253-dc5fefeb1351 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:07.253648 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-34b76858-80cd-4847-a253-dc5fefeb1351 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: 96576f7e-6227-41c7-92fd-30b88f961560] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:07.255716 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d10f9f8a-b18c-40e8-b0a0-e0f8c96d7521 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1517 microversion: 2.1 time: 0.152273 Jun 10 18:02:07.256609 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 782/1515] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:07 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:07.259913 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-34b76858-80cd-4847-a253-dc5fefeb1351 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:07.260418 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-34b76858-80cd-4847-a253-dc5fefeb1351 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:07.261155 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-34b76858-80cd-4847-a253-dc5fefeb1351 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:07.261587 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-34b76858-80cd-4847-a253-dc5fefeb1351 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:07.288426 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-34b76858-80cd-4847-a253-dc5fefeb1351 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: 96576f7e-6227-41c7-92fd-30b88f961560] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:02:07.579763 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-34b76858-80cd-4847-a253-dc5fefeb1351 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "DELETE /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560" status: 204 len: 0 microversion: 2.1 time: 0.330051 Jun 10 18:02:07.580445 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 734/1516] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:02:07 2022] DELETE /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:02:07.588655 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-45d1a18e-e4fa-4e79-a20b-340120ff8525 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:07.594535 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-45d1a18e-e4fa-4e79-a20b-340120ff8525 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: 96576f7e-6227-41c7-92fd-30b88f961560] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:07.596460 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45d1a18e-e4fa-4e79-a20b-340120ff8525 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:07.596926 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45d1a18e-e4fa-4e79-a20b-340120ff8525 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:07.597700 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45d1a18e-e4fa-4e79-a20b-340120ff8525 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:07.598223 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45d1a18e-e4fa-4e79-a20b-340120ff8525 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:07.700015 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3f64cbed-6397-4179-b94f-b89b79895a29 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:07.703320 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3f64cbed-6397-4179-b94f-b89b79895a29 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:07.706943 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f64cbed-6397-4179-b94f-b89b79895a29 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:07.707402 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f64cbed-6397-4179-b94f-b89b79895a29 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:07.708279 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f64cbed-6397-4179-b94f-b89b79895a29 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:07.708760 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f64cbed-6397-4179-b94f-b89b79895a29 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:07.741879 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-45d1a18e-e4fa-4e79-a20b-340120ff8525 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:07.750191 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-45d1a18e-e4fa-4e79-a20b-340120ff8525 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560" status: 200 len: 1467 microversion: 2.1 time: 0.165533 Jun 10 18:02:07.750753 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 783/1517] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:07 2022] GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560 => generated 1467 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:07.755516 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cc9d73f3-0a7d-42df-93a5-d6b0c1c67e90 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:07.756111 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cc9d73f3-0a7d-42df-93a5-d6b0c1c67e90 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:07.762344 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc9d73f3-0a7d-42df-93a5-d6b0c1c67e90 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:07.762786 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc9d73f3-0a7d-42df-93a5-d6b0c1c67e90 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:07.763763 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc9d73f3-0a7d-42df-93a5-d6b0c1c67e90 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:07.764198 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc9d73f3-0a7d-42df-93a5-d6b0c1c67e90 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:07.857074 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3f64cbed-6397-4179-b94f-b89b79895a29 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:07.866397 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3f64cbed-6397-4179-b94f-b89b79895a29 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1549 microversion: 2.1 time: 0.170566 Jun 10 18:02:07.866954 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 735/1518] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:07 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1549 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:02:07.901135 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-653ea44d-0e81-4b62-a198-011e73d1325f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:07.901755 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-653ea44d-0e81-4b62-a198-011e73d1325f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:07.908450 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-653ea44d-0e81-4b62-a198-011e73d1325f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:07.908911 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-653ea44d-0e81-4b62-a198-011e73d1325f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:07.909687 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-653ea44d-0e81-4b62-a198-011e73d1325f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:07.910128 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-653ea44d-0e81-4b62-a198-011e73d1325f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:07.921673 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cc9d73f3-0a7d-42df-93a5-d6b0c1c67e90 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:07.929319 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cc9d73f3-0a7d-42df-93a5-d6b0c1c67e90 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1537 microversion: 2.1 time: 0.177392 Jun 10 18:02:07.929927 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 784/1519] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:07 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1537 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:07.946764 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d737eefd-cd7e-48e0-9118-a8cb0393448f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:07.947373 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d737eefd-cd7e-48e0-9118-a8cb0393448f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:07.954081 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d737eefd-cd7e-48e0-9118-a8cb0393448f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:07.954534 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d737eefd-cd7e-48e0-9118-a8cb0393448f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:07.958352 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d737eefd-cd7e-48e0-9118-a8cb0393448f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:07.958352 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d737eefd-cd7e-48e0-9118-a8cb0393448f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:08.025803 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d737eefd-cd7e-48e0-9118-a8cb0393448f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:08.037645 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d737eefd-cd7e-48e0-9118-a8cb0393448f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:08.039266 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d737eefd-cd7e-48e0-9118-a8cb0393448f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:08.047149 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d737eefd-cd7e-48e0-9118-a8cb0393448f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1447 microversion: 2.75 time: 0.103999 Jun 10 18:02:08.047673 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 785/1520] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:07 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1447 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:08.056027 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-653ea44d-0e81-4b62-a198-011e73d1325f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:08.065701 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-653ea44d-0e81-4b62-a198-011e73d1325f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:08.067312 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-653ea44d-0e81-4b62-a198-011e73d1325f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:08.068536 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-653ea44d-0e81-4b62-a198-011e73d1325f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.171427 Jun 10 18:02:08.069091 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 736/1521] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:07 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:02:08.272942 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-da444501-ef48-43a7-8db5-c5dab98082f5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:08.273548 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-da444501-ef48-43a7-8db5-c5dab98082f5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:08.280272 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-da444501-ef48-43a7-8db5-c5dab98082f5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:08.280755 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-da444501-ef48-43a7-8db5-c5dab98082f5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:08.281512 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-da444501-ef48-43a7-8db5-c5dab98082f5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:08.281945 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-da444501-ef48-43a7-8db5-c5dab98082f5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:08.427475 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-4a45fec9-39dd-4834-ae2f-7129b344233c req-52462b44-cade-41e2-833c-86b9d15c6132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "186b67b3-3538-4bc2-8528-53b43d701bf1", "name": "network-vif-unplugged", "status": "completed", "tag": "128ee4eb-e784-41c8-acaa-39291810b2a4"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:02:08.438502 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-da444501-ef48-43a7-8db5-c5dab98082f5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:08.441970 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-4a45fec9-39dd-4834-ae2f-7129b344233c req-52462b44-cade-41e2-833c-86b9d15c6132 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:08.442727 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-4a45fec9-39dd-4834-ae2f-7129b344233c req-52462b44-cade-41e2-833c-86b9d15c6132 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:08.446171 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-da444501-ef48-43a7-8db5-c5dab98082f5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1517 microversion: 2.1 time: 0.177212 Jun 10 18:02:08.456462 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 786/1522] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:08 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1517 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:08.457382 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-4a45fec9-39dd-4834-ae2f-7129b344233c req-52462b44-cade-41e2-833c-86b9d15c6132 service nova] Creating event network-vif-unplugged:128ee4eb-e784-41c8-acaa-39291810b2a4 for instance 186b67b3-3538-4bc2-8528-53b43d701bf1 on chh1-master-2 Jun 10 18:02:08.462141 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-4a45fec9-39dd-4834-ae2f-7129b344233c req-52462b44-cade-41e2-833c-86b9d15c6132 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038628 Jun 10 18:02:08.462729 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 737/1523] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:02:08.767011 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ba090a44-b189-4af7-80b5-9f3318329371 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:08.767667 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ba090a44-b189-4af7-80b5-9f3318329371 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: 96576f7e-6227-41c7-92fd-30b88f961560] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:08.774480 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ba090a44-b189-4af7-80b5-9f3318329371 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:08.774938 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ba090a44-b189-4af7-80b5-9f3318329371 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:08.775714 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ba090a44-b189-4af7-80b5-9f3318329371 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:08.776155 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ba090a44-b189-4af7-80b5-9f3318329371 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:08.883826 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-be9db8fc-ba87-4a2f-8f88-b22b95855ceb tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:08.885195 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-be9db8fc-ba87-4a2f-8f88-b22b95855ceb tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:08.890817 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be9db8fc-ba87-4a2f-8f88-b22b95855ceb tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:08.891288 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be9db8fc-ba87-4a2f-8f88-b22b95855ceb tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:08.892369 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be9db8fc-ba87-4a2f-8f88-b22b95855ceb tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:08.892820 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be9db8fc-ba87-4a2f-8f88-b22b95855ceb tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:08.916922 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ba090a44-b189-4af7-80b5-9f3318329371 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:08.925158 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ba090a44-b189-4af7-80b5-9f3318329371 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560" status: 200 len: 1467 microversion: 2.1 time: 0.162097 Jun 10 18:02:08.925732 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 787/1524] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:08 2022] GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560 => generated 1467 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:08.945825 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bbc1eb59-aa8d-4c54-87b8-5521d4eea996 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:08.946444 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bbc1eb59-aa8d-4c54-87b8-5521d4eea996 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:08.952631 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bbc1eb59-aa8d-4c54-87b8-5521d4eea996 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:08.953094 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bbc1eb59-aa8d-4c54-87b8-5521d4eea996 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:08.956825 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bbc1eb59-aa8d-4c54-87b8-5521d4eea996 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:08.956825 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bbc1eb59-aa8d-4c54-87b8-5521d4eea996 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:09.033455 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-be9db8fc-ba87-4a2f-8f88-b22b95855ceb tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:09.042007 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-be9db8fc-ba87-4a2f-8f88-b22b95855ceb tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1549 microversion: 2.1 time: 0.162692 Jun 10 18:02:09.042583 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 738/1525] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:08 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1549 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:02:09.067899 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-24c57c22-c4b6-4b28-8666-67e05c5058de tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:09.068708 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-24c57c22-c4b6-4b28-8666-67e05c5058de tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:09.074834 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-24c57c22-c4b6-4b28-8666-67e05c5058de tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:09.075374 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-24c57c22-c4b6-4b28-8666-67e05c5058de tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:09.076232 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-24c57c22-c4b6-4b28-8666-67e05c5058de tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:09.076692 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-24c57c22-c4b6-4b28-8666-67e05c5058de tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:09.089729 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bbc1eb59-aa8d-4c54-87b8-5521d4eea996 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:09.099528 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bbc1eb59-aa8d-4c54-87b8-5521d4eea996 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1537 microversion: 2.1 time: 0.157124 Jun 10 18:02:09.100639 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 788/1526] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:08 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1537 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:02:09.105981 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-411ab7d4-b789-4ba4-ab49-3a249811907c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:09.106583 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-411ab7d4-b789-4ba4-ab49-3a249811907c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:09.110134 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:02:09.113599 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-411ab7d4-b789-4ba4-ab49-3a249811907c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:09.114053 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-411ab7d4-b789-4ba4-ab49-3a249811907c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:09.118355 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-411ab7d4-b789-4ba4-ab49-3a249811907c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:09.118355 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-411ab7d4-b789-4ba4-ab49-3a249811907c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:09.144048 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-24c57c22-c4b6-4b28-8666-67e05c5058de tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:09.152338 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-24c57c22-c4b6-4b28-8666-67e05c5058de tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:09.154669 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-24c57c22-c4b6-4b28-8666-67e05c5058de tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:09.159575 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-24c57c22-c4b6-4b28-8666-67e05c5058de tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1447 microversion: 2.75 time: 0.095488 Jun 10 18:02:09.160503 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 739/1527] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:09 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1447 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:09.250419 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-411ab7d4-b789-4ba4-ab49-3a249811907c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:09.258912 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-411ab7d4-b789-4ba4-ab49-3a249811907c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:09.260526 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-411ab7d4-b789-4ba4-ab49-3a249811907c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:09.261692 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-411ab7d4-b789-4ba4-ab49-3a249811907c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.159699 Jun 10 18:02:09.262252 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 789/1528] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:09 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:09.463965 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-838c6596-d4f9-4197-9573-db95f67709c2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:09.464619 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-838c6596-d4f9-4197-9573-db95f67709c2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:09.472294 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-838c6596-d4f9-4197-9573-db95f67709c2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:09.472780 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-838c6596-d4f9-4197-9573-db95f67709c2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:09.473556 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-838c6596-d4f9-4197-9573-db95f67709c2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:09.474000 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-838c6596-d4f9-4197-9573-db95f67709c2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:09.598729 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-838c6596-d4f9-4197-9573-db95f67709c2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:09.606212 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-838c6596-d4f9-4197-9573-db95f67709c2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1517 microversion: 2.1 time: 0.146147 Jun 10 18:02:09.606796 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 740/1529] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:09 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1517 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:02:09.942775 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1c5ef15e-3521-4cb2-803a-af31e628f3ff tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:09.943396 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1c5ef15e-3521-4cb2-803a-af31e628f3ff tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: 96576f7e-6227-41c7-92fd-30b88f961560] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:09.951273 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1c5ef15e-3521-4cb2-803a-af31e628f3ff tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:09.951726 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1c5ef15e-3521-4cb2-803a-af31e628f3ff tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:09.952524 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1c5ef15e-3521-4cb2-803a-af31e628f3ff tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:09.952961 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1c5ef15e-3521-4cb2-803a-af31e628f3ff tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:10.058850 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-27a365e1-75d5-4879-aa0e-6de26209188f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:10.059467 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-27a365e1-75d5-4879-aa0e-6de26209188f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:10.066186 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27a365e1-75d5-4879-aa0e-6de26209188f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:10.066638 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27a365e1-75d5-4879-aa0e-6de26209188f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:10.067409 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27a365e1-75d5-4879-aa0e-6de26209188f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:10.067854 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27a365e1-75d5-4879-aa0e-6de26209188f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:10.081630 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1c5ef15e-3521-4cb2-803a-af31e628f3ff tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:10.089333 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1c5ef15e-3521-4cb2-803a-af31e628f3ff tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560" status: 200 len: 1467 microversion: 2.1 time: 0.150432 Jun 10 18:02:10.089963 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 790/1530] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:09 2022] GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560 => generated 1467 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:10.118350 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cb52af1c-a516-4160-857a-3b356a0da6ab tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:10.120487 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cb52af1c-a516-4160-857a-3b356a0da6ab tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:10.126898 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cb52af1c-a516-4160-857a-3b356a0da6ab tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:10.127463 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cb52af1c-a516-4160-857a-3b356a0da6ab tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:10.128356 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cb52af1c-a516-4160-857a-3b356a0da6ab tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:10.128889 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cb52af1c-a516-4160-857a-3b356a0da6ab tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:10.201949 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-27a365e1-75d5-4879-aa0e-6de26209188f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:10.210204 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-27a365e1-75d5-4879-aa0e-6de26209188f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1549 microversion: 2.1 time: 0.155182 Jun 10 18:02:10.216577 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 741/1531] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:10 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:02:10.216577 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-834ea5bb-01be-48ba-9fe8-203e0d3476aa tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:10.216577 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-834ea5bb-01be-48ba-9fe8-203e0d3476aa tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:10.223428 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-834ea5bb-01be-48ba-9fe8-203e0d3476aa tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:10.223880 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-834ea5bb-01be-48ba-9fe8-203e0d3476aa tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:10.224688 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-834ea5bb-01be-48ba-9fe8-203e0d3476aa tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:10.225129 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-834ea5bb-01be-48ba-9fe8-203e0d3476aa tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:10.262788 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cb52af1c-a516-4160-857a-3b356a0da6ab tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:10.270344 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cb52af1c-a516-4160-857a-3b356a0da6ab tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1537 microversion: 2.1 time: 0.155776 Jun 10 18:02:10.270922 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 791/1532] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:10 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1537 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:02:10.279128 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b085d1d4-bcac-4663-88ef-0b7564960ba6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:10.279754 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b085d1d4-bcac-4663-88ef-0b7564960ba6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:10.285691 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b085d1d4-bcac-4663-88ef-0b7564960ba6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:10.286134 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b085d1d4-bcac-4663-88ef-0b7564960ba6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:10.286889 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b085d1d4-bcac-4663-88ef-0b7564960ba6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:10.287322 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b085d1d4-bcac-4663-88ef-0b7564960ba6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:10.300270 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-834ea5bb-01be-48ba-9fe8-203e0d3476aa tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:10.308602 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-834ea5bb-01be-48ba-9fe8-203e0d3476aa tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:10.310901 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-834ea5bb-01be-48ba-9fe8-203e0d3476aa tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:10.315873 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-834ea5bb-01be-48ba-9fe8-203e0d3476aa tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1447 microversion: 2.75 time: 0.103951 Jun 10 18:02:10.316575 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 742/1533] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:10 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1447 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:10.422902 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b085d1d4-bcac-4663-88ef-0b7564960ba6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:10.428131 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b085d1d4-bcac-4663-88ef-0b7564960ba6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:10.429366 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b085d1d4-bcac-4663-88ef-0b7564960ba6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:10.430714 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b085d1d4-bcac-4663-88ef-0b7564960ba6 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.155368 Jun 10 18:02:10.431474 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 792/1534] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:10 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:02:10.623458 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-09fae703-20a7-4dd4-b545-eee0bc8edad9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:10.624196 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-09fae703-20a7-4dd4-b545-eee0bc8edad9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:10.631061 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-09fae703-20a7-4dd4-b545-eee0bc8edad9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:10.631499 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-09fae703-20a7-4dd4-b545-eee0bc8edad9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:10.632556 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-09fae703-20a7-4dd4-b545-eee0bc8edad9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:10.632995 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-09fae703-20a7-4dd4-b545-eee0bc8edad9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:10.766734 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-09fae703-20a7-4dd4-b545-eee0bc8edad9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:10.774461 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-09fae703-20a7-4dd4-b545-eee0bc8edad9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1517 microversion: 2.1 time: 0.155266 Jun 10 18:02:10.775035 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 743/1535] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:10 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:11.106468 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b1fc89f1-528b-45ec-bad6-cebc5c763dbf tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:11.107521 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b1fc89f1-528b-45ec-bad6-cebc5c763dbf tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: 96576f7e-6227-41c7-92fd-30b88f961560] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:11.115030 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b1fc89f1-528b-45ec-bad6-cebc5c763dbf tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:11.115504 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b1fc89f1-528b-45ec-bad6-cebc5c763dbf tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:11.116263 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b1fc89f1-528b-45ec-bad6-cebc5c763dbf tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:11.116721 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b1fc89f1-528b-45ec-bad6-cebc5c763dbf tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:11.227451 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-77bfb6bc-10e1-4f81-9bf1-c25549216bde tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:11.228078 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-77bfb6bc-10e1-4f81-9bf1-c25549216bde tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:11.235106 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-77bfb6bc-10e1-4f81-9bf1-c25549216bde tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:11.235557 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-77bfb6bc-10e1-4f81-9bf1-c25549216bde tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:11.236351 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-77bfb6bc-10e1-4f81-9bf1-c25549216bde tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:11.236788 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-77bfb6bc-10e1-4f81-9bf1-c25549216bde tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:11.253716 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b1fc89f1-528b-45ec-bad6-cebc5c763dbf tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:11.261415 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b1fc89f1-528b-45ec-bad6-cebc5c763dbf tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560" status: 200 len: 1467 microversion: 2.1 time: 0.158913 Jun 10 18:02:11.262037 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 793/1536] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:11 2022] GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560 => generated 1467 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:11.287324 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-87d8dad3-74bf-4878-94de-003528381582 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:11.287939 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-87d8dad3-74bf-4878-94de-003528381582 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:11.298251 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-87d8dad3-74bf-4878-94de-003528381582 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:11.298915 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-87d8dad3-74bf-4878-94de-003528381582 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:11.299707 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-87d8dad3-74bf-4878-94de-003528381582 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:11.300156 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-87d8dad3-74bf-4878-94de-003528381582 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:11.315537 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:02:11.376012 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-77bfb6bc-10e1-4f81-9bf1-c25549216bde tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:11.384430 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-77bfb6bc-10e1-4f81-9bf1-c25549216bde tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1549 microversion: 2.1 time: 0.160942 Jun 10 18:02:11.384991 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 744/1537] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:11 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1549 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:11.389530 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-499ac967-5a5c-4fe7-ac4c-f9ddd755a79f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:11.390311 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-499ac967-5a5c-4fe7-ac4c-f9ddd755a79f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:11.396366 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-499ac967-5a5c-4fe7-ac4c-f9ddd755a79f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:11.396824 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-499ac967-5a5c-4fe7-ac4c-f9ddd755a79f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:11.397592 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-499ac967-5a5c-4fe7-ac4c-f9ddd755a79f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:11.398030 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-499ac967-5a5c-4fe7-ac4c-f9ddd755a79f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:11.442825 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-87d8dad3-74bf-4878-94de-003528381582 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:11.453893 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-87d8dad3-74bf-4878-94de-003528381582 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1537 microversion: 2.1 time: 0.170572 Jun 10 18:02:11.454627 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 794/1538] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:11 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1537 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:02:11.459798 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b225c1f6-281a-4885-a71e-df859558d7aa tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:11.460617 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b225c1f6-281a-4885-a71e-df859558d7aa tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:11.467491 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-499ac967-5a5c-4fe7-ac4c-f9ddd755a79f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:11.467668 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b225c1f6-281a-4885-a71e-df859558d7aa tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:11.468081 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b225c1f6-281a-4885-a71e-df859558d7aa tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:11.468888 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b225c1f6-281a-4885-a71e-df859558d7aa tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:11.469334 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b225c1f6-281a-4885-a71e-df859558d7aa tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:11.475576 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-499ac967-5a5c-4fe7-ac4c-f9ddd755a79f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:11.477099 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-499ac967-5a5c-4fe7-ac4c-f9ddd755a79f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:11.482464 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-499ac967-5a5c-4fe7-ac4c-f9ddd755a79f tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1447 microversion: 2.75 time: 0.095829 Jun 10 18:02:11.483030 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 745/1539] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:11 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1447 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:11.605164 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b225c1f6-281a-4885-a71e-df859558d7aa tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:11.613747 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b225c1f6-281a-4885-a71e-df859558d7aa tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:11.615238 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b225c1f6-281a-4885-a71e-df859558d7aa tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:11.616438 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b225c1f6-281a-4885-a71e-df859558d7aa tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.160563 Jun 10 18:02:11.618127 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 795/1540] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:11 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:11.790715 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-42874cba-160e-457e-8cb3-9701a720d278 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:11.791320 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-42874cba-160e-457e-8cb3-9701a720d278 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:11.797960 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-42874cba-160e-457e-8cb3-9701a720d278 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:11.798437 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-42874cba-160e-457e-8cb3-9701a720d278 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:11.799200 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-42874cba-160e-457e-8cb3-9701a720d278 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:11.799633 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-42874cba-160e-457e-8cb3-9701a720d278 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:11.941827 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-42874cba-160e-457e-8cb3-9701a720d278 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:11.953204 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-42874cba-160e-457e-8cb3-9701a720d278 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1517 microversion: 2.1 time: 0.166224 Jun 10 18:02:11.961854 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 746/1541] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:11 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1517 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:12.281191 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-57ffd4a9-3e86-49b3-abe3-6324b0f240b7 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:12.281851 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-57ffd4a9-3e86-49b3-abe3-6324b0f240b7 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: 96576f7e-6227-41c7-92fd-30b88f961560] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:12.292229 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-57ffd4a9-3e86-49b3-abe3-6324b0f240b7 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:12.296630 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-57ffd4a9-3e86-49b3-abe3-6324b0f240b7 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:12.297558 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-57ffd4a9-3e86-49b3-abe3-6324b0f240b7 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:12.298024 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-57ffd4a9-3e86-49b3-abe3-6324b0f240b7 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:12.402342 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f50d9a05-9fb3-4fc6-bb6f-9dc5c2972ba9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:12.403600 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f50d9a05-9fb3-4fc6-bb6f-9dc5c2972ba9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:12.414381 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f50d9a05-9fb3-4fc6-bb6f-9dc5c2972ba9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:12.416557 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f50d9a05-9fb3-4fc6-bb6f-9dc5c2972ba9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:12.420743 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f50d9a05-9fb3-4fc6-bb6f-9dc5c2972ba9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:12.421396 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f50d9a05-9fb3-4fc6-bb6f-9dc5c2972ba9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:12.643533 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f50d9a05-9fb3-4fc6-bb6f-9dc5c2972ba9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:12.654494 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f50d9a05-9fb3-4fc6-bb6f-9dc5c2972ba9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1549 microversion: 2.1 time: 0.256439 Jun 10 18:02:12.665324 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 747/1542] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:12 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1549 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:12.675229 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f3f170a5-61ad-43b8-aafb-af485b8bde4f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:12.676561 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f3f170a5-61ad-43b8-aafb-af485b8bde4f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:12.694557 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f3f170a5-61ad-43b8-aafb-af485b8bde4f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:12.695023 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f3f170a5-61ad-43b8-aafb-af485b8bde4f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:12.695814 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f3f170a5-61ad-43b8-aafb-af485b8bde4f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:12.696258 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f3f170a5-61ad-43b8-aafb-af485b8bde4f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:12.702120 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:02:12.847984 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-57ffd4a9-3e86-49b3-abe3-6324b0f240b7 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:12.862295 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-57ffd4a9-3e86-49b3-abe3-6324b0f240b7 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560" status: 200 len: 1467 microversion: 2.1 time: 0.587269 Jun 10 18:02:12.863201 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 796/1543] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:12 2022] GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560 => generated 1467 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:12.867781 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f120056b-9dc4-4137-8b92-a96e500a7160 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:12.868458 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f120056b-9dc4-4137-8b92-a96e500a7160 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:12.885453 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f120056b-9dc4-4137-8b92-a96e500a7160 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:12.886182 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f120056b-9dc4-4137-8b92-a96e500a7160 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:12.887125 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f120056b-9dc4-4137-8b92-a96e500a7160 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:12.887827 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f120056b-9dc4-4137-8b92-a96e500a7160 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:12.966582 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f3f170a5-61ad-43b8-aafb-af485b8bde4f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:12.975484 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f3f170a5-61ad-43b8-aafb-af485b8bde4f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1537 microversion: 2.1 time: 0.308945 Jun 10 18:02:12.980026 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 748/1544] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:12 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1537 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:13.005513 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b5384e74-5844-44ce-9c69-4357491f480f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:13.006412 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b5384e74-5844-44ce-9c69-4357491f480f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:13.015081 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5384e74-5844-44ce-9c69-4357491f480f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:13.015922 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5384e74-5844-44ce-9c69-4357491f480f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:13.017435 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5384e74-5844-44ce-9c69-4357491f480f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:13.018222 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5384e74-5844-44ce-9c69-4357491f480f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:13.069562 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f120056b-9dc4-4137-8b92-a96e500a7160 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:13.088453 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f120056b-9dc4-4137-8b92-a96e500a7160 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:13.091642 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f120056b-9dc4-4137-8b92-a96e500a7160 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:13.104732 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f120056b-9dc4-4137-8b92-a96e500a7160 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1447 microversion: 2.75 time: 0.233283 Jun 10 18:02:13.104732 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 797/1545] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:12 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1447 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:13.104732 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-b2fc2e88-c3ca-4ad4-bc87-68efb2455557 req-767e5946-1a22-4c58-b095-24660cdc7e8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "186b67b3-3538-4bc2-8528-53b43d701bf1", "name": "network-vif-plugged", "status": "completed", "tag": "128ee4eb-e784-41c8-acaa-39291810b2a4"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:02:13.127145 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-b2fc2e88-c3ca-4ad4-bc87-68efb2455557 req-767e5946-1a22-4c58-b095-24660cdc7e8b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:13.127595 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-b2fc2e88-c3ca-4ad4-bc87-68efb2455557 req-767e5946-1a22-4c58-b095-24660cdc7e8b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:13.145839 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-b2fc2e88-c3ca-4ad4-bc87-68efb2455557 req-767e5946-1a22-4c58-b095-24660cdc7e8b service nova] Creating event network-vif-plugged:128ee4eb-e784-41c8-acaa-39291810b2a4 for instance 186b67b3-3538-4bc2-8528-53b43d701bf1 on chh1-master-2 Jun 10 18:02:13.152522 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-b2fc2e88-c3ca-4ad4-bc87-68efb2455557 req-767e5946-1a22-4c58-b095-24660cdc7e8b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053275 Jun 10 18:02:13.153333 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 798/1546] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:02:13.164208 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-df5848c6-7bae-4bdb-a71d-52bae2973ee2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:13.165283 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-df5848c6-7bae-4bdb-a71d-52bae2973ee2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:13.174876 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df5848c6-7bae-4bdb-a71d-52bae2973ee2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:13.175622 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df5848c6-7bae-4bdb-a71d-52bae2973ee2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:13.176643 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df5848c6-7bae-4bdb-a71d-52bae2973ee2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:13.177620 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df5848c6-7bae-4bdb-a71d-52bae2973ee2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:13.255062 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b5384e74-5844-44ce-9c69-4357491f480f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:13.270251 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b5384e74-5844-44ce-9c69-4357491f480f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:13.272510 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b5384e74-5844-44ce-9c69-4357491f480f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:13.273908 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b5384e74-5844-44ce-9c69-4357491f480f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.290657 Jun 10 18:02:13.274653 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 749/1547] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:12 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:13.470989 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c5624ebc-9ae4-44be-8b5e-25ade635daf5 tempest-VolumesAdminNegativeTest-334649676 tempest-VolumesAdminNegativeTest-334649676-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "90d39e37-1ad1-4306-9c1e-a5ff35f262ad"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:02:13.472107 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c5624ebc-9ae4-44be-8b5e-25ade635daf5 tempest-VolumesAdminNegativeTest-334649676 tempest-VolumesAdminNegativeTest-334649676-project-admin] [instance: ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:13.487986 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5624ebc-9ae4-44be-8b5e-25ade635daf5 tempest-VolumesAdminNegativeTest-334649676 tempest-VolumesAdminNegativeTest-334649676-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:13.493481 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5624ebc-9ae4-44be-8b5e-25ade635daf5 tempest-VolumesAdminNegativeTest-334649676 tempest-VolumesAdminNegativeTest-334649676-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:13.493481 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5624ebc-9ae4-44be-8b5e-25ade635daf5 tempest-VolumesAdminNegativeTest-334649676 tempest-VolumesAdminNegativeTest-334649676-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:13.493481 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5624ebc-9ae4-44be-8b5e-25ade635daf5 tempest-VolumesAdminNegativeTest-334649676 tempest-VolumesAdminNegativeTest-334649676-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:13.608073 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-df5848c6-7bae-4bdb-a71d-52bae2973ee2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:13.619399 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-df5848c6-7bae-4bdb-a71d-52bae2973ee2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1517 microversion: 2.1 time: 0.461483 Jun 10 18:02:13.624218 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 799/1548] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:13 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1517 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:13.634221 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-69d6b7f6-9769-4168-9286-52008f88c766 req-8616140c-bb5b-47c8-8174-79ab0e79278a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d", "name": "network-vif-unplugged", "status": "completed", "tag": "f0ba52c3-5bcd-42ef-b82a-a280afc864bc"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:02:13.659842 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-69d6b7f6-9769-4168-9286-52008f88c766 req-8616140c-bb5b-47c8-8174-79ab0e79278a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:13.661510 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-69d6b7f6-9769-4168-9286-52008f88c766 req-8616140c-bb5b-47c8-8174-79ab0e79278a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:13.683031 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-69d6b7f6-9769-4168-9286-52008f88c766 req-8616140c-bb5b-47c8-8174-79ab0e79278a service nova] Creating event network-vif-unplugged:f0ba52c3-5bcd-42ef-b82a-a280afc864bc for instance a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d on chh1-master-2 Jun 10 18:02:13.690064 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-69d6b7f6-9769-4168-9286-52008f88c766 req-8616140c-bb5b-47c8-8174-79ab0e79278a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061885 Jun 10 18:02:13.691399 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 800/1549] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:02:13.698005 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-c5624ebc-9ae4-44be-8b5e-25ade635daf5 tempest-VolumesAdminNegativeTest-334649676 tempest-VolumesAdminNegativeTest-334649676-project-admin] HTTP exception thrown: Volume 90d39e37-1ad1-4306-9c1e-a5ff35f262ad could not be found. Jun 10 18:02:13.698879 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-957cf7d1-f37b-485f-8941-c7e3500d3a99 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:13.700013 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-957cf7d1-f37b-485f-8941-c7e3500d3a99 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:13.701732 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c5624ebc-9ae4-44be-8b5e-25ade635daf5 tempest-VolumesAdminNegativeTest-334649676 tempest-VolumesAdminNegativeTest-334649676-project-admin] Request method failure captured: Jun 10 18:02:13.701732 chdv-master-2 devstack@n-api.service[126594]: request: PUT /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63/os-volume_attachments/0445fae8-e2f4-40f7-bcaa-fba5beb9d7b9 HTTP/1.1 Jun 10 18:02:13.701732 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:02:13.701732 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:02:13.701732 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:02:13.701732 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 74 Jun 10 18:02:13.701732 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:02:13.701732 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:02:13.701732 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:02:13.701732 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:02:13.701732 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4aLsIh4DMVEzajy3FMaGiPdUFmn1i-fxTz05oBZxWAJEJ72Phy4_Erp8W1-pq0sdk7qr8mjmeBH5UVclEoeDxsHBbg_Z1HcfSKsjz0K7VRC29Zee633Xq6nxbUihmLXtf-Nkda0t3pXofJdJq_vwkSaBogYXAy7vT-VEKjMgRBFW6s Jun 10 18:02:13.701732 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:02:13.701732 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:02:13.701732 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:02:13.701732 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:02:13.701732 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:02:13.701732 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:02:13.701732 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 386a578f93a544fa879c76a45d51f95e Jun 10 18:02:13.701732 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-VolumesAdminNegativeTest-334649676 Jun 10 18:02:13.701732 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member,admin Jun 10 18:02:13.701732 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member,admin Jun 10 18:02:13.703015 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/386a578f93a544fa879c76a45d51f95e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/386a578f93a544fa879c76a45d51f95e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/386a578f93a544fa879c76a45d51f95e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_386a578f93a544fa879c76a45d51f95e", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:02:13.703015 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-VolumesAdminNegativeTest-334649676 Jun 10 18:02:13.703015 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 386a578f93a544fa879c76a45d51f95e Jun 10 18:02:13.703015 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-334649676 Jun 10 18:02:13.703015 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-VolumesAdminNegativeTest-334649676-project-admin Jun 10 18:02:13.703015 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:02:13.703015 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:02:13.703015 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: b48ceea384d34634b500496a4ab9cf6c Jun 10 18:02:13.703015 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-VolumesAdminNegativeTest-334649676-project-admin Jun 10 18:02:13.703015 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:02:13.703015 chdv-master-2 devstack@n-api.service[126594]: {"volumeAttachment": {"volumeId": "90d39e37-1ad1-4306-9c1e-a5ff35f262ad"}} Jun 10 18:02:13.703015 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:02:13.703015 chdv-master-2 devstack@n-api.service[126594]: exception: Volume 90d39e37-1ad1-4306-9c1e-a5ff35f262ad could not be found. Jun 10 18:02:13.703904 chdv-master-2 devstack@n-api.service[126594]: action_args: {'server_id': 'ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63', 'id': '0445fae8-e2f4-40f7-bcaa-fba5beb9d7b9', 'body': {'volumeAttachment': {'volumeId': '90d39e37-1ad1-4306-9c1e-a5ff35f262ad'}}} Jun 10 18:02:13.703904 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:02:13.703904 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:02:13.703904 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 10 18:02:13.703904 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 10 18:02:13.703904 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 10 18:02:13.703904 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 10 18:02:13.703904 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 10 18:02:13.703904 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 10 18:02:13.703904 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 10 18:02:13.703904 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 10 18:02:13.703904 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 10 18:02:13.703904 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 10 18:02:13.703904 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 10 18:02:13.703904 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 10 18:02:13.703904 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 10 18:02:13.703904 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 10 18:02:13.705037 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 90d39e37-1ad1-4306-9c1e-a5ff35f262ad could not be found. (HTTP 404) (Request-ID: req-f944eda4-6c8c-420c-9751-d1bec72ebf80) Jun 10 18:02:13.705037 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:02:13.705037 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:02:13.705037 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:02:13.705037 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:02:13.705037 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Jun 10 18:02:13.705037 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Jun 10 18:02:13.705037 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 10 18:02:13.705037 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 10 18:02:13.705037 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 10 18:02:13.705037 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 10 18:02:13.705037 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 10 18:02:13.705037 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 10 18:02:13.705037 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 10 18:02:13.705037 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 10 18:02:13.705037 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 10 18:02:13.705037 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 10 18:02:13.705037 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 10 18:02:13.705037 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 10 18:02:13.711283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 10 18:02:13.711283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 10 18:02:13.711283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 10 18:02:13.711283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 10 18:02:13.711283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 10 18:02:13.711283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 10 18:02:13.711283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 10 18:02:13.711283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 10 18:02:13.711283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 90d39e37-1ad1-4306-9c1e-a5ff35f262ad could not be found. Jun 10 18:02:13.711283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:02:13.711283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:02:13.711283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:02:13.711283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:02:13.711283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:02:13.711283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:02:13.711283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:02:13.711283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:02:13.711283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:02:13.711283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:02:13.714213 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:02:13.714213 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:02:13.714213 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:02:13.714213 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:02:13.714213 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jun 10 18:02:13.714213 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jun 10 18:02:13.714213 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Jun 10 18:02:13.714213 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 10 18:02:13.714213 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 90d39e37-1ad1-4306-9c1e-a5ff35f262ad could not be found. Jun 10 18:02:13.714213 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:02:13.714213 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:02:13.714213 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:02:13.714213 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:02:13.714213 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:02:13.714213 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:02:13.714213 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:02:13.714213 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:02:13.714213 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 90d39e37-1ad1-4306-9c1e-a5ff35f262ad could not be found. Jun 10 18:02:13.714213 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:02:13.717539 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c5624ebc-9ae4-44be-8b5e-25ade635daf5 tempest-VolumesAdminNegativeTest-334649676 tempest-VolumesAdminNegativeTest-334649676-project-admin] Returning 400 to user: Volume 90d39e37-1ad1-4306-9c1e-a5ff35f262ad could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:02:13.717539 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c5624ebc-9ae4-44be-8b5e-25ade635daf5 tempest-VolumesAdminNegativeTest-334649676 tempest-VolumesAdminNegativeTest-334649676-project-admin] 10.222.0.35 "PUT /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63/os-volume_attachments/0445fae8-e2f4-40f7-bcaa-fba5beb9d7b9" status: 400 len: 107 microversion: 2.1 time: 0.427438 Jun 10 18:02:13.717539 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 750/1550] 10.222.0.35 () {60 vars in 1432 bytes} [Fri Jun 10 18:02:13 2022] PUT /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63/os-volume_attachments/0445fae8-e2f4-40f7-bcaa-fba5beb9d7b9 => generated 107 bytes in 428 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:02:13.727904 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-957cf7d1-f37b-485f-8941-c7e3500d3a99 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:13.729215 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-957cf7d1-f37b-485f-8941-c7e3500d3a99 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:13.730365 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-957cf7d1-f37b-485f-8941-c7e3500d3a99 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:13.731052 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-957cf7d1-f37b-485f-8941-c7e3500d3a99 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:13.804362 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b213a93b-81b8-4cab-ba3f-2d851879f529 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:13.805663 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b213a93b-81b8-4cab-ba3f-2d851879f529 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:13.815352 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b213a93b-81b8-4cab-ba3f-2d851879f529 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:13.816295 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b213a93b-81b8-4cab-ba3f-2d851879f529 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:13.817268 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b213a93b-81b8-4cab-ba3f-2d851879f529 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:13.820745 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b213a93b-81b8-4cab-ba3f-2d851879f529 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:14.037137 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-b213a93b-81b8-4cab-ba3f-2d851879f529 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lazy-loading 'services' on Instance uuid ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:02:14.050163 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-957cf7d1-f37b-485f-8941-c7e3500d3a99 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:14.058733 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-957cf7d1-f37b-485f-8941-c7e3500d3a99 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1549 microversion: 2.1 time: 0.365841 Jun 10 18:02:14.063563 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 801/1551] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:13 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1549 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:14.087052 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7d5f5be1-65a8-4880-b30f-e11d6ac316b9 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:14.087052 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7d5f5be1-65a8-4880-b30f-e11d6ac316b9 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: 96576f7e-6227-41c7-92fd-30b88f961560] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:14.092403 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7d5f5be1-65a8-4880-b30f-e11d6ac316b9 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:14.093077 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7d5f5be1-65a8-4880-b30f-e11d6ac316b9 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:14.094055 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7d5f5be1-65a8-4880-b30f-e11d6ac316b9 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:14.094645 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7d5f5be1-65a8-4880-b30f-e11d6ac316b9 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:14.206559 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7d5f5be1-65a8-4880-b30f-e11d6ac316b9 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:14.223279 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7d5f5be1-65a8-4880-b30f-e11d6ac316b9 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560" status: 200 len: 1298 microversion: 2.1 time: 0.148806 Jun 10 18:02:14.223876 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 802/1552] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:14 2022] GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560 => generated 1298 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:14.232479 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c7df25b9-229e-4f25-92ec-54f98d3f10d9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:14.234054 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c7df25b9-229e-4f25-92ec-54f98d3f10d9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:14.243875 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c7df25b9-229e-4f25-92ec-54f98d3f10d9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:14.243875 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c7df25b9-229e-4f25-92ec-54f98d3f10d9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:14.243875 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c7df25b9-229e-4f25-92ec-54f98d3f10d9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:14.244587 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c7df25b9-229e-4f25-92ec-54f98d3f10d9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:14.408420 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b213a93b-81b8-4cab-ba3f-2d851879f529 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "DELETE /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63/os-volume_attachments/0445fae8-e2f4-40f7-bcaa-fba5beb9d7b9" status: 202 len: 0 microversion: 2.1 time: 0.609470 Jun 10 18:02:14.409259 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 751/1553] 10.222.0.35 () {58 vars in 1415 bytes} [Fri Jun 10 18:02:13 2022] DELETE /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63/os-volume_attachments/0445fae8-e2f4-40f7-bcaa-fba5beb9d7b9 => generated 0 bytes in 612 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:02:14.436794 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-76dbc059-c1a3-47d9-888e-9ba8b4ec7e82 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:14.440897 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-76dbc059-c1a3-47d9-888e-9ba8b4ec7e82 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:14.460242 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-76dbc059-c1a3-47d9-888e-9ba8b4ec7e82 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:14.460720 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-76dbc059-c1a3-47d9-888e-9ba8b4ec7e82 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:14.461702 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-76dbc059-c1a3-47d9-888e-9ba8b4ec7e82 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:14.462317 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-76dbc059-c1a3-47d9-888e-9ba8b4ec7e82 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:14.481512 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c7df25b9-229e-4f25-92ec-54f98d3f10d9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:14.489659 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c7df25b9-229e-4f25-92ec-54f98d3f10d9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1542 microversion: 2.1 time: 0.263341 Jun 10 18:02:14.490247 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 803/1554] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:14 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1542 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:14.514300 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2c28538a-6f80-41f0-a9d5-c56bd4403483 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:14.515316 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2c28538a-6f80-41f0-a9d5-c56bd4403483 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:14.522320 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c28538a-6f80-41f0-a9d5-c56bd4403483 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:14.522977 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c28538a-6f80-41f0-a9d5-c56bd4403483 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:14.524026 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c28538a-6f80-41f0-a9d5-c56bd4403483 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:14.524660 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c28538a-6f80-41f0-a9d5-c56bd4403483 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:14.575148 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-76dbc059-c1a3-47d9-888e-9ba8b4ec7e82 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:14.600592 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-76dbc059-c1a3-47d9-888e-9ba8b4ec7e82 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:14.602425 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-76dbc059-c1a3-47d9-888e-9ba8b4ec7e82 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:14.611253 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-76dbc059-c1a3-47d9-888e-9ba8b4ec7e82 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1447 microversion: 2.75 time: 0.199453 Jun 10 18:02:14.612354 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 752/1555] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:14 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1447 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:14.639804 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a4a2cc41-630b-4393-ace9-ce0451a6be79 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:14.641881 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a4a2cc41-630b-4393-ace9-ce0451a6be79 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:14.693753 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a4a2cc41-630b-4393-ace9-ce0451a6be79 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:14.694309 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a4a2cc41-630b-4393-ace9-ce0451a6be79 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:14.696608 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a4a2cc41-630b-4393-ace9-ce0451a6be79 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:14.698942 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a4a2cc41-630b-4393-ace9-ce0451a6be79 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:14.721180 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2c28538a-6f80-41f0-a9d5-c56bd4403483 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:14.732579 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2c28538a-6f80-41f0-a9d5-c56bd4403483 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:14.735447 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2c28538a-6f80-41f0-a9d5-c56bd4403483 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:14.740394 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2c28538a-6f80-41f0-a9d5-c56bd4403483 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.232062 Jun 10 18:02:14.741638 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 804/1556] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:14 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:14.742934 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a4a2cc41-630b-4393-ace9-ce0451a6be79 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129084 Jun 10 18:02:14.746851 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 753/1557] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:02:14 2022] GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:02:14.757932 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7d53a987-d507-48ab-b3e5-5b3243925c58 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:14.758553 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7d53a987-d507-48ab-b3e5-5b3243925c58 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:14.779378 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7d53a987-d507-48ab-b3e5-5b3243925c58 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:14.783048 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7d53a987-d507-48ab-b3e5-5b3243925c58 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:14.784835 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7d53a987-d507-48ab-b3e5-5b3243925c58 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:14.785299 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7d53a987-d507-48ab-b3e5-5b3243925c58 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:14.970171 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7d53a987-d507-48ab-b3e5-5b3243925c58 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:14.980140 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7d53a987-d507-48ab-b3e5-5b3243925c58 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1517 microversion: 2.1 time: 0.237175 Jun 10 18:02:14.985527 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 805/1558] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:14 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1517 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:15.094982 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0d5b0e35-eddf-4e88-bbef-cbd52e6c9e68 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:15.095613 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0d5b0e35-eddf-4e88-bbef-cbd52e6c9e68 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:15.103066 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0d5b0e35-eddf-4e88-bbef-cbd52e6c9e68 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:15.103737 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0d5b0e35-eddf-4e88-bbef-cbd52e6c9e68 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:15.104690 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0d5b0e35-eddf-4e88-bbef-cbd52e6c9e68 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:15.105361 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0d5b0e35-eddf-4e88-bbef-cbd52e6c9e68 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:15.240062 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-70882dc7-2771-4ee3-9819-5439a73e83b3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:15.240787 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-70882dc7-2771-4ee3-9819-5439a73e83b3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: 96576f7e-6227-41c7-92fd-30b88f961560] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:15.248964 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70882dc7-2771-4ee3-9819-5439a73e83b3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:15.249705 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70882dc7-2771-4ee3-9819-5439a73e83b3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:15.250681 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70882dc7-2771-4ee3-9819-5439a73e83b3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:15.251291 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70882dc7-2771-4ee3-9819-5439a73e83b3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:15.262706 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0d5b0e35-eddf-4e88-bbef-cbd52e6c9e68 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:15.271867 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0d5b0e35-eddf-4e88-bbef-cbd52e6c9e68 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1549 microversion: 2.1 time: 0.194334 Jun 10 18:02:15.282725 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 754/1559] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:15 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1549 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:15.292266 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70882dc7-2771-4ee3-9819-5439a73e83b3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:15.292835 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70882dc7-2771-4ee3-9819-5439a73e83b3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:15.293351 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-70882dc7-2771-4ee3-9819-5439a73e83b3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lazy-loading 'fault' on Instance uuid 96576f7e-6227-41c7-92fd-30b88f961560 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:02:15.335954 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-70882dc7-2771-4ee3-9819-5439a73e83b3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:15.344639 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-70882dc7-2771-4ee3-9819-5439a73e83b3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560" status: 200 len: 1303 microversion: 2.1 time: 0.108301 Jun 10 18:02:15.345552 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 806/1560] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:15 2022] GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560 => generated 1303 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:15.509405 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f20f578c-75aa-4d45-a6ce-82b6d6711161 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:15.510058 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f20f578c-75aa-4d45-a6ce-82b6d6711161 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:15.516219 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:02:15.518442 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f20f578c-75aa-4d45-a6ce-82b6d6711161 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:15.518897 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f20f578c-75aa-4d45-a6ce-82b6d6711161 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:15.519686 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f20f578c-75aa-4d45-a6ce-82b6d6711161 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:15.520352 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f20f578c-75aa-4d45-a6ce-82b6d6711161 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:15.632025 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6f708c80-1a54-438c-95f3-0cb5d60310aa tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:15.632698 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6f708c80-1a54-438c-95f3-0cb5d60310aa tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:15.651513 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6f708c80-1a54-438c-95f3-0cb5d60310aa tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:15.652283 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6f708c80-1a54-438c-95f3-0cb5d60310aa tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:15.653410 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6f708c80-1a54-438c-95f3-0cb5d60310aa tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:15.665094 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6f708c80-1a54-438c-95f3-0cb5d60310aa tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:15.732061 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f20f578c-75aa-4d45-a6ce-82b6d6711161 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:15.741541 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f20f578c-75aa-4d45-a6ce-82b6d6711161 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1542 microversion: 2.1 time: 0.235969 Jun 10 18:02:15.745031 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 755/1561] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:15 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1542 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:15.752923 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-0cc7c31a-8ff5-4f73-a621-378d95098a53 req-c581c198-53af-4651-89c7-4f9d933224e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96576f7e-6227-41c7-92fd-30b88f961560", "name": "network-vif-deleted", "tag": "75910fb8-9d43-4249-846f-06aa6225ad07"}, {"name": "network-changed", "server_uuid": "a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d", "tag": "f0ba52c3-5bcd-42ef-b82a-a280afc864bc"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:02:15.764523 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-0cc7c31a-8ff5-4f73-a621-378d95098a53 req-c581c198-53af-4651-89c7-4f9d933224e8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:15.768460 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-0cc7c31a-8ff5-4f73-a621-378d95098a53 req-c581c198-53af-4651-89c7-4f9d933224e8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:15.784032 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6f708c80-1a54-438c-95f3-0cb5d60310aa tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:15.785750 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-0cc7c31a-8ff5-4f73-a621-378d95098a53 req-c581c198-53af-4651-89c7-4f9d933224e8 service nova] Creating event network-vif-deleted:75910fb8-9d43-4249-846f-06aa6225ad07 for instance 96576f7e-6227-41c7-92fd-30b88f961560 on chh2-master-2 Jun 10 18:02:15.786267 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-0cc7c31a-8ff5-4f73-a621-378d95098a53 req-c581c198-53af-4651-89c7-4f9d933224e8 service nova] Creating event network-changed:f0ba52c3-5bcd-42ef-b82a-a280afc864bc for instance a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d on chh1-master-2 Jun 10 18:02:15.793873 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6f708c80-1a54-438c-95f3-0cb5d60310aa tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:15.797258 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-0cc7c31a-8ff5-4f73-a621-378d95098a53 req-c581c198-53af-4651-89c7-4f9d933224e8 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.050694 Jun 10 18:02:15.798244 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 756/1562] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:02:15.802157 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6f708c80-1a54-438c-95f3-0cb5d60310aa tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:15.803578 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-74e4ae04-4d7e-4c42-9bf2-6ae0f760813a tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:15.804605 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-74e4ae04-4d7e-4c42-9bf2-6ae0f760813a tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:15.812059 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-74e4ae04-4d7e-4c42-9bf2-6ae0f760813a tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:15.812540 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-74e4ae04-4d7e-4c42-9bf2-6ae0f760813a tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:15.813310 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-74e4ae04-4d7e-4c42-9bf2-6ae0f760813a tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:15.813746 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-74e4ae04-4d7e-4c42-9bf2-6ae0f760813a tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:15.825809 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6f708c80-1a54-438c-95f3-0cb5d60310aa tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1447 microversion: 2.75 time: 0.196965 Jun 10 18:02:15.826676 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 807/1563] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:15 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1447 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:02:15.831502 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ba95c136-3f55-4b4f-a47b-899b5a05e725 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:15.832331 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ba95c136-3f55-4b4f-a47b-899b5a05e725 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:15.846029 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ba95c136-3f55-4b4f-a47b-899b5a05e725 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:15.846788 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ba95c136-3f55-4b4f-a47b-899b5a05e725 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:15.849300 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ba95c136-3f55-4b4f-a47b-899b5a05e725 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:15.849925 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ba95c136-3f55-4b4f-a47b-899b5a05e725 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:15.857831 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-74e4ae04-4d7e-4c42-9bf2-6ae0f760813a tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057887 Jun 10 18:02:15.858521 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 757/1564] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:02:15 2022] GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:02:16.009742 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ce9587f8-11ab-486a-97c4-8b763aadbefe tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:16.011668 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ce9587f8-11ab-486a-97c4-8b763aadbefe tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:16.031783 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ce9587f8-11ab-486a-97c4-8b763aadbefe tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:16.031783 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ce9587f8-11ab-486a-97c4-8b763aadbefe tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:16.031783 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ce9587f8-11ab-486a-97c4-8b763aadbefe tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:16.031783 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ce9587f8-11ab-486a-97c4-8b763aadbefe tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:16.187861 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ba95c136-3f55-4b4f-a47b-899b5a05e725 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:16.206687 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ba95c136-3f55-4b4f-a47b-899b5a05e725 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:16.208207 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ba95c136-3f55-4b4f-a47b-899b5a05e725 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:16.209436 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ba95c136-3f55-4b4f-a47b-899b5a05e725 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.381658 Jun 10 18:02:16.210207 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 808/1565] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:15 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:16.270484 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ce9587f8-11ab-486a-97c4-8b763aadbefe tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:16.279331 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ce9587f8-11ab-486a-97c4-8b763aadbefe tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1517 microversion: 2.1 time: 0.280876 Jun 10 18:02:16.288663 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 758/1566] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:15 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1517 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:02:16.292905 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0e9ce6a0-2b1a-4126-8b15-c3ab2fc74899 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:16.293756 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0e9ce6a0-2b1a-4126-8b15-c3ab2fc74899 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:16.301233 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0e9ce6a0-2b1a-4126-8b15-c3ab2fc74899 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:16.301760 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0e9ce6a0-2b1a-4126-8b15-c3ab2fc74899 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:16.302743 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0e9ce6a0-2b1a-4126-8b15-c3ab2fc74899 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:16.303309 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0e9ce6a0-2b1a-4126-8b15-c3ab2fc74899 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:16.362491 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3a088ffc-bded-42b5-a4aa-b389944af485 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:16.363464 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3a088ffc-bded-42b5-a4aa-b389944af485 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: 96576f7e-6227-41c7-92fd-30b88f961560] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:16.369895 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3a088ffc-bded-42b5-a4aa-b389944af485 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:16.370534 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3a088ffc-bded-42b5-a4aa-b389944af485 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:16.371381 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3a088ffc-bded-42b5-a4aa-b389944af485 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:16.371892 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3a088ffc-bded-42b5-a4aa-b389944af485 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:16.394019 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-3a088ffc-bded-42b5-a4aa-b389944af485 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] HTTP exception thrown: Instance 96576f7e-6227-41c7-92fd-30b88f961560 could not be found. Jun 10 18:02:16.396239 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3a088ffc-bded-42b5-a4aa-b389944af485 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Request method failure captured: Jun 10 18:02:16.396239 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560 HTTP/1.1 Jun 10 18:02:16.396239 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:02:16.396239 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:02:16.396239 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:02:16.396239 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:02:16.396239 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:02:16.396239 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:02:16.396239 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:02:16.396239 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:02:16.396239 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4aWBamDI7P_G053EWdOp1-fDAE91xuVNeLMkwOScygzZsGEYn-C5CxNxq93Kd1vJ4D3dBObQboVm4uUVfDJa6nAklJ67_G7Dmeo4S1QaLoBOymY2bYLUuvT8MwCz3_BD3O2C8K33Pv1fs3hWi7RCi-RZY0otTZArtFQ5R5eVrzoKs0 Jun 10 18:02:16.396239 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:02:16.396239 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:02:16.396239 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:02:16.396239 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:02:16.396239 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:02:16.396239 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:02:16.396239 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: c36d8cd6f58f415a90f042aff9eddd85 Jun 10 18:02:16.396239 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersAdminTestJSON-427951095 Jun 10 18:02:16.396239 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:02:16.396239 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:02:16.398007 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/c36d8cd6f58f415a90f042aff9eddd85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c36d8cd6f58f415a90f042aff9eddd85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c36d8cd6f58f415a90f042aff9eddd85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_c36d8cd6f58f415a90f042aff9eddd85", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:02:16.398007 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersAdminTestJSON-427951095 Jun 10 18:02:16.398007 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: c36d8cd6f58f415a90f042aff9eddd85 Jun 10 18:02:16.398007 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersAdminTestJSON-427951095 Jun 10 18:02:16.398007 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersAdminTestJSON-427951095-project Jun 10 18:02:16.398007 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:02:16.398007 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:02:16.398007 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 7f050bed1312417f886cdad081809aa1 Jun 10 18:02:16.398007 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersAdminTestJSON-427951095-project Jun 10 18:02:16.398007 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:02:16.398007 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 96576f7e-6227-41c7-92fd-30b88f961560 could not be found. Jun 10 18:02:16.398007 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '96576f7e-6227-41c7-92fd-30b88f961560'} Jun 10 18:02:16.398958 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:02:16.398958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:02:16.398958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:02:16.398958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:02:16.398958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:02:16.398958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:02:16.398958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:02:16.398958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:02:16.398958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:02:16.398958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:02:16.398958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96576f7e-6227-41c7-92fd-30b88f961560 could not be found. Jun 10 18:02:16.398958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:02:16.398958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:02:16.398958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:02:16.398958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:02:16.398958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:02:16.398958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:02:16.398958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:02:16.398958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:02:16.398958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:02:16.400560 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:02:16.400560 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:02:16.400560 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:02:16.400560 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:02:16.400560 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:02:16.400560 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:02:16.400560 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:02:16.400560 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96576f7e-6227-41c7-92fd-30b88f961560 could not be found. Jun 10 18:02:16.400560 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:02:16.400560 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:02:16.400560 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:02:16.400560 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:02:16.400560 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:02:16.400560 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:02:16.400560 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:02:16.400560 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:02:16.400560 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96576f7e-6227-41c7-92fd-30b88f961560 could not be found. Jun 10 18:02:16.400560 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:02:16.401950 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3a088ffc-bded-42b5-a4aa-b389944af485 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Returning 404 to user: Instance 96576f7e-6227-41c7-92fd-30b88f961560 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:02:16.402812 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3a088ffc-bded-42b5-a4aa-b389944af485 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560" status: 404 len: 111 microversion: 2.1 time: 0.044323 Jun 10 18:02:16.403575 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 759/1567] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:16 2022] GET /compute/v2.1/servers/96576f7e-6227-41c7-92fd-30b88f961560 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:02:16.412349 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6cc196c5-52e9-4276-ad55-881583bdf9f3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:16.413065 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6cc196c5-52e9-4276-ad55-881583bdf9f3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:16.422952 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6cc196c5-52e9-4276-ad55-881583bdf9f3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:16.423673 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6cc196c5-52e9-4276-ad55-881583bdf9f3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:16.425208 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6cc196c5-52e9-4276-ad55-881583bdf9f3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:16.426179 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6cc196c5-52e9-4276-ad55-881583bdf9f3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:16.459425 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6cc196c5-52e9-4276-ad55-881583bdf9f3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:02:16.542715 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0e9ce6a0-2b1a-4126-8b15-c3ab2fc74899 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:16.551554 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0e9ce6a0-2b1a-4126-8b15-c3ab2fc74899 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1549 microversion: 2.1 time: 0.265507 Jun 10 18:02:16.552206 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 809/1568] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:16 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1549 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:16.761706 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3bb1ee2f-617f-4f5e-a1e6-964a7cfb3f5d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:16.762330 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3bb1ee2f-617f-4f5e-a1e6-964a7cfb3f5d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:16.769169 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3bb1ee2f-617f-4f5e-a1e6-964a7cfb3f5d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:16.769622 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3bb1ee2f-617f-4f5e-a1e6-964a7cfb3f5d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:16.770620 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3bb1ee2f-617f-4f5e-a1e6-964a7cfb3f5d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:16.771146 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3bb1ee2f-617f-4f5e-a1e6-964a7cfb3f5d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:16.948659 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6cc196c5-52e9-4276-ad55-881583bdf9f3 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "DELETE /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 204 len: 0 microversion: 2.1 time: 0.540178 Jun 10 18:02:16.953780 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 760/1569] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:02:16 2022] DELETE /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 0 bytes in 543 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:02:16.966757 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ea2e9290-a757-4f04-8796-d7ee008f13ef tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:16.968206 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ea2e9290-a757-4f04-8796-d7ee008f13ef tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:16.977750 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ea2e9290-a757-4f04-8796-d7ee008f13ef tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:16.978696 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ea2e9290-a757-4f04-8796-d7ee008f13ef tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:16.980012 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ea2e9290-a757-4f04-8796-d7ee008f13ef tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:16.980769 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ea2e9290-a757-4f04-8796-d7ee008f13ef tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:17.118984 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ea2e9290-a757-4f04-8796-d7ee008f13ef tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:17.125661 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3bb1ee2f-617f-4f5e-a1e6-964a7cfb3f5d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:17.133228 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3bb1ee2f-617f-4f5e-a1e6-964a7cfb3f5d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1542 microversion: 2.1 time: 0.375623 Jun 10 18:02:17.134675 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 810/1570] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:16 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1542 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:02:17.140149 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-23a8cb0a-369c-4c72-bc21-aedddc3b95d3 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:17.141438 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-23a8cb0a-369c-4c72-bc21-aedddc3b95d3 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:17.146478 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ea2e9290-a757-4f04-8796-d7ee008f13ef tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:17.148009 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-23a8cb0a-369c-4c72-bc21-aedddc3b95d3 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:17.148624 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-23a8cb0a-369c-4c72-bc21-aedddc3b95d3 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:17.148979 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ea2e9290-a757-4f04-8796-d7ee008f13ef tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:17.149596 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-23a8cb0a-369c-4c72-bc21-aedddc3b95d3 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:17.150145 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-23a8cb0a-369c-4c72-bc21-aedddc3b95d3 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:17.161894 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ea2e9290-a757-4f04-8796-d7ee008f13ef tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1447 microversion: 2.75 time: 0.205276 Jun 10 18:02:17.163242 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 761/1571] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:16 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1447 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:17.173063 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5433042c-59b9-4209-ae54-2ae6a4e4d575 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:17.173689 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5433042c-59b9-4209-ae54-2ae6a4e4d575 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:17.181892 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5433042c-59b9-4209-ae54-2ae6a4e4d575 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:17.182354 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5433042c-59b9-4209-ae54-2ae6a4e4d575 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:17.183142 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5433042c-59b9-4209-ae54-2ae6a4e4d575 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:17.183626 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5433042c-59b9-4209-ae54-2ae6a4e4d575 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:17.208144 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-23a8cb0a-369c-4c72-bc21-aedddc3b95d3 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071897 Jun 10 18:02:17.209042 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 811/1572] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:02:17 2022] GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:02:17.226758 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-42255eb6-f838-41da-97d3-ba9e1eeaa9f1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:17.227629 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-42255eb6-f838-41da-97d3-ba9e1eeaa9f1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:17.234706 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42255eb6-f838-41da-97d3-ba9e1eeaa9f1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:17.235408 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42255eb6-f838-41da-97d3-ba9e1eeaa9f1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:17.236414 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42255eb6-f838-41da-97d3-ba9e1eeaa9f1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:17.237017 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42255eb6-f838-41da-97d3-ba9e1eeaa9f1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:17.262348 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:02:17.366537 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5433042c-59b9-4209-ae54-2ae6a4e4d575 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:17.375408 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5433042c-59b9-4209-ae54-2ae6a4e4d575 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1467 microversion: 2.1 time: 0.211061 Jun 10 18:02:17.376202 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 762/1573] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:17 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1467 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:17.398708 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-90a8dfa0-ef97-4894-a87e-479ad4d12277 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:17.399389 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-90a8dfa0-ef97-4894-a87e-479ad4d12277 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:17.405642 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90a8dfa0-ef97-4894-a87e-479ad4d12277 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:17.406100 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90a8dfa0-ef97-4894-a87e-479ad4d12277 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:17.406892 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90a8dfa0-ef97-4894-a87e-479ad4d12277 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:17.407337 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90a8dfa0-ef97-4894-a87e-479ad4d12277 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:17.459381 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-42255eb6-f838-41da-97d3-ba9e1eeaa9f1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:17.469502 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-42255eb6-f838-41da-97d3-ba9e1eeaa9f1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:17.471355 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-42255eb6-f838-41da-97d3-ba9e1eeaa9f1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:17.472947 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-42255eb6-f838-41da-97d3-ba9e1eeaa9f1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.249589 Jun 10 18:02:17.473512 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 812/1574] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:17 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:02:17.570303 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ddb036b6-c686-4a67-b396-ab2c3e4ff7bd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:17.571195 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ddb036b6-c686-4a67-b396-ab2c3e4ff7bd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:17.583972 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ddb036b6-c686-4a67-b396-ab2c3e4ff7bd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:17.584833 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ddb036b6-c686-4a67-b396-ab2c3e4ff7bd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:17.586515 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ddb036b6-c686-4a67-b396-ab2c3e4ff7bd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:17.588878 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ddb036b6-c686-4a67-b396-ab2c3e4ff7bd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:17.623316 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-90a8dfa0-ef97-4894-a87e-479ad4d12277 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:17.632050 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-90a8dfa0-ef97-4894-a87e-479ad4d12277 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1517 microversion: 2.1 time: 0.245674 Jun 10 18:02:17.637259 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 763/1575] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:17 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1517 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:17.747918 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ddb036b6-c686-4a67-b396-ab2c3e4ff7bd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:17.760694 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ddb036b6-c686-4a67-b396-ab2c3e4ff7bd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1549 microversion: 2.1 time: 0.195635 Jun 10 18:02:17.764349 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 813/1576] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:17 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1549 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:18.151710 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e99ea6e3-b439-4867-8bb7-623e4ec36b66 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:18.154171 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e99ea6e3-b439-4867-8bb7-623e4ec36b66 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:18.161601 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e99ea6e3-b439-4867-8bb7-623e4ec36b66 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:18.162378 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e99ea6e3-b439-4867-8bb7-623e4ec36b66 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:18.163793 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e99ea6e3-b439-4867-8bb7-623e4ec36b66 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:18.164533 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e99ea6e3-b439-4867-8bb7-623e4ec36b66 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:18.170152 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:02:18.181829 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-30f71c4c-ddf5-4659-8718-7f624e9ec615 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:18.183559 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-30f71c4c-ddf5-4659-8718-7f624e9ec615 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:18.190824 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30f71c4c-ddf5-4659-8718-7f624e9ec615 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:18.191287 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30f71c4c-ddf5-4659-8718-7f624e9ec615 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:18.200760 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30f71c4c-ddf5-4659-8718-7f624e9ec615 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:18.201353 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30f71c4c-ddf5-4659-8718-7f624e9ec615 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:18.299536 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-30f71c4c-ddf5-4659-8718-7f624e9ec615 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:18.311104 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-30f71c4c-ddf5-4659-8718-7f624e9ec615 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:18.314856 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-30f71c4c-ddf5-4659-8718-7f624e9ec615 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:18.326015 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-30f71c4c-ddf5-4659-8718-7f624e9ec615 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1447 microversion: 2.75 time: 0.147370 Jun 10 18:02:18.326951 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 814/1577] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:18 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1447 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:02:18.332722 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9c4765ae-40ee-4f8c-bb23-98b3f85cfbb4 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:18.333701 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9c4765ae-40ee-4f8c-bb23-98b3f85cfbb4 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:18.340582 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9c4765ae-40ee-4f8c-bb23-98b3f85cfbb4 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:18.341993 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9c4765ae-40ee-4f8c-bb23-98b3f85cfbb4 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:18.343437 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9c4765ae-40ee-4f8c-bb23-98b3f85cfbb4 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:18.344290 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9c4765ae-40ee-4f8c-bb23-98b3f85cfbb4 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:18.372934 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e99ea6e3-b439-4867-8bb7-623e4ec36b66 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:18.382315 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e99ea6e3-b439-4867-8bb7-623e4ec36b66 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1542 microversion: 2.1 time: 0.234419 Jun 10 18:02:18.393729 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 764/1578] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:18 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1542 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:18.393914 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9c4765ae-40ee-4f8c-bb23-98b3f85cfbb4 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063667 Jun 10 18:02:18.396228 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 815/1579] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:02:18 2022] GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:02:18.404986 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fce86b1b-3c87-4d31-84c6-40229006df1c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:18.405651 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fce86b1b-3c87-4d31-84c6-40229006df1c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:18.413589 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fce86b1b-3c87-4d31-84c6-40229006df1c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:18.414183 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fce86b1b-3c87-4d31-84c6-40229006df1c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:18.415073 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fce86b1b-3c87-4d31-84c6-40229006df1c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:18.415609 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fce86b1b-3c87-4d31-84c6-40229006df1c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:18.510238 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-83332d0d-bf9d-473a-9abc-da50e14fcc33 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:18.511361 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-83332d0d-bf9d-473a-9abc-da50e14fcc33 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:18.525081 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83332d0d-bf9d-473a-9abc-da50e14fcc33 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:18.525531 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83332d0d-bf9d-473a-9abc-da50e14fcc33 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:18.526320 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83332d0d-bf9d-473a-9abc-da50e14fcc33 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:18.526762 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83332d0d-bf9d-473a-9abc-da50e14fcc33 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:18.624658 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fce86b1b-3c87-4d31-84c6-40229006df1c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:18.634757 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fce86b1b-3c87-4d31-84c6-40229006df1c tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1467 microversion: 2.1 time: 0.234540 Jun 10 18:02:18.646348 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 765/1580] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:18 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1467 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:18.656202 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-21c89719-602a-4e3b-b092-9a4dcb4ee9f7 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:18.658778 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-21c89719-602a-4e3b-b092-9a4dcb4ee9f7 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:18.682179 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-21c89719-602a-4e3b-b092-9a4dcb4ee9f7 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:18.682640 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-21c89719-602a-4e3b-b092-9a4dcb4ee9f7 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:18.683682 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-21c89719-602a-4e3b-b092-9a4dcb4ee9f7 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:18.684136 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-21c89719-602a-4e3b-b092-9a4dcb4ee9f7 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:18.827309 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-83332d0d-bf9d-473a-9abc-da50e14fcc33 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:18.839118 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-83332d0d-bf9d-473a-9abc-da50e14fcc33 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:18.840615 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-83332d0d-bf9d-473a-9abc-da50e14fcc33 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:18.845030 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-83332d0d-bf9d-473a-9abc-da50e14fcc33 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.357687 Jun 10 18:02:18.846870 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 816/1581] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:18 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:18.852541 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-15386f9c-d874-4aab-908f-cdaa4f30023c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:18.852541 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-15386f9c-d874-4aab-908f-cdaa4f30023c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:18.859312 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-15386f9c-d874-4aab-908f-cdaa4f30023c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:18.859761 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-15386f9c-d874-4aab-908f-cdaa4f30023c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:18.861537 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-15386f9c-d874-4aab-908f-cdaa4f30023c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:18.862004 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-15386f9c-d874-4aab-908f-cdaa4f30023c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:18.921917 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-21c89719-602a-4e3b-b092-9a4dcb4ee9f7 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:18.933928 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-21c89719-602a-4e3b-b092-9a4dcb4ee9f7 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1517 microversion: 2.1 time: 0.282555 Jun 10 18:02:18.935270 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 766/1582] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:18 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1517 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:19.101390 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-15386f9c-d874-4aab-908f-cdaa4f30023c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:19.112454 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-15386f9c-d874-4aab-908f-cdaa4f30023c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1549 microversion: 2.1 time: 0.264465 Jun 10 18:02:19.113199 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 817/1583] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:18 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1549 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:19.347710 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-18de920c-97a0-49b4-8a1e-7235a7c454f3 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:19.348427 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-18de920c-97a0-49b4-8a1e-7235a7c454f3 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:19.370372 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-18de920c-97a0-49b4-8a1e-7235a7c454f3 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:19.370829 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-18de920c-97a0-49b4-8a1e-7235a7c454f3 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:19.371628 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-18de920c-97a0-49b4-8a1e-7235a7c454f3 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:19.372119 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-18de920c-97a0-49b4-8a1e-7235a7c454f3 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:19.402744 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a26dc501-8944-4730-8907-5a395a41be67 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:19.403934 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a26dc501-8944-4730-8907-5a395a41be67 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:19.410997 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a26dc501-8944-4730-8907-5a395a41be67 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:19.411460 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a26dc501-8944-4730-8907-5a395a41be67 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:19.412247 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a26dc501-8944-4730-8907-5a395a41be67 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:19.417722 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a26dc501-8944-4730-8907-5a395a41be67 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:19.532248 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-18de920c-97a0-49b4-8a1e-7235a7c454f3 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:19.543195 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-18de920c-97a0-49b4-8a1e-7235a7c454f3 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:19.545254 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-18de920c-97a0-49b4-8a1e-7235a7c454f3 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:19.563831 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-18de920c-97a0-49b4-8a1e-7235a7c454f3 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1447 microversion: 2.75 time: 0.221364 Jun 10 18:02:19.565106 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 767/1584] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:19 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1447 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:19.570140 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-667b1676-e23a-4b8f-990a-13d5f3d0c435 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:19.571229 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-667b1676-e23a-4b8f-990a-13d5f3d0c435 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:19.592127 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-667b1676-e23a-4b8f-990a-13d5f3d0c435 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:19.593873 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-667b1676-e23a-4b8f-990a-13d5f3d0c435 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:19.594908 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-667b1676-e23a-4b8f-990a-13d5f3d0c435 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:19.595551 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-667b1676-e23a-4b8f-990a-13d5f3d0c435 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:19.661139 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-667b1676-e23a-4b8f-990a-13d5f3d0c435 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094661 Jun 10 18:02:19.668892 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 768/1585] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:02:19 2022] GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:02:19.677733 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-36df7cd5-7957-4b69-a2e7-31faba3748c2 req-d1acfe35-588b-4b32-bed1-5dc57d5b86ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab0caf46-568d-4b5a-bd31-458cdc99b06f", "name": "network-vif-deleted", "tag": "fe140919-8d1b-4aeb-a134-324a13655f62"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:02:19.697927 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-36df7cd5-7957-4b69-a2e7-31faba3748c2 req-d1acfe35-588b-4b32-bed1-5dc57d5b86ec service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:19.701800 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-36df7cd5-7957-4b69-a2e7-31faba3748c2 req-d1acfe35-588b-4b32-bed1-5dc57d5b86ec service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:19.724690 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-36df7cd5-7957-4b69-a2e7-31faba3748c2 req-d1acfe35-588b-4b32-bed1-5dc57d5b86ec service nova] Creating event network-vif-deleted:fe140919-8d1b-4aeb-a134-324a13655f62 for instance ab0caf46-568d-4b5a-bd31-458cdc99b06f on chh1-master-2 Jun 10 18:02:19.738492 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-36df7cd5-7957-4b69-a2e7-31faba3748c2 req-d1acfe35-588b-4b32-bed1-5dc57d5b86ec service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067892 Jun 10 18:02:19.739487 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 769/1586] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:02:19.757218 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bd797d40-2e85-4e16-a078-d48f5557c4af tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:19.764666 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bd797d40-2e85-4e16-a078-d48f5557c4af tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:19.785922 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bd797d40-2e85-4e16-a078-d48f5557c4af tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:19.792711 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bd797d40-2e85-4e16-a078-d48f5557c4af tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:19.795694 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bd797d40-2e85-4e16-a078-d48f5557c4af tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:19.798114 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bd797d40-2e85-4e16-a078-d48f5557c4af tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:19.822169 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a26dc501-8944-4730-8907-5a395a41be67 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:19.831443 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a26dc501-8944-4730-8907-5a395a41be67 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1542 microversion: 2.1 time: 0.432444 Jun 10 18:02:19.837632 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 818/1587] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:19 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1542 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:19.864339 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-eb0c0bfb-a7ed-453b-86a1-a524930873e5 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:19.864955 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-eb0c0bfb-a7ed-453b-86a1-a524930873e5 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:19.876558 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eb0c0bfb-a7ed-453b-86a1-a524930873e5 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:19.877033 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eb0c0bfb-a7ed-453b-86a1-a524930873e5 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:19.877844 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eb0c0bfb-a7ed-453b-86a1-a524930873e5 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:19.880818 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eb0c0bfb-a7ed-453b-86a1-a524930873e5 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:19.911658 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bd797d40-2e85-4e16-a078-d48f5557c4af tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:19.926611 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bd797d40-2e85-4e16-a078-d48f5557c4af tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1298 microversion: 2.1 time: 0.185559 Jun 10 18:02:19.927344 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 770/1588] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:19 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1298 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:19.952374 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-207b3873-e646-4f32-a925-853822c0ebfa tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:19.957588 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-207b3873-e646-4f32-a925-853822c0ebfa tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:19.974385 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-207b3873-e646-4f32-a925-853822c0ebfa tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:19.975266 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-207b3873-e646-4f32-a925-853822c0ebfa tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:19.975919 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-207b3873-e646-4f32-a925-853822c0ebfa tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:19.976523 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-207b3873-e646-4f32-a925-853822c0ebfa tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:20.098035 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-eb0c0bfb-a7ed-453b-86a1-a524930873e5 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:20.111226 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-eb0c0bfb-a7ed-453b-86a1-a524930873e5 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:20.116186 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-eb0c0bfb-a7ed-453b-86a1-a524930873e5 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:20.116186 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-eb0c0bfb-a7ed-453b-86a1-a524930873e5 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.254751 Jun 10 18:02:20.116186 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 819/1589] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:19 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:02:20.130523 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4b94e60a-85c4-43e6-89b1-c8591e2aa38f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:20.131706 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4b94e60a-85c4-43e6-89b1-c8591e2aa38f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:20.140353 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4b94e60a-85c4-43e6-89b1-c8591e2aa38f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:20.144646 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4b94e60a-85c4-43e6-89b1-c8591e2aa38f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:20.144646 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4b94e60a-85c4-43e6-89b1-c8591e2aa38f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:20.144646 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4b94e60a-85c4-43e6-89b1-c8591e2aa38f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:20.189420 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-207b3873-e646-4f32-a925-853822c0ebfa tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:20.199352 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-207b3873-e646-4f32-a925-853822c0ebfa tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1517 microversion: 2.1 time: 0.250762 Jun 10 18:02:20.211690 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 771/1590] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:19 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1517 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:02:20.331837 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4b94e60a-85c4-43e6-89b1-c8591e2aa38f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:20.342212 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4b94e60a-85c4-43e6-89b1-c8591e2aa38f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1549 microversion: 2.1 time: 0.216697 Jun 10 18:02:20.343274 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 820/1591] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:20 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1549 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:02:20.585406 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a727321f-ca70-41fd-84bd-3e52d7939eaf tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:20.586766 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a727321f-ca70-41fd-84bd-3e52d7939eaf tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:20.596172 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a727321f-ca70-41fd-84bd-3e52d7939eaf tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:20.600136 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a727321f-ca70-41fd-84bd-3e52d7939eaf tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:20.601280 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a727321f-ca70-41fd-84bd-3e52d7939eaf tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:20.601831 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a727321f-ca70-41fd-84bd-3e52d7939eaf tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:20.690950 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-11c64dec-c577-4440-ad4f-a365bf82bae1 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:20.694881 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-11c64dec-c577-4440-ad4f-a365bf82bae1 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:20.706366 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a727321f-ca70-41fd-84bd-3e52d7939eaf tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:20.711651 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-11c64dec-c577-4440-ad4f-a365bf82bae1 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:20.716918 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-11c64dec-c577-4440-ad4f-a365bf82bae1 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:20.717928 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-11c64dec-c577-4440-ad4f-a365bf82bae1 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:20.718378 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-11c64dec-c577-4440-ad4f-a365bf82bae1 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:20.719705 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a727321f-ca70-41fd-84bd-3e52d7939eaf tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:20.722241 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a727321f-ca70-41fd-84bd-3e52d7939eaf tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:20.728831 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a727321f-ca70-41fd-84bd-3e52d7939eaf tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1447 microversion: 2.75 time: 0.147816 Jun 10 18:02:20.730072 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 772/1592] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:20 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1447 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:20.759321 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-11c64dec-c577-4440-ad4f-a365bf82bae1 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083838 Jun 10 18:02:20.760185 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 821/1593] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:02:20 2022] GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:02:20.849153 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b9daa403-52c0-4259-8d5e-4ec4e50a2b50 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:20.849867 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b9daa403-52c0-4259-8d5e-4ec4e50a2b50 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:20.857771 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9daa403-52c0-4259-8d5e-4ec4e50a2b50 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:20.859258 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9daa403-52c0-4259-8d5e-4ec4e50a2b50 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:20.860160 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9daa403-52c0-4259-8d5e-4ec4e50a2b50 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:20.860645 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9daa403-52c0-4259-8d5e-4ec4e50a2b50 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:20.945496 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cf57a8f5-f248-47c8-8a2c-bd7ddc0a6580 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:20.946211 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cf57a8f5-f248-47c8-8a2c-bd7ddc0a6580 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:20.952556 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cf57a8f5-f248-47c8-8a2c-bd7ddc0a6580 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:20.953014 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cf57a8f5-f248-47c8-8a2c-bd7ddc0a6580 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:20.953790 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cf57a8f5-f248-47c8-8a2c-bd7ddc0a6580 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:20.954407 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cf57a8f5-f248-47c8-8a2c-bd7ddc0a6580 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:20.989049 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cf57a8f5-f248-47c8-8a2c-bd7ddc0a6580 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:20.989552 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cf57a8f5-f248-47c8-8a2c-bd7ddc0a6580 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:20.990012 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-cf57a8f5-f248-47c8-8a2c-bd7ddc0a6580 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lazy-loading 'fault' on Instance uuid ab0caf46-568d-4b5a-bd31-458cdc99b06f {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:02:21.022489 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b9daa403-52c0-4259-8d5e-4ec4e50a2b50 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:21.030777 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b9daa403-52c0-4259-8d5e-4ec4e50a2b50 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1542 microversion: 2.1 time: 0.185700 Jun 10 18:02:21.031359 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 773/1594] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:20 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1542 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:21.039928 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cf57a8f5-f248-47c8-8a2c-bd7ddc0a6580 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f050bed1312417f886cdad081809aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36d8cd6f58f415a90f042aff9eddd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:21.050262 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cf57a8f5-f248-47c8-8a2c-bd7ddc0a6580 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 200 len: 1303 microversion: 2.1 time: 0.108811 Jun 10 18:02:21.050927 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 822/1595] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:20 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 1303 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:02:21.134297 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8312369f-e704-4eee-8e58-a1fd67bb4a8e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:21.134297 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8312369f-e704-4eee-8e58-a1fd67bb4a8e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:21.141018 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8312369f-e704-4eee-8e58-a1fd67bb4a8e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:21.141477 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8312369f-e704-4eee-8e58-a1fd67bb4a8e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:21.142345 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8312369f-e704-4eee-8e58-a1fd67bb4a8e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:21.142798 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8312369f-e704-4eee-8e58-a1fd67bb4a8e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:21.221214 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-24dda632-e895-404f-96c0-750390f6df84 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:21.222066 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-24dda632-e895-404f-96c0-750390f6df84 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:21.230263 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-24dda632-e895-404f-96c0-750390f6df84 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:21.230765 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-24dda632-e895-404f-96c0-750390f6df84 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:21.232329 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-24dda632-e895-404f-96c0-750390f6df84 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:21.233620 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-24dda632-e895-404f-96c0-750390f6df84 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:21.354975 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8312369f-e704-4eee-8e58-a1fd67bb4a8e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:21.372514 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8312369f-e704-4eee-8e58-a1fd67bb4a8e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:21.374016 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8312369f-e704-4eee-8e58-a1fd67bb4a8e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:21.376714 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8312369f-e704-4eee-8e58-a1fd67bb4a8e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.246864 Jun 10 18:02:21.390853 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 774/1596] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:21 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:21.404016 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6cea46ee-b1c6-4912-a8d4-3be53bf79c5f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:21.404674 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6cea46ee-b1c6-4912-a8d4-3be53bf79c5f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:21.411703 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6cea46ee-b1c6-4912-a8d4-3be53bf79c5f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:21.412396 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6cea46ee-b1c6-4912-a8d4-3be53bf79c5f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:21.419504 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6cea46ee-b1c6-4912-a8d4-3be53bf79c5f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:21.420012 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6cea46ee-b1c6-4912-a8d4-3be53bf79c5f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:21.515440 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-24dda632-e895-404f-96c0-750390f6df84 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:21.529597 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-24dda632-e895-404f-96c0-750390f6df84 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1517 microversion: 2.1 time: 0.315337 Jun 10 18:02:21.532219 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 823/1597] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:21 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1517 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:02:21.637431 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6cea46ee-b1c6-4912-a8d4-3be53bf79c5f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:21.652840 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6cea46ee-b1c6-4912-a8d4-3be53bf79c5f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1549 microversion: 2.1 time: 0.262664 Jun 10 18:02:21.654542 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 775/1598] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:21 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1549 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:21.750547 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1c6b24f9-93ca-4157-8a1a-06a19d4539c2 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:21.751856 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1c6b24f9-93ca-4157-8a1a-06a19d4539c2 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:21.759102 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1c6b24f9-93ca-4157-8a1a-06a19d4539c2 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:21.759564 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1c6b24f9-93ca-4157-8a1a-06a19d4539c2 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:21.760422 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1c6b24f9-93ca-4157-8a1a-06a19d4539c2 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:21.760871 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1c6b24f9-93ca-4157-8a1a-06a19d4539c2 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:21.772919 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1d09c62e-6ec7-4380-955d-c8ec853aa201 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:21.773914 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1d09c62e-6ec7-4380-955d-c8ec853aa201 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:21.790090 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1d09c62e-6ec7-4380-955d-c8ec853aa201 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:21.790090 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1d09c62e-6ec7-4380-955d-c8ec853aa201 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:21.790090 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1d09c62e-6ec7-4380-955d-c8ec853aa201 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:21.790090 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1d09c62e-6ec7-4380-955d-c8ec853aa201 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:21.829287 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1d09c62e-6ec7-4380-955d-c8ec853aa201 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061919 Jun 10 18:02:21.835906 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 776/1599] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:02:21 2022] GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:02:21.837682 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1c6b24f9-93ca-4157-8a1a-06a19d4539c2 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:21.846291 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1c6b24f9-93ca-4157-8a1a-06a19d4539c2 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:21.847812 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1c6b24f9-93ca-4157-8a1a-06a19d4539c2 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:21.854139 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1c6b24f9-93ca-4157-8a1a-06a19d4539c2 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1447 microversion: 2.75 time: 0.108206 Jun 10 18:02:21.855049 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 824/1600] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:21 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1447 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:22.008851 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ff57e43d-7698-4089-af39-f22fd21b33a8 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-642540523", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "6b5a9d7c-48fd-4dc5-be64-fc076e8b4d21"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:02:22.049343 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dc71d3d1-e492-4703-be4b-164627fd1071 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:22.050318 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dc71d3d1-e492-4703-be4b-164627fd1071 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:22.059459 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc71d3d1-e492-4703-be4b-164627fd1071 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:22.061806 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc71d3d1-e492-4703-be4b-164627fd1071 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:22.061806 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc71d3d1-e492-4703-be4b-164627fd1071 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:22.062022 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc71d3d1-e492-4703-be4b-164627fd1071 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:22.068643 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-ff57e43d-7698-4089-af39-f22fd21b33a8 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] validate_networks() for [('6b5a9d7c-48fd-4dc5-be64-fc076e8b4d21', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:02:22.229622 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-dc71d3d1-e492-4703-be4b-164627fd1071 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:22.241025 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dc71d3d1-e492-4703-be4b-164627fd1071 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1542 microversion: 2.1 time: 0.195932 Jun 10 18:02:22.241805 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 825/1601] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:22 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1542 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:02:22.258924 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3cf512b0-2f97-4ad1-8722-ae30ef33ccc2 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:22.259549 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3cf512b0-2f97-4ad1-8722-ae30ef33ccc2 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] [instance: ab0caf46-568d-4b5a-bd31-458cdc99b06f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:22.267503 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3cf512b0-2f97-4ad1-8722-ae30ef33ccc2 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:22.268088 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3cf512b0-2f97-4ad1-8722-ae30ef33ccc2 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:22.269008 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3cf512b0-2f97-4ad1-8722-ae30ef33ccc2 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:22.269547 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3cf512b0-2f97-4ad1-8722-ae30ef33ccc2 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:22.287950 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-3cf512b0-2f97-4ad1-8722-ae30ef33ccc2 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] HTTP exception thrown: Instance ab0caf46-568d-4b5a-bd31-458cdc99b06f could not be found. Jun 10 18:02:22.289669 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3cf512b0-2f97-4ad1-8722-ae30ef33ccc2 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Request method failure captured: Jun 10 18:02:22.289669 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f HTTP/1.1 Jun 10 18:02:22.289669 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:02:22.289669 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:02:22.289669 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:02:22.289669 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:02:22.289669 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:02:22.289669 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:02:22.289669 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:02:22.289669 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:02:22.289669 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4aWBamDI7P_G053EWdOp1-fDAE91xuVNeLMkwOScygzZsGEYn-C5CxNxq93Kd1vJ4D3dBObQboVm4uUVfDJa6nAklJ67_G7Dmeo4S1QaLoBOymY2bYLUuvT8MwCz3_BD3O2C8K33Pv1fs3hWi7RCi-RZY0otTZArtFQ5R5eVrzoKs0 Jun 10 18:02:22.289669 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:02:22.289669 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:02:22.289669 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:02:22.289669 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:02:22.289669 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:02:22.289669 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:02:22.289669 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: c36d8cd6f58f415a90f042aff9eddd85 Jun 10 18:02:22.289669 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersAdminTestJSON-427951095 Jun 10 18:02:22.289669 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:02:22.289669 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:02:22.291327 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/c36d8cd6f58f415a90f042aff9eddd85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c36d8cd6f58f415a90f042aff9eddd85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c36d8cd6f58f415a90f042aff9eddd85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_c36d8cd6f58f415a90f042aff9eddd85", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:02:22.291327 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersAdminTestJSON-427951095 Jun 10 18:02:22.291327 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: c36d8cd6f58f415a90f042aff9eddd85 Jun 10 18:02:22.291327 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersAdminTestJSON-427951095 Jun 10 18:02:22.291327 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersAdminTestJSON-427951095-project Jun 10 18:02:22.291327 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:02:22.291327 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:02:22.291327 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 7f050bed1312417f886cdad081809aa1 Jun 10 18:02:22.291327 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersAdminTestJSON-427951095-project Jun 10 18:02:22.291327 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:02:22.291327 chdv-master-2 devstack@n-api.service[126595]: exception: Instance ab0caf46-568d-4b5a-bd31-458cdc99b06f could not be found. Jun 10 18:02:22.291327 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'ab0caf46-568d-4b5a-bd31-458cdc99b06f'} Jun 10 18:02:22.292353 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:02:22.292353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:02:22.292353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:02:22.292353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:02:22.292353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:02:22.292353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:02:22.292353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:02:22.292353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:02:22.292353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:02:22.292353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:02:22.292353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab0caf46-568d-4b5a-bd31-458cdc99b06f could not be found. Jun 10 18:02:22.292353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:02:22.292353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:02:22.292353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:02:22.292353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:02:22.292353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:02:22.292353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:02:22.292353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:02:22.292353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:02:22.292353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:02:22.295840 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:02:22.295840 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:02:22.295840 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:02:22.295840 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:02:22.295840 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:02:22.295840 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:02:22.295840 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:02:22.295840 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab0caf46-568d-4b5a-bd31-458cdc99b06f could not be found. Jun 10 18:02:22.295840 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:02:22.295840 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:02:22.295840 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:02:22.295840 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:02:22.295840 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:02:22.295840 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:02:22.295840 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:02:22.295840 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:02:22.295840 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab0caf46-568d-4b5a-bd31-458cdc99b06f could not be found. Jun 10 18:02:22.295840 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:02:22.297004 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3cf512b0-2f97-4ad1-8722-ae30ef33ccc2 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] Returning 404 to user: Instance ab0caf46-568d-4b5a-bd31-458cdc99b06f could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:02:22.297004 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3cf512b0-2f97-4ad1-8722-ae30ef33ccc2 tempest-ServersAdminTestJSON-427951095 tempest-ServersAdminTestJSON-427951095-project] 10.222.0.35 "GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f" status: 404 len: 111 microversion: 2.1 time: 0.036032 Jun 10 18:02:22.297004 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 826/1602] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:22 2022] GET /compute/v2.1/servers/ab0caf46-568d-4b5a-bd31-458cdc99b06f => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:02:22.396967 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-edb02ef1-8602-4657-b0f2-c97869c934c7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:22.398583 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-edb02ef1-8602-4657-b0f2-c97869c934c7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:22.411341 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-edb02ef1-8602-4657-b0f2-c97869c934c7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:22.411815 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-edb02ef1-8602-4657-b0f2-c97869c934c7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:22.419850 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-edb02ef1-8602-4657-b0f2-c97869c934c7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:22.420465 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-edb02ef1-8602-4657-b0f2-c97869c934c7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:22.609860 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-edb02ef1-8602-4657-b0f2-c97869c934c7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:22.619677 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-edb02ef1-8602-4657-b0f2-c97869c934c7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:22.624467 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-edb02ef1-8602-4657-b0f2-c97869c934c7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:22.624467 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-edb02ef1-8602-4657-b0f2-c97869c934c7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.230886 Jun 10 18:02:22.624467 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 827/1603] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:22 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:02:22.631970 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-ff57e43d-7698-4089-af39-f22fd21b33a8 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:02:22.632569 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-ff57e43d-7698-4089-af39-f22fd21b33a8 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:02:22.633314 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-ff57e43d-7698-4089-af39-f22fd21b33a8 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:02:22.633954 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-ff57e43d-7698-4089-af39-f22fd21b33a8 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:02:22.634481 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-ff57e43d-7698-4089-af39-f22fd21b33a8 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:02:22.642530 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b9aca788-ad51-46a0-adad-a005f51601cc tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:22.643772 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b9aca788-ad51-46a0-adad-a005f51601cc tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:22.649647 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ff57e43d-7698-4089-af39-f22fd21b33a8 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:22.650180 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9aca788-ad51-46a0-adad-a005f51601cc tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:22.650287 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ff57e43d-7698-4089-af39-f22fd21b33a8 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:22.650769 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9aca788-ad51-46a0-adad-a005f51601cc tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:22.651031 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ff57e43d-7698-4089-af39-f22fd21b33a8 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:22.651476 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ff57e43d-7698-4089-af39-f22fd21b33a8 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:22.651836 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9aca788-ad51-46a0-adad-a005f51601cc tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:22.652428 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9aca788-ad51-46a0-adad-a005f51601cc tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:22.691027 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-ff57e43d-7698-4089-af39-f22fd21b33a8 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Getting quotas for project dce8674b6db3471c8c94e809430651c4. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:02:22.698640 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-ff57e43d-7698-4089-af39-f22fd21b33a8 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Getting quotas for user 63889ce9e75140bd9c730857468b7fd5 and project dce8674b6db3471c8c94e809430651c4. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:02:22.714420 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ff57e43d-7698-4089-af39-f22fd21b33a8 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:02:22.718401 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ff57e43d-7698-4089-af39-f22fd21b33a8 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: 00eacc06-d58a-4a76-8ac8-2515de78f44d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:02:22.845315 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b9aca788-ad51-46a0-adad-a005f51601cc tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:22.855376 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b9aca788-ad51-46a0-adad-a005f51601cc tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1517 microversion: 2.1 time: 0.229646 Jun 10 18:02:22.857720 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 828/1604] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:22 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1517 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:22.862367 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4d03a97b-04cc-4681-ab4f-414598a1633a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:22.862972 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4d03a97b-04cc-4681-ab4f-414598a1633a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:22.869298 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d03a97b-04cc-4681-ab4f-414598a1633a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:22.873014 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d03a97b-04cc-4681-ab4f-414598a1633a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:22.873014 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d03a97b-04cc-4681-ab4f-414598a1633a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:22.873014 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d03a97b-04cc-4681-ab4f-414598a1633a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:22.873798 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:02:22.881753 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ff57e43d-7698-4089-af39-f22fd21b33a8 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.874846 Jun 10 18:02:22.882495 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 777/1605] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:02:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:02:22.903980 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8dcdb153-2e7a-45e8-8590-a61cb8f8de68 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:22.904790 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8dcdb153-2e7a-45e8-8590-a61cb8f8de68 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:22.911336 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8dcdb153-2e7a-45e8-8590-a61cb8f8de68 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:22.911792 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8dcdb153-2e7a-45e8-8590-a61cb8f8de68 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:22.912718 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8dcdb153-2e7a-45e8-8590-a61cb8f8de68 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:22.913157 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8dcdb153-2e7a-45e8-8590-a61cb8f8de68 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:23.054227 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4d03a97b-04cc-4681-ab4f-414598a1633a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:23.060549 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8dcdb153-2e7a-45e8-8590-a61cb8f8de68 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:23.068297 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4d03a97b-04cc-4681-ab4f-414598a1633a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1549 microversion: 2.1 time: 0.209547 Jun 10 18:02:23.069008 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8dcdb153-2e7a-45e8-8590-a61cb8f8de68 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:23.070327 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 829/1606] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:22 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1549 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:23.070535 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8dcdb153-2e7a-45e8-8590-a61cb8f8de68 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:23.083277 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-40ffa12c-98b5-49c3-beae-99532a839aca tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:23.086189 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-40ffa12c-98b5-49c3-beae-99532a839aca tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: 00eacc06-d58a-4a76-8ac8-2515de78f44d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:23.087105 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8dcdb153-2e7a-45e8-8590-a61cb8f8de68 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1447 microversion: 2.75 time: 0.200808 Jun 10 18:02:23.088032 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 778/1607] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:22 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1447 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:23.171484 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-40ffa12c-98b5-49c3-beae-99532a839aca tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63889ce9e75140bd9c730857468b7fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce8674b6db3471c8c94e809430651c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:23.178926 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-40ffa12c-98b5-49c3-beae-99532a839aca tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/00eacc06-d58a-4a76-8ac8-2515de78f44d" status: 200 len: 1217 microversion: 2.1 time: 0.105205 Jun 10 18:02:23.179822 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 830/1608] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:23 2022] GET /compute/v2.1/servers/00eacc06-d58a-4a76-8ac8-2515de78f44d => generated 1217 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:23.261053 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-75c2b73d-38d5-434b-b4fb-e8ced86da237 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:23.262006 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-75c2b73d-38d5-434b-b4fb-e8ced86da237 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:23.292181 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-75c2b73d-38d5-434b-b4fb-e8ced86da237 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:23.292181 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-75c2b73d-38d5-434b-b4fb-e8ced86da237 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:23.292181 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-75c2b73d-38d5-434b-b4fb-e8ced86da237 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:23.296708 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-75c2b73d-38d5-434b-b4fb-e8ced86da237 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:23.475834 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-75c2b73d-38d5-434b-b4fb-e8ced86da237 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:23.482208 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-75c2b73d-38d5-434b-b4fb-e8ced86da237 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1542 microversion: 2.1 time: 0.227417 Jun 10 18:02:23.485795 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 779/1609] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:23 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1542 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:23.647248 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2024a7fe-25f0-484f-a818-ccd5a9d57da3 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:23.648142 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2024a7fe-25f0-484f-a818-ccd5a9d57da3 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:23.655041 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2024a7fe-25f0-484f-a818-ccd5a9d57da3 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:23.655747 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2024a7fe-25f0-484f-a818-ccd5a9d57da3 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:23.658014 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2024a7fe-25f0-484f-a818-ccd5a9d57da3 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:23.658014 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2024a7fe-25f0-484f-a818-ccd5a9d57da3 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:23.824695 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2024a7fe-25f0-484f-a818-ccd5a9d57da3 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:23.863211 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2024a7fe-25f0-484f-a818-ccd5a9d57da3 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:23.877114 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2024a7fe-25f0-484f-a818-ccd5a9d57da3 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:23.880509 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1d76b47d-8972-4cea-bc86-6f1ce75096d8 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:23.881788 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1d76b47d-8972-4cea-bc86-6f1ce75096d8 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:23.881927 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2024a7fe-25f0-484f-a818-ccd5a9d57da3 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.242094 Jun 10 18:02:23.898239 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 831/1610] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:23 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:23.912182 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1d76b47d-8972-4cea-bc86-6f1ce75096d8 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:23.912782 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1d76b47d-8972-4cea-bc86-6f1ce75096d8 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:23.913656 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1d76b47d-8972-4cea-bc86-6f1ce75096d8 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:23.914132 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1d76b47d-8972-4cea-bc86-6f1ce75096d8 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:24.087251 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d357e827-1726-4790-9de0-b591c20c40ef tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:24.087981 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d357e827-1726-4790-9de0-b591c20c40ef tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:24.094511 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:02:24.104812 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d357e827-1726-4790-9de0-b591c20c40ef tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:24.105709 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d357e827-1726-4790-9de0-b591c20c40ef tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:24.107425 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d357e827-1726-4790-9de0-b591c20c40ef tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:24.108099 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d357e827-1726-4790-9de0-b591c20c40ef tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:24.119157 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1d76b47d-8972-4cea-bc86-6f1ce75096d8 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:24.128738 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1d76b47d-8972-4cea-bc86-6f1ce75096d8 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1517 microversion: 2.1 time: 0.257077 Jun 10 18:02:24.129638 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 780/1611] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:23 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1517 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:24.135933 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-26133b77-a2fc-4acb-a8b2-5d8bd5fff5bd tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:24.136685 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-26133b77-a2fc-4acb-a8b2-5d8bd5fff5bd tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:24.144135 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-26133b77-a2fc-4acb-a8b2-5d8bd5fff5bd tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:24.144648 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-26133b77-a2fc-4acb-a8b2-5d8bd5fff5bd tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:24.145665 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-26133b77-a2fc-4acb-a8b2-5d8bd5fff5bd tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:24.148141 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-26133b77-a2fc-4acb-a8b2-5d8bd5fff5bd tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:24.276348 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-26133b77-a2fc-4acb-a8b2-5d8bd5fff5bd tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:24.296803 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-26133b77-a2fc-4acb-a8b2-5d8bd5fff5bd tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:24.298928 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-26133b77-a2fc-4acb-a8b2-5d8bd5fff5bd tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:24.306273 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-26133b77-a2fc-4acb-a8b2-5d8bd5fff5bd tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1447 microversion: 2.75 time: 0.175167 Jun 10 18:02:24.307695 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 781/1612] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:24 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1447 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:24.315376 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-dbc2caf4-3b9a-4f07-8fd3-ab8c494f5d74 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:24.316458 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-dbc2caf4-3b9a-4f07-8fd3-ab8c494f5d74 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: 00eacc06-d58a-4a76-8ac8-2515de78f44d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:24.324672 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dbc2caf4-3b9a-4f07-8fd3-ab8c494f5d74 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:24.326263 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dbc2caf4-3b9a-4f07-8fd3-ab8c494f5d74 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:24.327298 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dbc2caf4-3b9a-4f07-8fd3-ab8c494f5d74 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:24.328075 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dbc2caf4-3b9a-4f07-8fd3-ab8c494f5d74 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:24.344578 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d357e827-1726-4790-9de0-b591c20c40ef tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:24.361176 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d357e827-1726-4790-9de0-b591c20c40ef tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1549 microversion: 2.1 time: 0.275776 Jun 10 18:02:24.366053 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:02:24.366239 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 832/1613] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:24 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1549 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:02:24.422843 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-dbc2caf4-3b9a-4f07-8fd3-ab8c494f5d74 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63889ce9e75140bd9c730857468b7fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce8674b6db3471c8c94e809430651c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:24.435369 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-dbc2caf4-3b9a-4f07-8fd3-ab8c494f5d74 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/00eacc06-d58a-4a76-8ac8-2515de78f44d" status: 200 len: 1213 microversion: 2.1 time: 0.125838 Jun 10 18:02:24.436667 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 782/1614] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:24 2022] GET /compute/v2.1/servers/00eacc06-d58a-4a76-8ac8-2515de78f44d => generated 1213 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:24.499102 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4f56b1c2-4dd6-4d6b-bf07-29cb6ca73dd9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:24.499783 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4f56b1c2-4dd6-4d6b-bf07-29cb6ca73dd9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:24.508731 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f56b1c2-4dd6-4d6b-bf07-29cb6ca73dd9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:24.509210 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f56b1c2-4dd6-4d6b-bf07-29cb6ca73dd9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:24.510002 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f56b1c2-4dd6-4d6b-bf07-29cb6ca73dd9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:24.510448 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f56b1c2-4dd6-4d6b-bf07-29cb6ca73dd9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:24.687409 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4f56b1c2-4dd6-4d6b-bf07-29cb6ca73dd9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:24.698231 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4f56b1c2-4dd6-4d6b-bf07-29cb6ca73dd9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1542 microversion: 2.1 time: 0.202986 Jun 10 18:02:24.699567 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 833/1615] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:24 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1542 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:24.912645 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-47c51fac-e2b2-4ec0-8d37-58e0a9b5d6f7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:24.912645 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-47c51fac-e2b2-4ec0-8d37-58e0a9b5d6f7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:24.928132 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-47c51fac-e2b2-4ec0-8d37-58e0a9b5d6f7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:24.928646 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-47c51fac-e2b2-4ec0-8d37-58e0a9b5d6f7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:24.929419 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-47c51fac-e2b2-4ec0-8d37-58e0a9b5d6f7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:24.929866 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-47c51fac-e2b2-4ec0-8d37-58e0a9b5d6f7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:25.150670 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c3c1c64a-a2cb-453d-8509-13cd884de06e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:25.152518 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c3c1c64a-a2cb-453d-8509-13cd884de06e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:25.160167 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c3c1c64a-a2cb-453d-8509-13cd884de06e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:25.160821 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c3c1c64a-a2cb-453d-8509-13cd884de06e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:25.161696 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c3c1c64a-a2cb-453d-8509-13cd884de06e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:25.162545 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c3c1c64a-a2cb-453d-8509-13cd884de06e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:25.170167 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-47c51fac-e2b2-4ec0-8d37-58e0a9b5d6f7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:25.181800 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-47c51fac-e2b2-4ec0-8d37-58e0a9b5d6f7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:25.183739 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-47c51fac-e2b2-4ec0-8d37-58e0a9b5d6f7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:25.185885 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-47c51fac-e2b2-4ec0-8d37-58e0a9b5d6f7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.283461 Jun 10 18:02:25.187193 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 783/1616] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:24 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:25.324127 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c3c1c64a-a2cb-453d-8509-13cd884de06e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:25.332715 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4f00ee3f-fdee-4c04-9008-c73e2775e3ff tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:25.333122 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c3c1c64a-a2cb-453d-8509-13cd884de06e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1517 microversion: 2.1 time: 0.189887 Jun 10 18:02:25.333544 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4f00ee3f-fdee-4c04-9008-c73e2775e3ff tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:25.334866 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 834/1617] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:25 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1517 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:02:25.340402 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4f00ee3f-fdee-4c04-9008-c73e2775e3ff tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:25.341338 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4f00ee3f-fdee-4c04-9008-c73e2775e3ff tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:25.342118 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4f00ee3f-fdee-4c04-9008-c73e2775e3ff tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:25.342559 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4f00ee3f-fdee-4c04-9008-c73e2775e3ff tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:25.382527 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f19876f1-7a12-489c-82f2-ff53f0f6079b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:25.383362 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f19876f1-7a12-489c-82f2-ff53f0f6079b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:25.390081 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f19876f1-7a12-489c-82f2-ff53f0f6079b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:25.390665 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f19876f1-7a12-489c-82f2-ff53f0f6079b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:25.397972 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f19876f1-7a12-489c-82f2-ff53f0f6079b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:25.397972 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f19876f1-7a12-489c-82f2-ff53f0f6079b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:25.407984 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4f00ee3f-fdee-4c04-9008-c73e2775e3ff tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:25.421534 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4f00ee3f-fdee-4c04-9008-c73e2775e3ff tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:25.423902 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4f00ee3f-fdee-4c04-9008-c73e2775e3ff tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:25.428781 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4f00ee3f-fdee-4c04-9008-c73e2775e3ff tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1447 microversion: 2.75 time: 0.100173 Jun 10 18:02:25.459788 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 784/1618] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:25 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1447 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:02:25.464895 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-53559c44-1c28-477e-b755-e8a6735a3776 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:25.466590 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-53559c44-1c28-477e-b755-e8a6735a3776 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: 00eacc06-d58a-4a76-8ac8-2515de78f44d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:25.475737 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-53559c44-1c28-477e-b755-e8a6735a3776 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:25.476202 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-53559c44-1c28-477e-b755-e8a6735a3776 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:25.477020 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-53559c44-1c28-477e-b755-e8a6735a3776 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:25.477467 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-53559c44-1c28-477e-b755-e8a6735a3776 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:25.539949 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-53559c44-1c28-477e-b755-e8a6735a3776 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63889ce9e75140bd9c730857468b7fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce8674b6db3471c8c94e809430651c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:25.549562 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-53559c44-1c28-477e-b755-e8a6735a3776 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/00eacc06-d58a-4a76-8ac8-2515de78f44d" status: 200 len: 1269 microversion: 2.1 time: 0.088472 Jun 10 18:02:25.558745 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 785/1619] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:25 2022] GET /compute/v2.1/servers/00eacc06-d58a-4a76-8ac8-2515de78f44d => generated 1269 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:25.559081 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f19876f1-7a12-489c-82f2-ff53f0f6079b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:25.564394 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f19876f1-7a12-489c-82f2-ff53f0f6079b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1549 microversion: 2.1 time: 0.185776 Jun 10 18:02:25.564974 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 835/1620] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:25 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1549 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:25.716415 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-aaae98b8-ba90-426d-99db-94246a370d3c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:25.717390 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-aaae98b8-ba90-426d-99db-94246a370d3c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:25.725397 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aaae98b8-ba90-426d-99db-94246a370d3c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:25.726277 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aaae98b8-ba90-426d-99db-94246a370d3c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:25.727944 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aaae98b8-ba90-426d-99db-94246a370d3c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:25.728631 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aaae98b8-ba90-426d-99db-94246a370d3c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:26.023668 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-aaae98b8-ba90-426d-99db-94246a370d3c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:26.043393 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-aaae98b8-ba90-426d-99db-94246a370d3c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1542 microversion: 2.1 time: 0.331760 Jun 10 18:02:26.046683 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 786/1621] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:25 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1542 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:02:26.210603 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3a595442-f0db-4902-b0d5-174f925428dc tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:26.211455 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3a595442-f0db-4902-b0d5-174f925428dc tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:26.224744 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3a595442-f0db-4902-b0d5-174f925428dc tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:26.227281 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3a595442-f0db-4902-b0d5-174f925428dc tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:26.233577 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3a595442-f0db-4902-b0d5-174f925428dc tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:26.234894 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3a595442-f0db-4902-b0d5-174f925428dc tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:26.351211 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b9f58d73-70cb-4168-b157-63ae558bd16e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:26.355864 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b9f58d73-70cb-4168-b157-63ae558bd16e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:26.359832 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9f58d73-70cb-4168-b157-63ae558bd16e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:26.364650 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9f58d73-70cb-4168-b157-63ae558bd16e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:26.366595 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9f58d73-70cb-4168-b157-63ae558bd16e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:26.368840 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9f58d73-70cb-4168-b157-63ae558bd16e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:26.542304 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3a595442-f0db-4902-b0d5-174f925428dc tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:26.558575 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3a595442-f0db-4902-b0d5-174f925428dc tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:26.566373 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3a595442-f0db-4902-b0d5-174f925428dc tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:26.568958 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3a595442-f0db-4902-b0d5-174f925428dc tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.366576 Jun 10 18:02:26.569894 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 836/1622] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:26 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:26.585519 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e2dbb951-6a97-413d-964c-9fcd756ce94a tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:26.592016 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e2dbb951-6a97-413d-964c-9fcd756ce94a tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:26.608961 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e2dbb951-6a97-413d-964c-9fcd756ce94a tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:26.610397 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e2dbb951-6a97-413d-964c-9fcd756ce94a tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:26.612550 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e2dbb951-6a97-413d-964c-9fcd756ce94a tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:26.613045 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e2dbb951-6a97-413d-964c-9fcd756ce94a tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:26.698895 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b9f58d73-70cb-4168-b157-63ae558bd16e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:26.716986 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b9f58d73-70cb-4168-b157-63ae558bd16e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1517 microversion: 2.1 time: 0.366340 Jun 10 18:02:26.716986 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 787/1623] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:26 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1517 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:26.724623 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6b817210-731f-4b36-8ad7-266c8c012dfa tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:26.726162 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6b817210-731f-4b36-8ad7-266c8c012dfa tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: 00eacc06-d58a-4a76-8ac8-2515de78f44d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:26.734233 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6b817210-731f-4b36-8ad7-266c8c012dfa tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:26.748601 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6b817210-731f-4b36-8ad7-266c8c012dfa tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:26.748601 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6b817210-731f-4b36-8ad7-266c8c012dfa tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:26.748601 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6b817210-731f-4b36-8ad7-266c8c012dfa tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:26.753526 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e2dbb951-6a97-413d-964c-9fcd756ce94a tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:26.762624 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e2dbb951-6a97-413d-964c-9fcd756ce94a tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:26.764853 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e2dbb951-6a97-413d-964c-9fcd756ce94a tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:26.770559 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e2dbb951-6a97-413d-964c-9fcd756ce94a tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1447 microversion: 2.75 time: 0.199075 Jun 10 18:02:26.783842 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 837/1624] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:26 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1447 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:26.788727 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-67688535-2901-493e-9bea-8b6fbce96ea0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:26.795662 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-67688535-2901-493e-9bea-8b6fbce96ea0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:26.806875 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-67688535-2901-493e-9bea-8b6fbce96ea0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:26.807346 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-67688535-2901-493e-9bea-8b6fbce96ea0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:26.808882 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-67688535-2901-493e-9bea-8b6fbce96ea0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:26.812202 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-67688535-2901-493e-9bea-8b6fbce96ea0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:26.838367 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6b817210-731f-4b36-8ad7-266c8c012dfa tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63889ce9e75140bd9c730857468b7fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce8674b6db3471c8c94e809430651c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:26.850232 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6b817210-731f-4b36-8ad7-266c8c012dfa tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/00eacc06-d58a-4a76-8ac8-2515de78f44d" status: 200 len: 1275 microversion: 2.1 time: 0.133836 Jun 10 18:02:26.851788 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 788/1625] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:26 2022] GET /compute/v2.1/servers/00eacc06-d58a-4a76-8ac8-2515de78f44d => generated 1275 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:27.000836 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-67688535-2901-493e-9bea-8b6fbce96ea0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:27.010472 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-67688535-2901-493e-9bea-8b6fbce96ea0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1549 microversion: 2.1 time: 0.224962 Jun 10 18:02:27.010947 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 838/1626] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:26 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1549 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:27.062303 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7676997b-f354-4888-8766-fe3967f482af tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:27.063229 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7676997b-f354-4888-8766-fe3967f482af tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:27.067664 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:02:27.082418 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7676997b-f354-4888-8766-fe3967f482af tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:27.082418 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7676997b-f354-4888-8766-fe3967f482af tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:27.082418 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7676997b-f354-4888-8766-fe3967f482af tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:27.082418 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7676997b-f354-4888-8766-fe3967f482af tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:27.554168 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7676997b-f354-4888-8766-fe3967f482af tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:27.564038 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7676997b-f354-4888-8766-fe3967f482af tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1542 microversion: 2.1 time: 0.505425 Jun 10 18:02:27.565564 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 789/1627] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:27 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1542 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:27.593681 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a94985c7-5e50-4fd7-92d7-67c9d4a51f11 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:27.594289 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a94985c7-5e50-4fd7-92d7-67c9d4a51f11 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:27.636889 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a94985c7-5e50-4fd7-92d7-67c9d4a51f11 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:27.641878 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a94985c7-5e50-4fd7-92d7-67c9d4a51f11 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:27.642639 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a94985c7-5e50-4fd7-92d7-67c9d4a51f11 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:27.643261 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a94985c7-5e50-4fd7-92d7-67c9d4a51f11 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:27.742917 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7fcaddc1-88ab-49a2-bcce-bf76a4d325bf tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:27.743787 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7fcaddc1-88ab-49a2-bcce-bf76a4d325bf tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:27.753496 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7fcaddc1-88ab-49a2-bcce-bf76a4d325bf tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:27.753496 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7fcaddc1-88ab-49a2-bcce-bf76a4d325bf tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:27.753496 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7fcaddc1-88ab-49a2-bcce-bf76a4d325bf tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:27.753496 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7fcaddc1-88ab-49a2-bcce-bf76a4d325bf tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:27.957818 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a94985c7-5e50-4fd7-92d7-67c9d4a51f11 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:27.966905 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a94985c7-5e50-4fd7-92d7-67c9d4a51f11 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:27.968560 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a94985c7-5e50-4fd7-92d7-67c9d4a51f11 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:27.970507 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a94985c7-5e50-4fd7-92d7-67c9d4a51f11 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.387474 Jun 10 18:02:27.971180 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 839/1628] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:27 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:27.976948 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7fcaddc1-88ab-49a2-bcce-bf76a4d325bf tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:27.979881 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2b7d4b7d-915b-4388-9db1-db5da08e8ab6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:27.980715 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2b7d4b7d-915b-4388-9db1-db5da08e8ab6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:27.987821 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2b7d4b7d-915b-4388-9db1-db5da08e8ab6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:27.988404 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2b7d4b7d-915b-4388-9db1-db5da08e8ab6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:27.988967 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7fcaddc1-88ab-49a2-bcce-bf76a4d325bf tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.249847 Jun 10 18:02:27.989402 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2b7d4b7d-915b-4388-9db1-db5da08e8ab6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:27.989866 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 790/1629] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:27 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:27.991622 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2b7d4b7d-915b-4388-9db1-db5da08e8ab6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:27.994895 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a8c6759f-9aac-418c-8fa0-a35667876e6e tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:27.995476 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a8c6759f-9aac-418c-8fa0-a35667876e6e tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:28.002402 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a8c6759f-9aac-418c-8fa0-a35667876e6e tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:28.003058 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a8c6759f-9aac-418c-8fa0-a35667876e6e tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:28.003908 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a8c6759f-9aac-418c-8fa0-a35667876e6e tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:28.004326 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a8c6759f-9aac-418c-8fa0-a35667876e6e tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:28.091834 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a8c6759f-9aac-418c-8fa0-a35667876e6e tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:28.103070 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a8c6759f-9aac-418c-8fa0-a35667876e6e tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:28.105832 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a8c6759f-9aac-418c-8fa0-a35667876e6e tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:28.112233 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a8c6759f-9aac-418c-8fa0-a35667876e6e tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1447 microversion: 2.75 time: 0.121230 Jun 10 18:02:28.113393 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 791/1630] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:27 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1447 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:28.119395 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b89755de-5632-4351-918a-4f14d966cbdd tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:28.119964 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b89755de-5632-4351-918a-4f14d966cbdd tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: 00eacc06-d58a-4a76-8ac8-2515de78f44d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:28.127462 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b89755de-5632-4351-918a-4f14d966cbdd tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:28.128137 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b89755de-5632-4351-918a-4f14d966cbdd tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:28.129095 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b89755de-5632-4351-918a-4f14d966cbdd tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:28.129686 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b89755de-5632-4351-918a-4f14d966cbdd tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:28.321985 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2b7d4b7d-915b-4388-9db1-db5da08e8ab6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:28.324358 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b89755de-5632-4351-918a-4f14d966cbdd tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63889ce9e75140bd9c730857468b7fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce8674b6db3471c8c94e809430651c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:28.342843 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2b7d4b7d-915b-4388-9db1-db5da08e8ab6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1517 microversion: 2.1 time: 0.360198 Jun 10 18:02:28.342843 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 840/1631] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:27 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1517 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:28.347406 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-34ed369f-e7d6-4e80-8174-88f2a78ace59 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-677532723"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:02:28.348349 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b89755de-5632-4351-918a-4f14d966cbdd tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/00eacc06-d58a-4a76-8ac8-2515de78f44d" status: 200 len: 1317 microversion: 2.1 time: 0.233519 Jun 10 18:02:28.349481 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-34ed369f-e7d6-4e80-8174-88f2a78ace59 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:28.357033 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 792/1632] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:28 2022] GET /compute/v2.1/servers/00eacc06-d58a-4a76-8ac8-2515de78f44d => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:28.358565 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-34ed369f-e7d6-4e80-8174-88f2a78ace59 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:28.359519 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-34ed369f-e7d6-4e80-8174-88f2a78ace59 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:28.360540 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-34ed369f-e7d6-4e80-8174-88f2a78ace59 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:28.361100 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-34ed369f-e7d6-4e80-8174-88f2a78ace59 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:28.362729 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d49c9712-b1fa-484d-9bfb-17a21b7737e6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:28.363344 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d49c9712-b1fa-484d-9bfb-17a21b7737e6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:28.372476 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d49c9712-b1fa-484d-9bfb-17a21b7737e6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:28.373466 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d49c9712-b1fa-484d-9bfb-17a21b7737e6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:28.374447 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d49c9712-b1fa-484d-9bfb-17a21b7737e6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:28.375319 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d49c9712-b1fa-484d-9bfb-17a21b7737e6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:28.566594 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d49c9712-b1fa-484d-9bfb-17a21b7737e6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:28.575064 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d49c9712-b1fa-484d-9bfb-17a21b7737e6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1549 microversion: 2.1 time: 0.216714 Jun 10 18:02:28.576640 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 793/1633] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:28 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1549 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:28.581959 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-842e3833-d211-445f-9d81-ae04d37372bf tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:28.582599 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-842e3833-d211-445f-9d81-ae04d37372bf tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:28.592912 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-842e3833-d211-445f-9d81-ae04d37372bf tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:28.592912 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-842e3833-d211-445f-9d81-ae04d37372bf tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:28.592912 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-842e3833-d211-445f-9d81-ae04d37372bf tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:28.592912 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-842e3833-d211-445f-9d81-ae04d37372bf tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:28.817009 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-842e3833-d211-445f-9d81-ae04d37372bf tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:28.831208 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-842e3833-d211-445f-9d81-ae04d37372bf tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1542 microversion: 2.1 time: 0.252576 Jun 10 18:02:28.857775 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 794/1634] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:28 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1542 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:28.875888 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-fab89835-96fa-4b71-bdfe-2058e7b2e95e req-4445697f-5794-4cd1-8652-5a072364ea63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00eacc06-d58a-4a76-8ac8-2515de78f44d", "tag": "276c472d-da12-416e-ac34-c63ed6266e5c"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:02:28.894570 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-fab89835-96fa-4b71-bdfe-2058e7b2e95e req-4445697f-5794-4cd1-8652-5a072364ea63 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:28.895467 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-fab89835-96fa-4b71-bdfe-2058e7b2e95e req-4445697f-5794-4cd1-8652-5a072364ea63 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:28.911017 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-fab89835-96fa-4b71-bdfe-2058e7b2e95e req-4445697f-5794-4cd1-8652-5a072364ea63 service nova] Creating event network-changed:276c472d-da12-416e-ac34-c63ed6266e5c for instance 00eacc06-d58a-4a76-8ac8-2515de78f44d on chh1-master-2 Jun 10 18:02:28.918194 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-fab89835-96fa-4b71-bdfe-2058e7b2e95e req-4445697f-5794-4cd1-8652-5a072364ea63 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057272 Jun 10 18:02:28.918194 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 795/1635] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:02:28.989694 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8b6e931f-40cf-491e-b548-3197bb2f032c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:28.990645 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8b6e931f-40cf-491e-b548-3197bb2f032c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:28.997433 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8b6e931f-40cf-491e-b548-3197bb2f032c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:28.998012 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8b6e931f-40cf-491e-b548-3197bb2f032c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:28.998853 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8b6e931f-40cf-491e-b548-3197bb2f032c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:28.999784 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8b6e931f-40cf-491e-b548-3197bb2f032c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:29.051732 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-34ed369f-e7d6-4e80-8174-88f2a78ace59 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "POST /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1/action" status: 202 len: 0 microversion: 2.1 time: 0.717094 Jun 10 18:02:29.052658 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 841/1636] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:02:28 2022] POST /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1/action => generated 0 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jun 10 18:02:29.061995 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-eeaa5545-7302-42a3-b217-4f868b269b72 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:29.062976 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-eeaa5545-7302-42a3-b217-4f868b269b72 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:29.072153 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eeaa5545-7302-42a3-b217-4f868b269b72 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:29.072655 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eeaa5545-7302-42a3-b217-4f868b269b72 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:29.074702 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eeaa5545-7302-42a3-b217-4f868b269b72 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:29.075941 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eeaa5545-7302-42a3-b217-4f868b269b72 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:29.273121 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8b6e931f-40cf-491e-b548-3197bb2f032c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:29.284838 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8b6e931f-40cf-491e-b548-3197bb2f032c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:29.290265 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8b6e931f-40cf-491e-b548-3197bb2f032c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:29.291411 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8b6e931f-40cf-491e-b548-3197bb2f032c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.307073 Jun 10 18:02:29.291988 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 796/1637] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:28 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:02:29.318643 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-98b7dca8-be84-4ecc-990a-f7b3415b1464 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:29.319521 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-98b7dca8-be84-4ecc-990a-f7b3415b1464 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:29.327400 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-98b7dca8-be84-4ecc-990a-f7b3415b1464 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:29.327862 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-98b7dca8-be84-4ecc-990a-f7b3415b1464 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:29.328671 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-98b7dca8-be84-4ecc-990a-f7b3415b1464 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:29.329121 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-98b7dca8-be84-4ecc-990a-f7b3415b1464 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:29.410365 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-98b7dca8-be84-4ecc-990a-f7b3415b1464 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:29.420199 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-98b7dca8-be84-4ecc-990a-f7b3415b1464 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:29.422378 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-98b7dca8-be84-4ecc-990a-f7b3415b1464 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:29.428918 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-eeaa5545-7302-42a3-b217-4f868b269b72 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:29.444254 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-eeaa5545-7302-42a3-b217-4f868b269b72 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1678 microversion: 2.1 time: 0.383823 Jun 10 18:02:29.454788 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-98b7dca8-be84-4ecc-990a-f7b3415b1464 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1447 microversion: 2.75 time: 0.141204 Jun 10 18:02:29.460031 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 842/1638] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:29 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1678 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:02:29.460298 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 797/1639] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:29 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1447 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:29.475008 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2ac4c604-fb50-4d9d-a3db-9df44a54c011 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:29.476161 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2ac4c604-fb50-4d9d-a3db-9df44a54c011 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: 00eacc06-d58a-4a76-8ac8-2515de78f44d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:29.476424 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d14b6d6a-0416-4318-96d0-108fe3112be9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:29.477234 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d14b6d6a-0416-4318-96d0-108fe3112be9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:29.483686 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2ac4c604-fb50-4d9d-a3db-9df44a54c011 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:29.484491 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2ac4c604-fb50-4d9d-a3db-9df44a54c011 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:29.485154 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d14b6d6a-0416-4318-96d0-108fe3112be9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:29.485958 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2ac4c604-fb50-4d9d-a3db-9df44a54c011 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:29.486177 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d14b6d6a-0416-4318-96d0-108fe3112be9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:29.486409 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2ac4c604-fb50-4d9d-a3db-9df44a54c011 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:29.487813 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d14b6d6a-0416-4318-96d0-108fe3112be9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:29.488493 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d14b6d6a-0416-4318-96d0-108fe3112be9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:29.774200 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2ac4c604-fb50-4d9d-a3db-9df44a54c011 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63889ce9e75140bd9c730857468b7fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce8674b6db3471c8c94e809430651c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:29.792123 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2ac4c604-fb50-4d9d-a3db-9df44a54c011 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/00eacc06-d58a-4a76-8ac8-2515de78f44d" status: 200 len: 1317 microversion: 2.1 time: 0.331095 Jun 10 18:02:29.800753 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 798/1640] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:29 2022] GET /compute/v2.1/servers/00eacc06-d58a-4a76-8ac8-2515de78f44d => generated 1317 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:29.801706 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a214ab1a-4543-4257-84c6-bf80a50d4c95 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:29.802729 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a214ab1a-4543-4257-84c6-bf80a50d4c95 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:29.820865 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a214ab1a-4543-4257-84c6-bf80a50d4c95 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:29.821524 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a214ab1a-4543-4257-84c6-bf80a50d4c95 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:29.822472 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a214ab1a-4543-4257-84c6-bf80a50d4c95 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:29.822995 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a214ab1a-4543-4257-84c6-bf80a50d4c95 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:29.850407 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:02:30.061563 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d14b6d6a-0416-4318-96d0-108fe3112be9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:30.068866 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d14b6d6a-0416-4318-96d0-108fe3112be9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1523 microversion: 2.1 time: 0.612155 Jun 10 18:02:30.069434 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 843/1641] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:29 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1523 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:30.074202 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b0169ebd-76ab-47fe-8851-948124579b5e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:30.074825 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b0169ebd-76ab-47fe-8851-948124579b5e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:30.084488 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b0169ebd-76ab-47fe-8851-948124579b5e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:30.084488 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b0169ebd-76ab-47fe-8851-948124579b5e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:30.084729 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a214ab1a-4543-4257-84c6-bf80a50d4c95 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:30.084846 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b0169ebd-76ab-47fe-8851-948124579b5e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:30.084846 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b0169ebd-76ab-47fe-8851-948124579b5e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:30.092234 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a214ab1a-4543-4257-84c6-bf80a50d4c95 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1549 microversion: 2.1 time: 0.297162 Jun 10 18:02:30.092806 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 799/1642] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:29 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1549 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:30.225025 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b0169ebd-76ab-47fe-8851-948124579b5e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:30.233723 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b0169ebd-76ab-47fe-8851-948124579b5e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1542 microversion: 2.1 time: 0.162992 Jun 10 18:02:30.234301 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 844/1643] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:30 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1542 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:30.309791 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c0c7cbcd-3bc6-4e3c-bceb-b33412380176 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:30.310409 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c0c7cbcd-3bc6-4e3c-bceb-b33412380176 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:30.316998 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c0c7cbcd-3bc6-4e3c-bceb-b33412380176 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:30.317691 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c0c7cbcd-3bc6-4e3c-bceb-b33412380176 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:30.318673 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c0c7cbcd-3bc6-4e3c-bceb-b33412380176 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:30.319114 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c0c7cbcd-3bc6-4e3c-bceb-b33412380176 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:30.467116 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9227915d-82a3-4ce8-9de4-30dfeb7d0a91 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:30.470661 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9227915d-82a3-4ce8-9de4-30dfeb7d0a91 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:30.478337 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9227915d-82a3-4ce8-9de4-30dfeb7d0a91 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:30.479037 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9227915d-82a3-4ce8-9de4-30dfeb7d0a91 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:30.480147 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9227915d-82a3-4ce8-9de4-30dfeb7d0a91 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:30.480932 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9227915d-82a3-4ce8-9de4-30dfeb7d0a91 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:30.495312 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c0c7cbcd-3bc6-4e3c-bceb-b33412380176 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:30.506970 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:02:30.510728 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c0c7cbcd-3bc6-4e3c-bceb-b33412380176 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:30.514721 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c0c7cbcd-3bc6-4e3c-bceb-b33412380176 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:30.516582 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c0c7cbcd-3bc6-4e3c-bceb-b33412380176 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.211079 Jun 10 18:02:30.517788 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 800/1644] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:30 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:30.526328 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-eb9666bb-a726-401f-a60c-cbbb77555734 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:30.527375 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-eb9666bb-a726-401f-a60c-cbbb77555734 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:30.538590 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eb9666bb-a726-401f-a60c-cbbb77555734 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:30.539385 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eb9666bb-a726-401f-a60c-cbbb77555734 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:30.541018 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eb9666bb-a726-401f-a60c-cbbb77555734 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:30.541871 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eb9666bb-a726-401f-a60c-cbbb77555734 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:30.671836 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-eb9666bb-a726-401f-a60c-cbbb77555734 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:30.686477 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-eb9666bb-a726-401f-a60c-cbbb77555734 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:30.692618 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-eb9666bb-a726-401f-a60c-cbbb77555734 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:30.705157 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-eb9666bb-a726-401f-a60c-cbbb77555734 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1447 microversion: 2.75 time: 0.186077 Jun 10 18:02:30.705758 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 801/1645] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:30 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1447 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:30.723358 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-2a6d8a6f-28af-4dbe-a5c3-fe911dee378b req-fcea0b9d-0f5c-4ae4-b068-c45e32e32bdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "186b67b3-3538-4bc2-8528-53b43d701bf1", "name": "network-vif-unplugged", "status": "completed", "tag": "128ee4eb-e784-41c8-acaa-39291810b2a4"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:02:30.738834 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-2a6d8a6f-28af-4dbe-a5c3-fe911dee378b req-fcea0b9d-0f5c-4ae4-b068-c45e32e32bdb service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:30.739297 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-2a6d8a6f-28af-4dbe-a5c3-fe911dee378b req-fcea0b9d-0f5c-4ae4-b068-c45e32e32bdb service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:30.768088 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9227915d-82a3-4ce8-9de4-30dfeb7d0a91 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:30.770158 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-2a6d8a6f-28af-4dbe-a5c3-fe911dee378b req-fcea0b9d-0f5c-4ae4-b068-c45e32e32bdb service nova] Creating event network-vif-unplugged:128ee4eb-e784-41c8-acaa-39291810b2a4 for instance 186b67b3-3538-4bc2-8528-53b43d701bf1 on chh1-master-2 Jun 10 18:02:30.778026 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-2a6d8a6f-28af-4dbe-a5c3-fe911dee378b req-fcea0b9d-0f5c-4ae4-b068-c45e32e32bdb service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065994 Jun 10 18:02:30.778288 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9227915d-82a3-4ce8-9de4-30dfeb7d0a91 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1678 microversion: 2.1 time: 0.314935 Jun 10 18:02:30.779316 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 845/1646] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:30 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1678 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:30.785697 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 802/1647] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:02:30.811363 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e24daa08-4115-4c2f-a959-aa9aee85e61a tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:30.812281 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e24daa08-4115-4c2f-a959-aa9aee85e61a tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: 00eacc06-d58a-4a76-8ac8-2515de78f44d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:30.819857 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e24daa08-4115-4c2f-a959-aa9aee85e61a tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:30.820540 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e24daa08-4115-4c2f-a959-aa9aee85e61a tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:30.821749 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e24daa08-4115-4c2f-a959-aa9aee85e61a tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:30.822362 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e24daa08-4115-4c2f-a959-aa9aee85e61a tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:30.968674 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e24daa08-4115-4c2f-a959-aa9aee85e61a tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63889ce9e75140bd9c730857468b7fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce8674b6db3471c8c94e809430651c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:30.979895 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e24daa08-4115-4c2f-a959-aa9aee85e61a tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/00eacc06-d58a-4a76-8ac8-2515de78f44d" status: 200 len: 1317 microversion: 2.1 time: 0.172266 Jun 10 18:02:30.980747 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 846/1648] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:30 2022] GET /compute/v2.1/servers/00eacc06-d58a-4a76-8ac8-2515de78f44d => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:31.088017 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7f094ab3-2958-48ee-b3bd-0cd3531a1d6a tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:31.088956 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7f094ab3-2958-48ee-b3bd-0cd3531a1d6a tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:31.096200 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7f094ab3-2958-48ee-b3bd-0cd3531a1d6a tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:31.097071 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7f094ab3-2958-48ee-b3bd-0cd3531a1d6a tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:31.098247 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7f094ab3-2958-48ee-b3bd-0cd3531a1d6a tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:31.098912 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7f094ab3-2958-48ee-b3bd-0cd3531a1d6a tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:31.110808 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8ddc14ef-c0a7-40f0-8c34-fcca6851b072 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:31.111654 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8ddc14ef-c0a7-40f0-8c34-fcca6851b072 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:31.127016 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8ddc14ef-c0a7-40f0-8c34-fcca6851b072 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:31.128758 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8ddc14ef-c0a7-40f0-8c34-fcca6851b072 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:31.131141 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8ddc14ef-c0a7-40f0-8c34-fcca6851b072 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:31.133033 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8ddc14ef-c0a7-40f0-8c34-fcca6851b072 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:31.414872 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7f094ab3-2958-48ee-b3bd-0cd3531a1d6a tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:31.424989 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7f094ab3-2958-48ee-b3bd-0cd3531a1d6a tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1523 microversion: 2.1 time: 0.342790 Jun 10 18:02:31.425755 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 803/1649] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:31 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1523 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:31.431401 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b3753a77-931b-42d2-ac90-d82950ec3714 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:31.432217 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b3753a77-931b-42d2-ac90-d82950ec3714 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:31.439769 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b3753a77-931b-42d2-ac90-d82950ec3714 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:31.440693 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b3753a77-931b-42d2-ac90-d82950ec3714 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:31.441633 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b3753a77-931b-42d2-ac90-d82950ec3714 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:31.442329 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b3753a77-931b-42d2-ac90-d82950ec3714 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:31.568170 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8ddc14ef-c0a7-40f0-8c34-fcca6851b072 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:31.578326 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8ddc14ef-c0a7-40f0-8c34-fcca6851b072 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1549 microversion: 2.1 time: 0.472801 Jun 10 18:02:31.579717 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 847/1650] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:31 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1549 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:31.585937 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fcc36ec7-f98e-4b55-bf65-d8025757104d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:31.586863 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fcc36ec7-f98e-4b55-bf65-d8025757104d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:31.596396 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fcc36ec7-f98e-4b55-bf65-d8025757104d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:31.597210 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fcc36ec7-f98e-4b55-bf65-d8025757104d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:31.599745 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fcc36ec7-f98e-4b55-bf65-d8025757104d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:31.600588 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fcc36ec7-f98e-4b55-bf65-d8025757104d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:31.682389 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b3753a77-931b-42d2-ac90-d82950ec3714 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:31.694967 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b3753a77-931b-42d2-ac90-d82950ec3714 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1542 microversion: 2.1 time: 0.267826 Jun 10 18:02:31.695817 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 804/1651] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:31 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1542 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:31.725157 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4137ff5a-59c5-4ceb-865f-2cc37e36361e tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:31.725950 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4137ff5a-59c5-4ceb-865f-2cc37e36361e tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:31.735285 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4137ff5a-59c5-4ceb-865f-2cc37e36361e tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:31.736189 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4137ff5a-59c5-4ceb-865f-2cc37e36361e tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:31.737252 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4137ff5a-59c5-4ceb-865f-2cc37e36361e tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:31.737898 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4137ff5a-59c5-4ceb-865f-2cc37e36361e tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:31.816558 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4137ff5a-59c5-4ceb-865f-2cc37e36361e tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:31.829466 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4137ff5a-59c5-4ceb-865f-2cc37e36361e tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:31.832630 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4137ff5a-59c5-4ceb-865f-2cc37e36361e tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:31.840145 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4137ff5a-59c5-4ceb-865f-2cc37e36361e tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1447 microversion: 2.75 time: 0.118525 Jun 10 18:02:31.843080 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 805/1652] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:31 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1447 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:02:31.849074 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fcc36ec7-f98e-4b55-bf65-d8025757104d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:31.850177 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-81bfe0ff-bd9a-4580-a541-f754e2cfb3c7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:31.851234 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-81bfe0ff-bd9a-4580-a541-f754e2cfb3c7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:31.861931 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fcc36ec7-f98e-4b55-bf65-d8025757104d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:31.862681 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-81bfe0ff-bd9a-4580-a541-f754e2cfb3c7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:31.863502 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fcc36ec7-f98e-4b55-bf65-d8025757104d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:31.864078 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-81bfe0ff-bd9a-4580-a541-f754e2cfb3c7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:31.865126 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-81bfe0ff-bd9a-4580-a541-f754e2cfb3c7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:31.865889 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-81bfe0ff-bd9a-4580-a541-f754e2cfb3c7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:31.869984 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fcc36ec7-f98e-4b55-bf65-d8025757104d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.288933 Jun 10 18:02:31.880413 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 848/1653] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:31 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:31.998020 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d4efd6da-3b11-4352-8077-3e4b1d62796a tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:31.999602 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d4efd6da-3b11-4352-8077-3e4b1d62796a tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: 00eacc06-d58a-4a76-8ac8-2515de78f44d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:32.007767 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d4efd6da-3b11-4352-8077-3e4b1d62796a tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:32.008230 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d4efd6da-3b11-4352-8077-3e4b1d62796a tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:32.009130 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d4efd6da-3b11-4352-8077-3e4b1d62796a tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:32.009580 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d4efd6da-3b11-4352-8077-3e4b1d62796a tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:32.172936 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d4efd6da-3b11-4352-8077-3e4b1d62796a tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63889ce9e75140bd9c730857468b7fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce8674b6db3471c8c94e809430651c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:32.182788 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d4efd6da-3b11-4352-8077-3e4b1d62796a tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/00eacc06-d58a-4a76-8ac8-2515de78f44d" status: 200 len: 1317 microversion: 2.1 time: 0.188102 Jun 10 18:02:32.183515 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 849/1654] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:31 2022] GET /compute/v2.1/servers/00eacc06-d58a-4a76-8ac8-2515de78f44d => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:02:32.385316 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-81bfe0ff-bd9a-4580-a541-f754e2cfb3c7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:32.403065 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-81bfe0ff-bd9a-4580-a541-f754e2cfb3c7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1686 microversion: 2.1 time: 0.557250 Jun 10 18:02:32.403885 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 806/1655] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:31 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1686 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:32.443607 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7b387b72-dd7e-4746-ba58-15480795e1c6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:32.444773 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7b387b72-dd7e-4746-ba58-15480795e1c6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:32.451679 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b387b72-dd7e-4746-ba58-15480795e1c6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:32.452432 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b387b72-dd7e-4746-ba58-15480795e1c6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:32.453420 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b387b72-dd7e-4746-ba58-15480795e1c6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:32.453965 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b387b72-dd7e-4746-ba58-15480795e1c6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:32.608012 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9f2f4c68-bbbf-47ca-9330-798fff206cec tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:32.608819 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9f2f4c68-bbbf-47ca-9330-798fff206cec tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:32.620529 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7b387b72-dd7e-4746-ba58-15480795e1c6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:32.631665 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7b387b72-dd7e-4746-ba58-15480795e1c6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1523 microversion: 2.1 time: 0.192523 Jun 10 18:02:32.632260 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 850/1656] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:32 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1523 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:32.634070 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9f2f4c68-bbbf-47ca-9330-798fff206cec tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:32.635311 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9f2f4c68-bbbf-47ca-9330-798fff206cec tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:32.636299 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9f2f4c68-bbbf-47ca-9330-798fff206cec tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:32.636773 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9f2f4c68-bbbf-47ca-9330-798fff206cec tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:32.679478 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:02:32.707010 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=6 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:02:32.711784 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6d300387-baf1-46bd-b50b-21e51712b79c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:32.712424 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6d300387-baf1-46bd-b50b-21e51712b79c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:32.725926 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d300387-baf1-46bd-b50b-21e51712b79c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:32.726857 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d300387-baf1-46bd-b50b-21e51712b79c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:32.727819 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d300387-baf1-46bd-b50b-21e51712b79c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:32.728641 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d300387-baf1-46bd-b50b-21e51712b79c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:32.887484 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9f2f4c68-bbbf-47ca-9330-798fff206cec tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:32.904771 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9f2f4c68-bbbf-47ca-9330-798fff206cec tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1549 microversion: 2.1 time: 0.302639 Jun 10 18:02:32.906990 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 807/1657] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:32 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1549 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:02:32.917320 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-916f9d36-1d07-4967-8b88-6ebe8728b16a req-29c2af04-9032-4d3f-8b8e-85d9e1e90c3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4", "name": "network-vif-unplugged", "status": "completed", "tag": "d492be44-5990-4f08-b390-1c1031db44f7"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:02:32.927701 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-916f9d36-1d07-4967-8b88-6ebe8728b16a req-29c2af04-9032-4d3f-8b8e-85d9e1e90c3a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:32.928159 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-916f9d36-1d07-4967-8b88-6ebe8728b16a req-29c2af04-9032-4d3f-8b8e-85d9e1e90c3a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:32.941282 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-916f9d36-1d07-4967-8b88-6ebe8728b16a req-29c2af04-9032-4d3f-8b8e-85d9e1e90c3a service nova] Creating event network-vif-unplugged:d492be44-5990-4f08-b390-1c1031db44f7 for instance ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 on chh2-master-2 Jun 10 18:02:32.947443 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-916f9d36-1d07-4967-8b88-6ebe8728b16a req-29c2af04-9032-4d3f-8b8e-85d9e1e90c3a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037742 Jun 10 18:02:32.948603 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 808/1658] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:02:32.955960 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-93791c10-75a9-473b-a580-dff691bf1674 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:32.956130 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-93791c10-75a9-473b-a580-dff691bf1674 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:32.963475 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-93791c10-75a9-473b-a580-dff691bf1674 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:32.964183 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-93791c10-75a9-473b-a580-dff691bf1674 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:32.966100 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-93791c10-75a9-473b-a580-dff691bf1674 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:32.966731 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-93791c10-75a9-473b-a580-dff691bf1674 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:33.070857 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-93791c10-75a9-473b-a580-dff691bf1674 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:33.101381 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-93791c10-75a9-473b-a580-dff691bf1674 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:33.102872 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-93791c10-75a9-473b-a580-dff691bf1674 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:33.115290 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-93791c10-75a9-473b-a580-dff691bf1674 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1447 microversion: 2.75 time: 0.165381 Jun 10 18:02:33.116268 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 809/1659] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:32 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1447 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:33.125034 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-17d35aac-4906-4bc4-a41a-fd76ba3520c2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:33.126736 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-17d35aac-4906-4bc4-a41a-fd76ba3520c2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:33.135039 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-17d35aac-4906-4bc4-a41a-fd76ba3520c2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:33.136076 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-17d35aac-4906-4bc4-a41a-fd76ba3520c2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:33.137378 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-17d35aac-4906-4bc4-a41a-fd76ba3520c2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:33.138024 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-17d35aac-4906-4bc4-a41a-fd76ba3520c2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:33.175426 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:02:33.368242 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-17d35aac-4906-4bc4-a41a-fd76ba3520c2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:33.380996 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-17d35aac-4906-4bc4-a41a-fd76ba3520c2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:33.384578 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-17d35aac-4906-4bc4-a41a-fd76ba3520c2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:33.386605 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-17d35aac-4906-4bc4-a41a-fd76ba3520c2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.268577 Jun 10 18:02:33.391609 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 810/1660] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:33 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:33.394912 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6d300387-baf1-46bd-b50b-21e51712b79c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:33.399333 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1643d06b-ccdd-4f22-87db-b4f2e78fa1b6 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:33.401528 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1643d06b-ccdd-4f22-87db-b4f2e78fa1b6 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: 00eacc06-d58a-4a76-8ac8-2515de78f44d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:33.412156 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6d300387-baf1-46bd-b50b-21e51712b79c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1542 microversion: 2.1 time: 0.704127 Jun 10 18:02:33.413029 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 851/1661] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:32 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1542 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:33.413282 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1643d06b-ccdd-4f22-87db-b4f2e78fa1b6 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:33.413793 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1643d06b-ccdd-4f22-87db-b4f2e78fa1b6 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:33.414569 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1643d06b-ccdd-4f22-87db-b4f2e78fa1b6 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:33.415170 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1643d06b-ccdd-4f22-87db-b4f2e78fa1b6 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:33.421143 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4bb0ed8f-23ae-4387-bd03-bc3a531dd169 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:33.421756 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4bb0ed8f-23ae-4387-bd03-bc3a531dd169 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:33.428177 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4bb0ed8f-23ae-4387-bd03-bc3a531dd169 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:33.428878 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4bb0ed8f-23ae-4387-bd03-bc3a531dd169 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:33.429842 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4bb0ed8f-23ae-4387-bd03-bc3a531dd169 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:33.431066 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4bb0ed8f-23ae-4387-bd03-bc3a531dd169 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:33.661942 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1643d06b-ccdd-4f22-87db-b4f2e78fa1b6 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63889ce9e75140bd9c730857468b7fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce8674b6db3471c8c94e809430651c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:33.674673 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1643d06b-ccdd-4f22-87db-b4f2e78fa1b6 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/00eacc06-d58a-4a76-8ac8-2515de78f44d" status: 200 len: 1317 microversion: 2.1 time: 0.279730 Jun 10 18:02:33.687529 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 811/1662] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:33 2022] GET /compute/v2.1/servers/00eacc06-d58a-4a76-8ac8-2515de78f44d => generated 1317 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:33.693777 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f98af06f-ea3e-4ef8-a0d7-db22a149f6ad tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:33.694391 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f98af06f-ea3e-4ef8-a0d7-db22a149f6ad tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:33.708748 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4bb0ed8f-23ae-4387-bd03-bc3a531dd169 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:33.714470 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f98af06f-ea3e-4ef8-a0d7-db22a149f6ad tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:33.723268 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f98af06f-ea3e-4ef8-a0d7-db22a149f6ad tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:33.725663 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f98af06f-ea3e-4ef8-a0d7-db22a149f6ad tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:33.726400 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4bb0ed8f-23ae-4387-bd03-bc3a531dd169 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1686 microversion: 2.1 time: 0.309135 Jun 10 18:02:33.727602 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f98af06f-ea3e-4ef8-a0d7-db22a149f6ad tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:33.729087 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 852/1663] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:33 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1686 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:33.883845 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f98af06f-ea3e-4ef8-a0d7-db22a149f6ad tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:33.890644 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f98af06f-ea3e-4ef8-a0d7-db22a149f6ad tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1523 microversion: 2.1 time: 0.202119 Jun 10 18:02:33.894148 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 812/1664] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:33 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1523 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:33.928373 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7b5f2e20-e660-43f8-867a-3856a88ac4e1 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:33.929374 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7b5f2e20-e660-43f8-867a-3856a88ac4e1 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:33.940800 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b5f2e20-e660-43f8-867a-3856a88ac4e1 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:33.941297 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b5f2e20-e660-43f8-867a-3856a88ac4e1 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:33.942385 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b5f2e20-e660-43f8-867a-3856a88ac4e1 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:33.942824 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b5f2e20-e660-43f8-867a-3856a88ac4e1 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:34.136245 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-02fd777a-0c89-4f60-aaa1-d3fbad889ee1 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:34.137384 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-02fd777a-0c89-4f60-aaa1-d3fbad889ee1 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:34.146323 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-02fd777a-0c89-4f60-aaa1-d3fbad889ee1 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:34.147019 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-02fd777a-0c89-4f60-aaa1-d3fbad889ee1 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:34.148846 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-02fd777a-0c89-4f60-aaa1-d3fbad889ee1 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:34.149352 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-02fd777a-0c89-4f60-aaa1-d3fbad889ee1 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:34.217607 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7b5f2e20-e660-43f8-867a-3856a88ac4e1 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:34.229934 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7b5f2e20-e660-43f8-867a-3856a88ac4e1 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1549 microversion: 2.1 time: 0.310755 Jun 10 18:02:34.234552 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 853/1665] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:33 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1549 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:34.413582 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3bc0f697-0cf6-4f1c-bc98-3a6923de33f3 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:34.414559 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3bc0f697-0cf6-4f1c-bc98-3a6923de33f3 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:34.426371 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3bc0f697-0cf6-4f1c-bc98-3a6923de33f3 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:34.427071 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3bc0f697-0cf6-4f1c-bc98-3a6923de33f3 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:34.430008 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3bc0f697-0cf6-4f1c-bc98-3a6923de33f3 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:34.430650 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3bc0f697-0cf6-4f1c-bc98-3a6923de33f3 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:34.508676 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-02fd777a-0c89-4f60-aaa1-d3fbad889ee1 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:34.517504 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-02fd777a-0c89-4f60-aaa1-d3fbad889ee1 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:34.527695 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-02fd777a-0c89-4f60-aaa1-d3fbad889ee1 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:34.536464 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-02fd777a-0c89-4f60-aaa1-d3fbad889ee1 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1447 microversion: 2.75 time: 0.404886 Jun 10 18:02:34.552641 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 813/1666] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:34 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1447 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:34.557971 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c4ce94b8-1b6b-46fd-8908-d6ec007f6255 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:34.558518 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c4ce94b8-1b6b-46fd-8908-d6ec007f6255 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:34.570931 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c4ce94b8-1b6b-46fd-8908-d6ec007f6255 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:34.573539 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c4ce94b8-1b6b-46fd-8908-d6ec007f6255 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:34.574528 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c4ce94b8-1b6b-46fd-8908-d6ec007f6255 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:34.578510 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c4ce94b8-1b6b-46fd-8908-d6ec007f6255 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:34.841223 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c4ce94b8-1b6b-46fd-8908-d6ec007f6255 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:34.845725 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3bc0f697-0cf6-4f1c-bc98-3a6923de33f3 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:34.859987 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3bc0f697-0cf6-4f1c-bc98-3a6923de33f3 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:34.874526 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3bc0f697-0cf6-4f1c-bc98-3a6923de33f3 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:34.874652 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c4ce94b8-1b6b-46fd-8908-d6ec007f6255 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1542 microversion: 2.1 time: 0.302310 Jun 10 18:02:34.874652 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 814/1667] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:34 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1542 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:34.875899 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3bc0f697-0cf6-4f1c-bc98-3a6923de33f3 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.466234 Jun 10 18:02:34.884693 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-77c61348-b472-4812-9b64-f315b31be6b7 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:34.885689 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-77c61348-b472-4812-9b64-f315b31be6b7 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: 00eacc06-d58a-4a76-8ac8-2515de78f44d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:34.886072 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 854/1668] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:34 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:02:34.904576 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-77c61348-b472-4812-9b64-f315b31be6b7 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:34.906744 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-77c61348-b472-4812-9b64-f315b31be6b7 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:34.909641 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-77c61348-b472-4812-9b64-f315b31be6b7 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:34.909882 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7fcb8085-a1b2-42f1-baf7-c03f6a66ed32 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:34.910510 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7fcb8085-a1b2-42f1-baf7-c03f6a66ed32 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:34.912074 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-77c61348-b472-4812-9b64-f315b31be6b7 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:34.918126 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7fcb8085-a1b2-42f1-baf7-c03f6a66ed32 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:34.918658 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7fcb8085-a1b2-42f1-baf7-c03f6a66ed32 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:34.919477 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7fcb8085-a1b2-42f1-baf7-c03f6a66ed32 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:34.919924 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7fcb8085-a1b2-42f1-baf7-c03f6a66ed32 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:35.116040 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7fcb8085-a1b2-42f1-baf7-c03f6a66ed32 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:35.126759 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7fcb8085-a1b2-42f1-baf7-c03f6a66ed32 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1681 microversion: 2.1 time: 0.239199 Jun 10 18:02:35.128204 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 855/1669] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:34 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1681 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:35.139293 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-165b20f3-08bb-47f9-a494-b3d7717ab1e6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:35.140426 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-165b20f3-08bb-47f9-a494-b3d7717ab1e6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:35.147650 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-165b20f3-08bb-47f9-a494-b3d7717ab1e6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:35.148841 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-165b20f3-08bb-47f9-a494-b3d7717ab1e6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:35.159425 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-165b20f3-08bb-47f9-a494-b3d7717ab1e6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:35.159425 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-165b20f3-08bb-47f9-a494-b3d7717ab1e6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:35.164544 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-77c61348-b472-4812-9b64-f315b31be6b7 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63889ce9e75140bd9c730857468b7fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce8674b6db3471c8c94e809430651c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:35.174645 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-77c61348-b472-4812-9b64-f315b31be6b7 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/00eacc06-d58a-4a76-8ac8-2515de78f44d" status: 200 len: 1317 microversion: 2.1 time: 0.303509 Jun 10 18:02:35.185074 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 815/1670] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:34 2022] GET /compute/v2.1/servers/00eacc06-d58a-4a76-8ac8-2515de78f44d => generated 1317 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:35.289329 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-21dbfcd4-0125-4a24-9b32-c530470acab0 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1257010110", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "d960cccc-e559-4107-b985-68eb02da9e75"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:02:35.360725 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-21dbfcd4-0125-4a24-9b32-c530470acab0 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] validate_networks() for [('d960cccc-e559-4107-b985-68eb02da9e75', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:02:35.364672 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-165b20f3-08bb-47f9-a494-b3d7717ab1e6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:35.380194 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-165b20f3-08bb-47f9-a494-b3d7717ab1e6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1523 microversion: 2.1 time: 0.250783 Jun 10 18:02:35.381153 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 856/1671] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:35 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1523 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:35.385828 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-234541db-2211-413a-add2-41abca20f54e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:35.386631 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-234541db-2211-413a-add2-41abca20f54e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:35.396723 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-234541db-2211-413a-add2-41abca20f54e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:35.397234 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-234541db-2211-413a-add2-41abca20f54e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:35.398259 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-234541db-2211-413a-add2-41abca20f54e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:35.398717 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-234541db-2211-413a-add2-41abca20f54e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:35.612247 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-234541db-2211-413a-add2-41abca20f54e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:35.624428 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-234541db-2211-413a-add2-41abca20f54e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1539 microversion: 2.1 time: 0.241953 Jun 10 18:02:35.628400 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 857/1672] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:35 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1539 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:35.633677 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-72b3ae13-ac39-48c3-be9e-04e11f5a0a47 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:35.634291 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-72b3ae13-ac39-48c3-be9e-04e11f5a0a47 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:35.657337 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72b3ae13-ac39-48c3-be9e-04e11f5a0a47 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:35.658266 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72b3ae13-ac39-48c3-be9e-04e11f5a0a47 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:35.663344 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72b3ae13-ac39-48c3-be9e-04e11f5a0a47 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:35.664094 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72b3ae13-ac39-48c3-be9e-04e11f5a0a47 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:35.784899 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-72b3ae13-ac39-48c3-be9e-04e11f5a0a47 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:35.802124 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-72b3ae13-ac39-48c3-be9e-04e11f5a0a47 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:35.804028 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-72b3ae13-ac39-48c3-be9e-04e11f5a0a47 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:35.812780 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-72b3ae13-ac39-48c3-be9e-04e11f5a0a47 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1447 microversion: 2.75 time: 0.182852 Jun 10 18:02:35.813891 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 858/1673] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:35 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1447 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:35.826868 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-989a2445-4353-44e7-a44e-3482070687ac tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Calling method '.version_select at 0x7f77c60fa160>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:35.830108 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-989a2445-4353-44e7-a44e-3482070687ac tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:35.830972 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-989a2445-4353-44e7-a44e-3482070687ac tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:35.852102 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-989a2445-4353-44e7-a44e-3482070687ac tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] 10.222.0.35 "GET /compute/v2.1/os-migrations" status: 200 len: 3494 microversion: 2.1 time: 0.036762 Jun 10 18:02:35.854646 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 859/1674] 10.222.0.35 () {58 vars in 1142 bytes} [Fri Jun 10 18:02:35 2022] GET /compute/v2.1/os-migrations => generated 3494 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:35.868005 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-328c6af8-706a-4665-9cdf-61565ad84113 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:35.869138 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-328c6af8-706a-4665-9cdf-61565ad84113 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:35.886420 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-328c6af8-706a-4665-9cdf-61565ad84113 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:35.887174 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-328c6af8-706a-4665-9cdf-61565ad84113 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:35.888158 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-328c6af8-706a-4665-9cdf-61565ad84113 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:35.889191 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-328c6af8-706a-4665-9cdf-61565ad84113 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:35.957468 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-21dbfcd4-0125-4a24-9b32-c530470acab0 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:02:35.958062 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-21dbfcd4-0125-4a24-9b32-c530470acab0 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:02:35.958363 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-21dbfcd4-0125-4a24-9b32-c530470acab0 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:02:35.958939 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-21dbfcd4-0125-4a24-9b32-c530470acab0 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:02:35.959475 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-21dbfcd4-0125-4a24-9b32-c530470acab0 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:02:35.985746 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-21dbfcd4-0125-4a24-9b32-c530470acab0 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:35.986203 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-21dbfcd4-0125-4a24-9b32-c530470acab0 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:35.987011 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-21dbfcd4-0125-4a24-9b32-c530470acab0 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:35.987918 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-21dbfcd4-0125-4a24-9b32-c530470acab0 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:36.020336 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-21dbfcd4-0125-4a24-9b32-c530470acab0 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Getting quotas for project b4a513641ffb46b091bb50e7b247e9a4. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:02:36.036505 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-21dbfcd4-0125-4a24-9b32-c530470acab0 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Getting quotas for user 5b8eb46cd9bd428b9f144077f3d7ed9f and project b4a513641ffb46b091bb50e7b247e9a4. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:02:36.052485 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-21dbfcd4-0125-4a24-9b32-c530470acab0 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:02:36.055402 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-21dbfcd4-0125-4a24-9b32-c530470acab0 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:02:36.173451 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-328c6af8-706a-4665-9cdf-61565ad84113 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1690 microversion: 2.1 time: 0.309156 Jun 10 18:02:36.185843 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 860/1675] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:35 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1690 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:36.195663 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5d2a675d-dae5-4f7e-9ed8-6676ac72406f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:36.197238 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5d2a675d-dae5-4f7e-9ed8-6676ac72406f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:36.201682 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-21dbfcd4-0125-4a24-9b32-c530470acab0 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.013172 Jun 10 18:02:36.202341 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 816/1676] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:02:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:02:36.204374 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5d2a675d-dae5-4f7e-9ed8-6676ac72406f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:36.205041 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5d2a675d-dae5-4f7e-9ed8-6676ac72406f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:36.205795 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5d2a675d-dae5-4f7e-9ed8-6676ac72406f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:36.206241 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5d2a675d-dae5-4f7e-9ed8-6676ac72406f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:36.219669 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9e1ea1af-ed8e-46bb-82dc-c02637e6c8fb tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:36.220582 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9e1ea1af-ed8e-46bb-82dc-c02637e6c8fb tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:36.239215 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9e1ea1af-ed8e-46bb-82dc-c02637e6c8fb tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:36.240009 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9e1ea1af-ed8e-46bb-82dc-c02637e6c8fb tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:36.241131 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9e1ea1af-ed8e-46bb-82dc-c02637e6c8fb tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:36.241764 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9e1ea1af-ed8e-46bb-82dc-c02637e6c8fb tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:36.446984 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5d2a675d-dae5-4f7e-9ed8-6676ac72406f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:36.458968 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5d2a675d-dae5-4f7e-9ed8-6676ac72406f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1542 microversion: 2.1 time: 0.271599 Jun 10 18:02:36.464826 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 861/1677] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:36 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1542 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:36.486232 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fa7b53ff-8ce2-49a4-a571-54339db00dd9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:36.486860 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fa7b53ff-8ce2-49a4-a571-54339db00dd9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:36.522120 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa7b53ff-8ce2-49a4-a571-54339db00dd9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:36.522590 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa7b53ff-8ce2-49a4-a571-54339db00dd9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:36.528894 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa7b53ff-8ce2-49a4-a571-54339db00dd9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:36.529451 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa7b53ff-8ce2-49a4-a571-54339db00dd9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:36.536340 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9e1ea1af-ed8e-46bb-82dc-c02637e6c8fb tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:36.546610 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9e1ea1af-ed8e-46bb-82dc-c02637e6c8fb tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:36.548465 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9e1ea1af-ed8e-46bb-82dc-c02637e6c8fb tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:36.549944 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9e1ea1af-ed8e-46bb-82dc-c02637e6c8fb tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.337053 Jun 10 18:02:36.550668 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 817/1678] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:36 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:36.557398 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e6015dbc-c5fd-4e58-9d49-ef70a7a1bb65 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:36.558289 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e6015dbc-c5fd-4e58-9d49-ef70a7a1bb65 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:36.568717 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e6015dbc-c5fd-4e58-9d49-ef70a7a1bb65 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:36.569183 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e6015dbc-c5fd-4e58-9d49-ef70a7a1bb65 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:36.570018 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e6015dbc-c5fd-4e58-9d49-ef70a7a1bb65 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:36.570462 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e6015dbc-c5fd-4e58-9d49-ef70a7a1bb65 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:36.593568 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:02:36.799152 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e6015dbc-c5fd-4e58-9d49-ef70a7a1bb65 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1690 microversion: 2.1 time: 0.244328 Jun 10 18:02:36.804232 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 818/1679] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:36 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1690 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:36.813962 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f50bc104-3d2f-4380-8c96-a9aacffb40d4 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:36.814121 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f50bc104-3d2f-4380-8c96-a9aacffb40d4 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: 00eacc06-d58a-4a76-8ac8-2515de78f44d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:36.828484 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f50bc104-3d2f-4380-8c96-a9aacffb40d4 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:36.830743 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f50bc104-3d2f-4380-8c96-a9aacffb40d4 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:36.831562 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f50bc104-3d2f-4380-8c96-a9aacffb40d4 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:36.832009 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f50bc104-3d2f-4380-8c96-a9aacffb40d4 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:36.866248 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fa7b53ff-8ce2-49a4-a571-54339db00dd9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:36.893311 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:02:36.905835 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fa7b53ff-8ce2-49a4-a571-54339db00dd9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1681 microversion: 2.1 time: 0.436177 Jun 10 18:02:36.908067 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 862/1680] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:36 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1681 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:36.923597 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e4eee7ae-9628-4255-b4f4-ad0a83f16287 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:36.926057 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e4eee7ae-9628-4255-b4f4-ad0a83f16287 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:37.068877 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e4eee7ae-9628-4255-b4f4-ad0a83f16287 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8eb46cd9bd428b9f144077f3d7ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a513641ffb46b091bb50e7b247e9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:37.077267 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e4eee7ae-9628-4255-b4f4-ad0a83f16287 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "GET /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d" status: 200 len: 1224 microversion: 2.1 time: 0.163238 Jun 10 18:02:37.079426 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 863/1681] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:36 2022] GET /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d => generated 1224 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:37.111489 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-26902d21-d140-4d17-9687-3745a0ba09df tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:37.112106 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-26902d21-d140-4d17-9687-3745a0ba09df tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:37.118561 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f50bc104-3d2f-4380-8c96-a9aacffb40d4 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63889ce9e75140bd9c730857468b7fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce8674b6db3471c8c94e809430651c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:37.130427 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-26902d21-d140-4d17-9687-3745a0ba09df tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:37.130878 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-26902d21-d140-4d17-9687-3745a0ba09df tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:37.131658 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-26902d21-d140-4d17-9687-3745a0ba09df tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:37.132159 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-26902d21-d140-4d17-9687-3745a0ba09df tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:37.132932 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f50bc104-3d2f-4380-8c96-a9aacffb40d4 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/00eacc06-d58a-4a76-8ac8-2515de78f44d" status: 200 len: 1317 microversion: 2.1 time: 0.327155 Jun 10 18:02:37.146226 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 819/1682] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:36 2022] GET /compute/v2.1/servers/00eacc06-d58a-4a76-8ac8-2515de78f44d => generated 1317 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:37.146226 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9fb29d7a-b552-4d0e-b6e6-2e69fe337e53 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:37.146226 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9fb29d7a-b552-4d0e-b6e6-2e69fe337e53 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:37.149159 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9fb29d7a-b552-4d0e-b6e6-2e69fe337e53 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:37.149627 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9fb29d7a-b552-4d0e-b6e6-2e69fe337e53 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:37.150763 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9fb29d7a-b552-4d0e-b6e6-2e69fe337e53 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:37.151299 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9fb29d7a-b552-4d0e-b6e6-2e69fe337e53 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:37.274271 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9fb29d7a-b552-4d0e-b6e6-2e69fe337e53 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:37.288351 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9fb29d7a-b552-4d0e-b6e6-2e69fe337e53 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:37.290840 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9fb29d7a-b552-4d0e-b6e6-2e69fe337e53 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:37.299547 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9fb29d7a-b552-4d0e-b6e6-2e69fe337e53 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1447 microversion: 2.75 time: 0.162670 Jun 10 18:02:37.300542 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 820/1683] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:37 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1447 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:37.321376 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-14199b51-518d-4129-b54d-2c26e9e7b1cc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:37.322094 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-14199b51-518d-4129-b54d-2c26e9e7b1cc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:37.331691 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-14199b51-518d-4129-b54d-2c26e9e7b1cc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:37.333262 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-14199b51-518d-4129-b54d-2c26e9e7b1cc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:37.334294 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-14199b51-518d-4129-b54d-2c26e9e7b1cc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:37.334962 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-14199b51-518d-4129-b54d-2c26e9e7b1cc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:37.553277 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-14199b51-518d-4129-b54d-2c26e9e7b1cc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lazy-loading 'services' on Instance uuid a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:02:37.619732 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-26902d21-d140-4d17-9687-3745a0ba09df tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:37.633642 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-26902d21-d140-4d17-9687-3745a0ba09df tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1523 microversion: 2.1 time: 0.543806 Jun 10 18:02:37.635643 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 864/1684] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:37 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1523 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:37.642822 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-4890594b-ea98-4a81-aa63-f3692704a429 req-6826bcc4-786c-46f3-88fa-1252755eb13c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00eacc06-d58a-4a76-8ac8-2515de78f44d", "name": "network-vif-plugged", "status": "completed", "tag": "276c472d-da12-416e-ac34-c63ed6266e5c"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:02:37.665885 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-4890594b-ea98-4a81-aa63-f3692704a429 req-6826bcc4-786c-46f3-88fa-1252755eb13c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:37.667088 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-4890594b-ea98-4a81-aa63-f3692704a429 req-6826bcc4-786c-46f3-88fa-1252755eb13c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:37.702977 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-4890594b-ea98-4a81-aa63-f3692704a429 req-6826bcc4-786c-46f3-88fa-1252755eb13c service nova] Creating event network-vif-plugged:276c472d-da12-416e-ac34-c63ed6266e5c for instance 00eacc06-d58a-4a76-8ac8-2515de78f44d on chh1-master-2 Jun 10 18:02:37.716784 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-4890594b-ea98-4a81-aa63-f3692704a429 req-6826bcc4-786c-46f3-88fa-1252755eb13c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077468 Jun 10 18:02:37.719619 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 865/1685] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:02:37.742241 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-61aff9ba-f55f-4c2f-82ec-53ed05db4be8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:37.761204 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-61aff9ba-f55f-4c2f-82ec-53ed05db4be8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:37.788295 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-61aff9ba-f55f-4c2f-82ec-53ed05db4be8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:37.790667 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-61aff9ba-f55f-4c2f-82ec-53ed05db4be8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:37.792218 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-61aff9ba-f55f-4c2f-82ec-53ed05db4be8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:37.794796 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-61aff9ba-f55f-4c2f-82ec-53ed05db4be8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:37.863109 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-14199b51-518d-4129-b54d-2c26e9e7b1cc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "DELETE /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d/os-volume_attachments/142854fd-ae98-4c8f-b0d1-0f7e60ad8f85" status: 202 len: 0 microversion: 2.1 time: 0.560849 Jun 10 18:02:37.863975 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 821/1686] 10.222.0.35 () {58 vars in 1415 bytes} [Fri Jun 10 18:02:37 2022] DELETE /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d/os-volume_attachments/142854fd-ae98-4c8f-b0d1-0f7e60ad8f85 => generated 0 bytes in 563 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:02:37.869686 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-aff75a5e-56fb-42fb-9eed-8c5f59452fe9 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:37.871768 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-aff75a5e-56fb-42fb-9eed-8c5f59452fe9 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:37.897591 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aff75a5e-56fb-42fb-9eed-8c5f59452fe9 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:37.901714 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aff75a5e-56fb-42fb-9eed-8c5f59452fe9 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:37.903681 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aff75a5e-56fb-42fb-9eed-8c5f59452fe9 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:37.905365 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aff75a5e-56fb-42fb-9eed-8c5f59452fe9 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:38.187106 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-aff75a5e-56fb-42fb-9eed-8c5f59452fe9 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:38.201180 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-aff75a5e-56fb-42fb-9eed-8c5f59452fe9 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:38.206604 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-aff75a5e-56fb-42fb-9eed-8c5f59452fe9 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:38.206604 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-aff75a5e-56fb-42fb-9eed-8c5f59452fe9 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.339500 Jun 10 18:02:38.206604 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 822/1687] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:37 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:38.222247 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-61aff9ba-f55f-4c2f-82ec-53ed05db4be8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:38.226611 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-aa4cec1c-1614-4584-893f-b71d9e3ab8c2 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:38.228078 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-aa4cec1c-1614-4584-893f-b71d9e3ab8c2 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:38.235219 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-61aff9ba-f55f-4c2f-82ec-53ed05db4be8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1542 microversion: 2.1 time: 0.513175 Jun 10 18:02:38.235219 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 866/1688] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:37 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1542 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:38.239633 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3183a3d1-8148-43a4-969e-ec850d8aa4aa tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:38.240239 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3183a3d1-8148-43a4-969e-ec850d8aa4aa tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:38.246168 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aa4cec1c-1614-4584-893f-b71d9e3ab8c2 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:38.247443 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aa4cec1c-1614-4584-893f-b71d9e3ab8c2 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:38.248791 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aa4cec1c-1614-4584-893f-b71d9e3ab8c2 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:38.249343 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aa4cec1c-1614-4584-893f-b71d9e3ab8c2 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:38.256871 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3183a3d1-8148-43a4-969e-ec850d8aa4aa tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:38.257326 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3183a3d1-8148-43a4-969e-ec850d8aa4aa tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:38.258113 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3183a3d1-8148-43a4-969e-ec850d8aa4aa tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:38.258552 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3183a3d1-8148-43a4-969e-ec850d8aa4aa tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:38.295076 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-aa4cec1c-1614-4584-893f-b71d9e3ab8c2 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087250 Jun 10 18:02:38.297488 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 823/1689] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:02:38 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:02:38.308358 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-11eb3540-9f7c-41d1-8516-b825eb39c15e tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:38.309800 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-11eb3540-9f7c-41d1-8516-b825eb39c15e tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:38.321250 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-11eb3540-9f7c-41d1-8516-b825eb39c15e tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:38.322407 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-11eb3540-9f7c-41d1-8516-b825eb39c15e tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:38.323466 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-11eb3540-9f7c-41d1-8516-b825eb39c15e tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:38.324132 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-11eb3540-9f7c-41d1-8516-b825eb39c15e tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:38.416613 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-11eb3540-9f7c-41d1-8516-b825eb39c15e tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8eb46cd9bd428b9f144077f3d7ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a513641ffb46b091bb50e7b247e9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:38.429893 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-11eb3540-9f7c-41d1-8516-b825eb39c15e tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "GET /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d" status: 200 len: 1228 microversion: 2.1 time: 0.126885 Jun 10 18:02:38.431087 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 824/1690] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:38 2022] GET /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d => generated 1228 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:38.437397 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f173fd17-756f-4ca4-85f1-58e1355e7d31 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:38.438579 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f173fd17-756f-4ca4-85f1-58e1355e7d31 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: 00eacc06-d58a-4a76-8ac8-2515de78f44d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:38.444941 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:02:38.446812 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f173fd17-756f-4ca4-85f1-58e1355e7d31 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:38.447487 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f173fd17-756f-4ca4-85f1-58e1355e7d31 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:38.449035 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f173fd17-756f-4ca4-85f1-58e1355e7d31 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:38.451155 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f173fd17-756f-4ca4-85f1-58e1355e7d31 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:38.514839 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3183a3d1-8148-43a4-969e-ec850d8aa4aa tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:38.526550 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3183a3d1-8148-43a4-969e-ec850d8aa4aa tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1681 microversion: 2.1 time: 0.290431 Jun 10 18:02:38.527904 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 867/1691] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:38 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1681 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:38.542814 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-db2b9a6d-ca42-48aa-a2f8-7b67d7fe58a2 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:38.543998 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-db2b9a6d-ca42-48aa-a2f8-7b67d7fe58a2 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:38.561817 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-db2b9a6d-ca42-48aa-a2f8-7b67d7fe58a2 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:38.563804 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-db2b9a6d-ca42-48aa-a2f8-7b67d7fe58a2 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:38.565647 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-db2b9a6d-ca42-48aa-a2f8-7b67d7fe58a2 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:38.567569 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-db2b9a6d-ca42-48aa-a2f8-7b67d7fe58a2 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:38.708841 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-db2b9a6d-ca42-48aa-a2f8-7b67d7fe58a2 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:38.724526 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f173fd17-756f-4ca4-85f1-58e1355e7d31 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63889ce9e75140bd9c730857468b7fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce8674b6db3471c8c94e809430651c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:38.727341 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-db2b9a6d-ca42-48aa-a2f8-7b67d7fe58a2 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:38.729226 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-db2b9a6d-ca42-48aa-a2f8-7b67d7fe58a2 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:38.735433 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f173fd17-756f-4ca4-85f1-58e1355e7d31 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/00eacc06-d58a-4a76-8ac8-2515de78f44d" status: 200 len: 1317 microversion: 2.1 time: 0.302758 Jun 10 18:02:38.736590 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 825/1692] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:38 2022] GET /compute/v2.1/servers/00eacc06-d58a-4a76-8ac8-2515de78f44d => generated 1317 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:38.738025 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-db2b9a6d-ca42-48aa-a2f8-7b67d7fe58a2 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1453 microversion: 2.75 time: 0.208718 Jun 10 18:02:38.741736 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4a0a49a1-d4d9-49b9-937d-c47f67fa3e44 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:38.742612 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4a0a49a1-d4d9-49b9-937d-c47f67fa3e44 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:38.749535 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4a0a49a1-d4d9-49b9-937d-c47f67fa3e44 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:38.750372 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4a0a49a1-d4d9-49b9-937d-c47f67fa3e44 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:38.751369 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4a0a49a1-d4d9-49b9-937d-c47f67fa3e44 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:38.752033 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4a0a49a1-d4d9-49b9-937d-c47f67fa3e44 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:38.752658 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 868/1693] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:38 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1453 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:38.978974 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4a0a49a1-d4d9-49b9-937d-c47f67fa3e44 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:38.995544 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4a0a49a1-d4d9-49b9-937d-c47f67fa3e44 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1523 microversion: 2.1 time: 0.257553 Jun 10 18:02:38.998751 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 826/1694] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:38 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1523 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:39.224425 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-583a103c-8aee-4ddd-a66c-50b09245a21c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:39.228604 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-583a103c-8aee-4ddd-a66c-50b09245a21c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:39.232783 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-583a103c-8aee-4ddd-a66c-50b09245a21c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:39.233245 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-583a103c-8aee-4ddd-a66c-50b09245a21c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:39.234027 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-583a103c-8aee-4ddd-a66c-50b09245a21c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:39.234463 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-583a103c-8aee-4ddd-a66c-50b09245a21c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:39.251373 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d8e70340-2f21-4b19-a4f0-9c2b473e9cc2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:39.252909 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d8e70340-2f21-4b19-a4f0-9c2b473e9cc2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:39.260967 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d8e70340-2f21-4b19-a4f0-9c2b473e9cc2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:39.263206 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d8e70340-2f21-4b19-a4f0-9c2b473e9cc2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:39.263206 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d8e70340-2f21-4b19-a4f0-9c2b473e9cc2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:39.263206 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d8e70340-2f21-4b19-a4f0-9c2b473e9cc2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:39.476404 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d8e70340-2f21-4b19-a4f0-9c2b473e9cc2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:39.484970 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d8e70340-2f21-4b19-a4f0-9c2b473e9cc2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1542 microversion: 2.1 time: 0.237683 Jun 10 18:02:39.486930 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 827/1695] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:39 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1542 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:02:39.492470 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-353c5f12-0c43-4188-b5dc-eda19d5611be tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:39.494160 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-353c5f12-0c43-4188-b5dc-eda19d5611be tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:39.502391 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-353c5f12-0c43-4188-b5dc-eda19d5611be tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:39.503206 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-353c5f12-0c43-4188-b5dc-eda19d5611be tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:39.504253 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-353c5f12-0c43-4188-b5dc-eda19d5611be tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:39.504964 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-353c5f12-0c43-4188-b5dc-eda19d5611be tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:39.508143 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-583a103c-8aee-4ddd-a66c-50b09245a21c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:39.522770 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-583a103c-8aee-4ddd-a66c-50b09245a21c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:39.527501 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-583a103c-8aee-4ddd-a66c-50b09245a21c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:39.540992 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-583a103c-8aee-4ddd-a66c-50b09245a21c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.311000 Jun 10 18:02:39.542063 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 869/1696] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:39 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:39.548208 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0714c55a-c924-4a05-aab6-582bb1f4f05c tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:39.548425 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-353c5f12-0c43-4188-b5dc-eda19d5611be tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059971 Jun 10 18:02:39.548842 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 828/1697] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:02:39 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:02:39.549660 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0714c55a-c924-4a05-aab6-582bb1f4f05c tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:39.557640 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0714c55a-c924-4a05-aab6-582bb1f4f05c tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:39.558476 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0714c55a-c924-4a05-aab6-582bb1f4f05c tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:39.559677 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0714c55a-c924-4a05-aab6-582bb1f4f05c tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:39.560250 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0714c55a-c924-4a05-aab6-582bb1f4f05c tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:39.569238 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-653d4440-940d-4816-b55f-1ce8f4b63aec tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:39.570189 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-653d4440-940d-4816-b55f-1ce8f4b63aec tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:39.591304 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-653d4440-940d-4816-b55f-1ce8f4b63aec tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:39.592278 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-653d4440-940d-4816-b55f-1ce8f4b63aec tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:39.594873 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-653d4440-940d-4816-b55f-1ce8f4b63aec tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:39.595664 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-653d4440-940d-4816-b55f-1ce8f4b63aec tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:39.639497 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0714c55a-c924-4a05-aab6-582bb1f4f05c tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8eb46cd9bd428b9f144077f3d7ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a513641ffb46b091bb50e7b247e9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:39.648321 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0714c55a-c924-4a05-aab6-582bb1f4f05c tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "GET /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d" status: 200 len: 1276 microversion: 2.1 time: 0.104874 Jun 10 18:02:39.659187 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 870/1698] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:39 2022] GET /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d => generated 1276 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:39.751872 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-a8f31722-df64-4094-87e9-136fa36a79c7 req-f14412a1-9883-49fe-a8d8-784400003ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "186b67b3-3538-4bc2-8528-53b43d701bf1", "name": "network-vif-plugged", "status": "completed", "tag": "128ee4eb-e784-41c8-acaa-39291810b2a4"}, {"server_uuid": "ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4", "name": "network-vif-plugged", "status": "completed", "tag": "d492be44-5990-4f08-b390-1c1031db44f7"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:02:39.772650 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-a8f31722-df64-4094-87e9-136fa36a79c7 req-f14412a1-9883-49fe-a8d8-784400003ef5 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:39.774802 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-a8f31722-df64-4094-87e9-136fa36a79c7 req-f14412a1-9883-49fe-a8d8-784400003ef5 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:39.802532 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-653d4440-940d-4816-b55f-1ce8f4b63aec tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:39.813577 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-653d4440-940d-4816-b55f-1ce8f4b63aec tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1681 microversion: 2.1 time: 0.248158 Jun 10 18:02:39.814191 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 829/1699] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:39 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1681 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:39.818649 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-a8f31722-df64-4094-87e9-136fa36a79c7 req-f14412a1-9883-49fe-a8d8-784400003ef5 service nova] Creating event network-vif-plugged:128ee4eb-e784-41c8-acaa-39291810b2a4 for instance 186b67b3-3538-4bc2-8528-53b43d701bf1 on chh1-master-2 Jun 10 18:02:39.819169 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-a8f31722-df64-4094-87e9-136fa36a79c7 req-f14412a1-9883-49fe-a8d8-784400003ef5 service nova] Creating event network-vif-plugged:d492be44-5990-4f08-b390-1c1031db44f7 for instance ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 on chh2-master-2 Jun 10 18:02:39.830753 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5a96af7e-619a-470f-8dfc-c309f426a510 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:39.831382 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5a96af7e-619a-470f-8dfc-c309f426a510 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: 00eacc06-d58a-4a76-8ac8-2515de78f44d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:39.834943 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-a8f31722-df64-4094-87e9-136fa36a79c7 req-f14412a1-9883-49fe-a8d8-784400003ef5 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.088287 Jun 10 18:02:39.837781 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 871/1700] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:02:39.847560 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5a96af7e-619a-470f-8dfc-c309f426a510 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:39.848030 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5a96af7e-619a-470f-8dfc-c309f426a510 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:39.850446 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-86edc91c-9aac-444d-8e31-a8f1545d9435 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:39.851154 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-86edc91c-9aac-444d-8e31-a8f1545d9435 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:39.855312 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5a96af7e-619a-470f-8dfc-c309f426a510 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:39.857165 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5a96af7e-619a-470f-8dfc-c309f426a510 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:39.872630 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86edc91c-9aac-444d-8e31-a8f1545d9435 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:39.873161 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86edc91c-9aac-444d-8e31-a8f1545d9435 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:39.873992 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86edc91c-9aac-444d-8e31-a8f1545d9435 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:39.874452 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86edc91c-9aac-444d-8e31-a8f1545d9435 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:39.987098 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-86edc91c-9aac-444d-8e31-a8f1545d9435 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:39.996254 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-86edc91c-9aac-444d-8e31-a8f1545d9435 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:39.997830 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-86edc91c-9aac-444d-8e31-a8f1545d9435 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:40.004174 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-86edc91c-9aac-444d-8e31-a8f1545d9435 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1453 microversion: 2.75 time: 0.164454 Jun 10 18:02:40.027273 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 872/1701] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:39 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1453 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:40.042036 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-417b1ef6-c5c3-4c66-931b-98d6df35d21a tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:40.042661 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-417b1ef6-c5c3-4c66-931b-98d6df35d21a tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:40.052749 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-417b1ef6-c5c3-4c66-931b-98d6df35d21a tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:40.053195 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-417b1ef6-c5c3-4c66-931b-98d6df35d21a tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:40.053970 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-417b1ef6-c5c3-4c66-931b-98d6df35d21a tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:40.054404 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-417b1ef6-c5c3-4c66-931b-98d6df35d21a tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:40.079948 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5a96af7e-619a-470f-8dfc-c309f426a510 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63889ce9e75140bd9c730857468b7fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce8674b6db3471c8c94e809430651c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:40.097482 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5a96af7e-619a-470f-8dfc-c309f426a510 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/00eacc06-d58a-4a76-8ac8-2515de78f44d" status: 200 len: 1506 microversion: 2.1 time: 0.282220 Jun 10 18:02:40.098399 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 830/1702] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:39 2022] GET /compute/v2.1/servers/00eacc06-d58a-4a76-8ac8-2515de78f44d => generated 1506 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:40.367042 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-417b1ef6-c5c3-4c66-931b-98d6df35d21a tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:40.384588 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-417b1ef6-c5c3-4c66-931b-98d6df35d21a tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1523 microversion: 2.1 time: 0.356586 Jun 10 18:02:40.385226 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 873/1703] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:40 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1523 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:40.508177 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1acfa46f-33f7-4026-bfec-6c69acfad120 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:40.508925 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1acfa46f-33f7-4026-bfec-6c69acfad120 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:40.515447 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1acfa46f-33f7-4026-bfec-6c69acfad120 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:40.517234 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1acfa46f-33f7-4026-bfec-6c69acfad120 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:40.517234 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1acfa46f-33f7-4026-bfec-6c69acfad120 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:40.517234 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1acfa46f-33f7-4026-bfec-6c69acfad120 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:40.551948 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b68bfff4-92cb-4182-8199-f709b158990d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:40.553230 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b68bfff4-92cb-4182-8199-f709b158990d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:40.563072 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b68bfff4-92cb-4182-8199-f709b158990d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:40.564907 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b68bfff4-92cb-4182-8199-f709b158990d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:40.565856 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b68bfff4-92cb-4182-8199-f709b158990d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:40.567112 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b68bfff4-92cb-4182-8199-f709b158990d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:40.728401 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1acfa46f-33f7-4026-bfec-6c69acfad120 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:40.739704 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1acfa46f-33f7-4026-bfec-6c69acfad120 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1542 microversion: 2.1 time: 0.240407 Jun 10 18:02:40.752416 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 831/1704] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:40 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1542 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:40.774749 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-acdba4e6-a2d4-4d7d-a197-ff57b9617fd0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:40.778941 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-acdba4e6-a2d4-4d7d-a197-ff57b9617fd0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:40.812394 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-acdba4e6-a2d4-4d7d-a197-ff57b9617fd0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:40.827084 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-acdba4e6-a2d4-4d7d-a197-ff57b9617fd0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:40.834971 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-acdba4e6-a2d4-4d7d-a197-ff57b9617fd0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:40.836182 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-acdba4e6-a2d4-4d7d-a197-ff57b9617fd0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:40.927644 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-acdba4e6-a2d4-4d7d-a197-ff57b9617fd0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.173766 Jun 10 18:02:40.932195 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 832/1705] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:02:40 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d/os-volume_attachments => generated 197 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:02:40.937028 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-55b4c40c-02b8-43a6-afdd-5324dca7fbca tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:40.938705 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-55b4c40c-02b8-43a6-afdd-5324dca7fbca tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:40.950190 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-55b4c40c-02b8-43a6-afdd-5324dca7fbca tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:40.950190 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-55b4c40c-02b8-43a6-afdd-5324dca7fbca tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:40.950190 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-55b4c40c-02b8-43a6-afdd-5324dca7fbca tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:40.950190 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-55b4c40c-02b8-43a6-afdd-5324dca7fbca tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:41.054006 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-55b4c40c-02b8-43a6-afdd-5324dca7fbca tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8eb46cd9bd428b9f144077f3d7ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a513641ffb46b091bb50e7b247e9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:41.064092 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-55b4c40c-02b8-43a6-afdd-5324dca7fbca tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "GET /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d" status: 200 len: 1282 microversion: 2.1 time: 0.130676 Jun 10 18:02:41.075345 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 833/1706] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:40 2022] GET /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d => generated 1282 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:41.075345 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-29a2afba-b2c0-4ae5-ab6c-23471293f6c5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:41.075345 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-29a2afba-b2c0-4ae5-ab6c-23471293f6c5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:41.086628 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-29a2afba-b2c0-4ae5-ab6c-23471293f6c5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:41.087132 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-29a2afba-b2c0-4ae5-ab6c-23471293f6c5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:41.088605 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-29a2afba-b2c0-4ae5-ab6c-23471293f6c5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:41.088768 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-29a2afba-b2c0-4ae5-ab6c-23471293f6c5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:41.089483 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b68bfff4-92cb-4182-8199-f709b158990d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:41.105642 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b68bfff4-92cb-4182-8199-f709b158990d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:41.110524 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b68bfff4-92cb-4182-8199-f709b158990d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:41.114782 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b68bfff4-92cb-4182-8199-f709b158990d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.566682 Jun 10 18:02:41.126359 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 874/1707] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:40 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:41.126536 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-85683f60-7caf-4e4c-b230-267505ce6d9c tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:41.128432 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:02:41.128542 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-85683f60-7caf-4e4c-b230-267505ce6d9c tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:41.134911 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-85683f60-7caf-4e4c-b230-267505ce6d9c tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:41.136109 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-85683f60-7caf-4e4c-b230-267505ce6d9c tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:41.137781 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-85683f60-7caf-4e4c-b230-267505ce6d9c tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:41.138492 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-85683f60-7caf-4e4c-b230-267505ce6d9c tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:41.242899 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-85683f60-7caf-4e4c-b230-267505ce6d9c tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:41.274145 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-85683f60-7caf-4e4c-b230-267505ce6d9c tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:41.280135 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-85683f60-7caf-4e4c-b230-267505ce6d9c tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:41.293073 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-85683f60-7caf-4e4c-b230-267505ce6d9c tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1453 microversion: 2.75 time: 0.174796 Jun 10 18:02:41.294608 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-29a2afba-b2c0-4ae5-ab6c-23471293f6c5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:41.295584 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 875/1708] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:41 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1453 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:41.316694 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-29a2afba-b2c0-4ae5-ab6c-23471293f6c5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1681 microversion: 2.1 time: 0.249101 Jun 10 18:02:41.327483 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 834/1709] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:41 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1681 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:41.404240 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d36fb325-5f1f-4dfb-994d-a718950b356d tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:41.404738 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d36fb325-5f1f-4dfb-994d-a718950b356d tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:41.418351 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d36fb325-5f1f-4dfb-994d-a718950b356d tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:41.418965 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d36fb325-5f1f-4dfb-994d-a718950b356d tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:41.420894 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d36fb325-5f1f-4dfb-994d-a718950b356d tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:41.424734 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d36fb325-5f1f-4dfb-994d-a718950b356d tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:41.763968 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d36fb325-5f1f-4dfb-994d-a718950b356d tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:41.768230 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0788e1f1-a378-4135-a6f7-a9bfb9103b94 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:41.769457 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0788e1f1-a378-4135-a6f7-a9bfb9103b94 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:41.775632 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d36fb325-5f1f-4dfb-994d-a718950b356d tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1523 microversion: 2.1 time: 0.377975 Jun 10 18:02:41.820285 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0788e1f1-a378-4135-a6f7-a9bfb9103b94 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:41.820285 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0788e1f1-a378-4135-a6f7-a9bfb9103b94 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:41.820285 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0788e1f1-a378-4135-a6f7-a9bfb9103b94 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:41.820285 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0788e1f1-a378-4135-a6f7-a9bfb9103b94 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:41.820752 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 876/1710] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:41 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1523 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:41.939756 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fcbd9626-0937-4fed-9cf9-882bad556d48 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:41.940777 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fcbd9626-0937-4fed-9cf9-882bad556d48 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:41.943797 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:02:41.949354 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fcbd9626-0937-4fed-9cf9-882bad556d48 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:41.949553 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0788e1f1-a378-4135-a6f7-a9bfb9103b94 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:41.950163 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fcbd9626-0937-4fed-9cf9-882bad556d48 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:41.950163 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fcbd9626-0937-4fed-9cf9-882bad556d48 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:41.950163 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fcbd9626-0937-4fed-9cf9-882bad556d48 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:41.957556 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0788e1f1-a378-4135-a6f7-a9bfb9103b94 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1542 microversion: 2.1 time: 0.192891 Jun 10 18:02:41.980268 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 835/1711] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:41 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1542 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:41.992681 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fcbd9626-0937-4fed-9cf9-882bad556d48 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056896 Jun 10 18:02:41.993397 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 877/1712] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:02:41 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:02:42.085402 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4d3eb791-de20-4d1f-b63e-bc9d5982f603 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:42.086060 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4d3eb791-de20-4d1f-b63e-bc9d5982f603 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:42.092381 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4d3eb791-de20-4d1f-b63e-bc9d5982f603 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:42.092840 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4d3eb791-de20-4d1f-b63e-bc9d5982f603 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:42.093620 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4d3eb791-de20-4d1f-b63e-bc9d5982f603 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:42.094066 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4d3eb791-de20-4d1f-b63e-bc9d5982f603 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:42.133915 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-af8700fb-086e-42bc-9ab1-e68c1a9b7726 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:42.134553 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-af8700fb-086e-42bc-9ab1-e68c1a9b7726 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:42.141162 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-af8700fb-086e-42bc-9ab1-e68c1a9b7726 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:42.141612 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-af8700fb-086e-42bc-9ab1-e68c1a9b7726 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:42.142382 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-af8700fb-086e-42bc-9ab1-e68c1a9b7726 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:42.142815 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-af8700fb-086e-42bc-9ab1-e68c1a9b7726 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:42.161372 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4d3eb791-de20-4d1f-b63e-bc9d5982f603 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8eb46cd9bd428b9f144077f3d7ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a513641ffb46b091bb50e7b247e9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:42.173463 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4d3eb791-de20-4d1f-b63e-bc9d5982f603 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "GET /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d" status: 200 len: 1282 microversion: 2.1 time: 0.091874 Jun 10 18:02:42.176432 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 836/1713] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:42 2022] GET /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d => generated 1282 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:02:42.313672 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c8d32c54-743f-490b-99d7-c6c753153d27 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:42.314626 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c8d32c54-743f-490b-99d7-c6c753153d27 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:42.330330 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c8d32c54-743f-490b-99d7-c6c753153d27 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:42.331084 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c8d32c54-743f-490b-99d7-c6c753153d27 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:42.332363 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c8d32c54-743f-490b-99d7-c6c753153d27 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:42.333032 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c8d32c54-743f-490b-99d7-c6c753153d27 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:42.434462 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-af8700fb-086e-42bc-9ab1-e68c1a9b7726 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:42.463249 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-af8700fb-086e-42bc-9ab1-e68c1a9b7726 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:42.463249 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-af8700fb-086e-42bc-9ab1-e68c1a9b7726 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:42.463249 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-af8700fb-086e-42bc-9ab1-e68c1a9b7726 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.330804 Jun 10 18:02:42.463614 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 878/1714] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:42 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:02:42.476632 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-13fc9a27-9aa2-4e8f-8518-bcdd0200b64c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:42.483989 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-13fc9a27-9aa2-4e8f-8518-bcdd0200b64c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:42.519001 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-13fc9a27-9aa2-4e8f-8518-bcdd0200b64c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:42.520492 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-13fc9a27-9aa2-4e8f-8518-bcdd0200b64c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:42.521732 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-13fc9a27-9aa2-4e8f-8518-bcdd0200b64c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:42.522980 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-13fc9a27-9aa2-4e8f-8518-bcdd0200b64c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:42.555433 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c8d32c54-743f-490b-99d7-c6c753153d27 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:42.581668 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c8d32c54-743f-490b-99d7-c6c753153d27 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:42.581668 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c8d32c54-743f-490b-99d7-c6c753153d27 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:42.598423 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c8d32c54-743f-490b-99d7-c6c753153d27 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1453 microversion: 2.75 time: 0.289320 Jun 10 18:02:42.599399 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 837/1715] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:42 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1453 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:42.794000 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-470edda4-f3ad-4375-9a94-011e6bc0f101 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:42.794622 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-470edda4-f3ad-4375-9a94-011e6bc0f101 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:42.816672 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-470edda4-f3ad-4375-9a94-011e6bc0f101 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:42.817125 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-470edda4-f3ad-4375-9a94-011e6bc0f101 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:42.817911 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-470edda4-f3ad-4375-9a94-011e6bc0f101 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:42.818352 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-470edda4-f3ad-4375-9a94-011e6bc0f101 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:43.080821 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-470edda4-f3ad-4375-9a94-011e6bc0f101 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:43.089834 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-470edda4-f3ad-4375-9a94-011e6bc0f101 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1523 microversion: 2.1 time: 0.300687 Jun 10 18:02:43.096711 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-13fc9a27-9aa2-4e8f-8518-bcdd0200b64c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:43.105354 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-13fc9a27-9aa2-4e8f-8518-bcdd0200b64c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1681 microversion: 2.1 time: 0.643048 Jun 10 18:02:43.110671 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 838/1716] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:42 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1523 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:43.119759 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 879/1717] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:42 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1681 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:43.138421 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-56eaacd0-3c34-42a6-9362-76ea35a97843 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:43.145845 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-56eaacd0-3c34-42a6-9362-76ea35a97843 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:43.146452 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-868f2aef-b001-4d29-bf18-a1781b1ccf28 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:43.147574 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-868f2aef-b001-4d29-bf18-a1781b1ccf28 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:43.163332 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-868f2aef-b001-4d29-bf18-a1781b1ccf28 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:43.166768 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-868f2aef-b001-4d29-bf18-a1781b1ccf28 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:43.167851 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-868f2aef-b001-4d29-bf18-a1781b1ccf28 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:43.168579 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-868f2aef-b001-4d29-bf18-a1781b1ccf28 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:43.172075 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-56eaacd0-3c34-42a6-9362-76ea35a97843 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:43.177837 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-56eaacd0-3c34-42a6-9362-76ea35a97843 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:43.180176 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-56eaacd0-3c34-42a6-9362-76ea35a97843 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:43.180665 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-56eaacd0-3c34-42a6-9362-76ea35a97843 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:43.243270 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-868f2aef-b001-4d29-bf18-a1781b1ccf28 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117958 Jun 10 18:02:43.243882 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 880/1718] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:02:43 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:02:43.256176 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e41a60f4-2423-4533-9e5a-d64abd1e381f tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:43.256812 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e41a60f4-2423-4533-9e5a-d64abd1e381f tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:43.274352 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e41a60f4-2423-4533-9e5a-d64abd1e381f tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:43.274811 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e41a60f4-2423-4533-9e5a-d64abd1e381f tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:43.275602 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e41a60f4-2423-4533-9e5a-d64abd1e381f tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:43.276757 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e41a60f4-2423-4533-9e5a-d64abd1e381f tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:43.487383 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e41a60f4-2423-4533-9e5a-d64abd1e381f tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8eb46cd9bd428b9f144077f3d7ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a513641ffb46b091bb50e7b247e9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:43.490304 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:02:43.501511 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e41a60f4-2423-4533-9e5a-d64abd1e381f tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "GET /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d" status: 200 len: 1324 microversion: 2.1 time: 0.248120 Jun 10 18:02:43.513799 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 881/1719] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:43 2022] GET /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d => generated 1324 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:43.523738 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c12aec8d-8365-4ec2-88f2-558ce94313c7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:43.526357 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c12aec8d-8365-4ec2-88f2-558ce94313c7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:43.541916 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c12aec8d-8365-4ec2-88f2-558ce94313c7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:43.542832 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c12aec8d-8365-4ec2-88f2-558ce94313c7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:43.543889 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c12aec8d-8365-4ec2-88f2-558ce94313c7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:43.544019 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-56eaacd0-3c34-42a6-9362-76ea35a97843 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:43.544591 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c12aec8d-8365-4ec2-88f2-558ce94313c7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:43.551713 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-56eaacd0-3c34-42a6-9362-76ea35a97843 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1542 microversion: 2.1 time: 0.434995 Jun 10 18:02:43.558054 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 839/1720] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:43 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1542 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:43.624696 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-20ea7e59-bcf6-4f4a-9302-0814ea9a50fc tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:43.626110 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-20ea7e59-bcf6-4f4a-9302-0814ea9a50fc tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:43.638131 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-20ea7e59-bcf6-4f4a-9302-0814ea9a50fc tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:43.638602 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-20ea7e59-bcf6-4f4a-9302-0814ea9a50fc tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:43.639405 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-20ea7e59-bcf6-4f4a-9302-0814ea9a50fc tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:43.639853 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-20ea7e59-bcf6-4f4a-9302-0814ea9a50fc tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:43.737958 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-20ea7e59-bcf6-4f4a-9302-0814ea9a50fc tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:43.754054 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-20ea7e59-bcf6-4f4a-9302-0814ea9a50fc tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:43.755731 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-20ea7e59-bcf6-4f4a-9302-0814ea9a50fc tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:43.772663 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-20ea7e59-bcf6-4f4a-9302-0814ea9a50fc tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1453 microversion: 2.75 time: 0.156828 Jun 10 18:02:43.773657 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 840/1721] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:43 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:43.819871 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c12aec8d-8365-4ec2-88f2-558ce94313c7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:43.832889 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c12aec8d-8365-4ec2-88f2-558ce94313c7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:43.834476 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c12aec8d-8365-4ec2-88f2-558ce94313c7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:43.835651 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c12aec8d-8365-4ec2-88f2-558ce94313c7 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.320631 Jun 10 18:02:43.836410 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 882/1722] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:43 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:44.133137 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bbbc4733-b013-4923-930e-61bf3dfc0a66 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:44.134694 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bbbc4733-b013-4923-930e-61bf3dfc0a66 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:44.141555 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dbdf52df-e738-4e03-a7c3-e7353feb44c9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:44.142444 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dbdf52df-e738-4e03-a7c3-e7353feb44c9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:44.150454 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bbbc4733-b013-4923-930e-61bf3dfc0a66 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:44.153656 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bbbc4733-b013-4923-930e-61bf3dfc0a66 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:44.155432 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bbbc4733-b013-4923-930e-61bf3dfc0a66 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:44.156693 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dbdf52df-e738-4e03-a7c3-e7353feb44c9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:44.159555 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dbdf52df-e738-4e03-a7c3-e7353feb44c9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:44.160698 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dbdf52df-e738-4e03-a7c3-e7353feb44c9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:44.161583 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bbbc4733-b013-4923-930e-61bf3dfc0a66 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:44.162193 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dbdf52df-e738-4e03-a7c3-e7353feb44c9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:44.442436 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bbbc4733-b013-4923-930e-61bf3dfc0a66 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:44.455125 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bbbc4733-b013-4923-930e-61bf3dfc0a66 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1523 microversion: 2.1 time: 0.327657 Jun 10 18:02:44.471069 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 841/1723] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:44 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1523 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:44.482148 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d5db0109-342b-4dec-91f4-3b54fa2e5db3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:44.485630 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d5db0109-342b-4dec-91f4-3b54fa2e5db3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:44.508767 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d5db0109-342b-4dec-91f4-3b54fa2e5db3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:44.509252 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d5db0109-342b-4dec-91f4-3b54fa2e5db3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:44.513718 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d5db0109-342b-4dec-91f4-3b54fa2e5db3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:44.513718 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d5db0109-342b-4dec-91f4-3b54fa2e5db3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:44.634186 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d5db0109-342b-4dec-91f4-3b54fa2e5db3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.158320 Jun 10 18:02:44.634856 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 842/1724] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:02:44 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:02:44.659708 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-dc7cde72-d09a-4e89-bfd4-e3f83f021fd1 req-2d8678c1-bec7-4f2d-ad7d-4e144fc2e854 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d", "tag": "f445eab9-755e-4cb4-8b43-362aa57d1ab2"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:02:44.664085 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-dbdf52df-e738-4e03-a7c3-e7353feb44c9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:44.673184 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dbdf52df-e738-4e03-a7c3-e7353feb44c9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1681 microversion: 2.1 time: 0.536519 Jun 10 18:02:44.674249 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 883/1725] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:44 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1681 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:44.679282 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-65a2467f-0847-4932-9db4-a8088cfea2fe tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:44.680078 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-65a2467f-0847-4932-9db4-a8088cfea2fe tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:44.686163 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-dc7cde72-d09a-4e89-bfd4-e3f83f021fd1 req-2d8678c1-bec7-4f2d-ad7d-4e144fc2e854 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:44.686622 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-dc7cde72-d09a-4e89-bfd4-e3f83f021fd1 req-2d8678c1-bec7-4f2d-ad7d-4e144fc2e854 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:44.689176 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-65a2467f-0847-4932-9db4-a8088cfea2fe tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:44.689840 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-65a2467f-0847-4932-9db4-a8088cfea2fe tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:44.690806 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-65a2467f-0847-4932-9db4-a8088cfea2fe tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:44.691415 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-65a2467f-0847-4932-9db4-a8088cfea2fe tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:44.712806 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-dc7cde72-d09a-4e89-bfd4-e3f83f021fd1 req-2d8678c1-bec7-4f2d-ad7d-4e144fc2e854 service nova] Creating event network-changed:f445eab9-755e-4cb4-8b43-362aa57d1ab2 for instance d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d on chh1-master-2 Jun 10 18:02:44.725801 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-dc7cde72-d09a-4e89-bfd4-e3f83f021fd1 req-2d8678c1-bec7-4f2d-ad7d-4e144fc2e854 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079902 Jun 10 18:02:44.726895 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 843/1726] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:02:44.740656 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3efbf1a1-2c99-46ea-a65f-ef89890a61b8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:44.741393 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3efbf1a1-2c99-46ea-a65f-ef89890a61b8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:44.762252 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3efbf1a1-2c99-46ea-a65f-ef89890a61b8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:44.762665 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3efbf1a1-2c99-46ea-a65f-ef89890a61b8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:44.763463 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3efbf1a1-2c99-46ea-a65f-ef89890a61b8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:44.763906 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3efbf1a1-2c99-46ea-a65f-ef89890a61b8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:45.001580 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3efbf1a1-2c99-46ea-a65f-ef89890a61b8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:45.015123 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3efbf1a1-2c99-46ea-a65f-ef89890a61b8 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1541 microversion: 2.1 time: 0.286615 Jun 10 18:02:45.024903 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 844/1727] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:44 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1541 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:45.025103 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-65a2467f-0847-4932-9db4-a8088cfea2fe tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8eb46cd9bd428b9f144077f3d7ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a513641ffb46b091bb50e7b247e9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:45.025209 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-27054b34-d77a-4e31-9046-75aaf17a47c0 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:45.025695 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-27054b34-d77a-4e31-9046-75aaf17a47c0 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:45.033544 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27054b34-d77a-4e31-9046-75aaf17a47c0 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:45.035230 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-65a2467f-0847-4932-9db4-a8088cfea2fe tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "GET /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d" status: 200 len: 1324 microversion: 2.1 time: 0.353614 Jun 10 18:02:45.045002 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27054b34-d77a-4e31-9046-75aaf17a47c0 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:45.045002 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27054b34-d77a-4e31-9046-75aaf17a47c0 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:45.045002 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27054b34-d77a-4e31-9046-75aaf17a47c0 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:45.048763 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 884/1728] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:44 2022] GET /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d => generated 1324 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:45.053331 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-46c51577-6818-4d1e-b041-bad651df920b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:45.053958 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-46c51577-6818-4d1e-b041-bad651df920b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:45.077326 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-46c51577-6818-4d1e-b041-bad651df920b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:45.077703 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-46c51577-6818-4d1e-b041-bad651df920b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:45.080912 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-46c51577-6818-4d1e-b041-bad651df920b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:45.081389 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-46c51577-6818-4d1e-b041-bad651df920b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:45.178801 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-27054b34-d77a-4e31-9046-75aaf17a47c0 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:45.188081 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-27054b34-d77a-4e31-9046-75aaf17a47c0 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:45.189609 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-27054b34-d77a-4e31-9046-75aaf17a47c0 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:45.210507 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-27054b34-d77a-4e31-9046-75aaf17a47c0 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1438 microversion: 2.75 time: 0.193063 Jun 10 18:02:45.211110 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 845/1729] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:45 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1438 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:45.377133 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9885e23d-ea65-4a4b-b7bd-5ba0dca96054 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:02:45.379337 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9885e23d-ea65-4a4b-b7bd-5ba0dca96054 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:45.387421 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9885e23d-ea65-4a4b-b7bd-5ba0dca96054 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:45.388465 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9885e23d-ea65-4a4b-b7bd-5ba0dca96054 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:45.390394 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9885e23d-ea65-4a4b-b7bd-5ba0dca96054 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:45.390394 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9885e23d-ea65-4a4b-b7bd-5ba0dca96054 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:45.519425 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-46c51577-6818-4d1e-b041-bad651df920b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:45.527926 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-9885e23d-ea65-4a4b-b7bd-5ba0dca96054 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:02:45.535275 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-9885e23d-ea65-4a4b-b7bd-5ba0dca96054 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:02:45.536022 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-9885e23d-ea65-4a4b-b7bd-5ba0dca96054 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:02:45.536579 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-9885e23d-ea65-4a4b-b7bd-5ba0dca96054 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:02:45.540337 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-9885e23d-ea65-4a4b-b7bd-5ba0dca96054 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:02:45.551687 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-46c51577-6818-4d1e-b041-bad651df920b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:45.556419 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-46c51577-6818-4d1e-b041-bad651df920b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:45.556419 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-46c51577-6818-4d1e-b041-bad651df920b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.513504 Jun 10 18:02:45.556419 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 885/1730] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:45 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:45.577413 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-29433892-b320-4696-8fc7-526218acac97 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:45.578027 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-29433892-b320-4696-8fc7-526218acac97 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:45.606215 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-29433892-b320-4696-8fc7-526218acac97 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:45.612860 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-29433892-b320-4696-8fc7-526218acac97 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:45.612860 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-29433892-b320-4696-8fc7-526218acac97 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:45.612860 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-29433892-b320-4696-8fc7-526218acac97 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:45.836057 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9885e23d-ea65-4a4b-b7bd-5ba0dca96054 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:45.876515 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9885e23d-ea65-4a4b-b7bd-5ba0dca96054 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:45.877167 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9885e23d-ea65-4a4b-b7bd-5ba0dca96054 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:45.880277 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9885e23d-ea65-4a4b-b7bd-5ba0dca96054 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:45.882625 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9885e23d-ea65-4a4b-b7bd-5ba0dca96054 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:45.952583 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-29433892-b320-4696-8fc7-526218acac97 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:45.972361 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-29433892-b320-4696-8fc7-526218acac97 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1523 microversion: 2.1 time: 0.398451 Jun 10 18:02:45.975333 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 886/1731] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:45 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1523 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:45.986851 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-baa741e6-4474-4b4c-b98e-64e292a4b95c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:45.988481 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-baa741e6-4474-4b4c-b98e-64e292a4b95c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:46.002318 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-baa741e6-4474-4b4c-b98e-64e292a4b95c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:46.003401 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-baa741e6-4474-4b4c-b98e-64e292a4b95c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:46.004383 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-baa741e6-4474-4b4c-b98e-64e292a4b95c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:46.004952 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-baa741e6-4474-4b4c-b98e-64e292a4b95c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:46.046175 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:02:46.046806 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=6 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:02:46.055429 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-baa741e6-4474-4b4c-b98e-64e292a4b95c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078096 Jun 10 18:02:46.061340 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 887/1732] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:02:45 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:02:46.068046 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5f4a86e1-7da1-4a38-bd18-cd59e2adf8e6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:46.068800 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5f4a86e1-7da1-4a38-bd18-cd59e2adf8e6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:46.076403 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5f4a86e1-7da1-4a38-bd18-cd59e2adf8e6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:46.079689 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5f4a86e1-7da1-4a38-bd18-cd59e2adf8e6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:46.079689 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5f4a86e1-7da1-4a38-bd18-cd59e2adf8e6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:46.079689 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5f4a86e1-7da1-4a38-bd18-cd59e2adf8e6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:46.183111 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-9885e23d-ea65-4a4b-b7bd-5ba0dca96054 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lazy-loading 'services' on Instance uuid a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:02:46.209155 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9885e23d-ea65-4a4b-b7bd-5ba0dca96054 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] 10.222.0.35 "POST /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe/action" status: 202 len: 1942 microversion: 2.75 time: 0.980555 Jun 10 18:02:46.225208 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 846/1733] 10.222.0.35 () {62 vars in 1318 bytes} [Fri Jun 10 18:02:45 2022] POST /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe/action => generated 1942 bytes in 993 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Jun 10 18:02:46.231399 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a6f17f00-2ce9-4471-ad58-0112221bc69c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:46.232052 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a6f17f00-2ce9-4471-ad58-0112221bc69c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:46.243146 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a6f17f00-2ce9-4471-ad58-0112221bc69c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:46.243678 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a6f17f00-2ce9-4471-ad58-0112221bc69c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:46.244707 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a6f17f00-2ce9-4471-ad58-0112221bc69c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:46.245233 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a6f17f00-2ce9-4471-ad58-0112221bc69c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:46.333283 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5f4a86e1-7da1-4a38-bd18-cd59e2adf8e6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:46.358776 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5f4a86e1-7da1-4a38-bd18-cd59e2adf8e6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1681 microversion: 2.1 time: 0.284144 Jun 10 18:02:46.358776 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 888/1734] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:46 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1681 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:46.358776 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b887b2cf-4c4a-438a-b7cd-8f0e7821c2a2 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:46.358776 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b887b2cf-4c4a-438a-b7cd-8f0e7821c2a2 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:46.371460 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b887b2cf-4c4a-438a-b7cd-8f0e7821c2a2 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:46.372124 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b887b2cf-4c4a-438a-b7cd-8f0e7821c2a2 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:46.373043 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b887b2cf-4c4a-438a-b7cd-8f0e7821c2a2 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:46.373727 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b887b2cf-4c4a-438a-b7cd-8f0e7821c2a2 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:46.473640 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a6f17f00-2ce9-4471-ad58-0112221bc69c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:46.503746 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a6f17f00-2ce9-4471-ad58-0112221bc69c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1541 microversion: 2.1 time: 0.276921 Jun 10 18:02:46.504856 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 847/1735] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:46 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1541 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:46.512448 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5b1e1fc6-1552-4384-9cfc-77c41db9676f tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:46.513663 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5b1e1fc6-1552-4384-9cfc-77c41db9676f tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:46.524497 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5b1e1fc6-1552-4384-9cfc-77c41db9676f tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:46.524497 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5b1e1fc6-1552-4384-9cfc-77c41db9676f tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:46.524497 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5b1e1fc6-1552-4384-9cfc-77c41db9676f tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:46.524497 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5b1e1fc6-1552-4384-9cfc-77c41db9676f tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:46.677845 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:02:46.683497 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-5b1e1fc6-1552-4384-9cfc-77c41db9676f tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lazy-loading 'services' on Instance uuid a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:02:46.703745 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5b1e1fc6-1552-4384-9cfc-77c41db9676f tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1929 microversion: 2.75 time: 0.196740 Jun 10 18:02:46.704553 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 848/1736] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:46 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1929 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:46.731644 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bf4f8036-94e3-48d6-b944-427de4c8365b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:46.733040 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bf4f8036-94e3-48d6-b944-427de4c8365b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:46.742583 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bf4f8036-94e3-48d6-b944-427de4c8365b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:46.743033 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bf4f8036-94e3-48d6-b944-427de4c8365b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:46.743960 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bf4f8036-94e3-48d6-b944-427de4c8365b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:46.744975 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bf4f8036-94e3-48d6-b944-427de4c8365b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:46.770742 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b887b2cf-4c4a-438a-b7cd-8f0e7821c2a2 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8eb46cd9bd428b9f144077f3d7ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a513641ffb46b091bb50e7b247e9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:46.780656 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b887b2cf-4c4a-438a-b7cd-8f0e7821c2a2 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "GET /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d" status: 200 len: 1324 microversion: 2.1 time: 0.431827 Jun 10 18:02:46.782245 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 889/1737] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:46 2022] GET /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d => generated 1324 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:46.935249 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-77490d9d-4821-4e83-bd82-d0f95bd0d1d5 req-9b36a406-6410-4eb7-a8ba-cbd3e3a60494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbc49fe4-a119-4ed9-9310-45babff4fec4", "name": "network-vif-unplugged", "status": "completed", "tag": "8e46ecde-2a76-4ced-9d12-e08541a4852f"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:02:46.950751 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-77490d9d-4821-4e83-bd82-d0f95bd0d1d5 req-9b36a406-6410-4eb7-a8ba-cbd3e3a60494 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:46.953791 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-77490d9d-4821-4e83-bd82-d0f95bd0d1d5 req-9b36a406-6410-4eb7-a8ba-cbd3e3a60494 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:46.968970 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bf4f8036-94e3-48d6-b944-427de4c8365b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:46.986254 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bf4f8036-94e3-48d6-b944-427de4c8365b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:46.988137 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bf4f8036-94e3-48d6-b944-427de4c8365b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:46.988780 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-77490d9d-4821-4e83-bd82-d0f95bd0d1d5 req-9b36a406-6410-4eb7-a8ba-cbd3e3a60494 service nova] Creating event network-vif-unplugged:8e46ecde-2a76-4ced-9d12-e08541a4852f for instance fbc49fe4-a119-4ed9-9310-45babff4fec4 on chh1-master-2 Jun 10 18:02:46.999981 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bf4f8036-94e3-48d6-b944-427de4c8365b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.284091 Jun 10 18:02:47.000980 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 849/1738] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:46 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:47.006399 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5cfca091-3630-4728-b7ce-5f59276b50df tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:47.007110 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5cfca091-3630-4728-b7ce-5f59276b50df tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:47.016214 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5cfca091-3630-4728-b7ce-5f59276b50df tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:47.016777 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5cfca091-3630-4728-b7ce-5f59276b50df tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:47.017692 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5cfca091-3630-4728-b7ce-5f59276b50df tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:47.018152 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5cfca091-3630-4728-b7ce-5f59276b50df tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:47.021505 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [req-77490d9d-4821-4e83-bd82-d0f95bd0d1d5 req-9b36a406-6410-4eb7-a8ba-cbd3e3a60494 service nova] Instance fbc49fe4-a119-4ed9-9310-45babff4fec4 is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 18:02:47.041574 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-77490d9d-4821-4e83-bd82-d0f95bd0d1d5 req-9b36a406-6410-4eb7-a8ba-cbd3e3a60494 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.246248 Jun 10 18:02:47.042533 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 890/1739] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:02:47.077743 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7ce89c0d-44ff-4e27-8e1d-59d9096e591f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:47.079417 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7ce89c0d-44ff-4e27-8e1d-59d9096e591f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:47.099010 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:02:47.100174 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7ce89c0d-44ff-4e27-8e1d-59d9096e591f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:47.100700 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7ce89c0d-44ff-4e27-8e1d-59d9096e591f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:47.101524 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7ce89c0d-44ff-4e27-8e1d-59d9096e591f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:47.101966 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7ce89c0d-44ff-4e27-8e1d-59d9096e591f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:47.283829 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7ce89c0d-44ff-4e27-8e1d-59d9096e591f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085892 Jun 10 18:02:47.283829 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 891/1740] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:02:47 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:02:47.284499 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5cfca091-3630-4728-b7ce-5f59276b50df tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:47.284499 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5cfca091-3630-4728-b7ce-5f59276b50df tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1508 microversion: 2.1 time: 0.241406 Jun 10 18:02:47.284499 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 850/1741] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:47 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1508 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:47.285775 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b843462e-ca7c-4623-9438-3b3e9ea0abb2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:47.285775 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b843462e-ca7c-4623-9438-3b3e9ea0abb2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:47.285775 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b843462e-ca7c-4623-9438-3b3e9ea0abb2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:47.285775 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b843462e-ca7c-4623-9438-3b3e9ea0abb2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:47.286525 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b843462e-ca7c-4623-9438-3b3e9ea0abb2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:47.286525 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b843462e-ca7c-4623-9438-3b3e9ea0abb2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:47.372786 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c26534da-f74f-44df-be2f-7260d9be184e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:47.375734 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c26534da-f74f-44df-be2f-7260d9be184e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:47.386419 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c26534da-f74f-44df-be2f-7260d9be184e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:47.387342 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c26534da-f74f-44df-be2f-7260d9be184e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:47.388907 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c26534da-f74f-44df-be2f-7260d9be184e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:47.389872 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c26534da-f74f-44df-be2f-7260d9be184e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:47.630665 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c26534da-f74f-44df-be2f-7260d9be184e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:47.648273 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c26534da-f74f-44df-be2f-7260d9be184e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1681 microversion: 2.1 time: 0.282555 Jun 10 18:02:47.652103 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 851/1742] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:47 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1681 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:47.663451 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9724cb09-f743-4a5c-b151-41dee01c2e10 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:47.667150 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9724cb09-f743-4a5c-b151-41dee01c2e10 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:47.682450 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9724cb09-f743-4a5c-b151-41dee01c2e10 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:47.683181 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9724cb09-f743-4a5c-b151-41dee01c2e10 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:47.684084 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9724cb09-f743-4a5c-b151-41dee01c2e10 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:47.686979 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9724cb09-f743-4a5c-b151-41dee01c2e10 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:47.718811 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b843462e-ca7c-4623-9438-3b3e9ea0abb2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:47.733926 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b843462e-ca7c-4623-9438-3b3e9ea0abb2 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 200 len: 1508 microversion: 2.1 time: 0.474629 Jun 10 18:02:47.736717 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 892/1743] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:47 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 1508 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:47.749742 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-03bd98df-3154-4691-aa9d-ba45018c346c tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:47.750496 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-03bd98df-3154-4691-aa9d-ba45018c346c tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:47.764997 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03bd98df-3154-4691-aa9d-ba45018c346c tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:47.765517 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03bd98df-3154-4691-aa9d-ba45018c346c tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:47.766330 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03bd98df-3154-4691-aa9d-ba45018c346c tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:47.766776 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03bd98df-3154-4691-aa9d-ba45018c346c tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:47.893869 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9724cb09-f743-4a5c-b151-41dee01c2e10 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:47.903661 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9724cb09-f743-4a5c-b151-41dee01c2e10 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1541 microversion: 2.1 time: 0.249712 Jun 10 18:02:47.914628 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 852/1744] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:47 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1541 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:47.914628 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b13f441f-dab7-413b-94c9-d9669a21324e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:47.914628 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b13f441f-dab7-413b-94c9-d9669a21324e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:47.921697 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b13f441f-dab7-413b-94c9-d9669a21324e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:47.922298 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b13f441f-dab7-413b-94c9-d9669a21324e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:47.923187 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b13f441f-dab7-413b-94c9-d9669a21324e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:47.923892 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b13f441f-dab7-413b-94c9-d9669a21324e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:47.956653 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b13f441f-dab7-413b-94c9-d9669a21324e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:02:48.131803 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-03bd98df-3154-4691-aa9d-ba45018c346c tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lazy-loading 'services' on Instance uuid a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:02:48.172573 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-03bd98df-3154-4691-aa9d-ba45018c346c tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1929 microversion: 2.75 time: 0.434170 Jun 10 18:02:48.174004 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 893/1745] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:47 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1929 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:48.179779 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-68179036-3ea6-48bd-9706-833966a3fcfc tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:48.180870 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-68179036-3ea6-48bd-9706-833966a3fcfc tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:48.194518 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-68179036-3ea6-48bd-9706-833966a3fcfc tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:48.194987 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-68179036-3ea6-48bd-9706-833966a3fcfc tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:48.195816 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-68179036-3ea6-48bd-9706-833966a3fcfc tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:48.200484 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-68179036-3ea6-48bd-9706-833966a3fcfc tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:48.442109 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b13f441f-dab7-413b-94c9-d9669a21324e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "DELETE /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 204 len: 0 microversion: 2.1 time: 0.534222 Jun 10 18:02:48.449808 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 853/1746] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:02:47 2022] DELETE /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:02:48.451765 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2a3231f6-2972-48d5-95ca-05084d14abf3 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:48.452678 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2a3231f6-2972-48d5-95ca-05084d14abf3 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:48.481752 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2a3231f6-2972-48d5-95ca-05084d14abf3 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:48.481752 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2a3231f6-2972-48d5-95ca-05084d14abf3 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:48.481752 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2a3231f6-2972-48d5-95ca-05084d14abf3 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:48.481752 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2a3231f6-2972-48d5-95ca-05084d14abf3 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:48.744500 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-68179036-3ea6-48bd-9706-833966a3fcfc tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8eb46cd9bd428b9f144077f3d7ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a513641ffb46b091bb50e7b247e9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:48.744500 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-68179036-3ea6-48bd-9706-833966a3fcfc tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "GET /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d" status: 200 len: 1324 microversion: 2.1 time: 0.545345 Jun 10 18:02:48.744500 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 894/1747] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:48 2022] GET /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d => generated 1324 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:48.744500 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1c60cb39-3b71-449a-b4a1-1fc4a8621de0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:48.745031 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1c60cb39-3b71-449a-b4a1-1fc4a8621de0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:48.745031 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1c60cb39-3b71-449a-b4a1-1fc4a8621de0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:48.745031 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1c60cb39-3b71-449a-b4a1-1fc4a8621de0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:48.745031 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1c60cb39-3b71-449a-b4a1-1fc4a8621de0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:48.745980 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1c60cb39-3b71-449a-b4a1-1fc4a8621de0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:48.753718 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2a3231f6-2972-48d5-95ca-05084d14abf3 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:48.764001 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2a3231f6-2972-48d5-95ca-05084d14abf3 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:48.765582 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2a3231f6-2972-48d5-95ca-05084d14abf3 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:48.766777 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2a3231f6-2972-48d5-95ca-05084d14abf3 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.322077 Jun 10 18:02:48.779273 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 854/1748] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:48 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:48.784788 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d06a6933-71bd-4006-9036-ca7fc3fdcde6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:48.785467 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d06a6933-71bd-4006-9036-ca7fc3fdcde6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:48.792586 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d06a6933-71bd-4006-9036-ca7fc3fdcde6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:48.793091 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d06a6933-71bd-4006-9036-ca7fc3fdcde6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:48.794423 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d06a6933-71bd-4006-9036-ca7fc3fdcde6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:48.794882 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d06a6933-71bd-4006-9036-ca7fc3fdcde6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:48.810683 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1c60cb39-3b71-449a-b4a1-1fc4a8621de0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088323 Jun 10 18:02:48.811281 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 895/1749] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:02:48 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:02:48.819870 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-35f6ac29-d5b1-487c-8864-7529720b0d65 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1648115017", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "c7533710-56da-4765-9437-5446e81c3a43"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:02:48.916824 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-35f6ac29-d5b1-487c-8864-7529720b0d65 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] validate_networks() for [('c7533710-56da-4765-9437-5446e81c3a43', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:02:48.972339 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d06a6933-71bd-4006-9036-ca7fc3fdcde6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:48.980536 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d06a6933-71bd-4006-9036-ca7fc3fdcde6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1681 microversion: 2.1 time: 0.201077 Jun 10 18:02:48.991987 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 855/1750] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:48 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1681 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:48.997685 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-291385cf-0d2e-4226-9786-312e9b947c92 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:48.998315 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-291385cf-0d2e-4226-9786-312e9b947c92 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:49.005068 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-291385cf-0d2e-4226-9786-312e9b947c92 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:49.005521 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-291385cf-0d2e-4226-9786-312e9b947c92 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:49.006304 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-291385cf-0d2e-4226-9786-312e9b947c92 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:49.006746 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-291385cf-0d2e-4226-9786-312e9b947c92 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:49.169069 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-291385cf-0d2e-4226-9786-312e9b947c92 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:49.181399 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-291385cf-0d2e-4226-9786-312e9b947c92 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1541 microversion: 2.1 time: 0.188007 Jun 10 18:02:49.191674 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 856/1751] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:48 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1541 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:49.191674 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-cc6bf703-29dc-4d48-b496-3fcc8adda48c req-a5ba37e9-cbb2-4717-b08d-da0ae122f574 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbc49fe4-a119-4ed9-9310-45babff4fec4", "tag": "8e46ecde-2a76-4ced-9d12-e08541a4852f"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:02:49.212629 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-cc6bf703-29dc-4d48-b496-3fcc8adda48c req-a5ba37e9-cbb2-4717-b08d-da0ae122f574 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:49.217847 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-cc6bf703-29dc-4d48-b496-3fcc8adda48c req-a5ba37e9-cbb2-4717-b08d-da0ae122f574 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:49.231368 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-cc6bf703-29dc-4d48-b496-3fcc8adda48c req-a5ba37e9-cbb2-4717-b08d-da0ae122f574 service nova] Creating event network-changed:8e46ecde-2a76-4ced-9d12-e08541a4852f for instance fbc49fe4-a119-4ed9-9310-45babff4fec4 on chh1-master-2 Jun 10 18:02:49.236842 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [req-cc6bf703-29dc-4d48-b496-3fcc8adda48c req-a5ba37e9-cbb2-4717-b08d-da0ae122f574 service nova] Instance fbc49fe4-a119-4ed9-9310-45babff4fec4 is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126594) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 18:02:49.249821 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-cc6bf703-29dc-4d48-b496-3fcc8adda48c req-a5ba37e9-cbb2-4717-b08d-da0ae122f574 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064129 Jun 10 18:02:49.256556 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 857/1752] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:02:49.262370 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7e15feea-11a8-4865-a089-20072d465257 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:49.263084 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7e15feea-11a8-4865-a089-20072d465257 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:49.270634 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7e15feea-11a8-4865-a089-20072d465257 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:49.273338 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7e15feea-11a8-4865-a089-20072d465257 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:49.273338 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7e15feea-11a8-4865-a089-20072d465257 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:49.273338 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7e15feea-11a8-4865-a089-20072d465257 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:49.426755 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-7e15feea-11a8-4865-a089-20072d465257 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lazy-loading 'services' on Instance uuid a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:02:49.478853 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7e15feea-11a8-4865-a089-20072d465257 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1929 microversion: 2.75 time: 0.220804 Jun 10 18:02:49.492604 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 858/1753] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:49 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1929 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:49.737438 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1fda5b9b-4b20-4066-a610-551e4c0c3a2c tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:49.738041 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1fda5b9b-4b20-4066-a610-551e4c0c3a2c tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:49.748650 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1fda5b9b-4b20-4066-a610-551e4c0c3a2c tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:49.749107 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1fda5b9b-4b20-4066-a610-551e4c0c3a2c tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:49.757239 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1fda5b9b-4b20-4066-a610-551e4c0c3a2c tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:49.758146 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1fda5b9b-4b20-4066-a610-551e4c0c3a2c tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:49.987144 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1fda5b9b-4b20-4066-a610-551e4c0c3a2c tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8eb46cd9bd428b9f144077f3d7ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a513641ffb46b091bb50e7b247e9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:50.005822 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1fda5b9b-4b20-4066-a610-551e4c0c3a2c tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "GET /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d" status: 200 len: 1324 microversion: 2.1 time: 0.268080 Jun 10 18:02:50.005822 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 859/1754] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:49 2022] GET /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d => generated 1324 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:02:50.022840 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-35f6ac29-d5b1-487c-8864-7529720b0d65 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:02:50.023428 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-35f6ac29-d5b1-487c-8864-7529720b0d65 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:02:50.024389 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-35f6ac29-d5b1-487c-8864-7529720b0d65 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:02:50.024926 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-35f6ac29-d5b1-487c-8864-7529720b0d65 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:02:50.025457 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-35f6ac29-d5b1-487c-8864-7529720b0d65 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:02:50.036649 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-35f6ac29-d5b1-487c-8864-7529720b0d65 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:50.037242 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-35f6ac29-d5b1-487c-8864-7529720b0d65 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:50.038217 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-35f6ac29-d5b1-487c-8864-7529720b0d65 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:50.038814 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-35f6ac29-d5b1-487c-8864-7529720b0d65 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:50.039587 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-73f0b8eb-43dd-48a9-bb71-22dea6728095 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:50.040204 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-73f0b8eb-43dd-48a9-bb71-22dea6728095 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:50.061069 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-73f0b8eb-43dd-48a9-bb71-22dea6728095 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:50.061528 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-73f0b8eb-43dd-48a9-bb71-22dea6728095 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:50.063653 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-73f0b8eb-43dd-48a9-bb71-22dea6728095 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:50.069483 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-73f0b8eb-43dd-48a9-bb71-22dea6728095 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:50.111384 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-35f6ac29-d5b1-487c-8864-7529720b0d65 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Getting quotas for project 188f32238c2c4e4f993cd11937715216. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:02:50.127382 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-35f6ac29-d5b1-487c-8864-7529720b0d65 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Getting quotas for user 6b1d1a0bd05d43368b969a9cc9435366 and project 188f32238c2c4e4f993cd11937715216. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:02:50.165624 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-35f6ac29-d5b1-487c-8864-7529720b0d65 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:02:50.173232 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-35f6ac29-d5b1-487c-8864-7529720b0d65 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:02:50.322531 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-35f6ac29-d5b1-487c-8864-7529720b0d65 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.510159 Jun 10 18:02:50.326860 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 896/1755] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:02:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:02:50.340903 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5c73845a-6b4c-4cd5-937a-77712f56f58e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:50.342418 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5c73845a-6b4c-4cd5-937a-77712f56f58e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:50.357246 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5c73845a-6b4c-4cd5-937a-77712f56f58e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:50.357246 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5c73845a-6b4c-4cd5-937a-77712f56f58e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:50.359934 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5c73845a-6b4c-4cd5-937a-77712f56f58e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:50.360679 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5c73845a-6b4c-4cd5-937a-77712f56f58e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:50.441613 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5c73845a-6b4c-4cd5-937a-77712f56f58e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.113287 Jun 10 18:02:50.447097 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 897/1756] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:02:50 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d/os-volume_attachments => generated 25 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:02:50.456361 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3729c665-3dea-49d9-8b1e-639f68a041c5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:50.460975 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3729c665-3dea-49d9-8b1e-639f68a041c5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:50.491647 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3729c665-3dea-49d9-8b1e-639f68a041c5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:50.499336 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3729c665-3dea-49d9-8b1e-639f68a041c5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:50.501220 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3729c665-3dea-49d9-8b1e-639f68a041c5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:50.502946 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3729c665-3dea-49d9-8b1e-639f68a041c5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:50.651174 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-73f0b8eb-43dd-48a9-bb71-22dea6728095 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:50.663335 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-73f0b8eb-43dd-48a9-bb71-22dea6728095 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:50.664917 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-73f0b8eb-43dd-48a9-bb71-22dea6728095 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:50.666125 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-73f0b8eb-43dd-48a9-bb71-22dea6728095 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.649846 Jun 10 18:02:50.683075 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 860/1757] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:50 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:50.696117 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-19020e6b-6a2c-458c-88d6-fbb3b54bd6cc tempest-VolumesAdminNegativeTest-334649676 tempest-VolumesAdminNegativeTest-334649676-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "98b25a5e-90c6-468a-b3e7-af872dc10b6b"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:02:50.697633 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-19020e6b-6a2c-458c-88d6-fbb3b54bd6cc tempest-VolumesAdminNegativeTest-334649676 tempest-VolumesAdminNegativeTest-334649676-project-admin] [instance: 00eacc06-d58a-4a76-8ac8-2515de78f44d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:50.712069 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-19020e6b-6a2c-458c-88d6-fbb3b54bd6cc tempest-VolumesAdminNegativeTest-334649676 tempest-VolumesAdminNegativeTest-334649676-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:50.712565 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-19020e6b-6a2c-458c-88d6-fbb3b54bd6cc tempest-VolumesAdminNegativeTest-334649676 tempest-VolumesAdminNegativeTest-334649676-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:50.713343 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-19020e6b-6a2c-458c-88d6-fbb3b54bd6cc tempest-VolumesAdminNegativeTest-334649676 tempest-VolumesAdminNegativeTest-334649676-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:50.713794 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-19020e6b-6a2c-458c-88d6-fbb3b54bd6cc tempest-VolumesAdminNegativeTest-334649676 tempest-VolumesAdminNegativeTest-334649676-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:50.976175 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3729c665-3dea-49d9-8b1e-639f68a041c5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:50.982687 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3729c665-3dea-49d9-8b1e-639f68a041c5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1681 microversion: 2.1 time: 0.534069 Jun 10 18:02:50.985889 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 898/1758] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:50 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1681 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:50.998598 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c9c11c6c-4b4b-432d-accb-41dcd8a792da tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:51.003939 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c9c11c6c-4b4b-432d-accb-41dcd8a792da tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:51.006653 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9c11c6c-4b4b-432d-accb-41dcd8a792da tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:51.007283 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9c11c6c-4b4b-432d-accb-41dcd8a792da tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:51.008222 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9c11c6c-4b4b-432d-accb-41dcd8a792da tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:51.008942 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9c11c6c-4b4b-432d-accb-41dcd8a792da tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:51.033052 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:02:51.168611 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c9c11c6c-4b4b-432d-accb-41dcd8a792da tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:51.180017 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c9c11c6c-4b4b-432d-accb-41dcd8a792da tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1473 microversion: 2.1 time: 0.184944 Jun 10 18:02:51.180564 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 899/1759] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:50 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1473 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:51.205311 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e88e79ce-000d-4a69-a262-c63af21a174d tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:51.213400 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e88e79ce-000d-4a69-a262-c63af21a174d tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:51.310571 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e88e79ce-000d-4a69-a262-c63af21a174d tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:51.317895 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e88e79ce-000d-4a69-a262-c63af21a174d tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8" status: 200 len: 1218 microversion: 2.1 time: 0.121856 Jun 10 18:02:51.331657 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 900/1760] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:51 2022] GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8 => generated 1218 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:51.343834 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-22199833-1795-4d28-a909-712ec79369d8 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:51.344063 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-22199833-1795-4d28-a909-712ec79369d8 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:51.358770 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-22199833-1795-4d28-a909-712ec79369d8 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:51.362771 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-22199833-1795-4d28-a909-712ec79369d8 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:51.363879 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-22199833-1795-4d28-a909-712ec79369d8 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:51.368905 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-22199833-1795-4d28-a909-712ec79369d8 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:51.543462 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-22199833-1795-4d28-a909-712ec79369d8 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lazy-loading 'services' on Instance uuid a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:02:51.564813 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-22199833-1795-4d28-a909-712ec79369d8 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1929 microversion: 2.75 time: 0.231698 Jun 10 18:02:51.566122 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 901/1761] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:51 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1929 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:51.572932 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-ce74bd42-b995-4d91-89ec-6b8cea287453 req-f9c38254-f7a8-47f8-8b9b-938bb45676ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d", "name": "network-vif-plugged", "status": "completed", "tag": "f445eab9-755e-4cb4-8b43-362aa57d1ab2"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:02:51.583895 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-ce74bd42-b995-4d91-89ec-6b8cea287453 req-f9c38254-f7a8-47f8-8b9b-938bb45676ed service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:51.589686 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-ce74bd42-b995-4d91-89ec-6b8cea287453 req-f9c38254-f7a8-47f8-8b9b-938bb45676ed service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:51.611814 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-ce74bd42-b995-4d91-89ec-6b8cea287453 req-f9c38254-f7a8-47f8-8b9b-938bb45676ed service nova] Creating event network-vif-plugged:f445eab9-755e-4cb4-8b43-362aa57d1ab2 for instance d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d on chh1-master-2 Jun 10 18:02:51.623898 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-ce74bd42-b995-4d91-89ec-6b8cea287453 req-f9c38254-f7a8-47f8-8b9b-938bb45676ed service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056222 Jun 10 18:02:51.625588 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 902/1762] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:02:51.638671 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cc4c6458-65e9-4161-87e6-a35326e8e772 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:51.643508 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cc4c6458-65e9-4161-87e6-a35326e8e772 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:51.661913 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc4c6458-65e9-4161-87e6-a35326e8e772 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:51.664197 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc4c6458-65e9-4161-87e6-a35326e8e772 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:51.666920 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc4c6458-65e9-4161-87e6-a35326e8e772 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:51.667610 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc4c6458-65e9-4161-87e6-a35326e8e772 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:51.679019 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-19020e6b-6a2c-458c-88d6-fbb3b54bd6cc tempest-VolumesAdminNegativeTest-334649676 tempest-VolumesAdminNegativeTest-334649676-project-admin] HTTP exception thrown: Volume 69035f6e-72b9-408a-bc9d-8296d99ede92 could not be found. Jun 10 18:02:51.691349 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-19020e6b-6a2c-458c-88d6-fbb3b54bd6cc tempest-VolumesAdminNegativeTest-334649676 tempest-VolumesAdminNegativeTest-334649676-project-admin] Request method failure captured: Jun 10 18:02:51.691349 chdv-master-2 devstack@n-api.service[126594]: request: PUT /compute/v2.1/servers/00eacc06-d58a-4a76-8ac8-2515de78f44d/os-volume_attachments/69035f6e-72b9-408a-bc9d-8296d99ede92 HTTP/1.1 Jun 10 18:02:51.691349 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:02:51.691349 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:02:51.691349 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:02:51.691349 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 74 Jun 10 18:02:51.691349 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:02:51.691349 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:02:51.691349 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:02:51.691349 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:02:51.691349 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4aLsIh4DMVEzajy3FMaGiPdUFmn1i-fxTz05oBZxWAJEJ72Phy4_Erp8W1-pq0sdk7qr8mjmeBH5UVclEoeDxsHBbg_Z1HcfSKsjz0K7VRC29Zee633Xq6nxbUihmLXtf-Nkda0t3pXofJdJq_vwkSaBogYXAy7vT-VEKjMgRBFW6s Jun 10 18:02:51.691349 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:02:51.691349 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:02:51.691349 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:02:51.691349 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:02:51.691349 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:02:51.691349 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:02:51.691349 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 386a578f93a544fa879c76a45d51f95e Jun 10 18:02:51.691349 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-VolumesAdminNegativeTest-334649676 Jun 10 18:02:51.691349 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member,admin Jun 10 18:02:51.691349 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member,admin Jun 10 18:02:51.692863 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/386a578f93a544fa879c76a45d51f95e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/386a578f93a544fa879c76a45d51f95e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/386a578f93a544fa879c76a45d51f95e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_386a578f93a544fa879c76a45d51f95e", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:02:51.692863 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-VolumesAdminNegativeTest-334649676 Jun 10 18:02:51.692863 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 386a578f93a544fa879c76a45d51f95e Jun 10 18:02:51.692863 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-334649676 Jun 10 18:02:51.692863 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-VolumesAdminNegativeTest-334649676-project-admin Jun 10 18:02:51.692863 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:02:51.692863 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:02:51.692863 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: b48ceea384d34634b500496a4ab9cf6c Jun 10 18:02:51.692863 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-VolumesAdminNegativeTest-334649676-project-admin Jun 10 18:02:51.692863 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:02:51.692863 chdv-master-2 devstack@n-api.service[126594]: {"volumeAttachment": {"volumeId": "98b25a5e-90c6-468a-b3e7-af872dc10b6b"}} Jun 10 18:02:51.692863 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:02:51.692863 chdv-master-2 devstack@n-api.service[126594]: exception: Volume 69035f6e-72b9-408a-bc9d-8296d99ede92 could not be found. Jun 10 18:02:51.693705 chdv-master-2 devstack@n-api.service[126594]: action_args: {'server_id': '00eacc06-d58a-4a76-8ac8-2515de78f44d', 'id': '69035f6e-72b9-408a-bc9d-8296d99ede92', 'body': {'volumeAttachment': {'volumeId': '98b25a5e-90c6-468a-b3e7-af872dc10b6b'}}} Jun 10 18:02:51.693705 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:02:51.693705 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:02:51.693705 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 10 18:02:51.693705 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 10 18:02:51.693705 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 10 18:02:51.693705 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 10 18:02:51.693705 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 10 18:02:51.693705 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 10 18:02:51.693705 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 10 18:02:51.693705 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 10 18:02:51.693705 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 10 18:02:51.693705 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 10 18:02:51.693705 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 10 18:02:51.693705 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 10 18:02:51.693705 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 10 18:02:51.693705 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 10 18:02:51.694873 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 69035f6e-72b9-408a-bc9d-8296d99ede92 could not be found. (HTTP 404) (Request-ID: req-0888a9e7-7b12-4930-8292-20f0b5c82d9f) Jun 10 18:02:51.694873 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:02:51.694873 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:02:51.694873 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:02:51.694873 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:02:51.694873 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Jun 10 18:02:51.694873 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Jun 10 18:02:51.694873 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 10 18:02:51.694873 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 10 18:02:51.694873 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 10 18:02:51.694873 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 10 18:02:51.694873 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 10 18:02:51.694873 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 10 18:02:51.694873 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 10 18:02:51.694873 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 10 18:02:51.694873 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 10 18:02:51.694873 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 10 18:02:51.694873 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 10 18:02:51.694873 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 10 18:02:51.702246 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 10 18:02:51.702246 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 10 18:02:51.702246 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 10 18:02:51.702246 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 10 18:02:51.702246 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 10 18:02:51.702246 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 10 18:02:51.702246 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 10 18:02:51.702246 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 10 18:02:51.702246 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 69035f6e-72b9-408a-bc9d-8296d99ede92 could not be found. Jun 10 18:02:51.702246 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:02:51.702246 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:02:51.702246 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:02:51.702246 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:02:51.702246 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:02:51.702246 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:02:51.702246 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:02:51.702246 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:02:51.702246 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:02:51.702246 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:02:51.703499 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:02:51.703499 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:02:51.703499 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:02:51.703499 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:02:51.703499 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jun 10 18:02:51.703499 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jun 10 18:02:51.703499 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Jun 10 18:02:51.703499 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:02:51.703499 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 69035f6e-72b9-408a-bc9d-8296d99ede92 could not be found. Jun 10 18:02:51.703499 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:02:51.703499 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:02:51.703499 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:02:51.703499 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:02:51.703499 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:02:51.703499 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:02:51.703499 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:02:51.703499 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:02:51.703499 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 69035f6e-72b9-408a-bc9d-8296d99ede92 could not be found. Jun 10 18:02:51.703499 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:02:51.704765 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-19020e6b-6a2c-458c-88d6-fbb3b54bd6cc tempest-VolumesAdminNegativeTest-334649676 tempest-VolumesAdminNegativeTest-334649676-project-admin] Returning 404 to user: Volume 69035f6e-72b9-408a-bc9d-8296d99ede92 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:02:51.704765 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-19020e6b-6a2c-458c-88d6-fbb3b54bd6cc tempest-VolumesAdminNegativeTest-334649676 tempest-VolumesAdminNegativeTest-334649676-project-admin] 10.222.0.35 "PUT /compute/v2.1/servers/00eacc06-d58a-4a76-8ac8-2515de78f44d/os-volume_attachments/69035f6e-72b9-408a-bc9d-8296d99ede92" status: 404 len: 109 microversion: 2.1 time: 1.016507 Jun 10 18:02:51.714333 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 861/1763] 10.222.0.35 () {60 vars in 1432 bytes} [Fri Jun 10 18:02:50 2022] PUT /compute/v2.1/servers/00eacc06-d58a-4a76-8ac8-2515de78f44d/os-volume_attachments/69035f6e-72b9-408a-bc9d-8296d99ede92 => generated 109 bytes in 1031 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:02:51.844090 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-5f3a385a-b1fa-4ad4-af07-41bcef4492b0 req-2d81fcac-dcf0-405d-bbcd-c44194554b4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4", "name": "network-vif-deleted", "tag": "d492be44-5990-4f08-b390-1c1031db44f7"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:02:51.874799 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-5f3a385a-b1fa-4ad4-af07-41bcef4492b0 req-2d81fcac-dcf0-405d-bbcd-c44194554b4c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:51.875568 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-5f3a385a-b1fa-4ad4-af07-41bcef4492b0 req-2d81fcac-dcf0-405d-bbcd-c44194554b4c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:51.906064 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-5f3a385a-b1fa-4ad4-af07-41bcef4492b0 req-2d81fcac-dcf0-405d-bbcd-c44194554b4c service nova] Creating event network-vif-deleted:d492be44-5990-4f08-b390-1c1031db44f7 for instance ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 on chh2-master-2 Jun 10 18:02:51.914837 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-5f3a385a-b1fa-4ad4-af07-41bcef4492b0 req-2d81fcac-dcf0-405d-bbcd-c44194554b4c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198511 Jun 10 18:02:51.915433 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 862/1764] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:02:51.930803 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-54782520-e056-4789-b3aa-db0e1612ba89 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:51.944780 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-54782520-e056-4789-b3aa-db0e1612ba89 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:51.963783 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-54782520-e056-4789-b3aa-db0e1612ba89 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:51.964251 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-54782520-e056-4789-b3aa-db0e1612ba89 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:51.965645 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-54782520-e056-4789-b3aa-db0e1612ba89 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:51.966097 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-54782520-e056-4789-b3aa-db0e1612ba89 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:52.169964 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-54782520-e056-4789-b3aa-db0e1612ba89 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:52.186552 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-54782520-e056-4789-b3aa-db0e1612ba89 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:52.188529 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-54782520-e056-4789-b3aa-db0e1612ba89 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:52.190016 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-54782520-e056-4789-b3aa-db0e1612ba89 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.265303 Jun 10 18:02:52.192800 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 863/1765] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:51 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:52.199270 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-238d139f-cfb5-422a-aac0-b18fe942dcbf tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:52.200207 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-238d139f-cfb5-422a-aac0-b18fe942dcbf tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:52.207000 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:02:52.214932 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-238d139f-cfb5-422a-aac0-b18fe942dcbf tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:52.214932 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-238d139f-cfb5-422a-aac0-b18fe942dcbf tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:52.214932 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-238d139f-cfb5-422a-aac0-b18fe942dcbf tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:52.214932 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-238d139f-cfb5-422a-aac0-b18fe942dcbf tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:52.247397 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:02:52.408446 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-238d139f-cfb5-422a-aac0-b18fe942dcbf tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:52.419637 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-238d139f-cfb5-422a-aac0-b18fe942dcbf tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1681 microversion: 2.1 time: 0.225474 Jun 10 18:02:52.423119 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 864/1766] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:52 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1681 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:52.439365 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1cf3caaa-cb98-474a-a562-8ce9d8260f99 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:52.440032 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1cf3caaa-cb98-474a-a562-8ce9d8260f99 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:52.447876 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1cf3caaa-cb98-474a-a562-8ce9d8260f99 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:52.448479 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1cf3caaa-cb98-474a-a562-8ce9d8260f99 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:52.450326 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1cf3caaa-cb98-474a-a562-8ce9d8260f99 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:52.451150 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1cf3caaa-cb98-474a-a562-8ce9d8260f99 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:52.467491 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cc4c6458-65e9-4161-87e6-a35326e8e772 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8eb46cd9bd428b9f144077f3d7ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a513641ffb46b091bb50e7b247e9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:52.483372 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cc4c6458-65e9-4161-87e6-a35326e8e772 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "GET /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d" status: 200 len: 1324 microversion: 2.1 time: 0.855165 Jun 10 18:02:52.487763 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 903/1767] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:51 2022] GET /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d => generated 1324 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:52.496644 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bef9037f-6480-421e-9567-48c1af7c7719 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:52.497270 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bef9037f-6480-421e-9567-48c1af7c7719 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:52.511121 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bef9037f-6480-421e-9567-48c1af7c7719 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:52.527966 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bef9037f-6480-421e-9567-48c1af7c7719 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:52.533862 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bef9037f-6480-421e-9567-48c1af7c7719 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:52.534634 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bef9037f-6480-421e-9567-48c1af7c7719 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:52.738958 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bef9037f-6480-421e-9567-48c1af7c7719 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:52.747864 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bef9037f-6480-421e-9567-48c1af7c7719 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8" status: 200 len: 1270 microversion: 2.1 time: 0.258997 Jun 10 18:02:52.748475 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 904/1768] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:52 2022] GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8 => generated 1270 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:52.762138 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2666f6fa-1777-4831-a9c3-b0511cfa09e3 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:52.765734 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2666f6fa-1777-4831-a9c3-b0511cfa09e3 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:52.777049 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2666f6fa-1777-4831-a9c3-b0511cfa09e3 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:52.784324 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2666f6fa-1777-4831-a9c3-b0511cfa09e3 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:52.786187 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2666f6fa-1777-4831-a9c3-b0511cfa09e3 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:52.789118 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2666f6fa-1777-4831-a9c3-b0511cfa09e3 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:52.934348 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1cf3caaa-cb98-474a-a562-8ce9d8260f99 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:52.948921 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1cf3caaa-cb98-474a-a562-8ce9d8260f99 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1470 microversion: 2.1 time: 0.521843 Jun 10 18:02:52.952767 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 865/1769] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:52 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1470 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:52.971145 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3ed01b5e-c6e6-4441-b76c-52135dc4270d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:02:52.972263 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3ed01b5e-c6e6-4441-b76c-52135dc4270d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:52.986822 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3ed01b5e-c6e6-4441-b76c-52135dc4270d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:52.988499 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3ed01b5e-c6e6-4441-b76c-52135dc4270d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:52.989367 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3ed01b5e-c6e6-4441-b76c-52135dc4270d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:52.993572 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3ed01b5e-c6e6-4441-b76c-52135dc4270d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:53.021565 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-2666f6fa-1777-4831-a9c3-b0511cfa09e3 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lazy-loading 'services' on Instance uuid a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:02:53.059256 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2666f6fa-1777-4831-a9c3-b0511cfa09e3 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1929 microversion: 2.75 time: 0.308227 Jun 10 18:02:53.061664 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 905/1770] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:52 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1929 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:53.121842 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3ed01b5e-c6e6-4441-b76c-52135dc4270d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:53.122676 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3ed01b5e-c6e6-4441-b76c-52135dc4270d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:53.123962 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3ed01b5e-c6e6-4441-b76c-52135dc4270d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:53.124598 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3ed01b5e-c6e6-4441-b76c-52135dc4270d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:53.202351 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-3ed01b5e-c6e6-4441-b76c-52135dc4270d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Getting quotas for project 66fd5e2ed0b84720849784c94f36d5da. Resources: {'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:02:53.211813 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7926048c-b604-4a52-8c36-ab19919f7315 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:53.212452 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7926048c-b604-4a52-8c36-ab19919f7315 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:53.223151 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-3ed01b5e-c6e6-4441-b76c-52135dc4270d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Getting quotas for user 1c74f45bf7fd4dea952d771a649519af and project 66fd5e2ed0b84720849784c94f36d5da. Resources: {'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:02:53.225605 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7926048c-b604-4a52-8c36-ab19919f7315 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:53.226060 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7926048c-b604-4a52-8c36-ab19919f7315 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:53.226848 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7926048c-b604-4a52-8c36-ab19919f7315 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:53.227532 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7926048c-b604-4a52-8c36-ab19919f7315 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:53.534890 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7926048c-b604-4a52-8c36-ab19919f7315 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:53.544079 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7926048c-b604-4a52-8c36-ab19919f7315 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:53.553308 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7926048c-b604-4a52-8c36-ab19919f7315 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:53.553308 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7926048c-b604-4a52-8c36-ab19919f7315 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.343717 Jun 10 18:02:53.553308 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 906/1771] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:53 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:53.569093 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1fbc0ef6-7f1f-44f2-907e-df0a56eea638 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:53.569730 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1fbc0ef6-7f1f-44f2-907e-df0a56eea638 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:53.587978 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1fbc0ef6-7f1f-44f2-907e-df0a56eea638 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:53.589357 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1fbc0ef6-7f1f-44f2-907e-df0a56eea638 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:53.589357 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1fbc0ef6-7f1f-44f2-907e-df0a56eea638 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:53.589629 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1fbc0ef6-7f1f-44f2-907e-df0a56eea638 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:53.849927 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3ed01b5e-c6e6-4441-b76c-52135dc4270d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "POST /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4/action" status: 202 len: 0 microversion: 2.1 time: 0.884768 Jun 10 18:02:53.854428 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 866/1772] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:02:52 2022] POST /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4/action => generated 0 bytes in 890 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:02:53.889963 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d017a540-c3ff-4955-a127-8638b75a9d8c tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:53.895463 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d017a540-c3ff-4955-a127-8638b75a9d8c tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:53.898817 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1fbc0ef6-7f1f-44f2-907e-df0a56eea638 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:53.914842 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1fbc0ef6-7f1f-44f2-907e-df0a56eea638 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1681 microversion: 2.1 time: 0.346775 Jun 10 18:02:53.916614 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 907/1773] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:53 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1681 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:53.928223 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-671a2688-1717-4c70-ba1c-5b35d45e47e5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:53.929253 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-671a2688-1717-4c70-ba1c-5b35d45e47e5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:53.936703 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d017a540-c3ff-4955-a127-8638b75a9d8c tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:53.937245 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d017a540-c3ff-4955-a127-8638b75a9d8c tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:53.938927 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d017a540-c3ff-4955-a127-8638b75a9d8c tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:53.940288 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d017a540-c3ff-4955-a127-8638b75a9d8c tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:53.948832 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-671a2688-1717-4c70-ba1c-5b35d45e47e5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:53.952712 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-671a2688-1717-4c70-ba1c-5b35d45e47e5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:53.954184 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-671a2688-1717-4c70-ba1c-5b35d45e47e5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:53.954817 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-671a2688-1717-4c70-ba1c-5b35d45e47e5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:54.295803 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-671a2688-1717-4c70-ba1c-5b35d45e47e5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:54.306453 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-671a2688-1717-4c70-ba1c-5b35d45e47e5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8" status: 200 len: 1270 microversion: 2.1 time: 0.387164 Jun 10 18:02:54.309976 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 908/1774] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:53 2022] GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8 => generated 1270 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:54.332669 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c88a7617-2510-4d26-a787-d6d007f02a9b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:54.333298 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c88a7617-2510-4d26-a787-d6d007f02a9b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:54.342381 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d017a540-c3ff-4955-a127-8638b75a9d8c tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8eb46cd9bd428b9f144077f3d7ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a513641ffb46b091bb50e7b247e9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:54.352825 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d017a540-c3ff-4955-a127-8638b75a9d8c tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "GET /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d" status: 200 len: 1324 microversion: 2.1 time: 0.493226 Jun 10 18:02:54.353556 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 867/1775] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:53 2022] GET /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d => generated 1324 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:54.362584 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c88a7617-2510-4d26-a787-d6d007f02a9b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:54.362833 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c88a7617-2510-4d26-a787-d6d007f02a9b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:54.363593 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c88a7617-2510-4d26-a787-d6d007f02a9b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:54.364036 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c88a7617-2510-4d26-a787-d6d007f02a9b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:54.376880 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-82edb816-dd80-44f5-84a6-3c054f4219c8 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:54.377591 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-82edb816-dd80-44f5-84a6-3c054f4219c8 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:54.403570 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-82edb816-dd80-44f5-84a6-3c054f4219c8 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:54.407800 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-82edb816-dd80-44f5-84a6-3c054f4219c8 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:54.407800 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-82edb816-dd80-44f5-84a6-3c054f4219c8 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:54.407800 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-82edb816-dd80-44f5-84a6-3c054f4219c8 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:54.693389 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-82edb816-dd80-44f5-84a6-3c054f4219c8 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lazy-loading 'services' on Instance uuid a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:02:54.775739 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-82edb816-dd80-44f5-84a6-3c054f4219c8 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1929 microversion: 2.75 time: 0.415096 Jun 10 18:02:54.793666 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 868/1776] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:54 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1929 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:54.795851 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a5e46d91-f1e0-41a8-97ec-8f80a91e44c1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:54.804696 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a5e46d91-f1e0-41a8-97ec-8f80a91e44c1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:54.814152 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a5e46d91-f1e0-41a8-97ec-8f80a91e44c1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:54.814625 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a5e46d91-f1e0-41a8-97ec-8f80a91e44c1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:54.815416 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a5e46d91-f1e0-41a8-97ec-8f80a91e44c1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:54.815870 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a5e46d91-f1e0-41a8-97ec-8f80a91e44c1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:55.133377 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a5e46d91-f1e0-41a8-97ec-8f80a91e44c1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:55.143745 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a5e46d91-f1e0-41a8-97ec-8f80a91e44c1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:55.148140 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a5e46d91-f1e0-41a8-97ec-8f80a91e44c1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:55.159104 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a5e46d91-f1e0-41a8-97ec-8f80a91e44c1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.365162 Jun 10 18:02:55.175030 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 869/1777] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:54 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:55.181461 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-949b327e-4cc8-42fb-8df2-af93d5d21209 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:55.189934 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-949b327e-4cc8-42fb-8df2-af93d5d21209 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:55.262953 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-949b327e-4cc8-42fb-8df2-af93d5d21209 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:55.265234 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-949b327e-4cc8-42fb-8df2-af93d5d21209 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:55.268009 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-949b327e-4cc8-42fb-8df2-af93d5d21209 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:55.268658 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-949b327e-4cc8-42fb-8df2-af93d5d21209 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:55.305611 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c88a7617-2510-4d26-a787-d6d007f02a9b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:55.324927 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c88a7617-2510-4d26-a787-d6d007f02a9b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1469 microversion: 2.1 time: 1.009802 Jun 10 18:02:55.331038 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 909/1778] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:54 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1469 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:55.354741 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7b5f77f5-1c5d-45e6-ba4f-469646d38ba9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:55.358171 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7b5f77f5-1c5d-45e6-ba4f-469646d38ba9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:55.385912 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b5f77f5-1c5d-45e6-ba4f-469646d38ba9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:55.394536 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b5f77f5-1c5d-45e6-ba4f-469646d38ba9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:55.402267 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b5f77f5-1c5d-45e6-ba4f-469646d38ba9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:55.402267 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b5f77f5-1c5d-45e6-ba4f-469646d38ba9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:55.580138 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7b5f77f5-1c5d-45e6-ba4f-469646d38ba9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:55.592262 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7b5f77f5-1c5d-45e6-ba4f-469646d38ba9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8" status: 200 len: 1276 microversion: 2.1 time: 0.256416 Jun 10 18:02:55.597291 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 910/1779] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:55 2022] GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8 => generated 1276 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:55.611151 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ebc05269-5f5d-473c-95dd-a1f5be00944b tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:55.619627 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ebc05269-5f5d-473c-95dd-a1f5be00944b tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:55.635284 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ebc05269-5f5d-473c-95dd-a1f5be00944b tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:55.650353 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ebc05269-5f5d-473c-95dd-a1f5be00944b tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:55.655635 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ebc05269-5f5d-473c-95dd-a1f5be00944b tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:55.655635 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ebc05269-5f5d-473c-95dd-a1f5be00944b tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:55.687826 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-949b327e-4cc8-42fb-8df2-af93d5d21209 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:55.701929 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-949b327e-4cc8-42fb-8df2-af93d5d21209 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1681 microversion: 2.1 time: 0.524112 Jun 10 18:02:55.705104 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 870/1780] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:55 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1681 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:55.724141 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-3b6b56ff-0c0d-4b7a-a356-709d41d41e77 req-a31edbd9-f7d8-4610-8e66-392681e0b218 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbc49fe4-a119-4ed9-9310-45babff4fec4", "name": "network-vif-plugged", "status": "completed", "tag": "8e46ecde-2a76-4ced-9d12-e08541a4852f"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:02:55.745360 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-3b6b56ff-0c0d-4b7a-a356-709d41d41e77 req-a31edbd9-f7d8-4610-8e66-392681e0b218 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:55.746652 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-3b6b56ff-0c0d-4b7a-a356-709d41d41e77 req-a31edbd9-f7d8-4610-8e66-392681e0b218 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:55.780273 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-3b6b56ff-0c0d-4b7a-a356-709d41d41e77 req-a31edbd9-f7d8-4610-8e66-392681e0b218 service nova] Creating event network-vif-plugged:8e46ecde-2a76-4ced-9d12-e08541a4852f for instance fbc49fe4-a119-4ed9-9310-45babff4fec4 on chh1-master-2 Jun 10 18:02:55.802757 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [req-3b6b56ff-0c0d-4b7a-a356-709d41d41e77 req-a31edbd9-f7d8-4610-8e66-392681e0b218 service nova] Instance fbc49fe4-a119-4ed9-9310-45babff4fec4 is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126594) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 18:02:55.835037 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-3b6b56ff-0c0d-4b7a-a356-709d41d41e77 req-a31edbd9-f7d8-4610-8e66-392681e0b218 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114197 Jun 10 18:02:55.836197 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 871/1781] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:02:55.852514 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4a6962c8-3b25-4bdd-843d-2d1d00e694ae tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:55.853320 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4a6962c8-3b25-4bdd-843d-2d1d00e694ae tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:55.862217 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4a6962c8-3b25-4bdd-843d-2d1d00e694ae tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:55.862953 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4a6962c8-3b25-4bdd-843d-2d1d00e694ae tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:55.863827 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4a6962c8-3b25-4bdd-843d-2d1d00e694ae tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:55.864370 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4a6962c8-3b25-4bdd-843d-2d1d00e694ae tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:56.005195 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-4a6962c8-3b25-4bdd-843d-2d1d00e694ae tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lazy-loading 'services' on Instance uuid a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:02:56.066333 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4a6962c8-3b25-4bdd-843d-2d1d00e694ae tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1929 microversion: 2.75 time: 0.225146 Jun 10 18:02:56.082242 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 872/1782] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:55 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1929 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:56.179083 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a36dd116-bb74-43f0-9fb4-e13f2eb611bd tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:56.180450 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a36dd116-bb74-43f0-9fb4-e13f2eb611bd tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:56.200555 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a36dd116-bb74-43f0-9fb4-e13f2eb611bd tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:56.204687 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a36dd116-bb74-43f0-9fb4-e13f2eb611bd tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:56.204687 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a36dd116-bb74-43f0-9fb4-e13f2eb611bd tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:56.206219 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a36dd116-bb74-43f0-9fb4-e13f2eb611bd tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:56.650075 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a36dd116-bb74-43f0-9fb4-e13f2eb611bd tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:56.666352 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a36dd116-bb74-43f0-9fb4-e13f2eb611bd tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:56.667686 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a36dd116-bb74-43f0-9fb4-e13f2eb611bd tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:56.669478 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a36dd116-bb74-43f0-9fb4-e13f2eb611bd tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.494354 Jun 10 18:02:56.670065 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 873/1783] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:56 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:02:56.687283 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-83cefb12-b1ed-4464-80cb-048fe323a955 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:56.687549 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-83cefb12-b1ed-4464-80cb-048fe323a955 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:56.693932 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-83cefb12-b1ed-4464-80cb-048fe323a955 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:56.694387 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-83cefb12-b1ed-4464-80cb-048fe323a955 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:56.695193 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-83cefb12-b1ed-4464-80cb-048fe323a955 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:56.695631 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-83cefb12-b1ed-4464-80cb-048fe323a955 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:56.836842 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ebc05269-5f5d-473c-95dd-a1f5be00944b tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8eb46cd9bd428b9f144077f3d7ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a513641ffb46b091bb50e7b247e9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:56.867648 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ebc05269-5f5d-473c-95dd-a1f5be00944b tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "GET /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d" status: 200 len: 1520 microversion: 2.1 time: 1.246192 Jun 10 18:02:56.867648 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 911/1784] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:55 2022] GET /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d => generated 1520 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:56.867648 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f5338e56-bb58-476c-9838-926631c2b3e9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:56.867648 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f5338e56-bb58-476c-9838-926631c2b3e9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:56.878096 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f5338e56-bb58-476c-9838-926631c2b3e9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:56.880760 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f5338e56-bb58-476c-9838-926631c2b3e9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:56.881641 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f5338e56-bb58-476c-9838-926631c2b3e9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:56.882086 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f5338e56-bb58-476c-9838-926631c2b3e9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:56.948632 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-83cefb12-b1ed-4464-80cb-048fe323a955 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:56.958917 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-83cefb12-b1ed-4464-80cb-048fe323a955 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1469 microversion: 2.1 time: 0.282166 Jun 10 18:02:56.960041 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 874/1785] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:56 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1469 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:56.969723 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c2613f99-2bfe-4b72-bfd2-60dfeaeb225f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:56.970428 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c2613f99-2bfe-4b72-bfd2-60dfeaeb225f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:56.978227 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c2613f99-2bfe-4b72-bfd2-60dfeaeb225f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:56.978686 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c2613f99-2bfe-4b72-bfd2-60dfeaeb225f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:56.979666 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c2613f99-2bfe-4b72-bfd2-60dfeaeb225f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:56.980880 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c2613f99-2bfe-4b72-bfd2-60dfeaeb225f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:57.164100 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c2613f99-2bfe-4b72-bfd2-60dfeaeb225f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:57.174860 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c2613f99-2bfe-4b72-bfd2-60dfeaeb225f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1681 microversion: 2.1 time: 0.213092 Jun 10 18:02:57.179283 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 875/1786] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:56 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1681 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:57.181438 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-186b42fe-a19e-45a2-88f1-60b703b95a31 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Action: 'create', calling method: .version_select at 0x7f77c0365040>, body: {"pool": null} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:02:58.033111 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f5338e56-bb58-476c-9838-926631c2b3e9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:58.056125 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f5338e56-bb58-476c-9838-926631c2b3e9 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8" status: 200 len: 1318 microversion: 2.1 time: 1.205997 Jun 10 18:02:58.064080 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 912/1787] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:56 2022] GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8 => generated 1318 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:58.089138 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fbce7edc-7642-402a-aaec-90a0c615ec8f tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:58.090758 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fbce7edc-7642-402a-aaec-90a0c615ec8f tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:58.110592 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fbce7edc-7642-402a-aaec-90a0c615ec8f tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:58.115785 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fbce7edc-7642-402a-aaec-90a0c615ec8f tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:58.117492 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fbce7edc-7642-402a-aaec-90a0c615ec8f tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:58.120144 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fbce7edc-7642-402a-aaec-90a0c615ec8f tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:58.365674 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-fbce7edc-7642-402a-aaec-90a0c615ec8f tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lazy-loading 'services' on Instance uuid a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:02:58.419910 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fbce7edc-7642-402a-aaec-90a0c615ec8f tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1929 microversion: 2.75 time: 0.345073 Jun 10 18:02:58.425528 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 913/1788] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:58 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1929 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:58.439762 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fd574dab-d09d-4a4f-96ef-57c25c780102 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:58.442140 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fd574dab-d09d-4a4f-96ef-57c25c780102 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:58.457400 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd574dab-d09d-4a4f-96ef-57c25c780102 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:58.459563 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd574dab-d09d-4a4f-96ef-57c25c780102 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:58.463914 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd574dab-d09d-4a4f-96ef-57c25c780102 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:58.465683 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd574dab-d09d-4a4f-96ef-57c25c780102 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:58.768089 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fd574dab-d09d-4a4f-96ef-57c25c780102 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:58.778077 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fd574dab-d09d-4a4f-96ef-57c25c780102 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:58.787026 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fd574dab-d09d-4a4f-96ef-57c25c780102 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:58.788581 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fd574dab-d09d-4a4f-96ef-57c25c780102 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.360334 Jun 10 18:02:58.800699 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 914/1789] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:02:58 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:02:58.806154 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3089e994-b00c-4025-9229-cf38efee3987 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:58.806864 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3089e994-b00c-4025-9229-cf38efee3987 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: 00eacc06-d58a-4a76-8ac8-2515de78f44d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:58.812657 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:02:58.814342 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3089e994-b00c-4025-9229-cf38efee3987 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:58.817029 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3089e994-b00c-4025-9229-cf38efee3987 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:58.818030 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3089e994-b00c-4025-9229-cf38efee3987 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:58.820141 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3089e994-b00c-4025-9229-cf38efee3987 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:58.870171 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3089e994-b00c-4025-9229-cf38efee3987 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: 00eacc06-d58a-4a76-8ac8-2515de78f44d] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:02:58.915049 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:02:59.390206 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3089e994-b00c-4025-9229-cf38efee3987 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "DELETE /compute/v2.1/servers/00eacc06-d58a-4a76-8ac8-2515de78f44d" status: 204 len: 0 microversion: 2.1 time: 0.587720 Jun 10 18:02:59.390853 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 915/1790] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:02:58 2022] DELETE /compute/v2.1/servers/00eacc06-d58a-4a76-8ac8-2515de78f44d => generated 0 bytes in 589 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:02:59.405440 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-160d6d7e-02ed-4452-99f4-11ffe249992b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:59.406423 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-160d6d7e-02ed-4452-99f4-11ffe249992b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:59.421567 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-160d6d7e-02ed-4452-99f4-11ffe249992b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:59.421567 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-160d6d7e-02ed-4452-99f4-11ffe249992b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:59.422115 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-160d6d7e-02ed-4452-99f4-11ffe249992b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:59.422841 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-160d6d7e-02ed-4452-99f4-11ffe249992b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:59.649529 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-160d6d7e-02ed-4452-99f4-11ffe249992b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:59.658305 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-160d6d7e-02ed-4452-99f4-11ffe249992b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1469 microversion: 2.1 time: 0.266368 Jun 10 18:02:59.668868 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 916/1791] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:59 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1469 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:59.674070 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-26178c29-577f-4b22-9543-c090a05a58b5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:59.674951 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-26178c29-577f-4b22-9543-c090a05a58b5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:59.681797 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-26178c29-577f-4b22-9543-c090a05a58b5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:59.682511 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-26178c29-577f-4b22-9543-c090a05a58b5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:59.684068 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-26178c29-577f-4b22-9543-c090a05a58b5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:59.684740 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-26178c29-577f-4b22-9543-c090a05a58b5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:59.830824 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-26178c29-577f-4b22-9543-c090a05a58b5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:02:59.838968 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-26178c29-577f-4b22-9543-c090a05a58b5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1681 microversion: 2.1 time: 0.168821 Jun 10 18:02:59.839569 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 917/1792] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:59 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:02:59.844439 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8b738d2d-57f2-4423-a7c4-438db3399654 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:02:59.845037 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8b738d2d-57f2-4423-a7c4-438db3399654 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:02:59.851136 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8b738d2d-57f2-4423-a7c4-438db3399654 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:59.852544 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8b738d2d-57f2-4423-a7c4-438db3399654 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:02:59.852544 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8b738d2d-57f2-4423-a7c4-438db3399654 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:02:59.852774 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8b738d2d-57f2-4423-a7c4-438db3399654 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:00.006207 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8b738d2d-57f2-4423-a7c4-438db3399654 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:00.015413 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8b738d2d-57f2-4423-a7c4-438db3399654 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8" status: 200 len: 1318 microversion: 2.1 time: 0.173764 Jun 10 18:03:00.026137 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 918/1793] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:02:59 2022] GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:00.032616 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-98b78495-c67f-4af8-8dad-65920d34cf9d tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:00.037932 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-98b78495-c67f-4af8-8dad-65920d34cf9d tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: 00eacc06-d58a-4a76-8ac8-2515de78f44d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:00.040717 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-98b78495-c67f-4af8-8dad-65920d34cf9d tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:00.041169 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-98b78495-c67f-4af8-8dad-65920d34cf9d tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:00.041935 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-98b78495-c67f-4af8-8dad-65920d34cf9d tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:00.042369 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-98b78495-c67f-4af8-8dad-65920d34cf9d tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:00.081510 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-186b42fe-a19e-45a2-88f1-60b703b95a31 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.904701 Jun 10 18:03:00.087363 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 876/1794] 10.222.0.35 () {60 vars in 1169 bytes} [Fri Jun 10 18:02:57 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2911 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:03:00.087822 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:03:00.101244 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-03f3b5b2-5797-4461-bb20-c2a339fa8151 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:00.101244 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-03f3b5b2-5797-4461-bb20-c2a339fa8151 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:00.106545 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-03f3b5b2-5797-4461-bb20-c2a339fa8151 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:00.107003 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-03f3b5b2-5797-4461-bb20-c2a339fa8151 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:00.107940 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-03f3b5b2-5797-4461-bb20-c2a339fa8151 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:00.108419 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-03f3b5b2-5797-4461-bb20-c2a339fa8151 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:00.190734 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-03f3b5b2-5797-4461-bb20-c2a339fa8151 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lazy-loading 'services' on Instance uuid a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:03:00.195923 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-98b78495-c67f-4af8-8dad-65920d34cf9d tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63889ce9e75140bd9c730857468b7fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce8674b6db3471c8c94e809430651c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:00.205988 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-98b78495-c67f-4af8-8dad-65920d34cf9d tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/00eacc06-d58a-4a76-8ac8-2515de78f44d" status: 200 len: 1512 microversion: 2.1 time: 0.177803 Jun 10 18:03:00.206970 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 919/1795] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:00 2022] GET /compute/v2.1/servers/00eacc06-d58a-4a76-8ac8-2515de78f44d => generated 1512 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:00.209685 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-03f3b5b2-5797-4461-bb20-c2a339fa8151 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1929 microversion: 2.75 time: 0.120356 Jun 10 18:03:00.210264 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 877/1796] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:00 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1929 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:00.213851 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-ac9e4cf2-c7cb-471e-8278-a5ea59084601 req-80015f39-eb3a-4e1e-a35c-356d20ac976e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8", "tag": "e789e333-819f-48ad-8d66-0eca0af19c5e"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:00.220371 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-04447ef3-c4cf-4840-b2c7-ec934a072228 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:00.220996 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-04447ef3-c4cf-4840-b2c7-ec934a072228 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:00.223794 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-ac9e4cf2-c7cb-471e-8278-a5ea59084601 req-80015f39-eb3a-4e1e-a35c-356d20ac976e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:00.224422 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-ac9e4cf2-c7cb-471e-8278-a5ea59084601 req-80015f39-eb3a-4e1e-a35c-356d20ac976e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:00.227562 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-04447ef3-c4cf-4840-b2c7-ec934a072228 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:00.228024 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-04447ef3-c4cf-4840-b2c7-ec934a072228 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:00.228827 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-04447ef3-c4cf-4840-b2c7-ec934a072228 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:00.229457 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-04447ef3-c4cf-4840-b2c7-ec934a072228 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:00.238548 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-ac9e4cf2-c7cb-471e-8278-a5ea59084601 req-80015f39-eb3a-4e1e-a35c-356d20ac976e service nova] Creating event network-changed:e789e333-819f-48ad-8d66-0eca0af19c5e for instance b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8 on chh1-master-2 Jun 10 18:03:00.243634 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-ac9e4cf2-c7cb-471e-8278-a5ea59084601 req-80015f39-eb3a-4e1e-a35c-356d20ac976e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033938 Jun 10 18:03:00.244244 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 920/1797] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:03:00.252066 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fafd8e3d-6bb8-4545-8144-f28d4b416cd5 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-484935267", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "d960cccc-e559-4107-b985-68eb02da9e75"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:00.255411 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:03:00.310841 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-fafd8e3d-6bb8-4545-8144-f28d4b416cd5 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] validate_networks() for [('d960cccc-e559-4107-b985-68eb02da9e75', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:03:00.375154 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-04447ef3-c4cf-4840-b2c7-ec934a072228 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:00.388281 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-04447ef3-c4cf-4840-b2c7-ec934a072228 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:00.390247 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-04447ef3-c4cf-4840-b2c7-ec934a072228 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:00.391740 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-04447ef3-c4cf-4840-b2c7-ec934a072228 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.180282 Jun 10 18:03:00.393157 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 878/1798] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:00 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:00.675467 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-72a8fe9e-b320-48cc-af7a-104a3be76017 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:00.684172 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-72a8fe9e-b320-48cc-af7a-104a3be76017 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:00.684172 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-72a8fe9e-b320-48cc-af7a-104a3be76017 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:00.684172 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-72a8fe9e-b320-48cc-af7a-104a3be76017 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:00.684571 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-72a8fe9e-b320-48cc-af7a-104a3be76017 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:00.685008 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-72a8fe9e-b320-48cc-af7a-104a3be76017 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:00.774469 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-fafd8e3d-6bb8-4545-8144-f28d4b416cd5 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:03:00.774977 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-fafd8e3d-6bb8-4545-8144-f28d4b416cd5 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:03:00.775515 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-fafd8e3d-6bb8-4545-8144-f28d4b416cd5 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:03:00.776003 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-fafd8e3d-6bb8-4545-8144-f28d4b416cd5 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:03:00.776535 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-fafd8e3d-6bb8-4545-8144-f28d4b416cd5 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:03:00.791453 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fafd8e3d-6bb8-4545-8144-f28d4b416cd5 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:00.792208 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fafd8e3d-6bb8-4545-8144-f28d4b416cd5 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:00.794024 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fafd8e3d-6bb8-4545-8144-f28d4b416cd5 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:00.800964 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fafd8e3d-6bb8-4545-8144-f28d4b416cd5 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:00.847789 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-fafd8e3d-6bb8-4545-8144-f28d4b416cd5 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Getting quotas for project b4a513641ffb46b091bb50e7b247e9a4. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:03:00.856699 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-fafd8e3d-6bb8-4545-8144-f28d4b416cd5 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Getting quotas for user 5b8eb46cd9bd428b9f144077f3d7ed9f and project b4a513641ffb46b091bb50e7b247e9a4. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:03:00.872496 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-72a8fe9e-b320-48cc-af7a-104a3be76017 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:00.873723 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fafd8e3d-6bb8-4545-8144-f28d4b416cd5 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:03:00.878314 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fafd8e3d-6bb8-4545-8144-f28d4b416cd5 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:03:00.885870 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-72a8fe9e-b320-48cc-af7a-104a3be76017 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1469 microversion: 2.1 time: 0.214363 Jun 10 18:03:00.887211 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 879/1799] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:00 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1469 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:03:00.897297 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f69e963e-7fc0-4294-a77e-c60b702db274 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:00.897908 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f69e963e-7fc0-4294-a77e-c60b702db274 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:00.904905 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f69e963e-7fc0-4294-a77e-c60b702db274 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:00.905364 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f69e963e-7fc0-4294-a77e-c60b702db274 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:00.906142 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f69e963e-7fc0-4294-a77e-c60b702db274 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:00.906579 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f69e963e-7fc0-4294-a77e-c60b702db274 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:01.040538 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fafd8e3d-6bb8-4545-8144-f28d4b416cd5 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.793626 Jun 10 18:03:01.050122 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 921/1800] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:03:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:03:01.059820 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-16350be6-d4d6-44f6-a662-fa99e66e6a58 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:01.061402 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-16350be6-d4d6-44f6-a662-fa99e66e6a58 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:01.069887 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-16350be6-d4d6-44f6-a662-fa99e66e6a58 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:01.073062 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-16350be6-d4d6-44f6-a662-fa99e66e6a58 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:01.073062 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-16350be6-d4d6-44f6-a662-fa99e66e6a58 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:01.073062 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-16350be6-d4d6-44f6-a662-fa99e66e6a58 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:01.083089 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f69e963e-7fc0-4294-a77e-c60b702db274 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:01.094078 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f69e963e-7fc0-4294-a77e-c60b702db274 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1681 microversion: 2.1 time: 0.204853 Jun 10 18:03:01.097859 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 880/1801] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:00 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1681 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:01.112089 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b4fd7805-c860-4254-ba8a-4b1c85bce6f0 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:01.113612 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b4fd7805-c860-4254-ba8a-4b1c85bce6f0 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:01.207195 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b4fd7805-c860-4254-ba8a-4b1c85bce6f0 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8eb46cd9bd428b9f144077f3d7ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a513641ffb46b091bb50e7b247e9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:01.220589 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b4fd7805-c860-4254-ba8a-4b1c85bce6f0 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "GET /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193" status: 200 len: 1223 microversion: 2.1 time: 0.122293 Jun 10 18:03:01.230570 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 881/1802] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:01 2022] GET /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193 => generated 1223 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:01.239137 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5076d57b-7182-4592-9182-0e6d44ab1b13 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:01.240746 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5076d57b-7182-4592-9182-0e6d44ab1b13 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: 00eacc06-d58a-4a76-8ac8-2515de78f44d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:01.257072 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5076d57b-7182-4592-9182-0e6d44ab1b13 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:01.257072 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5076d57b-7182-4592-9182-0e6d44ab1b13 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:01.257072 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5076d57b-7182-4592-9182-0e6d44ab1b13 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:01.257072 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5076d57b-7182-4592-9182-0e6d44ab1b13 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:01.432577 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-16350be6-d4d6-44f6-a662-fa99e66e6a58 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:01.441384 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-16350be6-d4d6-44f6-a662-fa99e66e6a58 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8" status: 200 len: 1318 microversion: 2.1 time: 0.395173 Jun 10 18:03:01.441960 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 922/1803] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:01 2022] GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8 => generated 1318 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:01.446535 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9da73d3d-9b88-46aa-967a-e86d4f8d75d3 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:01.447134 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9da73d3d-9b88-46aa-967a-e86d4f8d75d3 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:01.463714 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9da73d3d-9b88-46aa-967a-e86d4f8d75d3 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:01.463714 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9da73d3d-9b88-46aa-967a-e86d4f8d75d3 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:01.463714 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9da73d3d-9b88-46aa-967a-e86d4f8d75d3 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:01.463714 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9da73d3d-9b88-46aa-967a-e86d4f8d75d3 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:01.465452 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5076d57b-7182-4592-9182-0e6d44ab1b13 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63889ce9e75140bd9c730857468b7fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce8674b6db3471c8c94e809430651c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:01.478565 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5076d57b-7182-4592-9182-0e6d44ab1b13 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/00eacc06-d58a-4a76-8ac8-2515de78f44d" status: 200 len: 1512 microversion: 2.1 time: 0.246450 Jun 10 18:03:01.479146 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 882/1804] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:01 2022] GET /compute/v2.1/servers/00eacc06-d58a-4a76-8ac8-2515de78f44d => generated 1512 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:01.485789 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-850ff16b-ac82-4a2f-b4c9-f36d0620f0a2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:01.489353 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-850ff16b-ac82-4a2f-b4c9-f36d0620f0a2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:01.494157 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-850ff16b-ac82-4a2f-b4c9-f36d0620f0a2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:01.494703 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-850ff16b-ac82-4a2f-b4c9-f36d0620f0a2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:01.495623 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-850ff16b-ac82-4a2f-b4c9-f36d0620f0a2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:01.496717 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-850ff16b-ac82-4a2f-b4c9-f36d0620f0a2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:01.563943 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-9da73d3d-9b88-46aa-967a-e86d4f8d75d3 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lazy-loading 'services' on Instance uuid a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:03:01.593249 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9da73d3d-9b88-46aa-967a-e86d4f8d75d3 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1929 microversion: 2.75 time: 0.149809 Jun 10 18:03:01.598906 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 923/1805] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:01 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1929 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:01.655982 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-850ff16b-ac82-4a2f-b4c9-f36d0620f0a2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:01.669057 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-850ff16b-ac82-4a2f-b4c9-f36d0620f0a2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:01.671538 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-850ff16b-ac82-4a2f-b4c9-f36d0620f0a2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:01.673229 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-850ff16b-ac82-4a2f-b4c9-f36d0620f0a2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.191539 Jun 10 18:03:01.673759 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 883/1806] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:01 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:01.905340 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-57c8d69e-9443-4d55-ba5b-9f66ebec6304 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:01.906514 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-57c8d69e-9443-4d55-ba5b-9f66ebec6304 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:01.913028 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-57c8d69e-9443-4d55-ba5b-9f66ebec6304 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:01.913551 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-57c8d69e-9443-4d55-ba5b-9f66ebec6304 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:01.914379 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-57c8d69e-9443-4d55-ba5b-9f66ebec6304 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:01.922541 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-57c8d69e-9443-4d55-ba5b-9f66ebec6304 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:02.116668 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cd9ab8cb-6c25-4e48-9946-34377dc62a6d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:02.118767 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cd9ab8cb-6c25-4e48-9946-34377dc62a6d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:02.134028 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cd9ab8cb-6c25-4e48-9946-34377dc62a6d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:02.135356 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cd9ab8cb-6c25-4e48-9946-34377dc62a6d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:02.136235 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cd9ab8cb-6c25-4e48-9946-34377dc62a6d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:02.136830 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cd9ab8cb-6c25-4e48-9946-34377dc62a6d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:02.216027 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-57c8d69e-9443-4d55-ba5b-9f66ebec6304 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:02.224757 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-57c8d69e-9443-4d55-ba5b-9f66ebec6304 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1469 microversion: 2.1 time: 0.324029 Jun 10 18:03:02.225535 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 924/1807] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:01 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1469 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:02.240820 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c1949dc0-705c-4345-97b7-29ec48e42ca9 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:02.241785 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c1949dc0-705c-4345-97b7-29ec48e42ca9 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:02.247860 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c1949dc0-705c-4345-97b7-29ec48e42ca9 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:02.248683 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c1949dc0-705c-4345-97b7-29ec48e42ca9 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:02.249660 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c1949dc0-705c-4345-97b7-29ec48e42ca9 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:02.251654 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c1949dc0-705c-4345-97b7-29ec48e42ca9 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:02.341906 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cd9ab8cb-6c25-4e48-9946-34377dc62a6d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:02.349403 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cd9ab8cb-6c25-4e48-9946-34377dc62a6d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.236617 Jun 10 18:03:02.350039 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 884/1808] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:02 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:02.377500 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c1949dc0-705c-4345-97b7-29ec48e42ca9 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8eb46cd9bd428b9f144077f3d7ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a513641ffb46b091bb50e7b247e9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:02.388915 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c1949dc0-705c-4345-97b7-29ec48e42ca9 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "GET /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193" status: 200 len: 1227 microversion: 2.1 time: 0.152496 Jun 10 18:03:02.398385 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 925/1809] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:02 2022] GET /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193 => generated 1227 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:02.459773 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e998124e-797b-4eab-999d-0c64c7945999 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:02.460673 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e998124e-797b-4eab-999d-0c64c7945999 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:02.471668 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e998124e-797b-4eab-999d-0c64c7945999 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:02.472660 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e998124e-797b-4eab-999d-0c64c7945999 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:02.473901 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e998124e-797b-4eab-999d-0c64c7945999 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:02.474559 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e998124e-797b-4eab-999d-0c64c7945999 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:02.495912 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8aa706bf-fbd0-4ba4-b30d-c64e6de5afcf tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:02.496557 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8aa706bf-fbd0-4ba4-b30d-c64e6de5afcf tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: 00eacc06-d58a-4a76-8ac8-2515de78f44d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:02.504262 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8aa706bf-fbd0-4ba4-b30d-c64e6de5afcf tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:02.505706 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8aa706bf-fbd0-4ba4-b30d-c64e6de5afcf tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:02.506842 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8aa706bf-fbd0-4ba4-b30d-c64e6de5afcf tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:02.507492 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8aa706bf-fbd0-4ba4-b30d-c64e6de5afcf tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:02.618838 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8aa706bf-fbd0-4ba4-b30d-c64e6de5afcf tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63889ce9e75140bd9c730857468b7fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce8674b6db3471c8c94e809430651c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:02.630515 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8aa706bf-fbd0-4ba4-b30d-c64e6de5afcf tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/00eacc06-d58a-4a76-8ac8-2515de78f44d" status: 200 len: 1470 microversion: 2.1 time: 0.139378 Jun 10 18:03:02.647099 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 926/1810] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:02 2022] GET /compute/v2.1/servers/00eacc06-d58a-4a76-8ac8-2515de78f44d => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:03:02.653415 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cb4b7449-3fcd-49df-95e7-dfff4a21efed tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:02.655072 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cb4b7449-3fcd-49df-95e7-dfff4a21efed tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:02.684859 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cb4b7449-3fcd-49df-95e7-dfff4a21efed tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:02.687757 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cb4b7449-3fcd-49df-95e7-dfff4a21efed tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:02.687757 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cb4b7449-3fcd-49df-95e7-dfff4a21efed tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:02.687757 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cb4b7449-3fcd-49df-95e7-dfff4a21efed tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:02.788606 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e998124e-797b-4eab-999d-0c64c7945999 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:02.798673 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e998124e-797b-4eab-999d-0c64c7945999 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8" status: 200 len: 1318 microversion: 2.1 time: 0.344150 Jun 10 18:03:02.799340 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 885/1811] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:02 2022] GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8 => generated 1318 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:02.805596 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-c39e4aa1-bd6d-46ac-ad83-39d84eeea54a req-b0ab3b4f-e06d-46ec-a38a-88beb605fe12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00eacc06-d58a-4a76-8ac8-2515de78f44d", "name": "network-vif-deleted", "tag": "276c472d-da12-416e-ac34-c63ed6266e5c"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:02.815384 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-c39e4aa1-bd6d-46ac-ad83-39d84eeea54a req-b0ab3b4f-e06d-46ec-a38a-88beb605fe12 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:02.816103 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-c39e4aa1-bd6d-46ac-ad83-39d84eeea54a req-b0ab3b4f-e06d-46ec-a38a-88beb605fe12 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:02.816843 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-cb4b7449-3fcd-49df-95e7-dfff4a21efed tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lazy-loading 'services' on Instance uuid a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:03:02.833264 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-c39e4aa1-bd6d-46ac-ad83-39d84eeea54a req-b0ab3b4f-e06d-46ec-a38a-88beb605fe12 service nova] Creating event network-vif-deleted:276c472d-da12-416e-ac34-c63ed6266e5c for instance 00eacc06-d58a-4a76-8ac8-2515de78f44d on chh1-master-2 Jun 10 18:03:02.839444 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-c39e4aa1-bd6d-46ac-ad83-39d84eeea54a req-b0ab3b4f-e06d-46ec-a38a-88beb605fe12 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038320 Jun 10 18:03:02.841545 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 886/1812] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:03:02.848895 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cb4b7449-3fcd-49df-95e7-dfff4a21efed tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1929 microversion: 2.75 time: 0.200082 Jun 10 18:03:02.848895 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 927/1813] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:02 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1929 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:02.849168 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a0439f60-159e-4ade-a9b5-3733f439dcea tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:02.850021 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a0439f60-159e-4ade-a9b5-3733f439dcea tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:02.857836 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a0439f60-159e-4ade-a9b5-3733f439dcea tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:02.858575 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a0439f60-159e-4ade-a9b5-3733f439dcea tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:02.859535 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a0439f60-159e-4ade-a9b5-3733f439dcea tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:02.859985 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a0439f60-159e-4ade-a9b5-3733f439dcea tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:03.034538 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-cdd11abf-4360-4518-bfce-93f232faece9 req-358ec024-2aca-4e52-baec-cb699ae3a5fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbc49fe4-a119-4ed9-9310-45babff4fec4", "name": "network-vif-unplugged", "status": "completed", "tag": "8e46ecde-2a76-4ced-9d12-e08541a4852f"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:03.061024 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-cdd11abf-4360-4518-bfce-93f232faece9 req-358ec024-2aca-4e52-baec-cb699ae3a5fa service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:03.068663 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-cdd11abf-4360-4518-bfce-93f232faece9 req-358ec024-2aca-4e52-baec-cb699ae3a5fa service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:03.110058 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-cdd11abf-4360-4518-bfce-93f232faece9 req-358ec024-2aca-4e52-baec-cb699ae3a5fa service nova] Creating event network-vif-unplugged:8e46ecde-2a76-4ced-9d12-e08541a4852f for instance fbc49fe4-a119-4ed9-9310-45babff4fec4 on chh2-master-2 Jun 10 18:03:03.121541 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [req-cdd11abf-4360-4518-bfce-93f232faece9 req-358ec024-2aca-4e52-baec-cb699ae3a5fa service nova] Instance fbc49fe4-a119-4ed9-9310-45babff4fec4 is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 18:03:03.147133 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-cdd11abf-4360-4518-bfce-93f232faece9 req-358ec024-2aca-4e52-baec-cb699ae3a5fa service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.213927 Jun 10 18:03:03.148665 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 928/1814] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:03:03.148872 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=3 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:03:03.166659 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b10dd2b3-b21f-4720-93af-a721b658ca88 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:03.166659 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b10dd2b3-b21f-4720-93af-a721b658ca88 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:03.171432 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b10dd2b3-b21f-4720-93af-a721b658ca88 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:03.172430 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b10dd2b3-b21f-4720-93af-a721b658ca88 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:03.173576 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b10dd2b3-b21f-4720-93af-a721b658ca88 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:03.174479 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b10dd2b3-b21f-4720-93af-a721b658ca88 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:03.186473 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a0439f60-159e-4ade-a9b5-3733f439dcea tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:03.208961 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a0439f60-159e-4ade-a9b5-3733f439dcea tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:03.210476 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a0439f60-159e-4ade-a9b5-3733f439dcea tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:03.211734 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a0439f60-159e-4ade-a9b5-3733f439dcea tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.368433 Jun 10 18:03:03.212325 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 887/1815] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:02 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:03.243305 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-652aad15-e055-434b-ad03-6699e64e9b2b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:03.244918 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-652aad15-e055-434b-ad03-6699e64e9b2b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:03.254642 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-652aad15-e055-434b-ad03-6699e64e9b2b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:03.256503 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-652aad15-e055-434b-ad03-6699e64e9b2b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:03.258352 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-652aad15-e055-434b-ad03-6699e64e9b2b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:03.259538 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-652aad15-e055-434b-ad03-6699e64e9b2b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:03.479754 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-652aad15-e055-434b-ad03-6699e64e9b2b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:03.489720 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-652aad15-e055-434b-ad03-6699e64e9b2b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1535 microversion: 2.1 time: 0.250663 Jun 10 18:03:03.500390 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 888/1816] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:03 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1535 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:03.516581 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d118cea9-e7b9-43aa-ade8-afae34f2db1d tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:03.518195 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d118cea9-e7b9-43aa-ade8-afae34f2db1d tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:03.526518 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d118cea9-e7b9-43aa-ade8-afae34f2db1d tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:03.527582 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d118cea9-e7b9-43aa-ade8-afae34f2db1d tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:03.529674 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d118cea9-e7b9-43aa-ade8-afae34f2db1d tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:03.529674 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d118cea9-e7b9-43aa-ade8-afae34f2db1d tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:03.607855 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b10dd2b3-b21f-4720-93af-a721b658ca88 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:03.620402 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b10dd2b3-b21f-4720-93af-a721b658ca88 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.468943 Jun 10 18:03:03.633532 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 929/1817] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:03 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:03.651878 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8af1c560-e8f1-4e8e-abc9-e75da984b6fe tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:03.657819 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8af1c560-e8f1-4e8e-abc9-e75da984b6fe tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: 00eacc06-d58a-4a76-8ac8-2515de78f44d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:03.667662 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8af1c560-e8f1-4e8e-abc9-e75da984b6fe tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:03.668458 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8af1c560-e8f1-4e8e-abc9-e75da984b6fe tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:03.669462 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8af1c560-e8f1-4e8e-abc9-e75da984b6fe tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:03.670106 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8af1c560-e8f1-4e8e-abc9-e75da984b6fe tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:03.675720 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d118cea9-e7b9-43aa-ade8-afae34f2db1d tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8eb46cd9bd428b9f144077f3d7ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a513641ffb46b091bb50e7b247e9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:03.691455 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d118cea9-e7b9-43aa-ade8-afae34f2db1d tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "GET /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193" status: 200 len: 1219 microversion: 2.1 time: 0.175416 Jun 10 18:03:03.702414 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 889/1818] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:03 2022] GET /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193 => generated 1219 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:03.731267 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8af1c560-e8f1-4e8e-abc9-e75da984b6fe tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:03.734975 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8af1c560-e8f1-4e8e-abc9-e75da984b6fe tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:03.737146 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-8af1c560-e8f1-4e8e-abc9-e75da984b6fe tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lazy-loading 'fault' on Instance uuid 00eacc06-d58a-4a76-8ac8-2515de78f44d {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:03:03.812344 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8af1c560-e8f1-4e8e-abc9-e75da984b6fe tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63889ce9e75140bd9c730857468b7fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce8674b6db3471c8c94e809430651c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:03.815319 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8fc631d3-fce5-4d41-bc1c-7db213686570 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:03.816017 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8fc631d3-fce5-4d41-bc1c-7db213686570 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:03.827900 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8fc631d3-fce5-4d41-bc1c-7db213686570 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:03.828393 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8fc631d3-fce5-4d41-bc1c-7db213686570 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:03.829435 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8fc631d3-fce5-4d41-bc1c-7db213686570 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:03.829894 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8fc631d3-fce5-4d41-bc1c-7db213686570 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:03.834180 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8af1c560-e8f1-4e8e-abc9-e75da984b6fe tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/00eacc06-d58a-4a76-8ac8-2515de78f44d" status: 200 len: 1307 microversion: 2.1 time: 0.184626 Jun 10 18:03:03.834180 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 930/1819] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:03 2022] GET /compute/v2.1/servers/00eacc06-d58a-4a76-8ac8-2515de78f44d => generated 1307 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:03:03.867794 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4b3820db-8db2-4ede-864d-78ab2646022c tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:03.869460 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4b3820db-8db2-4ede-864d-78ab2646022c tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:03.891648 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4b3820db-8db2-4ede-864d-78ab2646022c tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:03.897852 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4b3820db-8db2-4ede-864d-78ab2646022c tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:03.901478 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4b3820db-8db2-4ede-864d-78ab2646022c tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:03.901997 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4b3820db-8db2-4ede-864d-78ab2646022c tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:04.087361 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-4b3820db-8db2-4ede-864d-78ab2646022c tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lazy-loading 'services' on Instance uuid a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:03:04.094597 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:03:04.114113 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4b3820db-8db2-4ede-864d-78ab2646022c tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1929 microversion: 2.75 time: 0.251764 Jun 10 18:03:04.114705 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 931/1820] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:03 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1929 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:04.171034 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8fc631d3-fce5-4d41-bc1c-7db213686570 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:04.180852 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8fc631d3-fce5-4d41-bc1c-7db213686570 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8" status: 200 len: 1318 microversion: 2.1 time: 0.369272 Jun 10 18:03:04.181667 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 890/1821] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:03 2022] GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8 => generated 1318 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:03:04.235934 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-130b06e6-624f-401c-9482-f46bff573c7f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:04.236718 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-130b06e6-624f-401c-9482-f46bff573c7f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:04.254731 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-130b06e6-624f-401c-9482-f46bff573c7f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:04.254731 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-130b06e6-624f-401c-9482-f46bff573c7f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:04.254731 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-130b06e6-624f-401c-9482-f46bff573c7f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:04.254731 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-130b06e6-624f-401c-9482-f46bff573c7f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:04.510721 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4e663006-a6c2-45c1-bc23-6ce09e779a91 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:04.511962 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4e663006-a6c2-45c1-bc23-6ce09e779a91 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:04.534722 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4e663006-a6c2-45c1-bc23-6ce09e779a91 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:04.536789 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4e663006-a6c2-45c1-bc23-6ce09e779a91 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:04.537651 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4e663006-a6c2-45c1-bc23-6ce09e779a91 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:04.538106 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4e663006-a6c2-45c1-bc23-6ce09e779a91 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:04.593053 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-130b06e6-624f-401c-9482-f46bff573c7f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:04.608370 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-130b06e6-624f-401c-9482-f46bff573c7f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:04.611038 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-130b06e6-624f-401c-9482-f46bff573c7f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:04.613504 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-130b06e6-624f-401c-9482-f46bff573c7f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.386708 Jun 10 18:03:04.614091 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 932/1822] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:04 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:04.710618 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d487b828-a40d-400e-8af9-235bcba756e9 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:04.711228 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d487b828-a40d-400e-8af9-235bcba756e9 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:04.720030 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d487b828-a40d-400e-8af9-235bcba756e9 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:04.720902 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d487b828-a40d-400e-8af9-235bcba756e9 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:04.723758 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d487b828-a40d-400e-8af9-235bcba756e9 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:04.723758 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d487b828-a40d-400e-8af9-235bcba756e9 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:04.859144 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4e663006-a6c2-45c1-bc23-6ce09e779a91 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:04.890777 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4e663006-a6c2-45c1-bc23-6ce09e779a91 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1535 microversion: 2.1 time: 0.386343 Jun 10 18:03:04.904932 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 891/1823] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:04 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1535 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:03:04.917787 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1117b591-e547-4477-a5b2-3e5edc1c9194 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:04.918598 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1117b591-e547-4477-a5b2-3e5edc1c9194 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: 00eacc06-d58a-4a76-8ac8-2515de78f44d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:04.933201 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1117b591-e547-4477-a5b2-3e5edc1c9194 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:04.942540 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1117b591-e547-4477-a5b2-3e5edc1c9194 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:04.942540 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1117b591-e547-4477-a5b2-3e5edc1c9194 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:04.942540 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1117b591-e547-4477-a5b2-3e5edc1c9194 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:04.955213 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-1117b591-e547-4477-a5b2-3e5edc1c9194 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] HTTP exception thrown: Instance 00eacc06-d58a-4a76-8ac8-2515de78f44d could not be found. Jun 10 18:03:04.957424 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1117b591-e547-4477-a5b2-3e5edc1c9194 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Request method failure captured: Jun 10 18:03:04.957424 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/00eacc06-d58a-4a76-8ac8-2515de78f44d HTTP/1.1 Jun 10 18:03:04.957424 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:03:04.957424 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:03:04.957424 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:03:04.957424 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:03:04.957424 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:03:04.957424 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:03:04.957424 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:03:04.957424 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:03:04.957424 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4Z5DPhCwDxR1s7DUPyjuelM5dRSgWaZBXvILztBCbIwgm2hlLtnbPz-xJtOIFfgF5_02bnUfTXud8xZIeDZeEHuEkzUz0GPwElwhX45xYjpht0VbHWYeBZYFi00fQe8UPjMhAbwnySsXCvIspXY3E7BHYY8QWT-0FPNePSz585EAeQ Jun 10 18:03:04.957424 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:03:04.957424 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:03:04.957424 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:03:04.957424 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:03:04.957424 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:03:04.957424 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:03:04.957424 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: dce8674b6db3471c8c94e809430651c4 Jun 10 18:03:04.957424 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-VolumesAdminNegativeTest-1543597419 Jun 10 18:03:04.957424 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:03:04.957424 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:03:04.959079 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/dce8674b6db3471c8c94e809430651c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/dce8674b6db3471c8c94e809430651c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/dce8674b6db3471c8c94e809430651c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_dce8674b6db3471c8c94e809430651c4", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:03:04.959079 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-VolumesAdminNegativeTest-1543597419 Jun 10 18:03:04.959079 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: dce8674b6db3471c8c94e809430651c4 Jun 10 18:03:04.959079 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1543597419 Jun 10 18:03:04.959079 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-VolumesAdminNegativeTest-1543597419-project Jun 10 18:03:04.959079 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:03:04.959079 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:03:04.959079 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 63889ce9e75140bd9c730857468b7fd5 Jun 10 18:03:04.959079 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-VolumesAdminNegativeTest-1543597419-project Jun 10 18:03:04.959079 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:03:04.959079 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 00eacc06-d58a-4a76-8ac8-2515de78f44d could not be found. Jun 10 18:03:04.959079 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '00eacc06-d58a-4a76-8ac8-2515de78f44d'} Jun 10 18:03:04.960044 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:03:04.960044 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:04.960044 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:03:04.960044 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:03:04.960044 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:03:04.960044 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:03:04.960044 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:03:04.960044 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:03:04.960044 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:03:04.960044 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:03:04.960044 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00eacc06-d58a-4a76-8ac8-2515de78f44d could not be found. Jun 10 18:03:04.960044 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:04.960044 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:03:04.960044 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:04.960044 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:04.960044 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:03:04.960044 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:03:04.960044 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:03:04.960044 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:03:04.960044 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:03:04.961905 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:03:04.961905 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:03:04.961905 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:03:04.961905 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:03:04.961905 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:03:04.961905 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:03:04.961905 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:03:04.961905 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00eacc06-d58a-4a76-8ac8-2515de78f44d could not be found. Jun 10 18:03:04.961905 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:04.961905 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:03:04.961905 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:04.961905 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:04.961905 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:03:04.961905 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:03:04.961905 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:03:04.961905 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:03:04.961905 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00eacc06-d58a-4a76-8ac8-2515de78f44d could not be found. Jun 10 18:03:04.961905 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:04.963680 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1117b591-e547-4477-a5b2-3e5edc1c9194 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Returning 404 to user: Instance 00eacc06-d58a-4a76-8ac8-2515de78f44d could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:03:04.963786 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d487b828-a40d-400e-8af9-235bcba756e9 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8eb46cd9bd428b9f144077f3d7ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a513641ffb46b091bb50e7b247e9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:04.972223 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d487b828-a40d-400e-8af9-235bcba756e9 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "GET /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193" status: 200 len: 1283 microversion: 2.1 time: 0.265719 Jun 10 18:03:04.982315 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 933/1824] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:04 2022] GET /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193 => generated 1283 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:04.982991 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1117b591-e547-4477-a5b2-3e5edc1c9194 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/00eacc06-d58a-4a76-8ac8-2515de78f44d" status: 404 len: 111 microversion: 2.1 time: 0.049320 Jun 10 18:03:04.982991 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 892/1825] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:04 2022] GET /compute/v2.1/servers/00eacc06-d58a-4a76-8ac8-2515de78f44d => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:03:05.031506 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-134a07e7-1603-4cae-8803-937a2928b0f1 req-40cfd4a5-9586-466d-baa8-a2703fb1f858 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbc49fe4-a119-4ed9-9310-45babff4fec4", "tag": "8e46ecde-2a76-4ced-9d12-e08541a4852f"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:05.048200 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-134a07e7-1603-4cae-8803-937a2928b0f1 req-40cfd4a5-9586-466d-baa8-a2703fb1f858 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:05.050728 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-134a07e7-1603-4cae-8803-937a2928b0f1 req-40cfd4a5-9586-466d-baa8-a2703fb1f858 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:05.079030 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-134a07e7-1603-4cae-8803-937a2928b0f1 req-40cfd4a5-9586-466d-baa8-a2703fb1f858 service nova] Creating event network-changed:8e46ecde-2a76-4ced-9d12-e08541a4852f for instance fbc49fe4-a119-4ed9-9310-45babff4fec4 on chh2-master-2 Jun 10 18:03:05.097321 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [req-134a07e7-1603-4cae-8803-937a2928b0f1 req-40cfd4a5-9586-466d-baa8-a2703fb1f858 service nova] Instance fbc49fe4-a119-4ed9-9310-45babff4fec4 is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 18:03:05.136803 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c121c975-06e2-40c2-af60-86fe2c4d48df tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:05.137433 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c121c975-06e2-40c2-af60-86fe2c4d48df tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:05.143497 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-134a07e7-1603-4cae-8803-937a2928b0f1 req-40cfd4a5-9586-466d-baa8-a2703fb1f858 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099401 Jun 10 18:03:05.146313 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 934/1826] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:03:05.147581 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c121c975-06e2-40c2-af60-86fe2c4d48df tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:05.148330 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c121c975-06e2-40c2-af60-86fe2c4d48df tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:05.149361 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c121c975-06e2-40c2-af60-86fe2c4d48df tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:05.150018 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c121c975-06e2-40c2-af60-86fe2c4d48df tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:05.244411 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-44173eea-4ed1-4ed4-a2d8-2fd2de725826 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:05.244411 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-44173eea-4ed1-4ed4-a2d8-2fd2de725826 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:05.244411 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44173eea-4ed1-4ed4-a2d8-2fd2de725826 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:05.244411 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44173eea-4ed1-4ed4-a2d8-2fd2de725826 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:05.244982 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44173eea-4ed1-4ed4-a2d8-2fd2de725826 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:05.244982 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44173eea-4ed1-4ed4-a2d8-2fd2de725826 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:05.271162 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-c121c975-06e2-40c2-af60-86fe2c4d48df tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lazy-loading 'services' on Instance uuid a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:03:05.310161 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c121c975-06e2-40c2-af60-86fe2c4d48df tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1929 microversion: 2.75 time: 0.177144 Jun 10 18:03:05.313382 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 893/1827] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:05 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1929 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:05.321666 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-36b18b3e-55da-4626-a077-a8e4edbc164f req-850f7632-4d54-4cd1-bec3-42e1f8b1caf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "186b67b3-3538-4bc2-8528-53b43d701bf1", "name": "network-vif-unplugged", "status": "completed", "tag": "128ee4eb-e784-41c8-acaa-39291810b2a4"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:05.338045 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-36b18b3e-55da-4626-a077-a8e4edbc164f req-850f7632-4d54-4cd1-bec3-42e1f8b1caf3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:05.339292 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-36b18b3e-55da-4626-a077-a8e4edbc164f req-850f7632-4d54-4cd1-bec3-42e1f8b1caf3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:05.378905 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-36b18b3e-55da-4626-a077-a8e4edbc164f req-850f7632-4d54-4cd1-bec3-42e1f8b1caf3 service nova] Creating event network-vif-unplugged:128ee4eb-e784-41c8-acaa-39291810b2a4 for instance 186b67b3-3538-4bc2-8528-53b43d701bf1 on chh1-master-2 Jun 10 18:03:05.389657 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-36b18b3e-55da-4626-a077-a8e4edbc164f req-850f7632-4d54-4cd1-bec3-42e1f8b1caf3 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073865 Jun 10 18:03:05.398223 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 894/1828] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:03:05.632974 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a3be0bcf-66e2-4bf9-808b-864c0d5396af tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:05.634314 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a3be0bcf-66e2-4bf9-808b-864c0d5396af tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:05.643978 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3be0bcf-66e2-4bf9-808b-864c0d5396af tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:05.644860 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3be0bcf-66e2-4bf9-808b-864c0d5396af tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:05.646088 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3be0bcf-66e2-4bf9-808b-864c0d5396af tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:05.646897 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3be0bcf-66e2-4bf9-808b-864c0d5396af tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:05.918578 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-44173eea-4ed1-4ed4-a2d8-2fd2de725826 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:05.933012 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-44173eea-4ed1-4ed4-a2d8-2fd2de725826 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8" status: 200 len: 1318 microversion: 2.1 time: 0.737937 Jun 10 18:03:05.934154 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 935/1829] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:05 2022] GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8 => generated 1318 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:03:05.949874 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-710a239b-be7d-4699-8d9f-a7c69efa486e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:05.950814 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-710a239b-be7d-4699-8d9f-a7c69efa486e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:05.958114 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-710a239b-be7d-4699-8d9f-a7c69efa486e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:05.958805 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-710a239b-be7d-4699-8d9f-a7c69efa486e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:05.959905 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-710a239b-be7d-4699-8d9f-a7c69efa486e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:05.960529 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-710a239b-be7d-4699-8d9f-a7c69efa486e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:06.243969 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a3be0bcf-66e2-4bf9-808b-864c0d5396af tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:06.262665 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a3be0bcf-66e2-4bf9-808b-864c0d5396af tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:06.267873 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a3be0bcf-66e2-4bf9-808b-864c0d5396af tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:06.270948 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a3be0bcf-66e2-4bf9-808b-864c0d5396af tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.642877 Jun 10 18:03:06.288958 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 895/1830] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:05 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:03:06.303907 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a80cf21d-0ed8-497c-adc8-7bde5ad68442 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:06.304551 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a80cf21d-0ed8-497c-adc8-7bde5ad68442 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:06.321149 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a80cf21d-0ed8-497c-adc8-7bde5ad68442 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:06.322281 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a80cf21d-0ed8-497c-adc8-7bde5ad68442 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:06.323268 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a80cf21d-0ed8-497c-adc8-7bde5ad68442 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:06.328737 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a80cf21d-0ed8-497c-adc8-7bde5ad68442 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:06.523336 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a80cf21d-0ed8-497c-adc8-7bde5ad68442 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8eb46cd9bd428b9f144077f3d7ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a513641ffb46b091bb50e7b247e9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:06.536386 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a80cf21d-0ed8-497c-adc8-7bde5ad68442 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "GET /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193" status: 200 len: 1281 microversion: 2.1 time: 0.245290 Jun 10 18:03:06.536986 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 896/1831] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:06 2022] GET /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193 => generated 1281 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:06.542258 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2c90d281-7d7e-4250-88a8-fc53636714a9 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:06.543415 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2c90d281-7d7e-4250-88a8-fc53636714a9 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:06.552409 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2c90d281-7d7e-4250-88a8-fc53636714a9 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:06.553006 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2c90d281-7d7e-4250-88a8-fc53636714a9 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:06.554076 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2c90d281-7d7e-4250-88a8-fc53636714a9 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:06.554570 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2c90d281-7d7e-4250-88a8-fc53636714a9 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:06.576269 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-710a239b-be7d-4699-8d9f-a7c69efa486e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:06.591943 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-710a239b-be7d-4699-8d9f-a7c69efa486e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1535 microversion: 2.1 time: 0.647428 Jun 10 18:03:06.592587 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 936/1832] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:05 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1535 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:06.661808 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:03:06.668570 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-2c90d281-7d7e-4250-88a8-fc53636714a9 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lazy-loading 'services' on Instance uuid a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:03:06.687001 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2c90d281-7d7e-4250-88a8-fc53636714a9 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1929 microversion: 2.75 time: 0.148592 Jun 10 18:03:06.688290 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 897/1833] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:06 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1929 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:06.950620 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d210939b-1836-41e9-85d2-455e9e0d4a6b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:06.951488 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d210939b-1836-41e9-85d2-455e9e0d4a6b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:06.959349 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d210939b-1836-41e9-85d2-455e9e0d4a6b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:06.960037 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d210939b-1836-41e9-85d2-455e9e0d4a6b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:06.961139 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d210939b-1836-41e9-85d2-455e9e0d4a6b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:06.961790 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d210939b-1836-41e9-85d2-455e9e0d4a6b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:07.082973 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-e867ceb6-c81f-4312-b09d-d8110044d9df req-c6d104a5-5eac-4935-8bcc-a65f8899a9bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0864d26-b605-4a49-b099-8144ecfde9bc", "name": "network-vif-unplugged", "status": "completed", "tag": "a5b5e0a1-0a97-4201-97ee-27e27e1763c7"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:07.092138 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-e867ceb6-c81f-4312-b09d-d8110044d9df req-c6d104a5-5eac-4935-8bcc-a65f8899a9bb service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:07.093205 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-e867ceb6-c81f-4312-b09d-d8110044d9df req-c6d104a5-5eac-4935-8bcc-a65f8899a9bb service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:07.106623 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-e867ceb6-c81f-4312-b09d-d8110044d9df req-c6d104a5-5eac-4935-8bcc-a65f8899a9bb service nova] Creating event network-vif-unplugged:a5b5e0a1-0a97-4201-97ee-27e27e1763c7 for instance a0864d26-b605-4a49-b099-8144ecfde9bc on chh1-master-2 Jun 10 18:03:07.112178 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-e867ceb6-c81f-4312-b09d-d8110044d9df req-c6d104a5-5eac-4935-8bcc-a65f8899a9bb service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032960 Jun 10 18:03:07.113567 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 898/1834] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:03:07.260935 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4dfa9638-e8c9-4155-b911-f809ebb781e9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:07.262077 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4dfa9638-e8c9-4155-b911-f809ebb781e9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:07.272010 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4dfa9638-e8c9-4155-b911-f809ebb781e9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:07.272919 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4dfa9638-e8c9-4155-b911-f809ebb781e9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:07.273901 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4dfa9638-e8c9-4155-b911-f809ebb781e9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:07.275287 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4dfa9638-e8c9-4155-b911-f809ebb781e9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:07.321778 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d210939b-1836-41e9-85d2-455e9e0d4a6b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:07.343840 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d210939b-1836-41e9-85d2-455e9e0d4a6b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8" status: 200 len: 1318 microversion: 2.1 time: 0.394647 Jun 10 18:03:07.346343 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 937/1835] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:06 2022] GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8 => generated 1318 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:07.358573 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d8e80cd1-4740-48a2-a59a-6bc4ef128a4d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:07.361650 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d8e80cd1-4740-48a2-a59a-6bc4ef128a4d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:07.405357 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d8e80cd1-4740-48a2-a59a-6bc4ef128a4d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:07.407772 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d8e80cd1-4740-48a2-a59a-6bc4ef128a4d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:07.409436 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d8e80cd1-4740-48a2-a59a-6bc4ef128a4d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:07.410151 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d8e80cd1-4740-48a2-a59a-6bc4ef128a4d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:07.603124 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4dfa9638-e8c9-4155-b911-f809ebb781e9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:07.617347 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4dfa9638-e8c9-4155-b911-f809ebb781e9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.361940 Jun 10 18:03:07.618653 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 899/1836] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:07 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:07.632775 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-95f61621-1a05-41e3-a51b-b4e5d7b0a53c req-9b701ade-cc44-4044-9b2a-c8afe362b955 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8", "name": "network-vif-plugged", "status": "completed", "tag": "e789e333-819f-48ad-8d66-0eca0af19c5e"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:07.662391 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-95f61621-1a05-41e3-a51b-b4e5d7b0a53c req-9b701ade-cc44-4044-9b2a-c8afe362b955 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:07.663105 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-95f61621-1a05-41e3-a51b-b4e5d7b0a53c req-9b701ade-cc44-4044-9b2a-c8afe362b955 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:07.682837 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-95f61621-1a05-41e3-a51b-b4e5d7b0a53c req-9b701ade-cc44-4044-9b2a-c8afe362b955 service nova] Creating event network-vif-plugged:e789e333-819f-48ad-8d66-0eca0af19c5e for instance b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8 on chh1-master-2 Jun 10 18:03:07.693111 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-95f61621-1a05-41e3-a51b-b4e5d7b0a53c req-9b701ade-cc44-4044-9b2a-c8afe362b955 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071976 Jun 10 18:03:07.694495 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 900/1837] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:03:07.715539 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-514dd44a-845a-4fc4-8145-de209da2cae1 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:07.721398 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d8e80cd1-4740-48a2-a59a-6bc4ef128a4d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:07.727728 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-514dd44a-845a-4fc4-8145-de209da2cae1 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:07.740198 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d8e80cd1-4740-48a2-a59a-6bc4ef128a4d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:07.747010 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d8e80cd1-4740-48a2-a59a-6bc4ef128a4d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:07.751747 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d8e80cd1-4740-48a2-a59a-6bc4ef128a4d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.401119 Jun 10 18:03:07.752755 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 938/1838] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:07 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:07.757484 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-514dd44a-845a-4fc4-8145-de209da2cae1 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:07.757973 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-514dd44a-845a-4fc4-8145-de209da2cae1 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:07.761908 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-514dd44a-845a-4fc4-8145-de209da2cae1 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:07.763169 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-514dd44a-845a-4fc4-8145-de209da2cae1 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:07.763855 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3492d990-5b01-4a16-8b56-643555e9f29a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:07.768074 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3492d990-5b01-4a16-8b56-643555e9f29a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:07.782242 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3492d990-5b01-4a16-8b56-643555e9f29a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:07.788628 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3492d990-5b01-4a16-8b56-643555e9f29a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:07.791485 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3492d990-5b01-4a16-8b56-643555e9f29a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:07.793954 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3492d990-5b01-4a16-8b56-643555e9f29a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:07.965341 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-514dd44a-845a-4fc4-8145-de209da2cae1 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8eb46cd9bd428b9f144077f3d7ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a513641ffb46b091bb50e7b247e9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:07.973753 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-514dd44a-845a-4fc4-8145-de209da2cae1 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "GET /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193" status: 200 len: 1323 microversion: 2.1 time: 0.277789 Jun 10 18:03:07.974928 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 901/1839] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:07 2022] GET /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193 => generated 1323 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:07.979579 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-502a29de-8a3b-4420-90e1-87eb373c8134 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:07.980370 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-502a29de-8a3b-4420-90e1-87eb373c8134 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:07.985618 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:03:07.988503 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-502a29de-8a3b-4420-90e1-87eb373c8134 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:07.989023 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-502a29de-8a3b-4420-90e1-87eb373c8134 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:07.989909 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-502a29de-8a3b-4420-90e1-87eb373c8134 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:07.990432 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-502a29de-8a3b-4420-90e1-87eb373c8134 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:08.165981 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-502a29de-8a3b-4420-90e1-87eb373c8134 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:08.175002 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-502a29de-8a3b-4420-90e1-87eb373c8134 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.198951 Jun 10 18:03:08.175595 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 902/1840] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:07 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:08.191233 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7ce449c8-84df-479a-927f-2e7e5e63f23b tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:08.191847 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7ce449c8-84df-479a-927f-2e7e5e63f23b tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:08.198224 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ce449c8-84df-479a-927f-2e7e5e63f23b tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:08.198732 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ce449c8-84df-479a-927f-2e7e5e63f23b tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:08.200039 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ce449c8-84df-479a-927f-2e7e5e63f23b tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:08.200569 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ce449c8-84df-479a-927f-2e7e5e63f23b tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:08.221175 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3492d990-5b01-4a16-8b56-643555e9f29a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:08.233746 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3492d990-5b01-4a16-8b56-643555e9f29a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1535 microversion: 2.1 time: 0.479267 Jun 10 18:03:08.235610 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 939/1841] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:07 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1535 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:08.241433 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e2d50003-0fc0-490d-b3db-67fcc2db6a78 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:08.242630 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e2d50003-0fc0-490d-b3db-67fcc2db6a78 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:08.250466 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e2d50003-0fc0-490d-b3db-67fcc2db6a78 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:08.251643 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e2d50003-0fc0-490d-b3db-67fcc2db6a78 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:08.253129 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e2d50003-0fc0-490d-b3db-67fcc2db6a78 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:08.253865 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e2d50003-0fc0-490d-b3db-67fcc2db6a78 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:08.348458 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-7ce449c8-84df-479a-927f-2e7e5e63f23b tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lazy-loading 'services' on Instance uuid a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:03:08.376366 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7ce449c8-84df-479a-927f-2e7e5e63f23b tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1929 microversion: 2.75 time: 0.188683 Jun 10 18:03:08.389073 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 903/1842] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:08 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1929 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:08.394399 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7071ee78-84e3-4d34-876f-84b4580c12e5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:08.395048 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7071ee78-84e3-4d34-876f-84b4580c12e5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:08.401769 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7071ee78-84e3-4d34-876f-84b4580c12e5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:08.403357 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7071ee78-84e3-4d34-876f-84b4580c12e5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:08.403867 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7071ee78-84e3-4d34-876f-84b4580c12e5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:08.404492 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7071ee78-84e3-4d34-876f-84b4580c12e5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:08.575147 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e2d50003-0fc0-490d-b3db-67fcc2db6a78 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:08.588375 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e2d50003-0fc0-490d-b3db-67fcc2db6a78 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.351291 Jun 10 18:03:08.589084 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 940/1843] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:08 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:08.606081 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-470443d0-e928-49f7-b253-f18e47de7d74 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:08.607444 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-470443d0-e928-49f7-b253-f18e47de7d74 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:08.614921 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-470443d0-e928-49f7-b253-f18e47de7d74 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:08.615725 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-470443d0-e928-49f7-b253-f18e47de7d74 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:08.619611 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-470443d0-e928-49f7-b253-f18e47de7d74 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:08.620348 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-470443d0-e928-49f7-b253-f18e47de7d74 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:08.664657 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7071ee78-84e3-4d34-876f-84b4580c12e5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:08.678146 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7071ee78-84e3-4d34-876f-84b4580c12e5 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8" status: 200 len: 1318 microversion: 2.1 time: 0.285595 Jun 10 18:03:08.679446 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 904/1844] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:08 2022] GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8 => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:08.770725 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9d230617-1a6e-42ca-a02c-14cad820abb4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:08.771217 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9d230617-1a6e-42ca-a02c-14cad820abb4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:08.778204 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9d230617-1a6e-42ca-a02c-14cad820abb4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:08.778773 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9d230617-1a6e-42ca-a02c-14cad820abb4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:08.779596 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9d230617-1a6e-42ca-a02c-14cad820abb4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:08.780011 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9d230617-1a6e-42ca-a02c-14cad820abb4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:08.891961 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-470443d0-e928-49f7-b253-f18e47de7d74 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "POST /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1/action" status: 202 len: 0 microversion: 2.1 time: 0.289375 Jun 10 18:03:08.893018 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 941/1845] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:03:08 2022] POST /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:03:08.904099 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d78f32e9-2645-46cc-b3a8-3291d915c4f8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:08.907694 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d78f32e9-2645-46cc-b3a8-3291d915c4f8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:08.923302 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d78f32e9-2645-46cc-b3a8-3291d915c4f8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:08.926405 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d78f32e9-2645-46cc-b3a8-3291d915c4f8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:08.927545 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d78f32e9-2645-46cc-b3a8-3291d915c4f8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:08.929297 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d78f32e9-2645-46cc-b3a8-3291d915c4f8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:09.049959 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9d230617-1a6e-42ca-a02c-14cad820abb4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:09.065080 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9d230617-1a6e-42ca-a02c-14cad820abb4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:09.070717 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9d230617-1a6e-42ca-a02c-14cad820abb4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:09.073455 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9d230617-1a6e-42ca-a02c-14cad820abb4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.306827 Jun 10 18:03:09.083365 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 905/1846] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:08 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:03:09.096588 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bc64713a-637c-49a2-a3ac-f6eed101998c tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:09.097761 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bc64713a-637c-49a2-a3ac-f6eed101998c tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:09.105348 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bc64713a-637c-49a2-a3ac-f6eed101998c tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:09.106407 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bc64713a-637c-49a2-a3ac-f6eed101998c tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:09.107584 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bc64713a-637c-49a2-a3ac-f6eed101998c tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:09.108131 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bc64713a-637c-49a2-a3ac-f6eed101998c tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:09.275650 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d78f32e9-2645-46cc-b3a8-3291d915c4f8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:09.288238 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d78f32e9-2645-46cc-b3a8-3291d915c4f8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1670 microversion: 2.1 time: 0.390830 Jun 10 18:03:09.288874 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 942/1847] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:08 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1670 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:09.298429 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-8a82802e-7981-41c0-b1e4-c902ed9784c0 req-417bc51b-3025-4b97-b54e-1b680fd01cbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0864d26-b605-4a49-b099-8144ecfde9bc", "tag": "a5b5e0a1-0a97-4201-97ee-27e27e1763c7"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:09.318627 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-8a82802e-7981-41c0-b1e4-c902ed9784c0 req-417bc51b-3025-4b97-b54e-1b680fd01cbf service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:09.319078 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-8a82802e-7981-41c0-b1e4-c902ed9784c0 req-417bc51b-3025-4b97-b54e-1b680fd01cbf service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:09.360465 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-8a82802e-7981-41c0-b1e4-c902ed9784c0 req-417bc51b-3025-4b97-b54e-1b680fd01cbf service nova] Creating event network-changed:a5b5e0a1-0a97-4201-97ee-27e27e1763c7 for instance a0864d26-b605-4a49-b099-8144ecfde9bc on chh1-master-2 Jun 10 18:03:09.375354 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-8a82802e-7981-41c0-b1e4-c902ed9784c0 req-417bc51b-3025-4b97-b54e-1b680fd01cbf service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085140 Jun 10 18:03:09.376028 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 943/1848] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:03:09.382581 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fd153075-7cf4-4ac7-9dba-5ae2b573e644 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:09.398039 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fd153075-7cf4-4ac7-9dba-5ae2b573e644 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:09.403616 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd153075-7cf4-4ac7-9dba-5ae2b573e644 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:09.403885 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd153075-7cf4-4ac7-9dba-5ae2b573e644 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:09.404684 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd153075-7cf4-4ac7-9dba-5ae2b573e644 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:09.405722 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd153075-7cf4-4ac7-9dba-5ae2b573e644 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:09.708372 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fd153075-7cf4-4ac7-9dba-5ae2b573e644 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:09.723113 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fd153075-7cf4-4ac7-9dba-5ae2b573e644 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1535 microversion: 2.1 time: 0.344568 Jun 10 18:03:09.725201 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 944/1849] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:09 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1535 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:09.742826 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b531eb29-68d7-472d-bf84-b683eb9fa14d tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:09.743896 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b531eb29-68d7-472d-bf84-b683eb9fa14d tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:09.751584 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b531eb29-68d7-472d-bf84-b683eb9fa14d tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:09.752456 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b531eb29-68d7-472d-bf84-b683eb9fa14d tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:09.753545 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b531eb29-68d7-472d-bf84-b683eb9fa14d tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:09.754305 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b531eb29-68d7-472d-bf84-b683eb9fa14d tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:09.793008 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bc64713a-637c-49a2-a3ac-f6eed101998c tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8eb46cd9bd428b9f144077f3d7ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a513641ffb46b091bb50e7b247e9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:09.806920 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bc64713a-637c-49a2-a3ac-f6eed101998c tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "GET /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193" status: 200 len: 1323 microversion: 2.1 time: 0.722022 Jun 10 18:03:09.807518 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 906/1850] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:09 2022] GET /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193 => generated 1323 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:09.819341 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-844049a2-d648-4232-9d1a-d59e25334020 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:09.819972 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-844049a2-d648-4232-9d1a-d59e25334020 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:09.837984 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-844049a2-d648-4232-9d1a-d59e25334020 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:09.838445 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-844049a2-d648-4232-9d1a-d59e25334020 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:09.839224 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-844049a2-d648-4232-9d1a-d59e25334020 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:09.854349 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-844049a2-d648-4232-9d1a-d59e25334020 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:10.046795 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-b531eb29-68d7-472d-bf84-b683eb9fa14d tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lazy-loading 'services' on Instance uuid a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:03:10.103883 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b531eb29-68d7-472d-bf84-b683eb9fa14d tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1929 microversion: 2.75 time: 0.366479 Jun 10 18:03:10.104530 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 945/1851] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:09 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1929 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:10.124200 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6c12588b-5a6d-4f09-bf6d-6446ea9c489e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:10.135714 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6c12588b-5a6d-4f09-bf6d-6446ea9c489e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:10.153148 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6c12588b-5a6d-4f09-bf6d-6446ea9c489e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:10.154164 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6c12588b-5a6d-4f09-bf6d-6446ea9c489e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:10.155164 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6c12588b-5a6d-4f09-bf6d-6446ea9c489e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:10.155943 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6c12588b-5a6d-4f09-bf6d-6446ea9c489e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:10.317588 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-844049a2-d648-4232-9d1a-d59e25334020 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:10.335148 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-844049a2-d648-4232-9d1a-d59e25334020 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8" status: 200 len: 1508 microversion: 2.1 time: 0.526474 Jun 10 18:03:10.335745 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 907/1852] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:09 2022] GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8 => generated 1508 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:10.343473 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ced4f11a-bbec-437f-97b4-ecd2783746ee tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:10.347849 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ced4f11a-bbec-437f-97b4-ecd2783746ee tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:10.361649 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ced4f11a-bbec-437f-97b4-ecd2783746ee tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:10.364595 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ced4f11a-bbec-437f-97b4-ecd2783746ee tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:10.365961 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ced4f11a-bbec-437f-97b4-ecd2783746ee tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:10.367150 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ced4f11a-bbec-437f-97b4-ecd2783746ee tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:10.606043 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ced4f11a-bbec-437f-97b4-ecd2783746ee tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:10.621674 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ced4f11a-bbec-437f-97b4-ecd2783746ee tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1670 microversion: 2.1 time: 0.284630 Jun 10 18:03:10.622253 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 908/1853] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:10 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1670 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:10.631006 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bf50a534-7312-4404-898c-f61bf8e333d4 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:10.631992 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bf50a534-7312-4404-898c-f61bf8e333d4 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:10.640424 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bf50a534-7312-4404-898c-f61bf8e333d4 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:10.640832 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bf50a534-7312-4404-898c-f61bf8e333d4 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:10.641514 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bf50a534-7312-4404-898c-f61bf8e333d4 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:10.641965 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bf50a534-7312-4404-898c-f61bf8e333d4 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:10.704166 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6c12588b-5a6d-4f09-bf6d-6446ea9c489e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:10.713102 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6c12588b-5a6d-4f09-bf6d-6446ea9c489e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:10.714702 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6c12588b-5a6d-4f09-bf6d-6446ea9c489e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:10.716171 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6c12588b-5a6d-4f09-bf6d-6446ea9c489e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.596139 Jun 10 18:03:10.734850 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 946/1854] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:10 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:10.742418 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-95b6eb29-c51a-4378-b6da-049ef3bcd12e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:10.743042 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-95b6eb29-c51a-4378-b6da-049ef3bcd12e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:10.753519 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-95b6eb29-c51a-4378-b6da-049ef3bcd12e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:10.757665 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-95b6eb29-c51a-4378-b6da-049ef3bcd12e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:10.760273 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-95b6eb29-c51a-4378-b6da-049ef3bcd12e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:10.761025 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-95b6eb29-c51a-4378-b6da-049ef3bcd12e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:10.834977 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:03:10.853845 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bf50a534-7312-4404-898c-f61bf8e333d4 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:10.863476 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bf50a534-7312-4404-898c-f61bf8e333d4 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8" status: 200 len: 1508 microversion: 2.1 time: 0.237153 Jun 10 18:03:10.875098 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 909/1855] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:10 2022] GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8 => generated 1508 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:10.875324 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=14 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:03:10.875456 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4e7c8cbb-2c4a-4e53-940d-2e76b14b4126 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:10.875456 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4e7c8cbb-2c4a-4e53-940d-2e76b14b4126 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:10.882821 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4e7c8cbb-2c4a-4e53-940d-2e76b14b4126 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:10.884778 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4e7c8cbb-2c4a-4e53-940d-2e76b14b4126 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:10.885600 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4e7c8cbb-2c4a-4e53-940d-2e76b14b4126 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:10.886047 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4e7c8cbb-2c4a-4e53-940d-2e76b14b4126 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:11.041562 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4e7c8cbb-2c4a-4e53-940d-2e76b14b4126 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8eb46cd9bd428b9f144077f3d7ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a513641ffb46b091bb50e7b247e9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:11.053584 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4e7c8cbb-2c4a-4e53-940d-2e76b14b4126 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "GET /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193" status: 200 len: 1323 microversion: 2.1 time: 0.187485 Jun 10 18:03:11.054530 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 910/1856] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:10 2022] GET /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193 => generated 1323 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:11.069304 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-20064125-03e1-4b6f-ba6b-37f90b923bb0 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:11.070511 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-20064125-03e1-4b6f-ba6b-37f90b923bb0 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:11.076968 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-20064125-03e1-4b6f-ba6b-37f90b923bb0 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:11.077417 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-20064125-03e1-4b6f-ba6b-37f90b923bb0 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:11.078211 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-20064125-03e1-4b6f-ba6b-37f90b923bb0 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:11.078655 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-20064125-03e1-4b6f-ba6b-37f90b923bb0 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:11.219585 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:03:11.325908 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-20064125-03e1-4b6f-ba6b-37f90b923bb0 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "PUT /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8" status: 200 len: 1080 microversion: 2.1 time: 0.260473 Jun 10 18:03:11.327295 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 911/1857] 10.222.0.35 () {60 vars in 1255 bytes} [Fri Jun 10 18:03:11 2022] PUT /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8 => generated 1080 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:11.333453 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7443b765-60b2-4073-94e2-f35f16a4d400 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:11.334449 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7443b765-60b2-4073-94e2-f35f16a4d400 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:11.360652 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7443b765-60b2-4073-94e2-f35f16a4d400 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:11.364578 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7443b765-60b2-4073-94e2-f35f16a4d400 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:11.367466 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7443b765-60b2-4073-94e2-f35f16a4d400 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:11.370002 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7443b765-60b2-4073-94e2-f35f16a4d400 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:11.406160 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-95b6eb29-c51a-4378-b6da-049ef3bcd12e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:11.416724 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-95b6eb29-c51a-4378-b6da-049ef3bcd12e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1535 microversion: 2.1 time: 0.678076 Jun 10 18:03:11.418141 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 947/1858] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:10 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1535 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:11.424801 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-17a4b62e-0cb5-424a-9e11-e9969ba561f6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:11.426020 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-17a4b62e-0cb5-424a-9e11-e9969ba561f6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:11.444441 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-17a4b62e-0cb5-424a-9e11-e9969ba561f6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:11.447369 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-17a4b62e-0cb5-424a-9e11-e9969ba561f6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:11.447369 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-17a4b62e-0cb5-424a-9e11-e9969ba561f6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:11.447369 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-17a4b62e-0cb5-424a-9e11-e9969ba561f6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:11.452094 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:03:11.511863 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-7443b765-60b2-4073-94e2-f35f16a4d400 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lazy-loading 'services' on Instance uuid a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:03:11.551830 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7443b765-60b2-4073-94e2-f35f16a4d400 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1929 microversion: 2.75 time: 0.223280 Jun 10 18:03:11.564034 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 912/1859] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:11 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1929 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:11.564034 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-49914a87-02cc-40dc-b62b-bc1b99c5b598 req-e90ae22a-b233-48ff-8e83-cf957440ae80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a5ddc8b-3e7a-48f8-9f48-69b3b5027193", "tag": "7477bf53-bd19-46b9-8356-316de6f77ec5"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:11.570726 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-49914a87-02cc-40dc-b62b-bc1b99c5b598 req-e90ae22a-b233-48ff-8e83-cf957440ae80 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:11.574246 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-49914a87-02cc-40dc-b62b-bc1b99c5b598 req-e90ae22a-b233-48ff-8e83-cf957440ae80 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:11.587841 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-49914a87-02cc-40dc-b62b-bc1b99c5b598 req-e90ae22a-b233-48ff-8e83-cf957440ae80 service nova] Creating event network-changed:7477bf53-bd19-46b9-8356-316de6f77ec5 for instance 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193 on chh1-master-2 Jun 10 18:03:11.601177 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-49914a87-02cc-40dc-b62b-bc1b99c5b598 req-e90ae22a-b233-48ff-8e83-cf957440ae80 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044792 Jun 10 18:03:11.608030 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 913/1860] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:03:11.642207 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-258299ae-ccf3-40a6-8f9e-fe07602fbec0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:11.644342 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-258299ae-ccf3-40a6-8f9e-fe07602fbec0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:11.664766 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-258299ae-ccf3-40a6-8f9e-fe07602fbec0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:11.665364 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-258299ae-ccf3-40a6-8f9e-fe07602fbec0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:11.670897 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-258299ae-ccf3-40a6-8f9e-fe07602fbec0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:11.671431 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-258299ae-ccf3-40a6-8f9e-fe07602fbec0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:11.732019 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-17a4b62e-0cb5-424a-9e11-e9969ba561f6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:11.742953 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-17a4b62e-0cb5-424a-9e11-e9969ba561f6 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8" status: 200 len: 1506 microversion: 2.1 time: 0.321294 Jun 10 18:03:11.743549 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 948/1861] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:11 2022] GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8 => generated 1506 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:11.756255 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9f62282f-e6a2-4800-942f-7fec2b2f43f5 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:11.757434 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9f62282f-e6a2-4800-942f-7fec2b2f43f5 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:11.766109 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f62282f-e6a2-4800-942f-7fec2b2f43f5 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:11.766567 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f62282f-e6a2-4800-942f-7fec2b2f43f5 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:11.767611 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f62282f-e6a2-4800-942f-7fec2b2f43f5 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:11.768393 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f62282f-e6a2-4800-942f-7fec2b2f43f5 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:11.893706 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-258299ae-ccf3-40a6-8f9e-fe07602fbec0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:11.904513 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:03:11.911920 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-258299ae-ccf3-40a6-8f9e-fe07602fbec0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1670 microversion: 2.1 time: 0.276741 Jun 10 18:03:11.926976 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 914/1862] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:11 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1670 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:03:11.937131 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c9df906e-e7f8-48ce-b479-8b1b157d6a51 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:11.937759 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c9df906e-e7f8-48ce-b479-8b1b157d6a51 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:11.954611 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c9df906e-e7f8-48ce-b479-8b1b157d6a51 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:11.955079 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c9df906e-e7f8-48ce-b479-8b1b157d6a51 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:11.956433 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c9df906e-e7f8-48ce-b479-8b1b157d6a51 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:11.956889 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c9df906e-e7f8-48ce-b479-8b1b157d6a51 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:11.977099 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9f62282f-e6a2-4800-942f-7fec2b2f43f5 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:11.986047 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9f62282f-e6a2-4800-942f-7fec2b2f43f5 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:11.992865 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9f62282f-e6a2-4800-942f-7fec2b2f43f5 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:11.996348 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9f62282f-e6a2-4800-942f-7fec2b2f43f5 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.247995 Jun 10 18:03:11.999245 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 949/1863] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:11 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:12.072325 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-387158b1-67aa-4fc0-b555-f95177ab41ce tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:12.073659 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-387158b1-67aa-4fc0-b555-f95177ab41ce tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:12.078690 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:03:12.082548 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-387158b1-67aa-4fc0-b555-f95177ab41ce tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:12.083411 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-387158b1-67aa-4fc0-b555-f95177ab41ce tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:12.084254 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-387158b1-67aa-4fc0-b555-f95177ab41ce tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:12.084976 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-387158b1-67aa-4fc0-b555-f95177ab41ce tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:12.144356 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c9df906e-e7f8-48ce-b479-8b1b157d6a51 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:12.152584 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c9df906e-e7f8-48ce-b479-8b1b157d6a51 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8" status: 200 len: 1506 microversion: 2.1 time: 0.224117 Jun 10 18:03:12.153537 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 915/1864] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:11 2022] GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8 => generated 1506 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:12.169578 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ffa180c8-1195-430d-8836-7ab74ca2b18e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:12.173511 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ffa180c8-1195-430d-8836-7ab74ca2b18e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:12.189502 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ffa180c8-1195-430d-8836-7ab74ca2b18e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:12.190882 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ffa180c8-1195-430d-8836-7ab74ca2b18e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:12.192189 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ffa180c8-1195-430d-8836-7ab74ca2b18e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:12.197452 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ffa180c8-1195-430d-8836-7ab74ca2b18e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:12.248884 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-387158b1-67aa-4fc0-b555-f95177ab41ce tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8eb46cd9bd428b9f144077f3d7ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a513641ffb46b091bb50e7b247e9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:12.257998 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-387158b1-67aa-4fc0-b555-f95177ab41ce tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "GET /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193" status: 200 len: 1323 microversion: 2.1 time: 0.190020 Jun 10 18:03:12.268659 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 950/1865] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:12 2022] GET /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193 => generated 1323 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:03:12.346629 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-aa6e9676-1fd8-4cd1-bbc1-2dceb029e4f4 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:12.347763 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-aa6e9676-1fd8-4cd1-bbc1-2dceb029e4f4 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:12.354510 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aa6e9676-1fd8-4cd1-bbc1-2dceb029e4f4 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:12.355571 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aa6e9676-1fd8-4cd1-bbc1-2dceb029e4f4 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:12.356456 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aa6e9676-1fd8-4cd1-bbc1-2dceb029e4f4 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:12.356960 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aa6e9676-1fd8-4cd1-bbc1-2dceb029e4f4 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:12.382725 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ffa180c8-1195-430d-8836-7ab74ca2b18e tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "PUT /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8" status: 200 len: 1082 microversion: 2.1 time: 0.217333 Jun 10 18:03:12.387931 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 916/1866] 10.222.0.35 () {60 vars in 1255 bytes} [Fri Jun 10 18:03:12 2022] PUT /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8 => generated 1082 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:12.388086 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-aa6e9676-1fd8-4cd1-bbc1-2dceb029e4f4 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:03:12.401740 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e2f038e4-3bdd-4910-bac7-94ed1e5ea44b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:12.402818 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e2f038e4-3bdd-4910-bac7-94ed1e5ea44b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:12.412380 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e2f038e4-3bdd-4910-bac7-94ed1e5ea44b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:12.416012 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e2f038e4-3bdd-4910-bac7-94ed1e5ea44b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:12.416012 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e2f038e4-3bdd-4910-bac7-94ed1e5ea44b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:12.416012 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e2f038e4-3bdd-4910-bac7-94ed1e5ea44b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:12.612987 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e2f038e4-3bdd-4910-bac7-94ed1e5ea44b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:12.621243 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e2f038e4-3bdd-4910-bac7-94ed1e5ea44b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8" status: 200 len: 1508 microversion: 2.1 time: 0.226635 Jun 10 18:03:12.631710 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 917/1867] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:12 2022] GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8 => generated 1508 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:03:12.631710 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-44e2e623-3292-4587-85f6-4218059a2baa tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:12.631710 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-44e2e623-3292-4587-85f6-4218059a2baa tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:12.638259 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-44e2e623-3292-4587-85f6-4218059a2baa tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:12.638969 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-44e2e623-3292-4587-85f6-4218059a2baa tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:12.639979 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-44e2e623-3292-4587-85f6-4218059a2baa tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:12.640928 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-44e2e623-3292-4587-85f6-4218059a2baa tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:12.806407 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-aa6e9676-1fd8-4cd1-bbc1-2dceb029e4f4 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "DELETE /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63" status: 204 len: 0 microversion: 2.1 time: 0.465579 Jun 10 18:03:12.809458 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 951/1868] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:03:12 2022] DELETE /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:03:12.814011 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5aae47e2-cbbe-4b1e-a299-1100fa0dc403 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:12.815007 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5aae47e2-cbbe-4b1e-a299-1100fa0dc403 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:12.822929 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5aae47e2-cbbe-4b1e-a299-1100fa0dc403 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:12.823878 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5aae47e2-cbbe-4b1e-a299-1100fa0dc403 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:12.824925 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5aae47e2-cbbe-4b1e-a299-1100fa0dc403 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:12.825608 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5aae47e2-cbbe-4b1e-a299-1100fa0dc403 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:12.833659 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-44e2e623-3292-4587-85f6-4218059a2baa tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:12.843015 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-44e2e623-3292-4587-85f6-4218059a2baa tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1528 microversion: 2.1 time: 0.219366 Jun 10 18:03:12.844176 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 918/1869] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:12 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1528 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:12.858590 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-888cfe02-56db-4a46-8b14-a3a34194c624 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:12.859208 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-888cfe02-56db-4a46-8b14-a3a34194c624 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:12.866313 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-888cfe02-56db-4a46-8b14-a3a34194c624 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:12.870165 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-888cfe02-56db-4a46-8b14-a3a34194c624 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:12.870165 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-888cfe02-56db-4a46-8b14-a3a34194c624 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:12.870165 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-888cfe02-56db-4a46-8b14-a3a34194c624 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:12.919453 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-5aae47e2-cbbe-4b1e-a299-1100fa0dc403 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lazy-loading 'services' on Instance uuid a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:03:12.941725 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5aae47e2-cbbe-4b1e-a299-1100fa0dc403 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1929 microversion: 2.75 time: 0.132504 Jun 10 18:03:12.954340 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 952/1870] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:12 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1929 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:12.959122 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8b096c19-1a22-4e73-b76f-f491e85132cd tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:12.961547 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8b096c19-1a22-4e73-b76f-f491e85132cd tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:12.968905 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8b096c19-1a22-4e73-b76f-f491e85132cd tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:12.969735 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8b096c19-1a22-4e73-b76f-f491e85132cd tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:12.971203 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8b096c19-1a22-4e73-b76f-f491e85132cd tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:12.971757 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8b096c19-1a22-4e73-b76f-f491e85132cd tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:13.029765 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-888cfe02-56db-4a46-8b14-a3a34194c624 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:13.038765 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-888cfe02-56db-4a46-8b14-a3a34194c624 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8" status: 200 len: 1508 microversion: 2.1 time: 0.193399 Jun 10 18:03:13.052457 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 919/1871] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:12 2022] GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8 => generated 1508 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:13.058021 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b5ef495b-3297-4fe8-ac19-1129fb4595fb tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:13.063726 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b5ef495b-3297-4fe8-ac19-1129fb4595fb tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:13.066621 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5ef495b-3297-4fe8-ac19-1129fb4595fb tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:13.067096 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5ef495b-3297-4fe8-ac19-1129fb4595fb tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:13.067974 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5ef495b-3297-4fe8-ac19-1129fb4595fb tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:13.068703 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5ef495b-3297-4fe8-ac19-1129fb4595fb tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:13.221618 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8b096c19-1a22-4e73-b76f-f491e85132cd tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63889ce9e75140bd9c730857468b7fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce8674b6db3471c8c94e809430651c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:13.229963 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8b096c19-1a22-4e73-b76f-f491e85132cd tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63" status: 200 len: 1681 microversion: 2.1 time: 0.286321 Jun 10 18:03:13.230555 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 953/1872] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:12 2022] GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63 => generated 1681 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:13.235360 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-27c3ffc5-87b8-48cd-a37c-65f23b64728a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:13.235914 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-27c3ffc5-87b8-48cd-a37c-65f23b64728a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:13.236626 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b5ef495b-3297-4fe8-ac19-1129fb4595fb tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:13.244664 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-27c3ffc5-87b8-48cd-a37c-65f23b64728a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:13.256569 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-27c3ffc5-87b8-48cd-a37c-65f23b64728a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:13.256725 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b5ef495b-3297-4fe8-ac19-1129fb4595fb tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1528 microversion: 2.1 time: 0.204637 Jun 10 18:03:13.256725 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 920/1873] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:13 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1528 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:13.256935 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-27c3ffc5-87b8-48cd-a37c-65f23b64728a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:13.256935 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-27c3ffc5-87b8-48cd-a37c-65f23b64728a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:13.257118 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4cc541d8-b8f7-4ea3-a584-866ef58ccc76 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:13.257118 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4cc541d8-b8f7-4ea3-a584-866ef58ccc76 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:13.257302 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4cc541d8-b8f7-4ea3-a584-866ef58ccc76 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:13.257625 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4cc541d8-b8f7-4ea3-a584-866ef58ccc76 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:13.258411 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4cc541d8-b8f7-4ea3-a584-866ef58ccc76 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:13.258862 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4cc541d8-b8f7-4ea3-a584-866ef58ccc76 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:13.395681 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-27c3ffc5-87b8-48cd-a37c-65f23b64728a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:13.404999 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-27c3ffc5-87b8-48cd-a37c-65f23b64728a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1675 microversion: 2.1 time: 0.172949 Jun 10 18:03:13.405730 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 954/1874] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:13 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1675 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:13.410342 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f1eb9973-5be9-47a4-a326-302fdb14fdd7 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:13.410943 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f1eb9973-5be9-47a4-a326-302fdb14fdd7 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:13.416783 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4cc541d8-b8f7-4ea3-a584-866ef58ccc76 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:13.422994 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f1eb9973-5be9-47a4-a326-302fdb14fdd7 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:13.423483 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f1eb9973-5be9-47a4-a326-302fdb14fdd7 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:13.425240 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f1eb9973-5be9-47a4-a326-302fdb14fdd7 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:13.425542 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4cc541d8-b8f7-4ea3-a584-866ef58ccc76 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:13.425896 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f1eb9973-5be9-47a4-a326-302fdb14fdd7 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:13.427051 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4cc541d8-b8f7-4ea3-a584-866ef58ccc76 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:13.428225 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4cc541d8-b8f7-4ea3-a584-866ef58ccc76 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.181351 Jun 10 18:03:13.428927 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 921/1875] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:13 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:13.434140 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-13d64cdb-cd68-4101-88d7-46a9664b6c86 tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:13.435009 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:03:13.435009 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 18:03:13.440210 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-13d64cdb-cd68-4101-88d7-46a9664b6c86 tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] HTTP exception thrown: Flavor 0808ae9d-5d11-4d53-9cba-46dd87bed7aa could not be found. Jun 10 18:03:13.449201 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-13d64cdb-cd68-4101-88d7-46a9664b6c86 tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Request method failure captured: Jun 10 18:03:13.449201 chdv-master-2 devstack@n-api.service[126594]: request: DELETE /compute/v2.1/flavors/0808ae9d-5d11-4d53-9cba-46dd87bed7aa HTTP/1.1 Jun 10 18:03:13.449201 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:03:13.449201 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:03:13.449201 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:03:13.449201 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:03:13.449201 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:03:13.449201 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:03:13.449201 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:03:13.449201 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:03:13.449201 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4Z0WMJiOZ5JljAMj008DssuWRHY5B02jJzWGPR1-39zsZtyOQCVwQLuZBk6L0Nb5sZBCPphf8BS1FrXPqBnDImDR2ClhnWlL8lWlBLYVUklwYF2qfeIDtbU2YFMuyG5IGd9mKOnaiH6iSOkZ9MrTyRVOt4wnyEmZoqJU3-z8-n6n7E Jun 10 18:03:13.449201 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:03:13.449201 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:03:13.449201 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:03:13.449201 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:03:13.449201 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:03:13.449201 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:03:13.449201 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 8a4a0e2335244c26adcc4cdfd10705d6 Jun 10 18:03:13.449201 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-MigrationsAdminTest-1983229517 Jun 10 18:03:13.449201 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member,admin Jun 10 18:03:13.449201 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member,admin Jun 10 18:03:13.451005 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/8a4a0e2335244c26adcc4cdfd10705d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8a4a0e2335244c26adcc4cdfd10705d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8a4a0e2335244c26adcc4cdfd10705d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_8a4a0e2335244c26adcc4cdfd10705d6", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:03:13.451005 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-MigrationsAdminTest-1983229517 Jun 10 18:03:13.451005 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 8a4a0e2335244c26adcc4cdfd10705d6 Jun 10 18:03:13.451005 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-MigrationsAdminTest-1983229517 Jun 10 18:03:13.451005 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-MigrationsAdminTest-1983229517-project-admin Jun 10 18:03:13.451005 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:03:13.451005 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:03:13.451005 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: c994b8591be74d3f8553e412dbd226d6 Jun 10 18:03:13.451005 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-MigrationsAdminTest-1983229517-project-admin Jun 10 18:03:13.451005 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:03:13.451005 chdv-master-2 devstack@n-api.service[126594]: exception: Flavor 0808ae9d-5d11-4d53-9cba-46dd87bed7aa could not be found. Jun 10 18:03:13.451005 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '0808ae9d-5d11-4d53-9cba-46dd87bed7aa'} Jun 10 18:03:13.452092 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:03:13.452092 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:13.452092 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Jun 10 18:03:13.452092 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi flavor.destroy() Jun 10 18:03:13.452092 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 10 18:03:13.452092 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 10 18:03:13.452092 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Jun 10 18:03:13.452092 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Jun 10 18:03:13.452092 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Jun 10 18:03:13.452092 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Jun 10 18:03:13.452092 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 10 18:03:13.452092 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 10 18:03:13.452092 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Jun 10 18:03:13.452092 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Jun 10 18:03:13.452092 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 0808ae9d-5d11-4d53-9cba-46dd87bed7aa could not be found. Jun 10 18:03:13.452092 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:13.452092 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:03:13.452092 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:13.452092 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:13.452092 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:03:13.453728 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:03:13.453728 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:03:13.453728 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:03:13.453728 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:03:13.453728 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:03:13.453728 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Jun 10 18:03:13.453728 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:03:13.453728 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 0808ae9d-5d11-4d53-9cba-46dd87bed7aa could not be found. Jun 10 18:03:13.453728 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:13.453728 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:03:13.453728 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:13.453728 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:13.453728 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:03:13.453728 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:03:13.453728 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:03:13.453728 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:03:13.453728 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 0808ae9d-5d11-4d53-9cba-46dd87bed7aa could not be found. Jun 10 18:03:13.453728 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:13.455125 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-13d64cdb-cd68-4101-88d7-46a9664b6c86 tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Returning 404 to user: Flavor 0808ae9d-5d11-4d53-9cba-46dd87bed7aa could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:03:13.455125 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-13d64cdb-cd68-4101-88d7-46a9664b6c86 tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] 10.222.0.35 "DELETE /compute/v2.1/flavors/0808ae9d-5d11-4d53-9cba-46dd87bed7aa" status: 404 len: 109 microversion: 2.1 time: 0.020955 Jun 10 18:03:13.458168 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 922/1876] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:03:13 2022] DELETE /compute/v2.1/flavors/0808ae9d-5d11-4d53-9cba-46dd87bed7aa => generated 109 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:03:13.458393 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f1eb9973-5be9-47a4-a326-302fdb14fdd7 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:03:13.468640 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ea7e21e0-0bcc-4396-9998-1a782c1a9a1f tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:13.468640 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ea7e21e0-0bcc-4396-9998-1a782c1a9a1f tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:13.481608 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ea7e21e0-0bcc-4396-9998-1a782c1a9a1f tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:13.483503 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ea7e21e0-0bcc-4396-9998-1a782c1a9a1f tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:13.484349 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ea7e21e0-0bcc-4396-9998-1a782c1a9a1f tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:13.484794 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ea7e21e0-0bcc-4396-9998-1a782c1a9a1f tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:13.644972 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ea7e21e0-0bcc-4396-9998-1a782c1a9a1f tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8eb46cd9bd428b9f144077f3d7ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a513641ffb46b091bb50e7b247e9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:13.652632 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ea7e21e0-0bcc-4396-9998-1a782c1a9a1f tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "GET /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193" status: 200 len: 1323 microversion: 2.1 time: 0.193449 Jun 10 18:03:13.653188 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 923/1877] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:13 2022] GET /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193 => generated 1323 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:13.657619 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7f8490a5-8009-46e4-8dca-1ee2ffb99f44 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1814749180", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:13.711535 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-7f8490a5-8009-46e4-8dca-1ee2ffb99f44 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] validate_networks() for None {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:03:13.934254 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-7f8490a5-8009-46e4-8dca-1ee2ffb99f44 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:03:13.934681 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-7f8490a5-8009-46e4-8dca-1ee2ffb99f44 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:03:13.935158 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-7f8490a5-8009-46e4-8dca-1ee2ffb99f44 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:03:13.935586 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-7f8490a5-8009-46e4-8dca-1ee2ffb99f44 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:03:13.936004 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-7f8490a5-8009-46e4-8dca-1ee2ffb99f44 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:03:13.945010 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7f8490a5-8009-46e4-8dca-1ee2ffb99f44 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:13.947251 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7f8490a5-8009-46e4-8dca-1ee2ffb99f44 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:13.947251 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7f8490a5-8009-46e4-8dca-1ee2ffb99f44 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:13.947251 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7f8490a5-8009-46e4-8dca-1ee2ffb99f44 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:13.963636 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-7f8490a5-8009-46e4-8dca-1ee2ffb99f44 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Getting quotas for project 66fd5e2ed0b84720849784c94f36d5da. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:03:13.969134 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-7f8490a5-8009-46e4-8dca-1ee2ffb99f44 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Getting quotas for user 1c74f45bf7fd4dea952d771a649519af and project 66fd5e2ed0b84720849784c94f36d5da. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:03:13.982014 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7f8490a5-8009-46e4-8dca-1ee2ffb99f44 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:03:13.984295 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7f8490a5-8009-46e4-8dca-1ee2ffb99f44 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:03:13.984648 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f1eb9973-5be9-47a4-a326-302fdb14fdd7 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "DELETE /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8" status: 204 len: 0 microversion: 2.1 time: 0.577163 Jun 10 18:03:13.985841 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 955/1878] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:03:13 2022] DELETE /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:03:13.999621 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-f7e4e435-0c1f-4155-85c2-47833925327a req-2a2eef93-0f5a-4359-92b6-dec27b9051c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbc49fe4-a119-4ed9-9310-45babff4fec4", "name": "network-vif-plugged", "status": "completed", "tag": "8e46ecde-2a76-4ced-9d12-e08541a4852f"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:14.010510 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-f7e4e435-0c1f-4155-85c2-47833925327a req-2a2eef93-0f5a-4359-92b6-dec27b9051c1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:14.011696 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-f7e4e435-0c1f-4155-85c2-47833925327a req-2a2eef93-0f5a-4359-92b6-dec27b9051c1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:14.024426 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-f7e4e435-0c1f-4155-85c2-47833925327a req-2a2eef93-0f5a-4359-92b6-dec27b9051c1 service nova] Creating event network-vif-plugged:8e46ecde-2a76-4ced-9d12-e08541a4852f for instance fbc49fe4-a119-4ed9-9310-45babff4fec4 on chh2-master-2 Jun 10 18:03:14.030468 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-f7e4e435-0c1f-4155-85c2-47833925327a req-2a2eef93-0f5a-4359-92b6-dec27b9051c1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037860 Jun 10 18:03:14.031072 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 956/1879] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:03:14.036535 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cab81313-306f-4500-a7e2-814ac7a25d1c tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:14.037238 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cab81313-306f-4500-a7e2-814ac7a25d1c tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:14.044381 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cab81313-306f-4500-a7e2-814ac7a25d1c tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:14.044745 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cab81313-306f-4500-a7e2-814ac7a25d1c tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:14.045458 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cab81313-306f-4500-a7e2-814ac7a25d1c tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:14.045907 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cab81313-306f-4500-a7e2-814ac7a25d1c tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:14.094640 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7f8490a5-8009-46e4-8dca-1ee2ffb99f44 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.440366 Jun 10 18:03:14.096582 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 924/1880] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:03:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:03:14.102278 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f1b02183-67f2-460c-a57a-ab9aa39b3c1c tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:14.105263 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f1b02183-67f2-460c-a57a-ab9aa39b3c1c tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:14.110215 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f1b02183-67f2-460c-a57a-ab9aa39b3c1c tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:14.110701 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f1b02183-67f2-460c-a57a-ab9aa39b3c1c tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:14.111974 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f1b02183-67f2-460c-a57a-ab9aa39b3c1c tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:14.112464 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f1b02183-67f2-460c-a57a-ab9aa39b3c1c tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:14.143108 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f1b02183-67f2-460c-a57a-ab9aa39b3c1c tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:03:14.146351 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-cab81313-306f-4500-a7e2-814ac7a25d1c tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lazy-loading 'services' on Instance uuid a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:03:14.176584 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cab81313-306f-4500-a7e2-814ac7a25d1c tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1929 microversion: 2.75 time: 0.143669 Jun 10 18:03:14.177197 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 957/1881] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:14 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1929 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:14.192071 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1fa7f019-8633-4ce8-8f9f-bd9e9f4e9eb0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:14.192901 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1fa7f019-8633-4ce8-8f9f-bd9e9f4e9eb0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:14.207391 chdv-master-2 devstack@n-api.service[126594]: INFO nova.compute.api [None req-f1b02183-67f2-460c-a57a-ab9aa39b3c1c tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8] Instance is already in deleting state, ignoring this request Jun 10 18:03:14.208293 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f1b02183-67f2-460c-a57a-ab9aa39b3c1c tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "DELETE /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8" status: 204 len: 0 microversion: 2.1 time: 0.110433 Jun 10 18:03:14.209061 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 925/1882] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:03:14 2022] DELETE /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:03:14.218402 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3988d4b9-64cd-44dc-8001-0b53613bcccd tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:14.219126 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3988d4b9-64cd-44dc-8001-0b53613bcccd tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:14.226690 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3988d4b9-64cd-44dc-8001-0b53613bcccd tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:14.227217 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3988d4b9-64cd-44dc-8001-0b53613bcccd tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:14.228073 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3988d4b9-64cd-44dc-8001-0b53613bcccd tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:14.228624 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3988d4b9-64cd-44dc-8001-0b53613bcccd tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:14.261407 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1fa7f019-8633-4ce8-8f9f-bd9e9f4e9eb0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:14.268795 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1fa7f019-8633-4ce8-8f9f-bd9e9f4e9eb0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1213 microversion: 2.1 time: 0.090573 Jun 10 18:03:14.269804 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 958/1883] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:14 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:14.274449 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5ccfb346-7325-4ec7-8186-f9f83ab92c97 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:14.275076 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5ccfb346-7325-4ec7-8186-f9f83ab92c97 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:14.282767 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ccfb346-7325-4ec7-8186-f9f83ab92c97 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:14.283225 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ccfb346-7325-4ec7-8186-f9f83ab92c97 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:14.284219 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ccfb346-7325-4ec7-8186-f9f83ab92c97 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:14.284690 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ccfb346-7325-4ec7-8186-f9f83ab92c97 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:14.389603 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3988d4b9-64cd-44dc-8001-0b53613bcccd tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:14.402681 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3988d4b9-64cd-44dc-8001-0b53613bcccd tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8" status: 200 len: 1514 microversion: 2.1 time: 0.188895 Jun 10 18:03:14.403609 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 926/1884] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:14 2022] GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8 => generated 1514 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:03:14.424374 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-dac9be29-a643-41c7-b906-8797ad0f72ac tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:14.424988 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-dac9be29-a643-41c7-b906-8797ad0f72ac tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:14.431563 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dac9be29-a643-41c7-b906-8797ad0f72ac tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:14.432026 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dac9be29-a643-41c7-b906-8797ad0f72ac tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:14.432884 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dac9be29-a643-41c7-b906-8797ad0f72ac tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:14.433347 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dac9be29-a643-41c7-b906-8797ad0f72ac tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:14.614822 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-dac9be29-a643-41c7-b906-8797ad0f72ac tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:14.622480 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-dac9be29-a643-41c7-b906-8797ad0f72ac tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1675 microversion: 2.1 time: 0.203828 Jun 10 18:03:14.623054 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 927/1885] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:14 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1675 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:03:14.627570 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a3e9bcc8-c651-46e2-93ad-66ac8822df2e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:14.628180 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a3e9bcc8-c651-46e2-93ad-66ac8822df2e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:14.634211 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3e9bcc8-c651-46e2-93ad-66ac8822df2e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:14.634659 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3e9bcc8-c651-46e2-93ad-66ac8822df2e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:14.635427 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3e9bcc8-c651-46e2-93ad-66ac8822df2e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:14.635855 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3e9bcc8-c651-46e2-93ad-66ac8822df2e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:14.670624 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5ccfb346-7325-4ec7-8186-f9f83ab92c97 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63889ce9e75140bd9c730857468b7fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce8674b6db3471c8c94e809430651c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:14.678815 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5ccfb346-7325-4ec7-8186-f9f83ab92c97 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63" status: 200 len: 1681 microversion: 2.1 time: 0.407972 Jun 10 18:03:14.679604 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 959/1886] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:14 2022] GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63 => generated 1681 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:14.684233 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9b623e70-f1c9-4dfc-84a2-ced90ef13deb tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:14.685236 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9b623e70-f1c9-4dfc-84a2-ced90ef13deb tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:14.691516 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b623e70-f1c9-4dfc-84a2-ced90ef13deb tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:14.692081 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b623e70-f1c9-4dfc-84a2-ced90ef13deb tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:14.692802 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b623e70-f1c9-4dfc-84a2-ced90ef13deb tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:14.693252 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b623e70-f1c9-4dfc-84a2-ced90ef13deb tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:14.800516 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a3e9bcc8-c651-46e2-93ad-66ac8822df2e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:14.810414 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a3e9bcc8-c651-46e2-93ad-66ac8822df2e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:14.812086 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a3e9bcc8-c651-46e2-93ad-66ac8822df2e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:14.813399 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a3e9bcc8-c651-46e2-93ad-66ac8822df2e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.189411 Jun 10 18:03:14.814309 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 928/1887] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:14 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:14.845198 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9b623e70-f1c9-4dfc-84a2-ced90ef13deb tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8eb46cd9bd428b9f144077f3d7ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a513641ffb46b091bb50e7b247e9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:14.853510 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9b623e70-f1c9-4dfc-84a2-ced90ef13deb tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "GET /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193" status: 200 len: 1323 microversion: 2.1 time: 0.172980 Jun 10 18:03:14.857663 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 960/1888] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:14 2022] GET /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193 => generated 1323 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:15.199717 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-11ded39d-2381-4dc2-8c4f-5447ae1c1406 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:15.200352 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-11ded39d-2381-4dc2-8c4f-5447ae1c1406 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:15.206547 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-11ded39d-2381-4dc2-8c4f-5447ae1c1406 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:15.207010 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-11ded39d-2381-4dc2-8c4f-5447ae1c1406 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:15.207784 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-11ded39d-2381-4dc2-8c4f-5447ae1c1406 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:15.208235 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-11ded39d-2381-4dc2-8c4f-5447ae1c1406 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:15.291012 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-db99eefe-e05b-4722-8012-932099047dcf tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:15.293383 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-db99eefe-e05b-4722-8012-932099047dcf tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:15.301055 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-db99eefe-e05b-4722-8012-932099047dcf tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:15.301229 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-11ded39d-2381-4dc2-8c4f-5447ae1c1406 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lazy-loading 'services' on Instance uuid a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:03:15.301889 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-db99eefe-e05b-4722-8012-932099047dcf tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:15.302781 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-db99eefe-e05b-4722-8012-932099047dcf tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:15.303667 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-db99eefe-e05b-4722-8012-932099047dcf tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:15.324697 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-11ded39d-2381-4dc2-8c4f-5447ae1c1406 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1929 microversion: 2.75 time: 0.129116 Jun 10 18:03:15.335206 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 929/1889] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:15 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1929 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:15.399805 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-db99eefe-e05b-4722-8012-932099047dcf tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:15.407499 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-db99eefe-e05b-4722-8012-932099047dcf tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1217 microversion: 2.1 time: 0.124689 Jun 10 18:03:15.408345 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 961/1890] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:15 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1217 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:03:15.424287 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d093fbd2-0007-40a0-8d91-a5106b849c5f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:15.425242 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d093fbd2-0007-40a0-8d91-a5106b849c5f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:15.432822 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d093fbd2-0007-40a0-8d91-a5106b849c5f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:15.433839 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d093fbd2-0007-40a0-8d91-a5106b849c5f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:15.434715 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d093fbd2-0007-40a0-8d91-a5106b849c5f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:15.435444 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d093fbd2-0007-40a0-8d91-a5106b849c5f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:15.590614 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d093fbd2-0007-40a0-8d91-a5106b849c5f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:15.594038 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:03:15.598763 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d093fbd2-0007-40a0-8d91-a5106b849c5f tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8" status: 200 len: 1514 microversion: 2.1 time: 0.183498 Jun 10 18:03:15.609317 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 930/1891] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:15 2022] GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8 => generated 1514 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:15.639278 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0621a4b2-7413-4949-a23e-11bf8700722e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:15.639890 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0621a4b2-7413-4949-a23e-11bf8700722e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:15.645921 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0621a4b2-7413-4949-a23e-11bf8700722e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:15.646383 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0621a4b2-7413-4949-a23e-11bf8700722e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:15.647161 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0621a4b2-7413-4949-a23e-11bf8700722e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:15.647597 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0621a4b2-7413-4949-a23e-11bf8700722e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:15.666121 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:03:15.695397 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ee772376-0ff3-408f-991b-49336229f853 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:15.696669 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ee772376-0ff3-408f-991b-49336229f853 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:15.704493 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ee772376-0ff3-408f-991b-49336229f853 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:15.708715 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ee772376-0ff3-408f-991b-49336229f853 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:15.708715 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ee772376-0ff3-408f-991b-49336229f853 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:15.708715 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ee772376-0ff3-408f-991b-49336229f853 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:15.860835 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ee772376-0ff3-408f-991b-49336229f853 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63889ce9e75140bd9c730857468b7fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce8674b6db3471c8c94e809430651c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:15.868729 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ee772376-0ff3-408f-991b-49336229f853 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63" status: 200 len: 1681 microversion: 2.1 time: 0.177114 Jun 10 18:03:15.872547 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 931/1892] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:15 2022] GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63 => generated 1681 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:03:15.873998 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1ecdde36-91ac-435a-97a6-bfcddaa44317 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:15.874903 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1ecdde36-91ac-435a-97a6-bfcddaa44317 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:15.885354 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1ecdde36-91ac-435a-97a6-bfcddaa44317 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:15.885864 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1ecdde36-91ac-435a-97a6-bfcddaa44317 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:15.886613 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1ecdde36-91ac-435a-97a6-bfcddaa44317 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:15.887094 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1ecdde36-91ac-435a-97a6-bfcddaa44317 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:15.906041 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0621a4b2-7413-4949-a23e-11bf8700722e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:15.916546 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0621a4b2-7413-4949-a23e-11bf8700722e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1675 microversion: 2.1 time: 0.281202 Jun 10 18:03:15.927074 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 962/1893] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:15 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1675 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:15.932022 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e62eaba2-1dc1-4236-80ef-de04c5f8bb65 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:15.932976 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e62eaba2-1dc1-4236-80ef-de04c5f8bb65 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:15.944225 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e62eaba2-1dc1-4236-80ef-de04c5f8bb65 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:15.944225 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e62eaba2-1dc1-4236-80ef-de04c5f8bb65 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:15.955722 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e62eaba2-1dc1-4236-80ef-de04c5f8bb65 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:15.955722 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e62eaba2-1dc1-4236-80ef-de04c5f8bb65 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:16.063966 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1ecdde36-91ac-435a-97a6-bfcddaa44317 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:16.073976 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1ecdde36-91ac-435a-97a6-bfcddaa44317 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:16.076710 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1ecdde36-91ac-435a-97a6-bfcddaa44317 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:16.077902 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1ecdde36-91ac-435a-97a6-bfcddaa44317 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.207686 Jun 10 18:03:16.078710 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 932/1894] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:15 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:16.152345 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e62eaba2-1dc1-4236-80ef-de04c5f8bb65 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8eb46cd9bd428b9f144077f3d7ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a513641ffb46b091bb50e7b247e9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:16.157741 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e62eaba2-1dc1-4236-80ef-de04c5f8bb65 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "GET /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193" status: 200 len: 1323 microversion: 2.1 time: 0.229394 Jun 10 18:03:16.159259 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 963/1895] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:15 2022] GET /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193 => generated 1323 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:16.345719 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-065160c4-6fb0-4e41-af57-9b4f6267f54c tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:16.346332 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-065160c4-6fb0-4e41-af57-9b4f6267f54c tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:16.352634 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-065160c4-6fb0-4e41-af57-9b4f6267f54c tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:16.353096 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-065160c4-6fb0-4e41-af57-9b4f6267f54c tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:16.353890 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-065160c4-6fb0-4e41-af57-9b4f6267f54c tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:16.354337 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-065160c4-6fb0-4e41-af57-9b4f6267f54c tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:16.427026 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-802decca-a158-45e0-aaac-dfa7eaa03407 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:16.427594 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-802decca-a158-45e0-aaac-dfa7eaa03407 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:16.437250 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-065160c4-6fb0-4e41-af57-9b4f6267f54c tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lazy-loading 'services' on Instance uuid a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:03:16.453537 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-802decca-a158-45e0-aaac-dfa7eaa03407 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:16.454007 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-802decca-a158-45e0-aaac-dfa7eaa03407 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:16.455181 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-802decca-a158-45e0-aaac-dfa7eaa03407 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:16.455556 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-802decca-a158-45e0-aaac-dfa7eaa03407 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:16.462088 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-065160c4-6fb0-4e41-af57-9b4f6267f54c tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1929 microversion: 2.75 time: 0.119977 Jun 10 18:03:16.474783 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 933/1896] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:16 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1929 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:16.498088 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-292bd825-7cdc-4a80-b5a1-fc62cabe50ca req-a1360071-dd78-42fd-b1c4-d247cefcc945 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63", "name": "network-vif-deleted", "tag": "9123aa43-baae-4951-a005-f47283092a90"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:16.507272 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-292bd825-7cdc-4a80-b5a1-fc62cabe50ca req-a1360071-dd78-42fd-b1c4-d247cefcc945 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:16.507731 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-292bd825-7cdc-4a80-b5a1-fc62cabe50ca req-a1360071-dd78-42fd-b1c4-d247cefcc945 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:16.520414 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-292bd825-7cdc-4a80-b5a1-fc62cabe50ca req-a1360071-dd78-42fd-b1c4-d247cefcc945 service nova] Creating event network-vif-deleted:9123aa43-baae-4951-a005-f47283092a90 for instance ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63 on chh2-master-2 Jun 10 18:03:16.526537 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-292bd825-7cdc-4a80-b5a1-fc62cabe50ca req-a1360071-dd78-42fd-b1c4-d247cefcc945 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032321 Jun 10 18:03:16.527691 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 934/1897] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:03:16.538874 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-802decca-a158-45e0-aaac-dfa7eaa03407 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:16.549907 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-802decca-a158-45e0-aaac-dfa7eaa03407 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1217 microversion: 2.1 time: 0.128870 Jun 10 18:03:16.551125 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 964/1898] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:16 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1217 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:03:16.617345 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1494ea8f-2fcd-42c7-8159-ecf41b60bc22 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:16.617902 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1494ea8f-2fcd-42c7-8159-ecf41b60bc22 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:16.625931 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1494ea8f-2fcd-42c7-8159-ecf41b60bc22 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:16.626390 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1494ea8f-2fcd-42c7-8159-ecf41b60bc22 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:16.627185 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1494ea8f-2fcd-42c7-8159-ecf41b60bc22 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:16.627740 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1494ea8f-2fcd-42c7-8159-ecf41b60bc22 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:16.805798 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1494ea8f-2fcd-42c7-8159-ecf41b60bc22 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:16.816859 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1494ea8f-2fcd-42c7-8159-ecf41b60bc22 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8" status: 200 len: 1514 microversion: 2.1 time: 0.203757 Jun 10 18:03:16.826858 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 935/1899] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:16 2022] GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8 => generated 1514 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:16.885702 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ed04ce72-df28-4303-9169-5a307f97cfa7 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:16.888565 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ed04ce72-df28-4303-9169-5a307f97cfa7 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:16.898488 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ed04ce72-df28-4303-9169-5a307f97cfa7 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:16.899080 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ed04ce72-df28-4303-9169-5a307f97cfa7 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:16.899983 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ed04ce72-df28-4303-9169-5a307f97cfa7 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:16.900694 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ed04ce72-df28-4303-9169-5a307f97cfa7 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:16.935160 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-44df6461-9a04-456a-9acc-f1bfc0227d8a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:16.936042 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-44df6461-9a04-456a-9acc-f1bfc0227d8a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:16.939373 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ed04ce72-df28-4303-9169-5a307f97cfa7 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:16.940074 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ed04ce72-df28-4303-9169-5a307f97cfa7 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:16.940781 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-ed04ce72-df28-4303-9169-5a307f97cfa7 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lazy-loading 'fault' on Instance uuid ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:03:16.942789 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-44df6461-9a04-456a-9acc-f1bfc0227d8a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:16.943422 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-44df6461-9a04-456a-9acc-f1bfc0227d8a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:16.944534 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-44df6461-9a04-456a-9acc-f1bfc0227d8a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:16.945782 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-44df6461-9a04-456a-9acc-f1bfc0227d8a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:16.992700 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ed04ce72-df28-4303-9169-5a307f97cfa7 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63889ce9e75140bd9c730857468b7fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce8674b6db3471c8c94e809430651c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:17.002270 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ed04ce72-df28-4303-9169-5a307f97cfa7 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63" status: 200 len: 1331 microversion: 2.1 time: 0.120775 Jun 10 18:03:17.013371 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 965/1900] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:16 2022] GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63 => generated 1331 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:17.098368 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4417ba3c-494e-4533-95b2-47c764ae7148 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:17.099258 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4417ba3c-494e-4533-95b2-47c764ae7148 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:17.111044 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4417ba3c-494e-4533-95b2-47c764ae7148 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:17.111702 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4417ba3c-494e-4533-95b2-47c764ae7148 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:17.112488 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4417ba3c-494e-4533-95b2-47c764ae7148 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:17.112947 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4417ba3c-494e-4533-95b2-47c764ae7148 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:17.117842 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-44df6461-9a04-456a-9acc-f1bfc0227d8a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:17.130621 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-44df6461-9a04-456a-9acc-f1bfc0227d8a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1675 microversion: 2.1 time: 0.200256 Jun 10 18:03:17.135812 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 936/1901] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:16 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1675 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:03:17.175282 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9e318d23-3309-47a3-9209-b4db4443ab85 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:17.175999 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9e318d23-3309-47a3-9209-b4db4443ab85 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:17.189940 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9e318d23-3309-47a3-9209-b4db4443ab85 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:17.190338 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9e318d23-3309-47a3-9209-b4db4443ab85 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:17.192250 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9e318d23-3309-47a3-9209-b4db4443ab85 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:17.192937 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9e318d23-3309-47a3-9209-b4db4443ab85 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:17.274716 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4417ba3c-494e-4533-95b2-47c764ae7148 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:17.287179 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4417ba3c-494e-4533-95b2-47c764ae7148 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:17.290968 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4417ba3c-494e-4533-95b2-47c764ae7148 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:17.294000 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4417ba3c-494e-4533-95b2-47c764ae7148 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.202354 Jun 10 18:03:17.296099 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 966/1902] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:17 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:03:17.361009 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9e318d23-3309-47a3-9209-b4db4443ab85 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8eb46cd9bd428b9f144077f3d7ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a513641ffb46b091bb50e7b247e9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:17.374746 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9e318d23-3309-47a3-9209-b4db4443ab85 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "GET /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193" status: 200 len: 1323 microversion: 2.1 time: 0.202648 Jun 10 18:03:17.385991 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 937/1903] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:17 2022] GET /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193 => generated 1323 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:03:17.482869 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-54c17b26-8675-47fa-a4ea-295895953bb1 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:17.483490 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-54c17b26-8675-47fa-a4ea-295895953bb1 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:17.490243 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-54c17b26-8675-47fa-a4ea-295895953bb1 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:17.490708 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-54c17b26-8675-47fa-a4ea-295895953bb1 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:17.491495 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-54c17b26-8675-47fa-a4ea-295895953bb1 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:17.492205 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-54c17b26-8675-47fa-a4ea-295895953bb1 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:17.509437 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-41ee09ce-cf92-47a4-ad0b-a17156be1bc2 req-2e878e50-12a5-4182-8adc-62e2f8528e26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a5ddc8b-3e7a-48f8-9f48-69b3b5027193", "name": "network-vif-plugged", "status": "completed", "tag": "7477bf53-bd19-46b9-8356-316de6f77ec5"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:17.522334 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-41ee09ce-cf92-47a4-ad0b-a17156be1bc2 req-2e878e50-12a5-4182-8adc-62e2f8528e26 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:17.523794 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-41ee09ce-cf92-47a4-ad0b-a17156be1bc2 req-2e878e50-12a5-4182-8adc-62e2f8528e26 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:17.545541 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-41ee09ce-cf92-47a4-ad0b-a17156be1bc2 req-2e878e50-12a5-4182-8adc-62e2f8528e26 service nova] Creating event network-vif-plugged:7477bf53-bd19-46b9-8356-316de6f77ec5 for instance 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193 on chh1-master-2 Jun 10 18:03:17.556582 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-41ee09ce-cf92-47a4-ad0b-a17156be1bc2 req-2e878e50-12a5-4182-8adc-62e2f8528e26 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050579 Jun 10 18:03:17.560730 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 938/1904] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:03:17.570247 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-285ac7fa-4443-4ee7-b3ff-6a035076d19b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:17.571172 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-285ac7fa-4443-4ee7-b3ff-6a035076d19b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:17.578395 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-285ac7fa-4443-4ee7-b3ff-6a035076d19b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:17.578862 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-285ac7fa-4443-4ee7-b3ff-6a035076d19b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:17.579646 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-285ac7fa-4443-4ee7-b3ff-6a035076d19b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:17.580099 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-285ac7fa-4443-4ee7-b3ff-6a035076d19b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:17.619126 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-54c17b26-8675-47fa-a4ea-295895953bb1 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lazy-loading 'services' on Instance uuid a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:03:17.657649 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-285ac7fa-4443-4ee7-b3ff-6a035076d19b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:17.664339 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-54c17b26-8675-47fa-a4ea-295895953bb1 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1929 microversion: 2.75 time: 0.185868 Jun 10 18:03:17.673573 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 967/1905] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:17 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1929 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:17.683210 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-285ac7fa-4443-4ee7-b3ff-6a035076d19b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1217 microversion: 2.1 time: 0.119866 Jun 10 18:03:17.688701 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 939/1906] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:17 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1217 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:17.834198 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-992f8a4d-2400-49e1-bdf5-aba0c3623acd tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:17.834846 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-992f8a4d-2400-49e1-bdf5-aba0c3623acd tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:17.843257 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-992f8a4d-2400-49e1-bdf5-aba0c3623acd tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:17.844394 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-992f8a4d-2400-49e1-bdf5-aba0c3623acd tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:17.845262 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-992f8a4d-2400-49e1-bdf5-aba0c3623acd tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:17.845719 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-992f8a4d-2400-49e1-bdf5-aba0c3623acd tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:17.989658 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-992f8a4d-2400-49e1-bdf5-aba0c3623acd tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:17.999850 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-992f8a4d-2400-49e1-bdf5-aba0c3623acd tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8" status: 200 len: 1514 microversion: 2.1 time: 0.169657 Jun 10 18:03:18.002209 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 968/1907] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:17 2022] GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:18.028034 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ac84cd37-fc29-4f1c-8aff-da8bb3dac422 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:18.028677 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ac84cd37-fc29-4f1c-8aff-da8bb3dac422 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] [instance: ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:18.035374 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ac84cd37-fc29-4f1c-8aff-da8bb3dac422 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:18.035889 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ac84cd37-fc29-4f1c-8aff-da8bb3dac422 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:18.036628 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ac84cd37-fc29-4f1c-8aff-da8bb3dac422 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:18.037069 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ac84cd37-fc29-4f1c-8aff-da8bb3dac422 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:18.065546 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-ac84cd37-fc29-4f1c-8aff-da8bb3dac422 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] HTTP exception thrown: Instance ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63 could not be found. Jun 10 18:03:18.067611 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ac84cd37-fc29-4f1c-8aff-da8bb3dac422 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Request method failure captured: Jun 10 18:03:18.067611 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63 HTTP/1.1 Jun 10 18:03:18.067611 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:03:18.067611 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:03:18.067611 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:03:18.067611 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:03:18.067611 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:03:18.067611 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:03:18.067611 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:03:18.067611 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:03:18.067611 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4Z5DPhCwDxR1s7DUPyjuelM5dRSgWaZBXvILztBCbIwgm2hlLtnbPz-xJtOIFfgF5_02bnUfTXud8xZIeDZeEHuEkzUz0GPwElwhX45xYjpht0VbHWYeBZYFi00fQe8UPjMhAbwnySsXCvIspXY3E7BHYY8QWT-0FPNePSz585EAeQ Jun 10 18:03:18.067611 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:03:18.067611 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:03:18.067611 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:03:18.067611 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:03:18.067611 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:03:18.067611 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:03:18.067611 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: dce8674b6db3471c8c94e809430651c4 Jun 10 18:03:18.067611 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-VolumesAdminNegativeTest-1543597419 Jun 10 18:03:18.067611 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:03:18.067611 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:03:18.069305 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/dce8674b6db3471c8c94e809430651c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/dce8674b6db3471c8c94e809430651c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/dce8674b6db3471c8c94e809430651c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_dce8674b6db3471c8c94e809430651c4", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:03:18.069305 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-VolumesAdminNegativeTest-1543597419 Jun 10 18:03:18.069305 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: dce8674b6db3471c8c94e809430651c4 Jun 10 18:03:18.069305 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1543597419 Jun 10 18:03:18.069305 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-VolumesAdminNegativeTest-1543597419-project Jun 10 18:03:18.069305 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:03:18.069305 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:03:18.069305 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 63889ce9e75140bd9c730857468b7fd5 Jun 10 18:03:18.069305 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-VolumesAdminNegativeTest-1543597419-project Jun 10 18:03:18.069305 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:03:18.069305 chdv-master-2 devstack@n-api.service[126594]: exception: Instance ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63 could not be found. Jun 10 18:03:18.069305 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63'} Jun 10 18:03:18.070411 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:03:18.070411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:18.070411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:03:18.070411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:03:18.070411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:03:18.070411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:03:18.070411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:03:18.070411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:03:18.070411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:03:18.070411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:03:18.070411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63 could not be found. Jun 10 18:03:18.070411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:18.070411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:03:18.070411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:18.070411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:18.070411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:03:18.070411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:03:18.070411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:03:18.070411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:03:18.070411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:03:18.071922 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:03:18.071922 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:03:18.071922 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:03:18.071922 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:03:18.071922 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:03:18.071922 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:03:18.071922 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:03:18.071922 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63 could not be found. Jun 10 18:03:18.071922 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:18.071922 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:03:18.071922 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:18.071922 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:18.071922 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:03:18.071922 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:03:18.071922 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:03:18.071922 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:03:18.071922 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63 could not be found. Jun 10 18:03:18.071922 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:18.073505 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ac84cd37-fc29-4f1c-8aff-da8bb3dac422 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Returning 404 to user: Instance ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:03:18.073505 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ac84cd37-fc29-4f1c-8aff-da8bb3dac422 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63" status: 404 len: 111 microversion: 2.1 time: 0.045439 Jun 10 18:03:18.075841 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 940/1908] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:18 2022] GET /compute/v2.1/servers/ca5a2d4a-a963-49f4-94a5-0ce3cf7dbd63 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:03:18.081475 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-96844955-aa83-4783-bb95-903675098837 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] Calling method '.version_select at 0x7f77c0616670>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:18.150963 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bc3e4ffa-874b-4d98-9e81-b120d2bc5c6f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:18.151595 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bc3e4ffa-874b-4d98-9e81-b120d2bc5c6f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:18.153623 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:03:18.158369 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bc3e4ffa-874b-4d98-9e81-b120d2bc5c6f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:18.158829 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bc3e4ffa-874b-4d98-9e81-b120d2bc5c6f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:18.159641 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bc3e4ffa-874b-4d98-9e81-b120d2bc5c6f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:18.160115 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bc3e4ffa-874b-4d98-9e81-b120d2bc5c6f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:18.173638 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-96844955-aa83-4783-bb95-903675098837 tempest-VolumesAdminNegativeTest-1543597419 tempest-VolumesAdminNegativeTest-1543597419-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1703438657" status: 202 len: 0 microversion: 2.1 time: 0.096106 Jun 10 18:03:18.174352 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 969/1909] 10.222.0.35 () {58 vars in 1220 bytes} [Fri Jun 10 18:03:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1703438657 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:03:18.305255 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bc3e4ffa-874b-4d98-9e81-b120d2bc5c6f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:18.313933 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1fb40763-32ff-4d51-baf1-f08601974e05 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:18.319741 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1fb40763-32ff-4d51-baf1-f08601974e05 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:18.319882 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bc3e4ffa-874b-4d98-9e81-b120d2bc5c6f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1675 microversion: 2.1 time: 0.168541 Jun 10 18:03:18.319882 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 941/1910] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:18 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:03:18.322164 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1fb40763-32ff-4d51-baf1-f08601974e05 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:18.322714 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1fb40763-32ff-4d51-baf1-f08601974e05 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:18.323684 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1fb40763-32ff-4d51-baf1-f08601974e05 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:18.324222 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1fb40763-32ff-4d51-baf1-f08601974e05 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:18.391368 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-45db0e08-2aa9-49d4-93a7-2d9072938929 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:18.403165 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-45db0e08-2aa9-49d4-93a7-2d9072938929 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:18.423690 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-45db0e08-2aa9-49d4-93a7-2d9072938929 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:18.424670 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-45db0e08-2aa9-49d4-93a7-2d9072938929 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:18.425712 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-45db0e08-2aa9-49d4-93a7-2d9072938929 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:18.426161 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-45db0e08-2aa9-49d4-93a7-2d9072938929 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:18.541344 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1fb40763-32ff-4d51-baf1-f08601974e05 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:18.553086 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1fb40763-32ff-4d51-baf1-f08601974e05 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:18.555269 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1fb40763-32ff-4d51-baf1-f08601974e05 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:18.557810 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1fb40763-32ff-4d51-baf1-f08601974e05 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.249599 Jun 10 18:03:18.569279 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 970/1911] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:18 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:18.599114 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-45db0e08-2aa9-49d4-93a7-2d9072938929 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8eb46cd9bd428b9f144077f3d7ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a513641ffb46b091bb50e7b247e9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:18.607254 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-45db0e08-2aa9-49d4-93a7-2d9072938929 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "GET /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193" status: 200 len: 1323 microversion: 2.1 time: 0.220021 Jun 10 18:03:18.616545 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 942/1912] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:18 2022] GET /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193 => generated 1323 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:18.684969 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bd4d0286-c57c-479e-8e37-fa84ae5bcfb7 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:18.685655 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bd4d0286-c57c-479e-8e37-fa84ae5bcfb7 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:18.691874 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bd4d0286-c57c-479e-8e37-fa84ae5bcfb7 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:18.692549 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bd4d0286-c57c-479e-8e37-fa84ae5bcfb7 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:18.693336 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bd4d0286-c57c-479e-8e37-fa84ae5bcfb7 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:18.695164 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bd4d0286-c57c-479e-8e37-fa84ae5bcfb7 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:18.700447 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9d5d924c-56da-4369-bc5e-7e7c02ef1ce0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:18.701067 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9d5d924c-56da-4369-bc5e-7e7c02ef1ce0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:18.710650 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9d5d924c-56da-4369-bc5e-7e7c02ef1ce0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:18.711333 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9d5d924c-56da-4369-bc5e-7e7c02ef1ce0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:18.712129 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9d5d924c-56da-4369-bc5e-7e7c02ef1ce0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:18.712597 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9d5d924c-56da-4369-bc5e-7e7c02ef1ce0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:18.779358 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9d5d924c-56da-4369-bc5e-7e7c02ef1ce0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:18.785101 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9d5d924c-56da-4369-bc5e-7e7c02ef1ce0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1217 microversion: 2.1 time: 0.088555 Jun 10 18:03:18.792835 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 943/1913] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:18 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:18.820129 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-bd4d0286-c57c-479e-8e37-fa84ae5bcfb7 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lazy-loading 'services' on Instance uuid a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:03:18.837767 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bd4d0286-c57c-479e-8e37-fa84ae5bcfb7 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1929 microversion: 2.75 time: 0.157130 Jun 10 18:03:18.838352 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 971/1914] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:18 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1929 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:03:19.017536 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bc21c454-3f08-4a18-90b4-c1d2364e1542 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:19.018249 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bc21c454-3f08-4a18-90b4-c1d2364e1542 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:19.024728 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bc21c454-3f08-4a18-90b4-c1d2364e1542 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:19.025114 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bc21c454-3f08-4a18-90b4-c1d2364e1542 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:19.025883 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bc21c454-3f08-4a18-90b4-c1d2364e1542 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:19.026324 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bc21c454-3f08-4a18-90b4-c1d2364e1542 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:19.175120 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bc21c454-3f08-4a18-90b4-c1d2364e1542 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:19.183657 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bc21c454-3f08-4a18-90b4-c1d2364e1542 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8" status: 200 len: 1514 microversion: 2.1 time: 0.170426 Jun 10 18:03:19.184771 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 944/1915] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:19 2022] GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:19.333618 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-69028213-51a9-4276-b112-cb71ab1b2006 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:19.334243 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-69028213-51a9-4276-b112-cb71ab1b2006 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:19.344677 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-69028213-51a9-4276-b112-cb71ab1b2006 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:19.345501 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-69028213-51a9-4276-b112-cb71ab1b2006 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:19.346559 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-69028213-51a9-4276-b112-cb71ab1b2006 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:19.347228 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-69028213-51a9-4276-b112-cb71ab1b2006 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:19.577094 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6e8f5b1c-4d58-4fba-80c7-f89c1ad6e11e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:19.577776 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6e8f5b1c-4d58-4fba-80c7-f89c1ad6e11e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:19.584187 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6e8f5b1c-4d58-4fba-80c7-f89c1ad6e11e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:19.584686 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6e8f5b1c-4d58-4fba-80c7-f89c1ad6e11e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:19.585468 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6e8f5b1c-4d58-4fba-80c7-f89c1ad6e11e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:19.585940 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6e8f5b1c-4d58-4fba-80c7-f89c1ad6e11e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:19.725310 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6e8f5b1c-4d58-4fba-80c7-f89c1ad6e11e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:19.734835 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6e8f5b1c-4d58-4fba-80c7-f89c1ad6e11e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:19.737261 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6e8f5b1c-4d58-4fba-80c7-f89c1ad6e11e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:19.738550 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6e8f5b1c-4d58-4fba-80c7-f89c1ad6e11e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.166080 Jun 10 18:03:19.739128 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 945/1916] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:19 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:03:19.754402 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f6c4b589-f46d-4b5c-92c7-5324d44aeefc tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:19.755032 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f6c4b589-f46d-4b5c-92c7-5324d44aeefc tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:19.762795 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f6c4b589-f46d-4b5c-92c7-5324d44aeefc tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:19.763263 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f6c4b589-f46d-4b5c-92c7-5324d44aeefc tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:19.764145 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f6c4b589-f46d-4b5c-92c7-5324d44aeefc tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:19.764630 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f6c4b589-f46d-4b5c-92c7-5324d44aeefc tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:19.910790 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f6c4b589-f46d-4b5c-92c7-5324d44aeefc tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8eb46cd9bd428b9f144077f3d7ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a513641ffb46b091bb50e7b247e9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:19.919088 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f6c4b589-f46d-4b5c-92c7-5324d44aeefc tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "GET /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193" status: 200 len: 1323 microversion: 2.1 time: 0.178977 Jun 10 18:03:19.919660 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 946/1917] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:19 2022] GET /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193 => generated 1323 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:19.924662 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-30ec9304-8779-4989-b8bd-b1f732605681 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:19.925942 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-30ec9304-8779-4989-b8bd-b1f732605681 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:19.931602 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-30ec9304-8779-4989-b8bd-b1f732605681 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:19.932087 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-30ec9304-8779-4989-b8bd-b1f732605681 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:19.933531 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-30ec9304-8779-4989-b8bd-b1f732605681 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:19.933979 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-30ec9304-8779-4989-b8bd-b1f732605681 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:19.987967 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-69028213-51a9-4276-b112-cb71ab1b2006 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:19.997315 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-69028213-51a9-4276-b112-cb71ab1b2006 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.668853 Jun 10 18:03:19.998123 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 972/1918] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:19 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:19.999455 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-30ec9304-8779-4989-b8bd-b1f732605681 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:20.003075 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c022f0b5-248f-4fa6-8eec-9b5d66b7aafa tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:20.003783 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c022f0b5-248f-4fa6-8eec-9b5d66b7aafa tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:20.010566 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c022f0b5-248f-4fa6-8eec-9b5d66b7aafa tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:20.011375 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-30ec9304-8779-4989-b8bd-b1f732605681 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1217 microversion: 2.1 time: 0.090544 Jun 10 18:03:20.011500 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c022f0b5-248f-4fa6-8eec-9b5d66b7aafa tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:20.012039 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 947/1919] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:19 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:20.012882 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c022f0b5-248f-4fa6-8eec-9b5d66b7aafa tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:20.013951 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c022f0b5-248f-4fa6-8eec-9b5d66b7aafa tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:20.025057 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3d2348af-5b6d-4353-a008-d65174468d2f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:20.026495 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3d2348af-5b6d-4353-a008-d65174468d2f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:20.034129 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3d2348af-5b6d-4353-a008-d65174468d2f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:20.034681 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3d2348af-5b6d-4353-a008-d65174468d2f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:20.035539 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3d2348af-5b6d-4353-a008-d65174468d2f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:20.036208 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3d2348af-5b6d-4353-a008-d65174468d2f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:20.107984 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-c022f0b5-248f-4fa6-8eec-9b5d66b7aafa tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lazy-loading 'services' on Instance uuid a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:03:20.126935 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c022f0b5-248f-4fa6-8eec-9b5d66b7aafa tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1929 microversion: 2.75 time: 0.127313 Jun 10 18:03:20.127711 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 973/1920] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:19 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1929 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:20.200766 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0e65e002-4c19-474e-ab82-edd99bf8674b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:20.201453 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0e65e002-4c19-474e-ab82-edd99bf8674b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:20.207954 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0e65e002-4c19-474e-ab82-edd99bf8674b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:20.208498 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0e65e002-4c19-474e-ab82-edd99bf8674b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:20.209274 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0e65e002-4c19-474e-ab82-edd99bf8674b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:20.209710 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0e65e002-4c19-474e-ab82-edd99bf8674b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:20.416624 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0e65e002-4c19-474e-ab82-edd99bf8674b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:20.425806 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0e65e002-4c19-474e-ab82-edd99bf8674b tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8" status: 200 len: 1514 microversion: 2.1 time: 0.228747 Jun 10 18:03:20.426467 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 974/1921] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:20 2022] GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8 => generated 1514 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:20.758575 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bad85aba-711a-45a4-9657-62af9d21d38d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:20.759536 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bad85aba-711a-45a4-9657-62af9d21d38d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:20.767325 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bad85aba-711a-45a4-9657-62af9d21d38d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:20.767787 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bad85aba-711a-45a4-9657-62af9d21d38d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:20.768609 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bad85aba-711a-45a4-9657-62af9d21d38d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:20.769267 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bad85aba-711a-45a4-9657-62af9d21d38d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:20.827875 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3d2348af-5b6d-4353-a008-d65174468d2f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "POST /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1/action" status: 200 len: 143 microversion: 2.1 time: 0.814481 Jun 10 18:03:20.833321 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 948/1922] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:03:20 2022] POST /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1/action => generated 143 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:03:20.840491 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fe3f73f6-7a6a-4790-aa1b-b2f54ee14c08 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:20.841331 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fe3f73f6-7a6a-4790-aa1b-b2f54ee14c08 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:20.848544 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fe3f73f6-7a6a-4790-aa1b-b2f54ee14c08 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:20.849074 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fe3f73f6-7a6a-4790-aa1b-b2f54ee14c08 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:20.849910 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fe3f73f6-7a6a-4790-aa1b-b2f54ee14c08 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:20.850421 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fe3f73f6-7a6a-4790-aa1b-b2f54ee14c08 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:20.871152 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:03:20.988497 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fe3f73f6-7a6a-4790-aa1b-b2f54ee14c08 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:20.996912 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fe3f73f6-7a6a-4790-aa1b-b2f54ee14c08 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.161875 Jun 10 18:03:20.997604 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 949/1923] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:20 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:21.002691 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5111e47d-d2af-4f07-9f05-75b60e981cf4 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:21.003532 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5111e47d-d2af-4f07-9f05-75b60e981cf4 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:21.013247 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bad85aba-711a-45a4-9657-62af9d21d38d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:21.015263 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5111e47d-d2af-4f07-9f05-75b60e981cf4 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:21.016790 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5111e47d-d2af-4f07-9f05-75b60e981cf4 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:21.018240 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5111e47d-d2af-4f07-9f05-75b60e981cf4 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:21.018707 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5111e47d-d2af-4f07-9f05-75b60e981cf4 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:21.022774 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bad85aba-711a-45a4-9657-62af9d21d38d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:21.025105 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bad85aba-711a-45a4-9657-62af9d21d38d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:21.026321 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bad85aba-711a-45a4-9657-62af9d21d38d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.272768 Jun 10 18:03:21.035535 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 975/1924] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:20 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:03:21.040909 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ecf6885b-3401-4071-85f5-6b926ea38fca tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:21.041642 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ecf6885b-3401-4071-85f5-6b926ea38fca tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:21.049156 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ecf6885b-3401-4071-85f5-6b926ea38fca tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:21.050303 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ecf6885b-3401-4071-85f5-6b926ea38fca tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:21.050525 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ecf6885b-3401-4071-85f5-6b926ea38fca tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:21.050971 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ecf6885b-3401-4071-85f5-6b926ea38fca tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:21.162831 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5111e47d-d2af-4f07-9f05-75b60e981cf4 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8eb46cd9bd428b9f144077f3d7ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a513641ffb46b091bb50e7b247e9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:21.176150 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5111e47d-d2af-4f07-9f05-75b60e981cf4 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "GET /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193" status: 200 len: 1323 microversion: 2.1 time: 0.176789 Jun 10 18:03:21.176933 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 950/1925] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:20 2022] GET /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193 => generated 1323 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:21.182462 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5e4bc259-9ee5-478c-aa78-d7760d01877f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:21.183931 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5e4bc259-9ee5-478c-aa78-d7760d01877f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:21.194422 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5e4bc259-9ee5-478c-aa78-d7760d01877f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:21.195521 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5e4bc259-9ee5-478c-aa78-d7760d01877f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:21.197113 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5e4bc259-9ee5-478c-aa78-d7760d01877f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:21.197731 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5e4bc259-9ee5-478c-aa78-d7760d01877f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:21.285043 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5e4bc259-9ee5-478c-aa78-d7760d01877f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:21.293312 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5e4bc259-9ee5-478c-aa78-d7760d01877f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1209 microversion: 2.1 time: 0.115188 Jun 10 18:03:21.294067 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 951/1926] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:21 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1209 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:21.300201 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f26d105f-6dcb-40eb-a383-56f015d91d31 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:21.300876 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f26d105f-6dcb-40eb-a383-56f015d91d31 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:21.307100 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f26d105f-6dcb-40eb-a383-56f015d91d31 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:21.311316 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f26d105f-6dcb-40eb-a383-56f015d91d31 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:21.311316 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f26d105f-6dcb-40eb-a383-56f015d91d31 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:21.311316 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f26d105f-6dcb-40eb-a383-56f015d91d31 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:21.353170 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ecf6885b-3401-4071-85f5-6b926ea38fca tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:21.363332 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ecf6885b-3401-4071-85f5-6b926ea38fca tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.326221 Jun 10 18:03:21.364100 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 976/1927] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:21 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:21.380813 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7665d890-66ed-4650-9114-21ddbebfe2de tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:21.381821 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7665d890-66ed-4650-9114-21ddbebfe2de tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:21.388983 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7665d890-66ed-4650-9114-21ddbebfe2de tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:21.389526 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7665d890-66ed-4650-9114-21ddbebfe2de tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:21.393025 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7665d890-66ed-4650-9114-21ddbebfe2de tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:21.393924 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7665d890-66ed-4650-9114-21ddbebfe2de tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:21.406490 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-f26d105f-6dcb-40eb-a383-56f015d91d31 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lazy-loading 'services' on Instance uuid a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:03:21.432076 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f26d105f-6dcb-40eb-a383-56f015d91d31 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1929 microversion: 2.75 time: 0.137113 Jun 10 18:03:21.440126 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 952/1928] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:21 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1929 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:21.447053 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f39a9a82-2820-4ee3-8699-49d253b4c808 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:21.447691 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f39a9a82-2820-4ee3-8699-49d253b4c808 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:21.456064 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f39a9a82-2820-4ee3-8699-49d253b4c808 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:21.456064 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f39a9a82-2820-4ee3-8699-49d253b4c808 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:21.456064 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f39a9a82-2820-4ee3-8699-49d253b4c808 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:21.456064 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f39a9a82-2820-4ee3-8699-49d253b4c808 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:21.639946 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f39a9a82-2820-4ee3-8699-49d253b4c808 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:21.648492 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f39a9a82-2820-4ee3-8699-49d253b4c808 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8" status: 200 len: 1514 microversion: 2.1 time: 0.205324 Jun 10 18:03:21.649263 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 953/1929] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:21 2022] GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8 => generated 1514 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:21.697957 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7665d890-66ed-4650-9114-21ddbebfe2de tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:21.707235 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7665d890-66ed-4650-9114-21ddbebfe2de tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.330430 Jun 10 18:03:21.715040 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 977/1930] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:21 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:03:21.723940 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d81413e6-b0cd-46f4-a5b0-e364d272fb82 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:21.724768 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d81413e6-b0cd-46f4-a5b0-e364d272fb82 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:21.731557 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d81413e6-b0cd-46f4-a5b0-e364d272fb82 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:21.732021 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d81413e6-b0cd-46f4-a5b0-e364d272fb82 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:21.732837 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d81413e6-b0cd-46f4-a5b0-e364d272fb82 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:21.733290 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d81413e6-b0cd-46f4-a5b0-e364d272fb82 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:21.875962 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d81413e6-b0cd-46f4-a5b0-e364d272fb82 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:21.884461 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d81413e6-b0cd-46f4-a5b0-e364d272fb82 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.164340 Jun 10 18:03:21.885359 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 954/1931] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:21 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:22.009054 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0bd5c0d8-f21b-4d43-b5c4-2f3caa5f2a7f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1590174493", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "02812646-dd80-4769-8285-9699f6c583d0"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:22.045568 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5756e296-6a7f-4676-bf0f-e841653b7c39 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:22.046251 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5756e296-6a7f-4676-bf0f-e841653b7c39 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:22.061693 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5756e296-6a7f-4676-bf0f-e841653b7c39 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:22.063402 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5756e296-6a7f-4676-bf0f-e841653b7c39 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:22.064800 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5756e296-6a7f-4676-bf0f-e841653b7c39 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:22.065138 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5756e296-6a7f-4676-bf0f-e841653b7c39 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:22.079981 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-0bd5c0d8-f21b-4d43-b5c4-2f3caa5f2a7f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] validate_networks() for [('02812646-dd80-4769-8285-9699f6c583d0', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:03:22.232504 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5756e296-6a7f-4676-bf0f-e841653b7c39 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:22.248343 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5756e296-6a7f-4676-bf0f-e841653b7c39 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:22.249547 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5756e296-6a7f-4676-bf0f-e841653b7c39 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:22.250739 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5756e296-6a7f-4676-bf0f-e841653b7c39 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.210631 Jun 10 18:03:22.253276 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 955/1932] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:22 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:22.257213 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-29c69e45-3536-4499-ae24-17845e54b9bf tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:22.257817 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-29c69e45-3536-4499-ae24-17845e54b9bf tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:22.264692 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-29c69e45-3536-4499-ae24-17845e54b9bf tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:22.265376 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-29c69e45-3536-4499-ae24-17845e54b9bf tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:22.266267 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-29c69e45-3536-4499-ae24-17845e54b9bf tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:22.267018 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-29c69e45-3536-4499-ae24-17845e54b9bf tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:22.414932 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-29c69e45-3536-4499-ae24-17845e54b9bf tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8eb46cd9bd428b9f144077f3d7ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a513641ffb46b091bb50e7b247e9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:22.425121 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-29c69e45-3536-4499-ae24-17845e54b9bf tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "GET /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193" status: 200 len: 1323 microversion: 2.1 time: 0.172504 Jun 10 18:03:22.425736 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 956/1933] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:22 2022] GET /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193 => generated 1323 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:22.430316 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-829d6216-e596-49b1-a8d4-6d8b38146fc4 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:22.430921 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-829d6216-e596-49b1-a8d4-6d8b38146fc4 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:22.437426 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-829d6216-e596-49b1-a8d4-6d8b38146fc4 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:22.437878 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-829d6216-e596-49b1-a8d4-6d8b38146fc4 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:22.438646 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-829d6216-e596-49b1-a8d4-6d8b38146fc4 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:22.439085 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-829d6216-e596-49b1-a8d4-6d8b38146fc4 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:22.804886 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-829d6216-e596-49b1-a8d4-6d8b38146fc4 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:22.813814 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-829d6216-e596-49b1-a8d4-6d8b38146fc4 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1209 microversion: 2.1 time: 0.386997 Jun 10 18:03:22.818008 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 957/1934] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:22 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1209 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:22.822496 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-99e503db-3416-4899-877c-e13ef3a1ff87 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:22.829305 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-99e503db-3416-4899-877c-e13ef3a1ff87 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:22.843406 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-99e503db-3416-4899-877c-e13ef3a1ff87 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:22.843911 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-99e503db-3416-4899-877c-e13ef3a1ff87 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:22.844924 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-99e503db-3416-4899-877c-e13ef3a1ff87 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:22.845547 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-99e503db-3416-4899-877c-e13ef3a1ff87 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:22.943119 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-99e503db-3416-4899-877c-e13ef3a1ff87 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lazy-loading 'services' on Instance uuid a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:03:22.975749 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-99e503db-3416-4899-877c-e13ef3a1ff87 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1935 microversion: 2.75 time: 0.158416 Jun 10 18:03:22.976739 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 958/1935] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:22 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1935 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:22.982038 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d75674ef-eee6-4acc-b5da-e0f5aadcfaf0 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:22.983110 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d75674ef-eee6-4acc-b5da-e0f5aadcfaf0 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:22.993992 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d75674ef-eee6-4acc-b5da-e0f5aadcfaf0 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:22.993992 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d75674ef-eee6-4acc-b5da-e0f5aadcfaf0 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:22.993992 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d75674ef-eee6-4acc-b5da-e0f5aadcfaf0 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:22.993992 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d75674ef-eee6-4acc-b5da-e0f5aadcfaf0 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:23.017554 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-0bd5c0d8-f21b-4d43-b5c4-2f3caa5f2a7f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:03:23.018579 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-0bd5c0d8-f21b-4d43-b5c4-2f3caa5f2a7f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:03:23.019471 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-0bd5c0d8-f21b-4d43-b5c4-2f3caa5f2a7f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:03:23.020970 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-0bd5c0d8-f21b-4d43-b5c4-2f3caa5f2a7f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:03:23.021822 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-0bd5c0d8-f21b-4d43-b5c4-2f3caa5f2a7f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:03:23.054673 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0bd5c0d8-f21b-4d43-b5c4-2f3caa5f2a7f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:23.055481 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0bd5c0d8-f21b-4d43-b5c4-2f3caa5f2a7f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:23.057046 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0bd5c0d8-f21b-4d43-b5c4-2f3caa5f2a7f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:23.068656 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0bd5c0d8-f21b-4d43-b5c4-2f3caa5f2a7f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:23.107420 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-0bd5c0d8-f21b-4d43-b5c4-2f3caa5f2a7f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Getting quotas for project 2b34cb51c168497088d66fa0e507e364. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:03:23.116411 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-0bd5c0d8-f21b-4d43-b5c4-2f3caa5f2a7f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Getting quotas for user 352e7f5de76c42da9241721fe0f0bf86 and project 2b34cb51c168497088d66fa0e507e364. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:03:23.125887 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d75674ef-eee6-4acc-b5da-e0f5aadcfaf0 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:23.136639 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0bd5c0d8-f21b-4d43-b5c4-2f3caa5f2a7f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:03:23.137479 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d75674ef-eee6-4acc-b5da-e0f5aadcfaf0 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8" status: 200 len: 1472 microversion: 2.1 time: 0.159492 Jun 10 18:03:23.138083 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 959/1936] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:22 2022] GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8 => generated 1472 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:23.139768 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0bd5c0d8-f21b-4d43-b5c4-2f3caa5f2a7f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 3a12492e-7860-4786-a695-48505e2c1840] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:03:23.269157 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d48633fb-8c8d-4ca9-bd72-1b08ef7aedbe tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:23.270191 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d48633fb-8c8d-4ca9-bd72-1b08ef7aedbe tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:23.277285 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d48633fb-8c8d-4ca9-bd72-1b08ef7aedbe tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:23.278162 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d48633fb-8c8d-4ca9-bd72-1b08ef7aedbe tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:23.279214 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d48633fb-8c8d-4ca9-bd72-1b08ef7aedbe tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:23.279895 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d48633fb-8c8d-4ca9-bd72-1b08ef7aedbe tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:23.430097 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0bd5c0d8-f21b-4d43-b5c4-2f3caa5f2a7f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.425608 Jun 10 18:03:23.445241 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 978/1937] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:03:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:03:23.459332 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b91e3c6a-3c70-4e35-ad17-46527b46753d tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:23.460360 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b91e3c6a-3c70-4e35-ad17-46527b46753d tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:23.468805 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:03:23.471227 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b91e3c6a-3c70-4e35-ad17-46527b46753d tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:23.471909 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b91e3c6a-3c70-4e35-ad17-46527b46753d tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:23.473426 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b91e3c6a-3c70-4e35-ad17-46527b46753d tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:23.474228 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b91e3c6a-3c70-4e35-ad17-46527b46753d tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:23.502013 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:03:23.602901 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d48633fb-8c8d-4ca9-bd72-1b08ef7aedbe tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:23.625450 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d48633fb-8c8d-4ca9-bd72-1b08ef7aedbe tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:23.631626 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d48633fb-8c8d-4ca9-bd72-1b08ef7aedbe tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:23.632985 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d48633fb-8c8d-4ca9-bd72-1b08ef7aedbe tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.367868 Jun 10 18:03:23.638738 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 960/1938] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:23 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:03:23.653372 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-75030e5e-832e-45b5-be71-19309e2cc777 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:23.660387 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-75030e5e-832e-45b5-be71-19309e2cc777 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 3a12492e-7860-4786-a695-48505e2c1840] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:23.755856 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-75030e5e-832e-45b5-be71-19309e2cc777 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:23.764057 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-75030e5e-832e-45b5-be71-19309e2cc777 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840" status: 200 len: 1215 microversion: 2.1 time: 0.114473 Jun 10 18:03:23.778614 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 961/1939] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:23 2022] GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840 => generated 1215 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:23.783556 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-cdc4b7ba-f168-42f4-9d93-17675989cd87 req-f493660f-e2cf-448d-9441-6deef3ce7a75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8", "name": "network-vif-deleted", "tag": "e789e333-819f-48ad-8d66-0eca0af19c5e"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:23.810571 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-cdc4b7ba-f168-42f4-9d93-17675989cd87 req-f493660f-e2cf-448d-9441-6deef3ce7a75 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:23.813912 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-cdc4b7ba-f168-42f4-9d93-17675989cd87 req-f493660f-e2cf-448d-9441-6deef3ce7a75 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:23.829430 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-cdc4b7ba-f168-42f4-9d93-17675989cd87 req-f493660f-e2cf-448d-9441-6deef3ce7a75 service nova] Creating event network-vif-deleted:e789e333-819f-48ad-8d66-0eca0af19c5e for instance b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8 on chh1-master-2 Jun 10 18:03:23.837103 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-cdc4b7ba-f168-42f4-9d93-17675989cd87 req-f493660f-e2cf-448d-9441-6deef3ce7a75 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056978 Jun 10 18:03:23.839892 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 962/1940] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:03:23.845047 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b91e3c6a-3c70-4e35-ad17-46527b46753d tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8eb46cd9bd428b9f144077f3d7ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a513641ffb46b091bb50e7b247e9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:23.846305 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ab38bcc1-8dd2-4686-91d9-287aebbe2a84 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:23.847216 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ab38bcc1-8dd2-4686-91d9-287aebbe2a84 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:23.871065 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b91e3c6a-3c70-4e35-ad17-46527b46753d tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "GET /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193" status: 200 len: 1519 microversion: 2.1 time: 0.423772 Jun 10 18:03:23.877742 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ab38bcc1-8dd2-4686-91d9-287aebbe2a84 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:23.878564 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ab38bcc1-8dd2-4686-91d9-287aebbe2a84 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:23.879627 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ab38bcc1-8dd2-4686-91d9-287aebbe2a84 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:23.880532 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ab38bcc1-8dd2-4686-91d9-287aebbe2a84 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:23.890479 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 979/1941] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:23 2022] GET /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193 => generated 1519 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:23.910697 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-084a8e47-ea43-4808-a43c-d593584e34fe tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Action: 'action', calling method: .version_select at 0x7f77c3bc3ca0>, body: {"addFloatingIp": {"address": "172.39.7.66"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:23.911883 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-084a8e47-ea43-4808-a43c-d593584e34fe tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:23.927756 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-084a8e47-ea43-4808-a43c-d593584e34fe tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:23.945002 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-084a8e47-ea43-4808-a43c-d593584e34fe tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:23.946876 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-084a8e47-ea43-4808-a43c-d593584e34fe tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:23.946876 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-084a8e47-ea43-4808-a43c-d593584e34fe tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:23.954510 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:03:24.038310 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ab38bcc1-8dd2-4686-91d9-287aebbe2a84 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:24.046955 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ab38bcc1-8dd2-4686-91d9-287aebbe2a84 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1273 microversion: 2.1 time: 0.205468 Jun 10 18:03:24.056767 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 963/1942] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:23 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1273 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:24.056881 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-084a8e47-ea43-4808-a43c-d593584e34fe tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Acquired lock "refresh_cache-d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d" {{(pid=126595) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 10 18:03:24.056984 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6e4ce85c-977d-4c7b-8472-55c193dd633d tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:24.056984 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6e4ce85c-977d-4c7b-8472-55c193dd633d tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:24.061946 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6e4ce85c-977d-4c7b-8472-55c193dd633d tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:24.062624 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6e4ce85c-977d-4c7b-8472-55c193dd633d tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:24.063609 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6e4ce85c-977d-4c7b-8472-55c193dd633d tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:24.064222 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6e4ce85c-977d-4c7b-8472-55c193dd633d tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:24.173744 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-6e4ce85c-977d-4c7b-8472-55c193dd633d tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lazy-loading 'services' on Instance uuid a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:03:24.221910 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6e4ce85c-977d-4c7b-8472-55c193dd633d tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1935 microversion: 2.75 time: 0.170012 Jun 10 18:03:24.237966 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 964/1943] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:24 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1935 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:24.237966 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-698cc44c-a14e-46b2-bf70-1ce9b5429669 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:24.239358 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-698cc44c-a14e-46b2-bf70-1ce9b5429669 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:24.255661 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-698cc44c-a14e-46b2-bf70-1ce9b5429669 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:24.256846 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-698cc44c-a14e-46b2-bf70-1ce9b5429669 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:24.258335 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-698cc44c-a14e-46b2-bf70-1ce9b5429669 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:24.258800 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-698cc44c-a14e-46b2-bf70-1ce9b5429669 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:24.310875 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-698cc44c-a14e-46b2-bf70-1ce9b5429669 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:24.317668 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-698cc44c-a14e-46b2-bf70-1ce9b5429669 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:24.318295 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-698cc44c-a14e-46b2-bf70-1ce9b5429669 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lazy-loading 'fault' on Instance uuid b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:03:24.383431 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-698cc44c-a14e-46b2-bf70-1ce9b5429669 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1d1a0bd05d43368b969a9cc9435366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188f32238c2c4e4f993cd11937715216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:24.400850 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-698cc44c-a14e-46b2-bf70-1ce9b5429669 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8" status: 200 len: 1308 microversion: 2.1 time: 0.173260 Jun 10 18:03:24.402195 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 965/1944] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:24 2022] GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8 => generated 1308 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:24.652417 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-44ad216f-62a5-4674-802c-ce12fd92f62d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:24.652920 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-44ad216f-62a5-4674-802c-ce12fd92f62d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:24.667805 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-44ad216f-62a5-4674-802c-ce12fd92f62d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:24.668159 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-44ad216f-62a5-4674-802c-ce12fd92f62d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:24.669014 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-44ad216f-62a5-4674-802c-ce12fd92f62d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:24.669458 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-44ad216f-62a5-4674-802c-ce12fd92f62d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:24.712267 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:03:24.975923 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-44ad216f-62a5-4674-802c-ce12fd92f62d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:24.990220 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-44ad216f-62a5-4674-802c-ce12fd92f62d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:24.992187 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-44ad216f-62a5-4674-802c-ce12fd92f62d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:24.996341 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-44ad216f-62a5-4674-802c-ce12fd92f62d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.349196 Jun 10 18:03:24.997734 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 966/1945] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:24 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:03:25.011932 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e7ff46a8-cb23-4499-b27e-55ece6287787 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:25.017720 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e7ff46a8-cb23-4499-b27e-55ece6287787 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 3a12492e-7860-4786-a695-48505e2c1840] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:25.033149 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7ff46a8-cb23-4499-b27e-55ece6287787 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:25.033538 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7ff46a8-cb23-4499-b27e-55ece6287787 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:25.034657 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7ff46a8-cb23-4499-b27e-55ece6287787 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:25.034789 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7ff46a8-cb23-4499-b27e-55ece6287787 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:25.216563 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e7ff46a8-cb23-4499-b27e-55ece6287787 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:25.225709 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e7ff46a8-cb23-4499-b27e-55ece6287787 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840" status: 200 len: 1219 microversion: 2.1 time: 0.226136 Jun 10 18:03:25.231006 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 967/1946] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:24 2022] GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840 => generated 1219 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:25.251158 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-60b617aa-f1dd-4d9a-981c-4dd27c27de33 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:25.264658 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-60b617aa-f1dd-4d9a-981c-4dd27c27de33 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:25.278941 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-60b617aa-f1dd-4d9a-981c-4dd27c27de33 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:25.282420 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-60b617aa-f1dd-4d9a-981c-4dd27c27de33 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:25.284125 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-60b617aa-f1dd-4d9a-981c-4dd27c27de33 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:25.284800 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-60b617aa-f1dd-4d9a-981c-4dd27c27de33 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:25.446464 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-60b617aa-f1dd-4d9a-981c-4dd27c27de33 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:25.465435 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-60b617aa-f1dd-4d9a-981c-4dd27c27de33 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1271 microversion: 2.1 time: 0.232732 Jun 10 18:03:25.474258 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 968/1947] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:25 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1271 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:25.490064 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-823b382a-76ca-461e-9520-c85aaa79bd86 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:25.491114 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-823b382a-76ca-461e-9520-c85aaa79bd86 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:25.506692 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-823b382a-76ca-461e-9520-c85aaa79bd86 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:25.514795 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-823b382a-76ca-461e-9520-c85aaa79bd86 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:25.514795 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-823b382a-76ca-461e-9520-c85aaa79bd86 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:25.514795 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-823b382a-76ca-461e-9520-c85aaa79bd86 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:25.683410 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-823b382a-76ca-461e-9520-c85aaa79bd86 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lazy-loading 'services' on Instance uuid a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:03:25.713714 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-823b382a-76ca-461e-9520-c85aaa79bd86 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1935 microversion: 2.75 time: 0.236922 Jun 10 18:03:25.724834 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 969/1948] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:25 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1935 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:25.740456 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d0d7a36f-9062-4baf-9009-1ac6c82ee0bb tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:25.743803 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d0d7a36f-9062-4baf-9009-1ac6c82ee0bb tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:25.747994 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d0d7a36f-9062-4baf-9009-1ac6c82ee0bb tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:25.748597 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d0d7a36f-9062-4baf-9009-1ac6c82ee0bb tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:25.749403 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d0d7a36f-9062-4baf-9009-1ac6c82ee0bb tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:25.750342 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d0d7a36f-9062-4baf-9009-1ac6c82ee0bb tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:25.766815 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-d0d7a36f-9062-4baf-9009-1ac6c82ee0bb tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] HTTP exception thrown: Instance b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8 could not be found. Jun 10 18:03:25.768537 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d0d7a36f-9062-4baf-9009-1ac6c82ee0bb tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Request method failure captured: Jun 10 18:03:25.768537 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8 HTTP/1.1 Jun 10 18:03:25.768537 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:03:25.768537 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:03:25.768537 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:03:25.768537 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:03:25.768537 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:03:25.768537 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:03:25.768537 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:03:25.768537 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:03:25.768537 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4akFJ1K_Fjn2gorM0kDifiVojjdoDltFLGcKa1ZIe7ie7gX2zENY9JmTovcMyt_06HtczqNl8chkk2jdk9u_AJZFApVjpyp5QH41BdxtZ7AEVi9R-TaQzjOahN-cvOUvERl7q617owRLyS_NksL5Wq_4OpZn81AIDdUbPHfuTGl68I Jun 10 18:03:25.768537 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:03:25.768537 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:03:25.768537 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:03:25.768537 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:03:25.768537 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:03:25.768537 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:03:25.768537 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 188f32238c2c4e4f993cd11937715216 Jun 10 18:03:25.768537 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1358512160 Jun 10 18:03:25.768537 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:03:25.768537 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:03:25.769944 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/188f32238c2c4e4f993cd11937715216"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/188f32238c2c4e4f993cd11937715216"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/188f32238c2c4e4f993cd11937715216"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_188f32238c2c4e4f993cd11937715216", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:03:25.769944 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServerDiskConfigTestJSON-1358512160 Jun 10 18:03:25.769944 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 188f32238c2c4e4f993cd11937715216 Jun 10 18:03:25.769944 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1358512160 Jun 10 18:03:25.769944 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServerDiskConfigTestJSON-1358512160-project Jun 10 18:03:25.769944 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:03:25.769944 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:03:25.769944 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 6b1d1a0bd05d43368b969a9cc9435366 Jun 10 18:03:25.769944 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServerDiskConfigTestJSON-1358512160-project Jun 10 18:03:25.769944 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:03:25.769944 chdv-master-2 devstack@n-api.service[126594]: exception: Instance b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8 could not be found. Jun 10 18:03:25.769944 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8'} Jun 10 18:03:25.770746 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:03:25.770746 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:25.770746 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:03:25.770746 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:03:25.770746 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:03:25.770746 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:03:25.770746 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:03:25.770746 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:03:25.770746 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:03:25.770746 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:03:25.770746 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8 could not be found. Jun 10 18:03:25.770746 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:25.770746 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:03:25.770746 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:25.770746 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:25.770746 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:03:25.770746 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:03:25.770746 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:03:25.770746 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:03:25.770746 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:03:25.773360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:03:25.773360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:03:25.773360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:03:25.773360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:03:25.773360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:03:25.773360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:03:25.773360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:03:25.773360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8 could not be found. Jun 10 18:03:25.773360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:25.773360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:03:25.773360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:25.773360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:25.773360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:03:25.773360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:03:25.773360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:03:25.773360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:03:25.773360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8 could not be found. Jun 10 18:03:25.773360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:25.774671 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d0d7a36f-9062-4baf-9009-1ac6c82ee0bb tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Returning 404 to user: Instance b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:03:25.774671 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d0d7a36f-9062-4baf-9009-1ac6c82ee0bb tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8" status: 404 len: 111 microversion: 2.1 time: 0.041808 Jun 10 18:03:25.774671 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 970/1949] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:25 2022] GET /compute/v2.1/servers/b88ef0cc-e62d-4bac-bfe0-60d47b87f3d8 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:03:25.791491 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-133cc92d-008a-49db-9c22-1edc0eb8df74 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:25.793131 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-133cc92d-008a-49db-9c22-1edc0eb8df74 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:25.809504 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-133cc92d-008a-49db-9c22-1edc0eb8df74 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:25.817591 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-133cc92d-008a-49db-9c22-1edc0eb8df74 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:25.817591 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-133cc92d-008a-49db-9c22-1edc0eb8df74 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:25.817591 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-133cc92d-008a-49db-9c22-1edc0eb8df74 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:25.826988 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-133cc92d-008a-49db-9c22-1edc0eb8df74 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] HTTP exception thrown: Instance ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 could not be found. Jun 10 18:03:25.829136 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-133cc92d-008a-49db-9c22-1edc0eb8df74 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Request method failure captured: Jun 10 18:03:25.829136 chdv-master-2 devstack@n-api.service[126594]: request: DELETE /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 HTTP/1.1 Jun 10 18:03:25.829136 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:03:25.829136 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:03:25.829136 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:03:25.829136 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:03:25.829136 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:03:25.829136 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:03:25.829136 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:03:25.829136 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:03:25.829136 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4akFJ1K_Fjn2gorM0kDifiVojjdoDltFLGcKa1ZIe7ie7gX2zENY9JmTovcMyt_06HtczqNl8chkk2jdk9u_AJZFApVjpyp5QH41BdxtZ7AEVi9R-TaQzjOahN-cvOUvERl7q617owRLyS_NksL5Wq_4OpZn81AIDdUbPHfuTGl68I Jun 10 18:03:25.829136 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:03:25.829136 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:03:25.829136 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:03:25.829136 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:03:25.829136 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:03:25.829136 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:03:25.829136 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 188f32238c2c4e4f993cd11937715216 Jun 10 18:03:25.829136 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1358512160 Jun 10 18:03:25.829136 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:03:25.829136 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:03:25.830794 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/188f32238c2c4e4f993cd11937715216"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/188f32238c2c4e4f993cd11937715216"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/188f32238c2c4e4f993cd11937715216"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_188f32238c2c4e4f993cd11937715216", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:03:25.830794 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServerDiskConfigTestJSON-1358512160 Jun 10 18:03:25.830794 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 188f32238c2c4e4f993cd11937715216 Jun 10 18:03:25.830794 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1358512160 Jun 10 18:03:25.830794 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServerDiskConfigTestJSON-1358512160-project Jun 10 18:03:25.830794 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:03:25.830794 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:03:25.830794 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 6b1d1a0bd05d43368b969a9cc9435366 Jun 10 18:03:25.830794 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServerDiskConfigTestJSON-1358512160-project Jun 10 18:03:25.830794 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:03:25.830794 chdv-master-2 devstack@n-api.service[126594]: exception: Instance ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 could not be found. Jun 10 18:03:25.830794 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4'} Jun 10 18:03:25.831700 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:03:25.831700 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:25.831700 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:03:25.831700 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:03:25.831700 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:03:25.831700 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:03:25.831700 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:03:25.831700 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:03:25.831700 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:03:25.831700 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:03:25.831700 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 could not be found. Jun 10 18:03:25.831700 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:25.831700 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:03:25.831700 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:25.831700 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:25.831700 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:03:25.831700 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:03:25.831700 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:03:25.831700 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:03:25.831700 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:03:25.833298 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:03:25.833298 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:03:25.833298 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:03:25.833298 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:03:25.833298 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:03:25.833298 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:03:25.833298 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:03:25.833298 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:03:25.833298 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:03:25.833298 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 could not be found. Jun 10 18:03:25.833298 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:25.833298 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:03:25.833298 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:25.833298 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:25.833298 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:03:25.833298 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:03:25.833298 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:03:25.833298 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:03:25.833298 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 could not be found. Jun 10 18:03:25.833298 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:25.834828 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-133cc92d-008a-49db-9c22-1edc0eb8df74 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Returning 404 to user: Instance ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:03:25.834828 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-133cc92d-008a-49db-9c22-1edc0eb8df74 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "DELETE /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 404 len: 111 microversion: 2.1 time: 0.049713 Jun 10 18:03:25.835908 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 971/1950] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:03:25 2022] DELETE /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:03:25.841555 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c4d6944f-f29e-42dd-bbf8-e34895aff2bb tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:25.842172 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c4d6944f-f29e-42dd-bbf8-e34895aff2bb tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:25.848728 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c4d6944f-f29e-42dd-bbf8-e34895aff2bb tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:25.853216 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c4d6944f-f29e-42dd-bbf8-e34895aff2bb tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:25.853216 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c4d6944f-f29e-42dd-bbf8-e34895aff2bb tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:25.853216 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c4d6944f-f29e-42dd-bbf8-e34895aff2bb tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:25.867351 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-c4d6944f-f29e-42dd-bbf8-e34895aff2bb tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] HTTP exception thrown: Instance ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 could not be found. Jun 10 18:03:25.870621 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c4d6944f-f29e-42dd-bbf8-e34895aff2bb tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Request method failure captured: Jun 10 18:03:25.870621 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 HTTP/1.1 Jun 10 18:03:25.870621 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:03:25.870621 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:03:25.870621 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:03:25.870621 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:03:25.870621 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:03:25.870621 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:03:25.870621 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:03:25.870621 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:03:25.870621 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4akFJ1K_Fjn2gorM0kDifiVojjdoDltFLGcKa1ZIe7ie7gX2zENY9JmTovcMyt_06HtczqNl8chkk2jdk9u_AJZFApVjpyp5QH41BdxtZ7AEVi9R-TaQzjOahN-cvOUvERl7q617owRLyS_NksL5Wq_4OpZn81AIDdUbPHfuTGl68I Jun 10 18:03:25.870621 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:03:25.870621 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:03:25.870621 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:03:25.870621 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:03:25.870621 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:03:25.870621 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:03:25.870621 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 188f32238c2c4e4f993cd11937715216 Jun 10 18:03:25.870621 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1358512160 Jun 10 18:03:25.870621 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:03:25.870621 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:03:25.872488 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/188f32238c2c4e4f993cd11937715216"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/188f32238c2c4e4f993cd11937715216"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/188f32238c2c4e4f993cd11937715216"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_188f32238c2c4e4f993cd11937715216", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:03:25.872488 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServerDiskConfigTestJSON-1358512160 Jun 10 18:03:25.872488 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 188f32238c2c4e4f993cd11937715216 Jun 10 18:03:25.872488 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1358512160 Jun 10 18:03:25.872488 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServerDiskConfigTestJSON-1358512160-project Jun 10 18:03:25.872488 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:03:25.872488 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:03:25.872488 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 6b1d1a0bd05d43368b969a9cc9435366 Jun 10 18:03:25.872488 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServerDiskConfigTestJSON-1358512160-project Jun 10 18:03:25.872488 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:03:25.872488 chdv-master-2 devstack@n-api.service[126594]: exception: Instance ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 could not be found. Jun 10 18:03:25.872488 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4'} Jun 10 18:03:25.873399 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:03:25.873399 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:25.873399 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:03:25.873399 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:03:25.873399 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:03:25.873399 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:03:25.873399 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:03:25.873399 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:03:25.873399 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:03:25.873399 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:03:25.873399 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 could not be found. Jun 10 18:03:25.873399 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:25.873399 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:03:25.873399 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:25.873399 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:25.873399 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:03:25.873399 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:03:25.873399 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:03:25.873399 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:03:25.873399 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:03:25.874902 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:03:25.874902 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:03:25.874902 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:03:25.874902 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:03:25.874902 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:03:25.874902 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:03:25.874902 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:03:25.874902 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 could not be found. Jun 10 18:03:25.874902 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:25.874902 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:03:25.874902 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:25.874902 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:25.874902 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:03:25.874902 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:03:25.874902 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:03:25.874902 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:03:25.874902 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 could not be found. Jun 10 18:03:25.874902 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:25.877840 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c4d6944f-f29e-42dd-bbf8-e34895aff2bb tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Returning 404 to user: Instance ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:03:25.878948 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c4d6944f-f29e-42dd-bbf8-e34895aff2bb tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4" status: 404 len: 111 microversion: 2.1 time: 0.041997 Jun 10 18:03:25.884041 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 972/1951] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:25 2022] GET /compute/v2.1/servers/ea4f41ee-a313-4b5c-8f29-91dfa75ff9e4 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:03:25.891869 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7c3ced8c-b5f2-4f0d-9df3-9c9f0bacbe80 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:25.892786 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7c3ced8c-b5f2-4f0d-9df3-9c9f0bacbe80 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:25.900299 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7c3ced8c-b5f2-4f0d-9df3-9c9f0bacbe80 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:25.901078 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7c3ced8c-b5f2-4f0d-9df3-9c9f0bacbe80 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:25.903391 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7c3ced8c-b5f2-4f0d-9df3-9c9f0bacbe80 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:25.904047 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7c3ced8c-b5f2-4f0d-9df3-9c9f0bacbe80 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:25.925500 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-7c3ced8c-b5f2-4f0d-9df3-9c9f0bacbe80 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] HTTP exception thrown: Instance 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be could not be found. Jun 10 18:03:25.927129 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7c3ced8c-b5f2-4f0d-9df3-9c9f0bacbe80 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Request method failure captured: Jun 10 18:03:25.927129 chdv-master-2 devstack@n-api.service[126594]: request: DELETE /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be HTTP/1.1 Jun 10 18:03:25.927129 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:03:25.927129 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:03:25.927129 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:03:25.927129 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:03:25.927129 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:03:25.927129 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:03:25.927129 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:03:25.927129 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:03:25.927129 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4akFJ1K_Fjn2gorM0kDifiVojjdoDltFLGcKa1ZIe7ie7gX2zENY9JmTovcMyt_06HtczqNl8chkk2jdk9u_AJZFApVjpyp5QH41BdxtZ7AEVi9R-TaQzjOahN-cvOUvERl7q617owRLyS_NksL5Wq_4OpZn81AIDdUbPHfuTGl68I Jun 10 18:03:25.927129 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:03:25.927129 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:03:25.927129 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:03:25.927129 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:03:25.927129 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:03:25.927129 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:03:25.927129 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 188f32238c2c4e4f993cd11937715216 Jun 10 18:03:25.927129 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1358512160 Jun 10 18:03:25.927129 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:03:25.927129 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:03:25.928875 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/188f32238c2c4e4f993cd11937715216"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/188f32238c2c4e4f993cd11937715216"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/188f32238c2c4e4f993cd11937715216"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_188f32238c2c4e4f993cd11937715216", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:03:25.928875 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServerDiskConfigTestJSON-1358512160 Jun 10 18:03:25.928875 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 188f32238c2c4e4f993cd11937715216 Jun 10 18:03:25.928875 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1358512160 Jun 10 18:03:25.928875 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServerDiskConfigTestJSON-1358512160-project Jun 10 18:03:25.928875 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:03:25.928875 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:03:25.928875 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 6b1d1a0bd05d43368b969a9cc9435366 Jun 10 18:03:25.928875 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServerDiskConfigTestJSON-1358512160-project Jun 10 18:03:25.928875 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:03:25.928875 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be could not be found. Jun 10 18:03:25.928875 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '2e0a785e-3a8a-466c-bcd0-c21ecf5c30be'} Jun 10 18:03:25.929770 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:03:25.929770 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:25.929770 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:03:25.929770 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:03:25.929770 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:03:25.929770 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:03:25.929770 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:03:25.929770 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:03:25.929770 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:03:25.929770 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:03:25.929770 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be could not be found. Jun 10 18:03:25.929770 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:25.929770 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:03:25.929770 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:25.929770 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:25.929770 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:03:25.929770 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:03:25.929770 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:03:25.929770 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:03:25.929770 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:03:25.931023 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:03:25.931023 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:03:25.931023 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:03:25.931023 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:03:25.931023 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:03:25.931023 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:03:25.931023 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:03:25.931023 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:03:25.931023 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:03:25.931023 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be could not be found. Jun 10 18:03:25.931023 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:25.931023 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:03:25.931023 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:25.931023 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:25.931023 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:03:25.931023 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:03:25.931023 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:03:25.931023 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:03:25.931023 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be could not be found. Jun 10 18:03:25.931023 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:25.932218 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7c3ced8c-b5f2-4f0d-9df3-9c9f0bacbe80 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Returning 404 to user: Instance 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:03:25.932218 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7c3ced8c-b5f2-4f0d-9df3-9c9f0bacbe80 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "DELETE /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 404 len: 111 microversion: 2.1 time: 0.043274 Jun 10 18:03:25.932218 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 973/1952] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:03:25 2022] DELETE /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:03:25.937380 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5d0c6682-7566-41a6-a63a-36c94b1e6a34 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:25.938082 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5d0c6682-7566-41a6-a63a-36c94b1e6a34 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] [instance: 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:25.945256 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5d0c6682-7566-41a6-a63a-36c94b1e6a34 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:25.946012 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5d0c6682-7566-41a6-a63a-36c94b1e6a34 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:25.947019 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5d0c6682-7566-41a6-a63a-36c94b1e6a34 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:25.951361 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5d0c6682-7566-41a6-a63a-36c94b1e6a34 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:25.963032 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-5d0c6682-7566-41a6-a63a-36c94b1e6a34 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] HTTP exception thrown: Instance 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be could not be found. Jun 10 18:03:25.965984 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5d0c6682-7566-41a6-a63a-36c94b1e6a34 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Request method failure captured: Jun 10 18:03:25.965984 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be HTTP/1.1 Jun 10 18:03:25.965984 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:03:25.965984 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:03:25.965984 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:03:25.965984 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:03:25.965984 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:03:25.965984 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:03:25.965984 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:03:25.965984 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:03:25.965984 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4akFJ1K_Fjn2gorM0kDifiVojjdoDltFLGcKa1ZIe7ie7gX2zENY9JmTovcMyt_06HtczqNl8chkk2jdk9u_AJZFApVjpyp5QH41BdxtZ7AEVi9R-TaQzjOahN-cvOUvERl7q617owRLyS_NksL5Wq_4OpZn81AIDdUbPHfuTGl68I Jun 10 18:03:25.965984 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:03:25.965984 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:03:25.965984 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:03:25.965984 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:03:25.965984 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:03:25.965984 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:03:25.965984 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 188f32238c2c4e4f993cd11937715216 Jun 10 18:03:25.965984 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1358512160 Jun 10 18:03:25.965984 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:03:25.965984 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:03:25.967586 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/188f32238c2c4e4f993cd11937715216"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/188f32238c2c4e4f993cd11937715216"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/188f32238c2c4e4f993cd11937715216"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_188f32238c2c4e4f993cd11937715216", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:03:25.967586 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServerDiskConfigTestJSON-1358512160 Jun 10 18:03:25.967586 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 188f32238c2c4e4f993cd11937715216 Jun 10 18:03:25.967586 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1358512160 Jun 10 18:03:25.967586 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServerDiskConfigTestJSON-1358512160-project Jun 10 18:03:25.967586 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:03:25.967586 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:03:25.967586 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 6b1d1a0bd05d43368b969a9cc9435366 Jun 10 18:03:25.967586 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServerDiskConfigTestJSON-1358512160-project Jun 10 18:03:25.967586 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:03:25.967586 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be could not be found. Jun 10 18:03:25.967586 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '2e0a785e-3a8a-466c-bcd0-c21ecf5c30be'} Jun 10 18:03:25.968515 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:03:25.968515 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:25.968515 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:03:25.968515 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:03:25.968515 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:03:25.968515 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:03:25.968515 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:03:25.968515 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:03:25.968515 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:03:25.968515 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:03:25.968515 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be could not be found. Jun 10 18:03:25.968515 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:25.968515 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:03:25.968515 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:25.968515 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:25.968515 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:03:25.968515 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:03:25.968515 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:03:25.968515 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:03:25.968515 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:03:25.970174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:03:25.970174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:03:25.970174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:03:25.970174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:03:25.970174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:03:25.970174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:03:25.970174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:03:25.970174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be could not be found. Jun 10 18:03:25.970174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:25.970174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:03:25.970174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:25.970174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:25.970174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:03:25.970174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:03:25.970174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:03:25.970174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:03:25.970174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be could not be found. Jun 10 18:03:25.970174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:25.972137 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5d0c6682-7566-41a6-a63a-36c94b1e6a34 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] Returning 404 to user: Instance 2e0a785e-3a8a-466c-bcd0-c21ecf5c30be could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:03:25.973658 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5d0c6682-7566-41a6-a63a-36c94b1e6a34 tempest-ServerDiskConfigTestJSON-1358512160 tempest-ServerDiskConfigTestJSON-1358512160-project] 10.222.0.35 "GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be" status: 404 len: 111 microversion: 2.1 time: 0.039975 Jun 10 18:03:25.978407 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 974/1953] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:25 2022] GET /compute/v2.1/servers/2e0a785e-3a8a-466c-bcd0-c21ecf5c30be => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:03:26.015989 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d49cec0a-02f5-4210-9481-de2aa6038d92 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:26.016959 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d49cec0a-02f5-4210-9481-de2aa6038d92 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:26.029228 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d49cec0a-02f5-4210-9481-de2aa6038d92 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:26.035033 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d49cec0a-02f5-4210-9481-de2aa6038d92 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:26.035033 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d49cec0a-02f5-4210-9481-de2aa6038d92 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:26.035033 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d49cec0a-02f5-4210-9481-de2aa6038d92 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:26.384507 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d49cec0a-02f5-4210-9481-de2aa6038d92 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:26.395297 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d49cec0a-02f5-4210-9481-de2aa6038d92 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:26.397597 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d49cec0a-02f5-4210-9481-de2aa6038d92 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:26.399101 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d49cec0a-02f5-4210-9481-de2aa6038d92 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.387429 Jun 10 18:03:26.400479 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 975/1954] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:26 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:03:26.418143 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4f9d58ed-afcf-4130-b41e-a6ad06b50c52 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:26.422117 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4f9d58ed-afcf-4130-b41e-a6ad06b50c52 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 3a12492e-7860-4786-a695-48505e2c1840] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:26.432484 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4f9d58ed-afcf-4130-b41e-a6ad06b50c52 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:26.433601 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4f9d58ed-afcf-4130-b41e-a6ad06b50c52 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:26.434409 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4f9d58ed-afcf-4130-b41e-a6ad06b50c52 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:26.435127 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4f9d58ed-afcf-4130-b41e-a6ad06b50c52 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:26.508481 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4f9d58ed-afcf-4130-b41e-a6ad06b50c52 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:26.517521 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4f9d58ed-afcf-4130-b41e-a6ad06b50c52 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840" status: 200 len: 1267 microversion: 2.1 time: 0.114737 Jun 10 18:03:26.518181 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 976/1955] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:26 2022] GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840 => generated 1267 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:26.523495 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-896cec70-17a7-4b6c-86c8-1205598d3b14 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:26.524211 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-896cec70-17a7-4b6c-86c8-1205598d3b14 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:26.531505 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-896cec70-17a7-4b6c-86c8-1205598d3b14 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:26.531956 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-896cec70-17a7-4b6c-86c8-1205598d3b14 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:26.532804 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-896cec70-17a7-4b6c-86c8-1205598d3b14 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:26.533245 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-896cec70-17a7-4b6c-86c8-1205598d3b14 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:26.759464 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-896cec70-17a7-4b6c-86c8-1205598d3b14 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:26.771105 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-896cec70-17a7-4b6c-86c8-1205598d3b14 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1313 microversion: 2.1 time: 0.251170 Jun 10 18:03:26.772733 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 977/1956] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:26 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:26.784135 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cf854d35-c46b-43e5-b6d9-6d52b4ca4195 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:26.785394 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cf854d35-c46b-43e5-b6d9-6d52b4ca4195 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:26.796704 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf854d35-c46b-43e5-b6d9-6d52b4ca4195 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:26.798442 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf854d35-c46b-43e5-b6d9-6d52b4ca4195 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:26.800984 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf854d35-c46b-43e5-b6d9-6d52b4ca4195 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:26.802715 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf854d35-c46b-43e5-b6d9-6d52b4ca4195 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:26.954982 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-cf854d35-c46b-43e5-b6d9-6d52b4ca4195 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lazy-loading 'services' on Instance uuid a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:03:27.006954 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cf854d35-c46b-43e5-b6d9-6d52b4ca4195 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1935 microversion: 2.75 time: 0.232959 Jun 10 18:03:27.009569 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 978/1957] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:26 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1935 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:27.418228 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cd327694-c912-44a6-af99-2dfa6119fe73 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:27.418972 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cd327694-c912-44a6-af99-2dfa6119fe73 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:27.426038 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cd327694-c912-44a6-af99-2dfa6119fe73 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:27.426493 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cd327694-c912-44a6-af99-2dfa6119fe73 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:27.427267 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cd327694-c912-44a6-af99-2dfa6119fe73 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:27.427890 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cd327694-c912-44a6-af99-2dfa6119fe73 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:27.577638 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cd327694-c912-44a6-af99-2dfa6119fe73 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:27.586747 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cd327694-c912-44a6-af99-2dfa6119fe73 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:27.592781 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cd327694-c912-44a6-af99-2dfa6119fe73 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:27.595127 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cd327694-c912-44a6-af99-2dfa6119fe73 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.181010 Jun 10 18:03:27.596317 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 979/1958] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:27 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:27.601385 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bd01cfba-bde0-46c6-a5e4-9d5167f6fd42 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:27.602253 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bd01cfba-bde0-46c6-a5e4-9d5167f6fd42 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 3a12492e-7860-4786-a695-48505e2c1840] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:27.608942 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bd01cfba-bde0-46c6-a5e4-9d5167f6fd42 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:27.619529 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bd01cfba-bde0-46c6-a5e4-9d5167f6fd42 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:27.619529 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bd01cfba-bde0-46c6-a5e4-9d5167f6fd42 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:27.619529 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bd01cfba-bde0-46c6-a5e4-9d5167f6fd42 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:27.681063 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bd01cfba-bde0-46c6-a5e4-9d5167f6fd42 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:27.689580 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bd01cfba-bde0-46c6-a5e4-9d5167f6fd42 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840" status: 200 len: 1273 microversion: 2.1 time: 0.092012 Jun 10 18:03:27.690265 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 980/1959] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:27 2022] GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840 => generated 1273 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:27.788707 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6a3c0a49-ca1d-49e2-8018-a1652775bdeb tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:27.789341 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6a3c0a49-ca1d-49e2-8018-a1652775bdeb tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:27.796556 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6a3c0a49-ca1d-49e2-8018-a1652775bdeb tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:27.797110 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6a3c0a49-ca1d-49e2-8018-a1652775bdeb tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:27.797979 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6a3c0a49-ca1d-49e2-8018-a1652775bdeb tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:27.798496 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6a3c0a49-ca1d-49e2-8018-a1652775bdeb tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:27.978236 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-084a8e47-ea43-4808-a43c-d593584e34fe tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d] Building network info cache for instance {{(pid=126595) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} Jun 10 18:03:28.031048 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6a3c0a49-ca1d-49e2-8018-a1652775bdeb tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:28.041526 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6a3c0a49-ca1d-49e2-8018-a1652775bdeb tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1313 microversion: 2.1 time: 0.256922 Jun 10 18:03:28.043561 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 981/1960] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:27 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:28.060994 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-24fc4f79-b158-4f96-b0af-3a465f3f54a2 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:28.061919 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-24fc4f79-b158-4f96-b0af-3a465f3f54a2 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:28.069170 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-24fc4f79-b158-4f96-b0af-3a465f3f54a2 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:28.069634 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-24fc4f79-b158-4f96-b0af-3a465f3f54a2 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:28.070497 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-24fc4f79-b158-4f96-b0af-3a465f3f54a2 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:28.070862 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-24fc4f79-b158-4f96-b0af-3a465f3f54a2 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:28.168434 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-24fc4f79-b158-4f96-b0af-3a465f3f54a2 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] Lazy-loading 'services' on Instance uuid a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:03:28.188661 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-24fc4f79-b158-4f96-b0af-3a465f3f54a2 tempest-ServersAdmin275Test-1947172151 tempest-ServersAdmin275Test-1947172151-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1920 microversion: 2.75 time: 0.132816 Jun 10 18:03:28.189425 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 982/1961] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:28 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1920 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:28.195220 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-6e57f218-bd42-4c49-8133-e2a6509a2943 req-11888355-21f7-43bb-9bcc-f211a82bfabe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d", "tag": "f445eab9-755e-4cb4-8b43-362aa57d1ab2"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:28.203840 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:03:28.207918 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-6e57f218-bd42-4c49-8133-e2a6509a2943 req-11888355-21f7-43bb-9bcc-f211a82bfabe service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:28.207918 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-6e57f218-bd42-4c49-8133-e2a6509a2943 req-11888355-21f7-43bb-9bcc-f211a82bfabe service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:28.224425 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-6e57f218-bd42-4c49-8133-e2a6509a2943 req-11888355-21f7-43bb-9bcc-f211a82bfabe service nova] Creating event network-changed:f445eab9-755e-4cb4-8b43-362aa57d1ab2 for instance d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d on chh1-master-2 Jun 10 18:03:28.230017 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-6e57f218-bd42-4c49-8133-e2a6509a2943 req-11888355-21f7-43bb-9bcc-f211a82bfabe service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038657 Jun 10 18:03:28.230657 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 983/1962] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:03:28.238097 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3ac4b1bc-353a-429b-a830-9f54fd305578 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:28.238706 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3ac4b1bc-353a-429b-a830-9f54fd305578 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:28.245186 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3ac4b1bc-353a-429b-a830-9f54fd305578 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:28.247863 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3ac4b1bc-353a-429b-a830-9f54fd305578 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:28.247863 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3ac4b1bc-353a-429b-a830-9f54fd305578 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:28.247863 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3ac4b1bc-353a-429b-a830-9f54fd305578 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:28.277237 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3ac4b1bc-353a-429b-a830-9f54fd305578 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:03:28.436893 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:03:28.763079 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3ac4b1bc-353a-429b-a830-9f54fd305578 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "DELETE /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 204 len: 0 microversion: 2.75 time: 0.530939 Jun 10 18:03:28.766093 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 984/1963] 10.222.0.35 () {60 vars in 1279 bytes} [Fri Jun 10 18:03:28 2022] DELETE /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 0 bytes in 533 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 10 18:03:28.773183 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d3bccae3-f47b-462d-a5ed-122b52c4540e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:28.773907 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d3bccae3-f47b-462d-a5ed-122b52c4540e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:28.831559 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d3bccae3-f47b-462d-a5ed-122b52c4540e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:28.832029 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d3bccae3-f47b-462d-a5ed-122b52c4540e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:28.832872 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d3bccae3-f47b-462d-a5ed-122b52c4540e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:28.833376 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d3bccae3-f47b-462d-a5ed-122b52c4540e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:29.169634 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d3bccae3-f47b-462d-a5ed-122b52c4540e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:29.181361 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d3bccae3-f47b-462d-a5ed-122b52c4540e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:29.184013 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d3bccae3-f47b-462d-a5ed-122b52c4540e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:29.185654 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d3bccae3-f47b-462d-a5ed-122b52c4540e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 0.419328 Jun 10 18:03:29.198437 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 985/1964] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:28 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:29.203570 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a10967f7-c982-4037-96ef-ab100e984c55 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:29.204551 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a10967f7-c982-4037-96ef-ab100e984c55 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 3a12492e-7860-4786-a695-48505e2c1840] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:29.214998 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a10967f7-c982-4037-96ef-ab100e984c55 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:29.215862 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a10967f7-c982-4037-96ef-ab100e984c55 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:29.216945 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a10967f7-c982-4037-96ef-ab100e984c55 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:29.217741 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a10967f7-c982-4037-96ef-ab100e984c55 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:29.296245 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a10967f7-c982-4037-96ef-ab100e984c55 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:29.304235 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a10967f7-c982-4037-96ef-ab100e984c55 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840" status: 200 len: 1273 microversion: 2.1 time: 0.104333 Jun 10 18:03:29.305324 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 986/1965] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:29 2022] GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840 => generated 1273 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:29.310158 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1f624a7c-c3fe-4541-8e6f-7ea789dfe542 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:29.310836 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1f624a7c-c3fe-4541-8e6f-7ea789dfe542 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:29.317730 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1f624a7c-c3fe-4541-8e6f-7ea789dfe542 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:29.318184 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1f624a7c-c3fe-4541-8e6f-7ea789dfe542 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:29.318966 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1f624a7c-c3fe-4541-8e6f-7ea789dfe542 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:29.319402 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1f624a7c-c3fe-4541-8e6f-7ea789dfe542 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:29.411255 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1f624a7c-c3fe-4541-8e6f-7ea789dfe542 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:29.415887 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1f624a7c-c3fe-4541-8e6f-7ea789dfe542 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:29.419042 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1f624a7c-c3fe-4541-8e6f-7ea789dfe542 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:29.425423 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1f624a7c-c3fe-4541-8e6f-7ea789dfe542 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1444 microversion: 2.75 time: 0.118747 Jun 10 18:03:29.426017 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 987/1966] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:29 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1444 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:29.430812 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8327d6aa-1383-46c4-b3ec-48daf2e6d0db tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:29.431521 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8327d6aa-1383-46c4-b3ec-48daf2e6d0db tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:29.439217 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8327d6aa-1383-46c4-b3ec-48daf2e6d0db tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:29.439217 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8327d6aa-1383-46c4-b3ec-48daf2e6d0db tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:29.439217 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8327d6aa-1383-46c4-b3ec-48daf2e6d0db tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:29.439782 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8327d6aa-1383-46c4-b3ec-48daf2e6d0db tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:29.610448 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8327d6aa-1383-46c4-b3ec-48daf2e6d0db tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:29.636617 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8327d6aa-1383-46c4-b3ec-48daf2e6d0db tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1313 microversion: 2.1 time: 0.208392 Jun 10 18:03:29.637331 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 988/1967] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:29 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:30.139432 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-084a8e47-ea43-4808-a43c-d593584e34fe tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d] Updating instance_info_cache with network_info: [{"id": "f445eab9-755e-4cb4-8b43-362aa57d1ab2", "address": "fa:16:3e:0c:e4:cd", "network": {"id": "d960cccc-e559-4107-b985-68eb02da9e75", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-872231948-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.39.7.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b4a513641ffb46b091bb50e7b247e9a4", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf445eab9-75", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126595) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 10 18:03:30.149337 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-084a8e47-ea43-4808-a43c-d593584e34fe tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Releasing lock "refresh_cache-d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d" {{(pid=126595) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 10 18:03:30.150201 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-084a8e47-ea43-4808-a43c-d593584e34fe tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "POST /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d/action" status: 202 len: 0 microversion: 2.1 time: 6.246766 Jun 10 18:03:30.150846 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 980/1968] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:03:23 2022] POST /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d/action => generated 0 bytes in 6248 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Jun 10 18:03:30.160024 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ae1ee061-57f2-4951-a92a-64677c8f642a tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Action: 'action', calling method: .version_select at 0x7f77c3bc2ca0>, body: {"addFloatingIp": {"address": "172.39.7.66"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:30.161308 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ae1ee061-57f2-4951-a92a-64677c8f642a tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:30.169541 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ae1ee061-57f2-4951-a92a-64677c8f642a tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:30.170409 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ae1ee061-57f2-4951-a92a-64677c8f642a tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:30.171191 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ae1ee061-57f2-4951-a92a-64677c8f642a tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:30.172450 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ae1ee061-57f2-4951-a92a-64677c8f642a tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:30.205003 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-42392459-a929-48aa-9bd2-411af8be6862 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:30.205543 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-42392459-a929-48aa-9bd2-411af8be6862 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:30.214101 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42392459-a929-48aa-9bd2-411af8be6862 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:30.215090 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42392459-a929-48aa-9bd2-411af8be6862 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:30.216544 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42392459-a929-48aa-9bd2-411af8be6862 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:30.216984 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42392459-a929-48aa-9bd2-411af8be6862 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:30.250121 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ae1ee061-57f2-4951-a92a-64677c8f642a tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Acquired lock "refresh_cache-5a5ddc8b-3e7a-48f8-9f48-69b3b5027193" {{(pid=126594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 10 18:03:31.307986 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-42392459-a929-48aa-9bd2-411af8be6862 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:31.320447 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-42392459-a929-48aa-9bd2-411af8be6862 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:31.323412 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-42392459-a929-48aa-9bd2-411af8be6862 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:31.326102 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-42392459-a929-48aa-9bd2-411af8be6862 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1645 microversion: 2.25 time: 1.125232 Jun 10 18:03:31.340130 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 981/1969] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:30 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1645 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:31.347284 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-aa55bfe9-926a-4a6c-9971-1b4001a9035e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:31.350951 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-aa55bfe9-926a-4a6c-9971-1b4001a9035e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 3a12492e-7860-4786-a695-48505e2c1840] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:31.362494 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aa55bfe9-926a-4a6c-9971-1b4001a9035e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:31.363696 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aa55bfe9-926a-4a6c-9971-1b4001a9035e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:31.364786 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aa55bfe9-926a-4a6c-9971-1b4001a9035e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:31.365472 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aa55bfe9-926a-4a6c-9971-1b4001a9035e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:31.959228 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-aa55bfe9-926a-4a6c-9971-1b4001a9035e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:31.968227 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-aa55bfe9-926a-4a6c-9971-1b4001a9035e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840" status: 200 len: 1315 microversion: 2.1 time: 0.626582 Jun 10 18:03:31.982444 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 982/1970] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:31 2022] GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840 => generated 1315 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:31.993293 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d4dbaeb0-2507-4efa-9abc-905b08c67100 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:32.004828 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d4dbaeb0-2507-4efa-9abc-905b08c67100 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:32.033506 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d4dbaeb0-2507-4efa-9abc-905b08c67100 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:32.037589 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d4dbaeb0-2507-4efa-9abc-905b08c67100 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:32.041295 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d4dbaeb0-2507-4efa-9abc-905b08c67100 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:32.048372 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d4dbaeb0-2507-4efa-9abc-905b08c67100 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:32.118491 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d4dbaeb0-2507-4efa-9abc-905b08c67100 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:32.119246 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d4dbaeb0-2507-4efa-9abc-905b08c67100 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:32.120096 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-d4dbaeb0-2507-4efa-9abc-905b08c67100 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lazy-loading 'fault' on Instance uuid a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:03:32.287477 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d4dbaeb0-2507-4efa-9abc-905b08c67100 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:32.297703 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d4dbaeb0-2507-4efa-9abc-905b08c67100 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:32.302382 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d4dbaeb0-2507-4efa-9abc-905b08c67100 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13316e7c8ac44f3886393385da11c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5854e6d50bb1440f8a095906bf21dab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:32.311235 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d4dbaeb0-2507-4efa-9abc-905b08c67100 tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 200 len: 1449 microversion: 2.75 time: 0.326227 Jun 10 18:03:32.325951 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 983/1971] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:31 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 1449 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:32.332869 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-6018232f-8900-43e6-88da-57b45980d972 req-340b056d-5ea6-45a3-85dd-0574c1604e02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "586adfa4-7b3c-4399-86ab-d2982771af1d", "tag": "8aa0aa37-a6b7-49eb-8548-6164b5ff95d7"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:32.344760 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-6018232f-8900-43e6-88da-57b45980d972 req-340b056d-5ea6-45a3-85dd-0574c1604e02 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:32.346238 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-6018232f-8900-43e6-88da-57b45980d972 req-340b056d-5ea6-45a3-85dd-0574c1604e02 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:32.363494 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-6018232f-8900-43e6-88da-57b45980d972 req-340b056d-5ea6-45a3-85dd-0574c1604e02 service nova] Creating event network-changed:8aa0aa37-a6b7-49eb-8548-6164b5ff95d7 for instance 586adfa4-7b3c-4399-86ab-d2982771af1d on chh1-master-2 Jun 10 18:03:32.370422 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-6018232f-8900-43e6-88da-57b45980d972 req-340b056d-5ea6-45a3-85dd-0574c1604e02 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041317 Jun 10 18:03:32.371654 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 984/1972] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:03:32.380167 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9d2bd86c-e8b5-48d7-9fbb-c7fae0d73b64 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:32.381329 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9d2bd86c-e8b5-48d7-9fbb-c7fae0d73b64 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:32.390061 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9d2bd86c-e8b5-48d7-9fbb-c7fae0d73b64 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:32.394981 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9d2bd86c-e8b5-48d7-9fbb-c7fae0d73b64 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:32.394981 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9d2bd86c-e8b5-48d7-9fbb-c7fae0d73b64 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:32.394981 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9d2bd86c-e8b5-48d7-9fbb-c7fae0d73b64 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:33.020450 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9d2bd86c-e8b5-48d7-9fbb-c7fae0d73b64 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:33.036725 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9d2bd86c-e8b5-48d7-9fbb-c7fae0d73b64 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1313 microversion: 2.1 time: 0.656041 Jun 10 18:03:33.044748 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 985/1973] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:32 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1313 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:33.044748 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1146f714-f56c-4469-96ea-e60710b29882 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1031300150", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "c66faed9-4ff8-42df-b60d-8140becdafb7"}], "block_device_mapping_v2": [{"uuid": "16a4458f-23a8-4345-a9a4-222d9fa96dab", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:33.090926 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:03:33.101902 chdv-master-2 devstack@n-api.service[126594]: INFO nova.network.neutron [None req-ae1ee061-57f2-4951-a92a-64677c8f642a tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193] re-assign floating IP 172.39.7.66 from instance d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d Jun 10 18:03:33.135783 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=8 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:03:33.187857 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-1146f714-f56c-4469-96ea-e60710b29882 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] validate_networks() for [('c66faed9-4ff8-42df-b60d-8140becdafb7', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:03:33.197657 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-ae1ee061-57f2-4951-a92a-64677c8f642a tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d] Building network info cache for instance {{(pid=126594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} Jun 10 18:03:33.761935 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=8 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:03:33.990173 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-ae1ee061-57f2-4951-a92a-64677c8f642a tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d] Updating instance_info_cache with network_info: [{"id": "f445eab9-755e-4cb4-8b43-362aa57d1ab2", "address": "fa:16:3e:0c:e4:cd", "network": {"id": "d960cccc-e559-4107-b985-68eb02da9e75", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-872231948-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b4a513641ffb46b091bb50e7b247e9a4", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf445eab9-75", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 10 18:03:34.085963 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-ae1ee061-57f2-4951-a92a-64677c8f642a tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193] Building network info cache for instance {{(pid=126594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} Jun 10 18:03:34.929781 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-1146f714-f56c-4469-96ea-e60710b29882 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:03:34.936022 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-1146f714-f56c-4469-96ea-e60710b29882 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:03:34.936022 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-1146f714-f56c-4469-96ea-e60710b29882 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:03:34.936022 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-1146f714-f56c-4469-96ea-e60710b29882 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:03:34.936022 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-1146f714-f56c-4469-96ea-e60710b29882 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:03:34.952088 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1146f714-f56c-4469-96ea-e60710b29882 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:34.952764 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1146f714-f56c-4469-96ea-e60710b29882 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:34.965440 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1146f714-f56c-4469-96ea-e60710b29882 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:34.965440 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1146f714-f56c-4469-96ea-e60710b29882 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:34.965642 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-ae1ee061-57f2-4951-a92a-64677c8f642a tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193] Updating instance_info_cache with network_info: [{"id": "7477bf53-bd19-46b9-8356-316de6f77ec5", "address": "fa:16:3e:35:50:af", "network": {"id": "d960cccc-e559-4107-b985-68eb02da9e75", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-872231948-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.39.7.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b4a513641ffb46b091bb50e7b247e9a4", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7477bf53-bd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 10 18:03:34.978435 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-1146f714-f56c-4469-96ea-e60710b29882 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Getting quotas for project c96da7ef0cbc46b594ec327ddf875f7a. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:03:34.984658 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-1146f714-f56c-4469-96ea-e60710b29882 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Getting quotas for user d0f741e8506743a8b51251b3019b3ad5 and project c96da7ef0cbc46b594ec327ddf875f7a. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:03:35.034934 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ae1ee061-57f2-4951-a92a-64677c8f642a tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Releasing lock "refresh_cache-5a5ddc8b-3e7a-48f8-9f48-69b3b5027193" {{(pid=126594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 10 18:03:35.037646 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ae1ee061-57f2-4951-a92a-64677c8f642a tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "POST /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193/action" status: 202 len: 0 microversion: 2.1 time: 4.882491 Jun 10 18:03:35.042415 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 989/1974] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:03:30 2022] POST /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193/action => generated 0 bytes in 4885 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Jun 10 18:03:35.046685 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-22617074-9bbd-43fc-86c6-ce6d36467e86 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:35.047390 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-22617074-9bbd-43fc-86c6-ce6d36467e86 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:35.060928 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-22617074-9bbd-43fc-86c6-ce6d36467e86 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:35.063265 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-22617074-9bbd-43fc-86c6-ce6d36467e86 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:35.063265 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-22617074-9bbd-43fc-86c6-ce6d36467e86 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:35.063265 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-22617074-9bbd-43fc-86c6-ce6d36467e86 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:35.071749 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1146f714-f56c-4469-96ea-e60710b29882 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:03:35.075716 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1146f714-f56c-4469-96ea-e60710b29882 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='16a4458f-23a8-4345-a9a4-222d9fa96dab',volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:03:35.236634 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-22617074-9bbd-43fc-86c6-ce6d36467e86 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:35.261481 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-22617074-9bbd-43fc-86c6-ce6d36467e86 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:35.264930 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-22617074-9bbd-43fc-86c6-ce6d36467e86 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:35.266873 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-22617074-9bbd-43fc-86c6-ce6d36467e86 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1635 microversion: 2.25 time: 0.226273 Jun 10 18:03:35.268679 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 990/1975] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:35 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1635 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:35.281359 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-b7d7077a-4e45-4b1a-9b63-0e726058717a req-982c2126-a25c-4c43-ac65-db8fb6f57516 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d", "tag": "f445eab9-755e-4cb4-8b43-362aa57d1ab2"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:35.289633 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-b7d7077a-4e45-4b1a-9b63-0e726058717a req-982c2126-a25c-4c43-ac65-db8fb6f57516 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:35.290088 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-b7d7077a-4e45-4b1a-9b63-0e726058717a req-982c2126-a25c-4c43-ac65-db8fb6f57516 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:35.301494 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-b7d7077a-4e45-4b1a-9b63-0e726058717a req-982c2126-a25c-4c43-ac65-db8fb6f57516 service nova] Creating event network-changed:f445eab9-755e-4cb4-8b43-362aa57d1ab2 for instance d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d on chh1-master-2 Jun 10 18:03:35.306890 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-b7d7077a-4e45-4b1a-9b63-0e726058717a req-982c2126-a25c-4c43-ac65-db8fb6f57516 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036457 Jun 10 18:03:35.308211 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 991/1976] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:03:35.313943 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a266f9f6-e867-4bf0-9e4d-a6109524b243 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:35.314831 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a266f9f6-e867-4bf0-9e4d-a6109524b243 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 3a12492e-7860-4786-a695-48505e2c1840] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:35.321394 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a266f9f6-e867-4bf0-9e4d-a6109524b243 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:35.321937 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a266f9f6-e867-4bf0-9e4d-a6109524b243 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:35.322724 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a266f9f6-e867-4bf0-9e4d-a6109524b243 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:35.323893 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a266f9f6-e867-4bf0-9e4d-a6109524b243 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:35.578545 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a266f9f6-e867-4bf0-9e4d-a6109524b243 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:35.589344 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a266f9f6-e867-4bf0-9e4d-a6109524b243 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840" status: 200 len: 1315 microversion: 2.1 time: 0.279631 Jun 10 18:03:35.600394 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 992/1977] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:35 2022] GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840 => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:35.607347 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a3c17554-a150-4df4-9c90-c9b67db3e5ce tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:35.608286 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a3c17554-a150-4df4-9c90-c9b67db3e5ce tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] [instance: a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:35.623478 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3c17554-a150-4df4-9c90-c9b67db3e5ce tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:35.624413 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3c17554-a150-4df4-9c90-c9b67db3e5ce tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:35.625470 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3c17554-a150-4df4-9c90-c9b67db3e5ce tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:35.626158 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3c17554-a150-4df4-9c90-c9b67db3e5ce tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:35.645414 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-a3c17554-a150-4df4-9c90-c9b67db3e5ce tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] HTTP exception thrown: Instance a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe could not be found. Jun 10 18:03:35.652099 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a3c17554-a150-4df4-9c90-c9b67db3e5ce tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Request method failure captured: Jun 10 18:03:35.652099 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe HTTP/1.1 Jun 10 18:03:35.652099 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:03:35.652099 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:03:35.652099 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:03:35.652099 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:03:35.652099 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:03:35.652099 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:03:35.652099 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:03:35.652099 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:03:35.652099 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4cLWex_F-oTEwFTZcM9Hb9vK-lUAGIEIZpSOtI9CMCO8L08EGtTc8mwOnpDFu13DnxylWqR7lsT29zGVIGZTjh90O3Vp2Df6atzMRkkD3TK0sQ65rac_VaF7a6Lc4dd_kj42-r00RFtTB6kVSPYuSChPikqfxMpiIJlb2HAv0yVJyc Jun 10 18:03:35.652099 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:03:35.652099 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:03:35.652099 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:03:35.652099 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:03:35.652099 chdv-master-2 devstack@n-api.service[126594]: X-Openstack-Nova-Api-Version: 2.75 Jun 10 18:03:35.652099 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:03:35.652099 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:03:35.652099 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 5854e6d50bb1440f8a095906bf21dab8 Jun 10 18:03:35.652099 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersAdmin275Test-1366963520 Jun 10 18:03:35.652099 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:03:35.652099 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:03:35.654054 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/5854e6d50bb1440f8a095906bf21dab8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/5854e6d50bb1440f8a095906bf21dab8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/5854e6d50bb1440f8a095906bf21dab8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_5854e6d50bb1440f8a095906bf21dab8", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:03:35.654054 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersAdmin275Test-1366963520 Jun 10 18:03:35.654054 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 5854e6d50bb1440f8a095906bf21dab8 Jun 10 18:03:35.654054 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersAdmin275Test-1366963520 Jun 10 18:03:35.654054 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersAdmin275Test-1366963520-project Jun 10 18:03:35.654054 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:03:35.654054 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:03:35.654054 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 13316e7c8ac44f3886393385da11c9d6 Jun 10 18:03:35.654054 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersAdmin275Test-1366963520-project Jun 10 18:03:35.654054 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:03:35.654054 chdv-master-2 devstack@n-api.service[126594]: exception: Instance a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe could not be found. Jun 10 18:03:35.654054 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe'} Jun 10 18:03:35.655088 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:03:35.655088 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:35.655088 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:03:35.655088 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:03:35.655088 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:03:35.655088 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:03:35.655088 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:03:35.655088 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:03:35.655088 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:03:35.655088 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:03:35.655088 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe could not be found. Jun 10 18:03:35.655088 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:35.655088 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:03:35.655088 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:35.655088 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:35.655088 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:03:35.655088 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:03:35.655088 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:03:35.655088 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:03:35.655088 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:03:35.656750 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:03:35.656750 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:03:35.656750 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:03:35.656750 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:03:35.656750 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:03:35.656750 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:03:35.656750 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:03:35.656750 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe could not be found. Jun 10 18:03:35.656750 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:35.656750 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:03:35.656750 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:35.656750 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:35.656750 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:03:35.656750 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:03:35.656750 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:03:35.656750 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:03:35.656750 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe could not be found. Jun 10 18:03:35.656750 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:35.659725 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a3c17554-a150-4df4-9c90-c9b67db3e5ce tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] Returning 404 to user: Instance a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:03:35.659725 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a3c17554-a150-4df4-9c90-c9b67db3e5ce tempest-ServersAdmin275Test-1366963520 tempest-ServersAdmin275Test-1366963520-project] 10.222.0.35 "GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe" status: 404 len: 111 microversion: 2.75 time: 0.057556 Jun 10 18:03:35.661450 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 993/1978] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:35 2022] GET /compute/v2.1/servers/a6fa76e9-ea2c-4c68-bb63-5bbfb41a2cfe => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:03:35.671523 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a036a583-5da0-463f-a253-d270ddcca063 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:35.671523 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a036a583-5da0-463f-a253-d270ddcca063 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:35.675489 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a036a583-5da0-463f-a253-d270ddcca063 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:35.676061 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a036a583-5da0-463f-a253-d270ddcca063 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:35.677121 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a036a583-5da0-463f-a253-d270ddcca063 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:35.677803 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a036a583-5da0-463f-a253-d270ddcca063 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:35.694231 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1146f714-f56c-4469-96ea-e60710b29882 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.655439 Jun 10 18:03:35.702652 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 986/1979] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:03:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:03:35.719762 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-615ebe5a-71ff-4242-85ae-72b32af2e038 req-4a48bc02-ebe0-460e-bac1-359d3e60c670 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a12492e-7860-4786-a695-48505e2c1840", "tag": "9a0263c8-f83a-411c-b1f7-64fc2cf760df"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:35.734084 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-615ebe5a-71ff-4242-85ae-72b32af2e038 req-4a48bc02-ebe0-460e-bac1-359d3e60c670 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:35.734482 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-615ebe5a-71ff-4242-85ae-72b32af2e038 req-4a48bc02-ebe0-460e-bac1-359d3e60c670 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:35.785752 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-615ebe5a-71ff-4242-85ae-72b32af2e038 req-4a48bc02-ebe0-460e-bac1-359d3e60c670 service nova] Creating event network-changed:9a0263c8-f83a-411c-b1f7-64fc2cf760df for instance 3a12492e-7860-4786-a695-48505e2c1840 on chh1-master-2 Jun 10 18:03:35.806574 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-615ebe5a-71ff-4242-85ae-72b32af2e038 req-4a48bc02-ebe0-460e-bac1-359d3e60c670 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102551 Jun 10 18:03:35.816162 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 987/1980] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:03:35.986256 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a036a583-5da0-463f-a253-d270ddcca063 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:35.996395 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-41bbfd3d-26e8-4f03-ba67-69facef112be tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1011142396", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "dff01cee-e2a1-4d80-8e20-a719fcccd07c"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:35.997549 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a036a583-5da0-463f-a253-d270ddcca063 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1313 microversion: 2.1 time: 0.334672 Jun 10 18:03:36.007891 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 994/1981] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:35 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1313 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:36.009277 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3772d98c-721a-4f64-a9e3-440389c7f640 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Action: 'action', calling method: .version_select at 0x7f77c3bc2a60>, body: {"removeFloatingIp": {"address": "172.39.7.66"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:36.063845 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-41bbfd3d-26e8-4f03-ba67-69facef112be tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] validate_networks() for [('dff01cee-e2a1-4d80-8e20-a719fcccd07c', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:03:36.238376 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3772d98c-721a-4f64-a9e3-440389c7f640 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:36.246050 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3772d98c-721a-4f64-a9e3-440389c7f640 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:36.246779 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3772d98c-721a-4f64-a9e3-440389c7f640 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:36.247760 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3772d98c-721a-4f64-a9e3-440389c7f640 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:36.248244 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3772d98c-721a-4f64-a9e3-440389c7f640 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:36.490360 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-3772d98c-721a-4f64-a9e3-440389c7f640 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] HTTP exception thrown: Floating IP 172.39.7.66 is not associated with instance d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d. Jun 10 18:03:36.493011 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3772d98c-721a-4f64-a9e3-440389c7f640 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Request method failure captured: Jun 10 18:03:36.493011 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d/action HTTP/1.1 Jun 10 18:03:36.493011 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:03:36.493011 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:03:36.493011 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:03:36.493011 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 48 Jun 10 18:03:36.493011 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:03:36.493011 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:03:36.493011 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:03:36.493011 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:03:36.493011 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4c6bKMPdoW6JM5vPU7sJZ9EKw5p_e5Nn3TIwZ8taSXQ0t9p_7pNjb_r4YMAZes9OZCJmuEzQc2x42I-9bQXq5Xrgtdtt86trEaDPwcjLqJL5CIujPL4LPvif1K6JTifq-zjls-ga-WpuFiPpsn6IHLrl-UWVmD-CrCEEjjieM48Bpk Jun 10 18:03:36.493011 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:03:36.493011 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:03:36.493011 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:03:36.493011 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:03:36.493011 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:03:36.493011 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:03:36.493011 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: b4a513641ffb46b091bb50e7b247e9a4 Jun 10 18:03:36.493011 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-230132700 Jun 10 18:03:36.493011 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:03:36.493011 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:03:36.494473 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/b4a513641ffb46b091bb50e7b247e9a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/b4a513641ffb46b091bb50e7b247e9a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/b4a513641ffb46b091bb50e7b247e9a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_b4a513641ffb46b091bb50e7b247e9a4", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:03:36.494473 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-230132700 Jun 10 18:03:36.494473 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: b4a513641ffb46b091bb50e7b247e9a4 Jun 10 18:03:36.494473 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-230132700 Jun 10 18:03:36.494473 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-FloatingIPsAssociationTestJSON-230132700-project Jun 10 18:03:36.494473 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:03:36.494473 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:03:36.494473 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 5b8eb46cd9bd428b9f144077f3d7ed9f Jun 10 18:03:36.494473 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-230132700-project Jun 10 18:03:36.494473 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:03:36.494473 chdv-master-2 devstack@n-api.service[126594]: {"removeFloatingIp": {"address": "172.39.7.66"}} Jun 10 18:03:36.494473 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 18:03:36.494473 chdv-master-2 devstack@n-api.service[126594]: exception: Floating IP 172.39.7.66 is not associated with instance d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d. Jun 10 18:03:36.495501 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'd7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d', 'body': {'removeFloatingIp': {'address': '172.39.7.66'}}} Jun 10 18:03:36.495501 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:03:36.495501 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:36.495501 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:03:36.495501 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:03:36.495501 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:03:36.495501 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:03:36.495501 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:03:36.495501 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:03:36.495501 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:03:36.495501 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:03:36.495501 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:03:36.495501 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:03:36.495501 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Jun 10 18:03:36.495501 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 10 18:03:36.495501 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.39.7.66 is not associated with instance d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d. Jun 10 18:03:36.495501 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:36.495501 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:03:36.495501 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:36.495501 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:36.498926 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:03:36.498926 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:03:36.498926 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:03:36.498926 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:03:36.498926 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.39.7.66 is not associated with instance d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d. Jun 10 18:03:36.498926 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:36.499843 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3772d98c-721a-4f64-a9e3-440389c7f640 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Returning 409 to user: Floating IP 172.39.7.66 is not associated with instance d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:03:36.501408 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3772d98c-721a-4f64-a9e3-440389c7f640 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "POST /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d/action" status: 409 len: 145 microversion: 2.1 time: 0.498560 Jun 10 18:03:36.506962 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 995/1982] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:03:36 2022] POST /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d/action => generated 145 bytes in 505 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:03:36.514367 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bacfde19-7aab-483c-95a8-6ded7ecc045c tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Calling method '.version_select at 0x7f77c622e790>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:36.517848 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bacfde19-7aab-483c-95a8-6ded7ecc045c tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:36.518701 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bacfde19-7aab-483c-95a8-6ded7ecc045c tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:36.537559 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bacfde19-7aab-483c-95a8-6ded7ecc045c tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] 10.222.0.35 "GET /compute/v2.1/os-migrations" status: 200 len: 3801 microversion: 2.25 time: 0.028703 Jun 10 18:03:36.540696 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 996/1983] 10.222.0.35 () {60 vars in 1183 bytes} [Fri Jun 10 18:03:36 2022] GET /compute/v2.1/os-migrations => generated 3801 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:36.553899 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4c197430-75b1-4bc4-a380-359320ce333b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:36.555841 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4c197430-75b1-4bc4-a380-359320ce333b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:36.613746 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4c197430-75b1-4bc4-a380-359320ce333b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:36.621265 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4c197430-75b1-4bc4-a380-359320ce333b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1053 microversion: 2.1 time: 0.079149 Jun 10 18:03:36.628321 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 997/1984] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:36 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1053 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:36.634818 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-88d9b322-066a-4123-962a-afdc85810a9b tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.39.7.66"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:36.896219 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-88d9b322-066a-4123-962a-afdc85810a9b tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:36.912900 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-88d9b322-066a-4123-962a-afdc85810a9b tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:36.913845 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-88d9b322-066a-4123-962a-afdc85810a9b tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:36.915335 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-88d9b322-066a-4123-962a-afdc85810a9b tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:36.916278 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-88d9b322-066a-4123-962a-afdc85810a9b tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:36.951257 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-41bbfd3d-26e8-4f03-ba67-69facef112be tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:03:36.951887 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-41bbfd3d-26e8-4f03-ba67-69facef112be tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:03:36.952435 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-41bbfd3d-26e8-4f03-ba67-69facef112be tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:03:36.952868 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-41bbfd3d-26e8-4f03-ba67-69facef112be tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:03:36.953268 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-41bbfd3d-26e8-4f03-ba67-69facef112be tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:03:36.964116 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41bbfd3d-26e8-4f03-ba67-69facef112be tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:36.964948 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41bbfd3d-26e8-4f03-ba67-69facef112be tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:36.965975 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41bbfd3d-26e8-4f03-ba67-69facef112be tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:36.966493 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41bbfd3d-26e8-4f03-ba67-69facef112be tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:36.989635 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-41bbfd3d-26e8-4f03-ba67-69facef112be tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Getting quotas for project 8f24d6db014a4fecb9533fa4cf1be8c7. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:03:36.995857 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-41bbfd3d-26e8-4f03-ba67-69facef112be tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Getting quotas for user be318f01fac5459cb4d0f55cf374824f and project 8f24d6db014a4fecb9533fa4cf1be8c7. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:03:37.021346 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-41bbfd3d-26e8-4f03-ba67-69facef112be tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Going to run 3 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:03:37.021346 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-41bbfd3d-26e8-4f03-ba67-69facef112be tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] [instance: aba801d8-0f5d-49d2-9d2a-be6a81cee5e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:03:37.208610 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-41bbfd3d-26e8-4f03-ba67-69facef112be tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] [instance: 07e79e24-76e1-476b-b064-a6729174e2ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=aba801d8-0f5d-49d2-9d2a-be6a81cee5e7,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:03:37.352526 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-88d9b322-066a-4123-962a-afdc85810a9b tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Acquired lock "refresh_cache-5a5ddc8b-3e7a-48f8-9f48-69b3b5027193" {{(pid=126594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 10 18:03:37.360727 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-41bbfd3d-26e8-4f03-ba67-69facef112be tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] [instance: ca923f2e-f40e-4c7c-bede-58ab9cda2763] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=07e79e24-76e1-476b-b064-a6729174e2ff,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:03:37.621302 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-41bbfd3d-26e8-4f03-ba67-69facef112be tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.800811 Jun 10 18:03:37.623986 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 988/1985] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:03:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:03:37.634133 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-93532463-dc03-49c0-a805-3b41bcc203cd tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:37.637297 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-93532463-dc03-49c0-a805-3b41bcc203cd tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:37.679721 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93532463-dc03-49c0-a805-3b41bcc203cd tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:37.684381 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93532463-dc03-49c0-a805-3b41bcc203cd tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:37.685414 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93532463-dc03-49c0-a805-3b41bcc203cd tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:37.686576 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93532463-dc03-49c0-a805-3b41bcc203cd tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:38.001873 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-93532463-dc03-49c0-a805-3b41bcc203cd tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lazy-loading 'services' on Instance uuid a0864d26-b605-4a49-b099-8144ecfde9bc {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:03:38.023195 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-93532463-dc03-49c0-a805-3b41bcc203cd tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 2127 microversion: 2.25 time: 0.397585 Jun 10 18:03:38.024139 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 989/1986] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:37 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 2127 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:38.030298 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-42e58afc-7658-4bf7-a8c3-dda12452cc71 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:38.031250 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-42e58afc-7658-4bf7-a8c3-dda12452cc71 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 3a12492e-7860-4786-a695-48505e2c1840] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:38.045234 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42e58afc-7658-4bf7-a8c3-dda12452cc71 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:38.049562 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42e58afc-7658-4bf7-a8c3-dda12452cc71 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:38.049562 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42e58afc-7658-4bf7-a8c3-dda12452cc71 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:38.049562 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42e58afc-7658-4bf7-a8c3-dda12452cc71 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:38.303035 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-42e58afc-7658-4bf7-a8c3-dda12452cc71 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:38.311975 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-42e58afc-7658-4bf7-a8c3-dda12452cc71 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840" status: 200 len: 1315 microversion: 2.1 time: 0.286481 Jun 10 18:03:38.323620 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 990/1987] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:38 2022] GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840 => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:38.329397 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a09b2cd7-b386-43f2-be2d-f80cb8729d03 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:38.330383 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a09b2cd7-b386-43f2-be2d-f80cb8729d03 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:38.338551 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a09b2cd7-b386-43f2-be2d-f80cb8729d03 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:38.339188 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a09b2cd7-b386-43f2-be2d-f80cb8729d03 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:38.340234 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a09b2cd7-b386-43f2-be2d-f80cb8729d03 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:38.340981 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a09b2cd7-b386-43f2-be2d-f80cb8729d03 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:38.567929 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a09b2cd7-b386-43f2-be2d-f80cb8729d03 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:38.578489 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a09b2cd7-b386-43f2-be2d-f80cb8729d03 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1313 microversion: 2.1 time: 0.252954 Jun 10 18:03:38.580139 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 991/1988] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:38 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:38.585687 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-d85bf75f-f0c9-4f74-bcf6-4817f58ee9b5 req-daa2562a-b1bc-4fa7-9a4f-113d2602e3a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a5ddc8b-3e7a-48f8-9f48-69b3b5027193", "tag": "7477bf53-bd19-46b9-8356-316de6f77ec5"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:38.607370 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-d85bf75f-f0c9-4f74-bcf6-4817f58ee9b5 req-daa2562a-b1bc-4fa7-9a4f-113d2602e3a3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:38.609939 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-d85bf75f-f0c9-4f74-bcf6-4817f58ee9b5 req-daa2562a-b1bc-4fa7-9a4f-113d2602e3a3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:38.622730 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-d85bf75f-f0c9-4f74-bcf6-4817f58ee9b5 req-daa2562a-b1bc-4fa7-9a4f-113d2602e3a3 service nova] Creating event network-changed:7477bf53-bd19-46b9-8356-316de6f77ec5 for instance 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193 on chh1-master-2 Jun 10 18:03:38.628420 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-d85bf75f-f0c9-4f74-bcf6-4817f58ee9b5 req-daa2562a-b1bc-4fa7-9a4f-113d2602e3a3 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046973 Jun 10 18:03:38.629385 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 992/1989] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:03:38.635092 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-99109a41-8b11-4c37-8bb6-938ff100142b req-de13d439-4717-4aca-9227-cbb99414cdad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586adfa4-7b3c-4399-86ab-d2982771af1d", "name": "network-vif-plugged", "status": "completed", "tag": "8aa0aa37-a6b7-49eb-8548-6164b5ff95d7"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:38.643731 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-99109a41-8b11-4c37-8bb6-938ff100142b req-de13d439-4717-4aca-9227-cbb99414cdad service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:38.644432 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-99109a41-8b11-4c37-8bb6-938ff100142b req-de13d439-4717-4aca-9227-cbb99414cdad service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:38.657931 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-99109a41-8b11-4c37-8bb6-938ff100142b req-de13d439-4717-4aca-9227-cbb99414cdad service nova] Creating event network-vif-plugged:8aa0aa37-a6b7-49eb-8548-6164b5ff95d7 for instance 586adfa4-7b3c-4399-86ab-d2982771af1d on chh1-master-2 Jun 10 18:03:38.663395 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-99109a41-8b11-4c37-8bb6-938ff100142b req-de13d439-4717-4aca-9227-cbb99414cdad service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032308 Jun 10 18:03:38.671180 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 993/1990] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:03:38.671180 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f927abf8-c2b3-4cbe-b54f-c1a34f949f1c tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:38.674097 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f927abf8-c2b3-4cbe-b54f-c1a34f949f1c tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'be318f01fac5459cb4d0f55cf374824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:38.674681 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f927abf8-c2b3-4cbe-b54f-c1a34f949f1c tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Searching by: {'deleted': False, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7'} {{(pid=126595) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 18:03:38.702869 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f927abf8-c2b3-4cbe-b54f-c1a34f949f1c tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:38.703244 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f927abf8-c2b3-4cbe-b54f-c1a34f949f1c tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:38.704072 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f927abf8-c2b3-4cbe-b54f-c1a34f949f1c tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:38.704622 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f927abf8-c2b3-4cbe-b54f-c1a34f949f1c tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:38.727316 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f927abf8-c2b3-4cbe-b54f-c1a34f949f1c tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.061632 Jun 10 18:03:38.727905 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 994/1991] 10.222.0.35 () {58 vars in 1124 bytes} [Fri Jun 10 18:03:38 2022] GET /compute/v2.1/servers => generated 1018 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:38.743007 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e175771e-8890-47c6-bcab-4e621f39fd42 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:38.755501 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e175771e-8890-47c6-bcab-4e621f39fd42 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:38.769421 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e175771e-8890-47c6-bcab-4e621f39fd42 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:38.771300 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e175771e-8890-47c6-bcab-4e621f39fd42 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:38.772413 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e175771e-8890-47c6-bcab-4e621f39fd42 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:38.773108 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e175771e-8890-47c6-bcab-4e621f39fd42 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:38.900017 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e175771e-8890-47c6-bcab-4e621f39fd42 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:38.918877 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e175771e-8890-47c6-bcab-4e621f39fd42 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1159 microversion: 2.1 time: 0.173154 Jun 10 18:03:38.918877 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 995/1992] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:38 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1159 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:38.927972 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a3d76973-3e1a-48f5-a1c1-0305f7e8722d tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:38.928946 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a3d76973-3e1a-48f5-a1c1-0305f7e8722d tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:38.938346 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a3d76973-3e1a-48f5-a1c1-0305f7e8722d tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:38.939052 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a3d76973-3e1a-48f5-a1c1-0305f7e8722d tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:38.940018 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a3d76973-3e1a-48f5-a1c1-0305f7e8722d tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:38.940659 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a3d76973-3e1a-48f5-a1c1-0305f7e8722d tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:39.231700 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-a3d76973-3e1a-48f5-a1c1-0305f7e8722d tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lazy-loading 'services' on Instance uuid a0864d26-b605-4a49-b099-8144ecfde9bc {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:03:39.250393 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a3d76973-3e1a-48f5-a1c1-0305f7e8722d tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 2127 microversion: 2.25 time: 0.327890 Jun 10 18:03:39.259487 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 996/1993] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:03:38 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 2127 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:39.267054 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-02f69659-fe17-4e80-99ab-f13e2d30af50 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:39.269908 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-02f69659-fe17-4e80-99ab-f13e2d30af50 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] [instance: ca923f2e-f40e-4c7c-bede-58ab9cda2763] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:39.406080 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-88d9b322-066a-4123-962a-afdc85810a9b tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193] Building network info cache for instance {{(pid=126594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} Jun 10 18:03:39.558134 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-02f69659-fe17-4e80-99ab-f13e2d30af50 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be318f01fac5459cb4d0f55cf374824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:39.565924 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-02f69659-fe17-4e80-99ab-f13e2d30af50 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "GET /compute/v2.1/servers/ca923f2e-f40e-4c7c-bede-58ab9cda2763" status: 200 len: 1223 microversion: 2.1 time: 0.305118 Jun 10 18:03:39.574489 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 997/1994] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:39 2022] GET /compute/v2.1/servers/ca923f2e-f40e-4c7c-bede-58ab9cda2763 => generated 1223 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:39.592166 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cfde7ef9-e201-4f23-ad65-54d428243af3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:39.599331 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cfde7ef9-e201-4f23-ad65-54d428243af3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 3a12492e-7860-4786-a695-48505e2c1840] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:39.623152 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cfde7ef9-e201-4f23-ad65-54d428243af3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:39.632074 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cfde7ef9-e201-4f23-ad65-54d428243af3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:39.636331 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cfde7ef9-e201-4f23-ad65-54d428243af3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:39.636925 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cfde7ef9-e201-4f23-ad65-54d428243af3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:40.095314 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cfde7ef9-e201-4f23-ad65-54d428243af3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:40.113020 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cfde7ef9-e201-4f23-ad65-54d428243af3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840" status: 200 len: 1315 microversion: 2.1 time: 0.538688 Jun 10 18:03:40.114350 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 998/1995] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:39 2022] GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840 => generated 1315 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:40.119354 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a304111b-5800-48fd-a989-7bf7278bdcb8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:40.122491 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a304111b-5800-48fd-a989-7bf7278bdcb8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:40.138254 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a304111b-5800-48fd-a989-7bf7278bdcb8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:40.138723 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a304111b-5800-48fd-a989-7bf7278bdcb8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:40.139524 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a304111b-5800-48fd-a989-7bf7278bdcb8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:40.142730 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a304111b-5800-48fd-a989-7bf7278bdcb8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:40.379947 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-a304111b-5800-48fd-a989-7bf7278bdcb8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lazy-loading 'services' on Instance uuid a0864d26-b605-4a49-b099-8144ecfde9bc {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:03:40.465379 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:03:40.575851 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-88d9b322-066a-4123-962a-afdc85810a9b tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193] Updating instance_info_cache with network_info: [{"id": "7477bf53-bd19-46b9-8356-316de6f77ec5", "address": "fa:16:3e:35:50:af", "network": {"id": "d960cccc-e559-4107-b985-68eb02da9e75", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-872231948-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b4a513641ffb46b091bb50e7b247e9a4", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7477bf53-bd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 10 18:03:40.646809 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-88d9b322-066a-4123-962a-afdc85810a9b tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Releasing lock "refresh_cache-5a5ddc8b-3e7a-48f8-9f48-69b3b5027193" {{(pid=126594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 10 18:03:40.648247 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-88d9b322-066a-4123-962a-afdc85810a9b tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "POST /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193/action" status: 202 len: 0 microversion: 2.1 time: 4.018513 Jun 10 18:03:40.652733 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 998/1996] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:03:36 2022] POST /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193/action => generated 0 bytes in 4022 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 10 18:03:40.658897 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8d2b050f-f54b-4f3b-844f-b93223b5f783 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:40.660224 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8d2b050f-f54b-4f3b-844f-b93223b5f783 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:40.671513 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8d2b050f-f54b-4f3b-844f-b93223b5f783 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:40.680519 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8d2b050f-f54b-4f3b-844f-b93223b5f783 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:40.680519 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8d2b050f-f54b-4f3b-844f-b93223b5f783 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:40.680519 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8d2b050f-f54b-4f3b-844f-b93223b5f783 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:40.817562 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a304111b-5800-48fd-a989-7bf7278bdcb8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "DELETE /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc/os-volume_attachments/416221aa-2986-462a-b30c-e5d67dfe2433" status: 202 len: 0 microversion: 2.25 time: 0.701726 Jun 10 18:03:40.845865 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 999/1997] 10.222.0.35 () {60 vars in 1456 bytes} [Fri Jun 10 18:03:40 2022] DELETE /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc/os-volume_attachments/416221aa-2986-462a-b30c-e5d67dfe2433 => generated 0 bytes in 731 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:03:40.869974 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d9e412a9-b1fc-4d0e-a491-a50d18c440b7 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:40.875574 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d9e412a9-b1fc-4d0e-a491-a50d18c440b7 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:40.890840 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d9e412a9-b1fc-4d0e-a491-a50d18c440b7 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:40.891423 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d9e412a9-b1fc-4d0e-a491-a50d18c440b7 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:40.892287 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d9e412a9-b1fc-4d0e-a491-a50d18c440b7 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:40.892979 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d9e412a9-b1fc-4d0e-a491-a50d18c440b7 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:40.953231 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8d2b050f-f54b-4f3b-844f-b93223b5f783 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:40.962108 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8d2b050f-f54b-4f3b-844f-b93223b5f783 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1313 microversion: 2.1 time: 0.308552 Jun 10 18:03:40.966280 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 999/1998] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:40 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1313 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:40.977169 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2b2ca4f7-72e7-49f2-aac1-14747107c856 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:40.977805 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2b2ca4f7-72e7-49f2-aac1-14747107c856 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] [instance: ca923f2e-f40e-4c7c-bede-58ab9cda2763] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:40.984178 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2b2ca4f7-72e7-49f2-aac1-14747107c856 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:40.984690 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2b2ca4f7-72e7-49f2-aac1-14747107c856 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:40.985598 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2b2ca4f7-72e7-49f2-aac1-14747107c856 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:40.986058 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2b2ca4f7-72e7-49f2-aac1-14747107c856 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:41.037905 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d9e412a9-b1fc-4d0e-a491-a50d18c440b7 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:41.050646 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d9e412a9-b1fc-4d0e-a491-a50d18c440b7 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1169 microversion: 2.1 time: 0.199605 Jun 10 18:03:41.052405 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1000/1999] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:40 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1169 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:41.064456 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4a99fabb-bfcd-400a-95cd-a91dc45e6ffe tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:41.068089 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4a99fabb-bfcd-400a-95cd-a91dc45e6ffe tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:41.081241 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a99fabb-bfcd-400a-95cd-a91dc45e6ffe tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:41.082496 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a99fabb-bfcd-400a-95cd-a91dc45e6ffe tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:41.089512 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a99fabb-bfcd-400a-95cd-a91dc45e6ffe tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:41.090124 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a99fabb-bfcd-400a-95cd-a91dc45e6ffe tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:41.105771 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2b2ca4f7-72e7-49f2-aac1-14747107c856 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be318f01fac5459cb4d0f55cf374824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:41.115194 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2b2ca4f7-72e7-49f2-aac1-14747107c856 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "GET /compute/v2.1/servers/ca923f2e-f40e-4c7c-bede-58ab9cda2763" status: 200 len: 1227 microversion: 2.1 time: 0.147757 Jun 10 18:03:41.116052 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1000/2000] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:40 2022] GET /compute/v2.1/servers/ca923f2e-f40e-4c7c-bede-58ab9cda2763 => generated 1227 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:41.144178 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4a99fabb-bfcd-400a-95cd-a91dc45e6ffe tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:03:41.147086 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-0bae7b7a-f43e-4796-bfb0-f0c79f92a88b req-8813bd27-9129-4e20-b078-b34fe0444572 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a5ddc8b-3e7a-48f8-9f48-69b3b5027193", "tag": "7477bf53-bd19-46b9-8356-316de6f77ec5"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:41.156370 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-0bae7b7a-f43e-4796-bfb0-f0c79f92a88b req-8813bd27-9129-4e20-b078-b34fe0444572 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:41.157077 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-0bae7b7a-f43e-4796-bfb0-f0c79f92a88b req-8813bd27-9129-4e20-b078-b34fe0444572 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:41.180392 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-0bae7b7a-f43e-4796-bfb0-f0c79f92a88b req-8813bd27-9129-4e20-b078-b34fe0444572 service nova] Creating event network-changed:7477bf53-bd19-46b9-8356-316de6f77ec5 for instance 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193 on chh1-master-2 Jun 10 18:03:41.197759 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-0bae7b7a-f43e-4796-bfb0-f0c79f92a88b req-8813bd27-9129-4e20-b078-b34fe0444572 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079754 Jun 10 18:03:41.202239 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1001/2001] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:03:41.213512 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a7ad1b54-5ffe-4c21-a45f-7e964c09032f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:41.215386 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a7ad1b54-5ffe-4c21-a45f-7e964c09032f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:41.224497 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a7ad1b54-5ffe-4c21-a45f-7e964c09032f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:41.225361 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a7ad1b54-5ffe-4c21-a45f-7e964c09032f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:41.226366 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a7ad1b54-5ffe-4c21-a45f-7e964c09032f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:41.227276 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a7ad1b54-5ffe-4c21-a45f-7e964c09032f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:41.255007 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=3,nova_cell1:RELEASE=3 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:03:41.269169 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a7ad1b54-5ffe-4c21-a45f-7e964c09032f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.065375 Jun 10 18:03:41.270247 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1002/2002] 10.222.0.35 () {60 vars in 1342 bytes} [Fri Jun 10 18:03:41 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:03:41.280778 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-27f37545-8619-4e57-96f0-80ffc344b07f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:41.280778 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-27f37545-8619-4e57-96f0-80ffc344b07f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 3a12492e-7860-4786-a695-48505e2c1840] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:41.293323 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27f37545-8619-4e57-96f0-80ffc344b07f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:41.293790 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27f37545-8619-4e57-96f0-80ffc344b07f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:41.294591 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27f37545-8619-4e57-96f0-80ffc344b07f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:41.295038 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27f37545-8619-4e57-96f0-80ffc344b07f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:41.613750 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4a99fabb-bfcd-400a-95cd-a91dc45e6ffe tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "DELETE /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193" status: 204 len: 0 microversion: 2.1 time: 0.558210 Jun 10 18:03:41.629490 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1001/2003] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:03:41 2022] DELETE /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:03:41.635957 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dc4dd76c-b4cf-446b-849c-b3bb50ded5f7 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.39.7.66"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:41.640128 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dc4dd76c-b4cf-446b-849c-b3bb50ded5f7 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:41.647362 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-27f37545-8619-4e57-96f0-80ffc344b07f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:41.660151 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-27f37545-8619-4e57-96f0-80ffc344b07f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840" status: 200 len: 1315 microversion: 2.1 time: 0.388657 Jun 10 18:03:41.667275 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1003/2004] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:41 2022] GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840 => generated 1315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:41.671408 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc4dd76c-b4cf-446b-849c-b3bb50ded5f7 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:41.671879 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc4dd76c-b4cf-446b-849c-b3bb50ded5f7 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:41.673101 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc4dd76c-b4cf-446b-849c-b3bb50ded5f7 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:41.673749 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc4dd76c-b4cf-446b-849c-b3bb50ded5f7 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:41.706735 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc4dd76c-b4cf-446b-849c-b3bb50ded5f7 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Acquired lock "refresh_cache-d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d" {{(pid=126595) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 10 18:03:41.982594 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-11a7614c-57ef-4d0b-bef3-396a6e8fd7c3 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:41.983127 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-11a7614c-57ef-4d0b-bef3-396a6e8fd7c3 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:41.992871 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-11a7614c-57ef-4d0b-bef3-396a6e8fd7c3 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:41.993334 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-11a7614c-57ef-4d0b-bef3-396a6e8fd7c3 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:41.994124 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-11a7614c-57ef-4d0b-bef3-396a6e8fd7c3 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:41.994594 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-11a7614c-57ef-4d0b-bef3-396a6e8fd7c3 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:42.252500 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-11a7614c-57ef-4d0b-bef3-396a6e8fd7c3 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:42.262398 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-11a7614c-57ef-4d0b-bef3-396a6e8fd7c3 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1462 microversion: 2.1 time: 0.284652 Jun 10 18:03:42.263590 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1004/2005] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:41 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1462 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:42.269098 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9bb20e84-de0e-477a-8f0a-46f411fb143a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:42.270001 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9bb20e84-de0e-477a-8f0a-46f411fb143a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:42.289089 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9bb20e84-de0e-477a-8f0a-46f411fb143a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:42.289554 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9bb20e84-de0e-477a-8f0a-46f411fb143a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:42.290364 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9bb20e84-de0e-477a-8f0a-46f411fb143a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:42.290816 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9bb20e84-de0e-477a-8f0a-46f411fb143a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:42.704656 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9bb20e84-de0e-477a-8f0a-46f411fb143a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:42.712554 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9bb20e84-de0e-477a-8f0a-46f411fb143a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1211 microversion: 2.1 time: 0.447309 Jun 10 18:03:42.724730 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1005/2006] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:42 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1211 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:42.738083 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9e7d30f6-080d-49c2-916f-81d510ef6224 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:42.739645 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9e7d30f6-080d-49c2-916f-81d510ef6224 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] [instance: ca923f2e-f40e-4c7c-bede-58ab9cda2763] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:42.756764 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9e7d30f6-080d-49c2-916f-81d510ef6224 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:42.757231 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9e7d30f6-080d-49c2-916f-81d510ef6224 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:42.758070 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9e7d30f6-080d-49c2-916f-81d510ef6224 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:42.758508 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9e7d30f6-080d-49c2-916f-81d510ef6224 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:42.886366 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9e7d30f6-080d-49c2-916f-81d510ef6224 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be318f01fac5459cb4d0f55cf374824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:42.897266 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9e7d30f6-080d-49c2-916f-81d510ef6224 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "GET /compute/v2.1/servers/ca923f2e-f40e-4c7c-bede-58ab9cda2763" status: 200 len: 1275 microversion: 2.1 time: 0.168919 Jun 10 18:03:42.898709 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1006/2007] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:42 2022] GET /compute/v2.1/servers/ca923f2e-f40e-4c7c-bede-58ab9cda2763 => generated 1275 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:42.910449 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-98415ba9-d2ed-4a22-8899-167e671a24fa req-56ae699b-f79b-45e4-9bc5-a2bf4d55c46b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a12492e-7860-4786-a695-48505e2c1840", "name": "network-vif-plugged", "status": "completed", "tag": "9a0263c8-f83a-411c-b1f7-64fc2cf760df"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:42.930990 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-98415ba9-d2ed-4a22-8899-167e671a24fa req-56ae699b-f79b-45e4-9bc5-a2bf4d55c46b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:42.932701 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-98415ba9-d2ed-4a22-8899-167e671a24fa req-56ae699b-f79b-45e4-9bc5-a2bf4d55c46b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:42.956798 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-98415ba9-d2ed-4a22-8899-167e671a24fa req-56ae699b-f79b-45e4-9bc5-a2bf4d55c46b service nova] Creating event network-vif-plugged:9a0263c8-f83a-411c-b1f7-64fc2cf760df for instance 3a12492e-7860-4786-a695-48505e2c1840 on chh1-master-2 Jun 10 18:03:42.971656 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-98415ba9-d2ed-4a22-8899-167e671a24fa req-56ae699b-f79b-45e4-9bc5-a2bf4d55c46b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070660 Jun 10 18:03:42.972849 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1007/2008] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:03:42.986382 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8648db24-17fc-43eb-8152-41054b504882 tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:42.987237 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8648db24-17fc-43eb-8152-41054b504882 tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:43.000359 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8648db24-17fc-43eb-8152-41054b504882 tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:43.000827 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8648db24-17fc-43eb-8152-41054b504882 tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:43.001630 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8648db24-17fc-43eb-8152-41054b504882 tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:43.002077 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8648db24-17fc-43eb-8152-41054b504882 tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:43.528221 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8648db24-17fc-43eb-8152-41054b504882 tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1613 microversion: 2.1 time: 0.547218 Jun 10 18:03:43.530874 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1008/2009] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:42 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1613 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:43.557929 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ca3c2d93-290c-4660-9b2e-4db5a6deab61 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:43.560803 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ca3c2d93-290c-4660-9b2e-4db5a6deab61 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:43.587021 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ca3c2d93-290c-4660-9b2e-4db5a6deab61 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:43.588903 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ca3c2d93-290c-4660-9b2e-4db5a6deab61 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:43.590146 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ca3c2d93-290c-4660-9b2e-4db5a6deab61 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:43.599073 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ca3c2d93-290c-4660-9b2e-4db5a6deab61 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:43.697794 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ca3c2d93-290c-4660-9b2e-4db5a6deab61 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.161516 Jun 10 18:03:43.699033 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1009/2010] 10.222.0.35 () {60 vars in 1342 bytes} [Fri Jun 10 18:03:43 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:03:43.704155 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b1cb4bca-fd44-4683-b31f-4161191f350e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:43.705025 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b1cb4bca-fd44-4683-b31f-4161191f350e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 3a12492e-7860-4786-a695-48505e2c1840] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:43.712434 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b1cb4bca-fd44-4683-b31f-4161191f350e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:43.713096 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b1cb4bca-fd44-4683-b31f-4161191f350e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:43.714910 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b1cb4bca-fd44-4683-b31f-4161191f350e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:43.715526 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b1cb4bca-fd44-4683-b31f-4161191f350e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:44.230112 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b1cb4bca-fd44-4683-b31f-4161191f350e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:44.249622 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b1cb4bca-fd44-4683-b31f-4161191f350e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840" status: 200 len: 1315 microversion: 2.1 time: 0.538772 Jun 10 18:03:44.249622 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1010/2011] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:43 2022] GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840 => generated 1315 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:44.607735 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ee0d8ccd-3e14-4d10-8cd0-8797b835f85c tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Action: 'update', calling method: .version_select at 0x7f77c612fee0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:44.609595 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:03:44.609595 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 18:03:44.616278 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ee0d8ccd-3e14-4d10-8cd0-8797b835f85c tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:44.616803 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ee0d8ccd-3e14-4d10-8cd0-8797b835f85c tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:44.641098 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ee0d8ccd-3e14-4d10-8cd0-8797b835f85c tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:44.643803 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ee0d8ccd-3e14-4d10-8cd0-8797b835f85c tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:44.683628 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-ee0d8ccd-3e14-4d10-8cd0-8797b835f85c tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] HTTP exception thrown: Service b7643ca7-c70d-4477-995f-ff814d2eac44 could not be found. Jun 10 18:03:44.690725 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ee0d8ccd-3e14-4d10-8cd0-8797b835f85c tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Request method failure captured: Jun 10 18:03:44.690725 chdv-master-2 devstack@n-api.service[126594]: request: PUT /compute/v2.1/os-services/b7643ca7-c70d-4477-995f-ff814d2eac44 HTTP/1.1 Jun 10 18:03:44.690725 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:03:44.690725 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:03:44.690725 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:03:44.690725 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 56 Jun 10 18:03:44.690725 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:03:44.690725 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:03:44.690725 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:03:44.690725 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:03:44.690725 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4d-0VbIlQGYE32_Espbx-aD1FtLwGsCoj9Gpc_4jTmFiNRRhvKtngdA0Jt312owyt2ugziU4XqYX_xXymdbatCCGdLrbBXU7eIf5BKAvyCIYXC2VsRFiEEfsIbw9AjATW6oXwUSQfv58SToNVJIxDRaFgdxV443eDJa6ggM0xUFwI0 Jun 10 18:03:44.690725 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:03:44.690725 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:03:44.690725 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:03:44.690725 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:03:44.690725 chdv-master-2 devstack@n-api.service[126594]: X-Openstack-Nova-Api-Version: 2.53 Jun 10 18:03:44.690725 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:03:44.690725 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:03:44.690725 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 642619d2191747589f8c22a2eac723df Jun 10 18:03:44.690725 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1709745804 Jun 10 18:03:44.690725 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member,admin Jun 10 18:03:44.690725 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member,admin Jun 10 18:03:44.692481 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/642619d2191747589f8c22a2eac723df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/642619d2191747589f8c22a2eac723df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/642619d2191747589f8c22a2eac723df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_642619d2191747589f8c22a2eac723df", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:03:44.692481 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1709745804 Jun 10 18:03:44.692481 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 642619d2191747589f8c22a2eac723df Jun 10 18:03:44.692481 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1709745804 Jun 10 18:03:44.692481 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin Jun 10 18:03:44.692481 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:03:44.692481 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:03:44.692481 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 619f4180ef394bf0b3ff72095f5551c8 Jun 10 18:03:44.692481 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin Jun 10 18:03:44.692481 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:03:44.692481 chdv-master-2 devstack@n-api.service[126594]: {"status": "disabled", "disabled_reason": "maintenance"} Jun 10 18:03:44.692481 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 18:03:44.692481 chdv-master-2 devstack@n-api.service[126594]: exception: Service b7643ca7-c70d-4477-995f-ff814d2eac44 could not be found. Jun 10 18:03:44.693448 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'b7643ca7-c70d-4477-995f-ff814d2eac44', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Jun 10 18:03:44.693448 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:03:44.693448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:44.693448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jun 10 18:03:44.693448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jun 10 18:03:44.693448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jun 10 18:03:44.693448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jun 10 18:03:44.693448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jun 10 18:03:44.693448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:44.693448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:03:44.693448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:44.693448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:44.693448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jun 10 18:03:44.693448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jun 10 18:03:44.693448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jun 10 18:03:44.693448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jun 10 18:03:44.693448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service b7643ca7-c70d-4477-995f-ff814d2eac44 could not be found. Jun 10 18:03:44.693448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:44.693448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:03:44.693448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:44.693448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:44.694938 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:03:44.694938 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:03:44.694938 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:03:44.694938 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:03:44.694938 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:03:44.694938 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:03:44.694938 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:03:44.694938 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:03:44.694938 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:03:44.694938 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:03:44.694938 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jun 10 18:03:44.694938 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:03:44.694938 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service b7643ca7-c70d-4477-995f-ff814d2eac44 could not be found. Jun 10 18:03:44.694938 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:44.694938 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:03:44.694938 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:44.694938 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:44.694938 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:03:44.694938 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:03:44.694938 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:03:44.698982 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:03:44.698982 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service b7643ca7-c70d-4477-995f-ff814d2eac44 could not be found. Jun 10 18:03:44.698982 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:44.702970 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ee0d8ccd-3e14-4d10-8cd0-8797b835f85c tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Returning 404 to user: Service b7643ca7-c70d-4477-995f-ff814d2eac44 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:03:44.704494 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ee0d8ccd-3e14-4d10-8cd0-8797b835f85c tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] 10.222.0.35 "PUT /compute/v2.1/os-services/b7643ca7-c70d-4477-995f-ff814d2eac44" status: 404 len: 110 microversion: 2.53 time: 0.461422 Jun 10 18:03:44.711191 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1011/2012] 10.222.0.35 () {62 vars in 1308 bytes} [Fri Jun 10 18:03:44 2022] PUT /compute/v2.1/os-services/b7643ca7-c70d-4477-995f-ff814d2eac44 => generated 110 bytes in 468 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:03:44.720081 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ce73d304-a699-45b5-817a-0ac9228beda0 tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:44.720716 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ce73d304-a699-45b5-817a-0ac9228beda0 tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:44.735751 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ce73d304-a699-45b5-817a-0ac9228beda0 tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:44.736230 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ce73d304-a699-45b5-817a-0ac9228beda0 tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:44.737065 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ce73d304-a699-45b5-817a-0ac9228beda0 tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:44.737517 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ce73d304-a699-45b5-817a-0ac9228beda0 tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:44.795851 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ce73d304-a699-45b5-817a-0ac9228beda0 tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'c994b8591be74d3f8553e412dbd226d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4a0e2335244c26adcc4cdfd10705d6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:44.796802 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ce73d304-a699-45b5-817a-0ac9228beda0 tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] flavor_id is None. Assuming migration. {{(pid=126594) resize /opt/stack/nova/nova/compute/api.py:4142}} Jun 10 18:03:44.797450 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ce73d304-a699-45b5-817a-0ac9228beda0 tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=126594) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 10 18:03:45.284684 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ce73d304-a699-45b5-817a-0ac9228beda0 tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] 10.222.0.35 "POST /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d/action" status: 202 len: 0 microversion: 2.1 time: 0.572444 Jun 10 18:03:45.290848 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1012/2013] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:03:44 2022] POST /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d/action => generated 0 bytes in 580 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:03:45.296804 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7041e1c9-e79e-4532-bc48-7278d2bfc4a8 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:45.297759 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7041e1c9-e79e-4532-bc48-7278d2bfc4a8 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:45.305256 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7041e1c9-e79e-4532-bc48-7278d2bfc4a8 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:45.306013 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7041e1c9-e79e-4532-bc48-7278d2bfc4a8 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:45.307794 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7041e1c9-e79e-4532-bc48-7278d2bfc4a8 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:45.308542 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7041e1c9-e79e-4532-bc48-7278d2bfc4a8 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:45.381275 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-dc4dd76c-b4cf-446b-849c-b3bb50ded5f7 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d] Building network info cache for instance {{(pid=126595) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} Jun 10 18:03:45.516548 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7041e1c9-e79e-4532-bc48-7278d2bfc4a8 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:45.529658 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7041e1c9-e79e-4532-bc48-7278d2bfc4a8 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1211 microversion: 2.1 time: 0.236592 Jun 10 18:03:45.539913 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1013/2014] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:45 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1211 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:45.545609 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-338eca8a-583a-43da-892e-f18d9e1b7370 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:45.546419 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-338eca8a-583a-43da-892e-f18d9e1b7370 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] [instance: ca923f2e-f40e-4c7c-bede-58ab9cda2763] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:45.556145 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-338eca8a-583a-43da-892e-f18d9e1b7370 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:45.560025 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-338eca8a-583a-43da-892e-f18d9e1b7370 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:45.560025 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-338eca8a-583a-43da-892e-f18d9e1b7370 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:45.560025 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-338eca8a-583a-43da-892e-f18d9e1b7370 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:45.636242 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-338eca8a-583a-43da-892e-f18d9e1b7370 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be318f01fac5459cb4d0f55cf374824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:45.648243 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-338eca8a-583a-43da-892e-f18d9e1b7370 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "GET /compute/v2.1/servers/ca923f2e-f40e-4c7c-bede-58ab9cda2763" status: 200 len: 1281 microversion: 2.1 time: 0.106899 Jun 10 18:03:45.651624 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1014/2015] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:45 2022] GET /compute/v2.1/servers/ca923f2e-f40e-4c7c-bede-58ab9cda2763 => generated 1281 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:45.657998 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bfe4183f-4190-40ea-a9f5-97196e43fe64 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:45.658981 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bfe4183f-4190-40ea-a9f5-97196e43fe64 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:45.672947 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bfe4183f-4190-40ea-a9f5-97196e43fe64 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:45.673407 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bfe4183f-4190-40ea-a9f5-97196e43fe64 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:45.674626 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bfe4183f-4190-40ea-a9f5-97196e43fe64 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:45.674626 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bfe4183f-4190-40ea-a9f5-97196e43fe64 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:45.718170 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bfe4183f-4190-40ea-a9f5-97196e43fe64 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.065032 Jun 10 18:03:45.719893 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1015/2016] 10.222.0.35 () {60 vars in 1342 bytes} [Fri Jun 10 18:03:45 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:03:45.727415 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-dcde19a3-183f-4d06-a26c-317f18987ab2 tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Action: 'update', calling method: .version_select at 0x7f77c61b31f0>, body: {"status": "disabled"} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:45.729150 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:03:45.729150 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 18:03:45.730802 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dcde19a3-183f-4d06-a26c-317f18987ab2 tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:45.732258 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dcde19a3-183f-4d06-a26c-317f18987ab2 tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:45.739389 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dcde19a3-183f-4d06-a26c-317f18987ab2 tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:45.740185 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dcde19a3-183f-4d06-a26c-317f18987ab2 tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:45.747748 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-dcde19a3-183f-4d06-a26c-317f18987ab2 tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] HTTP exception thrown: Service b7643ca7-c70d-4477-995f-ff814d2eac44 could not be found. Jun 10 18:03:45.749849 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-dcde19a3-183f-4d06-a26c-317f18987ab2 tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Request method failure captured: Jun 10 18:03:45.749849 chdv-master-2 devstack@n-api.service[126594]: request: PUT /compute/v2.1/os-services/b7643ca7-c70d-4477-995f-ff814d2eac44 HTTP/1.1 Jun 10 18:03:45.749849 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:03:45.749849 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:03:45.749849 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:03:45.749849 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 22 Jun 10 18:03:45.749849 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:03:45.749849 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:03:45.749849 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:03:45.749849 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:03:45.749849 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4d-0VbIlQGYE32_Espbx-aD1FtLwGsCoj9Gpc_4jTmFiNRRhvKtngdA0Jt312owyt2ugziU4XqYX_xXymdbatCCGdLrbBXU7eIf5BKAvyCIYXC2VsRFiEEfsIbw9AjATW6oXwUSQfv58SToNVJIxDRaFgdxV443eDJa6ggM0xUFwI0 Jun 10 18:03:45.749849 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:03:45.749849 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:03:45.749849 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:03:45.749849 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:03:45.749849 chdv-master-2 devstack@n-api.service[126594]: X-Openstack-Nova-Api-Version: 2.53 Jun 10 18:03:45.749849 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:03:45.749849 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:03:45.749849 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 642619d2191747589f8c22a2eac723df Jun 10 18:03:45.749849 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1709745804 Jun 10 18:03:45.749849 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member,admin Jun 10 18:03:45.749849 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member,admin Jun 10 18:03:45.755457 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/642619d2191747589f8c22a2eac723df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/642619d2191747589f8c22a2eac723df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/642619d2191747589f8c22a2eac723df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_642619d2191747589f8c22a2eac723df", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:03:45.755457 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1709745804 Jun 10 18:03:45.755457 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 642619d2191747589f8c22a2eac723df Jun 10 18:03:45.755457 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1709745804 Jun 10 18:03:45.755457 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin Jun 10 18:03:45.755457 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:03:45.755457 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:03:45.755457 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 619f4180ef394bf0b3ff72095f5551c8 Jun 10 18:03:45.755457 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin Jun 10 18:03:45.755457 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:03:45.755457 chdv-master-2 devstack@n-api.service[126594]: {"status": "disabled"} Jun 10 18:03:45.755457 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 18:03:45.755457 chdv-master-2 devstack@n-api.service[126594]: exception: Service b7643ca7-c70d-4477-995f-ff814d2eac44 could not be found. Jun 10 18:03:45.755457 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'b7643ca7-c70d-4477-995f-ff814d2eac44', 'body': {'status': 'disabled'}} Jun 10 18:03:45.756359 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:03:45.756359 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:45.756359 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jun 10 18:03:45.756359 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jun 10 18:03:45.756359 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jun 10 18:03:45.756359 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jun 10 18:03:45.756359 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jun 10 18:03:45.756359 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:45.756359 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:03:45.756359 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:45.756359 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:45.756359 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jun 10 18:03:45.756359 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jun 10 18:03:45.756359 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jun 10 18:03:45.756359 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jun 10 18:03:45.756359 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service b7643ca7-c70d-4477-995f-ff814d2eac44 could not be found. Jun 10 18:03:45.756359 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:45.756359 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:03:45.756359 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:45.756359 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:45.756359 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:03:45.757723 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:03:45.757723 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:03:45.757723 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:03:45.757723 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:03:45.757723 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:03:45.757723 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:03:45.757723 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:03:45.757723 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:03:45.757723 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:03:45.757723 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jun 10 18:03:45.757723 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:03:45.757723 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service b7643ca7-c70d-4477-995f-ff814d2eac44 could not be found. Jun 10 18:03:45.757723 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:45.757723 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:03:45.757723 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:45.757723 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:45.757723 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:03:45.757723 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:03:45.757723 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:03:45.757723 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:03:45.761765 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service b7643ca7-c70d-4477-995f-ff814d2eac44 could not be found. Jun 10 18:03:45.761765 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:45.761765 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-dcde19a3-183f-4d06-a26c-317f18987ab2 tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Returning 404 to user: Service b7643ca7-c70d-4477-995f-ff814d2eac44 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:03:45.761765 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-dcde19a3-183f-4d06-a26c-317f18987ab2 tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] 10.222.0.35 "PUT /compute/v2.1/os-services/b7643ca7-c70d-4477-995f-ff814d2eac44" status: 404 len: 110 microversion: 2.53 time: 0.030426 Jun 10 18:03:45.761765 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1016/2017] 10.222.0.35 () {62 vars in 1308 bytes} [Fri Jun 10 18:03:45 2022] PUT /compute/v2.1/os-services/b7643ca7-c70d-4477-995f-ff814d2eac44 => generated 110 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:03:45.761765 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-6794d31d-899d-4721-988f-6a596f33bebb req-1eddabcb-aad9-46fb-9cb5-3669d3c9543d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a5ddc8b-3e7a-48f8-9f48-69b3b5027193", "name": "network-vif-deleted", "tag": "7477bf53-bd19-46b9-8356-316de6f77ec5"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:45.769949 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-6794d31d-899d-4721-988f-6a596f33bebb req-1eddabcb-aad9-46fb-9cb5-3669d3c9543d service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:45.770535 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-6794d31d-899d-4721-988f-6a596f33bebb req-1eddabcb-aad9-46fb-9cb5-3669d3c9543d service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:45.784086 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-6794d31d-899d-4721-988f-6a596f33bebb req-1eddabcb-aad9-46fb-9cb5-3669d3c9543d service nova] Creating event network-vif-deleted:7477bf53-bd19-46b9-8356-316de6f77ec5 for instance 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193 on chh1-master-2 Jun 10 18:03:45.801110 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-6794d31d-899d-4721-988f-6a596f33bebb req-1eddabcb-aad9-46fb-9cb5-3669d3c9543d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037412 Jun 10 18:03:45.804516 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1017/2018] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:03:45.816345 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-aee7ec0c-7ed7-41f6-b8f4-5b24c9a72182 req-432d87d7-8eab-4aba-beb3-644216957ea8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e24cb05a-9ceb-4570-9773-b04297cbf4bb", "tag": "f0d78f74-c94f-47fc-b5f6-fca21d020e90"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:45.828792 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-aee7ec0c-7ed7-41f6-b8f4-5b24c9a72182 req-432d87d7-8eab-4aba-beb3-644216957ea8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:45.832232 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-aee7ec0c-7ed7-41f6-b8f4-5b24c9a72182 req-432d87d7-8eab-4aba-beb3-644216957ea8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:45.853153 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-aee7ec0c-7ed7-41f6-b8f4-5b24c9a72182 req-432d87d7-8eab-4aba-beb3-644216957ea8 service nova] Creating event network-changed:f0d78f74-c94f-47fc-b5f6-fca21d020e90 for instance e24cb05a-9ceb-4570-9773-b04297cbf4bb on chh2-master-2 Jun 10 18:03:45.859132 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-aee7ec0c-7ed7-41f6-b8f4-5b24c9a72182 req-432d87d7-8eab-4aba-beb3-644216957ea8 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052135 Jun 10 18:03:45.860053 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1018/2019] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:03:46.015288 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7542393d-2e46-457e-a58d-af17f285cadd tempest-AbsoluteLimitsNegativeTestJSON-656483446 tempest-AbsoluteLimitsNegativeTestJSON-656483446-project] Calling method '.version_select at 0x7f77c60c6160>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:46.030765 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7542393d-2e46-457e-a58d-af17f285cadd tempest-AbsoluteLimitsNegativeTestJSON-656483446 tempest-AbsoluteLimitsNegativeTestJSON-656483446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:46.031688 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7542393d-2e46-457e-a58d-af17f285cadd tempest-AbsoluteLimitsNegativeTestJSON-656483446 tempest-AbsoluteLimitsNegativeTestJSON-656483446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:46.033209 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7542393d-2e46-457e-a58d-af17f285cadd tempest-AbsoluteLimitsNegativeTestJSON-656483446 tempest-AbsoluteLimitsNegativeTestJSON-656483446-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:46.033818 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7542393d-2e46-457e-a58d-af17f285cadd tempest-AbsoluteLimitsNegativeTestJSON-656483446 tempest-AbsoluteLimitsNegativeTestJSON-656483446-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:46.095528 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7542393d-2e46-457e-a58d-af17f285cadd tempest-AbsoluteLimitsNegativeTestJSON-656483446 tempest-AbsoluteLimitsNegativeTestJSON-656483446-project] 10.222.0.35 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.233880 Jun 10 18:03:46.097601 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1019/2020] 10.222.0.35 () {58 vars in 1121 bytes} [Fri Jun 10 18:03:45 2022] GET /compute/v2.1/limits => generated 511 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:03:46.107267 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-176ef446-c11c-4fa8-b04f-33b5a58bd779 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:46.126784 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-176ef446-c11c-4fa8-b04f-33b5a58bd779 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 3a12492e-7860-4786-a695-48505e2c1840] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:46.137621 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-176ef446-c11c-4fa8-b04f-33b5a58bd779 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:46.141239 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-176ef446-c11c-4fa8-b04f-33b5a58bd779 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:46.142315 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-176ef446-c11c-4fa8-b04f-33b5a58bd779 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:46.142921 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-176ef446-c11c-4fa8-b04f-33b5a58bd779 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:47.001020 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-176ef446-c11c-4fa8-b04f-33b5a58bd779 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:47.014849 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-176ef446-c11c-4fa8-b04f-33b5a58bd779 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840" status: 200 len: 1502 microversion: 2.1 time: 0.914778 Jun 10 18:03:47.036485 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1020/2021] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:46 2022] GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840 => generated 1502 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:47.045311 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e35aca5c-ea66-40c7-89e9-8f633e1a5e7c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:47.046277 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e35aca5c-ea66-40c7-89e9-8f633e1a5e7c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:47.057895 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e35aca5c-ea66-40c7-89e9-8f633e1a5e7c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:47.058388 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e35aca5c-ea66-40c7-89e9-8f633e1a5e7c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:47.060327 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e35aca5c-ea66-40c7-89e9-8f633e1a5e7c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:47.073086 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e35aca5c-ea66-40c7-89e9-8f633e1a5e7c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:47.104033 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:03:47.168642 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-dc4dd76c-b4cf-446b-849c-b3bb50ded5f7 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d] Updating instance_info_cache with network_info: [{"id": "f445eab9-755e-4cb4-8b43-362aa57d1ab2", "address": "fa:16:3e:0c:e4:cd", "network": {"id": "d960cccc-e559-4107-b985-68eb02da9e75", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-872231948-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.39.7.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b4a513641ffb46b091bb50e7b247e9a4", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf445eab9-75", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126595) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 10 18:03:47.269295 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc4dd76c-b4cf-446b-849c-b3bb50ded5f7 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Releasing lock "refresh_cache-d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d" {{(pid=126595) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 10 18:03:47.270228 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dc4dd76c-b4cf-446b-849c-b3bb50ded5f7 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "POST /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d/action" status: 202 len: 0 microversion: 2.1 time: 5.639210 Jun 10 18:03:47.273697 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1002/2022] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:03:41 2022] POST /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d/action => generated 0 bytes in 5641 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 10 18:03:47.279038 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-29fcbe44-be44-469b-83e8-ebc0607f5a61 tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Action: 'update', calling method: .version_select at 0x7f77c05eb8b0>, body: {"status": "enabled"} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:47.280643 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:03:47.280643 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 18:03:47.286438 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-29fcbe44-be44-469b-83e8-ebc0607f5a61 tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:47.287005 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-29fcbe44-be44-469b-83e8-ebc0607f5a61 tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:47.312466 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-29fcbe44-be44-469b-83e8-ebc0607f5a61 tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:47.312961 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-29fcbe44-be44-469b-83e8-ebc0607f5a61 tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:47.323672 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-29fcbe44-be44-469b-83e8-ebc0607f5a61 tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] HTTP exception thrown: Service b7643ca7-c70d-4477-995f-ff814d2eac44 could not be found. Jun 10 18:03:47.325847 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-29fcbe44-be44-469b-83e8-ebc0607f5a61 tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Request method failure captured: Jun 10 18:03:47.325847 chdv-master-2 devstack@n-api.service[126595]: request: PUT /compute/v2.1/os-services/b7643ca7-c70d-4477-995f-ff814d2eac44 HTTP/1.1 Jun 10 18:03:47.325847 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:03:47.325847 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:03:47.325847 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:03:47.325847 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 21 Jun 10 18:03:47.325847 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:03:47.325847 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:03:47.325847 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:03:47.325847 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:03:47.325847 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4d-0VbIlQGYE32_Espbx-aD1FtLwGsCoj9Gpc_4jTmFiNRRhvKtngdA0Jt312owyt2ugziU4XqYX_xXymdbatCCGdLrbBXU7eIf5BKAvyCIYXC2VsRFiEEfsIbw9AjATW6oXwUSQfv58SToNVJIxDRaFgdxV443eDJa6ggM0xUFwI0 Jun 10 18:03:47.325847 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:03:47.325847 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:03:47.325847 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:03:47.325847 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:03:47.325847 chdv-master-2 devstack@n-api.service[126595]: X-Openstack-Nova-Api-Version: 2.53 Jun 10 18:03:47.325847 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:03:47.325847 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:03:47.325847 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 642619d2191747589f8c22a2eac723df Jun 10 18:03:47.325847 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1709745804 Jun 10 18:03:47.325847 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member,admin Jun 10 18:03:47.325847 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member,admin Jun 10 18:03:47.327534 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/642619d2191747589f8c22a2eac723df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/642619d2191747589f8c22a2eac723df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/642619d2191747589f8c22a2eac723df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_642619d2191747589f8c22a2eac723df", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:03:47.327534 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1709745804 Jun 10 18:03:47.327534 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 642619d2191747589f8c22a2eac723df Jun 10 18:03:47.327534 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1709745804 Jun 10 18:03:47.327534 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin Jun 10 18:03:47.327534 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:03:47.327534 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:03:47.327534 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 619f4180ef394bf0b3ff72095f5551c8 Jun 10 18:03:47.327534 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin Jun 10 18:03:47.327534 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:03:47.327534 chdv-master-2 devstack@n-api.service[126595]: {"status": "enabled"} Jun 10 18:03:47.327534 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:03:47.327534 chdv-master-2 devstack@n-api.service[126595]: exception: Service b7643ca7-c70d-4477-995f-ff814d2eac44 could not be found. Jun 10 18:03:47.327534 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'b7643ca7-c70d-4477-995f-ff814d2eac44', 'body': {'status': 'enabled'}} Jun 10 18:03:47.328618 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:03:47.328618 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:47.328618 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jun 10 18:03:47.328618 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jun 10 18:03:47.328618 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jun 10 18:03:47.328618 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jun 10 18:03:47.328618 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jun 10 18:03:47.328618 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:03:47.328618 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:03:47.328618 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:03:47.328618 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:47.328618 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jun 10 18:03:47.328618 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jun 10 18:03:47.328618 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jun 10 18:03:47.328618 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jun 10 18:03:47.328618 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service b7643ca7-c70d-4477-995f-ff814d2eac44 could not be found. Jun 10 18:03:47.328618 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:03:47.328618 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:03:47.328618 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:03:47.328618 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:47.328618 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:03:47.330150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:03:47.330150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:03:47.330150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:03:47.330150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:03:47.330150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:03:47.330150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:03:47.330150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:03:47.330150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:03:47.330150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:03:47.330150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jun 10 18:03:47.330150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:03:47.330150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service b7643ca7-c70d-4477-995f-ff814d2eac44 could not be found. Jun 10 18:03:47.330150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:03:47.330150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:03:47.330150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:03:47.330150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:47.330150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:03:47.330150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:03:47.330150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:03:47.330150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:03:47.331508 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service b7643ca7-c70d-4477-995f-ff814d2eac44 could not be found. Jun 10 18:03:47.331508 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:03:47.331508 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-29fcbe44-be44-469b-83e8-ebc0607f5a61 tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Returning 404 to user: Service b7643ca7-c70d-4477-995f-ff814d2eac44 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:03:47.331508 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-29fcbe44-be44-469b-83e8-ebc0607f5a61 tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] 10.222.0.35 "PUT /compute/v2.1/os-services/b7643ca7-c70d-4477-995f-ff814d2eac44" status: 404 len: 110 microversion: 2.53 time: 0.054719 Jun 10 18:03:47.332890 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1003/2023] 10.222.0.35 () {62 vars in 1308 bytes} [Fri Jun 10 18:03:47 2022] PUT /compute/v2.1/os-services/b7643ca7-c70d-4477-995f-ff814d2eac44 => generated 110 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:03:47.339898 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3d140c6a-4a5f-406d-9b00-36d20b0547ed tempest-AbsoluteLimitsNegativeTestJSON-656483446 tempest-AbsoluteLimitsNegativeTestJSON-656483446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1557111934", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:47.408061 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-3d140c6a-4a5f-406d-9b00-36d20b0547ed tempest-AbsoluteLimitsNegativeTestJSON-656483446 tempest-AbsoluteLimitsNegativeTestJSON-656483446-project] validate_networks() for None {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:03:47.508497 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e35aca5c-ea66-40c7-89e9-8f633e1a5e7c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:47.517645 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e35aca5c-ea66-40c7-89e9-8f633e1a5e7c tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1471 microversion: 2.1 time: 0.479719 Jun 10 18:03:47.529086 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1021/2024] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:47 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1471 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:47.534413 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-59d80ecc-9f29-497f-bb3a-d084951fa29d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:47.535303 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-59d80ecc-9f29-497f-bb3a-d084951fa29d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:47.548625 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-59d80ecc-9f29-497f-bb3a-d084951fa29d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:47.549359 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-59d80ecc-9f29-497f-bb3a-d084951fa29d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:47.550165 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-59d80ecc-9f29-497f-bb3a-d084951fa29d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:47.550615 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-59d80ecc-9f29-497f-bb3a-d084951fa29d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:47.861331 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-59d80ecc-9f29-497f-bb3a-d084951fa29d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:47.880061 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-59d80ecc-9f29-497f-bb3a-d084951fa29d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1211 microversion: 2.1 time: 0.349537 Jun 10 18:03:47.881697 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1022/2025] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:47 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1211 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:47.894493 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-803014de-faac-4894-bc61-925ffa875caf tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:47.895352 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-803014de-faac-4894-bc61-925ffa875caf tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] [instance: ca923f2e-f40e-4c7c-bede-58ab9cda2763] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:47.906434 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-803014de-faac-4894-bc61-925ffa875caf tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:47.906902 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-803014de-faac-4894-bc61-925ffa875caf tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:47.907724 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-803014de-faac-4894-bc61-925ffa875caf tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:47.908172 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-803014de-faac-4894-bc61-925ffa875caf tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:48.128490 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-803014de-faac-4894-bc61-925ffa875caf tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be318f01fac5459cb4d0f55cf374824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:48.151525 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-3d140c6a-4a5f-406d-9b00-36d20b0547ed tempest-AbsoluteLimitsNegativeTestJSON-656483446 tempest-AbsoluteLimitsNegativeTestJSON-656483446-project] Getting quotas for project 5a495fe9c711453dbd5296f454aa2148. Resources: dict_keys(['metadata_items']) {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:03:48.158009 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-803014de-faac-4894-bc61-925ffa875caf tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "GET /compute/v2.1/servers/ca923f2e-f40e-4c7c-bede-58ab9cda2763" status: 200 len: 1323 microversion: 2.1 time: 0.274016 Jun 10 18:03:48.169534 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=12,nova_api:UPDATE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:03:48.171155 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-3d140c6a-4a5f-406d-9b00-36d20b0547ed tempest-AbsoluteLimitsNegativeTestJSON-656483446 tempest-AbsoluteLimitsNegativeTestJSON-656483446-project] Getting quotas for user 7cc6010e98df4b4e8e9cc16fa1d738a6 and project 5a495fe9c711453dbd5296f454aa2148. Resources: dict_keys(['metadata_items']) {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:03:48.173154 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1023/2026] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:47 2022] GET /compute/v2.1/servers/ca923f2e-f40e-4c7c-bede-58ab9cda2763 => generated 1323 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:48.198604 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5bda2b84-e51e-487b-9dca-12683b62b90f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:48.203155 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5bda2b84-e51e-487b-9dca-12683b62b90f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:48.204261 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-3d140c6a-4a5f-406d-9b00-36d20b0547ed tempest-AbsoluteLimitsNegativeTestJSON-656483446 tempest-AbsoluteLimitsNegativeTestJSON-656483446-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Jun 10 18:03:48.209105 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3d140c6a-4a5f-406d-9b00-36d20b0547ed tempest-AbsoluteLimitsNegativeTestJSON-656483446 tempest-AbsoluteLimitsNegativeTestJSON-656483446-project] Request method failure captured: Jun 10 18:03:48.209105 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 10 18:03:48.209105 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:03:48.209105 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:03:48.209105 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:03:48.209105 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 1752 Jun 10 18:03:48.209105 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:03:48.209105 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:03:48.209105 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:03:48.209105 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:03:48.209105 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4eA8iLza3KJPnecYRHYLu-bwRUzjmurEaqri6PBv9rPHw-_t7CgHsOmxO9xf6Ki2PKRqUjTm7jgoARDh8_D7MuGYNY1ywG4gXxyvOhEmPYanleWDcwpu6yY-mB-TtCYGTUcnSFxobgU_NHUyseldGcrYFKKXIWvr8ZdaK9GIFGUFho Jun 10 18:03:48.209105 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:03:48.209105 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:03:48.209105 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:03:48.209105 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:03:48.209105 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:03:48.209105 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:03:48.209105 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 5a495fe9c711453dbd5296f454aa2148 Jun 10 18:03:48.209105 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-656483446 Jun 10 18:03:48.209105 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:03:48.209105 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:03:48.209105 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/5a495fe9c711453dbd5296f454aa2148"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/5a495fe9c711453dbd5296f454aa2148"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/5a495fe9c711453dbd5296f454aa2148"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_5a495fe9c711453dbd5296f454aa2148", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:03:48.209105 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-656483446 Jun 10 18:03:48.209105 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 5a495fe9c711453dbd5296f454aa2148 Jun 10 18:03:48.209105 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-656483446 Jun 10 18:03:48.209105 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-656483446-project Jun 10 18:03:48.209105 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:03:48.209105 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:03:48.209105 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 7cc6010e98df4b4e8e9cc16fa1d738a6 Jun 10 18:03:48.209105 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-656483446-project Jun 10 18:03:48.209105 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:03:48.209105 chdv-master-2 devstack@n-api.service[126595]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1557111934", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Jun 10 18:03:48.209105 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:03:48.209105 chdv-master-2 devstack@n-api.service[126595]: exception: Maximum number of metadata items exceeds 128 Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1557111934', 'imageRef': 'efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 462, in _check_metadata_properties_quota Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1002, in _checks_for_create_and_rebuild Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 469, in _check_metadata_properties_quota Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:03:48.220017 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:03:48.223648 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:03:48.223648 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 10 18:03:48.223648 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jun 10 18:03:48.223648 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 10 18:03:48.223648 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Jun 10 18:03:48.223648 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:03:48.223648 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:03:48.223648 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:03:48.223648 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:48.223648 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:03:48.223648 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:03:48.223648 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:03:48.223648 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:03:48.223648 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Jun 10 18:03:48.223648 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:03:48.223648 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3d140c6a-4a5f-406d-9b00-36d20b0547ed tempest-AbsoluteLimitsNegativeTestJSON-656483446 tempest-AbsoluteLimitsNegativeTestJSON-656483446-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:03:48.223648 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3d140c6a-4a5f-406d-9b00-36d20b0547ed tempest-AbsoluteLimitsNegativeTestJSON-656483446 tempest-AbsoluteLimitsNegativeTestJSON-656483446-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.877915 Jun 10 18:03:48.223648 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1004/2027] 10.222.0.35 () {60 vars in 1147 bytes} [Fri Jun 10 18:03:47 2022] POST /compute/v2.1/servers => generated 87 bytes in 881 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:03:48.229819 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8bd750b9-34e7-4121-a886-d49e064357d4 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:48.245651 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5bda2b84-e51e-487b-9dca-12683b62b90f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:48.247569 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5bda2b84-e51e-487b-9dca-12683b62b90f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:48.248383 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8bd750b9-34e7-4121-a886-d49e064357d4 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:48.248849 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8bd750b9-34e7-4121-a886-d49e064357d4 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:48.249292 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5bda2b84-e51e-487b-9dca-12683b62b90f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:48.249908 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5bda2b84-e51e-487b-9dca-12683b62b90f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:48.299164 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8bd750b9-34e7-4121-a886-d49e064357d4 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 3a12492e-7860-4786-a695-48505e2c1840] Going to try to stop instance {{(pid=126595) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 10 18:03:48.302725 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5bda2b84-e51e-487b-9dca-12683b62b90f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.128083 Jun 10 18:03:48.304607 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1024/2028] 10.222.0.35 () {60 vars in 1342 bytes} [Fri Jun 10 18:03:48 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:03:48.314154 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0895c675-1fc3-432f-a6c9-62d1e1f9e6a3 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Calling method '.version_select at 0x7f77c038d0d0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:48.632719 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8bd750b9-34e7-4121-a886-d49e064357d4 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "POST /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840/action" status: 202 len: 0 microversion: 2.1 time: 0.416507 Jun 10 18:03:48.633424 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1005/2029] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:03:48 2022] POST /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840/action => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:03:48.646520 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-78be25f3-71b8-476b-98a0-3ff78a8dd6b7 tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:48.648584 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:03:48.648584 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 18:03:48.650252 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-78be25f3-71b8-476b-98a0-3ff78a8dd6b7 tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:48.652400 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-78be25f3-71b8-476b-98a0-3ff78a8dd6b7 tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:48.653634 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-78be25f3-71b8-476b-98a0-3ff78a8dd6b7 tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:48.654231 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-78be25f3-71b8-476b-98a0-3ff78a8dd6b7 tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:48.688747 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-78be25f3-71b8-476b-98a0-3ff78a8dd6b7 tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] 10.222.0.35 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.053042 Jun 10 18:03:48.690172 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1006/2030] 10.222.0.35 () {60 vars in 1177 bytes} [Fri Jun 10 18:03:48 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:48.701056 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-e988292a-eef5-44fa-a1f2-3c89e87c3a33 req-9abb28bc-3e9f-4499-81e1-a3663fde9c7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aba801d8-0f5d-49d2-9d2a-be6a81cee5e7", "tag": "d0cb7524-3ee3-4919-bc48-4155f7dfa94d"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:48.707839 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-e988292a-eef5-44fa-a1f2-3c89e87c3a33 req-9abb28bc-3e9f-4499-81e1-a3663fde9c7c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:48.708551 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-e988292a-eef5-44fa-a1f2-3c89e87c3a33 req-9abb28bc-3e9f-4499-81e1-a3663fde9c7c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:48.738866 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-e988292a-eef5-44fa-a1f2-3c89e87c3a33 req-9abb28bc-3e9f-4499-81e1-a3663fde9c7c service nova] Creating event network-changed:d0cb7524-3ee3-4919-bc48-4155f7dfa94d for instance aba801d8-0f5d-49d2-9d2a-be6a81cee5e7 on chh2-master-2 Jun 10 18:03:48.748549 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-e988292a-eef5-44fa-a1f2-3c89e87c3a33 req-9abb28bc-3e9f-4499-81e1-a3663fde9c7c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057083 Jun 10 18:03:48.751274 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1007/2031] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:03:48.767306 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-1f50376d-daff-4744-a539-678d8bad3adf req-26af1e66-8c5e-43c6-9322-fa5cfe3e5a0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d", "tag": "f445eab9-755e-4cb4-8b43-362aa57d1ab2"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:48.808826 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0895c675-1fc3-432f-a6c9-62d1e1f9e6a3 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "GET /compute/v2.1/os-floating-ips/ef05a909-9a19-4a0d-9cac-d6dc0d6a2def" status: 200 len: 184 microversion: 2.1 time: 0.502948 Jun 10 18:03:48.809620 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1025/2032] 10.222.0.35 () {58 vars in 1259 bytes} [Fri Jun 10 18:03:48 2022] GET /compute/v2.1/os-floating-ips/ef05a909-9a19-4a0d-9cac-d6dc0d6a2def => generated 184 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:03:48.815307 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-1f50376d-daff-4744-a539-678d8bad3adf req-26af1e66-8c5e-43c6-9322-fa5cfe3e5a0a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:48.815307 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-1f50376d-daff-4744-a539-678d8bad3adf req-26af1e66-8c5e-43c6-9322-fa5cfe3e5a0a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:48.820716 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8099c647-1c2e-4c9c-b62a-95443bba6e88 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:48.822413 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8099c647-1c2e-4c9c-b62a-95443bba6e88 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:48.833723 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-1f50376d-daff-4744-a539-678d8bad3adf req-26af1e66-8c5e-43c6-9322-fa5cfe3e5a0a service nova] Creating event network-changed:f445eab9-755e-4cb4-8b43-362aa57d1ab2 for instance d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d on chh1-master-2 Jun 10 18:03:48.838816 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-1f50376d-daff-4744-a539-678d8bad3adf req-26af1e66-8c5e-43c6-9322-fa5cfe3e5a0a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085961 Jun 10 18:03:48.846791 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8099c647-1c2e-4c9c-b62a-95443bba6e88 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:48.846791 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8099c647-1c2e-4c9c-b62a-95443bba6e88 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:48.847105 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1008/2033] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:03:48.847230 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8099c647-1c2e-4c9c-b62a-95443bba6e88 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:48.847230 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8099c647-1c2e-4c9c-b62a-95443bba6e88 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:48.849602 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-68873bbf-730f-41fb-8383-c915440fddf2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:48.850578 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-68873bbf-730f-41fb-8383-c915440fddf2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 3a12492e-7860-4786-a695-48505e2c1840] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:48.857974 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-68873bbf-730f-41fb-8383-c915440fddf2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:48.858739 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-68873bbf-730f-41fb-8383-c915440fddf2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:48.859692 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-68873bbf-730f-41fb-8383-c915440fddf2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:48.860493 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-68873bbf-730f-41fb-8383-c915440fddf2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:49.197793 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-68873bbf-730f-41fb-8383-c915440fddf2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:49.230942 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-68873bbf-730f-41fb-8383-c915440fddf2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840" status: 200 len: 1512 microversion: 2.1 time: 0.371205 Jun 10 18:03:49.230942 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1009/2034] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:48 2022] GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840 => generated 1512 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:49.236168 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-86a315c6-6e27-49ae-8f36-275d66e3a852 tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:49.238328 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:03:49.238328 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 18:03:49.240026 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86a315c6-6e27-49ae-8f36-275d66e3a852 tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:49.240899 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86a315c6-6e27-49ae-8f36-275d66e3a852 tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:49.241384 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8099c647-1c2e-4c9c-b62a-95443bba6e88 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:49.242104 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86a315c6-6e27-49ae-8f36-275d66e3a852 tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:49.242801 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86a315c6-6e27-49ae-8f36-275d66e3a852 tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:49.251923 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8099c647-1c2e-4c9c-b62a-95443bba6e88 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1471 microversion: 2.1 time: 0.435028 Jun 10 18:03:49.255518 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1026/2035] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:48 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1471 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:49.259821 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0cb314dd-e5cb-44c4-9e59-c0a034164f25 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.39.7.66"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:49.284378 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-86a315c6-6e27-49ae-8f36-275d66e3a852 tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] 10.222.0.35 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.057422 Jun 10 18:03:49.285625 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1010/2036] 10.222.0.35 () {60 vars in 1210 bytes} [Fri Jun 10 18:03:49 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1242 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:49.290578 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-649469e6-2d79-4ba4-8091-17a49f0c882d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:49.292034 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-649469e6-2d79-4ba4-8091-17a49f0c882d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:49.299964 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-649469e6-2d79-4ba4-8091-17a49f0c882d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:49.301252 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-649469e6-2d79-4ba4-8091-17a49f0c882d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:49.302965 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-649469e6-2d79-4ba4-8091-17a49f0c882d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:49.304142 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-649469e6-2d79-4ba4-8091-17a49f0c882d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:49.499172 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0cb314dd-e5cb-44c4-9e59-c0a034164f25 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:49.513433 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0cb314dd-e5cb-44c4-9e59-c0a034164f25 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:49.514152 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0cb314dd-e5cb-44c4-9e59-c0a034164f25 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:49.515113 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0cb314dd-e5cb-44c4-9e59-c0a034164f25 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:49.515722 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0cb314dd-e5cb-44c4-9e59-c0a034164f25 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:49.612866 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-649469e6-2d79-4ba4-8091-17a49f0c882d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:49.623313 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-649469e6-2d79-4ba4-8091-17a49f0c882d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1211 microversion: 2.1 time: 0.336231 Jun 10 18:03:49.646011 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1011/2037] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:49 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1211 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:49.652077 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a38af444-7ba5-407f-943c-7b2af79c3f5c tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:49.652838 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a38af444-7ba5-407f-943c-7b2af79c3f5c tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] [instance: ca923f2e-f40e-4c7c-bede-58ab9cda2763] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:49.659561 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a38af444-7ba5-407f-943c-7b2af79c3f5c tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:49.660023 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a38af444-7ba5-407f-943c-7b2af79c3f5c tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:49.661110 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a38af444-7ba5-407f-943c-7b2af79c3f5c tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:49.661764 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a38af444-7ba5-407f-943c-7b2af79c3f5c tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:49.942409 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0cb314dd-e5cb-44c4-9e59-c0a034164f25 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Acquired lock "refresh_cache-d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d" {{(pid=126594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 10 18:03:49.970832 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a38af444-7ba5-407f-943c-7b2af79c3f5c tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be318f01fac5459cb4d0f55cf374824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:49.985330 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a38af444-7ba5-407f-943c-7b2af79c3f5c tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "GET /compute/v2.1/servers/ca923f2e-f40e-4c7c-bede-58ab9cda2763" status: 200 len: 1323 microversion: 2.1 time: 0.338436 Jun 10 18:03:49.987631 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1012/2038] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:49 2022] GET /compute/v2.1/servers/ca923f2e-f40e-4c7c-bede-58ab9cda2763 => generated 1323 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:49.996110 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-84bf3c8b-a73a-486a-8444-752e6c71c27f tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:49.998605 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:03:49.998605 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 18:03:50.001839 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-84bf3c8b-a73a-486a-8444-752e6c71c27f tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:50.002663 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-84bf3c8b-a73a-486a-8444-752e6c71c27f tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:50.008792 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-84bf3c8b-a73a-486a-8444-752e6c71c27f tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:50.009255 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-84bf3c8b-a73a-486a-8444-752e6c71c27f tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:50.045368 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-84bf3c8b-a73a-486a-8444-752e6c71c27f tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] 10.222.0.35 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.055660 Jun 10 18:03:50.046353 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1013/2039] 10.222.0.35 () {60 vars in 1177 bytes} [Fri Jun 10 18:03:49 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:03:50.051227 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ae088192-b36c-45a6-ac2a-2eb033de516f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:50.052356 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ae088192-b36c-45a6-ac2a-2eb033de516f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:50.059144 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ae088192-b36c-45a6-ac2a-2eb033de516f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:50.059580 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ae088192-b36c-45a6-ac2a-2eb033de516f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:50.060383 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ae088192-b36c-45a6-ac2a-2eb033de516f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:50.060841 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ae088192-b36c-45a6-ac2a-2eb033de516f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:50.091895 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ae088192-b36c-45a6-ac2a-2eb033de516f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.044424 Jun 10 18:03:50.092747 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1014/2040] 10.222.0.35 () {60 vars in 1342 bytes} [Fri Jun 10 18:03:50 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:03:50.121648 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f8c561ae-c34f-499e-b5e4-a16ab285e1e6 tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:50.123062 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:03:50.123062 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 18:03:50.124388 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8c561ae-c34f-499e-b5e4-a16ab285e1e6 tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:50.124857 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8c561ae-c34f-499e-b5e4-a16ab285e1e6 tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:50.126734 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8c561ae-c34f-499e-b5e4-a16ab285e1e6 tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:50.127203 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8c561ae-c34f-499e-b5e4-a16ab285e1e6 tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:50.166023 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f8c561ae-c34f-499e-b5e4-a16ab285e1e6 tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] 10.222.0.35 "GET /compute/v2.1/os-services?host=chdv-master-2&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.072228 Jun 10 18:03:50.167892 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1015/2041] 10.222.0.35 () {60 vars in 1236 bytes} [Fri Jun 10 18:03:50 2022] GET /compute/v2.1/os-services?host=chdv-master-2&binary=xxx => generated 16 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:50.180721 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-711590bd-b7ab-4dd8-8620-1c987cd30ca2 tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:50.182590 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:03:50.182590 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 18:03:50.183826 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-711590bd-b7ab-4dd8-8620-1c987cd30ca2 tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:50.184330 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-711590bd-b7ab-4dd8-8620-1c987cd30ca2 tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:50.185186 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-711590bd-b7ab-4dd8-8620-1c987cd30ca2 tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:50.186319 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-711590bd-b7ab-4dd8-8620-1c987cd30ca2 tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:50.211683 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-711590bd-b7ab-4dd8-8620-1c987cd30ca2 tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] 10.222.0.35 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.035101 Jun 10 18:03:50.212666 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1016/2042] 10.222.0.35 () {60 vars in 1177 bytes} [Fri Jun 10 18:03:50 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:03:50.223735 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0324f1b8-607c-4846-9db2-ab8d432f5f7f tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:50.225061 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:03:50.225061 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 18:03:50.226276 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0324f1b8-607c-4846-9db2-ab8d432f5f7f tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:50.226931 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0324f1b8-607c-4846-9db2-ab8d432f5f7f tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:50.227918 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0324f1b8-607c-4846-9db2-ab8d432f5f7f tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:50.228562 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0324f1b8-607c-4846-9db2-ab8d432f5f7f tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:50.254835 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0324f1b8-607c-4846-9db2-ab8d432f5f7f tempest-ServicesAdminNegativeV253TestJSON-1709745804 tempest-ServicesAdminNegativeV253TestJSON-1709745804-project-admin] 10.222.0.35 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.034585 Jun 10 18:03:50.263433 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1017/2043] 10.222.0.35 () {60 vars in 1238 bytes} [Fri Jun 10 18:03:50 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:03:50.268687 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fe83863e-d69b-4ff1-9500-316236b1c694 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:50.269509 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fe83863e-d69b-4ff1-9500-316236b1c694 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 3a12492e-7860-4786-a695-48505e2c1840] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:50.276810 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fe83863e-d69b-4ff1-9500-316236b1c694 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:50.277484 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fe83863e-d69b-4ff1-9500-316236b1c694 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:50.278514 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fe83863e-d69b-4ff1-9500-316236b1c694 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:50.279124 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fe83863e-d69b-4ff1-9500-316236b1c694 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:50.434540 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fe83863e-d69b-4ff1-9500-316236b1c694 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:50.445488 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fe83863e-d69b-4ff1-9500-316236b1c694 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840" status: 200 len: 1512 microversion: 2.1 time: 0.180637 Jun 10 18:03:50.454524 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1018/2044] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:50 2022] GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840 => generated 1512 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:50.672653 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d6b8e24f-d951-451e-9c08-45a37da8199d tempest-ServicesAdminNegativeV253TestJSON-965177856 tempest-ServicesAdminNegativeV253TestJSON-965177856-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:50.674160 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:03:50.674160 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 18:03:50.675463 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d6b8e24f-d951-451e-9c08-45a37da8199d tempest-ServicesAdminNegativeV253TestJSON-965177856 tempest-ServicesAdminNegativeV253TestJSON-965177856-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '19baf6ab3d6b48808dd083e840792011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd83ac20dc14def9871ee847fe4b963', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d6b8e24f-d951-451e-9c08-45a37da8199d tempest-ServicesAdminNegativeV253TestJSON-965177856 tempest-ServicesAdminNegativeV253TestJSON-965177856-project] Request method failure captured: Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/os-services HTTP/1.1 Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4d97_WBIPJix66DzI5u5JXtPlcm48F2PQILjQ9acmVycRoBPPNwx50Xxj3Km06ahw1VJGHorC8SDBN8pz57Yc_7Z8YWiwfUOH4uaBSo0LzdhovN5H9hio19uNRquXdkL4fepm8YICUsVV--2f3P6DUsIAcaD-d_UURAMaOvadVhXrQ Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: X-Openstack-Nova-Api-Version: 2.53 Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 0dd83ac20dc14def9871ee847fe4b963 Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-965177856 Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/0dd83ac20dc14def9871ee847fe4b963"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/0dd83ac20dc14def9871ee847fe4b963"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/0dd83ac20dc14def9871ee847fe4b963"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_0dd83ac20dc14def9871ee847fe4b963", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-965177856 Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 0dd83ac20dc14def9871ee847fe4b963 Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-965177856 Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServicesAdminNegativeV253TestJSON-965177856-project Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 19baf6ab3d6b48808dd083e840792011 Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-965177856-project Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: action_args: {} Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 10 18:03:50.678444 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:03:50.683937 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:03:50.683937 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:03:50.683937 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:50.683937 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:03:50.683937 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:03:50.683937 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 10 18:03:50.683937 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 10 18:03:50.683937 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 10 18:03:50.683937 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:03:50.683937 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d6b8e24f-d951-451e-9c08-45a37da8199d tempest-ServicesAdminNegativeV253TestJSON-965177856 tempest-ServicesAdminNegativeV253TestJSON-965177856-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:03:50.685135 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d6b8e24f-d951-451e-9c08-45a37da8199d tempest-ServicesAdminNegativeV253TestJSON-965177856 tempest-ServicesAdminNegativeV253TestJSON-965177856-project] 10.222.0.35 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.227127 Jun 10 18:03:50.685796 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1019/2045] 10.222.0.35 () {60 vars in 1177 bytes} [Fri Jun 10 18:03:50 2022] GET /compute/v2.1/os-services => generated 112 bytes in 231 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:03:50.693847 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-91b06635-0acb-4052-987f-b3c89dbdcfbc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:50.695375 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-91b06635-0acb-4052-987f-b3c89dbdcfbc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:50.707368 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-91b06635-0acb-4052-987f-b3c89dbdcfbc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:50.708103 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-91b06635-0acb-4052-987f-b3c89dbdcfbc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:50.709331 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-91b06635-0acb-4052-987f-b3c89dbdcfbc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:50.710125 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-91b06635-0acb-4052-987f-b3c89dbdcfbc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:50.752673 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=3,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:03:50.938431 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-91b06635-0acb-4052-987f-b3c89dbdcfbc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:50.949583 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-91b06635-0acb-4052-987f-b3c89dbdcfbc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1471 microversion: 2.1 time: 0.261889 Jun 10 18:03:50.950666 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1020/2046] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:50 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1471 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:50.984712 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f0bd412a-431b-4d0b-9ca9-34f5699d486b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:50.990707 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f0bd412a-431b-4d0b-9ca9-34f5699d486b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:51.006851 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f0bd412a-431b-4d0b-9ca9-34f5699d486b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:51.015526 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f0bd412a-431b-4d0b-9ca9-34f5699d486b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:51.015526 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f0bd412a-431b-4d0b-9ca9-34f5699d486b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:51.015526 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f0bd412a-431b-4d0b-9ca9-34f5699d486b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:51.177162 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f0bd412a-431b-4d0b-9ca9-34f5699d486b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:51.187757 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f0bd412a-431b-4d0b-9ca9-34f5699d486b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1211 microversion: 2.1 time: 0.234379 Jun 10 18:03:51.188381 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1021/2047] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:50 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1211 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:51.220189 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-5b2e12b4-1bd2-4723-a900-6897f5376d3d req-a3ed6265-1ae6-4369-80e1-37a8c19ee7b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07e79e24-76e1-476b-b064-a6729174e2ff", "tag": "2fd4d2ca-7508-415a-9af1-7f4ff48d0061"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:51.242047 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-5b2e12b4-1bd2-4723-a900-6897f5376d3d req-a3ed6265-1ae6-4369-80e1-37a8c19ee7b5 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:51.242507 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-5b2e12b4-1bd2-4723-a900-6897f5376d3d req-a3ed6265-1ae6-4369-80e1-37a8c19ee7b5 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:51.262096 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-5b2e12b4-1bd2-4723-a900-6897f5376d3d req-a3ed6265-1ae6-4369-80e1-37a8c19ee7b5 service nova] Creating event network-changed:2fd4d2ca-7508-415a-9af1-7f4ff48d0061 for instance 07e79e24-76e1-476b-b064-a6729174e2ff on chh2-master-2 Jun 10 18:03:51.268022 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-5b2e12b4-1bd2-4723-a900-6897f5376d3d req-a3ed6265-1ae6-4369-80e1-37a8c19ee7b5 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078433 Jun 10 18:03:51.277136 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1022/2048] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:03:51.278585 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-5c4949fd-a9a8-4faa-9eae-d237493a3e7b req-a7faef6f-d96e-4d22-918d-a46a37f558b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca923f2e-f40e-4c7c-bede-58ab9cda2763", "tag": "3929a812-05d7-4ecf-be86-c63b4062608d"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:51.287793 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-5c4949fd-a9a8-4faa-9eae-d237493a3e7b req-a7faef6f-d96e-4d22-918d-a46a37f558b4 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:51.288578 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-5c4949fd-a9a8-4faa-9eae-d237493a3e7b req-a7faef6f-d96e-4d22-918d-a46a37f558b4 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:51.301750 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-5c4949fd-a9a8-4faa-9eae-d237493a3e7b req-a7faef6f-d96e-4d22-918d-a46a37f558b4 service nova] Creating event network-changed:3929a812-05d7-4ecf-be86-c63b4062608d for instance ca923f2e-f40e-4c7c-bede-58ab9cda2763 on chh1-master-2 Jun 10 18:03:51.310180 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-5c4949fd-a9a8-4faa-9eae-d237493a3e7b req-a7faef6f-d96e-4d22-918d-a46a37f558b4 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036629 Jun 10 18:03:51.311087 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1023/2049] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:03:51.329444 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-51b04e25-6d84-4a45-bf4e-470f7e3d998a tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:51.330677 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-51b04e25-6d84-4a45-bf4e-470f7e3d998a tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] [instance: ca923f2e-f40e-4c7c-bede-58ab9cda2763] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:51.341157 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-51b04e25-6d84-4a45-bf4e-470f7e3d998a tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:51.341856 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-51b04e25-6d84-4a45-bf4e-470f7e3d998a tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:51.342823 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-51b04e25-6d84-4a45-bf4e-470f7e3d998a tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:51.343467 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-51b04e25-6d84-4a45-bf4e-470f7e3d998a tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:51.575517 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-51b04e25-6d84-4a45-bf4e-470f7e3d998a tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be318f01fac5459cb4d0f55cf374824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:51.583293 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-51b04e25-6d84-4a45-bf4e-470f7e3d998a tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "GET /compute/v2.1/servers/ca923f2e-f40e-4c7c-bede-58ab9cda2763" status: 200 len: 1323 microversion: 2.1 time: 0.270748 Jun 10 18:03:51.593065 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1024/2050] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:51 2022] GET /compute/v2.1/servers/ca923f2e-f40e-4c7c-bede-58ab9cda2763 => generated 1323 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:51.599669 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7a315078-8d18-492b-b3ff-6d1aab177164 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:51.601015 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7a315078-8d18-492b-b3ff-6d1aab177164 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:51.609793 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7a315078-8d18-492b-b3ff-6d1aab177164 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:51.610486 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7a315078-8d18-492b-b3ff-6d1aab177164 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:51.611501 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7a315078-8d18-492b-b3ff-6d1aab177164 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:51.612115 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7a315078-8d18-492b-b3ff-6d1aab177164 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:51.652558 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7a315078-8d18-492b-b3ff-6d1aab177164 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.057517 Jun 10 18:03:51.654647 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1025/2051] 10.222.0.35 () {60 vars in 1342 bytes} [Fri Jun 10 18:03:51 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:03:51.662641 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-0cb314dd-e5cb-44c4-9e59-c0a034164f25 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d] Building network info cache for instance {{(pid=126594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} Jun 10 18:03:51.663136 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-467ae131-e38e-42c3-a3f3-0b3ccddac7c2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:51.663552 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-467ae131-e38e-42c3-a3f3-0b3ccddac7c2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 3a12492e-7860-4786-a695-48505e2c1840] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:51.670660 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-467ae131-e38e-42c3-a3f3-0b3ccddac7c2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:51.671190 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-467ae131-e38e-42c3-a3f3-0b3ccddac7c2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:51.671973 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-467ae131-e38e-42c3-a3f3-0b3ccddac7c2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:51.672451 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-467ae131-e38e-42c3-a3f3-0b3ccddac7c2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:52.580282 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-467ae131-e38e-42c3-a3f3-0b3ccddac7c2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:52.594339 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-467ae131-e38e-42c3-a3f3-0b3ccddac7c2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840" status: 200 len: 1512 microversion: 2.1 time: 0.938046 Jun 10 18:03:52.595789 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1026/2052] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:51 2022] GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840 => generated 1512 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:52.606329 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-32f9ded2-2056-4b18-97ae-3f1b08be471d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:52.607204 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-32f9ded2-2056-4b18-97ae-3f1b08be471d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:52.614922 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-32f9ded2-2056-4b18-97ae-3f1b08be471d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:52.615662 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-32f9ded2-2056-4b18-97ae-3f1b08be471d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:52.616691 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-32f9ded2-2056-4b18-97ae-3f1b08be471d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:52.617297 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-32f9ded2-2056-4b18-97ae-3f1b08be471d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:52.775332 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-0cb314dd-e5cb-44c4-9e59-c0a034164f25 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d] Updating instance_info_cache with network_info: [{"id": "f445eab9-755e-4cb4-8b43-362aa57d1ab2", "address": "fa:16:3e:0c:e4:cd", "network": {"id": "d960cccc-e559-4107-b985-68eb02da9e75", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-872231948-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b4a513641ffb46b091bb50e7b247e9a4", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf445eab9-75", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 10 18:03:52.879689 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0cb314dd-e5cb-44c4-9e59-c0a034164f25 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Releasing lock "refresh_cache-d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d" {{(pid=126594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 10 18:03:52.880604 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0cb314dd-e5cb-44c4-9e59-c0a034164f25 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "POST /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d/action" status: 202 len: 0 microversion: 2.1 time: 3.626676 Jun 10 18:03:52.881767 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1027/2053] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:03:49 2022] POST /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d/action => generated 0 bytes in 3628 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 10 18:03:52.887110 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d282516b-1dbb-4cba-9c15-9fe6ff54acef tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:52.887737 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d282516b-1dbb-4cba-9c15-9fe6ff54acef tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:52.903809 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d282516b-1dbb-4cba-9c15-9fe6ff54acef tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:52.904568 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d282516b-1dbb-4cba-9c15-9fe6ff54acef tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:52.909957 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d282516b-1dbb-4cba-9c15-9fe6ff54acef tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:52.909957 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d282516b-1dbb-4cba-9c15-9fe6ff54acef tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:53.029529 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-32f9ded2-2056-4b18-97ae-3f1b08be471d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:53.049533 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-32f9ded2-2056-4b18-97ae-3f1b08be471d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1476 microversion: 2.1 time: 0.447449 Jun 10 18:03:53.053512 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1027/2054] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:52 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1476 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:53.061284 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cb5f8c7c-db47-4381-bc5e-1fa406550022 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:53.062451 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cb5f8c7c-db47-4381-bc5e-1fa406550022 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] [instance: ca923f2e-f40e-4c7c-bede-58ab9cda2763] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:53.079150 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cb5f8c7c-db47-4381-bc5e-1fa406550022 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:53.080362 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cb5f8c7c-db47-4381-bc5e-1fa406550022 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:53.082211 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cb5f8c7c-db47-4381-bc5e-1fa406550022 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:53.083207 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cb5f8c7c-db47-4381-bc5e-1fa406550022 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:53.295237 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d282516b-1dbb-4cba-9c15-9fe6ff54acef tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:53.309683 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d282516b-1dbb-4cba-9c15-9fe6ff54acef tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1211 microversion: 2.1 time: 0.426195 Jun 10 18:03:53.310737 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1028/2055] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:52 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1211 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:53.316098 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-be23f991-4a5d-4c7a-8901-24b990568b49 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:53.317715 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-be23f991-4a5d-4c7a-8901-24b990568b49 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:53.322977 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:03:53.325178 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be23f991-4a5d-4c7a-8901-24b990568b49 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:53.325726 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be23f991-4a5d-4c7a-8901-24b990568b49 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:53.326754 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be23f991-4a5d-4c7a-8901-24b990568b49 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:53.327207 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be23f991-4a5d-4c7a-8901-24b990568b49 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:53.360522 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-be23f991-4a5d-4c7a-8901-24b990568b49 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.048434 Jun 10 18:03:53.361712 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1029/2056] 10.222.0.35 () {60 vars in 1342 bytes} [Fri Jun 10 18:03:53 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:53.370513 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4c63a33b-464e-4cb1-a40b-a2328ad236af tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:53.370991 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4c63a33b-464e-4cb1-a40b-a2328ad236af tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:53.378142 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4c63a33b-464e-4cb1-a40b-a2328ad236af tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:53.378734 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4c63a33b-464e-4cb1-a40b-a2328ad236af tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:53.379545 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4c63a33b-464e-4cb1-a40b-a2328ad236af tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:53.380038 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4c63a33b-464e-4cb1-a40b-a2328ad236af tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:53.406423 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-4c63a33b-464e-4cb1-a40b-a2328ad236af tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] HTTP exception thrown: Instance 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193 could not be found. Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4c63a33b-464e-4cb1-a40b-a2328ad236af tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Request method failure captured: Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: request: DELETE /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193 HTTP/1.1 Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4c6bKMPdoW6JM5vPU7sJZ9EKw5p_e5Nn3TIwZ8taSXQ0t9p_7pNjb_r4YMAZes9OZCJmuEzQc2x42I-9bQXq5Xrgtdtt86trEaDPwcjLqJL5CIujPL4LPvif1K6JTifq-zjls-ga-WpuFiPpsn6IHLrl-UWVmD-CrCEEjjieM48Bpk Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: b4a513641ffb46b091bb50e7b247e9a4 Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-230132700 Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/b4a513641ffb46b091bb50e7b247e9a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/b4a513641ffb46b091bb50e7b247e9a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/b4a513641ffb46b091bb50e7b247e9a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_b4a513641ffb46b091bb50e7b247e9a4", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-230132700 Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: b4a513641ffb46b091bb50e7b247e9a4 Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-230132700 Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-FloatingIPsAssociationTestJSON-230132700-project Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 5b8eb46cd9bd428b9f144077f3d7ed9f Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-230132700-project Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193 could not be found. Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '5a5ddc8b-3e7a-48f8-9f48-69b3b5027193'} Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193 could not be found. Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:03:53.410393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:03:53.414500 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193 could not be found. Jun 10 18:03:53.414500 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:53.414500 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:03:53.414500 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:53.414500 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:53.414500 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:03:53.414500 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:03:53.414500 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:03:53.414500 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:03:53.414500 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193 could not be found. Jun 10 18:03:53.414500 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:03:53.414500 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4c63a33b-464e-4cb1-a40b-a2328ad236af tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Returning 404 to user: Instance 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:03:53.414500 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4c63a33b-464e-4cb1-a40b-a2328ad236af tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "DELETE /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193" status: 404 len: 111 microversion: 2.1 time: 0.050591 Jun 10 18:03:53.416085 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1030/2057] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:03:53 2022] DELETE /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:03:53.427443 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-187951dd-520c-4f85-abcb-0d8b96e56d95 req-8273250c-fc23-4864-9400-9a49eb2d01a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d", "tag": "f445eab9-755e-4cb4-8b43-362aa57d1ab2"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:53.441258 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cb5f8c7c-db47-4381-bc5e-1fa406550022 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be318f01fac5459cb4d0f55cf374824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:53.441773 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-187951dd-520c-4f85-abcb-0d8b96e56d95 req-8273250c-fc23-4864-9400-9a49eb2d01a0 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:53.445277 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-187951dd-520c-4f85-abcb-0d8b96e56d95 req-8273250c-fc23-4864-9400-9a49eb2d01a0 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:53.451862 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cb5f8c7c-db47-4381-bc5e-1fa406550022 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "GET /compute/v2.1/servers/ca923f2e-f40e-4c7c-bede-58ab9cda2763" status: 200 len: 1323 microversion: 2.1 time: 0.398931 Jun 10 18:03:53.453625 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1028/2058] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:53 2022] GET /compute/v2.1/servers/ca923f2e-f40e-4c7c-bede-58ab9cda2763 => generated 1323 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:53.465655 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fdddd6ed-630d-4134-bb14-a51d41c6cdcc tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:53.466624 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fdddd6ed-630d-4134-bb14-a51d41c6cdcc tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:53.474472 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-187951dd-520c-4f85-abcb-0d8b96e56d95 req-8273250c-fc23-4864-9400-9a49eb2d01a0 service nova] Creating event network-changed:f445eab9-755e-4cb4-8b43-362aa57d1ab2 for instance d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d on chh1-master-2 Jun 10 18:03:53.481263 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-187951dd-520c-4f85-abcb-0d8b96e56d95 req-8273250c-fc23-4864-9400-9a49eb2d01a0 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064749 Jun 10 18:03:53.487245 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1031/2059] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:03:53.487524 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fdddd6ed-630d-4134-bb14-a51d41c6cdcc tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:53.487524 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fdddd6ed-630d-4134-bb14-a51d41c6cdcc tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:53.487524 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fdddd6ed-630d-4134-bb14-a51d41c6cdcc tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:53.487524 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fdddd6ed-630d-4134-bb14-a51d41c6cdcc tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:53.524519 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-fdddd6ed-630d-4134-bb14-a51d41c6cdcc tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] HTTP exception thrown: Instance 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193 could not be found. Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fdddd6ed-630d-4134-bb14-a51d41c6cdcc tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Request method failure captured: Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193 HTTP/1.1 Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4c6bKMPdoW6JM5vPU7sJZ9EKw5p_e5Nn3TIwZ8taSXQ0t9p_7pNjb_r4YMAZes9OZCJmuEzQc2x42I-9bQXq5Xrgtdtt86trEaDPwcjLqJL5CIujPL4LPvif1K6JTifq-zjls-ga-WpuFiPpsn6IHLrl-UWVmD-CrCEEjjieM48Bpk Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: b4a513641ffb46b091bb50e7b247e9a4 Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-230132700 Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/b4a513641ffb46b091bb50e7b247e9a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/b4a513641ffb46b091bb50e7b247e9a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/b4a513641ffb46b091bb50e7b247e9a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_b4a513641ffb46b091bb50e7b247e9a4", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-230132700 Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: b4a513641ffb46b091bb50e7b247e9a4 Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-230132700 Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-FloatingIPsAssociationTestJSON-230132700-project Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 5b8eb46cd9bd428b9f144077f3d7ed9f Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-230132700-project Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193 could not be found. Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '5a5ddc8b-3e7a-48f8-9f48-69b3b5027193'} Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193 could not be found. Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193 could not be found. Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:03:53.529974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:03:53.534955 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:03:53.534955 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:03:53.534955 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:03:53.534955 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:03:53.534955 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:03:53.534955 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:03:53.534955 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193 could not be found. Jun 10 18:03:53.534955 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:03:53.539309 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fdddd6ed-630d-4134-bb14-a51d41c6cdcc tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Returning 404 to user: Instance 5a5ddc8b-3e7a-48f8-9f48-69b3b5027193 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:03:53.550600 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fdddd6ed-630d-4134-bb14-a51d41c6cdcc tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "GET /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193" status: 404 len: 111 microversion: 2.1 time: 0.093865 Jun 10 18:03:53.550600 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1029/2060] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:53 2022] GET /compute/v2.1/servers/5a5ddc8b-3e7a-48f8-9f48-69b3b5027193 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:03:53.562190 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-570582ef-5b33-4a75-abe9-7678f9121c76 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Calling method '.version_select at 0x7f77c60c6dc0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:53.611876 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a02b570e-a905-4990-9c70-e85bcac148bd tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:53.612542 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a02b570e-a905-4990-9c70-e85bcac148bd tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 3a12492e-7860-4786-a695-48505e2c1840] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:53.622073 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a02b570e-a905-4990-9c70-e85bcac148bd tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:53.622852 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a02b570e-a905-4990-9c70-e85bcac148bd tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:53.624254 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a02b570e-a905-4990-9c70-e85bcac148bd tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:53.625001 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a02b570e-a905-4990-9c70-e85bcac148bd tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:53.849331 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a02b570e-a905-4990-9c70-e85bcac148bd tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:53.860731 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a02b570e-a905-4990-9c70-e85bcac148bd tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840" status: 200 len: 1512 microversion: 2.1 time: 0.251597 Jun 10 18:03:53.861532 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1030/2061] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:53 2022] GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840 => generated 1512 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:03:54.076164 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-05754c11-6eda-482f-88d2-11f068501456 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:54.077124 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-05754c11-6eda-482f-88d2-11f068501456 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:54.085234 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05754c11-6eda-482f-88d2-11f068501456 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:54.086018 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05754c11-6eda-482f-88d2-11f068501456 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:54.087046 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05754c11-6eda-482f-88d2-11f068501456 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:54.087797 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05754c11-6eda-482f-88d2-11f068501456 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:54.251340 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-05754c11-6eda-482f-88d2-11f068501456 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:54.261022 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-05754c11-6eda-482f-88d2-11f068501456 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1476 microversion: 2.1 time: 0.188483 Jun 10 18:03:54.268717 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1031/2062] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:54 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1476 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:54.329203 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4a48cbdf-c058-4ba9-b320-382bee7af93f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:54.330108 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4a48cbdf-c058-4ba9-b320-382bee7af93f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:54.338867 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a48cbdf-c058-4ba9-b320-382bee7af93f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:54.340403 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a48cbdf-c058-4ba9-b320-382bee7af93f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:54.341429 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a48cbdf-c058-4ba9-b320-382bee7af93f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:54.342114 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a48cbdf-c058-4ba9-b320-382bee7af93f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:54.523986 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4a48cbdf-c058-4ba9-b320-382bee7af93f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:54.543935 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4a48cbdf-c058-4ba9-b320-382bee7af93f tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1211 microversion: 2.1 time: 0.217637 Jun 10 18:03:54.545132 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1032/2063] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:54 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1211 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:03:54.747317 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c50a8d2a-b2ad-4f95-9a0e-f6ab37764901 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Action: 'create', calling method: .version_select at 0x7f77c1175040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-765515554", "description": "tempest-description-965119362"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:55.132316 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-570582ef-5b33-4a75-abe9-7678f9121c76 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "DELETE /compute/v2.1/os-floating-ips/ef05a909-9a19-4a0d-9cac-d6dc0d6a2def" status: 202 len: 0 microversion: 2.1 time: 1.577699 Jun 10 18:03:55.137871 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1032/2064] 10.222.0.35 () {58 vars in 1262 bytes} [Fri Jun 10 18:03:53 2022] DELETE /compute/v2.1/os-floating-ips/ef05a909-9a19-4a0d-9cac-d6dc0d6a2def => generated 0 bytes in 1579 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:03:55.138391 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-078901de-acc6-446f-9c2f-7ca9a9ef96b5 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:55.138827 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-078901de-acc6-446f-9c2f-7ca9a9ef96b5 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] [instance: ca923f2e-f40e-4c7c-bede-58ab9cda2763] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:55.148062 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-078901de-acc6-446f-9c2f-7ca9a9ef96b5 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:55.148576 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-078901de-acc6-446f-9c2f-7ca9a9ef96b5 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:55.149567 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-078901de-acc6-446f-9c2f-7ca9a9ef96b5 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:55.151276 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-078901de-acc6-446f-9c2f-7ca9a9ef96b5 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:55.167323 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c50a8d2a-b2ad-4f95-9a0e-f6ab37764901 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.620029 Jun 10 18:03:55.168418 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1033/2065] 10.222.0.35 () {60 vars in 1179 bytes} [Fri Jun 10 18:03:54 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:03:55.183322 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-491ba532-335d-4ccd-8b5b-6d3a4a5812c1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:55.183989 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-491ba532-335d-4ccd-8b5b-6d3a4a5812c1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 3a12492e-7860-4786-a695-48505e2c1840] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:55.191623 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-491ba532-335d-4ccd-8b5b-6d3a4a5812c1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:55.192099 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-491ba532-335d-4ccd-8b5b-6d3a4a5812c1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:55.208824 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-491ba532-335d-4ccd-8b5b-6d3a4a5812c1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:55.209376 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-491ba532-335d-4ccd-8b5b-6d3a4a5812c1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:55.351282 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-078901de-acc6-446f-9c2f-7ca9a9ef96b5 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be318f01fac5459cb4d0f55cf374824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:55.363282 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-078901de-acc6-446f-9c2f-7ca9a9ef96b5 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "GET /compute/v2.1/servers/ca923f2e-f40e-4c7c-bede-58ab9cda2763" status: 200 len: 1323 microversion: 2.1 time: 0.229266 Jun 10 18:03:55.364070 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1033/2066] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:55 2022] GET /compute/v2.1/servers/ca923f2e-f40e-4c7c-bede-58ab9cda2763 => generated 1323 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:55.376909 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5fddf011-0b76-44c7-82f8-0a9d3e7ee252 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:55.378302 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5fddf011-0b76-44c7-82f8-0a9d3e7ee252 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:55.389255 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5fddf011-0b76-44c7-82f8-0a9d3e7ee252 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:55.390176 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5fddf011-0b76-44c7-82f8-0a9d3e7ee252 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:55.391043 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5fddf011-0b76-44c7-82f8-0a9d3e7ee252 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:55.391710 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5fddf011-0b76-44c7-82f8-0a9d3e7ee252 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:55.435242 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-491ba532-335d-4ccd-8b5b-6d3a4a5812c1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:55.441200 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5fddf011-0b76-44c7-82f8-0a9d3e7ee252 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:03:55.458610 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-491ba532-335d-4ccd-8b5b-6d3a4a5812c1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840" status: 200 len: 1512 microversion: 2.1 time: 0.289056 Jun 10 18:03:55.459212 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1034/2067] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:55 2022] GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840 => generated 1512 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:55.489561 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a7208d46-cd9c-4508-a5bd-91d8334e9a06 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Action: 'create', calling method: .version_select at 0x7f77c617a0d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-937164181", "description": "tempest-description-156264383"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:55.824864 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5fddf011-0b76-44c7-82f8-0a9d3e7ee252 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "DELETE /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d" status: 204 len: 0 microversion: 2.1 time: 0.458834 Jun 10 18:03:55.827464 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1034/2068] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:03:55 2022] DELETE /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:03:55.835992 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-caae57c7-ca39-4167-ace4-5087fba3db3d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:55.837759 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-caae57c7-ca39-4167-ace4-5087fba3db3d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:55.857283 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-caae57c7-ca39-4167-ace4-5087fba3db3d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:55.858765 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-caae57c7-ca39-4167-ace4-5087fba3db3d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:55.861775 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-caae57c7-ca39-4167-ace4-5087fba3db3d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:55.862536 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-caae57c7-ca39-4167-ace4-5087fba3db3d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:56.028464 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=4 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:03:56.055723 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=6 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:03:56.158625 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a7208d46-cd9c-4508-a5bd-91d8334e9a06 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.681091 Jun 10 18:03:56.159633 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1035/2069] 10.222.0.35 () {60 vars in 1179 bytes} [Fri Jun 10 18:03:55 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:03:56.164331 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8467878e-27a4-4510-a356-b507a2216925 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:56.164965 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8467878e-27a4-4510-a356-b507a2216925 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:56.173715 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8467878e-27a4-4510-a356-b507a2216925 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:56.174520 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8467878e-27a4-4510-a356-b507a2216925 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:56.175633 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8467878e-27a4-4510-a356-b507a2216925 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:56.176143 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8467878e-27a4-4510-a356-b507a2216925 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:56.227747 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-caae57c7-ca39-4167-ace4-5087fba3db3d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:56.239280 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-caae57c7-ca39-4167-ace4-5087fba3db3d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1476 microversion: 2.1 time: 0.408340 Jun 10 18:03:56.239877 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1035/2070] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:55 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1476 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:56.244769 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-124399af-0c15-4796-913a-bb6b00de13a6 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:56.245553 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-124399af-0c15-4796-913a-bb6b00de13a6 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:56.252926 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-124399af-0c15-4796-913a-bb6b00de13a6 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:56.253445 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-124399af-0c15-4796-913a-bb6b00de13a6 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:56.254225 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-124399af-0c15-4796-913a-bb6b00de13a6 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:56.255033 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-124399af-0c15-4796-913a-bb6b00de13a6 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:56.373806 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8467878e-27a4-4510-a356-b507a2216925 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:56.384636 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8467878e-27a4-4510-a356-b507a2216925 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1199 microversion: 2.1 time: 0.222936 Jun 10 18:03:56.385283 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1036/2071] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:56 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1199 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:56.406169 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-31ca2dc7-9d31-4036-901f-a597dc1509e7 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1021273948", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "5585293d-a4c1-4a92-a3ba-d8142e4ec6ed"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:56.475516 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-124399af-0c15-4796-913a-bb6b00de13a6 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8eb46cd9bd428b9f144077f3d7ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a513641ffb46b091bb50e7b247e9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:56.484991 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-124399af-0c15-4796-913a-bb6b00de13a6 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "GET /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d" status: 200 len: 1526 microversion: 2.1 time: 0.243782 Jun 10 18:03:56.486321 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1036/2072] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:56 2022] GET /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d => generated 1526 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:56.490052 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-31ca2dc7-9d31-4036-901f-a597dc1509e7 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] validate_networks() for [('5585293d-a4c1-4a92-a3ba-d8142e4ec6ed', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:03:56.491582 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bfa880b5-5a88-4812-a099-38c56278bb4e tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:56.492442 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bfa880b5-5a88-4812-a099-38c56278bb4e tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] [instance: ca923f2e-f40e-4c7c-bede-58ab9cda2763] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:56.498904 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bfa880b5-5a88-4812-a099-38c56278bb4e tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:56.499591 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bfa880b5-5a88-4812-a099-38c56278bb4e tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:56.500408 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bfa880b5-5a88-4812-a099-38c56278bb4e tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:56.501035 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bfa880b5-5a88-4812-a099-38c56278bb4e tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:56.725589 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bfa880b5-5a88-4812-a099-38c56278bb4e tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be318f01fac5459cb4d0f55cf374824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:56.734474 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bfa880b5-5a88-4812-a099-38c56278bb4e tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "GET /compute/v2.1/servers/ca923f2e-f40e-4c7c-bede-58ab9cda2763" status: 200 len: 1323 microversion: 2.1 time: 0.246876 Jun 10 18:03:56.735062 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1037/2073] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:56 2022] GET /compute/v2.1/servers/ca923f2e-f40e-4c7c-bede-58ab9cda2763 => generated 1323 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:56.740195 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2b2eadbf-18a7-4e33-b505-2ec83c157d7d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:56.741961 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2b2eadbf-18a7-4e33-b505-2ec83c157d7d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 3a12492e-7860-4786-a695-48505e2c1840] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:56.748865 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2b2eadbf-18a7-4e33-b505-2ec83c157d7d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:56.749726 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2b2eadbf-18a7-4e33-b505-2ec83c157d7d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:56.750820 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2b2eadbf-18a7-4e33-b505-2ec83c157d7d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:56.751270 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2b2eadbf-18a7-4e33-b505-2ec83c157d7d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:56.782272 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:03:56.949040 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2b2eadbf-18a7-4e33-b505-2ec83c157d7d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:56.956867 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2b2eadbf-18a7-4e33-b505-2ec83c157d7d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840" status: 200 len: 1512 microversion: 2.1 time: 0.220482 Jun 10 18:03:56.957906 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1038/2074] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:56 2022] GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840 => generated 1512 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:56.972974 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-4dd81824-3042-493b-94c5-5df13bc257db req-f813a27c-3a90-4c8c-928e-7cb6e747f342 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aba801d8-0f5d-49d2-9d2a-be6a81cee5e7", "name": "network-vif-plugged", "status": "completed", "tag": "d0cb7524-3ee3-4919-bc48-4155f7dfa94d"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:56.982513 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-4dd81824-3042-493b-94c5-5df13bc257db req-f813a27c-3a90-4c8c-928e-7cb6e747f342 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:56.982971 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-4dd81824-3042-493b-94c5-5df13bc257db req-f813a27c-3a90-4c8c-928e-7cb6e747f342 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:56.996226 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-4dd81824-3042-493b-94c5-5df13bc257db req-f813a27c-3a90-4c8c-928e-7cb6e747f342 service nova] Creating event network-vif-plugged:d0cb7524-3ee3-4919-bc48-4155f7dfa94d for instance aba801d8-0f5d-49d2-9d2a-be6a81cee5e7 on chh2-master-2 Jun 10 18:03:57.002738 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-4dd81824-3042-493b-94c5-5df13bc257db req-f813a27c-3a90-4c8c-928e-7cb6e747f342 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033656 Jun 10 18:03:57.004548 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1039/2075] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:03:57.093997 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-31ca2dc7-9d31-4036-901f-a597dc1509e7 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:03:57.094460 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-31ca2dc7-9d31-4036-901f-a597dc1509e7 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:03:57.094940 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-31ca2dc7-9d31-4036-901f-a597dc1509e7 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:03:57.095663 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-31ca2dc7-9d31-4036-901f-a597dc1509e7 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:03:57.096265 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-31ca2dc7-9d31-4036-901f-a597dc1509e7 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:03:57.106480 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-31ca2dc7-9d31-4036-901f-a597dc1509e7 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:57.106953 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-31ca2dc7-9d31-4036-901f-a597dc1509e7 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:57.107999 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-31ca2dc7-9d31-4036-901f-a597dc1509e7 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:57.108540 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-31ca2dc7-9d31-4036-901f-a597dc1509e7 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:57.127355 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-31ca2dc7-9d31-4036-901f-a597dc1509e7 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Getting quotas for project 304a5340852d4552a490e874dda8a0a3. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:03:57.133080 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-31ca2dc7-9d31-4036-901f-a597dc1509e7 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Getting quotas for user 7278ccddeee3495583093603a0fdb626 and project 304a5340852d4552a490e874dda8a0a3. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:03:57.146825 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-31ca2dc7-9d31-4036-901f-a597dc1509e7 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:03:57.149184 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-31ca2dc7-9d31-4036-901f-a597dc1509e7 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: 69ff0893-3da5-487f-8cb6-25763b854eaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:03:57.257105 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-dcf97705-f29e-4715-9ade-95744454850a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:57.259083 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-dcf97705-f29e-4715-9ade-95744454850a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:57.266627 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dcf97705-f29e-4715-9ade-95744454850a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:57.267353 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dcf97705-f29e-4715-9ade-95744454850a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:57.268150 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dcf97705-f29e-4715-9ade-95744454850a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:57.268653 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dcf97705-f29e-4715-9ade-95744454850a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:57.295861 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-31ca2dc7-9d31-4036-901f-a597dc1509e7 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.909498 Jun 10 18:03:57.297349 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1037/2076] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:03:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:03:57.318337 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4009e130-ac1e-4935-9494-c3e62d07254a tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:57.320614 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4009e130-ac1e-4935-9494-c3e62d07254a tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: 69ff0893-3da5-487f-8cb6-25763b854eaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:57.405368 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4009e130-ac1e-4935-9494-c3e62d07254a tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:57.424378 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4009e130-ac1e-4935-9494-c3e62d07254a tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa" status: 200 len: 1216 microversion: 2.1 time: 0.117510 Jun 10 18:03:57.425332 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1038/2077] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:57 2022] GET /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa => generated 1216 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:03:57.430110 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f6e6396f-fb96-42b7-bdff-6b91437f29bb tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:57.430717 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f6e6396f-fb96-42b7-bdff-6b91437f29bb tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:57.439661 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f6e6396f-fb96-42b7-bdff-6b91437f29bb tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:57.440120 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f6e6396f-fb96-42b7-bdff-6b91437f29bb tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:57.440945 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f6e6396f-fb96-42b7-bdff-6b91437f29bb tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:57.441388 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f6e6396f-fb96-42b7-bdff-6b91437f29bb tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:57.757153 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f6e6396f-fb96-42b7-bdff-6b91437f29bb tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:57.766340 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f6e6396f-fb96-42b7-bdff-6b91437f29bb tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1199 microversion: 2.1 time: 0.339835 Jun 10 18:03:57.775916 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1039/2078] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:57 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1199 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:57.780971 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-305e2dba-da56-4abe-8350-db98d06602eb tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:57.781780 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-305e2dba-da56-4abe-8350-db98d06602eb tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:57.790067 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-305e2dba-da56-4abe-8350-db98d06602eb tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:57.790783 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-305e2dba-da56-4abe-8350-db98d06602eb tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:57.791887 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-305e2dba-da56-4abe-8350-db98d06602eb tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:57.795946 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-305e2dba-da56-4abe-8350-db98d06602eb tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:57.849039 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-dcf97705-f29e-4715-9ade-95744454850a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:57.857727 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-dcf97705-f29e-4715-9ade-95744454850a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1476 microversion: 2.1 time: 0.605491 Jun 10 18:03:57.858652 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1040/2079] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:57 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1476 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:03:57.879440 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0b24eb53-c95c-4268-bcb3-c8a84c40bd48 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:57.881950 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0b24eb53-c95c-4268-bcb3-c8a84c40bd48 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] [instance: ca923f2e-f40e-4c7c-bede-58ab9cda2763] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:57.902035 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0b24eb53-c95c-4268-bcb3-c8a84c40bd48 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:57.905838 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0b24eb53-c95c-4268-bcb3-c8a84c40bd48 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:57.905838 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0b24eb53-c95c-4268-bcb3-c8a84c40bd48 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:57.905838 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0b24eb53-c95c-4268-bcb3-c8a84c40bd48 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:58.042051 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-305e2dba-da56-4abe-8350-db98d06602eb tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8eb46cd9bd428b9f144077f3d7ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a513641ffb46b091bb50e7b247e9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:58.049863 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-305e2dba-da56-4abe-8350-db98d06602eb tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "GET /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d" status: 200 len: 1526 microversion: 2.1 time: 0.272568 Jun 10 18:03:58.050680 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1040/2080] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:57 2022] GET /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d => generated 1526 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:58.055390 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4a73e077-1a01-4f3f-8232-104c4cc11f7e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:58.056208 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4a73e077-1a01-4f3f-8232-104c4cc11f7e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 3a12492e-7860-4786-a695-48505e2c1840] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:58.063039 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:03:58.068229 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a73e077-1a01-4f3f-8232-104c4cc11f7e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:58.072519 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a73e077-1a01-4f3f-8232-104c4cc11f7e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:58.072519 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a73e077-1a01-4f3f-8232-104c4cc11f7e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:58.072519 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a73e077-1a01-4f3f-8232-104c4cc11f7e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:58.248184 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4a73e077-1a01-4f3f-8232-104c4cc11f7e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:58.259819 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4a73e077-1a01-4f3f-8232-104c4cc11f7e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840" status: 200 len: 1512 microversion: 2.1 time: 0.207864 Jun 10 18:03:58.265276 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1041/2081] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:58 2022] GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840 => generated 1512 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:58.326404 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0b24eb53-c95c-4268-bcb3-c8a84c40bd48 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be318f01fac5459cb4d0f55cf374824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:58.335305 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0b24eb53-c95c-4268-bcb3-c8a84c40bd48 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "GET /compute/v2.1/servers/ca923f2e-f40e-4c7c-bede-58ab9cda2763" status: 200 len: 1323 microversion: 2.1 time: 0.474403 Jun 10 18:03:58.336277 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1041/2082] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:57 2022] GET /compute/v2.1/servers/ca923f2e-f40e-4c7c-bede-58ab9cda2763 => generated 1323 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:58.445184 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dabf75e2-7d9a-4944-a750-c0e18da81734 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:58.445815 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dabf75e2-7d9a-4944-a750-c0e18da81734 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: 69ff0893-3da5-487f-8cb6-25763b854eaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:58.561201 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-dabf75e2-7d9a-4944-a750-c0e18da81734 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:58.570276 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dabf75e2-7d9a-4944-a750-c0e18da81734 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa" status: 200 len: 1216 microversion: 2.1 time: 0.131238 Jun 10 18:03:58.570902 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1042/2083] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:58 2022] GET /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa => generated 1216 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:58.777173 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-873c3d53-ff23-4f12-aad2-c1876afee345 req-7b31948c-f0ed-4956-a612-b3f12c7213a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d", "name": "network-vif-deleted", "tag": "f445eab9-755e-4cb4-8b43-362aa57d1ab2"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:58.782616 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-892c17b1-59e9-4c55-8bf3-52577bae283d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:58.783230 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-892c17b1-59e9-4c55-8bf3-52577bae283d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:58.798889 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-892c17b1-59e9-4c55-8bf3-52577bae283d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:58.799142 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-873c3d53-ff23-4f12-aad2-c1876afee345 req-7b31948c-f0ed-4956-a612-b3f12c7213a1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:58.799374 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-873c3d53-ff23-4f12-aad2-c1876afee345 req-7b31948c-f0ed-4956-a612-b3f12c7213a1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:58.799910 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-892c17b1-59e9-4c55-8bf3-52577bae283d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:58.800884 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-892c17b1-59e9-4c55-8bf3-52577bae283d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:58.801488 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-892c17b1-59e9-4c55-8bf3-52577bae283d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:58.841020 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-873c3d53-ff23-4f12-aad2-c1876afee345 req-7b31948c-f0ed-4956-a612-b3f12c7213a1 service nova] Creating event network-vif-deleted:f445eab9-755e-4cb4-8b43-362aa57d1ab2 for instance d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d on chh1-master-2 Jun 10 18:03:58.853038 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-873c3d53-ff23-4f12-aad2-c1876afee345 req-7b31948c-f0ed-4956-a612-b3f12c7213a1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079431 Jun 10 18:03:58.860522 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1042/2084] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:03:58.886878 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-039c56f3-40b2-4bcb-8709-15934a167073 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:58.887965 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-039c56f3-40b2-4bcb-8709-15934a167073 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:58.895644 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-039c56f3-40b2-4bcb-8709-15934a167073 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:58.896605 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-039c56f3-40b2-4bcb-8709-15934a167073 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:58.897690 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-039c56f3-40b2-4bcb-8709-15934a167073 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:58.898136 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-039c56f3-40b2-4bcb-8709-15934a167073 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:59.075307 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-892c17b1-59e9-4c55-8bf3-52577bae283d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:59.075307 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:03:59.087143 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-892c17b1-59e9-4c55-8bf3-52577bae283d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1199 microversion: 2.1 time: 0.308142 Jun 10 18:03:59.088495 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1043/2085] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:58 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1199 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:03:59.100820 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-385006d8-9ae3-4b73-9c2e-c0aaf16b7166 req-1bc0a9b5-7282-4a64-9a0f-b21f5bb02d12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca923f2e-f40e-4c7c-bede-58ab9cda2763", "name": "network-vif-plugged", "status": "completed", "tag": "3929a812-05d7-4ecf-be86-c63b4062608d"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:03:59.122322 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-385006d8-9ae3-4b73-9c2e-c0aaf16b7166 req-1bc0a9b5-7282-4a64-9a0f-b21f5bb02d12 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:59.122788 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-385006d8-9ae3-4b73-9c2e-c0aaf16b7166 req-1bc0a9b5-7282-4a64-9a0f-b21f5bb02d12 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:59.148538 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-385006d8-9ae3-4b73-9c2e-c0aaf16b7166 req-1bc0a9b5-7282-4a64-9a0f-b21f5bb02d12 service nova] Creating event network-vif-plugged:3929a812-05d7-4ecf-be86-c63b4062608d for instance ca923f2e-f40e-4c7c-bede-58ab9cda2763 on chh1-master-2 Jun 10 18:03:59.164071 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-385006d8-9ae3-4b73-9c2e-c0aaf16b7166 req-1bc0a9b5-7282-4a64-9a0f-b21f5bb02d12 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069953 Jun 10 18:03:59.164736 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1044/2086] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:03:59.172490 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ad9d6b2e-10bf-4899-bcaa-8784f15343af tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:59.173534 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ad9d6b2e-10bf-4899-bcaa-8784f15343af tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:59.194836 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad9d6b2e-10bf-4899-bcaa-8784f15343af tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:59.195402 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad9d6b2e-10bf-4899-bcaa-8784f15343af tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:59.210872 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad9d6b2e-10bf-4899-bcaa-8784f15343af tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:59.223092 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad9d6b2e-10bf-4899-bcaa-8784f15343af tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:59.295564 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad9d6b2e-10bf-4899-bcaa-8784f15343af tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:59.296113 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad9d6b2e-10bf-4899-bcaa-8784f15343af tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:59.296871 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-ad9d6b2e-10bf-4899-bcaa-8784f15343af tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lazy-loading 'fault' on Instance uuid d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:03:59.399841 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-039c56f3-40b2-4bcb-8709-15934a167073 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:59.402628 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ad9d6b2e-10bf-4899-bcaa-8784f15343af tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b8eb46cd9bd428b9f144077f3d7ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a513641ffb46b091bb50e7b247e9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:59.419765 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ad9d6b2e-10bf-4899-bcaa-8784f15343af tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "GET /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d" status: 200 len: 1314 microversion: 2.1 time: 0.251281 Jun 10 18:03:59.420511 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1045/2087] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:59 2022] GET /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:59.421511 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-039c56f3-40b2-4bcb-8709-15934a167073 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1476 microversion: 2.1 time: 0.541876 Jun 10 18:03:59.422210 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1043/2088] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:58 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1476 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:59.429435 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8477a0d7-09c2-4b6e-81e1-181413d1e4c5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:59.431534 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8477a0d7-09c2-4b6e-81e1-181413d1e4c5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 3a12492e-7860-4786-a695-48505e2c1840] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:59.433844 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d5f6eef0-4361-41aa-b411-e8e1962daa84 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:59.434496 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d5f6eef0-4361-41aa-b411-e8e1962daa84 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] [instance: ca923f2e-f40e-4c7c-bede-58ab9cda2763] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:59.441071 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d5f6eef0-4361-41aa-b411-e8e1962daa84 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:59.441743 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d5f6eef0-4361-41aa-b411-e8e1962daa84 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:59.442917 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d5f6eef0-4361-41aa-b411-e8e1962daa84 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:59.443533 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d5f6eef0-4361-41aa-b411-e8e1962daa84 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:59.457782 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8477a0d7-09c2-4b6e-81e1-181413d1e4c5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:59.459023 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8477a0d7-09c2-4b6e-81e1-181413d1e4c5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:59.462231 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8477a0d7-09c2-4b6e-81e1-181413d1e4c5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:59.462231 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8477a0d7-09c2-4b6e-81e1-181413d1e4c5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:59.660323 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8477a0d7-09c2-4b6e-81e1-181413d1e4c5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:59.677525 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8477a0d7-09c2-4b6e-81e1-181413d1e4c5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840" status: 200 len: 1512 microversion: 2.1 time: 0.255938 Jun 10 18:03:59.688237 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1046/2089] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:59 2022] GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840 => generated 1512 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:59.693925 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e32c8914-eea1-4cb8-9585-2349c6b8ba49 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:03:59.695015 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e32c8914-eea1-4cb8-9585-2349c6b8ba49 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: 69ff0893-3da5-487f-8cb6-25763b854eaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:03:59.706056 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e32c8914-eea1-4cb8-9585-2349c6b8ba49 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:59.706873 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e32c8914-eea1-4cb8-9585-2349c6b8ba49 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:59.708267 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e32c8914-eea1-4cb8-9585-2349c6b8ba49 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:03:59.709558 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e32c8914-eea1-4cb8-9585-2349c6b8ba49 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:03:59.780799 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d5f6eef0-4361-41aa-b411-e8e1962daa84 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be318f01fac5459cb4d0f55cf374824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:59.789820 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d5f6eef0-4361-41aa-b411-e8e1962daa84 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "GET /compute/v2.1/servers/ca923f2e-f40e-4c7c-bede-58ab9cda2763" status: 200 len: 1323 microversion: 2.1 time: 0.366290 Jun 10 18:03:59.790417 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1044/2090] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:59 2022] GET /compute/v2.1/servers/ca923f2e-f40e-4c7c-bede-58ab9cda2763 => generated 1323 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:03:59.791985 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e32c8914-eea1-4cb8-9585-2349c6b8ba49 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:03:59.800659 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e32c8914-eea1-4cb8-9585-2349c6b8ba49 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa" status: 200 len: 1212 microversion: 2.1 time: 0.111022 Jun 10 18:03:59.801656 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1047/2091] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:03:59 2022] GET /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa => generated 1212 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:00.107258 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-87debe8d-0a62-4d4c-914c-2898b2f0e4a1 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:00.107890 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-87debe8d-0a62-4d4c-914c-2898b2f0e4a1 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:00.115986 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-87debe8d-0a62-4d4c-914c-2898b2f0e4a1 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:00.115986 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-87debe8d-0a62-4d4c-914c-2898b2f0e4a1 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:00.116472 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-87debe8d-0a62-4d4c-914c-2898b2f0e4a1 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:00.116875 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-87debe8d-0a62-4d4c-914c-2898b2f0e4a1 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:00.267769 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-87debe8d-0a62-4d4c-914c-2898b2f0e4a1 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:00.277273 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-87debe8d-0a62-4d4c-914c-2898b2f0e4a1 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1199 microversion: 2.1 time: 0.173452 Jun 10 18:04:00.278181 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1045/2092] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:00 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1199 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:04:00.439625 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-94f3c304-e763-4505-a022-15ad72b311d2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:00.440268 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a26b5cff-f07a-4f25-8685-42b86806a495 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:00.440535 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-94f3c304-e763-4505-a022-15ad72b311d2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:00.441483 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a26b5cff-f07a-4f25-8685-42b86806a495 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] [instance: d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:00.451376 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-94f3c304-e763-4505-a022-15ad72b311d2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:00.451946 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a26b5cff-f07a-4f25-8685-42b86806a495 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:00.452230 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-94f3c304-e763-4505-a022-15ad72b311d2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:00.452829 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a26b5cff-f07a-4f25-8685-42b86806a495 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:00.453951 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a26b5cff-f07a-4f25-8685-42b86806a495 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:00.454090 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-94f3c304-e763-4505-a022-15ad72b311d2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:00.454540 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-94f3c304-e763-4505-a022-15ad72b311d2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:00.454657 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a26b5cff-f07a-4f25-8685-42b86806a495 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:00.479719 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-a26b5cff-f07a-4f25-8685-42b86806a495 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] HTTP exception thrown: Instance d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d could not be found. Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a26b5cff-f07a-4f25-8685-42b86806a495 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Request method failure captured: Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d HTTP/1.1 Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4c6bKMPdoW6JM5vPU7sJZ9EKw5p_e5Nn3TIwZ8taSXQ0t9p_7pNjb_r4YMAZes9OZCJmuEzQc2x42I-9bQXq5Xrgtdtt86trEaDPwcjLqJL5CIujPL4LPvif1K6JTifq-zjls-ga-WpuFiPpsn6IHLrl-UWVmD-CrCEEjjieM48Bpk Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: b4a513641ffb46b091bb50e7b247e9a4 Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-230132700 Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/b4a513641ffb46b091bb50e7b247e9a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/b4a513641ffb46b091bb50e7b247e9a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/b4a513641ffb46b091bb50e7b247e9a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_b4a513641ffb46b091bb50e7b247e9a4", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-230132700 Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: b4a513641ffb46b091bb50e7b247e9a4 Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-230132700 Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-FloatingIPsAssociationTestJSON-230132700-project Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 5b8eb46cd9bd428b9f144077f3d7ed9f Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-230132700-project Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: exception: Instance d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d could not be found. Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'd7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d'} Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d could not be found. Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d could not be found. Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:00.482472 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:00.490851 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:00.490851 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:00.490851 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:04:00.490851 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:04:00.490851 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:04:00.490851 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:04:00.490851 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d could not be found. Jun 10 18:04:00.490851 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:00.490851 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a26b5cff-f07a-4f25-8685-42b86806a495 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] Returning 404 to user: Instance d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:04:00.493751 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a26b5cff-f07a-4f25-8685-42b86806a495 tempest-FloatingIPsAssociationTestJSON-230132700 tempest-FloatingIPsAssociationTestJSON-230132700-project] 10.222.0.35 "GET /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d" status: 404 len: 111 microversion: 2.1 time: 0.057430 Jun 10 18:04:00.499145 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1048/2093] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:00 2022] GET /compute/v2.1/servers/d7e79bcd-b213-45f7-a7a5-eb6c9aa78c8d => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:04:00.694760 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ffc6f18b-da51-40a9-831b-f0faeb0fc778 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:00.695375 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ffc6f18b-da51-40a9-831b-f0faeb0fc778 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 3a12492e-7860-4786-a695-48505e2c1840] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:00.717450 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ffc6f18b-da51-40a9-831b-f0faeb0fc778 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:00.721326 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ffc6f18b-da51-40a9-831b-f0faeb0fc778 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:00.723208 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ffc6f18b-da51-40a9-831b-f0faeb0fc778 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:00.726096 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ffc6f18b-da51-40a9-831b-f0faeb0fc778 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:00.857387 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-94f3c304-e763-4505-a022-15ad72b311d2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:00.874489 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-94f3c304-e763-4505-a022-15ad72b311d2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1476 microversion: 2.1 time: 0.438433 Jun 10 18:04:00.878118 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1046/2094] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:00 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1476 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:00.885361 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cce2a2f8-46ef-4f6a-967c-0f307e9ed72e tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:00.887191 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cce2a2f8-46ef-4f6a-967c-0f307e9ed72e tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] [instance: ca923f2e-f40e-4c7c-bede-58ab9cda2763] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:00.898032 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cce2a2f8-46ef-4f6a-967c-0f307e9ed72e tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:00.898714 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cce2a2f8-46ef-4f6a-967c-0f307e9ed72e tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:00.900051 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cce2a2f8-46ef-4f6a-967c-0f307e9ed72e tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:00.901317 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cce2a2f8-46ef-4f6a-967c-0f307e9ed72e tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:00.974141 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ffc6f18b-da51-40a9-831b-f0faeb0fc778 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:00.987436 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ffc6f18b-da51-40a9-831b-f0faeb0fc778 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840" status: 200 len: 1512 microversion: 2.1 time: 0.296505 Jun 10 18:04:00.989783 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1049/2095] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:00 2022] GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840 => generated 1512 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:00.995031 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f412ad0f-f022-4865-b97f-bdc357687ab3 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:00.996036 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f412ad0f-f022-4865-b97f-bdc357687ab3 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: 69ff0893-3da5-487f-8cb6-25763b854eaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:01.003403 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f412ad0f-f022-4865-b97f-bdc357687ab3 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:01.004077 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f412ad0f-f022-4865-b97f-bdc357687ab3 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:01.005036 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f412ad0f-f022-4865-b97f-bdc357687ab3 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:01.005650 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f412ad0f-f022-4865-b97f-bdc357687ab3 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:01.104247 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f412ad0f-f022-4865-b97f-bdc357687ab3 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:01.115240 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f412ad0f-f022-4865-b97f-bdc357687ab3 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa" status: 200 len: 1276 microversion: 2.1 time: 0.124196 Jun 10 18:04:01.116146 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1050/2096] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:00 2022] GET /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa => generated 1276 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:01.296008 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ad6e4497-4528-47ef-a9bb-1bfda853f7f6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:01.296918 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ad6e4497-4528-47ef-a9bb-1bfda853f7f6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:01.306400 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad6e4497-4528-47ef-a9bb-1bfda853f7f6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:01.307167 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad6e4497-4528-47ef-a9bb-1bfda853f7f6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:01.308219 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad6e4497-4528-47ef-a9bb-1bfda853f7f6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:01.308762 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad6e4497-4528-47ef-a9bb-1bfda853f7f6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:01.361633 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cce2a2f8-46ef-4f6a-967c-0f307e9ed72e tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be318f01fac5459cb4d0f55cf374824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:01.373537 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cce2a2f8-46ef-4f6a-967c-0f307e9ed72e tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "GET /compute/v2.1/servers/ca923f2e-f40e-4c7c-bede-58ab9cda2763" status: 200 len: 1323 microversion: 2.1 time: 0.493573 Jun 10 18:04:01.379989 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1047/2097] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:00 2022] GET /compute/v2.1/servers/ca923f2e-f40e-4c7c-bede-58ab9cda2763 => generated 1323 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:01.529438 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ad6e4497-4528-47ef-a9bb-1bfda853f7f6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:01.542030 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ad6e4497-4528-47ef-a9bb-1bfda853f7f6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1199 microversion: 2.1 time: 0.251120 Jun 10 18:04:01.542964 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1051/2098] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:01 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1199 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:04:01.687201 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-1ee68ed1-31aa-4d8b-9b14-39e0f4b1ad97 req-e5eec2da-9517-46b7-86fd-150dec1c943f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07e79e24-76e1-476b-b064-a6729174e2ff", "name": "network-vif-plugged", "status": "completed", "tag": "2fd4d2ca-7508-415a-9af1-7f4ff48d0061"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:01.696199 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-1ee68ed1-31aa-4d8b-9b14-39e0f4b1ad97 req-e5eec2da-9517-46b7-86fd-150dec1c943f service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:01.696947 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-1ee68ed1-31aa-4d8b-9b14-39e0f4b1ad97 req-e5eec2da-9517-46b7-86fd-150dec1c943f service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:01.714300 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-1ee68ed1-31aa-4d8b-9b14-39e0f4b1ad97 req-e5eec2da-9517-46b7-86fd-150dec1c943f service nova] Creating event network-vif-plugged:2fd4d2ca-7508-415a-9af1-7f4ff48d0061 for instance 07e79e24-76e1-476b-b064-a6729174e2ff on chh2-master-2 Jun 10 18:04:01.720092 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-1ee68ed1-31aa-4d8b-9b14-39e0f4b1ad97 req-e5eec2da-9517-46b7-86fd-150dec1c943f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036512 Jun 10 18:04:01.721336 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1048/2099] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:01.896718 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-192cbd7a-5580-46bc-888c-dd3aea48b988 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:01.898173 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-192cbd7a-5580-46bc-888c-dd3aea48b988 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:01.923418 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-192cbd7a-5580-46bc-888c-dd3aea48b988 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:01.923418 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-192cbd7a-5580-46bc-888c-dd3aea48b988 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:01.923418 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-192cbd7a-5580-46bc-888c-dd3aea48b988 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:01.923418 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-192cbd7a-5580-46bc-888c-dd3aea48b988 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:02.006234 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-050645de-e8ec-49d9-85c2-e0a3072b7323 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:02.007304 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-050645de-e8ec-49d9-85c2-e0a3072b7323 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 3a12492e-7860-4786-a695-48505e2c1840] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:02.029197 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-050645de-e8ec-49d9-85c2-e0a3072b7323 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:02.029197 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-050645de-e8ec-49d9-85c2-e0a3072b7323 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:02.029197 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-050645de-e8ec-49d9-85c2-e0a3072b7323 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:02.029197 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-050645de-e8ec-49d9-85c2-e0a3072b7323 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:02.120202 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-192cbd7a-5580-46bc-888c-dd3aea48b988 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:02.132435 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-192cbd7a-5580-46bc-888c-dd3aea48b988 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1476 microversion: 2.1 time: 0.242778 Jun 10 18:04:02.144415 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1052/2100] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:01 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1476 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:02.144415 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-30d46d4d-9b2d-44a9-82cf-8c6b3d5c177d tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:02.144415 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-30d46d4d-9b2d-44a9-82cf-8c6b3d5c177d tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: 69ff0893-3da5-487f-8cb6-25763b854eaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:02.148879 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30d46d4d-9b2d-44a9-82cf-8c6b3d5c177d tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:02.149281 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30d46d4d-9b2d-44a9-82cf-8c6b3d5c177d tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:02.150078 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30d46d4d-9b2d-44a9-82cf-8c6b3d5c177d tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:02.150564 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30d46d4d-9b2d-44a9-82cf-8c6b3d5c177d tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:02.226163 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-30d46d4d-9b2d-44a9-82cf-8c6b3d5c177d tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:02.243015 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-30d46d4d-9b2d-44a9-82cf-8c6b3d5c177d tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa" status: 200 len: 1274 microversion: 2.1 time: 0.105798 Jun 10 18:04:02.245511 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1053/2101] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:02 2022] GET /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa => generated 1274 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:02.397253 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-230cd1b3-d7dc-47ae-9d1a-76c3907e22a1 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:02.398027 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-230cd1b3-d7dc-47ae-9d1a-76c3907e22a1 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] [instance: ca923f2e-f40e-4c7c-bede-58ab9cda2763] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:02.411416 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-230cd1b3-d7dc-47ae-9d1a-76c3907e22a1 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:02.411416 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-230cd1b3-d7dc-47ae-9d1a-76c3907e22a1 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:02.411416 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-230cd1b3-d7dc-47ae-9d1a-76c3907e22a1 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:02.411416 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-230cd1b3-d7dc-47ae-9d1a-76c3907e22a1 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:02.491539 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-050645de-e8ec-49d9-85c2-e0a3072b7323 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:02.506121 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-050645de-e8ec-49d9-85c2-e0a3072b7323 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840" status: 200 len: 1512 microversion: 2.1 time: 0.504256 Jun 10 18:04:02.506874 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1049/2102] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:02 2022] GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840 => generated 1512 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:02.560110 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-17de4295-8a3a-44bc-87f2-6e456f8da8fd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:02.561138 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-17de4295-8a3a-44bc-87f2-6e456f8da8fd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:02.578561 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-17de4295-8a3a-44bc-87f2-6e456f8da8fd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:02.579400 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-17de4295-8a3a-44bc-87f2-6e456f8da8fd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:02.580501 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-17de4295-8a3a-44bc-87f2-6e456f8da8fd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:02.581327 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-17de4295-8a3a-44bc-87f2-6e456f8da8fd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:02.587446 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-230cd1b3-d7dc-47ae-9d1a-76c3907e22a1 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be318f01fac5459cb4d0f55cf374824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:02.602075 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-230cd1b3-d7dc-47ae-9d1a-76c3907e22a1 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "GET /compute/v2.1/servers/ca923f2e-f40e-4c7c-bede-58ab9cda2763" status: 200 len: 1515 microversion: 2.1 time: 0.208399 Jun 10 18:04:02.602857 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1054/2103] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:02 2022] GET /compute/v2.1/servers/ca923f2e-f40e-4c7c-bede-58ab9cda2763 => generated 1515 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:04:02.621807 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d3e4c4b4-c3aa-4874-a326-b56b20e7c890 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:02.622494 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d3e4c4b4-c3aa-4874-a326-b56b20e7c890 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] [instance: 07e79e24-76e1-476b-b064-a6729174e2ff] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:02.630079 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d3e4c4b4-c3aa-4874-a326-b56b20e7c890 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:02.630079 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d3e4c4b4-c3aa-4874-a326-b56b20e7c890 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:02.631827 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d3e4c4b4-c3aa-4874-a326-b56b20e7c890 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:02.632369 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d3e4c4b4-c3aa-4874-a326-b56b20e7c890 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:02.849020 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d3e4c4b4-c3aa-4874-a326-b56b20e7c890 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be318f01fac5459cb4d0f55cf374824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:02.857035 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d3e4c4b4-c3aa-4874-a326-b56b20e7c890 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "GET /compute/v2.1/servers/07e79e24-76e1-476b-b064-a6729174e2ff" status: 200 len: 1323 microversion: 2.1 time: 0.242288 Jun 10 18:04:02.869258 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1055/2104] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:02 2022] GET /compute/v2.1/servers/07e79e24-76e1-476b-b064-a6729174e2ff => generated 1323 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:02.967057 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-17de4295-8a3a-44bc-87f2-6e456f8da8fd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:02.975891 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-17de4295-8a3a-44bc-87f2-6e456f8da8fd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1199 microversion: 2.1 time: 0.420330 Jun 10 18:04:02.976767 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1050/2105] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:02 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1199 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:04:03.152338 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8d5da7a1-0ec5-4d9d-99a5-2ed5904ffbc1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:03.152954 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8d5da7a1-0ec5-4d9d-99a5-2ed5904ffbc1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:03.162078 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8d5da7a1-0ec5-4d9d-99a5-2ed5904ffbc1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:03.163483 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8d5da7a1-0ec5-4d9d-99a5-2ed5904ffbc1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:03.164432 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8d5da7a1-0ec5-4d9d-99a5-2ed5904ffbc1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:03.164868 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8d5da7a1-0ec5-4d9d-99a5-2ed5904ffbc1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:03.262375 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-092e8b4b-f569-407f-9eef-54f4a1d2b629 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:03.263596 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-092e8b4b-f569-407f-9eef-54f4a1d2b629 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: 69ff0893-3da5-487f-8cb6-25763b854eaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:03.279983 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-092e8b4b-f569-407f-9eef-54f4a1d2b629 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:03.282501 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-092e8b4b-f569-407f-9eef-54f4a1d2b629 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:03.286361 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-092e8b4b-f569-407f-9eef-54f4a1d2b629 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:03.288241 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-092e8b4b-f569-407f-9eef-54f4a1d2b629 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:03.472659 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-092e8b4b-f569-407f-9eef-54f4a1d2b629 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:03.483513 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-092e8b4b-f569-407f-9eef-54f4a1d2b629 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa" status: 200 len: 1274 microversion: 2.1 time: 0.226804 Jun 10 18:04:03.490828 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1051/2106] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:03 2022] GET /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa => generated 1274 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:03.523979 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ca4e2c93-7999-4c93-9878-afce991beac5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:03.525024 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ca4e2c93-7999-4c93-9878-afce991beac5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 3a12492e-7860-4786-a695-48505e2c1840] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:03.533385 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8d5da7a1-0ec5-4d9d-99a5-2ed5904ffbc1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:03.546277 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8d5da7a1-0ec5-4d9d-99a5-2ed5904ffbc1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1476 microversion: 2.1 time: 0.397813 Jun 10 18:04:03.547025 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ca4e2c93-7999-4c93-9878-afce991beac5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:03.547284 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1056/2107] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:03 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1476 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:03.553763 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ca4e2c93-7999-4c93-9878-afce991beac5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:03.555383 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ca4e2c93-7999-4c93-9878-afce991beac5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:03.556049 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ca4e2c93-7999-4c93-9878-afce991beac5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:03.875608 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-69c148ba-bb82-46cd-bdea-93f3bc8cc821 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:03.877089 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-69c148ba-bb82-46cd-bdea-93f3bc8cc821 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] [instance: 07e79e24-76e1-476b-b064-a6729174e2ff] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:03.890830 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-69c148ba-bb82-46cd-bdea-93f3bc8cc821 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:03.891882 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-69c148ba-bb82-46cd-bdea-93f3bc8cc821 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:03.895997 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-69c148ba-bb82-46cd-bdea-93f3bc8cc821 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:03.897114 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-69c148ba-bb82-46cd-bdea-93f3bc8cc821 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:03.963204 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ca4e2c93-7999-4c93-9878-afce991beac5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:03.981191 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ca4e2c93-7999-4c93-9878-afce991beac5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840" status: 200 len: 1512 microversion: 2.1 time: 0.461443 Jun 10 18:04:03.981976 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1052/2108] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:03 2022] GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840 => generated 1512 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:04:04.006238 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bcf201cd-b3f6-46b6-9575-034b3be88c07 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:04.006864 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bcf201cd-b3f6-46b6-9575-034b3be88c07 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:04.018902 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bcf201cd-b3f6-46b6-9575-034b3be88c07 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:04.019397 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bcf201cd-b3f6-46b6-9575-034b3be88c07 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:04.020200 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bcf201cd-b3f6-46b6-9575-034b3be88c07 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:04.020676 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bcf201cd-b3f6-46b6-9575-034b3be88c07 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:04.315070 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-69c148ba-bb82-46cd-bdea-93f3bc8cc821 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be318f01fac5459cb4d0f55cf374824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:04.324137 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-69c148ba-bb82-46cd-bdea-93f3bc8cc821 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "GET /compute/v2.1/servers/07e79e24-76e1-476b-b064-a6729174e2ff" status: 200 len: 1323 microversion: 2.1 time: 0.452723 Jun 10 18:04:04.334404 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1057/2109] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:03 2022] GET /compute/v2.1/servers/07e79e24-76e1-476b-b064-a6729174e2ff => generated 1323 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:04.502857 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3325f5aa-b6dd-461f-862f-2518673edef9 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:04.503551 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3325f5aa-b6dd-461f-862f-2518673edef9 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: 69ff0893-3da5-487f-8cb6-25763b854eaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:04.511372 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3325f5aa-b6dd-461f-862f-2518673edef9 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:04.512058 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3325f5aa-b6dd-461f-862f-2518673edef9 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:04.513070 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3325f5aa-b6dd-461f-862f-2518673edef9 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:04.513506 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3325f5aa-b6dd-461f-862f-2518673edef9 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:04.538887 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bcf201cd-b3f6-46b6-9575-034b3be88c07 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:04.551004 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bcf201cd-b3f6-46b6-9575-034b3be88c07 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1199 microversion: 2.1 time: 0.553380 Jun 10 18:04:04.560508 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1053/2110] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:03 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1199 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:04.577904 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-23909fdd-cec6-4968-8bae-1f71e0df9c07 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:04.580403 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-23909fdd-cec6-4968-8bae-1f71e0df9c07 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:04.589160 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-23909fdd-cec6-4968-8bae-1f71e0df9c07 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:04.589887 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-23909fdd-cec6-4968-8bae-1f71e0df9c07 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:04.590855 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-23909fdd-cec6-4968-8bae-1f71e0df9c07 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:04.593240 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-23909fdd-cec6-4968-8bae-1f71e0df9c07 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:04.765934 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3325f5aa-b6dd-461f-862f-2518673edef9 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:04.779900 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3325f5aa-b6dd-461f-862f-2518673edef9 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa" status: 200 len: 1316 microversion: 2.1 time: 0.280756 Jun 10 18:04:04.783991 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1058/2111] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:04 2022] GET /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa => generated 1316 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:04:05.001323 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-39b3a9f2-f977-4544-9206-de2ff6af91a1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:05.001973 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-39b3a9f2-f977-4544-9206-de2ff6af91a1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 3a12492e-7860-4786-a695-48505e2c1840] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:05.008389 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-39b3a9f2-f977-4544-9206-de2ff6af91a1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:05.012512 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-39b3a9f2-f977-4544-9206-de2ff6af91a1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:05.012512 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-39b3a9f2-f977-4544-9206-de2ff6af91a1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:05.012512 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-39b3a9f2-f977-4544-9206-de2ff6af91a1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:05.035697 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-23909fdd-cec6-4968-8bae-1f71e0df9c07 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:05.090827 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-23909fdd-cec6-4968-8bae-1f71e0df9c07 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1476 microversion: 2.1 time: 0.518249 Jun 10 18:04:05.096248 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1054/2112] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:04 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1476 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:05.341855 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ca6bf6ab-e43c-478e-a35e-27a79df7a015 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:05.342647 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ca6bf6ab-e43c-478e-a35e-27a79df7a015 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] [instance: 07e79e24-76e1-476b-b064-a6729174e2ff] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:05.355396 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ca6bf6ab-e43c-478e-a35e-27a79df7a015 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:05.356885 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ca6bf6ab-e43c-478e-a35e-27a79df7a015 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:05.358028 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ca6bf6ab-e43c-478e-a35e-27a79df7a015 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:05.359426 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ca6bf6ab-e43c-478e-a35e-27a79df7a015 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:05.692816 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-39b3a9f2-f977-4544-9206-de2ff6af91a1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:05.701994 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-39b3a9f2-f977-4544-9206-de2ff6af91a1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840" status: 200 len: 1512 microversion: 2.1 time: 0.704514 Jun 10 18:04:05.706036 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1059/2113] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:04 2022] GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840 => generated 1512 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:05.712009 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ac194101-4047-404f-b4a0-cb94d0689930 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:05.715438 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ac194101-4047-404f-b4a0-cb94d0689930 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:05.735906 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ac194101-4047-404f-b4a0-cb94d0689930 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:05.736692 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ac194101-4047-404f-b4a0-cb94d0689930 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:05.737817 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ac194101-4047-404f-b4a0-cb94d0689930 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:05.740226 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ac194101-4047-404f-b4a0-cb94d0689930 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:05.983263 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ac194101-4047-404f-b4a0-cb94d0689930 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:05.991823 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ac194101-4047-404f-b4a0-cb94d0689930 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1199 microversion: 2.1 time: 0.284512 Jun 10 18:04:06.001102 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1060/2114] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:05 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1199 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:06.006316 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e14bf343-bf76-4304-b5d5-183be101c6f8 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:06.006316 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e14bf343-bf76-4304-b5d5-183be101c6f8 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: 69ff0893-3da5-487f-8cb6-25763b854eaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:06.042673 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e14bf343-bf76-4304-b5d5-183be101c6f8 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:06.044337 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e14bf343-bf76-4304-b5d5-183be101c6f8 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:06.045353 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e14bf343-bf76-4304-b5d5-183be101c6f8 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:06.046155 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e14bf343-bf76-4304-b5d5-183be101c6f8 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:06.084914 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:04:06.353386 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ca6bf6ab-e43c-478e-a35e-27a79df7a015 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be318f01fac5459cb4d0f55cf374824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:06.365832 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ca6bf6ab-e43c-478e-a35e-27a79df7a015 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "GET /compute/v2.1/servers/07e79e24-76e1-476b-b064-a6729174e2ff" status: 200 len: 1323 microversion: 2.1 time: 1.029142 Jun 10 18:04:06.375793 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1055/2115] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:05 2022] GET /compute/v2.1/servers/07e79e24-76e1-476b-b064-a6729174e2ff => generated 1323 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:04:06.387192 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-eb42c779-e15a-498b-b2c4-ec7b40a46ce0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:06.388633 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-eb42c779-e15a-498b-b2c4-ec7b40a46ce0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:06.396215 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eb42c779-e15a-498b-b2c4-ec7b40a46ce0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:06.397046 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eb42c779-e15a-498b-b2c4-ec7b40a46ce0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:06.398455 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eb42c779-e15a-498b-b2c4-ec7b40a46ce0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:06.399278 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eb42c779-e15a-498b-b2c4-ec7b40a46ce0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:06.448919 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e14bf343-bf76-4304-b5d5-183be101c6f8 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:06.456854 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e14bf343-bf76-4304-b5d5-183be101c6f8 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa" status: 200 len: 1316 microversion: 2.1 time: 0.459168 Jun 10 18:04:06.467718 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1061/2116] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:05 2022] GET /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa => generated 1316 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:06.721315 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1f06d351-58eb-4142-98b7-462668329c1b tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:06.723184 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1f06d351-58eb-4142-98b7-462668329c1b tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 3a12492e-7860-4786-a695-48505e2c1840] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:06.745274 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f06d351-58eb-4142-98b7-462668329c1b tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:06.745419 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f06d351-58eb-4142-98b7-462668329c1b tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:06.746196 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f06d351-58eb-4142-98b7-462668329c1b tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:06.746634 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f06d351-58eb-4142-98b7-462668329c1b tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:06.788063 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-eb42c779-e15a-498b-b2c4-ec7b40a46ce0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:06.796513 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-eb42c779-e15a-498b-b2c4-ec7b40a46ce0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1476 microversion: 2.1 time: 0.422678 Jun 10 18:04:06.799589 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1056/2117] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:06 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1476 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:07.012443 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-23015543-bcd1-4751-9e3d-aa02e8e5989a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:07.013075 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-23015543-bcd1-4751-9e3d-aa02e8e5989a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:07.020840 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-23015543-bcd1-4751-9e3d-aa02e8e5989a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:07.022074 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-23015543-bcd1-4751-9e3d-aa02e8e5989a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:07.026811 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-23015543-bcd1-4751-9e3d-aa02e8e5989a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:07.026811 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-23015543-bcd1-4751-9e3d-aa02e8e5989a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:07.044649 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:04:07.115793 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=22 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:04:07.198449 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1f06d351-58eb-4142-98b7-462668329c1b tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:07.215734 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1f06d351-58eb-4142-98b7-462668329c1b tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840" status: 200 len: 1512 microversion: 2.1 time: 0.500147 Jun 10 18:04:07.219201 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1062/2118] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:06 2022] GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840 => generated 1512 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:07.282017 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-bf76aec3-83fd-4275-89ad-1a838649fe03 req-426e2cc1-a39f-480b-a66f-6c7f0f87be3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69ff0893-3da5-487f-8cb6-25763b854eaa", "tag": "23377b35-13e3-460e-98a2-837389f0a21d"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:07.301104 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-bf76aec3-83fd-4275-89ad-1a838649fe03 req-426e2cc1-a39f-480b-a66f-6c7f0f87be3b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:07.303304 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-bf76aec3-83fd-4275-89ad-1a838649fe03 req-426e2cc1-a39f-480b-a66f-6c7f0f87be3b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:07.359879 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-bf76aec3-83fd-4275-89ad-1a838649fe03 req-426e2cc1-a39f-480b-a66f-6c7f0f87be3b service nova] Creating event network-changed:23377b35-13e3-460e-98a2-837389f0a21d for instance 69ff0893-3da5-487f-8cb6-25763b854eaa on chh1-master-2 Jun 10 18:04:07.374847 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-bf76aec3-83fd-4275-89ad-1a838649fe03 req-426e2cc1-a39f-480b-a66f-6c7f0f87be3b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097792 Jun 10 18:04:07.375859 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1063/2119] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:04:07.394885 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-72a685f5-5ad0-4acd-8d8d-6edd1d7987c7 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:07.395604 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-72a685f5-5ad0-4acd-8d8d-6edd1d7987c7 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] [instance: 07e79e24-76e1-476b-b064-a6729174e2ff] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:07.421782 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72a685f5-5ad0-4acd-8d8d-6edd1d7987c7 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:07.426065 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72a685f5-5ad0-4acd-8d8d-6edd1d7987c7 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:07.428856 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72a685f5-5ad0-4acd-8d8d-6edd1d7987c7 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:07.433423 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72a685f5-5ad0-4acd-8d8d-6edd1d7987c7 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:07.613234 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-23015543-bcd1-4751-9e3d-aa02e8e5989a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:07.623555 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-23015543-bcd1-4751-9e3d-aa02e8e5989a tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1199 microversion: 2.1 time: 0.617669 Jun 10 18:04:07.634385 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1057/2120] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:07 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1199 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:07.640371 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-933c8f59-e3f9-46aa-ac56-ee85d27ec34b tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:07.640994 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-933c8f59-e3f9-46aa-ac56-ee85d27ec34b tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: 69ff0893-3da5-487f-8cb6-25763b854eaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:07.649367 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-933c8f59-e3f9-46aa-ac56-ee85d27ec34b tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:07.650910 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-933c8f59-e3f9-46aa-ac56-ee85d27ec34b tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:07.651955 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-933c8f59-e3f9-46aa-ac56-ee85d27ec34b tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:07.652802 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-933c8f59-e3f9-46aa-ac56-ee85d27ec34b tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:07.725877 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-72a685f5-5ad0-4acd-8d8d-6edd1d7987c7 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be318f01fac5459cb4d0f55cf374824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:07.731170 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-72a685f5-5ad0-4acd-8d8d-6edd1d7987c7 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "GET /compute/v2.1/servers/07e79e24-76e1-476b-b064-a6729174e2ff" status: 200 len: 1515 microversion: 2.1 time: 0.350192 Jun 10 18:04:07.732413 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1064/2121] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:07 2022] GET /compute/v2.1/servers/07e79e24-76e1-476b-b064-a6729174e2ff => generated 1515 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:07.761171 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-297421ed-b521-4650-a702-d92cd1c2c841 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:07.761790 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-297421ed-b521-4650-a702-d92cd1c2c841 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] [instance: aba801d8-0f5d-49d2-9d2a-be6a81cee5e7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:07.769687 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-297421ed-b521-4650-a702-d92cd1c2c841 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:07.770474 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-297421ed-b521-4650-a702-d92cd1c2c841 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:07.771518 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-297421ed-b521-4650-a702-d92cd1c2c841 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:07.772201 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-297421ed-b521-4650-a702-d92cd1c2c841 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:07.990090 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-297421ed-b521-4650-a702-d92cd1c2c841 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be318f01fac5459cb4d0f55cf374824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:07.999827 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-297421ed-b521-4650-a702-d92cd1c2c841 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "GET /compute/v2.1/servers/aba801d8-0f5d-49d2-9d2a-be6a81cee5e7" status: 200 len: 1515 microversion: 2.1 time: 0.246212 Jun 10 18:04:08.011201 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1065/2122] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:07 2022] GET /compute/v2.1/servers/aba801d8-0f5d-49d2-9d2a-be6a81cee5e7 => generated 1515 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:08.019116 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f767b227-f954-4dff-9ab8-10c6038a97ed tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:08.019737 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f767b227-f954-4dff-9ab8-10c6038a97ed tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:08.028440 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f767b227-f954-4dff-9ab8-10c6038a97ed tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:08.029588 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f767b227-f954-4dff-9ab8-10c6038a97ed tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:08.030404 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f767b227-f954-4dff-9ab8-10c6038a97ed tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:08.030849 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f767b227-f954-4dff-9ab8-10c6038a97ed tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:08.135995 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-933c8f59-e3f9-46aa-ac56-ee85d27ec34b tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:08.149627 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-933c8f59-e3f9-46aa-ac56-ee85d27ec34b tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa" status: 200 len: 1316 microversion: 2.1 time: 0.513749 Jun 10 18:04:08.152096 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1058/2123] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:07 2022] GET /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa => generated 1316 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:08.158965 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-25324d4b-2dd6-4122-a4a6-6182bd489673 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:08.159666 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-25324d4b-2dd6-4122-a4a6-6182bd489673 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] [instance: aba801d8-0f5d-49d2-9d2a-be6a81cee5e7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:08.170789 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-25324d4b-2dd6-4122-a4a6-6182bd489673 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:08.171984 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-25324d4b-2dd6-4122-a4a6-6182bd489673 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:08.179617 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-25324d4b-2dd6-4122-a4a6-6182bd489673 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:08.180361 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-25324d4b-2dd6-4122-a4a6-6182bd489673 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:08.186837 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f767b227-f954-4dff-9ab8-10c6038a97ed tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:08.195475 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f767b227-f954-4dff-9ab8-10c6038a97ed tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1476 microversion: 2.1 time: 0.181125 Jun 10 18:04:08.197791 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1066/2124] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:08 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1476 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:08.230725 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-25324d4b-2dd6-4122-a4a6-6182bd489673 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] [instance: aba801d8-0f5d-49d2-9d2a-be6a81cee5e7] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:04:08.441109 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8466039f-e772-45a3-ac9c-ddcc328f894f tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-819481907", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "dde12c67-1ecf-4aa1-a9c1-4bb2412e8e71"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:08.529062 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-8466039f-e772-45a3-ac9c-ddcc328f894f tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] validate_networks() for [('dde12c67-1ecf-4aa1-a9c1-4bb2412e8e71', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:04:08.568289 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=28 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:04:08.572767 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-25324d4b-2dd6-4122-a4a6-6182bd489673 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "DELETE /compute/v2.1/servers/aba801d8-0f5d-49d2-9d2a-be6a81cee5e7" status: 204 len: 0 microversion: 2.1 time: 0.419151 Jun 10 18:04:08.579743 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1059/2125] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:04:08 2022] DELETE /compute/v2.1/servers/aba801d8-0f5d-49d2-9d2a-be6a81cee5e7 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:04:08.586015 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ad1c8af0-2178-482b-b97d-a3d340942984 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:08.586732 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ad1c8af0-2178-482b-b97d-a3d340942984 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 3a12492e-7860-4786-a695-48505e2c1840] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:08.597677 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ad1c8af0-2178-482b-b97d-a3d340942984 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:08.600396 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ad1c8af0-2178-482b-b97d-a3d340942984 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:08.601594 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ad1c8af0-2178-482b-b97d-a3d340942984 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:08.602043 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ad1c8af0-2178-482b-b97d-a3d340942984 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:09.095901 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ad1c8af0-2178-482b-b97d-a3d340942984 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:09.108587 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ad1c8af0-2178-482b-b97d-a3d340942984 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840" status: 200 len: 1512 microversion: 2.1 time: 0.527257 Jun 10 18:04:09.117209 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1060/2126] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:08 2022] GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840 => generated 1512 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:09.127154 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-f7ef5db3-ef18-4f40-a534-5eae8793a8bd req-d4f7f508-6b6b-4498-bf25-e160d5703e66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e24cb05a-9ceb-4570-9773-b04297cbf4bb", "name": "network-vif-plugged", "status": "completed", "tag": "f0d78f74-c94f-47fc-b5f6-fca21d020e90"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:09.152006 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-f7ef5db3-ef18-4f40-a534-5eae8793a8bd req-d4f7f508-6b6b-4498-bf25-e160d5703e66 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:09.152504 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-f7ef5db3-ef18-4f40-a534-5eae8793a8bd req-d4f7f508-6b6b-4498-bf25-e160d5703e66 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:09.187725 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-f7ef5db3-ef18-4f40-a534-5eae8793a8bd req-d4f7f508-6b6b-4498-bf25-e160d5703e66 service nova] Creating event network-vif-plugged:f0d78f74-c94f-47fc-b5f6-fca21d020e90 for instance e24cb05a-9ceb-4570-9773-b04297cbf4bb on chh2-master-2 Jun 10 18:04:09.204704 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-f7ef5db3-ef18-4f40-a534-5eae8793a8bd req-d4f7f508-6b6b-4498-bf25-e160d5703e66 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081056 Jun 10 18:04:09.206227 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1061/2127] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:09.223046 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5c632018-f574-4364-86e9-afe04c24b768 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:09.226992 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5c632018-f574-4364-86e9-afe04c24b768 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] [instance: aba801d8-0f5d-49d2-9d2a-be6a81cee5e7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:09.244663 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5c632018-f574-4364-86e9-afe04c24b768 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:09.246844 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5c632018-f574-4364-86e9-afe04c24b768 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:09.254899 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5c632018-f574-4364-86e9-afe04c24b768 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:09.254899 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5c632018-f574-4364-86e9-afe04c24b768 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:09.255185 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-8466039f-e772-45a3-ac9c-ddcc328f894f tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:04:09.255185 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-8466039f-e772-45a3-ac9c-ddcc328f894f tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:04:09.255185 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-8466039f-e772-45a3-ac9c-ddcc328f894f tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:04:09.255185 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-8466039f-e772-45a3-ac9c-ddcc328f894f tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:04:09.255185 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-8466039f-e772-45a3-ac9c-ddcc328f894f tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:04:09.274972 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8466039f-e772-45a3-ac9c-ddcc328f894f tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:09.277513 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8466039f-e772-45a3-ac9c-ddcc328f894f tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:09.278983 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8466039f-e772-45a3-ac9c-ddcc328f894f tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:09.279875 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8466039f-e772-45a3-ac9c-ddcc328f894f tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:09.309319 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-8466039f-e772-45a3-ac9c-ddcc328f894f tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Getting quotas for project be8ad96cd98c4cf683f763099e3064a4. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:04:09.329546 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-8466039f-e772-45a3-ac9c-ddcc328f894f tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Getting quotas for user 9884a0b94aed42e5aa029f6d096a3d36 and project be8ad96cd98c4cf683f763099e3064a4. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:04:09.362021 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8466039f-e772-45a3-ac9c-ddcc328f894f tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:04:09.367267 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8466039f-e772-45a3-ac9c-ddcc328f894f tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] [instance: 4864e5b5-595a-4935-80c2-2572b66f8162] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:04:09.562651 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5c632018-f574-4364-86e9-afe04c24b768 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be318f01fac5459cb4d0f55cf374824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:09.575507 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5c632018-f574-4364-86e9-afe04c24b768 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "GET /compute/v2.1/servers/aba801d8-0f5d-49d2-9d2a-be6a81cee5e7" status: 200 len: 1521 microversion: 2.1 time: 0.367830 Jun 10 18:04:09.577053 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1062/2128] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:09 2022] GET /compute/v2.1/servers/aba801d8-0f5d-49d2-9d2a-be6a81cee5e7 => generated 1521 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:09.582729 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a6f47e44-3705-4f6b-8672-21e2e917fef9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:09.583590 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a6f47e44-3705-4f6b-8672-21e2e917fef9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:09.614421 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8466039f-e772-45a3-ac9c-ddcc328f894f tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.414991 Jun 10 18:04:09.618093 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a6f47e44-3705-4f6b-8672-21e2e917fef9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:09.618093 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a6f47e44-3705-4f6b-8672-21e2e917fef9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:09.619420 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1067/2129] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:04:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:04:09.630774 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0485dd01-3ba8-438d-b73a-cfdf627fa585 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:09.632476 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a6f47e44-3705-4f6b-8672-21e2e917fef9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:09.633131 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a6f47e44-3705-4f6b-8672-21e2e917fef9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:09.635528 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0485dd01-3ba8-438d-b73a-cfdf627fa585 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: 69ff0893-3da5-487f-8cb6-25763b854eaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:09.653605 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0485dd01-3ba8-438d-b73a-cfdf627fa585 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:09.655357 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0485dd01-3ba8-438d-b73a-cfdf627fa585 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:09.656498 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0485dd01-3ba8-438d-b73a-cfdf627fa585 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:09.657142 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0485dd01-3ba8-438d-b73a-cfdf627fa585 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:10.075671 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a6f47e44-3705-4f6b-8672-21e2e917fef9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:10.083886 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a6f47e44-3705-4f6b-8672-21e2e917fef9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1199 microversion: 2.1 time: 0.505440 Jun 10 18:04:10.096359 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1063/2130] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:09 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1199 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:10.113028 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d64dd175-bfda-41e6-9631-d6e47a602dac tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:10.113028 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d64dd175-bfda-41e6-9631-d6e47a602dac tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:10.134215 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d64dd175-bfda-41e6-9631-d6e47a602dac tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:10.135372 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d64dd175-bfda-41e6-9631-d6e47a602dac tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:10.146976 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d64dd175-bfda-41e6-9631-d6e47a602dac tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:10.147666 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d64dd175-bfda-41e6-9631-d6e47a602dac tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:10.326153 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0485dd01-3ba8-438d-b73a-cfdf627fa585 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:10.335437 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0485dd01-3ba8-438d-b73a-cfdf627fa585 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa" status: 200 len: 1316 microversion: 2.1 time: 0.713828 Jun 10 18:04:10.345820 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1068/2131] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:09 2022] GET /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa => generated 1316 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:10.353524 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5374648f-c2f6-4d51-bed4-9af0c2a64ff1 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:10.354068 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5374648f-c2f6-4d51-bed4-9af0c2a64ff1 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] [instance: 4864e5b5-595a-4935-80c2-2572b66f8162] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:10.402631 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d64dd175-bfda-41e6-9631-d6e47a602dac tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:10.413668 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d64dd175-bfda-41e6-9631-d6e47a602dac tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1476 microversion: 2.1 time: 0.322080 Jun 10 18:04:10.415064 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1064/2132] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:10 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1476 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:10.420523 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-edd0f347-8089-4222-94e3-dbec04552416 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:10.474116 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-edd0f347-8089-4222-94e3-dbec04552416 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 3a12492e-7860-4786-a695-48505e2c1840] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:10.474116 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-edd0f347-8089-4222-94e3-dbec04552416 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:10.474116 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-edd0f347-8089-4222-94e3-dbec04552416 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:10.474116 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-edd0f347-8089-4222-94e3-dbec04552416 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:10.474116 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-edd0f347-8089-4222-94e3-dbec04552416 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:10.475745 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5374648f-c2f6-4d51-bed4-9af0c2a64ff1 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9884a0b94aed42e5aa029f6d096a3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8ad96cd98c4cf683f763099e3064a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:10.475745 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5374648f-c2f6-4d51-bed4-9af0c2a64ff1 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] 10.222.0.35 "GET /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162" status: 200 len: 1231 microversion: 2.1 time: 0.110130 Jun 10 18:04:10.475745 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1069/2133] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:10 2022] GET /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162 => generated 1231 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:10.593627 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f9de03fa-57cb-4db8-802c-ba63388b6516 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:10.595259 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f9de03fa-57cb-4db8-802c-ba63388b6516 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] [instance: aba801d8-0f5d-49d2-9d2a-be6a81cee5e7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:10.611409 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f9de03fa-57cb-4db8-802c-ba63388b6516 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:10.611609 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f9de03fa-57cb-4db8-802c-ba63388b6516 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:10.615345 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f9de03fa-57cb-4db8-802c-ba63388b6516 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:10.615975 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f9de03fa-57cb-4db8-802c-ba63388b6516 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:10.802291 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-edd0f347-8089-4222-94e3-dbec04552416 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:10.816506 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-edd0f347-8089-4222-94e3-dbec04552416 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840" status: 200 len: 1512 microversion: 2.1 time: 0.396461 Jun 10 18:04:10.816506 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1065/2134] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:10 2022] GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840 => generated 1512 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:11.020236 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f9de03fa-57cb-4db8-802c-ba63388b6516 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be318f01fac5459cb4d0f55cf374824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:11.028029 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f9de03fa-57cb-4db8-802c-ba63388b6516 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "GET /compute/v2.1/servers/aba801d8-0f5d-49d2-9d2a-be6a81cee5e7" status: 200 len: 1521 microversion: 2.1 time: 0.438509 Jun 10 18:04:11.038273 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1070/2135] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:10 2022] GET /compute/v2.1/servers/aba801d8-0f5d-49d2-9d2a-be6a81cee5e7 => generated 1521 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:11.107023 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-78f8e791-3d37-4295-87a9-d0e3991391f0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:11.111996 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-78f8e791-3d37-4295-87a9-d0e3991391f0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:11.130010 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-78f8e791-3d37-4295-87a9-d0e3991391f0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:11.130577 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-78f8e791-3d37-4295-87a9-d0e3991391f0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:11.134387 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-78f8e791-3d37-4295-87a9-d0e3991391f0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:11.135094 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-78f8e791-3d37-4295-87a9-d0e3991391f0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:11.354461 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3662cf0b-ba2d-4d20-ae06-e120f02e9643 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:11.356156 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3662cf0b-ba2d-4d20-ae06-e120f02e9643 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: 69ff0893-3da5-487f-8cb6-25763b854eaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:11.365497 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-78f8e791-3d37-4295-87a9-d0e3991391f0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:11.368839 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3662cf0b-ba2d-4d20-ae06-e120f02e9643 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:11.369784 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3662cf0b-ba2d-4d20-ae06-e120f02e9643 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:11.373007 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3662cf0b-ba2d-4d20-ae06-e120f02e9643 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:11.373713 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3662cf0b-ba2d-4d20-ae06-e120f02e9643 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:11.379486 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-78f8e791-3d37-4295-87a9-d0e3991391f0 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1199 microversion: 2.1 time: 0.275693 Jun 10 18:04:11.379828 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1066/2136] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:11 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1199 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:11.432938 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4e608958-99e7-424f-b353-a6e6dc3859a2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:11.434684 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4e608958-99e7-424f-b353-a6e6dc3859a2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:11.445226 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4e608958-99e7-424f-b353-a6e6dc3859a2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:11.449027 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4e608958-99e7-424f-b353-a6e6dc3859a2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:11.449027 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4e608958-99e7-424f-b353-a6e6dc3859a2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:11.449027 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4e608958-99e7-424f-b353-a6e6dc3859a2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:11.626844 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3662cf0b-ba2d-4d20-ae06-e120f02e9643 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:11.663200 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3662cf0b-ba2d-4d20-ae06-e120f02e9643 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa" status: 200 len: 1316 microversion: 2.1 time: 0.304207 Jun 10 18:04:11.665713 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1071/2137] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:11 2022] GET /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa => generated 1316 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:11.672655 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-03e1fa60-4a19-4d35-b1dd-89e7566d24c0 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:11.674228 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-03e1fa60-4a19-4d35-b1dd-89e7566d24c0 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] [instance: 4864e5b5-595a-4935-80c2-2572b66f8162] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:11.767421 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-03e1fa60-4a19-4d35-b1dd-89e7566d24c0 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9884a0b94aed42e5aa029f6d096a3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8ad96cd98c4cf683f763099e3064a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:11.782487 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-03e1fa60-4a19-4d35-b1dd-89e7566d24c0 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] 10.222.0.35 "GET /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162" status: 200 len: 1231 microversion: 2.1 time: 0.115519 Jun 10 18:04:11.783091 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1072/2138] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:11 2022] GET /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162 => generated 1231 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:11.831897 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5f48ec83-8fce-48d5-b586-3eab416cb4c0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:11.832629 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5f48ec83-8fce-48d5-b586-3eab416cb4c0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 3a12492e-7860-4786-a695-48505e2c1840] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:11.844619 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5f48ec83-8fce-48d5-b586-3eab416cb4c0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:11.845304 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5f48ec83-8fce-48d5-b586-3eab416cb4c0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:11.845879 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5f48ec83-8fce-48d5-b586-3eab416cb4c0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:11.846331 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5f48ec83-8fce-48d5-b586-3eab416cb4c0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:11.893109 chdv-master-2 devstack@n-api.service[126594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 18:04:11.893460 chdv-master-2 devstack@n-api.service[126594]: Fri Jun 10 18:04:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d (ip 10.222.0.35) !!! Jun 10 18:04:11.957107 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4e608958-99e7-424f-b353-a6e6dc3859a2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:11.970162 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4e608958-99e7-424f-b353-a6e6dc3859a2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1476 microversion: 2.1 time: 0.542632 Jun 10 18:04:11.971089 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1067/2139] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:11 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1476 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:04:12.048218 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8264c86d-0853-491e-87e2-115d6c86916b tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:12.048218 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8264c86d-0853-491e-87e2-115d6c86916b tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] [instance: aba801d8-0f5d-49d2-9d2a-be6a81cee5e7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:12.062316 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8264c86d-0853-491e-87e2-115d6c86916b tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:12.062792 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8264c86d-0853-491e-87e2-115d6c86916b tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:12.063594 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8264c86d-0853-491e-87e2-115d6c86916b tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:12.064046 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8264c86d-0853-491e-87e2-115d6c86916b tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:12.151087 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5f48ec83-8fce-48d5-b586-3eab416cb4c0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:12.161336 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5f48ec83-8fce-48d5-b586-3eab416cb4c0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840" status: 200 len: 1512 microversion: 2.1 time: 0.333031 Jun 10 18:04:12.161927 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1073/2140] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:11 2022] GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840 => generated 1512 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:12.383703 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8264c86d-0853-491e-87e2-115d6c86916b tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be318f01fac5459cb4d0f55cf374824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:12.397069 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-75c7ba95-c235-4e76-b6cb-69738e65eef3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:12.400295 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-75c7ba95-c235-4e76-b6cb-69738e65eef3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:12.411772 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8264c86d-0853-491e-87e2-115d6c86916b tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "GET /compute/v2.1/servers/aba801d8-0f5d-49d2-9d2a-be6a81cee5e7" status: 200 len: 1521 microversion: 2.1 time: 0.349856 Jun 10 18:04:12.418429 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-75c7ba95-c235-4e76-b6cb-69738e65eef3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:12.418646 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1068/2141] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:12 2022] GET /compute/v2.1/servers/aba801d8-0f5d-49d2-9d2a-be6a81cee5e7 => generated 1521 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:12.419487 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-75c7ba95-c235-4e76-b6cb-69738e65eef3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:12.424204 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-75c7ba95-c235-4e76-b6cb-69738e65eef3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:12.424631 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-75c7ba95-c235-4e76-b6cb-69738e65eef3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:12.585715 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-3c4b5528-f872-48d7-b8b3-f97ef9c910b1 req-1ad282c0-1ad7-435d-8220-e8e6bc9daab3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aba801d8-0f5d-49d2-9d2a-be6a81cee5e7", "name": "network-vif-deleted", "tag": "d0cb7524-3ee3-4919-bc48-4155f7dfa94d"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:12.610115 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-3c4b5528-f872-48d7-b8b3-f97ef9c910b1 req-1ad282c0-1ad7-435d-8220-e8e6bc9daab3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:12.612465 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-3c4b5528-f872-48d7-b8b3-f97ef9c910b1 req-1ad282c0-1ad7-435d-8220-e8e6bc9daab3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:12.637981 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-3c4b5528-f872-48d7-b8b3-f97ef9c910b1 req-1ad282c0-1ad7-435d-8220-e8e6bc9daab3 service nova] Creating event network-vif-deleted:d0cb7524-3ee3-4919-bc48-4155f7dfa94d for instance aba801d8-0f5d-49d2-9d2a-be6a81cee5e7 on chh2-master-2 Jun 10 18:04:12.637981 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-3c4b5528-f872-48d7-b8b3-f97ef9c910b1 req-1ad282c0-1ad7-435d-8220-e8e6bc9daab3 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066870 Jun 10 18:04:12.637981 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1069/2142] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:12.674221 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fd901b48-defb-4101-91a1-91ba0f9b135d tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:12.681860 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fd901b48-defb-4101-91a1-91ba0f9b135d tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: 69ff0893-3da5-487f-8cb6-25763b854eaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:12.720058 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-75c7ba95-c235-4e76-b6cb-69738e65eef3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:12.724588 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fd901b48-defb-4101-91a1-91ba0f9b135d tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:12.725145 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fd901b48-defb-4101-91a1-91ba0f9b135d tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:12.729900 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-75c7ba95-c235-4e76-b6cb-69738e65eef3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1381 microversion: 2.1 time: 0.338682 Jun 10 18:04:12.730330 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fd901b48-defb-4101-91a1-91ba0f9b135d tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:12.730863 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fd901b48-defb-4101-91a1-91ba0f9b135d tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:12.741260 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1074/2143] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:12 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1381 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:04:12.749133 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3dec8ef2-d8b6-40cb-a11f-ea33c067d91e tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:12.749873 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3dec8ef2-d8b6-40cb-a11f-ea33c067d91e tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:12.757156 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3dec8ef2-d8b6-40cb-a11f-ea33c067d91e tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:12.757626 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3dec8ef2-d8b6-40cb-a11f-ea33c067d91e tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:12.758491 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3dec8ef2-d8b6-40cb-a11f-ea33c067d91e tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:12.758939 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3dec8ef2-d8b6-40cb-a11f-ea33c067d91e tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:13.032531 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3dec8ef2-d8b6-40cb-a11f-ea33c067d91e tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1532 microversion: 2.1 time: 0.289385 Jun 10 18:04:13.036940 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1075/2144] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:12 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1532 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:13.043485 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7181f4f6-9eea-441f-b50f-e73be5711062 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:13.044704 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7181f4f6-9eea-441f-b50f-e73be5711062 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] [instance: 4864e5b5-595a-4935-80c2-2572b66f8162] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:13.053441 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7181f4f6-9eea-441f-b50f-e73be5711062 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:13.054263 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7181f4f6-9eea-441f-b50f-e73be5711062 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:13.055575 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7181f4f6-9eea-441f-b50f-e73be5711062 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:13.056578 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7181f4f6-9eea-441f-b50f-e73be5711062 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:13.154080 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fd901b48-defb-4101-91a1-91ba0f9b135d tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:13.161966 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7181f4f6-9eea-441f-b50f-e73be5711062 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9884a0b94aed42e5aa029f6d096a3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8ad96cd98c4cf683f763099e3064a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:13.163638 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fd901b48-defb-4101-91a1-91ba0f9b135d tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa" status: 200 len: 1316 microversion: 2.1 time: 0.495549 Jun 10 18:04:13.164628 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1070/2145] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:12 2022] GET /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa => generated 1316 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:13.170188 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3dcbe616-181a-4467-9ad4-9ccfd729c7c5 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:13.171121 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3dcbe616-181a-4467-9ad4-9ccfd729c7c5 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:13.192716 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3dcbe616-181a-4467-9ad4-9ccfd729c7c5 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:13.193409 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3dcbe616-181a-4467-9ad4-9ccfd729c7c5 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:13.194412 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3dcbe616-181a-4467-9ad4-9ccfd729c7c5 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:13.195383 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3dcbe616-181a-4467-9ad4-9ccfd729c7c5 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:13.197508 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7181f4f6-9eea-441f-b50f-e73be5711062 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] 10.222.0.35 "GET /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162" status: 200 len: 1283 microversion: 2.1 time: 0.158324 Jun 10 18:04:13.206426 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1076/2146] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:13 2022] GET /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162 => generated 1283 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:13.214908 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ba184fb8-a2d1-4642-83f7-34b2326bfbcb tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:13.215535 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ba184fb8-a2d1-4642-83f7-34b2326bfbcb tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:13.233436 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ba184fb8-a2d1-4642-83f7-34b2326bfbcb tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:13.233895 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ba184fb8-a2d1-4642-83f7-34b2326bfbcb tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:13.234686 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ba184fb8-a2d1-4642-83f7-34b2326bfbcb tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:13.235133 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ba184fb8-a2d1-4642-83f7-34b2326bfbcb tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:13.412363 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3dcbe616-181a-4467-9ad4-9ccfd729c7c5 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:13.423322 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3dcbe616-181a-4467-9ad4-9ccfd729c7c5 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1476 microversion: 2.1 time: 0.256764 Jun 10 18:04:13.429862 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1071/2147] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:13 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1476 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:13.445361 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-686e7c2f-7711-47f4-9fd5-7cc048c19b69 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:13.446016 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-686e7c2f-7711-47f4-9fd5-7cc048c19b69 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 3a12492e-7860-4786-a695-48505e2c1840] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:13.461287 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-686e7c2f-7711-47f4-9fd5-7cc048c19b69 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:13.461815 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-686e7c2f-7711-47f4-9fd5-7cc048c19b69 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:13.473782 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-686e7c2f-7711-47f4-9fd5-7cc048c19b69 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:13.474932 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-686e7c2f-7711-47f4-9fd5-7cc048c19b69 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:13.481089 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ba184fb8-a2d1-4642-83f7-34b2326bfbcb tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1532 microversion: 2.1 time: 0.273340 Jun 10 18:04:13.481672 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1077/2148] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:13 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1532 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:13.487130 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1aa06f6d-0be9-40a0-8b1d-bbd896dd8af8 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:13.490079 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1aa06f6d-0be9-40a0-8b1d-bbd896dd8af8 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] [instance: aba801d8-0f5d-49d2-9d2a-be6a81cee5e7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:13.503899 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1aa06f6d-0be9-40a0-8b1d-bbd896dd8af8 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:13.503899 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1aa06f6d-0be9-40a0-8b1d-bbd896dd8af8 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:13.504711 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1aa06f6d-0be9-40a0-8b1d-bbd896dd8af8 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:13.505446 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1aa06f6d-0be9-40a0-8b1d-bbd896dd8af8 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:13.585312 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1aa06f6d-0be9-40a0-8b1d-bbd896dd8af8 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be318f01fac5459cb4d0f55cf374824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:13.595168 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1aa06f6d-0be9-40a0-8b1d-bbd896dd8af8 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "GET /compute/v2.1/servers/aba801d8-0f5d-49d2-9d2a-be6a81cee5e7" status: 200 len: 1308 microversion: 2.1 time: 0.112418 Jun 10 18:04:13.595766 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1078/2149] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:13 2022] GET /compute/v2.1/servers/aba801d8-0f5d-49d2-9d2a-be6a81cee5e7 => generated 1308 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:13.612497 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ae425b9e-7603-43c2-97dd-dcb969b46035 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:13.612497 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:04:13.612497 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 18:04:13.612497 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ae425b9e-7603-43c2-97dd-dcb969b46035 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:13.612497 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ae425b9e-7603-43c2-97dd-dcb969b46035 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:13.612497 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ae425b9e-7603-43c2-97dd-dcb969b46035 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:13.612497 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ae425b9e-7603-43c2-97dd-dcb969b46035 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:13.631935 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:04:13.641927 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ae425b9e-7603-43c2-97dd-dcb969b46035 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] 10.222.0.35 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.044822 Jun 10 18:04:13.642743 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1079/2150] 10.222.0.35 () {58 vars in 1175 bytes} [Fri Jun 10 18:04:13 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:13.655175 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9f5fec5a-455a-4643-904f-a70e34fcd0c1 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "chh1-master-2", "block_migration": false, "disk_over_commit": false}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:13.656341 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9f5fec5a-455a-4643-904f-a70e34fcd0c1 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:13.663140 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f5fec5a-455a-4643-904f-a70e34fcd0c1 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:13.663651 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f5fec5a-455a-4643-904f-a70e34fcd0c1 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:13.664732 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f5fec5a-455a-4643-904f-a70e34fcd0c1 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:13.665276 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f5fec5a-455a-4643-904f-a70e34fcd0c1 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:13.677263 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-686e7c2f-7711-47f4-9fd5-7cc048c19b69 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:13.687765 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-686e7c2f-7711-47f4-9fd5-7cc048c19b69 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840" status: 200 len: 1512 microversion: 2.1 time: 0.255239 Jun 10 18:04:13.688383 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1072/2151] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:13 2022] GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840 => generated 1512 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:13.694966 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-9f5fec5a-455a-4643-904f-a70e34fcd0c1 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lazy-loading 'flavor' on Instance uuid e24cb05a-9ceb-4570-9773-b04297cbf4bb {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:04:13.708567 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9f5fec5a-455a-4643-904f-a70e34fcd0c1 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Going to try to live migrate instance to chh1-master-2 {{(pid=126595) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 10 18:04:14.044681 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:04:14.188450 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b11ad99b-8e4e-4c8c-b8a1-80ca2b2f655f tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:14.188996 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b11ad99b-8e4e-4c8c-b8a1-80ca2b2f655f tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: 69ff0893-3da5-487f-8cb6-25763b854eaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:14.196904 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b11ad99b-8e4e-4c8c-b8a1-80ca2b2f655f tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:14.197701 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b11ad99b-8e4e-4c8c-b8a1-80ca2b2f655f tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:14.198496 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b11ad99b-8e4e-4c8c-b8a1-80ca2b2f655f tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:14.198943 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b11ad99b-8e4e-4c8c-b8a1-80ca2b2f655f tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:14.223270 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:04:14.388646 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b11ad99b-8e4e-4c8c-b8a1-80ca2b2f655f tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:14.400884 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b11ad99b-8e4e-4c8c-b8a1-80ca2b2f655f tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa" status: 200 len: 1316 microversion: 2.1 time: 0.214813 Jun 10 18:04:14.410249 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1073/2152] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:14 2022] GET /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa => generated 1316 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:04:14.418588 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a015e0cf-bae2-495f-8dfe-2f4e06ef50a1 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:14.419922 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a015e0cf-bae2-495f-8dfe-2f4e06ef50a1 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] [instance: 4864e5b5-595a-4935-80c2-2572b66f8162] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:14.427262 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:04:14.429958 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a015e0cf-bae2-495f-8dfe-2f4e06ef50a1 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:14.430801 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a015e0cf-bae2-495f-8dfe-2f4e06ef50a1 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:14.432150 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a015e0cf-bae2-495f-8dfe-2f4e06ef50a1 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:14.433013 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a015e0cf-bae2-495f-8dfe-2f4e06ef50a1 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:14.533975 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a015e0cf-bae2-495f-8dfe-2f4e06ef50a1 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9884a0b94aed42e5aa029f6d096a3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8ad96cd98c4cf683f763099e3064a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:14.547298 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a015e0cf-bae2-495f-8dfe-2f4e06ef50a1 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] 10.222.0.35 "GET /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162" status: 200 len: 1283 microversion: 2.1 time: 0.134348 Jun 10 18:04:14.548643 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1074/2153] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:14 2022] GET /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162 => generated 1283 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:14.563743 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-9d15497a-f253-4f52-83ab-ae02094c76e9 req-111083e1-1a9b-41f9-ac79-e529afa2fb26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69ff0893-3da5-487f-8cb6-25763b854eaa", "name": "network-vif-plugged", "status": "completed", "tag": "23377b35-13e3-460e-98a2-837389f0a21d"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:14.574657 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-9d15497a-f253-4f52-83ab-ae02094c76e9 req-111083e1-1a9b-41f9-ac79-e529afa2fb26 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:14.575312 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-9d15497a-f253-4f52-83ab-ae02094c76e9 req-111083e1-1a9b-41f9-ac79-e529afa2fb26 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:14.595079 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-9d15497a-f253-4f52-83ab-ae02094c76e9 req-111083e1-1a9b-41f9-ac79-e529afa2fb26 service nova] Creating event network-vif-plugged:23377b35-13e3-460e-98a2-837389f0a21d for instance 69ff0893-3da5-487f-8cb6-25763b854eaa on chh1-master-2 Jun 10 18:04:14.600993 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-9d15497a-f253-4f52-83ab-ae02094c76e9 req-111083e1-1a9b-41f9-ac79-e529afa2fb26 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041595 Jun 10 18:04:14.602264 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1075/2154] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:14.609311 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-35ca43ee-9879-42d7-8e40-8d9001803867 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:14.611492 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-35ca43ee-9879-42d7-8e40-8d9001803867 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:14.620204 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-35ca43ee-9879-42d7-8e40-8d9001803867 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:14.622153 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-35ca43ee-9879-42d7-8e40-8d9001803867 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:14.623437 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-35ca43ee-9879-42d7-8e40-8d9001803867 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:14.624076 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-35ca43ee-9879-42d7-8e40-8d9001803867 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:14.955685 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-35ca43ee-9879-42d7-8e40-8d9001803867 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:14.969578 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-35ca43ee-9879-42d7-8e40-8d9001803867 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1476 microversion: 2.1 time: 0.365731 Jun 10 18:04:14.970186 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1076/2155] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:14 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1476 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:14.988927 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-63e1be0f-1aa3-4ade-b3ac-7ffdba32d5d1 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:14.996477 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-63e1be0f-1aa3-4ade-b3ac-7ffdba32d5d1 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] [instance: aba801d8-0f5d-49d2-9d2a-be6a81cee5e7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:15.021543 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-63e1be0f-1aa3-4ade-b3ac-7ffdba32d5d1 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:15.022177 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-63e1be0f-1aa3-4ade-b3ac-7ffdba32d5d1 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:15.023034 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-63e1be0f-1aa3-4ade-b3ac-7ffdba32d5d1 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:15.023475 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-63e1be0f-1aa3-4ade-b3ac-7ffdba32d5d1 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:15.046200 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-63e1be0f-1aa3-4ade-b3ac-7ffdba32d5d1 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] HTTP exception thrown: Instance aba801d8-0f5d-49d2-9d2a-be6a81cee5e7 could not be found. Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-63e1be0f-1aa3-4ade-b3ac-7ffdba32d5d1 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Request method failure captured: Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/aba801d8-0f5d-49d2-9d2a-be6a81cee5e7 HTTP/1.1 Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4d2g6LisIDVkTYTcdOtG0A3umrUEUWfSSdKBZBTZSGZWByrOwwCj-5KqksYro3H1okjI-zzuU5IHUS4lo6yG-r96m6TXL_G3wFZOzgUE1VCvpXQWprzUOsbOtrwUJG6ZZ0kitxUWkFBtgkuEIiNHG9TcUYzDRR5llGfQuUx6UFa3gE Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 8f24d6db014a4fecb9533fa4cf1be8c7 Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ListServersNegativeTestJSON-1230596670 Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/8f24d6db014a4fecb9533fa4cf1be8c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8f24d6db014a4fecb9533fa4cf1be8c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8f24d6db014a4fecb9533fa4cf1be8c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_8f24d6db014a4fecb9533fa4cf1be8c7", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ListServersNegativeTestJSON-1230596670 Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 8f24d6db014a4fecb9533fa4cf1be8c7 Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1230596670 Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ListServersNegativeTestJSON-1230596670-project Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: be318f01fac5459cb4d0f55cf374824f Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ListServersNegativeTestJSON-1230596670-project Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: exception: Instance aba801d8-0f5d-49d2-9d2a-be6a81cee5e7 could not be found. Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'aba801d8-0f5d-49d2-9d2a-be6a81cee5e7'} Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aba801d8-0f5d-49d2-9d2a-be6a81cee5e7 could not be found. Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aba801d8-0f5d-49d2-9d2a-be6a81cee5e7 could not be found. Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:15.048390 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:15.053497 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:15.053497 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:04:15.053497 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:04:15.053497 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:04:15.053497 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:04:15.053497 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aba801d8-0f5d-49d2-9d2a-be6a81cee5e7 could not be found. Jun 10 18:04:15.053497 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:15.053497 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-63e1be0f-1aa3-4ade-b3ac-7ffdba32d5d1 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Returning 404 to user: Instance aba801d8-0f5d-49d2-9d2a-be6a81cee5e7 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:04:15.053497 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-63e1be0f-1aa3-4ade-b3ac-7ffdba32d5d1 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "GET /compute/v2.1/servers/aba801d8-0f5d-49d2-9d2a-be6a81cee5e7" status: 404 len: 111 microversion: 2.1 time: 0.078756 Jun 10 18:04:15.053497 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1077/2156] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:14 2022] GET /compute/v2.1/servers/aba801d8-0f5d-49d2-9d2a-be6a81cee5e7 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:04:15.055604 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4d0ce54a-7cc6-40b2-9bae-d2ae825c8f53 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:15.056874 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4d0ce54a-7cc6-40b2-9bae-d2ae825c8f53 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 3a12492e-7860-4786-a695-48505e2c1840] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:15.063296 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4d0ce54a-7cc6-40b2-9bae-d2ae825c8f53 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:15.065500 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4d0ce54a-7cc6-40b2-9bae-d2ae825c8f53 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:15.065500 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4d0ce54a-7cc6-40b2-9bae-d2ae825c8f53 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:15.065500 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4d0ce54a-7cc6-40b2-9bae-d2ae825c8f53 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:15.666216 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4d0ce54a-7cc6-40b2-9bae-d2ae825c8f53 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:15.674353 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4d0ce54a-7cc6-40b2-9bae-d2ae825c8f53 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840" status: 200 len: 1512 microversion: 2.1 time: 0.622351 Jun 10 18:04:15.674956 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1078/2157] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:15 2022] GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840 => generated 1512 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:15.679512 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b1875281-ec1b-49aa-b2e1-9c1d680f95ae tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:15.683618 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b1875281-ec1b-49aa-b2e1-9c1d680f95ae tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'be318f01fac5459cb4d0f55cf374824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:15.684514 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b1875281-ec1b-49aa-b2e1-9c1d680f95ae tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7'} {{(pid=126594) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 18:04:15.690226 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b1875281-ec1b-49aa-b2e1-9c1d680f95ae tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:15.691033 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b1875281-ec1b-49aa-b2e1-9c1d680f95ae tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:15.691851 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b1875281-ec1b-49aa-b2e1-9c1d680f95ae tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:15.692290 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b1875281-ec1b-49aa-b2e1-9c1d680f95ae tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:15.779067 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b1875281-ec1b-49aa-b2e1-9c1d680f95ae tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.103017 Jun 10 18:04:15.779655 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1079/2158] 10.222.0.35 () {58 vars in 1229 bytes} [Fri Jun 10 18:04:15 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:04:15.784879 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5dddb763-3534-474f-8b10-50bd8ec50941 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:15.785953 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5dddb763-3534-474f-8b10-50bd8ec50941 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: 69ff0893-3da5-487f-8cb6-25763b854eaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:15.792789 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5dddb763-3534-474f-8b10-50bd8ec50941 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:15.793410 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5dddb763-3534-474f-8b10-50bd8ec50941 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:15.794189 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5dddb763-3534-474f-8b10-50bd8ec50941 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:15.794626 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5dddb763-3534-474f-8b10-50bd8ec50941 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:16.199361 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5dddb763-3534-474f-8b10-50bd8ec50941 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:16.209995 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5dddb763-3534-474f-8b10-50bd8ec50941 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa" status: 200 len: 1316 microversion: 2.1 time: 0.429042 Jun 10 18:04:16.210582 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1080/2159] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:15 2022] GET /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa => generated 1316 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:16.216722 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1d261a91-aabd-433d-8fbb-b7e9592635d6 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:16.218266 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1d261a91-aabd-433d-8fbb-b7e9592635d6 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] [instance: 4864e5b5-595a-4935-80c2-2572b66f8162] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:16.225885 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1d261a91-aabd-433d-8fbb-b7e9592635d6 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:16.233172 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1d261a91-aabd-433d-8fbb-b7e9592635d6 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:16.233172 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1d261a91-aabd-433d-8fbb-b7e9592635d6 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:16.233172 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1d261a91-aabd-433d-8fbb-b7e9592635d6 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:16.353220 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1d261a91-aabd-433d-8fbb-b7e9592635d6 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9884a0b94aed42e5aa029f6d096a3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8ad96cd98c4cf683f763099e3064a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:16.360790 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1d261a91-aabd-433d-8fbb-b7e9592635d6 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] 10.222.0.35 "GET /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162" status: 200 len: 1289 microversion: 2.1 time: 0.148700 Jun 10 18:04:16.361441 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1081/2160] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:16 2022] GET /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162 => generated 1289 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:16.365958 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c1a83670-41d8-4120-80c4-50556b4d2f0b tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c1a83670-41d8-4120-80c4-50556b4d2f0b tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Request method failure captured: Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4d2g6LisIDVkTYTcdOtG0A3umrUEUWfSSdKBZBTZSGZWByrOwwCj-5KqksYro3H1okjI-zzuU5IHUS4lo6yG-r96m6TXL_G3wFZOzgUE1VCvpXQWprzUOsbOtrwUJG6ZZ0kitxUWkFBtgkuEIiNHG9TcUYzDRR5llGfQuUx6UFa3gE Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 8f24d6db014a4fecb9533fa4cf1be8c7 Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ListServersNegativeTestJSON-1230596670 Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/8f24d6db014a4fecb9533fa4cf1be8c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8f24d6db014a4fecb9533fa4cf1be8c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8f24d6db014a4fecb9533fa4cf1be8c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_8f24d6db014a4fecb9533fa4cf1be8c7", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ListServersNegativeTestJSON-1230596670 Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 8f24d6db014a4fecb9533fa4cf1be8c7 Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1230596670 Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ListServersNegativeTestJSON-1230596670-project Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: be318f01fac5459cb4d0f55cf374824f Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ListServersNegativeTestJSON-1230596670-project Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: action_args: {} Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise error Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi On instance[0]: Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi '2011/01/01' Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jun 10 18:04:16.368551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 10 18:04:16.374342 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 10 18:04:16.374342 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 10 18:04:16.374342 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 10 18:04:16.374342 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jun 10 18:04:16.374342 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:16.374342 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:16.374342 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:16.374342 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:16.374342 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:04:16.374342 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:04:16.374342 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 10 18:04:16.374342 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 10 18:04:16.374342 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jun 10 18:04:16.374342 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:16.374342 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c1a83670-41d8-4120-80c4-50556b4d2f0b tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:04:16.374342 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c1a83670-41d8-4120-80c4-50556b4d2f0b tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.007479 Jun 10 18:04:16.374342 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1082/2161] 10.222.0.35 () {58 vars in 1181 bytes} [Fri Jun 10 18:04:16 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:04:16.378340 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-dc559897-19d3-4384-9e55-94be6ce77813 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:16.379669 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-dc559897-19d3-4384-9e55-94be6ce77813 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:16.406228 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dc559897-19d3-4384-9e55-94be6ce77813 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:16.406680 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dc559897-19d3-4384-9e55-94be6ce77813 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:16.407486 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dc559897-19d3-4384-9e55-94be6ce77813 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:16.407914 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dc559897-19d3-4384-9e55-94be6ce77813 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:16.955388 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-dc559897-19d3-4384-9e55-94be6ce77813 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:16.964701 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-dc559897-19d3-4384-9e55-94be6ce77813 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1475 microversion: 2.1 time: 0.593008 Jun 10 18:04:16.965278 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1083/2162] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:16 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1475 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:16.970510 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c5cb21e8-8422-48df-8c9f-b8efaab3dbe2 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:16.974115 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c5cb21e8-8422-48df-8c9f-b8efaab3dbe2 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'be318f01fac5459cb4d0f55cf374824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:16.974978 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c5cb21e8-8422-48df-8c9f-b8efaab3dbe2 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Searching by: {'deleted': False, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7'} {{(pid=126594) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 18:04:16.981028 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5cb21e8-8422-48df-8c9f-b8efaab3dbe2 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:16.983437 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5cb21e8-8422-48df-8c9f-b8efaab3dbe2 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:16.983437 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5cb21e8-8422-48df-8c9f-b8efaab3dbe2 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:16.983658 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5cb21e8-8422-48df-8c9f-b8efaab3dbe2 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:17.074929 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.multi_cell_list [None req-c5cb21e8-8422-48df-8c9f-b8efaab3dbe2 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126594) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 10 18:04:17.165107 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c5cb21e8-8422-48df-8c9f-b8efaab3dbe2 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.198168 Jun 10 18:04:17.167155 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1084/2163] 10.222.0.35 () {58 vars in 1124 bytes} [Fri Jun 10 18:04:16 2022] GET /compute/v2.1/servers => generated 683 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:17.173306 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-c9abe7a9-cf5c-4e34-80a5-9b1cad74e067 req-9e016b15-0e51-4cac-b2cc-b966358c3008 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586adfa4-7b3c-4399-86ab-d2982771af1d", "name": "network-vif-unplugged", "status": "completed", "tag": "8aa0aa37-a6b7-49eb-8548-6164b5ff95d7"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:17.184563 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-c9abe7a9-cf5c-4e34-80a5-9b1cad74e067 req-9e016b15-0e51-4cac-b2cc-b966358c3008 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:17.185282 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-c9abe7a9-cf5c-4e34-80a5-9b1cad74e067 req-9e016b15-0e51-4cac-b2cc-b966358c3008 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:17.199925 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-c9abe7a9-cf5c-4e34-80a5-9b1cad74e067 req-9e016b15-0e51-4cac-b2cc-b966358c3008 service nova] Creating event network-vif-unplugged:8aa0aa37-a6b7-49eb-8548-6164b5ff95d7 for instance 586adfa4-7b3c-4399-86ab-d2982771af1d on chh2-master-2 Jun 10 18:04:17.207336 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [req-c9abe7a9-cf5c-4e34-80a5-9b1cad74e067 req-9e016b15-0e51-4cac-b2cc-b966358c3008 service nova] Instance 586adfa4-7b3c-4399-86ab-d2982771af1d is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126594) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 18:04:17.220612 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-c9abe7a9-cf5c-4e34-80a5-9b1cad74e067 req-9e016b15-0e51-4cac-b2cc-b966358c3008 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051865 Jun 10 18:04:17.221611 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1085/2164] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:17.227278 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-886fb1c7-def5-4d02-98ef-2b61ee784702 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:17.228900 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-886fb1c7-def5-4d02-98ef-2b61ee784702 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 3a12492e-7860-4786-a695-48505e2c1840] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:17.236052 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-886fb1c7-def5-4d02-98ef-2b61ee784702 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:17.236723 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-886fb1c7-def5-4d02-98ef-2b61ee784702 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:17.237705 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-886fb1c7-def5-4d02-98ef-2b61ee784702 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:17.238319 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-886fb1c7-def5-4d02-98ef-2b61ee784702 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:17.656184 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-886fb1c7-def5-4d02-98ef-2b61ee784702 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:17.673024 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-886fb1c7-def5-4d02-98ef-2b61ee784702 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840" status: 200 len: 1512 microversion: 2.1 time: 0.441724 Jun 10 18:04:17.673683 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1086/2165] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:17 2022] GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840 => generated 1512 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:17.686669 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5f5a022f-64fd-4e5b-b835-3406c70ec4a0 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:17.690444 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5f5a022f-64fd-4e5b-b835-3406c70ec4a0 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'be318f01fac5459cb4d0f55cf374824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:17.691137 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.compute.servers [None req-5f5a022f-64fd-4e5b-b835-3406c70ec4a0 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Removing options 'limit' from query {{(pid=126594) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jun 10 18:04:17.692215 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5f5a022f-64fd-4e5b-b835-3406c70ec4a0 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Searching by: {'deleted': False, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7'} {{(pid=126594) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 18:04:17.705973 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f5a022f-64fd-4e5b-b835-3406c70ec4a0 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:17.706680 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f5a022f-64fd-4e5b-b835-3406c70ec4a0 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:17.715826 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f5a022f-64fd-4e5b-b835-3406c70ec4a0 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:17.716275 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f5a022f-64fd-4e5b-b835-3406c70ec4a0 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:17.767501 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.multi_cell_list [None req-5f5a022f-64fd-4e5b-b835-3406c70ec4a0 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=126594) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 10 18:04:17.834958 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5f5a022f-64fd-4e5b-b835-3406c70ec4a0 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.159825 Jun 10 18:04:17.843041 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1087/2166] 10.222.0.35 () {58 vars in 1143 bytes} [Fri Jun 10 18:04:17 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:17.848163 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fb6c8bdf-d227-48ff-94e7-7b4b3234491c tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:17.849637 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fb6c8bdf-d227-48ff-94e7-7b4b3234491c tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: 69ff0893-3da5-487f-8cb6-25763b854eaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:17.856273 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fb6c8bdf-d227-48ff-94e7-7b4b3234491c tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:17.856993 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fb6c8bdf-d227-48ff-94e7-7b4b3234491c tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:17.857966 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fb6c8bdf-d227-48ff-94e7-7b4b3234491c tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:17.858576 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fb6c8bdf-d227-48ff-94e7-7b4b3234491c tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:18.197375 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fb6c8bdf-d227-48ff-94e7-7b4b3234491c tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:18.217703 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fb6c8bdf-d227-48ff-94e7-7b4b3234491c tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa" status: 200 len: 1502 microversion: 2.1 time: 0.373191 Jun 10 18:04:18.218622 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1088/2167] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:17 2022] GET /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa => generated 1502 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:18.235646 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-22bddd95-a95d-44bf-837d-c2934a077475 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:18.235646 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-22bddd95-a95d-44bf-837d-c2934a077475 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] [instance: 4864e5b5-595a-4935-80c2-2572b66f8162] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:18.256029 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-22bddd95-a95d-44bf-837d-c2934a077475 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:18.257940 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9f5fec5a-455a-4643-904f-a70e34fcd0c1 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] 10.222.0.35 "POST /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb/action" status: 202 len: 0 microversion: 2.1 time: 4.608133 Jun 10 18:04:18.259054 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1080/2168] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:04:13 2022] POST /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb/action => generated 0 bytes in 4610 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:04:18.260169 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-22bddd95-a95d-44bf-837d-c2934a077475 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:18.263165 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-22bddd95-a95d-44bf-837d-c2934a077475 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:18.266187 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-22bddd95-a95d-44bf-837d-c2934a077475 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:18.267918 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-843a3024-be96-4135-ba12-ab6f9ccb54ca tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-843a3024-be96-4135-ba12-ab6f9ccb54ca tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Request method failure captured: Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4d2g6LisIDVkTYTcdOtG0A3umrUEUWfSSdKBZBTZSGZWByrOwwCj-5KqksYro3H1okjI-zzuU5IHUS4lo6yG-r96m6TXL_G3wFZOzgUE1VCvpXQWprzUOsbOtrwUJG6ZZ0kitxUWkFBtgkuEIiNHG9TcUYzDRR5llGfQuUx6UFa3gE Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 8f24d6db014a4fecb9533fa4cf1be8c7 Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ListServersNegativeTestJSON-1230596670 Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/8f24d6db014a4fecb9533fa4cf1be8c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8f24d6db014a4fecb9533fa4cf1be8c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8f24d6db014a4fecb9533fa4cf1be8c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_8f24d6db014a4fecb9533fa4cf1be8c7", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ListServersNegativeTestJSON-1230596670 Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 8f24d6db014a4fecb9533fa4cf1be8c7 Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1230596670 Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ListServersNegativeTestJSON-1230596670-project Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: be318f01fac5459cb4d0f55cf374824f Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ListServersNegativeTestJSON-1230596670-project Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: action_args: {} Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise error Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi On instance[0]: Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi '-1' Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jun 10 18:04:18.270837 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jun 10 18:04:18.279340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 10 18:04:18.279340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 10 18:04:18.279340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 10 18:04:18.279340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 10 18:04:18.279340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jun 10 18:04:18.279340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:18.279340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:18.279340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:18.279340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:18.279340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:04:18.279340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:04:18.279340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 10 18:04:18.279340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 10 18:04:18.279340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jun 10 18:04:18.279340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:18.279340 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-843a3024-be96-4135-ba12-ab6f9ccb54ca tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:04:18.279340 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-843a3024-be96-4135-ba12-ab6f9ccb54ca tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.011086 Jun 10 18:04:18.279340 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1081/2169] 10.222.0.35 () {58 vars in 1141 bytes} [Fri Jun 10 18:04:18 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:04:18.288593 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5b18e0c1-6996-478f-b3a8-87000985c533 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:18.296982 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5b18e0c1-6996-478f-b3a8-87000985c533 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:18.304985 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5b18e0c1-6996-478f-b3a8-87000985c533 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:18.315900 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5b18e0c1-6996-478f-b3a8-87000985c533 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:18.316968 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5b18e0c1-6996-478f-b3a8-87000985c533 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:18.317496 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5b18e0c1-6996-478f-b3a8-87000985c533 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:18.668176 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-22bddd95-a95d-44bf-837d-c2934a077475 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9884a0b94aed42e5aa029f6d096a3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8ad96cd98c4cf683f763099e3064a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:18.676390 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-22bddd95-a95d-44bf-837d-c2934a077475 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] 10.222.0.35 "GET /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162" status: 200 len: 1331 microversion: 2.1 time: 0.445238 Jun 10 18:04:18.686030 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1089/2170] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:18 2022] GET /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162 => generated 1331 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:18.698810 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8ff8683e-c815-4e19-bf78-8259229cd489 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-765515554"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:18.707367 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8ff8683e-c815-4e19-bf78-8259229cd489 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: 69ff0893-3da5-487f-8cb6-25763b854eaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:18.752407 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5b18e0c1-6996-478f-b3a8-87000985c533 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:18.756066 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8ff8683e-c815-4e19-bf78-8259229cd489 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:18.757901 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8ff8683e-c815-4e19-bf78-8259229cd489 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:18.758801 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8ff8683e-c815-4e19-bf78-8259229cd489 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:18.760629 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8ff8683e-c815-4e19-bf78-8259229cd489 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:18.767610 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5b18e0c1-6996-478f-b3a8-87000985c533 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1475 microversion: 2.1 time: 0.483487 Jun 10 18:04:18.768727 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1082/2171] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:18 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1475 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:18.778041 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cf3bc666-7497-4c04-9ecc-a49166b3d904 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:18.780283 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cf3bc666-7497-4c04-9ecc-a49166b3d904 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:18.811535 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cf3bc666-7497-4c04-9ecc-a49166b3d904 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:18.816353 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cf3bc666-7497-4c04-9ecc-a49166b3d904 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:18.816353 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cf3bc666-7497-4c04-9ecc-a49166b3d904 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:18.816353 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cf3bc666-7497-4c04-9ecc-a49166b3d904 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:19.154256 chdv-master-2 devstack@n-api.service[126594]: INFO nova.network.security_group_api [None req-8ff8683e-c815-4e19-bf78-8259229cd489 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Adding security group dfb67a4b-9ba3-4d02-a64f-8c242a791d23 to port 23377b35-13e3-460e-98a2-837389f0a21d Jun 10 18:04:19.168839 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cf3bc666-7497-4c04-9ecc-a49166b3d904 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:19.180971 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cf3bc666-7497-4c04-9ecc-a49166b3d904 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1391 microversion: 2.1 time: 0.410984 Jun 10 18:04:19.181983 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1083/2172] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:18 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1391 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:19.187297 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5db46a81-bdad-4300-b998-d0693bba0e7b tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5db46a81-bdad-4300-b998-d0693bba0e7b tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Request method failure captured: Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4d2g6LisIDVkTYTcdOtG0A3umrUEUWfSSdKBZBTZSGZWByrOwwCj-5KqksYro3H1okjI-zzuU5IHUS4lo6yG-r96m6TXL_G3wFZOzgUE1VCvpXQWprzUOsbOtrwUJG6ZZ0kitxUWkFBtgkuEIiNHG9TcUYzDRR5llGfQuUx6UFa3gE Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 8f24d6db014a4fecb9533fa4cf1be8c7 Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ListServersNegativeTestJSON-1230596670 Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/8f24d6db014a4fecb9533fa4cf1be8c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8f24d6db014a4fecb9533fa4cf1be8c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8f24d6db014a4fecb9533fa4cf1be8c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_8f24d6db014a4fecb9533fa4cf1be8c7", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ListServersNegativeTestJSON-1230596670 Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 8f24d6db014a4fecb9533fa4cf1be8c7 Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1230596670 Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ListServersNegativeTestJSON-1230596670-project Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: be318f01fac5459cb4d0f55cf374824f Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ListServersNegativeTestJSON-1230596670-project Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: action_args: {} Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise error Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi On instance[0]: Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 'testing' Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jun 10 18:04:19.190345 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jun 10 18:04:19.196255 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 10 18:04:19.196255 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 10 18:04:19.196255 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 10 18:04:19.196255 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 10 18:04:19.196255 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jun 10 18:04:19.196255 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:19.196255 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:19.196255 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:19.196255 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:19.196255 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:04:19.196255 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:04:19.196255 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 10 18:04:19.196255 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 10 18:04:19.196255 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jun 10 18:04:19.196255 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:19.202174 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5db46a81-bdad-4300-b998-d0693bba0e7b tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:04:19.202174 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5db46a81-bdad-4300-b998-d0693bba0e7b tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.018408 Jun 10 18:04:19.203462 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1084/2173] 10.222.0.35 () {58 vars in 1151 bytes} [Fri Jun 10 18:04:19 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:04:19.216634 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0cd4ebca-0146-4c16-9a1f-902938a4051b tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:19.217503 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0cd4ebca-0146-4c16-9a1f-902938a4051b tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 3a12492e-7860-4786-a695-48505e2c1840] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:19.225479 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0cd4ebca-0146-4c16-9a1f-902938a4051b tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:19.226211 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0cd4ebca-0146-4c16-9a1f-902938a4051b tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:19.227182 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0cd4ebca-0146-4c16-9a1f-902938a4051b tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:19.227860 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0cd4ebca-0146-4c16-9a1f-902938a4051b tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:19.649923 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0cd4ebca-0146-4c16-9a1f-902938a4051b tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:19.666250 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0cd4ebca-0146-4c16-9a1f-902938a4051b tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840" status: 200 len: 1512 microversion: 2.1 time: 0.451016 Jun 10 18:04:19.667428 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1085/2174] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:19 2022] GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840 => generated 1512 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:19.677936 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-45dfb095-27a0-4f6c-b910-cd52c6fa2ed1 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:19.683491 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-45dfb095-27a0-4f6c-b910-cd52c6fa2ed1 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'be318f01fac5459cb4d0f55cf374824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:19.684608 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-45dfb095-27a0-4f6c-b910-cd52c6fa2ed1 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7'} {{(pid=126595) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 18:04:19.694239 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.compute.servers [None req-45dfb095-27a0-4f6c-b910-cd52c6fa2ed1 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Flavor 'non_existing_flavor' could not be found {{(pid=126595) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Jun 10 18:04:19.695308 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-45dfb095-27a0-4f6c-b910-cd52c6fa2ed1 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.024463 Jun 10 18:04:19.696106 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1086/2175] 10.222.0.35 () {58 vars in 1177 bytes} [Fri Jun 10 18:04:19 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:04:19.702180 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-1b0a0ce9-fc86-4905-bd36-f44b2cad9ba9 req-b2061ffc-634d-4ead-88c6-a0b2138340f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "586adfa4-7b3c-4399-86ab-d2982771af1d", "tag": "8aa0aa37-a6b7-49eb-8548-6164b5ff95d7"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:19.712594 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-1b0a0ce9-fc86-4905-bd36-f44b2cad9ba9 req-b2061ffc-634d-4ead-88c6-a0b2138340f6 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:19.716591 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-1b0a0ce9-fc86-4905-bd36-f44b2cad9ba9 req-b2061ffc-634d-4ead-88c6-a0b2138340f6 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:19.727615 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-1b0a0ce9-fc86-4905-bd36-f44b2cad9ba9 req-b2061ffc-634d-4ead-88c6-a0b2138340f6 service nova] Creating event network-changed:8aa0aa37-a6b7-49eb-8548-6164b5ff95d7 for instance 586adfa4-7b3c-4399-86ab-d2982771af1d on chh2-master-2 Jun 10 18:04:19.734192 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [req-1b0a0ce9-fc86-4905-bd36-f44b2cad9ba9 req-b2061ffc-634d-4ead-88c6-a0b2138340f6 service nova] Instance 586adfa4-7b3c-4399-86ab-d2982771af1d is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 18:04:19.748951 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-1b0a0ce9-fc86-4905-bd36-f44b2cad9ba9 req-b2061ffc-634d-4ead-88c6-a0b2138340f6 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050864 Jun 10 18:04:19.750110 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1087/2176] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:19.756049 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-34ef33f9-d7d5-4dd8-b18d-ac8acad38cfc tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:19.772292 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-34ef33f9-d7d5-4dd8-b18d-ac8acad38cfc tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] [instance: 4864e5b5-595a-4935-80c2-2572b66f8162] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:19.786379 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-34ef33f9-d7d5-4dd8-b18d-ac8acad38cfc tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:19.792947 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-34ef33f9-d7d5-4dd8-b18d-ac8acad38cfc tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:19.794135 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-34ef33f9-d7d5-4dd8-b18d-ac8acad38cfc tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:19.794926 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-34ef33f9-d7d5-4dd8-b18d-ac8acad38cfc tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:20.543072 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8ff8683e-c815-4e19-bf78-8259229cd489 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "POST /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa/action" status: 202 len: 0 microversion: 2.1 time: 1.854773 Jun 10 18:04:20.550235 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1090/2177] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:04:18 2022] POST /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa/action => generated 0 bytes in 1863 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:04:20.557993 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5d7f146f-2532-4f5d-b4d8-d2f8cca12884 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:20.563796 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5d7f146f-2532-4f5d-b4d8-d2f8cca12884 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'be318f01fac5459cb4d0f55cf374824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:20.565934 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5d7f146f-2532-4f5d-b4d8-d2f8cca12884 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7'} {{(pid=126594) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 18:04:20.576205 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5d7f146f-2532-4f5d-b4d8-d2f8cca12884 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:20.577025 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5d7f146f-2532-4f5d-b4d8-d2f8cca12884 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:20.578920 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5d7f146f-2532-4f5d-b4d8-d2f8cca12884 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:20.579659 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5d7f146f-2532-4f5d-b4d8-d2f8cca12884 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:20.642563 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-34ef33f9-d7d5-4dd8-b18d-ac8acad38cfc tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9884a0b94aed42e5aa029f6d096a3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8ad96cd98c4cf683f763099e3064a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:20.656921 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-34ef33f9-d7d5-4dd8-b18d-ac8acad38cfc tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] 10.222.0.35 "GET /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162" status: 200 len: 1331 microversion: 2.1 time: 0.904634 Jun 10 18:04:20.666691 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1088/2178] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:19 2022] GET /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162 => generated 1331 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:20.677183 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9f8e48f1-0133-4e35-a91d-273e850452a6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:20.678195 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9f8e48f1-0133-4e35-a91d-273e850452a6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:20.696118 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f8e48f1-0133-4e35-a91d-273e850452a6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:20.697370 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f8e48f1-0133-4e35-a91d-273e850452a6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:20.698693 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f8e48f1-0133-4e35-a91d-273e850452a6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:20.699369 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f8e48f1-0133-4e35-a91d-273e850452a6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:20.803321 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5d7f146f-2532-4f5d-b4d8-d2f8cca12884 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.249360 Jun 10 18:04:20.804676 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1091/2179] 10.222.0.35 () {58 vars in 1173 bytes} [Fri Jun 10 18:04:20 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:04:20.822802 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5f734d1b-362d-4232-bd2f-f5779404b1e6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:20.822802 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5f734d1b-362d-4232-bd2f-f5779404b1e6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:20.830322 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f734d1b-362d-4232-bd2f-f5779404b1e6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:20.830777 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f734d1b-362d-4232-bd2f-f5779404b1e6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:20.839900 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f734d1b-362d-4232-bd2f-f5779404b1e6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:20.840382 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f734d1b-362d-4232-bd2f-f5779404b1e6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:21.287558 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5f734d1b-362d-4232-bd2f-f5779404b1e6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:21.299268 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5f734d1b-362d-4232-bd2f-f5779404b1e6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1391 microversion: 2.1 time: 0.493255 Jun 10 18:04:21.301359 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1092/2180] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:20 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1391 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:21.308144 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2a6a0765-b5a0-4cc8-b343-eb82c169859d tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-937164181"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:21.309186 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2a6a0765-b5a0-4cc8-b343-eb82c169859d tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: 69ff0893-3da5-487f-8cb6-25763b854eaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:21.326869 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2a6a0765-b5a0-4cc8-b343-eb82c169859d tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:21.328214 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2a6a0765-b5a0-4cc8-b343-eb82c169859d tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:21.329031 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2a6a0765-b5a0-4cc8-b343-eb82c169859d tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:21.329474 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2a6a0765-b5a0-4cc8-b343-eb82c169859d tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:21.365169 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9f8e48f1-0133-4e35-a91d-273e850452a6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:21.379239 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9f8e48f1-0133-4e35-a91d-273e850452a6 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1473 microversion: 2.1 time: 0.716468 Jun 10 18:04:21.381773 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1089/2181] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:20 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1473 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:21.396948 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c6c96334-ab0b-4071-af88-14eafc3a5481 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:21.402276 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c6c96334-ab0b-4071-af88-14eafc3a5481 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 3a12492e-7860-4786-a695-48505e2c1840] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:21.427117 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c6c96334-ab0b-4071-af88-14eafc3a5481 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:21.428926 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c6c96334-ab0b-4071-af88-14eafc3a5481 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:21.432232 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c6c96334-ab0b-4071-af88-14eafc3a5481 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:21.434194 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c6c96334-ab0b-4071-af88-14eafc3a5481 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:21.568845 chdv-master-2 devstack@n-api.service[126594]: INFO nova.network.security_group_api [None req-2a6a0765-b5a0-4cc8-b343-eb82c169859d tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Adding security group 47e1dceb-00a5-420d-8917-74e6e31805d8 to port 23377b35-13e3-460e-98a2-837389f0a21d Jun 10 18:04:21.774913 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=10 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:04:21.866637 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c6c96334-ab0b-4071-af88-14eafc3a5481 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:21.881231 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c6c96334-ab0b-4071-af88-14eafc3a5481 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840" status: 200 len: 1489 microversion: 2.1 time: 0.489480 Jun 10 18:04:21.888213 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1090/2182] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:21 2022] GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840 => generated 1489 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:21.893637 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a91ab95d-5779-4364-80b9-521f960078c4 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:21.897652 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a91ab95d-5779-4364-80b9-521f960078c4 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'be318f01fac5459cb4d0f55cf374824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:21.898894 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a91ab95d-5779-4364-80b9-521f960078c4 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7'} {{(pid=126595) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 18:04:21.905207 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a91ab95d-5779-4364-80b9-521f960078c4 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:21.905892 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a91ab95d-5779-4364-80b9-521f960078c4 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:21.906864 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a91ab95d-5779-4364-80b9-521f960078c4 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:21.907510 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a91ab95d-5779-4364-80b9-521f960078c4 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:22.014192 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a91ab95d-5779-4364-80b9-521f960078c4 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.114142 Jun 10 18:04:22.014192 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1091/2183] 10.222.0.35 () {58 vars in 1183 bytes} [Fri Jun 10 18:04:21 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:04:22.014192 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8f9345d3-c1b8-4b46-ac88-30302740e806 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:22.014192 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8f9345d3-c1b8-4b46-ac88-30302740e806 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] [instance: 4864e5b5-595a-4935-80c2-2572b66f8162] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:22.016934 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8f9345d3-c1b8-4b46-ac88-30302740e806 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:22.017677 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8f9345d3-c1b8-4b46-ac88-30302740e806 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:22.018657 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8f9345d3-c1b8-4b46-ac88-30302740e806 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:22.019323 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8f9345d3-c1b8-4b46-ac88-30302740e806 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:22.173179 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2a6a0765-b5a0-4cc8-b343-eb82c169859d tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "POST /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa/action" status: 202 len: 0 microversion: 2.1 time: 0.869921 Jun 10 18:04:22.177162 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1093/2184] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:04:21 2022] POST /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa/action => generated 0 bytes in 872 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:04:22.181636 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-121efc6f-897a-46fc-80c7-dc8a8f5eb7d1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:22.186080 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-121efc6f-897a-46fc-80c7-dc8a8f5eb7d1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:22.203494 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-121efc6f-897a-46fc-80c7-dc8a8f5eb7d1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:22.204396 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-121efc6f-897a-46fc-80c7-dc8a8f5eb7d1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:22.205456 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-121efc6f-897a-46fc-80c7-dc8a8f5eb7d1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:22.206129 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-121efc6f-897a-46fc-80c7-dc8a8f5eb7d1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:22.215301 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:04:22.255486 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8f9345d3-c1b8-4b46-ac88-30302740e806 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9884a0b94aed42e5aa029f6d096a3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8ad96cd98c4cf683f763099e3064a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:22.269668 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8f9345d3-c1b8-4b46-ac88-30302740e806 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] 10.222.0.35 "GET /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162" status: 200 len: 1331 microversion: 2.1 time: 0.263958 Jun 10 18:04:22.277668 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1092/2185] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:22 2022] GET /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162 => generated 1331 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:22.290722 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dd456664-febe-410a-8980-23499357ffbd tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:22.290722 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-dd456664-febe-410a-8980-23499357ffbd tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'be318f01fac5459cb4d0f55cf374824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:22.290722 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dd456664-febe-410a-8980-23499357ffbd tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Searching by: {'deleted': False, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7'} {{(pid=126595) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 18:04:22.296100 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd456664-febe-410a-8980-23499357ffbd tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:22.297206 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd456664-febe-410a-8980-23499357ffbd tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:22.298012 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd456664-febe-410a-8980-23499357ffbd tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:22.298456 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd456664-febe-410a-8980-23499357ffbd tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:22.329290 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.multi_cell_list [None req-dd456664-febe-410a-8980-23499357ffbd tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126595) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 10 18:04:22.398220 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-dd456664-febe-410a-8980-23499357ffbd tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be318f01fac5459cb4d0f55cf374824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:22.408616 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd456664-febe-410a-8980-23499357ffbd tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:22.409336 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd456664-febe-410a-8980-23499357ffbd tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:22.644268 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dd456664-febe-410a-8980-23499357ffbd tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "GET /compute/v2.1/servers/detail" status: 200 len: 3023 microversion: 2.1 time: 0.365307 Jun 10 18:04:22.646576 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1093/2186] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 18:04:22 2022] GET /compute/v2.1/servers/detail => generated 3023 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:22.661155 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d996a969-2be5-47ae-a933-8c8472d5a851 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:22.661836 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d996a969-2be5-47ae-a933-8c8472d5a851 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: 69ff0893-3da5-487f-8cb6-25763b854eaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:22.676776 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d996a969-2be5-47ae-a933-8c8472d5a851 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:22.678409 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d996a969-2be5-47ae-a933-8c8472d5a851 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:22.681510 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d996a969-2be5-47ae-a933-8c8472d5a851 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:22.683754 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d996a969-2be5-47ae-a933-8c8472d5a851 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:22.792740 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-121efc6f-897a-46fc-80c7-dc8a8f5eb7d1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "POST /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1/action" status: 200 len: 128 microversion: 2.1 time: 0.616185 Jun 10 18:04:22.795322 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1094/2187] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:04:22 2022] POST /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1/action => generated 128 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:22.808729 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-95183fc5-804b-44a3-bc92-07834bbda655 req-48418223-87d2-4a02-8ffc-40d5874db657 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69ff0893-3da5-487f-8cb6-25763b854eaa", "tag": "23377b35-13e3-460e-98a2-837389f0a21d"}, {"name": "network-changed", "server_uuid": "4864e5b5-595a-4935-80c2-2572b66f8162", "tag": "40a20790-d62d-4bb6-98d8-b36feab7f804"}, {"name": "network-changed", "server_uuid": "69ff0893-3da5-487f-8cb6-25763b854eaa", "tag": "23377b35-13e3-460e-98a2-837389f0a21d"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:22.853571 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-95183fc5-804b-44a3-bc92-07834bbda655 req-48418223-87d2-4a02-8ffc-40d5874db657 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:22.854596 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-95183fc5-804b-44a3-bc92-07834bbda655 req-48418223-87d2-4a02-8ffc-40d5874db657 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:22.885243 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-95183fc5-804b-44a3-bc92-07834bbda655 req-48418223-87d2-4a02-8ffc-40d5874db657 service nova] Creating event network-changed:23377b35-13e3-460e-98a2-837389f0a21d for instance 69ff0893-3da5-487f-8cb6-25763b854eaa on chh1-master-2 Jun 10 18:04:22.886025 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-95183fc5-804b-44a3-bc92-07834bbda655 req-48418223-87d2-4a02-8ffc-40d5874db657 service nova] Creating event network-changed:40a20790-d62d-4bb6-98d8-b36feab7f804 for instance 4864e5b5-595a-4935-80c2-2572b66f8162 on chh1-master-2 Jun 10 18:04:22.886702 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-95183fc5-804b-44a3-bc92-07834bbda655 req-48418223-87d2-4a02-8ffc-40d5874db657 service nova] Creating event network-changed:23377b35-13e3-460e-98a2-837389f0a21d for instance 69ff0893-3da5-487f-8cb6-25763b854eaa on chh1-master-2 Jun 10 18:04:22.893632 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-95183fc5-804b-44a3-bc92-07834bbda655 req-48418223-87d2-4a02-8ffc-40d5874db657 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.095792 Jun 10 18:04:22.894576 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1095/2188] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:22.899943 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6a57f855-b2da-4318-bcbd-f636d020e65b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:22.900909 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6a57f855-b2da-4318-bcbd-f636d020e65b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:22.908446 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6a57f855-b2da-4318-bcbd-f636d020e65b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:22.909457 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6a57f855-b2da-4318-bcbd-f636d020e65b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:22.910407 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6a57f855-b2da-4318-bcbd-f636d020e65b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:22.911015 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6a57f855-b2da-4318-bcbd-f636d020e65b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:23.479622 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6a57f855-b2da-4318-bcbd-f636d020e65b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:23.492608 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6a57f855-b2da-4318-bcbd-f636d020e65b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1391 microversion: 2.1 time: 0.592749 Jun 10 18:04:23.520041 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1096/2189] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:22 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1391 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:23.541280 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-488ba427-2573-4189-99cb-21d65f7139bb tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:23.543117 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-488ba427-2573-4189-99cb-21d65f7139bb tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:23.557812 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-488ba427-2573-4189-99cb-21d65f7139bb tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:23.558323 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-488ba427-2573-4189-99cb-21d65f7139bb tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:23.560028 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-488ba427-2573-4189-99cb-21d65f7139bb tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:23.560538 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-488ba427-2573-4189-99cb-21d65f7139bb tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:23.717394 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d996a969-2be5-47ae-a933-8c8472d5a851 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa/os-security-groups" status: 200 len: 1155 microversion: 2.1 time: 1.068075 Jun 10 18:04:23.719256 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1094/2190] 10.222.0.35 () {58 vars in 1292 bytes} [Fri Jun 10 18:04:22 2022] GET /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa/os-security-groups => generated 1155 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:23.734115 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f2cacd50-2351-43a5-a05c-1032cf64bd20 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:23.747550 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f2cacd50-2351-43a5-a05c-1032cf64bd20 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'be318f01fac5459cb4d0f55cf374824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:23.750895 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f2cacd50-2351-43a5-a05c-1032cf64bd20 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.028119 Jun 10 18:04:23.752741 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1095/2191] 10.222.0.35 () {58 vars in 1177 bytes} [Fri Jun 10 18:04:23 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:04:23.769208 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4ae9c365-c858-4af9-a70d-24d975c8bd07 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:23.772330 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4ae9c365-c858-4af9-a70d-24d975c8bd07 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:23.783160 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ae9c365-c858-4af9-a70d-24d975c8bd07 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:23.784426 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ae9c365-c858-4af9-a70d-24d975c8bd07 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:23.785932 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ae9c365-c858-4af9-a70d-24d975c8bd07 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:23.787032 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ae9c365-c858-4af9-a70d-24d975c8bd07 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:23.883338 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-488ba427-2573-4189-99cb-21d65f7139bb tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:23.896428 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-488ba427-2573-4189-99cb-21d65f7139bb tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1473 microversion: 2.1 time: 0.372780 Jun 10 18:04:23.897719 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1097/2192] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:23 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1473 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:23.902987 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0467a138-1822-44f2-9bd4-cc55d5f07f6c tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:23.903865 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0467a138-1822-44f2-9bd4-cc55d5f07f6c tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] [instance: 4864e5b5-595a-4935-80c2-2572b66f8162] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:23.923444 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0467a138-1822-44f2-9bd4-cc55d5f07f6c tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:23.924730 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0467a138-1822-44f2-9bd4-cc55d5f07f6c tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:23.927448 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0467a138-1822-44f2-9bd4-cc55d5f07f6c tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:23.928130 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0467a138-1822-44f2-9bd4-cc55d5f07f6c tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:24.049210 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4ae9c365-c858-4af9-a70d-24d975c8bd07 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:24.068290 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4ae9c365-c858-4af9-a70d-24d975c8bd07 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.306367 Jun 10 18:04:24.072161 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1096/2193] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:23 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:24.077288 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ebb5f673-3ccc-4fd9-9d89-a241701a3a35 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Action: 'create', calling method: .version_select at 0x7f77c16909d0>, body: {"security_group": {"name": " tempest-securitygroup -320187166 ", "description": "tempest-description-1396132110"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:24.502759 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0467a138-1822-44f2-9bd4-cc55d5f07f6c tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9884a0b94aed42e5aa029f6d096a3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8ad96cd98c4cf683f763099e3064a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:24.517244 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0467a138-1822-44f2-9bd4-cc55d5f07f6c tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] 10.222.0.35 "GET /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162" status: 200 len: 1331 microversion: 2.1 time: 0.617497 Jun 10 18:04:24.527530 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1098/2194] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:23 2022] GET /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162 => generated 1331 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:24.527530 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e2da3484-7a76-4a84-9069-6cdd560f5b52 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:24.529078 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e2da3484-7a76-4a84-9069-6cdd560f5b52 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'be318f01fac5459cb4d0f55cf374824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:24.530779 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e2da3484-7a76-4a84-9069-6cdd560f5b52 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Searching by: {'deleted': False, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7'} {{(pid=126594) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 18:04:24.538393 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e2da3484-7a76-4a84-9069-6cdd560f5b52 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:24.539098 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e2da3484-7a76-4a84-9069-6cdd560f5b52 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:24.539958 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e2da3484-7a76-4a84-9069-6cdd560f5b52 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:24.540646 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e2da3484-7a76-4a84-9069-6cdd560f5b52 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:24.601521 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.multi_cell_list [None req-e2da3484-7a76-4a84-9069-6cdd560f5b52 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126594) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 10 18:04:24.635110 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e2da3484-7a76-4a84-9069-6cdd560f5b52 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.115915 Jun 10 18:04:24.643872 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1099/2195] 10.222.0.35 () {58 vars in 1124 bytes} [Fri Jun 10 18:04:24 2022] GET /compute/v2.1/servers => generated 683 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:24.650086 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3f4eed0a-d5fd-4031-9be4-9d21c2abbb4b tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:24.658940 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3f4eed0a-d5fd-4031-9be4-9d21c2abbb4b tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:24.658940 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f4eed0a-d5fd-4031-9be4-9d21c2abbb4b tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:24.658940 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f4eed0a-d5fd-4031-9be4-9d21c2abbb4b tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:24.658940 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f4eed0a-d5fd-4031-9be4-9d21c2abbb4b tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:24.659904 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f4eed0a-d5fd-4031-9be4-9d21c2abbb4b tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:24.766895 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ebb5f673-3ccc-4fd9-9d89-a241701a3a35 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.692584 Jun 10 18:04:24.766895 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1097/2196] 10.222.0.35 () {60 vars in 1179 bytes} [Fri Jun 10 18:04:24 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:25.002205 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3f4eed0a-d5fd-4031-9be4-9d21c2abbb4b tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:25.015894 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3f4eed0a-d5fd-4031-9be4-9d21c2abbb4b tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.370393 Jun 10 18:04:25.016518 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1100/2197] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:24 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:25.028770 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ec3fe30a-bba8-4e6b-9d6d-6d8acc8b3e14 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:25.030498 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ec3fe30a-bba8-4e6b-9d6d-6d8acc8b3e14 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] [instance: aba801d8-0f5d-49d2-9d2a-be6a81cee5e7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:25.051124 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec3fe30a-bba8-4e6b-9d6d-6d8acc8b3e14 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:25.051608 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec3fe30a-bba8-4e6b-9d6d-6d8acc8b3e14 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:25.052883 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec3fe30a-bba8-4e6b-9d6d-6d8acc8b3e14 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:25.052883 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec3fe30a-bba8-4e6b-9d6d-6d8acc8b3e14 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:25.101297 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-ec3fe30a-bba8-4e6b-9d6d-6d8acc8b3e14 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] HTTP exception thrown: Instance aba801d8-0f5d-49d2-9d2a-be6a81cee5e7 could not be found. Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ec3fe30a-bba8-4e6b-9d6d-6d8acc8b3e14 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Request method failure captured: Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: request: DELETE /compute/v2.1/servers/aba801d8-0f5d-49d2-9d2a-be6a81cee5e7 HTTP/1.1 Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4d2g6LisIDVkTYTcdOtG0A3umrUEUWfSSdKBZBTZSGZWByrOwwCj-5KqksYro3H1okjI-zzuU5IHUS4lo6yG-r96m6TXL_G3wFZOzgUE1VCvpXQWprzUOsbOtrwUJG6ZZ0kitxUWkFBtgkuEIiNHG9TcUYzDRR5llGfQuUx6UFa3gE Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 8f24d6db014a4fecb9533fa4cf1be8c7 Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ListServersNegativeTestJSON-1230596670 Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/8f24d6db014a4fecb9533fa4cf1be8c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8f24d6db014a4fecb9533fa4cf1be8c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8f24d6db014a4fecb9533fa4cf1be8c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_8f24d6db014a4fecb9533fa4cf1be8c7", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ListServersNegativeTestJSON-1230596670 Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 8f24d6db014a4fecb9533fa4cf1be8c7 Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1230596670 Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ListServersNegativeTestJSON-1230596670-project Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: be318f01fac5459cb4d0f55cf374824f Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ListServersNegativeTestJSON-1230596670-project Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: exception: Instance aba801d8-0f5d-49d2-9d2a-be6a81cee5e7 could not be found. Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'aba801d8-0f5d-49d2-9d2a-be6a81cee5e7'} Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aba801d8-0f5d-49d2-9d2a-be6a81cee5e7 could not be found. Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:04:25.106738 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:04:25.116988 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aba801d8-0f5d-49d2-9d2a-be6a81cee5e7 could not be found. Jun 10 18:04:25.116988 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:25.116988 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:25.116988 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:25.116988 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:25.116988 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:04:25.116988 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:04:25.116988 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:04:25.116988 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:04:25.116988 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aba801d8-0f5d-49d2-9d2a-be6a81cee5e7 could not be found. Jun 10 18:04:25.116988 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:25.120642 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ec3fe30a-bba8-4e6b-9d6d-6d8acc8b3e14 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Returning 404 to user: Instance aba801d8-0f5d-49d2-9d2a-be6a81cee5e7 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:04:25.121749 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ec3fe30a-bba8-4e6b-9d6d-6d8acc8b3e14 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "DELETE /compute/v2.1/servers/aba801d8-0f5d-49d2-9d2a-be6a81cee5e7" status: 404 len: 111 microversion: 2.1 time: 0.104020 Jun 10 18:04:25.126917 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1101/2198] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:04:25 2022] DELETE /compute/v2.1/servers/aba801d8-0f5d-49d2-9d2a-be6a81cee5e7 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:04:25.140788 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-259547ec-4848-4541-8cea-3456e5ab1ce9 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '.version_select at 0x7f77c0da8af0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:25.170756 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-610e75fe-12ae-4492-8d71-1b6f540dd069 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:25.178252 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-610e75fe-12ae-4492-8d71-1b6f540dd069 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:25.206060 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-610e75fe-12ae-4492-8d71-1b6f540dd069 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:25.207309 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-610e75fe-12ae-4492-8d71-1b6f540dd069 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:25.210662 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-610e75fe-12ae-4492-8d71-1b6f540dd069 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:25.214516 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-610e75fe-12ae-4492-8d71-1b6f540dd069 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:25.350430 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-259547ec-4848-4541-8cea-3456e5ab1ce9 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/os-security-groups/567a4f18-6e05-4aa8-935c-c35e1bfd1649" status: 200 len: 223 microversion: 2.1 time: 0.222039 Jun 10 18:04:25.351375 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1102/2199] 10.222.0.35 () {58 vars in 1268 bytes} [Fri Jun 10 18:04:25 2022] GET /compute/v2.1/os-security-groups/567a4f18-6e05-4aa8-935c-c35e1bfd1649 => generated 223 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:25.357093 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-78342d37-63e5-4a72-acba-d2fa7a17973a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:25.358292 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-78342d37-63e5-4a72-acba-d2fa7a17973a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:25.372357 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-78342d37-63e5-4a72-acba-d2fa7a17973a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:25.375371 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-78342d37-63e5-4a72-acba-d2fa7a17973a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:25.377261 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-78342d37-63e5-4a72-acba-d2fa7a17973a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:25.378731 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-78342d37-63e5-4a72-acba-d2fa7a17973a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:25.631771 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-610e75fe-12ae-4492-8d71-1b6f540dd069 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:25.650555 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-610e75fe-12ae-4492-8d71-1b6f540dd069 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1391 microversion: 2.1 time: 0.881613 Jun 10 18:04:25.664799 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-78342d37-63e5-4a72-acba-d2fa7a17973a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:25.666773 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1098/2200] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:24 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1391 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:25.674213 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-81a95c9b-f33c-4d8d-916a-9afbb60bd67d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:25.675268 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-81a95c9b-f33c-4d8d-916a-9afbb60bd67d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:25.686785 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-78342d37-63e5-4a72-acba-d2fa7a17973a tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1470 microversion: 2.1 time: 0.329941 Jun 10 18:04:25.689245 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1103/2201] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:25 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1470 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:25.698570 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-17a6568b-0bb8-4ca4-a460-7d363796ab46 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:25.704191 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-17a6568b-0bb8-4ca4-a460-7d363796ab46 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] [instance: 07e79e24-76e1-476b-b064-a6729174e2ff] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:25.714462 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-17a6568b-0bb8-4ca4-a460-7d363796ab46 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:25.714927 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-17a6568b-0bb8-4ca4-a460-7d363796ab46 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:25.719791 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-81a95c9b-f33c-4d8d-916a-9afbb60bd67d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:25.720338 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-81a95c9b-f33c-4d8d-916a-9afbb60bd67d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:25.720476 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-17a6568b-0bb8-4ca4-a460-7d363796ab46 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:25.721016 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-17a6568b-0bb8-4ca4-a460-7d363796ab46 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:25.721633 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-81a95c9b-f33c-4d8d-916a-9afbb60bd67d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:25.722152 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-81a95c9b-f33c-4d8d-916a-9afbb60bd67d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:25.779433 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-17a6568b-0bb8-4ca4-a460-7d363796ab46 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] [instance: 07e79e24-76e1-476b-b064-a6729174e2ff] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:04:26.241743 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-17a6568b-0bb8-4ca4-a460-7d363796ab46 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "DELETE /compute/v2.1/servers/07e79e24-76e1-476b-b064-a6729174e2ff" status: 204 len: 0 microversion: 2.1 time: 0.550691 Jun 10 18:04:26.246238 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1104/2202] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:04:25 2022] DELETE /compute/v2.1/servers/07e79e24-76e1-476b-b064-a6729174e2ff => generated 0 bytes in 553 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:04:26.254804 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8e1c8bf1-e203-4c0a-903e-e452d95b1f53 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '.version_select at 0x7f77c08fcdc0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:26.308061 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-81a95c9b-f33c-4d8d-916a-9afbb60bd67d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:26.316534 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-81a95c9b-f33c-4d8d-916a-9afbb60bd67d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.648226 Jun 10 18:04:26.321878 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1099/2203] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:25 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:26.366733 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a75bfb8f-8674-4434-a1c2-45292077fec7 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:26.366733 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a75bfb8f-8674-4434-a1c2-45292077fec7 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] [instance: 4864e5b5-595a-4935-80c2-2572b66f8162] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:26.387156 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a75bfb8f-8674-4434-a1c2-45292077fec7 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:26.387618 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a75bfb8f-8674-4434-a1c2-45292077fec7 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:26.388515 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a75bfb8f-8674-4434-a1c2-45292077fec7 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:26.388940 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a75bfb8f-8674-4434-a1c2-45292077fec7 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:26.639009 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a75bfb8f-8674-4434-a1c2-45292077fec7 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9884a0b94aed42e5aa029f6d096a3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8ad96cd98c4cf683f763099e3064a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:26.649165 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a75bfb8f-8674-4434-a1c2-45292077fec7 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] 10.222.0.35 "GET /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162" status: 200 len: 1331 microversion: 2.1 time: 0.310773 Jun 10 18:04:26.660717 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1100/2204] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:26 2022] GET /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162 => generated 1331 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:26.667227 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-86c82181-97ab-48e2-b092-e89ec6e3398f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:26.668923 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-86c82181-97ab-48e2-b092-e89ec6e3398f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:26.677705 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86c82181-97ab-48e2-b092-e89ec6e3398f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:26.678453 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86c82181-97ab-48e2-b092-e89ec6e3398f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:26.679402 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86c82181-97ab-48e2-b092-e89ec6e3398f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:26.680051 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86c82181-97ab-48e2-b092-e89ec6e3398f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:26.784132 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:04:26.897216 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8e1c8bf1-e203-4c0a-903e-e452d95b1f53 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "DELETE /compute/v2.1/os-security-groups/567a4f18-6e05-4aa8-935c-c35e1bfd1649" status: 202 len: 0 microversion: 2.1 time: 0.649332 Jun 10 18:04:26.898497 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1105/2205] 10.222.0.35 () {58 vars in 1271 bytes} [Fri Jun 10 18:04:26 2022] DELETE /compute/v2.1/os-security-groups/567a4f18-6e05-4aa8-935c-c35e1bfd1649 => generated 0 bytes in 651 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:04:26.913351 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-99f6530a-7d63-4648-b3e2-4eda9a383d26 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:26.913351 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-99f6530a-7d63-4648-b3e2-4eda9a383d26 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] [instance: ca923f2e-f40e-4c7c-bede-58ab9cda2763] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:26.916193 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-99f6530a-7d63-4648-b3e2-4eda9a383d26 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:26.917330 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-99f6530a-7d63-4648-b3e2-4eda9a383d26 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:26.918636 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-99f6530a-7d63-4648-b3e2-4eda9a383d26 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:26.919315 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-99f6530a-7d63-4648-b3e2-4eda9a383d26 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:26.957973 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-99f6530a-7d63-4648-b3e2-4eda9a383d26 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] [instance: ca923f2e-f40e-4c7c-bede-58ab9cda2763] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:04:27.226735 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-86c82181-97ab-48e2-b092-e89ec6e3398f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "POST /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d/action" status: 202 len: 0 microversion: 2.1 time: 0.564275 Jun 10 18:04:27.230333 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1101/2206] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:04:26 2022] POST /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d/action => generated 0 bytes in 569 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:04:27.236728 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ceb525ea-8bcf-486c-aaa9-6178dde2cc5b tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:27.237587 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ceb525ea-8bcf-486c-aaa9-6178dde2cc5b tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:27.246975 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ceb525ea-8bcf-486c-aaa9-6178dde2cc5b tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:27.247572 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ceb525ea-8bcf-486c-aaa9-6178dde2cc5b tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:27.248930 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ceb525ea-8bcf-486c-aaa9-6178dde2cc5b tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:27.249153 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ceb525ea-8bcf-486c-aaa9-6178dde2cc5b tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:27.432458 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ceb525ea-8bcf-486c-aaa9-6178dde2cc5b tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:27.441102 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ceb525ea-8bcf-486c-aaa9-6178dde2cc5b tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.208754 Jun 10 18:04:27.460970 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1102/2207] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:27 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:27.520743 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-99f6530a-7d63-4648-b3e2-4eda9a383d26 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "DELETE /compute/v2.1/servers/ca923f2e-f40e-4c7c-bede-58ab9cda2763" status: 204 len: 0 microversion: 2.1 time: 0.620755 Jun 10 18:04:27.521588 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1106/2208] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:04:26 2022] DELETE /compute/v2.1/servers/ca923f2e-f40e-4c7c-bede-58ab9cda2763 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:04:27.527053 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-27244f0d-621e-4a4d-b290-fee1ca9633d7 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:27.527806 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-27244f0d-621e-4a4d-b290-fee1ca9633d7 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:27.543879 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27244f0d-621e-4a4d-b290-fee1ca9633d7 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:27.544429 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27244f0d-621e-4a4d-b290-fee1ca9633d7 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:27.545228 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27244f0d-621e-4a4d-b290-fee1ca9633d7 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:27.549181 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27244f0d-621e-4a4d-b290-fee1ca9633d7 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:27.562165 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9578e642-1ed5-4630-9f72-72b13a0c3260 tempest-FloatingIPDetailsNegativeTestJSON-1767128215 tempest-FloatingIPDetailsNegativeTestJSON-1767128215-project] Calling method '.version_select at 0x7f77c05eb160>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:27.648204 chdv-master-2 devstack@n-api.service[126595]: DEBUG neutronclient.v2_0.client [None req-9578e642-1ed5-4630-9f72-72b13a0c3260 tempest-FloatingIPDetailsNegativeTestJSON-1767128215 tempest-FloatingIPDetailsNegativeTestJSON-1767128215-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 168c1fd9-dfd2-452a-a60c-45cdb3ecb6be could not be found", "detail": ""}} {{(pid=126595) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 10 18:04:27.648935 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-9578e642-1ed5-4630-9f72-72b13a0c3260 tempest-FloatingIPDetailsNegativeTestJSON-1767128215 tempest-FloatingIPDetailsNegativeTestJSON-1767128215-project] HTTP exception thrown: Floating IP not found for ID 168c1fd9-dfd2-452a-a60c-45cdb3ecb6be Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9578e642-1ed5-4630-9f72-72b13a0c3260 tempest-FloatingIPDetailsNegativeTestJSON-1767128215 tempest-FloatingIPDetailsNegativeTestJSON-1767128215-project] Request method failure captured: Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/os-floating-ips/168c1fd9-dfd2-452a-a60c-45cdb3ecb6be HTTP/1.1 Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4eqVyLuN0c7EBFcavlfrIi8Wlszak2n4HknNvtOljOmXPZe0NnE1N9bs-Q-9Vo87IANLCNarJqgzoTxqsU8aBeMxze1ASVbHMLGKMzP8ibiMo2aphgUiRJF2M1G3K5dv4BuUm78mvlCOYdnmRuVmlpri6MUWR1JzrUVEVgNH0DT8dY Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 8a05b56174ee4cb08e35b28e93409cca Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1767128215 Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/8a05b56174ee4cb08e35b28e93409cca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8a05b56174ee4cb08e35b28e93409cca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8a05b56174ee4cb08e35b28e93409cca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_8a05b56174ee4cb08e35b28e93409cca", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1767128215 Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 8a05b56174ee4cb08e35b28e93409cca Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1767128215 Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1767128215-project Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 43feeb3e2c7c42e1b715aa4d5f977e9b Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1767128215-project Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: exception: Floating IP not found for ID 168c1fd9-dfd2-452a-a60c-45cdb3ecb6be Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '168c1fd9-dfd2-452a-a60c-45cdb3ecb6be'} Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2810, in get_floating_ip Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 168c1fd9-dfd2-452a-a60c-45cdb3ecb6be could not be found Jun 10 18:04:27.650901 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-206b6667-3744-4634-bb7c-6a30b23431c9'] Jun 10 18:04:27.660527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:27.660527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:27.660527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:27.660527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:27.660527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jun 10 18:04:27.660527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jun 10 18:04:27.660527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2813, in get_floating_ip Jun 10 18:04:27.660527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jun 10 18:04:27.660527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 168c1fd9-dfd2-452a-a60c-45cdb3ecb6be. Jun 10 18:04:27.660527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:27.660527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:27.660527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:27.660527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:27.660527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:04:27.660527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:04:27.660527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:04:27.660527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:04:27.660527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:04:27.660527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:04:27.660527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:04:27.660527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:04:27.660527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jun 10 18:04:27.660527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 10 18:04:27.660527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 168c1fd9-dfd2-452a-a60c-45cdb3ecb6be Jun 10 18:04:27.660527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:27.660527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:27.660527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:27.660527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:27.660527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:04:27.660527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:04:27.660527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:04:27.660527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:04:27.660527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 168c1fd9-dfd2-452a-a60c-45cdb3ecb6be Jun 10 18:04:27.660527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:27.660527 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9578e642-1ed5-4630-9f72-72b13a0c3260 tempest-FloatingIPDetailsNegativeTestJSON-1767128215 tempest-FloatingIPDetailsNegativeTestJSON-1767128215-project] Returning 404 to user: Floating IP not found for ID 168c1fd9-dfd2-452a-a60c-45cdb3ecb6be {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:04:27.660527 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9578e642-1ed5-4630-9f72-72b13a0c3260 tempest-FloatingIPDetailsNegativeTestJSON-1767128215 tempest-FloatingIPDetailsNegativeTestJSON-1767128215-project] 10.222.0.35 "GET /compute/v2.1/os-floating-ips/168c1fd9-dfd2-452a-a60c-45cdb3ecb6be" status: 404 len: 111 microversion: 2.1 time: 0.190258 Jun 10 18:04:27.660527 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1103/2209] 10.222.0.35 () {58 vars in 1259 bytes} [Fri Jun 10 18:04:27 2022] GET /compute/v2.1/os-floating-ips/168c1fd9-dfd2-452a-a60c-45cdb3ecb6be => generated 111 bytes in 193 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:04:27.664058 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fbe8940e-4c82-46ad-a11c-362059dd9489 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '.version_select at 0x7f77c12c3af0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:27.734114 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-27244f0d-621e-4a4d-b290-fee1ca9633d7 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:27.743734 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-27244f0d-621e-4a4d-b290-fee1ca9633d7 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1391 microversion: 2.1 time: 0.220853 Jun 10 18:04:27.755792 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1107/2210] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:27 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1391 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:27.761551 chdv-master-2 devstack@n-api.service[126595]: DEBUG neutronclient.v2_0.client [None req-fbe8940e-4c82-46ad-a11c-362059dd9489 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 567a4f18-6e05-4aa8-935c-c35e1bfd1649 does not exist", "detail": ""}} {{(pid=126595) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 10 18:04:27.762156 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.security_group_api [None req-fbe8940e-4c82-46ad-a11c-362059dd9489 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Neutron security group 567a4f18-6e05-4aa8-935c-c35e1bfd1649 not found {{(pid=126595) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 10 18:04:27.762797 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-fbe8940e-4c82-46ad-a11c-362059dd9489 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] HTTP exception thrown: Security group 567a4f18-6e05-4aa8-935c-c35e1bfd1649 does not exist Jun 10 18:04:27.762797 chdv-master-2 devstack@n-api.service[126595]: Neutron server returns request_ids: ['req-1a0b1615-e02d-4ef2-8d09-8287e600cc8e'] Jun 10 18:04:27.765675 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-64de9eb7-6b1a-494e-9eac-b346cce3d154 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:27.766580 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-64de9eb7-6b1a-494e-9eac-b346cce3d154 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:27.773290 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-64de9eb7-6b1a-494e-9eac-b346cce3d154 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:27.773956 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-64de9eb7-6b1a-494e-9eac-b346cce3d154 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fbe8940e-4c82-46ad-a11c-362059dd9489 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Request method failure captured: Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/os-security-groups/567a4f18-6e05-4aa8-935c-c35e1bfd1649 HTTP/1.1 Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4eKfGQZQ_jvhwHBxZ1GMnYHkMaBNBt7T8Ue90hW5x7BTDgkg2AiOfeu2huz2YQsnFH29P56VFWZd48_hROirge71TvR4QiKyTENHZz-D3t9ZS-m9216ej7Rjuw3slpnWYAQuE-KXkyXTlRqKM7yyNbBp9KRqjUFN-v2IWlTc7Yfat0 Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 304a5340852d4552a490e874dda8a0a3 Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_304a5340852d4552a490e874dda8a0a3", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 304a5340852d4552a490e874dda8a0a3 Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-SecurityGroupsTestJSON-732923421-project Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 7278ccddeee3495583093603a0fdb626 Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-SecurityGroupsTestJSON-732923421-project Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: exception: Security group 567a4f18-6e05-4aa8-935c-c35e1bfd1649 does not exist Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: Neutron server returns request_ids: ['req-1a0b1615-e02d-4ef2-8d09-8287e600cc8e'] Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '567a4f18-6e05-4aa8-935c-c35e1bfd1649'} Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 10 18:04:27.777572 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 567a4f18-6e05-4aa8-935c-c35e1bfd1649 does not exist Jun 10 18:04:27.781989 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1a0b1615-e02d-4ef2-8d09-8287e600cc8e'] Jun 10 18:04:27.781989 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:27.781989 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:27.781989 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:27.781989 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:27.781989 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jun 10 18:04:27.781989 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 10 18:04:27.781989 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 10 18:04:27.781989 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 10 18:04:27.781989 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 567a4f18-6e05-4aa8-935c-c35e1bfd1649 does not exist Jun 10 18:04:27.781989 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1a0b1615-e02d-4ef2-8d09-8287e600cc8e'] Jun 10 18:04:27.781989 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:27.781989 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:27.781989 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:27.781989 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:27.781989 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:04:27.781989 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:04:27.781989 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:04:27.781989 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:04:27.781989 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:04:27.781989 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:04:27.781989 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:04:27.781989 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:04:27.781989 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jun 10 18:04:27.781989 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 10 18:04:27.781989 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 567a4f18-6e05-4aa8-935c-c35e1bfd1649 does not exist Jun 10 18:04:27.781989 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1a0b1615-e02d-4ef2-8d09-8287e600cc8e'] Jun 10 18:04:27.781989 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:27.781989 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:27.781989 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:27.781989 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:27.781989 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:04:27.781989 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:04:27.781989 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:04:27.781989 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:04:27.781989 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 567a4f18-6e05-4aa8-935c-c35e1bfd1649 does not exist Jun 10 18:04:27.781989 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1a0b1615-e02d-4ef2-8d09-8287e600cc8e'] Jun 10 18:04:27.781989 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:27.781989 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fbe8940e-4c82-46ad-a11c-362059dd9489 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Returning 404 to user: Security group 567a4f18-6e05-4aa8-935c-c35e1bfd1649 does not exist Jun 10 18:04:27.781989 chdv-master-2 devstack@n-api.service[126595]: Neutron server returns request_ids: ['req-1a0b1615-e02d-4ef2-8d09-8287e600cc8e'] {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:04:27.781989 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fbe8940e-4c82-46ad-a11c-362059dd9489 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/os-security-groups/567a4f18-6e05-4aa8-935c-c35e1bfd1649" status: 404 len: 194 microversion: 2.1 time: 0.124257 Jun 10 18:04:27.785056 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1104/2211] 10.222.0.35 () {58 vars in 1268 bytes} [Fri Jun 10 18:04:27 2022] GET /compute/v2.1/os-security-groups/567a4f18-6e05-4aa8-935c-c35e1bfd1649 => generated 194 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:04:27.795364 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-64de9eb7-6b1a-494e-9eac-b346cce3d154 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:27.795592 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3ec6430c-dee4-4537-aec2-4795fa2351cd tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:27.796439 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-64de9eb7-6b1a-494e-9eac-b346cce3d154 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:27.797324 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3ec6430c-dee4-4537-aec2-4795fa2351cd tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] [instance: aba801d8-0f5d-49d2-9d2a-be6a81cee5e7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:27.812986 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3ec6430c-dee4-4537-aec2-4795fa2351cd tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:27.813443 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3ec6430c-dee4-4537-aec2-4795fa2351cd tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:27.814237 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3ec6430c-dee4-4537-aec2-4795fa2351cd tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:27.815434 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3ec6430c-dee4-4537-aec2-4795fa2351cd tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:27.842970 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-3ec6430c-dee4-4537-aec2-4795fa2351cd tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] HTTP exception thrown: Instance aba801d8-0f5d-49d2-9d2a-be6a81cee5e7 could not be found. Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3ec6430c-dee4-4537-aec2-4795fa2351cd tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Request method failure captured: Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/aba801d8-0f5d-49d2-9d2a-be6a81cee5e7 HTTP/1.1 Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4d2g6LisIDVkTYTcdOtG0A3umrUEUWfSSdKBZBTZSGZWByrOwwCj-5KqksYro3H1okjI-zzuU5IHUS4lo6yG-r96m6TXL_G3wFZOzgUE1VCvpXQWprzUOsbOtrwUJG6ZZ0kitxUWkFBtgkuEIiNHG9TcUYzDRR5llGfQuUx6UFa3gE Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 8f24d6db014a4fecb9533fa4cf1be8c7 Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ListServersNegativeTestJSON-1230596670 Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/8f24d6db014a4fecb9533fa4cf1be8c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8f24d6db014a4fecb9533fa4cf1be8c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8f24d6db014a4fecb9533fa4cf1be8c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_8f24d6db014a4fecb9533fa4cf1be8c7", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ListServersNegativeTestJSON-1230596670 Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 8f24d6db014a4fecb9533fa4cf1be8c7 Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1230596670 Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ListServersNegativeTestJSON-1230596670-project Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: be318f01fac5459cb4d0f55cf374824f Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ListServersNegativeTestJSON-1230596670-project Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: exception: Instance aba801d8-0f5d-49d2-9d2a-be6a81cee5e7 could not be found. Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'aba801d8-0f5d-49d2-9d2a-be6a81cee5e7'} Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aba801d8-0f5d-49d2-9d2a-be6a81cee5e7 could not be found. Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aba801d8-0f5d-49d2-9d2a-be6a81cee5e7 could not be found. Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:27.844748 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:27.850533 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:27.850533 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:04:27.850533 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:04:27.850533 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:04:27.850533 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:04:27.850533 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aba801d8-0f5d-49d2-9d2a-be6a81cee5e7 could not be found. Jun 10 18:04:27.850533 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:27.850533 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3ec6430c-dee4-4537-aec2-4795fa2351cd tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Returning 404 to user: Instance aba801d8-0f5d-49d2-9d2a-be6a81cee5e7 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:04:27.850533 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3ec6430c-dee4-4537-aec2-4795fa2351cd tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "GET /compute/v2.1/servers/aba801d8-0f5d-49d2-9d2a-be6a81cee5e7" status: 404 len: 111 microversion: 2.1 time: 0.060955 Jun 10 18:04:27.850533 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1105/2212] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:27 2022] GET /compute/v2.1/servers/aba801d8-0f5d-49d2-9d2a-be6a81cee5e7 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:04:27.854264 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-648691ce-56c7-4ce9-9b98-c8f5b4654d76 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-437675087", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "02812646-dd80-4769-8285-9699f6c583d0"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:27.933092 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-648691ce-56c7-4ce9-9b98-c8f5b4654d76 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] validate_networks() for [('02812646-dd80-4769-8285-9699f6c583d0', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:04:28.160613 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-64de9eb7-6b1a-494e-9eac-b346cce3d154 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:28.171386 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-64de9eb7-6b1a-494e-9eac-b346cce3d154 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1469 microversion: 2.1 time: 0.414081 Jun 10 18:04:28.175397 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1108/2213] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:27 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1469 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:28.189550 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-768c1369-154d-4e7b-bba4-58de21924b35 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:28.199175 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-768c1369-154d-4e7b-bba4-58de21924b35 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] [instance: 4864e5b5-595a-4935-80c2-2572b66f8162] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:28.208297 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-768c1369-154d-4e7b-bba4-58de21924b35 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:28.209114 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-768c1369-154d-4e7b-bba4-58de21924b35 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:28.210226 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-768c1369-154d-4e7b-bba4-58de21924b35 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:28.210898 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-768c1369-154d-4e7b-bba4-58de21924b35 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:28.869721 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-648691ce-56c7-4ce9-9b98-c8f5b4654d76 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:04:28.870910 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-648691ce-56c7-4ce9-9b98-c8f5b4654d76 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:04:28.871623 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-648691ce-56c7-4ce9-9b98-c8f5b4654d76 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:04:28.873236 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-648691ce-56c7-4ce9-9b98-c8f5b4654d76 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:04:28.873919 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-648691ce-56c7-4ce9-9b98-c8f5b4654d76 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:04:28.886444 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-648691ce-56c7-4ce9-9b98-c8f5b4654d76 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:28.887327 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-648691ce-56c7-4ce9-9b98-c8f5b4654d76 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:28.888441 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-648691ce-56c7-4ce9-9b98-c8f5b4654d76 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:28.889186 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-648691ce-56c7-4ce9-9b98-c8f5b4654d76 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:28.912599 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-648691ce-56c7-4ce9-9b98-c8f5b4654d76 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Getting quotas for project 2b34cb51c168497088d66fa0e507e364. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:04:28.924017 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-648691ce-56c7-4ce9-9b98-c8f5b4654d76 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Getting quotas for user 352e7f5de76c42da9241721fe0f0bf86 and project 2b34cb51c168497088d66fa0e507e364. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:04:28.942845 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-648691ce-56c7-4ce9-9b98-c8f5b4654d76 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:04:28.946685 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-648691ce-56c7-4ce9-9b98-c8f5b4654d76 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 49b47316-e3b5-4ecd-962d-003a6cd0def3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:04:29.160253 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-648691ce-56c7-4ce9-9b98-c8f5b4654d76 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.310797 Jun 10 18:04:29.166273 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1106/2214] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:04:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1318 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:04:29.199652 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-48bcf47e-dee5-4466-a91f-513d0a56b9b9 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Action: 'create', calling method: .version_select at 0x7f77c12c31f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-13585014", "description": "tempest-description-703406525"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:29.214269 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-768c1369-154d-4e7b-bba4-58de21924b35 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9884a0b94aed42e5aa029f6d096a3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8ad96cd98c4cf683f763099e3064a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:29.248471 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-768c1369-154d-4e7b-bba4-58de21924b35 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] 10.222.0.35 "GET /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162" status: 200 len: 1331 microversion: 2.1 time: 1.062476 Jun 10 18:04:29.261446 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1109/2215] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:28 2022] GET /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162 => generated 1331 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:29.273602 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4d9d7a29-426c-4d21-a7a8-054443d3426b tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:29.274229 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4d9d7a29-426c-4d21-a7a8-054443d3426b tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] [instance: 07e79e24-76e1-476b-b064-a6729174e2ff] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:29.301261 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4d9d7a29-426c-4d21-a7a8-054443d3426b tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:29.302829 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4d9d7a29-426c-4d21-a7a8-054443d3426b tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:29.306171 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4d9d7a29-426c-4d21-a7a8-054443d3426b tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:29.306630 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4d9d7a29-426c-4d21-a7a8-054443d3426b tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:29.778089 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4d9d7a29-426c-4d21-a7a8-054443d3426b tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be318f01fac5459cb4d0f55cf374824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:29.785656 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:04:29.805019 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4d9d7a29-426c-4d21-a7a8-054443d3426b tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "GET /compute/v2.1/servers/07e79e24-76e1-476b-b064-a6729174e2ff" status: 200 len: 1521 microversion: 2.1 time: 0.533535 Jun 10 18:04:29.806639 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1110/2216] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:29 2022] GET /compute/v2.1/servers/07e79e24-76e1-476b-b064-a6729174e2ff => generated 1521 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:29.831394 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-bbea5039-5137-4ad4-912c-506a43823add req-ff773b40-4897-4838-8152-8ce76d2c78cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4864e5b5-595a-4935-80c2-2572b66f8162", "name": "network-vif-plugged", "status": "completed", "tag": "40a20790-d62d-4bb6-98d8-b36feab7f804"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:29.863764 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-bbea5039-5137-4ad4-912c-506a43823add req-ff773b40-4897-4838-8152-8ce76d2c78cc service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:29.865694 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-bbea5039-5137-4ad4-912c-506a43823add req-ff773b40-4897-4838-8152-8ce76d2c78cc service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:29.903267 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-bbea5039-5137-4ad4-912c-506a43823add req-ff773b40-4897-4838-8152-8ce76d2c78cc service nova] Creating event network-vif-plugged:40a20790-d62d-4bb6-98d8-b36feab7f804 for instance 4864e5b5-595a-4935-80c2-2572b66f8162 on chh1-master-2 Jun 10 18:04:29.916436 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-bbea5039-5137-4ad4-912c-506a43823add req-ff773b40-4897-4838-8152-8ce76d2c78cc service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105735 Jun 10 18:04:29.919382 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1111/2217] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:29.947585 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6fa61d13-6c01-4496-bcc4-0cba830f6917 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:29.948368 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6fa61d13-6c01-4496-bcc4-0cba830f6917 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:29.963634 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6fa61d13-6c01-4496-bcc4-0cba830f6917 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:29.967748 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6fa61d13-6c01-4496-bcc4-0cba830f6917 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:29.968842 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6fa61d13-6c01-4496-bcc4-0cba830f6917 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:29.969604 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6fa61d13-6c01-4496-bcc4-0cba830f6917 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:30.135281 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-48bcf47e-dee5-4466-a91f-513d0a56b9b9 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.964314 Jun 10 18:04:30.141752 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1107/2218] 10.222.0.35 () {60 vars in 1179 bytes} [Fri Jun 10 18:04:29 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:30.152059 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fdbd9c5c-bada-4016-9e2e-9e0c1110ae77 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:30.152723 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fdbd9c5c-bada-4016-9e2e-9e0c1110ae77 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 49b47316-e3b5-4ecd-962d-003a6cd0def3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:30.275876 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fdbd9c5c-bada-4016-9e2e-9e0c1110ae77 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:30.292992 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fdbd9c5c-bada-4016-9e2e-9e0c1110ae77 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3" status: 200 len: 1214 microversion: 2.1 time: 0.142274 Jun 10 18:04:30.293691 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1108/2219] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:30 2022] GET /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3 => generated 1214 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:30.309014 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-20dd2985-5bbf-4ee2-9f3f-444007f56221 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:30.309797 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-20dd2985-5bbf-4ee2-9f3f-444007f56221 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:30.330820 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-20dd2985-5bbf-4ee2-9f3f-444007f56221 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:30.337077 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-20dd2985-5bbf-4ee2-9f3f-444007f56221 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:30.338564 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-20dd2985-5bbf-4ee2-9f3f-444007f56221 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:30.339705 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-20dd2985-5bbf-4ee2-9f3f-444007f56221 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:30.490260 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6fa61d13-6c01-4496-bcc4-0cba830f6917 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:30.505393 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6fa61d13-6c01-4496-bcc4-0cba830f6917 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1391 microversion: 2.1 time: 0.579625 Jun 10 18:04:30.517670 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1112/2220] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:29 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1391 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:30.531589 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-db779a42-222f-4263-a3c3-5bb5de3437c4 req-174b789e-a59c-4a37-96fe-4273a3ed7a33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07e79e24-76e1-476b-b064-a6729174e2ff", "name": "network-vif-deleted", "tag": "2fd4d2ca-7508-415a-9af1-7f4ff48d0061"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:30.556580 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-db779a42-222f-4263-a3c3-5bb5de3437c4 req-174b789e-a59c-4a37-96fe-4273a3ed7a33 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:30.557927 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-db779a42-222f-4263-a3c3-5bb5de3437c4 req-174b789e-a59c-4a37-96fe-4273a3ed7a33 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:30.576512 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-db779a42-222f-4263-a3c3-5bb5de3437c4 req-174b789e-a59c-4a37-96fe-4273a3ed7a33 service nova] Creating event network-vif-deleted:2fd4d2ca-7508-415a-9af1-7f4ff48d0061 for instance 07e79e24-76e1-476b-b064-a6729174e2ff on chh2-master-2 Jun 10 18:04:30.583868 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-db779a42-222f-4263-a3c3-5bb5de3437c4 req-174b789e-a59c-4a37-96fe-4273a3ed7a33 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063952 Jun 10 18:04:30.585404 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1113/2221] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:30.598784 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2bd4a10d-c97a-4ee4-95de-1ecdf3258b9e tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Action: 'create', calling method: .version_select at 0x7f77c62c7ee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-587421652", "description": "tempest-description-2077466930"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:31.012457 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-20dd2985-5bbf-4ee2-9f3f-444007f56221 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:31.020255 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-20dd2985-5bbf-4ee2-9f3f-444007f56221 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1469 microversion: 2.1 time: 0.725481 Jun 10 18:04:31.021048 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1109/2222] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:30 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1469 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:31.025918 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ce15a5d8-1e26-4d18-8068-745a5f163bb8 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:31.026723 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ce15a5d8-1e26-4d18-8068-745a5f163bb8 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] [instance: 4864e5b5-595a-4935-80c2-2572b66f8162] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:31.033480 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ce15a5d8-1e26-4d18-8068-745a5f163bb8 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:31.033941 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ce15a5d8-1e26-4d18-8068-745a5f163bb8 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:31.034721 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ce15a5d8-1e26-4d18-8068-745a5f163bb8 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:31.035165 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ce15a5d8-1e26-4d18-8068-745a5f163bb8 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:31.237274 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2bd4a10d-c97a-4ee4-95de-1ecdf3258b9e tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.648006 Jun 10 18:04:31.242478 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1114/2223] 10.222.0.35 () {60 vars in 1179 bytes} [Fri Jun 10 18:04:30 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:31.244921 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-81593a08-daa4-4b2c-b71e-f6d780015f04 req-1bc51d17-08a7-409b-a60f-74a492126012 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca923f2e-f40e-4c7c-bede-58ab9cda2763", "name": "network-vif-deleted", "tag": "3929a812-05d7-4ecf-be86-c63b4062608d"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:31.266482 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-81593a08-daa4-4b2c-b71e-f6d780015f04 req-1bc51d17-08a7-409b-a60f-74a492126012 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:31.267656 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-81593a08-daa4-4b2c-b71e-f6d780015f04 req-1bc51d17-08a7-409b-a60f-74a492126012 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:31.284968 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-81593a08-daa4-4b2c-b71e-f6d780015f04 req-1bc51d17-08a7-409b-a60f-74a492126012 service nova] Creating event network-vif-deleted:3929a812-05d7-4ecf-be86-c63b4062608d for instance ca923f2e-f40e-4c7c-bede-58ab9cda2763 on chh1-master-2 Jun 10 18:04:31.295448 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-81593a08-daa4-4b2c-b71e-f6d780015f04 req-1bc51d17-08a7-409b-a60f-74a492126012 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055864 Jun 10 18:04:31.297731 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1115/2224] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:31.304909 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ce15a5d8-1e26-4d18-8068-745a5f163bb8 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9884a0b94aed42e5aa029f6d096a3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8ad96cd98c4cf683f763099e3064a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:31.311948 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a0d6147b-8fb7-4603-94eb-436be20416ec tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:31.316270 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ce15a5d8-1e26-4d18-8068-745a5f163bb8 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] 10.222.0.35 "GET /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162" status: 200 len: 1331 microversion: 2.1 time: 0.293987 Jun 10 18:04:31.317844 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1110/2225] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:31 2022] GET /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162 => generated 1331 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:31.320974 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a0d6147b-8fb7-4603-94eb-436be20416ec tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] [instance: 07e79e24-76e1-476b-b064-a6729174e2ff] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:31.325345 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-48bb2ca4-3b4f-409b-ae67-bf765847b739 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Action: 'create', calling method: .version_select at 0x7f77c0ce4700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-595870760", "description": "tempest-description-471845655"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:31.338811 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a0d6147b-8fb7-4603-94eb-436be20416ec tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:31.339568 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a0d6147b-8fb7-4603-94eb-436be20416ec tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:31.340403 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a0d6147b-8fb7-4603-94eb-436be20416ec tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:31.340858 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a0d6147b-8fb7-4603-94eb-436be20416ec tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:31.376642 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a0d6147b-8fb7-4603-94eb-436be20416ec tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:31.377097 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a0d6147b-8fb7-4603-94eb-436be20416ec tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:31.377804 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-a0d6147b-8fb7-4603-94eb-436be20416ec tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lazy-loading 'fault' on Instance uuid 07e79e24-76e1-476b-b064-a6729174e2ff {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:04:31.427684 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a0d6147b-8fb7-4603-94eb-436be20416ec tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be318f01fac5459cb4d0f55cf374824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:31.439777 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a0d6147b-8fb7-4603-94eb-436be20416ec tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "GET /compute/v2.1/servers/07e79e24-76e1-476b-b064-a6729174e2ff" status: 200 len: 1313 microversion: 2.1 time: 0.137431 Jun 10 18:04:31.439777 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1116/2226] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:31 2022] GET /compute/v2.1/servers/07e79e24-76e1-476b-b064-a6729174e2ff => generated 1313 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:31.441845 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bfd2f216-bc59-4d35-a7aa-d4fb2e4a0e6c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:31.442488 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bfd2f216-bc59-4d35-a7aa-d4fb2e4a0e6c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 49b47316-e3b5-4ecd-962d-003a6cd0def3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:31.449282 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bfd2f216-bc59-4d35-a7aa-d4fb2e4a0e6c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:31.449751 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bfd2f216-bc59-4d35-a7aa-d4fb2e4a0e6c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:31.450956 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bfd2f216-bc59-4d35-a7aa-d4fb2e4a0e6c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:31.451535 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bfd2f216-bc59-4d35-a7aa-d4fb2e4a0e6c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:31.519409 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bfd2f216-bc59-4d35-a7aa-d4fb2e4a0e6c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:31.527644 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bfd2f216-bc59-4d35-a7aa-d4fb2e4a0e6c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3" status: 200 len: 1218 microversion: 2.1 time: 0.089530 Jun 10 18:04:31.528162 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1117/2227] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:31 2022] GET /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:31.533014 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3dde3851-e856-49e1-9222-de52c019624e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:31.533626 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3dde3851-e856-49e1-9222-de52c019624e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:31.541522 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3dde3851-e856-49e1-9222-de52c019624e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:31.542210 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3dde3851-e856-49e1-9222-de52c019624e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:31.542940 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3dde3851-e856-49e1-9222-de52c019624e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:31.543546 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3dde3851-e856-49e1-9222-de52c019624e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:31.770301 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3dde3851-e856-49e1-9222-de52c019624e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:31.780637 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3dde3851-e856-49e1-9222-de52c019624e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1391 microversion: 2.1 time: 0.251174 Jun 10 18:04:31.781828 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1118/2228] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:31 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1391 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:31.955124 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-a8f748af-42d5-40fe-b0ae-deb43b53eead req-da96e418-7082-4434-a7e1-b19016e389ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586adfa4-7b3c-4399-86ab-d2982771af1d", "name": "network-vif-plugged", "status": "completed", "tag": "8aa0aa37-a6b7-49eb-8548-6164b5ff95d7"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:31.964045 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-a8f748af-42d5-40fe-b0ae-deb43b53eead req-da96e418-7082-4434-a7e1-b19016e389ce service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:31.966237 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-a8f748af-42d5-40fe-b0ae-deb43b53eead req-da96e418-7082-4434-a7e1-b19016e389ce service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:31.967924 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-48bb2ca4-3b4f-409b-ae67-bf765847b739 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.648871 Jun 10 18:04:31.970000 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1111/2229] 10.222.0.35 () {60 vars in 1179 bytes} [Fri Jun 10 18:04:31 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:31.982348 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-739c446f-b185-46b9-ba96-09b9e98dfcb7 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '.version_select at 0x7f77c0d1b280>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:31.987764 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-a8f748af-42d5-40fe-b0ae-deb43b53eead req-da96e418-7082-4434-a7e1-b19016e389ce service nova] Creating event network-vif-plugged:8aa0aa37-a6b7-49eb-8548-6164b5ff95d7 for instance 586adfa4-7b3c-4399-86ab-d2982771af1d on chh2-master-2 Jun 10 18:04:32.003857 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [req-a8f748af-42d5-40fe-b0ae-deb43b53eead req-da96e418-7082-4434-a7e1-b19016e389ce service nova] Instance 586adfa4-7b3c-4399-86ab-d2982771af1d is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126594) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 18:04:32.030785 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-a8f748af-42d5-40fe-b0ae-deb43b53eead req-da96e418-7082-4434-a7e1-b19016e389ce service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079388 Jun 10 18:04:32.035947 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1119/2230] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:04:32.044800 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-02b2a7b3-8180-433f-b64d-ad641a126ee9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:32.051671 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-02b2a7b3-8180-433f-b64d-ad641a126ee9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:32.060537 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-02b2a7b3-8180-433f-b64d-ad641a126ee9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:32.063555 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-02b2a7b3-8180-433f-b64d-ad641a126ee9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:32.065239 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-02b2a7b3-8180-433f-b64d-ad641a126ee9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:32.067542 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-02b2a7b3-8180-433f-b64d-ad641a126ee9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:32.304188 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-739c446f-b185-46b9-ba96-09b9e98dfcb7 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/os-security-groups" status: 200 len: 1827 microversion: 2.1 time: 0.326894 Jun 10 18:04:32.305320 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1112/2231] 10.222.0.35 () {58 vars in 1157 bytes} [Fri Jun 10 18:04:31 2022] GET /compute/v2.1/os-security-groups => generated 1827 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:32.318421 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a54774ee-8528-483e-adfe-ca6628b78b75 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '.version_select at 0x7f77c0659dc0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:32.430466 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-02b2a7b3-8180-433f-b64d-ad641a126ee9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:32.440724 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-02b2a7b3-8180-433f-b64d-ad641a126ee9 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1469 microversion: 2.1 time: 0.403020 Jun 10 18:04:32.441881 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1120/2232] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:32 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1469 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:32.448932 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-50382fd6-0400-4e88-a6f2-12236e793794 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:32.455595 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-50382fd6-0400-4e88-a6f2-12236e793794 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] [instance: 4864e5b5-595a-4935-80c2-2572b66f8162] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:32.455595 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:04:32.460815 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-50382fd6-0400-4e88-a6f2-12236e793794 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:32.462330 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-50382fd6-0400-4e88-a6f2-12236e793794 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:32.463661 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-50382fd6-0400-4e88-a6f2-12236e793794 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:32.464285 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-50382fd6-0400-4e88-a6f2-12236e793794 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:32.675204 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a54774ee-8528-483e-adfe-ca6628b78b75 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "DELETE /compute/v2.1/os-security-groups/550d428e-4683-40b2-a84a-8f882af2478b" status: 202 len: 0 microversion: 2.1 time: 0.361105 Jun 10 18:04:32.676119 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1113/2233] 10.222.0.35 () {58 vars in 1271 bytes} [Fri Jun 10 18:04:32 2022] DELETE /compute/v2.1/os-security-groups/550d428e-4683-40b2-a84a-8f882af2478b => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:04:32.681009 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4356f91c-f4e3-4f97-b288-b7cf3e2abc56 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:32.681861 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4356f91c-f4e3-4f97-b288-b7cf3e2abc56 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] [instance: 07e79e24-76e1-476b-b064-a6729174e2ff] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:32.699464 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-50382fd6-0400-4e88-a6f2-12236e793794 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9884a0b94aed42e5aa029f6d096a3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8ad96cd98c4cf683f763099e3064a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:32.702337 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4356f91c-f4e3-4f97-b288-b7cf3e2abc56 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:32.702802 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4356f91c-f4e3-4f97-b288-b7cf3e2abc56 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:32.708766 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-50382fd6-0400-4e88-a6f2-12236e793794 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] 10.222.0.35 "GET /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162" status: 200 len: 1535 microversion: 2.1 time: 0.265528 Jun 10 18:04:32.713506 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4356f91c-f4e3-4f97-b288-b7cf3e2abc56 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:32.713706 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1121/2234] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:32 2022] GET /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162 => generated 1535 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:32.715106 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4356f91c-f4e3-4f97-b288-b7cf3e2abc56 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:32.722525 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f649b5f8-7b17-4f04-b515-0c33efda6051 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:32.722525 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f649b5f8-7b17-4f04-b515-0c33efda6051 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 49b47316-e3b5-4ecd-962d-003a6cd0def3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:32.734908 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f649b5f8-7b17-4f04-b515-0c33efda6051 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:32.737147 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f649b5f8-7b17-4f04-b515-0c33efda6051 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:32.739127 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f649b5f8-7b17-4f04-b515-0c33efda6051 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:32.739722 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f649b5f8-7b17-4f04-b515-0c33efda6051 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:32.782863 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4356f91c-f4e3-4f97-b288-b7cf3e2abc56 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:32.782863 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4356f91c-f4e3-4f97-b288-b7cf3e2abc56 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:32.782863 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-4356f91c-f4e3-4f97-b288-b7cf3e2abc56 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lazy-loading 'fault' on Instance uuid 07e79e24-76e1-476b-b064-a6729174e2ff {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:04:32.841898 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4356f91c-f4e3-4f97-b288-b7cf3e2abc56 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be318f01fac5459cb4d0f55cf374824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f24d6db014a4fecb9533fa4cf1be8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:32.866003 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4356f91c-f4e3-4f97-b288-b7cf3e2abc56 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "GET /compute/v2.1/servers/07e79e24-76e1-476b-b064-a6729174e2ff" status: 200 len: 1313 microversion: 2.1 time: 0.188555 Jun 10 18:04:32.867808 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1114/2235] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:32 2022] GET /compute/v2.1/servers/07e79e24-76e1-476b-b064-a6729174e2ff => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:32.884277 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ce7e8aa4-05e0-4ba3-a936-0c897b62cc85 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '.version_select at 0x7f77c0ce4af0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:32.888547 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f649b5f8-7b17-4f04-b515-0c33efda6051 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:32.929583 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f649b5f8-7b17-4f04-b515-0c33efda6051 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3" status: 200 len: 1266 microversion: 2.1 time: 0.214644 Jun 10 18:04:32.931407 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1122/2236] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:32 2022] GET /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3 => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:32.942402 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-23d8289d-1e24-49ad-b429-033ba1b7f8f0 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Action: 'create', calling method: .version_select at 0x7f77c0c22ee0>, body: {"pool": "ee72fd31-e0e2-470e-b15d-ae5538ee16e6"} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:33.014594 chdv-master-2 devstack@n-api.service[126595]: DEBUG neutronclient.v2_0.client [None req-ce7e8aa4-05e0-4ba3-a936-0c897b62cc85 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 550d428e-4683-40b2-a84a-8f882af2478b does not exist", "detail": ""}} {{(pid=126595) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 10 18:04:33.015203 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.security_group_api [None req-ce7e8aa4-05e0-4ba3-a936-0c897b62cc85 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Neutron security group 550d428e-4683-40b2-a84a-8f882af2478b not found {{(pid=126595) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 10 18:04:33.016096 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-ce7e8aa4-05e0-4ba3-a936-0c897b62cc85 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] HTTP exception thrown: Security group 550d428e-4683-40b2-a84a-8f882af2478b does not exist Jun 10 18:04:33.016096 chdv-master-2 devstack@n-api.service[126595]: Neutron server returns request_ids: ['req-0989bef1-34ca-4056-9077-1f30de4e0edb'] Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ce7e8aa4-05e0-4ba3-a936-0c897b62cc85 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Request method failure captured: Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/os-security-groups/550d428e-4683-40b2-a84a-8f882af2478b HTTP/1.1 Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4eKfGQZQ_jvhwHBxZ1GMnYHkMaBNBt7T8Ue90hW5x7BTDgkg2AiOfeu2huz2YQsnFH29P56VFWZd48_hROirge71TvR4QiKyTENHZz-D3t9ZS-m9216ej7Rjuw3slpnWYAQuE-KXkyXTlRqKM7yyNbBp9KRqjUFN-v2IWlTc7Yfat0 Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 304a5340852d4552a490e874dda8a0a3 Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_304a5340852d4552a490e874dda8a0a3", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 304a5340852d4552a490e874dda8a0a3 Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-SecurityGroupsTestJSON-732923421-project Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 7278ccddeee3495583093603a0fdb626 Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-SecurityGroupsTestJSON-732923421-project Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: exception: Security group 550d428e-4683-40b2-a84a-8f882af2478b does not exist Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: Neutron server returns request_ids: ['req-0989bef1-34ca-4056-9077-1f30de4e0edb'] Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '550d428e-4683-40b2-a84a-8f882af2478b'} Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 10 18:04:33.018145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 550d428e-4683-40b2-a84a-8f882af2478b does not exist Jun 10 18:04:33.023162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0989bef1-34ca-4056-9077-1f30de4e0edb'] Jun 10 18:04:33.023162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:33.023162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:33.023162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:33.023162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:33.023162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jun 10 18:04:33.023162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 10 18:04:33.023162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 10 18:04:33.023162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 10 18:04:33.023162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 550d428e-4683-40b2-a84a-8f882af2478b does not exist Jun 10 18:04:33.023162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0989bef1-34ca-4056-9077-1f30de4e0edb'] Jun 10 18:04:33.023162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:33.023162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:33.023162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:33.023162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:33.023162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:04:33.023162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:04:33.023162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:04:33.023162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:04:33.023162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:04:33.023162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:04:33.023162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:04:33.023162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:04:33.023162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jun 10 18:04:33.023162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 10 18:04:33.023162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 550d428e-4683-40b2-a84a-8f882af2478b does not exist Jun 10 18:04:33.023162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0989bef1-34ca-4056-9077-1f30de4e0edb'] Jun 10 18:04:33.023162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:33.023162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:33.023162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:33.023162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:33.023162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:04:33.023162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:04:33.023162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:04:33.023162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:04:33.023162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 550d428e-4683-40b2-a84a-8f882af2478b does not exist Jun 10 18:04:33.023162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0989bef1-34ca-4056-9077-1f30de4e0edb'] Jun 10 18:04:33.023162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:33.023162 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ce7e8aa4-05e0-4ba3-a936-0c897b62cc85 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Returning 404 to user: Security group 550d428e-4683-40b2-a84a-8f882af2478b does not exist Jun 10 18:04:33.023162 chdv-master-2 devstack@n-api.service[126595]: Neutron server returns request_ids: ['req-0989bef1-34ca-4056-9077-1f30de4e0edb'] {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:04:33.023162 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ce7e8aa4-05e0-4ba3-a936-0c897b62cc85 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/os-security-groups/550d428e-4683-40b2-a84a-8f882af2478b" status: 404 len: 194 microversion: 2.1 time: 0.150802 Jun 10 18:04:33.023162 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1115/2237] 10.222.0.35 () {58 vars in 1268 bytes} [Fri Jun 10 18:04:32 2022] GET /compute/v2.1/os-security-groups/550d428e-4683-40b2-a84a-8f882af2478b => generated 194 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:04:33.027046 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7e254608-4b08-414b-80d5-bf71b822c977 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:33.027046 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7e254608-4b08-414b-80d5-bf71b822c977 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:33.035251 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e254608-4b08-414b-80d5-bf71b822c977 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:33.035788 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e254608-4b08-414b-80d5-bf71b822c977 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:33.036850 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e254608-4b08-414b-80d5-bf71b822c977 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:33.037489 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e254608-4b08-414b-80d5-bf71b822c977 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:33.394264 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7e254608-4b08-414b-80d5-bf71b822c977 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:33.404864 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7e254608-4b08-414b-80d5-bf71b822c977 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1391 microversion: 2.1 time: 0.383219 Jun 10 18:04:33.405864 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1116/2238] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:33 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1391 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:33.411575 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5b845db0-2aea-4db1-bedc-cbdf5c18ba9a tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '.version_select at 0x7f77c0ce4af0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:34.077886 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5b845db0-2aea-4db1-bedc-cbdf5c18ba9a tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "DELETE /compute/v2.1/os-security-groups/472ca415-301d-42c1-9b59-ab5c256390ed" status: 202 len: 0 microversion: 2.1 time: 0.670382 Jun 10 18:04:34.078546 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1117/2239] 10.222.0.35 () {58 vars in 1271 bytes} [Fri Jun 10 18:04:33 2022] DELETE /compute/v2.1/os-security-groups/472ca415-301d-42c1-9b59-ab5c256390ed => generated 0 bytes in 672 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:04:34.084431 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0559cb7d-b324-4d4f-9132-ad79dd9c1073 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:34.085196 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0559cb7d-b324-4d4f-9132-ad79dd9c1073 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:34.092631 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0559cb7d-b324-4d4f-9132-ad79dd9c1073 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:34.093180 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0559cb7d-b324-4d4f-9132-ad79dd9c1073 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:34.094077 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0559cb7d-b324-4d4f-9132-ad79dd9c1073 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:34.094644 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0559cb7d-b324-4d4f-9132-ad79dd9c1073 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:34.358001 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0559cb7d-b324-4d4f-9132-ad79dd9c1073 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:34.370149 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0559cb7d-b324-4d4f-9132-ad79dd9c1073 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1469 microversion: 2.1 time: 0.289960 Jun 10 18:04:34.371303 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1118/2240] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:34 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1469 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:34.376494 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d60afc2a-44a0-4d87-a7d8-9b8e697443c6 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:34.377105 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d60afc2a-44a0-4d87-a7d8-9b8e697443c6 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] [instance: 07e79e24-76e1-476b-b064-a6729174e2ff] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:34.384324 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d60afc2a-44a0-4d87-a7d8-9b8e697443c6 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:34.384779 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d60afc2a-44a0-4d87-a7d8-9b8e697443c6 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:34.385647 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d60afc2a-44a0-4d87-a7d8-9b8e697443c6 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:34.385984 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d60afc2a-44a0-4d87-a7d8-9b8e697443c6 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:34.405020 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-d60afc2a-44a0-4d87-a7d8-9b8e697443c6 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] HTTP exception thrown: Instance 07e79e24-76e1-476b-b064-a6729174e2ff could not be found. Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d60afc2a-44a0-4d87-a7d8-9b8e697443c6 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Request method failure captured: Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/07e79e24-76e1-476b-b064-a6729174e2ff HTTP/1.1 Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4d2g6LisIDVkTYTcdOtG0A3umrUEUWfSSdKBZBTZSGZWByrOwwCj-5KqksYro3H1okjI-zzuU5IHUS4lo6yG-r96m6TXL_G3wFZOzgUE1VCvpXQWprzUOsbOtrwUJG6ZZ0kitxUWkFBtgkuEIiNHG9TcUYzDRR5llGfQuUx6UFa3gE Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 8f24d6db014a4fecb9533fa4cf1be8c7 Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ListServersNegativeTestJSON-1230596670 Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/8f24d6db014a4fecb9533fa4cf1be8c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8f24d6db014a4fecb9533fa4cf1be8c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8f24d6db014a4fecb9533fa4cf1be8c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_8f24d6db014a4fecb9533fa4cf1be8c7", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ListServersNegativeTestJSON-1230596670 Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 8f24d6db014a4fecb9533fa4cf1be8c7 Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1230596670 Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ListServersNegativeTestJSON-1230596670-project Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: be318f01fac5459cb4d0f55cf374824f Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ListServersNegativeTestJSON-1230596670-project Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 07e79e24-76e1-476b-b064-a6729174e2ff could not be found. Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '07e79e24-76e1-476b-b064-a6729174e2ff'} Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07e79e24-76e1-476b-b064-a6729174e2ff could not be found. Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07e79e24-76e1-476b-b064-a6729174e2ff could not be found. Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:34.406100 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:34.413119 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:34.413119 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:04:34.413119 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:04:34.413119 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:04:34.413119 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:04:34.413119 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07e79e24-76e1-476b-b064-a6729174e2ff could not be found. Jun 10 18:04:34.413119 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:34.413119 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d60afc2a-44a0-4d87-a7d8-9b8e697443c6 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Returning 404 to user: Instance 07e79e24-76e1-476b-b064-a6729174e2ff could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:04:34.413119 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d60afc2a-44a0-4d87-a7d8-9b8e697443c6 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "GET /compute/v2.1/servers/07e79e24-76e1-476b-b064-a6729174e2ff" status: 404 len: 111 microversion: 2.1 time: 0.034892 Jun 10 18:04:34.413119 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1119/2241] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:34 2022] GET /compute/v2.1/servers/07e79e24-76e1-476b-b064-a6729174e2ff => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:04:34.414654 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1ec2e495-42a0-47b0-9db4-59553b808bd6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:34.415753 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1ec2e495-42a0-47b0-9db4-59553b808bd6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 49b47316-e3b5-4ecd-962d-003a6cd0def3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:34.427372 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1ec2e495-42a0-47b0-9db4-59553b808bd6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:34.427836 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1ec2e495-42a0-47b0-9db4-59553b808bd6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:34.428647 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1ec2e495-42a0-47b0-9db4-59553b808bd6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:34.429258 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1ec2e495-42a0-47b0-9db4-59553b808bd6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:34.564872 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=10 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:04:34.692288 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1ec2e495-42a0-47b0-9db4-59553b808bd6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:34.707396 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1ec2e495-42a0-47b0-9db4-59553b808bd6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3" status: 200 len: 1314 microversion: 2.1 time: 0.297456 Jun 10 18:04:34.708144 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1120/2242] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:34 2022] GET /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3 => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:34.713863 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-76c9992c-2781-48f1-924f-6209e8190b69 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1502422411", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "abaf7ab8-f0d7-4db9-bc12-3e0ab0d7e41a"}], "block_device_mapping_v2": [{"uuid": "e113765e-e659-41e1-8cc5-bd9d0e14a4a0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:34.809451 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-76c9992c-2781-48f1-924f-6209e8190b69 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] validate_networks() for [('abaf7ab8-f0d7-4db9-bc12-3e0ab0d7e41a', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:04:35.606800 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-76c9992c-2781-48f1-924f-6209e8190b69 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:04:35.609482 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-76c9992c-2781-48f1-924f-6209e8190b69 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:04:35.610389 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-76c9992c-2781-48f1-924f-6209e8190b69 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:04:35.613319 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-76c9992c-2781-48f1-924f-6209e8190b69 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:04:35.613319 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-76c9992c-2781-48f1-924f-6209e8190b69 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:04:35.623527 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-76c9992c-2781-48f1-924f-6209e8190b69 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:35.624073 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-76c9992c-2781-48f1-924f-6209e8190b69 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:35.625334 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-76c9992c-2781-48f1-924f-6209e8190b69 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:35.625853 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-76c9992c-2781-48f1-924f-6209e8190b69 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:35.647003 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-76c9992c-2781-48f1-924f-6209e8190b69 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Getting quotas for project 01ee7bcfe44746fda89fda904f81e1b9. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:04:35.653108 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-76c9992c-2781-48f1-924f-6209e8190b69 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Getting quotas for user d4967895f6f041058ef60cee35a3659c and project 01ee7bcfe44746fda89fda904f81e1b9. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:04:35.727493 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-76c9992c-2781-48f1-924f-6209e8190b69 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:04:35.727493 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-76c9992c-2781-48f1-924f-6209e8190b69 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e113765e-e659-41e1-8cc5-bd9d0e14a4a0',volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:04:36.095517 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-23d8289d-1e24-49ad-b429-033ba1b7f8f0 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] 10.222.0.35 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.162747 Jun 10 18:04:36.097994 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1123/2243] 10.222.0.35 () {60 vars in 1169 bytes} [Fri Jun 10 18:04:32 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:36.105279 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3eacbaa3-5904-4297-9436-e20be84febea tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '.version_select at 0x7f77c0b7c0d0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:36.134621 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:04:36.176216 chdv-master-2 devstack@n-api.service[126594]: DEBUG neutronclient.v2_0.client [None req-3eacbaa3-5904-4297-9436-e20be84febea tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 472ca415-301d-42c1-9b59-ab5c256390ed does not exist", "detail": ""}} {{(pid=126594) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 10 18:04:36.176216 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.security_group_api [None req-3eacbaa3-5904-4297-9436-e20be84febea tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Neutron security group 472ca415-301d-42c1-9b59-ab5c256390ed not found {{(pid=126594) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 10 18:04:36.176216 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-3eacbaa3-5904-4297-9436-e20be84febea tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] HTTP exception thrown: Security group 472ca415-301d-42c1-9b59-ab5c256390ed does not exist Jun 10 18:04:36.176216 chdv-master-2 devstack@n-api.service[126594]: Neutron server returns request_ids: ['req-35778c8a-ef84-4c29-bdb9-cd92f6f329b6'] Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3eacbaa3-5904-4297-9436-e20be84febea tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Request method failure captured: Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/os-security-groups/472ca415-301d-42c1-9b59-ab5c256390ed HTTP/1.1 Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4eKfGQZQ_jvhwHBxZ1GMnYHkMaBNBt7T8Ue90hW5x7BTDgkg2AiOfeu2huz2YQsnFH29P56VFWZd48_hROirge71TvR4QiKyTENHZz-D3t9ZS-m9216ej7Rjuw3slpnWYAQuE-KXkyXTlRqKM7yyNbBp9KRqjUFN-v2IWlTc7Yfat0 Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 304a5340852d4552a490e874dda8a0a3 Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_304a5340852d4552a490e874dda8a0a3", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 304a5340852d4552a490e874dda8a0a3 Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-SecurityGroupsTestJSON-732923421-project Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 7278ccddeee3495583093603a0fdb626 Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-SecurityGroupsTestJSON-732923421-project Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: exception: Security group 472ca415-301d-42c1-9b59-ab5c256390ed does not exist Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: Neutron server returns request_ids: ['req-35778c8a-ef84-4c29-bdb9-cd92f6f329b6'] Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '472ca415-301d-42c1-9b59-ab5c256390ed'} Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 10 18:04:36.179008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 472ca415-301d-42c1-9b59-ab5c256390ed does not exist Jun 10 18:04:36.185992 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-35778c8a-ef84-4c29-bdb9-cd92f6f329b6'] Jun 10 18:04:36.185992 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:36.185992 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:36.185992 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:36.185992 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:36.185992 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jun 10 18:04:36.185992 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 10 18:04:36.185992 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 10 18:04:36.185992 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 10 18:04:36.185992 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 472ca415-301d-42c1-9b59-ab5c256390ed does not exist Jun 10 18:04:36.185992 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-35778c8a-ef84-4c29-bdb9-cd92f6f329b6'] Jun 10 18:04:36.185992 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:36.185992 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:36.185992 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:36.185992 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:36.185992 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:04:36.185992 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:04:36.185992 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:04:36.185992 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:04:36.185992 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:04:36.185992 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:04:36.185992 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:04:36.185992 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:04:36.185992 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jun 10 18:04:36.185992 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 10 18:04:36.185992 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 472ca415-301d-42c1-9b59-ab5c256390ed does not exist Jun 10 18:04:36.185992 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-35778c8a-ef84-4c29-bdb9-cd92f6f329b6'] Jun 10 18:04:36.185992 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:36.185992 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:36.185992 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:36.185992 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:36.185992 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:04:36.185992 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:04:36.185992 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:04:36.185992 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:04:36.185992 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 472ca415-301d-42c1-9b59-ab5c256390ed does not exist Jun 10 18:04:36.185992 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-35778c8a-ef84-4c29-bdb9-cd92f6f329b6'] Jun 10 18:04:36.185992 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:36.192743 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3eacbaa3-5904-4297-9436-e20be84febea tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Returning 404 to user: Security group 472ca415-301d-42c1-9b59-ab5c256390ed does not exist Jun 10 18:04:36.192743 chdv-master-2 devstack@n-api.service[126594]: Neutron server returns request_ids: ['req-35778c8a-ef84-4c29-bdb9-cd92f6f329b6'] {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:04:36.193949 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3eacbaa3-5904-4297-9436-e20be84febea tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/os-security-groups/472ca415-301d-42c1-9b59-ab5c256390ed" status: 404 len: 194 microversion: 2.1 time: 0.094920 Jun 10 18:04:36.195546 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1124/2244] 10.222.0.35 () {58 vars in 1268 bytes} [Fri Jun 10 18:04:36 2022] GET /compute/v2.1/os-security-groups/472ca415-301d-42c1-9b59-ab5c256390ed => generated 194 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:04:36.204268 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-aaaeb5e6-bad6-4dd0-a919-9bc2d4c416a9 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:36.206379 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-aaaeb5e6-bad6-4dd0-a919-9bc2d4c416a9 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] [instance: ca923f2e-f40e-4c7c-bede-58ab9cda2763] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:36.215475 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aaaeb5e6-bad6-4dd0-a919-9bc2d4c416a9 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:36.215930 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aaaeb5e6-bad6-4dd0-a919-9bc2d4c416a9 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:36.216772 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aaaeb5e6-bad6-4dd0-a919-9bc2d4c416a9 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:36.217215 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aaaeb5e6-bad6-4dd0-a919-9bc2d4c416a9 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:36.235471 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-aaaeb5e6-bad6-4dd0-a919-9bc2d4c416a9 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] HTTP exception thrown: Instance ca923f2e-f40e-4c7c-bede-58ab9cda2763 could not be found. Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-aaaeb5e6-bad6-4dd0-a919-9bc2d4c416a9 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Request method failure captured: Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/ca923f2e-f40e-4c7c-bede-58ab9cda2763 HTTP/1.1 Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4d2g6LisIDVkTYTcdOtG0A3umrUEUWfSSdKBZBTZSGZWByrOwwCj-5KqksYro3H1okjI-zzuU5IHUS4lo6yG-r96m6TXL_G3wFZOzgUE1VCvpXQWprzUOsbOtrwUJG6ZZ0kitxUWkFBtgkuEIiNHG9TcUYzDRR5llGfQuUx6UFa3gE Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 8f24d6db014a4fecb9533fa4cf1be8c7 Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ListServersNegativeTestJSON-1230596670 Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/8f24d6db014a4fecb9533fa4cf1be8c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8f24d6db014a4fecb9533fa4cf1be8c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8f24d6db014a4fecb9533fa4cf1be8c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_8f24d6db014a4fecb9533fa4cf1be8c7", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ListServersNegativeTestJSON-1230596670 Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 8f24d6db014a4fecb9533fa4cf1be8c7 Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1230596670 Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ListServersNegativeTestJSON-1230596670-project Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: be318f01fac5459cb4d0f55cf374824f Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ListServersNegativeTestJSON-1230596670-project Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: exception: Instance ca923f2e-f40e-4c7c-bede-58ab9cda2763 could not be found. Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'ca923f2e-f40e-4c7c-bede-58ab9cda2763'} Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca923f2e-f40e-4c7c-bede-58ab9cda2763 could not be found. Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca923f2e-f40e-4c7c-bede-58ab9cda2763 could not be found. Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:36.237060 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:36.242389 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:36.242389 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:04:36.242389 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:04:36.242389 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:04:36.242389 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:04:36.242389 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca923f2e-f40e-4c7c-bede-58ab9cda2763 could not be found. Jun 10 18:04:36.242389 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:36.242389 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-aaaeb5e6-bad6-4dd0-a919-9bc2d4c416a9 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] Returning 404 to user: Instance ca923f2e-f40e-4c7c-bede-58ab9cda2763 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:04:36.242389 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-aaaeb5e6-bad6-4dd0-a919-9bc2d4c416a9 tempest-ListServersNegativeTestJSON-1230596670 tempest-ListServersNegativeTestJSON-1230596670-project] 10.222.0.35 "GET /compute/v2.1/servers/ca923f2e-f40e-4c7c-bede-58ab9cda2763" status: 404 len: 111 microversion: 2.1 time: 0.041243 Jun 10 18:04:36.242389 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1125/2245] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:36 2022] GET /compute/v2.1/servers/ca923f2e-f40e-4c7c-bede-58ab9cda2763 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:04:36.245114 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-94a64450-b6b1-4a3a-8054-73af3131385e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:36.247064 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-94a64450-b6b1-4a3a-8054-73af3131385e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:36.254162 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-94a64450-b6b1-4a3a-8054-73af3131385e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:36.254981 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-94a64450-b6b1-4a3a-8054-73af3131385e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:36.255956 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-94a64450-b6b1-4a3a-8054-73af3131385e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:36.256274 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-76c9992c-2781-48f1-924f-6209e8190b69 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.545388 Jun 10 18:04:36.256420 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-94a64450-b6b1-4a3a-8054-73af3131385e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:36.257293 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1121/2246] 10.222.0.35 () {62 vars in 1187 bytes} [Fri Jun 10 18:04:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1548 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 10 18:04:36.269139 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-78843061-748a-413f-b6a0-44f94e26dd0d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:36.271301 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-78843061-748a-413f-b6a0-44f94e26dd0d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:36.280379 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-78843061-748a-413f-b6a0-44f94e26dd0d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:36.281146 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-78843061-748a-413f-b6a0-44f94e26dd0d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:36.282216 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-78843061-748a-413f-b6a0-44f94e26dd0d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:36.282876 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-78843061-748a-413f-b6a0-44f94e26dd0d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:36.419479 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-94a64450-b6b1-4a3a-8054-73af3131385e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:36.431836 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-94a64450-b6b1-4a3a-8054-73af3131385e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1391 microversion: 2.1 time: 0.188353 Jun 10 18:04:36.439337 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1126/2247] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:36 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1391 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:36.444957 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-d1b40e23-cda6-46a8-8df1-10dbe99073bd req-a2307bc4-6ae9-4762-a1e8-f0adbcefbf5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586adfa4-7b3c-4399-86ab-d2982771af1d", "name": "network-vif-unplugged", "status": "completed", "tag": "8aa0aa37-a6b7-49eb-8548-6164b5ff95d7"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:36.454058 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-d1b40e23-cda6-46a8-8df1-10dbe99073bd req-a2307bc4-6ae9-4762-a1e8-f0adbcefbf5b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:36.454386 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-d1b40e23-cda6-46a8-8df1-10dbe99073bd req-a2307bc4-6ae9-4762-a1e8-f0adbcefbf5b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:36.467935 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-d1b40e23-cda6-46a8-8df1-10dbe99073bd req-a2307bc4-6ae9-4762-a1e8-f0adbcefbf5b service nova] Creating event network-vif-unplugged:8aa0aa37-a6b7-49eb-8548-6164b5ff95d7 for instance 586adfa4-7b3c-4399-86ab-d2982771af1d on chh1-master-2 Jun 10 18:04:36.474723 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [req-d1b40e23-cda6-46a8-8df1-10dbe99073bd req-a2307bc4-6ae9-4762-a1e8-f0adbcefbf5b service nova] Instance 586adfa4-7b3c-4399-86ab-d2982771af1d is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126594) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 18:04:36.489371 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-d1b40e23-cda6-46a8-8df1-10dbe99073bd req-a2307bc4-6ae9-4762-a1e8-f0adbcefbf5b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048185 Jun 10 18:04:36.492336 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1127/2248] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:36.514150 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3633cbcf-585a-4121-8caf-ce2d44631d30 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:36.515167 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3633cbcf-585a-4121-8caf-ce2d44631d30 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 49b47316-e3b5-4ecd-962d-003a6cd0def3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:36.523145 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3633cbcf-585a-4121-8caf-ce2d44631d30 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:36.523861 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3633cbcf-585a-4121-8caf-ce2d44631d30 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:36.525197 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3633cbcf-585a-4121-8caf-ce2d44631d30 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:36.526303 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3633cbcf-585a-4121-8caf-ce2d44631d30 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:36.859442 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-78843061-748a-413f-b6a0-44f94e26dd0d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:36.869106 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-78843061-748a-413f-b6a0-44f94e26dd0d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1469 microversion: 2.1 time: 0.608932 Jun 10 18:04:36.870029 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1122/2249] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:36 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1469 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:36.874823 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7a02ef95-f7cc-4230-a067-833d794fdf4b tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.39.7.175"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:36.877516 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7a02ef95-f7cc-4230-a067-833d794fdf4b tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] [instance: 4864e5b5-595a-4935-80c2-2572b66f8162] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:36.884797 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7a02ef95-f7cc-4230-a067-833d794fdf4b tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:36.885612 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7a02ef95-f7cc-4230-a067-833d794fdf4b tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:36.886779 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7a02ef95-f7cc-4230-a067-833d794fdf4b tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:36.887481 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7a02ef95-f7cc-4230-a067-833d794fdf4b tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:36.940554 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7a02ef95-f7cc-4230-a067-833d794fdf4b tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Acquired lock "refresh_cache-4864e5b5-595a-4935-80c2-2572b66f8162" {{(pid=126595) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 10 18:04:36.940782 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3633cbcf-585a-4121-8caf-ce2d44631d30 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:36.952903 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3633cbcf-585a-4121-8caf-ce2d44631d30 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3" status: 200 len: 1314 microversion: 2.1 time: 0.449657 Jun 10 18:04:36.953512 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1128/2250] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:36 2022] GET /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3 => generated 1314 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:36.959222 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c73dd174-6f53-4a31-b986-45781f14a1ec tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '.version_select at 0x7f77c030c310>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:37.474726 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c73dd174-6f53-4a31-b986-45781f14a1ec tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "DELETE /compute/v2.1/os-security-groups/3aed0600-32a5-486a-97b8-69bdf8b80c09" status: 202 len: 0 microversion: 2.1 time: 0.519275 Jun 10 18:04:37.476164 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1129/2251] 10.222.0.35 () {58 vars in 1271 bytes} [Fri Jun 10 18:04:36 2022] DELETE /compute/v2.1/os-security-groups/3aed0600-32a5-486a-97b8-69bdf8b80c09 => generated 0 bytes in 522 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:04:37.483933 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-d708cbdd-fd56-4639-93b6-567c8a1b466f req-a0bc5d2b-8451-4094-81f0-7a88677a3542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e24cb05a-9ceb-4570-9773-b04297cbf4bb", "name": "network-vif-unplugged", "status": "completed", "tag": "f0d78f74-c94f-47fc-b5f6-fca21d020e90"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:37.509940 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-d708cbdd-fd56-4639-93b6-567c8a1b466f req-a0bc5d2b-8451-4094-81f0-7a88677a3542 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:37.513186 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-d708cbdd-fd56-4639-93b6-567c8a1b466f req-a0bc5d2b-8451-4094-81f0-7a88677a3542 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:37.568176 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-d708cbdd-fd56-4639-93b6-567c8a1b466f req-a0bc5d2b-8451-4094-81f0-7a88677a3542 service nova] Creating event network-vif-unplugged:f0d78f74-c94f-47fc-b5f6-fca21d020e90 for instance e24cb05a-9ceb-4570-9773-b04297cbf4bb on chh2-master-2 Jun 10 18:04:37.575918 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-d708cbdd-fd56-4639-93b6-567c8a1b466f req-a0bc5d2b-8451-4094-81f0-7a88677a3542 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097021 Jun 10 18:04:37.590695 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1130/2252] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:37.597952 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0efd13f7-d69c-4a44-bd5a-91fc21b0ad9b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:37.598779 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0efd13f7-d69c-4a44-bd5a-91fc21b0ad9b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:37.605438 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0efd13f7-d69c-4a44-bd5a-91fc21b0ad9b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:37.610288 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0efd13f7-d69c-4a44-bd5a-91fc21b0ad9b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:37.610288 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0efd13f7-d69c-4a44-bd5a-91fc21b0ad9b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:37.610288 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0efd13f7-d69c-4a44-bd5a-91fc21b0ad9b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:37.739459 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0efd13f7-d69c-4a44-bd5a-91fc21b0ad9b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:37.753586 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0efd13f7-d69c-4a44-bd5a-91fc21b0ad9b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:37.757209 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0efd13f7-d69c-4a44-bd5a-91fc21b0ad9b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:37.764684 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0efd13f7-d69c-4a44-bd5a-91fc21b0ad9b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1185 microversion: 2.25 time: 0.170926 Jun 10 18:04:37.768075 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1131/2253] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:04:37 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1185 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:04:37.778127 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3b763226-0a3e-4f1f-b7d0-8d0175e4a6bb tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:37.779093 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3b763226-0a3e-4f1f-b7d0-8d0175e4a6bb tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:37.795789 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3b763226-0a3e-4f1f-b7d0-8d0175e4a6bb tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:37.798169 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3b763226-0a3e-4f1f-b7d0-8d0175e4a6bb tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:37.800111 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3b763226-0a3e-4f1f-b7d0-8d0175e4a6bb tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:37.802046 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3b763226-0a3e-4f1f-b7d0-8d0175e4a6bb tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:38.151388 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3b763226-0a3e-4f1f-b7d0-8d0175e4a6bb tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:38.162385 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3b763226-0a3e-4f1f-b7d0-8d0175e4a6bb tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1391 microversion: 2.1 time: 0.391483 Jun 10 18:04:38.175114 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1132/2254] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:37 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1391 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:38.181818 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c2927bc9-3f70-4da1-b829-14f687618baf tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '.version_select at 0x7f77c00ad3a0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:38.210081 chdv-master-2 devstack@n-api.service[126594]: DEBUG neutronclient.v2_0.client [None req-c2927bc9-3f70-4da1-b829-14f687618baf tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3aed0600-32a5-486a-97b8-69bdf8b80c09 does not exist", "detail": ""}} {{(pid=126594) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 10 18:04:38.210926 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.security_group_api [None req-c2927bc9-3f70-4da1-b829-14f687618baf tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Neutron security group 3aed0600-32a5-486a-97b8-69bdf8b80c09 not found {{(pid=126594) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 10 18:04:38.212166 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-c2927bc9-3f70-4da1-b829-14f687618baf tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] HTTP exception thrown: Security group 3aed0600-32a5-486a-97b8-69bdf8b80c09 does not exist Jun 10 18:04:38.212166 chdv-master-2 devstack@n-api.service[126594]: Neutron server returns request_ids: ['req-b19df5ae-5a3f-4204-b12c-5ddaaf41c7b8'] Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c2927bc9-3f70-4da1-b829-14f687618baf tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Request method failure captured: Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/os-security-groups/3aed0600-32a5-486a-97b8-69bdf8b80c09 HTTP/1.1 Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4eKfGQZQ_jvhwHBxZ1GMnYHkMaBNBt7T8Ue90hW5x7BTDgkg2AiOfeu2huz2YQsnFH29P56VFWZd48_hROirge71TvR4QiKyTENHZz-D3t9ZS-m9216ej7Rjuw3slpnWYAQuE-KXkyXTlRqKM7yyNbBp9KRqjUFN-v2IWlTc7Yfat0 Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 304a5340852d4552a490e874dda8a0a3 Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_304a5340852d4552a490e874dda8a0a3", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 304a5340852d4552a490e874dda8a0a3 Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-SecurityGroupsTestJSON-732923421-project Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 7278ccddeee3495583093603a0fdb626 Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-SecurityGroupsTestJSON-732923421-project Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: exception: Security group 3aed0600-32a5-486a-97b8-69bdf8b80c09 does not exist Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: Neutron server returns request_ids: ['req-b19df5ae-5a3f-4204-b12c-5ddaaf41c7b8'] Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '3aed0600-32a5-486a-97b8-69bdf8b80c09'} Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 10 18:04:38.214457 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3aed0600-32a5-486a-97b8-69bdf8b80c09 does not exist Jun 10 18:04:38.219546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b19df5ae-5a3f-4204-b12c-5ddaaf41c7b8'] Jun 10 18:04:38.219546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:38.219546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:38.219546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:38.219546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:38.219546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jun 10 18:04:38.219546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 10 18:04:38.219546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 10 18:04:38.219546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 10 18:04:38.219546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3aed0600-32a5-486a-97b8-69bdf8b80c09 does not exist Jun 10 18:04:38.219546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b19df5ae-5a3f-4204-b12c-5ddaaf41c7b8'] Jun 10 18:04:38.219546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:38.219546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:38.219546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:38.219546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:38.219546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:04:38.219546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:04:38.219546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:04:38.219546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:04:38.219546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:04:38.219546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:04:38.219546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:04:38.219546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:04:38.219546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jun 10 18:04:38.219546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 10 18:04:38.219546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3aed0600-32a5-486a-97b8-69bdf8b80c09 does not exist Jun 10 18:04:38.219546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b19df5ae-5a3f-4204-b12c-5ddaaf41c7b8'] Jun 10 18:04:38.219546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:38.219546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:38.219546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:38.219546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:38.219546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:04:38.219546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:04:38.219546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:04:38.219546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:04:38.219546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3aed0600-32a5-486a-97b8-69bdf8b80c09 does not exist Jun 10 18:04:38.219546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b19df5ae-5a3f-4204-b12c-5ddaaf41c7b8'] Jun 10 18:04:38.219546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:38.219546 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c2927bc9-3f70-4da1-b829-14f687618baf tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Returning 404 to user: Security group 3aed0600-32a5-486a-97b8-69bdf8b80c09 does not exist Jun 10 18:04:38.219546 chdv-master-2 devstack@n-api.service[126594]: Neutron server returns request_ids: ['req-b19df5ae-5a3f-4204-b12c-5ddaaf41c7b8'] {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:04:38.219546 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c2927bc9-3f70-4da1-b829-14f687618baf tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/os-security-groups/3aed0600-32a5-486a-97b8-69bdf8b80c09" status: 404 len: 194 microversion: 2.1 time: 0.040871 Jun 10 18:04:38.222933 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1133/2255] 10.222.0.35 () {58 vars in 1268 bytes} [Fri Jun 10 18:04:38 2022] GET /compute/v2.1/os-security-groups/3aed0600-32a5-486a-97b8-69bdf8b80c09 => generated 194 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:04:38.228332 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-65a5b366-8fac-4dd3-bf32-68b8e5273c2b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:38.228980 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-65a5b366-8fac-4dd3-bf32-68b8e5273c2b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:38.263169 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-65a5b366-8fac-4dd3-bf32-68b8e5273c2b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:38.263589 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-65a5b366-8fac-4dd3-bf32-68b8e5273c2b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:38.264472 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-65a5b366-8fac-4dd3-bf32-68b8e5273c2b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:38.264934 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-65a5b366-8fac-4dd3-bf32-68b8e5273c2b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:38.413036 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-65a5b366-8fac-4dd3-bf32-68b8e5273c2b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:38.421599 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-65a5b366-8fac-4dd3-bf32-68b8e5273c2b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1469 microversion: 2.1 time: 0.199508 Jun 10 18:04:38.422504 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1134/2256] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:38 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1469 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:38.428230 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-31e1ccd4-8bfb-4ea4-a45b-bdf69439ae83 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:38.428920 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-31e1ccd4-8bfb-4ea4-a45b-bdf69439ae83 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 49b47316-e3b5-4ecd-962d-003a6cd0def3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:38.435804 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-31e1ccd4-8bfb-4ea4-a45b-bdf69439ae83 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:38.436503 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-31e1ccd4-8bfb-4ea4-a45b-bdf69439ae83 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:38.437468 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-31e1ccd4-8bfb-4ea4-a45b-bdf69439ae83 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:38.437912 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-31e1ccd4-8bfb-4ea4-a45b-bdf69439ae83 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:38.585950 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-31e1ccd4-8bfb-4ea4-a45b-bdf69439ae83 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:38.598080 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-31e1ccd4-8bfb-4ea4-a45b-bdf69439ae83 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3" status: 200 len: 1314 microversion: 2.1 time: 0.174328 Jun 10 18:04:38.600690 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1135/2257] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:38 2022] GET /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:38.612646 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0f5529b4-6670-4070-84cd-8557b2241909 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '.version_select at 0x7f77c0ace3a0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:38.849306 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0f5529b4-6670-4070-84cd-8557b2241909 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/os-security-groups" status: 200 len: 1155 microversion: 2.1 time: 0.247326 Jun 10 18:04:38.858744 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1136/2258] 10.222.0.35 () {58 vars in 1157 bytes} [Fri Jun 10 18:04:38 2022] GET /compute/v2.1/os-security-groups => generated 1155 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:38.864068 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-163d681a-a069-47bc-a686-15e340bc218d req-e4de2ff4-f55b-4edb-8a96-5453224016dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "586adfa4-7b3c-4399-86ab-d2982771af1d", "tag": "8aa0aa37-a6b7-49eb-8548-6164b5ff95d7"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:38.876263 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-163d681a-a069-47bc-a686-15e340bc218d req-e4de2ff4-f55b-4edb-8a96-5453224016dd service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:38.876263 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-163d681a-a069-47bc-a686-15e340bc218d req-e4de2ff4-f55b-4edb-8a96-5453224016dd service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:38.879991 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:04:38.888539 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-163d681a-a069-47bc-a686-15e340bc218d req-e4de2ff4-f55b-4edb-8a96-5453224016dd service nova] Creating event network-changed:8aa0aa37-a6b7-49eb-8548-6164b5ff95d7 for instance 586adfa4-7b3c-4399-86ab-d2982771af1d on chh1-master-2 Jun 10 18:04:38.910369 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [req-163d681a-a069-47bc-a686-15e340bc218d req-e4de2ff4-f55b-4edb-8a96-5453224016dd service nova] Instance 586adfa4-7b3c-4399-86ab-d2982771af1d is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126594) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 18:04:38.934602 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-163d681a-a069-47bc-a686-15e340bc218d req-e4de2ff4-f55b-4edb-8a96-5453224016dd service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082021 Jun 10 18:04:38.936698 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1137/2259] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:38.942088 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-034ad175-37d1-408d-9fd3-cd7275050cea tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:38.944625 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-034ad175-37d1-408d-9fd3-cd7275050cea tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:38.954797 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-034ad175-37d1-408d-9fd3-cd7275050cea tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:38.955602 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-034ad175-37d1-408d-9fd3-cd7275050cea tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:38.957084 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-034ad175-37d1-408d-9fd3-cd7275050cea tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:38.957752 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-034ad175-37d1-408d-9fd3-cd7275050cea tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:38.967711 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-7a02ef95-f7cc-4230-a067-833d794fdf4b tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] [instance: 4864e5b5-595a-4935-80c2-2572b66f8162] Building network info cache for instance {{(pid=126595) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} Jun 10 18:04:39.046284 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-034ad175-37d1-408d-9fd3-cd7275050cea tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:39.054477 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-034ad175-37d1-408d-9fd3-cd7275050cea tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:39.056826 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-034ad175-37d1-408d-9fd3-cd7275050cea tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:39.063525 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-034ad175-37d1-408d-9fd3-cd7275050cea tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1233 microversion: 2.25 time: 0.126529 Jun 10 18:04:39.064643 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1138/2260] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:04:38 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1233 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:04:39.069432 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1b9e657b-0bf6-44c5-89a5-21227c10ae75 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Action: 'create', calling method: .version_select at 0x7f77c0b7c9d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1448673100", "description": "tempest-description-2025066001"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:39.905338 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1b9e657b-0bf6-44c5-89a5-21227c10ae75 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.839396 Jun 10 18:04:39.907301 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1139/2261] 10.222.0.35 () {60 vars in 1179 bytes} [Fri Jun 10 18:04:39 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:39.912881 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6afc9304-dcad-4eaa-b206-a3b054a30339 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:39.915942 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6afc9304-dcad-4eaa-b206-a3b054a30339 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:39.940641 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6afc9304-dcad-4eaa-b206-a3b054a30339 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:39.943747 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6afc9304-dcad-4eaa-b206-a3b054a30339 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:39.945987 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6afc9304-dcad-4eaa-b206-a3b054a30339 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:39.950991 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6afc9304-dcad-4eaa-b206-a3b054a30339 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:40.536254 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6afc9304-dcad-4eaa-b206-a3b054a30339 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:40.557522 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6afc9304-dcad-4eaa-b206-a3b054a30339 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1391 microversion: 2.1 time: 0.649015 Jun 10 18:04:40.562847 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1140/2262] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:39 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1391 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:40.575594 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-be6492ec-2eb3-499d-ac44-afaec8d3a738 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:40.576729 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-be6492ec-2eb3-499d-ac44-afaec8d3a738 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:40.596872 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be6492ec-2eb3-499d-ac44-afaec8d3a738 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:40.597646 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be6492ec-2eb3-499d-ac44-afaec8d3a738 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:40.598632 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be6492ec-2eb3-499d-ac44-afaec8d3a738 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:40.599242 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be6492ec-2eb3-499d-ac44-afaec8d3a738 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:40.788790 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-7a02ef95-f7cc-4230-a067-833d794fdf4b tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] [instance: 4864e5b5-595a-4935-80c2-2572b66f8162] Updating instance_info_cache with network_info: [{"id": "40a20790-d62d-4bb6-98d8-b36feab7f804", "address": "fa:16:3e:b5:04:d4", "network": {"id": "dde12c67-1ecf-4aa1-a9c1-4bb2412e8e71", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-797631625-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.39.7.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "be8ad96cd98c4cf683f763099e3064a4", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap40a20790-d6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126595) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 10 18:04:40.865672 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7a02ef95-f7cc-4230-a067-833d794fdf4b tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Releasing lock "refresh_cache-4864e5b5-595a-4935-80c2-2572b66f8162" {{(pid=126595) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 10 18:04:40.866559 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7a02ef95-f7cc-4230-a067-833d794fdf4b tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] 10.222.0.35 "POST /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162/action" status: 202 len: 0 microversion: 2.1 time: 3.995564 Jun 10 18:04:40.867186 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1123/2263] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:04:36 2022] POST /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162/action => generated 0 bytes in 3997 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 10 18:04:40.979849 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-be6492ec-2eb3-499d-ac44-afaec8d3a738 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:40.992094 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-be6492ec-2eb3-499d-ac44-afaec8d3a738 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1462 microversion: 2.1 time: 0.427376 Jun 10 18:04:41.003995 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1141/2264] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:40 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1462 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:41.003995 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e1e25d04-7186-4e69-9cf2-c42a9d62473c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:41.003995 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e1e25d04-7186-4e69-9cf2-c42a9d62473c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 49b47316-e3b5-4ecd-962d-003a6cd0def3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:41.010093 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e1e25d04-7186-4e69-9cf2-c42a9d62473c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:41.010561 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e1e25d04-7186-4e69-9cf2-c42a9d62473c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:41.011354 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e1e25d04-7186-4e69-9cf2-c42a9d62473c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:41.011805 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e1e25d04-7186-4e69-9cf2-c42a9d62473c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:41.142726 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ee414a60-002f-4965-b65f-2b2e1d26efed tempest-KeyPairsV2TestJSON-183912026 tempest-KeyPairsV2TestJSON-183912026-project] Action: 'create', calling method: .version_select at 0x7f77c06211f0>, body: {"keypair": {"name": "tempest-keypair-296590267", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKU4BfiSVEvp58OOIPGUJVbz7w5eRtya8cgqgv/aM2uSXt2zEU5zUhqv+NOCiNxSHL5M+lfr42RygvkijFJDN60i0+FOsDuLKNhUjWrrPRh3OzrpDZv33CzxJTsEc6s3zA=="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:41.165972 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-ee414a60-002f-4965-b65f-2b2e1d26efed tempest-KeyPairsV2TestJSON-183912026 tempest-KeyPairsV2TestJSON-183912026-project] Getting quotas for project 27e030e659cf4955b65d9a57b5cf84c4. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:04:41.171967 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-ee414a60-002f-4965-b65f-2b2e1d26efed tempest-KeyPairsV2TestJSON-183912026 tempest-KeyPairsV2TestJSON-183912026-project] Getting quotas for user eb4c3f18d5df4245a2da332286d7980b and project 27e030e659cf4955b65d9a57b5cf84c4. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:04:41.240951 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e1e25d04-7186-4e69-9cf2-c42a9d62473c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:41.249131 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e1e25d04-7186-4e69-9cf2-c42a9d62473c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3" status: 200 len: 1314 microversion: 2.1 time: 0.254094 Jun 10 18:04:41.252235 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1142/2265] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:40 2022] GET /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:41.253532 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ee414a60-002f-4965-b65f-2b2e1d26efed tempest-KeyPairsV2TestJSON-183912026 tempest-KeyPairsV2TestJSON-183912026-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.384121 Jun 10 18:04:41.254606 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1124/2266] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 18:04:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:41.258064 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-8f830ca8-3502-4089-8226-d1081dfadd66 req-242baee9-cb26-4f3a-91c1-2991e04c4b5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49b47316-e3b5-4ecd-962d-003a6cd0def3", "tag": "64263ed8-9f70-4dc5-9680-67d42e35c925"}, {"name": "network-changed", "server_uuid": "e24cb05a-9ceb-4570-9773-b04297cbf4bb", "tag": "f0d78f74-c94f-47fc-b5f6-fca21d020e90"}, {"name": "network-changed", "server_uuid": "4864e5b5-595a-4935-80c2-2572b66f8162", "tag": "40a20790-d62d-4bb6-98d8-b36feab7f804"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:41.260121 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6afd86be-59a7-423c-9a0d-241babb69f0f tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Action: 'create', calling method: .version_select at 0x7f77c0fd1040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1809523909", "description": "tempest-description-716224729"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:41.278392 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-8f830ca8-3502-4089-8226-d1081dfadd66 req-242baee9-cb26-4f3a-91c1-2991e04c4b5b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:41.278990 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-8f830ca8-3502-4089-8226-d1081dfadd66 req-242baee9-cb26-4f3a-91c1-2991e04c4b5b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:41.295056 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-8f830ca8-3502-4089-8226-d1081dfadd66 req-242baee9-cb26-4f3a-91c1-2991e04c4b5b service nova] Creating event network-changed:64263ed8-9f70-4dc5-9680-67d42e35c925 for instance 49b47316-e3b5-4ecd-962d-003a6cd0def3 on chh1-master-2 Jun 10 18:04:41.300327 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-8f830ca8-3502-4089-8226-d1081dfadd66 req-242baee9-cb26-4f3a-91c1-2991e04c4b5b service nova] Creating event network-changed:f0d78f74-c94f-47fc-b5f6-fca21d020e90 for instance e24cb05a-9ceb-4570-9773-b04297cbf4bb on chh2-master-2 Jun 10 18:04:41.300327 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-8f830ca8-3502-4089-8226-d1081dfadd66 req-242baee9-cb26-4f3a-91c1-2991e04c4b5b service nova] Creating event network-changed:40a20790-d62d-4bb6-98d8-b36feab7f804 for instance 4864e5b5-595a-4935-80c2-2572b66f8162 on chh1-master-2 Jun 10 18:04:41.305971 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-8f830ca8-3502-4089-8226-d1081dfadd66 req-242baee9-cb26-4f3a-91c1-2991e04c4b5b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.052013 Jun 10 18:04:41.306667 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1143/2267] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:41.312161 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7d2536a6-6d2e-48a0-baad-b6ad9616cdc4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:41.312953 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7d2536a6-6d2e-48a0-baad-b6ad9616cdc4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:41.319532 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7d2536a6-6d2e-48a0-baad-b6ad9616cdc4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:41.320076 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7d2536a6-6d2e-48a0-baad-b6ad9616cdc4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:41.320998 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7d2536a6-6d2e-48a0-baad-b6ad9616cdc4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:41.321522 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7d2536a6-6d2e-48a0-baad-b6ad9616cdc4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:41.545462 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7d2536a6-6d2e-48a0-baad-b6ad9616cdc4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:41.558666 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7d2536a6-6d2e-48a0-baad-b6ad9616cdc4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:41.560295 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7d2536a6-6d2e-48a0-baad-b6ad9616cdc4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:41.561712 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7d2536a6-6d2e-48a0-baad-b6ad9616cdc4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1293 microversion: 2.25 time: 0.253887 Jun 10 18:04:41.562555 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1144/2268] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:04:41 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1293 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:04:41.567141 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-78dc6bcf-2610-43fb-9388-24e0c3cceaea tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Action: 'create', calling method: .version_select at 0x7f77c00efa60>, body: {"pool": "ee72fd31-e0e2-470e-b15d-ae5538ee16e6"} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:41.868542 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6afd86be-59a7-423c-9a0d-241babb69f0f tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.612462 Jun 10 18:04:41.881896 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1125/2269] 10.222.0.35 () {60 vars in 1179 bytes} [Fri Jun 10 18:04:41 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:42.090142 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7ece86f6-1fb1-4064-ab4f-5341e082d19a tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:42.090782 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7ece86f6-1fb1-4064-ab4f-5341e082d19a tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:42.099166 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7ece86f6-1fb1-4064-ab4f-5341e082d19a tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:42.099637 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7ece86f6-1fb1-4064-ab4f-5341e082d19a tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:42.101551 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7ece86f6-1fb1-4064-ab4f-5341e082d19a tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:42.102559 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7ece86f6-1fb1-4064-ab4f-5341e082d19a tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:42.273394 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7ece86f6-1fb1-4064-ab4f-5341e082d19a tempest-MigrationsAdminTest-1983229517 tempest-MigrationsAdminTest-1983229517-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1613 microversion: 2.1 time: 0.389964 Jun 10 18:04:42.274014 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1126/2270] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:41 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1613 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:42.365222 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ba78e340-6946-4ee5-af7f-589e9795cb26 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-854138009", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": "none"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:42.448075 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-ba78e340-6946-4ee5-af7f-589e9795cb26 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:04:42.448761 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-ba78e340-6946-4ee5-af7f-589e9795cb26 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:04:42.449395 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-ba78e340-6946-4ee5-af7f-589e9795cb26 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:04:42.449965 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-ba78e340-6946-4ee5-af7f-589e9795cb26 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:04:42.450537 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-ba78e340-6946-4ee5-af7f-589e9795cb26 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:04:42.461550 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ba78e340-6946-4ee5-af7f-589e9795cb26 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:42.462281 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ba78e340-6946-4ee5-af7f-589e9795cb26 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:42.463815 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ba78e340-6946-4ee5-af7f-589e9795cb26 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:42.464459 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ba78e340-6946-4ee5-af7f-589e9795cb26 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:42.474931 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=13 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:04:42.489369 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-ba78e340-6946-4ee5-af7f-589e9795cb26 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Getting quotas for project 46b6584334c2481e8bbffb2d1d50cc3c. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:04:42.498846 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-ba78e340-6946-4ee5-af7f-589e9795cb26 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Getting quotas for user 56583ac49efa4176b34417b775f1398e and project 46b6584334c2481e8bbffb2d1d50cc3c. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:04:42.513341 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ba78e340-6946-4ee5-af7f-589e9795cb26 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:04:42.516370 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ba78e340-6946-4ee5-af7f-589e9795cb26 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] [instance: feb3b3b3-a867-4c17-9012-054b5e95790c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:04:42.647380 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ba78e340-6946-4ee5-af7f-589e9795cb26 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.346507 Jun 10 18:04:42.653327 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1127/2271] 10.222.0.35 () {62 vars in 1187 bytes} [Fri Jun 10 18:04:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 353 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 10 18:04:42.658249 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-95348c4d-80b6-47ba-931d-af31d8b1dddd tempest-KeyPairsV2TestJSON-183912026 tempest-KeyPairsV2TestJSON-183912026-project] Calling method '.version_select at 0x7f77c1725940>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:42.676499 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-95348c4d-80b6-47ba-931d-af31d8b1dddd tempest-KeyPairsV2TestJSON-183912026 tempest-KeyPairsV2TestJSON-183912026-project] 10.222.0.35 "GET /compute/v2.1/os-keypairs/tempest-keypair-296590267" status: 200 len: 497 microversion: 2.1 time: 0.019852 Jun 10 18:04:42.684137 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1128/2272] 10.222.0.35 () {58 vars in 1214 bytes} [Fri Jun 10 18:04:42 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-296590267 => generated 497 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:42.687682 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b9fc4c21-45cf-444a-a45e-0c11e1eac5ca tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:42.690341 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b9fc4c21-45cf-444a-a45e-0c11e1eac5ca tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:42.701679 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9fc4c21-45cf-444a-a45e-0c11e1eac5ca tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:42.701864 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9fc4c21-45cf-444a-a45e-0c11e1eac5ca tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:42.702758 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9fc4c21-45cf-444a-a45e-0c11e1eac5ca tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:42.703488 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9fc4c21-45cf-444a-a45e-0c11e1eac5ca tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:43.014954 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b9fc4c21-45cf-444a-a45e-0c11e1eac5ca tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:43.025966 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b9fc4c21-45cf-444a-a45e-0c11e1eac5ca tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1391 microversion: 2.1 time: 0.347668 Jun 10 18:04:43.029729 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1129/2273] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:42 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1391 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:43.039549 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-777af438-ad84-436d-8252-8a38dd827fd9 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1821001490", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "5585293d-a4c1-4a92-a3ba-d8142e4ec6ed"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:43.129209 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-777af438-ad84-436d-8252-8a38dd827fd9 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] validate_networks() for [('5585293d-a4c1-4a92-a3ba-d8142e4ec6ed', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:04:43.767087 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-777af438-ad84-436d-8252-8a38dd827fd9 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:04:43.767977 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-777af438-ad84-436d-8252-8a38dd827fd9 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:04:43.768778 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-777af438-ad84-436d-8252-8a38dd827fd9 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:04:43.769382 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-777af438-ad84-436d-8252-8a38dd827fd9 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:04:43.770073 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-777af438-ad84-436d-8252-8a38dd827fd9 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:04:43.782074 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-777af438-ad84-436d-8252-8a38dd827fd9 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:43.782793 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-777af438-ad84-436d-8252-8a38dd827fd9 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:43.784001 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-777af438-ad84-436d-8252-8a38dd827fd9 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:43.784701 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-777af438-ad84-436d-8252-8a38dd827fd9 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:43.807827 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-777af438-ad84-436d-8252-8a38dd827fd9 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Getting quotas for project 304a5340852d4552a490e874dda8a0a3. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:04:43.816192 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-777af438-ad84-436d-8252-8a38dd827fd9 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Getting quotas for user 7278ccddeee3495583093603a0fdb626 and project 304a5340852d4552a490e874dda8a0a3. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:04:43.849897 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-777af438-ad84-436d-8252-8a38dd827fd9 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:04:43.852583 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-777af438-ad84-436d-8252-8a38dd827fd9 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: b6fe7ee7-fe32-4aa2-8616-784a199a4973] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:04:44.122570 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-777af438-ad84-436d-8252-8a38dd827fd9 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.091536 Jun 10 18:04:44.124075 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1130/2274] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:04:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1094 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:04:44.138985 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-09fb6452-31fc-4cc7-b032-777780168526 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:44.141227 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-09fb6452-31fc-4cc7-b032-777780168526 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 49b47316-e3b5-4ecd-962d-003a6cd0def3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:44.163712 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-09fb6452-31fc-4cc7-b032-777780168526 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:44.164182 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-09fb6452-31fc-4cc7-b032-777780168526 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:44.168552 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-09fb6452-31fc-4cc7-b032-777780168526 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:44.168552 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-09fb6452-31fc-4cc7-b032-777780168526 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:44.761818 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-09fb6452-31fc-4cc7-b032-777780168526 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:44.761818 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-09fb6452-31fc-4cc7-b032-777780168526 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3" status: 200 len: 1314 microversion: 2.1 time: 0.330746 Jun 10 18:04:44.761818 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1131/2275] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:44 2022] GET /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3 => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:44.761818 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fcce9587-9c76-4325-a61e-f3febf0b88c1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:44.761818 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fcce9587-9c76-4325-a61e-f3febf0b88c1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:44.761818 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fcce9587-9c76-4325-a61e-f3febf0b88c1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:44.761818 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fcce9587-9c76-4325-a61e-f3febf0b88c1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:44.761818 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fcce9587-9c76-4325-a61e-f3febf0b88c1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:44.761818 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fcce9587-9c76-4325-a61e-f3febf0b88c1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:44.761818 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=94,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:04:44.761818 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fcce9587-9c76-4325-a61e-f3febf0b88c1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:04:44.770339 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-78dc6bcf-2610-43fb-9388-24e0c3cceaea tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] 10.222.0.35 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.971417 Jun 10 18:04:44.770339 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1145/2276] 10.222.0.35 () {60 vars in 1169 bytes} [Fri Jun 10 18:04:41 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2974 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:44.770339 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-632c3171-4650-41d3-a566-c369fd7c89c4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:44.770339 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-632c3171-4650-41d3-a566-c369fd7c89c4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:44.770339 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-632c3171-4650-41d3-a566-c369fd7c89c4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:44.770339 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-632c3171-4650-41d3-a566-c369fd7c89c4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:44.770339 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-632c3171-4650-41d3-a566-c369fd7c89c4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:44.770339 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-632c3171-4650-41d3-a566-c369fd7c89c4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:44.770339 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-632c3171-4650-41d3-a566-c369fd7c89c4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:44.770339 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-632c3171-4650-41d3-a566-c369fd7c89c4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:44.770339 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-632c3171-4650-41d3-a566-c369fd7c89c4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:44.773395 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-632c3171-4650-41d3-a566-c369fd7c89c4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1293 microversion: 2.25 time: 0.153897 Jun 10 18:04:44.773395 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1146/2277] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:04:44 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1293 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:04:44.773395 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f700a84c-8db4-49c9-9783-76e4e01fab4d tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:44.773395 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f700a84c-8db4-49c9-9783-76e4e01fab4d tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] [instance: feb3b3b3-a867-4c17-9012-054b5e95790c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:44.773395 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f700a84c-8db4-49c9-9783-76e4e01fab4d tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56583ac49efa4176b34417b775f1398e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b6584334c2481e8bbffb2d1d50cc3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:44.773395 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f700a84c-8db4-49c9-9783-76e4e01fab4d tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56583ac49efa4176b34417b775f1398e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b6584334c2481e8bbffb2d1d50cc3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:44.773395 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f700a84c-8db4-49c9-9783-76e4e01fab4d tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56583ac49efa4176b34417b775f1398e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b6584334c2481e8bbffb2d1d50cc3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:44.773395 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f700a84c-8db4-49c9-9783-76e4e01fab4d tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] 10.222.0.35 "GET /compute/v2.1/servers/feb3b3b3-a867-4c17-9012-054b5e95790c" status: 200 len: 1280 microversion: 2.47 time: 0.076722 Jun 10 18:04:44.773395 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1147/2278] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:04:44 2022] GET /compute/v2.1/servers/feb3b3b3-a867-4c17-9012-054b5e95790c => generated 1280 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:04:44.776328 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d0e39af5-c3eb-4abb-9feb-109398f929dd tempest-KeyPairsV2TestJSON-183912026 tempest-KeyPairsV2TestJSON-183912026-project] Calling method '.version_select at 0x7f77c00ef940>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:45.054952 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d0e39af5-c3eb-4abb-9feb-109398f929dd tempest-KeyPairsV2TestJSON-183912026 tempest-KeyPairsV2TestJSON-183912026-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-296590267" status: 202 len: 0 microversion: 2.1 time: 0.283182 Jun 10 18:04:45.056064 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1148/2279] 10.222.0.35 () {58 vars in 1217 bytes} [Fri Jun 10 18:04:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-296590267 => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:04:45.064443 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-ca7f0699-183d-444d-8b20-1ada17773ac5 req-d4556f5d-91c3-40d5-a186-a85e330c9333 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1a36d13-beb9-478b-b00f-94efeae1248b", "tag": "dd89a0eb-962f-4a1d-9233-8469a377029e"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:45.077639 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-ca7f0699-183d-444d-8b20-1ada17773ac5 req-d4556f5d-91c3-40d5-a186-a85e330c9333 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:45.080153 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-ca7f0699-183d-444d-8b20-1ada17773ac5 req-d4556f5d-91c3-40d5-a186-a85e330c9333 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:45.089962 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-ca7f0699-183d-444d-8b20-1ada17773ac5 req-d4556f5d-91c3-40d5-a186-a85e330c9333 service nova] Creating event network-changed:dd89a0eb-962f-4a1d-9233-8469a377029e for instance f1a36d13-beb9-478b-b00f-94efeae1248b on chh2-master-2 Jun 10 18:04:45.095167 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-ca7f0699-183d-444d-8b20-1ada17773ac5 req-d4556f5d-91c3-40d5-a186-a85e330c9333 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037570 Jun 10 18:04:45.095782 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1149/2280] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:45.101558 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f4c9427f-6ef6-41fb-88fb-019143f17b9b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:45.102303 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f4c9427f-6ef6-41fb-88fb-019143f17b9b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:45.109466 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4c9427f-6ef6-41fb-88fb-019143f17b9b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:45.109932 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4c9427f-6ef6-41fb-88fb-019143f17b9b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:45.110925 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4c9427f-6ef6-41fb-88fb-019143f17b9b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:45.111624 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4c9427f-6ef6-41fb-88fb-019143f17b9b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:45.304903 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fcce9587-9c76-4325-a61e-f3febf0b88c1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "DELETE /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 204 len: 0 microversion: 2.1 time: 0.842420 Jun 10 18:04:45.306471 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1132/2281] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:04:44 2022] DELETE /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 0 bytes in 844 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:04:45.312155 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-887d9d9b-ecc8-4594-b717-807875532eb9 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:45.312899 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-887d9d9b-ecc8-4594-b717-807875532eb9 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: b6fe7ee7-fe32-4aa2-8616-784a199a4973] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:45.373906 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-887d9d9b-ecc8-4594-b717-807875532eb9 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:45.383185 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-887d9d9b-ecc8-4594-b717-807875532eb9 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973" status: 200 len: 1216 microversion: 2.1 time: 0.075183 Jun 10 18:04:45.384366 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1133/2282] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:45 2022] GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973 => generated 1216 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:45.389289 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-9354cf33-3de2-40c4-a667-1e457ab0b1b3 req-2dfd5cb6-60b1-489f-90f6-a58a930abf23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586adfa4-7b3c-4399-86ab-d2982771af1d", "name": "network-vif-plugged", "status": "completed", "tag": "8aa0aa37-a6b7-49eb-8548-6164b5ff95d7"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:45.405825 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-9354cf33-3de2-40c4-a667-1e457ab0b1b3 req-2dfd5cb6-60b1-489f-90f6-a58a930abf23 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:45.406614 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-9354cf33-3de2-40c4-a667-1e457ab0b1b3 req-2dfd5cb6-60b1-489f-90f6-a58a930abf23 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:45.407529 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f4c9427f-6ef6-41fb-88fb-019143f17b9b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:45.425645 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f4c9427f-6ef6-41fb-88fb-019143f17b9b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1391 microversion: 2.1 time: 0.321093 Jun 10 18:04:45.425645 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1150/2283] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:45 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1391 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:45.429204 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-9354cf33-3de2-40c4-a667-1e457ab0b1b3 req-2dfd5cb6-60b1-489f-90f6-a58a930abf23 service nova] Creating event network-vif-plugged:8aa0aa37-a6b7-49eb-8548-6164b5ff95d7 for instance 586adfa4-7b3c-4399-86ab-d2982771af1d on chh1-master-2 Jun 10 18:04:45.436541 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-9354cf33-3de2-40c4-a667-1e457ab0b1b3 req-2dfd5cb6-60b1-489f-90f6-a58a930abf23 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050640 Jun 10 18:04:45.437804 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1134/2284] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:45.444701 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4f92a549-2450-4d19-a92c-664cec80e470 tempest-KeyPairsV2TestJSON-183912026 tempest-KeyPairsV2TestJSON-183912026-project] Action: 'create', calling method: .version_select at 0x7f77c0659ca0>, body: {"keypair": {"name": "tempest-keypair-327407707", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlutNmHmH/orTOV3NVuKFXM03PPTTRNOCPykCgMpYBIwVkFw48M2xa5IlgU7aub/v4mH7D/C5LDwvVH3EYwNaBDE50DbOzAhR/vnowG5vaSd0nR7J4vzsBm0RdlKLqIXg=="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:45.449624 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a87f0b6e-f044-415f-9165-007708086afe tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.39.7.130"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:45.449624 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a87f0b6e-f044-415f-9165-007708086afe tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] [instance: 4864e5b5-595a-4935-80c2-2572b66f8162] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:45.463774 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a87f0b6e-f044-415f-9165-007708086afe tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:45.464222 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a87f0b6e-f044-415f-9165-007708086afe tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:45.471653 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-4f92a549-2450-4d19-a92c-664cec80e470 tempest-KeyPairsV2TestJSON-183912026 tempest-KeyPairsV2TestJSON-183912026-project] Getting quotas for project 27e030e659cf4955b65d9a57b5cf84c4. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:04:45.477661 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a87f0b6e-f044-415f-9165-007708086afe tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:45.477661 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a87f0b6e-f044-415f-9165-007708086afe tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:45.478908 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-4f92a549-2450-4d19-a92c-664cec80e470 tempest-KeyPairsV2TestJSON-183912026 tempest-KeyPairsV2TestJSON-183912026-project] Getting quotas for user eb4c3f18d5df4245a2da332286d7980b and project 27e030e659cf4955b65d9a57b5cf84c4. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:04:45.535282 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a87f0b6e-f044-415f-9165-007708086afe tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Acquired lock "refresh_cache-4864e5b5-595a-4935-80c2-2572b66f8162" {{(pid=126594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 10 18:04:45.636028 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4f92a549-2450-4d19-a92c-664cec80e470 tempest-KeyPairsV2TestJSON-183912026 tempest-KeyPairsV2TestJSON-183912026-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.196575 Jun 10 18:04:45.641853 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1135/2285] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 18:04:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:45.654345 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e59c8d8e-351f-4f9a-ad18-e5b180eb7b20 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:45.659241 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e59c8d8e-351f-4f9a-ad18-e5b180eb7b20 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:45.662512 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e59c8d8e-351f-4f9a-ad18-e5b180eb7b20 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:45.663284 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e59c8d8e-351f-4f9a-ad18-e5b180eb7b20 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:45.664970 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e59c8d8e-351f-4f9a-ad18-e5b180eb7b20 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:45.665642 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e59c8d8e-351f-4f9a-ad18-e5b180eb7b20 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:45.830596 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e59c8d8e-351f-4f9a-ad18-e5b180eb7b20 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:45.839618 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e59c8d8e-351f-4f9a-ad18-e5b180eb7b20 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1468 microversion: 2.1 time: 0.201612 Jun 10 18:04:45.840216 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1136/2286] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:45 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1468 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:45.848043 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-47f590c5-4901-4290-9681-39ae672b4f66 tempest-KeyPairsV2TestJSON-183912026 tempest-KeyPairsV2TestJSON-183912026-project] Calling method '.version_select at 0x7f77c610caf0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:45.948503 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-47f590c5-4901-4290-9681-39ae672b4f66 tempest-KeyPairsV2TestJSON-183912026 tempest-KeyPairsV2TestJSON-183912026-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-327407707" status: 202 len: 0 microversion: 2.1 time: 0.107044 Jun 10 18:04:45.949773 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1137/2287] 10.222.0.35 () {58 vars in 1217 bytes} [Fri Jun 10 18:04:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-327407707 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:04:45.963191 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ef437c45-5650-40fc-bafe-696ad3f2354e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:45.964476 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ef437c45-5650-40fc-bafe-696ad3f2354e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 49b47316-e3b5-4ecd-962d-003a6cd0def3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:45.978446 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ef437c45-5650-40fc-bafe-696ad3f2354e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:45.978950 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ef437c45-5650-40fc-bafe-696ad3f2354e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:45.979940 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ef437c45-5650-40fc-bafe-696ad3f2354e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:45.980420 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ef437c45-5650-40fc-bafe-696ad3f2354e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:46.142530 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ef437c45-5650-40fc-bafe-696ad3f2354e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:46.156670 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ef437c45-5650-40fc-bafe-696ad3f2354e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3" status: 200 len: 1314 microversion: 2.1 time: 0.197015 Jun 10 18:04:46.156670 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1138/2288] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:45 2022] GET /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:46.164918 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-465f7d43-d4de-49fa-a274-a22f17109c0c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:46.165771 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-465f7d43-d4de-49fa-a274-a22f17109c0c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:46.172291 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-465f7d43-d4de-49fa-a274-a22f17109c0c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:46.172841 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-465f7d43-d4de-49fa-a274-a22f17109c0c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:46.173106 chdv-master-2 devstack@n-api.service[126594]: DEBUG neutronclient.v2_0.client [None req-a87f0b6e-f044-415f-9165-007708086afe tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.39.7.130 (0c07dba7-37ea-481e-8059-41094f2bb980) with port 40a20790-d62d-4bb6-98d8-b36feab7f804 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network ee72fd31-e0e2-470e-b15d-ae5538ee16e6.", "detail": ""}} {{(pid=126594) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 10 18:04:46.173700 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a87f0b6e-f044-415f-9165-007708086afe tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Releasing lock "refresh_cache-4864e5b5-595a-4935-80c2-2572b66f8162" {{(pid=126594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 10 18:04:46.173941 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-465f7d43-d4de-49fa-a274-a22f17109c0c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:46.174577 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-465f7d43-d4de-49fa-a274-a22f17109c0c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:46.176124 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-a87f0b6e-f044-415f-9165-007708086afe tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] HTTP exception thrown: Cannot associate floating IP 172.39.7.130 (0c07dba7-37ea-481e-8059-41094f2bb980) with port 40a20790-d62d-4bb6-98d8-b36feab7f804 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network ee72fd31-e0e2-470e-b15d-ae5538ee16e6. Jun 10 18:04:46.176124 chdv-master-2 devstack@n-api.service[126594]: Neutron server returns request_ids: ['req-9fb113c9-480a-4ab1-a37e-910155a5216c'] Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a87f0b6e-f044-415f-9165-007708086afe tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Request method failure captured: Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162/action HTTP/1.1 Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 46 Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4eXjV8VBmA-Zjw7Il0JmrDHm66QOdWxWj-6l2Bd2zPNYpnci5UWzEDszz5JZkSfom0Sc-CFqeKt9pYmIebPTNF4yYhzXhMAz536p4z9iPf8ae2r7uYqfYGYsUG7bzXysNB_c1n1LBIuEjBu2iJgZC7oRXa1HWZcl-s8SrpB_02R0jA Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: be8ad96cd98c4cf683f763099e3064a4 Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/be8ad96cd98c4cf683f763099e3064a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/be8ad96cd98c4cf683f763099e3064a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/be8ad96cd98c4cf683f763099e3064a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_be8ad96cd98c4cf683f763099e3064a4", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: be8ad96cd98c4cf683f763099e3064a4 Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 9884a0b94aed42e5aa029f6d096a3d36 Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: {"addFloatingIp": {"address": "172.39.7.130"}} Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: exception: Cannot associate floating IP 172.39.7.130 (0c07dba7-37ea-481e-8059-41094f2bb980) with port 40a20790-d62d-4bb6-98d8-b36feab7f804 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network ee72fd31-e0e2-470e-b15d-ae5538ee16e6. Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: Neutron server returns request_ids: ['req-9fb113c9-480a-4ab1-a37e-910155a5216c'] Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '4864e5b5-595a-4935-80c2-2572b66f8162', 'body': {'addFloatingIp': {'address': '172.39.7.130'}}} Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2689, in associate_floating_ip Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 10 18:04:46.179369 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.39.7.130 (0c07dba7-37ea-481e-8059-41094f2bb980) with port 40a20790-d62d-4bb6-98d8-b36feab7f804 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network ee72fd31-e0e2-470e-b15d-ae5538ee16e6. Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9fb113c9-480a-4ab1-a37e-910155a5216c'] Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2691, in associate_floating_ip Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.39.7.130 (0c07dba7-37ea-481e-8059-41094f2bb980) with port 40a20790-d62d-4bb6-98d8-b36feab7f804 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network ee72fd31-e0e2-470e-b15d-ae5538ee16e6. Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9fb113c9-480a-4ab1-a37e-910155a5216c'] Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.39.7.130 (0c07dba7-37ea-481e-8059-41094f2bb980) with port 40a20790-d62d-4bb6-98d8-b36feab7f804 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network ee72fd31-e0e2-470e-b15d-ae5538ee16e6. Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9fb113c9-480a-4ab1-a37e-910155a5216c'] Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.39.7.130 (0c07dba7-37ea-481e-8059-41094f2bb980) with port 40a20790-d62d-4bb6-98d8-b36feab7f804 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network ee72fd31-e0e2-470e-b15d-ae5538ee16e6. Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9fb113c9-480a-4ab1-a37e-910155a5216c'] Jun 10 18:04:46.184052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:46.192091 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a87f0b6e-f044-415f-9165-007708086afe tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Returning 400 to user: Cannot associate floating IP 172.39.7.130 (0c07dba7-37ea-481e-8059-41094f2bb980) with port 40a20790-d62d-4bb6-98d8-b36feab7f804 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network ee72fd31-e0e2-470e-b15d-ae5538ee16e6. Jun 10 18:04:46.192091 chdv-master-2 devstack@n-api.service[126594]: Neutron server returns request_ids: ['req-9fb113c9-480a-4ab1-a37e-910155a5216c'] {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:04:46.192091 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a87f0b6e-f044-415f-9165-007708086afe tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] 10.222.0.35 "POST /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162/action" status: 400 len: 382 microversion: 2.1 time: 0.757206 Jun 10 18:04:46.192091 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1151/2289] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:04:45 2022] POST /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162/action => generated 382 bytes in 758 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:04:46.192091 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-27a3d9f1-4416-43cd-a23c-4e3a02b216a3 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:46.192091 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-27a3d9f1-4416-43cd-a23c-4e3a02b216a3 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] [instance: feb3b3b3-a867-4c17-9012-054b5e95790c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:46.196573 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27a3d9f1-4416-43cd-a23c-4e3a02b216a3 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:46.197273 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27a3d9f1-4416-43cd-a23c-4e3a02b216a3 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:46.198062 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27a3d9f1-4416-43cd-a23c-4e3a02b216a3 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:46.198553 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27a3d9f1-4416-43cd-a23c-4e3a02b216a3 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:46.323808 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-27a3d9f1-4416-43cd-a23c-4e3a02b216a3 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56583ac49efa4176b34417b775f1398e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b6584334c2481e8bbffb2d1d50cc3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:46.334685 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-27a3d9f1-4416-43cd-a23c-4e3a02b216a3 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56583ac49efa4176b34417b775f1398e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b6584334c2481e8bbffb2d1d50cc3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:46.338287 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-465f7d43-d4de-49fa-a274-a22f17109c0c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:46.338909 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-27a3d9f1-4416-43cd-a23c-4e3a02b216a3 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56583ac49efa4176b34417b775f1398e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b6584334c2481e8bbffb2d1d50cc3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:46.341543 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-27a3d9f1-4416-43cd-a23c-4e3a02b216a3 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] 10.222.0.35 "GET /compute/v2.1/servers/feb3b3b3-a867-4c17-9012-054b5e95790c" status: 200 len: 1332 microversion: 2.47 time: 0.159950 Jun 10 18:04:46.345855 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1152/2290] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:04:46 2022] GET /compute/v2.1/servers/feb3b3b3-a867-4c17-9012-054b5e95790c => generated 1332 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:04:46.347872 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e1e80383-8438-49e5-81aa-6118bdc7cd7d tempest-KeyPairsV2TestJSON-183912026 tempest-KeyPairsV2TestJSON-183912026-project] Action: 'create', calling method: .version_select at 0x7f77c0e800d0>, body: {"keypair": {"name": "tempest-keypair-631813247", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:46.363188 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-465f7d43-d4de-49fa-a274-a22f17109c0c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:46.365081 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-465f7d43-d4de-49fa-a274-a22f17109c0c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:46.368728 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-465f7d43-d4de-49fa-a274-a22f17109c0c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1293 microversion: 2.25 time: 0.212331 Jun 10 18:04:46.368728 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1139/2291] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:04:46 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1293 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:04:46.372132 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-60ff4983-b79e-4259-9fc0-d37ad822039e tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Calling method '.version_select at 0x7f77c610caf0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:46.381201 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-e1e80383-8438-49e5-81aa-6118bdc7cd7d tempest-KeyPairsV2TestJSON-183912026 tempest-KeyPairsV2TestJSON-183912026-project] Getting quotas for project 27e030e659cf4955b65d9a57b5cf84c4. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:04:46.389987 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-e1e80383-8438-49e5-81aa-6118bdc7cd7d tempest-KeyPairsV2TestJSON-183912026 tempest-KeyPairsV2TestJSON-183912026-project] Getting quotas for user eb4c3f18d5df4245a2da332286d7980b and project 27e030e659cf4955b65d9a57b5cf84c4. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:04:46.534248 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e1e80383-8438-49e5-81aa-6118bdc7cd7d tempest-KeyPairsV2TestJSON-183912026 tempest-KeyPairsV2TestJSON-183912026-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.189802 Jun 10 18:04:46.536479 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1153/2292] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 18:04:46 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:46.543367 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7ed790ca-29b5-49f4-ac3c-fc2bf399dbda tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:46.544608 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7ed790ca-29b5-49f4-ac3c-fc2bf399dbda tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: b6fe7ee7-fe32-4aa2-8616-784a199a4973] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:46.554360 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ed790ca-29b5-49f4-ac3c-fc2bf399dbda tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:46.556232 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ed790ca-29b5-49f4-ac3c-fc2bf399dbda tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:46.557938 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ed790ca-29b5-49f4-ac3c-fc2bf399dbda tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:46.558589 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ed790ca-29b5-49f4-ac3c-fc2bf399dbda tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:46.637680 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7ed790ca-29b5-49f4-ac3c-fc2bf399dbda tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:46.654932 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7ed790ca-29b5-49f4-ac3c-fc2bf399dbda tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973" status: 200 len: 1220 microversion: 2.1 time: 0.115274 Jun 10 18:04:46.667067 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1154/2293] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:46 2022] GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973 => generated 1220 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:46.672144 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-20be4ad3-fd96-4818-9cd9-8d7c69edc142 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:46.674329 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-20be4ad3-fd96-4818-9cd9-8d7c69edc142 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:46.682676 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-20be4ad3-fd96-4818-9cd9-8d7c69edc142 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:46.683132 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-20be4ad3-fd96-4818-9cd9-8d7c69edc142 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:46.683912 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-20be4ad3-fd96-4818-9cd9-8d7c69edc142 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:46.684483 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-20be4ad3-fd96-4818-9cd9-8d7c69edc142 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:46.888730 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-20be4ad3-fd96-4818-9cd9-8d7c69edc142 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:46.898798 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-20be4ad3-fd96-4818-9cd9-8d7c69edc142 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1391 microversion: 2.1 time: 0.230535 Jun 10 18:04:46.900008 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1155/2294] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:46 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1391 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:46.905715 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7dfc3a49-aa27-4580-9feb-f3f7d581a72c tempest-KeyPairsV2TestJSON-183912026 tempest-KeyPairsV2TestJSON-183912026-project] Calling method '.version_select at 0x7f77c0090af0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:47.085175 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7dfc3a49-aa27-4580-9feb-f3f7d581a72c tempest-KeyPairsV2TestJSON-183912026 tempest-KeyPairsV2TestJSON-183912026-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-631813247" status: 202 len: 0 microversion: 2.1 time: 0.183982 Jun 10 18:04:47.086364 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1156/2295] 10.222.0.35 () {58 vars in 1217 bytes} [Fri Jun 10 18:04:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-631813247 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:04:47.097883 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8fbfcfbf-a07f-4cd2-8fae-115f24411663 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:47.100131 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8fbfcfbf-a07f-4cd2-8fae-115f24411663 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:47.109314 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8fbfcfbf-a07f-4cd2-8fae-115f24411663 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:47.109823 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8fbfcfbf-a07f-4cd2-8fae-115f24411663 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:47.110777 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8fbfcfbf-a07f-4cd2-8fae-115f24411663 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:47.111823 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8fbfcfbf-a07f-4cd2-8fae-115f24411663 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:47.285905 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8fbfcfbf-a07f-4cd2-8fae-115f24411663 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:47.295663 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8fbfcfbf-a07f-4cd2-8fae-115f24411663 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1468 microversion: 2.1 time: 0.207951 Jun 10 18:04:47.296750 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1157/2296] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:47 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1468 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:47.301000 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4b534975-99f7-41d8-96a9-0e8c50bb77a7 tempest-KeyPairsV2TestJSON-183912026 tempest-KeyPairsV2TestJSON-183912026-project] Action: 'create', calling method: .version_select at 0x7f77c030ce50>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1955116820", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzHOWy5qho0wk/WHkWlEYO3zE3XE2qbxxvOrYcTlJdBUMDttIHgAZ6iJbv5YjvMtqx0V3/5BNuQoNRJNXjw05ZDNOVvJScmtLOu0NM4PLhH8rz5mOx6uuXxVJV67tb7Rg=="}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:47.316175 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-4b534975-99f7-41d8-96a9-0e8c50bb77a7 tempest-KeyPairsV2TestJSON-183912026 tempest-KeyPairsV2TestJSON-183912026-project] Getting quotas for project 27e030e659cf4955b65d9a57b5cf84c4. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:04:47.321944 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-4b534975-99f7-41d8-96a9-0e8c50bb77a7 tempest-KeyPairsV2TestJSON-183912026 tempest-KeyPairsV2TestJSON-183912026-project] Getting quotas for user eb4c3f18d5df4245a2da332286d7980b and project 27e030e659cf4955b65d9a57b5cf84c4. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:04:47.430452 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4b534975-99f7-41d8-96a9-0e8c50bb77a7 tempest-KeyPairsV2TestJSON-183912026 tempest-KeyPairsV2TestJSON-183912026-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.132847 Jun 10 18:04:47.431546 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1158/2297] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 18:04:47 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:47.436843 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a7b6c57a-a32a-4158-96a2-31e44e3c6085 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:47.437454 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a7b6c57a-a32a-4158-96a2-31e44e3c6085 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 49b47316-e3b5-4ecd-962d-003a6cd0def3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:47.444966 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a7b6c57a-a32a-4158-96a2-31e44e3c6085 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:47.445479 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a7b6c57a-a32a-4158-96a2-31e44e3c6085 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:47.446261 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a7b6c57a-a32a-4158-96a2-31e44e3c6085 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:47.446699 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a7b6c57a-a32a-4158-96a2-31e44e3c6085 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:47.594709 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a7b6c57a-a32a-4158-96a2-31e44e3c6085 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:47.603315 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a7b6c57a-a32a-4158-96a2-31e44e3c6085 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3" status: 200 len: 1314 microversion: 2.1 time: 0.170593 Jun 10 18:04:47.607127 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1159/2298] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:47 2022] GET /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:47.612821 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d0dd3deb-ed8f-442f-bc5a-6e8b13f10cd6 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:47.613717 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d0dd3deb-ed8f-442f-bc5a-6e8b13f10cd6 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] [instance: feb3b3b3-a867-4c17-9012-054b5e95790c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:47.622260 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d0dd3deb-ed8f-442f-bc5a-6e8b13f10cd6 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:47.622724 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d0dd3deb-ed8f-442f-bc5a-6e8b13f10cd6 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:47.623514 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d0dd3deb-ed8f-442f-bc5a-6e8b13f10cd6 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:47.624125 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d0dd3deb-ed8f-442f-bc5a-6e8b13f10cd6 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:47.697847 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d0dd3deb-ed8f-442f-bc5a-6e8b13f10cd6 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56583ac49efa4176b34417b775f1398e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b6584334c2481e8bbffb2d1d50cc3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:47.706241 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d0dd3deb-ed8f-442f-bc5a-6e8b13f10cd6 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56583ac49efa4176b34417b775f1398e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b6584334c2481e8bbffb2d1d50cc3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:47.707849 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d0dd3deb-ed8f-442f-bc5a-6e8b13f10cd6 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56583ac49efa4176b34417b775f1398e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b6584334c2481e8bbffb2d1d50cc3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:47.709190 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d0dd3deb-ed8f-442f-bc5a-6e8b13f10cd6 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] 10.222.0.35 "GET /compute/v2.1/servers/feb3b3b3-a867-4c17-9012-054b5e95790c" status: 200 len: 1338 microversion: 2.47 time: 0.104238 Jun 10 18:04:47.709833 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1160/2299] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:04:47 2022] GET /compute/v2.1/servers/feb3b3b3-a867-4c17-9012-054b5e95790c => generated 1338 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:04:47.715268 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e93fd82f-e4d6-4bd8-bfa9-49e43118cd1b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:47.715960 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e93fd82f-e4d6-4bd8-bfa9-49e43118cd1b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:47.723160 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e93fd82f-e4d6-4bd8-bfa9-49e43118cd1b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:47.723622 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e93fd82f-e4d6-4bd8-bfa9-49e43118cd1b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:47.724434 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e93fd82f-e4d6-4bd8-bfa9-49e43118cd1b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:47.724880 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e93fd82f-e4d6-4bd8-bfa9-49e43118cd1b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:47.954931 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e93fd82f-e4d6-4bd8-bfa9-49e43118cd1b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:47.967389 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e93fd82f-e4d6-4bd8-bfa9-49e43118cd1b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:47.968942 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e93fd82f-e4d6-4bd8-bfa9-49e43118cd1b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:47.970830 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e93fd82f-e4d6-4bd8-bfa9-49e43118cd1b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1293 microversion: 2.25 time: 0.259240 Jun 10 18:04:47.970983 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1161/2300] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:04:47 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1293 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:04:47.985070 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-df3f8a12-2023-488d-95df-6acde7bd1b5b tempest-KeyPairsV2TestJSON-183912026 tempest-KeyPairsV2TestJSON-183912026-project] Action: 'create', calling method: .version_select at 0x7f77c0b7c4c0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-550228071", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyqsN0Vd3BmJncGDw57GUK95qAL1G6Kk+7NJKWAC87mRDHKRA256MQDCQhUhyfO7YUhk9XsdKycLsprkc+WYkuqls7smcb+x2Eg2eZiN8a6lbHfbKHQUF/Fv8JNFetssw=="}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:48.006256 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-df3f8a12-2023-488d-95df-6acde7bd1b5b tempest-KeyPairsV2TestJSON-183912026 tempest-KeyPairsV2TestJSON-183912026-project] Getting quotas for project 27e030e659cf4955b65d9a57b5cf84c4. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:04:48.013557 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-df3f8a12-2023-488d-95df-6acde7bd1b5b tempest-KeyPairsV2TestJSON-183912026 tempest-KeyPairsV2TestJSON-183912026-project] Getting quotas for user eb4c3f18d5df4245a2da332286d7980b and project 27e030e659cf4955b65d9a57b5cf84c4. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:04:48.015431 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:INSERT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:04:48.150066 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-df3f8a12-2023-488d-95df-6acde7bd1b5b tempest-KeyPairsV2TestJSON-183912026 tempest-KeyPairsV2TestJSON-183912026-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.177954 Jun 10 18:04:48.150850 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1162/2301] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 18:04:47 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:48.162901 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-83b8703c-fd01-4bdf-8627-450ac39601b6 req-fcd33de3-ad40-4af5-ad81-47de5f728248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49b47316-e3b5-4ecd-962d-003a6cd0def3", "name": "network-vif-plugged", "status": "completed", "tag": "64263ed8-9f70-4dc5-9680-67d42e35c925"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:48.171700 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-83b8703c-fd01-4bdf-8627-450ac39601b6 req-fcd33de3-ad40-4af5-ad81-47de5f728248 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:48.172553 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-83b8703c-fd01-4bdf-8627-450ac39601b6 req-fcd33de3-ad40-4af5-ad81-47de5f728248 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:48.197596 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-83b8703c-fd01-4bdf-8627-450ac39601b6 req-fcd33de3-ad40-4af5-ad81-47de5f728248 service nova] Creating event network-vif-plugged:64263ed8-9f70-4dc5-9680-67d42e35c925 for instance 49b47316-e3b5-4ecd-962d-003a6cd0def3 on chh1-master-2 Jun 10 18:04:48.203534 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-83b8703c-fd01-4bdf-8627-450ac39601b6 req-fcd33de3-ad40-4af5-ad81-47de5f728248 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043800 Jun 10 18:04:48.203534 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1163/2302] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:48.208587 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8e7c85e4-4908-4932-aabb-9fb7f8a3b8bf tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:48.209393 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8e7c85e4-4908-4932-aabb-9fb7f8a3b8bf tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: b6fe7ee7-fe32-4aa2-8616-784a199a4973] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:48.224504 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8e7c85e4-4908-4932-aabb-9fb7f8a3b8bf tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:48.224504 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8e7c85e4-4908-4932-aabb-9fb7f8a3b8bf tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:48.225290 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8e7c85e4-4908-4932-aabb-9fb7f8a3b8bf tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:48.225733 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8e7c85e4-4908-4932-aabb-9fb7f8a3b8bf tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:48.249725 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:04:48.310758 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8e7c85e4-4908-4932-aabb-9fb7f8a3b8bf tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:48.325058 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8e7c85e4-4908-4932-aabb-9fb7f8a3b8bf tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973" status: 200 len: 1286 microversion: 2.1 time: 0.120077 Jun 10 18:04:48.326015 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1164/2303] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:48 2022] GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973 => generated 1286 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:48.330869 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f8614a0b-813a-433b-95c0-d967a246df69 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:48.331714 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f8614a0b-813a-433b-95c0-d967a246df69 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:48.346679 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f8614a0b-813a-433b-95c0-d967a246df69 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:48.350384 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f8614a0b-813a-433b-95c0-d967a246df69 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:48.353446 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f8614a0b-813a-433b-95c0-d967a246df69 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:48.353895 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f8614a0b-813a-433b-95c0-d967a246df69 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:48.481403 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-60ff4983-b79e-4259-9fc0-d37ad822039e tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] 10.222.0.35 "DELETE /compute/v2.1/os-floating-ips/0c07dba7-37ea-481e-8059-41094f2bb980" status: 202 len: 0 microversion: 2.1 time: 2.113018 Jun 10 18:04:48.490278 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1140/2304] 10.222.0.35 () {58 vars in 1262 bytes} [Fri Jun 10 18:04:46 2022] DELETE /compute/v2.1/os-floating-ips/0c07dba7-37ea-481e-8059-41094f2bb980 => generated 0 bytes in 2118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:04:48.491750 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-114219ba-c251-4c6f-9cb8-58ef377cba1e tempest-KeyPairsV2TestJSON-183912026 tempest-KeyPairsV2TestJSON-183912026-project] Action: 'create', calling method: .version_select at 0x7f77c051af70>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-454424053", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2DHzaETCQ0z6hbcMMIbzfAZNj14tQTL9rmJLS9M2olV5FxAFFIJQyDs9L9MZB81LH0oX0/X4ogZ5oHje0rceP9Qbx2/Zz+u5fkSQB9dBld5MWNLeqVGZceTc3LvD25iQ=="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:48.525749 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-114219ba-c251-4c6f-9cb8-58ef377cba1e tempest-KeyPairsV2TestJSON-183912026 tempest-KeyPairsV2TestJSON-183912026-project] Getting quotas for project 27e030e659cf4955b65d9a57b5cf84c4. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:04:48.536606 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-114219ba-c251-4c6f-9cb8-58ef377cba1e tempest-KeyPairsV2TestJSON-183912026 tempest-KeyPairsV2TestJSON-183912026-project] Getting quotas for user eb4c3f18d5df4245a2da332286d7980b and project 27e030e659cf4955b65d9a57b5cf84c4. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:04:48.542985 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=8,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:04:48.562139 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f8614a0b-813a-433b-95c0-d967a246df69 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:48.571859 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f8614a0b-813a-433b-95c0-d967a246df69 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1391 microversion: 2.1 time: 0.244208 Jun 10 18:04:48.580519 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1165/2305] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:48 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1391 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:48.580519 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-760bcf61-9296-41fa-b0ed-38e541c1ffe0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:48.580519 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-760bcf61-9296-41fa-b0ed-38e541c1ffe0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:48.587177 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-760bcf61-9296-41fa-b0ed-38e541c1ffe0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:48.587636 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-760bcf61-9296-41fa-b0ed-38e541c1ffe0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:48.588712 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-760bcf61-9296-41fa-b0ed-38e541c1ffe0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:48.589161 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-760bcf61-9296-41fa-b0ed-38e541c1ffe0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:48.652919 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-760bcf61-9296-41fa-b0ed-38e541c1ffe0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:48.660902 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-760bcf61-9296-41fa-b0ed-38e541c1ffe0 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1426 microversion: 2.1 time: 0.086680 Jun 10 18:04:48.661486 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1166/2306] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:48 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1426 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:48.666694 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-44e7d579-42d3-45f7-88e5-cb351d120aff req-f93b5a5b-697c-4847-a3d2-d116366397ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586adfa4-7b3c-4399-86ab-d2982771af1d", "name": "network-vif-deleted", "tag": "8aa0aa37-a6b7-49eb-8548-6164b5ff95d7"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:48.675306 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-114219ba-c251-4c6f-9cb8-58ef377cba1e tempest-KeyPairsV2TestJSON-183912026 tempest-KeyPairsV2TestJSON-183912026-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.188284 Jun 10 18:04:48.678000 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1141/2307] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 18:04:48 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:48.678134 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-44e7d579-42d3-45f7-88e5-cb351d120aff req-f93b5a5b-697c-4847-a3d2-d116366397ed service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:48.678134 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-44e7d579-42d3-45f7-88e5-cb351d120aff req-f93b5a5b-697c-4847-a3d2-d116366397ed service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:48.682184 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9f37c6fb-42a0-44a4-a94d-d9de6b3009b3 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Action: 'action', calling method: .version_select at 0x7f77c3bc3a60>, body: {"removeFloatingIp": {"address": "172.39.7.175"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:48.693966 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-44e7d579-42d3-45f7-88e5-cb351d120aff req-f93b5a5b-697c-4847-a3d2-d116366397ed service nova] Creating event network-vif-deleted:8aa0aa37-a6b7-49eb-8548-6164b5ff95d7 for instance 586adfa4-7b3c-4399-86ab-d2982771af1d on chh1-master-2 Jun 10 18:04:48.700030 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-44e7d579-42d3-45f7-88e5-cb351d120aff req-f93b5a5b-697c-4847-a3d2-d116366397ed service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037311 Jun 10 18:04:48.700919 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1167/2308] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:48.706124 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bbfda335-c4b3-4d5d-ae2a-466e5177fd05 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:48.706852 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bbfda335-c4b3-4d5d-ae2a-466e5177fd05 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 49b47316-e3b5-4ecd-962d-003a6cd0def3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:48.714375 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bbfda335-c4b3-4d5d-ae2a-466e5177fd05 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:48.714745 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bbfda335-c4b3-4d5d-ae2a-466e5177fd05 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:48.715540 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bbfda335-c4b3-4d5d-ae2a-466e5177fd05 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:48.715990 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bbfda335-c4b3-4d5d-ae2a-466e5177fd05 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:48.856630 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9f37c6fb-42a0-44a4-a94d-d9de6b3009b3 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] [instance: 4864e5b5-595a-4935-80c2-2572b66f8162] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:48.863148 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f37c6fb-42a0-44a4-a94d-d9de6b3009b3 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:48.863609 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f37c6fb-42a0-44a4-a94d-d9de6b3009b3 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:48.864493 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f37c6fb-42a0-44a4-a94d-d9de6b3009b3 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:48.865013 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f37c6fb-42a0-44a4-a94d-d9de6b3009b3 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:48.872112 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bbfda335-c4b3-4d5d-ae2a-466e5177fd05 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:48.892969 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bbfda335-c4b3-4d5d-ae2a-466e5177fd05 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3" status: 200 len: 1314 microversion: 2.1 time: 0.191019 Jun 10 18:04:48.893591 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1168/2309] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:48 2022] GET /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:48.898325 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-68acba90-f6b0-4858-bca6-33d7f49de4bb tempest-KeyPairsV2TestJSON-183912026 tempest-KeyPairsV2TestJSON-183912026-project] Calling method '.version_select at 0x7f77c0090b80>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:48.901804 chdv-master-2 devstack@n-api.service[126594]: WARNING oslo_db.sqlalchemy.utils [None req-68acba90-f6b0-4858-bca6-33d7f49de4bb tempest-KeyPairsV2TestJSON-183912026 tempest-KeyPairsV2TestJSON-183912026-project] Unique keys not in sort_keys. The sorting order may be unstable. Jun 10 18:04:48.907381 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-68acba90-f6b0-4858-bca6-33d7f49de4bb tempest-KeyPairsV2TestJSON-183912026 tempest-KeyPairsV2TestJSON-183912026-project] 10.222.0.35 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.012521 Jun 10 18:04:48.907962 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1169/2310] 10.222.0.35 () {58 vars in 1136 bytes} [Fri Jun 10 18:04:48 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:48.912577 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ecca3116-803d-4b56-ba62-2f971bc4c928 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:48.913705 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ecca3116-803d-4b56-ba62-2f971bc4c928 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] [instance: feb3b3b3-a867-4c17-9012-054b5e95790c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:48.920693 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ecca3116-803d-4b56-ba62-2f971bc4c928 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:48.921316 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ecca3116-803d-4b56-ba62-2f971bc4c928 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:48.922113 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ecca3116-803d-4b56-ba62-2f971bc4c928 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:48.922559 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ecca3116-803d-4b56-ba62-2f971bc4c928 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:48.988097 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ecca3116-803d-4b56-ba62-2f971bc4c928 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56583ac49efa4176b34417b775f1398e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b6584334c2481e8bbffb2d1d50cc3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:48.998341 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ecca3116-803d-4b56-ba62-2f971bc4c928 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56583ac49efa4176b34417b775f1398e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b6584334c2481e8bbffb2d1d50cc3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:49.000015 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ecca3116-803d-4b56-ba62-2f971bc4c928 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56583ac49efa4176b34417b775f1398e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b6584334c2481e8bbffb2d1d50cc3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:49.001294 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ecca3116-803d-4b56-ba62-2f971bc4c928 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] 10.222.0.35 "GET /compute/v2.1/servers/feb3b3b3-a867-4c17-9012-054b5e95790c" status: 200 len: 1338 microversion: 2.47 time: 0.092175 Jun 10 18:04:49.001857 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1170/2311] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:04:48 2022] GET /compute/v2.1/servers/feb3b3b3-a867-4c17-9012-054b5e95790c => generated 1338 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:04:49.006775 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b73e68ec-ef25-4970-a928-dff3de9feace tempest-KeyPairsV2TestJSON-183912026 tempest-KeyPairsV2TestJSON-183912026-project] Calling method '.version_select at 0x7f77c0090790>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:49.100073 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f37c6fb-42a0-44a4-a94d-d9de6b3009b3 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Acquired lock "refresh_cache-4864e5b5-595a-4935-80c2-2572b66f8162" {{(pid=126595) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 10 18:04:49.107664 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b73e68ec-ef25-4970-a928-dff3de9feace tempest-KeyPairsV2TestJSON-183912026 tempest-KeyPairsV2TestJSON-183912026-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-454424053" status: 202 len: 0 microversion: 2.1 time: 0.104635 Jun 10 18:04:49.108420 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1171/2312] 10.222.0.35 () {58 vars in 1274 bytes} [Fri Jun 10 18:04:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-454424053 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:04:49.113936 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-924a1585-de4c-4fb9-b82e-c15d4f2992db tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:49.114548 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-924a1585-de4c-4fb9-b82e-c15d4f2992db tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:49.121180 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-924a1585-de4c-4fb9-b82e-c15d4f2992db tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:49.121638 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-924a1585-de4c-4fb9-b82e-c15d4f2992db tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:49.122406 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-924a1585-de4c-4fb9-b82e-c15d4f2992db tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:49.123007 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-924a1585-de4c-4fb9-b82e-c15d4f2992db tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:49.255216 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-924a1585-de4c-4fb9-b82e-c15d4f2992db tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:49.263832 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-924a1585-de4c-4fb9-b82e-c15d4f2992db tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:49.265437 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-924a1585-de4c-4fb9-b82e-c15d4f2992db tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:49.266601 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-924a1585-de4c-4fb9-b82e-c15d4f2992db tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1293 microversion: 2.25 time: 0.156856 Jun 10 18:04:49.267166 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1172/2313] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:04:49 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1293 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:04:49.271959 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6c85032b-beb3-4a5a-b3c0-efabdafdba6b tempest-KeyPairsV2TestJSON-183912026 tempest-KeyPairsV2TestJSON-183912026-project] Calling method '.version_select at 0x7f77b3fdbc10>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:49.435658 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6c85032b-beb3-4a5a-b3c0-efabdafdba6b tempest-KeyPairsV2TestJSON-183912026 tempest-KeyPairsV2TestJSON-183912026-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-550228071" status: 202 len: 0 microversion: 2.1 time: 0.167452 Jun 10 18:04:49.436254 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1173/2314] 10.222.0.35 () {58 vars in 1274 bytes} [Fri Jun 10 18:04:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-550228071 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:04:49.440801 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fb34fe5b-fb7b-4faf-a6aa-5da16d5d9b7a tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:49.441423 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fb34fe5b-fb7b-4faf-a6aa-5da16d5d9b7a tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: b6fe7ee7-fe32-4aa2-8616-784a199a4973] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:49.447993 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fb34fe5b-fb7b-4faf-a6aa-5da16d5d9b7a tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:49.448482 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fb34fe5b-fb7b-4faf-a6aa-5da16d5d9b7a tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:49.449255 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fb34fe5b-fb7b-4faf-a6aa-5da16d5d9b7a tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:49.449697 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fb34fe5b-fb7b-4faf-a6aa-5da16d5d9b7a tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:49.515486 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fb34fe5b-fb7b-4faf-a6aa-5da16d5d9b7a tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:49.523439 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fb34fe5b-fb7b-4faf-a6aa-5da16d5d9b7a tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973" status: 200 len: 1286 microversion: 2.1 time: 0.086143 Jun 10 18:04:49.524434 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1174/2315] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:49 2022] GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973 => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:49.528699 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7888f25c-7f47-4803-8b7a-71b63bcdca90 tempest-KeyPairsV2TestJSON-183912026 tempest-KeyPairsV2TestJSON-183912026-project] Calling method '.version_select at 0x7f77c0e80b80>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:49.634313 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7888f25c-7f47-4803-8b7a-71b63bcdca90 tempest-KeyPairsV2TestJSON-183912026 tempest-KeyPairsV2TestJSON-183912026-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1955116820" status: 202 len: 0 microversion: 2.1 time: 0.108336 Jun 10 18:04:49.635069 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1175/2316] 10.222.0.35 () {58 vars in 1277 bytes} [Fri Jun 10 18:04:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1955116820 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:04:49.643929 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-81a28801-87c1-4d4d-a70c-efe1e04d2eb3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:49.644594 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-81a28801-87c1-4d4d-a70c-efe1e04d2eb3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:49.661025 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-81a28801-87c1-4d4d-a70c-efe1e04d2eb3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:49.661502 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-81a28801-87c1-4d4d-a70c-efe1e04d2eb3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:49.662279 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-81a28801-87c1-4d4d-a70c-efe1e04d2eb3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:49.662695 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-81a28801-87c1-4d4d-a70c-efe1e04d2eb3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:49.815338 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-81a28801-87c1-4d4d-a70c-efe1e04d2eb3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:49.829204 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-81a28801-87c1-4d4d-a70c-efe1e04d2eb3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1391 microversion: 2.1 time: 0.188956 Jun 10 18:04:49.834555 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1176/2317] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:49 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1391 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:49.836857 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-9f37c6fb-42a0-44a4-a94d-d9de6b3009b3 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] [instance: 4864e5b5-595a-4935-80c2-2572b66f8162] Building network info cache for instance {{(pid=126595) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} Jun 10 18:04:49.840556 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8a6be4dc-f15f-449d-9b67-6a5a83c6757b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:49.848386 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8a6be4dc-f15f-449d-9b67-6a5a83c6757b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:49.853734 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8a6be4dc-f15f-449d-9b67-6a5a83c6757b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:49.854509 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8a6be4dc-f15f-449d-9b67-6a5a83c6757b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:49.855327 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8a6be4dc-f15f-449d-9b67-6a5a83c6757b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:49.855779 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8a6be4dc-f15f-449d-9b67-6a5a83c6757b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:49.888015 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8a6be4dc-f15f-449d-9b67-6a5a83c6757b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:49.888517 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8a6be4dc-f15f-449d-9b67-6a5a83c6757b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:49.888981 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-8a6be4dc-f15f-449d-9b67-6a5a83c6757b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lazy-loading 'fault' on Instance uuid 586adfa4-7b3c-4399-86ab-d2982771af1d {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:04:49.933082 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8a6be4dc-f15f-449d-9b67-6a5a83c6757b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:49.941645 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8a6be4dc-f15f-449d-9b67-6a5a83c6757b tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 200 len: 1303 microversion: 2.1 time: 0.105589 Jun 10 18:04:49.942644 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1177/2318] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:49 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 1303 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:49.947263 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f2e2b169-bb0d-4275-b054-178c9e457f37 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:49.947875 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f2e2b169-bb0d-4275-b054-178c9e457f37 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 49b47316-e3b5-4ecd-962d-003a6cd0def3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:49.955765 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f2e2b169-bb0d-4275-b054-178c9e457f37 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:49.956388 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f2e2b169-bb0d-4275-b054-178c9e457f37 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:49.957283 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f2e2b169-bb0d-4275-b054-178c9e457f37 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:49.957740 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f2e2b169-bb0d-4275-b054-178c9e457f37 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:50.141512 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f2e2b169-bb0d-4275-b054-178c9e457f37 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:50.152585 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f2e2b169-bb0d-4275-b054-178c9e457f37 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3" status: 200 len: 1314 microversion: 2.1 time: 0.208806 Jun 10 18:04:50.163312 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1178/2319] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:49 2022] GET /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:50.196559 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-507f258a-d7e3-46eb-a7b3-374f0fc76434 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:50.197237 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-507f258a-d7e3-46eb-a7b3-374f0fc76434 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] [instance: feb3b3b3-a867-4c17-9012-054b5e95790c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:50.216495 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-507f258a-d7e3-46eb-a7b3-374f0fc76434 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:50.217101 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-507f258a-d7e3-46eb-a7b3-374f0fc76434 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:50.218068 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-507f258a-d7e3-46eb-a7b3-374f0fc76434 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:50.218605 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-507f258a-d7e3-46eb-a7b3-374f0fc76434 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:50.361463 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-507f258a-d7e3-46eb-a7b3-374f0fc76434 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56583ac49efa4176b34417b775f1398e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b6584334c2481e8bbffb2d1d50cc3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:50.370532 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-507f258a-d7e3-46eb-a7b3-374f0fc76434 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56583ac49efa4176b34417b775f1398e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b6584334c2481e8bbffb2d1d50cc3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:50.372058 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-507f258a-d7e3-46eb-a7b3-374f0fc76434 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56583ac49efa4176b34417b775f1398e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b6584334c2481e8bbffb2d1d50cc3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:50.384386 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-507f258a-d7e3-46eb-a7b3-374f0fc76434 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] 10.222.0.35 "GET /compute/v2.1/servers/feb3b3b3-a867-4c17-9012-054b5e95790c" status: 200 len: 1338 microversion: 2.47 time: 0.207942 Jun 10 18:04:50.385429 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1179/2320] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:04:50 2022] GET /compute/v2.1/servers/feb3b3b3-a867-4c17-9012-054b5e95790c => generated 1338 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:04:50.390299 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-01674eb8-e846-4a23-b7ec-b7f087add9f2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:50.390915 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-01674eb8-e846-4a23-b7ec-b7f087add9f2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:50.404248 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-01674eb8-e846-4a23-b7ec-b7f087add9f2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:50.404739 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-01674eb8-e846-4a23-b7ec-b7f087add9f2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:50.405535 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-01674eb8-e846-4a23-b7ec-b7f087add9f2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:50.405981 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-01674eb8-e846-4a23-b7ec-b7f087add9f2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:50.714361 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-01674eb8-e846-4a23-b7ec-b7f087add9f2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:50.731381 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-01674eb8-e846-4a23-b7ec-b7f087add9f2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:50.731618 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-01674eb8-e846-4a23-b7ec-b7f087add9f2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:50.733264 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-01674eb8-e846-4a23-b7ec-b7f087add9f2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1293 microversion: 2.25 time: 0.346740 Jun 10 18:04:50.743401 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1180/2321] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:04:50 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1293 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:04:50.743401 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-486f1fd9-1c83-40c5-930d-25e59ac09185 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:50.743401 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-486f1fd9-1c83-40c5-930d-25e59ac09185 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: b6fe7ee7-fe32-4aa2-8616-784a199a4973] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:50.751254 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-486f1fd9-1c83-40c5-930d-25e59ac09185 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:50.755142 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-486f1fd9-1c83-40c5-930d-25e59ac09185 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:50.755592 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-486f1fd9-1c83-40c5-930d-25e59ac09185 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:50.756656 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-486f1fd9-1c83-40c5-930d-25e59ac09185 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:50.889029 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-486f1fd9-1c83-40c5-930d-25e59ac09185 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:50.894757 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-486f1fd9-1c83-40c5-930d-25e59ac09185 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973" status: 200 len: 1274 microversion: 2.1 time: 0.159133 Jun 10 18:04:50.895656 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1181/2322] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:50 2022] GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973 => generated 1274 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:50.897128 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-9f37c6fb-42a0-44a4-a94d-d9de6b3009b3 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] [instance: 4864e5b5-595a-4935-80c2-2572b66f8162] Updating instance_info_cache with network_info: [{"id": "40a20790-d62d-4bb6-98d8-b36feab7f804", "address": "fa:16:3e:b5:04:d4", "network": {"id": "dde12c67-1ecf-4aa1-a9c1-4bb2412e8e71", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-797631625-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "be8ad96cd98c4cf683f763099e3064a4", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap40a20790-d6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126595) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 10 18:04:50.900971 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-ce7232bc-c4c8-4bc0-ba5d-f9fdb3de67ad req-c38b5cb4-7d42-4662-9ece-c6d97d871d85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4864e5b5-595a-4935-80c2-2572b66f8162", "tag": "40a20790-d62d-4bb6-98d8-b36feab7f804"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:50.909695 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-ce7232bc-c4c8-4bc0-ba5d-f9fdb3de67ad req-c38b5cb4-7d42-4662-9ece-c6d97d871d85 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:50.910179 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-ce7232bc-c4c8-4bc0-ba5d-f9fdb3de67ad req-c38b5cb4-7d42-4662-9ece-c6d97d871d85 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:50.922117 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-ce7232bc-c4c8-4bc0-ba5d-f9fdb3de67ad req-c38b5cb4-7d42-4662-9ece-c6d97d871d85 service nova] Creating event network-changed:40a20790-d62d-4bb6-98d8-b36feab7f804 for instance 4864e5b5-595a-4935-80c2-2572b66f8162 on chh1-master-2 Jun 10 18:04:50.927160 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-ce7232bc-c4c8-4bc0-ba5d-f9fdb3de67ad req-c38b5cb4-7d42-4662-9ece-c6d97d871d85 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030293 Jun 10 18:04:50.927988 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1182/2323] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:50.934335 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a37d7fde-7dfa-41b3-acc3-aebb479aa85d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:50.935020 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a37d7fde-7dfa-41b3-acc3-aebb479aa85d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:50.946430 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a37d7fde-7dfa-41b3-acc3-aebb479aa85d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:50.946430 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a37d7fde-7dfa-41b3-acc3-aebb479aa85d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:50.946430 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a37d7fde-7dfa-41b3-acc3-aebb479aa85d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:50.946712 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a37d7fde-7dfa-41b3-acc3-aebb479aa85d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:50.966597 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f37c6fb-42a0-44a4-a94d-d9de6b3009b3 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Releasing lock "refresh_cache-4864e5b5-595a-4935-80c2-2572b66f8162" {{(pid=126595) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 10 18:04:50.968064 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9f37c6fb-42a0-44a4-a94d-d9de6b3009b3 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] 10.222.0.35 "POST /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162/action" status: 202 len: 0 microversion: 2.1 time: 2.291166 Jun 10 18:04:50.968724 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1142/2324] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:04:48 2022] POST /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162/action => generated 0 bytes in 2292 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 10 18:04:50.977391 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9b097fca-dd21-44b0-857d-2234649bd799 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:50.977391 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9b097fca-dd21-44b0-857d-2234649bd799 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 586adfa4-7b3c-4399-86ab-d2982771af1d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:50.987937 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b097fca-dd21-44b0-857d-2234649bd799 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:50.988432 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b097fca-dd21-44b0-857d-2234649bd799 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:50.989637 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b097fca-dd21-44b0-857d-2234649bd799 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:50.990471 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b097fca-dd21-44b0-857d-2234649bd799 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:51.009609 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-9b097fca-dd21-44b0-857d-2234649bd799 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] HTTP exception thrown: Instance 586adfa4-7b3c-4399-86ab-d2982771af1d could not be found. Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9b097fca-dd21-44b0-857d-2234649bd799 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Request method failure captured: Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d HTTP/1.1 Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4Zy3r1pX7b3MtL_-NjN-zlRyjsPaJf9nUlwgEmvUs6EwjOw40qP9dbLbsHgij_gMl6uhbXl9nIlkqHmrWwww9dWms-7XOTEOvy9MdKMCvcMLYW-x2PIZ_wthjppQYWTgc0gmbBlQDA4e11wPRqBUoXg28RiqROpiqwC1wftTAJuO0M Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 66fd5e2ed0b84720849784c94f36d5da Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-MigrationsAdminTest-1164955500 Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/66fd5e2ed0b84720849784c94f36d5da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/66fd5e2ed0b84720849784c94f36d5da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/66fd5e2ed0b84720849784c94f36d5da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_66fd5e2ed0b84720849784c94f36d5da", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-MigrationsAdminTest-1164955500 Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 66fd5e2ed0b84720849784c94f36d5da Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-MigrationsAdminTest-1164955500 Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-MigrationsAdminTest-1164955500-project Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 1c74f45bf7fd4dea952d771a649519af Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-MigrationsAdminTest-1164955500-project Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 586adfa4-7b3c-4399-86ab-d2982771af1d could not be found. Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '586adfa4-7b3c-4399-86ab-d2982771af1d'} Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 586adfa4-7b3c-4399-86ab-d2982771af1d could not be found. Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 586adfa4-7b3c-4399-86ab-d2982771af1d could not be found. Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:51.011308 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:51.017528 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:51.017528 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:04:51.017528 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:04:51.017528 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:04:51.017528 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:04:51.017528 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 586adfa4-7b3c-4399-86ab-d2982771af1d could not be found. Jun 10 18:04:51.017528 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:51.017528 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9b097fca-dd21-44b0-857d-2234649bd799 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Returning 404 to user: Instance 586adfa4-7b3c-4399-86ab-d2982771af1d could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:04:51.017528 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9b097fca-dd21-44b0-857d-2234649bd799 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d" status: 404 len: 111 microversion: 2.1 time: 0.042728 Jun 10 18:04:51.021183 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1143/2325] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:50 2022] GET /compute/v2.1/servers/586adfa4-7b3c-4399-86ab-d2982771af1d => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:04:51.032924 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dc6869cc-a3bd-4fad-a7e6-50fe880fc159 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Calling method '.version_select at 0x7f77c0fd1670>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:51.612489 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a37d7fde-7dfa-41b3-acc3-aebb479aa85d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:51.621030 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a37d7fde-7dfa-41b3-acc3-aebb479aa85d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1391 microversion: 2.1 time: 0.692050 Jun 10 18:04:51.622379 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1183/2326] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:50 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1391 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:51.627003 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-afe3cff8-3935-4eea-896f-c1836df8e2a1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:51.627740 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-afe3cff8-3935-4eea-896f-c1836df8e2a1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:51.635117 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-afe3cff8-3935-4eea-896f-c1836df8e2a1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:51.635895 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-afe3cff8-3935-4eea-896f-c1836df8e2a1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:51.636898 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-afe3cff8-3935-4eea-896f-c1836df8e2a1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:51.637627 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-afe3cff8-3935-4eea-896f-c1836df8e2a1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:51.667669 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-afe3cff8-3935-4eea-896f-c1836df8e2a1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:04:51.785408 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:04:52.031081 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-afe3cff8-3935-4eea-896f-c1836df8e2a1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "DELETE /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 204 len: 0 microversion: 2.1 time: 0.403147 Jun 10 18:04:52.031081 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1184/2327] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:04:51 2022] DELETE /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:04:52.033891 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c8ad2a0a-3ae2-410c-8d7f-e40fbc143d5b tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:52.034632 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c8ad2a0a-3ae2-410c-8d7f-e40fbc143d5b tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 49b47316-e3b5-4ecd-962d-003a6cd0def3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:52.048432 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c8ad2a0a-3ae2-410c-8d7f-e40fbc143d5b tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:52.055900 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c8ad2a0a-3ae2-410c-8d7f-e40fbc143d5b tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:52.056873 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c8ad2a0a-3ae2-410c-8d7f-e40fbc143d5b tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:52.060228 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c8ad2a0a-3ae2-410c-8d7f-e40fbc143d5b tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:52.318904 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c8ad2a0a-3ae2-410c-8d7f-e40fbc143d5b tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:52.329118 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c8ad2a0a-3ae2-410c-8d7f-e40fbc143d5b tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3" status: 200 len: 1500 microversion: 2.1 time: 0.299688 Jun 10 18:04:52.329877 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1185/2328] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:52 2022] GET /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3 => generated 1500 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:52.338417 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f651b83d-3ade-43df-aafe-111b71c7fa55 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:52.339374 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f651b83d-3ade-43df-aafe-111b71c7fa55 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] [instance: feb3b3b3-a867-4c17-9012-054b5e95790c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:52.350387 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f651b83d-3ade-43df-aafe-111b71c7fa55 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:52.350731 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f651b83d-3ade-43df-aafe-111b71c7fa55 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:52.352197 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f651b83d-3ade-43df-aafe-111b71c7fa55 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:52.356557 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dc6869cc-a3bd-4fad-a7e6-50fe880fc159 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] 10.222.0.35 "DELETE /compute/v2.1/os-floating-ips/c8554c54-ebe0-4950-bf71-6c217d63ba24" status: 202 len: 0 microversion: 2.1 time: 1.334164 Jun 10 18:04:52.357567 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1144/2329] 10.222.0.35 () {58 vars in 1262 bytes} [Fri Jun 10 18:04:51 2022] DELETE /compute/v2.1/os-floating-ips/c8554c54-ebe0-4950-bf71-6c217d63ba24 => generated 0 bytes in 1336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:04:52.360942 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f651b83d-3ade-43df-aafe-111b71c7fa55 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:52.362793 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e54baf56-079a-4088-b2e0-eca39a9dfd06 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:52.363626 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e54baf56-079a-4088-b2e0-eca39a9dfd06 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:52.372192 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e54baf56-079a-4088-b2e0-eca39a9dfd06 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:52.372673 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e54baf56-079a-4088-b2e0-eca39a9dfd06 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:52.373446 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e54baf56-079a-4088-b2e0-eca39a9dfd06 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:52.373887 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e54baf56-079a-4088-b2e0-eca39a9dfd06 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:52.458173 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f651b83d-3ade-43df-aafe-111b71c7fa55 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56583ac49efa4176b34417b775f1398e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b6584334c2481e8bbffb2d1d50cc3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:52.470671 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f651b83d-3ade-43df-aafe-111b71c7fa55 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56583ac49efa4176b34417b775f1398e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b6584334c2481e8bbffb2d1d50cc3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:52.479886 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f651b83d-3ade-43df-aafe-111b71c7fa55 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56583ac49efa4176b34417b775f1398e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b6584334c2481e8bbffb2d1d50cc3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:52.481581 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f651b83d-3ade-43df-aafe-111b71c7fa55 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] 10.222.0.35 "GET /compute/v2.1/servers/feb3b3b3-a867-4c17-9012-054b5e95790c" status: 200 len: 1359 microversion: 2.47 time: 0.150697 Jun 10 18:04:52.494356 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1186/2330] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:04:52 2022] GET /compute/v2.1/servers/feb3b3b3-a867-4c17-9012-054b5e95790c => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:04:52.500660 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a6342070-fbc1-456b-975b-ab8b40dcd856 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:52.512630 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a6342070-fbc1-456b-975b-ab8b40dcd856 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: b6fe7ee7-fe32-4aa2-8616-784a199a4973] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:52.512630 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a6342070-fbc1-456b-975b-ab8b40dcd856 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:52.512630 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a6342070-fbc1-456b-975b-ab8b40dcd856 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:52.512630 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a6342070-fbc1-456b-975b-ab8b40dcd856 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:52.512630 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a6342070-fbc1-456b-975b-ab8b40dcd856 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:52.572938 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e54baf56-079a-4088-b2e0-eca39a9dfd06 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:52.584603 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e54baf56-079a-4088-b2e0-eca39a9dfd06 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:52.586906 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e54baf56-079a-4088-b2e0-eca39a9dfd06 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:52.589051 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e54baf56-079a-4088-b2e0-eca39a9dfd06 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1281 microversion: 2.25 time: 0.230314 Jun 10 18:04:52.601260 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1145/2331] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:04:52 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1281 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:04:52.607867 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f77e4ce1-efb7-41db-a925-7663e7125137 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:52.615513 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f77e4ce1-efb7-41db-a925-7663e7125137 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:52.616155 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f77e4ce1-efb7-41db-a925-7663e7125137 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:52.616617 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f77e4ce1-efb7-41db-a925-7663e7125137 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:52.617642 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f77e4ce1-efb7-41db-a925-7663e7125137 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:52.618089 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f77e4ce1-efb7-41db-a925-7663e7125137 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:52.658263 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a6342070-fbc1-456b-975b-ab8b40dcd856 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:52.679983 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a6342070-fbc1-456b-975b-ab8b40dcd856 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973" status: 200 len: 1316 microversion: 2.1 time: 0.188862 Jun 10 18:04:52.681171 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1187/2332] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:52 2022] GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973 => generated 1316 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:52.685757 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1b8a5f53-a185-4034-a1a2-37934ab1117d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:52.699318 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1b8a5f53-a185-4034-a1a2-37934ab1117d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 49b47316-e3b5-4ecd-962d-003a6cd0def3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:52.706411 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1b8a5f53-a185-4034-a1a2-37934ab1117d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:52.709285 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1b8a5f53-a185-4034-a1a2-37934ab1117d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:52.710466 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1b8a5f53-a185-4034-a1a2-37934ab1117d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:52.710831 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1b8a5f53-a185-4034-a1a2-37934ab1117d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:52.757887 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1b8a5f53-a185-4034-a1a2-37934ab1117d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "POST /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3/action" status: 200 len: 14 microversion: 2.1 time: 0.075526 Jun 10 18:04:52.760023 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1188/2333] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:04:52 2022] POST /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:04:52.768696 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-83e5ad43-50cc-40cf-9b3c-06fa699ace16 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-83e5ad43-50cc-40cf-9b3c-06fa699ace16 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Request method failure captured: Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162/action HTTP/1.1 Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 34 Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4eXjV8VBmA-Zjw7Il0JmrDHm66QOdWxWj-6l2Bd2zPNYpnci5UWzEDszz5JZkSfom0Sc-CFqeKt9pYmIebPTNF4yYhzXhMAz536p4z9iPf8ae2r7uYqfYGYsUG7bzXysNB_c1n1LBIuEjBu2iJgZC7oRXa1HWZcl-s8SrpB_02R0jA Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: be8ad96cd98c4cf683f763099e3064a4 Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/be8ad96cd98c4cf683f763099e3064a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/be8ad96cd98c4cf683f763099e3064a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/be8ad96cd98c4cf683f763099e3064a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_be8ad96cd98c4cf683f763099e3064a4", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: be8ad96cd98c4cf683f763099e3064a4 Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 9884a0b94aed42e5aa029f6d096a3d36 Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: {"addFloatingIp": {"address": ""}} Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '4864e5b5-595a-4935-80c2-2572b66f8162', 'body': {'addFloatingIp': {'address': ''}}} Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise error Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi '' Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 10 18:04:52.772113 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 10 18:04:52.778736 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 10 18:04:52.778736 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jun 10 18:04:52.778736 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:52.778736 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:52.778736 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:52.778736 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:52.778736 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:04:52.778736 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:04:52.778736 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 10 18:04:52.778736 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 10 18:04:52.778736 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jun 10 18:04:52.778736 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:04:52.778736 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-83e5ad43-50cc-40cf-9b3c-06fa699ace16 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:04:52.778736 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-83e5ad43-50cc-40cf-9b3c-06fa699ace16 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] 10.222.0.35 "POST /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162/action" status: 400 len: 142 microversion: 2.1 time: 0.009101 Jun 10 18:04:52.778736 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1189/2334] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:04:52 2022] POST /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162/action => generated 142 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:04:52.783759 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f77e4ce1-efb7-41db-a925-7663e7125137 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:52.785355 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-53186450-03dc-44e6-bda2-84ac644f80d6 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-339049416"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:52.785355 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-53186450-03dc-44e6-bda2-84ac644f80d6 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] [instance: feb3b3b3-a867-4c17-9012-054b5e95790c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:52.793486 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-53186450-03dc-44e6-bda2-84ac644f80d6 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:52.793944 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-53186450-03dc-44e6-bda2-84ac644f80d6 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:52.794582 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f77e4ce1-efb7-41db-a925-7663e7125137 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1534 microversion: 2.1 time: 0.190825 Jun 10 18:04:52.794706 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-53186450-03dc-44e6-bda2-84ac644f80d6 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:52.795134 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-53186450-03dc-44e6-bda2-84ac644f80d6 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:52.804757 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1146/2335] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:52 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1534 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:52.804757 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c81d8212-7330-44be-ad87-575a047fc6e9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:52.804757 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c81d8212-7330-44be-ad87-575a047fc6e9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:52.811598 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c81d8212-7330-44be-ad87-575a047fc6e9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:52.812238 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c81d8212-7330-44be-ad87-575a047fc6e9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:52.814566 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c81d8212-7330-44be-ad87-575a047fc6e9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:52.815427 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c81d8212-7330-44be-ad87-575a047fc6e9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:52.987265 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c81d8212-7330-44be-ad87-575a047fc6e9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:52.996271 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c81d8212-7330-44be-ad87-575a047fc6e9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1381 microversion: 2.1 time: 0.199009 Jun 10 18:04:53.001166 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1147/2336] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:52 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1381 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:53.009012 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-05b9195a-49b9-4f0d-baa6-520464af37b6 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:53.010463 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-05b9195a-49b9-4f0d-baa6-520464af37b6 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] [instance: 4864e5b5-595a-4935-80c2-2572b66f8162] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:53.016824 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05b9195a-49b9-4f0d-baa6-520464af37b6 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:53.017455 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05b9195a-49b9-4f0d-baa6-520464af37b6 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:53.018231 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05b9195a-49b9-4f0d-baa6-520464af37b6 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:53.018676 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05b9195a-49b9-4f0d-baa6-520464af37b6 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:53.048687 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05b9195a-49b9-4f0d-baa6-520464af37b6 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Acquired lock "refresh_cache-4864e5b5-595a-4935-80c2-2572b66f8162" {{(pid=126595) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 10 18:04:53.154142 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05b9195a-49b9-4f0d-baa6-520464af37b6 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Releasing lock "refresh_cache-4864e5b5-595a-4935-80c2-2572b66f8162" {{(pid=126595) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 10 18:04:53.154142 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-05b9195a-49b9-4f0d-baa6-520464af37b6 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] HTTP exception thrown: floating IP not found Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-05b9195a-49b9-4f0d-baa6-520464af37b6 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Request method failure captured: Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162/action HTTP/1.1 Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 41 Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4eXjV8VBmA-Zjw7Il0JmrDHm66QOdWxWj-6l2Bd2zPNYpnci5UWzEDszz5JZkSfom0Sc-CFqeKt9pYmIebPTNF4yYhzXhMAz536p4z9iPf8ae2r7uYqfYGYsUG7bzXysNB_c1n1LBIuEjBu2iJgZC7oRXa1HWZcl-s8SrpB_02R0jA Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: be8ad96cd98c4cf683f763099e3064a4 Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/be8ad96cd98c4cf683f763099e3064a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/be8ad96cd98c4cf683f763099e3064a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/be8ad96cd98c4cf683f763099e3064a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_be8ad96cd98c4cf683f763099e3064a4", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: be8ad96cd98c4cf683f763099e3064a4 Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 9884a0b94aed42e5aa029f6d096a3d36 Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: {"addFloatingIp": {"address": "0.0.0.0"}} Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: exception: floating IP not found Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '4864e5b5-595a-4935-80c2-2572b66f8162', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2685, in associate_floating_ip Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2997, in _get_floating_ip_by_address Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Jun 10 18:04:53.155527 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:53.161575 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:53.161575 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:53.161575 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:53.161575 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:04:53.161575 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:04:53.161575 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:04:53.161575 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:04:53.161575 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Jun 10 18:04:53.161575 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:53.161575 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-05b9195a-49b9-4f0d-baa6-520464af37b6 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Returning 404 to user: floating IP not found {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:04:53.161575 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-05b9195a-49b9-4f0d-baa6-520464af37b6 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] 10.222.0.35 "POST /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162/action" status: 404 len: 67 microversion: 2.1 time: 0.154700 Jun 10 18:04:53.161575 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1148/2337] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:04:53 2022] POST /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162/action => generated 67 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:04:53.164917 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e6028a0b-7066-4320-aafd-01afdf7035d4 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Calling method '.version_select at 0x7f77c06599d0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:53.168332 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e6028a0b-7066-4320-aafd-01afdf7035d4 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:53.169619 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e6028a0b-7066-4320-aafd-01afdf7035d4 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:53.187672 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e6028a0b-7066-4320-aafd-01afdf7035d4 tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] 10.222.0.35 "GET /compute/v2.1/os-migrations" status: 200 len: 3881 microversion: 2.1 time: 0.027927 Jun 10 18:04:53.190727 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1149/2338] 10.222.0.35 () {58 vars in 1142 bytes} [Fri Jun 10 18:04:53 2022] GET /compute/v2.1/os-migrations => generated 3881 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:53.196963 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0ac52cf5-04ae-49ef-9ba2-dd3e2dcaf6cd tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:53.242955 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-0ac52cf5-04ae-49ef-9ba2-dd3e2dcaf6cd tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0ac52cf5-04ae-49ef-9ba2-dd3e2dcaf6cd tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Request method failure captured: Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162/action HTTP/1.1 Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 44 Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4eXjV8VBmA-Zjw7Il0JmrDHm66QOdWxWj-6l2Bd2zPNYpnci5UWzEDszz5JZkSfom0Sc-CFqeKt9pYmIebPTNF4yYhzXhMAz536p4z9iPf8ae2r7uYqfYGYsUG7bzXysNB_c1n1LBIuEjBu2iJgZC7oRXa1HWZcl-s8SrpB_02R0jA Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: be8ad96cd98c4cf683f763099e3064a4 Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/be8ad96cd98c4cf683f763099e3064a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/be8ad96cd98c4cf683f763099e3064a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/be8ad96cd98c4cf683f763099e3064a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_be8ad96cd98c4cf683f763099e3064a4", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: be8ad96cd98c4cf683f763099e3064a4 Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 9884a0b94aed42e5aa029f6d096a3d36 Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: {"removeFloatingIp": {"address": "0.0.0.0"}} Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: exception: Floating IP not found for address 0.0.0.0. Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '4864e5b5-595a-4935-80c2-2572b66f8162', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2913, in get_instance_id_by_floating_address Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2997, in _get_floating_ip_by_address Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Jun 10 18:04:53.244614 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Jun 10 18:04:53.250043 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Jun 10 18:04:53.250043 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:53.250043 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:53.250043 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:53.250043 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:53.250043 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:04:53.250043 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:04:53.250043 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:04:53.250043 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:04:53.250043 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Jun 10 18:04:53.250043 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:53.250043 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0ac52cf5-04ae-49ef-9ba2-dd3e2dcaf6cd tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:04:53.250043 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0ac52cf5-04ae-49ef-9ba2-dd3e2dcaf6cd tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] 10.222.0.35 "POST /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162/action" status: 404 len: 88 microversion: 2.1 time: 0.053639 Jun 10 18:04:53.250043 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1150/2339] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:04:53 2022] POST /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162/action => generated 88 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:04:53.252119 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9a9de6bc-04d1-450e-be3b-cebabff2050f tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:53.252227 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9a9de6bc-04d1-450e-be3b-cebabff2050f tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:53.260147 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9a9de6bc-04d1-450e-be3b-cebabff2050f tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:53.260687 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9a9de6bc-04d1-450e-be3b-cebabff2050f tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:53.261465 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9a9de6bc-04d1-450e-be3b-cebabff2050f tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:53.261909 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9a9de6bc-04d1-450e-be3b-cebabff2050f tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:53.394642 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9a9de6bc-04d1-450e-be3b-cebabff2050f tempest-LiveMigrationTest-735360073 tempest-LiveMigrationTest-735360073-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1532 microversion: 2.1 time: 0.147095 Jun 10 18:04:53.406138 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1151/2340] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:53 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1532 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:53.422130 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2dfaef50-1c93-400c-b915-dff784d6ba71 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:53.422915 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2dfaef50-1c93-400c-b915-dff784d6ba71 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] [instance: 4864e5b5-595a-4935-80c2-2572b66f8162] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:53.430470 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2dfaef50-1c93-400c-b915-dff784d6ba71 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:53.430988 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2dfaef50-1c93-400c-b915-dff784d6ba71 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:53.432072 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2dfaef50-1c93-400c-b915-dff784d6ba71 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:53.432196 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2dfaef50-1c93-400c-b915-dff784d6ba71 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:53.460933 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2dfaef50-1c93-400c-b915-dff784d6ba71 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] [instance: 4864e5b5-595a-4935-80c2-2572b66f8162] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:04:53.484944 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-53186450-03dc-44e6-bda2-84ac644f80d6 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] 10.222.0.35 "POST /compute/v2.1/servers/feb3b3b3-a867-4c17-9012-054b5e95790c/action" status: 202 len: 52 microversion: 2.47 time: 0.706654 Jun 10 18:04:53.486498 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1190/2341] 10.222.0.35 () {62 vars in 1318 bytes} [Fri Jun 10 18:04:52 2022] POST /compute/v2.1/servers/feb3b3b3-a867-4c17-9012-054b5e95790c/action => generated 52 bytes in 709 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Jun 10 18:04:53.499851 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6d174227-5566-4f67-a087-df571d00447e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:53.500510 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6d174227-5566-4f67-a087-df571d00447e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:53.507545 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6d174227-5566-4f67-a087-df571d00447e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:53.512445 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6d174227-5566-4f67-a087-df571d00447e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:53.512445 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6d174227-5566-4f67-a087-df571d00447e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:53.512445 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6d174227-5566-4f67-a087-df571d00447e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:53.535127 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6d174227-5566-4f67-a087-df571d00447e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:04:53.799586 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:04:53.807653 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2dfaef50-1c93-400c-b915-dff784d6ba71 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] 10.222.0.35 "DELETE /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162" status: 204 len: 0 microversion: 2.1 time: 0.390692 Jun 10 18:04:53.808387 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1152/2342] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:04:53 2022] DELETE /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:04:53.813419 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-006db52d-41a1-4ed8-85a2-a88e005ac21e tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:53.814155 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-006db52d-41a1-4ed8-85a2-a88e005ac21e tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] [instance: feb3b3b3-a867-4c17-9012-054b5e95790c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:53.826689 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-006db52d-41a1-4ed8-85a2-a88e005ac21e tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:53.827149 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-006db52d-41a1-4ed8-85a2-a88e005ac21e tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:53.828034 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-006db52d-41a1-4ed8-85a2-a88e005ac21e tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:53.828499 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-006db52d-41a1-4ed8-85a2-a88e005ac21e tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:53.857053 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-006db52d-41a1-4ed8-85a2-a88e005ac21e tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] [instance: feb3b3b3-a867-4c17-9012-054b5e95790c] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:04:53.871230 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:04:53.960363 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6d174227-5566-4f67-a087-df571d00447e tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "DELETE /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 204 len: 0 microversion: 2.1 time: 0.471715 Jun 10 18:04:53.962082 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1191/2343] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:04:53 2022] DELETE /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:04:54.092149 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ebb76513-4ece-4a55-9d69-c152cd17743c tempest-AbsoluteLimitsTestJSON-1210343322 tempest-AbsoluteLimitsTestJSON-1210343322-project] Calling method '.version_select at 0x7f77b3fdbf70>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:54.103257 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ebb76513-4ece-4a55-9d69-c152cd17743c tempest-AbsoluteLimitsTestJSON-1210343322 tempest-AbsoluteLimitsTestJSON-1210343322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:54.108410 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ebb76513-4ece-4a55-9d69-c152cd17743c tempest-AbsoluteLimitsTestJSON-1210343322 tempest-AbsoluteLimitsTestJSON-1210343322-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:54.108410 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ebb76513-4ece-4a55-9d69-c152cd17743c tempest-AbsoluteLimitsTestJSON-1210343322 tempest-AbsoluteLimitsTestJSON-1210343322-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:54.108410 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ebb76513-4ece-4a55-9d69-c152cd17743c tempest-AbsoluteLimitsTestJSON-1210343322 tempest-AbsoluteLimitsTestJSON-1210343322-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:54.123973 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ebb76513-4ece-4a55-9d69-c152cd17743c tempest-AbsoluteLimitsTestJSON-1210343322 tempest-AbsoluteLimitsTestJSON-1210343322-project] 10.222.0.35 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.160189 Jun 10 18:04:54.124585 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1192/2344] 10.222.0.35 () {58 vars in 1121 bytes} [Fri Jun 10 18:04:53 2022] GET /compute/v2.1/limits => generated 511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:54.161604 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-006db52d-41a1-4ed8-85a2-a88e005ac21e tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] 10.222.0.35 "DELETE /compute/v2.1/servers/feb3b3b3-a867-4c17-9012-054b5e95790c" status: 204 len: 0 microversion: 2.47 time: 0.349142 Jun 10 18:04:54.161604 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1153/2345] 10.222.0.35 () {60 vars in 1279 bytes} [Fri Jun 10 18:04:53 2022] DELETE /compute/v2.1/servers/feb3b3b3-a867-4c17-9012-054b5e95790c => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 10 18:04:54.166610 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8ae02967-576b-44be-b022-a3be6dea7f77 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:54.167429 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8ae02967-576b-44be-b022-a3be6dea7f77 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: b6fe7ee7-fe32-4aa2-8616-784a199a4973] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:54.173747 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8ae02967-576b-44be-b022-a3be6dea7f77 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:54.174406 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8ae02967-576b-44be-b022-a3be6dea7f77 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:54.175253 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8ae02967-576b-44be-b022-a3be6dea7f77 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:54.175772 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8ae02967-576b-44be-b022-a3be6dea7f77 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:54.243218 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-095e2b56-3ca1-4f6c-a45c-889930e3ac54 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:54.244106 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-095e2b56-3ca1-4f6c-a45c-889930e3ac54 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:54.251342 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-095e2b56-3ca1-4f6c-a45c-889930e3ac54 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:54.251859 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-095e2b56-3ca1-4f6c-a45c-889930e3ac54 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:54.252667 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-095e2b56-3ca1-4f6c-a45c-889930e3ac54 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:54.253111 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-095e2b56-3ca1-4f6c-a45c-889930e3ac54 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:54.314566 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8ae02967-576b-44be-b022-a3be6dea7f77 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:54.322808 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8ae02967-576b-44be-b022-a3be6dea7f77 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973" status: 200 len: 1316 microversion: 2.1 time: 0.161492 Jun 10 18:04:54.323390 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1154/2346] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:54 2022] GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973 => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:54.328407 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a68395bf-b0c8-4b00-ba25-1cce61d9cee5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:54.329579 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a68395bf-b0c8-4b00-ba25-1cce61d9cee5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 49b47316-e3b5-4ecd-962d-003a6cd0def3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:54.338701 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a68395bf-b0c8-4b00-ba25-1cce61d9cee5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:54.339159 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a68395bf-b0c8-4b00-ba25-1cce61d9cee5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:54.339924 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a68395bf-b0c8-4b00-ba25-1cce61d9cee5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:54.340382 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a68395bf-b0c8-4b00-ba25-1cce61d9cee5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:54.391579 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-095e2b56-3ca1-4f6c-a45c-889930e3ac54 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:54.403251 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-095e2b56-3ca1-4f6c-a45c-889930e3ac54 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:54.405172 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-095e2b56-3ca1-4f6c-a45c-889930e3ac54 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:54.407120 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-095e2b56-3ca1-4f6c-a45c-889930e3ac54 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1281 microversion: 2.25 time: 0.281512 Jun 10 18:04:54.407695 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1193/2347] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:04:54 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1281 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:04:54.413320 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a1de3e0a-d013-473c-bcdc-66ef27d0e8b2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:54.414180 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a1de3e0a-d013-473c-bcdc-66ef27d0e8b2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:54.425220 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a1de3e0a-d013-473c-bcdc-66ef27d0e8b2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:54.425220 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a1de3e0a-d013-473c-bcdc-66ef27d0e8b2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:54.425220 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a1de3e0a-d013-473c-bcdc-66ef27d0e8b2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:54.425220 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a1de3e0a-d013-473c-bcdc-66ef27d0e8b2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:54.557188 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a1de3e0a-d013-473c-bcdc-66ef27d0e8b2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:54.564869 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a1de3e0a-d013-473c-bcdc-66ef27d0e8b2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1534 microversion: 2.1 time: 0.155722 Jun 10 18:04:54.565322 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1194/2348] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:54 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1534 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:54.571007 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-98957ec7-8e6e-44b5-ad81-9fb4d7abfb93 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:54.571616 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-98957ec7-8e6e-44b5-ad81-9fb4d7abfb93 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] [instance: 4864e5b5-595a-4935-80c2-2572b66f8162] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:54.577791 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-98957ec7-8e6e-44b5-ad81-9fb4d7abfb93 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:54.578241 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-98957ec7-8e6e-44b5-ad81-9fb4d7abfb93 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:54.578999 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-98957ec7-8e6e-44b5-ad81-9fb4d7abfb93 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:54.579434 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-98957ec7-8e6e-44b5-ad81-9fb4d7abfb93 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:54.716819 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-98957ec7-8e6e-44b5-ad81-9fb4d7abfb93 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9884a0b94aed42e5aa029f6d096a3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8ad96cd98c4cf683f763099e3064a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:54.724285 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-98957ec7-8e6e-44b5-ad81-9fb4d7abfb93 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] 10.222.0.35 "GET /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162" status: 200 len: 1541 microversion: 2.1 time: 0.157243 Jun 10 18:04:54.724906 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1195/2349] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:54 2022] GET /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162 => generated 1541 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:54.729545 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-826fb96f-3009-4ec5-a123-c8716ae52cdf tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:54.730344 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-826fb96f-3009-4ec5-a123-c8716ae52cdf tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:54.736452 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-826fb96f-3009-4ec5-a123-c8716ae52cdf tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:54.736901 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-826fb96f-3009-4ec5-a123-c8716ae52cdf tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:54.739191 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-826fb96f-3009-4ec5-a123-c8716ae52cdf tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:54.739191 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-826fb96f-3009-4ec5-a123-c8716ae52cdf tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:54.881814 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-826fb96f-3009-4ec5-a123-c8716ae52cdf tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:54.891642 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-826fb96f-3009-4ec5-a123-c8716ae52cdf tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1387 microversion: 2.1 time: 0.165747 Jun 10 18:04:54.892361 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1196/2350] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:54 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1387 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:54.898054 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-f4540e18-880a-4e82-b8b2-d6b9ec73a2b4 req-0656ee01-5fa5-4c71-8f1e-a3145478cc44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6fe7ee7-fe32-4aa2-8616-784a199a4973", "tag": "58c69631-b12a-467a-a2c5-02827b6006bb"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:54.906733 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-f4540e18-880a-4e82-b8b2-d6b9ec73a2b4 req-0656ee01-5fa5-4c71-8f1e-a3145478cc44 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:54.907372 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-f4540e18-880a-4e82-b8b2-d6b9ec73a2b4 req-0656ee01-5fa5-4c71-8f1e-a3145478cc44 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:54.918115 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-f4540e18-880a-4e82-b8b2-d6b9ec73a2b4 req-0656ee01-5fa5-4c71-8f1e-a3145478cc44 service nova] Creating event network-changed:58c69631-b12a-467a-a2c5-02827b6006bb for instance b6fe7ee7-fe32-4aa2-8616-784a199a4973 on chh2-master-2 Jun 10 18:04:54.922768 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-f4540e18-880a-4e82-b8b2-d6b9ec73a2b4 req-0656ee01-5fa5-4c71-8f1e-a3145478cc44 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029281 Jun 10 18:04:54.923345 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1197/2351] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:54.928478 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2c058428-5e3e-4a99-9b18-11d90c471e47 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:54.929245 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2c058428-5e3e-4a99-9b18-11d90c471e47 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] [instance: feb3b3b3-a867-4c17-9012-054b5e95790c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:54.935979 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2c058428-5e3e-4a99-9b18-11d90c471e47 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:54.936485 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2c058428-5e3e-4a99-9b18-11d90c471e47 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:54.937467 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2c058428-5e3e-4a99-9b18-11d90c471e47 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:54.937901 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2c058428-5e3e-4a99-9b18-11d90c471e47 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:54.969454 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a68395bf-b0c8-4b00-ba25-1cce61d9cee5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "POST /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3/action" status: 200 len: 14 microversion: 2.1 time: 0.644665 Jun 10 18:04:54.970864 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1155/2352] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:04:54 2022] POST /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3/action => generated 14 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:04:55.003344 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2c058428-5e3e-4a99-9b18-11d90c471e47 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56583ac49efa4176b34417b775f1398e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b6584334c2481e8bbffb2d1d50cc3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:55.012162 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2c058428-5e3e-4a99-9b18-11d90c471e47 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56583ac49efa4176b34417b775f1398e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b6584334c2481e8bbffb2d1d50cc3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:55.013697 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2c058428-5e3e-4a99-9b18-11d90c471e47 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56583ac49efa4176b34417b775f1398e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b6584334c2481e8bbffb2d1d50cc3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:55.014860 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2c058428-5e3e-4a99-9b18-11d90c471e47 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] 10.222.0.35 "GET /compute/v2.1/servers/feb3b3b3-a867-4c17-9012-054b5e95790c" status: 200 len: 1365 microversion: 2.47 time: 0.090462 Jun 10 18:04:55.015418 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1198/2353] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:04:54 2022] GET /compute/v2.1/servers/feb3b3b3-a867-4c17-9012-054b5e95790c => generated 1365 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:04:55.342281 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c80041ba-40d8-439e-87b6-53b7e2047e77 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:55.343355 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c80041ba-40d8-439e-87b6-53b7e2047e77 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: b6fe7ee7-fe32-4aa2-8616-784a199a4973] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:55.354610 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c80041ba-40d8-439e-87b6-53b7e2047e77 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:55.354998 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c80041ba-40d8-439e-87b6-53b7e2047e77 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:55.356235 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c80041ba-40d8-439e-87b6-53b7e2047e77 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:55.356706 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c80041ba-40d8-439e-87b6-53b7e2047e77 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:55.425675 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8586ea1f-7f2f-4222-a725-6f7ff48c949a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:55.426532 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8586ea1f-7f2f-4222-a725-6f7ff48c949a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:55.428800 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=1,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:04:55.436627 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8586ea1f-7f2f-4222-a725-6f7ff48c949a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:55.437089 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8586ea1f-7f2f-4222-a725-6f7ff48c949a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:55.437879 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8586ea1f-7f2f-4222-a725-6f7ff48c949a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:55.438322 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8586ea1f-7f2f-4222-a725-6f7ff48c949a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:55.568896 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c80041ba-40d8-439e-87b6-53b7e2047e77 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:55.583091 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c80041ba-40d8-439e-87b6-53b7e2047e77 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973" status: 200 len: 1316 microversion: 2.1 time: 0.246722 Jun 10 18:04:55.593297 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1156/2354] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:55 2022] GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973 => generated 1316 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:55.593297 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-194a5d8e-b14e-4aa1-aa0c-919322254952 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:55.593297 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-194a5d8e-b14e-4aa1-aa0c-919322254952 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:55.597550 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-194a5d8e-b14e-4aa1-aa0c-919322254952 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:55.597749 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-194a5d8e-b14e-4aa1-aa0c-919322254952 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:55.598751 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-194a5d8e-b14e-4aa1-aa0c-919322254952 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:55.599631 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-194a5d8e-b14e-4aa1-aa0c-919322254952 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:55.722776 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8586ea1f-7f2f-4222-a725-6f7ff48c949a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:55.732719 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8586ea1f-7f2f-4222-a725-6f7ff48c949a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:55.734833 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8586ea1f-7f2f-4222-a725-6f7ff48c949a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:55.736201 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8586ea1f-7f2f-4222-a725-6f7ff48c949a tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1281 microversion: 2.25 time: 0.314739 Jun 10 18:04:55.737196 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1199/2355] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:04:55 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1281 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:04:55.742871 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c492b614-c77f-414f-93e5-d3268846b07b tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:55.743760 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c492b614-c77f-414f-93e5-d3268846b07b tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] [instance: 4864e5b5-595a-4935-80c2-2572b66f8162] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:55.750438 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c492b614-c77f-414f-93e5-d3268846b07b tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:55.751013 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c492b614-c77f-414f-93e5-d3268846b07b tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:55.752261 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c492b614-c77f-414f-93e5-d3268846b07b tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:55.752947 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c492b614-c77f-414f-93e5-d3268846b07b tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:56.019900 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-194a5d8e-b14e-4aa1-aa0c-919322254952 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:56.030569 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-194a5d8e-b14e-4aa1-aa0c-919322254952 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1534 microversion: 2.1 time: 0.443732 Jun 10 18:04:56.033542 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1157/2356] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:55 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1534 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:56.042100 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2a8ad5d1-f725-447b-a90a-f60c18966fbc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:56.046968 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2a8ad5d1-f725-447b-a90a-f60c18966fbc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:56.059517 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2a8ad5d1-f725-447b-a90a-f60c18966fbc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:56.060174 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2a8ad5d1-f725-447b-a90a-f60c18966fbc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:56.063174 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2a8ad5d1-f725-447b-a90a-f60c18966fbc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:56.065664 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2a8ad5d1-f725-447b-a90a-f60c18966fbc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:56.125873 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c492b614-c77f-414f-93e5-d3268846b07b tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9884a0b94aed42e5aa029f6d096a3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8ad96cd98c4cf683f763099e3064a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:56.132635 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:04:56.135893 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c492b614-c77f-414f-93e5-d3268846b07b tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] 10.222.0.35 "GET /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162" status: 200 len: 1541 microversion: 2.1 time: 0.396974 Jun 10 18:04:56.136831 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1200/2357] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:55 2022] GET /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162 => generated 1541 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:56.142115 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-15eaf34e-cf17-4286-9210-4ebb84ddf6da tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:56.143406 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-15eaf34e-cf17-4286-9210-4ebb84ddf6da tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 49b47316-e3b5-4ecd-962d-003a6cd0def3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:56.154290 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-15eaf34e-cf17-4286-9210-4ebb84ddf6da tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:56.154757 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-15eaf34e-cf17-4286-9210-4ebb84ddf6da tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:56.155545 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-15eaf34e-cf17-4286-9210-4ebb84ddf6da tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:56.155992 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-15eaf34e-cf17-4286-9210-4ebb84ddf6da tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:56.201754 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-15eaf34e-cf17-4286-9210-4ebb84ddf6da tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "POST /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3/action" status: 200 len: 14 microversion: 2.1 time: 0.063139 Jun 10 18:04:56.202524 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1201/2358] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:04:56 2022] POST /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3/action => generated 14 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:04:56.211650 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0b484bca-d731-4774-badf-25da36d170bc tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:56.212802 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0b484bca-d731-4774-badf-25da36d170bc tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] [instance: feb3b3b3-a867-4c17-9012-054b5e95790c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:56.221966 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0b484bca-d731-4774-badf-25da36d170bc tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:56.222501 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0b484bca-d731-4774-badf-25da36d170bc tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:56.223406 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0b484bca-d731-4774-badf-25da36d170bc tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:56.224292 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0b484bca-d731-4774-badf-25da36d170bc tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:56.312038 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0b484bca-d731-4774-badf-25da36d170bc tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56583ac49efa4176b34417b775f1398e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b6584334c2481e8bbffb2d1d50cc3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:56.322898 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0b484bca-d731-4774-badf-25da36d170bc tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56583ac49efa4176b34417b775f1398e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b6584334c2481e8bbffb2d1d50cc3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:56.324387 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0b484bca-d731-4774-badf-25da36d170bc tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56583ac49efa4176b34417b775f1398e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b6584334c2481e8bbffb2d1d50cc3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:56.325593 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0b484bca-d731-4774-badf-25da36d170bc tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] 10.222.0.35 "GET /compute/v2.1/servers/feb3b3b3-a867-4c17-9012-054b5e95790c" status: 200 len: 1365 microversion: 2.47 time: 0.119400 Jun 10 18:04:56.326340 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1202/2359] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:04:56 2022] GET /compute/v2.1/servers/feb3b3b3-a867-4c17-9012-054b5e95790c => generated 1365 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:04:56.431312 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2a8ad5d1-f725-447b-a90a-f60c18966fbc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:56.441531 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2a8ad5d1-f725-447b-a90a-f60c18966fbc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1387 microversion: 2.1 time: 0.405410 Jun 10 18:04:56.442186 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1158/2360] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:56 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1387 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:56.600875 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-71b5efc0-d5a0-49be-88ee-0bb32a14487f tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:56.602307 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-71b5efc0-d5a0-49be-88ee-0bb32a14487f tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: b6fe7ee7-fe32-4aa2-8616-784a199a4973] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:56.614872 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-71b5efc0-d5a0-49be-88ee-0bb32a14487f tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:56.616024 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-71b5efc0-d5a0-49be-88ee-0bb32a14487f tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:56.626213 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-71b5efc0-d5a0-49be-88ee-0bb32a14487f tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:56.627055 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-71b5efc0-d5a0-49be-88ee-0bb32a14487f tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:56.722542 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-178d2fb1-1f78-426d-8316-c6018fe1e659 req-e8478328-67a9-4e86-b9f7-c5204435f555 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbc49fe4-a119-4ed9-9310-45babff4fec4", "name": "network-vif-deleted", "tag": "8e46ecde-2a76-4ced-9d12-e08541a4852f"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:56.732949 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-178d2fb1-1f78-426d-8316-c6018fe1e659 req-e8478328-67a9-4e86-b9f7-c5204435f555 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:56.733608 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-178d2fb1-1f78-426d-8316-c6018fe1e659 req-e8478328-67a9-4e86-b9f7-c5204435f555 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:56.752607 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-178d2fb1-1f78-426d-8316-c6018fe1e659 req-e8478328-67a9-4e86-b9f7-c5204435f555 service nova] Creating event network-vif-deleted:8e46ecde-2a76-4ced-9d12-e08541a4852f for instance fbc49fe4-a119-4ed9-9310-45babff4fec4 on chh2-master-2 Jun 10 18:04:56.761550 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-178d2fb1-1f78-426d-8316-c6018fe1e659 req-e8478328-67a9-4e86-b9f7-c5204435f555 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042859 Jun 10 18:04:56.763258 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1159/2361] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:56.769531 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ef59301a-a89d-4f43-9312-8cc8d4ed47c8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:56.770624 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ef59301a-a89d-4f43-9312-8cc8d4ed47c8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:56.778388 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ef59301a-a89d-4f43-9312-8cc8d4ed47c8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:56.778959 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ef59301a-a89d-4f43-9312-8cc8d4ed47c8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:56.780036 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ef59301a-a89d-4f43-9312-8cc8d4ed47c8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:56.780673 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ef59301a-a89d-4f43-9312-8cc8d4ed47c8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:56.865177 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-71b5efc0-d5a0-49be-88ee-0bb32a14487f tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:56.875013 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-71b5efc0-d5a0-49be-88ee-0bb32a14487f tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973" status: 200 len: 1316 microversion: 2.1 time: 0.278165 Jun 10 18:04:56.875796 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1203/2362] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:56 2022] GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973 => generated 1316 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:56.952471 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-a05c07ea-34c4-4f43-a14b-dae86a9199b6 req-d8436abd-b978-41cb-803b-268db8e89df6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4864e5b5-595a-4935-80c2-2572b66f8162", "name": "network-vif-deleted", "tag": "40a20790-d62d-4bb6-98d8-b36feab7f804"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:56.974364 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-a05c07ea-34c4-4f43-a14b-dae86a9199b6 req-d8436abd-b978-41cb-803b-268db8e89df6 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:56.975588 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-a05c07ea-34c4-4f43-a14b-dae86a9199b6 req-d8436abd-b978-41cb-803b-268db8e89df6 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:56.991873 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ef59301a-a89d-4f43-9312-8cc8d4ed47c8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:57.001369 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ef59301a-a89d-4f43-9312-8cc8d4ed47c8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:57.002921 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ef59301a-a89d-4f43-9312-8cc8d4ed47c8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:57.004154 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ef59301a-a89d-4f43-9312-8cc8d4ed47c8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1281 microversion: 2.25 time: 0.239426 Jun 10 18:04:57.005081 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1160/2363] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:04:56 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1281 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:04:57.012810 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-a05c07ea-34c4-4f43-a14b-dae86a9199b6 req-d8436abd-b978-41cb-803b-268db8e89df6 service nova] Creating event network-vif-deleted:40a20790-d62d-4bb6-98d8-b36feab7f804 for instance 4864e5b5-595a-4935-80c2-2572b66f8162 on chh1-master-2 Jun 10 18:04:57.019462 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-a05c07ea-34c4-4f43-a14b-dae86a9199b6 req-d8436abd-b978-41cb-803b-268db8e89df6 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074768 Jun 10 18:04:57.020585 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1204/2364] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:57.051096 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-09004ff1-954f-4c98-b2aa-cab0a4bed340 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:57.052514 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-09004ff1-954f-4c98-b2aa-cab0a4bed340 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:57.061102 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-09004ff1-954f-4c98-b2aa-cab0a4bed340 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:57.061833 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-09004ff1-954f-4c98-b2aa-cab0a4bed340 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:57.062941 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-09004ff1-954f-4c98-b2aa-cab0a4bed340 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:57.063567 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-09004ff1-954f-4c98-b2aa-cab0a4bed340 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:57.139230 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-09004ff1-954f-4c98-b2aa-cab0a4bed340 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:57.148696 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-09004ff1-954f-4c98-b2aa-cab0a4bed340 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1492 microversion: 2.1 time: 0.102295 Jun 10 18:04:57.150094 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1161/2365] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:57 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1492 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:57.154135 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-846ebbdf-f0dc-45ff-b9b4-eaab8b8184d1 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:57.155380 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-846ebbdf-f0dc-45ff-b9b4-eaab8b8184d1 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] [instance: 4864e5b5-595a-4935-80c2-2572b66f8162] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:57.178699 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-846ebbdf-f0dc-45ff-b9b4-eaab8b8184d1 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:57.179181 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-846ebbdf-f0dc-45ff-b9b4-eaab8b8184d1 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:57.186632 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-846ebbdf-f0dc-45ff-b9b4-eaab8b8184d1 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:57.186632 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-846ebbdf-f0dc-45ff-b9b4-eaab8b8184d1 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:57.218103 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-adf9f385-cc7c-4aa3-9472-fab61da6d727 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:57.219136 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-adf9f385-cc7c-4aa3-9472-fab61da6d727 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 49b47316-e3b5-4ecd-962d-003a6cd0def3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:57.225358 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-adf9f385-cc7c-4aa3-9472-fab61da6d727 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:57.225815 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-adf9f385-cc7c-4aa3-9472-fab61da6d727 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:57.226628 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-adf9f385-cc7c-4aa3-9472-fab61da6d727 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:57.226857 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-846ebbdf-f0dc-45ff-b9b4-eaab8b8184d1 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:57.228322 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-846ebbdf-f0dc-45ff-b9b4-eaab8b8184d1 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:57.229007 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-846ebbdf-f0dc-45ff-b9b4-eaab8b8184d1 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lazy-loading 'fault' on Instance uuid 4864e5b5-595a-4935-80c2-2572b66f8162 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:04:57.230801 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-adf9f385-cc7c-4aa3-9472-fab61da6d727 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:57.275486 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-adf9f385-cc7c-4aa3-9472-fab61da6d727 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "POST /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3/action" status: 200 len: 14 microversion: 2.1 time: 0.065324 Jun 10 18:04:57.276495 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1162/2366] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:04:57 2022] POST /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3/action => generated 14 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:04:57.320499 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-846ebbdf-f0dc-45ff-b9b4-eaab8b8184d1 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9884a0b94aed42e5aa029f6d096a3d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be8ad96cd98c4cf683f763099e3064a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:57.330032 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-846ebbdf-f0dc-45ff-b9b4-eaab8b8184d1 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] 10.222.0.35 "GET /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162" status: 200 len: 1321 microversion: 2.1 time: 0.180316 Jun 10 18:04:57.330618 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1205/2367] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:57 2022] GET /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162 => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:04:57.343970 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2e0baa73-765c-4390-9e0b-1e662707c0f3 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:57.346494 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2e0baa73-765c-4390-9e0b-1e662707c0f3 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] [instance: feb3b3b3-a867-4c17-9012-054b5e95790c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:57.352821 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e0baa73-765c-4390-9e0b-1e662707c0f3 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:57.353501 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e0baa73-765c-4390-9e0b-1e662707c0f3 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:57.354295 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e0baa73-765c-4390-9e0b-1e662707c0f3 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:57.354920 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e0baa73-765c-4390-9e0b-1e662707c0f3 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:57.459245 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7deb477c-9e39-4647-bc78-261ef2960e0c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:57.460236 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7deb477c-9e39-4647-bc78-261ef2960e0c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:57.473795 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7deb477c-9e39-4647-bc78-261ef2960e0c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:57.474551 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7deb477c-9e39-4647-bc78-261ef2960e0c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:57.475692 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7deb477c-9e39-4647-bc78-261ef2960e0c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:57.476334 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7deb477c-9e39-4647-bc78-261ef2960e0c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:57.491492 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2e0baa73-765c-4390-9e0b-1e662707c0f3 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56583ac49efa4176b34417b775f1398e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b6584334c2481e8bbffb2d1d50cc3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:57.508297 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2e0baa73-765c-4390-9e0b-1e662707c0f3 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56583ac49efa4176b34417b775f1398e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b6584334c2481e8bbffb2d1d50cc3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:57.510688 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2e0baa73-765c-4390-9e0b-1e662707c0f3 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56583ac49efa4176b34417b775f1398e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b6584334c2481e8bbffb2d1d50cc3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:57.512998 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2e0baa73-765c-4390-9e0b-1e662707c0f3 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] 10.222.0.35 "GET /compute/v2.1/servers/feb3b3b3-a867-4c17-9012-054b5e95790c" status: 200 len: 1365 microversion: 2.47 time: 0.172705 Jun 10 18:04:57.535537 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1163/2368] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:04:57 2022] GET /compute/v2.1/servers/feb3b3b3-a867-4c17-9012-054b5e95790c => generated 1365 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:04:57.620201 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7deb477c-9e39-4647-bc78-261ef2960e0c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:57.639709 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7deb477c-9e39-4647-bc78-261ef2960e0c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1184 microversion: 2.1 time: 0.184180 Jun 10 18:04:57.642332 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1206/2369] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:57 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1184 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:04:57.892232 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-831c3de8-047e-4326-92af-2eecbd57dec6 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:57.892826 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-831c3de8-047e-4326-92af-2eecbd57dec6 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: b6fe7ee7-fe32-4aa2-8616-784a199a4973] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:57.900680 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-831c3de8-047e-4326-92af-2eecbd57dec6 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:57.901141 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-831c3de8-047e-4326-92af-2eecbd57dec6 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:57.901918 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-831c3de8-047e-4326-92af-2eecbd57dec6 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:57.902559 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-831c3de8-047e-4326-92af-2eecbd57dec6 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:58.023160 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7c48a226-acf1-43a3-9a65-66c23c4cbbdb tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:58.025268 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7c48a226-acf1-43a3-9a65-66c23c4cbbdb tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:58.034101 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7c48a226-acf1-43a3-9a65-66c23c4cbbdb tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:58.034891 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7c48a226-acf1-43a3-9a65-66c23c4cbbdb tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:58.036010 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7c48a226-acf1-43a3-9a65-66c23c4cbbdb tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:58.036576 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7c48a226-acf1-43a3-9a65-66c23c4cbbdb tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:58.106182 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-831c3de8-047e-4326-92af-2eecbd57dec6 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:58.119294 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-831c3de8-047e-4326-92af-2eecbd57dec6 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973" status: 200 len: 1316 microversion: 2.1 time: 0.230292 Jun 10 18:04:58.120201 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1164/2370] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:57 2022] GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973 => generated 1316 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:58.166161 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-83eddc05-4acc-447a-ad3a-8c36fb7d7a96 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:58.167149 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-83eddc05-4acc-447a-ad3a-8c36fb7d7a96 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:58.173822 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83eddc05-4acc-447a-ad3a-8c36fb7d7a96 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:58.174282 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83eddc05-4acc-447a-ad3a-8c36fb7d7a96 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:58.175063 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83eddc05-4acc-447a-ad3a-8c36fb7d7a96 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:58.175502 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83eddc05-4acc-447a-ad3a-8c36fb7d7a96 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:58.198944 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7c48a226-acf1-43a3-9a65-66c23c4cbbdb tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:58.209853 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83eddc05-4acc-447a-ad3a-8c36fb7d7a96 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:58.210355 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83eddc05-4acc-447a-ad3a-8c36fb7d7a96 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:58.211604 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-83eddc05-4acc-447a-ad3a-8c36fb7d7a96 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lazy-loading 'fault' on Instance uuid fbc49fe4-a119-4ed9-9310-45babff4fec4 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:04:58.213335 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7c48a226-acf1-43a3-9a65-66c23c4cbbdb tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:58.215366 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7c48a226-acf1-43a3-9a65-66c23c4cbbdb tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:58.217947 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7c48a226-acf1-43a3-9a65-66c23c4cbbdb tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1281 microversion: 2.25 time: 0.199093 Jun 10 18:04:58.230159 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1207/2371] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:04:58 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1281 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:04:58.259213 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-83eddc05-4acc-447a-ad3a-8c36fb7d7a96 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:58.269496 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-83eddc05-4acc-447a-ad3a-8c36fb7d7a96 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1369 microversion: 2.1 time: 0.107152 Jun 10 18:04:58.275510 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1165/2372] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:58 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1369 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:04:58.287552 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-235eae3f-1fad-4a23-903f-b68b0ec94da1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:58.288786 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-235eae3f-1fad-4a23-903f-b68b0ec94da1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 49b47316-e3b5-4ecd-962d-003a6cd0def3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:58.295559 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-235eae3f-1fad-4a23-903f-b68b0ec94da1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:58.296018 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-235eae3f-1fad-4a23-903f-b68b0ec94da1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:58.296811 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-235eae3f-1fad-4a23-903f-b68b0ec94da1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:58.297280 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-235eae3f-1fad-4a23-903f-b68b0ec94da1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:58.333623 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-235eae3f-1fad-4a23-903f-b68b0ec94da1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "POST /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3/action" status: 200 len: 14 microversion: 2.1 time: 0.050575 Jun 10 18:04:58.338131 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1208/2373] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:04:58 2022] POST /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3/action => generated 14 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:04:58.347407 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-462db09c-5fb3-4ab7-b6f6-3f2bb8d2dbee tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:58.348105 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-462db09c-5fb3-4ab7-b6f6-3f2bb8d2dbee tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] [instance: 4864e5b5-595a-4935-80c2-2572b66f8162] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:58.354858 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-462db09c-5fb3-4ab7-b6f6-3f2bb8d2dbee tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:58.362906 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-462db09c-5fb3-4ab7-b6f6-3f2bb8d2dbee tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:58.362906 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-462db09c-5fb3-4ab7-b6f6-3f2bb8d2dbee tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:58.362906 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-462db09c-5fb3-4ab7-b6f6-3f2bb8d2dbee tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:58.372054 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-462db09c-5fb3-4ab7-b6f6-3f2bb8d2dbee tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] HTTP exception thrown: Instance 4864e5b5-595a-4935-80c2-2572b66f8162 could not be found. Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-462db09c-5fb3-4ab7-b6f6-3f2bb8d2dbee tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Request method failure captured: Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162 HTTP/1.1 Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4eXjV8VBmA-Zjw7Il0JmrDHm66QOdWxWj-6l2Bd2zPNYpnci5UWzEDszz5JZkSfom0Sc-CFqeKt9pYmIebPTNF4yYhzXhMAz536p4z9iPf8ae2r7uYqfYGYsUG7bzXysNB_c1n1LBIuEjBu2iJgZC7oRXa1HWZcl-s8SrpB_02R0jA Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: be8ad96cd98c4cf683f763099e3064a4 Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/be8ad96cd98c4cf683f763099e3064a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/be8ad96cd98c4cf683f763099e3064a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/be8ad96cd98c4cf683f763099e3064a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_be8ad96cd98c4cf683f763099e3064a4", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: be8ad96cd98c4cf683f763099e3064a4 Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 9884a0b94aed42e5aa029f6d096a3d36 Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 4864e5b5-595a-4935-80c2-2572b66f8162 could not be found. Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '4864e5b5-595a-4935-80c2-2572b66f8162'} Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4864e5b5-595a-4935-80c2-2572b66f8162 could not be found. Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4864e5b5-595a-4935-80c2-2572b66f8162 could not be found. Jun 10 18:04:58.373849 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:58.385414 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:04:58.385414 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:58.385414 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:04:58.385414 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:04:58.385414 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:04:58.385414 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:04:58.385414 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:04:58.385414 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4864e5b5-595a-4935-80c2-2572b66f8162 could not be found. Jun 10 18:04:58.385414 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:04:58.385414 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-462db09c-5fb3-4ab7-b6f6-3f2bb8d2dbee tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] Returning 404 to user: Instance 4864e5b5-595a-4935-80c2-2572b66f8162 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:04:58.385414 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-462db09c-5fb3-4ab7-b6f6-3f2bb8d2dbee tempest-FloatingIPsAssociationNegativeTestJSON-2047339737 tempest-FloatingIPsAssociationNegativeTestJSON-2047339737-project] 10.222.0.35 "GET /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162" status: 404 len: 111 microversion: 2.1 time: 0.032770 Jun 10 18:04:58.385414 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1166/2374] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:58 2022] GET /compute/v2.1/servers/4864e5b5-595a-4935-80c2-2572b66f8162 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:04:58.536686 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e7ed69dc-a7ae-4919-bc65-199da3accfef tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:58.541008 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e7ed69dc-a7ae-4919-bc65-199da3accfef tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] [instance: feb3b3b3-a867-4c17-9012-054b5e95790c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:58.550883 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7ed69dc-a7ae-4919-bc65-199da3accfef tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:58.553875 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7ed69dc-a7ae-4919-bc65-199da3accfef tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:58.558574 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7ed69dc-a7ae-4919-bc65-199da3accfef tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:58.559212 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7ed69dc-a7ae-4919-bc65-199da3accfef tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:58.640070 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e7ed69dc-a7ae-4919-bc65-199da3accfef tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56583ac49efa4176b34417b775f1398e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b6584334c2481e8bbffb2d1d50cc3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:58.648694 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e7ed69dc-a7ae-4919-bc65-199da3accfef tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56583ac49efa4176b34417b775f1398e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b6584334c2481e8bbffb2d1d50cc3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:58.651219 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e7ed69dc-a7ae-4919-bc65-199da3accfef tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56583ac49efa4176b34417b775f1398e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b6584334c2481e8bbffb2d1d50cc3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:58.653202 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e7ed69dc-a7ae-4919-bc65-199da3accfef tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] 10.222.0.35 "GET /compute/v2.1/servers/feb3b3b3-a867-4c17-9012-054b5e95790c" status: 200 len: 1365 microversion: 2.47 time: 0.123221 Jun 10 18:04:58.654933 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1209/2375] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:04:58 2022] GET /compute/v2.1/servers/feb3b3b3-a867-4c17-9012-054b5e95790c => generated 1365 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:04:58.667493 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-10df79fa-b658-403d-b093-4de327213d8c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:58.668241 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-10df79fa-b658-403d-b093-4de327213d8c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:58.670433 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=42 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:04:58.675653 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10df79fa-b658-403d-b093-4de327213d8c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:58.676457 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10df79fa-b658-403d-b093-4de327213d8c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:58.677496 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10df79fa-b658-403d-b093-4de327213d8c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:58.678175 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10df79fa-b658-403d-b093-4de327213d8c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:58.750631 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-10df79fa-b658-403d-b093-4de327213d8c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:58.761236 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-10df79fa-b658-403d-b093-4de327213d8c tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1184 microversion: 2.1 time: 0.107937 Jun 10 18:04:58.770870 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1167/2376] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:58 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1184 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:58.778879 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-055bbae1-7502-4edc-ba49-3d1614d05416 req-834b0625-ad24-4955-9526-5c9e0325fa58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e24cb05a-9ceb-4570-9773-b04297cbf4bb", "name": "network-vif-deleted", "tag": "f0d78f74-c94f-47fc-b5f6-fca21d020e90"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:58.788321 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-055bbae1-7502-4edc-ba49-3d1614d05416 req-834b0625-ad24-4955-9526-5c9e0325fa58 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:58.788799 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-055bbae1-7502-4edc-ba49-3d1614d05416 req-834b0625-ad24-4955-9526-5c9e0325fa58 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:58.800828 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-055bbae1-7502-4edc-ba49-3d1614d05416 req-834b0625-ad24-4955-9526-5c9e0325fa58 service nova] Creating event network-vif-deleted:f0d78f74-c94f-47fc-b5f6-fca21d020e90 for instance e24cb05a-9ceb-4570-9773-b04297cbf4bb on chh1-master-2 Jun 10 18:04:58.807317 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-055bbae1-7502-4edc-ba49-3d1614d05416 req-834b0625-ad24-4955-9526-5c9e0325fa58 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031713 Jun 10 18:04:58.809619 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1168/2377] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:04:58.841509 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8656af05-dadc-47c6-acd6-db91448a3d81 tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] Action: 'create', calling method: .version_select at 0x7f77c0056940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-660898278", "description": "tempest-description-1325048989"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:59.138061 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dfb35175-38ff-458a-9c6f-1133aa2199a6 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:59.139503 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dfb35175-38ff-458a-9c6f-1133aa2199a6 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: b6fe7ee7-fe32-4aa2-8616-784a199a4973] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:59.147204 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dfb35175-38ff-458a-9c6f-1133aa2199a6 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:59.147729 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dfb35175-38ff-458a-9c6f-1133aa2199a6 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:59.148580 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dfb35175-38ff-458a-9c6f-1133aa2199a6 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:59.149031 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dfb35175-38ff-458a-9c6f-1133aa2199a6 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:59.302400 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-dfb35175-38ff-458a-9c6f-1133aa2199a6 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:59.312682 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dfb35175-38ff-458a-9c6f-1133aa2199a6 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973" status: 200 len: 1316 microversion: 2.1 time: 0.179053 Jun 10 18:04:59.313592 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1169/2378] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:59 2022] GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973 => generated 1316 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:04:59.327121 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-619d0ae9-d80b-4fbf-a617-fa1bf9dbe4ec tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:59.327121 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-619d0ae9-d80b-4fbf-a617-fa1bf9dbe4ec tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:59.330551 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-619d0ae9-d80b-4fbf-a617-fa1bf9dbe4ec tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:59.331101 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-619d0ae9-d80b-4fbf-a617-fa1bf9dbe4ec tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:59.332138 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-619d0ae9-d80b-4fbf-a617-fa1bf9dbe4ec tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:59.332607 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-619d0ae9-d80b-4fbf-a617-fa1bf9dbe4ec tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:59.353991 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8656af05-dadc-47c6-acd6-db91448a3d81 tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] 10.222.0.35 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.667485 Jun 10 18:04:59.355515 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1210/2379] 10.222.0.35 () {60 vars in 1179 bytes} [Fri Jun 10 18:04:58 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:04:59.365730 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7bf5ba62-6fa3-4b36-9e10-db04892f6fd2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:59.365730 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7bf5ba62-6fa3-4b36-9e10-db04892f6fd2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:59.370984 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7bf5ba62-6fa3-4b36-9e10-db04892f6fd2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:59.371738 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7bf5ba62-6fa3-4b36-9e10-db04892f6fd2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:59.374167 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7bf5ba62-6fa3-4b36-9e10-db04892f6fd2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:59.383604 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7bf5ba62-6fa3-4b36-9e10-db04892f6fd2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:59.432415 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7bf5ba62-6fa3-4b36-9e10-db04892f6fd2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:59.433128 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7bf5ba62-6fa3-4b36-9e10-db04892f6fd2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:59.436205 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-7bf5ba62-6fa3-4b36-9e10-db04892f6fd2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lazy-loading 'fault' on Instance uuid fbc49fe4-a119-4ed9-9310-45babff4fec4 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:04:59.478097 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7bf5ba62-6fa3-4b36-9e10-db04892f6fd2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:59.486265 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7bf5ba62-6fa3-4b36-9e10-db04892f6fd2 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1369 microversion: 2.1 time: 0.129649 Jun 10 18:04:59.486843 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1211/2380] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:59 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1369 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:04:59.491964 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bae068cb-941a-4f9b-b508-52990f1de875 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:59.493009 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bae068cb-941a-4f9b-b508-52990f1de875 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 49b47316-e3b5-4ecd-962d-003a6cd0def3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:59.499091 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bae068cb-941a-4f9b-b508-52990f1de875 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:59.499862 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bae068cb-941a-4f9b-b508-52990f1de875 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:59.500840 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bae068cb-941a-4f9b-b508-52990f1de875 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:59.504581 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bae068cb-941a-4f9b-b508-52990f1de875 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:59.504816 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-619d0ae9-d80b-4fbf-a617-fa1bf9dbe4ec tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:59.513346 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-619d0ae9-d80b-4fbf-a617-fa1bf9dbe4ec tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:59.514850 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-619d0ae9-d80b-4fbf-a617-fa1bf9dbe4ec tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:04:59.515964 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-619d0ae9-d80b-4fbf-a617-fa1bf9dbe4ec tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1281 microversion: 2.25 time: 0.198389 Jun 10 18:04:59.526732 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1170/2381] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:04:59 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1281 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:04:59.526732 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7b64118e-8b8d-49fe-8652-cc1ace9fafad tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] Action: 'create', calling method: .version_select at 0x7f77c046baf0>, body: {"security_group_rule": {"parent_group_id": "11255a47-5566-4e96-8696-0f90c3a2a47c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:04:59.546627 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bae068cb-941a-4f9b-b508-52990f1de875 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "POST /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3/action" status: 200 len: 14 microversion: 2.1 time: 0.058255 Jun 10 18:04:59.550542 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1212/2382] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:04:59 2022] POST /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3/action => generated 14 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:04:59.673977 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a3b613f9-f165-4a41-81a3-437ec749e719 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:04:59.679822 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a3b613f9-f165-4a41-81a3-437ec749e719 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] [instance: feb3b3b3-a867-4c17-9012-054b5e95790c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:04:59.683904 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3b613f9-f165-4a41-81a3-437ec749e719 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:59.684632 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3b613f9-f165-4a41-81a3-437ec749e719 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:59.685630 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3b613f9-f165-4a41-81a3-437ec749e719 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:04:59.686339 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3b613f9-f165-4a41-81a3-437ec749e719 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:04:59.996568 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7b64118e-8b8d-49fe-8652-cc1ace9fafad tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] 10.222.0.35 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.478557 Jun 10 18:04:59.999699 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1171/2383] 10.222.0.35 () {60 vars in 1194 bytes} [Fri Jun 10 18:04:59 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:00.002320 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d7a9597a-bd15-4a03-b217-0276910679db tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:00.003530 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d7a9597a-bd15-4a03-b217-0276910679db tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:00.010809 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d7a9597a-bd15-4a03-b217-0276910679db tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:00.011789 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d7a9597a-bd15-4a03-b217-0276910679db tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:00.013114 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d7a9597a-bd15-4a03-b217-0276910679db tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:00.013768 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d7a9597a-bd15-4a03-b217-0276910679db tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:00.032773 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:05:00.092862 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d7a9597a-bd15-4a03-b217-0276910679db tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:00.104543 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d7a9597a-bd15-4a03-b217-0276910679db tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1184 microversion: 2.1 time: 0.106101 Jun 10 18:05:00.105419 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1172/2384] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:04:59 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1184 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:00.105831 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a3b613f9-f165-4a41-81a3-437ec749e719 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56583ac49efa4176b34417b775f1398e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b6584334c2481e8bbffb2d1d50cc3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:00.110093 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-04a6d17e-1063-401e-bd28-2ba638b1ada3 tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] Action: 'create', calling method: .version_select at 0x7f77c6108d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1593098606", "description": "tempest-description-1744143072"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:00.126316 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a3b613f9-f165-4a41-81a3-437ec749e719 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56583ac49efa4176b34417b775f1398e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b6584334c2481e8bbffb2d1d50cc3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:00.129473 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a3b613f9-f165-4a41-81a3-437ec749e719 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56583ac49efa4176b34417b775f1398e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b6584334c2481e8bbffb2d1d50cc3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:00.131647 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a3b613f9-f165-4a41-81a3-437ec749e719 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] 10.222.0.35 "GET /compute/v2.1/servers/feb3b3b3-a867-4c17-9012-054b5e95790c" status: 200 len: 1365 microversion: 2.47 time: 0.461414 Jun 10 18:05:00.132730 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1213/2385] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:04:59 2022] GET /compute/v2.1/servers/feb3b3b3-a867-4c17-9012-054b5e95790c => generated 1365 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:05:00.330964 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-158b7e49-55b0-494e-9a8c-fe6402d67382 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:00.331133 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-158b7e49-55b0-494e-9a8c-fe6402d67382 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: b6fe7ee7-fe32-4aa2-8616-784a199a4973] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:00.339438 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-158b7e49-55b0-494e-9a8c-fe6402d67382 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:00.340338 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-158b7e49-55b0-494e-9a8c-fe6402d67382 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:00.341290 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-158b7e49-55b0-494e-9a8c-fe6402d67382 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:00.342063 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-158b7e49-55b0-494e-9a8c-fe6402d67382 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:00.493597 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-04a6d17e-1063-401e-bd28-2ba638b1ada3 tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] 10.222.0.35 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.387096 Jun 10 18:05:00.494998 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1173/2386] 10.222.0.35 () {60 vars in 1179 bytes} [Fri Jun 10 18:05:00 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:00.508081 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-99a504b7-1882-4ab7-b9ab-925564df01dc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:00.508817 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-99a504b7-1882-4ab7-b9ab-925564df01dc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:00.521160 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99a504b7-1882-4ab7-b9ab-925564df01dc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:00.521689 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99a504b7-1882-4ab7-b9ab-925564df01dc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:00.522548 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99a504b7-1882-4ab7-b9ab-925564df01dc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:00.523076 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99a504b7-1882-4ab7-b9ab-925564df01dc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:00.561838 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99a504b7-1882-4ab7-b9ab-925564df01dc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:00.562555 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99a504b7-1882-4ab7-b9ab-925564df01dc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:00.563109 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-99a504b7-1882-4ab7-b9ab-925564df01dc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lazy-loading 'fault' on Instance uuid fbc49fe4-a119-4ed9-9310-45babff4fec4 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:05:00.606786 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-158b7e49-55b0-494e-9a8c-fe6402d67382 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:00.622456 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-99a504b7-1882-4ab7-b9ab-925564df01dc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:00.626226 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-158b7e49-55b0-494e-9a8c-fe6402d67382 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973" status: 200 len: 1316 microversion: 2.1 time: 0.299805 Jun 10 18:05:00.626826 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1214/2387] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:00 2022] GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973 => generated 1316 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:05:00.640952 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4befb99c-2596-41cc-94b3-3a900468b980 tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] Action: 'create', calling method: .version_select at 0x7f77b3f99dc0>, body: {"security_group_rule": {"parent_group_id": "5830a542-ffe6-4cc4-a556-fa8e14cec7a4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:00.650840 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-99a504b7-1882-4ab7-b9ab-925564df01dc tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1369 microversion: 2.1 time: 0.146724 Jun 10 18:05:00.653306 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1174/2388] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:00 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1369 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:00.658711 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b3a1a193-453a-4533-aebe-03fd5ee8053b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:00.662877 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b3a1a193-453a-4533-aebe-03fd5ee8053b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:00.668274 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b3a1a193-453a-4533-aebe-03fd5ee8053b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:00.669014 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b3a1a193-453a-4533-aebe-03fd5ee8053b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:00.670199 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b3a1a193-453a-4533-aebe-03fd5ee8053b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:00.670839 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b3a1a193-453a-4533-aebe-03fd5ee8053b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:01.183570 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b3a1a193-453a-4533-aebe-03fd5ee8053b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:01.198187 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b3a1a193-453a-4533-aebe-03fd5ee8053b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:01.200016 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b3a1a193-453a-4533-aebe-03fd5ee8053b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:01.201556 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b3a1a193-453a-4533-aebe-03fd5ee8053b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1281 microversion: 2.25 time: 0.546833 Jun 10 18:05:01.202052 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1175/2389] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:05:00 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1281 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:05:01.221167 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-26c4cabc-aad4-4d9a-bb40-961795c8f53e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:01.222202 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-26c4cabc-aad4-4d9a-bb40-961795c8f53e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 49b47316-e3b5-4ecd-962d-003a6cd0def3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:01.230058 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-26c4cabc-aad4-4d9a-bb40-961795c8f53e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:01.230526 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-26c4cabc-aad4-4d9a-bb40-961795c8f53e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:01.231429 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-26c4cabc-aad4-4d9a-bb40-961795c8f53e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:01.231883 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-26c4cabc-aad4-4d9a-bb40-961795c8f53e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:01.283213 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-26c4cabc-aad4-4d9a-bb40-961795c8f53e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "POST /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3/action" status: 200 len: 14 microversion: 2.1 time: 0.066006 Jun 10 18:05:01.283876 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1176/2390] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:05:01 2022] POST /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3/action => generated 14 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:05:01.308129 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c1b64f0c-8317-47f1-9d07-ff47cc2f94ab tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:01.308902 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c1b64f0c-8317-47f1-9d07-ff47cc2f94ab tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:01.324829 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c1b64f0c-8317-47f1-9d07-ff47cc2f94ab tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:01.325284 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c1b64f0c-8317-47f1-9d07-ff47cc2f94ab tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:01.326318 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c1b64f0c-8317-47f1-9d07-ff47cc2f94ab tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:01.326508 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c1b64f0c-8317-47f1-9d07-ff47cc2f94ab tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:01.429326 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c1b64f0c-8317-47f1-9d07-ff47cc2f94ab tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:01.438105 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c1b64f0c-8317-47f1-9d07-ff47cc2f94ab tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1184 microversion: 2.1 time: 0.147079 Jun 10 18:05:01.438616 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1177/2391] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:01 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1184 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:01.444289 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4dcd4947-5f33-45c1-bc34-63f5e74755c5 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:01.446647 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4dcd4947-5f33-45c1-bc34-63f5e74755c5 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] [instance: feb3b3b3-a867-4c17-9012-054b5e95790c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:01.454116 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4dcd4947-5f33-45c1-bc34-63f5e74755c5 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:01.454756 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4dcd4947-5f33-45c1-bc34-63f5e74755c5 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:01.455747 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4dcd4947-5f33-45c1-bc34-63f5e74755c5 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:01.459528 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4dcd4947-5f33-45c1-bc34-63f5e74755c5 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:01.510844 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4dcd4947-5f33-45c1-bc34-63f5e74755c5 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:01.511502 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4dcd4947-5f33-45c1-bc34-63f5e74755c5 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:01.513377 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-4dcd4947-5f33-45c1-bc34-63f5e74755c5 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lazy-loading 'fault' on Instance uuid feb3b3b3-a867-4c17-9012-054b5e95790c {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:05:01.544671 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4befb99c-2596-41cc-94b3-3a900468b980 tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] 10.222.0.35 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.906858 Jun 10 18:05:01.546122 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1215/2392] 10.222.0.35 () {60 vars in 1194 bytes} [Fri Jun 10 18:05:00 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:01.559223 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cedd6515-47a7-408d-8995-155534bfcee5 tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] Action: 'create', calling method: .version_select at 0x7f77c0056af0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1133435820", "description": "tempest-description-439638487"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:01.568774 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4dcd4947-5f33-45c1-bc34-63f5e74755c5 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56583ac49efa4176b34417b775f1398e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b6584334c2481e8bbffb2d1d50cc3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:01.579173 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4dcd4947-5f33-45c1-bc34-63f5e74755c5 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56583ac49efa4176b34417b775f1398e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b6584334c2481e8bbffb2d1d50cc3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:01.581143 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4dcd4947-5f33-45c1-bc34-63f5e74755c5 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56583ac49efa4176b34417b775f1398e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b6584334c2481e8bbffb2d1d50cc3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:01.585863 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4dcd4947-5f33-45c1-bc34-63f5e74755c5 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] 10.222.0.35 "GET /compute/v2.1/servers/feb3b3b3-a867-4c17-9012-054b5e95790c" status: 200 len: 1370 microversion: 2.47 time: 0.142632 Jun 10 18:05:01.585863 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1178/2393] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:05:01 2022] GET /compute/v2.1/servers/feb3b3b3-a867-4c17-9012-054b5e95790c => generated 1370 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:05:01.665253 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f62f1ef0-5c77-4c9c-839a-884235175503 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:01.665958 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f62f1ef0-5c77-4c9c-839a-884235175503 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: b6fe7ee7-fe32-4aa2-8616-784a199a4973] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:01.685751 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f62f1ef0-5c77-4c9c-839a-884235175503 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:01.686915 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f62f1ef0-5c77-4c9c-839a-884235175503 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:01.688089 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f62f1ef0-5c77-4c9c-839a-884235175503 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:01.688705 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f62f1ef0-5c77-4c9c-839a-884235175503 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:01.886095 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f62f1ef0-5c77-4c9c-839a-884235175503 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:01.894223 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f62f1ef0-5c77-4c9c-839a-884235175503 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973" status: 200 len: 1316 microversion: 2.1 time: 0.254985 Jun 10 18:05:01.900445 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1179/2394] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:01 2022] GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973 => generated 1316 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:01.909270 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0bb883a4-600f-43dd-950e-f3f523505084 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:01.910109 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0bb883a4-600f-43dd-950e-f3f523505084 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:01.922909 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0bb883a4-600f-43dd-950e-f3f523505084 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:01.923472 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0bb883a4-600f-43dd-950e-f3f523505084 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:01.924375 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0bb883a4-600f-43dd-950e-f3f523505084 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:01.924922 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0bb883a4-600f-43dd-950e-f3f523505084 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:01.959758 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0bb883a4-600f-43dd-950e-f3f523505084 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:01.960191 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0bb883a4-600f-43dd-950e-f3f523505084 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:01.961208 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-0bb883a4-600f-43dd-950e-f3f523505084 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lazy-loading 'fault' on Instance uuid fbc49fe4-a119-4ed9-9310-45babff4fec4 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:05:02.007861 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0bb883a4-600f-43dd-950e-f3f523505084 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:02.015566 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0bb883a4-600f-43dd-950e-f3f523505084 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 200 len: 1369 microversion: 2.1 time: 0.119046 Jun 10 18:05:02.016347 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1180/2395] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:01 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 1369 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:02.134090 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cedd6515-47a7-408d-8995-155534bfcee5 tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] 10.222.0.35 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.579099 Jun 10 18:05:02.136093 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1216/2396] 10.222.0.35 () {60 vars in 1179 bytes} [Fri Jun 10 18:05:01 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:02.148377 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8f1d1d95-e6f2-4acf-b827-af6e647892a2 tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] Action: 'create', calling method: .version_select at 0x7f77c048fc10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-288952744", "description": "tempest-description-181036763"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:02.220154 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a665e22d-2407-47fc-bd6a-4087aea6cae2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:02.220824 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a665e22d-2407-47fc-bd6a-4087aea6cae2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:02.228341 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a665e22d-2407-47fc-bd6a-4087aea6cae2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:02.228800 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a665e22d-2407-47fc-bd6a-4087aea6cae2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:02.229582 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a665e22d-2407-47fc-bd6a-4087aea6cae2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:02.230028 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a665e22d-2407-47fc-bd6a-4087aea6cae2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:02.463418 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a665e22d-2407-47fc-bd6a-4087aea6cae2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:02.482482 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a665e22d-2407-47fc-bd6a-4087aea6cae2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:02.486552 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a665e22d-2407-47fc-bd6a-4087aea6cae2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:02.488211 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a665e22d-2407-47fc-bd6a-4087aea6cae2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1281 microversion: 2.25 time: 0.272191 Jun 10 18:05:02.488923 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1217/2397] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:05:02 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1281 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:05:02.510340 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3f8a3016-eac6-49f7-bdbf-ac209a2918e1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:02.512088 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3f8a3016-eac6-49f7-bdbf-ac209a2918e1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 49b47316-e3b5-4ecd-962d-003a6cd0def3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:02.521358 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f8a3016-eac6-49f7-bdbf-ac209a2918e1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:02.522179 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f8a3016-eac6-49f7-bdbf-ac209a2918e1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:02.524451 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f8a3016-eac6-49f7-bdbf-ac209a2918e1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:02.525273 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f8a3016-eac6-49f7-bdbf-ac209a2918e1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:02.584969 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3f8a3016-eac6-49f7-bdbf-ac209a2918e1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "POST /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3/action" status: 200 len: 14 microversion: 2.1 time: 0.089652 Jun 10 18:05:02.584969 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1218/2398] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:05:02 2022] POST /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:05:02.591622 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a22b5fb5-6036-4986-9dba-29cdde2e64bd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:02.592643 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a22b5fb5-6036-4986-9dba-29cdde2e64bd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:02.609559 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a22b5fb5-6036-4986-9dba-29cdde2e64bd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:02.610258 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a22b5fb5-6036-4986-9dba-29cdde2e64bd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:02.611302 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a22b5fb5-6036-4986-9dba-29cdde2e64bd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:02.611913 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a22b5fb5-6036-4986-9dba-29cdde2e64bd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:02.718188 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8f1d1d95-e6f2-4acf-b827-af6e647892a2 tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] 10.222.0.35 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.571621 Jun 10 18:05:02.720871 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1181/2399] 10.222.0.35 () {60 vars in 1179 bytes} [Fri Jun 10 18:05:02 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:02.722042 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a22b5fb5-6036-4986-9dba-29cdde2e64bd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:02.726696 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0f14659c-06a5-4727-a57f-824ff974bfb8 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:02.727308 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0f14659c-06a5-4727-a57f-824ff974bfb8 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] [instance: feb3b3b3-a867-4c17-9012-054b5e95790c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:02.735676 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0f14659c-06a5-4727-a57f-824ff974bfb8 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:02.736118 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0f14659c-06a5-4727-a57f-824ff974bfb8 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:02.737212 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0f14659c-06a5-4727-a57f-824ff974bfb8 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:02.738358 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0f14659c-06a5-4727-a57f-824ff974bfb8 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:02.739670 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a22b5fb5-6036-4986-9dba-29cdde2e64bd tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 200 len: 1184 microversion: 2.1 time: 0.156130 Jun 10 18:05:02.741782 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1219/2400] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:02 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 1184 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:02.748923 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-baa3c512-ba2c-486a-b35b-9629743a22ee tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] Action: 'create', calling method: .version_select at 0x7f77c0056a60>, body: {"security_group_rule": {"parent_group_id": "9f6bc52f-8506-46c8-9aa1-52f61089f7d2", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "5cfeb40d-f568-4c71-b533-534334f273b3"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:02.759245 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-0f14659c-06a5-4727-a57f-824ff974bfb8 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] HTTP exception thrown: Instance feb3b3b3-a867-4c17-9012-054b5e95790c could not be found. Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0f14659c-06a5-4727-a57f-824ff974bfb8 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Request method failure captured: Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/feb3b3b3-a867-4c17-9012-054b5e95790c HTTP/1.1 Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4e4Xcye_30R5t3sFdOCKJQmc2PmL522kbHz7FeHQdaIFQ1vNBFNBkJvlM43DnFc_k42_y00OrMHUrZ4fUzUoT1EI2AvSu9e6M5qkBJPSxIxSljwG-nuyK5sN5vuy6VSwAxzszaX12oApaKMCg_NinYQDvN4pUmdnFOm7lO364wVFHU Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: X-Openstack-Nova-Api-Version: 2.47 Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 46b6584334c2481e8bbffb2d1d50cc3c Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersAaction247Test-300089275 Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/46b6584334c2481e8bbffb2d1d50cc3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/46b6584334c2481e8bbffb2d1d50cc3c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/46b6584334c2481e8bbffb2d1d50cc3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_46b6584334c2481e8bbffb2d1d50cc3c", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersAaction247Test-300089275 Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 46b6584334c2481e8bbffb2d1d50cc3c Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersAaction247Test-300089275 Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersAaction247Test-300089275-project Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 56583ac49efa4176b34417b775f1398e Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersAaction247Test-300089275-project Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: exception: Instance feb3b3b3-a867-4c17-9012-054b5e95790c could not be found. Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'feb3b3b3-a867-4c17-9012-054b5e95790c'} Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feb3b3b3-a867-4c17-9012-054b5e95790c could not be found. Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feb3b3b3-a867-4c17-9012-054b5e95790c could not be found. Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:02.761413 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:02.766640 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:02.766640 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:02.766640 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:02.766640 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:05:02.766640 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:05:02.766640 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feb3b3b3-a867-4c17-9012-054b5e95790c could not be found. Jun 10 18:05:02.766640 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:02.766640 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0f14659c-06a5-4727-a57f-824ff974bfb8 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] Returning 404 to user: Instance feb3b3b3-a867-4c17-9012-054b5e95790c could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:05:02.766640 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0f14659c-06a5-4727-a57f-824ff974bfb8 tempest-ServersAaction247Test-300089275 tempest-ServersAaction247Test-300089275-project] 10.222.0.35 "GET /compute/v2.1/servers/feb3b3b3-a867-4c17-9012-054b5e95790c" status: 404 len: 111 microversion: 2.47 time: 0.040873 Jun 10 18:05:02.766640 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1182/2401] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:05:02 2022] GET /compute/v2.1/servers/feb3b3b3-a867-4c17-9012-054b5e95790c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:05:02.920576 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a003fd78-4739-4de9-93e4-be6dc23d8569 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:02.921266 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a003fd78-4739-4de9-93e4-be6dc23d8569 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: b6fe7ee7-fe32-4aa2-8616-784a199a4973] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:02.932019 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a003fd78-4739-4de9-93e4-be6dc23d8569 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:02.932876 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a003fd78-4739-4de9-93e4-be6dc23d8569 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:02.933928 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a003fd78-4739-4de9-93e4-be6dc23d8569 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:02.934654 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a003fd78-4739-4de9-93e4-be6dc23d8569 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:03.126363 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a003fd78-4739-4de9-93e4-be6dc23d8569 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:03.144728 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a003fd78-4739-4de9-93e4-be6dc23d8569 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973" status: 200 len: 1316 microversion: 2.1 time: 0.236491 Jun 10 18:05:03.146376 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1183/2402] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:02 2022] GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973 => generated 1316 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:03.167032 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7979faef-addf-4c69-ba35-cf51520692ba tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:03.174514 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7979faef-addf-4c69-ba35-cf51520692ba tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: fbc49fe4-a119-4ed9-9310-45babff4fec4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:03.202803 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7979faef-addf-4c69-ba35-cf51520692ba tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:03.204149 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7979faef-addf-4c69-ba35-cf51520692ba tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:03.205329 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7979faef-addf-4c69-ba35-cf51520692ba tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:03.209186 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7979faef-addf-4c69-ba35-cf51520692ba tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:03.237072 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-7979faef-addf-4c69-ba35-cf51520692ba tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] HTTP exception thrown: Instance fbc49fe4-a119-4ed9-9310-45babff4fec4 could not be found. Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7979faef-addf-4c69-ba35-cf51520692ba tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Request method failure captured: Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 HTTP/1.1 Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4Zy3r1pX7b3MtL_-NjN-zlRyjsPaJf9nUlwgEmvUs6EwjOw40qP9dbLbsHgij_gMl6uhbXl9nIlkqHmrWwww9dWms-7XOTEOvy9MdKMCvcMLYW-x2PIZ_wthjppQYWTgc0gmbBlQDA4e11wPRqBUoXg28RiqROpiqwC1wftTAJuO0M Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 66fd5e2ed0b84720849784c94f36d5da Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-MigrationsAdminTest-1164955500 Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/66fd5e2ed0b84720849784c94f36d5da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/66fd5e2ed0b84720849784c94f36d5da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/66fd5e2ed0b84720849784c94f36d5da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_66fd5e2ed0b84720849784c94f36d5da", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-MigrationsAdminTest-1164955500 Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 66fd5e2ed0b84720849784c94f36d5da Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-MigrationsAdminTest-1164955500 Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-MigrationsAdminTest-1164955500-project Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 1c74f45bf7fd4dea952d771a649519af Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-MigrationsAdminTest-1164955500-project Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: exception: Instance fbc49fe4-a119-4ed9-9310-45babff4fec4 could not be found. Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'fbc49fe4-a119-4ed9-9310-45babff4fec4'} Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbc49fe4-a119-4ed9-9310-45babff4fec4 could not be found. Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbc49fe4-a119-4ed9-9310-45babff4fec4 could not be found. Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:03.241040 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:03.249218 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:03.249218 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:03.249218 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:03.249218 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:05:03.249218 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:05:03.249218 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbc49fe4-a119-4ed9-9310-45babff4fec4 could not be found. Jun 10 18:05:03.249218 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:03.249218 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7979faef-addf-4c69-ba35-cf51520692ba tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Returning 404 to user: Instance fbc49fe4-a119-4ed9-9310-45babff4fec4 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:05:03.249218 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7979faef-addf-4c69-ba35-cf51520692ba tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4" status: 404 len: 111 microversion: 2.1 time: 0.095743 Jun 10 18:05:03.256603 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1184/2403] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:03 2022] GET /compute/v2.1/servers/fbc49fe4-a119-4ed9-9310-45babff4fec4 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:05:03.263727 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e27c0a37-7d16-49c2-96fd-2702da2f1728 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '.version_select at 0x7f77c0499a60>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:03.273831 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:05:03.424959 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e27c0a37-7d16-49c2-96fd-2702da2f1728 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-998261225" status: 202 len: 0 microversion: 2.1 time: 0.165718 Jun 10 18:05:03.425935 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1185/2404] 10.222.0.35 () {58 vars in 1217 bytes} [Fri Jun 10 18:05:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-998261225 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:05:03.507973 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1ada1585-390b-4ee9-9946-bafa318a1fb2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:03.508827 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1ada1585-390b-4ee9-9946-bafa318a1fb2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:03.525877 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1ada1585-390b-4ee9-9946-bafa318a1fb2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:03.527502 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1ada1585-390b-4ee9-9946-bafa318a1fb2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:03.528908 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1ada1585-390b-4ee9-9946-bafa318a1fb2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:03.529706 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1ada1585-390b-4ee9-9946-bafa318a1fb2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:03.616645 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-baa3c512-ba2c-486a-b35b-9629743a22ee tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] 10.222.0.35 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.872573 Jun 10 18:05:03.626390 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1220/2405] 10.222.0.35 () {60 vars in 1194 bytes} [Fri Jun 10 18:05:02 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:03.634515 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2dcb8bc4-45c2-4f9e-bfc6-e2534d18b102 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:03.636240 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2dcb8bc4-45c2-4f9e-bfc6-e2534d18b102 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 49b47316-e3b5-4ecd-962d-003a6cd0def3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:03.668755 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2dcb8bc4-45c2-4f9e-bfc6-e2534d18b102 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:03.676378 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2dcb8bc4-45c2-4f9e-bfc6-e2534d18b102 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:03.682963 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2dcb8bc4-45c2-4f9e-bfc6-e2534d18b102 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:03.684011 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2dcb8bc4-45c2-4f9e-bfc6-e2534d18b102 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:03.762077 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2dcb8bc4-45c2-4f9e-bfc6-e2534d18b102 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "POST /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3/action" status: 200 len: 14 microversion: 2.1 time: 0.137995 Jun 10 18:05:03.762077 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1221/2406] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:05:03 2022] POST /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:05:03.770940 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bb3c823f-8d83-4a27-ba3c-71efcf0a5f4d tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] Action: 'create', calling method: .version_select at 0x7f77b3f97b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1741025214", "description": "tempest-description-1226469050"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:03.919552 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1ada1585-390b-4ee9-9946-bafa318a1fb2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:03.933138 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1ada1585-390b-4ee9-9946-bafa318a1fb2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:03.935171 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1ada1585-390b-4ee9-9946-bafa318a1fb2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:03.936840 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1ada1585-390b-4ee9-9946-bafa318a1fb2 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1281 microversion: 2.25 time: 0.433306 Jun 10 18:05:03.938169 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1186/2407] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:05:03 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1281 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:05:03.946074 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0536b47f-2d0d-47ba-b50e-0c1da087265d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:03.947037 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0536b47f-2d0d-47ba-b50e-0c1da087265d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: e24cb05a-9ceb-4570-9773-b04297cbf4bb] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:03.989917 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0536b47f-2d0d-47ba-b50e-0c1da087265d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:03.990541 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0536b47f-2d0d-47ba-b50e-0c1da087265d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:03.991458 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0536b47f-2d0d-47ba-b50e-0c1da087265d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:03.992230 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0536b47f-2d0d-47ba-b50e-0c1da087265d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:04.038551 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-0536b47f-2d0d-47ba-b50e-0c1da087265d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] HTTP exception thrown: Instance e24cb05a-9ceb-4570-9773-b04297cbf4bb could not be found. Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0536b47f-2d0d-47ba-b50e-0c1da087265d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Request method failure captured: Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb HTTP/1.1 Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4Z1ErqekzqbT7WRsjkgkcIzOI_kHmS-v_gvh4SRJ2CMh-NfkzhIoAtBfjl57mQ3Zi2c8A0N4Q1ae1LCxXwPlP907CgwMHpQ3m2O1zE3NlaVYvIAW686XQfO0IP3gUnl9nQpF0XYTmOfelRJZNyQoLoHq3yZptXhyCu_RxXmqZPldSo Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: c96da7ef0cbc46b594ec327ddf875f7a Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-LiveMigrationTest-1635373537 Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/c96da7ef0cbc46b594ec327ddf875f7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c96da7ef0cbc46b594ec327ddf875f7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c96da7ef0cbc46b594ec327ddf875f7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_c96da7ef0cbc46b594ec327ddf875f7a", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-LiveMigrationTest-1635373537 Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: c96da7ef0cbc46b594ec327ddf875f7a Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-LiveMigrationTest-1635373537 Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-LiveMigrationTest-1635373537-project Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: d0f741e8506743a8b51251b3019b3ad5 Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-LiveMigrationTest-1635373537-project Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: exception: Instance e24cb05a-9ceb-4570-9773-b04297cbf4bb could not be found. Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'e24cb05a-9ceb-4570-9773-b04297cbf4bb'} Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e24cb05a-9ceb-4570-9773-b04297cbf4bb could not be found. Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e24cb05a-9ceb-4570-9773-b04297cbf4bb could not be found. Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:04.042965 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:04.048323 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:04.048323 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:04.048323 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:04.048323 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:05:04.048323 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:05:04.048323 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e24cb05a-9ceb-4570-9773-b04297cbf4bb could not be found. Jun 10 18:05:04.048323 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:04.048323 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0536b47f-2d0d-47ba-b50e-0c1da087265d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Returning 404 to user: Instance e24cb05a-9ceb-4570-9773-b04297cbf4bb could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:05:04.048323 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0536b47f-2d0d-47ba-b50e-0c1da087265d tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb" status: 404 len: 111 microversion: 2.1 time: 0.105592 Jun 10 18:05:04.050652 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1187/2408] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:03 2022] GET /compute/v2.1/servers/e24cb05a-9ceb-4570-9773-b04297cbf4bb => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:05:04.100750 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=16 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:05:04.113182 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:05:04.166726 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5ef21808-29af-49b9-9aa1-9c4ab47a391e tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:04.167393 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5ef21808-29af-49b9-9aa1-9c4ab47a391e tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: b6fe7ee7-fe32-4aa2-8616-784a199a4973] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:04.190699 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ef21808-29af-49b9-9aa1-9c4ab47a391e tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:04.190699 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ef21808-29af-49b9-9aa1-9c4ab47a391e tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:04.190699 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ef21808-29af-49b9-9aa1-9c4ab47a391e tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:04.191873 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ef21808-29af-49b9-9aa1-9c4ab47a391e tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:04.649794 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5ef21808-29af-49b9-9aa1-9c4ab47a391e tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:04.658043 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5ef21808-29af-49b9-9aa1-9c4ab47a391e tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973" status: 200 len: 1316 microversion: 2.1 time: 0.498450 Jun 10 18:05:04.663848 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1188/2409] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:04 2022] GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973 => generated 1316 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:04.773400 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ee362fe7-8bd2-48a1-b253-6834d2a553db tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:04.774620 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ee362fe7-8bd2-48a1-b253-6834d2a553db tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 49b47316-e3b5-4ecd-962d-003a6cd0def3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:04.789441 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee362fe7-8bd2-48a1-b253-6834d2a553db tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:04.790524 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee362fe7-8bd2-48a1-b253-6834d2a553db tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:04.791516 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee362fe7-8bd2-48a1-b253-6834d2a553db tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:04.792279 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee362fe7-8bd2-48a1-b253-6834d2a553db tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:04.882299 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ee362fe7-8bd2-48a1-b253-6834d2a553db tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "POST /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3/action" status: 200 len: 8205 microversion: 2.1 time: 0.114751 Jun 10 18:05:04.888193 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1189/2410] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:05:04 2022] POST /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3/action => generated 8205 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:04.894729 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fcf81c61-24a8-4cb0-9685-7d7a5cc131fb tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:04.895436 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fcf81c61-24a8-4cb0-9685-7d7a5cc131fb tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:04.920455 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fcf81c61-24a8-4cb0-9685-7d7a5cc131fb tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:04.921113 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fcf81c61-24a8-4cb0-9685-7d7a5cc131fb tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:04.921694 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fcf81c61-24a8-4cb0-9685-7d7a5cc131fb tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:04.922131 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fcf81c61-24a8-4cb0-9685-7d7a5cc131fb tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:04.943744 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bb3c823f-8d83-4a27-ba3c-71efcf0a5f4d tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] 10.222.0.35 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.178296 Jun 10 18:05:04.944742 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1222/2411] 10.222.0.35 () {60 vars in 1179 bytes} [Fri Jun 10 18:05:03 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:04.957836 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-963cd17f-484f-4a57-a462-70aee95c4e1e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:04.959692 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-963cd17f-484f-4a57-a462-70aee95c4e1e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:04.975396 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-963cd17f-484f-4a57-a462-70aee95c4e1e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:04.977522 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-963cd17f-484f-4a57-a462-70aee95c4e1e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:04.984165 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-963cd17f-484f-4a57-a462-70aee95c4e1e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:04.987308 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-963cd17f-484f-4a57-a462-70aee95c4e1e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:05.239987 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fcf81c61-24a8-4cb0-9685-7d7a5cc131fb tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:05.248115 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fcf81c61-24a8-4cb0-9685-7d7a5cc131fb tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.358540 Jun 10 18:05:05.248736 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1190/2412] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:04 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:05.254627 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7bd8a777-3cbf-48cf-bd92-9ac62987e089 tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] Action: 'create', calling method: .version_select at 0x7f77c610c160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1330343630", "description": "tempest-description-396420070"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:05.278962 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-963cd17f-484f-4a57-a462-70aee95c4e1e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:05.287820 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-963cd17f-484f-4a57-a462-70aee95c4e1e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:05.290011 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-963cd17f-484f-4a57-a462-70aee95c4e1e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:05.291169 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-963cd17f-484f-4a57-a462-70aee95c4e1e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1281 microversion: 2.25 time: 0.339495 Jun 10 18:05:05.297196 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1223/2413] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:05:04 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1281 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:05:05.312234 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3845aeee-740b-4178-b421-d33a370a4343 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:05.313284 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3845aeee-740b-4178-b421-d33a370a4343 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:05.323282 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3845aeee-740b-4178-b421-d33a370a4343 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:05.324672 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3845aeee-740b-4178-b421-d33a370a4343 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:05.329680 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3845aeee-740b-4178-b421-d33a370a4343 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:05.330170 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3845aeee-740b-4178-b421-d33a370a4343 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:05.368372 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:05:05.672212 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3845aeee-740b-4178-b421-d33a370a4343 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:05.684125 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3845aeee-740b-4178-b421-d33a370a4343 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.378353 Jun 10 18:05:05.684771 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1224/2414] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:05 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:05.698192 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-67398715-7665-4c0a-a969-537e3e4c8a8e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:05.698697 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-67398715-7665-4c0a-a969-537e3e4c8a8e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:05.706160 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-67398715-7665-4c0a-a969-537e3e4c8a8e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:05.706619 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-67398715-7665-4c0a-a969-537e3e4c8a8e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:05.707533 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-67398715-7665-4c0a-a969-537e3e4c8a8e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:05.707972 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-67398715-7665-4c0a-a969-537e3e4c8a8e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:05.737135 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-67398715-7665-4c0a-a969-537e3e4c8a8e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:05:05.873398 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7bd8a777-3cbf-48cf-bd92-9ac62987e089 tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] 10.222.0.35 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.622381 Jun 10 18:05:05.873998 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1191/2415] 10.222.0.35 () {60 vars in 1179 bytes} [Fri Jun 10 18:05:05 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:05.885056 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3591b14e-a769-47d5-8ef6-a16780be670e tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:05.885685 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3591b14e-a769-47d5-8ef6-a16780be670e tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: b6fe7ee7-fe32-4aa2-8616-784a199a4973] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:05.902225 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3591b14e-a769-47d5-8ef6-a16780be670e tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:05.902833 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3591b14e-a769-47d5-8ef6-a16780be670e tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:05.903977 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3591b14e-a769-47d5-8ef6-a16780be670e tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:05.906584 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3591b14e-a769-47d5-8ef6-a16780be670e tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:06.083321 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-67398715-7665-4c0a-a969-537e3e4c8a8e tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "DELETE /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 204 len: 0 microversion: 2.1 time: 0.391819 Jun 10 18:05:06.083938 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1225/2416] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:05:05 2022] DELETE /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:05:06.089502 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3591b14e-a769-47d5-8ef6-a16780be670e tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:06.094756 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1d7a48fc-97f9-4413-88e9-2138e2db6ea8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:06.095474 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1d7a48fc-97f9-4413-88e9-2138e2db6ea8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:06.102970 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3591b14e-a769-47d5-8ef6-a16780be670e tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973" status: 200 len: 1316 microversion: 2.1 time: 0.220401 Jun 10 18:05:06.103567 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1192/2417] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:05 2022] GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973 => generated 1316 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:06.108260 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-677b0173-79b0-49be-af20-a0287ad808df tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] Action: 'create', calling method: .version_select at 0x7f77c0d1baf0>, body: {"security_group_rule": {"parent_group_id": "de7e4b5b-d1b9-490c-ad8e-41f973ff9412", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "9160160f-984c-46b4-ba66-57e186bcee43"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:06.115755 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1d7a48fc-97f9-4413-88e9-2138e2db6ea8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:06.116386 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1d7a48fc-97f9-4413-88e9-2138e2db6ea8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:06.117830 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1d7a48fc-97f9-4413-88e9-2138e2db6ea8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:06.119329 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1d7a48fc-97f9-4413-88e9-2138e2db6ea8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:06.318048 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1d7a48fc-97f9-4413-88e9-2138e2db6ea8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:06.329117 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1d7a48fc-97f9-4413-88e9-2138e2db6ea8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.238509 Jun 10 18:05:06.330063 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1226/2418] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:06 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:06.335344 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-027901c3-2237-4c82-a3ee-3bba2b6fa280 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:06.336933 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-027901c3-2237-4c82-a3ee-3bba2b6fa280 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:06.349819 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-027901c3-2237-4c82-a3ee-3bba2b6fa280 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:06.350644 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-027901c3-2237-4c82-a3ee-3bba2b6fa280 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:06.351580 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-027901c3-2237-4c82-a3ee-3bba2b6fa280 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:06.352209 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-027901c3-2237-4c82-a3ee-3bba2b6fa280 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:06.562051 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-027901c3-2237-4c82-a3ee-3bba2b6fa280 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:06.572815 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-027901c3-2237-4c82-a3ee-3bba2b6fa280 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1468 microversion: 2.1 time: 0.241489 Jun 10 18:05:06.573864 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1227/2419] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:06 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1468 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:06.589315 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-eee6f670-0c2e-45c3-a522-77985aa56fd1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:06.590107 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-eee6f670-0c2e-45c3-a522-77985aa56fd1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:06.598056 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eee6f670-0c2e-45c3-a522-77985aa56fd1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:06.600032 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eee6f670-0c2e-45c3-a522-77985aa56fd1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:06.600032 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eee6f670-0c2e-45c3-a522-77985aa56fd1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:06.600032 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eee6f670-0c2e-45c3-a522-77985aa56fd1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:06.856469 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-eee6f670-0c2e-45c3-a522-77985aa56fd1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:06.865145 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-eee6f670-0c2e-45c3-a522-77985aa56fd1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:06.866664 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-eee6f670-0c2e-45c3-a522-77985aa56fd1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:06.867808 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-eee6f670-0c2e-45c3-a522-77985aa56fd1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1281 microversion: 2.25 time: 0.292923 Jun 10 18:05:06.868747 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1228/2420] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:05:06 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1281 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:05:06.874079 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e04e0c91-e8f9-4ad8-82d6-0c6a8d386fc3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:06.874829 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e04e0c91-e8f9-4ad8-82d6-0c6a8d386fc3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:06.881200 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e04e0c91-e8f9-4ad8-82d6-0c6a8d386fc3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:06.891185 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e04e0c91-e8f9-4ad8-82d6-0c6a8d386fc3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:06.891185 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e04e0c91-e8f9-4ad8-82d6-0c6a8d386fc3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:06.891185 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e04e0c91-e8f9-4ad8-82d6-0c6a8d386fc3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:06.891897 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-677b0173-79b0-49be-af20-a0287ad808df tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] 10.222.0.35 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.779752 Jun 10 18:05:06.891897 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1193/2421] 10.222.0.35 () {60 vars in 1194 bytes} [Fri Jun 10 18:05:06 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:06.901195 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-aa4f4cc8-550c-4d21-8269-235decce7816 tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] Calling method '.version_select at 0x7f77c0459550>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:07.082504 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e04e0c91-e8f9-4ad8-82d6-0c6a8d386fc3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:07.095013 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e04e0c91-e8f9-4ad8-82d6-0c6a8d386fc3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.224979 Jun 10 18:05:07.106057 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1229/2422] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:06 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:07.120777 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-eac4a61c-e20c-468d-8d27-b93ca0a16785 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:07.121758 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-eac4a61c-e20c-468d-8d27-b93ca0a16785 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:07.133994 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eac4a61c-e20c-468d-8d27-b93ca0a16785 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:07.134918 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eac4a61c-e20c-468d-8d27-b93ca0a16785 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:07.136538 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eac4a61c-e20c-468d-8d27-b93ca0a16785 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:07.137233 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eac4a61c-e20c-468d-8d27-b93ca0a16785 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:07.398977 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-eac4a61c-e20c-468d-8d27-b93ca0a16785 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Locking {{(pid=126594) lock /opt/stack/nova/nova/compute/api.py:4700}} Jun 10 18:05:07.535993 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-aa4f4cc8-550c-4d21-8269-235decce7816 tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] 10.222.0.35 "DELETE /compute/v2.1/os-security-groups/9160160f-984c-46b4-ba66-57e186bcee43" status: 202 len: 0 microversion: 2.1 time: 0.638436 Jun 10 18:05:07.542997 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1194/2423] 10.222.0.35 () {58 vars in 1271 bytes} [Fri Jun 10 18:05:06 2022] DELETE /compute/v2.1/os-security-groups/9160160f-984c-46b4-ba66-57e186bcee43 => generated 0 bytes in 647 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 18:05:07.556174 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-62cd96b1-7fd2-4200-8678-d2dcd519a419 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:07.558355 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-62cd96b1-7fd2-4200-8678-d2dcd519a419 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: b6fe7ee7-fe32-4aa2-8616-784a199a4973] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:07.608460 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-62cd96b1-7fd2-4200-8678-d2dcd519a419 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:07.613770 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-62cd96b1-7fd2-4200-8678-d2dcd519a419 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:07.617141 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-62cd96b1-7fd2-4200-8678-d2dcd519a419 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:07.621621 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-62cd96b1-7fd2-4200-8678-d2dcd519a419 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:07.743329 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-eac4a61c-e20c-468d-8d27-b93ca0a16785 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "POST /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1/action" status: 202 len: 0 microversion: 2.1 time: 0.630875 Jun 10 18:05:07.744808 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1230/2424] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:05:07 2022] POST /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1/action => generated 0 bytes in 637 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:05:07.751048 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-252c2a21-6635-4f26-9b15-72c2d7d60edf req-7a377f80-1c0f-4ddf-ae1e-e254a5cc9b4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6fe7ee7-fe32-4aa2-8616-784a199a4973", "name": "network-vif-plugged", "status": "completed", "tag": "58c69631-b12a-467a-a2c5-02827b6006bb"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:07.774783 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-252c2a21-6635-4f26-9b15-72c2d7d60edf req-7a377f80-1c0f-4ddf-ae1e-e254a5cc9b4b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:07.775246 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-252c2a21-6635-4f26-9b15-72c2d7d60edf req-7a377f80-1c0f-4ddf-ae1e-e254a5cc9b4b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:07.789925 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-252c2a21-6635-4f26-9b15-72c2d7d60edf req-7a377f80-1c0f-4ddf-ae1e-e254a5cc9b4b service nova] Creating event network-vif-plugged:58c69631-b12a-467a-a2c5-02827b6006bb for instance b6fe7ee7-fe32-4aa2-8616-784a199a4973 on chh2-master-2 Jun 10 18:05:07.795559 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-252c2a21-6635-4f26-9b15-72c2d7d60edf req-7a377f80-1c0f-4ddf-ae1e-e254a5cc9b4b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048572 Jun 10 18:05:07.796178 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1231/2425] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:07.807104 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1b2e5d15-5eb3-428e-aa98-6a68b0967d13 tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] Calling method '.version_select at 0x7f77b3f97430>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:07.915377 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1b2e5d15-5eb3-428e-aa98-6a68b0967d13 tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] 10.222.0.35 "GET /compute/v2.1/os-security-groups/de7e4b5b-d1b9-490c-ad8e-41f973ff9412" status: 200 len: 248 microversion: 2.1 time: 0.113331 Jun 10 18:05:07.916098 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1232/2426] 10.222.0.35 () {58 vars in 1268 bytes} [Fri Jun 10 18:05:07 2022] GET /compute/v2.1/os-security-groups/de7e4b5b-d1b9-490c-ad8e-41f973ff9412 => generated 248 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:07.921140 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-61757474-bf73-4b5f-9c3f-1a685959d07d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:07.922059 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-61757474-bf73-4b5f-9c3f-1a685959d07d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:07.939601 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-61757474-bf73-4b5f-9c3f-1a685959d07d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:07.941615 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-61757474-bf73-4b5f-9c3f-1a685959d07d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:07.943842 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-61757474-bf73-4b5f-9c3f-1a685959d07d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:07.945722 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-61757474-bf73-4b5f-9c3f-1a685959d07d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:08.279568 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-61757474-bf73-4b5f-9c3f-1a685959d07d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:08.292868 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-61757474-bf73-4b5f-9c3f-1a685959d07d tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1468 microversion: 2.1 time: 0.372529 Jun 10 18:05:08.292868 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1233/2427] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:07 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1468 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:08.302101 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c8fca848-2043-4bca-99b1-f88de643c305 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:08.302733 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c8fca848-2043-4bca-99b1-f88de643c305 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:08.326475 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c8fca848-2043-4bca-99b1-f88de643c305 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:08.327209 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c8fca848-2043-4bca-99b1-f88de643c305 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:08.328266 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c8fca848-2043-4bca-99b1-f88de643c305 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:08.328821 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c8fca848-2043-4bca-99b1-f88de643c305 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:08.365005 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-62cd96b1-7fd2-4200-8678-d2dcd519a419 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:08.378961 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-62cd96b1-7fd2-4200-8678-d2dcd519a419 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973" status: 200 len: 1316 microversion: 2.1 time: 0.832182 Jun 10 18:05:08.379567 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1195/2428] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:07 2022] GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973 => generated 1316 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:08.414474 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-99bb2c58-839b-41db-8f6e-5014aad7ab74 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:08.414474 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-99bb2c58-839b-41db-8f6e-5014aad7ab74 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:08.424589 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99bb2c58-839b-41db-8f6e-5014aad7ab74 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:08.440413 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99bb2c58-839b-41db-8f6e-5014aad7ab74 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:08.443020 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99bb2c58-839b-41db-8f6e-5014aad7ab74 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:08.443792 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99bb2c58-839b-41db-8f6e-5014aad7ab74 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:08.701341 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c8fca848-2043-4bca-99b1-f88de643c305 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:08.712767 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c8fca848-2043-4bca-99b1-f88de643c305 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.420743 Jun 10 18:05:08.727213 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1234/2429] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:08 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:08.730542 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f673ebae-f64a-41f1-964e-2fb65925b3ac tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] Action: 'create', calling method: .version_select at 0x7f77b3f939d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-209758384", "description": "tempest-description-1815568162"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:08.807895 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-99bb2c58-839b-41db-8f6e-5014aad7ab74 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:08.812280 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:05:08.822054 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-99bb2c58-839b-41db-8f6e-5014aad7ab74 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:08.826466 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-99bb2c58-839b-41db-8f6e-5014aad7ab74 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:08.830345 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-99bb2c58-839b-41db-8f6e-5014aad7ab74 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1281 microversion: 2.25 time: 0.437213 Jun 10 18:05:08.835308 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1196/2430] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:05:08 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1281 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:05:08.852713 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-db17c54f-c02a-41d1-9f7f-fa9e1d5b1940 req-754fdcf1-037c-45a7-a9f3-e0fc5cf782b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89b2f687-3173-411f-92fa-c2e4dde322f6", "name": "network-vif-deleted", "tag": "ee1a855b-cfd0-4246-8752-23c466c46c38"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:08.865813 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-db17c54f-c02a-41d1-9f7f-fa9e1d5b1940 req-754fdcf1-037c-45a7-a9f3-e0fc5cf782b6 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:08.866930 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-db17c54f-c02a-41d1-9f7f-fa9e1d5b1940 req-754fdcf1-037c-45a7-a9f3-e0fc5cf782b6 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:08.893402 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-db17c54f-c02a-41d1-9f7f-fa9e1d5b1940 req-754fdcf1-037c-45a7-a9f3-e0fc5cf782b6 service nova] Creating event network-vif-deleted:ee1a855b-cfd0-4246-8752-23c466c46c38 for instance 89b2f687-3173-411f-92fa-c2e4dde322f6 on chh1-master-2 Jun 10 18:05:08.902950 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-db17c54f-c02a-41d1-9f7f-fa9e1d5b1940 req-754fdcf1-037c-45a7-a9f3-e0fc5cf782b6 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056032 Jun 10 18:05:08.904167 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1197/2431] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:08.918228 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-50c4de46-5605-4844-b37f-9d31336e3d56 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:08.925733 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-50c4de46-5605-4844-b37f-9d31336e3d56 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:08.926193 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-50c4de46-5605-4844-b37f-9d31336e3d56 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:08.984821 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-50c4de46-5605-4844-b37f-9d31336e3d56 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] HTTP exception thrown: Instance 186b67b3-3538-4bc2-8528-53b43d701bf1 is locked Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-50c4de46-5605-4844-b37f-9d31336e3d56 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Request method failure captured: Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1/action HTTP/1.1 Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 15 Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4bjYRjdJJInCzu3PVxYJsfBkminC6Ikt7M75i6Sx-ogiu0g-ClcDk6pe5ZbprSFn2IZnkupAGWwRhhyzLuF9eMcuLH1bKi15cgeBj7qi81gCxtLZj7Eo_sXXfXIhz0vAnCNJVtg10TQ8DAW2pxp6y_-W-5vyky7ezDgXd3Gl7vJQCo Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 2b34cb51c168497088d66fa0e507e364 Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServerActionsTestJSON-197909573 Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/2b34cb51c168497088d66fa0e507e364"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2b34cb51c168497088d66fa0e507e364"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2b34cb51c168497088d66fa0e507e364"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_2b34cb51c168497088d66fa0e507e364", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServerActionsTestJSON-197909573 Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 2b34cb51c168497088d66fa0e507e364 Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServerActionsTestJSON-197909573 Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServerActionsTestJSON-197909573-project Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 352e7f5de76c42da9241721fe0f0bf86 Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServerActionsTestJSON-197909573-project Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: {"os-stop": {}} Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 186b67b3-3538-4bc2-8528-53b43d701bf1 is locked Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '186b67b3-3538-4bc2-8528-53b43d701bf1', 'body': {'os-stop': {}}} Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 186b67b3-3538-4bc2-8528-53b43d701bf1 is locked Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 186b67b3-3538-4bc2-8528-53b43d701bf1 is locked Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 186b67b3-3538-4bc2-8528-53b43d701bf1 is locked Jun 10 18:05:08.986678 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:08.993945 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-50c4de46-5605-4844-b37f-9d31336e3d56 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Returning 409 to user: Instance 186b67b3-3538-4bc2-8528-53b43d701bf1 is locked {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:05:08.995022 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-50c4de46-5605-4844-b37f-9d31336e3d56 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "POST /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1/action" status: 409 len: 107 microversion: 2.1 time: 0.089141 Jun 10 18:05:08.999377 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1198/2432] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:05:08 2022] POST /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1/action => generated 107 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:05:09.005083 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-eb45cd54-5b96-4099-8b8c-e0e6feb3bdcc tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] Calling method '.version_select at 0x7f77c0459af0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:09.061356 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-eb45cd54-5b96-4099-8b8c-e0e6feb3bdcc tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] 10.222.0.35 "GET /compute/v2.1/images/c975828a-b6d1-4ff4-961b-c380ea55cbd6" status: 200 len: 637 microversion: 2.1 time: 0.060534 Jun 10 18:05:09.071481 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1199/2433] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:05:08 2022] GET /compute/v2.1/images/c975828a-b6d1-4ff4-961b-c380ea55cbd6 => generated 637 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:09.091146 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-25714443-5edd-4f24-801d-074cc42f3042 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:09.091146 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-25714443-5edd-4f24-801d-074cc42f3042 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:09.101862 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-25714443-5edd-4f24-801d-074cc42f3042 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:09.102864 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-25714443-5edd-4f24-801d-074cc42f3042 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:09.113057 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-25714443-5edd-4f24-801d-074cc42f3042 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:09.113842 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-25714443-5edd-4f24-801d-074cc42f3042 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:09.338643 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-25714443-5edd-4f24-801d-074cc42f3042 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Unlocking {{(pid=126595) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jun 10 18:05:09.341365 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f673ebae-f64a-41f1-964e-2fb65925b3ac tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] 10.222.0.35 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.616366 Jun 10 18:05:09.342907 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1235/2434] 10.222.0.35 () {60 vars in 1179 bytes} [Fri Jun 10 18:05:08 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:09.348107 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cc453fb9-d8c8-4951-9cc5-c4bb5f8623d9 tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] Action: 'update_all', calling method: .version_select at 0x7f77c00a60d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:09.405274 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-cc453fb9-d8c8-4951-9cc5-c4bb5f8623d9 tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] Getting quotas for project 466403f0fb994f33866a5307f8f0bcca. Resources: dict_keys(['metadata_items']) {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:05:09.410560 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-cc453fb9-d8c8-4951-9cc5-c4bb5f8623d9 tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] Getting quotas for user 1f1a86fb89e04fb6b3b46979f0b94064 and project 466403f0fb994f33866a5307f8f0bcca. Resources: dict_keys(['metadata_items']) {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:05:09.598002 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-25714443-5edd-4f24-801d-074cc42f3042 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "POST /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1/action" status: 202 len: 0 microversion: 2.1 time: 0.524729 Jun 10 18:05:09.609145 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1200/2435] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:05:09 2022] POST /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1/action => generated 0 bytes in 537 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:05:09.626661 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fdbf7ff4-05c9-4a74-9972-73d46b69c840 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:09.627329 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fdbf7ff4-05c9-4a74-9972-73d46b69c840 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:09.637868 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fdbf7ff4-05c9-4a74-9972-73d46b69c840 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:09.638324 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fdbf7ff4-05c9-4a74-9972-73d46b69c840 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:09.639373 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fdbf7ff4-05c9-4a74-9972-73d46b69c840 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:09.639824 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fdbf7ff4-05c9-4a74-9972-73d46b69c840 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:09.725424 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fdbf7ff4-05c9-4a74-9972-73d46b69c840 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:09.725991 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fdbf7ff4-05c9-4a74-9972-73d46b69c840 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:09.727176 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-fdbf7ff4-05c9-4a74-9972-73d46b69c840 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lazy-loading 'fault' on Instance uuid 89b2f687-3173-411f-92fa-c2e4dde322f6 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:05:09.801366 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fdbf7ff4-05c9-4a74-9972-73d46b69c840 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:09.811810 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fdbf7ff4-05c9-4a74-9972-73d46b69c840 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 200 len: 1302 microversion: 2.1 time: 0.201209 Jun 10 18:05:09.821060 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1201/2436] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:09 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 1302 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:09.826014 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-aa4d4ceb-81a6-4fd0-acb2-db6015d9ddc1 tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] Action: 'create', calling method: .version_select at 0x7f77c045dd30>, body: {"security_group_rule": {"parent_group_id": "9180ee7a-9b82-4c28-a54e-c40a5f1693fa", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:09.941173 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cc453fb9-d8c8-4951-9cc5-c4bb5f8623d9 tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] 10.222.0.35 "PUT /compute/v2.1/images/c975828a-b6d1-4ff4-961b-c380ea55cbd6/metadata" status: 200 len: 61 microversion: 2.1 time: 0.597004 Jun 10 18:05:09.950161 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1236/2437] 10.222.0.35 () {60 vars in 1279 bytes} [Fri Jun 10 18:05:09 2022] PUT /compute/v2.1/images/c975828a-b6d1-4ff4-961b-c380ea55cbd6/metadata => generated 61 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:05:09.951409 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-33c22096-7596-4f88-b2a3-94fa8cab9307 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:09.953353 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-33c22096-7596-4f88-b2a3-94fa8cab9307 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: b6fe7ee7-fe32-4aa2-8616-784a199a4973] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:09.959987 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-33c22096-7596-4f88-b2a3-94fa8cab9307 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:09.963812 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-33c22096-7596-4f88-b2a3-94fa8cab9307 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:09.963812 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-33c22096-7596-4f88-b2a3-94fa8cab9307 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:09.963812 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-33c22096-7596-4f88-b2a3-94fa8cab9307 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:10.114677 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-33c22096-7596-4f88-b2a3-94fa8cab9307 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:10.124214 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-33c22096-7596-4f88-b2a3-94fa8cab9307 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973" status: 200 len: 1316 microversion: 2.1 time: 0.178566 Jun 10 18:05:10.132898 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1237/2438] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:09 2022] GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973 => generated 1316 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:10.132898 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d3b6f897-9f95-4115-93d6-612b91c35676 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:10.137473 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d3b6f897-9f95-4115-93d6-612b91c35676 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:10.137934 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d3b6f897-9f95-4115-93d6-612b91c35676 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:10.162150 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d3b6f897-9f95-4115-93d6-612b91c35676 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Going to try to stop instance {{(pid=126594) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 10 18:05:10.292985 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-aa4d4ceb-81a6-4fd0-acb2-db6015d9ddc1 tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] 10.222.0.35 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.470525 Jun 10 18:05:10.293654 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1202/2439] 10.222.0.35 () {60 vars in 1194 bytes} [Fri Jun 10 18:05:09 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:10.298344 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0017a025-e097-45c5-a424-2f92755c3577 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:10.299096 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0017a025-e097-45c5-a424-2f92755c3577 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:10.305384 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0017a025-e097-45c5-a424-2f92755c3577 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:10.305776 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0017a025-e097-45c5-a424-2f92755c3577 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:10.306538 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0017a025-e097-45c5-a424-2f92755c3577 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:10.306996 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0017a025-e097-45c5-a424-2f92755c3577 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:10.332814 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0017a025-e097-45c5-a424-2f92755c3577 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:05:10.349658 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d3b6f897-9f95-4115-93d6-612b91c35676 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "POST /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1/action" status: 202 len: 0 microversion: 2.1 time: 0.223119 Jun 10 18:05:10.350553 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1238/2440] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:05:10 2022] POST /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:05:10.366491 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-ab620ef5-3b11-4e05-ae71-3f554df53a9a req-fcc6930e-1fee-4118-b906-64de2d6bc9ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1a36d13-beb9-478b-b00f-94efeae1248b", "name": "network-vif-plugged", "status": "completed", "tag": "dd89a0eb-962f-4a1d-9233-8469a377029e"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:10.378138 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-ab620ef5-3b11-4e05-ae71-3f554df53a9a req-fcc6930e-1fee-4118-b906-64de2d6bc9ca service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:10.378785 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-ab620ef5-3b11-4e05-ae71-3f554df53a9a req-fcc6930e-1fee-4118-b906-64de2d6bc9ca service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:10.390489 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-ab620ef5-3b11-4e05-ae71-3f554df53a9a req-fcc6930e-1fee-4118-b906-64de2d6bc9ca service nova] Creating event network-vif-plugged:dd89a0eb-962f-4a1d-9233-8469a377029e for instance f1a36d13-beb9-478b-b00f-94efeae1248b on chh2-master-2 Jun 10 18:05:10.395640 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-ab620ef5-3b11-4e05-ae71-3f554df53a9a req-fcc6930e-1fee-4118-b906-64de2d6bc9ca service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043326 Jun 10 18:05:10.396225 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1239/2441] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:10.403385 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4ad42e69-1314-4ace-a636-cf747059ea0c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:10.405683 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4ad42e69-1314-4ace-a636-cf747059ea0c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:10.419721 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4ad42e69-1314-4ace-a636-cf747059ea0c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:10.420293 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4ad42e69-1314-4ace-a636-cf747059ea0c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:10.421179 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4ad42e69-1314-4ace-a636-cf747059ea0c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:10.421703 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4ad42e69-1314-4ace-a636-cf747059ea0c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:10.427240 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:05:10.644052 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4ad42e69-1314-4ace-a636-cf747059ea0c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:10.652577 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4ad42e69-1314-4ace-a636-cf747059ea0c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:10.654055 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4ad42e69-1314-4ace-a636-cf747059ea0c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:10.655185 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4ad42e69-1314-4ace-a636-cf747059ea0c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1281 microversion: 2.25 time: 0.257185 Jun 10 18:05:10.655733 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1240/2442] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:05:10 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1281 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:05:10.662877 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0017a025-e097-45c5-a424-2f92755c3577 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "DELETE /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 204 len: 0 microversion: 2.1 time: 0.367697 Jun 10 18:05:10.663829 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1203/2443] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:05:10 2022] DELETE /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:05:10.669689 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9d08d584-31f9-4096-a3e2-e9aa843dd4fd tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] Calling method '.version_select at 0x7f77c046b310>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:10.797637 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f33034a9-2e2c-48fe-8638-e104e1c99af1 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-560979862", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "5916f11b-5717-464f-b761-826564c4c17b"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:10.852457 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-f33034a9-2e2c-48fe-8638-e104e1c99af1 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] validate_networks() for [('5916f11b-5717-464f-b761-826564c4c17b', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:05:11.102719 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9d08d584-31f9-4096-a3e2-e9aa843dd4fd tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] 10.222.0.35 "DELETE /compute/v2.1/images/c975828a-b6d1-4ff4-961b-c380ea55cbd6/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.437358 Jun 10 18:05:11.103356 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1204/2444] 10.222.0.35 () {58 vars in 1295 bytes} [Fri Jun 10 18:05:10 2022] DELETE /compute/v2.1/images/c975828a-b6d1-4ff4-961b-c380ea55cbd6/metadata/os_version => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:05:11.107978 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6497c219-5557-42bc-97ab-c74e6f92d324 tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] Action: 'create', calling method: .version_select at 0x7f77c6108790>, body: {"security_group_rule": {"parent_group_id": "9180ee7a-9b82-4c28-a54e-c40a5f1693fa", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:11.196048 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-f33034a9-2e2c-48fe-8638-e104e1c99af1 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:05:11.196505 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-f33034a9-2e2c-48fe-8638-e104e1c99af1 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:05:11.196985 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-f33034a9-2e2c-48fe-8638-e104e1c99af1 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:05:11.197391 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-f33034a9-2e2c-48fe-8638-e104e1c99af1 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:05:11.197801 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-f33034a9-2e2c-48fe-8638-e104e1c99af1 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:05:11.206874 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f33034a9-2e2c-48fe-8638-e104e1c99af1 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:11.207335 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f33034a9-2e2c-48fe-8638-e104e1c99af1 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:11.208144 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f33034a9-2e2c-48fe-8638-e104e1c99af1 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:11.208623 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f33034a9-2e2c-48fe-8638-e104e1c99af1 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:11.226697 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-f33034a9-2e2c-48fe-8638-e104e1c99af1 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Getting quotas for project a02fbcda5546455ca6ba1533af1373df. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:05:11.231949 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-f33034a9-2e2c-48fe-8638-e104e1c99af1 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Getting quotas for user cdebe891ebac49128820e80cc5f2fca9 and project a02fbcda5546455ca6ba1533af1373df. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:05:11.244215 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f33034a9-2e2c-48fe-8638-e104e1c99af1 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:05:11.246510 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f33034a9-2e2c-48fe-8638-e104e1c99af1 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] [instance: 7928b35c-fde4-48c5-8068-a32c4395684b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:05:11.264985 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:05:11.404234 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f33034a9-2e2c-48fe-8638-e104e1c99af1 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.747260 Jun 10 18:05:11.404948 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1241/2445] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:05:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:05:11.409483 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-70db1971-01e1-4436-aa1b-a004fc3d9cc2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:11.410109 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-70db1971-01e1-4436-aa1b-a004fc3d9cc2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:11.417784 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-70db1971-01e1-4436-aa1b-a004fc3d9cc2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:11.418273 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-70db1971-01e1-4436-aa1b-a004fc3d9cc2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:11.419128 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-70db1971-01e1-4436-aa1b-a004fc3d9cc2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:11.419644 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-70db1971-01e1-4436-aa1b-a004fc3d9cc2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:11.512905 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6497c219-5557-42bc-97ab-c74e6f92d324 tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] 10.222.0.35 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.408373 Jun 10 18:05:11.513494 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1205/2446] 10.222.0.35 () {60 vars in 1194 bytes} [Fri Jun 10 18:05:11 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:11.524616 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-84f3d747-6006-4357-a792-5f07b95777b9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:11.525681 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-84f3d747-6006-4357-a792-5f07b95777b9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:11.532788 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-84f3d747-6006-4357-a792-5f07b95777b9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:11.533339 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-84f3d747-6006-4357-a792-5f07b95777b9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:11.534501 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-84f3d747-6006-4357-a792-5f07b95777b9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:11.534944 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-84f3d747-6006-4357-a792-5f07b95777b9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:11.572089 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-70db1971-01e1-4436-aa1b-a004fc3d9cc2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:11.579841 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-70db1971-01e1-4436-aa1b-a004fc3d9cc2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1678 microversion: 2.1 time: 0.173819 Jun 10 18:05:11.580657 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1242/2447] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:11 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:11.587907 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1a07de77-f693-4298-b596-47005f348478 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:11.588783 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1a07de77-f693-4298-b596-47005f348478 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 89b2f687-3173-411f-92fa-c2e4dde322f6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:11.595303 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1a07de77-f693-4298-b596-47005f348478 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:11.595958 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1a07de77-f693-4298-b596-47005f348478 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:11.596760 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1a07de77-f693-4298-b596-47005f348478 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:11.597198 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1a07de77-f693-4298-b596-47005f348478 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:11.610998 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-1a07de77-f693-4298-b596-47005f348478 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] HTTP exception thrown: Instance 89b2f687-3173-411f-92fa-c2e4dde322f6 could not be found. Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1a07de77-f693-4298-b596-47005f348478 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Request method failure captured: Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 HTTP/1.1 Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4Zy3r1pX7b3MtL_-NjN-zlRyjsPaJf9nUlwgEmvUs6EwjOw40qP9dbLbsHgij_gMl6uhbXl9nIlkqHmrWwww9dWms-7XOTEOvy9MdKMCvcMLYW-x2PIZ_wthjppQYWTgc0gmbBlQDA4e11wPRqBUoXg28RiqROpiqwC1wftTAJuO0M Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 66fd5e2ed0b84720849784c94f36d5da Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-MigrationsAdminTest-1164955500 Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/66fd5e2ed0b84720849784c94f36d5da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/66fd5e2ed0b84720849784c94f36d5da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/66fd5e2ed0b84720849784c94f36d5da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_66fd5e2ed0b84720849784c94f36d5da", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-MigrationsAdminTest-1164955500 Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 66fd5e2ed0b84720849784c94f36d5da Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-MigrationsAdminTest-1164955500 Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-MigrationsAdminTest-1164955500-project Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 1c74f45bf7fd4dea952d771a649519af Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-MigrationsAdminTest-1164955500-project Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 89b2f687-3173-411f-92fa-c2e4dde322f6 could not be found. Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '89b2f687-3173-411f-92fa-c2e4dde322f6'} Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89b2f687-3173-411f-92fa-c2e4dde322f6 could not be found. Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89b2f687-3173-411f-92fa-c2e4dde322f6 could not be found. Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:11.612703 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:11.618144 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:11.618144 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:11.618144 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:11.618144 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:05:11.618144 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:05:11.618144 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89b2f687-3173-411f-92fa-c2e4dde322f6 could not be found. Jun 10 18:05:11.618144 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:11.618144 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1a07de77-f693-4298-b596-47005f348478 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Returning 404 to user: Instance 89b2f687-3173-411f-92fa-c2e4dde322f6 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:05:11.618144 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1a07de77-f693-4298-b596-47005f348478 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6" status: 404 len: 111 microversion: 2.1 time: 0.032706 Jun 10 18:05:11.618144 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1243/2448] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:11 2022] GET /compute/v2.1/servers/89b2f687-3173-411f-92fa-c2e4dde322f6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:05:11.622439 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cd7d8a7e-e17c-41a6-8e80-ecc457321061 tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] Calling method '.version_select at 0x7f77b3f53dc0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:11.662484 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cd7d8a7e-e17c-41a6-8e80-ecc457321061 tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] 10.222.0.35 "GET /compute/v2.1/images/c975828a-b6d1-4ff4-961b-c380ea55cbd6/metadata" status: 200 len: 37 microversion: 2.1 time: 0.043490 Jun 10 18:05:11.663061 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1244/2449] 10.222.0.35 () {58 vars in 1259 bytes} [Fri Jun 10 18:05:11 2022] GET /compute/v2.1/images/c975828a-b6d1-4ff4-961b-c380ea55cbd6/metadata => generated 37 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:05:11.669076 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1e38a757-fd94-4756-ab44-eebe5da30672 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:11.669707 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1e38a757-fd94-4756-ab44-eebe5da30672 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: b6fe7ee7-fe32-4aa2-8616-784a199a4973] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:11.675960 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1e38a757-fd94-4756-ab44-eebe5da30672 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:11.676466 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1e38a757-fd94-4756-ab44-eebe5da30672 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:11.677244 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1e38a757-fd94-4756-ab44-eebe5da30672 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:11.677692 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1e38a757-fd94-4756-ab44-eebe5da30672 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:11.685414 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-84f3d747-6006-4357-a792-5f07b95777b9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:11.692883 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-84f3d747-6006-4357-a792-5f07b95777b9 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1499 microversion: 2.1 time: 0.172625 Jun 10 18:05:11.693445 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1206/2450] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:11 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1499 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:11.698506 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8af17ea5-2140-4d4e-93f0-58af4eaebcfc tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:11.699362 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8af17ea5-2140-4d4e-93f0-58af4eaebcfc tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] [instance: 7928b35c-fde4-48c5-8068-a32c4395684b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:11.754145 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8af17ea5-2140-4d4e-93f0-58af4eaebcfc tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebe891ebac49128820e80cc5f2fca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02fbcda5546455ca6ba1533af1373df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:11.761827 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8af17ea5-2140-4d4e-93f0-58af4eaebcfc tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] 10.222.0.35 "GET /compute/v2.1/servers/7928b35c-fde4-48c5-8068-a32c4395684b" status: 200 len: 1223 microversion: 2.1 time: 0.067240 Jun 10 18:05:11.762403 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1207/2451] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:11 2022] GET /compute/v2.1/servers/7928b35c-fde4-48c5-8068-a32c4395684b => generated 1223 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:11.771161 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e77d4cdb-5603-4309-bbd2-8275328216ab tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] Calling method '.version_select at 0x7f77c61089d0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:11.811580 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1e38a757-fd94-4756-ab44-eebe5da30672 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:11.818087 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e77d4cdb-5603-4309-bbd2-8275328216ab tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] 10.222.0.35 "GET /compute/v2.1/os-security-groups/9180ee7a-9b82-4c28-a54e-c40a5f1693fa" status: 200 len: 664 microversion: 2.1 time: 0.054626 Jun 10 18:05:11.821131 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1208/2452] 10.222.0.35 () {58 vars in 1268 bytes} [Fri Jun 10 18:05:11 2022] GET /compute/v2.1/os-security-groups/9180ee7a-9b82-4c28-a54e-c40a5f1693fa => generated 664 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:11.821270 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1e38a757-fd94-4756-ab44-eebe5da30672 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973" status: 200 len: 1502 microversion: 2.1 time: 0.155096 Jun 10 18:05:11.821270 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1245/2453] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:11 2022] GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973 => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:11.825095 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-433ec37b-e111-455d-a0ad-77b65ca24af7 tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] Action: 'update_all', calling method: .version_select at 0x7f77b3fb7820>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:11.833196 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b5d0a836-06d0-48d0-ab0d-c8b5f7c11084 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:11.833196 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b5d0a836-06d0-48d0-ab0d-c8b5f7c11084 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:11.840963 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5d0a836-06d0-48d0-ab0d-c8b5f7c11084 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:11.841419 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5d0a836-06d0-48d0-ab0d-c8b5f7c11084 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:11.842186 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5d0a836-06d0-48d0-ab0d-c8b5f7c11084 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:11.842624 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5d0a836-06d0-48d0-ab0d-c8b5f7c11084 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:11.871585 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b5d0a836-06d0-48d0-ab0d-c8b5f7c11084 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:05:11.877748 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-433ec37b-e111-455d-a0ad-77b65ca24af7 tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] Getting quotas for project 466403f0fb994f33866a5307f8f0bcca. Resources: dict_keys(['metadata_items']) {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:05:11.884065 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-433ec37b-e111-455d-a0ad-77b65ca24af7 tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] Getting quotas for user 1f1a86fb89e04fb6b3b46979f0b94064 and project 466403f0fb994f33866a5307f8f0bcca. Resources: dict_keys(['metadata_items']) {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:05:12.153953 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b5d0a836-06d0-48d0-ab0d-c8b5f7c11084 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "DELETE /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 204 len: 0 microversion: 2.1 time: 0.333950 Jun 10 18:05:12.154588 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1209/2454] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:05:11 2022] DELETE /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:05:12.160383 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ed313796-1d88-4658-9674-7db4e02e1126 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:12.162023 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ed313796-1d88-4658-9674-7db4e02e1126 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:12.167133 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ed313796-1d88-4658-9674-7db4e02e1126 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:12.167584 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ed313796-1d88-4658-9674-7db4e02e1126 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:12.168416 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ed313796-1d88-4658-9674-7db4e02e1126 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:12.168857 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ed313796-1d88-4658-9674-7db4e02e1126 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:12.295082 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-433ec37b-e111-455d-a0ad-77b65ca24af7 tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] 10.222.0.35 "PUT /compute/v2.1/images/c975828a-b6d1-4ff4-961b-c380ea55cbd6/metadata" status: 200 len: 61 microversion: 2.1 time: 0.473789 Jun 10 18:05:12.296003 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1246/2455] 10.222.0.35 () {60 vars in 1279 bytes} [Fri Jun 10 18:05:11 2022] PUT /compute/v2.1/images/c975828a-b6d1-4ff4-961b-c380ea55cbd6/metadata => generated 61 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:05:12.301142 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-aec799bf-aefd-4e25-81ed-3af8b3151099 tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] Calling method '.version_select at 0x7f77b3f99a60>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:12.311398 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ed313796-1d88-4658-9674-7db4e02e1126 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:12.321344 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ed313796-1d88-4658-9674-7db4e02e1126 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:12.322846 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ed313796-1d88-4658-9674-7db4e02e1126 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:12.324040 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ed313796-1d88-4658-9674-7db4e02e1126 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1281 microversion: 2.25 time: 0.168213 Jun 10 18:05:12.324673 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1210/2456] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:05:12 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1281 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:05:12.329744 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a9fd5ea1-cbc3-4448-8ac4-0d0328d3d7e1 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1448673100"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:12.330283 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a9fd5ea1-cbc3-4448-8ac4-0d0328d3d7e1 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: b6fe7ee7-fe32-4aa2-8616-784a199a4973] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:12.336389 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a9fd5ea1-cbc3-4448-8ac4-0d0328d3d7e1 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:12.336975 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a9fd5ea1-cbc3-4448-8ac4-0d0328d3d7e1 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:12.338129 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a9fd5ea1-cbc3-4448-8ac4-0d0328d3d7e1 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:12.338568 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a9fd5ea1-cbc3-4448-8ac4-0d0328d3d7e1 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:12.487587 chdv-master-2 devstack@n-api.service[126595]: INFO nova.network.security_group_api [None req-a9fd5ea1-cbc3-4448-8ac4-0d0328d3d7e1 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Adding security group b113cd95-ae25-426a-adf9-4331d6346d01 to port 58c69631-b12a-467a-a2c5-02827b6006bb Jun 10 18:05:12.604120 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-aec799bf-aefd-4e25-81ed-3af8b3151099 tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] 10.222.0.35 "DELETE /compute/v2.1/os-security-group-rules/b49db47b-ceb5-4ecc-8e59-4111b287734f" status: 202 len: 0 microversion: 2.1 time: 0.306610 Jun 10 18:05:12.606039 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1247/2457] 10.222.0.35 () {58 vars in 1286 bytes} [Fri Jun 10 18:05:12 2022] DELETE /compute/v2.1/os-security-group-rules/b49db47b-ceb5-4ecc-8e59-4111b287734f => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:05:12.614194 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6c921856-e804-414f-abc2-95bc7730611f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:12.615792 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6c921856-e804-414f-abc2-95bc7730611f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:12.634907 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6c921856-e804-414f-abc2-95bc7730611f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:12.635730 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6c921856-e804-414f-abc2-95bc7730611f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:12.636614 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6c921856-e804-414f-abc2-95bc7730611f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:12.637176 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6c921856-e804-414f-abc2-95bc7730611f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:12.817866 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6c921856-e804-414f-abc2-95bc7730611f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:12.825471 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6c921856-e804-414f-abc2-95bc7730611f tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1468 microversion: 2.1 time: 0.218426 Jun 10 18:05:12.826073 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1248/2458] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:12 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1468 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:12.831359 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3cfb15b3-ee21-4c02-a65b-6408bbf24190 tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] Calling method '.version_select at 0x7f77b3f93310>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:12.877596 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3cfb15b3-ee21-4c02-a65b-6408bbf24190 tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] 10.222.0.35 "GET /compute/v2.1/images/c975828a-b6d1-4ff4-961b-c380ea55cbd6/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.050332 Jun 10 18:05:12.880861 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1249/2459] 10.222.0.35 () {58 vars in 1289 bytes} [Fri Jun 10 18:05:12 2022] GET /compute/v2.1/images/c975828a-b6d1-4ff4-961b-c380ea55cbd6/metadata/os_distro => generated 33 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:05:12.888403 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cd68b181-b825-417a-b8d3-ae99f8528ce0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:12.889037 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cd68b181-b825-417a-b8d3-ae99f8528ce0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:12.895821 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cd68b181-b825-417a-b8d3-ae99f8528ce0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:12.896283 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cd68b181-b825-417a-b8d3-ae99f8528ce0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:12.897168 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cd68b181-b825-417a-b8d3-ae99f8528ce0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:12.898431 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cd68b181-b825-417a-b8d3-ae99f8528ce0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:12.930858 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a9fd5ea1-cbc3-4448-8ac4-0d0328d3d7e1 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "POST /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973/action" status: 202 len: 0 microversion: 2.1 time: 0.605127 Jun 10 18:05:12.931783 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1211/2460] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:05:12 2022] POST /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973/action => generated 0 bytes in 607 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:05:12.940370 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-92fd8a42-0701-4817-8633-97ed395aafd8 tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] Calling method '.version_select at 0x7f77c046b1f0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:13.323379 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-92fd8a42-0701-4817-8633-97ed395aafd8 tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] 10.222.0.35 "DELETE /compute/v2.1/os-security-groups/9180ee7a-9b82-4c28-a54e-c40a5f1693fa" status: 202 len: 0 microversion: 2.1 time: 0.390152 Jun 10 18:05:13.325679 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1212/2461] 10.222.0.35 () {58 vars in 1271 bytes} [Fri Jun 10 18:05:12 2022] DELETE /compute/v2.1/os-security-groups/9180ee7a-9b82-4c28-a54e-c40a5f1693fa => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:05:13.343752 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b7b726ad-2a06-457b-9a7b-066205b487e6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:13.343752 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b7b726ad-2a06-457b-9a7b-066205b487e6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:13.350726 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b7b726ad-2a06-457b-9a7b-066205b487e6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:13.351501 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b7b726ad-2a06-457b-9a7b-066205b487e6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:13.352643 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b7b726ad-2a06-457b-9a7b-066205b487e6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:13.353344 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b7b726ad-2a06-457b-9a7b-066205b487e6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:13.398817 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cd68b181-b825-417a-b8d3-ae99f8528ce0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:13.408150 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cd68b181-b825-417a-b8d3-ae99f8528ce0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1678 microversion: 2.1 time: 0.528533 Jun 10 18:05:13.409252 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1250/2462] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:12 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1678 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:13.414842 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7307b98e-0b86-4142-9510-84d1b3e6c03c tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:13.415594 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7307b98e-0b86-4142-9510-84d1b3e6c03c tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] [instance: 7928b35c-fde4-48c5-8068-a32c4395684b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:13.421888 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7307b98e-0b86-4142-9510-84d1b3e6c03c tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:13.429788 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7307b98e-0b86-4142-9510-84d1b3e6c03c tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:13.429788 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7307b98e-0b86-4142-9510-84d1b3e6c03c tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:13.429788 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7307b98e-0b86-4142-9510-84d1b3e6c03c tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:13.489151 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7307b98e-0b86-4142-9510-84d1b3e6c03c tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebe891ebac49128820e80cc5f2fca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02fbcda5546455ca6ba1533af1373df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:13.498117 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7307b98e-0b86-4142-9510-84d1b3e6c03c tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] 10.222.0.35 "GET /compute/v2.1/servers/7928b35c-fde4-48c5-8068-a32c4395684b" status: 200 len: 1275 microversion: 2.1 time: 0.087653 Jun 10 18:05:13.498975 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1251/2463] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:13 2022] GET /compute/v2.1/servers/7928b35c-fde4-48c5-8068-a32c4395684b => generated 1275 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:13.503785 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-100960c6-7c87-4125-b1e2-3a44a17e5904 tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] Action: 'update_all', calling method: .version_select at 0x7f77b3f1c0d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:13.519980 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b7b726ad-2a06-457b-9a7b-066205b487e6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:13.527618 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b7b726ad-2a06-457b-9a7b-066205b487e6 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 200 len: 1499 microversion: 2.1 time: 0.196370 Jun 10 18:05:13.528409 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1213/2464] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:13 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 1499 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:13.536706 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-536ea5d6-bb59-460a-80d1-2486f46ba6a6 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '.version_select at 0x7f77c0459430>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:13.553659 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-100960c6-7c87-4125-b1e2-3a44a17e5904 tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] Getting quotas for project 466403f0fb994f33866a5307f8f0bcca. Resources: dict_keys(['metadata_items']) {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:05:13.559574 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-100960c6-7c87-4125-b1e2-3a44a17e5904 tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] Getting quotas for user 1f1a86fb89e04fb6b3b46979f0b94064 and project 466403f0fb994f33866a5307f8f0bcca. Resources: dict_keys(['metadata_items']) {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:05:13.647974 chdv-master-2 devstack@n-api.service[126595]: DEBUG neutronclient.v2_0.client [None req-536ea5d6-bb59-460a-80d1-2486f46ba6a6 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group b113cd95-ae25-426a-adf9-4331d6346d01 in use.", "detail": ""}} {{(pid=126595) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 10 18:05:13.648722 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-536ea5d6-bb59-460a-80d1-2486f46ba6a6 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] HTTP exception thrown: Security Group b113cd95-ae25-426a-adf9-4331d6346d01 in use. Jun 10 18:05:13.648722 chdv-master-2 devstack@n-api.service[126595]: Neutron server returns request_ids: ['req-8c765803-0ceb-4af7-bdb3-723c83300f30'] Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-536ea5d6-bb59-460a-80d1-2486f46ba6a6 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Request method failure captured: Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/os-security-groups/b113cd95-ae25-426a-adf9-4331d6346d01 HTTP/1.1 Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4eKfGQZQ_jvhwHBxZ1GMnYHkMaBNBt7T8Ue90hW5x7BTDgkg2AiOfeu2huz2YQsnFH29P56VFWZd48_hROirge71TvR4QiKyTENHZz-D3t9ZS-m9216ej7Rjuw3slpnWYAQuE-KXkyXTlRqKM7yyNbBp9KRqjUFN-v2IWlTc7Yfat0 Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 304a5340852d4552a490e874dda8a0a3 Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_304a5340852d4552a490e874dda8a0a3", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 304a5340852d4552a490e874dda8a0a3 Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-SecurityGroupsTestJSON-732923421-project Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 7278ccddeee3495583093603a0fdb626 Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-SecurityGroupsTestJSON-732923421-project Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: exception: Security Group b113cd95-ae25-426a-adf9-4331d6346d01 in use. Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: Neutron server returns request_ids: ['req-8c765803-0ceb-4af7-bdb3-723c83300f30'] Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'b113cd95-ae25-426a-adf9-4331d6346d01'} Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 10 18:05:13.650774 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group b113cd95-ae25-426a-adf9-4331d6346d01 in use. Jun 10 18:05:13.655786 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c765803-0ceb-4af7-bdb3-723c83300f30'] Jun 10 18:05:13.655786 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:13.655786 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:13.655786 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:13.655786 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:13.655786 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jun 10 18:05:13.655786 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jun 10 18:05:13.655786 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jun 10 18:05:13.655786 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jun 10 18:05:13.655786 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group b113cd95-ae25-426a-adf9-4331d6346d01 in use. Jun 10 18:05:13.655786 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c765803-0ceb-4af7-bdb3-723c83300f30'] Jun 10 18:05:13.655786 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:13.655786 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:13.655786 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:13.655786 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:13.655786 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:13.655786 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:13.655786 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:05:13.655786 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:05:13.655786 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:05:13.655786 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:05:13.655786 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:05:13.655786 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:05:13.655786 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jun 10 18:05:13.655786 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 10 18:05:13.655786 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group b113cd95-ae25-426a-adf9-4331d6346d01 in use. Jun 10 18:05:13.655786 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c765803-0ceb-4af7-bdb3-723c83300f30'] Jun 10 18:05:13.655786 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:13.655786 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:13.655786 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:13.655786 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:13.655786 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:13.655786 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:13.655786 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:05:13.655786 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:05:13.655786 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group b113cd95-ae25-426a-adf9-4331d6346d01 in use. Jun 10 18:05:13.655786 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c765803-0ceb-4af7-bdb3-723c83300f30'] Jun 10 18:05:13.655786 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:13.655786 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-536ea5d6-bb59-460a-80d1-2486f46ba6a6 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Returning 400 to user: Security Group b113cd95-ae25-426a-adf9-4331d6346d01 in use. Jun 10 18:05:13.655786 chdv-master-2 devstack@n-api.service[126595]: Neutron server returns request_ids: ['req-8c765803-0ceb-4af7-bdb3-723c83300f30'] {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:05:13.655786 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-536ea5d6-bb59-460a-80d1-2486f46ba6a6 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "DELETE /compute/v2.1/os-security-groups/b113cd95-ae25-426a-adf9-4331d6346d01" status: 400 len: 185 microversion: 2.1 time: 0.123227 Jun 10 18:05:13.655786 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1214/2465] 10.222.0.35 () {58 vars in 1271 bytes} [Fri Jun 10 18:05:13 2022] DELETE /compute/v2.1/os-security-groups/b113cd95-ae25-426a-adf9-4331d6346d01 => generated 185 bytes in 124 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:05:13.663797 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-e309bfa5-396e-40b3-9d61-1c4119606e40 req-bdc7303f-2f90-402d-8bfb-e09bb39bcc4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6fe7ee7-fe32-4aa2-8616-784a199a4973", "tag": "58c69631-b12a-467a-a2c5-02827b6006bb"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:13.674716 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-e309bfa5-396e-40b3-9d61-1c4119606e40 req-bdc7303f-2f90-402d-8bfb-e09bb39bcc4e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:13.675169 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-e309bfa5-396e-40b3-9d61-1c4119606e40 req-bdc7303f-2f90-402d-8bfb-e09bb39bcc4e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:13.688462 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-e309bfa5-396e-40b3-9d61-1c4119606e40 req-bdc7303f-2f90-402d-8bfb-e09bb39bcc4e service nova] Creating event network-changed:58c69631-b12a-467a-a2c5-02827b6006bb for instance b6fe7ee7-fe32-4aa2-8616-784a199a4973 on chh2-master-2 Jun 10 18:05:13.693963 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-e309bfa5-396e-40b3-9d61-1c4119606e40 req-bdc7303f-2f90-402d-8bfb-e09bb39bcc4e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035450 Jun 10 18:05:13.695489 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1215/2466] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:13.702915 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c2fa158e-4009-4ab5-a190-73c0f83fe1c5 tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] Calling method '.version_select at 0x7f77c1690790>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:13.730423 chdv-master-2 devstack@n-api.service[126595]: DEBUG neutronclient.v2_0.client [None req-c2fa158e-4009-4ab5-a190-73c0f83fe1c5 tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9160160f-984c-46b4-ba66-57e186bcee43 does not exist", "detail": ""}} {{(pid=126595) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 10 18:05:13.730423 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.security_group_api [None req-c2fa158e-4009-4ab5-a190-73c0f83fe1c5 tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] Neutron security group 9160160f-984c-46b4-ba66-57e186bcee43 not found {{(pid=126595) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 10 18:05:13.730785 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-c2fa158e-4009-4ab5-a190-73c0f83fe1c5 tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] HTTP exception thrown: Security group 9160160f-984c-46b4-ba66-57e186bcee43 does not exist Jun 10 18:05:13.730785 chdv-master-2 devstack@n-api.service[126595]: Neutron server returns request_ids: ['req-3ec080ae-6835-43ee-a8b4-baf551785184'] Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c2fa158e-4009-4ab5-a190-73c0f83fe1c5 tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] Request method failure captured: Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/os-security-groups/9160160f-984c-46b4-ba66-57e186bcee43 HTTP/1.1 Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4fK1oSQYvxNIdr3a3YibZp4nd5vV5y5q5wTsEb8o_1qTUw3-OvjNgNErPss7JeIGBQuGq6B3aMnTEsTJGoVXhYcond0sqrthQijvaJbBm8_R3oQgeduM2HKt59PjI7Is31g0s1aAKzqnT7oI3s3W3yQrW0L5cGcuqVh3dxwkt4uLdU Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 6e5dcd255bff4acc8956021c255dca68 Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-319715108 Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/6e5dcd255bff4acc8956021c255dca68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/6e5dcd255bff4acc8956021c255dca68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/6e5dcd255bff4acc8956021c255dca68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_6e5dcd255bff4acc8956021c255dca68", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-SecurityGroupRulesTestJSON-319715108 Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 6e5dcd255bff4acc8956021c255dca68 Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-319715108 Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-SecurityGroupRulesTestJSON-319715108-project Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 2319408a87a144a4b0b5de2f24814c4c Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-SecurityGroupRulesTestJSON-319715108-project Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: exception: Security group 9160160f-984c-46b4-ba66-57e186bcee43 does not exist Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: Neutron server returns request_ids: ['req-3ec080ae-6835-43ee-a8b4-baf551785184'] Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '9160160f-984c-46b4-ba66-57e186bcee43'} Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 10 18:05:13.732911 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9160160f-984c-46b4-ba66-57e186bcee43 does not exist Jun 10 18:05:13.737230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ec080ae-6835-43ee-a8b4-baf551785184'] Jun 10 18:05:13.737230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:13.737230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:13.737230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:13.737230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:13.737230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 10 18:05:13.737230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 10 18:05:13.737230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 10 18:05:13.737230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 10 18:05:13.737230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9160160f-984c-46b4-ba66-57e186bcee43 does not exist Jun 10 18:05:13.737230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ec080ae-6835-43ee-a8b4-baf551785184'] Jun 10 18:05:13.737230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:13.737230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:13.737230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:13.737230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:13.737230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:13.737230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:13.737230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:05:13.737230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:05:13.737230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:05:13.737230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:05:13.737230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:05:13.737230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:05:13.737230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 10 18:05:13.737230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 10 18:05:13.737230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9160160f-984c-46b4-ba66-57e186bcee43 does not exist Jun 10 18:05:13.737230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ec080ae-6835-43ee-a8b4-baf551785184'] Jun 10 18:05:13.737230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:13.737230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:13.737230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:13.737230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:13.737230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:13.737230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:13.737230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:05:13.737230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:05:13.737230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9160160f-984c-46b4-ba66-57e186bcee43 does not exist Jun 10 18:05:13.737230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ec080ae-6835-43ee-a8b4-baf551785184'] Jun 10 18:05:13.737230 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:13.737230 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c2fa158e-4009-4ab5-a190-73c0f83fe1c5 tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] Returning 404 to user: Security group 9160160f-984c-46b4-ba66-57e186bcee43 does not exist Jun 10 18:05:13.737230 chdv-master-2 devstack@n-api.service[126595]: Neutron server returns request_ids: ['req-3ec080ae-6835-43ee-a8b4-baf551785184'] {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:05:13.737230 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c2fa158e-4009-4ab5-a190-73c0f83fe1c5 tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] 10.222.0.35 "DELETE /compute/v2.1/os-security-groups/9160160f-984c-46b4-ba66-57e186bcee43" status: 404 len: 194 microversion: 2.1 time: 0.037904 Jun 10 18:05:13.737230 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1216/2467] 10.222.0.35 () {58 vars in 1271 bytes} [Fri Jun 10 18:05:13 2022] DELETE /compute/v2.1/os-security-groups/9160160f-984c-46b4-ba66-57e186bcee43 => generated 194 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:05:13.743326 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a61e757b-78c0-45e6-9d64-549d60fb9f49 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:13.744385 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a61e757b-78c0-45e6-9d64-549d60fb9f49 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:13.753566 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a61e757b-78c0-45e6-9d64-549d60fb9f49 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:13.754285 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a61e757b-78c0-45e6-9d64-549d60fb9f49 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:13.754907 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a61e757b-78c0-45e6-9d64-549d60fb9f49 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:13.755352 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a61e757b-78c0-45e6-9d64-549d60fb9f49 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:13.863772 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-100960c6-7c87-4125-b1e2-3a44a17e5904 tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] 10.222.0.35 "PUT /compute/v2.1/images/c975828a-b6d1-4ff4-961b-c380ea55cbd6/metadata" status: 200 len: 61 microversion: 2.1 time: 0.363449 Jun 10 18:05:13.865151 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1252/2468] 10.222.0.35 () {60 vars in 1279 bytes} [Fri Jun 10 18:05:13 2022] PUT /compute/v2.1/images/c975828a-b6d1-4ff4-961b-c380ea55cbd6/metadata => generated 61 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:05:13.872953 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c74f6cb0-b755-4ac0-b228-dd3d65e54d84 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:13.874010 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c74f6cb0-b755-4ac0-b228-dd3d65e54d84 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: b6fe7ee7-fe32-4aa2-8616-784a199a4973] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:13.888675 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c74f6cb0-b755-4ac0-b228-dd3d65e54d84 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:13.889236 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c74f6cb0-b755-4ac0-b228-dd3d65e54d84 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:13.890263 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c74f6cb0-b755-4ac0-b228-dd3d65e54d84 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:13.891389 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c74f6cb0-b755-4ac0-b228-dd3d65e54d84 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:14.027134 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a61e757b-78c0-45e6-9d64-549d60fb9f49 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:14.036597 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a61e757b-78c0-45e6-9d64-549d60fb9f49 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:14.038116 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a61e757b-78c0-45e6-9d64-549d60fb9f49 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:14.039307 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a61e757b-78c0-45e6-9d64-549d60fb9f49 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1478 microversion: 2.25 time: 0.300364 Jun 10 18:05:14.040704 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1217/2469] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:05:13 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1478 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:05:14.045526 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5264812c-b2e3-4bbe-bf2f-7294e63c49bb tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] Calling method '.version_select at 0x7f77c04191f0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:14.191070 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c74f6cb0-b755-4ac0-b228-dd3d65e54d84 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "POST /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973/action" status: 202 len: 0 microversion: 2.1 time: 0.324063 Jun 10 18:05:14.197196 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1253/2470] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:05:13 2022] POST /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:05:14.207699 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-af2d0620-2215-4125-a111-f7944e046ef1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:14.208823 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-af2d0620-2215-4125-a111-f7944e046ef1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:14.228038 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-af2d0620-2215-4125-a111-f7944e046ef1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:14.229222 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-af2d0620-2215-4125-a111-f7944e046ef1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:14.229976 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-af2d0620-2215-4125-a111-f7944e046ef1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:14.230414 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-af2d0620-2215-4125-a111-f7944e046ef1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:14.389357 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-af2d0620-2215-4125-a111-f7944e046ef1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:14.406004 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-af2d0620-2215-4125-a111-f7944e046ef1 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1468 microversion: 2.1 time: 0.207048 Jun 10 18:05:14.406725 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1254/2471] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:14 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1468 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:14.411619 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6ec8d1ae-f64b-48e7-939f-1f4506096bc4 tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] Calling method '.version_select at 0x7f77c0090e50>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:14.467464 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6ec8d1ae-f64b-48e7-939f-1f4506096bc4 tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] 10.222.0.35 "GET /compute/v2.1/images/c975828a-b6d1-4ff4-961b-c380ea55cbd6/metadata" status: 200 len: 61 microversion: 2.1 time: 0.058568 Jun 10 18:05:14.474073 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1255/2472] 10.222.0.35 () {58 vars in 1259 bytes} [Fri Jun 10 18:05:14 2022] GET /compute/v2.1/images/c975828a-b6d1-4ff4-961b-c380ea55cbd6/metadata => generated 61 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:05:14.603969 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e14775cc-7824-48cb-bc99-b9ee0d8b3eae tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:14.604858 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e14775cc-7824-48cb-bc99-b9ee0d8b3eae tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:14.611026 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e14775cc-7824-48cb-bc99-b9ee0d8b3eae tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:14.611466 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e14775cc-7824-48cb-bc99-b9ee0d8b3eae tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:14.612361 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e14775cc-7824-48cb-bc99-b9ee0d8b3eae tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:14.612995 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e14775cc-7824-48cb-bc99-b9ee0d8b3eae tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:14.765111 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-e14775cc-7824-48cb-bc99-b9ee0d8b3eae tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lazy-loading 'services' on Instance uuid f1a36d13-beb9-478b-b00f-94efeae1248b {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:05:14.779046 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e14775cc-7824-48cb-bc99-b9ee0d8b3eae tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1971 microversion: 2.25 time: 0.303816 Jun 10 18:05:14.779965 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1256/2473] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:05:14 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1971 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:05:14.784511 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-c8492d5b-a081-4641-bb3d-838fefda2f4c req-b0665d54-1efc-4a9b-9ea4-42545592b1de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d", "name": "network-vif-deleted", "tag": "f0ba52c3-5bcd-42ef-b82a-a280afc864bc"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:14.793491 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-c8492d5b-a081-4641-bb3d-838fefda2f4c req-b0665d54-1efc-4a9b-9ea4-42545592b1de service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:14.793950 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-c8492d5b-a081-4641-bb3d-838fefda2f4c req-b0665d54-1efc-4a9b-9ea4-42545592b1de service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:14.805054 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-c8492d5b-a081-4641-bb3d-838fefda2f4c req-b0665d54-1efc-4a9b-9ea4-42545592b1de service nova] Creating event network-vif-deleted:f0ba52c3-5bcd-42ef-b82a-a280afc864bc for instance a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d on chh2-master-2 Jun 10 18:05:14.810147 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-c8492d5b-a081-4641-bb3d-838fefda2f4c req-b0665d54-1efc-4a9b-9ea4-42545592b1de service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028946 Jun 10 18:05:14.811143 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1257/2474] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:14.816705 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6f3c02be-ec21-446c-aa40-2428d0207ec7 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:14.817519 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6f3c02be-ec21-446c-aa40-2428d0207ec7 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: b6fe7ee7-fe32-4aa2-8616-784a199a4973] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:14.824399 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6f3c02be-ec21-446c-aa40-2428d0207ec7 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:14.829270 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6f3c02be-ec21-446c-aa40-2428d0207ec7 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:14.829270 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6f3c02be-ec21-446c-aa40-2428d0207ec7 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:14.829270 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6f3c02be-ec21-446c-aa40-2428d0207ec7 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:14.995950 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5264812c-b2e3-4bbe-bf2f-7294e63c49bb tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] 10.222.0.35 "DELETE /compute/v2.1/os-security-groups/de7e4b5b-d1b9-490c-ad8e-41f973ff9412" status: 202 len: 0 microversion: 2.1 time: 0.953720 Jun 10 18:05:14.999505 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6f3c02be-ec21-446c-aa40-2428d0207ec7 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:15.000055 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1218/2475] 10.222.0.35 () {58 vars in 1271 bytes} [Fri Jun 10 18:05:14 2022] DELETE /compute/v2.1/os-security-groups/de7e4b5b-d1b9-490c-ad8e-41f973ff9412 => generated 0 bytes in 955 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:05:15.004393 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1e1126fb-ce94-423a-a9a6-1b741c2aaeb2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:15.005204 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1e1126fb-ce94-423a-a9a6-1b741c2aaeb2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:15.007802 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6f3c02be-ec21-446c-aa40-2428d0207ec7 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973" status: 200 len: 1573 microversion: 2.1 time: 0.195372 Jun 10 18:05:15.008998 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1258/2476] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:14 2022] GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973 => generated 1573 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:15.013746 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4c98e9b4-f248-453e-876f-00a42e53b9b6 tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] Action: 'update_all', calling method: .version_select at 0x7f77b3f1caf0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:15.023488 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1e1126fb-ce94-423a-a9a6-1b741c2aaeb2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:15.024197 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1e1126fb-ce94-423a-a9a6-1b741c2aaeb2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:15.025238 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1e1126fb-ce94-423a-a9a6-1b741c2aaeb2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:15.025932 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1e1126fb-ce94-423a-a9a6-1b741c2aaeb2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:15.033252 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:05:15.095430 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-4c98e9b4-f248-453e-876f-00a42e53b9b6 tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] Getting quotas for project 466403f0fb994f33866a5307f8f0bcca. Resources: dict_keys(['metadata_items']) {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:05:15.101819 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-4c98e9b4-f248-453e-876f-00a42e53b9b6 tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] Getting quotas for user 1f1a86fb89e04fb6b3b46979f0b94064 and project 466403f0fb994f33866a5307f8f0bcca. Resources: dict_keys(['metadata_items']) {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:05:15.365846 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4c98e9b4-f248-453e-876f-00a42e53b9b6 tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] 10.222.0.35 "PUT /compute/v2.1/images/c975828a-b6d1-4ff4-961b-c380ea55cbd6/metadata" status: 200 len: 61 microversion: 2.1 time: 0.355671 Jun 10 18:05:15.370605 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1259/2477] 10.222.0.35 () {60 vars in 1279 bytes} [Fri Jun 10 18:05:15 2022] PUT /compute/v2.1/images/c975828a-b6d1-4ff4-961b-c380ea55cbd6/metadata => generated 61 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:05:15.375615 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e4ed280f-09b5-4cdc-9923-47d0f4d735ae tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:15.376239 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e4ed280f-09b5-4cdc-9923-47d0f4d735ae tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] [instance: 7928b35c-fde4-48c5-8068-a32c4395684b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:15.384502 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e4ed280f-09b5-4cdc-9923-47d0f4d735ae tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:15.388356 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e4ed280f-09b5-4cdc-9923-47d0f4d735ae tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:15.388356 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e4ed280f-09b5-4cdc-9923-47d0f4d735ae tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:15.388356 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e4ed280f-09b5-4cdc-9923-47d0f4d735ae tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:15.456253 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e4ed280f-09b5-4cdc-9923-47d0f4d735ae tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebe891ebac49128820e80cc5f2fca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02fbcda5546455ca6ba1533af1373df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:15.464813 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e4ed280f-09b5-4cdc-9923-47d0f4d735ae tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] 10.222.0.35 "GET /compute/v2.1/servers/7928b35c-fde4-48c5-8068-a32c4395684b" status: 200 len: 1281 microversion: 2.1 time: 0.093139 Jun 10 18:05:15.465403 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1260/2478] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:15 2022] GET /compute/v2.1/servers/7928b35c-fde4-48c5-8068-a32c4395684b => generated 1281 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:15.469920 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-18d9bf5a-4f2a-4066-9e89-e3a8f47dd9c7 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:15.470520 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-18d9bf5a-4f2a-4066-9e89-e3a8f47dd9c7 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:15.479868 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-18d9bf5a-4f2a-4066-9e89-e3a8f47dd9c7 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:15.480342 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-18d9bf5a-4f2a-4066-9e89-e3a8f47dd9c7 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:15.481152 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-18d9bf5a-4f2a-4066-9e89-e3a8f47dd9c7 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:15.481593 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-18d9bf5a-4f2a-4066-9e89-e3a8f47dd9c7 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:15.497011 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-18d9bf5a-4f2a-4066-9e89-e3a8f47dd9c7 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] HTTP exception thrown: Instance a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d could not be found. Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-18d9bf5a-4f2a-4066-9e89-e3a8f47dd9c7 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Request method failure captured: Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d HTTP/1.1 Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4Z1ErqekzqbT7WRsjkgkcIzOI_kHmS-v_gvh4SRJ2CMh-NfkzhIoAtBfjl57mQ3Zi2c8A0N4Q1ae1LCxXwPlP907CgwMHpQ3m2O1zE3NlaVYvIAW686XQfO0IP3gUnl9nQpF0XYTmOfelRJZNyQoLoHq3yZptXhyCu_RxXmqZPldSo Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: c96da7ef0cbc46b594ec327ddf875f7a Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-LiveMigrationTest-1635373537 Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/c96da7ef0cbc46b594ec327ddf875f7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c96da7ef0cbc46b594ec327ddf875f7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c96da7ef0cbc46b594ec327ddf875f7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_c96da7ef0cbc46b594ec327ddf875f7a", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-LiveMigrationTest-1635373537 Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: c96da7ef0cbc46b594ec327ddf875f7a Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-LiveMigrationTest-1635373537 Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-LiveMigrationTest-1635373537-project Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: d0f741e8506743a8b51251b3019b3ad5 Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-LiveMigrationTest-1635373537-project Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: exception: Instance a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d could not be found. Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d'} Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d could not be found. Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d could not be found. Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:15.498634 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:15.508116 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:15.508116 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:15.508116 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:15.508116 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:05:15.508116 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:05:15.508116 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d could not be found. Jun 10 18:05:15.508116 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:15.508116 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-18d9bf5a-4f2a-4066-9e89-e3a8f47dd9c7 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Returning 404 to user: Instance a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:05:15.508116 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-18d9bf5a-4f2a-4066-9e89-e3a8f47dd9c7 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d" status: 404 len: 111 microversion: 2.1 time: 0.033756 Jun 10 18:05:15.508116 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1261/2479] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:15 2022] GET /compute/v2.1/servers/a5d72d30-0770-4ad8-8a6f-2b222eaf4e7d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:05:15.508116 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-886b8c71-2e4a-417e-9839-d84f5e222e4a tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:15.508116 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-886b8c71-2e4a-417e-9839-d84f5e222e4a tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:15.514357 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-886b8c71-2e4a-417e-9839-d84f5e222e4a tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:15.514810 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-886b8c71-2e4a-417e-9839-d84f5e222e4a tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:15.515578 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-886b8c71-2e4a-417e-9839-d84f5e222e4a tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:15.516012 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-886b8c71-2e4a-417e-9839-d84f5e222e4a tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:15.687010 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-886b8c71-2e4a-417e-9839-d84f5e222e4a tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lazy-loading 'services' on Instance uuid f1a36d13-beb9-478b-b00f-94efeae1248b {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:05:15.689446 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-886b8c71-2e4a-417e-9839-d84f5e222e4a tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1971 microversion: 2.25 time: 0.187842 Jun 10 18:05:15.690439 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1262/2480] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:05:15 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1971 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:05:15.696397 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0c63428d-4793-41f2-95fa-3785b84ecbe6 tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] Calling method '.version_select at 0x7f77c0090a60>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:15.708376 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1e1126fb-ce94-423a-a9a6-1b741c2aaeb2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:15.717434 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1e1126fb-ce94-423a-a9a6-1b741c2aaeb2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1678 microversion: 2.1 time: 0.719034 Jun 10 18:05:15.718116 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1219/2481] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:14 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1678 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:15.728714 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-81e6109c-5348-4c3d-b650-62c9bf72ec42 tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] Action: 'update_all', calling method: .version_select at 0x7f77c610c8b0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:15.784825 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-81e6109c-5348-4c3d-b650-62c9bf72ec42 tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] Getting quotas for project 466403f0fb994f33866a5307f8f0bcca. Resources: dict_keys(['metadata_items']) {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:05:15.791265 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-81e6109c-5348-4c3d-b650-62c9bf72ec42 tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] Getting quotas for user 1f1a86fb89e04fb6b3b46979f0b94064 and project 466403f0fb994f33866a5307f8f0bcca. Resources: dict_keys(['metadata_items']) {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:05:16.088789 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0c63428d-4793-41f2-95fa-3785b84ecbe6 tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] 10.222.0.35 "DELETE /compute/v2.1/os-security-groups/5cfeb40d-f568-4c71-b533-534334f273b3" status: 202 len: 0 microversion: 2.1 time: 0.394849 Jun 10 18:05:16.096333 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1263/2482] 10.222.0.35 () {58 vars in 1271 bytes} [Fri Jun 10 18:05:15 2022] DELETE /compute/v2.1/os-security-groups/5cfeb40d-f568-4c71-b533-534334f273b3 => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:05:16.102130 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5672da0d-9821-434a-b33e-a9121b036093 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:16.102745 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5672da0d-9821-434a-b33e-a9121b036093 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:16.122381 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5672da0d-9821-434a-b33e-a9121b036093 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:16.129721 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5672da0d-9821-434a-b33e-a9121b036093 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:16.130843 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5672da0d-9821-434a-b33e-a9121b036093 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:16.138084 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5672da0d-9821-434a-b33e-a9121b036093 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:16.205354 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5672da0d-9821-434a-b33e-a9121b036093 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c74f45bf7fd4dea952d771a649519af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66fd5e2ed0b84720849784c94f36d5da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:16.214034 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5672da0d-9821-434a-b33e-a9121b036093 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 200 len: 1426 microversion: 2.1 time: 0.116564 Jun 10 18:05:16.217243 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1264/2483] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:16 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 1426 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:16.219384 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b0cd48ab-500c-4dc5-b8b6-db8530099926 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:16.219991 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b0cd48ab-500c-4dc5-b8b6-db8530099926 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:16.226363 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b0cd48ab-500c-4dc5-b8b6-db8530099926 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:16.226813 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b0cd48ab-500c-4dc5-b8b6-db8530099926 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:16.227581 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b0cd48ab-500c-4dc5-b8b6-db8530099926 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:16.228014 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b0cd48ab-500c-4dc5-b8b6-db8530099926 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:16.253937 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b0cd48ab-500c-4dc5-b8b6-db8530099926 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:05:16.256833 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:05:16.332881 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-81e6109c-5348-4c3d-b650-62c9bf72ec42 tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] 10.222.0.35 "PUT /compute/v2.1/images/c975828a-b6d1-4ff4-961b-c380ea55cbd6/metadata" status: 200 len: 64 microversion: 2.1 time: 0.613293 Jun 10 18:05:16.333765 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1220/2484] 10.222.0.35 () {60 vars in 1279 bytes} [Fri Jun 10 18:05:15 2022] PUT /compute/v2.1/images/c975828a-b6d1-4ff4-961b-c380ea55cbd6/metadata => generated 64 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:05:16.339721 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b290699c-9d4e-430f-96f8-1957f18dc726 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:16.341120 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:05:16.341120 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 18:05:16.342354 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b290699c-9d4e-430f-96f8-1957f18dc726 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:16.343036 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b290699c-9d4e-430f-96f8-1957f18dc726 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:16.343853 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b290699c-9d4e-430f-96f8-1957f18dc726 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:16.344296 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b290699c-9d4e-430f-96f8-1957f18dc726 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:16.370493 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b290699c-9d4e-430f-96f8-1957f18dc726 tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] 10.222.0.35 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.035406 Jun 10 18:05:16.371239 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1221/2485] 10.222.0.35 () {60 vars in 1216 bytes} [Fri Jun 10 18:05:16 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:05:16.375601 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-fdb396f2-4669-46ab-b61e-01aa4a61b13d req-ca430d75-30f9-4bea-9385-b04ad73098f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f344351-d882-4028-98db-751266b3d74d", "name": "network-vif-deleted", "tag": "7a719916-3937-4cb7-b0d4-e5842975b4c3"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:16.387742 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-fdb396f2-4669-46ab-b61e-01aa4a61b13d req-ca430d75-30f9-4bea-9385-b04ad73098f8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:16.388209 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-fdb396f2-4669-46ab-b61e-01aa4a61b13d req-ca430d75-30f9-4bea-9385-b04ad73098f8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:16.403324 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-fdb396f2-4669-46ab-b61e-01aa4a61b13d req-ca430d75-30f9-4bea-9385-b04ad73098f8 service nova] Creating event network-vif-deleted:7a719916-3937-4cb7-b0d4-e5842975b4c3 for instance 2f344351-d882-4028-98db-751266b3d74d on chh2-master-2 Jun 10 18:05:16.413094 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-fdb396f2-4669-46ab-b61e-01aa4a61b13d req-ca430d75-30f9-4bea-9385-b04ad73098f8 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035812 Jun 10 18:05:16.413094 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1222/2486] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:16.413679 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-49ee218c-db62-4e6b-b313-49412cc43305 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:16.415389 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-49ee218c-db62-4e6b-b313-49412cc43305 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: b6fe7ee7-fe32-4aa2-8616-784a199a4973] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:16.422521 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-49ee218c-db62-4e6b-b313-49412cc43305 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:16.423009 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-49ee218c-db62-4e6b-b313-49412cc43305 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:16.423759 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-49ee218c-db62-4e6b-b313-49412cc43305 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:16.424199 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-49ee218c-db62-4e6b-b313-49412cc43305 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:16.578862 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b0cd48ab-500c-4dc5-b8b6-db8530099926 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "DELETE /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd" status: 204 len: 0 microversion: 2.1 time: 0.358804 Jun 10 18:05:16.578862 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1265/2487] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:05:16 2022] DELETE /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:05:16.582430 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-aa981fd8-0888-49b7-b933-30a580bc9ed3 tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] Calling method '.version_select at 0x7f77c0056dc0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:16.720883 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-49ee218c-db62-4e6b-b313-49412cc43305 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:16.745778 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-49ee218c-db62-4e6b-b313-49412cc43305 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973" status: 200 len: 1573 microversion: 2.1 time: 0.335451 Jun 10 18:05:16.763113 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1223/2488] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:16 2022] GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973 => generated 1573 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:16.763113 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-40da7a74-feb9-437f-8585-b2c30237e108 tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] Calling method '.version_select at 0x7f77c03b28b0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:16.802799 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-40da7a74-feb9-437f-8585-b2c30237e108 tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] 10.222.0.35 "GET /compute/v2.1/images/c975828a-b6d1-4ff4-961b-c380ea55cbd6/metadata" status: 200 len: 64 microversion: 2.1 time: 0.046100 Jun 10 18:05:16.803375 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1224/2489] 10.222.0.35 () {58 vars in 1259 bytes} [Fri Jun 10 18:05:16 2022] GET /compute/v2.1/images/c975828a-b6d1-4ff4-961b-c380ea55cbd6/metadata => generated 64 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:05:16.808753 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ff4b95ab-d586-400b-a72c-290c898f259a tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "chh1-master-2", "block_migration": "auto"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:16.810188 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ff4b95ab-d586-400b-a72c-290c898f259a tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:16.816665 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ff4b95ab-d586-400b-a72c-290c898f259a tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:16.817115 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ff4b95ab-d586-400b-a72c-290c898f259a tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:16.817885 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ff4b95ab-d586-400b-a72c-290c898f259a tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:16.818320 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ff4b95ab-d586-400b-a72c-290c898f259a tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:16.839243 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-aa981fd8-0888-49b7-b933-30a580bc9ed3 tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] 10.222.0.35 "DELETE /compute/v2.1/os-security-groups/9f6bc52f-8506-46c8-9aa1-52f61089f7d2" status: 202 len: 0 microversion: 2.1 time: 0.261504 Jun 10 18:05:16.843861 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1266/2490] 10.222.0.35 () {58 vars in 1271 bytes} [Fri Jun 10 18:05:16 2022] DELETE /compute/v2.1/os-security-groups/9f6bc52f-8506-46c8-9aa1-52f61089f7d2 => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:05:16.844398 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-ff4b95ab-d586-400b-a72c-290c898f259a tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lazy-loading 'flavor' on Instance uuid f1a36d13-beb9-478b-b00f-94efeae1248b {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:05:16.849290 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8b9d9604-83f7-4a25-860a-9ca4fe10472d tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:16.854775 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8b9d9604-83f7-4a25-860a-9ca4fe10472d tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] [instance: 7928b35c-fde4-48c5-8068-a32c4395684b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:16.859621 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ff4b95ab-d586-400b-a72c-290c898f259a tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Going to try to live migrate instance to chh1-master-2 {{(pid=126595) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 10 18:05:16.860074 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8b9d9604-83f7-4a25-860a-9ca4fe10472d tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:16.860784 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8b9d9604-83f7-4a25-860a-9ca4fe10472d tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:16.861566 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8b9d9604-83f7-4a25-860a-9ca4fe10472d tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:16.862011 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8b9d9604-83f7-4a25-860a-9ca4fe10472d tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:17.005087 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8b9d9604-83f7-4a25-860a-9ca4fe10472d tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebe891ebac49128820e80cc5f2fca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02fbcda5546455ca6ba1533af1373df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:17.012566 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8b9d9604-83f7-4a25-860a-9ca4fe10472d tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] 10.222.0.35 "GET /compute/v2.1/servers/7928b35c-fde4-48c5-8068-a32c4395684b" status: 200 len: 1323 microversion: 2.1 time: 0.167184 Jun 10 18:05:17.021814 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1267/2491] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:16 2022] GET /compute/v2.1/servers/7928b35c-fde4-48c5-8068-a32c4395684b => generated 1323 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:17.021814 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ec41a6d5-f1b7-4f58-b353-651e5e801abc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:17.021814 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ec41a6d5-f1b7-4f58-b353-651e5e801abc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:17.024298 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec41a6d5-f1b7-4f58-b353-651e5e801abc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:17.024787 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec41a6d5-f1b7-4f58-b353-651e5e801abc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:17.025589 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec41a6d5-f1b7-4f58-b353-651e5e801abc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:17.026009 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec41a6d5-f1b7-4f58-b353-651e5e801abc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:17.168450 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ec41a6d5-f1b7-4f58-b353-651e5e801abc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:17.175683 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ec41a6d5-f1b7-4f58-b353-651e5e801abc tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd" status: 200 len: 1484 microversion: 2.1 time: 0.161511 Jun 10 18:05:17.176244 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1268/2492] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:17 2022] GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd => generated 1484 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:17.181893 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0e4c46b7-8e1f-432a-a5eb-a5c0ed6d7f61 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:17.183003 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0e4c46b7-8e1f-432a-a5eb-a5c0ed6d7f61 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:17.189526 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0e4c46b7-8e1f-432a-a5eb-a5c0ed6d7f61 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:17.189987 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0e4c46b7-8e1f-432a-a5eb-a5c0ed6d7f61 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:17.191358 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0e4c46b7-8e1f-432a-a5eb-a5c0ed6d7f61 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:17.191805 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0e4c46b7-8e1f-432a-a5eb-a5c0ed6d7f61 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:17.326201 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0e4c46b7-8e1f-432a-a5eb-a5c0ed6d7f61 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:17.334428 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0e4c46b7-8e1f-432a-a5eb-a5c0ed6d7f61 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1678 microversion: 2.1 time: 0.157079 Jun 10 18:05:17.335002 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1269/2493] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:17 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:17.341336 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a4e7893f-1f66-422e-af56-2449c4f10725 tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] Action: 'update_all', calling method: .version_select at 0x7f77b3f663a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:17.392247 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-a4e7893f-1f66-422e-af56-2449c4f10725 tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] Getting quotas for project 466403f0fb994f33866a5307f8f0bcca. Resources: dict_keys(['metadata_items']) {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:05:17.401437 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-a4e7893f-1f66-422e-af56-2449c4f10725 tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] Getting quotas for user 1f1a86fb89e04fb6b3b46979f0b94064 and project 466403f0fb994f33866a5307f8f0bcca. Resources: dict_keys(['metadata_items']) {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:05:17.813750 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a4e7893f-1f66-422e-af56-2449c4f10725 tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] 10.222.0.35 "PUT /compute/v2.1/images/c975828a-b6d1-4ff4-961b-c380ea55cbd6/metadata" status: 200 len: 61 microversion: 2.1 time: 0.476961 Jun 10 18:05:17.814347 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1270/2494] 10.222.0.35 () {60 vars in 1279 bytes} [Fri Jun 10 18:05:17 2022] PUT /compute/v2.1/images/c975828a-b6d1-4ff4-961b-c380ea55cbd6/metadata => generated 61 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:05:17.823588 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8dcb926b-c3b5-4efc-a3f2-62d0473dcba4 tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] Calling method '.version_select at 0x7f77b3f99af0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:18.157024 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8dcb926b-c3b5-4efc-a3f2-62d0473dcba4 tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] 10.222.0.35 "DELETE /compute/v2.1/os-security-groups/5830a542-ffe6-4cc4-a556-fa8e14cec7a4" status: 202 len: 0 microversion: 2.1 time: 0.337298 Jun 10 18:05:18.157726 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1271/2495] 10.222.0.35 () {58 vars in 1271 bytes} [Fri Jun 10 18:05:17 2022] DELETE /compute/v2.1/os-security-groups/5830a542-ffe6-4cc4-a556-fa8e14cec7a4 => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:05:18.162439 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-153beb42-779e-4161-b4ba-64f6bb8122f3 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:18.163138 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-153beb42-779e-4161-b4ba-64f6bb8122f3 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] [instance: 2f344351-d882-4028-98db-751266b3d74d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:18.175157 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-153beb42-779e-4161-b4ba-64f6bb8122f3 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:18.179651 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-153beb42-779e-4161-b4ba-64f6bb8122f3 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:18.180677 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-153beb42-779e-4161-b4ba-64f6bb8122f3 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:18.181829 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-153beb42-779e-4161-b4ba-64f6bb8122f3 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:18.201725 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-153beb42-779e-4161-b4ba-64f6bb8122f3 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] HTTP exception thrown: Instance 2f344351-d882-4028-98db-751266b3d74d could not be found. Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-153beb42-779e-4161-b4ba-64f6bb8122f3 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Request method failure captured: Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d HTTP/1.1 Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4Zy3r1pX7b3MtL_-NjN-zlRyjsPaJf9nUlwgEmvUs6EwjOw40qP9dbLbsHgij_gMl6uhbXl9nIlkqHmrWwww9dWms-7XOTEOvy9MdKMCvcMLYW-x2PIZ_wthjppQYWTgc0gmbBlQDA4e11wPRqBUoXg28RiqROpiqwC1wftTAJuO0M Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 66fd5e2ed0b84720849784c94f36d5da Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-MigrationsAdminTest-1164955500 Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/66fd5e2ed0b84720849784c94f36d5da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/66fd5e2ed0b84720849784c94f36d5da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/66fd5e2ed0b84720849784c94f36d5da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_66fd5e2ed0b84720849784c94f36d5da", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-MigrationsAdminTest-1164955500 Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 66fd5e2ed0b84720849784c94f36d5da Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-MigrationsAdminTest-1164955500 Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-MigrationsAdminTest-1164955500-project Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 1c74f45bf7fd4dea952d771a649519af Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-MigrationsAdminTest-1164955500-project Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 2f344351-d882-4028-98db-751266b3d74d could not be found. Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '2f344351-d882-4028-98db-751266b3d74d'} Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f344351-d882-4028-98db-751266b3d74d could not be found. Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f344351-d882-4028-98db-751266b3d74d could not be found. Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:18.205165 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:18.214588 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:18.214588 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:18.214588 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:18.214588 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:05:18.214588 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:05:18.214588 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f344351-d882-4028-98db-751266b3d74d could not be found. Jun 10 18:05:18.214588 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:18.214588 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-153beb42-779e-4161-b4ba-64f6bb8122f3 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] Returning 404 to user: Instance 2f344351-d882-4028-98db-751266b3d74d could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:05:18.214588 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-153beb42-779e-4161-b4ba-64f6bb8122f3 tempest-MigrationsAdminTest-1164955500 tempest-MigrationsAdminTest-1164955500-project] 10.222.0.35 "GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d" status: 404 len: 111 microversion: 2.1 time: 0.049142 Jun 10 18:05:18.220068 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1272/2496] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:18 2022] GET /compute/v2.1/servers/2f344351-d882-4028-98db-751266b3d74d => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:05:18.224859 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ba93ccbe-b0b8-4775-8d92-4f147e8b5166 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:18.230486 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ba93ccbe-b0b8-4775-8d92-4f147e8b5166 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: b6fe7ee7-fe32-4aa2-8616-784a199a4973] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:18.241302 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ba93ccbe-b0b8-4775-8d92-4f147e8b5166 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:18.242296 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ba93ccbe-b0b8-4775-8d92-4f147e8b5166 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:18.243085 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ba93ccbe-b0b8-4775-8d92-4f147e8b5166 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:18.243529 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ba93ccbe-b0b8-4775-8d92-4f147e8b5166 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:18.420730 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ba93ccbe-b0b8-4775-8d92-4f147e8b5166 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:18.430016 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ba93ccbe-b0b8-4775-8d92-4f147e8b5166 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973" status: 200 len: 1578 microversion: 2.1 time: 0.208804 Jun 10 18:05:18.431049 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1273/2497] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:18 2022] GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973 => generated 1578 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:18.436553 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-08b8aafa-c6a6-47ac-b05d-e1a96776ef7e tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] Action: 'update', calling method: .version_select at 0x7f77c00ef3a0>, body: {"meta": {"os_version": "alt"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:18.495393 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-08b8aafa-c6a6-47ac-b05d-e1a96776ef7e tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] Getting quotas for project 466403f0fb994f33866a5307f8f0bcca. Resources: dict_keys(['metadata_items']) {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:05:18.503041 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-08b8aafa-c6a6-47ac-b05d-e1a96776ef7e tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] Getting quotas for user 1f1a86fb89e04fb6b3b46979f0b94064 and project 466403f0fb994f33866a5307f8f0bcca. Resources: dict_keys(['metadata_items']) {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:05:18.895164 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-08b8aafa-c6a6-47ac-b05d-e1a96776ef7e tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] 10.222.0.35 "PUT /compute/v2.1/images/c975828a-b6d1-4ff4-961b-c380ea55cbd6/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.462608 Jun 10 18:05:18.901385 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1274/2498] 10.222.0.35 () {60 vars in 1312 bytes} [Fri Jun 10 18:05:18 2022] PUT /compute/v2.1/images/c975828a-b6d1-4ff4-961b-c380ea55cbd6/metadata/os_version => generated 31 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:05:18.907146 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f4d8fde8-351c-4268-8d3c-d8e209f542c3 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:18.907785 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f4d8fde8-351c-4268-8d3c-d8e209f542c3 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] [instance: 7928b35c-fde4-48c5-8068-a32c4395684b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:18.915319 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4d8fde8-351c-4268-8d3c-d8e209f542c3 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:18.915778 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4d8fde8-351c-4268-8d3c-d8e209f542c3 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:18.916896 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4d8fde8-351c-4268-8d3c-d8e209f542c3 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:18.917025 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4d8fde8-351c-4268-8d3c-d8e209f542c3 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:19.106158 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f4d8fde8-351c-4268-8d3c-d8e209f542c3 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebe891ebac49128820e80cc5f2fca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02fbcda5546455ca6ba1533af1373df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:19.113584 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f4d8fde8-351c-4268-8d3c-d8e209f542c3 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] 10.222.0.35 "GET /compute/v2.1/servers/7928b35c-fde4-48c5-8068-a32c4395684b" status: 200 len: 1323 microversion: 2.1 time: 0.216831 Jun 10 18:05:19.114147 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1275/2499] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:18 2022] GET /compute/v2.1/servers/7928b35c-fde4-48c5-8068-a32c4395684b => generated 1323 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:19.118807 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e6f8fee3-7948-4de6-8eee-5c10fed468f3 tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] Calling method '.version_select at 0x7f77b3fb7f70>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:19.440916 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e6f8fee3-7948-4de6-8eee-5c10fed468f3 tempest-SecurityGroupRulesTestJSON-319715108 tempest-SecurityGroupRulesTestJSON-319715108-project] 10.222.0.35 "DELETE /compute/v2.1/os-security-groups/11255a47-5566-4e96-8696-0f90c3a2a47c" status: 202 len: 0 microversion: 2.1 time: 0.324930 Jun 10 18:05:19.445986 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1276/2500] 10.222.0.35 () {58 vars in 1271 bytes} [Fri Jun 10 18:05:19 2022] DELETE /compute/v2.1/os-security-groups/11255a47-5566-4e96-8696-0f90c3a2a47c => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:05:19.451645 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cdd96367-7ca9-4ba4-ac40-03e707f28e55 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:19.452484 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cdd96367-7ca9-4ba4-ac40-03e707f28e55 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:19.459807 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cdd96367-7ca9-4ba4-ac40-03e707f28e55 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:19.460433 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cdd96367-7ca9-4ba4-ac40-03e707f28e55 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:19.461276 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cdd96367-7ca9-4ba4-ac40-03e707f28e55 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:19.461719 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cdd96367-7ca9-4ba4-ac40-03e707f28e55 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:19.497483 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cdd96367-7ca9-4ba4-ac40-03e707f28e55 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:19.497933 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cdd96367-7ca9-4ba4-ac40-03e707f28e55 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:19.498609 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-cdd96367-7ca9-4ba4-ac40-03e707f28e55 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lazy-loading 'fault' on Instance uuid 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:05:19.578028 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cdd96367-7ca9-4ba4-ac40-03e707f28e55 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:19.590680 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cdd96367-7ca9-4ba4-ac40-03e707f28e55 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd" status: 200 len: 1301 microversion: 2.1 time: 0.143586 Jun 10 18:05:19.592714 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1277/2501] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:19 2022] GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd => generated 1301 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:19.609243 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2be62b8e-49e8-41d5-a6ad-309c2975b32f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:19.609965 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2be62b8e-49e8-41d5-a6ad-309c2975b32f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:19.615983 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2be62b8e-49e8-41d5-a6ad-309c2975b32f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:19.617257 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2be62b8e-49e8-41d5-a6ad-309c2975b32f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:19.618155 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2be62b8e-49e8-41d5-a6ad-309c2975b32f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:19.618667 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2be62b8e-49e8-41d5-a6ad-309c2975b32f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:19.790862 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2be62b8e-49e8-41d5-a6ad-309c2975b32f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:19.795707 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2be62b8e-49e8-41d5-a6ad-309c2975b32f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1678 microversion: 2.1 time: 0.190249 Jun 10 18:05:19.796281 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1278/2502] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:19 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1678 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:19.800724 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-ff709ae3-32c9-44d9-9140-6efd1b8d1899 req-24343fc3-f56c-4b7f-b4e8-3a4f00a889c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7928b35c-fde4-48c5-8068-a32c4395684b", "tag": "26e1c56e-d6c1-43d2-9639-dde152bfe361"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:19.809004 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-ff709ae3-32c9-44d9-9140-6efd1b8d1899 req-24343fc3-f56c-4b7f-b4e8-3a4f00a889c1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:19.809449 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-ff709ae3-32c9-44d9-9140-6efd1b8d1899 req-24343fc3-f56c-4b7f-b4e8-3a4f00a889c1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:19.820522 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-ff709ae3-32c9-44d9-9140-6efd1b8d1899 req-24343fc3-f56c-4b7f-b4e8-3a4f00a889c1 service nova] Creating event network-changed:26e1c56e-d6c1-43d2-9639-dde152bfe361 for instance 7928b35c-fde4-48c5-8068-a32c4395684b on chh1-master-2 Jun 10 18:05:19.825162 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-ff709ae3-32c9-44d9-9140-6efd1b8d1899 req-24343fc3-f56c-4b7f-b4e8-3a4f00a889c1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027776 Jun 10 18:05:19.825823 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1279/2503] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:19.830524 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4fbe2b99-ff44-492a-b16e-6d432bb266ab tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] Calling method '.version_select at 0x7f77b3ee48b0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:19.873948 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4fbe2b99-ff44-492a-b16e-6d432bb266ab tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] 10.222.0.35 "GET /compute/v2.1/images/c975828a-b6d1-4ff4-961b-c380ea55cbd6/metadata" status: 200 len: 58 microversion: 2.1 time: 0.046955 Jun 10 18:05:19.874657 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1280/2504] 10.222.0.35 () {58 vars in 1259 bytes} [Fri Jun 10 18:05:19 2022] GET /compute/v2.1/images/c975828a-b6d1-4ff4-961b-c380ea55cbd6/metadata => generated 58 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:05:19.888084 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-178d2d31-9c70-494d-b5db-2e42c3fc196a tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:19.888882 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-178d2d31-9c70-494d-b5db-2e42c3fc196a tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: b6fe7ee7-fe32-4aa2-8616-784a199a4973] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:19.894598 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:05:19.896512 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-178d2d31-9c70-494d-b5db-2e42c3fc196a tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:19.896966 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-178d2d31-9c70-494d-b5db-2e42c3fc196a tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:19.897769 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-178d2d31-9c70-494d-b5db-2e42c3fc196a tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:19.898218 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-178d2d31-9c70-494d-b5db-2e42c3fc196a tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:20.250610 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-178d2d31-9c70-494d-b5db-2e42c3fc196a tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:20.262043 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-178d2d31-9c70-494d-b5db-2e42c3fc196a tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973" status: 200 len: 1571 microversion: 2.1 time: 0.386493 Jun 10 18:05:20.262862 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1281/2505] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:19 2022] GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973 => generated 1571 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:20.284025 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5e2456bb-ef8a-47f2-a1f0-8ea798c6d348 tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] Action: 'update_all', calling method: .version_select at 0x7f77b3ee4550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:20.336047 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-5e2456bb-ef8a-47f2-a1f0-8ea798c6d348 tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] Getting quotas for project 466403f0fb994f33866a5307f8f0bcca. Resources: dict_keys(['metadata_items']) {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:05:20.342231 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-5e2456bb-ef8a-47f2-a1f0-8ea798c6d348 tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] Getting quotas for user 1f1a86fb89e04fb6b3b46979f0b94064 and project 466403f0fb994f33866a5307f8f0bcca. Resources: dict_keys(['metadata_items']) {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:05:20.863048 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5e2456bb-ef8a-47f2-a1f0-8ea798c6d348 tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] 10.222.0.35 "PUT /compute/v2.1/images/c975828a-b6d1-4ff4-961b-c380ea55cbd6/metadata" status: 200 len: 61 microversion: 2.1 time: 0.587113 Jun 10 18:05:20.864264 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1282/2506] 10.222.0.35 () {60 vars in 1279 bytes} [Fri Jun 10 18:05:20 2022] PUT /compute/v2.1/images/c975828a-b6d1-4ff4-961b-c380ea55cbd6/metadata => generated 61 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:05:20.870274 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-08f8f7c8-923b-4d6c-af49-98c71a5757ba tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:20.870958 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-08f8f7c8-923b-4d6c-af49-98c71a5757ba tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] [instance: 7928b35c-fde4-48c5-8068-a32c4395684b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:20.878524 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-08f8f7c8-923b-4d6c-af49-98c71a5757ba tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:20.879219 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-08f8f7c8-923b-4d6c-af49-98c71a5757ba tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:20.880220 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-08f8f7c8-923b-4d6c-af49-98c71a5757ba tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:20.880872 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-08f8f7c8-923b-4d6c-af49-98c71a5757ba tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:21.023995 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-08f8f7c8-923b-4d6c-af49-98c71a5757ba tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebe891ebac49128820e80cc5f2fca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02fbcda5546455ca6ba1533af1373df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:21.031589 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-08f8f7c8-923b-4d6c-af49-98c71a5757ba tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] 10.222.0.35 "GET /compute/v2.1/servers/7928b35c-fde4-48c5-8068-a32c4395684b" status: 200 len: 1323 microversion: 2.1 time: 0.166033 Jun 10 18:05:21.032168 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1283/2507] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:20 2022] GET /compute/v2.1/servers/7928b35c-fde4-48c5-8068-a32c4395684b => generated 1323 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:21.037380 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ad4abba6-c071-4474-a065-acd6765e49a1 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1809523909"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:21.037917 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ad4abba6-c071-4474-a065-acd6765e49a1 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: b6fe7ee7-fe32-4aa2-8616-784a199a4973] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:21.043727 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ff4b95ab-d586-400b-a72c-290c898f259a tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] 10.222.0.35 "POST /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b/action" status: 202 len: 0 microversion: 2.25 time: 4.238324 Jun 10 18:05:21.044288 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ad4abba6-c071-4474-a065-acd6765e49a1 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:21.044881 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ad4abba6-c071-4474-a065-acd6765e49a1 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:21.046519 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ad4abba6-c071-4474-a065-acd6765e49a1 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:21.047145 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1225/2508] 10.222.0.35 () {62 vars in 1318 bytes} [Fri Jun 10 18:05:16 2022] POST /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b/action => generated 0 bytes in 4243 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:05:21.047316 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ad4abba6-c071-4474-a065-acd6765e49a1 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:21.053397 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6ac19e1d-0ebc-4fac-b2c8-a37e005f7a44 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:21.054788 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6ac19e1d-0ebc-4fac-b2c8-a37e005f7a44 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:21.065346 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6ac19e1d-0ebc-4fac-b2c8-a37e005f7a44 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:21.065728 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6ac19e1d-0ebc-4fac-b2c8-a37e005f7a44 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:21.066522 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6ac19e1d-0ebc-4fac-b2c8-a37e005f7a44 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:21.067217 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6ac19e1d-0ebc-4fac-b2c8-a37e005f7a44 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:21.083831 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-6ac19e1d-0ebc-4fac-b2c8-a37e005f7a44 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] HTTP exception thrown: Instance 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd could not be found. Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6ac19e1d-0ebc-4fac-b2c8-a37e005f7a44 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Request method failure captured: Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd HTTP/1.1 Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4Z1ErqekzqbT7WRsjkgkcIzOI_kHmS-v_gvh4SRJ2CMh-NfkzhIoAtBfjl57mQ3Zi2c8A0N4Q1ae1LCxXwPlP907CgwMHpQ3m2O1zE3NlaVYvIAW686XQfO0IP3gUnl9nQpF0XYTmOfelRJZNyQoLoHq3yZptXhyCu_RxXmqZPldSo Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: c96da7ef0cbc46b594ec327ddf875f7a Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-LiveMigrationTest-1635373537 Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/c96da7ef0cbc46b594ec327ddf875f7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c96da7ef0cbc46b594ec327ddf875f7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c96da7ef0cbc46b594ec327ddf875f7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_c96da7ef0cbc46b594ec327ddf875f7a", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-LiveMigrationTest-1635373537 Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: c96da7ef0cbc46b594ec327ddf875f7a Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-LiveMigrationTest-1635373537 Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-LiveMigrationTest-1635373537-project Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: d0f741e8506743a8b51251b3019b3ad5 Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-LiveMigrationTest-1635373537-project Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd could not be found. Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd'} Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd could not be found. Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd could not be found. Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:21.089061 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:21.093662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:21.093662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:21.093662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:21.093662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:05:21.093662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:05:21.093662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd could not be found. Jun 10 18:05:21.093662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:21.093662 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6ac19e1d-0ebc-4fac-b2c8-a37e005f7a44 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Returning 404 to user: Instance 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:05:21.093662 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6ac19e1d-0ebc-4fac-b2c8-a37e005f7a44 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd" status: 404 len: 111 microversion: 2.1 time: 0.038291 Jun 10 18:05:21.093662 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1226/2509] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:21 2022] GET /compute/v2.1/servers/2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:05:21.093662 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dd02100c-7ccc-47cb-a055-f711f39c4f2f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:21.093662 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dd02100c-7ccc-47cb-a055-f711f39c4f2f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:21.100072 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd02100c-7ccc-47cb-a055-f711f39c4f2f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:21.100555 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd02100c-7ccc-47cb-a055-f711f39c4f2f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:21.101358 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd02100c-7ccc-47cb-a055-f711f39c4f2f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:21.101801 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd02100c-7ccc-47cb-a055-f711f39c4f2f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:21.204412 chdv-master-2 devstack@n-api.service[126594]: INFO nova.network.security_group_api [None req-ad4abba6-c071-4474-a065-acd6765e49a1 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Adding security group 722393a8-008a-4d7a-9c56-52d99668bfad to port 58c69631-b12a-467a-a2c5-02827b6006bb Jun 10 18:05:21.217172 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:05:21.333217 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-dd02100c-7ccc-47cb-a055-f711f39c4f2f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:21.350203 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dd02100c-7ccc-47cb-a055-f711f39c4f2f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1655 microversion: 2.1 time: 0.261201 Jun 10 18:05:21.356233 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1227/2510] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:21 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1655 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:21.361310 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-97afab5b-f198-4413-9762-6fd828208a1a tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] Action: 'create', calling method: .version_select at 0x7f77c046b790>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:21.419212 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-97afab5b-f198-4413-9762-6fd828208a1a tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] Getting quotas for project 466403f0fb994f33866a5307f8f0bcca. Resources: dict_keys(['metadata_items']) {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:05:21.425239 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-97afab5b-f198-4413-9762-6fd828208a1a tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] Getting quotas for user 1f1a86fb89e04fb6b3b46979f0b94064 and project 466403f0fb994f33866a5307f8f0bcca. Resources: dict_keys(['metadata_items']) {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:05:21.841047 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ad4abba6-c071-4474-a065-acd6765e49a1 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "POST /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973/action" status: 202 len: 0 microversion: 2.1 time: 0.807770 Jun 10 18:05:21.842460 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1284/2511] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:05:21 2022] POST /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973/action => generated 0 bytes in 810 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:05:21.865760 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-447f93d7-d8b2-4960-809e-c33c34088549 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:21.868467 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-447f93d7-d8b2-4960-809e-c33c34088549 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:21.882518 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-447f93d7-d8b2-4960-809e-c33c34088549 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:21.883310 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-447f93d7-d8b2-4960-809e-c33c34088549 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:21.884877 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-447f93d7-d8b2-4960-809e-c33c34088549 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:21.885586 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-447f93d7-d8b2-4960-809e-c33c34088549 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:22.012985 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-97afab5b-f198-4413-9762-6fd828208a1a tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] 10.222.0.35 "POST /compute/v2.1/images/c975828a-b6d1-4ff4-961b-c380ea55cbd6/metadata" status: 200 len: 85 microversion: 2.1 time: 0.652745 Jun 10 18:05:22.014303 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1228/2512] 10.222.0.35 () {60 vars in 1280 bytes} [Fri Jun 10 18:05:21 2022] POST /compute/v2.1/images/c975828a-b6d1-4ff4-961b-c380ea55cbd6/metadata => generated 85 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:05:22.023465 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0dc4206a-0350-46bc-9a63-1de2107d1f48 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:22.029786 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0dc4206a-0350-46bc-9a63-1de2107d1f48 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: dea27a27-b11b-445c-b811-e852cd66e197] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:22.047302 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0dc4206a-0350-46bc-9a63-1de2107d1f48 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:22.048550 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0dc4206a-0350-46bc-9a63-1de2107d1f48 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:22.050926 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0dc4206a-0350-46bc-9a63-1de2107d1f48 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:22.052336 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0dc4206a-0350-46bc-9a63-1de2107d1f48 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:22.124005 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0dc4206a-0350-46bc-9a63-1de2107d1f48 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: dea27a27-b11b-445c-b811-e852cd66e197] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:05:22.137173 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-447f93d7-d8b2-4960-809e-c33c34088549 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:22.146874 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-447f93d7-d8b2-4960-809e-c33c34088549 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:22.152971 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-447f93d7-d8b2-4960-809e-c33c34088549 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:22.152971 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-447f93d7-d8b2-4960-809e-c33c34088549 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1488 microversion: 2.25 time: 0.304048 Jun 10 18:05:22.162676 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1285/2513] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:05:21 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1488 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:05:22.168099 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d7d24808-30b6-4f18-83a1-2a16a90af298 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:22.174597 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d7d24808-30b6-4f18-83a1-2a16a90af298 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:22.175171 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d7d24808-30b6-4f18-83a1-2a16a90af298 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:22.201867 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d7d24808-30b6-4f18-83a1-2a16a90af298 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Going to try to start instance {{(pid=126594) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 10 18:05:22.398087 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:05:22.501899 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0dc4206a-0350-46bc-9a63-1de2107d1f48 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "DELETE /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197" status: 204 len: 0 microversion: 2.1 time: 0.482975 Jun 10 18:05:22.504998 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1229/2514] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:05:22 2022] DELETE /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:05:22.506084 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d7d24808-30b6-4f18-83a1-2a16a90af298 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "POST /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1/action" status: 202 len: 0 microversion: 2.1 time: 0.341986 Jun 10 18:05:22.522033 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1286/2515] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:05:22 2022] POST /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:05:22.535934 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-16f42d93-af70-4c24-bd47-524f74f0014c tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '.version_select at 0x7f77c048f4c0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:22.540954 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-2f54b504-eb32-478f-8a86-692f5cce4ae5 req-d9d18502-c1d8-4466-9a70-a5dcc54d68cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6fe7ee7-fe32-4aa2-8616-784a199a4973", "tag": "58c69631-b12a-467a-a2c5-02827b6006bb"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:22.560843 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-2f54b504-eb32-478f-8a86-692f5cce4ae5 req-d9d18502-c1d8-4466-9a70-a5dcc54d68cb service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:22.561487 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-2f54b504-eb32-478f-8a86-692f5cce4ae5 req-d9d18502-c1d8-4466-9a70-a5dcc54d68cb service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:22.575119 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-2f54b504-eb32-478f-8a86-692f5cce4ae5 req-d9d18502-c1d8-4466-9a70-a5dcc54d68cb service nova] Creating event network-changed:58c69631-b12a-467a-a2c5-02827b6006bb for instance b6fe7ee7-fe32-4aa2-8616-784a199a4973 on chh2-master-2 Jun 10 18:05:22.583474 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-2f54b504-eb32-478f-8a86-692f5cce4ae5 req-d9d18502-c1d8-4466-9a70-a5dcc54d68cb service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055400 Jun 10 18:05:22.583474 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1287/2516] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:22.592087 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-9c074aed-5b0c-4217-824e-a4351797c650 req-0ec20fe8-8c4f-46c1-99f2-1ca12d88b85e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd", "name": "network-vif-deleted", "tag": "64c42e0e-3ccd-469e-bafd-7ce42fa87561"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:22.597770 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-9c074aed-5b0c-4217-824e-a4351797c650 req-0ec20fe8-8c4f-46c1-99f2-1ca12d88b85e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:22.598500 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-9c074aed-5b0c-4217-824e-a4351797c650 req-0ec20fe8-8c4f-46c1-99f2-1ca12d88b85e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:22.612984 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-9c074aed-5b0c-4217-824e-a4351797c650 req-0ec20fe8-8c4f-46c1-99f2-1ca12d88b85e service nova] Creating event network-vif-deleted:64c42e0e-3ccd-469e-bafd-7ce42fa87561 for instance 2a2bfbf2-05db-4493-8c4e-9e0d4e3023cd on chh2-master-2 Jun 10 18:05:22.618801 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-9c074aed-5b0c-4217-824e-a4351797c650 req-0ec20fe8-8c4f-46c1-99f2-1ca12d88b85e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035812 Jun 10 18:05:22.620223 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1288/2517] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:22.630535 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-029cfaf4-24c4-4a2a-9c76-b137244bee48 tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] Calling method '.version_select at 0x7f77b3f93d30>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:22.725087 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-029cfaf4-24c4-4a2a-9c76-b137244bee48 tempest-ImagesMetadataTestJSON-1735820593 tempest-ImagesMetadataTestJSON-1735820593-project] 10.222.0.35 "GET /compute/v2.1/images/c975828a-b6d1-4ff4-961b-c380ea55cbd6/metadata" status: 200 len: 85 microversion: 2.1 time: 0.102649 Jun 10 18:05:22.727308 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1289/2518] 10.222.0.35 () {58 vars in 1259 bytes} [Fri Jun 10 18:05:22 2022] GET /compute/v2.1/images/c975828a-b6d1-4ff4-961b-c380ea55cbd6/metadata => generated 85 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:05:22.732852 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5f513b80-9fbc-4f74-9020-bf0d7e704b75 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:22.734804 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5f513b80-9fbc-4f74-9020-bf0d7e704b75 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] [instance: 7928b35c-fde4-48c5-8068-a32c4395684b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:22.736984 chdv-master-2 devstack@n-api.service[126595]: DEBUG neutronclient.v2_0.client [None req-16f42d93-af70-4c24-bd47-524f74f0014c tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 722393a8-008a-4d7a-9c56-52d99668bfad in use.", "detail": ""}} {{(pid=126595) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 10 18:05:22.737678 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-16f42d93-af70-4c24-bd47-524f74f0014c tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] HTTP exception thrown: Security Group 722393a8-008a-4d7a-9c56-52d99668bfad in use. Jun 10 18:05:22.737678 chdv-master-2 devstack@n-api.service[126595]: Neutron server returns request_ids: ['req-393e8aa4-14c5-41a7-b81a-b180d7ba4a07'] Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-16f42d93-af70-4c24-bd47-524f74f0014c tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Request method failure captured: Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/os-security-groups/722393a8-008a-4d7a-9c56-52d99668bfad HTTP/1.1 Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4eKfGQZQ_jvhwHBxZ1GMnYHkMaBNBt7T8Ue90hW5x7BTDgkg2AiOfeu2huz2YQsnFH29P56VFWZd48_hROirge71TvR4QiKyTENHZz-D3t9ZS-m9216ej7Rjuw3slpnWYAQuE-KXkyXTlRqKM7yyNbBp9KRqjUFN-v2IWlTc7Yfat0 Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 304a5340852d4552a490e874dda8a0a3 Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_304a5340852d4552a490e874dda8a0a3", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 304a5340852d4552a490e874dda8a0a3 Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-SecurityGroupsTestJSON-732923421-project Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 7278ccddeee3495583093603a0fdb626 Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-SecurityGroupsTestJSON-732923421-project Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: exception: Security Group 722393a8-008a-4d7a-9c56-52d99668bfad in use. Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: Neutron server returns request_ids: ['req-393e8aa4-14c5-41a7-b81a-b180d7ba4a07'] Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '722393a8-008a-4d7a-9c56-52d99668bfad'} Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 10 18:05:22.739603 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 722393a8-008a-4d7a-9c56-52d99668bfad in use. Jun 10 18:05:22.745591 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-393e8aa4-14c5-41a7-b81a-b180d7ba4a07'] Jun 10 18:05:22.745591 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:22.745591 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:22.745591 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:22.745591 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:22.745591 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jun 10 18:05:22.745591 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jun 10 18:05:22.745591 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jun 10 18:05:22.745591 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jun 10 18:05:22.745591 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 722393a8-008a-4d7a-9c56-52d99668bfad in use. Jun 10 18:05:22.745591 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-393e8aa4-14c5-41a7-b81a-b180d7ba4a07'] Jun 10 18:05:22.745591 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:22.745591 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:22.745591 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:22.745591 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:22.745591 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:22.745591 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:22.745591 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:05:22.745591 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:05:22.745591 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:05:22.745591 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:05:22.745591 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:05:22.745591 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:05:22.745591 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jun 10 18:05:22.745591 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 10 18:05:22.745591 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 722393a8-008a-4d7a-9c56-52d99668bfad in use. Jun 10 18:05:22.745591 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-393e8aa4-14c5-41a7-b81a-b180d7ba4a07'] Jun 10 18:05:22.745591 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:22.745591 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:22.745591 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:22.745591 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:22.745591 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:22.745591 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:22.745591 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:05:22.745591 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:05:22.745591 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 722393a8-008a-4d7a-9c56-52d99668bfad in use. Jun 10 18:05:22.745591 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-393e8aa4-14c5-41a7-b81a-b180d7ba4a07'] Jun 10 18:05:22.745591 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:22.745591 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-16f42d93-af70-4c24-bd47-524f74f0014c tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Returning 400 to user: Security Group 722393a8-008a-4d7a-9c56-52d99668bfad in use. Jun 10 18:05:22.745591 chdv-master-2 devstack@n-api.service[126595]: Neutron server returns request_ids: ['req-393e8aa4-14c5-41a7-b81a-b180d7ba4a07'] {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:05:22.745591 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-16f42d93-af70-4c24-bd47-524f74f0014c tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "DELETE /compute/v2.1/os-security-groups/722393a8-008a-4d7a-9c56-52d99668bfad" status: 400 len: 185 microversion: 2.1 time: 0.237318 Jun 10 18:05:22.753011 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1230/2519] 10.222.0.35 () {58 vars in 1271 bytes} [Fri Jun 10 18:05:22 2022] DELETE /compute/v2.1/os-security-groups/722393a8-008a-4d7a-9c56-52d99668bfad => generated 185 bytes in 243 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:05:22.753011 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-efe7316f-4be5-4dd8-9dc1-325c2e09bf21 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:22.755795 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-efe7316f-4be5-4dd8-9dc1-325c2e09bf21 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: dea27a27-b11b-445c-b811-e852cd66e197] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:22.756282 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f513b80-9fbc-4f74-9020-bf0d7e704b75 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:22.757713 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f513b80-9fbc-4f74-9020-bf0d7e704b75 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:22.758846 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f513b80-9fbc-4f74-9020-bf0d7e704b75 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:22.759969 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f513b80-9fbc-4f74-9020-bf0d7e704b75 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:22.774778 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-efe7316f-4be5-4dd8-9dc1-325c2e09bf21 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:22.775257 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-efe7316f-4be5-4dd8-9dc1-325c2e09bf21 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:22.776080 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-efe7316f-4be5-4dd8-9dc1-325c2e09bf21 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:22.776554 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-efe7316f-4be5-4dd8-9dc1-325c2e09bf21 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:22.824870 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:05:22.983752 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5f513b80-9fbc-4f74-9020-bf0d7e704b75 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebe891ebac49128820e80cc5f2fca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02fbcda5546455ca6ba1533af1373df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:22.994150 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5f513b80-9fbc-4f74-9020-bf0d7e704b75 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] 10.222.0.35 "GET /compute/v2.1/servers/7928b35c-fde4-48c5-8068-a32c4395684b" status: 200 len: 1323 microversion: 2.1 time: 0.266803 Jun 10 18:05:22.995318 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1290/2520] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:22 2022] GET /compute/v2.1/servers/7928b35c-fde4-48c5-8068-a32c4395684b => generated 1323 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:23.001807 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9a09f86f-4079-481f-9672-b43a210d7296 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:23.003138 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9a09f86f-4079-481f-9672-b43a210d7296 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:23.010273 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9a09f86f-4079-481f-9672-b43a210d7296 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:23.011294 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9a09f86f-4079-481f-9672-b43a210d7296 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:23.012642 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9a09f86f-4079-481f-9672-b43a210d7296 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:23.013323 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9a09f86f-4079-481f-9672-b43a210d7296 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:23.303766 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9a09f86f-4079-481f-9672-b43a210d7296 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:23.310533 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-efe7316f-4be5-4dd8-9dc1-325c2e09bf21 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:23.317926 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9a09f86f-4079-481f-9672-b43a210d7296 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1664 microversion: 2.1 time: 0.319372 Jun 10 18:05:23.318606 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1291/2521] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:22 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1664 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:23.319091 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-efe7316f-4be5-4dd8-9dc1-325c2e09bf21 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197" status: 200 len: 1498 microversion: 2.1 time: 0.571776 Jun 10 18:05:23.319710 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1231/2522] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:22 2022] GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197 => generated 1498 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:23.324862 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8cb70f5f-4e52-4f35-bec5-76fa4d591abe tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:23.325684 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8cb70f5f-4e52-4f35-bec5-76fa4d591abe tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:23.330091 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3c45575f-5e69-4dfb-8523-63bc3aa73be7 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:23.330602 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3c45575f-5e69-4dfb-8523-63bc3aa73be7 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: b6fe7ee7-fe32-4aa2-8616-784a199a4973] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:23.332651 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8cb70f5f-4e52-4f35-bec5-76fa4d591abe tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:23.333170 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8cb70f5f-4e52-4f35-bec5-76fa4d591abe tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:23.334005 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8cb70f5f-4e52-4f35-bec5-76fa4d591abe tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:23.334446 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8cb70f5f-4e52-4f35-bec5-76fa4d591abe tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:23.350592 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3c45575f-5e69-4dfb-8523-63bc3aa73be7 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:23.353056 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3c45575f-5e69-4dfb-8523-63bc3aa73be7 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:23.356863 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3c45575f-5e69-4dfb-8523-63bc3aa73be7 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:23.358159 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3c45575f-5e69-4dfb-8523-63bc3aa73be7 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:23.404850 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3c45575f-5e69-4dfb-8523-63bc3aa73be7 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: b6fe7ee7-fe32-4aa2-8616-784a199a4973] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:05:23.812157 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3c45575f-5e69-4dfb-8523-63bc3aa73be7 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "DELETE /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973" status: 204 len: 0 microversion: 2.1 time: 0.490822 Jun 10 18:05:23.813370 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1292/2523] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:05:23 2022] DELETE /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:05:23.964460 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d7ef0343-8942-4d64-95d2-34a89a97413b tempest-NetworksTest-401952702 tempest-NetworksTest-401952702-project-admin] Calling method '.version_select at 0x7f77b3ef3310>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:24.050422 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8cb70f5f-4e52-4f35-bec5-76fa4d591abe tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:24.067503 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8cb70f5f-4e52-4f35-bec5-76fa4d591abe tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:24.069949 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8cb70f5f-4e52-4f35-bec5-76fa4d591abe tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:24.081991 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8cb70f5f-4e52-4f35-bec5-76fa4d591abe tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1488 microversion: 2.25 time: 0.760740 Jun 10 18:05:24.084080 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1232/2524] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:05:23 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1488 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:05:24.094872 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-800a16dc-556e-494d-b3fb-909a5c09b6d4 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:24.095504 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-800a16dc-556e-494d-b3fb-909a5c09b6d4 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: b6fe7ee7-fe32-4aa2-8616-784a199a4973] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:24.108496 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-800a16dc-556e-494d-b3fb-909a5c09b6d4 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:24.108958 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-800a16dc-556e-494d-b3fb-909a5c09b6d4 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:24.109985 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-800a16dc-556e-494d-b3fb-909a5c09b6d4 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:24.110959 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-800a16dc-556e-494d-b3fb-909a5c09b6d4 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:24.139927 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d7ef0343-8942-4d64-95d2-34a89a97413b tempest-NetworksTest-401952702 tempest-NetworksTest-401952702-project-admin] 10.222.0.35 "GET /compute/v2.1/os-networks" status: 200 len: 6734 microversion: 2.1 time: 0.324984 Jun 10 18:05:24.141150 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1293/2525] 10.222.0.35 () {58 vars in 1136 bytes} [Fri Jun 10 18:05:23 2022] GET /compute/v2.1/os-networks => generated 6734 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:24.150519 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bc6f10be-4b34-4eae-a21f-0d2842bcf44d tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:24.151454 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bc6f10be-4b34-4eae-a21f-0d2842bcf44d tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] [instance: 7928b35c-fde4-48c5-8068-a32c4395684b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:24.159931 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bc6f10be-4b34-4eae-a21f-0d2842bcf44d tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:24.160624 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bc6f10be-4b34-4eae-a21f-0d2842bcf44d tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:24.161791 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bc6f10be-4b34-4eae-a21f-0d2842bcf44d tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:24.162402 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bc6f10be-4b34-4eae-a21f-0d2842bcf44d tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:24.360576 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bc6f10be-4b34-4eae-a21f-0d2842bcf44d tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebe891ebac49128820e80cc5f2fca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02fbcda5546455ca6ba1533af1373df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:24.370191 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bc6f10be-4b34-4eae-a21f-0d2842bcf44d tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] 10.222.0.35 "GET /compute/v2.1/servers/7928b35c-fde4-48c5-8068-a32c4395684b" status: 200 len: 1323 microversion: 2.1 time: 0.224587 Jun 10 18:05:24.371045 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1294/2526] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:24 2022] GET /compute/v2.1/servers/7928b35c-fde4-48c5-8068-a32c4395684b => generated 1323 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:24.385669 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e3538625-6759-4d96-88b6-ab4904eb9de9 tempest-NetworksTest-401952702 tempest-NetworksTest-401952702-project-admin] Calling method '.version_select at 0x7f77b3ef3040>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:24.587997 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e3538625-6759-4d96-88b6-ab4904eb9de9 tempest-NetworksTest-401952702 tempest-NetworksTest-401952702-project-admin] 10.222.0.35 "GET /compute/v2.1/os-networks/ee72fd31-e0e2-470e-b15d-ae5538ee16e6" status: 200 len: 652 microversion: 2.1 time: 0.206916 Jun 10 18:05:24.588986 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1295/2527] 10.222.0.35 () {58 vars in 1247 bytes} [Fri Jun 10 18:05:24 2022] GET /compute/v2.1/os-networks/ee72fd31-e0e2-470e-b15d-ae5538ee16e6 => generated 652 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:24.605234 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-800a16dc-556e-494d-b3fb-909a5c09b6d4 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:24.610074 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4897b8da-dc7e-4ea7-92d6-4ed481686fb5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:24.610635 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-800a16dc-556e-494d-b3fb-909a5c09b6d4 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973" status: 200 len: 1646 microversion: 2.1 time: 0.525322 Jun 10 18:05:24.620119 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1233/2528] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:24 2022] GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973 => generated 1646 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:24.621682 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4897b8da-dc7e-4ea7-92d6-4ed481686fb5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:24.627620 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3269672b-5017-4408-8491-d5e603b0b8e3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:24.628249 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3269672b-5017-4408-8491-d5e603b0b8e3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: dea27a27-b11b-445c-b811-e852cd66e197] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:24.634898 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4897b8da-dc7e-4ea7-92d6-4ed481686fb5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:24.635599 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4897b8da-dc7e-4ea7-92d6-4ed481686fb5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:24.636646 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4897b8da-dc7e-4ea7-92d6-4ed481686fb5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:24.637319 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4897b8da-dc7e-4ea7-92d6-4ed481686fb5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:24.641817 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3269672b-5017-4408-8491-d5e603b0b8e3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:24.642286 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3269672b-5017-4408-8491-d5e603b0b8e3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:24.643084 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3269672b-5017-4408-8491-d5e603b0b8e3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:24.643927 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3269672b-5017-4408-8491-d5e603b0b8e3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:24.824022 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4897b8da-dc7e-4ea7-92d6-4ed481686fb5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:24.841364 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4897b8da-dc7e-4ea7-92d6-4ed481686fb5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1664 microversion: 2.1 time: 0.240276 Jun 10 18:05:24.843212 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1296/2529] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:24 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1664 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:24.854324 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1fd2d7e0-cfea-4bbe-9a4c-5c04b2d322c0 tempest-NetworksTest-401952702 tempest-NetworksTest-401952702-project-admin] Calling method '.version_select at 0x7f77c00ef3a0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:24.967488 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3269672b-5017-4408-8491-d5e603b0b8e3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:24.979220 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3269672b-5017-4408-8491-d5e603b0b8e3 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197" status: 200 len: 1498 microversion: 2.1 time: 0.366802 Jun 10 18:05:24.980388 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1234/2530] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:24 2022] GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197 => generated 1498 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:25.004900 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1fd2d7e0-cfea-4bbe-9a4c-5c04b2d322c0 tempest-NetworksTest-401952702 tempest-NetworksTest-401952702-project-admin] 10.222.0.35 "GET /compute/v2.1/os-networks" status: 200 len: 6734 microversion: 2.1 time: 0.156949 Jun 10 18:05:25.006182 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1297/2531] 10.222.0.35 () {58 vars in 1136 bytes} [Fri Jun 10 18:05:24 2022] GET /compute/v2.1/os-networks => generated 6734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:25.103121 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8a1c5319-2b74-4cd2-b72b-0a6666e155e4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:25.104777 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8a1c5319-2b74-4cd2-b72b-0a6666e155e4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:25.118768 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8a1c5319-2b74-4cd2-b72b-0a6666e155e4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:25.120298 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8a1c5319-2b74-4cd2-b72b-0a6666e155e4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:25.121289 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8a1c5319-2b74-4cd2-b72b-0a6666e155e4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:25.123847 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8a1c5319-2b74-4cd2-b72b-0a6666e155e4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:25.387055 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a93a1a80-84d4-4747-b990-6264bd1036bb tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:25.387874 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a93a1a80-84d4-4747-b990-6264bd1036bb tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] [instance: 7928b35c-fde4-48c5-8068-a32c4395684b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:25.405327 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a93a1a80-84d4-4747-b990-6264bd1036bb tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:25.405792 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a93a1a80-84d4-4747-b990-6264bd1036bb tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:25.410410 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a93a1a80-84d4-4747-b990-6264bd1036bb tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:25.410868 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a93a1a80-84d4-4747-b990-6264bd1036bb tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:25.657421 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8a1c5319-2b74-4cd2-b72b-0a6666e155e4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:25.702537 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8a1c5319-2b74-4cd2-b72b-0a6666e155e4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:25.706623 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8a1c5319-2b74-4cd2-b72b-0a6666e155e4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:25.709115 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8a1c5319-2b74-4cd2-b72b-0a6666e155e4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1488 microversion: 2.25 time: 0.610632 Jun 10 18:05:25.714017 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1235/2532] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:05:25 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1488 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:05:25.732551 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-cb32f3da-d5ca-41f1-8f9d-fa81c8defcfb req-cb106b9f-8c04-49b9-a724-390e9ab670b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dea27a27-b11b-445c-b811-e852cd66e197", "name": "network-vif-deleted", "tag": "17c3fdaf-8a01-4c8c-ac51-d926bd2c7869"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:25.752871 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-cb32f3da-d5ca-41f1-8f9d-fa81c8defcfb req-cb106b9f-8c04-49b9-a724-390e9ab670b6 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:25.753257 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-cb32f3da-d5ca-41f1-8f9d-fa81c8defcfb req-cb106b9f-8c04-49b9-a724-390e9ab670b6 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:25.779717 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-cb32f3da-d5ca-41f1-8f9d-fa81c8defcfb req-cb106b9f-8c04-49b9-a724-390e9ab670b6 service nova] Creating event network-vif-deleted:17c3fdaf-8a01-4c8c-ac51-d926bd2c7869 for instance dea27a27-b11b-445c-b811-e852cd66e197 on chh2-master-2 Jun 10 18:05:25.786916 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-cb32f3da-d5ca-41f1-8f9d-fa81c8defcfb req-cb106b9f-8c04-49b9-a724-390e9ab670b6 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070677 Jun 10 18:05:25.792743 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1236/2533] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:25.802325 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-4f008166-645b-478d-a781-66ad00fccbbc req-6dd24d9e-0a7a-4f92-8e4e-1e7994e55a5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7928b35c-fde4-48c5-8068-a32c4395684b", "name": "network-vif-plugged", "status": "completed", "tag": "26e1c56e-d6c1-43d2-9639-dde152bfe361"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:25.816265 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-4f008166-645b-478d-a781-66ad00fccbbc req-6dd24d9e-0a7a-4f92-8e4e-1e7994e55a5c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:25.816547 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-4f008166-645b-478d-a781-66ad00fccbbc req-6dd24d9e-0a7a-4f92-8e4e-1e7994e55a5c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:25.831689 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-4f008166-645b-478d-a781-66ad00fccbbc req-6dd24d9e-0a7a-4f92-8e4e-1e7994e55a5c service nova] Creating event network-vif-plugged:26e1c56e-d6c1-43d2-9639-dde152bfe361 for instance 7928b35c-fde4-48c5-8068-a32c4395684b on chh1-master-2 Jun 10 18:05:25.840883 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-4f008166-645b-478d-a781-66ad00fccbbc req-6dd24d9e-0a7a-4f92-8e4e-1e7994e55a5c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046160 Jun 10 18:05:25.843291 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1237/2534] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:25.851763 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-648478cf-5cfb-41fc-bc36-3bf365a844e9 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:25.857965 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-648478cf-5cfb-41fc-bc36-3bf365a844e9 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: b6fe7ee7-fe32-4aa2-8616-784a199a4973] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:25.874111 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-648478cf-5cfb-41fc-bc36-3bf365a844e9 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:25.878913 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-648478cf-5cfb-41fc-bc36-3bf365a844e9 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:25.878913 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-648478cf-5cfb-41fc-bc36-3bf365a844e9 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:25.878913 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-648478cf-5cfb-41fc-bc36-3bf365a844e9 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:25.934997 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a93a1a80-84d4-4747-b990-6264bd1036bb tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebe891ebac49128820e80cc5f2fca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02fbcda5546455ca6ba1533af1373df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:25.947254 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a93a1a80-84d4-4747-b990-6264bd1036bb tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] 10.222.0.35 "GET /compute/v2.1/servers/7928b35c-fde4-48c5-8068-a32c4395684b" status: 200 len: 1323 microversion: 2.1 time: 0.563321 Jun 10 18:05:25.949888 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1298/2535] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:25 2022] GET /compute/v2.1/servers/7928b35c-fde4-48c5-8068-a32c4395684b => generated 1323 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:25.967003 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3eb10c38-834f-4d59-b63d-f6480cf37b2d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:25.968844 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3eb10c38-834f-4d59-b63d-f6480cf37b2d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:25.980196 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3eb10c38-834f-4d59-b63d-f6480cf37b2d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:25.980999 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3eb10c38-834f-4d59-b63d-f6480cf37b2d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:25.981960 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3eb10c38-834f-4d59-b63d-f6480cf37b2d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:25.983402 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3eb10c38-834f-4d59-b63d-f6480cf37b2d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:26.269697 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3eb10c38-834f-4d59-b63d-f6480cf37b2d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:26.278508 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3eb10c38-834f-4d59-b63d-f6480cf37b2d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.326413 Jun 10 18:05:26.278723 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1299/2536] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:25 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:26.312420 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-525d1e19-2a96-4990-a6b4-26fa09683f0b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:26.313322 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-525d1e19-2a96-4990-a6b4-26fa09683f0b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: dea27a27-b11b-445c-b811-e852cd66e197] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:26.322040 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-525d1e19-2a96-4990-a6b4-26fa09683f0b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:26.322816 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-525d1e19-2a96-4990-a6b4-26fa09683f0b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:26.323677 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-525d1e19-2a96-4990-a6b4-26fa09683f0b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:26.324254 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-525d1e19-2a96-4990-a6b4-26fa09683f0b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:26.353039 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:05:26.387397 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-525d1e19-2a96-4990-a6b4-26fa09683f0b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:26.400263 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-525d1e19-2a96-4990-a6b4-26fa09683f0b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:26.401150 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-525d1e19-2a96-4990-a6b4-26fa09683f0b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lazy-loading 'fault' on Instance uuid dea27a27-b11b-445c-b811-e852cd66e197 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:05:26.495988 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-525d1e19-2a96-4990-a6b4-26fa09683f0b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0f741e8506743a8b51251b3019b3ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96da7ef0cbc46b594ec327ddf875f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:26.509230 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-525d1e19-2a96-4990-a6b4-26fa09683f0b tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197" status: 200 len: 1300 microversion: 2.1 time: 0.214342 Jun 10 18:05:26.511234 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1300/2537] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:26 2022] GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197 => generated 1300 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:26.525256 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cf513d96-f740-4386-a0c9-fc3ef2c9435a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:26.526252 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cf513d96-f740-4386-a0c9-fc3ef2c9435a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:26.543732 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf513d96-f740-4386-a0c9-fc3ef2c9435a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:26.544855 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf513d96-f740-4386-a0c9-fc3ef2c9435a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:26.546261 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf513d96-f740-4386-a0c9-fc3ef2c9435a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:26.548534 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf513d96-f740-4386-a0c9-fc3ef2c9435a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:26.826638 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-648478cf-5cfb-41fc-bc36-3bf365a844e9 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:26.834545 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-648478cf-5cfb-41fc-bc36-3bf365a844e9 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973" status: 200 len: 1646 microversion: 2.1 time: 0.989193 Jun 10 18:05:26.849899 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1238/2538] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:25 2022] GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973 => generated 1646 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:26.867112 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-145b9ea2-460d-4f0b-a238-1ad38648df6d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:26.869659 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-145b9ea2-460d-4f0b-a238-1ad38648df6d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:26.902148 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-145b9ea2-460d-4f0b-a238-1ad38648df6d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:26.905497 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-145b9ea2-460d-4f0b-a238-1ad38648df6d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:26.912604 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-145b9ea2-460d-4f0b-a238-1ad38648df6d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:26.913654 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-145b9ea2-460d-4f0b-a238-1ad38648df6d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:26.977290 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:05:27.017418 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cf513d96-f740-4386-a0c9-fc3ef2c9435a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:27.028540 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cf513d96-f740-4386-a0c9-fc3ef2c9435a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.513767 Jun 10 18:05:27.029109 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1301/2539] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:26 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:27.197161 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-145b9ea2-460d-4f0b-a238-1ad38648df6d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:27.201897 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-145b9ea2-460d-4f0b-a238-1ad38648df6d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:27.208989 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-145b9ea2-460d-4f0b-a238-1ad38648df6d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:27.211371 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-145b9ea2-460d-4f0b-a238-1ad38648df6d tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1488 microversion: 2.25 time: 0.364766 Jun 10 18:05:27.217163 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1239/2540] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:05:26 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1488 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:05:27.230112 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7d4b3260-8b06-4861-95d7-9eedb7fa4513 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:27.230765 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7d4b3260-8b06-4861-95d7-9eedb7fa4513 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] [instance: 7928b35c-fde4-48c5-8068-a32c4395684b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:27.249655 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7d4b3260-8b06-4861-95d7-9eedb7fa4513 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:27.250116 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7d4b3260-8b06-4861-95d7-9eedb7fa4513 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:27.253969 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7d4b3260-8b06-4861-95d7-9eedb7fa4513 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:27.254645 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7d4b3260-8b06-4861-95d7-9eedb7fa4513 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:27.308674 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-73d4bd31-b623-465b-b6de-f804fbaa1d24 tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] Action: 'create', calling method: .version_select at 0x7f77b3f33af0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2049081427", "description": "tempest-description-265014173"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:27.510232 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7d4b3260-8b06-4861-95d7-9eedb7fa4513 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebe891ebac49128820e80cc5f2fca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02fbcda5546455ca6ba1533af1373df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:27.518697 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7d4b3260-8b06-4861-95d7-9eedb7fa4513 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] 10.222.0.35 "GET /compute/v2.1/servers/7928b35c-fde4-48c5-8068-a32c4395684b" status: 200 len: 1323 microversion: 2.1 time: 0.296518 Jun 10 18:05:27.530215 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1240/2541] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:27 2022] GET /compute/v2.1/servers/7928b35c-fde4-48c5-8068-a32c4395684b => generated 1323 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:27.535733 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0a1e9150-e47e-43a9-a0e5-1094d9cf2cba tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:27.536655 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0a1e9150-e47e-43a9-a0e5-1094d9cf2cba tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:27.543754 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0a1e9150-e47e-43a9-a0e5-1094d9cf2cba tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:27.544500 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0a1e9150-e47e-43a9-a0e5-1094d9cf2cba tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:27.545448 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0a1e9150-e47e-43a9-a0e5-1094d9cf2cba tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:27.546051 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0a1e9150-e47e-43a9-a0e5-1094d9cf2cba tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:27.746702 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0a1e9150-e47e-43a9-a0e5-1094d9cf2cba tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Unlocking {{(pid=126595) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jun 10 18:05:27.863791 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-73d4bd31-b623-465b-b6de-f804fbaa1d24 tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] 10.222.0.35 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.833019 Jun 10 18:05:27.864595 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1302/2542] 10.222.0.35 () {60 vars in 1179 bytes} [Fri Jun 10 18:05:27 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:27.869610 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-902c4eca-581f-4405-9ebf-8215ec87a300 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:27.870730 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-902c4eca-581f-4405-9ebf-8215ec87a300 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] [instance: dea27a27-b11b-445c-b811-e852cd66e197] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:27.877853 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-902c4eca-581f-4405-9ebf-8215ec87a300 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:27.878300 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-902c4eca-581f-4405-9ebf-8215ec87a300 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:27.879073 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-902c4eca-581f-4405-9ebf-8215ec87a300 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:27.879509 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-902c4eca-581f-4405-9ebf-8215ec87a300 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:27.904321 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-902c4eca-581f-4405-9ebf-8215ec87a300 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] HTTP exception thrown: Instance dea27a27-b11b-445c-b811-e852cd66e197 could not be found. Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-902c4eca-581f-4405-9ebf-8215ec87a300 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Request method failure captured: Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197 HTTP/1.1 Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4Z1ErqekzqbT7WRsjkgkcIzOI_kHmS-v_gvh4SRJ2CMh-NfkzhIoAtBfjl57mQ3Zi2c8A0N4Q1ae1LCxXwPlP907CgwMHpQ3m2O1zE3NlaVYvIAW686XQfO0IP3gUnl9nQpF0XYTmOfelRJZNyQoLoHq3yZptXhyCu_RxXmqZPldSo Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: c96da7ef0cbc46b594ec327ddf875f7a Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-LiveMigrationTest-1635373537 Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/c96da7ef0cbc46b594ec327ddf875f7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c96da7ef0cbc46b594ec327ddf875f7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c96da7ef0cbc46b594ec327ddf875f7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_c96da7ef0cbc46b594ec327ddf875f7a", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-LiveMigrationTest-1635373537 Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: c96da7ef0cbc46b594ec327ddf875f7a Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-LiveMigrationTest-1635373537 Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-LiveMigrationTest-1635373537-project Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: d0f741e8506743a8b51251b3019b3ad5 Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-LiveMigrationTest-1635373537-project Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: exception: Instance dea27a27-b11b-445c-b811-e852cd66e197 could not be found. Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'dea27a27-b11b-445c-b811-e852cd66e197'} Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dea27a27-b11b-445c-b811-e852cd66e197 could not be found. Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dea27a27-b11b-445c-b811-e852cd66e197 could not be found. Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:27.907590 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:27.912772 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:27.912772 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:27.912772 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:27.912772 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:05:27.912772 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:05:27.912772 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dea27a27-b11b-445c-b811-e852cd66e197 could not be found. Jun 10 18:05:27.912772 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:27.912772 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-902c4eca-581f-4405-9ebf-8215ec87a300 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] Returning 404 to user: Instance dea27a27-b11b-445c-b811-e852cd66e197 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:05:27.912772 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-902c4eca-581f-4405-9ebf-8215ec87a300 tempest-LiveMigrationTest-1635373537 tempest-LiveMigrationTest-1635373537-project] 10.222.0.35 "GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197" status: 404 len: 111 microversion: 2.1 time: 0.043597 Jun 10 18:05:27.912772 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1303/2543] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:27 2022] GET /compute/v2.1/servers/dea27a27-b11b-445c-b811-e852cd66e197 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:05:27.927217 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-539af23f-fe58-4ce8-8378-725bace1ae0e tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:27.927217 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-539af23f-fe58-4ce8-8378-725bace1ae0e tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: b6fe7ee7-fe32-4aa2-8616-784a199a4973] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:27.931174 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-539af23f-fe58-4ce8-8378-725bace1ae0e tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:27.931637 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-539af23f-fe58-4ce8-8378-725bace1ae0e tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:27.932617 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-539af23f-fe58-4ce8-8378-725bace1ae0e tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:27.933065 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-539af23f-fe58-4ce8-8378-725bace1ae0e tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:27.978717 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0a1e9150-e47e-43a9-a0e5-1094d9cf2cba tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "POST /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1/action" status: 202 len: 0 microversion: 2.1 time: 0.446968 Jun 10 18:05:27.979357 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1241/2544] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:05:27 2022] POST /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1/action => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:05:27.991101 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-4c1c4fc0-a02e-4662-b1a0-ecffb8b3929a req-f86d69b1-8564-44ea-ac99-1357f48af59c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6fe7ee7-fe32-4aa2-8616-784a199a4973", "name": "network-vif-deleted", "tag": "58c69631-b12a-467a-a2c5-02827b6006bb"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:28.000694 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-4c1c4fc0-a02e-4662-b1a0-ecffb8b3929a req-f86d69b1-8564-44ea-ac99-1357f48af59c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:28.001832 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-4c1c4fc0-a02e-4662-b1a0-ecffb8b3929a req-f86d69b1-8564-44ea-ac99-1357f48af59c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:28.014021 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-4c1c4fc0-a02e-4662-b1a0-ecffb8b3929a req-f86d69b1-8564-44ea-ac99-1357f48af59c service nova] Creating event network-vif-deleted:58c69631-b12a-467a-a2c5-02827b6006bb for instance b6fe7ee7-fe32-4aa2-8616-784a199a4973 on chh2-master-2 Jun 10 18:05:28.021123 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-4c1c4fc0-a02e-4662-b1a0-ecffb8b3929a req-f86d69b1-8564-44ea-ac99-1357f48af59c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039340 Jun 10 18:05:28.021738 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1242/2545] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:28.028201 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0a51a6da-3f60-4e97-853c-93767fefd413 tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] Action: 'create', calling method: .version_select at 0x7f77c04171f0>, body: {"security_group_rule": {"parent_group_id": "b9ab3180-55c9-442d-bd8e-a8f93bf2c844", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:28.050633 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-539af23f-fe58-4ce8-8378-725bace1ae0e tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:28.065867 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-539af23f-fe58-4ce8-8378-725bace1ae0e tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973" status: 200 len: 1301 microversion: 2.1 time: 0.154788 Jun 10 18:05:28.070691 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1304/2546] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:27 2022] GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973 => generated 1301 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:28.076190 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3f27f7c5-a39a-4054-97e6-2bb76a43f319 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:28.081548 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3f27f7c5-a39a-4054-97e6-2bb76a43f319 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:28.083908 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f27f7c5-a39a-4054-97e6-2bb76a43f319 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:28.084388 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f27f7c5-a39a-4054-97e6-2bb76a43f319 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:28.086205 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f27f7c5-a39a-4054-97e6-2bb76a43f319 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:28.087072 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f27f7c5-a39a-4054-97e6-2bb76a43f319 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:28.270265 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3f27f7c5-a39a-4054-97e6-2bb76a43f319 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:28.281276 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3f27f7c5-a39a-4054-97e6-2bb76a43f319 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.208337 Jun 10 18:05:28.284189 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1305/2547] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:28 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:28.290602 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5db16d9d-5ae2-4bac-ad77-6e88c916dc30 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:28.291344 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5db16d9d-5ae2-4bac-ad77-6e88c916dc30 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:28.298855 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5db16d9d-5ae2-4bac-ad77-6e88c916dc30 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:28.299394 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5db16d9d-5ae2-4bac-ad77-6e88c916dc30 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:28.300273 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5db16d9d-5ae2-4bac-ad77-6e88c916dc30 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:28.300847 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5db16d9d-5ae2-4bac-ad77-6e88c916dc30 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:28.562966 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5db16d9d-5ae2-4bac-ad77-6e88c916dc30 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:28.572628 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5db16d9d-5ae2-4bac-ad77-6e88c916dc30 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:28.574435 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5db16d9d-5ae2-4bac-ad77-6e88c916dc30 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:28.575738 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5db16d9d-5ae2-4bac-ad77-6e88c916dc30 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1488 microversion: 2.25 time: 0.291723 Jun 10 18:05:28.576728 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1306/2548] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:05:28 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1488 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:05:28.582016 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d4c24a4f-2b62-40f9-843a-8f862529068e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:28.582781 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d4c24a4f-2b62-40f9-843a-8f862529068e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:28.590027 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d4c24a4f-2b62-40f9-843a-8f862529068e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:28.590482 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d4c24a4f-2b62-40f9-843a-8f862529068e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:28.591267 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d4c24a4f-2b62-40f9-843a-8f862529068e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:28.591905 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d4c24a4f-2b62-40f9-843a-8f862529068e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:28.820925 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d4c24a4f-2b62-40f9-843a-8f862529068e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:28.828683 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d4c24a4f-2b62-40f9-843a-8f862529068e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.250369 Jun 10 18:05:28.840939 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1307/2549] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:28 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:28.846519 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7844808f-0351-4f2b-99b7-609d7a6fde14 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:28.847383 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7844808f-0351-4f2b-99b7-609d7a6fde14 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] [instance: 7928b35c-fde4-48c5-8068-a32c4395684b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:28.854397 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7844808f-0351-4f2b-99b7-609d7a6fde14 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:28.855091 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7844808f-0351-4f2b-99b7-609d7a6fde14 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:28.856071 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7844808f-0351-4f2b-99b7-609d7a6fde14 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:28.856821 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7844808f-0351-4f2b-99b7-609d7a6fde14 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:28.903949 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0a51a6da-3f60-4e97-853c-93767fefd413 tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] 10.222.0.35 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.880047 Jun 10 18:05:28.904898 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1243/2550] 10.222.0.35 () {60 vars in 1194 bytes} [Fri Jun 10 18:05:28 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:28.910723 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-043e5d84-2e1a-4f6b-953c-2ce73ad6a4e2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:28.912049 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-043e5d84-2e1a-4f6b-953c-2ce73ad6a4e2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:28.925354 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-043e5d84-2e1a-4f6b-953c-2ce73ad6a4e2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:28.926361 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-043e5d84-2e1a-4f6b-953c-2ce73ad6a4e2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:28.928187 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-043e5d84-2e1a-4f6b-953c-2ce73ad6a4e2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:28.929784 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-043e5d84-2e1a-4f6b-953c-2ce73ad6a4e2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:29.055330 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7844808f-0351-4f2b-99b7-609d7a6fde14 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebe891ebac49128820e80cc5f2fca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02fbcda5546455ca6ba1533af1373df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:29.064587 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7844808f-0351-4f2b-99b7-609d7a6fde14 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] 10.222.0.35 "GET /compute/v2.1/servers/7928b35c-fde4-48c5-8068-a32c4395684b" status: 200 len: 1518 microversion: 2.1 time: 0.222143 Jun 10 18:05:29.065753 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1308/2551] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:28 2022] GET /compute/v2.1/servers/7928b35c-fde4-48c5-8068-a32c4395684b => generated 1518 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:29.092728 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2f894261-b341-47aa-a03c-5e96b5d92c9d tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] Action: 'create', calling method: .version_select at 0x7f77b3f97ca0>, body: {"security_group_rule": {"parent_group_id": "b9ab3180-55c9-442d-bd8e-a8f93bf2c844", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:29.281542 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-2f894261-b341-47aa-a03c-5e96b5d92c9d tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] HTTP exception thrown: This rule already exists in group b9ab3180-55c9-442d-bd8e-a8f93bf2c844 Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2f894261-b341-47aa-a03c-5e96b5d92c9d tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] Request method failure captured: Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 138 Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4fmWLCP-6Rt0dlcqEmykPR7RflxTDHKzZ791gM56jZgAvNjh1cAW0D9UAwjtFzfmxEJMTnNV6Xw2ZYSfRuZZGPc2N8FVt28WV_A_6b4mnEZIfP2jVqsVVsCR4ej6fPT5l6hj-krlC-_QJMoQVvahGDXv94S11GRtD_8znvxnp__pFY Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: c22803727b7f49bbaa7fb99f13156667 Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-442371350 Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/c22803727b7f49bbaa7fb99f13156667"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c22803727b7f49bbaa7fb99f13156667"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c22803727b7f49bbaa7fb99f13156667"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_c22803727b7f49bbaa7fb99f13156667", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-442371350 Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: c22803727b7f49bbaa7fb99f13156667 Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-442371350 Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-442371350-project Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: abc5f81394264f2dba5cd16cdb2d077d Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-442371350-project Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: {"security_group_rule": {"parent_group_id": "b9ab3180-55c9-442d-bd8e-a8f93bf2c844", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: exception: This rule already exists in group b9ab3180-55c9-442d-bd8e-a8f93bf2c844 Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'b9ab3180-55c9-442d-bd8e-a8f93bf2c844', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group b9ab3180-55c9-442d-bd8e-a8f93bf2c844 Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group b9ab3180-55c9-442d-bd8e-a8f93bf2c844 Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:29.284535 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:29.289723 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:05:29.289723 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:05:29.289723 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group b9ab3180-55c9-442d-bd8e-a8f93bf2c844 Jun 10 18:05:29.289723 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:29.300192 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2f894261-b341-47aa-a03c-5e96b5d92c9d tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] Returning 400 to user: This rule already exists in group b9ab3180-55c9-442d-bd8e-a8f93bf2c844 {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:05:29.300192 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2f894261-b341-47aa-a03c-5e96b5d92c9d tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] 10.222.0.35 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.229285 Jun 10 18:05:29.300192 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1309/2552] 10.222.0.35 () {60 vars in 1194 bytes} [Fri Jun 10 18:05:29 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 230 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:05:29.302613 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-574eac3f-9b3a-4aef-a6ab-05db0751663a tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:29.303235 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-574eac3f-9b3a-4aef-a6ab-05db0751663a tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: b6fe7ee7-fe32-4aa2-8616-784a199a4973] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:29.309397 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-043e5d84-2e1a-4f6b-953c-2ce73ad6a4e2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:29.311481 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-574eac3f-9b3a-4aef-a6ab-05db0751663a tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:29.312391 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-574eac3f-9b3a-4aef-a6ab-05db0751663a tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:29.313241 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-574eac3f-9b3a-4aef-a6ab-05db0751663a tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:29.314073 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-574eac3f-9b3a-4aef-a6ab-05db0751663a tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:29.318166 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-043e5d84-2e1a-4f6b-953c-2ce73ad6a4e2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.411929 Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1244/2553] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:28 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c2e0213f-0dd4-4e59-bf12-cb0f2f437902 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-470322453", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "5916f11b-5717-464f-b761-826564c4c17b"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c2e0213f-0dd4-4e59-bf12-cb0f2f437902 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Request method failure captured: Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 242 Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4fVKaV2yOV2R_JljWTbThJEMEjIYXgRQuhdx_KIZcVaOe4UmRGsZcdaV9rcP7GJic9zWagOCpUnX_g7LYBWqdBjRijta-GwQ5znLE0NkyU0ZOS8B9sBYUb8cWAy4b7xDsg1syrbjo-CekjQ7u2e4MVyk2x2jWtLB0CISqaTfmtlIM8 Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: a02fbcda5546455ca6ba1533af1373df Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-119967093 Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/a02fbcda5546455ca6ba1533af1373df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a02fbcda5546455ca6ba1533af1373df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a02fbcda5546455ca6ba1533af1373df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_a02fbcda5546455ca6ba1533af1373df", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-119967093 Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: a02fbcda5546455ca6ba1533af1373df Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-119967093 Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServerMetadataNegativeTestJSON-119967093-project Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: cdebe891ebac49128820e80cc5f2fca9 Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-119967093-project Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-470322453", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "5916f11b-5717-464f-b761-826564c4c17b"}]}} Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-470322453', 'imageRef': 'efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '5916f11b-5717-464f-b761-826564c4c17b'}]}}} Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise error Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi {'': 'data1'} Jun 10 18:05:29.331631 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:29.337639 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:29.337639 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:29.337639 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:29.337639 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:29.337639 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:29.337639 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:05:29.337639 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:05:29.337639 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:05:29.337639 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:05:29.337639 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:05:29.337639 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:05:29.337639 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 10 18:05:29.337639 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 10 18:05:29.337639 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 10 18:05:29.337639 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 10 18:05:29.337639 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 10 18:05:29.337639 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 10 18:05:29.337639 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 10 18:05:29.337639 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:29.337639 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:29.337639 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:29.337639 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:29.337639 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:29.337639 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:29.337639 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 10 18:05:29.337639 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 10 18:05:29.337639 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 10 18:05:29.337639 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:29.337639 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c2e0213f-0dd4-4e59-bf12-cb0f2f437902 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:05:29.337639 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c2e0213f-0dd4-4e59-bf12-cb0f2f437902 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.008460 Jun 10 18:05:29.337639 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1245/2554] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:05:29 2022] POST /compute/v2.1/servers => generated 175 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:05:29.344293 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-617d0675-823a-4292-a766-c992ce545f53 tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] Calling method '.version_select at 0x7f77c040a700>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:29.360271 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-574eac3f-9b3a-4aef-a6ab-05db0751663a tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] HTTP exception thrown: Instance b6fe7ee7-fe32-4aa2-8616-784a199a4973 could not be found. Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-574eac3f-9b3a-4aef-a6ab-05db0751663a tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Request method failure captured: Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973 HTTP/1.1 Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4eKfGQZQ_jvhwHBxZ1GMnYHkMaBNBt7T8Ue90hW5x7BTDgkg2AiOfeu2huz2YQsnFH29P56VFWZd48_hROirge71TvR4QiKyTENHZz-D3t9ZS-m9216ej7Rjuw3slpnWYAQuE-KXkyXTlRqKM7yyNbBp9KRqjUFN-v2IWlTc7Yfat0 Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 304a5340852d4552a490e874dda8a0a3 Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_304a5340852d4552a490e874dda8a0a3", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 304a5340852d4552a490e874dda8a0a3 Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-SecurityGroupsTestJSON-732923421-project Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 7278ccddeee3495583093603a0fdb626 Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-SecurityGroupsTestJSON-732923421-project Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: exception: Instance b6fe7ee7-fe32-4aa2-8616-784a199a4973 could not be found. Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'b6fe7ee7-fe32-4aa2-8616-784a199a4973'} Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6fe7ee7-fe32-4aa2-8616-784a199a4973 could not be found. Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6fe7ee7-fe32-4aa2-8616-784a199a4973 could not be found. Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:29.362305 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:29.367696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:29.367696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:29.367696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:29.367696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:05:29.367696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:05:29.367696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6fe7ee7-fe32-4aa2-8616-784a199a4973 could not be found. Jun 10 18:05:29.367696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:29.370109 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-574eac3f-9b3a-4aef-a6ab-05db0751663a tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Returning 404 to user: Instance b6fe7ee7-fe32-4aa2-8616-784a199a4973 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:05:29.374258 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-574eac3f-9b3a-4aef-a6ab-05db0751663a tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973" status: 404 len: 111 microversion: 2.1 time: 0.073134 Jun 10 18:05:29.374258 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1310/2555] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:29 2022] GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:05:29.378279 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-be0f9581-170a-4942-ae23-896e9a5bbf02 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:29.378786 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-be0f9581-170a-4942-ae23-896e9a5bbf02 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] [instance: e9bf8539-b335-4ce8-912c-6ae2162516cb] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:29.384692 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-be0f9581-170a-4942-ae23-896e9a5bbf02 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] HTTP exception thrown: Instance e9bf8539-b335-4ce8-912c-6ae2162516cb could not be found. Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-be0f9581-170a-4942-ae23-896e9a5bbf02 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Request method failure captured: Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/e9bf8539-b335-4ce8-912c-6ae2162516cb/metadata HTTP/1.1 Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4fVKaV2yOV2R_JljWTbThJEMEjIYXgRQuhdx_KIZcVaOe4UmRGsZcdaV9rcP7GJic9zWagOCpUnX_g7LYBWqdBjRijta-GwQ5znLE0NkyU0ZOS8B9sBYUb8cWAy4b7xDsg1syrbjo-CekjQ7u2e4MVyk2x2jWtLB0CISqaTfmtlIM8 Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: a02fbcda5546455ca6ba1533af1373df Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-119967093 Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/a02fbcda5546455ca6ba1533af1373df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a02fbcda5546455ca6ba1533af1373df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a02fbcda5546455ca6ba1533af1373df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_a02fbcda5546455ca6ba1533af1373df", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-119967093 Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: a02fbcda5546455ca6ba1533af1373df Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-119967093 Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServerMetadataNegativeTestJSON-119967093-project Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: cdebe891ebac49128820e80cc5f2fca9 Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-119967093-project Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: exception: Instance e9bf8539-b335-4ce8-912c-6ae2162516cb could not be found. Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: action_args: {'server_id': 'e9bf8539-b335-4ce8-912c-6ae2162516cb'} Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9bf8539-b335-4ce8-912c-6ae2162516cb could not be found. Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9bf8539-b335-4ce8-912c-6ae2162516cb could not be found. Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:29.386899 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:29.406730 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:05:29.406730 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:05:29.406730 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9bf8539-b335-4ce8-912c-6ae2162516cb could not be found. Jun 10 18:05:29.406730 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:29.406730 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-be0f9581-170a-4942-ae23-896e9a5bbf02 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Returning 404 to user: Instance e9bf8539-b335-4ce8-912c-6ae2162516cb could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:05:29.406730 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-be0f9581-170a-4942-ae23-896e9a5bbf02 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] 10.222.0.35 "GET /compute/v2.1/servers/e9bf8539-b335-4ce8-912c-6ae2162516cb/metadata" status: 404 len: 111 microversion: 2.1 time: 0.016100 Jun 10 18:05:29.406730 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1311/2556] 10.222.0.35 () {58 vars in 1262 bytes} [Fri Jun 10 18:05:29 2022] GET /compute/v2.1/servers/e9bf8539-b335-4ce8-912c-6ae2162516cb/metadata => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:05:29.423797 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-74745c44-f843-4718-8126-be3bbb88861c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:29.426530 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-74745c44-f843-4718-8126-be3bbb88861c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:29.436090 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-74745c44-f843-4718-8126-be3bbb88861c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:29.436580 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-74745c44-f843-4718-8126-be3bbb88861c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:29.440556 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-74745c44-f843-4718-8126-be3bbb88861c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:29.445159 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-74745c44-f843-4718-8126-be3bbb88861c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:29.464735 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:05:29.748906 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-74745c44-f843-4718-8126-be3bbb88861c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "POST /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1/action" status: 202 len: 0 microversion: 2.1 time: 0.357947 Jun 10 18:05:29.749551 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1312/2557] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:05:29 2022] POST /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:05:29.764112 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c5d2858f-3959-46e0-9f42-6f60c37b6f1a tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '.version_select at 0x7f77b3f47b80>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:29.956113 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-617d0675-823a-4292-a766-c992ce545f53 tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] 10.222.0.35 "DELETE /compute/v2.1/os-security-group-rules/e293dfe6-8cf4-496b-a4c9-e9553a13a508" status: 202 len: 0 microversion: 2.1 time: 0.617074 Jun 10 18:05:29.960188 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1246/2558] 10.222.0.35 () {58 vars in 1286 bytes} [Fri Jun 10 18:05:29 2022] DELETE /compute/v2.1/os-security-group-rules/e293dfe6-8cf4-496b-a4c9-e9553a13a508 => generated 0 bytes in 625 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:05:29.968593 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-65b363f3-9a32-4297-98bb-28886d4cd766 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:29.969202 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-65b363f3-9a32-4297-98bb-28886d4cd766 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:29.977960 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-65b363f3-9a32-4297-98bb-28886d4cd766 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:29.980106 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-65b363f3-9a32-4297-98bb-28886d4cd766 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:29.981125 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-65b363f3-9a32-4297-98bb-28886d4cd766 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:29.981568 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-65b363f3-9a32-4297-98bb-28886d4cd766 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:30.138198 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-65b363f3-9a32-4297-98bb-28886d4cd766 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:30.147128 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-65b363f3-9a32-4297-98bb-28886d4cd766 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:30.148770 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-65b363f3-9a32-4297-98bb-28886d4cd766 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:30.150067 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-65b363f3-9a32-4297-98bb-28886d4cd766 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1488 microversion: 2.25 time: 0.186363 Jun 10 18:05:30.150802 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1247/2559] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:05:29 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1488 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:05:30.155423 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-303c0597-2677-4ecc-b99f-afcfbb0c790f tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-601037290", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5916f11b-5717-464f-b761-826564c4c17b"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-303c0597-2677-4ecc-b99f-afcfbb0c790f tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Request method failure captured: Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 498 Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4fVKaV2yOV2R_JljWTbThJEMEjIYXgRQuhdx_KIZcVaOe4UmRGsZcdaV9rcP7GJic9zWagOCpUnX_g7LYBWqdBjRijta-GwQ5znLE0NkyU0ZOS8B9sBYUb8cWAy4b7xDsg1syrbjo-CekjQ7u2e4MVyk2x2jWtLB0CISqaTfmtlIM8 Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: a02fbcda5546455ca6ba1533af1373df Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-119967093 Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/a02fbcda5546455ca6ba1533af1373df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a02fbcda5546455ca6ba1533af1373df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a02fbcda5546455ca6ba1533af1373df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_a02fbcda5546455ca6ba1533af1373df", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-119967093 Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: a02fbcda5546455ca6ba1533af1373df Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-119967093 Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServerMetadataNegativeTestJSON-119967093-project Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: cdebe891ebac49128820e80cc5f2fca9 Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-119967093-project Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-601037290", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5916f11b-5717-464f-b761-826564c4c17b"}]}} Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-601037290', 'imageRef': 'efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '5916f11b-5717-464f-b761-826564c4c17b'}]}}} Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise error Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 10 18:05:30.163304 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 10 18:05:30.170521 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:30.170521 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 10 18:05:30.170521 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jun 10 18:05:30.170521 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:30.170521 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:30.170521 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:30.170521 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:30.170521 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:30.170521 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:30.170521 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:05:30.170521 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:05:30.170521 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:05:30.170521 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:05:30.170521 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:05:30.170521 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:05:30.170521 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 10 18:05:30.170521 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 10 18:05:30.170521 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 10 18:05:30.170521 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 10 18:05:30.170521 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 10 18:05:30.170521 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 10 18:05:30.170521 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 10 18:05:30.170521 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:30.170521 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:30.170521 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:30.170521 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:30.170521 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:30.170521 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:30.170521 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 10 18:05:30.170521 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 10 18:05:30.170521 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 10 18:05:30.170521 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:30.170521 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-303c0597-2677-4ecc-b99f-afcfbb0c790f tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:05:30.170521 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-303c0597-2677-4ecc-b99f-afcfbb0c790f tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.012876 Jun 10 18:05:30.170521 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1248/2560] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:05:30 2022] POST /compute/v2.1/servers => generated 687 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:05:30.176208 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bc945e52-a426-45c9-8570-b105eaa9263c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:30.177052 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bc945e52-a426-45c9-8570-b105eaa9263c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:30.185444 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bc945e52-a426-45c9-8570-b105eaa9263c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:30.186916 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bc945e52-a426-45c9-8570-b105eaa9263c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:30.188207 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bc945e52-a426-45c9-8570-b105eaa9263c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:30.188888 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bc945e52-a426-45c9-8570-b105eaa9263c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:30.193856 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c5d2858f-3959-46e0-9f42-6f60c37b6f1a tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "DELETE /compute/v2.1/os-security-groups/b113cd95-ae25-426a-adf9-4331d6346d01" status: 202 len: 0 microversion: 2.1 time: 0.442840 Jun 10 18:05:30.204561 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1313/2561] 10.222.0.35 () {58 vars in 1271 bytes} [Fri Jun 10 18:05:29 2022] DELETE /compute/v2.1/os-security-groups/b113cd95-ae25-426a-adf9-4331d6346d01 => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:05:30.351449 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=34 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:05:30.426091 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bc945e52-a426-45c9-8570-b105eaa9263c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:30.435855 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bc945e52-a426-45c9-8570-b105eaa9263c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1673 microversion: 2.1 time: 0.268673 Jun 10 18:05:30.437040 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1249/2562] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:30 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1673 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:30.441905 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8eacb14c-b61e-4f0c-9c75-a0a03c3c480e tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] Action: 'create', calling method: .version_select at 0x7f77c03b0820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1536459224", "description": "tempest-description-1392769023"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:30.509035 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9ca8a829-f8a9-4324-9a89-0d54eded3753 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-580122321", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "d54e5981-7a3d-42d3-ae71-85d1f7436f39"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:30.560621 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-9ca8a829-f8a9-4324-9a89-0d54eded3753 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] validate_networks() for [('d54e5981-7a3d-42d3-ae71-85d1f7436f39', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:05:30.894829 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8eacb14c-b61e-4f0c-9c75-a0a03c3c480e tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] 10.222.0.35 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.454758 Jun 10 18:05:30.894829 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1250/2563] 10.222.0.35 () {60 vars in 1179 bytes} [Fri Jun 10 18:05:30 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:30.904714 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-07efbddd-03fb-4aa3-b03c-a6a3de1b6180 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '.version_select at 0x7f77c03b0670>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:30.984243 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-9ca8a829-f8a9-4324-9a89-0d54eded3753 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:05:30.985039 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-9ca8a829-f8a9-4324-9a89-0d54eded3753 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:05:30.985533 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-9ca8a829-f8a9-4324-9a89-0d54eded3753 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:05:30.985955 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-9ca8a829-f8a9-4324-9a89-0d54eded3753 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:05:30.986410 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-9ca8a829-f8a9-4324-9a89-0d54eded3753 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:05:31.005654 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9ca8a829-f8a9-4324-9a89-0d54eded3753 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:31.005654 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9ca8a829-f8a9-4324-9a89-0d54eded3753 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:31.005654 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9ca8a829-f8a9-4324-9a89-0d54eded3753 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:31.005654 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9ca8a829-f8a9-4324-9a89-0d54eded3753 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:31.025594 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-9ca8a829-f8a9-4324-9a89-0d54eded3753 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Getting quotas for project af241982b5884c22b5e7103f1ea4b8ef. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:05:31.032629 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-9ca8a829-f8a9-4324-9a89-0d54eded3753 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Getting quotas for user 8adb0ac9df46461489fa6bd3951417cf and project af241982b5884c22b5e7103f1ea4b8ef. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:05:31.046189 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9ca8a829-f8a9-4324-9a89-0d54eded3753 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:05:31.048605 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9ca8a829-f8a9-4324-9a89-0d54eded3753 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 935bcaad-c46d-4d6c-8b00-7d349eefb5b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:05:31.179099 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-07efbddd-03fb-4aa3-b03c-a6a3de1b6180 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "DELETE /compute/v2.1/os-security-groups/722393a8-008a-4d7a-9c56-52d99668bfad" status: 202 len: 0 microversion: 2.1 time: 0.284501 Jun 10 18:05:31.179916 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1251/2564] 10.222.0.35 () {58 vars in 1271 bytes} [Fri Jun 10 18:05:30 2022] DELETE /compute/v2.1/os-security-groups/722393a8-008a-4d7a-9c56-52d99668bfad => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:05:31.188349 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1a31a5ba-a768-4b6a-acee-309c85608416 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1358446406", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5916f11b-5717-464f-b761-826564c4c17b"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1a31a5ba-a768-4b6a-acee-309c85608416 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Request method failure captured: Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 500 Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4fVKaV2yOV2R_JljWTbThJEMEjIYXgRQuhdx_KIZcVaOe4UmRGsZcdaV9rcP7GJic9zWagOCpUnX_g7LYBWqdBjRijta-GwQ5znLE0NkyU0ZOS8B9sBYUb8cWAy4b7xDsg1syrbjo-CekjQ7u2e4MVyk2x2jWtLB0CISqaTfmtlIM8 Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: a02fbcda5546455ca6ba1533af1373df Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-119967093 Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/a02fbcda5546455ca6ba1533af1373df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a02fbcda5546455ca6ba1533af1373df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a02fbcda5546455ca6ba1533af1373df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_a02fbcda5546455ca6ba1533af1373df", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-119967093 Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: a02fbcda5546455ca6ba1533af1373df Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-119967093 Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServerMetadataNegativeTestJSON-119967093-project Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: cdebe891ebac49128820e80cc5f2fca9 Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-119967093-project Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1358446406", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5916f11b-5717-464f-b761-826564c4c17b"}]}} Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1358446406', 'imageRef': 'efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '5916f11b-5717-464f-b761-826564c4c17b'}]}}} Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise error Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 10 18:05:31.190091 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 10 18:05:31.194710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:31.194710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 10 18:05:31.194710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jun 10 18:05:31.194710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:31.194710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:31.194710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:31.194710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:31.194710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:31.194710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:31.194710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:05:31.194710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:05:31.194710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:05:31.194710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:05:31.194710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:05:31.194710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:05:31.194710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 10 18:05:31.194710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 10 18:05:31.194710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 10 18:05:31.194710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 10 18:05:31.194710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 10 18:05:31.194710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 10 18:05:31.194710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 10 18:05:31.194710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:31.194710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:31.194710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:31.194710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:31.194710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:31.194710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:31.194710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 10 18:05:31.194710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 10 18:05:31.194710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 10 18:05:31.194710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:31.198064 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1a31a5ba-a768-4b6a-acee-309c85608416 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:05:31.199178 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1a31a5ba-a768-4b6a-acee-309c85608416 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.018118 Jun 10 18:05:31.200019 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1252/2565] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:05:31 2022] POST /compute/v2.1/servers => generated 689 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:05:31.204984 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9ca8a829-f8a9-4324-9a89-0d54eded3753 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.996233 Jun 10 18:05:31.207009 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1314/2566] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:05:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:05:31.208080 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f5712e6e-e6a1-49ef-b127-5077a3059160 tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] Action: 'create', calling method: .version_select at 0x7f77c0459430>, body: {"security_group_rule": {"parent_group_id": "513dcc9c-ad9e-4817-87d1-c9863b94a935", "ip_protocol": "tcp", "from_port": 104191512, "to_port": 22}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:31.221109 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a39068e6-810a-4e5b-958b-0f1b31d2a5f1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:31.221793 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a39068e6-810a-4e5b-958b-0f1b31d2a5f1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:31.252461 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a39068e6-810a-4e5b-958b-0f1b31d2a5f1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:31.253418 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a39068e6-810a-4e5b-958b-0f1b31d2a5f1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:31.262857 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a39068e6-810a-4e5b-958b-0f1b31d2a5f1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:31.264799 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a39068e6-810a-4e5b-958b-0f1b31d2a5f1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:31.275405 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-f5712e6e-e6a1-49ef-b127-5077a3059160 tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] HTTP exception thrown: Invalid port range 104191512:22. Former value cannot be greater than the later Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f5712e6e-e6a1-49ef-b127-5077a3059160 tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] Request method failure captured: Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 145 Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4fmWLCP-6Rt0dlcqEmykPR7RflxTDHKzZ791gM56jZgAvNjh1cAW0D9UAwjtFzfmxEJMTnNV6Xw2ZYSfRuZZGPc2N8FVt28WV_A_6b4mnEZIfP2jVqsVVsCR4ej6fPT5l6hj-krlC-_QJMoQVvahGDXv94S11GRtD_8znvxnp__pFY Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: c22803727b7f49bbaa7fb99f13156667 Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-442371350 Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/c22803727b7f49bbaa7fb99f13156667"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c22803727b7f49bbaa7fb99f13156667"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c22803727b7f49bbaa7fb99f13156667"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_c22803727b7f49bbaa7fb99f13156667", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-442371350 Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: c22803727b7f49bbaa7fb99f13156667 Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-442371350 Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-442371350-project Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: abc5f81394264f2dba5cd16cdb2d077d Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-442371350-project Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: {"security_group_rule": {"parent_group_id": "513dcc9c-ad9e-4817-87d1-c9863b94a935", "ip_protocol": "tcp", "from_port": 104191512, "to_port": 22}} Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: exception: Invalid port range 104191512:22. Former value cannot be greater than the later Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: action_args: {'body': {'security_group_rule': {'parent_group_id': '513dcc9c-ad9e-4817-87d1-c9863b94a935', 'ip_protocol': 'tcp', 'from_port': 104191512, 'to_port': 22}}} Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 104191512:22. Former value cannot be greater than the later Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 104191512:22. Former value cannot be greater than the later Jun 10 18:05:31.277224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:31.281657 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:31.281657 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:31.281657 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:31.281657 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:31.281657 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:31.281657 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:05:31.281657 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:05:31.281657 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 104191512:22. Former value cannot be greater than the later Jun 10 18:05:31.281657 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:31.283778 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f5712e6e-e6a1-49ef-b127-5077a3059160 tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] Returning 400 to user: Invalid port range 104191512:22. Former value cannot be greater than the later {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:05:31.284836 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f5712e6e-e6a1-49ef-b127-5077a3059160 tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] 10.222.0.35 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.083654 Jun 10 18:05:31.285592 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1253/2567] 10.222.0.35 () {60 vars in 1194 bytes} [Fri Jun 10 18:05:31 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 85 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:05:31.291517 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-708044bd-0380-4754-8b69-76a8f249af74 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Action: 'create', calling method: .version_select at 0x7f77c03b0d30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-370290728", "description": "tempest-description-2131134515"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:31.433289 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=10 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:05:31.468832 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a39068e6-810a-4e5b-958b-0f1b31d2a5f1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:31.479370 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a39068e6-810a-4e5b-958b-0f1b31d2a5f1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:31.481120 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a39068e6-810a-4e5b-958b-0f1b31d2a5f1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:31.482651 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a39068e6-810a-4e5b-958b-0f1b31d2a5f1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1488 microversion: 2.25 time: 0.273829 Jun 10 18:05:31.489374 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1315/2568] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:05:31 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1488 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:05:31.500027 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e77a9258-f734-4cac-9f7c-773e6f9b7077 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:31.502075 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e77a9258-f734-4cac-9f7c-773e6f9b7077 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 935bcaad-c46d-4d6c-8b00-7d349eefb5b2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:31.566940 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e77a9258-f734-4cac-9f7c-773e6f9b7077 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:31.574305 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e77a9258-f734-4cac-9f7c-773e6f9b7077 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/935bcaad-c46d-4d6c-8b00-7d349eefb5b2" status: 200 len: 1207 microversion: 2.1 time: 0.083494 Jun 10 18:05:31.574884 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1316/2569] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:31 2022] GET /compute/v2.1/servers/935bcaad-c46d-4d6c-8b00-7d349eefb5b2 => generated 1207 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:31.579742 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0c1db390-cd26-4404-a904-763d34211083 tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] Action: 'create', calling method: .version_select at 0x7f77b3e96160>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-437031459", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:31.581894 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-0c1db390-cd26-4404-a904-763d34211083 tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] HTTP exception thrown: Security group id should be uuid Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0c1db390-cd26-4404-a904-763d34211083 tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] Request method failure captured: Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 130 Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4fmWLCP-6Rt0dlcqEmykPR7RflxTDHKzZ791gM56jZgAvNjh1cAW0D9UAwjtFzfmxEJMTnNV6Xw2ZYSfRuZZGPc2N8FVt28WV_A_6b4mnEZIfP2jVqsVVsCR4ej6fPT5l6hj-krlC-_QJMoQVvahGDXv94S11GRtD_8znvxnp__pFY Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: c22803727b7f49bbaa7fb99f13156667 Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-442371350 Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/c22803727b7f49bbaa7fb99f13156667"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c22803727b7f49bbaa7fb99f13156667"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c22803727b7f49bbaa7fb99f13156667"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_c22803727b7f49bbaa7fb99f13156667", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-442371350 Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: c22803727b7f49bbaa7fb99f13156667 Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-442371350 Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-442371350-project Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: abc5f81394264f2dba5cd16cdb2d077d Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-442371350-project Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-437031459", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: exception: Security group id should be uuid Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-437031459', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:05:31.583658 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:05:31.589530 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Jun 10 18:05:31.589530 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:31.590508 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0c1db390-cd26-4404-a904-763d34211083 tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] Returning 400 to user: Security group id should be uuid {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:05:31.591686 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0c1db390-cd26-4404-a904-763d34211083 tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] 10.222.0.35 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.015452 Jun 10 18:05:31.593294 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1317/2570] 10.222.0.35 () {60 vars in 1194 bytes} [Fri Jun 10 18:05:31 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 10 18:05:31.598427 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2f86ab77-3179-410f-8c1c-80843d581f21 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-255893", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5916f11b-5717-464f-b761-826564c4c17b"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:31.604686 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2f86ab77-3179-410f-8c1c-80843d581f21 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Request method failure captured: Jun 10 18:05:31.604686 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 10 18:05:31.604686 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:05:31.604686 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:05:31.604686 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:05:31.604686 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 750 Jun 10 18:05:31.604686 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:05:31.604686 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:05:31.604686 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:05:31.604686 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:05:31.604686 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4fVKaV2yOV2R_JljWTbThJEMEjIYXgRQuhdx_KIZcVaOe4UmRGsZcdaV9rcP7GJic9zWagOCpUnX_g7LYBWqdBjRijta-GwQ5znLE0NkyU0ZOS8B9sBYUb8cWAy4b7xDsg1syrbjo-CekjQ7u2e4MVyk2x2jWtLB0CISqaTfmtlIM8 Jun 10 18:05:31.604686 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:05:31.604686 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:05:31.604686 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:05:31.604686 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:05:31.604686 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:05:31.604686 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:05:31.604686 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: a02fbcda5546455ca6ba1533af1373df Jun 10 18:05:31.604686 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-119967093 Jun 10 18:05:31.604686 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:05:31.604686 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:05:31.604686 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/a02fbcda5546455ca6ba1533af1373df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a02fbcda5546455ca6ba1533af1373df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a02fbcda5546455ca6ba1533af1373df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_a02fbcda5546455ca6ba1533af1373df", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:05:31.604686 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-119967093 Jun 10 18:05:31.604686 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: a02fbcda5546455ca6ba1533af1373df Jun 10 18:05:31.604686 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-119967093 Jun 10 18:05:31.604686 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServerMetadataNegativeTestJSON-119967093-project Jun 10 18:05:31.604686 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:05:31.604686 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:05:31.604686 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: cdebe891ebac49128820e80cc5f2fca9 Jun 10 18:05:31.604686 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-119967093-project Jun 10 18:05:31.604686 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:05:31.604686 chdv-master-2 devstack@n-api.service[126594]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-255893", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5916f11b-5717-464f-b761-826564c4c17b"}]}} Jun 10 18:05:31.604686 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:05:31.604686 chdv-master-2 devstack@n-api.service[126594]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 10 18:05:31.604686 chdv-master-2 devstack@n-api.service[126594]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-255893', 'imageRef': 'efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '5916f11b-5717-464f-b761-826564c4c17b'}]}}} Jun 10 18:05:31.604686 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:05:31.604686 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:31.604686 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 10 18:05:31.604686 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 10 18:05:31.604686 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 10 18:05:31.607657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise error Jun 10 18:05:31.607657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 10 18:05:31.607657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:31.607657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jun 10 18:05:31.607657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 10 18:05:31.607657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 10 18:05:31.607657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 10 18:05:31.607657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 10 18:05:31.607657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:31.607657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 10 18:05:31.607657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jun 10 18:05:31.607657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:31.607657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:31.607657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:31.607657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:31.607657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:31.607657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:31.607657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:05:31.607657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:05:31.607657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:05:31.607657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:05:31.607657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:05:31.607657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:05:31.607657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 10 18:05:31.607657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 10 18:05:31.607657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 10 18:05:31.607657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 10 18:05:31.607657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 10 18:05:31.607657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 10 18:05:31.607657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 10 18:05:31.607657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:31.607657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:31.607657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:31.607657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:31.607657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:31.607657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:31.607657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 10 18:05:31.607657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 10 18:05:31.613031 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 10 18:05:31.613031 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:31.613031 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2f86ab77-3179-410f-8c1c-80843d581f21 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:05:31.613031 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2f86ab77-3179-410f-8c1c-80843d581f21 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.011656 Jun 10 18:05:31.613031 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1318/2571] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:05:31 2022] POST /compute/v2.1/servers => generated 1197 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jun 10 18:05:31.614251 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bafe1345-99ea-4c8c-956b-3110576089b9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:31.614884 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bafe1345-99ea-4c8c-956b-3110576089b9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:31.622224 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bafe1345-99ea-4c8c-956b-3110576089b9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:31.622812 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bafe1345-99ea-4c8c-956b-3110576089b9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:31.623657 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bafe1345-99ea-4c8c-956b-3110576089b9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:31.624316 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bafe1345-99ea-4c8c-956b-3110576089b9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:31.775549 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-708044bd-0380-4754-8b69-76a8f249af74 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.488038 Jun 10 18:05:31.782259 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1254/2572] 10.222.0.35 () {60 vars in 1179 bytes} [Fri Jun 10 18:05:31 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:31.795382 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e5e61521-dc0f-4abd-b92c-cf525bbd064f tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] Action: 'create', calling method: .version_select at 0x7f77c62cc670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1255931139", "description": "tempest-description-774853385"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:32.076095 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bafe1345-99ea-4c8c-956b-3110576089b9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:32.086189 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bafe1345-99ea-4c8c-956b-3110576089b9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1653 microversion: 2.1 time: 0.478273 Jun 10 18:05:32.087021 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1319/2573] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:31 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1653 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:32.092343 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-592a4ed9-d80a-4877-a607-62907631d464 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1140899141", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5916f11b-5717-464f-b761-826564c4c17b"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:32.095870 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-592a4ed9-d80a-4877-a607-62907631d464 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Request method failure captured: Jun 10 18:05:32.095870 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 10 18:05:32.095870 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:05:32.095870 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:05:32.095870 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:05:32.095870 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 1266 Jun 10 18:05:32.095870 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:05:32.095870 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:05:32.095870 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:05:32.095870 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:05:32.095870 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4fVKaV2yOV2R_JljWTbThJEMEjIYXgRQuhdx_KIZcVaOe4UmRGsZcdaV9rcP7GJic9zWagOCpUnX_g7LYBWqdBjRijta-GwQ5znLE0NkyU0ZOS8B9sBYUb8cWAy4b7xDsg1syrbjo-CekjQ7u2e4MVyk2x2jWtLB0CISqaTfmtlIM8 Jun 10 18:05:32.095870 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:05:32.095870 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:05:32.095870 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:05:32.095870 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:05:32.095870 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:05:32.095870 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:05:32.095870 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: a02fbcda5546455ca6ba1533af1373df Jun 10 18:05:32.095870 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-119967093 Jun 10 18:05:32.095870 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:05:32.095870 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:05:32.095870 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/a02fbcda5546455ca6ba1533af1373df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a02fbcda5546455ca6ba1533af1373df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a02fbcda5546455ca6ba1533af1373df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_a02fbcda5546455ca6ba1533af1373df", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:05:32.095870 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-119967093 Jun 10 18:05:32.095870 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: a02fbcda5546455ca6ba1533af1373df Jun 10 18:05:32.095870 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-119967093 Jun 10 18:05:32.095870 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServerMetadataNegativeTestJSON-119967093-project Jun 10 18:05:32.095870 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:05:32.095870 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:05:32.095870 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: cdebe891ebac49128820e80cc5f2fca9 Jun 10 18:05:32.095870 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-119967093-project Jun 10 18:05:32.095870 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:05:32.095870 chdv-master-2 devstack@n-api.service[126594]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1140899141", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5916f11b-5717-464f-b761-826564c4c17b"}]}} Jun 10 18:05:32.095870 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:05:32.098306 chdv-master-2 devstack@n-api.service[126594]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 10 18:05:32.098306 chdv-master-2 devstack@n-api.service[126594]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1140899141', 'imageRef': 'efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '5916f11b-5717-464f-b761-826564c4c17b'}]}}} Jun 10 18:05:32.098306 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:05:32.098306 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:32.098306 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 10 18:05:32.098306 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 10 18:05:32.098306 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 10 18:05:32.098306 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise error Jun 10 18:05:32.098306 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 10 18:05:32.098306 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:32.098306 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jun 10 18:05:32.098306 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 10 18:05:32.098306 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 10 18:05:32.098306 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 10 18:05:32.098306 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 10 18:05:32.098306 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:32.098306 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 10 18:05:32.099540 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jun 10 18:05:32.099540 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:32.099540 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:32.099540 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:32.099540 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:32.099540 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:32.099540 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:32.099540 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:05:32.099540 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:05:32.099540 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:05:32.099540 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:05:32.099540 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:05:32.099540 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:05:32.099540 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 10 18:05:32.099540 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 10 18:05:32.099540 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 10 18:05:32.099540 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 10 18:05:32.099540 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 10 18:05:32.099540 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 10 18:05:32.099540 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 10 18:05:32.099540 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:32.099540 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:32.099540 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:32.099540 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:32.099540 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:32.099540 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:32.099540 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 10 18:05:32.099540 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 10 18:05:32.104086 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 10 18:05:32.104086 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:32.105420 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-592a4ed9-d80a-4877-a607-62907631d464 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:05:32.106599 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-592a4ed9-d80a-4877-a607-62907631d464 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.018403 Jun 10 18:05:32.107386 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1320/2574] 10.222.0.35 () {60 vars in 1147 bytes} [Fri Jun 10 18:05:32 2022] POST /compute/v2.1/servers => generated 2221 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jun 10 18:05:32.115488 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e4a6d075-9da8-4c99-a3a8-e15bd4dd7d51 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Action: 'update', calling method: .version_select at 0x7f77b3ee4820>, body: {"security_group": {"name": "tempest-sg-hth-945501413", "description": "tempest-description-hth-832065532"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:32.398920 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e4a6d075-9da8-4c99-a3a8-e15bd4dd7d51 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "PUT /compute/v2.1/os-security-groups/204de29e-a1bb-4983-be3f-bebd804265bc" status: 200 len: 216 microversion: 2.1 time: 0.287759 Jun 10 18:05:32.423660 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1321/2575] 10.222.0.35 () {60 vars in 1289 bytes} [Fri Jun 10 18:05:32 2022] PUT /compute/v2.1/os-security-groups/204de29e-a1bb-4983-be3f-bebd804265bc => generated 216 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:32.423660 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cdbd2596-67b1-4f61-979c-596a10e80cf2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:32.423660 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cdbd2596-67b1-4f61-979c-596a10e80cf2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:32.423660 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cdbd2596-67b1-4f61-979c-596a10e80cf2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:32.423660 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cdbd2596-67b1-4f61-979c-596a10e80cf2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:32.423660 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cdbd2596-67b1-4f61-979c-596a10e80cf2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:32.423660 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cdbd2596-67b1-4f61-979c-596a10e80cf2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:32.528013 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e5e61521-dc0f-4abd-b92c-cf525bbd064f tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] 10.222.0.35 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.743999 Jun 10 18:05:32.532400 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1255/2576] 10.222.0.35 () {60 vars in 1179 bytes} [Fri Jun 10 18:05:31 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:32.548142 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c9096e24-20a2-4539-b890-5f4168ff2f4f tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:32.548686 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c9096e24-20a2-4539-b890-5f4168ff2f4f tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] [instance: 78cbdcec-ed67-48ac-b3ea-4af5386cdf46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:32.561154 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-c9096e24-20a2-4539-b890-5f4168ff2f4f tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] HTTP exception thrown: Instance 78cbdcec-ed67-48ac-b3ea-4af5386cdf46 could not be found. Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c9096e24-20a2-4539-b890-5f4168ff2f4f tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Request method failure captured: Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/78cbdcec-ed67-48ac-b3ea-4af5386cdf46/metadata/test2 HTTP/1.1 Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4fVKaV2yOV2R_JljWTbThJEMEjIYXgRQuhdx_KIZcVaOe4UmRGsZcdaV9rcP7GJic9zWagOCpUnX_g7LYBWqdBjRijta-GwQ5znLE0NkyU0ZOS8B9sBYUb8cWAy4b7xDsg1syrbjo-CekjQ7u2e4MVyk2x2jWtLB0CISqaTfmtlIM8 Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: a02fbcda5546455ca6ba1533af1373df Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-119967093 Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/a02fbcda5546455ca6ba1533af1373df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a02fbcda5546455ca6ba1533af1373df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a02fbcda5546455ca6ba1533af1373df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_a02fbcda5546455ca6ba1533af1373df", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-119967093 Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: a02fbcda5546455ca6ba1533af1373df Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-119967093 Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServerMetadataNegativeTestJSON-119967093-project Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: cdebe891ebac49128820e80cc5f2fca9 Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-119967093-project Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 78cbdcec-ed67-48ac-b3ea-4af5386cdf46 could not be found. Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: action_args: {'server_id': '78cbdcec-ed67-48ac-b3ea-4af5386cdf46', 'id': 'test2'} Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78cbdcec-ed67-48ac-b3ea-4af5386cdf46 could not be found. Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78cbdcec-ed67-48ac-b3ea-4af5386cdf46 could not be found. Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:32.562934 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:32.568400 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:05:32.568400 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:05:32.568400 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78cbdcec-ed67-48ac-b3ea-4af5386cdf46 could not be found. Jun 10 18:05:32.568400 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:32.569974 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c9096e24-20a2-4539-b890-5f4168ff2f4f tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Returning 404 to user: Instance 78cbdcec-ed67-48ac-b3ea-4af5386cdf46 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:05:32.570835 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c9096e24-20a2-4539-b890-5f4168ff2f4f tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] 10.222.0.35 "GET /compute/v2.1/servers/78cbdcec-ed67-48ac-b3ea-4af5386cdf46/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.040806 Jun 10 18:05:32.571413 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1256/2577] 10.222.0.35 () {58 vars in 1280 bytes} [Fri Jun 10 18:05:32 2022] GET /compute/v2.1/servers/78cbdcec-ed67-48ac-b3ea-4af5386cdf46/metadata/test2 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:05:32.623795 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cdbd2596-67b1-4f61-979c-596a10e80cf2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "POST /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1/action" status: 202 len: 0 microversion: 2.1 time: 0.222659 Jun 10 18:05:32.625224 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1322/2578] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:05:32 2022] POST /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:05:32.635829 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3d4e77e2-57f7-4b78-8334-69fdfaeec921 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '.version_select at 0x7f77b3ee4c10>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:32.853806 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2c3fd129-3823-4944-a66a-56865641fc85 tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] Calling method '.version_select at 0x7f77c61081f0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:32.934993 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2c3fd129-3823-4944-a66a-56865641fc85 tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] 10.222.0.35 "GET /compute/v2.1/os-quota-sets/42320403f2de43218dbbcf61fcc1ece9" status: 200 len: 371 microversion: 2.1 time: 0.362426 Jun 10 18:05:32.935502 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1257/2579] 10.222.0.35 () {58 vars in 1241 bytes} [Fri Jun 10 18:05:32 2022] GET /compute/v2.1/os-quota-sets/42320403f2de43218dbbcf61fcc1ece9 => generated 371 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:32.940533 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-04a601b2-d11b-496e-8681-44ffa7521afc tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:32.941076 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-04a601b2-d11b-496e-8681-44ffa7521afc tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:32.948263 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-04a601b2-d11b-496e-8681-44ffa7521afc tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:32.948861 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-04a601b2-d11b-496e-8681-44ffa7521afc tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:32.949478 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-04a601b2-d11b-496e-8681-44ffa7521afc tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:32.949919 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-04a601b2-d11b-496e-8681-44ffa7521afc tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:32.990450 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3d4e77e2-57f7-4b78-8334-69fdfaeec921 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/os-security-groups/204de29e-a1bb-4983-be3f-bebd804265bc" status: 200 len: 216 microversion: 2.1 time: 0.363958 Jun 10 18:05:32.991606 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1323/2580] 10.222.0.35 () {58 vars in 1268 bytes} [Fri Jun 10 18:05:32 2022] GET /compute/v2.1/os-security-groups/204de29e-a1bb-4983-be3f-bebd804265bc => generated 216 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:32.997688 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-98fd631e-7f63-494a-9730-142bd51ed08b tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] Action: 'create', calling method: .version_select at 0x7f77b3ed69d0>, body: {"security_group_rule": {"parent_group_id": "60054dc6-17c0-4bff-8384-9269265da540", "ip_protocol": "tempest-999-1418021351", "from_port": 22, "to_port": 22}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:33.049238 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-98fd631e-7f63-494a-9730-142bd51ed08b tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] HTTP exception thrown: Invalid IP protocol tempest-999-1418021351. Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-98fd631e-7f63-494a-9730-142bd51ed08b tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] Request method failure captured: Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 157 Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4fmWLCP-6Rt0dlcqEmykPR7RflxTDHKzZ791gM56jZgAvNjh1cAW0D9UAwjtFzfmxEJMTnNV6Xw2ZYSfRuZZGPc2N8FVt28WV_A_6b4mnEZIfP2jVqsVVsCR4ej6fPT5l6hj-krlC-_QJMoQVvahGDXv94S11GRtD_8znvxnp__pFY Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: c22803727b7f49bbaa7fb99f13156667 Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-442371350 Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/c22803727b7f49bbaa7fb99f13156667"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c22803727b7f49bbaa7fb99f13156667"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c22803727b7f49bbaa7fb99f13156667"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_c22803727b7f49bbaa7fb99f13156667", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-442371350 Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: c22803727b7f49bbaa7fb99f13156667 Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-442371350 Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-442371350-project Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: abc5f81394264f2dba5cd16cdb2d077d Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-442371350-project Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: {"security_group_rule": {"parent_group_id": "60054dc6-17c0-4bff-8384-9269265da540", "ip_protocol": "tempest-999-1418021351", "from_port": 22, "to_port": 22}} Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: exception: Invalid IP protocol tempest-999-1418021351. Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: action_args: {'body': {'security_group_rule': {'parent_group_id': '60054dc6-17c0-4bff-8384-9269265da540', 'ip_protocol': 'tempest-999-1418021351', 'from_port': 22, 'to_port': 22}}} Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1418021351. Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1418021351. Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:33.052520 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:33.066269 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:33.066269 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:33.066269 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:33.066269 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:33.066269 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:05:33.066269 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:05:33.066269 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1418021351. Jun 10 18:05:33.066269 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:33.066269 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-98fd631e-7f63-494a-9730-142bd51ed08b tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] Returning 400 to user: Invalid IP protocol tempest-999-1418021351. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:05:33.066269 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-98fd631e-7f63-494a-9730-142bd51ed08b tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] 10.222.0.35 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.062658 Jun 10 18:05:33.066269 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1324/2581] 10.222.0.35 () {60 vars in 1194 bytes} [Fri Jun 10 18:05:32 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 64 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 10 18:05:33.066269 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9d39447d-4207-464c-8b09-79c109e37d20 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:33.067522 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9d39447d-4207-464c-8b09-79c109e37d20 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] [instance: 7928b35c-fde4-48c5-8068-a32c4395684b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:33.076537 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9d39447d-4207-464c-8b09-79c109e37d20 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:33.077162 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9d39447d-4207-464c-8b09-79c109e37d20 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:33.078086 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9d39447d-4207-464c-8b09-79c109e37d20 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:33.078650 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9d39447d-4207-464c-8b09-79c109e37d20 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:33.123626 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9d39447d-4207-464c-8b09-79c109e37d20 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] [instance: 7928b35c-fde4-48c5-8068-a32c4395684b] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:05:33.166416 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-04a601b2-d11b-496e-8681-44ffa7521afc tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:33.175560 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-04a601b2-d11b-496e-8681-44ffa7521afc tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:33.180922 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-04a601b2-d11b-496e-8681-44ffa7521afc tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:33.180922 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-04a601b2-d11b-496e-8681-44ffa7521afc tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1488 microversion: 2.25 time: 0.243407 Jun 10 18:05:33.192750 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1258/2582] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:05:32 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1488 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:05:33.199989 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0ea40adb-b4ef-4fbf-ac15-e858ea4a10da tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:33.201083 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0ea40adb-b4ef-4fbf-ac15-e858ea4a10da tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 935bcaad-c46d-4d6c-8b00-7d349eefb5b2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:33.209010 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0ea40adb-b4ef-4fbf-ac15-e858ea4a10da tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:33.213727 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0ea40adb-b4ef-4fbf-ac15-e858ea4a10da tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:33.213727 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0ea40adb-b4ef-4fbf-ac15-e858ea4a10da tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:33.213727 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0ea40adb-b4ef-4fbf-ac15-e858ea4a10da tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:33.281344 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0ea40adb-b4ef-4fbf-ac15-e858ea4a10da tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:33.289447 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0ea40adb-b4ef-4fbf-ac15-e858ea4a10da tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/935bcaad-c46d-4d6c-8b00-7d349eefb5b2" status: 200 len: 1203 microversion: 2.1 time: 0.094994 Jun 10 18:05:33.290027 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1259/2583] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:33 2022] GET /compute/v2.1/servers/935bcaad-c46d-4d6c-8b00-7d349eefb5b2 => generated 1203 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:33.294492 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ab4e2238-2576-4364-9526-2f415aa4bb8e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:33.302871 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ab4e2238-2576-4364-9526-2f415aa4bb8e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:33.302871 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ab4e2238-2576-4364-9526-2f415aa4bb8e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:33.302871 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ab4e2238-2576-4364-9526-2f415aa4bb8e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:33.302871 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ab4e2238-2576-4364-9526-2f415aa4bb8e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:33.302871 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ab4e2238-2576-4364-9526-2f415aa4bb8e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:33.454083 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ab4e2238-2576-4364-9526-2f415aa4bb8e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:33.462307 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ab4e2238-2576-4364-9526-2f415aa4bb8e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.171238 Jun 10 18:05:33.462918 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1260/2584] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:33 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:33.467717 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2332b538-33fa-44d6-a07d-aae2aa5d5ab6 tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] Action: 'update', calling method: .version_select at 0x7f77c051af70>, body: {"quota_set": {"ram": "5120"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:33.522316 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9d39447d-4207-464c-8b09-79c109e37d20 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] 10.222.0.35 "DELETE /compute/v2.1/servers/7928b35c-fde4-48c5-8068-a32c4395684b" status: 204 len: 0 microversion: 2.1 time: 0.462940 Jun 10 18:05:33.523225 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1325/2585] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:05:33 2022] DELETE /compute/v2.1/servers/7928b35c-fde4-48c5-8068-a32c4395684b => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:05:33.528913 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e11fe614-592b-4233-8b1b-050cfa99ce4b tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '.version_select at 0x7f77b3ee48b0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:33.673997 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2332b538-33fa-44d6-a07d-aae2aa5d5ab6 tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:33.673997 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2332b538-33fa-44d6-a07d-aae2aa5d5ab6 tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:33.673997 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2332b538-33fa-44d6-a07d-aae2aa5d5ab6 tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:33.673997 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2332b538-33fa-44d6-a07d-aae2aa5d5ab6 tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:33.788729 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2332b538-33fa-44d6-a07d-aae2aa5d5ab6 tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] 10.222.0.35 "PUT /compute/v2.1/os-quota-sets/42320403f2de43218dbbcf61fcc1ece9" status: 200 len: 328 microversion: 2.1 time: 0.324461 Jun 10 18:05:33.789470 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1261/2586] 10.222.0.35 () {60 vars in 1261 bytes} [Fri Jun 10 18:05:33 2022] PUT /compute/v2.1/os-quota-sets/42320403f2de43218dbbcf61fcc1ece9 => generated 328 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:33.794531 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e951f7f5-f48e-4678-8a81-a166d2981d14 tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] Action: 'create', calling method: .version_select at 0x7f77c0499ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1667766786", "description": "tempest-description-302653124"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:33.815334 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e11fe614-592b-4233-8b1b-050cfa99ce4b tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "DELETE /compute/v2.1/os-security-groups/204de29e-a1bb-4983-be3f-bebd804265bc" status: 202 len: 0 microversion: 2.1 time: 0.290592 Jun 10 18:05:33.819793 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1326/2587] 10.222.0.35 () {58 vars in 1271 bytes} [Fri Jun 10 18:05:33 2022] DELETE /compute/v2.1/os-security-groups/204de29e-a1bb-4983-be3f-bebd804265bc => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:05:33.824903 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-477ad99b-70e0-4b5c-96e5-0791693d3c63 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:33.825653 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-477ad99b-70e0-4b5c-96e5-0791693d3c63 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:33.827854 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:05:33.834911 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-477ad99b-70e0-4b5c-96e5-0791693d3c63 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:33.835944 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-477ad99b-70e0-4b5c-96e5-0791693d3c63 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:33.836344 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-477ad99b-70e0-4b5c-96e5-0791693d3c63 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:33.837239 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-477ad99b-70e0-4b5c-96e5-0791693d3c63 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:33.971539 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-477ad99b-70e0-4b5c-96e5-0791693d3c63 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:33.980960 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-477ad99b-70e0-4b5c-96e5-0791693d3c63 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.159852 Jun 10 18:05:33.981851 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1327/2588] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:33 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:33.987236 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-92f7d74c-a04f-486a-b7bc-145ceaa5af42 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:33.990232 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-92f7d74c-a04f-486a-b7bc-145ceaa5af42 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] [instance: 7928b35c-fde4-48c5-8068-a32c4395684b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:34.005589 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-92f7d74c-a04f-486a-b7bc-145ceaa5af42 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:34.006053 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-92f7d74c-a04f-486a-b7bc-145ceaa5af42 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:34.007458 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-92f7d74c-a04f-486a-b7bc-145ceaa5af42 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:34.008345 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-92f7d74c-a04f-486a-b7bc-145ceaa5af42 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:34.157493 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-92f7d74c-a04f-486a-b7bc-145ceaa5af42 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebe891ebac49128820e80cc5f2fca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02fbcda5546455ca6ba1533af1373df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:34.172694 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-92f7d74c-a04f-486a-b7bc-145ceaa5af42 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] 10.222.0.35 "GET /compute/v2.1/servers/7928b35c-fde4-48c5-8068-a32c4395684b" status: 200 len: 1524 microversion: 2.1 time: 0.189429 Jun 10 18:05:34.173497 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1328/2589] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:33 2022] GET /compute/v2.1/servers/7928b35c-fde4-48c5-8068-a32c4395684b => generated 1524 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:34.181537 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2b73cf97-1232-4b20-9931-a748bd6c44a2 tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:34.242684 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e951f7f5-f48e-4678-8a81-a166d2981d14 tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] 10.222.0.35 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.449582 Jun 10 18:05:34.242684 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1262/2590] 10.222.0.35 () {60 vars in 1179 bytes} [Fri Jun 10 18:05:33 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:34.247208 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d77f2c0e-a257-4062-9360-f307464ac4fb tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:34.248087 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d77f2c0e-a257-4062-9360-f307464ac4fb tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: b6fe7ee7-fe32-4aa2-8616-784a199a4973] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:34.254431 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d77f2c0e-a257-4062-9360-f307464ac4fb tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:34.254886 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d77f2c0e-a257-4062-9360-f307464ac4fb tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:34.255652 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d77f2c0e-a257-4062-9360-f307464ac4fb tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:34.256082 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d77f2c0e-a257-4062-9360-f307464ac4fb tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:34.262226 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2b73cf97-1232-4b20-9931-a748bd6c44a2 tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] 10.222.0.35 "DELETE /compute/v2.1/os-quota-sets/42320403f2de43218dbbcf61fcc1ece9" status: 202 len: 0 microversion: 2.1 time: 0.087446 Jun 10 18:05:34.265627 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1329/2591] 10.222.0.35 () {58 vars in 1244 bytes} [Fri Jun 10 18:05:34 2022] DELETE /compute/v2.1/os-quota-sets/42320403f2de43218dbbcf61fcc1ece9 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:05:34.268645 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-feca5ba8-24f1-4a4c-aedf-46ce4ae52a21 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:34.269409 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-feca5ba8-24f1-4a4c-aedf-46ce4ae52a21 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:34.276592 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-feca5ba8-24f1-4a4c-aedf-46ce4ae52a21 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:34.278090 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-feca5ba8-24f1-4a4c-aedf-46ce4ae52a21 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:34.279271 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-feca5ba8-24f1-4a4c-aedf-46ce4ae52a21 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:34.279410 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-d77f2c0e-a257-4062-9360-f307464ac4fb tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] HTTP exception thrown: Instance b6fe7ee7-fe32-4aa2-8616-784a199a4973 could not be found. Jun 10 18:05:34.280022 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-feca5ba8-24f1-4a4c-aedf-46ce4ae52a21 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d77f2c0e-a257-4062-9360-f307464ac4fb tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Request method failure captured: Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973 HTTP/1.1 Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4eKfGQZQ_jvhwHBxZ1GMnYHkMaBNBt7T8Ue90hW5x7BTDgkg2AiOfeu2huz2YQsnFH29P56VFWZd48_hROirge71TvR4QiKyTENHZz-D3t9ZS-m9216ej7Rjuw3slpnWYAQuE-KXkyXTlRqKM7yyNbBp9KRqjUFN-v2IWlTc7Yfat0 Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 304a5340852d4552a490e874dda8a0a3 Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_304a5340852d4552a490e874dda8a0a3", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 304a5340852d4552a490e874dda8a0a3 Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-SecurityGroupsTestJSON-732923421-project Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 7278ccddeee3495583093603a0fdb626 Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-SecurityGroupsTestJSON-732923421-project Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: exception: Instance b6fe7ee7-fe32-4aa2-8616-784a199a4973 could not be found. Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'b6fe7ee7-fe32-4aa2-8616-784a199a4973'} Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6fe7ee7-fe32-4aa2-8616-784a199a4973 could not be found. Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:05:34.280968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:05:34.287541 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6fe7ee7-fe32-4aa2-8616-784a199a4973 could not be found. Jun 10 18:05:34.287541 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:34.287541 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:34.287541 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:34.287541 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:34.287541 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:34.287541 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:34.287541 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:05:34.287541 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:05:34.287541 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6fe7ee7-fe32-4aa2-8616-784a199a4973 could not be found. Jun 10 18:05:34.287541 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:34.287541 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d77f2c0e-a257-4062-9360-f307464ac4fb tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Returning 404 to user: Instance b6fe7ee7-fe32-4aa2-8616-784a199a4973 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:05:34.287541 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d77f2c0e-a257-4062-9360-f307464ac4fb tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "DELETE /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973" status: 404 len: 111 microversion: 2.1 time: 0.039848 Jun 10 18:05:34.287541 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1263/2592] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:05:34 2022] DELETE /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:05:34.290443 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-16685975-1590-4e4d-bca9-4a893fe487c0 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:34.290443 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-16685975-1590-4e4d-bca9-4a893fe487c0 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:34.294998 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-16685975-1590-4e4d-bca9-4a893fe487c0 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:34.295477 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-16685975-1590-4e4d-bca9-4a893fe487c0 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:34.296247 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-16685975-1590-4e4d-bca9-4a893fe487c0 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:34.296710 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-16685975-1590-4e4d-bca9-4a893fe487c0 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:34.437479 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-feca5ba8-24f1-4a4c-aedf-46ce4ae52a21 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:34.447004 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-feca5ba8-24f1-4a4c-aedf-46ce4ae52a21 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.182688 Jun 10 18:05:34.447587 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1330/2593] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:34 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:34.452853 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f40ff499-884b-42df-a11f-f32439406092 tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] Action: 'create', calling method: .version_select at 0x7f77b3ed6040>, body: {"security_group_rule": {"parent_group_id": "b0811cb6-d384-4c65-a6ae-a5e7b2702627", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:34.506981 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-f40ff499-884b-42df-a11f-f32439406092 tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f40ff499-884b-42df-a11f-f32439406092 tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] Request method failure captured: Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 138 Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4fmWLCP-6Rt0dlcqEmykPR7RflxTDHKzZ791gM56jZgAvNjh1cAW0D9UAwjtFzfmxEJMTnNV6Xw2ZYSfRuZZGPc2N8FVt28WV_A_6b4mnEZIfP2jVqsVVsCR4ej6fPT5l6hj-krlC-_QJMoQVvahGDXv94S11GRtD_8znvxnp__pFY Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: c22803727b7f49bbaa7fb99f13156667 Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-442371350 Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/c22803727b7f49bbaa7fb99f13156667"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c22803727b7f49bbaa7fb99f13156667"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c22803727b7f49bbaa7fb99f13156667"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_c22803727b7f49bbaa7fb99f13156667", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-442371350 Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: c22803727b7f49bbaa7fb99f13156667 Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-442371350 Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-442371350-project Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: abc5f81394264f2dba5cd16cdb2d077d Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-442371350-project Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: {"security_group_rule": {"parent_group_id": "b0811cb6-d384-4c65-a6ae-a5e7b2702627", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: exception: Invalid port range 22:21. Former value cannot be greater than the later Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'b0811cb6-d384-4c65-a6ae-a5e7b2702627', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Jun 10 18:05:34.509533 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:34.517385 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:34.517385 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:34.517385 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:34.517385 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:34.517385 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:34.517385 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:05:34.517385 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:05:34.517385 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Jun 10 18:05:34.517385 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:34.517385 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f40ff499-884b-42df-a11f-f32439406092 tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:05:34.517385 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f40ff499-884b-42df-a11f-f32439406092 tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] 10.222.0.35 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.062191 Jun 10 18:05:34.517385 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1331/2594] 10.222.0.35 () {60 vars in 1194 bytes} [Fri Jun 10 18:05:34 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 63 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:05:34.519514 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-58776c26-763a-4652-92bd-ffca38ea02ec tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] Calling method '.version_select at 0x7f77b3ee4d30>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:34.733716 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-16685975-1590-4e4d-bca9-4a893fe487c0 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:34.742689 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-16685975-1590-4e4d-bca9-4a893fe487c0 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:34.744755 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-16685975-1590-4e4d-bca9-4a893fe487c0 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:34.745929 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-16685975-1590-4e4d-bca9-4a893fe487c0 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1488 microversion: 2.25 time: 0.462108 Jun 10 18:05:34.746491 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1264/2595] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:05:34 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1488 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:05:34.751368 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-837545c7-b706-4b70-b8ce-2b6e2fea3404 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:34.752044 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-837545c7-b706-4b70-b8ce-2b6e2fea3404 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: b6fe7ee7-fe32-4aa2-8616-784a199a4973] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:34.758292 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-837545c7-b706-4b70-b8ce-2b6e2fea3404 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:34.758684 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-837545c7-b706-4b70-b8ce-2b6e2fea3404 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:34.759442 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-837545c7-b706-4b70-b8ce-2b6e2fea3404 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:34.759879 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-837545c7-b706-4b70-b8ce-2b6e2fea3404 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:34.774452 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-837545c7-b706-4b70-b8ce-2b6e2fea3404 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] HTTP exception thrown: Instance b6fe7ee7-fe32-4aa2-8616-784a199a4973 could not be found. Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-837545c7-b706-4b70-b8ce-2b6e2fea3404 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Request method failure captured: Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973 HTTP/1.1 Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4eKfGQZQ_jvhwHBxZ1GMnYHkMaBNBt7T8Ue90hW5x7BTDgkg2AiOfeu2huz2YQsnFH29P56VFWZd48_hROirge71TvR4QiKyTENHZz-D3t9ZS-m9216ej7Rjuw3slpnWYAQuE-KXkyXTlRqKM7yyNbBp9KRqjUFN-v2IWlTc7Yfat0 Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 304a5340852d4552a490e874dda8a0a3 Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_304a5340852d4552a490e874dda8a0a3", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 304a5340852d4552a490e874dda8a0a3 Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-SecurityGroupsTestJSON-732923421-project Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 7278ccddeee3495583093603a0fdb626 Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-SecurityGroupsTestJSON-732923421-project Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: exception: Instance b6fe7ee7-fe32-4aa2-8616-784a199a4973 could not be found. Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'b6fe7ee7-fe32-4aa2-8616-784a199a4973'} Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6fe7ee7-fe32-4aa2-8616-784a199a4973 could not be found. Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6fe7ee7-fe32-4aa2-8616-784a199a4973 could not be found. Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:34.776558 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:34.784008 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:34.784008 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:34.784008 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:34.784008 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:05:34.784008 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:05:34.784008 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6fe7ee7-fe32-4aa2-8616-784a199a4973 could not be found. Jun 10 18:05:34.784008 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:34.784008 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-837545c7-b706-4b70-b8ce-2b6e2fea3404 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Returning 404 to user: Instance b6fe7ee7-fe32-4aa2-8616-784a199a4973 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:05:34.784008 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-837545c7-b706-4b70-b8ce-2b6e2fea3404 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973" status: 404 len: 111 microversion: 2.1 time: 0.034570 Jun 10 18:05:34.785586 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1265/2596] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:34 2022] GET /compute/v2.1/servers/b6fe7ee7-fe32-4aa2-8616-784a199a4973 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:05:34.791203 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-70c31b5a-fdde-4b0e-8c84-143f0ccfe4b4 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:34.791807 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-70c31b5a-fdde-4b0e-8c84-143f0ccfe4b4 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 935bcaad-c46d-4d6c-8b00-7d349eefb5b2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:34.797734 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70c31b5a-fdde-4b0e-8c84-143f0ccfe4b4 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:34.798323 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70c31b5a-fdde-4b0e-8c84-143f0ccfe4b4 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:34.798929 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70c31b5a-fdde-4b0e-8c84-143f0ccfe4b4 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:34.799362 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70c31b5a-fdde-4b0e-8c84-143f0ccfe4b4 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:34.828966 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-58776c26-763a-4652-92bd-ffca38ea02ec tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] 10.222.0.35 "GET /compute/v2.1/os-quota-sets/42320403f2de43218dbbcf61fcc1ece9" status: 200 len: 371 microversion: 2.1 time: 0.315402 Jun 10 18:05:34.835883 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1332/2597] 10.222.0.35 () {58 vars in 1241 bytes} [Fri Jun 10 18:05:34 2022] GET /compute/v2.1/os-quota-sets/42320403f2de43218dbbcf61fcc1ece9 => generated 371 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:34.841111 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d8c409c9-a567-4626-9f98-a458beea56b7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:34.841731 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d8c409c9-a567-4626-9f98-a458beea56b7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:34.847749 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d8c409c9-a567-4626-9f98-a458beea56b7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:34.854560 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d8c409c9-a567-4626-9f98-a458beea56b7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:34.854560 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d8c409c9-a567-4626-9f98-a458beea56b7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:34.854560 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d8c409c9-a567-4626-9f98-a458beea56b7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:34.913277 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-70c31b5a-fdde-4b0e-8c84-143f0ccfe4b4 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:34.923873 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-70c31b5a-fdde-4b0e-8c84-143f0ccfe4b4 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/935bcaad-c46d-4d6c-8b00-7d349eefb5b2" status: 200 len: 1265 microversion: 2.1 time: 0.136949 Jun 10 18:05:34.924807 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1266/2598] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:34 2022] GET /compute/v2.1/servers/935bcaad-c46d-4d6c-8b00-7d349eefb5b2 => generated 1265 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:34.930228 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3e4bfd70-5e2f-4e42-ad60-9c0c3fec8223 tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] Action: 'create', calling method: .version_select at 0x7f77c048f4c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1364093352", "description": "tempest-description-497404980"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:35.033010 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d8c409c9-a567-4626-9f98-a458beea56b7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:35.042316 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d8c409c9-a567-4626-9f98-a458beea56b7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.204754 Jun 10 18:05:35.043183 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1333/2599] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:34 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:35.053844 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c4b921ba-365c-478d-a1e3-6e841ec29efe tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '.version_select at 0x7f77b3f66dc0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:35.073035 chdv-master-2 devstack@n-api.service[126594]: DEBUG neutronclient.v2_0.client [None req-c4b921ba-365c-478d-a1e3-6e841ec29efe tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 722393a8-008a-4d7a-9c56-52d99668bfad does not exist", "detail": ""}} {{(pid=126594) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 10 18:05:35.073650 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.security_group_api [None req-c4b921ba-365c-478d-a1e3-6e841ec29efe tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Neutron security group 722393a8-008a-4d7a-9c56-52d99668bfad not found {{(pid=126594) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 10 18:05:35.074185 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-c4b921ba-365c-478d-a1e3-6e841ec29efe tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] HTTP exception thrown: Security group 722393a8-008a-4d7a-9c56-52d99668bfad does not exist Jun 10 18:05:35.074185 chdv-master-2 devstack@n-api.service[126594]: Neutron server returns request_ids: ['req-d74651d5-72d0-4a18-81de-aa411478b53c'] Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c4b921ba-365c-478d-a1e3-6e841ec29efe tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Request method failure captured: Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: request: DELETE /compute/v2.1/os-security-groups/722393a8-008a-4d7a-9c56-52d99668bfad HTTP/1.1 Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4eKfGQZQ_jvhwHBxZ1GMnYHkMaBNBt7T8Ue90hW5x7BTDgkg2AiOfeu2huz2YQsnFH29P56VFWZd48_hROirge71TvR4QiKyTENHZz-D3t9ZS-m9216ej7Rjuw3slpnWYAQuE-KXkyXTlRqKM7yyNbBp9KRqjUFN-v2IWlTc7Yfat0 Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 304a5340852d4552a490e874dda8a0a3 Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_304a5340852d4552a490e874dda8a0a3", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 304a5340852d4552a490e874dda8a0a3 Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-SecurityGroupsTestJSON-732923421-project Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 7278ccddeee3495583093603a0fdb626 Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-SecurityGroupsTestJSON-732923421-project Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: exception: Security group 722393a8-008a-4d7a-9c56-52d99668bfad does not exist Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: Neutron server returns request_ids: ['req-d74651d5-72d0-4a18-81de-aa411478b53c'] Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '722393a8-008a-4d7a-9c56-52d99668bfad'} Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 10 18:05:35.076024 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 722393a8-008a-4d7a-9c56-52d99668bfad does not exist Jun 10 18:05:35.081947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d74651d5-72d0-4a18-81de-aa411478b53c'] Jun 10 18:05:35.081947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:35.081947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:35.081947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:35.081947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:35.081947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 10 18:05:35.081947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 10 18:05:35.081947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 10 18:05:35.081947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 10 18:05:35.081947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 722393a8-008a-4d7a-9c56-52d99668bfad does not exist Jun 10 18:05:35.081947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d74651d5-72d0-4a18-81de-aa411478b53c'] Jun 10 18:05:35.081947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:35.081947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:35.081947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:35.081947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:35.081947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:35.081947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:35.081947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:05:35.081947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:05:35.081947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:05:35.081947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:05:35.081947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:05:35.081947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:05:35.081947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 10 18:05:35.081947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 10 18:05:35.081947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 722393a8-008a-4d7a-9c56-52d99668bfad does not exist Jun 10 18:05:35.081947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d74651d5-72d0-4a18-81de-aa411478b53c'] Jun 10 18:05:35.081947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:35.081947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:35.081947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:35.081947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:35.081947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:35.081947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:35.081947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:05:35.081947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:05:35.081947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 722393a8-008a-4d7a-9c56-52d99668bfad does not exist Jun 10 18:05:35.081947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d74651d5-72d0-4a18-81de-aa411478b53c'] Jun 10 18:05:35.081947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:35.081947 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c4b921ba-365c-478d-a1e3-6e841ec29efe tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Returning 404 to user: Security group 722393a8-008a-4d7a-9c56-52d99668bfad does not exist Jun 10 18:05:35.081947 chdv-master-2 devstack@n-api.service[126594]: Neutron server returns request_ids: ['req-d74651d5-72d0-4a18-81de-aa411478b53c'] {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:05:35.081947 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c4b921ba-365c-478d-a1e3-6e841ec29efe tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "DELETE /compute/v2.1/os-security-groups/722393a8-008a-4d7a-9c56-52d99668bfad" status: 404 len: 194 microversion: 2.1 time: 0.033195 Jun 10 18:05:35.081947 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1334/2600] 10.222.0.35 () {58 vars in 1271 bytes} [Fri Jun 10 18:05:35 2022] DELETE /compute/v2.1/os-security-groups/722393a8-008a-4d7a-9c56-52d99668bfad => generated 194 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:05:35.090566 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-996077a8-fe13-451b-940e-d3ad7d47339e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:35.090566 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-996077a8-fe13-451b-940e-d3ad7d47339e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:35.094462 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-996077a8-fe13-451b-940e-d3ad7d47339e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:35.094885 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-996077a8-fe13-451b-940e-d3ad7d47339e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:35.095624 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-996077a8-fe13-451b-940e-d3ad7d47339e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:35.096171 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-996077a8-fe13-451b-940e-d3ad7d47339e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:35.233381 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-996077a8-fe13-451b-940e-d3ad7d47339e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:35.243167 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-996077a8-fe13-451b-940e-d3ad7d47339e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.161017 Jun 10 18:05:35.243874 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1335/2601] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:35 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:35.250835 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-316d1609-dc95-4fbd-86a5-04c7cdec00e3 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '.version_select at 0x7f77b3f9eee0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:35.276811 chdv-master-2 devstack@n-api.service[126594]: DEBUG neutronclient.v2_0.client [None req-316d1609-dc95-4fbd-86a5-04c7cdec00e3 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b113cd95-ae25-426a-adf9-4331d6346d01 does not exist", "detail": ""}} {{(pid=126594) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 10 18:05:35.277675 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.security_group_api [None req-316d1609-dc95-4fbd-86a5-04c7cdec00e3 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Neutron security group b113cd95-ae25-426a-adf9-4331d6346d01 not found {{(pid=126594) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 10 18:05:35.278384 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-316d1609-dc95-4fbd-86a5-04c7cdec00e3 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] HTTP exception thrown: Security group b113cd95-ae25-426a-adf9-4331d6346d01 does not exist Jun 10 18:05:35.278384 chdv-master-2 devstack@n-api.service[126594]: Neutron server returns request_ids: ['req-08dc4636-ac35-4357-b81b-915b9a9bd481'] Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-316d1609-dc95-4fbd-86a5-04c7cdec00e3 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Request method failure captured: Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: request: DELETE /compute/v2.1/os-security-groups/b113cd95-ae25-426a-adf9-4331d6346d01 HTTP/1.1 Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4eKfGQZQ_jvhwHBxZ1GMnYHkMaBNBt7T8Ue90hW5x7BTDgkg2AiOfeu2huz2YQsnFH29P56VFWZd48_hROirge71TvR4QiKyTENHZz-D3t9ZS-m9216ej7Rjuw3slpnWYAQuE-KXkyXTlRqKM7yyNbBp9KRqjUFN-v2IWlTc7Yfat0 Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 304a5340852d4552a490e874dda8a0a3 Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_304a5340852d4552a490e874dda8a0a3", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 304a5340852d4552a490e874dda8a0a3 Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-SecurityGroupsTestJSON-732923421-project Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 7278ccddeee3495583093603a0fdb626 Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-SecurityGroupsTestJSON-732923421-project Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: exception: Security group b113cd95-ae25-426a-adf9-4331d6346d01 does not exist Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: Neutron server returns request_ids: ['req-08dc4636-ac35-4357-b81b-915b9a9bd481'] Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'b113cd95-ae25-426a-adf9-4331d6346d01'} Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 10 18:05:35.280553 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b113cd95-ae25-426a-adf9-4331d6346d01 does not exist Jun 10 18:05:35.285708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08dc4636-ac35-4357-b81b-915b9a9bd481'] Jun 10 18:05:35.285708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:35.285708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:35.285708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:35.285708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:35.285708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 10 18:05:35.285708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 10 18:05:35.285708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 10 18:05:35.285708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 10 18:05:35.285708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b113cd95-ae25-426a-adf9-4331d6346d01 does not exist Jun 10 18:05:35.285708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08dc4636-ac35-4357-b81b-915b9a9bd481'] Jun 10 18:05:35.285708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:35.285708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:35.285708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:35.285708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:35.285708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:35.285708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:35.285708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:05:35.285708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:05:35.285708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:05:35.285708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:05:35.285708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:05:35.285708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:05:35.285708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 10 18:05:35.285708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 10 18:05:35.285708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b113cd95-ae25-426a-adf9-4331d6346d01 does not exist Jun 10 18:05:35.285708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08dc4636-ac35-4357-b81b-915b9a9bd481'] Jun 10 18:05:35.285708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:35.285708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:35.285708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:35.285708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:35.285708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:35.285708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:35.285708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:05:35.285708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:05:35.285708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b113cd95-ae25-426a-adf9-4331d6346d01 does not exist Jun 10 18:05:35.285708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08dc4636-ac35-4357-b81b-915b9a9bd481'] Jun 10 18:05:35.285708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:35.285708 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-316d1609-dc95-4fbd-86a5-04c7cdec00e3 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Returning 404 to user: Security group b113cd95-ae25-426a-adf9-4331d6346d01 does not exist Jun 10 18:05:35.285708 chdv-master-2 devstack@n-api.service[126594]: Neutron server returns request_ids: ['req-08dc4636-ac35-4357-b81b-915b9a9bd481'] {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:05:35.285708 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-316d1609-dc95-4fbd-86a5-04c7cdec00e3 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "DELETE /compute/v2.1/os-security-groups/b113cd95-ae25-426a-adf9-4331d6346d01" status: 404 len: 194 microversion: 2.1 time: 0.036881 Jun 10 18:05:35.285708 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1336/2602] 10.222.0.35 () {58 vars in 1271 bytes} [Fri Jun 10 18:05:35 2022] DELETE /compute/v2.1/os-security-groups/b113cd95-ae25-426a-adf9-4331d6346d01 => generated 194 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:05:35.290325 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ddf2f7a7-b5e8-45b3-8f9a-e879ca9066d3 tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] Calling method '.version_select at 0x7f77b3e82d30>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:35.561254 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ddf2f7a7-b5e8-45b3-8f9a-e879ca9066d3 tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] 10.222.0.35 "GET /compute/v2.1/os-quota-sets/e192924a1ecd42cc918419008004c70e/defaults" status: 200 len: 371 microversion: 2.1 time: 0.270813 Jun 10 18:05:35.561254 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1337/2603] 10.222.0.35 () {58 vars in 1268 bytes} [Fri Jun 10 18:05:35 2022] GET /compute/v2.1/os-quota-sets/e192924a1ecd42cc918419008004c70e/defaults => generated 371 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:35.568727 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-984fc252-e4d1-4949-9a0c-e28ae16b4029 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:35.573610 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-984fc252-e4d1-4949-9a0c-e28ae16b4029 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] [instance: 7928b35c-fde4-48c5-8068-a32c4395684b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:35.587564 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-984fc252-e4d1-4949-9a0c-e28ae16b4029 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:35.588403 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-984fc252-e4d1-4949-9a0c-e28ae16b4029 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:35.589201 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-984fc252-e4d1-4949-9a0c-e28ae16b4029 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:35.590170 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-984fc252-e4d1-4949-9a0c-e28ae16b4029 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:35.640211 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3e4bfd70-5e2f-4e42-ad60-9c0c3fec8223 tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] 10.222.0.35 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.711794 Jun 10 18:05:35.640211 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1267/2604] 10.222.0.35 () {60 vars in 1179 bytes} [Fri Jun 10 18:05:34 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:35.643132 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-83133de2-d4f5-4816-aeef-b5dd65370334 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:35.643925 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-83133de2-d4f5-4816-aeef-b5dd65370334 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:35.660807 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83133de2-d4f5-4816-aeef-b5dd65370334 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:35.663159 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83133de2-d4f5-4816-aeef-b5dd65370334 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:35.664757 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83133de2-d4f5-4816-aeef-b5dd65370334 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:35.666283 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83133de2-d4f5-4816-aeef-b5dd65370334 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:35.772419 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-984fc252-e4d1-4949-9a0c-e28ae16b4029 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebe891ebac49128820e80cc5f2fca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02fbcda5546455ca6ba1533af1373df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:35.800531 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-984fc252-e4d1-4949-9a0c-e28ae16b4029 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] 10.222.0.35 "GET /compute/v2.1/servers/7928b35c-fde4-48c5-8068-a32c4395684b" status: 200 len: 1524 microversion: 2.1 time: 0.229836 Jun 10 18:05:35.800531 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1338/2605] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:35 2022] GET /compute/v2.1/servers/7928b35c-fde4-48c5-8068-a32c4395684b => generated 1524 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:35.806417 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0a711a58-580a-4446-aa06-e3bed6c127d8 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '.version_select at 0x7f77b3f66700>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:35.838086 chdv-master-2 devstack@n-api.service[126594]: DEBUG neutronclient.v2_0.client [None req-0a711a58-580a-4446-aa06-e3bed6c127d8 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3aed0600-32a5-486a-97b8-69bdf8b80c09 does not exist", "detail": ""}} {{(pid=126594) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 10 18:05:35.838086 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.security_group_api [None req-0a711a58-580a-4446-aa06-e3bed6c127d8 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Neutron security group 3aed0600-32a5-486a-97b8-69bdf8b80c09 not found {{(pid=126594) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 10 18:05:35.838086 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-0a711a58-580a-4446-aa06-e3bed6c127d8 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] HTTP exception thrown: Security group 3aed0600-32a5-486a-97b8-69bdf8b80c09 does not exist Jun 10 18:05:35.838086 chdv-master-2 devstack@n-api.service[126594]: Neutron server returns request_ids: ['req-34b00bf9-ddc0-4609-a159-b2605308d4dc'] Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0a711a58-580a-4446-aa06-e3bed6c127d8 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Request method failure captured: Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: request: DELETE /compute/v2.1/os-security-groups/3aed0600-32a5-486a-97b8-69bdf8b80c09 HTTP/1.1 Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4eKfGQZQ_jvhwHBxZ1GMnYHkMaBNBt7T8Ue90hW5x7BTDgkg2AiOfeu2huz2YQsnFH29P56VFWZd48_hROirge71TvR4QiKyTENHZz-D3t9ZS-m9216ej7Rjuw3slpnWYAQuE-KXkyXTlRqKM7yyNbBp9KRqjUFN-v2IWlTc7Yfat0 Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 304a5340852d4552a490e874dda8a0a3 Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_304a5340852d4552a490e874dda8a0a3", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 304a5340852d4552a490e874dda8a0a3 Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-SecurityGroupsTestJSON-732923421-project Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 7278ccddeee3495583093603a0fdb626 Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-SecurityGroupsTestJSON-732923421-project Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: exception: Security group 3aed0600-32a5-486a-97b8-69bdf8b80c09 does not exist Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: Neutron server returns request_ids: ['req-34b00bf9-ddc0-4609-a159-b2605308d4dc'] Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '3aed0600-32a5-486a-97b8-69bdf8b80c09'} Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 10 18:05:35.839536 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3aed0600-32a5-486a-97b8-69bdf8b80c09 does not exist Jun 10 18:05:35.845585 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-34b00bf9-ddc0-4609-a159-b2605308d4dc'] Jun 10 18:05:35.845585 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:35.845585 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:35.845585 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:35.845585 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:35.845585 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 10 18:05:35.845585 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 10 18:05:35.845585 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 10 18:05:35.845585 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 10 18:05:35.845585 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3aed0600-32a5-486a-97b8-69bdf8b80c09 does not exist Jun 10 18:05:35.845585 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-34b00bf9-ddc0-4609-a159-b2605308d4dc'] Jun 10 18:05:35.845585 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:35.845585 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:35.845585 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:35.845585 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:35.845585 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:35.845585 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:35.845585 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:05:35.845585 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:05:35.845585 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:05:35.845585 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:05:35.845585 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:05:35.845585 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:05:35.845585 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 10 18:05:35.845585 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 10 18:05:35.845585 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3aed0600-32a5-486a-97b8-69bdf8b80c09 does not exist Jun 10 18:05:35.845585 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-34b00bf9-ddc0-4609-a159-b2605308d4dc'] Jun 10 18:05:35.845585 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:35.845585 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:35.845585 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:35.845585 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:35.845585 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:35.845585 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:35.845585 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:05:35.845585 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:05:35.845585 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3aed0600-32a5-486a-97b8-69bdf8b80c09 does not exist Jun 10 18:05:35.845585 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-34b00bf9-ddc0-4609-a159-b2605308d4dc'] Jun 10 18:05:35.845585 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:35.845585 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0a711a58-580a-4446-aa06-e3bed6c127d8 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Returning 404 to user: Security group 3aed0600-32a5-486a-97b8-69bdf8b80c09 does not exist Jun 10 18:05:35.845585 chdv-master-2 devstack@n-api.service[126594]: Neutron server returns request_ids: ['req-34b00bf9-ddc0-4609-a159-b2605308d4dc'] {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:05:35.845585 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0a711a58-580a-4446-aa06-e3bed6c127d8 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "DELETE /compute/v2.1/os-security-groups/3aed0600-32a5-486a-97b8-69bdf8b80c09" status: 404 len: 194 microversion: 2.1 time: 0.049888 Jun 10 18:05:35.845585 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1339/2606] 10.222.0.35 () {58 vars in 1271 bytes} [Fri Jun 10 18:05:35 2022] DELETE /compute/v2.1/os-security-groups/3aed0600-32a5-486a-97b8-69bdf8b80c09 => generated 194 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:05:35.855490 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7bc0fb16-2af3-4458-82a9-06fafa630f36 tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] Action: 'create', calling method: .version_select at 0x7f77b3ed6040>, body: {"security_group_rule": {"parent_group_id": "88747c33-3bfe-4f8d-8433-52883e8ce667", "ip_protocol": "tcp", "from_port": 22, "to_port": 690962706}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:35.909654 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-7bc0fb16-2af3-4458-82a9-06fafa630f36 tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] HTTP exception thrown: Invalid port range 22:690962706. Valid TCP ports should be between 1-65535 Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7bc0fb16-2af3-4458-82a9-06fafa630f36 tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] Request method failure captured: Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 145 Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4fmWLCP-6Rt0dlcqEmykPR7RflxTDHKzZ791gM56jZgAvNjh1cAW0D9UAwjtFzfmxEJMTnNV6Xw2ZYSfRuZZGPc2N8FVt28WV_A_6b4mnEZIfP2jVqsVVsCR4ej6fPT5l6hj-krlC-_QJMoQVvahGDXv94S11GRtD_8znvxnp__pFY Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: c22803727b7f49bbaa7fb99f13156667 Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-442371350 Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/c22803727b7f49bbaa7fb99f13156667"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c22803727b7f49bbaa7fb99f13156667"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c22803727b7f49bbaa7fb99f13156667"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_c22803727b7f49bbaa7fb99f13156667", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-442371350 Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: c22803727b7f49bbaa7fb99f13156667 Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-442371350 Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-442371350-project Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: abc5f81394264f2dba5cd16cdb2d077d Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-442371350-project Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: {"security_group_rule": {"parent_group_id": "88747c33-3bfe-4f8d-8433-52883e8ce667", "ip_protocol": "tcp", "from_port": 22, "to_port": 690962706}} Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: exception: Invalid port range 22:690962706. Valid TCP ports should be between 1-65535 Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: action_args: {'body': {'security_group_rule': {'parent_group_id': '88747c33-3bfe-4f8d-8433-52883e8ce667', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 690962706}}} Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:690962706. Valid TCP ports should be between 1-65535 Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:690962706. Valid TCP ports should be between 1-65535 Jun 10 18:05:35.911304 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:35.920297 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:35.920297 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:35.920297 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:35.920297 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:35.920297 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:35.920297 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:05:35.920297 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:05:35.920297 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:690962706. Valid TCP ports should be between 1-65535 Jun 10 18:05:35.920297 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:35.920297 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7bc0fb16-2af3-4458-82a9-06fafa630f36 tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] Returning 400 to user: Invalid port range 22:690962706. Valid TCP ports should be between 1-65535 {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:05:35.920297 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7bc0fb16-2af3-4458-82a9-06fafa630f36 tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] 10.222.0.35 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.071005 Jun 10 18:05:35.920297 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1340/2607] 10.222.0.35 () {60 vars in 1194 bytes} [Fri Jun 10 18:05:35 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 72 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:05:36.041057 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-83133de2-d4f5-4816-aeef-b5dd65370334 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:36.049393 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-83133de2-d4f5-4816-aeef-b5dd65370334 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.410041 Jun 10 18:05:36.049986 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1268/2608] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:35 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:36.055519 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cef87855-da0e-41f0-ba3d-2b25ae667795 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:36.056683 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cef87855-da0e-41f0-ba3d-2b25ae667795 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:36.065109 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cef87855-da0e-41f0-ba3d-2b25ae667795 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:36.065603 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cef87855-da0e-41f0-ba3d-2b25ae667795 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:36.066395 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cef87855-da0e-41f0-ba3d-2b25ae667795 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:36.066843 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cef87855-da0e-41f0-ba3d-2b25ae667795 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:36.096831 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8a2a5141-2cbf-41e6-9f2b-623520c9953e tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1585300162", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:36.148756 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-8a2a5141-2cbf-41e6-9f2b-623520c9953e tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] validate_networks() for None {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:05:36.266227 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cef87855-da0e-41f0-ba3d-2b25ae667795 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:36.280073 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cef87855-da0e-41f0-ba3d-2b25ae667795 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:36.281616 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cef87855-da0e-41f0-ba3d-2b25ae667795 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:36.282800 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cef87855-da0e-41f0-ba3d-2b25ae667795 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1488 microversion: 2.25 time: 0.231897 Jun 10 18:05:36.283361 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1269/2609] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:05:36 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1488 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:05:36.293950 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1e67fc48-f4e2-406e-a414-571da832f4b4 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '.version_select at 0x7f77c040a040>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:36.342867 chdv-master-2 devstack@n-api.service[126595]: DEBUG neutronclient.v2_0.client [None req-1e67fc48-f4e2-406e-a414-571da832f4b4 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 472ca415-301d-42c1-9b59-ab5c256390ed does not exist", "detail": ""}} {{(pid=126595) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 10 18:05:36.343477 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.security_group_api [None req-1e67fc48-f4e2-406e-a414-571da832f4b4 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Neutron security group 472ca415-301d-42c1-9b59-ab5c256390ed not found {{(pid=126595) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 10 18:05:36.344011 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-1e67fc48-f4e2-406e-a414-571da832f4b4 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] HTTP exception thrown: Security group 472ca415-301d-42c1-9b59-ab5c256390ed does not exist Jun 10 18:05:36.344011 chdv-master-2 devstack@n-api.service[126595]: Neutron server returns request_ids: ['req-2f532d49-812e-4213-8e5f-0dae55c80b71'] Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1e67fc48-f4e2-406e-a414-571da832f4b4 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Request method failure captured: Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/os-security-groups/472ca415-301d-42c1-9b59-ab5c256390ed HTTP/1.1 Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4eKfGQZQ_jvhwHBxZ1GMnYHkMaBNBt7T8Ue90hW5x7BTDgkg2AiOfeu2huz2YQsnFH29P56VFWZd48_hROirge71TvR4QiKyTENHZz-D3t9ZS-m9216ej7Rjuw3slpnWYAQuE-KXkyXTlRqKM7yyNbBp9KRqjUFN-v2IWlTc7Yfat0 Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 304a5340852d4552a490e874dda8a0a3 Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_304a5340852d4552a490e874dda8a0a3", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 304a5340852d4552a490e874dda8a0a3 Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-SecurityGroupsTestJSON-732923421-project Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 7278ccddeee3495583093603a0fdb626 Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-SecurityGroupsTestJSON-732923421-project Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: exception: Security group 472ca415-301d-42c1-9b59-ab5c256390ed does not exist Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: Neutron server returns request_ids: ['req-2f532d49-812e-4213-8e5f-0dae55c80b71'] Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '472ca415-301d-42c1-9b59-ab5c256390ed'} Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 10 18:05:36.346192 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 472ca415-301d-42c1-9b59-ab5c256390ed does not exist Jun 10 18:05:36.350645 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2f532d49-812e-4213-8e5f-0dae55c80b71'] Jun 10 18:05:36.350645 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:36.350645 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:36.350645 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:36.350645 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:36.350645 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 10 18:05:36.350645 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 10 18:05:36.350645 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 10 18:05:36.350645 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 10 18:05:36.350645 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 472ca415-301d-42c1-9b59-ab5c256390ed does not exist Jun 10 18:05:36.350645 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2f532d49-812e-4213-8e5f-0dae55c80b71'] Jun 10 18:05:36.350645 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:36.350645 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:36.350645 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:36.350645 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:36.350645 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:36.350645 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:36.350645 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:05:36.350645 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:05:36.350645 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:05:36.350645 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:05:36.350645 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:05:36.350645 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:05:36.350645 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 10 18:05:36.350645 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 10 18:05:36.350645 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 472ca415-301d-42c1-9b59-ab5c256390ed does not exist Jun 10 18:05:36.350645 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2f532d49-812e-4213-8e5f-0dae55c80b71'] Jun 10 18:05:36.350645 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:36.350645 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:36.350645 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:36.350645 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:36.350645 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:36.350645 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:36.350645 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:05:36.350645 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:05:36.350645 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 472ca415-301d-42c1-9b59-ab5c256390ed does not exist Jun 10 18:05:36.350645 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2f532d49-812e-4213-8e5f-0dae55c80b71'] Jun 10 18:05:36.350645 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:36.350645 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1e67fc48-f4e2-406e-a414-571da832f4b4 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Returning 404 to user: Security group 472ca415-301d-42c1-9b59-ab5c256390ed does not exist Jun 10 18:05:36.350645 chdv-master-2 devstack@n-api.service[126595]: Neutron server returns request_ids: ['req-2f532d49-812e-4213-8e5f-0dae55c80b71'] {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:05:36.350645 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1e67fc48-f4e2-406e-a414-571da832f4b4 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "DELETE /compute/v2.1/os-security-groups/472ca415-301d-42c1-9b59-ab5c256390ed" status: 404 len: 194 microversion: 2.1 time: 0.062155 Jun 10 18:05:36.359942 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1270/2610] 10.222.0.35 () {58 vars in 1271 bytes} [Fri Jun 10 18:05:36 2022] DELETE /compute/v2.1/os-security-groups/472ca415-301d-42c1-9b59-ab5c256390ed => generated 194 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:05:36.363456 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-8a2a5141-2cbf-41e6-9f2b-623520c9953e tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:05:36.363887 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-8a2a5141-2cbf-41e6-9f2b-623520c9953e tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:05:36.364522 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-8a2a5141-2cbf-41e6-9f2b-623520c9953e tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:05:36.364977 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-8a2a5141-2cbf-41e6-9f2b-623520c9953e tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:05:36.365419 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-8a2a5141-2cbf-41e6-9f2b-623520c9953e tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:05:36.366278 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c08c3a18-521f-427e-a944-8fb9abd7badf tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] Action: 'create', calling method: .version_select at 0x7f77c03c41f0>, body: {"security_group_rule": {"parent_group_id": "1b8c1e07-4d11-49bc-b55e-a511c57a5611", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:36.381034 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8a2a5141-2cbf-41e6-9f2b-623520c9953e tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:36.382440 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8a2a5141-2cbf-41e6-9f2b-623520c9953e tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:36.383423 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8a2a5141-2cbf-41e6-9f2b-623520c9953e tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:36.385300 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8a2a5141-2cbf-41e6-9f2b-623520c9953e tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:36.410641 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-8a2a5141-2cbf-41e6-9f2b-623520c9953e tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Getting quotas for project bb2c4b1067ac4cab8b8565bc987f00b1. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:05:36.416636 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-8a2a5141-2cbf-41e6-9f2b-623520c9953e tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Getting quotas for user 9c189471a3ab4ec2b644b3ee1352d4e6 and project bb2c4b1067ac4cab8b8565bc987f00b1. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:05:36.435600 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8a2a5141-2cbf-41e6-9f2b-623520c9953e tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:05:36.435767 chdv-master-2 devstack@n-api.service[126595]: DEBUG neutronclient.v2_0.client [None req-c08c3a18-521f-427e-a944-8fb9abd7badf tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1b8c1e07-4d11-49bc-b55e-a511c57a5611 does not exist", "detail": ""}} {{(pid=126595) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 10 18:05:36.435767 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.security_group_api [None req-c08c3a18-521f-427e-a944-8fb9abd7badf tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] Neutron security group 1b8c1e07-4d11-49bc-b55e-a511c57a5611 not found {{(pid=126595) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 10 18:05:36.436004 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8a2a5141-2cbf-41e6-9f2b-623520c9953e tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 5a7cc611-89ea-4c58-af65-315000f47739] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:05:36.436139 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-c08c3a18-521f-427e-a944-8fb9abd7badf tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] HTTP exception thrown: Security group 1b8c1e07-4d11-49bc-b55e-a511c57a5611 does not exist Jun 10 18:05:36.436139 chdv-master-2 devstack@n-api.service[126595]: Neutron server returns request_ids: ['req-d4c842ad-a98f-4feb-bef3-97eb16e61957'] Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c08c3a18-521f-427e-a944-8fb9abd7badf tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] Request method failure captured: Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 138 Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4fmWLCP-6Rt0dlcqEmykPR7RflxTDHKzZ791gM56jZgAvNjh1cAW0D9UAwjtFzfmxEJMTnNV6Xw2ZYSfRuZZGPc2N8FVt28WV_A_6b4mnEZIfP2jVqsVVsCR4ej6fPT5l6hj-krlC-_QJMoQVvahGDXv94S11GRtD_8znvxnp__pFY Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: c22803727b7f49bbaa7fb99f13156667 Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-442371350 Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/c22803727b7f49bbaa7fb99f13156667"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c22803727b7f49bbaa7fb99f13156667"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c22803727b7f49bbaa7fb99f13156667"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_c22803727b7f49bbaa7fb99f13156667", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-442371350 Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: c22803727b7f49bbaa7fb99f13156667 Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-442371350 Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-442371350-project Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: abc5f81394264f2dba5cd16cdb2d077d Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-442371350-project Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: {"security_group_rule": {"parent_group_id": "1b8c1e07-4d11-49bc-b55e-a511c57a5611", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: exception: Security group 1b8c1e07-4d11-49bc-b55e-a511c57a5611 does not exist Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: Neutron server returns request_ids: ['req-d4c842ad-a98f-4feb-bef3-97eb16e61957'] Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: action_args: {'body': {'security_group_rule': {'parent_group_id': '1b8c1e07-4d11-49bc-b55e-a511c57a5611', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 10 18:05:36.439089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 10 18:05:36.443477 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 10 18:05:36.443477 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1b8c1e07-4d11-49bc-b55e-a511c57a5611 does not exist Jun 10 18:05:36.443477 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d4c842ad-a98f-4feb-bef3-97eb16e61957'] Jun 10 18:05:36.443477 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:36.443477 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:36.443477 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:36.443477 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:36.443477 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Jun 10 18:05:36.443477 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Jun 10 18:05:36.443477 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 10 18:05:36.443477 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 10 18:05:36.443477 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1b8c1e07-4d11-49bc-b55e-a511c57a5611 does not exist Jun 10 18:05:36.443477 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d4c842ad-a98f-4feb-bef3-97eb16e61957'] Jun 10 18:05:36.443477 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:36.443477 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:36.443477 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:36.443477 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:36.443477 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:36.443477 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:36.443477 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:05:36.443477 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:05:36.443477 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:05:36.443477 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:05:36.443477 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:05:36.443477 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:05:36.443477 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Jun 10 18:05:36.443477 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 10 18:05:36.443477 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1b8c1e07-4d11-49bc-b55e-a511c57a5611 does not exist Jun 10 18:05:36.443477 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d4c842ad-a98f-4feb-bef3-97eb16e61957'] Jun 10 18:05:36.443477 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:36.443477 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:36.443477 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:36.443477 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:36.443477 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:36.443477 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:36.443477 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:05:36.443477 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:05:36.443477 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1b8c1e07-4d11-49bc-b55e-a511c57a5611 does not exist Jun 10 18:05:36.443477 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d4c842ad-a98f-4feb-bef3-97eb16e61957'] Jun 10 18:05:36.443477 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:36.449445 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c08c3a18-521f-427e-a944-8fb9abd7badf tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] Returning 404 to user: Security group 1b8c1e07-4d11-49bc-b55e-a511c57a5611 does not exist Jun 10 18:05:36.449445 chdv-master-2 devstack@n-api.service[126595]: Neutron server returns request_ids: ['req-d4c842ad-a98f-4feb-bef3-97eb16e61957'] {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:05:36.450909 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c08c3a18-521f-427e-a944-8fb9abd7badf tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] 10.222.0.35 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.097202 Jun 10 18:05:36.451510 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1271/2611] 10.222.0.35 () {60 vars in 1194 bytes} [Fri Jun 10 18:05:36 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:05:36.456921 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ecf2dffe-32cd-4c5b-9333-d1fbfa47a429 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:36.460254 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ecf2dffe-32cd-4c5b-9333-d1fbfa47a429 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 935bcaad-c46d-4d6c-8b00-7d349eefb5b2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:36.466277 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ecf2dffe-32cd-4c5b-9333-d1fbfa47a429 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:36.466984 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ecf2dffe-32cd-4c5b-9333-d1fbfa47a429 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:36.467948 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ecf2dffe-32cd-4c5b-9333-d1fbfa47a429 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:36.468427 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ecf2dffe-32cd-4c5b-9333-d1fbfa47a429 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:36.485235 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:05:36.562208 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8a2a5141-2cbf-41e6-9f2b-623520c9953e tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.645254 Jun 10 18:05:36.563417 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1341/2612] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:05:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:05:36.567737 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c2c26d49-33ca-463b-9aec-598c221fd38f tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] Action: 'update', calling method: .version_select at 0x7f77b3f8e8b0>, body: {"quota_set": {"ram": "5120"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:36.651077 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c2c26d49-33ca-463b-9aec-598c221fd38f tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:36.651641 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c2c26d49-33ca-463b-9aec-598c221fd38f tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:36.652809 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c2c26d49-33ca-463b-9aec-598c221fd38f tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:36.653674 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c2c26d49-33ca-463b-9aec-598c221fd38f tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:36.685216 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ecf2dffe-32cd-4c5b-9333-d1fbfa47a429 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:36.696965 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ecf2dffe-32cd-4c5b-9333-d1fbfa47a429 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/935bcaad-c46d-4d6c-8b00-7d349eefb5b2" status: 200 len: 1307 microversion: 2.1 time: 0.243997 Jun 10 18:05:36.702142 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1272/2613] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:36 2022] GET /compute/v2.1/servers/935bcaad-c46d-4d6c-8b00-7d349eefb5b2 => generated 1307 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:36.704435 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-97cf98d1-ed3a-4225-b0f9-53e8948a4f71 req-f90f7093-d3a7-4ecc-aea9-e15c475b8776 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7928b35c-fde4-48c5-8068-a32c4395684b", "name": "network-vif-deleted", "tag": "26e1c56e-d6c1-43d2-9639-dde152bfe361"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:36.716019 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-97cf98d1-ed3a-4225-b0f9-53e8948a4f71 req-f90f7093-d3a7-4ecc-aea9-e15c475b8776 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:36.716962 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-97cf98d1-ed3a-4225-b0f9-53e8948a4f71 req-f90f7093-d3a7-4ecc-aea9-e15c475b8776 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:36.736953 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-97cf98d1-ed3a-4225-b0f9-53e8948a4f71 req-f90f7093-d3a7-4ecc-aea9-e15c475b8776 service nova] Creating event network-vif-deleted:26e1c56e-d6c1-43d2-9639-dde152bfe361 for instance 7928b35c-fde4-48c5-8068-a32c4395684b on chh1-master-2 Jun 10 18:05:36.744708 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-97cf98d1-ed3a-4225-b0f9-53e8948a4f71 req-f90f7093-d3a7-4ecc-aea9-e15c475b8776 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044612 Jun 10 18:05:36.745905 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1273/2614] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:36.754194 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-acec00df-113c-4937-9ad0-3e907e7e309b tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '.version_select at 0x7f77c03c4c10>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:36.799843 chdv-master-2 devstack@n-api.service[126595]: DEBUG neutronclient.v2_0.client [None req-acec00df-113c-4937-9ad0-3e907e7e309b tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 550d428e-4683-40b2-a84a-8f882af2478b does not exist", "detail": ""}} {{(pid=126595) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 10 18:05:36.801709 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.security_group_api [None req-acec00df-113c-4937-9ad0-3e907e7e309b tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Neutron security group 550d428e-4683-40b2-a84a-8f882af2478b not found {{(pid=126595) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 10 18:05:36.801709 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-acec00df-113c-4937-9ad0-3e907e7e309b tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] HTTP exception thrown: Security group 550d428e-4683-40b2-a84a-8f882af2478b does not exist Jun 10 18:05:36.801709 chdv-master-2 devstack@n-api.service[126595]: Neutron server returns request_ids: ['req-9066327c-b304-4418-b31b-9386cc4d3119'] Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-acec00df-113c-4937-9ad0-3e907e7e309b tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Request method failure captured: Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/os-security-groups/550d428e-4683-40b2-a84a-8f882af2478b HTTP/1.1 Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4eKfGQZQ_jvhwHBxZ1GMnYHkMaBNBt7T8Ue90hW5x7BTDgkg2AiOfeu2huz2YQsnFH29P56VFWZd48_hROirge71TvR4QiKyTENHZz-D3t9ZS-m9216ej7Rjuw3slpnWYAQuE-KXkyXTlRqKM7yyNbBp9KRqjUFN-v2IWlTc7Yfat0 Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 304a5340852d4552a490e874dda8a0a3 Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_304a5340852d4552a490e874dda8a0a3", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 304a5340852d4552a490e874dda8a0a3 Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-SecurityGroupsTestJSON-732923421-project Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 7278ccddeee3495583093603a0fdb626 Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-SecurityGroupsTestJSON-732923421-project Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: exception: Security group 550d428e-4683-40b2-a84a-8f882af2478b does not exist Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: Neutron server returns request_ids: ['req-9066327c-b304-4418-b31b-9386cc4d3119'] Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '550d428e-4683-40b2-a84a-8f882af2478b'} Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 10 18:05:36.803715 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 550d428e-4683-40b2-a84a-8f882af2478b does not exist Jun 10 18:05:36.815104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9066327c-b304-4418-b31b-9386cc4d3119'] Jun 10 18:05:36.815104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:36.815104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:36.815104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:36.815104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:36.815104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 10 18:05:36.815104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 10 18:05:36.815104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 10 18:05:36.815104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 10 18:05:36.815104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 550d428e-4683-40b2-a84a-8f882af2478b does not exist Jun 10 18:05:36.815104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9066327c-b304-4418-b31b-9386cc4d3119'] Jun 10 18:05:36.815104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:36.815104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:36.815104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:36.815104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:36.815104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:36.815104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:36.815104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:05:36.815104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:05:36.815104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:05:36.815104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:05:36.815104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:05:36.815104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:05:36.815104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 10 18:05:36.815104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 10 18:05:36.815104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 550d428e-4683-40b2-a84a-8f882af2478b does not exist Jun 10 18:05:36.815104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9066327c-b304-4418-b31b-9386cc4d3119'] Jun 10 18:05:36.815104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:36.815104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:36.815104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:36.815104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:36.815104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:36.815104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:36.815104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:05:36.815104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:05:36.815104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 550d428e-4683-40b2-a84a-8f882af2478b does not exist Jun 10 18:05:36.815104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9066327c-b304-4418-b31b-9386cc4d3119'] Jun 10 18:05:36.815104 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:36.815104 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-acec00df-113c-4937-9ad0-3e907e7e309b tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Returning 404 to user: Security group 550d428e-4683-40b2-a84a-8f882af2478b does not exist Jun 10 18:05:36.815104 chdv-master-2 devstack@n-api.service[126595]: Neutron server returns request_ids: ['req-9066327c-b304-4418-b31b-9386cc4d3119'] {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:05:36.815104 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-acec00df-113c-4937-9ad0-3e907e7e309b tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "DELETE /compute/v2.1/os-security-groups/550d428e-4683-40b2-a84a-8f882af2478b" status: 404 len: 194 microversion: 2.1 time: 0.057059 Jun 10 18:05:36.815104 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1274/2615] 10.222.0.35 () {58 vars in 1271 bytes} [Fri Jun 10 18:05:36 2022] DELETE /compute/v2.1/os-security-groups/550d428e-4683-40b2-a84a-8f882af2478b => generated 194 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:05:36.815104 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-61ba63de-bafa-42a5-b4e3-9075c9700ba2 tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] Calling method '.version_select at 0x7f77c03cdc10>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:36.847017 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c2c26d49-33ca-463b-9aec-598c221fd38f tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] 10.222.0.35 "PUT /compute/v2.1/os-quota-sets/4148e2a214a94168be4648239d3ab63a" status: 200 len: 328 microversion: 2.1 time: 0.282608 Jun 10 18:05:36.847575 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1342/2616] 10.222.0.35 () {60 vars in 1261 bytes} [Fri Jun 10 18:05:36 2022] PUT /compute/v2.1/os-quota-sets/4148e2a214a94168be4648239d3ab63a => generated 328 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:36.850188 chdv-master-2 devstack@n-api.service[126595]: DEBUG neutronclient.v2_0.client [None req-61ba63de-bafa-42a5-b4e3-9075c9700ba2 tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 12a9aa95-4985-4c39-99a6-6cc8a7c80017 does not exist", "detail": ""}} {{(pid=126595) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 10 18:05:36.853803 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.security_group_api [None req-61ba63de-bafa-42a5-b4e3-9075c9700ba2 tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] Neutron security group rule 12a9aa95-4985-4c39-99a6-6cc8a7c80017 not found {{(pid=126595) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Jun 10 18:05:36.854675 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-61ba63de-bafa-42a5-b4e3-9075c9700ba2 tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] HTTP exception thrown: Security group rule 12a9aa95-4985-4c39-99a6-6cc8a7c80017 does not exist Jun 10 18:05:36.854675 chdv-master-2 devstack@n-api.service[126595]: Neutron server returns request_ids: ['req-33c6c962-6ea5-45b8-873e-cd07dc7d135b'] Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-61ba63de-bafa-42a5-b4e3-9075c9700ba2 tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] Request method failure captured: Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/os-security-group-rules/12a9aa95-4985-4c39-99a6-6cc8a7c80017 HTTP/1.1 Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4fmWLCP-6Rt0dlcqEmykPR7RflxTDHKzZ791gM56jZgAvNjh1cAW0D9UAwjtFzfmxEJMTnNV6Xw2ZYSfRuZZGPc2N8FVt28WV_A_6b4mnEZIfP2jVqsVVsCR4ej6fPT5l6hj-krlC-_QJMoQVvahGDXv94S11GRtD_8znvxnp__pFY Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: c22803727b7f49bbaa7fb99f13156667 Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-442371350 Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/c22803727b7f49bbaa7fb99f13156667"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c22803727b7f49bbaa7fb99f13156667"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c22803727b7f49bbaa7fb99f13156667"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_c22803727b7f49bbaa7fb99f13156667", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-442371350 Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: c22803727b7f49bbaa7fb99f13156667 Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-442371350 Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-442371350-project Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: abc5f81394264f2dba5cd16cdb2d077d Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-442371350-project Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: exception: Security group rule 12a9aa95-4985-4c39-99a6-6cc8a7c80017 does not exist Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: Neutron server returns request_ids: ['req-33c6c962-6ea5-45b8-873e-cd07dc7d135b'] Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '12a9aa95-4985-4c39-99a6-6cc8a7c80017'} Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 10 18:05:36.857800 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 12a9aa95-4985-4c39-99a6-6cc8a7c80017 does not exist Jun 10 18:05:36.863162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-33c6c962-6ea5-45b8-873e-cd07dc7d135b'] Jun 10 18:05:36.863162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:36.863162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:36.863162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:36.863162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:36.863162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Jun 10 18:05:36.863162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Jun 10 18:05:36.863162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Jun 10 18:05:36.863162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 10 18:05:36.863162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 12a9aa95-4985-4c39-99a6-6cc8a7c80017 does not exist Jun 10 18:05:36.863162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-33c6c962-6ea5-45b8-873e-cd07dc7d135b'] Jun 10 18:05:36.863162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:36.863162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:36.863162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:36.863162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:36.863162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:36.863162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:36.863162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:05:36.863162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:05:36.863162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:05:36.863162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:05:36.863162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:05:36.863162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:05:36.863162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Jun 10 18:05:36.863162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 10 18:05:36.863162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 12a9aa95-4985-4c39-99a6-6cc8a7c80017 does not exist Jun 10 18:05:36.863162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-33c6c962-6ea5-45b8-873e-cd07dc7d135b'] Jun 10 18:05:36.863162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:36.863162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:36.863162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:36.863162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:36.863162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:36.863162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:36.863162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:05:36.863162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:05:36.863162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 12a9aa95-4985-4c39-99a6-6cc8a7c80017 does not exist Jun 10 18:05:36.863162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-33c6c962-6ea5-45b8-873e-cd07dc7d135b'] Jun 10 18:05:36.863162 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:05:36.874986 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-331415f8-8a7c-4eab-8fd6-927f2e596a05 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:36.874986 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-331415f8-8a7c-4eab-8fd6-927f2e596a05 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 5a7cc611-89ea-4c58-af65-315000f47739] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:36.875196 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-61ba63de-bafa-42a5-b4e3-9075c9700ba2 tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] Returning 404 to user: Security group rule 12a9aa95-4985-4c39-99a6-6cc8a7c80017 does not exist Jun 10 18:05:36.875196 chdv-master-2 devstack@n-api.service[126595]: Neutron server returns request_ids: ['req-33c6c962-6ea5-45b8-873e-cd07dc7d135b'] {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:05:36.875196 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-61ba63de-bafa-42a5-b4e3-9075c9700ba2 tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] 10.222.0.35 "DELETE /compute/v2.1/os-security-group-rules/12a9aa95-4985-4c39-99a6-6cc8a7c80017" status: 404 len: 199 microversion: 2.1 time: 0.052657 Jun 10 18:05:36.875196 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1275/2617] 10.222.0.35 () {58 vars in 1286 bytes} [Fri Jun 10 18:05:36 2022] DELETE /compute/v2.1/os-security-group-rules/12a9aa95-4985-4c39-99a6-6cc8a7c80017 => generated 199 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:05:36.875196 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-64be70ba-2284-4370-8d8f-def5edf02b9a tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:36.875196 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-64be70ba-2284-4370-8d8f-def5edf02b9a tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] [instance: 7928b35c-fde4-48c5-8068-a32c4395684b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:36.881033 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-64be70ba-2284-4370-8d8f-def5edf02b9a tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:36.882251 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-64be70ba-2284-4370-8d8f-def5edf02b9a tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:36.883140 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-64be70ba-2284-4370-8d8f-def5edf02b9a tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:36.883707 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-64be70ba-2284-4370-8d8f-def5edf02b9a tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:36.912117 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-331415f8-8a7c-4eab-8fd6-927f2e596a05 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:36.919249 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-331415f8-8a7c-4eab-8fd6-927f2e596a05 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/5a7cc611-89ea-4c58-af65-315000f47739" status: 200 len: 1217 microversion: 2.1 time: 0.065505 Jun 10 18:05:36.929834 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1343/2618] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:36 2022] GET /compute/v2.1/servers/5a7cc611-89ea-4c58-af65-315000f47739 => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:36.935629 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-df871202-3045-4837-921a-625ce4404911 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '.version_select at 0x7f77b3ee4b80>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:36.963650 chdv-master-2 devstack@n-api.service[126594]: DEBUG neutronclient.v2_0.client [None req-df871202-3045-4837-921a-625ce4404911 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 567a4f18-6e05-4aa8-935c-c35e1bfd1649 does not exist", "detail": ""}} {{(pid=126594) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 10 18:05:36.964263 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.security_group_api [None req-df871202-3045-4837-921a-625ce4404911 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Neutron security group 567a4f18-6e05-4aa8-935c-c35e1bfd1649 not found {{(pid=126594) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 10 18:05:36.964828 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-df871202-3045-4837-921a-625ce4404911 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] HTTP exception thrown: Security group 567a4f18-6e05-4aa8-935c-c35e1bfd1649 does not exist Jun 10 18:05:36.964828 chdv-master-2 devstack@n-api.service[126594]: Neutron server returns request_ids: ['req-bb6bcdd4-e200-4142-8eb3-5a77b61e7784'] Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-df871202-3045-4837-921a-625ce4404911 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Request method failure captured: Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: request: DELETE /compute/v2.1/os-security-groups/567a4f18-6e05-4aa8-935c-c35e1bfd1649 HTTP/1.1 Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4eKfGQZQ_jvhwHBxZ1GMnYHkMaBNBt7T8Ue90hW5x7BTDgkg2AiOfeu2huz2YQsnFH29P56VFWZd48_hROirge71TvR4QiKyTENHZz-D3t9ZS-m9216ej7Rjuw3slpnWYAQuE-KXkyXTlRqKM7yyNbBp9KRqjUFN-v2IWlTc7Yfat0 Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 304a5340852d4552a490e874dda8a0a3 Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_304a5340852d4552a490e874dda8a0a3", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 304a5340852d4552a490e874dda8a0a3 Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-SecurityGroupsTestJSON-732923421-project Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 7278ccddeee3495583093603a0fdb626 Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-SecurityGroupsTestJSON-732923421-project Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: exception: Security group 567a4f18-6e05-4aa8-935c-c35e1bfd1649 does not exist Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: Neutron server returns request_ids: ['req-bb6bcdd4-e200-4142-8eb3-5a77b61e7784'] Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '567a4f18-6e05-4aa8-935c-c35e1bfd1649'} Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 10 18:05:36.966696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 567a4f18-6e05-4aa8-935c-c35e1bfd1649 does not exist Jun 10 18:05:36.971741 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb6bcdd4-e200-4142-8eb3-5a77b61e7784'] Jun 10 18:05:36.971741 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:36.971741 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:36.971741 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:36.971741 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:36.971741 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 10 18:05:36.971741 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 10 18:05:36.971741 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 10 18:05:36.971741 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 10 18:05:36.971741 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 567a4f18-6e05-4aa8-935c-c35e1bfd1649 does not exist Jun 10 18:05:36.971741 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb6bcdd4-e200-4142-8eb3-5a77b61e7784'] Jun 10 18:05:36.971741 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:36.971741 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:36.971741 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:36.971741 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:36.971741 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:36.971741 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:36.971741 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:05:36.971741 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:05:36.971741 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:05:36.971741 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:05:36.971741 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:05:36.971741 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:05:36.971741 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 10 18:05:36.971741 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 10 18:05:36.971741 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 567a4f18-6e05-4aa8-935c-c35e1bfd1649 does not exist Jun 10 18:05:36.971741 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb6bcdd4-e200-4142-8eb3-5a77b61e7784'] Jun 10 18:05:36.971741 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:36.971741 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:36.971741 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:36.971741 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:36.971741 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:36.971741 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:36.971741 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:05:36.971741 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:05:36.971741 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 567a4f18-6e05-4aa8-935c-c35e1bfd1649 does not exist Jun 10 18:05:36.971741 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb6bcdd4-e200-4142-8eb3-5a77b61e7784'] Jun 10 18:05:36.971741 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:36.971741 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-df871202-3045-4837-921a-625ce4404911 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Returning 404 to user: Security group 567a4f18-6e05-4aa8-935c-c35e1bfd1649 does not exist Jun 10 18:05:36.971741 chdv-master-2 devstack@n-api.service[126594]: Neutron server returns request_ids: ['req-bb6bcdd4-e200-4142-8eb3-5a77b61e7784'] {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:05:36.971741 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-df871202-3045-4837-921a-625ce4404911 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "DELETE /compute/v2.1/os-security-groups/567a4f18-6e05-4aa8-935c-c35e1bfd1649" status: 404 len: 194 microversion: 2.1 time: 0.036658 Jun 10 18:05:36.975618 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1344/2619] 10.222.0.35 () {58 vars in 1271 bytes} [Fri Jun 10 18:05:36 2022] DELETE /compute/v2.1/os-security-groups/567a4f18-6e05-4aa8-935c-c35e1bfd1649 => generated 194 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:05:36.980043 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-272be425-83f7-46d5-a6b6-63b119166a93 tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] Calling method '.version_select at 0x7f77b3f8e9d0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:37.022877 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-64be70ba-2284-4370-8d8f-def5edf02b9a tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdebe891ebac49128820e80cc5f2fca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02fbcda5546455ca6ba1533af1373df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:37.035705 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-64be70ba-2284-4370-8d8f-def5edf02b9a tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] 10.222.0.35 "GET /compute/v2.1/servers/7928b35c-fde4-48c5-8068-a32c4395684b" status: 200 len: 1308 microversion: 2.1 time: 0.168657 Jun 10 18:05:37.035705 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1276/2620] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:36 2022] GET /compute/v2.1/servers/7928b35c-fde4-48c5-8068-a32c4395684b => generated 1308 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:37.049777 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-272be425-83f7-46d5-a6b6-63b119166a93 tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:37.050066 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-43b678bc-db03-4b52-80b5-b236d5f4b5ee tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] Calling method '.version_select at 0x7f77c0d1b280>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:37.050538 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-272be425-83f7-46d5-a6b6-63b119166a93 tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:37.051058 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-272be425-83f7-46d5-a6b6-63b119166a93 tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:37.051509 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-272be425-83f7-46d5-a6b6-63b119166a93 tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:37.075485 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-272be425-83f7-46d5-a6b6-63b119166a93 tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] 10.222.0.35 "GET /compute/v2.1/os-quota-sets/4148e2a214a94168be4648239d3ab63a/detail" status: 200 len: 916 microversion: 2.1 time: 0.102539 Jun 10 18:05:37.076200 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1345/2621] 10.222.0.35 () {58 vars in 1262 bytes} [Fri Jun 10 18:05:36 2022] GET /compute/v2.1/os-quota-sets/4148e2a214a94168be4648239d3ab63a/detail => generated 916 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:37.082810 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3ae61b9b-212f-4c8d-8aa4-951e47105a2b tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:37.084037 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3ae61b9b-212f-4c8d-8aa4-951e47105a2b tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: 69ff0893-3da5-487f-8cb6-25763b854eaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:37.092982 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3ae61b9b-212f-4c8d-8aa4-951e47105a2b tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:37.092982 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3ae61b9b-212f-4c8d-8aa4-951e47105a2b tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:37.093695 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3ae61b9b-212f-4c8d-8aa4-951e47105a2b tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:37.094328 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3ae61b9b-212f-4c8d-8aa4-951e47105a2b tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:37.150391 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3ae61b9b-212f-4c8d-8aa4-951e47105a2b tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: 69ff0893-3da5-487f-8cb6-25763b854eaa] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:05:37.172884 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:05:37.653854 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-43b678bc-db03-4b52-80b5-b236d5f4b5ee tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] 10.222.0.35 "DELETE /compute/v2.1/os-security-groups/88747c33-3bfe-4f8d-8433-52883e8ce667" status: 202 len: 0 microversion: 2.1 time: 0.607879 Jun 10 18:05:37.658856 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1277/2622] 10.222.0.35 () {58 vars in 1271 bytes} [Fri Jun 10 18:05:37 2022] DELETE /compute/v2.1/os-security-groups/88747c33-3bfe-4f8d-8433-52883e8ce667 => generated 0 bytes in 624 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:05:37.664954 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b7a7f222-74b0-4351-ba10-44e663760a32 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:37.665589 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b7a7f222-74b0-4351-ba10-44e663760a32 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:37.680258 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b7a7f222-74b0-4351-ba10-44e663760a32 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:37.683114 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b7a7f222-74b0-4351-ba10-44e663760a32 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:37.685518 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b7a7f222-74b0-4351-ba10-44e663760a32 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:37.686000 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b7a7f222-74b0-4351-ba10-44e663760a32 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:37.690910 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3ae61b9b-212f-4c8d-8aa4-951e47105a2b tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "DELETE /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa" status: 204 len: 0 microversion: 2.1 time: 0.613137 Jun 10 18:05:37.691781 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1346/2623] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:05:37 2022] DELETE /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa => generated 0 bytes in 615 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:05:37.697710 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2c24af4d-9b1e-4a1f-ac1f-8f94db6404fe tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] Action: 'update', calling method: .version_select at 0x7f77b3ed6940>, body: {"quota_set": {"ram": "2048"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:37.807469 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2c24af4d-9b1e-4a1f-ac1f-8f94db6404fe tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:37.808638 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2c24af4d-9b1e-4a1f-ac1f-8f94db6404fe tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:37.809936 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2c24af4d-9b1e-4a1f-ac1f-8f94db6404fe tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:37.810382 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2c24af4d-9b1e-4a1f-ac1f-8f94db6404fe tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:37.849269 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2c24af4d-9b1e-4a1f-ac1f-8f94db6404fe tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:37.849922 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2c24af4d-9b1e-4a1f-ac1f-8f94db6404fe tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:37.850574 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2c24af4d-9b1e-4a1f-ac1f-8f94db6404fe tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:37.851015 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2c24af4d-9b1e-4a1f-ac1f-8f94db6404fe tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:37.990100 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b7a7f222-74b0-4351-ba10-44e663760a32 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:37.998291 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b7a7f222-74b0-4351-ba10-44e663760a32 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:37.999773 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b7a7f222-74b0-4351-ba10-44e663760a32 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:38.000985 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b7a7f222-74b0-4351-ba10-44e663760a32 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1488 microversion: 2.25 time: 0.341096 Jun 10 18:05:38.001537 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1278/2624] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:05:37 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1488 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:05:38.021151 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8662f227-9094-4238-94ee-17a3dc6392cb tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] Calling method '.version_select at 0x7f77c03cd670>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:38.037798 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2c24af4d-9b1e-4a1f-ac1f-8f94db6404fe tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] 10.222.0.35 "PUT /compute/v2.1/os-quota-sets/4148e2a214a94168be4648239d3ab63a?user_id=bc593c6f4ddb4be2b6e41862db16aeb2" status: 200 len: 328 microversion: 2.1 time: 0.344596 Jun 10 18:05:38.038594 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1347/2625] 10.222.0.35 () {60 vars in 1342 bytes} [Fri Jun 10 18:05:37 2022] PUT /compute/v2.1/os-quota-sets/4148e2a214a94168be4648239d3ab63a?user_id=bc593c6f4ddb4be2b6e41862db16aeb2 => generated 328 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:38.045162 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-783773c1-3658-49db-8b43-1a6e846703a1 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:38.046030 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-783773c1-3658-49db-8b43-1a6e846703a1 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: 69ff0893-3da5-487f-8cb6-25763b854eaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:38.052988 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-783773c1-3658-49db-8b43-1a6e846703a1 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:38.053523 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-783773c1-3658-49db-8b43-1a6e846703a1 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:38.054510 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-783773c1-3658-49db-8b43-1a6e846703a1 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:38.055001 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-783773c1-3658-49db-8b43-1a6e846703a1 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:38.241786 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-783773c1-3658-49db-8b43-1a6e846703a1 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:38.251036 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-783773c1-3658-49db-8b43-1a6e846703a1 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa" status: 200 len: 1644 microversion: 2.1 time: 0.209516 Jun 10 18:05:38.259052 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1348/2626] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:38 2022] GET /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa => generated 1644 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:38.269193 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ab12e669-ca55-4534-82e6-4ab501a8bfab tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:38.270143 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ab12e669-ca55-4534-82e6-4ab501a8bfab tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 935bcaad-c46d-4d6c-8b00-7d349eefb5b2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:38.277130 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ab12e669-ca55-4534-82e6-4ab501a8bfab tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:38.277590 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ab12e669-ca55-4534-82e6-4ab501a8bfab tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:38.278724 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ab12e669-ca55-4534-82e6-4ab501a8bfab tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:38.279208 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ab12e669-ca55-4534-82e6-4ab501a8bfab tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:38.459511 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ab12e669-ca55-4534-82e6-4ab501a8bfab tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:38.467398 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ab12e669-ca55-4534-82e6-4ab501a8bfab tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/935bcaad-c46d-4d6c-8b00-7d349eefb5b2" status: 200 len: 1307 microversion: 2.1 time: 0.207045 Jun 10 18:05:38.467976 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1349/2627] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:38 2022] GET /compute/v2.1/servers/935bcaad-c46d-4d6c-8b00-7d349eefb5b2 => generated 1307 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:38.472799 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-95367600-fa3e-4f7e-adae-fa0f9bf74ab0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:38.473665 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-95367600-fa3e-4f7e-adae-fa0f9bf74ab0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 5a7cc611-89ea-4c58-af65-315000f47739] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:38.480497 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-95367600-fa3e-4f7e-adae-fa0f9bf74ab0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:38.481218 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-95367600-fa3e-4f7e-adae-fa0f9bf74ab0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:38.482232 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-95367600-fa3e-4f7e-adae-fa0f9bf74ab0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:38.483032 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-95367600-fa3e-4f7e-adae-fa0f9bf74ab0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:38.492240 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8662f227-9094-4238-94ee-17a3dc6392cb tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] 10.222.0.35 "DELETE /compute/v2.1/os-security-groups/b0811cb6-d384-4c65-a6ae-a5e7b2702627" status: 202 len: 0 microversion: 2.1 time: 0.475194 Jun 10 18:05:38.494216 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1279/2628] 10.222.0.35 () {58 vars in 1271 bytes} [Fri Jun 10 18:05:38 2022] DELETE /compute/v2.1/os-security-groups/b0811cb6-d384-4c65-a6ae-a5e7b2702627 => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:05:38.501480 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-77c1389d-39f7-43e0-ba4e-92c345f627e2 tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] Calling method '.version_select at 0x7f77c03cdca0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:38.567485 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-95367600-fa3e-4f7e-adae-fa0f9bf74ab0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:38.576341 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-95367600-fa3e-4f7e-adae-fa0f9bf74ab0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/5a7cc611-89ea-4c58-af65-315000f47739" status: 200 len: 1221 microversion: 2.1 time: 0.107125 Jun 10 18:05:38.576915 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1350/2629] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:38 2022] GET /compute/v2.1/servers/5a7cc611-89ea-4c58-af65-315000f47739 => generated 1221 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:38.585640 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c18ec677-108a-45b7-b5f1-095fad58a005 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:38.586318 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c18ec677-108a-45b7-b5f1-095fad58a005 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] [instance: 7928b35c-fde4-48c5-8068-a32c4395684b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:38.593254 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c18ec677-108a-45b7-b5f1-095fad58a005 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:38.593720 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c18ec677-108a-45b7-b5f1-095fad58a005 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:38.594503 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c18ec677-108a-45b7-b5f1-095fad58a005 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:38.594954 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c18ec677-108a-45b7-b5f1-095fad58a005 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:38.610189 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-c18ec677-108a-45b7-b5f1-095fad58a005 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] HTTP exception thrown: Instance 7928b35c-fde4-48c5-8068-a32c4395684b could not be found. Jun 10 18:05:38.610784 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-77c1389d-39f7-43e0-ba4e-92c345f627e2 tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] 10.222.0.35 "GET /compute/v2.1/os-quota-sets/4148e2a214a94168be4648239d3ab63a?user_id=bc593c6f4ddb4be2b6e41862db16aeb2" status: 200 len: 370 microversion: 2.1 time: 0.113437 Jun 10 18:05:38.611371 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1280/2630] 10.222.0.35 () {58 vars in 1322 bytes} [Fri Jun 10 18:05:38 2022] GET /compute/v2.1/os-quota-sets/4148e2a214a94168be4648239d3ab63a?user_id=bc593c6f4ddb4be2b6e41862db16aeb2 => generated 370 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:38.616473 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a7188635-6b77-49ed-993b-53e683b2d06f tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] Calling method '.version_select at 0x7f77c0419e50>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c18ec677-108a-45b7-b5f1-095fad58a005 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Request method failure captured: Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/7928b35c-fde4-48c5-8068-a32c4395684b HTTP/1.1 Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4fVKaV2yOV2R_JljWTbThJEMEjIYXgRQuhdx_KIZcVaOe4UmRGsZcdaV9rcP7GJic9zWagOCpUnX_g7LYBWqdBjRijta-GwQ5znLE0NkyU0ZOS8B9sBYUb8cWAy4b7xDsg1syrbjo-CekjQ7u2e4MVyk2x2jWtLB0CISqaTfmtlIM8 Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: a02fbcda5546455ca6ba1533af1373df Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-119967093 Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/a02fbcda5546455ca6ba1533af1373df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a02fbcda5546455ca6ba1533af1373df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a02fbcda5546455ca6ba1533af1373df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_a02fbcda5546455ca6ba1533af1373df", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-119967093 Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: a02fbcda5546455ca6ba1533af1373df Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-119967093 Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServerMetadataNegativeTestJSON-119967093-project Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: cdebe891ebac49128820e80cc5f2fca9 Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-119967093-project Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 7928b35c-fde4-48c5-8068-a32c4395684b could not be found. Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '7928b35c-fde4-48c5-8068-a32c4395684b'} Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7928b35c-fde4-48c5-8068-a32c4395684b could not be found. Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7928b35c-fde4-48c5-8068-a32c4395684b could not be found. Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:38.617676 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:38.628283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:38.628283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:38.628283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:38.628283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:38.628283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:05:38.628283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:05:38.628283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7928b35c-fde4-48c5-8068-a32c4395684b could not be found. Jun 10 18:05:38.628283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:38.628283 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c18ec677-108a-45b7-b5f1-095fad58a005 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] Returning 404 to user: Instance 7928b35c-fde4-48c5-8068-a32c4395684b could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:05:38.628283 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c18ec677-108a-45b7-b5f1-095fad58a005 tempest-ServerMetadataNegativeTestJSON-119967093 tempest-ServerMetadataNegativeTestJSON-119967093-project] 10.222.0.35 "GET /compute/v2.1/servers/7928b35c-fde4-48c5-8068-a32c4395684b" status: 404 len: 111 microversion: 2.1 time: 0.037706 Jun 10 18:05:38.628283 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1351/2631] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:38 2022] GET /compute/v2.1/servers/7928b35c-fde4-48c5-8068-a32c4395684b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:05:38.774424 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-f4558ce7-db79-4f61-b8ba-9ea7731f5e5d req-b316ef51-6bc0-4029-95e3-0ef60e4ad2dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1a36d13-beb9-478b-b00f-94efeae1248b", "name": "network-vif-unplugged", "status": "completed", "tag": "dd89a0eb-962f-4a1d-9233-8469a377029e"}, {"name": "network-changed", "server_uuid": "935bcaad-c46d-4d6c-8b00-7d349eefb5b2", "tag": "5e62510d-78bb-4546-9a32-2b22d19ec94b"}, {"name": "network-changed", "server_uuid": "f1a36d13-beb9-478b-b00f-94efeae1248b", "tag": "dd89a0eb-962f-4a1d-9233-8469a377029e"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:38.791714 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=2,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:05:38.797161 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-f4558ce7-db79-4f61-b8ba-9ea7731f5e5d req-b316ef51-6bc0-4029-95e3-0ef60e4ad2dd service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:38.797610 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-f4558ce7-db79-4f61-b8ba-9ea7731f5e5d req-b316ef51-6bc0-4029-95e3-0ef60e4ad2dd service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:38.816754 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-f4558ce7-db79-4f61-b8ba-9ea7731f5e5d req-b316ef51-6bc0-4029-95e3-0ef60e4ad2dd service nova] Creating event network-vif-unplugged:dd89a0eb-962f-4a1d-9233-8469a377029e for instance f1a36d13-beb9-478b-b00f-94efeae1248b on chh2-master-2 Jun 10 18:05:38.817443 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-f4558ce7-db79-4f61-b8ba-9ea7731f5e5d req-b316ef51-6bc0-4029-95e3-0ef60e4ad2dd service nova] Creating event network-changed:5e62510d-78bb-4546-9a32-2b22d19ec94b for instance 935bcaad-c46d-4d6c-8b00-7d349eefb5b2 on chh2-master-2 Jun 10 18:05:38.817959 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-f4558ce7-db79-4f61-b8ba-9ea7731f5e5d req-b316ef51-6bc0-4029-95e3-0ef60e4ad2dd service nova] Creating event network-changed:dd89a0eb-962f-4a1d-9233-8469a377029e for instance f1a36d13-beb9-478b-b00f-94efeae1248b on chh2-master-2 Jun 10 18:05:38.827242 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-f4558ce7-db79-4f61-b8ba-9ea7731f5e5d req-b316ef51-6bc0-4029-95e3-0ef60e4ad2dd service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.058415 Jun 10 18:05:38.828407 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1352/2632] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:05:38.939073 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a7188635-6b77-49ed-993b-53e683b2d06f tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] 10.222.0.35 "DELETE /compute/v2.1/os-security-groups/60054dc6-17c0-4bff-8384-9269265da540" status: 202 len: 0 microversion: 2.1 time: 0.324865 Jun 10 18:05:38.941145 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1281/2633] 10.222.0.35 () {58 vars in 1271 bytes} [Fri Jun 10 18:05:38 2022] DELETE /compute/v2.1/os-security-groups/60054dc6-17c0-4bff-8384-9269265da540 => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:05:38.947874 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f44acf50-8962-4517-b7f0-2bf51c7fed69 tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] Calling method '.version_select at 0x7f77b3ed61f0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:39.027084 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ade844cc-b297-4a15-a65e-26255a2b7d08 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:39.029491 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ade844cc-b297-4a15-a65e-26255a2b7d08 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:39.048076 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ade844cc-b297-4a15-a65e-26255a2b7d08 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:39.049362 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ade844cc-b297-4a15-a65e-26255a2b7d08 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:39.051884 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ade844cc-b297-4a15-a65e-26255a2b7d08 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:39.052599 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ade844cc-b297-4a15-a65e-26255a2b7d08 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:39.366782 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f44acf50-8962-4517-b7f0-2bf51c7fed69 tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] 10.222.0.35 "DELETE /compute/v2.1/os-security-groups/513dcc9c-ad9e-4817-87d1-c9863b94a935" status: 202 len: 0 microversion: 2.1 time: 0.424149 Jun 10 18:05:39.367635 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1353/2634] 10.222.0.35 () {58 vars in 1271 bytes} [Fri Jun 10 18:05:38 2022] DELETE /compute/v2.1/os-security-groups/513dcc9c-ad9e-4817-87d1-c9863b94a935 => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 18:05:39.373653 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-315fa4db-b08d-455c-b990-34232eb0cb7a tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:39.374738 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-315fa4db-b08d-455c-b990-34232eb0cb7a tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: 69ff0893-3da5-487f-8cb6-25763b854eaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:39.386175 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-315fa4db-b08d-455c-b990-34232eb0cb7a tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:39.386639 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-315fa4db-b08d-455c-b990-34232eb0cb7a tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:39.387431 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-315fa4db-b08d-455c-b990-34232eb0cb7a tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:39.387878 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-315fa4db-b08d-455c-b990-34232eb0cb7a tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:39.440773 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ade844cc-b297-4a15-a65e-26255a2b7d08 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:39.450833 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ade844cc-b297-4a15-a65e-26255a2b7d08 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:39.454037 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ade844cc-b297-4a15-a65e-26255a2b7d08 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:39.456235 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ade844cc-b297-4a15-a65e-26255a2b7d08 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1488 microversion: 2.25 time: 0.439837 Jun 10 18:05:39.457375 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1282/2635] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:05:39 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1488 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:05:39.465591 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fae0bc84-abbc-4129-b52e-b6d9761656b9 tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] Calling method '.version_select at 0x7f77c0364820>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:39.569810 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-315fa4db-b08d-455c-b990-34232eb0cb7a tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:39.577886 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-315fa4db-b08d-455c-b990-34232eb0cb7a tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa" status: 200 len: 1644 microversion: 2.1 time: 0.208266 Jun 10 18:05:39.588359 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1354/2636] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:39 2022] GET /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa => generated 1644 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:39.588359 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-29aa2361-2180-42d6-b88d-c8d147f6ea41 tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] Calling method '.version_select at 0x7f77b3f9eee0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:39.782759 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-29aa2361-2180-42d6-b88d-c8d147f6ea41 tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] 10.222.0.35 "GET /compute/v2.1/os-quota-sets/e192924a1ecd42cc918419008004c70e/defaults" status: 200 len: 371 microversion: 2.1 time: 0.203222 Jun 10 18:05:39.785252 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1355/2637] 10.222.0.35 () {58 vars in 1268 bytes} [Fri Jun 10 18:05:39 2022] GET /compute/v2.1/os-quota-sets/e192924a1ecd42cc918419008004c70e/defaults => generated 371 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:39.793836 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-30de4281-4c34-4afa-8f1f-a3ac8af4d6a5 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:39.794475 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-30de4281-4c34-4afa-8f1f-a3ac8af4d6a5 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 935bcaad-c46d-4d6c-8b00-7d349eefb5b2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:39.802360 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-30de4281-4c34-4afa-8f1f-a3ac8af4d6a5 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:39.803693 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-30de4281-4c34-4afa-8f1f-a3ac8af4d6a5 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:39.804672 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-30de4281-4c34-4afa-8f1f-a3ac8af4d6a5 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:39.805441 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-30de4281-4c34-4afa-8f1f-a3ac8af4d6a5 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:39.964724 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-30de4281-4c34-4afa-8f1f-a3ac8af4d6a5 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:39.972084 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-30de4281-4c34-4afa-8f1f-a3ac8af4d6a5 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/935bcaad-c46d-4d6c-8b00-7d349eefb5b2" status: 200 len: 1307 microversion: 2.1 time: 0.187742 Jun 10 18:05:39.972975 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1356/2638] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:39 2022] GET /compute/v2.1/servers/935bcaad-c46d-4d6c-8b00-7d349eefb5b2 => generated 1307 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:39.977902 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e1e98df9-7cf6-41d8-a93f-05dfeaa64ed4 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:39.978522 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e1e98df9-7cf6-41d8-a93f-05dfeaa64ed4 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 5a7cc611-89ea-4c58-af65-315000f47739] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:39.984847 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e1e98df9-7cf6-41d8-a93f-05dfeaa64ed4 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:39.985310 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e1e98df9-7cf6-41d8-a93f-05dfeaa64ed4 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:39.986088 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e1e98df9-7cf6-41d8-a93f-05dfeaa64ed4 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:39.986538 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e1e98df9-7cf6-41d8-a93f-05dfeaa64ed4 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:40.045112 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fae0bc84-abbc-4129-b52e-b6d9761656b9 tempest-SecurityGroupRulesNegativeTestJSON-442371350 tempest-SecurityGroupRulesNegativeTestJSON-442371350-project] 10.222.0.35 "DELETE /compute/v2.1/os-security-groups/b9ab3180-55c9-442d-bd8e-a8f93bf2c844" status: 202 len: 0 microversion: 2.1 time: 0.586175 Jun 10 18:05:40.045876 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1283/2639] 10.222.0.35 () {58 vars in 1271 bytes} [Fri Jun 10 18:05:39 2022] DELETE /compute/v2.1/os-security-groups/b9ab3180-55c9-442d-bd8e-a8f93bf2c844 => generated 0 bytes in 588 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:05:40.049891 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e1e98df9-7cf6-41d8-a93f-05dfeaa64ed4 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:40.051687 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-03a8f17d-44d0-4952-ad42-d5990ff03800 tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] Action: 'update', calling method: .version_select at 0x7f77c0364c10>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:40.066929 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e1e98df9-7cf6-41d8-a93f-05dfeaa64ed4 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/5a7cc611-89ea-4c58-af65-315000f47739" status: 200 len: 1269 microversion: 2.1 time: 0.092501 Jun 10 18:05:40.068026 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1357/2640] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:39 2022] GET /compute/v2.1/servers/5a7cc611-89ea-4c58-af65-315000f47739 => generated 1269 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:40.161091 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03a8f17d-44d0-4952-ad42-d5990ff03800 tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:40.161348 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03a8f17d-44d0-4952-ad42-d5990ff03800 tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:40.164257 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03a8f17d-44d0-4952-ad42-d5990ff03800 tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:40.170197 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03a8f17d-44d0-4952-ad42-d5990ff03800 tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:40.475627 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=95,nova_api:INSERT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:05:40.476991 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-306acd1c-e74d-4717-8f7d-4f116ceaf4a9 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:40.478030 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-306acd1c-e74d-4717-8f7d-4f116ceaf4a9 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:40.484040 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-306acd1c-e74d-4717-8f7d-4f116ceaf4a9 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:40.484866 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-306acd1c-e74d-4717-8f7d-4f116ceaf4a9 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:40.485934 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-306acd1c-e74d-4717-8f7d-4f116ceaf4a9 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:40.486624 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-306acd1c-e74d-4717-8f7d-4f116ceaf4a9 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:40.668112 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-306acd1c-e74d-4717-8f7d-4f116ceaf4a9 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:40.676951 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-306acd1c-e74d-4717-8f7d-4f116ceaf4a9 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:40.678624 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-306acd1c-e74d-4717-8f7d-4f116ceaf4a9 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:40.679894 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-306acd1c-e74d-4717-8f7d-4f116ceaf4a9 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1488 microversion: 2.25 time: 0.208736 Jun 10 18:05:40.680521 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1358/2641] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:05:40 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1488 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:05:40.685519 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cf71d051-ea6b-41dc-b199-7544148cdbcb tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:40.691071 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cf71d051-ea6b-41dc-b199-7544148cdbcb tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: 69ff0893-3da5-487f-8cb6-25763b854eaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:40.692867 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf71d051-ea6b-41dc-b199-7544148cdbcb tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:40.693392 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf71d051-ea6b-41dc-b199-7544148cdbcb tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:40.694324 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf71d051-ea6b-41dc-b199-7544148cdbcb tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:40.694829 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf71d051-ea6b-41dc-b199-7544148cdbcb tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:40.730936 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf71d051-ea6b-41dc-b199-7544148cdbcb tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:40.731706 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf71d051-ea6b-41dc-b199-7544148cdbcb tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:40.732420 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-cf71d051-ea6b-41dc-b199-7544148cdbcb tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lazy-loading 'fault' on Instance uuid 69ff0893-3da5-487f-8cb6-25763b854eaa {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:05:40.839380 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cf71d051-ea6b-41dc-b199-7544148cdbcb tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7278ccddeee3495583093603a0fdb626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304a5340852d4552a490e874dda8a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:40.859235 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cf71d051-ea6b-41dc-b199-7544148cdbcb tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa" status: 200 len: 1306 microversion: 2.1 time: 0.177449 Jun 10 18:05:40.864631 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1359/2642] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:40 2022] GET /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa => generated 1306 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:40.872771 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-65591a79-7f4e-4f01-894a-89098c36cabd req-6cb67aa1-2944-423c-b366-512c0f0ebfe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69ff0893-3da5-487f-8cb6-25763b854eaa", "name": "network-vif-deleted", "tag": "23377b35-13e3-460e-98a2-837389f0a21d"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:40.887330 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-65591a79-7f4e-4f01-894a-89098c36cabd req-6cb67aa1-2944-423c-b366-512c0f0ebfe8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:40.888264 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-65591a79-7f4e-4f01-894a-89098c36cabd req-6cb67aa1-2944-423c-b366-512c0f0ebfe8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:40.906662 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-65591a79-7f4e-4f01-894a-89098c36cabd req-6cb67aa1-2944-423c-b366-512c0f0ebfe8 service nova] Creating event network-vif-deleted:23377b35-13e3-460e-98a2-837389f0a21d for instance 69ff0893-3da5-487f-8cb6-25763b854eaa on chh1-master-2 Jun 10 18:05:40.913792 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-65591a79-7f4e-4f01-894a-89098c36cabd req-6cb67aa1-2944-423c-b366-512c0f0ebfe8 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046430 Jun 10 18:05:40.915506 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1360/2643] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:40.990722 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3a9f9f66-5adb-4576-b503-8ebd5fb96db9 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:40.991457 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3a9f9f66-5adb-4576-b503-8ebd5fb96db9 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 935bcaad-c46d-4d6c-8b00-7d349eefb5b2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:40.998615 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3a9f9f66-5adb-4576-b503-8ebd5fb96db9 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:40.999281 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3a9f9f66-5adb-4576-b503-8ebd5fb96db9 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:41.001806 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3a9f9f66-5adb-4576-b503-8ebd5fb96db9 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:41.001806 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3a9f9f66-5adb-4576-b503-8ebd5fb96db9 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:41.251418 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3a9f9f66-5adb-4576-b503-8ebd5fb96db9 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:41.260914 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3a9f9f66-5adb-4576-b503-8ebd5fb96db9 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/935bcaad-c46d-4d6c-8b00-7d349eefb5b2" status: 200 len: 1307 microversion: 2.1 time: 0.274580 Jun 10 18:05:41.261581 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1361/2644] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:40 2022] GET /compute/v2.1/servers/935bcaad-c46d-4d6c-8b00-7d349eefb5b2 => generated 1307 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:05:41.275836 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c5b7da66-90e4-4364-be20-a17c1ffbbfc7 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:41.278609 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c5b7da66-90e4-4364-be20-a17c1ffbbfc7 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 5a7cc611-89ea-4c58-af65-315000f47739] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:41.294405 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5b7da66-90e4-4364-be20-a17c1ffbbfc7 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:41.294875 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5b7da66-90e4-4364-be20-a17c1ffbbfc7 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:41.295735 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5b7da66-90e4-4364-be20-a17c1ffbbfc7 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:41.296407 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5b7da66-90e4-4364-be20-a17c1ffbbfc7 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:41.379896 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c5b7da66-90e4-4364-be20-a17c1ffbbfc7 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:41.391343 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c5b7da66-90e4-4364-be20-a17c1ffbbfc7 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/5a7cc611-89ea-4c58-af65-315000f47739" status: 200 len: 1275 microversion: 2.1 time: 0.128608 Jun 10 18:05:41.394097 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1362/2645] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:41 2022] GET /compute/v2.1/servers/5a7cc611-89ea-4c58-af65-315000f47739 => generated 1275 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:41.698455 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6379406e-b06d-412b-bb62-a7a87b905170 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:41.699533 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6379406e-b06d-412b-bb62-a7a87b905170 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:41.710220 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6379406e-b06d-412b-bb62-a7a87b905170 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:41.710686 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6379406e-b06d-412b-bb62-a7a87b905170 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:41.711748 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6379406e-b06d-412b-bb62-a7a87b905170 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:41.712333 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6379406e-b06d-412b-bb62-a7a87b905170 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:41.776290 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-03a8f17d-44d0-4952-ad42-d5990ff03800 tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] 10.222.0.35 "PUT /compute/v2.1/os-quota-sets/e192924a1ecd42cc918419008004c70e" status: 200 len: 329 microversion: 2.1 time: 1.728686 Jun 10 18:05:41.777242 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1284/2646] 10.222.0.35 () {60 vars in 1262 bytes} [Fri Jun 10 18:05:40 2022] PUT /compute/v2.1/os-quota-sets/e192924a1ecd42cc918419008004c70e => generated 329 bytes in 1730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:41.788405 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-997649f3-0ada-499c-a207-c891a7317e88 tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] Action: 'update', calling method: .version_select at 0x7f77c03df430>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:41.938688 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6379406e-b06d-412b-bb62-a7a87b905170 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:41.948655 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6379406e-b06d-412b-bb62-a7a87b905170 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:41.955872 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6379406e-b06d-412b-bb62-a7a87b905170 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:41.955872 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6379406e-b06d-412b-bb62-a7a87b905170 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1488 microversion: 2.25 time: 0.257837 Jun 10 18:05:41.955872 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1363/2647] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:05:41 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1488 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:05:41.959868 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f0b23acd-0b35-40ea-8a29-b43861c10503 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:41.960849 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f0b23acd-0b35-40ea-8a29-b43861c10503 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] [instance: 69ff0893-3da5-487f-8cb6-25763b854eaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:41.971922 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f0b23acd-0b35-40ea-8a29-b43861c10503 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:41.972817 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f0b23acd-0b35-40ea-8a29-b43861c10503 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:41.974122 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f0b23acd-0b35-40ea-8a29-b43861c10503 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:41.974806 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f0b23acd-0b35-40ea-8a29-b43861c10503 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:42.016382 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-f0b23acd-0b35-40ea-8a29-b43861c10503 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] HTTP exception thrown: Instance 69ff0893-3da5-487f-8cb6-25763b854eaa could not be found. Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f0b23acd-0b35-40ea-8a29-b43861c10503 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Request method failure captured: Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa HTTP/1.1 Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4eKfGQZQ_jvhwHBxZ1GMnYHkMaBNBt7T8Ue90hW5x7BTDgkg2AiOfeu2huz2YQsnFH29P56VFWZd48_hROirge71TvR4QiKyTENHZz-D3t9ZS-m9216ej7Rjuw3slpnWYAQuE-KXkyXTlRqKM7yyNbBp9KRqjUFN-v2IWlTc7Yfat0 Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 304a5340852d4552a490e874dda8a0a3 Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/304a5340852d4552a490e874dda8a0a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_304a5340852d4552a490e874dda8a0a3", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 304a5340852d4552a490e874dda8a0a3 Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-732923421 Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-SecurityGroupsTestJSON-732923421-project Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 7278ccddeee3495583093603a0fdb626 Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-SecurityGroupsTestJSON-732923421-project Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 69ff0893-3da5-487f-8cb6-25763b854eaa could not be found. Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '69ff0893-3da5-487f-8cb6-25763b854eaa'} Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69ff0893-3da5-487f-8cb6-25763b854eaa could not be found. Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69ff0893-3da5-487f-8cb6-25763b854eaa could not be found. Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:05:42.018735 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:42.024217 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:05:42.024217 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:05:42.024217 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:05:42.024217 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:05:42.024217 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:05:42.024217 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69ff0893-3da5-487f-8cb6-25763b854eaa could not be found. Jun 10 18:05:42.024217 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:05:42.024217 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f0b23acd-0b35-40ea-8a29-b43861c10503 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Returning 404 to user: Instance 69ff0893-3da5-487f-8cb6-25763b854eaa could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:05:42.024217 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f0b23acd-0b35-40ea-8a29-b43861c10503 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "GET /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa" status: 404 len: 111 microversion: 2.1 time: 0.069699 Jun 10 18:05:42.024945 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1364/2648] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:41 2022] GET /compute/v2.1/servers/69ff0893-3da5-487f-8cb6-25763b854eaa => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:05:42.032994 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3305715c-727e-400a-bb67-6171fcd03f69 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '.version_select at 0x7f77c18768b0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:42.200584 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-997649f3-0ada-499c-a207-c891a7317e88 tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:42.201203 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-997649f3-0ada-499c-a207-c891a7317e88 tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:42.203245 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-997649f3-0ada-499c-a207-c891a7317e88 tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:42.204963 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-997649f3-0ada-499c-a207-c891a7317e88 tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:42.671147 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3305715c-727e-400a-bb67-6171fcd03f69 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "DELETE /compute/v2.1/os-security-groups/47e1dceb-00a5-420d-8917-74e6e31805d8" status: 202 len: 0 microversion: 2.1 time: 0.642395 Jun 10 18:05:42.671740 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1365/2649] 10.222.0.35 () {58 vars in 1271 bytes} [Fri Jun 10 18:05:42 2022] DELETE /compute/v2.1/os-security-groups/47e1dceb-00a5-420d-8917-74e6e31805d8 => generated 0 bytes in 644 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:05:42.676528 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-142dec7b-6aac-49ad-952a-9c56ec8ef95e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:42.677293 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-142dec7b-6aac-49ad-952a-9c56ec8ef95e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 935bcaad-c46d-4d6c-8b00-7d349eefb5b2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:42.685324 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-142dec7b-6aac-49ad-952a-9c56ec8ef95e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:42.685793 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-142dec7b-6aac-49ad-952a-9c56ec8ef95e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:42.687953 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-142dec7b-6aac-49ad-952a-9c56ec8ef95e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:42.689048 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-142dec7b-6aac-49ad-952a-9c56ec8ef95e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:43.012943 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-142dec7b-6aac-49ad-952a-9c56ec8ef95e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:43.028192 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-142dec7b-6aac-49ad-952a-9c56ec8ef95e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/935bcaad-c46d-4d6c-8b00-7d349eefb5b2" status: 200 len: 1307 microversion: 2.1 time: 0.351650 Jun 10 18:05:43.028889 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1366/2650] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:42 2022] GET /compute/v2.1/servers/935bcaad-c46d-4d6c-8b00-7d349eefb5b2 => generated 1307 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:43.047349 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2f6aebc6-7dbe-4162-8af4-01b776a87035 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:43.049926 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2f6aebc6-7dbe-4162-8af4-01b776a87035 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 5a7cc611-89ea-4c58-af65-315000f47739] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:43.072597 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2f6aebc6-7dbe-4162-8af4-01b776a87035 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:43.073383 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2f6aebc6-7dbe-4162-8af4-01b776a87035 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:43.079879 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2f6aebc6-7dbe-4162-8af4-01b776a87035 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:43.080720 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2f6aebc6-7dbe-4162-8af4-01b776a87035 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:43.141625 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:05:43.433540 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2f6aebc6-7dbe-4162-8af4-01b776a87035 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:43.441138 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2f6aebc6-7dbe-4162-8af4-01b776a87035 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/5a7cc611-89ea-4c58-af65-315000f47739" status: 200 len: 1317 microversion: 2.1 time: 0.410886 Jun 10 18:05:43.441713 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1367/2651] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:43 2022] GET /compute/v2.1/servers/5a7cc611-89ea-4c58-af65-315000f47739 => generated 1317 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:43.446312 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6283a2fa-8893-46fd-bc6d-70eb3a05a0d8 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] Calling method '.version_select at 0x7f77b3f9e550>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:44.031880 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6283a2fa-8893-46fd-bc6d-70eb3a05a0d8 tempest-SecurityGroupsTestJSON-732923421 tempest-SecurityGroupsTestJSON-732923421-project] 10.222.0.35 "DELETE /compute/v2.1/os-security-groups/dfb67a4b-9ba3-4d02-a64f-8c242a791d23" status: 202 len: 0 microversion: 2.1 time: 0.588908 Jun 10 18:05:44.032575 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1368/2652] 10.222.0.35 () {58 vars in 1271 bytes} [Fri Jun 10 18:05:43 2022] DELETE /compute/v2.1/os-security-groups/dfb67a4b-9ba3-4d02-a64f-8c242a791d23 => generated 0 bytes in 590 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:05:44.038024 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6f6c3a2d-7959-411b-bca1-f4d2dbfa6c73 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:44.039209 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6f6c3a2d-7959-411b-bca1-f4d2dbfa6c73 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:44.046067 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6f6c3a2d-7959-411b-bca1-f4d2dbfa6c73 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:44.046769 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6f6c3a2d-7959-411b-bca1-f4d2dbfa6c73 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:44.047768 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6f6c3a2d-7959-411b-bca1-f4d2dbfa6c73 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:44.048420 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6f6c3a2d-7959-411b-bca1-f4d2dbfa6c73 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:44.439889 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6f6c3a2d-7959-411b-bca1-f4d2dbfa6c73 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:44.452085 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6f6c3a2d-7959-411b-bca1-f4d2dbfa6c73 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:44.454373 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6f6c3a2d-7959-411b-bca1-f4d2dbfa6c73 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:44.458495 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6f6c3a2d-7959-411b-bca1-f4d2dbfa6c73 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1488 microversion: 2.25 time: 0.422410 Jun 10 18:05:44.458495 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1369/2653] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:05:44 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1488 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:05:44.465143 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-dc662522-e322-446b-b89d-c3cc5f082e94 req-ee447115-6f6a-4f21-ad8c-c2bb1a144fc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a7cc611-89ea-4c58-af65-315000f47739", "tag": "ac79ea71-a2b0-4849-806b-8ca1657704b3"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:44.476359 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-dc662522-e322-446b-b89d-c3cc5f082e94 req-ee447115-6f6a-4f21-ad8c-c2bb1a144fc6 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:44.477145 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-dc662522-e322-446b-b89d-c3cc5f082e94 req-ee447115-6f6a-4f21-ad8c-c2bb1a144fc6 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:44.488643 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-dc662522-e322-446b-b89d-c3cc5f082e94 req-ee447115-6f6a-4f21-ad8c-c2bb1a144fc6 service nova] Creating event network-changed:ac79ea71-a2b0-4849-806b-8ca1657704b3 for instance 5a7cc611-89ea-4c58-af65-315000f47739 on chh1-master-2 Jun 10 18:05:44.493612 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-dc662522-e322-446b-b89d-c3cc5f082e94 req-ee447115-6f6a-4f21-ad8c-c2bb1a144fc6 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032937 Jun 10 18:05:44.494607 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1370/2654] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:44.499690 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7f5ae753-39ba-4412-a1c8-be206bdfbfca tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:44.500457 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7f5ae753-39ba-4412-a1c8-be206bdfbfca tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 935bcaad-c46d-4d6c-8b00-7d349eefb5b2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:44.508268 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7f5ae753-39ba-4412-a1c8-be206bdfbfca tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:44.509108 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7f5ae753-39ba-4412-a1c8-be206bdfbfca tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:44.515917 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7f5ae753-39ba-4412-a1c8-be206bdfbfca tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:44.515917 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7f5ae753-39ba-4412-a1c8-be206bdfbfca tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:44.715086 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7f5ae753-39ba-4412-a1c8-be206bdfbfca tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:44.723396 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7f5ae753-39ba-4412-a1c8-be206bdfbfca tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/935bcaad-c46d-4d6c-8b00-7d349eefb5b2" status: 200 len: 1307 microversion: 2.1 time: 0.227785 Jun 10 18:05:44.724011 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1371/2655] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:44 2022] GET /compute/v2.1/servers/935bcaad-c46d-4d6c-8b00-7d349eefb5b2 => generated 1307 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:44.730879 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-33f1b361-9bf8-4edf-a0bd-027a1086b4ea tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:44.731511 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-33f1b361-9bf8-4edf-a0bd-027a1086b4ea tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 5a7cc611-89ea-4c58-af65-315000f47739] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:44.738029 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-33f1b361-9bf8-4edf-a0bd-027a1086b4ea tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:44.740151 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-33f1b361-9bf8-4edf-a0bd-027a1086b4ea tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:44.740151 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-33f1b361-9bf8-4edf-a0bd-027a1086b4ea tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:44.740151 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-33f1b361-9bf8-4edf-a0bd-027a1086b4ea tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:44.802712 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-997649f3-0ada-499c-a207-c891a7317e88 tempest-QuotasAdminTestJSON-2128103224 tempest-QuotasAdminTestJSON-2128103224-project-admin] 10.222.0.35 "PUT /compute/v2.1/os-quota-sets/e192924a1ecd42cc918419008004c70e" status: 200 len: 329 microversion: 2.1 time: 3.018912 Jun 10 18:05:44.804383 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1285/2656] 10.222.0.35 () {60 vars in 1262 bytes} [Fri Jun 10 18:05:41 2022] PUT /compute/v2.1/os-quota-sets/e192924a1ecd42cc918419008004c70e => generated 329 bytes in 3021 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:45.097656 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-33f1b361-9bf8-4edf-a0bd-027a1086b4ea tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:45.106575 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-33f1b361-9bf8-4edf-a0bd-027a1086b4ea tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/5a7cc611-89ea-4c58-af65-315000f47739" status: 200 len: 1317 microversion: 2.1 time: 0.381439 Jun 10 18:05:45.107496 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1372/2657] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:44 2022] GET /compute/v2.1/servers/5a7cc611-89ea-4c58-af65-315000f47739 => generated 1317 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:45.252930 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-48fff80c-c4bf-4828-a738-4342aedfff7b tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-823404259", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "10fd2735-c689-44c6-9a22-0c6ae2f892f2"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:45.341838 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-48fff80c-c4bf-4828-a738-4342aedfff7b tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] validate_networks() for [('10fd2735-c689-44c6-9a22-0c6ae2f892f2', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:05:45.373784 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-be365cc5-49cf-4ee0-ba81-e76ed0f6a842 req-f2077459-80b1-4006-9561-e8c0e951a7f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "935bcaad-c46d-4d6c-8b00-7d349eefb5b2", "name": "network-vif-plugged", "status": "completed", "tag": "5e62510d-78bb-4546-9a32-2b22d19ec94b"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:45.390030 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-be365cc5-49cf-4ee0-ba81-e76ed0f6a842 req-f2077459-80b1-4006-9561-e8c0e951a7f5 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:45.400994 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-be365cc5-49cf-4ee0-ba81-e76ed0f6a842 req-f2077459-80b1-4006-9561-e8c0e951a7f5 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:45.423193 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-be365cc5-49cf-4ee0-ba81-e76ed0f6a842 req-f2077459-80b1-4006-9561-e8c0e951a7f5 service nova] Creating event network-vif-plugged:5e62510d-78bb-4546-9a32-2b22d19ec94b for instance 935bcaad-c46d-4d6c-8b00-7d349eefb5b2 on chh2-master-2 Jun 10 18:05:45.428925 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-be365cc5-49cf-4ee0-ba81-e76ed0f6a842 req-f2077459-80b1-4006-9561-e8c0e951a7f5 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059541 Jun 10 18:05:45.430350 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1373/2658] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:05:45.478152 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-966295cd-7ba2-4d06-a10f-789b9b393b4c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:45.479087 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-966295cd-7ba2-4d06-a10f-789b9b393b4c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:45.516055 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-966295cd-7ba2-4d06-a10f-789b9b393b4c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:45.519642 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-966295cd-7ba2-4d06-a10f-789b9b393b4c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:45.522381 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-966295cd-7ba2-4d06-a10f-789b9b393b4c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:45.524106 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-966295cd-7ba2-4d06-a10f-789b9b393b4c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:45.978273 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-48fff80c-c4bf-4828-a738-4342aedfff7b tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:05:45.980733 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-966295cd-7ba2-4d06-a10f-789b9b393b4c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:45.981969 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-48fff80c-c4bf-4828-a738-4342aedfff7b tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:05:45.982742 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-48fff80c-c4bf-4828-a738-4342aedfff7b tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:05:45.983162 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-48fff80c-c4bf-4828-a738-4342aedfff7b tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:05:45.983607 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-48fff80c-c4bf-4828-a738-4342aedfff7b tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:05:45.993224 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-48fff80c-c4bf-4828-a738-4342aedfff7b tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:45.994146 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-48fff80c-c4bf-4828-a738-4342aedfff7b tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:45.994275 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-966295cd-7ba2-4d06-a10f-789b9b393b4c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:45.995526 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-48fff80c-c4bf-4828-a738-4342aedfff7b tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:45.995677 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-966295cd-7ba2-4d06-a10f-789b9b393b4c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:45.996555 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-48fff80c-c4bf-4828-a738-4342aedfff7b tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:45.997112 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-966295cd-7ba2-4d06-a10f-789b9b393b4c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1488 microversion: 2.25 time: 0.523808 Jun 10 18:05:45.997673 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1374/2659] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:05:45 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1488 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:05:46.004527 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-13553f05-1b01-4535-a516-28b16efed675 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:46.005411 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-13553f05-1b01-4535-a516-28b16efed675 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 935bcaad-c46d-4d6c-8b00-7d349eefb5b2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:46.011931 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-13553f05-1b01-4535-a516-28b16efed675 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:46.012610 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-13553f05-1b01-4535-a516-28b16efed675 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:46.013394 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-13553f05-1b01-4535-a516-28b16efed675 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:46.014028 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-13553f05-1b01-4535-a516-28b16efed675 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:46.014235 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=25,nova_api:UPDATE=14 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:05:46.024416 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-48fff80c-c4bf-4828-a738-4342aedfff7b tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Getting quotas for project 834322ffb5f54cff911c2fc52a35e3e7. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:05:46.030149 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-48fff80c-c4bf-4828-a738-4342aedfff7b tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Getting quotas for user de8bb9feeac64f588262980fe5052c96 and project 834322ffb5f54cff911c2fc52a35e3e7. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:05:46.050984 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-48fff80c-c4bf-4828-a738-4342aedfff7b tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:05:46.055126 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-48fff80c-c4bf-4828-a738-4342aedfff7b tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] [instance: 68801152-6e36-4e3e-95b6-e9e6eac3b8c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:05:46.292968 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-48fff80c-c4bf-4828-a738-4342aedfff7b tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.258694 Jun 10 18:05:46.294153 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1286/2660] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:05:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:05:46.300287 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c74d64cd-5971-41db-a85c-41e4224ce3bf tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:46.301190 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c74d64cd-5971-41db-a85c-41e4224ce3bf tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 5a7cc611-89ea-4c58-af65-315000f47739] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:46.308616 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c74d64cd-5971-41db-a85c-41e4224ce3bf tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:46.313400 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c74d64cd-5971-41db-a85c-41e4224ce3bf tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:46.313400 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c74d64cd-5971-41db-a85c-41e4224ce3bf tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:46.313400 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c74d64cd-5971-41db-a85c-41e4224ce3bf tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:46.514681 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c74d64cd-5971-41db-a85c-41e4224ce3bf tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:46.523670 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c74d64cd-5971-41db-a85c-41e4224ce3bf tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/5a7cc611-89ea-4c58-af65-315000f47739" status: 200 len: 1317 microversion: 2.1 time: 0.226244 Jun 10 18:05:46.524948 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1287/2661] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:46 2022] GET /compute/v2.1/servers/5a7cc611-89ea-4c58-af65-315000f47739 => generated 1317 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:46.530464 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-30b51c82-31f5-47cb-97d5-709465a57397 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:46.531060 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-30b51c82-31f5-47cb-97d5-709465a57397 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] [instance: 68801152-6e36-4e3e-95b6-e9e6eac3b8c3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:46.609129 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-30b51c82-31f5-47cb-97d5-709465a57397 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8bb9feeac64f588262980fe5052c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834322ffb5f54cff911c2fc52a35e3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:46.617302 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-30b51c82-31f5-47cb-97d5-709465a57397 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] 10.222.0.35 "GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3" status: 200 len: 1215 microversion: 2.1 time: 0.091237 Jun 10 18:05:46.617858 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1288/2662] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:46 2022] GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3 => generated 1215 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:46.695247 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-13553f05-1b01-4535-a516-28b16efed675 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:46.704697 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-13553f05-1b01-4535-a516-28b16efed675 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/935bcaad-c46d-4d6c-8b00-7d349eefb5b2" status: 200 len: 1307 microversion: 2.1 time: 0.705753 Jun 10 18:05:46.705644 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1375/2663] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:45 2022] GET /compute/v2.1/servers/935bcaad-c46d-4d6c-8b00-7d349eefb5b2 => generated 1307 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:47.015344 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-32a8f071-2644-4609-a521-c662cb0cb7b8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:47.016577 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-32a8f071-2644-4609-a521-c662cb0cb7b8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:47.023224 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-32a8f071-2644-4609-a521-c662cb0cb7b8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:47.023672 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-32a8f071-2644-4609-a521-c662cb0cb7b8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:47.024473 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-32a8f071-2644-4609-a521-c662cb0cb7b8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:47.025095 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-32a8f071-2644-4609-a521-c662cb0cb7b8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:47.277054 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-32a8f071-2644-4609-a521-c662cb0cb7b8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:47.288259 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-32a8f071-2644-4609-a521-c662cb0cb7b8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:47.289819 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-32a8f071-2644-4609-a521-c662cb0cb7b8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:47.291257 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-32a8f071-2644-4609-a521-c662cb0cb7b8 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1488 microversion: 2.25 time: 0.280100 Jun 10 18:05:47.303471 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1289/2664] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:05:47 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1488 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:05:47.542090 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7d399a08-cdd3-4b18-b016-c8451ea3f9c9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:47.542860 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7d399a08-cdd3-4b18-b016-c8451ea3f9c9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 5a7cc611-89ea-4c58-af65-315000f47739] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:47.550471 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7d399a08-cdd3-4b18-b016-c8451ea3f9c9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:47.553055 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7d399a08-cdd3-4b18-b016-c8451ea3f9c9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:47.553055 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7d399a08-cdd3-4b18-b016-c8451ea3f9c9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:47.553055 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7d399a08-cdd3-4b18-b016-c8451ea3f9c9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:47.639560 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4d3f6473-17b6-4cb6-94f5-9d69d9ffec3c tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:47.640291 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4d3f6473-17b6-4cb6-94f5-9d69d9ffec3c tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] [instance: 68801152-6e36-4e3e-95b6-e9e6eac3b8c3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:47.837727 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4d3f6473-17b6-4cb6-94f5-9d69d9ffec3c tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8bb9feeac64f588262980fe5052c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834322ffb5f54cff911c2fc52a35e3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:47.846301 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4d3f6473-17b6-4cb6-94f5-9d69d9ffec3c tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] 10.222.0.35 "GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3" status: 200 len: 1215 microversion: 2.1 time: 0.211426 Jun 10 18:05:47.847468 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1290/2665] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:47 2022] GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3 => generated 1215 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:47.852748 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2513c894-da9b-47a0-8bee-71574a29156a tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:47.853924 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2513c894-da9b-47a0-8bee-71574a29156a tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 935bcaad-c46d-4d6c-8b00-7d349eefb5b2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:47.864142 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=13 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:05:47.869553 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2513c894-da9b-47a0-8bee-71574a29156a tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:47.869553 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2513c894-da9b-47a0-8bee-71574a29156a tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:47.869843 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2513c894-da9b-47a0-8bee-71574a29156a tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:47.870146 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2513c894-da9b-47a0-8bee-71574a29156a tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:47.900610 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7d399a08-cdd3-4b18-b016-c8451ea3f9c9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:47.907485 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7d399a08-cdd3-4b18-b016-c8451ea3f9c9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/5a7cc611-89ea-4c58-af65-315000f47739" status: 200 len: 1317 microversion: 2.1 time: 0.370288 Jun 10 18:05:47.908071 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1376/2666] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:47 2022] GET /compute/v2.1/servers/5a7cc611-89ea-4c58-af65-315000f47739 => generated 1317 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:48.015554 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2513c894-da9b-47a0-8bee-71574a29156a tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:48.035684 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2513c894-da9b-47a0-8bee-71574a29156a tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/935bcaad-c46d-4d6c-8b00-7d349eefb5b2" status: 200 len: 1486 microversion: 2.1 time: 0.175445 Jun 10 18:05:48.035684 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1291/2667] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:47 2022] GET /compute/v2.1/servers/935bcaad-c46d-4d6c-8b00-7d349eefb5b2 => generated 1486 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:48.043197 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d6bb02cc-ce16-43f2-bfd7-643f8f1fbbd3 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:48.044142 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d6bb02cc-ce16-43f2-bfd7-643f8f1fbbd3 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 935bcaad-c46d-4d6c-8b00-7d349eefb5b2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:48.049161 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=40 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:05:48.063303 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d6bb02cc-ce16-43f2-bfd7-643f8f1fbbd3 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:48.063303 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d6bb02cc-ce16-43f2-bfd7-643f8f1fbbd3 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:48.063303 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d6bb02cc-ce16-43f2-bfd7-643f8f1fbbd3 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:48.063303 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d6bb02cc-ce16-43f2-bfd7-643f8f1fbbd3 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:48.309860 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c69e8b24-9d25-48e1-82af-73537f808e3c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:48.310854 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c69e8b24-9d25-48e1-82af-73537f808e3c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:48.324621 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c69e8b24-9d25-48e1-82af-73537f808e3c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:48.324621 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c69e8b24-9d25-48e1-82af-73537f808e3c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:48.324621 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c69e8b24-9d25-48e1-82af-73537f808e3c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:48.324621 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c69e8b24-9d25-48e1-82af-73537f808e3c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:48.387252 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d6bb02cc-ce16-43f2-bfd7-643f8f1fbbd3 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "POST /compute/v2.1/servers/935bcaad-c46d-4d6c-8b00-7d349eefb5b2/action" status: 202 len: 0 microversion: 2.1 time: 0.348422 Jun 10 18:05:48.389376 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1377/2668] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:05:48 2022] POST /compute/v2.1/servers/935bcaad-c46d-4d6c-8b00-7d349eefb5b2/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:05:48.434747 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d15aa3ce-2394-490e-ae86-803a156c0673 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:48.454329 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d15aa3ce-2394-490e-ae86-803a156c0673 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 935bcaad-c46d-4d6c-8b00-7d349eefb5b2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:48.475917 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d15aa3ce-2394-490e-ae86-803a156c0673 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:48.477806 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d15aa3ce-2394-490e-ae86-803a156c0673 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:48.478856 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d15aa3ce-2394-490e-ae86-803a156c0673 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:48.480675 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d15aa3ce-2394-490e-ae86-803a156c0673 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:48.624786 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c69e8b24-9d25-48e1-82af-73537f808e3c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:48.635998 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c69e8b24-9d25-48e1-82af-73537f808e3c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:48.639153 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c69e8b24-9d25-48e1-82af-73537f808e3c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:48.651774 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c69e8b24-9d25-48e1-82af-73537f808e3c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1488 microversion: 2.25 time: 0.334993 Jun 10 18:05:48.653884 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1292/2669] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:05:48 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1488 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:05:48.863364 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-21680812-afd9-4276-8a39-4f3899e68414 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:48.863980 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-21680812-afd9-4276-8a39-4f3899e68414 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] [instance: 68801152-6e36-4e3e-95b6-e9e6eac3b8c3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:48.880798 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d15aa3ce-2394-490e-ae86-803a156c0673 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:48.884614 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d15aa3ce-2394-490e-ae86-803a156c0673 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/935bcaad-c46d-4d6c-8b00-7d349eefb5b2" status: 200 len: 1491 microversion: 2.1 time: 0.488740 Jun 10 18:05:48.888367 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1378/2670] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:48 2022] GET /compute/v2.1/servers/935bcaad-c46d-4d6c-8b00-7d349eefb5b2 => generated 1491 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:05:48.888534 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-21680812-afd9-4276-8a39-4f3899e68414 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:48.888534 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-21680812-afd9-4276-8a39-4f3899e68414 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:48.888534 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-21680812-afd9-4276-8a39-4f3899e68414 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:48.888534 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-21680812-afd9-4276-8a39-4f3899e68414 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:48.925066 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9f93a9b2-0e50-4f92-ba65-e8d6fd8e2163 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:48.925922 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9f93a9b2-0e50-4f92-ba65-e8d6fd8e2163 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 5a7cc611-89ea-4c58-af65-315000f47739] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:48.935534 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9f93a9b2-0e50-4f92-ba65-e8d6fd8e2163 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:48.937003 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9f93a9b2-0e50-4f92-ba65-e8d6fd8e2163 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:48.938835 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9f93a9b2-0e50-4f92-ba65-e8d6fd8e2163 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:48.941112 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9f93a9b2-0e50-4f92-ba65-e8d6fd8e2163 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:49.025558 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-21680812-afd9-4276-8a39-4f3899e68414 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8bb9feeac64f588262980fe5052c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834322ffb5f54cff911c2fc52a35e3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:49.032936 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-21680812-afd9-4276-8a39-4f3899e68414 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] 10.222.0.35 "GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3" status: 200 len: 1211 microversion: 2.1 time: 0.173374 Jun 10 18:05:49.042830 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1293/2671] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:48 2022] GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3 => generated 1211 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:49.379221 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9f93a9b2-0e50-4f92-ba65-e8d6fd8e2163 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:49.392728 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9f93a9b2-0e50-4f92-ba65-e8d6fd8e2163 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/5a7cc611-89ea-4c58-af65-315000f47739" status: 200 len: 1317 microversion: 2.1 time: 0.471412 Jun 10 18:05:49.395224 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1379/2672] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:48 2022] GET /compute/v2.1/servers/5a7cc611-89ea-4c58-af65-315000f47739 => generated 1317 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:05:49.664102 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dc2ef8f4-5963-4ea8-b99b-1d798a099276 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:49.664863 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dc2ef8f4-5963-4ea8-b99b-1d798a099276 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:49.673994 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc2ef8f4-5963-4ea8-b99b-1d798a099276 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:49.674522 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc2ef8f4-5963-4ea8-b99b-1d798a099276 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:49.675376 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc2ef8f4-5963-4ea8-b99b-1d798a099276 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:49.675923 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc2ef8f4-5963-4ea8-b99b-1d798a099276 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:49.902415 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-dc2ef8f4-5963-4ea8-b99b-1d798a099276 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:49.902948 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-46ea6399-527e-4d4c-b718-154b6e91dc98 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:49.903822 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-46ea6399-527e-4d4c-b718-154b6e91dc98 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 935bcaad-c46d-4d6c-8b00-7d349eefb5b2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:49.912340 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-46ea6399-527e-4d4c-b718-154b6e91dc98 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:49.913151 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-46ea6399-527e-4d4c-b718-154b6e91dc98 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:49.914303 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-dc2ef8f4-5963-4ea8-b99b-1d798a099276 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:49.914609 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-46ea6399-527e-4d4c-b718-154b6e91dc98 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:49.916219 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-46ea6399-527e-4d4c-b718-154b6e91dc98 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:49.916652 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-dc2ef8f4-5963-4ea8-b99b-1d798a099276 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:49.919484 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dc2ef8f4-5963-4ea8-b99b-1d798a099276 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1488 microversion: 2.25 time: 0.264021 Jun 10 18:05:49.920619 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1294/2673] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:05:49 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1488 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:05:50.057364 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8ba2db1d-34c6-4a42-91a4-96e6eafa92be tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:50.058306 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8ba2db1d-34c6-4a42-91a4-96e6eafa92be tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] [instance: 68801152-6e36-4e3e-95b6-e9e6eac3b8c3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:50.068004 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8ba2db1d-34c6-4a42-91a4-96e6eafa92be tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:50.069530 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8ba2db1d-34c6-4a42-91a4-96e6eafa92be tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:50.070914 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8ba2db1d-34c6-4a42-91a4-96e6eafa92be tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:50.071593 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8ba2db1d-34c6-4a42-91a4-96e6eafa92be tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:50.205898 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8ba2db1d-34c6-4a42-91a4-96e6eafa92be tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8bb9feeac64f588262980fe5052c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834322ffb5f54cff911c2fc52a35e3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:50.216036 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8ba2db1d-34c6-4a42-91a4-96e6eafa92be tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] 10.222.0.35 "GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3" status: 200 len: 1275 microversion: 2.1 time: 0.166988 Jun 10 18:05:50.217333 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1295/2674] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:50 2022] GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3 => generated 1275 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:50.410906 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c144098a-af71-4fb5-a389-a812dfa78172 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:50.411747 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c144098a-af71-4fb5-a389-a812dfa78172 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 5a7cc611-89ea-4c58-af65-315000f47739] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:50.427041 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c144098a-af71-4fb5-a389-a812dfa78172 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:50.434337 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c144098a-af71-4fb5-a389-a812dfa78172 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:50.435837 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c144098a-af71-4fb5-a389-a812dfa78172 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:50.436561 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c144098a-af71-4fb5-a389-a812dfa78172 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:50.505560 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-46ea6399-527e-4d4c-b718-154b6e91dc98 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:50.514209 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-46ea6399-527e-4d4c-b718-154b6e91dc98 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/935bcaad-c46d-4d6c-8b00-7d349eefb5b2" status: 200 len: 1471 microversion: 2.1 time: 0.615377 Jun 10 18:05:50.515151 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1380/2675] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:49 2022] GET /compute/v2.1/servers/935bcaad-c46d-4d6c-8b00-7d349eefb5b2 => generated 1471 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:05:50.538764 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2cee8d19-0510-4e0d-8a6a-b57661ba639d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-143303434"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:50.540365 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2cee8d19-0510-4e0d-8a6a-b57661ba639d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 935bcaad-c46d-4d6c-8b00-7d349eefb5b2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:50.553801 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2cee8d19-0510-4e0d-8a6a-b57661ba639d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:50.554811 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2cee8d19-0510-4e0d-8a6a-b57661ba639d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:50.555634 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2cee8d19-0510-4e0d-8a6a-b57661ba639d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:50.556087 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2cee8d19-0510-4e0d-8a6a-b57661ba639d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:50.760624 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c144098a-af71-4fb5-a389-a812dfa78172 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:50.770356 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c144098a-af71-4fb5-a389-a812dfa78172 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/5a7cc611-89ea-4c58-af65-315000f47739" status: 200 len: 1317 microversion: 2.1 time: 0.363295 Jun 10 18:05:50.780849 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1296/2676] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:50 2022] GET /compute/v2.1/servers/5a7cc611-89ea-4c58-af65-315000f47739 => generated 1317 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:05:50.944716 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7986695b-6fe7-40d2-8922-9e33039c0f3e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:50.946045 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7986695b-6fe7-40d2-8922-9e33039c0f3e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:50.956483 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7986695b-6fe7-40d2-8922-9e33039c0f3e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:50.956996 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7986695b-6fe7-40d2-8922-9e33039c0f3e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:50.960967 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7986695b-6fe7-40d2-8922-9e33039c0f3e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:50.960967 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7986695b-6fe7-40d2-8922-9e33039c0f3e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:51.145862 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7986695b-6fe7-40d2-8922-9e33039c0f3e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:51.160191 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7986695b-6fe7-40d2-8922-9e33039c0f3e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:51.163283 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7986695b-6fe7-40d2-8922-9e33039c0f3e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:51.168226 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7986695b-6fe7-40d2-8922-9e33039c0f3e tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1478 microversion: 2.25 time: 0.229960 Jun 10 18:05:51.168226 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1297/2677] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:05:50 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1478 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:05:51.188350 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-15823658-f1a0-4eee-868a-6a9ee0ba314b tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Calling method '.version_select at 0x7f77c03c4c10>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:51.192860 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-15823658-f1a0-4eee-868a-6a9ee0ba314b tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:51.199088 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-15823658-f1a0-4eee-868a-6a9ee0ba314b tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:51.199270 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2cee8d19-0510-4e0d-8a6a-b57661ba639d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "POST /compute/v2.1/servers/935bcaad-c46d-4d6c-8b00-7d349eefb5b2/action" status: 202 len: 0 microversion: 2.1 time: 0.664229 Jun 10 18:05:51.200646 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1381/2678] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:05:50 2022] POST /compute/v2.1/servers/935bcaad-c46d-4d6c-8b00-7d349eefb5b2/action => generated 0 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jun 10 18:05:51.207007 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-15823658-f1a0-4eee-868a-6a9ee0ba314b tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] 10.222.0.35 "GET /compute/v2.1/os-migrations" status: 200 len: 1943 microversion: 2.25 time: 0.029073 Jun 10 18:05:51.208277 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1298/2679] 10.222.0.35 () {60 vars in 1183 bytes} [Fri Jun 10 18:05:51 2022] GET /compute/v2.1/os-migrations => generated 1943 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:05:51.212460 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d94b3635-5d13-48a8-b9c2-6ccb635293d2 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c00ad4c0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:51.220564 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e47c409f-1fb2-40ea-9fbb-8634f58c5bfd tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:51.221484 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e47c409f-1fb2-40ea-9fbb-8634f58c5bfd tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:51.229701 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e47c409f-1fb2-40ea-9fbb-8634f58c5bfd tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:51.230412 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e47c409f-1fb2-40ea-9fbb-8634f58c5bfd tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:51.233524 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e47c409f-1fb2-40ea-9fbb-8634f58c5bfd tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:51.233524 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e47c409f-1fb2-40ea-9fbb-8634f58c5bfd tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:51.289616 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d94b3635-5d13-48a8-b9c2-6ccb635293d2 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df" status: 200 len: 1409 microversion: 2.1 time: 0.081530 Jun 10 18:05:51.295213 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1382/2680] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:05:51 2022] GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df => generated 1409 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:05:51.319793 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d71f559b-b81b-46ae-ba1c-803cb7f1d3c4 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:51.321349 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d71f559b-b81b-46ae-ba1c-803cb7f1d3c4 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] [instance: 68801152-6e36-4e3e-95b6-e9e6eac3b8c3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:51.331327 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d71f559b-b81b-46ae-ba1c-803cb7f1d3c4 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:51.331789 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d71f559b-b81b-46ae-ba1c-803cb7f1d3c4 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:51.332734 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d71f559b-b81b-46ae-ba1c-803cb7f1d3c4 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:51.333191 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d71f559b-b81b-46ae-ba1c-803cb7f1d3c4 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:51.494738 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d71f559b-b81b-46ae-ba1c-803cb7f1d3c4 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8bb9feeac64f588262980fe5052c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834322ffb5f54cff911c2fc52a35e3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:51.510055 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-e47c409f-1fb2-40ea-9fbb-8634f58c5bfd tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] Lazy-loading 'services' on Instance uuid f1a36d13-beb9-478b-b00f-94efeae1248b {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:05:51.513165 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d71f559b-b81b-46ae-ba1c-803cb7f1d3c4 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] 10.222.0.35 "GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3" status: 200 len: 1273 microversion: 2.1 time: 0.221476 Jun 10 18:05:51.525704 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1383/2681] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:51 2022] GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3 => generated 1273 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:51.531189 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-9240bd6a-0f03-44d4-8b23-53ac06eb155b req-520d42c1-d005-4dbd-89f8-fb21a27225bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a7cc611-89ea-4c58-af65-315000f47739", "name": "network-vif-plugged", "status": "completed", "tag": "ac79ea71-a2b0-4849-806b-8ca1657704b3"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:51.532363 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e47c409f-1fb2-40ea-9fbb-8634f58c5bfd tempest-LiveAutoBlockMigrationV225Test-412516204 tempest-LiveAutoBlockMigrationV225Test-412516204-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1971 microversion: 2.25 time: 0.315396 Jun 10 18:05:51.533976 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1299/2682] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:05:51 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1971 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:05:51.554697 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-9240bd6a-0f03-44d4-8b23-53ac06eb155b req-520d42c1-d005-4dbd-89f8-fb21a27225bd service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:51.557291 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-9240bd6a-0f03-44d4-8b23-53ac06eb155b req-520d42c1-d005-4dbd-89f8-fb21a27225bd service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:51.575894 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-9240bd6a-0f03-44d4-8b23-53ac06eb155b req-520d42c1-d005-4dbd-89f8-fb21a27225bd service nova] Creating event network-vif-plugged:ac79ea71-a2b0-4849-806b-8ca1657704b3 for instance 5a7cc611-89ea-4c58-af65-315000f47739 on chh1-master-2 Jun 10 18:05:51.579483 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-10141223-d2e8-46a5-968b-4eacb419a9fe tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:51.580063 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-10141223-d2e8-46a5-968b-4eacb419a9fe tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:51.581293 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-9240bd6a-0f03-44d4-8b23-53ac06eb155b req-520d42c1-d005-4dbd-89f8-fb21a27225bd service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053824 Jun 10 18:05:51.582498 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1384/2683] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:51.593184 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10141223-d2e8-46a5-968b-4eacb419a9fe tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:51.593840 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10141223-d2e8-46a5-968b-4eacb419a9fe tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:51.594877 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10141223-d2e8-46a5-968b-4eacb419a9fe tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:51.595571 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10141223-d2e8-46a5-968b-4eacb419a9fe tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:51.632402 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-10141223-d2e8-46a5-968b-4eacb419a9fe tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:05:51.652126 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:05:51.802067 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4b80cb15-7e73-464d-88e6-675cc73ff07f tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:51.802806 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4b80cb15-7e73-464d-88e6-675cc73ff07f tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 5a7cc611-89ea-4c58-af65-315000f47739] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:51.836673 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4b80cb15-7e73-464d-88e6-675cc73ff07f tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:51.840477 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4b80cb15-7e73-464d-88e6-675cc73ff07f tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:51.841463 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4b80cb15-7e73-464d-88e6-675cc73ff07f tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:51.842026 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4b80cb15-7e73-464d-88e6-675cc73ff07f tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:52.067997 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-10141223-d2e8-46a5-968b-4eacb419a9fe tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "DELETE /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 204 len: 0 microversion: 2.25 time: 0.503497 Jun 10 18:05:52.072645 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1300/2684] 10.222.0.35 () {60 vars in 1279 bytes} [Fri Jun 10 18:05:51 2022] DELETE /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 10 18:05:52.078931 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6584c625-9069-4cbb-b5cb-a17f453d6204 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:52.079655 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6584c625-9069-4cbb-b5cb-a17f453d6204 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:52.094136 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6584c625-9069-4cbb-b5cb-a17f453d6204 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:52.098836 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6584c625-9069-4cbb-b5cb-a17f453d6204 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:52.099945 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6584c625-9069-4cbb-b5cb-a17f453d6204 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:52.100606 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6584c625-9069-4cbb-b5cb-a17f453d6204 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:52.160482 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4b80cb15-7e73-464d-88e6-675cc73ff07f tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:52.164857 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:05:52.170734 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4b80cb15-7e73-464d-88e6-675cc73ff07f tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/5a7cc611-89ea-4c58-af65-315000f47739" status: 200 len: 1317 microversion: 2.1 time: 0.385946 Jun 10 18:05:52.171775 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1385/2685] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:51 2022] GET /compute/v2.1/servers/5a7cc611-89ea-4c58-af65-315000f47739 => generated 1317 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:52.326791 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6584c625-9069-4cbb-b5cb-a17f453d6204 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:52.344600 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6584c625-9069-4cbb-b5cb-a17f453d6204 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:52.346819 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6584c625-9069-4cbb-b5cb-a17f453d6204 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:52.348557 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6584c625-9069-4cbb-b5cb-a17f453d6204 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1484 microversion: 2.25 time: 0.274189 Jun 10 18:05:52.361726 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1301/2686] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:05:52 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1484 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:05:52.379464 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5c04e975-7a48-43ba-bc6d-f3f6914adeec tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c03dfc10>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:52.432082 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6dea39c4-f668-4527-8bfe-e6a129a1a09d tempest-QuotasAdminTestV257-786999868 tempest-QuotasAdminTestV257-786999868-project-admin] Action: 'update', calling method: .version_select at 0x7f77c0cb23a0>, body: {"quota_set": {"ram": "5120"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:52.456778 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5c04e975-7a48-43ba-bc6d-f3f6914adeec tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df" status: 200 len: 1409 microversion: 2.1 time: 0.093558 Jun 10 18:05:52.457461 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1302/2687] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:05:52 2022] GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df => generated 1409 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:52.516235 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6dea39c4-f668-4527-8bfe-e6a129a1a09d tempest-QuotasAdminTestV257-786999868 tempest-QuotasAdminTestV257-786999868-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:52.517333 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6dea39c4-f668-4527-8bfe-e6a129a1a09d tempest-QuotasAdminTestV257-786999868 tempest-QuotasAdminTestV257-786999868-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:52.518488 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6dea39c4-f668-4527-8bfe-e6a129a1a09d tempest-QuotasAdminTestV257-786999868 tempest-QuotasAdminTestV257-786999868-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:52.519162 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6dea39c4-f668-4527-8bfe-e6a129a1a09d tempest-QuotasAdminTestV257-786999868 tempest-QuotasAdminTestV257-786999868-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:52.533213 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9d5b7d3d-86b2-4e32-aaad-0a6bcdac8e19 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:52.534305 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9d5b7d3d-86b2-4e32-aaad-0a6bcdac8e19 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] [instance: 68801152-6e36-4e3e-95b6-e9e6eac3b8c3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:52.545216 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9d5b7d3d-86b2-4e32-aaad-0a6bcdac8e19 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:52.545969 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9d5b7d3d-86b2-4e32-aaad-0a6bcdac8e19 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:52.549207 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9d5b7d3d-86b2-4e32-aaad-0a6bcdac8e19 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:52.550598 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9d5b7d3d-86b2-4e32-aaad-0a6bcdac8e19 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:52.748886 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6dea39c4-f668-4527-8bfe-e6a129a1a09d tempest-QuotasAdminTestV257-786999868 tempest-QuotasAdminTestV257-786999868-project-admin] 10.222.0.35 "PUT /compute/v2.1/os-quota-sets/6bcb446f557d471fbe69a3c580915f8f" status: 200 len: 148 microversion: 2.57 time: 0.575043 Jun 10 18:05:52.750159 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1386/2688] 10.222.0.35 () {62 vars in 1302 bytes} [Fri Jun 10 18:05:52 2022] PUT /compute/v2.1/os-quota-sets/6bcb446f557d471fbe69a3c580915f8f => generated 148 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:05:52.761912 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d1aa10fa-1604-4dec-817b-0f82accaa45b tempest-QuotasAdminTestV257-786999868 tempest-QuotasAdminTestV257-786999868-project-admin] Calling method '.version_select at 0x7f77c0d55ee0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:52.820046 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9d5b7d3d-86b2-4e32-aaad-0a6bcdac8e19 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8bb9feeac64f588262980fe5052c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834322ffb5f54cff911c2fc52a35e3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:52.830737 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9d5b7d3d-86b2-4e32-aaad-0a6bcdac8e19 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] 10.222.0.35 "GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3" status: 200 len: 1315 microversion: 2.1 time: 0.302655 Jun 10 18:05:52.831931 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1303/2689] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:52 2022] GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3 => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:52.859927 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d1aa10fa-1604-4dec-817b-0f82accaa45b tempest-QuotasAdminTestV257-786999868 tempest-QuotasAdminTestV257-786999868-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:52.860427 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d1aa10fa-1604-4dec-817b-0f82accaa45b tempest-QuotasAdminTestV257-786999868 tempest-QuotasAdminTestV257-786999868-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:52.861242 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d1aa10fa-1604-4dec-817b-0f82accaa45b tempest-QuotasAdminTestV257-786999868 tempest-QuotasAdminTestV257-786999868-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:52.861685 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d1aa10fa-1604-4dec-817b-0f82accaa45b tempest-QuotasAdminTestV257-786999868 tempest-QuotasAdminTestV257-786999868-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:52.886691 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d1aa10fa-1604-4dec-817b-0f82accaa45b tempest-QuotasAdminTestV257-786999868 tempest-QuotasAdminTestV257-786999868-project-admin] 10.222.0.35 "GET /compute/v2.1/os-quota-sets/6bcb446f557d471fbe69a3c580915f8f/detail" status: 200 len: 463 microversion: 2.57 time: 0.130440 Jun 10 18:05:52.887828 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1387/2690] 10.222.0.35 () {60 vars in 1303 bytes} [Fri Jun 10 18:05:52 2022] GET /compute/v2.1/os-quota-sets/6bcb446f557d471fbe69a3c580915f8f/detail => generated 463 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:05:53.120802 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-daf4a290-3ce0-49cc-a006-03817bf95bc7 tempest-QuotasAdminTestV257-786999868 tempest-QuotasAdminTestV257-786999868-project-admin] Action: 'update', calling method: .version_select at 0x7f77c0364940>, body: {"quota_set": {"ram": "2048"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:53.198678 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cf7c6db5-c1fb-4d82-99b9-a2721691ae31 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:53.199743 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cf7c6db5-c1fb-4d82-99b9-a2721691ae31 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 5a7cc611-89ea-4c58-af65-315000f47739] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:53.211370 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-daf4a290-3ce0-49cc-a006-03817bf95bc7 tempest-QuotasAdminTestV257-786999868 tempest-QuotasAdminTestV257-786999868-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:53.212071 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-daf4a290-3ce0-49cc-a006-03817bf95bc7 tempest-QuotasAdminTestV257-786999868 tempest-QuotasAdminTestV257-786999868-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:53.216665 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-daf4a290-3ce0-49cc-a006-03817bf95bc7 tempest-QuotasAdminTestV257-786999868 tempest-QuotasAdminTestV257-786999868-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:53.227200 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-daf4a290-3ce0-49cc-a006-03817bf95bc7 tempest-QuotasAdminTestV257-786999868 tempest-QuotasAdminTestV257-786999868-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:53.227639 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf7c6db5-c1fb-4d82-99b9-a2721691ae31 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:53.227639 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf7c6db5-c1fb-4d82-99b9-a2721691ae31 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:53.227639 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf7c6db5-c1fb-4d82-99b9-a2721691ae31 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:53.240988 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf7c6db5-c1fb-4d82-99b9-a2721691ae31 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:53.291337 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-daf4a290-3ce0-49cc-a006-03817bf95bc7 tempest-QuotasAdminTestV257-786999868 tempest-QuotasAdminTestV257-786999868-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:53.292103 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-daf4a290-3ce0-49cc-a006-03817bf95bc7 tempest-QuotasAdminTestV257-786999868 tempest-QuotasAdminTestV257-786999868-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:53.293401 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-daf4a290-3ce0-49cc-a006-03817bf95bc7 tempest-QuotasAdminTestV257-786999868 tempest-QuotasAdminTestV257-786999868-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:53.294076 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-daf4a290-3ce0-49cc-a006-03817bf95bc7 tempest-QuotasAdminTestV257-786999868 tempest-QuotasAdminTestV257-786999868-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:53.325081 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:05:53.456599 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-daf4a290-3ce0-49cc-a006-03817bf95bc7 tempest-QuotasAdminTestV257-786999868 tempest-QuotasAdminTestV257-786999868-project-admin] 10.222.0.35 "PUT /compute/v2.1/os-quota-sets/6bcb446f557d471fbe69a3c580915f8f?user_id=e53764027a90447cae7683c55302c248" status: 200 len: 148 microversion: 2.57 time: 0.339982 Jun 10 18:05:53.465319 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1304/2691] 10.222.0.35 () {62 vars in 1383 bytes} [Fri Jun 10 18:05:53 2022] PUT /compute/v2.1/os-quota-sets/6bcb446f557d471fbe69a3c580915f8f?user_id=e53764027a90447cae7683c55302c248 => generated 148 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:05:53.473250 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-77fd0eaf-4214-45f5-a675-337d34ecafb1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:53.474248 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-77fd0eaf-4214-45f5-a675-337d34ecafb1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:53.484377 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-77fd0eaf-4214-45f5-a675-337d34ecafb1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:53.486112 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-77fd0eaf-4214-45f5-a675-337d34ecafb1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:53.487199 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-77fd0eaf-4214-45f5-a675-337d34ecafb1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:53.488547 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-77fd0eaf-4214-45f5-a675-337d34ecafb1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:53.667881 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cf7c6db5-c1fb-4d82-99b9-a2721691ae31 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:53.687157 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cf7c6db5-c1fb-4d82-99b9-a2721691ae31 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/5a7cc611-89ea-4c58-af65-315000f47739" status: 200 len: 1317 microversion: 2.1 time: 0.502144 Jun 10 18:05:53.688573 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1388/2692] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:53 2022] GET /compute/v2.1/servers/5a7cc611-89ea-4c58-af65-315000f47739 => generated 1317 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:05:53.700032 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-49c80d79-44f2-49d0-9f24-3fe73a60d9c7 tempest-QuotasAdminTestV257-786999868 tempest-QuotasAdminTestV257-786999868-project-admin] Calling method '.version_select at 0x7f77c00a6ca0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:53.847118 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-49c80d79-44f2-49d0-9f24-3fe73a60d9c7 tempest-QuotasAdminTestV257-786999868 tempest-QuotasAdminTestV257-786999868-project-admin] 10.222.0.35 "GET /compute/v2.1/os-quota-sets/6bcb446f557d471fbe69a3c580915f8f?user_id=e53764027a90447cae7683c55302c248" status: 200 len: 190 microversion: 2.57 time: 0.152762 Jun 10 18:05:53.854594 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1389/2693] 10.222.0.35 () {60 vars in 1363 bytes} [Fri Jun 10 18:05:53 2022] GET /compute/v2.1/os-quota-sets/6bcb446f557d471fbe69a3c580915f8f?user_id=e53764027a90447cae7683c55302c248 => generated 190 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:05:53.876078 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-284b68a3-9a02-4fbb-89f7-8ea29b3e0331 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77b3f334c0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:53.976766 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-284b68a3-9a02-4fbb-89f7-8ea29b3e0331 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df" status: 200 len: 1409 microversion: 2.1 time: 0.124078 Jun 10 18:05:53.985218 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1390/2694] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:05:53 2022] GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df => generated 1409 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:53.988955 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a8219659-441e-49fe-934c-0a663011de1f tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:53.989594 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a8219659-441e-49fe-934c-0a663011de1f tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] [instance: 68801152-6e36-4e3e-95b6-e9e6eac3b8c3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:53.998306 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a8219659-441e-49fe-934c-0a663011de1f tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:53.998819 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a8219659-441e-49fe-934c-0a663011de1f tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:53.999734 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a8219659-441e-49fe-934c-0a663011de1f tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:54.000190 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a8219659-441e-49fe-934c-0a663011de1f tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:54.327831 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a8219659-441e-49fe-934c-0a663011de1f tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8bb9feeac64f588262980fe5052c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834322ffb5f54cff911c2fc52a35e3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:54.331214 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-77fd0eaf-4214-45f5-a675-337d34ecafb1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:54.344052 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-77fd0eaf-4214-45f5-a675-337d34ecafb1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:54.344855 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a8219659-441e-49fe-934c-0a663011de1f tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] 10.222.0.35 "GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3" status: 200 len: 1315 microversion: 2.1 time: 0.363083 Jun 10 18:05:54.345526 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-77fd0eaf-4214-45f5-a675-337d34ecafb1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:54.345817 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1391/2695] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:53 2022] GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3 => generated 1315 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:54.346717 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-77fd0eaf-4214-45f5-a675-337d34ecafb1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1484 microversion: 2.25 time: 0.879216 Jun 10 18:05:54.356836 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1305/2696] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:05:53 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1484 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:05:54.713319 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-009edc7e-81c6-4369-a9a0-0c9e59d2c6b1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:54.714115 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-009edc7e-81c6-4369-a9a0-0c9e59d2c6b1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 5a7cc611-89ea-4c58-af65-315000f47739] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:54.756427 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-009edc7e-81c6-4369-a9a0-0c9e59d2c6b1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:54.759087 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-009edc7e-81c6-4369-a9a0-0c9e59d2c6b1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:54.761497 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-009edc7e-81c6-4369-a9a0-0c9e59d2c6b1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:54.762564 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-009edc7e-81c6-4369-a9a0-0c9e59d2c6b1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:54.765261 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-b241624c-efeb-4a5d-801d-c1bbf355bbd9 req-dd352408-14b6-47a3-bbcb-caf6922f286a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68801152-6e36-4e3e-95b6-e9e6eac3b8c3", "tag": "cd9c4aa8-ceaf-4554-b626-6c22db4fcfb1"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:54.787756 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-b241624c-efeb-4a5d-801d-c1bbf355bbd9 req-dd352408-14b6-47a3-bbcb-caf6922f286a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:54.789373 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-b241624c-efeb-4a5d-801d-c1bbf355bbd9 req-dd352408-14b6-47a3-bbcb-caf6922f286a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:54.820423 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-b241624c-efeb-4a5d-801d-c1bbf355bbd9 req-dd352408-14b6-47a3-bbcb-caf6922f286a service nova] Creating event network-changed:cd9c4aa8-ceaf-4554-b626-6c22db4fcfb1 for instance 68801152-6e36-4e3e-95b6-e9e6eac3b8c3 on chh1-master-2 Jun 10 18:05:54.826925 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-b241624c-efeb-4a5d-801d-c1bbf355bbd9 req-dd352408-14b6-47a3-bbcb-caf6922f286a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065155 Jun 10 18:05:54.828685 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1306/2697] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:05:54.998146 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-57e335bb-e7da-44ea-b9e6-8acf32a91ab9 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c03773a0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:55.099985 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-57e335bb-e7da-44ea-b9e6-8acf32a91ab9 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df" status: 200 len: 1409 microversion: 2.1 time: 0.104899 Jun 10 18:05:55.100692 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1307/2698] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:05:54 2022] GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df => generated 1409 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:55.258487 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-009edc7e-81c6-4369-a9a0-0c9e59d2c6b1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:55.273220 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-009edc7e-81c6-4369-a9a0-0c9e59d2c6b1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/5a7cc611-89ea-4c58-af65-315000f47739" status: 200 len: 1466 microversion: 2.1 time: 0.572114 Jun 10 18:05:55.276051 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1392/2699] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:54 2022] GET /compute/v2.1/servers/5a7cc611-89ea-4c58-af65-315000f47739 => generated 1466 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:55.362251 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f554ae2a-e7a8-43db-91aa-5ff4f64f5c20 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:55.363771 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f554ae2a-e7a8-43db-91aa-5ff4f64f5c20 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] [instance: 68801152-6e36-4e3e-95b6-e9e6eac3b8c3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:55.382341 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f554ae2a-e7a8-43db-91aa-5ff4f64f5c20 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:55.382807 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f554ae2a-e7a8-43db-91aa-5ff4f64f5c20 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:55.383610 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f554ae2a-e7a8-43db-91aa-5ff4f64f5c20 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:55.384056 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f554ae2a-e7a8-43db-91aa-5ff4f64f5c20 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:55.649166 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7ac302e8-4914-4300-86ac-5f05a388d19f tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:55.651251 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7ac302e8-4914-4300-86ac-5f05a388d19f tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] [instance: 5a7cc611-89ea-4c58-af65-315000f47739] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:55.678161 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7ac302e8-4914-4300-86ac-5f05a388d19f tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:55.680893 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7ac302e8-4914-4300-86ac-5f05a388d19f tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:55.682015 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7ac302e8-4914-4300-86ac-5f05a388d19f tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:55.683624 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7ac302e8-4914-4300-86ac-5f05a388d19f tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:56.115822 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f554ae2a-e7a8-43db-91aa-5ff4f64f5c20 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8bb9feeac64f588262980fe5052c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834322ffb5f54cff911c2fc52a35e3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:56.127959 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f554ae2a-e7a8-43db-91aa-5ff4f64f5c20 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] 10.222.0.35 "GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3" status: 200 len: 1315 microversion: 2.1 time: 0.770579 Jun 10 18:05:56.137228 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1393/2700] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:55 2022] GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3 => generated 1315 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:05:56.141061 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9af9fe3b-936e-4671-9623-f7eb7ad415e1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:56.141690 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9af9fe3b-936e-4671-9623-f7eb7ad415e1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:56.179669 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9af9fe3b-936e-4671-9623-f7eb7ad415e1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:56.186211 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9af9fe3b-936e-4671-9623-f7eb7ad415e1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:56.187201 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9af9fe3b-936e-4671-9623-f7eb7ad415e1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:56.187663 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9af9fe3b-936e-4671-9623-f7eb7ad415e1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:56.745105 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7ac302e8-4914-4300-86ac-5f05a388d19f tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/5a7cc611-89ea-4c58-af65-315000f47739" status: 200 len: 1617 microversion: 2.1 time: 1.454130 Jun 10 18:05:56.767603 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1308/2701] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:55 2022] GET /compute/v2.1/servers/5a7cc611-89ea-4c58-af65-315000f47739 => generated 1617 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:56.773386 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-1d430a8b-c5b8-42b6-aeca-dfdac00596a2 req-c5cb9c08-8002-416d-b9ac-288f5cf88c71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1a36d13-beb9-478b-b00f-94efeae1248b", "name": "network-vif-deleted", "tag": "dd89a0eb-962f-4a1d-9233-8469a377029e"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:56.796100 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-1d430a8b-c5b8-42b6-aeca-dfdac00596a2 req-c5cb9c08-8002-416d-b9ac-288f5cf88c71 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:56.797052 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-1d430a8b-c5b8-42b6-aeca-dfdac00596a2 req-c5cb9c08-8002-416d-b9ac-288f5cf88c71 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:56.824750 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-1d430a8b-c5b8-42b6-aeca-dfdac00596a2 req-c5cb9c08-8002-416d-b9ac-288f5cf88c71 service nova] Creating event network-vif-deleted:dd89a0eb-962f-4a1d-9233-8469a377029e for instance f1a36d13-beb9-478b-b00f-94efeae1248b on chh1-master-2 Jun 10 18:05:56.838239 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-1d430a8b-c5b8-42b6-aeca-dfdac00596a2 req-c5cb9c08-8002-416d-b9ac-288f5cf88c71 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068506 Jun 10 18:05:56.839573 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1309/2702] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:56.856920 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f494ff40-4d8e-4290-8034-9a1cb2560864 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c03963a0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:56.956441 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f494ff40-4d8e-4290-8034-9a1cb2560864 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df" status: 200 len: 1409 microversion: 2.1 time: 0.115155 Jun 10 18:05:56.960009 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1310/2703] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:05:56 2022] GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df => generated 1409 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:56.980646 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3b3dbefc-2de3-4ab9-8ce8-0ad4ed9911ea tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Action: 'create', calling method: .version_select at 0x7f77c03df5e0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-427925545", "policies": ["affinity"]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:57.041365 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-3b3dbefc-2de3-4ab9-8ce8-0ad4ed9911ea tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Getting quotas for project bb2c4b1067ac4cab8b8565bc987f00b1. Resources: {'server_groups'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:05:57.048515 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9af9fe3b-936e-4671-9623-f7eb7ad415e1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:57.054148 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-3b3dbefc-2de3-4ab9-8ce8-0ad4ed9911ea tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Getting quotas for user 9c189471a3ab4ec2b644b3ee1352d4e6 and project bb2c4b1067ac4cab8b8565bc987f00b1. Resources: {'server_groups'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:05:57.068137 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9af9fe3b-936e-4671-9623-f7eb7ad415e1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:57.070484 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9af9fe3b-936e-4671-9623-f7eb7ad415e1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:57.073717 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9af9fe3b-936e-4671-9623-f7eb7ad415e1 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1266 microversion: 2.25 time: 0.936577 Jun 10 18:05:57.081012 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1394/2704] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:05:56 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1266 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:05:57.151887 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ccb1e0c2-7ae0-4b5b-8135-832d6c486335 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:57.154364 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ccb1e0c2-7ae0-4b5b-8135-832d6c486335 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] [instance: 68801152-6e36-4e3e-95b6-e9e6eac3b8c3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:57.168888 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ccb1e0c2-7ae0-4b5b-8135-832d6c486335 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:57.172669 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ccb1e0c2-7ae0-4b5b-8135-832d6c486335 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:57.173863 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ccb1e0c2-7ae0-4b5b-8135-832d6c486335 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:57.175322 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ccb1e0c2-7ae0-4b5b-8135-832d6c486335 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:57.248363 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:05:57.280688 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-3b3dbefc-2de3-4ab9-8ce8-0ad4ed9911ea tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Getting quotas for project bb2c4b1067ac4cab8b8565bc987f00b1. Resources: {'server_groups'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:05:57.297413 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-3b3dbefc-2de3-4ab9-8ce8-0ad4ed9911ea tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Getting quotas for user 9c189471a3ab4ec2b644b3ee1352d4e6 and project bb2c4b1067ac4cab8b8565bc987f00b1. Resources: {'server_groups'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:05:57.328916 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3b3dbefc-2de3-4ab9-8ce8-0ad4ed9911ea tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.366298 Jun 10 18:05:57.350818 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1311/2705] 10.222.0.35 () {60 vars in 1173 bytes} [Fri Jun 10 18:05:56 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:57.520870 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-44892fa2-6046-4316-8464-c010b1ad1b11 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-320251558", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "9cae038e-8739-45c4-927d-bdae8e405060"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:57.625499 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-44892fa2-6046-4316-8464-c010b1ad1b11 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] validate_networks() for None {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:05:57.643757 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ccb1e0c2-7ae0-4b5b-8135-832d6c486335 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8bb9feeac64f588262980fe5052c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834322ffb5f54cff911c2fc52a35e3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:57.655554 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ccb1e0c2-7ae0-4b5b-8135-832d6c486335 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] 10.222.0.35 "GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3" status: 200 len: 1315 microversion: 2.1 time: 0.507189 Jun 10 18:05:57.657458 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1395/2706] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:57 2022] GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3 => generated 1315 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:58.157005 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-08a0e28e-6ffd-4c95-966b-62cb80e3034a tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Action: 'create', calling method: .version_select at 0x7f77c0bd4700>, body: {"keypair": {"name": "tempest-keypair-1944142214", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPDJun2CJZi3oCREDraxEPUl+yXHOUHJVHoX7x2bAY3uSO3YvuWw0NRtCbG4jjBFuKSBq5hM6f5NgmwxOgkaxT16gMlkE5pPUdUDnePPkLQE4UO1oPfLxUpyX0QkvOCN2g=="}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:05:58.173701 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:05:58.200238 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-08a0e28e-6ffd-4c95-966b-62cb80e3034a tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Getting quotas for project 142022afade745b9984068f42f0074dc. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:05:58.209793 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-08a0e28e-6ffd-4c95-966b-62cb80e3034a tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Getting quotas for user e633cf9c8e3b41f5a538f5937acf00d7 and project 142022afade745b9984068f42f0074dc. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:05:58.345222 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-08a0e28e-6ffd-4c95-966b-62cb80e3034a tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.660677 Jun 10 18:05:58.346656 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-44892fa2-6046-4316-8464-c010b1ad1b11 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:05:58.346656 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-44892fa2-6046-4316-8464-c010b1ad1b11 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:05:58.349376 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1396/2707] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 18:05:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:05:58.351370 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-44892fa2-6046-4316-8464-c010b1ad1b11 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:05:58.352414 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-44892fa2-6046-4316-8464-c010b1ad1b11 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:05:58.353128 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-44892fa2-6046-4316-8464-c010b1ad1b11 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:05:58.375408 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-945bc672-d32b-41e0-b3d7-f96c4079644e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77b3f9eaf0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:58.486995 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-945bc672-d32b-41e0-b3d7-f96c4079644e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df" status: 200 len: 1409 microversion: 2.1 time: 0.134893 Jun 10 18:05:58.489049 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1397/2708] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:05:58 2022] GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df => generated 1409 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:58.498823 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44892fa2-6046-4316-8464-c010b1ad1b11 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:58.503337 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44892fa2-6046-4316-8464-c010b1ad1b11 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:58.506237 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a6b8dd9c-653c-4d75-a7a4-b76860ce9a1b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:58.507420 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a6b8dd9c-653c-4d75-a7a4-b76860ce9a1b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:58.511958 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44892fa2-6046-4316-8464-c010b1ad1b11 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:58.511958 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44892fa2-6046-4316-8464-c010b1ad1b11 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:58.522939 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a6b8dd9c-653c-4d75-a7a4-b76860ce9a1b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:58.525681 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a6b8dd9c-653c-4d75-a7a4-b76860ce9a1b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:58.528392 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a6b8dd9c-653c-4d75-a7a4-b76860ce9a1b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:58.529135 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a6b8dd9c-653c-4d75-a7a4-b76860ce9a1b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:58.536559 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=14 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:05:58.567603 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-44892fa2-6046-4316-8464-c010b1ad1b11 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Getting quotas for project bb2c4b1067ac4cab8b8565bc987f00b1. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:05:58.580942 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-44892fa2-6046-4316-8464-c010b1ad1b11 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Getting quotas for user 9c189471a3ab4ec2b644b3ee1352d4e6 and project bb2c4b1067ac4cab8b8565bc987f00b1. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:05:58.631439 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-44892fa2-6046-4316-8464-c010b1ad1b11 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Going to run 2 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:05:58.635375 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-44892fa2-6046-4316-8464-c010b1ad1b11 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 05c9cadb-1823-4e2c-9c9f-c3be6892e074] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:05:58.763494 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-44892fa2-6046-4316-8464-c010b1ad1b11 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=126595) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jun 10 18:05:58.805842 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-44892fa2-6046-4316-8464-c010b1ad1b11 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Getting quotas for project bb2c4b1067ac4cab8b8565bc987f00b1. Resources: {'server_group_members'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:05:58.824590 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-44892fa2-6046-4316-8464-c010b1ad1b11 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Getting quotas for user 9c189471a3ab4ec2b644b3ee1352d4e6 and project bb2c4b1067ac4cab8b8565bc987f00b1. Resources: {'server_group_members'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:05:58.837560 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a6b8dd9c-653c-4d75-a7a4-b76860ce9a1b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:58.851075 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a6b8dd9c-653c-4d75-a7a4-b76860ce9a1b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:58.855643 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a6b8dd9c-653c-4d75-a7a4-b76860ce9a1b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:58.862130 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a6b8dd9c-653c-4d75-a7a4-b76860ce9a1b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1266 microversion: 2.25 time: 0.369930 Jun 10 18:05:58.863532 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1398/2709] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:05:58 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1266 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:05:58.885552 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2782ff6f-55b6-4210-a943-b3ae081f859e tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:58.887554 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2782ff6f-55b6-4210-a943-b3ae081f859e tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] [instance: 68801152-6e36-4e3e-95b6-e9e6eac3b8c3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:58.909252 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2782ff6f-55b6-4210-a943-b3ae081f859e tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:58.909722 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2782ff6f-55b6-4210-a943-b3ae081f859e tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:58.910531 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2782ff6f-55b6-4210-a943-b3ae081f859e tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:58.910981 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2782ff6f-55b6-4210-a943-b3ae081f859e tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:59.082876 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-44892fa2-6046-4316-8464-c010b1ad1b11 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Getting quotas for project bb2c4b1067ac4cab8b8565bc987f00b1. Resources: {'server_group_members'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:05:59.104106 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-44892fa2-6046-4316-8464-c010b1ad1b11 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Getting quotas for user 9c189471a3ab4ec2b644b3ee1352d4e6 and project bb2c4b1067ac4cab8b8565bc987f00b1. Resources: {'server_group_members'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:05:59.131240 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-44892fa2-6046-4316-8464-c010b1ad1b11 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 07afccc2-6b07-4dd4-b9f5-aaa7609f72d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=05c9cadb-1823-4e2c-9c9f-c3be6892e074,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:05:59.335180 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-44892fa2-6046-4316-8464-c010b1ad1b11 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Getting quotas for project bb2c4b1067ac4cab8b8565bc987f00b1. Resources: {'server_group_members'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:05:59.341740 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-44892fa2-6046-4316-8464-c010b1ad1b11 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Getting quotas for user 9c189471a3ab4ec2b644b3ee1352d4e6 and project bb2c4b1067ac4cab8b8565bc987f00b1. Resources: {'server_group_members'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:05:59.344165 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2782ff6f-55b6-4210-a943-b3ae081f859e tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8bb9feeac64f588262980fe5052c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834322ffb5f54cff911c2fc52a35e3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:59.353063 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2782ff6f-55b6-4210-a943-b3ae081f859e tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] 10.222.0.35 "GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3" status: 200 len: 1315 microversion: 2.1 time: 0.487509 Jun 10 18:05:59.360950 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1399/2710] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:58 2022] GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3 => generated 1315 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:59.501425 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-369d2b2b-efb6-426f-b091-1abff5639e3d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c0d0a3a0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:59.519522 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-44892fa2-6046-4316-8464-c010b1ad1b11 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Getting quotas for project bb2c4b1067ac4cab8b8565bc987f00b1. Resources: {'server_group_members'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:05:59.538754 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-44892fa2-6046-4316-8464-c010b1ad1b11 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Getting quotas for user 9c189471a3ab4ec2b644b3ee1352d4e6 and project bb2c4b1067ac4cab8b8565bc987f00b1. Resources: {'server_group_members'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:05:59.578742 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-369d2b2b-efb6-426f-b091-1abff5639e3d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df" status: 200 len: 1409 microversion: 2.1 time: 0.080919 Jun 10 18:05:59.580649 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1400/2711] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:05:59 2022] GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df => generated 1409 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:59.689769 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-44892fa2-6046-4316-8464-c010b1ad1b11 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.174744 Jun 10 18:05:59.693862 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1312/2712] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:05:57 2022] POST /compute/v2.1/servers => generated 32 bytes in 2177 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jun 10 18:05:59.699175 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c5ebf98f-3746-46d9-a43d-cf5b965ad073 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:59.710028 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c5ebf98f-3746-46d9-a43d-cf5b965ad073 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:05:59.710028 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c5ebf98f-3746-46d9-a43d-cf5b965ad073 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Searching by: {'deleted': False, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1'} {{(pid=126594) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 18:05:59.740670 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5ebf98f-3746-46d9-a43d-cf5b965ad073 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:59.740670 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5ebf98f-3746-46d9-a43d-cf5b965ad073 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:59.740670 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5ebf98f-3746-46d9-a43d-cf5b965ad073 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:59.740984 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5ebf98f-3746-46d9-a43d-cf5b965ad073 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:59.788735 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.multi_cell_list [None req-c5ebf98f-3746-46d9-a43d-cf5b965ad073 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=126594) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 10 18:05:59.850214 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c5ebf98f-3746-46d9-a43d-cf5b965ad073 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.152247 Jun 10 18:05:59.853959 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1401/2713] 10.222.0.35 () {58 vars in 1124 bytes} [Fri Jun 10 18:05:59 2022] GET /compute/v2.1/servers => generated 1002 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:05:59.859791 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d6b0c317-2d04-4f4e-99bc-f40274f08789 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:59.860870 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d6b0c317-2d04-4f4e-99bc-f40274f08789 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 07afccc2-6b07-4dd4-b9f5-aaa7609f72d1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:59.884667 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f4fb9bc1-7110-45c1-9fdb-5b74c7523904 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:05:59.887253 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f4fb9bc1-7110-45c1-9fdb-5b74c7523904 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:05:59.912584 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4fb9bc1-7110-45c1-9fdb-5b74c7523904 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:59.913414 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4fb9bc1-7110-45c1-9fdb-5b74c7523904 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:05:59.917046 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4fb9bc1-7110-45c1-9fdb-5b74c7523904 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:05:59.931179 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4fb9bc1-7110-45c1-9fdb-5b74c7523904 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:00.118359 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f4fb9bc1-7110-45c1-9fdb-5b74c7523904 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:00.128819 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f4fb9bc1-7110-45c1-9fdb-5b74c7523904 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:00.137371 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f4fb9bc1-7110-45c1-9fdb-5b74c7523904 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:00.150344 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f4fb9bc1-7110-45c1-9fdb-5b74c7523904 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1266 microversion: 2.25 time: 0.263248 Jun 10 18:06:00.150344 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1402/2714] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:05:59 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1266 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:06:00.370920 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5e3bad13-563c-4b2a-bbfb-bf4d0710deb2 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:00.372332 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5e3bad13-563c-4b2a-bbfb-bf4d0710deb2 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] [instance: 68801152-6e36-4e3e-95b6-e9e6eac3b8c3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:00.384354 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5e3bad13-563c-4b2a-bbfb-bf4d0710deb2 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:00.396816 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d6b0c317-2d04-4f4e-99bc-f40274f08789 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:00.397725 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5e3bad13-563c-4b2a-bbfb-bf4d0710deb2 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:00.397725 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5e3bad13-563c-4b2a-bbfb-bf4d0710deb2 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:00.397725 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5e3bad13-563c-4b2a-bbfb-bf4d0710deb2 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:00.402375 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d6b0c317-2d04-4f4e-99bc-f40274f08789 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/07afccc2-6b07-4dd4-b9f5-aaa7609f72d1" status: 200 len: 1218 microversion: 2.1 time: 0.546962 Jun 10 18:06:00.402978 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1313/2715] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:05:59 2022] GET /compute/v2.1/servers/07afccc2-6b07-4dd4-b9f5-aaa7609f72d1 => generated 1218 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:00.520086 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-3eb48698-0a3c-4830-8652-dd4bf10301a0 req-cf845721-652c-4233-bf15-6f63aec45db5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "935bcaad-c46d-4d6c-8b00-7d349eefb5b2", "name": "network-vif-plugged", "status": "completed", "tag": "5e62510d-78bb-4546-9a32-2b22d19ec94b"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:06:00.571628 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-3eb48698-0a3c-4830-8652-dd4bf10301a0 req-cf845721-652c-4233-bf15-6f63aec45db5 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:00.574121 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-3eb48698-0a3c-4830-8652-dd4bf10301a0 req-cf845721-652c-4233-bf15-6f63aec45db5 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:00.642480 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-3eb48698-0a3c-4830-8652-dd4bf10301a0 req-cf845721-652c-4233-bf15-6f63aec45db5 service nova] Creating event network-vif-plugged:5e62510d-78bb-4546-9a32-2b22d19ec94b for instance 935bcaad-c46d-4d6c-8b00-7d349eefb5b2 on chh2-master-2 Jun 10 18:06:00.668250 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-3eb48698-0a3c-4830-8652-dd4bf10301a0 req-cf845721-652c-4233-bf15-6f63aec45db5 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146615 Jun 10 18:06:00.679957 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1314/2716] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:06:00.704534 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-80cefa1a-e368-4ca2-a1a1-f8672b3cf30b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c03df820>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:00.837036 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-80cefa1a-e368-4ca2-a1a1-f8672b3cf30b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df" status: 200 len: 1409 microversion: 2.1 time: 0.154268 Jun 10 18:06:00.838092 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1315/2717] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:06:00 2022] GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df => generated 1409 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:01.132268 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5e3bad13-563c-4b2a-bbfb-bf4d0710deb2 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8bb9feeac64f588262980fe5052c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834322ffb5f54cff911c2fc52a35e3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:01.164167 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8376b90a-93a6-4be2-9855-2eb067745c67 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:01.165494 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8376b90a-93a6-4be2-9855-2eb067745c67 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:01.173260 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5e3bad13-563c-4b2a-bbfb-bf4d0710deb2 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] 10.222.0.35 "GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3" status: 200 len: 1315 microversion: 2.1 time: 0.790489 Jun 10 18:06:01.187635 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1403/2718] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:00 2022] GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3 => generated 1315 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:06:01.204942 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8376b90a-93a6-4be2-9855-2eb067745c67 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:01.212926 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8376b90a-93a6-4be2-9855-2eb067745c67 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:01.214149 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8376b90a-93a6-4be2-9855-2eb067745c67 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:01.214769 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8376b90a-93a6-4be2-9855-2eb067745c67 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:01.382878 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8376b90a-93a6-4be2-9855-2eb067745c67 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:01.404484 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8376b90a-93a6-4be2-9855-2eb067745c67 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:01.419228 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ecc6515c-6ad6-4a18-bfd1-c4d30cf68bfa tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:01.420386 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8376b90a-93a6-4be2-9855-2eb067745c67 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:01.421071 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ecc6515c-6ad6-4a18-bfd1-c4d30cf68bfa tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 07afccc2-6b07-4dd4-b9f5-aaa7609f72d1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:01.426376 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8376b90a-93a6-4be2-9855-2eb067745c67 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1266 microversion: 2.25 time: 0.268584 Jun 10 18:06:01.441280 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1316/2719] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:06:01 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1266 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:06:01.628396 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ecc6515c-6ad6-4a18-bfd1-c4d30cf68bfa tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:01.635477 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ecc6515c-6ad6-4a18-bfd1-c4d30cf68bfa tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/07afccc2-6b07-4dd4-b9f5-aaa7609f72d1" status: 200 len: 1218 microversion: 2.1 time: 0.220277 Jun 10 18:06:01.637823 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1404/2720] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:01 2022] GET /compute/v2.1/servers/07afccc2-6b07-4dd4-b9f5-aaa7609f72d1 => generated 1218 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:01.850808 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d2aa5d5f-8df3-4d81-bcfb-2f56aab878b8 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c036de50>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:01.925354 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d2aa5d5f-8df3-4d81-bcfb-2f56aab878b8 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df" status: 200 len: 1409 microversion: 2.1 time: 0.078484 Jun 10 18:06:01.925955 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1317/2721] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:06:01 2022] GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df => generated 1409 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:02.196536 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3031a8a4-999e-47db-aa86-5d55fe2b89ec tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:02.197444 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3031a8a4-999e-47db-aa86-5d55fe2b89ec tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] [instance: 68801152-6e36-4e3e-95b6-e9e6eac3b8c3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:02.210476 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3031a8a4-999e-47db-aa86-5d55fe2b89ec tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:02.216040 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3031a8a4-999e-47db-aa86-5d55fe2b89ec tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:02.229831 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3031a8a4-999e-47db-aa86-5d55fe2b89ec tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:02.229960 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3031a8a4-999e-47db-aa86-5d55fe2b89ec tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:02.449304 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ced15d39-b14d-4fa8-bd24-88e96d1d5f2b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:02.449930 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ced15d39-b14d-4fa8-bd24-88e96d1d5f2b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:02.465049 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ced15d39-b14d-4fa8-bd24-88e96d1d5f2b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:02.465649 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ced15d39-b14d-4fa8-bd24-88e96d1d5f2b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:02.497563 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ced15d39-b14d-4fa8-bd24-88e96d1d5f2b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:02.504723 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ced15d39-b14d-4fa8-bd24-88e96d1d5f2b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:02.805918 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3031a8a4-999e-47db-aa86-5d55fe2b89ec tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8bb9feeac64f588262980fe5052c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834322ffb5f54cff911c2fc52a35e3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:02.819963 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3031a8a4-999e-47db-aa86-5d55fe2b89ec tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] 10.222.0.35 "GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3" status: 200 len: 1315 microversion: 2.1 time: 0.622619 Jun 10 18:06:02.822347 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1405/2722] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:02 2022] GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3 => generated 1315 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:02.830379 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-39ad0f67-9277-4862-911f-4137c11a90ef tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:02.831343 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-39ad0f67-9277-4862-911f-4137c11a90ef tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 07afccc2-6b07-4dd4-b9f5-aaa7609f72d1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:02.844711 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-39ad0f67-9277-4862-911f-4137c11a90ef tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:02.845869 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-39ad0f67-9277-4862-911f-4137c11a90ef tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:02.847030 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-39ad0f67-9277-4862-911f-4137c11a90ef tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:02.847732 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-39ad0f67-9277-4862-911f-4137c11a90ef tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:03.166624 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-39ad0f67-9277-4862-911f-4137c11a90ef tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:03.183224 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-39ad0f67-9277-4862-911f-4137c11a90ef tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/07afccc2-6b07-4dd4-b9f5-aaa7609f72d1" status: 200 len: 1222 microversion: 2.1 time: 0.356786 Jun 10 18:06:03.184148 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1406/2723] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:02 2022] GET /compute/v2.1/servers/07afccc2-6b07-4dd4-b9f5-aaa7609f72d1 => generated 1222 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:03.457225 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6fe43c56-7a70-4cd3-8dda-3b967677a0ef tempest-ListImagesTestJSON-46703193 tempest-ListImagesTestJSON-46703193-project] Calling method '.version_select at 0x7f77c0927e50>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:03.494066 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ced15d39-b14d-4fa8-bd24-88e96d1d5f2b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:03.516604 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ced15d39-b14d-4fa8-bd24-88e96d1d5f2b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:03.525774 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ced15d39-b14d-4fa8-bd24-88e96d1d5f2b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:03.533286 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ced15d39-b14d-4fa8-bd24-88e96d1d5f2b tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1266 microversion: 2.25 time: 1.089103 Jun 10 18:06:03.538749 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1318/2724] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:06:02 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1266 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:06:03.546225 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6fe43c56-7a70-4cd3-8dda-3b967677a0ef tempest-ListImagesTestJSON-46703193 tempest-ListImagesTestJSON-46703193-project] 10.222.0.35 "GET /compute/v2.1/images/efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8" status: 200 len: 784 microversion: 2.1 time: 0.359142 Jun 10 18:06:03.546824 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1407/2725] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:06:03 2022] GET /compute/v2.1/images/efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8 => generated 784 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:06:03.565391 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d1e232a9-2874-4c3f-85a0-432c4947e9e7 tempest-ListImagesTestJSON-46703193 tempest-ListImagesTestJSON-46703193-project] Calling method '.version_select at 0x7f77c005a3a0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:03.569661 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-52b6dabe-0a4b-4947-9270-e1a4a04e6a3a tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c0364310>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:03.806559 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-52b6dabe-0a4b-4947-9270-e1a4a04e6a3a tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df" status: 200 len: 1409 microversion: 2.1 time: 0.255206 Jun 10 18:06:03.807147 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1319/2726] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:06:03 2022] GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df => generated 1409 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:03.842866 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b2da0fd1-9b94-49fc-b91a-0fe4d9c4631a tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:03.843670 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b2da0fd1-9b94-49fc-b91a-0fe4d9c4631a tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] [instance: 68801152-6e36-4e3e-95b6-e9e6eac3b8c3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:03.859773 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d1e232a9-2874-4c3f-85a0-432c4947e9e7 tempest-ListImagesTestJSON-46703193 tempest-ListImagesTestJSON-46703193-project] 10.222.0.35 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.273787 Jun 10 18:06:03.865343 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1408/2727] 10.222.0.35 () {58 vars in 1121 bytes} [Fri Jun 10 18:06:03 2022] GET /compute/v2.1/images => generated 445 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:06:03.885649 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a9b87446-5568-4506-9269-078ee0654abf tempest-ListImagesTestJSON-46703193 tempest-ListImagesTestJSON-46703193-project] Calling method '.version_select at 0x7f77c005a670>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:03.891859 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b2da0fd1-9b94-49fc-b91a-0fe4d9c4631a tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:03.892838 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b2da0fd1-9b94-49fc-b91a-0fe4d9c4631a tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:03.897512 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b2da0fd1-9b94-49fc-b91a-0fe4d9c4631a tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:03.900119 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b2da0fd1-9b94-49fc-b91a-0fe4d9c4631a tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:04.014626 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a9b87446-5568-4506-9269-078ee0654abf tempest-ListImagesTestJSON-46703193 tempest-ListImagesTestJSON-46703193-project] 10.222.0.35 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.144011 Jun 10 18:06:04.016782 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1409/2728] 10.222.0.35 () {58 vars in 1142 bytes} [Fri Jun 10 18:06:03 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:06:04.160487 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-71e22b4a-eced-4cbe-8213-65a8213419e8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:06:04.162428 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-71e22b4a-eced-4cbe-8213-65a8213419e8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:04.181008 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-71e22b4a-eced-4cbe-8213-65a8213419e8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:04.184429 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-71e22b4a-eced-4cbe-8213-65a8213419e8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:04.186479 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-71e22b4a-eced-4cbe-8213-65a8213419e8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:04.188501 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-71e22b4a-eced-4cbe-8213-65a8213419e8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:04.589094 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-71e22b4a-eced-4cbe-8213-65a8213419e8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "POST /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1/action" status: 202 len: 0 microversion: 2.1 time: 0.433228 Jun 10 18:06:04.591067 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1410/2729] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:06:04 2022] POST /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1/action => generated 0 bytes in 436 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 18:06:04.621239 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b41aa3cc-3ff6-4ff4-80de-36e9aef0e4b3 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:04.624149 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b41aa3cc-3ff6-4ff4-80de-36e9aef0e4b3 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 07afccc2-6b07-4dd4-b9f5-aaa7609f72d1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:04.687838 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b41aa3cc-3ff6-4ff4-80de-36e9aef0e4b3 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:04.688089 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b41aa3cc-3ff6-4ff4-80de-36e9aef0e4b3 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:04.690590 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b41aa3cc-3ff6-4ff4-80de-36e9aef0e4b3 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:04.691215 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b41aa3cc-3ff6-4ff4-80de-36e9aef0e4b3 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:04.762530 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:06:05.068647 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b2da0fd1-9b94-49fc-b91a-0fe4d9c4631a tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8bb9feeac64f588262980fe5052c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834322ffb5f54cff911c2fc52a35e3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:05.103239 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b2da0fd1-9b94-49fc-b91a-0fe4d9c4631a tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] 10.222.0.35 "GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3" status: 200 len: 1315 microversion: 2.1 time: 1.264282 Jun 10 18:06:05.110657 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1320/2730] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:03 2022] GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3 => generated 1315 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:06:05.137744 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6273dae5-e454-4e52-8521-36ebe67a1005 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:05.143987 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6273dae5-e454-4e52-8521-36ebe67a1005 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:05.173347 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6273dae5-e454-4e52-8521-36ebe67a1005 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:05.174216 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6273dae5-e454-4e52-8521-36ebe67a1005 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:05.175265 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6273dae5-e454-4e52-8521-36ebe67a1005 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:05.175920 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6273dae5-e454-4e52-8521-36ebe67a1005 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:05.435734 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6273dae5-e454-4e52-8521-36ebe67a1005 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:05.450452 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6273dae5-e454-4e52-8521-36ebe67a1005 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:05.460149 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6273dae5-e454-4e52-8521-36ebe67a1005 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:05.465391 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6273dae5-e454-4e52-8521-36ebe67a1005 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1266 microversion: 2.25 time: 0.353813 Jun 10 18:06:05.470843 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1321/2731] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:06:05 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1266 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:06:05.487072 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a292b45f-70d5-466a-9809-587f6482ce4f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:05.489576 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a292b45f-70d5-466a-9809-587f6482ce4f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:05.519369 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a292b45f-70d5-466a-9809-587f6482ce4f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:05.522547 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a292b45f-70d5-466a-9809-587f6482ce4f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:05.523593 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a292b45f-70d5-466a-9809-587f6482ce4f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:05.527885 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a292b45f-70d5-466a-9809-587f6482ce4f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:05.992079 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b41aa3cc-3ff6-4ff4-80de-36e9aef0e4b3 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:06.002617 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b41aa3cc-3ff6-4ff4-80de-36e9aef0e4b3 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/07afccc2-6b07-4dd4-b9f5-aaa7609f72d1" status: 200 len: 1278 microversion: 2.1 time: 1.409362 Jun 10 18:06:06.003213 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1411/2732] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:04 2022] GET /compute/v2.1/servers/07afccc2-6b07-4dd4-b9f5-aaa7609f72d1 => generated 1278 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:06.029863 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e7cc4f0c-8954-4ac9-921f-3ad28fa951d1 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77b3e828b0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:06.133713 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e7cc4f0c-8954-4ac9-921f-3ad28fa951d1 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df" status: 200 len: 1409 microversion: 2.1 time: 0.129252 Jun 10 18:06:06.134571 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1412/2733] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:06:06 2022] GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df => generated 1409 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:06.161185 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ad6a833c-404d-4c2f-9e81-142dda9fee99 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:06.162167 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ad6a833c-404d-4c2f-9e81-142dda9fee99 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] [instance: 68801152-6e36-4e3e-95b6-e9e6eac3b8c3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:06.184510 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ad6a833c-404d-4c2f-9e81-142dda9fee99 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:06.187024 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ad6a833c-404d-4c2f-9e81-142dda9fee99 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:06.188052 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ad6a833c-404d-4c2f-9e81-142dda9fee99 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:06.195738 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ad6a833c-404d-4c2f-9e81-142dda9fee99 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:07.052330 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ad6a833c-404d-4c2f-9e81-142dda9fee99 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8bb9feeac64f588262980fe5052c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834322ffb5f54cff911c2fc52a35e3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:07.062149 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ad6a833c-404d-4c2f-9e81-142dda9fee99 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] 10.222.0.35 "GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3" status: 200 len: 1315 microversion: 2.1 time: 0.906004 Jun 10 18:06:07.069006 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1413/2734] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:06 2022] GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3 => generated 1315 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:06:07.089717 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-65f94279-cd47-48f2-9315-32b7d5d69a7f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:07.090361 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-65f94279-cd47-48f2-9315-32b7d5d69a7f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:07.123802 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-65f94279-cd47-48f2-9315-32b7d5d69a7f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:07.124277 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-65f94279-cd47-48f2-9315-32b7d5d69a7f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:07.125135 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-65f94279-cd47-48f2-9315-32b7d5d69a7f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:07.131591 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-65f94279-cd47-48f2-9315-32b7d5d69a7f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:07.379722 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-65f94279-cd47-48f2-9315-32b7d5d69a7f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:07.390002 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-65f94279-cd47-48f2-9315-32b7d5d69a7f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:07.406952 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-65f94279-cd47-48f2-9315-32b7d5d69a7f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:07.408986 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-65f94279-cd47-48f2-9315-32b7d5d69a7f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 200 len: 1266 microversion: 2.25 time: 0.333293 Jun 10 18:06:07.409866 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1414/2735] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:06:07 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 1266 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:06:07.415464 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-12db4b38-470c-4b40-a713-7894bffd8058 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:07.416519 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-12db4b38-470c-4b40-a713-7894bffd8058 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 07afccc2-6b07-4dd4-b9f5-aaa7609f72d1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:07.428979 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-12db4b38-470c-4b40-a713-7894bffd8058 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:07.429468 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-12db4b38-470c-4b40-a713-7894bffd8058 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:07.432856 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-12db4b38-470c-4b40-a713-7894bffd8058 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:07.433841 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-12db4b38-470c-4b40-a713-7894bffd8058 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:07.456816 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a292b45f-70d5-466a-9809-587f6482ce4f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:07.481837 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a292b45f-70d5-466a-9809-587f6482ce4f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1670 microversion: 2.1 time: 2.009324 Jun 10 18:06:07.484739 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1322/2736] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:05 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1670 bytes in 2013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:07.523846 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0212c212-3799-4b1c-98e5-78b7c6d745a1 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c033dd30>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:07.660292 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0212c212-3799-4b1c-98e5-78b7c6d745a1 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df" status: 200 len: 1409 microversion: 2.1 time: 0.171520 Jun 10 18:06:07.662206 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1323/2737] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:06:07 2022] GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df => generated 1409 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:07.676679 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-758cb01e-e520-48f3-be64-29651f12fc59 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1716027838", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "fc42ac1e-b0b9-4520-a1f7-045c0a4dcc73"}], "security_groups": [{"name": "tempest-securitygroup--1348025473"}], "key_name": "tempest-keypair-1944142214", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:06:07.801017 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-12db4b38-470c-4b40-a713-7894bffd8058 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:07.828222 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-12db4b38-470c-4b40-a713-7894bffd8058 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/07afccc2-6b07-4dd4-b9f5-aaa7609f72d1" status: 200 len: 1276 microversion: 2.1 time: 0.412407 Jun 10 18:06:07.833034 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1415/2738] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:07 2022] GET /compute/v2.1/servers/07afccc2-6b07-4dd4-b9f5-aaa7609f72d1 => generated 1276 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:08.086432 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-954d603b-6393-4186-8d5e-d330e6a4a0dc tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:08.088779 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-954d603b-6393-4186-8d5e-d330e6a4a0dc tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] [instance: 68801152-6e36-4e3e-95b6-e9e6eac3b8c3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:08.098334 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-954d603b-6393-4186-8d5e-d330e6a4a0dc tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:08.098774 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-954d603b-6393-4186-8d5e-d330e6a4a0dc tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:08.112540 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-954d603b-6393-4186-8d5e-d330e6a4a0dc tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:08.113162 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-954d603b-6393-4186-8d5e-d330e6a4a0dc tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:08.306261 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-758cb01e-e520-48f3-be64-29651f12fc59 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] validate_networks() for [('fc42ac1e-b0b9-4520-a1f7-045c0a4dcc73', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:06:09.317590 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-954d603b-6393-4186-8d5e-d330e6a4a0dc tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8bb9feeac64f588262980fe5052c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834322ffb5f54cff911c2fc52a35e3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:09.328714 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-954d603b-6393-4186-8d5e-d330e6a4a0dc tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] 10.222.0.35 "GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3" status: 200 len: 1315 microversion: 2.1 time: 1.247148 Jun 10 18:06:09.338201 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1416/2739] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:08 2022] GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3 => generated 1315 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:09.352275 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-20a04f41-cf7f-4bc4-8d46-079dc93e6abd tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:09.353190 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-20a04f41-cf7f-4bc4-8d46-079dc93e6abd tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f1a36d13-beb9-478b-b00f-94efeae1248b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:09.381869 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-20a04f41-cf7f-4bc4-8d46-079dc93e6abd tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:09.387766 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-20a04f41-cf7f-4bc4-8d46-079dc93e6abd tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:09.387766 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-20a04f41-cf7f-4bc4-8d46-079dc93e6abd tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:09.387766 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-20a04f41-cf7f-4bc4-8d46-079dc93e6abd tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:09.424783 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-20a04f41-cf7f-4bc4-8d46-079dc93e6abd tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] HTTP exception thrown: Instance f1a36d13-beb9-478b-b00f-94efeae1248b could not be found. Jun 10 18:06:09.434964 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-20a04f41-cf7f-4bc4-8d46-079dc93e6abd tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Request method failure captured: Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b HTTP/1.1 Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4aT7ZDtNgTD7bsmYg0DE4dyYI9hyVzTZoZn9JI8KjDdIMYIYOEOs1GqGLwiSWpMtOdIMlu8m1zLYUoQ6fx9aFNAP5QDfQMHsPjHdlUVi6e06F5VDYuGHApQQa7pMTSMkgvakVsQiAjjkkHaFoPrh5IDgK4RE6k56aeo5c-ALWlmr6Q Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: X-Openstack-Nova-Api-Version: 2.25 Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 01ee7bcfe44746fda89fda904f81e1b9 Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-306431913 Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/01ee7bcfe44746fda89fda904f81e1b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/01ee7bcfe44746fda89fda904f81e1b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/01ee7bcfe44746fda89fda904f81e1b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_01ee7bcfe44746fda89fda904f81e1b9", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-306431913 Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 01ee7bcfe44746fda89fda904f81e1b9 Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-306431913 Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-LiveAutoBlockMigrationV225Test-306431913-project Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: d4967895f6f041058ef60cee35a3659c Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-306431913-project Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: exception: Instance f1a36d13-beb9-478b-b00f-94efeae1248b could not be found. Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'f1a36d13-beb9-478b-b00f-94efeae1248b'} Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1a36d13-beb9-478b-b00f-94efeae1248b could not be found. Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1a36d13-beb9-478b-b00f-94efeae1248b could not be found. Jun 10 18:06:09.435554 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:06:09.441408 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:06:09.441408 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:06:09.441408 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:06:09.441408 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:06:09.441408 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:06:09.441408 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:06:09.441408 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:06:09.441408 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1a36d13-beb9-478b-b00f-94efeae1248b could not be found. Jun 10 18:06:09.441408 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:06:09.443775 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-20a04f41-cf7f-4bc4-8d46-079dc93e6abd tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Returning 404 to user: Instance f1a36d13-beb9-478b-b00f-94efeae1248b could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:06:09.445030 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-20a04f41-cf7f-4bc4-8d46-079dc93e6abd tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b" status: 404 len: 111 microversion: 2.25 time: 0.105555 Jun 10 18:06:09.449054 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1417/2740] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:06:09 2022] GET /compute/v2.1/servers/f1a36d13-beb9-478b-b00f-94efeae1248b => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:06:09.685473 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:06:09.761102 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=6 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:06:09.955455 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-758cb01e-e520-48f3-be64-29651f12fc59 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Getting quotas for project 142022afade745b9984068f42f0074dc. Resources: dict_keys(['metadata_items']) {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:06:09.966514 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-758cb01e-e520-48f3-be64-29651f12fc59 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Getting quotas for user e633cf9c8e3b41f5a538f5937acf00d7 and project 142022afade745b9984068f42f0074dc. Resources: dict_keys(['metadata_items']) {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:06:09.991261 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-758cb01e-e520-48f3-be64-29651f12fc59 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:06:09.992434 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-758cb01e-e520-48f3-be64-29651f12fc59 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:06:09.993117 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-758cb01e-e520-48f3-be64-29651f12fc59 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:06:09.993654 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-758cb01e-e520-48f3-be64-29651f12fc59 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:06:09.995211 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-758cb01e-e520-48f3-be64-29651f12fc59 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:06:10.013974 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-758cb01e-e520-48f3-be64-29651f12fc59 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:10.014687 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-758cb01e-e520-48f3-be64-29651f12fc59 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:10.016791 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-758cb01e-e520-48f3-be64-29651f12fc59 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:10.017349 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-758cb01e-e520-48f3-be64-29651f12fc59 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:10.075863 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-758cb01e-e520-48f3-be64-29651f12fc59 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Getting quotas for project 142022afade745b9984068f42f0074dc. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:06:10.096459 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-758cb01e-e520-48f3-be64-29651f12fc59 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Getting quotas for user e633cf9c8e3b41f5a538f5937acf00d7 and project 142022afade745b9984068f42f0074dc. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:06:10.143052 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-758cb01e-e520-48f3-be64-29651f12fc59 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:06:10.156374 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-758cb01e-e520-48f3-be64-29651f12fc59 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] [instance: b8136d11-a591-48c2-ab1a-c17422d326e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:06:10.189591 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3ab7d185-0049-4bed-b8d1-43c2518c75cc tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:10.190149 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3ab7d185-0049-4bed-b8d1-43c2518c75cc tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:10.207010 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3ab7d185-0049-4bed-b8d1-43c2518c75cc tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:10.207473 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3ab7d185-0049-4bed-b8d1-43c2518c75cc tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:10.208838 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3ab7d185-0049-4bed-b8d1-43c2518c75cc tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:10.225551 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3ab7d185-0049-4bed-b8d1-43c2518c75cc tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:10.413222 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-758cb01e-e520-48f3-be64-29651f12fc59 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.744428 Jun 10 18:06:10.413222 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1324/2741] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:06:07 2022] POST /compute/v2.1/servers => generated 407 bytes in 2746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:06:10.465561 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9bd2e98d-1550-4d51-a4cc-6140fab29871 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c0364550>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:10.606853 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9bd2e98d-1550-4d51-a4cc-6140fab29871 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df" status: 200 len: 1409 microversion: 2.1 time: 0.173141 Jun 10 18:06:10.613808 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1325/2742] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:06:10 2022] GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df => generated 1409 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:10.623384 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fafcd9b2-e977-4b65-87a0-5b2973cfacfa tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:10.625729 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fafcd9b2-e977-4b65-87a0-5b2973cfacfa tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 07afccc2-6b07-4dd4-b9f5-aaa7609f72d1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:10.646884 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fafcd9b2-e977-4b65-87a0-5b2973cfacfa tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:10.649770 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fafcd9b2-e977-4b65-87a0-5b2973cfacfa tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:10.652734 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fafcd9b2-e977-4b65-87a0-5b2973cfacfa tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:10.654583 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fafcd9b2-e977-4b65-87a0-5b2973cfacfa tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:11.494166 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3ab7d185-0049-4bed-b8d1-43c2518c75cc tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:11.511724 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3ab7d185-0049-4bed-b8d1-43c2518c75cc tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 2.057933 Jun 10 18:06:11.512494 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1418/2743] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:09 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 2063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:11.531132 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-9d67d80d-f1cc-4418-88c0-67af4526f58d req-b5f4272a-e403-4efd-bdb3-4890c12e004a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68801152-6e36-4e3e-95b6-e9e6eac3b8c3", "name": "network-vif-plugged", "status": "completed", "tag": "cd9c4aa8-ceaf-4554-b626-6c22db4fcfb1"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:06:11.542149 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-9d67d80d-f1cc-4418-88c0-67af4526f58d req-b5f4272a-e403-4efd-bdb3-4890c12e004a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:11.543088 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-9d67d80d-f1cc-4418-88c0-67af4526f58d req-b5f4272a-e403-4efd-bdb3-4890c12e004a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:11.565669 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-9d67d80d-f1cc-4418-88c0-67af4526f58d req-b5f4272a-e403-4efd-bdb3-4890c12e004a service nova] Creating event network-vif-plugged:cd9c4aa8-ceaf-4554-b626-6c22db4fcfb1 for instance 68801152-6e36-4e3e-95b6-e9e6eac3b8c3 on chh1-master-2 Jun 10 18:06:11.581715 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-9d67d80d-f1cc-4418-88c0-67af4526f58d req-b5f4272a-e403-4efd-bdb3-4890c12e004a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067920 Jun 10 18:06:11.587415 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1419/2744] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:06:11.595636 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a09a499f-b31d-418b-9a74-f175c2649ecc tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:11.601585 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a09a499f-b31d-418b-9a74-f175c2649ecc tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] [instance: 68801152-6e36-4e3e-95b6-e9e6eac3b8c3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:11.622258 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a09a499f-b31d-418b-9a74-f175c2649ecc tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:11.623039 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a09a499f-b31d-418b-9a74-f175c2649ecc tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:11.624125 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a09a499f-b31d-418b-9a74-f175c2649ecc tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:11.626460 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a09a499f-b31d-418b-9a74-f175c2649ecc tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:11.656227 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=20 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:06:11.994942 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fafcd9b2-e977-4b65-87a0-5b2973cfacfa tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:12.025001 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fafcd9b2-e977-4b65-87a0-5b2973cfacfa tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/07afccc2-6b07-4dd4-b9f5-aaa7609f72d1" status: 200 len: 1318 microversion: 2.1 time: 1.414078 Jun 10 18:06:12.025001 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1326/2745] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:10 2022] GET /compute/v2.1/servers/07afccc2-6b07-4dd4-b9f5-aaa7609f72d1 => generated 1318 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:12.065233 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9c91c638-29ad-4233-aaca-b9e06baa95d7 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:12.066400 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9c91c638-29ad-4233-aaca-b9e06baa95d7 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] [instance: b8136d11-a591-48c2-ab1a-c17422d326e6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:12.263409 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a09a499f-b31d-418b-9a74-f175c2649ecc tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8bb9feeac64f588262980fe5052c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834322ffb5f54cff911c2fc52a35e3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:12.287329 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a09a499f-b31d-418b-9a74-f175c2649ecc tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] 10.222.0.35 "GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3" status: 200 len: 1315 microversion: 2.1 time: 0.686916 Jun 10 18:06:12.293148 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1420/2746] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:11 2022] GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3 => generated 1315 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:12.300468 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1b3ac121-54ae-41b4-8520-d3a745373cc8 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77b3ee44c0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:12.399170 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1b3ac121-54ae-41b4-8520-d3a745373cc8 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df" status: 200 len: 1409 microversion: 2.1 time: 0.106546 Jun 10 18:06:12.409240 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1421/2747] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:06:12 2022] GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df => generated 1409 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:12.931150 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9c91c638-29ad-4233-aaca-b9e06baa95d7 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e633cf9c8e3b41f5a538f5937acf00d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142022afade745b9984068f42f0074dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:12.936682 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-771dfd12-b776-4795-9f3c-73b9722eb832 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1383789740", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "8ab79ce4-b538-43d0-b9a5-af1f85fc87b9"}, {"uuid": "ef397ae8-c3d7-4cbb-9548-314cdd2b4c17"}, {"uuid": "8ab79ce4-b538-43d0-b9a5-af1f85fc87b9"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:06:12.952255 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9c91c638-29ad-4233-aaca-b9e06baa95d7 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] 10.222.0.35 "GET /compute/v2.1/servers/b8136d11-a591-48c2-ab1a-c17422d326e6" status: 200 len: 1270 microversion: 2.1 time: 0.899434 Jun 10 18:06:12.953197 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1327/2748] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:12 2022] GET /compute/v2.1/servers/b8136d11-a591-48c2-ab1a-c17422d326e6 => generated 1270 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:13.015846 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-771dfd12-b776-4795-9f3c-73b9722eb832 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] validate_networks() for [('8ab79ce4-b538-43d0-b9a5-af1f85fc87b9', None, None, None, None, None), ('ef397ae8-c3d7-4cbb-9548-314cdd2b4c17', None, None, None, None, None), ('8ab79ce4-b538-43d0-b9a5-af1f85fc87b9', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:06:13.046572 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-88492f33-163b-410b-a7ee-ead89aba2c2a tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:13.047194 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-88492f33-163b-410b-a7ee-ead89aba2c2a tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 07afccc2-6b07-4dd4-b9f5-aaa7609f72d1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:13.066108 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-88492f33-163b-410b-a7ee-ead89aba2c2a tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:13.069978 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-88492f33-163b-410b-a7ee-ead89aba2c2a tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:13.069978 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-88492f33-163b-410b-a7ee-ead89aba2c2a tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:13.073297 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-88492f33-163b-410b-a7ee-ead89aba2c2a tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:13.998553 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-88492f33-163b-410b-a7ee-ead89aba2c2a tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:14.007955 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-88492f33-163b-410b-a7ee-ead89aba2c2a tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/07afccc2-6b07-4dd4-b9f5-aaa7609f72d1" status: 200 len: 1318 microversion: 2.1 time: 0.966224 Jun 10 18:06:14.026966 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1328/2749] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:13 2022] GET /compute/v2.1/servers/07afccc2-6b07-4dd4-b9f5-aaa7609f72d1 => generated 1318 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:14.058659 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-06bd0139-72ed-4dc8-88a4-61e4d8ab59e3 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:14.066047 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-06bd0139-72ed-4dc8-88a4-61e4d8ab59e3 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] [instance: 68801152-6e36-4e3e-95b6-e9e6eac3b8c3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:14.094458 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-06bd0139-72ed-4dc8-88a4-61e4d8ab59e3 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:14.097746 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-06bd0139-72ed-4dc8-88a4-61e4d8ab59e3 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:14.109013 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-06bd0139-72ed-4dc8-88a4-61e4d8ab59e3 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:14.109432 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-06bd0139-72ed-4dc8-88a4-61e4d8ab59e3 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:14.790404 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-06bd0139-72ed-4dc8-88a4-61e4d8ab59e3 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8bb9feeac64f588262980fe5052c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834322ffb5f54cff911c2fc52a35e3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:14.800388 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-06bd0139-72ed-4dc8-88a4-61e4d8ab59e3 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] 10.222.0.35 "GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3" status: 200 len: 1504 microversion: 2.1 time: 0.770867 Jun 10 18:06:14.816053 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1329/2750] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:14 2022] GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3 => generated 1504 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:14.841163 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0ece4075-3873-4eeb-85ca-9ce8a7b6905f tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c03288b0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:14.932765 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0ece4075-3873-4eeb-85ca-9ce8a7b6905f tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df" status: 200 len: 1409 microversion: 2.1 time: 0.113522 Jun 10 18:06:14.933477 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1330/2751] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:06:14 2022] GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df => generated 1409 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:14.971509 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-edf3a8e1-e104-4df9-94c1-ca4cbc201bbb tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:14.972717 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-edf3a8e1-e104-4df9-94c1-ca4cbc201bbb tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] [instance: b8136d11-a591-48c2-ab1a-c17422d326e6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:15.012259 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-edf3a8e1-e104-4df9-94c1-ca4cbc201bbb tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:15.013850 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-edf3a8e1-e104-4df9-94c1-ca4cbc201bbb tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:15.027763 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-edf3a8e1-e104-4df9-94c1-ca4cbc201bbb tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:15.027763 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-edf3a8e1-e104-4df9-94c1-ca4cbc201bbb tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:15.086472 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:06:15.232341 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-edf3a8e1-e104-4df9-94c1-ca4cbc201bbb tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e633cf9c8e3b41f5a538f5937acf00d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142022afade745b9984068f42f0074dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:15.247073 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-edf3a8e1-e104-4df9-94c1-ca4cbc201bbb tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] 10.222.0.35 "GET /compute/v2.1/servers/b8136d11-a591-48c2-ab1a-c17422d326e6" status: 200 len: 1328 microversion: 2.1 time: 0.294968 Jun 10 18:06:15.249337 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1331/2752] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:14 2022] GET /compute/v2.1/servers/b8136d11-a591-48c2-ab1a-c17422d326e6 => generated 1328 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:15.258941 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-f8bdf71d-2ec1-49a5-8046-972deeda94a7 req-0c330a44-9872-4875-a670-7d223a1d8003 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05c9cadb-1823-4e2c-9c9f-c3be6892e074", "tag": "8be362a0-24f5-47ff-977c-3dac2ced769c"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:06:15.280873 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-f8bdf71d-2ec1-49a5-8046-972deeda94a7 req-0c330a44-9872-4875-a670-7d223a1d8003 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:15.282140 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-f8bdf71d-2ec1-49a5-8046-972deeda94a7 req-0c330a44-9872-4875-a670-7d223a1d8003 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:15.310605 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-f8bdf71d-2ec1-49a5-8046-972deeda94a7 req-0c330a44-9872-4875-a670-7d223a1d8003 service nova] Creating event network-changed:8be362a0-24f5-47ff-977c-3dac2ced769c for instance 05c9cadb-1823-4e2c-9c9f-c3be6892e074 on chh2-master-2 Jun 10 18:06:15.324432 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-f8bdf71d-2ec1-49a5-8046-972deeda94a7 req-0c330a44-9872-4875-a670-7d223a1d8003 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073532 Jun 10 18:06:15.327383 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1332/2753] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:06:15.341584 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-13933748-b346-4876-88e4-f0b2812b99f7 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:15.343761 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-13933748-b346-4876-88e4-f0b2812b99f7 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] [instance: 68801152-6e36-4e3e-95b6-e9e6eac3b8c3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:15.353013 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-13933748-b346-4876-88e4-f0b2812b99f7 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:15.353726 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-13933748-b346-4876-88e4-f0b2812b99f7 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:15.354505 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-13933748-b346-4876-88e4-f0b2812b99f7 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:15.354939 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-13933748-b346-4876-88e4-f0b2812b99f7 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:15.662447 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-13933748-b346-4876-88e4-f0b2812b99f7 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] 10.222.0.35 "DELETE /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.331681 Jun 10 18:06:15.667848 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1333/2754] 10.222.0.35 () {58 vars in 1295 bytes} [Fri Jun 10 18:06:15 2022] DELETE /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3/os-server-password => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:06:15.688199 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2ba442fb-6d8b-4401-9dfa-802997948028 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:15.695269 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2ba442fb-6d8b-4401-9dfa-802997948028 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 07afccc2-6b07-4dd4-b9f5-aaa7609f72d1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:15.733325 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2ba442fb-6d8b-4401-9dfa-802997948028 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:15.739951 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2ba442fb-6d8b-4401-9dfa-802997948028 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:15.739951 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2ba442fb-6d8b-4401-9dfa-802997948028 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:15.739951 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2ba442fb-6d8b-4401-9dfa-802997948028 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:16.709534 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2ba442fb-6d8b-4401-9dfa-802997948028 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:16.724847 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2ba442fb-6d8b-4401-9dfa-802997948028 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/07afccc2-6b07-4dd4-b9f5-aaa7609f72d1" status: 200 len: 1318 microversion: 2.1 time: 1.053576 Jun 10 18:06:16.727978 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1334/2755] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:15 2022] GET /compute/v2.1/servers/07afccc2-6b07-4dd4-b9f5-aaa7609f72d1 => generated 1318 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:16.740049 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-02b79e88-3a15-4cd2-85c0-0162b89ebd6a tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:16.743283 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-02b79e88-3a15-4cd2-85c0-0162b89ebd6a tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] [instance: 68801152-6e36-4e3e-95b6-e9e6eac3b8c3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:16.807331 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02b79e88-3a15-4cd2-85c0-0162b89ebd6a tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:16.808482 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02b79e88-3a15-4cd2-85c0-0162b89ebd6a tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:16.811460 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02b79e88-3a15-4cd2-85c0-0162b89ebd6a tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:16.812114 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02b79e88-3a15-4cd2-85c0-0162b89ebd6a tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:16.851484 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-02b79e88-3a15-4cd2-85c0-0162b89ebd6a tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] 10.222.0.35 "GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.121594 Jun 10 18:06:16.860760 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1335/2756] 10.222.0.35 () {58 vars in 1292 bytes} [Fri Jun 10 18:06:16 2022] GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3/os-server-password => generated 16 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:06:16.867285 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c712c5ef-3ee6-4c62-a2e5-f44a349cf20c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c03648b0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:16.943519 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c712c5ef-3ee6-4c62-a2e5-f44a349cf20c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df" status: 200 len: 1409 microversion: 2.1 time: 0.080220 Jun 10 18:06:16.946362 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1336/2757] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:06:16 2022] GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df => generated 1409 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:16.959924 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a6057a23-2fe6-47d5-99f2-ccc53ca25fc9 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:16.961348 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a6057a23-2fe6-47d5-99f2-ccc53ca25fc9 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] [instance: b8136d11-a591-48c2-ab1a-c17422d326e6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:16.990784 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a6057a23-2fe6-47d5-99f2-ccc53ca25fc9 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:16.990784 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a6057a23-2fe6-47d5-99f2-ccc53ca25fc9 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:16.991763 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a6057a23-2fe6-47d5-99f2-ccc53ca25fc9 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:16.992353 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a6057a23-2fe6-47d5-99f2-ccc53ca25fc9 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:17.125218 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a6057a23-2fe6-47d5-99f2-ccc53ca25fc9 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e633cf9c8e3b41f5a538f5937acf00d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142022afade745b9984068f42f0074dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:17.133708 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a6057a23-2fe6-47d5-99f2-ccc53ca25fc9 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] 10.222.0.35 "GET /compute/v2.1/servers/b8136d11-a591-48c2-ab1a-c17422d326e6" status: 200 len: 1328 microversion: 2.1 time: 0.185014 Jun 10 18:06:17.134554 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1337/2758] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:16 2022] GET /compute/v2.1/servers/b8136d11-a591-48c2-ab1a-c17422d326e6 => generated 1328 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:17.148914 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2f785264-4690-4928-a8b2-122247c62285 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:17.149416 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2f785264-4690-4928-a8b2-122247c62285 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] [instance: 68801152-6e36-4e3e-95b6-e9e6eac3b8c3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:17.155926 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2f785264-4690-4928-a8b2-122247c62285 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:17.156414 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2f785264-4690-4928-a8b2-122247c62285 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:17.157201 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2f785264-4690-4928-a8b2-122247c62285 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:17.157638 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2f785264-4690-4928-a8b2-122247c62285 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:17.188418 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2f785264-4690-4928-a8b2-122247c62285 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] [instance: 68801152-6e36-4e3e-95b6-e9e6eac3b8c3] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:06:17.370562 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-771dfd12-b776-4795-9f3c-73b9722eb832 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:06:17.371671 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-771dfd12-b776-4795-9f3c-73b9722eb832 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:06:17.372435 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-771dfd12-b776-4795-9f3c-73b9722eb832 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:06:17.373083 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-771dfd12-b776-4795-9f3c-73b9722eb832 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:06:17.373735 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-771dfd12-b776-4795-9f3c-73b9722eb832 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:06:17.403787 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-771dfd12-b776-4795-9f3c-73b9722eb832 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:17.404250 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-771dfd12-b776-4795-9f3c-73b9722eb832 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:17.409074 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-771dfd12-b776-4795-9f3c-73b9722eb832 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:17.412930 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-771dfd12-b776-4795-9f3c-73b9722eb832 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:17.467003 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-771dfd12-b776-4795-9f3c-73b9722eb832 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Getting quotas for project 818440b6c7d34e09a1afd8a6e0c0b3ed. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:06:17.479764 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-771dfd12-b776-4795-9f3c-73b9722eb832 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Getting quotas for user 1d61eddc0c334ec79e23a069a422fad8 and project 818440b6c7d34e09a1afd8a6e0c0b3ed. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:06:17.552842 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-771dfd12-b776-4795-9f3c-73b9722eb832 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:06:17.555475 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-771dfd12-b776-4795-9f3c-73b9722eb832 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:06:17.657798 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2f785264-4690-4928-a8b2-122247c62285 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] 10.222.0.35 "DELETE /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3" status: 204 len: 0 microversion: 2.1 time: 0.513678 Jun 10 18:06:17.659387 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1338/2759] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:06:17 2022] DELETE /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:06:17.665901 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-9f996a50-b800-4147-a060-baf1ee1f4220 req-2deb5a78-0e52-459d-87e1-7417caaea62e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07afccc2-6b07-4dd4-b9f5-aaa7609f72d1", "tag": "5f3d7a05-ae18-47e6-b31b-ac40d7700ec1"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:06:17.683672 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-9f996a50-b800-4147-a060-baf1ee1f4220 req-2deb5a78-0e52-459d-87e1-7417caaea62e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:17.687957 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-9f996a50-b800-4147-a060-baf1ee1f4220 req-2deb5a78-0e52-459d-87e1-7417caaea62e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:17.722653 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-9f996a50-b800-4147-a060-baf1ee1f4220 req-2deb5a78-0e52-459d-87e1-7417caaea62e service nova] Creating event network-changed:5f3d7a05-ae18-47e6-b31b-ac40d7700ec1 for instance 07afccc2-6b07-4dd4-b9f5-aaa7609f72d1 on chh2-master-2 Jun 10 18:06:17.733410 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-9f996a50-b800-4147-a060-baf1ee1f4220 req-2deb5a78-0e52-459d-87e1-7417caaea62e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071034 Jun 10 18:06:17.738265 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1339/2760] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:06:17.767198 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2bdac895-86be-49b5-9975-7fb2a3ab3e8a tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:17.767198 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2bdac895-86be-49b5-9975-7fb2a3ab3e8a tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] [instance: 68801152-6e36-4e3e-95b6-e9e6eac3b8c3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:17.797275 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2bdac895-86be-49b5-9975-7fb2a3ab3e8a tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:17.797738 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2bdac895-86be-49b5-9975-7fb2a3ab3e8a tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:17.798530 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2bdac895-86be-49b5-9975-7fb2a3ab3e8a tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:17.798975 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2bdac895-86be-49b5-9975-7fb2a3ab3e8a tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:17.825471 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-771dfd12-b776-4795-9f3c-73b9722eb832 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.860857 Jun 10 18:06:17.827574 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1422/2761] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:06:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 4906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:06:17.842620 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-55d512e5-8c78-479c-bb71-fb50f71f315c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:17.843554 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-55d512e5-8c78-479c-bb71-fb50f71f315c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 07afccc2-6b07-4dd4-b9f5-aaa7609f72d1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:17.859333 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-55d512e5-8c78-479c-bb71-fb50f71f315c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:17.861245 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-55d512e5-8c78-479c-bb71-fb50f71f315c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:17.865349 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-55d512e5-8c78-479c-bb71-fb50f71f315c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:17.866180 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-55d512e5-8c78-479c-bb71-fb50f71f315c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:18.123219 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2bdac895-86be-49b5-9975-7fb2a3ab3e8a tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8bb9feeac64f588262980fe5052c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834322ffb5f54cff911c2fc52a35e3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:18.140465 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2bdac895-86be-49b5-9975-7fb2a3ab3e8a tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] 10.222.0.35 "GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3" status: 200 len: 1510 microversion: 2.1 time: 0.400618 Jun 10 18:06:18.141584 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1340/2762] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:17 2022] GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3 => generated 1510 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:18.148213 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f9f19a4d-07cc-4f27-aaf4-b64b77585ad6 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:18.148852 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f9f19a4d-07cc-4f27-aaf4-b64b77585ad6 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:18.294618 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f9f19a4d-07cc-4f27-aaf4-b64b77585ad6 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:18.310884 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f9f19a4d-07cc-4f27-aaf4-b64b77585ad6 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058" status: 200 len: 1213 microversion: 2.1 time: 0.168012 Jun 10 18:06:18.315384 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1341/2763] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:18 2022] GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 => generated 1213 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:18.316494 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1f6d9842-4f83-4a8f-871e-928c5aa86bcf tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:18.316839 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1f6d9842-4f83-4a8f-871e-928c5aa86bcf tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:18.336951 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f6d9842-4f83-4a8f-871e-928c5aa86bcf tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:18.337510 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f6d9842-4f83-4a8f-871e-928c5aa86bcf tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:18.338247 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f6d9842-4f83-4a8f-871e-928c5aa86bcf tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:18.338612 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f6d9842-4f83-4a8f-871e-928c5aa86bcf tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:18.404208 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1f6d9842-4f83-4a8f-871e-928c5aa86bcf tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:06:18.752762 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1f6d9842-4f83-4a8f-871e-928c5aa86bcf tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "DELETE /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 204 len: 0 microversion: 2.25 time: 0.439594 Jun 10 18:06:18.757155 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1342/2764] 10.222.0.35 () {60 vars in 1279 bytes} [Fri Jun 10 18:06:18 2022] DELETE /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 10 18:06:18.763007 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-924d7c76-406f-4077-976e-afa6deba3c56 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c03c4940>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:18.836449 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-55d512e5-8c78-479c-bb71-fb50f71f315c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:18.848094 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-924d7c76-406f-4077-976e-afa6deba3c56 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df" status: 200 len: 1409 microversion: 2.1 time: 0.089312 Jun 10 18:06:18.853078 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-55d512e5-8c78-479c-bb71-fb50f71f315c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/07afccc2-6b07-4dd4-b9f5-aaa7609f72d1" status: 200 len: 1318 microversion: 2.1 time: 1.023329 Jun 10 18:06:18.858967 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1423/2765] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:17 2022] GET /compute/v2.1/servers/07afccc2-6b07-4dd4-b9f5-aaa7609f72d1 => generated 1318 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:18.863639 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1343/2766] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:06:18 2022] GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df => generated 1409 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:18.883061 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ab8bc968-fb9d-44b3-a9b6-c5e6b8008ddc tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:18.886798 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ab8bc968-fb9d-44b3-a9b6-c5e6b8008ddc tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] [instance: b8136d11-a591-48c2-ab1a-c17422d326e6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:18.919158 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ab8bc968-fb9d-44b3-a9b6-c5e6b8008ddc tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:18.927374 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ab8bc968-fb9d-44b3-a9b6-c5e6b8008ddc tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:18.928893 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ab8bc968-fb9d-44b3-a9b6-c5e6b8008ddc tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:18.928893 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ab8bc968-fb9d-44b3-a9b6-c5e6b8008ddc tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:19.166953 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6f45a62c-cd9c-4d8f-ac54-7266805cede4 tempest-SecurityGroupsNegativeTestJSON-392092015 tempest-SecurityGroupsNegativeTestJSON-392092015-project] Calling method '.version_select at 0x7f77c09c3280>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:19.257232 chdv-master-2 devstack@n-api.service[126594]: DEBUG neutronclient.v2_0.client [None req-6f45a62c-cd9c-4d8f-ac54-7266805cede4 tempest-SecurityGroupsNegativeTestJSON-392092015 tempest-SecurityGroupsNegativeTestJSON-392092015-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c7f22691-8d33-4a5a-b30b-bf1afb2daca2 does not exist", "detail": ""}} {{(pid=126594) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 10 18:06:19.258414 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.security_group_api [None req-6f45a62c-cd9c-4d8f-ac54-7266805cede4 tempest-SecurityGroupsNegativeTestJSON-392092015 tempest-SecurityGroupsNegativeTestJSON-392092015-project] Neutron security group c7f22691-8d33-4a5a-b30b-bf1afb2daca2 not found {{(pid=126594) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 10 18:06:19.259211 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-6f45a62c-cd9c-4d8f-ac54-7266805cede4 tempest-SecurityGroupsNegativeTestJSON-392092015 tempest-SecurityGroupsNegativeTestJSON-392092015-project] HTTP exception thrown: Security group c7f22691-8d33-4a5a-b30b-bf1afb2daca2 does not exist Jun 10 18:06:19.259211 chdv-master-2 devstack@n-api.service[126594]: Neutron server returns request_ids: ['req-14df81a3-7b92-4849-9d66-289c073945b9'] Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6f45a62c-cd9c-4d8f-ac54-7266805cede4 tempest-SecurityGroupsNegativeTestJSON-392092015 tempest-SecurityGroupsNegativeTestJSON-392092015-project] Request method failure captured: Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: request: DELETE /compute/v2.1/os-security-groups/c7f22691-8d33-4a5a-b30b-bf1afb2daca2 HTTP/1.1 Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4gZ2rwXeFYEU27LwI_jKNt6gOvY8fnegL5MxVKqaQ_4xS-wd4te849uYkRkbAwsmdUEDqfCatrLfnS7LVUm5GxZ-a-_HZc8Ua9RIWZueoHGFZlfMZqKR7TY7CDM7CdvFMXDd6HEFJRKddpFVrb0acsA80avJsK3y9QEBWFe8hrrkRk Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 8699a77a058541ca8b3388231a63864c Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-392092015 Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/8699a77a058541ca8b3388231a63864c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8699a77a058541ca8b3388231a63864c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8699a77a058541ca8b3388231a63864c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_8699a77a058541ca8b3388231a63864c", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-392092015 Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 8699a77a058541ca8b3388231a63864c Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-392092015 Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-SecurityGroupsNegativeTestJSON-392092015-project Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 8635227495974ac6955305a25d218662 Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-392092015-project Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: exception: Security group c7f22691-8d33-4a5a-b30b-bf1afb2daca2 does not exist Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: Neutron server returns request_ids: ['req-14df81a3-7b92-4849-9d66-289c073945b9'] Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'c7f22691-8d33-4a5a-b30b-bf1afb2daca2'} Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 10 18:06:19.261989 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c7f22691-8d33-4a5a-b30b-bf1afb2daca2 does not exist Jun 10 18:06:19.266551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-14df81a3-7b92-4849-9d66-289c073945b9'] Jun 10 18:06:19.266551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:06:19.266551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:06:19.266551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:06:19.266551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:06:19.266551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 10 18:06:19.266551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 10 18:06:19.266551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 10 18:06:19.266551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 10 18:06:19.266551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c7f22691-8d33-4a5a-b30b-bf1afb2daca2 does not exist Jun 10 18:06:19.266551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-14df81a3-7b92-4849-9d66-289c073945b9'] Jun 10 18:06:19.266551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:06:19.266551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:06:19.266551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:06:19.266551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:06:19.266551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:06:19.266551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:06:19.266551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:06:19.266551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:06:19.266551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:06:19.266551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:06:19.266551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:06:19.266551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:06:19.266551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 10 18:06:19.266551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 10 18:06:19.266551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c7f22691-8d33-4a5a-b30b-bf1afb2daca2 does not exist Jun 10 18:06:19.266551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-14df81a3-7b92-4849-9d66-289c073945b9'] Jun 10 18:06:19.266551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:06:19.266551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:06:19.266551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:06:19.266551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:06:19.266551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:06:19.266551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:06:19.266551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:06:19.266551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:06:19.266551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c7f22691-8d33-4a5a-b30b-bf1afb2daca2 does not exist Jun 10 18:06:19.266551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-14df81a3-7b92-4849-9d66-289c073945b9'] Jun 10 18:06:19.266551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:06:19.272485 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6f45a62c-cd9c-4d8f-ac54-7266805cede4 tempest-SecurityGroupsNegativeTestJSON-392092015 tempest-SecurityGroupsNegativeTestJSON-392092015-project] Returning 404 to user: Security group c7f22691-8d33-4a5a-b30b-bf1afb2daca2 does not exist Jun 10 18:06:19.272485 chdv-master-2 devstack@n-api.service[126594]: Neutron server returns request_ids: ['req-14df81a3-7b92-4849-9d66-289c073945b9'] {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:06:19.274190 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6f45a62c-cd9c-4d8f-ac54-7266805cede4 tempest-SecurityGroupsNegativeTestJSON-392092015 tempest-SecurityGroupsNegativeTestJSON-392092015-project] 10.222.0.35 "DELETE /compute/v2.1/os-security-groups/c7f22691-8d33-4a5a-b30b-bf1afb2daca2" status: 404 len: 194 microversion: 2.1 time: 0.413585 Jun 10 18:06:19.275188 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1424/2767] 10.222.0.35 () {58 vars in 1271 bytes} [Fri Jun 10 18:06:18 2022] DELETE /compute/v2.1/os-security-groups/c7f22691-8d33-4a5a-b30b-bf1afb2daca2 => generated 194 bytes in 415 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:06:19.281500 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-74d81913-dc2c-429e-84a3-b80e4f1aa5ea tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:19.282490 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-74d81913-dc2c-429e-84a3-b80e4f1aa5ea tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:19.294453 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-74d81913-dc2c-429e-84a3-b80e4f1aa5ea tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:19.295219 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-74d81913-dc2c-429e-84a3-b80e4f1aa5ea tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:19.296332 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-74d81913-dc2c-429e-84a3-b80e4f1aa5ea tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:19.296912 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-74d81913-dc2c-429e-84a3-b80e4f1aa5ea tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:19.766520 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-74d81913-dc2c-429e-84a3-b80e4f1aa5ea tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:19.775864 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-74d81913-dc2c-429e-84a3-b80e4f1aa5ea tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:19.779530 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-74d81913-dc2c-429e-84a3-b80e4f1aa5ea tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:19.783777 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-74d81913-dc2c-429e-84a3-b80e4f1aa5ea tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1563 microversion: 2.25 time: 0.507046 Jun 10 18:06:19.796408 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1425/2768] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:06:19 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1563 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:06:19.807422 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f30be6e2-7bd9-473b-b8de-14fcfed4c3eb tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:19.811049 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f30be6e2-7bd9-473b-b8de-14fcfed4c3eb tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] [instance: 68801152-6e36-4e3e-95b6-e9e6eac3b8c3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:19.827323 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f30be6e2-7bd9-473b-b8de-14fcfed4c3eb tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:19.829928 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f30be6e2-7bd9-473b-b8de-14fcfed4c3eb tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:19.830970 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f30be6e2-7bd9-473b-b8de-14fcfed4c3eb tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:19.831604 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f30be6e2-7bd9-473b-b8de-14fcfed4c3eb tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:20.059706 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ab8bc968-fb9d-44b3-a9b6-c5e6b8008ddc tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e633cf9c8e3b41f5a538f5937acf00d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142022afade745b9984068f42f0074dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:20.113986 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ab8bc968-fb9d-44b3-a9b6-c5e6b8008ddc tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] 10.222.0.35 "GET /compute/v2.1/servers/b8136d11-a591-48c2-ab1a-c17422d326e6" status: 200 len: 1396 microversion: 2.1 time: 1.242352 Jun 10 18:06:20.119424 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1344/2769] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:18 2022] GET /compute/v2.1/servers/b8136d11-a591-48c2-ab1a-c17422d326e6 => generated 1396 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:20.139698 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-430f7450-1fe2-4c16-b691-20fc8b0f746b tempest-SecurityGroupsNegativeTestJSON-392092015 tempest-SecurityGroupsNegativeTestJSON-392092015-project] 10.222.0.35 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.015152 Jun 10 18:06:20.149476 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1345/2770] 10.222.0.35 () {58 vars in 1163 bytes} [Fri Jun 10 18:06:20 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 29 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 10 18:06:20.180945 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-82e7bd72-5fa4-41bd-a4f7-0630da6b0f7a tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:20.180945 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-82e7bd72-5fa4-41bd-a4f7-0630da6b0f7a tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:20.197446 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-82e7bd72-5fa4-41bd-a4f7-0630da6b0f7a tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:20.201482 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-82e7bd72-5fa4-41bd-a4f7-0630da6b0f7a tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:20.202968 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-82e7bd72-5fa4-41bd-a4f7-0630da6b0f7a tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:20.205131 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-82e7bd72-5fa4-41bd-a4f7-0630da6b0f7a tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:20.419544 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-82e7bd72-5fa4-41bd-a4f7-0630da6b0f7a tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:20.419544 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-82e7bd72-5fa4-41bd-a4f7-0630da6b0f7a tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058" status: 200 len: 1209 microversion: 2.1 time: 0.178829 Jun 10 18:06:20.419544 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1346/2771] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:20 2022] GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 => generated 1209 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:20.419544 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-154e82e8-88d5-42f4-8cc5-7bf16d690c59 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c0349ca0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:20.419544 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-154e82e8-88d5-42f4-8cc5-7bf16d690c59 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df" status: 200 len: 1409 microversion: 2.1 time: 0.060302 Jun 10 18:06:20.419544 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1347/2772] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:06:20 2022] GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df => generated 1409 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:20.419544 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2c3ad272-5293-442c-8ffb-cfce5ce21ed6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:20.419544 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2c3ad272-5293-442c-8ffb-cfce5ce21ed6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 07afccc2-6b07-4dd4-b9f5-aaa7609f72d1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:20.419544 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c3ad272-5293-442c-8ffb-cfce5ce21ed6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:20.419544 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c3ad272-5293-442c-8ffb-cfce5ce21ed6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:20.419544 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c3ad272-5293-442c-8ffb-cfce5ce21ed6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:20.419544 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c3ad272-5293-442c-8ffb-cfce5ce21ed6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:20.522979 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:06:20.531863 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f30be6e2-7bd9-473b-b8de-14fcfed4c3eb tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8bb9feeac64f588262980fe5052c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834322ffb5f54cff911c2fc52a35e3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:20.541552 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f30be6e2-7bd9-473b-b8de-14fcfed4c3eb tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] 10.222.0.35 "GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3" status: 200 len: 1510 microversion: 2.1 time: 0.742225 Jun 10 18:06:20.542790 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1426/2773] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:19 2022] GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3 => generated 1510 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:20.549564 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6f816830-2332-431d-a4c5-173baafd1724 tempest-SecurityGroupsNegativeTestJSON-392092015 tempest-SecurityGroupsNegativeTestJSON-392092015-project] Calling method '.version_select at 0x7f77b3ee40d0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:20.618944 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2c3ad272-5293-442c-8ffb-cfce5ce21ed6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:20.629105 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2c3ad272-5293-442c-8ffb-cfce5ce21ed6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/07afccc2-6b07-4dd4-b9f5-aaa7609f72d1" status: 200 len: 1318 microversion: 2.1 time: 0.234030 Jun 10 18:06:20.630687 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1348/2774] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:20 2022] GET /compute/v2.1/servers/07afccc2-6b07-4dd4-b9f5-aaa7609f72d1 => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:20.816565 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-61565c57-6635-4854-830a-f039364ef284 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:20.818533 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-61565c57-6635-4854-830a-f039364ef284 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:20.849128 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-61565c57-6635-4854-830a-f039364ef284 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:20.855927 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-61565c57-6635-4854-830a-f039364ef284 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:20.855927 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-61565c57-6635-4854-830a-f039364ef284 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:20.855927 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-61565c57-6635-4854-830a-f039364ef284 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:20.918213 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6f816830-2332-431d-a4c5-173baafd1724 tempest-SecurityGroupsNegativeTestJSON-392092015 tempest-SecurityGroupsNegativeTestJSON-392092015-project] 10.222.0.35 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.372791 Jun 10 18:06:20.921142 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1427/2775] 10.222.0.35 () {58 vars in 1157 bytes} [Fri Jun 10 18:06:20 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:06:20.935131 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0bc68ff7-6d17-44bc-8c27-ceb0fa347301 tempest-SecurityGroupsNegativeTestJSON-392092015 tempest-SecurityGroupsNegativeTestJSON-392092015-project] Calling method '.version_select at 0x7f77c093de50>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:21.108003 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-61565c57-6635-4854-830a-f039364ef284 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:21.122884 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-61565c57-6635-4854-830a-f039364ef284 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:21.124436 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-61565c57-6635-4854-830a-f039364ef284 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:21.125772 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-61565c57-6635-4854-830a-f039364ef284 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1563 microversion: 2.25 time: 0.314863 Jun 10 18:06:21.126649 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1349/2776] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:06:20 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1563 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:06:21.142083 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-7789fb0b-6225-4b84-8089-3951011ad3fe req-723b80b2-5811-4b73-a214-ae4a0f9975b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68801152-6e36-4e3e-95b6-e9e6eac3b8c3", "name": "network-vif-deleted", "tag": "cd9c4aa8-ceaf-4554-b626-6c22db4fcfb1"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:06:21.157204 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-7789fb0b-6225-4b84-8089-3951011ad3fe req-723b80b2-5811-4b73-a214-ae4a0f9975b4 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:21.158825 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-7789fb0b-6225-4b84-8089-3951011ad3fe req-723b80b2-5811-4b73-a214-ae4a0f9975b4 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:21.163519 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=3,nova_cell1:INSERT=6 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:06:21.173474 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-7789fb0b-6225-4b84-8089-3951011ad3fe req-723b80b2-5811-4b73-a214-ae4a0f9975b4 service nova] Creating event network-vif-deleted:cd9c4aa8-ceaf-4554-b626-6c22db4fcfb1 for instance 68801152-6e36-4e3e-95b6-e9e6eac3b8c3 on chh1-master-2 Jun 10 18:06:21.181292 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-7789fb0b-6225-4b84-8089-3951011ad3fe req-723b80b2-5811-4b73-a214-ae4a0f9975b4 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051859 Jun 10 18:06:21.181292 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1350/2777] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:06:21.190651 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d1b2a5cc-877d-42e7-8724-8744f209a2c9 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:21.191638 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d1b2a5cc-877d-42e7-8724-8744f209a2c9 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] [instance: b8136d11-a591-48c2-ab1a-c17422d326e6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:21.202664 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d1b2a5cc-877d-42e7-8724-8744f209a2c9 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:21.204805 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d1b2a5cc-877d-42e7-8724-8744f209a2c9 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:21.204805 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d1b2a5cc-877d-42e7-8724-8744f209a2c9 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:21.205035 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d1b2a5cc-877d-42e7-8724-8744f209a2c9 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:21.289682 chdv-master-2 devstack@n-api.service[126594]: DEBUG neutronclient.v2_0.client [None req-0bc68ff7-6d17-44bc-8c27-ceb0fa347301 tempest-SecurityGroupsNegativeTestJSON-392092015 tempest-SecurityGroupsNegativeTestJSON-392092015-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=126594) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 10 18:06:21.290390 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-0bc68ff7-6d17-44bc-8c27-ceb0fa347301 tempest-SecurityGroupsNegativeTestJSON-392092015 tempest-SecurityGroupsNegativeTestJSON-392092015-project] HTTP exception thrown: Insufficient rights for removing default security group. Jun 10 18:06:21.290390 chdv-master-2 devstack@n-api.service[126594]: Neutron server returns request_ids: ['req-cb3cdbee-f777-4b8f-b325-985268b27aab'] Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0bc68ff7-6d17-44bc-8c27-ceb0fa347301 tempest-SecurityGroupsNegativeTestJSON-392092015 tempest-SecurityGroupsNegativeTestJSON-392092015-project] Request method failure captured: Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: request: DELETE /compute/v2.1/os-security-groups/08f601d9-b43f-48db-a606-1ef0c862f3f4 HTTP/1.1 Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4gZ2rwXeFYEU27LwI_jKNt6gOvY8fnegL5MxVKqaQ_4xS-wd4te849uYkRkbAwsmdUEDqfCatrLfnS7LVUm5GxZ-a-_HZc8Ua9RIWZueoHGFZlfMZqKR7TY7CDM7CdvFMXDd6HEFJRKddpFVrb0acsA80avJsK3y9QEBWFe8hrrkRk Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 8699a77a058541ca8b3388231a63864c Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-392092015 Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/8699a77a058541ca8b3388231a63864c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8699a77a058541ca8b3388231a63864c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8699a77a058541ca8b3388231a63864c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_8699a77a058541ca8b3388231a63864c", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-392092015 Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 8699a77a058541ca8b3388231a63864c Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-392092015 Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-SecurityGroupsNegativeTestJSON-392092015-project Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 8635227495974ac6955305a25d218662 Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-392092015-project Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: exception: Insufficient rights for removing default security group. Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: Neutron server returns request_ids: ['req-cb3cdbee-f777-4b8f-b325-985268b27aab'] Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '08f601d9-b43f-48db-a606-1ef0c862f3f4'} Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 10 18:06:21.292357 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Jun 10 18:06:21.296719 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb3cdbee-f777-4b8f-b325-985268b27aab'] Jun 10 18:06:21.296719 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:06:21.296719 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:06:21.296719 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:06:21.296719 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:06:21.296719 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jun 10 18:06:21.296719 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jun 10 18:06:21.296719 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jun 10 18:06:21.296719 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jun 10 18:06:21.296719 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Jun 10 18:06:21.296719 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb3cdbee-f777-4b8f-b325-985268b27aab'] Jun 10 18:06:21.296719 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:06:21.296719 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:06:21.296719 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:06:21.296719 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:06:21.296719 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:06:21.296719 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:06:21.296719 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:06:21.296719 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:06:21.296719 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:06:21.296719 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:06:21.296719 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:06:21.296719 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:06:21.296719 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jun 10 18:06:21.296719 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 10 18:06:21.296719 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Jun 10 18:06:21.296719 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb3cdbee-f777-4b8f-b325-985268b27aab'] Jun 10 18:06:21.296719 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:06:21.296719 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:06:21.296719 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:06:21.296719 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:06:21.296719 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:06:21.296719 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:06:21.296719 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:06:21.296719 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:06:21.296719 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Jun 10 18:06:21.296719 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb3cdbee-f777-4b8f-b325-985268b27aab'] Jun 10 18:06:21.296719 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:06:21.296719 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0bc68ff7-6d17-44bc-8c27-ceb0fa347301 tempest-SecurityGroupsNegativeTestJSON-392092015 tempest-SecurityGroupsNegativeTestJSON-392092015-project] Returning 400 to user: Insufficient rights for removing default security group. Jun 10 18:06:21.296719 chdv-master-2 devstack@n-api.service[126594]: Neutron server returns request_ids: ['req-cb3cdbee-f777-4b8f-b325-985268b27aab'] {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:06:21.296719 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0bc68ff7-6d17-44bc-8c27-ceb0fa347301 tempest-SecurityGroupsNegativeTestJSON-392092015 tempest-SecurityGroupsNegativeTestJSON-392092015-project] 10.222.0.35 "DELETE /compute/v2.1/os-security-groups/08f601d9-b43f-48db-a606-1ef0c862f3f4" status: 400 len: 182 microversion: 2.1 time: 0.364809 Jun 10 18:06:21.296719 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1428/2778] 10.222.0.35 () {58 vars in 1271 bytes} [Fri Jun 10 18:06:20 2022] DELETE /compute/v2.1/os-security-groups/08f601d9-b43f-48db-a606-1ef0c862f3f4 => generated 182 bytes in 366 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 10 18:06:21.313063 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-3cd2476f-b5bb-4ca3-96c3-9cf1425d01e5 req-c37ec994-cbfb-4ecd-af60-4a136e8d7279 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8136d11-a591-48c2-ab1a-c17422d326e6", "tag": "2b19c5f3-6d53-4f1e-ab63-c786eef0c74e"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:06:21.327762 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-3cd2476f-b5bb-4ca3-96c3-9cf1425d01e5 req-c37ec994-cbfb-4ecd-af60-4a136e8d7279 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:21.328713 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-3cd2476f-b5bb-4ca3-96c3-9cf1425d01e5 req-c37ec994-cbfb-4ecd-af60-4a136e8d7279 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:21.344388 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-3cd2476f-b5bb-4ca3-96c3-9cf1425d01e5 req-c37ec994-cbfb-4ecd-af60-4a136e8d7279 service nova] Creating event network-changed:2b19c5f3-6d53-4f1e-ab63-c786eef0c74e for instance b8136d11-a591-48c2-ab1a-c17422d326e6 on chh1-master-2 Jun 10 18:06:21.351158 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-3cd2476f-b5bb-4ca3-96c3-9cf1425d01e5 req-c37ec994-cbfb-4ecd-af60-4a136e8d7279 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054993 Jun 10 18:06:21.352540 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1429/2779] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:06:21.362064 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-64739ca2-907c-4506-aee5-9e9cf279d913 tempest-SecurityGroupsNegativeTestJSON-392092015 tempest-SecurityGroupsNegativeTestJSON-392092015-project] Calling method '.version_select at 0x7f77c11cc940>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:21.392696 chdv-master-2 devstack@n-api.service[126594]: DEBUG neutronclient.v2_0.client [None req-64739ca2-907c-4506-aee5-9e9cf279d913 tempest-SecurityGroupsNegativeTestJSON-392092015 tempest-SecurityGroupsNegativeTestJSON-392092015-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9589aa8d-57e7-4b72-b3de-824a602939a7 does not exist", "detail": ""}} {{(pid=126594) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 10 18:06:21.393710 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.security_group_api [None req-64739ca2-907c-4506-aee5-9e9cf279d913 tempest-SecurityGroupsNegativeTestJSON-392092015 tempest-SecurityGroupsNegativeTestJSON-392092015-project] Neutron security group 9589aa8d-57e7-4b72-b3de-824a602939a7 not found {{(pid=126594) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 10 18:06:21.394480 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-64739ca2-907c-4506-aee5-9e9cf279d913 tempest-SecurityGroupsNegativeTestJSON-392092015 tempest-SecurityGroupsNegativeTestJSON-392092015-project] HTTP exception thrown: Security group 9589aa8d-57e7-4b72-b3de-824a602939a7 does not exist Jun 10 18:06:21.394480 chdv-master-2 devstack@n-api.service[126594]: Neutron server returns request_ids: ['req-f5f71804-2f02-4b09-af01-05291f62e857'] Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-64739ca2-907c-4506-aee5-9e9cf279d913 tempest-SecurityGroupsNegativeTestJSON-392092015 tempest-SecurityGroupsNegativeTestJSON-392092015-project] Request method failure captured: Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/os-security-groups/9589aa8d-57e7-4b72-b3de-824a602939a7 HTTP/1.1 Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4gZ2rwXeFYEU27LwI_jKNt6gOvY8fnegL5MxVKqaQ_4xS-wd4te849uYkRkbAwsmdUEDqfCatrLfnS7LVUm5GxZ-a-_HZc8Ua9RIWZueoHGFZlfMZqKR7TY7CDM7CdvFMXDd6HEFJRKddpFVrb0acsA80avJsK3y9QEBWFe8hrrkRk Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 8699a77a058541ca8b3388231a63864c Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-392092015 Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/8699a77a058541ca8b3388231a63864c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8699a77a058541ca8b3388231a63864c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8699a77a058541ca8b3388231a63864c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_8699a77a058541ca8b3388231a63864c", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-392092015 Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 8699a77a058541ca8b3388231a63864c Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-392092015 Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-SecurityGroupsNegativeTestJSON-392092015-project Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 8635227495974ac6955305a25d218662 Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-392092015-project Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: exception: Security group 9589aa8d-57e7-4b72-b3de-824a602939a7 does not exist Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: Neutron server returns request_ids: ['req-f5f71804-2f02-4b09-af01-05291f62e857'] Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '9589aa8d-57e7-4b72-b3de-824a602939a7'} Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 10 18:06:21.409999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9589aa8d-57e7-4b72-b3de-824a602939a7 does not exist Jun 10 18:06:21.425565 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5f71804-2f02-4b09-af01-05291f62e857'] Jun 10 18:06:21.425565 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:06:21.425565 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:06:21.425565 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:06:21.425565 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:06:21.425565 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jun 10 18:06:21.425565 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 10 18:06:21.425565 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 10 18:06:21.425565 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 10 18:06:21.425565 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9589aa8d-57e7-4b72-b3de-824a602939a7 does not exist Jun 10 18:06:21.425565 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5f71804-2f02-4b09-af01-05291f62e857'] Jun 10 18:06:21.425565 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:06:21.425565 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:06:21.425565 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:06:21.425565 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:06:21.425565 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:06:21.425565 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:06:21.425565 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:06:21.425565 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:06:21.425565 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:06:21.425565 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:06:21.425565 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:06:21.425565 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:06:21.425565 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jun 10 18:06:21.425565 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 10 18:06:21.425565 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9589aa8d-57e7-4b72-b3de-824a602939a7 does not exist Jun 10 18:06:21.425565 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5f71804-2f02-4b09-af01-05291f62e857'] Jun 10 18:06:21.425565 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:06:21.425565 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:06:21.425565 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:06:21.425565 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:06:21.425565 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:06:21.425565 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:06:21.425565 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:06:21.425565 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:06:21.425565 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9589aa8d-57e7-4b72-b3de-824a602939a7 does not exist Jun 10 18:06:21.425565 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5f71804-2f02-4b09-af01-05291f62e857'] Jun 10 18:06:21.425565 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:06:21.425565 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-64739ca2-907c-4506-aee5-9e9cf279d913 tempest-SecurityGroupsNegativeTestJSON-392092015 tempest-SecurityGroupsNegativeTestJSON-392092015-project] Returning 404 to user: Security group 9589aa8d-57e7-4b72-b3de-824a602939a7 does not exist Jun 10 18:06:21.425565 chdv-master-2 devstack@n-api.service[126594]: Neutron server returns request_ids: ['req-f5f71804-2f02-4b09-af01-05291f62e857'] {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:06:21.425565 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-64739ca2-907c-4506-aee5-9e9cf279d913 tempest-SecurityGroupsNegativeTestJSON-392092015 tempest-SecurityGroupsNegativeTestJSON-392092015-project] 10.222.0.35 "GET /compute/v2.1/os-security-groups/9589aa8d-57e7-4b72-b3de-824a602939a7" status: 404 len: 194 microversion: 2.1 time: 0.058485 Jun 10 18:06:21.425565 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1430/2780] 10.222.0.35 () {58 vars in 1268 bytes} [Fri Jun 10 18:06:21 2022] GET /compute/v2.1/os-security-groups/9589aa8d-57e7-4b72-b3de-824a602939a7 => generated 194 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:06:21.437497 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a46ae38e-e94e-4d77-b5f2-f62c3c62b8fc tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:21.438447 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a46ae38e-e94e-4d77-b5f2-f62c3c62b8fc tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:21.442994 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d1b2a5cc-877d-42e7-8724-8744f209a2c9 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e633cf9c8e3b41f5a538f5937acf00d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142022afade745b9984068f42f0074dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:21.462477 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a46ae38e-e94e-4d77-b5f2-f62c3c62b8fc tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:21.463607 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d1b2a5cc-877d-42e7-8724-8744f209a2c9 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] 10.222.0.35 "GET /compute/v2.1/servers/b8136d11-a591-48c2-ab1a-c17422d326e6" status: 200 len: 1396 microversion: 2.1 time: 0.278012 Jun 10 18:06:21.467390 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a46ae38e-e94e-4d77-b5f2-f62c3c62b8fc tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:21.468733 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1351/2781] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:21 2022] GET /compute/v2.1/servers/b8136d11-a591-48c2-ab1a-c17422d326e6 => generated 1396 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:21.470303 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a46ae38e-e94e-4d77-b5f2-f62c3c62b8fc tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:21.470938 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a46ae38e-e94e-4d77-b5f2-f62c3c62b8fc tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:21.473583 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-634ba3a5-f54b-4290-8972-1758522175df tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c02e31f0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:21.564079 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-634ba3a5-f54b-4290-8972-1758522175df tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df" status: 200 len: 1409 microversion: 2.1 time: 0.090797 Jun 10 18:06:21.565465 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1352/2782] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:06:21 2022] GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df => generated 1409 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:21.583595 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-84e07268-2418-403e-83a9-cf8aa9c3e53a tempest-SecurityGroupsNegativeTestJSON-392092015 tempest-SecurityGroupsNegativeTestJSON-392092015-project] Action: 'update', calling method: .version_select at 0x7f77c02f94c0>, body: {"security_group": {"name": "tempest-sg-1822613767", "description": "tempest-description-271518122"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:06:21.637654 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a46ae38e-e94e-4d77-b5f2-f62c3c62b8fc tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:21.644353 chdv-master-2 devstack@n-api.service[126595]: DEBUG neutronclient.v2_0.client [None req-84e07268-2418-403e-83a9-cf8aa9c3e53a tempest-SecurityGroupsNegativeTestJSON-392092015 tempest-SecurityGroupsNegativeTestJSON-392092015-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ceea742c-a7c5-485d-99ec-40643e1bbc69 does not exist", "detail": ""}} {{(pid=126595) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 10 18:06:21.645029 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.security_group_api [None req-84e07268-2418-403e-83a9-cf8aa9c3e53a tempest-SecurityGroupsNegativeTestJSON-392092015 tempest-SecurityGroupsNegativeTestJSON-392092015-project] Neutron security group ceea742c-a7c5-485d-99ec-40643e1bbc69 not found {{(pid=126595) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 10 18:06:21.646203 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-84e07268-2418-403e-83a9-cf8aa9c3e53a tempest-SecurityGroupsNegativeTestJSON-392092015 tempest-SecurityGroupsNegativeTestJSON-392092015-project] HTTP exception thrown: Security group ceea742c-a7c5-485d-99ec-40643e1bbc69 does not exist Jun 10 18:06:21.646203 chdv-master-2 devstack@n-api.service[126595]: Neutron server returns request_ids: ['req-fbaac9c2-f09e-4de5-bfac-3adac1590d3d'] Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-84e07268-2418-403e-83a9-cf8aa9c3e53a tempest-SecurityGroupsNegativeTestJSON-392092015 tempest-SecurityGroupsNegativeTestJSON-392092015-project] Request method failure captured: Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: request: PUT /compute/v2.1/os-security-groups/ceea742c-a7c5-485d-99ec-40643e1bbc69 HTTP/1.1 Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 101 Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4gZ2rwXeFYEU27LwI_jKNt6gOvY8fnegL5MxVKqaQ_4xS-wd4te849uYkRkbAwsmdUEDqfCatrLfnS7LVUm5GxZ-a-_HZc8Ua9RIWZueoHGFZlfMZqKR7TY7CDM7CdvFMXDd6HEFJRKddpFVrb0acsA80avJsK3y9QEBWFe8hrrkRk Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 8699a77a058541ca8b3388231a63864c Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-392092015 Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/8699a77a058541ca8b3388231a63864c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8699a77a058541ca8b3388231a63864c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8699a77a058541ca8b3388231a63864c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_8699a77a058541ca8b3388231a63864c", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-392092015 Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 8699a77a058541ca8b3388231a63864c Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-392092015 Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-SecurityGroupsNegativeTestJSON-392092015-project Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 8635227495974ac6955305a25d218662 Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-392092015-project Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: {"security_group": {"name": "tempest-sg-1822613767", "description": "tempest-description-271518122"}} Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: exception: Security group ceea742c-a7c5-485d-99ec-40643e1bbc69 does not exist Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: Neutron server returns request_ids: ['req-fbaac9c2-f09e-4de5-bfac-3adac1590d3d'] Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'ceea742c-a7c5-485d-99ec-40643e1bbc69', 'body': {'security_group': {'name': 'tempest-sg-1822613767', 'description': 'tempest-description-271518122'}}} Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 10 18:06:21.648255 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ceea742c-a7c5-485d-99ec-40643e1bbc69 does not exist Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fbaac9c2-f09e-4de5-bfac-3adac1590d3d'] Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ceea742c-a7c5-485d-99ec-40643e1bbc69 does not exist Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fbaac9c2-f09e-4de5-bfac-3adac1590d3d'] Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ceea742c-a7c5-485d-99ec-40643e1bbc69 does not exist Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fbaac9c2-f09e-4de5-bfac-3adac1590d3d'] Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ceea742c-a7c5-485d-99ec-40643e1bbc69 does not exist Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fbaac9c2-f09e-4de5-bfac-3adac1590d3d'] Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-84e07268-2418-403e-83a9-cf8aa9c3e53a tempest-SecurityGroupsNegativeTestJSON-392092015 tempest-SecurityGroupsNegativeTestJSON-392092015-project] Returning 404 to user: Security group ceea742c-a7c5-485d-99ec-40643e1bbc69 does not exist Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: Neutron server returns request_ids: ['req-fbaac9c2-f09e-4de5-bfac-3adac1590d3d'] {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-84e07268-2418-403e-83a9-cf8aa9c3e53a tempest-SecurityGroupsNegativeTestJSON-392092015 tempest-SecurityGroupsNegativeTestJSON-392092015-project] 10.222.0.35 "PUT /compute/v2.1/os-security-groups/ceea742c-a7c5-485d-99ec-40643e1bbc69" status: 404 len: 194 microversion: 2.1 time: 0.074270 Jun 10 18:06:21.660222 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1353/2783] 10.222.0.35 () {60 vars in 1289 bytes} [Fri Jun 10 18:06:21 2022] PUT /compute/v2.1/os-security-groups/ceea742c-a7c5-485d-99ec-40643e1bbc69 => generated 194 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:06:21.670304 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a46ae38e-e94e-4d77-b5f2-f62c3c62b8fc tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058" status: 200 len: 1209 microversion: 2.1 time: 0.239669 Jun 10 18:06:21.670304 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1431/2784] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:21 2022] GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 => generated 1209 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:21.674900 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ff27fe03-9a77-4ebd-aa77-49bdad12918a tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:21.675528 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ff27fe03-9a77-4ebd-aa77-49bdad12918a tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 07afccc2-6b07-4dd4-b9f5-aaa7609f72d1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:21.677797 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1f089e09-7962-4fbb-bf0a-7948e6f0fed8 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:21.678527 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1f089e09-7962-4fbb-bf0a-7948e6f0fed8 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] [instance: 68801152-6e36-4e3e-95b6-e9e6eac3b8c3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:21.688788 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ff27fe03-9a77-4ebd-aa77-49bdad12918a tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:21.690725 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f089e09-7962-4fbb-bf0a-7948e6f0fed8 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:21.691252 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f089e09-7962-4fbb-bf0a-7948e6f0fed8 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:21.691966 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f089e09-7962-4fbb-bf0a-7948e6f0fed8 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:21.693254 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f089e09-7962-4fbb-bf0a-7948e6f0fed8 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:21.696251 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ff27fe03-9a77-4ebd-aa77-49bdad12918a tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:21.697532 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ff27fe03-9a77-4ebd-aa77-49bdad12918a tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:21.698343 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ff27fe03-9a77-4ebd-aa77-49bdad12918a tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:21.765681 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f089e09-7962-4fbb-bf0a-7948e6f0fed8 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:21.766485 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f089e09-7962-4fbb-bf0a-7948e6f0fed8 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:21.767214 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-1f089e09-7962-4fbb-bf0a-7948e6f0fed8 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lazy-loading 'fault' on Instance uuid 68801152-6e36-4e3e-95b6-e9e6eac3b8c3 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:06:21.842416 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1f089e09-7962-4fbb-bf0a-7948e6f0fed8 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8bb9feeac64f588262980fe5052c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834322ffb5f54cff911c2fc52a35e3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:21.850301 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1f089e09-7962-4fbb-bf0a-7948e6f0fed8 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] 10.222.0.35 "GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3" status: 200 len: 1305 microversion: 2.1 time: 0.192419 Jun 10 18:06:21.850880 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1354/2785] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:21 2022] GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3 => generated 1305 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:21.948041 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ff27fe03-9a77-4ebd-aa77-49bdad12918a tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:21.957658 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ff27fe03-9a77-4ebd-aa77-49bdad12918a tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/07afccc2-6b07-4dd4-b9f5-aaa7609f72d1" status: 200 len: 1318 microversion: 2.1 time: 0.286319 Jun 10 18:06:21.958828 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1432/2786] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:21 2022] GET /compute/v2.1/servers/07afccc2-6b07-4dd4-b9f5-aaa7609f72d1 => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:22.143466 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4aa73c35-7b35-419c-afd6-f9d84568d887 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:22.145568 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4aa73c35-7b35-419c-afd6-f9d84568d887 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:22.158744 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4aa73c35-7b35-419c-afd6-f9d84568d887 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:22.159964 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4aa73c35-7b35-419c-afd6-f9d84568d887 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:22.165926 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4aa73c35-7b35-419c-afd6-f9d84568d887 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:22.166940 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4aa73c35-7b35-419c-afd6-f9d84568d887 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:22.282826 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4aa73c35-7b35-419c-afd6-f9d84568d887 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:22.295581 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4aa73c35-7b35-419c-afd6-f9d84568d887 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:22.295757 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4aa73c35-7b35-419c-afd6-f9d84568d887 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:22.297052 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4aa73c35-7b35-419c-afd6-f9d84568d887 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1521 microversion: 2.25 time: 0.157612 Jun 10 18:06:22.298286 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1355/2787] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:06:22 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:06:22.491939 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-163c87d3-6863-4af5-a4da-066b9f274030 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:22.494143 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-163c87d3-6863-4af5-a4da-066b9f274030 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] [instance: b8136d11-a591-48c2-ab1a-c17422d326e6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:22.512539 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-163c87d3-6863-4af5-a4da-066b9f274030 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:22.515851 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-163c87d3-6863-4af5-a4da-066b9f274030 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:22.517958 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-163c87d3-6863-4af5-a4da-066b9f274030 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:22.518667 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-163c87d3-6863-4af5-a4da-066b9f274030 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:22.581153 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ce045ba8-e95d-4565-a3ff-31e63d43ea49 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c0364310>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:22.651330 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ce045ba8-e95d-4565-a3ff-31e63d43ea49 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df" status: 200 len: 1409 microversion: 2.1 time: 0.073892 Jun 10 18:06:22.652633 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1356/2788] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:06:22 2022] GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df => generated 1409 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:22.682905 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-203886a1-fa6e-40cb-8dff-2b2d9c9db1ab tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:22.683954 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-203886a1-fa6e-40cb-8dff-2b2d9c9db1ab tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:22.701316 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-203886a1-fa6e-40cb-8dff-2b2d9c9db1ab tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:22.702186 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-203886a1-fa6e-40cb-8dff-2b2d9c9db1ab tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:22.708970 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-203886a1-fa6e-40cb-8dff-2b2d9c9db1ab tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:22.709750 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-203886a1-fa6e-40cb-8dff-2b2d9c9db1ab tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:22.814630 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-203886a1-fa6e-40cb-8dff-2b2d9c9db1ab tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:22.828958 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-203886a1-fa6e-40cb-8dff-2b2d9c9db1ab tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058" status: 200 len: 1265 microversion: 2.1 time: 0.149787 Jun 10 18:06:22.829822 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1357/2789] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:22 2022] GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:06:22.868633 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ee13098c-fb0a-4abb-817f-d9e552085b72 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:22.869254 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ee13098c-fb0a-4abb-817f-d9e552085b72 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] [instance: 68801152-6e36-4e3e-95b6-e9e6eac3b8c3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:22.877673 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-163c87d3-6863-4af5-a4da-066b9f274030 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e633cf9c8e3b41f5a538f5937acf00d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142022afade745b9984068f42f0074dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:22.883164 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee13098c-fb0a-4abb-817f-d9e552085b72 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:22.883627 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee13098c-fb0a-4abb-817f-d9e552085b72 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:22.886080 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee13098c-fb0a-4abb-817f-d9e552085b72 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:22.886080 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee13098c-fb0a-4abb-817f-d9e552085b72 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:22.888815 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-163c87d3-6863-4af5-a4da-066b9f274030 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] 10.222.0.35 "GET /compute/v2.1/servers/b8136d11-a591-48c2-ab1a-c17422d326e6" status: 200 len: 1396 microversion: 2.1 time: 0.408496 Jun 10 18:06:22.899365 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1433/2790] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:22 2022] GET /compute/v2.1/servers/b8136d11-a591-48c2-ab1a-c17422d326e6 => generated 1396 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:22.911161 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-ee13098c-fb0a-4abb-817f-d9e552085b72 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] HTTP exception thrown: Instance 68801152-6e36-4e3e-95b6-e9e6eac3b8c3 could not be found. Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ee13098c-fb0a-4abb-817f-d9e552085b72 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Request method failure captured: Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3 HTTP/1.1 Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4f4f6oOtBmBhWjsZ_B85j61cP3ykalFsejNhka9teMQUx29b9R0r030QuSzx6i2S3VD7zNnP2KxhQMF56vbrLKDj1U-ReBhdBe6MfNCkBZGUJVNb3H_8yDqvMo2S2fy6Xn0p08PWWN9kJNttfgrV1nojx-oGbupRQZcByqYICJa8fM Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 834322ffb5f54cff911c2fc52a35e3e7 Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServerPasswordTestJSON-2084875613 Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/834322ffb5f54cff911c2fc52a35e3e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/834322ffb5f54cff911c2fc52a35e3e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/834322ffb5f54cff911c2fc52a35e3e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_834322ffb5f54cff911c2fc52a35e3e7", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServerPasswordTestJSON-2084875613 Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 834322ffb5f54cff911c2fc52a35e3e7 Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServerPasswordTestJSON-2084875613 Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServerPasswordTestJSON-2084875613-project Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: de8bb9feeac64f588262980fe5052c96 Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServerPasswordTestJSON-2084875613-project Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 68801152-6e36-4e3e-95b6-e9e6eac3b8c3 could not be found. Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '68801152-6e36-4e3e-95b6-e9e6eac3b8c3'} Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68801152-6e36-4e3e-95b6-e9e6eac3b8c3 could not be found. Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68801152-6e36-4e3e-95b6-e9e6eac3b8c3 could not be found. Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:06:22.914057 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:06:22.920885 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:06:22.920885 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:06:22.920885 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:06:22.920885 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:06:22.920885 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:06:22.920885 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68801152-6e36-4e3e-95b6-e9e6eac3b8c3 could not be found. Jun 10 18:06:22.920885 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:06:22.925162 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ee13098c-fb0a-4abb-817f-d9e552085b72 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] Returning 404 to user: Instance 68801152-6e36-4e3e-95b6-e9e6eac3b8c3 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:06:22.926284 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ee13098c-fb0a-4abb-817f-d9e552085b72 tempest-ServerPasswordTestJSON-2084875613 tempest-ServerPasswordTestJSON-2084875613-project] 10.222.0.35 "GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3" status: 404 len: 111 microversion: 2.1 time: 0.062309 Jun 10 18:06:22.927422 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1358/2791] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:22 2022] GET /compute/v2.1/servers/68801152-6e36-4e3e-95b6-e9e6eac3b8c3 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:06:22.976575 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1bb7f4ce-76f3-471c-a3bf-7014d49e08f1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:22.976575 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1bb7f4ce-76f3-471c-a3bf-7014d49e08f1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 07afccc2-6b07-4dd4-b9f5-aaa7609f72d1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:22.994236 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1bb7f4ce-76f3-471c-a3bf-7014d49e08f1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:22.994597 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1bb7f4ce-76f3-471c-a3bf-7014d49e08f1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:22.996037 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1bb7f4ce-76f3-471c-a3bf-7014d49e08f1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:22.996037 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1bb7f4ce-76f3-471c-a3bf-7014d49e08f1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:23.318558 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-85368a8b-7f60-4ae8-81f9-7055dfa21b20 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:23.320423 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-85368a8b-7f60-4ae8-81f9-7055dfa21b20 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:23.326576 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1bb7f4ce-76f3-471c-a3bf-7014d49e08f1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:23.341863 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1bb7f4ce-76f3-471c-a3bf-7014d49e08f1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/07afccc2-6b07-4dd4-b9f5-aaa7609f72d1" status: 200 len: 1318 microversion: 2.1 time: 0.370388 Jun 10 18:06:23.346456 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-85368a8b-7f60-4ae8-81f9-7055dfa21b20 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:23.347325 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1434/2792] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:22 2022] GET /compute/v2.1/servers/07afccc2-6b07-4dd4-b9f5-aaa7609f72d1 => generated 1318 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:23.351078 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-85368a8b-7f60-4ae8-81f9-7055dfa21b20 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:23.355670 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-85368a8b-7f60-4ae8-81f9-7055dfa21b20 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:23.356218 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-85368a8b-7f60-4ae8-81f9-7055dfa21b20 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:23.371980 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-bb969dff-f293-453a-9b8b-be2ab7514f50 req-d90c8c3f-b0aa-4d36-8deb-2fb33cc15fbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0864d26-b605-4a49-b099-8144ecfde9bc", "name": "network-vif-deleted", "tag": "a5b5e0a1-0a97-4201-97ee-27e27e1763c7"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:06:23.381906 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-bb969dff-f293-453a-9b8b-be2ab7514f50 req-d90c8c3f-b0aa-4d36-8deb-2fb33cc15fbd service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:23.382361 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-bb969dff-f293-453a-9b8b-be2ab7514f50 req-d90c8c3f-b0aa-4d36-8deb-2fb33cc15fbd service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:23.404166 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-bb969dff-f293-453a-9b8b-be2ab7514f50 req-d90c8c3f-b0aa-4d36-8deb-2fb33cc15fbd service nova] Creating event network-vif-deleted:a5b5e0a1-0a97-4201-97ee-27e27e1763c7 for instance a0864d26-b605-4a49-b099-8144ecfde9bc on chh2-master-2 Jun 10 18:06:23.409997 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-bb969dff-f293-453a-9b8b-be2ab7514f50 req-d90c8c3f-b0aa-4d36-8deb-2fb33cc15fbd service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043519 Jun 10 18:06:23.428892 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1435/2793] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:06:23.441381 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-85368a8b-7f60-4ae8-81f9-7055dfa21b20 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:23.442912 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-85368a8b-7f60-4ae8-81f9-7055dfa21b20 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:23.443623 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-85368a8b-7f60-4ae8-81f9-7055dfa21b20 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lazy-loading 'fault' on Instance uuid a0864d26-b605-4a49-b099-8144ecfde9bc {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:06:23.548554 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-85368a8b-7f60-4ae8-81f9-7055dfa21b20 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:23.558612 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-85368a8b-7f60-4ae8-81f9-7055dfa21b20 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:23.573618 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-85368a8b-7f60-4ae8-81f9-7055dfa21b20 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:23.581763 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-85368a8b-7f60-4ae8-81f9-7055dfa21b20 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 200 len: 1351 microversion: 2.25 time: 0.268097 Jun 10 18:06:23.583013 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1359/2794] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:06:23 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 1351 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:06:23.670112 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2c6375ce-8080-4cfe-b407-4dc6befb51ab tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77b3e829d0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:23.746906 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2c6375ce-8080-4cfe-b407-4dc6befb51ab tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df" status: 200 len: 1409 microversion: 2.1 time: 0.084363 Jun 10 18:06:23.747695 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1436/2795] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:06:23 2022] GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df => generated 1409 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:23.847499 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bccac91b-4ce5-4e9b-ab4a-274a65e4d4bf tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:23.849087 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bccac91b-4ce5-4e9b-ab4a-274a65e4d4bf tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:23.858482 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bccac91b-4ce5-4e9b-ab4a-274a65e4d4bf tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:23.861385 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bccac91b-4ce5-4e9b-ab4a-274a65e4d4bf tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:23.863826 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bccac91b-4ce5-4e9b-ab4a-274a65e4d4bf tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:23.865728 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bccac91b-4ce5-4e9b-ab4a-274a65e4d4bf tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:23.907829 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a3075c5c-1e7b-463f-9373-b5cfb0fb282b tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:23.909274 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a3075c5c-1e7b-463f-9373-b5cfb0fb282b tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] [instance: b8136d11-a591-48c2-ab1a-c17422d326e6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:23.938263 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3075c5c-1e7b-463f-9373-b5cfb0fb282b tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:23.948427 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3075c5c-1e7b-463f-9373-b5cfb0fb282b tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:23.949415 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3075c5c-1e7b-463f-9373-b5cfb0fb282b tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:23.956765 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3075c5c-1e7b-463f-9373-b5cfb0fb282b tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:24.092159 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bccac91b-4ce5-4e9b-ab4a-274a65e4d4bf tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:24.108716 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bccac91b-4ce5-4e9b-ab4a-274a65e4d4bf tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058" status: 200 len: 1283 microversion: 2.1 time: 0.265659 Jun 10 18:06:24.111062 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1360/2796] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:23 2022] GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 => generated 1283 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:24.122129 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-e9d88dd2-529f-4b8a-b215-0dfe126ee197 req-3529464e-ba4d-438f-a0cc-80e5d8ed8053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05c9cadb-1823-4e2c-9c9f-c3be6892e074", "name": "network-vif-plugged", "status": "completed", "tag": "8be362a0-24f5-47ff-977c-3dac2ced769c"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:06:24.142526 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-e9d88dd2-529f-4b8a-b215-0dfe126ee197 req-3529464e-ba4d-438f-a0cc-80e5d8ed8053 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:24.144057 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-e9d88dd2-529f-4b8a-b215-0dfe126ee197 req-3529464e-ba4d-438f-a0cc-80e5d8ed8053 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:24.174494 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-e9d88dd2-529f-4b8a-b215-0dfe126ee197 req-3529464e-ba4d-438f-a0cc-80e5d8ed8053 service nova] Creating event network-vif-plugged:8be362a0-24f5-47ff-977c-3dac2ced769c for instance 05c9cadb-1823-4e2c-9c9f-c3be6892e074 on chh2-master-2 Jun 10 18:06:24.187854 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-e9d88dd2-529f-4b8a-b215-0dfe126ee197 req-3529464e-ba4d-438f-a0cc-80e5d8ed8053 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074226 Jun 10 18:06:24.190553 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1361/2797] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:06:24.367957 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-906e691a-7a0e-47d6-8d8e-3e4d868cb1e4 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:24.370222 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-906e691a-7a0e-47d6-8d8e-3e4d868cb1e4 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 07afccc2-6b07-4dd4-b9f5-aaa7609f72d1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:24.374895 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:06:24.379532 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-906e691a-7a0e-47d6-8d8e-3e4d868cb1e4 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:24.380936 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-906e691a-7a0e-47d6-8d8e-3e4d868cb1e4 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:24.382131 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-906e691a-7a0e-47d6-8d8e-3e4d868cb1e4 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:24.382795 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-906e691a-7a0e-47d6-8d8e-3e4d868cb1e4 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:24.667664 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a3075c5c-1e7b-463f-9373-b5cfb0fb282b tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e633cf9c8e3b41f5a538f5937acf00d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142022afade745b9984068f42f0074dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:24.685377 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a3075c5c-1e7b-463f-9373-b5cfb0fb282b tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] 10.222.0.35 "GET /compute/v2.1/servers/b8136d11-a591-48c2-ab1a-c17422d326e6" status: 200 len: 1396 microversion: 2.1 time: 0.782245 Jun 10 18:06:24.685958 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1437/2798] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:23 2022] GET /compute/v2.1/servers/b8136d11-a591-48c2-ab1a-c17422d326e6 => generated 1396 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:06:24.690868 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-82504254-537d-4765-9c80-a75153a296b4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:24.691690 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-82504254-537d-4765-9c80-a75153a296b4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: a0864d26-b605-4a49-b099-8144ecfde9bc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:24.709437 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-82504254-537d-4765-9c80-a75153a296b4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:24.710497 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-82504254-537d-4765-9c80-a75153a296b4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:24.711292 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-82504254-537d-4765-9c80-a75153a296b4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:24.711741 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-82504254-537d-4765-9c80-a75153a296b4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:24.740826 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-82504254-537d-4765-9c80-a75153a296b4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] HTTP exception thrown: Instance a0864d26-b605-4a49-b099-8144ecfde9bc could not be found. Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-82504254-537d-4765-9c80-a75153a296b4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Request method failure captured: Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc HTTP/1.1 Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4aT7ZDtNgTD7bsmYg0DE4dyYI9hyVzTZoZn9JI8KjDdIMYIYOEOs1GqGLwiSWpMtOdIMlu8m1zLYUoQ6fx9aFNAP5QDfQMHsPjHdlUVi6e06F5VDYuGHApQQa7pMTSMkgvakVsQiAjjkkHaFoPrh5IDgK4RE6k56aeo5c-ALWlmr6Q Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: X-Openstack-Nova-Api-Version: 2.25 Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 01ee7bcfe44746fda89fda904f81e1b9 Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-306431913 Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/01ee7bcfe44746fda89fda904f81e1b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/01ee7bcfe44746fda89fda904f81e1b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/01ee7bcfe44746fda89fda904f81e1b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_01ee7bcfe44746fda89fda904f81e1b9", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-306431913 Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 01ee7bcfe44746fda89fda904f81e1b9 Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-306431913 Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-LiveAutoBlockMigrationV225Test-306431913-project Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: d4967895f6f041058ef60cee35a3659c Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-306431913-project Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: exception: Instance a0864d26-b605-4a49-b099-8144ecfde9bc could not be found. Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'a0864d26-b605-4a49-b099-8144ecfde9bc'} Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0864d26-b605-4a49-b099-8144ecfde9bc could not be found. Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0864d26-b605-4a49-b099-8144ecfde9bc could not be found. Jun 10 18:06:24.742542 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:06:24.751137 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:06:24.751137 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:06:24.751137 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:06:24.751137 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:06:24.751137 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:06:24.751137 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:06:24.751137 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:06:24.751137 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0864d26-b605-4a49-b099-8144ecfde9bc could not be found. Jun 10 18:06:24.751137 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:06:24.751137 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-82504254-537d-4765-9c80-a75153a296b4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Returning 404 to user: Instance a0864d26-b605-4a49-b099-8144ecfde9bc could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:06:24.751137 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-82504254-537d-4765-9c80-a75153a296b4 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc" status: 404 len: 111 microversion: 2.25 time: 0.056871 Jun 10 18:06:24.751137 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1438/2799] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:06:24 2022] GET /compute/v2.1/servers/a0864d26-b605-4a49-b099-8144ecfde9bc => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:06:24.763532 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-53d7aacb-1745-4bf5-927f-c5dd21a92187 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:24.764165 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-53d7aacb-1745-4bf5-927f-c5dd21a92187 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f5230492-7afa-4202-82ed-1df1cacd2605] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:24.771370 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-53d7aacb-1745-4bf5-927f-c5dd21a92187 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:24.771847 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-53d7aacb-1745-4bf5-927f-c5dd21a92187 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:24.772646 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-53d7aacb-1745-4bf5-927f-c5dd21a92187 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:24.773095 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-53d7aacb-1745-4bf5-927f-c5dd21a92187 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:24.777460 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:06:24.834962 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-53d7aacb-1745-4bf5-927f-c5dd21a92187 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f5230492-7afa-4202-82ed-1df1cacd2605] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:06:25.225676 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-53d7aacb-1745-4bf5-927f-c5dd21a92187 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "DELETE /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605" status: 204 len: 0 microversion: 2.25 time: 0.476656 Jun 10 18:06:25.226548 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1439/2800] 10.222.0.35 () {60 vars in 1279 bytes} [Fri Jun 10 18:06:24 2022] DELETE /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 10 18:06:25.232150 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a54de559-92f1-4701-af3c-c12967277e18 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77b3f51c10>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:25.319082 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a54de559-92f1-4701-af3c-c12967277e18 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df" status: 200 len: 1409 microversion: 2.1 time: 0.090767 Jun 10 18:06:25.319679 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1440/2801] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:06:25 2022] GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df => generated 1409 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:25.341641 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1e7bdca6-0de8-41b9-9733-095cdc011af1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:25.342403 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1e7bdca6-0de8-41b9-9733-095cdc011af1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:25.379328 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1e7bdca6-0de8-41b9-9733-095cdc011af1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:25.381679 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1e7bdca6-0de8-41b9-9733-095cdc011af1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:25.382508 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1e7bdca6-0de8-41b9-9733-095cdc011af1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:25.382968 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1e7bdca6-0de8-41b9-9733-095cdc011af1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:25.549626 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1e7bdca6-0de8-41b9-9733-095cdc011af1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:25.588338 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1e7bdca6-0de8-41b9-9733-095cdc011af1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058" status: 200 len: 1271 microversion: 2.1 time: 0.265233 Jun 10 18:06:25.602408 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1441/2802] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:25 2022] GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 => generated 1271 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:25.615771 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-11808161-7cb5-451f-98ca-55b0b94d2043 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:25.616151 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-906e691a-7a0e-47d6-8d8e-3e4d868cb1e4 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:25.617317 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-11808161-7cb5-451f-98ca-55b0b94d2043 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f5230492-7afa-4202-82ed-1df1cacd2605] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:25.634703 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-906e691a-7a0e-47d6-8d8e-3e4d868cb1e4 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/07afccc2-6b07-4dd4-b9f5-aaa7609f72d1" status: 200 len: 1318 microversion: 2.1 time: 1.272543 Jun 10 18:06:25.636654 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-11808161-7cb5-451f-98ca-55b0b94d2043 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:25.637429 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-11808161-7cb5-451f-98ca-55b0b94d2043 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:25.637587 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1362/2803] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:24 2022] GET /compute/v2.1/servers/07afccc2-6b07-4dd4-b9f5-aaa7609f72d1 => generated 1318 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:25.641464 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-11808161-7cb5-451f-98ca-55b0b94d2043 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:25.642390 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-11808161-7cb5-451f-98ca-55b0b94d2043 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:25.704798 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f799c423-ecad-4dbc-af32-eafddbbc91a0 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:25.728673 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f799c423-ecad-4dbc-af32-eafddbbc91a0 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] [instance: b8136d11-a591-48c2-ab1a-c17422d326e6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:25.728673 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f799c423-ecad-4dbc-af32-eafddbbc91a0 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:25.728673 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f799c423-ecad-4dbc-af32-eafddbbc91a0 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:25.728673 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f799c423-ecad-4dbc-af32-eafddbbc91a0 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:25.742216 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f799c423-ecad-4dbc-af32-eafddbbc91a0 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:25.965942 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-11808161-7cb5-451f-98ca-55b0b94d2043 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:25.983900 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-11808161-7cb5-451f-98ca-55b0b94d2043 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:25.989760 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-11808161-7cb5-451f-98ca-55b0b94d2043 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:25.994792 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-11808161-7cb5-451f-98ca-55b0b94d2043 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605" status: 200 len: 1549 microversion: 2.25 time: 0.390792 Jun 10 18:06:26.000044 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1442/2804] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:06:25 2022] GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605 => generated 1549 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:06:26.216119 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-3060da1a-1252-4a9b-bd62-98283b96c0cb req-bebc5368-2620-43ac-8798-70ad71cccf79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07afccc2-6b07-4dd4-b9f5-aaa7609f72d1", "name": "network-vif-plugged", "status": "completed", "tag": "5f3d7a05-ae18-47e6-b31b-ac40d7700ec1"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:06:26.221016 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:06:26.234697 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-3060da1a-1252-4a9b-bd62-98283b96c0cb req-bebc5368-2620-43ac-8798-70ad71cccf79 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:26.235848 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-3060da1a-1252-4a9b-bd62-98283b96c0cb req-bebc5368-2620-43ac-8798-70ad71cccf79 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:26.260265 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-3060da1a-1252-4a9b-bd62-98283b96c0cb req-bebc5368-2620-43ac-8798-70ad71cccf79 service nova] Creating event network-vif-plugged:5f3d7a05-ae18-47e6-b31b-ac40d7700ec1 for instance 07afccc2-6b07-4dd4-b9f5-aaa7609f72d1 on chh2-master-2 Jun 10 18:06:26.277894 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f799c423-ecad-4dbc-af32-eafddbbc91a0 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e633cf9c8e3b41f5a538f5937acf00d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142022afade745b9984068f42f0074dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:26.285701 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-3060da1a-1252-4a9b-bd62-98283b96c0cb req-bebc5368-2620-43ac-8798-70ad71cccf79 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073970 Jun 10 18:06:26.287524 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1443/2805] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:06:26.295430 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f799c423-ecad-4dbc-af32-eafddbbc91a0 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] 10.222.0.35 "GET /compute/v2.1/servers/b8136d11-a591-48c2-ab1a-c17422d326e6" status: 200 len: 1396 microversion: 2.1 time: 0.593374 Jun 10 18:06:26.295430 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1363/2806] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:25 2022] GET /compute/v2.1/servers/b8136d11-a591-48c2-ab1a-c17422d326e6 => generated 1396 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:06:26.335748 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1f6d168d-5d9f-4d59-9fad-78c6c0d828bb tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c0cc6d30>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:26.400299 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1f6d168d-5d9f-4d59-9fad-78c6c0d828bb tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df" status: 200 len: 1409 microversion: 2.1 time: 0.069611 Jun 10 18:06:26.400914 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1444/2807] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:06:26 2022] GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df => generated 1409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:26.610831 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c0ec806c-c3e2-4ebb-8244-14a9f1ed70c6 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:26.611721 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c0ec806c-c3e2-4ebb-8244-14a9f1ed70c6 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:26.624811 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c0ec806c-c3e2-4ebb-8244-14a9f1ed70c6 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:26.625560 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c0ec806c-c3e2-4ebb-8244-14a9f1ed70c6 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:26.628030 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c0ec806c-c3e2-4ebb-8244-14a9f1ed70c6 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:26.628495 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c0ec806c-c3e2-4ebb-8244-14a9f1ed70c6 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:26.654309 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6a4a9f13-0997-4fc4-84d5-d4d3628f2016 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:26.655074 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6a4a9f13-0997-4fc4-84d5-d4d3628f2016 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 07afccc2-6b07-4dd4-b9f5-aaa7609f72d1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:26.671408 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6a4a9f13-0997-4fc4-84d5-d4d3628f2016 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:26.671892 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6a4a9f13-0997-4fc4-84d5-d4d3628f2016 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:26.672755 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6a4a9f13-0997-4fc4-84d5-d4d3628f2016 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:26.673205 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6a4a9f13-0997-4fc4-84d5-d4d3628f2016 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:26.990224 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6a4a9f13-0997-4fc4-84d5-d4d3628f2016 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:27.002243 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6a4a9f13-0997-4fc4-84d5-d4d3628f2016 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/07afccc2-6b07-4dd4-b9f5-aaa7609f72d1" status: 200 len: 1318 microversion: 2.1 time: 0.352190 Jun 10 18:06:27.005302 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1445/2808] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:26 2022] GET /compute/v2.1/servers/07afccc2-6b07-4dd4-b9f5-aaa7609f72d1 => generated 1318 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:27.023505 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d5d386d6-8486-4f3f-8b0d-15273b062034 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:27.024354 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d5d386d6-8486-4f3f-8b0d-15273b062034 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f5230492-7afa-4202-82ed-1df1cacd2605] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:27.034456 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d5d386d6-8486-4f3f-8b0d-15273b062034 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:27.034934 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d5d386d6-8486-4f3f-8b0d-15273b062034 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:27.035974 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d5d386d6-8486-4f3f-8b0d-15273b062034 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:27.036688 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d5d386d6-8486-4f3f-8b0d-15273b062034 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:27.294293 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d5d386d6-8486-4f3f-8b0d-15273b062034 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:27.312569 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c0ec806c-c3e2-4ebb-8244-14a9f1ed70c6 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:27.327013 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d5d386d6-8486-4f3f-8b0d-15273b062034 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:27.328215 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c0ec806c-c3e2-4ebb-8244-14a9f1ed70c6 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058" status: 200 len: 1313 microversion: 2.1 time: 0.721663 Jun 10 18:06:27.331970 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d5d386d6-8486-4f3f-8b0d-15273b062034 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:27.333066 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1364/2809] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:26 2022] GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 => generated 1313 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:27.335510 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d5d386d6-8486-4f3f-8b0d-15273b062034 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605" status: 200 len: 1549 microversion: 2.25 time: 0.317884 Jun 10 18:06:27.338930 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1446/2810] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:06:27 2022] GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605 => generated 1549 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:06:27.352982 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dac51711-ed49-45fc-b403-5242596883b4 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:27.354691 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dac51711-ed49-45fc-b403-5242596883b4 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] [instance: b8136d11-a591-48c2-ab1a-c17422d326e6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:27.370520 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dac51711-ed49-45fc-b403-5242596883b4 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:27.371283 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dac51711-ed49-45fc-b403-5242596883b4 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:27.372262 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dac51711-ed49-45fc-b403-5242596883b4 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:27.373004 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dac51711-ed49-45fc-b403-5242596883b4 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:27.414119 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-71b5a7ac-19a3-4ab7-a7c9-c6d9c72b2247 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c0cc6af0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:27.442304 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:06:27.469243 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-71b5a7ac-19a3-4ab7-a7c9-c6d9c72b2247 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df" status: 200 len: 1409 microversion: 2.1 time: 0.059304 Jun 10 18:06:27.479691 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1447/2811] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:06:27 2022] GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df => generated 1409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:06:27.806556 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-dac51711-ed49-45fc-b403-5242596883b4 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e633cf9c8e3b41f5a538f5937acf00d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142022afade745b9984068f42f0074dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:27.829924 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dac51711-ed49-45fc-b403-5242596883b4 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] 10.222.0.35 "GET /compute/v2.1/servers/b8136d11-a591-48c2-ab1a-c17422d326e6" status: 200 len: 1396 microversion: 2.1 time: 0.495722 Jun 10 18:06:27.859313 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1365/2812] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:27 2022] GET /compute/v2.1/servers/b8136d11-a591-48c2-ab1a-c17422d326e6 => generated 1396 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:28.023652 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f5169935-610c-4748-8d8c-fd8d24b639bb tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:28.024277 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f5169935-610c-4748-8d8c-fd8d24b639bb tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 07afccc2-6b07-4dd4-b9f5-aaa7609f72d1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:28.030749 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f5169935-610c-4748-8d8c-fd8d24b639bb tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:28.032487 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f5169935-610c-4748-8d8c-fd8d24b639bb tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:28.033359 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f5169935-610c-4748-8d8c-fd8d24b639bb tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:28.033890 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f5169935-610c-4748-8d8c-fd8d24b639bb tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:28.035579 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=6 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:06:28.187464 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-82c17fbf-7eea-4407-83d4-a0d9e4333356 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-84605646", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": "none"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:06:28.248176 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-82c17fbf-7eea-4407-83d4-a0d9e4333356 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:06:28.248707 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-82c17fbf-7eea-4407-83d4-a0d9e4333356 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:06:28.249290 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-82c17fbf-7eea-4407-83d4-a0d9e4333356 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:06:28.249932 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-82c17fbf-7eea-4407-83d4-a0d9e4333356 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:06:28.250535 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-82c17fbf-7eea-4407-83d4-a0d9e4333356 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:06:28.258286 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f5169935-610c-4748-8d8c-fd8d24b639bb tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:28.262978 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-82c17fbf-7eea-4407-83d4-a0d9e4333356 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:28.263461 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-82c17fbf-7eea-4407-83d4-a0d9e4333356 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:28.264484 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-82c17fbf-7eea-4407-83d4-a0d9e4333356 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:28.264928 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-82c17fbf-7eea-4407-83d4-a0d9e4333356 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:28.267366 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f5169935-610c-4748-8d8c-fd8d24b639bb tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/07afccc2-6b07-4dd4-b9f5-aaa7609f72d1" status: 200 len: 1318 microversion: 2.1 time: 0.248778 Jun 10 18:06:28.268219 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1366/2813] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:28 2022] GET /compute/v2.1/servers/07afccc2-6b07-4dd4-b9f5-aaa7609f72d1 => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:06:28.274010 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-463af81e-f2a6-4b58-a1e8-6d6a7fc135e5 req-506779fd-de4a-404f-9351-24af8f590781 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5230492-7afa-4202-82ed-1df1cacd2605", "name": "network-vif-deleted", "tag": "12fa01a2-8605-49e5-baff-4c9c0392af50"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:06:28.284184 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-463af81e-f2a6-4b58-a1e8-6d6a7fc135e5 req-506779fd-de4a-404f-9351-24af8f590781 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:28.284880 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-463af81e-f2a6-4b58-a1e8-6d6a7fc135e5 req-506779fd-de4a-404f-9351-24af8f590781 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:28.286828 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-82c17fbf-7eea-4407-83d4-a0d9e4333356 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Getting quotas for project 6a06e5e6218a4b5a9ac106fd7a81067a. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:06:28.293127 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-82c17fbf-7eea-4407-83d4-a0d9e4333356 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Getting quotas for user f619bd3c4e5245de9013a516a347a1ee and project 6a06e5e6218a4b5a9ac106fd7a81067a. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:06:28.298429 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-463af81e-f2a6-4b58-a1e8-6d6a7fc135e5 req-506779fd-de4a-404f-9351-24af8f590781 service nova] Creating event network-vif-deleted:12fa01a2-8605-49e5-baff-4c9c0392af50 for instance f5230492-7afa-4202-82ed-1df1cacd2605 on chh2-master-2 Jun 10 18:06:28.305533 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=50 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:06:28.309778 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-463af81e-f2a6-4b58-a1e8-6d6a7fc135e5 req-506779fd-de4a-404f-9351-24af8f590781 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039298 Jun 10 18:06:28.310996 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1367/2814] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:06:28.327475 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-82c17fbf-7eea-4407-83d4-a0d9e4333356 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:06:28.330741 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-82c17fbf-7eea-4407-83d4-a0d9e4333356 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 44dd88e0-99b5-4d16-8dc7-ae488ab4f44c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:06:28.344124 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-29e0fa21-b4ab-48fc-a3be-b101561365ec tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:28.357456 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-29e0fa21-b4ab-48fc-a3be-b101561365ec tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:28.357456 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-29e0fa21-b4ab-48fc-a3be-b101561365ec tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:28.357456 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-29e0fa21-b4ab-48fc-a3be-b101561365ec tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:28.357456 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-29e0fa21-b4ab-48fc-a3be-b101561365ec tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:28.357456 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-29e0fa21-b4ab-48fc-a3be-b101561365ec tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:28.534415 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-82c17fbf-7eea-4407-83d4-a0d9e4333356 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.520519 Jun 10 18:06:28.542274 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1448/2815] 10.222.0.35 () {62 vars in 1187 bytes} [Fri Jun 10 18:06:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 10 18:06:28.548208 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cd511325-af83-41b8-ae0b-898fe146653c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:28.549321 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cd511325-af83-41b8-ae0b-898fe146653c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f5230492-7afa-4202-82ed-1df1cacd2605] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:28.558684 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cd511325-af83-41b8-ae0b-898fe146653c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:28.559936 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cd511325-af83-41b8-ae0b-898fe146653c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:28.561177 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cd511325-af83-41b8-ae0b-898fe146653c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:28.561877 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cd511325-af83-41b8-ae0b-898fe146653c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:28.585732 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-29e0fa21-b4ab-48fc-a3be-b101561365ec tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:28.596451 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-29e0fa21-b4ab-48fc-a3be-b101561365ec tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058" status: 200 len: 1334 microversion: 2.1 time: 0.256474 Jun 10 18:06:28.598805 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1368/2816] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:28 2022] GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 => generated 1334 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:28.608332 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6f9abe39-6c58-4ff7-8bbe-5e374b728682 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c0301550>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:28.679645 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6f9abe39-6c58-4ff7-8bbe-5e374b728682 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df" status: 200 len: 1418 microversion: 2.1 time: 0.079375 Jun 10 18:06:28.680339 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1369/2817] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:06:28 2022] GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df => generated 1418 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:28.691537 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2ff60343-e7ec-4bd9-a7a4-c9517e709453 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:28.698258 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2ff60343-e7ec-4bd9-a7a4-c9517e709453 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 44dd88e0-99b5-4d16-8dc7-ae488ab4f44c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:28.705232 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cd511325-af83-41b8-ae0b-898fe146653c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:28.714462 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cd511325-af83-41b8-ae0b-898fe146653c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:28.716142 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cd511325-af83-41b8-ae0b-898fe146653c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:28.717470 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cd511325-af83-41b8-ae0b-898fe146653c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605" status: 200 len: 1332 microversion: 2.25 time: 0.173652 Jun 10 18:06:28.734609 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1449/2818] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:06:28 2022] GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605 => generated 1332 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:06:28.740502 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9bf5eaaa-5dbd-4dd2-8a16-25055e9f6d3d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c030cca0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:28.800565 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2ff60343-e7ec-4bd9-a7a4-c9517e709453 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:28.805873 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9bf5eaaa-5dbd-4dd2-8a16-25055e9f6d3d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df" status: 200 len: 1418 microversion: 2.1 time: 0.069788 Jun 10 18:06:28.811774 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2ff60343-e7ec-4bd9-a7a4-c9517e709453 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:28.813671 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1450/2819] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:06:28 2022] GET /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df => generated 1418 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:28.814162 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2ff60343-e7ec-4bd9-a7a4-c9517e709453 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:28.818860 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2ff60343-e7ec-4bd9-a7a4-c9517e709453 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/44dd88e0-99b5-4d16-8dc7-ae488ab4f44c" status: 200 len: 1276 microversion: 2.47 time: 0.127668 Jun 10 18:06:28.818860 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1370/2820] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:06:28 2022] GET /compute/v2.1/servers/44dd88e0-99b5-4d16-8dc7-ae488ab4f44c => generated 1276 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:06:28.819916 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a4a27e6a-e473-4264-8634-f8789fe1798b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c0cc64c0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:28.853302 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-39b413b8-d62d-4d06-984e-f56ec2f7e481 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:28.853302 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-39b413b8-d62d-4d06-984e-f56ec2f7e481 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] [instance: b8136d11-a591-48c2-ab1a-c17422d326e6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:28.857262 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-39b413b8-d62d-4d06-984e-f56ec2f7e481 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:28.858058 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-39b413b8-d62d-4d06-984e-f56ec2f7e481 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:28.859035 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-39b413b8-d62d-4d06-984e-f56ec2f7e481 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:28.859880 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-39b413b8-d62d-4d06-984e-f56ec2f7e481 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:29.156913 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-39b413b8-d62d-4d06-984e-f56ec2f7e481 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e633cf9c8e3b41f5a538f5937acf00d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142022afade745b9984068f42f0074dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:29.166112 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-39b413b8-d62d-4d06-984e-f56ec2f7e481 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] 10.222.0.35 "GET /compute/v2.1/servers/b8136d11-a591-48c2-ab1a-c17422d326e6" status: 200 len: 1396 microversion: 2.1 time: 0.321649 Jun 10 18:06:29.166713 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1371/2821] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:28 2022] GET /compute/v2.1/servers/b8136d11-a591-48c2-ab1a-c17422d326e6 => generated 1396 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:06:29.191316 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-12d2bf9d-1208-409a-bf34-5149ce9e3a7a tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-2020030854", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": "none"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:06:29.254842 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-12d2bf9d-1208-409a-bf34-5149ce9e3a7a tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:06:29.255447 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-12d2bf9d-1208-409a-bf34-5149ce9e3a7a tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:06:29.255917 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-12d2bf9d-1208-409a-bf34-5149ce9e3a7a tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:06:29.256591 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-12d2bf9d-1208-409a-bf34-5149ce9e3a7a tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:06:29.257035 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-12d2bf9d-1208-409a-bf34-5149ce9e3a7a tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:06:29.267672 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-12d2bf9d-1208-409a-bf34-5149ce9e3a7a tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:29.268118 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-12d2bf9d-1208-409a-bf34-5149ce9e3a7a tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:29.268952 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-12d2bf9d-1208-409a-bf34-5149ce9e3a7a tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:29.269413 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-12d2bf9d-1208-409a-bf34-5149ce9e3a7a tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:29.288792 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-12d2bf9d-1208-409a-bf34-5149ce9e3a7a tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Getting quotas for project 6a06e5e6218a4b5a9ac106fd7a81067a. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:06:29.293983 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-12d2bf9d-1208-409a-bf34-5149ce9e3a7a tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Getting quotas for user f619bd3c4e5245de9013a516a347a1ee and project 6a06e5e6218a4b5a9ac106fd7a81067a. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:06:29.315323 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-12d2bf9d-1208-409a-bf34-5149ce9e3a7a tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:06:29.315323 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-12d2bf9d-1208-409a-bf34-5149ce9e3a7a tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:06:29.475685 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-12d2bf9d-1208-409a-bf34-5149ce9e3a7a tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.303386 Jun 10 18:06:29.477773 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1372/2822] 10.222.0.35 () {62 vars in 1187 bytes} [Fri Jun 10 18:06:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 306 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 10 18:06:29.498053 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c928beef-1030-45dd-b642-a8cd552bfb68 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:29.498708 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c928beef-1030-45dd-b642-a8cd552bfb68 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 07afccc2-6b07-4dd4-b9f5-aaa7609f72d1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:29.508620 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c928beef-1030-45dd-b642-a8cd552bfb68 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:29.509078 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c928beef-1030-45dd-b642-a8cd552bfb68 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:29.510688 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c928beef-1030-45dd-b642-a8cd552bfb68 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:29.511170 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c928beef-1030-45dd-b642-a8cd552bfb68 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:29.804578 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c928beef-1030-45dd-b642-a8cd552bfb68 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:29.814127 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c928beef-1030-45dd-b642-a8cd552bfb68 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/07afccc2-6b07-4dd4-b9f5-aaa7609f72d1" status: 200 len: 1468 microversion: 2.1 time: 0.335282 Jun 10 18:06:29.815039 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1373/2823] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:29 2022] GET /compute/v2.1/servers/07afccc2-6b07-4dd4-b9f5-aaa7609f72d1 => generated 1468 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:29.821175 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-70c5a395-196d-435b-92c7-83c8b97175c2 req-dee3f671-9fdd-41bd-88e0-8d608a3b6a7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8136d11-a591-48c2-ab1a-c17422d326e6", "name": "network-vif-plugged", "status": "completed", "tag": "2b19c5f3-6d53-4f1e-ab63-c786eef0c74e"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:06:29.829808 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-70c5a395-196d-435b-92c7-83c8b97175c2 req-dee3f671-9fdd-41bd-88e0-8d608a3b6a7e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:29.830263 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-70c5a395-196d-435b-92c7-83c8b97175c2 req-dee3f671-9fdd-41bd-88e0-8d608a3b6a7e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:29.847381 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-70c5a395-196d-435b-92c7-83c8b97175c2 req-dee3f671-9fdd-41bd-88e0-8d608a3b6a7e service nova] Creating event network-vif-plugged:2b19c5f3-6d53-4f1e-ab63-c786eef0c74e for instance b8136d11-a591-48c2-ab1a-c17422d326e6 on chh1-master-2 Jun 10 18:06:29.854757 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-70c5a395-196d-435b-92c7-83c8b97175c2 req-dee3f671-9fdd-41bd-88e0-8d608a3b6a7e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038389 Jun 10 18:06:29.855563 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1374/2824] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:06:29.862087 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-182475ac-10d6-44f9-8acb-76a655c06205 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:06:29.863955 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-182475ac-10d6-44f9-8acb-76a655c06205 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:29.934622 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-182475ac-10d6-44f9-8acb-76a655c06205 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "PUT /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30" status: 200 len: 992 microversion: 2.47 time: 0.077379 Jun 10 18:06:29.936032 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1375/2825] 10.222.0.35 () {62 vars in 1296 bytes} [Fri Jun 10 18:06:29 2022] PUT /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30 => generated 992 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:06:29.942828 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7968f0b8-4689-464f-8e59-734940dccbf2 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:29.943719 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7968f0b8-4689-464f-8e59-734940dccbf2 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:29.960839 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7968f0b8-4689-464f-8e59-734940dccbf2 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:29.964398 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7968f0b8-4689-464f-8e59-734940dccbf2 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:29.965326 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7968f0b8-4689-464f-8e59-734940dccbf2 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:29.966032 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7968f0b8-4689-464f-8e59-734940dccbf2 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:29.971855 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:06:30.297133 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7968f0b8-4689-464f-8e59-734940dccbf2 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:30.310172 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7968f0b8-4689-464f-8e59-734940dccbf2 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058" status: 200 len: 1355 microversion: 2.1 time: 0.372430 Jun 10 18:06:30.319686 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1376/2826] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:29 2022] GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 => generated 1355 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:30.326917 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9979e90c-50b8-40e7-a482-0ab364244576 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:30.327543 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9979e90c-50b8-40e7-a482-0ab364244576 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: f5230492-7afa-4202-82ed-1df1cacd2605] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:30.352417 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9979e90c-50b8-40e7-a482-0ab364244576 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:30.353217 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9979e90c-50b8-40e7-a482-0ab364244576 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:30.355126 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9979e90c-50b8-40e7-a482-0ab364244576 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:30.355583 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9979e90c-50b8-40e7-a482-0ab364244576 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:30.378871 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-9979e90c-50b8-40e7-a482-0ab364244576 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] HTTP exception thrown: Instance f5230492-7afa-4202-82ed-1df1cacd2605 could not be found. Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9979e90c-50b8-40e7-a482-0ab364244576 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Request method failure captured: Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605 HTTP/1.1 Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4aT7ZDtNgTD7bsmYg0DE4dyYI9hyVzTZoZn9JI8KjDdIMYIYOEOs1GqGLwiSWpMtOdIMlu8m1zLYUoQ6fx9aFNAP5QDfQMHsPjHdlUVi6e06F5VDYuGHApQQa7pMTSMkgvakVsQiAjjkkHaFoPrh5IDgK4RE6k56aeo5c-ALWlmr6Q Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: X-Openstack-Nova-Api-Version: 2.25 Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 01ee7bcfe44746fda89fda904f81e1b9 Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-306431913 Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/01ee7bcfe44746fda89fda904f81e1b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/01ee7bcfe44746fda89fda904f81e1b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/01ee7bcfe44746fda89fda904f81e1b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_01ee7bcfe44746fda89fda904f81e1b9", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-306431913 Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 01ee7bcfe44746fda89fda904f81e1b9 Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-306431913 Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-LiveAutoBlockMigrationV225Test-306431913-project Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: d4967895f6f041058ef60cee35a3659c Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-306431913-project Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: exception: Instance f5230492-7afa-4202-82ed-1df1cacd2605 could not be found. Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'f5230492-7afa-4202-82ed-1df1cacd2605'} Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5230492-7afa-4202-82ed-1df1cacd2605 could not be found. Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5230492-7afa-4202-82ed-1df1cacd2605 could not be found. Jun 10 18:06:30.380642 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:06:30.390110 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:06:30.390110 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:06:30.390110 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:06:30.390110 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:06:30.390110 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:06:30.390110 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:06:30.390110 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:06:30.390110 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5230492-7afa-4202-82ed-1df1cacd2605 could not be found. Jun 10 18:06:30.390110 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:06:30.390110 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9979e90c-50b8-40e7-a482-0ab364244576 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Returning 404 to user: Instance f5230492-7afa-4202-82ed-1df1cacd2605 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:06:30.390110 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9979e90c-50b8-40e7-a482-0ab364244576 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605" status: 404 len: 111 microversion: 2.25 time: 0.060771 Jun 10 18:06:30.390110 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1377/2827] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:06:30 2022] GET /compute/v2.1/servers/f5230492-7afa-4202-82ed-1df1cacd2605 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:06:30.390110 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7548d0d8-6864-41f3-bc26-f8db352d4429 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:30.391386 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7548d0d8-6864-41f3-bc26-f8db352d4429 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 05c9cadb-1823-4e2c-9c9f-c3be6892e074] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:30.401469 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7548d0d8-6864-41f3-bc26-f8db352d4429 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:30.402262 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7548d0d8-6864-41f3-bc26-f8db352d4429 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:30.403261 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7548d0d8-6864-41f3-bc26-f8db352d4429 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:30.403936 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7548d0d8-6864-41f3-bc26-f8db352d4429 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:30.484085 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a4a27e6a-e473-4264-8634-f8789fe1798b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "DELETE /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df" status: 204 len: 0 microversion: 2.1 time: 1.668875 Jun 10 18:06:30.485296 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1451/2828] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:28 2022] DELETE /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df => generated 0 bytes in 1671 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:06:30.491971 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-dc1cd0f5-99f9-410d-b0ca-ad80cfdc2d0c tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:30.492625 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-dc1cd0f5-99f9-410d-b0ca-ad80cfdc2d0c tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:30.609213 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-dc1cd0f5-99f9-410d-b0ca-ad80cfdc2d0c tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:30.635342 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7548d0d8-6864-41f3-bc26-f8db352d4429 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:30.644299 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-dc1cd0f5-99f9-410d-b0ca-ad80cfdc2d0c tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:30.647280 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7548d0d8-6864-41f3-bc26-f8db352d4429 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/05c9cadb-1823-4e2c-9c9f-c3be6892e074" status: 200 len: 1468 microversion: 2.1 time: 0.263220 Jun 10 18:06:30.651120 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-dc1cd0f5-99f9-410d-b0ca-ad80cfdc2d0c tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:30.651651 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1378/2829] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:30 2022] GET /compute/v2.1/servers/05c9cadb-1823-4e2c-9c9f-c3be6892e074 => generated 1468 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:30.652333 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-dc1cd0f5-99f9-410d-b0ca-ad80cfdc2d0c tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30" status: 200 len: 1278 microversion: 2.47 time: 0.165900 Jun 10 18:06:30.663714 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2545db99-f12a-4e6b-9b26-320f35991ae5 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:30.664774 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2545db99-f12a-4e6b-9b26-320f35991ae5 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] [instance: b8136d11-a591-48c2-ab1a-c17422d326e6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:30.672075 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1452/2830] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:06:30 2022] GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30 => generated 1278 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:06:30.679976 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2545db99-f12a-4e6b-9b26-320f35991ae5 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:30.680188 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-380611f0-85e2-4dd9-8f43-74219bf7e50c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:30.680660 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-380611f0-85e2-4dd9-8f43-74219bf7e50c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: 42863b6d-5afb-46d7-9ec6-592145bba6e0] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:30.681363 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2545db99-f12a-4e6b-9b26-320f35991ae5 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:30.682476 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2545db99-f12a-4e6b-9b26-320f35991ae5 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:30.683934 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2545db99-f12a-4e6b-9b26-320f35991ae5 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:30.692119 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-380611f0-85e2-4dd9-8f43-74219bf7e50c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:30.692953 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-380611f0-85e2-4dd9-8f43-74219bf7e50c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:30.694451 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-380611f0-85e2-4dd9-8f43-74219bf7e50c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:30.695076 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-380611f0-85e2-4dd9-8f43-74219bf7e50c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:30.729101 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-380611f0-85e2-4dd9-8f43-74219bf7e50c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: 42863b6d-5afb-46d7-9ec6-592145bba6e0] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:06:30.972197 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2545db99-f12a-4e6b-9b26-320f35991ae5 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e633cf9c8e3b41f5a538f5937acf00d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142022afade745b9984068f42f0074dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:30.988296 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2545db99-f12a-4e6b-9b26-320f35991ae5 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] 10.222.0.35 "GET /compute/v2.1/servers/b8136d11-a591-48c2-ab1a-c17422d326e6" status: 200 len: 1396 microversion: 2.1 time: 0.334372 Jun 10 18:06:31.004797 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1379/2831] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:30 2022] GET /compute/v2.1/servers/b8136d11-a591-48c2-ab1a-c17422d326e6 => generated 1396 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:31.024797 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-93c45049-d28e-45ba-a0b2-78c1eadf21d8 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:31.025641 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-93c45049-d28e-45ba-a0b2-78c1eadf21d8 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 935bcaad-c46d-4d6c-8b00-7d349eefb5b2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:31.032859 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93c45049-d28e-45ba-a0b2-78c1eadf21d8 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:31.033648 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93c45049-d28e-45ba-a0b2-78c1eadf21d8 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:31.035054 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93c45049-d28e-45ba-a0b2-78c1eadf21d8 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:31.036433 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93c45049-d28e-45ba-a0b2-78c1eadf21d8 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:31.066219 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-93c45049-d28e-45ba-a0b2-78c1eadf21d8 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 935bcaad-c46d-4d6c-8b00-7d349eefb5b2] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:06:31.126574 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-380611f0-85e2-4dd9-8f43-74219bf7e50c tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "DELETE /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0" status: 204 len: 0 microversion: 2.25 time: 0.452832 Jun 10 18:06:31.127306 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1453/2832] 10.222.0.35 () {60 vars in 1279 bytes} [Fri Jun 10 18:06:30 2022] DELETE /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 10 18:06:31.134875 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-28e24078-3032-4161-aa1d-a8bb01b02bc9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:31.138635 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-28e24078-3032-4161-aa1d-a8bb01b02bc9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:31.139480 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-28e24078-3032-4161-aa1d-a8bb01b02bc9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Searching by: {'reservation_id': 'r-5bo7sc8w', 'deleted': False, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1'} {{(pid=126594) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 18:06:31.145801 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-28e24078-3032-4161-aa1d-a8bb01b02bc9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:31.146248 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-28e24078-3032-4161-aa1d-a8bb01b02bc9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:31.147057 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-28e24078-3032-4161-aa1d-a8bb01b02bc9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:31.147489 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-28e24078-3032-4161-aa1d-a8bb01b02bc9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:31.271283 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.multi_cell_list [None req-28e24078-3032-4161-aa1d-a8bb01b02bc9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126594) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 10 18:06:31.396692 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-28e24078-3032-4161-aa1d-a8bb01b02bc9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:31.408883 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-28e24078-3032-4161-aa1d-a8bb01b02bc9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:31.409574 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-28e24078-3032-4161-aa1d-a8bb01b02bc9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:31.497725 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-93c45049-d28e-45ba-a0b2-78c1eadf21d8 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "DELETE /compute/v2.1/servers/935bcaad-c46d-4d6c-8b00-7d349eefb5b2" status: 204 len: 0 microversion: 2.1 time: 0.487127 Jun 10 18:06:31.522095 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1380/2833] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:06:31 2022] DELETE /compute/v2.1/servers/935bcaad-c46d-4d6c-8b00-7d349eefb5b2 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:06:31.531649 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8e4d0df9-2423-4116-a5cc-ffd6d99e3e82 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:31.533292 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8e4d0df9-2423-4116-a5cc-ffd6d99e3e82 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: 42863b6d-5afb-46d7-9ec6-592145bba6e0] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:31.561348 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8e4d0df9-2423-4116-a5cc-ffd6d99e3e82 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:31.561807 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8e4d0df9-2423-4116-a5cc-ffd6d99e3e82 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:31.565701 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8e4d0df9-2423-4116-a5cc-ffd6d99e3e82 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:31.566160 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8e4d0df9-2423-4116-a5cc-ffd6d99e3e82 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:31.799015 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-28e24078-3032-4161-aa1d-a8bb01b02bc9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/detail?reservation_id=r-5bo7sc8w" status: 200 len: 2929 microversion: 2.1 time: 0.669606 Jun 10 18:06:31.800693 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1454/2834] 10.222.0.35 () {58 vars in 1196 bytes} [Fri Jun 10 18:06:31 2022] GET /compute/v2.1/servers/detail?reservation_id=r-5bo7sc8w => generated 2929 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:31.806538 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b5f64c0a-6fa5-49c4-9c08-226f587635ef tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:31.807468 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b5f64c0a-6fa5-49c4-9c08-226f587635ef tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:31.819073 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5f64c0a-6fa5-49c4-9c08-226f587635ef tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:31.833792 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5f64c0a-6fa5-49c4-9c08-226f587635ef tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:31.840862 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5f64c0a-6fa5-49c4-9c08-226f587635ef tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:31.841582 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5f64c0a-6fa5-49c4-9c08-226f587635ef tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:31.891414 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8e4d0df9-2423-4116-a5cc-ffd6d99e3e82 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:31.904110 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8e4d0df9-2423-4116-a5cc-ffd6d99e3e82 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:31.908424 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8e4d0df9-2423-4116-a5cc-ffd6d99e3e82 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:31.911273 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8e4d0df9-2423-4116-a5cc-ffd6d99e3e82 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0" status: 200 len: 1564 microversion: 2.25 time: 0.385817 Jun 10 18:06:31.912015 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1381/2835] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:06:31 2022] GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0 => generated 1564 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:06:31.934272 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b1dae71f-be16-4cb2-8b39-ac9529146f0b tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:31.938505 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b1dae71f-be16-4cb2-8b39-ac9529146f0b tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:31.945367 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b1dae71f-be16-4cb2-8b39-ac9529146f0b tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:31.946244 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b1dae71f-be16-4cb2-8b39-ac9529146f0b tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:31.947378 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b1dae71f-be16-4cb2-8b39-ac9529146f0b tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:31.947986 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b1dae71f-be16-4cb2-8b39-ac9529146f0b tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:32.053901 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b1dae71f-be16-4cb2-8b39-ac9529146f0b tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:32.088492 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b1dae71f-be16-4cb2-8b39-ac9529146f0b tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:32.091341 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b1dae71f-be16-4cb2-8b39-ac9529146f0b tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:32.094490 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b1dae71f-be16-4cb2-8b39-ac9529146f0b tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30" status: 200 len: 1330 microversion: 2.47 time: 0.179879 Jun 10 18:06:32.095750 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1382/2836] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:06:31 2022] GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30 => generated 1330 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:06:32.096386 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b5f64c0a-6fa5-49c4-9c08-226f587635ef tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:32.102111 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-09ff46c4-d2e0-4870-98a5-6921b12ae16c req-9908fb99-49dc-4904-bf43-c0a66d71cff1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58980efb-1c1a-45bb-9ac8-99383b147058", "tag": "65574b89-4808-4278-86d3-b1a0e74bff16"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:06:32.109143 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b5f64c0a-6fa5-49c4-9c08-226f587635ef tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058" status: 200 len: 1355 microversion: 2.1 time: 0.304986 Jun 10 18:06:32.111527 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1455/2837] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:31 2022] GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 => generated 1355 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:32.112988 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-09ff46c4-d2e0-4870-98a5-6921b12ae16c req-9908fb99-49dc-4904-bf43-c0a66d71cff1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:32.113528 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-09ff46c4-d2e0-4870-98a5-6921b12ae16c req-9908fb99-49dc-4904-bf43-c0a66d71cff1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:32.126684 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-09ff46c4-d2e0-4870-98a5-6921b12ae16c req-9908fb99-49dc-4904-bf43-c0a66d71cff1 service nova] Creating event network-changed:65574b89-4808-4278-86d3-b1a0e74bff16 for instance 58980efb-1c1a-45bb-9ac8-99383b147058 on chh2-master-2 Jun 10 18:06:32.127281 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f0ca617c-edb6-4429-8cdd-786f9da77b38 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1008559950", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "d54e5981-7a3d-42d3-ae71-85d1f7436f39"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:06:32.132295 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-09ff46c4-d2e0-4870-98a5-6921b12ae16c req-9908fb99-49dc-4904-bf43-c0a66d71cff1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034718 Jun 10 18:06:32.133369 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1383/2838] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:06:32.140197 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2d2b2e55-6201-4c39-b6d4-6edf1f627390 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:32.159354 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.compute.server_groups [None req-2d2b2e55-6201-4c39-b6d4-6edf1f627390 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Querying cell 0f13ffb7-1a21-4641-8558-8a89dd295960(cell1) for 2 instances {{(pid=126595) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jun 10 18:06:32.160463 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2d2b2e55-6201-4c39-b6d4-6edf1f627390 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:32.162279 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2d2b2e55-6201-4c39-b6d4-6edf1f627390 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:32.205449 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2d2b2e55-6201-4c39-b6d4-6edf1f627390 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/os-server-groups/9cae038e-8739-45c4-927d-bdae8e405060" status: 200 len: 265 microversion: 2.1 time: 0.070734 Jun 10 18:06:32.206043 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1384/2839] 10.222.0.35 () {58 vars in 1262 bytes} [Fri Jun 10 18:06:32 2022] GET /compute/v2.1/os-server-groups/9cae038e-8739-45c4-927d-bdae8e405060 => generated 265 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:06:32.226300 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-33fb83da-9efe-4a57-abc2-cb047f443316 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:32.228729 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-33fb83da-9efe-4a57-abc2-cb047f443316 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] [instance: b8136d11-a591-48c2-ab1a-c17422d326e6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:32.229418 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-f0ca617c-edb6-4429-8cdd-786f9da77b38 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] validate_networks() for [('d54e5981-7a3d-42d3-ae71-85d1f7436f39', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:06:32.233798 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-33fb83da-9efe-4a57-abc2-cb047f443316 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:32.234323 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-33fb83da-9efe-4a57-abc2-cb047f443316 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:32.235164 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-33fb83da-9efe-4a57-abc2-cb047f443316 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:32.235666 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-33fb83da-9efe-4a57-abc2-cb047f443316 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:32.377418 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-33fb83da-9efe-4a57-abc2-cb047f443316 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e633cf9c8e3b41f5a538f5937acf00d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142022afade745b9984068f42f0074dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:32.385933 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-33fb83da-9efe-4a57-abc2-cb047f443316 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] 10.222.0.35 "GET /compute/v2.1/servers/b8136d11-a591-48c2-ab1a-c17422d326e6" status: 200 len: 1577 microversion: 2.1 time: 0.164697 Jun 10 18:06:32.386518 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1385/2840] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:32 2022] GET /compute/v2.1/servers/b8136d11-a591-48c2-ab1a-c17422d326e6 => generated 1577 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:32.391046 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3747d484-bd31-48fd-b815-7a31116eba00 tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:32.391869 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3747d484-bd31-48fd-b815-7a31116eba00 tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] [instance: 07afccc2-6b07-4dd4-b9f5-aaa7609f72d1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:32.405578 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3747d484-bd31-48fd-b815-7a31116eba00 tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:32.406802 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3747d484-bd31-48fd-b815-7a31116eba00 tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:32.407709 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3747d484-bd31-48fd-b815-7a31116eba00 tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:32.408241 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3747d484-bd31-48fd-b815-7a31116eba00 tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:32.559042 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3747d484-bd31-48fd-b815-7a31116eba00 tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/07afccc2-6b07-4dd4-b9f5-aaa7609f72d1" status: 200 len: 1619 microversion: 2.1 time: 0.171243 Jun 10 18:06:32.560678 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1386/2841] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:32 2022] GET /compute/v2.1/servers/07afccc2-6b07-4dd4-b9f5-aaa7609f72d1 => generated 1619 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:32.565528 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-661103cd-5a85-4a37-9651-a70328e731e6 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:32.566010 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-661103cd-5a85-4a37-9651-a70328e731e6 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] [instance: b8136d11-a591-48c2-ab1a-c17422d326e6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:32.572863 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-661103cd-5a85-4a37-9651-a70328e731e6 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:32.573541 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-661103cd-5a85-4a37-9651-a70328e731e6 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:32.578926 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-661103cd-5a85-4a37-9651-a70328e731e6 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:32.578926 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-661103cd-5a85-4a37-9651-a70328e731e6 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:32.669223 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-661103cd-5a85-4a37-9651-a70328e731e6 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] 10.222.0.35 "GET /compute/v2.1/servers/b8136d11-a591-48c2-ab1a-c17422d326e6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106554 Jun 10 18:06:32.670525 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1387/2842] 10.222.0.35 () {58 vars in 1274 bytes} [Fri Jun 10 18:06:32 2022] GET /compute/v2.1/servers/b8136d11-a591-48c2-ab1a-c17422d326e6/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:06:32.681372 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d032f4ba-25fb-41d6-8782-2a55e3ac394a tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:32.683339 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d032f4ba-25fb-41d6-8782-2a55e3ac394a tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] [instance: 05c9cadb-1823-4e2c-9c9f-c3be6892e074] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:32.708564 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d032f4ba-25fb-41d6-8782-2a55e3ac394a tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:32.711741 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d032f4ba-25fb-41d6-8782-2a55e3ac394a tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:32.717299 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d032f4ba-25fb-41d6-8782-2a55e3ac394a tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:32.717990 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d032f4ba-25fb-41d6-8782-2a55e3ac394a tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:32.901236 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-f0ca617c-edb6-4429-8cdd-786f9da77b38 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:06:32.901772 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-f0ca617c-edb6-4429-8cdd-786f9da77b38 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:06:32.902283 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-f0ca617c-edb6-4429-8cdd-786f9da77b38 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:06:32.902906 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-f0ca617c-edb6-4429-8cdd-786f9da77b38 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:06:32.903354 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-f0ca617c-edb6-4429-8cdd-786f9da77b38 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:06:32.916684 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f0ca617c-edb6-4429-8cdd-786f9da77b38 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:32.923149 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f0ca617c-edb6-4429-8cdd-786f9da77b38 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:32.924210 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f0ca617c-edb6-4429-8cdd-786f9da77b38 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:32.931339 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f0ca617c-edb6-4429-8cdd-786f9da77b38 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:32.955204 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-f0ca617c-edb6-4429-8cdd-786f9da77b38 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Getting quotas for project af241982b5884c22b5e7103f1ea4b8ef. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:06:32.965883 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-f0ca617c-edb6-4429-8cdd-786f9da77b38 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Getting quotas for user 8adb0ac9df46461489fa6bd3951417cf and project af241982b5884c22b5e7103f1ea4b8ef. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:06:32.981086 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f0ca617c-edb6-4429-8cdd-786f9da77b38 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:06:32.983725 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f0ca617c-edb6-4429-8cdd-786f9da77b38 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:06:33.064791 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d032f4ba-25fb-41d6-8782-2a55e3ac394a tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/05c9cadb-1823-4e2c-9c9f-c3be6892e074" status: 200 len: 1619 microversion: 2.1 time: 0.392843 Jun 10 18:06:33.074106 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1388/2843] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:32 2022] GET /compute/v2.1/servers/05c9cadb-1823-4e2c-9c9f-c3be6892e074 => generated 1619 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:33.080373 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dd08df86-abb2-49a5-b0e1-5666f67cb8f5 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:33.081542 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dd08df86-abb2-49a5-b0e1-5666f67cb8f5 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: 42863b6d-5afb-46d7-9ec6-592145bba6e0] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:33.090090 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd08df86-abb2-49a5-b0e1-5666f67cb8f5 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:33.090783 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd08df86-abb2-49a5-b0e1-5666f67cb8f5 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:33.091811 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd08df86-abb2-49a5-b0e1-5666f67cb8f5 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:33.092690 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd08df86-abb2-49a5-b0e1-5666f67cb8f5 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:33.166488 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f0ca617c-edb6-4429-8cdd-786f9da77b38 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.053678 Jun 10 18:06:33.167280 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1456/2844] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:06:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:06:33.172887 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3ccbe528-6a69-450a-912f-95c86b1cd5d5 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Action: 'create', calling method: .version_select at 0x7f77c11cc8b0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-476685652", "policies": ["anti-affinity"]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:06:33.202060 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-3ccbe528-6a69-450a-912f-95c86b1cd5d5 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Getting quotas for project bb2c4b1067ac4cab8b8565bc987f00b1. Resources: {'server_groups'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:06:33.210180 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-3ccbe528-6a69-450a-912f-95c86b1cd5d5 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Getting quotas for user 9c189471a3ab4ec2b644b3ee1352d4e6 and project bb2c4b1067ac4cab8b8565bc987f00b1. Resources: {'server_groups'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:06:33.716156 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-3ccbe528-6a69-450a-912f-95c86b1cd5d5 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Getting quotas for project bb2c4b1067ac4cab8b8565bc987f00b1. Resources: {'server_groups'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:06:33.716156 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-3ccbe528-6a69-450a-912f-95c86b1cd5d5 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Getting quotas for user 9c189471a3ab4ec2b644b3ee1352d4e6 and project bb2c4b1067ac4cab8b8565bc987f00b1. Resources: {'server_groups'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:06:33.716156 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3ccbe528-6a69-450a-912f-95c86b1cd5d5 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.262449 Jun 10 18:06:33.716156 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1457/2845] 10.222.0.35 () {60 vars in 1173 bytes} [Fri Jun 10 18:06:33 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:06:33.716156 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-eb1a69d1-73cc-4b42-848c-6989d2b125cb tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:33.716156 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-eb1a69d1-73cc-4b42-848c-6989d2b125cb tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:33.716156 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eb1a69d1-73cc-4b42-848c-6989d2b125cb tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:33.716156 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eb1a69d1-73cc-4b42-848c-6989d2b125cb tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:33.716156 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eb1a69d1-73cc-4b42-848c-6989d2b125cb tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:33.716156 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eb1a69d1-73cc-4b42-848c-6989d2b125cb tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:33.716156 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-eb1a69d1-73cc-4b42-848c-6989d2b125cb tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:33.716156 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-eb1a69d1-73cc-4b42-848c-6989d2b125cb tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:33.721486 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-eb1a69d1-73cc-4b42-848c-6989d2b125cb tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:33.721486 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-eb1a69d1-73cc-4b42-848c-6989d2b125cb tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30" status: 200 len: 1348 microversion: 2.47 time: 0.246235 Jun 10 18:06:33.721486 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1458/2846] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:06:33 2022] GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30 => generated 1348 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:06:33.721486 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a7859e39-eaf9-4a06-93a7-cd1c3e570c5a tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:33.721486 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a7859e39-eaf9-4a06-93a7-cd1c3e570c5a tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:33.732824 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a7859e39-eaf9-4a06-93a7-cd1c3e570c5a tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:33.734546 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a7859e39-eaf9-4a06-93a7-cd1c3e570c5a tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:33.735745 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a7859e39-eaf9-4a06-93a7-cd1c3e570c5a tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:33.736572 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a7859e39-eaf9-4a06-93a7-cd1c3e570c5a tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:34.272865 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a7859e39-eaf9-4a06-93a7-cd1c3e570c5a tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:34.280687 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a7859e39-eaf9-4a06-93a7-cd1c3e570c5a tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058" status: 200 len: 1355 microversion: 2.1 time: 0.587126 Jun 10 18:06:34.281736 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1459/2847] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:33 2022] GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 => generated 1355 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:34.286408 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3f55ae9b-1a75-4ac3-b43b-e0e0f9aeaf62 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:34.287527 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3f55ae9b-1a75-4ac3-b43b-e0e0f9aeaf62 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:34.333712 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-dd08df86-abb2-49a5-b0e1-5666f67cb8f5 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:34.353433 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-dd08df86-abb2-49a5-b0e1-5666f67cb8f5 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:34.356710 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-dd08df86-abb2-49a5-b0e1-5666f67cb8f5 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:34.358526 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dd08df86-abb2-49a5-b0e1-5666f67cb8f5 tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0" status: 200 len: 1564 microversion: 2.25 time: 1.282676 Jun 10 18:06:34.359672 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1389/2848] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:06:33 2022] GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0 => generated 1564 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:06:34.365449 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-17537b56-22b4-4ef2-8104-bf2f4be52649 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1740295384", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "f1232bf5-d888-4a4d-af7c-4e6e28703ed6"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:06:34.392030 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3f55ae9b-1a75-4ac3-b43b-e0e0f9aeaf62 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:34.402154 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3f55ae9b-1a75-4ac3-b43b-e0e0f9aeaf62 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b" status: 200 len: 1208 microversion: 2.1 time: 0.117094 Jun 10 18:06:34.404762 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1460/2849] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:34 2022] GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b => generated 1208 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:34.413863 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-32446786-54ad-4013-86c5-49c7140ab686 req-c72e833c-cc6d-4fc0-a26d-ca412f2cd7d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "935bcaad-c46d-4d6c-8b00-7d349eefb5b2", "name": "network-vif-unplugged", "status": "completed", "tag": "5e62510d-78bb-4546-9a32-2b22d19ec94b"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:06:34.438926 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-32446786-54ad-4013-86c5-49c7140ab686 req-c72e833c-cc6d-4fc0-a26d-ca412f2cd7d7 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:34.439527 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-32446786-54ad-4013-86c5-49c7140ab686 req-c72e833c-cc6d-4fc0-a26d-ca412f2cd7d7 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:34.464504 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-17537b56-22b4-4ef2-8104-bf2f4be52649 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] validate_networks() for None {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:06:34.477945 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-32446786-54ad-4013-86c5-49c7140ab686 req-c72e833c-cc6d-4fc0-a26d-ca412f2cd7d7 service nova] Creating event network-vif-unplugged:5e62510d-78bb-4546-9a32-2b22d19ec94b for instance 935bcaad-c46d-4d6c-8b00-7d349eefb5b2 on chh2-master-2 Jun 10 18:06:34.485939 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-32446786-54ad-4013-86c5-49c7140ab686 req-c72e833c-cc6d-4fc0-a26d-ca412f2cd7d7 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078382 Jun 10 18:06:34.486648 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1461/2850] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:06:34.711640 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-366f8abf-df00-42d4-b192-38d1fbbaf7ef tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:34.712595 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-366f8abf-df00-42d4-b192-38d1fbbaf7ef tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:34.719207 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-366f8abf-df00-42d4-b192-38d1fbbaf7ef tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:34.719896 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-366f8abf-df00-42d4-b192-38d1fbbaf7ef tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:34.720868 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-366f8abf-df00-42d4-b192-38d1fbbaf7ef tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:34.721443 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-366f8abf-df00-42d4-b192-38d1fbbaf7ef tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:34.745127 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:06:34.875973 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-366f8abf-df00-42d4-b192-38d1fbbaf7ef tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:34.904467 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-366f8abf-df00-42d4-b192-38d1fbbaf7ef tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:34.909073 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-366f8abf-df00-42d4-b192-38d1fbbaf7ef tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:34.911872 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-366f8abf-df00-42d4-b192-38d1fbbaf7ef tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30" status: 200 len: 1336 microversion: 2.47 time: 0.204237 Jun 10 18:06:34.913221 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1462/2851] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:06:34 2022] GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30 => generated 1336 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:06:35.189017 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-c11373bc-c43a-4100-aff8-cabe69880644 req-bfec3e15-01f3-4a66-9af4-ffc5e9e98fe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "935bcaad-c46d-4d6c-8b00-7d349eefb5b2", "name": "network-vif-deleted", "tag": "5e62510d-78bb-4546-9a32-2b22d19ec94b"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:06:35.218803 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-c11373bc-c43a-4100-aff8-cabe69880644 req-bfec3e15-01f3-4a66-9af4-ffc5e9e98fe4 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:35.223553 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-17537b56-22b4-4ef2-8104-bf2f4be52649 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:06:35.225211 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-17537b56-22b4-4ef2-8104-bf2f4be52649 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:06:35.226685 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-17537b56-22b4-4ef2-8104-bf2f4be52649 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:06:35.228471 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-17537b56-22b4-4ef2-8104-bf2f4be52649 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:06:35.228916 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-c11373bc-c43a-4100-aff8-cabe69880644 req-bfec3e15-01f3-4a66-9af4-ffc5e9e98fe4 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:35.229750 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-17537b56-22b4-4ef2-8104-bf2f4be52649 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:06:35.250074 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-c11373bc-c43a-4100-aff8-cabe69880644 req-bfec3e15-01f3-4a66-9af4-ffc5e9e98fe4 service nova] Creating event network-vif-deleted:5e62510d-78bb-4546-9a32-2b22d19ec94b for instance 935bcaad-c46d-4d6c-8b00-7d349eefb5b2 on chh2-master-2 Jun 10 18:06:35.252248 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-17537b56-22b4-4ef2-8104-bf2f4be52649 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:35.252897 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-17537b56-22b4-4ef2-8104-bf2f4be52649 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:35.253764 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-17537b56-22b4-4ef2-8104-bf2f4be52649 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:35.254239 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-17537b56-22b4-4ef2-8104-bf2f4be52649 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:35.257517 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-c11373bc-c43a-4100-aff8-cabe69880644 req-bfec3e15-01f3-4a66-9af4-ffc5e9e98fe4 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074654 Jun 10 18:06:35.258691 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1463/2852] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:06:35.283157 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-17537b56-22b4-4ef2-8104-bf2f4be52649 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Getting quotas for project bb2c4b1067ac4cab8b8565bc987f00b1. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:06:35.288880 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-17537b56-22b4-4ef2-8104-bf2f4be52649 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Getting quotas for user 9c189471a3ab4ec2b644b3ee1352d4e6 and project bb2c4b1067ac4cab8b8565bc987f00b1. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:06:35.302089 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0c3e4c1c-7dbc-4b3d-9f1f-5c0c3ba0ec0c tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:35.303836 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0c3e4c1c-7dbc-4b3d-9f1f-5c0c3ba0ec0c tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:35.308962 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-17537b56-22b4-4ef2-8104-bf2f4be52649 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Going to run 2 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:06:35.311492 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-17537b56-22b4-4ef2-8104-bf2f4be52649 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: f448b274-8163-42f3-9eea-1e4f3458dd2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:06:35.316610 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:06:35.327176 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0c3e4c1c-7dbc-4b3d-9f1f-5c0c3ba0ec0c tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:35.329346 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0c3e4c1c-7dbc-4b3d-9f1f-5c0c3ba0ec0c tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:35.332967 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0c3e4c1c-7dbc-4b3d-9f1f-5c0c3ba0ec0c tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:35.333659 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0c3e4c1c-7dbc-4b3d-9f1f-5c0c3ba0ec0c tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:35.437012 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:06:35.622774 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-17537b56-22b4-4ef2-8104-bf2f4be52649 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Getting quotas for project bb2c4b1067ac4cab8b8565bc987f00b1. Resources: {'server_group_members'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:06:35.630443 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-17537b56-22b4-4ef2-8104-bf2f4be52649 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Getting quotas for user 9c189471a3ab4ec2b644b3ee1352d4e6 and project bb2c4b1067ac4cab8b8565bc987f00b1. Resources: {'server_group_members'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:06:35.817079 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-17537b56-22b4-4ef2-8104-bf2f4be52649 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Getting quotas for project bb2c4b1067ac4cab8b8565bc987f00b1. Resources: {'server_group_members'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:06:35.825010 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-17537b56-22b4-4ef2-8104-bf2f4be52649 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Getting quotas for user 9c189471a3ab4ec2b644b3ee1352d4e6 and project bb2c4b1067ac4cab8b8565bc987f00b1. Resources: {'server_group_members'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:06:35.875486 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-17537b56-22b4-4ef2-8104-bf2f4be52649 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: d4580fa2-bf3a-4dc7-af2b-0d6af14508b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=f448b274-8163-42f3-9eea-1e4f3458dd2b,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:06:36.042709 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-17537b56-22b4-4ef2-8104-bf2f4be52649 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Getting quotas for project bb2c4b1067ac4cab8b8565bc987f00b1. Resources: {'server_group_members'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:06:36.070513 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-17537b56-22b4-4ef2-8104-bf2f4be52649 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Getting quotas for user 9c189471a3ab4ec2b644b3ee1352d4e6 and project bb2c4b1067ac4cab8b8565bc987f00b1. Resources: {'server_group_members'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:06:36.240585 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-17537b56-22b4-4ef2-8104-bf2f4be52649 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Getting quotas for project bb2c4b1067ac4cab8b8565bc987f00b1. Resources: {'server_group_members'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:06:36.253937 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-17537b56-22b4-4ef2-8104-bf2f4be52649 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Getting quotas for user 9c189471a3ab4ec2b644b3ee1352d4e6 and project bb2c4b1067ac4cab8b8565bc987f00b1. Resources: {'server_group_members'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:06:36.326584 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-17537b56-22b4-4ef2-8104-bf2f4be52649 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.964926 Jun 10 18:06:36.331548 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1390/2853] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:06:34 2022] POST /compute/v2.1/servers => generated 32 bytes in 1971 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jun 10 18:06:36.339000 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-277cd7cb-76d1-46d7-8e6a-c5934fe48abd tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:36.339834 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-277cd7cb-76d1-46d7-8e6a-c5934fe48abd tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: 42863b6d-5afb-46d7-9ec6-592145bba6e0] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:36.353369 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-277cd7cb-76d1-46d7-8e6a-c5934fe48abd tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:36.354061 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-277cd7cb-76d1-46d7-8e6a-c5934fe48abd tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:36.360218 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-277cd7cb-76d1-46d7-8e6a-c5934fe48abd tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:36.361010 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-277cd7cb-76d1-46d7-8e6a-c5934fe48abd tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:36.475160 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0c3e4c1c-7dbc-4b3d-9f1f-5c0c3ba0ec0c tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:36.492663 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0c3e4c1c-7dbc-4b3d-9f1f-5c0c3ba0ec0c tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058" status: 200 len: 1355 microversion: 2.1 time: 1.196816 Jun 10 18:06:36.495927 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1464/2854] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:35 2022] GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 => generated 1355 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:36.507341 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-84f7c4a5-2b0a-480d-bd3b-c96a2c1b1633 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:36.508347 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-84f7c4a5-2b0a-480d-bd3b-c96a2c1b1633 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:36.519568 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-84f7c4a5-2b0a-480d-bd3b-c96a2c1b1633 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:36.521906 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-84f7c4a5-2b0a-480d-bd3b-c96a2c1b1633 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:36.523022 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-84f7c4a5-2b0a-480d-bd3b-c96a2c1b1633 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:36.523776 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-84f7c4a5-2b0a-480d-bd3b-c96a2c1b1633 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:36.653345 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-277cd7cb-76d1-46d7-8e6a-c5934fe48abd tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:36.668754 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-277cd7cb-76d1-46d7-8e6a-c5934fe48abd tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:36.673291 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-277cd7cb-76d1-46d7-8e6a-c5934fe48abd tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:36.679002 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-277cd7cb-76d1-46d7-8e6a-c5934fe48abd tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0" status: 200 len: 1346 microversion: 2.25 time: 0.343225 Jun 10 18:06:36.680087 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1391/2855] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:06:36 2022] GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0 => generated 1346 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:06:36.688671 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4e6bf60a-5e97-4932-96e4-5567246e8482 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:36.693868 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4e6bf60a-5e97-4932-96e4-5567246e8482 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:36.710831 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e6bf60a-5e97-4932-96e4-5567246e8482 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:36.711470 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e6bf60a-5e97-4932-96e4-5567246e8482 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:36.713726 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e6bf60a-5e97-4932-96e4-5567246e8482 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:36.714331 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e6bf60a-5e97-4932-96e4-5567246e8482 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:36.811411 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-84f7c4a5-2b0a-480d-bd3b-c96a2c1b1633 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:36.826390 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-84f7c4a5-2b0a-480d-bd3b-c96a2c1b1633 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b" status: 200 len: 1268 microversion: 2.1 time: 0.328770 Jun 10 18:06:36.830967 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1465/2856] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:36 2022] GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b => generated 1268 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:36.841483 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-36fee7d4-bf45-45d9-a0f5-e07f8deb87e9 req-1009d7ac-eae2-4daa-92ae-ce1c3cc5e4d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42863b6d-5afb-46d7-9ec6-592145bba6e0", "name": "network-vif-deleted", "tag": "67e4d336-b9e8-43b3-8284-8dc5d8f3355b"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:06:36.865952 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-36fee7d4-bf45-45d9-a0f5-e07f8deb87e9 req-1009d7ac-eae2-4daa-92ae-ce1c3cc5e4d1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:36.869409 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-36fee7d4-bf45-45d9-a0f5-e07f8deb87e9 req-1009d7ac-eae2-4daa-92ae-ce1c3cc5e4d1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:36.883445 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4e6bf60a-5e97-4932-96e4-5567246e8482 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:36.899614 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4e6bf60a-5e97-4932-96e4-5567246e8482 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:36.901240 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4e6bf60a-5e97-4932-96e4-5567246e8482 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:36.909352 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-36fee7d4-bf45-45d9-a0f5-e07f8deb87e9 req-1009d7ac-eae2-4daa-92ae-ce1c3cc5e4d1 service nova] Creating event network-vif-deleted:67e4d336-b9e8-43b3-8284-8dc5d8f3355b for instance 42863b6d-5afb-46d7-9ec6-592145bba6e0 on chh2-master-2 Jun 10 18:06:36.911471 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4e6bf60a-5e97-4932-96e4-5567246e8482 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30" status: 200 len: 1336 microversion: 2.47 time: 0.223426 Jun 10 18:06:36.912820 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1392/2857] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:06:36 2022] GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30 => generated 1336 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:06:36.922788 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ce8ba997-b5dc-4ad0-b1d5-1e60fe7e9577 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:36.923669 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ce8ba997-b5dc-4ad0-b1d5-1e60fe7e9577 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] [instance: b8136d11-a591-48c2-ab1a-c17422d326e6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:36.938953 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ce8ba997-b5dc-4ad0-b1d5-1e60fe7e9577 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:36.942942 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ce8ba997-b5dc-4ad0-b1d5-1e60fe7e9577 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:36.943774 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ce8ba997-b5dc-4ad0-b1d5-1e60fe7e9577 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:36.944229 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ce8ba997-b5dc-4ad0-b1d5-1e60fe7e9577 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:36.945670 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-36fee7d4-bf45-45d9-a0f5-e07f8deb87e9 req-1009d7ac-eae2-4daa-92ae-ce1c3cc5e4d1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113297 Jun 10 18:06:36.946339 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1466/2858] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:06:36.958353 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b51848bc-3f67-4b56-9e17-16e0c646078d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:36.964569 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b51848bc-3f67-4b56-9e17-16e0c646078d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:36.966723 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b51848bc-3f67-4b56-9e17-16e0c646078d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Searching by: {'deleted': False, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1'} {{(pid=126594) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 18:06:37.009747 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b51848bc-3f67-4b56-9e17-16e0c646078d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:37.010431 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b51848bc-3f67-4b56-9e17-16e0c646078d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:37.011416 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b51848bc-3f67-4b56-9e17-16e0c646078d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:37.012002 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b51848bc-3f67-4b56-9e17-16e0c646078d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:37.045199 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.multi_cell_list [None req-b51848bc-3f67-4b56-9e17-16e0c646078d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=126594) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 10 18:06:37.082009 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b51848bc-3f67-4b56-9e17-16e0c646078d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers" status: 200 len: 1664 microversion: 2.1 time: 0.134218 Jun 10 18:06:37.082665 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1467/2859] 10.222.0.35 () {58 vars in 1124 bytes} [Fri Jun 10 18:06:36 2022] GET /compute/v2.1/servers => generated 1664 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:37.097183 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bf7ec38f-f107-428d-8115-667c2826a97f tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:37.101310 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bf7ec38f-f107-428d-8115-667c2826a97f tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: d4580fa2-bf3a-4dc7-af2b-0d6af14508b3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:37.164107 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bf7ec38f-f107-428d-8115-667c2826a97f tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:37.180999 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bf7ec38f-f107-428d-8115-667c2826a97f tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3" status: 200 len: 1219 microversion: 2.1 time: 0.090252 Jun 10 18:06:37.193638 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1468/2860] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:37 2022] GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3 => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:06:37.378440 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ce8ba997-b5dc-4ad0-b1d5-1e60fe7e9577 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e633cf9c8e3b41f5a538f5937acf00d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142022afade745b9984068f42f0074dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:37.402852 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:06:37.405531 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ce8ba997-b5dc-4ad0-b1d5-1e60fe7e9577 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] 10.222.0.35 "GET /compute/v2.1/servers/b8136d11-a591-48c2-ab1a-c17422d326e6" status: 200 len: 1577 microversion: 2.1 time: 0.491482 Jun 10 18:06:37.416387 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1393/2861] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:36 2022] GET /compute/v2.1/servers/b8136d11-a591-48c2-ab1a-c17422d326e6 => generated 1577 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:37.523243 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0c199549-7997-47c0-b29f-9f9164df2adc tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:37.523769 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0c199549-7997-47c0-b29f-9f9164df2adc tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:37.541489 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0c199549-7997-47c0-b29f-9f9164df2adc tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:37.542129 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0c199549-7997-47c0-b29f-9f9164df2adc tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:37.543086 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0c199549-7997-47c0-b29f-9f9164df2adc tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:37.543680 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0c199549-7997-47c0-b29f-9f9164df2adc tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:37.697320 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-108e7763-056a-4eef-bcd0-fb0ab630336f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:37.698544 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-108e7763-056a-4eef-bcd0-fb0ab630336f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: 42863b6d-5afb-46d7-9ec6-592145bba6e0] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:37.730373 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-108e7763-056a-4eef-bcd0-fb0ab630336f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:37.735489 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-108e7763-056a-4eef-bcd0-fb0ab630336f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:37.737666 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-108e7763-056a-4eef-bcd0-fb0ab630336f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:37.742870 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-108e7763-056a-4eef-bcd0-fb0ab630336f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:37.853518 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-108e7763-056a-4eef-bcd0-fb0ab630336f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:37.857853 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-108e7763-056a-4eef-bcd0-fb0ab630336f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:37.858427 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-108e7763-056a-4eef-bcd0-fb0ab630336f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lazy-loading 'fault' on Instance uuid 42863b6d-5afb-46d7-9ec6-592145bba6e0 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:06:37.979904 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-108e7763-056a-4eef-bcd0-fb0ab630336f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:38.009599 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-108e7763-056a-4eef-bcd0-fb0ab630336f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:38.011398 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-108e7763-056a-4eef-bcd0-fb0ab630336f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4967895f6f041058ef60cee35a3659c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ee7bcfe44746fda89fda904f81e1b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:38.012658 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-108e7763-056a-4eef-bcd0-fb0ab630336f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0" status: 200 len: 1351 microversion: 2.25 time: 0.319925 Jun 10 18:06:38.013219 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1394/2862] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:06:37 2022] GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0 => generated 1351 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:06:38.039806 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-35bfe68a-f557-4081-99e0-78854108d08f tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:38.040467 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-35bfe68a-f557-4081-99e0-78854108d08f tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:38.049020 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-35bfe68a-f557-4081-99e0-78854108d08f tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:38.069462 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-35bfe68a-f557-4081-99e0-78854108d08f tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:38.088396 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-35bfe68a-f557-4081-99e0-78854108d08f tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:38.093816 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-35bfe68a-f557-4081-99e0-78854108d08f tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:38.126293 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0c199549-7997-47c0-b29f-9f9164df2adc tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:38.147274 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0c199549-7997-47c0-b29f-9f9164df2adc tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058" status: 200 len: 1355 microversion: 2.1 time: 0.636635 Jun 10 18:06:38.152450 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1469/2863] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:37 2022] GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 => generated 1355 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:38.161695 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-08596705-c3a2-427c-afd9-3fdec4780b70 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:38.161695 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-08596705-c3a2-427c-afd9-3fdec4780b70 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:38.205470 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-08596705-c3a2-427c-afd9-3fdec4780b70 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:38.205996 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-08596705-c3a2-427c-afd9-3fdec4780b70 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:38.208212 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-08596705-c3a2-427c-afd9-3fdec4780b70 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:38.217851 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-08596705-c3a2-427c-afd9-3fdec4780b70 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:38.304966 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-35bfe68a-f557-4081-99e0-78854108d08f tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:38.319158 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-35bfe68a-f557-4081-99e0-78854108d08f tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b" status: 200 len: 1266 microversion: 2.1 time: 0.291209 Jun 10 18:06:38.327453 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1395/2864] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:38 2022] GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b => generated 1266 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:38.335472 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-10e7246e-2dad-4cb5-88f3-50a6c8768073 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:38.338109 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-10e7246e-2dad-4cb5-88f3-50a6c8768073 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: d4580fa2-bf3a-4dc7-af2b-0d6af14508b3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:38.375541 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-08596705-c3a2-427c-afd9-3fdec4780b70 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:38.383420 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-08596705-c3a2-427c-afd9-3fdec4780b70 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:38.393734 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-08596705-c3a2-427c-afd9-3fdec4780b70 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:38.395534 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-08596705-c3a2-427c-afd9-3fdec4780b70 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30" status: 200 len: 1357 microversion: 2.47 time: 0.241476 Jun 10 18:06:38.396111 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1470/2865] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:06:38 2022] GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30 => generated 1357 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:06:38.486582 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-10e7246e-2dad-4cb5-88f3-50a6c8768073 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:38.498497 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-10e7246e-2dad-4cb5-88f3-50a6c8768073 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3" status: 200 len: 1219 microversion: 2.1 time: 0.167271 Jun 10 18:06:38.499148 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1396/2866] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:38 2022] GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3 => generated 1219 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:38.521541 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-42ed20f5-55f5-474b-b9a2-a1bd9d68bd7f tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:06:38.529441 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-42ed20f5-55f5-474b-b9a2-a1bd9d68bd7f tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:38.536362 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-62930dfd-e9ee-4f4e-978b-37c944fee499 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Action: 'create', calling method: .version_select at 0x7f77c00ad4c0>, body: {"keypair": {"name": "tempest-keypair-1258135869", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDNqriiIgoNvWhJDazKu0khgMQ5Lq8OZ9lzzCOEgSMrvc66XQPt0LN1AL+w2W6nOlzebZhiK0kzJQHzF0IM0gkMxGibNyZEHSnctHcolPV5fcppU6Bx/GCAp8ny2xsMx5A=="}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:06:38.538975 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42ed20f5-55f5-474b-b9a2-a1bd9d68bd7f tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:38.539561 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42ed20f5-55f5-474b-b9a2-a1bd9d68bd7f tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:38.540606 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42ed20f5-55f5-474b-b9a2-a1bd9d68bd7f tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:38.541167 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42ed20f5-55f5-474b-b9a2-a1bd9d68bd7f tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:38.567396 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-62930dfd-e9ee-4f4e-978b-37c944fee499 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Getting quotas for project 3c384e1bab854ad8b4c2ae9ab895cd88. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:06:38.574807 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-62930dfd-e9ee-4f4e-978b-37c944fee499 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Getting quotas for user 41f463dd5d9140ecb29e0daa415331a9 and project 3c384e1bab854ad8b4c2ae9ab895cd88. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:06:38.668462 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-42ed20f5-55f5-474b-b9a2-a1bd9d68bd7f tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:06:38.668987 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-42ed20f5-55f5-474b-b9a2-a1bd9d68bd7f tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:06:38.669638 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-42ed20f5-55f5-474b-b9a2-a1bd9d68bd7f tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:06:38.670079 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-42ed20f5-55f5-474b-b9a2-a1bd9d68bd7f tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:06:38.670501 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-42ed20f5-55f5-474b-b9a2-a1bd9d68bd7f tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:06:38.716000 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-62930dfd-e9ee-4f4e-978b-37c944fee499 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.314320 Jun 10 18:06:38.716904 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1471/2867] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 18:06:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:06:38.892759 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-42ed20f5-55f5-474b-b9a2-a1bd9d68bd7f tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:38.899721 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42ed20f5-55f5-474b-b9a2-a1bd9d68bd7f tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:38.900555 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42ed20f5-55f5-474b-b9a2-a1bd9d68bd7f tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:38.901486 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42ed20f5-55f5-474b-b9a2-a1bd9d68bd7f tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:38.902068 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42ed20f5-55f5-474b-b9a2-a1bd9d68bd7f tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:38.946879 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-42ed20f5-55f5-474b-b9a2-a1bd9d68bd7f tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "POST /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30/action" status: 202 len: 1079 microversion: 2.47 time: 0.436141 Jun 10 18:06:38.948020 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1397/2868] 10.222.0.35 () {62 vars in 1318 bytes} [Fri Jun 10 18:06:38 2022] POST /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30/action => generated 1079 bytes in 448 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jun 10 18:06:38.964283 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4fb14e2e-5b4a-4f5c-ba8a-a2160afa5679 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:38.964932 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4fb14e2e-5b4a-4f5c-ba8a-a2160afa5679 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:38.972214 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4fb14e2e-5b4a-4f5c-ba8a-a2160afa5679 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:38.972711 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4fb14e2e-5b4a-4f5c-ba8a-a2160afa5679 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:38.974201 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4fb14e2e-5b4a-4f5c-ba8a-a2160afa5679 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:38.974645 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4fb14e2e-5b4a-4f5c-ba8a-a2160afa5679 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:38.982556 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-b50359f2-5a57-4847-a9f8-84d04fe5bc6f req-60356fbd-8217-4b91-b70b-79df9996c9cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8136d11-a591-48c2-ab1a-c17422d326e6", "tag": "2b19c5f3-6d53-4f1e-ab63-c786eef0c74e"}, {"name": "network-changed", "server_uuid": "58980efb-1c1a-45bb-9ac8-99383b147058", "tag": "64d536e0-a4bf-403a-8ba1-f12c3ad0e6d6"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:06:38.998230 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-b50359f2-5a57-4847-a9f8-84d04fe5bc6f req-60356fbd-8217-4b91-b70b-79df9996c9cc service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:38.999558 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-b50359f2-5a57-4847-a9f8-84d04fe5bc6f req-60356fbd-8217-4b91-b70b-79df9996c9cc service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:39.038402 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-b50359f2-5a57-4847-a9f8-84d04fe5bc6f req-60356fbd-8217-4b91-b70b-79df9996c9cc service nova] Creating event network-changed:2b19c5f3-6d53-4f1e-ab63-c786eef0c74e for instance b8136d11-a591-48c2-ab1a-c17422d326e6 on chh1-master-2 Jun 10 18:06:39.041521 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-b50359f2-5a57-4847-a9f8-84d04fe5bc6f req-60356fbd-8217-4b91-b70b-79df9996c9cc service nova] Creating event network-changed:64d536e0-a4bf-403a-8ba1-f12c3ad0e6d6 for instance 58980efb-1c1a-45bb-9ac8-99383b147058 on chh2-master-2 Jun 10 18:06:39.059508 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-b50359f2-5a57-4847-a9f8-84d04fe5bc6f req-60356fbd-8217-4b91-b70b-79df9996c9cc service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.081151 Jun 10 18:06:39.062811 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1398/2869] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:06:39.077439 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a479a8bf-59d6-4766-a578-62d5f5ec932f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:39.080472 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a479a8bf-59d6-4766-a578-62d5f5ec932f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] [instance: 42863b6d-5afb-46d7-9ec6-592145bba6e0] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:39.090883 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4fb14e2e-5b4a-4f5c-ba8a-a2160afa5679 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:39.092691 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a479a8bf-59d6-4766-a578-62d5f5ec932f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:39.093559 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a479a8bf-59d6-4766-a578-62d5f5ec932f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:39.094682 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a479a8bf-59d6-4766-a578-62d5f5ec932f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:39.095330 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a479a8bf-59d6-4766-a578-62d5f5ec932f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:39.114289 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4fb14e2e-5b4a-4f5c-ba8a-a2160afa5679 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:39.116049 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4fb14e2e-5b4a-4f5c-ba8a-a2160afa5679 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:39.118043 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-a479a8bf-59d6-4766-a578-62d5f5ec932f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] HTTP exception thrown: Instance 42863b6d-5afb-46d7-9ec6-592145bba6e0 could not be found. Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a479a8bf-59d6-4766-a578-62d5f5ec932f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Request method failure captured: Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0 HTTP/1.1 Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4aT7ZDtNgTD7bsmYg0DE4dyYI9hyVzTZoZn9JI8KjDdIMYIYOEOs1GqGLwiSWpMtOdIMlu8m1zLYUoQ6fx9aFNAP5QDfQMHsPjHdlUVi6e06F5VDYuGHApQQa7pMTSMkgvakVsQiAjjkkHaFoPrh5IDgK4RE6k56aeo5c-ALWlmr6Q Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: X-Openstack-Nova-Api-Version: 2.25 Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 01ee7bcfe44746fda89fda904f81e1b9 Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-306431913 Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/01ee7bcfe44746fda89fda904f81e1b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/01ee7bcfe44746fda89fda904f81e1b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/01ee7bcfe44746fda89fda904f81e1b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_01ee7bcfe44746fda89fda904f81e1b9", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-306431913 Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 01ee7bcfe44746fda89fda904f81e1b9 Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-306431913 Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-LiveAutoBlockMigrationV225Test-306431913-project Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: d4967895f6f041058ef60cee35a3659c Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-306431913-project Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 42863b6d-5afb-46d7-9ec6-592145bba6e0 could not be found. Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '42863b6d-5afb-46d7-9ec6-592145bba6e0'} Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42863b6d-5afb-46d7-9ec6-592145bba6e0 could not be found. Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42863b6d-5afb-46d7-9ec6-592145bba6e0 could not be found. Jun 10 18:06:39.120478 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:06:39.124795 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:06:39.124795 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:06:39.124795 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:06:39.124795 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:06:39.124795 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:06:39.124795 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:06:39.124795 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:06:39.124795 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42863b6d-5afb-46d7-9ec6-592145bba6e0 could not be found. Jun 10 18:06:39.124795 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:06:39.126717 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a479a8bf-59d6-4766-a578-62d5f5ec932f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] Returning 404 to user: Instance 42863b6d-5afb-46d7-9ec6-592145bba6e0 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:06:39.127348 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4fb14e2e-5b4a-4f5c-ba8a-a2160afa5679 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30" status: 200 len: 1366 microversion: 2.47 time: 0.167608 Jun 10 18:06:39.127999 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1472/2870] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:06:38 2022] GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:06:39.128577 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a479a8bf-59d6-4766-a578-62d5f5ec932f tempest-LiveAutoBlockMigrationV225Test-306431913 tempest-LiveAutoBlockMigrationV225Test-306431913-project] 10.222.0.35 "GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0" status: 404 len: 111 microversion: 2.25 time: 0.062414 Jun 10 18:06:39.129315 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1399/2871] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:06:39 2022] GET /compute/v2.1/servers/42863b6d-5afb-46d7-9ec6-592145bba6e0 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:06:39.168864 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7a413651-8a88-4f19-b55d-d791d0bdde51 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:39.169575 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7a413651-8a88-4f19-b55d-d791d0bdde51 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:39.190177 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7a413651-8a88-4f19-b55d-d791d0bdde51 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:39.193181 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7a413651-8a88-4f19-b55d-d791d0bdde51 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:39.194182 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7a413651-8a88-4f19-b55d-d791d0bdde51 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:39.197507 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7a413651-8a88-4f19-b55d-d791d0bdde51 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:39.342288 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-501ca6d6-bdb3-4a8e-96cd-540beecdfdfb tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:39.343914 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-501ca6d6-bdb3-4a8e-96cd-540beecdfdfb tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:39.357162 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-501ca6d6-bdb3-4a8e-96cd-540beecdfdfb tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:39.359845 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-501ca6d6-bdb3-4a8e-96cd-540beecdfdfb tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:39.360929 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-501ca6d6-bdb3-4a8e-96cd-540beecdfdfb tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:39.362716 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-501ca6d6-bdb3-4a8e-96cd-540beecdfdfb tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:39.960168 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-501ca6d6-bdb3-4a8e-96cd-540beecdfdfb tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:39.981897 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7a413651-8a88-4f19-b55d-d791d0bdde51 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:39.992008 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7a413651-8a88-4f19-b55d-d791d0bdde51 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058" status: 200 len: 1355 microversion: 2.1 time: 0.827008 Jun 10 18:06:40.011870 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-501ca6d6-bdb3-4a8e-96cd-540beecdfdfb tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b" status: 200 len: 1308 microversion: 2.1 time: 0.657380 Jun 10 18:06:40.012041 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1473/2872] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:39 2022] GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 => generated 1355 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:40.012277 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1400/2873] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:39 2022] GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b => generated 1308 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:06:40.024877 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9023fb37-d15a-4d84-9486-1d3b37763b44 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:40.030806 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9023fb37-d15a-4d84-9486-1d3b37763b44 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: d4580fa2-bf3a-4dc7-af2b-0d6af14508b3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:40.046313 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9023fb37-d15a-4d84-9486-1d3b37763b44 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:40.046915 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9023fb37-d15a-4d84-9486-1d3b37763b44 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:40.049223 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9023fb37-d15a-4d84-9486-1d3b37763b44 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:40.050275 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9023fb37-d15a-4d84-9486-1d3b37763b44 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:40.146623 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2736f411-90bd-4fd8-9cbf-68a70290bc3a tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:40.147473 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2736f411-90bd-4fd8-9cbf-68a70290bc3a tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:40.162914 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2736f411-90bd-4fd8-9cbf-68a70290bc3a tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:40.163373 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2736f411-90bd-4fd8-9cbf-68a70290bc3a tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:40.164168 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2736f411-90bd-4fd8-9cbf-68a70290bc3a tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:40.172497 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2736f411-90bd-4fd8-9cbf-68a70290bc3a tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:40.329675 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9023fb37-d15a-4d84-9486-1d3b37763b44 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:40.341166 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9023fb37-d15a-4d84-9486-1d3b37763b44 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3" status: 200 len: 1215 microversion: 2.1 time: 0.326510 Jun 10 18:06:40.342064 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1474/2874] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:40 2022] GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3 => generated 1215 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:40.400838 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2736f411-90bd-4fd8-9cbf-68a70290bc3a tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:40.419003 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2736f411-90bd-4fd8-9cbf-68a70290bc3a tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:40.425110 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2736f411-90bd-4fd8-9cbf-68a70290bc3a tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:40.426956 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2736f411-90bd-4fd8-9cbf-68a70290bc3a tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30" status: 200 len: 1366 microversion: 2.47 time: 0.284341 Jun 10 18:06:40.429443 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1401/2875] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:06:40 2022] GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30 => generated 1366 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:06:41.014674 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-054b04b8-7613-432b-82b1-955410dcf3a0 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:41.018103 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-62613f58-acd2-40f9-b54e-792f7cf662aa tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:41.019289 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-054b04b8-7613-432b-82b1-955410dcf3a0 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:41.020238 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-62613f58-acd2-40f9-b54e-792f7cf662aa tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:41.051514 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-054b04b8-7613-432b-82b1-955410dcf3a0 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:41.053777 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-62613f58-acd2-40f9-b54e-792f7cf662aa tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:41.054417 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-62613f58-acd2-40f9-b54e-792f7cf662aa tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:41.055363 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-62613f58-acd2-40f9-b54e-792f7cf662aa tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:41.056007 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-054b04b8-7613-432b-82b1-955410dcf3a0 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:41.056993 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-054b04b8-7613-432b-82b1-955410dcf3a0 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:41.057586 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-62613f58-acd2-40f9-b54e-792f7cf662aa tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:41.059897 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-054b04b8-7613-432b-82b1-955410dcf3a0 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:41.430171 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-62613f58-acd2-40f9-b54e-792f7cf662aa tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:41.441224 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-62613f58-acd2-40f9-b54e-792f7cf662aa tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058" status: 200 len: 1355 microversion: 2.1 time: 0.433778 Jun 10 18:06:41.442233 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1475/2876] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:41 2022] GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 => generated 1355 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:41.447547 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-dbf2db1c-9fbf-49a3-8879-5ef1535a45d4 req-7db36778-bcf0-43f8-b66d-97a66799e6d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58980efb-1c1a-45bb-9ac8-99383b147058", "tag": "44ed9fcb-fbc5-4fd8-82c9-6b494e913b38"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:06:41.458656 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-dbf2db1c-9fbf-49a3-8879-5ef1535a45d4 req-7db36778-bcf0-43f8-b66d-97a66799e6d3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:41.459338 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-dbf2db1c-9fbf-49a3-8879-5ef1535a45d4 req-7db36778-bcf0-43f8-b66d-97a66799e6d3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:41.472092 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-dbf2db1c-9fbf-49a3-8879-5ef1535a45d4 req-7db36778-bcf0-43f8-b66d-97a66799e6d3 service nova] Creating event network-changed:44ed9fcb-fbc5-4fd8-82c9-6b494e913b38 for instance 58980efb-1c1a-45bb-9ac8-99383b147058 on chh2-master-2 Jun 10 18:06:41.481376 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-dbf2db1c-9fbf-49a3-8879-5ef1535a45d4 req-7db36778-bcf0-43f8-b66d-97a66799e6d3 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037544 Jun 10 18:06:41.482450 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1476/2877] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:06:41.490816 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-86ac9024-c80a-4a9b-bde7-db2b78678dd3 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:41.491682 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-86ac9024-c80a-4a9b-bde7-db2b78678dd3 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: d4580fa2-bf3a-4dc7-af2b-0d6af14508b3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:41.502321 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-86ac9024-c80a-4a9b-bde7-db2b78678dd3 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:41.503095 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-86ac9024-c80a-4a9b-bde7-db2b78678dd3 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:41.504100 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-86ac9024-c80a-4a9b-bde7-db2b78678dd3 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:41.504752 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-86ac9024-c80a-4a9b-bde7-db2b78678dd3 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:41.667356 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-86ac9024-c80a-4a9b-bde7-db2b78678dd3 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:41.678333 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-86ac9024-c80a-4a9b-bde7-db2b78678dd3 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3" status: 200 len: 1289 microversion: 2.1 time: 0.193945 Jun 10 18:06:41.683717 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1477/2878] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:41 2022] GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3 => generated 1289 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:41.695474 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b6a18208-d79e-4fb7-be1a-0e514fc2de4b tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:41.696195 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b6a18208-d79e-4fb7-be1a-0e514fc2de4b tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:41.707533 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b6a18208-d79e-4fb7-be1a-0e514fc2de4b tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:41.708236 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b6a18208-d79e-4fb7-be1a-0e514fc2de4b tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:41.713524 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b6a18208-d79e-4fb7-be1a-0e514fc2de4b tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:41.714244 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b6a18208-d79e-4fb7-be1a-0e514fc2de4b tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:41.850380 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-054b04b8-7613-432b-82b1-955410dcf3a0 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:41.859601 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-054b04b8-7613-432b-82b1-955410dcf3a0 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b" status: 200 len: 1308 microversion: 2.1 time: 0.848552 Jun 10 18:06:41.860533 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b6a18208-d79e-4fb7-be1a-0e514fc2de4b tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:41.870595 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1402/2879] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:41 2022] GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b => generated 1308 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:06:41.873457 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b6a18208-d79e-4fb7-be1a-0e514fc2de4b tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:41.875057 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b6a18208-d79e-4fb7-be1a-0e514fc2de4b tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:41.877175 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b6a18208-d79e-4fb7-be1a-0e514fc2de4b tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30" status: 200 len: 1366 microversion: 2.47 time: 0.191954 Jun 10 18:06:41.877747 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1478/2880] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:06:41 2022] GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:06:42.458208 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1c3ed900-6260-4b23-a8af-15f4dd312ec7 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:42.458855 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1c3ed900-6260-4b23-a8af-15f4dd312ec7 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:42.467802 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1c3ed900-6260-4b23-a8af-15f4dd312ec7 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:42.468498 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1c3ed900-6260-4b23-a8af-15f4dd312ec7 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:42.469280 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1c3ed900-6260-4b23-a8af-15f4dd312ec7 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:42.469875 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1c3ed900-6260-4b23-a8af-15f4dd312ec7 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:42.697307 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1f9ce8f2-3ee0-4145-9c83-10c870042b06 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:42.699089 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1f9ce8f2-3ee0-4145-9c83-10c870042b06 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: d4580fa2-bf3a-4dc7-af2b-0d6af14508b3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:42.710220 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1f9ce8f2-3ee0-4145-9c83-10c870042b06 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:42.711068 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1f9ce8f2-3ee0-4145-9c83-10c870042b06 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:42.711733 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1c3ed900-6260-4b23-a8af-15f4dd312ec7 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:42.712214 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1f9ce8f2-3ee0-4145-9c83-10c870042b06 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:42.712693 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1f9ce8f2-3ee0-4145-9c83-10c870042b06 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:42.721186 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1c3ed900-6260-4b23-a8af-15f4dd312ec7 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058" status: 200 len: 1355 microversion: 2.1 time: 0.267599 Jun 10 18:06:42.731899 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1403/2881] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:42 2022] GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 => generated 1355 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:42.877871 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-96db4554-e50f-4872-a981-c33717de4474 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:42.879572 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-96db4554-e50f-4872-a981-c33717de4474 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:42.896735 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-96db4554-e50f-4872-a981-c33717de4474 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:42.901503 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-96db4554-e50f-4872-a981-c33717de4474 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:42.903607 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-96db4554-e50f-4872-a981-c33717de4474 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:42.904251 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-96db4554-e50f-4872-a981-c33717de4474 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:43.173014 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1f9ce8f2-3ee0-4145-9c83-10c870042b06 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:43.214328 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1f9ce8f2-3ee0-4145-9c83-10c870042b06 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3" status: 200 len: 1277 microversion: 2.1 time: 0.520316 Jun 10 18:06:43.230764 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1479/2882] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:42 2022] GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3 => generated 1277 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:43.245736 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f5d8c24d-53ff-4fec-b763-3015aa181a70 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:43.247876 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f5d8c24d-53ff-4fec-b763-3015aa181a70 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:43.259214 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f5d8c24d-53ff-4fec-b763-3015aa181a70 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:43.261778 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f5d8c24d-53ff-4fec-b763-3015aa181a70 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:43.303022 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f5d8c24d-53ff-4fec-b763-3015aa181a70 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.039s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:43.304951 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f5d8c24d-53ff-4fec-b763-3015aa181a70 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:43.544657 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-96db4554-e50f-4872-a981-c33717de4474 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:43.554521 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-96db4554-e50f-4872-a981-c33717de4474 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b" status: 200 len: 1308 microversion: 2.1 time: 0.680659 Jun 10 18:06:43.574362 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1404/2883] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:42 2022] GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b => generated 1308 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:43.586039 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f5d8c24d-53ff-4fec-b763-3015aa181a70 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:43.600687 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f5d8c24d-53ff-4fec-b763-3015aa181a70 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:43.602349 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f5d8c24d-53ff-4fec-b763-3015aa181a70 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:43.615703 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f5d8c24d-53ff-4fec-b763-3015aa181a70 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30" status: 200 len: 1366 microversion: 2.47 time: 0.371624 Jun 10 18:06:43.615703 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1480/2884] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:06:43 2022] GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30 => generated 1366 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:06:43.640736 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-667909ff-d74b-43b8-8891-e4fb5c4fdf67 req-4e2a9d46-97af-4378-81a2-1c6926ff5238 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "284a4545-1204-4256-a8b5-8d2e1524948b", "tag": "6d10ff2b-6274-42d1-a74b-a9738d45b4d7"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:06:43.652363 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-667909ff-d74b-43b8-8891-e4fb5c4fdf67 req-4e2a9d46-97af-4378-81a2-1c6926ff5238 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:43.655038 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-667909ff-d74b-43b8-8891-e4fb5c4fdf67 req-4e2a9d46-97af-4378-81a2-1c6926ff5238 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:43.673063 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-667909ff-d74b-43b8-8891-e4fb5c4fdf67 req-4e2a9d46-97af-4378-81a2-1c6926ff5238 service nova] Creating event network-changed:6d10ff2b-6274-42d1-a74b-a9738d45b4d7 for instance 284a4545-1204-4256-a8b5-8d2e1524948b on chh2-master-2 Jun 10 18:06:43.687614 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-667909ff-d74b-43b8-8891-e4fb5c4fdf67 req-4e2a9d46-97af-4378-81a2-1c6926ff5238 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050445 Jun 10 18:06:43.688658 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1405/2885] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:06:43.739065 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1b3b3f2f-802b-4a7e-bbdc-a1a129f33dfa tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:43.739737 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1b3b3f2f-802b-4a7e-bbdc-a1a129f33dfa tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:43.747132 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1b3b3f2f-802b-4a7e-bbdc-a1a129f33dfa tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:43.747590 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1b3b3f2f-802b-4a7e-bbdc-a1a129f33dfa tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:43.748413 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1b3b3f2f-802b-4a7e-bbdc-a1a129f33dfa tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:43.748859 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1b3b3f2f-802b-4a7e-bbdc-a1a129f33dfa tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:44.057951 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1b3b3f2f-802b-4a7e-bbdc-a1a129f33dfa tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:44.067144 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1b3b3f2f-802b-4a7e-bbdc-a1a129f33dfa tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058" status: 200 len: 1355 microversion: 2.1 time: 0.331886 Jun 10 18:06:44.068368 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1481/2886] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:43 2022] GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 => generated 1355 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:44.240109 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7e24223a-dc8e-49ce-abaa-c9fdce7ba2dc tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:44.243102 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7e24223a-dc8e-49ce-abaa-c9fdce7ba2dc tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: d4580fa2-bf3a-4dc7-af2b-0d6af14508b3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:44.261787 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e24223a-dc8e-49ce-abaa-c9fdce7ba2dc tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:44.262249 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e24223a-dc8e-49ce-abaa-c9fdce7ba2dc tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:44.263040 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e24223a-dc8e-49ce-abaa-c9fdce7ba2dc tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:44.263487 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e24223a-dc8e-49ce-abaa-c9fdce7ba2dc tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:44.456210 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7e24223a-dc8e-49ce-abaa-c9fdce7ba2dc tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:44.465125 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7e24223a-dc8e-49ce-abaa-c9fdce7ba2dc tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3" status: 200 len: 1319 microversion: 2.1 time: 0.230160 Jun 10 18:06:44.465709 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1406/2887] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:44 2022] GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3 => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:44.581725 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bcb5bc8d-d401-4b64-aac5-0832ff252bc7 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:44.582389 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bcb5bc8d-d401-4b64-aac5-0832ff252bc7 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:44.588748 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bcb5bc8d-d401-4b64-aac5-0832ff252bc7 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:44.589202 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bcb5bc8d-d401-4b64-aac5-0832ff252bc7 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:44.589963 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bcb5bc8d-d401-4b64-aac5-0832ff252bc7 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:44.590399 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bcb5bc8d-d401-4b64-aac5-0832ff252bc7 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:44.626080 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b892999b-92ff-41ca-b467-6c863948abd8 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:44.627083 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b892999b-92ff-41ca-b467-6c863948abd8 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:44.636557 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b892999b-92ff-41ca-b467-6c863948abd8 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:44.637227 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b892999b-92ff-41ca-b467-6c863948abd8 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:44.638405 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b892999b-92ff-41ca-b467-6c863948abd8 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:44.639086 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b892999b-92ff-41ca-b467-6c863948abd8 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:44.715638 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b892999b-92ff-41ca-b467-6c863948abd8 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:44.724502 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b892999b-92ff-41ca-b467-6c863948abd8 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:44.726009 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b892999b-92ff-41ca-b467-6c863948abd8 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:44.727429 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b892999b-92ff-41ca-b467-6c863948abd8 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30" status: 200 len: 1366 microversion: 2.47 time: 0.107728 Jun 10 18:06:44.728123 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1407/2888] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:06:44 2022] GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30 => generated 1366 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:06:44.915083 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bcb5bc8d-d401-4b64-aac5-0832ff252bc7 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:44.918981 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:06:44.924029 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bcb5bc8d-d401-4b64-aac5-0832ff252bc7 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b" status: 200 len: 1308 microversion: 2.1 time: 0.346161 Jun 10 18:06:44.924655 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1482/2889] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:44 2022] GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b => generated 1308 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:45.085760 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c9b05d31-d29b-4fd3-bfea-9b9b81c16946 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:45.086407 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c9b05d31-d29b-4fd3-bfea-9b9b81c16946 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:45.092774 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9b05d31-d29b-4fd3-bfea-9b9b81c16946 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:45.093253 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9b05d31-d29b-4fd3-bfea-9b9b81c16946 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:45.100837 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9b05d31-d29b-4fd3-bfea-9b9b81c16946 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:45.100837 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9b05d31-d29b-4fd3-bfea-9b9b81c16946 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:45.204112 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-53156ca8-ee33-43dd-879c-0f47b63691e0 req-686aac47-eeca-4b65-8395-0fe6c30093a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f448b274-8163-42f3-9eea-1e4f3458dd2b", "tag": "70b6fde1-0c64-4e89-803e-1fa13a46aaf6"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:06:45.217816 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-53156ca8-ee33-43dd-879c-0f47b63691e0 req-686aac47-eeca-4b65-8395-0fe6c30093a3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:45.219003 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-53156ca8-ee33-43dd-879c-0f47b63691e0 req-686aac47-eeca-4b65-8395-0fe6c30093a3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:45.258486 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-53156ca8-ee33-43dd-879c-0f47b63691e0 req-686aac47-eeca-4b65-8395-0fe6c30093a3 service nova] Creating event network-changed:70b6fde1-0c64-4e89-803e-1fa13a46aaf6 for instance f448b274-8163-42f3-9eea-1e4f3458dd2b on chh1-master-2 Jun 10 18:06:45.265011 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-53156ca8-ee33-43dd-879c-0f47b63691e0 req-686aac47-eeca-4b65-8395-0fe6c30093a3 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066297 Jun 10 18:06:45.266587 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1483/2890] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:06:45.271946 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:06:45.319731 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c9b05d31-d29b-4fd3-bfea-9b9b81c16946 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:45.329296 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c9b05d31-d29b-4fd3-bfea-9b9b81c16946 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058" status: 200 len: 1355 microversion: 2.1 time: 0.247263 Jun 10 18:06:45.339492 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1408/2891] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:45 2022] GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 => generated 1355 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:45.489187 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d21bafe5-9bf3-4ab0-8dde-33e349affbce tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:45.492003 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d21bafe5-9bf3-4ab0-8dde-33e349affbce tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: d4580fa2-bf3a-4dc7-af2b-0d6af14508b3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:45.500334 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d21bafe5-9bf3-4ab0-8dde-33e349affbce tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:45.501096 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d21bafe5-9bf3-4ab0-8dde-33e349affbce tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:45.502129 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d21bafe5-9bf3-4ab0-8dde-33e349affbce tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:45.502648 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d21bafe5-9bf3-4ab0-8dde-33e349affbce tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:45.729705 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d21bafe5-9bf3-4ab0-8dde-33e349affbce tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:45.737712 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d21bafe5-9bf3-4ab0-8dde-33e349affbce tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3" status: 200 len: 1319 microversion: 2.1 time: 0.257093 Jun 10 18:06:45.739340 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1484/2892] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:45 2022] GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3 => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:45.747769 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bfc4b335-39da-45ec-9c67-a19186920312 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:45.748479 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bfc4b335-39da-45ec-9c67-a19186920312 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:45.756238 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bfc4b335-39da-45ec-9c67-a19186920312 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:45.756782 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bfc4b335-39da-45ec-9c67-a19186920312 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:45.757618 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bfc4b335-39da-45ec-9c67-a19186920312 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:45.758226 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bfc4b335-39da-45ec-9c67-a19186920312 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:45.828960 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bfc4b335-39da-45ec-9c67-a19186920312 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:45.837327 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bfc4b335-39da-45ec-9c67-a19186920312 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:45.838840 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bfc4b335-39da-45ec-9c67-a19186920312 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:45.840016 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bfc4b335-39da-45ec-9c67-a19186920312 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30" status: 200 len: 1366 microversion: 2.47 time: 0.097038 Jun 10 18:06:45.840625 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1409/2893] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:06:45 2022] GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30 => generated 1366 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:06:45.944053 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3dcb3fda-b309-4412-8b46-e76f86d5a56a tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:45.945484 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3dcb3fda-b309-4412-8b46-e76f86d5a56a tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:45.957620 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3dcb3fda-b309-4412-8b46-e76f86d5a56a tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:45.959151 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3dcb3fda-b309-4412-8b46-e76f86d5a56a tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:45.960119 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3dcb3fda-b309-4412-8b46-e76f86d5a56a tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:45.960633 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3dcb3fda-b309-4412-8b46-e76f86d5a56a tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:46.185532 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3dcb3fda-b309-4412-8b46-e76f86d5a56a tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:46.193871 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3dcb3fda-b309-4412-8b46-e76f86d5a56a tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b" status: 200 len: 1308 microversion: 2.1 time: 0.255782 Jun 10 18:06:46.195651 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1485/2894] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:45 2022] GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b => generated 1308 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:46.347288 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-835e2b45-1e17-4f01-ade0-56223cb3aa17 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:46.348474 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-835e2b45-1e17-4f01-ade0-56223cb3aa17 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:46.351900 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=94 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:06:46.355615 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-835e2b45-1e17-4f01-ade0-56223cb3aa17 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:46.356069 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-835e2b45-1e17-4f01-ade0-56223cb3aa17 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:46.356856 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-835e2b45-1e17-4f01-ade0-56223cb3aa17 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:46.357293 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-835e2b45-1e17-4f01-ade0-56223cb3aa17 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:46.649984 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-835e2b45-1e17-4f01-ade0-56223cb3aa17 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:46.659274 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-835e2b45-1e17-4f01-ade0-56223cb3aa17 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058" status: 200 len: 1355 microversion: 2.1 time: 0.316028 Jun 10 18:06:46.669488 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1410/2895] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:46 2022] GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 => generated 1355 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:46.755419 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6b7a33c6-2403-43d9-89f0-a5dc92f9ced0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:46.756059 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6b7a33c6-2403-43d9-89f0-a5dc92f9ced0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: d4580fa2-bf3a-4dc7-af2b-0d6af14508b3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:46.764198 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6b7a33c6-2403-43d9-89f0-a5dc92f9ced0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:46.764762 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6b7a33c6-2403-43d9-89f0-a5dc92f9ced0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:46.765697 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6b7a33c6-2403-43d9-89f0-a5dc92f9ced0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:46.766062 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6b7a33c6-2403-43d9-89f0-a5dc92f9ced0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:46.859718 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4a4ce3cc-dd0a-4a7d-ae73-53396a847c08 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:46.860908 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4a4ce3cc-dd0a-4a7d-ae73-53396a847c08 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:46.869935 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a4ce3cc-dd0a-4a7d-ae73-53396a847c08 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:46.870602 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a4ce3cc-dd0a-4a7d-ae73-53396a847c08 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:46.871545 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a4ce3cc-dd0a-4a7d-ae73-53396a847c08 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:46.872431 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a4ce3cc-dd0a-4a7d-ae73-53396a847c08 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:46.881904 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:06:46.948168 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6b7a33c6-2403-43d9-89f0-a5dc92f9ced0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:46.959372 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6b7a33c6-2403-43d9-89f0-a5dc92f9ced0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3" status: 200 len: 1319 microversion: 2.1 time: 0.207536 Jun 10 18:06:46.960869 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1486/2896] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:46 2022] GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:46.968199 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-31af64f3-c532-47f9-9a83-9a28ac8612fe req-d08d4c12-55cb-4402-b9b0-c06c59b547e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4580fa2-bf3a-4dc7-af2b-0d6af14508b3", "tag": "9f84dd8d-0598-49b8-a89f-aab5783f86d9"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:06:46.977928 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-31af64f3-c532-47f9-9a83-9a28ac8612fe req-d08d4c12-55cb-4402-b9b0-c06c59b547e3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:46.978389 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-31af64f3-c532-47f9-9a83-9a28ac8612fe req-d08d4c12-55cb-4402-b9b0-c06c59b547e3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:46.991500 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-31af64f3-c532-47f9-9a83-9a28ac8612fe req-d08d4c12-55cb-4402-b9b0-c06c59b547e3 service nova] Creating event network-changed:9f84dd8d-0598-49b8-a89f-aab5783f86d9 for instance d4580fa2-bf3a-4dc7-af2b-0d6af14508b3 on chh2-master-2 Jun 10 18:06:46.996922 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-31af64f3-c532-47f9-9a83-9a28ac8612fe req-d08d4c12-55cb-4402-b9b0-c06c59b547e3 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032441 Jun 10 18:06:46.997941 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1487/2897] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:06:47.074912 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=8 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:06:47.081540 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7732caa7-a7ab-445b-9573-43d27d51a896 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:47.081540 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7732caa7-a7ab-445b-9573-43d27d51a896 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:47.102387 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7732caa7-a7ab-445b-9573-43d27d51a896 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:47.102853 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7732caa7-a7ab-445b-9573-43d27d51a896 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:47.112101 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7732caa7-a7ab-445b-9573-43d27d51a896 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:47.113939 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7732caa7-a7ab-445b-9573-43d27d51a896 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:47.250487 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4a4ce3cc-dd0a-4a7d-ae73-53396a847c08 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:47.260537 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4a4ce3cc-dd0a-4a7d-ae73-53396a847c08 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:47.262513 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4a4ce3cc-dd0a-4a7d-ae73-53396a847c08 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:47.265398 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4a4ce3cc-dd0a-4a7d-ae73-53396a847c08 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30" status: 200 len: 1366 microversion: 2.47 time: 0.409001 Jun 10 18:06:47.265398 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1411/2898] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:06:46 2022] GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30 => generated 1366 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:06:47.281723 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b704804b-630a-4795-a027-958b0970bdf1 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:47.282582 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b704804b-630a-4795-a027-958b0970bdf1 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:47.289072 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b704804b-630a-4795-a027-958b0970bdf1 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:47.289549 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b704804b-630a-4795-a027-958b0970bdf1 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:47.290358 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b704804b-630a-4795-a027-958b0970bdf1 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:47.290872 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b704804b-630a-4795-a027-958b0970bdf1 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:47.306481 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7732caa7-a7ab-445b-9573-43d27d51a896 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:47.316899 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7732caa7-a7ab-445b-9573-43d27d51a896 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.242034 Jun 10 18:06:47.317740 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1488/2899] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:47 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:06:47.336915 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fc159216-7f3e-49a9-b2b5-9f7483d152b8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:47.337606 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fc159216-7f3e-49a9-b2b5-9f7483d152b8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:47.354954 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fc159216-7f3e-49a9-b2b5-9f7483d152b8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:47.355413 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fc159216-7f3e-49a9-b2b5-9f7483d152b8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:47.356287 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fc159216-7f3e-49a9-b2b5-9f7483d152b8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:47.359147 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fc159216-7f3e-49a9-b2b5-9f7483d152b8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:47.463030 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b704804b-630a-4795-a027-958b0970bdf1 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:47.472790 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b704804b-630a-4795-a027-958b0970bdf1 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b" status: 200 len: 1308 microversion: 2.1 time: 0.207176 Jun 10 18:06:47.474164 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1412/2900] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:47 2022] GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b => generated 1308 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:47.517988 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fc159216-7f3e-49a9-b2b5-9f7483d152b8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:47.525681 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fc159216-7f3e-49a9-b2b5-9f7483d152b8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.194171 Jun 10 18:06:47.526360 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1489/2901] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:47 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:06:47.542367 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-90a783b6-bc48-4f93-95f5-7018fd11d1a6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:47.543084 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-90a783b6-bc48-4f93-95f5-7018fd11d1a6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:47.551255 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-90a783b6-bc48-4f93-95f5-7018fd11d1a6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:47.554469 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-90a783b6-bc48-4f93-95f5-7018fd11d1a6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:47.554469 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-90a783b6-bc48-4f93-95f5-7018fd11d1a6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:47.554469 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-90a783b6-bc48-4f93-95f5-7018fd11d1a6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:47.679939 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e273e5ff-a95f-4b2f-9d6a-0e64353b17f8 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:47.681504 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e273e5ff-a95f-4b2f-9d6a-0e64353b17f8 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:47.692142 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e273e5ff-a95f-4b2f-9d6a-0e64353b17f8 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:47.692875 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e273e5ff-a95f-4b2f-9d6a-0e64353b17f8 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:47.694110 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e273e5ff-a95f-4b2f-9d6a-0e64353b17f8 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:47.694945 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e273e5ff-a95f-4b2f-9d6a-0e64353b17f8 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:47.708810 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-90a783b6-bc48-4f93-95f5-7018fd11d1a6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:47.718371 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-90a783b6-bc48-4f93-95f5-7018fd11d1a6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.179661 Jun 10 18:06:47.720106 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1413/2902] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:47 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:47.738095 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c8eaf5a1-7dff-42ac-993b-53700d705bac tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:47.741406 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c8eaf5a1-7dff-42ac-993b-53700d705bac tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:47.751759 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c8eaf5a1-7dff-42ac-993b-53700d705bac tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:47.752564 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c8eaf5a1-7dff-42ac-993b-53700d705bac tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:47.753448 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c8eaf5a1-7dff-42ac-993b-53700d705bac tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:47.753900 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c8eaf5a1-7dff-42ac-993b-53700d705bac tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:47.888378 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e273e5ff-a95f-4b2f-9d6a-0e64353b17f8 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:47.906606 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e273e5ff-a95f-4b2f-9d6a-0e64353b17f8 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058" status: 200 len: 1355 microversion: 2.1 time: 0.233218 Jun 10 18:06:47.907201 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1490/2903] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:47 2022] GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 => generated 1355 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:06:47.933723 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c8eaf5a1-7dff-42ac-993b-53700d705bac tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:47.942643 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c8eaf5a1-7dff-42ac-993b-53700d705bac tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.209832 Jun 10 18:06:47.945076 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1414/2904] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:47 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:06:47.979855 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-70bafb32-5526-4ce2-937f-116c69c9895c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:47.980818 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-70bafb32-5526-4ce2-937f-116c69c9895c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: d4580fa2-bf3a-4dc7-af2b-0d6af14508b3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:47.995281 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-70bafb32-5526-4ce2-937f-116c69c9895c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:47.995853 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-70bafb32-5526-4ce2-937f-116c69c9895c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:47.997101 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-70bafb32-5526-4ce2-937f-116c69c9895c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:47.998428 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-70bafb32-5526-4ce2-937f-116c69c9895c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:48.070220 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-942a26b4-e00f-4437-a420-2d1433fcc3eb tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-608893404", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "02812646-dd80-4769-8285-9699f6c583d0"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:06:48.140672 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-942a26b4-e00f-4437-a420-2d1433fcc3eb tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] validate_networks() for [('02812646-dd80-4769-8285-9699f6c583d0', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:06:48.170064 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-70bafb32-5526-4ce2-937f-116c69c9895c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:48.179839 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-70bafb32-5526-4ce2-937f-116c69c9895c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3" status: 200 len: 1319 microversion: 2.1 time: 0.205792 Jun 10 18:06:48.180483 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1491/2905] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:47 2022] GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3 => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:06:48.283207 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-13907519-05f2-4e60-a812-706ddce6e680 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:48.285740 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-13907519-05f2-4e60-a812-706ddce6e680 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:48.293327 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-13907519-05f2-4e60-a812-706ddce6e680 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:48.293781 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-13907519-05f2-4e60-a812-706ddce6e680 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:48.294718 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-13907519-05f2-4e60-a812-706ddce6e680 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:48.295315 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-13907519-05f2-4e60-a812-706ddce6e680 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:48.367909 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-13907519-05f2-4e60-a812-706ddce6e680 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:48.378127 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-13907519-05f2-4e60-a812-706ddce6e680 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:48.380171 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-13907519-05f2-4e60-a812-706ddce6e680 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:48.381369 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-13907519-05f2-4e60-a812-706ddce6e680 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30" status: 200 len: 1366 microversion: 2.47 time: 0.102376 Jun 10 18:06:48.393542 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1492/2906] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:06:48 2022] GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30 => generated 1366 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:06:48.492707 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=32 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:06:48.587133 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=32 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:06:48.617255 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-942a26b4-e00f-4437-a420-2d1433fcc3eb tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:06:48.617680 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-942a26b4-e00f-4437-a420-2d1433fcc3eb tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:06:48.618159 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-942a26b4-e00f-4437-a420-2d1433fcc3eb tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:06:48.619293 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-942a26b4-e00f-4437-a420-2d1433fcc3eb tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:06:48.621950 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-942a26b4-e00f-4437-a420-2d1433fcc3eb tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:06:48.635584 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-942a26b4-e00f-4437-a420-2d1433fcc3eb tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:48.636022 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-942a26b4-e00f-4437-a420-2d1433fcc3eb tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:48.639112 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-942a26b4-e00f-4437-a420-2d1433fcc3eb tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:48.639112 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-942a26b4-e00f-4437-a420-2d1433fcc3eb tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:48.662109 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f3f5b413-4d23-4467-acd4-6e97d3c0cc14 tempest-ServicesAdminNegativeTestJSON-1670146759 tempest-ServicesAdminNegativeTestJSON-1670146759-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:48.666753 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:06:48.666753 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 18:06:48.671326 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f3f5b413-4d23-4467-acd4-6e97d3c0cc14 tempest-ServicesAdminNegativeTestJSON-1670146759 tempest-ServicesAdminNegativeTestJSON-1670146759-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:48.672001 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f3f5b413-4d23-4467-acd4-6e97d3c0cc14 tempest-ServicesAdminNegativeTestJSON-1670146759 tempest-ServicesAdminNegativeTestJSON-1670146759-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:48.679620 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f3f5b413-4d23-4467-acd4-6e97d3c0cc14 tempest-ServicesAdminNegativeTestJSON-1670146759 tempest-ServicesAdminNegativeTestJSON-1670146759-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:48.680398 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f3f5b413-4d23-4467-acd4-6e97d3c0cc14 tempest-ServicesAdminNegativeTestJSON-1670146759 tempest-ServicesAdminNegativeTestJSON-1670146759-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:48.688910 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-942a26b4-e00f-4437-a420-2d1433fcc3eb tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Getting quotas for project 2b34cb51c168497088d66fa0e507e364. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:06:48.698360 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-942a26b4-e00f-4437-a420-2d1433fcc3eb tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Getting quotas for user 352e7f5de76c42da9241721fe0f0bf86 and project 2b34cb51c168497088d66fa0e507e364. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:06:48.732690 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-942a26b4-e00f-4437-a420-2d1433fcc3eb tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:06:48.735532 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-942a26b4-e00f-4437-a420-2d1433fcc3eb tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 5cb5b4a5-d399-4f64-8f6a-8815d86e921a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:06:48.757072 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f3f5b413-4d23-4467-acd4-6e97d3c0cc14 tempest-ServicesAdminNegativeTestJSON-1670146759 tempest-ServicesAdminNegativeTestJSON-1670146759-project-admin] 10.222.0.35 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.278956 Jun 10 18:06:48.757923 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1493/2907] 10.222.0.35 () {58 vars in 1136 bytes} [Fri Jun 10 18:06:48 2022] GET /compute/v2.1/os-services => generated 947 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:06:48.770260 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-94d24bf6-5382-40d9-b1c8-9e2d680c8003 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:48.772491 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-94d24bf6-5382-40d9-b1c8-9e2d680c8003 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:48.793758 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-94d24bf6-5382-40d9-b1c8-9e2d680c8003 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:48.797483 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-94d24bf6-5382-40d9-b1c8-9e2d680c8003 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:48.797483 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-94d24bf6-5382-40d9-b1c8-9e2d680c8003 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:48.797483 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-94d24bf6-5382-40d9-b1c8-9e2d680c8003 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:48.871159 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-942a26b4-e00f-4437-a420-2d1433fcc3eb tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.805067 Jun 10 18:06:48.871813 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1415/2908] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:06:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:06:48.884804 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cf6afbfd-1dd2-493d-90ff-1dff0564b0b6 tempest-ServicesAdminNegativeTestJSON-1670146759 tempest-ServicesAdminNegativeTestJSON-1670146759-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:48.890082 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:06:48.890082 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 18:06:48.902525 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cf6afbfd-1dd2-493d-90ff-1dff0564b0b6 tempest-ServicesAdminNegativeTestJSON-1670146759 tempest-ServicesAdminNegativeTestJSON-1670146759-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:48.902525 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cf6afbfd-1dd2-493d-90ff-1dff0564b0b6 tempest-ServicesAdminNegativeTestJSON-1670146759 tempest-ServicesAdminNegativeTestJSON-1670146759-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:48.902525 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cf6afbfd-1dd2-493d-90ff-1dff0564b0b6 tempest-ServicesAdminNegativeTestJSON-1670146759 tempest-ServicesAdminNegativeTestJSON-1670146759-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:48.902525 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cf6afbfd-1dd2-493d-90ff-1dff0564b0b6 tempest-ServicesAdminNegativeTestJSON-1670146759 tempest-ServicesAdminNegativeTestJSON-1670146759-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:48.958597 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cf6afbfd-1dd2-493d-90ff-1dff0564b0b6 tempest-ServicesAdminNegativeTestJSON-1670146759 tempest-ServicesAdminNegativeTestJSON-1670146759-project-admin] 10.222.0.35 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.084727 Jun 10 18:06:48.964518 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1416/2909] 10.222.0.35 () {58 vars in 1169 bytes} [Fri Jun 10 18:06:48 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 947 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:06:48.978516 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3cb44451-93d3-438d-a261-3d39be8a8c38 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:48.979233 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3cb44451-93d3-438d-a261-3d39be8a8c38 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 5cb5b4a5-d399-4f64-8f6a-8815d86e921a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:49.068633 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3cb44451-93d3-438d-a261-3d39be8a8c38 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:49.077226 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3cb44451-93d3-438d-a261-3d39be8a8c38 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a" status: 200 len: 1214 microversion: 2.1 time: 0.110916 Jun 10 18:06:49.077822 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1417/2910] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:48 2022] GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a => generated 1214 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:49.096591 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0053d6c8-42e8-4ffb-a19a-24111416f86d tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:49.096591 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0053d6c8-42e8-4ffb-a19a-24111416f86d tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:49.114637 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0053d6c8-42e8-4ffb-a19a-24111416f86d tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:49.115194 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0053d6c8-42e8-4ffb-a19a-24111416f86d tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:49.117132 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0053d6c8-42e8-4ffb-a19a-24111416f86d tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:49.118112 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0053d6c8-42e8-4ffb-a19a-24111416f86d tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:49.225497 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-94d24bf6-5382-40d9-b1c8-9e2d680c8003 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:49.235304 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-94d24bf6-5382-40d9-b1c8-9e2d680c8003 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b" status: 200 len: 1308 microversion: 2.1 time: 0.475815 Jun 10 18:06:49.236752 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1494/2911] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:48 2022] GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b => generated 1308 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:49.242533 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8fb5ecde-519d-4924-8265-600fbd5e70bb tempest-ServicesAdminNegativeTestJSON-1670146759 tempest-ServicesAdminNegativeTestJSON-1670146759-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:49.248748 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:06:49.248748 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 18:06:49.248748 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8fb5ecde-519d-4924-8265-600fbd5e70bb tempest-ServicesAdminNegativeTestJSON-1670146759 tempest-ServicesAdminNegativeTestJSON-1670146759-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:49.248748 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8fb5ecde-519d-4924-8265-600fbd5e70bb tempest-ServicesAdminNegativeTestJSON-1670146759 tempest-ServicesAdminNegativeTestJSON-1670146759-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:49.248748 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8fb5ecde-519d-4924-8265-600fbd5e70bb tempest-ServicesAdminNegativeTestJSON-1670146759 tempest-ServicesAdminNegativeTestJSON-1670146759-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:49.248748 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8fb5ecde-519d-4924-8265-600fbd5e70bb tempest-ServicesAdminNegativeTestJSON-1670146759 tempest-ServicesAdminNegativeTestJSON-1670146759-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:49.278143 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8fb5ecde-519d-4924-8265-600fbd5e70bb tempest-ServicesAdminNegativeTestJSON-1670146759 tempest-ServicesAdminNegativeTestJSON-1670146759-project-admin] 10.222.0.35 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.040119 Jun 10 18:06:49.282097 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1495/2912] 10.222.0.35 () {58 vars in 1136 bytes} [Fri Jun 10 18:06:49 2022] GET /compute/v2.1/os-services => generated 947 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:06:49.288534 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b9f2795a-7b6c-411c-91fe-1c145bf85661 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:49.289374 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b9f2795a-7b6c-411c-91fe-1c145bf85661 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: d4580fa2-bf3a-4dc7-af2b-0d6af14508b3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:49.297104 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9f2795a-7b6c-411c-91fe-1c145bf85661 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:49.298081 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9f2795a-7b6c-411c-91fe-1c145bf85661 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:49.299010 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9f2795a-7b6c-411c-91fe-1c145bf85661 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:49.299619 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9f2795a-7b6c-411c-91fe-1c145bf85661 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:49.556773 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b9f2795a-7b6c-411c-91fe-1c145bf85661 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:49.567264 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b9f2795a-7b6c-411c-91fe-1c145bf85661 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3" status: 200 len: 1319 microversion: 2.1 time: 0.283114 Jun 10 18:06:49.568455 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1496/2913] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:49 2022] GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3 => generated 1319 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:49.585268 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4e143190-497c-43a8-ba5a-05548d0b4195 tempest-ServicesAdminNegativeTestJSON-1670146759 tempest-ServicesAdminNegativeTestJSON-1670146759-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:49.587663 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:06:49.587663 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 18:06:49.590090 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4e143190-497c-43a8-ba5a-05548d0b4195 tempest-ServicesAdminNegativeTestJSON-1670146759 tempest-ServicesAdminNegativeTestJSON-1670146759-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:49.590830 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4e143190-497c-43a8-ba5a-05548d0b4195 tempest-ServicesAdminNegativeTestJSON-1670146759 tempest-ServicesAdminNegativeTestJSON-1670146759-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:49.591857 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4e143190-497c-43a8-ba5a-05548d0b4195 tempest-ServicesAdminNegativeTestJSON-1670146759 tempest-ServicesAdminNegativeTestJSON-1670146759-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:49.592338 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4e143190-497c-43a8-ba5a-05548d0b4195 tempest-ServicesAdminNegativeTestJSON-1670146759 tempest-ServicesAdminNegativeTestJSON-1670146759-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:49.604599 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0053d6c8-42e8-4ffb-a19a-24111416f86d tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:49.618519 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0053d6c8-42e8-4ffb-a19a-24111416f86d tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058" status: 200 len: 1355 microversion: 2.1 time: 0.539067 Jun 10 18:06:49.623848 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4e143190-497c-43a8-ba5a-05548d0b4195 tempest-ServicesAdminNegativeTestJSON-1670146759 tempest-ServicesAdminNegativeTestJSON-1670146759-project-admin] 10.222.0.35 "GET /compute/v2.1/os-services?host=chdv-master-2&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.053865 Jun 10 18:06:49.630684 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1497/2914] 10.222.0.35 () {58 vars in 1195 bytes} [Fri Jun 10 18:06:49 2022] GET /compute/v2.1/os-services?host=chdv-master-2&binary=xxx => generated 16 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:06:49.632414 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-799310b8-024d-4457-95ba-b878f3b360c4 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:49.632655 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1418/2915] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:49 2022] GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 => generated 1355 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:49.633050 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-799310b8-024d-4457-95ba-b878f3b360c4 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:49.641400 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-799310b8-024d-4457-95ba-b878f3b360c4 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:49.641400 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-799310b8-024d-4457-95ba-b878f3b360c4 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:49.641400 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-799310b8-024d-4457-95ba-b878f3b360c4 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:49.641745 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-799310b8-024d-4457-95ba-b878f3b360c4 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:49.655372 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3b9dacea-e03a-4923-9a6c-614c73d76ba5 tempest-ServicesAdminNegativeTestJSON-1670146759 tempest-ServicesAdminNegativeTestJSON-1670146759-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:49.656977 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:06:49.656977 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 18:06:49.660982 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3b9dacea-e03a-4923-9a6c-614c73d76ba5 tempest-ServicesAdminNegativeTestJSON-1670146759 tempest-ServicesAdminNegativeTestJSON-1670146759-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:49.663544 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3b9dacea-e03a-4923-9a6c-614c73d76ba5 tempest-ServicesAdminNegativeTestJSON-1670146759 tempest-ServicesAdminNegativeTestJSON-1670146759-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:49.664694 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3b9dacea-e03a-4923-9a6c-614c73d76ba5 tempest-ServicesAdminNegativeTestJSON-1670146759 tempest-ServicesAdminNegativeTestJSON-1670146759-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:49.669438 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3b9dacea-e03a-4923-9a6c-614c73d76ba5 tempest-ServicesAdminNegativeTestJSON-1670146759 tempest-ServicesAdminNegativeTestJSON-1670146759-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:49.735465 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3b9dacea-e03a-4923-9a6c-614c73d76ba5 tempest-ServicesAdminNegativeTestJSON-1670146759 tempest-ServicesAdminNegativeTestJSON-1670146759-project-admin] 10.222.0.35 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.094371 Jun 10 18:06:49.740357 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1419/2916] 10.222.0.35 () {58 vars in 1136 bytes} [Fri Jun 10 18:06:49 2022] GET /compute/v2.1/os-services => generated 947 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:06:49.748580 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-077edf40-f1ea-41a2-92db-2cff79a54a22 tempest-ServicesAdminNegativeTestJSON-1670146759 tempest-ServicesAdminNegativeTestJSON-1670146759-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:49.750404 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:06:49.750404 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 18:06:49.754920 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-077edf40-f1ea-41a2-92db-2cff79a54a22 tempest-ServicesAdminNegativeTestJSON-1670146759 tempest-ServicesAdminNegativeTestJSON-1670146759-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:49.755533 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-077edf40-f1ea-41a2-92db-2cff79a54a22 tempest-ServicesAdminNegativeTestJSON-1670146759 tempest-ServicesAdminNegativeTestJSON-1670146759-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:49.756560 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-077edf40-f1ea-41a2-92db-2cff79a54a22 tempest-ServicesAdminNegativeTestJSON-1670146759 tempest-ServicesAdminNegativeTestJSON-1670146759-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:49.757152 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-077edf40-f1ea-41a2-92db-2cff79a54a22 tempest-ServicesAdminNegativeTestJSON-1670146759 tempest-ServicesAdminNegativeTestJSON-1670146759-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:49.757766 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-799310b8-024d-4457-95ba-b878f3b360c4 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:49.771960 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-799310b8-024d-4457-95ba-b878f3b360c4 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:49.778041 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-799310b8-024d-4457-95ba-b878f3b360c4 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:49.783935 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-799310b8-024d-4457-95ba-b878f3b360c4 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30" status: 200 len: 1366 microversion: 2.47 time: 0.155093 Jun 10 18:06:49.788511 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1498/2917] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:06:49 2022] GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:06:49.805588 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-077edf40-f1ea-41a2-92db-2cff79a54a22 tempest-ServicesAdminNegativeTestJSON-1670146759 tempest-ServicesAdminNegativeTestJSON-1670146759-project-admin] 10.222.0.35 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.060777 Jun 10 18:06:49.812208 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1420/2918] 10.222.0.35 () {58 vars in 1197 bytes} [Fri Jun 10 18:06:49 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:06:49.950522 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-97c1e51b-f334-4480-b630-2950cde76ad8 tempest-ServicesAdminNegativeTestJSON-2049412102 tempest-ServicesAdminNegativeTestJSON-2049412102-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:49.951867 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:06:49.951867 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 18:06:49.953230 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-97c1e51b-f334-4480-b630-2950cde76ad8 tempest-ServicesAdminNegativeTestJSON-2049412102 tempest-ServicesAdminNegativeTestJSON-2049412102-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'a12e116467ef46b490a0256005ae5043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c64fbbf43449929972eece47df891a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-97c1e51b-f334-4480-b630-2950cde76ad8 tempest-ServicesAdminNegativeTestJSON-2049412102 tempest-ServicesAdminNegativeTestJSON-2049412102-project] Request method failure captured: Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/os-services HTTP/1.1 Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4g3m09DBj3ry_9En88AJYBU59Ri4mBRpPYx43yWSkZ34o-YiXY53c4rvY3zBi5DdtGZNCkt7SH7FbdUgiRuBFwCu_qRrGYUocZeu_W99aDiD8KOWQWnwQj9_9O0ZeHcLgAZsabLNkBQo9jsZ83Dc-KSOIygqh9egVNvVMvteqU112o Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 74c64fbbf43449929972eece47df891a Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-2049412102 Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/74c64fbbf43449929972eece47df891a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/74c64fbbf43449929972eece47df891a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/74c64fbbf43449929972eece47df891a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_74c64fbbf43449929972eece47df891a", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-2049412102 Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 74c64fbbf43449929972eece47df891a Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-2049412102 Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServicesAdminNegativeTestJSON-2049412102-project Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: a12e116467ef46b490a0256005ae5043 Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-2049412102-project Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: action_args: {} Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 10 18:06:49.955098 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:06:49.959127 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:06:49.959127 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:06:49.959127 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:06:49.959127 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:06:49.959127 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:06:49.959127 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 10 18:06:49.959127 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 10 18:06:49.959127 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 10 18:06:49.959127 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:06:49.960136 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-97c1e51b-f334-4480-b630-2950cde76ad8 tempest-ServicesAdminNegativeTestJSON-2049412102 tempest-ServicesAdminNegativeTestJSON-2049412102-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:06:49.963715 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-97c1e51b-f334-4480-b630-2950cde76ad8 tempest-ServicesAdminNegativeTestJSON-2049412102 tempest-ServicesAdminNegativeTestJSON-2049412102-project] 10.222.0.35 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.149375 Jun 10 18:06:49.968481 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1499/2919] 10.222.0.35 () {58 vars in 1136 bytes} [Fri Jun 10 18:06:49 2022] GET /compute/v2.1/os-services => generated 112 bytes in 151 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:06:50.095042 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-aff2d195-5ea6-47c8-826f-7f29ad48b8b6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:50.095730 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-aff2d195-5ea6-47c8-826f-7f29ad48b8b6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 5cb5b4a5-d399-4f64-8f6a-8815d86e921a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:50.104237 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aff2d195-5ea6-47c8-826f-7f29ad48b8b6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:50.105149 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aff2d195-5ea6-47c8-826f-7f29ad48b8b6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:50.106436 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aff2d195-5ea6-47c8-826f-7f29ad48b8b6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:50.107069 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aff2d195-5ea6-47c8-826f-7f29ad48b8b6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:50.172472 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-aff2d195-5ea6-47c8-826f-7f29ad48b8b6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:50.180925 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-aff2d195-5ea6-47c8-826f-7f29ad48b8b6 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a" status: 200 len: 1218 microversion: 2.1 time: 0.090058 Jun 10 18:06:50.182127 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1421/2920] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:50 2022] GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:50.254868 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-445a9379-cffe-4531-a1f2-294dfa7c20bb tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:50.255619 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-445a9379-cffe-4531-a1f2-294dfa7c20bb tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:50.266405 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-445a9379-cffe-4531-a1f2-294dfa7c20bb tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:50.267124 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-445a9379-cffe-4531-a1f2-294dfa7c20bb tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:50.268110 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-445a9379-cffe-4531-a1f2-294dfa7c20bb tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:50.268767 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-445a9379-cffe-4531-a1f2-294dfa7c20bb tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:50.401100 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-f3d7a3c1-d4b2-4b57-bec9-30e9d6502125 req-1e4d4217-a5c1-41c7-ab10-40d3e3c7165c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "284a4545-1204-4256-a8b5-8d2e1524948b", "name": "network-vif-plugged", "status": "completed", "tag": "6d10ff2b-6274-42d1-a74b-a9738d45b4d7"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:06:50.414041 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-f3d7a3c1-d4b2-4b57-bec9-30e9d6502125 req-1e4d4217-a5c1-41c7-ab10-40d3e3c7165c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:50.414616 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-f3d7a3c1-d4b2-4b57-bec9-30e9d6502125 req-1e4d4217-a5c1-41c7-ab10-40d3e3c7165c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:50.427207 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-f3d7a3c1-d4b2-4b57-bec9-30e9d6502125 req-1e4d4217-a5c1-41c7-ab10-40d3e3c7165c service nova] Creating event network-vif-plugged:6d10ff2b-6274-42d1-a74b-a9738d45b4d7 for instance 284a4545-1204-4256-a8b5-8d2e1524948b on chh2-master-2 Jun 10 18:06:50.432997 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-f3d7a3c1-d4b2-4b57-bec9-30e9d6502125 req-1e4d4217-a5c1-41c7-ab10-40d3e3c7165c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042053 Jun 10 18:06:50.434043 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1422/2921] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:06:50.462243 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-445a9379-cffe-4531-a1f2-294dfa7c20bb tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:50.470062 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-445a9379-cffe-4531-a1f2-294dfa7c20bb tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b" status: 200 len: 1308 microversion: 2.1 time: 0.220921 Jun 10 18:06:50.470638 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1500/2922] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:50 2022] GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b => generated 1308 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:50.593561 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7c8df73f-bf2f-4783-a033-52865fe9bb60 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:50.594442 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7c8df73f-bf2f-4783-a033-52865fe9bb60 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: d4580fa2-bf3a-4dc7-af2b-0d6af14508b3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:50.610359 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7c8df73f-bf2f-4783-a033-52865fe9bb60 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:50.611082 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7c8df73f-bf2f-4783-a033-52865fe9bb60 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:50.611609 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7c8df73f-bf2f-4783-a033-52865fe9bb60 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:50.614429 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7c8df73f-bf2f-4783-a033-52865fe9bb60 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:50.635693 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f4fb2a6d-8e82-443f-a24f-201ec5e442f1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:50.637597 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f4fb2a6d-8e82-443f-a24f-201ec5e442f1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:50.645550 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4fb2a6d-8e82-443f-a24f-201ec5e442f1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:50.646787 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4fb2a6d-8e82-443f-a24f-201ec5e442f1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:50.647907 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4fb2a6d-8e82-443f-a24f-201ec5e442f1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:50.648562 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4fb2a6d-8e82-443f-a24f-201ec5e442f1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:50.773758 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7c8df73f-bf2f-4783-a033-52865fe9bb60 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:50.784368 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7c8df73f-bf2f-4783-a033-52865fe9bb60 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3" status: 200 len: 1319 microversion: 2.1 time: 0.201343 Jun 10 18:06:50.784916 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1423/2923] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:50 2022] GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3 => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:50.806229 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b0e0fc10-4f13-4614-b2d7-52dab7657261 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:50.806839 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b0e0fc10-4f13-4614-b2d7-52dab7657261 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:50.814372 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b0e0fc10-4f13-4614-b2d7-52dab7657261 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:50.814827 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b0e0fc10-4f13-4614-b2d7-52dab7657261 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:50.815854 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b0e0fc10-4f13-4614-b2d7-52dab7657261 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:50.817151 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b0e0fc10-4f13-4614-b2d7-52dab7657261 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:50.860845 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f4fb2a6d-8e82-443f-a24f-201ec5e442f1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:50.870235 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f4fb2a6d-8e82-443f-a24f-201ec5e442f1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058" status: 200 len: 1355 microversion: 2.1 time: 0.238325 Jun 10 18:06:50.871038 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1501/2924] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:50 2022] GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 => generated 1355 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:06:50.897215 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b0e0fc10-4f13-4614-b2d7-52dab7657261 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:50.907703 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b0e0fc10-4f13-4614-b2d7-52dab7657261 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:50.907703 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b0e0fc10-4f13-4614-b2d7-52dab7657261 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:50.908680 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b0e0fc10-4f13-4614-b2d7-52dab7657261 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30" status: 200 len: 1366 microversion: 2.47 time: 0.106207 Jun 10 18:06:50.920743 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1424/2925] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:06:50 2022] GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30 => generated 1366 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:06:51.198841 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3d0a7f56-42d4-4640-a8cd-9339a163d5de tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:51.439135 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3d0a7f56-42d4-4640-a8cd-9339a163d5de tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 5cb5b4a5-d399-4f64-8f6a-8815d86e921a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:51.439135 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3d0a7f56-42d4-4640-a8cd-9339a163d5de tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:51.439135 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3d0a7f56-42d4-4640-a8cd-9339a163d5de tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:51.439135 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3d0a7f56-42d4-4640-a8cd-9339a163d5de tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:51.439135 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3d0a7f56-42d4-4640-a8cd-9339a163d5de tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:51.439135 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3d0a7f56-42d4-4640-a8cd-9339a163d5de tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:51.439135 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3d0a7f56-42d4-4640-a8cd-9339a163d5de tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a" status: 200 len: 1218 microversion: 2.1 time: 0.082332 Jun 10 18:06:51.439135 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1502/2926] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:51 2022] GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:51.486872 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1f0b4851-37ce-4b6a-b589-06ef18988483 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:51.487482 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1f0b4851-37ce-4b6a-b589-06ef18988483 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:51.495074 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f0b4851-37ce-4b6a-b589-06ef18988483 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:51.495527 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f0b4851-37ce-4b6a-b589-06ef18988483 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:51.496289 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f0b4851-37ce-4b6a-b589-06ef18988483 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:51.496748 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f0b4851-37ce-4b6a-b589-06ef18988483 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:51.657905 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1f0b4851-37ce-4b6a-b589-06ef18988483 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:51.666433 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1f0b4851-37ce-4b6a-b589-06ef18988483 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b" status: 200 len: 1308 microversion: 2.1 time: 0.183305 Jun 10 18:06:51.670113 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1425/2927] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:51 2022] GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b => generated 1308 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:51.800511 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e509bec2-f337-4917-a18b-e38b644a41ad tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:51.801137 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e509bec2-f337-4917-a18b-e38b644a41ad tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: d4580fa2-bf3a-4dc7-af2b-0d6af14508b3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:51.807672 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e509bec2-f337-4917-a18b-e38b644a41ad tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:51.808128 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e509bec2-f337-4917-a18b-e38b644a41ad tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:51.808931 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e509bec2-f337-4917-a18b-e38b644a41ad tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:51.809372 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e509bec2-f337-4917-a18b-e38b644a41ad tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:51.891466 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0127e8f9-3276-480d-b950-9ade434445f5 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:51.892878 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0127e8f9-3276-480d-b950-9ade434445f5 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:51.903043 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0127e8f9-3276-480d-b950-9ade434445f5 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:51.903744 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0127e8f9-3276-480d-b950-9ade434445f5 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:51.905084 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0127e8f9-3276-480d-b950-9ade434445f5 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:51.906109 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0127e8f9-3276-480d-b950-9ade434445f5 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:51.984335 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e509bec2-f337-4917-a18b-e38b644a41ad tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:51.984959 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:06:51.994485 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e509bec2-f337-4917-a18b-e38b644a41ad tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3" status: 200 len: 1319 microversion: 2.1 time: 0.197812 Jun 10 18:06:51.995233 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1503/2928] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:51 2022] GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3 => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:52.000667 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ba4db9cf-56ec-4c5e-8854-56500de62cf9 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:52.002523 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ba4db9cf-56ec-4c5e-8854-56500de62cf9 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:52.010293 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ba4db9cf-56ec-4c5e-8854-56500de62cf9 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:52.010750 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ba4db9cf-56ec-4c5e-8854-56500de62cf9 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:52.011527 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ba4db9cf-56ec-4c5e-8854-56500de62cf9 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:52.011967 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ba4db9cf-56ec-4c5e-8854-56500de62cf9 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:52.085519 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ba4db9cf-56ec-4c5e-8854-56500de62cf9 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:52.095215 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ba4db9cf-56ec-4c5e-8854-56500de62cf9 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:52.096888 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ba4db9cf-56ec-4c5e-8854-56500de62cf9 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:52.098386 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ba4db9cf-56ec-4c5e-8854-56500de62cf9 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30" status: 200 len: 1366 microversion: 2.47 time: 0.101707 Jun 10 18:06:52.099423 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1504/2929] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:06:51 2022] GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30 => generated 1366 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:06:52.109082 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0127e8f9-3276-480d-b950-9ade434445f5 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:52.117265 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0127e8f9-3276-480d-b950-9ade434445f5 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058" status: 200 len: 1355 microversion: 2.1 time: 0.233803 Jun 10 18:06:52.121569 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1426/2930] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:51 2022] GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 => generated 1355 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:52.452130 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-87902fd0-a1d9-470b-a184-163816961b0f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:52.452653 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-87902fd0-a1d9-470b-a184-163816961b0f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 5cb5b4a5-d399-4f64-8f6a-8815d86e921a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:52.460409 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-21f91c4c-f8cc-4d40-be9c-b0f87e50a667 req-731a049e-7c93-4007-8cd9-672ed2d7ac19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f448b274-8163-42f3-9eea-1e4f3458dd2b", "name": "network-vif-plugged", "status": "completed", "tag": "70b6fde1-0c64-4e89-803e-1fa13a46aaf6"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:06:52.472516 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-21f91c4c-f8cc-4d40-be9c-b0f87e50a667 req-731a049e-7c93-4007-8cd9-672ed2d7ac19 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:52.472953 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-21f91c4c-f8cc-4d40-be9c-b0f87e50a667 req-731a049e-7c93-4007-8cd9-672ed2d7ac19 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:52.474942 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-87902fd0-a1d9-470b-a184-163816961b0f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:52.475556 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-87902fd0-a1d9-470b-a184-163816961b0f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:52.476449 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-87902fd0-a1d9-470b-a184-163816961b0f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:52.476795 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-87902fd0-a1d9-470b-a184-163816961b0f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:52.510747 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-21f91c4c-f8cc-4d40-be9c-b0f87e50a667 req-731a049e-7c93-4007-8cd9-672ed2d7ac19 service nova] Creating event network-vif-plugged:70b6fde1-0c64-4e89-803e-1fa13a46aaf6 for instance f448b274-8163-42f3-9eea-1e4f3458dd2b on chh1-master-2 Jun 10 18:06:52.510747 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-21f91c4c-f8cc-4d40-be9c-b0f87e50a667 req-731a049e-7c93-4007-8cd9-672ed2d7ac19 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053922 Jun 10 18:06:52.512288 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1505/2931] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:06:52.577711 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-87902fd0-a1d9-470b-a184-163816961b0f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:52.585693 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-87902fd0-a1d9-470b-a184-163816961b0f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a" status: 200 len: 1218 microversion: 2.1 time: 0.137389 Jun 10 18:06:52.586520 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1427/2932] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:52 2022] GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a => generated 1218 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:52.685441 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6113f02e-10d9-4d77-9006-9687afca46c2 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:52.694171 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6113f02e-10d9-4d77-9006-9687afca46c2 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:52.700534 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:06:52.718651 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6113f02e-10d9-4d77-9006-9687afca46c2 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:52.720255 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6113f02e-10d9-4d77-9006-9687afca46c2 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:52.720255 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6113f02e-10d9-4d77-9006-9687afca46c2 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:52.720471 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6113f02e-10d9-4d77-9006-9687afca46c2 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:52.901537 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6113f02e-10d9-4d77-9006-9687afca46c2 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:52.919339 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6113f02e-10d9-4d77-9006-9687afca46c2 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b" status: 200 len: 1308 microversion: 2.1 time: 0.238002 Jun 10 18:06:52.921766 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1506/2933] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:52 2022] GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b => generated 1308 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:53.011083 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5d8ac135-5362-4a56-84d3-aa7a0bab112e tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:53.011738 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5d8ac135-5362-4a56-84d3-aa7a0bab112e tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: d4580fa2-bf3a-4dc7-af2b-0d6af14508b3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:53.018813 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5d8ac135-5362-4a56-84d3-aa7a0bab112e tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:53.019989 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5d8ac135-5362-4a56-84d3-aa7a0bab112e tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:53.021223 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5d8ac135-5362-4a56-84d3-aa7a0bab112e tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:53.021815 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5d8ac135-5362-4a56-84d3-aa7a0bab112e tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:53.117163 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-952efb4d-8740-4fc8-95f6-5d9e5f4d1989 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:53.118210 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-952efb4d-8740-4fc8-95f6-5d9e5f4d1989 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:53.125485 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-952efb4d-8740-4fc8-95f6-5d9e5f4d1989 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:53.125923 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-952efb4d-8740-4fc8-95f6-5d9e5f4d1989 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:53.127664 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-952efb4d-8740-4fc8-95f6-5d9e5f4d1989 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:53.129250 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-952efb4d-8740-4fc8-95f6-5d9e5f4d1989 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:53.204490 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5d8ac135-5362-4a56-84d3-aa7a0bab112e tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:53.218632 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5d8ac135-5362-4a56-84d3-aa7a0bab112e tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3" status: 200 len: 1319 microversion: 2.1 time: 0.211278 Jun 10 18:06:53.224481 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1428/2934] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:53 2022] GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3 => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:53.229862 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a6e462e3-4d86-4230-86cd-8879af022211 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:53.230925 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a6e462e3-4d86-4230-86cd-8879af022211 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:53.234850 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-952efb4d-8740-4fc8-95f6-5d9e5f4d1989 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:53.238328 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a6e462e3-4d86-4230-86cd-8879af022211 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:53.238783 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a6e462e3-4d86-4230-86cd-8879af022211 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:53.239563 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a6e462e3-4d86-4230-86cd-8879af022211 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:53.240003 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a6e462e3-4d86-4230-86cd-8879af022211 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:53.248695 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-952efb4d-8740-4fc8-95f6-5d9e5f4d1989 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:53.251948 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-952efb4d-8740-4fc8-95f6-5d9e5f4d1989 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:53.254126 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-952efb4d-8740-4fc8-95f6-5d9e5f4d1989 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30" status: 200 len: 1366 microversion: 2.47 time: 0.141530 Jun 10 18:06:53.258529 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1507/2935] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:06:53 2022] GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30 => generated 1366 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:06:53.422798 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a6e462e3-4d86-4230-86cd-8879af022211 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:53.430484 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a6e462e3-4d86-4230-86cd-8879af022211 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058" status: 200 len: 1355 microversion: 2.1 time: 0.209953 Jun 10 18:06:53.438466 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1429/2936] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:53 2022] GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 => generated 1355 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:53.605810 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5fc55766-b193-40fd-9830-6ee8697bbd28 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:53.606428 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5fc55766-b193-40fd-9830-6ee8697bbd28 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 5cb5b4a5-d399-4f64-8f6a-8815d86e921a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:53.614278 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5fc55766-b193-40fd-9830-6ee8697bbd28 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:53.615200 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5fc55766-b193-40fd-9830-6ee8697bbd28 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:53.616461 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5fc55766-b193-40fd-9830-6ee8697bbd28 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:53.617259 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5fc55766-b193-40fd-9830-6ee8697bbd28 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:53.692067 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5fc55766-b193-40fd-9830-6ee8697bbd28 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:53.699659 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5fc55766-b193-40fd-9830-6ee8697bbd28 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a" status: 200 len: 1266 microversion: 2.1 time: 0.101235 Jun 10 18:06:53.706239 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1508/2937] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:53 2022] GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a => generated 1266 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:53.940698 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-790591c6-1be9-472f-97b5-f1b2b1bc28d9 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:53.942033 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-790591c6-1be9-472f-97b5-f1b2b1bc28d9 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:53.948988 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-790591c6-1be9-472f-97b5-f1b2b1bc28d9 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:53.949450 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-790591c6-1be9-472f-97b5-f1b2b1bc28d9 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:53.950218 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-790591c6-1be9-472f-97b5-f1b2b1bc28d9 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:53.950651 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-790591c6-1be9-472f-97b5-f1b2b1bc28d9 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:54.099490 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-790591c6-1be9-472f-97b5-f1b2b1bc28d9 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:54.108988 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-790591c6-1be9-472f-97b5-f1b2b1bc28d9 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b" status: 200 len: 1308 microversion: 2.1 time: 0.173248 Jun 10 18:06:54.121108 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1430/2938] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:53 2022] GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b => generated 1308 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:54.239065 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f7fc15d4-41f7-452b-b0fc-8105b5750b76 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:54.239671 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f7fc15d4-41f7-452b-b0fc-8105b5750b76 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: d4580fa2-bf3a-4dc7-af2b-0d6af14508b3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:54.245852 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f7fc15d4-41f7-452b-b0fc-8105b5750b76 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:54.246314 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f7fc15d4-41f7-452b-b0fc-8105b5750b76 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:54.247091 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f7fc15d4-41f7-452b-b0fc-8105b5750b76 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:54.247585 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f7fc15d4-41f7-452b-b0fc-8105b5750b76 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:54.275328 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-74c61057-55f9-4ec4-a484-796be5e9dbd8 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:54.278384 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-74c61057-55f9-4ec4-a484-796be5e9dbd8 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:54.286086 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-74c61057-55f9-4ec4-a484-796be5e9dbd8 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:54.286730 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-74c61057-55f9-4ec4-a484-796be5e9dbd8 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:54.288154 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-74c61057-55f9-4ec4-a484-796be5e9dbd8 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:54.288762 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-74c61057-55f9-4ec4-a484-796be5e9dbd8 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:54.365578 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-74c61057-55f9-4ec4-a484-796be5e9dbd8 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:54.375129 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-74c61057-55f9-4ec4-a484-796be5e9dbd8 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:54.377075 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-74c61057-55f9-4ec4-a484-796be5e9dbd8 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:54.378385 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-74c61057-55f9-4ec4-a484-796be5e9dbd8 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30" status: 200 len: 1366 microversion: 2.47 time: 0.107259 Jun 10 18:06:54.379558 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1431/2939] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:06:54 2022] GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30 => generated 1366 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:06:54.419037 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f7fc15d4-41f7-452b-b0fc-8105b5750b76 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:54.433247 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f7fc15d4-41f7-452b-b0fc-8105b5750b76 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3" status: 200 len: 1319 microversion: 2.1 time: 0.200582 Jun 10 18:06:54.435419 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1509/2940] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:54 2022] GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:54.447187 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-031a40b2-ea8f-42fa-82ad-446ce1b595da tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:54.447809 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-031a40b2-ea8f-42fa-82ad-446ce1b595da tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:54.454573 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-031a40b2-ea8f-42fa-82ad-446ce1b595da tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:54.455040 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-031a40b2-ea8f-42fa-82ad-446ce1b595da tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:54.455840 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-031a40b2-ea8f-42fa-82ad-446ce1b595da tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:54.456293 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-031a40b2-ea8f-42fa-82ad-446ce1b595da tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:54.461332 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:06:54.622543 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-031a40b2-ea8f-42fa-82ad-446ce1b595da tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:54.630737 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-031a40b2-ea8f-42fa-82ad-446ce1b595da tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058" status: 200 len: 1355 microversion: 2.1 time: 0.187498 Jun 10 18:06:54.631312 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1432/2941] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:54 2022] GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 => generated 1355 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:54.727474 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0b100330-96db-4488-ba8f-f1852ba8399d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:54.728220 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0b100330-96db-4488-ba8f-f1852ba8399d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 5cb5b4a5-d399-4f64-8f6a-8815d86e921a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:54.737178 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0b100330-96db-4488-ba8f-f1852ba8399d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:54.737713 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0b100330-96db-4488-ba8f-f1852ba8399d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:54.738597 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0b100330-96db-4488-ba8f-f1852ba8399d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:54.739226 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0b100330-96db-4488-ba8f-f1852ba8399d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:54.806867 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0b100330-96db-4488-ba8f-f1852ba8399d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:54.815487 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0b100330-96db-4488-ba8f-f1852ba8399d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a" status: 200 len: 1266 microversion: 2.1 time: 0.091823 Jun 10 18:06:54.816103 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1510/2942] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:54 2022] GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:55.129310 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8f7a6dee-6e8b-4e55-96c0-f1539a37ae27 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:55.130286 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8f7a6dee-6e8b-4e55-96c0-f1539a37ae27 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:55.141270 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8f7a6dee-6e8b-4e55-96c0-f1539a37ae27 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:55.141726 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8f7a6dee-6e8b-4e55-96c0-f1539a37ae27 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:55.146433 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8f7a6dee-6e8b-4e55-96c0-f1539a37ae27 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:55.146433 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8f7a6dee-6e8b-4e55-96c0-f1539a37ae27 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:55.398168 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3c07ba33-0eb0-4c45-9074-95a7d3153eb7 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:55.399137 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3c07ba33-0eb0-4c45-9074-95a7d3153eb7 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:55.424014 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3c07ba33-0eb0-4c45-9074-95a7d3153eb7 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:55.424710 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3c07ba33-0eb0-4c45-9074-95a7d3153eb7 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:55.426316 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3c07ba33-0eb0-4c45-9074-95a7d3153eb7 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:55.426775 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3c07ba33-0eb0-4c45-9074-95a7d3153eb7 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:55.432956 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8f7a6dee-6e8b-4e55-96c0-f1539a37ae27 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:55.449569 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8f7a6dee-6e8b-4e55-96c0-f1539a37ae27 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b" status: 200 len: 1488 microversion: 2.1 time: 0.324484 Jun 10 18:06:55.452568 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1433/2943] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:55 2022] GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b => generated 1488 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:55.458327 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cb3cb214-121a-4c7a-9fe3-a228bfc38dfe tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:55.463869 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cb3cb214-121a-4c7a-9fe3-a228bfc38dfe tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: d4580fa2-bf3a-4dc7-af2b-0d6af14508b3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:55.479517 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cb3cb214-121a-4c7a-9fe3-a228bfc38dfe tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:55.481983 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cb3cb214-121a-4c7a-9fe3-a228bfc38dfe tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:55.483152 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cb3cb214-121a-4c7a-9fe3-a228bfc38dfe tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:55.483942 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cb3cb214-121a-4c7a-9fe3-a228bfc38dfe tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:55.528011 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3c07ba33-0eb0-4c45-9074-95a7d3153eb7 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:55.539042 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3c07ba33-0eb0-4c45-9074-95a7d3153eb7 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:55.541618 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3c07ba33-0eb0-4c45-9074-95a7d3153eb7 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:55.546233 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3c07ba33-0eb0-4c45-9074-95a7d3153eb7 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30" status: 200 len: 1366 microversion: 2.47 time: 0.151091 Jun 10 18:06:55.556490 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1511/2944] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:06:55 2022] GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:06:55.556490 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c860c058-50dc-4fe0-8a4f-24d01a08b77f tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:06:55.561053 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c860c058-50dc-4fe0-8a4f-24d01a08b77f tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:55.561524 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c860c058-50dc-4fe0-8a4f-24d01a08b77f tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:55.592909 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c860c058-50dc-4fe0-8a4f-24d01a08b77f tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Going to try to stop instance {{(pid=126594) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 10 18:06:55.710481 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cb3cb214-121a-4c7a-9fe3-a228bfc38dfe tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:55.720243 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cb3cb214-121a-4c7a-9fe3-a228bfc38dfe tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3" status: 200 len: 1319 microversion: 2.1 time: 0.266344 Jun 10 18:06:55.729749 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1434/2945] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:55 2022] GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3 => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:55.863580 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4b1df3a4-c121-4760-8299-1012d440f32a tempest-TenantUsagesNegativeTestJSON-1209994619 tempest-TenantUsagesNegativeTestJSON-1209994619-project-admin] 10.222.0.35 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-06-09T18%3A06%3A55.595326&end=2022-06-11T18%3A06%3A55.595326" status: 404 len: 112 microversion: - time: 0.140970 Jun 10 18:06:55.869613 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1435/2946] 10.222.0.35 () {58 vars in 1315 bytes} [Fri Jun 10 18:06:55 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-06-09T18%3A06%3A55.595326&end=2022-06-11T18%3A06%3A55.595326 => generated 112 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 10 18:06:55.874786 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-56ac51b2-6807-4c62-adf1-5fb87253041b tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:55.875775 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-56ac51b2-6807-4c62-adf1-5fb87253041b tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:55.876460 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c860c058-50dc-4fe0-8a4f-24d01a08b77f tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "POST /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b/action" status: 202 len: 0 microversion: 2.1 time: 0.327660 Jun 10 18:06:55.879153 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1512/2947] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:06:55 2022] POST /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:06:55.883227 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-56ac51b2-6807-4c62-adf1-5fb87253041b tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:55.883754 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-56ac51b2-6807-4c62-adf1-5fb87253041b tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:55.884820 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-56ac51b2-6807-4c62-adf1-5fb87253041b tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:55.885341 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-56ac51b2-6807-4c62-adf1-5fb87253041b tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:55.890205 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-982102ed-4f54-4e88-8d39-8507f2e86b8e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:55.891130 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-982102ed-4f54-4e88-8d39-8507f2e86b8e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 5cb5b4a5-d399-4f64-8f6a-8815d86e921a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:55.898066 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-982102ed-4f54-4e88-8d39-8507f2e86b8e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:55.898845 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-982102ed-4f54-4e88-8d39-8507f2e86b8e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:55.900086 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-982102ed-4f54-4e88-8d39-8507f2e86b8e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:55.900732 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-982102ed-4f54-4e88-8d39-8507f2e86b8e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:55.976166 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-982102ed-4f54-4e88-8d39-8507f2e86b8e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:55.984648 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-982102ed-4f54-4e88-8d39-8507f2e86b8e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a" status: 200 len: 1272 microversion: 2.1 time: 0.100396 Jun 10 18:06:55.995317 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1513/2948] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:55 2022] GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a => generated 1272 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:56.003081 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ba771f1e-c16a-4cd2-999f-fa39a3332ff3 tempest-TenantUsagesNegativeTestJSON-1209994619 tempest-TenantUsagesNegativeTestJSON-1209994619-project-admin] Calling method '.version_select at 0x7f77c094f280>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:56.006475 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-ba771f1e-c16a-4cd2-999f-fa39a3332ff3 tempest-TenantUsagesNegativeTestJSON-1209994619 tempest-TenantUsagesNegativeTestJSON-1209994619-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ba771f1e-c16a-4cd2-999f-fa39a3332ff3 tempest-TenantUsagesNegativeTestJSON-1209994619 tempest-TenantUsagesNegativeTestJSON-1209994619-project-admin] Request method failure captured: Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/os-simple-tenant-usage/c12d8803486648b4852c9eefcecf1df8?start=2022-06-11T18%3A06%3A55.595326&end=2022-06-09T18%3A06%3A55.595326 HTTP/1.1 Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4g__bjXxKCoz-MJluYkihHrKq_EkgxFIELSpNWHDrG5Mo7cYtKT03w9iwyRWPirA5AlN33lU9_XcrEgd2rZnM_TtqgnaOLhSjrinDTuEU3X_q-rutLNSNHfty3fWI22mqpRPnatrTiaFLOpuWzqwU9p-80oin2vQHQqqaTlr4SZ8Ek Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 9d0b305dbabc446db85bbc1daa034479 Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1209994619 Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member,admin Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member,admin Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/9d0b305dbabc446db85bbc1daa034479"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9d0b305dbabc446db85bbc1daa034479"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9d0b305dbabc446db85bbc1daa034479"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_9d0b305dbabc446db85bbc1daa034479", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1209994619 Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 9d0b305dbabc446db85bbc1daa034479 Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1209994619 Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-TenantUsagesNegativeTestJSON-1209994619-project-admin Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 6aeb98e307c84ab6b09b84b0202cfac4 Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1209994619-project-admin Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: exception: Invalid start time. The start time cannot occur after the end time. Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'c12d8803486648b4852c9eefcecf1df8'} Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Jun 10 18:06:56.016031 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:06:56.022266 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ba771f1e-c16a-4cd2-999f-fa39a3332ff3 tempest-TenantUsagesNegativeTestJSON-1209994619 tempest-TenantUsagesNegativeTestJSON-1209994619-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:06:56.022266 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ba771f1e-c16a-4cd2-999f-fa39a3332ff3 tempest-TenantUsagesNegativeTestJSON-1209994619 tempest-TenantUsagesNegativeTestJSON-1209994619-project-admin] 10.222.0.35 "GET /compute/v2.1/os-simple-tenant-usage/c12d8803486648b4852c9eefcecf1df8?start=2022-06-11T18%3A06%3A55.595326&end=2022-06-09T18%3A06%3A55.595326" status: 400 len: 111 microversion: 2.1 time: 0.021508 Jun 10 18:06:56.022266 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1514/2949] 10.222.0.35 () {58 vars in 1411 bytes} [Fri Jun 10 18:06:55 2022] GET /compute/v2.1/os-simple-tenant-usage/c12d8803486648b4852c9eefcecf1df8?start=2022-06-11T18%3A06%3A55.595326&end=2022-06-09T18%3A06%3A55.595326 => generated 111 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:06:56.028197 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3abfc29e-3b11-4511-8da8-769cbac9085c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:56.029113 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3abfc29e-3b11-4511-8da8-769cbac9085c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:56.039650 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3abfc29e-3b11-4511-8da8-769cbac9085c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:56.040111 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3abfc29e-3b11-4511-8da8-769cbac9085c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:56.040925 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3abfc29e-3b11-4511-8da8-769cbac9085c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:56.041378 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3abfc29e-3b11-4511-8da8-769cbac9085c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:56.092029 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-56ac51b2-6807-4c62-adf1-5fb87253041b tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:56.103483 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-56ac51b2-6807-4c62-adf1-5fb87253041b tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058" status: 200 len: 1355 microversion: 2.1 time: 0.232347 Jun 10 18:06:56.104161 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1436/2950] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:55 2022] GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 => generated 1355 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:56.195369 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3abfc29e-3b11-4511-8da8-769cbac9085c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:56.204797 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3abfc29e-3b11-4511-8da8-769cbac9085c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b" status: 200 len: 1498 microversion: 2.1 time: 0.182496 Jun 10 18:06:56.205541 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1515/2951] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:56 2022] GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b => generated 1498 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:56.272923 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-488229f5-e471-4a07-bf0e-00d56ffcd492 tempest-TenantUsagesNegativeTestJSON-76582775 tempest-TenantUsagesNegativeTestJSON-76582775-project] Calling method '.version_select at 0x7f77c0377820>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-488229f5-e471-4a07-bf0e-00d56ffcd492 tempest-TenantUsagesNegativeTestJSON-76582775 tempest-TenantUsagesNegativeTestJSON-76582775-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'afae0b7910784e1abaede2bb9fc30796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12d8803486648b4852c9eefcecf1df8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-488229f5-e471-4a07-bf0e-00d56ffcd492 tempest-TenantUsagesNegativeTestJSON-76582775 tempest-TenantUsagesNegativeTestJSON-76582775-project] Request method failure captured: Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-09T18%3A06%3A55.595326&end=2022-06-11T18%3A06%3A55.595326&detailed=1 HTTP/1.1 Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4g-onag61XtNAweUuSf39nta_EM4vEuotNrfiDxRB30J2BJThUglEeEJHPiX7flDTN9V2moV_9ArI9HixBy8G40WIXRJr0INAzjR3lIJqHz1T5jdc0JV68quEqtpI4XbJ6tcq7vQAP8z2I3IlD0G_7b8Fr8bPYFaIAVKs53Li3OS0s Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: c12d8803486648b4852c9eefcecf1df8 Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-76582775 Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/c12d8803486648b4852c9eefcecf1df8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c12d8803486648b4852c9eefcecf1df8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c12d8803486648b4852c9eefcecf1df8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_c12d8803486648b4852c9eefcecf1df8", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-76582775 Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: c12d8803486648b4852c9eefcecf1df8 Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-76582775 Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-TenantUsagesNegativeTestJSON-76582775-project Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: afae0b7910784e1abaede2bb9fc30796 Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-76582775-project Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: action_args: {} Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._index(req) Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 18:06:56.289182 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 18:06:56.292769 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 18:06:56.292769 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 18:06:56.292769 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 10 18:06:56.292769 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 10 18:06:56.292769 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 10 18:06:56.292769 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 10 18:06:56.292769 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 10 18:06:56.292769 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 10 18:06:56.292769 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jun 10 18:06:56.292769 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:06:56.292769 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:06:56.292769 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:06:56.292769 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:06:56.292769 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:06:56.292769 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:06:56.292769 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 10 18:06:56.292769 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 10 18:06:56.292769 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jun 10 18:06:56.292769 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:06:56.292769 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-488229f5-e471-4a07-bf0e-00d56ffcd492 tempest-TenantUsagesNegativeTestJSON-76582775 tempest-TenantUsagesNegativeTestJSON-76582775-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:06:56.292769 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-488229f5-e471-4a07-bf0e-00d56ffcd492 tempest-TenantUsagesNegativeTestJSON-76582775 tempest-TenantUsagesNegativeTestJSON-76582775-project] 10.222.0.35 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-09T18%3A06%3A55.595326&end=2022-06-11T18%3A06%3A55.595326&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.185327 Jun 10 18:06:56.296984 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1437/2952] 10.222.0.35 () {58 vars in 1334 bytes} [Fri Jun 10 18:06:56 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-09T18%3A06%3A55.595326&end=2022-06-11T18%3A06%3A55.595326&detailed=1 => generated 123 bytes in 192 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:06:56.567098 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-033de429-e1e0-49de-a9e6-dfefe6bcfa19 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:56.567976 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-033de429-e1e0-49de-a9e6-dfefe6bcfa19 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:56.575044 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-033de429-e1e0-49de-a9e6-dfefe6bcfa19 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:56.575044 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-033de429-e1e0-49de-a9e6-dfefe6bcfa19 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:56.577603 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-033de429-e1e0-49de-a9e6-dfefe6bcfa19 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:56.578623 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-033de429-e1e0-49de-a9e6-dfefe6bcfa19 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:56.666536 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-6981f568-1503-4b2a-af4f-bf48c0157a3f req-01824c8c-e597-4a3c-9c40-101348258c16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58980efb-1c1a-45bb-9ac8-99383b147058", "name": "network-vif-plugged", "status": "completed", "tag": "44ed9fcb-fbc5-4fd8-82c9-6b494e913b38"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:06:56.687529 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-6981f568-1503-4b2a-af4f-bf48c0157a3f req-01824c8c-e597-4a3c-9c40-101348258c16 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:56.688907 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-6981f568-1503-4b2a-af4f-bf48c0157a3f req-01824c8c-e597-4a3c-9c40-101348258c16 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:56.694113 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-033de429-e1e0-49de-a9e6-dfefe6bcfa19 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:56.704651 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-033de429-e1e0-49de-a9e6-dfefe6bcfa19 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:56.706188 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-033de429-e1e0-49de-a9e6-dfefe6bcfa19 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:56.708066 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-033de429-e1e0-49de-a9e6-dfefe6bcfa19 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30" status: 200 len: 1366 microversion: 2.47 time: 0.145701 Jun 10 18:06:56.713501 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1516/2953] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:06:56 2022] GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:06:56.737348 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-aa0a13c9-dd07-4609-9345-12b4735a96fd tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:56.738504 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-aa0a13c9-dd07-4609-9345-12b4735a96fd tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: d4580fa2-bf3a-4dc7-af2b-0d6af14508b3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:56.744510 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-6981f568-1503-4b2a-af4f-bf48c0157a3f req-01824c8c-e597-4a3c-9c40-101348258c16 service nova] Creating event network-vif-plugged:44ed9fcb-fbc5-4fd8-82c9-6b494e913b38 for instance 58980efb-1c1a-45bb-9ac8-99383b147058 on chh2-master-2 Jun 10 18:06:56.751579 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-6981f568-1503-4b2a-af4f-bf48c0157a3f req-01824c8c-e597-4a3c-9c40-101348258c16 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087653 Jun 10 18:06:56.760948 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1438/2954] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:06:56.761100 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aa0a13c9-dd07-4609-9345-12b4735a96fd tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:56.761100 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aa0a13c9-dd07-4609-9345-12b4735a96fd tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:56.761100 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aa0a13c9-dd07-4609-9345-12b4735a96fd tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:56.761100 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aa0a13c9-dd07-4609-9345-12b4735a96fd tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:56.934562 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-aa0a13c9-dd07-4609-9345-12b4735a96fd tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:56.945865 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-aa0a13c9-dd07-4609-9345-12b4735a96fd tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3" status: 200 len: 1319 microversion: 2.1 time: 0.210385 Jun 10 18:06:56.945865 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1517/2955] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:56 2022] GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3 => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:57.002286 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ecea0b2c-c033-45f6-876d-d1d31d695b7a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:57.003161 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ecea0b2c-c033-45f6-876d-d1d31d695b7a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 5cb5b4a5-d399-4f64-8f6a-8815d86e921a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:57.010434 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ecea0b2c-c033-45f6-876d-d1d31d695b7a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:57.013286 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ecea0b2c-c033-45f6-876d-d1d31d695b7a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:57.013286 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ecea0b2c-c033-45f6-876d-d1d31d695b7a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:57.013286 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ecea0b2c-c033-45f6-876d-d1d31d695b7a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:57.122141 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cb29fcc2-c3dc-428e-b70a-eb4102ad875e tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:57.123022 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cb29fcc2-c3dc-428e-b70a-eb4102ad875e tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:57.133465 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cb29fcc2-c3dc-428e-b70a-eb4102ad875e tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:57.136202 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cb29fcc2-c3dc-428e-b70a-eb4102ad875e tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:57.142549 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cb29fcc2-c3dc-428e-b70a-eb4102ad875e tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:57.145169 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cb29fcc2-c3dc-428e-b70a-eb4102ad875e tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:57.253254 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ecea0b2c-c033-45f6-876d-d1d31d695b7a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:57.264058 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ecea0b2c-c033-45f6-876d-d1d31d695b7a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a" status: 200 len: 1314 microversion: 2.1 time: 0.266359 Jun 10 18:06:57.265158 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1439/2956] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:56 2022] GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:57.278175 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-08d6d9ed-7aa1-4ab5-bed4-391e649861b3 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:57.283738 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-08d6d9ed-7aa1-4ab5-bed4-391e649861b3 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:57.302310 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-08d6d9ed-7aa1-4ab5-bed4-391e649861b3 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:57.304258 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-08d6d9ed-7aa1-4ab5-bed4-391e649861b3 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:57.304258 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-08d6d9ed-7aa1-4ab5-bed4-391e649861b3 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:57.304258 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-08d6d9ed-7aa1-4ab5-bed4-391e649861b3 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:57.383912 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cb29fcc2-c3dc-428e-b70a-eb4102ad875e tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:57.399306 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cb29fcc2-c3dc-428e-b70a-eb4102ad875e tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058" status: 200 len: 1355 microversion: 2.1 time: 0.282587 Jun 10 18:06:57.400696 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1518/2957] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:57 2022] GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 => generated 1355 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:57.524361 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-08d6d9ed-7aa1-4ab5-bed4-391e649861b3 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:57.538208 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-08d6d9ed-7aa1-4ab5-bed4-391e649861b3 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b" status: 200 len: 1498 microversion: 2.1 time: 0.264466 Jun 10 18:06:57.538208 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1440/2958] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:57 2022] GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b => generated 1498 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:57.739182 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b06724b2-c2eb-4538-ae7e-ab6489f88ef0 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:57.739182 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b06724b2-c2eb-4538-ae7e-ab6489f88ef0 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:57.742340 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b06724b2-c2eb-4538-ae7e-ab6489f88ef0 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:57.742864 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b06724b2-c2eb-4538-ae7e-ab6489f88ef0 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:57.745194 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b06724b2-c2eb-4538-ae7e-ab6489f88ef0 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:57.750144 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b06724b2-c2eb-4538-ae7e-ab6489f88ef0 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:57.845956 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b06724b2-c2eb-4538-ae7e-ab6489f88ef0 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:57.860984 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b06724b2-c2eb-4538-ae7e-ab6489f88ef0 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:57.862977 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b06724b2-c2eb-4538-ae7e-ab6489f88ef0 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:57.864207 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b06724b2-c2eb-4538-ae7e-ab6489f88ef0 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30" status: 200 len: 1366 microversion: 2.47 time: 0.138323 Jun 10 18:06:57.865278 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1519/2959] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:06:57 2022] GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30 => generated 1366 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:06:57.952441 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-fe677e15-460a-42f5-b4c5-98f93e8c428b req-cb8e170e-0deb-49b0-b06a-1db51410d4d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cb5b4a5-d399-4f64-8f6a-8815d86e921a", "tag": "01aa0dae-0896-47f3-b43f-12eb45f1ec84"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:06:57.964447 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-eea9d1de-6654-49d9-8fb6-2900e8b0ffac tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:57.965085 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-eea9d1de-6654-49d9-8fb6-2900e8b0ffac tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: d4580fa2-bf3a-4dc7-af2b-0d6af14508b3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:57.969416 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-fe677e15-460a-42f5-b4c5-98f93e8c428b req-cb8e170e-0deb-49b0-b06a-1db51410d4d1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:57.969868 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-fe677e15-460a-42f5-b4c5-98f93e8c428b req-cb8e170e-0deb-49b0-b06a-1db51410d4d1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:57.973118 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eea9d1de-6654-49d9-8fb6-2900e8b0ffac tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:57.976488 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eea9d1de-6654-49d9-8fb6-2900e8b0ffac tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:57.977536 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eea9d1de-6654-49d9-8fb6-2900e8b0ffac tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:57.978302 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eea9d1de-6654-49d9-8fb6-2900e8b0ffac tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:58.006623 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-fe677e15-460a-42f5-b4c5-98f93e8c428b req-cb8e170e-0deb-49b0-b06a-1db51410d4d1 service nova] Creating event network-changed:01aa0dae-0896-47f3-b43f-12eb45f1ec84 for instance 5cb5b4a5-d399-4f64-8f6a-8815d86e921a on chh2-master-2 Jun 10 18:06:58.023324 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-fe677e15-460a-42f5-b4c5-98f93e8c428b req-cb8e170e-0deb-49b0-b06a-1db51410d4d1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074366 Jun 10 18:06:58.031686 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1441/2960] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:06:58.166064 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-eea9d1de-6654-49d9-8fb6-2900e8b0ffac tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:58.173918 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-eea9d1de-6654-49d9-8fb6-2900e8b0ffac tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3" status: 200 len: 1319 microversion: 2.1 time: 0.217246 Jun 10 18:06:58.174510 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1520/2961] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:57 2022] GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:06:58.282023 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7187c0c7-b770-4673-b6ec-5b391b9c9a6f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:58.287662 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7187c0c7-b770-4673-b6ec-5b391b9c9a6f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 5cb5b4a5-d399-4f64-8f6a-8815d86e921a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:58.298702 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7187c0c7-b770-4673-b6ec-5b391b9c9a6f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:58.298702 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7187c0c7-b770-4673-b6ec-5b391b9c9a6f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:58.299408 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7187c0c7-b770-4673-b6ec-5b391b9c9a6f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:58.300508 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7187c0c7-b770-4673-b6ec-5b391b9c9a6f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:58.417780 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c901fd9b-f63a-4b0c-aaf5-0536bb99ff99 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:58.418861 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c901fd9b-f63a-4b0c-aaf5-0536bb99ff99 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:58.428162 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c901fd9b-f63a-4b0c-aaf5-0536bb99ff99 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:58.428971 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c901fd9b-f63a-4b0c-aaf5-0536bb99ff99 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:58.429921 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c901fd9b-f63a-4b0c-aaf5-0536bb99ff99 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:58.430621 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c901fd9b-f63a-4b0c-aaf5-0536bb99ff99 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:58.435081 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:06:58.577573 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7187c0c7-b770-4673-b6ec-5b391b9c9a6f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:58.589574 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7187c0c7-b770-4673-b6ec-5b391b9c9a6f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a" status: 200 len: 1314 microversion: 2.1 time: 0.311665 Jun 10 18:06:58.590718 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1442/2962] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:58 2022] GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:58.594870 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2bb47b0b-0b46-44c1-9305-158a24b820ba tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:58.610265 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2bb47b0b-0b46-44c1-9305-158a24b820ba tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:58.626392 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2bb47b0b-0b46-44c1-9305-158a24b820ba tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:58.626851 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2bb47b0b-0b46-44c1-9305-158a24b820ba tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:58.627649 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2bb47b0b-0b46-44c1-9305-158a24b820ba tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:58.627903 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c901fd9b-f63a-4b0c-aaf5-0536bb99ff99 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:58.628090 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2bb47b0b-0b46-44c1-9305-158a24b820ba tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:58.638408 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c901fd9b-f63a-4b0c-aaf5-0536bb99ff99 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058" status: 200 len: 1355 microversion: 2.1 time: 0.224658 Jun 10 18:06:58.638408 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1521/2963] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:58 2022] GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 => generated 1355 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:06:58.814988 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-09d513ce-012f-4e98-a3d5-8f7e413bdafd req-6c04ce82-6ae4-43fe-bb6d-b75cb2229ca3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58980efb-1c1a-45bb-9ac8-99383b147058", "name": "network-vif-plugged", "status": "completed", "tag": "65574b89-4808-4278-86d3-b1a0e74bff16"}, {"server_uuid": "58980efb-1c1a-45bb-9ac8-99383b147058", "name": "network-vif-plugged", "status": "completed", "tag": "64d536e0-a4bf-403a-8ba1-f12c3ad0e6d6"}, {"server_uuid": "d4580fa2-bf3a-4dc7-af2b-0d6af14508b3", "name": "network-vif-plugged", "status": "completed", "tag": "9f84dd8d-0598-49b8-a89f-aab5783f86d9"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:06:58.850783 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-09d513ce-012f-4e98-a3d5-8f7e413bdafd req-6c04ce82-6ae4-43fe-bb6d-b75cb2229ca3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:58.854765 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-09d513ce-012f-4e98-a3d5-8f7e413bdafd req-6c04ce82-6ae4-43fe-bb6d-b75cb2229ca3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:58.856116 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2bb47b0b-0b46-44c1-9305-158a24b820ba tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:58.873490 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2bb47b0b-0b46-44c1-9305-158a24b820ba tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b" status: 200 len: 1498 microversion: 2.1 time: 0.281822 Jun 10 18:06:58.877000 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1443/2964] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:58 2022] GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b => generated 1498 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:58.877313 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-09d513ce-012f-4e98-a3d5-8f7e413bdafd req-6c04ce82-6ae4-43fe-bb6d-b75cb2229ca3 service nova] Creating event network-vif-plugged:65574b89-4808-4278-86d3-b1a0e74bff16 for instance 58980efb-1c1a-45bb-9ac8-99383b147058 on chh2-master-2 Jun 10 18:06:58.877313 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-09d513ce-012f-4e98-a3d5-8f7e413bdafd req-6c04ce82-6ae4-43fe-bb6d-b75cb2229ca3 service nova] Creating event network-vif-plugged:64d536e0-a4bf-403a-8ba1-f12c3ad0e6d6 for instance 58980efb-1c1a-45bb-9ac8-99383b147058 on chh2-master-2 Jun 10 18:06:58.877313 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-09d513ce-012f-4e98-a3d5-8f7e413bdafd req-6c04ce82-6ae4-43fe-bb6d-b75cb2229ca3 service nova] Creating event network-vif-plugged:9f84dd8d-0598-49b8-a89f-aab5783f86d9 for instance d4580fa2-bf3a-4dc7-af2b-0d6af14508b3 on chh2-master-2 Jun 10 18:06:58.883597 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-09d513ce-012f-4e98-a3d5-8f7e413bdafd req-6c04ce82-6ae4-43fe-bb6d-b75cb2229ca3 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.072878 Jun 10 18:06:58.884840 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1522/2965] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:06:58.891444 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3343e48f-e69a-410f-9891-09c2f9d528cf tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:58.893863 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3343e48f-e69a-410f-9891-09c2f9d528cf tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:58.901043 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3343e48f-e69a-410f-9891-09c2f9d528cf tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:58.903948 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3343e48f-e69a-410f-9891-09c2f9d528cf tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:58.906362 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3343e48f-e69a-410f-9891-09c2f9d528cf tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:58.906827 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3343e48f-e69a-410f-9891-09c2f9d528cf tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:58.997133 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3343e48f-e69a-410f-9891-09c2f9d528cf tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:59.018150 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3343e48f-e69a-410f-9891-09c2f9d528cf tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:59.020519 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3343e48f-e69a-410f-9891-09c2f9d528cf tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:59.022445 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3343e48f-e69a-410f-9891-09c2f9d528cf tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30" status: 200 len: 1366 microversion: 2.47 time: 0.140417 Jun 10 18:06:59.033217 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1444/2966] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:06:58 2022] GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:06:59.196104 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1e4fd6cf-5dce-43da-a95f-d3135706fa50 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:59.196994 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1e4fd6cf-5dce-43da-a95f-d3135706fa50 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: d4580fa2-bf3a-4dc7-af2b-0d6af14508b3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:59.204585 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1e4fd6cf-5dce-43da-a95f-d3135706fa50 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:59.205166 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1e4fd6cf-5dce-43da-a95f-d3135706fa50 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:59.205946 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1e4fd6cf-5dce-43da-a95f-d3135706fa50 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:59.206928 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1e4fd6cf-5dce-43da-a95f-d3135706fa50 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:59.346287 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1e4fd6cf-5dce-43da-a95f-d3135706fa50 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:59.354791 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1e4fd6cf-5dce-43da-a95f-d3135706fa50 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3" status: 200 len: 1319 microversion: 2.1 time: 0.167205 Jun 10 18:06:59.355375 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1523/2967] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:59 2022] GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:06:59.606342 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-94a66fb1-2cb5-4191-9ae7-7909dc90f4e2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:59.606939 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-94a66fb1-2cb5-4191-9ae7-7909dc90f4e2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 5cb5b4a5-d399-4f64-8f6a-8815d86e921a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:59.609302 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=8 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:06:59.615347 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-94a66fb1-2cb5-4191-9ae7-7909dc90f4e2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:59.616740 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-94a66fb1-2cb5-4191-9ae7-7909dc90f4e2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:59.616740 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-94a66fb1-2cb5-4191-9ae7-7909dc90f4e2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:59.617062 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-94a66fb1-2cb5-4191-9ae7-7909dc90f4e2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:59.653303 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ff928971-d0d0-488b-83b5-364fd2cd0d23 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:59.654016 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ff928971-d0d0-488b-83b5-364fd2cd0d23 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:59.662843 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=6 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:06:59.666780 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ff928971-d0d0-488b-83b5-364fd2cd0d23 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:59.667252 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ff928971-d0d0-488b-83b5-364fd2cd0d23 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:59.668044 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ff928971-d0d0-488b-83b5-364fd2cd0d23 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:59.668538 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ff928971-d0d0-488b-83b5-364fd2cd0d23 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:59.766736 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=8 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:06:59.774269 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-94a66fb1-2cb5-4191-9ae7-7909dc90f4e2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:59.782909 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-94a66fb1-2cb5-4191-9ae7-7909dc90f4e2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a" status: 200 len: 1314 microversion: 2.1 time: 0.180159 Jun 10 18:06:59.783488 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1445/2968] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:59 2022] GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:06:59.833032 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ff928971-d0d0-488b-83b5-364fd2cd0d23 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:06:59.842506 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ff928971-d0d0-488b-83b5-364fd2cd0d23 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058" status: 200 len: 1355 microversion: 2.1 time: 0.192938 Jun 10 18:06:59.843640 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1524/2969] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:59 2022] GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 => generated 1355 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:06:59.891038 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-de7b1b8e-4162-4b99-89c8-25a75c045f32 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:06:59.904098 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-de7b1b8e-4162-4b99-89c8-25a75c045f32 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:06:59.904098 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de7b1b8e-4162-4b99-89c8-25a75c045f32 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:59.905562 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de7b1b8e-4162-4b99-89c8-25a75c045f32 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:06:59.905562 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de7b1b8e-4162-4b99-89c8-25a75c045f32 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:06:59.909304 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de7b1b8e-4162-4b99-89c8-25a75c045f32 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:00.043384 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-15ce49c7-ffab-42f5-89c2-6f2f880990d6 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:00.044070 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-15ce49c7-ffab-42f5-89c2-6f2f880990d6 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:00.052381 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-15ce49c7-ffab-42f5-89c2-6f2f880990d6 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:00.053261 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-15ce49c7-ffab-42f5-89c2-6f2f880990d6 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:00.058929 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-15ce49c7-ffab-42f5-89c2-6f2f880990d6 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:00.058929 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-15ce49c7-ffab-42f5-89c2-6f2f880990d6 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:00.061610 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-de7b1b8e-4162-4b99-89c8-25a75c045f32 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:00.070882 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-de7b1b8e-4162-4b99-89c8-25a75c045f32 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b" status: 200 len: 1498 microversion: 2.1 time: 0.184084 Jun 10 18:07:00.071467 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1446/2970] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:06:59 2022] GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b => generated 1498 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:00.129196 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-15ce49c7-ffab-42f5-89c2-6f2f880990d6 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:00.138715 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-15ce49c7-ffab-42f5-89c2-6f2f880990d6 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:00.141879 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-15ce49c7-ffab-42f5-89c2-6f2f880990d6 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:00.143518 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-15ce49c7-ffab-42f5-89c2-6f2f880990d6 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30" status: 200 len: 1366 microversion: 2.47 time: 0.105388 Jun 10 18:07:00.144262 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1525/2971] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:07:00 2022] GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30 => generated 1366 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:07:00.371260 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a029aba2-1f37-4946-8ddb-80730e1218e5 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:00.371875 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a029aba2-1f37-4946-8ddb-80730e1218e5 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: d4580fa2-bf3a-4dc7-af2b-0d6af14508b3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:00.378465 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a029aba2-1f37-4946-8ddb-80730e1218e5 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:00.378863 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a029aba2-1f37-4946-8ddb-80730e1218e5 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:00.379672 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a029aba2-1f37-4946-8ddb-80730e1218e5 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:00.380112 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a029aba2-1f37-4946-8ddb-80730e1218e5 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:00.530521 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a029aba2-1f37-4946-8ddb-80730e1218e5 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:00.544665 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a029aba2-1f37-4946-8ddb-80730e1218e5 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3" status: 200 len: 1319 microversion: 2.1 time: 0.177088 Jun 10 18:07:00.548877 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1447/2972] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:00 2022] GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:00.799441 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-50f08a47-7718-4857-ac97-9c68f68d8468 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:00.800623 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-50f08a47-7718-4857-ac97-9c68f68d8468 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 5cb5b4a5-d399-4f64-8f6a-8815d86e921a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:00.808833 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-50f08a47-7718-4857-ac97-9c68f68d8468 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:00.809443 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-50f08a47-7718-4857-ac97-9c68f68d8468 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:00.810227 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-50f08a47-7718-4857-ac97-9c68f68d8468 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:00.810668 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-50f08a47-7718-4857-ac97-9c68f68d8468 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:00.860917 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-54728023-06e8-4acb-9f43-f212c6dbb39d tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:00.861982 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-54728023-06e8-4acb-9f43-f212c6dbb39d tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:00.870337 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-54728023-06e8-4acb-9f43-f212c6dbb39d tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:00.870962 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-54728023-06e8-4acb-9f43-f212c6dbb39d tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:00.871853 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-54728023-06e8-4acb-9f43-f212c6dbb39d tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:00.872472 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-54728023-06e8-4acb-9f43-f212c6dbb39d tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:01.041445 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-54728023-06e8-4acb-9f43-f212c6dbb39d tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:01.049770 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-54728023-06e8-4acb-9f43-f212c6dbb39d tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058" status: 200 len: 1355 microversion: 2.1 time: 0.194446 Jun 10 18:07:01.053463 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1448/2973] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:00 2022] GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 => generated 1355 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:07:01.087400 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5e3fdedd-3354-4b8c-910a-b153460ee342 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:01.088178 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5e3fdedd-3354-4b8c-910a-b153460ee342 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:01.094589 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5e3fdedd-3354-4b8c-910a-b153460ee342 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:01.095109 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5e3fdedd-3354-4b8c-910a-b153460ee342 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:01.095931 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5e3fdedd-3354-4b8c-910a-b153460ee342 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:01.096402 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5e3fdedd-3354-4b8c-910a-b153460ee342 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:01.223120 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-50f08a47-7718-4857-ac97-9c68f68d8468 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:01.234090 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-50f08a47-7718-4857-ac97-9c68f68d8468 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a" status: 200 len: 1314 microversion: 2.1 time: 0.438303 Jun 10 18:07:01.235159 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1526/2974] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:00 2022] GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a => generated 1314 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:01.241599 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-40db0f5b-a686-4c03-a056-69c0f495fd35 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:01.242426 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-40db0f5b-a686-4c03-a056-69c0f495fd35 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:01.249374 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-40db0f5b-a686-4c03-a056-69c0f495fd35 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:01.250132 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-40db0f5b-a686-4c03-a056-69c0f495fd35 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:01.251273 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-40db0f5b-a686-4c03-a056-69c0f495fd35 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:01.251723 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-40db0f5b-a686-4c03-a056-69c0f495fd35 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:01.253521 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5e3fdedd-3354-4b8c-910a-b153460ee342 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:01.263964 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5e3fdedd-3354-4b8c-910a-b153460ee342 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b" status: 200 len: 1498 microversion: 2.1 time: 0.180670 Jun 10 18:07:01.266731 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1449/2975] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:01 2022] GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b => generated 1498 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:07:01.322475 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-40db0f5b-a686-4c03-a056-69c0f495fd35 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:01.331714 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-40db0f5b-a686-4c03-a056-69c0f495fd35 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:01.332576 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-40db0f5b-a686-4c03-a056-69c0f495fd35 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:01.333753 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-40db0f5b-a686-4c03-a056-69c0f495fd35 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30" status: 200 len: 1366 microversion: 2.47 time: 0.097482 Jun 10 18:07:01.334843 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1527/2976] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:07:01 2022] GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30 => generated 1366 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:07:01.561585 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-96b74369-ca88-4372-a07e-c9d90730b239 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:01.562371 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-96b74369-ca88-4372-a07e-c9d90730b239 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: d4580fa2-bf3a-4dc7-af2b-0d6af14508b3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:01.568928 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-96b74369-ca88-4372-a07e-c9d90730b239 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:01.569488 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-96b74369-ca88-4372-a07e-c9d90730b239 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:01.570480 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-96b74369-ca88-4372-a07e-c9d90730b239 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:01.571031 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-96b74369-ca88-4372-a07e-c9d90730b239 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:01.729886 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-96b74369-ca88-4372-a07e-c9d90730b239 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:01.743049 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-96b74369-ca88-4372-a07e-c9d90730b239 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3" status: 200 len: 1319 microversion: 2.1 time: 0.184506 Jun 10 18:07:01.743049 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1450/2977] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:01 2022] GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:02.070452 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-696a281b-9ec9-47f3-8317-a65a6a06827b tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:02.071913 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-696a281b-9ec9-47f3-8317-a65a6a06827b tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:02.078716 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-696a281b-9ec9-47f3-8317-a65a6a06827b tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:02.079348 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-696a281b-9ec9-47f3-8317-a65a6a06827b tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:02.080284 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-696a281b-9ec9-47f3-8317-a65a6a06827b tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:02.080905 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-696a281b-9ec9-47f3-8317-a65a6a06827b tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:02.231983 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-696a281b-9ec9-47f3-8317-a65a6a06827b tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:02.329784 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-696a281b-9ec9-47f3-8317-a65a6a06827b tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058" status: 200 len: 1355 microversion: 2.1 time: 0.175573 Jun 10 18:07:02.329784 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1528/2978] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:02 2022] GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 => generated 1355 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:02.330103 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7083d5d1-f4d0-461b-b6ff-820c01d75a4e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:02.330103 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7083d5d1-f4d0-461b-b6ff-820c01d75a4e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 5cb5b4a5-d399-4f64-8f6a-8815d86e921a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:02.330103 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:07:02.330103 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7083d5d1-f4d0-461b-b6ff-820c01d75a4e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:02.330103 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7083d5d1-f4d0-461b-b6ff-820c01d75a4e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:02.330103 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7083d5d1-f4d0-461b-b6ff-820c01d75a4e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:02.330103 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7083d5d1-f4d0-461b-b6ff-820c01d75a4e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:02.331458 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-82054c21-824e-498e-826f-629421e16923 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:02.331458 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-82054c21-824e-498e-826f-629421e16923 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:02.331458 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-82054c21-824e-498e-826f-629421e16923 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:02.331458 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-82054c21-824e-498e-826f-629421e16923 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:02.331458 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-82054c21-824e-498e-826f-629421e16923 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:02.331458 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-82054c21-824e-498e-826f-629421e16923 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:02.408748 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7083d5d1-f4d0-461b-b6ff-820c01d75a4e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:02.419081 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7083d5d1-f4d0-461b-b6ff-820c01d75a4e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a" status: 200 len: 1314 microversion: 2.1 time: 0.171867 Jun 10 18:07:02.419791 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1451/2979] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:02 2022] GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:07:02.425587 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-57a61312-38af-4327-b800-4b91f63c0669 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:02.426201 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-57a61312-38af-4327-b800-4b91f63c0669 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:02.432732 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-57a61312-38af-4327-b800-4b91f63c0669 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:02.433192 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-57a61312-38af-4327-b800-4b91f63c0669 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:02.433992 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-57a61312-38af-4327-b800-4b91f63c0669 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:02.434492 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-57a61312-38af-4327-b800-4b91f63c0669 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:02.439282 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:07:02.473453 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-82054c21-824e-498e-826f-629421e16923 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:02.484135 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-82054c21-824e-498e-826f-629421e16923 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b" status: 200 len: 1498 microversion: 2.1 time: 0.204983 Jun 10 18:07:02.484987 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1529/2980] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:02 2022] GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b => generated 1498 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:07:02.512148 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-57a61312-38af-4327-b800-4b91f63c0669 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:02.520708 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-57a61312-38af-4327-b800-4b91f63c0669 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:02.522236 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-57a61312-38af-4327-b800-4b91f63c0669 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:02.523439 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-57a61312-38af-4327-b800-4b91f63c0669 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30" status: 200 len: 1366 microversion: 2.47 time: 0.102610 Jun 10 18:07:02.524005 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1452/2981] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:07:02 2022] GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30 => generated 1366 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:07:02.760054 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-029dc705-fd74-48c1-a1c7-a46960ff2636 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:02.760798 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-029dc705-fd74-48c1-a1c7-a46960ff2636 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: d4580fa2-bf3a-4dc7-af2b-0d6af14508b3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:02.766952 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-029dc705-fd74-48c1-a1c7-a46960ff2636 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:02.767402 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-029dc705-fd74-48c1-a1c7-a46960ff2636 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:02.768159 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-029dc705-fd74-48c1-a1c7-a46960ff2636 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:02.768643 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-029dc705-fd74-48c1-a1c7-a46960ff2636 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:02.916649 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-029dc705-fd74-48c1-a1c7-a46960ff2636 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:02.932411 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-029dc705-fd74-48c1-a1c7-a46960ff2636 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3" status: 200 len: 1319 microversion: 2.1 time: 0.176987 Jun 10 18:07:02.939074 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1530/2982] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:02 2022] GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:07:03.267540 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0761418b-ef87-45ca-bf58-7ccbbc4b901c tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:03.268158 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0761418b-ef87-45ca-bf58-7ccbbc4b901c tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:03.287299 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0761418b-ef87-45ca-bf58-7ccbbc4b901c tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:03.287823 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0761418b-ef87-45ca-bf58-7ccbbc4b901c tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:03.288882 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0761418b-ef87-45ca-bf58-7ccbbc4b901c tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:03.289467 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0761418b-ef87-45ca-bf58-7ccbbc4b901c tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:03.441353 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-197964ec-dbe9-4558-9ff1-81b381b69e9f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:03.443020 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-197964ec-dbe9-4558-9ff1-81b381b69e9f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 5cb5b4a5-d399-4f64-8f6a-8815d86e921a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:03.453963 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-197964ec-dbe9-4558-9ff1-81b381b69e9f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:03.454829 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-197964ec-dbe9-4558-9ff1-81b381b69e9f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:03.457199 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-197964ec-dbe9-4558-9ff1-81b381b69e9f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:03.458583 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-197964ec-dbe9-4558-9ff1-81b381b69e9f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:03.488081 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0761418b-ef87-45ca-bf58-7ccbbc4b901c tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:03.506261 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0761418b-ef87-45ca-bf58-7ccbbc4b901c tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058" status: 200 len: 1355 microversion: 2.1 time: 0.242369 Jun 10 18:07:03.523110 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1453/2983] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:03 2022] GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 => generated 1355 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:03.523316 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7d5c660d-d848-4358-a8db-ef08269fca7b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:03.523966 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7d5c660d-d848-4358-a8db-ef08269fca7b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:03.530205 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7d5c660d-d848-4358-a8db-ef08269fca7b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:03.530658 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7d5c660d-d848-4358-a8db-ef08269fca7b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:03.531430 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7d5c660d-d848-4358-a8db-ef08269fca7b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:03.531930 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7d5c660d-d848-4358-a8db-ef08269fca7b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:03.731189 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7d5c660d-d848-4358-a8db-ef08269fca7b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:03.742282 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7d5c660d-d848-4358-a8db-ef08269fca7b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b" status: 200 len: 1498 microversion: 2.1 time: 0.224172 Jun 10 18:07:03.744935 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1454/2984] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:03 2022] GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b => generated 1498 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:03.763829 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-99c3d84e-6e13-4818-989b-35d0cef7a7a7 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:03.764886 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-99c3d84e-6e13-4818-989b-35d0cef7a7a7 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:03.772123 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99c3d84e-6e13-4818-989b-35d0cef7a7a7 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:03.773023 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99c3d84e-6e13-4818-989b-35d0cef7a7a7 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:03.773968 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99c3d84e-6e13-4818-989b-35d0cef7a7a7 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:03.774764 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99c3d84e-6e13-4818-989b-35d0cef7a7a7 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:03.890819 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-197964ec-dbe9-4558-9ff1-81b381b69e9f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:03.906712 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-197964ec-dbe9-4558-9ff1-81b381b69e9f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a" status: 200 len: 1314 microversion: 2.1 time: 0.470927 Jun 10 18:07:03.907833 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1531/2985] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:03 2022] GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a => generated 1314 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:03.921138 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-99c3d84e-6e13-4818-989b-35d0cef7a7a7 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:03.935021 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-99c3d84e-6e13-4818-989b-35d0cef7a7a7 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:03.939468 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-99c3d84e-6e13-4818-989b-35d0cef7a7a7 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:03.945761 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-99c3d84e-6e13-4818-989b-35d0cef7a7a7 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30" status: 200 len: 1366 microversion: 2.47 time: 0.188855 Jun 10 18:07:03.946563 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1455/2986] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:07:03 2022] GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30 => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:07:03.951073 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e2e35016-c999-46f0-a2b9-e808349980d2 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:03.955804 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e2e35016-c999-46f0-a2b9-e808349980d2 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: d4580fa2-bf3a-4dc7-af2b-0d6af14508b3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:03.964147 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e2e35016-c999-46f0-a2b9-e808349980d2 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:03.964974 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e2e35016-c999-46f0-a2b9-e808349980d2 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:03.968586 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e2e35016-c999-46f0-a2b9-e808349980d2 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:03.969234 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e2e35016-c999-46f0-a2b9-e808349980d2 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:04.265898 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e2e35016-c999-46f0-a2b9-e808349980d2 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:04.277169 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e2e35016-c999-46f0-a2b9-e808349980d2 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3" status: 200 len: 1319 microversion: 2.1 time: 0.332629 Jun 10 18:07:04.278758 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1532/2987] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:03 2022] GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3 => generated 1319 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:07:04.523624 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-47050cf5-6972-4386-9443-f8ab26c45de8 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:04.524494 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-47050cf5-6972-4386-9443-f8ab26c45de8 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:04.531678 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-47050cf5-6972-4386-9443-f8ab26c45de8 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:04.532201 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-47050cf5-6972-4386-9443-f8ab26c45de8 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:04.533146 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-47050cf5-6972-4386-9443-f8ab26c45de8 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:04.533780 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-47050cf5-6972-4386-9443-f8ab26c45de8 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:04.735055 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-47050cf5-6972-4386-9443-f8ab26c45de8 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:04.743435 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-47050cf5-6972-4386-9443-f8ab26c45de8 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058" status: 200 len: 1805 microversion: 2.1 time: 0.224160 Jun 10 18:07:04.752347 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1456/2988] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:04 2022] GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 => generated 1805 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:04.760688 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-63c744b8-c1d8-4668-8bfb-b98a3d98110c tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:04.761202 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-63c744b8-c1d8-4668-8bfb-b98a3d98110c tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:04.766260 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-af5e30db-613e-4d83-9a78-6d641dd21584 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:04.767084 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-af5e30db-613e-4d83-9a78-6d641dd21584 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:04.768450 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-63c744b8-c1d8-4668-8bfb-b98a3d98110c tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:04.769563 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-63c744b8-c1d8-4668-8bfb-b98a3d98110c tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:04.770347 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-63c744b8-c1d8-4668-8bfb-b98a3d98110c tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:04.770789 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-63c744b8-c1d8-4668-8bfb-b98a3d98110c tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:04.774020 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-af5e30db-613e-4d83-9a78-6d641dd21584 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:04.775781 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-af5e30db-613e-4d83-9a78-6d641dd21584 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:04.775781 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-af5e30db-613e-4d83-9a78-6d641dd21584 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:04.775781 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-af5e30db-613e-4d83-9a78-6d641dd21584 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:04.795777 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-63c744b8-c1d8-4668-8bfb-b98a3d98110c tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058/ips" status: 200 len: 218 microversion: 2.1 time: 0.039033 Jun 10 18:07:04.800363 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1533/2989] 10.222.0.35 () {58 vars in 1247 bytes} [Fri Jun 10 18:07:04 2022] GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058/ips => generated 218 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:07:04.810039 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7cde7e0e-b24b-4f10-a4f1-ac7cb6cd4914 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:04.810617 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7cde7e0e-b24b-4f10-a4f1-ac7cb6cd4914 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:04.817956 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7cde7e0e-b24b-4f10-a4f1-ac7cb6cd4914 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:04.818477 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7cde7e0e-b24b-4f10-a4f1-ac7cb6cd4914 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:04.819481 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7cde7e0e-b24b-4f10-a4f1-ac7cb6cd4914 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:04.820176 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7cde7e0e-b24b-4f10-a4f1-ac7cb6cd4914 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:04.848645 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7cde7e0e-b24b-4f10-a4f1-ac7cb6cd4914 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:07:04.942446 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-af5e30db-613e-4d83-9a78-6d641dd21584 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:04.953262 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-af5e30db-613e-4d83-9a78-6d641dd21584 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b" status: 200 len: 1498 microversion: 2.1 time: 0.191126 Jun 10 18:07:04.954196 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1457/2990] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:04 2022] GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b => generated 1498 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:07:04.968564 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-604f58a1-d442-41c6-9c0d-1db1aa9a7345 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:04.969183 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-604f58a1-d442-41c6-9c0d-1db1aa9a7345 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 5cb5b4a5-d399-4f64-8f6a-8815d86e921a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:04.975640 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-604f58a1-d442-41c6-9c0d-1db1aa9a7345 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:04.976095 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-604f58a1-d442-41c6-9c0d-1db1aa9a7345 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:04.976905 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-604f58a1-d442-41c6-9c0d-1db1aa9a7345 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:04.977343 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-604f58a1-d442-41c6-9c0d-1db1aa9a7345 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:05.203261 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-604f58a1-d442-41c6-9c0d-1db1aa9a7345 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:05.213562 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-604f58a1-d442-41c6-9c0d-1db1aa9a7345 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a" status: 200 len: 1314 microversion: 2.1 time: 0.248882 Jun 10 18:07:05.215089 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1458/2991] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:04 2022] GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:05.220644 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0430eb97-8c21-4178-8497-b275156f403f tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:05.221491 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0430eb97-8c21-4178-8497-b275156f403f tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:05.235843 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0430eb97-8c21-4178-8497-b275156f403f tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:05.236429 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0430eb97-8c21-4178-8497-b275156f403f tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:05.238081 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0430eb97-8c21-4178-8497-b275156f403f tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:05.238603 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0430eb97-8c21-4178-8497-b275156f403f tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:05.246740 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7cde7e0e-b24b-4f10-a4f1-ac7cb6cd4914 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "DELETE /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058" status: 204 len: 0 microversion: 2.1 time: 0.440880 Jun 10 18:07:05.247453 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1534/2992] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:07:04 2022] DELETE /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:07:05.258196 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d1bbc5b7-cca8-4af3-aec4-989573ac8016 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:05.259110 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d1bbc5b7-cca8-4af3-aec4-989573ac8016 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:05.278191 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d1bbc5b7-cca8-4af3-aec4-989573ac8016 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:05.279750 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d1bbc5b7-cca8-4af3-aec4-989573ac8016 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:05.282660 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d1bbc5b7-cca8-4af3-aec4-989573ac8016 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:05.283137 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d1bbc5b7-cca8-4af3-aec4-989573ac8016 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:05.363387 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0430eb97-8c21-4178-8497-b275156f403f tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:05.374870 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0430eb97-8c21-4178-8497-b275156f403f tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:05.377935 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0430eb97-8c21-4178-8497-b275156f403f tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:05.380288 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0430eb97-8c21-4178-8497-b275156f403f tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30" status: 200 len: 1366 microversion: 2.47 time: 0.163272 Jun 10 18:07:05.381395 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1459/2993] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:07:05 2022] GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:07:05.387760 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c563e1c9-7faa-4339-9702-29420396701b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:05.388887 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c563e1c9-7faa-4339-9702-29420396701b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: d4580fa2-bf3a-4dc7-af2b-0d6af14508b3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:05.399507 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c563e1c9-7faa-4339-9702-29420396701b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:05.400338 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c563e1c9-7faa-4339-9702-29420396701b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:05.400745 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c563e1c9-7faa-4339-9702-29420396701b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:05.401381 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c563e1c9-7faa-4339-9702-29420396701b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:05.563912 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d1bbc5b7-cca8-4af3-aec4-989573ac8016 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:05.573265 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d1bbc5b7-cca8-4af3-aec4-989573ac8016 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058" status: 200 len: 1811 microversion: 2.1 time: 0.321220 Jun 10 18:07:05.585241 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c563e1c9-7faa-4339-9702-29420396701b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:05.588618 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1535/2994] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:05 2022] GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 => generated 1811 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:05.600128 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c563e1c9-7faa-4339-9702-29420396701b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3" status: 200 len: 1468 microversion: 2.1 time: 0.217469 Jun 10 18:07:05.600809 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1460/2995] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:05 2022] GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3 => generated 1468 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:05.619946 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5f32dcf0-ddca-4c64-8f80-9679f7785418 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:05.621132 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5f32dcf0-ddca-4c64-8f80-9679f7785418 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: f448b274-8163-42f3-9eea-1e4f3458dd2b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:05.627601 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f32dcf0-ddca-4c64-8f80-9679f7785418 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:05.628799 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f32dcf0-ddca-4c64-8f80-9679f7785418 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:05.629726 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f32dcf0-ddca-4c64-8f80-9679f7785418 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:05.630528 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f32dcf0-ddca-4c64-8f80-9679f7785418 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:05.885222 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5f32dcf0-ddca-4c64-8f80-9679f7785418 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:05.903242 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5f32dcf0-ddca-4c64-8f80-9679f7785418 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/f448b274-8163-42f3-9eea-1e4f3458dd2b" status: 200 len: 1468 microversion: 2.1 time: 0.286941 Jun 10 18:07:05.904011 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1536/2996] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:05 2022] GET /compute/v2.1/servers/f448b274-8163-42f3-9eea-1e4f3458dd2b => generated 1468 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:05.923036 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-03e8a4cc-36cb-450c-9844-b8976b21a86a tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:05.929319 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-03e8a4cc-36cb-450c-9844-b8976b21a86a tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:05.930843 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-03e8a4cc-36cb-450c-9844-b8976b21a86a tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Searching by: {'reservation_id': 'r-i2m3hs0w', 'deleted': False, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1'} {{(pid=126595) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 18:07:05.939464 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03e8a4cc-36cb-450c-9844-b8976b21a86a tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:05.939925 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03e8a4cc-36cb-450c-9844-b8976b21a86a tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:05.941686 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03e8a4cc-36cb-450c-9844-b8976b21a86a tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:05.942303 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03e8a4cc-36cb-450c-9844-b8976b21a86a tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:05.971582 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-782e1b9d-4a28-44fe-a84f-8f464f2750e3 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:05.972504 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-782e1b9d-4a28-44fe-a84f-8f464f2750e3 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:05.984789 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-782e1b9d-4a28-44fe-a84f-8f464f2750e3 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:05.985316 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-782e1b9d-4a28-44fe-a84f-8f464f2750e3 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:05.986228 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-782e1b9d-4a28-44fe-a84f-8f464f2750e3 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:05.986674 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-782e1b9d-4a28-44fe-a84f-8f464f2750e3 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:06.000151 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:07:06.164527 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.multi_cell_list [None req-03e8a4cc-36cb-450c-9844-b8976b21a86a tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126595) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 10 18:07:06.275603 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-03e8a4cc-36cb-450c-9844-b8976b21a86a tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:06.286018 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03e8a4cc-36cb-450c-9844-b8976b21a86a tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:06.286204 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-782e1b9d-4a28-44fe-a84f-8f464f2750e3 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:06.286476 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03e8a4cc-36cb-450c-9844-b8976b21a86a tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:06.296822 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-782e1b9d-4a28-44fe-a84f-8f464f2750e3 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b" status: 200 len: 1498 microversion: 2.1 time: 0.329701 Jun 10 18:07:06.306669 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1537/2997] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:05 2022] GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b => generated 1498 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:07:06.307324 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9d4a842c-0829-4d3a-975c-4383e090f5a3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:06.307940 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9d4a842c-0829-4d3a-975c-4383e090f5a3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 5cb5b4a5-d399-4f64-8f6a-8815d86e921a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:06.336178 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9d4a842c-0829-4d3a-975c-4383e090f5a3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:06.336668 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9d4a842c-0829-4d3a-975c-4383e090f5a3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:06.337486 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9d4a842c-0829-4d3a-975c-4383e090f5a3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:06.348209 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9d4a842c-0829-4d3a-975c-4383e090f5a3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:06.458489 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-03e8a4cc-36cb-450c-9844-b8976b21a86a tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/detail?reservation_id=r-i2m3hs0w" status: 200 len: 2929 microversion: 2.1 time: 0.541090 Jun 10 18:07:06.459496 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1461/2998] 10.222.0.35 () {58 vars in 1196 bytes} [Fri Jun 10 18:07:05 2022] GET /compute/v2.1/servers/detail?reservation_id=r-i2m3hs0w => generated 2929 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:06.478846 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e5cab6c8-6f33-4b04-9d70-4ec9182e1778 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:06.479477 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e5cab6c8-6f33-4b04-9d70-4ec9182e1778 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:06.489992 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e5cab6c8-6f33-4b04-9d70-4ec9182e1778 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:06.491194 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e5cab6c8-6f33-4b04-9d70-4ec9182e1778 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:06.492481 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e5cab6c8-6f33-4b04-9d70-4ec9182e1778 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:06.493730 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e5cab6c8-6f33-4b04-9d70-4ec9182e1778 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:06.586785 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e5cab6c8-6f33-4b04-9d70-4ec9182e1778 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:06.601787 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e5cab6c8-6f33-4b04-9d70-4ec9182e1778 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:06.603623 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e5cab6c8-6f33-4b04-9d70-4ec9182e1778 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:06.605718 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e5cab6c8-6f33-4b04-9d70-4ec9182e1778 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30" status: 200 len: 1366 microversion: 2.47 time: 0.143502 Jun 10 18:07:06.619851 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1462/2999] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:07:06 2022] GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:07:06.630003 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1fb4b741-d4e4-45fd-9289-1d470c18d404 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:06.647962 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.compute.server_groups [None req-1fb4b741-d4e4-45fd-9289-1d470c18d404 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Querying cell 0f13ffb7-1a21-4641-8558-8a89dd295960(cell1) for 2 instances {{(pid=126595) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jun 10 18:07:06.649725 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1fb4b741-d4e4-45fd-9289-1d470c18d404 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:06.651969 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1fb4b741-d4e4-45fd-9289-1d470c18d404 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:06.685572 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1fb4b741-d4e4-45fd-9289-1d470c18d404 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/os-server-groups/f1232bf5-d888-4a4d-af7c-4e6e28703ed6" status: 200 len: 270 microversion: 2.1 time: 0.064044 Jun 10 18:07:06.692955 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1463/3000] 10.222.0.35 () {58 vars in 1262 bytes} [Fri Jun 10 18:07:06 2022] GET /compute/v2.1/os-server-groups/f1232bf5-d888-4a4d-af7c-4e6e28703ed6 => generated 270 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:07:06.698208 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0bb3e256-47d6-4ede-959a-98c01c53589c tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:06.699375 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0bb3e256-47d6-4ede-959a-98c01c53589c tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:06.709573 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0bb3e256-47d6-4ede-959a-98c01c53589c tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:06.710401 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0bb3e256-47d6-4ede-959a-98c01c53589c tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:06.711592 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0bb3e256-47d6-4ede-959a-98c01c53589c tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:06.713963 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0bb3e256-47d6-4ede-959a-98c01c53589c tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:06.758135 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9d4a842c-0829-4d3a-975c-4383e090f5a3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:06.768080 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9d4a842c-0829-4d3a-975c-4383e090f5a3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a" status: 200 len: 1314 microversion: 2.1 time: 0.467882 Jun 10 18:07:06.769219 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1538/3001] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:06 2022] GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a => generated 1314 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:06.783348 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e620e16b-af3a-4b74-9441-f917745ca1c7 tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:06.787004 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e620e16b-af3a-4b74-9441-f917745ca1c7 tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] [instance: d4580fa2-bf3a-4dc7-af2b-0d6af14508b3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:06.799681 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e620e16b-af3a-4b74-9441-f917745ca1c7 tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:06.806290 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e620e16b-af3a-4b74-9441-f917745ca1c7 tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:06.808503 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e620e16b-af3a-4b74-9441-f917745ca1c7 tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:06.808503 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e620e16b-af3a-4b74-9441-f917745ca1c7 tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:06.980789 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0bb3e256-47d6-4ede-959a-98c01c53589c tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:07.000956 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0bb3e256-47d6-4ede-959a-98c01c53589c tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058" status: 200 len: 1811 microversion: 2.1 time: 0.306445 Jun 10 18:07:07.012548 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1464/3002] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:06 2022] GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 => generated 1811 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:07.119269 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e620e16b-af3a-4b74-9441-f917745ca1c7 tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3" status: 200 len: 1619 microversion: 2.1 time: 0.346981 Jun 10 18:07:07.120906 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1539/3003] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:06 2022] GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3 => generated 1619 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:07.139330 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3e04a716-344a-41b8-9837-04f3be7a0f63 tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:07.139955 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3e04a716-344a-41b8-9837-04f3be7a0f63 tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] [instance: f448b274-8163-42f3-9eea-1e4f3458dd2b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:07.147129 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3e04a716-344a-41b8-9837-04f3be7a0f63 tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:07.148073 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3e04a716-344a-41b8-9837-04f3be7a0f63 tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:07.149466 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3e04a716-344a-41b8-9837-04f3be7a0f63 tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:07.150197 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3e04a716-344a-41b8-9837-04f3be7a0f63 tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:07.315093 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3e04a716-344a-41b8-9837-04f3be7a0f63 tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/f448b274-8163-42f3-9eea-1e4f3458dd2b" status: 200 len: 1619 microversion: 2.1 time: 0.179612 Jun 10 18:07:07.316192 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1465/3004] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:07 2022] GET /compute/v2.1/servers/f448b274-8163-42f3-9eea-1e4f3458dd2b => generated 1619 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:07.322870 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cccefd64-ef2f-4cc9-9ad2-7bb73bbb56c8 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:07.323844 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cccefd64-ef2f-4cc9-9ad2-7bb73bbb56c8 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:07.337955 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cccefd64-ef2f-4cc9-9ad2-7bb73bbb56c8 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:07.338644 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cccefd64-ef2f-4cc9-9ad2-7bb73bbb56c8 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:07.339627 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cccefd64-ef2f-4cc9-9ad2-7bb73bbb56c8 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:07.340221 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cccefd64-ef2f-4cc9-9ad2-7bb73bbb56c8 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:07.484389 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a12a6529-4667-499d-adf9-8b350106d50b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-113900320", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "5a7cc611-89ea-4c58-af65-315000f47739"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:07:07.587103 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-a12a6529-4667-499d-adf9-8b350106d50b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] validate_networks() for None {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:07:07.700476 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cccefd64-ef2f-4cc9-9ad2-7bb73bbb56c8 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:07.713117 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cccefd64-ef2f-4cc9-9ad2-7bb73bbb56c8 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b" status: 200 len: 1498 microversion: 2.1 time: 0.402443 Jun 10 18:07:07.713714 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1540/3005] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:07 2022] GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b => generated 1498 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:07:07.727266 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4b7005fb-5dc0-4422-afb7-07ffec8da18f tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:07.727876 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4b7005fb-5dc0-4422-afb7-07ffec8da18f tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:07.742334 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4b7005fb-5dc0-4422-afb7-07ffec8da18f tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:07.742785 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4b7005fb-5dc0-4422-afb7-07ffec8da18f tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:07.743574 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4b7005fb-5dc0-4422-afb7-07ffec8da18f tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:07.744015 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4b7005fb-5dc0-4422-afb7-07ffec8da18f tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:07.943002 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4b7005fb-5dc0-4422-afb7-07ffec8da18f tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:07.951842 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4b7005fb-5dc0-4422-afb7-07ffec8da18f tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:07.953607 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4b7005fb-5dc0-4422-afb7-07ffec8da18f tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:07.955026 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4b7005fb-5dc0-4422-afb7-07ffec8da18f tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30" status: 200 len: 1366 microversion: 2.47 time: 0.240382 Jun 10 18:07:07.955760 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1541/3006] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:07:07 2022] GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30 => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:07:07.961680 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-eaa077fd-e953-4618-811a-3172cc5333cc tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:07.962479 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-eaa077fd-e953-4618-811a-3172cc5333cc tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 5cb5b4a5-d399-4f64-8f6a-8815d86e921a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:07.968700 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eaa077fd-e953-4618-811a-3172cc5333cc tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:07.969328 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eaa077fd-e953-4618-811a-3172cc5333cc tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:07.970273 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eaa077fd-e953-4618-811a-3172cc5333cc tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:07.970855 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eaa077fd-e953-4618-811a-3172cc5333cc tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:08.149848 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-a12a6529-4667-499d-adf9-8b350106d50b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:07:08.150487 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-a12a6529-4667-499d-adf9-8b350106d50b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:07:08.150969 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-a12a6529-4667-499d-adf9-8b350106d50b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:07:08.152167 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-a12a6529-4667-499d-adf9-8b350106d50b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:07:08.152768 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-a12a6529-4667-499d-adf9-8b350106d50b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:07:08.169599 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a12a6529-4667-499d-adf9-8b350106d50b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:08.170547 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a12a6529-4667-499d-adf9-8b350106d50b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:08.172634 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a12a6529-4667-499d-adf9-8b350106d50b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:08.172634 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a12a6529-4667-499d-adf9-8b350106d50b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:08.196037 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-a12a6529-4667-499d-adf9-8b350106d50b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Getting quotas for project bb2c4b1067ac4cab8b8565bc987f00b1. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:07:08.203086 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-a12a6529-4667-499d-adf9-8b350106d50b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Getting quotas for user 9c189471a3ab4ec2b644b3ee1352d4e6 and project bb2c4b1067ac4cab8b8565bc987f00b1. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:07:08.218257 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a12a6529-4667-499d-adf9-8b350106d50b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:07:08.218722 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-eaa077fd-e953-4618-811a-3172cc5333cc tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:08.220967 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a12a6529-4667-499d-adf9-8b350106d50b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 03dcc828-a971-496c-aa8c-28681ec6fc01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:07:08.229977 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-eaa077fd-e953-4618-811a-3172cc5333cc tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a" status: 200 len: 1314 microversion: 2.1 time: 0.272354 Jun 10 18:07:08.232794 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1542/3007] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:07 2022] GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:08.243684 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e1ce9f1d-dd78-4e2b-a7a1-ee7a1b46686b tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:08.245338 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e1ce9f1d-dd78-4e2b-a7a1-ee7a1b46686b tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:08.260849 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e1ce9f1d-dd78-4e2b-a7a1-ee7a1b46686b tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:08.261385 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e1ce9f1d-dd78-4e2b-a7a1-ee7a1b46686b tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:08.262563 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e1ce9f1d-dd78-4e2b-a7a1-ee7a1b46686b tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:08.263811 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e1ce9f1d-dd78-4e2b-a7a1-ee7a1b46686b tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:08.387811 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a12a6529-4667-499d-adf9-8b350106d50b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.906147 Jun 10 18:07:08.391425 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1466/3008] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:07:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:07:08.400137 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2fcf09ac-f9c3-44d4-87ea-e5dcfc086400 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:08.403163 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2fcf09ac-f9c3-44d4-87ea-e5dcfc086400 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 03dcc828-a971-496c-aa8c-28681ec6fc01] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:08.578627 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2fcf09ac-f9c3-44d4-87ea-e5dcfc086400 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:08.591561 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2fcf09ac-f9c3-44d4-87ea-e5dcfc086400 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01" status: 200 len: 1216 microversion: 2.1 time: 0.194448 Jun 10 18:07:08.592323 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1467/3009] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:08 2022] GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01 => generated 1216 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:07:08.602029 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-f9818c27-f8ab-4ac4-9b08-4349551e1b26 req-39860b24-4862-47ad-8790-2b27445fd0aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58980efb-1c1a-45bb-9ac8-99383b147058", "name": "network-vif-deleted", "tag": "44ed9fcb-fbc5-4fd8-82c9-6b494e913b38"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:07:08.616502 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-f9818c27-f8ab-4ac4-9b08-4349551e1b26 req-39860b24-4862-47ad-8790-2b27445fd0aa service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:08.616502 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-f9818c27-f8ab-4ac4-9b08-4349551e1b26 req-39860b24-4862-47ad-8790-2b27445fd0aa service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:08.657082 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-f9818c27-f8ab-4ac4-9b08-4349551e1b26 req-39860b24-4862-47ad-8790-2b27445fd0aa service nova] Creating event network-vif-deleted:44ed9fcb-fbc5-4fd8-82c9-6b494e913b38 for instance 58980efb-1c1a-45bb-9ac8-99383b147058 on chh2-master-2 Jun 10 18:07:08.667833 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-f9818c27-f8ab-4ac4-9b08-4349551e1b26 req-39860b24-4862-47ad-8790-2b27445fd0aa service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073762 Jun 10 18:07:08.669773 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1468/3010] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:07:08.735647 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c4f810a7-3a2c-4950-ac3a-dcbf6a46b9eb tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:08.744122 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c4f810a7-3a2c-4950-ac3a-dcbf6a46b9eb tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:08.770472 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c4f810a7-3a2c-4950-ac3a-dcbf6a46b9eb tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:08.772859 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c4f810a7-3a2c-4950-ac3a-dcbf6a46b9eb tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:08.775671 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c4f810a7-3a2c-4950-ac3a-dcbf6a46b9eb tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:08.776292 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c4f810a7-3a2c-4950-ac3a-dcbf6a46b9eb tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:09.115965 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c4f810a7-3a2c-4950-ac3a-dcbf6a46b9eb tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:09.124284 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c4f810a7-3a2c-4950-ac3a-dcbf6a46b9eb tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b" status: 200 len: 1498 microversion: 2.1 time: 0.396948 Jun 10 18:07:09.125138 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1469/3011] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:08 2022] GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b => generated 1498 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:07:09.130490 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-e9a19e13-6be7-423f-83c9-2fed958830e2 req-dd419be9-5233-4620-aae7-8caea66537ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cb5b4a5-d399-4f64-8f6a-8815d86e921a", "name": "network-vif-plugged", "status": "completed", "tag": "01aa0dae-0896-47f3-b43f-12eb45f1ec84"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:07:09.140943 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-e9a19e13-6be7-423f-83c9-2fed958830e2 req-dd419be9-5233-4620-aae7-8caea66537ec service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:09.141570 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-e9a19e13-6be7-423f-83c9-2fed958830e2 req-dd419be9-5233-4620-aae7-8caea66537ec service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:09.168574 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-e9a19e13-6be7-423f-83c9-2fed958830e2 req-dd419be9-5233-4620-aae7-8caea66537ec service nova] Creating event network-vif-plugged:01aa0dae-0896-47f3-b43f-12eb45f1ec84 for instance 5cb5b4a5-d399-4f64-8f6a-8815d86e921a on chh2-master-2 Jun 10 18:07:09.176752 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-e9a19e13-6be7-423f-83c9-2fed958830e2 req-dd419be9-5233-4620-aae7-8caea66537ec service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049999 Jun 10 18:07:09.182063 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1470/3012] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:07:09.191761 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-281480fb-cbd9-4452-b8ee-b936d7d52975 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:09.198852 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-281480fb-cbd9-4452-b8ee-b936d7d52975 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:09.212852 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-281480fb-cbd9-4452-b8ee-b936d7d52975 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:09.213599 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-281480fb-cbd9-4452-b8ee-b936d7d52975 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:09.214571 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-281480fb-cbd9-4452-b8ee-b936d7d52975 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:09.215192 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-281480fb-cbd9-4452-b8ee-b936d7d52975 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:09.253488 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:07:09.321019 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-281480fb-cbd9-4452-b8ee-b936d7d52975 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:09.333127 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-281480fb-cbd9-4452-b8ee-b936d7d52975 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:09.335804 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-281480fb-cbd9-4452-b8ee-b936d7d52975 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:09.337819 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-281480fb-cbd9-4452-b8ee-b936d7d52975 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30" status: 200 len: 1366 microversion: 2.47 time: 0.154375 Jun 10 18:07:09.339078 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1471/3013] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:07:09 2022] GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:07:09.345910 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4172fce9-4e31-44f9-b04f-49f86acd63b8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:09.350303 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4172fce9-4e31-44f9-b04f-49f86acd63b8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 5cb5b4a5-d399-4f64-8f6a-8815d86e921a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:09.357872 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4172fce9-4e31-44f9-b04f-49f86acd63b8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:09.358788 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4172fce9-4e31-44f9-b04f-49f86acd63b8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:09.359789 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4172fce9-4e31-44f9-b04f-49f86acd63b8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:09.360582 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4172fce9-4e31-44f9-b04f-49f86acd63b8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:09.499106 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e1ce9f1d-dd78-4e2b-a7a1-ee7a1b46686b tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:09.523363 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e1ce9f1d-dd78-4e2b-a7a1-ee7a1b46686b tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058" status: 200 len: 1790 microversion: 2.1 time: 1.288025 Jun 10 18:07:09.525783 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1543/3014] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:08 2022] GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 => generated 1790 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:09.610840 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6adb9eb1-9630-4149-b710-8e50e5ae6947 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:09.611781 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6adb9eb1-9630-4149-b710-8e50e5ae6947 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 03dcc828-a971-496c-aa8c-28681ec6fc01] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:09.709474 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6adb9eb1-9630-4149-b710-8e50e5ae6947 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:09.719549 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6adb9eb1-9630-4149-b710-8e50e5ae6947 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01" status: 200 len: 1216 microversion: 2.1 time: 0.114160 Jun 10 18:07:09.720442 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1544/3015] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:09 2022] GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01 => generated 1216 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:09.768274 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4172fce9-4e31-44f9-b04f-49f86acd63b8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:09.777032 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4172fce9-4e31-44f9-b04f-49f86acd63b8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a" status: 200 len: 1314 microversion: 2.1 time: 0.436561 Jun 10 18:07:09.777648 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1472/3016] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:09 2022] GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:10.144853 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-583541fb-6a63-4b50-a299-8274e12e981d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:10.145539 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-583541fb-6a63-4b50-a299-8274e12e981d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:10.160947 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-583541fb-6a63-4b50-a299-8274e12e981d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:10.166332 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-583541fb-6a63-4b50-a299-8274e12e981d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:10.168145 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-583541fb-6a63-4b50-a299-8274e12e981d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:10.169361 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-583541fb-6a63-4b50-a299-8274e12e981d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:10.344134 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-583541fb-6a63-4b50-a299-8274e12e981d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:10.352474 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-583541fb-6a63-4b50-a299-8274e12e981d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b" status: 200 len: 1498 microversion: 2.1 time: 0.213696 Jun 10 18:07:10.353067 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1545/3017] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:10 2022] GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b => generated 1498 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:10.356350 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c9c1a0c4-41e8-405c-9c36-1c6b484fde09 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:10.356983 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c9c1a0c4-41e8-405c-9c36-1c6b484fde09 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:10.364254 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9c1a0c4-41e8-405c-9c36-1c6b484fde09 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:10.364765 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9c1a0c4-41e8-405c-9c36-1c6b484fde09 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:10.365572 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9c1a0c4-41e8-405c-9c36-1c6b484fde09 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:10.366019 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9c1a0c4-41e8-405c-9c36-1c6b484fde09 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:10.472452 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c9c1a0c4-41e8-405c-9c36-1c6b484fde09 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:10.482866 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c9c1a0c4-41e8-405c-9c36-1c6b484fde09 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:10.484702 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c9c1a0c4-41e8-405c-9c36-1c6b484fde09 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:10.486103 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c9c1a0c4-41e8-405c-9c36-1c6b484fde09 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30" status: 200 len: 1366 microversion: 2.47 time: 0.133896 Jun 10 18:07:10.487224 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1473/3018] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:07:10 2022] GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30 => generated 1366 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:07:10.542691 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ae8a7fe2-fc65-4ef0-bcfa-a2cadf843beb tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:10.543313 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ae8a7fe2-fc65-4ef0-bcfa-a2cadf843beb tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:10.549899 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ae8a7fe2-fc65-4ef0-bcfa-a2cadf843beb tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:10.550354 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ae8a7fe2-fc65-4ef0-bcfa-a2cadf843beb tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:10.551149 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ae8a7fe2-fc65-4ef0-bcfa-a2cadf843beb tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:10.551593 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ae8a7fe2-fc65-4ef0-bcfa-a2cadf843beb tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:10.617609 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ae8a7fe2-fc65-4ef0-bcfa-a2cadf843beb tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:10.625685 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ae8a7fe2-fc65-4ef0-bcfa-a2cadf843beb tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058" status: 200 len: 1612 microversion: 2.1 time: 0.086831 Jun 10 18:07:10.626190 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1546/3019] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:10 2022] GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 => generated 1612 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:10.738459 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a840191d-9ba6-4753-a74a-c5c182e2daf9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:10.741175 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a840191d-9ba6-4753-a74a-c5c182e2daf9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 03dcc828-a971-496c-aa8c-28681ec6fc01] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:10.748329 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a840191d-9ba6-4753-a74a-c5c182e2daf9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:10.748789 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a840191d-9ba6-4753-a74a-c5c182e2daf9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:10.750087 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a840191d-9ba6-4753-a74a-c5c182e2daf9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:10.750511 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a840191d-9ba6-4753-a74a-c5c182e2daf9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:10.761566 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-a00a214a-8bb1-4fd5-a781-504a36ff0213 req-f56c4831-35af-4527-9025-7a2112aa8426 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58980efb-1c1a-45bb-9ac8-99383b147058", "name": "network-vif-deleted", "tag": "64d536e0-a4bf-403a-8ba1-f12c3ad0e6d6"}, {"server_uuid": "58980efb-1c1a-45bb-9ac8-99383b147058", "name": "network-vif-deleted", "tag": "65574b89-4808-4278-86d3-b1a0e74bff16"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:07:10.785411 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-a00a214a-8bb1-4fd5-a781-504a36ff0213 req-f56c4831-35af-4527-9025-7a2112aa8426 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:10.785869 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-a00a214a-8bb1-4fd5-a781-504a36ff0213 req-f56c4831-35af-4527-9025-7a2112aa8426 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:10.803012 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-a00a214a-8bb1-4fd5-a781-504a36ff0213 req-f56c4831-35af-4527-9025-7a2112aa8426 service nova] Creating event network-vif-deleted:64d536e0-a4bf-403a-8ba1-f12c3ad0e6d6 for instance 58980efb-1c1a-45bb-9ac8-99383b147058 on chh2-master-2 Jun 10 18:07:10.803912 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-a00a214a-8bb1-4fd5-a781-504a36ff0213 req-f56c4831-35af-4527-9025-7a2112aa8426 service nova] Creating event network-vif-deleted:65574b89-4808-4278-86d3-b1a0e74bff16 for instance 58980efb-1c1a-45bb-9ac8-99383b147058 on chh2-master-2 Jun 10 18:07:10.810166 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-a00a214a-8bb1-4fd5-a781-504a36ff0213 req-f56c4831-35af-4527-9025-7a2112aa8426 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.056729 Jun 10 18:07:10.811625 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1547/3020] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:07:10.817071 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-55155f87-72a7-407d-aa68-a29c002ec672 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:10.817953 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-55155f87-72a7-407d-aa68-a29c002ec672 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 5cb5b4a5-d399-4f64-8f6a-8815d86e921a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:10.824856 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-55155f87-72a7-407d-aa68-a29c002ec672 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:10.825314 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-55155f87-72a7-407d-aa68-a29c002ec672 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:10.826257 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-55155f87-72a7-407d-aa68-a29c002ec672 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:10.826863 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-55155f87-72a7-407d-aa68-a29c002ec672 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:10.859860 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a840191d-9ba6-4753-a74a-c5c182e2daf9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:10.868461 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a840191d-9ba6-4753-a74a-c5c182e2daf9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01" status: 200 len: 1220 microversion: 2.1 time: 0.134962 Jun 10 18:07:10.869286 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1474/3021] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:10 2022] GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01 => generated 1220 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:10.976583 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-55155f87-72a7-407d-aa68-a29c002ec672 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:10.984212 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-55155f87-72a7-407d-aa68-a29c002ec672 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a" status: 200 len: 1314 microversion: 2.1 time: 0.171316 Jun 10 18:07:10.984819 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1548/3022] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:10 2022] GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:11.369785 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2a4cb02c-fce0-449e-a143-bc41b2c397b1 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:11.370426 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2a4cb02c-fce0-449e-a143-bc41b2c397b1 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:11.378554 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2a4cb02c-fce0-449e-a143-bc41b2c397b1 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:11.379006 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2a4cb02c-fce0-449e-a143-bc41b2c397b1 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:11.379786 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2a4cb02c-fce0-449e-a143-bc41b2c397b1 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:11.380227 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2a4cb02c-fce0-449e-a143-bc41b2c397b1 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:11.504387 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4d8a4aa5-0b72-435c-9718-01cceec0d171 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:11.505003 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4d8a4aa5-0b72-435c-9718-01cceec0d171 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:11.517389 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4d8a4aa5-0b72-435c-9718-01cceec0d171 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:11.517389 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4d8a4aa5-0b72-435c-9718-01cceec0d171 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:11.517389 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4d8a4aa5-0b72-435c-9718-01cceec0d171 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:11.517389 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4d8a4aa5-0b72-435c-9718-01cceec0d171 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:11.556993 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2a4cb02c-fce0-449e-a143-bc41b2c397b1 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:11.560143 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2a4cb02c-fce0-449e-a143-bc41b2c397b1 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b" status: 200 len: 1498 microversion: 2.1 time: 0.194259 Jun 10 18:07:11.561955 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1475/3023] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:11 2022] GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b => generated 1498 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:11.629915 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4d8a4aa5-0b72-435c-9718-01cceec0d171 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:11.642461 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4d8a4aa5-0b72-435c-9718-01cceec0d171 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:11.644296 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-02b47bb7-f507-40d8-9bcf-44a3462ec4cf tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:11.644635 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4d8a4aa5-0b72-435c-9718-01cceec0d171 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:11.645280 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-02b47bb7-f507-40d8-9bcf-44a3462ec4cf tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:11.647487 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4d8a4aa5-0b72-435c-9718-01cceec0d171 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30" status: 200 len: 1366 microversion: 2.47 time: 0.145992 Jun 10 18:07:11.649119 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1549/3024] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:07:11 2022] GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:07:11.654274 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02b47bb7-f507-40d8-9bcf-44a3462ec4cf tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:11.656744 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02b47bb7-f507-40d8-9bcf-44a3462ec4cf tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:11.658399 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02b47bb7-f507-40d8-9bcf-44a3462ec4cf tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:11.661089 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02b47bb7-f507-40d8-9bcf-44a3462ec4cf tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:11.697841 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02b47bb7-f507-40d8-9bcf-44a3462ec4cf tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:11.698295 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02b47bb7-f507-40d8-9bcf-44a3462ec4cf tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:11.698746 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-02b47bb7-f507-40d8-9bcf-44a3462ec4cf tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lazy-loading 'fault' on Instance uuid 58980efb-1c1a-45bb-9ac8-99383b147058 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:07:11.755380 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-02b47bb7-f507-40d8-9bcf-44a3462ec4cf tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:11.764220 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-02b47bb7-f507-40d8-9bcf-44a3462ec4cf tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058" status: 200 len: 1303 microversion: 2.1 time: 0.124588 Jun 10 18:07:11.764838 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1476/3025] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:11 2022] GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 => generated 1303 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:07:11.885854 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f4e7f7bd-6600-45d6-9c5d-babd647f1aee tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:11.886674 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f4e7f7bd-6600-45d6-9c5d-babd647f1aee tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 03dcc828-a971-496c-aa8c-28681ec6fc01] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:11.893023 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4e7f7bd-6600-45d6-9c5d-babd647f1aee tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:11.894033 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4e7f7bd-6600-45d6-9c5d-babd647f1aee tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:11.894829 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4e7f7bd-6600-45d6-9c5d-babd647f1aee tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:11.895268 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4e7f7bd-6600-45d6-9c5d-babd647f1aee tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:11.964605 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f4e7f7bd-6600-45d6-9c5d-babd647f1aee tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:11.973916 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f4e7f7bd-6600-45d6-9c5d-babd647f1aee tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01" status: 200 len: 1268 microversion: 2.1 time: 0.092321 Jun 10 18:07:11.975961 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1550/3026] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:11 2022] GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01 => generated 1268 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:12.001576 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ada567b3-edc9-4b22-8d73-b6d4f7e1310e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:12.002838 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ada567b3-edc9-4b22-8d73-b6d4f7e1310e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 5cb5b4a5-d399-4f64-8f6a-8815d86e921a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:12.010721 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ada567b3-edc9-4b22-8d73-b6d4f7e1310e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:12.011189 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ada567b3-edc9-4b22-8d73-b6d4f7e1310e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:12.012008 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ada567b3-edc9-4b22-8d73-b6d4f7e1310e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:12.012490 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ada567b3-edc9-4b22-8d73-b6d4f7e1310e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:12.210150 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ada567b3-edc9-4b22-8d73-b6d4f7e1310e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:12.219029 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ada567b3-edc9-4b22-8d73-b6d4f7e1310e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a" status: 200 len: 1500 microversion: 2.1 time: 0.221348 Jun 10 18:07:12.232770 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1477/3027] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:11 2022] GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a => generated 1500 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:12.238336 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4f8e7542-a718-4404-9f4b-86b1dec06280 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:07:12.238891 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4f8e7542-a718-4404-9f4b-86b1dec06280 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 5cb5b4a5-d399-4f64-8f6a-8815d86e921a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:12.246481 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4f8e7542-a718-4404-9f4b-86b1dec06280 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:12.246951 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4f8e7542-a718-4404-9f4b-86b1dec06280 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:12.248831 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4f8e7542-a718-4404-9f4b-86b1dec06280 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:12.249339 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4f8e7542-a718-4404-9f4b-86b1dec06280 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:12.559301 chdv-master-2 devstack@n-api.service[126594]: INFO nova.network.security_group_api [None req-4f8e7542-a718-4404-9f4b-86b1dec06280 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Removing security group d66da2bb-58d2-43e2-bcc0-619fc76d518a from port 01aa0dae-0896-47f3-b43f-12eb45f1ec84 Jun 10 18:07:12.579262 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-39849cce-c575-413e-90dd-7da546900a67 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:12.580271 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-39849cce-c575-413e-90dd-7da546900a67 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:12.593412 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-39849cce-c575-413e-90dd-7da546900a67 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:12.600625 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-39849cce-c575-413e-90dd-7da546900a67 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:12.602054 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-39849cce-c575-413e-90dd-7da546900a67 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:12.602719 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-39849cce-c575-413e-90dd-7da546900a67 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:13.045280 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-39849cce-c575-413e-90dd-7da546900a67 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:13.045280 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-39849cce-c575-413e-90dd-7da546900a67 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b" status: 200 len: 1498 microversion: 2.1 time: 0.455352 Jun 10 18:07:13.045280 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1478/3028] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:12 2022] GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b => generated 1498 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:07:13.050420 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-27351e56-4f7f-432a-bad3-2e4503cabe1e tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:13.051215 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-27351e56-4f7f-432a-bad3-2e4503cabe1e tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:13.058791 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-27351e56-4f7f-432a-bad3-2e4503cabe1e tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:13.059262 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-27351e56-4f7f-432a-bad3-2e4503cabe1e tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:13.060151 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-27351e56-4f7f-432a-bad3-2e4503cabe1e tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:13.070997 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-27351e56-4f7f-432a-bad3-2e4503cabe1e tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:13.166625 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-27351e56-4f7f-432a-bad3-2e4503cabe1e tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:13.178573 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-27351e56-4f7f-432a-bad3-2e4503cabe1e tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:13.180411 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-27351e56-4f7f-432a-bad3-2e4503cabe1e tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:13.181831 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-27351e56-4f7f-432a-bad3-2e4503cabe1e tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30" status: 200 len: 1372 microversion: 2.47 time: 0.138525 Jun 10 18:07:13.182567 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1479/3029] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:07:13 2022] GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30 => generated 1372 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:07:13.200043 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b874be98-994c-40fd-a9ee-c3c79d7c50b0 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:13.201074 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b874be98-994c-40fd-a9ee-c3c79d7c50b0 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:13.208409 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b874be98-994c-40fd-a9ee-c3c79d7c50b0 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:13.212562 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b874be98-994c-40fd-a9ee-c3c79d7c50b0 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:13.212562 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b874be98-994c-40fd-a9ee-c3c79d7c50b0 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:13.212562 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b874be98-994c-40fd-a9ee-c3c79d7c50b0 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:13.227034 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-b874be98-994c-40fd-a9ee-c3c79d7c50b0 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] HTTP exception thrown: Instance 58980efb-1c1a-45bb-9ac8-99383b147058 could not be found. Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b874be98-994c-40fd-a9ee-c3c79d7c50b0 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Request method failure captured: Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 HTTP/1.1 Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4gJTZlKpxqln8lKC9Kk_1a-omRv696X6tGCmr-BNFyfScay85WTbCpW3KUrWzOFJfrP0SdxxRWfcHRbOzg7E4AwwPL-KIhggFrJa3mAbCig37CGigRqqBhDtgWJ_8f_RkZysWT-wKl28gaxKI9jcBhlt-V6MsVpjeFF20icX5AihhY Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 818440b6c7d34e09a1afd8a6e0c0b3ed Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersTestMultiNic-255908356 Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/818440b6c7d34e09a1afd8a6e0c0b3ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/818440b6c7d34e09a1afd8a6e0c0b3ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/818440b6c7d34e09a1afd8a6e0c0b3ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_818440b6c7d34e09a1afd8a6e0c0b3ed", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersTestMultiNic-255908356 Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 818440b6c7d34e09a1afd8a6e0c0b3ed Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersTestMultiNic-255908356 Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersTestMultiNic-255908356-project Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 1d61eddc0c334ec79e23a069a422fad8 Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersTestMultiNic-255908356-project Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 58980efb-1c1a-45bb-9ac8-99383b147058 could not be found. Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '58980efb-1c1a-45bb-9ac8-99383b147058'} Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58980efb-1c1a-45bb-9ac8-99383b147058 could not be found. Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58980efb-1c1a-45bb-9ac8-99383b147058 could not be found. Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:07:13.228783 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:07:13.232724 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:07:13.232724 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:07:13.232724 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:07:13.232724 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:07:13.232724 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:07:13.232724 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58980efb-1c1a-45bb-9ac8-99383b147058 could not be found. Jun 10 18:07:13.232724 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:07:13.232724 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b874be98-994c-40fd-a9ee-c3c79d7c50b0 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Returning 404 to user: Instance 58980efb-1c1a-45bb-9ac8-99383b147058 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:07:13.232724 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b874be98-994c-40fd-a9ee-c3c79d7c50b0 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058" status: 404 len: 111 microversion: 2.1 time: 0.035246 Jun 10 18:07:13.236040 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1480/3030] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:13 2022] GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:07:13.241134 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3f42ca7d-ce6f-43df-b527-d41c5fa117a8 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:13.241765 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3f42ca7d-ce6f-43df-b527-d41c5fa117a8 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 03dcc828-a971-496c-aa8c-28681ec6fc01] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:13.248172 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3f42ca7d-ce6f-43df-b527-d41c5fa117a8 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:13.248670 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3f42ca7d-ce6f-43df-b527-d41c5fa117a8 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:13.249471 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3f42ca7d-ce6f-43df-b527-d41c5fa117a8 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:13.249912 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3f42ca7d-ce6f-43df-b527-d41c5fa117a8 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:13.364969 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3f42ca7d-ce6f-43df-b527-d41c5fa117a8 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:13.380913 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3f42ca7d-ce6f-43df-b527-d41c5fa117a8 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01" status: 200 len: 1274 microversion: 2.1 time: 0.143456 Jun 10 18:07:13.382413 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1481/3031] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:13 2022] GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01 => generated 1274 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:13.415105 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4f8e7542-a718-4404-9f4b-86b1dec06280 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "POST /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a/action" status: 202 len: 0 microversion: 2.1 time: 1.182935 Jun 10 18:07:13.415815 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1551/3032] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:07:12 2022] POST /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a/action => generated 0 bytes in 1184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:07:13.426330 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-976a1316-5793-49e8-85d1-ad2163d41017 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:13.427138 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-976a1316-5793-49e8-85d1-ad2163d41017 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 5cb5b4a5-d399-4f64-8f6a-8815d86e921a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:13.437028 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-b439493f-e251-47a8-b4e5-dfabd947c66c req-bb20875d-c573-47f4-9ec5-8a08e928160f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cb5b4a5-d399-4f64-8f6a-8815d86e921a", "tag": "01aa0dae-0896-47f3-b43f-12eb45f1ec84"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:07:13.471993 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-976a1316-5793-49e8-85d1-ad2163d41017 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:13.471993 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-976a1316-5793-49e8-85d1-ad2163d41017 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:13.471993 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-976a1316-5793-49e8-85d1-ad2163d41017 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:13.471993 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-976a1316-5793-49e8-85d1-ad2163d41017 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:13.475478 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-b439493f-e251-47a8-b4e5-dfabd947c66c req-bb20875d-c573-47f4-9ec5-8a08e928160f service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:13.475951 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-b439493f-e251-47a8-b4e5-dfabd947c66c req-bb20875d-c573-47f4-9ec5-8a08e928160f service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:13.507625 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-b439493f-e251-47a8-b4e5-dfabd947c66c req-bb20875d-c573-47f4-9ec5-8a08e928160f service nova] Creating event network-changed:01aa0dae-0896-47f3-b43f-12eb45f1ec84 for instance 5cb5b4a5-d399-4f64-8f6a-8815d86e921a on chh2-master-2 Jun 10 18:07:13.524606 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-b439493f-e251-47a8-b4e5-dfabd947c66c req-bb20875d-c573-47f4-9ec5-8a08e928160f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093388 Jun 10 18:07:13.525827 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1552/3033] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:07:13.810369 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-976a1316-5793-49e8-85d1-ad2163d41017 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:13.827987 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-976a1316-5793-49e8-85d1-ad2163d41017 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a" status: 200 len: 1458 microversion: 2.1 time: 0.400723 Jun 10 18:07:13.827987 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1482/3034] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:13 2022] GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a => generated 1458 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:13.841087 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-dacef238-bc73-4de6-9cfa-05745cd957ab tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:13.843430 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-dacef238-bc73-4de6-9cfa-05745cd957ab tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:13.852075 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:07:13.854811 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dacef238-bc73-4de6-9cfa-05745cd957ab tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:13.855778 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dacef238-bc73-4de6-9cfa-05745cd957ab tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:13.862791 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dacef238-bc73-4de6-9cfa-05745cd957ab tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:13.863582 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dacef238-bc73-4de6-9cfa-05745cd957ab tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:14.051053 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bcd6f586-c0d3-4f40-a2b8-a4fe4bd1fc6f tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:14.052274 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bcd6f586-c0d3-4f40-a2b8-a4fe4bd1fc6f tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:14.072590 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bcd6f586-c0d3-4f40-a2b8-a4fe4bd1fc6f tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:14.073428 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bcd6f586-c0d3-4f40-a2b8-a4fe4bd1fc6f tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:14.075263 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bcd6f586-c0d3-4f40-a2b8-a4fe4bd1fc6f tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:14.078932 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bcd6f586-c0d3-4f40-a2b8-a4fe4bd1fc6f tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:14.326248 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-dacef238-bc73-4de6-9cfa-05745cd957ab tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:14.337699 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-dacef238-bc73-4de6-9cfa-05745cd957ab tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.500766 Jun 10 18:07:14.350379 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1553/3035] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:13 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:14.357625 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0a09241e-35ed-4b6f-a8e5-c2b5d9993992 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:14.358264 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0a09241e-35ed-4b6f-a8e5-c2b5d9993992 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:14.372598 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0a09241e-35ed-4b6f-a8e5-c2b5d9993992 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:14.373058 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0a09241e-35ed-4b6f-a8e5-c2b5d9993992 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:14.376789 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0a09241e-35ed-4b6f-a8e5-c2b5d9993992 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:14.379123 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0a09241e-35ed-4b6f-a8e5-c2b5d9993992 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:14.582726 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0a09241e-35ed-4b6f-a8e5-c2b5d9993992 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:14.599129 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0a09241e-35ed-4b6f-a8e5-c2b5d9993992 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:14.600108 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0a09241e-35ed-4b6f-a8e5-c2b5d9993992 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:14.601522 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0a09241e-35ed-4b6f-a8e5-c2b5d9993992 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30" status: 200 len: 1372 microversion: 2.47 time: 0.253418 Jun 10 18:07:14.605284 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1554/3036] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:07:14 2022] GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30 => generated 1372 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:07:14.613386 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7b19f86d-0c80-45d9-9903-34d979965f85 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:14.614318 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7b19f86d-0c80-45d9-9903-34d979965f85 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:14.625161 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7b19f86d-0c80-45d9-9903-34d979965f85 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:14.625161 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7b19f86d-0c80-45d9-9903-34d979965f85 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:14.625673 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7b19f86d-0c80-45d9-9903-34d979965f85 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:14.626494 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7b19f86d-0c80-45d9-9903-34d979965f85 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:14.840543 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bcd6f586-c0d3-4f40-a2b8-a4fe4bd1fc6f tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:14.852826 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bcd6f586-c0d3-4f40-a2b8-a4fe4bd1fc6f tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b" status: 200 len: 1498 microversion: 2.1 time: 0.806803 Jun 10 18:07:14.854110 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1483/3037] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:14 2022] GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b => generated 1498 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:14.858991 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7b19f86d-0c80-45d9-9903-34d979965f85 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:14.859196 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-54229c21-7936-4fe5-9331-3f9df2b76498 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:14.860180 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-54229c21-7936-4fe5-9331-3f9df2b76498 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 03dcc828-a971-496c-aa8c-28681ec6fc01] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:14.867078 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-54229c21-7936-4fe5-9331-3f9df2b76498 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:14.867733 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-54229c21-7936-4fe5-9331-3f9df2b76498 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:14.868711 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-54229c21-7936-4fe5-9331-3f9df2b76498 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:14.869297 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7b19f86d-0c80-45d9-9903-34d979965f85 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.261816 Jun 10 18:07:14.869561 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-54229c21-7936-4fe5-9331-3f9df2b76498 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:14.870347 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1555/3038] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:14 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:14.894982 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b9467773-13d4-4257-8633-28cbf8e4fd13 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:14.895626 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b9467773-13d4-4257-8633-28cbf8e4fd13 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:14.916719 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9467773-13d4-4257-8633-28cbf8e4fd13 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:14.917212 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9467773-13d4-4257-8633-28cbf8e4fd13 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:14.919035 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9467773-13d4-4257-8633-28cbf8e4fd13 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:14.920771 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9467773-13d4-4257-8633-28cbf8e4fd13 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:14.951306 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:07:15.268531 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b9467773-13d4-4257-8633-28cbf8e4fd13 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:15.278118 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b9467773-13d4-4257-8633-28cbf8e4fd13 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.396121 Jun 10 18:07:15.280169 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1556/3039] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:14 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:15.298578 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bb19283e-3b3a-4805-a958-6244bc40b010 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:15.299215 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bb19283e-3b3a-4805-a958-6244bc40b010 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:15.311209 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bb19283e-3b3a-4805-a958-6244bc40b010 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:15.318450 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bb19283e-3b3a-4805-a958-6244bc40b010 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:15.319319 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bb19283e-3b3a-4805-a958-6244bc40b010 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:15.319771 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bb19283e-3b3a-4805-a958-6244bc40b010 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:15.678614 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bb19283e-3b3a-4805-a958-6244bc40b010 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:15.688226 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bb19283e-3b3a-4805-a958-6244bc40b010 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.395886 Jun 10 18:07:15.703908 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1557/3040] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:15 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:07:15.715917 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ca26ad6d-3b61-46e0-9d5d-2e199d4ca741 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:15.715917 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ca26ad6d-3b61-46e0-9d5d-2e199d4ca741 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:15.722055 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ca26ad6d-3b61-46e0-9d5d-2e199d4ca741 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:15.722862 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ca26ad6d-3b61-46e0-9d5d-2e199d4ca741 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:15.724076 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ca26ad6d-3b61-46e0-9d5d-2e199d4ca741 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:15.724712 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ca26ad6d-3b61-46e0-9d5d-2e199d4ca741 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:15.802575 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ca26ad6d-3b61-46e0-9d5d-2e199d4ca741 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:15.812351 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ca26ad6d-3b61-46e0-9d5d-2e199d4ca741 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:15.814927 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ca26ad6d-3b61-46e0-9d5d-2e199d4ca741 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:15.816692 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ca26ad6d-3b61-46e0-9d5d-2e199d4ca741 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30" status: 200 len: 1357 microversion: 2.47 time: 0.110764 Jun 10 18:07:15.817478 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1558/3041] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:07:15 2022] GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30 => generated 1357 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:07:15.824458 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-54229c21-7936-4fe5-9331-3f9df2b76498 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:15.839343 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-54229c21-7936-4fe5-9331-3f9df2b76498 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01" status: 200 len: 1316 microversion: 2.1 time: 0.983915 Jun 10 18:07:15.839975 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1484/3042] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:14 2022] GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01 => generated 1316 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:15.841093 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bb4fa45d-0666-42a0-9d13-873964092f7c tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:15.844764 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bb4fa45d-0666-42a0-9d13-873964092f7c tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:15.845800 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bb4fa45d-0666-42a0-9d13-873964092f7c tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Searching by: {'deleted': False, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a'} {{(pid=126594) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 18:07:15.853067 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bb4fa45d-0666-42a0-9d13-873964092f7c tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:15.853737 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bb4fa45d-0666-42a0-9d13-873964092f7c tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:15.854699 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bb4fa45d-0666-42a0-9d13-873964092f7c tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:15.855299 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bb4fa45d-0666-42a0-9d13-873964092f7c tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:15.871973 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-457ce701-0f28-489f-8294-a5a8cb04f3ff tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:15.873474 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-457ce701-0f28-489f-8294-a5a8cb04f3ff tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:15.886533 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-457ce701-0f28-489f-8294-a5a8cb04f3ff tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:15.889557 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-457ce701-0f28-489f-8294-a5a8cb04f3ff tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:15.890536 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-457ce701-0f28-489f-8294-a5a8cb04f3ff tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:15.900750 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-457ce701-0f28-489f-8294-a5a8cb04f3ff tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:16.054025 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.multi_cell_list [None req-bb4fa45d-0666-42a0-9d13-873964092f7c tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126594) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 10 18:07:16.145069 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bb4fa45d-0666-42a0-9d13-873964092f7c tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:16.153914 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bb4fa45d-0666-42a0-9d13-873964092f7c tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:16.154660 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bb4fa45d-0666-42a0-9d13-873964092f7c tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:16.169934 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bb4fa45d-0666-42a0-9d13-873964092f7c tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:16.171814 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bb4fa45d-0666-42a0-9d13-873964092f7c tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:16.223170 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bb4fa45d-0666-42a0-9d13-873964092f7c tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 0.390654 Jun 10 18:07:16.236575 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1559/3043] 10.222.0.35 () {60 vars in 1186 bytes} [Fri Jun 10 18:07:15 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:07:16.236575 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e7b1356c-b4c7-43f5-ac73-3fcfb3fbdb6f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-112183953", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "02812646-dd80-4769-8285-9699f6c583d0"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:07:16.303072 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-e7b1356c-b4c7-43f5-ac73-3fcfb3fbdb6f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] validate_networks() for [('02812646-dd80-4769-8285-9699f6c583d0', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:07:16.367199 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-457ce701-0f28-489f-8294-a5a8cb04f3ff tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:16.384873 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-457ce701-0f28-489f-8294-a5a8cb04f3ff tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b" status: 200 len: 1498 microversion: 2.1 time: 0.515823 Jun 10 18:07:16.385121 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1485/3044] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:15 2022] GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b => generated 1498 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:07:16.393926 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-07acf764-b955-47bf-b006-f62d72d3f045 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:16.399601 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-07acf764-b955-47bf-b006-f62d72d3f045 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:16.422237 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-07acf764-b955-47bf-b006-f62d72d3f045 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:16.425205 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-07acf764-b955-47bf-b006-f62d72d3f045 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:16.425205 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-07acf764-b955-47bf-b006-f62d72d3f045 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:16.425205 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-07acf764-b955-47bf-b006-f62d72d3f045 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:16.465727 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-07acf764-b955-47bf-b006-f62d72d3f045 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:07:16.647891 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:07:16.867597 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-07acf764-b955-47bf-b006-f62d72d3f045 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "DELETE /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30" status: 204 len: 0 microversion: 2.47 time: 0.480978 Jun 10 18:07:16.868161 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1486/3045] 10.222.0.35 () {60 vars in 1279 bytes} [Fri Jun 10 18:07:16 2022] DELETE /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 10 18:07:16.885108 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8627f8bc-b773-4c6f-9f88-7a6a580c4dee tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:16.886679 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8627f8bc-b773-4c6f-9f88-7a6a580c4dee tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 03dcc828-a971-496c-aa8c-28681ec6fc01] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:16.901602 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-e7b1356c-b4c7-43f5-ac73-3fcfb3fbdb6f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:07:16.901602 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-e7b1356c-b4c7-43f5-ac73-3fcfb3fbdb6f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:07:16.903254 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:07:16.903749 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-e7b1356c-b4c7-43f5-ac73-3fcfb3fbdb6f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:07:16.904276 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-e7b1356c-b4c7-43f5-ac73-3fcfb3fbdb6f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:07:16.906240 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-e7b1356c-b4c7-43f5-ac73-3fcfb3fbdb6f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:07:16.906634 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8627f8bc-b773-4c6f-9f88-7a6a580c4dee tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:16.907103 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8627f8bc-b773-4c6f-9f88-7a6a580c4dee tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:16.907917 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8627f8bc-b773-4c6f-9f88-7a6a580c4dee tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:16.908381 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8627f8bc-b773-4c6f-9f88-7a6a580c4dee tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:16.923848 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7b1356c-b4c7-43f5-ac73-3fcfb3fbdb6f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:16.925261 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7b1356c-b4c7-43f5-ac73-3fcfb3fbdb6f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:16.926409 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7b1356c-b4c7-43f5-ac73-3fcfb3fbdb6f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:16.926986 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7b1356c-b4c7-43f5-ac73-3fcfb3fbdb6f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:16.979790 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-e7b1356c-b4c7-43f5-ac73-3fcfb3fbdb6f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Getting quotas for project 2b34cb51c168497088d66fa0e507e364. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:07:16.988184 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-e7b1356c-b4c7-43f5-ac73-3fcfb3fbdb6f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Getting quotas for user 352e7f5de76c42da9241721fe0f0bf86 and project 2b34cb51c168497088d66fa0e507e364. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:07:17.004389 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e7b1356c-b4c7-43f5-ac73-3fcfb3fbdb6f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:07:17.006767 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e7b1356c-b4c7-43f5-ac73-3fcfb3fbdb6f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:07:17.145828 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e7b1356c-b4c7-43f5-ac73-3fcfb3fbdb6f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.919916 Jun 10 18:07:17.151733 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1560/3046] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:07:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:07:17.153714 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c7636001-0418-4773-9c37-8c24bd126148 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:17.154340 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c7636001-0418-4773-9c37-8c24bd126148 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:17.164200 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c7636001-0418-4773-9c37-8c24bd126148 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:17.164704 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c7636001-0418-4773-9c37-8c24bd126148 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:17.165525 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c7636001-0418-4773-9c37-8c24bd126148 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:17.165977 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c7636001-0418-4773-9c37-8c24bd126148 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:17.288904 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c7636001-0418-4773-9c37-8c24bd126148 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:17.297869 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c7636001-0418-4773-9c37-8c24bd126148 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:17.299468 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c7636001-0418-4773-9c37-8c24bd126148 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:17.300814 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c7636001-0418-4773-9c37-8c24bd126148 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30" status: 200 len: 1363 microversion: 2.47 time: 0.151817 Jun 10 18:07:17.301710 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1561/3047] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:07:17 2022] GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:07:17.316604 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a11a94b4-11bf-46de-b6d6-7cb5c135f934 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:17.320452 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a11a94b4-11bf-46de-b6d6-7cb5c135f934 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:17.383573 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a11a94b4-11bf-46de-b6d6-7cb5c135f934 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:17.408776 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a11a94b4-11bf-46de-b6d6-7cb5c135f934 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1214 microversion: 2.1 time: 0.105067 Jun 10 18:07:17.410880 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1562/3048] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:17 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1214 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:17.422872 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-feecd1d9-4963-46c4-adb1-af6d99ee92c8 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:17.423575 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-feecd1d9-4963-46c4-adb1-af6d99ee92c8 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:17.430335 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-feecd1d9-4963-46c4-adb1-af6d99ee92c8 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:17.431489 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-feecd1d9-4963-46c4-adb1-af6d99ee92c8 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:17.432397 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-feecd1d9-4963-46c4-adb1-af6d99ee92c8 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:17.432922 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-feecd1d9-4963-46c4-adb1-af6d99ee92c8 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:17.764261 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-feecd1d9-4963-46c4-adb1-af6d99ee92c8 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:17.776279 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-feecd1d9-4963-46c4-adb1-af6d99ee92c8 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b" status: 200 len: 1498 microversion: 2.1 time: 0.363797 Jun 10 18:07:17.777129 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1563/3049] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:17 2022] GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b => generated 1498 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:17.828500 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8627f8bc-b773-4c6f-9f88-7a6a580c4dee tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:17.848223 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8627f8bc-b773-4c6f-9f88-7a6a580c4dee tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01" status: 200 len: 1316 microversion: 2.1 time: 0.974859 Jun 10 18:07:17.863564 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1487/3050] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:16 2022] GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01 => generated 1316 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:18.304365 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-caad6f63-bb37-44ba-ad14-a2f44fbaf181 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-2105628392", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "e2e3e731-cadc-4455-b734-6a8c7c29fb2f"}], "security_groups": [{"name": "tempest-securitygroup--1435555177"}], "key_name": "tempest-keypair-1258135869", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "f5f4bc6f-a1d2-444b-9d8e-f7cb1381c014", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:07:18.319410 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-edea5b97-72b5-44a3-b511-a5c8b4f1b2cc tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:18.320034 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-edea5b97-72b5-44a3-b511-a5c8b4f1b2cc tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:18.323352 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:07:18.335215 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-edea5b97-72b5-44a3-b511-a5c8b4f1b2cc tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:18.341406 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-edea5b97-72b5-44a3-b511-a5c8b4f1b2cc tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:18.349402 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-edea5b97-72b5-44a3-b511-a5c8b4f1b2cc tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:18.349549 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-edea5b97-72b5-44a3-b511-a5c8b4f1b2cc tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:18.554990 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-edea5b97-72b5-44a3-b511-a5c8b4f1b2cc tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:18.560639 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-caad6f63-bb37-44ba-ad14-a2f44fbaf181 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] validate_networks() for [('e2e3e731-cadc-4455-b734-6a8c7c29fb2f', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:07:18.588690 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-edea5b97-72b5-44a3-b511-a5c8b4f1b2cc tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:18.592189 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-edea5b97-72b5-44a3-b511-a5c8b4f1b2cc tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:18.596171 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-edea5b97-72b5-44a3-b511-a5c8b4f1b2cc tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30" status: 200 len: 1363 microversion: 2.47 time: 0.280906 Jun 10 18:07:18.597527 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1488/3051] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:07:18 2022] GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30 => generated 1363 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:07:18.606400 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0c44a036-5421-4673-9a55-31e23188ab00 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:18.606400 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0c44a036-5421-4673-9a55-31e23188ab00 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:18.639289 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=10 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:07:18.652762 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0c44a036-5421-4673-9a55-31e23188ab00 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:18.658011 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0c44a036-5421-4673-9a55-31e23188ab00 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:18.678007 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0c44a036-5421-4673-9a55-31e23188ab00 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:18.678488 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0c44a036-5421-4673-9a55-31e23188ab00 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:18.869714 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0c44a036-5421-4673-9a55-31e23188ab00 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:18.889243 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0c44a036-5421-4673-9a55-31e23188ab00 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1210 microversion: 2.1 time: 0.278493 Jun 10 18:07:18.889243 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1489/3052] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:18 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1210 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:18.889243 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-b6d83dee-9b0c-446f-b3d2-e809a809bbb0 req-9d4e017c-52fe-4153-a2f1-679e66135f5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03dcc828-a971-496c-aa8c-28681ec6fc01", "tag": "0bc2cf3a-92dd-4ff7-9e94-25dfa402dcb0"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:07:18.904954 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-b6d83dee-9b0c-446f-b3d2-e809a809bbb0 req-9d4e017c-52fe-4153-a2f1-679e66135f5a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:18.905582 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-b6d83dee-9b0c-446f-b3d2-e809a809bbb0 req-9d4e017c-52fe-4153-a2f1-679e66135f5a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:18.923161 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-b6d83dee-9b0c-446f-b3d2-e809a809bbb0 req-9d4e017c-52fe-4153-a2f1-679e66135f5a service nova] Creating event network-changed:0bc2cf3a-92dd-4ff7-9e94-25dfa402dcb0 for instance 03dcc828-a971-496c-aa8c-28681ec6fc01 on chh2-master-2 Jun 10 18:07:18.935946 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-b6d83dee-9b0c-446f-b3d2-e809a809bbb0 req-9d4e017c-52fe-4153-a2f1-679e66135f5a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054124 Jun 10 18:07:18.946703 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1490/3053] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:07:18.956656 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-343d16fb-3691-47eb-ae90-7471fb5d618e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:18.957683 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-343d16fb-3691-47eb-ae90-7471fb5d618e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:18.965787 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-343d16fb-3691-47eb-ae90-7471fb5d618e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:18.966291 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-343d16fb-3691-47eb-ae90-7471fb5d618e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:18.967307 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-343d16fb-3691-47eb-ae90-7471fb5d618e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:18.967983 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-343d16fb-3691-47eb-ae90-7471fb5d618e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:19.273945 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-caad6f63-bb37-44ba-ad14-a2f44fbaf181 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Getting quotas for project 3c384e1bab854ad8b4c2ae9ab895cd88. Resources: dict_keys(['metadata_items']) {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:07:19.279248 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-caad6f63-bb37-44ba-ad14-a2f44fbaf181 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Getting quotas for user 41f463dd5d9140ecb29e0daa415331a9 and project 3c384e1bab854ad8b4c2ae9ab895cd88. Resources: dict_keys(['metadata_items']) {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:07:19.291820 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-caad6f63-bb37-44ba-ad14-a2f44fbaf181 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:07:19.292247 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-caad6f63-bb37-44ba-ad14-a2f44fbaf181 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:07:19.292758 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-caad6f63-bb37-44ba-ad14-a2f44fbaf181 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:07:19.293175 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-caad6f63-bb37-44ba-ad14-a2f44fbaf181 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:07:19.293592 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-caad6f63-bb37-44ba-ad14-a2f44fbaf181 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:07:19.301999 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-caad6f63-bb37-44ba-ad14-a2f44fbaf181 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:19.302457 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-caad6f63-bb37-44ba-ad14-a2f44fbaf181 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:19.303267 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-caad6f63-bb37-44ba-ad14-a2f44fbaf181 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:19.303717 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-caad6f63-bb37-44ba-ad14-a2f44fbaf181 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:19.315510 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-343d16fb-3691-47eb-ae90-7471fb5d618e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:19.323548 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-343d16fb-3691-47eb-ae90-7471fb5d618e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b" status: 200 len: 1498 microversion: 2.1 time: 0.375295 Jun 10 18:07:19.332851 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1491/3054] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:18 2022] GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b => generated 1498 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:19.332851 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-aa958192-746d-4821-8643-aef6cb26a3d9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:19.340058 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-aa958192-746d-4821-8643-aef6cb26a3d9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 03dcc828-a971-496c-aa8c-28681ec6fc01] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:19.341754 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-caad6f63-bb37-44ba-ad14-a2f44fbaf181 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Getting quotas for project 3c384e1bab854ad8b4c2ae9ab895cd88. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:07:19.342231 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aa958192-746d-4821-8643-aef6cb26a3d9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:19.342231 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aa958192-746d-4821-8643-aef6cb26a3d9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:19.342998 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aa958192-746d-4821-8643-aef6cb26a3d9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:19.343447 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aa958192-746d-4821-8643-aef6cb26a3d9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:19.350290 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-caad6f63-bb37-44ba-ad14-a2f44fbaf181 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Getting quotas for user 41f463dd5d9140ecb29e0daa415331a9 and project 3c384e1bab854ad8b4c2ae9ab895cd88. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:07:19.434684 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-caad6f63-bb37-44ba-ad14-a2f44fbaf181 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:07:19.436991 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-caad6f63-bb37-44ba-ad14-a2f44fbaf181 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] [instance: 4f169350-57ce-4ea3-bfca-ccf6f1957aa9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f5f4bc6f-a1d2-444b-9d8e-f7cb1381c014',volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:07:19.788217 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-aa958192-746d-4821-8643-aef6cb26a3d9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:19.805160 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-aa958192-746d-4821-8643-aef6cb26a3d9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01" status: 200 len: 1316 microversion: 2.1 time: 0.477195 Jun 10 18:07:19.817941 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1492/3055] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:19 2022] GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01 => generated 1316 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:19.831351 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f76203b3-8bfa-4905-8224-af09ab2620d8 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:19.831982 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f76203b3-8bfa-4905-8224-af09ab2620d8 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 8207fc4f-c37e-456c-91d7-9bea06ecbc30] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:19.874360 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f76203b3-8bfa-4905-8224-af09ab2620d8 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:19.875060 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f76203b3-8bfa-4905-8224-af09ab2620d8 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:19.876670 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f76203b3-8bfa-4905-8224-af09ab2620d8 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:19.880295 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f76203b3-8bfa-4905-8224-af09ab2620d8 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:19.919058 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-f76203b3-8bfa-4905-8224-af09ab2620d8 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] HTTP exception thrown: Instance 8207fc4f-c37e-456c-91d7-9bea06ecbc30 could not be found. Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f76203b3-8bfa-4905-8224-af09ab2620d8 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Request method failure captured: Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30 HTTP/1.1 Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4gjAXA1tYVBpzYg53ZED_NoURDWQurr4smylkgdPqFzt1vI9heqEq7BcGgzhZe8ABqBnaJm7m3N3jepWdvr_nRJ3rMmM5kwUyNswKJ68t4P6-tdxH384AOwrvpTuv5aulYl069hznGACnORiHkzFdr-cTtk9VqDgpeXi6QzGD77z1Y Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: X-Openstack-Nova-Api-Version: 2.47 Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 6a06e5e6218a4b5a9ac106fd7a81067a Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServerShowV247Test-1928876094 Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/6a06e5e6218a4b5a9ac106fd7a81067a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/6a06e5e6218a4b5a9ac106fd7a81067a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/6a06e5e6218a4b5a9ac106fd7a81067a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_6a06e5e6218a4b5a9ac106fd7a81067a", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServerShowV247Test-1928876094 Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 6a06e5e6218a4b5a9ac106fd7a81067a Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServerShowV247Test-1928876094 Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServerShowV247Test-1928876094-project Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: f619bd3c4e5245de9013a516a347a1ee Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServerShowV247Test-1928876094-project Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 8207fc4f-c37e-456c-91d7-9bea06ecbc30 could not be found. Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '8207fc4f-c37e-456c-91d7-9bea06ecbc30'} Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8207fc4f-c37e-456c-91d7-9bea06ecbc30 could not be found. Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8207fc4f-c37e-456c-91d7-9bea06ecbc30 could not be found. Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:07:19.923097 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:07:19.928027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:07:19.928027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:07:19.928027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:07:19.928027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:07:19.928027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:07:19.928027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8207fc4f-c37e-456c-91d7-9bea06ecbc30 could not be found. Jun 10 18:07:19.928027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:07:19.928027 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f76203b3-8bfa-4905-8224-af09ab2620d8 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Returning 404 to user: Instance 8207fc4f-c37e-456c-91d7-9bea06ecbc30 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:07:19.928027 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f76203b3-8bfa-4905-8224-af09ab2620d8 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30" status: 404 len: 111 microversion: 2.47 time: 0.106645 Jun 10 18:07:19.934245 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1493/3056] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:07:19 2022] GET /compute/v2.1/servers/8207fc4f-c37e-456c-91d7-9bea06ecbc30 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:07:19.936444 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6fa72ab9-6540-4be8-addd-701b17c3fdbe tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:19.937066 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6fa72ab9-6540-4be8-addd-701b17c3fdbe tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:19.945250 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6fa72ab9-6540-4be8-addd-701b17c3fdbe tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:19.945718 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6fa72ab9-6540-4be8-addd-701b17c3fdbe tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:19.946512 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6fa72ab9-6540-4be8-addd-701b17c3fdbe tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:19.946964 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6fa72ab9-6540-4be8-addd-701b17c3fdbe tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:20.012679 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-caad6f63-bb37-44ba-ad14-a2f44fbaf181 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.718073 Jun 10 18:07:20.018968 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1564/3057] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:07:18 2022] POST /compute/v2.1/servers => generated 407 bytes in 1725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:07:20.024705 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-86eeedb8-4b0f-4fc2-9ace-cf347236ffa1 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:20.025280 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-86eeedb8-4b0f-4fc2-9ace-cf347236ffa1 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 44dd88e0-99b5-4d16-8dc7-ae488ab4f44c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:20.032060 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-86eeedb8-4b0f-4fc2-9ace-cf347236ffa1 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:20.032558 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-86eeedb8-4b0f-4fc2-9ace-cf347236ffa1 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:20.033348 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-86eeedb8-4b0f-4fc2-9ace-cf347236ffa1 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:20.035128 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-86eeedb8-4b0f-4fc2-9ace-cf347236ffa1 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:20.065844 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-86eeedb8-4b0f-4fc2-9ace-cf347236ffa1 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 44dd88e0-99b5-4d16-8dc7-ae488ab4f44c] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:07:20.091912 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6fa72ab9-6540-4be8-addd-701b17c3fdbe tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:20.102374 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6fa72ab9-6540-4be8-addd-701b17c3fdbe tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1274 microversion: 2.1 time: 0.170501 Jun 10 18:07:20.118651 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1494/3058] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:19 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1274 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:20.144244 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9898fe4b-9c48-48b0-9af7-12c4cde9ade7 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:20.144953 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9898fe4b-9c48-48b0-9af7-12c4cde9ade7 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] [instance: 4f169350-57ce-4ea3-bfca-ccf6f1957aa9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:20.246962 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9898fe4b-9c48-48b0-9af7-12c4cde9ade7 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f463dd5d9140ecb29e0daa415331a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c384e1bab854ad8b4c2ae9ab895cd88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:20.254410 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9898fe4b-9c48-48b0-9af7-12c4cde9ade7 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] 10.222.0.35 "GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9" status: 200 len: 1122 microversion: 2.1 time: 0.123477 Jun 10 18:07:20.255019 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1495/3059] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:20 2022] GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9 => generated 1122 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:20.342261 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-56c3570a-a78d-4eb5-baf0-1e32aff30c75 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:20.343835 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-56c3570a-a78d-4eb5-baf0-1e32aff30c75 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:20.351127 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-56c3570a-a78d-4eb5-baf0-1e32aff30c75 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:20.351759 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-56c3570a-a78d-4eb5-baf0-1e32aff30c75 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:20.352597 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-56c3570a-a78d-4eb5-baf0-1e32aff30c75 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:20.353053 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-56c3570a-a78d-4eb5-baf0-1e32aff30c75 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:20.394037 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-86eeedb8-4b0f-4fc2-9ace-cf347236ffa1 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "DELETE /compute/v2.1/servers/44dd88e0-99b5-4d16-8dc7-ae488ab4f44c" status: 204 len: 0 microversion: 2.47 time: 0.372351 Jun 10 18:07:20.394640 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1565/3060] 10.222.0.35 () {60 vars in 1279 bytes} [Fri Jun 10 18:07:20 2022] DELETE /compute/v2.1/servers/44dd88e0-99b5-4d16-8dc7-ae488ab4f44c => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 10 18:07:20.407493 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b9ebece1-94c8-4408-af27-852284adad7b tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:20.408478 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b9ebece1-94c8-4408-af27-852284adad7b tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 44dd88e0-99b5-4d16-8dc7-ae488ab4f44c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:20.427664 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9ebece1-94c8-4408-af27-852284adad7b tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:20.428155 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9ebece1-94c8-4408-af27-852284adad7b tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:20.429846 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9ebece1-94c8-4408-af27-852284adad7b tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:20.429846 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9ebece1-94c8-4408-af27-852284adad7b tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:20.654401 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-56c3570a-a78d-4eb5-baf0-1e32aff30c75 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:20.664958 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-56c3570a-a78d-4eb5-baf0-1e32aff30c75 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b" status: 200 len: 1498 microversion: 2.1 time: 0.326777 Jun 10 18:07:20.675762 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1496/3061] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:20 2022] GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b => generated 1498 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:07:20.711486 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b9ebece1-94c8-4408-af27-852284adad7b tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:20.722900 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b9ebece1-94c8-4408-af27-852284adad7b tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:20.724692 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b9ebece1-94c8-4408-af27-852284adad7b tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:20.727149 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b9ebece1-94c8-4408-af27-852284adad7b tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/44dd88e0-99b5-4d16-8dc7-ae488ab4f44c" status: 200 len: 1361 microversion: 2.47 time: 0.323900 Jun 10 18:07:20.729289 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1566/3062] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:07:20 2022] GET /compute/v2.1/servers/44dd88e0-99b5-4d16-8dc7-ae488ab4f44c => generated 1361 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:07:20.827028 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2fa43f3a-c50b-46be-9f4a-7d48260afe3c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:20.830226 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2fa43f3a-c50b-46be-9f4a-7d48260afe3c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 03dcc828-a971-496c-aa8c-28681ec6fc01] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:20.841756 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2fa43f3a-c50b-46be-9f4a-7d48260afe3c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:20.842309 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2fa43f3a-c50b-46be-9f4a-7d48260afe3c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:20.843102 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2fa43f3a-c50b-46be-9f4a-7d48260afe3c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:20.843569 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2fa43f3a-c50b-46be-9f4a-7d48260afe3c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:21.026769 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2fa43f3a-c50b-46be-9f4a-7d48260afe3c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:21.043320 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2fa43f3a-c50b-46be-9f4a-7d48260afe3c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01" status: 200 len: 1316 microversion: 2.1 time: 0.221771 Jun 10 18:07:21.048477 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1497/3063] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:20 2022] GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01 => generated 1316 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:07:21.140996 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3a3447df-7239-465b-84b8-fc0c50edb2b7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:21.141930 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3a3447df-7239-465b-84b8-fc0c50edb2b7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:21.158000 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3a3447df-7239-465b-84b8-fc0c50edb2b7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:21.158471 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3a3447df-7239-465b-84b8-fc0c50edb2b7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:21.166464 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3a3447df-7239-465b-84b8-fc0c50edb2b7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:21.167182 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3a3447df-7239-465b-84b8-fc0c50edb2b7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:21.272269 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-71a8dcb0-ea26-450c-aac8-7444c92e7a94 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:21.273755 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-71a8dcb0-ea26-450c-aac8-7444c92e7a94 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] [instance: 4f169350-57ce-4ea3-bfca-ccf6f1957aa9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:21.337613 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-71a8dcb0-ea26-450c-aac8-7444c92e7a94 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f463dd5d9140ecb29e0daa415331a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c384e1bab854ad8b4c2ae9ab895cd88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:21.363646 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-71a8dcb0-ea26-450c-aac8-7444c92e7a94 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] 10.222.0.35 "GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9" status: 200 len: 1122 microversion: 2.1 time: 0.092936 Jun 10 18:07:21.364350 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1498/3064] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:21 2022] GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9 => generated 1122 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:21.372568 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5305066f-9e67-40c2-bdf5-134cd1a5f05d tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:21.377722 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5305066f-9e67-40c2-bdf5-134cd1a5f05d tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e633cf9c8e3b41f5a538f5937acf00d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142022afade745b9984068f42f0074dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:21.379339 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5305066f-9e67-40c2-bdf5-134cd1a5f05d tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Searching by: {'deleted': False, 'project_id': '142022afade745b9984068f42f0074dc'} {{(pid=126595) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 18:07:21.396027 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5305066f-9e67-40c2-bdf5-134cd1a5f05d tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:21.396720 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5305066f-9e67-40c2-bdf5-134cd1a5f05d tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:21.398573 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5305066f-9e67-40c2-bdf5-134cd1a5f05d tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:21.399368 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5305066f-9e67-40c2-bdf5-134cd1a5f05d tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:21.429711 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.multi_cell_list [None req-5305066f-9e67-40c2-bdf5-134cd1a5f05d tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126595) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 10 18:07:21.461240 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5305066f-9e67-40c2-bdf5-134cd1a5f05d tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] 10.222.0.35 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.093675 Jun 10 18:07:21.462538 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1499/3065] 10.222.0.35 () {58 vars in 1124 bytes} [Fri Jun 10 18:07:21 2022] GET /compute/v2.1/servers => generated 334 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:07:21.475564 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2992cb5c-5ca1-45aa-92a0-febc6e1c00df tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:21.491472 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2992cb5c-5ca1-45aa-92a0-febc6e1c00df tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e633cf9c8e3b41f5a538f5937acf00d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142022afade745b9984068f42f0074dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:21.492230 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2992cb5c-5ca1-45aa-92a0-febc6e1c00df tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Searching by: {'deleted': False, 'project_id': '142022afade745b9984068f42f0074dc'} {{(pid=126595) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 18:07:21.497959 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2992cb5c-5ca1-45aa-92a0-febc6e1c00df tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:21.498764 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2992cb5c-5ca1-45aa-92a0-febc6e1c00df tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:21.499543 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2992cb5c-5ca1-45aa-92a0-febc6e1c00df tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:21.499979 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2992cb5c-5ca1-45aa-92a0-febc6e1c00df tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:21.534926 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.multi_cell_list [None req-2992cb5c-5ca1-45aa-92a0-febc6e1c00df tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126595) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 10 18:07:21.569900 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3a3447df-7239-465b-84b8-fc0c50edb2b7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:21.574560 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2992cb5c-5ca1-45aa-92a0-febc6e1c00df tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e633cf9c8e3b41f5a538f5937acf00d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142022afade745b9984068f42f0074dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:21.582913 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3a3447df-7239-465b-84b8-fc0c50edb2b7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1314 microversion: 2.1 time: 0.450171 Jun 10 18:07:21.584962 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1567/3066] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:21 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:21.585320 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2992cb5c-5ca1-45aa-92a0-febc6e1c00df tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:21.585983 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2992cb5c-5ca1-45aa-92a0-febc6e1c00df tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:21.683124 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-132fb808-2e1a-4e21-99f8-64e8b46d849f tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:21.683861 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-132fb808-2e1a-4e21-99f8-64e8b46d849f tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:21.690549 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-132fb808-2e1a-4e21-99f8-64e8b46d849f tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:21.691295 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-132fb808-2e1a-4e21-99f8-64e8b46d849f tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:21.694299 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-132fb808-2e1a-4e21-99f8-64e8b46d849f tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:21.694299 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-132fb808-2e1a-4e21-99f8-64e8b46d849f tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:21.719203 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2992cb5c-5ca1-45aa-92a0-febc6e1c00df tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] 10.222.0.35 "GET /compute/v2.1/servers/detail" status: 200 len: 1699 microversion: 2.1 time: 0.248059 Jun 10 18:07:21.731874 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1500/3067] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 18:07:21 2022] GET /compute/v2.1/servers/detail => generated 1699 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:07:21.746925 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bcd49f6a-ddf4-44ac-888f-8e2b030efa03 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:21.756606 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bcd49f6a-ddf4-44ac-888f-8e2b030efa03 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] 10.222.0.35 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013621 Jun 10 18:07:21.757517 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1501/3068] 10.222.0.35 () {58 vars in 1136 bytes} [Fri Jun 10 18:07:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:07:21.763146 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7b2d84b7-b19b-4f83-b029-26021a83337a tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:21.764079 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7b2d84b7-b19b-4f83-b029-26021a83337a tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 44dd88e0-99b5-4d16-8dc7-ae488ab4f44c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:21.774200 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b2d84b7-b19b-4f83-b029-26021a83337a tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:21.774821 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b2d84b7-b19b-4f83-b029-26021a83337a tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:21.776736 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b2d84b7-b19b-4f83-b029-26021a83337a tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:21.777363 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b2d84b7-b19b-4f83-b029-26021a83337a tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:21.851690 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7b2d84b7-b19b-4f83-b029-26021a83337a tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:21.860507 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7b2d84b7-b19b-4f83-b029-26021a83337a tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:21.862236 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7b2d84b7-b19b-4f83-b029-26021a83337a tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:21.863428 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7b2d84b7-b19b-4f83-b029-26021a83337a tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/44dd88e0-99b5-4d16-8dc7-ae488ab4f44c" status: 200 len: 1361 microversion: 2.47 time: 0.104630 Jun 10 18:07:21.864170 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1502/3069] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:07:21 2022] GET /compute/v2.1/servers/44dd88e0-99b5-4d16-8dc7-ae488ab4f44c => generated 1361 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:07:21.970513 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-132fb808-2e1a-4e21-99f8-64e8b46d849f tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:21.981051 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-132fb808-2e1a-4e21-99f8-64e8b46d849f tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b" status: 200 len: 1498 microversion: 2.1 time: 0.301982 Jun 10 18:07:22.002034 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1568/3070] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:21 2022] GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b => generated 1498 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:07:22.085487 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4d3a6a79-4687-460f-861c-63faf88eeef8 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:22.085487 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4d3a6a79-4687-460f-861c-63faf88eeef8 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 03dcc828-a971-496c-aa8c-28681ec6fc01] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:22.085487 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d3a6a79-4687-460f-861c-63faf88eeef8 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:22.085487 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d3a6a79-4687-460f-861c-63faf88eeef8 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:22.085487 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d3a6a79-4687-460f-861c-63faf88eeef8 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:22.089537 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d3a6a79-4687-460f-861c-63faf88eeef8 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:22.258000 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4d3a6a79-4687-460f-861c-63faf88eeef8 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:22.266621 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4d3a6a79-4687-460f-861c-63faf88eeef8 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01" status: 200 len: 1316 microversion: 2.1 time: 0.205597 Jun 10 18:07:22.275830 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1503/3071] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:22 2022] GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01 => generated 1316 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:22.383279 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c8a7bb8a-8b10-4c56-b778-dfb048368b1b tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:22.384176 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c8a7bb8a-8b10-4c56-b778-dfb048368b1b tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] [instance: 4f169350-57ce-4ea3-bfca-ccf6f1957aa9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:22.395809 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c8a7bb8a-8b10-4c56-b778-dfb048368b1b tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:22.397871 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c8a7bb8a-8b10-4c56-b778-dfb048368b1b tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:22.398907 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c8a7bb8a-8b10-4c56-b778-dfb048368b1b tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:22.404085 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c8a7bb8a-8b10-4c56-b778-dfb048368b1b tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:22.433726 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b391df83-a8ba-4e46-87c0-f97c6f84f7a0 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:22.434268 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b391df83-a8ba-4e46-87c0-f97c6f84f7a0 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] [instance: b8136d11-a591-48c2-ab1a-c17422d326e6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:22.444547 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b391df83-a8ba-4e46-87c0-f97c6f84f7a0 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:22.445008 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b391df83-a8ba-4e46-87c0-f97c6f84f7a0 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:22.445807 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b391df83-a8ba-4e46-87c0-f97c6f84f7a0 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:22.446252 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b391df83-a8ba-4e46-87c0-f97c6f84f7a0 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:22.526296 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b391df83-a8ba-4e46-87c0-f97c6f84f7a0 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] [instance: b8136d11-a591-48c2-ab1a-c17422d326e6] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:07:22.576103 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c8a7bb8a-8b10-4c56-b778-dfb048368b1b tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f463dd5d9140ecb29e0daa415331a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c384e1bab854ad8b4c2ae9ab895cd88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:22.591124 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c8a7bb8a-8b10-4c56-b778-dfb048368b1b tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] 10.222.0.35 "GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9" status: 200 len: 1172 microversion: 2.1 time: 0.214987 Jun 10 18:07:22.591960 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1569/3072] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:22 2022] GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9 => generated 1172 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:22.606077 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-96239eca-1a20-4874-96d1-3afa17b880ff tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:22.606747 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-96239eca-1a20-4874-96d1-3afa17b880ff tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:22.616609 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-96239eca-1a20-4874-96d1-3afa17b880ff tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:22.617055 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-96239eca-1a20-4874-96d1-3afa17b880ff tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:22.617871 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-96239eca-1a20-4874-96d1-3afa17b880ff tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:22.618312 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-96239eca-1a20-4874-96d1-3afa17b880ff tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:22.947012 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b391df83-a8ba-4e46-87c0-f97c6f84f7a0 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] 10.222.0.35 "DELETE /compute/v2.1/servers/b8136d11-a591-48c2-ab1a-c17422d326e6" status: 204 len: 0 microversion: 2.1 time: 0.516873 Jun 10 18:07:22.951452 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1504/3073] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:07:22 2022] DELETE /compute/v2.1/servers/b8136d11-a591-48c2-ab1a-c17422d326e6 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 18:07:22.958188 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d2c23e5b-b4a1-4956-8a17-1b84f60389b5 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:22.960224 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d2c23e5b-b4a1-4956-8a17-1b84f60389b5 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 44dd88e0-99b5-4d16-8dc7-ae488ab4f44c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:22.976466 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d2c23e5b-b4a1-4956-8a17-1b84f60389b5 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:22.978502 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d2c23e5b-b4a1-4956-8a17-1b84f60389b5 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:22.980224 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d2c23e5b-b4a1-4956-8a17-1b84f60389b5 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:22.983966 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d2c23e5b-b4a1-4956-8a17-1b84f60389b5 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:22.998200 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:07:23.028830 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-96239eca-1a20-4874-96d1-3afa17b880ff tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:23.040557 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-96239eca-1a20-4874-96d1-3afa17b880ff tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1314 microversion: 2.1 time: 0.443817 Jun 10 18:07:23.041180 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1570/3074] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:22 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:07:23.045784 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-600b098f-1452-4986-a06e-0042cc6a8fe5 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:23.046462 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-600b098f-1452-4986-a06e-0042cc6a8fe5 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] [instance: b8136d11-a591-48c2-ab1a-c17422d326e6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:23.057479 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-600b098f-1452-4986-a06e-0042cc6a8fe5 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:23.058086 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-600b098f-1452-4986-a06e-0042cc6a8fe5 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:23.059338 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-600b098f-1452-4986-a06e-0042cc6a8fe5 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:23.059993 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-600b098f-1452-4986-a06e-0042cc6a8fe5 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:23.104584 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d2c23e5b-b4a1-4956-8a17-1b84f60389b5 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:23.114368 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d2c23e5b-b4a1-4956-8a17-1b84f60389b5 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:23.117237 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d2c23e5b-b4a1-4956-8a17-1b84f60389b5 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:23.122835 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d2c23e5b-b4a1-4956-8a17-1b84f60389b5 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/44dd88e0-99b5-4d16-8dc7-ae488ab4f44c" status: 200 len: 1361 microversion: 2.47 time: 0.165669 Jun 10 18:07:23.122835 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1505/3075] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:07:22 2022] GET /compute/v2.1/servers/44dd88e0-99b5-4d16-8dc7-ae488ab4f44c => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:07:23.124819 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a778c3a9-ced4-4ba6-ae45-8e190c5d144b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:23.125725 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a778c3a9-ced4-4ba6-ae45-8e190c5d144b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:23.141841 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a778c3a9-ced4-4ba6-ae45-8e190c5d144b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:23.142442 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a778c3a9-ced4-4ba6-ae45-8e190c5d144b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:23.144440 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a778c3a9-ced4-4ba6-ae45-8e190c5d144b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:23.145158 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a778c3a9-ced4-4ba6-ae45-8e190c5d144b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:23.353628 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-600b098f-1452-4986-a06e-0042cc6a8fe5 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e633cf9c8e3b41f5a538f5937acf00d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142022afade745b9984068f42f0074dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:23.363781 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-600b098f-1452-4986-a06e-0042cc6a8fe5 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] 10.222.0.35 "GET /compute/v2.1/servers/b8136d11-a591-48c2-ab1a-c17422d326e6" status: 200 len: 1702 microversion: 2.1 time: 0.321476 Jun 10 18:07:23.364405 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1571/3076] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:23 2022] GET /compute/v2.1/servers/b8136d11-a591-48c2-ab1a-c17422d326e6 => generated 1702 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:23.370032 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6fc853a6-70cc-4cf1-812a-321b87b4b2fd tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:23.376763 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6fc853a6-70cc-4cf1-812a-321b87b4b2fd tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 03dcc828-a971-496c-aa8c-28681ec6fc01] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:23.383579 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6fc853a6-70cc-4cf1-812a-321b87b4b2fd tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:23.384040 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6fc853a6-70cc-4cf1-812a-321b87b4b2fd tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:23.384869 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6fc853a6-70cc-4cf1-812a-321b87b4b2fd tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:23.385321 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6fc853a6-70cc-4cf1-812a-321b87b4b2fd tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:23.758799 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6fc853a6-70cc-4cf1-812a-321b87b4b2fd tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:23.765226 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6fc853a6-70cc-4cf1-812a-321b87b4b2fd tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01" status: 200 len: 1316 microversion: 2.1 time: 0.399100 Jun 10 18:07:23.766027 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1572/3077] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:23 2022] GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01 => generated 1316 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:23.771358 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8a5119ea-2c0c-4077-ae00-2c6b491209c9 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:23.774077 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8a5119ea-2c0c-4077-ae00-2c6b491209c9 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] [instance: 4f169350-57ce-4ea3-bfca-ccf6f1957aa9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:23.782670 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8a5119ea-2c0c-4077-ae00-2c6b491209c9 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:23.783378 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8a5119ea-2c0c-4077-ae00-2c6b491209c9 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:23.785794 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8a5119ea-2c0c-4077-ae00-2c6b491209c9 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:23.786402 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8a5119ea-2c0c-4077-ae00-2c6b491209c9 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:23.795233 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:07:23.863435 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a778c3a9-ced4-4ba6-ae45-8e190c5d144b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:23.876978 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a778c3a9-ced4-4ba6-ae45-8e190c5d144b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b" status: 200 len: 1498 microversion: 2.1 time: 0.756135 Jun 10 18:07:23.878121 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1506/3078] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:23 2022] GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b => generated 1498 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:23.880025 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8a5119ea-2c0c-4077-ae00-2c6b491209c9 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f463dd5d9140ecb29e0daa415331a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c384e1bab854ad8b4c2ae9ab895cd88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:23.897358 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8a5119ea-2c0c-4077-ae00-2c6b491209c9 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] 10.222.0.35 "GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9" status: 200 len: 1164 microversion: 2.1 time: 0.129840 Jun 10 18:07:23.898992 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1573/3079] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:23 2022] GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9 => generated 1164 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:24.059162 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9f46daaa-8bd9-46bf-abbe-f804eca919b7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:24.059320 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9f46daaa-8bd9-46bf-abbe-f804eca919b7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:24.070960 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f46daaa-8bd9-46bf-abbe-f804eca919b7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:24.072902 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f46daaa-8bd9-46bf-abbe-f804eca919b7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:24.076972 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f46daaa-8bd9-46bf-abbe-f804eca919b7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:24.079236 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f46daaa-8bd9-46bf-abbe-f804eca919b7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:24.139342 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-85d6bb62-184f-4503-b6da-83baa0f4dac2 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:24.144084 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-85d6bb62-184f-4503-b6da-83baa0f4dac2 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 44dd88e0-99b5-4d16-8dc7-ae488ab4f44c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:24.155560 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-85d6bb62-184f-4503-b6da-83baa0f4dac2 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:24.157125 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-85d6bb62-184f-4503-b6da-83baa0f4dac2 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:24.162302 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-85d6bb62-184f-4503-b6da-83baa0f4dac2 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:24.163633 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-85d6bb62-184f-4503-b6da-83baa0f4dac2 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:24.234240 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-85d6bb62-184f-4503-b6da-83baa0f4dac2 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:24.235394 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-85d6bb62-184f-4503-b6da-83baa0f4dac2 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:24.235861 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-85d6bb62-184f-4503-b6da-83baa0f4dac2 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lazy-loading 'fault' on Instance uuid 44dd88e0-99b5-4d16-8dc7-ae488ab4f44c {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:07:24.309391 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-85d6bb62-184f-4503-b6da-83baa0f4dac2 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:24.335276 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-85d6bb62-184f-4503-b6da-83baa0f4dac2 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:24.340091 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-85d6bb62-184f-4503-b6da-83baa0f4dac2 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f619bd3c4e5245de9013a516a347a1ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06e5e6218a4b5a9ac106fd7a81067a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:24.342502 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-85d6bb62-184f-4503-b6da-83baa0f4dac2 tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/44dd88e0-99b5-4d16-8dc7-ae488ab4f44c" status: 200 len: 1366 microversion: 2.47 time: 0.208713 Jun 10 18:07:24.343078 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1574/3080] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:07:24 2022] GET /compute/v2.1/servers/44dd88e0-99b5-4d16-8dc7-ae488ab4f44c => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:07:24.383383 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e2210cfb-7e35-48d3-b997-786fc00816ce tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:24.384988 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e2210cfb-7e35-48d3-b997-786fc00816ce tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] [instance: b8136d11-a591-48c2-ab1a-c17422d326e6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:24.411923 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e2210cfb-7e35-48d3-b997-786fc00816ce tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:24.412415 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e2210cfb-7e35-48d3-b997-786fc00816ce tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:24.420628 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e2210cfb-7e35-48d3-b997-786fc00816ce tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:24.421251 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e2210cfb-7e35-48d3-b997-786fc00816ce tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:24.589374 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9f46daaa-8bd9-46bf-abbe-f804eca919b7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:24.622205 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9f46daaa-8bd9-46bf-abbe-f804eca919b7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1314 microversion: 2.1 time: 0.568456 Jun 10 18:07:24.627820 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1507/3081] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:24 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1314 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:24.783095 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5fc4b80b-0a42-40da-b85c-641f40fca359 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:24.784224 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5fc4b80b-0a42-40da-b85c-641f40fca359 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 03dcc828-a971-496c-aa8c-28681ec6fc01] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:24.795166 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5fc4b80b-0a42-40da-b85c-641f40fca359 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:24.795639 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5fc4b80b-0a42-40da-b85c-641f40fca359 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:24.813184 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5fc4b80b-0a42-40da-b85c-641f40fca359 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:24.825478 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5fc4b80b-0a42-40da-b85c-641f40fca359 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:25.681853 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e2210cfb-7e35-48d3-b997-786fc00816ce tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e633cf9c8e3b41f5a538f5937acf00d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142022afade745b9984068f42f0074dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:25.697151 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e2210cfb-7e35-48d3-b997-786fc00816ce tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] 10.222.0.35 "GET /compute/v2.1/servers/b8136d11-a591-48c2-ab1a-c17422d326e6" status: 200 len: 1702 microversion: 2.1 time: 1.318375 Jun 10 18:07:25.718910 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1575/3082] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:24 2022] GET /compute/v2.1/servers/b8136d11-a591-48c2-ab1a-c17422d326e6 => generated 1702 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:25.724642 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d0ee6d55-0525-4557-b063-c0e88459effe tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:25.725414 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d0ee6d55-0525-4557-b063-c0e88459effe tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:25.739993 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d0ee6d55-0525-4557-b063-c0e88459effe tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:25.740640 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d0ee6d55-0525-4557-b063-c0e88459effe tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:25.741537 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d0ee6d55-0525-4557-b063-c0e88459effe tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:25.748858 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5fc4b80b-0a42-40da-b85c-641f40fca359 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:25.750088 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d0ee6d55-0525-4557-b063-c0e88459effe tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:25.764196 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5fc4b80b-0a42-40da-b85c-641f40fca359 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01" status: 200 len: 1316 microversion: 2.1 time: 0.985313 Jun 10 18:07:25.764827 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1508/3083] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:24 2022] GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01 => generated 1316 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:07:25.779254 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-49073504-12a9-47e5-8c99-6accd3433d6e tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:25.811038 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-49073504-12a9-47e5-8c99-6accd3433d6e tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] [instance: 4f169350-57ce-4ea3-bfca-ccf6f1957aa9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:25.842291 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-49073504-12a9-47e5-8c99-6accd3433d6e tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:25.842904 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-49073504-12a9-47e5-8c99-6accd3433d6e tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:25.853073 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-49073504-12a9-47e5-8c99-6accd3433d6e tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:25.854082 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-49073504-12a9-47e5-8c99-6accd3433d6e tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:26.038652 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-49073504-12a9-47e5-8c99-6accd3433d6e tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f463dd5d9140ecb29e0daa415331a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c384e1bab854ad8b4c2ae9ab895cd88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:26.052985 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-49073504-12a9-47e5-8c99-6accd3433d6e tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] 10.222.0.35 "GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9" status: 200 len: 1220 microversion: 2.1 time: 0.275547 Jun 10 18:07:26.054498 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1509/3084] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:25 2022] GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9 => generated 1220 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:26.067346 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b034be67-3619-4935-a534-23cac7c99ff1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1417029675", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "08beea26-4ff5-4952-8be8-f5185d968682"}, {"uuid": "ae598ded-53f3-428d-9903-8d311f8e8d1e"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:07:26.204766 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-b034be67-3619-4935-a534-23cac7c99ff1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] validate_networks() for [('08beea26-4ff5-4952-8be8-f5185d968682', None, None, None, None, None), ('ae598ded-53f3-428d-9903-8d311f8e8d1e', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:07:26.334521 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d0ee6d55-0525-4557-b063-c0e88459effe tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:26.345823 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d0ee6d55-0525-4557-b063-c0e88459effe tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b" status: 200 len: 1498 microversion: 2.1 time: 0.625546 Jun 10 18:07:26.347489 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1576/3085] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:25 2022] GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b => generated 1498 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:26.375645 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1400d5e0-9881-4b9c-8aa5-0fd4ca9aeb5c tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:26.377013 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1400d5e0-9881-4b9c-8aa5-0fd4ca9aeb5c tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] [instance: 44dd88e0-99b5-4d16-8dc7-ae488ab4f44c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:26.400791 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1400d5e0-9881-4b9c-8aa5-0fd4ca9aeb5c tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:26.401753 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1400d5e0-9881-4b9c-8aa5-0fd4ca9aeb5c tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:26.405650 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1400d5e0-9881-4b9c-8aa5-0fd4ca9aeb5c tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:26.406315 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1400d5e0-9881-4b9c-8aa5-0fd4ca9aeb5c tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:26.454177 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-1400d5e0-9881-4b9c-8aa5-0fd4ca9aeb5c tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] HTTP exception thrown: Instance 44dd88e0-99b5-4d16-8dc7-ae488ab4f44c could not be found. Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1400d5e0-9881-4b9c-8aa5-0fd4ca9aeb5c tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Request method failure captured: Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/44dd88e0-99b5-4d16-8dc7-ae488ab4f44c HTTP/1.1 Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4gjAXA1tYVBpzYg53ZED_NoURDWQurr4smylkgdPqFzt1vI9heqEq7BcGgzhZe8ABqBnaJm7m3N3jepWdvr_nRJ3rMmM5kwUyNswKJ68t4P6-tdxH384AOwrvpTuv5aulYl069hznGACnORiHkzFdr-cTtk9VqDgpeXi6QzGD77z1Y Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: X-Openstack-Nova-Api-Version: 2.47 Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 6a06e5e6218a4b5a9ac106fd7a81067a Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServerShowV247Test-1928876094 Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/6a06e5e6218a4b5a9ac106fd7a81067a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/6a06e5e6218a4b5a9ac106fd7a81067a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/6a06e5e6218a4b5a9ac106fd7a81067a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_6a06e5e6218a4b5a9ac106fd7a81067a", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServerShowV247Test-1928876094 Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 6a06e5e6218a4b5a9ac106fd7a81067a Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServerShowV247Test-1928876094 Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServerShowV247Test-1928876094-project Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: f619bd3c4e5245de9013a516a347a1ee Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServerShowV247Test-1928876094-project Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 44dd88e0-99b5-4d16-8dc7-ae488ab4f44c could not be found. Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '44dd88e0-99b5-4d16-8dc7-ae488ab4f44c'} Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44dd88e0-99b5-4d16-8dc7-ae488ab4f44c could not be found. Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44dd88e0-99b5-4d16-8dc7-ae488ab4f44c could not be found. Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:07:26.456432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:07:26.460292 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:07:26.460292 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:07:26.460292 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:07:26.460292 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:07:26.460292 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:07:26.460292 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44dd88e0-99b5-4d16-8dc7-ae488ab4f44c could not be found. Jun 10 18:07:26.460292 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:07:26.462862 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1400d5e0-9881-4b9c-8aa5-0fd4ca9aeb5c tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] Returning 404 to user: Instance 44dd88e0-99b5-4d16-8dc7-ae488ab4f44c could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:07:26.463986 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1400d5e0-9881-4b9c-8aa5-0fd4ca9aeb5c tempest-ServerShowV247Test-1928876094 tempest-ServerShowV247Test-1928876094-project] 10.222.0.35 "GET /compute/v2.1/servers/44dd88e0-99b5-4d16-8dc7-ae488ab4f44c" status: 404 len: 111 microversion: 2.47 time: 0.115174 Jun 10 18:07:26.464821 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1577/3086] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:07:26 2022] GET /compute/v2.1/servers/44dd88e0-99b5-4d16-8dc7-ae488ab4f44c => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:07:26.473883 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-95af1e2a-503c-4abf-a501-b616538a47d4 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:26.477072 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-95af1e2a-503c-4abf-a501-b616538a47d4 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:26.485088 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:07:26.502031 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-95af1e2a-503c-4abf-a501-b616538a47d4 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:26.505638 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-95af1e2a-503c-4abf-a501-b616538a47d4 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:26.510442 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-95af1e2a-503c-4abf-a501-b616538a47d4 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:26.510442 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-95af1e2a-503c-4abf-a501-b616538a47d4 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:27.006860 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-95af1e2a-503c-4abf-a501-b616538a47d4 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:27.022316 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-95af1e2a-503c-4abf-a501-b616538a47d4 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1314 microversion: 2.1 time: 0.556178 Jun 10 18:07:27.023071 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1578/3087] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:26 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1314 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:27.036856 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-36604dc2-e1e0-494e-8705-1e95078918cf req-3dc834b7-e598-405b-a471-dad580dab74a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da4ca117-eaa1-4a19-83ca-3da2766c5f15", "tag": "a82f9160-ebd4-4524-8522-95af49c18023"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:07:27.073129 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-36604dc2-e1e0-494e-8705-1e95078918cf req-3dc834b7-e598-405b-a471-dad580dab74a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:27.075835 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-36604dc2-e1e0-494e-8705-1e95078918cf req-3dc834b7-e598-405b-a471-dad580dab74a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:27.117567 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-36604dc2-e1e0-494e-8705-1e95078918cf req-3dc834b7-e598-405b-a471-dad580dab74a service nova] Creating event network-changed:a82f9160-ebd4-4524-8522-95af49c18023 for instance da4ca117-eaa1-4a19-83ca-3da2766c5f15 on chh2-master-2 Jun 10 18:07:27.131818 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-36604dc2-e1e0-494e-8705-1e95078918cf req-3dc834b7-e598-405b-a471-dad580dab74a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107276 Jun 10 18:07:27.137903 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1579/3088] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:07:27.144517 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1006a47a-1b89-45a5-967a-3cfd58b54dda tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:27.145746 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1006a47a-1b89-45a5-967a-3cfd58b54dda tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] [instance: b8136d11-a591-48c2-ab1a-c17422d326e6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:27.152462 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1006a47a-1b89-45a5-967a-3cfd58b54dda tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:27.153222 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1006a47a-1b89-45a5-967a-3cfd58b54dda tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:27.155583 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1006a47a-1b89-45a5-967a-3cfd58b54dda tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:27.156773 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1006a47a-1b89-45a5-967a-3cfd58b54dda tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:27.798622 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1006a47a-1b89-45a5-967a-3cfd58b54dda tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e633cf9c8e3b41f5a538f5937acf00d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142022afade745b9984068f42f0074dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:27.815831 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1006a47a-1b89-45a5-967a-3cfd58b54dda tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] 10.222.0.35 "GET /compute/v2.1/servers/b8136d11-a591-48c2-ab1a-c17422d326e6" status: 200 len: 1702 microversion: 2.1 time: 0.670364 Jun 10 18:07:27.821209 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1580/3089] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:27 2022] GET /compute/v2.1/servers/b8136d11-a591-48c2-ab1a-c17422d326e6 => generated 1702 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:27.858929 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2632cf8f-293d-4e79-8c94-bdba16557998 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:27.865295 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2632cf8f-293d-4e79-8c94-bdba16557998 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 03dcc828-a971-496c-aa8c-28681ec6fc01] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:27.911438 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2632cf8f-293d-4e79-8c94-bdba16557998 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:27.913003 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2632cf8f-293d-4e79-8c94-bdba16557998 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:27.916899 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2632cf8f-293d-4e79-8c94-bdba16557998 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:27.944061 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2632cf8f-293d-4e79-8c94-bdba16557998 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:29.260968 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2632cf8f-293d-4e79-8c94-bdba16557998 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:29.278011 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2632cf8f-293d-4e79-8c94-bdba16557998 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01" status: 200 len: 1316 microversion: 2.1 time: 1.445019 Jun 10 18:07:29.279795 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1581/3090] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:27 2022] GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01 => generated 1316 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:29.291674 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-210a8c51-47c7-4431-9bdf-fb2392336d00 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:29.294904 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-210a8c51-47c7-4431-9bdf-fb2392336d00 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] [instance: 4f169350-57ce-4ea3-bfca-ccf6f1957aa9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:29.311113 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-210a8c51-47c7-4431-9bdf-fb2392336d00 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:29.312847 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-210a8c51-47c7-4431-9bdf-fb2392336d00 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:29.315852 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-210a8c51-47c7-4431-9bdf-fb2392336d00 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:29.317413 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-210a8c51-47c7-4431-9bdf-fb2392336d00 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:29.318894 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=6 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:07:29.359778 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=22 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:07:29.601560 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-210a8c51-47c7-4431-9bdf-fb2392336d00 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f463dd5d9140ecb29e0daa415331a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c384e1bab854ad8b4c2ae9ab895cd88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:29.616952 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-210a8c51-47c7-4431-9bdf-fb2392336d00 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] 10.222.0.35 "GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9" status: 200 len: 1238 microversion: 2.1 time: 0.330393 Jun 10 18:07:29.632543 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1582/3091] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:29 2022] GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9 => generated 1238 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:29.640376 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fc363b6f-50f1-46c8-b885-b411b66c1df2 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:29.658238 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fc363b6f-50f1-46c8-b885-b411b66c1df2 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:29.688646 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fc363b6f-50f1-46c8-b885-b411b66c1df2 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:29.690517 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fc363b6f-50f1-46c8-b885-b411b66c1df2 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:29.693826 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fc363b6f-50f1-46c8-b885-b411b66c1df2 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:29.696477 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fc363b6f-50f1-46c8-b885-b411b66c1df2 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:30.053620 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fc363b6f-50f1-46c8-b885-b411b66c1df2 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:30.095662 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fc363b6f-50f1-46c8-b885-b411b66c1df2 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b" status: 200 len: 1475 microversion: 2.1 time: 0.461811 Jun 10 18:07:30.121138 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1583/3092] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:29 2022] GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b => generated 1475 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:30.143535 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3fd5111c-7747-4025-b7d5-ca33782fc4e1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:30.143535 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3fd5111c-7747-4025-b7d5-ca33782fc4e1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:30.157941 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3fd5111c-7747-4025-b7d5-ca33782fc4e1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:30.160683 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3fd5111c-7747-4025-b7d5-ca33782fc4e1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:30.163250 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3fd5111c-7747-4025-b7d5-ca33782fc4e1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:30.167703 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3fd5111c-7747-4025-b7d5-ca33782fc4e1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:30.511699 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3fd5111c-7747-4025-b7d5-ca33782fc4e1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:30.532529 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3fd5111c-7747-4025-b7d5-ca33782fc4e1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1314 microversion: 2.1 time: 0.407874 Jun 10 18:07:30.558349 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1584/3093] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:30 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:30.573070 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-752fcf5e-0ad8-48af-8d0d-a47f3865f573 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:30.575988 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-752fcf5e-0ad8-48af-8d0d-a47f3865f573 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] [instance: b8136d11-a591-48c2-ab1a-c17422d326e6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:30.604460 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-752fcf5e-0ad8-48af-8d0d-a47f3865f573 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:30.607211 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-752fcf5e-0ad8-48af-8d0d-a47f3865f573 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:30.608455 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-752fcf5e-0ad8-48af-8d0d-a47f3865f573 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:30.609090 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-752fcf5e-0ad8-48af-8d0d-a47f3865f573 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:30.754434 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-752fcf5e-0ad8-48af-8d0d-a47f3865f573 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:30.759044 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-752fcf5e-0ad8-48af-8d0d-a47f3865f573 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:30.761742 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-752fcf5e-0ad8-48af-8d0d-a47f3865f573 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lazy-loading 'fault' on Instance uuid b8136d11-a591-48c2-ab1a-c17422d326e6 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:07:30.880223 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-752fcf5e-0ad8-48af-8d0d-a47f3865f573 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e633cf9c8e3b41f5a538f5937acf00d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142022afade745b9984068f42f0074dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:30.898267 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-752fcf5e-0ad8-48af-8d0d-a47f3865f573 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] 10.222.0.35 "GET /compute/v2.1/servers/b8136d11-a591-48c2-ab1a-c17422d326e6" status: 200 len: 1360 microversion: 2.1 time: 0.337121 Jun 10 18:07:30.901032 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1585/3094] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:30 2022] GET /compute/v2.1/servers/b8136d11-a591-48c2-ab1a-c17422d326e6 => generated 1360 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:30.922320 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-1e6d64f8-fc8f-4e52-82a4-6b7c4e422093 req-6b8b7019-c7ec-437c-ba5f-78ae134c70a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8136d11-a591-48c2-ab1a-c17422d326e6", "name": "network-vif-deleted", "tag": "2b19c5f3-6d53-4f1e-ab63-c786eef0c74e"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:07:30.947591 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-1e6d64f8-fc8f-4e52-82a4-6b7c4e422093 req-6b8b7019-c7ec-437c-ba5f-78ae134c70a1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:30.949535 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-1e6d64f8-fc8f-4e52-82a4-6b7c4e422093 req-6b8b7019-c7ec-437c-ba5f-78ae134c70a1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:30.985247 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-1e6d64f8-fc8f-4e52-82a4-6b7c4e422093 req-6b8b7019-c7ec-437c-ba5f-78ae134c70a1 service nova] Creating event network-vif-deleted:2b19c5f3-6d53-4f1e-ab63-c786eef0c74e for instance b8136d11-a591-48c2-ab1a-c17422d326e6 on chh1-master-2 Jun 10 18:07:31.016617 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-1e6d64f8-fc8f-4e52-82a4-6b7c4e422093 req-6b8b7019-c7ec-437c-ba5f-78ae134c70a1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111122 Jun 10 18:07:31.030137 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1586/3095] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:07:31.049964 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ced497bf-fa1b-4c60-ba2a-d591adb9ccbd tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1830206942"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:07:31.056461 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ced497bf-fa1b-4c60-ba2a-d591adb9ccbd tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:31.078079 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ced497bf-fa1b-4c60-ba2a-d591adb9ccbd tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:31.078693 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ced497bf-fa1b-4c60-ba2a-d591adb9ccbd tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:31.082475 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ced497bf-fa1b-4c60-ba2a-d591adb9ccbd tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:31.084351 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ced497bf-fa1b-4c60-ba2a-d591adb9ccbd tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:31.506508 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:07:31.573424 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=6 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:07:32.058914 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-b034be67-3619-4935-a534-23cac7c99ff1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:07:32.059551 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-b034be67-3619-4935-a534-23cac7c99ff1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:07:32.060497 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-b034be67-3619-4935-a534-23cac7c99ff1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:07:32.061003 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-b034be67-3619-4935-a534-23cac7c99ff1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:07:32.061670 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-b034be67-3619-4935-a534-23cac7c99ff1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:07:32.088080 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b034be67-3619-4935-a534-23cac7c99ff1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:32.090072 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b034be67-3619-4935-a534-23cac7c99ff1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:32.097562 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b034be67-3619-4935-a534-23cac7c99ff1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:32.098350 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b034be67-3619-4935-a534-23cac7c99ff1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:32.181514 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-b034be67-3619-4935-a534-23cac7c99ff1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Getting quotas for project 818440b6c7d34e09a1afd8a6e0c0b3ed. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:07:32.190112 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-b034be67-3619-4935-a534-23cac7c99ff1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Getting quotas for user 1d61eddc0c334ec79e23a069a422fad8 and project 818440b6c7d34e09a1afd8a6e0c0b3ed. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:07:32.213068 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b034be67-3619-4935-a534-23cac7c99ff1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:07:32.217085 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b034be67-3619-4935-a534-23cac7c99ff1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 7e727aa8-591d-4232-bf55-d7e8c0ce0047] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:07:32.285834 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ced497bf-fa1b-4c60-ba2a-d591adb9ccbd tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "POST /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b/action" status: 202 len: 0 microversion: 2.1 time: 1.252951 Jun 10 18:07:32.294991 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1587/3096] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:07:31 2022] POST /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b/action => generated 0 bytes in 1264 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 10 18:07:32.308973 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-057ef03a-4f4e-4f92-9e42-dba814a034af tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:32.313195 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-057ef03a-4f4e-4f92-9e42-dba814a034af tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 03dcc828-a971-496c-aa8c-28681ec6fc01] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:32.325942 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-057ef03a-4f4e-4f92-9e42-dba814a034af tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:32.328930 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-057ef03a-4f4e-4f92-9e42-dba814a034af tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:32.329869 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-057ef03a-4f4e-4f92-9e42-dba814a034af tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:32.330959 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-057ef03a-4f4e-4f92-9e42-dba814a034af tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:32.433348 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b034be67-3619-4935-a534-23cac7c99ff1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.377560 Jun 10 18:07:32.447168 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1510/3097] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:07:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 6392 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:07:32.461191 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4a09a09c-369c-4078-b3ae-c04b8d6cd088 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:32.471345 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4a09a09c-369c-4078-b3ae-c04b8d6cd088 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] [instance: 4f169350-57ce-4ea3-bfca-ccf6f1957aa9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:32.491755 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a09a09c-369c-4078-b3ae-c04b8d6cd088 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:32.522161 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a09a09c-369c-4078-b3ae-c04b8d6cd088 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:32.525140 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a09a09c-369c-4078-b3ae-c04b8d6cd088 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:32.533002 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a09a09c-369c-4078-b3ae-c04b8d6cd088 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:32.780459 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-057ef03a-4f4e-4f92-9e42-dba814a034af tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:32.790060 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-057ef03a-4f4e-4f92-9e42-dba814a034af tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01" status: 200 len: 1316 microversion: 2.1 time: 0.493538 Jun 10 18:07:32.793094 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1588/3098] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:32 2022] GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01 => generated 1316 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:32.801386 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fd877a03-a7ca-4c11-916d-525a65ba5f76 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:32.827765 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fd877a03-a7ca-4c11-916d-525a65ba5f76 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:32.874093 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fd877a03-a7ca-4c11-916d-525a65ba5f76 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:32.874741 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fd877a03-a7ca-4c11-916d-525a65ba5f76 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:32.878992 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fd877a03-a7ca-4c11-916d-525a65ba5f76 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:32.882647 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fd877a03-a7ca-4c11-916d-525a65ba5f76 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:33.300637 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fd877a03-a7ca-4c11-916d-525a65ba5f76 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:33.305598 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:07:33.322541 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fd877a03-a7ca-4c11-916d-525a65ba5f76 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1314 microversion: 2.1 time: 0.522257 Jun 10 18:07:33.324543 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1589/3099] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:32 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1314 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:33.351099 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f19d3139-aa7a-448d-b150-cc1192e983f9 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:33.353080 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f19d3139-aa7a-448d-b150-cc1192e983f9 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] [instance: b8136d11-a591-48c2-ab1a-c17422d326e6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:33.370231 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f19d3139-aa7a-448d-b150-cc1192e983f9 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:33.373819 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f19d3139-aa7a-448d-b150-cc1192e983f9 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:33.374840 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f19d3139-aa7a-448d-b150-cc1192e983f9 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:33.375445 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f19d3139-aa7a-448d-b150-cc1192e983f9 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:33.412259 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-f19d3139-aa7a-448d-b150-cc1192e983f9 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] HTTP exception thrown: Instance b8136d11-a591-48c2-ab1a-c17422d326e6 could not be found. Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f19d3139-aa7a-448d-b150-cc1192e983f9 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Request method failure captured: Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/b8136d11-a591-48c2-ab1a-c17422d326e6 HTTP/1.1 Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4gF-MubmclFY0tG9TBHFCHSbW6d2NXw73jIiCSB4SFbilPTiC2ae0IAsgtNGkxBy7mLx8_-EV2wVXP6fo-U3gMaCtr023jEpKX5Coi4nVCFgEuYN38aF7J-AesyvoHW1S2UvnLD6XqbB626HTXvo79-9W1c1sxdLV8sADXDtnA9ptI Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 142022afade745b9984068f42f0074dc Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersTestJSON-997053441 Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/142022afade745b9984068f42f0074dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/142022afade745b9984068f42f0074dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/142022afade745b9984068f42f0074dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_142022afade745b9984068f42f0074dc", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersTestJSON-997053441 Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 142022afade745b9984068f42f0074dc Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersTestJSON-997053441 Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersTestJSON-997053441-project Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: e633cf9c8e3b41f5a538f5937acf00d7 Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersTestJSON-997053441-project Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: exception: Instance b8136d11-a591-48c2-ab1a-c17422d326e6 could not be found. Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'b8136d11-a591-48c2-ab1a-c17422d326e6'} Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8136d11-a591-48c2-ab1a-c17422d326e6 could not be found. Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8136d11-a591-48c2-ab1a-c17422d326e6 could not be found. Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:07:33.414968 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:07:33.418696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:07:33.418696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:07:33.418696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:07:33.418696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:07:33.418696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8136d11-a591-48c2-ab1a-c17422d326e6 could not be found. Jun 10 18:07:33.418696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:07:33.419816 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f19d3139-aa7a-448d-b150-cc1192e983f9 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Returning 404 to user: Instance b8136d11-a591-48c2-ab1a-c17422d326e6 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:07:33.421882 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f19d3139-aa7a-448d-b150-cc1192e983f9 tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] 10.222.0.35 "GET /compute/v2.1/servers/b8136d11-a591-48c2-ab1a-c17422d326e6" status: 404 len: 111 microversion: 2.1 time: 0.095625 Jun 10 18:07:33.427036 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1590/3100] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:33 2022] GET /compute/v2.1/servers/b8136d11-a591-48c2-ab1a-c17422d326e6 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:07:33.432754 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c694a6d9-3294-4970-ae3e-7691167c06e7 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c6082700>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:33.459123 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4a09a09c-369c-4078-b3ae-c04b8d6cd088 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f463dd5d9140ecb29e0daa415331a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c384e1bab854ad8b4c2ae9ab895cd88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:33.472908 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4a09a09c-369c-4078-b3ae-c04b8d6cd088 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] 10.222.0.35 "GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9" status: 200 len: 1306 microversion: 2.1 time: 1.024063 Jun 10 18:07:33.474342 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1511/3101] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:32 2022] GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9 => generated 1306 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:33.520008 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c694a6d9-3294-4970-ae3e-7691167c06e7 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/3c691b7d-1df9-4bde-93bd-492788d2c966" status: 200 len: 1410 microversion: 2.1 time: 0.091670 Jun 10 18:07:33.553335 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1591/3102] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:07:33 2022] GET /compute/v2.1/images/3c691b7d-1df9-4bde-93bd-492788d2c966 => generated 1410 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:33.581229 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-038604fb-f7e2-4df0-a0b5-28624d0df1e1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:33.587564 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-038604fb-f7e2-4df0-a0b5-28624d0df1e1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 7e727aa8-591d-4232-bf55-d7e8c0ce0047] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:33.738979 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2baf6b36-e282-4e41-9453-41f7f730b647 tempest-ExtensionsTest-289962127 tempest-ExtensionsTest-289962127-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:33.740964 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2baf6b36-e282-4e41-9453-41f7f730b647 tempest-ExtensionsTest-289962127 tempest-ExtensionsTest-289962127-project] 10.222.0.35 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.265397 Jun 10 18:07:33.741650 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1512/3103] 10.222.0.35 () {58 vars in 1169 bytes} [Fri Jun 10 18:07:33 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:07:33.773194 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9adaef37-0a4f-48d5-8633-3e711bfaa6bf tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] Calling method '.version_select at 0x7f77c04cd9d0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:33.825993 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-038604fb-f7e2-4df0-a0b5-28624d0df1e1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:33.838490 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-038604fb-f7e2-4df0-a0b5-28624d0df1e1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047" status: 200 len: 1213 microversion: 2.1 time: 0.266186 Jun 10 18:07:33.839195 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1592/3104] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:33 2022] GET /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047 => generated 1213 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:33.870367 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c863045e-e602-4b24-800f-a6a8fcd8968d tempest-ExtensionsTest-289962127 tempest-ExtensionsTest-289962127-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:33.885616 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9adaef37-0a4f-48d5-8633-3e711bfaa6bf tempest-ServersTestJSON-997053441 tempest-ServersTestJSON-997053441-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1944142214" status: 202 len: 0 microversion: 2.1 time: 0.142760 Jun 10 18:07:33.886476 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1513/3105] 10.222.0.35 () {58 vars in 1220 bytes} [Fri Jun 10 18:07:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1944142214 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:07:33.902010 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-170dc438-40cf-4c69-a2fd-ff5fc0a3cdb6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:33.907767 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c863045e-e602-4b24-800f-a6a8fcd8968d tempest-ExtensionsTest-289962127 tempest-ExtensionsTest-289962127-project] 10.222.0.35 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.065097 Jun 10 18:07:33.910060 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-170dc438-40cf-4c69-a2fd-ff5fc0a3cdb6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 03dcc828-a971-496c-aa8c-28681ec6fc01] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:33.924833 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1593/3106] 10.222.0.35 () {58 vars in 1133 bytes} [Fri Jun 10 18:07:33 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:07:33.935643 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-170dc438-40cf-4c69-a2fd-ff5fc0a3cdb6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:33.939354 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-170dc438-40cf-4c69-a2fd-ff5fc0a3cdb6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:33.941626 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-170dc438-40cf-4c69-a2fd-ff5fc0a3cdb6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:33.949177 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-170dc438-40cf-4c69-a2fd-ff5fc0a3cdb6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:34.256509 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-15606a4d-6c72-4cf5-9199-fb0179b34b7a req-9004abae-5c9a-4c7d-98f4-b671757aea1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03dcc828-a971-496c-aa8c-28681ec6fc01", "name": "network-vif-plugged", "status": "completed", "tag": "0bc2cf3a-92dd-4ff7-9e94-25dfa402dcb0"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:07:34.286650 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-15606a4d-6c72-4cf5-9199-fb0179b34b7a req-9004abae-5c9a-4c7d-98f4-b671757aea1d service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:34.289525 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-15606a4d-6c72-4cf5-9199-fb0179b34b7a req-9004abae-5c9a-4c7d-98f4-b671757aea1d service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:34.341837 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-15606a4d-6c72-4cf5-9199-fb0179b34b7a req-9004abae-5c9a-4c7d-98f4-b671757aea1d service nova] Creating event network-vif-plugged:0bc2cf3a-92dd-4ff7-9e94-25dfa402dcb0 for instance 03dcc828-a971-496c-aa8c-28681ec6fc01 on chh2-master-2 Jun 10 18:07:34.363018 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-15606a4d-6c72-4cf5-9199-fb0179b34b7a req-9004abae-5c9a-4c7d-98f4-b671757aea1d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106044 Jun 10 18:07:34.367602 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1594/3107] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:07:34.388002 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c2b42339-553d-4584-9cdc-7fbb28407f13 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:34.406103 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c2b42339-553d-4584-9cdc-7fbb28407f13 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:34.441630 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c2b42339-553d-4584-9cdc-7fbb28407f13 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:34.442152 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c2b42339-553d-4584-9cdc-7fbb28407f13 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:34.442999 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c2b42339-553d-4584-9cdc-7fbb28407f13 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:34.447839 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c2b42339-553d-4584-9cdc-7fbb28407f13 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:35.524252 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c2b42339-553d-4584-9cdc-7fbb28407f13 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:35.532487 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c2b42339-553d-4584-9cdc-7fbb28407f13 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1314 microversion: 2.1 time: 1.163121 Jun 10 18:07:35.533100 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1595/3108] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:34 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1314 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:35.599932 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-170d6664-091e-4a1a-bca4-699db61fe89f tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:35.599932 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-170d6664-091e-4a1a-bca4-699db61fe89f tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] [instance: 4f169350-57ce-4ea3-bfca-ccf6f1957aa9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:35.614783 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-170d6664-091e-4a1a-bca4-699db61fe89f tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:35.620138 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-170d6664-091e-4a1a-bca4-699db61fe89f tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:35.622208 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-170d6664-091e-4a1a-bca4-699db61fe89f tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:35.624090 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-170d6664-091e-4a1a-bca4-699db61fe89f tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:35.996342 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-170dc438-40cf-4c69-a2fd-ff5fc0a3cdb6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:36.020853 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-170dc438-40cf-4c69-a2fd-ff5fc0a3cdb6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01" status: 200 len: 1316 microversion: 2.1 time: 2.132894 Jun 10 18:07:36.028345 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1514/3109] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:33 2022] GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01 => generated 1316 bytes in 2134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:36.036475 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-38825c63-27cd-4513-bc15-cec695a06ab5 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c610c430>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:36.154424 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-38825c63-27cd-4513-bc15-cec695a06ab5 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/3c691b7d-1df9-4bde-93bd-492788d2c966" status: 200 len: 1410 microversion: 2.1 time: 0.131140 Jun 10 18:07:36.155046 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1515/3110] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:07:36 2022] GET /compute/v2.1/images/3c691b7d-1df9-4bde-93bd-492788d2c966 => generated 1410 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:36.175404 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cbafba6c-e273-4667-b3a5-0ec4f226e97e tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:36.176046 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cbafba6c-e273-4667-b3a5-0ec4f226e97e tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 7e727aa8-591d-4232-bf55-d7e8c0ce0047] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:36.214510 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cbafba6c-e273-4667-b3a5-0ec4f226e97e tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:36.216367 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cbafba6c-e273-4667-b3a5-0ec4f226e97e tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:36.217310 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cbafba6c-e273-4667-b3a5-0ec4f226e97e tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:36.217776 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cbafba6c-e273-4667-b3a5-0ec4f226e97e tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:36.502828 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cbafba6c-e273-4667-b3a5-0ec4f226e97e tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:36.518967 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cbafba6c-e273-4667-b3a5-0ec4f226e97e tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047" status: 200 len: 1283 microversion: 2.1 time: 0.362826 Jun 10 18:07:36.533847 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1516/3111] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:36 2022] GET /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047 => generated 1283 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:36.575033 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-74663c6c-d021-4ec4-91a5-e0e94636d07f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:36.575669 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-74663c6c-d021-4ec4-91a5-e0e94636d07f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:36.589964 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-74663c6c-d021-4ec4-91a5-e0e94636d07f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:36.590459 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-74663c6c-d021-4ec4-91a5-e0e94636d07f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:36.593052 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-74663c6c-d021-4ec4-91a5-e0e94636d07f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:36.593536 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-74663c6c-d021-4ec4-91a5-e0e94636d07f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:37.034416 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-170d6664-091e-4a1a-bca4-699db61fe89f tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f463dd5d9140ecb29e0daa415331a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c384e1bab854ad8b4c2ae9ab895cd88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:37.051185 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-170d6664-091e-4a1a-bca4-699db61fe89f tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] 10.222.0.35 "GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9" status: 200 len: 1306 microversion: 2.1 time: 1.489178 Jun 10 18:07:37.055038 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1596/3112] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:35 2022] GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9 => generated 1306 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:37.069903 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-eebdbe6e-46d4-4ddc-be3e-7cf1497b936f req-6b36c176-2d86-4704-8b6d-0217efbe374c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f169350-57ce-4ea3-bfca-ccf6f1957aa9", "tag": "10868c25-7b88-4c10-9a0f-b5344b001642"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:07:37.097598 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-eebdbe6e-46d4-4ddc-be3e-7cf1497b936f req-6b36c176-2d86-4704-8b6d-0217efbe374c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:37.098823 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-eebdbe6e-46d4-4ddc-be3e-7cf1497b936f req-6b36c176-2d86-4704-8b6d-0217efbe374c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:37.149791 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-eebdbe6e-46d4-4ddc-be3e-7cf1497b936f req-6b36c176-2d86-4704-8b6d-0217efbe374c service nova] Creating event network-changed:10868c25-7b88-4c10-9a0f-b5344b001642 for instance 4f169350-57ce-4ea3-bfca-ccf6f1957aa9 on chh1-master-2 Jun 10 18:07:37.168254 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-eebdbe6e-46d4-4ddc-be3e-7cf1497b936f req-6b36c176-2d86-4704-8b6d-0217efbe374c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111475 Jun 10 18:07:37.173873 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1597/3113] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:07:37.201359 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-faa73c8a-102d-4f87-acdf-c96ce0bda326 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:37.206302 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-faa73c8a-102d-4f87-acdf-c96ce0bda326 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 03dcc828-a971-496c-aa8c-28681ec6fc01] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:37.238804 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-faa73c8a-102d-4f87-acdf-c96ce0bda326 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:37.239427 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-faa73c8a-102d-4f87-acdf-c96ce0bda326 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:37.242059 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-faa73c8a-102d-4f87-acdf-c96ce0bda326 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:37.245204 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-faa73c8a-102d-4f87-acdf-c96ce0bda326 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:37.739331 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-74663c6c-d021-4ec4-91a5-e0e94636d07f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:37.753227 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-74663c6c-d021-4ec4-91a5-e0e94636d07f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1314 microversion: 2.1 time: 1.198440 Jun 10 18:07:37.762643 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1517/3114] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:36 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1314 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:37.765951 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-92ef3f3b-f573-48d5-b8d4-a6f252f9bc52 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c03b2280>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:37.817200 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-faa73c8a-102d-4f87-acdf-c96ce0bda326 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:37.835217 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-faa73c8a-102d-4f87-acdf-c96ce0bda326 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01" status: 200 len: 1466 microversion: 2.1 time: 0.656034 Jun 10 18:07:37.836354 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1598/3115] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:37 2022] GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01 => generated 1466 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:37.846586 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a7f8a61c-bc55-4295-8972-87b8d6837af9 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:37.847558 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a7f8a61c-bc55-4295-8972-87b8d6837af9 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 7e727aa8-591d-4232-bf55-d7e8c0ce0047] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:37.848415 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-92ef3f3b-f573-48d5-b8d4-a6f252f9bc52 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/3c691b7d-1df9-4bde-93bd-492788d2c966" status: 200 len: 1410 microversion: 2.1 time: 0.093049 Jun 10 18:07:37.849559 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1518/3116] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:07:37 2022] GET /compute/v2.1/images/3c691b7d-1df9-4bde-93bd-492788d2c966 => generated 1410 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:37.866249 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a7f8a61c-bc55-4295-8972-87b8d6837af9 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:37.867071 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a7f8a61c-bc55-4295-8972-87b8d6837af9 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:37.868622 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a7f8a61c-bc55-4295-8972-87b8d6837af9 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:37.871477 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a34dde7d-398c-4e38-9f23-6c11448af394 tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:37.872100 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a7f8a61c-bc55-4295-8972-87b8d6837af9 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:37.873122 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a34dde7d-398c-4e38-9f23-6c11448af394 tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] [instance: 03dcc828-a971-496c-aa8c-28681ec6fc01] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:37.885280 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a34dde7d-398c-4e38-9f23-6c11448af394 tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:37.887917 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a34dde7d-398c-4e38-9f23-6c11448af394 tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:37.889012 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a34dde7d-398c-4e38-9f23-6c11448af394 tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:37.889637 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a34dde7d-398c-4e38-9f23-6c11448af394 tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:38.157007 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a7f8a61c-bc55-4295-8972-87b8d6837af9 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:38.179965 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a7f8a61c-bc55-4295-8972-87b8d6837af9 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047" status: 200 len: 1271 microversion: 2.1 time: 0.341891 Jun 10 18:07:38.190208 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1599/3117] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:37 2022] GET /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047 => generated 1271 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:38.204832 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b5ef32b7-f975-4859-bf08-7bbafc0fee0e tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:38.208160 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b5ef32b7-f975-4859-bf08-7bbafc0fee0e tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] [instance: 4f169350-57ce-4ea3-bfca-ccf6f1957aa9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:38.226608 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5ef32b7-f975-4859-bf08-7bbafc0fee0e tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:38.226608 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5ef32b7-f975-4859-bf08-7bbafc0fee0e tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:38.226608 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5ef32b7-f975-4859-bf08-7bbafc0fee0e tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:38.230885 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5ef32b7-f975-4859-bf08-7bbafc0fee0e tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:38.805186 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b5ef32b7-f975-4859-bf08-7bbafc0fee0e tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f463dd5d9140ecb29e0daa415331a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c384e1bab854ad8b4c2ae9ab895cd88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:38.828704 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b5ef32b7-f975-4859-bf08-7bbafc0fee0e tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] 10.222.0.35 "GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9" status: 200 len: 1306 microversion: 2.1 time: 0.635301 Jun 10 18:07:38.840891 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1600/3118] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:38 2022] GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9 => generated 1306 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:38.885872 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c754c2a4-968a-4614-9dc5-6ecc8a18ec95 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:38.886502 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c754c2a4-968a-4614-9dc5-6ecc8a18ec95 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:38.906759 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c754c2a4-968a-4614-9dc5-6ecc8a18ec95 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:38.907226 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c754c2a4-968a-4614-9dc5-6ecc8a18ec95 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:38.914873 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c754c2a4-968a-4614-9dc5-6ecc8a18ec95 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:38.915372 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c754c2a4-968a-4614-9dc5-6ecc8a18ec95 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:39.041204 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a34dde7d-398c-4e38-9f23-6c11448af394 tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01" status: 200 len: 1617 microversion: 2.1 time: 1.173864 Jun 10 18:07:39.043316 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1519/3119] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:37 2022] GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01 => generated 1617 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:39.050367 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5b33077e-dee6-45cb-a43c-94847a20243a tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c0486b80>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:39.148874 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5b33077e-dee6-45cb-a43c-94847a20243a tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/3c691b7d-1df9-4bde-93bd-492788d2c966" status: 200 len: 1410 microversion: 2.1 time: 0.101400 Jun 10 18:07:39.152502 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1520/3120] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:07:39 2022] GET /compute/v2.1/images/3c691b7d-1df9-4bde-93bd-492788d2c966 => generated 1410 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:39.215315 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-633fbab3-b387-426c-b7d8-c969ec7a68cc tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:39.216501 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-633fbab3-b387-426c-b7d8-c969ec7a68cc tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 7e727aa8-591d-4232-bf55-d7e8c0ce0047] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:39.232374 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-633fbab3-b387-426c-b7d8-c969ec7a68cc tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:39.238674 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-633fbab3-b387-426c-b7d8-c969ec7a68cc tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:39.241308 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c754c2a4-968a-4614-9dc5-6ecc8a18ec95 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:39.242690 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-633fbab3-b387-426c-b7d8-c969ec7a68cc tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:39.243358 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-633fbab3-b387-426c-b7d8-c969ec7a68cc tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:39.250067 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c754c2a4-968a-4614-9dc5-6ecc8a18ec95 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1314 microversion: 2.1 time: 0.400054 Jun 10 18:07:39.258444 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1601/3121] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:38 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:39.301896 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-31daf189-4b14-483c-bd99-a6dce35ca176 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1722841535", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["5a7cc611-89ea-4c58-af65-315000f47739"]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:07:39.409641 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-31daf189-4b14-483c-bd99-a6dce35ca176 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] validate_networks() for None {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:07:39.489684 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-633fbab3-b387-426c-b7d8-c969ec7a68cc tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:39.498135 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-633fbab3-b387-426c-b7d8-c969ec7a68cc tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047" status: 200 len: 1271 microversion: 2.1 time: 0.298931 Jun 10 18:07:39.502091 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1521/3122] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:39 2022] GET /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047 => generated 1271 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:39.857913 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-161530c9-ec98-412d-8778-7005ffd1fba4 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:39.859017 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-161530c9-ec98-412d-8778-7005ffd1fba4 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] [instance: 4f169350-57ce-4ea3-bfca-ccf6f1957aa9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:39.874511 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-161530c9-ec98-412d-8778-7005ffd1fba4 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:39.875192 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-161530c9-ec98-412d-8778-7005ffd1fba4 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:39.880981 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-161530c9-ec98-412d-8778-7005ffd1fba4 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:39.880981 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-161530c9-ec98-412d-8778-7005ffd1fba4 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:39.922656 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-31daf189-4b14-483c-bd99-a6dce35ca176 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:07:39.923305 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-31daf189-4b14-483c-bd99-a6dce35ca176 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:07:39.923987 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-31daf189-4b14-483c-bd99-a6dce35ca176 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:07:39.924574 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-31daf189-4b14-483c-bd99-a6dce35ca176 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:07:39.925130 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-31daf189-4b14-483c-bd99-a6dce35ca176 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:07:39.945006 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-31daf189-4b14-483c-bd99-a6dce35ca176 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:39.945657 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-31daf189-4b14-483c-bd99-a6dce35ca176 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:39.947229 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-31daf189-4b14-483c-bd99-a6dce35ca176 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:39.951245 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-31daf189-4b14-483c-bd99-a6dce35ca176 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:40.001430 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-31daf189-4b14-483c-bd99-a6dce35ca176 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Getting quotas for project bb2c4b1067ac4cab8b8565bc987f00b1. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:07:40.015371 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-31daf189-4b14-483c-bd99-a6dce35ca176 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Getting quotas for user 9c189471a3ab4ec2b644b3ee1352d4e6 and project bb2c4b1067ac4cab8b8565bc987f00b1. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:07:40.057130 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-31daf189-4b14-483c-bd99-a6dce35ca176 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:07:40.065812 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-31daf189-4b14-483c-bd99-a6dce35ca176 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: db296b3f-c053-4988-933b-b5d6673853b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:07:40.246102 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-31daf189-4b14-483c-bd99-a6dce35ca176 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.948513 Jun 10 18:07:40.246774 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1602/3123] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:07:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 10 18:07:40.279080 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-41d3f6d9-6b89-46d0-b18e-7265fd79cf7e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c60a8550>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:40.344078 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-41d3f6d9-6b89-46d0-b18e-7265fd79cf7e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/3c691b7d-1df9-4bde-93bd-492788d2c966" status: 200 len: 1410 microversion: 2.1 time: 0.096241 Jun 10 18:07:40.348659 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1603/3124] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:07:40 2022] GET /compute/v2.1/images/3c691b7d-1df9-4bde-93bd-492788d2c966 => generated 1410 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:40.366821 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b1443d3e-8260-4c80-bbd6-014fc8edb0b6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:40.371202 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b1443d3e-8260-4c80-bbd6-014fc8edb0b6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: db296b3f-c053-4988-933b-b5d6673853b4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:40.563307 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b1443d3e-8260-4c80-bbd6-014fc8edb0b6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:40.574660 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b1443d3e-8260-4c80-bbd6-014fc8edb0b6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/db296b3f-c053-4988-933b-b5d6673853b4" status: 200 len: 1217 microversion: 2.1 time: 0.222609 Jun 10 18:07:40.578119 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1604/3125] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:40 2022] GET /compute/v2.1/servers/db296b3f-c053-4988-933b-b5d6673853b4 => generated 1217 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:40.587367 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d89d03f5-1a35-42bb-9815-7983adb575d5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:40.590228 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d89d03f5-1a35-42bb-9815-7983adb575d5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:40.605764 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d89d03f5-1a35-42bb-9815-7983adb575d5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:40.606455 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d89d03f5-1a35-42bb-9815-7983adb575d5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:40.607780 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d89d03f5-1a35-42bb-9815-7983adb575d5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:40.608675 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d89d03f5-1a35-42bb-9815-7983adb575d5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:40.833546 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-161530c9-ec98-412d-8778-7005ffd1fba4 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f463dd5d9140ecb29e0daa415331a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c384e1bab854ad8b4c2ae9ab895cd88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:40.843325 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-161530c9-ec98-412d-8778-7005ffd1fba4 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] 10.222.0.35 "GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9" status: 200 len: 1306 microversion: 2.1 time: 0.990749 Jun 10 18:07:40.862054 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1522/3126] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:39 2022] GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9 => generated 1306 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:07:40.873853 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d806c980-3279-4797-a0e0-a676a38265fb tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:40.875699 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d806c980-3279-4797-a0e0-a676a38265fb tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 7e727aa8-591d-4232-bf55-d7e8c0ce0047] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:40.889620 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d806c980-3279-4797-a0e0-a676a38265fb tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:40.892136 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d806c980-3279-4797-a0e0-a676a38265fb tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:40.893059 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d806c980-3279-4797-a0e0-a676a38265fb tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:40.893513 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d806c980-3279-4797-a0e0-a676a38265fb tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:40.937979 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d89d03f5-1a35-42bb-9815-7983adb575d5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:40.955158 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d89d03f5-1a35-42bb-9815-7983adb575d5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1314 microversion: 2.1 time: 0.372097 Jun 10 18:07:40.962119 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1605/3127] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:40 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:40.978903 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-3d343aee-6100-4566-9fc7-ac57bf3fbd79 req-5a28ea73-044a-4177-a7c5-325a3a2589ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da4ca117-eaa1-4a19-83ca-3da2766c5f15", "name": "network-vif-plugged", "status": "completed", "tag": "a82f9160-ebd4-4524-8522-95af49c18023"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:07:41.024230 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-3d343aee-6100-4566-9fc7-ac57bf3fbd79 req-5a28ea73-044a-4177-a7c5-325a3a2589ae service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:41.028665 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-3d343aee-6100-4566-9fc7-ac57bf3fbd79 req-5a28ea73-044a-4177-a7c5-325a3a2589ae service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:41.073880 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-3d343aee-6100-4566-9fc7-ac57bf3fbd79 req-5a28ea73-044a-4177-a7c5-325a3a2589ae service nova] Creating event network-vif-plugged:a82f9160-ebd4-4524-8522-95af49c18023 for instance da4ca117-eaa1-4a19-83ca-3da2766c5f15 on chh2-master-2 Jun 10 18:07:41.104399 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-3d343aee-6100-4566-9fc7-ac57bf3fbd79 req-5a28ea73-044a-4177-a7c5-325a3a2589ae service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131863 Jun 10 18:07:41.105959 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1606/3128] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:07:41.360180 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-76064fcf-5226-495b-9123-97bdd4f7c10d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c61b34c0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:41.467730 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-76064fcf-5226-495b-9123-97bdd4f7c10d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/3c691b7d-1df9-4bde-93bd-492788d2c966" status: 200 len: 1410 microversion: 2.1 time: 0.113442 Jun 10 18:07:41.468535 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1607/3129] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:07:41 2022] GET /compute/v2.1/images/3c691b7d-1df9-4bde-93bd-492788d2c966 => generated 1410 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:07:41.573226 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d806c980-3279-4797-a0e0-a676a38265fb tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:41.584619 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d806c980-3279-4797-a0e0-a676a38265fb tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047" status: 200 len: 1313 microversion: 2.1 time: 0.721205 Jun 10 18:07:41.589141 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1523/3130] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:40 2022] GET /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047 => generated 1313 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:41.595871 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a64bbb0d-e22f-4872-83fd-804a47e4a4e6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:41.597715 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a64bbb0d-e22f-4872-83fd-804a47e4a4e6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: db296b3f-c053-4988-933b-b5d6673853b4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:41.755806 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a64bbb0d-e22f-4872-83fd-804a47e4a4e6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:41.766533 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a64bbb0d-e22f-4872-83fd-804a47e4a4e6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/db296b3f-c053-4988-933b-b5d6673853b4" status: 200 len: 1217 microversion: 2.1 time: 0.175782 Jun 10 18:07:41.769039 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1608/3131] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:41 2022] GET /compute/v2.1/servers/db296b3f-c053-4988-933b-b5d6673853b4 => generated 1217 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:41.864069 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b8e439a2-e307-4368-b66f-2c4bbace87f0 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:41.864898 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b8e439a2-e307-4368-b66f-2c4bbace87f0 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] [instance: 4f169350-57ce-4ea3-bfca-ccf6f1957aa9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:41.876867 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b8e439a2-e307-4368-b66f-2c4bbace87f0 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:41.877332 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b8e439a2-e307-4368-b66f-2c4bbace87f0 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:41.885791 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b8e439a2-e307-4368-b66f-2c4bbace87f0 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:41.886316 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b8e439a2-e307-4368-b66f-2c4bbace87f0 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:41.978314 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f8510621-0fe9-4b70-ab11-66736ebda3ca tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:41.979004 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f8510621-0fe9-4b70-ab11-66736ebda3ca tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:41.993552 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f8510621-0fe9-4b70-ab11-66736ebda3ca tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:41.994008 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f8510621-0fe9-4b70-ab11-66736ebda3ca tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:41.994784 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f8510621-0fe9-4b70-ab11-66736ebda3ca tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:41.995227 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f8510621-0fe9-4b70-ab11-66736ebda3ca tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:42.152281 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:07:42.199234 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=6 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:07:42.307444 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b8e439a2-e307-4368-b66f-2c4bbace87f0 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f463dd5d9140ecb29e0daa415331a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c384e1bab854ad8b4c2ae9ab895cd88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:42.322604 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f8510621-0fe9-4b70-ab11-66736ebda3ca tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:42.331036 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f8510621-0fe9-4b70-ab11-66736ebda3ca tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1314 microversion: 2.1 time: 0.356499 Jun 10 18:07:42.335755 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1609/3132] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:41 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:42.348392 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b8e439a2-e307-4368-b66f-2c4bbace87f0 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] 10.222.0.35 "GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9" status: 200 len: 1294 microversion: 2.1 time: 0.488065 Jun 10 18:07:42.364390 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1524/3133] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:41 2022] GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9 => generated 1294 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:42.481214 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f40a971f-82a0-4915-8aa4-aae92291dfea tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c60a8d30>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:42.563582 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f40a971f-82a0-4915-8aa4-aae92291dfea tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/3c691b7d-1df9-4bde-93bd-492788d2c966" status: 200 len: 1410 microversion: 2.1 time: 0.084101 Jun 10 18:07:42.567862 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1610/3134] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:07:42 2022] GET /compute/v2.1/images/3c691b7d-1df9-4bde-93bd-492788d2c966 => generated 1410 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:42.603887 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f7afd8fb-9795-40c1-8017-fb850546ec39 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:42.604782 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f7afd8fb-9795-40c1-8017-fb850546ec39 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 7e727aa8-591d-4232-bf55-d7e8c0ce0047] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:42.631504 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f7afd8fb-9795-40c1-8017-fb850546ec39 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:42.632230 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f7afd8fb-9795-40c1-8017-fb850546ec39 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:42.633264 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f7afd8fb-9795-40c1-8017-fb850546ec39 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:42.633942 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f7afd8fb-9795-40c1-8017-fb850546ec39 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:42.788002 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0cc6b8c8-359d-4374-8870-a7e3126b1b47 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:42.789035 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0cc6b8c8-359d-4374-8870-a7e3126b1b47 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: db296b3f-c053-4988-933b-b5d6673853b4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:42.812646 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0cc6b8c8-359d-4374-8870-a7e3126b1b47 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:42.816782 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0cc6b8c8-359d-4374-8870-a7e3126b1b47 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:42.820769 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0cc6b8c8-359d-4374-8870-a7e3126b1b47 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:42.822629 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0cc6b8c8-359d-4374-8870-a7e3126b1b47 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:43.006419 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0cc6b8c8-359d-4374-8870-a7e3126b1b47 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:43.021922 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0cc6b8c8-359d-4374-8870-a7e3126b1b47 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/db296b3f-c053-4988-933b-b5d6673853b4" status: 200 len: 1221 microversion: 2.1 time: 0.238422 Jun 10 18:07:43.025698 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1611/3135] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:42 2022] GET /compute/v2.1/servers/db296b3f-c053-4988-933b-b5d6673853b4 => generated 1221 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:43.093500 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f7afd8fb-9795-40c1-8017-fb850546ec39 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:43.109734 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f7afd8fb-9795-40c1-8017-fb850546ec39 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047" status: 200 len: 1334 microversion: 2.1 time: 0.509074 Jun 10 18:07:43.110773 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1525/3136] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:42 2022] GET /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047 => generated 1334 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:43.183009 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-8596cb0f-eca3-43a4-82bc-8706266744db req-63540678-bc9e-4a38-a867-50a4638f83f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "284a4545-1204-4256-a8b5-8d2e1524948b", "name": "network-vif-plugged", "status": "completed", "tag": "6d10ff2b-6274-42d1-a74b-a9738d45b4d7"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:07:43.221884 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-8596cb0f-eca3-43a4-82bc-8706266744db req-63540678-bc9e-4a38-a867-50a4638f83f0 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:43.221884 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-8596cb0f-eca3-43a4-82bc-8706266744db req-63540678-bc9e-4a38-a867-50a4638f83f0 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:43.295918 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-8596cb0f-eca3-43a4-82bc-8706266744db req-63540678-bc9e-4a38-a867-50a4638f83f0 service nova] Creating event network-vif-plugged:6d10ff2b-6274-42d1-a74b-a9738d45b4d7 for instance 284a4545-1204-4256-a8b5-8d2e1524948b on chh2-master-2 Jun 10 18:07:43.307799 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-8596cb0f-eca3-43a4-82bc-8706266744db req-63540678-bc9e-4a38-a867-50a4638f83f0 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133403 Jun 10 18:07:43.309932 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1612/3137] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:07:43.352154 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-072dc1df-6367-4ca6-b87d-fc0371e2148e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:43.352859 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-072dc1df-6367-4ca6-b87d-fc0371e2148e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:43.367155 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1d197c9b-7b74-4cf7-8e72-b3a262f2224b tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:43.367881 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1d197c9b-7b74-4cf7-8e72-b3a262f2224b tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] [instance: 4f169350-57ce-4ea3-bfca-ccf6f1957aa9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:43.389037 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1d197c9b-7b74-4cf7-8e72-b3a262f2224b tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:43.389283 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-072dc1df-6367-4ca6-b87d-fc0371e2148e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:43.389751 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-072dc1df-6367-4ca6-b87d-fc0371e2148e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:43.390613 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-072dc1df-6367-4ca6-b87d-fc0371e2148e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:43.391067 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-072dc1df-6367-4ca6-b87d-fc0371e2148e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:43.397798 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1d197c9b-7b74-4cf7-8e72-b3a262f2224b tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:43.400473 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1d197c9b-7b74-4cf7-8e72-b3a262f2224b tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:43.401109 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1d197c9b-7b74-4cf7-8e72-b3a262f2224b tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:43.712919 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1d197c9b-7b74-4cf7-8e72-b3a262f2224b tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f463dd5d9140ecb29e0daa415331a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c384e1bab854ad8b4c2ae9ab895cd88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:43.736795 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1d197c9b-7b74-4cf7-8e72-b3a262f2224b tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] 10.222.0.35 "GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9" status: 200 len: 1294 microversion: 2.1 time: 0.374470 Jun 10 18:07:43.748372 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1613/3138] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:43 2022] GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9 => generated 1294 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:07:43.754770 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6301e7f2-c610-43b5-a339-4df607e5f156 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c60cb430>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:43.816154 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6301e7f2-c610-43b5-a339-4df607e5f156 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/3c691b7d-1df9-4bde-93bd-492788d2c966" status: 200 len: 1410 microversion: 2.1 time: 0.066374 Jun 10 18:07:43.817169 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1614/3139] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:07:43 2022] GET /compute/v2.1/images/3c691b7d-1df9-4bde-93bd-492788d2c966 => generated 1410 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:43.905352 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-072dc1df-6367-4ca6-b87d-fc0371e2148e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:43.914792 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-072dc1df-6367-4ca6-b87d-fc0371e2148e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1314 microversion: 2.1 time: 0.566571 Jun 10 18:07:43.916550 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1526/3140] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:43 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:44.052609 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-15b052a8-0dfb-49c3-8c7f-992154d286b4 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:44.053758 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-15b052a8-0dfb-49c3-8c7f-992154d286b4 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: db296b3f-c053-4988-933b-b5d6673853b4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:44.068776 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-15b052a8-0dfb-49c3-8c7f-992154d286b4 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:44.068776 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-15b052a8-0dfb-49c3-8c7f-992154d286b4 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:44.068776 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-15b052a8-0dfb-49c3-8c7f-992154d286b4 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:44.068776 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-15b052a8-0dfb-49c3-8c7f-992154d286b4 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:44.129197 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5a544c08-c3c8-44fa-b816-301371ebe1c0 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:44.129824 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5a544c08-c3c8-44fa-b816-301371ebe1c0 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 7e727aa8-591d-4232-bf55-d7e8c0ce0047] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:44.134537 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:07:44.142070 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5a544c08-c3c8-44fa-b816-301371ebe1c0 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:44.146907 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5a544c08-c3c8-44fa-b816-301371ebe1c0 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:44.148859 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5a544c08-c3c8-44fa-b816-301371ebe1c0 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:44.154961 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5a544c08-c3c8-44fa-b816-301371ebe1c0 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:44.155124 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-15b052a8-0dfb-49c3-8c7f-992154d286b4 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:44.163027 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-15b052a8-0dfb-49c3-8c7f-992154d286b4 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/db296b3f-c053-4988-933b-b5d6673853b4" status: 200 len: 1269 microversion: 2.1 time: 0.122152 Jun 10 18:07:44.182129 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1615/3141] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:44 2022] GET /compute/v2.1/servers/db296b3f-c053-4988-933b-b5d6673853b4 => generated 1269 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:44.183853 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:07:44.591595 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5a544c08-c3c8-44fa-b816-301371ebe1c0 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:44.614076 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5a544c08-c3c8-44fa-b816-301371ebe1c0 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047" status: 200 len: 1334 microversion: 2.1 time: 0.490404 Jun 10 18:07:44.624050 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1527/3142] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:44 2022] GET /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047 => generated 1334 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:44.762257 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0ca5a54e-fb37-4627-afb5-9606199fa5ea tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:44.764201 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0ca5a54e-fb37-4627-afb5-9606199fa5ea tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] [instance: 4f169350-57ce-4ea3-bfca-ccf6f1957aa9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:44.786677 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0ca5a54e-fb37-4627-afb5-9606199fa5ea tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:44.791092 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0ca5a54e-fb37-4627-afb5-9606199fa5ea tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:44.792141 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0ca5a54e-fb37-4627-afb5-9606199fa5ea tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:44.795229 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0ca5a54e-fb37-4627-afb5-9606199fa5ea tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:44.836659 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-50b97003-d45d-42bf-80cc-55411185add5 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c03b2040>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:45.341881 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0ca5a54e-fb37-4627-afb5-9606199fa5ea tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f463dd5d9140ecb29e0daa415331a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c384e1bab854ad8b4c2ae9ab895cd88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:45.377193 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0ca5a54e-fb37-4627-afb5-9606199fa5ea tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] 10.222.0.35 "GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9" status: 200 len: 1294 microversion: 2.1 time: 0.622826 Jun 10 18:07:45.378160 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1616/3143] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:44 2022] GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9 => generated 1294 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:45.386645 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e4314bc9-05db-453e-8ab1-d9f7f3dc11c4 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:45.387544 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e4314bc9-05db-453e-8ab1-d9f7f3dc11c4 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:45.396699 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e4314bc9-05db-453e-8ab1-d9f7f3dc11c4 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:45.397924 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e4314bc9-05db-453e-8ab1-d9f7f3dc11c4 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:45.398924 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e4314bc9-05db-453e-8ab1-d9f7f3dc11c4 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:45.402332 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e4314bc9-05db-453e-8ab1-d9f7f3dc11c4 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:45.834268 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e4314bc9-05db-453e-8ab1-d9f7f3dc11c4 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:45.856958 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e4314bc9-05db-453e-8ab1-d9f7f3dc11c4 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1500 microversion: 2.1 time: 0.477314 Jun 10 18:07:45.882844 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1617/3144] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:45 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1500 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:45.897186 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f89878de-7d98-46ac-a98f-715064792a99 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:45.913662 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f89878de-7d98-46ac-a98f-715064792a99 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: db296b3f-c053-4988-933b-b5d6673853b4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:45.941047 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f89878de-7d98-46ac-a98f-715064792a99 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:45.941513 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f89878de-7d98-46ac-a98f-715064792a99 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:45.944892 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f89878de-7d98-46ac-a98f-715064792a99 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:45.947118 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f89878de-7d98-46ac-a98f-715064792a99 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:46.230683 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f89878de-7d98-46ac-a98f-715064792a99 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:46.253236 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f89878de-7d98-46ac-a98f-715064792a99 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/db296b3f-c053-4988-933b-b5d6673853b4" status: 200 len: 1275 microversion: 2.1 time: 0.362052 Jun 10 18:07:46.259701 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1618/3145] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:45 2022] GET /compute/v2.1/servers/db296b3f-c053-4988-933b-b5d6673853b4 => generated 1275 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:46.699135 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-92ba7b1c-db08-4337-9f14-63434140088d req-baac4bc9-f184-408c-bbb4-b7ca6bf6ac39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e727aa8-591d-4232-bf55-d7e8c0ce0047", "tag": "85930c63-06f4-4807-8d5f-87244cff2bc3"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:07:46.731753 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-92ba7b1c-db08-4337-9f14-63434140088d req-baac4bc9-f184-408c-bbb4-b7ca6bf6ac39 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:46.742301 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-92ba7b1c-db08-4337-9f14-63434140088d req-baac4bc9-f184-408c-bbb4-b7ca6bf6ac39 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:46.809153 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-92ba7b1c-db08-4337-9f14-63434140088d req-baac4bc9-f184-408c-bbb4-b7ca6bf6ac39 service nova] Creating event network-changed:85930c63-06f4-4807-8d5f-87244cff2bc3 for instance 7e727aa8-591d-4232-bf55-d7e8c0ce0047 on chh1-master-2 Jun 10 18:07:46.824460 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-92ba7b1c-db08-4337-9f14-63434140088d req-baac4bc9-f184-408c-bbb4-b7ca6bf6ac39 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.567879 Jun 10 18:07:46.828733 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1619/3146] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:07:46.847094 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-381d56d2-e4a7-4cbb-b39f-f32a139baacd tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:46.850289 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-381d56d2-e4a7-4cbb-b39f-f32a139baacd tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 7e727aa8-591d-4232-bf55-d7e8c0ce0047] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:46.869659 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-381d56d2-e4a7-4cbb-b39f-f32a139baacd tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:46.873668 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-381d56d2-e4a7-4cbb-b39f-f32a139baacd tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:46.874683 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-381d56d2-e4a7-4cbb-b39f-f32a139baacd tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:46.878067 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-381d56d2-e4a7-4cbb-b39f-f32a139baacd tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:46.889826 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:07:47.218186 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-381d56d2-e4a7-4cbb-b39f-f32a139baacd tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:47.227186 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-381d56d2-e4a7-4cbb-b39f-f32a139baacd tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047" status: 200 len: 1334 microversion: 2.1 time: 0.392057 Jun 10 18:07:47.228383 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1620/3147] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:46 2022] GET /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047 => generated 1334 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:47.243116 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-42c5522e-eaa2-4ec1-a94c-2124004d2ebf tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:07:47.243695 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-42c5522e-eaa2-4ec1-a94c-2124004d2ebf tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:47.259800 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-42c5522e-eaa2-4ec1-a94c-2124004d2ebf tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:47.260268 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-42c5522e-eaa2-4ec1-a94c-2124004d2ebf tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:47.262965 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-42c5522e-eaa2-4ec1-a94c-2124004d2ebf tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:47.264482 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-42c5522e-eaa2-4ec1-a94c-2124004d2ebf tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:47.576722 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-42c5522e-eaa2-4ec1-a94c-2124004d2ebf tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "POST /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15/action" status: 202 len: 0 microversion: 2.1 time: 0.342992 Jun 10 18:07:47.576722 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1621/3148] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:07:47 2022] POST /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:07:47.597468 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6b38caf2-b828-47db-afc3-4924b46a45ed tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:47.598433 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6b38caf2-b828-47db-afc3-4924b46a45ed tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] [instance: 4f169350-57ce-4ea3-bfca-ccf6f1957aa9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:47.624099 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6b38caf2-b828-47db-afc3-4924b46a45ed tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:47.624814 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6b38caf2-b828-47db-afc3-4924b46a45ed tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:47.625789 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6b38caf2-b828-47db-afc3-4924b46a45ed tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:47.626421 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6b38caf2-b828-47db-afc3-4924b46a45ed tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:48.290763 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6b38caf2-b828-47db-afc3-4924b46a45ed tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f463dd5d9140ecb29e0daa415331a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c384e1bab854ad8b4c2ae9ab895cd88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:48.300020 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6b38caf2-b828-47db-afc3-4924b46a45ed tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] 10.222.0.35 "GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9" status: 200 len: 1294 microversion: 2.1 time: 0.723456 Jun 10 18:07:48.304334 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1622/3149] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:47 2022] GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9 => generated 1294 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:48.325110 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-01a51891-5a45-423e-9c27-93bc72aebb3e tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:48.328889 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-01a51891-5a45-423e-9c27-93bc72aebb3e tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: db296b3f-c053-4988-933b-b5d6673853b4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:48.341348 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:07:48.343298 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-01a51891-5a45-423e-9c27-93bc72aebb3e tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:48.343904 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-01a51891-5a45-423e-9c27-93bc72aebb3e tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:48.350167 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-01a51891-5a45-423e-9c27-93bc72aebb3e tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:48.350853 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-01a51891-5a45-423e-9c27-93bc72aebb3e tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:48.601043 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-01a51891-5a45-423e-9c27-93bc72aebb3e tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:48.610156 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-01a51891-5a45-423e-9c27-93bc72aebb3e tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/db296b3f-c053-4988-933b-b5d6673853b4" status: 200 len: 1317 microversion: 2.1 time: 0.295994 Jun 10 18:07:48.624577 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1623/3150] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:48 2022] GET /compute/v2.1/servers/db296b3f-c053-4988-933b-b5d6673853b4 => generated 1317 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:48.634280 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-007300c1-cebb-4cd1-a052-fe9d6a6f0c5f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:48.636193 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-007300c1-cebb-4cd1-a052-fe9d6a6f0c5f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:48.656003 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-007300c1-cebb-4cd1-a052-fe9d6a6f0c5f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:48.659595 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-007300c1-cebb-4cd1-a052-fe9d6a6f0c5f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:48.660621 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-007300c1-cebb-4cd1-a052-fe9d6a6f0c5f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:48.661605 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-007300c1-cebb-4cd1-a052-fe9d6a6f0c5f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:48.949308 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-007300c1-cebb-4cd1-a052-fe9d6a6f0c5f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:48.960821 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-007300c1-cebb-4cd1-a052-fe9d6a6f0c5f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1485 microversion: 2.1 time: 0.334801 Jun 10 18:07:48.961419 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1624/3151] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:48 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1485 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:48.975724 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1d47f132-1b51-4fa3-87c9-1f56d92e15fa tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:48.976368 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1d47f132-1b51-4fa3-87c9-1f56d92e15fa tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 7e727aa8-591d-4232-bf55-d7e8c0ce0047] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:49.009260 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1d47f132-1b51-4fa3-87c9-1f56d92e15fa tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:49.012428 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1d47f132-1b51-4fa3-87c9-1f56d92e15fa tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:49.013311 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1d47f132-1b51-4fa3-87c9-1f56d92e15fa tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:49.013766 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1d47f132-1b51-4fa3-87c9-1f56d92e15fa tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:49.376716 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1d47f132-1b51-4fa3-87c9-1f56d92e15fa tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:49.393406 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1d47f132-1b51-4fa3-87c9-1f56d92e15fa tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047" status: 200 len: 1334 microversion: 2.1 time: 0.430901 Jun 10 18:07:49.411387 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1625/3152] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:48 2022] GET /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047 => generated 1334 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:49.426722 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5d6dc290-e65e-4332-89cb-f9b61e4eaf56 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:07:49.442191 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5d6dc290-e65e-4332-89cb-f9b61e4eaf56 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:49.459328 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5d6dc290-e65e-4332-89cb-f9b61e4eaf56 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:49.460573 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5d6dc290-e65e-4332-89cb-f9b61e4eaf56 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:49.464101 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5d6dc290-e65e-4332-89cb-f9b61e4eaf56 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:49.466198 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5d6dc290-e65e-4332-89cb-f9b61e4eaf56 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:49.540242 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-5d6dc290-e65e-4332-89cb-f9b61e4eaf56 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lazy-loading 'flavor' on Instance uuid da4ca117-eaa1-4a19-83ca-3da2766c5f15 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:07:49.981457 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:07:51.761990 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=12 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:07:54.862974 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:07:58.504445 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-50b97003-d45d-42bf-80cc-55411185add5 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/3c691b7d-1df9-4bde-93bd-492788d2c966" status: 200 len: 1410 microversion: 2.1 time: 13.677988 Jun 10 18:07:58.520406 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1528/3153] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:07:44 2022] GET /compute/v2.1/images/3c691b7d-1df9-4bde-93bd-492788d2c966 => generated 1410 bytes in 13694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:07:58.528454 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e68716f1-7c70-416f-9da2-885a4fc3ac93 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:58.542511 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e68716f1-7c70-416f-9da2-885a4fc3ac93 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] [instance: 4f169350-57ce-4ea3-bfca-ccf6f1957aa9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:58.549849 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e68716f1-7c70-416f-9da2-885a4fc3ac93 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:58.550412 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e68716f1-7c70-416f-9da2-885a4fc3ac93 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:58.551203 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e68716f1-7c70-416f-9da2-885a4fc3ac93 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:58.551656 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e68716f1-7c70-416f-9da2-885a4fc3ac93 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:58.758124 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e68716f1-7c70-416f-9da2-885a4fc3ac93 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f463dd5d9140ecb29e0daa415331a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c384e1bab854ad8b4c2ae9ab895cd88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:58.769346 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e68716f1-7c70-416f-9da2-885a4fc3ac93 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] 10.222.0.35 "GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9" status: 200 len: 1294 microversion: 2.1 time: 0.247308 Jun 10 18:07:58.770552 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1529/3154] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:58 2022] GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9 => generated 1294 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:58.775282 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d830bb50-1596-4039-adf9-705691872af1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:58.776144 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d830bb50-1596-4039-adf9-705691872af1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: db296b3f-c053-4988-933b-b5d6673853b4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:58.787561 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d830bb50-1596-4039-adf9-705691872af1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:58.788816 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d830bb50-1596-4039-adf9-705691872af1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:58.789937 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d830bb50-1596-4039-adf9-705691872af1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:58.790679 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d830bb50-1596-4039-adf9-705691872af1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:58.878511 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5d6dc290-e65e-4332-89cb-f9b61e4eaf56 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "POST /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15/action" status: 202 len: 0 microversion: 2.1 time: 9.465322 Jun 10 18:07:58.882932 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1626/3155] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:07:49 2022] POST /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15/action => generated 0 bytes in 9471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:07:58.889052 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-0092b432-5860-49af-800d-1859b778af15 req-888bbbfb-a99f-4ef2-8f05-4d935216021c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e727aa8-591d-4232-bf55-d7e8c0ce0047", "tag": "5b7c29d6-b930-4a0d-a343-382a08a89e58"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:07:58.900719 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-0092b432-5860-49af-800d-1859b778af15 req-888bbbfb-a99f-4ef2-8f05-4d935216021c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:58.901616 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-0092b432-5860-49af-800d-1859b778af15 req-888bbbfb-a99f-4ef2-8f05-4d935216021c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:58.914914 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-0092b432-5860-49af-800d-1859b778af15 req-888bbbfb-a99f-4ef2-8f05-4d935216021c service nova] Creating event network-changed:5b7c29d6-b930-4a0d-a343-382a08a89e58 for instance 7e727aa8-591d-4232-bf55-d7e8c0ce0047 on chh1-master-2 Jun 10 18:07:58.922613 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-0092b432-5860-49af-800d-1859b778af15 req-888bbbfb-a99f-4ef2-8f05-4d935216021c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037731 Jun 10 18:07:58.928075 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1627/3156] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:07:58.942696 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4616ec0a-d00f-4fe9-8c37-274e006cb428 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:58.943415 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4616ec0a-d00f-4fe9-8c37-274e006cb428 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 7e727aa8-591d-4232-bf55-d7e8c0ce0047] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:58.960965 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4616ec0a-d00f-4fe9-8c37-274e006cb428 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:58.962075 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4616ec0a-d00f-4fe9-8c37-274e006cb428 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:58.963647 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4616ec0a-d00f-4fe9-8c37-274e006cb428 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:58.965202 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4616ec0a-d00f-4fe9-8c37-274e006cb428 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:59.183381 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4616ec0a-d00f-4fe9-8c37-274e006cb428 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:59.192237 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4616ec0a-d00f-4fe9-8c37-274e006cb428 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047" status: 200 len: 1334 microversion: 2.1 time: 0.257213 Jun 10 18:07:59.194429 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1628/3157] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:58 2022] GET /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047 => generated 1334 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:59.202316 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-444e896a-6c3d-45c4-b157-f84af0b3fbf5 req-d9cc8531-1529-434e-8f39-bf018721f0d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f169350-57ce-4ea3-bfca-ccf6f1957aa9", "name": "network-vif-plugged", "status": "completed", "tag": "10868c25-7b88-4c10-9a0f-b5344b001642"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:07:59.218651 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-444e896a-6c3d-45c4-b157-f84af0b3fbf5 req-d9cc8531-1529-434e-8f39-bf018721f0d8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:59.219338 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-444e896a-6c3d-45c4-b157-f84af0b3fbf5 req-d9cc8531-1529-434e-8f39-bf018721f0d8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:59.242335 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-444e896a-6c3d-45c4-b157-f84af0b3fbf5 req-d9cc8531-1529-434e-8f39-bf018721f0d8 service nova] Creating event network-vif-plugged:10868c25-7b88-4c10-9a0f-b5344b001642 for instance 4f169350-57ce-4ea3-bfca-ccf6f1957aa9 on chh1-master-2 Jun 10 18:07:59.242335 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-444e896a-6c3d-45c4-b157-f84af0b3fbf5 req-d9cc8531-1529-434e-8f39-bf018721f0d8 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042793 Jun 10 18:07:59.242335 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1629/3158] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:07:59.312443 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d830bb50-1596-4039-adf9-705691872af1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:07:59.325922 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d830bb50-1596-4039-adf9-705691872af1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/db296b3f-c053-4988-933b-b5d6673853b4" status: 200 len: 1317 microversion: 2.1 time: 0.554227 Jun 10 18:07:59.326550 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1530/3159] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:58 2022] GET /compute/v2.1/servers/db296b3f-c053-4988-933b-b5d6673853b4 => generated 1317 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:07:59.645802 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1d585038-6b66-4e9c-a321-34b1e878cfc3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1362332384", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "01d41899-bf8f-45ad-9aa1-db371d9cd1c4"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:07:59.735948 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c9d85d91-1b45-4954-a684-cc031c618af7 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Action: 'create', calling method: .version_select at 0x7f77c0da99d0>, body: {"keypair": {"name": "tempest-keypair-1035448627", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZ+mzXaty+CdK6SKc+tMjY84O7jQl+Oo0lrL8dMHN22VPHBS5KBa7If1TZfseaZQlehWcCBCvxnxiLMCHFa2NyaMshUJGrA6siLfHQcvll5797J0qHsL24Ie8QEPUvwDw=="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:07:59.748124 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-1d585038-6b66-4e9c-a321-34b1e878cfc3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] validate_networks() for [('01d41899-bf8f-45ad-9aa1-db371d9cd1c4', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:07:59.762001 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-c9d85d91-1b45-4954-a684-cc031c618af7 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Getting quotas for project e53380f847a949a0b61c83fc5661d236. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:07:59.770587 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-c9d85d91-1b45-4954-a684-cc031c618af7 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Getting quotas for user 0c4caa591fe84879a787d0601f2d8445 and project e53380f847a949a0b61c83fc5661d236. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:07:59.844009 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c9d85d91-1b45-4954-a684-cc031c618af7 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.510274 Jun 10 18:07:59.850369 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1531/3160] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 18:07:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:07:59.856497 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c305d257-17f0-44de-b7ff-b557e5c9b1c3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:07:59.857385 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c305d257-17f0-44de-b7ff-b557e5c9b1c3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:07:59.864144 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c305d257-17f0-44de-b7ff-b557e5c9b1c3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:59.864978 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c305d257-17f0-44de-b7ff-b557e5c9b1c3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:07:59.865967 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c305d257-17f0-44de-b7ff-b557e5c9b1c3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:07:59.866610 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c305d257-17f0-44de-b7ff-b557e5c9b1c3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:00.163106 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c305d257-17f0-44de-b7ff-b557e5c9b1c3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:00.179312 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c305d257-17f0-44de-b7ff-b557e5c9b1c3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1491 microversion: 2.1 time: 0.326967 Jun 10 18:08:00.180081 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1532/3161] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:07:59 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1491 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:00.193788 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2a3aa8e0-14f1-49ae-a0d8-5a2f08131693 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c03b2040>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:00.263608 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2a3aa8e0-14f1-49ae-a0d8-5a2f08131693 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/3c691b7d-1df9-4bde-93bd-492788d2c966" status: 200 len: 1410 microversion: 2.1 time: 0.081900 Jun 10 18:08:00.264395 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-1d585038-6b66-4e9c-a321-34b1e878cfc3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:08:00.264841 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-1d585038-6b66-4e9c-a321-34b1e878cfc3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:08:00.265312 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-1d585038-6b66-4e9c-a321-34b1e878cfc3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:08:00.265586 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1533/3162] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:08:00 2022] GET /compute/v2.1/images/3c691b7d-1df9-4bde-93bd-492788d2c966 => generated 1410 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:00.265927 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-1d585038-6b66-4e9c-a321-34b1e878cfc3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:08:00.266551 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-1d585038-6b66-4e9c-a321-34b1e878cfc3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:08:00.273338 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-646914fc-070a-40da-ab5b-2713d0a2d075 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:00.274449 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-646914fc-070a-40da-ab5b-2713d0a2d075 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] [instance: 4f169350-57ce-4ea3-bfca-ccf6f1957aa9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:00.277226 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1d585038-6b66-4e9c-a321-34b1e878cfc3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:00.277692 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1d585038-6b66-4e9c-a321-34b1e878cfc3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:00.278618 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1d585038-6b66-4e9c-a321-34b1e878cfc3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:00.279063 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1d585038-6b66-4e9c-a321-34b1e878cfc3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:00.283086 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-646914fc-070a-40da-ab5b-2713d0a2d075 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:00.283543 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-646914fc-070a-40da-ab5b-2713d0a2d075 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:00.284328 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-646914fc-070a-40da-ab5b-2713d0a2d075 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:00.284946 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-646914fc-070a-40da-ab5b-2713d0a2d075 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:00.305135 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-1d585038-6b66-4e9c-a321-34b1e878cfc3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Getting quotas for project 457c4a300936498b9e8b61645e655751. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:08:00.313449 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-1d585038-6b66-4e9c-a321-34b1e878cfc3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Getting quotas for user 8166793f60ee479689b4a21457b71d07 and project 457c4a300936498b9e8b61645e655751. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:08:00.332164 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1d585038-6b66-4e9c-a321-34b1e878cfc3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:08:00.335356 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1d585038-6b66-4e9c-a321-34b1e878cfc3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: a6779f56-7475-4ea6-8bd0-91feb2a3c36c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:08:00.491916 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-646914fc-070a-40da-ab5b-2713d0a2d075 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f463dd5d9140ecb29e0daa415331a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c384e1bab854ad8b4c2ae9ab895cd88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:00.514607 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-646914fc-070a-40da-ab5b-2713d0a2d075 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] 10.222.0.35 "GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9" status: 200 len: 1294 microversion: 2.1 time: 0.247647 Jun 10 18:08:00.519488 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1d585038-6b66-4e9c-a321-34b1e878cfc3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.278827 Jun 10 18:08:00.525484 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1630/3163] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:07:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1285 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:08:00.533498 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3e8e5013-4d9d-4e23-a4a0-2e1c1132570a tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:00.534330 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3e8e5013-4d9d-4e23-a4a0-2e1c1132570a tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 7e727aa8-591d-4232-bf55-d7e8c0ce0047] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:00.536486 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1534/3164] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:00 2022] GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9 => generated 1294 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:00.542355 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3e8e5013-4d9d-4e23-a4a0-2e1c1132570a tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:00.542355 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3e8e5013-4d9d-4e23-a4a0-2e1c1132570a tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:00.543738 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3e8e5013-4d9d-4e23-a4a0-2e1c1132570a tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:00.544268 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3e8e5013-4d9d-4e23-a4a0-2e1c1132570a tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:00.568179 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f899b510-3995-4788-a414-d9435df3ab6b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:00.569044 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f899b510-3995-4788-a414-d9435df3ab6b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: db296b3f-c053-4988-933b-b5d6673853b4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:00.580089 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f899b510-3995-4788-a414-d9435df3ab6b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:00.580835 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f899b510-3995-4788-a414-d9435df3ab6b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:00.581945 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f899b510-3995-4788-a414-d9435df3ab6b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:00.583485 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f899b510-3995-4788-a414-d9435df3ab6b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:00.839281 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f899b510-3995-4788-a414-d9435df3ab6b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:00.850977 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f899b510-3995-4788-a414-d9435df3ab6b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/db296b3f-c053-4988-933b-b5d6673853b4" status: 200 len: 1317 microversion: 2.1 time: 0.311641 Jun 10 18:08:00.852042 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1535/3165] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:00 2022] GET /compute/v2.1/servers/db296b3f-c053-4988-933b-b5d6673853b4 => generated 1317 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:00.856987 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e9e1404a-2a9f-4185-8932-8a67535da688 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:00.865365 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e9e1404a-2a9f-4185-8932-8a67535da688 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: a6779f56-7475-4ea6-8bd0-91feb2a3c36c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:00.926209 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e9e1404a-2a9f-4185-8932-8a67535da688 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:00.934955 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e9e1404a-2a9f-4185-8932-8a67535da688 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/a6779f56-7475-4ea6-8bd0-91feb2a3c36c" status: 200 len: 1215 microversion: 2.1 time: 0.081552 Jun 10 18:08:00.945846 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1536/3166] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:00 2022] GET /compute/v2.1/servers/a6779f56-7475-4ea6-8bd0-91feb2a3c36c => generated 1215 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:00.953860 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3e8e5013-4d9d-4e23-a4a0-2e1c1132570a tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:00.962653 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3e8e5013-4d9d-4e23-a4a0-2e1c1132570a tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047" status: 200 len: 1334 microversion: 2.1 time: 0.435829 Jun 10 18:08:00.979533 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1631/3167] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:00 2022] GET /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047 => generated 1334 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:00.981275 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-1b71fae5-e7b5-4a93-8914-67c48c64398c req-dc9aa242-3c7f-4269-a31f-ea3819313edb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db296b3f-c053-4988-933b-b5d6673853b4", "tag": "f3da2400-2bb5-4986-a700-9e1b527eaeb5"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:08:01.001038 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-1b71fae5-e7b5-4a93-8914-67c48c64398c req-dc9aa242-3c7f-4269-a31f-ea3819313edb service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:01.001503 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-1b71fae5-e7b5-4a93-8914-67c48c64398c req-dc9aa242-3c7f-4269-a31f-ea3819313edb service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:01.014921 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-1b71fae5-e7b5-4a93-8914-67c48c64398c req-dc9aa242-3c7f-4269-a31f-ea3819313edb service nova] Creating event network-changed:f3da2400-2bb5-4986-a700-9e1b527eaeb5 for instance db296b3f-c053-4988-933b-b5d6673853b4 on chh2-master-2 Jun 10 18:08:01.025054 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-1b71fae5-e7b5-4a93-8914-67c48c64398c req-dc9aa242-3c7f-4269-a31f-ea3819313edb service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046346 Jun 10 18:08:01.026726 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1537/3168] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:08:01.203758 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ed17a9ac-d5ed-4410-8a28-4973f68f9f85 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:01.203758 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ed17a9ac-d5ed-4410-8a28-4973f68f9f85 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:01.214067 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ed17a9ac-d5ed-4410-8a28-4973f68f9f85 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:01.215456 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ed17a9ac-d5ed-4410-8a28-4973f68f9f85 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:01.218290 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ed17a9ac-d5ed-4410-8a28-4973f68f9f85 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:01.219011 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ed17a9ac-d5ed-4410-8a28-4973f68f9f85 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:01.280064 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4deabd1a-c82c-4803-92d4-65a3e395b04c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c610c0d0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:01.340131 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4deabd1a-c82c-4803-92d4-65a3e395b04c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/3c691b7d-1df9-4bde-93bd-492788d2c966" status: 200 len: 1410 microversion: 2.1 time: 0.065417 Jun 10 18:08:01.341334 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1538/3169] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:08:01 2022] GET /compute/v2.1/images/3c691b7d-1df9-4bde-93bd-492788d2c966 => generated 1410 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:08:01.346765 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-36c92f85-0fbd-4ea4-ba40-7024f1a176a7 req-0ef02bfe-28bc-4088-9c8d-cb337b8491c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e727aa8-591d-4232-bf55-d7e8c0ce0047", "name": "network-vif-plugged", "status": "completed", "tag": "85930c63-06f4-4807-8d5f-87244cff2bc3"}, {"server_uuid": "7e727aa8-591d-4232-bf55-d7e8c0ce0047", "name": "network-vif-plugged", "status": "completed", "tag": "5b7c29d6-b930-4a0d-a343-382a08a89e58"}, {"server_uuid": "db296b3f-c053-4988-933b-b5d6673853b4", "name": "network-vif-plugged", "status": "completed", "tag": "f3da2400-2bb5-4986-a700-9e1b527eaeb5"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:08:01.358611 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-36c92f85-0fbd-4ea4-ba40-7024f1a176a7 req-0ef02bfe-28bc-4088-9c8d-cb337b8491c3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:01.372432 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-36c92f85-0fbd-4ea4-ba40-7024f1a176a7 req-0ef02bfe-28bc-4088-9c8d-cb337b8491c3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:01.373323 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-36c92f85-0fbd-4ea4-ba40-7024f1a176a7 req-0ef02bfe-28bc-4088-9c8d-cb337b8491c3 service nova] Creating event network-vif-plugged:85930c63-06f4-4807-8d5f-87244cff2bc3 for instance 7e727aa8-591d-4232-bf55-d7e8c0ce0047 on chh1-master-2 Jun 10 18:08:01.373996 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-36c92f85-0fbd-4ea4-ba40-7024f1a176a7 req-0ef02bfe-28bc-4088-9c8d-cb337b8491c3 service nova] Creating event network-vif-plugged:5b7c29d6-b930-4a0d-a343-382a08a89e58 for instance 7e727aa8-591d-4232-bf55-d7e8c0ce0047 on chh1-master-2 Jun 10 18:08:01.374846 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-36c92f85-0fbd-4ea4-ba40-7024f1a176a7 req-0ef02bfe-28bc-4088-9c8d-cb337b8491c3 service nova] Creating event network-vif-plugged:f3da2400-2bb5-4986-a700-9e1b527eaeb5 for instance db296b3f-c053-4988-933b-b5d6673853b4 on chh2-master-2 Jun 10 18:08:01.394887 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-36c92f85-0fbd-4ea4-ba40-7024f1a176a7 req-0ef02bfe-28bc-4088-9c8d-cb337b8491c3 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.052043 Jun 10 18:08:01.400783 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1539/3170] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:08:01.532877 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2a26b089-7175-45d5-9b1b-9524c22dd935 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:01.533608 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2a26b089-7175-45d5-9b1b-9524c22dd935 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] [instance: 4f169350-57ce-4ea3-bfca-ccf6f1957aa9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:01.552283 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2a26b089-7175-45d5-9b1b-9524c22dd935 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:01.554072 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2a26b089-7175-45d5-9b1b-9524c22dd935 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:01.555520 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2a26b089-7175-45d5-9b1b-9524c22dd935 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:01.557346 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2a26b089-7175-45d5-9b1b-9524c22dd935 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:01.579138 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ed17a9ac-d5ed-4410-8a28-4973f68f9f85 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:01.596646 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ed17a9ac-d5ed-4410-8a28-4973f68f9f85 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1512 microversion: 2.1 time: 0.403182 Jun 10 18:08:01.599339 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1632/3171] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:01 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1512 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:01.869121 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-af4682b3-9c16-468b-ab66-77d96ad088f7 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:01.869756 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-af4682b3-9c16-468b-ab66-77d96ad088f7 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: db296b3f-c053-4988-933b-b5d6673853b4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:01.881135 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-af4682b3-9c16-468b-ab66-77d96ad088f7 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:01.885611 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-af4682b3-9c16-468b-ab66-77d96ad088f7 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:01.886897 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-af4682b3-9c16-468b-ab66-77d96ad088f7 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:01.887813 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-af4682b3-9c16-468b-ab66-77d96ad088f7 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:02.206101 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2a26b089-7175-45d5-9b1b-9524c22dd935 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f463dd5d9140ecb29e0daa415331a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c384e1bab854ad8b4c2ae9ab895cd88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:02.206830 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-af4682b3-9c16-468b-ab66-77d96ad088f7 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:02.213310 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2a26b089-7175-45d5-9b1b-9524c22dd935 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] 10.222.0.35 "GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9" status: 200 len: 1484 microversion: 2.1 time: 0.685471 Jun 10 18:08:02.213915 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1540/3172] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:01 2022] GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9 => generated 1484 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:02.229724 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a5a158b9-88f2-4f21-b13c-78338af98621 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:02.230346 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a5a158b9-88f2-4f21-b13c-78338af98621 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: a6779f56-7475-4ea6-8bd0-91feb2a3c36c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:02.236632 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-af4682b3-9c16-468b-ab66-77d96ad088f7 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/db296b3f-c053-4988-933b-b5d6673853b4" status: 200 len: 1317 microversion: 2.1 time: 0.368476 Jun 10 18:08:02.237577 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a5a158b9-88f2-4f21-b13c-78338af98621 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:02.238294 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a5a158b9-88f2-4f21-b13c-78338af98621 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:02.239945 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a5a158b9-88f2-4f21-b13c-78338af98621 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:02.240727 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a5a158b9-88f2-4f21-b13c-78338af98621 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:02.246473 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1633/3173] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:01 2022] GET /compute/v2.1/servers/db296b3f-c053-4988-933b-b5d6673853b4 => generated 1317 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:02.254072 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b459e505-0111-4cf7-962d-7dc8e051a2c1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:02.255497 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b459e505-0111-4cf7-962d-7dc8e051a2c1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 7e727aa8-591d-4232-bf55-d7e8c0ce0047] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:02.267717 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b459e505-0111-4cf7-962d-7dc8e051a2c1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:02.268543 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b459e505-0111-4cf7-962d-7dc8e051a2c1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:02.269890 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b459e505-0111-4cf7-962d-7dc8e051a2c1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:02.270959 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b459e505-0111-4cf7-962d-7dc8e051a2c1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:02.354748 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a5a158b9-88f2-4f21-b13c-78338af98621 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:02.364155 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a5a158b9-88f2-4f21-b13c-78338af98621 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/a6779f56-7475-4ea6-8bd0-91feb2a3c36c" status: 200 len: 1211 microversion: 2.1 time: 0.148237 Jun 10 18:08:02.375512 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1541/3174] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:02 2022] GET /compute/v2.1/servers/a6779f56-7475-4ea6-8bd0-91feb2a3c36c => generated 1211 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:02.443992 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-115fd2d8-c044-4817-8281-8c6c722e3bf6 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:02.443992 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-115fd2d8-c044-4817-8281-8c6c722e3bf6 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] [instance: 4f169350-57ce-4ea3-bfca-ccf6f1957aa9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:02.443992 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-115fd2d8-c044-4817-8281-8c6c722e3bf6 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:02.443992 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-115fd2d8-c044-4817-8281-8c6c722e3bf6 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:02.443992 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-115fd2d8-c044-4817-8281-8c6c722e3bf6 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:02.443992 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-115fd2d8-c044-4817-8281-8c6c722e3bf6 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:02.484634 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-115fd2d8-c044-4817-8281-8c6c722e3bf6 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] 10.222.0.35 "GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107000 Jun 10 18:08:02.485350 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1542/3175] 10.222.0.35 () {58 vars in 1274 bytes} [Fri Jun 10 18:08:02 2022] GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:08:02.491828 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b459e505-0111-4cf7-962d-7dc8e051a2c1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:02.496432 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8304609a-0b7a-416c-a887-485864be1288 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c0499280>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:02.501222 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b459e505-0111-4cf7-962d-7dc8e051a2c1 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047" status: 200 len: 1334 microversion: 2.1 time: 0.253170 Jun 10 18:08:02.505434 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1634/3176] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:02 2022] GET /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047 => generated 1334 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:02.545136 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8304609a-0b7a-416c-a887-485864be1288 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/3c691b7d-1df9-4bde-93bd-492788d2c966" status: 200 len: 1410 microversion: 2.1 time: 0.052238 Jun 10 18:08:02.545719 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1543/3177] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:08:02 2022] GET /compute/v2.1/images/3c691b7d-1df9-4bde-93bd-492788d2c966 => generated 1410 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:02.615207 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d945d610-7c39-4b79-b567-ff03fcbefcbc tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:02.615907 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d945d610-7c39-4b79-b567-ff03fcbefcbc tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:02.622030 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d945d610-7c39-4b79-b567-ff03fcbefcbc tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:02.622540 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d945d610-7c39-4b79-b567-ff03fcbefcbc tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:02.623329 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d945d610-7c39-4b79-b567-ff03fcbefcbc tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:02.623773 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d945d610-7c39-4b79-b567-ff03fcbefcbc tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:03.255558 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d97d1eb3-1f57-4402-b08a-c12b9b4589a6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:03.256274 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d97d1eb3-1f57-4402-b08a-c12b9b4589a6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: db296b3f-c053-4988-933b-b5d6673853b4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:03.261082 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d945d610-7c39-4b79-b567-ff03fcbefcbc tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:03.266752 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d97d1eb3-1f57-4402-b08a-c12b9b4589a6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:03.269537 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:08:03.271343 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d97d1eb3-1f57-4402-b08a-c12b9b4589a6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:03.276799 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d945d610-7c39-4b79-b567-ff03fcbefcbc tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1512 microversion: 2.1 time: 0.665483 Jun 10 18:08:03.277106 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d97d1eb3-1f57-4402-b08a-c12b9b4589a6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:03.283068 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d97d1eb3-1f57-4402-b08a-c12b9b4589a6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:03.290390 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1635/3178] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:02 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1512 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:03.382780 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-93729f20-5058-48e0-841f-1a3cdfa0b9e9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:03.383575 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-93729f20-5058-48e0-841f-1a3cdfa0b9e9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: a6779f56-7475-4ea6-8bd0-91feb2a3c36c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:03.425531 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-93729f20-5058-48e0-841f-1a3cdfa0b9e9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:03.432489 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-93729f20-5058-48e0-841f-1a3cdfa0b9e9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:03.434406 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-93729f20-5058-48e0-841f-1a3cdfa0b9e9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:03.436671 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-93729f20-5058-48e0-841f-1a3cdfa0b9e9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:03.635706 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-93729f20-5058-48e0-841f-1a3cdfa0b9e9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:03.650254 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-93729f20-5058-48e0-841f-1a3cdfa0b9e9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/a6779f56-7475-4ea6-8bd0-91feb2a3c36c" status: 200 len: 1267 microversion: 2.1 time: 0.272002 Jun 10 18:08:03.650962 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1636/3179] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:03 2022] GET /compute/v2.1/servers/a6779f56-7475-4ea6-8bd0-91feb2a3c36c => generated 1267 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:03.676164 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-98b1feb4-9dfa-4326-ace2-ded86b2bcd72 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:03.676614 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-98b1feb4-9dfa-4326-ace2-ded86b2bcd72 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 7e727aa8-591d-4232-bf55-d7e8c0ce0047] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:03.696098 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-98b1feb4-9dfa-4326-ace2-ded86b2bcd72 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:03.701652 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-98b1feb4-9dfa-4326-ace2-ded86b2bcd72 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:03.702528 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-98b1feb4-9dfa-4326-ace2-ded86b2bcd72 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:03.702987 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-98b1feb4-9dfa-4326-ace2-ded86b2bcd72 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:03.913747 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d97d1eb3-1f57-4402-b08a-c12b9b4589a6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:03.928426 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d97d1eb3-1f57-4402-b08a-c12b9b4589a6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/db296b3f-c053-4988-933b-b5d6673853b4" status: 200 len: 1317 microversion: 2.1 time: 0.675292 Jun 10 18:08:03.929749 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1544/3180] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:03 2022] GET /compute/v2.1/servers/db296b3f-c053-4988-933b-b5d6673853b4 => generated 1317 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:03.944710 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-73e64071-d481-4fa8-8231-c736fbf3e986 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c0b88670>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:04.033252 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-73e64071-d481-4fa8-8231-c736fbf3e986 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/3c691b7d-1df9-4bde-93bd-492788d2c966" status: 200 len: 1410 microversion: 2.1 time: 0.099824 Jun 10 18:08:04.033968 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1545/3181] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:08:03 2022] GET /compute/v2.1/images/3c691b7d-1df9-4bde-93bd-492788d2c966 => generated 1410 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:04.204780 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-98b1feb4-9dfa-4326-ace2-ded86b2bcd72 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:04.224951 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-98b1feb4-9dfa-4326-ace2-ded86b2bcd72 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047" status: 200 len: 1670 microversion: 2.1 time: 0.554192 Jun 10 18:08:04.225837 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1637/3182] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:03 2022] GET /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047 => generated 1670 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:04.247048 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1d802a9e-70b4-4645-9ae9-e3694a5146cb tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:04.252679 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1d802a9e-70b4-4645-9ae9-e3694a5146cb tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 7e727aa8-591d-4232-bf55-d7e8c0ce0047] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:04.269909 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d802a9e-70b4-4645-9ae9-e3694a5146cb tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:04.271278 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d802a9e-70b4-4645-9ae9-e3694a5146cb tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:04.273450 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d802a9e-70b4-4645-9ae9-e3694a5146cb tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:04.277395 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d802a9e-70b4-4645-9ae9-e3694a5146cb tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:04.294923 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6f97b2a3-6905-4f94-9b4d-cf93554ee611 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:04.295916 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6f97b2a3-6905-4f94-9b4d-cf93554ee611 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:04.303573 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6f97b2a3-6905-4f94-9b4d-cf93554ee611 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:04.307297 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6f97b2a3-6905-4f94-9b4d-cf93554ee611 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:04.309540 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6f97b2a3-6905-4f94-9b4d-cf93554ee611 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:04.310817 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6f97b2a3-6905-4f94-9b4d-cf93554ee611 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:04.339325 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1d802a9e-70b4-4645-9ae9-e3694a5146cb tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047/ips" status: 200 len: 180 microversion: 2.1 time: 0.085886 Jun 10 18:08:04.342795 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1546/3183] 10.222.0.35 () {58 vars in 1247 bytes} [Fri Jun 10 18:08:04 2022] GET /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047/ips => generated 180 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:08:04.355908 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-96f65984-6800-4542-831d-4cf066e235bb tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:04.357060 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-96f65984-6800-4542-831d-4cf066e235bb tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 7e727aa8-591d-4232-bf55-d7e8c0ce0047] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:04.366156 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-96f65984-6800-4542-831d-4cf066e235bb tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:04.368951 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-96f65984-6800-4542-831d-4cf066e235bb tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:04.368951 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-96f65984-6800-4542-831d-4cf066e235bb tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:04.368951 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-96f65984-6800-4542-831d-4cf066e235bb tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:04.442679 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-96f65984-6800-4542-831d-4cf066e235bb tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 7e727aa8-591d-4232-bf55-d7e8c0ce0047] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:08:04.791061 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-96f65984-6800-4542-831d-4cf066e235bb tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "DELETE /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047" status: 204 len: 0 microversion: 2.1 time: 0.443609 Jun 10 18:08:04.791853 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1547/3184] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:08:04 2022] DELETE /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:08:04.799593 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9cc73920-9439-4ea0-9e92-5e31dbe7f3ef tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:04.802529 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9cc73920-9439-4ea0-9e92-5e31dbe7f3ef tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: a6779f56-7475-4ea6-8bd0-91feb2a3c36c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:04.821189 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9cc73920-9439-4ea0-9e92-5e31dbe7f3ef tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:04.821756 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9cc73920-9439-4ea0-9e92-5e31dbe7f3ef tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:04.822880 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9cc73920-9439-4ea0-9e92-5e31dbe7f3ef tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:04.823331 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9cc73920-9439-4ea0-9e92-5e31dbe7f3ef tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:04.913656 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6f97b2a3-6905-4f94-9b4d-cf93554ee611 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:04.923708 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6f97b2a3-6905-4f94-9b4d-cf93554ee611 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1512 microversion: 2.1 time: 0.631670 Jun 10 18:08:04.933124 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1638/3185] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:04 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1512 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:08:04.942276 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e46e2cd2-ed7e-4bd0-ad9c-72d24556df7a tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:04.942276 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e46e2cd2-ed7e-4bd0-ad9c-72d24556df7a tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 7e727aa8-591d-4232-bf55-d7e8c0ce0047] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:04.948223 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e46e2cd2-ed7e-4bd0-ad9c-72d24556df7a tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:04.948896 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e46e2cd2-ed7e-4bd0-ad9c-72d24556df7a tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:04.949689 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e46e2cd2-ed7e-4bd0-ad9c-72d24556df7a tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:04.950300 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e46e2cd2-ed7e-4bd0-ad9c-72d24556df7a tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:04.951068 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9cc73920-9439-4ea0-9e92-5e31dbe7f3ef tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:04.995866 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9cc73920-9439-4ea0-9e92-5e31dbe7f3ef tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/a6779f56-7475-4ea6-8bd0-91feb2a3c36c" status: 200 len: 1273 microversion: 2.1 time: 0.202504 Jun 10 18:08:04.997634 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1548/3186] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:04 2022] GET /compute/v2.1/servers/a6779f56-7475-4ea6-8bd0-91feb2a3c36c => generated 1273 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:05.006173 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2eba35f9-ff88-45d1-9a42-80b24373d12c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:05.006924 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2eba35f9-ff88-45d1-9a42-80b24373d12c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: db296b3f-c053-4988-933b-b5d6673853b4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:05.014045 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2eba35f9-ff88-45d1-9a42-80b24373d12c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:05.014589 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2eba35f9-ff88-45d1-9a42-80b24373d12c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:05.016291 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2eba35f9-ff88-45d1-9a42-80b24373d12c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:05.017176 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2eba35f9-ff88-45d1-9a42-80b24373d12c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:05.291308 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2eba35f9-ff88-45d1-9a42-80b24373d12c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:05.299215 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e46e2cd2-ed7e-4bd0-ad9c-72d24556df7a tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:05.299773 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2eba35f9-ff88-45d1-9a42-80b24373d12c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/db296b3f-c053-4988-933b-b5d6673853b4" status: 200 len: 1467 microversion: 2.1 time: 0.300344 Jun 10 18:08:05.300386 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1549/3187] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:04 2022] GET /compute/v2.1/servers/db296b3f-c053-4988-933b-b5d6673853b4 => generated 1467 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:05.308840 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-162c47b7-6a09-48fc-aa24-e9e72ac77799 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c0ce41f0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:05.317320 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e46e2cd2-ed7e-4bd0-ad9c-72d24556df7a tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047" status: 200 len: 1676 microversion: 2.1 time: 0.382641 Jun 10 18:08:05.318224 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1639/3188] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:04 2022] GET /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047 => generated 1676 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:05.406900 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-162c47b7-6a09-48fc-aa24-e9e72ac77799 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/3c691b7d-1df9-4bde-93bd-492788d2c966" status: 200 len: 1419 microversion: 2.1 time: 0.102166 Jun 10 18:08:05.408009 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1550/3189] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:08:05 2022] GET /compute/v2.1/images/3c691b7d-1df9-4bde-93bd-492788d2c966 => generated 1419 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:05.427332 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-84eac0bc-a3c7-411f-8a52-e9d4db0977a9 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:05.428323 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-84eac0bc-a3c7-411f-8a52-e9d4db0977a9 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] [instance: 4f169350-57ce-4ea3-bfca-ccf6f1957aa9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:05.440381 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-84eac0bc-a3c7-411f-8a52-e9d4db0977a9 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:05.441050 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-84eac0bc-a3c7-411f-8a52-e9d4db0977a9 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:05.442065 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-84eac0bc-a3c7-411f-8a52-e9d4db0977a9 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:05.442836 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-84eac0bc-a3c7-411f-8a52-e9d4db0977a9 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:05.544024 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-5d7f3909-bf6e-4797-a22d-b482be9ef890 req-a67b19e4-7c5b-42db-8e81-53525f8d0d47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da4ca117-eaa1-4a19-83ca-3da2766c5f15", "name": "network-vif-plugged", "status": "completed", "tag": "a82f9160-ebd4-4524-8522-95af49c18023"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:08:05.558458 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-5d7f3909-bf6e-4797-a22d-b482be9ef890 req-a67b19e4-7c5b-42db-8e81-53525f8d0d47 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:05.560866 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-5d7f3909-bf6e-4797-a22d-b482be9ef890 req-a67b19e4-7c5b-42db-8e81-53525f8d0d47 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:05.573759 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-5d7f3909-bf6e-4797-a22d-b482be9ef890 req-a67b19e4-7c5b-42db-8e81-53525f8d0d47 service nova] Creating event network-vif-plugged:a82f9160-ebd4-4524-8522-95af49c18023 for instance da4ca117-eaa1-4a19-83ca-3da2766c5f15 on chh2-master-2 Jun 10 18:08:05.581320 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-5d7f3909-bf6e-4797-a22d-b482be9ef890 req-a67b19e4-7c5b-42db-8e81-53525f8d0d47 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.259795 Jun 10 18:08:05.581320 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1640/3190] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:08:05.588511 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d75ccc80-faa9-44d7-a674-570c526335d4 tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:05.589384 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d75ccc80-faa9-44d7-a674-570c526335d4 tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] [instance: db296b3f-c053-4988-933b-b5d6673853b4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:05.597827 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d75ccc80-faa9-44d7-a674-570c526335d4 tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:05.598448 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d75ccc80-faa9-44d7-a674-570c526335d4 tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:05.599511 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d75ccc80-faa9-44d7-a674-570c526335d4 tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:05.600107 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d75ccc80-faa9-44d7-a674-570c526335d4 tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:05.705896 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-84eac0bc-a3c7-411f-8a52-e9d4db0977a9 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f463dd5d9140ecb29e0daa415331a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c384e1bab854ad8b4c2ae9ab895cd88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:05.728590 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-84eac0bc-a3c7-411f-8a52-e9d4db0977a9 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] 10.222.0.35 "GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9" status: 200 len: 1484 microversion: 2.1 time: 0.310413 Jun 10 18:08:05.729832 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1551/3191] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:05 2022] GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9 => generated 1484 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:05.818746 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d75ccc80-faa9-44d7-a674-570c526335d4 tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/db296b3f-c053-4988-933b-b5d6673853b4" status: 200 len: 1618 microversion: 2.1 time: 0.235720 Jun 10 18:08:05.833490 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1641/3192] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:05 2022] GET /compute/v2.1/servers/db296b3f-c053-4988-933b-b5d6673853b4 => generated 1618 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:05.845098 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-18bbc4cb-1635-4506-a341-f681abcf3681 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c0c224c0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:05.895543 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-fec5162f-fe51-480c-9322-972c972f58a6 req-c44f5658-c738-4bc0-9b15-6d5bc307937d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f169350-57ce-4ea3-bfca-ccf6f1957aa9", "tag": "10868c25-7b88-4c10-9a0f-b5344b001642"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:08:05.914178 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-fec5162f-fe51-480c-9322-972c972f58a6 req-c44f5658-c738-4bc0-9b15-6d5bc307937d service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:05.914644 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-fec5162f-fe51-480c-9322-972c972f58a6 req-c44f5658-c738-4bc0-9b15-6d5bc307937d service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:05.943083 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-fec5162f-fe51-480c-9322-972c972f58a6 req-c44f5658-c738-4bc0-9b15-6d5bc307937d service nova] Creating event network-changed:10868c25-7b88-4c10-9a0f-b5344b001642 for instance 4f169350-57ce-4ea3-bfca-ccf6f1957aa9 on chh1-master-2 Jun 10 18:08:05.948505 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-18bbc4cb-1635-4506-a341-f681abcf3681 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/3c691b7d-1df9-4bde-93bd-492788d2c966" status: 200 len: 1419 microversion: 2.1 time: 0.113591 Jun 10 18:08:05.949088 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1642/3193] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:08:05 2022] GET /compute/v2.1/images/3c691b7d-1df9-4bde-93bd-492788d2c966 => generated 1419 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:05.960744 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-fec5162f-fe51-480c-9322-972c972f58a6 req-c44f5658-c738-4bc0-9b15-6d5bc307937d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.227600 Jun 10 18:08:05.962491 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1552/3194] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:08:05.969830 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-efce0d83-8590-4f09-9072-1a1b3b3fa455 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c04cd0d0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:05.970555 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-61a1438d-d2e4-49fa-9bfc-a53f28560081 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:05.971217 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-61a1438d-d2e4-49fa-9bfc-a53f28560081 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:05.986415 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-61a1438d-d2e4-49fa-9bfc-a53f28560081 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:05.987052 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-61a1438d-d2e4-49fa-9bfc-a53f28560081 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:05.990896 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-61a1438d-d2e4-49fa-9bfc-a53f28560081 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:05.993603 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-61a1438d-d2e4-49fa-9bfc-a53f28560081 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:06.349800 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-61a1438d-d2e4-49fa-9bfc-a53f28560081 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:06.362416 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-61a1438d-d2e4-49fa-9bfc-a53f28560081 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1512 microversion: 2.1 time: 0.402421 Jun 10 18:08:06.367398 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1643/3195] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:05 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1512 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:06.371674 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fdca175b-fadd-4f12-9f4a-e97c038355c7 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:06.372500 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fdca175b-fadd-4f12-9f4a-e97c038355c7 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: a6779f56-7475-4ea6-8bd0-91feb2a3c36c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:06.397482 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fdca175b-fadd-4f12-9f4a-e97c038355c7 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:06.398852 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fdca175b-fadd-4f12-9f4a-e97c038355c7 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:06.406482 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fdca175b-fadd-4f12-9f4a-e97c038355c7 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:06.406482 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fdca175b-fadd-4f12-9f4a-e97c038355c7 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:06.656161 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fdca175b-fadd-4f12-9f4a-e97c038355c7 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:06.666379 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fdca175b-fadd-4f12-9f4a-e97c038355c7 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/a6779f56-7475-4ea6-8bd0-91feb2a3c36c" status: 200 len: 1315 microversion: 2.1 time: 0.300372 Jun 10 18:08:06.671494 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1644/3196] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:06 2022] GET /compute/v2.1/servers/a6779f56-7475-4ea6-8bd0-91feb2a3c36c => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:06.683079 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-17ece179-02d6-4310-874b-533de42484b0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1131530947", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "5a7cc611-89ea-4c58-af65-315000f47739"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:08:06.782609 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-17ece179-02d6-4310-874b-533de42484b0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] validate_networks() for None {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:08:07.227766 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-17ece179-02d6-4310-874b-533de42484b0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:08:07.229001 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-17ece179-02d6-4310-874b-533de42484b0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:08:07.230189 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-17ece179-02d6-4310-874b-533de42484b0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:08:07.230987 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-17ece179-02d6-4310-874b-533de42484b0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:08:07.231645 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-17ece179-02d6-4310-874b-533de42484b0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:08:07.243922 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-17ece179-02d6-4310-874b-533de42484b0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:07.244405 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-17ece179-02d6-4310-874b-533de42484b0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:07.245296 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-17ece179-02d6-4310-874b-533de42484b0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:07.246306 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-17ece179-02d6-4310-874b-533de42484b0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:07.277839 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-17ece179-02d6-4310-874b-533de42484b0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Getting quotas for project bb2c4b1067ac4cab8b8565bc987f00b1. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:08:07.283561 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-17ece179-02d6-4310-874b-533de42484b0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Getting quotas for user 9c189471a3ab4ec2b644b3ee1352d4e6 and project bb2c4b1067ac4cab8b8565bc987f00b1. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:08:07.307894 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-17ece179-02d6-4310-874b-533de42484b0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:08:07.311215 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-17ece179-02d6-4310-874b-533de42484b0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 1f619a78-8e18-41fa-bb60-88d513d84cd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:08:07.468455 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-17ece179-02d6-4310-874b-533de42484b0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.795019 Jun 10 18:08:07.469138 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1645/3197] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:08:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:08:07.482218 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-23a78e89-09fb-4376-9f42-471e47316423 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1770076937", "imageRef": "3fb650ed-f4b2-411f-9401-f33c32bb8986", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "e2e99953-8131-4892-9773-097204f8dd0c"}], "security_groups": [{"name": "tempest-securitygroup--618837218"}], "key_name": "tempest-keypair-1035448627", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:08:07.630202 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-efce0d83-8590-4f09-9072-1a1b3b3fa455 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "DELETE /compute/v2.1/images/3c691b7d-1df9-4bde-93bd-492788d2c966" status: 204 len: 0 microversion: 2.1 time: 1.666205 Jun 10 18:08:07.634473 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1553/3198] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:05 2022] DELETE /compute/v2.1/images/3c691b7d-1df9-4bde-93bd-492788d2c966 => generated 0 bytes in 1668 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:08:07.642911 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-810e243f-9c89-4ee7-a3d0-fb8b860ff168 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:07.643847 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-810e243f-9c89-4ee7-a3d0-fb8b860ff168 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 7e727aa8-591d-4232-bf55-d7e8c0ce0047] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:07.652282 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-810e243f-9c89-4ee7-a3d0-fb8b860ff168 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:07.652999 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-810e243f-9c89-4ee7-a3d0-fb8b860ff168 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:07.653946 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-810e243f-9c89-4ee7-a3d0-fb8b860ff168 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:07.654544 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-810e243f-9c89-4ee7-a3d0-fb8b860ff168 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:07.702064 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:08:07.745215 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-23a78e89-09fb-4376-9f42-471e47316423 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] validate_networks() for [('e2e99953-8131-4892-9773-097204f8dd0c', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:08:08.037252 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-810e243f-9c89-4ee7-a3d0-fb8b860ff168 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:08.048580 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-810e243f-9c89-4ee7-a3d0-fb8b860ff168 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047" status: 200 len: 1655 microversion: 2.1 time: 0.408694 Jun 10 18:08:08.058736 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1554/3199] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:07 2022] GET /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047 => generated 1655 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:08.058736 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-26495ada-4655-4d5d-96f1-351b98cd3d90 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:08.059247 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-26495ada-4655-4d5d-96f1-351b98cd3d90 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:08.094140 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-26495ada-4655-4d5d-96f1-351b98cd3d90 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:08.096639 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-26495ada-4655-4d5d-96f1-351b98cd3d90 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:08.102222 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-26495ada-4655-4d5d-96f1-351b98cd3d90 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:08.102853 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-26495ada-4655-4d5d-96f1-351b98cd3d90 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:08.356962 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-26495ada-4655-4d5d-96f1-351b98cd3d90 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:08.374128 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-26495ada-4655-4d5d-96f1-351b98cd3d90 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1507 microversion: 2.1 time: 0.321119 Jun 10 18:08:08.375374 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1555/3200] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:08 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1507 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:08.381534 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-cb15e72c-b7cd-4bcb-87d9-f44b62b6bf1f req-43238dc8-6da1-4558-888a-25a0fa3b1dcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6779f56-7475-4ea6-8bd0-91feb2a3c36c", "tag": "63a7912a-7262-410f-8a70-49e1ece45fd8"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:08:08.399754 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-cb15e72c-b7cd-4bcb-87d9-f44b62b6bf1f req-43238dc8-6da1-4558-888a-25a0fa3b1dcc service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:08.399754 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-cb15e72c-b7cd-4bcb-87d9-f44b62b6bf1f req-43238dc8-6da1-4558-888a-25a0fa3b1dcc service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:08.412109 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-cb15e72c-b7cd-4bcb-87d9-f44b62b6bf1f req-43238dc8-6da1-4558-888a-25a0fa3b1dcc service nova] Creating event network-changed:63a7912a-7262-410f-8a70-49e1ece45fd8 for instance a6779f56-7475-4ea6-8bd0-91feb2a3c36c on chh1-master-2 Jun 10 18:08:08.418142 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-cb15e72c-b7cd-4bcb-87d9-f44b62b6bf1f req-43238dc8-6da1-4558-888a-25a0fa3b1dcc service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040899 Jun 10 18:08:08.425441 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1556/3201] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:08:08.433674 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d6c64c71-213c-44a0-bf81-98112e61fee1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:08.434624 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d6c64c71-213c-44a0-bf81-98112e61fee1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 1f619a78-8e18-41fa-bb60-88d513d84cd8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:08.439758 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-23a78e89-09fb-4376-9f42-471e47316423 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:08:08.440291 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-23a78e89-09fb-4376-9f42-471e47316423 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:08:08.440730 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-23a78e89-09fb-4376-9f42-471e47316423 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:08:08.441331 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-23a78e89-09fb-4376-9f42-471e47316423 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:08:08.441889 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-23a78e89-09fb-4376-9f42-471e47316423 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:08:08.457996 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-23a78e89-09fb-4376-9f42-471e47316423 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:08.458452 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-23a78e89-09fb-4376-9f42-471e47316423 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:08.459267 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-23a78e89-09fb-4376-9f42-471e47316423 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:08.459726 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-23a78e89-09fb-4376-9f42-471e47316423 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:08.488018 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-23a78e89-09fb-4376-9f42-471e47316423 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Getting quotas for project e53380f847a949a0b61c83fc5661d236. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:08:08.499044 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-23a78e89-09fb-4376-9f42-471e47316423 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Getting quotas for user 0c4caa591fe84879a787d0601f2d8445 and project e53380f847a949a0b61c83fc5661d236. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:08:08.505215 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d6c64c71-213c-44a0-bf81-98112e61fee1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:08.511259 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d6c64c71-213c-44a0-bf81-98112e61fee1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/1f619a78-8e18-41fa-bb60-88d513d84cd8" status: 200 len: 1217 microversion: 2.1 time: 0.084268 Jun 10 18:08:08.514483 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1557/3202] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:08 2022] GET /compute/v2.1/servers/1f619a78-8e18-41fa-bb60-88d513d84cd8 => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:08.520032 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-135722de-57b7-4db3-9baa-115bb3ee5940 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:08.521040 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-135722de-57b7-4db3-9baa-115bb3ee5940 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:08.522004 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-23a78e89-09fb-4376-9f42-471e47316423 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:08:08.525779 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-23a78e89-09fb-4376-9f42-471e47316423 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3fb650ed-f4b2-411f-9401-f33c32bb8986',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:08:08.538022 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-135722de-57b7-4db3-9baa-115bb3ee5940 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:08.538492 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-135722de-57b7-4db3-9baa-115bb3ee5940 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:08.539300 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-135722de-57b7-4db3-9baa-115bb3ee5940 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:08.539830 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-135722de-57b7-4db3-9baa-115bb3ee5940 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:08.615260 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-135722de-57b7-4db3-9baa-115bb3ee5940 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:08:08.687027 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-23a78e89-09fb-4376-9f42-471e47316423 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.204921 Jun 10 18:08:08.687027 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1646/3203] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:08:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 1206 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:08:08.687027 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-224f1e65-422d-4c52-b424-82025f7045b2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:08.687027 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-224f1e65-422d-4c52-b424-82025f7045b2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: a6779f56-7475-4ea6-8bd0-91feb2a3c36c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:08.724123 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-224f1e65-422d-4c52-b424-82025f7045b2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:08.727375 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-224f1e65-422d-4c52-b424-82025f7045b2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:08.728991 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-224f1e65-422d-4c52-b424-82025f7045b2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:08.729350 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-224f1e65-422d-4c52-b424-82025f7045b2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:08.949602 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-224f1e65-422d-4c52-b424-82025f7045b2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:08.958156 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-224f1e65-422d-4c52-b424-82025f7045b2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/a6779f56-7475-4ea6-8bd0-91feb2a3c36c" status: 200 len: 1315 microversion: 2.1 time: 0.281244 Jun 10 18:08:08.958738 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1647/3204] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:08 2022] GET /compute/v2.1/servers/a6779f56-7475-4ea6-8bd0-91feb2a3c36c => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:08.965219 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-a0b9cfa1-0e41-43f1-a6be-0b4755b09278 req-175251c7-5d84-4abe-b1c3-a833f941bb70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e727aa8-591d-4232-bf55-d7e8c0ce0047", "name": "network-vif-deleted", "tag": "85930c63-06f4-4807-8d5f-87244cff2bc3"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:08:08.975634 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-a0b9cfa1-0e41-43f1-a6be-0b4755b09278 req-175251c7-5d84-4abe-b1c3-a833f941bb70 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:08.976141 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-a0b9cfa1-0e41-43f1-a6be-0b4755b09278 req-175251c7-5d84-4abe-b1c3-a833f941bb70 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:08.987733 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-a0b9cfa1-0e41-43f1-a6be-0b4755b09278 req-175251c7-5d84-4abe-b1c3-a833f941bb70 service nova] Creating event network-vif-deleted:85930c63-06f4-4807-8d5f-87244cff2bc3 for instance 7e727aa8-591d-4232-bf55-d7e8c0ce0047 on chh1-master-2 Jun 10 18:08:08.992693 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-a0b9cfa1-0e41-43f1-a6be-0b4755b09278 req-175251c7-5d84-4abe-b1c3-a833f941bb70 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032729 Jun 10 18:08:08.993280 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1648/3205] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:08:08.998372 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0371a7a8-c98e-45b3-ae6c-f2ed2eada7f3 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:08.999157 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0371a7a8-c98e-45b3-ae6c-f2ed2eada7f3 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:09.003702 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-135722de-57b7-4db3-9baa-115bb3ee5940 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "DELETE /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b" status: 204 len: 0 microversion: 2.1 time: 0.489020 Jun 10 18:08:09.003702 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1558/3206] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:08:08 2022] DELETE /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b => generated 0 bytes in 490 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:08:09.061617 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0371a7a8-c98e-45b3-ae6c-f2ed2eada7f3 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4caa591fe84879a787d0601f2d8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53380f847a949a0b61c83fc5661d236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:09.069051 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9bc669ee-ee23-4c56-b674-1f41b382885a tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:09.069147 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9bc669ee-ee23-4c56-b674-1f41b382885a tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 7e727aa8-591d-4232-bf55-d7e8c0ce0047] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:09.073448 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0371a7a8-c98e-45b3-ae6c-f2ed2eada7f3 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1" status: 200 len: 1246 microversion: 2.1 time: 0.078967 Jun 10 18:08:09.081406 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9bc669ee-ee23-4c56-b674-1f41b382885a tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:09.082396 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9bc669ee-ee23-4c56-b674-1f41b382885a tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:09.083375 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9bc669ee-ee23-4c56-b674-1f41b382885a tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:09.084711 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1649/3207] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:08 2022] GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1 => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:09.085545 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9bc669ee-ee23-4c56-b674-1f41b382885a tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:09.137460 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-a9e5ffea-379b-49c0-8b24-2227c523e60a req-8ee69ce3-8ff1-4623-a84b-ad956a7a6ffe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "284a4545-1204-4256-a8b5-8d2e1524948b", "name": "network-vif-unplugged", "status": "completed", "tag": "6d10ff2b-6274-42d1-a74b-a9738d45b4d7"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:08:09.162971 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-a9e5ffea-379b-49c0-8b24-2227c523e60a req-8ee69ce3-8ff1-4623-a84b-ad956a7a6ffe service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:09.163434 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-a9e5ffea-379b-49c0-8b24-2227c523e60a req-8ee69ce3-8ff1-4623-a84b-ad956a7a6ffe service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:09.177957 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-a9e5ffea-379b-49c0-8b24-2227c523e60a req-8ee69ce3-8ff1-4623-a84b-ad956a7a6ffe service nova] Creating event network-vif-unplugged:6d10ff2b-6274-42d1-a74b-a9738d45b4d7 for instance 284a4545-1204-4256-a8b5-8d2e1524948b on chh2-master-2 Jun 10 18:08:09.186833 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-a9e5ffea-379b-49c0-8b24-2227c523e60a req-8ee69ce3-8ff1-4623-a84b-ad956a7a6ffe service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053032 Jun 10 18:08:09.186833 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1650/3208] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:08:09.189433 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-04338aca-b249-4488-9d38-7d38fd476740 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-16286223", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "d54e5981-7a3d-42d3-ae71-85d1f7436f39"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:08:09.203583 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:08:09.213270 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9bc669ee-ee23-4c56-b674-1f41b382885a tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:09.222870 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9bc669ee-ee23-4c56-b674-1f41b382885a tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047" status: 200 len: 1613 microversion: 2.1 time: 0.159682 Jun 10 18:08:09.224205 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1559/3209] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:09 2022] GET /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047 => generated 1613 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:09.283816 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-04338aca-b249-4488-9d38-7d38fd476740 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] validate_networks() for [('d54e5981-7a3d-42d3-ae71-85d1f7436f39', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:08:09.396663 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f85a52cc-c7a0-4d70-9c6b-0095d1b4a364 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:09.397531 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f85a52cc-c7a0-4d70-9c6b-0095d1b4a364 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:09.406094 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f85a52cc-c7a0-4d70-9c6b-0095d1b4a364 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:09.407620 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f85a52cc-c7a0-4d70-9c6b-0095d1b4a364 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:09.408878 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f85a52cc-c7a0-4d70-9c6b-0095d1b4a364 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:09.409482 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f85a52cc-c7a0-4d70-9c6b-0095d1b4a364 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:09.630766 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f85a52cc-c7a0-4d70-9c6b-0095d1b4a364 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:09.640551 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f85a52cc-c7a0-4d70-9c6b-0095d1b4a364 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1507 microversion: 2.1 time: 0.248787 Jun 10 18:08:09.646056 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1560/3210] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:09 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1507 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:09.702060 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f4853004-e484-482c-a0a0-1ec4236e18b9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:09.706071 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f4853004-e484-482c-a0a0-1ec4236e18b9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 1f619a78-8e18-41fa-bb60-88d513d84cd8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:09.725625 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f4853004-e484-482c-a0a0-1ec4236e18b9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:09.726085 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f4853004-e484-482c-a0a0-1ec4236e18b9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:09.726894 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f4853004-e484-482c-a0a0-1ec4236e18b9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:09.727785 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f4853004-e484-482c-a0a0-1ec4236e18b9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:09.885574 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f4853004-e484-482c-a0a0-1ec4236e18b9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:09.897938 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f4853004-e484-482c-a0a0-1ec4236e18b9 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/1f619a78-8e18-41fa-bb60-88d513d84cd8" status: 200 len: 1213 microversion: 2.1 time: 0.250497 Jun 10 18:08:09.898549 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1561/3211] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:09 2022] GET /compute/v2.1/servers/1f619a78-8e18-41fa-bb60-88d513d84cd8 => generated 1213 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:09.975816 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cc030bf7-99cd-4068-81cd-6bfb30fdf0ac tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:09.976742 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cc030bf7-99cd-4068-81cd-6bfb30fdf0ac tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: a6779f56-7475-4ea6-8bd0-91feb2a3c36c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:09.991487 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc030bf7-99cd-4068-81cd-6bfb30fdf0ac tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:09.993673 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc030bf7-99cd-4068-81cd-6bfb30fdf0ac tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:09.997634 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc030bf7-99cd-4068-81cd-6bfb30fdf0ac tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:09.998469 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc030bf7-99cd-4068-81cd-6bfb30fdf0ac tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:10.180345 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cc030bf7-99cd-4068-81cd-6bfb30fdf0ac tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:10.195114 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cc030bf7-99cd-4068-81cd-6bfb30fdf0ac tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/a6779f56-7475-4ea6-8bd0-91feb2a3c36c" status: 200 len: 1315 microversion: 2.1 time: 0.222349 Jun 10 18:08:10.196481 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1562/3212] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:09 2022] GET /compute/v2.1/servers/a6779f56-7475-4ea6-8bd0-91feb2a3c36c => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:10.201780 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d2d3205b-56da-4c15-bf8a-fec551d9bd3e tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:10.202403 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d2d3205b-56da-4c15-bf8a-fec551d9bd3e tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:10.281385 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-04338aca-b249-4488-9d38-7d38fd476740 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:08:10.281936 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-04338aca-b249-4488-9d38-7d38fd476740 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:08:10.282526 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-04338aca-b249-4488-9d38-7d38fd476740 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:08:10.283058 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-04338aca-b249-4488-9d38-7d38fd476740 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:08:10.283535 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-04338aca-b249-4488-9d38-7d38fd476740 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:08:10.297359 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-04338aca-b249-4488-9d38-7d38fd476740 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:10.297876 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d2d3205b-56da-4c15-bf8a-fec551d9bd3e tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4caa591fe84879a787d0601f2d8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53380f847a949a0b61c83fc5661d236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:10.298558 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-04338aca-b249-4488-9d38-7d38fd476740 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:10.299628 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-04338aca-b249-4488-9d38-7d38fd476740 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:10.300402 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-04338aca-b249-4488-9d38-7d38fd476740 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:10.313658 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d2d3205b-56da-4c15-bf8a-fec551d9bd3e tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1" status: 200 len: 1246 microversion: 2.1 time: 0.110168 Jun 10 18:08:10.313658 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1563/3213] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:10 2022] GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1 => generated 1246 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:10.318159 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d7a994f8-256b-4fe7-93fa-17a1062c35ca tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:10.319018 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d7a994f8-256b-4fe7-93fa-17a1062c35ca tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 7e727aa8-591d-4232-bf55-d7e8c0ce0047] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:10.327285 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-04338aca-b249-4488-9d38-7d38fd476740 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Getting quotas for project af241982b5884c22b5e7103f1ea4b8ef. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:08:10.335234 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-04338aca-b249-4488-9d38-7d38fd476740 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Getting quotas for user 8adb0ac9df46461489fa6bd3951417cf and project af241982b5884c22b5e7103f1ea4b8ef. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:08:10.338318 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d7a994f8-256b-4fe7-93fa-17a1062c35ca tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:10.338784 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d7a994f8-256b-4fe7-93fa-17a1062c35ca tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:10.344500 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d7a994f8-256b-4fe7-93fa-17a1062c35ca tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:10.344606 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d7a994f8-256b-4fe7-93fa-17a1062c35ca tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:10.402295 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-04338aca-b249-4488-9d38-7d38fd476740 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:08:10.412185 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-04338aca-b249-4488-9d38-7d38fd476740 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 289cf5c3-10c7-4a83-94d9-d83623d0c5e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:08:10.418285 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d7a994f8-256b-4fe7-93fa-17a1062c35ca tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:10.421669 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d7a994f8-256b-4fe7-93fa-17a1062c35ca tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:10.421669 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-d7a994f8-256b-4fe7-93fa-17a1062c35ca tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lazy-loading 'fault' on Instance uuid 7e727aa8-591d-4232-bf55-d7e8c0ce0047 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:08:10.483120 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d7a994f8-256b-4fe7-93fa-17a1062c35ca tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d61eddc0c334ec79e23a069a422fad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818440b6c7d34e09a1afd8a6e0c0b3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:10.496852 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d7a994f8-256b-4fe7-93fa-17a1062c35ca tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047" status: 200 len: 1303 microversion: 2.1 time: 0.182067 Jun 10 18:08:10.498071 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1564/3214] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:10 2022] GET /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047 => generated 1303 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:10.614641 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-04338aca-b249-4488-9d38-7d38fd476740 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.429884 Jun 10 18:08:10.620948 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1651/3215] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:08:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1437 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:08:10.627602 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-30df4102-bfe3-42c5-8f8c-5e69c4d5dd67 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:10.629161 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-30df4102-bfe3-42c5-8f8c-5e69c4d5dd67 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 289cf5c3-10c7-4a83-94d9-d83623d0c5e7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:10.658473 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-87998d85-23f8-4f9b-acfa-ed9107af7b69 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:10.662933 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-87998d85-23f8-4f9b-acfa-ed9107af7b69 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:10.729626 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-87998d85-23f8-4f9b-acfa-ed9107af7b69 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:10.730949 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-87998d85-23f8-4f9b-acfa-ed9107af7b69 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:10.737377 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-87998d85-23f8-4f9b-acfa-ed9107af7b69 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:10.740222 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-87998d85-23f8-4f9b-acfa-ed9107af7b69 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:10.970142 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-30df4102-bfe3-42c5-8f8c-5e69c4d5dd67 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:10.977761 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-30df4102-bfe3-42c5-8f8c-5e69c4d5dd67 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7" status: 200 len: 1206 microversion: 2.1 time: 0.355163 Jun 10 18:08:10.983220 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1565/3216] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:10 2022] GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7 => generated 1206 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:08:11.004440 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4699a841-390a-49bf-959f-ad9f8d85e60d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:11.006381 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4699a841-390a-49bf-959f-ad9f8d85e60d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 1f619a78-8e18-41fa-bb60-88d513d84cd8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:11.013599 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4699a841-390a-49bf-959f-ad9f8d85e60d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:11.016354 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4699a841-390a-49bf-959f-ad9f8d85e60d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:11.017206 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4699a841-390a-49bf-959f-ad9f8d85e60d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:11.017745 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4699a841-390a-49bf-959f-ad9f8d85e60d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:11.252608 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4699a841-390a-49bf-959f-ad9f8d85e60d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:11.274833 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4699a841-390a-49bf-959f-ad9f8d85e60d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/1f619a78-8e18-41fa-bb60-88d513d84cd8" status: 200 len: 1277 microversion: 2.1 time: 0.290455 Jun 10 18:08:11.275437 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1566/3217] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:10 2022] GET /compute/v2.1/servers/1f619a78-8e18-41fa-bb60-88d513d84cd8 => generated 1277 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:11.286159 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4822365f-45b2-43e4-a82e-77037d54b352 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:11.286791 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4822365f-45b2-43e4-a82e-77037d54b352 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: a6779f56-7475-4ea6-8bd0-91feb2a3c36c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:11.339567 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4822365f-45b2-43e4-a82e-77037d54b352 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:11.340577 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4822365f-45b2-43e4-a82e-77037d54b352 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:11.345321 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4822365f-45b2-43e4-a82e-77037d54b352 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:11.346843 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4822365f-45b2-43e4-a82e-77037d54b352 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:11.460277 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-87998d85-23f8-4f9b-acfa-ed9107af7b69 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:11.477519 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-87998d85-23f8-4f9b-acfa-ed9107af7b69 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1507 microversion: 2.1 time: 0.822647 Jun 10 18:08:11.479183 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1652/3218] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:10 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1507 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:11.487249 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e59a0ad0-e1b8-4405-a282-c3383823ae7a tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:11.488572 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e59a0ad0-e1b8-4405-a282-c3383823ae7a tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:11.500411 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e59a0ad0-e1b8-4405-a282-c3383823ae7a tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:11.501204 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e59a0ad0-e1b8-4405-a282-c3383823ae7a tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:11.502220 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e59a0ad0-e1b8-4405-a282-c3383823ae7a tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:11.503627 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e59a0ad0-e1b8-4405-a282-c3383823ae7a tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:11.613911 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e59a0ad0-e1b8-4405-a282-c3383823ae7a tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4caa591fe84879a787d0601f2d8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53380f847a949a0b61c83fc5661d236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:11.624012 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e59a0ad0-e1b8-4405-a282-c3383823ae7a tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1" status: 200 len: 1298 microversion: 2.1 time: 0.143198 Jun 10 18:08:11.625152 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1653/3219] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:11 2022] GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1 => generated 1298 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:11.630217 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-bb0def22-6764-4734-b191-689a37aca969 req-8e256967-9888-492f-ad51-8c9634acf38a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e727aa8-591d-4232-bf55-d7e8c0ce0047", "name": "network-vif-deleted", "tag": "5b7c29d6-b930-4a0d-a343-382a08a89e58"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:08:11.639596 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-bb0def22-6764-4734-b191-689a37aca969 req-8e256967-9888-492f-ad51-8c9634acf38a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:11.640567 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-bb0def22-6764-4734-b191-689a37aca969 req-8e256967-9888-492f-ad51-8c9634acf38a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:11.660693 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-bb0def22-6764-4734-b191-689a37aca969 req-8e256967-9888-492f-ad51-8c9634acf38a service nova] Creating event network-vif-deleted:5b7c29d6-b930-4a0d-a343-382a08a89e58 for instance 7e727aa8-591d-4232-bf55-d7e8c0ce0047 on chh1-master-2 Jun 10 18:08:11.667353 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-bb0def22-6764-4734-b191-689a37aca969 req-8e256967-9888-492f-ad51-8c9634acf38a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040626 Jun 10 18:08:11.668344 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1654/3220] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:08:11.676546 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-05fefc4c-b778-461f-90de-4f7f2fbe45e4 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:11.676546 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-05fefc4c-b778-461f-90de-4f7f2fbe45e4 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 7e727aa8-591d-4232-bf55-d7e8c0ce0047] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:11.682375 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-05fefc4c-b778-461f-90de-4f7f2fbe45e4 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:11.685871 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-05fefc4c-b778-461f-90de-4f7f2fbe45e4 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:11.685871 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-05fefc4c-b778-461f-90de-4f7f2fbe45e4 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:11.685871 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-05fefc4c-b778-461f-90de-4f7f2fbe45e4 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:11.701355 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-05fefc4c-b778-461f-90de-4f7f2fbe45e4 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] HTTP exception thrown: Instance 7e727aa8-591d-4232-bf55-d7e8c0ce0047 could not be found. Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-05fefc4c-b778-461f-90de-4f7f2fbe45e4 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Request method failure captured: Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047 HTTP/1.1 Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4gJTZlKpxqln8lKC9Kk_1a-omRv696X6tGCmr-BNFyfScay85WTbCpW3KUrWzOFJfrP0SdxxRWfcHRbOzg7E4AwwPL-KIhggFrJa3mAbCig37CGigRqqBhDtgWJ_8f_RkZysWT-wKl28gaxKI9jcBhlt-V6MsVpjeFF20icX5AihhY Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 818440b6c7d34e09a1afd8a6e0c0b3ed Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersTestMultiNic-255908356 Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/818440b6c7d34e09a1afd8a6e0c0b3ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/818440b6c7d34e09a1afd8a6e0c0b3ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/818440b6c7d34e09a1afd8a6e0c0b3ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_818440b6c7d34e09a1afd8a6e0c0b3ed", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersTestMultiNic-255908356 Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 818440b6c7d34e09a1afd8a6e0c0b3ed Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersTestMultiNic-255908356 Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersTestMultiNic-255908356-project Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 1d61eddc0c334ec79e23a069a422fad8 Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersTestMultiNic-255908356-project Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 7e727aa8-591d-4232-bf55-d7e8c0ce0047 could not be found. Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '7e727aa8-591d-4232-bf55-d7e8c0ce0047'} Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e727aa8-591d-4232-bf55-d7e8c0ce0047 could not be found. Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e727aa8-591d-4232-bf55-d7e8c0ce0047 could not be found. Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:08:11.704640 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:08:11.708539 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:08:11.708539 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:08:11.708539 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:08:11.708539 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:08:11.708539 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:08:11.708539 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e727aa8-591d-4232-bf55-d7e8c0ce0047 could not be found. Jun 10 18:08:11.708539 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:08:11.708539 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-05fefc4c-b778-461f-90de-4f7f2fbe45e4 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Returning 404 to user: Instance 7e727aa8-591d-4232-bf55-d7e8c0ce0047 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:08:11.708539 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-05fefc4c-b778-461f-90de-4f7f2fbe45e4 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047" status: 404 len: 111 microversion: 2.1 time: 0.035279 Jun 10 18:08:11.708539 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1655/3221] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:11 2022] GET /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:08:12.004068 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e596abfd-a858-4c7c-8bfd-49034b46dd4c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:12.007760 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e596abfd-a858-4c7c-8bfd-49034b46dd4c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 289cf5c3-10c7-4a83-94d9-d83623d0c5e7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:12.029451 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e596abfd-a858-4c7c-8bfd-49034b46dd4c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:12.032815 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e596abfd-a858-4c7c-8bfd-49034b46dd4c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:12.034648 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e596abfd-a858-4c7c-8bfd-49034b46dd4c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:12.035182 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e596abfd-a858-4c7c-8bfd-49034b46dd4c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:12.177972 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e596abfd-a858-4c7c-8bfd-49034b46dd4c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:12.188262 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e596abfd-a858-4c7c-8bfd-49034b46dd4c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7" status: 200 len: 1210 microversion: 2.1 time: 0.189760 Jun 10 18:08:12.189623 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1656/3222] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:11 2022] GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7 => generated 1210 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:12.294402 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2f740ac8-1535-48fb-a908-e812ab2c7602 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:12.295040 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2f740ac8-1535-48fb-a908-e812ab2c7602 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 1f619a78-8e18-41fa-bb60-88d513d84cd8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:12.310176 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2f740ac8-1535-48fb-a908-e812ab2c7602 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:12.310645 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2f740ac8-1535-48fb-a908-e812ab2c7602 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:12.311497 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2f740ac8-1535-48fb-a908-e812ab2c7602 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:12.312499 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2f740ac8-1535-48fb-a908-e812ab2c7602 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:12.467701 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2f740ac8-1535-48fb-a908-e812ab2c7602 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:12.473095 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4822365f-45b2-43e4-a82e-77037d54b352 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:12.491825 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4822365f-45b2-43e4-a82e-77037d54b352 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/a6779f56-7475-4ea6-8bd0-91feb2a3c36c" status: 200 len: 1315 microversion: 2.1 time: 1.202809 Jun 10 18:08:12.493934 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1567/3223] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:11 2022] GET /compute/v2.1/servers/a6779f56-7475-4ea6-8bd0-91feb2a3c36c => generated 1315 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:12.510994 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2f740ac8-1535-48fb-a908-e812ab2c7602 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/1f619a78-8e18-41fa-bb60-88d513d84cd8" status: 200 len: 1275 microversion: 2.1 time: 0.218617 Jun 10 18:08:12.513329 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1657/3224] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:12 2022] GET /compute/v2.1/servers/1f619a78-8e18-41fa-bb60-88d513d84cd8 => generated 1275 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:12.534759 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-63744bc7-ff11-44f0-bb80-1e538f6b163c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:12.539491 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-63744bc7-ff11-44f0-bb80-1e538f6b163c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:12.555711 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:08:12.560259 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-63744bc7-ff11-44f0-bb80-1e538f6b163c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:12.560934 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-63744bc7-ff11-44f0-bb80-1e538f6b163c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:12.564675 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-63744bc7-ff11-44f0-bb80-1e538f6b163c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:12.565515 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-63744bc7-ff11-44f0-bb80-1e538f6b163c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:12.646211 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-94b096f7-f0af-4710-8e42-5a37e937b1c8 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:12.646892 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-94b096f7-f0af-4710-8e42-5a37e937b1c8 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:12.664696 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-94b096f7-f0af-4710-8e42-5a37e937b1c8 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:12.665160 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-94b096f7-f0af-4710-8e42-5a37e937b1c8 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:12.666046 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-94b096f7-f0af-4710-8e42-5a37e937b1c8 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:12.666374 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-94b096f7-f0af-4710-8e42-5a37e937b1c8 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:12.787159 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-94b096f7-f0af-4710-8e42-5a37e937b1c8 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4caa591fe84879a787d0601f2d8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53380f847a949a0b61c83fc5661d236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:12.796778 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-94b096f7-f0af-4710-8e42-5a37e937b1c8 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1" status: 200 len: 1316 microversion: 2.1 time: 0.158956 Jun 10 18:08:12.807572 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1658/3225] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:12 2022] GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1 => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:12.928116 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-2872d564-7b52-4372-85bc-36f93455299d req-53c742f8-2c52-47c0-8cae-fae57ea1991d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6779f56-7475-4ea6-8bd0-91feb2a3c36c", "name": "network-vif-plugged", "status": "completed", "tag": "63a7912a-7262-410f-8a70-49e1ece45fd8"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:08:12.963576 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-2872d564-7b52-4372-85bc-36f93455299d req-53c742f8-2c52-47c0-8cae-fae57ea1991d service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:12.964022 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-2872d564-7b52-4372-85bc-36f93455299d req-53c742f8-2c52-47c0-8cae-fae57ea1991d service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:12.987645 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-2872d564-7b52-4372-85bc-36f93455299d req-53c742f8-2c52-47c0-8cae-fae57ea1991d service nova] Creating event network-vif-plugged:63a7912a-7262-410f-8a70-49e1ece45fd8 for instance a6779f56-7475-4ea6-8bd0-91feb2a3c36c on chh1-master-2 Jun 10 18:08:13.005117 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-2872d564-7b52-4372-85bc-36f93455299d req-53c742f8-2c52-47c0-8cae-fae57ea1991d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080490 Jun 10 18:08:13.007412 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1659/3226] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:08:13.206621 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-403b0402-9511-4714-b353-2ddc28b13c10 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:13.208441 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-403b0402-9511-4714-b353-2ddc28b13c10 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 289cf5c3-10c7-4a83-94d9-d83623d0c5e7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:13.225757 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-403b0402-9511-4714-b353-2ddc28b13c10 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:13.226484 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-403b0402-9511-4714-b353-2ddc28b13c10 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:13.227460 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-403b0402-9511-4714-b353-2ddc28b13c10 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:13.231173 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-403b0402-9511-4714-b353-2ddc28b13c10 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:13.293496 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:08:13.404338 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-403b0402-9511-4714-b353-2ddc28b13c10 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:13.414645 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-403b0402-9511-4714-b353-2ddc28b13c10 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7" status: 200 len: 1258 microversion: 2.1 time: 0.212645 Jun 10 18:08:13.428733 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1660/3227] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:13 2022] GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7 => generated 1258 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:08:13.510488 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1016ceb0-4f14-4aa0-8a49-02dd64d95903 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:13.511976 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1016ceb0-4f14-4aa0-8a49-02dd64d95903 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: a6779f56-7475-4ea6-8bd0-91feb2a3c36c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:13.524631 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1016ceb0-4f14-4aa0-8a49-02dd64d95903 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:13.528297 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1016ceb0-4f14-4aa0-8a49-02dd64d95903 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:13.528297 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1016ceb0-4f14-4aa0-8a49-02dd64d95903 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:13.528297 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1016ceb0-4f14-4aa0-8a49-02dd64d95903 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:13.628908 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-63744bc7-ff11-44f0-bb80-1e538f6b163c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:13.640892 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-63744bc7-ff11-44f0-bb80-1e538f6b163c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1507 microversion: 2.1 time: 1.143638 Jun 10 18:08:13.642231 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1568/3228] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:12 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1507 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:13.648839 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-47ea8f4b-4a30-4090-9832-1c09138d95a8 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:13.649795 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-47ea8f4b-4a30-4090-9832-1c09138d95a8 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 1f619a78-8e18-41fa-bb60-88d513d84cd8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:13.671758 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-47ea8f4b-4a30-4090-9832-1c09138d95a8 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:13.673165 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-47ea8f4b-4a30-4090-9832-1c09138d95a8 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:13.674897 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-47ea8f4b-4a30-4090-9832-1c09138d95a8 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:13.675554 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-47ea8f4b-4a30-4090-9832-1c09138d95a8 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:14.188511 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1016ceb0-4f14-4aa0-8a49-02dd64d95903 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:14.200940 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1016ceb0-4f14-4aa0-8a49-02dd64d95903 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/a6779f56-7475-4ea6-8bd0-91feb2a3c36c" status: 200 len: 1315 microversion: 2.1 time: 0.690002 Jun 10 18:08:14.201646 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1661/3229] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:13 2022] GET /compute/v2.1/servers/a6779f56-7475-4ea6-8bd0-91feb2a3c36c => generated 1315 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:08:14.219753 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f645dc53-700d-461f-8b09-a08e7b4da091 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:14.220748 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f645dc53-700d-461f-8b09-a08e7b4da091 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:14.234668 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f645dc53-700d-461f-8b09-a08e7b4da091 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:14.236901 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f645dc53-700d-461f-8b09-a08e7b4da091 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:14.239528 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f645dc53-700d-461f-8b09-a08e7b4da091 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:14.240688 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f645dc53-700d-461f-8b09-a08e7b4da091 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:14.371603 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-47ea8f4b-4a30-4090-9832-1c09138d95a8 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:14.383846 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-47ea8f4b-4a30-4090-9832-1c09138d95a8 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/1f619a78-8e18-41fa-bb60-88d513d84cd8" status: 200 len: 1275 microversion: 2.1 time: 0.739923 Jun 10 18:08:14.389379 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1569/3230] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:13 2022] GET /compute/v2.1/servers/1f619a78-8e18-41fa-bb60-88d513d84cd8 => generated 1275 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:14.440838 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f645dc53-700d-461f-8b09-a08e7b4da091 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4caa591fe84879a787d0601f2d8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53380f847a949a0b61c83fc5661d236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:14.454421 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-aed44d65-69c5-4394-975c-3301cc8bead5 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:14.455204 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-aed44d65-69c5-4394-975c-3301cc8bead5 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 289cf5c3-10c7-4a83-94d9-d83623d0c5e7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:14.475366 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f645dc53-700d-461f-8b09-a08e7b4da091 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1" status: 200 len: 1304 microversion: 2.1 time: 0.272156 Jun 10 18:08:14.475986 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1662/3231] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:14 2022] GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1 => generated 1304 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:14.477386 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aed44d65-69c5-4394-975c-3301cc8bead5 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:14.479720 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aed44d65-69c5-4394-975c-3301cc8bead5 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:14.480794 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aed44d65-69c5-4394-975c-3301cc8bead5 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:14.491550 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aed44d65-69c5-4394-975c-3301cc8bead5 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:14.645910 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-0069e9f8-eb55-4e94-a8ed-6d824b4ce287 req-bca74c13-8239-4b5e-9a1c-5b77522743de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "284a4545-1204-4256-a8b5-8d2e1524948b", "name": "network-vif-deleted", "tag": "6d10ff2b-6274-42d1-a74b-a9738d45b4d7"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:08:14.667544 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-0069e9f8-eb55-4e94-a8ed-6d824b4ce287 req-bca74c13-8239-4b5e-9a1c-5b77522743de service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:14.669057 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-0069e9f8-eb55-4e94-a8ed-6d824b4ce287 req-bca74c13-8239-4b5e-9a1c-5b77522743de service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:14.701793 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-0069e9f8-eb55-4e94-a8ed-6d824b4ce287 req-bca74c13-8239-4b5e-9a1c-5b77522743de service nova] Creating event network-vif-deleted:6d10ff2b-6274-42d1-a74b-a9738d45b4d7 for instance 284a4545-1204-4256-a8b5-8d2e1524948b on chh2-master-2 Jun 10 18:08:14.707260 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-aed44d65-69c5-4394-975c-3301cc8bead5 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:14.713808 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-0069e9f8-eb55-4e94-a8ed-6d824b4ce287 req-bca74c13-8239-4b5e-9a1c-5b77522743de service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083704 Jun 10 18:08:14.717017 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1663/3232] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:08:14.724223 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-90d25419-ea55-4e13-ad02-d638756c57b0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:14.724814 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-aed44d65-69c5-4394-975c-3301cc8bead5 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7" status: 200 len: 1264 microversion: 2.1 time: 0.276261 Jun 10 18:08:14.725741 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1570/3233] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:14 2022] GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7 => generated 1264 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:08:14.726538 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-90d25419-ea55-4e13-ad02-d638756c57b0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:14.739861 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90d25419-ea55-4e13-ad02-d638756c57b0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:14.741725 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90d25419-ea55-4e13-ad02-d638756c57b0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:14.743494 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90d25419-ea55-4e13-ad02-d638756c57b0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:14.744210 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90d25419-ea55-4e13-ad02-d638756c57b0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:15.067179 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-90d25419-ea55-4e13-ad02-d638756c57b0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:15.092023 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-90d25419-ea55-4e13-ad02-d638756c57b0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1507 microversion: 2.1 time: 0.373128 Jun 10 18:08:15.093998 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1664/3234] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:14 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1507 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:15.219767 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c0b506c8-44eb-4ec3-98da-5107e30e3a7f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:15.222321 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c0b506c8-44eb-4ec3-98da-5107e30e3a7f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: a6779f56-7475-4ea6-8bd0-91feb2a3c36c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:15.232106 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c0b506c8-44eb-4ec3-98da-5107e30e3a7f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:15.250060 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c0b506c8-44eb-4ec3-98da-5107e30e3a7f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:15.251379 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c0b506c8-44eb-4ec3-98da-5107e30e3a7f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:15.252145 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c0b506c8-44eb-4ec3-98da-5107e30e3a7f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:15.410886 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4f7d7047-d8d5-4b0e-a416-7bce37740eb0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:15.411489 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4f7d7047-d8d5-4b0e-a416-7bce37740eb0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 1f619a78-8e18-41fa-bb60-88d513d84cd8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:15.443972 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4f7d7047-d8d5-4b0e-a416-7bce37740eb0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:15.453499 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4f7d7047-d8d5-4b0e-a416-7bce37740eb0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:15.455054 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4f7d7047-d8d5-4b0e-a416-7bce37740eb0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:15.455520 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4f7d7047-d8d5-4b0e-a416-7bce37740eb0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:15.966007 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4f7d7047-d8d5-4b0e-a416-7bce37740eb0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:15.977282 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4f7d7047-d8d5-4b0e-a416-7bce37740eb0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/1f619a78-8e18-41fa-bb60-88d513d84cd8" status: 200 len: 1317 microversion: 2.1 time: 0.572352 Jun 10 18:08:15.989712 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1665/3235] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:15 2022] GET /compute/v2.1/servers/1f619a78-8e18-41fa-bb60-88d513d84cd8 => generated 1317 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:16.003978 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0601e632-3529-4a12-a648-a771a6fea720 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:16.004655 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0601e632-3529-4a12-a648-a771a6fea720 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:16.033450 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0601e632-3529-4a12-a648-a771a6fea720 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:16.033933 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0601e632-3529-4a12-a648-a771a6fea720 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:16.034771 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0601e632-3529-4a12-a648-a771a6fea720 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:16.035228 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0601e632-3529-4a12-a648-a771a6fea720 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:16.225078 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c0b506c8-44eb-4ec3-98da-5107e30e3a7f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:16.245323 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c0b506c8-44eb-4ec3-98da-5107e30e3a7f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/a6779f56-7475-4ea6-8bd0-91feb2a3c36c" status: 200 len: 1501 microversion: 2.1 time: 1.027137 Jun 10 18:08:16.247395 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1571/3236] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:15 2022] GET /compute/v2.1/servers/a6779f56-7475-4ea6-8bd0-91feb2a3c36c => generated 1501 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:16.267166 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-47c1568b-56be-4611-a82b-401d4b62e320 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:16.267804 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-47c1568b-56be-4611-a82b-401d4b62e320 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 289cf5c3-10c7-4a83-94d9-d83623d0c5e7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:16.292605 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-47c1568b-56be-4611-a82b-401d4b62e320 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:16.292605 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-47c1568b-56be-4611-a82b-401d4b62e320 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:16.292605 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-47c1568b-56be-4611-a82b-401d4b62e320 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:16.292605 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-47c1568b-56be-4611-a82b-401d4b62e320 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:16.356004 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0601e632-3529-4a12-a648-a771a6fea720 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4caa591fe84879a787d0601f2d8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53380f847a949a0b61c83fc5661d236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:16.366838 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0601e632-3529-4a12-a648-a771a6fea720 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1" status: 200 len: 1371 microversion: 2.1 time: 0.375580 Jun 10 18:08:16.368914 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1666/3237] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:15 2022] GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1 => generated 1371 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:16.381093 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9f275076-f497-4ec6-bdbe-b683f7ae268e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:16.382089 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9f275076-f497-4ec6-bdbe-b683f7ae268e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:16.395075 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9f275076-f497-4ec6-bdbe-b683f7ae268e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:16.396456 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9f275076-f497-4ec6-bdbe-b683f7ae268e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:16.398818 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9f275076-f497-4ec6-bdbe-b683f7ae268e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:16.400707 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9f275076-f497-4ec6-bdbe-b683f7ae268e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:17.353648 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9f275076-f497-4ec6-bdbe-b683f7ae268e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:17.354784 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-47c1568b-56be-4611-a82b-401d4b62e320 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:17.358785 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:08:17.367849 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9f275076-f497-4ec6-bdbe-b683f7ae268e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1507 microversion: 2.1 time: 0.997663 Jun 10 18:08:17.380864 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-47c1568b-56be-4611-a82b-401d4b62e320 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7" status: 200 len: 1306 microversion: 2.1 time: 1.117306 Jun 10 18:08:17.381102 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1667/3238] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:16 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1507 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:17.381202 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1572/3239] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:16 2022] GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7 => generated 1306 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:17.392386 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e07c5297-181b-480e-aedc-c37bda019136 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:17.393846 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e07c5297-181b-480e-aedc-c37bda019136 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 1f619a78-8e18-41fa-bb60-88d513d84cd8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:17.400821 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f8b099e9-5bb7-409e-8ae5-b5c30b519f4a tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:17.401345 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f8b099e9-5bb7-409e-8ae5-b5c30b519f4a tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: a6779f56-7475-4ea6-8bd0-91feb2a3c36c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:17.418840 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f8b099e9-5bb7-409e-8ae5-b5c30b519f4a tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:17.419139 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f8b099e9-5bb7-409e-8ae5-b5c30b519f4a tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:17.419933 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f8b099e9-5bb7-409e-8ae5-b5c30b519f4a tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:17.421866 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f8b099e9-5bb7-409e-8ae5-b5c30b519f4a tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:17.432928 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e07c5297-181b-480e-aedc-c37bda019136 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:17.433715 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e07c5297-181b-480e-aedc-c37bda019136 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:17.436386 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e07c5297-181b-480e-aedc-c37bda019136 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:17.437026 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e07c5297-181b-480e-aedc-c37bda019136 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:17.523370 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f8b099e9-5bb7-409e-8ae5-b5c30b519f4a tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: a6779f56-7475-4ea6-8bd0-91feb2a3c36c] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:08:17.905927 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f8b099e9-5bb7-409e-8ae5-b5c30b519f4a tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "DELETE /compute/v2.1/servers/a6779f56-7475-4ea6-8bd0-91feb2a3c36c" status: 204 len: 0 microversion: 2.1 time: 0.522861 Jun 10 18:08:17.910892 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1668/3240] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:08:17 2022] DELETE /compute/v2.1/servers/a6779f56-7475-4ea6-8bd0-91feb2a3c36c => generated 0 bytes in 536 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:08:17.945877 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-24f01662-5ba9-495d-86c0-42de66bfff38 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:17.948039 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-24f01662-5ba9-495d-86c0-42de66bfff38 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:17.989115 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-24f01662-5ba9-495d-86c0-42de66bfff38 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:17.991712 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-24f01662-5ba9-495d-86c0-42de66bfff38 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:17.993679 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-24f01662-5ba9-495d-86c0-42de66bfff38 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:17.994807 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-24f01662-5ba9-495d-86c0-42de66bfff38 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:18.003156 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e07c5297-181b-480e-aedc-c37bda019136 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:18.017393 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e07c5297-181b-480e-aedc-c37bda019136 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/1f619a78-8e18-41fa-bb60-88d513d84cd8" status: 200 len: 1317 microversion: 2.1 time: 0.642948 Jun 10 18:08:18.020151 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1573/3241] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:17 2022] GET /compute/v2.1/servers/1f619a78-8e18-41fa-bb60-88d513d84cd8 => generated 1317 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:18.036101 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-76448bf5-aff0-464c-8caa-bd7064a7fb26 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:18.037262 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-76448bf5-aff0-464c-8caa-bd7064a7fb26 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: a6779f56-7475-4ea6-8bd0-91feb2a3c36c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:18.078570 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-76448bf5-aff0-464c-8caa-bd7064a7fb26 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:18.080265 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-76448bf5-aff0-464c-8caa-bd7064a7fb26 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:18.084174 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-76448bf5-aff0-464c-8caa-bd7064a7fb26 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:18.084943 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-76448bf5-aff0-464c-8caa-bd7064a7fb26 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:18.780339 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-24f01662-5ba9-495d-86c0-42de66bfff38 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4caa591fe84879a787d0601f2d8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53380f847a949a0b61c83fc5661d236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:18.808830 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-24f01662-5ba9-495d-86c0-42de66bfff38 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1" status: 200 len: 1371 microversion: 2.1 time: 0.895828 Jun 10 18:08:18.819525 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1669/3242] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:17 2022] GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1 => generated 1371 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:18.831512 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d68e7f4a-2130-4a9c-bca3-9f6dade18b7f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:18.833902 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d68e7f4a-2130-4a9c-bca3-9f6dade18b7f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:18.865498 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d68e7f4a-2130-4a9c-bca3-9f6dade18b7f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:18.866347 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d68e7f4a-2130-4a9c-bca3-9f6dade18b7f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:18.867952 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d68e7f4a-2130-4a9c-bca3-9f6dade18b7f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:18.869173 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d68e7f4a-2130-4a9c-bca3-9f6dade18b7f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:19.375765 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-76448bf5-aff0-464c-8caa-bd7064a7fb26 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:19.389013 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-76448bf5-aff0-464c-8caa-bd7064a7fb26 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/a6779f56-7475-4ea6-8bd0-91feb2a3c36c" status: 200 len: 1507 microversion: 2.1 time: 1.364412 Jun 10 18:08:19.389670 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1574/3243] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:18 2022] GET /compute/v2.1/servers/a6779f56-7475-4ea6-8bd0-91feb2a3c36c => generated 1507 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:19.413694 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-293a1e92-babd-458a-98ff-b16021a1f21b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:19.414323 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-293a1e92-babd-458a-98ff-b16021a1f21b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 289cf5c3-10c7-4a83-94d9-d83623d0c5e7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:19.433533 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-293a1e92-babd-458a-98ff-b16021a1f21b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:19.434461 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-293a1e92-babd-458a-98ff-b16021a1f21b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:19.438467 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-293a1e92-babd-458a-98ff-b16021a1f21b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:19.440730 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-293a1e92-babd-458a-98ff-b16021a1f21b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:19.584291 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d68e7f4a-2130-4a9c-bca3-9f6dade18b7f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:19.597643 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d68e7f4a-2130-4a9c-bca3-9f6dade18b7f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1507 microversion: 2.1 time: 0.776670 Jun 10 18:08:19.605097 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1670/3244] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:18 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1507 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:19.617658 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-17f2e014-1fec-4f40-894d-fb5527d5dc79 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:19.617658 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-17f2e014-1fec-4f40-894d-fb5527d5dc79 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 1f619a78-8e18-41fa-bb60-88d513d84cd8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:19.658688 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-17f2e014-1fec-4f40-894d-fb5527d5dc79 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:19.659140 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-17f2e014-1fec-4f40-894d-fb5527d5dc79 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:19.659931 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-17f2e014-1fec-4f40-894d-fb5527d5dc79 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:19.661054 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-17f2e014-1fec-4f40-894d-fb5527d5dc79 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:20.291082 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-293a1e92-babd-458a-98ff-b16021a1f21b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:20.300993 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-293a1e92-babd-458a-98ff-b16021a1f21b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7" status: 200 len: 1306 microversion: 2.1 time: 0.894331 Jun 10 18:08:20.308601 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1575/3245] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:19 2022] GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7 => generated 1306 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:20.322562 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=8 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:08:20.323068 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-2b7578ca-a723-47c5-9180-4b4a0efc770e req-417fa5b5-f1ef-4b74-b97b-5746f49547c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "289cf5c3-10c7-4a83-94d9-d83623d0c5e7", "tag": "4e1596e3-56a7-4159-afe3-a1bd5b198fc7"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:08:20.340530 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-2b7578ca-a723-47c5-9180-4b4a0efc770e req-417fa5b5-f1ef-4b74-b97b-5746f49547c2 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:20.347203 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-2b7578ca-a723-47c5-9180-4b4a0efc770e req-417fa5b5-f1ef-4b74-b97b-5746f49547c2 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:20.357034 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-17f2e014-1fec-4f40-894d-fb5527d5dc79 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:20.369271 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-17f2e014-1fec-4f40-894d-fb5527d5dc79 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/1f619a78-8e18-41fa-bb60-88d513d84cd8" status: 200 len: 1317 microversion: 2.1 time: 0.763039 Jun 10 18:08:20.369925 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1671/3246] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:19 2022] GET /compute/v2.1/servers/1f619a78-8e18-41fa-bb60-88d513d84cd8 => generated 1317 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:20.385491 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f3806a2f-c63c-4648-a922-36fdc9be468d tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:20.386120 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f3806a2f-c63c-4648-a922-36fdc9be468d tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:20.387565 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-2b7578ca-a723-47c5-9180-4b4a0efc770e req-417fa5b5-f1ef-4b74-b97b-5746f49547c2 service nova] Creating event network-changed:4e1596e3-56a7-4159-afe3-a1bd5b198fc7 for instance 289cf5c3-10c7-4a83-94d9-d83623d0c5e7 on chh2-master-2 Jun 10 18:08:20.388082 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=26 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:08:20.398657 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-2b7578ca-a723-47c5-9180-4b4a0efc770e req-417fa5b5-f1ef-4b74-b97b-5746f49547c2 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088123 Jun 10 18:08:20.405192 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1576/3247] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:08:20.407297 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f3806a2f-c63c-4648-a922-36fdc9be468d tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:20.408004 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f3806a2f-c63c-4648-a922-36fdc9be468d tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:20.409306 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f3806a2f-c63c-4648-a922-36fdc9be468d tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:20.409892 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f3806a2f-c63c-4648-a922-36fdc9be468d tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:20.410645 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a9ee7bec-bcf3-4ab7-a447-40210eae166b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:20.429004 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a9ee7bec-bcf3-4ab7-a447-40210eae166b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: a6779f56-7475-4ea6-8bd0-91feb2a3c36c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:20.456141 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a9ee7bec-bcf3-4ab7-a447-40210eae166b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:20.464782 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a9ee7bec-bcf3-4ab7-a447-40210eae166b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:20.464782 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a9ee7bec-bcf3-4ab7-a447-40210eae166b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:20.464782 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a9ee7bec-bcf3-4ab7-a447-40210eae166b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:20.977733 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=12 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:08:21.046751 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f3806a2f-c63c-4648-a922-36fdc9be468d tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4caa591fe84879a787d0601f2d8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53380f847a949a0b61c83fc5661d236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:21.054878 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f3806a2f-c63c-4648-a922-36fdc9be468d tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1" status: 200 len: 1371 microversion: 2.1 time: 0.683797 Jun 10 18:08:21.064949 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1672/3248] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:20 2022] GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1 => generated 1371 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:21.070414 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-b5734c51-a178-4fb4-8b8d-0f81707f783d req-290c1857-1830-4862-b130-f13cf171c6f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f619a78-8e18-41fa-bb60-88d513d84cd8", "tag": "a5f5b662-6669-42d0-933b-d82008924db0"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:08:21.080732 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-b5734c51-a178-4fb4-8b8d-0f81707f783d req-290c1857-1830-4862-b130-f13cf171c6f1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:21.081427 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-b5734c51-a178-4fb4-8b8d-0f81707f783d req-290c1857-1830-4862-b130-f13cf171c6f1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:21.102342 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-b5734c51-a178-4fb4-8b8d-0f81707f783d req-290c1857-1830-4862-b130-f13cf171c6f1 service nova] Creating event network-changed:a5f5b662-6669-42d0-933b-d82008924db0 for instance 1f619a78-8e18-41fa-bb60-88d513d84cd8 on chh1-master-2 Jun 10 18:08:21.126727 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-b5734c51-a178-4fb4-8b8d-0f81707f783d req-290c1857-1830-4862-b130-f13cf171c6f1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060151 Jun 10 18:08:21.130625 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1673/3249] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:08:21.142608 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-45f63c60-1d87-47a0-8bc9-db0f31bf1d01 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:21.150495 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-45f63c60-1d87-47a0-8bc9-db0f31bf1d01 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:21.172183 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-45f63c60-1d87-47a0-8bc9-db0f31bf1d01 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:21.173519 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-45f63c60-1d87-47a0-8bc9-db0f31bf1d01 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:21.184030 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-45f63c60-1d87-47a0-8bc9-db0f31bf1d01 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:21.184809 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-45f63c60-1d87-47a0-8bc9-db0f31bf1d01 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:21.494567 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a9ee7bec-bcf3-4ab7-a447-40210eae166b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:21.508767 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a9ee7bec-bcf3-4ab7-a447-40210eae166b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/a6779f56-7475-4ea6-8bd0-91feb2a3c36c" status: 200 len: 1507 microversion: 2.1 time: 1.101937 Jun 10 18:08:21.509683 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1577/3250] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:20 2022] GET /compute/v2.1/servers/a6779f56-7475-4ea6-8bd0-91feb2a3c36c => generated 1507 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:21.529863 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-83256041-479c-4263-a0ea-a7707ed8eeae tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:21.530961 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-83256041-479c-4263-a0ea-a7707ed8eeae tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 289cf5c3-10c7-4a83-94d9-d83623d0c5e7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:21.539397 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83256041-479c-4263-a0ea-a7707ed8eeae tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:21.539873 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83256041-479c-4263-a0ea-a7707ed8eeae tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:21.540746 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83256041-479c-4263-a0ea-a7707ed8eeae tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:21.541311 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83256041-479c-4263-a0ea-a7707ed8eeae tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:21.818282 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-83256041-479c-4263-a0ea-a7707ed8eeae tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:21.836733 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-83256041-479c-4263-a0ea-a7707ed8eeae tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7" status: 200 len: 1306 microversion: 2.1 time: 0.313446 Jun 10 18:08:21.851429 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1578/3251] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:21 2022] GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7 => generated 1306 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:21.868243 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d1516402-b4ac-4504-9d4f-7afb9b16140b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:21.873268 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d1516402-b4ac-4504-9d4f-7afb9b16140b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 1f619a78-8e18-41fa-bb60-88d513d84cd8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:21.881883 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d1516402-b4ac-4504-9d4f-7afb9b16140b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:21.882933 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d1516402-b4ac-4504-9d4f-7afb9b16140b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:21.884324 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d1516402-b4ac-4504-9d4f-7afb9b16140b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:21.884995 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d1516402-b4ac-4504-9d4f-7afb9b16140b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:22.166828 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-45f63c60-1d87-47a0-8bc9-db0f31bf1d01 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:22.194820 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-45f63c60-1d87-47a0-8bc9-db0f31bf1d01 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1507 microversion: 2.1 time: 1.060293 Jun 10 18:08:22.195426 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1674/3252] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:21 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1507 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:22.222670 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3319b9ca-12a3-409f-a613-eb7d0897e44f tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:22.230902 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3319b9ca-12a3-409f-a613-eb7d0897e44f tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 7e727aa8-591d-4232-bf55-d7e8c0ce0047] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:22.241500 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3319b9ca-12a3-409f-a613-eb7d0897e44f tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:22.243024 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3319b9ca-12a3-409f-a613-eb7d0897e44f tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:22.246802 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3319b9ca-12a3-409f-a613-eb7d0897e44f tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:22.247404 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3319b9ca-12a3-409f-a613-eb7d0897e44f tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:22.312256 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-3319b9ca-12a3-409f-a613-eb7d0897e44f tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] HTTP exception thrown: Instance 7e727aa8-591d-4232-bf55-d7e8c0ce0047 could not be found. Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3319b9ca-12a3-409f-a613-eb7d0897e44f tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Request method failure captured: Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: request: DELETE /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047 HTTP/1.1 Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4gJTZlKpxqln8lKC9Kk_1a-omRv696X6tGCmr-BNFyfScay85WTbCpW3KUrWzOFJfrP0SdxxRWfcHRbOzg7E4AwwPL-KIhggFrJa3mAbCig37CGigRqqBhDtgWJ_8f_RkZysWT-wKl28gaxKI9jcBhlt-V6MsVpjeFF20icX5AihhY Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 818440b6c7d34e09a1afd8a6e0c0b3ed Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersTestMultiNic-255908356 Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/818440b6c7d34e09a1afd8a6e0c0b3ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/818440b6c7d34e09a1afd8a6e0c0b3ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/818440b6c7d34e09a1afd8a6e0c0b3ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_818440b6c7d34e09a1afd8a6e0c0b3ed", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersTestMultiNic-255908356 Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 818440b6c7d34e09a1afd8a6e0c0b3ed Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersTestMultiNic-255908356 Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersTestMultiNic-255908356-project Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 1d61eddc0c334ec79e23a069a422fad8 Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersTestMultiNic-255908356-project Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 7e727aa8-591d-4232-bf55-d7e8c0ce0047 could not be found. Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '7e727aa8-591d-4232-bf55-d7e8c0ce0047'} Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e727aa8-591d-4232-bf55-d7e8c0ce0047 could not be found. Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:08:22.319708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e727aa8-591d-4232-bf55-d7e8c0ce0047 could not be found. Jun 10 18:08:22.324204 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:08:22.324204 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:08:22.324204 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:08:22.324204 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:08:22.324204 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:08:22.324204 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:08:22.324204 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:08:22.324204 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:08:22.324204 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e727aa8-591d-4232-bf55-d7e8c0ce0047 could not be found. Jun 10 18:08:22.324204 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:08:22.331271 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3319b9ca-12a3-409f-a613-eb7d0897e44f tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Returning 404 to user: Instance 7e727aa8-591d-4232-bf55-d7e8c0ce0047 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:08:22.331271 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3319b9ca-12a3-409f-a613-eb7d0897e44f tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "DELETE /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047" status: 404 len: 111 microversion: 2.1 time: 0.119822 Jun 10 18:08:22.332025 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1675/3253] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:08:22 2022] DELETE /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:08:22.340716 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d1bba7df-eebf-4fef-a6f7-0bcbf4dbdc79 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:22.341738 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d1bba7df-eebf-4fef-a6f7-0bcbf4dbdc79 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:22.352968 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d1bba7df-eebf-4fef-a6f7-0bcbf4dbdc79 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:22.363415 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d1bba7df-eebf-4fef-a6f7-0bcbf4dbdc79 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:22.363415 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d1bba7df-eebf-4fef-a6f7-0bcbf4dbdc79 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:22.363415 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d1bba7df-eebf-4fef-a6f7-0bcbf4dbdc79 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:22.415608 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d1516402-b4ac-4504-9d4f-7afb9b16140b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:22.428336 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d1516402-b4ac-4504-9d4f-7afb9b16140b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/1f619a78-8e18-41fa-bb60-88d513d84cd8" status: 200 len: 1317 microversion: 2.1 time: 0.575255 Jun 10 18:08:22.432237 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1579/3254] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:21 2022] GET /compute/v2.1/servers/1f619a78-8e18-41fa-bb60-88d513d84cd8 => generated 1317 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:22.442772 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-45cb9244-edff-4a9d-83bb-ed89334843dd tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:22.443443 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-45cb9244-edff-4a9d-83bb-ed89334843dd tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 7e727aa8-591d-4232-bf55-d7e8c0ce0047] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:22.459995 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45cb9244-edff-4a9d-83bb-ed89334843dd tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:22.460819 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45cb9244-edff-4a9d-83bb-ed89334843dd tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:22.462428 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45cb9244-edff-4a9d-83bb-ed89334843dd tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:22.462880 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45cb9244-edff-4a9d-83bb-ed89334843dd tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:22.485296 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-45cb9244-edff-4a9d-83bb-ed89334843dd tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] HTTP exception thrown: Instance 7e727aa8-591d-4232-bf55-d7e8c0ce0047 could not be found. Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-45cb9244-edff-4a9d-83bb-ed89334843dd tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Request method failure captured: Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047 HTTP/1.1 Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4gJTZlKpxqln8lKC9Kk_1a-omRv696X6tGCmr-BNFyfScay85WTbCpW3KUrWzOFJfrP0SdxxRWfcHRbOzg7E4AwwPL-KIhggFrJa3mAbCig37CGigRqqBhDtgWJ_8f_RkZysWT-wKl28gaxKI9jcBhlt-V6MsVpjeFF20icX5AihhY Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 818440b6c7d34e09a1afd8a6e0c0b3ed Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersTestMultiNic-255908356 Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/818440b6c7d34e09a1afd8a6e0c0b3ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/818440b6c7d34e09a1afd8a6e0c0b3ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/818440b6c7d34e09a1afd8a6e0c0b3ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_818440b6c7d34e09a1afd8a6e0c0b3ed", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersTestMultiNic-255908356 Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 818440b6c7d34e09a1afd8a6e0c0b3ed Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersTestMultiNic-255908356 Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersTestMultiNic-255908356-project Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 1d61eddc0c334ec79e23a069a422fad8 Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersTestMultiNic-255908356-project Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 7e727aa8-591d-4232-bf55-d7e8c0ce0047 could not be found. Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '7e727aa8-591d-4232-bf55-d7e8c0ce0047'} Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e727aa8-591d-4232-bf55-d7e8c0ce0047 could not be found. Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e727aa8-591d-4232-bf55-d7e8c0ce0047 could not be found. Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:08:22.488711 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:08:22.492984 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:08:22.492984 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:08:22.492984 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:08:22.492984 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:08:22.492984 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:08:22.492984 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e727aa8-591d-4232-bf55-d7e8c0ce0047 could not be found. Jun 10 18:08:22.492984 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:08:22.492984 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-45cb9244-edff-4a9d-83bb-ed89334843dd tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Returning 404 to user: Instance 7e727aa8-591d-4232-bf55-d7e8c0ce0047 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:08:22.492984 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-45cb9244-edff-4a9d-83bb-ed89334843dd tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047" status: 404 len: 111 microversion: 2.1 time: 0.055250 Jun 10 18:08:22.494007 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1580/3255] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:22 2022] GET /compute/v2.1/servers/7e727aa8-591d-4232-bf55-d7e8c0ce0047 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:08:22.507110 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-43f600a0-bbe1-4d99-a40f-146e387a1929 req-eecf715b-d069-433b-a26e-84f7c5c7f302 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6779f56-7475-4ea6-8bd0-91feb2a3c36c", "name": "network-vif-deleted", "tag": "63a7912a-7262-410f-8a70-49e1ece45fd8"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:08:22.530794 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-43f600a0-bbe1-4d99-a40f-146e387a1929 req-eecf715b-d069-433b-a26e-84f7c5c7f302 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:22.531970 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-43f600a0-bbe1-4d99-a40f-146e387a1929 req-eecf715b-d069-433b-a26e-84f7c5c7f302 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:22.554679 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-43f600a0-bbe1-4d99-a40f-146e387a1929 req-eecf715b-d069-433b-a26e-84f7c5c7f302 service nova] Creating event network-vif-deleted:63a7912a-7262-410f-8a70-49e1ece45fd8 for instance a6779f56-7475-4ea6-8bd0-91feb2a3c36c on chh1-master-2 Jun 10 18:08:22.566642 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-43f600a0-bbe1-4d99-a40f-146e387a1929 req-eecf715b-d069-433b-a26e-84f7c5c7f302 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067318 Jun 10 18:08:22.568778 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1581/3256] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:08:22.583570 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-660d5beb-74e9-4149-9520-fc0f7d02d5e2 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:22.584472 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-660d5beb-74e9-4149-9520-fc0f7d02d5e2 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:22.598209 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-660d5beb-74e9-4149-9520-fc0f7d02d5e2 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:22.599040 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-660d5beb-74e9-4149-9520-fc0f7d02d5e2 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:22.600240 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-660d5beb-74e9-4149-9520-fc0f7d02d5e2 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:22.608676 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-660d5beb-74e9-4149-9520-fc0f7d02d5e2 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:22.660776 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-660d5beb-74e9-4149-9520-fc0f7d02d5e2 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] HTTP exception thrown: Instance 58980efb-1c1a-45bb-9ac8-99383b147058 could not be found. Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-660d5beb-74e9-4149-9520-fc0f7d02d5e2 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Request method failure captured: Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 HTTP/1.1 Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4gJTZlKpxqln8lKC9Kk_1a-omRv696X6tGCmr-BNFyfScay85WTbCpW3KUrWzOFJfrP0SdxxRWfcHRbOzg7E4AwwPL-KIhggFrJa3mAbCig37CGigRqqBhDtgWJ_8f_RkZysWT-wKl28gaxKI9jcBhlt-V6MsVpjeFF20icX5AihhY Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 818440b6c7d34e09a1afd8a6e0c0b3ed Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersTestMultiNic-255908356 Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/818440b6c7d34e09a1afd8a6e0c0b3ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/818440b6c7d34e09a1afd8a6e0c0b3ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/818440b6c7d34e09a1afd8a6e0c0b3ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_818440b6c7d34e09a1afd8a6e0c0b3ed", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersTestMultiNic-255908356 Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 818440b6c7d34e09a1afd8a6e0c0b3ed Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersTestMultiNic-255908356 Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersTestMultiNic-255908356-project Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 1d61eddc0c334ec79e23a069a422fad8 Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersTestMultiNic-255908356-project Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 58980efb-1c1a-45bb-9ac8-99383b147058 could not be found. Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '58980efb-1c1a-45bb-9ac8-99383b147058'} Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58980efb-1c1a-45bb-9ac8-99383b147058 could not be found. Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:08:22.668165 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58980efb-1c1a-45bb-9ac8-99383b147058 could not be found. Jun 10 18:08:22.672922 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:08:22.672922 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:08:22.672922 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:08:22.672922 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:08:22.672922 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:08:22.672922 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:08:22.672922 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:08:22.672922 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:08:22.672922 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58980efb-1c1a-45bb-9ac8-99383b147058 could not be found. Jun 10 18:08:22.672922 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:08:22.675427 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-660d5beb-74e9-4149-9520-fc0f7d02d5e2 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Returning 404 to user: Instance 58980efb-1c1a-45bb-9ac8-99383b147058 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:08:22.675586 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d1bba7df-eebf-4fef-a6f7-0bcbf4dbdc79 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4caa591fe84879a787d0601f2d8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53380f847a949a0b61c83fc5661d236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:22.676768 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-660d5beb-74e9-4149-9520-fc0f7d02d5e2 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "DELETE /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058" status: 404 len: 111 microversion: 2.1 time: 0.106482 Jun 10 18:08:22.679624 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1582/3257] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:08:22 2022] DELETE /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:08:22.699514 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d1bba7df-eebf-4fef-a6f7-0bcbf4dbdc79 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1" status: 200 len: 1371 microversion: 2.1 time: 0.356118 Jun 10 18:08:22.699758 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-686a980e-cce0-4537-ba7f-fddb883573eb tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:22.699758 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-686a980e-cce0-4537-ba7f-fddb883573eb tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: a6779f56-7475-4ea6-8bd0-91feb2a3c36c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:22.699965 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1676/3258] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:22 2022] GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1 => generated 1371 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:22.710885 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-686a980e-cce0-4537-ba7f-fddb883573eb tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:22.711591 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-686a980e-cce0-4537-ba7f-fddb883573eb tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:22.712774 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-686a980e-cce0-4537-ba7f-fddb883573eb tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:22.713377 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-686a980e-cce0-4537-ba7f-fddb883573eb tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:22.726299 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ba30d810-b8f0-4cda-a915-42ce59f02459 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:22.729036 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ba30d810-b8f0-4cda-a915-42ce59f02459 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] [instance: 58980efb-1c1a-45bb-9ac8-99383b147058] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:22.748844 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ba30d810-b8f0-4cda-a915-42ce59f02459 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:22.751116 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ba30d810-b8f0-4cda-a915-42ce59f02459 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:22.754013 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ba30d810-b8f0-4cda-a915-42ce59f02459 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:22.755652 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ba30d810-b8f0-4cda-a915-42ce59f02459 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:22.789797 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-ba30d810-b8f0-4cda-a915-42ce59f02459 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] HTTP exception thrown: Instance 58980efb-1c1a-45bb-9ac8-99383b147058 could not be found. Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ba30d810-b8f0-4cda-a915-42ce59f02459 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Request method failure captured: Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 HTTP/1.1 Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4gJTZlKpxqln8lKC9Kk_1a-omRv696X6tGCmr-BNFyfScay85WTbCpW3KUrWzOFJfrP0SdxxRWfcHRbOzg7E4AwwPL-KIhggFrJa3mAbCig37CGigRqqBhDtgWJ_8f_RkZysWT-wKl28gaxKI9jcBhlt-V6MsVpjeFF20icX5AihhY Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 818440b6c7d34e09a1afd8a6e0c0b3ed Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersTestMultiNic-255908356 Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/818440b6c7d34e09a1afd8a6e0c0b3ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/818440b6c7d34e09a1afd8a6e0c0b3ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/818440b6c7d34e09a1afd8a6e0c0b3ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_818440b6c7d34e09a1afd8a6e0c0b3ed", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersTestMultiNic-255908356 Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 818440b6c7d34e09a1afd8a6e0c0b3ed Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersTestMultiNic-255908356 Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersTestMultiNic-255908356-project Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 1d61eddc0c334ec79e23a069a422fad8 Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersTestMultiNic-255908356-project Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 58980efb-1c1a-45bb-9ac8-99383b147058 could not be found. Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '58980efb-1c1a-45bb-9ac8-99383b147058'} Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58980efb-1c1a-45bb-9ac8-99383b147058 could not be found. Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58980efb-1c1a-45bb-9ac8-99383b147058 could not be found. Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:08:22.794251 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:08:22.800600 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:08:22.800600 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:08:22.800600 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:08:22.800600 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:08:22.800600 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:08:22.800600 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58980efb-1c1a-45bb-9ac8-99383b147058 could not be found. Jun 10 18:08:22.800600 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:08:22.804631 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ba30d810-b8f0-4cda-a915-42ce59f02459 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] Returning 404 to user: Instance 58980efb-1c1a-45bb-9ac8-99383b147058 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:08:22.807368 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ba30d810-b8f0-4cda-a915-42ce59f02459 tempest-ServersTestMultiNic-255908356 tempest-ServersTestMultiNic-255908356-project] 10.222.0.35 "GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058" status: 404 len: 111 microversion: 2.1 time: 0.107728 Jun 10 18:08:22.808121 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1677/3259] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:22 2022] GET /compute/v2.1/servers/58980efb-1c1a-45bb-9ac8-99383b147058 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:08:22.858977 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-36add47e-78ad-440f-bd09-549b925bdf8e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:22.867666 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-36add47e-78ad-440f-bd09-549b925bdf8e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 289cf5c3-10c7-4a83-94d9-d83623d0c5e7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:22.886411 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-36add47e-78ad-440f-bd09-549b925bdf8e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:22.889727 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-36add47e-78ad-440f-bd09-549b925bdf8e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:22.895798 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-36add47e-78ad-440f-bd09-549b925bdf8e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:22.896971 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-36add47e-78ad-440f-bd09-549b925bdf8e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:22.913915 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-686a980e-cce0-4537-ba7f-fddb883573eb tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:22.943219 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-686a980e-cce0-4537-ba7f-fddb883573eb tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/a6779f56-7475-4ea6-8bd0-91feb2a3c36c" status: 200 len: 1465 microversion: 2.1 time: 0.254187 Jun 10 18:08:22.946604 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:08:22.960208 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1583/3260] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:22 2022] GET /compute/v2.1/servers/a6779f56-7475-4ea6-8bd0-91feb2a3c36c => generated 1465 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:23.163714 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-b62c9ae8-6bdd-4295-9ef5-c13fc01d1248 req-099ade3e-886d-4df2-bab7-5e5ee2f90792 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "739d282e-c869-4ebe-b4fb-7122f0070ce1", "tag": "a649028f-7a43-401d-adaa-1e45a3ebf42c"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:08:23.206318 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-b62c9ae8-6bdd-4295-9ef5-c13fc01d1248 req-099ade3e-886d-4df2-bab7-5e5ee2f90792 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:23.208635 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-b62c9ae8-6bdd-4295-9ef5-c13fc01d1248 req-099ade3e-886d-4df2-bab7-5e5ee2f90792 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:23.247551 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-b62c9ae8-6bdd-4295-9ef5-c13fc01d1248 req-099ade3e-886d-4df2-bab7-5e5ee2f90792 service nova] Creating event network-changed:a649028f-7a43-401d-adaa-1e45a3ebf42c for instance 739d282e-c869-4ebe-b4fb-7122f0070ce1 on chh2-master-2 Jun 10 18:08:23.267840 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-b62c9ae8-6bdd-4295-9ef5-c13fc01d1248 req-099ade3e-886d-4df2-bab7-5e5ee2f90792 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110503 Jun 10 18:08:23.269206 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1584/3261] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:08:23.284162 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3bc87669-11b9-42bb-9fec-506837da8b88 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:23.291868 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3bc87669-11b9-42bb-9fec-506837da8b88 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:23.346962 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3bc87669-11b9-42bb-9fec-506837da8b88 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:23.347425 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3bc87669-11b9-42bb-9fec-506837da8b88 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:23.348244 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3bc87669-11b9-42bb-9fec-506837da8b88 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:23.348710 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3bc87669-11b9-42bb-9fec-506837da8b88 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:23.612621 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-36add47e-78ad-440f-bd09-549b925bdf8e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:23.619412 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3bc87669-11b9-42bb-9fec-506837da8b88 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:23.629453 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-36add47e-78ad-440f-bd09-549b925bdf8e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7" status: 200 len: 1306 microversion: 2.1 time: 0.777309 Jun 10 18:08:23.636371 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3bc87669-11b9-42bb-9fec-506837da8b88 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1507 microversion: 2.1 time: 0.365692 Jun 10 18:08:23.637456 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1585/3262] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:23 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1507 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:23.639639 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1678/3263] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:22 2022] GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7 => generated 1306 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:23.643622 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8a3b9080-b34b-44c5-8602-6eb8481aed9f tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:23.644553 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8a3b9080-b34b-44c5-8602-6eb8481aed9f tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 1f619a78-8e18-41fa-bb60-88d513d84cd8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:23.651187 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8a3b9080-b34b-44c5-8602-6eb8481aed9f tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:23.651962 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8a3b9080-b34b-44c5-8602-6eb8481aed9f tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:23.653296 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8a3b9080-b34b-44c5-8602-6eb8481aed9f tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:23.656927 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8a3b9080-b34b-44c5-8602-6eb8481aed9f tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:23.719813 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1009cd5a-a9cf-4893-916b-68802c4ec967 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:23.720851 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1009cd5a-a9cf-4893-916b-68802c4ec967 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:23.736395 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1009cd5a-a9cf-4893-916b-68802c4ec967 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:23.745415 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1009cd5a-a9cf-4893-916b-68802c4ec967 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:23.746660 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1009cd5a-a9cf-4893-916b-68802c4ec967 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:23.749703 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1009cd5a-a9cf-4893-916b-68802c4ec967 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:23.858291 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8a3b9080-b34b-44c5-8602-6eb8481aed9f tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:23.884210 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8a3b9080-b34b-44c5-8602-6eb8481aed9f tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/1f619a78-8e18-41fa-bb60-88d513d84cd8" status: 200 len: 1317 microversion: 2.1 time: 0.245237 Jun 10 18:08:23.885095 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1586/3264] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:23 2022] GET /compute/v2.1/servers/1f619a78-8e18-41fa-bb60-88d513d84cd8 => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:23.970570 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0252284e-5696-4b0a-b464-7a2b79792627 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:23.970570 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0252284e-5696-4b0a-b464-7a2b79792627 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: a6779f56-7475-4ea6-8bd0-91feb2a3c36c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:23.988174 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0252284e-5696-4b0a-b464-7a2b79792627 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:23.988174 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0252284e-5696-4b0a-b464-7a2b79792627 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:23.988174 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0252284e-5696-4b0a-b464-7a2b79792627 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:23.988174 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0252284e-5696-4b0a-b464-7a2b79792627 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:24.021919 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0252284e-5696-4b0a-b464-7a2b79792627 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:24.022209 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0252284e-5696-4b0a-b464-7a2b79792627 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:24.022790 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-0252284e-5696-4b0a-b464-7a2b79792627 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lazy-loading 'fault' on Instance uuid a6779f56-7475-4ea6-8bd0-91feb2a3c36c {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:08:24.089536 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0252284e-5696-4b0a-b464-7a2b79792627 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:24.089536 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0252284e-5696-4b0a-b464-7a2b79792627 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/a6779f56-7475-4ea6-8bd0-91feb2a3c36c" status: 200 len: 1305 microversion: 2.1 time: 0.117908 Jun 10 18:08:24.089536 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1587/3265] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:23 2022] GET /compute/v2.1/servers/a6779f56-7475-4ea6-8bd0-91feb2a3c36c => generated 1305 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:08:24.253511 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1009cd5a-a9cf-4893-916b-68802c4ec967 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4caa591fe84879a787d0601f2d8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53380f847a949a0b61c83fc5661d236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:24.271935 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1009cd5a-a9cf-4893-916b-68802c4ec967 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1" status: 200 len: 1371 microversion: 2.1 time: 0.555876 Jun 10 18:08:24.274546 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1679/3266] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:23 2022] GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1 => generated 1371 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:24.647598 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fdd4a14a-0667-43e5-876f-38ff8cfc69cc tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:24.649617 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fdd4a14a-0667-43e5-876f-38ff8cfc69cc tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 289cf5c3-10c7-4a83-94d9-d83623d0c5e7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:24.653810 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d9ab189d-d6b0-422b-8a1c-2fdd319e979d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:24.655016 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d9ab189d-d6b0-422b-8a1c-2fdd319e979d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:24.670876 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d9ab189d-d6b0-422b-8a1c-2fdd319e979d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:24.671112 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fdd4a14a-0667-43e5-876f-38ff8cfc69cc tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:24.673847 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fdd4a14a-0667-43e5-876f-38ff8cfc69cc tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:24.674493 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d9ab189d-d6b0-422b-8a1c-2fdd319e979d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:24.675398 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fdd4a14a-0667-43e5-876f-38ff8cfc69cc tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:24.676337 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d9ab189d-d6b0-422b-8a1c-2fdd319e979d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:24.677585 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fdd4a14a-0667-43e5-876f-38ff8cfc69cc tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:24.680984 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d9ab189d-d6b0-422b-8a1c-2fdd319e979d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:24.986570 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fdd4a14a-0667-43e5-876f-38ff8cfc69cc tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:25.003696 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fdd4a14a-0667-43e5-876f-38ff8cfc69cc tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7" status: 200 len: 1306 microversion: 2.1 time: 0.358953 Jun 10 18:08:25.007175 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1588/3267] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:24 2022] GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7 => generated 1306 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:25.023258 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6633d29a-9436-479f-ac33-82f923bcfd1b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:25.023891 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6633d29a-9436-479f-ac33-82f923bcfd1b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 1f619a78-8e18-41fa-bb60-88d513d84cd8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:25.046627 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d9ab189d-d6b0-422b-8a1c-2fdd319e979d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:25.046806 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6633d29a-9436-479f-ac33-82f923bcfd1b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:25.046806 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6633d29a-9436-479f-ac33-82f923bcfd1b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:25.046806 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6633d29a-9436-479f-ac33-82f923bcfd1b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:25.046806 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6633d29a-9436-479f-ac33-82f923bcfd1b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:25.061862 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d9ab189d-d6b0-422b-8a1c-2fdd319e979d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1507 microversion: 2.1 time: 0.412503 Jun 10 18:08:25.064515 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1680/3268] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:24 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1507 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:25.103782 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6ed6af7c-2e47-4c8b-a765-791c7fb04ed2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:25.104426 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6ed6af7c-2e47-4c8b-a765-791c7fb04ed2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: a6779f56-7475-4ea6-8bd0-91feb2a3c36c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:25.121539 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6ed6af7c-2e47-4c8b-a765-791c7fb04ed2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:25.122002 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6ed6af7c-2e47-4c8b-a765-791c7fb04ed2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:25.124629 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6ed6af7c-2e47-4c8b-a765-791c7fb04ed2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:25.125165 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6ed6af7c-2e47-4c8b-a765-791c7fb04ed2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:25.148577 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-6ed6af7c-2e47-4c8b-a765-791c7fb04ed2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] HTTP exception thrown: Instance a6779f56-7475-4ea6-8bd0-91feb2a3c36c could not be found. Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6ed6af7c-2e47-4c8b-a765-791c7fb04ed2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Request method failure captured: Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/a6779f56-7475-4ea6-8bd0-91feb2a3c36c HTTP/1.1 Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4h5IGwn2s1svunn67FxK1RLA1ZXNP7yhKtLh1eaKFO5RiF1I7YeJHWcfSjdUGMBWYC3nFgfMdv1-bfem3ewEozYf-uHKxgVE7ziplyuJN8iPaP89LX8AXS1cyKZcnxByDcQMqTPs4bimJxM1lNaVEmx4VPDZsfMeZBdbBH4r5hYsr8 Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/457c4a300936498b9e8b61645e655751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "tempest-type-1142384015", "name": "tempest-service-1838487701", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_457c4a300936498b9e8b61645e655751", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 8166793f60ee479689b4a21457b71d07 Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: exception: Instance a6779f56-7475-4ea6-8bd0-91feb2a3c36c could not be found. Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'a6779f56-7475-4ea6-8bd0-91feb2a3c36c'} Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6779f56-7475-4ea6-8bd0-91feb2a3c36c could not be found. Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6779f56-7475-4ea6-8bd0-91feb2a3c36c could not be found. Jun 10 18:08:25.150532 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:08:25.154987 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:08:25.154987 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:08:25.154987 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:08:25.154987 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:08:25.154987 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:08:25.154987 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:08:25.154987 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:08:25.154987 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6779f56-7475-4ea6-8bd0-91feb2a3c36c could not be found. Jun 10 18:08:25.154987 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:08:25.157332 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6ed6af7c-2e47-4c8b-a765-791c7fb04ed2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Returning 404 to user: Instance a6779f56-7475-4ea6-8bd0-91feb2a3c36c could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:08:25.159293 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6ed6af7c-2e47-4c8b-a765-791c7fb04ed2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/a6779f56-7475-4ea6-8bd0-91feb2a3c36c" status: 404 len: 111 microversion: 2.1 time: 0.061409 Jun 10 18:08:25.160382 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1681/3269] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:25 2022] GET /compute/v2.1/servers/a6779f56-7475-4ea6-8bd0-91feb2a3c36c => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:08:25.294128 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7e9c7721-377a-48ac-afb3-44e68de5dbf0 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:25.295186 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7e9c7721-377a-48ac-afb3-44e68de5dbf0 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:25.307981 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7e9c7721-377a-48ac-afb3-44e68de5dbf0 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:25.309018 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7e9c7721-377a-48ac-afb3-44e68de5dbf0 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:25.310041 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7e9c7721-377a-48ac-afb3-44e68de5dbf0 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:25.311120 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7e9c7721-377a-48ac-afb3-44e68de5dbf0 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:25.426817 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6633d29a-9436-479f-ac33-82f923bcfd1b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:25.443832 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6633d29a-9436-479f-ac33-82f923bcfd1b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/1f619a78-8e18-41fa-bb60-88d513d84cd8" status: 200 len: 1317 microversion: 2.1 time: 0.435187 Jun 10 18:08:25.445386 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1589/3270] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:25 2022] GET /compute/v2.1/servers/1f619a78-8e18-41fa-bb60-88d513d84cd8 => generated 1317 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:25.453542 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f87d61fb-6b73-46dc-9e36-efb16240a949 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1924823415", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "01d41899-bf8f-45ad-9aa1-db371d9cd1c4"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:08:25.746680 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7e9c7721-377a-48ac-afb3-44e68de5dbf0 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4caa591fe84879a787d0601f2d8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53380f847a949a0b61c83fc5661d236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:25.756110 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7e9c7721-377a-48ac-afb3-44e68de5dbf0 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1" status: 200 len: 1371 microversion: 2.1 time: 0.468646 Jun 10 18:08:25.759905 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1682/3271] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:25 2022] GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1 => generated 1371 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:08:26.024658 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cf4f57a8-ad4f-4d1c-9371-c85cbb4197ec tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:26.026744 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cf4f57a8-ad4f-4d1c-9371-c85cbb4197ec tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 289cf5c3-10c7-4a83-94d9-d83623d0c5e7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:26.046153 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf4f57a8-ad4f-4d1c-9371-c85cbb4197ec tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:26.051097 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf4f57a8-ad4f-4d1c-9371-c85cbb4197ec tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:26.056751 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf4f57a8-ad4f-4d1c-9371-c85cbb4197ec tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:26.058594 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf4f57a8-ad4f-4d1c-9371-c85cbb4197ec tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:26.951227 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cf4f57a8-ad4f-4d1c-9371-c85cbb4197ec tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:26.952825 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cf4f57a8-ad4f-4d1c-9371-c85cbb4197ec tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7" status: 200 len: 1306 microversion: 2.1 time: 0.935599 Jun 10 18:08:26.954304 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1683/3272] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:26 2022] GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7 => generated 1306 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:26.961907 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5272d556-71a3-497c-a523-86adf8923078 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:26.962752 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5272d556-71a3-497c-a523-86adf8923078 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:26.976158 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5272d556-71a3-497c-a523-86adf8923078 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:26.977359 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5272d556-71a3-497c-a523-86adf8923078 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:26.980117 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5272d556-71a3-497c-a523-86adf8923078 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:26.982077 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5272d556-71a3-497c-a523-86adf8923078 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:27.485047 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5272d556-71a3-497c-a523-86adf8923078 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:27.497303 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5272d556-71a3-497c-a523-86adf8923078 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1507 microversion: 2.1 time: 0.541022 Jun 10 18:08:27.501280 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1684/3273] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:26 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1507 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:27.510132 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fad15acf-5ac0-4b1e-b273-2854bd7c0d97 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:27.510132 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fad15acf-5ac0-4b1e-b273-2854bd7c0d97 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 1f619a78-8e18-41fa-bb60-88d513d84cd8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:27.555169 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fad15acf-5ac0-4b1e-b273-2854bd7c0d97 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:27.555710 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fad15acf-5ac0-4b1e-b273-2854bd7c0d97 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:27.556589 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fad15acf-5ac0-4b1e-b273-2854bd7c0d97 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:27.557029 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fad15acf-5ac0-4b1e-b273-2854bd7c0d97 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:28.713459 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fad15acf-5ac0-4b1e-b273-2854bd7c0d97 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:28.725606 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fad15acf-5ac0-4b1e-b273-2854bd7c0d97 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/1f619a78-8e18-41fa-bb60-88d513d84cd8" status: 200 len: 1317 microversion: 2.1 time: 1.223009 Jun 10 18:08:28.726789 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1685/3274] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:27 2022] GET /compute/v2.1/servers/1f619a78-8e18-41fa-bb60-88d513d84cd8 => generated 1317 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:28.736052 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-42a5a9eb-1091-4d60-a694-e7e5c14feaca tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:28.742010 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-42a5a9eb-1091-4d60-a694-e7e5c14feaca tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:28.757778 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-42a5a9eb-1091-4d60-a694-e7e5c14feaca tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:28.758791 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-42a5a9eb-1091-4d60-a694-e7e5c14feaca tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:28.763102 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-42a5a9eb-1091-4d60-a694-e7e5c14feaca tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:28.763102 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-42a5a9eb-1091-4d60-a694-e7e5c14feaca tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:29.057417 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-42a5a9eb-1091-4d60-a694-e7e5c14feaca tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4caa591fe84879a787d0601f2d8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53380f847a949a0b61c83fc5661d236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:29.073851 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-42a5a9eb-1091-4d60-a694-e7e5c14feaca tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1" status: 200 len: 1371 microversion: 2.1 time: 0.341576 Jun 10 18:08:29.073851 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1686/3275] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:28 2022] GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1 => generated 1371 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:29.076922 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-425ac81e-c035-449d-84f7-0e598bfb1f85 req-688a7910-2190-4121-8b7d-6073b9a9beb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f619a78-8e18-41fa-bb60-88d513d84cd8", "name": "network-vif-plugged", "status": "completed", "tag": "a5f5b662-6669-42d0-933b-d82008924db0"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:08:29.087274 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-425ac81e-c035-449d-84f7-0e598bfb1f85 req-688a7910-2190-4121-8b7d-6073b9a9beb5 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:29.087887 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-425ac81e-c035-449d-84f7-0e598bfb1f85 req-688a7910-2190-4121-8b7d-6073b9a9beb5 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:29.101282 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-425ac81e-c035-449d-84f7-0e598bfb1f85 req-688a7910-2190-4121-8b7d-6073b9a9beb5 service nova] Creating event network-vif-plugged:a5f5b662-6669-42d0-933b-d82008924db0 for instance 1f619a78-8e18-41fa-bb60-88d513d84cd8 on chh1-master-2 Jun 10 18:08:29.114308 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-425ac81e-c035-449d-84f7-0e598bfb1f85 req-688a7910-2190-4121-8b7d-6073b9a9beb5 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040538 Jun 10 18:08:29.115308 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1687/3276] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:08:29.122521 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d708232b-d81c-4ed6-bdf7-a5003413651d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:29.123527 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d708232b-d81c-4ed6-bdf7-a5003413651d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 289cf5c3-10c7-4a83-94d9-d83623d0c5e7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:29.131436 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d708232b-d81c-4ed6-bdf7-a5003413651d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:29.133570 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d708232b-d81c-4ed6-bdf7-a5003413651d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:29.134156 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d708232b-d81c-4ed6-bdf7-a5003413651d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:29.134978 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d708232b-d81c-4ed6-bdf7-a5003413651d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:29.346819 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d708232b-d81c-4ed6-bdf7-a5003413651d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:29.414272 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d708232b-d81c-4ed6-bdf7-a5003413651d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7" status: 200 len: 1306 microversion: 2.1 time: 0.245707 Jun 10 18:08:29.414272 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1688/3277] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:29 2022] GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7 => generated 1306 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:29.414272 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f0a094b4-d3b5-4f04-b547-f8264d851ba0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:29.414272 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f0a094b4-d3b5-4f04-b547-f8264d851ba0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:29.414272 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f0a094b4-d3b5-4f04-b547-f8264d851ba0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:29.414272 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f0a094b4-d3b5-4f04-b547-f8264d851ba0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:29.414272 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f0a094b4-d3b5-4f04-b547-f8264d851ba0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:29.414272 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f0a094b4-d3b5-4f04-b547-f8264d851ba0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:29.496171 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-f87d61fb-6b73-46dc-9e36-efb16240a949 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] validate_networks() for [('01d41899-bf8f-45ad-9aa1-db371d9cd1c4', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:08:29.624159 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f0a094b4-d3b5-4f04-b547-f8264d851ba0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:29.632675 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f0a094b4-d3b5-4f04-b547-f8264d851ba0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1507 microversion: 2.1 time: 0.267882 Jun 10 18:08:29.634088 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1689/3278] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:29 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1507 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:29.743627 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bd1dc352-8208-4caf-b471-29eac7160f06 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:29.744964 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bd1dc352-8208-4caf-b471-29eac7160f06 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 1f619a78-8e18-41fa-bb60-88d513d84cd8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:29.754935 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bd1dc352-8208-4caf-b471-29eac7160f06 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:29.756978 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bd1dc352-8208-4caf-b471-29eac7160f06 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:29.758377 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bd1dc352-8208-4caf-b471-29eac7160f06 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:29.759958 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bd1dc352-8208-4caf-b471-29eac7160f06 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:29.978135 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bd1dc352-8208-4caf-b471-29eac7160f06 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:29.993263 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bd1dc352-8208-4caf-b471-29eac7160f06 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/1f619a78-8e18-41fa-bb60-88d513d84cd8" status: 200 len: 1317 microversion: 2.1 time: 0.253478 Jun 10 18:08:30.003262 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1690/3279] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:29 2022] GET /compute/v2.1/servers/1f619a78-8e18-41fa-bb60-88d513d84cd8 => generated 1317 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:30.088809 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9c1e5363-8e45-4106-809b-3fb4e9d49b69 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:30.089424 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9c1e5363-8e45-4106-809b-3fb4e9d49b69 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:30.093785 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:08:30.098151 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9c1e5363-8e45-4106-809b-3fb4e9d49b69 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:30.098950 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9c1e5363-8e45-4106-809b-3fb4e9d49b69 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:30.099784 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9c1e5363-8e45-4106-809b-3fb4e9d49b69 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:30.100171 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9c1e5363-8e45-4106-809b-3fb4e9d49b69 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:30.254490 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-f87d61fb-6b73-46dc-9e36-efb16240a949 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:08:30.255194 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-f87d61fb-6b73-46dc-9e36-efb16240a949 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:08:30.255865 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-f87d61fb-6b73-46dc-9e36-efb16240a949 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:08:30.256645 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-f87d61fb-6b73-46dc-9e36-efb16240a949 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:08:30.263078 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-f87d61fb-6b73-46dc-9e36-efb16240a949 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:08:30.272433 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f87d61fb-6b73-46dc-9e36-efb16240a949 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:30.273797 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f87d61fb-6b73-46dc-9e36-efb16240a949 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:30.274844 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f87d61fb-6b73-46dc-9e36-efb16240a949 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:30.275474 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f87d61fb-6b73-46dc-9e36-efb16240a949 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:30.301177 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-f87d61fb-6b73-46dc-9e36-efb16240a949 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Getting quotas for project 457c4a300936498b9e8b61645e655751. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:08:30.308016 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-f87d61fb-6b73-46dc-9e36-efb16240a949 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Getting quotas for user 8166793f60ee479689b4a21457b71d07 and project 457c4a300936498b9e8b61645e655751. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:08:30.323647 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f87d61fb-6b73-46dc-9e36-efb16240a949 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:08:30.326477 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f87d61fb-6b73-46dc-9e36-efb16240a949 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: ea345031-5220-43d0-9971-ada561720697] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:08:30.385968 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9c1e5363-8e45-4106-809b-3fb4e9d49b69 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4caa591fe84879a787d0601f2d8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53380f847a949a0b61c83fc5661d236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:30.396125 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9c1e5363-8e45-4106-809b-3fb4e9d49b69 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1" status: 200 len: 1371 microversion: 2.1 time: 0.311474 Jun 10 18:08:30.396764 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1691/3280] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:30 2022] GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1 => generated 1371 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:08:30.405159 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-12b3a667-7b7f-4a64-9c12-36c87cee9808 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:30.406443 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-12b3a667-7b7f-4a64-9c12-36c87cee9808 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 289cf5c3-10c7-4a83-94d9-d83623d0c5e7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:30.413792 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-12b3a667-7b7f-4a64-9c12-36c87cee9808 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:30.419227 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-12b3a667-7b7f-4a64-9c12-36c87cee9808 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:30.419227 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-12b3a667-7b7f-4a64-9c12-36c87cee9808 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:30.419227 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-12b3a667-7b7f-4a64-9c12-36c87cee9808 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:30.489239 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f87d61fb-6b73-46dc-9e36-efb16240a949 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.042485 Jun 10 18:08:30.491925 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1590/3281] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:08:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 5046 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:08:30.502103 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f6a11dba-0c78-4521-85d5-74984484dbaa tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:30.505022 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f6a11dba-0c78-4521-85d5-74984484dbaa tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: ea345031-5220-43d0-9971-ada561720697] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:30.652049 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-12b3a667-7b7f-4a64-9c12-36c87cee9808 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:30.668386 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-12b3a667-7b7f-4a64-9c12-36c87cee9808 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7" status: 200 len: 1306 microversion: 2.1 time: 0.270400 Jun 10 18:08:30.682651 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1692/3282] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:30 2022] GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7 => generated 1306 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:30.689339 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f86c496f-81d5-44cb-802f-4cbfc62e0b8a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:30.690404 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f86c496f-81d5-44cb-802f-4cbfc62e0b8a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:30.699463 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f86c496f-81d5-44cb-802f-4cbfc62e0b8a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:30.704107 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f86c496f-81d5-44cb-802f-4cbfc62e0b8a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:30.704107 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f86c496f-81d5-44cb-802f-4cbfc62e0b8a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:30.704107 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f86c496f-81d5-44cb-802f-4cbfc62e0b8a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:30.801677 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f6a11dba-0c78-4521-85d5-74984484dbaa tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:30.814774 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f6a11dba-0c78-4521-85d5-74984484dbaa tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697" status: 200 len: 1215 microversion: 2.1 time: 0.314980 Jun 10 18:08:30.816589 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1591/3283] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:30 2022] GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697 => generated 1215 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:08:31.014535 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4d8111c0-4544-4061-876e-c19c11c660e6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:31.015184 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4d8111c0-4544-4061-876e-c19c11c660e6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 1f619a78-8e18-41fa-bb60-88d513d84cd8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:31.038773 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d8111c0-4544-4061-876e-c19c11c660e6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:31.044881 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d8111c0-4544-4061-876e-c19c11c660e6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:31.047548 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d8111c0-4544-4061-876e-c19c11c660e6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:31.047548 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d8111c0-4544-4061-876e-c19c11c660e6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:31.154070 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f86c496f-81d5-44cb-802f-4cbfc62e0b8a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:31.206495 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f86c496f-81d5-44cb-802f-4cbfc62e0b8a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1507 microversion: 2.1 time: 0.522075 Jun 10 18:08:31.214126 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1693/3284] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:30 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1507 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:31.219051 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-a2594456-80af-4d43-aeab-7bf621a88f21 req-f9f991d8-bb00-4ffa-b9de-d83b4346eabc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "289cf5c3-10c7-4a83-94d9-d83623d0c5e7", "name": "network-vif-plugged", "status": "completed", "tag": "4e1596e3-56a7-4159-afe3-a1bd5b198fc7"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:08:31.244518 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-a2594456-80af-4d43-aeab-7bf621a88f21 req-f9f991d8-bb00-4ffa-b9de-d83b4346eabc service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:31.245533 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-a2594456-80af-4d43-aeab-7bf621a88f21 req-f9f991d8-bb00-4ffa-b9de-d83b4346eabc service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:31.269120 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-a2594456-80af-4d43-aeab-7bf621a88f21 req-f9f991d8-bb00-4ffa-b9de-d83b4346eabc service nova] Creating event network-vif-plugged:4e1596e3-56a7-4159-afe3-a1bd5b198fc7 for instance 289cf5c3-10c7-4a83-94d9-d83623d0c5e7 on chh2-master-2 Jun 10 18:08:31.278909 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-a2594456-80af-4d43-aeab-7bf621a88f21 req-f9f991d8-bb00-4ffa-b9de-d83b4346eabc service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062409 Jun 10 18:08:31.280113 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1694/3285] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:08:31.425896 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2f21c79b-b22b-4553-9fac-62f55afd3dab tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:31.426690 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2f21c79b-b22b-4553-9fac-62f55afd3dab tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:31.430856 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4d8111c0-4544-4061-876e-c19c11c660e6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:31.440050 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4d8111c0-4544-4061-876e-c19c11c660e6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/1f619a78-8e18-41fa-bb60-88d513d84cd8" status: 200 len: 1467 microversion: 2.1 time: 0.433181 Jun 10 18:08:31.442688 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2f21c79b-b22b-4553-9fac-62f55afd3dab tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:31.443359 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2f21c79b-b22b-4553-9fac-62f55afd3dab tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:31.443938 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1592/3286] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:31 2022] GET /compute/v2.1/servers/1f619a78-8e18-41fa-bb60-88d513d84cd8 => generated 1467 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:31.444915 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2f21c79b-b22b-4553-9fac-62f55afd3dab tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:31.446648 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2f21c79b-b22b-4553-9fac-62f55afd3dab tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:31.460656 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ca53646d-7f6c-4bfa-b291-4957f0facd4c tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:31.461567 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ca53646d-7f6c-4bfa-b291-4957f0facd4c tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] [instance: 1f619a78-8e18-41fa-bb60-88d513d84cd8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:31.480878 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ca53646d-7f6c-4bfa-b291-4957f0facd4c tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:31.481346 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ca53646d-7f6c-4bfa-b291-4957f0facd4c tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:31.486636 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ca53646d-7f6c-4bfa-b291-4957f0facd4c tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:31.487108 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ca53646d-7f6c-4bfa-b291-4957f0facd4c tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:31.891304 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2f21c79b-b22b-4553-9fac-62f55afd3dab tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4caa591fe84879a787d0601f2d8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53380f847a949a0b61c83fc5661d236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:31.929990 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2f21c79b-b22b-4553-9fac-62f55afd3dab tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1" status: 200 len: 1371 microversion: 2.1 time: 0.519982 Jun 10 18:08:31.954501 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1695/3287] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:31 2022] GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1 => generated 1371 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:08:31.963225 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-185a2fe4-00b8-42cc-8ec4-754cc8bbba53 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:31.964040 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-185a2fe4-00b8-42cc-8ec4-754cc8bbba53 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 289cf5c3-10c7-4a83-94d9-d83623d0c5e7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:31.988460 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-185a2fe4-00b8-42cc-8ec4-754cc8bbba53 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:31.991212 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-185a2fe4-00b8-42cc-8ec4-754cc8bbba53 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:31.992154 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-185a2fe4-00b8-42cc-8ec4-754cc8bbba53 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:31.992634 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-185a2fe4-00b8-42cc-8ec4-754cc8bbba53 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:32.064117 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ca53646d-7f6c-4bfa-b291-4957f0facd4c tempest-ServersOnMultiNodesTest-133330230 tempest-ServersOnMultiNodesTest-133330230-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/1f619a78-8e18-41fa-bb60-88d513d84cd8" status: 200 len: 1618 microversion: 2.1 time: 0.608362 Jun 10 18:08:32.064861 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1593/3288] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:31 2022] GET /compute/v2.1/servers/1f619a78-8e18-41fa-bb60-88d513d84cd8 => generated 1618 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:32.072179 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-91d73159-034b-4813-bbc0-34f7594e9dbf tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:32.080424 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-91d73159-034b-4813-bbc0-34f7594e9dbf tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: ea345031-5220-43d0-9971-ada561720697] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:32.090812 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-91d73159-034b-4813-bbc0-34f7594e9dbf tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:32.099492 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-91d73159-034b-4813-bbc0-34f7594e9dbf tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:32.100625 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-91d73159-034b-4813-bbc0-34f7594e9dbf tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:32.101139 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-91d73159-034b-4813-bbc0-34f7594e9dbf tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:32.112879 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:08:32.272551 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-91d73159-034b-4813-bbc0-34f7594e9dbf tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:32.290915 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-91d73159-034b-4813-bbc0-34f7594e9dbf tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697" status: 200 len: 1219 microversion: 2.1 time: 0.224238 Jun 10 18:08:32.301450 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1594/3289] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:32 2022] GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697 => generated 1219 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:32.306532 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-de1dba91-0012-4f14-8424-539b65c9c752 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:32.307079 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-de1dba91-0012-4f14-8424-539b65c9c752 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 1f619a78-8e18-41fa-bb60-88d513d84cd8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:32.315356 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de1dba91-0012-4f14-8424-539b65c9c752 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:32.321247 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de1dba91-0012-4f14-8424-539b65c9c752 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:32.329377 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de1dba91-0012-4f14-8424-539b65c9c752 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:32.329846 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de1dba91-0012-4f14-8424-539b65c9c752 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:32.390230 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-de1dba91-0012-4f14-8424-539b65c9c752 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 1f619a78-8e18-41fa-bb60-88d513d84cd8] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:08:32.508990 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-185a2fe4-00b8-42cc-8ec4-754cc8bbba53 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:32.520598 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:08:32.534467 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-185a2fe4-00b8-42cc-8ec4-754cc8bbba53 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7" status: 200 len: 1306 microversion: 2.1 time: 0.582992 Jun 10 18:08:32.535349 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1696/3290] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:31 2022] GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7 => generated 1306 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:32.549383 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-90002748-fb88-4ba4-8d98-f8bb6029604e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:32.551582 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-90002748-fb88-4ba4-8d98-f8bb6029604e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:32.564484 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90002748-fb88-4ba4-8d98-f8bb6029604e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:32.565265 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90002748-fb88-4ba4-8d98-f8bb6029604e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:32.579893 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90002748-fb88-4ba4-8d98-f8bb6029604e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:32.579893 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90002748-fb88-4ba4-8d98-f8bb6029604e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:32.832979 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-de1dba91-0012-4f14-8424-539b65c9c752 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "DELETE /compute/v2.1/servers/1f619a78-8e18-41fa-bb60-88d513d84cd8" status: 204 len: 0 microversion: 2.1 time: 0.529423 Jun 10 18:08:32.834563 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1595/3291] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:08:32 2022] DELETE /compute/v2.1/servers/1f619a78-8e18-41fa-bb60-88d513d84cd8 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:08:32.845761 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-95135e11-d857-4381-a199-ed3599a66fd2 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:32.846782 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-95135e11-d857-4381-a199-ed3599a66fd2 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 1f619a78-8e18-41fa-bb60-88d513d84cd8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:32.853900 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-95135e11-d857-4381-a199-ed3599a66fd2 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:32.858960 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-95135e11-d857-4381-a199-ed3599a66fd2 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:32.858960 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-95135e11-d857-4381-a199-ed3599a66fd2 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:32.858960 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-95135e11-d857-4381-a199-ed3599a66fd2 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:32.880156 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-90002748-fb88-4ba4-8d98-f8bb6029604e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:32.905495 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-90002748-fb88-4ba4-8d98-f8bb6029604e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1504 microversion: 2.1 time: 0.359506 Jun 10 18:08:32.908033 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1697/3292] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:32 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1504 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:32.971209 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-dd5f5456-0ea4-43c0-a48d-19dc8cd5659d tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:32.971209 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-dd5f5456-0ea4-43c0-a48d-19dc8cd5659d tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:32.994345 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dd5f5456-0ea4-43c0-a48d-19dc8cd5659d tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:32.994345 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dd5f5456-0ea4-43c0-a48d-19dc8cd5659d tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:32.995166 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dd5f5456-0ea4-43c0-a48d-19dc8cd5659d tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:32.995629 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dd5f5456-0ea4-43c0-a48d-19dc8cd5659d tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:33.187407 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-dd5f5456-0ea4-43c0-a48d-19dc8cd5659d tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4caa591fe84879a787d0601f2d8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53380f847a949a0b61c83fc5661d236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:33.196450 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-dd5f5456-0ea4-43c0-a48d-19dc8cd5659d tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1" status: 200 len: 1371 microversion: 2.1 time: 0.230463 Jun 10 18:08:33.197431 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1698/3293] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:32 2022] GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1 => generated 1371 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:08:33.293938 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-95135e11-d857-4381-a199-ed3599a66fd2 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:33.306192 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-95135e11-d857-4381-a199-ed3599a66fd2 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/1f619a78-8e18-41fa-bb60-88d513d84cd8" status: 200 len: 1473 microversion: 2.1 time: 0.463147 Jun 10 18:08:33.306819 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1596/3294] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:32 2022] GET /compute/v2.1/servers/1f619a78-8e18-41fa-bb60-88d513d84cd8 => generated 1473 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:33.311396 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d961af36-d7f1-4055-92b0-31597f97711d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:33.313340 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d961af36-d7f1-4055-92b0-31597f97711d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: ea345031-5220-43d0-9971-ada561720697] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:33.325378 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d961af36-d7f1-4055-92b0-31597f97711d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:33.325922 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d961af36-d7f1-4055-92b0-31597f97711d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:33.328422 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-dea3026b-5816-4f5d-9e2b-2b0e928c04c6 req-3800669d-da2c-43e7-9709-2bb65d9edff4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da4ca117-eaa1-4a19-83ca-3da2766c5f15", "name": "network-vif-unplugged", "status": "completed", "tag": "a82f9160-ebd4-4524-8522-95af49c18023"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:08:33.329283 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d961af36-d7f1-4055-92b0-31597f97711d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:33.329842 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d961af36-d7f1-4055-92b0-31597f97711d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:33.338645 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-dea3026b-5816-4f5d-9e2b-2b0e928c04c6 req-3800669d-da2c-43e7-9709-2bb65d9edff4 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:33.339351 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-dea3026b-5816-4f5d-9e2b-2b0e928c04c6 req-3800669d-da2c-43e7-9709-2bb65d9edff4 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:33.353503 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-dea3026b-5816-4f5d-9e2b-2b0e928c04c6 req-3800669d-da2c-43e7-9709-2bb65d9edff4 service nova] Creating event network-vif-unplugged:a82f9160-ebd4-4524-8522-95af49c18023 for instance da4ca117-eaa1-4a19-83ca-3da2766c5f15 on chh2-master-2 Jun 10 18:08:33.359949 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-dea3026b-5816-4f5d-9e2b-2b0e928c04c6 req-3800669d-da2c-43e7-9709-2bb65d9edff4 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036505 Jun 10 18:08:33.361162 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1597/3295] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:08:33.414274 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d961af36-d7f1-4055-92b0-31597f97711d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:33.431761 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d961af36-d7f1-4055-92b0-31597f97711d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697" status: 200 len: 1267 microversion: 2.1 time: 0.125593 Jun 10 18:08:33.442414 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1699/3296] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:33 2022] GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697 => generated 1267 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:33.552756 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9f4f174f-9aa0-47eb-8992-d7083e3bac39 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:33.553750 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9f4f174f-9aa0-47eb-8992-d7083e3bac39 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 289cf5c3-10c7-4a83-94d9-d83623d0c5e7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:33.564437 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f4f174f-9aa0-47eb-8992-d7083e3bac39 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:33.568640 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f4f174f-9aa0-47eb-8992-d7083e3bac39 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:33.568640 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f4f174f-9aa0-47eb-8992-d7083e3bac39 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:33.568640 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f4f174f-9aa0-47eb-8992-d7083e3bac39 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:33.754024 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9f4f174f-9aa0-47eb-8992-d7083e3bac39 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:33.761910 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9f4f174f-9aa0-47eb-8992-d7083e3bac39 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7" status: 200 len: 1306 microversion: 2.1 time: 0.214532 Jun 10 18:08:33.762581 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1598/3297] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:33 2022] GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7 => generated 1306 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:33.925364 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7595783d-d0f1-401f-8a41-7acf58c1ac44 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:33.926176 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7595783d-d0f1-401f-8a41-7acf58c1ac44 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:33.932892 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7595783d-d0f1-401f-8a41-7acf58c1ac44 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:33.933344 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7595783d-d0f1-401f-8a41-7acf58c1ac44 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:33.934114 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7595783d-d0f1-401f-8a41-7acf58c1ac44 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:33.934548 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7595783d-d0f1-401f-8a41-7acf58c1ac44 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:34.081762 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7595783d-d0f1-401f-8a41-7acf58c1ac44 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:34.089448 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7595783d-d0f1-401f-8a41-7acf58c1ac44 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1504 microversion: 2.1 time: 0.168463 Jun 10 18:08:34.090035 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1700/3298] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:33 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:34.213633 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e81420b8-4a48-4018-9512-1b51cea2f1b5 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:34.214605 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e81420b8-4a48-4018-9512-1b51cea2f1b5 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:34.222132 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e81420b8-4a48-4018-9512-1b51cea2f1b5 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:34.222783 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e81420b8-4a48-4018-9512-1b51cea2f1b5 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:34.223807 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e81420b8-4a48-4018-9512-1b51cea2f1b5 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:34.223997 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e81420b8-4a48-4018-9512-1b51cea2f1b5 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:34.323050 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-04e45609-d657-4ee2-b780-c417ee84266c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:34.323697 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-04e45609-d657-4ee2-b780-c417ee84266c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 1f619a78-8e18-41fa-bb60-88d513d84cd8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:34.334985 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-04e45609-d657-4ee2-b780-c417ee84266c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:34.334985 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-04e45609-d657-4ee2-b780-c417ee84266c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:34.334985 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-04e45609-d657-4ee2-b780-c417ee84266c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:34.334985 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-04e45609-d657-4ee2-b780-c417ee84266c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:34.449725 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e81420b8-4a48-4018-9512-1b51cea2f1b5 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4caa591fe84879a787d0601f2d8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53380f847a949a0b61c83fc5661d236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:34.461522 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e81420b8-4a48-4018-9512-1b51cea2f1b5 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1" status: 200 len: 1371 microversion: 2.1 time: 0.251559 Jun 10 18:08:34.473850 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1599/3299] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:34 2022] GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1 => generated 1371 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:34.479722 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0405f15a-adcb-4d8a-8f50-86c7ffb66a1e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:34.480365 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0405f15a-adcb-4d8a-8f50-86c7ffb66a1e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: ea345031-5220-43d0-9971-ada561720697] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:34.488641 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0405f15a-adcb-4d8a-8f50-86c7ffb66a1e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:34.489357 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0405f15a-adcb-4d8a-8f50-86c7ffb66a1e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:34.490385 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0405f15a-adcb-4d8a-8f50-86c7ffb66a1e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:34.491024 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0405f15a-adcb-4d8a-8f50-86c7ffb66a1e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:34.508427 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-04e45609-d657-4ee2-b780-c417ee84266c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:34.519702 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-04e45609-d657-4ee2-b780-c417ee84266c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/1f619a78-8e18-41fa-bb60-88d513d84cd8" status: 200 len: 1473 microversion: 2.1 time: 0.200439 Jun 10 18:08:34.520662 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1701/3300] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:34 2022] GET /compute/v2.1/servers/1f619a78-8e18-41fa-bb60-88d513d84cd8 => generated 1473 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:08:34.585101 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0405f15a-adcb-4d8a-8f50-86c7ffb66a1e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:34.600394 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0405f15a-adcb-4d8a-8f50-86c7ffb66a1e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697" status: 200 len: 1267 microversion: 2.1 time: 0.123525 Jun 10 18:08:34.611867 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1600/3301] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:34 2022] GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697 => generated 1267 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:34.779576 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b9345e10-2298-40bb-92f2-b61b8249888b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:34.780215 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b9345e10-2298-40bb-92f2-b61b8249888b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 289cf5c3-10c7-4a83-94d9-d83623d0c5e7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:34.787542 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9345e10-2298-40bb-92f2-b61b8249888b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:34.788236 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9345e10-2298-40bb-92f2-b61b8249888b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:34.789045 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9345e10-2298-40bb-92f2-b61b8249888b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:34.789486 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9345e10-2298-40bb-92f2-b61b8249888b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:34.972453 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b9345e10-2298-40bb-92f2-b61b8249888b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:34.993937 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b9345e10-2298-40bb-92f2-b61b8249888b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7" status: 200 len: 1306 microversion: 2.1 time: 0.217916 Jun 10 18:08:34.995511 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1702/3302] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:34 2022] GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7 => generated 1306 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:35.086782 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-ddb86568-fd89-47ee-a12b-ca547646bc9d req-5e857074-c881-462b-b502-188559b7a7a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f619a78-8e18-41fa-bb60-88d513d84cd8", "name": "network-vif-deleted", "tag": "a5f5b662-6669-42d0-933b-d82008924db0"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:08:35.112192 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-94d72fc3-3118-439a-8dda-d1b73fb046df tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:35.113134 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-94d72fc3-3118-439a-8dda-d1b73fb046df tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:35.136295 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-94d72fc3-3118-439a-8dda-d1b73fb046df tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:35.136996 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-94d72fc3-3118-439a-8dda-d1b73fb046df tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:35.137766 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-94d72fc3-3118-439a-8dda-d1b73fb046df tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:35.138210 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-94d72fc3-3118-439a-8dda-d1b73fb046df tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:35.142078 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-ddb86568-fd89-47ee-a12b-ca547646bc9d req-5e857074-c881-462b-b502-188559b7a7a6 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:35.142833 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-ddb86568-fd89-47ee-a12b-ca547646bc9d req-5e857074-c881-462b-b502-188559b7a7a6 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:35.164966 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-ddb86568-fd89-47ee-a12b-ca547646bc9d req-5e857074-c881-462b-b502-188559b7a7a6 service nova] Creating event network-vif-deleted:a5f5b662-6669-42d0-933b-d82008924db0 for instance 1f619a78-8e18-41fa-bb60-88d513d84cd8 on chh1-master-2 Jun 10 18:08:35.176485 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-ddb86568-fd89-47ee-a12b-ca547646bc9d req-5e857074-c881-462b-b502-188559b7a7a6 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093739 Jun 10 18:08:35.198235 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1601/3303] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:08:35.397380 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-94d72fc3-3118-439a-8dda-d1b73fb046df tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:35.409714 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-94d72fc3-3118-439a-8dda-d1b73fb046df tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1504 microversion: 2.1 time: 0.306524 Jun 10 18:08:35.410343 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1703/3304] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:35 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1504 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:35.480204 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cb1d44fa-2726-4b1b-8fc2-8bac2a0709d2 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:35.481873 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cb1d44fa-2726-4b1b-8fc2-8bac2a0709d2 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:35.493742 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cb1d44fa-2726-4b1b-8fc2-8bac2a0709d2 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:35.494432 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cb1d44fa-2726-4b1b-8fc2-8bac2a0709d2 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:35.495375 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cb1d44fa-2726-4b1b-8fc2-8bac2a0709d2 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:35.496160 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cb1d44fa-2726-4b1b-8fc2-8bac2a0709d2 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:35.537782 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-12e052c3-e94f-4858-a536-e4343caed9cb tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:35.538760 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-12e052c3-e94f-4858-a536-e4343caed9cb tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 1f619a78-8e18-41fa-bb60-88d513d84cd8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:35.545146 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-12e052c3-e94f-4858-a536-e4343caed9cb tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:35.545893 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-12e052c3-e94f-4858-a536-e4343caed9cb tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:35.547430 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-12e052c3-e94f-4858-a536-e4343caed9cb tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:35.548117 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-12e052c3-e94f-4858-a536-e4343caed9cb tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:35.597271 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-12e052c3-e94f-4858-a536-e4343caed9cb tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:35.598504 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-12e052c3-e94f-4858-a536-e4343caed9cb tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:35.599322 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-12e052c3-e94f-4858-a536-e4343caed9cb tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lazy-loading 'fault' on Instance uuid 1f619a78-8e18-41fa-bb60-88d513d84cd8 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:08:35.663652 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-12e052c3-e94f-4858-a536-e4343caed9cb tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:35.676297 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-12e052c3-e94f-4858-a536-e4343caed9cb tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/1f619a78-8e18-41fa-bb60-88d513d84cd8" status: 200 len: 1307 microversion: 2.1 time: 0.142591 Jun 10 18:08:35.686677 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1704/3305] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:35 2022] GET /compute/v2.1/servers/1f619a78-8e18-41fa-bb60-88d513d84cd8 => generated 1307 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:08:35.691920 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-090c2873-e3bd-4ca5-b544-98dab5cb0d2e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:35.695187 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-090c2873-e3bd-4ca5-b544-98dab5cb0d2e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: ea345031-5220-43d0-9971-ada561720697] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:35.701725 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-090c2873-e3bd-4ca5-b544-98dab5cb0d2e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:35.702709 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-090c2873-e3bd-4ca5-b544-98dab5cb0d2e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:35.703767 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-090c2873-e3bd-4ca5-b544-98dab5cb0d2e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:35.704290 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-090c2873-e3bd-4ca5-b544-98dab5cb0d2e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:35.711356 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cb1d44fa-2726-4b1b-8fc2-8bac2a0709d2 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4caa591fe84879a787d0601f2d8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53380f847a949a0b61c83fc5661d236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:35.721606 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cb1d44fa-2726-4b1b-8fc2-8bac2a0709d2 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1" status: 200 len: 1371 microversion: 2.1 time: 0.245544 Jun 10 18:08:35.722832 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1602/3306] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:35 2022] GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1 => generated 1371 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:35.778464 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-090c2873-e3bd-4ca5-b544-98dab5cb0d2e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:35.788092 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-090c2873-e3bd-4ca5-b544-98dab5cb0d2e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697" status: 200 len: 1273 microversion: 2.1 time: 0.109131 Jun 10 18:08:35.788715 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1705/3307] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:35 2022] GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697 => generated 1273 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:36.011282 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-29f03033-574d-4c16-868f-2977f8ca22df tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:36.011919 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-29f03033-574d-4c16-868f-2977f8ca22df tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 289cf5c3-10c7-4a83-94d9-d83623d0c5e7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:36.018967 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-29f03033-574d-4c16-868f-2977f8ca22df tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:36.019421 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-29f03033-574d-4c16-868f-2977f8ca22df tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:36.020194 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-29f03033-574d-4c16-868f-2977f8ca22df tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:36.020658 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-29f03033-574d-4c16-868f-2977f8ca22df tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:36.156944 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-29f03033-574d-4c16-868f-2977f8ca22df tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:36.171128 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-29f03033-574d-4c16-868f-2977f8ca22df tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7" status: 200 len: 1306 microversion: 2.1 time: 0.158445 Jun 10 18:08:36.171128 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1603/3308] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:36 2022] GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7 => generated 1306 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:36.433716 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c303a8e3-a870-4a7c-b98f-601c948a3b7f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:36.435220 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c303a8e3-a870-4a7c-b98f-601c948a3b7f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:36.442523 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c303a8e3-a870-4a7c-b98f-601c948a3b7f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:36.443240 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c303a8e3-a870-4a7c-b98f-601c948a3b7f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:36.444677 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c303a8e3-a870-4a7c-b98f-601c948a3b7f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:36.446107 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c303a8e3-a870-4a7c-b98f-601c948a3b7f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:36.613351 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c303a8e3-a870-4a7c-b98f-601c948a3b7f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:36.622271 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c303a8e3-a870-4a7c-b98f-601c948a3b7f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1504 microversion: 2.1 time: 0.199358 Jun 10 18:08:36.622856 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1604/3309] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:36 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1504 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:36.694484 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c602b44f-0590-483c-bce5-da8595025917 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:36.695165 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c602b44f-0590-483c-bce5-da8595025917 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 1f619a78-8e18-41fa-bb60-88d513d84cd8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:36.702964 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c602b44f-0590-483c-bce5-da8595025917 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:36.703414 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c602b44f-0590-483c-bce5-da8595025917 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:36.704188 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c602b44f-0590-483c-bce5-da8595025917 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:36.704652 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c602b44f-0590-483c-bce5-da8595025917 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:36.719819 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-c602b44f-0590-483c-bce5-da8595025917 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] HTTP exception thrown: Instance 1f619a78-8e18-41fa-bb60-88d513d84cd8 could not be found. Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c602b44f-0590-483c-bce5-da8595025917 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Request method failure captured: Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/1f619a78-8e18-41fa-bb60-88d513d84cd8 HTTP/1.1 Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4fu_AYOPdFFJd8JVAYOTheTFSnyPZ-qiPxdNG_pAfWLUrJ5f24u96zVdpuDpUlsPTInijfnJBXVbodAhbFGtTke7WBdKaH4uaKtjYUFQOzVbOhDwYx8uvcAx6JIEZVUJCzrT5Zs3s_HlXd7mITajtJGPkUNp7u0UhMy3r7J2GEvLGU Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: bb2c4b1067ac4cab8b8565bc987f00b1 Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersOnMultiNodesTest-1408923964 Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/bb2c4b1067ac4cab8b8565bc987f00b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bb2c4b1067ac4cab8b8565bc987f00b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bb2c4b1067ac4cab8b8565bc987f00b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_bb2c4b1067ac4cab8b8565bc987f00b1", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersOnMultiNodesTest-1408923964 Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: bb2c4b1067ac4cab8b8565bc987f00b1 Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1408923964 Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersOnMultiNodesTest-1408923964-project Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 9c189471a3ab4ec2b644b3ee1352d4e6 Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersOnMultiNodesTest-1408923964-project Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 1f619a78-8e18-41fa-bb60-88d513d84cd8 could not be found. Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '1f619a78-8e18-41fa-bb60-88d513d84cd8'} Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f619a78-8e18-41fa-bb60-88d513d84cd8 could not be found. Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f619a78-8e18-41fa-bb60-88d513d84cd8 could not be found. Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:08:36.731142 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:08:36.735819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:08:36.735819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:08:36.735819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:08:36.735819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:08:36.735819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:08:36.735819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f619a78-8e18-41fa-bb60-88d513d84cd8 could not be found. Jun 10 18:08:36.735819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:08:36.735819 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c602b44f-0590-483c-bce5-da8595025917 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Returning 404 to user: Instance 1f619a78-8e18-41fa-bb60-88d513d84cd8 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:08:36.735819 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c602b44f-0590-483c-bce5-da8595025917 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/1f619a78-8e18-41fa-bb60-88d513d84cd8" status: 404 len: 111 microversion: 2.1 time: 0.032726 Jun 10 18:08:36.735819 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1605/3310] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:36 2022] GET /compute/v2.1/servers/1f619a78-8e18-41fa-bb60-88d513d84cd8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:08:36.735819 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-88ea67fb-c041-469c-9e21-403a90bd2a7b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:36.735819 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-88ea67fb-c041-469c-9e21-403a90bd2a7b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: db296b3f-c053-4988-933b-b5d6673853b4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:36.739748 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:08:36.741288 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-88ea67fb-c041-469c-9e21-403a90bd2a7b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:36.741751 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-88ea67fb-c041-469c-9e21-403a90bd2a7b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:36.742540 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-88ea67fb-c041-469c-9e21-403a90bd2a7b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:36.742989 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-88ea67fb-c041-469c-9e21-403a90bd2a7b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:36.770851 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6891d973-b579-4c4f-9889-3adb9b37753e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-45885879", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": "none"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:08:36.784238 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-88ea67fb-c041-469c-9e21-403a90bd2a7b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: db296b3f-c053-4988-933b-b5d6673853b4] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:08:36.837128 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-6891d973-b579-4c4f-9889-3adb9b37753e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:08:36.837646 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-6891d973-b579-4c4f-9889-3adb9b37753e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:08:36.838199 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-6891d973-b579-4c4f-9889-3adb9b37753e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:08:36.838684 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-6891d973-b579-4c4f-9889-3adb9b37753e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:08:36.839176 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-6891d973-b579-4c4f-9889-3adb9b37753e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:08:36.848333 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6891d973-b579-4c4f-9889-3adb9b37753e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:36.848865 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6891d973-b579-4c4f-9889-3adb9b37753e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:36.850005 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6891d973-b579-4c4f-9889-3adb9b37753e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:36.850516 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6891d973-b579-4c4f-9889-3adb9b37753e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:36.869137 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-6891d973-b579-4c4f-9889-3adb9b37753e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Getting quotas for project 899cb2a2846949f1bd8482b3b8f1b176. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:08:36.874534 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-6891d973-b579-4c4f-9889-3adb9b37753e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Getting quotas for user 44285f249557488ea96367d7eeccf276 and project 899cb2a2846949f1bd8482b3b8f1b176. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:08:36.887152 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6891d973-b579-4c4f-9889-3adb9b37753e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:08:36.889536 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6891d973-b579-4c4f-9889-3adb9b37753e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:08:37.141095 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6891d973-b579-4c4f-9889-3adb9b37753e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.751055 Jun 10 18:08:37.142293 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1706/3311] 10.222.0.35 () {62 vars in 1187 bytes} [Fri Jun 10 18:08:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 10 18:08:37.150578 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2a7902fc-0f94-4414-8440-c6af2f987625 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:37.151491 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2a7902fc-0f94-4414-8440-c6af2f987625 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:37.158173 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2a7902fc-0f94-4414-8440-c6af2f987625 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:37.158939 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2a7902fc-0f94-4414-8440-c6af2f987625 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:37.160003 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2a7902fc-0f94-4414-8440-c6af2f987625 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:37.160687 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2a7902fc-0f94-4414-8440-c6af2f987625 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:37.219244 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-88ea67fb-c041-469c-9e21-403a90bd2a7b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "DELETE /compute/v2.1/servers/db296b3f-c053-4988-933b-b5d6673853b4" status: 204 len: 0 microversion: 2.1 time: 0.490084 Jun 10 18:08:37.220756 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1606/3312] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:08:36 2022] DELETE /compute/v2.1/servers/db296b3f-c053-4988-933b-b5d6673853b4 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:08:37.229759 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1fc32ef5-2a4a-4537-941c-d636881eb96c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:37.230683 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1fc32ef5-2a4a-4537-941c-d636881eb96c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: ea345031-5220-43d0-9971-ada561720697] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:37.238050 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1fc32ef5-2a4a-4537-941c-d636881eb96c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:37.238955 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1fc32ef5-2a4a-4537-941c-d636881eb96c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:37.240083 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1fc32ef5-2a4a-4537-941c-d636881eb96c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:37.241326 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1fc32ef5-2a4a-4537-941c-d636881eb96c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:37.407267 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1fc32ef5-2a4a-4537-941c-d636881eb96c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:37.418130 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1fc32ef5-2a4a-4537-941c-d636881eb96c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697" status: 200 len: 1315 microversion: 2.1 time: 0.195763 Jun 10 18:08:37.418716 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1607/3313] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:37 2022] GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:37.429318 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-a0c27c9e-024d-4142-84c0-31aaab76115b req-423a1008-c967-41ba-bad1-ffa18b8d45b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea345031-5220-43d0-9971-ada561720697", "tag": "ae82cc20-9d2b-43b8-bd6a-60e640f9e53a"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:08:37.438971 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-a0c27c9e-024d-4142-84c0-31aaab76115b req-423a1008-c967-41ba-bad1-ffa18b8d45b8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:37.439479 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-a0c27c9e-024d-4142-84c0-31aaab76115b req-423a1008-c967-41ba-bad1-ffa18b8d45b8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:37.450997 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-a0c27c9e-024d-4142-84c0-31aaab76115b req-423a1008-c967-41ba-bad1-ffa18b8d45b8 service nova] Creating event network-changed:ae82cc20-9d2b-43b8-bd6a-60e640f9e53a for instance ea345031-5220-43d0-9971-ada561720697 on chh1-master-2 Jun 10 18:08:37.456463 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-a0c27c9e-024d-4142-84c0-31aaab76115b req-423a1008-c967-41ba-bad1-ffa18b8d45b8 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030329 Jun 10 18:08:37.457231 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1608/3314] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:08:37.462384 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9f86fa60-de5c-4297-aa8c-3b6fac19003a tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:37.466221 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9f86fa60-de5c-4297-aa8c-3b6fac19003a tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:37.477643 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2a7902fc-0f94-4414-8440-c6af2f987625 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4caa591fe84879a787d0601f2d8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53380f847a949a0b61c83fc5661d236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:37.486706 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2a7902fc-0f94-4414-8440-c6af2f987625 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1" status: 200 len: 1371 microversion: 2.1 time: 0.343112 Jun 10 18:08:37.494899 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1707/3315] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:37 2022] GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1 => generated 1371 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:37.494899 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8e1c7889-eba7-4f5a-a445-6a6589acaeb3 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:37.494899 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8e1c7889-eba7-4f5a-a445-6a6589acaeb3 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 289cf5c3-10c7-4a83-94d9-d83623d0c5e7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:37.501922 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8e1c7889-eba7-4f5a-a445-6a6589acaeb3 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:37.502603 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8e1c7889-eba7-4f5a-a445-6a6589acaeb3 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:37.503392 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8e1c7889-eba7-4f5a-a445-6a6589acaeb3 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:37.503840 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8e1c7889-eba7-4f5a-a445-6a6589acaeb3 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:37.520882 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9f86fa60-de5c-4297-aa8c-3b6fac19003a tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:37.528634 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9f86fa60-de5c-4297-aa8c-3b6fac19003a tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:37.530143 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9f86fa60-de5c-4297-aa8c-3b6fac19003a tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:37.531386 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9f86fa60-de5c-4297-aa8c-3b6fac19003a tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6" status: 200 len: 1276 microversion: 2.54 time: 0.072920 Jun 10 18:08:37.542749 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1609/3316] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:08:37 2022] GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 => generated 1276 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:08:37.547696 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-062f3b05-a07f-49cc-8cbd-77a3d836126f tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:37.548409 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-062f3b05-a07f-49cc-8cbd-77a3d836126f tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: db296b3f-c053-4988-933b-b5d6673853b4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:37.555250 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-062f3b05-a07f-49cc-8cbd-77a3d836126f tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:37.555699 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-062f3b05-a07f-49cc-8cbd-77a3d836126f tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:37.556500 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-062f3b05-a07f-49cc-8cbd-77a3d836126f tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:37.557449 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-062f3b05-a07f-49cc-8cbd-77a3d836126f tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:37.705310 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-062f3b05-a07f-49cc-8cbd-77a3d836126f tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:37.714411 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-062f3b05-a07f-49cc-8cbd-77a3d836126f tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/db296b3f-c053-4988-933b-b5d6673853b4" status: 200 len: 1473 microversion: 2.1 time: 0.180841 Jun 10 18:08:37.715357 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1610/3317] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:37 2022] GET /compute/v2.1/servers/db296b3f-c053-4988-933b-b5d6673853b4 => generated 1473 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:37.721185 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8e1c7889-eba7-4f5a-a445-6a6589acaeb3 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:37.730270 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8e1c7889-eba7-4f5a-a445-6a6589acaeb3 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7" status: 200 len: 1306 microversion: 2.1 time: 0.241748 Jun 10 18:08:37.731155 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7a377041-8e21-473a-ba0b-d1c445d296ce tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:37.731446 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1708/3318] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:37 2022] GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7 => generated 1306 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:37.734819 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7a377041-8e21-473a-ba0b-d1c445d296ce tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:37.740364 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7a377041-8e21-473a-ba0b-d1c445d296ce tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:37.742402 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7a377041-8e21-473a-ba0b-d1c445d296ce tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:37.743202 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7a377041-8e21-473a-ba0b-d1c445d296ce tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:37.743643 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7a377041-8e21-473a-ba0b-d1c445d296ce tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:37.748047 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:08:37.879923 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7a377041-8e21-473a-ba0b-d1c445d296ce tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:37.888190 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7a377041-8e21-473a-ba0b-d1c445d296ce tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1504 microversion: 2.1 time: 0.171647 Jun 10 18:08:37.897761 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1611/3319] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:37 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:38.435335 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-49681904-0704-46e0-8e17-583623a4b505 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:38.435950 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-49681904-0704-46e0-8e17-583623a4b505 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: ea345031-5220-43d0-9971-ada561720697] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:38.442661 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-49681904-0704-46e0-8e17-583623a4b505 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:38.443160 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-49681904-0704-46e0-8e17-583623a4b505 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:38.443932 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-49681904-0704-46e0-8e17-583623a4b505 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:38.444406 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-49681904-0704-46e0-8e17-583623a4b505 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:38.503914 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c4069fa4-2c4f-472c-85f1-584bc909e5fd tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:38.504591 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c4069fa4-2c4f-472c-85f1-584bc909e5fd tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:38.512829 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c4069fa4-2c4f-472c-85f1-584bc909e5fd tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:38.521106 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c4069fa4-2c4f-472c-85f1-584bc909e5fd tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:38.522301 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c4069fa4-2c4f-472c-85f1-584bc909e5fd tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:38.522755 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c4069fa4-2c4f-472c-85f1-584bc909e5fd tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:38.597385 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-49681904-0704-46e0-8e17-583623a4b505 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:38.605240 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-49681904-0704-46e0-8e17-583623a4b505 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697" status: 200 len: 1315 microversion: 2.1 time: 0.173993 Jun 10 18:08:38.605822 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1709/3320] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:38 2022] GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:38.619775 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6707b22c-3cbb-4cb0-9b1a-6e1af19b6c6c tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:38.620699 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6707b22c-3cbb-4cb0-9b1a-6e1af19b6c6c tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:38.683195 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c4069fa4-2c4f-472c-85f1-584bc909e5fd tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4caa591fe84879a787d0601f2d8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53380f847a949a0b61c83fc5661d236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:38.691477 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c4069fa4-2c4f-472c-85f1-584bc909e5fd tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1" status: 200 len: 1371 microversion: 2.1 time: 0.192009 Jun 10 18:08:38.692141 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1612/3321] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:38 2022] GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1 => generated 1371 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:08:38.708009 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6707b22c-3cbb-4cb0-9b1a-6e1af19b6c6c tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:38.715521 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6707b22c-3cbb-4cb0-9b1a-6e1af19b6c6c tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:38.717087 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6707b22c-3cbb-4cb0-9b1a-6e1af19b6c6c tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:38.718289 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6707b22c-3cbb-4cb0-9b1a-6e1af19b6c6c tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6" status: 200 len: 1276 microversion: 2.54 time: 0.111312 Jun 10 18:08:38.718953 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1710/3322] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:08:38 2022] GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 => generated 1276 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:08:38.732051 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b78b7105-ad3a-49d8-aec9-70c5053731e1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:38.732709 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b78b7105-ad3a-49d8-aec9-70c5053731e1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: db296b3f-c053-4988-933b-b5d6673853b4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:38.739382 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b78b7105-ad3a-49d8-aec9-70c5053731e1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:38.743165 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b78b7105-ad3a-49d8-aec9-70c5053731e1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:38.743165 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b78b7105-ad3a-49d8-aec9-70c5053731e1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:38.743165 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b78b7105-ad3a-49d8-aec9-70c5053731e1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:38.747753 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e77623f7-0d92-487f-a455-c75520ac34f2 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:38.748396 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e77623f7-0d92-487f-a455-c75520ac34f2 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 289cf5c3-10c7-4a83-94d9-d83623d0c5e7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:38.757627 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e77623f7-0d92-487f-a455-c75520ac34f2 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:38.758089 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e77623f7-0d92-487f-a455-c75520ac34f2 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:38.758869 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e77623f7-0d92-487f-a455-c75520ac34f2 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:38.759498 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e77623f7-0d92-487f-a455-c75520ac34f2 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:38.892829 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b78b7105-ad3a-49d8-aec9-70c5053731e1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:38.903663 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b78b7105-ad3a-49d8-aec9-70c5053731e1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/db296b3f-c053-4988-933b-b5d6673853b4" status: 200 len: 1473 microversion: 2.1 time: 0.175326 Jun 10 18:08:38.904444 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1613/3323] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:38 2022] GET /compute/v2.1/servers/db296b3f-c053-4988-933b-b5d6673853b4 => generated 1473 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:38.910342 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d12643d8-9536-4211-829c-91b4a1970e3f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:38.911110 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d12643d8-9536-4211-829c-91b4a1970e3f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:38.913026 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e77623f7-0d92-487f-a455-c75520ac34f2 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:38.917968 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d12643d8-9536-4211-829c-91b4a1970e3f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:38.918500 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d12643d8-9536-4211-829c-91b4a1970e3f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:38.919396 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d12643d8-9536-4211-829c-91b4a1970e3f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:38.919965 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d12643d8-9536-4211-829c-91b4a1970e3f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:38.931133 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e77623f7-0d92-487f-a455-c75520ac34f2 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7" status: 200 len: 1306 microversion: 2.1 time: 0.177065 Jun 10 18:08:38.931133 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1711/3324] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:38 2022] GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7 => generated 1306 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:08:39.063959 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d12643d8-9536-4211-829c-91b4a1970e3f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:39.078502 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d12643d8-9536-4211-829c-91b4a1970e3f tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1504 microversion: 2.1 time: 0.171762 Jun 10 18:08:39.080023 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1614/3325] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:38 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:39.622950 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5fe710c1-c2cc-4169-9270-b9e8714b59b7 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:39.623794 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5fe710c1-c2cc-4169-9270-b9e8714b59b7 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: ea345031-5220-43d0-9971-ada561720697] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:39.631193 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5fe710c1-c2cc-4169-9270-b9e8714b59b7 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:39.631758 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5fe710c1-c2cc-4169-9270-b9e8714b59b7 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:39.632658 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5fe710c1-c2cc-4169-9270-b9e8714b59b7 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:39.633460 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5fe710c1-c2cc-4169-9270-b9e8714b59b7 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:39.709535 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-088f48eb-517f-44fb-aaa6-665481a593ca tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:39.711082 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-088f48eb-517f-44fb-aaa6-665481a593ca tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:39.721621 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-088f48eb-517f-44fb-aaa6-665481a593ca tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:39.721621 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-088f48eb-517f-44fb-aaa6-665481a593ca tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:39.721621 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-088f48eb-517f-44fb-aaa6-665481a593ca tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:39.721621 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-088f48eb-517f-44fb-aaa6-665481a593ca tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:39.773667 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5fe710c1-c2cc-4169-9270-b9e8714b59b7 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:39.781780 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5fe710c1-c2cc-4169-9270-b9e8714b59b7 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697" status: 200 len: 1315 microversion: 2.1 time: 0.162872 Jun 10 18:08:39.782355 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1712/3326] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:39 2022] GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:39.796490 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8499c40a-1c7b-4786-a022-a5b3dbaca61e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:39.797106 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8499c40a-1c7b-4786-a022-a5b3dbaca61e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:39.804255 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8499c40a-1c7b-4786-a022-a5b3dbaca61e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:39.804812 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8499c40a-1c7b-4786-a022-a5b3dbaca61e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:39.806068 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8499c40a-1c7b-4786-a022-a5b3dbaca61e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:39.806577 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8499c40a-1c7b-4786-a022-a5b3dbaca61e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:39.873452 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-088f48eb-517f-44fb-aaa6-665481a593ca tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4caa591fe84879a787d0601f2d8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53380f847a949a0b61c83fc5661d236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:39.873999 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8499c40a-1c7b-4786-a022-a5b3dbaca61e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:39.881601 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-088f48eb-517f-44fb-aaa6-665481a593ca tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1" status: 200 len: 1371 microversion: 2.1 time: 0.176197 Jun 10 18:08:39.882183 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1615/3327] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:39 2022] GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1 => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:08:39.882403 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8499c40a-1c7b-4786-a022-a5b3dbaca61e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:39.883954 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8499c40a-1c7b-4786-a022-a5b3dbaca61e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:39.885150 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8499c40a-1c7b-4786-a022-a5b3dbaca61e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6" status: 200 len: 1328 microversion: 2.54 time: 0.092611 Jun 10 18:08:39.885711 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1713/3328] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:08:39 2022] GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 => generated 1328 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:08:39.921009 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7f7b31ae-c931-4d68-a9a0-52a440875a57 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:39.921643 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7f7b31ae-c931-4d68-a9a0-52a440875a57 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: db296b3f-c053-4988-933b-b5d6673853b4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:39.928291 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7f7b31ae-c931-4d68-a9a0-52a440875a57 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:39.928782 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7f7b31ae-c931-4d68-a9a0-52a440875a57 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:39.929563 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7f7b31ae-c931-4d68-a9a0-52a440875a57 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:39.930011 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7f7b31ae-c931-4d68-a9a0-52a440875a57 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:39.937978 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0b053638-5f2f-4401-84d5-228544fc3d3d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:39.938588 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0b053638-5f2f-4401-84d5-228544fc3d3d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 289cf5c3-10c7-4a83-94d9-d83623d0c5e7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:39.945019 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0b053638-5f2f-4401-84d5-228544fc3d3d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:39.945477 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0b053638-5f2f-4401-84d5-228544fc3d3d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:39.946413 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0b053638-5f2f-4401-84d5-228544fc3d3d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:39.946850 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0b053638-5f2f-4401-84d5-228544fc3d3d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:40.099910 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0b053638-5f2f-4401-84d5-228544fc3d3d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:40.100047 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7f7b31ae-c931-4d68-a9a0-52a440875a57 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:40.104250 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:08:40.108919 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0b053638-5f2f-4401-84d5-228544fc3d3d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7" status: 200 len: 1486 microversion: 2.1 time: 0.174764 Jun 10 18:08:40.109423 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7f7b31ae-c931-4d68-a9a0-52a440875a57 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/db296b3f-c053-4988-933b-b5d6673853b4" status: 200 len: 1473 microversion: 2.1 time: 0.191849 Jun 10 18:08:40.112456 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1714/3329] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:39 2022] GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7 => generated 1486 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:40.116663 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-80daf07e-1b87-4190-89ff-9ce63288b9e9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:40.117272 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-80daf07e-1b87-4190-89ff-9ce63288b9e9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:40.119571 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1616/3330] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:39 2022] GET /compute/v2.1/servers/db296b3f-c053-4988-933b-b5d6673853b4 => generated 1473 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:40.123822 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-80daf07e-1b87-4190-89ff-9ce63288b9e9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:40.125193 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-80daf07e-1b87-4190-89ff-9ce63288b9e9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:40.126915 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-80daf07e-1b87-4190-89ff-9ce63288b9e9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:40.128347 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4374c42a-15dd-4a3a-9117-9c896107d31b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:08:40.128347 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4374c42a-15dd-4a3a-9117-9c896107d31b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 289cf5c3-10c7-4a83-94d9-d83623d0c5e7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:40.136601 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-80daf07e-1b87-4190-89ff-9ce63288b9e9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:40.136688 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4374c42a-15dd-4a3a-9117-9c896107d31b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:40.136688 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4374c42a-15dd-4a3a-9117-9c896107d31b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:40.136688 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4374c42a-15dd-4a3a-9117-9c896107d31b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:40.136688 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4374c42a-15dd-4a3a-9117-9c896107d31b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:40.161726 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-4374c42a-15dd-4a3a-9117-9c896107d31b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lazy-loading 'flavor' on Instance uuid 289cf5c3-10c7-4a83-94d9-d83623d0c5e7 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:08:40.281079 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-80daf07e-1b87-4190-89ff-9ce63288b9e9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:40.289256 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:08:40.293930 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-80daf07e-1b87-4190-89ff-9ce63288b9e9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1504 microversion: 2.1 time: 0.182622 Jun 10 18:08:40.294732 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1715/3331] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:40 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1504 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:40.593896 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4374c42a-15dd-4a3a-9117-9c896107d31b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "POST /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7/action" status: 202 len: 0 microversion: 2.1 time: 0.470980 Jun 10 18:08:40.602808 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1617/3332] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:08:40 2022] POST /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7/action => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 18:08:40.604727 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-50007213-0a23-4c16-b1c3-1a759d568f04 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:40.604727 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-50007213-0a23-4c16-b1c3-1a759d568f04 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 289cf5c3-10c7-4a83-94d9-d83623d0c5e7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:40.613110 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-50007213-0a23-4c16-b1c3-1a759d568f04 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:40.613568 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-50007213-0a23-4c16-b1c3-1a759d568f04 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:40.614361 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-50007213-0a23-4c16-b1c3-1a759d568f04 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:40.614806 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-50007213-0a23-4c16-b1c3-1a759d568f04 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:40.800887 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-664549f7-92a1-44d8-8dd1-a4308e0b7353 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:40.801813 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-664549f7-92a1-44d8-8dd1-a4308e0b7353 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: ea345031-5220-43d0-9971-ada561720697] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:40.809280 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-664549f7-92a1-44d8-8dd1-a4308e0b7353 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:40.810021 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-664549f7-92a1-44d8-8dd1-a4308e0b7353 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:40.810912 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-664549f7-92a1-44d8-8dd1-a4308e0b7353 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:40.811821 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-664549f7-92a1-44d8-8dd1-a4308e0b7353 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:40.852489 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-50007213-0a23-4c16-b1c3-1a759d568f04 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:40.861679 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-50007213-0a23-4c16-b1c3-1a759d568f04 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7" status: 200 len: 1494 microversion: 2.1 time: 0.262588 Jun 10 18:08:40.877140 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1716/3333] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:40 2022] GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7 => generated 1494 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:40.899016 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8cb50da1-2555-4c17-8907-ddd956815327 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:40.900169 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8cb50da1-2555-4c17-8907-ddd956815327 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:40.911900 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8cb50da1-2555-4c17-8907-ddd956815327 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:40.912389 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8cb50da1-2555-4c17-8907-ddd956815327 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:40.913175 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8cb50da1-2555-4c17-8907-ddd956815327 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:40.913832 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8cb50da1-2555-4c17-8907-ddd956815327 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:41.099170 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8cb50da1-2555-4c17-8907-ddd956815327 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4caa591fe84879a787d0601f2d8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53380f847a949a0b61c83fc5661d236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:41.106749 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8cb50da1-2555-4c17-8907-ddd956815327 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1" status: 200 len: 1371 microversion: 2.1 time: 0.211605 Jun 10 18:08:41.107349 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1717/3334] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:40 2022] GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1 => generated 1371 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:08:41.111564 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-664549f7-92a1-44d8-8dd1-a4308e0b7353 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:41.112638 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-663d8adf-9a74-46e1-8e4d-905b9a24f7a8 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:41.113439 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-663d8adf-9a74-46e1-8e4d-905b9a24f7a8 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:41.119370 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-664549f7-92a1-44d8-8dd1-a4308e0b7353 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697" status: 200 len: 1315 microversion: 2.1 time: 0.324932 Jun 10 18:08:41.119548 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-663d8adf-9a74-46e1-8e4d-905b9a24f7a8 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:41.119805 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-663d8adf-9a74-46e1-8e4d-905b9a24f7a8 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:41.128639 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1618/3335] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:40 2022] GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697 => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:08:41.128946 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-663d8adf-9a74-46e1-8e4d-905b9a24f7a8 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:41.128946 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-663d8adf-9a74-46e1-8e4d-905b9a24f7a8 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:41.129089 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f2f716f8-590e-43d8-b85f-3a1eaaf807b7 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:41.129089 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f2f716f8-590e-43d8-b85f-3a1eaaf807b7 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: db296b3f-c053-4988-933b-b5d6673853b4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:41.134893 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f2f716f8-590e-43d8-b85f-3a1eaaf807b7 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:41.135610 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f2f716f8-590e-43d8-b85f-3a1eaaf807b7 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:41.140947 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f2f716f8-590e-43d8-b85f-3a1eaaf807b7 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:41.140947 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f2f716f8-590e-43d8-b85f-3a1eaaf807b7 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:41.220240 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-663d8adf-9a74-46e1-8e4d-905b9a24f7a8 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:41.232934 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-663d8adf-9a74-46e1-8e4d-905b9a24f7a8 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:41.234695 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-663d8adf-9a74-46e1-8e4d-905b9a24f7a8 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:41.236154 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-663d8adf-9a74-46e1-8e4d-905b9a24f7a8 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6" status: 200 len: 1334 microversion: 2.54 time: 0.127636 Jun 10 18:08:41.238214 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1718/3336] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:08:41 2022] GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 => generated 1334 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:08:41.316051 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b97c74ac-4053-40e3-9b93-13b672006ff7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:41.316989 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b97c74ac-4053-40e3-9b93-13b672006ff7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:41.326747 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b97c74ac-4053-40e3-9b93-13b672006ff7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:41.326747 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b97c74ac-4053-40e3-9b93-13b672006ff7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:41.326976 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b97c74ac-4053-40e3-9b93-13b672006ff7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:41.327958 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b97c74ac-4053-40e3-9b93-13b672006ff7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:41.480071 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b97c74ac-4053-40e3-9b93-13b672006ff7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:41.489661 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b97c74ac-4053-40e3-9b93-13b672006ff7 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1504 microversion: 2.1 time: 0.182127 Jun 10 18:08:41.492347 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1719/3337] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:41 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1504 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:41.637172 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f2f716f8-590e-43d8-b85f-3a1eaaf807b7 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:41.645423 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f2f716f8-590e-43d8-b85f-3a1eaaf807b7 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/db296b3f-c053-4988-933b-b5d6673853b4" status: 200 len: 1473 microversion: 2.1 time: 0.521197 Jun 10 18:08:41.646022 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1619/3338] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:41 2022] GET /compute/v2.1/servers/db296b3f-c053-4988-933b-b5d6673853b4 => generated 1473 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:41.885466 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0cfb7941-95df-4842-8246-5725a2df6b6e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:41.886303 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0cfb7941-95df-4842-8246-5725a2df6b6e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 289cf5c3-10c7-4a83-94d9-d83623d0c5e7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:41.889216 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-09d4ca86-a583-462c-8ddc-e45b531b8ae3 req-cbbcf731-770a-4b65-93e1-d928f22f835c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db296b3f-c053-4988-933b-b5d6673853b4", "name": "network-vif-deleted", "tag": "f3da2400-2bb5-4986-a700-9e1b527eaeb5"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:08:41.892606 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0cfb7941-95df-4842-8246-5725a2df6b6e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:41.897326 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0cfb7941-95df-4842-8246-5725a2df6b6e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:41.897326 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0cfb7941-95df-4842-8246-5725a2df6b6e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:41.897528 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0cfb7941-95df-4842-8246-5725a2df6b6e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:41.899287 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-09d4ca86-a583-462c-8ddc-e45b531b8ae3 req-cbbcf731-770a-4b65-93e1-d928f22f835c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:41.899743 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-09d4ca86-a583-462c-8ddc-e45b531b8ae3 req-cbbcf731-770a-4b65-93e1-d928f22f835c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:41.913045 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-09d4ca86-a583-462c-8ddc-e45b531b8ae3 req-cbbcf731-770a-4b65-93e1-d928f22f835c service nova] Creating event network-vif-deleted:f3da2400-2bb5-4986-a700-9e1b527eaeb5 for instance db296b3f-c053-4988-933b-b5d6673853b4 on chh2-master-2 Jun 10 18:08:41.920212 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-09d4ca86-a583-462c-8ddc-e45b531b8ae3 req-cbbcf731-770a-4b65-93e1-d928f22f835c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034900 Jun 10 18:08:41.925764 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1620/3339] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:08:42.065770 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0cfb7941-95df-4842-8246-5725a2df6b6e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:42.074676 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0cfb7941-95df-4842-8246-5725a2df6b6e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7" status: 200 len: 1494 microversion: 2.1 time: 0.195339 Jun 10 18:08:42.075974 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1720/3340] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:41 2022] GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7 => generated 1494 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:42.124930 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-536c06b8-8e27-46da-b065-9784cb2be017 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:42.126230 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-536c06b8-8e27-46da-b065-9784cb2be017 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:42.132841 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-536c06b8-8e27-46da-b065-9784cb2be017 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:42.133476 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-536c06b8-8e27-46da-b065-9784cb2be017 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:42.134407 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-536c06b8-8e27-46da-b065-9784cb2be017 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:42.135370 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-536c06b8-8e27-46da-b065-9784cb2be017 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:42.141093 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8ea1d1dd-4b84-4870-9983-94c3cca9d33f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:42.142098 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8ea1d1dd-4b84-4870-9983-94c3cca9d33f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: ea345031-5220-43d0-9971-ada561720697] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:42.149534 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8ea1d1dd-4b84-4870-9983-94c3cca9d33f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:42.150004 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8ea1d1dd-4b84-4870-9983-94c3cca9d33f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:42.151032 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8ea1d1dd-4b84-4870-9983-94c3cca9d33f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:42.151632 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8ea1d1dd-4b84-4870-9983-94c3cca9d33f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:42.380889 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8ea1d1dd-4b84-4870-9983-94c3cca9d33f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:42.384564 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-536c06b8-8e27-46da-b065-9784cb2be017 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4caa591fe84879a787d0601f2d8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53380f847a949a0b61c83fc5661d236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:42.392355 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8ea1d1dd-4b84-4870-9983-94c3cca9d33f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697" status: 200 len: 1315 microversion: 2.1 time: 0.255373 Jun 10 18:08:42.393016 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1721/3341] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:42 2022] GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697 => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:42.393413 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-536c06b8-8e27-46da-b065-9784cb2be017 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1" status: 200 len: 1371 microversion: 2.1 time: 0.272882 Jun 10 18:08:42.394362 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1621/3342] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:42 2022] GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1 => generated 1371 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:42.407348 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5b9d7d9a-9a27-4f98-88bc-fefac03f5e39 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:42.408271 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5b9d7d9a-9a27-4f98-88bc-fefac03f5e39 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:42.415631 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5b9d7d9a-9a27-4f98-88bc-fefac03f5e39 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:42.416143 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5b9d7d9a-9a27-4f98-88bc-fefac03f5e39 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:42.416966 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5b9d7d9a-9a27-4f98-88bc-fefac03f5e39 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:42.417412 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5b9d7d9a-9a27-4f98-88bc-fefac03f5e39 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:42.486545 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5b9d7d9a-9a27-4f98-88bc-fefac03f5e39 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:42.494746 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5b9d7d9a-9a27-4f98-88bc-fefac03f5e39 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:42.496227 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5b9d7d9a-9a27-4f98-88bc-fefac03f5e39 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:42.497399 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5b9d7d9a-9a27-4f98-88bc-fefac03f5e39 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6" status: 200 len: 1334 microversion: 2.54 time: 0.103358 Jun 10 18:08:42.497961 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1722/3343] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:08:42 2022] GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 => generated 1334 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:08:42.508509 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-01e8ec58-f28e-48a4-a8b4-c713e9184aa3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:42.509506 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-01e8ec58-f28e-48a4-a8b4-c713e9184aa3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:42.516278 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-01e8ec58-f28e-48a4-a8b4-c713e9184aa3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:42.516768 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-01e8ec58-f28e-48a4-a8b4-c713e9184aa3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:42.519512 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-01e8ec58-f28e-48a4-a8b4-c713e9184aa3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:42.519512 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-01e8ec58-f28e-48a4-a8b4-c713e9184aa3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:42.651702 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-01e8ec58-f28e-48a4-a8b4-c713e9184aa3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:42.662834 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-baa6b086-f88a-4777-97e3-2c4a42e954b3 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:42.663435 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-baa6b086-f88a-4777-97e3-2c4a42e954b3 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: db296b3f-c053-4988-933b-b5d6673853b4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:42.669234 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-01e8ec58-f28e-48a4-a8b4-c713e9184aa3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1504 microversion: 2.1 time: 0.165894 Jun 10 18:08:42.670133 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1622/3344] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:42 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:42.670270 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-baa6b086-f88a-4777-97e3-2c4a42e954b3 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:42.670822 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-baa6b086-f88a-4777-97e3-2c4a42e954b3 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:42.672173 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-baa6b086-f88a-4777-97e3-2c4a42e954b3 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:42.672652 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-baa6b086-f88a-4777-97e3-2c4a42e954b3 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:42.737381 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-baa6b086-f88a-4777-97e3-2c4a42e954b3 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:42.745136 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-baa6b086-f88a-4777-97e3-2c4a42e954b3 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/db296b3f-c053-4988-933b-b5d6673853b4" status: 200 len: 1431 microversion: 2.1 time: 0.086774 Jun 10 18:08:42.745716 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1723/3345] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:42 2022] GET /compute/v2.1/servers/db296b3f-c053-4988-933b-b5d6673853b4 => generated 1431 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:42.785396 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-34998d87-c17e-4358-9ec7-99ab7f5e5f17 req-8fe84146-870b-4c5f-87cf-4cea31b35604 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea345031-5220-43d0-9971-ada561720697", "name": "network-vif-plugged", "status": "completed", "tag": "ae82cc20-9d2b-43b8-bd6a-60e640f9e53a"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:08:42.794735 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-34998d87-c17e-4358-9ec7-99ab7f5e5f17 req-8fe84146-870b-4c5f-87cf-4cea31b35604 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:42.795176 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-34998d87-c17e-4358-9ec7-99ab7f5e5f17 req-8fe84146-870b-4c5f-87cf-4cea31b35604 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:42.806923 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-34998d87-c17e-4358-9ec7-99ab7f5e5f17 req-8fe84146-870b-4c5f-87cf-4cea31b35604 service nova] Creating event network-vif-plugged:ae82cc20-9d2b-43b8-bd6a-60e640f9e53a for instance ea345031-5220-43d0-9971-ada561720697 on chh1-master-2 Jun 10 18:08:42.812002 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-34998d87-c17e-4358-9ec7-99ab7f5e5f17 req-8fe84146-870b-4c5f-87cf-4cea31b35604 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030327 Jun 10 18:08:42.813232 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1623/3346] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:08:43.092181 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-40bff187-2026-4862-841d-edc545e94e84 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:43.092863 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-40bff187-2026-4862-841d-edc545e94e84 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 289cf5c3-10c7-4a83-94d9-d83623d0c5e7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:43.099978 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-40bff187-2026-4862-841d-edc545e94e84 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:43.100472 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-40bff187-2026-4862-841d-edc545e94e84 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:43.101355 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-40bff187-2026-4862-841d-edc545e94e84 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:43.101868 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-40bff187-2026-4862-841d-edc545e94e84 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:43.235036 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-40bff187-2026-4862-841d-edc545e94e84 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:43.242556 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-40bff187-2026-4862-841d-edc545e94e84 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7" status: 200 len: 1494 microversion: 2.1 time: 0.154274 Jun 10 18:08:43.243125 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1724/3347] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:43 2022] GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7 => generated 1494 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:43.411199 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d3b4b828-31ce-4af1-b1f8-65342e1482c4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:43.411932 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d3b4b828-31ce-4af1-b1f8-65342e1482c4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: ea345031-5220-43d0-9971-ada561720697] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:43.413933 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c68369f1-5467-45de-8b30-03b671eb828b tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:43.414754 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c68369f1-5467-45de-8b30-03b671eb828b tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:43.418504 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d3b4b828-31ce-4af1-b1f8-65342e1482c4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:43.418959 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d3b4b828-31ce-4af1-b1f8-65342e1482c4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:43.419731 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d3b4b828-31ce-4af1-b1f8-65342e1482c4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:43.420169 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d3b4b828-31ce-4af1-b1f8-65342e1482c4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:43.421290 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c68369f1-5467-45de-8b30-03b671eb828b tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:43.421752 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c68369f1-5467-45de-8b30-03b671eb828b tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:43.423153 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c68369f1-5467-45de-8b30-03b671eb828b tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:43.423597 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c68369f1-5467-45de-8b30-03b671eb828b tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:43.571121 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d3b4b828-31ce-4af1-b1f8-65342e1482c4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:43.581849 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c68369f1-5467-45de-8b30-03b671eb828b tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4caa591fe84879a787d0601f2d8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53380f847a949a0b61c83fc5661d236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:43.582257 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d3b4b828-31ce-4af1-b1f8-65342e1482c4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697" status: 200 len: 1315 microversion: 2.1 time: 0.176351 Jun 10 18:08:43.583407 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1624/3348] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:43 2022] GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:43.588489 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0d031747-ec8d-443b-b7da-edde86240116 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:43.589285 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0d031747-ec8d-443b-b7da-edde86240116 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:43.590232 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c68369f1-5467-45de-8b30-03b671eb828b tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1" status: 200 len: 1371 microversion: 2.1 time: 0.180329 Jun 10 18:08:43.590939 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1725/3349] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:43 2022] GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1 => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:08:43.597677 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0d031747-ec8d-443b-b7da-edde86240116 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:43.598322 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0d031747-ec8d-443b-b7da-edde86240116 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:43.599630 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0d031747-ec8d-443b-b7da-edde86240116 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:43.600892 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0d031747-ec8d-443b-b7da-edde86240116 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:43.673910 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0d031747-ec8d-443b-b7da-edde86240116 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:43.682588 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0d031747-ec8d-443b-b7da-edde86240116 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:43.684134 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0d031747-ec8d-443b-b7da-edde86240116 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:43.685472 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0d031747-ec8d-443b-b7da-edde86240116 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6" status: 200 len: 1355 microversion: 2.54 time: 0.100821 Jun 10 18:08:43.686051 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1625/3350] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:08:43 2022] GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 => generated 1355 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:08:43.688145 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-21b10585-9ccc-48af-a9ec-d915429eae74 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:43.688740 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-21b10585-9ccc-48af-a9ec-d915429eae74 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:43.696408 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-21b10585-9ccc-48af-a9ec-d915429eae74 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:43.696828 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-21b10585-9ccc-48af-a9ec-d915429eae74 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:43.697676 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-21b10585-9ccc-48af-a9ec-d915429eae74 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:43.701699 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-21b10585-9ccc-48af-a9ec-d915429eae74 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:43.711845 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a8955e74-ad6c-4abb-b36b-0130e3a3f89c tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Action: 'create', calling method: .version_select at 0x7f77c122e940>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1271853710", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDKZXvNJA/TKsPCbvbqMgVrLDN/zfOgfNbE1G5GrvBDOunyOQQrwDvQsC+jWZXT4+kkg5kAR+jTnFFMkPOTkN9xrcR14188xgEiWWVLuX5zPZKHURaEwiIc33aGPGVcO4Q=="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:08:43.728767 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-a8955e74-ad6c-4abb-b36b-0130e3a3f89c tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Getting quotas for project 899cb2a2846949f1bd8482b3b8f1b176. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:08:43.735565 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-a8955e74-ad6c-4abb-b36b-0130e3a3f89c tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Getting quotas for user 44285f249557488ea96367d7eeccf276 and project 899cb2a2846949f1bd8482b3b8f1b176. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:08:43.843215 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a8955e74-ad6c-4abb-b36b-0130e3a3f89c tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.135819 Jun 10 18:08:43.844465 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1626/3351] 10.222.0.35 () {62 vars in 1199 bytes} [Fri Jun 10 18:08:43 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 138 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 10 18:08:43.849305 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-eb27fde3-7830-4705-a774-5e27a627156b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:43.850318 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-eb27fde3-7830-4705-a774-5e27a627156b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: db296b3f-c053-4988-933b-b5d6673853b4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:43.856679 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eb27fde3-7830-4705-a774-5e27a627156b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:43.857139 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eb27fde3-7830-4705-a774-5e27a627156b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:43.857913 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eb27fde3-7830-4705-a774-5e27a627156b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:43.858352 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eb27fde3-7830-4705-a774-5e27a627156b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:43.862080 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-21b10585-9ccc-48af-a9ec-d915429eae74 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:43.870453 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-21b10585-9ccc-48af-a9ec-d915429eae74 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1504 microversion: 2.1 time: 0.187310 Jun 10 18:08:43.880464 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1726/3352] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:43 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1504 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:08:43.880464 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-64036cf8-e427-41a4-88ec-e77ae25cc460 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1271853710", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:08:43.880464 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-64036cf8-e427-41a4-88ec-e77ae25cc460 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:43.885065 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-64036cf8-e427-41a4-88ec-e77ae25cc460 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:43.885589 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-64036cf8-e427-41a4-88ec-e77ae25cc460 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:43.886435 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-64036cf8-e427-41a4-88ec-e77ae25cc460 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:43.886945 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-64036cf8-e427-41a4-88ec-e77ae25cc460 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:43.949531 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-eb27fde3-7830-4705-a774-5e27a627156b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:43.959929 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-eb27fde3-7830-4705-a774-5e27a627156b tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/db296b3f-c053-4988-933b-b5d6673853b4" status: 200 len: 1302 microversion: 2.1 time: 0.114249 Jun 10 18:08:43.970462 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1627/3353] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:43 2022] GET /compute/v2.1/servers/db296b3f-c053-4988-933b-b5d6673853b4 => generated 1302 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:43.993619 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-64036cf8-e427-41a4-88ec-e77ae25cc460 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:08:43.994042 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-64036cf8-e427-41a4-88ec-e77ae25cc460 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:08:43.994521 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-64036cf8-e427-41a4-88ec-e77ae25cc460 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:08:43.994930 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-64036cf8-e427-41a4-88ec-e77ae25cc460 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:08:43.995343 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-64036cf8-e427-41a4-88ec-e77ae25cc460 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:08:44.261255 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2f6068c5-0872-4eda-9929-c26558718361 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:44.262226 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2f6068c5-0872-4eda-9929-c26558718361 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 289cf5c3-10c7-4a83-94d9-d83623d0c5e7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:44.275972 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2f6068c5-0872-4eda-9929-c26558718361 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:44.276454 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2f6068c5-0872-4eda-9929-c26558718361 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:44.277380 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2f6068c5-0872-4eda-9929-c26558718361 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:44.278014 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2f6068c5-0872-4eda-9929-c26558718361 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:44.316475 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:08:44.462979 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2f6068c5-0872-4eda-9929-c26558718361 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:44.471171 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2f6068c5-0872-4eda-9929-c26558718361 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7" status: 200 len: 1477 microversion: 2.1 time: 0.214207 Jun 10 18:08:44.471759 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1628/3354] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:44 2022] GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7 => generated 1477 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:08:44.483755 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-64036cf8-e427-41a4-88ec-e77ae25cc460 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:44.487403 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-55250916-cf56-4aa5-924f-642e8f6705c6 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-737443567"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:08:44.488701 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-55250916-cf56-4aa5-924f-642e8f6705c6 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 289cf5c3-10c7-4a83-94d9-d83623d0c5e7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:44.490459 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-64036cf8-e427-41a4-88ec-e77ae25cc460 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:44.490843 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-64036cf8-e427-41a4-88ec-e77ae25cc460 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:44.491646 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-64036cf8-e427-41a4-88ec-e77ae25cc460 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:44.492147 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-64036cf8-e427-41a4-88ec-e77ae25cc460 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:44.495597 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-55250916-cf56-4aa5-924f-642e8f6705c6 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:44.496234 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-55250916-cf56-4aa5-924f-642e8f6705c6 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:44.500813 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-55250916-cf56-4aa5-924f-642e8f6705c6 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:44.500813 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-55250916-cf56-4aa5-924f-642e8f6705c6 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:44.533142 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-64036cf8-e427-41a4-88ec-e77ae25cc460 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "POST /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6/action" status: 202 len: 1138 microversion: 2.54 time: 0.660992 Jun 10 18:08:44.533787 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1727/3355] 10.222.0.35 () {62 vars in 1319 bytes} [Fri Jun 10 18:08:43 2022] POST /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6/action => generated 1138 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jun 10 18:08:44.550880 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-514ab817-1358-4f60-aa36-bd5e38d31ba2 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:44.551622 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-514ab817-1358-4f60-aa36-bd5e38d31ba2 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:44.558537 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-514ab817-1358-4f60-aa36-bd5e38d31ba2 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:44.559044 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-514ab817-1358-4f60-aa36-bd5e38d31ba2 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:44.559915 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-514ab817-1358-4f60-aa36-bd5e38d31ba2 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:44.560382 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-514ab817-1358-4f60-aa36-bd5e38d31ba2 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:44.663214 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-514ab817-1358-4f60-aa36-bd5e38d31ba2 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:44.675830 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-514ab817-1358-4f60-aa36-bd5e38d31ba2 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:44.677383 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-514ab817-1358-4f60-aa36-bd5e38d31ba2 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:44.678690 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-514ab817-1358-4f60-aa36-bd5e38d31ba2 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6" status: 200 len: 1407 microversion: 2.54 time: 0.133103 Jun 10 18:08:44.684517 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1728/3356] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:08:44 2022] GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 => generated 1407 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:08:44.688867 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-518261e9-a52c-4e5c-a9ca-4cd2b94d77ae tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:44.689835 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-518261e9-a52c-4e5c-a9ca-4cd2b94d77ae tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: ea345031-5220-43d0-9971-ada561720697] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:44.696348 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:08:44.700981 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-518261e9-a52c-4e5c-a9ca-4cd2b94d77ae tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:44.701524 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-518261e9-a52c-4e5c-a9ca-4cd2b94d77ae tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:44.702314 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-518261e9-a52c-4e5c-a9ca-4cd2b94d77ae tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:44.702792 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-518261e9-a52c-4e5c-a9ca-4cd2b94d77ae tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:44.708227 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:08:44.843103 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-518261e9-a52c-4e5c-a9ca-4cd2b94d77ae tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:44.851406 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-518261e9-a52c-4e5c-a9ca-4cd2b94d77ae tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697" status: 200 len: 1501 microversion: 2.1 time: 0.170956 Jun 10 18:08:44.852173 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1729/3357] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:44 2022] GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697 => generated 1501 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:44.862291 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2bc22790-00c6-4ad2-929b-c233a183fb61 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:44.862903 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2bc22790-00c6-4ad2-929b-c233a183fb61 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:44.870744 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2bc22790-00c6-4ad2-929b-c233a183fb61 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:44.871145 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2bc22790-00c6-4ad2-929b-c233a183fb61 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:44.872029 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2bc22790-00c6-4ad2-929b-c233a183fb61 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:44.872630 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2bc22790-00c6-4ad2-929b-c233a183fb61 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:45.035145 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2bc22790-00c6-4ad2-929b-c233a183fb61 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4caa591fe84879a787d0601f2d8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53380f847a949a0b61c83fc5661d236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:45.048812 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2bc22790-00c6-4ad2-929b-c233a183fb61 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1" status: 200 len: 1371 microversion: 2.1 time: 0.190676 Jun 10 18:08:45.058544 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1730/3358] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:44 2022] GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1 => generated 1371 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:45.065278 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-34430d58-6abe-4886-96d8-f2312e56e9a0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:45.066041 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-34430d58-6abe-4886-96d8-f2312e56e9a0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:45.072297 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-34430d58-6abe-4886-96d8-f2312e56e9a0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:45.073049 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-34430d58-6abe-4886-96d8-f2312e56e9a0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:45.073878 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-34430d58-6abe-4886-96d8-f2312e56e9a0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:45.075045 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-34430d58-6abe-4886-96d8-f2312e56e9a0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:45.181024 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-55250916-cf56-4aa5-924f-642e8f6705c6 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "POST /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7/action" status: 202 len: 0 microversion: 2.1 time: 0.697122 Jun 10 18:08:45.181806 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1629/3359] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:08:44 2022] POST /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7/action => generated 0 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jun 10 18:08:45.188687 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-70b16ef0-a4eb-4807-af15-7a8b07e62012 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:45.189770 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-70b16ef0-a4eb-4807-af15-7a8b07e62012 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: db296b3f-c053-4988-933b-b5d6673853b4] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:45.197128 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70b16ef0-a4eb-4807-af15-7a8b07e62012 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:45.197811 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70b16ef0-a4eb-4807-af15-7a8b07e62012 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:45.198671 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70b16ef0-a4eb-4807-af15-7a8b07e62012 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:45.199387 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70b16ef0-a4eb-4807-af15-7a8b07e62012 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:45.241399 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70b16ef0-a4eb-4807-af15-7a8b07e62012 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:45.241856 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70b16ef0-a4eb-4807-af15-7a8b07e62012 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:45.242498 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-70b16ef0-a4eb-4807-af15-7a8b07e62012 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lazy-loading 'fault' on Instance uuid db296b3f-c053-4988-933b-b5d6673853b4 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:08:45.255735 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-34430d58-6abe-4886-96d8-f2312e56e9a0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:45.264458 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-34430d58-6abe-4886-96d8-f2312e56e9a0 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 200 len: 1447 microversion: 2.1 time: 0.204739 Jun 10 18:08:45.265069 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1731/3360] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:45 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 1447 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:45.269770 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-42d9674b-87d9-461c-8ef9-f3a036cb9b3a tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77b3cfcd30>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:45.298440 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-70b16ef0-a4eb-4807-af15-7a8b07e62012 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:45.307358 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-70b16ef0-a4eb-4807-af15-7a8b07e62012 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/db296b3f-c053-4988-933b-b5d6673853b4" status: 200 len: 1307 microversion: 2.1 time: 0.124208 Jun 10 18:08:45.307935 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1630/3361] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:45 2022] GET /compute/v2.1/servers/db296b3f-c053-4988-933b-b5d6673853b4 => generated 1307 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:45.312466 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8440363b-7d5e-495a-a94f-9ac87494ebb2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:45.313080 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8440363b-7d5e-495a-a94f-9ac87494ebb2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:45.316293 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-42d9674b-87d9-461c-8ef9-f3a036cb9b3a tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a" status: 200 len: 1435 microversion: 2.1 time: 0.050098 Jun 10 18:08:45.317334 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1732/3362] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:08:45 2022] GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a => generated 1435 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:45.319267 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8440363b-7d5e-495a-a94f-9ac87494ebb2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:45.319785 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8440363b-7d5e-495a-a94f-9ac87494ebb2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:45.320773 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8440363b-7d5e-495a-a94f-9ac87494ebb2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:45.321241 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8440363b-7d5e-495a-a94f-9ac87494ebb2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:45.470344 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8440363b-7d5e-495a-a94f-9ac87494ebb2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:45.479106 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8440363b-7d5e-495a-a94f-9ac87494ebb2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.169240 Jun 10 18:08:45.482052 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1631/3363] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:45 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:45.511470 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-55713b19-28e1-4541-8553-9c22af777f7e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:45.512151 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-55713b19-28e1-4541-8553-9c22af777f7e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:45.519502 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-55713b19-28e1-4541-8553-9c22af777f7e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:45.519952 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-55713b19-28e1-4541-8553-9c22af777f7e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:45.520744 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-55713b19-28e1-4541-8553-9c22af777f7e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:45.521178 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-55713b19-28e1-4541-8553-9c22af777f7e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:45.654357 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-55713b19-28e1-4541-8553-9c22af777f7e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:45.662370 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-55713b19-28e1-4541-8553-9c22af777f7e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.156106 Jun 10 18:08:45.662957 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1733/3364] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:45 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:45.684073 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5a555e0e-3941-410a-9bf5-7bb77e66367c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:45.684787 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5a555e0e-3941-410a-9bf5-7bb77e66367c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:45.695237 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5a555e0e-3941-410a-9bf5-7bb77e66367c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:45.696451 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5a555e0e-3941-410a-9bf5-7bb77e66367c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:45.697477 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5a555e0e-3941-410a-9bf5-7bb77e66367c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:45.698120 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5a555e0e-3941-410a-9bf5-7bb77e66367c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:45.699561 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-85c4d01e-ffee-442c-90e4-a6dc4466d3b5 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:45.700425 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-85c4d01e-ffee-442c-90e4-a6dc4466d3b5 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:45.707795 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-85c4d01e-ffee-442c-90e4-a6dc4466d3b5 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:45.711585 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-85c4d01e-ffee-442c-90e4-a6dc4466d3b5 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:45.711585 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-85c4d01e-ffee-442c-90e4-a6dc4466d3b5 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:45.711585 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-85c4d01e-ffee-442c-90e4-a6dc4466d3b5 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:45.792498 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-85c4d01e-ffee-442c-90e4-a6dc4466d3b5 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:45.805637 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-85c4d01e-ffee-442c-90e4-a6dc4466d3b5 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:45.807850 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-85c4d01e-ffee-442c-90e4-a6dc4466d3b5 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:45.809090 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-85c4d01e-ffee-442c-90e4-a6dc4466d3b5 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6" status: 200 len: 1407 microversion: 2.54 time: 0.113991 Jun 10 18:08:45.809920 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1734/3365] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:08:45 2022] GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 => generated 1407 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:08:45.867018 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5a555e0e-3941-410a-9bf5-7bb77e66367c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:45.875059 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5a555e0e-3941-410a-9bf5-7bb77e66367c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.200437 Jun 10 18:08:45.875622 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1632/3366] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:45 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:45.892324 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b8cb7f08-7179-4ce8-ad2e-02c56cba6ae2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:45.892961 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b8cb7f08-7179-4ce8-ad2e-02c56cba6ae2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:45.899156 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b8cb7f08-7179-4ce8-ad2e-02c56cba6ae2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:45.899615 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b8cb7f08-7179-4ce8-ad2e-02c56cba6ae2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:45.900448 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b8cb7f08-7179-4ce8-ad2e-02c56cba6ae2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:45.900944 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b8cb7f08-7179-4ce8-ad2e-02c56cba6ae2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:46.035875 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b8cb7f08-7179-4ce8-ad2e-02c56cba6ae2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:46.043700 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b8cb7f08-7179-4ce8-ad2e-02c56cba6ae2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.156845 Jun 10 18:08:46.044279 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1735/3367] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:45 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:46.059786 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c94b5a45-30b4-471a-b0d7-8559cdbb31c8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:08:46.065936 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-aeeec18d-47fc-453e-bbb2-7c2867e74ca6 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:46.066559 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-aeeec18d-47fc-453e-bbb2-7c2867e74ca6 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:46.066839 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c94b5a45-30b4-471a-b0d7-8559cdbb31c8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:46.067306 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c94b5a45-30b4-471a-b0d7-8559cdbb31c8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:46.072770 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aeeec18d-47fc-453e-bbb2-7c2867e74ca6 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:46.080431 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aeeec18d-47fc-453e-bbb2-7c2867e74ca6 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:46.080431 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aeeec18d-47fc-453e-bbb2-7c2867e74ca6 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:46.080431 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aeeec18d-47fc-453e-bbb2-7c2867e74ca6 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:46.092531 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c94b5a45-30b4-471a-b0d7-8559cdbb31c8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Going to try to stop instance {{(pid=126595) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 10 18:08:46.219604 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-aeeec18d-47fc-453e-bbb2-7c2867e74ca6 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4caa591fe84879a787d0601f2d8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53380f847a949a0b61c83fc5661d236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:46.227240 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-aeeec18d-47fc-453e-bbb2-7c2867e74ca6 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1" status: 200 len: 1371 microversion: 2.1 time: 0.165628 Jun 10 18:08:46.227880 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1736/3368] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:46 2022] GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:08:46.327460 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-87e57399-c690-46f8-9558-d67f618fd619 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:46.329145 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-87e57399-c690-46f8-9558-d67f618fd619 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: db296b3f-c053-4988-933b-b5d6673853b4] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:46.332981 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c94b5a45-30b4-471a-b0d7-8559cdbb31c8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "POST /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1/action" status: 202 len: 0 microversion: 2.1 time: 0.276633 Jun 10 18:08:46.334332 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1633/3369] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:08:46 2022] POST /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:08:46.339166 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-87e57399-c690-46f8-9558-d67f618fd619 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:46.339823 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-87e57399-c690-46f8-9558-d67f618fd619 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:46.341231 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-87e57399-c690-46f8-9558-d67f618fd619 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:46.341833 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-87e57399-c690-46f8-9558-d67f618fd619 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:46.343355 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0572b5d2-459d-4fd1-851c-28121cc06b41 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c1a3aa60>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:46.360004 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-87e57399-c690-46f8-9558-d67f618fd619 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] HTTP exception thrown: Instance db296b3f-c053-4988-933b-b5d6673853b4 could not be found. Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-87e57399-c690-46f8-9558-d67f618fd619 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Request method failure captured: Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/db296b3f-c053-4988-933b-b5d6673853b4 HTTP/1.1 Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4fu_AYOPdFFJd8JVAYOTheTFSnyPZ-qiPxdNG_pAfWLUrJ5f24u96zVdpuDpUlsPTInijfnJBXVbodAhbFGtTke7WBdKaH4uaKtjYUFQOzVbOhDwYx8uvcAx6JIEZVUJCzrT5Zs3s_HlXd7mITajtJGPkUNp7u0UhMy3r7J2GEvLGU Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: bb2c4b1067ac4cab8b8565bc987f00b1 Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersOnMultiNodesTest-1408923964 Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/bb2c4b1067ac4cab8b8565bc987f00b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bb2c4b1067ac4cab8b8565bc987f00b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bb2c4b1067ac4cab8b8565bc987f00b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_bb2c4b1067ac4cab8b8565bc987f00b1", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersOnMultiNodesTest-1408923964 Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: bb2c4b1067ac4cab8b8565bc987f00b1 Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1408923964 Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersOnMultiNodesTest-1408923964-project Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 9c189471a3ab4ec2b644b3ee1352d4e6 Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersOnMultiNodesTest-1408923964-project Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: exception: Instance db296b3f-c053-4988-933b-b5d6673853b4 could not be found. Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'db296b3f-c053-4988-933b-b5d6673853b4'} Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db296b3f-c053-4988-933b-b5d6673853b4 could not be found. Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db296b3f-c053-4988-933b-b5d6673853b4 could not be found. Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:08:46.362528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:08:46.366423 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:08:46.366423 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:08:46.366423 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:08:46.366423 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:08:46.366423 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:08:46.366423 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db296b3f-c053-4988-933b-b5d6673853b4 could not be found. Jun 10 18:08:46.366423 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:08:46.366423 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-87e57399-c690-46f8-9558-d67f618fd619 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Returning 404 to user: Instance db296b3f-c053-4988-933b-b5d6673853b4 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:08:46.366423 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-87e57399-c690-46f8-9558-d67f618fd619 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/db296b3f-c053-4988-933b-b5d6673853b4" status: 404 len: 111 microversion: 2.1 time: 0.042295 Jun 10 18:08:46.367822 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1737/3370] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:46 2022] GET /compute/v2.1/servers/db296b3f-c053-4988-933b-b5d6673853b4 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:08:46.373464 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b44a3fdb-5a52-440e-8004-7eed7a4725f8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:46.374314 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b44a3fdb-5a52-440e-8004-7eed7a4725f8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:46.382194 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b44a3fdb-5a52-440e-8004-7eed7a4725f8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:46.382964 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b44a3fdb-5a52-440e-8004-7eed7a4725f8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:46.384229 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b44a3fdb-5a52-440e-8004-7eed7a4725f8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:46.384846 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b44a3fdb-5a52-440e-8004-7eed7a4725f8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:46.428605 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0572b5d2-459d-4fd1-851c-28121cc06b41 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a" status: 200 len: 1435 microversion: 2.1 time: 0.090051 Jun 10 18:08:46.431917 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1634/3371] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:08:46 2022] GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a => generated 1435 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:46.437415 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5e722146-d326-4a60-928e-a4563ef5402e tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:46.439451 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5e722146-d326-4a60-928e-a4563ef5402e tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 03dcc828-a971-496c-aa8c-28681ec6fc01] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:46.448667 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5e722146-d326-4a60-928e-a4563ef5402e tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:46.449332 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5e722146-d326-4a60-928e-a4563ef5402e tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:46.450452 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5e722146-d326-4a60-928e-a4563ef5402e tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:46.451109 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5e722146-d326-4a60-928e-a4563ef5402e tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:46.482308 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5e722146-d326-4a60-928e-a4563ef5402e tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 03dcc828-a971-496c-aa8c-28681ec6fc01] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:08:46.584535 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b44a3fdb-5a52-440e-8004-7eed7a4725f8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:46.595205 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b44a3fdb-5a52-440e-8004-7eed7a4725f8 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1678 microversion: 2.1 time: 0.226036 Jun 10 18:08:46.607537 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1738/3372] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:46 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1678 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:46.622480 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-693946da-bd12-4bec-9022-24208aee0ae6 req-73ad1904-72f8-4f18-a69a-36883c802369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "739d282e-c869-4ebe-b4fb-7122f0070ce1", "name": "network-vif-plugged", "status": "completed", "tag": "a649028f-7a43-401d-adaa-1e45a3ebf42c"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:08:46.632010 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-693946da-bd12-4bec-9022-24208aee0ae6 req-73ad1904-72f8-4f18-a69a-36883c802369 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:46.632783 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-693946da-bd12-4bec-9022-24208aee0ae6 req-73ad1904-72f8-4f18-a69a-36883c802369 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:46.644167 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-693946da-bd12-4bec-9022-24208aee0ae6 req-73ad1904-72f8-4f18-a69a-36883c802369 service nova] Creating event network-vif-plugged:a649028f-7a43-401d-adaa-1e45a3ebf42c for instance 739d282e-c869-4ebe-b4fb-7122f0070ce1 on chh2-master-2 Jun 10 18:08:46.649585 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-693946da-bd12-4bec-9022-24208aee0ae6 req-73ad1904-72f8-4f18-a69a-36883c802369 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034570 Jun 10 18:08:46.650175 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1739/3373] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:08:46.830301 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2a9ba908-00dc-43af-88ec-0e5d8c71c698 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:46.831593 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2a9ba908-00dc-43af-88ec-0e5d8c71c698 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:46.834597 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5e722146-d326-4a60-928e-a4563ef5402e tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "DELETE /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01" status: 204 len: 0 microversion: 2.1 time: 0.401265 Jun 10 18:08:46.835606 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1635/3374] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:08:46 2022] DELETE /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:08:46.845213 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-72d99f4f-56f6-4a69-b7c3-64e67c32f490 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:46.845923 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-72d99f4f-56f6-4a69-b7c3-64e67c32f490 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 03dcc828-a971-496c-aa8c-28681ec6fc01] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:46.863038 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:08:46.863394 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2a9ba908-00dc-43af-88ec-0e5d8c71c698 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:46.863829 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2a9ba908-00dc-43af-88ec-0e5d8c71c698 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:46.864650 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2a9ba908-00dc-43af-88ec-0e5d8c71c698 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:46.865092 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2a9ba908-00dc-43af-88ec-0e5d8c71c698 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:46.872184 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72d99f4f-56f6-4a69-b7c3-64e67c32f490 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:46.872921 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72d99f4f-56f6-4a69-b7c3-64e67c32f490 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:46.873703 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72d99f4f-56f6-4a69-b7c3-64e67c32f490 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:46.874318 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72d99f4f-56f6-4a69-b7c3-64e67c32f490 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:46.965465 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2a9ba908-00dc-43af-88ec-0e5d8c71c698 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:46.974252 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2a9ba908-00dc-43af-88ec-0e5d8c71c698 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:46.975815 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2a9ba908-00dc-43af-88ec-0e5d8c71c698 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:46.977341 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2a9ba908-00dc-43af-88ec-0e5d8c71c698 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6" status: 200 len: 1407 microversion: 2.54 time: 0.151885 Jun 10 18:08:46.981481 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1740/3375] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:08:46 2022] GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:08:47.074604 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-72d99f4f-56f6-4a69-b7c3-64e67c32f490 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:47.082512 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-72d99f4f-56f6-4a69-b7c3-64e67c32f490 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01" status: 200 len: 1472 microversion: 2.1 time: 0.242619 Jun 10 18:08:47.083095 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1636/3376] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:46 2022] GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01 => generated 1472 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:08:47.244609 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3578b668-55db-4572-934b-3d4ef3af05f2 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:47.245231 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3578b668-55db-4572-934b-3d4ef3af05f2 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:47.254137 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3578b668-55db-4572-934b-3d4ef3af05f2 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:47.254858 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3578b668-55db-4572-934b-3d4ef3af05f2 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:47.255651 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3578b668-55db-4572-934b-3d4ef3af05f2 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:47.256137 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3578b668-55db-4572-934b-3d4ef3af05f2 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:47.414217 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3578b668-55db-4572-934b-3d4ef3af05f2 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4caa591fe84879a787d0601f2d8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53380f847a949a0b61c83fc5661d236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:47.422614 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3578b668-55db-4572-934b-3d4ef3af05f2 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1" status: 200 len: 1371 microversion: 2.1 time: 0.182102 Jun 10 18:08:47.423259 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1741/3377] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:47 2022] GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1 => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:47.444042 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7e6d8e37-1b01-45a0-b728-5b930638a9a7 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c1725310>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:47.489422 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7e6d8e37-1b01-45a0-b728-5b930638a9a7 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a" status: 200 len: 1435 microversion: 2.1 time: 0.049215 Jun 10 18:08:47.490046 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1637/3378] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:08:47 2022] GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a => generated 1435 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:47.613272 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a4af74a1-8b18-4a22-b482-fb9b2457d279 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:47.613913 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a4af74a1-8b18-4a22-b482-fb9b2457d279 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:47.620335 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a4af74a1-8b18-4a22-b482-fb9b2457d279 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:47.620834 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a4af74a1-8b18-4a22-b482-fb9b2457d279 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:47.621606 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a4af74a1-8b18-4a22-b482-fb9b2457d279 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:47.622048 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a4af74a1-8b18-4a22-b482-fb9b2457d279 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:47.752517 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a4af74a1-8b18-4a22-b482-fb9b2457d279 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:47.760085 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a4af74a1-8b18-4a22-b482-fb9b2457d279 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1678 microversion: 2.1 time: 0.150754 Jun 10 18:08:47.760697 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1742/3379] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:47 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:47.999188 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2915c40d-ac69-46c2-a87f-e57b5f7f6377 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:48.004958 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2915c40d-ac69-46c2-a87f-e57b5f7f6377 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:48.005904 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ec32e1ad-ae06-497d-8cfe-c12f396fbfe0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ab8c051-595a-45da-af33-0ef000ae7779"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:08:48.007139 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ec32e1ad-ae06-497d-8cfe-c12f396fbfe0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: ea345031-5220-43d0-9971-ada561720697] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:48.012402 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2915c40d-ac69-46c2-a87f-e57b5f7f6377 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:48.012868 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2915c40d-ac69-46c2-a87f-e57b5f7f6377 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:48.013640 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec32e1ad-ae06-497d-8cfe-c12f396fbfe0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:48.013765 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2915c40d-ac69-46c2-a87f-e57b5f7f6377 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:48.014077 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2915c40d-ac69-46c2-a87f-e57b5f7f6377 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:48.014266 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec32e1ad-ae06-497d-8cfe-c12f396fbfe0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:48.015118 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec32e1ad-ae06-497d-8cfe-c12f396fbfe0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:48.015630 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec32e1ad-ae06-497d-8cfe-c12f396fbfe0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:48.089768 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2915c40d-ac69-46c2-a87f-e57b5f7f6377 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:48.098386 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2915c40d-ac69-46c2-a87f-e57b5f7f6377 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:48.099969 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2915c40d-ac69-46c2-a87f-e57b5f7f6377 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:48.101253 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2915c40d-ac69-46c2-a87f-e57b5f7f6377 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6" status: 200 len: 1407 microversion: 2.54 time: 0.107669 Jun 10 18:08:48.101819 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1638/3380] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:08:47 2022] GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 => generated 1407 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:08:48.116471 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f0d08d4c-f057-4e95-9d36-d755c29af52f tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:48.118088 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f0d08d4c-f057-4e95-9d36-d755c29af52f tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 03dcc828-a971-496c-aa8c-28681ec6fc01] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:48.124122 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f0d08d4c-f057-4e95-9d36-d755c29af52f tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:48.124615 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f0d08d4c-f057-4e95-9d36-d755c29af52f tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:48.126106 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f0d08d4c-f057-4e95-9d36-d755c29af52f tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:48.126496 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f0d08d4c-f057-4e95-9d36-d755c29af52f tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:48.258437 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f0d08d4c-f057-4e95-9d36-d755c29af52f tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:48.270998 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f0d08d4c-f057-4e95-9d36-d755c29af52f tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01" status: 200 len: 1472 microversion: 2.1 time: 0.165210 Jun 10 18:08:48.271903 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1639/3381] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:48 2022] GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01 => generated 1472 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:48.439258 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-95fd383b-bb69-4e54-b6a8-b7e742f8b073 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:48.440223 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-95fd383b-bb69-4e54-b6a8-b7e742f8b073 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:48.446356 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-95fd383b-bb69-4e54-b6a8-b7e742f8b073 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:48.446810 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-95fd383b-bb69-4e54-b6a8-b7e742f8b073 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:48.447570 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-95fd383b-bb69-4e54-b6a8-b7e742f8b073 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:48.448006 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-95fd383b-bb69-4e54-b6a8-b7e742f8b073 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:48.612885 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-95fd383b-bb69-4e54-b6a8-b7e742f8b073 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4caa591fe84879a787d0601f2d8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53380f847a949a0b61c83fc5661d236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:48.632960 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-95fd383b-bb69-4e54-b6a8-b7e742f8b073 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1" status: 200 len: 1371 microversion: 2.1 time: 0.197196 Jun 10 18:08:48.633775 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1640/3382] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:48 2022] GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1 => generated 1371 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:48.642462 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-24ffd105-36ab-4100-9f43-3e1c6b168dfd tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c6126790>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:48.709693 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-24ffd105-36ab-4100-9f43-3e1c6b168dfd tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a" status: 200 len: 1435 microversion: 2.1 time: 0.072080 Jun 10 18:08:48.710683 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1641/3383] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:08:48 2022] GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a => generated 1435 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:48.712335 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=8 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:08:48.778621 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-03b24db5-95e4-4638-b264-46285c92f135 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:48.779169 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-03b24db5-95e4-4638-b264-46285c92f135 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:48.785735 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03b24db5-95e4-4638-b264-46285c92f135 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:48.786184 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03b24db5-95e4-4638-b264-46285c92f135 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:48.786947 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03b24db5-95e4-4638-b264-46285c92f135 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:48.787412 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03b24db5-95e4-4638-b264-46285c92f135 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:48.929384 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-03b24db5-95e4-4638-b264-46285c92f135 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:48.933800 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-03b24db5-95e4-4638-b264-46285c92f135 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1678 microversion: 2.1 time: 0.159688 Jun 10 18:08:48.934388 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1642/3384] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:48 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:49.119449 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ec32e1ad-ae06-497d-8cfe-c12f396fbfe0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "POST /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.117611 Jun 10 18:08:49.124825 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b040d43b-8c60-42d9-a497-c6ffea540fc8 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:49.124825 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b040d43b-8c60-42d9-a497-c6ffea540fc8 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:49.125206 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1743/3385] 10.222.0.35 () {60 vars in 1322 bytes} [Fri Jun 10 18:08:47 2022] POST /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697/os-volume_attachments => generated 194 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:08:49.127836 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b040d43b-8c60-42d9-a497-c6ffea540fc8 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:49.128412 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b040d43b-8c60-42d9-a497-c6ffea540fc8 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:49.129217 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b040d43b-8c60-42d9-a497-c6ffea540fc8 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:49.129595 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b040d43b-8c60-42d9-a497-c6ffea540fc8 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:49.199745 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b040d43b-8c60-42d9-a497-c6ffea540fc8 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:49.207510 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:08:49.213580 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b040d43b-8c60-42d9-a497-c6ffea540fc8 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:49.215101 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b040d43b-8c60-42d9-a497-c6ffea540fc8 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:49.216296 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b040d43b-8c60-42d9-a497-c6ffea540fc8 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6" status: 200 len: 1407 microversion: 2.54 time: 0.099833 Jun 10 18:08:49.219177 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1643/3386] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:08:49 2022] GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 => generated 1407 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:08:49.289539 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4cbad45a-720f-4ff8-8c17-dcf0edf206af tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:49.290315 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4cbad45a-720f-4ff8-8c17-dcf0edf206af tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 03dcc828-a971-496c-aa8c-28681ec6fc01] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:49.297560 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4cbad45a-720f-4ff8-8c17-dcf0edf206af tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:49.297949 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4cbad45a-720f-4ff8-8c17-dcf0edf206af tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:49.298741 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4cbad45a-720f-4ff8-8c17-dcf0edf206af tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:49.299182 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4cbad45a-720f-4ff8-8c17-dcf0edf206af tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:49.569104 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4cbad45a-720f-4ff8-8c17-dcf0edf206af tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:49.578368 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4cbad45a-720f-4ff8-8c17-dcf0edf206af tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01" status: 200 len: 1472 microversion: 2.1 time: 0.293090 Jun 10 18:08:49.579269 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1744/3387] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:49 2022] GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01 => generated 1472 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:49.650129 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ae527094-a799-41e2-879e-3b9bdf4c0b9a tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:49.650880 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ae527094-a799-41e2-879e-3b9bdf4c0b9a tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:49.663202 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ae527094-a799-41e2-879e-3b9bdf4c0b9a tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:49.663664 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ae527094-a799-41e2-879e-3b9bdf4c0b9a tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:49.665684 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ae527094-a799-41e2-879e-3b9bdf4c0b9a tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:49.666141 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ae527094-a799-41e2-879e-3b9bdf4c0b9a tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:49.724775 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-89902c53-399c-4315-a63e-4d0db3e76e85 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77b3c8ddc0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:49.795412 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-89902c53-399c-4315-a63e-4d0db3e76e85 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a" status: 200 len: 1435 microversion: 2.1 time: 0.075269 Jun 10 18:08:49.801759 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1745/3388] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:08:49 2022] GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a => generated 1435 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:08:49.886857 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ae527094-a799-41e2-879e-3b9bdf4c0b9a tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4caa591fe84879a787d0601f2d8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53380f847a949a0b61c83fc5661d236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:49.895268 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ae527094-a799-41e2-879e-3b9bdf4c0b9a tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1" status: 200 len: 1371 microversion: 2.1 time: 0.248933 Jun 10 18:08:49.895856 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1644/3389] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:49 2022] GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1 => generated 1371 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:49.952638 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c8168253-86e7-4856-bd22-6db89cbdb5ff tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:49.953974 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c8168253-86e7-4856-bd22-6db89cbdb5ff tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:49.961398 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c8168253-86e7-4856-bd22-6db89cbdb5ff tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:49.962146 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c8168253-86e7-4856-bd22-6db89cbdb5ff tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:49.966782 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c8168253-86e7-4856-bd22-6db89cbdb5ff tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:49.966782 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c8168253-86e7-4856-bd22-6db89cbdb5ff tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:50.100850 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-db59fd8b-7bdf-4a62-b582-2f27963ef230 req-f440e75c-3a1e-4c1d-b802-01e5ff3ee3e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03dcc828-a971-496c-aa8c-28681ec6fc01", "name": "network-vif-deleted", "tag": "0bc2cf3a-92dd-4ff7-9e94-25dfa402dcb0"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:08:50.116733 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-db59fd8b-7bdf-4a62-b582-2f27963ef230 req-f440e75c-3a1e-4c1d-b802-01e5ff3ee3e1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:50.117187 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-db59fd8b-7bdf-4a62-b582-2f27963ef230 req-f440e75c-3a1e-4c1d-b802-01e5ff3ee3e1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:50.144736 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-db59fd8b-7bdf-4a62-b582-2f27963ef230 req-f440e75c-3a1e-4c1d-b802-01e5ff3ee3e1 service nova] Creating event network-vif-deleted:0bc2cf3a-92dd-4ff7-9e94-25dfa402dcb0 for instance 03dcc828-a971-496c-aa8c-28681ec6fc01 on chh2-master-2 Jun 10 18:08:50.151914 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-db59fd8b-7bdf-4a62-b582-2f27963ef230 req-f440e75c-3a1e-4c1d-b802-01e5ff3ee3e1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054793 Jun 10 18:08:50.152566 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1645/3390] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:08:50.177560 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c8168253-86e7-4856-bd22-6db89cbdb5ff tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:50.203263 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c8168253-86e7-4856-bd22-6db89cbdb5ff tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1678 microversion: 2.1 time: 0.255419 Jun 10 18:08:50.205133 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1746/3391] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:49 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1678 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:50.237029 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-51b42cb5-8fc8-4889-bca5-1117ebba8acf tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:50.237757 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-51b42cb5-8fc8-4889-bca5-1117ebba8acf tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:50.241069 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:08:50.254015 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-51b42cb5-8fc8-4889-bca5-1117ebba8acf tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:50.254514 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-51b42cb5-8fc8-4889-bca5-1117ebba8acf tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:50.255328 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-51b42cb5-8fc8-4889-bca5-1117ebba8acf tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:50.255777 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-51b42cb5-8fc8-4889-bca5-1117ebba8acf tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:50.356099 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-51b42cb5-8fc8-4889-bca5-1117ebba8acf tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:50.370117 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-51b42cb5-8fc8-4889-bca5-1117ebba8acf tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:50.375287 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-51b42cb5-8fc8-4889-bca5-1117ebba8acf tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:50.378358 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-51b42cb5-8fc8-4889-bca5-1117ebba8acf tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6" status: 200 len: 1407 microversion: 2.54 time: 0.146648 Jun 10 18:08:50.391390 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1646/3392] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:08:50 2022] GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:08:50.596678 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2049630b-b364-42ff-90d1-a7d8c7734302 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:50.597328 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2049630b-b364-42ff-90d1-a7d8c7734302 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 03dcc828-a971-496c-aa8c-28681ec6fc01] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:50.606413 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2049630b-b364-42ff-90d1-a7d8c7734302 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:50.607092 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2049630b-b364-42ff-90d1-a7d8c7734302 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:50.608038 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2049630b-b364-42ff-90d1-a7d8c7734302 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:50.608890 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2049630b-b364-42ff-90d1-a7d8c7734302 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:50.693496 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2049630b-b364-42ff-90d1-a7d8c7734302 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:50.700908 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:08:50.703487 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2049630b-b364-42ff-90d1-a7d8c7734302 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01" status: 200 len: 1301 microversion: 2.1 time: 0.112258 Jun 10 18:08:50.704132 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1747/3393] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:50 2022] GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01 => generated 1301 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:50.759242 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-82466632-94cc-48b3-8a21-e8a0ff32e256 req-8ebeae2c-e8ca-4ae6-bc25-04d76d94949b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "289cf5c3-10c7-4a83-94d9-d83623d0c5e7", "name": "network-vif-plugged", "status": "completed", "tag": "4e1596e3-56a7-4159-afe3-a1bd5b198fc7"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:08:50.769539 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-82466632-94cc-48b3-8a21-e8a0ff32e256 req-8ebeae2c-e8ca-4ae6-bc25-04d76d94949b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:50.771086 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-82466632-94cc-48b3-8a21-e8a0ff32e256 req-8ebeae2c-e8ca-4ae6-bc25-04d76d94949b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:50.784967 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-82466632-94cc-48b3-8a21-e8a0ff32e256 req-8ebeae2c-e8ca-4ae6-bc25-04d76d94949b service nova] Creating event network-vif-plugged:4e1596e3-56a7-4159-afe3-a1bd5b198fc7 for instance 289cf5c3-10c7-4a83-94d9-d83623d0c5e7 on chh2-master-2 Jun 10 18:08:50.790149 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-82466632-94cc-48b3-8a21-e8a0ff32e256 req-8ebeae2c-e8ca-4ae6-bc25-04d76d94949b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034663 Jun 10 18:08:50.791176 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1647/3394] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:08:50.808890 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c6be254b-4ca3-4c42-b8a3-de445f1b5d0b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c0c22b80>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:50.853917 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c6be254b-4ca3-4c42-b8a3-de445f1b5d0b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a" status: 200 len: 1435 microversion: 2.1 time: 0.048928 Jun 10 18:08:50.854498 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1748/3395] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:08:50 2022] GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a => generated 1435 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:50.913674 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-72572806-2d62-4998-846b-457a7e00aba5 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:50.914654 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-72572806-2d62-4998-846b-457a7e00aba5 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:50.922183 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72572806-2d62-4998-846b-457a7e00aba5 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:50.922633 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72572806-2d62-4998-846b-457a7e00aba5 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:50.923645 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72572806-2d62-4998-846b-457a7e00aba5 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:50.924171 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72572806-2d62-4998-846b-457a7e00aba5 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:51.082595 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-72572806-2d62-4998-846b-457a7e00aba5 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4caa591fe84879a787d0601f2d8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53380f847a949a0b61c83fc5661d236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:51.094952 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-72572806-2d62-4998-846b-457a7e00aba5 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1" status: 200 len: 1556 microversion: 2.1 time: 0.185534 Jun 10 18:08:51.106577 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1648/3396] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:50 2022] GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1 => generated 1556 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:51.113025 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7afa4dc0-8f8e-41d3-8445-633715f4d099 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:51.113528 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7afa4dc0-8f8e-41d3-8445-633715f4d099 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:51.121080 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7afa4dc0-8f8e-41d3-8445-633715f4d099 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:51.121636 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7afa4dc0-8f8e-41d3-8445-633715f4d099 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:51.122563 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7afa4dc0-8f8e-41d3-8445-633715f4d099 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:51.123126 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7afa4dc0-8f8e-41d3-8445-633715f4d099 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:51.211725 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7afa4dc0-8f8e-41d3-8445-633715f4d099 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102896 Jun 10 18:08:51.212346 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1749/3397] 10.222.0.35 () {58 vars in 1274 bytes} [Fri Jun 10 18:08:51 2022] GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:08:51.223823 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1033c6bd-3c92-4c4b-a80d-85d8f63f00ca tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:51.226988 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1033c6bd-3c92-4c4b-a80d-85d8f63f00ca tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:51.250600 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1033c6bd-3c92-4c4b-a80d-85d8f63f00ca tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:51.253312 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1033c6bd-3c92-4c4b-a80d-85d8f63f00ca tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:51.255085 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1033c6bd-3c92-4c4b-a80d-85d8f63f00ca tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:51.256338 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1033c6bd-3c92-4c4b-a80d-85d8f63f00ca tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:51.400231 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fa0b1683-f7c8-47da-8e71-9e200d6670c0 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:51.401381 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fa0b1683-f7c8-47da-8e71-9e200d6670c0 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:51.429991 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fa0b1683-f7c8-47da-8e71-9e200d6670c0 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:51.430470 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fa0b1683-f7c8-47da-8e71-9e200d6670c0 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:51.431265 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fa0b1683-f7c8-47da-8e71-9e200d6670c0 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:51.431716 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fa0b1683-f7c8-47da-8e71-9e200d6670c0 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:51.528257 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fa0b1683-f7c8-47da-8e71-9e200d6670c0 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:51.536569 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fa0b1683-f7c8-47da-8e71-9e200d6670c0 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:51.538076 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fa0b1683-f7c8-47da-8e71-9e200d6670c0 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:51.539251 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fa0b1683-f7c8-47da-8e71-9e200d6670c0 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6" status: 200 len: 1407 microversion: 2.54 time: 0.143377 Jun 10 18:08:51.540019 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1750/3398] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:08:51 2022] GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 => generated 1407 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:08:51.581343 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1033c6bd-3c92-4c4b-a80d-85d8f63f00ca tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:51.589549 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1033c6bd-3c92-4c4b-a80d-85d8f63f00ca tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1678 microversion: 2.1 time: 0.371574 Jun 10 18:08:51.594116 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1649/3399] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:51 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1678 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:51.721100 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-04704a39-12eb-4f0d-8924-b35307bf2d5a tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:51.722128 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-04704a39-12eb-4f0d-8924-b35307bf2d5a tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 03dcc828-a971-496c-aa8c-28681ec6fc01] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:51.730460 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-04704a39-12eb-4f0d-8924-b35307bf2d5a tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:51.731200 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-04704a39-12eb-4f0d-8924-b35307bf2d5a tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:51.732076 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-04704a39-12eb-4f0d-8924-b35307bf2d5a tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:51.732607 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-04704a39-12eb-4f0d-8924-b35307bf2d5a tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:51.747730 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-04704a39-12eb-4f0d-8924-b35307bf2d5a tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] HTTP exception thrown: Instance 03dcc828-a971-496c-aa8c-28681ec6fc01 could not be found. Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-04704a39-12eb-4f0d-8924-b35307bf2d5a tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Request method failure captured: Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01 HTTP/1.1 Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4fu_AYOPdFFJd8JVAYOTheTFSnyPZ-qiPxdNG_pAfWLUrJ5f24u96zVdpuDpUlsPTInijfnJBXVbodAhbFGtTke7WBdKaH4uaKtjYUFQOzVbOhDwYx8uvcAx6JIEZVUJCzrT5Zs3s_HlXd7mITajtJGPkUNp7u0UhMy3r7J2GEvLGU Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: bb2c4b1067ac4cab8b8565bc987f00b1 Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersOnMultiNodesTest-1408923964 Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/bb2c4b1067ac4cab8b8565bc987f00b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bb2c4b1067ac4cab8b8565bc987f00b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bb2c4b1067ac4cab8b8565bc987f00b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_bb2c4b1067ac4cab8b8565bc987f00b1", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersOnMultiNodesTest-1408923964 Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: bb2c4b1067ac4cab8b8565bc987f00b1 Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1408923964 Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersOnMultiNodesTest-1408923964-project Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 9c189471a3ab4ec2b644b3ee1352d4e6 Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersOnMultiNodesTest-1408923964-project Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 03dcc828-a971-496c-aa8c-28681ec6fc01 could not be found. Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '03dcc828-a971-496c-aa8c-28681ec6fc01'} Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03dcc828-a971-496c-aa8c-28681ec6fc01 could not be found. Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03dcc828-a971-496c-aa8c-28681ec6fc01 could not be found. Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:08:51.749512 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:08:51.753829 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:08:51.753829 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:08:51.753829 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:08:51.753829 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:08:51.753829 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:08:51.753829 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03dcc828-a971-496c-aa8c-28681ec6fc01 could not be found. Jun 10 18:08:51.753829 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:08:51.756292 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-04704a39-12eb-4f0d-8924-b35307bf2d5a tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Returning 404 to user: Instance 03dcc828-a971-496c-aa8c-28681ec6fc01 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:08:51.757315 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-04704a39-12eb-4f0d-8924-b35307bf2d5a tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01" status: 404 len: 111 microversion: 2.1 time: 0.040646 Jun 10 18:08:51.757968 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1751/3400] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:51 2022] GET /compute/v2.1/servers/03dcc828-a971-496c-aa8c-28681ec6fc01 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:08:51.770102 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-10f9b4e0-f814-4e11-85ca-5ec2156c9b3d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:51.770650 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-10f9b4e0-f814-4e11-85ca-5ec2156c9b3d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: f448b274-8163-42f3-9eea-1e4f3458dd2b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:51.778394 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10f9b4e0-f814-4e11-85ca-5ec2156c9b3d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:51.778852 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10f9b4e0-f814-4e11-85ca-5ec2156c9b3d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:51.779887 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10f9b4e0-f814-4e11-85ca-5ec2156c9b3d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:51.780552 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10f9b4e0-f814-4e11-85ca-5ec2156c9b3d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:51.809831 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-10f9b4e0-f814-4e11-85ca-5ec2156c9b3d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: f448b274-8163-42f3-9eea-1e4f3458dd2b] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:08:51.867812 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-78fc646e-e035-444e-a36a-8045e0b853df tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c6106ee0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:51.913391 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-78fc646e-e035-444e-a36a-8045e0b853df tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a" status: 200 len: 1435 microversion: 2.1 time: 0.050025 Jun 10 18:08:51.914006 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1752/3401] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:08:51 2022] GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a => generated 1435 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:08:52.123950 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-10f9b4e0-f814-4e11-85ca-5ec2156c9b3d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "DELETE /compute/v2.1/servers/f448b274-8163-42f3-9eea-1e4f3458dd2b" status: 204 len: 0 microversion: 2.1 time: 0.360912 Jun 10 18:08:52.128758 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1650/3402] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:08:51 2022] DELETE /compute/v2.1/servers/f448b274-8163-42f3-9eea-1e4f3458dd2b => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:08:52.134011 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bbe191a9-bcdb-4a2d-9826-aa8d12b17aa6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:52.134530 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bbe191a9-bcdb-4a2d-9826-aa8d12b17aa6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: d4580fa2-bf3a-4dc7-af2b-0d6af14508b3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:52.144515 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bbe191a9-bcdb-4a2d-9826-aa8d12b17aa6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:52.145385 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bbe191a9-bcdb-4a2d-9826-aa8d12b17aa6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:52.147557 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bbe191a9-bcdb-4a2d-9826-aa8d12b17aa6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:52.148440 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bbe191a9-bcdb-4a2d-9826-aa8d12b17aa6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:52.191682 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bbe191a9-bcdb-4a2d-9826-aa8d12b17aa6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: d4580fa2-bf3a-4dc7-af2b-0d6af14508b3] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:08:52.493112 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-b6641b9b-975f-4315-adc0-252889c32c9a req-68d775a5-e2e9-42da-af65-3886b28e89a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "739d282e-c869-4ebe-b4fb-7122f0070ce1", "tag": "a649028f-7a43-401d-adaa-1e45a3ebf42c"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:08:52.510120 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-b6641b9b-975f-4315-adc0-252889c32c9a req-68d775a5-e2e9-42da-af65-3886b28e89a3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:52.511115 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-b6641b9b-975f-4315-adc0-252889c32c9a req-68d775a5-e2e9-42da-af65-3886b28e89a3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:52.525479 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-b6641b9b-975f-4315-adc0-252889c32c9a req-68d775a5-e2e9-42da-af65-3886b28e89a3 service nova] Creating event network-changed:a649028f-7a43-401d-adaa-1e45a3ebf42c for instance 739d282e-c869-4ebe-b4fb-7122f0070ce1 on chh2-master-2 Jun 10 18:08:52.532521 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-b6641b9b-975f-4315-adc0-252889c32c9a req-68d775a5-e2e9-42da-af65-3886b28e89a3 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050559 Jun 10 18:08:52.533133 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1651/3403] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:08:52.561420 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5af34ffd-cfda-4737-8603-5e3e3198976b tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:52.562507 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5af34ffd-cfda-4737-8603-5e3e3198976b tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:52.570989 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5af34ffd-cfda-4737-8603-5e3e3198976b tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:52.571861 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5af34ffd-cfda-4737-8603-5e3e3198976b tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:52.572906 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5af34ffd-cfda-4737-8603-5e3e3198976b tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:52.573431 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5af34ffd-cfda-4737-8603-5e3e3198976b tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:52.594318 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bbe191a9-bcdb-4a2d-9826-aa8d12b17aa6 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "DELETE /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3" status: 204 len: 0 microversion: 2.1 time: 0.462598 Jun 10 18:08:52.596767 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1753/3404] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:08:52 2022] DELETE /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:08:52.611046 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-05774c77-32dc-4497-8927-28271be9230c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:52.612005 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-05774c77-32dc-4497-8927-28271be9230c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: f448b274-8163-42f3-9eea-1e4f3458dd2b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:52.621517 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-05774c77-32dc-4497-8927-28271be9230c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:52.622132 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-05774c77-32dc-4497-8927-28271be9230c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:52.622905 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-05774c77-32dc-4497-8927-28271be9230c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:52.623360 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-05774c77-32dc-4497-8927-28271be9230c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:52.667955 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5af34ffd-cfda-4737-8603-5e3e3198976b tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:52.678732 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5af34ffd-cfda-4737-8603-5e3e3198976b tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:52.680821 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5af34ffd-cfda-4737-8603-5e3e3198976b tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:52.682331 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5af34ffd-cfda-4737-8603-5e3e3198976b tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6" status: 200 len: 1407 microversion: 2.54 time: 0.127285 Jun 10 18:08:52.692984 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1652/3405] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:08:52 2022] GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 => generated 1407 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:08:52.704679 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b798c062-a281-4ccd-836d-2e305c265ad9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:52.705315 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b798c062-a281-4ccd-836d-2e305c265ad9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:52.726918 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b798c062-a281-4ccd-836d-2e305c265ad9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:52.727687 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b798c062-a281-4ccd-836d-2e305c265ad9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:52.728517 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b798c062-a281-4ccd-836d-2e305c265ad9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:52.729139 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b798c062-a281-4ccd-836d-2e305c265ad9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:52.883050 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-05774c77-32dc-4497-8927-28271be9230c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:52.894539 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-05774c77-32dc-4497-8927-28271be9230c tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/f448b274-8163-42f3-9eea-1e4f3458dd2b" status: 200 len: 1474 microversion: 2.1 time: 0.293210 Jun 10 18:08:52.906546 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1754/3406] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:52 2022] GET /compute/v2.1/servers/f448b274-8163-42f3-9eea-1e4f3458dd2b => generated 1474 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:52.931391 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ada0600d-ac13-455b-b2e2-969eeb76cb77 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c0365f70>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:52.974587 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b798c062-a281-4ccd-836d-2e305c265ad9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:52.983364 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b798c062-a281-4ccd-836d-2e305c265ad9 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1678 microversion: 2.1 time: 0.289186 Jun 10 18:08:52.983976 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1653/3407] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:52 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1678 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:53.010854 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ada0600d-ac13-455b-b2e2-969eeb76cb77 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a" status: 200 len: 1435 microversion: 2.1 time: 0.087487 Jun 10 18:08:53.013182 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1755/3408] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:08:52 2022] GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a => generated 1435 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:08:53.706878 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5733c719-be8a-40fb-86c8-5085cade6284 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:53.707897 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5733c719-be8a-40fb-86c8-5085cade6284 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:53.715205 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5733c719-be8a-40fb-86c8-5085cade6284 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:53.715673 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5733c719-be8a-40fb-86c8-5085cade6284 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:53.716560 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5733c719-be8a-40fb-86c8-5085cade6284 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:53.717399 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5733c719-be8a-40fb-86c8-5085cade6284 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:53.760725 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=14 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:08:53.808205 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5733c719-be8a-40fb-86c8-5085cade6284 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:53.817074 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5733c719-be8a-40fb-86c8-5085cade6284 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:53.818849 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5733c719-be8a-40fb-86c8-5085cade6284 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:53.820377 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5733c719-be8a-40fb-86c8-5085cade6284 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6" status: 200 len: 1407 microversion: 2.54 time: 0.117800 Jun 10 18:08:53.821531 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1654/3409] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:08:53 2022] GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 => generated 1407 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:08:53.919835 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c6012f3b-2049-44b7-9414-74ef0a71675d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:53.919835 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c6012f3b-2049-44b7-9414-74ef0a71675d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: f448b274-8163-42f3-9eea-1e4f3458dd2b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:53.933292 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c6012f3b-2049-44b7-9414-74ef0a71675d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:53.933758 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c6012f3b-2049-44b7-9414-74ef0a71675d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:53.939145 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c6012f3b-2049-44b7-9414-74ef0a71675d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:53.939614 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c6012f3b-2049-44b7-9414-74ef0a71675d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:54.002257 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e52345bd-9613-49ea-b2b0-ddd137a23471 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:54.003524 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e52345bd-9613-49ea-b2b0-ddd137a23471 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:54.017519 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e52345bd-9613-49ea-b2b0-ddd137a23471 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:54.017988 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e52345bd-9613-49ea-b2b0-ddd137a23471 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:54.018781 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e52345bd-9613-49ea-b2b0-ddd137a23471 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:54.020977 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e52345bd-9613-49ea-b2b0-ddd137a23471 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:54.216553 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e52345bd-9613-49ea-b2b0-ddd137a23471 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:54.226058 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e52345bd-9613-49ea-b2b0-ddd137a23471 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1678 microversion: 2.1 time: 0.227944 Jun 10 18:08:54.227286 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1655/3410] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:53 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1678 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:54.240536 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0b7e3a05-c70a-43f5-976c-f2ba09bc8be4 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c62ccf70>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:54.301015 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0b7e3a05-c70a-43f5-976c-f2ba09bc8be4 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a" status: 200 len: 1435 microversion: 2.1 time: 0.071781 Jun 10 18:08:54.302236 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1656/3411] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:08:54 2022] GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a => generated 1435 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:54.341751 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c6012f3b-2049-44b7-9414-74ef0a71675d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:54.356011 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c6012f3b-2049-44b7-9414-74ef0a71675d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/f448b274-8163-42f3-9eea-1e4f3458dd2b" status: 200 len: 1474 microversion: 2.1 time: 0.445753 Jun 10 18:08:54.356961 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1756/3412] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:53 2022] GET /compute/v2.1/servers/f448b274-8163-42f3-9eea-1e4f3458dd2b => generated 1474 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:54.766801 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-ceda0266-de05-4867-9641-08cc3c645b57 req-12bbe592-35d2-49a9-844e-bcbcd859629b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f448b274-8163-42f3-9eea-1e4f3458dd2b", "name": "network-vif-deleted", "tag": "70b6fde1-0c64-4e89-803e-1fa13a46aaf6"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:08:54.781247 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-ceda0266-de05-4867-9641-08cc3c645b57 req-12bbe592-35d2-49a9-844e-bcbcd859629b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:54.784808 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-ceda0266-de05-4867-9641-08cc3c645b57 req-12bbe592-35d2-49a9-844e-bcbcd859629b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:54.823775 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-ceda0266-de05-4867-9641-08cc3c645b57 req-12bbe592-35d2-49a9-844e-bcbcd859629b service nova] Creating event network-vif-deleted:70b6fde1-0c64-4e89-803e-1fa13a46aaf6 for instance f448b274-8163-42f3-9eea-1e4f3458dd2b on chh1-master-2 Jun 10 18:08:54.839128 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-ceda0266-de05-4867-9641-08cc3c645b57 req-12bbe592-35d2-49a9-844e-bcbcd859629b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076083 Jun 10 18:08:54.839328 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-38ee4a67-bc2c-465d-8bb5-71a2383f92e2 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:54.839859 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-38ee4a67-bc2c-465d-8bb5-71a2383f92e2 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:54.842728 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1657/3413] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:08:54.851895 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-38ee4a67-bc2c-465d-8bb5-71a2383f92e2 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:54.854944 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-38ee4a67-bc2c-465d-8bb5-71a2383f92e2 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:54.855945 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-38ee4a67-bc2c-465d-8bb5-71a2383f92e2 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:54.863453 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-38ee4a67-bc2c-465d-8bb5-71a2383f92e2 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:55.075089 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-38ee4a67-bc2c-465d-8bb5-71a2383f92e2 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:55.090368 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-38ee4a67-bc2c-465d-8bb5-71a2383f92e2 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:55.091890 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-38ee4a67-bc2c-465d-8bb5-71a2383f92e2 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:55.093149 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-38ee4a67-bc2c-465d-8bb5-71a2383f92e2 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6" status: 200 len: 1407 microversion: 2.54 time: 0.257959 Jun 10 18:08:55.111597 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1757/3414] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:08:54 2022] GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 => generated 1407 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:08:55.246559 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-422ecaa3-9381-42b5-af83-b1143aa60209 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:55.247368 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-422ecaa3-9381-42b5-af83-b1143aa60209 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:55.326821 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-422ecaa3-9381-42b5-af83-b1143aa60209 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:55.326821 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-422ecaa3-9381-42b5-af83-b1143aa60209 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:55.326821 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-422ecaa3-9381-42b5-af83-b1143aa60209 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:55.326821 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-422ecaa3-9381-42b5-af83-b1143aa60209 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:55.329507 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-51d785ee-6d28-4526-8334-ec78f19632cb tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77b3c418b0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:55.365349 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-51d785ee-6d28-4526-8334-ec78f19632cb tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a" status: 200 len: 1435 microversion: 2.1 time: 0.051863 Jun 10 18:08:55.365927 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1758/3415] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:08:55 2022] GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a => generated 1435 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:08:55.373929 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-16e439f3-6679-4fef-a8fb-62a93ac29ee1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:55.375063 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-16e439f3-6679-4fef-a8fb-62a93ac29ee1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: f448b274-8163-42f3-9eea-1e4f3458dd2b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:55.381117 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-16e439f3-6679-4fef-a8fb-62a93ac29ee1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:55.381571 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-16e439f3-6679-4fef-a8fb-62a93ac29ee1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:55.382429 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-16e439f3-6679-4fef-a8fb-62a93ac29ee1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:55.382870 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-16e439f3-6679-4fef-a8fb-62a93ac29ee1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:55.405458 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-422ecaa3-9381-42b5-af83-b1143aa60209 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:55.413437 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-422ecaa3-9381-42b5-af83-b1143aa60209 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1678 microversion: 2.1 time: 0.173251 Jun 10 18:08:55.414026 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1658/3416] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:55 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:55.414936 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-16e439f3-6679-4fef-a8fb-62a93ac29ee1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:55.415393 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-16e439f3-6679-4fef-a8fb-62a93ac29ee1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:55.415877 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-16e439f3-6679-4fef-a8fb-62a93ac29ee1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lazy-loading 'fault' on Instance uuid f448b274-8163-42f3-9eea-1e4f3458dd2b {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:08:55.457768 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-16e439f3-6679-4fef-a8fb-62a93ac29ee1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:55.465436 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-16e439f3-6679-4fef-a8fb-62a93ac29ee1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/f448b274-8163-42f3-9eea-1e4f3458dd2b" status: 200 len: 1309 microversion: 2.1 time: 0.095225 Jun 10 18:08:55.465998 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1759/3417] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:55 2022] GET /compute/v2.1/servers/f448b274-8163-42f3-9eea-1e4f3458dd2b => generated 1309 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:08:55.715404 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-b0a2a321-daac-4bf6-9e5a-296542443ef8 req-f98d6331-af6b-474e-9404-eaa41a0736db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4580fa2-bf3a-4dc7-af2b-0d6af14508b3", "name": "network-vif-deleted", "tag": "9f84dd8d-0598-49b8-a89f-aab5783f86d9"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:08:55.732897 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-b0a2a321-daac-4bf6-9e5a-296542443ef8 req-f98d6331-af6b-474e-9404-eaa41a0736db service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:55.734532 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-b0a2a321-daac-4bf6-9e5a-296542443ef8 req-f98d6331-af6b-474e-9404-eaa41a0736db service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:55.763699 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-b0a2a321-daac-4bf6-9e5a-296542443ef8 req-f98d6331-af6b-474e-9404-eaa41a0736db service nova] Creating event network-vif-deleted:9f84dd8d-0598-49b8-a89f-aab5783f86d9 for instance d4580fa2-bf3a-4dc7-af2b-0d6af14508b3 on chh2-master-2 Jun 10 18:08:55.781267 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-b0a2a321-daac-4bf6-9e5a-296542443ef8 req-f98d6331-af6b-474e-9404-eaa41a0736db service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073341 Jun 10 18:08:55.786118 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1659/3418] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:08:56.112025 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7280d9e3-5b32-4e1f-8111-0ce3f2d7de6e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:56.116358 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7280d9e3-5b32-4e1f-8111-0ce3f2d7de6e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:56.136583 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7280d9e3-5b32-4e1f-8111-0ce3f2d7de6e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:56.139318 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7280d9e3-5b32-4e1f-8111-0ce3f2d7de6e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:56.143849 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7280d9e3-5b32-4e1f-8111-0ce3f2d7de6e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:56.145151 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7280d9e3-5b32-4e1f-8111-0ce3f2d7de6e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:56.278788 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7280d9e3-5b32-4e1f-8111-0ce3f2d7de6e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:56.290511 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7280d9e3-5b32-4e1f-8111-0ce3f2d7de6e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:56.292199 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7280d9e3-5b32-4e1f-8111-0ce3f2d7de6e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:56.293643 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7280d9e3-5b32-4e1f-8111-0ce3f2d7de6e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6" status: 200 len: 1407 microversion: 2.54 time: 0.186343 Jun 10 18:08:56.301498 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1760/3419] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:08:56 2022] GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:08:56.385191 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0685379f-ecae-4d0f-9996-083dd418c14c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c11c2b80>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:56.433949 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f0cd5f0d-875f-402c-866c-87aa2c3bf20c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:56.434938 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f0cd5f0d-875f-402c-866c-87aa2c3bf20c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:56.443748 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f0cd5f0d-875f-402c-866c-87aa2c3bf20c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:56.445120 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f0cd5f0d-875f-402c-866c-87aa2c3bf20c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:56.446824 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f0cd5f0d-875f-402c-866c-87aa2c3bf20c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:56.447536 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f0cd5f0d-875f-402c-866c-87aa2c3bf20c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:56.482114 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0685379f-ecae-4d0f-9996-083dd418c14c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a" status: 200 len: 1435 microversion: 2.1 time: 0.104106 Jun 10 18:08:56.482711 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1660/3420] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:08:56 2022] GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a => generated 1435 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:56.488052 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-95a8a616-b864-402c-8e14-0632b863daf0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:56.491237 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-95a8a616-b864-402c-8e14-0632b863daf0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: f448b274-8163-42f3-9eea-1e4f3458dd2b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:56.503759 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-95a8a616-b864-402c-8e14-0632b863daf0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:56.508004 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-95a8a616-b864-402c-8e14-0632b863daf0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:56.509252 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-95a8a616-b864-402c-8e14-0632b863daf0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:56.509763 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-95a8a616-b864-402c-8e14-0632b863daf0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:56.527223 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-95a8a616-b864-402c-8e14-0632b863daf0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] HTTP exception thrown: Instance f448b274-8163-42f3-9eea-1e4f3458dd2b could not be found. Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-95a8a616-b864-402c-8e14-0632b863daf0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Request method failure captured: Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/f448b274-8163-42f3-9eea-1e4f3458dd2b HTTP/1.1 Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4fu_AYOPdFFJd8JVAYOTheTFSnyPZ-qiPxdNG_pAfWLUrJ5f24u96zVdpuDpUlsPTInijfnJBXVbodAhbFGtTke7WBdKaH4uaKtjYUFQOzVbOhDwYx8uvcAx6JIEZVUJCzrT5Zs3s_HlXd7mITajtJGPkUNp7u0UhMy3r7J2GEvLGU Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: bb2c4b1067ac4cab8b8565bc987f00b1 Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersOnMultiNodesTest-1408923964 Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/bb2c4b1067ac4cab8b8565bc987f00b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bb2c4b1067ac4cab8b8565bc987f00b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bb2c4b1067ac4cab8b8565bc987f00b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_bb2c4b1067ac4cab8b8565bc987f00b1", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersOnMultiNodesTest-1408923964 Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: bb2c4b1067ac4cab8b8565bc987f00b1 Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1408923964 Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersOnMultiNodesTest-1408923964-project Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 9c189471a3ab4ec2b644b3ee1352d4e6 Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersOnMultiNodesTest-1408923964-project Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: exception: Instance f448b274-8163-42f3-9eea-1e4f3458dd2b could not be found. Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'f448b274-8163-42f3-9eea-1e4f3458dd2b'} Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f448b274-8163-42f3-9eea-1e4f3458dd2b could not be found. Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f448b274-8163-42f3-9eea-1e4f3458dd2b could not be found. Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:08:56.529193 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:08:56.534364 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:08:56.534364 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:08:56.534364 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:08:56.534364 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:08:56.534364 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:08:56.534364 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f448b274-8163-42f3-9eea-1e4f3458dd2b could not be found. Jun 10 18:08:56.534364 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:08:56.535888 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-95a8a616-b864-402c-8e14-0632b863daf0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Returning 404 to user: Instance f448b274-8163-42f3-9eea-1e4f3458dd2b could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:08:56.537841 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-95a8a616-b864-402c-8e14-0632b863daf0 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/f448b274-8163-42f3-9eea-1e4f3458dd2b" status: 404 len: 111 microversion: 2.1 time: 0.053922 Jun 10 18:08:56.538952 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1661/3421] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:56 2022] GET /compute/v2.1/servers/f448b274-8163-42f3-9eea-1e4f3458dd2b => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:08:56.548286 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-900a1ff3-6ac5-4a87-a2e9-f07cfbeafc39 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:56.548916 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-900a1ff3-6ac5-4a87-a2e9-f07cfbeafc39 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: d4580fa2-bf3a-4dc7-af2b-0d6af14508b3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:56.563024 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-900a1ff3-6ac5-4a87-a2e9-f07cfbeafc39 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:56.563500 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-900a1ff3-6ac5-4a87-a2e9-f07cfbeafc39 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:56.566794 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-900a1ff3-6ac5-4a87-a2e9-f07cfbeafc39 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:56.566794 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-900a1ff3-6ac5-4a87-a2e9-f07cfbeafc39 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:56.601820 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-900a1ff3-6ac5-4a87-a2e9-f07cfbeafc39 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:56.602213 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-900a1ff3-6ac5-4a87-a2e9-f07cfbeafc39 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:56.602752 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-900a1ff3-6ac5-4a87-a2e9-f07cfbeafc39 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lazy-loading 'fault' on Instance uuid d4580fa2-bf3a-4dc7-af2b-0d6af14508b3 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:08:56.653875 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-900a1ff3-6ac5-4a87-a2e9-f07cfbeafc39 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:56.664455 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-900a1ff3-6ac5-4a87-a2e9-f07cfbeafc39 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3" status: 200 len: 1309 microversion: 2.1 time: 0.121256 Jun 10 18:08:56.675183 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1662/3422] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:56 2022] GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3 => generated 1309 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:08:56.682983 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f0cd5f0d-875f-402c-866c-87aa2c3bf20c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:56.699288 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f0cd5f0d-875f-402c-866c-87aa2c3bf20c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1678 microversion: 2.1 time: 0.267567 Jun 10 18:08:56.700705 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1761/3423] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:56 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1678 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:08:57.314193 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c9dfa7e5-3093-456b-8368-536d9f5cec81 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:57.315162 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c9dfa7e5-3093-456b-8368-536d9f5cec81 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:57.322757 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9dfa7e5-3093-456b-8368-536d9f5cec81 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:57.323586 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9dfa7e5-3093-456b-8368-536d9f5cec81 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:57.324547 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9dfa7e5-3093-456b-8368-536d9f5cec81 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:57.325186 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9dfa7e5-3093-456b-8368-536d9f5cec81 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:57.395384 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c9dfa7e5-3093-456b-8368-536d9f5cec81 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:57.407975 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c9dfa7e5-3093-456b-8368-536d9f5cec81 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:57.409688 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c9dfa7e5-3093-456b-8368-536d9f5cec81 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:57.411223 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c9dfa7e5-3093-456b-8368-536d9f5cec81 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6" status: 200 len: 1407 microversion: 2.54 time: 0.101566 Jun 10 18:08:57.411993 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1663/3424] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:08:57 2022] GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 => generated 1407 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:08:57.495036 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e661924e-fc34-4ec0-b438-d00247dfb351 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77b3cbe3a0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:57.559146 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e661924e-fc34-4ec0-b438-d00247dfb351 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a" status: 200 len: 1435 microversion: 2.1 time: 0.063882 Jun 10 18:08:57.561385 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1762/3425] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:08:57 2022] GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a => generated 1435 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:57.683028 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-849323e6-ffe9-498f-8d73-72c5d6ecb390 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:57.683927 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-849323e6-ffe9-498f-8d73-72c5d6ecb390 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: d4580fa2-bf3a-4dc7-af2b-0d6af14508b3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:57.691331 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-849323e6-ffe9-498f-8d73-72c5d6ecb390 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:57.692006 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-849323e6-ffe9-498f-8d73-72c5d6ecb390 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:57.692869 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-849323e6-ffe9-498f-8d73-72c5d6ecb390 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:57.693340 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-849323e6-ffe9-498f-8d73-72c5d6ecb390 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:57.709210 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-849323e6-ffe9-498f-8d73-72c5d6ecb390 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] HTTP exception thrown: Instance d4580fa2-bf3a-4dc7-af2b-0d6af14508b3 could not be found. Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-849323e6-ffe9-498f-8d73-72c5d6ecb390 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Request method failure captured: Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3 HTTP/1.1 Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4fu_AYOPdFFJd8JVAYOTheTFSnyPZ-qiPxdNG_pAfWLUrJ5f24u96zVdpuDpUlsPTInijfnJBXVbodAhbFGtTke7WBdKaH4uaKtjYUFQOzVbOhDwYx8uvcAx6JIEZVUJCzrT5Zs3s_HlXd7mITajtJGPkUNp7u0UhMy3r7J2GEvLGU Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: bb2c4b1067ac4cab8b8565bc987f00b1 Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersOnMultiNodesTest-1408923964 Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/bb2c4b1067ac4cab8b8565bc987f00b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bb2c4b1067ac4cab8b8565bc987f00b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bb2c4b1067ac4cab8b8565bc987f00b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_bb2c4b1067ac4cab8b8565bc987f00b1", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersOnMultiNodesTest-1408923964 Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: bb2c4b1067ac4cab8b8565bc987f00b1 Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1408923964 Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersOnMultiNodesTest-1408923964-project Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 9c189471a3ab4ec2b644b3ee1352d4e6 Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersOnMultiNodesTest-1408923964-project Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: exception: Instance d4580fa2-bf3a-4dc7-af2b-0d6af14508b3 could not be found. Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'd4580fa2-bf3a-4dc7-af2b-0d6af14508b3'} Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4580fa2-bf3a-4dc7-af2b-0d6af14508b3 could not be found. Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4580fa2-bf3a-4dc7-af2b-0d6af14508b3 could not be found. Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:08:57.710755 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:08:57.715080 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:08:57.715080 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:08:57.715080 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:08:57.715080 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:08:57.715080 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:08:57.715080 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4580fa2-bf3a-4dc7-af2b-0d6af14508b3 could not be found. Jun 10 18:08:57.715080 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:08:57.715080 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-849323e6-ffe9-498f-8d73-72c5d6ecb390 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Returning 404 to user: Instance d4580fa2-bf3a-4dc7-af2b-0d6af14508b3 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:08:57.715080 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-849323e6-ffe9-498f-8d73-72c5d6ecb390 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3" status: 404 len: 111 microversion: 2.1 time: 0.033839 Jun 10 18:08:57.715080 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1664/3426] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:57 2022] GET /compute/v2.1/servers/d4580fa2-bf3a-4dc7-af2b-0d6af14508b3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:08:57.731936 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-dc45553a-8c81-4d84-a4ca-723431517176 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:57.733209 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6dec1246-8753-4775-8d47-8ee8d45704a3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:57.734362 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6dec1246-8753-4775-8d47-8ee8d45704a3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:57.750683 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6dec1246-8753-4775-8d47-8ee8d45704a3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:57.751941 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6dec1246-8753-4775-8d47-8ee8d45704a3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:57.751941 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6dec1246-8753-4775-8d47-8ee8d45704a3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:57.752413 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6dec1246-8753-4775-8d47-8ee8d45704a3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:57.766017 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:08:57.872033 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-dc45553a-8c81-4d84-a4ca-723431517176 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "DELETE /compute/v2.1/os-server-groups/f1232bf5-d888-4a4d-af7c-4e6e28703ed6" status: 204 len: 0 microversion: 2.1 time: 0.154003 Jun 10 18:08:57.872033 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1763/3427] 10.222.0.35 () {58 vars in 1265 bytes} [Fri Jun 10 18:08:57 2022] DELETE /compute/v2.1/os-server-groups/f1232bf5-d888-4a4d-af7c-4e6e28703ed6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:08:57.882716 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f840bb79-c764-4b4a-9089-ea4975c31c97 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:57.883909 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f840bb79-c764-4b4a-9089-ea4975c31c97 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 05c9cadb-1823-4e2c-9c9f-c3be6892e074] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:57.899326 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f840bb79-c764-4b4a-9089-ea4975c31c97 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:57.902978 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f840bb79-c764-4b4a-9089-ea4975c31c97 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:57.904854 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f840bb79-c764-4b4a-9089-ea4975c31c97 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:57.905481 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f840bb79-c764-4b4a-9089-ea4975c31c97 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:57.923681 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6dec1246-8753-4775-8d47-8ee8d45704a3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:57.930983 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6dec1246-8753-4775-8d47-8ee8d45704a3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1655 microversion: 2.1 time: 0.201463 Jun 10 18:08:57.931669 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1665/3428] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:57 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1655 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:57.948609 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2e097e09-40d2-4372-8bc8-b7a1e5f2d8fa tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:08:57.952406 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f840bb79-c764-4b4a-9089-ea4975c31c97 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 05c9cadb-1823-4e2c-9c9f-c3be6892e074] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:08:57.956344 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e097e09-40d2-4372-8bc8-b7a1e5f2d8fa tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:57.956840 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e097e09-40d2-4372-8bc8-b7a1e5f2d8fa tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:58.004107 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2e097e09-40d2-4372-8bc8-b7a1e5f2d8fa tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Going to try to start instance {{(pid=126595) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 10 18:08:58.204195 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2e097e09-40d2-4372-8bc8-b7a1e5f2d8fa tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "POST /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1/action" status: 202 len: 0 microversion: 2.1 time: 0.259385 Jun 10 18:08:58.204919 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1666/3429] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:08:57 2022] POST /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 18:08:58.214126 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0306f570-2521-4de6-8e74-62cb046c0982 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:58.215131 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0306f570-2521-4de6-8e74-62cb046c0982 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:58.225100 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0306f570-2521-4de6-8e74-62cb046c0982 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:58.225641 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0306f570-2521-4de6-8e74-62cb046c0982 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:58.226559 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0306f570-2521-4de6-8e74-62cb046c0982 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:58.227035 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0306f570-2521-4de6-8e74-62cb046c0982 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:58.258860 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f840bb79-c764-4b4a-9089-ea4975c31c97 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "DELETE /compute/v2.1/servers/05c9cadb-1823-4e2c-9c9f-c3be6892e074" status: 204 len: 0 microversion: 2.1 time: 0.381528 Jun 10 18:08:58.262348 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1764/3430] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:08:57 2022] DELETE /compute/v2.1/servers/05c9cadb-1823-4e2c-9c9f-c3be6892e074 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:08:58.268780 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a1c82a73-18e5-482f-886d-62c5e7a03547 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:58.269713 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a1c82a73-18e5-482f-886d-62c5e7a03547 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 07afccc2-6b07-4dd4-b9f5-aaa7609f72d1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:58.287001 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a1c82a73-18e5-482f-886d-62c5e7a03547 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:58.287752 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a1c82a73-18e5-482f-886d-62c5e7a03547 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:58.288897 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a1c82a73-18e5-482f-886d-62c5e7a03547 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:58.289349 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a1c82a73-18e5-482f-886d-62c5e7a03547 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:58.328513 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a1c82a73-18e5-482f-886d-62c5e7a03547 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 07afccc2-6b07-4dd4-b9f5-aaa7609f72d1] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:08:58.419064 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0306f570-2521-4de6-8e74-62cb046c0982 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:58.427791 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0306f570-2521-4de6-8e74-62cb046c0982 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1664 microversion: 2.1 time: 0.217729 Jun 10 18:08:58.428936 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1667/3431] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:58 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1664 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:58.434495 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-70159612-0449-4bb0-91dc-efde6b197b96 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:58.435410 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-70159612-0449-4bb0-91dc-efde6b197b96 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:58.443460 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70159612-0449-4bb0-91dc-efde6b197b96 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:58.453578 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70159612-0449-4bb0-91dc-efde6b197b96 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:58.456511 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70159612-0449-4bb0-91dc-efde6b197b96 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:58.459418 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70159612-0449-4bb0-91dc-efde6b197b96 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:58.541821 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-70159612-0449-4bb0-91dc-efde6b197b96 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:58.565068 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-70159612-0449-4bb0-91dc-efde6b197b96 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:58.571060 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-70159612-0449-4bb0-91dc-efde6b197b96 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:58.574324 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-70159612-0449-4bb0-91dc-efde6b197b96 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6" status: 200 len: 1407 microversion: 2.54 time: 0.144050 Jun 10 18:08:58.579294 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1668/3432] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:08:58 2022] GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:08:58.587373 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-14fa7910-8f1b-4bfd-a724-6f100eb706b2 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c12513a0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:58.637991 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-14fa7910-8f1b-4bfd-a724-6f100eb706b2 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a" status: 200 len: 1435 microversion: 2.1 time: 0.056586 Jun 10 18:08:58.638900 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1669/3433] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:08:58 2022] GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a => generated 1435 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:58.672646 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a1c82a73-18e5-482f-886d-62c5e7a03547 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "DELETE /compute/v2.1/servers/07afccc2-6b07-4dd4-b9f5-aaa7609f72d1" status: 204 len: 0 microversion: 2.1 time: 0.408138 Jun 10 18:08:58.674636 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1765/3434] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:08:58 2022] DELETE /compute/v2.1/servers/07afccc2-6b07-4dd4-b9f5-aaa7609f72d1 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:08:58.683758 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-039cda10-c86e-46d6-9ad1-145e6d656e83 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:58.684640 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-039cda10-c86e-46d6-9ad1-145e6d656e83 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 05c9cadb-1823-4e2c-9c9f-c3be6892e074] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:58.696552 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-039cda10-c86e-46d6-9ad1-145e6d656e83 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:58.696552 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-039cda10-c86e-46d6-9ad1-145e6d656e83 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:58.697235 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-039cda10-c86e-46d6-9ad1-145e6d656e83 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:58.697646 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-039cda10-c86e-46d6-9ad1-145e6d656e83 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:58.853177 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-039cda10-c86e-46d6-9ad1-145e6d656e83 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:58.861947 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-039cda10-c86e-46d6-9ad1-145e6d656e83 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/05c9cadb-1823-4e2c-9c9f-c3be6892e074" status: 200 len: 1474 microversion: 2.1 time: 0.183036 Jun 10 18:08:58.871835 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1670/3435] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:58 2022] GET /compute/v2.1/servers/05c9cadb-1823-4e2c-9c9f-c3be6892e074 => generated 1474 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:08:59.446261 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a3aeb7f8-78a9-4426-93ed-29f04a48e993 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:59.447114 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a3aeb7f8-78a9-4426-93ed-29f04a48e993 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:59.453255 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3aeb7f8-78a9-4426-93ed-29f04a48e993 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:59.453713 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3aeb7f8-78a9-4426-93ed-29f04a48e993 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:59.454541 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3aeb7f8-78a9-4426-93ed-29f04a48e993 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:59.454988 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3aeb7f8-78a9-4426-93ed-29f04a48e993 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:59.460139 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:08:59.599870 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6d895465-74a5-4065-a7ff-8f3019cd776a tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:59.602578 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6d895465-74a5-4065-a7ff-8f3019cd776a tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:59.613818 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d895465-74a5-4065-a7ff-8f3019cd776a tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:59.614279 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d895465-74a5-4065-a7ff-8f3019cd776a tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:59.615065 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d895465-74a5-4065-a7ff-8f3019cd776a tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:59.615538 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d895465-74a5-4065-a7ff-8f3019cd776a tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:59.617675 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a3aeb7f8-78a9-4426-93ed-29f04a48e993 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:59.625897 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a3aeb7f8-78a9-4426-93ed-29f04a48e993 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1664 microversion: 2.1 time: 0.184031 Jun 10 18:08:59.628541 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1766/3436] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:59 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1664 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:59.653204 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-95f9bc25-638d-42e6-8339-1252c21883ec tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77b3d0fca0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:59.701728 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6d895465-74a5-4065-a7ff-8f3019cd776a tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:59.710696 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6d895465-74a5-4065-a7ff-8f3019cd776a tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:59.712147 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-95f9bc25-638d-42e6-8339-1252c21883ec tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a" status: 200 len: 1435 microversion: 2.1 time: 0.064034 Jun 10 18:08:59.712623 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6d895465-74a5-4065-a7ff-8f3019cd776a tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:08:59.713301 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1767/3437] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:08:59 2022] GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a => generated 1435 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:08:59.719425 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6d895465-74a5-4065-a7ff-8f3019cd776a tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6" status: 200 len: 1407 microversion: 2.54 time: 0.124640 Jun 10 18:08:59.720042 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1671/3438] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:08:59 2022] GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 => generated 1407 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:08:59.879220 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ec623840-b1c7-4551-884d-4551b1a271a1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:08:59.879863 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ec623840-b1c7-4551-884d-4551b1a271a1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 05c9cadb-1823-4e2c-9c9f-c3be6892e074] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:08:59.886739 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec623840-b1c7-4551-884d-4551b1a271a1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:59.887312 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec623840-b1c7-4551-884d-4551b1a271a1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:08:59.888246 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec623840-b1c7-4551-884d-4551b1a271a1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:08:59.888724 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec623840-b1c7-4551-884d-4551b1a271a1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:00.041930 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ec623840-b1c7-4551-884d-4551b1a271a1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:00.050803 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ec623840-b1c7-4551-884d-4551b1a271a1 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/05c9cadb-1823-4e2c-9c9f-c3be6892e074" status: 200 len: 1474 microversion: 2.1 time: 0.175656 Jun 10 18:09:00.054911 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1768/3439] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:08:59 2022] GET /compute/v2.1/servers/05c9cadb-1823-4e2c-9c9f-c3be6892e074 => generated 1474 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:00.645813 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-34bd6c8d-9d39-419c-aa84-9103d216bf37 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:00.646450 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-34bd6c8d-9d39-419c-aa84-9103d216bf37 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:00.660019 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-34bd6c8d-9d39-419c-aa84-9103d216bf37 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:00.660610 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-34bd6c8d-9d39-419c-aa84-9103d216bf37 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:00.661580 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-34bd6c8d-9d39-419c-aa84-9103d216bf37 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:00.662578 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-34bd6c8d-9d39-419c-aa84-9103d216bf37 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:00.885431 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f27194e1-0ffb-4436-a895-fd331541895d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77b3c8d5e0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:00.885431 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f27194e1-0ffb-4436-a895-fd331541895d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a" status: 200 len: 1435 microversion: 2.1 time: 0.069520 Jun 10 18:09:00.885431 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1769/3440] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:09:00 2022] GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a => generated 1435 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:09:00.885431 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bc31ec58-8a97-41df-b834-795743b0a886 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:00.885431 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bc31ec58-8a97-41df-b834-795743b0a886 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:00.885431 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bc31ec58-8a97-41df-b834-795743b0a886 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:00.885431 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bc31ec58-8a97-41df-b834-795743b0a886 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:00.885431 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bc31ec58-8a97-41df-b834-795743b0a886 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:00.885431 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bc31ec58-8a97-41df-b834-795743b0a886 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:00.888623 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-34bd6c8d-9d39-419c-aa84-9103d216bf37 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:00.888623 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-34bd6c8d-9d39-419c-aa84-9103d216bf37 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.229169 Jun 10 18:09:00.888623 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1672/3441] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:00 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:00.894138 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d3480053-57f4-4137-b3b9-81e390904423 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:00.894755 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d3480053-57f4-4137-b3b9-81e390904423 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:00.903825 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d3480053-57f4-4137-b3b9-81e390904423 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:00.904634 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d3480053-57f4-4137-b3b9-81e390904423 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:00.905557 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d3480053-57f4-4137-b3b9-81e390904423 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:00.906247 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d3480053-57f4-4137-b3b9-81e390904423 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:00.909366 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bc31ec58-8a97-41df-b834-795743b0a886 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:00.920225 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bc31ec58-8a97-41df-b834-795743b0a886 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:00.923401 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bc31ec58-8a97-41df-b834-795743b0a886 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:00.924908 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bc31ec58-8a97-41df-b834-795743b0a886 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6" status: 200 len: 1407 microversion: 2.54 time: 0.129612 Jun 10 18:09:00.925638 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1770/3442] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:09:00 2022] GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 => generated 1407 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:09:01.068109 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5afce1eb-166d-4c0a-a3af-17381004a98d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:01.079303 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5afce1eb-166d-4c0a-a3af-17381004a98d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 05c9cadb-1823-4e2c-9c9f-c3be6892e074] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:01.079746 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5afce1eb-166d-4c0a-a3af-17381004a98d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:01.080529 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5afce1eb-166d-4c0a-a3af-17381004a98d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:01.086839 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5afce1eb-166d-4c0a-a3af-17381004a98d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:01.086839 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5afce1eb-166d-4c0a-a3af-17381004a98d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:01.091431 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d3480053-57f4-4137-b3b9-81e390904423 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:01.103745 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d3480053-57f4-4137-b3b9-81e390904423 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.212100 Jun 10 18:09:01.105066 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1673/3443] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:00 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:09:01.134625 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e988058e-5ce5-4b5b-9dfe-cb6bbfee9fe5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:01.135378 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e988058e-5ce5-4b5b-9dfe-cb6bbfee9fe5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:01.142508 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e988058e-5ce5-4b5b-9dfe-cb6bbfee9fe5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:01.143016 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e988058e-5ce5-4b5b-9dfe-cb6bbfee9fe5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:01.149767 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e988058e-5ce5-4b5b-9dfe-cb6bbfee9fe5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:01.149767 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e988058e-5ce5-4b5b-9dfe-cb6bbfee9fe5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:01.364724 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5afce1eb-166d-4c0a-a3af-17381004a98d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:01.377326 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5afce1eb-166d-4c0a-a3af-17381004a98d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/05c9cadb-1823-4e2c-9c9f-c3be6892e074" status: 200 len: 1474 microversion: 2.1 time: 0.313225 Jun 10 18:09:01.377935 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1771/3444] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:01 2022] GET /compute/v2.1/servers/05c9cadb-1823-4e2c-9c9f-c3be6892e074 => generated 1474 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:09:01.429297 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e988058e-5ce5-4b5b-9dfe-cb6bbfee9fe5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:01.438435 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e988058e-5ce5-4b5b-9dfe-cb6bbfee9fe5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.308185 Jun 10 18:09:01.439346 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1674/3445] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:01 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:09:01.458789 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cb72d10d-85ec-4813-bfc6-edcbaa457721 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:01.465205 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cb72d10d-85ec-4813-bfc6-edcbaa457721 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:01.473764 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cb72d10d-85ec-4813-bfc6-edcbaa457721 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:01.474239 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cb72d10d-85ec-4813-bfc6-edcbaa457721 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:01.475035 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cb72d10d-85ec-4813-bfc6-edcbaa457721 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:01.475482 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cb72d10d-85ec-4813-bfc6-edcbaa457721 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:01.816706 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cb72d10d-85ec-4813-bfc6-edcbaa457721 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:01.833622 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cb72d10d-85ec-4813-bfc6-edcbaa457721 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.382650 Jun 10 18:09:01.834966 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1772/3446] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:01 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:01.862780 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9f7b3ed8-e6ef-466e-b49e-d303c7702387 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:01.863579 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9f7b3ed8-e6ef-466e-b49e-d303c7702387 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:01.871257 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f7b3ed8-e6ef-466e-b49e-d303c7702387 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:01.871782 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f7b3ed8-e6ef-466e-b49e-d303c7702387 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:01.872843 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f7b3ed8-e6ef-466e-b49e-d303c7702387 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:01.873299 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f7b3ed8-e6ef-466e-b49e-d303c7702387 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:01.889368 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-92a99a74-17de-43f2-b622-ed61f576d404 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77b3c658b0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:01.969506 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-92a99a74-17de-43f2-b622-ed61f576d404 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a" status: 200 len: 1435 microversion: 2.1 time: 0.083807 Jun 10 18:09:01.970098 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1773/3447] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:09:01 2022] GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a => generated 1435 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:09:01.987395 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5fddbfe2-53ad-4c01-a7ec-b5afdb95510e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:01.990993 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5fddbfe2-53ad-4c01-a7ec-b5afdb95510e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:02.032453 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5fddbfe2-53ad-4c01-a7ec-b5afdb95510e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:02.033920 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5fddbfe2-53ad-4c01-a7ec-b5afdb95510e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:02.035768 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5fddbfe2-53ad-4c01-a7ec-b5afdb95510e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:02.037688 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5fddbfe2-53ad-4c01-a7ec-b5afdb95510e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:02.172448 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9f7b3ed8-e6ef-466e-b49e-d303c7702387 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:02.184714 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9f7b3ed8-e6ef-466e-b49e-d303c7702387 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.336654 Jun 10 18:09:02.186095 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1675/3448] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:01 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:02.204057 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-83b94de6-b40a-43e6-9487-3cf753ab199c req-5d7056ac-304c-416b-bcfe-c1dd56d4ef4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05c9cadb-1823-4e2c-9c9f-c3be6892e074", "name": "network-vif-deleted", "tag": "8be362a0-24f5-47ff-977c-3dac2ced769c"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:02.210771 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-83b94de6-b40a-43e6-9487-3cf753ab199c req-5d7056ac-304c-416b-bcfe-c1dd56d4ef4a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:02.211694 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-83b94de6-b40a-43e6-9487-3cf753ab199c req-5d7056ac-304c-416b-bcfe-c1dd56d4ef4a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:02.227595 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-83b94de6-b40a-43e6-9487-3cf753ab199c req-5d7056ac-304c-416b-bcfe-c1dd56d4ef4a service nova] Creating event network-vif-deleted:8be362a0-24f5-47ff-977c-3dac2ced769c for instance 05c9cadb-1823-4e2c-9c9f-c3be6892e074 on chh2-master-2 Jun 10 18:09:02.240599 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-83b94de6-b40a-43e6-9487-3cf753ab199c req-5d7056ac-304c-416b-bcfe-c1dd56d4ef4a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052655 Jun 10 18:09:02.246660 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1676/3449] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:09:02.261719 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ffa7e5b9-4613-473e-af18-d4e371083851 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:02.262812 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ffa7e5b9-4613-473e-af18-d4e371083851 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:02.287989 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ffa7e5b9-4613-473e-af18-d4e371083851 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:02.290323 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ffa7e5b9-4613-473e-af18-d4e371083851 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:02.290323 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ffa7e5b9-4613-473e-af18-d4e371083851 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:02.290323 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ffa7e5b9-4613-473e-af18-d4e371083851 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:02.380148 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-ffa7e5b9-4613-473e-af18-d4e371083851 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lazy-loading 'flavor' on Instance uuid 186b67b3-3538-4bc2-8528-53b43d701bf1 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:09:02.673015 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5fddbfe2-53ad-4c01-a7ec-b5afdb95510e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:02.692508 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5fddbfe2-53ad-4c01-a7ec-b5afdb95510e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:02.696567 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5fddbfe2-53ad-4c01-a7ec-b5afdb95510e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:02.698715 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5fddbfe2-53ad-4c01-a7ec-b5afdb95510e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6" status: 200 len: 1407 microversion: 2.54 time: 0.727027 Jun 10 18:09:02.698820 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1774/3450] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:09:01 2022] GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 => generated 1407 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:09:02.713187 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ca65eec1-e848-4d65-a868-436ea4842305 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:02.713813 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ca65eec1-e848-4d65-a868-436ea4842305 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 05c9cadb-1823-4e2c-9c9f-c3be6892e074] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:02.721008 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ca65eec1-e848-4d65-a868-436ea4842305 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:02.721705 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ca65eec1-e848-4d65-a868-436ea4842305 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:02.734123 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ca65eec1-e848-4d65-a868-436ea4842305 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:02.734123 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ca65eec1-e848-4d65-a868-436ea4842305 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:02.762795 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=3 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:09:02.768735 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ca65eec1-e848-4d65-a868-436ea4842305 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:02.768735 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ca65eec1-e848-4d65-a868-436ea4842305 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:02.768735 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-ca65eec1-e848-4d65-a868-436ea4842305 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lazy-loading 'fault' on Instance uuid 05c9cadb-1823-4e2c-9c9f-c3be6892e074 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:09:02.815709 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ca65eec1-e848-4d65-a868-436ea4842305 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:02.824267 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ca65eec1-e848-4d65-a868-436ea4842305 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/05c9cadb-1823-4e2c-9c9f-c3be6892e074" status: 200 len: 1308 microversion: 2.1 time: 0.118875 Jun 10 18:09:02.824989 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1775/3451] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:02 2022] GET /compute/v2.1/servers/05c9cadb-1823-4e2c-9c9f-c3be6892e074 => generated 1308 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:02.842060 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9450db14-d4ee-4c66-ab36-5704431440ff tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:02.842925 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9450db14-d4ee-4c66-ab36-5704431440ff tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: ea345031-5220-43d0-9971-ada561720697] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:02.843748 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ffa7e5b9-4613-473e-af18-d4e371083851 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "POST /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1/action" status: 202 len: 0 microversion: 2.1 time: 0.594133 Jun 10 18:09:02.848470 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1677/3452] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:09:02 2022] POST /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1/action => generated 0 bytes in 601 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:09:02.851368 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9450db14-d4ee-4c66-ab36-5704431440ff tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:02.852049 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9450db14-d4ee-4c66-ab36-5704431440ff tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:02.853064 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9450db14-d4ee-4c66-ab36-5704431440ff tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:02.853697 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9450db14-d4ee-4c66-ab36-5704431440ff tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:02.876523 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-50f4fe81-5246-4b80-bcc4-e79de018c98d req-76510e03-8783-4155-9581-125b1f2fd740 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07afccc2-6b07-4dd4-b9f5-aaa7609f72d1", "name": "network-vif-deleted", "tag": "5f3d7a05-ae18-47e6-b31b-ac40d7700ec1"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:02.888279 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-50f4fe81-5246-4b80-bcc4-e79de018c98d req-76510e03-8783-4155-9581-125b1f2fd740 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:02.888956 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-50f4fe81-5246-4b80-bcc4-e79de018c98d req-76510e03-8783-4155-9581-125b1f2fd740 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:02.890629 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9450db14-d4ee-4c66-ab36-5704431440ff tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: ea345031-5220-43d0-9971-ada561720697] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:09:02.914523 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-50f4fe81-5246-4b80-bcc4-e79de018c98d req-76510e03-8783-4155-9581-125b1f2fd740 service nova] Creating event network-vif-deleted:5f3d7a05-ae18-47e6-b31b-ac40d7700ec1 for instance 07afccc2-6b07-4dd4-b9f5-aaa7609f72d1 on chh2-master-2 Jun 10 18:09:02.923424 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-50f4fe81-5246-4b80-bcc4-e79de018c98d req-76510e03-8783-4155-9581-125b1f2fd740 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073216 Jun 10 18:09:02.924414 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1678/3453] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:09:02.932033 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-58695e90-0235-4b77-8b8d-950f20b7cd8e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:02.939092 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-58695e90-0235-4b77-8b8d-950f20b7cd8e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:02.946908 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-58695e90-0235-4b77-8b8d-950f20b7cd8e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:02.956094 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-58695e90-0235-4b77-8b8d-950f20b7cd8e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:02.956094 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-58695e90-0235-4b77-8b8d-950f20b7cd8e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:02.956094 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-58695e90-0235-4b77-8b8d-950f20b7cd8e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:03.198102 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-58695e90-0235-4b77-8b8d-950f20b7cd8e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:03.215797 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-58695e90-0235-4b77-8b8d-950f20b7cd8e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1676 microversion: 2.1 time: 0.289263 Jun 10 18:09:03.218598 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1679/3454] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:02 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1676 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:03.225479 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0ae008bd-b4a6-4c07-b5b9-ce68c30c811e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c62ccf70>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:03.303677 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0ae008bd-b4a6-4c07-b5b9-ce68c30c811e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a" status: 200 len: 1435 microversion: 2.1 time: 0.083746 Jun 10 18:09:03.304275 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1680/3455] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:09:03 2022] GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a => generated 1435 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:03.728618 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9555dd31-df8a-447a-b6ab-cd68dd702ab3 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:03.729214 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9555dd31-df8a-447a-b6ab-cd68dd702ab3 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:03.736278 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9555dd31-df8a-447a-b6ab-cd68dd702ab3 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:03.736916 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9555dd31-df8a-447a-b6ab-cd68dd702ab3 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:03.737728 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9555dd31-df8a-447a-b6ab-cd68dd702ab3 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:03.738204 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9555dd31-df8a-447a-b6ab-cd68dd702ab3 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:03.802807 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9555dd31-df8a-447a-b6ab-cd68dd702ab3 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:03.818071 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9555dd31-df8a-447a-b6ab-cd68dd702ab3 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:03.819594 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9555dd31-df8a-447a-b6ab-cd68dd702ab3 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:03.820785 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9555dd31-df8a-447a-b6ab-cd68dd702ab3 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6" status: 200 len: 1407 microversion: 2.54 time: 0.106824 Jun 10 18:09:03.821345 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1681/3456] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:09:03 2022] GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 => generated 1407 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:09:03.844581 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8af2e744-e615-4ec1-a2d4-832328a0356d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:03.845193 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8af2e744-e615-4ec1-a2d4-832328a0356d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 05c9cadb-1823-4e2c-9c9f-c3be6892e074] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:03.854749 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8af2e744-e615-4ec1-a2d4-832328a0356d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:03.855206 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8af2e744-e615-4ec1-a2d4-832328a0356d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:03.855983 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8af2e744-e615-4ec1-a2d4-832328a0356d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:03.856469 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8af2e744-e615-4ec1-a2d4-832328a0356d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:03.879066 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:09:03.894922 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8af2e744-e615-4ec1-a2d4-832328a0356d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:03.895493 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8af2e744-e615-4ec1-a2d4-832328a0356d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:03.896270 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-8af2e744-e615-4ec1-a2d4-832328a0356d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lazy-loading 'fault' on Instance uuid 05c9cadb-1823-4e2c-9c9f-c3be6892e074 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:09:03.904061 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9450db14-d4ee-4c66-ab36-5704431440ff tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "DELETE /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697" status: 204 len: 0 microversion: 2.1 time: 1.066893 Jun 10 18:09:03.904687 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1776/3457] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:09:02 2022] DELETE /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697 => generated 0 bytes in 1079 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:09:03.913694 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-79d2c0dc-7b9b-46e2-aa7a-3c8d7ff67484 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:03.914396 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-79d2c0dc-7b9b-46e2-aa7a-3c8d7ff67484 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: ea345031-5220-43d0-9971-ada561720697] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:03.922250 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-79d2c0dc-7b9b-46e2-aa7a-3c8d7ff67484 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:03.925003 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-79d2c0dc-7b9b-46e2-aa7a-3c8d7ff67484 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:03.925003 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-79d2c0dc-7b9b-46e2-aa7a-3c8d7ff67484 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:03.925003 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-79d2c0dc-7b9b-46e2-aa7a-3c8d7ff67484 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:03.959290 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8af2e744-e615-4ec1-a2d4-832328a0356d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:03.968611 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8af2e744-e615-4ec1-a2d4-832328a0356d tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/05c9cadb-1823-4e2c-9c9f-c3be6892e074" status: 200 len: 1308 microversion: 2.1 time: 0.127372 Jun 10 18:09:03.969600 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1682/3458] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:03 2022] GET /compute/v2.1/servers/05c9cadb-1823-4e2c-9c9f-c3be6892e074 => generated 1308 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:09:04.100353 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-79d2c0dc-7b9b-46e2-aa7a-3c8d7ff67484 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:04.107510 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-79d2c0dc-7b9b-46e2-aa7a-3c8d7ff67484 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697" status: 200 len: 1553 microversion: 2.1 time: 0.198177 Jun 10 18:09:04.109235 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1777/3459] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:03 2022] GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697 => generated 1553 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:09:04.237188 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-86153f04-8f49-4bb8-b0bf-f5a6049752d3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:04.238110 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-86153f04-8f49-4bb8-b0bf-f5a6049752d3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:04.246102 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86153f04-8f49-4bb8-b0bf-f5a6049752d3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:04.246102 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86153f04-8f49-4bb8-b0bf-f5a6049752d3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:04.247241 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86153f04-8f49-4bb8-b0bf-f5a6049752d3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:04.247818 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86153f04-8f49-4bb8-b0bf-f5a6049752d3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:04.317404 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-eb9e07db-de6b-48a8-bdca-1c4443e90cee tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77b3cbd310>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:04.412245 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-eb9e07db-de6b-48a8-bdca-1c4443e90cee tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a" status: 200 len: 1435 microversion: 2.1 time: 0.098520 Jun 10 18:09:04.420121 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1778/3460] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:09:04 2022] GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a => generated 1435 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:09:04.523272 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-86153f04-8f49-4bb8-b0bf-f5a6049752d3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:04.534619 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-86153f04-8f49-4bb8-b0bf-f5a6049752d3 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1659 microversion: 2.1 time: 0.302414 Jun 10 18:09:04.545506 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1683/3461] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:04 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1659 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:04.561495 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0f301e7a-6d8e-4737-a707-2bb91dd00362 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:04.562633 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0f301e7a-6d8e-4737-a707-2bb91dd00362 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:04.572166 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0f301e7a-6d8e-4737-a707-2bb91dd00362 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:04.572655 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0f301e7a-6d8e-4737-a707-2bb91dd00362 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:04.573439 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0f301e7a-6d8e-4737-a707-2bb91dd00362 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:04.573889 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0f301e7a-6d8e-4737-a707-2bb91dd00362 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:04.805238 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0f301e7a-6d8e-4737-a707-2bb91dd00362 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "POST /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1/action" status: 202 len: 0 microversion: 2.1 time: 0.247434 Jun 10 18:09:04.806284 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1779/3462] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:09:04 2022] POST /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:09:04.816705 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1f82f455-0f04-4b13-bdea-80339b4ccaac tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:04.817162 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1f82f455-0f04-4b13-bdea-80339b4ccaac tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:04.823597 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f82f455-0f04-4b13-bdea-80339b4ccaac tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:04.824051 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f82f455-0f04-4b13-bdea-80339b4ccaac tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:04.824885 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f82f455-0f04-4b13-bdea-80339b4ccaac tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:04.825331 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f82f455-0f04-4b13-bdea-80339b4ccaac tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:04.840014 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8c3fb4b6-3b24-43b0-9175-9a1f88d4b942 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:04.840816 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8c3fb4b6-3b24-43b0-9175-9a1f88d4b942 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:04.852152 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8c3fb4b6-3b24-43b0-9175-9a1f88d4b942 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:04.853025 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8c3fb4b6-3b24-43b0-9175-9a1f88d4b942 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:04.853477 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8c3fb4b6-3b24-43b0-9175-9a1f88d4b942 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:04.853940 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8c3fb4b6-3b24-43b0-9175-9a1f88d4b942 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:04.929812 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8c3fb4b6-3b24-43b0-9175-9a1f88d4b942 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:04.939649 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8c3fb4b6-3b24-43b0-9175-9a1f88d4b942 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:04.941838 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8c3fb4b6-3b24-43b0-9175-9a1f88d4b942 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:04.943577 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8c3fb4b6-3b24-43b0-9175-9a1f88d4b942 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6" status: 200 len: 1407 microversion: 2.54 time: 0.107713 Jun 10 18:09:04.944657 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1780/3463] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:09:04 2022] GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 => generated 1407 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:09:04.991354 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-004974d7-26ad-4746-9e12-31f87ae49c53 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:04.992474 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-004974d7-26ad-4746-9e12-31f87ae49c53 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 05c9cadb-1823-4e2c-9c9f-c3be6892e074] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:05.006169 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1f82f455-0f04-4b13-bdea-80339b4ccaac tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:05.007329 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-004974d7-26ad-4746-9e12-31f87ae49c53 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:05.008121 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-004974d7-26ad-4746-9e12-31f87ae49c53 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:05.009250 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-004974d7-26ad-4746-9e12-31f87ae49c53 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:05.009965 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-004974d7-26ad-4746-9e12-31f87ae49c53 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:05.016602 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1f82f455-0f04-4b13-bdea-80339b4ccaac tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1665 microversion: 2.1 time: 0.205539 Jun 10 18:09:05.017170 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1684/3464] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:04 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1665 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:09:05.028261 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-004974d7-26ad-4746-9e12-31f87ae49c53 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] HTTP exception thrown: Instance 05c9cadb-1823-4e2c-9c9f-c3be6892e074 could not be found. Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-004974d7-26ad-4746-9e12-31f87ae49c53 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Request method failure captured: Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/05c9cadb-1823-4e2c-9c9f-c3be6892e074 HTTP/1.1 Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4fu_AYOPdFFJd8JVAYOTheTFSnyPZ-qiPxdNG_pAfWLUrJ5f24u96zVdpuDpUlsPTInijfnJBXVbodAhbFGtTke7WBdKaH4uaKtjYUFQOzVbOhDwYx8uvcAx6JIEZVUJCzrT5Zs3s_HlXd7mITajtJGPkUNp7u0UhMy3r7J2GEvLGU Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: bb2c4b1067ac4cab8b8565bc987f00b1 Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersOnMultiNodesTest-1408923964 Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/bb2c4b1067ac4cab8b8565bc987f00b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bb2c4b1067ac4cab8b8565bc987f00b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bb2c4b1067ac4cab8b8565bc987f00b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_bb2c4b1067ac4cab8b8565bc987f00b1", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersOnMultiNodesTest-1408923964 Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: bb2c4b1067ac4cab8b8565bc987f00b1 Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1408923964 Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersOnMultiNodesTest-1408923964-project Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 9c189471a3ab4ec2b644b3ee1352d4e6 Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersOnMultiNodesTest-1408923964-project Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 05c9cadb-1823-4e2c-9c9f-c3be6892e074 could not be found. Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '05c9cadb-1823-4e2c-9c9f-c3be6892e074'} Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05c9cadb-1823-4e2c-9c9f-c3be6892e074 could not be found. Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05c9cadb-1823-4e2c-9c9f-c3be6892e074 could not be found. Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:05.029956 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:05.034110 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:05.034110 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:05.034110 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:05.034110 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:09:05.034110 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:09:05.034110 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05c9cadb-1823-4e2c-9c9f-c3be6892e074 could not be found. Jun 10 18:09:05.034110 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:05.034110 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-004974d7-26ad-4746-9e12-31f87ae49c53 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Returning 404 to user: Instance 05c9cadb-1823-4e2c-9c9f-c3be6892e074 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:09:05.034110 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-004974d7-26ad-4746-9e12-31f87ae49c53 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/05c9cadb-1823-4e2c-9c9f-c3be6892e074" status: 404 len: 111 microversion: 2.1 time: 0.048260 Jun 10 18:09:05.034110 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1781/3465] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:04 2022] GET /compute/v2.1/servers/05c9cadb-1823-4e2c-9c9f-c3be6892e074 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:09:05.040448 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9b520c3a-913b-464c-b79d-1377da089b21 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:05.041208 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9b520c3a-913b-464c-b79d-1377da089b21 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 07afccc2-6b07-4dd4-b9f5-aaa7609f72d1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:05.048686 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b520c3a-913b-464c-b79d-1377da089b21 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:05.052120 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b520c3a-913b-464c-b79d-1377da089b21 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:05.052120 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b520c3a-913b-464c-b79d-1377da089b21 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:05.052120 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b520c3a-913b-464c-b79d-1377da089b21 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:05.070564 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-9b520c3a-913b-464c-b79d-1377da089b21 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] HTTP exception thrown: Instance 07afccc2-6b07-4dd4-b9f5-aaa7609f72d1 could not be found. Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9b520c3a-913b-464c-b79d-1377da089b21 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Request method failure captured: Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/07afccc2-6b07-4dd4-b9f5-aaa7609f72d1 HTTP/1.1 Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4fu_AYOPdFFJd8JVAYOTheTFSnyPZ-qiPxdNG_pAfWLUrJ5f24u96zVdpuDpUlsPTInijfnJBXVbodAhbFGtTke7WBdKaH4uaKtjYUFQOzVbOhDwYx8uvcAx6JIEZVUJCzrT5Zs3s_HlXd7mITajtJGPkUNp7u0UhMy3r7J2GEvLGU Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: bb2c4b1067ac4cab8b8565bc987f00b1 Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersOnMultiNodesTest-1408923964 Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/bb2c4b1067ac4cab8b8565bc987f00b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bb2c4b1067ac4cab8b8565bc987f00b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bb2c4b1067ac4cab8b8565bc987f00b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_bb2c4b1067ac4cab8b8565bc987f00b1", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersOnMultiNodesTest-1408923964 Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: bb2c4b1067ac4cab8b8565bc987f00b1 Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1408923964 Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersOnMultiNodesTest-1408923964-project Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 9c189471a3ab4ec2b644b3ee1352d4e6 Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersOnMultiNodesTest-1408923964-project Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 07afccc2-6b07-4dd4-b9f5-aaa7609f72d1 could not be found. Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '07afccc2-6b07-4dd4-b9f5-aaa7609f72d1'} Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07afccc2-6b07-4dd4-b9f5-aaa7609f72d1 could not be found. Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07afccc2-6b07-4dd4-b9f5-aaa7609f72d1 could not be found. Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:05.072174 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:05.076747 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:05.076747 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:05.076747 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:05.076747 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:09:05.076747 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:09:05.076747 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07afccc2-6b07-4dd4-b9f5-aaa7609f72d1 could not be found. Jun 10 18:09:05.076747 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:05.076747 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9b520c3a-913b-464c-b79d-1377da089b21 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Returning 404 to user: Instance 07afccc2-6b07-4dd4-b9f5-aaa7609f72d1 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:09:05.076747 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9b520c3a-913b-464c-b79d-1377da089b21 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/07afccc2-6b07-4dd4-b9f5-aaa7609f72d1" status: 404 len: 111 microversion: 2.1 time: 0.037187 Jun 10 18:09:05.083153 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-44c66c15-1e51-426c-bd73-028dca5036c3 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:05.084569 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1685/3466] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:05 2022] GET /compute/v2.1/servers/07afccc2-6b07-4dd4-b9f5-aaa7609f72d1 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:09:05.128664 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-10f5cddd-4836-428d-a186-bfc5e1eb45f0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:05.129276 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-10f5cddd-4836-428d-a186-bfc5e1eb45f0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: ea345031-5220-43d0-9971-ada561720697] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:05.139161 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10f5cddd-4836-428d-a186-bfc5e1eb45f0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:05.139647 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10f5cddd-4836-428d-a186-bfc5e1eb45f0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:05.141609 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10f5cddd-4836-428d-a186-bfc5e1eb45f0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:05.142051 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10f5cddd-4836-428d-a186-bfc5e1eb45f0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:05.231944 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-44c66c15-1e51-426c-bd73-028dca5036c3 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "DELETE /compute/v2.1/os-server-groups/9cae038e-8739-45c4-927d-bdae8e405060" status: 204 len: 0 microversion: 2.1 time: 0.152629 Jun 10 18:09:05.233398 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1782/3467] 10.222.0.35 () {58 vars in 1265 bytes} [Fri Jun 10 18:09:05 2022] DELETE /compute/v2.1/os-server-groups/9cae038e-8739-45c4-927d-bdae8e405060 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:09:05.241471 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8e007f6d-df86-4bc3-bf50-5234a0b74975 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:05.244628 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8e007f6d-df86-4bc3-bf50-5234a0b74975 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 5a7cc611-89ea-4c58-af65-315000f47739] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:05.261312 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8e007f6d-df86-4bc3-bf50-5234a0b74975 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:05.267267 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8e007f6d-df86-4bc3-bf50-5234a0b74975 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:05.268144 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8e007f6d-df86-4bc3-bf50-5234a0b74975 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:05.268980 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8e007f6d-df86-4bc3-bf50-5234a0b74975 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:05.304326 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8e007f6d-df86-4bc3-bf50-5234a0b74975 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 5a7cc611-89ea-4c58-af65-315000f47739] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:09:05.324249 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-10f5cddd-4836-428d-a186-bfc5e1eb45f0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:05.337540 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-10f5cddd-4836-428d-a186-bfc5e1eb45f0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697" status: 200 len: 1553 microversion: 2.1 time: 0.214272 Jun 10 18:09:05.339900 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1686/3468] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:05 2022] GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697 => generated 1553 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:09:05.431141 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e10103dd-ce23-4bc7-95c7-fe67e628d1eb tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c17fc0d0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:05.481884 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e10103dd-ce23-4bc7-95c7-fe67e628d1eb tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a" status: 200 len: 1435 microversion: 2.1 time: 0.058272 Jun 10 18:09:05.482476 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1687/3469] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:09:05 2022] GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a => generated 1435 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:05.551341 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:09:05.835595 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8e007f6d-df86-4bc3-bf50-5234a0b74975 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "DELETE /compute/v2.1/servers/5a7cc611-89ea-4c58-af65-315000f47739" status: 204 len: 0 microversion: 2.1 time: 0.597729 Jun 10 18:09:05.838589 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1783/3470] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:09:05 2022] DELETE /compute/v2.1/servers/5a7cc611-89ea-4c58-af65-315000f47739 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 18:09:05.846765 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ca664e69-8f7b-4eb8-a332-6fa3b9646894 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:05.847821 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ca664e69-8f7b-4eb8-a332-6fa3b9646894 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 5a7cc611-89ea-4c58-af65-315000f47739] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:05.868676 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ca664e69-8f7b-4eb8-a332-6fa3b9646894 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:05.875860 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ca664e69-8f7b-4eb8-a332-6fa3b9646894 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:05.876974 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ca664e69-8f7b-4eb8-a332-6fa3b9646894 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:05.877449 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ca664e69-8f7b-4eb8-a332-6fa3b9646894 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:05.965851 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c394313a-c6eb-4116-908a-8139f4f8a0b8 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:05.966912 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c394313a-c6eb-4116-908a-8139f4f8a0b8 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:05.975776 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c394313a-c6eb-4116-908a-8139f4f8a0b8 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:05.976738 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c394313a-c6eb-4116-908a-8139f4f8a0b8 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:05.977772 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c394313a-c6eb-4116-908a-8139f4f8a0b8 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:05.978447 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c394313a-c6eb-4116-908a-8139f4f8a0b8 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:06.074482 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c394313a-c6eb-4116-908a-8139f4f8a0b8 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:06.084088 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c394313a-c6eb-4116-908a-8139f4f8a0b8 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:06.086936 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c394313a-c6eb-4116-908a-8139f4f8a0b8 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:06.088693 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c394313a-c6eb-4116-908a-8139f4f8a0b8 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6" status: 200 len: 1407 microversion: 2.54 time: 0.129156 Jun 10 18:09:06.089869 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1784/3471] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:09:05 2022] GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 => generated 1407 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:09:06.095305 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-32d8ec5d-070c-46d9-9c56-2090ccb25c01 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:06.096094 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-32d8ec5d-070c-46d9-9c56-2090ccb25c01 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:06.103749 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-32d8ec5d-070c-46d9-9c56-2090ccb25c01 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:06.104203 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-32d8ec5d-070c-46d9-9c56-2090ccb25c01 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:06.105054 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-32d8ec5d-070c-46d9-9c56-2090ccb25c01 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:06.105517 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-32d8ec5d-070c-46d9-9c56-2090ccb25c01 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:06.135868 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ca664e69-8f7b-4eb8-a332-6fa3b9646894 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:06.152371 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ca664e69-8f7b-4eb8-a332-6fa3b9646894 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/5a7cc611-89ea-4c58-af65-315000f47739" status: 200 len: 1472 microversion: 2.1 time: 0.311799 Jun 10 18:09:06.153922 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1688/3472] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:05 2022] GET /compute/v2.1/servers/5a7cc611-89ea-4c58-af65-315000f47739 => generated 1472 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:06.271379 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-32d8ec5d-070c-46d9-9c56-2090ccb25c01 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:06.281675 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-32d8ec5d-070c-46d9-9c56-2090ccb25c01 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1665 microversion: 2.1 time: 0.189492 Jun 10 18:09:06.282676 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1785/3473] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:06 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1665 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:06.357450 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1abed97c-5d18-43d3-8e2d-910e5190e0c7 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:06.358383 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1abed97c-5d18-43d3-8e2d-910e5190e0c7 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: ea345031-5220-43d0-9971-ada561720697] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:06.365581 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1abed97c-5d18-43d3-8e2d-910e5190e0c7 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:06.366074 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1abed97c-5d18-43d3-8e2d-910e5190e0c7 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:06.367689 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1abed97c-5d18-43d3-8e2d-910e5190e0c7 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:06.367689 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1abed97c-5d18-43d3-8e2d-910e5190e0c7 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:06.501463 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a71b75bc-5d0d-49f6-a950-4426cf64ecd0 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77b3c24430>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:06.572334 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a71b75bc-5d0d-49f6-a950-4426cf64ecd0 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a" status: 200 len: 1435 microversion: 2.1 time: 0.069698 Jun 10 18:09:06.573573 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1786/3474] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:09:06 2022] GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a => generated 1435 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:06.580346 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-42ffe234-9183-4755-b2f1-bc0653231099 req-2e70377b-09ca-4301-bbbb-d40bd14c23f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea345031-5220-43d0-9971-ada561720697", "name": "network-vif-deleted", "tag": "ae82cc20-9d2b-43b8-bd6a-60e640f9e53a"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:06.590479 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-42ffe234-9183-4755-b2f1-bc0653231099 req-2e70377b-09ca-4301-bbbb-d40bd14c23f1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:06.591145 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-42ffe234-9183-4755-b2f1-bc0653231099 req-2e70377b-09ca-4301-bbbb-d40bd14c23f1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:06.608990 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-42ffe234-9183-4755-b2f1-bc0653231099 req-2e70377b-09ca-4301-bbbb-d40bd14c23f1 service nova] Creating event network-vif-deleted:ae82cc20-9d2b-43b8-bd6a-60e640f9e53a for instance ea345031-5220-43d0-9971-ada561720697 on chh1-master-2 Jun 10 18:09:06.614393 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-42ffe234-9183-4755-b2f1-bc0653231099 req-2e70377b-09ca-4301-bbbb-d40bd14c23f1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038944 Jun 10 18:09:06.615666 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1787/3475] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:09:06.647204 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1abed97c-5d18-43d3-8e2d-910e5190e0c7 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:06.656098 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1abed97c-5d18-43d3-8e2d-910e5190e0c7 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697" status: 200 len: 1553 microversion: 2.1 time: 0.302426 Jun 10 18:09:06.665934 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1689/3476] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:06 2022] GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697 => generated 1553 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:09:07.110299 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6c372a96-2512-47ca-8dd5-dc4b7f2f7310 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:07.111464 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6c372a96-2512-47ca-8dd5-dc4b7f2f7310 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:07.120567 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6c372a96-2512-47ca-8dd5-dc4b7f2f7310 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:07.120567 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6c372a96-2512-47ca-8dd5-dc4b7f2f7310 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:07.123883 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6c372a96-2512-47ca-8dd5-dc4b7f2f7310 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:07.123883 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6c372a96-2512-47ca-8dd5-dc4b7f2f7310 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:07.170329 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b318386f-0f9e-4876-a7a0-2494cca5a749 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:07.171502 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b318386f-0f9e-4876-a7a0-2494cca5a749 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 5a7cc611-89ea-4c58-af65-315000f47739] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:07.179294 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b318386f-0f9e-4876-a7a0-2494cca5a749 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:07.179765 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b318386f-0f9e-4876-a7a0-2494cca5a749 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:07.184544 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b318386f-0f9e-4876-a7a0-2494cca5a749 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:07.184544 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b318386f-0f9e-4876-a7a0-2494cca5a749 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:07.351353 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6c372a96-2512-47ca-8dd5-dc4b7f2f7310 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:07.351353 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6c372a96-2512-47ca-8dd5-dc4b7f2f7310 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:07.351353 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6c372a96-2512-47ca-8dd5-dc4b7f2f7310 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:07.351353 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6c372a96-2512-47ca-8dd5-dc4b7f2f7310 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6" status: 200 len: 1407 microversion: 2.54 time: 0.124850 Jun 10 18:09:07.351353 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1788/3477] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:09:07 2022] GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 => generated 1407 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:09:07.351353 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a47f382f-fafc-48b6-8545-e2b061756921 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:07.351353 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a47f382f-fafc-48b6-8545-e2b061756921 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:07.351353 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a47f382f-fafc-48b6-8545-e2b061756921 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:07.351353 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a47f382f-fafc-48b6-8545-e2b061756921 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:07.351353 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a47f382f-fafc-48b6-8545-e2b061756921 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:07.351353 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a47f382f-fafc-48b6-8545-e2b061756921 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:07.516575 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b318386f-0f9e-4876-a7a0-2494cca5a749 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:07.525080 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b318386f-0f9e-4876-a7a0-2494cca5a749 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/5a7cc611-89ea-4c58-af65-315000f47739" status: 200 len: 1472 microversion: 2.1 time: 0.358469 Jun 10 18:09:07.527653 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1690/3478] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:07 2022] GET /compute/v2.1/servers/5a7cc611-89ea-4c58-af65-315000f47739 => generated 1472 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:09:07.540522 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a47f382f-fafc-48b6-8545-e2b061756921 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:07.550898 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a47f382f-fafc-48b6-8545-e2b061756921 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1665 microversion: 2.1 time: 0.254263 Jun 10 18:09:07.552542 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1789/3479] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:07 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1665 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:09:07.589036 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4eaa0529-3e1a-4776-9c70-3c4522bc06b0 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c60f29d0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:07.672653 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4eaa0529-3e1a-4776-9c70-3c4522bc06b0 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a" status: 200 len: 1435 microversion: 2.1 time: 0.095753 Jun 10 18:09:07.676253 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ba442d0e-2748-42eb-9e43-512b0363ec81 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:07.677407 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ba442d0e-2748-42eb-9e43-512b0363ec81 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: ea345031-5220-43d0-9971-ada561720697] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:07.681567 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1691/3480] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:09:07 2022] GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a => generated 1435 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:07.688480 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ba442d0e-2748-42eb-9e43-512b0363ec81 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:07.689230 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ba442d0e-2748-42eb-9e43-512b0363ec81 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:07.690188 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ba442d0e-2748-42eb-9e43-512b0363ec81 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:07.690777 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ba442d0e-2748-42eb-9e43-512b0363ec81 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:07.801635 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ba442d0e-2748-42eb-9e43-512b0363ec81 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:07.821765 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ba442d0e-2748-42eb-9e43-512b0363ec81 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697" status: 200 len: 1346 microversion: 2.1 time: 0.151883 Jun 10 18:09:07.824214 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1790/3481] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:07 2022] GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697 => generated 1346 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:09:08.253307 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-41bc21e8-9cdc-42b8-a013-44fa6a0643e3 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:08.254037 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-41bc21e8-9cdc-42b8-a013-44fa6a0643e3 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:08.261673 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41bc21e8-9cdc-42b8-a013-44fa6a0643e3 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:08.262137 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41bc21e8-9cdc-42b8-a013-44fa6a0643e3 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:08.263128 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41bc21e8-9cdc-42b8-a013-44fa6a0643e3 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:08.263436 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41bc21e8-9cdc-42b8-a013-44fa6a0643e3 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:08.403210 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-41bc21e8-9cdc-42b8-a013-44fa6a0643e3 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:08.418159 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-41bc21e8-9cdc-42b8-a013-44fa6a0643e3 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:08.418159 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-41bc21e8-9cdc-42b8-a013-44fa6a0643e3 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:08.418159 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-41bc21e8-9cdc-42b8-a013-44fa6a0643e3 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6" status: 200 len: 1407 microversion: 2.54 time: 0.168420 Jun 10 18:09:08.418159 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1692/3482] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:09:08 2022] GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:09:08.547939 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-45d92245-a64e-4c55-a540-bdfb995ac705 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:08.549061 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-45d92245-a64e-4c55-a540-bdfb995ac705 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 5a7cc611-89ea-4c58-af65-315000f47739] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:08.555811 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-45d92245-a64e-4c55-a540-bdfb995ac705 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:08.556436 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-45d92245-a64e-4c55-a540-bdfb995ac705 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:08.557285 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-45d92245-a64e-4c55-a540-bdfb995ac705 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:08.557804 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-45d92245-a64e-4c55-a540-bdfb995ac705 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:08.568735 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-180b17b9-afe6-4cdf-8ae0-ea5d927ea515 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:08.569498 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-180b17b9-afe6-4cdf-8ae0-ea5d927ea515 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:08.576736 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-180b17b9-afe6-4cdf-8ae0-ea5d927ea515 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:08.577452 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-180b17b9-afe6-4cdf-8ae0-ea5d927ea515 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:08.578352 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-180b17b9-afe6-4cdf-8ae0-ea5d927ea515 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:08.578859 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-180b17b9-afe6-4cdf-8ae0-ea5d927ea515 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:08.638625 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-45d92245-a64e-4c55-a540-bdfb995ac705 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c189471a3ab4ec2b644b3ee1352d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2c4b1067ac4cab8b8565bc987f00b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:08.653364 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-45d92245-a64e-4c55-a540-bdfb995ac705 tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/5a7cc611-89ea-4c58-af65-315000f47739" status: 200 len: 1430 microversion: 2.1 time: 0.104634 Jun 10 18:09:08.654748 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1791/3483] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:08 2022] GET /compute/v2.1/servers/5a7cc611-89ea-4c58-af65-315000f47739 => generated 1430 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:08.661233 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-4b2fc1d0-d4e2-4531-a96b-8652107fecfb req-7f465d8d-7722-41e4-8ec6-1bdfa7272a9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a7cc611-89ea-4c58-af65-315000f47739", "name": "network-vif-deleted", "tag": "ac79ea71-a2b0-4849-806b-8ca1657704b3"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:08.673675 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-4b2fc1d0-d4e2-4531-a96b-8652107fecfb req-7f465d8d-7722-41e4-8ec6-1bdfa7272a9a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:08.674361 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-4b2fc1d0-d4e2-4531-a96b-8652107fecfb req-7f465d8d-7722-41e4-8ec6-1bdfa7272a9a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:08.694157 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-4b2fc1d0-d4e2-4531-a96b-8652107fecfb req-7f465d8d-7722-41e4-8ec6-1bdfa7272a9a service nova] Creating event network-vif-deleted:ac79ea71-a2b0-4849-806b-8ca1657704b3 for instance 5a7cc611-89ea-4c58-af65-315000f47739 on chh1-master-2 Jun 10 18:09:08.709475 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-4b2fc1d0-d4e2-4531-a96b-8652107fecfb req-7f465d8d-7722-41e4-8ec6-1bdfa7272a9a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052266 Jun 10 18:09:08.710098 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1792/3484] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:09:08.717592 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bc4db653-9b72-4076-a52b-4c7d59c2b11f tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77b3c65310>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:08.761023 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-180b17b9-afe6-4cdf-8ae0-ea5d927ea515 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:08.783814 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-180b17b9-afe6-4cdf-8ae0-ea5d927ea515 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.219407 Jun 10 18:09:08.784435 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1693/3485] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:08 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:08.789411 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bc4db653-9b72-4076-a52b-4c7d59c2b11f tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a" status: 200 len: 1444 microversion: 2.1 time: 0.078056 Jun 10 18:09:08.790490 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1793/3486] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:09:08 2022] GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a => generated 1444 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:08.802590 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f49f4a56-064d-4fa3-b299-dd7b6d153a55 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c614b700>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:08.805086 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-45c380cf-488f-49ea-87fc-168004c847ec tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:08.806239 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-45c380cf-488f-49ea-87fc-168004c847ec tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:08.814631 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-45c380cf-488f-49ea-87fc-168004c847ec tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:08.815372 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-45c380cf-488f-49ea-87fc-168004c847ec tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:08.818136 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-45c380cf-488f-49ea-87fc-168004c847ec tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:08.818584 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-45c380cf-488f-49ea-87fc-168004c847ec tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:08.856943 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f49f4a56-064d-4fa3-b299-dd7b6d153a55 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a" status: 200 len: 1444 microversion: 2.1 time: 0.058324 Jun 10 18:09:08.861948 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1694/3487] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:09:08 2022] GET /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a => generated 1444 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:08.866890 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-20235c71-2e52-42ad-ace7-bd2a6d61a659 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:08.867656 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-20235c71-2e52-42ad-ace7-bd2a6d61a659 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: ea345031-5220-43d0-9971-ada561720697] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:08.875923 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-20235c71-2e52-42ad-ace7-bd2a6d61a659 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:08.876560 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-20235c71-2e52-42ad-ace7-bd2a6d61a659 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:08.877589 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-20235c71-2e52-42ad-ace7-bd2a6d61a659 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:08.878296 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-20235c71-2e52-42ad-ace7-bd2a6d61a659 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:08.958964 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-20235c71-2e52-42ad-ace7-bd2a6d61a659 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:08.967416 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-20235c71-2e52-42ad-ace7-bd2a6d61a659 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697" status: 200 len: 1346 microversion: 2.1 time: 0.104213 Jun 10 18:09:08.968578 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1695/3488] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:08 2022] GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697 => generated 1346 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:08.974118 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1d4bfc18-0f7b-47dc-9c01-b47447be301b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c614b550>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:08.989889 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-45c380cf-488f-49ea-87fc-168004c847ec tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:08.997049 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-45c380cf-488f-49ea-87fc-168004c847ec tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1668 microversion: 2.1 time: 0.196408 Jun 10 18:09:08.997620 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1794/3489] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:08 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1668 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:09.014383 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0a8df755-4b61-4738-95bb-c63d12fbd4d1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:09.015446 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0a8df755-4b61-4738-95bb-c63d12fbd4d1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:09.022136 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0a8df755-4b61-4738-95bb-c63d12fbd4d1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:09.023056 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0a8df755-4b61-4738-95bb-c63d12fbd4d1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:09.024441 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0a8df755-4b61-4738-95bb-c63d12fbd4d1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:09.024441 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0a8df755-4b61-4738-95bb-c63d12fbd4d1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:09.053573 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0a8df755-4b61-4738-95bb-c63d12fbd4d1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:09:09.060768 chdv-master-2 devstack@n-api.service[126594]: INFO nova.compute.api [None req-0a8df755-4b61-4738-95bb-c63d12fbd4d1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Working on deleting snapshot 30223dbe-e935-463d-a769-775228415c33 from shelved instance... Jun 10 18:09:10.828415 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1d4bfc18-0f7b-47dc-9c01-b47447be301b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "DELETE /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a" status: 204 len: 0 microversion: 2.1 time: 1.858583 Jun 10 18:09:10.828996 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1696/3490] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:08 2022] DELETE /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a => generated 0 bytes in 1860 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:09:10.834016 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bfe518ea-334f-4c18-8c58-ea94508cc6d5 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:10.834627 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bfe518ea-334f-4c18-8c58-ea94508cc6d5 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:10.841659 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bfe518ea-334f-4c18-8c58-ea94508cc6d5 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:10.842109 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bfe518ea-334f-4c18-8c58-ea94508cc6d5 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:10.843065 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bfe518ea-334f-4c18-8c58-ea94508cc6d5 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:10.843608 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bfe518ea-334f-4c18-8c58-ea94508cc6d5 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:10.910449 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bfe518ea-334f-4c18-8c58-ea94508cc6d5 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:10.919387 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bfe518ea-334f-4c18-8c58-ea94508cc6d5 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:10.920961 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bfe518ea-334f-4c18-8c58-ea94508cc6d5 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:10.922132 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bfe518ea-334f-4c18-8c58-ea94508cc6d5 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6" status: 200 len: 1407 microversion: 2.54 time: 0.092225 Jun 10 18:09:10.922683 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1697/3491] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:09:10 2022] GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 => generated 1407 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:09:10.927658 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-82811d14-e8d3-418b-bf6a-7dafb59ffcfa tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:10.928261 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-82811d14-e8d3-418b-bf6a-7dafb59ffcfa tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] [instance: 5a7cc611-89ea-4c58-af65-315000f47739] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:10.934754 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-82811d14-e8d3-418b-bf6a-7dafb59ffcfa tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:10.935327 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-82811d14-e8d3-418b-bf6a-7dafb59ffcfa tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:10.936103 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-82811d14-e8d3-418b-bf6a-7dafb59ffcfa tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:10.940032 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-82811d14-e8d3-418b-bf6a-7dafb59ffcfa tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:10.954040 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-82811d14-e8d3-418b-bf6a-7dafb59ffcfa tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] HTTP exception thrown: Instance 5a7cc611-89ea-4c58-af65-315000f47739 could not be found. Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-82811d14-e8d3-418b-bf6a-7dafb59ffcfa tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Request method failure captured: Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/5a7cc611-89ea-4c58-af65-315000f47739 HTTP/1.1 Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4fu_AYOPdFFJd8JVAYOTheTFSnyPZ-qiPxdNG_pAfWLUrJ5f24u96zVdpuDpUlsPTInijfnJBXVbodAhbFGtTke7WBdKaH4uaKtjYUFQOzVbOhDwYx8uvcAx6JIEZVUJCzrT5Zs3s_HlXd7mITajtJGPkUNp7u0UhMy3r7J2GEvLGU Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: bb2c4b1067ac4cab8b8565bc987f00b1 Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersOnMultiNodesTest-1408923964 Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/bb2c4b1067ac4cab8b8565bc987f00b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bb2c4b1067ac4cab8b8565bc987f00b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bb2c4b1067ac4cab8b8565bc987f00b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_bb2c4b1067ac4cab8b8565bc987f00b1", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersOnMultiNodesTest-1408923964 Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: bb2c4b1067ac4cab8b8565bc987f00b1 Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1408923964 Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersOnMultiNodesTest-1408923964-project Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 9c189471a3ab4ec2b644b3ee1352d4e6 Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersOnMultiNodesTest-1408923964-project Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 5a7cc611-89ea-4c58-af65-315000f47739 could not be found. Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '5a7cc611-89ea-4c58-af65-315000f47739'} Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a7cc611-89ea-4c58-af65-315000f47739 could not be found. Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a7cc611-89ea-4c58-af65-315000f47739 could not be found. Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:10.955844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:10.961003 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:10.961003 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:10.961003 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:10.961003 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:09:10.961003 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:09:10.961003 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a7cc611-89ea-4c58-af65-315000f47739 could not be found. Jun 10 18:09:10.961003 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:10.961003 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-82811d14-e8d3-418b-bf6a-7dafb59ffcfa tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] Returning 404 to user: Instance 5a7cc611-89ea-4c58-af65-315000f47739 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:09:10.961003 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-82811d14-e8d3-418b-bf6a-7dafb59ffcfa tempest-ServersOnMultiNodesTest-1408923964 tempest-ServersOnMultiNodesTest-1408923964-project] 10.222.0.35 "GET /compute/v2.1/servers/5a7cc611-89ea-4c58-af65-315000f47739" status: 404 len: 111 microversion: 2.1 time: 0.033655 Jun 10 18:09:10.961003 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1698/3492] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:10 2022] GET /compute/v2.1/servers/5a7cc611-89ea-4c58-af65-315000f47739 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:09:10.976417 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1dd928f1-821b-4d12-8e8f-b861895d2a9f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:10.977433 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1dd928f1-821b-4d12-8e8f-b861895d2a9f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: ea345031-5220-43d0-9971-ada561720697] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:10.984480 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:09:10.986812 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1dd928f1-821b-4d12-8e8f-b861895d2a9f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:10.987442 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1dd928f1-821b-4d12-8e8f-b861895d2a9f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:10.988224 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1dd928f1-821b-4d12-8e8f-b861895d2a9f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:10.988695 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1dd928f1-821b-4d12-8e8f-b861895d2a9f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:11.056873 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1dd928f1-821b-4d12-8e8f-b861895d2a9f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:11.066249 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1dd928f1-821b-4d12-8e8f-b861895d2a9f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697" status: 200 len: 1346 microversion: 2.1 time: 0.095899 Jun 10 18:09:11.067434 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1699/3493] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:10 2022] GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697 => generated 1346 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:11.072368 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-551cd401-ac7d-4122-a4b9-753146789737 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:11.073396 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0a8df755-4b61-4738-95bb-c63d12fbd4d1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Doing local delete in cell 0f13ffb7-1a21-4641-8558-8a89dd295960(cell1) {{(pid=126594) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 10 18:09:11.073955 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-551cd401-ac7d-4122-a4b9-753146789737 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 289cf5c3-10c7-4a83-94d9-d83623d0c5e7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:11.074264 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0a8df755-4b61-4738-95bb-c63d12fbd4d1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:11.075730 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0a8df755-4b61-4738-95bb-c63d12fbd4d1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:11.076625 chdv-master-2 devstack@n-api.service[126594]: INFO nova.compute.api [None req-0a8df755-4b61-4738-95bb-c63d12fbd4d1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jun 10 18:09:11.081981 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-551cd401-ac7d-4122-a4b9-753146789737 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:11.082440 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-551cd401-ac7d-4122-a4b9-753146789737 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:11.083360 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-0a8df755-4b61-4738-95bb-c63d12fbd4d1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] deallocate_for_instance() {{(pid=126594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 10 18:09:11.083565 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-551cd401-ac7d-4122-a4b9-753146789737 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:11.084021 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-551cd401-ac7d-4122-a4b9-753146789737 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:11.125315 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-551cd401-ac7d-4122-a4b9-753146789737 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 289cf5c3-10c7-4a83-94d9-d83623d0c5e7] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:09:11.461431 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-551cd401-ac7d-4122-a4b9-753146789737 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "DELETE /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7" status: 204 len: 0 microversion: 2.1 time: 0.391685 Jun 10 18:09:11.465733 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1700/3494] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:09:11 2022] DELETE /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:09:11.637390 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-29c33852-5e34-4908-9852-6bbbfd2c06df tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1032682944", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "d54e5981-7a3d-42d3-ae71-85d1f7436f39"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:11.712953 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-29c33852-5e34-4908-9852-6bbbfd2c06df tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] validate_networks() for [('d54e5981-7a3d-42d3-ae71-85d1f7436f39', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:09:11.823415 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-0a8df755-4b61-4738-95bb-c63d12fbd4d1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Updating instance_info_cache with network_info: [] {{(pid=126594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 10 18:09:12.236776 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-29c33852-5e34-4908-9852-6bbbfd2c06df tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:09:12.237542 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-29c33852-5e34-4908-9852-6bbbfd2c06df tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:09:12.238018 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-29c33852-5e34-4908-9852-6bbbfd2c06df tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:09:12.238427 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-29c33852-5e34-4908-9852-6bbbfd2c06df tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:09:12.239339 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-29c33852-5e34-4908-9852-6bbbfd2c06df tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:09:12.251265 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-29c33852-5e34-4908-9852-6bbbfd2c06df tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:12.251714 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-29c33852-5e34-4908-9852-6bbbfd2c06df tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:12.252545 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-29c33852-5e34-4908-9852-6bbbfd2c06df tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:12.252991 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-29c33852-5e34-4908-9852-6bbbfd2c06df tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:12.275106 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-29c33852-5e34-4908-9852-6bbbfd2c06df tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Getting quotas for project af241982b5884c22b5e7103f1ea4b8ef. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:09:12.280967 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-29c33852-5e34-4908-9852-6bbbfd2c06df tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Getting quotas for user 8adb0ac9df46461489fa6bd3951417cf and project af241982b5884c22b5e7103f1ea4b8ef. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:09:12.295137 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-29c33852-5e34-4908-9852-6bbbfd2c06df tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:09:12.297587 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-29c33852-5e34-4908-9852-6bbbfd2c06df tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: cd20ed09-0a67-4b14-881f-2977acd23396] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:09:12.462000 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-29c33852-5e34-4908-9852-6bbbfd2c06df tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.836207 Jun 10 18:09:12.467966 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1701/3495] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:09:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 10 18:09:12.473315 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-07f35d31-ca4e-43fa-929e-00433fecdef0 req-a9d0d375-a3d5-41d8-8776-baee7d7d84ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da4ca117-eaa1-4a19-83ca-3da2766c5f15", "name": "network-vif-deleted", "tag": "a82f9160-ebd4-4524-8522-95af49c18023"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:12.485338 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-07f35d31-ca4e-43fa-929e-00433fecdef0 req-a9d0d375-a3d5-41d8-8776-baee7d7d84ac service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:12.485338 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-07f35d31-ca4e-43fa-929e-00433fecdef0 req-a9d0d375-a3d5-41d8-8776-baee7d7d84ac service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:12.494823 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.compute.server_external_events [req-07f35d31-ca4e-43fa-929e-00433fecdef0 req-a9d0d375-a3d5-41d8-8776-baee7d7d84ac service nova] Unable to find a host for instance da4ca117-eaa1-4a19-83ca-3da2766c5f15. Dropping event network-vif-deleted {{(pid=126595) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 10 18:09:12.495708 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-07f35d31-ca4e-43fa-929e-00433fecdef0 req-a9d0d375-a3d5-41d8-8776-baee7d7d84ac service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.026690 Jun 10 18:09:12.496290 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1702/3496] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 10 18:09:12.501386 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d1d40958-09c2-4862-bb79-533751d84b84 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:12.502004 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d1d40958-09c2-4862-bb79-533751d84b84 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:12.509656 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d1d40958-09c2-4862-bb79-533751d84b84 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:12.510358 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d1d40958-09c2-4862-bb79-533751d84b84 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:12.511019 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d1d40958-09c2-4862-bb79-533751d84b84 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:12.511460 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d1d40958-09c2-4862-bb79-533751d84b84 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:12.582506 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d1d40958-09c2-4862-bb79-533751d84b84 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:12.586436 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:09:12.592285 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d1d40958-09c2-4862-bb79-533751d84b84 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:12.594243 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d1d40958-09c2-4862-bb79-533751d84b84 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:12.596368 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d1d40958-09c2-4862-bb79-533751d84b84 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6" status: 200 len: 1407 microversion: 2.54 time: 0.098903 Jun 10 18:09:12.597348 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1703/3497] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:09:12 2022] GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 => generated 1407 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:09:12.607390 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-756456c3-cc6b-4c9b-b6b4-83759a4b2db2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:12.607390 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-756456c3-cc6b-4c9b-b6b4-83759a4b2db2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: ea345031-5220-43d0-9971-ada561720697] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:12.620805 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-756456c3-cc6b-4c9b-b6b4-83759a4b2db2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:12.621402 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-756456c3-cc6b-4c9b-b6b4-83759a4b2db2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:12.623097 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-756456c3-cc6b-4c9b-b6b4-83759a4b2db2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:12.624254 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-756456c3-cc6b-4c9b-b6b4-83759a4b2db2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:12.675825 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-756456c3-cc6b-4c9b-b6b4-83759a4b2db2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:12.676280 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-756456c3-cc6b-4c9b-b6b4-83759a4b2db2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:12.677106 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-756456c3-cc6b-4c9b-b6b4-83759a4b2db2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lazy-loading 'fault' on Instance uuid ea345031-5220-43d0-9971-ada561720697 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:09:12.757976 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-756456c3-cc6b-4c9b-b6b4-83759a4b2db2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:12.767565 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-756456c3-cc6b-4c9b-b6b4-83759a4b2db2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697" status: 200 len: 1351 microversion: 2.1 time: 0.169613 Jun 10 18:09:12.768258 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1704/3498] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:12 2022] GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697 => generated 1351 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:12.773113 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-458618d9-ce8f-4710-8d12-c5d77ff7ce1f req-5bb66c77-d9fb-4253-ac28-8562834488cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "289cf5c3-10c7-4a83-94d9-d83623d0c5e7", "name": "network-vif-unplugged", "status": "completed", "tag": "4e1596e3-56a7-4159-afe3-a1bd5b198fc7"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:12.781896 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-458618d9-ce8f-4710-8d12-c5d77ff7ce1f req-5bb66c77-d9fb-4253-ac28-8562834488cb service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:12.782451 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-458618d9-ce8f-4710-8d12-c5d77ff7ce1f req-5bb66c77-d9fb-4253-ac28-8562834488cb service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:12.794798 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-458618d9-ce8f-4710-8d12-c5d77ff7ce1f req-5bb66c77-d9fb-4253-ac28-8562834488cb service nova] Creating event network-vif-unplugged:4e1596e3-56a7-4159-afe3-a1bd5b198fc7 for instance 289cf5c3-10c7-4a83-94d9-d83623d0c5e7 on chh2-master-2 Jun 10 18:09:12.800770 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-458618d9-ce8f-4710-8d12-c5d77ff7ce1f req-5bb66c77-d9fb-4253-ac28-8562834488cb service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031221 Jun 10 18:09:12.801526 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1705/3499] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:09:12.806829 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-08125b4d-d047-48ae-9e13-0c6580c2240c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:12.807533 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-08125b4d-d047-48ae-9e13-0c6580c2240c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: cd20ed09-0a67-4b14-881f-2977acd23396] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:12.871473 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-08125b4d-d047-48ae-9e13-0c6580c2240c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:12.880014 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-08125b4d-d047-48ae-9e13-0c6580c2240c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396" status: 200 len: 1208 microversion: 2.1 time: 0.077083 Jun 10 18:09:12.880663 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1706/3500] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:12 2022] GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396 => generated 1208 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:13.074134 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0a8df755-4b61-4738-95bb-c63d12fbd4d1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "DELETE /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 204 len: 0 microversion: 2.1 time: 4.063573 Jun 10 18:09:13.074736 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1795/3501] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:09:09 2022] DELETE /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 0 bytes in 4065 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:09:13.083264 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-359d2389-e057-4e58-abbf-bb405eec5f54 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:13.083898 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-359d2389-e057-4e58-abbf-bb405eec5f54 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: da4ca117-eaa1-4a19-83ca-3da2766c5f15] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:13.090820 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-359d2389-e057-4e58-abbf-bb405eec5f54 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:13.091270 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-359d2389-e057-4e58-abbf-bb405eec5f54 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:13.092033 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-359d2389-e057-4e58-abbf-bb405eec5f54 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:13.093041 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-359d2389-e057-4e58-abbf-bb405eec5f54 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:13.106855 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-359d2389-e057-4e58-abbf-bb405eec5f54 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] HTTP exception thrown: Instance da4ca117-eaa1-4a19-83ca-3da2766c5f15 could not be found. Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-359d2389-e057-4e58-abbf-bb405eec5f54 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Request method failure captured: Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 HTTP/1.1 Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4bjYRjdJJInCzu3PVxYJsfBkminC6Ikt7M75i6Sx-ogiu0g-ClcDk6pe5ZbprSFn2IZnkupAGWwRhhyzLuF9eMcuLH1bKi15cgeBj7qi81gCxtLZj7Eo_sXXfXIhz0vAnCNJVtg10TQ8DAW2pxp6y_-W-5vyky7ezDgXd3Gl7vJQCo Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 2b34cb51c168497088d66fa0e507e364 Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServerActionsTestJSON-197909573 Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/2b34cb51c168497088d66fa0e507e364"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2b34cb51c168497088d66fa0e507e364"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2b34cb51c168497088d66fa0e507e364"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_2b34cb51c168497088d66fa0e507e364", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServerActionsTestJSON-197909573 Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 2b34cb51c168497088d66fa0e507e364 Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServerActionsTestJSON-197909573 Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServerActionsTestJSON-197909573-project Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 352e7f5de76c42da9241721fe0f0bf86 Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServerActionsTestJSON-197909573-project Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: exception: Instance da4ca117-eaa1-4a19-83ca-3da2766c5f15 could not be found. Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'da4ca117-eaa1-4a19-83ca-3da2766c5f15'} Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da4ca117-eaa1-4a19-83ca-3da2766c5f15 could not be found. Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da4ca117-eaa1-4a19-83ca-3da2766c5f15 could not be found. Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:13.109151 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:13.113629 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:13.113629 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:13.113629 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:13.113629 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:09:13.113629 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:09:13.113629 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da4ca117-eaa1-4a19-83ca-3da2766c5f15 could not be found. Jun 10 18:09:13.113629 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:13.113629 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-359d2389-e057-4e58-abbf-bb405eec5f54 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Returning 404 to user: Instance da4ca117-eaa1-4a19-83ca-3da2766c5f15 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:09:13.113629 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-359d2389-e057-4e58-abbf-bb405eec5f54 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15" status: 404 len: 111 microversion: 2.1 time: 0.031433 Jun 10 18:09:13.113629 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1707/3502] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:13 2022] GET /compute/v2.1/servers/da4ca117-eaa1-4a19-83ca-3da2766c5f15 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:09:13.120131 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6cf668ac-8c2e-4614-9f6c-c018f70ab3f2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:13.120728 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6cf668ac-8c2e-4614-9f6c-c018f70ab3f2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 5cb5b4a5-d399-4f64-8f6a-8815d86e921a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:13.126852 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6cf668ac-8c2e-4614-9f6c-c018f70ab3f2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:13.127315 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6cf668ac-8c2e-4614-9f6c-c018f70ab3f2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:13.128095 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6cf668ac-8c2e-4614-9f6c-c018f70ab3f2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:13.128562 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6cf668ac-8c2e-4614-9f6c-c018f70ab3f2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:13.159382 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6cf668ac-8c2e-4614-9f6c-c018f70ab3f2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 5cb5b4a5-d399-4f64-8f6a-8815d86e921a] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:09:13.189009 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:09:13.492681 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6cf668ac-8c2e-4614-9f6c-c018f70ab3f2 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "DELETE /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a" status: 204 len: 0 microversion: 2.1 time: 0.376661 Jun 10 18:09:13.493289 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1796/3503] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:09:13 2022] DELETE /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:09:13.502252 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cb577507-695c-4c60-b9f9-9996306e3876 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:13.502864 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cb577507-695c-4c60-b9f9-9996306e3876 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 5cb5b4a5-d399-4f64-8f6a-8815d86e921a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:13.510195 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cb577507-695c-4c60-b9f9-9996306e3876 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:13.515268 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cb577507-695c-4c60-b9f9-9996306e3876 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:13.515268 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cb577507-695c-4c60-b9f9-9996306e3876 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:13.515268 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cb577507-695c-4c60-b9f9-9996306e3876 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:13.598539 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cb577507-695c-4c60-b9f9-9996306e3876 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:13.606227 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cb577507-695c-4c60-b9f9-9996306e3876 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a" status: 200 len: 1464 microversion: 2.1 time: 0.108704 Jun 10 18:09:13.606784 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1708/3504] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:13 2022] GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a => generated 1464 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:13.617464 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9ed0afe7-c14f-4fab-840a-a4b3b098805b tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:13.618259 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9ed0afe7-c14f-4fab-840a-a4b3b098805b tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:13.626323 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9ed0afe7-c14f-4fab-840a-a4b3b098805b tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:13.626779 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9ed0afe7-c14f-4fab-840a-a4b3b098805b tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:13.627552 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9ed0afe7-c14f-4fab-840a-a4b3b098805b tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:13.627996 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9ed0afe7-c14f-4fab-840a-a4b3b098805b tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:13.696334 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9ed0afe7-c14f-4fab-840a-a4b3b098805b tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:13.704768 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9ed0afe7-c14f-4fab-840a-a4b3b098805b tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:13.706604 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9ed0afe7-c14f-4fab-840a-a4b3b098805b tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:13.707808 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9ed0afe7-c14f-4fab-840a-a4b3b098805b tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6" status: 200 len: 1407 microversion: 2.54 time: 0.094937 Jun 10 18:09:13.708377 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1797/3505] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:09:13 2022] GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 => generated 1407 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:09:13.785242 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b17c6eda-8002-47fb-be57-55ab71d87b19 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:13.785962 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b17c6eda-8002-47fb-be57-55ab71d87b19 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: ea345031-5220-43d0-9971-ada561720697] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:13.793422 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b17c6eda-8002-47fb-be57-55ab71d87b19 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:13.793929 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b17c6eda-8002-47fb-be57-55ab71d87b19 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:13.794784 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b17c6eda-8002-47fb-be57-55ab71d87b19 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:13.795237 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b17c6eda-8002-47fb-be57-55ab71d87b19 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:13.809881 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-b17c6eda-8002-47fb-be57-55ab71d87b19 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] HTTP exception thrown: Instance ea345031-5220-43d0-9971-ada561720697 could not be found. Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b17c6eda-8002-47fb-be57-55ab71d87b19 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Request method failure captured: Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697 HTTP/1.1 Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4h5IGwn2s1svunn67FxK1RLA1ZXNP7yhKtLh1eaKFO5RiF1I7YeJHWcfSjdUGMBWYC3nFgfMdv1-bfem3ewEozYf-uHKxgVE7ziplyuJN8iPaP89LX8AXS1cyKZcnxByDcQMqTPs4bimJxM1lNaVEmx4VPDZsfMeZBdbBH4r5hYsr8 Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/457c4a300936498b9e8b61645e655751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "tempest-type-1142384015", "name": "tempest-service-1838487701", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_457c4a300936498b9e8b61645e655751", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 8166793f60ee479689b4a21457b71d07 Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: exception: Instance ea345031-5220-43d0-9971-ada561720697 could not be found. Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'ea345031-5220-43d0-9971-ada561720697'} Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea345031-5220-43d0-9971-ada561720697 could not be found. Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea345031-5220-43d0-9971-ada561720697 could not be found. Jun 10 18:09:13.811604 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:13.816323 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:13.816323 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:13.816323 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:13.816323 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:13.816323 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:13.816323 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:09:13.816323 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:09:13.816323 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea345031-5220-43d0-9971-ada561720697 could not be found. Jun 10 18:09:13.816323 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:13.816323 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b17c6eda-8002-47fb-be57-55ab71d87b19 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Returning 404 to user: Instance ea345031-5220-43d0-9971-ada561720697 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:09:13.816323 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b17c6eda-8002-47fb-be57-55ab71d87b19 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697" status: 404 len: 111 microversion: 2.1 time: 0.031848 Jun 10 18:09:13.816323 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1709/3506] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:13 2022] GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:09:13.897626 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-691cb37d-8827-44c2-b1f6-49108b63a755 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:13.898249 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-691cb37d-8827-44c2-b1f6-49108b63a755 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: cd20ed09-0a67-4b14-881f-2977acd23396] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:13.905950 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-691cb37d-8827-44c2-b1f6-49108b63a755 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:13.906503 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-691cb37d-8827-44c2-b1f6-49108b63a755 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:13.907284 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-691cb37d-8827-44c2-b1f6-49108b63a755 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:13.907734 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-691cb37d-8827-44c2-b1f6-49108b63a755 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:13.918375 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-34bd7314-3069-446e-81ce-4ba56bb653ad tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:13.919396 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-34bd7314-3069-446e-81ce-4ba56bb653ad tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: ea345031-5220-43d0-9971-ada561720697] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:13.926163 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-34bd7314-3069-446e-81ce-4ba56bb653ad tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:13.926617 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-34bd7314-3069-446e-81ce-4ba56bb653ad tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:13.927553 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-34bd7314-3069-446e-81ce-4ba56bb653ad tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:13.928181 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-34bd7314-3069-446e-81ce-4ba56bb653ad tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:13.941462 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-34bd7314-3069-446e-81ce-4ba56bb653ad tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] HTTP exception thrown: Instance ea345031-5220-43d0-9971-ada561720697 could not be found. Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-34bd7314-3069-446e-81ce-4ba56bb653ad tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Request method failure captured: Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697/os-volume_attachments HTTP/1.1 Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4h5IGwn2s1svunn67FxK1RLA1ZXNP7yhKtLh1eaKFO5RiF1I7YeJHWcfSjdUGMBWYC3nFgfMdv1-bfem3ewEozYf-uHKxgVE7ziplyuJN8iPaP89LX8AXS1cyKZcnxByDcQMqTPs4bimJxM1lNaVEmx4VPDZsfMeZBdbBH4r5hYsr8 Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/457c4a300936498b9e8b61645e655751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "tempest-type-1142384015", "name": "tempest-service-1838487701", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_457c4a300936498b9e8b61645e655751", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 8166793f60ee479689b4a21457b71d07 Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: exception: Instance ea345031-5220-43d0-9971-ada561720697 could not be found. Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: action_args: {'server_id': 'ea345031-5220-43d0-9971-ada561720697'} Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea345031-5220-43d0-9971-ada561720697 could not be found. Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:09:13.943415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:09:13.947877 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea345031-5220-43d0-9971-ada561720697 could not be found. Jun 10 18:09:13.947877 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:13.947877 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:13.947877 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:13.947877 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:13.947877 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:13.947877 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:13.947877 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:09:13.947877 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:09:13.947877 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea345031-5220-43d0-9971-ada561720697 could not be found. Jun 10 18:09:13.947877 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:13.947877 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-34bd7314-3069-446e-81ce-4ba56bb653ad tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Returning 404 to user: Instance ea345031-5220-43d0-9971-ada561720697 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:09:13.947877 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-34bd7314-3069-446e-81ce-4ba56bb653ad tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.030671 Jun 10 18:09:13.947877 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1710/3507] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:09:13 2022] GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:09:13.976819 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-691cb37d-8827-44c2-b1f6-49108b63a755 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:13.985952 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-691cb37d-8827-44c2-b1f6-49108b63a755 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396" status: 200 len: 1212 microversion: 2.1 time: 0.092470 Jun 10 18:09:13.986973 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1798/3508] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:13 2022] GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396 => generated 1212 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:09:14.098596 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-74151c43-85db-4221-9b80-08071ac1524d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-762280550", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "01d41899-bf8f-45ad-9aa1-db371d9cd1c4"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:14.152325 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-74151c43-85db-4221-9b80-08071ac1524d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] validate_networks() for [('01d41899-bf8f-45ad-9aa1-db371d9cd1c4', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:09:14.504381 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-74151c43-85db-4221-9b80-08071ac1524d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:09:14.504960 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-74151c43-85db-4221-9b80-08071ac1524d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:09:14.505277 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-74151c43-85db-4221-9b80-08071ac1524d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:09:14.505689 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-74151c43-85db-4221-9b80-08071ac1524d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:09:14.506104 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-74151c43-85db-4221-9b80-08071ac1524d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:09:14.516508 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-74151c43-85db-4221-9b80-08071ac1524d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:14.516966 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-74151c43-85db-4221-9b80-08071ac1524d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:14.517783 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-74151c43-85db-4221-9b80-08071ac1524d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:14.518226 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-74151c43-85db-4221-9b80-08071ac1524d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:14.535710 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-74151c43-85db-4221-9b80-08071ac1524d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Getting quotas for project 457c4a300936498b9e8b61645e655751. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:09:14.541024 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-74151c43-85db-4221-9b80-08071ac1524d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Getting quotas for user 8166793f60ee479689b4a21457b71d07 and project 457c4a300936498b9e8b61645e655751. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:09:14.554390 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-74151c43-85db-4221-9b80-08071ac1524d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:09:14.556706 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-74151c43-85db-4221-9b80-08071ac1524d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: f8f45b46-fa33-45f4-8361-a67a3734b084] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:09:14.624689 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a91fc9e1-c2a7-4aff-ae6a-05d0aed9aa4e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:14.625424 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a91fc9e1-c2a7-4aff-ae6a-05d0aed9aa4e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 5cb5b4a5-d399-4f64-8f6a-8815d86e921a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:14.632974 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a91fc9e1-c2a7-4aff-ae6a-05d0aed9aa4e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:14.633436 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a91fc9e1-c2a7-4aff-ae6a-05d0aed9aa4e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:14.634205 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a91fc9e1-c2a7-4aff-ae6a-05d0aed9aa4e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:14.634649 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a91fc9e1-c2a7-4aff-ae6a-05d0aed9aa4e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:14.699191 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-74151c43-85db-4221-9b80-08071ac1524d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.604302 Jun 10 18:09:14.700337 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1711/3509] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:09:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:09:14.711195 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e6bde60b-cb60-427e-9036-c989c9ec58b4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:14.712083 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e6bde60b-cb60-427e-9036-c989c9ec58b4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: f8f45b46-fa33-45f4-8361-a67a3734b084] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:14.791326 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e6bde60b-cb60-427e-9036-c989c9ec58b4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:14.798708 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e6bde60b-cb60-427e-9036-c989c9ec58b4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/f8f45b46-fa33-45f4-8361-a67a3734b084" status: 200 len: 1214 microversion: 2.1 time: 0.091192 Jun 10 18:09:14.806561 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a91fc9e1-c2a7-4aff-ae6a-05d0aed9aa4e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:14.810209 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1712/3510] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:14 2022] GET /compute/v2.1/servers/f8f45b46-fa33-45f4-8361-a67a3734b084 => generated 1214 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:09:14.818564 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-62fbbe2e-a8b3-42a7-9ec3-9f14113e3227 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:14.818564 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-62fbbe2e-a8b3-42a7-9ec3-9f14113e3227 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:14.820116 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a91fc9e1-c2a7-4aff-ae6a-05d0aed9aa4e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a" status: 200 len: 1464 microversion: 2.1 time: 0.199473 Jun 10 18:09:14.821516 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1799/3511] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:14 2022] GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a => generated 1464 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:09:14.828617 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-62fbbe2e-a8b3-42a7-9ec3-9f14113e3227 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:14.829282 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-62fbbe2e-a8b3-42a7-9ec3-9f14113e3227 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:14.830450 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-62fbbe2e-a8b3-42a7-9ec3-9f14113e3227 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:14.831145 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-62fbbe2e-a8b3-42a7-9ec3-9f14113e3227 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:14.837281 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8af71828-6104-42ce-b028-23042740af28 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:14.838147 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8af71828-6104-42ce-b028-23042740af28 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: f8f45b46-fa33-45f4-8361-a67a3734b084] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:14.858804 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8af71828-6104-42ce-b028-23042740af28 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: f8f45b46-fa33-45f4-8361-a67a3734b084] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:09:14.931242 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-62fbbe2e-a8b3-42a7-9ec3-9f14113e3227 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:14.940042 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-62fbbe2e-a8b3-42a7-9ec3-9f14113e3227 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:14.941581 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-62fbbe2e-a8b3-42a7-9ec3-9f14113e3227 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:14.942764 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-62fbbe2e-a8b3-42a7-9ec3-9f14113e3227 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6" status: 200 len: 1407 microversion: 2.54 time: 0.131310 Jun 10 18:09:14.943494 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1713/3512] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:09:14 2022] GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 => generated 1407 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:09:15.005977 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-08763d1e-292b-4f75-a436-f04fc680be9a tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:15.007691 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-08763d1e-292b-4f75-a436-f04fc680be9a tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: cd20ed09-0a67-4b14-881f-2977acd23396] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:15.016134 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-08763d1e-292b-4f75-a436-f04fc680be9a tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:15.016628 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-08763d1e-292b-4f75-a436-f04fc680be9a tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:15.017443 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-08763d1e-292b-4f75-a436-f04fc680be9a tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:15.017890 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-08763d1e-292b-4f75-a436-f04fc680be9a tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:15.092788 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-08763d1e-292b-4f75-a436-f04fc680be9a tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:15.100733 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-08763d1e-292b-4f75-a436-f04fc680be9a tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396" status: 200 len: 1204 microversion: 2.1 time: 0.101462 Jun 10 18:09:15.101313 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1714/3513] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:14 2022] GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396 => generated 1204 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:09:15.176862 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8af71828-6104-42ce-b028-23042740af28 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "DELETE /compute/v2.1/servers/f8f45b46-fa33-45f4-8361-a67a3734b084" status: 204 len: 0 microversion: 2.1 time: 0.351176 Jun 10 18:09:15.177775 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1800/3514] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:09:14 2022] DELETE /compute/v2.1/servers/f8f45b46-fa33-45f4-8361-a67a3734b084 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:09:15.190015 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-56fcfb9c-8dae-4560-94e0-eaf6329d5692 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:15.191718 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-56fcfb9c-8dae-4560-94e0-eaf6329d5692 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: f8f45b46-fa33-45f4-8361-a67a3734b084] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:15.245427 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-56fcfb9c-8dae-4560-94e0-eaf6329d5692 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] HTTP exception thrown: Instance f8f45b46-fa33-45f4-8361-a67a3734b084 could not be found. Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-56fcfb9c-8dae-4560-94e0-eaf6329d5692 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Request method failure captured: Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/f8f45b46-fa33-45f4-8361-a67a3734b084 HTTP/1.1 Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4h5IGwn2s1svunn67FxK1RLA1ZXNP7yhKtLh1eaKFO5RiF1I7YeJHWcfSjdUGMBWYC3nFgfMdv1-bfem3ewEozYf-uHKxgVE7ziplyuJN8iPaP89LX8AXS1cyKZcnxByDcQMqTPs4bimJxM1lNaVEmx4VPDZsfMeZBdbBH4r5hYsr8 Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/457c4a300936498b9e8b61645e655751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "tempest-type-1142384015", "name": "tempest-service-1838487701", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_457c4a300936498b9e8b61645e655751", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 8166793f60ee479689b4a21457b71d07 Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: exception: Instance f8f45b46-fa33-45f4-8361-a67a3734b084 could not be found. Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'f8f45b46-fa33-45f4-8361-a67a3734b084'} Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2877, in _get_instance Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance f8f45b46-fa33-45f4-8361-a67a3734b084 Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2889, in _get_instance Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8f45b46-fa33-45f4-8361-a67a3734b084 could not be found. Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:15.260160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:15.264414 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:15.264414 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:09:15.264414 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:09:15.264414 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:09:15.264414 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:09:15.264414 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:09:15.264414 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:09:15.264414 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:09:15.264414 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:09:15.264414 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:09:15.264414 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:09:15.264414 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8f45b46-fa33-45f4-8361-a67a3734b084 could not be found. Jun 10 18:09:15.264414 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:15.264414 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:15.264414 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:15.264414 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:15.264414 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:15.264414 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:15.264414 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:09:15.264414 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:09:15.264414 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8f45b46-fa33-45f4-8361-a67a3734b084 could not be found. Jun 10 18:09:15.264414 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:15.265920 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-56fcfb9c-8dae-4560-94e0-eaf6329d5692 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Returning 404 to user: Instance f8f45b46-fa33-45f4-8361-a67a3734b084 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:09:15.266681 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-56fcfb9c-8dae-4560-94e0-eaf6329d5692 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/f8f45b46-fa33-45f4-8361-a67a3734b084" status: 404 len: 111 microversion: 2.1 time: 0.084248 Jun 10 18:09:15.267438 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1715/3515] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:15 2022] GET /compute/v2.1/servers/f8f45b46-fa33-45f4-8361-a67a3734b084 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:09:15.371893 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f434a7e1-a8d6-4b8c-98e5-b9568d94b8e5 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1956270889", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "01d41899-bf8f-45ad-9aa1-db371d9cd1c4"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:15.462379 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-f434a7e1-a8d6-4b8c-98e5-b9568d94b8e5 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] validate_networks() for [('01d41899-bf8f-45ad-9aa1-db371d9cd1c4', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:09:15.579715 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-e256315d-0dd6-4afb-b149-d0bb64cb9b56 req-fd0699a9-e7e6-4d96-a278-91bac113f781 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "289cf5c3-10c7-4a83-94d9-d83623d0c5e7", "name": "network-vif-deleted", "tag": "4e1596e3-56a7-4159-afe3-a1bd5b198fc7"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:15.593451 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-e256315d-0dd6-4afb-b149-d0bb64cb9b56 req-fd0699a9-e7e6-4d96-a278-91bac113f781 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:15.594025 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-e256315d-0dd6-4afb-b149-d0bb64cb9b56 req-fd0699a9-e7e6-4d96-a278-91bac113f781 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:15.608964 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-e256315d-0dd6-4afb-b149-d0bb64cb9b56 req-fd0699a9-e7e6-4d96-a278-91bac113f781 service nova] Creating event network-vif-deleted:4e1596e3-56a7-4159-afe3-a1bd5b198fc7 for instance 289cf5c3-10c7-4a83-94d9-d83623d0c5e7 on chh2-master-2 Jun 10 18:09:15.622087 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-e256315d-0dd6-4afb-b149-d0bb64cb9b56 req-fd0699a9-e7e6-4d96-a278-91bac113f781 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041583 Jun 10 18:09:15.623254 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1716/3516] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:09:15.840928 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-45c5c17e-77c5-448c-9800-8d566247bf54 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:15.841669 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-45c5c17e-77c5-448c-9800-8d566247bf54 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 5cb5b4a5-d399-4f64-8f6a-8815d86e921a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:15.849750 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45c5c17e-77c5-448c-9800-8d566247bf54 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:15.850201 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45c5c17e-77c5-448c-9800-8d566247bf54 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:15.851289 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45c5c17e-77c5-448c-9800-8d566247bf54 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:15.851780 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45c5c17e-77c5-448c-9800-8d566247bf54 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:15.986672 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-f434a7e1-a8d6-4b8c-98e5-b9568d94b8e5 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:09:15.987235 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-f434a7e1-a8d6-4b8c-98e5-b9568d94b8e5 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:09:15.987760 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-f434a7e1-a8d6-4b8c-98e5-b9568d94b8e5 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:09:15.988434 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-f434a7e1-a8d6-4b8c-98e5-b9568d94b8e5 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:09:15.989089 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-f434a7e1-a8d6-4b8c-98e5-b9568d94b8e5 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:09:15.998379 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-45c5c17e-77c5-448c-9800-8d566247bf54 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:16.002375 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f434a7e1-a8d6-4b8c-98e5-b9568d94b8e5 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:16.003967 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f434a7e1-a8d6-4b8c-98e5-b9568d94b8e5 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:16.005332 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f434a7e1-a8d6-4b8c-98e5-b9568d94b8e5 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:16.005955 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f434a7e1-a8d6-4b8c-98e5-b9568d94b8e5 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:16.012630 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-45c5c17e-77c5-448c-9800-8d566247bf54 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a" status: 200 len: 1464 microversion: 2.1 time: 0.176077 Jun 10 18:09:16.013714 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1717/3517] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:15 2022] GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a => generated 1464 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:09:16.025308 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4f492db2-5cd9-438b-a601-1474940763e1 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:16.026155 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4f492db2-5cd9-438b-a601-1474940763e1 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:16.032687 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-f434a7e1-a8d6-4b8c-98e5-b9568d94b8e5 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Getting quotas for project 457c4a300936498b9e8b61645e655751. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:09:16.033587 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f492db2-5cd9-438b-a601-1474940763e1 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:16.034032 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f492db2-5cd9-438b-a601-1474940763e1 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:16.035324 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f492db2-5cd9-438b-a601-1474940763e1 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:16.035942 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f492db2-5cd9-438b-a601-1474940763e1 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:16.039222 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-f434a7e1-a8d6-4b8c-98e5-b9568d94b8e5 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Getting quotas for user 8166793f60ee479689b4a21457b71d07 and project 457c4a300936498b9e8b61645e655751. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:09:16.051547 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=5,nova_api:DELETE=4 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:09:16.059142 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f434a7e1-a8d6-4b8c-98e5-b9568d94b8e5 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:09:16.062420 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f434a7e1-a8d6-4b8c-98e5-b9568d94b8e5 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: db7ba61a-bb40-4246-91fb-426ccc9da491] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:09:16.143150 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4f492db2-5cd9-438b-a601-1474940763e1 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:16.155136 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4f492db2-5cd9-438b-a601-1474940763e1 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:16.157456 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4f492db2-5cd9-438b-a601-1474940763e1 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:16.159792 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4f492db2-5cd9-438b-a601-1474940763e1 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6" status: 200 len: 1407 microversion: 2.54 time: 0.144234 Jun 10 18:09:16.163020 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1718/3518] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:09:16 2022] GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 => generated 1407 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:09:16.179027 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f06ae8d6-717f-4f38-b073-c78558085516 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:16.179918 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f06ae8d6-717f-4f38-b073-c78558085516 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: cd20ed09-0a67-4b14-881f-2977acd23396] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:16.201131 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f06ae8d6-717f-4f38-b073-c78558085516 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:16.202709 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f06ae8d6-717f-4f38-b073-c78558085516 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:16.203639 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f06ae8d6-717f-4f38-b073-c78558085516 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:16.204093 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f06ae8d6-717f-4f38-b073-c78558085516 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:16.279746 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f06ae8d6-717f-4f38-b073-c78558085516 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:16.288393 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f06ae8d6-717f-4f38-b073-c78558085516 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396" status: 200 len: 1268 microversion: 2.1 time: 0.124052 Jun 10 18:09:16.298117 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1719/3519] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:16 2022] GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396 => generated 1268 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:16.312066 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-26320823-ea7d-45b0-b89f-ace6dd01da32 req-29ce7166-dde2-4851-a2e9-20f2f3741bd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cb5b4a5-d399-4f64-8f6a-8815d86e921a", "name": "network-vif-deleted", "tag": "01aa0dae-0896-47f3-b43f-12eb45f1ec84"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:16.322893 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-26320823-ea7d-45b0-b89f-ace6dd01da32 req-29ce7166-dde2-4851-a2e9-20f2f3741bd0 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:16.324105 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-26320823-ea7d-45b0-b89f-ace6dd01da32 req-29ce7166-dde2-4851-a2e9-20f2f3741bd0 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:16.340831 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-26320823-ea7d-45b0-b89f-ace6dd01da32 req-29ce7166-dde2-4851-a2e9-20f2f3741bd0 service nova] Creating event network-vif-deleted:01aa0dae-0896-47f3-b43f-12eb45f1ec84 for instance 5cb5b4a5-d399-4f64-8f6a-8815d86e921a on chh2-master-2 Jun 10 18:09:16.346285 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-26320823-ea7d-45b0-b89f-ace6dd01da32 req-29ce7166-dde2-4851-a2e9-20f2f3741bd0 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052537 Jun 10 18:09:16.348503 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1720/3520] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:09:16.349498 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f434a7e1-a8d6-4b8c-98e5-b9568d94b8e5 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.979131 Jun 10 18:09:16.362999 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1801/3521] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:09:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:09:16.384873 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2135e00f-20e8-45f5-bdb1-5a51a9f0727d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:16.388575 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2135e00f-20e8-45f5-bdb1-5a51a9f0727d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: db7ba61a-bb40-4246-91fb-426ccc9da491] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:16.469502 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2135e00f-20e8-45f5-bdb1-5a51a9f0727d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:16.477670 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2135e00f-20e8-45f5-bdb1-5a51a9f0727d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491" status: 200 len: 1215 microversion: 2.1 time: 0.104860 Jun 10 18:09:16.478571 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1721/3522] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:16 2022] GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491 => generated 1215 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:17.031729 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bcda983e-3339-4724-a4c9-244e64c509fb tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:17.038449 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bcda983e-3339-4724-a4c9-244e64c509fb tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 5cb5b4a5-d399-4f64-8f6a-8815d86e921a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:17.042458 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bcda983e-3339-4724-a4c9-244e64c509fb tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:17.043207 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bcda983e-3339-4724-a4c9-244e64c509fb tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:17.044115 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bcda983e-3339-4724-a4c9-244e64c509fb tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:17.044671 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bcda983e-3339-4724-a4c9-244e64c509fb tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:17.080622 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bcda983e-3339-4724-a4c9-244e64c509fb tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:17.081386 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bcda983e-3339-4724-a4c9-244e64c509fb tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:17.082185 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-bcda983e-3339-4724-a4c9-244e64c509fb tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lazy-loading 'fault' on Instance uuid 5cb5b4a5-d399-4f64-8f6a-8815d86e921a {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:09:17.143152 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bcda983e-3339-4724-a4c9-244e64c509fb tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:17.151509 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bcda983e-3339-4724-a4c9-244e64c509fb tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a" status: 200 len: 1304 microversion: 2.1 time: 0.124514 Jun 10 18:09:17.152838 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1802/3523] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:17 2022] GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a => generated 1304 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:17.184499 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-17323967-12c1-4144-b390-f565e6d3606e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:17.185352 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-17323967-12c1-4144-b390-f565e6d3606e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:17.196254 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-17323967-12c1-4144-b390-f565e6d3606e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:17.197224 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-17323967-12c1-4144-b390-f565e6d3606e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:17.198285 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-17323967-12c1-4144-b390-f565e6d3606e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:17.198890 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-17323967-12c1-4144-b390-f565e6d3606e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:17.307272 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-61de8d32-e624-4e63-bb69-0a21600aa76d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:17.307888 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-61de8d32-e624-4e63-bb69-0a21600aa76d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: cd20ed09-0a67-4b14-881f-2977acd23396] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:17.314390 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-61de8d32-e624-4e63-bb69-0a21600aa76d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:17.314853 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-61de8d32-e624-4e63-bb69-0a21600aa76d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:17.315673 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-61de8d32-e624-4e63-bb69-0a21600aa76d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:17.316099 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-61de8d32-e624-4e63-bb69-0a21600aa76d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:17.322091 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-17323967-12c1-4144-b390-f565e6d3606e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:17.340142 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-17323967-12c1-4144-b390-f565e6d3606e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:17.342232 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-17323967-12c1-4144-b390-f565e6d3606e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:17.344958 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-17323967-12c1-4144-b390-f565e6d3606e tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6" status: 200 len: 1407 microversion: 2.54 time: 0.165564 Jun 10 18:09:17.353685 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1722/3524] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:09:17 2022] GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:09:17.498669 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-55c7bf48-ca28-4ccd-b6e1-b3ad9a161be2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:17.499549 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-55c7bf48-ca28-4ccd-b6e1-b3ad9a161be2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: db7ba61a-bb40-4246-91fb-426ccc9da491] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:17.507913 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-55c7bf48-ca28-4ccd-b6e1-b3ad9a161be2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:17.508627 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-55c7bf48-ca28-4ccd-b6e1-b3ad9a161be2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:17.509495 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-55c7bf48-ca28-4ccd-b6e1-b3ad9a161be2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:17.509949 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-55c7bf48-ca28-4ccd-b6e1-b3ad9a161be2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:17.611619 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-55c7bf48-ca28-4ccd-b6e1-b3ad9a161be2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:17.634725 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-55c7bf48-ca28-4ccd-b6e1-b3ad9a161be2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491" status: 200 len: 1219 microversion: 2.1 time: 0.139220 Jun 10 18:09:17.635606 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1723/3525] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:17 2022] GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491 => generated 1219 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:09:17.943979 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-61de8d32-e624-4e63-bb69-0a21600aa76d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:17.951621 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-61de8d32-e624-4e63-bb69-0a21600aa76d tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396" status: 200 len: 1308 microversion: 2.1 time: 0.648437 Jun 10 18:09:17.952200 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1803/3526] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:17 2022] GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396 => generated 1308 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:09:18.177250 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a0c058dd-122f-4b74-96a9-6b701bd28c93 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:18.178203 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a0c058dd-122f-4b74-96a9-6b701bd28c93 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 5cb5b4a5-d399-4f64-8f6a-8815d86e921a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:18.190108 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a0c058dd-122f-4b74-96a9-6b701bd28c93 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:18.191307 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a0c058dd-122f-4b74-96a9-6b701bd28c93 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:18.192509 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a0c058dd-122f-4b74-96a9-6b701bd28c93 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:18.193166 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a0c058dd-122f-4b74-96a9-6b701bd28c93 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:18.209724 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-a0c058dd-122f-4b74-96a9-6b701bd28c93 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] HTTP exception thrown: Instance 5cb5b4a5-d399-4f64-8f6a-8815d86e921a could not be found. Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a0c058dd-122f-4b74-96a9-6b701bd28c93 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Request method failure captured: Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a HTTP/1.1 Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4bjYRjdJJInCzu3PVxYJsfBkminC6Ikt7M75i6Sx-ogiu0g-ClcDk6pe5ZbprSFn2IZnkupAGWwRhhyzLuF9eMcuLH1bKi15cgeBj7qi81gCxtLZj7Eo_sXXfXIhz0vAnCNJVtg10TQ8DAW2pxp6y_-W-5vyky7ezDgXd3Gl7vJQCo Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 2b34cb51c168497088d66fa0e507e364 Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServerActionsTestJSON-197909573 Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/2b34cb51c168497088d66fa0e507e364"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2b34cb51c168497088d66fa0e507e364"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2b34cb51c168497088d66fa0e507e364"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_2b34cb51c168497088d66fa0e507e364", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServerActionsTestJSON-197909573 Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 2b34cb51c168497088d66fa0e507e364 Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServerActionsTestJSON-197909573 Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServerActionsTestJSON-197909573-project Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 352e7f5de76c42da9241721fe0f0bf86 Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServerActionsTestJSON-197909573-project Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 5cb5b4a5-d399-4f64-8f6a-8815d86e921a could not be found. Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '5cb5b4a5-d399-4f64-8f6a-8815d86e921a'} Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cb5b4a5-d399-4f64-8f6a-8815d86e921a could not be found. Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cb5b4a5-d399-4f64-8f6a-8815d86e921a could not be found. Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:18.211415 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:18.216176 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:18.216176 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:18.216176 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:18.216176 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:09:18.216176 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:09:18.216176 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cb5b4a5-d399-4f64-8f6a-8815d86e921a could not be found. Jun 10 18:09:18.216176 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:18.216176 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a0c058dd-122f-4b74-96a9-6b701bd28c93 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Returning 404 to user: Instance 5cb5b4a5-d399-4f64-8f6a-8815d86e921a could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:09:18.216176 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a0c058dd-122f-4b74-96a9-6b701bd28c93 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a" status: 404 len: 111 microversion: 2.1 time: 0.043136 Jun 10 18:09:18.216176 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1724/3527] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:18 2022] GET /compute/v2.1/servers/5cb5b4a5-d399-4f64-8f6a-8815d86e921a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:09:18.221886 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-75e8034b-89ad-4fe5-922c-8bce3d246e5a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:18.222398 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-75e8034b-89ad-4fe5-922c-8bce3d246e5a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 49b47316-e3b5-4ecd-962d-003a6cd0def3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:18.231794 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-75e8034b-89ad-4fe5-922c-8bce3d246e5a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:18.232490 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-75e8034b-89ad-4fe5-922c-8bce3d246e5a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:18.233848 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-75e8034b-89ad-4fe5-922c-8bce3d246e5a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:18.240028 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-75e8034b-89ad-4fe5-922c-8bce3d246e5a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:18.265268 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-75e8034b-89ad-4fe5-922c-8bce3d246e5a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 49b47316-e3b5-4ecd-962d-003a6cd0def3] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:09:18.365711 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4566fe0c-345b-46fc-9d27-72ce53f9a60b tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:18.366738 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4566fe0c-345b-46fc-9d27-72ce53f9a60b tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:18.373894 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4566fe0c-345b-46fc-9d27-72ce53f9a60b tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:18.374706 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4566fe0c-345b-46fc-9d27-72ce53f9a60b tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:18.375879 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4566fe0c-345b-46fc-9d27-72ce53f9a60b tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:18.376562 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4566fe0c-345b-46fc-9d27-72ce53f9a60b tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:18.470406 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4566fe0c-345b-46fc-9d27-72ce53f9a60b tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:18.479942 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4566fe0c-345b-46fc-9d27-72ce53f9a60b tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:18.481745 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4566fe0c-345b-46fc-9d27-72ce53f9a60b tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:18.483697 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4566fe0c-345b-46fc-9d27-72ce53f9a60b tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6" status: 200 len: 1413 microversion: 2.54 time: 0.122402 Jun 10 18:09:18.496483 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1725/3528] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:09:18 2022] GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 => generated 1413 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:09:18.652346 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-75e8034b-89ad-4fe5-922c-8bce3d246e5a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "DELETE /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3" status: 204 len: 0 microversion: 2.1 time: 0.433897 Jun 10 18:09:18.653686 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-79ef28c9-0f7e-4c92-a61f-d00d7cab1953 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:18.653797 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1804/3529] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:09:18 2022] DELETE /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:09:18.653877 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-79ef28c9-0f7e-4c92-a61f-d00d7cab1953 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: db7ba61a-bb40-4246-91fb-426ccc9da491] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:18.657643 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:09:18.661228 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-79ef28c9-0f7e-4c92-a61f-d00d7cab1953 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:18.661905 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-79ef28c9-0f7e-4c92-a61f-d00d7cab1953 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:18.662853 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-79ef28c9-0f7e-4c92-a61f-d00d7cab1953 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:18.663459 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-79ef28c9-0f7e-4c92-a61f-d00d7cab1953 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:18.664095 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-efcef34b-ad13-4114-a2af-50620c80db6c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:18.665507 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-efcef34b-ad13-4114-a2af-50620c80db6c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 49b47316-e3b5-4ecd-962d-003a6cd0def3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:18.678158 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-efcef34b-ad13-4114-a2af-50620c80db6c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:18.678691 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-efcef34b-ad13-4114-a2af-50620c80db6c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:18.679486 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-efcef34b-ad13-4114-a2af-50620c80db6c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:18.679939 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-efcef34b-ad13-4114-a2af-50620c80db6c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:18.766105 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-79ef28c9-0f7e-4c92-a61f-d00d7cab1953 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:18.774379 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-79ef28c9-0f7e-4c92-a61f-d00d7cab1953 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491" status: 200 len: 1219 microversion: 2.1 time: 0.124860 Jun 10 18:09:18.775804 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1726/3530] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:18 2022] GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491 => generated 1219 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:09:18.971618 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c79fa861-ae93-4448-ab9a-b7d2b51e56a5 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:18.976388 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-efcef34b-ad13-4114-a2af-50620c80db6c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:18.982471 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c79fa861-ae93-4448-ab9a-b7d2b51e56a5 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: cd20ed09-0a67-4b14-881f-2977acd23396] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:18.991286 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-efcef34b-ad13-4114-a2af-50620c80db6c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3" status: 200 len: 1506 microversion: 2.1 time: 0.332115 Jun 10 18:09:18.997120 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1805/3531] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:18 2022] GET /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3 => generated 1506 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:18.997374 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c79fa861-ae93-4448-ab9a-b7d2b51e56a5 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:18.997966 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c79fa861-ae93-4448-ab9a-b7d2b51e56a5 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:18.999203 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c79fa861-ae93-4448-ab9a-b7d2b51e56a5 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:19.000490 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c79fa861-ae93-4448-ab9a-b7d2b51e56a5 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:19.152360 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c79fa861-ae93-4448-ab9a-b7d2b51e56a5 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:19.172632 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c79fa861-ae93-4448-ab9a-b7d2b51e56a5 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396" status: 200 len: 1308 microversion: 2.1 time: 0.205814 Jun 10 18:09:19.183923 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1727/3532] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:18 2022] GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396 => generated 1308 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:09:19.403129 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-5ba2795b-a9c8-4e27-bcae-6109deacf1e5 req-34807d56-a524-4539-bfd8-8a51c29dfef5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd20ed09-0a67-4b14-881f-2977acd23396", "tag": "01f956de-a6b2-4cd1-9d96-7f5e4524b19c"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:19.413448 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-5ba2795b-a9c8-4e27-bcae-6109deacf1e5 req-34807d56-a524-4539-bfd8-8a51c29dfef5 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:19.413899 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-5ba2795b-a9c8-4e27-bcae-6109deacf1e5 req-34807d56-a524-4539-bfd8-8a51c29dfef5 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:19.428870 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-5ba2795b-a9c8-4e27-bcae-6109deacf1e5 req-34807d56-a524-4539-bfd8-8a51c29dfef5 service nova] Creating event network-changed:01f956de-a6b2-4cd1-9d96-7f5e4524b19c for instance cd20ed09-0a67-4b14-881f-2977acd23396 on chh2-master-2 Jun 10 18:09:19.435402 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-5ba2795b-a9c8-4e27-bcae-6109deacf1e5 req-34807d56-a524-4539-bfd8-8a51c29dfef5 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038980 Jun 10 18:09:19.436056 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1806/3533] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:09:19.503696 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bbb16470-ec15-42ac-81d3-465040008ecf tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:19.504335 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bbb16470-ec15-42ac-81d3-465040008ecf tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:19.512814 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bbb16470-ec15-42ac-81d3-465040008ecf tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:19.513266 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bbb16470-ec15-42ac-81d3-465040008ecf tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:19.514040 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bbb16470-ec15-42ac-81d3-465040008ecf tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:19.514480 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bbb16470-ec15-42ac-81d3-465040008ecf tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:19.581627 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bbb16470-ec15-42ac-81d3-465040008ecf tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:19.589861 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bbb16470-ec15-42ac-81d3-465040008ecf tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:19.591372 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bbb16470-ec15-42ac-81d3-465040008ecf tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:19.592599 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bbb16470-ec15-42ac-81d3-465040008ecf tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6" status: 200 len: 1413 microversion: 2.54 time: 0.093801 Jun 10 18:09:19.593344 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1728/3534] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:09:19 2022] GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 => generated 1413 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:09:19.792694 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-be4d4a9e-4cb4-4466-844a-81ea8a7f958a tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:19.793412 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-be4d4a9e-4cb4-4466-844a-81ea8a7f958a tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: db7ba61a-bb40-4246-91fb-426ccc9da491] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:19.804535 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be4d4a9e-4cb4-4466-844a-81ea8a7f958a tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:19.804535 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be4d4a9e-4cb4-4466-844a-81ea8a7f958a tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:19.804535 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be4d4a9e-4cb4-4466-844a-81ea8a7f958a tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:19.804535 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be4d4a9e-4cb4-4466-844a-81ea8a7f958a tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:19.889561 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-be4d4a9e-4cb4-4466-844a-81ea8a7f958a tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:19.904148 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-be4d4a9e-4cb4-4466-844a-81ea8a7f958a tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491" status: 200 len: 1211 microversion: 2.1 time: 0.115600 Jun 10 18:09:19.916035 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1807/3535] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:19 2022] GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491 => generated 1211 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:20.014940 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-317f8c46-315f-43d0-ab6c-d0725a8e514e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:20.015572 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-317f8c46-315f-43d0-ab6c-d0725a8e514e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 49b47316-e3b5-4ecd-962d-003a6cd0def3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:20.024616 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-317f8c46-315f-43d0-ab6c-d0725a8e514e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:20.025449 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-317f8c46-315f-43d0-ab6c-d0725a8e514e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:20.030439 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-317f8c46-315f-43d0-ab6c-d0725a8e514e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:20.030941 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-317f8c46-315f-43d0-ab6c-d0725a8e514e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:20.086085 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:09:20.190818 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d28d60a2-6705-4b28-a086-24b8acb2e004 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:20.191801 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d28d60a2-6705-4b28-a086-24b8acb2e004 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: cd20ed09-0a67-4b14-881f-2977acd23396] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:20.202158 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d28d60a2-6705-4b28-a086-24b8acb2e004 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:20.205837 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d28d60a2-6705-4b28-a086-24b8acb2e004 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:20.206749 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d28d60a2-6705-4b28-a086-24b8acb2e004 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:20.207880 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d28d60a2-6705-4b28-a086-24b8acb2e004 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:20.240077 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-317f8c46-315f-43d0-ab6c-d0725a8e514e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:20.248969 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-317f8c46-315f-43d0-ab6c-d0725a8e514e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3" status: 200 len: 1506 microversion: 2.1 time: 0.237761 Jun 10 18:09:20.251283 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1729/3536] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:20 2022] GET /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3 => generated 1506 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:20.590624 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d28d60a2-6705-4b28-a086-24b8acb2e004 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:20.598633 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d28d60a2-6705-4b28-a086-24b8acb2e004 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396" status: 200 len: 1308 microversion: 2.1 time: 0.412124 Jun 10 18:09:20.608219 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1808/3537] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:20 2022] GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396 => generated 1308 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:09:20.619282 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4504ef13-3773-4c4b-ab8d-11b3dbccbcf9 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:20.622102 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4504ef13-3773-4c4b-ab8d-11b3dbccbcf9 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:20.635053 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4504ef13-3773-4c4b-ab8d-11b3dbccbcf9 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:20.636155 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4504ef13-3773-4c4b-ab8d-11b3dbccbcf9 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:20.637987 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4504ef13-3773-4c4b-ab8d-11b3dbccbcf9 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:20.640056 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4504ef13-3773-4c4b-ab8d-11b3dbccbcf9 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:20.735896 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4504ef13-3773-4c4b-ab8d-11b3dbccbcf9 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:20.745236 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4504ef13-3773-4c4b-ab8d-11b3dbccbcf9 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:20.746753 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4504ef13-3773-4c4b-ab8d-11b3dbccbcf9 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:20.747928 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4504ef13-3773-4c4b-ab8d-11b3dbccbcf9 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6" status: 200 len: 1413 microversion: 2.54 time: 0.140643 Jun 10 18:09:20.749040 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1730/3538] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:09:20 2022] GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 => generated 1413 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:09:20.924057 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-722cb955-d854-4fb4-a617-a431f206c3fa tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:20.924972 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-722cb955-d854-4fb4-a617-a431f206c3fa tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: db7ba61a-bb40-4246-91fb-426ccc9da491] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:20.931709 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-722cb955-d854-4fb4-a617-a431f206c3fa tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:20.933096 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-722cb955-d854-4fb4-a617-a431f206c3fa tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:20.933096 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-722cb955-d854-4fb4-a617-a431f206c3fa tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:20.934107 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-722cb955-d854-4fb4-a617-a431f206c3fa tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:21.196891 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-722cb955-d854-4fb4-a617-a431f206c3fa tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:21.207988 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-722cb955-d854-4fb4-a617-a431f206c3fa tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491" status: 200 len: 1267 microversion: 2.1 time: 0.288359 Jun 10 18:09:21.215740 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1809/3539] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:20 2022] GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491 => generated 1267 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:21.267849 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-41d1a308-cf16-4b15-8542-7030ad067bba tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:21.268756 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-41d1a308-cf16-4b15-8542-7030ad067bba tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 49b47316-e3b5-4ecd-962d-003a6cd0def3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:21.279091 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41d1a308-cf16-4b15-8542-7030ad067bba tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:21.280916 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41d1a308-cf16-4b15-8542-7030ad067bba tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:21.281944 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41d1a308-cf16-4b15-8542-7030ad067bba tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:21.282636 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41d1a308-cf16-4b15-8542-7030ad067bba tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:21.556894 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-41d1a308-cf16-4b15-8542-7030ad067bba tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:21.574069 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-41d1a308-cf16-4b15-8542-7030ad067bba tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3" status: 200 len: 1506 microversion: 2.1 time: 0.310279 Jun 10 18:09:21.596358 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1731/3540] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:21 2022] GET /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3 => generated 1506 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:21.615191 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5f42ae80-a746-46a5-80e2-c25e8a5cb9b7 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:21.615942 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5f42ae80-a746-46a5-80e2-c25e8a5cb9b7 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: cd20ed09-0a67-4b14-881f-2977acd23396] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:21.627720 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f42ae80-a746-46a5-80e2-c25e8a5cb9b7 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:21.628181 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f42ae80-a746-46a5-80e2-c25e8a5cb9b7 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:21.629000 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f42ae80-a746-46a5-80e2-c25e8a5cb9b7 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:21.631254 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f42ae80-a746-46a5-80e2-c25e8a5cb9b7 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:21.770940 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e61d38fc-4fea-463d-809a-f885c5fd0825 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:21.772603 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e61d38fc-4fea-463d-809a-f885c5fd0825 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:21.782096 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e61d38fc-4fea-463d-809a-f885c5fd0825 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:21.782556 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e61d38fc-4fea-463d-809a-f885c5fd0825 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:21.783532 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e61d38fc-4fea-463d-809a-f885c5fd0825 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:21.784025 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e61d38fc-4fea-463d-809a-f885c5fd0825 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:21.982449 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e61d38fc-4fea-463d-809a-f885c5fd0825 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:22.015329 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e61d38fc-4fea-463d-809a-f885c5fd0825 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:22.024037 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e61d38fc-4fea-463d-809a-f885c5fd0825 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:22.026736 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e61d38fc-4fea-463d-809a-f885c5fd0825 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6" status: 200 len: 1398 microversion: 2.54 time: 0.263381 Jun 10 18:09:22.031764 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1732/3541] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:09:21 2022] GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 => generated 1398 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:09:22.049424 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f881acb0-9887-430f-a9da-5809a9fcc75c tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '.version_select at 0x7f77c0419ee0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:22.203565 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f881acb0-9887-430f-a9da-5809a9fcc75c tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1271853710" status: 204 len: 0 microversion: 2.54 time: 0.157430 Jun 10 18:09:22.203565 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1733/3542] 10.222.0.35 () {60 vars in 1318 bytes} [Fri Jun 10 18:09:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1271853710 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 10 18:09:22.212213 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-3e1c1133-d275-493e-b441-b6fe1871be69 req-d7357b75-41f4-4962-b4c5-b430f6bb30d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49b47316-e3b5-4ecd-962d-003a6cd0def3", "name": "network-vif-deleted", "tag": "64263ed8-9f70-4dc5-9680-67d42e35c925"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:22.215299 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5f42ae80-a746-46a5-80e2-c25e8a5cb9b7 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:22.226155 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5f42ae80-a746-46a5-80e2-c25e8a5cb9b7 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396" status: 200 len: 1308 microversion: 2.1 time: 0.614752 Jun 10 18:09:22.241762 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1810/3543] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:21 2022] GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396 => generated 1308 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:22.241762 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-124b2125-08ac-42a3-abb6-79d464c9f5a0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:22.256036 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-124b2125-08ac-42a3-abb6-79d464c9f5a0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: db7ba61a-bb40-4246-91fb-426ccc9da491] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:22.260457 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-3e1c1133-d275-493e-b441-b6fe1871be69 req-d7357b75-41f4-4962-b4c5-b430f6bb30d3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:22.262250 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-3e1c1133-d275-493e-b441-b6fe1871be69 req-d7357b75-41f4-4962-b4c5-b430f6bb30d3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:22.281467 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-124b2125-08ac-42a3-abb6-79d464c9f5a0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:22.285135 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-124b2125-08ac-42a3-abb6-79d464c9f5a0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:22.287261 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-124b2125-08ac-42a3-abb6-79d464c9f5a0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:22.293780 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-124b2125-08ac-42a3-abb6-79d464c9f5a0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:22.305777 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-3e1c1133-d275-493e-b441-b6fe1871be69 req-d7357b75-41f4-4962-b4c5-b430f6bb30d3 service nova] Creating event network-vif-deleted:64263ed8-9f70-4dc5-9680-67d42e35c925 for instance 49b47316-e3b5-4ecd-962d-003a6cd0def3 on chh1-master-2 Jun 10 18:09:22.317843 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-3e1c1133-d275-493e-b441-b6fe1871be69 req-d7357b75-41f4-4962-b4c5-b430f6bb30d3 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109759 Jun 10 18:09:22.318878 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1734/3544] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:09:22.325356 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a8a64c2e-1022-4e9c-9da3-a6f5f0b158cd tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:22.326159 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a8a64c2e-1022-4e9c-9da3-a6f5f0b158cd tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:22.335745 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a8a64c2e-1022-4e9c-9da3-a6f5f0b158cd tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:22.336194 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a8a64c2e-1022-4e9c-9da3-a6f5f0b158cd tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:22.337211 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a8a64c2e-1022-4e9c-9da3-a6f5f0b158cd tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:22.337650 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a8a64c2e-1022-4e9c-9da3-a6f5f0b158cd tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:22.366108 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a8a64c2e-1022-4e9c-9da3-a6f5f0b158cd tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:09:22.415290 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-124b2125-08ac-42a3-abb6-79d464c9f5a0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:22.428713 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-124b2125-08ac-42a3-abb6-79d464c9f5a0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491" status: 200 len: 1285 microversion: 2.1 time: 0.200797 Jun 10 18:09:22.440672 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1811/3545] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:22 2022] GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491 => generated 1285 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:22.560176 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b44ebf96-2aef-48c9-b3e7-aba8213eadad tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:22.565678 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b44ebf96-2aef-48c9-b3e7-aba8213eadad tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '41f463dd5d9140ecb29e0daa415331a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c384e1bab854ad8b4c2ae9ab895cd88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:22.566833 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b44ebf96-2aef-48c9-b3e7-aba8213eadad tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Searching by: {'deleted': False, 'project_id': '3c384e1bab854ad8b4c2ae9ab895cd88'} {{(pid=126594) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 18:09:22.573978 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b44ebf96-2aef-48c9-b3e7-aba8213eadad tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:22.574560 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b44ebf96-2aef-48c9-b3e7-aba8213eadad tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:22.575497 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b44ebf96-2aef-48c9-b3e7-aba8213eadad tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:22.576180 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b44ebf96-2aef-48c9-b3e7-aba8213eadad tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:22.618037 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.multi_cell_list [None req-b44ebf96-2aef-48c9-b3e7-aba8213eadad tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126594) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 10 18:09:22.642498 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:09:22.668487 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b44ebf96-2aef-48c9-b3e7-aba8213eadad tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] 10.222.0.35 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.113431 Jun 10 18:09:22.673222 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1812/3546] 10.222.0.35 () {58 vars in 1124 bytes} [Fri Jun 10 18:09:22 2022] GET /compute/v2.1/servers => generated 344 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:09:22.683924 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2e7777ae-4d51-47a8-8de3-7bfe2962459e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:22.691471 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2e7777ae-4d51-47a8-8de3-7bfe2962459e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 49b47316-e3b5-4ecd-962d-003a6cd0def3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:22.703271 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2e7777ae-4d51-47a8-8de3-7bfe2962459e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:22.707002 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2e7777ae-4d51-47a8-8de3-7bfe2962459e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:22.708902 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2e7777ae-4d51-47a8-8de3-7bfe2962459e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:22.709480 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2e7777ae-4d51-47a8-8de3-7bfe2962459e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:22.776261 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2e7777ae-4d51-47a8-8de3-7bfe2962459e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:22.777231 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2e7777ae-4d51-47a8-8de3-7bfe2962459e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:22.777916 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-2e7777ae-4d51-47a8-8de3-7bfe2962459e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lazy-loading 'fault' on Instance uuid 49b47316-e3b5-4ecd-962d-003a6cd0def3 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:09:22.831648 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a8a64c2e-1022-4e9c-9da3-a6f5f0b158cd tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "DELETE /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6" status: 204 len: 0 microversion: 2.54 time: 0.509270 Jun 10 18:09:22.834981 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1735/3547] 10.222.0.35 () {60 vars in 1279 bytes} [Fri Jun 10 18:09:22 2022] DELETE /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 10 18:09:22.844224 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c08459e2-4c2e-4cb3-873b-e54a8185c464 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:22.848909 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c08459e2-4c2e-4cb3-873b-e54a8185c464 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '41f463dd5d9140ecb29e0daa415331a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c384e1bab854ad8b4c2ae9ab895cd88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:22.849921 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c08459e2-4c2e-4cb3-873b-e54a8185c464 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Searching by: {'deleted': False, 'project_id': '3c384e1bab854ad8b4c2ae9ab895cd88'} {{(pid=126595) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 18:09:22.863626 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c08459e2-4c2e-4cb3-873b-e54a8185c464 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:22.866024 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c08459e2-4c2e-4cb3-873b-e54a8185c464 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:22.867367 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c08459e2-4c2e-4cb3-873b-e54a8185c464 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:22.870593 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c08459e2-4c2e-4cb3-873b-e54a8185c464 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:22.872689 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2e7777ae-4d51-47a8-8de3-7bfe2962459e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:22.886786 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2e7777ae-4d51-47a8-8de3-7bfe2962459e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3" status: 200 len: 1304 microversion: 2.1 time: 0.212137 Jun 10 18:09:22.889256 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1813/3548] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:22 2022] GET /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3 => generated 1304 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:22.896922 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8bd04d34-285d-4bad-b57c-2c8963356281 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:22.897693 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8bd04d34-285d-4bad-b57c-2c8963356281 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:22.907401 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8bd04d34-285d-4bad-b57c-2c8963356281 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:22.908132 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8bd04d34-285d-4bad-b57c-2c8963356281 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:22.909960 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8bd04d34-285d-4bad-b57c-2c8963356281 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:22.910638 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8bd04d34-285d-4bad-b57c-2c8963356281 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:22.913017 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.multi_cell_list [None req-c08459e2-4c2e-4cb3-873b-e54a8185c464 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126595) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 10 18:09:22.972396 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c08459e2-4c2e-4cb3-873b-e54a8185c464 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f463dd5d9140ecb29e0daa415331a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c384e1bab854ad8b4c2ae9ab895cd88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:22.979760 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c08459e2-4c2e-4cb3-873b-e54a8185c464 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:22.980221 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c08459e2-4c2e-4cb3-873b-e54a8185c464 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:23.017463 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8bd04d34-285d-4bad-b57c-2c8963356281 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:23.038543 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8bd04d34-285d-4bad-b57c-2c8963356281 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:23.042936 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8bd04d34-285d-4bad-b57c-2c8963356281 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:23.047372 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8bd04d34-285d-4bad-b57c-2c8963356281 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6" status: 200 len: 1404 microversion: 2.54 time: 0.154121 Jun 10 18:09:23.048555 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1814/3549] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:09:22 2022] GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 => generated 1404 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:09:23.258300 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2500506e-30b5-4c89-90fa-99ec222b15e3 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:23.259753 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2500506e-30b5-4c89-90fa-99ec222b15e3 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: cd20ed09-0a67-4b14-881f-2977acd23396] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:23.268119 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2500506e-30b5-4c89-90fa-99ec222b15e3 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:23.269622 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2500506e-30b5-4c89-90fa-99ec222b15e3 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:23.270546 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2500506e-30b5-4c89-90fa-99ec222b15e3 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:23.271077 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2500506e-30b5-4c89-90fa-99ec222b15e3 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:23.283631 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c08459e2-4c2e-4cb3-873b-e54a8185c464 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] 10.222.0.35 "GET /compute/v2.1/servers/detail" status: 200 len: 1606 microversion: 2.1 time: 0.448927 Jun 10 18:09:23.284752 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1736/3550] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 18:09:22 2022] GET /compute/v2.1/servers/detail => generated 1606 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:23.305707 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-363b6f3f-48f4-4fad-b054-9482bebf0766 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:23.318643 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-363b6f3f-48f4-4fad-b054-9482bebf0766 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] 10.222.0.35 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018582 Jun 10 18:09:23.320835 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1737/3551] 10.222.0.35 () {58 vars in 1136 bytes} [Fri Jun 10 18:09:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:09:23.453890 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2519110c-57a9-45f1-ac47-5d92e14552e3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:23.456702 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2519110c-57a9-45f1-ac47-5d92e14552e3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: db7ba61a-bb40-4246-91fb-426ccc9da491] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:23.472469 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2519110c-57a9-45f1-ac47-5d92e14552e3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:23.473049 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2519110c-57a9-45f1-ac47-5d92e14552e3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:23.475099 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2519110c-57a9-45f1-ac47-5d92e14552e3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:23.476100 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2519110c-57a9-45f1-ac47-5d92e14552e3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:23.570967 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2519110c-57a9-45f1-ac47-5d92e14552e3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:23.595022 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2519110c-57a9-45f1-ac47-5d92e14552e3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491" status: 200 len: 1273 microversion: 2.1 time: 0.149296 Jun 10 18:09:23.596019 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1738/3552] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:23 2022] GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491 => generated 1273 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:09:23.635307 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2500506e-30b5-4c89-90fa-99ec222b15e3 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:23.648796 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2500506e-30b5-4c89-90fa-99ec222b15e3 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396" status: 200 len: 1308 microversion: 2.1 time: 0.393557 Jun 10 18:09:23.658830 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1815/3553] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:23 2022] GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396 => generated 1308 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:09:23.780827 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-eae84a87-4928-4c43-adc9-2e5befa4fd10 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:23.781220 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-eae84a87-4928-4c43-adc9-2e5befa4fd10 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] [instance: 4f169350-57ce-4ea3-bfca-ccf6f1957aa9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:23.788976 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eae84a87-4928-4c43-adc9-2e5befa4fd10 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:23.789438 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eae84a87-4928-4c43-adc9-2e5befa4fd10 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:23.790217 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eae84a87-4928-4c43-adc9-2e5befa4fd10 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:23.790663 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eae84a87-4928-4c43-adc9-2e5befa4fd10 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:23.828149 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-eae84a87-4928-4c43-adc9-2e5befa4fd10 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] [instance: 4f169350-57ce-4ea3-bfca-ccf6f1957aa9] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:09:23.907025 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-52bd52d0-a550-477a-94e7-1de679744843 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:23.907727 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-52bd52d0-a550-477a-94e7-1de679744843 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 49b47316-e3b5-4ecd-962d-003a6cd0def3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:23.926574 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-52bd52d0-a550-477a-94e7-1de679744843 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:23.928016 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-52bd52d0-a550-477a-94e7-1de679744843 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:23.933741 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-52bd52d0-a550-477a-94e7-1de679744843 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:23.933741 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-52bd52d0-a550-477a-94e7-1de679744843 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:23.963615 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-52bd52d0-a550-477a-94e7-1de679744843 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] HTTP exception thrown: Instance 49b47316-e3b5-4ecd-962d-003a6cd0def3 could not be found. Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-52bd52d0-a550-477a-94e7-1de679744843 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Request method failure captured: Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3 HTTP/1.1 Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4bjYRjdJJInCzu3PVxYJsfBkminC6Ikt7M75i6Sx-ogiu0g-ClcDk6pe5ZbprSFn2IZnkupAGWwRhhyzLuF9eMcuLH1bKi15cgeBj7qi81gCxtLZj7Eo_sXXfXIhz0vAnCNJVtg10TQ8DAW2pxp6y_-W-5vyky7ezDgXd3Gl7vJQCo Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 2b34cb51c168497088d66fa0e507e364 Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServerActionsTestJSON-197909573 Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/2b34cb51c168497088d66fa0e507e364"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2b34cb51c168497088d66fa0e507e364"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2b34cb51c168497088d66fa0e507e364"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_2b34cb51c168497088d66fa0e507e364", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServerActionsTestJSON-197909573 Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 2b34cb51c168497088d66fa0e507e364 Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServerActionsTestJSON-197909573 Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServerActionsTestJSON-197909573-project Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 352e7f5de76c42da9241721fe0f0bf86 Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServerActionsTestJSON-197909573-project Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 49b47316-e3b5-4ecd-962d-003a6cd0def3 could not be found. Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '49b47316-e3b5-4ecd-962d-003a6cd0def3'} Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49b47316-e3b5-4ecd-962d-003a6cd0def3 could not be found. Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49b47316-e3b5-4ecd-962d-003a6cd0def3 could not be found. Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:23.966231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:23.970880 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:23.970880 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:23.970880 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:23.970880 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:09:23.970880 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:09:23.970880 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49b47316-e3b5-4ecd-962d-003a6cd0def3 could not be found. Jun 10 18:09:23.970880 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:23.970880 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-52bd52d0-a550-477a-94e7-1de679744843 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Returning 404 to user: Instance 49b47316-e3b5-4ecd-962d-003a6cd0def3 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:09:23.972415 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-52bd52d0-a550-477a-94e7-1de679744843 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3" status: 404 len: 111 microversion: 2.1 time: 0.069840 Jun 10 18:09:23.977908 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1816/3554] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:23 2022] GET /compute/v2.1/servers/49b47316-e3b5-4ecd-962d-003a6cd0def3 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:09:23.983988 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-55c2f76c-a2db-4c7b-a405-9d7283ee8d3d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:23.984642 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-55c2f76c-a2db-4c7b-a405-9d7283ee8d3d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 3a12492e-7860-4786-a695-48505e2c1840] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:23.991360 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-55c2f76c-a2db-4c7b-a405-9d7283ee8d3d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:23.991945 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-55c2f76c-a2db-4c7b-a405-9d7283ee8d3d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:23.992906 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-55c2f76c-a2db-4c7b-a405-9d7283ee8d3d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:23.993448 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-55c2f76c-a2db-4c7b-a405-9d7283ee8d3d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:24.023350 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-55c2f76c-a2db-4c7b-a405-9d7283ee8d3d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 3a12492e-7860-4786-a695-48505e2c1840] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:09:24.225003 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-eae84a87-4928-4c43-adc9-2e5befa4fd10 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] 10.222.0.35 "DELETE /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9" status: 204 len: 0 microversion: 2.1 time: 0.447777 Jun 10 18:09:24.225957 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1739/3555] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:09:23 2022] DELETE /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:09:24.353648 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-55c2f76c-a2db-4c7b-a405-9d7283ee8d3d tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "DELETE /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840" status: 204 len: 0 microversion: 2.1 time: 0.374211 Jun 10 18:09:24.356528 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1817/3556] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:09:23 2022] DELETE /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:09:24.362811 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-183151ca-8195-48d7-895a-3137d5ae15df tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:24.363794 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-183151ca-8195-48d7-895a-3137d5ae15df tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:24.372371 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-183151ca-8195-48d7-895a-3137d5ae15df tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:24.373052 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-183151ca-8195-48d7-895a-3137d5ae15df tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:24.374011 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-183151ca-8195-48d7-895a-3137d5ae15df tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:24.374615 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-183151ca-8195-48d7-895a-3137d5ae15df tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:24.466878 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-183151ca-8195-48d7-895a-3137d5ae15df tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:24.478407 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-183151ca-8195-48d7-895a-3137d5ae15df tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:24.480264 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-183151ca-8195-48d7-895a-3137d5ae15df tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:24.481914 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-183151ca-8195-48d7-895a-3137d5ae15df tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6" status: 200 len: 1404 microversion: 2.54 time: 0.126020 Jun 10 18:09:24.483472 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1818/3557] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:09:24 2022] GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 => generated 1404 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:09:24.488466 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1a83a096-5a18-464f-b480-583285c56f9f tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:24.489788 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1a83a096-5a18-464f-b480-583285c56f9f tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] [instance: 4f169350-57ce-4ea3-bfca-ccf6f1957aa9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:24.503868 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1a83a096-5a18-464f-b480-583285c56f9f tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:24.504658 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1a83a096-5a18-464f-b480-583285c56f9f tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:24.506150 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1a83a096-5a18-464f-b480-583285c56f9f tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:24.507340 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1a83a096-5a18-464f-b480-583285c56f9f tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:24.640957 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-90be7475-a216-4d41-a1fb-5ca7887f377d tempest-FloatingIPDetailsTestJSON-1740843904 tempest-FloatingIPDetailsTestJSON-1740843904-project] Action: 'create', calling method: .version_select at 0x7f77c614b940>, body: {"pool": null} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:25.005234 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1a83a096-5a18-464f-b480-583285c56f9f tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f463dd5d9140ecb29e0daa415331a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c384e1bab854ad8b4c2ae9ab895cd88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:25.016388 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1a83a096-5a18-464f-b480-583285c56f9f tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] 10.222.0.35 "GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9" status: 200 len: 1609 microversion: 2.1 time: 0.531676 Jun 10 18:09:25.016897 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1819/3558] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:24 2022] GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9 => generated 1609 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:25.035313 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-811b6b1e-39d6-434c-a3bc-be80574e878a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:25.041383 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-811b6b1e-39d6-434c-a3bc-be80574e878a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 3a12492e-7860-4786-a695-48505e2c1840] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:25.049691 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-811b6b1e-39d6-434c-a3bc-be80574e878a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:25.050149 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-811b6b1e-39d6-434c-a3bc-be80574e878a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:25.050933 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-811b6b1e-39d6-434c-a3bc-be80574e878a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:25.051375 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-811b6b1e-39d6-434c-a3bc-be80574e878a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:25.305221 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-811b6b1e-39d6-434c-a3bc-be80574e878a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:25.318438 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-811b6b1e-39d6-434c-a3bc-be80574e878a tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840" status: 200 len: 1495 microversion: 2.1 time: 0.286895 Jun 10 18:09:25.319309 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1820/3559] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:25 2022] GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840 => generated 1495 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:25.339197 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-90d6840f-47aa-41ad-a3f5-c42936d17986 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:25.344716 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-90d6840f-47aa-41ad-a3f5-c42936d17986 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: db7ba61a-bb40-4246-91fb-426ccc9da491] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:25.370844 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90d6840f-47aa-41ad-a3f5-c42936d17986 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:25.371212 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90d6840f-47aa-41ad-a3f5-c42936d17986 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:25.372063 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90d6840f-47aa-41ad-a3f5-c42936d17986 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:25.377913 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90d6840f-47aa-41ad-a3f5-c42936d17986 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:25.802421 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-90d6840f-47aa-41ad-a3f5-c42936d17986 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:25.814767 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-90d6840f-47aa-41ad-a3f5-c42936d17986 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491" status: 200 len: 1315 microversion: 2.1 time: 0.491467 Jun 10 18:09:25.826055 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1821/3560] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:25 2022] GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491 => generated 1315 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:25.835226 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-02ba4b12-012f-4832-9ccb-f2f93574ea1c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:25.837197 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-02ba4b12-012f-4832-9ccb-f2f93574ea1c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: cd20ed09-0a67-4b14-881f-2977acd23396] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:25.847562 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-02ba4b12-012f-4832-9ccb-f2f93574ea1c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:25.848594 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-02ba4b12-012f-4832-9ccb-f2f93574ea1c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:25.849686 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-02ba4b12-012f-4832-9ccb-f2f93574ea1c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:25.850495 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-02ba4b12-012f-4832-9ccb-f2f93574ea1c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:26.049416 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=8 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:09:26.197793 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-02ba4b12-012f-4832-9ccb-f2f93574ea1c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:26.206586 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-02ba4b12-012f-4832-9ccb-f2f93574ea1c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396" status: 200 len: 1308 microversion: 2.1 time: 0.378238 Jun 10 18:09:26.207173 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1822/3561] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:25 2022] GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396 => generated 1308 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:26.216752 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3710e159-e130-494f-ab3a-0e9030c911e2 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:26.218424 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3710e159-e130-494f-ab3a-0e9030c911e2 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:26.225488 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3710e159-e130-494f-ab3a-0e9030c911e2 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:26.226377 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3710e159-e130-494f-ab3a-0e9030c911e2 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:26.227169 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3710e159-e130-494f-ab3a-0e9030c911e2 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:26.227613 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3710e159-e130-494f-ab3a-0e9030c911e2 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:26.312503 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3710e159-e130-494f-ab3a-0e9030c911e2 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:26.321216 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3710e159-e130-494f-ab3a-0e9030c911e2 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:26.322984 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3710e159-e130-494f-ab3a-0e9030c911e2 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:26.324684 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3710e159-e130-494f-ab3a-0e9030c911e2 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6" status: 200 len: 1404 microversion: 2.54 time: 0.116014 Jun 10 18:09:26.326006 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1823/3562] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:09:26 2022] GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 => generated 1404 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:09:26.331494 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9d0ae0a0-1499-4754-929d-79e6632a031f tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:26.332178 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9d0ae0a0-1499-4754-929d-79e6632a031f tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] [instance: 4f169350-57ce-4ea3-bfca-ccf6f1957aa9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:26.339009 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9d0ae0a0-1499-4754-929d-79e6632a031f tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:26.339758 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9d0ae0a0-1499-4754-929d-79e6632a031f tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:26.340811 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9d0ae0a0-1499-4754-929d-79e6632a031f tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:26.341658 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9d0ae0a0-1499-4754-929d-79e6632a031f tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:26.925941 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9d0ae0a0-1499-4754-929d-79e6632a031f tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f463dd5d9140ecb29e0daa415331a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c384e1bab854ad8b4c2ae9ab895cd88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:26.950829 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9d0ae0a0-1499-4754-929d-79e6632a031f tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] 10.222.0.35 "GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9" status: 200 len: 1609 microversion: 2.1 time: 0.617748 Jun 10 18:09:26.953836 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1824/3563] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:26 2022] GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9 => generated 1609 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:26.966093 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-595fde9c-6642-4e85-90bf-c2e08aac422f req-306e086a-c5ad-4b18-a4b7-4815ee12faca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db7ba61a-bb40-4246-91fb-426ccc9da491", "tag": "a933607b-850a-4fe8-8c3e-ada642644d94"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:26.987598 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-595fde9c-6642-4e85-90bf-c2e08aac422f req-306e086a-c5ad-4b18-a4b7-4815ee12faca service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:26.989171 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-595fde9c-6642-4e85-90bf-c2e08aac422f req-306e086a-c5ad-4b18-a4b7-4815ee12faca service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:27.010130 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-595fde9c-6642-4e85-90bf-c2e08aac422f req-306e086a-c5ad-4b18-a4b7-4815ee12faca service nova] Creating event network-changed:a933607b-850a-4fe8-8c3e-ada642644d94 for instance db7ba61a-bb40-4246-91fb-426ccc9da491 on chh1-master-2 Jun 10 18:09:27.019983 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-595fde9c-6642-4e85-90bf-c2e08aac422f req-306e086a-c5ad-4b18-a4b7-4815ee12faca service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060490 Jun 10 18:09:27.019983 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1825/3564] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:09:27.028374 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4e481221-cc55-44f4-b220-b3f5abde3f3e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:27.033238 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4e481221-cc55-44f4-b220-b3f5abde3f3e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 3a12492e-7860-4786-a695-48505e2c1840] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:27.050200 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4e481221-cc55-44f4-b220-b3f5abde3f3e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:27.050805 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4e481221-cc55-44f4-b220-b3f5abde3f3e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:27.051609 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4e481221-cc55-44f4-b220-b3f5abde3f3e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:27.052123 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4e481221-cc55-44f4-b220-b3f5abde3f3e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:27.267466 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4e481221-cc55-44f4-b220-b3f5abde3f3e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:27.278187 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4e481221-cc55-44f4-b220-b3f5abde3f3e tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840" status: 200 len: 1495 microversion: 2.1 time: 0.258579 Jun 10 18:09:27.278639 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1826/3565] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:27 2022] GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840 => generated 1495 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:27.298255 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e56ce24d-a418-4b42-9dc2-4be6bebc87fe tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:27.303384 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e56ce24d-a418-4b42-9dc2-4be6bebc87fe tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: db7ba61a-bb40-4246-91fb-426ccc9da491] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:27.321311 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e56ce24d-a418-4b42-9dc2-4be6bebc87fe tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:27.321687 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e56ce24d-a418-4b42-9dc2-4be6bebc87fe tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:27.322847 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e56ce24d-a418-4b42-9dc2-4be6bebc87fe tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:27.323229 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e56ce24d-a418-4b42-9dc2-4be6bebc87fe tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:27.561167 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e56ce24d-a418-4b42-9dc2-4be6bebc87fe tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:27.584992 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e56ce24d-a418-4b42-9dc2-4be6bebc87fe tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491" status: 200 len: 1315 microversion: 2.1 time: 0.305117 Jun 10 18:09:27.588094 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1827/3566] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:27 2022] GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491 => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:27.600714 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-1d7d9949-edc1-4d9f-a7d7-2f41116936d4 req-44d00b83-881f-4ef7-afef-854de14f6168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd20ed09-0a67-4b14-881f-2977acd23396", "name": "network-vif-plugged", "status": "completed", "tag": "01f956de-a6b2-4cd1-9d96-7f5e4524b19c"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:27.609599 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-1d7d9949-edc1-4d9f-a7d7-2f41116936d4 req-44d00b83-881f-4ef7-afef-854de14f6168 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:27.610105 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-1d7d9949-edc1-4d9f-a7d7-2f41116936d4 req-44d00b83-881f-4ef7-afef-854de14f6168 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:27.654584 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-1d7d9949-edc1-4d9f-a7d7-2f41116936d4 req-44d00b83-881f-4ef7-afef-854de14f6168 service nova] Creating event network-vif-plugged:01f956de-a6b2-4cd1-9d96-7f5e4524b19c for instance cd20ed09-0a67-4b14-881f-2977acd23396 on chh2-master-2 Jun 10 18:09:27.661498 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-1d7d9949-edc1-4d9f-a7d7-2f41116936d4 req-44d00b83-881f-4ef7-afef-854de14f6168 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070866 Jun 10 18:09:27.662522 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1828/3567] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:09:27.669374 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f73f5a76-f819-4c16-b2b3-9dccf38db354 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:27.679955 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f73f5a76-f819-4c16-b2b3-9dccf38db354 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: cd20ed09-0a67-4b14-881f-2977acd23396] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:27.698888 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f73f5a76-f819-4c16-b2b3-9dccf38db354 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:27.703977 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f73f5a76-f819-4c16-b2b3-9dccf38db354 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:27.703977 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f73f5a76-f819-4c16-b2b3-9dccf38db354 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:27.703977 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f73f5a76-f819-4c16-b2b3-9dccf38db354 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:27.709318 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:09:27.938288 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f73f5a76-f819-4c16-b2b3-9dccf38db354 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:27.946600 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f73f5a76-f819-4c16-b2b3-9dccf38db354 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396" status: 200 len: 1308 microversion: 2.1 time: 0.282800 Jun 10 18:09:27.947203 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1829/3568] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:27 2022] GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396 => generated 1308 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:27.955861 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b351f057-35b6-43e5-9462-65157a2a935c tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:27.961165 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b351f057-35b6-43e5-9462-65157a2a935c tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:27.968073 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b351f057-35b6-43e5-9462-65157a2a935c tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:27.974359 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b351f057-35b6-43e5-9462-65157a2a935c tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:27.974359 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b351f057-35b6-43e5-9462-65157a2a935c tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:27.974359 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b351f057-35b6-43e5-9462-65157a2a935c tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:28.011392 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b351f057-35b6-43e5-9462-65157a2a935c tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:28.012033 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b351f057-35b6-43e5-9462-65157a2a935c tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:28.012686 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-b351f057-35b6-43e5-9462-65157a2a935c tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lazy-loading 'fault' on Instance uuid 81edd649-dbf7-4020-a3fc-327fadc68cf6 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:09:28.090859 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b351f057-35b6-43e5-9462-65157a2a935c tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:28.101192 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b351f057-35b6-43e5-9462-65157a2a935c tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:28.106334 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b351f057-35b6-43e5-9462-65157a2a935c tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44285f249557488ea96367d7eeccf276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '899cb2a2846949f1bd8482b3b8f1b176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:28.106334 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b351f057-35b6-43e5-9462-65157a2a935c tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6" status: 200 len: 1409 microversion: 2.54 time: 0.154824 Jun 10 18:09:28.106334 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1830/3569] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:09:27 2022] GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 => generated 1409 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:09:28.111821 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a48cc823-0566-471c-9e6b-94438c81aa31 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:28.112565 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a48cc823-0566-471c-9e6b-94438c81aa31 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] [instance: 4f169350-57ce-4ea3-bfca-ccf6f1957aa9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:28.119951 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a48cc823-0566-471c-9e6b-94438c81aa31 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:28.120780 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a48cc823-0566-471c-9e6b-94438c81aa31 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:28.122353 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a48cc823-0566-471c-9e6b-94438c81aa31 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:28.122901 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a48cc823-0566-471c-9e6b-94438c81aa31 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:28.229438 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-90be7475-a216-4d41-a1fb-5ca7887f377d tempest-FloatingIPDetailsTestJSON-1740843904 tempest-FloatingIPDetailsTestJSON-1740843904-project] 10.222.0.35 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.001391 Jun 10 18:09:28.230929 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1740/3570] 10.222.0.35 () {60 vars in 1169 bytes} [Fri Jun 10 18:09:24 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4004 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:09:28.239190 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-ea9778a2-2aa5-4e92-834f-35139a87e916 req-420c5f50-6608-484a-bc99-12989f6505f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a12492e-7860-4786-a695-48505e2c1840", "name": "network-vif-deleted", "tag": "9a0263c8-f83a-411c-b1f7-64fc2cf760df"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:28.251150 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-ea9778a2-2aa5-4e92-834f-35139a87e916 req-420c5f50-6608-484a-bc99-12989f6505f7 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:28.251920 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-ea9778a2-2aa5-4e92-834f-35139a87e916 req-420c5f50-6608-484a-bc99-12989f6505f7 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:28.266134 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-ea9778a2-2aa5-4e92-834f-35139a87e916 req-420c5f50-6608-484a-bc99-12989f6505f7 service nova] Creating event network-vif-deleted:9a0263c8-f83a-411c-b1f7-64fc2cf760df for instance 3a12492e-7860-4786-a695-48505e2c1840 on chh1-master-2 Jun 10 18:09:28.272148 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-ea9778a2-2aa5-4e92-834f-35139a87e916 req-420c5f50-6608-484a-bc99-12989f6505f7 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039180 Jun 10 18:09:28.273590 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1741/3571] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:09:28.281836 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-19fe02ab-eaf0-4886-8082-83248574fbe6 tempest-FloatingIPDetailsTestJSON-1740843904 tempest-FloatingIPDetailsTestJSON-1740843904-project] Action: 'create', calling method: .version_select at 0x7f77c024e940>, body: {"pool": null} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:28.298740 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a48cc823-0566-471c-9e6b-94438c81aa31 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f463dd5d9140ecb29e0daa415331a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c384e1bab854ad8b4c2ae9ab895cd88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:28.307247 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a48cc823-0566-471c-9e6b-94438c81aa31 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] 10.222.0.35 "GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9" status: 200 len: 1609 microversion: 2.1 time: 0.199782 Jun 10 18:09:28.307944 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1831/3572] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:28 2022] GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9 => generated 1609 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:28.313276 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-eb49f38c-a541-491a-b6bb-70123bf432e1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:28.314188 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-eb49f38c-a541-491a-b6bb-70123bf432e1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 3a12492e-7860-4786-a695-48505e2c1840] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:28.320905 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eb49f38c-a541-491a-b6bb-70123bf432e1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:28.324123 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eb49f38c-a541-491a-b6bb-70123bf432e1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:28.324123 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eb49f38c-a541-491a-b6bb-70123bf432e1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:28.324123 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eb49f38c-a541-491a-b6bb-70123bf432e1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:28.396912 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-eb49f38c-a541-491a-b6bb-70123bf432e1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:28.405709 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-eb49f38c-a541-491a-b6bb-70123bf432e1 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840" status: 200 len: 1453 microversion: 2.1 time: 0.096501 Jun 10 18:09:28.406375 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1832/3573] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:28 2022] GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840 => generated 1453 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:28.604661 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-be2e597e-1598-4091-937e-60dcb8f016b0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:28.605363 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-be2e597e-1598-4091-937e-60dcb8f016b0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: db7ba61a-bb40-4246-91fb-426ccc9da491] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:28.611472 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be2e597e-1598-4091-937e-60dcb8f016b0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:28.612006 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be2e597e-1598-4091-937e-60dcb8f016b0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:28.612885 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be2e597e-1598-4091-937e-60dcb8f016b0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:28.613401 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be2e597e-1598-4091-937e-60dcb8f016b0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:28.792531 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-be2e597e-1598-4091-937e-60dcb8f016b0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:28.803639 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-be2e597e-1598-4091-937e-60dcb8f016b0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491" status: 200 len: 1315 microversion: 2.1 time: 0.200033 Jun 10 18:09:28.803639 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1833/3574] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:28 2022] GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:09:28.965179 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ee8b7234-bb21-4841-965b-d21e230ad818 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:28.967593 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ee8b7234-bb21-4841-965b-d21e230ad818 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: cd20ed09-0a67-4b14-881f-2977acd23396] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:28.990632 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ee8b7234-bb21-4841-965b-d21e230ad818 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:28.993538 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ee8b7234-bb21-4841-965b-d21e230ad818 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:28.997628 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ee8b7234-bb21-4841-965b-d21e230ad818 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:29.000809 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ee8b7234-bb21-4841-965b-d21e230ad818 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:29.215487 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ee8b7234-bb21-4841-965b-d21e230ad818 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:29.226777 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ee8b7234-bb21-4841-965b-d21e230ad818 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396" status: 200 len: 1308 microversion: 2.1 time: 0.265934 Jun 10 18:09:29.227692 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1834/3575] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:28 2022] GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396 => generated 1308 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:29.237654 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bc98ca51-c7fe-4f69-b1e5-4306cffdf5d7 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:29.238273 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bc98ca51-c7fe-4f69-b1e5-4306cffdf5d7 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] [instance: 81edd649-dbf7-4020-a3fc-327fadc68cf6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:29.245238 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bc98ca51-c7fe-4f69-b1e5-4306cffdf5d7 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:29.245760 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bc98ca51-c7fe-4f69-b1e5-4306cffdf5d7 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:29.246542 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bc98ca51-c7fe-4f69-b1e5-4306cffdf5d7 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:29.247034 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bc98ca51-c7fe-4f69-b1e5-4306cffdf5d7 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:29.265762 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-bc98ca51-c7fe-4f69-b1e5-4306cffdf5d7 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] HTTP exception thrown: Instance 81edd649-dbf7-4020-a3fc-327fadc68cf6 could not be found. Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bc98ca51-c7fe-4f69-b1e5-4306cffdf5d7 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Request method failure captured: Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 HTTP/1.1 Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4iklQIggGBdN59mvL3YucI-iEOUYbuv_fl-w77j_2U-Zh-pwovpZghIQZbrOMzsskvrB5RFPhPt6dr0MTvwPkpvYAf-Ug2ehosozFDOavWdPq0Qc1a0wjQmT6o4Wi3Su0UbO9KOSSZHOqVCz26IUv7WtR566IT4AJJNOv8j98Lxhwc Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: X-Openstack-Nova-Api-Version: 2.54 Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 899cb2a2846949f1bd8482b3b8f1b176 Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServerShowV254Test-1760044128 Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/899cb2a2846949f1bd8482b3b8f1b176"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/899cb2a2846949f1bd8482b3b8f1b176"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/899cb2a2846949f1bd8482b3b8f1b176"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_899cb2a2846949f1bd8482b3b8f1b176", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServerShowV254Test-1760044128 Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 899cb2a2846949f1bd8482b3b8f1b176 Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServerShowV254Test-1760044128 Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServerShowV254Test-1760044128-project Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 44285f249557488ea96367d7eeccf276 Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServerShowV254Test-1760044128-project Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 81edd649-dbf7-4020-a3fc-327fadc68cf6 could not be found. Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '81edd649-dbf7-4020-a3fc-327fadc68cf6'} Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81edd649-dbf7-4020-a3fc-327fadc68cf6 could not be found. Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81edd649-dbf7-4020-a3fc-327fadc68cf6 could not be found. Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:29.268238 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:29.273258 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:29.273258 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:29.273258 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:29.273258 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:09:29.273258 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:09:29.273258 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81edd649-dbf7-4020-a3fc-327fadc68cf6 could not be found. Jun 10 18:09:29.273258 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:29.275444 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bc98ca51-c7fe-4f69-b1e5-4306cffdf5d7 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] Returning 404 to user: Instance 81edd649-dbf7-4020-a3fc-327fadc68cf6 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:09:29.276765 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bc98ca51-c7fe-4f69-b1e5-4306cffdf5d7 tempest-ServerShowV254Test-1760044128 tempest-ServerShowV254Test-1760044128-project] 10.222.0.35 "GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6" status: 404 len: 111 microversion: 2.54 time: 0.047795 Jun 10 18:09:29.277562 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1835/3576] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:09:29 2022] GET /compute/v2.1/servers/81edd649-dbf7-4020-a3fc-327fadc68cf6 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:09:29.324928 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fc40780b-8970-4deb-b955-a30d1d5c6d81 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:29.325674 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fc40780b-8970-4deb-b955-a30d1d5c6d81 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] [instance: 4f169350-57ce-4ea3-bfca-ccf6f1957aa9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:29.332433 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fc40780b-8970-4deb-b955-a30d1d5c6d81 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:29.338329 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fc40780b-8970-4deb-b955-a30d1d5c6d81 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:29.339729 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fc40780b-8970-4deb-b955-a30d1d5c6d81 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:29.351407 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fc40780b-8970-4deb-b955-a30d1d5c6d81 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:29.462885 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fc40780b-8970-4deb-b955-a30d1d5c6d81 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f463dd5d9140ecb29e0daa415331a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c384e1bab854ad8b4c2ae9ab895cd88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:29.494400 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fc40780b-8970-4deb-b955-a30d1d5c6d81 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] 10.222.0.35 "GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9" status: 200 len: 1541 microversion: 2.1 time: 0.172740 Jun 10 18:09:29.495575 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1836/3577] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:29 2022] GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9 => generated 1541 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:29.502067 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f4ff6ff6-2233-4ca3-aece-90afde2efc20 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:29.503347 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f4ff6ff6-2233-4ca3-aece-90afde2efc20 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 3a12492e-7860-4786-a695-48505e2c1840] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:29.518105 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4ff6ff6-2233-4ca3-aece-90afde2efc20 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:29.518105 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4ff6ff6-2233-4ca3-aece-90afde2efc20 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:29.518105 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4ff6ff6-2233-4ca3-aece-90afde2efc20 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:29.518105 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4ff6ff6-2233-4ca3-aece-90afde2efc20 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:29.556885 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4ff6ff6-2233-4ca3-aece-90afde2efc20 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:29.556885 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4ff6ff6-2233-4ca3-aece-90afde2efc20 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:29.556885 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-f4ff6ff6-2233-4ca3-aece-90afde2efc20 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lazy-loading 'fault' on Instance uuid 3a12492e-7860-4786-a695-48505e2c1840 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:09:29.623203 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f4ff6ff6-2233-4ca3-aece-90afde2efc20 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:29.631944 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f4ff6ff6-2233-4ca3-aece-90afde2efc20 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840" status: 200 len: 1305 microversion: 2.1 time: 0.135047 Jun 10 18:09:29.634162 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1837/3578] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:29 2022] GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840 => generated 1305 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:29.822054 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-009bfc27-864c-4278-bf3f-2ec8f58d9425 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:29.823786 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-009bfc27-864c-4278-bf3f-2ec8f58d9425 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: db7ba61a-bb40-4246-91fb-426ccc9da491] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:29.849891 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-009bfc27-864c-4278-bf3f-2ec8f58d9425 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:29.850636 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-009bfc27-864c-4278-bf3f-2ec8f58d9425 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:29.851606 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-009bfc27-864c-4278-bf3f-2ec8f58d9425 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:29.854006 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-009bfc27-864c-4278-bf3f-2ec8f58d9425 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:30.216063 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-009bfc27-864c-4278-bf3f-2ec8f58d9425 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:30.235219 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-009bfc27-864c-4278-bf3f-2ec8f58d9425 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491" status: 200 len: 1315 microversion: 2.1 time: 0.410747 Jun 10 18:09:30.235904 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1838/3579] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:29 2022] GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491 => generated 1315 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:30.254096 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-06040913-2d93-4d40-bf57-0bb7918d2ba9 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:30.255089 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-06040913-2d93-4d40-bf57-0bb7918d2ba9 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: cd20ed09-0a67-4b14-881f-2977acd23396] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:30.261762 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:09:30.268757 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-06040913-2d93-4d40-bf57-0bb7918d2ba9 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:30.270012 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-06040913-2d93-4d40-bf57-0bb7918d2ba9 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:30.271879 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-06040913-2d93-4d40-bf57-0bb7918d2ba9 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:30.273088 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-06040913-2d93-4d40-bf57-0bb7918d2ba9 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:30.521085 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-06040913-2d93-4d40-bf57-0bb7918d2ba9 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:30.528639 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-06040913-2d93-4d40-bf57-0bb7918d2ba9 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396" status: 200 len: 1488 microversion: 2.1 time: 0.287626 Jun 10 18:09:30.535605 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1839/3580] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:30 2022] GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396 => generated 1488 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:30.552765 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-15975c61-54d8-431b-a6d5-42fb9c68e9aa req-fd9f7093-d497-4d08-befd-f501cc54c2e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f169350-57ce-4ea3-bfca-ccf6f1957aa9", "name": "network-vif-deleted", "tag": "10868c25-7b88-4c10-9a0f-b5344b001642"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:30.564285 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-15975c61-54d8-431b-a6d5-42fb9c68e9aa req-fd9f7093-d497-4d08-befd-f501cc54c2e9 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:30.565077 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-15975c61-54d8-431b-a6d5-42fb9c68e9aa req-fd9f7093-d497-4d08-befd-f501cc54c2e9 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:30.591270 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-15975c61-54d8-431b-a6d5-42fb9c68e9aa req-fd9f7093-d497-4d08-befd-f501cc54c2e9 service nova] Creating event network-vif-deleted:10868c25-7b88-4c10-9a0f-b5344b001642 for instance 4f169350-57ce-4ea3-bfca-ccf6f1957aa9 on chh1-master-2 Jun 10 18:09:30.598815 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-15975c61-54d8-431b-a6d5-42fb9c68e9aa req-fd9f7093-d497-4d08-befd-f501cc54c2e9 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061666 Jun 10 18:09:30.603471 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1840/3581] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:09:30.609136 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-83de0497-bc39-4f5b-aed1-6a328c886dfa tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:30.610107 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-83de0497-bc39-4f5b-aed1-6a328c886dfa tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] [instance: 4f169350-57ce-4ea3-bfca-ccf6f1957aa9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:30.619916 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-83de0497-bc39-4f5b-aed1-6a328c886dfa tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:30.620739 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-83de0497-bc39-4f5b-aed1-6a328c886dfa tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:30.621793 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-83de0497-bc39-4f5b-aed1-6a328c886dfa tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:30.622589 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-83de0497-bc39-4f5b-aed1-6a328c886dfa tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:30.744121 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-83de0497-bc39-4f5b-aed1-6a328c886dfa tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f463dd5d9140ecb29e0daa415331a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c384e1bab854ad8b4c2ae9ab895cd88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:30.757261 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-83de0497-bc39-4f5b-aed1-6a328c886dfa tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] 10.222.0.35 "GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9" status: 200 len: 1253 microversion: 2.1 time: 0.155042 Jun 10 18:09:30.758184 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1841/3582] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:30 2022] GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9 => generated 1253 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:30.766419 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4a5a126d-469d-49ad-b66e-ee7e9f641961 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1309378178"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:30.768846 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4a5a126d-469d-49ad-b66e-ee7e9f641961 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: cd20ed09-0a67-4b14-881f-2977acd23396] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:30.784053 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4a5a126d-469d-49ad-b66e-ee7e9f641961 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:30.786063 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4a5a126d-469d-49ad-b66e-ee7e9f641961 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:30.786942 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4a5a126d-469d-49ad-b66e-ee7e9f641961 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:30.787410 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4a5a126d-469d-49ad-b66e-ee7e9f641961 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:31.092942 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-19fe02ab-eaf0-4886-8082-83248574fbe6 tempest-FloatingIPDetailsTestJSON-1740843904 tempest-FloatingIPDetailsTestJSON-1740843904-project] 10.222.0.35 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.817811 Jun 10 18:09:31.093555 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1742/3583] 10.222.0.35 () {60 vars in 1169 bytes} [Fri Jun 10 18:09:28 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:09:31.102688 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-563651a6-c34a-4197-9614-386d1cb60b43 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:31.103685 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-563651a6-c34a-4197-9614-386d1cb60b43 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 3a12492e-7860-4786-a695-48505e2c1840] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:31.111917 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-563651a6-c34a-4197-9614-386d1cb60b43 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:31.112684 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-563651a6-c34a-4197-9614-386d1cb60b43 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:31.117868 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-563651a6-c34a-4197-9614-386d1cb60b43 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:31.117868 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-563651a6-c34a-4197-9614-386d1cb60b43 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:31.130078 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-563651a6-c34a-4197-9614-386d1cb60b43 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] HTTP exception thrown: Instance 3a12492e-7860-4786-a695-48505e2c1840 could not be found. Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-563651a6-c34a-4197-9614-386d1cb60b43 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Request method failure captured: Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840 HTTP/1.1 Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4bjYRjdJJInCzu3PVxYJsfBkminC6Ikt7M75i6Sx-ogiu0g-ClcDk6pe5ZbprSFn2IZnkupAGWwRhhyzLuF9eMcuLH1bKi15cgeBj7qi81gCxtLZj7Eo_sXXfXIhz0vAnCNJVtg10TQ8DAW2pxp6y_-W-5vyky7ezDgXd3Gl7vJQCo Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 2b34cb51c168497088d66fa0e507e364 Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServerActionsTestJSON-197909573 Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/2b34cb51c168497088d66fa0e507e364"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2b34cb51c168497088d66fa0e507e364"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2b34cb51c168497088d66fa0e507e364"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_2b34cb51c168497088d66fa0e507e364", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServerActionsTestJSON-197909573 Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 2b34cb51c168497088d66fa0e507e364 Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServerActionsTestJSON-197909573 Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServerActionsTestJSON-197909573-project Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 352e7f5de76c42da9241721fe0f0bf86 Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServerActionsTestJSON-197909573-project Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 3a12492e-7860-4786-a695-48505e2c1840 could not be found. Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '3a12492e-7860-4786-a695-48505e2c1840'} Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a12492e-7860-4786-a695-48505e2c1840 could not be found. Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a12492e-7860-4786-a695-48505e2c1840 could not be found. Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:31.131935 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:31.136663 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:31.136663 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:31.136663 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:31.136663 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:09:31.136663 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:09:31.136663 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a12492e-7860-4786-a695-48505e2c1840 could not be found. Jun 10 18:09:31.136663 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:31.141118 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-563651a6-c34a-4197-9614-386d1cb60b43 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Returning 404 to user: Instance 3a12492e-7860-4786-a695-48505e2c1840 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:09:31.142106 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-563651a6-c34a-4197-9614-386d1cb60b43 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840" status: 404 len: 111 microversion: 2.1 time: 0.044820 Jun 10 18:09:31.144339 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1743/3584] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:31 2022] GET /compute/v2.1/servers/3a12492e-7860-4786-a695-48505e2c1840 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:09:31.151798 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fc72f155-80b6-49e9-8b73-59183f5ba46e tempest-FloatingIPDetailsTestJSON-1740843904 tempest-FloatingIPDetailsTestJSON-1740843904-project] Action: 'create', calling method: .version_select at 0x7f77c04191f0>, body: {"pool": null} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:31.505413 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4a5a126d-469d-49ad-b66e-ee7e9f641961 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "POST /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396/action" status: 202 len: 0 microversion: 2.1 time: 0.745782 Jun 10 18:09:31.508820 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1842/3585] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:09:30 2022] POST /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396/action => generated 0 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 10 18:09:31.512706 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-398d786d-7356-40d3-aa64-5f90120ed125 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:31.513300 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-398d786d-7356-40d3-aa64-5f90120ed125 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:31.519587 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-398d786d-7356-40d3-aa64-5f90120ed125 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:31.520091 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-398d786d-7356-40d3-aa64-5f90120ed125 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:31.521088 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-398d786d-7356-40d3-aa64-5f90120ed125 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:31.521536 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-398d786d-7356-40d3-aa64-5f90120ed125 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:31.602552 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-398d786d-7356-40d3-aa64-5f90120ed125 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:09:31.816063 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:09:32.046866 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-398d786d-7356-40d3-aa64-5f90120ed125 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "DELETE /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 204 len: 0 microversion: 2.1 time: 0.538599 Jun 10 18:09:32.047780 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1843/3586] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:09:31 2022] DELETE /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:09:32.058711 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e668e618-d748-4494-8134-0f8727996ff9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:32.059288 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e668e618-d748-4494-8134-0f8727996ff9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: db7ba61a-bb40-4246-91fb-426ccc9da491] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:32.066104 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e668e618-d748-4494-8134-0f8727996ff9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:32.066891 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e668e618-d748-4494-8134-0f8727996ff9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:32.068108 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e668e618-d748-4494-8134-0f8727996ff9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:32.068746 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e668e618-d748-4494-8134-0f8727996ff9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:32.264427 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e668e618-d748-4494-8134-0f8727996ff9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:32.271987 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e668e618-d748-4494-8134-0f8727996ff9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491" status: 200 len: 1315 microversion: 2.1 time: 0.221104 Jun 10 18:09:32.276480 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1844/3587] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:32 2022] GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:32.286180 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3eb9c177-9fa5-4e5b-b17b-6ff59424be24 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77b3d3e940>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:32.343738 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3eb9c177-9fa5-4e5b-b17b-6ff59424be24 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/9a826550-1c1d-4c15-80fa-7ffe91868fba" status: 200 len: 1410 microversion: 2.1 time: 0.065854 Jun 10 18:09:32.346297 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1845/3588] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:09:32 2022] GET /compute/v2.1/images/9a826550-1c1d-4c15-80fa-7ffe91868fba => generated 1410 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:32.361850 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6db91f6c-e17d-4894-b2d8-7565683e3cab tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:32.362670 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6db91f6c-e17d-4894-b2d8-7565683e3cab tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] [instance: 4f169350-57ce-4ea3-bfca-ccf6f1957aa9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:32.401837 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6db91f6c-e17d-4894-b2d8-7565683e3cab tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:32.402345 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6db91f6c-e17d-4894-b2d8-7565683e3cab tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:32.413330 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6db91f6c-e17d-4894-b2d8-7565683e3cab tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:32.413330 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6db91f6c-e17d-4894-b2d8-7565683e3cab tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:32.490307 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6db91f6c-e17d-4894-b2d8-7565683e3cab tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f463dd5d9140ecb29e0daa415331a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c384e1bab854ad8b4c2ae9ab895cd88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:32.502213 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6db91f6c-e17d-4894-b2d8-7565683e3cab tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] 10.222.0.35 "GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9" status: 200 len: 1253 microversion: 2.1 time: 0.154356 Jun 10 18:09:32.504072 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1846/3589] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:32 2022] GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9 => generated 1253 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:32.519899 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4fceb61b-5831-4088-aa3c-c33f66525488 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:32.521042 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4fceb61b-5831-4088-aa3c-c33f66525488 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:32.528184 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4fceb61b-5831-4088-aa3c-c33f66525488 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:32.528707 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4fceb61b-5831-4088-aa3c-c33f66525488 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:32.530111 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4fceb61b-5831-4088-aa3c-c33f66525488 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:32.530555 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4fceb61b-5831-4088-aa3c-c33f66525488 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:32.596941 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=4 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:09:32.719622 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4fceb61b-5831-4088-aa3c-c33f66525488 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:32.733422 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4fceb61b-5831-4088-aa3c-c33f66525488 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1674 microversion: 2.1 time: 0.228055 Jun 10 18:09:32.739686 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1847/3590] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:32 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1674 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:32.753187 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3b2cdc53-4635-4d04-95a2-27062fc071fe tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c61574c0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:32.815018 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3b2cdc53-4635-4d04-95a2-27062fc071fe tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/9a826550-1c1d-4c15-80fa-7ffe91868fba" status: 200 len: 1410 microversion: 2.1 time: 0.073902 Jun 10 18:09:32.816029 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1848/3591] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:09:32 2022] GET /compute/v2.1/images/9a826550-1c1d-4c15-80fa-7ffe91868fba => generated 1410 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:32.829090 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0e9a9521-ba5a-4374-8928-ca9ffc03f3da tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c62991f0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:32.878912 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=6 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:09:32.968394 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=20 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:09:33.177107 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0e9a9521-ba5a-4374-8928-ca9ffc03f3da tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "DELETE /compute/v2.1/images/9a826550-1c1d-4c15-80fa-7ffe91868fba" status: 204 len: 0 microversion: 2.1 time: 0.352955 Jun 10 18:09:33.177700 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1849/3592] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:32 2022] DELETE /compute/v2.1/images/9a826550-1c1d-4c15-80fa-7ffe91868fba => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:09:33.437612 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2aca2a8e-8788-48e4-a218-62a595097257 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1628591510", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": "none"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:33.447235 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fc72f155-80b6-49e9-8b73-59183f5ba46e tempest-FloatingIPDetailsTestJSON-1740843904 tempest-FloatingIPDetailsTestJSON-1740843904-project] 10.222.0.35 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.302853 Jun 10 18:09:33.447890 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1744/3593] 10.222.0.35 () {60 vars in 1169 bytes} [Fri Jun 10 18:09:31 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:09:33.453526 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-3df05e95-c307-46fe-877c-bc0243c1ac93 req-94afc791-f364-43a7-a244-a22bbdb0b074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db7ba61a-bb40-4246-91fb-426ccc9da491", "name": "network-vif-plugged", "status": "completed", "tag": "a933607b-850a-4fe8-8c3e-ada642644d94"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:33.466344 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-3df05e95-c307-46fe-877c-bc0243c1ac93 req-94afc791-f364-43a7-a244-a22bbdb0b074 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:33.467696 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-3df05e95-c307-46fe-877c-bc0243c1ac93 req-94afc791-f364-43a7-a244-a22bbdb0b074 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:33.481460 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-3df05e95-c307-46fe-877c-bc0243c1ac93 req-94afc791-f364-43a7-a244-a22bbdb0b074 service nova] Creating event network-vif-plugged:a933607b-850a-4fe8-8c3e-ada642644d94 for instance db7ba61a-bb40-4246-91fb-426ccc9da491 on chh1-master-2 Jun 10 18:09:33.487807 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-3df05e95-c307-46fe-877c-bc0243c1ac93 req-94afc791-f364-43a7-a244-a22bbdb0b074 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038083 Jun 10 18:09:33.489143 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1745/3594] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:09:33.499599 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cbb85aad-6d17-464f-88cc-693f64c5caac tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c613e820>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:33.532943 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-2aca2a8e-8788-48e4-a218-62a595097257 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:09:33.533420 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-2aca2a8e-8788-48e4-a218-62a595097257 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:09:33.533849 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-2aca2a8e-8788-48e4-a218-62a595097257 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:09:33.534270 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-2aca2a8e-8788-48e4-a218-62a595097257 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:09:33.534772 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-2aca2a8e-8788-48e4-a218-62a595097257 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:09:33.537585 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-cbb85aad-6d17-464f-88cc-693f64c5caac tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] HTTP exception thrown: Image not found. Jun 10 18:09:33.552740 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2aca2a8e-8788-48e4-a218-62a595097257 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:33.553469 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2aca2a8e-8788-48e4-a218-62a595097257 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:33.554334 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2aca2a8e-8788-48e4-a218-62a595097257 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:33.555111 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2aca2a8e-8788-48e4-a218-62a595097257 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cbb85aad-6d17-464f-88cc-693f64c5caac tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Request method failure captured: Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/images/9a826550-1c1d-4c15-80fa-7ffe91868fba HTTP/1.1 Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4fpk-i12apG1VgsMUVwPtQpaZk13MV4SM6M42Og9sHaOGAl94RmFuulvShkHQAFyfvECSdOXF3YdT8WPuqdnEqM1w6kND66S76WDoal-aLGFad_z4ElOIqTs_7k98WN4aZzOrwcyGdKQ76TZzPeuu6jMsJIsXWmRGoci16cbKcHviU Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: af241982b5884c22b5e7103f1ea4b8ef Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ImagesTestJSON-58204800 Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/af241982b5884c22b5e7103f1ea4b8ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/af241982b5884c22b5e7103f1ea4b8ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/af241982b5884c22b5e7103f1ea4b8ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_af241982b5884c22b5e7103f1ea4b8ef", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ImagesTestJSON-58204800 Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: af241982b5884c22b5e7103f1ea4b8ef Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ImagesTestJSON-58204800 Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ImagesTestJSON-58204800-project Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 8adb0ac9df46461489fa6bd3951417cf Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ImagesTestJSON-58204800-project Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: exception: Image not found. Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '9a826550-1c1d-4c15-80fa-7ffe91868fba'} Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9a826550-1c1d-4c15-80fa-7ffe91868fba Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 10 18:09:33.567881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 10 18:09:33.571898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 10 18:09:33.571898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 10 18:09:33.571898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 10 18:09:33.571898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 10 18:09:33.571898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 10 18:09:33.571898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 10 18:09:33.571898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 10 18:09:33.571898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 10 18:09:33.571898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 10 18:09:33.571898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 10 18:09:33.571898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 10 18:09:33.571898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 10 18:09:33.571898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 10 18:09:33.571898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 10 18:09:33.571898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 10 18:09:33.571898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 10 18:09:33.571898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9a826550-1c1d-4c15-80fa-7ffe91868fba could not be found. Jun 10 18:09:33.571898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:33.571898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:33.571898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:33.571898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:33.571898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:33.571898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:33.571898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:09:33.571898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:09:33.571898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:09:33.571898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:09:33.571898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:09:33.571898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:09:33.571898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jun 10 18:09:33.571898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 10 18:09:33.571898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 10 18:09:33.571898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:33.571898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:33.571898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:33.571898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:33.571898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:33.571898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:33.571898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:09:33.571898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:09:33.571898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 10 18:09:33.571898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:33.581021 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cbb85aad-6d17-464f-88cc-693f64c5caac tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Returning 404 to user: Image not found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:09:33.582309 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cbb85aad-6d17-464f-88cc-693f64c5caac tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/images/9a826550-1c1d-4c15-80fa-7ffe91868fba" status: 404 len: 62 microversion: 2.1 time: 0.091538 Jun 10 18:09:33.583226 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1746/3595] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:09:33 2022] GET /compute/v2.1/images/9a826550-1c1d-4c15-80fa-7ffe91868fba => generated 62 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:09:33.589740 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-aad7ee53-6812-44de-85ac-44fff86457ab tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:33.591335 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-aad7ee53-6812-44de-85ac-44fff86457ab tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: db7ba61a-bb40-4246-91fb-426ccc9da491] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:33.603052 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aad7ee53-6812-44de-85ac-44fff86457ab tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:33.603859 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aad7ee53-6812-44de-85ac-44fff86457ab tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:33.605050 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aad7ee53-6812-44de-85ac-44fff86457ab tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:33.605577 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aad7ee53-6812-44de-85ac-44fff86457ab tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:33.613957 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-2aca2a8e-8788-48e4-a218-62a595097257 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Getting quotas for project 8eddb11fcb9c4793a69bc00090064758. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:09:33.622481 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-2aca2a8e-8788-48e4-a218-62a595097257 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Getting quotas for user 5541893018e141818e3876aa4ebfb9ea and project 8eddb11fcb9c4793a69bc00090064758. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:09:33.636455 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2aca2a8e-8788-48e4-a218-62a595097257 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:09:33.639293 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2aca2a8e-8788-48e4-a218-62a595097257 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] [instance: a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:09:33.800119 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2aca2a8e-8788-48e4-a218-62a595097257 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.621324 Jun 10 18:09:33.801064 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1850/3596] 10.222.0.35 () {62 vars in 1187 bytes} [Fri Jun 10 18:09:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 10 18:09:33.816474 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7aa7a5ee-e9ca-4e61-b68a-5e04abf2258f tempest-FloatingIPDetailsTestJSON-1740843904 tempest-FloatingIPDetailsTestJSON-1740843904-project] Action: 'create', calling method: .version_select at 0x7f77c6299280>, body: {"pool": null} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:33.977706 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-aad7ee53-6812-44de-85ac-44fff86457ab tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:33.987750 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-aad7ee53-6812-44de-85ac-44fff86457ab tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491" status: 200 len: 1315 microversion: 2.1 time: 0.401982 Jun 10 18:09:33.989771 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1747/3597] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:33 2022] GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491 => generated 1315 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:33.999464 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-43ad8118-e972-483d-93bd-37a603954b59 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:34.000099 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-43ad8118-e972-483d-93bd-37a603954b59 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] [instance: 4f169350-57ce-4ea3-bfca-ccf6f1957aa9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:34.015687 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-43ad8118-e972-483d-93bd-37a603954b59 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:34.020633 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-43ad8118-e972-483d-93bd-37a603954b59 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:34.021492 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-43ad8118-e972-483d-93bd-37a603954b59 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:34.022185 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-43ad8118-e972-483d-93bd-37a603954b59 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:34.177360 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-43ad8118-e972-483d-93bd-37a603954b59 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f463dd5d9140ecb29e0daa415331a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c384e1bab854ad8b4c2ae9ab895cd88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:34.188454 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-43ad8118-e972-483d-93bd-37a603954b59 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] 10.222.0.35 "GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9" status: 200 len: 1253 microversion: 2.1 time: 0.197320 Jun 10 18:09:34.189342 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1748/3598] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:33 2022] GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9 => generated 1253 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:34.195823 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4303443d-1362-4b98-8dac-0bfae6ee69cd tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:34.196706 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4303443d-1362-4b98-8dac-0bfae6ee69cd tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: cd20ed09-0a67-4b14-881f-2977acd23396] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:34.204666 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4303443d-1362-4b98-8dac-0bfae6ee69cd tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:34.205366 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4303443d-1362-4b98-8dac-0bfae6ee69cd tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:34.206349 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4303443d-1362-4b98-8dac-0bfae6ee69cd tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:34.206949 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4303443d-1362-4b98-8dac-0bfae6ee69cd tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:34.442790 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4303443d-1362-4b98-8dac-0bfae6ee69cd tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:34.471308 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4303443d-1362-4b98-8dac-0bfae6ee69cd tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396" status: 200 len: 1506 microversion: 2.1 time: 0.272175 Jun 10 18:09:34.474143 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1749/3599] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:34 2022] GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396 => generated 1506 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:34.484759 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-43e33936-cdf4-49e8-9e4d-40cef97bea9c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:34.485383 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-43e33936-cdf4-49e8-9e4d-40cef97bea9c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:34.507398 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-43e33936-cdf4-49e8-9e4d-40cef97bea9c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:34.507880 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-43e33936-cdf4-49e8-9e4d-40cef97bea9c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:34.508709 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-43e33936-cdf4-49e8-9e4d-40cef97bea9c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:34.509149 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-43e33936-cdf4-49e8-9e4d-40cef97bea9c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:34.813142 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-43e33936-cdf4-49e8-9e4d-40cef97bea9c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:34.822559 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:09:34.851004 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-43e33936-cdf4-49e8-9e4d-40cef97bea9c tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1674 microversion: 2.1 time: 0.362062 Jun 10 18:09:34.877313 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1750/3600] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:34 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1674 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:34.913933 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-72540317-3aba-4ca9-84a1-5fe71b12d292 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:34.914770 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-72540317-3aba-4ca9-84a1-5fe71b12d292 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] [instance: a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:35.087356 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-72540317-3aba-4ca9-84a1-5fe71b12d292 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:35.108415 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-72540317-3aba-4ca9-84a1-5fe71b12d292 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:35.109652 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-72540317-3aba-4ca9-84a1-5fe71b12d292 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:35.110828 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-72540317-3aba-4ca9-84a1-5fe71b12d292 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] 10.222.0.35 "GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9" status: 200 len: 1278 microversion: 2.57 time: 0.232409 Jun 10 18:09:35.111649 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1751/3601] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:09:34 2022] GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9 => generated 1278 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:09:35.140775 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-977d0d0f-174a-4c8e-bace-05762d904b50 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:35.142710 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-977d0d0f-174a-4c8e-bace-05762d904b50 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: db7ba61a-bb40-4246-91fb-426ccc9da491] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:35.153342 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-977d0d0f-174a-4c8e-bace-05762d904b50 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:35.161110 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-977d0d0f-174a-4c8e-bace-05762d904b50 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:35.162495 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-977d0d0f-174a-4c8e-bace-05762d904b50 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:35.163243 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-977d0d0f-174a-4c8e-bace-05762d904b50 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:35.420493 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-977d0d0f-174a-4c8e-bace-05762d904b50 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:35.429543 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-977d0d0f-174a-4c8e-bace-05762d904b50 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491" status: 200 len: 1315 microversion: 2.1 time: 0.310719 Jun 10 18:09:35.430150 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1752/3602] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:35 2022] GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491 => generated 1315 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:35.434868 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0fdb6f1e-4e02-47c4-9d6c-27bc6024a178 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:35.435510 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0fdb6f1e-4e02-47c4-9d6c-27bc6024a178 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] [instance: 4f169350-57ce-4ea3-bfca-ccf6f1957aa9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:35.441599 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0fdb6f1e-4e02-47c4-9d6c-27bc6024a178 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:35.442048 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0fdb6f1e-4e02-47c4-9d6c-27bc6024a178 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:35.442809 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0fdb6f1e-4e02-47c4-9d6c-27bc6024a178 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:35.443413 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0fdb6f1e-4e02-47c4-9d6c-27bc6024a178 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:35.553483 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0fdb6f1e-4e02-47c4-9d6c-27bc6024a178 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f463dd5d9140ecb29e0daa415331a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c384e1bab854ad8b4c2ae9ab895cd88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:35.567516 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0fdb6f1e-4e02-47c4-9d6c-27bc6024a178 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] 10.222.0.35 "GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9" status: 200 len: 1253 microversion: 2.1 time: 0.136093 Jun 10 18:09:35.579783 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1753/3603] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:35 2022] GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9 => generated 1253 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:35.589364 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-3b8f4362-b979-417b-b459-2dcd3aafe137 req-8fb1aa4a-33e3-44f3-9bd0-5f3567de0400 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "186b67b3-3538-4bc2-8528-53b43d701bf1", "name": "network-vif-deleted", "tag": "128ee4eb-e784-41c8-acaa-39291810b2a4"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:35.597812 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-3b8f4362-b979-417b-b459-2dcd3aafe137 req-8fb1aa4a-33e3-44f3-9bd0-5f3567de0400 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:35.598271 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-3b8f4362-b979-417b-b459-2dcd3aafe137 req-8fb1aa4a-33e3-44f3-9bd0-5f3567de0400 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:35.611092 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-3b8f4362-b979-417b-b459-2dcd3aafe137 req-8fb1aa4a-33e3-44f3-9bd0-5f3567de0400 service nova] Creating event network-vif-deleted:128ee4eb-e784-41c8-acaa-39291810b2a4 for instance 186b67b3-3538-4bc2-8528-53b43d701bf1 on chh1-master-2 Jun 10 18:09:35.616049 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-3b8f4362-b979-417b-b459-2dcd3aafe137 req-8fb1aa4a-33e3-44f3-9bd0-5f3567de0400 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034886 Jun 10 18:09:35.620203 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1754/3604] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:09:35.626283 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4728c8ef-f093-4a8b-95a3-a0a1f927fe16 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:35.629379 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4728c8ef-f093-4a8b-95a3-a0a1f927fe16 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: cd20ed09-0a67-4b14-881f-2977acd23396] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:35.633989 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4728c8ef-f093-4a8b-95a3-a0a1f927fe16 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:35.634454 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4728c8ef-f093-4a8b-95a3-a0a1f927fe16 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:35.635240 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4728c8ef-f093-4a8b-95a3-a0a1f927fe16 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:35.635687 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4728c8ef-f093-4a8b-95a3-a0a1f927fe16 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:35.813580 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4728c8ef-f093-4a8b-95a3-a0a1f927fe16 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:35.822159 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4728c8ef-f093-4a8b-95a3-a0a1f927fe16 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396" status: 200 len: 1506 microversion: 2.1 time: 0.200628 Jun 10 18:09:35.838098 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1755/3605] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:35 2022] GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396 => generated 1506 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:35.876014 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-56c25fd0-1c24-4404-9900-cffc11cffe11 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:35.876745 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-56c25fd0-1c24-4404-9900-cffc11cffe11 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:35.883898 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-56c25fd0-1c24-4404-9900-cffc11cffe11 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:35.884607 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-56c25fd0-1c24-4404-9900-cffc11cffe11 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:35.885457 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-56c25fd0-1c24-4404-9900-cffc11cffe11 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:35.885860 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-56c25fd0-1c24-4404-9900-cffc11cffe11 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:35.928085 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-56c25fd0-1c24-4404-9900-cffc11cffe11 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:35.928577 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-56c25fd0-1c24-4404-9900-cffc11cffe11 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:35.929022 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-56c25fd0-1c24-4404-9900-cffc11cffe11 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lazy-loading 'fault' on Instance uuid 186b67b3-3538-4bc2-8528-53b43d701bf1 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:09:35.970513 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-56c25fd0-1c24-4404-9900-cffc11cffe11 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352e7f5de76c42da9241721fe0f0bf86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b34cb51c168497088d66fa0e507e364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:35.978586 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-56c25fd0-1c24-4404-9900-cffc11cffe11 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 200 len: 1328 microversion: 2.1 time: 0.112774 Jun 10 18:09:35.979761 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1756/3606] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:35 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 1328 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:09:36.135275 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d642f517-6e49-45bd-b475-2273bd4e2c13 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:36.136548 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d642f517-6e49-45bd-b475-2273bd4e2c13 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] [instance: a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:36.143113 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d642f517-6e49-45bd-b475-2273bd4e2c13 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:36.143558 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d642f517-6e49-45bd-b475-2273bd4e2c13 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:36.144404 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d642f517-6e49-45bd-b475-2273bd4e2c13 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:36.144849 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d642f517-6e49-45bd-b475-2273bd4e2c13 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:36.273942 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d642f517-6e49-45bd-b475-2273bd4e2c13 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:36.283259 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d642f517-6e49-45bd-b475-2273bd4e2c13 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:36.289444 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d642f517-6e49-45bd-b475-2273bd4e2c13 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:36.290748 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d642f517-6e49-45bd-b475-2273bd4e2c13 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] 10.222.0.35 "GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9" status: 200 len: 1274 microversion: 2.57 time: 0.162113 Jun 10 18:09:36.291408 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1757/3607] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:09:36 2022] GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9 => generated 1274 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:09:36.450555 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fb0b45fd-6661-4197-8742-45ef5ed4d644 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:36.451523 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fb0b45fd-6661-4197-8742-45ef5ed4d644 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: db7ba61a-bb40-4246-91fb-426ccc9da491] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:36.473444 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fb0b45fd-6661-4197-8742-45ef5ed4d644 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:36.477854 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fb0b45fd-6661-4197-8742-45ef5ed4d644 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:36.479311 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fb0b45fd-6661-4197-8742-45ef5ed4d644 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:36.479938 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fb0b45fd-6661-4197-8742-45ef5ed4d644 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:36.544182 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7aa7a5ee-e9ca-4e61-b68a-5e04abf2258f tempest-FloatingIPDetailsTestJSON-1740843904 tempest-FloatingIPDetailsTestJSON-1740843904-project] 10.222.0.35 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.740550 Jun 10 18:09:36.546904 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1851/3608] 10.222.0.35 () {60 vars in 1169 bytes} [Fri Jun 10 18:09:33 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2744 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:09:36.558885 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cc01a655-51a2-43b8-8e9f-0ad4ceb48301 tempest-FloatingIPDetailsTestJSON-1740843904 tempest-FloatingIPDetailsTestJSON-1740843904-project] Calling method '.version_select at 0x7f77c60e2a60>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:36.806629 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fb0b45fd-6661-4197-8742-45ef5ed4d644 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:36.814529 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fb0b45fd-6661-4197-8742-45ef5ed4d644 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491" status: 200 len: 1502 microversion: 2.1 time: 0.368772 Jun 10 18:09:36.816142 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1758/3609] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:36 2022] GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491 => generated 1502 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:09:36.826585 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8aa5ef66-53f4-417d-a39e-ae0db61a9515 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:36.832836 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8aa5ef66-53f4-417d-a39e-ae0db61a9515 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] [instance: 4f169350-57ce-4ea3-bfca-ccf6f1957aa9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:36.849819 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8aa5ef66-53f4-417d-a39e-ae0db61a9515 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:36.853051 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8aa5ef66-53f4-417d-a39e-ae0db61a9515 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:36.860849 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cc01a655-51a2-43b8-8e9f-0ad4ceb48301 tempest-FloatingIPDetailsTestJSON-1740843904 tempest-FloatingIPDetailsTestJSON-1740843904-project] 10.222.0.35 "GET /compute/v2.1/os-floating-ips/a253c590-5839-4727-ae74-5ce73e193a88" status: 200 len: 142 microversion: 2.1 time: 0.305721 Jun 10 18:09:36.861715 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1852/3610] 10.222.0.35 () {58 vars in 1259 bytes} [Fri Jun 10 18:09:36 2022] GET /compute/v2.1/os-floating-ips/a253c590-5839-4727-ae74-5ce73e193a88 => generated 142 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:09:36.863040 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8aa5ef66-53f4-417d-a39e-ae0db61a9515 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:36.863461 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8aa5ef66-53f4-417d-a39e-ae0db61a9515 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:36.883988 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-803fa534-3c11-4f65-9fda-7a93a150b661 req-64f3e466-c996-41b1-a34f-31ecd6ce5801 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd20ed09-0a67-4b14-881f-2977acd23396", "name": "network-vif-plugged", "status": "completed", "tag": "01f956de-a6b2-4cd1-9d96-7f5e4524b19c"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:36.907538 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-803fa534-3c11-4f65-9fda-7a93a150b661 req-64f3e466-c996-41b1-a34f-31ecd6ce5801 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:36.908583 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-803fa534-3c11-4f65-9fda-7a93a150b661 req-64f3e466-c996-41b1-a34f-31ecd6ce5801 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:36.913660 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8aa5ef66-53f4-417d-a39e-ae0db61a9515 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:36.914134 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8aa5ef66-53f4-417d-a39e-ae0db61a9515 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:36.914610 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-8aa5ef66-53f4-417d-a39e-ae0db61a9515 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lazy-loading 'fault' on Instance uuid 4f169350-57ce-4ea3-bfca-ccf6f1957aa9 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:09:36.922136 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-803fa534-3c11-4f65-9fda-7a93a150b661 req-64f3e466-c996-41b1-a34f-31ecd6ce5801 service nova] Creating event network-vif-plugged:01f956de-a6b2-4cd1-9d96-7f5e4524b19c for instance cd20ed09-0a67-4b14-881f-2977acd23396 on chh2-master-2 Jun 10 18:09:36.929250 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-803fa534-3c11-4f65-9fda-7a93a150b661 req-64f3e466-c996-41b1-a34f-31ecd6ce5801 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065324 Jun 10 18:09:36.930923 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1853/3611] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:09:36.943174 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-04c42886-52f2-43e8-b28c-cee7a045bb68 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:36.944281 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-04c42886-52f2-43e8-b28c-cee7a045bb68 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: db7ba61a-bb40-4246-91fb-426ccc9da491] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:36.955267 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-04c42886-52f2-43e8-b28c-cee7a045bb68 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:36.956263 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-04c42886-52f2-43e8-b28c-cee7a045bb68 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:36.958720 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-04c42886-52f2-43e8-b28c-cee7a045bb68 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:36.959720 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-04c42886-52f2-43e8-b28c-cee7a045bb68 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:36.975999 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8aa5ef66-53f4-417d-a39e-ae0db61a9515 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f463dd5d9140ecb29e0daa415331a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c384e1bab854ad8b4c2ae9ab895cd88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:36.983888 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8aa5ef66-53f4-417d-a39e-ae0db61a9515 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] 10.222.0.35 "GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9" status: 200 len: 1258 microversion: 2.1 time: 0.166522 Jun 10 18:09:36.985383 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1759/3612] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:36 2022] GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9 => generated 1258 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:36.991770 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1d3e83bc-674d-4bb1-917c-ab8c7b9ccf9f tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:36.992437 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1d3e83bc-674d-4bb1-917c-ab8c7b9ccf9f tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: cd20ed09-0a67-4b14-881f-2977acd23396] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:36.999635 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d3e83bc-674d-4bb1-917c-ab8c7b9ccf9f tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:36.999635 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d3e83bc-674d-4bb1-917c-ab8c7b9ccf9f tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:37.000390 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d3e83bc-674d-4bb1-917c-ab8c7b9ccf9f tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:37.001956 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d3e83bc-674d-4bb1-917c-ab8c7b9ccf9f tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:37.190803 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1d3e83bc-674d-4bb1-917c-ab8c7b9ccf9f tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:37.196161 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1d3e83bc-674d-4bb1-917c-ab8c7b9ccf9f tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396" status: 200 len: 1506 microversion: 2.1 time: 0.209703 Jun 10 18:09:37.197018 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1760/3613] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:36 2022] GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396 => generated 1506 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:37.202836 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3d033499-0697-4566-b1d8-90d310b6cea4 tempest-FloatingIPDetailsTestJSON-1740843904 tempest-FloatingIPDetailsTestJSON-1740843904-project] Calling method '.version_select at 0x7f77c02d24c0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:37.237306 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-04c42886-52f2-43e8-b28c-cee7a045bb68 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "POST /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491/action" status: 202 len: 0 microversion: 2.1 time: 0.304782 Jun 10 18:09:37.238742 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1854/3614] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:09:36 2022] POST /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:09:37.251207 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ee463c6e-c09a-4448-abe4-6eb8050120f5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:37.252388 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ee463c6e-c09a-4448-abe4-6eb8050120f5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] [instance: 186b67b3-3538-4bc2-8528-53b43d701bf1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:37.267110 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ee463c6e-c09a-4448-abe4-6eb8050120f5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:37.270723 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ee463c6e-c09a-4448-abe4-6eb8050120f5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:37.272210 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ee463c6e-c09a-4448-abe4-6eb8050120f5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:37.273694 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ee463c6e-c09a-4448-abe4-6eb8050120f5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:37.296325 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-ee463c6e-c09a-4448-abe4-6eb8050120f5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] HTTP exception thrown: Instance 186b67b3-3538-4bc2-8528-53b43d701bf1 could not be found. Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ee463c6e-c09a-4448-abe4-6eb8050120f5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Request method failure captured: Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 HTTP/1.1 Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4bjYRjdJJInCzu3PVxYJsfBkminC6Ikt7M75i6Sx-ogiu0g-ClcDk6pe5ZbprSFn2IZnkupAGWwRhhyzLuF9eMcuLH1bKi15cgeBj7qi81gCxtLZj7Eo_sXXfXIhz0vAnCNJVtg10TQ8DAW2pxp6y_-W-5vyky7ezDgXd3Gl7vJQCo Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 2b34cb51c168497088d66fa0e507e364 Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServerActionsTestJSON-197909573 Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/2b34cb51c168497088d66fa0e507e364"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2b34cb51c168497088d66fa0e507e364"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2b34cb51c168497088d66fa0e507e364"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_2b34cb51c168497088d66fa0e507e364", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServerActionsTestJSON-197909573 Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 2b34cb51c168497088d66fa0e507e364 Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServerActionsTestJSON-197909573 Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServerActionsTestJSON-197909573-project Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 352e7f5de76c42da9241721fe0f0bf86 Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServerActionsTestJSON-197909573-project Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 186b67b3-3538-4bc2-8528-53b43d701bf1 could not be found. Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '186b67b3-3538-4bc2-8528-53b43d701bf1'} Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 186b67b3-3538-4bc2-8528-53b43d701bf1 could not be found. Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 186b67b3-3538-4bc2-8528-53b43d701bf1 could not be found. Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:37.298367 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:37.302902 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:37.302902 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:37.302902 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:37.302902 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:09:37.302902 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:09:37.302902 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 186b67b3-3538-4bc2-8528-53b43d701bf1 could not be found. Jun 10 18:09:37.302902 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:37.302902 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ee463c6e-c09a-4448-abe4-6eb8050120f5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Returning 404 to user: Instance 186b67b3-3538-4bc2-8528-53b43d701bf1 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:09:37.306251 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ee463c6e-c09a-4448-abe4-6eb8050120f5 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1" status: 404 len: 111 microversion: 2.1 time: 0.065977 Jun 10 18:09:37.311033 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1855/3615] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:37 2022] GET /compute/v2.1/servers/186b67b3-3538-4bc2-8528-53b43d701bf1 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:09:37.316889 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3a62fdf4-976f-43a7-9030-aacceb2fc721 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:37.320844 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3a62fdf4-976f-43a7-9030-aacceb2fc721 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: db7ba61a-bb40-4246-91fb-426ccc9da491] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:37.329983 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3a62fdf4-976f-43a7-9030-aacceb2fc721 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:37.330740 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3a62fdf4-976f-43a7-9030-aacceb2fc721 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:37.332383 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3a62fdf4-976f-43a7-9030-aacceb2fc721 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:37.332831 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3a62fdf4-976f-43a7-9030-aacceb2fc721 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:37.493670 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3a62fdf4-976f-43a7-9030-aacceb2fc721 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:37.512341 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3a62fdf4-976f-43a7-9030-aacceb2fc721 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491" status: 200 len: 1507 microversion: 2.1 time: 0.199875 Jun 10 18:09:37.523433 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1856/3616] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:37 2022] GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491 => generated 1507 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:37.529778 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4098db35-fc53-454a-a5ea-b8b8752aaab6 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:37.530859 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4098db35-fc53-454a-a5ea-b8b8752aaab6 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] [instance: a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:37.551423 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4098db35-fc53-454a-a5ea-b8b8752aaab6 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:37.552038 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4098db35-fc53-454a-a5ea-b8b8752aaab6 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:37.555857 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4098db35-fc53-454a-a5ea-b8b8752aaab6 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:37.556337 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4098db35-fc53-454a-a5ea-b8b8752aaab6 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:37.635827 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4098db35-fc53-454a-a5ea-b8b8752aaab6 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:37.648517 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4098db35-fc53-454a-a5ea-b8b8752aaab6 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:37.664129 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4098db35-fc53-454a-a5ea-b8b8752aaab6 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:37.664129 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4098db35-fc53-454a-a5ea-b8b8752aaab6 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] 10.222.0.35 "GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9" status: 200 len: 1348 microversion: 2.57 time: 0.127035 Jun 10 18:09:37.664563 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1857/3617] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:09:37 2022] GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9 => generated 1348 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:09:37.670273 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-800f02d0-4f5a-4af0-9bf5-654a1cc5f753 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] Calling method '.version_select at 0x7f77c60e21f0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:37.785285 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-800f02d0-4f5a-4af0-9bf5-654a1cc5f753 tempest-ServerActionsTestJSON-197909573 tempest-ServerActionsTestJSON-197909573-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1972248464" status: 202 len: 0 microversion: 2.1 time: 0.119139 Jun 10 18:09:37.790486 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1858/3618] 10.222.0.35 () {58 vars in 1220 bytes} [Fri Jun 10 18:09:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1972248464 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:09:38.004325 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ecad2fe1-8aad-48d5-8731-b3c0fb933f37 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:38.005445 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ecad2fe1-8aad-48d5-8731-b3c0fb933f37 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] [instance: 4f169350-57ce-4ea3-bfca-ccf6f1957aa9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:38.013775 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ecad2fe1-8aad-48d5-8731-b3c0fb933f37 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:38.014513 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ecad2fe1-8aad-48d5-8731-b3c0fb933f37 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:38.015695 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ecad2fe1-8aad-48d5-8731-b3c0fb933f37 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:38.016411 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ecad2fe1-8aad-48d5-8731-b3c0fb933f37 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:38.042261 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-ecad2fe1-8aad-48d5-8731-b3c0fb933f37 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] HTTP exception thrown: Instance 4f169350-57ce-4ea3-bfca-ccf6f1957aa9 could not be found. Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ecad2fe1-8aad-48d5-8731-b3c0fb933f37 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Request method failure captured: Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9 HTTP/1.1 Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4guQSF8is-2wo_Ogs6HjkeXm1PtkyTzqTTH5QOgJY2tGGuI1i9Q3mRqR215XSuLk_FeQYGxNH-kqTfyDGqyuMGYXTplrFVQ5tPluB7t-MqTsRpQLjft69OIA2EFm1T8xXWFRBQdY9KHyad5dysqtGzgmtx2TcgxUY_s7v1BrJR9qbg Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 3c384e1bab854ad8b4c2ae9ab895cd88 Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersTestBootFromVolume-6050166 Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/3c384e1bab854ad8b4c2ae9ab895cd88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3c384e1bab854ad8b4c2ae9ab895cd88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3c384e1bab854ad8b4c2ae9ab895cd88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_3c384e1bab854ad8b4c2ae9ab895cd88", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersTestBootFromVolume-6050166 Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 3c384e1bab854ad8b4c2ae9ab895cd88 Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersTestBootFromVolume-6050166 Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersTestBootFromVolume-6050166-project Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 41f463dd5d9140ecb29e0daa415331a9 Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersTestBootFromVolume-6050166-project Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 4f169350-57ce-4ea3-bfca-ccf6f1957aa9 could not be found. Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '4f169350-57ce-4ea3-bfca-ccf6f1957aa9'} Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f169350-57ce-4ea3-bfca-ccf6f1957aa9 could not be found. Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f169350-57ce-4ea3-bfca-ccf6f1957aa9 could not be found. Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:38.044163 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:38.050332 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:38.050332 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:38.050332 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:38.050332 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:09:38.050332 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:09:38.050332 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f169350-57ce-4ea3-bfca-ccf6f1957aa9 could not be found. Jun 10 18:09:38.050332 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:38.050332 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ecad2fe1-8aad-48d5-8731-b3c0fb933f37 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Returning 404 to user: Instance 4f169350-57ce-4ea3-bfca-ccf6f1957aa9 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:09:38.050332 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ecad2fe1-8aad-48d5-8731-b3c0fb933f37 tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] 10.222.0.35 "GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9" status: 404 len: 111 microversion: 2.1 time: 0.046394 Jun 10 18:09:38.050332 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1859/3619] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:37 2022] GET /compute/v2.1/servers/4f169350-57ce-4ea3-bfca-ccf6f1957aa9 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:09:38.068297 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f0b92a50-f0fd-402a-9988-8e8bacea38fe tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] Calling method '.version_select at 0x7f77c60c6a60>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:38.171850 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f0b92a50-f0fd-402a-9988-8e8bacea38fe tempest-ServersTestBootFromVolume-6050166 tempest-ServersTestBootFromVolume-6050166-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1258135869" status: 202 len: 0 microversion: 2.1 time: 0.117712 Jun 10 18:09:38.172406 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1860/3620] 10.222.0.35 () {58 vars in 1220 bytes} [Fri Jun 10 18:09:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1258135869 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:09:38.221172 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a574e7a4-cc2a-49c7-9554-b219069d62b6 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:38.222011 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a574e7a4-cc2a-49c7-9554-b219069d62b6 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: cd20ed09-0a67-4b14-881f-2977acd23396] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:38.229481 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a574e7a4-cc2a-49c7-9554-b219069d62b6 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:38.230310 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a574e7a4-cc2a-49c7-9554-b219069d62b6 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:38.231381 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a574e7a4-cc2a-49c7-9554-b219069d62b6 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:38.231997 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a574e7a4-cc2a-49c7-9554-b219069d62b6 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:38.363158 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3d033499-0697-4566-b1d8-90d310b6cea4 tempest-FloatingIPDetailsTestJSON-1740843904 tempest-FloatingIPDetailsTestJSON-1740843904-project] 10.222.0.35 "DELETE /compute/v2.1/os-floating-ips/a253c590-5839-4727-ae74-5ce73e193a88" status: 202 len: 0 microversion: 2.1 time: 1.164562 Jun 10 18:09:38.364094 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1761/3621] 10.222.0.35 () {58 vars in 1262 bytes} [Fri Jun 10 18:09:37 2022] DELETE /compute/v2.1/os-floating-ips/a253c590-5839-4727-ae74-5ce73e193a88 => generated 0 bytes in 1166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:09:38.374565 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-208bb78a-1652-4928-851b-c49a1b474ead tempest-FloatingIPDetailsTestJSON-1740843904 tempest-FloatingIPDetailsTestJSON-1740843904-project] Calling method '.version_select at 0x7f77c613e280>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:38.470260 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a574e7a4-cc2a-49c7-9554-b219069d62b6 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:38.496832 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a574e7a4-cc2a-49c7-9554-b219069d62b6 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396" status: 200 len: 1506 microversion: 2.1 time: 0.285236 Jun 10 18:09:38.498801 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1861/3622] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:38 2022] GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396 => generated 1506 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:38.532661 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b72a8e39-54a7-4aa9-a791-e17424b08120 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:38.533717 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b72a8e39-54a7-4aa9-a791-e17424b08120 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: db7ba61a-bb40-4246-91fb-426ccc9da491] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:38.546404 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b72a8e39-54a7-4aa9-a791-e17424b08120 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:38.546971 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b72a8e39-54a7-4aa9-a791-e17424b08120 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:38.547863 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b72a8e39-54a7-4aa9-a791-e17424b08120 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:38.548439 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b72a8e39-54a7-4aa9-a791-e17424b08120 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:38.691163 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-208bb78a-1652-4928-851b-c49a1b474ead tempest-FloatingIPDetailsTestJSON-1740843904 tempest-FloatingIPDetailsTestJSON-1740843904-project] 10.222.0.35 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.314649 Jun 10 18:09:38.691163 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1762/3623] 10.222.0.35 () {58 vars in 1163 bytes} [Fri Jun 10 18:09:38 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:09:38.708580 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d5d950b9-e434-48bb-9304-0706215cc269 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:38.710042 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d5d950b9-e434-48bb-9304-0706215cc269 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] [instance: a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:38.732536 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d5d950b9-e434-48bb-9304-0706215cc269 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:38.733028 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d5d950b9-e434-48bb-9304-0706215cc269 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:38.738638 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d5d950b9-e434-48bb-9304-0706215cc269 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:38.738638 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d5d950b9-e434-48bb-9304-0706215cc269 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:38.867288 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d5d950b9-e434-48bb-9304-0706215cc269 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:38.880233 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d5d950b9-e434-48bb-9304-0706215cc269 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:38.882664 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d5d950b9-e434-48bb-9304-0706215cc269 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:38.885612 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d5d950b9-e434-48bb-9304-0706215cc269 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] 10.222.0.35 "GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9" status: 200 len: 1336 microversion: 2.57 time: 0.192352 Jun 10 18:09:38.901437 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1763/3624] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:09:38 2022] GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9 => generated 1336 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:09:38.914927 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1b33d1de-f923-4f81-99bc-e0f017bfdd5a tempest-FloatingIPDetailsTestJSON-1740843904 tempest-FloatingIPDetailsTestJSON-1740843904-project] Calling method '.version_select at 0x7f77c02251f0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:38.920190 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b72a8e39-54a7-4aa9-a791-e17424b08120 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:38.931419 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b72a8e39-54a7-4aa9-a791-e17424b08120 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491" status: 200 len: 1487 microversion: 2.1 time: 0.404452 Jun 10 18:09:38.934951 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1862/3625] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:38 2022] GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491 => generated 1487 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:38.948392 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6c1d25ef-a94c-486d-a27d-04d8ad5dd81c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:38.949051 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6c1d25ef-a94c-486d-a27d-04d8ad5dd81c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: db7ba61a-bb40-4246-91fb-426ccc9da491] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:38.956699 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6c1d25ef-a94c-486d-a27d-04d8ad5dd81c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:38.956876 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6c1d25ef-a94c-486d-a27d-04d8ad5dd81c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:38.957622 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6c1d25ef-a94c-486d-a27d-04d8ad5dd81c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:38.958070 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6c1d25ef-a94c-486d-a27d-04d8ad5dd81c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:38.993171 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6c1d25ef-a94c-486d-a27d-04d8ad5dd81c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: db7ba61a-bb40-4246-91fb-426ccc9da491] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:09:39.245901 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1b33d1de-f923-4f81-99bc-e0f017bfdd5a tempest-FloatingIPDetailsTestJSON-1740843904 tempest-FloatingIPDetailsTestJSON-1740843904-project] 10.222.0.35 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.338871 Jun 10 18:09:39.253941 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1764/3626] 10.222.0.35 () {58 vars in 1148 bytes} [Fri Jun 10 18:09:38 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:09:39.259141 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6123220e-719a-443a-867d-2b11b192b389 tempest-FloatingIPDetailsTestJSON-1740843904 tempest-FloatingIPDetailsTestJSON-1740843904-project] Calling method '.version_select at 0x7f77c03960d0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:39.343973 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6c1d25ef-a94c-486d-a27d-04d8ad5dd81c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "DELETE /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491" status: 204 len: 0 microversion: 2.1 time: 0.399372 Jun 10 18:09:39.345868 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1863/3627] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:09:38 2022] DELETE /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 18:09:39.354578 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-dede7422-7be9-40ba-b77c-5f058ad1e1a5 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:39.355534 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-dede7422-7be9-40ba-b77c-5f058ad1e1a5 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: db7ba61a-bb40-4246-91fb-426ccc9da491] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:39.363156 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dede7422-7be9-40ba-b77c-5f058ad1e1a5 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:39.363914 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dede7422-7be9-40ba-b77c-5f058ad1e1a5 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:39.365080 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dede7422-7be9-40ba-b77c-5f058ad1e1a5 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:39.365754 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dede7422-7be9-40ba-b77c-5f058ad1e1a5 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:39.912638 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-dede7422-7be9-40ba-b77c-5f058ad1e1a5 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:39.920879 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-dede7422-7be9-40ba-b77c-5f058ad1e1a5 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491" status: 200 len: 1493 microversion: 2.1 time: 0.570593 Jun 10 18:09:39.930486 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1864/3628] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:39 2022] GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491 => generated 1493 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:39.936116 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8c06c7f1-f656-475d-9c61-57df527d7f8e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:39.936776 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8c06c7f1-f656-475d-9c61-57df527d7f8e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: cd20ed09-0a67-4b14-881f-2977acd23396] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:39.944139 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8c06c7f1-f656-475d-9c61-57df527d7f8e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:39.944662 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8c06c7f1-f656-475d-9c61-57df527d7f8e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:39.945455 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8c06c7f1-f656-475d-9c61-57df527d7f8e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:39.945907 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8c06c7f1-f656-475d-9c61-57df527d7f8e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:40.327382 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8c06c7f1-f656-475d-9c61-57df527d7f8e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:40.338720 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8c06c7f1-f656-475d-9c61-57df527d7f8e tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396" status: 200 len: 1488 microversion: 2.1 time: 0.406407 Jun 10 18:09:40.341601 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1865/3629] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:39 2022] GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396 => generated 1488 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:40.358591 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-05c6875c-b960-4e95-b724-3bb8be3cd1ab tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:40.358591 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-05c6875c-b960-4e95-b724-3bb8be3cd1ab tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] [instance: a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:40.363730 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-05c6875c-b960-4e95-b724-3bb8be3cd1ab tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:40.368361 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-05c6875c-b960-4e95-b724-3bb8be3cd1ab tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:40.369547 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-05c6875c-b960-4e95-b724-3bb8be3cd1ab tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:40.370301 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-05c6875c-b960-4e95-b724-3bb8be3cd1ab tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:40.510977 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-05c6875c-b960-4e95-b724-3bb8be3cd1ab tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:40.520133 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-05c6875c-b960-4e95-b724-3bb8be3cd1ab tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:40.522178 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-05c6875c-b960-4e95-b724-3bb8be3cd1ab tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:40.524008 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-05c6875c-b960-4e95-b724-3bb8be3cd1ab tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] 10.222.0.35 "GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9" status: 200 len: 1336 microversion: 2.57 time: 0.181295 Jun 10 18:09:40.525126 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1866/3630] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:09:40 2022] GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9 => generated 1336 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:09:40.530522 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-59be5dbc-a6c9-4135-ac1c-4a1b53157550 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:40.531261 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-59be5dbc-a6c9-4135-ac1c-4a1b53157550 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: cd20ed09-0a67-4b14-881f-2977acd23396] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:40.539030 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-59be5dbc-a6c9-4135-ac1c-4a1b53157550 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:40.539807 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-59be5dbc-a6c9-4135-ac1c-4a1b53157550 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:40.540871 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-59be5dbc-a6c9-4135-ac1c-4a1b53157550 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:40.541671 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-59be5dbc-a6c9-4135-ac1c-4a1b53157550 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:40.566537 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:09:40.572487 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-59be5dbc-a6c9-4135-ac1c-4a1b53157550 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: cd20ed09-0a67-4b14-881f-2977acd23396] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:09:40.727233 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6123220e-719a-443a-867d-2b11b192b389 tempest-FloatingIPDetailsTestJSON-1740843904 tempest-FloatingIPDetailsTestJSON-1740843904-project] 10.222.0.35 "DELETE /compute/v2.1/os-floating-ips/2f89e8f8-f4b7-4dfc-b782-304dbe70e01e" status: 202 len: 0 microversion: 2.1 time: 1.462553 Jun 10 18:09:40.727233 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1765/3631] 10.222.0.35 () {58 vars in 1262 bytes} [Fri Jun 10 18:09:39 2022] DELETE /compute/v2.1/os-floating-ips/2f89e8f8-f4b7-4dfc-b782-304dbe70e01e => generated 0 bytes in 1468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:09:40.736685 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4880e6de-08c2-4e88-8138-a051d21a69aa tempest-FloatingIPDetailsTestJSON-1740843904 tempest-FloatingIPDetailsTestJSON-1740843904-project] Calling method '.version_select at 0x7f77c0225790>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:41.006109 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-59be5dbc-a6c9-4135-ac1c-4a1b53157550 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "DELETE /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396" status: 204 len: 0 microversion: 2.1 time: 0.479542 Jun 10 18:09:41.011304 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1867/3632] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:09:40 2022] DELETE /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:09:41.017555 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2f8adee0-aad9-49e7-8909-dbcf16215a01 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:41.018280 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2f8adee0-aad9-49e7-8909-dbcf16215a01 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: db7ba61a-bb40-4246-91fb-426ccc9da491] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:41.034172 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2f8adee0-aad9-49e7-8909-dbcf16215a01 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:41.034638 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2f8adee0-aad9-49e7-8909-dbcf16215a01 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:41.035440 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2f8adee0-aad9-49e7-8909-dbcf16215a01 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:41.035884 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2f8adee0-aad9-49e7-8909-dbcf16215a01 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:41.440057 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2f8adee0-aad9-49e7-8909-dbcf16215a01 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:41.448125 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2f8adee0-aad9-49e7-8909-dbcf16215a01 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491" status: 200 len: 1493 microversion: 2.1 time: 0.439877 Jun 10 18:09:41.452823 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1868/3633] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:41 2022] GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491 => generated 1493 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:41.464062 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5370bdad-fdfb-49f1-b48e-44ce4cac9105 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c37d8670>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:41.523259 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-5370bdad-fdfb-49f1-b48e-44ce4cac9105 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] HTTP exception thrown: Image not found. Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5370bdad-fdfb-49f1-b48e-44ce4cac9105 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Request method failure captured: Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: request: DELETE /compute/v2.1/images/9a826550-1c1d-4c15-80fa-7ffe91868fba HTTP/1.1 Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4fpk-i12apG1VgsMUVwPtQpaZk13MV4SM6M42Og9sHaOGAl94RmFuulvShkHQAFyfvECSdOXF3YdT8WPuqdnEqM1w6kND66S76WDoal-aLGFad_z4ElOIqTs_7k98WN4aZzOrwcyGdKQ76TZzPeuu6jMsJIsXWmRGoci16cbKcHviU Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: af241982b5884c22b5e7103f1ea4b8ef Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ImagesTestJSON-58204800 Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/af241982b5884c22b5e7103f1ea4b8ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/af241982b5884c22b5e7103f1ea4b8ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/af241982b5884c22b5e7103f1ea4b8ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_af241982b5884c22b5e7103f1ea4b8ef", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ImagesTestJSON-58204800 Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: af241982b5884c22b5e7103f1ea4b8ef Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ImagesTestJSON-58204800 Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ImagesTestJSON-58204800-project Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 8adb0ac9df46461489fa6bd3951417cf Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ImagesTestJSON-58204800-project Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: exception: Image not found. Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '9a826550-1c1d-4c15-80fa-7ffe91868fba'} Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9a826550-1c1d-4c15-80fa-7ffe91868fba to delete Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9a826550-1c1d-4c15-80fa-7ffe91868fba could not be found. Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:41.527423 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:41.534381 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:41.534381 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:41.534381 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:09:41.534381 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:09:41.534381 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:09:41.534381 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:09:41.534381 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:09:41.534381 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:09:41.534381 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 10 18:09:41.534381 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 10 18:09:41.534381 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 10 18:09:41.534381 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:41.534381 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:41.534381 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:41.534381 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:41.534381 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:41.534381 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:41.534381 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:09:41.534381 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:09:41.534381 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 10 18:09:41.534381 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:41.534381 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5370bdad-fdfb-49f1-b48e-44ce4cac9105 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Returning 404 to user: Image not found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:09:41.534381 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5370bdad-fdfb-49f1-b48e-44ce4cac9105 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "DELETE /compute/v2.1/images/9a826550-1c1d-4c15-80fa-7ffe91868fba" status: 404 len: 62 microversion: 2.1 time: 0.071056 Jun 10 18:09:41.534381 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1869/3634] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:41 2022] DELETE /compute/v2.1/images/9a826550-1c1d-4c15-80fa-7ffe91868fba => generated 62 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:09:41.539297 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-79591e62-84a0-41dd-b8ec-5ce735125562 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:41.539449 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-79591e62-84a0-41dd-b8ec-5ce735125562 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: cd20ed09-0a67-4b14-881f-2977acd23396] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:41.549208 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-79591e62-84a0-41dd-b8ec-5ce735125562 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:41.550279 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-79591e62-84a0-41dd-b8ec-5ce735125562 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:41.551104 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-79591e62-84a0-41dd-b8ec-5ce735125562 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:41.551833 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-79591e62-84a0-41dd-b8ec-5ce735125562 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:41.587166 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-79591e62-84a0-41dd-b8ec-5ce735125562 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: cd20ed09-0a67-4b14-881f-2977acd23396] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:09:41.719521 chdv-master-2 devstack@n-api.service[126594]: INFO nova.compute.api [None req-79591e62-84a0-41dd-b8ec-5ce735125562 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: cd20ed09-0a67-4b14-881f-2977acd23396] Instance is already in deleting state, ignoring this request Jun 10 18:09:41.720600 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-79591e62-84a0-41dd-b8ec-5ce735125562 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "DELETE /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396" status: 204 len: 0 microversion: 2.1 time: 0.185786 Jun 10 18:09:41.724198 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1870/3635] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:09:41 2022] DELETE /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:09:41.729798 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-33f558c9-afed-4375-aa0b-051e4cd975f3 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:41.730549 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-33f558c9-afed-4375-aa0b-051e4cd975f3 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] [instance: a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:41.743558 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-33f558c9-afed-4375-aa0b-051e4cd975f3 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:41.743558 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-33f558c9-afed-4375-aa0b-051e4cd975f3 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:41.743558 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-33f558c9-afed-4375-aa0b-051e4cd975f3 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:41.743558 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-33f558c9-afed-4375-aa0b-051e4cd975f3 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:41.842529 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-33f558c9-afed-4375-aa0b-051e4cd975f3 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:41.855593 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-33f558c9-afed-4375-aa0b-051e4cd975f3 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:41.858014 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-33f558c9-afed-4375-aa0b-051e4cd975f3 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:41.859646 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-33f558c9-afed-4375-aa0b-051e4cd975f3 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] 10.222.0.35 "GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9" status: 200 len: 1357 microversion: 2.57 time: 0.134063 Jun 10 18:09:41.876381 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1871/3636] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:09:41 2022] GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:09:41.883090 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-779123fb-c71a-4426-9e1c-16a80c522a7c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:41.886813 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-779123fb-c71a-4426-9e1c-16a80c522a7c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: cd20ed09-0a67-4b14-881f-2977acd23396] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:41.893140 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-779123fb-c71a-4426-9e1c-16a80c522a7c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:41.893918 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-779123fb-c71a-4426-9e1c-16a80c522a7c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:41.894921 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-779123fb-c71a-4426-9e1c-16a80c522a7c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:41.895568 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-779123fb-c71a-4426-9e1c-16a80c522a7c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:42.057078 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-779123fb-c71a-4426-9e1c-16a80c522a7c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:42.067956 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-779123fb-c71a-4426-9e1c-16a80c522a7c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396" status: 200 len: 1494 microversion: 2.1 time: 0.190035 Jun 10 18:09:42.068576 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1872/3637] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:41 2022] GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396 => generated 1494 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:42.075085 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e8754765-bad8-41e3-9951-e797fb934edf tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:42.078619 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e8754765-bad8-41e3-9951-e797fb934edf tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] [instance: a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:42.087771 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e8754765-bad8-41e3-9951-e797fb934edf tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:42.088589 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e8754765-bad8-41e3-9951-e797fb934edf tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:42.089827 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e8754765-bad8-41e3-9951-e797fb934edf tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:42.090471 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e8754765-bad8-41e3-9951-e797fb934edf tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:42.211641 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-e8754765-bad8-41e3-9951-e797fb934edf tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:09:42.212138 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-e8754765-bad8-41e3-9951-e797fb934edf tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:09:42.212769 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-e8754765-bad8-41e3-9951-e797fb934edf tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:09:42.213243 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-e8754765-bad8-41e3-9951-e797fb934edf tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:09:42.213729 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-e8754765-bad8-41e3-9951-e797fb934edf tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:09:42.521197 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e8754765-bad8-41e3-9951-e797fb934edf tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] [instance: a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:42.538043 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e8754765-bad8-41e3-9951-e797fb934edf tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:42.539969 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e8754765-bad8-41e3-9951-e797fb934edf tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:42.541686 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e8754765-bad8-41e3-9951-e797fb934edf tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:42.545205 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e8754765-bad8-41e3-9951-e797fb934edf tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:42.594787 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e8754765-bad8-41e3-9951-e797fb934edf tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] 10.222.0.35 "POST /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9/action" status: 202 len: 1138 microversion: 2.57 time: 0.524905 Jun 10 18:09:42.605445 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1873/3638] 10.222.0.35 () {62 vars in 1319 bytes} [Fri Jun 10 18:09:42 2022] POST /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9/action => generated 1138 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jun 10 18:09:42.612073 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2d02b8a7-f8ca-47a0-9922-bd8dc935848a tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:42.613034 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2d02b8a7-f8ca-47a0-9922-bd8dc935848a tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: db7ba61a-bb40-4246-91fb-426ccc9da491] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:42.619210 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2d02b8a7-f8ca-47a0-9922-bd8dc935848a tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:42.619670 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2d02b8a7-f8ca-47a0-9922-bd8dc935848a tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:42.620652 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2d02b8a7-f8ca-47a0-9922-bd8dc935848a tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:42.621543 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2d02b8a7-f8ca-47a0-9922-bd8dc935848a tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:42.725796 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2d02b8a7-f8ca-47a0-9922-bd8dc935848a tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:42.735583 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2d02b8a7-f8ca-47a0-9922-bd8dc935848a tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491" status: 200 len: 1451 microversion: 2.1 time: 0.128945 Jun 10 18:09:42.736348 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1874/3639] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:42 2022] GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491 => generated 1451 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:42.744963 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-36ec11b8-0a31-42c2-89c5-83bd34734ad3 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:42.744963 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-36ec11b8-0a31-42c2-89c5-83bd34734ad3 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] [instance: a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:42.745828 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:09:42.752068 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-36ec11b8-0a31-42c2-89c5-83bd34734ad3 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:42.752556 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-36ec11b8-0a31-42c2-89c5-83bd34734ad3 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:42.754166 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-36ec11b8-0a31-42c2-89c5-83bd34734ad3 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:42.754639 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-36ec11b8-0a31-42c2-89c5-83bd34734ad3 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:42.876801 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-36ec11b8-0a31-42c2-89c5-83bd34734ad3 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:42.893060 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-36ec11b8-0a31-42c2-89c5-83bd34734ad3 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:42.895152 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-36ec11b8-0a31-42c2-89c5-83bd34734ad3 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:42.897069 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-36ec11b8-0a31-42c2-89c5-83bd34734ad3 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] 10.222.0.35 "GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9" status: 200 len: 1366 microversion: 2.57 time: 0.159735 Jun 10 18:09:42.897842 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1875/3640] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:09:42 2022] GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:09:42.912998 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-c7d32548-3ec3-446d-ac4e-43173d98f18c req-69805632-ec95-4d61-8f2f-ac5c15f758e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd20ed09-0a67-4b14-881f-2977acd23396", "name": "network-vif-unplugged", "status": "completed", "tag": "01f956de-a6b2-4cd1-9d96-7f5e4524b19c"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:42.929808 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-c7d32548-3ec3-446d-ac4e-43173d98f18c req-69805632-ec95-4d61-8f2f-ac5c15f758e5 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:42.930275 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-c7d32548-3ec3-446d-ac4e-43173d98f18c req-69805632-ec95-4d61-8f2f-ac5c15f758e5 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:42.965667 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-c7d32548-3ec3-446d-ac4e-43173d98f18c req-69805632-ec95-4d61-8f2f-ac5c15f758e5 service nova] Creating event network-vif-unplugged:01f956de-a6b2-4cd1-9d96-7f5e4524b19c for instance cd20ed09-0a67-4b14-881f-2977acd23396 on chh2-master-2 Jun 10 18:09:42.982050 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-c7d32548-3ec3-446d-ac4e-43173d98f18c req-69805632-ec95-4d61-8f2f-ac5c15f758e5 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082705 Jun 10 18:09:42.982831 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1876/3641] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:09:43.088088 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7e369e76-c221-4c5f-88b3-25d24c8bf55c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:43.088828 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7e369e76-c221-4c5f-88b3-25d24c8bf55c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: cd20ed09-0a67-4b14-881f-2977acd23396] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:43.096391 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7e369e76-c221-4c5f-88b3-25d24c8bf55c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:43.097000 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7e369e76-c221-4c5f-88b3-25d24c8bf55c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:43.097962 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7e369e76-c221-4c5f-88b3-25d24c8bf55c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:43.098628 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7e369e76-c221-4c5f-88b3-25d24c8bf55c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:43.367414 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7e369e76-c221-4c5f-88b3-25d24c8bf55c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:43.379263 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7e369e76-c221-4c5f-88b3-25d24c8bf55c tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396" status: 200 len: 1494 microversion: 2.1 time: 0.296543 Jun 10 18:09:43.379853 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1877/3642] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:43 2022] GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396 => generated 1494 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:43.561309 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-b57c5591-02ea-4cb4-aa82-7dd8b64acb2d req-1f8f7a69-6bea-49e7-a102-69d14f3f337c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db7ba61a-bb40-4246-91fb-426ccc9da491", "name": "network-vif-deleted", "tag": "a933607b-850a-4fe8-8c3e-ada642644d94"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:43.573088 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-b57c5591-02ea-4cb4-aa82-7dd8b64acb2d req-1f8f7a69-6bea-49e7-a102-69d14f3f337c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:43.577112 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-b57c5591-02ea-4cb4-aa82-7dd8b64acb2d req-1f8f7a69-6bea-49e7-a102-69d14f3f337c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:43.585978 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:09:43.588870 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-b57c5591-02ea-4cb4-aa82-7dd8b64acb2d req-1f8f7a69-6bea-49e7-a102-69d14f3f337c service nova] Creating event network-vif-deleted:a933607b-850a-4fe8-8c3e-ada642644d94 for instance db7ba61a-bb40-4246-91fb-426ccc9da491 on chh1-master-2 Jun 10 18:09:43.595684 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-b57c5591-02ea-4cb4-aa82-7dd8b64acb2d req-1f8f7a69-6bea-49e7-a102-69d14f3f337c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042642 Jun 10 18:09:43.601987 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1878/3643] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:09:43.613397 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4880e6de-08c2-4e88-8138-a051d21a69aa tempest-FloatingIPDetailsTestJSON-1740843904 tempest-FloatingIPDetailsTestJSON-1740843904-project] 10.222.0.35 "DELETE /compute/v2.1/os-floating-ips/af0b967d-769c-4e7e-a727-9b72572a6425" status: 202 len: 0 microversion: 2.1 time: 2.884926 Jun 10 18:09:43.614929 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1766/3644] 10.222.0.35 () {58 vars in 1262 bytes} [Fri Jun 10 18:09:40 2022] DELETE /compute/v2.1/os-floating-ips/af0b967d-769c-4e7e-a727-9b72572a6425 => generated 0 bytes in 2888 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:09:43.623952 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0c1c45ef-85ec-4c99-9e26-8be92308234d tempest-FloatingIPDetailsTestJSON-1740843904 tempest-FloatingIPDetailsTestJSON-1740843904-project] Calling method '.version_select at 0x7f77c037a5e0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:43.630978 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=6 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:09:43.753041 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9a14012d-453a-4057-a25f-8878a2012b31 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:43.753904 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9a14012d-453a-4057-a25f-8878a2012b31 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: db7ba61a-bb40-4246-91fb-426ccc9da491] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:43.763046 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9a14012d-453a-4057-a25f-8878a2012b31 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:43.763859 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9a14012d-453a-4057-a25f-8878a2012b31 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:43.764829 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9a14012d-453a-4057-a25f-8878a2012b31 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:43.765970 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9a14012d-453a-4057-a25f-8878a2012b31 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:43.799654 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9a14012d-453a-4057-a25f-8878a2012b31 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:43.800106 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9a14012d-453a-4057-a25f-8878a2012b31 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:43.800755 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-9a14012d-453a-4057-a25f-8878a2012b31 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lazy-loading 'fault' on Instance uuid db7ba61a-bb40-4246-91fb-426ccc9da491 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:09:43.902229 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9a14012d-453a-4057-a25f-8878a2012b31 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:43.913917 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9a14012d-453a-4057-a25f-8878a2012b31 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491" status: 200 len: 1305 microversion: 2.1 time: 0.164507 Jun 10 18:09:43.916411 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1767/3645] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:43 2022] GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491 => generated 1305 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:43.928766 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-55df2299-123d-4bb3-89b3-d40d8856ed3c tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:43.929383 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-55df2299-123d-4bb3-89b3-d40d8856ed3c tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] [instance: a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:43.937414 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-55df2299-123d-4bb3-89b3-d40d8856ed3c tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:43.937871 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-55df2299-123d-4bb3-89b3-d40d8856ed3c tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:43.938653 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-55df2299-123d-4bb3-89b3-d40d8856ed3c tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:43.939095 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-55df2299-123d-4bb3-89b3-d40d8856ed3c tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:44.016815 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-55df2299-123d-4bb3-89b3-d40d8856ed3c tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:44.027099 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-55df2299-123d-4bb3-89b3-d40d8856ed3c tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:44.030109 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-55df2299-123d-4bb3-89b3-d40d8856ed3c tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:44.031674 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-55df2299-123d-4bb3-89b3-d40d8856ed3c tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] 10.222.0.35 "GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9" status: 200 len: 1366 microversion: 2.57 time: 0.114519 Jun 10 18:09:44.037716 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1768/3646] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:09:43 2022] GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9 => generated 1366 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:09:44.045558 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-849f640b-29bc-465e-96f7-381f86998653 req-d136b891-a7fe-4a29-8f0f-63f3fcd8faa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd20ed09-0a67-4b14-881f-2977acd23396", "name": "network-vif-deleted", "tag": "01f956de-a6b2-4cd1-9d96-7f5e4524b19c"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:44.054767 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-849f640b-29bc-465e-96f7-381f86998653 req-d136b891-a7fe-4a29-8f0f-63f3fcd8faa0 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:44.055222 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-849f640b-29bc-465e-96f7-381f86998653 req-d136b891-a7fe-4a29-8f0f-63f3fcd8faa0 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:44.077507 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-849f640b-29bc-465e-96f7-381f86998653 req-d136b891-a7fe-4a29-8f0f-63f3fcd8faa0 service nova] Creating event network-vif-deleted:01f956de-a6b2-4cd1-9d96-7f5e4524b19c for instance cd20ed09-0a67-4b14-881f-2977acd23396 on chh2-master-2 Jun 10 18:09:44.083289 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-849f640b-29bc-465e-96f7-381f86998653 req-d136b891-a7fe-4a29-8f0f-63f3fcd8faa0 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043959 Jun 10 18:09:44.084457 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1769/3647] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:09:44.398142 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f2e9eb46-a482-4958-bf80-d352d865ce5b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:44.399102 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f2e9eb46-a482-4958-bf80-d352d865ce5b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: cd20ed09-0a67-4b14-881f-2977acd23396] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:44.420023 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f2e9eb46-a482-4958-bf80-d352d865ce5b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:44.422775 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f2e9eb46-a482-4958-bf80-d352d865ce5b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:44.426818 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f2e9eb46-a482-4958-bf80-d352d865ce5b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:44.428278 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f2e9eb46-a482-4958-bf80-d352d865ce5b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:44.569454 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f2e9eb46-a482-4958-bf80-d352d865ce5b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:44.570139 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f2e9eb46-a482-4958-bf80-d352d865ce5b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:44.572472 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-f2e9eb46-a482-4958-bf80-d352d865ce5b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lazy-loading 'fault' on Instance uuid cd20ed09-0a67-4b14-881f-2977acd23396 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:09:44.683956 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f2e9eb46-a482-4958-bf80-d352d865ce5b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb0ac9df46461489fa6bd3951417cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af241982b5884c22b5e7103f1ea4b8ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:44.692970 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f2e9eb46-a482-4958-bf80-d352d865ce5b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396" status: 200 len: 1298 microversion: 2.1 time: 0.299161 Jun 10 18:09:44.694223 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1770/3648] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:44 2022] GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396 => generated 1298 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:44.935591 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-af91f9ae-8ca7-475e-a37d-268d1d23dc20 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:44.936653 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-af91f9ae-8ca7-475e-a37d-268d1d23dc20 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: db7ba61a-bb40-4246-91fb-426ccc9da491] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:44.945100 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-af91f9ae-8ca7-475e-a37d-268d1d23dc20 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:44.948034 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-af91f9ae-8ca7-475e-a37d-268d1d23dc20 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:44.951413 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-af91f9ae-8ca7-475e-a37d-268d1d23dc20 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:44.952231 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-af91f9ae-8ca7-475e-a37d-268d1d23dc20 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:44.953378 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0c1c45ef-85ec-4c99-9e26-8be92308234d tempest-FloatingIPDetailsTestJSON-1740843904 tempest-FloatingIPDetailsTestJSON-1740843904-project] 10.222.0.35 "DELETE /compute/v2.1/os-floating-ips/318fb72a-4f59-4b24-abbe-cec8b753cccd" status: 202 len: 0 microversion: 2.1 time: 1.334319 Jun 10 18:09:44.958481 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1879/3649] 10.222.0.35 () {58 vars in 1262 bytes} [Fri Jun 10 18:09:43 2022] DELETE /compute/v2.1/os-floating-ips/318fb72a-4f59-4b24-abbe-cec8b753cccd => generated 0 bytes in 1340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:09:44.976435 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-af91f9ae-8ca7-475e-a37d-268d1d23dc20 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] HTTP exception thrown: Instance db7ba61a-bb40-4246-91fb-426ccc9da491 could not be found. Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-af91f9ae-8ca7-475e-a37d-268d1d23dc20 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Request method failure captured: Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491 HTTP/1.1 Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4h5IGwn2s1svunn67FxK1RLA1ZXNP7yhKtLh1eaKFO5RiF1I7YeJHWcfSjdUGMBWYC3nFgfMdv1-bfem3ewEozYf-uHKxgVE7ziplyuJN8iPaP89LX8AXS1cyKZcnxByDcQMqTPs4bimJxM1lNaVEmx4VPDZsfMeZBdbBH4r5hYsr8 Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/457c4a300936498b9e8b61645e655751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "tempest-type-1142384015", "name": "tempest-service-1838487701", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_457c4a300936498b9e8b61645e655751", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 8166793f60ee479689b4a21457b71d07 Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: exception: Instance db7ba61a-bb40-4246-91fb-426ccc9da491 could not be found. Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'db7ba61a-bb40-4246-91fb-426ccc9da491'} Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db7ba61a-bb40-4246-91fb-426ccc9da491 could not be found. Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db7ba61a-bb40-4246-91fb-426ccc9da491 could not be found. Jun 10 18:09:44.978505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:44.984355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:44.984355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:44.984355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:44.984355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:44.984355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:44.984355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:09:44.984355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:09:44.984355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db7ba61a-bb40-4246-91fb-426ccc9da491 could not be found. Jun 10 18:09:44.984355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:44.984355 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-af91f9ae-8ca7-475e-a37d-268d1d23dc20 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Returning 404 to user: Instance db7ba61a-bb40-4246-91fb-426ccc9da491 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:09:44.984355 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-af91f9ae-8ca7-475e-a37d-268d1d23dc20 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491" status: 404 len: 111 microversion: 2.1 time: 0.052850 Jun 10 18:09:45.006899 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1771/3650] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:44 2022] GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:09:45.050916 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c0bdb0cc-318a-4679-b0f0-fc8dc18cbb12 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:45.051896 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c0bdb0cc-318a-4679-b0f0-fc8dc18cbb12 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] [instance: a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:45.066510 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c0bdb0cc-318a-4679-b0f0-fc8dc18cbb12 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:45.066970 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c0bdb0cc-318a-4679-b0f0-fc8dc18cbb12 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:45.071064 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c0bdb0cc-318a-4679-b0f0-fc8dc18cbb12 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:45.073415 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c0bdb0cc-318a-4679-b0f0-fc8dc18cbb12 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:45.162514 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f3ff0e92-fe5d-439a-8bcc-1add89b8cc92 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1539662015", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "01d41899-bf8f-45ad-9aa1-db371d9cd1c4"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:45.188168 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:09:45.189490 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:09:45.264747 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-f3ff0e92-fe5d-439a-8bcc-1add89b8cc92 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] validate_networks() for [('01d41899-bf8f-45ad-9aa1-db371d9cd1c4', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:09:45.484798 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c0bdb0cc-318a-4679-b0f0-fc8dc18cbb12 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:45.494459 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c0bdb0cc-318a-4679-b0f0-fc8dc18cbb12 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:45.496394 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c0bdb0cc-318a-4679-b0f0-fc8dc18cbb12 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:45.498283 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c0bdb0cc-318a-4679-b0f0-fc8dc18cbb12 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] 10.222.0.35 "GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9" status: 200 len: 1366 microversion: 2.57 time: 0.451405 Jun 10 18:09:45.499277 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1880/3651] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:09:45 2022] GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9 => generated 1366 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:09:45.713193 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-79b2daa2-df72-4a55-bdce-c55f4afb1ce5 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:45.713193 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-79b2daa2-df72-4a55-bdce-c55f4afb1ce5 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: cd20ed09-0a67-4b14-881f-2977acd23396] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:45.720336 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-79b2daa2-df72-4a55-bdce-c55f4afb1ce5 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:45.728283 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-79b2daa2-df72-4a55-bdce-c55f4afb1ce5 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:45.728283 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-79b2daa2-df72-4a55-bdce-c55f4afb1ce5 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:45.728283 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-79b2daa2-df72-4a55-bdce-c55f4afb1ce5 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:45.747920 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-79b2daa2-df72-4a55-bdce-c55f4afb1ce5 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] HTTP exception thrown: Instance cd20ed09-0a67-4b14-881f-2977acd23396 could not be found. Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-79b2daa2-df72-4a55-bdce-c55f4afb1ce5 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Request method failure captured: Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396 HTTP/1.1 Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4fpk-i12apG1VgsMUVwPtQpaZk13MV4SM6M42Og9sHaOGAl94RmFuulvShkHQAFyfvECSdOXF3YdT8WPuqdnEqM1w6kND66S76WDoal-aLGFad_z4ElOIqTs_7k98WN4aZzOrwcyGdKQ76TZzPeuu6jMsJIsXWmRGoci16cbKcHviU Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: af241982b5884c22b5e7103f1ea4b8ef Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ImagesTestJSON-58204800 Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/af241982b5884c22b5e7103f1ea4b8ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/af241982b5884c22b5e7103f1ea4b8ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/af241982b5884c22b5e7103f1ea4b8ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_af241982b5884c22b5e7103f1ea4b8ef", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ImagesTestJSON-58204800 Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: af241982b5884c22b5e7103f1ea4b8ef Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ImagesTestJSON-58204800 Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ImagesTestJSON-58204800-project Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 8adb0ac9df46461489fa6bd3951417cf Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ImagesTestJSON-58204800-project Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: exception: Instance cd20ed09-0a67-4b14-881f-2977acd23396 could not be found. Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'cd20ed09-0a67-4b14-881f-2977acd23396'} Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd20ed09-0a67-4b14-881f-2977acd23396 could not be found. Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd20ed09-0a67-4b14-881f-2977acd23396 could not be found. Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:45.757346 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:45.762068 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:45.762068 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:45.762068 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:09:45.762068 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:09:45.762068 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd20ed09-0a67-4b14-881f-2977acd23396 could not be found. Jun 10 18:09:45.762068 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:45.762068 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-79b2daa2-df72-4a55-bdce-c55f4afb1ce5 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Returning 404 to user: Instance cd20ed09-0a67-4b14-881f-2977acd23396 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:09:45.764026 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-79b2daa2-df72-4a55-bdce-c55f4afb1ce5 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396" status: 404 len: 111 microversion: 2.1 time: 0.056093 Jun 10 18:09:45.765050 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1881/3652] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:45 2022] GET /compute/v2.1/servers/cd20ed09-0a67-4b14-881f-2977acd23396 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:09:45.786198 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-df5d0f96-6e1b-49be-a861-998f705cc0a4 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c612f4c0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:45.835522 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-df5d0f96-6e1b-49be-a861-998f705cc0a4 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] HTTP exception thrown: Image not found. Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-df5d0f96-6e1b-49be-a861-998f705cc0a4 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Request method failure captured: Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: request: DELETE /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a HTTP/1.1 Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4fpk-i12apG1VgsMUVwPtQpaZk13MV4SM6M42Og9sHaOGAl94RmFuulvShkHQAFyfvECSdOXF3YdT8WPuqdnEqM1w6kND66S76WDoal-aLGFad_z4ElOIqTs_7k98WN4aZzOrwcyGdKQ76TZzPeuu6jMsJIsXWmRGoci16cbKcHviU Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: af241982b5884c22b5e7103f1ea4b8ef Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ImagesTestJSON-58204800 Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/af241982b5884c22b5e7103f1ea4b8ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/af241982b5884c22b5e7103f1ea4b8ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/af241982b5884c22b5e7103f1ea4b8ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_af241982b5884c22b5e7103f1ea4b8ef", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ImagesTestJSON-58204800 Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: af241982b5884c22b5e7103f1ea4b8ef Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ImagesTestJSON-58204800 Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ImagesTestJSON-58204800-project Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 8adb0ac9df46461489fa6bd3951417cf Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ImagesTestJSON-58204800-project Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: exception: Image not found. Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '065af8f5-6106-4c50-a302-b136271a737a'} Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 065af8f5-6106-4c50-a302-b136271a737a to delete Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 065af8f5-6106-4c50-a302-b136271a737a could not be found. Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:45.845478 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:45.850118 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:45.850118 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:45.850118 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:09:45.850118 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:09:45.850118 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:09:45.850118 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:09:45.850118 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:09:45.850118 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:09:45.850118 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 10 18:09:45.850118 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 10 18:09:45.850118 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 10 18:09:45.850118 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:45.850118 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:45.850118 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:45.850118 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:45.850118 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:45.850118 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:45.850118 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:09:45.850118 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:09:45.850118 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 10 18:09:45.850118 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:45.855906 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-df5d0f96-6e1b-49be-a861-998f705cc0a4 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Returning 404 to user: Image not found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:09:45.861819 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-df5d0f96-6e1b-49be-a861-998f705cc0a4 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "DELETE /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a" status: 404 len: 62 microversion: 2.1 time: 0.087883 Jun 10 18:09:45.867049 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1882/3653] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:45 2022] DELETE /compute/v2.1/images/065af8f5-6106-4c50-a302-b136271a737a => generated 62 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:09:45.881544 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0d88e898-04d6-4b00-b41d-7a6f830decdd tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:45.885123 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0d88e898-04d6-4b00-b41d-7a6f830decdd tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 289cf5c3-10c7-4a83-94d9-d83623d0c5e7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:45.912748 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0d88e898-04d6-4b00-b41d-7a6f830decdd tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:45.913417 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0d88e898-04d6-4b00-b41d-7a6f830decdd tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:45.914270 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0d88e898-04d6-4b00-b41d-7a6f830decdd tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:45.914713 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0d88e898-04d6-4b00-b41d-7a6f830decdd tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:45.948448 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-0d88e898-04d6-4b00-b41d-7a6f830decdd tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] HTTP exception thrown: Instance 289cf5c3-10c7-4a83-94d9-d83623d0c5e7 could not be found. Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0d88e898-04d6-4b00-b41d-7a6f830decdd tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Request method failure captured: Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: request: DELETE /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7 HTTP/1.1 Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4fpk-i12apG1VgsMUVwPtQpaZk13MV4SM6M42Og9sHaOGAl94RmFuulvShkHQAFyfvECSdOXF3YdT8WPuqdnEqM1w6kND66S76WDoal-aLGFad_z4ElOIqTs_7k98WN4aZzOrwcyGdKQ76TZzPeuu6jMsJIsXWmRGoci16cbKcHviU Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: af241982b5884c22b5e7103f1ea4b8ef Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ImagesTestJSON-58204800 Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/af241982b5884c22b5e7103f1ea4b8ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/af241982b5884c22b5e7103f1ea4b8ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/af241982b5884c22b5e7103f1ea4b8ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_af241982b5884c22b5e7103f1ea4b8ef", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ImagesTestJSON-58204800 Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: af241982b5884c22b5e7103f1ea4b8ef Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ImagesTestJSON-58204800 Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ImagesTestJSON-58204800-project Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 8adb0ac9df46461489fa6bd3951417cf Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ImagesTestJSON-58204800-project Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 289cf5c3-10c7-4a83-94d9-d83623d0c5e7 could not be found. Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '289cf5c3-10c7-4a83-94d9-d83623d0c5e7'} Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 289cf5c3-10c7-4a83-94d9-d83623d0c5e7 could not be found. Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 289cf5c3-10c7-4a83-94d9-d83623d0c5e7 could not be found. Jun 10 18:09:45.950264 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:45.956344 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:45.956344 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:45.956344 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:45.956344 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:45.956344 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:45.956344 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:09:45.956344 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:09:45.956344 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 289cf5c3-10c7-4a83-94d9-d83623d0c5e7 could not be found. Jun 10 18:09:45.956344 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:45.960607 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0d88e898-04d6-4b00-b41d-7a6f830decdd tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Returning 404 to user: Instance 289cf5c3-10c7-4a83-94d9-d83623d0c5e7 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:09:45.960607 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0d88e898-04d6-4b00-b41d-7a6f830decdd tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "DELETE /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7" status: 404 len: 111 microversion: 2.1 time: 0.090137 Jun 10 18:09:45.960607 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1883/3654] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:09:45 2022] DELETE /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:09:45.968095 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9c29d38c-0107-4f77-83ae-93b728343bca tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:45.973114 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9c29d38c-0107-4f77-83ae-93b728343bca tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 289cf5c3-10c7-4a83-94d9-d83623d0c5e7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:45.989260 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9c29d38c-0107-4f77-83ae-93b728343bca tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:45.989910 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9c29d38c-0107-4f77-83ae-93b728343bca tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:45.991044 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9c29d38c-0107-4f77-83ae-93b728343bca tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:45.991456 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9c29d38c-0107-4f77-83ae-93b728343bca tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:46.000178 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-f3ff0e92-fe5d-439a-8bcc-1add89b8cc92 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:09:46.001295 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-f3ff0e92-fe5d-439a-8bcc-1add89b8cc92 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:09:46.001975 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-f3ff0e92-fe5d-439a-8bcc-1add89b8cc92 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:09:46.002405 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-f3ff0e92-fe5d-439a-8bcc-1add89b8cc92 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:09:46.002830 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-f3ff0e92-fe5d-439a-8bcc-1add89b8cc92 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:09:46.018139 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-9c29d38c-0107-4f77-83ae-93b728343bca tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] HTTP exception thrown: Instance 289cf5c3-10c7-4a83-94d9-d83623d0c5e7 could not be found. Jun 10 18:09:46.019299 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f3ff0e92-fe5d-439a-8bcc-1add89b8cc92 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9c29d38c-0107-4f77-83ae-93b728343bca tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Request method failure captured: Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7 HTTP/1.1 Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4fpk-i12apG1VgsMUVwPtQpaZk13MV4SM6M42Og9sHaOGAl94RmFuulvShkHQAFyfvECSdOXF3YdT8WPuqdnEqM1w6kND66S76WDoal-aLGFad_z4ElOIqTs_7k98WN4aZzOrwcyGdKQ76TZzPeuu6jMsJIsXWmRGoci16cbKcHviU Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: af241982b5884c22b5e7103f1ea4b8ef Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ImagesTestJSON-58204800 Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/af241982b5884c22b5e7103f1ea4b8ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/af241982b5884c22b5e7103f1ea4b8ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/af241982b5884c22b5e7103f1ea4b8ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_af241982b5884c22b5e7103f1ea4b8ef", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ImagesTestJSON-58204800 Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: af241982b5884c22b5e7103f1ea4b8ef Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ImagesTestJSON-58204800 Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ImagesTestJSON-58204800-project Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 8adb0ac9df46461489fa6bd3951417cf Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ImagesTestJSON-58204800-project Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 289cf5c3-10c7-4a83-94d9-d83623d0c5e7 could not be found. Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '289cf5c3-10c7-4a83-94d9-d83623d0c5e7'} Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 289cf5c3-10c7-4a83-94d9-d83623d0c5e7 could not be found. Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 289cf5c3-10c7-4a83-94d9-d83623d0c5e7 could not be found. Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:46.019708 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:46.026512 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:46.026512 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:46.026512 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:09:46.026512 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:09:46.026512 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 289cf5c3-10c7-4a83-94d9-d83623d0c5e7 could not be found. Jun 10 18:09:46.026512 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:46.026512 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9c29d38c-0107-4f77-83ae-93b728343bca tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Returning 404 to user: Instance 289cf5c3-10c7-4a83-94d9-d83623d0c5e7 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:09:46.027123 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f3ff0e92-fe5d-439a-8bcc-1add89b8cc92 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:46.027228 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9c29d38c-0107-4f77-83ae-93b728343bca tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7" status: 404 len: 111 microversion: 2.1 time: 0.057696 Jun 10 18:09:46.027228 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1884/3655] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:45 2022] GET /compute/v2.1/servers/289cf5c3-10c7-4a83-94d9-d83623d0c5e7 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:09:46.029888 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f3ff0e92-fe5d-439a-8bcc-1add89b8cc92 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:46.030756 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c4f62084-b50f-4586-8219-ac505ffcbcbc tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77c6299c10>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:46.031721 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f3ff0e92-fe5d-439a-8bcc-1add89b8cc92 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:46.057686 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-c4f62084-b50f-4586-8219-ac505ffcbcbc tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] HTTP exception thrown: Image not found. Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c4f62084-b50f-4586-8219-ac505ffcbcbc tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Request method failure captured: Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: request: DELETE /compute/v2.1/images/3c691b7d-1df9-4bde-93bd-492788d2c966 HTTP/1.1 Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4fpk-i12apG1VgsMUVwPtQpaZk13MV4SM6M42Og9sHaOGAl94RmFuulvShkHQAFyfvECSdOXF3YdT8WPuqdnEqM1w6kND66S76WDoal-aLGFad_z4ElOIqTs_7k98WN4aZzOrwcyGdKQ76TZzPeuu6jMsJIsXWmRGoci16cbKcHviU Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: af241982b5884c22b5e7103f1ea4b8ef Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ImagesTestJSON-58204800 Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/af241982b5884c22b5e7103f1ea4b8ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/af241982b5884c22b5e7103f1ea4b8ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/af241982b5884c22b5e7103f1ea4b8ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_af241982b5884c22b5e7103f1ea4b8ef", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ImagesTestJSON-58204800 Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: af241982b5884c22b5e7103f1ea4b8ef Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ImagesTestJSON-58204800 Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ImagesTestJSON-58204800-project Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 8adb0ac9df46461489fa6bd3951417cf Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ImagesTestJSON-58204800-project Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: exception: Image not found. Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '3c691b7d-1df9-4bde-93bd-492788d2c966'} Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3c691b7d-1df9-4bde-93bd-492788d2c966 to delete Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3c691b7d-1df9-4bde-93bd-492788d2c966 could not be found. Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:46.059696 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:46.065216 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:46.065216 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:46.065216 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:09:46.065216 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:09:46.065216 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:09:46.065216 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:09:46.065216 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:09:46.065216 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:09:46.065216 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 10 18:09:46.065216 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 10 18:09:46.065216 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 10 18:09:46.065216 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:46.065216 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:46.065216 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:46.065216 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:46.065216 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:46.065216 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:46.065216 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:09:46.065216 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:09:46.065216 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 10 18:09:46.065216 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:46.069463 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c4f62084-b50f-4586-8219-ac505ffcbcbc tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Returning 404 to user: Image not found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:09:46.069463 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c4f62084-b50f-4586-8219-ac505ffcbcbc tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "DELETE /compute/v2.1/images/3c691b7d-1df9-4bde-93bd-492788d2c966" status: 404 len: 62 microversion: 2.1 time: 0.042450 Jun 10 18:09:46.069463 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1885/3656] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:46 2022] DELETE /compute/v2.1/images/3c691b7d-1df9-4bde-93bd-492788d2c966 => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:09:46.079101 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cadca65b-e036-4c9b-8915-4d9db37bb209 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:46.079756 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cadca65b-e036-4c9b-8915-4d9db37bb209 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:46.089979 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cadca65b-e036-4c9b-8915-4d9db37bb209 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:46.090436 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cadca65b-e036-4c9b-8915-4d9db37bb209 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:46.091133 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-f3ff0e92-fe5d-439a-8bcc-1add89b8cc92 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Getting quotas for project 457c4a300936498b9e8b61645e655751. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:09:46.091637 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cadca65b-e036-4c9b-8915-4d9db37bb209 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:46.092225 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cadca65b-e036-4c9b-8915-4d9db37bb209 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:46.103955 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-f3ff0e92-fe5d-439a-8bcc-1add89b8cc92 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Getting quotas for user 8166793f60ee479689b4a21457b71d07 and project 457c4a300936498b9e8b61645e655751. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:09:46.108399 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:09:46.109952 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-cadca65b-e036-4c9b-8915-4d9db37bb209 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] HTTP exception thrown: Instance 284a4545-1204-4256-a8b5-8d2e1524948b could not be found. Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cadca65b-e036-4c9b-8915-4d9db37bb209 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Request method failure captured: Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: request: DELETE /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b HTTP/1.1 Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4fpk-i12apG1VgsMUVwPtQpaZk13MV4SM6M42Og9sHaOGAl94RmFuulvShkHQAFyfvECSdOXF3YdT8WPuqdnEqM1w6kND66S76WDoal-aLGFad_z4ElOIqTs_7k98WN4aZzOrwcyGdKQ76TZzPeuu6jMsJIsXWmRGoci16cbKcHviU Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: af241982b5884c22b5e7103f1ea4b8ef Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ImagesTestJSON-58204800 Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/af241982b5884c22b5e7103f1ea4b8ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/af241982b5884c22b5e7103f1ea4b8ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/af241982b5884c22b5e7103f1ea4b8ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_af241982b5884c22b5e7103f1ea4b8ef", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ImagesTestJSON-58204800 Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: af241982b5884c22b5e7103f1ea4b8ef Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ImagesTestJSON-58204800 Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ImagesTestJSON-58204800-project Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 8adb0ac9df46461489fa6bd3951417cf Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ImagesTestJSON-58204800-project Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 284a4545-1204-4256-a8b5-8d2e1524948b could not be found. Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '284a4545-1204-4256-a8b5-8d2e1524948b'} Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 284a4545-1204-4256-a8b5-8d2e1524948b could not be found. Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 284a4545-1204-4256-a8b5-8d2e1524948b could not be found. Jun 10 18:09:46.111698 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:46.117003 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:46.117003 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:46.117003 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:46.117003 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:46.117003 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:46.117003 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:09:46.117003 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:09:46.117003 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 284a4545-1204-4256-a8b5-8d2e1524948b could not be found. Jun 10 18:09:46.117003 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:46.118329 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cadca65b-e036-4c9b-8915-4d9db37bb209 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Returning 404 to user: Instance 284a4545-1204-4256-a8b5-8d2e1524948b could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:09:46.119451 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cadca65b-e036-4c9b-8915-4d9db37bb209 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "DELETE /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b" status: 404 len: 111 microversion: 2.1 time: 0.045665 Jun 10 18:09:46.120536 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1886/3657] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:09:46 2022] DELETE /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:09:46.131140 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6601831c-070e-457a-b91a-5f6e2b512889 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:46.131767 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6601831c-070e-457a-b91a-5f6e2b512889 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 284a4545-1204-4256-a8b5-8d2e1524948b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:46.137171 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f3ff0e92-fe5d-439a-8bcc-1add89b8cc92 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:09:46.138738 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6601831c-070e-457a-b91a-5f6e2b512889 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:46.139198 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6601831c-070e-457a-b91a-5f6e2b512889 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:46.140044 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6601831c-070e-457a-b91a-5f6e2b512889 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:46.140595 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6601831c-070e-457a-b91a-5f6e2b512889 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:46.141513 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f3ff0e92-fe5d-439a-8bcc-1add89b8cc92 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:09:46.155661 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-6601831c-070e-457a-b91a-5f6e2b512889 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] HTTP exception thrown: Instance 284a4545-1204-4256-a8b5-8d2e1524948b could not be found. Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6601831c-070e-457a-b91a-5f6e2b512889 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Request method failure captured: Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b HTTP/1.1 Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4fpk-i12apG1VgsMUVwPtQpaZk13MV4SM6M42Og9sHaOGAl94RmFuulvShkHQAFyfvECSdOXF3YdT8WPuqdnEqM1w6kND66S76WDoal-aLGFad_z4ElOIqTs_7k98WN4aZzOrwcyGdKQ76TZzPeuu6jMsJIsXWmRGoci16cbKcHviU Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: af241982b5884c22b5e7103f1ea4b8ef Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ImagesTestJSON-58204800 Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/af241982b5884c22b5e7103f1ea4b8ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/af241982b5884c22b5e7103f1ea4b8ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/af241982b5884c22b5e7103f1ea4b8ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_af241982b5884c22b5e7103f1ea4b8ef", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ImagesTestJSON-58204800 Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: af241982b5884c22b5e7103f1ea4b8ef Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ImagesTestJSON-58204800 Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ImagesTestJSON-58204800-project Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 8adb0ac9df46461489fa6bd3951417cf Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ImagesTestJSON-58204800-project Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 284a4545-1204-4256-a8b5-8d2e1524948b could not be found. Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '284a4545-1204-4256-a8b5-8d2e1524948b'} Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 284a4545-1204-4256-a8b5-8d2e1524948b could not be found. Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 284a4545-1204-4256-a8b5-8d2e1524948b could not be found. Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:46.157475 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:46.167224 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:46.167224 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:46.167224 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:09:46.167224 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:09:46.167224 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 284a4545-1204-4256-a8b5-8d2e1524948b could not be found. Jun 10 18:09:46.167224 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:46.167224 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6601831c-070e-457a-b91a-5f6e2b512889 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Returning 404 to user: Instance 284a4545-1204-4256-a8b5-8d2e1524948b could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:09:46.167224 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6601831c-070e-457a-b91a-5f6e2b512889 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b" status: 404 len: 111 microversion: 2.1 time: 0.032768 Jun 10 18:09:46.167224 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1887/3658] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:46 2022] GET /compute/v2.1/servers/284a4545-1204-4256-a8b5-8d2e1524948b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:09:46.177473 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3ca39c6a-aed1-4974-8b9c-3425e62095c5 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '.version_select at 0x7f77b3cf2160>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:46.204370 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-3ca39c6a-aed1-4974-8b9c-3425e62095c5 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] HTTP exception thrown: Image not found. Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3ca39c6a-aed1-4974-8b9c-3425e62095c5 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Request method failure captured: Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: request: DELETE /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df HTTP/1.1 Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4fpk-i12apG1VgsMUVwPtQpaZk13MV4SM6M42Og9sHaOGAl94RmFuulvShkHQAFyfvECSdOXF3YdT8WPuqdnEqM1w6kND66S76WDoal-aLGFad_z4ElOIqTs_7k98WN4aZzOrwcyGdKQ76TZzPeuu6jMsJIsXWmRGoci16cbKcHviU Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: af241982b5884c22b5e7103f1ea4b8ef Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ImagesTestJSON-58204800 Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/af241982b5884c22b5e7103f1ea4b8ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/af241982b5884c22b5e7103f1ea4b8ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/af241982b5884c22b5e7103f1ea4b8ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_af241982b5884c22b5e7103f1ea4b8ef", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ImagesTestJSON-58204800 Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: af241982b5884c22b5e7103f1ea4b8ef Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ImagesTestJSON-58204800 Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ImagesTestJSON-58204800-project Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 8adb0ac9df46461489fa6bd3951417cf Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ImagesTestJSON-58204800-project Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: exception: Image not found. Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'e90567ed-dd13-45f2-86c3-4256db3d34df'} Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e90567ed-dd13-45f2-86c3-4256db3d34df to delete Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e90567ed-dd13-45f2-86c3-4256db3d34df could not be found. Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:46.206317 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:46.221169 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:46.221169 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:46.221169 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:09:46.221169 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:09:46.221169 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:09:46.221169 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:09:46.221169 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:09:46.221169 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:09:46.221169 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 10 18:09:46.221169 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 10 18:09:46.221169 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 10 18:09:46.221169 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:46.221169 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:46.221169 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:46.221169 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:46.221169 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:46.221169 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:46.221169 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:09:46.221169 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:09:46.221169 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 10 18:09:46.221169 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:46.221169 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3ca39c6a-aed1-4974-8b9c-3425e62095c5 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Returning 404 to user: Image not found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:09:46.221169 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3ca39c6a-aed1-4974-8b9c-3425e62095c5 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "DELETE /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df" status: 404 len: 62 microversion: 2.1 time: 0.034904 Jun 10 18:09:46.221169 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1888/3659] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:46 2022] DELETE /compute/v2.1/images/e90567ed-dd13-45f2-86c3-4256db3d34df => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:09:46.228451 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-05424590-dc8f-4094-8c5e-921572e85d6b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:46.229184 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-05424590-dc8f-4094-8c5e-921572e85d6b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 935bcaad-c46d-4d6c-8b00-7d349eefb5b2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:46.240535 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-05424590-dc8f-4094-8c5e-921572e85d6b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:46.241525 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-05424590-dc8f-4094-8c5e-921572e85d6b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:46.242650 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-05424590-dc8f-4094-8c5e-921572e85d6b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:46.243106 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-05424590-dc8f-4094-8c5e-921572e85d6b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:46.274015 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-05424590-dc8f-4094-8c5e-921572e85d6b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] HTTP exception thrown: Instance 935bcaad-c46d-4d6c-8b00-7d349eefb5b2 could not be found. Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-05424590-dc8f-4094-8c5e-921572e85d6b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Request method failure captured: Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: request: DELETE /compute/v2.1/servers/935bcaad-c46d-4d6c-8b00-7d349eefb5b2 HTTP/1.1 Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4fpk-i12apG1VgsMUVwPtQpaZk13MV4SM6M42Og9sHaOGAl94RmFuulvShkHQAFyfvECSdOXF3YdT8WPuqdnEqM1w6kND66S76WDoal-aLGFad_z4ElOIqTs_7k98WN4aZzOrwcyGdKQ76TZzPeuu6jMsJIsXWmRGoci16cbKcHviU Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: af241982b5884c22b5e7103f1ea4b8ef Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ImagesTestJSON-58204800 Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/af241982b5884c22b5e7103f1ea4b8ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/af241982b5884c22b5e7103f1ea4b8ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/af241982b5884c22b5e7103f1ea4b8ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_af241982b5884c22b5e7103f1ea4b8ef", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ImagesTestJSON-58204800 Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: af241982b5884c22b5e7103f1ea4b8ef Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ImagesTestJSON-58204800 Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ImagesTestJSON-58204800-project Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 8adb0ac9df46461489fa6bd3951417cf Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ImagesTestJSON-58204800-project Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 935bcaad-c46d-4d6c-8b00-7d349eefb5b2 could not be found. Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '935bcaad-c46d-4d6c-8b00-7d349eefb5b2'} Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 935bcaad-c46d-4d6c-8b00-7d349eefb5b2 could not be found. Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 935bcaad-c46d-4d6c-8b00-7d349eefb5b2 could not be found. Jun 10 18:09:46.275960 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:46.280770 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:46.280770 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:46.280770 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:46.280770 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:46.280770 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:46.280770 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:09:46.280770 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:09:46.280770 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 935bcaad-c46d-4d6c-8b00-7d349eefb5b2 could not be found. Jun 10 18:09:46.280770 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:46.280770 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-05424590-dc8f-4094-8c5e-921572e85d6b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Returning 404 to user: Instance 935bcaad-c46d-4d6c-8b00-7d349eefb5b2 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:09:46.280770 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-05424590-dc8f-4094-8c5e-921572e85d6b tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "DELETE /compute/v2.1/servers/935bcaad-c46d-4d6c-8b00-7d349eefb5b2" status: 404 len: 111 microversion: 2.1 time: 0.063738 Jun 10 18:09:46.280770 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1889/3660] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:09:46 2022] DELETE /compute/v2.1/servers/935bcaad-c46d-4d6c-8b00-7d349eefb5b2 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:09:46.289919 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-47327120-de5c-4f81-8cd8-349e19d3b1a7 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:46.291404 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-47327120-de5c-4f81-8cd8-349e19d3b1a7 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] [instance: 935bcaad-c46d-4d6c-8b00-7d349eefb5b2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:46.292232 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f3ff0e92-fe5d-439a-8bcc-1add89b8cc92 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.133391 Jun 10 18:09:46.293591 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1772/3661] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:09:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1136 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 10 18:09:46.298836 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-47327120-de5c-4f81-8cd8-349e19d3b1a7 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:46.306682 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-47327120-de5c-4f81-8cd8-349e19d3b1a7 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:46.306682 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-47327120-de5c-4f81-8cd8-349e19d3b1a7 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:46.306682 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-47327120-de5c-4f81-8cd8-349e19d3b1a7 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:46.306946 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f2cdb7e0-0942-48c8-bc9b-2d0d71700705 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:46.306946 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f2cdb7e0-0942-48c8-bc9b-2d0d71700705 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:46.318469 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-47327120-de5c-4f81-8cd8-349e19d3b1a7 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] HTTP exception thrown: Instance 935bcaad-c46d-4d6c-8b00-7d349eefb5b2 could not be found. Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-47327120-de5c-4f81-8cd8-349e19d3b1a7 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Request method failure captured: Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/935bcaad-c46d-4d6c-8b00-7d349eefb5b2 HTTP/1.1 Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4fpk-i12apG1VgsMUVwPtQpaZk13MV4SM6M42Og9sHaOGAl94RmFuulvShkHQAFyfvECSdOXF3YdT8WPuqdnEqM1w6kND66S76WDoal-aLGFad_z4ElOIqTs_7k98WN4aZzOrwcyGdKQ76TZzPeuu6jMsJIsXWmRGoci16cbKcHviU Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: af241982b5884c22b5e7103f1ea4b8ef Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ImagesTestJSON-58204800 Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/af241982b5884c22b5e7103f1ea4b8ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/af241982b5884c22b5e7103f1ea4b8ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/af241982b5884c22b5e7103f1ea4b8ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_af241982b5884c22b5e7103f1ea4b8ef", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ImagesTestJSON-58204800 Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: af241982b5884c22b5e7103f1ea4b8ef Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ImagesTestJSON-58204800 Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ImagesTestJSON-58204800-project Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 8adb0ac9df46461489fa6bd3951417cf Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ImagesTestJSON-58204800-project Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 935bcaad-c46d-4d6c-8b00-7d349eefb5b2 could not be found. Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '935bcaad-c46d-4d6c-8b00-7d349eefb5b2'} Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 935bcaad-c46d-4d6c-8b00-7d349eefb5b2 could not be found. Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 935bcaad-c46d-4d6c-8b00-7d349eefb5b2 could not be found. Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:46.320230 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:46.325011 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:46.325011 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:46.325011 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:09:46.325011 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:09:46.325011 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 935bcaad-c46d-4d6c-8b00-7d349eefb5b2 could not be found. Jun 10 18:09:46.325011 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:46.329998 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-47327120-de5c-4f81-8cd8-349e19d3b1a7 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] Returning 404 to user: Instance 935bcaad-c46d-4d6c-8b00-7d349eefb5b2 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:09:46.331093 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-47327120-de5c-4f81-8cd8-349e19d3b1a7 tempest-ImagesTestJSON-58204800 tempest-ImagesTestJSON-58204800-project] 10.222.0.35 "GET /compute/v2.1/servers/935bcaad-c46d-4d6c-8b00-7d349eefb5b2" status: 404 len: 111 microversion: 2.1 time: 0.046421 Jun 10 18:09:46.332150 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1890/3662] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:46 2022] GET /compute/v2.1/servers/935bcaad-c46d-4d6c-8b00-7d349eefb5b2 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:09:46.408744 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f2cdb7e0-0942-48c8-bc9b-2d0d71700705 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:46.433566 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f2cdb7e0-0942-48c8-bc9b-2d0d71700705 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1215 microversion: 2.1 time: 0.134166 Jun 10 18:09:46.434733 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1773/3663] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:46 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1215 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:09:46.517584 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-54282ac2-bfa6-4d4b-8da4-741e8e71f95d tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:46.518475 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-54282ac2-bfa6-4d4b-8da4-741e8e71f95d tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] [instance: a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:46.528355 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-54282ac2-bfa6-4d4b-8da4-741e8e71f95d tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:46.541137 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-54282ac2-bfa6-4d4b-8da4-741e8e71f95d tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:46.542643 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-54282ac2-bfa6-4d4b-8da4-741e8e71f95d tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:46.543259 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-54282ac2-bfa6-4d4b-8da4-741e8e71f95d tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:46.747410 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-54282ac2-bfa6-4d4b-8da4-741e8e71f95d tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:46.760017 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-54282ac2-bfa6-4d4b-8da4-741e8e71f95d tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:46.762754 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-54282ac2-bfa6-4d4b-8da4-741e8e71f95d tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:46.776264 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-54282ac2-bfa6-4d4b-8da4-741e8e71f95d tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] 10.222.0.35 "GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9" status: 200 len: 1366 microversion: 2.57 time: 0.251677 Jun 10 18:09:46.777595 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1891/3664] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:09:46 2022] GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9 => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:09:47.454636 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-51718491-bb34-41c1-9ada-d9bf60d23395 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:47.455865 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-51718491-bb34-41c1-9ada-d9bf60d23395 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:47.521324 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-51718491-bb34-41c1-9ada-d9bf60d23395 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:47.529791 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-51718491-bb34-41c1-9ada-d9bf60d23395 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1215 microversion: 2.1 time: 0.082502 Jun 10 18:09:47.532758 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1774/3665] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:47 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1215 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:47.790110 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7ea41bed-38aa-4d4e-845a-88b6bf1c9511 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:47.792064 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7ea41bed-38aa-4d4e-845a-88b6bf1c9511 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] [instance: a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:47.816968 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ea41bed-38aa-4d4e-845a-88b6bf1c9511 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:47.817455 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ea41bed-38aa-4d4e-845a-88b6bf1c9511 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:47.818293 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ea41bed-38aa-4d4e-845a-88b6bf1c9511 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:47.818744 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ea41bed-38aa-4d4e-845a-88b6bf1c9511 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:48.002065 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7ea41bed-38aa-4d4e-845a-88b6bf1c9511 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:48.014806 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7ea41bed-38aa-4d4e-845a-88b6bf1c9511 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:48.018364 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7ea41bed-38aa-4d4e-845a-88b6bf1c9511 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:48.041691 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7ea41bed-38aa-4d4e-845a-88b6bf1c9511 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] 10.222.0.35 "GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9" status: 200 len: 1366 microversion: 2.57 time: 0.240020 Jun 10 18:09:48.041691 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1892/3666] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:09:47 2022] GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9 => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:09:48.547710 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1f2b0a9a-4b95-4594-847f-42bc49130b75 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:48.548389 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1f2b0a9a-4b95-4594-847f-42bc49130b75 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:48.556503 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f2b0a9a-4b95-4594-847f-42bc49130b75 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:48.558280 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f2b0a9a-4b95-4594-847f-42bc49130b75 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:48.558280 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f2b0a9a-4b95-4594-847f-42bc49130b75 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:48.558816 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f2b0a9a-4b95-4594-847f-42bc49130b75 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:48.687391 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1f2b0a9a-4b95-4594-847f-42bc49130b75 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:48.697276 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1f2b0a9a-4b95-4594-847f-42bc49130b75 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1267 microversion: 2.1 time: 0.153819 Jun 10 18:09:48.698384 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1775/3667] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:48 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:49.056485 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2237ef9a-3469-4ac8-b145-315e6300fa36 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:49.057827 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2237ef9a-3469-4ac8-b145-315e6300fa36 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] [instance: a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:49.069421 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2237ef9a-3469-4ac8-b145-315e6300fa36 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:49.072763 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2237ef9a-3469-4ac8-b145-315e6300fa36 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:49.074311 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2237ef9a-3469-4ac8-b145-315e6300fa36 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:49.076717 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2237ef9a-3469-4ac8-b145-315e6300fa36 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:49.265153 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2237ef9a-3469-4ac8-b145-315e6300fa36 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:49.274637 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2237ef9a-3469-4ac8-b145-315e6300fa36 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:49.276560 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2237ef9a-3469-4ac8-b145-315e6300fa36 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:49.278188 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2237ef9a-3469-4ac8-b145-315e6300fa36 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] 10.222.0.35 "GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9" status: 200 len: 1366 microversion: 2.57 time: 0.227013 Jun 10 18:09:49.279393 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1893/3668] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:09:49 2022] GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:09:49.715689 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-21adea2d-54a1-42ac-bc45-414bc7904ebe tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:49.716805 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-21adea2d-54a1-42ac-bc45-414bc7904ebe tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:49.730276 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-21adea2d-54a1-42ac-bc45-414bc7904ebe tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:49.730817 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-21adea2d-54a1-42ac-bc45-414bc7904ebe tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:49.732411 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-21adea2d-54a1-42ac-bc45-414bc7904ebe tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:49.732855 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-21adea2d-54a1-42ac-bc45-414bc7904ebe tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:50.050627 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-21adea2d-54a1-42ac-bc45-414bc7904ebe tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:50.060059 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:09:50.062925 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-21adea2d-54a1-42ac-bc45-414bc7904ebe tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1273 microversion: 2.1 time: 0.351036 Jun 10 18:09:50.077230 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1776/3669] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:49 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1273 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:50.298073 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e4deb257-0ac9-425a-b695-5682141ac3b7 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:50.299321 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e4deb257-0ac9-425a-b695-5682141ac3b7 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] [instance: a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:50.315568 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e4deb257-0ac9-425a-b695-5682141ac3b7 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:50.318227 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e4deb257-0ac9-425a-b695-5682141ac3b7 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:50.319297 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e4deb257-0ac9-425a-b695-5682141ac3b7 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:50.319745 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e4deb257-0ac9-425a-b695-5682141ac3b7 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:50.508890 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e4deb257-0ac9-425a-b695-5682141ac3b7 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:50.526133 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e4deb257-0ac9-425a-b695-5682141ac3b7 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:50.527777 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e4deb257-0ac9-425a-b695-5682141ac3b7 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:50.533732 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e4deb257-0ac9-425a-b695-5682141ac3b7 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] 10.222.0.35 "GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9" status: 200 len: 1366 microversion: 2.57 time: 0.240240 Jun 10 18:09:50.544472 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1894/3670] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:09:50 2022] GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9 => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:09:51.003940 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a728ccf2-4a29-462a-b552-f15bbdec5391 tempest-ImagesDeleteNegativeTestJSON-369958626 tempest-ImagesDeleteNegativeTestJSON-369958626-project] 10.222.0.35 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.186408 Jun 10 18:09:51.004557 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1777/3671] 10.222.0.35 () {58 vars in 1127 bytes} [Fri Jun 10 18:09:50 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 10 18:09:51.014777 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5ab0a246-90d4-471b-a129-e7c19a3d1d84 tempest-ImagesDeleteNegativeTestJSON-369958626 tempest-ImagesDeleteNegativeTestJSON-369958626-project] Calling method '.version_select at 0x7f77c6150c10>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:51.052886 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-5ab0a246-90d4-471b-a129-e7c19a3d1d84 tempest-ImagesDeleteNegativeTestJSON-369958626 tempest-ImagesDeleteNegativeTestJSON-369958626-project] HTTP exception thrown: Image not found. Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5ab0a246-90d4-471b-a129-e7c19a3d1d84 tempest-ImagesDeleteNegativeTestJSON-369958626 tempest-ImagesDeleteNegativeTestJSON-369958626-project] Request method failure captured: Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4juLJP_42gfMNv8HJbNmKE1nsv3Ghsez2muUsNWUkl2nLZqZCsjx3XGAZC6uilVLoZQdrPEgsfiHcvxe6sXa4CXxjX8fmJNaRZGaxX4V50yR4taZpa-DAs12HLcTSyCvEL4JoIf1ZmmXNOLiI3UFOZKTffKAjrFJf7v720VpcsAmpw Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 0b8dc9e63f5b483a8d2a6f871fd5bef6 Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-369958626 Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/0b8dc9e63f5b483a8d2a6f871fd5bef6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/0b8dc9e63f5b483a8d2a6f871fd5bef6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/0b8dc9e63f5b483a8d2a6f871fd5bef6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_0b8dc9e63f5b483a8d2a6f871fd5bef6", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-369958626 Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 0b8dc9e63f5b483a8d2a6f871fd5bef6 Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-369958626 Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ImagesDeleteNegativeTestJSON-369958626-project Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 5b7eb925002e490f84e99df0a424e6f3 Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-369958626-project Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: exception: Image not found. Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '-1'} Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:51.054937 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:51.059598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:51.059598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:51.059598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:09:51.059598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:09:51.059598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:09:51.059598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:09:51.059598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:09:51.059598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:09:51.059598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 10 18:09:51.059598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 10 18:09:51.059598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 10 18:09:51.059598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:51.059598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:51.059598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:51.059598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:51.059598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:51.059598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:51.059598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:09:51.059598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:09:51.059598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 10 18:09:51.059598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:51.062858 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5ab0a246-90d4-471b-a129-e7c19a3d1d84 tempest-ImagesDeleteNegativeTestJSON-369958626 tempest-ImagesDeleteNegativeTestJSON-369958626-project] Returning 404 to user: Image not found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:09:51.064322 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5ab0a246-90d4-471b-a129-e7c19a3d1d84 tempest-ImagesDeleteNegativeTestJSON-369958626 tempest-ImagesDeleteNegativeTestJSON-369958626-project] 10.222.0.35 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.053489 Jun 10 18:09:51.065402 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1895/3672] 10.222.0.35 () {58 vars in 1133 bytes} [Fri Jun 10 18:09:51 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:09:51.074360 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-676b6854-efdd-41a4-8a97-baf3625bf9ba tempest-ImagesDeleteNegativeTestJSON-369958626 tempest-ImagesDeleteNegativeTestJSON-369958626-project] Calling method '.version_select at 0x7f77c06303a0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:51.081978 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-82109597-f7dd-4041-8324-8bb9f8a0fe70 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:51.084045 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-82109597-f7dd-4041-8324-8bb9f8a0fe70 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:51.102047 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-82109597-f7dd-4041-8324-8bb9f8a0fe70 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:51.104413 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-82109597-f7dd-4041-8324-8bb9f8a0fe70 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:51.104413 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-82109597-f7dd-4041-8324-8bb9f8a0fe70 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:51.104413 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-82109597-f7dd-4041-8324-8bb9f8a0fe70 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:51.107987 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-676b6854-efdd-41a4-8a97-baf3625bf9ba tempest-ImagesDeleteNegativeTestJSON-369958626 tempest-ImagesDeleteNegativeTestJSON-369958626-project] HTTP exception thrown: Image not found. Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-676b6854-efdd-41a4-8a97-baf3625bf9ba tempest-ImagesDeleteNegativeTestJSON-369958626 tempest-ImagesDeleteNegativeTestJSON-369958626-project] Request method failure captured: Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/images/06240f2c-d3ae-46d5-8c20-fa2bd9a45c8j HTTP/1.1 Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4juLJP_42gfMNv8HJbNmKE1nsv3Ghsez2muUsNWUkl2nLZqZCsjx3XGAZC6uilVLoZQdrPEgsfiHcvxe6sXa4CXxjX8fmJNaRZGaxX4V50yR4taZpa-DAs12HLcTSyCvEL4JoIf1ZmmXNOLiI3UFOZKTffKAjrFJf7v720VpcsAmpw Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 0b8dc9e63f5b483a8d2a6f871fd5bef6 Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-369958626 Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/0b8dc9e63f5b483a8d2a6f871fd5bef6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/0b8dc9e63f5b483a8d2a6f871fd5bef6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/0b8dc9e63f5b483a8d2a6f871fd5bef6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_0b8dc9e63f5b483a8d2a6f871fd5bef6", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-369958626 Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 0b8dc9e63f5b483a8d2a6f871fd5bef6 Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-369958626 Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ImagesDeleteNegativeTestJSON-369958626-project Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 5b7eb925002e490f84e99df0a424e6f3 Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-369958626-project Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: exception: Image not found. Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '06240f2c-d3ae-46d5-8c20-fa2bd9a45c8j'} Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 06240f2c-d3ae-46d5-8c20-fa2bd9a45c8j to delete Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 06240f2c-d3ae-46d5-8c20-fa2bd9a45c8j could not be found. Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:51.109947 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:51.114467 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:51.114467 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:51.114467 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:51.114467 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:09:51.114467 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:09:51.114467 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:09:51.114467 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:09:51.114467 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:09:51.114467 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:09:51.114467 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 10 18:09:51.114467 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 10 18:09:51.114467 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 10 18:09:51.114467 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:51.114467 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:51.114467 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:51.114467 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:51.114467 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:51.114467 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:51.114467 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:09:51.114467 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:09:51.114467 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 10 18:09:51.114467 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:51.116769 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-676b6854-efdd-41a4-8a97-baf3625bf9ba tempest-ImagesDeleteNegativeTestJSON-369958626 tempest-ImagesDeleteNegativeTestJSON-369958626-project] Returning 404 to user: Image not found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:09:51.117957 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-676b6854-efdd-41a4-8a97-baf3625bf9ba tempest-ImagesDeleteNegativeTestJSON-369958626 tempest-ImagesDeleteNegativeTestJSON-369958626-project] 10.222.0.35 "DELETE /compute/v2.1/images/06240f2c-d3ae-46d5-8c20-fa2bd9a45c8j" status: 404 len: 62 microversion: 2.1 time: 0.047464 Jun 10 18:09:51.118675 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1778/3673] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:51 2022] DELETE /compute/v2.1/images/06240f2c-d3ae-46d5-8c20-fa2bd9a45c8j => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:09:51.129827 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-75e14bf8-165e-4ff3-bf3a-a9549edf3fdc tempest-ImagesDeleteNegativeTestJSON-369958626 tempest-ImagesDeleteNegativeTestJSON-369958626-project] Calling method '.version_select at 0x7f77c614bc10>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:51.146689 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-75e14bf8-165e-4ff3-bf3a-a9549edf3fdc tempest-ImagesDeleteNegativeTestJSON-369958626 tempest-ImagesDeleteNegativeTestJSON-369958626-project] HTTP exception thrown: Image not found. Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-75e14bf8-165e-4ff3-bf3a-a9549edf3fdc tempest-ImagesDeleteNegativeTestJSON-369958626 tempest-ImagesDeleteNegativeTestJSON-369958626-project] Request method failure captured: Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/images/af1913c7-bc93-427e-ba09-345ae600c8501 HTTP/1.1 Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4juLJP_42gfMNv8HJbNmKE1nsv3Ghsez2muUsNWUkl2nLZqZCsjx3XGAZC6uilVLoZQdrPEgsfiHcvxe6sXa4CXxjX8fmJNaRZGaxX4V50yR4taZpa-DAs12HLcTSyCvEL4JoIf1ZmmXNOLiI3UFOZKTffKAjrFJf7v720VpcsAmpw Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 0b8dc9e63f5b483a8d2a6f871fd5bef6 Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-369958626 Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/0b8dc9e63f5b483a8d2a6f871fd5bef6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/0b8dc9e63f5b483a8d2a6f871fd5bef6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/0b8dc9e63f5b483a8d2a6f871fd5bef6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_0b8dc9e63f5b483a8d2a6f871fd5bef6", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-369958626 Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 0b8dc9e63f5b483a8d2a6f871fd5bef6 Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-369958626 Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ImagesDeleteNegativeTestJSON-369958626-project Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 5b7eb925002e490f84e99df0a424e6f3 Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-369958626-project Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: exception: Image not found. Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'af1913c7-bc93-427e-ba09-345ae600c8501'} Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image af1913c7-bc93-427e-ba09-345ae600c8501 to delete Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image af1913c7-bc93-427e-ba09-345ae600c8501 could not be found. Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:51.148734 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:51.153265 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:51.153265 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:51.153265 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:51.153265 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:09:51.153265 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:09:51.153265 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:09:51.153265 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:09:51.153265 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:09:51.153265 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:09:51.153265 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 10 18:09:51.153265 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 10 18:09:51.153265 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 10 18:09:51.153265 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:51.153265 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:51.153265 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:51.153265 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:51.153265 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:51.153265 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:51.153265 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:09:51.153265 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:09:51.153265 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 10 18:09:51.153265 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:51.155490 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-75e14bf8-165e-4ff3-bf3a-a9549edf3fdc tempest-ImagesDeleteNegativeTestJSON-369958626 tempest-ImagesDeleteNegativeTestJSON-369958626-project] Returning 404 to user: Image not found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:09:51.156558 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-75e14bf8-165e-4ff3-bf3a-a9549edf3fdc tempest-ImagesDeleteNegativeTestJSON-369958626 tempest-ImagesDeleteNegativeTestJSON-369958626-project] 10.222.0.35 "DELETE /compute/v2.1/images/af1913c7-bc93-427e-ba09-345ae600c8501" status: 404 len: 62 microversion: 2.1 time: 0.031317 Jun 10 18:09:51.161727 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1779/3674] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:09:51 2022] DELETE /compute/v2.1/images/af1913c7-bc93-427e-ba09-345ae600c8501 => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:09:51.167774 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5d176656-c0b8-4ab2-939f-13c51b5071bb tempest-ImagesDeleteNegativeTestJSON-369958626 tempest-ImagesDeleteNegativeTestJSON-369958626-project] Calling method '.version_select at 0x7f77c0607700>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:51.216867 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-5d176656-c0b8-4ab2-939f-13c51b5071bb tempest-ImagesDeleteNegativeTestJSON-369958626 tempest-ImagesDeleteNegativeTestJSON-369958626-project] HTTP exception thrown: Image not found. Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5d176656-c0b8-4ab2-939f-13c51b5071bb tempest-ImagesDeleteNegativeTestJSON-369958626 tempest-ImagesDeleteNegativeTestJSON-369958626-project] Request method failure captured: Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/images/tempest-invalid-346868461 HTTP/1.1 Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4juLJP_42gfMNv8HJbNmKE1nsv3Ghsez2muUsNWUkl2nLZqZCsjx3XGAZC6uilVLoZQdrPEgsfiHcvxe6sXa4CXxjX8fmJNaRZGaxX4V50yR4taZpa-DAs12HLcTSyCvEL4JoIf1ZmmXNOLiI3UFOZKTffKAjrFJf7v720VpcsAmpw Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 0b8dc9e63f5b483a8d2a6f871fd5bef6 Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-369958626 Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/0b8dc9e63f5b483a8d2a6f871fd5bef6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/0b8dc9e63f5b483a8d2a6f871fd5bef6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/0b8dc9e63f5b483a8d2a6f871fd5bef6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_0b8dc9e63f5b483a8d2a6f871fd5bef6", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-369958626 Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 0b8dc9e63f5b483a8d2a6f871fd5bef6 Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-369958626 Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ImagesDeleteNegativeTestJSON-369958626-project Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 5b7eb925002e490f84e99df0a424e6f3 Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-369958626-project Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: exception: Image not found. Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'tempest-invalid-346868461'} Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-346868461 to delete Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-346868461 could not be found. Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:51.219154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:51.227835 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:51.227835 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:51.227835 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:09:51.227835 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:09:51.227835 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:09:51.227835 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:09:51.227835 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:09:51.227835 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:09:51.227835 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 10 18:09:51.227835 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 10 18:09:51.227835 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 10 18:09:51.227835 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:51.227835 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:51.227835 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:51.227835 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:51.227835 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:51.227835 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:51.227835 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:09:51.227835 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:09:51.227835 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 10 18:09:51.227835 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:51.227835 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5d176656-c0b8-4ab2-939f-13c51b5071bb tempest-ImagesDeleteNegativeTestJSON-369958626 tempest-ImagesDeleteNegativeTestJSON-369958626-project] Returning 404 to user: Image not found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:09:51.227835 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5d176656-c0b8-4ab2-939f-13c51b5071bb tempest-ImagesDeleteNegativeTestJSON-369958626 tempest-ImagesDeleteNegativeTestJSON-369958626-project] 10.222.0.35 "DELETE /compute/v2.1/images/tempest-invalid-346868461" status: 404 len: 62 microversion: 2.1 time: 0.057804 Jun 10 18:09:51.227835 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1780/3675] 10.222.0.35 () {58 vars in 1202 bytes} [Fri Jun 10 18:09:51 2022] DELETE /compute/v2.1/images/tempest-invalid-346868461 => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:09:51.237979 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-73cd4cac-d194-4832-8b41-22c8f112dfd9 tempest-ImagesDeleteNegativeTestJSON-369958626 tempest-ImagesDeleteNegativeTestJSON-369958626-project] Calling method '.version_select at 0x7f77c0607790>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:51.266723 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-73cd4cac-d194-4832-8b41-22c8f112dfd9 tempest-ImagesDeleteNegativeTestJSON-369958626 tempest-ImagesDeleteNegativeTestJSON-369958626-project] HTTP exception thrown: Image not found. Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-73cd4cac-d194-4832-8b41-22c8f112dfd9 tempest-ImagesDeleteNegativeTestJSON-369958626 tempest-ImagesDeleteNegativeTestJSON-369958626-project] Request method failure captured: Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/images/69cb8561-9c1d-4369-9402-bc5909ed3b0b HTTP/1.1 Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4juLJP_42gfMNv8HJbNmKE1nsv3Ghsez2muUsNWUkl2nLZqZCsjx3XGAZC6uilVLoZQdrPEgsfiHcvxe6sXa4CXxjX8fmJNaRZGaxX4V50yR4taZpa-DAs12HLcTSyCvEL4JoIf1ZmmXNOLiI3UFOZKTffKAjrFJf7v720VpcsAmpw Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 0b8dc9e63f5b483a8d2a6f871fd5bef6 Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-369958626 Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/0b8dc9e63f5b483a8d2a6f871fd5bef6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/0b8dc9e63f5b483a8d2a6f871fd5bef6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/0b8dc9e63f5b483a8d2a6f871fd5bef6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_0b8dc9e63f5b483a8d2a6f871fd5bef6", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-369958626 Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 0b8dc9e63f5b483a8d2a6f871fd5bef6 Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-369958626 Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ImagesDeleteNegativeTestJSON-369958626-project Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 5b7eb925002e490f84e99df0a424e6f3 Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-369958626-project Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: exception: Image not found. Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '69cb8561-9c1d-4369-9402-bc5909ed3b0b'} Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 69cb8561-9c1d-4369-9402-bc5909ed3b0b to delete Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 69cb8561-9c1d-4369-9402-bc5909ed3b0b could not be found. Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:51.269584 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:51.275860 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:51.275860 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:51.275860 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:51.275860 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:09:51.275860 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:09:51.275860 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:09:51.275860 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:09:51.275860 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:09:51.275860 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:09:51.275860 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 10 18:09:51.275860 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 10 18:09:51.275860 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 10 18:09:51.275860 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:51.275860 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:51.275860 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:51.275860 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:51.275860 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:51.275860 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:51.275860 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:09:51.275860 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:09:51.275860 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 10 18:09:51.275860 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:51.280203 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-73cd4cac-d194-4832-8b41-22c8f112dfd9 tempest-ImagesDeleteNegativeTestJSON-369958626 tempest-ImagesDeleteNegativeTestJSON-369958626-project] Returning 404 to user: Image not found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:09:51.281292 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-73cd4cac-d194-4832-8b41-22c8f112dfd9 tempest-ImagesDeleteNegativeTestJSON-369958626 tempest-ImagesDeleteNegativeTestJSON-369958626-project] 10.222.0.35 "DELETE /compute/v2.1/images/69cb8561-9c1d-4369-9402-bc5909ed3b0b" status: 404 len: 62 microversion: 2.1 time: 0.050051 Jun 10 18:09:51.285653 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1781/3676] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:51 2022] DELETE /compute/v2.1/images/69cb8561-9c1d-4369-9402-bc5909ed3b0b => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 10 18:09:51.513138 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-82109597-f7dd-4041-8324-8bb9f8a0fe70 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:51.537452 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-82109597-f7dd-4041-8324-8bb9f8a0fe70 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1315 microversion: 2.1 time: 0.459941 Jun 10 18:09:51.538336 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1896/3677] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:51 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1315 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:09:51.555441 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cec39e5b-4b45-40c4-aa67-bdcd0e65174b tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:51.556120 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cec39e5b-4b45-40c4-aa67-bdcd0e65174b tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] [instance: a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:51.563048 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cec39e5b-4b45-40c4-aa67-bdcd0e65174b tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:51.563551 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cec39e5b-4b45-40c4-aa67-bdcd0e65174b tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:51.564549 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cec39e5b-4b45-40c4-aa67-bdcd0e65174b tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:51.564988 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cec39e5b-4b45-40c4-aa67-bdcd0e65174b tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:51.657153 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cec39e5b-4b45-40c4-aa67-bdcd0e65174b tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:51.671469 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cec39e5b-4b45-40c4-aa67-bdcd0e65174b tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:51.674050 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cec39e5b-4b45-40c4-aa67-bdcd0e65174b tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:51.679665 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cec39e5b-4b45-40c4-aa67-bdcd0e65174b tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] 10.222.0.35 "GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9" status: 200 len: 1366 microversion: 2.57 time: 0.128122 Jun 10 18:09:51.682075 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1782/3678] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:09:51 2022] GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9 => generated 1366 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:09:52.561606 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7a2481a5-17a2-4938-a049-18c2eb0a08fd tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:52.561606 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7a2481a5-17a2-4938-a049-18c2eb0a08fd tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:52.571463 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7a2481a5-17a2-4938-a049-18c2eb0a08fd tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:52.572045 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7a2481a5-17a2-4938-a049-18c2eb0a08fd tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:52.574546 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7a2481a5-17a2-4938-a049-18c2eb0a08fd tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:52.576149 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7a2481a5-17a2-4938-a049-18c2eb0a08fd tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:52.698516 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-612e3151-8705-42d3-9da2-60585ff6b55e tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:52.703293 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-612e3151-8705-42d3-9da2-60585ff6b55e tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] [instance: a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:52.707964 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-612e3151-8705-42d3-9da2-60585ff6b55e tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:52.708478 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-612e3151-8705-42d3-9da2-60585ff6b55e tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:52.709263 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-612e3151-8705-42d3-9da2-60585ff6b55e tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:52.709711 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-612e3151-8705-42d3-9da2-60585ff6b55e tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:52.828990 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-612e3151-8705-42d3-9da2-60585ff6b55e tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:52.838187 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-612e3151-8705-42d3-9da2-60585ff6b55e tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:52.839932 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-612e3151-8705-42d3-9da2-60585ff6b55e tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:52.841460 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-612e3151-8705-42d3-9da2-60585ff6b55e tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] 10.222.0.35 "GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9" status: 200 len: 1366 microversion: 2.57 time: 0.146900 Jun 10 18:09:52.842528 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1783/3679] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:09:52 2022] GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:09:53.034128 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7a2481a5-17a2-4938-a049-18c2eb0a08fd tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:53.048840 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7a2481a5-17a2-4938-a049-18c2eb0a08fd tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1315 microversion: 2.1 time: 0.495745 Jun 10 18:09:53.057233 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1897/3680] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:52 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1315 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:53.699055 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-fbf9af49-77cc-4aa1-8f48-bc008b9f24b3 req-20fea6d8-63bf-48fe-bc3d-f9c315e988ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d514aab-bc5c-462a-a759-6182effadcbe", "tag": "c91bc6bc-9338-4e16-af93-6a63229f16dd"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:53.714195 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-fbf9af49-77cc-4aa1-8f48-bc008b9f24b3 req-20fea6d8-63bf-48fe-bc3d-f9c315e988ba service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:53.714901 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-fbf9af49-77cc-4aa1-8f48-bc008b9f24b3 req-20fea6d8-63bf-48fe-bc3d-f9c315e988ba service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:53.733476 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-fbf9af49-77cc-4aa1-8f48-bc008b9f24b3 req-20fea6d8-63bf-48fe-bc3d-f9c315e988ba service nova] Creating event network-changed:c91bc6bc-9338-4e16-af93-6a63229f16dd for instance 7d514aab-bc5c-462a-a759-6182effadcbe on chh2-master-2 Jun 10 18:09:53.739440 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-fbf9af49-77cc-4aa1-8f48-bc008b9f24b3 req-20fea6d8-63bf-48fe-bc3d-f9c315e988ba service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044671 Jun 10 18:09:53.741535 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1784/3681] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:09:53.862519 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-933fdd8c-53b8-4043-8201-e69fed04ac87 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:53.863164 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-933fdd8c-53b8-4043-8201-e69fed04ac87 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] [instance: a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:53.878300 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-933fdd8c-53b8-4043-8201-e69fed04ac87 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:53.878851 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-933fdd8c-53b8-4043-8201-e69fed04ac87 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:53.879735 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-933fdd8c-53b8-4043-8201-e69fed04ac87 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:53.881737 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-933fdd8c-53b8-4043-8201-e69fed04ac87 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:54.171776 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b13499aa-7dbc-45b4-b463-c6b1edff5c8d tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Action: 'create', calling method: .version_select at 0x7f77c16ffa60>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1084641237", "policies": ["affinity"]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:54.193456 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-b13499aa-7dbc-45b4-b463-c6b1edff5c8d tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Getting quotas for project 088c9a2a1f8a429eba4b4a68c9bade12. Resources: {'server_groups'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:09:54.201477 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-b13499aa-7dbc-45b4-b463-c6b1edff5c8d tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Getting quotas for user 6e0c14dee0e14114aa63c2496ef2d4cf and project 088c9a2a1f8a429eba4b4a68c9bade12. Resources: {'server_groups'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:09:54.220148 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-933fdd8c-53b8-4043-8201-e69fed04ac87 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:54.233199 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-933fdd8c-53b8-4043-8201-e69fed04ac87 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:54.235849 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-933fdd8c-53b8-4043-8201-e69fed04ac87 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:54.237422 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-933fdd8c-53b8-4043-8201-e69fed04ac87 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] 10.222.0.35 "GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9" status: 200 len: 1366 microversion: 2.57 time: 0.379545 Jun 10 18:09:54.238313 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1898/3682] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:09:53 2022] GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9 => generated 1366 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:09:54.386938 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-209619f9-3b05-415a-a4e8-d04b636bf989 tempest-ListImageFiltersNegativeTestJSON-246035248 tempest-ListImageFiltersNegativeTestJSON-246035248-project] Calling method '.version_select at 0x7f77c60e29d0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:54.409981 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-b13499aa-7dbc-45b4-b463-c6b1edff5c8d tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Getting quotas for project 088c9a2a1f8a429eba4b4a68c9bade12. Resources: {'server_groups'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:09:54.425462 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-209619f9-3b05-415a-a4e8-d04b636bf989 tempest-ListImageFiltersNegativeTestJSON-246035248 tempest-ListImageFiltersNegativeTestJSON-246035248-project] HTTP exception thrown: Image not found. Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-209619f9-3b05-415a-a4e8-d04b636bf989 tempest-ListImageFiltersNegativeTestJSON-246035248 tempest-ListImageFiltersNegativeTestJSON-246035248-project] Request method failure captured: Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/images/39b28843-aa03-4949-b83a-150ce4679a28 HTTP/1.1 Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4jxUDex-K-e7VYIKHVvKy8nkBNjTpMAROTZO6OPSDgQWoXWgy8drN1FeD4jhlbYBjDBj9XOqudcG9107Q9tO4fhhkyXioDBlmW0xZPDjqG-zeZExkEWibuvDb83IajTsVfkVjyr-0pHvBmcv595QMyR4x6zSoWXAZl7-b3s4uLa2FQ Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 656e8f9687d84433b09847bf1b810f6a Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-246035248 Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/656e8f9687d84433b09847bf1b810f6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/656e8f9687d84433b09847bf1b810f6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/656e8f9687d84433b09847bf1b810f6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_656e8f9687d84433b09847bf1b810f6a", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-246035248 Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 656e8f9687d84433b09847bf1b810f6a Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-246035248 Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ListImageFiltersNegativeTestJSON-246035248-project Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: c11e94b398ee4362a0cf47b68775954d Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-246035248-project Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: exception: Image not found. Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '39b28843-aa03-4949-b83a-150ce4679a28'} Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 39b28843-aa03-4949-b83a-150ce4679a28 Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 10 18:09:54.427528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 10 18:09:54.431804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 10 18:09:54.431804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 10 18:09:54.431804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 10 18:09:54.431804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 10 18:09:54.431804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 10 18:09:54.431804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 10 18:09:54.431804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 10 18:09:54.431804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 10 18:09:54.431804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 10 18:09:54.431804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 10 18:09:54.431804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 10 18:09:54.431804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 10 18:09:54.431804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 10 18:09:54.431804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 10 18:09:54.431804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 10 18:09:54.431804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 10 18:09:54.431804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 10 18:09:54.431804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 39b28843-aa03-4949-b83a-150ce4679a28 could not be found. Jun 10 18:09:54.431804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:54.431804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:54.431804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:54.431804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:54.431804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:54.431804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:54.431804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:09:54.431804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:09:54.431804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:09:54.431804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:09:54.431804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:09:54.431804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:09:54.431804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jun 10 18:09:54.431804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 10 18:09:54.431804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 10 18:09:54.431804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:54.431804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:54.431804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:54.431804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:54.431804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:54.431804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:54.431804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:09:54.431804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:09:54.431804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 10 18:09:54.431804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:09:54.447989 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-b13499aa-7dbc-45b4-b463-c6b1edff5c8d tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Getting quotas for user 6e0c14dee0e14114aa63c2496ef2d4cf and project 088c9a2a1f8a429eba4b4a68c9bade12. Resources: {'server_groups'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:09:54.448251 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-209619f9-3b05-415a-a4e8-d04b636bf989 tempest-ListImageFiltersNegativeTestJSON-246035248 tempest-ListImageFiltersNegativeTestJSON-246035248-project] Returning 404 to user: Image not found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:09:54.448251 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-209619f9-3b05-415a-a4e8-d04b636bf989 tempest-ListImageFiltersNegativeTestJSON-246035248 tempest-ListImageFiltersNegativeTestJSON-246035248-project] 10.222.0.35 "GET /compute/v2.1/images/39b28843-aa03-4949-b83a-150ce4679a28" status: 404 len: 62 microversion: 2.1 time: 0.198545 Jun 10 18:09:54.448251 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1899/3683] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:09:54 2022] GET /compute/v2.1/images/39b28843-aa03-4949-b83a-150ce4679a28 => generated 62 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:09:54.449807 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b53dd962-a9c8-438d-9cfa-28abdd716891 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:54.451572 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b53dd962-a9c8-438d-9cfa-28abdd716891 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:54.467749 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b53dd962-a9c8-438d-9cfa-28abdd716891 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:54.469278 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b53dd962-a9c8-438d-9cfa-28abdd716891 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:54.470533 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b53dd962-a9c8-438d-9cfa-28abdd716891 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:54.472910 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b53dd962-a9c8-438d-9cfa-28abdd716891 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:54.482978 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b13499aa-7dbc-45b4-b463-c6b1edff5c8d tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.481038 Jun 10 18:09:54.488418 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1785/3684] 10.222.0.35 () {60 vars in 1173 bytes} [Fri Jun 10 18:09:53 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:09:54.495464 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bc151a3a-687c-402d-944a-bbe5ae4d7bd6 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Action: 'create', calling method: .version_select at 0x7f77c613e820>, body: {"server_group": {"name": "tempest-server-group-2082236895", "policies": ["affinity"]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:54.538353 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-bc151a3a-687c-402d-944a-bbe5ae4d7bd6 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Getting quotas for project 088c9a2a1f8a429eba4b4a68c9bade12. Resources: {'server_groups'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:09:54.550609 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-bc151a3a-687c-402d-944a-bbe5ae4d7bd6 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Getting quotas for user 6e0c14dee0e14114aa63c2496ef2d4cf and project 088c9a2a1f8a429eba4b4a68c9bade12. Resources: {'server_groups'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:09:54.709907 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-bc151a3a-687c-402d-944a-bbe5ae4d7bd6 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Getting quotas for project 088c9a2a1f8a429eba4b4a68c9bade12. Resources: {'server_groups'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:09:54.716088 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-bc151a3a-687c-402d-944a-bbe5ae4d7bd6 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Getting quotas for user 6e0c14dee0e14114aa63c2496ef2d4cf and project 088c9a2a1f8a429eba4b4a68c9bade12. Resources: {'server_groups'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:09:54.729723 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bc151a3a-687c-402d-944a-bbe5ae4d7bd6 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.239094 Jun 10 18:09:54.732253 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1786/3685] 10.222.0.35 () {60 vars in 1172 bytes} [Fri Jun 10 18:09:54 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:09:54.741115 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ed1ffd70-b988-4dc6-b4eb-9f4573914248 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Action: 'create', calling method: .version_select at 0x7f77c613e9d0>, body: {"server_group": {"name": "tempest-server-group-2082236895", "policies": ["affinity"]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:54.760585 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-ed1ffd70-b988-4dc6-b4eb-9f4573914248 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Getting quotas for project 088c9a2a1f8a429eba4b4a68c9bade12. Resources: {'server_groups'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:09:54.763229 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-ed1ffd70-b988-4dc6-b4eb-9f4573914248 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Getting quotas for user 6e0c14dee0e14114aa63c2496ef2d4cf and project 088c9a2a1f8a429eba4b4a68c9bade12. Resources: {'server_groups'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:09:54.780849 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:09:54.884434 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-ed1ffd70-b988-4dc6-b4eb-9f4573914248 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Getting quotas for project 088c9a2a1f8a429eba4b4a68c9bade12. Resources: {'server_groups'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:09:54.893089 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-ed1ffd70-b988-4dc6-b4eb-9f4573914248 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Getting quotas for user 6e0c14dee0e14114aa63c2496ef2d4cf and project 088c9a2a1f8a429eba4b4a68c9bade12. Resources: {'server_groups'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:09:54.907351 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ed1ffd70-b988-4dc6-b4eb-9f4573914248 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.170216 Jun 10 18:09:54.908286 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1787/3686] 10.222.0.35 () {60 vars in 1172 bytes} [Fri Jun 10 18:09:54 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:09:54.919403 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5a795bc0-b858-4a6e-bfbb-347b16d4b163 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:54.924146 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b53dd962-a9c8-438d-9cfa-28abdd716891 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:54.932004 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b53dd962-a9c8-438d-9cfa-28abdd716891 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1315 microversion: 2.1 time: 0.492335 Jun 10 18:09:54.938320 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1900/3687] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:54 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1315 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:55.017473 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5a795bc0-b858-4a6e-bfbb-347b16d4b163 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "DELETE /compute/v2.1/os-server-groups/2976b19c-2be3-41e6-a192-d771fc78bc6f" status: 204 len: 0 microversion: 2.1 time: 0.102576 Jun 10 18:09:55.025082 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1788/3688] 10.222.0.35 () {58 vars in 1265 bytes} [Fri Jun 10 18:09:54 2022] DELETE /compute/v2.1/os-server-groups/2976b19c-2be3-41e6-a192-d771fc78bc6f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 18:09:55.032881 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b2f7ea16-ce25-4887-ac2f-86beca75f38c tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:55.085297 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b2f7ea16-ce25-4887-ac2f-86beca75f38c tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.057161 Jun 10 18:09:55.086691 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1901/3689] 10.222.0.35 () {58 vars in 1151 bytes} [Fri Jun 10 18:09:55 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:09:55.101376 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-760fc565-3bca-4cd2-9dce-4b8e0a45c73a tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:55.195605 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-760fc565-3bca-4cd2-9dce-4b8e0a45c73a tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "DELETE /compute/v2.1/os-server-groups/e42fcc4d-26f6-403e-8952-cbd12eff0505" status: 204 len: 0 microversion: 2.1 time: 0.102252 Jun 10 18:09:55.196647 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1789/3690] 10.222.0.35 () {58 vars in 1265 bytes} [Fri Jun 10 18:09:55 2022] DELETE /compute/v2.1/os-server-groups/e42fcc4d-26f6-403e-8952-cbd12eff0505 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:09:55.209956 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-49afd4f0-8a10-4b31-9af8-bb9bec2572fc tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:55.237250 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-49afd4f0-8a10-4b31-9af8-bb9bec2572fc tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.031334 Jun 10 18:09:55.249654 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1790/3691] 10.222.0.35 () {58 vars in 1151 bytes} [Fri Jun 10 18:09:55 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:09:55.257070 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-28874875-e206-4dae-9f53-812194a278f3 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Action: 'create', calling method: .version_select at 0x7f77c6084ee0>, body: {"server_group": {"name": "tempest-server-group-1165733394", "policies": ["affinity"]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:55.299059 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-28874875-e206-4dae-9f53-812194a278f3 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Getting quotas for project 088c9a2a1f8a429eba4b4a68c9bade12. Resources: {'server_groups'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:09:55.312766 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-28874875-e206-4dae-9f53-812194a278f3 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Getting quotas for user 6e0c14dee0e14114aa63c2496ef2d4cf and project 088c9a2a1f8a429eba4b4a68c9bade12. Resources: {'server_groups'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:09:55.431994 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7006406e-9aac-431e-9223-81b8e19a08c9 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1579336990", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "ecd8888e-ac0f-4963-a02c-4316679f6c8e"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:55.456864 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-28874875-e206-4dae-9f53-812194a278f3 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Getting quotas for project 088c9a2a1f8a429eba4b4a68c9bade12. Resources: {'server_groups'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:09:55.463320 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-28874875-e206-4dae-9f53-812194a278f3 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Getting quotas for user 6e0c14dee0e14114aa63c2496ef2d4cf and project 088c9a2a1f8a429eba4b4a68c9bade12. Resources: {'server_groups'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:09:55.509648 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-28874875-e206-4dae-9f53-812194a278f3 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.258701 Jun 10 18:09:55.510280 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1791/3692] 10.222.0.35 () {60 vars in 1172 bytes} [Fri Jun 10 18:09:55 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:09:55.529941 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c2d04d82-3b1c-4519-a290-cd70142afc32 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:55.531858 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c2d04d82-3b1c-4519-a290-cd70142afc32 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] [instance: a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:55.539479 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-7006406e-9aac-431e-9223-81b8e19a08c9 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] validate_networks() for [('ecd8888e-ac0f-4963-a02c-4316679f6c8e', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:09:55.540596 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c2d04d82-3b1c-4519-a290-cd70142afc32 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:55.541729 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c2d04d82-3b1c-4519-a290-cd70142afc32 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:55.542697 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c2d04d82-3b1c-4519-a290-cd70142afc32 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:55.543216 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c2d04d82-3b1c-4519-a290-cd70142afc32 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:55.638254 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c2d04d82-3b1c-4519-a290-cd70142afc32 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:55.646983 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c2d04d82-3b1c-4519-a290-cd70142afc32 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:55.648583 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c2d04d82-3b1c-4519-a290-cd70142afc32 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:55.649877 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c2d04d82-3b1c-4519-a290-cd70142afc32 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] 10.222.0.35 "GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9" status: 200 len: 1366 microversion: 2.57 time: 0.138079 Jun 10 18:09:55.650550 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1792/3693] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:09:55 2022] GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9 => generated 1366 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:09:55.666600 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9e1e6d99-25ff-4397-a965-af1644bbc2ce tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:55.772688 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9e1e6d99-25ff-4397-a965-af1644bbc2ce tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "DELETE /compute/v2.1/os-server-groups/ad17b564-bd31-4a00-8af3-b5e3d2139f78" status: 204 len: 0 microversion: 2.1 time: 0.120491 Jun 10 18:09:55.774193 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1793/3694] 10.222.0.35 () {58 vars in 1265 bytes} [Fri Jun 10 18:09:55 2022] DELETE /compute/v2.1/os-server-groups/ad17b564-bd31-4a00-8af3-b5e3d2139f78 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:09:55.794831 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-54949669-1b2d-46e3-a82d-4bfcb3c79b2d tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:55.814642 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-54949669-1b2d-46e3-a82d-4bfcb3c79b2d tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.036118 Jun 10 18:09:55.815726 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1794/3695] 10.222.0.35 () {58 vars in 1151 bytes} [Fri Jun 10 18:09:55 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:09:55.827059 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e6542d0e-21b7-438f-8339-58a6ac98dbc5 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Action: 'create', calling method: .version_select at 0x7f77c6084ca0>, body: {"server_group": {"name": "tempest-server-group-1668128539", "policies": ["anti-affinity"]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:55.843387 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-e6542d0e-21b7-438f-8339-58a6ac98dbc5 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Getting quotas for project 088c9a2a1f8a429eba4b4a68c9bade12. Resources: {'server_groups'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:09:55.849641 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-e6542d0e-21b7-438f-8339-58a6ac98dbc5 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Getting quotas for user 6e0c14dee0e14114aa63c2496ef2d4cf and project 088c9a2a1f8a429eba4b4a68c9bade12. Resources: {'server_groups'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:09:55.978530 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-e6542d0e-21b7-438f-8339-58a6ac98dbc5 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Getting quotas for project 088c9a2a1f8a429eba4b4a68c9bade12. Resources: {'server_groups'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:09:55.988741 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-e6542d0e-21b7-438f-8339-58a6ac98dbc5 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Getting quotas for user 6e0c14dee0e14114aa63c2496ef2d4cf and project 088c9a2a1f8a429eba4b4a68c9bade12. Resources: {'server_groups'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:09:56.004600 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e6542d0e-21b7-438f-8339-58a6ac98dbc5 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.181505 Jun 10 18:09:56.007588 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1795/3696] 10.222.0.35 () {60 vars in 1172 bytes} [Fri Jun 10 18:09:55 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:09:56.013553 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-af605140-0a49-4f19-8fc0-62ffefcb46dd tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:56.014176 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-af605140-0a49-4f19-8fc0-62ffefcb46dd tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:56.020395 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-af605140-0a49-4f19-8fc0-62ffefcb46dd tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:56.020762 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-af605140-0a49-4f19-8fc0-62ffefcb46dd tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:56.021543 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-af605140-0a49-4f19-8fc0-62ffefcb46dd tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:56.021990 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-af605140-0a49-4f19-8fc0-62ffefcb46dd tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:56.030925 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-7006406e-9aac-431e-9223-81b8e19a08c9 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:09:56.032257 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-7006406e-9aac-431e-9223-81b8e19a08c9 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:09:56.033063 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-7006406e-9aac-431e-9223-81b8e19a08c9 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:09:56.033706 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-7006406e-9aac-431e-9223-81b8e19a08c9 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:09:56.034202 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-7006406e-9aac-431e-9223-81b8e19a08c9 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:09:56.043966 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7006406e-9aac-431e-9223-81b8e19a08c9 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:56.044563 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7006406e-9aac-431e-9223-81b8e19a08c9 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:56.045443 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7006406e-9aac-431e-9223-81b8e19a08c9 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:56.045956 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7006406e-9aac-431e-9223-81b8e19a08c9 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:56.068026 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-7006406e-9aac-431e-9223-81b8e19a08c9 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Getting quotas for project acded04c228a408b82bccdf323bb5a13. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:09:56.074730 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-7006406e-9aac-431e-9223-81b8e19a08c9 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Getting quotas for user 36d89341a3e541b2a765c011c1d751cd and project acded04c228a408b82bccdf323bb5a13. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:09:56.076857 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:09:56.090273 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7006406e-9aac-431e-9223-81b8e19a08c9 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:09:56.092869 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7006406e-9aac-431e-9223-81b8e19a08c9 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] [instance: 38887a36-3b6b-48ad-b967-77a941762301] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:09:56.202891 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7006406e-9aac-431e-9223-81b8e19a08c9 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.100346 Jun 10 18:09:56.204734 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-af605140-0a49-4f19-8fc0-62ffefcb46dd tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:56.210048 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1902/3697] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:09:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1108 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:09:56.217375 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-081f0a9f-5305-4731-805c-ed3ea7e0fce3 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:56.230032 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-af605140-0a49-4f19-8fc0-62ffefcb46dd tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1315 microversion: 2.1 time: 0.220979 Jun 10 18:09:56.230968 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1796/3698] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:56 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:56.239384 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4110f06b-6cd0-4abf-a75b-b6961166dab5 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:56.240017 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4110f06b-6cd0-4abf-a75b-b6961166dab5 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] [instance: 38887a36-3b6b-48ad-b967-77a941762301] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:56.242029 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=86,nova_api:DELETE=9 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:09:56.305361 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4110f06b-6cd0-4abf-a75b-b6961166dab5 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d89341a3e541b2a765c011c1d751cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acded04c228a408b82bccdf323bb5a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:56.315701 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4110f06b-6cd0-4abf-a75b-b6961166dab5 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] 10.222.0.35 "GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301" status: 200 len: 1217 microversion: 2.1 time: 0.083094 Jun 10 18:09:56.316935 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1797/3699] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:56 2022] GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301 => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:56.350900 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-081f0a9f-5305-4731-805c-ed3ea7e0fce3 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "DELETE /compute/v2.1/os-server-groups/f661d8f0-05c9-4244-bde0-07e1bb1d8049" status: 204 len: 0 microversion: 2.1 time: 0.134914 Jun 10 18:09:56.350900 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1903/3700] 10.222.0.35 () {58 vars in 1265 bytes} [Fri Jun 10 18:09:56 2022] DELETE /compute/v2.1/os-server-groups/f661d8f0-05c9-4244-bde0-07e1bb1d8049 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:09:56.358521 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b44b1040-4ed4-4f90-b23c-12d8a8b40b02 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:56.370595 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b44b1040-4ed4-4f90-b23c-12d8a8b40b02 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.016619 Jun 10 18:09:56.371181 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1798/3701] 10.222.0.35 () {58 vars in 1151 bytes} [Fri Jun 10 18:09:56 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:09:56.555025 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-136b8e01-0936-49fa-b871-969ea966d073 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1696007024", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "61f352de-6c00-4a70-85b2-ca90c4036e3d"}]}, "os:scheduler_hints": {"group": "eeb86332-5321-49af-8694-2b0446ea117e"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:56.631009 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-136b8e01-0936-49fa-b871-969ea966d073 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] validate_networks() for [('61f352de-6c00-4a70-85b2-ca90c4036e3d', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:09:56.670935 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-44f6f26c-362b-471c-9480-6c5d2d94b4c0 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:56.671551 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-44f6f26c-362b-471c-9480-6c5d2d94b4c0 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] [instance: a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:56.680529 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44f6f26c-362b-471c-9480-6c5d2d94b4c0 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:56.682609 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44f6f26c-362b-471c-9480-6c5d2d94b4c0 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:56.685841 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44f6f26c-362b-471c-9480-6c5d2d94b4c0 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:56.686477 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44f6f26c-362b-471c-9480-6c5d2d94b4c0 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:56.803028 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-44f6f26c-362b-471c-9480-6c5d2d94b4c0 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:56.813662 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-44f6f26c-362b-471c-9480-6c5d2d94b4c0 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:56.818457 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-44f6f26c-362b-471c-9480-6c5d2d94b4c0 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:56.820048 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-44f6f26c-362b-471c-9480-6c5d2d94b4c0 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] 10.222.0.35 "GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9" status: 200 len: 1366 microversion: 2.57 time: 0.153443 Jun 10 18:09:56.828722 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1799/3702] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:09:56 2022] GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:09:57.053957 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e30af790-1c8d-441d-912b-266e926657de tempest-ImagesMetadataNegativeTestJSON-731614565 tempest-ImagesMetadataNegativeTestJSON-731614565-project] Calling method '.version_select at 0x7f77c014cdc0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:57.089495 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-e30af790-1c8d-441d-912b-266e926657de tempest-ImagesMetadataNegativeTestJSON-731614565 tempest-ImagesMetadataNegativeTestJSON-731614565-project] HTTP exception thrown: Image not found. Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e30af790-1c8d-441d-912b-266e926657de tempest-ImagesMetadataNegativeTestJSON-731614565 tempest-ImagesMetadataNegativeTestJSON-731614565-project] Request method failure captured: Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/images/85d8f1b2-edfe-467b-93b8-a69351154036/metadata/os_distro HTTP/1.1 Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4j0mGfF-VhUjet7oMtFIMAZIib9082Uke3T7mGlrG1uT3lz1DLGZTCn7v8lVzF1N1jvMR-EDPyWJ7iYOFc0OGGwhC5EJKriSd921I_AMatHlStxF2Ron38S5DQ76I9Df_30mNx1RcsYO0Cz4mXjlRp4RbA5L1qIrrREXZTBn7_T6Vg Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 87f08ecaee50434a8d08d0f42676d4a7 Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-731614565 Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/87f08ecaee50434a8d08d0f42676d4a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/87f08ecaee50434a8d08d0f42676d4a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/87f08ecaee50434a8d08d0f42676d4a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_87f08ecaee50434a8d08d0f42676d4a7", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-731614565 Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 87f08ecaee50434a8d08d0f42676d4a7 Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-731614565 Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ImagesMetadataNegativeTestJSON-731614565-project Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 55907ac619bb4d9d8affe0f206d44cba Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-731614565-project Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: exception: Image not found. Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: action_args: {'image_id': '85d8f1b2-edfe-467b-93b8-a69351154036', 'id': 'os_distro'} Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 85d8f1b2-edfe-467b-93b8-a69351154036 Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 10 18:09:57.098509 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 85d8f1b2-edfe-467b-93b8-a69351154036 could not be found. Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e30af790-1c8d-441d-912b-266e926657de tempest-ImagesMetadataNegativeTestJSON-731614565 tempest-ImagesMetadataNegativeTestJSON-731614565-project] Returning 404 to user: Image not found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e30af790-1c8d-441d-912b-266e926657de tempest-ImagesMetadataNegativeTestJSON-731614565 tempest-ImagesMetadataNegativeTestJSON-731614565-project] 10.222.0.35 "DELETE /compute/v2.1/images/85d8f1b2-edfe-467b-93b8-a69351154036/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.179298 Jun 10 18:09:57.114407 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1800/3703] 10.222.0.35 () {58 vars in 1292 bytes} [Fri Jun 10 18:09:56 2022] DELETE /compute/v2.1/images/85d8f1b2-edfe-467b-93b8-a69351154036/metadata/os_distro => generated 62 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 10 18:09:57.118395 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-872e1d9a-23b8-4d7d-8ffb-93dcdd79d64a tempest-ImagesMetadataNegativeTestJSON-731614565 tempest-ImagesMetadataNegativeTestJSON-731614565-project] Calling method '.version_select at 0x7f77c0225a60>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:57.148526 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-872e1d9a-23b8-4d7d-8ffb-93dcdd79d64a tempest-ImagesMetadataNegativeTestJSON-731614565 tempest-ImagesMetadataNegativeTestJSON-731614565-project] HTTP exception thrown: Image not found. Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-872e1d9a-23b8-4d7d-8ffb-93dcdd79d64a tempest-ImagesMetadataNegativeTestJSON-731614565 tempest-ImagesMetadataNegativeTestJSON-731614565-project] Request method failure captured: Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/images/112eabce-2d00-44a4-93fe-74f467012740/metadata/os_version HTTP/1.1 Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4j0mGfF-VhUjet7oMtFIMAZIib9082Uke3T7mGlrG1uT3lz1DLGZTCn7v8lVzF1N1jvMR-EDPyWJ7iYOFc0OGGwhC5EJKriSd921I_AMatHlStxF2Ron38S5DQ76I9Df_30mNx1RcsYO0Cz4mXjlRp4RbA5L1qIrrREXZTBn7_T6Vg Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 87f08ecaee50434a8d08d0f42676d4a7 Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-731614565 Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/87f08ecaee50434a8d08d0f42676d4a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/87f08ecaee50434a8d08d0f42676d4a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/87f08ecaee50434a8d08d0f42676d4a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_87f08ecaee50434a8d08d0f42676d4a7", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-731614565 Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 87f08ecaee50434a8d08d0f42676d4a7 Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-731614565 Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ImagesMetadataNegativeTestJSON-731614565-project Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 55907ac619bb4d9d8affe0f206d44cba Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-731614565-project Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: exception: Image not found. Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: action_args: {'image_id': '112eabce-2d00-44a4-93fe-74f467012740', 'id': 'os_version'} Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 112eabce-2d00-44a4-93fe-74f467012740 Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 10 18:09:57.151089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 112eabce-2d00-44a4-93fe-74f467012740 could not be found. Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-872e1d9a-23b8-4d7d-8ffb-93dcdd79d64a tempest-ImagesMetadataNegativeTestJSON-731614565 tempest-ImagesMetadataNegativeTestJSON-731614565-project] Returning 404 to user: Image not found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-872e1d9a-23b8-4d7d-8ffb-93dcdd79d64a tempest-ImagesMetadataNegativeTestJSON-731614565 tempest-ImagesMetadataNegativeTestJSON-731614565-project] 10.222.0.35 "GET /compute/v2.1/images/112eabce-2d00-44a4-93fe-74f467012740/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.039697 Jun 10 18:09:57.155224 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1801/3704] 10.222.0.35 () {58 vars in 1292 bytes} [Fri Jun 10 18:09:57 2022] GET /compute/v2.1/images/112eabce-2d00-44a4-93fe-74f467012740/metadata/os_version => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:09:57.164608 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dcf26f07-a876-44cf-bac8-0da3d6852a2c tempest-ImagesMetadataNegativeTestJSON-731614565 tempest-ImagesMetadataNegativeTestJSON-731614565-project] Calling method '.version_select at 0x7f77c014cdc0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:57.185748 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-dcf26f07-a876-44cf-bac8-0da3d6852a2c tempest-ImagesMetadataNegativeTestJSON-731614565 tempest-ImagesMetadataNegativeTestJSON-731614565-project] HTTP exception thrown: Image not found. Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dcf26f07-a876-44cf-bac8-0da3d6852a2c tempest-ImagesMetadataNegativeTestJSON-731614565 tempest-ImagesMetadataNegativeTestJSON-731614565-project] Request method failure captured: Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/images/2316366a-26f1-4e51-bcdf-babed3e12051/metadata HTTP/1.1 Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4j0mGfF-VhUjet7oMtFIMAZIib9082Uke3T7mGlrG1uT3lz1DLGZTCn7v8lVzF1N1jvMR-EDPyWJ7iYOFc0OGGwhC5EJKriSd921I_AMatHlStxF2Ron38S5DQ76I9Df_30mNx1RcsYO0Cz4mXjlRp4RbA5L1qIrrREXZTBn7_T6Vg Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 87f08ecaee50434a8d08d0f42676d4a7 Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-731614565 Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/87f08ecaee50434a8d08d0f42676d4a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/87f08ecaee50434a8d08d0f42676d4a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/87f08ecaee50434a8d08d0f42676d4a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_87f08ecaee50434a8d08d0f42676d4a7", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-731614565 Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 87f08ecaee50434a8d08d0f42676d4a7 Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-731614565 Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ImagesMetadataNegativeTestJSON-731614565-project Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 55907ac619bb4d9d8affe0f206d44cba Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-731614565-project Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: exception: Image not found. Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: action_args: {'image_id': '2316366a-26f1-4e51-bcdf-babed3e12051'} Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 2316366a-26f1-4e51-bcdf-babed3e12051 Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 10 18:09:57.187815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2316366a-26f1-4e51-bcdf-babed3e12051 could not be found. Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dcf26f07-a876-44cf-bac8-0da3d6852a2c tempest-ImagesMetadataNegativeTestJSON-731614565 tempest-ImagesMetadataNegativeTestJSON-731614565-project] Returning 404 to user: Image not found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dcf26f07-a876-44cf-bac8-0da3d6852a2c tempest-ImagesMetadataNegativeTestJSON-731614565 tempest-ImagesMetadataNegativeTestJSON-731614565-project] 10.222.0.35 "GET /compute/v2.1/images/2316366a-26f1-4e51-bcdf-babed3e12051/metadata" status: 404 len: 62 microversion: 2.1 time: 0.028419 Jun 10 18:09:57.191556 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1802/3705] 10.222.0.35 () {58 vars in 1259 bytes} [Fri Jun 10 18:09:57 2022] GET /compute/v2.1/images/2316366a-26f1-4e51-bcdf-babed3e12051/metadata => generated 62 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:09:57.199612 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b09f72ff-c2b8-4eda-9861-23cac2a106b8 tempest-ImagesMetadataNegativeTestJSON-731614565 tempest-ImagesMetadataNegativeTestJSON-731614565-project] Action: 'update_all', calling method: .version_select at 0x7f77c02d2ca0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:57.225141 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-b09f72ff-c2b8-4eda-9861-23cac2a106b8 tempest-ImagesMetadataNegativeTestJSON-731614565 tempest-ImagesMetadataNegativeTestJSON-731614565-project] HTTP exception thrown: Image not found. Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b09f72ff-c2b8-4eda-9861-23cac2a106b8 tempest-ImagesMetadataNegativeTestJSON-731614565 tempest-ImagesMetadataNegativeTestJSON-731614565-project] Request method failure captured: Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: request: PUT /compute/v2.1/images/f07db35e-7a17-4956-8c9c-e56e75af140d/metadata HTTP/1.1 Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 57 Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4j0mGfF-VhUjet7oMtFIMAZIib9082Uke3T7mGlrG1uT3lz1DLGZTCn7v8lVzF1N1jvMR-EDPyWJ7iYOFc0OGGwhC5EJKriSd921I_AMatHlStxF2Ron38S5DQ76I9Df_30mNx1RcsYO0Cz4mXjlRp4RbA5L1qIrrREXZTBn7_T6Vg Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 87f08ecaee50434a8d08d0f42676d4a7 Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-731614565 Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/87f08ecaee50434a8d08d0f42676d4a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/87f08ecaee50434a8d08d0f42676d4a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/87f08ecaee50434a8d08d0f42676d4a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_87f08ecaee50434a8d08d0f42676d4a7", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-731614565 Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 87f08ecaee50434a8d08d0f42676d4a7 Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-731614565 Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ImagesMetadataNegativeTestJSON-731614565-project Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 55907ac619bb4d9d8affe0f206d44cba Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-731614565-project Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: exception: Image not found. Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: action_args: {'image_id': 'f07db35e-7a17-4956-8c9c-e56e75af140d', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f07db35e-7a17-4956-8c9c-e56e75af140d Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 10 18:09:57.227295 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f07db35e-7a17-4956-8c9c-e56e75af140d could not be found. Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b09f72ff-c2b8-4eda-9861-23cac2a106b8 tempest-ImagesMetadataNegativeTestJSON-731614565 tempest-ImagesMetadataNegativeTestJSON-731614565-project] Returning 404 to user: Image not found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:09:57.232354 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b09f72ff-c2b8-4eda-9861-23cac2a106b8 tempest-ImagesMetadataNegativeTestJSON-731614565 tempest-ImagesMetadataNegativeTestJSON-731614565-project] 10.222.0.35 "PUT /compute/v2.1/images/f07db35e-7a17-4956-8c9c-e56e75af140d/metadata" status: 404 len: 62 microversion: 2.1 time: 0.035003 Jun 10 18:09:57.241173 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1803/3706] 10.222.0.35 () {60 vars in 1279 bytes} [Fri Jun 10 18:09:57 2022] PUT /compute/v2.1/images/f07db35e-7a17-4956-8c9c-e56e75af140d/metadata => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 10 18:09:57.253159 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-72a52402-5a77-4459-a48e-d9f6ad60925d tempest-ImagesMetadataNegativeTestJSON-731614565 tempest-ImagesMetadataNegativeTestJSON-731614565-project] Action: 'update', calling method: .version_select at 0x7f77c0225790>, body: {"meta": {"os_distro": "alt"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:57.277647 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-72a52402-5a77-4459-a48e-d9f6ad60925d tempest-ImagesMetadataNegativeTestJSON-731614565 tempest-ImagesMetadataNegativeTestJSON-731614565-project] HTTP exception thrown: Image not found. Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-72a52402-5a77-4459-a48e-d9f6ad60925d tempest-ImagesMetadataNegativeTestJSON-731614565 tempest-ImagesMetadataNegativeTestJSON-731614565-project] Request method failure captured: Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: request: PUT /compute/v2.1/images/9748fef6-1e84-458f-8ea0-24e62f9de544/metadata/os_distro HTTP/1.1 Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 30 Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4j0mGfF-VhUjet7oMtFIMAZIib9082Uke3T7mGlrG1uT3lz1DLGZTCn7v8lVzF1N1jvMR-EDPyWJ7iYOFc0OGGwhC5EJKriSd921I_AMatHlStxF2Ron38S5DQ76I9Df_30mNx1RcsYO0Cz4mXjlRp4RbA5L1qIrrREXZTBn7_T6Vg Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 87f08ecaee50434a8d08d0f42676d4a7 Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-731614565 Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/87f08ecaee50434a8d08d0f42676d4a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/87f08ecaee50434a8d08d0f42676d4a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/87f08ecaee50434a8d08d0f42676d4a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_87f08ecaee50434a8d08d0f42676d4a7", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-731614565 Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 87f08ecaee50434a8d08d0f42676d4a7 Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-731614565 Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ImagesMetadataNegativeTestJSON-731614565-project Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 55907ac619bb4d9d8affe0f206d44cba Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-731614565-project Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: {"meta": {"os_distro": "alt"}} Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: exception: Image not found. Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: action_args: {'image_id': '9748fef6-1e84-458f-8ea0-24e62f9de544', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9748fef6-1e84-458f-8ea0-24e62f9de544 Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 10 18:09:57.280571 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9748fef6-1e84-458f-8ea0-24e62f9de544 could not be found. Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-72a52402-5a77-4459-a48e-d9f6ad60925d tempest-ImagesMetadataNegativeTestJSON-731614565 tempest-ImagesMetadataNegativeTestJSON-731614565-project] Returning 404 to user: Image not found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-72a52402-5a77-4459-a48e-d9f6ad60925d tempest-ImagesMetadataNegativeTestJSON-731614565 tempest-ImagesMetadataNegativeTestJSON-731614565-project] 10.222.0.35 "PUT /compute/v2.1/images/9748fef6-1e84-458f-8ea0-24e62f9de544/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.039506 Jun 10 18:09:57.284971 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1804/3707] 10.222.0.35 () {60 vars in 1309 bytes} [Fri Jun 10 18:09:57 2022] PUT /compute/v2.1/images/9748fef6-1e84-458f-8ea0-24e62f9de544/metadata/os_distro => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:09:57.290188 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fef32b49-494e-4416-a9dc-b6f6d29cf196 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:57.290808 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fef32b49-494e-4416-a9dc-b6f6d29cf196 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:57.297774 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fef32b49-494e-4416-a9dc-b6f6d29cf196 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:57.298396 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fef32b49-494e-4416-a9dc-b6f6d29cf196 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:57.299360 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fef32b49-494e-4416-a9dc-b6f6d29cf196 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:57.299811 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fef32b49-494e-4416-a9dc-b6f6d29cf196 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:57.317289 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-136b8e01-0936-49fa-b871-969ea966d073 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:09:57.317289 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-136b8e01-0936-49fa-b871-969ea966d073 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:09:57.317289 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-136b8e01-0936-49fa-b871-969ea966d073 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:09:57.317289 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-136b8e01-0936-49fa-b871-969ea966d073 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:09:57.317289 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-136b8e01-0936-49fa-b871-969ea966d073 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:09:57.323486 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-136b8e01-0936-49fa-b871-969ea966d073 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:57.323942 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-136b8e01-0936-49fa-b871-969ea966d073 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:57.324784 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-136b8e01-0936-49fa-b871-969ea966d073 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:57.325325 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-136b8e01-0936-49fa-b871-969ea966d073 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:57.344124 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-136b8e01-0936-49fa-b871-969ea966d073 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Getting quotas for project 088c9a2a1f8a429eba4b4a68c9bade12. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:09:57.349554 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-136b8e01-0936-49fa-b871-969ea966d073 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Getting quotas for user 6e0c14dee0e14114aa63c2496ef2d4cf and project 088c9a2a1f8a429eba4b4a68c9bade12. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:09:57.363317 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-136b8e01-0936-49fa-b871-969ea966d073 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:09:57.365630 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-136b8e01-0936-49fa-b871-969ea966d073 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] [instance: 55d00e0b-eb97-4076-94f6-0ecf02d933cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:09:57.478449 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fef32b49-494e-4416-a9dc-b6f6d29cf196 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:57.492554 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fef32b49-494e-4416-a9dc-b6f6d29cf196 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1315 microversion: 2.1 time: 0.207905 Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1805/3708] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:57 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-df25b326-b84d-4d58-aafc-51233ee6f29f tempest-ImagesMetadataNegativeTestJSON-731614565 tempest-ImagesMetadataNegativeTestJSON-731614565-project] Action: 'create', calling method: .version_select at 0x7f77c613e9d0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-df25b326-b84d-4d58-aafc-51233ee6f29f tempest-ImagesMetadataNegativeTestJSON-731614565 tempest-ImagesMetadataNegativeTestJSON-731614565-project] HTTP exception thrown: Image not found. Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-df25b326-b84d-4d58-aafc-51233ee6f29f tempest-ImagesMetadataNegativeTestJSON-731614565 tempest-ImagesMetadataNegativeTestJSON-731614565-project] Request method failure captured: Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/images/97cc7ecd-3b7e-4201-9fb3-47ec135837a9/metadata HTTP/1.1 Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 57 Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4j0mGfF-VhUjet7oMtFIMAZIib9082Uke3T7mGlrG1uT3lz1DLGZTCn7v8lVzF1N1jvMR-EDPyWJ7iYOFc0OGGwhC5EJKriSd921I_AMatHlStxF2Ron38S5DQ76I9Df_30mNx1RcsYO0Cz4mXjlRp4RbA5L1qIrrREXZTBn7_T6Vg Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 87f08ecaee50434a8d08d0f42676d4a7 Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-731614565 Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/87f08ecaee50434a8d08d0f42676d4a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/87f08ecaee50434a8d08d0f42676d4a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/87f08ecaee50434a8d08d0f42676d4a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_87f08ecaee50434a8d08d0f42676d4a7", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-731614565 Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 87f08ecaee50434a8d08d0f42676d4a7 Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-731614565 Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ImagesMetadataNegativeTestJSON-731614565-project Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 55907ac619bb4d9d8affe0f206d44cba Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-731614565-project Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: exception: Image not found. Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: action_args: {'image_id': '97cc7ecd-3b7e-4201-9fb3-47ec135837a9', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 10 18:09:57.552283 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 97cc7ecd-3b7e-4201-9fb3-47ec135837a9 Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 97cc7ecd-3b7e-4201-9fb3-47ec135837a9 could not be found. Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 10 18:09:57.558254 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:09:57.566053 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-df25b326-b84d-4d58-aafc-51233ee6f29f tempest-ImagesMetadataNegativeTestJSON-731614565 tempest-ImagesMetadataNegativeTestJSON-731614565-project] Returning 404 to user: Image not found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:09:57.566053 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-df25b326-b84d-4d58-aafc-51233ee6f29f tempest-ImagesMetadataNegativeTestJSON-731614565 tempest-ImagesMetadataNegativeTestJSON-731614565-project] 10.222.0.35 "POST /compute/v2.1/images/97cc7ecd-3b7e-4201-9fb3-47ec135837a9/metadata" status: 404 len: 62 microversion: 2.1 time: 0.030952 Jun 10 18:09:57.566053 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1806/3709] 10.222.0.35 () {60 vars in 1280 bytes} [Fri Jun 10 18:09:57 2022] POST /compute/v2.1/images/97cc7ecd-3b7e-4201-9fb3-47ec135837a9/metadata => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:09:57.566053 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f4c0fc10-0727-4804-8509-9b69891b3b98 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:57.566053 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f4c0fc10-0727-4804-8509-9b69891b3b98 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] [instance: 38887a36-3b6b-48ad-b967-77a941762301] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:57.607403 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f4c0fc10-0727-4804-8509-9b69891b3b98 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d89341a3e541b2a765c011c1d751cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acded04c228a408b82bccdf323bb5a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:57.607403 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f4c0fc10-0727-4804-8509-9b69891b3b98 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] 10.222.0.35 "GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301" status: 200 len: 1217 microversion: 2.1 time: 0.077981 Jun 10 18:09:57.607403 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1807/3710] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:57 2022] GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301 => generated 1217 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:57.733823 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b7cd3f2a-da77-4dd0-8087-fedaf1c1a056 tempest-AZV2TestJSON-1907401957 tempest-AZV2TestJSON-1907401957-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:57.735684 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b7cd3f2a-da77-4dd0-8087-fedaf1c1a056 tempest-AZV2TestJSON-1907401957 tempest-AZV2TestJSON-1907401957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:57.736136 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b7cd3f2a-da77-4dd0-8087-fedaf1c1a056 tempest-AZV2TestJSON-1907401957 tempest-AZV2TestJSON-1907401957-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:57.737610 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b7cd3f2a-da77-4dd0-8087-fedaf1c1a056 tempest-AZV2TestJSON-1907401957 tempest-AZV2TestJSON-1907401957-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:57.738060 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b7cd3f2a-da77-4dd0-8087-fedaf1c1a056 tempest-AZV2TestJSON-1907401957 tempest-AZV2TestJSON-1907401957-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:57.760906 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b7cd3f2a-da77-4dd0-8087-fedaf1c1a056 tempest-AZV2TestJSON-1907401957 tempest-AZV2TestJSON-1907401957-project] 10.222.0.35 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.152771 Jun 10 18:09:57.761485 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1808/3711] 10.222.0.35 () {58 vars in 1163 bytes} [Fri Jun 10 18:09:57 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:09:57.844643 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ece4ae7b-288c-43ff-a776-88000a2dd93f tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:57.845307 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ece4ae7b-288c-43ff-a776-88000a2dd93f tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] [instance: a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:57.851313 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ece4ae7b-288c-43ff-a776-88000a2dd93f tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:57.851841 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ece4ae7b-288c-43ff-a776-88000a2dd93f tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:57.852569 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ece4ae7b-288c-43ff-a776-88000a2dd93f tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:57.853011 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ece4ae7b-288c-43ff-a776-88000a2dd93f tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:57.921630 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ece4ae7b-288c-43ff-a776-88000a2dd93f tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:57.929801 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ece4ae7b-288c-43ff-a776-88000a2dd93f tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:57.931393 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ece4ae7b-288c-43ff-a776-88000a2dd93f tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:57.932676 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ece4ae7b-288c-43ff-a776-88000a2dd93f tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] 10.222.0.35 "GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9" status: 200 len: 1366 microversion: 2.57 time: 0.092596 Jun 10 18:09:57.933321 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1809/3712] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:09:57 2022] GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9 => generated 1366 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:09:57.947337 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-136b8e01-0936-49fa-b871-969ea966d073 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=126594) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jun 10 18:09:57.972205 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-136b8e01-0936-49fa-b871-969ea966d073 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Getting quotas for project 088c9a2a1f8a429eba4b4a68c9bade12. Resources: {'server_group_members'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:09:57.981059 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-136b8e01-0936-49fa-b871-969ea966d073 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Getting quotas for user 6e0c14dee0e14114aa63c2496ef2d4cf and project 088c9a2a1f8a429eba4b4a68c9bade12. Resources: {'server_group_members'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:09:58.129865 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:09:58.142420 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-136b8e01-0936-49fa-b871-969ea966d073 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Getting quotas for project 088c9a2a1f8a429eba4b4a68c9bade12. Resources: {'server_group_members'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:09:58.148826 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-136b8e01-0936-49fa-b871-969ea966d073 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Getting quotas for user 6e0c14dee0e14114aa63c2496ef2d4cf and project 088c9a2a1f8a429eba4b4a68c9bade12. Resources: {'server_group_members'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:09:58.175590 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-136b8e01-0936-49fa-b871-969ea966d073 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.625206 Jun 10 18:09:58.186531 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1904/3713] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:09:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:09:58.187990 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c9843827-2cfe-4e42-b344-1458cee70b2c tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:58.188864 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c9843827-2cfe-4e42-b344-1458cee70b2c tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] [instance: 55d00e0b-eb97-4076-94f6-0ecf02d933cd] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:58.297795 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c9843827-2cfe-4e42-b344-1458cee70b2c tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0c14dee0e14114aa63c2496ef2d4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088c9a2a1f8a429eba4b4a68c9bade12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:58.297795 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c9843827-2cfe-4e42-b344-1458cee70b2c tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd" status: 200 len: 1213 microversion: 2.1 time: 0.095062 Jun 10 18:09:58.297795 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1810/3714] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:58 2022] GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:58.567643 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8dd91d9c-0b87-44b9-af7c-2824cd957063 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:58.568279 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8dd91d9c-0b87-44b9-af7c-2824cd957063 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:58.578731 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8dd91d9c-0b87-44b9-af7c-2824cd957063 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:58.578731 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8dd91d9c-0b87-44b9-af7c-2824cd957063 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:58.578731 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8dd91d9c-0b87-44b9-af7c-2824cd957063 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:58.578731 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8dd91d9c-0b87-44b9-af7c-2824cd957063 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:58.624567 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5a94679b-6339-46d7-bd73-32d622446329 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:58.625627 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5a94679b-6339-46d7-bd73-32d622446329 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] [instance: 38887a36-3b6b-48ad-b967-77a941762301] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:58.633279 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5a94679b-6339-46d7-bd73-32d622446329 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:58.634512 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5a94679b-6339-46d7-bd73-32d622446329 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:58.635678 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5a94679b-6339-46d7-bd73-32d622446329 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:58.636277 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5a94679b-6339-46d7-bd73-32d622446329 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:58.740777 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5a94679b-6339-46d7-bd73-32d622446329 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d89341a3e541b2a765c011c1d751cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acded04c228a408b82bccdf323bb5a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:58.760829 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5a94679b-6339-46d7-bd73-32d622446329 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] 10.222.0.35 "GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301" status: 200 len: 1213 microversion: 2.1 time: 0.141090 Jun 10 18:09:58.763323 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1811/3715] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:58 2022] GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301 => generated 1213 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:58.833153 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8dd91d9c-0b87-44b9-af7c-2824cd957063 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:58.841817 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8dd91d9c-0b87-44b9-af7c-2824cd957063 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1315 microversion: 2.1 time: 0.278433 Jun 10 18:09:58.842648 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1905/3716] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:58 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:58.951573 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e126dd56-ee60-477f-8ea2-56668aed8ceb tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:58.952321 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e126dd56-ee60-477f-8ea2-56668aed8ceb tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] [instance: a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:58.958678 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e126dd56-ee60-477f-8ea2-56668aed8ceb tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:58.959131 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e126dd56-ee60-477f-8ea2-56668aed8ceb tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:58.959919 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e126dd56-ee60-477f-8ea2-56668aed8ceb tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:58.960380 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e126dd56-ee60-477f-8ea2-56668aed8ceb tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:59.066979 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e126dd56-ee60-477f-8ea2-56668aed8ceb tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:59.089884 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e126dd56-ee60-477f-8ea2-56668aed8ceb tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:59.092255 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e126dd56-ee60-477f-8ea2-56668aed8ceb tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:59.093743 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e126dd56-ee60-477f-8ea2-56668aed8ceb tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] 10.222.0.35 "GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9" status: 200 len: 1366 microversion: 2.57 time: 0.146392 Jun 10 18:09:59.094823 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1812/3717] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:09:58 2022] GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:09:59.298915 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fc395bb5-84b1-45c7-abca-8ed2a717d271 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:59.299540 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fc395bb5-84b1-45c7-abca-8ed2a717d271 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] [instance: 55d00e0b-eb97-4076-94f6-0ecf02d933cd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:59.364482 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fc395bb5-84b1-45c7-abca-8ed2a717d271 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0c14dee0e14114aa63c2496ef2d4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088c9a2a1f8a429eba4b4a68c9bade12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:59.372523 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fc395bb5-84b1-45c7-abca-8ed2a717d271 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd" status: 200 len: 1213 microversion: 2.1 time: 0.080648 Jun 10 18:09:59.373319 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1906/3718] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:59 2022] GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:09:59.787295 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2c5a92f2-0cf2-4501-808e-02f078694b7b tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:59.788127 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2c5a92f2-0cf2-4501-808e-02f078694b7b tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] [instance: 38887a36-3b6b-48ad-b967-77a941762301] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:59.812601 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c5a92f2-0cf2-4501-808e-02f078694b7b tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:59.812601 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c5a92f2-0cf2-4501-808e-02f078694b7b tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:59.812601 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c5a92f2-0cf2-4501-808e-02f078694b7b tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:59.812601 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c5a92f2-0cf2-4501-808e-02f078694b7b tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:59.858959 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5715ffe1-61e0-4cea-a1ac-5d05385eb6eb tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:09:59.861617 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5715ffe1-61e0-4cea-a1ac-5d05385eb6eb tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:09:59.876346 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5715ffe1-61e0-4cea-a1ac-5d05385eb6eb tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:59.876346 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5715ffe1-61e0-4cea-a1ac-5d05385eb6eb tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:59.877507 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5715ffe1-61e0-4cea-a1ac-5d05385eb6eb tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:09:59.889978 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5715ffe1-61e0-4cea-a1ac-5d05385eb6eb tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:09:59.898662 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2c5a92f2-0cf2-4501-808e-02f078694b7b tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d89341a3e541b2a765c011c1d751cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acded04c228a408b82bccdf323bb5a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:09:59.920892 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2c5a92f2-0cf2-4501-808e-02f078694b7b tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] 10.222.0.35 "GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301" status: 200 len: 1277 microversion: 2.1 time: 0.139097 Jun 10 18:09:59.935290 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1813/3719] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:59 2022] GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301 => generated 1277 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:00.121418 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bcd9c052-1729-4d80-a1a9-ae8524558b6c tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:00.124152 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bcd9c052-1729-4d80-a1a9-ae8524558b6c tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] [instance: a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:00.140285 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bcd9c052-1729-4d80-a1a9-ae8524558b6c tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:00.145572 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bcd9c052-1729-4d80-a1a9-ae8524558b6c tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:00.146641 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bcd9c052-1729-4d80-a1a9-ae8524558b6c tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:00.147591 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bcd9c052-1729-4d80-a1a9-ae8524558b6c tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:00.196195 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5715ffe1-61e0-4cea-a1ac-5d05385eb6eb tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:00.208365 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5715ffe1-61e0-4cea-a1ac-5d05385eb6eb tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1315 microversion: 2.1 time: 0.352528 Jun 10 18:10:00.211305 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1907/3720] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:09:59 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:00.269191 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bcd9c052-1729-4d80-a1a9-ae8524558b6c tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:00.274019 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bcd9c052-1729-4d80-a1a9-ae8524558b6c tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:00.275536 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bcd9c052-1729-4d80-a1a9-ae8524558b6c tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:00.276946 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bcd9c052-1729-4d80-a1a9-ae8524558b6c tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] 10.222.0.35 "GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9" status: 200 len: 1366 microversion: 2.57 time: 0.163805 Jun 10 18:10:00.278093 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1814/3721] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:10:00 2022] GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:10:00.391256 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7e11b37f-1eff-4dfc-911a-fde8ca77fa83 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:00.392109 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7e11b37f-1eff-4dfc-911a-fde8ca77fa83 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] [instance: 55d00e0b-eb97-4076-94f6-0ecf02d933cd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:00.402300 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7e11b37f-1eff-4dfc-911a-fde8ca77fa83 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:00.402677 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7e11b37f-1eff-4dfc-911a-fde8ca77fa83 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:00.404161 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7e11b37f-1eff-4dfc-911a-fde8ca77fa83 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:00.404661 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7e11b37f-1eff-4dfc-911a-fde8ca77fa83 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:00.510364 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7e11b37f-1eff-4dfc-911a-fde8ca77fa83 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0c14dee0e14114aa63c2496ef2d4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088c9a2a1f8a429eba4b4a68c9bade12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:00.522050 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7e11b37f-1eff-4dfc-911a-fde8ca77fa83 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd" status: 200 len: 1265 microversion: 2.1 time: 0.136175 Jun 10 18:10:00.524574 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1908/3722] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:00 2022] GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd => generated 1265 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:10:00.942756 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-403b9bb7-e41f-4fc2-88ad-2f7002cf6ac6 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:00.944109 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-403b9bb7-e41f-4fc2-88ad-2f7002cf6ac6 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] [instance: 38887a36-3b6b-48ad-b967-77a941762301] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:00.952254 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-403b9bb7-e41f-4fc2-88ad-2f7002cf6ac6 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:00.958676 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-403b9bb7-e41f-4fc2-88ad-2f7002cf6ac6 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:00.967619 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-403b9bb7-e41f-4fc2-88ad-2f7002cf6ac6 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:00.968547 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-403b9bb7-e41f-4fc2-88ad-2f7002cf6ac6 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:01.029854 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c4a65bca-f1a0-4005-85a2-199e7c55ddf5 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-2089925428", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:10:01.087018 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-403b9bb7-e41f-4fc2-88ad-2f7002cf6ac6 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d89341a3e541b2a765c011c1d751cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acded04c228a408b82bccdf323bb5a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:01.095272 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-403b9bb7-e41f-4fc2-88ad-2f7002cf6ac6 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] 10.222.0.35 "GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301" status: 200 len: 1275 microversion: 2.1 time: 0.156343 Jun 10 18:10:01.095929 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1909/3723] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:00 2022] GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301 => generated 1275 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:01.097736 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-c4a65bca-f1a0-4005-85a2-199e7c55ddf5 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] validate_networks() for None {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:10:01.226921 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6fe1b167-9385-4677-b709-3d9de5b83d7d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:01.227547 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6fe1b167-9385-4677-b709-3d9de5b83d7d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:01.234362 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6fe1b167-9385-4677-b709-3d9de5b83d7d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:01.234829 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6fe1b167-9385-4677-b709-3d9de5b83d7d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:01.235600 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6fe1b167-9385-4677-b709-3d9de5b83d7d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:01.236045 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6fe1b167-9385-4677-b709-3d9de5b83d7d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:01.513663 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6fe1b167-9385-4677-b709-3d9de5b83d7d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:01.551003 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6fe1b167-9385-4677-b709-3d9de5b83d7d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1315 microversion: 2.1 time: 0.327339 Jun 10 18:10:01.554177 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1910/3724] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:01 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:10:01.565665 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d087769c-df5a-4ca0-bc78-d0a871245118 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:01.569517 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d087769c-df5a-4ca0-bc78-d0a871245118 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] [instance: a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:01.581047 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d087769c-df5a-4ca0-bc78-d0a871245118 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:01.581512 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d087769c-df5a-4ca0-bc78-d0a871245118 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:01.582296 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d087769c-df5a-4ca0-bc78-d0a871245118 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:01.582735 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d087769c-df5a-4ca0-bc78-d0a871245118 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:01.739266 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-c4a65bca-f1a0-4005-85a2-199e7c55ddf5 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:10:01.739789 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-c4a65bca-f1a0-4005-85a2-199e7c55ddf5 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:10:01.740923 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-c4a65bca-f1a0-4005-85a2-199e7c55ddf5 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:10:01.743004 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-c4a65bca-f1a0-4005-85a2-199e7c55ddf5 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:10:01.743004 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-c4a65bca-f1a0-4005-85a2-199e7c55ddf5 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:10:01.755986 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d087769c-df5a-4ca0-bc78-d0a871245118 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:01.761098 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c4a65bca-f1a0-4005-85a2-199e7c55ddf5 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:01.763536 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c4a65bca-f1a0-4005-85a2-199e7c55ddf5 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:01.764551 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c4a65bca-f1a0-4005-85a2-199e7c55ddf5 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:01.766048 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c4a65bca-f1a0-4005-85a2-199e7c55ddf5 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:01.769556 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d087769c-df5a-4ca0-bc78-d0a871245118 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:01.772762 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d087769c-df5a-4ca0-bc78-d0a871245118 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:01.776323 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d087769c-df5a-4ca0-bc78-d0a871245118 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] 10.222.0.35 "GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9" status: 200 len: 1366 microversion: 2.57 time: 0.221026 Jun 10 18:10:01.779717 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1911/3725] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:10:01 2022] GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:10:01.799282 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-073d7737-a71e-4dfe-b7a1-8efb6d58dc82 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:01.802748 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-073d7737-a71e-4dfe-b7a1-8efb6d58dc82 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] [instance: 55d00e0b-eb97-4076-94f6-0ecf02d933cd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:01.813395 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-073d7737-a71e-4dfe-b7a1-8efb6d58dc82 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:01.813852 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-073d7737-a71e-4dfe-b7a1-8efb6d58dc82 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:01.814638 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-073d7737-a71e-4dfe-b7a1-8efb6d58dc82 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:01.815112 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-073d7737-a71e-4dfe-b7a1-8efb6d58dc82 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:01.832221 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-c4a65bca-f1a0-4005-85a2-199e7c55ddf5 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Getting quotas for project 38326c7c8786498a94e003d80740c5cf. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:10:01.839021 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-c4a65bca-f1a0-4005-85a2-199e7c55ddf5 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Getting quotas for user cc673eee8339438cbb69ac8bc8df633e and project 38326c7c8786498a94e003d80740c5cf. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:10:01.859986 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c4a65bca-f1a0-4005-85a2-199e7c55ddf5 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:10:01.863075 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c4a65bca-f1a0-4005-85a2-199e7c55ddf5 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] [instance: 911b33c1-545d-4bcb-9ca1-c42c7bda606b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:10:01.921370 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-073d7737-a71e-4dfe-b7a1-8efb6d58dc82 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0c14dee0e14114aa63c2496ef2d4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088c9a2a1f8a429eba4b4a68c9bade12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:01.929606 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:10:01.932570 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-073d7737-a71e-4dfe-b7a1-8efb6d58dc82 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd" status: 200 len: 1271 microversion: 2.1 time: 0.149812 Jun 10 18:10:01.933446 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1912/3726] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:01 2022] GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd => generated 1271 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:02.026873 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c4a65bca-f1a0-4005-85a2-199e7c55ddf5 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.353435 Jun 10 18:10:02.032051 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1815/3727] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:10:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1359 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:10:02.043840 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-66416dc3-48b0-4120-859a-1c9933fe0215 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:02.046816 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-66416dc3-48b0-4120-859a-1c9933fe0215 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] [instance: 911b33c1-545d-4bcb-9ca1-c42c7bda606b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:02.115034 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-58ac4526-4b5f-45fb-b149-663c030326d6 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:02.116528 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-58ac4526-4b5f-45fb-b149-663c030326d6 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] [instance: 38887a36-3b6b-48ad-b967-77a941762301] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:02.126304 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-66416dc3-48b0-4120-859a-1c9933fe0215 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc673eee8339438cbb69ac8bc8df633e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38326c7c8786498a94e003d80740c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:02.126676 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-58ac4526-4b5f-45fb-b149-663c030326d6 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:02.127293 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-58ac4526-4b5f-45fb-b149-663c030326d6 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:02.128357 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-58ac4526-4b5f-45fb-b149-663c030326d6 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:02.129443 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-58ac4526-4b5f-45fb-b149-663c030326d6 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:02.133703 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-66416dc3-48b0-4120-859a-1c9933fe0215 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b" status: 200 len: 1217 microversion: 2.1 time: 0.093530 Jun 10 18:10:02.138342 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1913/3728] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:02 2022] GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:02.473967 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-58ac4526-4b5f-45fb-b149-663c030326d6 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d89341a3e541b2a765c011c1d751cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acded04c228a408b82bccdf323bb5a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:02.486433 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-58ac4526-4b5f-45fb-b149-663c030326d6 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] 10.222.0.35 "GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301" status: 200 len: 1317 microversion: 2.1 time: 0.376478 Jun 10 18:10:02.486433 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1816/3729] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:02 2022] GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301 => generated 1317 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:10:02.568811 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-dfd22cd4-4fbd-4ff8-8c4e-731f40e56367 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:02.569437 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-dfd22cd4-4fbd-4ff8-8c4e-731f40e56367 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:02.577073 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dfd22cd4-4fbd-4ff8-8c4e-731f40e56367 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:02.577535 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dfd22cd4-4fbd-4ff8-8c4e-731f40e56367 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:02.578863 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dfd22cd4-4fbd-4ff8-8c4e-731f40e56367 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:02.579533 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dfd22cd4-4fbd-4ff8-8c4e-731f40e56367 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:02.801324 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6b1e0738-85fd-4586-a898-9f1d53c67558 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:02.801928 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6b1e0738-85fd-4586-a898-9f1d53c67558 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] [instance: a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:02.806473 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-dfd22cd4-4fbd-4ff8-8c4e-731f40e56367 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:02.818173 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-dfd22cd4-4fbd-4ff8-8c4e-731f40e56367 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1315 microversion: 2.1 time: 0.253178 Jun 10 18:10:02.818389 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6b1e0738-85fd-4586-a898-9f1d53c67558 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:02.818839 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6b1e0738-85fd-4586-a898-9f1d53c67558 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:02.819446 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1914/3730] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:02 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:02.820526 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6b1e0738-85fd-4586-a898-9f1d53c67558 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:02.820975 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6b1e0738-85fd-4586-a898-9f1d53c67558 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:02.854099 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-d71d0436-ab4d-4c97-b49c-5e19bb30f758 req-83863ade-7460-46ac-aa79-5e17cd51deff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d514aab-bc5c-462a-a759-6182effadcbe", "name": "network-vif-plugged", "status": "completed", "tag": "c91bc6bc-9338-4e16-af93-6a63229f16dd"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:10:02.879781 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-d71d0436-ab4d-4c97-b49c-5e19bb30f758 req-83863ade-7460-46ac-aa79-5e17cd51deff service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:02.880865 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-d71d0436-ab4d-4c97-b49c-5e19bb30f758 req-83863ade-7460-46ac-aa79-5e17cd51deff service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:02.895967 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-d71d0436-ab4d-4c97-b49c-5e19bb30f758 req-83863ade-7460-46ac-aa79-5e17cd51deff service nova] Creating event network-vif-plugged:c91bc6bc-9338-4e16-af93-6a63229f16dd for instance 7d514aab-bc5c-462a-a759-6182effadcbe on chh2-master-2 Jun 10 18:10:02.902691 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-d71d0436-ab4d-4c97-b49c-5e19bb30f758 req-83863ade-7460-46ac-aa79-5e17cd51deff service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052890 Jun 10 18:10:02.904177 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1915/3731] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:10:02.964334 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8d4532da-ba4e-44f7-81e5-f3d484964e9d tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:02.965080 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8d4532da-ba4e-44f7-81e5-f3d484964e9d tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] [instance: 55d00e0b-eb97-4076-94f6-0ecf02d933cd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:02.980795 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8d4532da-ba4e-44f7-81e5-f3d484964e9d tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:02.988964 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8d4532da-ba4e-44f7-81e5-f3d484964e9d tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:02.989860 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8d4532da-ba4e-44f7-81e5-f3d484964e9d tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:02.993050 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8d4532da-ba4e-44f7-81e5-f3d484964e9d tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:02.993617 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6b1e0738-85fd-4586-a898-9f1d53c67558 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:03.034629 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6b1e0738-85fd-4586-a898-9f1d53c67558 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:03.054060 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6b1e0738-85fd-4586-a898-9f1d53c67558 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:03.058360 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6b1e0738-85fd-4586-a898-9f1d53c67558 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] 10.222.0.35 "GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9" status: 200 len: 1366 microversion: 2.57 time: 0.264839 Jun 10 18:10:03.059000 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1817/3732] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:10:02 2022] GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9 => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:10:03.153842 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e2dcd51b-659b-47a2-b32c-b00622952dbb tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:03.154795 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e2dcd51b-659b-47a2-b32c-b00622952dbb tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] [instance: 911b33c1-545d-4bcb-9ca1-c42c7bda606b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:03.262785 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e2dcd51b-659b-47a2-b32c-b00622952dbb tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc673eee8339438cbb69ac8bc8df633e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38326c7c8786498a94e003d80740c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:03.281188 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e2dcd51b-659b-47a2-b32c-b00622952dbb tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b" status: 200 len: 1217 microversion: 2.1 time: 0.125698 Jun 10 18:10:03.281188 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1818/3733] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:03 2022] GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b => generated 1217 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:03.318247 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8d4532da-ba4e-44f7-81e5-f3d484964e9d tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0c14dee0e14114aa63c2496ef2d4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088c9a2a1f8a429eba4b4a68c9bade12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:03.331748 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8d4532da-ba4e-44f7-81e5-f3d484964e9d tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd" status: 200 len: 1313 microversion: 2.1 time: 0.378822 Jun 10 18:10:03.331966 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1916/3734] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:02 2022] GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd => generated 1313 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:03.505279 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bec05884-36fa-4317-8345-b6cd59e6518b tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:03.506436 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bec05884-36fa-4317-8345-b6cd59e6518b tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] [instance: 38887a36-3b6b-48ad-b967-77a941762301] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:03.513936 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bec05884-36fa-4317-8345-b6cd59e6518b tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:03.514669 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bec05884-36fa-4317-8345-b6cd59e6518b tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:03.516213 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bec05884-36fa-4317-8345-b6cd59e6518b tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:03.517014 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bec05884-36fa-4317-8345-b6cd59e6518b tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:03.752265 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-fdbd5955-39df-4962-ba12-ec537a4d7b8f req-d855a21f-5e23-4b6c-a2a4-6d424cf28447 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38887a36-3b6b-48ad-b967-77a941762301", "tag": "6a372080-5ad3-4b6e-9715-fca55eed9b4d"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:10:03.761354 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-fdbd5955-39df-4962-ba12-ec537a4d7b8f req-d855a21f-5e23-4b6c-a2a4-6d424cf28447 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:03.766525 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-fdbd5955-39df-4962-ba12-ec537a4d7b8f req-d855a21f-5e23-4b6c-a2a4-6d424cf28447 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:03.786986 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-fdbd5955-39df-4962-ba12-ec537a4d7b8f req-d855a21f-5e23-4b6c-a2a4-6d424cf28447 service nova] Creating event network-changed:6a372080-5ad3-4b6e-9715-fca55eed9b4d for instance 38887a36-3b6b-48ad-b967-77a941762301 on chh1-master-2 Jun 10 18:10:03.794370 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-fdbd5955-39df-4962-ba12-ec537a4d7b8f req-d855a21f-5e23-4b6c-a2a4-6d424cf28447 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045236 Jun 10 18:10:03.795229 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1917/3735] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:10:03.837026 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a134f81d-d1d9-4436-8ccf-ccb7e09041c9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:03.837739 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a134f81d-d1d9-4436-8ccf-ccb7e09041c9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:03.852201 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a134f81d-d1d9-4436-8ccf-ccb7e09041c9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:03.852697 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a134f81d-d1d9-4436-8ccf-ccb7e09041c9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:03.853649 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a134f81d-d1d9-4436-8ccf-ccb7e09041c9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:03.854265 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a134f81d-d1d9-4436-8ccf-ccb7e09041c9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:04.121790 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bec05884-36fa-4317-8345-b6cd59e6518b tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d89341a3e541b2a765c011c1d751cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acded04c228a408b82bccdf323bb5a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:04.137816 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bec05884-36fa-4317-8345-b6cd59e6518b tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] 10.222.0.35 "GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301" status: 200 len: 1317 microversion: 2.1 time: 0.637441 Jun 10 18:10:04.138753 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a134f81d-d1d9-4436-8ccf-ccb7e09041c9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:04.139904 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1819/3736] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:03 2022] GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301 => generated 1317 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:04.150355 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a134f81d-d1d9-4436-8ccf-ccb7e09041c9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1315 microversion: 2.1 time: 0.315853 Jun 10 18:10:04.152464 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1918/3737] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:03 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:04.161468 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cc417047-4d05-450d-9b7b-72a5c620d4ca tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:04.167547 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cc417047-4d05-450d-9b7b-72a5c620d4ca tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] [instance: a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:04.192858 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc417047-4d05-450d-9b7b-72a5c620d4ca tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:04.198375 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc417047-4d05-450d-9b7b-72a5c620d4ca tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:04.198375 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc417047-4d05-450d-9b7b-72a5c620d4ca tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:04.198375 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc417047-4d05-450d-9b7b-72a5c620d4ca tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:04.296578 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b7e7243a-4f0b-48e6-a5b5-e0ffb2e34c8e tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:04.297491 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b7e7243a-4f0b-48e6-a5b5-e0ffb2e34c8e tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] [instance: 911b33c1-545d-4bcb-9ca1-c42c7bda606b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:04.307280 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b7e7243a-4f0b-48e6-a5b5-e0ffb2e34c8e tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:04.307771 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b7e7243a-4f0b-48e6-a5b5-e0ffb2e34c8e tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:04.310995 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b7e7243a-4f0b-48e6-a5b5-e0ffb2e34c8e tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:04.311479 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b7e7243a-4f0b-48e6-a5b5-e0ffb2e34c8e tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:04.350249 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cc417047-4d05-450d-9b7b-72a5c620d4ca tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:04.374674 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cc417047-4d05-450d-9b7b-72a5c620d4ca tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:04.377007 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cc417047-4d05-450d-9b7b-72a5c620d4ca tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:04.380759 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cc417047-4d05-450d-9b7b-72a5c620d4ca tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] 10.222.0.35 "GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9" status: 200 len: 1366 microversion: 2.57 time: 0.239618 Jun 10 18:10:04.382471 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1820/3738] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:10:04 2022] GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9 => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:10:04.387338 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-733ce731-15b9-4676-a319-878721d10061 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:04.393191 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-733ce731-15b9-4676-a319-878721d10061 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] [instance: 55d00e0b-eb97-4076-94f6-0ecf02d933cd] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:04.423162 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-733ce731-15b9-4676-a319-878721d10061 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:04.423162 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-733ce731-15b9-4676-a319-878721d10061 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:04.424880 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-733ce731-15b9-4676-a319-878721d10061 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:04.425578 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-733ce731-15b9-4676-a319-878721d10061 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:04.454815 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b7e7243a-4f0b-48e6-a5b5-e0ffb2e34c8e tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc673eee8339438cbb69ac8bc8df633e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38326c7c8786498a94e003d80740c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:04.458335 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:10:04.475284 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b7e7243a-4f0b-48e6-a5b5-e0ffb2e34c8e tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b" status: 200 len: 1221 microversion: 2.1 time: 0.177500 Jun 10 18:10:04.486922 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1919/3739] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:04 2022] GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b => generated 1221 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:04.974495 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-733ce731-15b9-4676-a319-878721d10061 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0c14dee0e14114aa63c2496ef2d4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088c9a2a1f8a429eba4b4a68c9bade12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:04.984724 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-733ce731-15b9-4676-a319-878721d10061 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd" status: 200 len: 1313 microversion: 2.1 time: 0.598969 Jun 10 18:10:04.988389 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1821/3740] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:04 2022] GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd => generated 1313 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:05.160138 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-dc47564c-6c1f-4de0-a7ab-69d3b7a1d762 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:05.161781 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-dc47564c-6c1f-4de0-a7ab-69d3b7a1d762 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] [instance: 38887a36-3b6b-48ad-b967-77a941762301] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:05.169542 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ebc0998a-9c25-443d-a1d0-eb9aa59e94ea tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:05.172187 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ebc0998a-9c25-443d-a1d0-eb9aa59e94ea tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:05.187039 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ebc0998a-9c25-443d-a1d0-eb9aa59e94ea tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:05.187796 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ebc0998a-9c25-443d-a1d0-eb9aa59e94ea tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:05.190084 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ebc0998a-9c25-443d-a1d0-eb9aa59e94ea tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:05.191312 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dc47564c-6c1f-4de0-a7ab-69d3b7a1d762 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:05.191787 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dc47564c-6c1f-4de0-a7ab-69d3b7a1d762 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:05.193085 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ebc0998a-9c25-443d-a1d0-eb9aa59e94ea tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:05.197658 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dc47564c-6c1f-4de0-a7ab-69d3b7a1d762 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:05.201087 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dc47564c-6c1f-4de0-a7ab-69d3b7a1d762 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:05.570124 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-dc47564c-6c1f-4de0-a7ab-69d3b7a1d762 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d89341a3e541b2a765c011c1d751cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acded04c228a408b82bccdf323bb5a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:05.592855 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-dc47564c-6c1f-4de0-a7ab-69d3b7a1d762 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] 10.222.0.35 "GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301" status: 200 len: 1317 microversion: 2.1 time: 0.441087 Jun 10 18:10:05.593556 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1920/3741] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:05 2022] GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301 => generated 1317 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:10:05.610094 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1e2db1b0-1bea-4c45-a9fe-f68579db29b8 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:05.611395 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1e2db1b0-1bea-4c45-a9fe-f68579db29b8 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] [instance: a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:05.622764 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1e2db1b0-1bea-4c45-a9fe-f68579db29b8 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:05.623882 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1e2db1b0-1bea-4c45-a9fe-f68579db29b8 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:05.625130 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1e2db1b0-1bea-4c45-a9fe-f68579db29b8 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:05.626731 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1e2db1b0-1bea-4c45-a9fe-f68579db29b8 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:05.687408 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ebc0998a-9c25-443d-a1d0-eb9aa59e94ea tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:05.698118 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ebc0998a-9c25-443d-a1d0-eb9aa59e94ea tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1502 microversion: 2.1 time: 0.532552 Jun 10 18:10:05.699308 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1822/3742] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:05 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1502 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:10:05.707311 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-64414cf3-4d7b-418f-b745-d8072b6a347e tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:05.708190 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-64414cf3-4d7b-418f-b745-d8072b6a347e tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] [instance: 911b33c1-545d-4bcb-9ca1-c42c7bda606b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:05.716156 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-64414cf3-4d7b-418f-b745-d8072b6a347e tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:05.717083 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-64414cf3-4d7b-418f-b745-d8072b6a347e tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:05.717906 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-64414cf3-4d7b-418f-b745-d8072b6a347e tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:05.718574 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-64414cf3-4d7b-418f-b745-d8072b6a347e tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:05.819382 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1e2db1b0-1bea-4c45-a9fe-f68579db29b8 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:05.834234 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1e2db1b0-1bea-4c45-a9fe-f68579db29b8 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:05.838048 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1e2db1b0-1bea-4c45-a9fe-f68579db29b8 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:05.838048 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1e2db1b0-1bea-4c45-a9fe-f68579db29b8 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] 10.222.0.35 "GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9" status: 200 len: 1366 microversion: 2.57 time: 0.242712 Jun 10 18:10:05.838048 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1921/3743] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:10:05 2022] GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9 => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:10:05.848769 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-44d89f2b-0652-4e37-aea1-576241b4df30 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:10:05.854819 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-64414cf3-4d7b-418f-b745-d8072b6a347e tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc673eee8339438cbb69ac8bc8df633e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38326c7c8786498a94e003d80740c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:05.858292 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-44d89f2b-0652-4e37-aea1-576241b4df30 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:05.867640 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-64414cf3-4d7b-418f-b745-d8072b6a347e tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b" status: 200 len: 1269 microversion: 2.1 time: 0.166525 Jun 10 18:10:05.868351 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1823/3744] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:05 2022] GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b => generated 1269 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:05.870850 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-44d89f2b-0652-4e37-aea1-576241b4df30 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:05.875777 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-44d89f2b-0652-4e37-aea1-576241b4df30 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:05.876640 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-44d89f2b-0652-4e37-aea1-576241b4df30 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:05.881817 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-44d89f2b-0652-4e37-aea1-576241b4df30 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:05.885683 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-dafede9f-86c0-493a-9494-433be0356082 req-dddd22c4-137c-4b74-8ebe-5e585bb6f358 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55d00e0b-eb97-4076-94f6-0ecf02d933cd", "tag": "86b443a4-9d66-43c7-a118-7e396dad778a"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:10:05.896692 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-dafede9f-86c0-493a-9494-433be0356082 req-dddd22c4-137c-4b74-8ebe-5e585bb6f358 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:05.901300 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-dafede9f-86c0-493a-9494-433be0356082 req-dddd22c4-137c-4b74-8ebe-5e585bb6f358 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:05.934982 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-44d89f2b-0652-4e37-aea1-576241b4df30 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lazy-loading 'flavor' on Instance uuid 7d514aab-bc5c-462a-a759-6182effadcbe {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:10:05.954432 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-dafede9f-86c0-493a-9494-433be0356082 req-dddd22c4-137c-4b74-8ebe-5e585bb6f358 service nova] Creating event network-changed:86b443a4-9d66-43c7-a118-7e396dad778a for instance 55d00e0b-eb97-4076-94f6-0ecf02d933cd on chh1-master-2 Jun 10 18:10:05.968251 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-dafede9f-86c0-493a-9494-433be0356082 req-dddd22c4-137c-4b74-8ebe-5e585bb6f358 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089292 Jun 10 18:10:05.969546 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1824/3745] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:10:06.007121 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6d877d2d-b4c5-4b02-89ff-302532d3a3f5 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:06.008019 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6d877d2d-b4c5-4b02-89ff-302532d3a3f5 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] [instance: 55d00e0b-eb97-4076-94f6-0ecf02d933cd] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:06.023485 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d877d2d-b4c5-4b02-89ff-302532d3a3f5 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:06.024257 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d877d2d-b4c5-4b02-89ff-302532d3a3f5 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:06.025511 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d877d2d-b4c5-4b02-89ff-302532d3a3f5 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:06.026117 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d877d2d-b4c5-4b02-89ff-302532d3a3f5 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:06.332289 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6d877d2d-b4c5-4b02-89ff-302532d3a3f5 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0c14dee0e14114aa63c2496ef2d4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088c9a2a1f8a429eba4b4a68c9bade12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:06.347208 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6d877d2d-b4c5-4b02-89ff-302532d3a3f5 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd" status: 200 len: 1313 microversion: 2.1 time: 0.349634 Jun 10 18:10:06.348667 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1825/3746] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:05 2022] GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd => generated 1313 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:10:06.610479 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2b3dbe02-8f0c-4ffc-bf22-8d6fb41a7c1c tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:06.611100 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2b3dbe02-8f0c-4ffc-bf22-8d6fb41a7c1c tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] [instance: 38887a36-3b6b-48ad-b967-77a941762301] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:06.617914 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2b3dbe02-8f0c-4ffc-bf22-8d6fb41a7c1c tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:06.618723 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2b3dbe02-8f0c-4ffc-bf22-8d6fb41a7c1c tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:06.619601 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2b3dbe02-8f0c-4ffc-bf22-8d6fb41a7c1c tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:06.620462 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2b3dbe02-8f0c-4ffc-bf22-8d6fb41a7c1c tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:06.660226 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-44d89f2b-0652-4e37-aea1-576241b4df30 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "POST /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe/action" status: 202 len: 0 microversion: 2.1 time: 0.817175 Jun 10 18:10:06.661666 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1922/3747] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:10:05 2022] POST /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe/action => generated 0 bytes in 823 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:10:06.678169 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1b08fddf-432c-4eab-8a1f-7e8abe4ecf70 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:06.680531 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1b08fddf-432c-4eab-8a1f-7e8abe4ecf70 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:06.687929 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1b08fddf-432c-4eab-8a1f-7e8abe4ecf70 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:06.688712 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1b08fddf-432c-4eab-8a1f-7e8abe4ecf70 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:06.689757 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1b08fddf-432c-4eab-8a1f-7e8abe4ecf70 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:06.690433 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1b08fddf-432c-4eab-8a1f-7e8abe4ecf70 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:06.799978 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2b3dbe02-8f0c-4ffc-bf22-8d6fb41a7c1c tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d89341a3e541b2a765c011c1d751cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acded04c228a408b82bccdf323bb5a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:06.812183 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2b3dbe02-8f0c-4ffc-bf22-8d6fb41a7c1c tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] 10.222.0.35 "GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301" status: 200 len: 1317 microversion: 2.1 time: 0.205772 Jun 10 18:10:06.813785 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1826/3748] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:06 2022] GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301 => generated 1317 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:06.854882 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a01530f1-02b2-432a-9016-a9c5e640e404 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:06.855730 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a01530f1-02b2-432a-9016-a9c5e640e404 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] [instance: a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:06.864398 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a01530f1-02b2-432a-9016-a9c5e640e404 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:06.870361 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a01530f1-02b2-432a-9016-a9c5e640e404 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:06.870361 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a01530f1-02b2-432a-9016-a9c5e640e404 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:06.870361 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a01530f1-02b2-432a-9016-a9c5e640e404 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:06.978555 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1b08fddf-432c-4eab-8a1f-7e8abe4ecf70 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:06.985813 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a01530f1-02b2-432a-9016-a9c5e640e404 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:06.989691 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1b08fddf-432c-4eab-8a1f-7e8abe4ecf70 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1508 microversion: 2.1 time: 0.322206 Jun 10 18:10:07.000266 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1923/3749] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:06 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1508 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:07.004528 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0f3f6ee9-9ffa-4528-9731-ab471be17017 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:07.005232 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0f3f6ee9-9ffa-4528-9731-ab471be17017 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] [instance: 911b33c1-545d-4bcb-9ca1-c42c7bda606b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:07.006679 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a01530f1-02b2-432a-9016-a9c5e640e404 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:07.008292 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a01530f1-02b2-432a-9016-a9c5e640e404 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:07.009590 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a01530f1-02b2-432a-9016-a9c5e640e404 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] 10.222.0.35 "GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9" status: 200 len: 1366 microversion: 2.57 time: 0.158530 Jun 10 18:10:07.010256 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1827/3750] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:10:06 2022] GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:10:07.018297 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0f3f6ee9-9ffa-4528-9731-ab471be17017 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:07.018869 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0f3f6ee9-9ffa-4528-9731-ab471be17017 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:07.019889 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0f3f6ee9-9ffa-4528-9731-ab471be17017 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:07.020581 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0f3f6ee9-9ffa-4528-9731-ab471be17017 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:07.142727 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0f3f6ee9-9ffa-4528-9731-ab471be17017 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc673eee8339438cbb69ac8bc8df633e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38326c7c8786498a94e003d80740c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:07.151095 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0f3f6ee9-9ffa-4528-9731-ab471be17017 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b" status: 200 len: 1275 microversion: 2.1 time: 0.158913 Jun 10 18:10:07.156434 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1924/3751] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:06 2022] GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b => generated 1275 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:07.372247 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2b2997c7-46e3-4e06-b6c8-00bfcce9eaa3 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:07.372247 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2b2997c7-46e3-4e06-b6c8-00bfcce9eaa3 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] [instance: 55d00e0b-eb97-4076-94f6-0ecf02d933cd] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:07.378173 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2b2997c7-46e3-4e06-b6c8-00bfcce9eaa3 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:07.378897 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2b2997c7-46e3-4e06-b6c8-00bfcce9eaa3 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:07.379871 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2b2997c7-46e3-4e06-b6c8-00bfcce9eaa3 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:07.380558 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2b2997c7-46e3-4e06-b6c8-00bfcce9eaa3 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:07.565623 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2b2997c7-46e3-4e06-b6c8-00bfcce9eaa3 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0c14dee0e14114aa63c2496ef2d4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088c9a2a1f8a429eba4b4a68c9bade12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:07.579532 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2b2997c7-46e3-4e06-b6c8-00bfcce9eaa3 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd" status: 200 len: 1313 microversion: 2.1 time: 0.218134 Jun 10 18:10:07.580835 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1828/3752] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:07 2022] GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:07.830785 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-43282495-34e3-4efd-9f09-a23398cdca19 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:07.832233 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-43282495-34e3-4efd-9f09-a23398cdca19 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] [instance: 38887a36-3b6b-48ad-b967-77a941762301] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:07.836714 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=4 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:10:07.841789 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-43282495-34e3-4efd-9f09-a23398cdca19 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:07.855950 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-43282495-34e3-4efd-9f09-a23398cdca19 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:07.857531 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-43282495-34e3-4efd-9f09-a23398cdca19 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:07.858914 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-43282495-34e3-4efd-9f09-a23398cdca19 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:08.010715 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-86f149e7-2480-4164-b78a-0b1879a5ab05 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:08.011860 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-86f149e7-2480-4164-b78a-0b1879a5ab05 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:08.028574 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86f149e7-2480-4164-b78a-0b1879a5ab05 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:08.029763 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86f149e7-2480-4164-b78a-0b1879a5ab05 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:08.031916 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86f149e7-2480-4164-b78a-0b1879a5ab05 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:08.034653 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86f149e7-2480-4164-b78a-0b1879a5ab05 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:08.136415 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-43282495-34e3-4efd-9f09-a23398cdca19 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d89341a3e541b2a765c011c1d751cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acded04c228a408b82bccdf323bb5a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:08.164185 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-43282495-34e3-4efd-9f09-a23398cdca19 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] 10.222.0.35 "GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301" status: 200 len: 1317 microversion: 2.1 time: 0.326463 Jun 10 18:10:08.164185 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1925/3753] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:07 2022] GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301 => generated 1317 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:08.176749 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d5a95453-ffe4-4e04-8fd3-e5e1a953c5db tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:08.177504 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d5a95453-ffe4-4e04-8fd3-e5e1a953c5db tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] [instance: a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:08.191912 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d5a95453-ffe4-4e04-8fd3-e5e1a953c5db tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:08.192398 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d5a95453-ffe4-4e04-8fd3-e5e1a953c5db tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:08.193182 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d5a95453-ffe4-4e04-8fd3-e5e1a953c5db tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:08.193623 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d5a95453-ffe4-4e04-8fd3-e5e1a953c5db tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:08.339430 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d5a95453-ffe4-4e04-8fd3-e5e1a953c5db tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:08.352436 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d5a95453-ffe4-4e04-8fd3-e5e1a953c5db tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:08.355860 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d5a95453-ffe4-4e04-8fd3-e5e1a953c5db tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:08.359836 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d5a95453-ffe4-4e04-8fd3-e5e1a953c5db tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] 10.222.0.35 "GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9" status: 200 len: 1366 microversion: 2.57 time: 0.194489 Jun 10 18:10:08.361138 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1926/3754] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:10:08 2022] GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9 => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:10:08.367770 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a116cceb-9bef-4e13-b162-441a5f826fda tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:08.368735 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a116cceb-9bef-4e13-b162-441a5f826fda tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] [instance: 911b33c1-545d-4bcb-9ca1-c42c7bda606b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:08.385075 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a116cceb-9bef-4e13-b162-441a5f826fda tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:08.387803 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a116cceb-9bef-4e13-b162-441a5f826fda tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:08.388966 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a116cceb-9bef-4e13-b162-441a5f826fda tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:08.392556 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a116cceb-9bef-4e13-b162-441a5f826fda tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:08.770039 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-86f149e7-2480-4164-b78a-0b1879a5ab05 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:08.778962 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-86f149e7-2480-4164-b78a-0b1879a5ab05 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1508 microversion: 2.1 time: 0.775166 Jun 10 18:10:08.794207 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1829/3755] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:08 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1508 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:10:08.801340 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9fa870c5-788a-430c-8b6c-f4d09a7405c2 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:08.813593 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9fa870c5-788a-430c-8b6c-f4d09a7405c2 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] [instance: 55d00e0b-eb97-4076-94f6-0ecf02d933cd] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:08.828959 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9fa870c5-788a-430c-8b6c-f4d09a7405c2 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:08.831450 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9fa870c5-788a-430c-8b6c-f4d09a7405c2 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:08.833360 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9fa870c5-788a-430c-8b6c-f4d09a7405c2 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:08.834988 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a116cceb-9bef-4e13-b162-441a5f826fda tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc673eee8339438cbb69ac8bc8df633e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38326c7c8786498a94e003d80740c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:08.836004 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9fa870c5-788a-430c-8b6c-f4d09a7405c2 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:08.843633 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a116cceb-9bef-4e13-b162-441a5f826fda tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b" status: 200 len: 1317 microversion: 2.1 time: 0.480428 Jun 10 18:10:08.844233 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1927/3756] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:08 2022] GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b => generated 1317 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:09.114239 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9fa870c5-788a-430c-8b6c-f4d09a7405c2 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0c14dee0e14114aa63c2496ef2d4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088c9a2a1f8a429eba4b4a68c9bade12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:09.124799 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9fa870c5-788a-430c-8b6c-f4d09a7405c2 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd" status: 200 len: 1313 microversion: 2.1 time: 0.326637 Jun 10 18:10:09.126126 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1830/3757] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:08 2022] GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd => generated 1313 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:09.172624 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e9f160e8-fe91-42c4-a5ce-974d5989957e tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:09.173264 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e9f160e8-fe91-42c4-a5ce-974d5989957e tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] [instance: 38887a36-3b6b-48ad-b967-77a941762301] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:09.189144 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e9f160e8-fe91-42c4-a5ce-974d5989957e tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:09.189608 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e9f160e8-fe91-42c4-a5ce-974d5989957e tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:09.190403 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e9f160e8-fe91-42c4-a5ce-974d5989957e tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:09.191642 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e9f160e8-fe91-42c4-a5ce-974d5989957e tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:09.380492 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4f5fc056-3146-4b93-a742-44fdaa35a3fe tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:09.381422 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4f5fc056-3146-4b93-a742-44fdaa35a3fe tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] [instance: a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:09.409521 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f5fc056-3146-4b93-a742-44fdaa35a3fe tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:09.409991 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f5fc056-3146-4b93-a742-44fdaa35a3fe tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:09.414281 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e9f160e8-fe91-42c4-a5ce-974d5989957e tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d89341a3e541b2a765c011c1d751cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acded04c228a408b82bccdf323bb5a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:09.427168 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f5fc056-3146-4b93-a742-44fdaa35a3fe tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:09.427993 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f5fc056-3146-4b93-a742-44fdaa35a3fe tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:09.433578 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e9f160e8-fe91-42c4-a5ce-974d5989957e tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] 10.222.0.35 "GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301" status: 200 len: 1317 microversion: 2.1 time: 0.267002 Jun 10 18:10:09.452780 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1928/3758] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:09 2022] GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301 => generated 1317 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:09.726599 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4f5fc056-3146-4b93-a742-44fdaa35a3fe tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:09.751052 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4f5fc056-3146-4b93-a742-44fdaa35a3fe tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:09.752613 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4f5fc056-3146-4b93-a742-44fdaa35a3fe tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:09.753840 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4f5fc056-3146-4b93-a742-44fdaa35a3fe tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] 10.222.0.35 "GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9" status: 200 len: 1366 microversion: 2.57 time: 0.378105 Jun 10 18:10:09.776726 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1831/3759] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:10:09 2022] GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9 => generated 1366 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:10:09.799929 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7ce03520-737e-4df4-ac11-848e95acd571 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:09.800946 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7ce03520-737e-4df4-ac11-848e95acd571 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:09.818427 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ce03520-737e-4df4-ac11-848e95acd571 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:09.829036 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ce03520-737e-4df4-ac11-848e95acd571 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:09.830233 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ce03520-737e-4df4-ac11-848e95acd571 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:09.830786 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ce03520-737e-4df4-ac11-848e95acd571 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:09.862550 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d0d01a5b-b121-42ea-be71-0ceb664c44bd tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:09.863198 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d0d01a5b-b121-42ea-be71-0ceb664c44bd tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] [instance: 911b33c1-545d-4bcb-9ca1-c42c7bda606b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:09.871122 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d0d01a5b-b121-42ea-be71-0ceb664c44bd tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:09.872542 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d0d01a5b-b121-42ea-be71-0ceb664c44bd tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:09.875398 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d0d01a5b-b121-42ea-be71-0ceb664c44bd tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:09.876553 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d0d01a5b-b121-42ea-be71-0ceb664c44bd tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:10.362526 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7ce03520-737e-4df4-ac11-848e95acd571 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:10.366710 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:10:10.372107 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7ce03520-737e-4df4-ac11-848e95acd571 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1508 microversion: 2.1 time: 0.576335 Jun 10 18:10:10.376400 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1929/3760] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:09 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1508 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:10.400498 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ab1a8321-8361-4774-a9d7-d9343d2c7622 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:10.401274 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ab1a8321-8361-4774-a9d7-d9343d2c7622 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] [instance: 55d00e0b-eb97-4076-94f6-0ecf02d933cd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:10.409649 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d0d01a5b-b121-42ea-be71-0ceb664c44bd tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc673eee8339438cbb69ac8bc8df633e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38326c7c8786498a94e003d80740c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:10.419988 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ab1a8321-8361-4774-a9d7-d9343d2c7622 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:10.420774 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ab1a8321-8361-4774-a9d7-d9343d2c7622 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:10.421733 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ab1a8321-8361-4774-a9d7-d9343d2c7622 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:10.422271 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ab1a8321-8361-4774-a9d7-d9343d2c7622 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:10.424208 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d0d01a5b-b121-42ea-be71-0ceb664c44bd tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b" status: 200 len: 1317 microversion: 2.1 time: 0.567473 Jun 10 18:10:10.425284 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1832/3761] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:09 2022] GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b => generated 1317 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:10:10.452129 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bb7a8c6c-e665-44fa-b151-767ddd8394da tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:10.452792 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bb7a8c6c-e665-44fa-b151-767ddd8394da tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] [instance: 38887a36-3b6b-48ad-b967-77a941762301] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:10.466280 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb7a8c6c-e665-44fa-b151-767ddd8394da tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:10.469586 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb7a8c6c-e665-44fa-b151-767ddd8394da tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:10.472024 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb7a8c6c-e665-44fa-b151-767ddd8394da tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:10.472549 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb7a8c6c-e665-44fa-b151-767ddd8394da tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:10.806837 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ab1a8321-8361-4774-a9d7-d9343d2c7622 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0c14dee0e14114aa63c2496ef2d4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088c9a2a1f8a429eba4b4a68c9bade12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:10.827459 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ab1a8321-8361-4774-a9d7-d9343d2c7622 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd" status: 200 len: 1313 microversion: 2.1 time: 0.437674 Jun 10 18:10:10.829326 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1930/3762] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:10 2022] GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd => generated 1313 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:10.834510 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-06f1766a-11b4-4742-b984-6aab71084269 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:10.835434 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-06f1766a-11b4-4742-b984-6aab71084269 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] [instance: a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:10.851053 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-06f1766a-11b4-4742-b984-6aab71084269 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:10.853869 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-06f1766a-11b4-4742-b984-6aab71084269 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:10.857206 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-06f1766a-11b4-4742-b984-6aab71084269 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:10.857912 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-06f1766a-11b4-4742-b984-6aab71084269 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:10.909299 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bb7a8c6c-e665-44fa-b151-767ddd8394da tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d89341a3e541b2a765c011c1d751cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acded04c228a408b82bccdf323bb5a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:10.922827 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bb7a8c6c-e665-44fa-b151-767ddd8394da tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] 10.222.0.35 "GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301" status: 200 len: 1317 microversion: 2.1 time: 0.475287 Jun 10 18:10:10.937712 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1833/3763] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:10 2022] GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301 => generated 1317 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:10:10.943531 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-78f2f3af-65e1-43a9-bd2f-28f7c8f37647 req-323601a5-62b7-47ce-9765-b25ed8c36c51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "911b33c1-545d-4bcb-9ca1-c42c7bda606b", "tag": "a7249e1c-d1cb-43c4-9fa6-d68705a79807"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:10:10.959326 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-78f2f3af-65e1-43a9-bd2f-28f7c8f37647 req-323601a5-62b7-47ce-9765-b25ed8c36c51 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:10.960102 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-78f2f3af-65e1-43a9-bd2f-28f7c8f37647 req-323601a5-62b7-47ce-9765-b25ed8c36c51 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:10.974368 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-78f2f3af-65e1-43a9-bd2f-28f7c8f37647 req-323601a5-62b7-47ce-9765-b25ed8c36c51 service nova] Creating event network-changed:a7249e1c-d1cb-43c4-9fa6-d68705a79807 for instance 911b33c1-545d-4bcb-9ca1-c42c7bda606b on chh2-master-2 Jun 10 18:10:10.991411 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-78f2f3af-65e1-43a9-bd2f-28f7c8f37647 req-323601a5-62b7-47ce-9765-b25ed8c36c51 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051869 Jun 10 18:10:10.992677 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1834/3764] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:10:11.115648 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-06f1766a-11b4-4742-b984-6aab71084269 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:11.124737 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-06f1766a-11b4-4742-b984-6aab71084269 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:11.130852 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-06f1766a-11b4-4742-b984-6aab71084269 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:11.132246 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-06f1766a-11b4-4742-b984-6aab71084269 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] 10.222.0.35 "GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9" status: 200 len: 1372 microversion: 2.57 time: 0.301656 Jun 10 18:10:11.135194 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1931/3765] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:10:10 2022] GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9 => generated 1372 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:10:11.399269 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dd5963b4-6853-4f65-9962-482907f784d0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:11.406122 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dd5963b4-6853-4f65-9962-482907f784d0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:11.458142 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4b5d15d5-af37-4303-85f0-60cbd1825eea tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:11.459585 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4b5d15d5-af37-4303-85f0-60cbd1825eea tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] [instance: 911b33c1-545d-4bcb-9ca1-c42c7bda606b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:11.467615 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd5963b4-6853-4f65-9962-482907f784d0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:11.474172 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd5963b4-6853-4f65-9962-482907f784d0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:11.484821 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd5963b4-6853-4f65-9962-482907f784d0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:11.501439 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd5963b4-6853-4f65-9962-482907f784d0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:11.504946 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4b5d15d5-af37-4303-85f0-60cbd1825eea tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:11.509972 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4b5d15d5-af37-4303-85f0-60cbd1825eea tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:11.518922 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4b5d15d5-af37-4303-85f0-60cbd1825eea tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:11.518922 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4b5d15d5-af37-4303-85f0-60cbd1825eea tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:11.790693 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-dd5963b4-6853-4f65-9962-482907f784d0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:11.807998 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:10:11.812067 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dd5963b4-6853-4f65-9962-482907f784d0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1508 microversion: 2.1 time: 0.422198 Jun 10 18:10:11.813452 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1835/3766] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:11 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1508 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:11.845964 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-05a8860f-5b3f-45ae-9a5f-4479fda64a7c tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:11.846453 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-05a8860f-5b3f-45ae-9a5f-4479fda64a7c tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] [instance: 55d00e0b-eb97-4076-94f6-0ecf02d933cd] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:11.854204 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05a8860f-5b3f-45ae-9a5f-4479fda64a7c tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:11.854798 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05a8860f-5b3f-45ae-9a5f-4479fda64a7c tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:11.855878 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05a8860f-5b3f-45ae-9a5f-4479fda64a7c tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:11.856568 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05a8860f-5b3f-45ae-9a5f-4479fda64a7c tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:12.003770 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4b5d15d5-af37-4303-85f0-60cbd1825eea tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc673eee8339438cbb69ac8bc8df633e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38326c7c8786498a94e003d80740c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:12.021778 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4b5d15d5-af37-4303-85f0-60cbd1825eea tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b" status: 200 len: 1317 microversion: 2.1 time: 0.583480 Jun 10 18:10:12.023367 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1932/3767] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:11 2022] GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b => generated 1317 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:12.036545 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e9d16ccb-bb6a-4944-b9ae-88380e5f3c02 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:12.036545 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e9d16ccb-bb6a-4944-b9ae-88380e5f3c02 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] [instance: 38887a36-3b6b-48ad-b967-77a941762301] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:12.041900 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e9d16ccb-bb6a-4944-b9ae-88380e5f3c02 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:12.043100 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e9d16ccb-bb6a-4944-b9ae-88380e5f3c02 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:12.044423 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e9d16ccb-bb6a-4944-b9ae-88380e5f3c02 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:12.045092 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e9d16ccb-bb6a-4944-b9ae-88380e5f3c02 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:12.096448 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-05a8860f-5b3f-45ae-9a5f-4479fda64a7c tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0c14dee0e14114aa63c2496ef2d4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088c9a2a1f8a429eba4b4a68c9bade12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:12.106649 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-05a8860f-5b3f-45ae-9a5f-4479fda64a7c tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd" status: 200 len: 1313 microversion: 2.1 time: 0.264091 Jun 10 18:10:12.111351 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1836/3768] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:11 2022] GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:12.120758 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-3024c5c1-3a05-40a1-874a-fb5f53df1b70 req-126b7d7f-eb32-4d4e-8a61-8ceb0f24ddde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38887a36-3b6b-48ad-b967-77a941762301", "name": "network-vif-plugged", "status": "completed", "tag": "6a372080-5ad3-4b6e-9715-fca55eed9b4d"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:10:12.133073 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-3024c5c1-3a05-40a1-874a-fb5f53df1b70 req-126b7d7f-eb32-4d4e-8a61-8ceb0f24ddde service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:12.134357 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-3024c5c1-3a05-40a1-874a-fb5f53df1b70 req-126b7d7f-eb32-4d4e-8a61-8ceb0f24ddde service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:12.136043 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=24 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:10:12.155692 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-3024c5c1-3a05-40a1-874a-fb5f53df1b70 req-126b7d7f-eb32-4d4e-8a61-8ceb0f24ddde service nova] Creating event network-vif-plugged:6a372080-5ad3-4b6e-9715-fca55eed9b4d for instance 38887a36-3b6b-48ad-b967-77a941762301 on chh1-master-2 Jun 10 18:10:12.178228 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-3024c5c1-3a05-40a1-874a-fb5f53df1b70 req-126b7d7f-eb32-4d4e-8a61-8ceb0f24ddde service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065563 Jun 10 18:10:12.179563 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1837/3769] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:10:12.194212 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2d6c3c80-dcfc-4ac2-91c0-2860d280ebd1 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:12.196884 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2d6c3c80-dcfc-4ac2-91c0-2860d280ebd1 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] [instance: a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:12.215465 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2d6c3c80-dcfc-4ac2-91c0-2860d280ebd1 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:12.216207 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2d6c3c80-dcfc-4ac2-91c0-2860d280ebd1 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:12.219437 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2d6c3c80-dcfc-4ac2-91c0-2860d280ebd1 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:12.220126 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2d6c3c80-dcfc-4ac2-91c0-2860d280ebd1 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:12.440862 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2d6c3c80-dcfc-4ac2-91c0-2860d280ebd1 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:12.472830 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2d6c3c80-dcfc-4ac2-91c0-2860d280ebd1 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:12.496073 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2d6c3c80-dcfc-4ac2-91c0-2860d280ebd1 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:12.509478 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2d6c3c80-dcfc-4ac2-91c0-2860d280ebd1 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] 10.222.0.35 "GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9" status: 200 len: 1372 microversion: 2.57 time: 0.327329 Jun 10 18:10:12.522826 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1838/3770] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:10:12 2022] GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9 => generated 1372 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:10:12.529017 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5d9d1f3a-2975-4028-bb3d-b9019fa6a5fa tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e40940bd-e343-4cf7-a598-5f26bcbed548"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:10:12.530407 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5d9d1f3a-2975-4028-bb3d-b9019fa6a5fa tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:12.537271 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5d9d1f3a-2975-4028-bb3d-b9019fa6a5fa tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:12.538094 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5d9d1f3a-2975-4028-bb3d-b9019fa6a5fa tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:12.545475 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5d9d1f3a-2975-4028-bb3d-b9019fa6a5fa tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:12.545950 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5d9d1f3a-2975-4028-bb3d-b9019fa6a5fa tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:12.789354 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e9d16ccb-bb6a-4944-b9ae-88380e5f3c02 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d89341a3e541b2a765c011c1d751cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acded04c228a408b82bccdf323bb5a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:12.797892 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e9d16ccb-bb6a-4944-b9ae-88380e5f3c02 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] 10.222.0.35 "GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301" status: 200 len: 1317 microversion: 2.1 time: 0.772488 Jun 10 18:10:12.798493 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1933/3771] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:12 2022] GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301 => generated 1317 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:12.836356 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:10:12.851663 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ad43e52e-f250-437f-b12e-c2a4bf41b6eb tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:12.852595 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ad43e52e-f250-437f-b12e-c2a4bf41b6eb tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:12.870250 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ad43e52e-f250-437f-b12e-c2a4bf41b6eb tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:12.870914 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ad43e52e-f250-437f-b12e-c2a4bf41b6eb tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:12.872420 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ad43e52e-f250-437f-b12e-c2a4bf41b6eb tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:12.873108 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ad43e52e-f250-437f-b12e-c2a4bf41b6eb tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:13.218531 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ad43e52e-f250-437f-b12e-c2a4bf41b6eb tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:13.227580 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ad43e52e-f250-437f-b12e-c2a4bf41b6eb tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1508 microversion: 2.1 time: 0.400213 Jun 10 18:10:13.228066 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1934/3772] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:12 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1508 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:13.249021 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-44a89dd1-fd58-4470-b75f-adf107b6b7a7 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:13.249858 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-44a89dd1-fd58-4470-b75f-adf107b6b7a7 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] [instance: 911b33c1-545d-4bcb-9ca1-c42c7bda606b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:13.262004 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-44a89dd1-fd58-4470-b75f-adf107b6b7a7 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:13.262793 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-44a89dd1-fd58-4470-b75f-adf107b6b7a7 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:13.263780 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-44a89dd1-fd58-4470-b75f-adf107b6b7a7 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:13.264461 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-44a89dd1-fd58-4470-b75f-adf107b6b7a7 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:13.267217 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=64 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:10:13.501514 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5d9d1f3a-2975-4028-bb3d-b9019fa6a5fa tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "POST /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.968468 Jun 10 18:10:13.511306 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1839/3773] 10.222.0.35 () {60 vars in 1322 bytes} [Fri Jun 10 18:10:12 2022] POST /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1/os-volume_attachments => generated 194 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:10:13.526374 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-44a89dd1-fd58-4470-b75f-adf107b6b7a7 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc673eee8339438cbb69ac8bc8df633e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38326c7c8786498a94e003d80740c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:13.547366 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-44a89dd1-fd58-4470-b75f-adf107b6b7a7 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b" status: 200 len: 1317 microversion: 2.1 time: 0.308387 Jun 10 18:10:13.553326 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1935/3774] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:13 2022] GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b => generated 1317 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:13.561789 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2011eb2e-8c6f-4812-a573-f1b8855ee71b tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:13.564038 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2011eb2e-8c6f-4812-a573-f1b8855ee71b tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] [instance: 55d00e0b-eb97-4076-94f6-0ecf02d933cd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:13.595927 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2011eb2e-8c6f-4812-a573-f1b8855ee71b tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:13.596644 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2011eb2e-8c6f-4812-a573-f1b8855ee71b tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:13.606472 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2011eb2e-8c6f-4812-a573-f1b8855ee71b tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:13.606472 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2011eb2e-8c6f-4812-a573-f1b8855ee71b tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:13.805576 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-206bbabf-8fea-4868-9de8-745336b2dab2 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Action: 'create', calling method: .version_select at 0x7f77c010faf0>, body: {"keypair": {"name": "tempest-keypair-802723711", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjhCfTD+G50aF/FmkqkswRfUnDE56WX98KczABPLRfstzHo0w6blB/X7QkegxOeAphqDxYPXKiMOy3PZ6I+Z+Xb563FHVVfk7xZoIn3jefyoKuGTjIE9bPZUpMVmoG7kQ=="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:10:13.807922 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2011eb2e-8c6f-4812-a573-f1b8855ee71b tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0c14dee0e14114aa63c2496ef2d4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088c9a2a1f8a429eba4b4a68c9bade12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:13.816610 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2011eb2e-8c6f-4812-a573-f1b8855ee71b tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd" status: 200 len: 1313 microversion: 2.1 time: 0.261097 Jun 10 18:10:13.817209 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1936/3775] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:13 2022] GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd => generated 1313 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:13.830166 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3b891050-f8bb-449f-82ee-4605a7c1a31c tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:13.830805 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3b891050-f8bb-449f-82ee-4605a7c1a31c tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] [instance: a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:13.833211 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:10:13.839745 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3b891050-f8bb-449f-82ee-4605a7c1a31c tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:13.841785 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3b891050-f8bb-449f-82ee-4605a7c1a31c tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:13.845153 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3b891050-f8bb-449f-82ee-4605a7c1a31c tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:13.847844 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3b891050-f8bb-449f-82ee-4605a7c1a31c tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:13.849471 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-206bbabf-8fea-4868-9de8-745336b2dab2 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Getting quotas for project 1e32c729a2b641f381e661905d930ee3. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:10:13.869040 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-206bbabf-8fea-4868-9de8-745336b2dab2 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Getting quotas for user 3c896f867509494cbce2e8f37d4cf0c2 and project 1e32c729a2b641f381e661905d930ee3. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:10:13.934824 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3b891050-f8bb-449f-82ee-4605a7c1a31c tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:13.943201 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3b891050-f8bb-449f-82ee-4605a7c1a31c tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:13.944900 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3b891050-f8bb-449f-82ee-4605a7c1a31c tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:13.946213 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3b891050-f8bb-449f-82ee-4605a7c1a31c tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] 10.222.0.35 "GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9" status: 200 len: 1357 microversion: 2.57 time: 0.126116 Jun 10 18:10:13.946886 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1937/3776] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:10:13 2022] GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9 => generated 1357 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:10:13.953091 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-284a7018-60cd-4f62-a1c1-d016fbc3a977 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:13.953689 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-284a7018-60cd-4f62-a1c1-d016fbc3a977 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] [instance: 38887a36-3b6b-48ad-b967-77a941762301] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:13.960388 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-284a7018-60cd-4f62-a1c1-d016fbc3a977 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:13.961137 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-284a7018-60cd-4f62-a1c1-d016fbc3a977 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:13.962093 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-284a7018-60cd-4f62-a1c1-d016fbc3a977 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:13.962688 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-284a7018-60cd-4f62-a1c1-d016fbc3a977 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:13.976580 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-206bbabf-8fea-4868-9de8-745336b2dab2 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.463341 Jun 10 18:10:13.977736 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1840/3777] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 18:10:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:10:13.984814 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-88253873-3da9-40e5-82b2-d1db1cacbd0a tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:13.985690 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-88253873-3da9-40e5-82b2-d1db1cacbd0a tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] [instance: a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:13.993994 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-88253873-3da9-40e5-82b2-d1db1cacbd0a tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:13.994921 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-88253873-3da9-40e5-82b2-d1db1cacbd0a tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:13.995883 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-88253873-3da9-40e5-82b2-d1db1cacbd0a tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:14.000183 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-88253873-3da9-40e5-82b2-d1db1cacbd0a tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:14.025295 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-88253873-3da9-40e5-82b2-d1db1cacbd0a tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] [instance: a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:10:14.175639 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-284a7018-60cd-4f62-a1c1-d016fbc3a977 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d89341a3e541b2a765c011c1d751cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acded04c228a408b82bccdf323bb5a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:14.193960 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-284a7018-60cd-4f62-a1c1-d016fbc3a977 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] 10.222.0.35 "GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301" status: 200 len: 1507 microversion: 2.1 time: 0.245814 Jun 10 18:10:14.203313 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1938/3778] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:13 2022] GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301 => generated 1507 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:14.212878 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1852d069-7dda-40d7-a767-7b95d054a444 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:14.213852 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1852d069-7dda-40d7-a767-7b95d054a444 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] [instance: 38887a36-3b6b-48ad-b967-77a941762301] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:14.220611 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1852d069-7dda-40d7-a767-7b95d054a444 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:14.221433 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1852d069-7dda-40d7-a767-7b95d054a444 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:14.222390 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1852d069-7dda-40d7-a767-7b95d054a444 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:14.231191 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1852d069-7dda-40d7-a767-7b95d054a444 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:14.292371 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1852d069-7dda-40d7-a767-7b95d054a444 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '36d89341a3e541b2a765c011c1d751cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acded04c228a408b82bccdf323bb5a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:14.293908 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1852d069-7dda-40d7-a767-7b95d054a444 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] 10.222.0.35 "GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301/os-instance-actions/req-7006406e-9aac-431e-9223-81b8e19a08c9" status: 200 len: 313 microversion: 2.1 time: 0.085811 Jun 10 18:10:14.295977 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1939/3779] 10.222.0.35 () {58 vars in 1418 bytes} [Fri Jun 10 18:10:14 2022] GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301/os-instance-actions/req-7006406e-9aac-431e-9223-81b8e19a08c9 => generated 313 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:10:14.323780 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-a5000f03-53ab-4ae2-8068-7486a0c46bd8 req-71e8e423-fd4a-483f-b6a6-ddb145b44183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55d00e0b-eb97-4076-94f6-0ecf02d933cd", "name": "network-vif-plugged", "status": "completed", "tag": "86b443a4-9d66-43c7-a118-7e396dad778a"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:10:14.342540 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-a5000f03-53ab-4ae2-8068-7486a0c46bd8 req-71e8e423-fd4a-483f-b6a6-ddb145b44183 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:14.344820 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-a5000f03-53ab-4ae2-8068-7486a0c46bd8 req-71e8e423-fd4a-483f-b6a6-ddb145b44183 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:14.362885 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-a5000f03-53ab-4ae2-8068-7486a0c46bd8 req-71e8e423-fd4a-483f-b6a6-ddb145b44183 service nova] Creating event network-vif-plugged:86b443a4-9d66-43c7-a118-7e396dad778a for instance 55d00e0b-eb97-4076-94f6-0ecf02d933cd on chh1-master-2 Jun 10 18:10:14.373841 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-a5000f03-53ab-4ae2-8068-7486a0c46bd8 req-71e8e423-fd4a-483f-b6a6-ddb145b44183 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075094 Jun 10 18:10:14.374913 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1940/3780] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:10:14.384236 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a3874898-97da-4986-b796-9e53d51fc7ba tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:14.385268 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a3874898-97da-4986-b796-9e53d51fc7ba tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:14.402853 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3874898-97da-4986-b796-9e53d51fc7ba tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:14.402853 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3874898-97da-4986-b796-9e53d51fc7ba tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:14.404125 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3874898-97da-4986-b796-9e53d51fc7ba tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:14.404753 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3874898-97da-4986-b796-9e53d51fc7ba tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:14.469192 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-88253873-3da9-40e5-82b2-d1db1cacbd0a tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] 10.222.0.35 "DELETE /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9" status: 204 len: 0 microversion: 2.57 time: 0.489935 Jun 10 18:10:14.470377 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1841/3781] 10.222.0.35 () {60 vars in 1279 bytes} [Fri Jun 10 18:10:13 2022] DELETE /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 10 18:10:14.478452 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-87518277-da19-4378-9fb4-c1d44c74c7d8 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:10:14.480825 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-87518277-da19-4378-9fb4-c1d44c74c7d8 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] [instance: 38887a36-3b6b-48ad-b967-77a941762301] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:14.495780 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-87518277-da19-4378-9fb4-c1d44c74c7d8 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:14.499879 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-87518277-da19-4378-9fb4-c1d44c74c7d8 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:14.500943 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-87518277-da19-4378-9fb4-c1d44c74c7d8 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:14.501588 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-87518277-da19-4378-9fb4-c1d44c74c7d8 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:14.703863 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a3874898-97da-4986-b796-9e53d51fc7ba tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:14.710953 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a3874898-97da-4986-b796-9e53d51fc7ba tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1508 microversion: 2.1 time: 0.334497 Jun 10 18:10:14.712179 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1941/3782] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:14 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1508 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:14.724995 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d452c5c0-7782-448d-8316-a4608c3c94dd tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:14.725950 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d452c5c0-7782-448d-8316-a4608c3c94dd tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] [instance: a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:14.743257 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d452c5c0-7782-448d-8316-a4608c3c94dd tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:14.762300 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d452c5c0-7782-448d-8316-a4608c3c94dd tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:14.762300 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d452c5c0-7782-448d-8316-a4608c3c94dd tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:14.762300 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d452c5c0-7782-448d-8316-a4608c3c94dd tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:14.824976 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d452c5c0-7782-448d-8316-a4608c3c94dd tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:14.837146 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d452c5c0-7782-448d-8316-a4608c3c94dd tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:14.839072 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d452c5c0-7782-448d-8316-a4608c3c94dd tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:14.840831 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d452c5c0-7782-448d-8316-a4608c3c94dd tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] 10.222.0.35 "GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9" status: 200 len: 1363 microversion: 2.57 time: 0.127619 Jun 10 18:10:14.855115 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1942/3783] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:10:14 2022] GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9 => generated 1363 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:10:14.855327 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-87518277-da19-4378-9fb4-c1d44c74c7d8 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] 10.222.0.35 "POST /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301/action" status: 202 len: 0 microversion: 2.1 time: 0.378021 Jun 10 18:10:14.855327 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1842/3784] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:10:14 2022] POST /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301/action => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:10:14.859149 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-014e13d7-5d62-46bd-a937-b14782770ff9 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:14.862283 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-014e13d7-5d62-46bd-a937-b14782770ff9 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] [instance: 911b33c1-545d-4bcb-9ca1-c42c7bda606b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:14.870220 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-854b2c85-6dae-4271-9372-87b0ced664aa tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:14.870930 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-854b2c85-6dae-4271-9372-87b0ced664aa tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] [instance: 55d00e0b-eb97-4076-94f6-0ecf02d933cd] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:14.881896 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-854b2c85-6dae-4271-9372-87b0ced664aa tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:14.882624 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-854b2c85-6dae-4271-9372-87b0ced664aa tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:14.883920 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-854b2c85-6dae-4271-9372-87b0ced664aa tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:14.884852 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-854b2c85-6dae-4271-9372-87b0ced664aa tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:14.887602 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-014e13d7-5d62-46bd-a937-b14782770ff9 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:14.888335 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-014e13d7-5d62-46bd-a937-b14782770ff9 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:14.892467 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-014e13d7-5d62-46bd-a937-b14782770ff9 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:14.893088 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-014e13d7-5d62-46bd-a937-b14782770ff9 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:15.111306 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-014e13d7-5d62-46bd-a937-b14782770ff9 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc673eee8339438cbb69ac8bc8df633e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38326c7c8786498a94e003d80740c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:15.128837 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-014e13d7-5d62-46bd-a937-b14782770ff9 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b" status: 200 len: 1317 microversion: 2.1 time: 0.279710 Jun 10 18:10:15.130909 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1943/3785] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:14 2022] GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b => generated 1317 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:15.143239 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-908100a4-8d93-4b80-b4d7-ffe7140d2239 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:15.144115 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-908100a4-8d93-4b80-b4d7-ffe7140d2239 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] [instance: 38887a36-3b6b-48ad-b967-77a941762301] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:15.154823 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-908100a4-8d93-4b80-b4d7-ffe7140d2239 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:15.155675 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-908100a4-8d93-4b80-b4d7-ffe7140d2239 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:15.156887 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-908100a4-8d93-4b80-b4d7-ffe7140d2239 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:15.157348 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-908100a4-8d93-4b80-b4d7-ffe7140d2239 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:15.253419 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-854b2c85-6dae-4271-9372-87b0ced664aa tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0c14dee0e14114aa63c2496ef2d4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088c9a2a1f8a429eba4b4a68c9bade12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:15.265201 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-854b2c85-6dae-4271-9372-87b0ced664aa tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd" status: 200 len: 1313 microversion: 2.1 time: 0.412769 Jun 10 18:10:15.269051 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1843/3786] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:14 2022] GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd => generated 1313 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:15.418515 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-908100a4-8d93-4b80-b4d7-ffe7140d2239 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d89341a3e541b2a765c011c1d751cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acded04c228a408b82bccdf323bb5a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:15.434098 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-908100a4-8d93-4b80-b4d7-ffe7140d2239 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] 10.222.0.35 "GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301" status: 200 len: 1509 microversion: 2.1 time: 0.295319 Jun 10 18:10:15.434693 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1944/3787] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:15 2022] GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301 => generated 1509 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:15.728252 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ec7af2a7-12f1-4c78-9521-c4196b594894 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:15.728920 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ec7af2a7-12f1-4c78-9521-c4196b594894 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:15.743105 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ec7af2a7-12f1-4c78-9521-c4196b594894 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:15.743588 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ec7af2a7-12f1-4c78-9521-c4196b594894 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:15.744444 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ec7af2a7-12f1-4c78-9521-c4196b594894 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:15.744890 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ec7af2a7-12f1-4c78-9521-c4196b594894 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:15.864028 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bdfa13c0-672e-4704-9517-37444ecddc55 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:15.864565 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bdfa13c0-672e-4704-9517-37444ecddc55 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] [instance: a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:15.878251 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bdfa13c0-672e-4704-9517-37444ecddc55 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:15.878251 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bdfa13c0-672e-4704-9517-37444ecddc55 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:15.878251 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bdfa13c0-672e-4704-9517-37444ecddc55 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:15.878251 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bdfa13c0-672e-4704-9517-37444ecddc55 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:15.984794 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bdfa13c0-672e-4704-9517-37444ecddc55 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:16.005508 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bdfa13c0-672e-4704-9517-37444ecddc55 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:16.006526 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bdfa13c0-672e-4704-9517-37444ecddc55 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:16.010825 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bdfa13c0-672e-4704-9517-37444ecddc55 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] 10.222.0.35 "GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9" status: 200 len: 1363 microversion: 2.57 time: 0.151747 Jun 10 18:10:16.013870 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1945/3788] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:10:15 2022] GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:10:16.103542 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ec7af2a7-12f1-4c78-9521-c4196b594894 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:16.112440 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ec7af2a7-12f1-4c78-9521-c4196b594894 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1508 microversion: 2.1 time: 0.388266 Jun 10 18:10:16.123408 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1844/3789] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:15 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1508 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:16.146650 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9469f3ba-2a80-4733-847f-e79f2dee0715 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:16.147336 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9469f3ba-2a80-4733-847f-e79f2dee0715 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] [instance: 911b33c1-545d-4bcb-9ca1-c42c7bda606b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:16.154476 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9469f3ba-2a80-4733-847f-e79f2dee0715 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:16.155147 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9469f3ba-2a80-4733-847f-e79f2dee0715 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:16.162414 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9469f3ba-2a80-4733-847f-e79f2dee0715 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:16.162414 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9469f3ba-2a80-4733-847f-e79f2dee0715 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:16.289300 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a8748e6c-d115-462a-9377-d8a0548175dd tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:16.290467 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a8748e6c-d115-462a-9377-d8a0548175dd tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] [instance: 55d00e0b-eb97-4076-94f6-0ecf02d933cd] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:16.299248 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a8748e6c-d115-462a-9377-d8a0548175dd tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:16.299829 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a8748e6c-d115-462a-9377-d8a0548175dd tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:16.300777 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a8748e6c-d115-462a-9377-d8a0548175dd tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:16.301278 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a8748e6c-d115-462a-9377-d8a0548175dd tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:16.469692 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9469f3ba-2a80-4733-847f-e79f2dee0715 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc673eee8339438cbb69ac8bc8df633e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38326c7c8786498a94e003d80740c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:16.491744 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9469f3ba-2a80-4733-847f-e79f2dee0715 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b" status: 200 len: 1317 microversion: 2.1 time: 0.349521 Jun 10 18:10:16.494166 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1946/3790] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:16 2022] GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b => generated 1317 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:10:16.515712 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a8748e6c-d115-462a-9377-d8a0548175dd tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0c14dee0e14114aa63c2496ef2d4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088c9a2a1f8a429eba4b4a68c9bade12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:16.525014 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a8748e6c-d115-462a-9377-d8a0548175dd tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd" status: 200 len: 1313 microversion: 2.1 time: 0.239739 Jun 10 18:10:16.526600 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1845/3791] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:16 2022] GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd => generated 1313 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:16.532068 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ef3eb62f-1a01-4e87-afc3-a24ce2cc17f5 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:16.536102 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ef3eb62f-1a01-4e87-afc3-a24ce2cc17f5 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] [instance: 38887a36-3b6b-48ad-b967-77a941762301] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:16.549769 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ef3eb62f-1a01-4e87-afc3-a24ce2cc17f5 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:16.550691 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ef3eb62f-1a01-4e87-afc3-a24ce2cc17f5 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:16.551981 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ef3eb62f-1a01-4e87-afc3-a24ce2cc17f5 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:16.552743 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ef3eb62f-1a01-4e87-afc3-a24ce2cc17f5 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:16.563930 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:10:17.032344 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0830393f-5b6e-400c-86e5-45b66b43efd6 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:17.033824 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0830393f-5b6e-400c-86e5-45b66b43efd6 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] [instance: a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:17.044475 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ef3eb62f-1a01-4e87-afc3-a24ce2cc17f5 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d89341a3e541b2a765c011c1d751cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acded04c228a408b82bccdf323bb5a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:17.050143 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0830393f-5b6e-400c-86e5-45b66b43efd6 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:17.050860 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0830393f-5b6e-400c-86e5-45b66b43efd6 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:17.052108 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ef3eb62f-1a01-4e87-afc3-a24ce2cc17f5 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] 10.222.0.35 "GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301" status: 200 len: 1509 microversion: 2.1 time: 0.556542 Jun 10 18:10:17.053700 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0830393f-5b6e-400c-86e5-45b66b43efd6 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:17.055062 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0830393f-5b6e-400c-86e5-45b66b43efd6 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:17.067585 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1947/3792] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:16 2022] GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301 => generated 1509 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:17.132103 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e7e5be45-9fba-49f2-935c-d5e0c3d9a176 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:17.133328 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e7e5be45-9fba-49f2-935c-d5e0c3d9a176 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:17.135336 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:10:17.159998 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7e5be45-9fba-49f2-935c-d5e0c3d9a176 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:17.161315 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0830393f-5b6e-400c-86e5-45b66b43efd6 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:17.161465 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7e5be45-9fba-49f2-935c-d5e0c3d9a176 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:17.162461 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7e5be45-9fba-49f2-935c-d5e0c3d9a176 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:17.163171 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7e5be45-9fba-49f2-935c-d5e0c3d9a176 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:17.176777 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0830393f-5b6e-400c-86e5-45b66b43efd6 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:17.178314 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0830393f-5b6e-400c-86e5-45b66b43efd6 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5541893018e141818e3876aa4ebfb9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eddb11fcb9c4793a69bc00090064758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:17.179520 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0830393f-5b6e-400c-86e5-45b66b43efd6 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] 10.222.0.35 "GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9" status: 200 len: 1363 microversion: 2.57 time: 0.152316 Jun 10 18:10:17.180087 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1846/3793] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:10:17 2022] GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:10:17.481630 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e7e5be45-9fba-49f2-935c-d5e0c3d9a176 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:17.502122 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e7e5be45-9fba-49f2-935c-d5e0c3d9a176 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1508 microversion: 2.1 time: 0.375636 Jun 10 18:10:17.503374 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1948/3794] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:17 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1508 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:17.516179 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-431306c2-7e14-425a-bd0a-5d0e6f281d3b tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:17.517033 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-431306c2-7e14-425a-bd0a-5d0e6f281d3b tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] [instance: 911b33c1-545d-4bcb-9ca1-c42c7bda606b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:17.524776 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-431306c2-7e14-425a-bd0a-5d0e6f281d3b tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:17.525479 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-431306c2-7e14-425a-bd0a-5d0e6f281d3b tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:17.526456 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-431306c2-7e14-425a-bd0a-5d0e6f281d3b tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:17.527058 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-431306c2-7e14-425a-bd0a-5d0e6f281d3b tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:17.543537 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e92ef9bd-a5ae-4dc0-8555-d84e2544f469 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:17.544754 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e92ef9bd-a5ae-4dc0-8555-d84e2544f469 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] [instance: 55d00e0b-eb97-4076-94f6-0ecf02d933cd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:17.554252 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e92ef9bd-a5ae-4dc0-8555-d84e2544f469 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:17.554709 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e92ef9bd-a5ae-4dc0-8555-d84e2544f469 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:17.561114 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e92ef9bd-a5ae-4dc0-8555-d84e2544f469 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:17.561927 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e92ef9bd-a5ae-4dc0-8555-d84e2544f469 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:17.687360 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-431306c2-7e14-425a-bd0a-5d0e6f281d3b tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc673eee8339438cbb69ac8bc8df633e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38326c7c8786498a94e003d80740c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:17.695275 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-431306c2-7e14-425a-bd0a-5d0e6f281d3b tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b" status: 200 len: 1317 microversion: 2.1 time: 0.186504 Jun 10 18:10:17.696430 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1847/3795] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:17 2022] GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:17.815499 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e92ef9bd-a5ae-4dc0-8555-d84e2544f469 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0c14dee0e14114aa63c2496ef2d4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088c9a2a1f8a429eba4b4a68c9bade12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:17.825275 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e92ef9bd-a5ae-4dc0-8555-d84e2544f469 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd" status: 200 len: 1499 microversion: 2.1 time: 0.286119 Jun 10 18:10:17.825874 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1949/3796] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:17 2022] GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd => generated 1499 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:17.843993 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2cdf28fa-e601-4fac-8e61-9273c64821c9 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:17.859680 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.compute.server_groups [None req-2cdf28fa-e601-4fac-8e61-9273c64821c9 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Querying cell 0f13ffb7-1a21-4641-8558-8a89dd295960(cell1) for 1 instances {{(pid=126595) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jun 10 18:10:17.860642 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2cdf28fa-e601-4fac-8e61-9273c64821c9 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:17.861365 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2cdf28fa-e601-4fac-8e61-9273c64821c9 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:17.906754 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2cdf28fa-e601-4fac-8e61-9273c64821c9 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "GET /compute/v2.1/os-server-groups/eeb86332-5321-49af-8694-2b0446ea117e" status: 200 len: 222 microversion: 2.1 time: 0.067327 Jun 10 18:10:17.928748 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1848/3797] 10.222.0.35 () {58 vars in 1262 bytes} [Fri Jun 10 18:10:17 2022] GET /compute/v2.1/os-server-groups/eeb86332-5321-49af-8694-2b0446ea117e => generated 222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:10:17.938913 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-570082c8-118f-4ce0-8f88-8649562a2ab5 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:17.939524 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-570082c8-118f-4ce0-8f88-8649562a2ab5 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] [instance: 55d00e0b-eb97-4076-94f6-0ecf02d933cd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:17.961129 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-570082c8-118f-4ce0-8f88-8649562a2ab5 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:17.964025 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-570082c8-118f-4ce0-8f88-8649562a2ab5 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:17.969775 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-570082c8-118f-4ce0-8f88-8649562a2ab5 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:17.974386 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-570082c8-118f-4ce0-8f88-8649562a2ab5 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:18.011202 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-570082c8-118f-4ce0-8f88-8649562a2ab5 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] [instance: 55d00e0b-eb97-4076-94f6-0ecf02d933cd] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:10:18.084579 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4bcfbe9c-cae7-4ceb-93a7-a1f6ddf07b1d tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:18.086371 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4bcfbe9c-cae7-4ceb-93a7-a1f6ddf07b1d tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] [instance: 38887a36-3b6b-48ad-b967-77a941762301] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:18.107609 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4bcfbe9c-cae7-4ceb-93a7-a1f6ddf07b1d tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:18.108403 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4bcfbe9c-cae7-4ceb-93a7-a1f6ddf07b1d tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:18.109461 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4bcfbe9c-cae7-4ceb-93a7-a1f6ddf07b1d tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:18.110068 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4bcfbe9c-cae7-4ceb-93a7-a1f6ddf07b1d tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:18.319430 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4bcfbe9c-cae7-4ceb-93a7-a1f6ddf07b1d tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d89341a3e541b2a765c011c1d751cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acded04c228a408b82bccdf323bb5a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:18.329177 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4bcfbe9c-cae7-4ceb-93a7-a1f6ddf07b1d tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] 10.222.0.35 "GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301" status: 200 len: 1514 microversion: 2.1 time: 0.258080 Jun 10 18:10:18.329774 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1849/3798] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:18 2022] GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301 => generated 1514 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:10:18.344353 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0ea04838-26fb-4906-bb6b-08972a7cb3c7 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:18.345239 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0ea04838-26fb-4906-bb6b-08972a7cb3c7 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] [instance: a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:18.351769 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0ea04838-26fb-4906-bb6b-08972a7cb3c7 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:18.352223 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0ea04838-26fb-4906-bb6b-08972a7cb3c7 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:18.353037 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0ea04838-26fb-4906-bb6b-08972a7cb3c7 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:18.353478 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0ea04838-26fb-4906-bb6b-08972a7cb3c7 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:18.367992 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-0ea04838-26fb-4906-bb6b-08972a7cb3c7 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] HTTP exception thrown: Instance a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9 could not be found. Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0ea04838-26fb-4906-bb6b-08972a7cb3c7 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Request method failure captured: Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9 HTTP/1.1 Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4jc1i8TdEW6Ex5nv3uksCG_S3vAUrdhTeL-_iNhywxQ5dbmXmJzvPsSYCnTi7UQbEWTALIY_PSz7cS7Q6y7gkSA5m1vXt5uVtT3fhkphVrcu1elLEn6sFuQ9Kqx9grMc7DT4wztT-J0Lwn0IF-t-LVSCAQHQFZYT6CBPLPSStExleg Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: X-Openstack-Nova-Api-Version: 2.57 Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 8eddb11fcb9c4793a69bc00090064758 Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServerShowV257Test-1936348118 Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/8eddb11fcb9c4793a69bc00090064758"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8eddb11fcb9c4793a69bc00090064758"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8eddb11fcb9c4793a69bc00090064758"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_8eddb11fcb9c4793a69bc00090064758", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServerShowV257Test-1936348118 Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 8eddb11fcb9c4793a69bc00090064758 Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServerShowV257Test-1936348118 Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServerShowV257Test-1936348118-project Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 5541893018e141818e3876aa4ebfb9ea Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServerShowV257Test-1936348118-project Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: exception: Instance a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9 could not be found. Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9'} Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9 could not be found. Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9 could not be found. Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:10:18.369859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:10:18.374644 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:10:18.374644 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:10:18.374644 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:10:18.374644 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:10:18.374644 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:10:18.374644 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9 could not be found. Jun 10 18:10:18.374644 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:10:18.375997 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0ea04838-26fb-4906-bb6b-08972a7cb3c7 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] Returning 404 to user: Instance a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:10:18.377466 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0ea04838-26fb-4906-bb6b-08972a7cb3c7 tempest-ServerShowV257Test-1936348118 tempest-ServerShowV257Test-1936348118-project] 10.222.0.35 "GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9" status: 404 len: 111 microversion: 2.57 time: 0.037576 Jun 10 18:10:18.378522 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1850/3799] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:10:18 2022] GET /compute/v2.1/servers/a92eed5b-e33c-4ecc-9c8b-8b6f74b663b9 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:10:18.425355 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-570082c8-118f-4ce0-8f88-8649562a2ab5 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "DELETE /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd" status: 204 len: 0 microversion: 2.1 time: 0.490290 Jun 10 18:10:18.425975 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1950/3800] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:10:17 2022] DELETE /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd => generated 0 bytes in 492 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:10:18.444926 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-410d374d-ca4a-443e-a64f-d39fc07f9835 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:18.445826 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-410d374d-ca4a-443e-a64f-d39fc07f9835 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] [instance: 55d00e0b-eb97-4076-94f6-0ecf02d933cd] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:18.456992 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-410d374d-ca4a-443e-a64f-d39fc07f9835 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:18.457582 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-410d374d-ca4a-443e-a64f-d39fc07f9835 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:18.458407 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-410d374d-ca4a-443e-a64f-d39fc07f9835 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:18.458855 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-410d374d-ca4a-443e-a64f-d39fc07f9835 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:18.520160 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-62fd548c-2043-4517-a5f6-61dab70155d0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:18.520919 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-62fd548c-2043-4517-a5f6-61dab70155d0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:18.547545 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-62fd548c-2043-4517-a5f6-61dab70155d0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:18.548017 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-62fd548c-2043-4517-a5f6-61dab70155d0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:18.549215 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-62fd548c-2043-4517-a5f6-61dab70155d0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:18.549853 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-62fd548c-2043-4517-a5f6-61dab70155d0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:18.810684 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-62fd548c-2043-4517-a5f6-61dab70155d0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:18.826260 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-62fd548c-2043-4517-a5f6-61dab70155d0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1508 microversion: 2.1 time: 0.305268 Jun 10 18:10:18.826260 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1951/3801] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:18 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1508 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:18.828726 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ca2536b1-38fb-4573-a909-f84c5dbe052a tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "edd09bc1-805a-4a37-a20d-e6828a19fda0"}], "security_groups": [{"name": "tempest-securitygroup--619412197"}], "key_name": "tempest-keypair-802723711", "user_data": "}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:10:19.038114 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-ca2536b1-38fb-4573-a909-f84c5dbe052a tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] validate_networks() for [('edd09bc1-805a-4a37-a20d-e6828a19fda0', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:10:19.362647 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-410d374d-ca4a-443e-a64f-d39fc07f9835 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0c14dee0e14114aa63c2496ef2d4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088c9a2a1f8a429eba4b4a68c9bade12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:19.372457 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-410d374d-ca4a-443e-a64f-d39fc07f9835 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd" status: 200 len: 1505 microversion: 2.1 time: 0.942006 Jun 10 18:10:19.382220 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1851/3802] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:18 2022] GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd => generated 1505 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:19.382220 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8ef5f9f4-20fd-4a68-bad7-e344cb319d0f tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:19.382220 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8ef5f9f4-20fd-4a68-bad7-e344cb319d0f tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] [instance: 911b33c1-545d-4bcb-9ca1-c42c7bda606b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:19.387092 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8ef5f9f4-20fd-4a68-bad7-e344cb319d0f tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:19.387552 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8ef5f9f4-20fd-4a68-bad7-e344cb319d0f tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:19.388551 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8ef5f9f4-20fd-4a68-bad7-e344cb319d0f tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:19.388998 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8ef5f9f4-20fd-4a68-bad7-e344cb319d0f tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:19.567871 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8ef5f9f4-20fd-4a68-bad7-e344cb319d0f tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc673eee8339438cbb69ac8bc8df633e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38326c7c8786498a94e003d80740c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:19.577076 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8ef5f9f4-20fd-4a68-bad7-e344cb319d0f tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b" status: 200 len: 1317 microversion: 2.1 time: 0.202160 Jun 10 18:10:19.587488 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1852/3803] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:19 2022] GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b => generated 1317 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:19.594668 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-df45be57-3d12-4767-8515-7aedb97179c2 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:19.595526 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-df45be57-3d12-4767-8515-7aedb97179c2 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] [instance: 38887a36-3b6b-48ad-b967-77a941762301] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:19.602589 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df45be57-3d12-4767-8515-7aedb97179c2 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:19.603506 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df45be57-3d12-4767-8515-7aedb97179c2 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:19.604489 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df45be57-3d12-4767-8515-7aedb97179c2 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:19.605086 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df45be57-3d12-4767-8515-7aedb97179c2 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:19.763204 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-df45be57-3d12-4767-8515-7aedb97179c2 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d89341a3e541b2a765c011c1d751cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acded04c228a408b82bccdf323bb5a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:19.768186 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-df45be57-3d12-4767-8515-7aedb97179c2 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] 10.222.0.35 "GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301" status: 200 len: 1507 microversion: 2.1 time: 0.179219 Jun 10 18:10:19.770056 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1853/3804] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:19 2022] GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301 => generated 1507 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:19.787646 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-01e19c76-e6da-48b7-a5ef-34d5174d6014 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Calling method '.version_select at 0x7f77c0073c10>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:19.788203 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-01e19c76-e6da-48b7-a5ef-34d5174d6014 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] [instance: 38887a36-3b6b-48ad-b967-77a941762301] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:19.795618 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-01e19c76-e6da-48b7-a5ef-34d5174d6014 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:19.796076 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-01e19c76-e6da-48b7-a5ef-34d5174d6014 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:19.804161 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-01e19c76-e6da-48b7-a5ef-34d5174d6014 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:19.804161 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-01e19c76-e6da-48b7-a5ef-34d5174d6014 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:19.828182 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:10:19.837524 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-01e19c76-e6da-48b7-a5ef-34d5174d6014 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] 10.222.0.35 "GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.053436 Jun 10 18:10:19.838497 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1854/3805] 10.222.0.35 () {58 vars in 1295 bytes} [Fri Jun 10 18:10:19 2022] GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301/os-instance-actions => generated 611 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:10:19.847093 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-451db28f-6e68-44a0-8242-7fe2efc0a1a2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:19.848015 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-451db28f-6e68-44a0-8242-7fe2efc0a1a2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:19.858811 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-451db28f-6e68-44a0-8242-7fe2efc0a1a2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:19.859609 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-451db28f-6e68-44a0-8242-7fe2efc0a1a2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:19.860937 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-451db28f-6e68-44a0-8242-7fe2efc0a1a2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:19.861381 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-451db28f-6e68-44a0-8242-7fe2efc0a1a2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:20.145502 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-451db28f-6e68-44a0-8242-7fe2efc0a1a2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:20.158785 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-451db28f-6e68-44a0-8242-7fe2efc0a1a2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1508 microversion: 2.1 time: 0.318434 Jun 10 18:10:20.161096 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1855/3806] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:19 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1508 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:20.166076 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c9a618bd-3260-4f16-9d2d-6977262e39aa tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:20.166881 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c9a618bd-3260-4f16-9d2d-6977262e39aa tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] [instance: 38887a36-3b6b-48ad-b967-77a941762301] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:20.175861 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9a618bd-3260-4f16-9d2d-6977262e39aa tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:20.177139 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9a618bd-3260-4f16-9d2d-6977262e39aa tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:20.179178 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9a618bd-3260-4f16-9d2d-6977262e39aa tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:20.179821 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9a618bd-3260-4f16-9d2d-6977262e39aa tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:20.228061 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c9a618bd-3260-4f16-9d2d-6977262e39aa tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] [instance: 38887a36-3b6b-48ad-b967-77a941762301] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:10:20.235290 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-ca2536b1-38fb-4573-a909-f84c5dbe052a tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:10:20.235806 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-ca2536b1-38fb-4573-a909-f84c5dbe052a tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:10:20.236532 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-ca2536b1-38fb-4573-a909-f84c5dbe052a tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:10:20.236941 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-ca2536b1-38fb-4573-a909-f84c5dbe052a tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:10:20.237367 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-ca2536b1-38fb-4573-a909-f84c5dbe052a tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:10:20.253188 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ca2536b1-38fb-4573-a909-f84c5dbe052a tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:20.253659 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ca2536b1-38fb-4573-a909-f84c5dbe052a tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:20.254501 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ca2536b1-38fb-4573-a909-f84c5dbe052a tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:20.254954 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ca2536b1-38fb-4573-a909-f84c5dbe052a tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:20.298008 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-ca2536b1-38fb-4573-a909-f84c5dbe052a tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Getting quotas for project 1e32c729a2b641f381e661905d930ee3. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:10:20.303798 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-ca2536b1-38fb-4573-a909-f84c5dbe052a tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Getting quotas for user 3c896f867509494cbce2e8f37d4cf0c2 and project 1e32c729a2b641f381e661905d930ee3. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:10:20.338674 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ca2536b1-38fb-4573-a909-f84c5dbe052a tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:10:20.343186 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ca2536b1-38fb-4573-a909-f84c5dbe052a tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] [instance: 7c3a4081-92e2-4c7c-8283-faebd5302cf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:10:20.548761 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ca2536b1-38fb-4573-a909-f84c5dbe052a tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.725310 Jun 10 18:10:20.551296 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1952/3807] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:10:18 2022] POST /compute/v2.1/servers => generated 408 bytes in 1728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:10:20.559171 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-165870d1-e61f-42a2-8b36-9eab0d564273 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:20.560286 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-165870d1-e61f-42a2-8b36-9eab0d564273 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] [instance: 55d00e0b-eb97-4076-94f6-0ecf02d933cd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:20.567825 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-165870d1-e61f-42a2-8b36-9eab0d564273 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:20.568408 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-165870d1-e61f-42a2-8b36-9eab0d564273 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:20.569428 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-165870d1-e61f-42a2-8b36-9eab0d564273 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:20.570128 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-165870d1-e61f-42a2-8b36-9eab0d564273 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:20.657088 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c9a618bd-3260-4f16-9d2d-6977262e39aa tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] 10.222.0.35 "DELETE /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301" status: 204 len: 0 microversion: 2.1 time: 0.494494 Jun 10 18:10:20.662186 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1856/3808] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:10:20 2022] DELETE /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:10:20.668686 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7bc321e1-9b71-47c6-bbf7-d293d19c0551 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:20.669701 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7bc321e1-9b71-47c6-bbf7-d293d19c0551 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] [instance: 7c3a4081-92e2-4c7c-8283-faebd5302cf9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:20.771313 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-165870d1-e61f-42a2-8b36-9eab0d564273 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0c14dee0e14114aa63c2496ef2d4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088c9a2a1f8a429eba4b4a68c9bade12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:20.774839 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7bc321e1-9b71-47c6-bbf7-d293d19c0551 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c896f867509494cbce2e8f37d4cf0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e32c729a2b641f381e661905d930ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:20.786437 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7bc321e1-9b71-47c6-bbf7-d293d19c0551 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] 10.222.0.35 "GET /compute/v2.1/servers/7c3a4081-92e2-4c7c-8283-faebd5302cf9" status: 200 len: 1225 microversion: 2.1 time: 0.122576 Jun 10 18:10:20.789149 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1857/3809] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:20 2022] GET /compute/v2.1/servers/7c3a4081-92e2-4c7c-8283-faebd5302cf9 => generated 1225 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:20.790322 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-165870d1-e61f-42a2-8b36-9eab0d564273 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd" status: 200 len: 1463 microversion: 2.1 time: 0.234994 Jun 10 18:10:20.795381 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1953/3810] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:20 2022] GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd => generated 1463 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:20.810241 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-174bcfd2-9d89-4507-adfb-401fb871bbf7 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:20.810878 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-174bcfd2-9d89-4507-adfb-401fb871bbf7 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] [instance: 38887a36-3b6b-48ad-b967-77a941762301] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:20.813043 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3b8ad9fc-d608-4a49-bfe3-3360706e41c7 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:20.816008 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3b8ad9fc-d608-4a49-bfe3-3360706e41c7 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] [instance: 911b33c1-545d-4bcb-9ca1-c42c7bda606b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:20.824607 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-174bcfd2-9d89-4507-adfb-401fb871bbf7 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:20.825069 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-174bcfd2-9d89-4507-adfb-401fb871bbf7 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:20.825858 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-174bcfd2-9d89-4507-adfb-401fb871bbf7 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:20.826304 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-174bcfd2-9d89-4507-adfb-401fb871bbf7 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:20.832527 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3b8ad9fc-d608-4a49-bfe3-3360706e41c7 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:20.832984 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3b8ad9fc-d608-4a49-bfe3-3360706e41c7 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:20.833775 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3b8ad9fc-d608-4a49-bfe3-3360706e41c7 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:20.834237 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3b8ad9fc-d608-4a49-bfe3-3360706e41c7 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:21.078943 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-174bcfd2-9d89-4507-adfb-401fb871bbf7 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d89341a3e541b2a765c011c1d751cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acded04c228a408b82bccdf323bb5a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:21.088694 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-174bcfd2-9d89-4507-adfb-401fb871bbf7 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] 10.222.0.35 "GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301" status: 200 len: 1513 microversion: 2.1 time: 0.291934 Jun 10 18:10:21.090152 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1954/3811] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:20 2022] GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301 => generated 1513 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:21.097105 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-20d53009-1a6d-45b4-bcda-d78707acb1e2 req-a1aac3fe-4d1b-492c-8e1e-02cd45755f97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55d00e0b-eb97-4076-94f6-0ecf02d933cd", "name": "network-vif-deleted", "tag": "86b443a4-9d66-43c7-a118-7e396dad778a"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:10:21.107442 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-20d53009-1a6d-45b4-bcda-d78707acb1e2 req-a1aac3fe-4d1b-492c-8e1e-02cd45755f97 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:21.107900 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-20d53009-1a6d-45b4-bcda-d78707acb1e2 req-a1aac3fe-4d1b-492c-8e1e-02cd45755f97 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:21.120926 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-20d53009-1a6d-45b4-bcda-d78707acb1e2 req-a1aac3fe-4d1b-492c-8e1e-02cd45755f97 service nova] Creating event network-vif-deleted:86b443a4-9d66-43c7-a118-7e396dad778a for instance 55d00e0b-eb97-4076-94f6-0ecf02d933cd on chh1-master-2 Jun 10 18:10:21.128604 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-20d53009-1a6d-45b4-bcda-d78707acb1e2 req-a1aac3fe-4d1b-492c-8e1e-02cd45755f97 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036944 Jun 10 18:10:21.129513 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1955/3812] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:10:21.134301 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3b8ad9fc-d608-4a49-bfe3-3360706e41c7 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc673eee8339438cbb69ac8bc8df633e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38326c7c8786498a94e003d80740c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:21.143485 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-65106b94-0fa9-4b53-a998-0b8cf9be539c req-f02b0f02-f64c-4088-a9ae-9f1f6e7df628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "911b33c1-545d-4bcb-9ca1-c42c7bda606b", "name": "network-vif-plugged", "status": "completed", "tag": "a7249e1c-d1cb-43c4-9fa6-d68705a79807"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:10:21.144718 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3b8ad9fc-d608-4a49-bfe3-3360706e41c7 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b" status: 200 len: 1317 microversion: 2.1 time: 0.354227 Jun 10 18:10:21.145891 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1858/3813] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:20 2022] GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b => generated 1317 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:21.152689 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-65106b94-0fa9-4b53-a998-0b8cf9be539c req-f02b0f02-f64c-4088-a9ae-9f1f6e7df628 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:21.156326 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-65106b94-0fa9-4b53-a998-0b8cf9be539c req-f02b0f02-f64c-4088-a9ae-9f1f6e7df628 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:21.182438 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a329fd7a-9fab-465a-b4e6-dd9c4fdc97d2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:21.183408 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a329fd7a-9fab-465a-b4e6-dd9c4fdc97d2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:21.193305 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a329fd7a-9fab-465a-b4e6-dd9c4fdc97d2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:21.193977 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-65106b94-0fa9-4b53-a998-0b8cf9be539c req-f02b0f02-f64c-4088-a9ae-9f1f6e7df628 service nova] Creating event network-vif-plugged:a7249e1c-d1cb-43c4-9fa6-d68705a79807 for instance 911b33c1-545d-4bcb-9ca1-c42c7bda606b on chh2-master-2 Jun 10 18:10:21.195036 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a329fd7a-9fab-465a-b4e6-dd9c4fdc97d2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:21.196037 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a329fd7a-9fab-465a-b4e6-dd9c4fdc97d2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:21.196805 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a329fd7a-9fab-465a-b4e6-dd9c4fdc97d2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:21.210459 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-65106b94-0fa9-4b53-a998-0b8cf9be539c req-f02b0f02-f64c-4088-a9ae-9f1f6e7df628 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077031 Jun 10 18:10:21.211826 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1956/3814] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:10:21.457036 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a329fd7a-9fab-465a-b4e6-dd9c4fdc97d2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:21.465520 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a329fd7a-9fab-465a-b4e6-dd9c4fdc97d2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1508 microversion: 2.1 time: 0.291636 Jun 10 18:10:21.466102 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1859/3815] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:21 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1508 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:10:21.809725 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bc6d09f4-fb4c-4114-8897-438c05f0c428 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:21.810439 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bc6d09f4-fb4c-4114-8897-438c05f0c428 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] [instance: 7c3a4081-92e2-4c7c-8283-faebd5302cf9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:21.814983 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-45709804-07fb-4237-97c7-095cfb74b409 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:21.814983 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-45709804-07fb-4237-97c7-095cfb74b409 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] [instance: 55d00e0b-eb97-4076-94f6-0ecf02d933cd] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:21.821339 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45709804-07fb-4237-97c7-095cfb74b409 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:21.822569 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45709804-07fb-4237-97c7-095cfb74b409 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:21.825645 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45709804-07fb-4237-97c7-095cfb74b409 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:21.826986 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45709804-07fb-4237-97c7-095cfb74b409 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:21.925720 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bc6d09f4-fb4c-4114-8897-438c05f0c428 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c896f867509494cbce2e8f37d4cf0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e32c729a2b641f381e661905d930ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:21.936659 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bc6d09f4-fb4c-4114-8897-438c05f0c428 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] 10.222.0.35 "GET /compute/v2.1/servers/7c3a4081-92e2-4c7c-8283-faebd5302cf9" status: 200 len: 1225 microversion: 2.1 time: 0.133167 Jun 10 18:10:21.937263 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1957/3816] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:21 2022] GET /compute/v2.1/servers/7c3a4081-92e2-4c7c-8283-faebd5302cf9 => generated 1225 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:21.950535 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-45709804-07fb-4237-97c7-095cfb74b409 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0c14dee0e14114aa63c2496ef2d4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088c9a2a1f8a429eba4b4a68c9bade12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:21.962066 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-45709804-07fb-4237-97c7-095cfb74b409 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd" status: 200 len: 1463 microversion: 2.1 time: 0.154613 Jun 10 18:10:21.971605 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1860/3817] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:21 2022] GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd => generated 1463 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:22.111266 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b8485241-cf74-4aee-a302-8662b03774a9 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:22.112198 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b8485241-cf74-4aee-a302-8662b03774a9 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] [instance: 38887a36-3b6b-48ad-b967-77a941762301] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:22.125091 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b8485241-cf74-4aee-a302-8662b03774a9 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:22.128027 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b8485241-cf74-4aee-a302-8662b03774a9 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:22.129761 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b8485241-cf74-4aee-a302-8662b03774a9 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:22.140057 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b8485241-cf74-4aee-a302-8662b03774a9 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:22.164487 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-51d3f261-2aeb-421b-b622-fb748d609de0 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:22.165096 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-51d3f261-2aeb-421b-b622-fb748d609de0 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] [instance: 911b33c1-545d-4bcb-9ca1-c42c7bda606b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:22.177938 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-51d3f261-2aeb-421b-b622-fb748d609de0 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:22.178495 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-51d3f261-2aeb-421b-b622-fb748d609de0 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:22.179277 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-51d3f261-2aeb-421b-b622-fb748d609de0 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:22.179713 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-51d3f261-2aeb-421b-b622-fb748d609de0 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:22.445639 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-51d3f261-2aeb-421b-b622-fb748d609de0 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc673eee8339438cbb69ac8bc8df633e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38326c7c8786498a94e003d80740c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:22.455366 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-51d3f261-2aeb-421b-b622-fb748d609de0 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b" status: 200 len: 1317 microversion: 2.1 time: 0.295310 Jun 10 18:10:22.457947 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1861/3818] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:22 2022] GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b => generated 1317 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:22.482716 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-37c360c4-d6ac-4d51-93c4-47360c615705 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:22.483332 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-37c360c4-d6ac-4d51-93c4-47360c615705 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:22.492706 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-37c360c4-d6ac-4d51-93c4-47360c615705 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:22.493339 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-37c360c4-d6ac-4d51-93c4-47360c615705 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:22.496673 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-37c360c4-d6ac-4d51-93c4-47360c615705 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:22.496673 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-37c360c4-d6ac-4d51-93c4-47360c615705 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:22.614504 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b8485241-cf74-4aee-a302-8662b03774a9 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d89341a3e541b2a765c011c1d751cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acded04c228a408b82bccdf323bb5a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:22.634591 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b8485241-cf74-4aee-a302-8662b03774a9 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] 10.222.0.35 "GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301" status: 200 len: 1513 microversion: 2.1 time: 0.529027 Jun 10 18:10:22.635184 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1958/3819] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:22 2022] GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301 => generated 1513 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:22.736122 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-37c360c4-d6ac-4d51-93c4-47360c615705 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:22.745588 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-37c360c4-d6ac-4d51-93c4-47360c615705 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1508 microversion: 2.1 time: 0.267416 Jun 10 18:10:22.746291 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1862/3820] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:22 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1508 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:10:22.954748 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-097bb2ee-76f6-48da-ad74-1ddde0a4c242 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:22.955380 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-097bb2ee-76f6-48da-ad74-1ddde0a4c242 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] [instance: 7c3a4081-92e2-4c7c-8283-faebd5302cf9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:22.962257 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-097bb2ee-76f6-48da-ad74-1ddde0a4c242 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:22.962894 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-097bb2ee-76f6-48da-ad74-1ddde0a4c242 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:22.963778 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-097bb2ee-76f6-48da-ad74-1ddde0a4c242 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:22.964550 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-097bb2ee-76f6-48da-ad74-1ddde0a4c242 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:22.978915 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6cb17979-cacd-46b8-9c5a-48bedcec9424 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:22.980162 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6cb17979-cacd-46b8-9c5a-48bedcec9424 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] [instance: 55d00e0b-eb97-4076-94f6-0ecf02d933cd] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:22.995934 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6cb17979-cacd-46b8-9c5a-48bedcec9424 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:22.996456 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6cb17979-cacd-46b8-9c5a-48bedcec9424 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:22.997235 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6cb17979-cacd-46b8-9c5a-48bedcec9424 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:22.998549 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6cb17979-cacd-46b8-9c5a-48bedcec9424 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:23.036736 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6cb17979-cacd-46b8-9c5a-48bedcec9424 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:23.041296 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6cb17979-cacd-46b8-9c5a-48bedcec9424 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:23.041296 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-6cb17979-cacd-46b8-9c5a-48bedcec9424 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lazy-loading 'fault' on Instance uuid 55d00e0b-eb97-4076-94f6-0ecf02d933cd {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:10:23.092791 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6cb17979-cacd-46b8-9c5a-48bedcec9424 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0c14dee0e14114aa63c2496ef2d4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088c9a2a1f8a429eba4b4a68c9bade12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:23.096243 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-097bb2ee-76f6-48da-ad74-1ddde0a4c242 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c896f867509494cbce2e8f37d4cf0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e32c729a2b641f381e661905d930ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:23.101771 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6cb17979-cacd-46b8-9c5a-48bedcec9424 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd" status: 200 len: 1303 microversion: 2.1 time: 0.126592 Jun 10 18:10:23.102363 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1863/3821] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:22 2022] GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd => generated 1303 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:10:23.111587 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-097bb2ee-76f6-48da-ad74-1ddde0a4c242 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] 10.222.0.35 "GET /compute/v2.1/servers/7c3a4081-92e2-4c7c-8283-faebd5302cf9" status: 200 len: 1277 microversion: 2.1 time: 0.154680 Jun 10 18:10:23.111587 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1959/3822] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:22 2022] GET /compute/v2.1/servers/7c3a4081-92e2-4c7c-8283-faebd5302cf9 => generated 1277 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:23.147750 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-0c0fe7ab-8cf7-4687-ad8a-ebbedc8b877a req-832b2b63-200c-4ad8-b093-38e40c0135d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38887a36-3b6b-48ad-b967-77a941762301", "name": "network-vif-deleted", "tag": "6a372080-5ad3-4b6e-9715-fca55eed9b4d"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:10:23.164794 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-0c0fe7ab-8cf7-4687-ad8a-ebbedc8b877a req-832b2b63-200c-4ad8-b093-38e40c0135d3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:23.165260 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-0c0fe7ab-8cf7-4687-ad8a-ebbedc8b877a req-832b2b63-200c-4ad8-b093-38e40c0135d3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:23.184383 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-0c0fe7ab-8cf7-4687-ad8a-ebbedc8b877a req-832b2b63-200c-4ad8-b093-38e40c0135d3 service nova] Creating event network-vif-deleted:6a372080-5ad3-4b6e-9715-fca55eed9b4d for instance 38887a36-3b6b-48ad-b967-77a941762301 on chh1-master-2 Jun 10 18:10:23.194789 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-0c0fe7ab-8cf7-4687-ad8a-ebbedc8b877a req-832b2b63-200c-4ad8-b093-38e40c0135d3 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049597 Jun 10 18:10:23.195370 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1960/3823] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:10:23.473671 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6a4055c2-134c-4295-8b19-1786c7bf5573 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:23.476781 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6a4055c2-134c-4295-8b19-1786c7bf5573 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] [instance: 911b33c1-545d-4bcb-9ca1-c42c7bda606b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:23.498791 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a4055c2-134c-4295-8b19-1786c7bf5573 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:23.502687 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a4055c2-134c-4295-8b19-1786c7bf5573 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:23.503841 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a4055c2-134c-4295-8b19-1786c7bf5573 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:23.506732 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a4055c2-134c-4295-8b19-1786c7bf5573 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:23.652229 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-afb7646f-e32b-4cf6-92dd-dd7178162455 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:23.653198 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-afb7646f-e32b-4cf6-92dd-dd7178162455 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] [instance: 38887a36-3b6b-48ad-b967-77a941762301] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:23.672983 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-afb7646f-e32b-4cf6-92dd-dd7178162455 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:23.673566 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-afb7646f-e32b-4cf6-92dd-dd7178162455 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:23.676512 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-afb7646f-e32b-4cf6-92dd-dd7178162455 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:23.677077 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-afb7646f-e32b-4cf6-92dd-dd7178162455 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:23.716155 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-afb7646f-e32b-4cf6-92dd-dd7178162455 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:23.716604 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-afb7646f-e32b-4cf6-92dd-dd7178162455 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:23.717060 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-afb7646f-e32b-4cf6-92dd-dd7178162455 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lazy-loading 'fault' on Instance uuid 38887a36-3b6b-48ad-b967-77a941762301 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:10:23.768464 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-afb7646f-e32b-4cf6-92dd-dd7178162455 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d89341a3e541b2a765c011c1d751cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acded04c228a408b82bccdf323bb5a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:23.777330 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-afb7646f-e32b-4cf6-92dd-dd7178162455 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] 10.222.0.35 "GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301" status: 200 len: 1307 microversion: 2.1 time: 0.129939 Jun 10 18:10:23.787515 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1961/3824] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:23 2022] GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301 => generated 1307 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:10:23.788204 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6a4055c2-134c-4295-8b19-1786c7bf5573 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc673eee8339438cbb69ac8bc8df633e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38326c7c8786498a94e003d80740c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:23.794233 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-de953a5d-2640-4ba3-b57a-282e60581497 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:23.794942 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-de953a5d-2640-4ba3-b57a-282e60581497 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:23.801372 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-de953a5d-2640-4ba3-b57a-282e60581497 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:23.802083 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-de953a5d-2640-4ba3-b57a-282e60581497 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:23.809358 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-de953a5d-2640-4ba3-b57a-282e60581497 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:23.809358 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-de953a5d-2640-4ba3-b57a-282e60581497 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:23.809565 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6a4055c2-134c-4295-8b19-1786c7bf5573 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b" status: 200 len: 1467 microversion: 2.1 time: 0.337987 Jun 10 18:10:23.822169 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1864/3825] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:23 2022] GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b => generated 1467 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:23.829169 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-97aaafee-30fb-491d-8059-038445af5d09 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-483283232", "metadata": {"image_type": "test"}}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:10:23.843428 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-97aaafee-30fb-491d-8059-038445af5d09 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] [instance: 911b33c1-545d-4bcb-9ca1-c42c7bda606b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:23.851688 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-97aaafee-30fb-491d-8059-038445af5d09 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:23.852440 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-97aaafee-30fb-491d-8059-038445af5d09 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:23.853573 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-97aaafee-30fb-491d-8059-038445af5d09 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:23.854225 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-97aaafee-30fb-491d-8059-038445af5d09 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:23.906170 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-97aaafee-30fb-491d-8059-038445af5d09 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Getting quotas for project 38326c7c8786498a94e003d80740c5cf. Resources: dict_keys(['metadata_items']) {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:10:23.915323 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-97aaafee-30fb-491d-8059-038445af5d09 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Getting quotas for user cc673eee8339438cbb69ac8bc8df633e and project 38326c7c8786498a94e003d80740c5cf. Resources: dict_keys(['metadata_items']) {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:10:23.999942 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-de953a5d-2640-4ba3-b57a-282e60581497 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:24.014649 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-de953a5d-2640-4ba3-b57a-282e60581497 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1508 microversion: 2.1 time: 0.229361 Jun 10 18:10:24.015388 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1962/3826] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:23 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1508 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:24.122603 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e854117f-48cf-421d-98ab-b466450c0cb7 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:24.123247 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e854117f-48cf-421d-98ab-b466450c0cb7 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] [instance: 55d00e0b-eb97-4076-94f6-0ecf02d933cd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:24.138496 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e854117f-48cf-421d-98ab-b466450c0cb7 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:24.140269 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e854117f-48cf-421d-98ab-b466450c0cb7 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:24.142161 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e854117f-48cf-421d-98ab-b466450c0cb7 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:24.142161 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e854117f-48cf-421d-98ab-b466450c0cb7 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:24.168732 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-e854117f-48cf-421d-98ab-b466450c0cb7 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] HTTP exception thrown: Instance 55d00e0b-eb97-4076-94f6-0ecf02d933cd could not be found. Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e854117f-48cf-421d-98ab-b466450c0cb7 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Request method failure captured: Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd HTTP/1.1 Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4jx4JuLUuS4nWZwfF_f7Q35GZ456Vat8_MJWsWum7U1dFMA_sI8SbMV_RtJwUxa2HQTNqGNugtlVbiKqWi7Z1qmQywv8WBJEG_r9IKGjwl_1PqgzfEHtZBufY1JLPzgXHNHCoGmrEnFd_uMVVrHYnOXptTninq7ehkWouJNryL3_qc Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 088c9a2a1f8a429eba4b4a68c9bade12 Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServerGroupTestJSON-1793951911 Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/088c9a2a1f8a429eba4b4a68c9bade12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/088c9a2a1f8a429eba4b4a68c9bade12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/088c9a2a1f8a429eba4b4a68c9bade12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_088c9a2a1f8a429eba4b4a68c9bade12", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServerGroupTestJSON-1793951911 Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 088c9a2a1f8a429eba4b4a68c9bade12 Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServerGroupTestJSON-1793951911 Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServerGroupTestJSON-1793951911-project Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 6e0c14dee0e14114aa63c2496ef2d4cf Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServerGroupTestJSON-1793951911-project Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 55d00e0b-eb97-4076-94f6-0ecf02d933cd could not be found. Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '55d00e0b-eb97-4076-94f6-0ecf02d933cd'} Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55d00e0b-eb97-4076-94f6-0ecf02d933cd could not be found. Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55d00e0b-eb97-4076-94f6-0ecf02d933cd could not be found. Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:10:24.172119 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:10:24.178999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:10:24.178999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:10:24.178999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:10:24.178999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:10:24.178999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:10:24.178999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55d00e0b-eb97-4076-94f6-0ecf02d933cd could not be found. Jun 10 18:10:24.178999 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:10:24.178999 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e854117f-48cf-421d-98ab-b466450c0cb7 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Returning 404 to user: Instance 55d00e0b-eb97-4076-94f6-0ecf02d933cd could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:10:24.184018 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e854117f-48cf-421d-98ab-b466450c0cb7 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd" status: 404 len: 111 microversion: 2.1 time: 0.059696 Jun 10 18:10:24.185001 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1963/3827] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:24 2022] GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:10:24.195244 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7da01a75-078f-4f5d-a0b9-47e2c1ee4992 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:24.196344 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7da01a75-078f-4f5d-a0b9-47e2c1ee4992 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] [instance: 7c3a4081-92e2-4c7c-8283-faebd5302cf9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:24.224956 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7da01a75-078f-4f5d-a0b9-47e2c1ee4992 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:24.225944 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7da01a75-078f-4f5d-a0b9-47e2c1ee4992 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:24.226768 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7da01a75-078f-4f5d-a0b9-47e2c1ee4992 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:24.227211 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7da01a75-078f-4f5d-a0b9-47e2c1ee4992 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:24.488670 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7da01a75-078f-4f5d-a0b9-47e2c1ee4992 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c896f867509494cbce2e8f37d4cf0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e32c729a2b641f381e661905d930ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:24.502708 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7da01a75-078f-4f5d-a0b9-47e2c1ee4992 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] 10.222.0.35 "GET /compute/v2.1/servers/7c3a4081-92e2-4c7c-8283-faebd5302cf9" status: 200 len: 1283 microversion: 2.1 time: 0.315363 Jun 10 18:10:24.503589 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1964/3828] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:24 2022] GET /compute/v2.1/servers/7c3a4081-92e2-4c7c-8283-faebd5302cf9 => generated 1283 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:24.520210 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-14c3c97d-f7a4-4e28-b862-900e6bb90c40 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:24.540832 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.compute.server_groups [None req-14c3c97d-f7a4-4e28-b862-900e6bb90c40 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Querying cell 0f13ffb7-1a21-4641-8558-8a89dd295960(cell1) for 1 instances {{(pid=126594) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jun 10 18:10:24.542008 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-14c3c97d-f7a4-4e28-b862-900e6bb90c40 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:24.542767 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-14c3c97d-f7a4-4e28-b862-900e6bb90c40 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:24.575197 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-14c3c97d-f7a4-4e28-b862-900e6bb90c40 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.070383 Jun 10 18:10:24.576337 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1965/3829] 10.222.0.35 () {58 vars in 1151 bytes} [Fri Jun 10 18:10:24 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:10:24.587876 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0eb13411-cc94-4d1e-8fa7-8a2dd466ac4b tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:24.604084 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.compute.server_groups [None req-0eb13411-cc94-4d1e-8fa7-8a2dd466ac4b tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Querying cell 0f13ffb7-1a21-4641-8558-8a89dd295960(cell1) for 1 instances {{(pid=126594) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jun 10 18:10:24.606222 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0eb13411-cc94-4d1e-8fa7-8a2dd466ac4b tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:24.607137 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0eb13411-cc94-4d1e-8fa7-8a2dd466ac4b tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:24.621929 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0eb13411-cc94-4d1e-8fa7-8a2dd466ac4b tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "GET /compute/v2.1/os-server-groups/eeb86332-5321-49af-8694-2b0446ea117e" status: 200 len: 184 microversion: 2.1 time: 0.038360 Jun 10 18:10:24.623369 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1966/3830] 10.222.0.35 () {58 vars in 1262 bytes} [Fri Jun 10 18:10:24 2022] GET /compute/v2.1/os-server-groups/eeb86332-5321-49af-8694-2b0446ea117e => generated 184 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:10:24.634507 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-de092d92-c55d-49ca-87f4-574a9bf4fec6 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:24.635367 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-de092d92-c55d-49ca-87f4-574a9bf4fec6 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] [instance: 55d00e0b-eb97-4076-94f6-0ecf02d933cd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:24.643975 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-de092d92-c55d-49ca-87f4-574a9bf4fec6 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:24.646099 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-de092d92-c55d-49ca-87f4-574a9bf4fec6 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:24.654260 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-de092d92-c55d-49ca-87f4-574a9bf4fec6 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:24.654260 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-de092d92-c55d-49ca-87f4-574a9bf4fec6 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:24.666081 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-de092d92-c55d-49ca-87f4-574a9bf4fec6 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] HTTP exception thrown: Instance 55d00e0b-eb97-4076-94f6-0ecf02d933cd could not be found. Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-de092d92-c55d-49ca-87f4-574a9bf4fec6 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Request method failure captured: Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: request: DELETE /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd HTTP/1.1 Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4jx4JuLUuS4nWZwfF_f7Q35GZ456Vat8_MJWsWum7U1dFMA_sI8SbMV_RtJwUxa2HQTNqGNugtlVbiKqWi7Z1qmQywv8WBJEG_r9IKGjwl_1PqgzfEHtZBufY1JLPzgXHNHCoGmrEnFd_uMVVrHYnOXptTninq7ehkWouJNryL3_qc Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 088c9a2a1f8a429eba4b4a68c9bade12 Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServerGroupTestJSON-1793951911 Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/088c9a2a1f8a429eba4b4a68c9bade12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/088c9a2a1f8a429eba4b4a68c9bade12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/088c9a2a1f8a429eba4b4a68c9bade12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_088c9a2a1f8a429eba4b4a68c9bade12", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServerGroupTestJSON-1793951911 Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 088c9a2a1f8a429eba4b4a68c9bade12 Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServerGroupTestJSON-1793951911 Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServerGroupTestJSON-1793951911-project Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 6e0c14dee0e14114aa63c2496ef2d4cf Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServerGroupTestJSON-1793951911-project Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 55d00e0b-eb97-4076-94f6-0ecf02d933cd could not be found. Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '55d00e0b-eb97-4076-94f6-0ecf02d933cd'} Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55d00e0b-eb97-4076-94f6-0ecf02d933cd could not be found. Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:10:24.668694 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:10:24.673328 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55d00e0b-eb97-4076-94f6-0ecf02d933cd could not be found. Jun 10 18:10:24.673328 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:10:24.673328 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:10:24.673328 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:10:24.673328 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:10:24.673328 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:10:24.673328 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:10:24.673328 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:10:24.673328 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:10:24.673328 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55d00e0b-eb97-4076-94f6-0ecf02d933cd could not be found. Jun 10 18:10:24.673328 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:10:24.673328 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-de092d92-c55d-49ca-87f4-574a9bf4fec6 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Returning 404 to user: Instance 55d00e0b-eb97-4076-94f6-0ecf02d933cd could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:10:24.673328 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-de092d92-c55d-49ca-87f4-574a9bf4fec6 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "DELETE /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd" status: 404 len: 111 microversion: 2.1 time: 0.041442 Jun 10 18:10:24.673328 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1967/3831] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:10:24 2022] DELETE /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:10:24.684941 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e856c186-85a7-4019-8298-67f7a17a8df7 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:24.685665 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e856c186-85a7-4019-8298-67f7a17a8df7 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] [instance: 55d00e0b-eb97-4076-94f6-0ecf02d933cd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:24.687542 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-97aaafee-30fb-491d-8059-038445af5d09 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "POST /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b/action" status: 202 len: 0 microversion: 2.1 time: 0.863618 Jun 10 18:10:24.689756 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1865/3832] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:10:23 2022] POST /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b/action => generated 0 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 10 18:10:24.705772 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e856c186-85a7-4019-8298-67f7a17a8df7 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:24.706348 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e856c186-85a7-4019-8298-67f7a17a8df7 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:24.707282 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e856c186-85a7-4019-8298-67f7a17a8df7 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:24.707845 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e856c186-85a7-4019-8298-67f7a17a8df7 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:24.713114 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:10:24.723804 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-e856c186-85a7-4019-8298-67f7a17a8df7 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] HTTP exception thrown: Instance 55d00e0b-eb97-4076-94f6-0ecf02d933cd could not be found. Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e856c186-85a7-4019-8298-67f7a17a8df7 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Request method failure captured: Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd HTTP/1.1 Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4jx4JuLUuS4nWZwfF_f7Q35GZ456Vat8_MJWsWum7U1dFMA_sI8SbMV_RtJwUxa2HQTNqGNugtlVbiKqWi7Z1qmQywv8WBJEG_r9IKGjwl_1PqgzfEHtZBufY1JLPzgXHNHCoGmrEnFd_uMVVrHYnOXptTninq7ehkWouJNryL3_qc Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 088c9a2a1f8a429eba4b4a68c9bade12 Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServerGroupTestJSON-1793951911 Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/088c9a2a1f8a429eba4b4a68c9bade12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/088c9a2a1f8a429eba4b4a68c9bade12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/088c9a2a1f8a429eba4b4a68c9bade12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_088c9a2a1f8a429eba4b4a68c9bade12", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServerGroupTestJSON-1793951911 Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 088c9a2a1f8a429eba4b4a68c9bade12 Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServerGroupTestJSON-1793951911 Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServerGroupTestJSON-1793951911-project Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 6e0c14dee0e14114aa63c2496ef2d4cf Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServerGroupTestJSON-1793951911-project Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 55d00e0b-eb97-4076-94f6-0ecf02d933cd could not be found. Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '55d00e0b-eb97-4076-94f6-0ecf02d933cd'} Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55d00e0b-eb97-4076-94f6-0ecf02d933cd could not be found. Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55d00e0b-eb97-4076-94f6-0ecf02d933cd could not be found. Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:10:24.726498 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:10:24.730326 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:10:24.730326 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:10:24.730326 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:10:24.730326 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:10:24.730326 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:10:24.730326 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55d00e0b-eb97-4076-94f6-0ecf02d933cd could not be found. Jun 10 18:10:24.730326 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:10:24.732285 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e856c186-85a7-4019-8298-67f7a17a8df7 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Returning 404 to user: Instance 55d00e0b-eb97-4076-94f6-0ecf02d933cd could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:10:24.733345 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e856c186-85a7-4019-8298-67f7a17a8df7 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd" status: 404 len: 111 microversion: 2.1 time: 0.055976 Jun 10 18:10:24.736971 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1968/3833] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:24 2022] GET /compute/v2.1/servers/55d00e0b-eb97-4076-94f6-0ecf02d933cd => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:10:24.742444 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3ebc1713-8971-4c5b-b1b2-9186af25ee0a tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:24.745463 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-026583da-67d0-4009-a138-d442243f5d18 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c0099430>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:24.750333 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-3ebc1713-8971-4c5b-b1b2-9186af25ee0a tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] HTTP exception thrown: Instance group f661d8f0-05c9-4244-bde0-07e1bb1d8049 could not be found. Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3ebc1713-8971-4c5b-b1b2-9186af25ee0a tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Request method failure captured: Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: request: DELETE /compute/v2.1/os-server-groups/f661d8f0-05c9-4244-bde0-07e1bb1d8049 HTTP/1.1 Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4jx4JuLUuS4nWZwfF_f7Q35GZ456Vat8_MJWsWum7U1dFMA_sI8SbMV_RtJwUxa2HQTNqGNugtlVbiKqWi7Z1qmQywv8WBJEG_r9IKGjwl_1PqgzfEHtZBufY1JLPzgXHNHCoGmrEnFd_uMVVrHYnOXptTninq7ehkWouJNryL3_qc Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 088c9a2a1f8a429eba4b4a68c9bade12 Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServerGroupTestJSON-1793951911 Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/088c9a2a1f8a429eba4b4a68c9bade12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/088c9a2a1f8a429eba4b4a68c9bade12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/088c9a2a1f8a429eba4b4a68c9bade12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_088c9a2a1f8a429eba4b4a68c9bade12", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServerGroupTestJSON-1793951911 Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 088c9a2a1f8a429eba4b4a68c9bade12 Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServerGroupTestJSON-1793951911 Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServerGroupTestJSON-1793951911-project Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 6e0c14dee0e14114aa63c2496ef2d4cf Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServerGroupTestJSON-1793951911-project Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: exception: Instance group f661d8f0-05c9-4244-bde0-07e1bb1d8049 could not be found. Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'f661d8f0-05c9-4244-bde0-07e1bb1d8049'} Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group f661d8f0-05c9-4244-bde0-07e1bb1d8049 could not be found. Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group f661d8f0-05c9-4244-bde0-07e1bb1d8049 could not be found. Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:10:24.781266 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:10:24.785232 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:10:24.785232 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:10:24.785232 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:10:24.785232 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:10:24.785232 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group f661d8f0-05c9-4244-bde0-07e1bb1d8049 could not be found. Jun 10 18:10:24.785232 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:10:24.785232 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3ebc1713-8971-4c5b-b1b2-9186af25ee0a tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Returning 404 to user: Instance group f661d8f0-05c9-4244-bde0-07e1bb1d8049 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:10:24.786038 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3ebc1713-8971-4c5b-b1b2-9186af25ee0a tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "DELETE /compute/v2.1/os-server-groups/f661d8f0-05c9-4244-bde0-07e1bb1d8049" status: 404 len: 117 microversion: 2.1 time: 0.047801 Jun 10 18:10:24.793221 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1969/3834] 10.222.0.35 () {58 vars in 1265 bytes} [Fri Jun 10 18:10:24 2022] DELETE /compute/v2.1/os-server-groups/f661d8f0-05c9-4244-bde0-07e1bb1d8049 => generated 117 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:10:24.808903 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0005b061-fbb0-4a54-a466-eaaef80d80c9 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:24.812439 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0005b061-fbb0-4a54-a466-eaaef80d80c9 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] [instance: 38887a36-3b6b-48ad-b967-77a941762301] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:24.855392 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-026583da-67d0-4009-a138-d442243f5d18 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/8a932e43-b89d-4e0e-9927-1a9b2061c2c0" status: 200 len: 1421 microversion: 2.1 time: 0.133695 Jun 10 18:10:24.857177 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1866/3835] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:10:24 2022] GET /compute/v2.1/images/8a932e43-b89d-4e0e-9927-1a9b2061c2c0 => generated 1421 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:24.866178 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a54c0813-4e42-4186-a9e5-2d1880479737 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:24.874014 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0005b061-fbb0-4a54-a466-eaaef80d80c9 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:24.874545 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0005b061-fbb0-4a54-a466-eaaef80d80c9 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:24.875562 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0005b061-fbb0-4a54-a466-eaaef80d80c9 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:24.876165 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0005b061-fbb0-4a54-a466-eaaef80d80c9 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:24.881327 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-a54c0813-4e42-4186-a9e5-2d1880479737 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] HTTP exception thrown: Instance group ad17b564-bd31-4a00-8af3-b5e3d2139f78 could not be found. Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a54c0813-4e42-4186-a9e5-2d1880479737 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Request method failure captured: Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/os-server-groups/ad17b564-bd31-4a00-8af3-b5e3d2139f78 HTTP/1.1 Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4jx4JuLUuS4nWZwfF_f7Q35GZ456Vat8_MJWsWum7U1dFMA_sI8SbMV_RtJwUxa2HQTNqGNugtlVbiKqWi7Z1qmQywv8WBJEG_r9IKGjwl_1PqgzfEHtZBufY1JLPzgXHNHCoGmrEnFd_uMVVrHYnOXptTninq7ehkWouJNryL3_qc Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 088c9a2a1f8a429eba4b4a68c9bade12 Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServerGroupTestJSON-1793951911 Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/088c9a2a1f8a429eba4b4a68c9bade12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/088c9a2a1f8a429eba4b4a68c9bade12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/088c9a2a1f8a429eba4b4a68c9bade12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_088c9a2a1f8a429eba4b4a68c9bade12", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServerGroupTestJSON-1793951911 Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 088c9a2a1f8a429eba4b4a68c9bade12 Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServerGroupTestJSON-1793951911 Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServerGroupTestJSON-1793951911-project Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 6e0c14dee0e14114aa63c2496ef2d4cf Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServerGroupTestJSON-1793951911-project Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: exception: Instance group ad17b564-bd31-4a00-8af3-b5e3d2139f78 could not be found. Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'ad17b564-bd31-4a00-8af3-b5e3d2139f78'} Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group ad17b564-bd31-4a00-8af3-b5e3d2139f78 could not be found. Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group ad17b564-bd31-4a00-8af3-b5e3d2139f78 could not be found. Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:10:24.884620 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:10:24.889248 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:10:24.889248 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:10:24.889248 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:10:24.889248 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:10:24.889248 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group ad17b564-bd31-4a00-8af3-b5e3d2139f78 could not be found. Jun 10 18:10:24.889248 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:10:24.893472 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a54c0813-4e42-4186-a9e5-2d1880479737 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Returning 404 to user: Instance group ad17b564-bd31-4a00-8af3-b5e3d2139f78 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:10:24.895746 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a54c0813-4e42-4186-a9e5-2d1880479737 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "DELETE /compute/v2.1/os-server-groups/ad17b564-bd31-4a00-8af3-b5e3d2139f78" status: 404 len: 117 microversion: 2.1 time: 0.037402 Jun 10 18:10:24.896956 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1867/3836] 10.222.0.35 () {58 vars in 1265 bytes} [Fri Jun 10 18:10:24 2022] DELETE /compute/v2.1/os-server-groups/ad17b564-bd31-4a00-8af3-b5e3d2139f78 => generated 117 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:10:24.914572 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8afc6648-4bf7-4861-992a-0338e673d673 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:24.922886 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-0005b061-fbb0-4a54-a466-eaaef80d80c9 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] HTTP exception thrown: Instance 38887a36-3b6b-48ad-b967-77a941762301 could not be found. Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0005b061-fbb0-4a54-a466-eaaef80d80c9 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Request method failure captured: Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301 HTTP/1.1 Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4jynUcMHshWYxJLNAtyaPiwa4dbEv8UWNALTBgXTE1I_u7-Lunn0pR8QKDF3WSDLJKHKKiDaMms818iOIlAs5jS2cwFgHRuOpbpKWngsTbV-SCkNLG1EXmjjJaIB3rw7TUoBLLKND5V37iL39nsmzmiSXbSLOtBsKbkvKALwqT1eYU Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: acded04c228a408b82bccdf323bb5a13 Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-InstanceActionsTestJSON-187480122 Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/acded04c228a408b82bccdf323bb5a13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/acded04c228a408b82bccdf323bb5a13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/acded04c228a408b82bccdf323bb5a13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_acded04c228a408b82bccdf323bb5a13", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-InstanceActionsTestJSON-187480122 Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: acded04c228a408b82bccdf323bb5a13 Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-InstanceActionsTestJSON-187480122 Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-InstanceActionsTestJSON-187480122-project Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 36d89341a3e541b2a765c011c1d751cd Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-InstanceActionsTestJSON-187480122-project Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 38887a36-3b6b-48ad-b967-77a941762301 could not be found. Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '38887a36-3b6b-48ad-b967-77a941762301'} Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38887a36-3b6b-48ad-b967-77a941762301 could not be found. Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38887a36-3b6b-48ad-b967-77a941762301 could not be found. Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:10:24.925321 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:10:24.929767 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:10:24.929767 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:10:24.929767 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:10:24.929767 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:10:24.929767 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:10:24.929767 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38887a36-3b6b-48ad-b967-77a941762301 could not be found. Jun 10 18:10:24.929767 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:10:24.931853 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0005b061-fbb0-4a54-a466-eaaef80d80c9 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] Returning 404 to user: Instance 38887a36-3b6b-48ad-b967-77a941762301 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:10:24.934631 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0005b061-fbb0-4a54-a466-eaaef80d80c9 tempest-InstanceActionsTestJSON-187480122 tempest-InstanceActionsTestJSON-187480122-project] 10.222.0.35 "GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301" status: 404 len: 111 microversion: 2.1 time: 0.136724 Jun 10 18:10:24.935788 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1970/3837] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:24 2022] GET /compute/v2.1/servers/38887a36-3b6b-48ad-b967-77a941762301 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:10:24.940784 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-8afc6648-4bf7-4861-992a-0338e673d673 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] HTTP exception thrown: Instance group e42fcc4d-26f6-403e-8952-cbd12eff0505 could not be found. Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8afc6648-4bf7-4861-992a-0338e673d673 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Request method failure captured: Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/os-server-groups/e42fcc4d-26f6-403e-8952-cbd12eff0505 HTTP/1.1 Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4jx4JuLUuS4nWZwfF_f7Q35GZ456Vat8_MJWsWum7U1dFMA_sI8SbMV_RtJwUxa2HQTNqGNugtlVbiKqWi7Z1qmQywv8WBJEG_r9IKGjwl_1PqgzfEHtZBufY1JLPzgXHNHCoGmrEnFd_uMVVrHYnOXptTninq7ehkWouJNryL3_qc Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 088c9a2a1f8a429eba4b4a68c9bade12 Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServerGroupTestJSON-1793951911 Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/088c9a2a1f8a429eba4b4a68c9bade12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/088c9a2a1f8a429eba4b4a68c9bade12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/088c9a2a1f8a429eba4b4a68c9bade12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_088c9a2a1f8a429eba4b4a68c9bade12", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServerGroupTestJSON-1793951911 Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 088c9a2a1f8a429eba4b4a68c9bade12 Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServerGroupTestJSON-1793951911 Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServerGroupTestJSON-1793951911-project Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 6e0c14dee0e14114aa63c2496ef2d4cf Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServerGroupTestJSON-1793951911-project Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: exception: Instance group e42fcc4d-26f6-403e-8952-cbd12eff0505 could not be found. Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'e42fcc4d-26f6-403e-8952-cbd12eff0505'} Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group e42fcc4d-26f6-403e-8952-cbd12eff0505 could not be found. Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group e42fcc4d-26f6-403e-8952-cbd12eff0505 could not be found. Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:10:24.942390 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:10:24.946348 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:10:24.946348 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:10:24.946348 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:10:24.946348 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:10:24.946348 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group e42fcc4d-26f6-403e-8952-cbd12eff0505 could not be found. Jun 10 18:10:24.946348 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:10:24.946348 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8afc6648-4bf7-4861-992a-0338e673d673 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Returning 404 to user: Instance group e42fcc4d-26f6-403e-8952-cbd12eff0505 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:10:24.946348 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8afc6648-4bf7-4861-992a-0338e673d673 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "DELETE /compute/v2.1/os-server-groups/e42fcc4d-26f6-403e-8952-cbd12eff0505" status: 404 len: 117 microversion: 2.1 time: 0.041342 Jun 10 18:10:24.946348 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1868/3838] 10.222.0.35 () {58 vars in 1265 bytes} [Fri Jun 10 18:10:24 2022] DELETE /compute/v2.1/os-server-groups/e42fcc4d-26f6-403e-8952-cbd12eff0505 => generated 117 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:10:24.953813 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c33d08df-7c95-47e4-8d96-a724eb3b8661 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:24.962066 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-c33d08df-7c95-47e4-8d96-a724eb3b8661 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] HTTP exception thrown: Instance group 2976b19c-2be3-41e6-a192-d771fc78bc6f could not be found. Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c33d08df-7c95-47e4-8d96-a724eb3b8661 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Request method failure captured: Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: request: DELETE /compute/v2.1/os-server-groups/2976b19c-2be3-41e6-a192-d771fc78bc6f HTTP/1.1 Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4jx4JuLUuS4nWZwfF_f7Q35GZ456Vat8_MJWsWum7U1dFMA_sI8SbMV_RtJwUxa2HQTNqGNugtlVbiKqWi7Z1qmQywv8WBJEG_r9IKGjwl_1PqgzfEHtZBufY1JLPzgXHNHCoGmrEnFd_uMVVrHYnOXptTninq7ehkWouJNryL3_qc Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 088c9a2a1f8a429eba4b4a68c9bade12 Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServerGroupTestJSON-1793951911 Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/088c9a2a1f8a429eba4b4a68c9bade12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/088c9a2a1f8a429eba4b4a68c9bade12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/088c9a2a1f8a429eba4b4a68c9bade12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_088c9a2a1f8a429eba4b4a68c9bade12", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServerGroupTestJSON-1793951911 Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 088c9a2a1f8a429eba4b4a68c9bade12 Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServerGroupTestJSON-1793951911 Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServerGroupTestJSON-1793951911-project Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 6e0c14dee0e14114aa63c2496ef2d4cf Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServerGroupTestJSON-1793951911-project Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: exception: Instance group 2976b19c-2be3-41e6-a192-d771fc78bc6f could not be found. Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '2976b19c-2be3-41e6-a192-d771fc78bc6f'} Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 2976b19c-2be3-41e6-a192-d771fc78bc6f could not be found. Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 2976b19c-2be3-41e6-a192-d771fc78bc6f could not be found. Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:10:24.962592 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:10:24.967285 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:10:24.967285 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:10:24.967285 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:10:24.967285 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:10:24.967285 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 2976b19c-2be3-41e6-a192-d771fc78bc6f could not be found. Jun 10 18:10:24.967285 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:10:24.967285 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c33d08df-7c95-47e4-8d96-a724eb3b8661 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Returning 404 to user: Instance group 2976b19c-2be3-41e6-a192-d771fc78bc6f could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:10:24.967285 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c33d08df-7c95-47e4-8d96-a724eb3b8661 tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "DELETE /compute/v2.1/os-server-groups/2976b19c-2be3-41e6-a192-d771fc78bc6f" status: 404 len: 117 microversion: 2.1 time: 0.015754 Jun 10 18:10:24.967285 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1971/3839] 10.222.0.35 () {58 vars in 1265 bytes} [Fri Jun 10 18:10:24 2022] DELETE /compute/v2.1/os-server-groups/2976b19c-2be3-41e6-a192-d771fc78bc6f => generated 117 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:10:24.976522 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1321fff8-4259-48a2-af7a-22dcc2cc3c8b tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:25.035241 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d46f4cec-4b55-415c-9e63-c01c9d65f89f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:25.036020 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d46f4cec-4b55-415c-9e63-c01c9d65f89f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:25.050667 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d46f4cec-4b55-415c-9e63-c01c9d65f89f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:25.051132 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d46f4cec-4b55-415c-9e63-c01c9d65f89f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:25.055115 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d46f4cec-4b55-415c-9e63-c01c9d65f89f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:25.055634 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d46f4cec-4b55-415c-9e63-c01c9d65f89f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:25.096339 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1321fff8-4259-48a2-af7a-22dcc2cc3c8b tempest-ServerGroupTestJSON-1793951911 tempest-ServerGroupTestJSON-1793951911-project] 10.222.0.35 "DELETE /compute/v2.1/os-server-groups/eeb86332-5321-49af-8694-2b0446ea117e" status: 204 len: 0 microversion: 2.1 time: 0.125363 Jun 10 18:10:25.097014 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1869/3840] 10.222.0.35 () {58 vars in 1265 bytes} [Fri Jun 10 18:10:24 2022] DELETE /compute/v2.1/os-server-groups/eeb86332-5321-49af-8694-2b0446ea117e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:10:25.527872 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0ffa12ad-924e-4203-896f-a832a3c595ba tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:25.528893 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0ffa12ad-924e-4203-896f-a832a3c595ba tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] [instance: 7c3a4081-92e2-4c7c-8283-faebd5302cf9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:25.539254 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0ffa12ad-924e-4203-896f-a832a3c595ba tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:25.540212 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0ffa12ad-924e-4203-896f-a832a3c595ba tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:25.541251 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0ffa12ad-924e-4203-896f-a832a3c595ba tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:25.542283 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0ffa12ad-924e-4203-896f-a832a3c595ba tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:25.822424 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d46f4cec-4b55-415c-9e63-c01c9d65f89f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:25.834107 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d46f4cec-4b55-415c-9e63-c01c9d65f89f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1508 microversion: 2.1 time: 0.804899 Jun 10 18:10:25.835102 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1972/3841] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:25 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1508 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:25.854198 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0ffa12ad-924e-4203-896f-a832a3c595ba tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c896f867509494cbce2e8f37d4cf0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e32c729a2b641f381e661905d930ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:25.867784 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0ffa12ad-924e-4203-896f-a832a3c595ba tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] 10.222.0.35 "GET /compute/v2.1/servers/7c3a4081-92e2-4c7c-8283-faebd5302cf9" status: 200 len: 1350 microversion: 2.1 time: 0.345891 Jun 10 18:10:25.878503 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f4a9e1ef-5b30-4526-b167-e0a557bedf81 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c08fcee0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:25.879835 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1870/3842] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:25 2022] GET /compute/v2.1/servers/7c3a4081-92e2-4c7c-8283-faebd5302cf9 => generated 1350 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:10:25.943672 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f4a9e1ef-5b30-4526-b167-e0a557bedf81 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/8a932e43-b89d-4e0e-9927-1a9b2061c2c0" status: 200 len: 1421 microversion: 2.1 time: 0.077581 Jun 10 18:10:25.945132 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1973/3843] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:10:25 2022] GET /compute/v2.1/images/8a932e43-b89d-4e0e-9927-1a9b2061c2c0 => generated 1421 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:10:26.229890 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-b3b7de7a-5749-47df-af6d-11b69afaf35e req-60367718-0a83-4a60-8a8b-25071f8dd23e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c3a4081-92e2-4c7c-8283-faebd5302cf9", "tag": "8ab067d1-1b0e-4361-8885-c16e28f66095"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:10:26.235054 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=1,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:10:26.254376 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-b3b7de7a-5749-47df-af6d-11b69afaf35e req-60367718-0a83-4a60-8a8b-25071f8dd23e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:26.256450 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-b3b7de7a-5749-47df-af6d-11b69afaf35e req-60367718-0a83-4a60-8a8b-25071f8dd23e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:26.278318 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-b3b7de7a-5749-47df-af6d-11b69afaf35e req-60367718-0a83-4a60-8a8b-25071f8dd23e service nova] Creating event network-changed:8ab067d1-1b0e-4361-8885-c16e28f66095 for instance 7c3a4081-92e2-4c7c-8283-faebd5302cf9 on chh1-master-2 Jun 10 18:10:26.283592 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-b3b7de7a-5749-47df-af6d-11b69afaf35e req-60367718-0a83-4a60-8a8b-25071f8dd23e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058009 Jun 10 18:10:26.284602 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1871/3844] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:10:26.855640 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b2021e1a-673c-4dec-83ae-f3a577bf4209 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:26.857012 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b2021e1a-673c-4dec-83ae-f3a577bf4209 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:26.882636 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b2021e1a-673c-4dec-83ae-f3a577bf4209 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:26.883295 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b2021e1a-673c-4dec-83ae-f3a577bf4209 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:26.884217 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b2021e1a-673c-4dec-83ae-f3a577bf4209 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:26.888932 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b2021e1a-673c-4dec-83ae-f3a577bf4209 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:26.899892 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4820da6d-ace9-482f-bcb6-e4869b7b0a59 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:26.901292 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4820da6d-ace9-482f-bcb6-e4869b7b0a59 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] [instance: 7c3a4081-92e2-4c7c-8283-faebd5302cf9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:26.916822 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4820da6d-ace9-482f-bcb6-e4869b7b0a59 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:26.918120 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4820da6d-ace9-482f-bcb6-e4869b7b0a59 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:26.919138 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4820da6d-ace9-482f-bcb6-e4869b7b0a59 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:26.919744 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4820da6d-ace9-482f-bcb6-e4869b7b0a59 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:27.164993 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4820da6d-ace9-482f-bcb6-e4869b7b0a59 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c896f867509494cbce2e8f37d4cf0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e32c729a2b641f381e661905d930ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:27.174765 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4820da6d-ace9-482f-bcb6-e4869b7b0a59 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] 10.222.0.35 "GET /compute/v2.1/servers/7c3a4081-92e2-4c7c-8283-faebd5302cf9" status: 200 len: 1350 microversion: 2.1 time: 0.292248 Jun 10 18:10:27.175999 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1872/3845] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:26 2022] GET /compute/v2.1/servers/7c3a4081-92e2-4c7c-8283-faebd5302cf9 => generated 1350 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:10:27.180700 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e01f64f5-380f-47bf-bf4b-7beff2c4bc5e tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c0039c10>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:27.242534 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e01f64f5-380f-47bf-bf4b-7beff2c4bc5e tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/8a932e43-b89d-4e0e-9927-1a9b2061c2c0" status: 200 len: 1421 microversion: 2.1 time: 0.065743 Jun 10 18:10:27.249262 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1873/3846] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:10:27 2022] GET /compute/v2.1/images/8a932e43-b89d-4e0e-9927-1a9b2061c2c0 => generated 1421 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:27.308027 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b2021e1a-673c-4dec-83ae-f3a577bf4209 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:27.316321 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b2021e1a-673c-4dec-83ae-f3a577bf4209 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1508 microversion: 2.1 time: 0.467313 Jun 10 18:10:27.316913 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1974/3847] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:26 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1508 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:28.191359 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-24f19a5c-b2f9-4eaf-bc2d-ac5749304b42 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:28.192245 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-24f19a5c-b2f9-4eaf-bc2d-ac5749304b42 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] [instance: 7c3a4081-92e2-4c7c-8283-faebd5302cf9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:28.200016 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-24f19a5c-b2f9-4eaf-bc2d-ac5749304b42 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:28.200556 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-24f19a5c-b2f9-4eaf-bc2d-ac5749304b42 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:28.201545 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-24f19a5c-b2f9-4eaf-bc2d-ac5749304b42 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:28.202191 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-24f19a5c-b2f9-4eaf-bc2d-ac5749304b42 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:28.303558 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-170d9cae-1753-46f8-9097-44ff8c3645c9 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1433948541", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "c4c55f71-1c4e-45cb-86cc-248508a27e11"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:10:28.361081 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-170d9cae-1753-46f8-9097-44ff8c3645c9 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] validate_networks() for [('c4c55f71-1c4e-45cb-86cc-248508a27e11', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:10:28.426743 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-24f19a5c-b2f9-4eaf-bc2d-ac5749304b42 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c896f867509494cbce2e8f37d4cf0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e32c729a2b641f381e661905d930ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:28.436528 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-24f19a5c-b2f9-4eaf-bc2d-ac5749304b42 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] 10.222.0.35 "GET /compute/v2.1/servers/7c3a4081-92e2-4c7c-8283-faebd5302cf9" status: 200 len: 1350 microversion: 2.1 time: 0.249208 Jun 10 18:10:28.440427 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1975/3848] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:28 2022] GET /compute/v2.1/servers/7c3a4081-92e2-4c7c-8283-faebd5302cf9 => generated 1350 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:10:28.472887 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8d5fa8b5-9fbd-40c4-ada6-91eaef917904 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c0cc6ee0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:28.563856 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8d5fa8b5-9fbd-40c4-ada6-91eaef917904 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/8a932e43-b89d-4e0e-9927-1a9b2061c2c0" status: 200 len: 1421 microversion: 2.1 time: 0.121107 Jun 10 18:10:28.564815 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1976/3849] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:10:28 2022] GET /compute/v2.1/images/8a932e43-b89d-4e0e-9927-1a9b2061c2c0 => generated 1421 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:28.575425 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5833ce55-277f-4d1a-bf2f-a9a9568cb71e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:28.576288 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5833ce55-277f-4d1a-bf2f-a9a9568cb71e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:28.586061 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5833ce55-277f-4d1a-bf2f-a9a9568cb71e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:28.586527 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5833ce55-277f-4d1a-bf2f-a9a9568cb71e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:28.587321 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5833ce55-277f-4d1a-bf2f-a9a9568cb71e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:28.587808 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5833ce55-277f-4d1a-bf2f-a9a9568cb71e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:28.801490 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5833ce55-277f-4d1a-bf2f-a9a9568cb71e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:28.810620 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5833ce55-277f-4d1a-bf2f-a9a9568cb71e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1508 microversion: 2.1 time: 0.244641 Jun 10 18:10:28.811942 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1977/3850] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:28 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1508 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:28.890098 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-170d9cae-1753-46f8-9097-44ff8c3645c9 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:10:28.890098 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-170d9cae-1753-46f8-9097-44ff8c3645c9 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:10:28.890098 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-170d9cae-1753-46f8-9097-44ff8c3645c9 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:10:28.890681 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-170d9cae-1753-46f8-9097-44ff8c3645c9 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:10:28.891236 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-170d9cae-1753-46f8-9097-44ff8c3645c9 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:10:28.900755 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-170d9cae-1753-46f8-9097-44ff8c3645c9 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:28.901207 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-170d9cae-1753-46f8-9097-44ff8c3645c9 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:28.902647 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-170d9cae-1753-46f8-9097-44ff8c3645c9 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:28.903091 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-170d9cae-1753-46f8-9097-44ff8c3645c9 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:28.910486 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:10:28.924334 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-170d9cae-1753-46f8-9097-44ff8c3645c9 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Getting quotas for project 4d33177df0b44227bfaa8be53d56d7a1. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:10:28.930493 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-170d9cae-1753-46f8-9097-44ff8c3645c9 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Getting quotas for user 03179d7b781041f0988b9d1e00bd0963 and project 4d33177df0b44227bfaa8be53d56d7a1. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:10:28.959697 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-170d9cae-1753-46f8-9097-44ff8c3645c9 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:10:28.959697 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-170d9cae-1753-46f8-9097-44ff8c3645c9 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] [instance: b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:10:29.138708 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-170d9cae-1753-46f8-9097-44ff8c3645c9 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.007331 Jun 10 18:10:29.143794 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1874/3851] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:10:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:10:29.175019 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b72f02e6-c02f-437f-8484-c287e9248609 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:29.175676 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b72f02e6-c02f-437f-8484-c287e9248609 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] [instance: b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:29.338778 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a3db64e3-5dcb-4c12-b03d-dfa5965d6da6 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:29.338778 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a3db64e3-5dcb-4c12-b03d-dfa5965d6da6 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:29.364218 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a3db64e3-5dcb-4c12-b03d-dfa5965d6da6 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:29.372374 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a3db64e3-5dcb-4c12-b03d-dfa5965d6da6 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:29.372374 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a3db64e3-5dcb-4c12-b03d-dfa5965d6da6 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:29.372374 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a3db64e3-5dcb-4c12-b03d-dfa5965d6da6 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:29.429076 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b72f02e6-c02f-437f-8484-c287e9248609 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03179d7b781041f0988b9d1e00bd0963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d33177df0b44227bfaa8be53d56d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:29.436800 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b72f02e6-c02f-437f-8484-c287e9248609 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] 10.222.0.35 "GET /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1" status: 200 len: 1228 microversion: 2.1 time: 0.278543 Jun 10 18:10:29.458376 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1978/3852] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:29 2022] GET /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 => generated 1228 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:29.459964 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a3db64e3-5dcb-4c12-b03d-dfa5965d6da6 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127798 Jun 10 18:10:29.461066 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1875/3853] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:10:29 2022] GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:10:29.467851 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b8394246-198d-4b07-a285-71420f32eae7 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:29.468510 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b8394246-198d-4b07-a285-71420f32eae7 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] [instance: 7c3a4081-92e2-4c7c-8283-faebd5302cf9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:29.472254 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-60df49cc-8066-4140-a477-19c3e8337710 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:29.483650 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-60df49cc-8066-4140-a477-19c3e8337710 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:29.493893 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b8394246-198d-4b07-a285-71420f32eae7 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:29.494355 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b8394246-198d-4b07-a285-71420f32eae7 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:29.495150 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b8394246-198d-4b07-a285-71420f32eae7 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:29.496134 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b8394246-198d-4b07-a285-71420f32eae7 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:29.528583 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-60df49cc-8066-4140-a477-19c3e8337710 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:29.534320 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-60df49cc-8066-4140-a477-19c3e8337710 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:29.537193 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-60df49cc-8066-4140-a477-19c3e8337710 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:29.537921 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-60df49cc-8066-4140-a477-19c3e8337710 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:29.693458 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-60df49cc-8066-4140-a477-19c3e8337710 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lazy-loading 'services' on Instance uuid 739d282e-c869-4ebe-b4fb-7122f0070ce1 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:10:29.733387 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b8394246-198d-4b07-a285-71420f32eae7 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c896f867509494cbce2e8f37d4cf0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e32c729a2b641f381e661905d930ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:29.741562 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b8394246-198d-4b07-a285-71420f32eae7 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] 10.222.0.35 "GET /compute/v2.1/servers/7c3a4081-92e2-4c7c-8283-faebd5302cf9" status: 200 len: 1350 microversion: 2.1 time: 0.283762 Jun 10 18:10:29.745101 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1979/3854] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:29 2022] GET /compute/v2.1/servers/7c3a4081-92e2-4c7c-8283-faebd5302cf9 => generated 1350 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:29.754908 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-34830120-660f-42e3-a198-8bf0d4e625e7 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c094fd30>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:29.802373 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-34830120-660f-42e3-a198-8bf0d4e625e7 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/8a932e43-b89d-4e0e-9927-1a9b2061c2c0" status: 200 len: 1421 microversion: 2.1 time: 0.054802 Jun 10 18:10:29.807654 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1980/3855] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:10:29 2022] GET /compute/v2.1/images/8a932e43-b89d-4e0e-9927-1a9b2061c2c0 => generated 1421 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:29.830864 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-64580619-0080-40fa-9f44-9372f53460bd tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:29.830864 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-64580619-0080-40fa-9f44-9372f53460bd tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:29.835552 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-64580619-0080-40fa-9f44-9372f53460bd tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:29.836016 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-64580619-0080-40fa-9f44-9372f53460bd tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:29.836972 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-64580619-0080-40fa-9f44-9372f53460bd tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:29.837413 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-64580619-0080-40fa-9f44-9372f53460bd tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:30.056141 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-60df49cc-8066-4140-a477-19c3e8337710 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "DELETE /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1/os-volume_attachments/e40940bd-e343-4cf7-a598-5f26bcbed548" status: 202 len: 0 microversion: 2.1 time: 0.589546 Jun 10 18:10:30.057690 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1876/3856] 10.222.0.35 () {58 vars in 1415 bytes} [Fri Jun 10 18:10:29 2022] DELETE /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1/os-volume_attachments/e40940bd-e343-4cf7-a598-5f26bcbed548 => generated 0 bytes in 592 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 18:10:30.078025 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-64580619-0080-40fa-9f44-9372f53460bd tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:30.094951 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-64580619-0080-40fa-9f44-9372f53460bd tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1508 microversion: 2.1 time: 0.268620 Jun 10 18:10:30.096334 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1981/3857] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:29 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1508 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:10:30.454958 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5457346b-8ca4-4697-90d7-6d03ff2a3ee5 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:30.455673 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5457346b-8ca4-4697-90d7-6d03ff2a3ee5 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] [instance: b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:30.525879 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5457346b-8ca4-4697-90d7-6d03ff2a3ee5 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03179d7b781041f0988b9d1e00bd0963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d33177df0b44227bfaa8be53d56d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:30.534757 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5457346b-8ca4-4697-90d7-6d03ff2a3ee5 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] 10.222.0.35 "GET /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1" status: 200 len: 1228 microversion: 2.1 time: 0.084476 Jun 10 18:10:30.535404 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1877/3858] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:30 2022] GET /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 => generated 1228 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:10:30.763836 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1b816ba6-e063-44a8-af6d-97990b3fde05 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:30.764530 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1b816ba6-e063-44a8-af6d-97990b3fde05 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] [instance: 7c3a4081-92e2-4c7c-8283-faebd5302cf9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:30.767171 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:10:30.772207 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1b816ba6-e063-44a8-af6d-97990b3fde05 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:30.772718 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1b816ba6-e063-44a8-af6d-97990b3fde05 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:30.773546 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1b816ba6-e063-44a8-af6d-97990b3fde05 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:30.773990 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1b816ba6-e063-44a8-af6d-97990b3fde05 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:30.815011 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cc730f20-d355-4da1-a89e-2bf05a19a095 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c003e4c0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:30.867951 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cc730f20-d355-4da1-a89e-2bf05a19a095 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/8a932e43-b89d-4e0e-9927-1a9b2061c2c0" status: 200 len: 1421 microversion: 2.1 time: 0.056759 Jun 10 18:10:30.868582 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1878/3859] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:10:30 2022] GET /compute/v2.1/images/8a932e43-b89d-4e0e-9927-1a9b2061c2c0 => generated 1421 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:10:30.978688 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1b816ba6-e063-44a8-af6d-97990b3fde05 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c896f867509494cbce2e8f37d4cf0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e32c729a2b641f381e661905d930ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:30.989248 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1b816ba6-e063-44a8-af6d-97990b3fde05 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] 10.222.0.35 "GET /compute/v2.1/servers/7c3a4081-92e2-4c7c-8283-faebd5302cf9" status: 200 len: 1350 microversion: 2.1 time: 0.230578 Jun 10 18:10:30.991275 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1982/3860] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:30 2022] GET /compute/v2.1/servers/7c3a4081-92e2-4c7c-8283-faebd5302cf9 => generated 1350 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:31.114735 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8b710eb0-f311-4f63-9892-c03cb80812b4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:31.115357 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8b710eb0-f311-4f63-9892-c03cb80812b4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:31.124910 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8b710eb0-f311-4f63-9892-c03cb80812b4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:31.125369 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8b710eb0-f311-4f63-9892-c03cb80812b4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:31.132514 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8b710eb0-f311-4f63-9892-c03cb80812b4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:31.132977 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8b710eb0-f311-4f63-9892-c03cb80812b4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:31.449264 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8b710eb0-f311-4f63-9892-c03cb80812b4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:31.461357 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8b710eb0-f311-4f63-9892-c03cb80812b4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1508 microversion: 2.1 time: 0.350421 Jun 10 18:10:31.462628 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1879/3861] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:31 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1508 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:31.551439 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-402c75e0-aaef-428f-a00b-81c28eb5f1ac tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:31.552361 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-402c75e0-aaef-428f-a00b-81c28eb5f1ac tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] [instance: b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:31.559423 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-402c75e0-aaef-428f-a00b-81c28eb5f1ac tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:31.561220 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-402c75e0-aaef-428f-a00b-81c28eb5f1ac tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:31.561220 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-402c75e0-aaef-428f-a00b-81c28eb5f1ac tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:31.561664 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-402c75e0-aaef-428f-a00b-81c28eb5f1ac tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:31.699057 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-402c75e0-aaef-428f-a00b-81c28eb5f1ac tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03179d7b781041f0988b9d1e00bd0963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d33177df0b44227bfaa8be53d56d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:31.712861 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-402c75e0-aaef-428f-a00b-81c28eb5f1ac tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] 10.222.0.35 "GET /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1" status: 200 len: 1280 microversion: 2.1 time: 0.165196 Jun 10 18:10:31.722715 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1983/3862] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:31 2022] GET /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 => generated 1280 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:31.882929 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-45f52fc7-464d-482a-835e-de143bde9d71 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c00320d0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:31.963436 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-45f52fc7-464d-482a-835e-de143bde9d71 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/8a932e43-b89d-4e0e-9927-1a9b2061c2c0" status: 200 len: 1421 microversion: 2.1 time: 0.085031 Jun 10 18:10:31.964116 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1880/3863] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:10:31 2022] GET /compute/v2.1/images/8a932e43-b89d-4e0e-9927-1a9b2061c2c0 => generated 1421 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:32.008553 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-184e200d-e26f-497c-bdd3-e80aad7604f0 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:32.010766 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-184e200d-e26f-497c-bdd3-e80aad7604f0 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] [instance: 7c3a4081-92e2-4c7c-8283-faebd5302cf9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:32.024014 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-184e200d-e26f-497c-bdd3-e80aad7604f0 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:32.026824 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-184e200d-e26f-497c-bdd3-e80aad7604f0 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:32.029536 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-184e200d-e26f-497c-bdd3-e80aad7604f0 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:32.032218 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-184e200d-e26f-497c-bdd3-e80aad7604f0 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:32.221345 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-184e200d-e26f-497c-bdd3-e80aad7604f0 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c896f867509494cbce2e8f37d4cf0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e32c729a2b641f381e661905d930ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:32.230574 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-184e200d-e26f-497c-bdd3-e80aad7604f0 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] 10.222.0.35 "GET /compute/v2.1/servers/7c3a4081-92e2-4c7c-8283-faebd5302cf9" status: 200 len: 1350 microversion: 2.1 time: 0.225699 Jun 10 18:10:32.232418 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1984/3864] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:32 2022] GET /compute/v2.1/servers/7c3a4081-92e2-4c7c-8283-faebd5302cf9 => generated 1350 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:32.480669 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a5362fd0-5e83-4e41-a025-a75bfe551c05 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:32.482083 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a5362fd0-5e83-4e41-a025-a75bfe551c05 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:32.511761 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a5362fd0-5e83-4e41-a025-a75bfe551c05 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:32.514057 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a5362fd0-5e83-4e41-a025-a75bfe551c05 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:32.519385 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a5362fd0-5e83-4e41-a025-a75bfe551c05 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:32.532184 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a5362fd0-5e83-4e41-a025-a75bfe551c05 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:32.729414 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bf1f9770-8489-447d-a053-df9c1d9587b6 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:32.730471 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bf1f9770-8489-447d-a053-df9c1d9587b6 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] [instance: b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:32.734031 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:10:32.764339 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bf1f9770-8489-447d-a053-df9c1d9587b6 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:32.781025 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bf1f9770-8489-447d-a053-df9c1d9587b6 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:32.783874 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bf1f9770-8489-447d-a053-df9c1d9587b6 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:32.785166 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bf1f9770-8489-447d-a053-df9c1d9587b6 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:32.926393 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a5362fd0-5e83-4e41-a025-a75bfe551c05 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:32.935691 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a5362fd0-5e83-4e41-a025-a75bfe551c05 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1508 microversion: 2.1 time: 0.460271 Jun 10 18:10:32.941439 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1881/3865] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:32 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1508 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:32.965361 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bf1f9770-8489-447d-a053-df9c1d9587b6 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03179d7b781041f0988b9d1e00bd0963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d33177df0b44227bfaa8be53d56d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:32.977144 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bf1f9770-8489-447d-a053-df9c1d9587b6 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] 10.222.0.35 "GET /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1" status: 200 len: 1298 microversion: 2.1 time: 0.251593 Jun 10 18:10:32.983105 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1985/3866] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:32 2022] GET /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 => generated 1298 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:33.000420 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-166a133b-52fd-4db6-bc8e-e1bc599db22c tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c0927ee0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:33.087104 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-166a133b-52fd-4db6-bc8e-e1bc599db22c tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/8a932e43-b89d-4e0e-9927-1a9b2061c2c0" status: 200 len: 1421 microversion: 2.1 time: 0.102487 Jun 10 18:10:33.087922 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1986/3867] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:10:32 2022] GET /compute/v2.1/images/8a932e43-b89d-4e0e-9927-1a9b2061c2c0 => generated 1421 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:33.232082 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4f647fe9-ad2c-4ac3-9541-10fdeee14ef5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1366728224", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "ec033079-44eb-425d-beee-8bccdd30063c"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:10:33.249330 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-293f3da4-0a43-4644-84a0-19325e3f03df tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:33.250087 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-293f3da4-0a43-4644-84a0-19325e3f03df tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] [instance: 7c3a4081-92e2-4c7c-8283-faebd5302cf9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:33.262134 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-293f3da4-0a43-4644-84a0-19325e3f03df tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:33.267638 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-293f3da4-0a43-4644-84a0-19325e3f03df tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:33.270184 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-293f3da4-0a43-4644-84a0-19325e3f03df tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:33.272384 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-293f3da4-0a43-4644-84a0-19325e3f03df tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:33.358206 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-4f647fe9-ad2c-4ac3-9541-10fdeee14ef5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] validate_networks() for [('ec033079-44eb-425d-beee-8bccdd30063c', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:10:33.528060 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-293f3da4-0a43-4644-84a0-19325e3f03df tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c896f867509494cbce2e8f37d4cf0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e32c729a2b641f381e661905d930ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:33.536598 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-293f3da4-0a43-4644-84a0-19325e3f03df tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] 10.222.0.35 "GET /compute/v2.1/servers/7c3a4081-92e2-4c7c-8283-faebd5302cf9" status: 200 len: 1350 microversion: 2.1 time: 0.292619 Jun 10 18:10:33.537825 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1987/3868] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:33 2022] GET /compute/v2.1/servers/7c3a4081-92e2-4c7c-8283-faebd5302cf9 => generated 1350 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:10:33.628099 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b15df51c-a845-4b08-b6e9-a3fd6e016937 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-156969497", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "41b5e0b7-0df8-4f26-9332-ec3ec221f33b"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:10:33.756202 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-b15df51c-a845-4b08-b6e9-a3fd6e016937 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] validate_networks() for [('41b5e0b7-0df8-4f26-9332-ec3ec221f33b', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:10:34.109332 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-4f647fe9-ad2c-4ac3-9541-10fdeee14ef5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:10:34.110384 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-4f647fe9-ad2c-4ac3-9541-10fdeee14ef5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:10:34.111405 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-4f647fe9-ad2c-4ac3-9541-10fdeee14ef5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:10:34.113074 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-4f647fe9-ad2c-4ac3-9541-10fdeee14ef5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:10:34.113871 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-4f647fe9-ad2c-4ac3-9541-10fdeee14ef5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:10:34.154240 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f647fe9-ad2c-4ac3-9541-10fdeee14ef5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:34.155306 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f647fe9-ad2c-4ac3-9541-10fdeee14ef5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:34.165072 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f647fe9-ad2c-4ac3-9541-10fdeee14ef5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:34.167635 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f647fe9-ad2c-4ac3-9541-10fdeee14ef5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:34.247833 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-4f647fe9-ad2c-4ac3-9541-10fdeee14ef5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Getting quotas for project 1089f87ad8fc4f1ca82ee23dfd567b1b. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:10:34.256550 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-4f647fe9-ad2c-4ac3-9541-10fdeee14ef5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Getting quotas for user 3824b7a76a5641b7b6f338ee052f6e94 and project 1089f87ad8fc4f1ca82ee23dfd567b1b. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:10:34.274228 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4f647fe9-ad2c-4ac3-9541-10fdeee14ef5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:10:34.279065 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4f647fe9-ad2c-4ac3-9541-10fdeee14ef5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:10:34.489855 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4f647fe9-ad2c-4ac3-9541-10fdeee14ef5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.528823 Jun 10 18:10:34.501032 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1882/3869] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:10:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 10 18:10:34.514209 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-b44c2b71-ba62-4def-a416-96d237e51cd9 req-fedcc3e7-df1a-47cb-983b-68f150109691 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "911b33c1-545d-4bcb-9ca1-c42c7bda606b", "name": "network-vif-plugged", "status": "completed", "tag": "a7249e1c-d1cb-43c4-9fa6-d68705a79807"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:10:34.539436 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-b44c2b71-ba62-4def-a416-96d237e51cd9 req-fedcc3e7-df1a-47cb-983b-68f150109691 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:34.541879 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-b44c2b71-ba62-4def-a416-96d237e51cd9 req-fedcc3e7-df1a-47cb-983b-68f150109691 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:34.575414 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-b44c2b71-ba62-4def-a416-96d237e51cd9 req-fedcc3e7-df1a-47cb-983b-68f150109691 service nova] Creating event network-vif-plugged:a7249e1c-d1cb-43c4-9fa6-d68705a79807 for instance 911b33c1-545d-4bcb-9ca1-c42c7bda606b on chh2-master-2 Jun 10 18:10:34.587696 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-b44c2b71-ba62-4def-a416-96d237e51cd9 req-fedcc3e7-df1a-47cb-983b-68f150109691 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084366 Jun 10 18:10:34.591961 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1883/3870] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:10:34.604924 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dc31e571-4aac-4e50-939f-715000b730e9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:34.608467 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dc31e571-4aac-4e50-939f-715000b730e9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:34.632186 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc31e571-4aac-4e50-939f-715000b730e9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:34.633130 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc31e571-4aac-4e50-939f-715000b730e9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:34.634149 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc31e571-4aac-4e50-939f-715000b730e9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:34.634816 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc31e571-4aac-4e50-939f-715000b730e9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:34.983341 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-b15df51c-a845-4b08-b6e9-a3fd6e016937 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:10:34.990393 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-b15df51c-a845-4b08-b6e9-a3fd6e016937 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:10:34.991188 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-b15df51c-a845-4b08-b6e9-a3fd6e016937 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:10:34.991791 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-b15df51c-a845-4b08-b6e9-a3fd6e016937 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:10:34.993553 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-b15df51c-a845-4b08-b6e9-a3fd6e016937 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:10:35.012332 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b15df51c-a845-4b08-b6e9-a3fd6e016937 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:35.013216 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b15df51c-a845-4b08-b6e9-a3fd6e016937 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:35.014399 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b15df51c-a845-4b08-b6e9-a3fd6e016937 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:35.015176 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b15df51c-a845-4b08-b6e9-a3fd6e016937 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:35.038834 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-b15df51c-a845-4b08-b6e9-a3fd6e016937 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Getting quotas for project c470806ae3004e8c8c9828a8db2f3f7b. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:10:35.062761 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-b15df51c-a845-4b08-b6e9-a3fd6e016937 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Getting quotas for user 92c9e71f37154b4faaa223f2f3d3645b and project c470806ae3004e8c8c9828a8db2f3f7b. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:10:35.094317 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b15df51c-a845-4b08-b6e9-a3fd6e016937 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:10:35.097207 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b15df51c-a845-4b08-b6e9-a3fd6e016937 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] [instance: b84fd25b-3629-41a1-8de6-bd43cab180ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:10:35.199387 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-dc31e571-4aac-4e50-939f-715000b730e9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:35.217993 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dc31e571-4aac-4e50-939f-715000b730e9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1508 microversion: 2.1 time: 0.624605 Jun 10 18:10:35.220919 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1884/3871] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:34 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1508 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:35.231400 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cd39fde5-0c23-4f8d-81bb-ac4bd4cf45d5 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:35.234055 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cd39fde5-0c23-4f8d-81bb-ac4bd4cf45d5 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] [instance: b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:35.265422 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd39fde5-0c23-4f8d-81bb-ac4bd4cf45d5 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:35.269790 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd39fde5-0c23-4f8d-81bb-ac4bd4cf45d5 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:35.271700 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd39fde5-0c23-4f8d-81bb-ac4bd4cf45d5 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:35.274788 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd39fde5-0c23-4f8d-81bb-ac4bd4cf45d5 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:35.283441 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b15df51c-a845-4b08-b6e9-a3fd6e016937 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.744195 Jun 10 18:10:35.305396 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1988/3872] 10.222.0.35 () {62 vars in 1187 bytes} [Fri Jun 10 18:10:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1767 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 10 18:10:35.323116 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d8e3b7e3-77ae-45fe-9869-c8116ad4a31c tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c093d550>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:35.457767 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d8e3b7e3-77ae-45fe-9869-c8116ad4a31c tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/8a932e43-b89d-4e0e-9927-1a9b2061c2c0" status: 200 len: 1421 microversion: 2.1 time: 0.151144 Jun 10 18:10:35.460181 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1989/3873] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:10:35 2022] GET /compute/v2.1/images/8a932e43-b89d-4e0e-9927-1a9b2061c2c0 => generated 1421 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:35.476772 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0742535f-f1f1-477d-8405-b74430bdf53c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:35.478690 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0742535f-f1f1-477d-8405-b74430bdf53c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:35.675154 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0742535f-f1f1-477d-8405-b74430bdf53c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:35.687025 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0742535f-f1f1-477d-8405-b74430bdf53c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1217 microversion: 2.1 time: 0.223520 Jun 10 18:10:35.702653 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1990/3874] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:35 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1217 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:35.719781 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-27080fe6-7def-4d17-8dec-23b75bdfd093 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:35.720901 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-27080fe6-7def-4d17-8dec-23b75bdfd093 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] [instance: 7c3a4081-92e2-4c7c-8283-faebd5302cf9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:35.742756 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27080fe6-7def-4d17-8dec-23b75bdfd093 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:35.743223 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27080fe6-7def-4d17-8dec-23b75bdfd093 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:35.750960 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27080fe6-7def-4d17-8dec-23b75bdfd093 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:35.751582 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27080fe6-7def-4d17-8dec-23b75bdfd093 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:35.974400 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cd39fde5-0c23-4f8d-81bb-ac4bd4cf45d5 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03179d7b781041f0988b9d1e00bd0963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d33177df0b44227bfaa8be53d56d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:35.994528 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cd39fde5-0c23-4f8d-81bb-ac4bd4cf45d5 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] 10.222.0.35 "GET /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1" status: 200 len: 1328 microversion: 2.1 time: 0.767699 Jun 10 18:10:35.998364 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1885/3875] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:35 2022] GET /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 => generated 1328 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:36.012069 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b0eac914-a93e-484e-8ca1-cdbbe1b3740a tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:36.013290 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b0eac914-a93e-484e-8ca1-cdbbe1b3740a tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] [instance: b84fd25b-3629-41a1-8de6-bd43cab180ac] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:36.164082 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b0eac914-a93e-484e-8ca1-cdbbe1b3740a tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:36.172178 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b0eac914-a93e-484e-8ca1-cdbbe1b3740a tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:36.179132 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b0eac914-a93e-484e-8ca1-cdbbe1b3740a tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:36.180573 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b0eac914-a93e-484e-8ca1-cdbbe1b3740a tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] 10.222.0.35 "GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac" status: 200 len: 1258 microversion: 2.21 time: 0.181019 Jun 10 18:10:36.187200 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1886/3876] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:10:35 2022] GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac => generated 1258 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:10:36.236323 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-05678514-a43f-4fca-8952-e019076d3c00 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:36.237365 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-05678514-a43f-4fca-8952-e019076d3c00 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:36.244658 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05678514-a43f-4fca-8952-e019076d3c00 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:36.250185 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05678514-a43f-4fca-8952-e019076d3c00 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:36.251265 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05678514-a43f-4fca-8952-e019076d3c00 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:36.255303 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-27080fe6-7def-4d17-8dec-23b75bdfd093 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c896f867509494cbce2e8f37d4cf0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e32c729a2b641f381e661905d930ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:36.265755 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05678514-a43f-4fca-8952-e019076d3c00 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:36.267876 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-27080fe6-7def-4d17-8dec-23b75bdfd093 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] 10.222.0.35 "GET /compute/v2.1/servers/7c3a4081-92e2-4c7c-8283-faebd5302cf9" status: 200 len: 1350 microversion: 2.1 time: 0.564822 Jun 10 18:10:36.269561 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1991/3877] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:35 2022] GET /compute/v2.1/servers/7c3a4081-92e2-4c7c-8283-faebd5302cf9 => generated 1350 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:36.417907 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-c107c4c8-4959-4a2e-9a9f-33cb7861fabc req-20d2df22-328d-457d-a740-c61ee8a1d652 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1", "tag": "ce89b606-ef43-411a-b6ad-cc5361e810f9"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:10:36.427181 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-c107c4c8-4959-4a2e-9a9f-33cb7861fabc req-20d2df22-328d-457d-a740-c61ee8a1d652 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:36.430315 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-c107c4c8-4959-4a2e-9a9f-33cb7861fabc req-20d2df22-328d-457d-a740-c61ee8a1d652 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:36.458309 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-c107c4c8-4959-4a2e-9a9f-33cb7861fabc req-20d2df22-328d-457d-a740-c61ee8a1d652 service nova] Creating event network-changed:ce89b606-ef43-411a-b6ad-cc5361e810f9 for instance b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 on chh1-master-2 Jun 10 18:10:36.464170 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-c107c4c8-4959-4a2e-9a9f-33cb7861fabc req-20d2df22-328d-457d-a740-c61ee8a1d652 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054937 Jun 10 18:10:36.468052 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1992/3878] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:10:36.486951 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-84dab702-e91e-49f8-8fc6-bdf21f0a468f tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c08e8af0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:36.587261 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-84dab702-e91e-49f8-8fc6-bdf21f0a468f tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/8a932e43-b89d-4e0e-9927-1a9b2061c2c0" status: 200 len: 1421 microversion: 2.1 time: 0.116957 Jun 10 18:10:36.588131 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1993/3879] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:10:36 2022] GET /compute/v2.1/images/8a932e43-b89d-4e0e-9927-1a9b2061c2c0 => generated 1421 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:36.599546 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-05678514-a43f-4fca-8952-e019076d3c00 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:36.602972 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-70dc21df-6b47-4bfd-99c1-117d98bd5870 req-e736f561-5c32-4da8-9a8c-edbed9fbd95b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c3a4081-92e2-4c7c-8283-faebd5302cf9", "name": "network-vif-plugged", "status": "completed", "tag": "8ab067d1-1b0e-4361-8885-c16e28f66095"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:10:36.610614 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-05678514-a43f-4fca-8952-e019076d3c00 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1508 microversion: 2.1 time: 0.378156 Jun 10 18:10:36.613655 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1887/3880] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:36 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1508 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:10:36.634771 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-70dc21df-6b47-4bfd-99c1-117d98bd5870 req-e736f561-5c32-4da8-9a8c-edbed9fbd95b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:36.637428 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-70dc21df-6b47-4bfd-99c1-117d98bd5870 req-e736f561-5c32-4da8-9a8c-edbed9fbd95b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:36.674278 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-70dc21df-6b47-4bfd-99c1-117d98bd5870 req-e736f561-5c32-4da8-9a8c-edbed9fbd95b service nova] Creating event network-vif-plugged:8ab067d1-1b0e-4361-8885-c16e28f66095 for instance 7c3a4081-92e2-4c7c-8283-faebd5302cf9 on chh1-master-2 Jun 10 18:10:36.685094 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-70dc21df-6b47-4bfd-99c1-117d98bd5870 req-e736f561-5c32-4da8-9a8c-edbed9fbd95b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085668 Jun 10 18:10:36.688216 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1994/3881] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:10:36.706006 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6763ae75-5459-4166-b4f8-be227137df37 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:36.706993 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6763ae75-5459-4166-b4f8-be227137df37 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:36.748391 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6763ae75-5459-4166-b4f8-be227137df37 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:36.752504 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6763ae75-5459-4166-b4f8-be227137df37 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:36.760401 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6763ae75-5459-4166-b4f8-be227137df37 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:36.764590 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6763ae75-5459-4166-b4f8-be227137df37 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:36.896264 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6763ae75-5459-4166-b4f8-be227137df37 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:36.924374 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6763ae75-5459-4166-b4f8-be227137df37 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1213 microversion: 2.1 time: 0.223138 Jun 10 18:10:36.945538 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1888/3882] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:36 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1213 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:37.016339 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ae0737c9-1bff-47af-81eb-d81ce88a5b7b tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:37.017657 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ae0737c9-1bff-47af-81eb-d81ce88a5b7b tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] [instance: b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:37.043093 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ae0737c9-1bff-47af-81eb-d81ce88a5b7b tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:37.044224 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ae0737c9-1bff-47af-81eb-d81ce88a5b7b tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:37.045085 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ae0737c9-1bff-47af-81eb-d81ce88a5b7b tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:37.047782 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ae0737c9-1bff-47af-81eb-d81ce88a5b7b tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:37.199429 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9cc45720-76e4-439b-9326-65da72474765 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:37.200329 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9cc45720-76e4-439b-9326-65da72474765 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] [instance: b84fd25b-3629-41a1-8de6-bd43cab180ac] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:37.222670 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9cc45720-76e4-439b-9326-65da72474765 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:37.223322 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9cc45720-76e4-439b-9326-65da72474765 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:37.225788 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9cc45720-76e4-439b-9326-65da72474765 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:37.226488 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9cc45720-76e4-439b-9326-65da72474765 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:37.307119 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ae0737c9-1bff-47af-81eb-d81ce88a5b7b tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03179d7b781041f0988b9d1e00bd0963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d33177df0b44227bfaa8be53d56d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:37.317939 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ae0737c9-1bff-47af-81eb-d81ce88a5b7b tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] 10.222.0.35 "GET /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1" status: 200 len: 1328 microversion: 2.1 time: 0.306951 Jun 10 18:10:37.319473 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1995/3883] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:37 2022] GET /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 => generated 1328 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:37.325701 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1683a361-cc64-49e6-bcc6-0c729218f643 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:37.326545 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1683a361-cc64-49e6-bcc6-0c729218f643 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] [instance: 7c3a4081-92e2-4c7c-8283-faebd5302cf9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:37.344426 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1683a361-cc64-49e6-bcc6-0c729218f643 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:37.347437 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1683a361-cc64-49e6-bcc6-0c729218f643 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:37.350845 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1683a361-cc64-49e6-bcc6-0c729218f643 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:37.355867 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1683a361-cc64-49e6-bcc6-0c729218f643 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:37.430262 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9cc45720-76e4-439b-9326-65da72474765 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:37.447505 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9cc45720-76e4-439b-9326-65da72474765 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:37.450058 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9cc45720-76e4-439b-9326-65da72474765 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:37.451388 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9cc45720-76e4-439b-9326-65da72474765 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] 10.222.0.35 "GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac" status: 200 len: 1262 microversion: 2.21 time: 0.256395 Jun 10 18:10:37.452912 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1889/3884] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:10:37 2022] GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac => generated 1262 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:10:37.600957 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-179eaa4c-32b7-4bb4-9171-f432cbffe193 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c003e790>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:37.614202 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1683a361-cc64-49e6-bcc6-0c729218f643 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c896f867509494cbce2e8f37d4cf0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e32c729a2b641f381e661905d930ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:37.623955 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1683a361-cc64-49e6-bcc6-0c729218f643 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] 10.222.0.35 "GET /compute/v2.1/servers/7c3a4081-92e2-4c7c-8283-faebd5302cf9" status: 200 len: 1350 microversion: 2.1 time: 0.303169 Jun 10 18:10:37.624829 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1996/3885] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:37 2022] GET /compute/v2.1/servers/7c3a4081-92e2-4c7c-8283-faebd5302cf9 => generated 1350 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:37.643674 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8bd14e24-9cd1-463d-8538-7d0fe52eb9ac tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:37.646098 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8bd14e24-9cd1-463d-8538-7d0fe52eb9ac tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:37.657515 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8bd14e24-9cd1-463d-8538-7d0fe52eb9ac tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:37.658053 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8bd14e24-9cd1-463d-8538-7d0fe52eb9ac tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:37.659477 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8bd14e24-9cd1-463d-8538-7d0fe52eb9ac tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:37.660533 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8bd14e24-9cd1-463d-8538-7d0fe52eb9ac tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:37.670202 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-179eaa4c-32b7-4bb4-9171-f432cbffe193 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/8a932e43-b89d-4e0e-9927-1a9b2061c2c0" status: 200 len: 1421 microversion: 2.1 time: 0.073037 Jun 10 18:10:37.676966 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1890/3886] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:10:37 2022] GET /compute/v2.1/images/8a932e43-b89d-4e0e-9927-1a9b2061c2c0 => generated 1421 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:10:37.833618 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8bd14e24-9cd1-463d-8538-7d0fe52eb9ac tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:37.871531 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8bd14e24-9cd1-463d-8538-7d0fe52eb9ac tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1508 microversion: 2.1 time: 0.232516 Jun 10 18:10:37.875082 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1997/3887] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:37 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1508 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:37.965061 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e3a7b96e-e80c-496d-b009-6297d3ccda5f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:37.965711 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e3a7b96e-e80c-496d-b009-6297d3ccda5f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:37.988887 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e3a7b96e-e80c-496d-b009-6297d3ccda5f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:37.989362 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e3a7b96e-e80c-496d-b009-6297d3ccda5f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:37.990176 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e3a7b96e-e80c-496d-b009-6297d3ccda5f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:37.990626 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e3a7b96e-e80c-496d-b009-6297d3ccda5f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:38.163720 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e3a7b96e-e80c-496d-b009-6297d3ccda5f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:38.175440 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e3a7b96e-e80c-496d-b009-6297d3ccda5f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1269 microversion: 2.1 time: 0.228118 Jun 10 18:10:38.186574 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1891/3888] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:37 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1269 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:38.313990 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-11ea7908-b912-4df0-8d33-3a317059b87f tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:38.315925 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-11ea7908-b912-4df0-8d33-3a317059b87f tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:38.334414 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-11ea7908-b912-4df0-8d33-3a317059b87f tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:38.337595 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e3452f5f-4d59-4f14-926b-7a199ea44c9c tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:38.337933 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-11ea7908-b912-4df0-8d33-3a317059b87f tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:38.338371 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e3452f5f-4d59-4f14-926b-7a199ea44c9c tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] [instance: b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:38.340171 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-11ea7908-b912-4df0-8d33-3a317059b87f tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:38.340665 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-11ea7908-b912-4df0-8d33-3a317059b87f tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:38.352271 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:10:38.364737 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e3452f5f-4d59-4f14-926b-7a199ea44c9c tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:38.367701 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e3452f5f-4d59-4f14-926b-7a199ea44c9c tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:38.371509 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e3452f5f-4d59-4f14-926b-7a199ea44c9c tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:38.372851 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e3452f5f-4d59-4f14-926b-7a199ea44c9c tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:38.408768 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-11ea7908-b912-4df0-8d33-3a317059b87f tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100440 Jun 10 18:10:38.412809 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1998/3889] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:10:38 2022] GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:10:38.471682 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-96938e0a-1fa4-4c5a-b1bc-a629472eee04 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:38.472495 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-96938e0a-1fa4-4c5a-b1bc-a629472eee04 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] [instance: b84fd25b-3629-41a1-8de6-bd43cab180ac] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:38.488084 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-96938e0a-1fa4-4c5a-b1bc-a629472eee04 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:38.501202 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-96938e0a-1fa4-4c5a-b1bc-a629472eee04 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:38.502517 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-96938e0a-1fa4-4c5a-b1bc-a629472eee04 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:38.504058 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-96938e0a-1fa4-4c5a-b1bc-a629472eee04 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:38.677371 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-96938e0a-1fa4-4c5a-b1bc-a629472eee04 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:38.695342 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-96938e0a-1fa4-4c5a-b1bc-a629472eee04 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:38.697478 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-96938e0a-1fa4-4c5a-b1bc-a629472eee04 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:38.699738 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-96938e0a-1fa4-4c5a-b1bc-a629472eee04 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] 10.222.0.35 "GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac" status: 200 len: 1310 microversion: 2.21 time: 0.232511 Jun 10 18:10:38.712649 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 1999/3890] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:10:38 2022] GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac => generated 1310 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:10:38.719161 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-884c74d9-e91c-4c0c-83c9-08c661e402b4 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:38.720081 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-884c74d9-e91c-4c0c-83c9-08c661e402b4 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] [instance: 7c3a4081-92e2-4c7c-8283-faebd5302cf9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:38.752591 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-884c74d9-e91c-4c0c-83c9-08c661e402b4 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:38.755805 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-884c74d9-e91c-4c0c-83c9-08c661e402b4 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:38.757027 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-884c74d9-e91c-4c0c-83c9-08c661e402b4 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:38.757648 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-884c74d9-e91c-4c0c-83c9-08c661e402b4 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:38.786912 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e3452f5f-4d59-4f14-926b-7a199ea44c9c tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03179d7b781041f0988b9d1e00bd0963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d33177df0b44227bfaa8be53d56d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:38.814285 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e3452f5f-4d59-4f14-926b-7a199ea44c9c tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] 10.222.0.35 "GET /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1" status: 200 len: 1328 microversion: 2.1 time: 0.478832 Jun 10 18:10:38.817774 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1892/3891] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:38 2022] GET /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 => generated 1328 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:10:38.828585 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-41a37eba-0a3b-4d8b-87b7-3373eb5cfbfb tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c0040040>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:38.907535 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-41a37eba-0a3b-4d8b-87b7-3373eb5cfbfb tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/8a932e43-b89d-4e0e-9927-1a9b2061c2c0" status: 200 len: 1421 microversion: 2.1 time: 0.088104 Jun 10 18:10:38.908492 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1893/3892] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:10:38 2022] GET /compute/v2.1/images/8a932e43-b89d-4e0e-9927-1a9b2061c2c0 => generated 1421 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:38.914400 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-46a8502f-4bf3-48bc-9ca5-0e618c04fb7e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:38.915273 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-46a8502f-4bf3-48bc-9ca5-0e618c04fb7e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:38.922557 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-46a8502f-4bf3-48bc-9ca5-0e618c04fb7e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:38.923241 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-46a8502f-4bf3-48bc-9ca5-0e618c04fb7e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:38.924195 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-46a8502f-4bf3-48bc-9ca5-0e618c04fb7e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:38.924842 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-46a8502f-4bf3-48bc-9ca5-0e618c04fb7e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:38.952783 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-884c74d9-e91c-4c0c-83c9-08c661e402b4 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c896f867509494cbce2e8f37d4cf0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e32c729a2b641f381e661905d930ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:38.977077 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-884c74d9-e91c-4c0c-83c9-08c661e402b4 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] 10.222.0.35 "GET /compute/v2.1/servers/7c3a4081-92e2-4c7c-8283-faebd5302cf9" status: 200 len: 1541 microversion: 2.1 time: 0.257724 Jun 10 18:10:39.013084 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2000/3893] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:38 2022] GET /compute/v2.1/servers/7c3a4081-92e2-4c7c-8283-faebd5302cf9 => generated 1541 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:39.035178 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-14dd5dbf-914f-45fd-8924-dc88cf09d5a0 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:39.036537 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-14dd5dbf-914f-45fd-8924-dc88cf09d5a0 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] [instance: 7c3a4081-92e2-4c7c-8283-faebd5302cf9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:39.049996 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-14dd5dbf-914f-45fd-8924-dc88cf09d5a0 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:39.050844 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-14dd5dbf-914f-45fd-8924-dc88cf09d5a0 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:39.053801 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-14dd5dbf-914f-45fd-8924-dc88cf09d5a0 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:39.055179 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-14dd5dbf-914f-45fd-8924-dc88cf09d5a0 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:39.101883 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-46a8502f-4bf3-48bc-9ca5-0e618c04fb7e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:39.115113 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-46a8502f-4bf3-48bc-9ca5-0e618c04fb7e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1529 microversion: 2.1 time: 0.205118 Jun 10 18:10:39.125512 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1894/3894] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:38 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1529 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:39.172257 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-14dd5dbf-914f-45fd-8924-dc88cf09d5a0 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] 10.222.0.35 "GET /compute/v2.1/servers/7c3a4081-92e2-4c7c-8283-faebd5302cf9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.141638 Jun 10 18:10:39.175822 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2001/3895] 10.222.0.35 () {58 vars in 1274 bytes} [Fri Jun 10 18:10:39 2022] GET /compute/v2.1/servers/7c3a4081-92e2-4c7c-8283-faebd5302cf9/os-interface => generated 285 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:10:39.197107 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1b88ec6a-7ce6-4327-b639-ccc62d278a72 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:39.197839 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1b88ec6a-7ce6-4327-b639-ccc62d278a72 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:39.204617 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1b88ec6a-7ce6-4327-b639-ccc62d278a72 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:39.205073 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1b88ec6a-7ce6-4327-b639-ccc62d278a72 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:39.205863 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1b88ec6a-7ce6-4327-b639-ccc62d278a72 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:39.206301 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1b88ec6a-7ce6-4327-b639-ccc62d278a72 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:39.370580 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1b88ec6a-7ce6-4327-b639-ccc62d278a72 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:39.388425 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1b88ec6a-7ce6-4327-b639-ccc62d278a72 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1287 microversion: 2.1 time: 0.194429 Jun 10 18:10:39.390136 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1895/3896] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:39 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1287 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:39.433511 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f4d3b40d-e465-411e-82d0-58172eada6bc tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:39.435715 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f4d3b40d-e465-411e-82d0-58172eada6bc tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:39.466958 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4d3b40d-e465-411e-82d0-58172eada6bc tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:39.467428 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4d3b40d-e465-411e-82d0-58172eada6bc tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:39.474610 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4d3b40d-e465-411e-82d0-58172eada6bc tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:39.476372 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4d3b40d-e465-411e-82d0-58172eada6bc tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:39.562632 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f4d3b40d-e465-411e-82d0-58172eada6bc tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.137083 Jun 10 18:10:39.564730 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2002/3897] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:10:39 2022] GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1/os-volume_attachments => generated 25 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:10:39.644496 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-16b74a03-8dc2-4403-80d3-0f59567c8c68 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:39.646361 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-16b74a03-8dc2-4403-80d3-0f59567c8c68 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:39.655044 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-16b74a03-8dc2-4403-80d3-0f59567c8c68 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:39.655944 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-16b74a03-8dc2-4403-80d3-0f59567c8c68 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:39.656966 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-16b74a03-8dc2-4403-80d3-0f59567c8c68 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:39.657565 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-16b74a03-8dc2-4403-80d3-0f59567c8c68 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:39.707460 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-16b74a03-8dc2-4403-80d3-0f59567c8c68 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068331 Jun 10 18:10:39.713359 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1896/3898] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:10:39 2022] GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:10:39.730250 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f0622b9d-1939-4e0f-bc04-d07333008061 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:39.731372 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f0622b9d-1939-4e0f-bc04-d07333008061 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] [instance: b84fd25b-3629-41a1-8de6-bd43cab180ac] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:39.740030 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f0622b9d-1939-4e0f-bc04-d07333008061 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:39.740666 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f0622b9d-1939-4e0f-bc04-d07333008061 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:39.741606 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f0622b9d-1939-4e0f-bc04-d07333008061 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:39.742159 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f0622b9d-1939-4e0f-bc04-d07333008061 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:39.839323 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b059a649-7654-41bd-8f86-06f30c0d5637 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:39.840614 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b059a649-7654-41bd-8f86-06f30c0d5637 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] [instance: b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:39.858112 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b059a649-7654-41bd-8f86-06f30c0d5637 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:39.858501 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b059a649-7654-41bd-8f86-06f30c0d5637 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:39.859305 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b059a649-7654-41bd-8f86-06f30c0d5637 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:39.859798 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b059a649-7654-41bd-8f86-06f30c0d5637 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:39.906164 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f0622b9d-1939-4e0f-bc04-d07333008061 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:39.924430 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f0622b9d-1939-4e0f-bc04-d07333008061 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:39.928734 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f0622b9d-1939-4e0f-bc04-d07333008061 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:39.931024 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f0622b9d-1939-4e0f-bc04-d07333008061 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] 10.222.0.35 "GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac" status: 200 len: 1318 microversion: 2.21 time: 0.215738 Jun 10 18:10:39.934041 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2003/3899] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:10:39 2022] GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:10:39.941200 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e5461541-06cc-426b-baf3-dc8bea98bb39 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:39.943143 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e5461541-06cc-426b-baf3-dc8bea98bb39 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:39.960832 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e5461541-06cc-426b-baf3-dc8bea98bb39 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:39.962154 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e5461541-06cc-426b-baf3-dc8bea98bb39 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:39.962949 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e5461541-06cc-426b-baf3-dc8bea98bb39 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:39.963564 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e5461541-06cc-426b-baf3-dc8bea98bb39 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:40.009764 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e5461541-06cc-426b-baf3-dc8bea98bb39 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:10:40.123833 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b059a649-7654-41bd-8f86-06f30c0d5637 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03179d7b781041f0988b9d1e00bd0963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d33177df0b44227bfaa8be53d56d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:40.139418 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b059a649-7654-41bd-8f86-06f30c0d5637 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] 10.222.0.35 "GET /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1" status: 200 len: 1328 microversion: 2.1 time: 0.302610 Jun 10 18:10:40.140270 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1897/3900] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:39 2022] GET /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 => generated 1328 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:40.145630 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bbd79078-6c0a-4dc8-a87b-472911c527bf tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c0225820>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:40.199148 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bbd79078-6c0a-4dc8-a87b-472911c527bf tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/8a932e43-b89d-4e0e-9927-1a9b2061c2c0" status: 200 len: 1421 microversion: 2.1 time: 0.057481 Jun 10 18:10:40.199909 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1898/3901] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:10:40 2022] GET /compute/v2.1/images/8a932e43-b89d-4e0e-9927-1a9b2061c2c0 => generated 1421 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:40.206411 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-04a77de2-c817-4283-8301-c003e90d131c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:40.207385 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-04a77de2-c817-4283-8301-c003e90d131c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:40.230827 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-04a77de2-c817-4283-8301-c003e90d131c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:40.231494 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-04a77de2-c817-4283-8301-c003e90d131c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:40.232287 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-04a77de2-c817-4283-8301-c003e90d131c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:40.232749 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-04a77de2-c817-4283-8301-c003e90d131c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:40.239333 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:10:40.471066 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e5461541-06cc-426b-baf3-dc8bea98bb39 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "DELETE /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1" status: 204 len: 0 microversion: 2.1 time: 0.534735 Jun 10 18:10:40.471972 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2004/3902] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:10:39 2022] DELETE /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:10:40.477838 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1118b224-6ce9-4951-bd34-2bb6f066e0f7 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:40.479935 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1118b224-6ce9-4951-bd34-2bb6f066e0f7 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:40.496050 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1118b224-6ce9-4951-bd34-2bb6f066e0f7 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:40.496564 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1118b224-6ce9-4951-bd34-2bb6f066e0f7 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:40.499549 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1118b224-6ce9-4951-bd34-2bb6f066e0f7 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:40.500103 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1118b224-6ce9-4951-bd34-2bb6f066e0f7 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:41.132474 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-04a77de2-c817-4283-8301-c003e90d131c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:41.145511 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-04a77de2-c817-4283-8301-c003e90d131c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1529 microversion: 2.1 time: 0.942426 Jun 10 18:10:41.145511 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1899/3903] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:40 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1529 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:41.153388 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c710020e-8346-45a1-a96a-3489c10f4880 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:41.154219 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c710020e-8346-45a1-a96a-3489c10f4880 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:41.175979 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1118b224-6ce9-4951-bd34-2bb6f066e0f7 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:41.185172 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c710020e-8346-45a1-a96a-3489c10f4880 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:41.186669 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c710020e-8346-45a1-a96a-3489c10f4880 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:41.193040 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1118b224-6ce9-4951-bd34-2bb6f066e0f7 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1317 microversion: 2.1 time: 0.717026 Jun 10 18:10:41.193565 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c710020e-8346-45a1-a96a-3489c10f4880 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:41.194536 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c710020e-8346-45a1-a96a-3489c10f4880 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:41.205659 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2005/3904] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:40 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1317 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:41.219988 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-15b7f40b-12f3-4601-a3da-86fab43929ad tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:41.220840 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-15b7f40b-12f3-4601-a3da-86fab43929ad tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] [instance: b84fd25b-3629-41a1-8de6-bd43cab180ac] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:41.236515 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-15b7f40b-12f3-4601-a3da-86fab43929ad tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:41.239616 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-15b7f40b-12f3-4601-a3da-86fab43929ad tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:41.243238 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-15b7f40b-12f3-4601-a3da-86fab43929ad tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:41.243238 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-15b7f40b-12f3-4601-a3da-86fab43929ad tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:41.384354 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-15b7f40b-12f3-4601-a3da-86fab43929ad tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:41.417309 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-15b7f40b-12f3-4601-a3da-86fab43929ad tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:41.417309 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-15b7f40b-12f3-4601-a3da-86fab43929ad tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:41.417309 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-15b7f40b-12f3-4601-a3da-86fab43929ad tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] 10.222.0.35 "GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac" status: 200 len: 1316 microversion: 2.21 time: 0.199054 Jun 10 18:10:41.417309 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2006/3905] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:10:41 2022] GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac => generated 1316 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:10:41.418882 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-ed339f4c-757d-4a37-b7cf-384f0806e6b5 req-e50114d6-ad57-4ab3-a6af-bdb9af764542 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c3a4081-92e2-4c7c-8283-faebd5302cf9", "tag": "8ab067d1-1b0e-4361-8885-c16e28f66095"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:10:41.438399 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-ed339f4c-757d-4a37-b7cf-384f0806e6b5 req-e50114d6-ad57-4ab3-a6af-bdb9af764542 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:41.438880 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-ed339f4c-757d-4a37-b7cf-384f0806e6b5 req-e50114d6-ad57-4ab3-a6af-bdb9af764542 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:41.470724 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-ed339f4c-757d-4a37-b7cf-384f0806e6b5 req-e50114d6-ad57-4ab3-a6af-bdb9af764542 service nova] Creating event network-changed:8ab067d1-1b0e-4361-8885-c16e28f66095 for instance 7c3a4081-92e2-4c7c-8283-faebd5302cf9 on chh1-master-2 Jun 10 18:10:41.482559 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-ed339f4c-757d-4a37-b7cf-384f0806e6b5 req-e50114d6-ad57-4ab3-a6af-bdb9af764542 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071805 Jun 10 18:10:41.483196 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2007/3906] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:10:41.500335 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e8ca1dbf-e723-49c4-9285-38d745e4ab7f tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:41.508243 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e8ca1dbf-e723-49c4-9285-38d745e4ab7f tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] [instance: b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:41.534951 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e8ca1dbf-e723-49c4-9285-38d745e4ab7f tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:41.535490 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e8ca1dbf-e723-49c4-9285-38d745e4ab7f tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:41.536366 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e8ca1dbf-e723-49c4-9285-38d745e4ab7f tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:41.536958 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e8ca1dbf-e723-49c4-9285-38d745e4ab7f tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:41.939055 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c710020e-8346-45a1-a96a-3489c10f4880 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4caa591fe84879a787d0601f2d8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53380f847a949a0b61c83fc5661d236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:41.951003 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c710020e-8346-45a1-a96a-3489c10f4880 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1" status: 200 len: 1681 microversion: 2.1 time: 0.803609 Jun 10 18:10:41.969982 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1900/3907] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:41 2022] GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1 => generated 1681 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:41.972228 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e8ca1dbf-e723-49c4-9285-38d745e4ab7f tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03179d7b781041f0988b9d1e00bd0963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d33177df0b44227bfaa8be53d56d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:41.975175 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-adc1b122-f763-4431-b138-a9d8343b5e65 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c015dee0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:41.989350 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e8ca1dbf-e723-49c4-9285-38d745e4ab7f tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] 10.222.0.35 "GET /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1" status: 200 len: 1328 microversion: 2.1 time: 0.497728 Jun 10 18:10:41.989974 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2008/3908] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:41 2022] GET /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 => generated 1328 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:42.057823 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-adc1b122-f763-4431-b138-a9d8343b5e65 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/8a932e43-b89d-4e0e-9927-1a9b2061c2c0" status: 200 len: 1421 microversion: 2.1 time: 0.086581 Jun 10 18:10:42.061272 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1901/3909] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:10:41 2022] GET /compute/v2.1/images/8a932e43-b89d-4e0e-9927-1a9b2061c2c0 => generated 1421 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:42.162330 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-78c4cdfc-6775-42f7-a55f-06011f4363d2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:42.163333 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-78c4cdfc-6775-42f7-a55f-06011f4363d2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:42.175014 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-78c4cdfc-6775-42f7-a55f-06011f4363d2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:42.175809 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-78c4cdfc-6775-42f7-a55f-06011f4363d2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:42.179370 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-78c4cdfc-6775-42f7-a55f-06011f4363d2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:42.180721 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-78c4cdfc-6775-42f7-a55f-06011f4363d2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:42.210884 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3874fd22-2148-48fb-a49c-5499a3013ac1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:42.211495 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3874fd22-2148-48fb-a49c-5499a3013ac1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:42.222202 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3874fd22-2148-48fb-a49c-5499a3013ac1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:42.225855 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3874fd22-2148-48fb-a49c-5499a3013ac1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:42.231246 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3874fd22-2148-48fb-a49c-5499a3013ac1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:42.231931 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3874fd22-2148-48fb-a49c-5499a3013ac1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:42.506707 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-78c4cdfc-6775-42f7-a55f-06011f4363d2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:42.519758 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-78c4cdfc-6775-42f7-a55f-06011f4363d2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1529 microversion: 2.1 time: 0.362234 Jun 10 18:10:42.524324 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2009/3910] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:42 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1529 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:42.538509 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-77750c3a-35c4-4cc1-81e8-76010b78b2da tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:42.539444 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-77750c3a-35c4-4cc1-81e8-76010b78b2da tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] [instance: b84fd25b-3629-41a1-8de6-bd43cab180ac] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:42.554508 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-77750c3a-35c4-4cc1-81e8-76010b78b2da tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:42.557796 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-77750c3a-35c4-4cc1-81e8-76010b78b2da tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:42.560077 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-77750c3a-35c4-4cc1-81e8-76010b78b2da tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:42.562690 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-77750c3a-35c4-4cc1-81e8-76010b78b2da tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:42.830690 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-77750c3a-35c4-4cc1-81e8-76010b78b2da tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:42.848892 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-77750c3a-35c4-4cc1-81e8-76010b78b2da tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:42.853965 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-77750c3a-35c4-4cc1-81e8-76010b78b2da tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:42.857718 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-77750c3a-35c4-4cc1-81e8-76010b78b2da tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] 10.222.0.35 "GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac" status: 200 len: 1316 microversion: 2.21 time: 0.330903 Jun 10 18:10:42.873724 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2010/3911] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:10:42 2022] GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac => generated 1316 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:10:42.948044 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3874fd22-2148-48fb-a49c-5499a3013ac1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:42.965743 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3874fd22-2148-48fb-a49c-5499a3013ac1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1317 microversion: 2.1 time: 0.758500 Jun 10 18:10:42.969837 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d32956f7-1d4b-400a-b5b1-42fe57612787 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:42.970637 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d32956f7-1d4b-400a-b5b1-42fe57612787 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:42.971255 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1902/3912] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:42 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1317 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:42.982779 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d32956f7-1d4b-400a-b5b1-42fe57612787 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:42.985124 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d32956f7-1d4b-400a-b5b1-42fe57612787 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:42.986990 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d32956f7-1d4b-400a-b5b1-42fe57612787 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:42.989113 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d32956f7-1d4b-400a-b5b1-42fe57612787 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:43.009028 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-17a8c115-dddb-44d6-8f6a-305fe145d5f3 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:43.010066 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-17a8c115-dddb-44d6-8f6a-305fe145d5f3 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] [instance: b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:43.022195 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-17a8c115-dddb-44d6-8f6a-305fe145d5f3 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:43.028602 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-17a8c115-dddb-44d6-8f6a-305fe145d5f3 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:43.029617 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-17a8c115-dddb-44d6-8f6a-305fe145d5f3 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:43.030411 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-17a8c115-dddb-44d6-8f6a-305fe145d5f3 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:43.493560 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d32956f7-1d4b-400a-b5b1-42fe57612787 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4caa591fe84879a787d0601f2d8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53380f847a949a0b61c83fc5661d236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:43.508360 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d32956f7-1d4b-400a-b5b1-42fe57612787 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1" status: 200 len: 1681 microversion: 2.1 time: 0.541469 Jun 10 18:10:43.511772 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2011/3913] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:42 2022] GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1 => generated 1681 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:10:43.532537 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fb95623a-5550-4d56-988e-ce4424c5bf7c tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c09c34c0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:43.646151 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-17a8c115-dddb-44d6-8f6a-305fe145d5f3 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03179d7b781041f0988b9d1e00bd0963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d33177df0b44227bfaa8be53d56d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:43.659066 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-17a8c115-dddb-44d6-8f6a-305fe145d5f3 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] 10.222.0.35 "GET /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1" status: 200 len: 1328 microversion: 2.1 time: 0.656215 Jun 10 18:10:43.671696 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1903/3914] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:43 2022] GET /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 => generated 1328 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:43.671696 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1649e68d-ffad-487f-90f1-1f9d254d5bf8 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:43.675533 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1649e68d-ffad-487f-90f1-1f9d254d5bf8 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:43.690365 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1649e68d-ffad-487f-90f1-1f9d254d5bf8 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:43.690957 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1649e68d-ffad-487f-90f1-1f9d254d5bf8 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:43.691839 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1649e68d-ffad-487f-90f1-1f9d254d5bf8 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:43.694976 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1649e68d-ffad-487f-90f1-1f9d254d5bf8 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:43.830621 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fb95623a-5550-4d56-988e-ce4424c5bf7c tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/8a932e43-b89d-4e0e-9927-1a9b2061c2c0" status: 200 len: 1421 microversion: 2.1 time: 0.311721 Jun 10 18:10:43.831995 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2012/3915] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:10:43 2022] GET /compute/v2.1/images/8a932e43-b89d-4e0e-9927-1a9b2061c2c0 => generated 1421 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:43.866612 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-095f3390-c404-4cca-8219-3c52994c0e4b req-2a1d112e-e8a7-43c3-9483-b372ae46d0c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d514aab-bc5c-462a-a759-6182effadcbe", "name": "network-vif-plugged", "status": "completed", "tag": "c91bc6bc-9338-4e16-af93-6a63229f16dd"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:10:43.898290 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-095f3390-c404-4cca-8219-3c52994c0e4b req-2a1d112e-e8a7-43c3-9483-b372ae46d0c3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:43.899089 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-095f3390-c404-4cca-8219-3c52994c0e4b req-2a1d112e-e8a7-43c3-9483-b372ae46d0c3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:43.926237 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-095f3390-c404-4cca-8219-3c52994c0e4b req-2a1d112e-e8a7-43c3-9483-b372ae46d0c3 service nova] Creating event network-vif-plugged:c91bc6bc-9338-4e16-af93-6a63229f16dd for instance 7d514aab-bc5c-462a-a759-6182effadcbe on chh2-master-2 Jun 10 18:10:43.942854 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-095f3390-c404-4cca-8219-3c52994c0e4b req-2a1d112e-e8a7-43c3-9483-b372ae46d0c3 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097934 Jun 10 18:10:43.945252 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2013/3916] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:10:43.961447 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-4395911b-1efe-448d-8dbb-5c9365cf13a1 req-8eff7a36-6741-4001-8a11-7109e38b18a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57a377b2-f75e-4a0c-8401-090db42db644", "tag": "ea23750f-0e21-482f-b68f-6361eeb3c636"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:10:43.994582 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-4395911b-1efe-448d-8dbb-5c9365cf13a1 req-8eff7a36-6741-4001-8a11-7109e38b18a6 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:43.995385 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-4395911b-1efe-448d-8dbb-5c9365cf13a1 req-8eff7a36-6741-4001-8a11-7109e38b18a6 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:44.007771 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-4395911b-1efe-448d-8dbb-5c9365cf13a1 req-8eff7a36-6741-4001-8a11-7109e38b18a6 service nova] Creating event network-changed:ea23750f-0e21-482f-b68f-6361eeb3c636 for instance 57a377b2-f75e-4a0c-8401-090db42db644 on chh1-master-2 Jun 10 18:10:44.013444 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-4395911b-1efe-448d-8dbb-5c9365cf13a1 req-8eff7a36-6741-4001-8a11-7109e38b18a6 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064887 Jun 10 18:10:44.014759 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2014/3917] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:10:44.022676 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6ad004f4-89af-4b4b-8862-859e4d2a0ee6 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:44.023476 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6ad004f4-89af-4b4b-8862-859e4d2a0ee6 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] [instance: b84fd25b-3629-41a1-8de6-bd43cab180ac] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:44.032199 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6ad004f4-89af-4b4b-8862-859e4d2a0ee6 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:44.032199 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6ad004f4-89af-4b4b-8862-859e4d2a0ee6 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:44.033164 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6ad004f4-89af-4b4b-8862-859e4d2a0ee6 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:44.033659 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6ad004f4-89af-4b4b-8862-859e4d2a0ee6 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:44.186115 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:10:44.254906 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1649e68d-ffad-487f-90f1-1f9d254d5bf8 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:44.268205 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1649e68d-ffad-487f-90f1-1f9d254d5bf8 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1524 microversion: 2.1 time: 0.603794 Jun 10 18:10:44.270381 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1904/3918] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:43 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1524 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:44.282017 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cd840e48-c714-4db7-b2a5-0af30b9c9ba8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:44.283094 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cd840e48-c714-4db7-b2a5-0af30b9c9ba8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:44.310632 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd840e48-c714-4db7-b2a5-0af30b9c9ba8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:44.312903 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd840e48-c714-4db7-b2a5-0af30b9c9ba8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:44.314163 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd840e48-c714-4db7-b2a5-0af30b9c9ba8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:44.315842 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd840e48-c714-4db7-b2a5-0af30b9c9ba8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:44.560511 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6ad004f4-89af-4b4b-8862-859e4d2a0ee6 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:44.582290 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6ad004f4-89af-4b4b-8862-859e4d2a0ee6 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:44.585667 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6ad004f4-89af-4b4b-8862-859e4d2a0ee6 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:44.586865 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6ad004f4-89af-4b4b-8862-859e4d2a0ee6 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] 10.222.0.35 "GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac" status: 200 len: 1358 microversion: 2.21 time: 0.569721 Jun 10 18:10:44.587443 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2015/3919] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:10:44 2022] GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac => generated 1358 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:10:44.602157 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-81a2a6d2-337f-4a87-a619-086a58c979e8 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:44.603616 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-81a2a6d2-337f-4a87-a619-086a58c979e8 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:44.623138 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-81a2a6d2-337f-4a87-a619-086a58c979e8 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:44.623699 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-81a2a6d2-337f-4a87-a619-086a58c979e8 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:44.625213 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-81a2a6d2-337f-4a87-a619-086a58c979e8 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:44.626376 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-81a2a6d2-337f-4a87-a619-086a58c979e8 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:44.677010 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:10:45.027134 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:10:45.122718 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cd840e48-c714-4db7-b2a5-0af30b9c9ba8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:45.139259 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cd840e48-c714-4db7-b2a5-0af30b9c9ba8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1317 microversion: 2.1 time: 0.861261 Jun 10 18:10:45.141851 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1905/3920] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:44 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1317 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:45.164887 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-939228a6-56cf-4086-b5f1-06b9b52b22e5 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:45.168069 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-939228a6-56cf-4086-b5f1-06b9b52b22e5 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] [instance: b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:45.192587 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-939228a6-56cf-4086-b5f1-06b9b52b22e5 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:45.193222 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-939228a6-56cf-4086-b5f1-06b9b52b22e5 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:45.194370 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-939228a6-56cf-4086-b5f1-06b9b52b22e5 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:45.195092 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-939228a6-56cf-4086-b5f1-06b9b52b22e5 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:45.578239 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-81a2a6d2-337f-4a87-a619-086a58c979e8 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4caa591fe84879a787d0601f2d8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53380f847a949a0b61c83fc5661d236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:45.589594 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-81a2a6d2-337f-4a87-a619-086a58c979e8 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1" status: 200 len: 1614 microversion: 2.1 time: 1.000522 Jun 10 18:10:45.600128 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2016/3921] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:44 2022] GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1 => generated 1614 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:45.610834 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-61fb7bb5-5229-476d-b66e-85ca13330375 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c0e17940>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:45.679775 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=18 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:10:46.007619 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-939228a6-56cf-4086-b5f1-06b9b52b22e5 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03179d7b781041f0988b9d1e00bd0963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d33177df0b44227bfaa8be53d56d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:46.027977 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-939228a6-56cf-4086-b5f1-06b9b52b22e5 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] 10.222.0.35 "GET /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1" status: 200 len: 1328 microversion: 2.1 time: 0.880925 Jun 10 18:10:46.029255 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1906/3922] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:45 2022] GET /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 => generated 1328 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:46.038729 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bc8b3c25-8a9e-4b1b-9801-7df933c41d2d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:46.042575 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bc8b3c25-8a9e-4b1b-9801-7df933c41d2d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:46.068297 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bc8b3c25-8a9e-4b1b-9801-7df933c41d2d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:46.069218 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bc8b3c25-8a9e-4b1b-9801-7df933c41d2d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:46.070060 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bc8b3c25-8a9e-4b1b-9801-7df933c41d2d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:46.070508 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bc8b3c25-8a9e-4b1b-9801-7df933c41d2d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:46.171532 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=22 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:10:46.553438 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bc8b3c25-8a9e-4b1b-9801-7df933c41d2d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:46.562652 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bc8b3c25-8a9e-4b1b-9801-7df933c41d2d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1524 microversion: 2.1 time: 0.530603 Jun 10 18:10:46.604789 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1907/3923] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:46 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1524 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:46.623063 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-96cf930a-6ea5-48cc-a1a6-ab3b1500590b tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:46.625957 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-96cf930a-6ea5-48cc-a1a6-ab3b1500590b tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] [instance: b84fd25b-3629-41a1-8de6-bd43cab180ac] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:46.661416 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-96cf930a-6ea5-48cc-a1a6-ab3b1500590b tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:46.666223 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-96cf930a-6ea5-48cc-a1a6-ab3b1500590b tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:46.669767 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-96cf930a-6ea5-48cc-a1a6-ab3b1500590b tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:46.681126 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-96cf930a-6ea5-48cc-a1a6-ab3b1500590b tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:47.273023 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-96cf930a-6ea5-48cc-a1a6-ab3b1500590b tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:47.287748 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-96cf930a-6ea5-48cc-a1a6-ab3b1500590b tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:47.289221 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-96cf930a-6ea5-48cc-a1a6-ab3b1500590b tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:47.298597 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-96cf930a-6ea5-48cc-a1a6-ab3b1500590b tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] 10.222.0.35 "GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac" status: 200 len: 1358 microversion: 2.21 time: 0.704319 Jun 10 18:10:47.314297 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1908/3924] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:10:46 2022] GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac => generated 1358 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:10:47.330811 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-b2118676-fce8-4311-ad1f-13c37fadc2cd req-4f16ecb6-11bd-4b19-ba10-1c3c65e16ee3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1", "name": "network-vif-plugged", "status": "completed", "tag": "ce89b606-ef43-411a-b6ad-cc5361e810f9"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:10:47.360743 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-b2118676-fce8-4311-ad1f-13c37fadc2cd req-4f16ecb6-11bd-4b19-ba10-1c3c65e16ee3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:47.363115 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-b2118676-fce8-4311-ad1f-13c37fadc2cd req-4f16ecb6-11bd-4b19-ba10-1c3c65e16ee3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:47.435591 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-b2118676-fce8-4311-ad1f-13c37fadc2cd req-4f16ecb6-11bd-4b19-ba10-1c3c65e16ee3 service nova] Creating event network-vif-plugged:ce89b606-ef43-411a-b6ad-cc5361e810f9 for instance b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 on chh1-master-2 Jun 10 18:10:47.441417 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-b2118676-fce8-4311-ad1f-13c37fadc2cd req-4f16ecb6-11bd-4b19-ba10-1c3c65e16ee3 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134478 Jun 10 18:10:47.442702 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1909/3925] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:10:47.492749 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bbfa5c5c-6104-4d76-a17d-641198d96b88 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:47.492749 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bbfa5c5c-6104-4d76-a17d-641198d96b88 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:47.492749 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bbfa5c5c-6104-4d76-a17d-641198d96b88 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:47.492749 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bbfa5c5c-6104-4d76-a17d-641198d96b88 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:47.492749 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bbfa5c5c-6104-4d76-a17d-641198d96b88 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:47.492749 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bbfa5c5c-6104-4d76-a17d-641198d96b88 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:48.012728 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bbfa5c5c-6104-4d76-a17d-641198d96b88 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:48.028010 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bbfa5c5c-6104-4d76-a17d-641198d96b88 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1317 microversion: 2.1 time: 0.584030 Jun 10 18:10:48.029010 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1910/3926] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:47 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1317 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:48.049164 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-b490046b-3e04-4394-8dba-1ac192b32b5b req-4138ab66-50b4-4a50-b326-cb72059aa51c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "739d282e-c869-4ebe-b4fb-7122f0070ce1", "name": "network-vif-deleted", "tag": "a649028f-7a43-401d-adaa-1e45a3ebf42c"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:10:48.077912 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-b490046b-3e04-4394-8dba-1ac192b32b5b req-4138ab66-50b4-4a50-b326-cb72059aa51c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:48.078360 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-b490046b-3e04-4394-8dba-1ac192b32b5b req-4138ab66-50b4-4a50-b326-cb72059aa51c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:48.127107 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-b490046b-3e04-4394-8dba-1ac192b32b5b req-4138ab66-50b4-4a50-b326-cb72059aa51c service nova] Creating event network-vif-deleted:a649028f-7a43-401d-adaa-1e45a3ebf42c for instance 739d282e-c869-4ebe-b4fb-7122f0070ce1 on chh2-master-2 Jun 10 18:10:48.140121 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-b490046b-3e04-4394-8dba-1ac192b32b5b req-4138ab66-50b4-4a50-b326-cb72059aa51c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109646 Jun 10 18:10:48.145661 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1911/3927] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:10:48.169250 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d3226811-45f2-4d33-8d65-2961c5668a48 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:48.189439 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d3226811-45f2-4d33-8d65-2961c5668a48 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:48.192568 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:10:48.196244 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d3226811-45f2-4d33-8d65-2961c5668a48 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:48.204196 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d3226811-45f2-4d33-8d65-2961c5668a48 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:48.208867 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d3226811-45f2-4d33-8d65-2961c5668a48 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:48.209511 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d3226811-45f2-4d33-8d65-2961c5668a48 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:48.315485 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d3226811-45f2-4d33-8d65-2961c5668a48 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:48.316177 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d3226811-45f2-4d33-8d65-2961c5668a48 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:48.316473 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-d3226811-45f2-4d33-8d65-2961c5668a48 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lazy-loading 'fault' on Instance uuid 739d282e-c869-4ebe-b4fb-7122f0070ce1 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:10:48.475672 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d3226811-45f2-4d33-8d65-2961c5668a48 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4caa591fe84879a787d0601f2d8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53380f847a949a0b61c83fc5661d236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:48.496098 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d3226811-45f2-4d33-8d65-2961c5668a48 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1" status: 200 len: 1332 microversion: 2.1 time: 0.348867 Jun 10 18:10:48.498064 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1912/3928] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:48 2022] GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1 => generated 1332 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:48.507175 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-0d726bd8-6ec3-4d64-8fcb-7eebe88b6d41 req-d71e76c2-0797-44df-8a16-30cca6c35151 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b84fd25b-3629-41a1-8de6-bd43cab180ac", "tag": "8fad7197-8cec-4ec4-b6a8-75dee09a50b1"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:10:48.533176 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-0d726bd8-6ec3-4d64-8fcb-7eebe88b6d41 req-d71e76c2-0797-44df-8a16-30cca6c35151 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:48.540133 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-0d726bd8-6ec3-4d64-8fcb-7eebe88b6d41 req-d71e76c2-0797-44df-8a16-30cca6c35151 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:48.562515 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-0d726bd8-6ec3-4d64-8fcb-7eebe88b6d41 req-d71e76c2-0797-44df-8a16-30cca6c35151 service nova] Creating event network-changed:8fad7197-8cec-4ec4-b6a8-75dee09a50b1 for instance b84fd25b-3629-41a1-8de6-bd43cab180ac on chh1-master-2 Jun 10 18:10:48.571743 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-0d726bd8-6ec3-4d64-8fcb-7eebe88b6d41 req-d71e76c2-0797-44df-8a16-30cca6c35151 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068411 Jun 10 18:10:48.575735 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1913/3929] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:10:48.592118 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-527a3730-0106-4936-9811-d91bfc9bd357 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:48.594042 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-527a3730-0106-4936-9811-d91bfc9bd357 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] [instance: b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:48.605987 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-527a3730-0106-4936-9811-d91bfc9bd357 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:48.606468 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-527a3730-0106-4936-9811-d91bfc9bd357 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:48.607318 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-527a3730-0106-4936-9811-d91bfc9bd357 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:48.607773 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-527a3730-0106-4936-9811-d91bfc9bd357 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:48.951048 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-527a3730-0106-4936-9811-d91bfc9bd357 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03179d7b781041f0988b9d1e00bd0963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d33177df0b44227bfaa8be53d56d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:48.971428 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-527a3730-0106-4936-9811-d91bfc9bd357 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] 10.222.0.35 "GET /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1" status: 200 len: 1328 microversion: 2.1 time: 0.389974 Jun 10 18:10:48.972065 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1914/3930] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:48 2022] GET /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 => generated 1328 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:48.990771 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-00f1a1ed-056a-475d-8ad3-4721be7adb94 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:48.993747 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-00f1a1ed-056a-475d-8ad3-4721be7adb94 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:49.008760 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-00f1a1ed-056a-475d-8ad3-4721be7adb94 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:49.008760 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-00f1a1ed-056a-475d-8ad3-4721be7adb94 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:49.008760 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-00f1a1ed-056a-475d-8ad3-4721be7adb94 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:49.008760 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-00f1a1ed-056a-475d-8ad3-4721be7adb94 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:49.294454 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-00f1a1ed-056a-475d-8ad3-4721be7adb94 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:49.303886 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-00f1a1ed-056a-475d-8ad3-4721be7adb94 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1524 microversion: 2.1 time: 0.328555 Jun 10 18:10:49.304610 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1915/3931] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:48 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1524 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:49.315422 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f0e25664-2ed8-4261-9e5f-2a630f81c59b tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:49.316046 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f0e25664-2ed8-4261-9e5f-2a630f81c59b tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] [instance: b84fd25b-3629-41a1-8de6-bd43cab180ac] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:49.333329 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f0e25664-2ed8-4261-9e5f-2a630f81c59b tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:49.358410 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f0e25664-2ed8-4261-9e5f-2a630f81c59b tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:49.358410 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f0e25664-2ed8-4261-9e5f-2a630f81c59b tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:49.358410 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f0e25664-2ed8-4261-9e5f-2a630f81c59b tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:49.740468 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f0e25664-2ed8-4261-9e5f-2a630f81c59b tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:49.755615 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f0e25664-2ed8-4261-9e5f-2a630f81c59b tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:49.757501 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f0e25664-2ed8-4261-9e5f-2a630f81c59b tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:49.758791 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f0e25664-2ed8-4261-9e5f-2a630f81c59b tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] 10.222.0.35 "GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac" status: 200 len: 1358 microversion: 2.21 time: 0.453162 Jun 10 18:10:49.759533 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1916/3932] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:10:49 2022] GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac => generated 1358 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:10:49.779352 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-234df674-845d-4dcb-9844-f6c118153699 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:49.780038 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-234df674-845d-4dcb-9844-f6c118153699 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:49.791482 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-234df674-845d-4dcb-9844-f6c118153699 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:49.792488 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-234df674-845d-4dcb-9844-f6c118153699 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:49.793465 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-234df674-845d-4dcb-9844-f6c118153699 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:49.794311 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-234df674-845d-4dcb-9844-f6c118153699 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:50.448283 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-234df674-845d-4dcb-9844-f6c118153699 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:50.460142 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-234df674-845d-4dcb-9844-f6c118153699 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1317 microversion: 2.1 time: 0.683352 Jun 10 18:10:50.461000 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1917/3933] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:49 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1317 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:50.477951 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-01eb7d65-09a7-451a-973f-f597093d358b tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:50.478820 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-01eb7d65-09a7-451a-973f-f597093d358b tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:50.491032 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-01eb7d65-09a7-451a-973f-f597093d358b tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:50.491580 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-01eb7d65-09a7-451a-973f-f597093d358b tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:50.496477 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-01eb7d65-09a7-451a-973f-f597093d358b tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:50.496477 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-01eb7d65-09a7-451a-973f-f597093d358b tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:50.526435 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-01eb7d65-09a7-451a-973f-f597093d358b tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] HTTP exception thrown: Instance 739d282e-c869-4ebe-b4fb-7122f0070ce1 could not be found. Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-01eb7d65-09a7-451a-973f-f597093d358b tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Request method failure captured: Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1 HTTP/1.1 Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4hOdb8FyF3q0k3norSczXTwEqaGBO8Zm7LzTT8WcGhVKAxHpU8jHMhzRz1LBvuAWsiAk1ASME1luJH6w6N_uk0HJnS4QmUol5olkMHExHM_8rPH4CKVbfXIlEa-0LKLXbalhPio0_ILE_Ib0VJCDCmL6mzJO4vy_5SoqB-_90BbLV4 Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: e53380f847a949a0b61c83fc5661d236 Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2114578814 Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/e53380f847a949a0b61c83fc5661d236"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/e53380f847a949a0b61c83fc5661d236"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/e53380f847a949a0b61c83fc5661d236"}]}, {"type": "tempest-type-1142384015", "name": "tempest-service-1838487701", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_e53380f847a949a0b61c83fc5661d236", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2114578814 Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: e53380f847a949a0b61c83fc5661d236 Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2114578814 Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-AttachSCSIVolumeTestJSON-2114578814-project Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 0c4caa591fe84879a787d0601f2d8445 Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2114578814-project Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 739d282e-c869-4ebe-b4fb-7122f0070ce1 could not be found. Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '739d282e-c869-4ebe-b4fb-7122f0070ce1'} Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 739d282e-c869-4ebe-b4fb-7122f0070ce1 could not be found. Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 739d282e-c869-4ebe-b4fb-7122f0070ce1 could not be found. Jun 10 18:10:50.528144 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:10:50.532822 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:10:50.532822 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:10:50.532822 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:10:50.532822 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:10:50.532822 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:10:50.532822 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:10:50.532822 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:10:50.532822 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 739d282e-c869-4ebe-b4fb-7122f0070ce1 could not be found. Jun 10 18:10:50.532822 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:10:50.542065 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-01eb7d65-09a7-451a-973f-f597093d358b tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Returning 404 to user: Instance 739d282e-c869-4ebe-b4fb-7122f0070ce1 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:10:50.545247 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-01eb7d65-09a7-451a-973f-f597093d358b tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1" status: 404 len: 111 microversion: 2.1 time: 0.079640 Jun 10 18:10:50.551254 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1918/3934] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:50 2022] GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:10:50.566145 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-36dbbce3-62fd-45f5-bf9b-cb1fd1ac4853 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:50.567071 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-36dbbce3-62fd-45f5-bf9b-cb1fd1ac4853 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] [instance: b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:50.596150 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-36dbbce3-62fd-45f5-bf9b-cb1fd1ac4853 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:50.596671 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-36dbbce3-62fd-45f5-bf9b-cb1fd1ac4853 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:50.597478 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-36dbbce3-62fd-45f5-bf9b-cb1fd1ac4853 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:50.621345 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-36dbbce3-62fd-45f5-bf9b-cb1fd1ac4853 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:50.631549 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:10:50.868066 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-36dbbce3-62fd-45f5-bf9b-cb1fd1ac4853 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03179d7b781041f0988b9d1e00bd0963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d33177df0b44227bfaa8be53d56d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:50.881068 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-36dbbce3-62fd-45f5-bf9b-cb1fd1ac4853 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] 10.222.0.35 "GET /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1" status: 200 len: 1528 microversion: 2.1 time: 0.328331 Jun 10 18:10:50.886198 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1919/3935] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:50 2022] GET /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 => generated 1528 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:50.892688 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d94f64c0-8e1e-4efe-ac7b-1787bd1a3902 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:50.893829 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d94f64c0-8e1e-4efe-ac7b-1787bd1a3902 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:50.902900 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d94f64c0-8e1e-4efe-ac7b-1787bd1a3902 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:50.903420 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d94f64c0-8e1e-4efe-ac7b-1787bd1a3902 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:50.904211 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d94f64c0-8e1e-4efe-ac7b-1787bd1a3902 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:50.904678 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d94f64c0-8e1e-4efe-ac7b-1787bd1a3902 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:51.115683 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d94f64c0-8e1e-4efe-ac7b-1787bd1a3902 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:51.128763 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d94f64c0-8e1e-4efe-ac7b-1787bd1a3902 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1524 microversion: 2.1 time: 0.241158 Jun 10 18:10:51.131864 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1920/3936] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:50 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1524 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:51.137654 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6f39f66b-7782-4106-9e05-179c998476c4 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '.version_select at 0x7f77c003eb80>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:51.219553 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6f39f66b-7782-4106-9e05-179c998476c4 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1035448627" status: 202 len: 0 microversion: 2.1 time: 0.086443 Jun 10 18:10:51.220966 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1921/3937] 10.222.0.35 () {58 vars in 1220 bytes} [Fri Jun 10 18:10:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1035448627 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:10:51.245529 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ddfcc3d7-1627-4f0e-8ac0-e33d6d5bb72f tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:51.249168 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ddfcc3d7-1627-4f0e-8ac0-e33d6d5bb72f tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] [instance: b84fd25b-3629-41a1-8de6-bd43cab180ac] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:51.284944 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ddfcc3d7-1627-4f0e-8ac0-e33d6d5bb72f tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:51.287528 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ddfcc3d7-1627-4f0e-8ac0-e33d6d5bb72f tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:51.290372 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ddfcc3d7-1627-4f0e-8ac0-e33d6d5bb72f tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:51.291129 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ddfcc3d7-1627-4f0e-8ac0-e33d6d5bb72f tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:51.584224 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ddfcc3d7-1627-4f0e-8ac0-e33d6d5bb72f tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:51.593557 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ddfcc3d7-1627-4f0e-8ac0-e33d6d5bb72f tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:51.595093 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ddfcc3d7-1627-4f0e-8ac0-e33d6d5bb72f tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:51.596249 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ddfcc3d7-1627-4f0e-8ac0-e33d6d5bb72f tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] 10.222.0.35 "GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac" status: 200 len: 1358 microversion: 2.21 time: 0.373858 Jun 10 18:10:51.604834 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1922/3938] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:10:51 2022] GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac => generated 1358 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:10:51.611866 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-577d4871-a84a-470d-b6de-467869424857 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:51.612526 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-577d4871-a84a-470d-b6de-467869424857 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] [instance: b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:51.624357 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-577d4871-a84a-470d-b6de-467869424857 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:51.624828 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-577d4871-a84a-470d-b6de-467869424857 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:51.626022 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-577d4871-a84a-470d-b6de-467869424857 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:51.626499 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-577d4871-a84a-470d-b6de-467869424857 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:51.979470 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-577d4871-a84a-470d-b6de-467869424857 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03179d7b781041f0988b9d1e00bd0963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d33177df0b44227bfaa8be53d56d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:51.989729 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-577d4871-a84a-470d-b6de-467869424857 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] 10.222.0.35 "GET /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1" status: 200 len: 1528 microversion: 2.1 time: 0.383767 Jun 10 18:10:52.006356 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1923/3939] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:51 2022] GET /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 => generated 1528 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:52.012578 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-927a2c22-20f0-4608-a35f-6384be013b76 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:52.013535 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-927a2c22-20f0-4608-a35f-6384be013b76 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:52.047232 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-927a2c22-20f0-4608-a35f-6384be013b76 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:52.048558 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-927a2c22-20f0-4608-a35f-6384be013b76 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:52.049389 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-927a2c22-20f0-4608-a35f-6384be013b76 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:52.050564 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-927a2c22-20f0-4608-a35f-6384be013b76 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:52.319636 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-927a2c22-20f0-4608-a35f-6384be013b76 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:52.341686 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-927a2c22-20f0-4608-a35f-6384be013b76 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1317 microversion: 2.1 time: 0.322525 Jun 10 18:10:52.341686 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1924/3940] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:52 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1317 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:52.341686 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-3523afb7-db67-480a-8bfc-5cace72b818d req-2f40c7e3-3e2a-4023-89b2-7ee49df34d3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57a377b2-f75e-4a0c-8401-090db42db644", "name": "network-vif-plugged", "status": "completed", "tag": "ea23750f-0e21-482f-b68f-6361eeb3c636"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:10:52.347883 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-3523afb7-db67-480a-8bfc-5cace72b818d req-2f40c7e3-3e2a-4023-89b2-7ee49df34d3c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:52.348457 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-3523afb7-db67-480a-8bfc-5cace72b818d req-2f40c7e3-3e2a-4023-89b2-7ee49df34d3c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:52.368261 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-3523afb7-db67-480a-8bfc-5cace72b818d req-2f40c7e3-3e2a-4023-89b2-7ee49df34d3c service nova] Creating event network-vif-plugged:ea23750f-0e21-482f-b68f-6361eeb3c636 for instance 57a377b2-f75e-4a0c-8401-090db42db644 on chh1-master-2 Jun 10 18:10:52.388977 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-3523afb7-db67-480a-8bfc-5cace72b818d req-2f40c7e3-3e2a-4023-89b2-7ee49df34d3c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055076 Jun 10 18:10:52.390023 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1925/3941] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:10:52.710029 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-46da7deb-f798-42da-8dec-93a878b24f54 tempest-ServersNegativeTestMultiTenantJSON-2097857352 tempest-ServersNegativeTestMultiTenantJSON-2097857352-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:52.722886 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-46da7deb-f798-42da-8dec-93a878b24f54 tempest-ServersNegativeTestMultiTenantJSON-2097857352 tempest-ServersNegativeTestMultiTenantJSON-2097857352-project] [instance: b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-46da7deb-f798-42da-8dec-93a878b24f54 tempest-ServersNegativeTestMultiTenantJSON-2097857352 tempest-ServersNegativeTestMultiTenantJSON-2097857352-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-46da7deb-f798-42da-8dec-93a878b24f54 tempest-ServersNegativeTestMultiTenantJSON-2097857352 tempest-ServersNegativeTestMultiTenantJSON-2097857352-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-46da7deb-f798-42da-8dec-93a878b24f54 tempest-ServersNegativeTestMultiTenantJSON-2097857352 tempest-ServersNegativeTestMultiTenantJSON-2097857352-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-46da7deb-f798-42da-8dec-93a878b24f54 tempest-ServersNegativeTestMultiTenantJSON-2097857352 tempest-ServersNegativeTestMultiTenantJSON-2097857352-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-46da7deb-f798-42da-8dec-93a878b24f54 tempest-ServersNegativeTestMultiTenantJSON-2097857352 tempest-ServersNegativeTestMultiTenantJSON-2097857352-project] HTTP exception thrown: Instance b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 could not be found. Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-46da7deb-f798-42da-8dec-93a878b24f54 tempest-ServersNegativeTestMultiTenantJSON-2097857352 tempest-ServersNegativeTestMultiTenantJSON-2097857352-project] Request method failure captured: Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 HTTP/1.1 Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4kTyBH6W1qITlrbxzNxT50yeBzXS117NjjpxLV5zwZQMt000-EfNqvLvw9e9REqwOFUmuhiuAYLyz6YIIJLJrxEE1UQzfJ1rT1PU6gCqGtCPpUnmh0aHoyGGEV8LPKRDAh2IGZorMinvq8sUOaRyCkPHVS0vkr2P-K0Ys9l8NGyxkg Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: db1761d757374dd4a596babf322864df Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2097857352 Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/db1761d757374dd4a596babf322864df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/db1761d757374dd4a596babf322864df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/db1761d757374dd4a596babf322864df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_db1761d757374dd4a596babf322864df", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2097857352 Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: db1761d757374dd4a596babf322864df Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2097857352 Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2097857352-project Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: fe369d54f1e5424ba8fc37fe9d5baca0 Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2097857352-project Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: exception: Instance b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 could not be found. Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1'} Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:10:52.788281 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:10:52.793340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:10:52.793340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:10:52.793340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:10:52.793340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:10:52.793340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 could not be found. Jun 10 18:10:52.793340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:10:52.793340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:10:52.793340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:10:52.793340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:10:52.793340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:10:52.793340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:10:52.793340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:10:52.793340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:10:52.793340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:10:52.793340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:10:52.793340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:10:52.793340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:10:52.793340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:10:52.793340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:10:52.793340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:10:52.793340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:10:52.793340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:10:52.793340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:10:52.793340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 could not be found. Jun 10 18:10:52.793340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:10:52.793340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:10:52.793340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:10:52.793340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:10:52.793340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:10:52.793340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:10:52.793340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:10:52.793340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:10:52.793340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 could not be found. Jun 10 18:10:52.793340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:10:52.793340 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-46da7deb-f798-42da-8dec-93a878b24f54 tempest-ServersNegativeTestMultiTenantJSON-2097857352 tempest-ServersNegativeTestMultiTenantJSON-2097857352-project] Returning 404 to user: Instance b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:10:52.793340 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-46da7deb-f798-42da-8dec-93a878b24f54 tempest-ServersNegativeTestMultiTenantJSON-2097857352 tempest-ServersNegativeTestMultiTenantJSON-2097857352-project] 10.222.0.35 "DELETE /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1" status: 404 len: 111 microversion: 2.1 time: 0.367442 Jun 10 18:10:52.793340 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1926/3942] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:10:52 2022] DELETE /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 => generated 111 bytes in 369 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:10:52.793340 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e593731a-1769-4308-bcf9-b54bb7b1f24e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:52.793340 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e593731a-1769-4308-bcf9-b54bb7b1f24e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:52.793340 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e593731a-1769-4308-bcf9-b54bb7b1f24e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:52.796623 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e593731a-1769-4308-bcf9-b54bb7b1f24e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:52.798397 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e593731a-1769-4308-bcf9-b54bb7b1f24e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:52.798978 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e593731a-1769-4308-bcf9-b54bb7b1f24e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:52.987683 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e593731a-1769-4308-bcf9-b54bb7b1f24e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:52.999096 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e593731a-1769-4308-bcf9-b54bb7b1f24e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1524 microversion: 2.1 time: 0.237217 Jun 10 18:10:52.999824 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1927/3943] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:52 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1524 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:53.019880 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-35c91d46-11ac-4bbf-a03e-918d42e287b6 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:53.020649 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-35c91d46-11ac-4bbf-a03e-918d42e287b6 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] [instance: b84fd25b-3629-41a1-8de6-bd43cab180ac] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:53.032599 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-35c91d46-11ac-4bbf-a03e-918d42e287b6 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:53.036725 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-35c91d46-11ac-4bbf-a03e-918d42e287b6 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:53.036725 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-35c91d46-11ac-4bbf-a03e-918d42e287b6 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:53.036725 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-35c91d46-11ac-4bbf-a03e-918d42e287b6 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:53.262080 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-35c91d46-11ac-4bbf-a03e-918d42e287b6 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:53.274419 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-35c91d46-11ac-4bbf-a03e-918d42e287b6 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:53.277375 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-35c91d46-11ac-4bbf-a03e-918d42e287b6 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:53.279090 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-35c91d46-11ac-4bbf-a03e-918d42e287b6 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] 10.222.0.35 "GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac" status: 200 len: 1358 microversion: 2.21 time: 0.269605 Jun 10 18:10:53.282724 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1928/3944] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:10:52 2022] GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac => generated 1358 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:10:53.285797 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4064a113-8de0-4d2f-95b9-8289225580da tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:53.286870 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4064a113-8de0-4d2f-95b9-8289225580da tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] [instance: b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:53.294378 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4064a113-8de0-4d2f-95b9-8289225580da tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:53.295468 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4064a113-8de0-4d2f-95b9-8289225580da tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:53.296781 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4064a113-8de0-4d2f-95b9-8289225580da tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:53.297660 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4064a113-8de0-4d2f-95b9-8289225580da tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:53.582325 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4064a113-8de0-4d2f-95b9-8289225580da tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03179d7b781041f0988b9d1e00bd0963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d33177df0b44227bfaa8be53d56d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:53.596171 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4064a113-8de0-4d2f-95b9-8289225580da tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] 10.222.0.35 "GET /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1" status: 200 len: 1528 microversion: 2.1 time: 0.311901 Jun 10 18:10:53.610403 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1929/3945] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:53 2022] GET /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 => generated 1528 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:53.619482 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-58878764-f09e-4be4-869a-f3e581ecae1d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:53.619482 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-58878764-f09e-4be4-869a-f3e581ecae1d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:53.622470 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-58878764-f09e-4be4-869a-f3e581ecae1d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:53.622979 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-58878764-f09e-4be4-869a-f3e581ecae1d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:53.624669 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-58878764-f09e-4be4-869a-f3e581ecae1d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:53.625877 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-58878764-f09e-4be4-869a-f3e581ecae1d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:54.379761 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-58878764-f09e-4be4-869a-f3e581ecae1d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:54.388412 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-58878764-f09e-4be4-869a-f3e581ecae1d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1317 microversion: 2.1 time: 0.776781 Jun 10 18:10:54.389343 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1930/3946] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:53 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1317 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:54.407562 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-449439aa-0084-4f52-8263-5cd4daeef2f1 tempest-ServersNegativeTestMultiTenantJSON-2097857352 tempest-ServersNegativeTestMultiTenantJSON-2097857352-project] Action: 'update', calling method: >, body: {"server": {"name": "b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1_new"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:10:54.409290 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-449439aa-0084-4f52-8263-5cd4daeef2f1 tempest-ServersNegativeTestMultiTenantJSON-2097857352 tempest-ServersNegativeTestMultiTenantJSON-2097857352-project] [instance: b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:54.416870 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-449439aa-0084-4f52-8263-5cd4daeef2f1 tempest-ServersNegativeTestMultiTenantJSON-2097857352 tempest-ServersNegativeTestMultiTenantJSON-2097857352-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:54.417451 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-449439aa-0084-4f52-8263-5cd4daeef2f1 tempest-ServersNegativeTestMultiTenantJSON-2097857352 tempest-ServersNegativeTestMultiTenantJSON-2097857352-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:54.418615 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-449439aa-0084-4f52-8263-5cd4daeef2f1 tempest-ServersNegativeTestMultiTenantJSON-2097857352 tempest-ServersNegativeTestMultiTenantJSON-2097857352-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:54.419185 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-449439aa-0084-4f52-8263-5cd4daeef2f1 tempest-ServersNegativeTestMultiTenantJSON-2097857352 tempest-ServersNegativeTestMultiTenantJSON-2097857352-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:54.435281 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-449439aa-0084-4f52-8263-5cd4daeef2f1 tempest-ServersNegativeTestMultiTenantJSON-2097857352 tempest-ServersNegativeTestMultiTenantJSON-2097857352-project] HTTP exception thrown: Instance b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 could not be found. Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-449439aa-0084-4f52-8263-5cd4daeef2f1 tempest-ServersNegativeTestMultiTenantJSON-2097857352 tempest-ServersNegativeTestMultiTenantJSON-2097857352-project] Request method failure captured: Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: request: PUT /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 HTTP/1.1 Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 64 Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4kTyBH6W1qITlrbxzNxT50yeBzXS117NjjpxLV5zwZQMt000-EfNqvLvw9e9REqwOFUmuhiuAYLyz6YIIJLJrxEE1UQzfJ1rT1PU6gCqGtCPpUnmh0aHoyGGEV8LPKRDAh2IGZorMinvq8sUOaRyCkPHVS0vkr2P-K0Ys9l8NGyxkg Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: db1761d757374dd4a596babf322864df Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2097857352 Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/db1761d757374dd4a596babf322864df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/db1761d757374dd4a596babf322864df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/db1761d757374dd4a596babf322864df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_db1761d757374dd4a596babf322864df", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2097857352 Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: db1761d757374dd4a596babf322864df Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2097857352 Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2097857352-project Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: fe369d54f1e5424ba8fc37fe9d5baca0 Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2097857352-project Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: {"server": {"name": "b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1_new"}} Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: exception: Instance b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 could not be found. Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1', 'body': {'server': {'name': 'b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1_new'}}} Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 could not be found. Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 10 18:10:54.443280 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jun 10 18:10:54.447662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jun 10 18:10:54.447662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:10:54.447662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:10:54.447662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:10:54.447662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:10:54.447662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 could not be found. Jun 10 18:10:54.447662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:10:54.447662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:10:54.447662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:10:54.447662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:10:54.447662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:10:54.447662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:10:54.447662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:10:54.447662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:10:54.447662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 could not be found. Jun 10 18:10:54.447662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:10:54.447662 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-449439aa-0084-4f52-8263-5cd4daeef2f1 tempest-ServersNegativeTestMultiTenantJSON-2097857352 tempest-ServersNegativeTestMultiTenantJSON-2097857352-project] Returning 404 to user: Instance b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:10:54.447662 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-449439aa-0084-4f52-8263-5cd4daeef2f1 tempest-ServersNegativeTestMultiTenantJSON-2097857352 tempest-ServersNegativeTestMultiTenantJSON-2097857352-project] 10.222.0.35 "PUT /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1" status: 404 len: 111 microversion: 2.1 time: 0.037701 Jun 10 18:10:54.447662 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1931/3947] 10.222.0.35 () {60 vars in 1255 bytes} [Fri Jun 10 18:10:54 2022] PUT /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:10:54.447662 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-39854a58-41b7-4308-8fd5-22461b1dde4c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:54.447662 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-39854a58-41b7-4308-8fd5-22461b1dde4c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:54.454858 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-39854a58-41b7-4308-8fd5-22461b1dde4c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:54.455392 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-39854a58-41b7-4308-8fd5-22461b1dde4c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:54.456284 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-39854a58-41b7-4308-8fd5-22461b1dde4c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:54.456829 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-39854a58-41b7-4308-8fd5-22461b1dde4c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:54.620881 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:10:54.723724 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-39854a58-41b7-4308-8fd5-22461b1dde4c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:54.733169 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-39854a58-41b7-4308-8fd5-22461b1dde4c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1524 microversion: 2.1 time: 0.292119 Jun 10 18:10:54.737992 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1932/3948] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:54 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1524 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:54.740857 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e49dc466-fc0a-4326-9180-2510823212dc tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:54.741649 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e49dc466-fc0a-4326-9180-2510823212dc tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] [instance: b84fd25b-3629-41a1-8de6-bd43cab180ac] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:54.748123 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e49dc466-fc0a-4326-9180-2510823212dc tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:54.748836 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e49dc466-fc0a-4326-9180-2510823212dc tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:54.749804 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e49dc466-fc0a-4326-9180-2510823212dc tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:54.750414 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e49dc466-fc0a-4326-9180-2510823212dc tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:54.918865 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e49dc466-fc0a-4326-9180-2510823212dc tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:54.929177 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e49dc466-fc0a-4326-9180-2510823212dc tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:54.931543 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e49dc466-fc0a-4326-9180-2510823212dc tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:54.932750 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e49dc466-fc0a-4326-9180-2510823212dc tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] 10.222.0.35 "GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac" status: 200 len: 1358 microversion: 2.21 time: 0.196799 Jun 10 18:10:54.933545 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1933/3949] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:10:54 2022] GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:10:54.965111 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0236c20d-f8b4-4c73-b93e-0462cf6cf159 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:54.965633 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0236c20d-f8b4-4c73-b93e-0462cf6cf159 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] [instance: b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:54.973146 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0236c20d-f8b4-4c73-b93e-0462cf6cf159 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:54.973606 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0236c20d-f8b4-4c73-b93e-0462cf6cf159 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:54.974391 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0236c20d-f8b4-4c73-b93e-0462cf6cf159 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:54.974832 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0236c20d-f8b4-4c73-b93e-0462cf6cf159 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:55.009351 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0236c20d-f8b4-4c73-b93e-0462cf6cf159 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] [instance: b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:10:55.626391 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:10:55.675243 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0236c20d-f8b4-4c73-b93e-0462cf6cf159 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] 10.222.0.35 "DELETE /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1" status: 204 len: 0 microversion: 2.1 time: 0.718875 Jun 10 18:10:55.676703 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1934/3950] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:10:54 2022] DELETE /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 => generated 0 bytes in 743 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:10:55.683205 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e0886ec5-226d-4813-a48d-25523c4a7416 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:55.684329 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e0886ec5-226d-4813-a48d-25523c4a7416 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:55.690720 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e0886ec5-226d-4813-a48d-25523c4a7416 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:55.691247 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e0886ec5-226d-4813-a48d-25523c4a7416 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:55.692079 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e0886ec5-226d-4813-a48d-25523c4a7416 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:55.692625 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e0886ec5-226d-4813-a48d-25523c4a7416 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:55.852147 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e0886ec5-226d-4813-a48d-25523c4a7416 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:55.861945 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e0886ec5-226d-4813-a48d-25523c4a7416 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.183760 Jun 10 18:10:55.863215 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1935/3951] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:55 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:55.869568 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-2b44e08a-accb-4765-a82b-da6e24581500 req-43cd160d-e928-4303-8420-87a14c814190 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b84fd25b-3629-41a1-8de6-bd43cab180ac", "name": "network-vif-plugged", "status": "completed", "tag": "8fad7197-8cec-4ec4-b6a8-75dee09a50b1"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:10:55.879488 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-2b44e08a-accb-4765-a82b-da6e24581500 req-43cd160d-e928-4303-8420-87a14c814190 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:55.880224 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-2b44e08a-accb-4765-a82b-da6e24581500 req-43cd160d-e928-4303-8420-87a14c814190 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:55.896532 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-2b44e08a-accb-4765-a82b-da6e24581500 req-43cd160d-e928-4303-8420-87a14c814190 service nova] Creating event network-vif-plugged:8fad7197-8cec-4ec4-b6a8-75dee09a50b1 for instance b84fd25b-3629-41a1-8de6-bd43cab180ac on chh1-master-2 Jun 10 18:10:55.902196 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-2b44e08a-accb-4765-a82b-da6e24581500 req-43cd160d-e928-4303-8420-87a14c814190 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036861 Jun 10 18:10:55.903367 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1936/3952] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:10:55.911030 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-401261f7-d40d-4d97-9466-f14d246a62fe tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:55.912124 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-401261f7-d40d-4d97-9466-f14d246a62fe tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] [instance: b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:55.926032 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-401261f7-d40d-4d97-9466-f14d246a62fe tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:55.931536 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-401261f7-d40d-4d97-9466-f14d246a62fe tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:55.932475 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-401261f7-d40d-4d97-9466-f14d246a62fe tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:55.932935 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-401261f7-d40d-4d97-9466-f14d246a62fe tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:56.122200 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-401261f7-d40d-4d97-9466-f14d246a62fe tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03179d7b781041f0988b9d1e00bd0963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d33177df0b44227bfaa8be53d56d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:56.127369 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:10:56.134629 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-401261f7-d40d-4d97-9466-f14d246a62fe tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] 10.222.0.35 "GET /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1" status: 200 len: 1534 microversion: 2.1 time: 0.228804 Jun 10 18:10:56.144338 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1937/3953] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:55 2022] GET /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 => generated 1534 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:56.144338 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-530fbbab-2030-4406-bd50-5f35db27830d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:56.144338 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-530fbbab-2030-4406-bd50-5f35db27830d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:56.152354 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-530fbbab-2030-4406-bd50-5f35db27830d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:56.152354 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-530fbbab-2030-4406-bd50-5f35db27830d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:56.153060 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-530fbbab-2030-4406-bd50-5f35db27830d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:56.153606 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-530fbbab-2030-4406-bd50-5f35db27830d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:56.331183 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-530fbbab-2030-4406-bd50-5f35db27830d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:56.338883 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-530fbbab-2030-4406-bd50-5f35db27830d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1524 microversion: 2.1 time: 0.201510 Jun 10 18:10:56.349912 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1938/3954] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:56 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1524 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:56.358100 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5a7679a2-c297-4120-9636-8278e279bde9 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:56.358735 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5a7679a2-c297-4120-9636-8278e279bde9 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] [instance: b84fd25b-3629-41a1-8de6-bd43cab180ac] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:56.366062 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5a7679a2-c297-4120-9636-8278e279bde9 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:56.366520 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5a7679a2-c297-4120-9636-8278e279bde9 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:56.369070 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5a7679a2-c297-4120-9636-8278e279bde9 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:56.369070 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5a7679a2-c297-4120-9636-8278e279bde9 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:56.549153 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5a7679a2-c297-4120-9636-8278e279bde9 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:56.560609 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5a7679a2-c297-4120-9636-8278e279bde9 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:56.563031 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5a7679a2-c297-4120-9636-8278e279bde9 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:56.564807 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5a7679a2-c297-4120-9636-8278e279bde9 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] 10.222.0.35 "GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac" status: 200 len: 1358 microversion: 2.21 time: 0.213493 Jun 10 18:10:56.577913 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1939/3955] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:10:56 2022] GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:10:56.585084 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4b1ca5ed-5255-4e29-a720-709fe871254c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-479529093", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "ec033079-44eb-425d-beee-8bccdd30063c"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:10:57.054974 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-61fb7bb5-5229-476d-b66e-85ca13330375 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/8a932e43-b89d-4e0e-9927-1a9b2061c2c0" status: 200 len: 1430 microversion: 2.1 time: 11.453295 Jun 10 18:10:57.062515 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2017/3956] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:10:45 2022] GET /compute/v2.1/images/8a932e43-b89d-4e0e-9927-1a9b2061c2c0 => generated 1430 bytes in 11461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:57.078544 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b4ad1540-5bd3-473b-939b-201de8ded4c1 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c0bd4ca0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:57.126544 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-4b1ca5ed-5255-4e29-a720-709fe871254c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] validate_networks() for [('ec033079-44eb-425d-beee-8bccdd30063c', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:10:57.193564 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b4ad1540-5bd3-473b-939b-201de8ded4c1 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/8a932e43-b89d-4e0e-9927-1a9b2061c2c0" status: 200 len: 1430 microversion: 2.1 time: 0.129525 Jun 10 18:10:57.202312 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2018/3957] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:10:57 2022] GET /compute/v2.1/images/8a932e43-b89d-4e0e-9927-1a9b2061c2c0 => generated 1430 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:57.210205 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-08c74df6-18fc-4bb3-894c-8e2077fb1f51 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:57.211124 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-08c74df6-18fc-4bb3-894c-8e2077fb1f51 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] [instance: b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:57.221216 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-08c74df6-18fc-4bb3-894c-8e2077fb1f51 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:57.221960 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-08c74df6-18fc-4bb3-894c-8e2077fb1f51 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:57.222777 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-08c74df6-18fc-4bb3-894c-8e2077fb1f51 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:57.223274 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-08c74df6-18fc-4bb3-894c-8e2077fb1f51 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:57.444295 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-08c74df6-18fc-4bb3-894c-8e2077fb1f51 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03179d7b781041f0988b9d1e00bd0963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d33177df0b44227bfaa8be53d56d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:57.456080 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-08c74df6-18fc-4bb3-894c-8e2077fb1f51 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] 10.222.0.35 "GET /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1" status: 200 len: 1534 microversion: 2.1 time: 0.250065 Jun 10 18:10:57.460140 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2019/3958] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:57 2022] GET /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 => generated 1534 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:57.476403 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3f1f574f-0d99-4ee4-8cf8-d175eb2304bf tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:57.479959 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3f1f574f-0d99-4ee4-8cf8-d175eb2304bf tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] [instance: 911b33c1-545d-4bcb-9ca1-c42c7bda606b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:57.486665 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f1f574f-0d99-4ee4-8cf8-d175eb2304bf tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:57.487488 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f1f574f-0d99-4ee4-8cf8-d175eb2304bf tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:57.488531 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f1f574f-0d99-4ee4-8cf8-d175eb2304bf tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:57.489187 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f1f574f-0d99-4ee4-8cf8-d175eb2304bf tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:57.735490 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3f1f574f-0d99-4ee4-8cf8-d175eb2304bf tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc673eee8339438cbb69ac8bc8df633e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38326c7c8786498a94e003d80740c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:57.748078 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3f1f574f-0d99-4ee4-8cf8-d175eb2304bf tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b" status: 200 len: 1480 microversion: 2.1 time: 0.285002 Jun 10 18:10:57.749667 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2020/3959] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:57 2022] GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b => generated 1480 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:57.755366 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-64b5a4f5-9fc7-4494-a1c0-801772fa2b53 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:57.756247 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-64b5a4f5-9fc7-4494-a1c0-801772fa2b53 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:57.766202 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-64b5a4f5-9fc7-4494-a1c0-801772fa2b53 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:57.766887 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-64b5a4f5-9fc7-4494-a1c0-801772fa2b53 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:57.770300 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-64b5a4f5-9fc7-4494-a1c0-801772fa2b53 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:57.771006 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-64b5a4f5-9fc7-4494-a1c0-801772fa2b53 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:58.009506 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-64b5a4f5-9fc7-4494-a1c0-801772fa2b53 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:58.011475 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-4b1ca5ed-5255-4e29-a720-709fe871254c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:10:58.011958 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-4b1ca5ed-5255-4e29-a720-709fe871254c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:10:58.012492 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-4b1ca5ed-5255-4e29-a720-709fe871254c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:10:58.012963 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-4b1ca5ed-5255-4e29-a720-709fe871254c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:10:58.013384 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-4b1ca5ed-5255-4e29-a720-709fe871254c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:10:58.022783 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-64b5a4f5-9fc7-4494-a1c0-801772fa2b53 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1524 microversion: 2.1 time: 0.271801 Jun 10 18:10:58.024443 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2021/3960] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:57 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1524 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:58.030502 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d85679f8-62fb-4574-9ebf-68b90929c46b tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:58.031352 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d85679f8-62fb-4574-9ebf-68b90929c46b tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] [instance: b84fd25b-3629-41a1-8de6-bd43cab180ac] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:58.032048 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4b1ca5ed-5255-4e29-a720-709fe871254c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:58.032581 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4b1ca5ed-5255-4e29-a720-709fe871254c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:58.033394 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4b1ca5ed-5255-4e29-a720-709fe871254c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:58.041740 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4b1ca5ed-5255-4e29-a720-709fe871254c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:58.041925 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d85679f8-62fb-4574-9ebf-68b90929c46b tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:58.041925 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d85679f8-62fb-4574-9ebf-68b90929c46b tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:58.041925 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d85679f8-62fb-4574-9ebf-68b90929c46b tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:58.042747 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d85679f8-62fb-4574-9ebf-68b90929c46b tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:58.091828 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-4b1ca5ed-5255-4e29-a720-709fe871254c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Getting quotas for project 1089f87ad8fc4f1ca82ee23dfd567b1b. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:10:58.103176 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-4b1ca5ed-5255-4e29-a720-709fe871254c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Getting quotas for user 3824b7a76a5641b7b6f338ee052f6e94 and project 1089f87ad8fc4f1ca82ee23dfd567b1b. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:10:58.167121 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4b1ca5ed-5255-4e29-a720-709fe871254c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:10:58.178508 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4b1ca5ed-5255-4e29-a720-709fe871254c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 74e411c5-d389-4307-99fd-a6cf439f1c61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:10:58.332891 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d85679f8-62fb-4574-9ebf-68b90929c46b tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:58.349959 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d85679f8-62fb-4574-9ebf-68b90929c46b tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:58.351490 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d85679f8-62fb-4574-9ebf-68b90929c46b tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:58.355335 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d85679f8-62fb-4574-9ebf-68b90929c46b tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] 10.222.0.35 "GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac" status: 200 len: 1358 microversion: 2.21 time: 0.329067 Jun 10 18:10:58.355917 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2022/3961] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:10:58 2022] GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac => generated 1358 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:10:58.447075 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4b1ca5ed-5255-4e29-a720-709fe871254c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.867361 Jun 10 18:10:58.464675 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1940/3962] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:10:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:10:58.475838 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-96e07a1a-4911-4f7a-acb1-20eab2d6793e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:58.476490 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-96e07a1a-4911-4f7a-acb1-20eab2d6793e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 74e411c5-d389-4307-99fd-a6cf439f1c61] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:58.479471 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f57f5939-30be-46c5-b455-fe82bfab24d8 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:58.480117 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f57f5939-30be-46c5-b455-fe82bfab24d8 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] [instance: b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:58.498788 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f57f5939-30be-46c5-b455-fe82bfab24d8 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:58.501361 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f57f5939-30be-46c5-b455-fe82bfab24d8 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:58.504547 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f57f5939-30be-46c5-b455-fe82bfab24d8 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:58.505248 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f57f5939-30be-46c5-b455-fe82bfab24d8 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:58.642568 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-96e07a1a-4911-4f7a-acb1-20eab2d6793e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:58.651466 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-96e07a1a-4911-4f7a-acb1-20eab2d6793e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61" status: 200 len: 1216 microversion: 2.1 time: 0.180600 Jun 10 18:10:58.660704 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2023/3963] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:58 2022] GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61 => generated 1216 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:58.700050 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-de536fc0-4f7f-45f0-a09c-b6cf88e9925b req-5e153903-a502-4c8b-9850-e01d36eba07f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1", "name": "network-vif-deleted", "tag": "ce89b606-ef43-411a-b6ad-cc5361e810f9"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:10:58.716296 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f57f5939-30be-46c5-b455-fe82bfab24d8 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03179d7b781041f0988b9d1e00bd0963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d33177df0b44227bfaa8be53d56d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:58.725274 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-de536fc0-4f7f-45f0-a09c-b6cf88e9925b req-5e153903-a502-4c8b-9850-e01d36eba07f service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:58.726438 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-de536fc0-4f7f-45f0-a09c-b6cf88e9925b req-5e153903-a502-4c8b-9850-e01d36eba07f service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:58.728967 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f57f5939-30be-46c5-b455-fe82bfab24d8 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] 10.222.0.35 "GET /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1" status: 200 len: 1492 microversion: 2.1 time: 0.253125 Jun 10 18:10:58.745036 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1941/3964] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:58 2022] GET /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 => generated 1492 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:58.755196 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-de536fc0-4f7f-45f0-a09c-b6cf88e9925b req-5e153903-a502-4c8b-9850-e01d36eba07f service nova] Creating event network-vif-deleted:ce89b606-ef43-411a-b6ad-cc5361e810f9 for instance b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 on chh1-master-2 Jun 10 18:10:58.770113 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ee6f65a8-38e1-46a3-8ed8-b341b7ac4c21 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:58.770875 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ee6f65a8-38e1-46a3-8ed8-b341b7ac4c21 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] [instance: 911b33c1-545d-4bcb-9ca1-c42c7bda606b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:58.772803 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-de536fc0-4f7f-45f0-a09c-b6cf88e9925b req-5e153903-a502-4c8b-9850-e01d36eba07f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077571 Jun 10 18:10:58.776156 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2024/3965] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:10:58.781409 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee6f65a8-38e1-46a3-8ed8-b341b7ac4c21 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:58.784993 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee6f65a8-38e1-46a3-8ed8-b341b7ac4c21 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:58.786418 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee6f65a8-38e1-46a3-8ed8-b341b7ac4c21 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:58.788043 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee6f65a8-38e1-46a3-8ed8-b341b7ac4c21 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:59.048482 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f83ee9f2-eca9-41ab-b661-df7760b8097d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:59.049935 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f83ee9f2-eca9-41ab-b661-df7760b8097d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:59.059455 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f83ee9f2-eca9-41ab-b661-df7760b8097d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:59.087903 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f83ee9f2-eca9-41ab-b661-df7760b8097d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:59.089224 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f83ee9f2-eca9-41ab-b661-df7760b8097d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:59.089676 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f83ee9f2-eca9-41ab-b661-df7760b8097d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:59.134952 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ee6f65a8-38e1-46a3-8ed8-b341b7ac4c21 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc673eee8339438cbb69ac8bc8df633e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38326c7c8786498a94e003d80740c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:59.152608 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ee6f65a8-38e1-46a3-8ed8-b341b7ac4c21 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b" status: 200 len: 1467 microversion: 2.1 time: 0.390033 Jun 10 18:10:59.155446 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1942/3966] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:58 2022] GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b => generated 1467 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:10:59.177140 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-82d4b257-2ef9-45fa-b0ba-6f08cc18372b tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c005f160>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:59.271334 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-82d4b257-2ef9-45fa-b0ba-6f08cc18372b tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8" status: 200 len: 784 microversion: 2.1 time: 0.098666 Jun 10 18:10:59.272523 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1943/3967] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:10:59 2022] GET /compute/v2.1/images/efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8 => generated 784 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:10:59.283955 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8648a1f3-d615-422f-b9ed-5ace1916722f tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:59.310003 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8648a1f3-d615-422f-b9ed-5ace1916722f tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030238 Jun 10 18:10:59.316144 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1944/3968] 10.222.0.35 () {58 vars in 1136 bytes} [Fri Jun 10 18:10:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:10:59.336409 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-99d33ad6-a3d6-4c1a-8192-f322a7a782f2 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77b3ff6670>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:59.443084 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f83ee9f2-eca9-41ab-b661-df7760b8097d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:59.455872 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f83ee9f2-eca9-41ab-b661-df7760b8097d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1524 microversion: 2.1 time: 0.419378 Jun 10 18:10:59.473249 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2025/3969] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:59 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1524 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:59.476136 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f4e544ce-8d98-4634-915e-570724475f8c tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:59.480755 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f4e544ce-8d98-4634-915e-570724475f8c tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] [instance: b84fd25b-3629-41a1-8de6-bd43cab180ac] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:59.495651 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4e544ce-8d98-4634-915e-570724475f8c tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:59.498027 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4e544ce-8d98-4634-915e-570724475f8c tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:59.500940 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4e544ce-8d98-4634-915e-570724475f8c tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:10:59.501649 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4e544ce-8d98-4634-915e-570724475f8c tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:10:59.802757 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f4e544ce-8d98-4634-915e-570724475f8c tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:59.813378 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f4e544ce-8d98-4634-915e-570724475f8c tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:59.815374 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f4e544ce-8d98-4634-915e-570724475f8c tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:59.816686 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f4e544ce-8d98-4634-915e-570724475f8c tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] 10.222.0.35 "GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac" status: 200 len: 1550 microversion: 2.21 time: 0.345953 Jun 10 18:10:59.817603 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2026/3970] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:10:59 2022] GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac => generated 1550 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:10:59.837091 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-64e76ab1-a48b-4c63-b737-36f44ff9cfe3 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:10:59.839145 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-64e76ab1-a48b-4c63-b737-36f44ff9cfe3 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 74e411c5-d389-4307-99fd-a6cf439f1c61] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:10:59.977376 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-64e76ab1-a48b-4c63-b737-36f44ff9cfe3 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:10:59.986509 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-64e76ab1-a48b-4c63-b737-36f44ff9cfe3 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61" status: 200 len: 1216 microversion: 2.1 time: 0.167609 Jun 10 18:10:59.997456 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2027/3971] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:59 2022] GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61 => generated 1216 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:10:59.999535 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cd432c6c-60ca-4339-8b1e-c70f62b3944a tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:00.001307 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cd432c6c-60ca-4339-8b1e-c70f62b3944a tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] [instance: b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:00.012841 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cd432c6c-60ca-4339-8b1e-c70f62b3944a tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:00.013302 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cd432c6c-60ca-4339-8b1e-c70f62b3944a tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:00.014306 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cd432c6c-60ca-4339-8b1e-c70f62b3944a tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:00.014841 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cd432c6c-60ca-4339-8b1e-c70f62b3944a tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:00.074648 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cd432c6c-60ca-4339-8b1e-c70f62b3944a tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:00.075392 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cd432c6c-60ca-4339-8b1e-c70f62b3944a tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:00.075871 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-cd432c6c-60ca-4339-8b1e-c70f62b3944a tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lazy-loading 'fault' on Instance uuid b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:11:00.211552 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cd432c6c-60ca-4339-8b1e-c70f62b3944a tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03179d7b781041f0988b9d1e00bd0963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d33177df0b44227bfaa8be53d56d7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:00.220026 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cd432c6c-60ca-4339-8b1e-c70f62b3944a tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] 10.222.0.35 "GET /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1" status: 200 len: 1318 microversion: 2.1 time: 0.230680 Jun 10 18:11:00.221362 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2028/3972] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:59 2022] GET /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:00.234460 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d9cea7db-7d6b-48ed-8430-62a0cb7598ab tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:00.234973 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d9cea7db-7d6b-48ed-8430-62a0cb7598ab tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] [instance: b84fd25b-3629-41a1-8de6-bd43cab180ac] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:00.242925 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d9cea7db-7d6b-48ed-8430-62a0cb7598ab tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:00.243388 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d9cea7db-7d6b-48ed-8430-62a0cb7598ab tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:00.248157 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d9cea7db-7d6b-48ed-8430-62a0cb7598ab tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:00.257243 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d9cea7db-7d6b-48ed-8430-62a0cb7598ab tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:00.304206 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d9cea7db-7d6b-48ed-8430-62a0cb7598ab tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] [instance: b84fd25b-3629-41a1-8de6-bd43cab180ac] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:11:01.121391 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d9cea7db-7d6b-48ed-8430-62a0cb7598ab tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] 10.222.0.35 "DELETE /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac" status: 204 len: 0 microversion: 2.21 time: 0.897809 Jun 10 18:11:01.122379 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2029/3973] 10.222.0.35 () {60 vars in 1279 bytes} [Fri Jun 10 18:11:00 2022] DELETE /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac => generated 0 bytes in 900 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 10 18:11:01.128139 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-56f91edb-4477-434a-93fe-e2617b059c45 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:01.134153 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-56f91edb-4477-434a-93fe-e2617b059c45 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:01.146775 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-56f91edb-4477-434a-93fe-e2617b059c45 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:01.147504 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-56f91edb-4477-434a-93fe-e2617b059c45 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:01.148504 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-56f91edb-4477-434a-93fe-e2617b059c45 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:01.149238 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-56f91edb-4477-434a-93fe-e2617b059c45 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:01.361843 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-56f91edb-4477-434a-93fe-e2617b059c45 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:01.372708 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-56f91edb-4477-434a-93fe-e2617b059c45 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1524 microversion: 2.1 time: 0.248819 Jun 10 18:11:01.373604 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2030/3974] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:01 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1524 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:01.389640 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7ff2e4b9-5320-4fd8-b023-69ab9d91bf3f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:01.392246 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7ff2e4b9-5320-4fd8-b023-69ab9d91bf3f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 74e411c5-d389-4307-99fd-a6cf439f1c61] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:01.403232 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ff2e4b9-5320-4fd8-b023-69ab9d91bf3f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:01.403905 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ff2e4b9-5320-4fd8-b023-69ab9d91bf3f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:01.405181 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ff2e4b9-5320-4fd8-b023-69ab9d91bf3f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:01.405826 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ff2e4b9-5320-4fd8-b023-69ab9d91bf3f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:01.537963 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7ff2e4b9-5320-4fd8-b023-69ab9d91bf3f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:01.551593 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7ff2e4b9-5320-4fd8-b023-69ab9d91bf3f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61" status: 200 len: 1268 microversion: 2.1 time: 0.166170 Jun 10 18:11:01.553091 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2031/3975] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:01 2022] GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61 => generated 1268 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:01.567775 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f9cdeb3c-18e9-41b3-8945-ee73b963ff8a tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:01.569587 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f9cdeb3c-18e9-41b3-8945-ee73b963ff8a tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] [instance: b84fd25b-3629-41a1-8de6-bd43cab180ac] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:01.580471 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f9cdeb3c-18e9-41b3-8945-ee73b963ff8a tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:01.586031 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f9cdeb3c-18e9-41b3-8945-ee73b963ff8a tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:01.589401 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f9cdeb3c-18e9-41b3-8945-ee73b963ff8a tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:01.589401 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f9cdeb3c-18e9-41b3-8945-ee73b963ff8a tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:01.750803 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f9cdeb3c-18e9-41b3-8945-ee73b963ff8a tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:01.761049 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f9cdeb3c-18e9-41b3-8945-ee73b963ff8a tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:01.763128 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f9cdeb3c-18e9-41b3-8945-ee73b963ff8a tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:01.764955 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f9cdeb3c-18e9-41b3-8945-ee73b963ff8a tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] 10.222.0.35 "GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac" status: 200 len: 1556 microversion: 2.21 time: 0.210326 Jun 10 18:11:01.765736 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2032/3976] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:11:01 2022] GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac => generated 1556 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:11:01.777530 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7f263ecb-cdcf-4e20-8205-9d97ff1fe555 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:01.780660 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7f263ecb-cdcf-4e20-8205-9d97ff1fe555 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] [instance: b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:01.787359 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7f263ecb-cdcf-4e20-8205-9d97ff1fe555 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:01.787826 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7f263ecb-cdcf-4e20-8205-9d97ff1fe555 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:01.789250 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7f263ecb-cdcf-4e20-8205-9d97ff1fe555 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:01.789695 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7f263ecb-cdcf-4e20-8205-9d97ff1fe555 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:01.816440 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-7f263ecb-cdcf-4e20-8205-9d97ff1fe555 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] HTTP exception thrown: Instance b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 could not be found. Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7f263ecb-cdcf-4e20-8205-9d97ff1fe555 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Request method failure captured: Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 HTTP/1.1 Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4kQyHYx5ahVKmJdh1Kbt-On1JKJc5mL1e4BqOkiCrO6dLFTEg0zTp4b_3RXpP0FciyPNKWJlsDLkrtSBD0VYjjBQA--Q-yEXAL3xUxh0n0Rb6r07OySxp0DMyz-LboSZTNAtDiFHUlMmB7wI9DeTG_iFJOlq06WUQTD-ZQG_lsB-64 Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 4d33177df0b44227bfaa8be53d56d7a1 Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1683678204 Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/4d33177df0b44227bfaa8be53d56d7a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/4d33177df0b44227bfaa8be53d56d7a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/4d33177df0b44227bfaa8be53d56d7a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_4d33177df0b44227bfaa8be53d56d7a1", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1683678204 Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 4d33177df0b44227bfaa8be53d56d7a1 Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1683678204 Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1683678204-project Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 03179d7b781041f0988b9d1e00bd0963 Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1683678204-project Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: exception: Instance b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 could not be found. Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1'} Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 could not be found. Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 could not be found. Jun 10 18:11:01.818223 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:01.823683 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:01.823683 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:01.823683 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:01.823683 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:01.823683 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:01.823683 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:11:01.823683 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:11:01.823683 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 could not be found. Jun 10 18:11:01.823683 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:01.823683 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7f263ecb-cdcf-4e20-8205-9d97ff1fe555 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] Returning 404 to user: Instance b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:11:01.823683 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7f263ecb-cdcf-4e20-8205-9d97ff1fe555 tempest-ServersNegativeTestMultiTenantJSON-1683678204 tempest-ServersNegativeTestMultiTenantJSON-1683678204-project] 10.222.0.35 "GET /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1" status: 404 len: 111 microversion: 2.1 time: 0.050008 Jun 10 18:11:01.823683 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2033/3977] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:01 2022] GET /compute/v2.1/servers/b1d6bd2f-a1ca-4e52-a1f9-f25da3ef95f1 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:11:01.944468 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-99d33ad6-a3d6-4c1a-8192-f322a7a782f2 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "DELETE /compute/v2.1/images/8a932e43-b89d-4e0e-9927-1a9b2061c2c0" status: 204 len: 0 microversion: 2.1 time: 2.617671 Jun 10 18:11:01.944468 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1945/3978] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:10:59 2022] DELETE /compute/v2.1/images/8a932e43-b89d-4e0e-9927-1a9b2061c2c0 => generated 0 bytes in 2619 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:11:01.953957 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e988f36b-74f8-4595-8c79-d78cd9359f52 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77b3d3e3a0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:01.980553 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-e988f36b-74f8-4595-8c79-d78cd9359f52 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] HTTP exception thrown: Image not found. Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e988f36b-74f8-4595-8c79-d78cd9359f52 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Request method failure captured: Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/images/8a932e43-b89d-4e0e-9927-1a9b2061c2c0 HTTP/1.1 Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4j4MT-Z4ESW-ZHH6v8qYBfWBshBMMUFsUuM8cUmod3OeulH_mDx0ocIcUj9YyynmHF_Z5imsjOxOdJVshTHuvrNGuSN8INlqRSjbYgIb6xukMFFk0_xl3e3vNEegzqVTqoWA_QJthN3aTiAPxlMFBlUt8a1ohNMLRH_qiRTq_4U9kI Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 38326c7c8786498a94e003d80740c5cf Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ImagesOneServerTestJSON-800511224 Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/38326c7c8786498a94e003d80740c5cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/38326c7c8786498a94e003d80740c5cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/38326c7c8786498a94e003d80740c5cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_38326c7c8786498a94e003d80740c5cf", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ImagesOneServerTestJSON-800511224 Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 38326c7c8786498a94e003d80740c5cf Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-800511224 Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ImagesOneServerTestJSON-800511224-project Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: cc673eee8339438cbb69ac8bc8df633e Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ImagesOneServerTestJSON-800511224-project Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: exception: Image not found. Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '8a932e43-b89d-4e0e-9927-1a9b2061c2c0'} Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8a932e43-b89d-4e0e-9927-1a9b2061c2c0 Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 10 18:11:01.982551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8a932e43-b89d-4e0e-9927-1a9b2061c2c0 could not be found. Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e988f36b-74f8-4595-8c79-d78cd9359f52 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Returning 404 to user: Image not found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:11:01.987427 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e988f36b-74f8-4595-8c79-d78cd9359f52 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/8a932e43-b89d-4e0e-9927-1a9b2061c2c0" status: 404 len: 62 microversion: 2.1 time: 0.037087 Jun 10 18:11:02.013071 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2034/3979] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:11:01 2022] GET /compute/v2.1/images/8a932e43-b89d-4e0e-9927-1a9b2061c2c0 => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 10 18:11:02.013268 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8b5b00e9-8875-4d5e-b39d-3d3bb42f5fbd tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1730699612"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:11:02.014635 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8b5b00e9-8875-4d5e-b39d-3d3bb42f5fbd tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] [instance: 911b33c1-545d-4bcb-9ca1-c42c7bda606b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:02.025986 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8b5b00e9-8875-4d5e-b39d-3d3bb42f5fbd tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:02.030749 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8b5b00e9-8875-4d5e-b39d-3d3bb42f5fbd tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:02.030749 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8b5b00e9-8875-4d5e-b39d-3d3bb42f5fbd tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:02.030749 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8b5b00e9-8875-4d5e-b39d-3d3bb42f5fbd tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:02.395638 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e7092e08-c8fc-4056-8e0e-9348ddedb23d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:02.407988 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e7092e08-c8fc-4056-8e0e-9348ddedb23d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:02.421586 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7092e08-c8fc-4056-8e0e-9348ddedb23d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:02.421586 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7092e08-c8fc-4056-8e0e-9348ddedb23d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:02.421826 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7092e08-c8fc-4056-8e0e-9348ddedb23d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:02.422432 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7092e08-c8fc-4056-8e0e-9348ddedb23d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:02.727934 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8b5b00e9-8875-4d5e-b39d-3d3bb42f5fbd tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "POST /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b/action" status: 202 len: 0 microversion: 2.1 time: 0.736285 Jun 10 18:11:02.733874 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1946/3980] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:11:01 2022] POST /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b/action => generated 0 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 10 18:11:02.737713 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a84070c5-dc22-4618-ab36-f6e4e1ed41df tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:02.739640 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a84070c5-dc22-4618-ab36-f6e4e1ed41df tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 74e411c5-d389-4307-99fd-a6cf439f1c61] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:02.750015 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a84070c5-dc22-4618-ab36-f6e4e1ed41df tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:02.754115 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a84070c5-dc22-4618-ab36-f6e4e1ed41df tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:02.755582 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a84070c5-dc22-4618-ab36-f6e4e1ed41df tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:02.756270 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a84070c5-dc22-4618-ab36-f6e4e1ed41df tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:02.815977 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e7092e08-c8fc-4056-8e0e-9348ddedb23d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:02.834298 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e7092e08-c8fc-4056-8e0e-9348ddedb23d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1524 microversion: 2.1 time: 0.444753 Jun 10 18:11:02.836474 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2035/3981] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:02 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1524 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:11:02.842856 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-13faa2cf-6090-4351-b4b5-b7fcd414e602 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c09ce040>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:02.917570 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-13faa2cf-6090-4351-b4b5-b7fcd414e602 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86" status: 200 len: 1427 microversion: 2.1 time: 0.078553 Jun 10 18:11:02.918296 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2036/3982] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:11:02 2022] GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86 => generated 1427 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:02.931277 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e567037f-24c6-44a2-b11c-cfdb718b8f17 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:02.932089 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e567037f-24c6-44a2-b11c-cfdb718b8f17 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] [instance: b84fd25b-3629-41a1-8de6-bd43cab180ac] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:02.940317 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e567037f-24c6-44a2-b11c-cfdb718b8f17 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:02.940873 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e567037f-24c6-44a2-b11c-cfdb718b8f17 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:02.941929 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e567037f-24c6-44a2-b11c-cfdb718b8f17 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:02.942462 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e567037f-24c6-44a2-b11c-cfdb718b8f17 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:02.953007 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a84070c5-dc22-4618-ab36-f6e4e1ed41df tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:02.972728 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a84070c5-dc22-4618-ab36-f6e4e1ed41df tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61" status: 200 len: 1286 microversion: 2.1 time: 0.231252 Jun 10 18:11:02.974311 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1947/3983] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:02 2022] GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61 => generated 1286 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:02.984109 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-01f59e9a-dae1-4b34-bd35-6edb45611ebc tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:02.984655 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-01f59e9a-dae1-4b34-bd35-6edb45611ebc tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:03.020563 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-01f59e9a-dae1-4b34-bd35-6edb45611ebc tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:03.022473 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-01f59e9a-dae1-4b34-bd35-6edb45611ebc tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:03.023555 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-01f59e9a-dae1-4b34-bd35-6edb45611ebc tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:03.024607 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-01f59e9a-dae1-4b34-bd35-6edb45611ebc tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:03.050317 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-01f59e9a-dae1-4b34-bd35-6edb45611ebc tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] HTTP exception thrown: Instance 739d282e-c869-4ebe-b4fb-7122f0070ce1 could not be found. Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-01f59e9a-dae1-4b34-bd35-6edb45611ebc tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Request method failure captured: Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1 HTTP/1.1 Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4hOdb8FyF3q0k3norSczXTwEqaGBO8Zm7LzTT8WcGhVKAxHpU8jHMhzRz1LBvuAWsiAk1ASME1luJH6w6N_uk0HJnS4QmUol5olkMHExHM_8rPH4CKVbfXIlEa-0LKLXbalhPio0_ILE_Ib0VJCDCmL6mzJO4vy_5SoqB-_90BbLV4 Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: e53380f847a949a0b61c83fc5661d236 Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2114578814 Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/e53380f847a949a0b61c83fc5661d236"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/e53380f847a949a0b61c83fc5661d236"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/e53380f847a949a0b61c83fc5661d236"}]}, {"type": "tempest-type-1142384015", "name": "tempest-service-1838487701", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_e53380f847a949a0b61c83fc5661d236", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2114578814 Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: e53380f847a949a0b61c83fc5661d236 Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2114578814 Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-AttachSCSIVolumeTestJSON-2114578814-project Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 0c4caa591fe84879a787d0601f2d8445 Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2114578814-project Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 739d282e-c869-4ebe-b4fb-7122f0070ce1 could not be found. Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '739d282e-c869-4ebe-b4fb-7122f0070ce1'} Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 739d282e-c869-4ebe-b4fb-7122f0070ce1 could not be found. Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:11:03.055376 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:11:03.061120 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 739d282e-c869-4ebe-b4fb-7122f0070ce1 could not be found. Jun 10 18:11:03.061120 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:03.061120 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:03.061120 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:03.061120 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:03.061120 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:03.061120 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:03.061120 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:11:03.061120 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:11:03.061120 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 739d282e-c869-4ebe-b4fb-7122f0070ce1 could not be found. Jun 10 18:11:03.061120 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:03.074293 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-01f59e9a-dae1-4b34-bd35-6edb45611ebc tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Returning 404 to user: Instance 739d282e-c869-4ebe-b4fb-7122f0070ce1 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:11:03.077627 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-01f59e9a-dae1-4b34-bd35-6edb45611ebc tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "DELETE /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1" status: 404 len: 111 microversion: 2.1 time: 0.102106 Jun 10 18:11:03.078368 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1948/3984] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:11:02 2022] DELETE /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:11:03.089021 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-97043769-0539-4fea-b6f7-941d1b87819e req-847524f7-1f08-41e3-9f72-a161447550d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "911b33c1-545d-4bcb-9ca1-c42c7bda606b", "name": "network-vif-unplugged", "status": "completed", "tag": "a7249e1c-d1cb-43c4-9fa6-d68705a79807"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:11:03.105604 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-97043769-0539-4fea-b6f7-941d1b87819e req-847524f7-1f08-41e3-9f72-a161447550d9 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:03.107056 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-97043769-0539-4fea-b6f7-941d1b87819e req-847524f7-1f08-41e3-9f72-a161447550d9 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:03.128542 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-97043769-0539-4fea-b6f7-941d1b87819e req-847524f7-1f08-41e3-9f72-a161447550d9 service nova] Creating event network-vif-unplugged:a7249e1c-d1cb-43c4-9fa6-d68705a79807 for instance 911b33c1-545d-4bcb-9ca1-c42c7bda606b on chh2-master-2 Jun 10 18:11:03.140600 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-97043769-0539-4fea-b6f7-941d1b87819e req-847524f7-1f08-41e3-9f72-a161447550d9 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055849 Jun 10 18:11:03.141670 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1949/3985] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:11:03.157684 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-25901f50-f2ef-482a-aae0-d7c22fd8b0e4 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:03.157684 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-25901f50-f2ef-482a-aae0-d7c22fd8b0e4 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] [instance: 739d282e-c869-4ebe-b4fb-7122f0070ce1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:03.163990 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-25901f50-f2ef-482a-aae0-d7c22fd8b0e4 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:03.164803 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-25901f50-f2ef-482a-aae0-d7c22fd8b0e4 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:03.167165 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-25901f50-f2ef-482a-aae0-d7c22fd8b0e4 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:03.167976 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-25901f50-f2ef-482a-aae0-d7c22fd8b0e4 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:03.192513 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-25901f50-f2ef-482a-aae0-d7c22fd8b0e4 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] HTTP exception thrown: Instance 739d282e-c869-4ebe-b4fb-7122f0070ce1 could not be found. Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-25901f50-f2ef-482a-aae0-d7c22fd8b0e4 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Request method failure captured: Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1 HTTP/1.1 Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4hOdb8FyF3q0k3norSczXTwEqaGBO8Zm7LzTT8WcGhVKAxHpU8jHMhzRz1LBvuAWsiAk1ASME1luJH6w6N_uk0HJnS4QmUol5olkMHExHM_8rPH4CKVbfXIlEa-0LKLXbalhPio0_ILE_Ib0VJCDCmL6mzJO4vy_5SoqB-_90BbLV4 Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: e53380f847a949a0b61c83fc5661d236 Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2114578814 Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/e53380f847a949a0b61c83fc5661d236"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/e53380f847a949a0b61c83fc5661d236"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/e53380f847a949a0b61c83fc5661d236"}]}, {"type": "tempest-type-1142384015", "name": "tempest-service-1838487701", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_e53380f847a949a0b61c83fc5661d236", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2114578814 Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: e53380f847a949a0b61c83fc5661d236 Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2114578814 Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-AttachSCSIVolumeTestJSON-2114578814-project Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 0c4caa591fe84879a787d0601f2d8445 Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2114578814-project Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 739d282e-c869-4ebe-b4fb-7122f0070ce1 could not be found. Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '739d282e-c869-4ebe-b4fb-7122f0070ce1'} Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 739d282e-c869-4ebe-b4fb-7122f0070ce1 could not be found. Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 739d282e-c869-4ebe-b4fb-7122f0070ce1 could not be found. Jun 10 18:11:03.194349 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:03.199064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:03.199064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:03.199064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:03.199064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:03.199064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:03.199064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:11:03.199064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:11:03.199064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 739d282e-c869-4ebe-b4fb-7122f0070ce1 could not be found. Jun 10 18:11:03.199064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:03.199064 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-25901f50-f2ef-482a-aae0-d7c22fd8b0e4 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] Returning 404 to user: Instance 739d282e-c869-4ebe-b4fb-7122f0070ce1 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:11:03.199064 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-25901f50-f2ef-482a-aae0-d7c22fd8b0e4 tempest-AttachSCSIVolumeTestJSON-2114578814 tempest-AttachSCSIVolumeTestJSON-2114578814-project] 10.222.0.35 "GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1" status: 404 len: 111 microversion: 2.1 time: 0.053365 Jun 10 18:11:03.203334 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1950/3986] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:03 2022] GET /compute/v2.1/servers/739d282e-c869-4ebe-b4fb-7122f0070ce1 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:11:03.486708 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e567037f-24c6-44a2-b11c-cfdb718b8f17 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:03.493103 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e567037f-24c6-44a2-b11c-cfdb718b8f17 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:03.505232 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e567037f-24c6-44a2-b11c-cfdb718b8f17 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:03.506666 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e567037f-24c6-44a2-b11c-cfdb718b8f17 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] 10.222.0.35 "GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac" status: 200 len: 1556 microversion: 2.21 time: 0.580327 Jun 10 18:11:03.518077 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2037/3987] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:11:02 2022] GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac => generated 1556 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:11:03.864691 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7c6badbf-d4f6-4154-8879-375570a9cfab tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:03.865413 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7c6badbf-d4f6-4154-8879-375570a9cfab tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:03.891477 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7c6badbf-d4f6-4154-8879-375570a9cfab tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:03.891947 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7c6badbf-d4f6-4154-8879-375570a9cfab tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:03.892773 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7c6badbf-d4f6-4154-8879-375570a9cfab tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:03.894055 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7c6badbf-d4f6-4154-8879-375570a9cfab tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:03.931185 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-92090441-73c8-4190-b009-adc1b437f58a tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c00ad310>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:03.986785 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-92090441-73c8-4190-b009-adc1b437f58a tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86" status: 200 len: 1427 microversion: 2.1 time: 0.059306 Jun 10 18:11:03.993743 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2038/3988] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:11:03 2022] GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86 => generated 1427 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:03.995672 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-12eb92aa-a107-4b1b-8b97-af789f4ee7eb tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:03.996422 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-12eb92aa-a107-4b1b-8b97-af789f4ee7eb tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 74e411c5-d389-4307-99fd-a6cf439f1c61] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:04.005941 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-12eb92aa-a107-4b1b-8b97-af789f4ee7eb tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:04.006548 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-12eb92aa-a107-4b1b-8b97-af789f4ee7eb tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:04.007903 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-12eb92aa-a107-4b1b-8b97-af789f4ee7eb tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:04.008805 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-12eb92aa-a107-4b1b-8b97-af789f4ee7eb tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:04.312675 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7c6badbf-d4f6-4154-8879-375570a9cfab tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:04.320570 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7c6badbf-d4f6-4154-8879-375570a9cfab tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1506 microversion: 2.1 time: 0.472697 Jun 10 18:11:04.324775 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1951/3989] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:03 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1506 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:04.334421 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-4a017fb2-6b27-4c88-9207-f28afc1e2364 req-250809ab-47d5-43d2-9b81-78552392ad7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b84fd25b-3629-41a1-8de6-bd43cab180ac", "name": "network-vif-deleted", "tag": "8fad7197-8cec-4ec4-b6a8-75dee09a50b1"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:11:04.340729 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:11:04.377908 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-4a017fb2-6b27-4c88-9207-f28afc1e2364 req-250809ab-47d5-43d2-9b81-78552392ad7b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:04.379276 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-4a017fb2-6b27-4c88-9207-f28afc1e2364 req-250809ab-47d5-43d2-9b81-78552392ad7b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:04.411298 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-4a017fb2-6b27-4c88-9207-f28afc1e2364 req-250809ab-47d5-43d2-9b81-78552392ad7b service nova] Creating event network-vif-deleted:8fad7197-8cec-4ec4-b6a8-75dee09a50b1 for instance b84fd25b-3629-41a1-8de6-bd43cab180ac on chh1-master-2 Jun 10 18:11:04.440780 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-4a017fb2-6b27-4c88-9207-f28afc1e2364 req-250809ab-47d5-43d2-9b81-78552392ad7b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113905 Jun 10 18:11:04.444891 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1952/3990] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:11:04.527114 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1aaadb7a-bd7e-4d5e-8b8c-3f4c42e7d3df tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:04.527986 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1aaadb7a-bd7e-4d5e-8b8c-3f4c42e7d3df tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] [instance: b84fd25b-3629-41a1-8de6-bd43cab180ac] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:04.535586 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1aaadb7a-bd7e-4d5e-8b8c-3f4c42e7d3df tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:04.536245 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1aaadb7a-bd7e-4d5e-8b8c-3f4c42e7d3df tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:04.539790 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1aaadb7a-bd7e-4d5e-8b8c-3f4c42e7d3df tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:04.539790 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1aaadb7a-bd7e-4d5e-8b8c-3f4c42e7d3df tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:04.588689 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1aaadb7a-bd7e-4d5e-8b8c-3f4c42e7d3df tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:04.589501 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1aaadb7a-bd7e-4d5e-8b8c-3f4c42e7d3df tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:04.598323 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-1aaadb7a-bd7e-4d5e-8b8c-3f4c42e7d3df tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lazy-loading 'fault' on Instance uuid b84fd25b-3629-41a1-8de6-bd43cab180ac {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:11:04.694297 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-12eb92aa-a107-4b1b-8b97-af789f4ee7eb tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:04.695816 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1aaadb7a-bd7e-4d5e-8b8c-3f4c42e7d3df tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:04.707530 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:11:04.711270 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-12eb92aa-a107-4b1b-8b97-af789f4ee7eb tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61" status: 200 len: 1316 microversion: 2.1 time: 0.720040 Jun 10 18:11:04.716344 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1aaadb7a-bd7e-4d5e-8b8c-3f4c42e7d3df tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:04.718457 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1aaadb7a-bd7e-4d5e-8b8c-3f4c42e7d3df tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c9e71f37154b4faaa223f2f3d3645b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470806ae3004e8c8c9828a8db2f3f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:04.722372 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1aaadb7a-bd7e-4d5e-8b8c-3f4c42e7d3df tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] 10.222.0.35 "GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac" status: 200 len: 1348 microversion: 2.21 time: 0.201076 Jun 10 18:11:04.725918 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2039/3991] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:03 2022] GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61 => generated 1316 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:04.726686 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1953/3992] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:11:04 2022] GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac => generated 1348 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:11:05.002302 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-aa2a5f14-e863-4864-a499-c5a7b103a300 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c0ace8b0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:05.061860 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-aa2a5f14-e863-4864-a499-c5a7b103a300 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86" status: 200 len: 1427 microversion: 2.1 time: 0.064135 Jun 10 18:11:05.062479 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2040/3993] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:11:04 2022] GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86 => generated 1427 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:05.341023 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-71287fce-4b18-46b5-a78f-64fa959105d3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:05.342891 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-71287fce-4b18-46b5-a78f-64fa959105d3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:05.350565 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-71287fce-4b18-46b5-a78f-64fa959105d3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:05.351321 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-71287fce-4b18-46b5-a78f-64fa959105d3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:05.352086 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-71287fce-4b18-46b5-a78f-64fa959105d3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:05.352743 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-71287fce-4b18-46b5-a78f-64fa959105d3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:05.597962 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-71287fce-4b18-46b5-a78f-64fa959105d3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:05.606229 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-71287fce-4b18-46b5-a78f-64fa959105d3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1506 microversion: 2.1 time: 0.269490 Jun 10 18:11:05.606833 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1954/3994] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:05 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1506 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:05.738703 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-10a981bd-626c-4f30-8495-ad58dde79e03 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:05.740599 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-10a981bd-626c-4f30-8495-ad58dde79e03 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 74e411c5-d389-4307-99fd-a6cf439f1c61] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:05.750019 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c550eb41-7d2e-4795-a563-dbd5b9f566e3 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:05.751007 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c550eb41-7d2e-4795-a563-dbd5b9f566e3 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] [instance: b84fd25b-3629-41a1-8de6-bd43cab180ac] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:05.762975 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c550eb41-7d2e-4795-a563-dbd5b9f566e3 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:05.763736 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c550eb41-7d2e-4795-a563-dbd5b9f566e3 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:05.772611 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c550eb41-7d2e-4795-a563-dbd5b9f566e3 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:05.776840 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c550eb41-7d2e-4795-a563-dbd5b9f566e3 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:05.780740 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-10a981bd-626c-4f30-8495-ad58dde79e03 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:05.781946 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-10a981bd-626c-4f30-8495-ad58dde79e03 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:05.785178 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-10a981bd-626c-4f30-8495-ad58dde79e03 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:05.785805 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-10a981bd-626c-4f30-8495-ad58dde79e03 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:05.838961 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-c550eb41-7d2e-4795-a563-dbd5b9f566e3 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] HTTP exception thrown: Instance b84fd25b-3629-41a1-8de6-bd43cab180ac could not be found. Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c550eb41-7d2e-4795-a563-dbd5b9f566e3 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Request method failure captured: Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac HTTP/1.1 Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4kZA7hx_JU51xFtiopu5sGvy15nVimOMkCOf-ANpFYMsJODS96EOzoiolzsfoWS5bN2hEWi9p6DR-0LnmcFqONYyhdCZKP-pHGFOw0tRd6kUEedZUv7zDe3LDcxHpIr7qKcMTcZj5UpBGG5zUt94wIhgxH8EFuXda2Hpo0qEYaEjCg Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: X-Openstack-Nova-Api-Version: 2.21 Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: c470806ae3004e8c8c9828a8db2f3f7b Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1173220135 Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/c470806ae3004e8c8c9828a8db2f3f7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c470806ae3004e8c8c9828a8db2f3f7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c470806ae3004e8c8c9828a8db2f3f7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_c470806ae3004e8c8c9828a8db2f3f7b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-InstanceActionsV221TestJSON-1173220135 Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: c470806ae3004e8c8c9828a8db2f3f7b Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1173220135 Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-InstanceActionsV221TestJSON-1173220135-project Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 92c9e71f37154b4faaa223f2f3d3645b Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-InstanceActionsV221TestJSON-1173220135-project Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: exception: Instance b84fd25b-3629-41a1-8de6-bd43cab180ac could not be found. Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'b84fd25b-3629-41a1-8de6-bd43cab180ac'} Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b84fd25b-3629-41a1-8de6-bd43cab180ac could not be found. Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b84fd25b-3629-41a1-8de6-bd43cab180ac could not be found. Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:05.842298 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:05.848124 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:05.848124 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:05.848124 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:05.848124 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:05.848124 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:11:05.848124 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:11:05.848124 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b84fd25b-3629-41a1-8de6-bd43cab180ac could not be found. Jun 10 18:11:05.848124 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:05.852701 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c550eb41-7d2e-4795-a563-dbd5b9f566e3 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Returning 404 to user: Instance b84fd25b-3629-41a1-8de6-bd43cab180ac could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:11:05.858282 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c550eb41-7d2e-4795-a563-dbd5b9f566e3 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] 10.222.0.35 "GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac" status: 404 len: 111 microversion: 2.21 time: 0.109504 Jun 10 18:11:05.863029 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1955/3995] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:11:05 2022] GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:11:05.876102 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-da1b5d68-3b3b-4f04-b1be-74d414c54a75 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Calling method '.version_select at 0x7f77c0099040>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:05.884192 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-da1b5d68-3b3b-4f04-b1be-74d414c54a75 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] [instance: b84fd25b-3629-41a1-8de6-bd43cab180ac] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:05.891319 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-da1b5d68-3b3b-4f04-b1be-74d414c54a75 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:05.891793 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-da1b5d68-3b3b-4f04-b1be-74d414c54a75 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:05.892570 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-da1b5d68-3b3b-4f04-b1be-74d414c54a75 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:05.893255 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-da1b5d68-3b3b-4f04-b1be-74d414c54a75 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:05.968373 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-da1b5d68-3b3b-4f04-b1be-74d414c54a75 tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] 10.222.0.35 "GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.102583 Jun 10 18:11:05.969129 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1956/3996] 10.222.0.35 () {60 vars in 1336 bytes} [Fri Jun 10 18:11:05 2022] GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac/os-instance-actions => generated 611 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:11:05.985854 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-961e112f-f559-485c-a837-fa63a0d366fc tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:05.986556 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-961e112f-f559-485c-a837-fa63a0d366fc tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] [instance: b84fd25b-3629-41a1-8de6-bd43cab180ac] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:05.993258 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-961e112f-f559-485c-a837-fa63a0d366fc tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:05.993710 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-961e112f-f559-485c-a837-fa63a0d366fc tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:05.998493 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-961e112f-f559-485c-a837-fa63a0d366fc tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:05.998493 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-961e112f-f559-485c-a837-fa63a0d366fc tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:06.013084 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-961e112f-f559-485c-a837-fa63a0d366fc tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] HTTP exception thrown: Instance b84fd25b-3629-41a1-8de6-bd43cab180ac could not be found. Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-961e112f-f559-485c-a837-fa63a0d366fc tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Request method failure captured: Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac HTTP/1.1 Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4kZA7hx_JU51xFtiopu5sGvy15nVimOMkCOf-ANpFYMsJODS96EOzoiolzsfoWS5bN2hEWi9p6DR-0LnmcFqONYyhdCZKP-pHGFOw0tRd6kUEedZUv7zDe3LDcxHpIr7qKcMTcZj5UpBGG5zUt94wIhgxH8EFuXda2Hpo0qEYaEjCg Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: X-Openstack-Nova-Api-Version: 2.21 Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: c470806ae3004e8c8c9828a8db2f3f7b Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1173220135 Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/c470806ae3004e8c8c9828a8db2f3f7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c470806ae3004e8c8c9828a8db2f3f7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c470806ae3004e8c8c9828a8db2f3f7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_c470806ae3004e8c8c9828a8db2f3f7b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-InstanceActionsV221TestJSON-1173220135 Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: c470806ae3004e8c8c9828a8db2f3f7b Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1173220135 Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-InstanceActionsV221TestJSON-1173220135-project Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 92c9e71f37154b4faaa223f2f3d3645b Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-InstanceActionsV221TestJSON-1173220135-project Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: exception: Instance b84fd25b-3629-41a1-8de6-bd43cab180ac could not be found. Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'b84fd25b-3629-41a1-8de6-bd43cab180ac'} Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b84fd25b-3629-41a1-8de6-bd43cab180ac could not be found. Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:11:06.015153 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:11:06.019792 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b84fd25b-3629-41a1-8de6-bd43cab180ac could not be found. Jun 10 18:11:06.019792 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:06.019792 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:06.019792 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:06.019792 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:06.019792 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:06.019792 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:06.019792 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:11:06.019792 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:11:06.019792 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b84fd25b-3629-41a1-8de6-bd43cab180ac could not be found. Jun 10 18:11:06.019792 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:06.020619 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-10a981bd-626c-4f30-8495-ad58dde79e03 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:06.021961 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-961e112f-f559-485c-a837-fa63a0d366fc tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Returning 404 to user: Instance b84fd25b-3629-41a1-8de6-bd43cab180ac could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:11:06.023889 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-961e112f-f559-485c-a837-fa63a0d366fc tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] 10.222.0.35 "DELETE /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac" status: 404 len: 111 microversion: 2.21 time: 0.042905 Jun 10 18:11:06.024922 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1957/3997] 10.222.0.35 () {60 vars in 1279 bytes} [Fri Jun 10 18:11:05 2022] DELETE /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 10 18:11:06.030882 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-10a981bd-626c-4f30-8495-ad58dde79e03 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61" status: 200 len: 1316 microversion: 2.1 time: 0.298637 Jun 10 18:11:06.031537 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2041/3998] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:05 2022] GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61 => generated 1316 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:06.036213 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b23407a5-b42a-400e-ab55-90101d21a54e tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:06.037291 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b23407a5-b42a-400e-ab55-90101d21a54e tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] [instance: b84fd25b-3629-41a1-8de6-bd43cab180ac] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:06.059208 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b23407a5-b42a-400e-ab55-90101d21a54e tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:06.064079 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b23407a5-b42a-400e-ab55-90101d21a54e tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:06.067077 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b23407a5-b42a-400e-ab55-90101d21a54e tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:06.068631 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b23407a5-b42a-400e-ab55-90101d21a54e tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:06.077694 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3cd96141-b7fb-4273-a829-dec493bfe893 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c08e8790>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:06.108728 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-b23407a5-b42a-400e-ab55-90101d21a54e tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] HTTP exception thrown: Instance b84fd25b-3629-41a1-8de6-bd43cab180ac could not be found. Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b23407a5-b42a-400e-ab55-90101d21a54e tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Request method failure captured: Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac HTTP/1.1 Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4kZA7hx_JU51xFtiopu5sGvy15nVimOMkCOf-ANpFYMsJODS96EOzoiolzsfoWS5bN2hEWi9p6DR-0LnmcFqONYyhdCZKP-pHGFOw0tRd6kUEedZUv7zDe3LDcxHpIr7qKcMTcZj5UpBGG5zUt94wIhgxH8EFuXda2Hpo0qEYaEjCg Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: X-Openstack-Nova-Api-Version: 2.21 Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: c470806ae3004e8c8c9828a8db2f3f7b Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1173220135 Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/c470806ae3004e8c8c9828a8db2f3f7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c470806ae3004e8c8c9828a8db2f3f7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c470806ae3004e8c8c9828a8db2f3f7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_c470806ae3004e8c8c9828a8db2f3f7b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-InstanceActionsV221TestJSON-1173220135 Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: c470806ae3004e8c8c9828a8db2f3f7b Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1173220135 Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-InstanceActionsV221TestJSON-1173220135-project Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 92c9e71f37154b4faaa223f2f3d3645b Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-InstanceActionsV221TestJSON-1173220135-project Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: exception: Instance b84fd25b-3629-41a1-8de6-bd43cab180ac could not be found. Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'b84fd25b-3629-41a1-8de6-bd43cab180ac'} Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b84fd25b-3629-41a1-8de6-bd43cab180ac could not be found. Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b84fd25b-3629-41a1-8de6-bd43cab180ac could not be found. Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:06.116475 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:06.121761 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:06.121761 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:06.121761 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:06.121761 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:06.121761 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:11:06.121761 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:11:06.121761 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b84fd25b-3629-41a1-8de6-bd43cab180ac could not be found. Jun 10 18:11:06.121761 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:06.124383 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b23407a5-b42a-400e-ab55-90101d21a54e tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] Returning 404 to user: Instance b84fd25b-3629-41a1-8de6-bd43cab180ac could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:11:06.125424 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b23407a5-b42a-400e-ab55-90101d21a54e tempest-InstanceActionsV221TestJSON-1173220135 tempest-InstanceActionsV221TestJSON-1173220135-project] 10.222.0.35 "GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac" status: 404 len: 111 microversion: 2.21 time: 0.094228 Jun 10 18:11:06.129548 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1958/3999] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:11:06 2022] GET /compute/v2.1/servers/b84fd25b-3629-41a1-8de6-bd43cab180ac => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:11:06.147200 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3cd96141-b7fb-4273-a829-dec493bfe893 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86" status: 200 len: 1427 microversion: 2.1 time: 0.075361 Jun 10 18:11:06.153848 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2042/4000] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:11:06 2022] GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86 => generated 1427 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:11:06.251982 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-c9775599-941d-486f-849f-42971a2f6b8c req-a769b7af-b292-4727-bd9e-53edc6fa1c4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74e411c5-d389-4307-99fd-a6cf439f1c61", "tag": "6ffbd004-8c63-480b-bbd0-9d5aa48fd2b2"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:11:06.261478 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-c9775599-941d-486f-849f-42971a2f6b8c req-a769b7af-b292-4727-bd9e-53edc6fa1c4a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:06.262224 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-c9775599-941d-486f-849f-42971a2f6b8c req-a769b7af-b292-4727-bd9e-53edc6fa1c4a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:06.276394 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-c9775599-941d-486f-849f-42971a2f6b8c req-a769b7af-b292-4727-bd9e-53edc6fa1c4a service nova] Creating event network-changed:6ffbd004-8c63-480b-bbd0-9d5aa48fd2b2 for instance 74e411c5-d389-4307-99fd-a6cf439f1c61 on chh2-master-2 Jun 10 18:11:06.282589 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-c9775599-941d-486f-849f-42971a2f6b8c req-a769b7af-b292-4727-bd9e-53edc6fa1c4a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034177 Jun 10 18:11:06.284023 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1959/4001] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:11:06.626196 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7114c8b6-f4ff-467f-9696-e82f05beb537 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:06.628078 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7114c8b6-f4ff-467f-9696-e82f05beb537 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:06.655872 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7114c8b6-f4ff-467f-9696-e82f05beb537 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:06.660112 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7114c8b6-f4ff-467f-9696-e82f05beb537 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:06.667143 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7114c8b6-f4ff-467f-9696-e82f05beb537 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:06.667143 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7114c8b6-f4ff-467f-9696-e82f05beb537 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:06.930485 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-1e2717d1-6b19-47ff-af58-ae3d2f41aad8 req-38e0a4dc-ffab-49c1-b7de-6cdac24eec5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d514aab-bc5c-462a-a759-6182effadcbe", "name": "network-vif-unplugged", "status": "completed", "tag": "c91bc6bc-9338-4e16-af93-6a63229f16dd"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:11:06.946136 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-1e2717d1-6b19-47ff-af58-ae3d2f41aad8 req-38e0a4dc-ffab-49c1-b7de-6cdac24eec5c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:06.946635 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-1e2717d1-6b19-47ff-af58-ae3d2f41aad8 req-38e0a4dc-ffab-49c1-b7de-6cdac24eec5c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:06.971274 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-1e2717d1-6b19-47ff-af58-ae3d2f41aad8 req-38e0a4dc-ffab-49c1-b7de-6cdac24eec5c service nova] Creating event network-vif-unplugged:c91bc6bc-9338-4e16-af93-6a63229f16dd for instance 7d514aab-bc5c-462a-a759-6182effadcbe on chh2-master-2 Jun 10 18:11:06.985044 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-1e2717d1-6b19-47ff-af58-ae3d2f41aad8 req-38e0a4dc-ffab-49c1-b7de-6cdac24eec5c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058722 Jun 10 18:11:06.988157 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1960/4002] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:11:07.025785 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7114c8b6-f4ff-467f-9696-e82f05beb537 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:07.057671 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7114c8b6-f4ff-467f-9696-e82f05beb537 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1506 microversion: 2.1 time: 0.438267 Jun 10 18:11:07.059905 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2043/4003] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:06 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1506 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:07.062651 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5bd9d7e6-72e5-419e-ba48-4490e63ff9ae tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:07.064206 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5bd9d7e6-72e5-419e-ba48-4490e63ff9ae tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 74e411c5-d389-4307-99fd-a6cf439f1c61] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:07.100133 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5bd9d7e6-72e5-419e-ba48-4490e63ff9ae tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:07.100812 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5bd9d7e6-72e5-419e-ba48-4490e63ff9ae tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:07.101799 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5bd9d7e6-72e5-419e-ba48-4490e63ff9ae tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:07.102410 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5bd9d7e6-72e5-419e-ba48-4490e63ff9ae tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:07.162190 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c8fa6936-c098-4ae3-ac27-feb1be26a25c tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c0bd4ca0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:07.246636 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c8fa6936-c098-4ae3-ac27-feb1be26a25c tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86" status: 200 len: 1427 microversion: 2.1 time: 0.089437 Jun 10 18:11:07.247260 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2044/4004] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:11:07 2022] GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86 => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:07.523507 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5bd9d7e6-72e5-419e-ba48-4490e63ff9ae tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:07.538119 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5bd9d7e6-72e5-419e-ba48-4490e63ff9ae tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61" status: 200 len: 1316 microversion: 2.1 time: 0.486921 Jun 10 18:11:07.540599 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1961/4005] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:07 2022] GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61 => generated 1316 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:08.077286 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-99dd7a4e-d043-48b6-8280-17e70cedd71a tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:08.077921 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-99dd7a4e-d043-48b6-8280-17e70cedd71a tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:08.090852 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-99dd7a4e-d043-48b6-8280-17e70cedd71a tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:08.102952 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-99dd7a4e-d043-48b6-8280-17e70cedd71a tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:08.102952 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-99dd7a4e-d043-48b6-8280-17e70cedd71a tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:08.102952 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-99dd7a4e-d043-48b6-8280-17e70cedd71a tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:08.260863 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-249b57e4-9a88-4a3f-ab20-8a80f7ea4821 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77b3ff6670>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:08.268383 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:11:08.274538 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=6 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:11:08.345167 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-99dd7a4e-d043-48b6-8280-17e70cedd71a tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:08.365783 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-249b57e4-9a88-4a3f-ab20-8a80f7ea4821 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86" status: 200 len: 1427 microversion: 2.1 time: 0.109616 Jun 10 18:11:08.366379 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1962/4006] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:11:08 2022] GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86 => generated 1427 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:08.367338 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-99dd7a4e-d043-48b6-8280-17e70cedd71a tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 200 len: 1449 microversion: 2.1 time: 0.295669 Jun 10 18:11:08.369284 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2045/4007] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:08 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 1449 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:08.396854 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4f268b64-aff1-4bb2-beb2-dd9471679bfd tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:08.397613 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4f268b64-aff1-4bb2-beb2-dd9471679bfd tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:08.409177 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f268b64-aff1-4bb2-beb2-dd9471679bfd tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:08.409650 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f268b64-aff1-4bb2-beb2-dd9471679bfd tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:08.410439 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f268b64-aff1-4bb2-beb2-dd9471679bfd tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:08.410881 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f268b64-aff1-4bb2-beb2-dd9471679bfd tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:08.436008 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:11:08.711004 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4f268b64-aff1-4bb2-beb2-dd9471679bfd tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:11:08.711004 chdv-master-2 devstack@n-api.service[126595]: INFO nova.compute.api [None req-4f268b64-aff1-4bb2-beb2-dd9471679bfd tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Working on deleting snapshot 9a113f9e-61e5-4eb2-a755-6cfdf5682d78 from shelved instance... Jun 10 18:11:08.715959 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-64f1e263-a199-49f2-9485-b94c70d8788a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:08.715959 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-64f1e263-a199-49f2-9485-b94c70d8788a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 74e411c5-d389-4307-99fd-a6cf439f1c61] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:08.715959 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-64f1e263-a199-49f2-9485-b94c70d8788a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:08.715959 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-64f1e263-a199-49f2-9485-b94c70d8788a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:08.715959 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-64f1e263-a199-49f2-9485-b94c70d8788a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:08.715959 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-64f1e263-a199-49f2-9485-b94c70d8788a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:08.745195 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-64f1e263-a199-49f2-9485-b94c70d8788a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:08.756877 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-64f1e263-a199-49f2-9485-b94c70d8788a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61" status: 200 len: 1316 microversion: 2.1 time: 0.201609 Jun 10 18:11:08.757169 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2046/4008] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:08 2022] GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61 => generated 1316 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:11:09.379519 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b83a7645-c7f0-4174-b47e-51c4b66d3374 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c08f5c10>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:09.532148 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b83a7645-c7f0-4174-b47e-51c4b66d3374 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86" status: 200 len: 1427 microversion: 2.1 time: 0.154939 Jun 10 18:11:09.538314 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2047/4009] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:11:09 2022] GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86 => generated 1427 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:11:09.538314 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b83a7645-c7f0-4174-b47e-51c4b66d3374 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:09.538314 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b83a7645-c7f0-4174-b47e-51c4b66d3374 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001719 Jun 10 18:11:09.538314 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2048/4010] 10.222.0.35 () {56 vars in 885 bytes} [Fri Jun 10 18:11:09 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jun 10 18:11:09.545890 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b83a7645-c7f0-4174-b47e-51c4b66d3374 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:09.548007 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b83a7645-c7f0-4174-b47e-51c4b66d3374 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002695 Jun 10 18:11:09.552344 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2049/4011] 10.222.0.35 () {54 vars in 1034 bytes} [Fri Jun 10 18:11:09 2022] GET /compute/v2/ => generated 379 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Jun 10 18:11:09.571306 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b83a7645-c7f0-4174-b47e-51c4b66d3374 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:09.572718 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b83a7645-c7f0-4174-b47e-51c4b66d3374 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001780 Jun 10 18:11:09.573170 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2050/4012] 10.222.0.35 () {54 vars in 1040 bytes} [Fri Jun 10 18:11:09 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:11:09.586774 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b83a7645-c7f0-4174-b47e-51c4b66d3374 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:09.589221 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b83a7645-c7f0-4174-b47e-51c4b66d3374 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001453 Jun 10 18:11:09.596106 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2051/4013] 10.222.0.35 () {56 vars in 885 bytes} [Fri Jun 10 18:11:09 2022] GET /compute/ => generated 377 bytes in 13 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jun 10 18:11:09.778468 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f0f9d310-9f40-4181-a6cc-07056c823581 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:09.779099 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f0f9d310-9f40-4181-a6cc-07056c823581 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 74e411c5-d389-4307-99fd-a6cf439f1c61] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:09.810867 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f0f9d310-9f40-4181-a6cc-07056c823581 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:09.811921 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f0f9d310-9f40-4181-a6cc-07056c823581 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:09.813343 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f0f9d310-9f40-4181-a6cc-07056c823581 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:09.818186 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f0f9d310-9f40-4181-a6cc-07056c823581 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:09.985757 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=4 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:11:10.062133 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f0f9d310-9f40-4181-a6cc-07056c823581 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:10.070483 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f0f9d310-9f40-4181-a6cc-07056c823581 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61" status: 200 len: 1316 microversion: 2.1 time: 0.300106 Jun 10 18:11:10.071501 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2052/4014] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:09 2022] GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61 => generated 1316 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:10.286031 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4f268b64-aff1-4bb2-beb2-dd9471679bfd tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Doing local delete in cell 0f13ffb7-1a21-4641-8558-8a89dd295960(cell1) {{(pid=126595) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 10 18:11:10.286850 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f268b64-aff1-4bb2-beb2-dd9471679bfd tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:10.287339 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f268b64-aff1-4bb2-beb2-dd9471679bfd tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:10.287770 chdv-master-2 devstack@n-api.service[126595]: INFO nova.compute.api [None req-4f268b64-aff1-4bb2-beb2-dd9471679bfd tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jun 10 18:11:10.295678 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-4f268b64-aff1-4bb2-beb2-dd9471679bfd tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] deallocate_for_instance() {{(pid=126595) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 10 18:11:10.551365 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c6979251-cf9a-4d56-85fe-66195b17f135 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c08f5c10>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:10.622576 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c6979251-cf9a-4d56-85fe-66195b17f135 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86" status: 200 len: 1427 microversion: 2.1 time: 0.080779 Jun 10 18:11:10.623635 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2053/4015] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:11:10 2022] GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86 => generated 1427 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:10.981971 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-83dbc313-9cd1-4121-98db-b97373954612 req-1089ca0e-0248-48fe-8a10-92a6db21a0d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "911b33c1-545d-4bcb-9ca1-c42c7bda606b", "name": "network-vif-plugged", "status": "completed", "tag": "a7249e1c-d1cb-43c4-9fa6-d68705a79807"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:11:10.999952 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-83dbc313-9cd1-4121-98db-b97373954612 req-1089ca0e-0248-48fe-8a10-92a6db21a0d0 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:11.001318 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-83dbc313-9cd1-4121-98db-b97373954612 req-1089ca0e-0248-48fe-8a10-92a6db21a0d0 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:11.021067 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-83dbc313-9cd1-4121-98db-b97373954612 req-1089ca0e-0248-48fe-8a10-92a6db21a0d0 service nova] Creating event network-vif-plugged:a7249e1c-d1cb-43c4-9fa6-d68705a79807 for instance 911b33c1-545d-4bcb-9ca1-c42c7bda606b on chh2-master-2 Jun 10 18:11:11.027224 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-83dbc313-9cd1-4121-98db-b97373954612 req-1089ca0e-0248-48fe-8a10-92a6db21a0d0 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050267 Jun 10 18:11:11.032962 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2054/4016] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:11:11.094636 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f077a731-f5f5-405e-a2b0-6145795fefea tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:11.096280 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f077a731-f5f5-405e-a2b0-6145795fefea tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 74e411c5-d389-4307-99fd-a6cf439f1c61] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:11.110651 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f077a731-f5f5-405e-a2b0-6145795fefea tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:11.111867 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f077a731-f5f5-405e-a2b0-6145795fefea tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:11.113160 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f077a731-f5f5-405e-a2b0-6145795fefea tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:11.113828 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f077a731-f5f5-405e-a2b0-6145795fefea tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:11.539635 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-4f268b64-aff1-4bb2-beb2-dd9471679bfd tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Updating instance_info_cache with network_info: [] {{(pid=126595) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 10 18:11:11.578993 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f077a731-f5f5-405e-a2b0-6145795fefea tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:11.589569 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f077a731-f5f5-405e-a2b0-6145795fefea tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61" status: 200 len: 1316 microversion: 2.1 time: 0.503224 Jun 10 18:11:11.590216 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2055/4017] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:11 2022] GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61 => generated 1316 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:11:11.595221 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-7a7b3600-7564-49ca-b2fa-4049d51a138a req-a42a8a31-18c6-4a36-95ea-8c4a044882a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d514aab-bc5c-462a-a759-6182effadcbe", "name": "network-vif-deleted", "tag": "c91bc6bc-9338-4e16-af93-6a63229f16dd"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:11:11.603896 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-7a7b3600-7564-49ca-b2fa-4049d51a138a req-a42a8a31-18c6-4a36-95ea-8c4a044882a2 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:11.604634 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-7a7b3600-7564-49ca-b2fa-4049d51a138a req-a42a8a31-18c6-4a36-95ea-8c4a044882a2 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:11.617730 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.compute.server_external_events [req-7a7b3600-7564-49ca-b2fa-4049d51a138a req-a42a8a31-18c6-4a36-95ea-8c4a044882a2 service nova] Unable to find a host for instance 7d514aab-bc5c-462a-a759-6182effadcbe. Dropping event network-vif-deleted {{(pid=126594) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 10 18:11:11.619331 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-7a7b3600-7564-49ca-b2fa-4049d51a138a req-a42a8a31-18c6-4a36-95ea-8c4a044882a2 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.027991 Jun 10 18:11:11.620797 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2056/4018] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 10 18:11:11.642223 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ae2bbcdf-04dc-4f01-85ec-77468300a3d1 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c0ace4c0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:11.691041 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ae2bbcdf-04dc-4f01-85ec-77468300a3d1 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86" status: 200 len: 1427 microversion: 2.1 time: 0.055409 Jun 10 18:11:11.693880 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2057/4019] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:11:11 2022] GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86 => generated 1427 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:12.609091 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ec334998-e6de-4734-a102-c960aea89f29 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:12.609755 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ec334998-e6de-4734-a102-c960aea89f29 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 74e411c5-d389-4307-99fd-a6cf439f1c61] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:12.626376 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec334998-e6de-4734-a102-c960aea89f29 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:12.627065 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec334998-e6de-4734-a102-c960aea89f29 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:12.629245 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec334998-e6de-4734-a102-c960aea89f29 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:12.632192 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec334998-e6de-4734-a102-c960aea89f29 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:12.828941 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4f268b64-aff1-4bb2-beb2-dd9471679bfd tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "DELETE /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 204 len: 0 microversion: 2.1 time: 4.441249 Jun 10 18:11:12.830429 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1963/4020] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:11:08 2022] DELETE /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 0 bytes in 4443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:11:12.838259 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b27bf807-1525-4c66-8162-6e86f1c87d77 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c00999d0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:12.893596 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ec334998-e6de-4734-a102-c960aea89f29 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:12.904878 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ec334998-e6de-4734-a102-c960aea89f29 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61" status: 200 len: 1316 microversion: 2.1 time: 0.300389 Jun 10 18:11:12.918477 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2058/4021] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:12 2022] GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61 => generated 1316 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:11:12.918477 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-21061eaa-2760-45e2-9823-f1092c46caed tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:12.918477 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-21061eaa-2760-45e2-9823-f1092c46caed tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:12.933019 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-21061eaa-2760-45e2-9823-f1092c46caed tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:12.933019 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-21061eaa-2760-45e2-9823-f1092c46caed tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:12.933019 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-21061eaa-2760-45e2-9823-f1092c46caed tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:12.933342 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b27bf807-1525-4c66-8162-6e86f1c87d77 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86" status: 200 len: 1427 microversion: 2.1 time: 0.101067 Jun 10 18:11:12.934393 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1964/4022] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:11:12 2022] GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86 => generated 1427 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:12.939837 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-21061eaa-2760-45e2-9823-f1092c46caed tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:12.957295 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-21061eaa-2760-45e2-9823-f1092c46caed tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] HTTP exception thrown: Instance 7d514aab-bc5c-462a-a759-6182effadcbe could not be found. Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-21061eaa-2760-45e2-9823-f1092c46caed tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Request method failure captured: Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe HTTP/1.1 Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4h5IGwn2s1svunn67FxK1RLA1ZXNP7yhKtLh1eaKFO5RiF1I7YeJHWcfSjdUGMBWYC3nFgfMdv1-bfem3ewEozYf-uHKxgVE7ziplyuJN8iPaP89LX8AXS1cyKZcnxByDcQMqTPs4bimJxM1lNaVEmx4VPDZsfMeZBdbBH4r5hYsr8 Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/457c4a300936498b9e8b61645e655751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "tempest-type-1142384015", "name": "tempest-service-1838487701", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_457c4a300936498b9e8b61645e655751", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 8166793f60ee479689b4a21457b71d07 Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 7d514aab-bc5c-462a-a759-6182effadcbe could not be found. Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '7d514aab-bc5c-462a-a759-6182effadcbe'} Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d514aab-bc5c-462a-a759-6182effadcbe could not be found. Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d514aab-bc5c-462a-a759-6182effadcbe could not be found. Jun 10 18:11:12.959174 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:12.964779 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:12.964779 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:12.964779 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:12.964779 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:12.964779 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:12.964779 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:11:12.964779 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:11:12.964779 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d514aab-bc5c-462a-a759-6182effadcbe could not be found. Jun 10 18:11:12.964779 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:12.964779 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-21061eaa-2760-45e2-9823-f1092c46caed tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Returning 404 to user: Instance 7d514aab-bc5c-462a-a759-6182effadcbe could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:11:12.964779 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-21061eaa-2760-45e2-9823-f1092c46caed tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 404 len: 111 microversion: 2.1 time: 0.050559 Jun 10 18:11:12.964779 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2059/4023] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:12 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:11:13.130400 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d8c0b6b4-d295-4692-a35e-243fb12bd962 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-933480758", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "edbdcc1f-fcf0-4e91-a0f9-092cebab9a40"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:11:13.211594 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-d8c0b6b4-d295-4692-a35e-243fb12bd962 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] validate_networks() for [('edbdcc1f-fcf0-4e91-a0f9-092cebab9a40', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:11:13.242931 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b3ad6a5a-924f-46d7-9708-d0282e03d79c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1543481213", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "01d41899-bf8f-45ad-9aa1-db371d9cd1c4"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:11:13.338635 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-b3ad6a5a-924f-46d7-9708-d0282e03d79c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] validate_networks() for [('01d41899-bf8f-45ad-9aa1-db371d9cd1c4', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:11:13.838441 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-d8c0b6b4-d295-4692-a35e-243fb12bd962 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:11:13.839560 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-d8c0b6b4-d295-4692-a35e-243fb12bd962 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:11:13.840667 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-d8c0b6b4-d295-4692-a35e-243fb12bd962 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:11:13.841298 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-d8c0b6b4-d295-4692-a35e-243fb12bd962 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:11:13.842189 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-d8c0b6b4-d295-4692-a35e-243fb12bd962 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:11:13.869651 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d8c0b6b4-d295-4692-a35e-243fb12bd962 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:13.870992 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d8c0b6b4-d295-4692-a35e-243fb12bd962 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:13.873329 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d8c0b6b4-d295-4692-a35e-243fb12bd962 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:13.874371 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d8c0b6b4-d295-4692-a35e-243fb12bd962 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:13.903893 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-d8c0b6b4-d295-4692-a35e-243fb12bd962 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Getting quotas for project c84d3b6f9eb74076b4c74f01fb4bd6e8. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:11:13.910218 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-d8c0b6b4-d295-4692-a35e-243fb12bd962 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Getting quotas for user b082ea4ee3dd46f29a326e0299d69583 and project c84d3b6f9eb74076b4c74f01fb4bd6e8. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:11:13.924175 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d8c0b6b4-d295-4692-a35e-243fb12bd962 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:11:13.926640 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d8c0b6b4-d295-4692-a35e-243fb12bd962 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] [instance: dc0e228e-55d2-4eaf-94fd-61213629df65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:11:14.053239 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d8c0b6b4-d295-4692-a35e-243fb12bd962 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.106500 Jun 10 18:11:14.053239 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1965/4024] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:11:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1108 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:11:14.053239 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c223a914-d033-4882-b1bb-81be7b335f53 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:14.053239 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c223a914-d033-4882-b1bb-81be7b335f53 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 74e411c5-d389-4307-99fd-a6cf439f1c61] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:14.096167 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c223a914-d033-4882-b1bb-81be7b335f53 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:14.099372 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c223a914-d033-4882-b1bb-81be7b335f53 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:14.103407 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c223a914-d033-4882-b1bb-81be7b335f53 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:14.105601 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c223a914-d033-4882-b1bb-81be7b335f53 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:14.292633 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-b3ad6a5a-924f-46d7-9708-d0282e03d79c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:11:14.293513 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-b3ad6a5a-924f-46d7-9708-d0282e03d79c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:11:14.294160 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-b3ad6a5a-924f-46d7-9708-d0282e03d79c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:11:14.294827 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-b3ad6a5a-924f-46d7-9708-d0282e03d79c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:11:14.295413 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-b3ad6a5a-924f-46d7-9708-d0282e03d79c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:11:14.317776 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b3ad6a5a-924f-46d7-9708-d0282e03d79c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:14.317776 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b3ad6a5a-924f-46d7-9708-d0282e03d79c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:14.317776 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b3ad6a5a-924f-46d7-9708-d0282e03d79c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:14.317776 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b3ad6a5a-924f-46d7-9708-d0282e03d79c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:14.335875 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-b3ad6a5a-924f-46d7-9708-d0282e03d79c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Getting quotas for project 457c4a300936498b9e8b61645e655751. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:11:14.342773 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-b3ad6a5a-924f-46d7-9708-d0282e03d79c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Getting quotas for user 8166793f60ee479689b4a21457b71d07 and project 457c4a300936498b9e8b61645e655751. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:11:14.366160 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b3ad6a5a-924f-46d7-9708-d0282e03d79c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:11:14.368461 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b3ad6a5a-924f-46d7-9708-d0282e03d79c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:11:14.427552 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c223a914-d033-4882-b1bb-81be7b335f53 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:14.435896 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c223a914-d033-4882-b1bb-81be7b335f53 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61" status: 200 len: 1316 microversion: 2.1 time: 0.391506 Jun 10 18:11:14.438683 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1966/4025] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:14 2022] GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61 => generated 1316 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:14.445077 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6059eeb5-a130-4d33-9e55-dd720bb37691 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c00a5c10>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:14.556876 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6059eeb5-a130-4d33-9e55-dd720bb37691 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86" status: 200 len: 1427 microversion: 2.1 time: 0.117067 Jun 10 18:11:14.560353 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1967/4026] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:11:14 2022] GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86 => generated 1427 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:14.579401 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-66fff5a6-b8de-487c-8d64-ceb66089cccb tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:14.580012 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-66fff5a6-b8de-487c-8d64-ceb66089cccb tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] [instance: dc0e228e-55d2-4eaf-94fd-61213629df65] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:14.631537 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b3ad6a5a-924f-46d7-9708-d0282e03d79c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.387849 Jun 10 18:11:14.631537 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2060/4027] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:11:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1389 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:11:14.644129 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7411f6b7-6ebb-4560-9cb4-afb2b73f8995 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:14.645144 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7411f6b7-6ebb-4560-9cb4-afb2b73f8995 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:14.760001 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7411f6b7-6ebb-4560-9cb4-afb2b73f8995 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:14.767388 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7411f6b7-6ebb-4560-9cb4-afb2b73f8995 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559" status: 200 len: 1215 microversion: 2.1 time: 0.133873 Jun 10 18:11:14.774369 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2061/4028] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:14 2022] GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 => generated 1215 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:14.803303 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-66fff5a6-b8de-487c-8d64-ceb66089cccb tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b082ea4ee3dd46f29a326e0299d69583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d3b6f9eb74076b4c74f01fb4bd6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:14.819310 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-66fff5a6-b8de-487c-8d64-ceb66089cccb tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] 10.222.0.35 "GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65" status: 200 len: 1224 microversion: 2.1 time: 0.255680 Jun 10 18:11:14.820887 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1968/4029] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:14 2022] GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65 => generated 1224 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:15.424848 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-83878af6-65a6-4acf-bd83-5bca340534e4 req-4a838a6d-2d16-48ce-8a1a-b0afdbdb1379 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74e411c5-d389-4307-99fd-a6cf439f1c61", "name": "network-vif-plugged", "status": "completed", "tag": "6ffbd004-8c63-480b-bbd0-9d5aa48fd2b2"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:11:15.440559 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-83878af6-65a6-4acf-bd83-5bca340534e4 req-4a838a6d-2d16-48ce-8a1a-b0afdbdb1379 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:15.441201 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-83878af6-65a6-4acf-bd83-5bca340534e4 req-4a838a6d-2d16-48ce-8a1a-b0afdbdb1379 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:15.453612 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-67cce0d6-d94a-4092-a9df-c54cf4596eed tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:15.454225 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-67cce0d6-d94a-4092-a9df-c54cf4596eed tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 74e411c5-d389-4307-99fd-a6cf439f1c61] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:15.458389 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-83878af6-65a6-4acf-bd83-5bca340534e4 req-4a838a6d-2d16-48ce-8a1a-b0afdbdb1379 service nova] Creating event network-vif-plugged:6ffbd004-8c63-480b-bbd0-9d5aa48fd2b2 for instance 74e411c5-d389-4307-99fd-a6cf439f1c61 on chh2-master-2 Jun 10 18:11:15.464238 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-83878af6-65a6-4acf-bd83-5bca340534e4 req-4a838a6d-2d16-48ce-8a1a-b0afdbdb1379 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043021 Jun 10 18:11:15.465800 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2062/4030] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:11:15.476773 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-67cce0d6-d94a-4092-a9df-c54cf4596eed tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:15.479789 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-67cce0d6-d94a-4092-a9df-c54cf4596eed tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:15.481595 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-67cce0d6-d94a-4092-a9df-c54cf4596eed tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:15.485216 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-67cce0d6-d94a-4092-a9df-c54cf4596eed tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:15.572342 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-dcc133ad-75ee-434b-92aa-cdeff61a133c tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c030cf70>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:15.678450 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-dcc133ad-75ee-434b-92aa-cdeff61a133c tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86" status: 200 len: 1427 microversion: 2.1 time: 0.110432 Jun 10 18:11:15.679611 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2063/4031] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:11:15 2022] GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86 => generated 1427 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:11:15.794823 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a882b3ab-88cb-4bdc-9b52-26b90d51712d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:15.796735 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a882b3ab-88cb-4bdc-9b52-26b90d51712d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:15.922333 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a882b3ab-88cb-4bdc-9b52-26b90d51712d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:15.931883 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a882b3ab-88cb-4bdc-9b52-26b90d51712d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559" status: 200 len: 1215 microversion: 2.1 time: 0.144825 Jun 10 18:11:15.943462 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2064/4032] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:15 2022] GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 => generated 1215 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:15.956247 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d924be06-acaf-47e6-87be-12713442e3ae tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:15.957466 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d924be06-acaf-47e6-87be-12713442e3ae tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] [instance: dc0e228e-55d2-4eaf-94fd-61213629df65] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:15.979937 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d924be06-acaf-47e6-87be-12713442e3ae tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:15.982272 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d924be06-acaf-47e6-87be-12713442e3ae tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:15.983345 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d924be06-acaf-47e6-87be-12713442e3ae tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:15.986528 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d924be06-acaf-47e6-87be-12713442e3ae tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:16.051024 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-67cce0d6-d94a-4092-a9df-c54cf4596eed tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:16.085174 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-67cce0d6-d94a-4092-a9df-c54cf4596eed tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61" status: 200 len: 1316 microversion: 2.1 time: 0.635960 Jun 10 18:11:16.096385 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1969/4033] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:15 2022] GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61 => generated 1316 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:11:16.118448 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d924be06-acaf-47e6-87be-12713442e3ae tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b082ea4ee3dd46f29a326e0299d69583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d3b6f9eb74076b4c74f01fb4bd6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:16.131297 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d924be06-acaf-47e6-87be-12713442e3ae tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] 10.222.0.35 "GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65" status: 200 len: 1228 microversion: 2.1 time: 0.186363 Jun 10 18:11:16.135383 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2065/4034] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:15 2022] GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65 => generated 1228 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:16.691976 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fb309a79-de0e-422c-bd88-aa5be36a372a tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c00f6790>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:16.741722 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fb309a79-de0e-422c-bd88-aa5be36a372a tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86" status: 200 len: 1427 microversion: 2.1 time: 0.053344 Jun 10 18:11:16.742484 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1970/4035] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:11:16 2022] GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86 => generated 1427 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:16.951616 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-294e4773-6edb-45a6-ac9c-e75c65a24009 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:16.953039 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-294e4773-6edb-45a6-ac9c-e75c65a24009 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:16.964257 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-294e4773-6edb-45a6-ac9c-e75c65a24009 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:16.965006 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-294e4773-6edb-45a6-ac9c-e75c65a24009 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:16.966176 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-294e4773-6edb-45a6-ac9c-e75c65a24009 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:16.967424 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-294e4773-6edb-45a6-ac9c-e75c65a24009 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:17.049240 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-294e4773-6edb-45a6-ac9c-e75c65a24009 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:17.063592 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-294e4773-6edb-45a6-ac9c-e75c65a24009 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559" status: 200 len: 1219 microversion: 2.1 time: 0.117629 Jun 10 18:11:17.064716 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2066/4036] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:16 2022] GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 => generated 1219 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:17.105159 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-884367dc-5db1-44fb-9cb9-f1e18a80aa9e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:17.108086 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-884367dc-5db1-44fb-9cb9-f1e18a80aa9e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 74e411c5-d389-4307-99fd-a6cf439f1c61] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:17.139271 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-884367dc-5db1-44fb-9cb9-f1e18a80aa9e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:17.139988 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-884367dc-5db1-44fb-9cb9-f1e18a80aa9e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:17.141023 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-884367dc-5db1-44fb-9cb9-f1e18a80aa9e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:17.141640 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-884367dc-5db1-44fb-9cb9-f1e18a80aa9e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:17.158442 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e29d5cb2-a6bb-417c-9015-8908e494a2fe tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:17.159100 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e29d5cb2-a6bb-417c-9015-8908e494a2fe tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] [instance: dc0e228e-55d2-4eaf-94fd-61213629df65] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:17.176166 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:11:17.204495 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e29d5cb2-a6bb-417c-9015-8908e494a2fe tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:17.205833 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e29d5cb2-a6bb-417c-9015-8908e494a2fe tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:17.208911 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e29d5cb2-a6bb-417c-9015-8908e494a2fe tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:17.209372 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e29d5cb2-a6bb-417c-9015-8908e494a2fe tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:17.376932 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e29d5cb2-a6bb-417c-9015-8908e494a2fe tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b082ea4ee3dd46f29a326e0299d69583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d3b6f9eb74076b4c74f01fb4bd6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:17.387544 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e29d5cb2-a6bb-417c-9015-8908e494a2fe tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] 10.222.0.35 "GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65" status: 200 len: 1220 microversion: 2.1 time: 0.239268 Jun 10 18:11:17.398758 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2067/4037] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:17 2022] GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65 => generated 1220 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:17.458076 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-884367dc-5db1-44fb-9cb9-f1e18a80aa9e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:17.467949 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-884367dc-5db1-44fb-9cb9-f1e18a80aa9e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61" status: 200 len: 1316 microversion: 2.1 time: 0.368094 Jun 10 18:11:17.471129 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1971/4038] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:17 2022] GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61 => generated 1316 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:17.756634 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-757f7220-3133-4112-a90d-3144092bc5f4 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77b3ee41f0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:17.856831 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-757f7220-3133-4112-a90d-3144092bc5f4 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86" status: 200 len: 1427 microversion: 2.1 time: 0.104757 Jun 10 18:11:17.857769 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2068/4039] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:11:17 2022] GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86 => generated 1427 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:11:18.081634 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a38f5bc5-cd94-4f1a-9867-90b4795221b9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:18.083056 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a38f5bc5-cd94-4f1a-9867-90b4795221b9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:18.092525 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a38f5bc5-cd94-4f1a-9867-90b4795221b9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:18.093581 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a38f5bc5-cd94-4f1a-9867-90b4795221b9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:18.094552 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a38f5bc5-cd94-4f1a-9867-90b4795221b9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:18.095262 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a38f5bc5-cd94-4f1a-9867-90b4795221b9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:18.299686 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a38f5bc5-cd94-4f1a-9867-90b4795221b9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:18.312968 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a38f5bc5-cd94-4f1a-9867-90b4795221b9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559" status: 200 len: 1275 microversion: 2.1 time: 0.236309 Jun 10 18:11:18.314019 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1972/4040] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:18 2022] GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 => generated 1275 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:18.375211 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-756a15e8-6226-4e6a-b6e0-88c130be4ad2 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:18.375776 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-756a15e8-6226-4e6a-b6e0-88c130be4ad2 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] [instance: 7c3a4081-92e2-4c7c-8283-faebd5302cf9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:18.392292 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-756a15e8-6226-4e6a-b6e0-88c130be4ad2 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:18.393144 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-756a15e8-6226-4e6a-b6e0-88c130be4ad2 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:18.397302 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-756a15e8-6226-4e6a-b6e0-88c130be4ad2 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:18.397989 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-756a15e8-6226-4e6a-b6e0-88c130be4ad2 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:18.411270 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cae937b0-f374-435b-8119-fcbefd2abc8e tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:18.417072 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cae937b0-f374-435b-8119-fcbefd2abc8e tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] [instance: dc0e228e-55d2-4eaf-94fd-61213629df65] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:18.428051 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cae937b0-f374-435b-8119-fcbefd2abc8e tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:18.446459 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cae937b0-f374-435b-8119-fcbefd2abc8e tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:18.446459 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cae937b0-f374-435b-8119-fcbefd2abc8e tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:18.446459 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cae937b0-f374-435b-8119-fcbefd2abc8e tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:18.513051 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-756a15e8-6226-4e6a-b6e0-88c130be4ad2 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] [instance: 7c3a4081-92e2-4c7c-8283-faebd5302cf9] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:11:18.751501 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cae937b0-f374-435b-8119-fcbefd2abc8e tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b082ea4ee3dd46f29a326e0299d69583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d3b6f9eb74076b4c74f01fb4bd6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:18.760628 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cae937b0-f374-435b-8119-fcbefd2abc8e tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] 10.222.0.35 "GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65" status: 200 len: 1284 microversion: 2.1 time: 0.357212 Jun 10 18:11:18.770734 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1973/4041] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:18 2022] GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65 => generated 1284 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:11:18.777259 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8f95ac82-c458-42eb-a9dc-581d92f36e74 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:18.778209 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8f95ac82-c458-42eb-a9dc-581d92f36e74 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 74e411c5-d389-4307-99fd-a6cf439f1c61] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:18.784960 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8f95ac82-c458-42eb-a9dc-581d92f36e74 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:18.785669 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8f95ac82-c458-42eb-a9dc-581d92f36e74 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:18.786677 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8f95ac82-c458-42eb-a9dc-581d92f36e74 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:18.787272 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8f95ac82-c458-42eb-a9dc-581d92f36e74 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:18.969014 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-756a15e8-6226-4e6a-b6e0-88c130be4ad2 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] 10.222.0.35 "DELETE /compute/v2.1/servers/7c3a4081-92e2-4c7c-8283-faebd5302cf9" status: 204 len: 0 microversion: 2.1 time: 0.600372 Jun 10 18:11:18.975571 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2069/4042] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:11:18 2022] DELETE /compute/v2.1/servers/7c3a4081-92e2-4c7c-8283-faebd5302cf9 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:11:18.976736 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-01d9ca84-6884-46f3-8bf1-df22e0263ca4 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77b3f8e550>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:19.036812 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8f95ac82-c458-42eb-a9dc-581d92f36e74 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:19.051665 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8f95ac82-c458-42eb-a9dc-581d92f36e74 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61" status: 200 len: 1505 microversion: 2.1 time: 0.271795 Jun 10 18:11:19.051665 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1974/4043] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:18 2022] GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61 => generated 1505 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:19.054866 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6f7f3a55-f384-4996-9aa1-ba6b3d8f1ad2 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:19.059270 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6f7f3a55-f384-4996-9aa1-ba6b3d8f1ad2 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] [instance: 7c3a4081-92e2-4c7c-8283-faebd5302cf9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:19.069527 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-01d9ca84-6884-46f3-8bf1-df22e0263ca4 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86" status: 200 len: 1427 microversion: 2.1 time: 0.097878 Jun 10 18:11:19.077026 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2070/4044] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:11:18 2022] GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86 => generated 1427 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:19.082616 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6f7f3a55-f384-4996-9aa1-ba6b3d8f1ad2 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:19.082616 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6f7f3a55-f384-4996-9aa1-ba6b3d8f1ad2 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:19.082616 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6f7f3a55-f384-4996-9aa1-ba6b3d8f1ad2 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:19.082616 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6f7f3a55-f384-4996-9aa1-ba6b3d8f1ad2 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:19.084763 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bc63b76d-cabf-45bb-8e0c-9370ba171c45 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:19.085634 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bc63b76d-cabf-45bb-8e0c-9370ba171c45 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 74e411c5-d389-4307-99fd-a6cf439f1c61] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:19.096131 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bc63b76d-cabf-45bb-8e0c-9370ba171c45 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:19.097004 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bc63b76d-cabf-45bb-8e0c-9370ba171c45 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:19.098008 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bc63b76d-cabf-45bb-8e0c-9370ba171c45 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:19.098693 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bc63b76d-cabf-45bb-8e0c-9370ba171c45 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:19.141379 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bc63b76d-cabf-45bb-8e0c-9370ba171c45 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 74e411c5-d389-4307-99fd-a6cf439f1c61] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:11:19.275999 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6f7f3a55-f384-4996-9aa1-ba6b3d8f1ad2 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c896f867509494cbce2e8f37d4cf0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e32c729a2b641f381e661905d930ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:19.292959 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6f7f3a55-f384-4996-9aa1-ba6b3d8f1ad2 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] 10.222.0.35 "GET /compute/v2.1/servers/7c3a4081-92e2-4c7c-8283-faebd5302cf9" status: 200 len: 1666 microversion: 2.1 time: 0.247000 Jun 10 18:11:19.293810 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1975/4045] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:19 2022] GET /compute/v2.1/servers/7c3a4081-92e2-4c7c-8283-faebd5302cf9 => generated 1666 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:19.331045 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-aaf5ef8b-1fbb-433f-a489-e2889da3ae65 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:19.339987 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-aaf5ef8b-1fbb-433f-a489-e2889da3ae65 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:19.342910 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aaf5ef8b-1fbb-433f-a489-e2889da3ae65 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:19.343241 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aaf5ef8b-1fbb-433f-a489-e2889da3ae65 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:19.344904 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:11:19.346569 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aaf5ef8b-1fbb-433f-a489-e2889da3ae65 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:19.347196 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aaf5ef8b-1fbb-433f-a489-e2889da3ae65 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:19.628911 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bc63b76d-cabf-45bb-8e0c-9370ba171c45 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "DELETE /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61" status: 204 len: 0 microversion: 2.1 time: 0.549915 Jun 10 18:11:19.631324 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-aaf5ef8b-1fbb-433f-a489-e2889da3ae65 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:19.632414 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2071/4046] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:11:19 2022] DELETE /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:11:19.638799 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d9fa20a0-af41-4a09-9a27-a84a12522fb6 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:19.639773 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d9fa20a0-af41-4a09-9a27-a84a12522fb6 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 74e411c5-d389-4307-99fd-a6cf439f1c61] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:19.659806 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-aaf5ef8b-1fbb-433f-a489-e2889da3ae65 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559" status: 200 len: 1315 microversion: 2.1 time: 0.332461 Jun 10 18:11:19.660703 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1976/4047] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:19 2022] GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:11:19.683684 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d9fa20a0-af41-4a09-9a27-a84a12522fb6 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:19.684433 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d9fa20a0-af41-4a09-9a27-a84a12522fb6 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:19.685402 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d9fa20a0-af41-4a09-9a27-a84a12522fb6 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:19.686245 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d9fa20a0-af41-4a09-9a27-a84a12522fb6 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:19.778586 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bcb37b88-cdcd-4c16-b89d-6d83f9bef807 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:19.783750 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bcb37b88-cdcd-4c16-b89d-6d83f9bef807 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] [instance: dc0e228e-55d2-4eaf-94fd-61213629df65] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:19.803723 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bcb37b88-cdcd-4c16-b89d-6d83f9bef807 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:19.808575 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bcb37b88-cdcd-4c16-b89d-6d83f9bef807 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:19.810044 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bcb37b88-cdcd-4c16-b89d-6d83f9bef807 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:19.811251 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bcb37b88-cdcd-4c16-b89d-6d83f9bef807 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:19.957957 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d9fa20a0-af41-4a09-9a27-a84a12522fb6 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:19.970662 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d9fa20a0-af41-4a09-9a27-a84a12522fb6 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61" status: 200 len: 1511 microversion: 2.1 time: 0.336855 Jun 10 18:11:19.980629 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2072/4048] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:19 2022] GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61 => generated 1511 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:20.027419 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bcb37b88-cdcd-4c16-b89d-6d83f9bef807 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b082ea4ee3dd46f29a326e0299d69583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d3b6f9eb74076b4c74f01fb4bd6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:20.037918 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bcb37b88-cdcd-4c16-b89d-6d83f9bef807 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] 10.222.0.35 "GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65" status: 200 len: 1282 microversion: 2.1 time: 0.263660 Jun 10 18:11:20.039020 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1977/4049] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:19 2022] GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65 => generated 1282 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:11:20.179611 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d74dff98-93e1-4b20-b871-378ee942c8fd tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c00ad4c0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:20.179611 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d74dff98-93e1-4b20-b871-378ee942c8fd tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86" status: 200 len: 1427 microversion: 2.1 time: 0.069495 Jun 10 18:11:20.179611 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2073/4050] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:11:20 2022] GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86 => generated 1427 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:20.311189 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-76dd2f97-bee0-416b-818d-e8f80ce53ef3 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:20.311798 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-76dd2f97-bee0-416b-818d-e8f80ce53ef3 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] [instance: 7c3a4081-92e2-4c7c-8283-faebd5302cf9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:20.318780 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-76dd2f97-bee0-416b-818d-e8f80ce53ef3 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:20.319237 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-76dd2f97-bee0-416b-818d-e8f80ce53ef3 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:20.320094 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-76dd2f97-bee0-416b-818d-e8f80ce53ef3 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:20.320561 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-76dd2f97-bee0-416b-818d-e8f80ce53ef3 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:20.339885 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:11:20.686401 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2a9e8c1c-de57-454b-adba-84846ea8116a tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:20.687645 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2a9e8c1c-de57-454b-adba-84846ea8116a tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:20.695971 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2a9e8c1c-de57-454b-adba-84846ea8116a tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:20.697963 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2a9e8c1c-de57-454b-adba-84846ea8116a tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:20.699006 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2a9e8c1c-de57-454b-adba-84846ea8116a tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:20.699689 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2a9e8c1c-de57-454b-adba-84846ea8116a tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:20.758658 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-76dd2f97-bee0-416b-818d-e8f80ce53ef3 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c896f867509494cbce2e8f37d4cf0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e32c729a2b641f381e661905d930ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:20.776618 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-76dd2f97-bee0-416b-818d-e8f80ce53ef3 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] 10.222.0.35 "GET /compute/v2.1/servers/7c3a4081-92e2-4c7c-8283-faebd5302cf9" status: 200 len: 1666 microversion: 2.1 time: 0.468795 Jun 10 18:11:20.777218 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1978/4051] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:20 2022] GET /compute/v2.1/servers/7c3a4081-92e2-4c7c-8283-faebd5302cf9 => generated 1666 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:20.988066 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-779636a1-dce9-4d90-b35c-e29554ec87de tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:20.988974 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-779636a1-dce9-4d90-b35c-e29554ec87de tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 74e411c5-d389-4307-99fd-a6cf439f1c61] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:20.996656 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-779636a1-dce9-4d90-b35c-e29554ec87de tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:21.001748 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-779636a1-dce9-4d90-b35c-e29554ec87de tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:21.013420 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-779636a1-dce9-4d90-b35c-e29554ec87de tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:21.014230 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-779636a1-dce9-4d90-b35c-e29554ec87de tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:21.017325 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2a9e8c1c-de57-454b-adba-84846ea8116a tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:21.026641 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2a9e8c1c-de57-454b-adba-84846ea8116a tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559" status: 200 len: 1315 microversion: 2.1 time: 0.348266 Jun 10 18:11:21.029911 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2074/4052] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:20 2022] GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 => generated 1315 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:11:21.057235 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-080b60e3-a44c-4681-9040-45f1a3310ef8 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:21.058193 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-080b60e3-a44c-4681-9040-45f1a3310ef8 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] [instance: dc0e228e-55d2-4eaf-94fd-61213629df65] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:21.067610 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-080b60e3-a44c-4681-9040-45f1a3310ef8 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:21.086695 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-080b60e3-a44c-4681-9040-45f1a3310ef8 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:21.086695 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-080b60e3-a44c-4681-9040-45f1a3310ef8 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:21.086695 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-080b60e3-a44c-4681-9040-45f1a3310ef8 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:21.486670 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-080b60e3-a44c-4681-9040-45f1a3310ef8 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b082ea4ee3dd46f29a326e0299d69583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d3b6f9eb74076b4c74f01fb4bd6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:21.498700 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-080b60e3-a44c-4681-9040-45f1a3310ef8 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] 10.222.0.35 "GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65" status: 200 len: 1324 microversion: 2.1 time: 0.445987 Jun 10 18:11:21.506595 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2075/4053] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:21 2022] GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65 => generated 1324 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:11:21.526186 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8289751c-f25f-4caf-a26f-9b2b26c37a59 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77b3f8ee50>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:21.585903 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8289751c-f25f-4caf-a26f-9b2b26c37a59 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86" status: 200 len: 1427 microversion: 2.1 time: 0.069303 Jun 10 18:11:21.586730 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2076/4054] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:11:21 2022] GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86 => generated 1427 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:22.205363 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-694b1f5a-01c9-432a-bb41-abb487cd11a6 tempest-FlavorsV2NegativeTest-876383088 tempest-FlavorsV2NegativeTest-876383088-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:22.229673 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-694b1f5a-01c9-432a-bb41-abb487cd11a6 tempest-FlavorsV2NegativeTest-876383088 tempest-FlavorsV2NegativeTest-876383088-project] 10.222.0.35 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.641598 Jun 10 18:11:22.230274 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2077/4055] 10.222.0.35 () {58 vars in 1136 bytes} [Fri Jun 10 18:11:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:11:22.273338 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fd384146-b334-4093-8aa6-f41eb9e64ed5 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:22.274418 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fd384146-b334-4093-8aa6-f41eb9e64ed5 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] [instance: 7c3a4081-92e2-4c7c-8283-faebd5302cf9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:22.300778 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fd384146-b334-4093-8aa6-f41eb9e64ed5 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:22.301433 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fd384146-b334-4093-8aa6-f41eb9e64ed5 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:22.302320 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fd384146-b334-4093-8aa6-f41eb9e64ed5 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:22.302850 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fd384146-b334-4093-8aa6-f41eb9e64ed5 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:22.409711 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fd384146-b334-4093-8aa6-f41eb9e64ed5 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c896f867509494cbce2e8f37d4cf0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e32c729a2b641f381e661905d930ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:22.429769 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fd384146-b334-4093-8aa6-f41eb9e64ed5 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] 10.222.0.35 "GET /compute/v2.1/servers/7c3a4081-92e2-4c7c-8283-faebd5302cf9" status: 200 len: 1599 microversion: 2.1 time: 0.161658 Jun 10 18:11:22.432902 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2078/4056] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:22 2022] GET /compute/v2.1/servers/7c3a4081-92e2-4c7c-8283-faebd5302cf9 => generated 1599 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:22.441386 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f6e06282-e1b1-4bac-8031-e2842e1a7b31 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:22.448020 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f6e06282-e1b1-4bac-8031-e2842e1a7b31 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:22.461364 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f6e06282-e1b1-4bac-8031-e2842e1a7b31 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:22.462928 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f6e06282-e1b1-4bac-8031-e2842e1a7b31 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:22.466370 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f6e06282-e1b1-4bac-8031-e2842e1a7b31 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:22.467067 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f6e06282-e1b1-4bac-8031-e2842e1a7b31 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:22.501625 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-779636a1-dce9-4d90-b35c-e29554ec87de tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:22.515522 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-779636a1-dce9-4d90-b35c-e29554ec87de tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61" status: 200 len: 1511 microversion: 2.1 time: 1.531913 Jun 10 18:11:22.516810 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1979/4057] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:20 2022] GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61 => generated 1511 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:22.533562 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-f413a933-e2bb-4a30-b392-e965f6b12cc6 req-b14f9471-0502-4388-9888-bcece36ad5e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f0a3407-710b-426e-8909-3395a119f559", "tag": "0c597e2d-7c45-426d-937e-7f012531a187"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:11:22.548278 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-f413a933-e2bb-4a30-b392-e965f6b12cc6 req-b14f9471-0502-4388-9888-bcece36ad5e5 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:22.549001 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-f413a933-e2bb-4a30-b392-e965f6b12cc6 req-b14f9471-0502-4388-9888-bcece36ad5e5 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:22.569803 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-f413a933-e2bb-4a30-b392-e965f6b12cc6 req-b14f9471-0502-4388-9888-bcece36ad5e5 service nova] Creating event network-changed:0c597e2d-7c45-426d-937e-7f012531a187 for instance 4f0a3407-710b-426e-8909-3395a119f559 on chh2-master-2 Jun 10 18:11:22.579297 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-f413a933-e2bb-4a30-b392-e965f6b12cc6 req-b14f9471-0502-4388-9888-bcece36ad5e5 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059765 Jun 10 18:11:22.580428 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1980/4058] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:11:22.588345 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fc69647d-ae10-44ca-921e-a18b83cc692d tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:22.589298 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fc69647d-ae10-44ca-921e-a18b83cc692d tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] [instance: dc0e228e-55d2-4eaf-94fd-61213629df65] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:22.599603 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fc69647d-ae10-44ca-921e-a18b83cc692d tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:22.600558 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fc69647d-ae10-44ca-921e-a18b83cc692d tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:22.603455 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fc69647d-ae10-44ca-921e-a18b83cc692d tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:22.605751 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fc69647d-ae10-44ca-921e-a18b83cc692d tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:23.140532 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f6e06282-e1b1-4bac-8031-e2842e1a7b31 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:23.150726 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f6e06282-e1b1-4bac-8031-e2842e1a7b31 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559" status: 200 len: 1315 microversion: 2.1 time: 0.716507 Jun 10 18:11:23.155109 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2079/4059] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:22 2022] GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 => generated 1315 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:23.162331 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8af36220-9d0e-49d4-88f0-54d6dd7b7ddc tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c00a6040>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:23.894788 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fc69647d-ae10-44ca-921e-a18b83cc692d tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b082ea4ee3dd46f29a326e0299d69583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d3b6f9eb74076b4c74f01fb4bd6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:23.910994 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:11:23.924575 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fc69647d-ae10-44ca-921e-a18b83cc692d tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] 10.222.0.35 "GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65" status: 200 len: 1324 microversion: 2.1 time: 1.342662 Jun 10 18:11:23.935873 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1981/4060] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:22 2022] GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65 => generated 1324 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:23.942822 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1bb07d33-e365-4aa7-8447-c13c1ab47c41 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:23.943636 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1bb07d33-e365-4aa7-8447-c13c1ab47c41 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] [instance: 7c3a4081-92e2-4c7c-8283-faebd5302cf9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:23.954539 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1bb07d33-e365-4aa7-8447-c13c1ab47c41 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:23.957279 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1bb07d33-e365-4aa7-8447-c13c1ab47c41 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:23.958841 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1bb07d33-e365-4aa7-8447-c13c1ab47c41 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:23.959692 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1bb07d33-e365-4aa7-8447-c13c1ab47c41 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:24.168189 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8af36220-9d0e-49d4-88f0-54d6dd7b7ddc tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86" status: 200 len: 1427 microversion: 2.1 time: 1.011365 Jun 10 18:11:24.169120 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2080/4061] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:11:23 2022] GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86 => generated 1427 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:24.197112 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d20e6447-3326-4fd8-9c22-0d441ac146cb tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:24.198151 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d20e6447-3326-4fd8-9c22-0d441ac146cb tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 74e411c5-d389-4307-99fd-a6cf439f1c61] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:24.211524 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d20e6447-3326-4fd8-9c22-0d441ac146cb tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:24.212499 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d20e6447-3326-4fd8-9c22-0d441ac146cb tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:24.213614 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d20e6447-3326-4fd8-9c22-0d441ac146cb tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:24.216183 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d20e6447-3326-4fd8-9c22-0d441ac146cb tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:24.277495 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1bb07d33-e365-4aa7-8447-c13c1ab47c41 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c896f867509494cbce2e8f37d4cf0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e32c729a2b641f381e661905d930ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:24.303526 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1bb07d33-e365-4aa7-8447-c13c1ab47c41 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] 10.222.0.35 "GET /compute/v2.1/servers/7c3a4081-92e2-4c7c-8283-faebd5302cf9" status: 200 len: 1599 microversion: 2.1 time: 0.365603 Jun 10 18:11:24.307524 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1982/4062] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:23 2022] GET /compute/v2.1/servers/7c3a4081-92e2-4c7c-8283-faebd5302cf9 => generated 1599 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:24.323476 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-56591375-434b-43d9-ac94-14a18697ae68 req-fcc320d5-eb22-4e1c-986c-0c53138334ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c3a4081-92e2-4c7c-8283-faebd5302cf9", "name": "network-vif-deleted", "tag": "8ab067d1-1b0e-4361-8885-c16e28f66095"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:11:24.337011 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:11:24.407969 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-56591375-434b-43d9-ac94-14a18697ae68 req-fcc320d5-eb22-4e1c-986c-0c53138334ef service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:24.409645 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-56591375-434b-43d9-ac94-14a18697ae68 req-fcc320d5-eb22-4e1c-986c-0c53138334ef service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:24.519397 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-56591375-434b-43d9-ac94-14a18697ae68 req-fcc320d5-eb22-4e1c-986c-0c53138334ef service nova] Creating event network-vif-deleted:8ab067d1-1b0e-4361-8885-c16e28f66095 for instance 7c3a4081-92e2-4c7c-8283-faebd5302cf9 on chh1-master-2 Jun 10 18:11:24.541175 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-56591375-434b-43d9-ac94-14a18697ae68 req-fcc320d5-eb22-4e1c-986c-0c53138334ef service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.231244 Jun 10 18:11:24.542956 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1983/4063] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:11:24.557123 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-71134082-e10b-40e4-81fb-8ca967994a2e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:24.558142 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-71134082-e10b-40e4-81fb-8ca967994a2e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:24.571571 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-71134082-e10b-40e4-81fb-8ca967994a2e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:24.573023 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-71134082-e10b-40e4-81fb-8ca967994a2e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:24.574486 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-71134082-e10b-40e4-81fb-8ca967994a2e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:24.576386 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-71134082-e10b-40e4-81fb-8ca967994a2e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:24.749511 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d20e6447-3326-4fd8-9c22-0d441ac146cb tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:24.757613 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d20e6447-3326-4fd8-9c22-0d441ac146cb tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61" status: 200 len: 1511 microversion: 2.1 time: 0.587407 Jun 10 18:11:24.760656 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2081/4064] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:24 2022] GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61 => generated 1511 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:24.772190 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5f12c74a-ed1b-441a-82be-4a2a66a76755 tempest-FlavorsV2NegativeTest-876383088 tempest-FlavorsV2NegativeTest-876383088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1077841647", "imageRef": "00a276ec-2ab1-41b2-9071-095a9c02d349", "flavorRef": "452"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:11:24.819534 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=8 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:11:24.880816 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-5f12c74a-ed1b-441a-82be-4a2a66a76755 tempest-FlavorsV2NegativeTest-876383088 tempest-FlavorsV2NegativeTest-876383088-project] validate_networks() for None {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:11:25.205915 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-71134082-e10b-40e4-81fb-8ca967994a2e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:25.215311 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-71134082-e10b-40e4-81fb-8ca967994a2e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559" status: 200 len: 1315 microversion: 2.1 time: 0.668415 Jun 10 18:11:25.217104 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-5f12c74a-ed1b-441a-82be-4a2a66a76755 tempest-FlavorsV2NegativeTest-876383088 tempest-FlavorsV2NegativeTest-876383088-project] HTTP exception thrown: Flavor's memory is too small for requested image. Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5f12c74a-ed1b-441a-82be-4a2a66a76755 tempest-FlavorsV2NegativeTest-876383088 tempest-FlavorsV2NegativeTest-876383088-project] Request method failure captured: Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 143 Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4lJrBW7VnKtJZN_H24ZhIa2X_9TnGr6WMyoL3fblbY26WMdHwerkBhLqNqsrzI14kyEL4tzhO8WB-AoZaoYNgQrJ-olO4d8QD9V15B3qC4oQvqJNPkw6z0rFxSL726cRTIpG3Lt5Nhq8GuawXClvhPHujIKRrbsllRfFW5zYbs4X4Y Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: ff3c3c5d075144bc97472884cd3f729b Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-FlavorsV2NegativeTest-876383088 Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ff3c3c5d075144bc97472884cd3f729b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ff3c3c5d075144bc97472884cd3f729b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ff3c3c5d075144bc97472884cd3f729b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ff3c3c5d075144bc97472884cd3f729b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-FlavorsV2NegativeTest-876383088 Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: ff3c3c5d075144bc97472884cd3f729b Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-876383088 Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-FlavorsV2NegativeTest-876383088-project Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 7152c1d300514a2dbafce49c3660060d Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-FlavorsV2NegativeTest-876383088-project Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1077841647", "imageRef": "00a276ec-2ab1-41b2-9071-095a9c02d349", "flavorRef": "452"}} Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: exception: Flavor's memory is too small for requested image. Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1077841647', 'imageRef': '00a276ec-2ab1-41b2-9071-095a9c02d349', 'flavorRef': '452'}}} Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1005, in _checks_for_create_and_rebuild Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 669, in _validate_flavor_image Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 737, in _validate_flavor_image_nostatus Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:11:25.220148 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:11:25.225327 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:11:25.225327 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:11:25.225327 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 10 18:11:25.225327 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Jun 10 18:11:25.225327 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jun 10 18:11:25.225327 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Jun 10 18:11:25.225327 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:25.225327 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:25.225327 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:25.225327 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:25.225327 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:25.225327 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:25.225327 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:11:25.225327 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:11:25.225327 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Jun 10 18:11:25.225327 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:25.238729 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1984/4065] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:24 2022] GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 => generated 1315 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:25.238729 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d4be061f-7362-4111-9cc9-438b2f91ff96 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:25.238729 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d4be061f-7362-4111-9cc9-438b2f91ff96 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] [instance: dc0e228e-55d2-4eaf-94fd-61213629df65] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:25.247470 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5f12c74a-ed1b-441a-82be-4a2a66a76755 tempest-FlavorsV2NegativeTest-876383088 tempest-FlavorsV2NegativeTest-876383088-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:11:25.247470 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5f12c74a-ed1b-441a-82be-4a2a66a76755 tempest-FlavorsV2NegativeTest-876383088 tempest-FlavorsV2NegativeTest-876383088-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.479451 Jun 10 18:11:25.247470 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2082/4066] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:11:24 2022] POST /compute/v2.1/servers => generated 93 bytes in 482 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 10 18:11:25.253878 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4a0ee3b4-c0ab-4d0f-8c71-d9dd163779d8 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c00ad3a0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:25.260099 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d4be061f-7362-4111-9cc9-438b2f91ff96 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:25.260932 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d4be061f-7362-4111-9cc9-438b2f91ff96 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:25.261767 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d4be061f-7362-4111-9cc9-438b2f91ff96 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:25.262222 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d4be061f-7362-4111-9cc9-438b2f91ff96 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:25.522981 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d4be061f-7362-4111-9cc9-438b2f91ff96 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b082ea4ee3dd46f29a326e0299d69583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d3b6f9eb74076b4c74f01fb4bd6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:25.540838 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d4be061f-7362-4111-9cc9-438b2f91ff96 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] 10.222.0.35 "GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65" status: 200 len: 1324 microversion: 2.1 time: 0.300392 Jun 10 18:11:25.541457 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1985/4067] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:25 2022] GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65 => generated 1324 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:25.547255 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-12d8e771-f6a5-430d-af18-3dc9bf6d7ec9 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:25.547882 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-12d8e771-f6a5-430d-af18-3dc9bf6d7ec9 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] [instance: 7c3a4081-92e2-4c7c-8283-faebd5302cf9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:25.567580 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-12d8e771-f6a5-430d-af18-3dc9bf6d7ec9 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:25.584583 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-12d8e771-f6a5-430d-af18-3dc9bf6d7ec9 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:25.585646 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-12d8e771-f6a5-430d-af18-3dc9bf6d7ec9 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:25.586116 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-12d8e771-f6a5-430d-af18-3dc9bf6d7ec9 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:25.618942 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-12d8e771-f6a5-430d-af18-3dc9bf6d7ec9 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] HTTP exception thrown: Instance 7c3a4081-92e2-4c7c-8283-faebd5302cf9 could not be found. Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-12d8e771-f6a5-430d-af18-3dc9bf6d7ec9 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Request method failure captured: Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/7c3a4081-92e2-4c7c-8283-faebd5302cf9 HTTP/1.1 Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4kEIZSHsCF7h4rS2-AJdF2iLRk_3n0c4GJXf2BsClPBxVQ3rXw9ih3MIRbiv9A4fd4lNqTa1jaXd0ssSaWVbhcNRH9q9lN0aki18tGy6DV5rVkzGc7ZAoL7rDilrwPvnAYoKjf9D7qhJGQQwnfPpGWklt6IzF3pRXXBf1kSo3TwAOM Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 1e32c729a2b641f381e661905d930ee3 Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersTestFqdnHostnames-1778760664 Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1e32c729a2b641f381e661905d930ee3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1e32c729a2b641f381e661905d930ee3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1e32c729a2b641f381e661905d930ee3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1e32c729a2b641f381e661905d930ee3", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersTestFqdnHostnames-1778760664 Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 1e32c729a2b641f381e661905d930ee3 Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1778760664 Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersTestFqdnHostnames-1778760664-project Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 3c896f867509494cbce2e8f37d4cf0c2 Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersTestFqdnHostnames-1778760664-project Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 7c3a4081-92e2-4c7c-8283-faebd5302cf9 could not be found. Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '7c3a4081-92e2-4c7c-8283-faebd5302cf9'} Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c3a4081-92e2-4c7c-8283-faebd5302cf9 could not be found. Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c3a4081-92e2-4c7c-8283-faebd5302cf9 could not be found. Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:25.622140 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:25.627777 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:25.627777 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:25.627777 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:25.627777 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:11:25.627777 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:11:25.627777 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c3a4081-92e2-4c7c-8283-faebd5302cf9 could not be found. Jun 10 18:11:25.627777 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:25.627777 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-12d8e771-f6a5-430d-af18-3dc9bf6d7ec9 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Returning 404 to user: Instance 7c3a4081-92e2-4c7c-8283-faebd5302cf9 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:11:25.632108 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-12d8e771-f6a5-430d-af18-3dc9bf6d7ec9 tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] 10.222.0.35 "GET /compute/v2.1/servers/7c3a4081-92e2-4c7c-8283-faebd5302cf9" status: 404 len: 111 microversion: 2.1 time: 0.089425 Jun 10 18:11:25.632989 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1986/4068] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:25 2022] GET /compute/v2.1/servers/7c3a4081-92e2-4c7c-8283-faebd5302cf9 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:11:25.643796 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5c3d3223-d7be-4db1-80cd-e5160007eaad tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] Calling method '.version_select at 0x7f77c00b49d0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:25.753463 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5c3d3223-d7be-4db1-80cd-e5160007eaad tempest-ServersTestFqdnHostnames-1778760664 tempest-ServersTestFqdnHostnames-1778760664-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-802723711" status: 202 len: 0 microversion: 2.1 time: 0.114941 Jun 10 18:11:25.755121 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1987/4069] 10.222.0.35 () {58 vars in 1217 bytes} [Fri Jun 10 18:11:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-802723711 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 18:11:25.776545 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3806e745-23b3-42b1-a20b-111d77332650 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:25.777400 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3806e745-23b3-42b1-a20b-111d77332650 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 74e411c5-d389-4307-99fd-a6cf439f1c61] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:25.795586 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3806e745-23b3-42b1-a20b-111d77332650 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:25.797523 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3806e745-23b3-42b1-a20b-111d77332650 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:25.799528 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3806e745-23b3-42b1-a20b-111d77332650 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:25.801679 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3806e745-23b3-42b1-a20b-111d77332650 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:25.931334 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=10 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:11:26.011687 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3806e745-23b3-42b1-a20b-111d77332650 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:26.025295 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3806e745-23b3-42b1-a20b-111d77332650 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61" status: 200 len: 1469 microversion: 2.1 time: 0.249720 Jun 10 18:11:26.041584 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1988/4070] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:25 2022] GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61 => generated 1469 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:26.250398 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-548e6ae0-bfba-4ee0-a39d-51722a42931f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:26.257846 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-548e6ae0-bfba-4ee0-a39d-51722a42931f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:26.267713 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-548e6ae0-bfba-4ee0-a39d-51722a42931f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:26.268590 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-548e6ae0-bfba-4ee0-a39d-51722a42931f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:26.269627 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-548e6ae0-bfba-4ee0-a39d-51722a42931f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:26.270435 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-548e6ae0-bfba-4ee0-a39d-51722a42931f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:26.736865 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4a0ee3b4-c0ab-4d0f-8c71-d9dd163779d8 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86" status: 200 len: 1427 microversion: 2.1 time: 1.492354 Jun 10 18:11:26.755298 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2083/4071] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:11:25 2022] GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86 => generated 1427 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:26.777969 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-85622320-5094-4b4f-933d-015829a190d0 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:26.778944 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-85622320-5094-4b4f-933d-015829a190d0 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] [instance: dc0e228e-55d2-4eaf-94fd-61213629df65] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:26.808809 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-85622320-5094-4b4f-933d-015829a190d0 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:26.809596 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-85622320-5094-4b4f-933d-015829a190d0 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:26.810601 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-85622320-5094-4b4f-933d-015829a190d0 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:26.813311 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-85622320-5094-4b4f-933d-015829a190d0 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:27.056975 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-548e6ae0-bfba-4ee0-a39d-51722a42931f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:27.085759 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-548e6ae0-bfba-4ee0-a39d-51722a42931f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559" status: 200 len: 1315 microversion: 2.1 time: 0.843032 Jun 10 18:11:27.086488 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1989/4072] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:26 2022] GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 => generated 1315 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:27.091271 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-85622320-5094-4b4f-933d-015829a190d0 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b082ea4ee3dd46f29a326e0299d69583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d3b6f9eb74076b4c74f01fb4bd6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:27.108324 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-85622320-5094-4b4f-933d-015829a190d0 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] 10.222.0.35 "GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65" status: 200 len: 1324 microversion: 2.1 time: 0.352899 Jun 10 18:11:27.109193 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2084/4073] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:26 2022] GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65 => generated 1324 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:27.119619 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-e5f18308-684f-4095-9935-e1b16994ebca req-1bef90fe-66e3-44d4-9f64-5bdae08aa2a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc0e228e-55d2-4eaf-94fd-61213629df65", "tag": "228a8879-fa9d-4731-b769-d54d6f0b6e9e"}, {"server_uuid": "74e411c5-d389-4307-99fd-a6cf439f1c61", "name": "network-vif-deleted", "tag": "6ffbd004-8c63-480b-bbd0-9d5aa48fd2b2"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:11:27.120588 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e4f0df48-499c-4069-9908-ad87ea632d1c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:27.121406 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e4f0df48-499c-4069-9908-ad87ea632d1c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 74e411c5-d389-4307-99fd-a6cf439f1c61] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:27.161089 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e4f0df48-499c-4069-9908-ad87ea632d1c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:27.163468 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e4f0df48-499c-4069-9908-ad87ea632d1c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:27.164447 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-e5f18308-684f-4095-9935-e1b16994ebca req-1bef90fe-66e3-44d4-9f64-5bdae08aa2a2 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:27.165511 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-e5f18308-684f-4095-9935-e1b16994ebca req-1bef90fe-66e3-44d4-9f64-5bdae08aa2a2 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:27.165942 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e4f0df48-499c-4069-9908-ad87ea632d1c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:27.167206 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e4f0df48-499c-4069-9908-ad87ea632d1c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:27.225126 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-e5f18308-684f-4095-9935-e1b16994ebca req-1bef90fe-66e3-44d4-9f64-5bdae08aa2a2 service nova] Creating event network-changed:228a8879-fa9d-4731-b769-d54d6f0b6e9e for instance dc0e228e-55d2-4eaf-94fd-61213629df65 on chh2-master-2 Jun 10 18:11:27.225689 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-e5f18308-684f-4095-9935-e1b16994ebca req-1bef90fe-66e3-44d4-9f64-5bdae08aa2a2 service nova] Creating event network-vif-deleted:6ffbd004-8c63-480b-bbd0-9d5aa48fd2b2 for instance 74e411c5-d389-4307-99fd-a6cf439f1c61 on chh2-master-2 Jun 10 18:11:27.251875 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-e5f18308-684f-4095-9935-e1b16994ebca req-1bef90fe-66e3-44d4-9f64-5bdae08aa2a2 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.158842 Jun 10 18:11:27.264502 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1990/4074] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:11:27.297224 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e4f0df48-499c-4069-9908-ad87ea632d1c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:27.299372 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e4f0df48-499c-4069-9908-ad87ea632d1c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:27.300712 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-e4f0df48-499c-4069-9908-ad87ea632d1c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lazy-loading 'fault' on Instance uuid 74e411c5-d389-4307-99fd-a6cf439f1c61 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:11:27.502918 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e4f0df48-499c-4069-9908-ad87ea632d1c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:27.518010 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e4f0df48-499c-4069-9908-ad87ea632d1c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61" status: 200 len: 1306 microversion: 2.1 time: 0.406949 Jun 10 18:11:27.531956 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2085/4075] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:27 2022] GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61 => generated 1306 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:27.769538 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-67e737d5-368c-47b2-9eec-e099c3520b41 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c00b9280>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:27.859193 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-67e737d5-368c-47b2-9eec-e099c3520b41 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86" status: 200 len: 1427 microversion: 2.1 time: 0.098399 Jun 10 18:11:27.860228 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1991/4076] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:11:27 2022] GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86 => generated 1427 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:28.105841 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b646c2f1-2d63-4b70-8d49-f13ed9507986 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:28.107087 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b646c2f1-2d63-4b70-8d49-f13ed9507986 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:28.127704 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d1877c12-3e87-48b9-8a9f-a5a11a46b3bf tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:28.128754 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d1877c12-3e87-48b9-8a9f-a5a11a46b3bf tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] [instance: dc0e228e-55d2-4eaf-94fd-61213629df65] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:28.133685 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b646c2f1-2d63-4b70-8d49-f13ed9507986 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:28.139031 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b646c2f1-2d63-4b70-8d49-f13ed9507986 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:28.144495 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b646c2f1-2d63-4b70-8d49-f13ed9507986 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:28.144968 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b646c2f1-2d63-4b70-8d49-f13ed9507986 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:28.155044 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d1877c12-3e87-48b9-8a9f-a5a11a46b3bf tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:28.158505 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d1877c12-3e87-48b9-8a9f-a5a11a46b3bf tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:28.160357 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d1877c12-3e87-48b9-8a9f-a5a11a46b3bf tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:28.161022 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d1877c12-3e87-48b9-8a9f-a5a11a46b3bf tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:28.436940 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b646c2f1-2d63-4b70-8d49-f13ed9507986 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:28.455541 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b646c2f1-2d63-4b70-8d49-f13ed9507986 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559" status: 200 len: 1315 microversion: 2.1 time: 0.355763 Jun 10 18:11:28.459129 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2086/4077] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:28 2022] GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 => generated 1315 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:28.538196 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7d8aecea-d1ed-4dc0-99ea-c3d791c01a79 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:28.539012 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7d8aecea-d1ed-4dc0-99ea-c3d791c01a79 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 74e411c5-d389-4307-99fd-a6cf439f1c61] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:28.552752 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7d8aecea-d1ed-4dc0-99ea-c3d791c01a79 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:28.554272 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7d8aecea-d1ed-4dc0-99ea-c3d791c01a79 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:28.555751 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7d8aecea-d1ed-4dc0-99ea-c3d791c01a79 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:28.557561 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7d8aecea-d1ed-4dc0-99ea-c3d791c01a79 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:28.623073 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-7d8aecea-d1ed-4dc0-99ea-c3d791c01a79 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] HTTP exception thrown: Instance 74e411c5-d389-4307-99fd-a6cf439f1c61 could not be found. Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7d8aecea-d1ed-4dc0-99ea-c3d791c01a79 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61 HTTP/1.1 Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 74e411c5-d389-4307-99fd-a6cf439f1c61 could not be found. Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '74e411c5-d389-4307-99fd-a6cf439f1c61'} Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74e411c5-d389-4307-99fd-a6cf439f1c61 could not be found. Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74e411c5-d389-4307-99fd-a6cf439f1c61 could not be found. Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:28.625974 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:28.634720 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:28.634720 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:28.634720 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:28.634720 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:11:28.634720 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:11:28.634720 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74e411c5-d389-4307-99fd-a6cf439f1c61 could not be found. Jun 10 18:11:28.634720 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:28.634720 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7d8aecea-d1ed-4dc0-99ea-c3d791c01a79 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 404 to user: Instance 74e411c5-d389-4307-99fd-a6cf439f1c61 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:11:28.634720 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7d8aecea-d1ed-4dc0-99ea-c3d791c01a79 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61" status: 404 len: 111 microversion: 2.1 time: 0.097425 Jun 10 18:11:28.634720 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2087/4078] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:28 2022] GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:11:28.645653 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2e8c56dd-04f4-4ebe-bf1d-a4fedd560a99 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:28.646310 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2e8c56dd-04f4-4ebe-bf1d-a4fedd560a99 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:28.662594 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2e8c56dd-04f4-4ebe-bf1d-a4fedd560a99 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:28.663054 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2e8c56dd-04f4-4ebe-bf1d-a4fedd560a99 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:28.663894 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2e8c56dd-04f4-4ebe-bf1d-a4fedd560a99 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:28.664362 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2e8c56dd-04f4-4ebe-bf1d-a4fedd560a99 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:29.208165 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d1877c12-3e87-48b9-8a9f-a5a11a46b3bf tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b082ea4ee3dd46f29a326e0299d69583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d3b6f9eb74076b4c74f01fb4bd6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:29.216985 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d1877c12-3e87-48b9-8a9f-a5a11a46b3bf tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] 10.222.0.35 "GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65" status: 200 len: 1324 microversion: 2.1 time: 1.094161 Jun 10 18:11:29.217582 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1992/4079] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:28 2022] GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65 => generated 1324 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:29.232144 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-35717482-f07f-46ae-b53a-21bbef9aaa56 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c015d790>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:29.318044 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-35717482-f07f-46ae-b53a-21bbef9aaa56 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86" status: 200 len: 1427 microversion: 2.1 time: 0.096761 Jun 10 18:11:29.319281 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1993/4080] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:11:29 2022] GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86 => generated 1427 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:29.474436 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6aa9853b-f104-435f-979e-5e917f09eddb tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:29.475954 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6aa9853b-f104-435f-979e-5e917f09eddb tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:29.483941 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:11:29.487681 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6aa9853b-f104-435f-979e-5e917f09eddb tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:29.487681 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6aa9853b-f104-435f-979e-5e917f09eddb tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:29.487681 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6aa9853b-f104-435f-979e-5e917f09eddb tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:29.488548 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6aa9853b-f104-435f-979e-5e917f09eddb tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:29.538270 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2e8c56dd-04f4-4ebe-bf1d-a4fedd560a99 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:29.552026 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2e8c56dd-04f4-4ebe-bf1d-a4fedd560a99 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.915365 Jun 10 18:11:29.572568 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2088/4081] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:28 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:29.900085 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6aa9853b-f104-435f-979e-5e917f09eddb tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:29.931741 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-755821e8-b6b3-491d-8e99-d659761dfd99 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "ec033079-44eb-425d-beee-8bccdd30063c"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-755821e8-b6b3-491d-8e99-d659761dfd99 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 163 Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: {"server": {"name": 12345, "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "ec033079-44eb-425d-beee-8bccdd30063c"}]}} Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8', 'flavorRef': '452', 'networks': [{'uuid': 'ec033079-44eb-425d-beee-8bccdd30063c'}]}}} Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise error Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi 12345 Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 10 18:11:29.936582 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 10 18:11:29.946381 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 10 18:11:29.946381 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jun 10 18:11:29.946381 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:29.946381 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:29.946381 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:29.946381 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:29.946381 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:29.946381 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:29.946381 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 10 18:11:29.946381 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 10 18:11:29.946381 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jun 10 18:11:29.946381 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:29.952210 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-755821e8-b6b3-491d-8e99-d659761dfd99 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:11:29.953427 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-755821e8-b6b3-491d-8e99-d659761dfd99 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.028428 Jun 10 18:11:29.956560 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2089/4082] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:11:29 2022] POST /compute/v2.1/servers => generated 127 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:11:29.961272 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6aa9853b-f104-435f-979e-5e917f09eddb tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559" status: 200 len: 1315 microversion: 2.1 time: 0.480537 Jun 10 18:11:29.972871 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1994/4083] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:29 2022] GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 => generated 1315 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:29.984956 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d97bff65-55b6-4c4a-b34d-5a0654e023c1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:29.992532 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d97bff65-55b6-4c4a-b34d-5a0654e023c1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:30.006160 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d97bff65-55b6-4c4a-b34d-5a0654e023c1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:30.021095 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d97bff65-55b6-4c4a-b34d-5a0654e023c1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:30.022397 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d97bff65-55b6-4c4a-b34d-5a0654e023c1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:30.023250 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d97bff65-55b6-4c4a-b34d-5a0654e023c1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:30.241194 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1babd2e2-c03d-4728-897c-39cfad1a1eb8 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:30.241897 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1babd2e2-c03d-4728-897c-39cfad1a1eb8 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] [instance: dc0e228e-55d2-4eaf-94fd-61213629df65] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:30.282089 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1babd2e2-c03d-4728-897c-39cfad1a1eb8 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:30.282859 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1babd2e2-c03d-4728-897c-39cfad1a1eb8 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:30.283854 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1babd2e2-c03d-4728-897c-39cfad1a1eb8 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:30.284519 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1babd2e2-c03d-4728-897c-39cfad1a1eb8 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:30.581712 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d97bff65-55b6-4c4a-b34d-5a0654e023c1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:30.593659 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d97bff65-55b6-4c4a-b34d-5a0654e023c1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.633675 Jun 10 18:11:30.596791 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2090/4084] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:29 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:30.609516 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b39abe85-1399-4434-b65a-011903120c86 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c6257dc0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:30.689609 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1babd2e2-c03d-4728-897c-39cfad1a1eb8 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b082ea4ee3dd46f29a326e0299d69583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d3b6f9eb74076b4c74f01fb4bd6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:30.710326 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1babd2e2-c03d-4728-897c-39cfad1a1eb8 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] 10.222.0.35 "GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65" status: 200 len: 1324 microversion: 2.1 time: 0.474319 Jun 10 18:11:30.713378 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1995/4085] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:30 2022] GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65 => generated 1324 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:30.733132 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b39abe85-1399-4434-b65a-011903120c86 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86" status: 200 len: 1427 microversion: 2.1 time: 0.135032 Jun 10 18:11:30.734378 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2091/4086] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:11:30 2022] GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86 => generated 1427 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:30.738291 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fc207441-a472-4667-b9d7-62513ad33808 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:30.739166 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fc207441-a472-4667-b9d7-62513ad33808 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:30.753376 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fc207441-a472-4667-b9d7-62513ad33808 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:30.753854 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fc207441-a472-4667-b9d7-62513ad33808 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:30.754660 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fc207441-a472-4667-b9d7-62513ad33808 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:30.755112 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fc207441-a472-4667-b9d7-62513ad33808 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:30.988719 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-15217ba6-95d1-4a79-be55-39e329037b2b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:30.989572 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-15217ba6-95d1-4a79-be55-39e329037b2b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:31.004747 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-15217ba6-95d1-4a79-be55-39e329037b2b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:31.009079 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-15217ba6-95d1-4a79-be55-39e329037b2b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:31.009079 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-15217ba6-95d1-4a79-be55-39e329037b2b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:31.009079 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-15217ba6-95d1-4a79-be55-39e329037b2b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:31.010773 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fc207441-a472-4667-b9d7-62513ad33808 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:31.021000 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fc207441-a472-4667-b9d7-62513ad33808 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.306335 Jun 10 18:11:31.054698 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1996/4087] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:30 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:31.307524 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-15217ba6-95d1-4a79-be55-39e329037b2b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:31.321043 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-15217ba6-95d1-4a79-be55-39e329037b2b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559" status: 200 len: 1315 microversion: 2.1 time: 0.336318 Jun 10 18:11:31.321642 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2092/4088] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:30 2022] GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 => generated 1315 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:31.716170 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-8577089e-9413-41c3-a545-b4a7ed737668 req-2992624e-2db6-48d5-8428-2b22ee8db6c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f0a3407-710b-426e-8909-3395a119f559", "name": "network-vif-plugged", "status": "completed", "tag": "0c597e2d-7c45-426d-937e-7f012531a187"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:11:31.728934 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-265b306e-ce33-45e5-92a7-94524d5d770e tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:31.729573 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-265b306e-ce33-45e5-92a7-94524d5d770e tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] [instance: dc0e228e-55d2-4eaf-94fd-61213629df65] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:31.748944 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-8577089e-9413-41c3-a545-b4a7ed737668 req-2992624e-2db6-48d5-8428-2b22ee8db6c7 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:31.748944 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-8577089e-9413-41c3-a545-b4a7ed737668 req-2992624e-2db6-48d5-8428-2b22ee8db6c7 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:31.749149 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-265b306e-ce33-45e5-92a7-94524d5d770e tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:31.749149 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-265b306e-ce33-45e5-92a7-94524d5d770e tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:31.751993 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-265b306e-ce33-45e5-92a7-94524d5d770e tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:31.753582 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-265b306e-ce33-45e5-92a7-94524d5d770e tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:31.783117 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-8577089e-9413-41c3-a545-b4a7ed737668 req-2992624e-2db6-48d5-8428-2b22ee8db6c7 service nova] Creating event network-vif-plugged:0c597e2d-7c45-426d-937e-7f012531a187 for instance 4f0a3407-710b-426e-8909-3395a119f559 on chh2-master-2 Jun 10 18:11:31.821253 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-8577089e-9413-41c3-a545-b4a7ed737668 req-2992624e-2db6-48d5-8428-2b22ee8db6c7 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108689 Jun 10 18:11:31.842630 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1997/4089] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:11:31.867725 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d281bcf0-358e-4a57-b2d9-551f1d3e71f9 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c015d160>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:32.018604 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d281bcf0-358e-4a57-b2d9-551f1d3e71f9 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86" status: 200 len: 1427 microversion: 2.1 time: 0.174240 Jun 10 18:11:32.028714 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1998/4090] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:11:31 2022] GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86 => generated 1427 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:32.221032 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-265b306e-ce33-45e5-92a7-94524d5d770e tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b082ea4ee3dd46f29a326e0299d69583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d3b6f9eb74076b4c74f01fb4bd6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:32.233013 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-265b306e-ce33-45e5-92a7-94524d5d770e tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] 10.222.0.35 "GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65" status: 200 len: 1324 microversion: 2.1 time: 0.506996 Jun 10 18:11:32.236646 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2093/4091] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:31 2022] GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65 => generated 1324 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:32.338773 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-02f2144b-6d80-4b12-814c-75e00c260956 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:32.339691 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-02f2144b-6d80-4b12-814c-75e00c260956 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:32.351644 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02f2144b-6d80-4b12-814c-75e00c260956 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:32.361167 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02f2144b-6d80-4b12-814c-75e00c260956 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:32.368777 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02f2144b-6d80-4b12-814c-75e00c260956 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:32.369858 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02f2144b-6d80-4b12-814c-75e00c260956 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:33.042939 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0287958b-0045-48b5-855a-c403422dd702 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c005a1f0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:33.136748 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0287958b-0045-48b5-855a-c403422dd702 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86" status: 200 len: 1427 microversion: 2.1 time: 0.098753 Jun 10 18:11:33.137339 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2094/4092] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:11:33 2022] GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86 => generated 1427 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:11:33.251897 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-beb84a43-8d0d-45a0-93a1-9285e3286c95 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:33.252727 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-beb84a43-8d0d-45a0-93a1-9285e3286c95 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] [instance: dc0e228e-55d2-4eaf-94fd-61213629df65] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:33.270053 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-beb84a43-8d0d-45a0-93a1-9285e3286c95 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:33.270525 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-beb84a43-8d0d-45a0-93a1-9285e3286c95 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:33.284144 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-beb84a43-8d0d-45a0-93a1-9285e3286c95 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:33.296391 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-beb84a43-8d0d-45a0-93a1-9285e3286c95 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:33.348277 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-02f2144b-6d80-4b12-814c-75e00c260956 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:33.363363 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-02f2144b-6d80-4b12-814c-75e00c260956 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559" status: 200 len: 1315 microversion: 2.1 time: 1.028536 Jun 10 18:11:33.363985 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 1999/4093] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:32 2022] GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 => generated 1315 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:34.062799 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-beb84a43-8d0d-45a0-93a1-9285e3286c95 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b082ea4ee3dd46f29a326e0299d69583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d3b6f9eb74076b4c74f01fb4bd6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:34.077360 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-beb84a43-8d0d-45a0-93a1-9285e3286c95 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] 10.222.0.35 "GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65" status: 200 len: 1324 microversion: 2.1 time: 0.829211 Jun 10 18:11:34.078594 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2095/4094] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:33 2022] GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65 => generated 1324 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:34.155733 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bbe5d35e-0e16-4171-b8e8-517280f4cefd tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c015d8b0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:34.278546 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bbe5d35e-0e16-4171-b8e8-517280f4cefd tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86" status: 200 len: 1427 microversion: 2.1 time: 0.132745 Jun 10 18:11:34.279899 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2000/4095] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:11:34 2022] GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86 => generated 1427 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:34.380507 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-75382253-f530-4884-a08b-1412fbdf5ac4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:34.381482 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-75382253-f530-4884-a08b-1412fbdf5ac4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:34.394944 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-75382253-f530-4884-a08b-1412fbdf5ac4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:34.395782 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-75382253-f530-4884-a08b-1412fbdf5ac4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:34.396844 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-75382253-f530-4884-a08b-1412fbdf5ac4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:34.397515 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-75382253-f530-4884-a08b-1412fbdf5ac4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:34.888125 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-75382253-f530-4884-a08b-1412fbdf5ac4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:34.899714 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-75382253-f530-4884-a08b-1412fbdf5ac4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559" status: 200 len: 1501 microversion: 2.1 time: 0.521948 Jun 10 18:11:34.903410 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2096/4096] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:34 2022] GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 => generated 1501 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:34.920937 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-429c1244-775f-4131-809f-ee1d5ff4e416 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:11:34.940234 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-429c1244-775f-4131-809f-ee1d5ff4e416 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:34.949105 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-429c1244-775f-4131-809f-ee1d5ff4e416 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:35.003692 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-429c1244-775f-4131-809f-ee1d5ff4e416 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] Going to try to stop instance {{(pid=126595) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 10 18:11:35.093831 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9ba0c658-0ddb-4870-9d91-75dcf9dde39f tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:35.094559 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9ba0c658-0ddb-4870-9d91-75dcf9dde39f tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] [instance: dc0e228e-55d2-4eaf-94fd-61213629df65] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:35.114312 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9ba0c658-0ddb-4870-9d91-75dcf9dde39f tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:35.114837 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9ba0c658-0ddb-4870-9d91-75dcf9dde39f tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:35.115555 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9ba0c658-0ddb-4870-9d91-75dcf9dde39f tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:35.116168 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9ba0c658-0ddb-4870-9d91-75dcf9dde39f tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:35.148197 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:11:35.237664 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-429c1244-775f-4131-809f-ee1d5ff4e416 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "POST /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559/action" status: 202 len: 0 microversion: 2.1 time: 0.322133 Jun 10 18:11:35.240334 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2001/4097] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:11:34 2022] POST /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:11:35.268610 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-914c434b-9922-436e-ab19-5f73b34c705f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:35.270844 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-914c434b-9922-436e-ab19-5f73b34c705f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:35.284796 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-914c434b-9922-436e-ab19-5f73b34c705f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:35.287953 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-914c434b-9922-436e-ab19-5f73b34c705f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:35.291794 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-914c434b-9922-436e-ab19-5f73b34c705f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:35.295010 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-914c434b-9922-436e-ab19-5f73b34c705f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:35.357719 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:11:35.365466 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9ba0c658-0ddb-4870-9d91-75dcf9dde39f tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b082ea4ee3dd46f29a326e0299d69583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d3b6f9eb74076b4c74f01fb4bd6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:35.374152 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9ba0c658-0ddb-4870-9d91-75dcf9dde39f tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] 10.222.0.35 "GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65" status: 200 len: 1324 microversion: 2.1 time: 0.284097 Jun 10 18:11:35.387171 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2097/4098] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:35 2022] GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65 => generated 1324 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:11:35.399602 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d8740506-329f-4f35-af67-ac73110cd4b3 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c0d0a160>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:35.486787 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d8740506-329f-4f35-af67-ac73110cd4b3 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86" status: 200 len: 1427 microversion: 2.1 time: 0.098194 Jun 10 18:11:35.487756 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2098/4099] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:11:35 2022] GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86 => generated 1427 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:35.725461 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-914c434b-9922-436e-ab19-5f73b34c705f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:35.737376 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-914c434b-9922-436e-ab19-5f73b34c705f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559" status: 200 len: 1511 microversion: 2.1 time: 0.482298 Jun 10 18:11:35.751155 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2002/4100] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:35 2022] GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 => generated 1511 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:36.102705 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-085c70cb-dd67-4018-a186-8d4e7d8eebdc tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-587380455", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "acf8874a-63a4-42ec-ac03-8b489c811c95", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "ec033079-44eb-425d-beee-8bccdd30063c"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:11:36.108674 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-2669fb13-31d6-4416-a96c-646dcb7031ae req-2f5cbeca-6deb-424f-822a-ead4c216fca3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc0e228e-55d2-4eaf-94fd-61213629df65", "name": "network-vif-plugged", "status": "completed", "tag": "228a8879-fa9d-4731-b769-d54d6f0b6e9e"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:11:36.138347 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-2669fb13-31d6-4416-a96c-646dcb7031ae req-2f5cbeca-6deb-424f-822a-ead4c216fca3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:36.141917 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-2669fb13-31d6-4416-a96c-646dcb7031ae req-2f5cbeca-6deb-424f-822a-ead4c216fca3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:36.171367 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-2669fb13-31d6-4416-a96c-646dcb7031ae req-2f5cbeca-6deb-424f-822a-ead4c216fca3 service nova] Creating event network-vif-plugged:228a8879-fa9d-4731-b769-d54d6f0b6e9e for instance dc0e228e-55d2-4eaf-94fd-61213629df65 on chh2-master-2 Jun 10 18:11:36.177511 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-2669fb13-31d6-4416-a96c-646dcb7031ae req-2f5cbeca-6deb-424f-822a-ead4c216fca3 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072587 Jun 10 18:11:36.178765 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2003/4101] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:11:36.275270 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-085c70cb-dd67-4018-a186-8d4e7d8eebdc tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] HTTP exception thrown: Block Device acf8874a-63a4-42ec-ac03-8b489c811c95 is not bootable. Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-085c70cb-dd67-4018-a186-8d4e7d8eebdc tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 357 Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-587380455", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "acf8874a-63a4-42ec-ac03-8b489c811c95", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "ec033079-44eb-425d-beee-8bccdd30063c"}]}} Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: exception: Block Device acf8874a-63a4-42ec-ac03-8b489c811c95 is not bootable. Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-587380455', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'acf8874a-63a4-42ec-ac03-8b489c811c95'}], 'networks': [{'uuid': 'ec033079-44eb-425d-beee-8bccdd30063c'}]}}} Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1622, in _create_instance Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device acf8874a-63a4-42ec-ac03-8b489c811c95 is not bootable. Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:11:36.287700 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:11:36.292546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:11:36.292546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:11:36.292546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:11:36.292546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 10 18:11:36.292546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jun 10 18:11:36.292546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jun 10 18:11:36.292546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device acf8874a-63a4-42ec-ac03-8b489c811c95 is not bootable. Jun 10 18:11:36.292546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:36.292546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:36.292546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:36.292546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:36.292546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:36.292546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:36.292546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:11:36.292546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:11:36.292546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device acf8874a-63a4-42ec-ac03-8b489c811c95 is not bootable. Jun 10 18:11:36.292546 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:36.294385 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-085c70cb-dd67-4018-a186-8d4e7d8eebdc tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 400 to user: Block Device acf8874a-63a4-42ec-ac03-8b489c811c95 is not bootable. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:11:36.296201 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-085c70cb-dd67-4018-a186-8d4e7d8eebdc tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.197696 Jun 10 18:11:36.298165 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2099/4102] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:11:36 2022] POST /compute/v2.1/servers => generated 110 bytes in 200 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:11:36.306414 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-106e38a7-c18d-479f-8e51-2ffa0d462e47 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:36.307135 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-106e38a7-c18d-479f-8e51-2ffa0d462e47 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:36.313817 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-106e38a7-c18d-479f-8e51-2ffa0d462e47 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:36.314475 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-106e38a7-c18d-479f-8e51-2ffa0d462e47 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:36.315455 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-106e38a7-c18d-479f-8e51-2ffa0d462e47 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:36.316057 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-106e38a7-c18d-479f-8e51-2ffa0d462e47 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:36.392568 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-56eb5245-564b-4b36-8b3e-1fc81d462f6d tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:36.393561 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-56eb5245-564b-4b36-8b3e-1fc81d462f6d tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] [instance: dc0e228e-55d2-4eaf-94fd-61213629df65] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:36.406534 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-56eb5245-564b-4b36-8b3e-1fc81d462f6d tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:36.408264 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-56eb5245-564b-4b36-8b3e-1fc81d462f6d tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:36.408581 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-56eb5245-564b-4b36-8b3e-1fc81d462f6d tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:36.409443 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-56eb5245-564b-4b36-8b3e-1fc81d462f6d tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:36.909253 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-106e38a7-c18d-479f-8e51-2ffa0d462e47 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:36.924593 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-106e38a7-c18d-479f-8e51-2ffa0d462e47 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.622438 Jun 10 18:11:36.930193 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2004/4103] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:36 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:36.946679 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e158de76-78c7-408f-9687-5760648d978d tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c014c040>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:37.037508 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-56eb5245-564b-4b36-8b3e-1fc81d462f6d tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b082ea4ee3dd46f29a326e0299d69583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d3b6f9eb74076b4c74f01fb4bd6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:37.050629 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-56eb5245-564b-4b36-8b3e-1fc81d462f6d tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] 10.222.0.35 "GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65" status: 200 len: 1324 microversion: 2.1 time: 0.658234 Jun 10 18:11:37.050955 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e158de76-78c7-408f-9687-5760648d978d tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86" status: 200 len: 1427 microversion: 2.1 time: 0.115586 Jun 10 18:11:37.051547 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2005/4104] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:11:36 2022] GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86 => generated 1427 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:37.051821 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2100/4105] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:36 2022] GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65 => generated 1324 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:11:37.063958 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5db14b11-c58f-4e4d-8366-f6dfbee7d097 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:37.064861 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5db14b11-c58f-4e4d-8366-f6dfbee7d097 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:37.072217 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-495b6b88-c2cf-4471-a28d-e9c70e1e2d7c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:37.074057 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-495b6b88-c2cf-4471-a28d-e9c70e1e2d7c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:37.082218 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5db14b11-c58f-4e4d-8366-f6dfbee7d097 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:37.083036 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5db14b11-c58f-4e4d-8366-f6dfbee7d097 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:37.084006 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5db14b11-c58f-4e4d-8366-f6dfbee7d097 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:37.084826 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5db14b11-c58f-4e4d-8366-f6dfbee7d097 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:37.107914 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-495b6b88-c2cf-4471-a28d-e9c70e1e2d7c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:37.111320 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-495b6b88-c2cf-4471-a28d-e9c70e1e2d7c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:37.112350 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-495b6b88-c2cf-4471-a28d-e9c70e1e2d7c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:37.115536 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-495b6b88-c2cf-4471-a28d-e9c70e1e2d7c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:37.466652 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5db14b11-c58f-4e4d-8366-f6dfbee7d097 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:37.480859 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5db14b11-c58f-4e4d-8366-f6dfbee7d097 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.425318 Jun 10 18:11:37.494063 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2006/4106] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:37 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:37.671916 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-495b6b88-c2cf-4471-a28d-e9c70e1e2d7c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:37.681709 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-495b6b88-c2cf-4471-a28d-e9c70e1e2d7c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559" status: 200 len: 1511 microversion: 2.1 time: 0.628419 Jun 10 18:11:37.689047 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2101/4107] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:37 2022] GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 => generated 1511 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:38.067385 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b97f528d-e689-4b1c-9000-b58802f405d4 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:38.068043 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b97f528d-e689-4b1c-9000-b58802f405d4 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] [instance: dc0e228e-55d2-4eaf-94fd-61213629df65] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:38.082948 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cf138d98-73d1-46d4-84ec-7fb738c39a0c tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c00a6430>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:38.105156 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b97f528d-e689-4b1c-9000-b58802f405d4 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:38.105621 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b97f528d-e689-4b1c-9000-b58802f405d4 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:38.106438 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b97f528d-e689-4b1c-9000-b58802f405d4 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:38.106938 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b97f528d-e689-4b1c-9000-b58802f405d4 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:38.158417 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cf138d98-73d1-46d4-84ec-7fb738c39a0c tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86" status: 200 len: 1436 microversion: 2.1 time: 0.084906 Jun 10 18:11:38.166487 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2102/4108] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:11:38 2022] GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86 => generated 1436 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:38.179329 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c4d791f7-7de6-4d80-a660-6df646ae7197 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77b3f8ea60>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:38.306301 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c4d791f7-7de6-4d80-a660-6df646ae7197 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86" status: 200 len: 1436 microversion: 2.1 time: 0.138028 Jun 10 18:11:38.317868 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2103/4109] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:11:38 2022] GET /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86 => generated 1436 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:11:38.331150 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cf4e59b6-73fc-4d31-9296-b9906d73b230 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:38.333252 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cf4e59b6-73fc-4d31-9296-b9906d73b230 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] [instance: 911b33c1-545d-4bcb-9ca1-c42c7bda606b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:38.355588 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf4e59b6-73fc-4d31-9296-b9906d73b230 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:38.357655 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf4e59b6-73fc-4d31-9296-b9906d73b230 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:38.362481 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf4e59b6-73fc-4d31-9296-b9906d73b230 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:38.372750 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf4e59b6-73fc-4d31-9296-b9906d73b230 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:38.595184 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b97f528d-e689-4b1c-9000-b58802f405d4 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b082ea4ee3dd46f29a326e0299d69583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d3b6f9eb74076b4c74f01fb4bd6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:38.625913 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b97f528d-e689-4b1c-9000-b58802f405d4 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] 10.222.0.35 "GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65" status: 200 len: 1324 microversion: 2.1 time: 0.558648 Jun 10 18:11:38.628534 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2007/4110] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:38 2022] GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65 => generated 1324 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:38.708832 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9356f9d6-2a25-415d-9b1d-6dd9730afebb tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:38.710132 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9356f9d6-2a25-415d-9b1d-6dd9730afebb tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:38.723111 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9356f9d6-2a25-415d-9b1d-6dd9730afebb tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:38.725319 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9356f9d6-2a25-415d-9b1d-6dd9730afebb tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:38.736538 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9356f9d6-2a25-415d-9b1d-6dd9730afebb tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:38.736538 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9356f9d6-2a25-415d-9b1d-6dd9730afebb tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:38.989055 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cf4e59b6-73fc-4d31-9296-b9906d73b230 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc673eee8339438cbb69ac8bc8df633e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38326c7c8786498a94e003d80740c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:38.997621 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cf4e59b6-73fc-4d31-9296-b9906d73b230 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b" status: 200 len: 1480 microversion: 2.1 time: 0.678584 Jun 10 18:11:39.008842 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2104/4111] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:38 2022] GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b => generated 1480 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:39.091986 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9356f9d6-2a25-415d-9b1d-6dd9730afebb tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:39.110881 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9356f9d6-2a25-415d-9b1d-6dd9730afebb tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559" status: 200 len: 1511 microversion: 2.1 time: 0.407707 Jun 10 18:11:39.111618 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2008/4112] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:38 2022] GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 => generated 1511 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:11:39.642953 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6a2efe08-bfa7-4c19-8965-f60334234bfc tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:39.643571 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6a2efe08-bfa7-4c19-8965-f60334234bfc tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] [instance: dc0e228e-55d2-4eaf-94fd-61213629df65] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:39.655692 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6a2efe08-bfa7-4c19-8965-f60334234bfc tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:39.656411 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6a2efe08-bfa7-4c19-8965-f60334234bfc tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:39.660771 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6a2efe08-bfa7-4c19-8965-f60334234bfc tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:39.660771 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6a2efe08-bfa7-4c19-8965-f60334234bfc tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:40.030063 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5083bd46-a7f5-413a-b284-5df0a9df7349 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:40.030857 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5083bd46-a7f5-413a-b284-5df0a9df7349 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] [instance: 911b33c1-545d-4bcb-9ca1-c42c7bda606b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:40.040012 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5083bd46-a7f5-413a-b284-5df0a9df7349 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:40.040717 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5083bd46-a7f5-413a-b284-5df0a9df7349 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:40.041961 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5083bd46-a7f5-413a-b284-5df0a9df7349 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:40.042606 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5083bd46-a7f5-413a-b284-5df0a9df7349 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:40.208153 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5083bd46-a7f5-413a-b284-5df0a9df7349 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc673eee8339438cbb69ac8bc8df633e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38326c7c8786498a94e003d80740c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:40.218119 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5083bd46-a7f5-413a-b284-5df0a9df7349 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b" status: 200 len: 1467 microversion: 2.1 time: 0.194388 Jun 10 18:11:40.218920 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2009/4113] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:40 2022] GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b => generated 1467 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:11:40.223641 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-be302611-06d5-4771-86c2-879fd7e3ebb3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:40.224254 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-be302611-06d5-4771-86c2-879fd7e3ebb3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:40.230990 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-be302611-06d5-4771-86c2-879fd7e3ebb3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:40.231715 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-be302611-06d5-4771-86c2-879fd7e3ebb3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:40.233002 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-be302611-06d5-4771-86c2-879fd7e3ebb3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:40.233453 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-be302611-06d5-4771-86c2-879fd7e3ebb3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:40.385477 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-be302611-06d5-4771-86c2-879fd7e3ebb3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:40.398455 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-be302611-06d5-4771-86c2-879fd7e3ebb3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559" status: 200 len: 1511 microversion: 2.1 time: 0.177993 Jun 10 18:11:40.400275 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2010/4114] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:40 2022] GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 => generated 1511 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:40.418132 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-226094d5-c50f-462b-9ec7-67d64ed50d49 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c010f5e0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:40.512728 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6a2efe08-bfa7-4c19-8965-f60334234bfc tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b082ea4ee3dd46f29a326e0299d69583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d3b6f9eb74076b4c74f01fb4bd6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:40.524136 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6a2efe08-bfa7-4c19-8965-f60334234bfc tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] 10.222.0.35 "GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65" status: 200 len: 1521 microversion: 2.1 time: 0.884981 Jun 10 18:11:40.525177 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2105/4115] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:39 2022] GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65 => generated 1521 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:40.541201 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-57624033-5ccb-49b2-b41a-f1c948688a13 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:40.541782 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-57624033-5ccb-49b2-b41a-f1c948688a13 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] [instance: dc0e228e-55d2-4eaf-94fd-61213629df65] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:40.552427 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-57624033-5ccb-49b2-b41a-f1c948688a13 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:40.565005 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-57624033-5ccb-49b2-b41a-f1c948688a13 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:40.565864 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-57624033-5ccb-49b2-b41a-f1c948688a13 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:40.566324 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-57624033-5ccb-49b2-b41a-f1c948688a13 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:40.596983 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-57624033-5ccb-49b2-b41a-f1c948688a13 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] HTTP exception thrown: Instance is not a member of specified network Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-57624033-5ccb-49b2-b41a-f1c948688a13 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Request method failure captured: Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65/ips/invalid HTTP/1.1 Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4lAF6shLX9KYr8RUNeaveC4jy0PJ6Qs43hERengYxwDpMODiMVZ_5aKgP7Q2Pv8ouIEfj6mHTeaV6T6kAjYK_FkcMweXxjeF-phvDGMEMO8Mvhq2tAJPF06FYQ1qPQgAmZ9xPxQ6zmlhdycdHvki990Givo78u16_PpigDQUtvoPZk Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: c84d3b6f9eb74076b4c74f01fb4bd6e8 Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-859363046 Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/c84d3b6f9eb74076b4c74f01fb4bd6e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c84d3b6f9eb74076b4c74f01fb4bd6e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c84d3b6f9eb74076b4c74f01fb4bd6e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_c84d3b6f9eb74076b4c74f01fb4bd6e8", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-859363046 Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: c84d3b6f9eb74076b4c74f01fb4bd6e8 Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-859363046 Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServerAddressesNegativeTestJSON-859363046-project Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: b082ea4ee3dd46f29a326e0299d69583 Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-859363046-project Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: exception: Instance is not a member of specified network Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: action_args: {'server_id': 'dc0e228e-55d2-4eaf-94fd-61213629df65', 'id': 'invalid'} Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Jun 10 18:11:40.603087 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:40.607113 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-57624033-5ccb-49b2-b41a-f1c948688a13 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Returning 404 to user: Instance is not a member of specified network {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:11:40.607345 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-57624033-5ccb-49b2-b41a-f1c948688a13 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] 10.222.0.35 "GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.069911 Jun 10 18:11:40.608372 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2106/4116] 10.222.0.35 () {58 vars in 1271 bytes} [Fri Jun 10 18:11:40 2022] GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65/ips/invalid => generated 91 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 10 18:11:40.622703 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2ceb307b-0ee9-44e8-ab50-88f162c62956 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:40.623233 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2ceb307b-0ee9-44e8-ab50-88f162c62956 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Failed to fetch instance by id 999 {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 10 18:11:40.623736 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-2ceb307b-0ee9-44e8-ab50-88f162c62956 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] HTTP exception thrown: Instance 999 could not be found. Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2ceb307b-0ee9-44e8-ab50-88f162c62956 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Request method failure captured: Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4lAF6shLX9KYr8RUNeaveC4jy0PJ6Qs43hERengYxwDpMODiMVZ_5aKgP7Q2Pv8ouIEfj6mHTeaV6T6kAjYK_FkcMweXxjeF-phvDGMEMO8Mvhq2tAJPF06FYQ1qPQgAmZ9xPxQ6zmlhdycdHvki990Givo78u16_PpigDQUtvoPZk Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: c84d3b6f9eb74076b4c74f01fb4bd6e8 Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-859363046 Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/c84d3b6f9eb74076b4c74f01fb4bd6e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c84d3b6f9eb74076b4c74f01fb4bd6e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c84d3b6f9eb74076b4c74f01fb4bd6e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_c84d3b6f9eb74076b4c74f01fb4bd6e8", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-859363046 Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: c84d3b6f9eb74076b4c74f01fb4bd6e8 Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-859363046 Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServerAddressesNegativeTestJSON-859363046-project Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: b082ea4ee3dd46f29a326e0299d69583 Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-859363046-project Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 999 could not be found. Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: action_args: {'server_id': '999'} Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jun 10 18:11:40.628529 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:40.635909 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2ceb307b-0ee9-44e8-ab50-88f162c62956 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Returning 404 to user: Instance 999 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:11:40.637119 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2ceb307b-0ee9-44e8-ab50-88f162c62956 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] 10.222.0.35 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.023504 Jun 10 18:11:40.639449 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2107/4117] 10.222.0.35 () {58 vars in 1148 bytes} [Fri Jun 10 18:11:40 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:11:40.653617 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-90c6c31c-e02d-4219-a4dc-37a1e00c347f tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:40.654242 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-90c6c31c-e02d-4219-a4dc-37a1e00c347f tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] [instance: dc0e228e-55d2-4eaf-94fd-61213629df65] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:40.665507 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90c6c31c-e02d-4219-a4dc-37a1e00c347f tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:40.665966 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90c6c31c-e02d-4219-a4dc-37a1e00c347f tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:40.668424 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90c6c31c-e02d-4219-a4dc-37a1e00c347f tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:40.668424 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90c6c31c-e02d-4219-a4dc-37a1e00c347f tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:40.700369 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-90c6c31c-e02d-4219-a4dc-37a1e00c347f tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] [instance: dc0e228e-55d2-4eaf-94fd-61213629df65] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:11:41.062529 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-90c6c31c-e02d-4219-a4dc-37a1e00c347f tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] 10.222.0.35 "DELETE /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65" status: 204 len: 0 microversion: 2.1 time: 0.414456 Jun 10 18:11:41.063143 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2108/4118] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:11:40 2022] DELETE /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 18:11:41.080120 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ad326f6e-ebcc-4b9b-ae9b-bf7751998333 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1718168963", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "destination_type": "local"}, {"source_type": "volume", "uuid": "77e23ca5-57ac-4f7b-950c-d218ca8b549a", "destination_type": "invalid"}], "networks": [{"uuid": "ec033079-44eb-425d-beee-8bccdd30063c"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ad326f6e-ebcc-4b9b-ae9b-bf7751998333 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 495 Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1718168963", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "destination_type": "local"}, {"source_type": "volume", "uuid": "77e23ca5-57ac-4f7b-950c-d218ca8b549a", "destination_type": "invalid"}], "networks": [{"uuid": "ec033079-44eb-425d-beee-8bccdd30063c"}]}} Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1718168963', 'imageRef': 'efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '77e23ca5-57ac-4f7b-950c-d218ca8b549a', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'ec033079-44eb-425d-beee-8bccdd30063c'}]}}} Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise error Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi 'invalid' Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:11:41.084750 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:11:41.094244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:11:41.094244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:11:41.094244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 10 18:11:41.094244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 10 18:11:41.094244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 10 18:11:41.094244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 10 18:11:41.094244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 10 18:11:41.094244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 10 18:11:41.094244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jun 10 18:11:41.094244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:41.094244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:41.094244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:41.094244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:41.094244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:41.094244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:41.094244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 10 18:11:41.094244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 10 18:11:41.094244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jun 10 18:11:41.094244 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:41.094244 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ad326f6e-ebcc-4b9b-ae9b-bf7751998333 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:11:41.094244 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ad326f6e-ebcc-4b9b-ae9b-bf7751998333 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.017517 Jun 10 18:11:41.094244 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2109/4119] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:11:41 2022] POST /compute/v2.1/servers => generated 155 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:11:41.097889 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-aca77409-b8fe-4c2e-85b0-6a535fc1f1b9 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:41.098638 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-aca77409-b8fe-4c2e-85b0-6a535fc1f1b9 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] [instance: dc0e228e-55d2-4eaf-94fd-61213629df65] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:41.106349 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aca77409-b8fe-4c2e-85b0-6a535fc1f1b9 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:41.106911 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aca77409-b8fe-4c2e-85b0-6a535fc1f1b9 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:41.107706 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aca77409-b8fe-4c2e-85b0-6a535fc1f1b9 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:41.108192 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aca77409-b8fe-4c2e-85b0-6a535fc1f1b9 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:41.285346 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-aca77409-b8fe-4c2e-85b0-6a535fc1f1b9 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b082ea4ee3dd46f29a326e0299d69583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d3b6f9eb74076b4c74f01fb4bd6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:41.295250 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-aca77409-b8fe-4c2e-85b0-6a535fc1f1b9 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] 10.222.0.35 "GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65" status: 200 len: 1527 microversion: 2.1 time: 0.207043 Jun 10 18:11:41.306579 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2110/4120] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:41 2022] GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65 => generated 1527 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:41.312916 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4fb83991-db63-48d8-8fd7-70c55f65aca0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:41.313958 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4fb83991-db63-48d8-8fd7-70c55f65aca0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:41.322708 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4fb83991-db63-48d8-8fd7-70c55f65aca0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:41.326314 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4fb83991-db63-48d8-8fd7-70c55f65aca0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:41.326314 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4fb83991-db63-48d8-8fd7-70c55f65aca0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:41.326314 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4fb83991-db63-48d8-8fd7-70c55f65aca0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:41.809128 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4fb83991-db63-48d8-8fd7-70c55f65aca0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:41.821335 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4fb83991-db63-48d8-8fd7-70c55f65aca0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.512188 Jun 10 18:11:41.822559 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2111/4121] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:41 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:41.829976 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2d5892ef-de7b-4cdb-ace2-9cbf3d094e11 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:41.831598 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2d5892ef-de7b-4cdb-ace2-9cbf3d094e11 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:41.840296 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2d5892ef-de7b-4cdb-ace2-9cbf3d094e11 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:41.840909 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2d5892ef-de7b-4cdb-ace2-9cbf3d094e11 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:41.841795 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2d5892ef-de7b-4cdb-ace2-9cbf3d094e11 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:41.842299 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2d5892ef-de7b-4cdb-ace2-9cbf3d094e11 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:42.068201 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2d5892ef-de7b-4cdb-ace2-9cbf3d094e11 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:42.080829 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2d5892ef-de7b-4cdb-ace2-9cbf3d094e11 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559" status: 200 len: 1511 microversion: 2.1 time: 0.255810 Jun 10 18:11:42.082406 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2112/4122] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:41 2022] GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 => generated 1511 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:42.088950 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-3826622d-59c6-48da-b909-19490dd8600e req-9a1bdbba-a345-462d-b789-4f948d368ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "911b33c1-545d-4bcb-9ca1-c42c7bda606b", "name": "network-vif-unplugged", "status": "completed", "tag": "a7249e1c-d1cb-43c4-9fa6-d68705a79807"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:11:42.098394 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-3826622d-59c6-48da-b909-19490dd8600e req-9a1bdbba-a345-462d-b789-4f948d368ed8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:42.098846 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-3826622d-59c6-48da-b909-19490dd8600e req-9a1bdbba-a345-462d-b789-4f948d368ed8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:42.112845 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-3826622d-59c6-48da-b909-19490dd8600e req-9a1bdbba-a345-462d-b789-4f948d368ed8 service nova] Creating event network-vif-unplugged:a7249e1c-d1cb-43c4-9fa6-d68705a79807 for instance 911b33c1-545d-4bcb-9ca1-c42c7bda606b on chh2-master-2 Jun 10 18:11:42.119459 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-3826622d-59c6-48da-b909-19490dd8600e req-9a1bdbba-a345-462d-b789-4f948d368ed8 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035639 Jun 10 18:11:42.120069 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2113/4123] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:11:42.126905 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9380665e-8dce-402f-afa0-dde84bc61dd5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:42.127658 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9380665e-8dce-402f-afa0-dde84bc61dd5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:42.135995 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9380665e-8dce-402f-afa0-dde84bc61dd5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:42.136643 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9380665e-8dce-402f-afa0-dde84bc61dd5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:42.137605 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9380665e-8dce-402f-afa0-dde84bc61dd5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:42.139296 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9380665e-8dce-402f-afa0-dde84bc61dd5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:42.330744 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9380665e-8dce-402f-afa0-dde84bc61dd5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:42.343695 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9380665e-8dce-402f-afa0-dde84bc61dd5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.222295 Jun 10 18:11:42.346107 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2114/4124] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:42 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:42.353792 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0580a2f8-d3ff-435d-9bb8-e030768065a7 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:42.355945 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0580a2f8-d3ff-435d-9bb8-e030768065a7 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] [instance: dc0e228e-55d2-4eaf-94fd-61213629df65] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:42.370711 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0580a2f8-d3ff-435d-9bb8-e030768065a7 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:42.371293 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0580a2f8-d3ff-435d-9bb8-e030768065a7 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:42.372171 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0580a2f8-d3ff-435d-9bb8-e030768065a7 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:42.372720 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0580a2f8-d3ff-435d-9bb8-e030768065a7 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:42.431445 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-226094d5-c50f-462b-9ec7-67d64ed50d49 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "DELETE /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86" status: 204 len: 0 microversion: 2.1 time: 2.019064 Jun 10 18:11:42.435441 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2011/4125] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:40 2022] DELETE /compute/v2.1/images/05013587-398f-47d2-8fe4-a60c9b9f4b86 => generated 0 bytes in 2021 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:11:42.441440 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f0762d09-797f-4249-b9f7-1edc2ab64820 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '.version_select at 0x7f77c0396040>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:42.472550 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-f0762d09-797f-4249-b9f7-1edc2ab64820 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] HTTP exception thrown: Image not found. Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f0762d09-797f-4249-b9f7-1edc2ab64820 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Request method failure captured: Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/images/8a932e43-b89d-4e0e-9927-1a9b2061c2c0 HTTP/1.1 Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4j4MT-Z4ESW-ZHH6v8qYBfWBshBMMUFsUuM8cUmod3OeulH_mDx0ocIcUj9YyynmHF_Z5imsjOxOdJVshTHuvrNGuSN8INlqRSjbYgIb6xukMFFk0_xl3e3vNEegzqVTqoWA_QJthN3aTiAPxlMFBlUt8a1ohNMLRH_qiRTq_4U9kI Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 38326c7c8786498a94e003d80740c5cf Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ImagesOneServerTestJSON-800511224 Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/38326c7c8786498a94e003d80740c5cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/38326c7c8786498a94e003d80740c5cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/38326c7c8786498a94e003d80740c5cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_38326c7c8786498a94e003d80740c5cf", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ImagesOneServerTestJSON-800511224 Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 38326c7c8786498a94e003d80740c5cf Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-800511224 Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ImagesOneServerTestJSON-800511224-project Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: cc673eee8339438cbb69ac8bc8df633e Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ImagesOneServerTestJSON-800511224-project Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: exception: Image not found. Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '8a932e43-b89d-4e0e-9927-1a9b2061c2c0'} Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8a932e43-b89d-4e0e-9927-1a9b2061c2c0 to delete Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8a932e43-b89d-4e0e-9927-1a9b2061c2c0 could not be found. Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:42.474903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:42.480687 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:42.480687 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:42.480687 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:11:42.480687 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:11:42.480687 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:11:42.480687 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:11:42.480687 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:11:42.480687 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:11:42.480687 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 10 18:11:42.480687 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 10 18:11:42.480687 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 10 18:11:42.480687 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:42.480687 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:42.480687 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:42.480687 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:42.480687 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:42.480687 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:42.480687 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:11:42.480687 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:11:42.480687 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 10 18:11:42.480687 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:42.487253 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f0762d09-797f-4249-b9f7-1edc2ab64820 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Returning 404 to user: Image not found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:11:42.487253 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f0762d09-797f-4249-b9f7-1edc2ab64820 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "DELETE /compute/v2.1/images/8a932e43-b89d-4e0e-9927-1a9b2061c2c0" status: 404 len: 62 microversion: 2.1 time: 0.046056 Jun 10 18:11:42.487253 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2012/4126] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:42 2022] DELETE /compute/v2.1/images/8a932e43-b89d-4e0e-9927-1a9b2061c2c0 => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:11:42.495788 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6eb6ea44-c726-449c-945e-ed75d127a2bb tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:42.497271 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6eb6ea44-c726-449c-945e-ed75d127a2bb tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] [instance: 911b33c1-545d-4bcb-9ca1-c42c7bda606b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:42.506017 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6eb6ea44-c726-449c-945e-ed75d127a2bb tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:42.507288 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6eb6ea44-c726-449c-945e-ed75d127a2bb tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:42.509083 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6eb6ea44-c726-449c-945e-ed75d127a2bb tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:42.509798 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6eb6ea44-c726-449c-945e-ed75d127a2bb tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:42.543344 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6eb6ea44-c726-449c-945e-ed75d127a2bb tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] [instance: 911b33c1-545d-4bcb-9ca1-c42c7bda606b] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:11:42.652930 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0580a2f8-d3ff-435d-9bb8-e030768065a7 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b082ea4ee3dd46f29a326e0299d69583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d3b6f9eb74076b4c74f01fb4bd6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:42.665989 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0580a2f8-d3ff-435d-9bb8-e030768065a7 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] 10.222.0.35 "GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65" status: 200 len: 1527 microversion: 2.1 time: 0.316707 Jun 10 18:11:42.666978 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2115/4127] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:42 2022] GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65 => generated 1527 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:42.800931 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ed5b94d3-e8f7-4653-817e-034dd77a998c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1649975924", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "ec033079-44eb-425d-beee-8bccdd30063c"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ed5b94d3-e8f7-4653-817e-034dd77a998c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 492 Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1649975924", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "ec033079-44eb-425d-beee-8bccdd30063c"}]}} Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1649975924', 'imageRef': 'efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'ec033079-44eb-425d-beee-8bccdd30063c'}]}}} Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise error Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Jun 10 18:11:42.807720 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Jun 10 18:11:42.812159 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:42.812159 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:42.812159 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:42.812159 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:42.812159 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:42.812159 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:42.812159 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:11:42.812159 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:11:42.812159 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:11:42.812159 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:11:42.812159 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:11:42.812159 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:11:42.812159 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 10 18:11:42.812159 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 10 18:11:42.812159 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 10 18:11:42.812159 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 10 18:11:42.812159 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 10 18:11:42.812159 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 10 18:11:42.812159 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jun 10 18:11:42.812159 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:42.812159 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:42.812159 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:42.812159 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:42.812159 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:42.812159 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:42.812159 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 10 18:11:42.812159 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 10 18:11:42.812159 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jun 10 18:11:42.812159 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:42.817188 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ed5b94d3-e8f7-4653-817e-034dd77a998c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:11:42.818228 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ed5b94d3-e8f7-4653-817e-034dd77a998c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.029852 Jun 10 18:11:42.824463 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2116/4128] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:11:42 2022] POST /compute/v2.1/servers => generated 624 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:11:42.840232 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-048f11db-599a-489f-8d97-14217a4faf82 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:42.840907 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-048f11db-599a-489f-8d97-14217a4faf82 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:42.858181 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-048f11db-599a-489f-8d97-14217a4faf82 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:42.859280 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-048f11db-599a-489f-8d97-14217a4faf82 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:42.860896 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-048f11db-599a-489f-8d97-14217a4faf82 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:42.861735 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-048f11db-599a-489f-8d97-14217a4faf82 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:42.942021 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6eb6ea44-c726-449c-945e-ed75d127a2bb tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "DELETE /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b" status: 204 len: 0 microversion: 2.1 time: 0.451149 Jun 10 18:11:42.942680 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2013/4129] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:11:42 2022] DELETE /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:11:42.954256 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4e28017d-1bd1-415e-a5d5-9c1b5689ea93 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:42.955334 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4e28017d-1bd1-415e-a5d5-9c1b5689ea93 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] [instance: 911b33c1-545d-4bcb-9ca1-c42c7bda606b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:42.971811 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e28017d-1bd1-415e-a5d5-9c1b5689ea93 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:42.974422 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e28017d-1bd1-415e-a5d5-9c1b5689ea93 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:42.974422 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e28017d-1bd1-415e-a5d5-9c1b5689ea93 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:42.974422 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e28017d-1bd1-415e-a5d5-9c1b5689ea93 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:43.049356 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-048f11db-599a-489f-8d97-14217a4faf82 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:43.061152 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-048f11db-599a-489f-8d97-14217a4faf82 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.233774 Jun 10 18:11:43.071556 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2117/4130] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:42 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:43.081457 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e8616f4a-6d59-4137-9ce6-c94df8146bb0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:43.082725 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e8616f4a-6d59-4137-9ce6-c94df8146bb0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:43.090394 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e8616f4a-6d59-4137-9ce6-c94df8146bb0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:43.091034 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e8616f4a-6d59-4137-9ce6-c94df8146bb0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:43.091976 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e8616f4a-6d59-4137-9ce6-c94df8146bb0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:43.093602 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e8616f4a-6d59-4137-9ce6-c94df8146bb0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:43.352187 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e8616f4a-6d59-4137-9ce6-c94df8146bb0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:43.357308 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e8616f4a-6d59-4137-9ce6-c94df8146bb0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.279809 Jun 10 18:11:43.358463 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2118/4131] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:43 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:43.364038 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fc583b3c-9388-47eb-8176-25edc978310e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:43.364669 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fc583b3c-9388-47eb-8176-25edc978310e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:43.372884 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fc583b3c-9388-47eb-8176-25edc978310e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:43.373601 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fc583b3c-9388-47eb-8176-25edc978310e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:43.375220 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fc583b3c-9388-47eb-8176-25edc978310e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:43.375826 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fc583b3c-9388-47eb-8176-25edc978310e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:43.408551 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4e28017d-1bd1-415e-a5d5-9c1b5689ea93 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc673eee8339438cbb69ac8bc8df633e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38326c7c8786498a94e003d80740c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:43.432835 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4e28017d-1bd1-415e-a5d5-9c1b5689ea93 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b" status: 200 len: 1473 microversion: 2.1 time: 0.473998 Jun 10 18:11:43.432835 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2014/4132] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:42 2022] GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b => generated 1473 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:11:43.553171 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6fbf760c-d218-4c5f-b7a2-2286ecc9d304 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "ec033079-44eb-425d-beee-8bccdd30063c"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6fbf760c-d218-4c5f-b7a2-2286ecc9d304 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 416 Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "ec033079-44eb-425d-beee-8bccdd30063c"}]}} Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8', 'flavorRef': '452', 'networks': [{'uuid': 'ec033079-44eb-425d-beee-8bccdd30063c'}]}}} Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise error Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:43.557342 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:43.561365 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:43.561365 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:43.561365 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:43.561365 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:11:43.561365 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:11:43.561365 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:11:43.561365 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:11:43.561365 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:11:43.561365 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:11:43.561365 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 10 18:11:43.561365 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 10 18:11:43.561365 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 10 18:11:43.561365 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 10 18:11:43.561365 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 10 18:11:43.561365 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 10 18:11:43.561365 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 10 18:11:43.561365 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:43.561365 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:43.561365 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:43.561365 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:43.561365 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:43.561365 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:43.561365 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 10 18:11:43.561365 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 10 18:11:43.561365 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 10 18:11:43.561365 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:43.561365 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6fbf760c-d218-4c5f-b7a2-2286ecc9d304 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:11:43.561365 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6fbf760c-d218-4c5f-b7a2-2286ecc9d304 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.010848 Jun 10 18:11:43.561365 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2015/4133] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:11:43 2022] POST /compute/v2.1/servers => generated 619 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 10 18:11:43.590342 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8beb1546-45c3-4d2c-8103-6660aaad3442 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:43.593109 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8beb1546-45c3-4d2c-8103-6660aaad3442 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:43.611324 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8beb1546-45c3-4d2c-8103-6660aaad3442 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:43.611901 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8beb1546-45c3-4d2c-8103-6660aaad3442 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:43.612575 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8beb1546-45c3-4d2c-8103-6660aaad3442 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:43.613186 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8beb1546-45c3-4d2c-8103-6660aaad3442 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:43.654672 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fc583b3c-9388-47eb-8176-25edc978310e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:43.665927 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fc583b3c-9388-47eb-8176-25edc978310e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559" status: 200 len: 1511 microversion: 2.1 time: 0.306171 Jun 10 18:11:43.666521 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2119/4134] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:43 2022] GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 => generated 1511 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:43.684986 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-108c52f2-d693-45d1-bddf-5672fe89bced tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:43.685821 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-108c52f2-d693-45d1-bddf-5672fe89bced tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] [instance: dc0e228e-55d2-4eaf-94fd-61213629df65] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:43.694292 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-108c52f2-d693-45d1-bddf-5672fe89bced tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:43.695089 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-108c52f2-d693-45d1-bddf-5672fe89bced tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:43.696153 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-108c52f2-d693-45d1-bddf-5672fe89bced tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:43.697615 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-108c52f2-d693-45d1-bddf-5672fe89bced tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:43.723195 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:11:43.907448 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8beb1546-45c3-4d2c-8103-6660aaad3442 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:43.916557 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-108c52f2-d693-45d1-bddf-5672fe89bced tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b082ea4ee3dd46f29a326e0299d69583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d3b6f9eb74076b4c74f01fb4bd6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:43.917847 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8beb1546-45c3-4d2c-8103-6660aaad3442 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.345796 Jun 10 18:11:43.920411 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2016/4135] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:43 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:43.930336 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-108c52f2-d693-45d1-bddf-5672fe89bced tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] 10.222.0.35 "GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65" status: 200 len: 1527 microversion: 2.1 time: 0.250909 Jun 10 18:11:43.935458 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2120/4136] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:43 2022] GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65 => generated 1527 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:11:43.936957 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d1d2ffe2-1194-445e-995a-c01150e15d74 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:43.937929 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d1d2ffe2-1194-445e-995a-c01150e15d74 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:43.946147 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d1d2ffe2-1194-445e-995a-c01150e15d74 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:43.946946 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d1d2ffe2-1194-445e-995a-c01150e15d74 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:43.957478 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d1d2ffe2-1194-445e-995a-c01150e15d74 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:43.957941 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d1d2ffe2-1194-445e-995a-c01150e15d74 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:44.266571 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-8267f0af-4c4a-4d4a-914e-450015b39db5 req-2f90688d-8fcf-45a4-9736-bc187c32efeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc0e228e-55d2-4eaf-94fd-61213629df65", "name": "network-vif-deleted", "tag": "228a8879-fa9d-4731-b769-d54d6f0b6e9e"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:11:44.280694 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-8267f0af-4c4a-4d4a-914e-450015b39db5 req-2f90688d-8fcf-45a4-9736-bc187c32efeb service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:44.293098 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-8267f0af-4c4a-4d4a-914e-450015b39db5 req-2f90688d-8fcf-45a4-9736-bc187c32efeb service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:44.307901 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-8267f0af-4c4a-4d4a-914e-450015b39db5 req-2f90688d-8fcf-45a4-9736-bc187c32efeb service nova] Creating event network-vif-deleted:228a8879-fa9d-4731-b769-d54d6f0b6e9e for instance dc0e228e-55d2-4eaf-94fd-61213629df65 on chh2-master-2 Jun 10 18:11:44.322011 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-8267f0af-4c4a-4d4a-914e-450015b39db5 req-2f90688d-8fcf-45a4-9736-bc187c32efeb service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059034 Jun 10 18:11:44.323453 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2121/4137] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:11:44.442472 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d48af36a-b8c9-4001-9314-d307675ad6da tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:44.445125 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d48af36a-b8c9-4001-9314-d307675ad6da tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] [instance: 911b33c1-545d-4bcb-9ca1-c42c7bda606b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:44.447385 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:11:44.451520 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d1d2ffe2-1194-445e-995a-c01150e15d74 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:44.459430 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d1d2ffe2-1194-445e-995a-c01150e15d74 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.526872 Jun 10 18:11:44.480652 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2017/4138] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:43 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:44.489425 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d48af36a-b8c9-4001-9314-d307675ad6da tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:44.489883 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d48af36a-b8c9-4001-9314-d307675ad6da tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:44.491012 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d48af36a-b8c9-4001-9314-d307675ad6da tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:44.491429 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d48af36a-b8c9-4001-9314-d307675ad6da tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:44.684813 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-20a68162-45c0-4951-a052-0a2ff73aabb0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:44.685433 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-20a68162-45c0-4951-a052-0a2ff73aabb0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:44.692133 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-20a68162-45c0-4951-a052-0a2ff73aabb0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:44.692888 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-20a68162-45c0-4951-a052-0a2ff73aabb0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:44.693834 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-20a68162-45c0-4951-a052-0a2ff73aabb0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:44.696240 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-20a68162-45c0-4951-a052-0a2ff73aabb0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:44.951890 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-20a68162-45c0-4951-a052-0a2ff73aabb0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:44.960341 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-20a68162-45c0-4951-a052-0a2ff73aabb0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559" status: 200 len: 1511 microversion: 2.1 time: 0.281932 Jun 10 18:11:44.969135 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2018/4139] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:44 2022] GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 => generated 1511 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:44.985876 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2fdd57d2-3e08-4b83-80df-be7f938e9623 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-151843690", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": -1, "networks": [{"uuid": "ec033079-44eb-425d-beee-8bccdd30063c"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:11:45.008261 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-2fdd57d2-3e08-4b83-80df-be7f938e9623 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] HTTP exception thrown: Flavor -1 could not be found. Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2fdd57d2-3e08-4b83-80df-be7f938e9623 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 205 Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-151843690", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": -1, "networks": [{"uuid": "ec033079-44eb-425d-beee-8bccdd30063c"}]}} Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: exception: Flavor -1 could not be found. Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-151843690', 'imageRef': 'efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8', 'flavorRef': -1, 'networks': [{'uuid': 'ec033079-44eb-425d-beee-8bccdd30063c'}]}}} Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:11:45.010336 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:11:45.021200 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:11:45.021200 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:11:45.021200 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:11:45.021200 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:11:45.021200 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 10 18:11:45.021200 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jun 10 18:11:45.021200 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jun 10 18:11:45.021200 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Jun 10 18:11:45.021200 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:45.021200 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:45.021200 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:45.021200 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:45.021200 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:45.021200 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:45.021200 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:11:45.021200 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:11:45.021200 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Jun 10 18:11:45.021200 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:45.021200 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2fdd57d2-3e08-4b83-80df-be7f938e9623 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:11:45.021200 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2fdd57d2-3e08-4b83-80df-be7f938e9623 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.044050 Jun 10 18:11:45.021200 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2019/4140] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:11:44 2022] POST /compute/v2.1/servers => generated 73 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 10 18:11:45.022563 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d48af36a-b8c9-4001-9314-d307675ad6da tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc673eee8339438cbb69ac8bc8df633e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38326c7c8786498a94e003d80740c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:45.027471 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-102d072c-1058-49fc-9401-14a20857392d tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:45.028184 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-102d072c-1058-49fc-9401-14a20857392d tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] [instance: dc0e228e-55d2-4eaf-94fd-61213629df65] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:45.031056 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d48af36a-b8c9-4001-9314-d307675ad6da tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b" status: 200 len: 1473 microversion: 2.1 time: 0.592831 Jun 10 18:11:45.041320 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2122/4141] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:44 2022] GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b => generated 1473 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:45.045159 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-102d072c-1058-49fc-9401-14a20857392d tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:45.047995 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-102d072c-1058-49fc-9401-14a20857392d tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:45.047995 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-102d072c-1058-49fc-9401-14a20857392d tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:45.047995 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-102d072c-1058-49fc-9401-14a20857392d tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:45.048289 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f9fbca88-fc12-4933-9c05-aee3bc36c886 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:45.048289 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f9fbca88-fc12-4933-9c05-aee3bc36c886 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:45.064730 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f9fbca88-fc12-4933-9c05-aee3bc36c886 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:45.065238 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f9fbca88-fc12-4933-9c05-aee3bc36c886 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:45.066088 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f9fbca88-fc12-4933-9c05-aee3bc36c886 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:45.068934 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f9fbca88-fc12-4933-9c05-aee3bc36c886 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:45.137833 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-102d072c-1058-49fc-9401-14a20857392d tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:45.138294 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-102d072c-1058-49fc-9401-14a20857392d tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:45.138761 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-102d072c-1058-49fc-9401-14a20857392d tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lazy-loading 'fault' on Instance uuid dc0e228e-55d2-4eaf-94fd-61213629df65 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:11:45.223986 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-102d072c-1058-49fc-9401-14a20857392d tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b082ea4ee3dd46f29a326e0299d69583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d3b6f9eb74076b4c74f01fb4bd6e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:45.239741 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-102d072c-1058-49fc-9401-14a20857392d tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] 10.222.0.35 "GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65" status: 200 len: 1314 microversion: 2.1 time: 0.223875 Jun 10 18:11:45.243086 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2020/4142] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:45 2022] GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:45.405961 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5e38cb9e-f3b2-4961-9e07-47fb17c8c13b tempest-FloatingIPsTestJSON-765028900 tempest-FloatingIPsTestJSON-765028900-project] Action: 'create', calling method: .version_select at 0x7f77c60e90d0>, body: {"pool": null} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:11:45.427780 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f9fbca88-fc12-4933-9c05-aee3bc36c886 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:45.436126 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f9fbca88-fc12-4933-9c05-aee3bc36c886 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.402857 Jun 10 18:11:45.452289 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2123/4143] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:45 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:45.456474 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-496d9e00-b8b8-471e-98d6-ca1636ec6b9d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:45.457274 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-496d9e00-b8b8-471e-98d6-ca1636ec6b9d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:45.464244 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-496d9e00-b8b8-471e-98d6-ca1636ec6b9d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:45.465124 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-496d9e00-b8b8-471e-98d6-ca1636ec6b9d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:45.466242 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-496d9e00-b8b8-471e-98d6-ca1636ec6b9d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:45.466896 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-496d9e00-b8b8-471e-98d6-ca1636ec6b9d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:45.745825 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-496d9e00-b8b8-471e-98d6-ca1636ec6b9d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:45.761556 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-496d9e00-b8b8-471e-98d6-ca1636ec6b9d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.310653 Jun 10 18:11:45.762262 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2124/4144] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:45 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:11:45.818862 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2154beab-97fd-423d-a9b4-23f101c79352 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1855970077", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "ec033079-44eb-425d-beee-8bccdd30063c"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2154beab-97fd-423d-a9b4-23f101c79352 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 173 Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1855970077", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "ec033079-44eb-425d-beee-8bccdd30063c"}]}} Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1855970077', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'ec033079-44eb-425d-beee-8bccdd30063c'}]}}} Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise error Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi -1 Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 10 18:11:45.822717 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 10 18:11:45.827932 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 10 18:11:45.827932 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 10 18:11:45.827932 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jun 10 18:11:45.827932 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:45.827932 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:45.827932 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:45.827932 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:45.827932 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:45.827932 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:45.827932 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 10 18:11:45.827932 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 10 18:11:45.827932 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jun 10 18:11:45.827932 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:45.833493 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2154beab-97fd-423d-a9b4-23f101c79352 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:11:45.833493 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2154beab-97fd-423d-a9b4-23f101c79352 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.018306 Jun 10 18:11:45.835372 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2125/4145] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:11:45 2022] POST /compute/v2.1/servers => generated 145 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:11:45.843924 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-017ed7f1-80b1-4bcb-99db-4f72ea5380ea tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:45.844761 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-017ed7f1-80b1-4bcb-99db-4f72ea5380ea tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:45.853425 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-017ed7f1-80b1-4bcb-99db-4f72ea5380ea tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:45.854077 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-017ed7f1-80b1-4bcb-99db-4f72ea5380ea tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:45.855262 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-017ed7f1-80b1-4bcb-99db-4f72ea5380ea tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:45.855812 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-017ed7f1-80b1-4bcb-99db-4f72ea5380ea tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:46.128271 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-017ed7f1-80b1-4bcb-99db-4f72ea5380ea tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:46.141438 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-017ed7f1-80b1-4bcb-99db-4f72ea5380ea tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.302278 Jun 10 18:11:46.142421 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2126/4146] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:45 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:46.156535 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f564959c-efd1-4762-a5a4-58a2d52213c8 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:46.157576 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f564959c-efd1-4762-a5a4-58a2d52213c8 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:46.167436 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f564959c-efd1-4762-a5a4-58a2d52213c8 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:46.170043 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f564959c-efd1-4762-a5a4-58a2d52213c8 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:46.179380 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f564959c-efd1-4762-a5a4-58a2d52213c8 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:46.180605 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f564959c-efd1-4762-a5a4-58a2d52213c8 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:46.482230 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f564959c-efd1-4762-a5a4-58a2d52213c8 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:46.498520 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f564959c-efd1-4762-a5a4-58a2d52213c8 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559" status: 200 len: 1511 microversion: 2.1 time: 0.354172 Jun 10 18:11:46.499749 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2127/4147] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:46 2022] GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 => generated 1511 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:46.513698 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-93ac6976-6a9c-450e-8585-10c4e0e18c52 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:46.514371 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-93ac6976-6a9c-450e-8585-10c4e0e18c52 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] [instance: 911b33c1-545d-4bcb-9ca1-c42c7bda606b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:46.522049 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-93ac6976-6a9c-450e-8585-10c4e0e18c52 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:46.522616 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-93ac6976-6a9c-450e-8585-10c4e0e18c52 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:46.524355 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-93ac6976-6a9c-450e-8585-10c4e0e18c52 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:46.524794 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-93ac6976-6a9c-450e-8585-10c4e0e18c52 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:46.637904 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-93ac6976-6a9c-450e-8585-10c4e0e18c52 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc673eee8339438cbb69ac8bc8df633e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38326c7c8786498a94e003d80740c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:46.653183 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-93ac6976-6a9c-450e-8585-10c4e0e18c52 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b" status: 200 len: 1431 microversion: 2.1 time: 0.150983 Jun 10 18:11:46.659323 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2128/4148] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:46 2022] GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b => generated 1431 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:46.669828 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e38eface-37b6-490c-ac8c-98ff54b8441d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:46.671817 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e38eface-37b6-490c-ac8c-98ff54b8441d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:46.689345 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e38eface-37b6-490c-ac8c-98ff54b8441d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:46.690676 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e38eface-37b6-490c-ac8c-98ff54b8441d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:46.693528 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e38eface-37b6-490c-ac8c-98ff54b8441d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:46.694012 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e38eface-37b6-490c-ac8c-98ff54b8441d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:46.970904 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e38eface-37b6-490c-ac8c-98ff54b8441d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:46.981316 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e38eface-37b6-490c-ac8c-98ff54b8441d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.325750 Jun 10 18:11:46.990382 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2129/4149] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:46 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:46.990382 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cf84640a-15d4-4358-9542-b57dc57ffac9 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:46.993104 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cf84640a-15d4-4358-9542-b57dc57ffac9 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] [instance: dc0e228e-55d2-4eaf-94fd-61213629df65] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:47.010896 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf84640a-15d4-4358-9542-b57dc57ffac9 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:47.032375 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf84640a-15d4-4358-9542-b57dc57ffac9 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:47.033292 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf84640a-15d4-4358-9542-b57dc57ffac9 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:47.033867 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf84640a-15d4-4358-9542-b57dc57ffac9 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:47.116683 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-cf84640a-15d4-4358-9542-b57dc57ffac9 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] HTTP exception thrown: Instance dc0e228e-55d2-4eaf-94fd-61213629df65 could not be found. Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cf84640a-15d4-4358-9542-b57dc57ffac9 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Request method failure captured: Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65 HTTP/1.1 Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4lAF6shLX9KYr8RUNeaveC4jy0PJ6Qs43hERengYxwDpMODiMVZ_5aKgP7Q2Pv8ouIEfj6mHTeaV6T6kAjYK_FkcMweXxjeF-phvDGMEMO8Mvhq2tAJPF06FYQ1qPQgAmZ9xPxQ6zmlhdycdHvki990Givo78u16_PpigDQUtvoPZk Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: c84d3b6f9eb74076b4c74f01fb4bd6e8 Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-859363046 Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/c84d3b6f9eb74076b4c74f01fb4bd6e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c84d3b6f9eb74076b4c74f01fb4bd6e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c84d3b6f9eb74076b4c74f01fb4bd6e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_c84d3b6f9eb74076b4c74f01fb4bd6e8", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-859363046 Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: c84d3b6f9eb74076b4c74f01fb4bd6e8 Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-859363046 Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServerAddressesNegativeTestJSON-859363046-project Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: b082ea4ee3dd46f29a326e0299d69583 Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-859363046-project Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: exception: Instance dc0e228e-55d2-4eaf-94fd-61213629df65 could not be found. Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'dc0e228e-55d2-4eaf-94fd-61213629df65'} Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc0e228e-55d2-4eaf-94fd-61213629df65 could not be found. Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc0e228e-55d2-4eaf-94fd-61213629df65 could not be found. Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:47.118876 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:47.123505 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:47.123505 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:47.123505 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:47.123505 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:47.123505 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:11:47.123505 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:11:47.123505 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc0e228e-55d2-4eaf-94fd-61213629df65 could not be found. Jun 10 18:11:47.123505 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:47.124857 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cf84640a-15d4-4358-9542-b57dc57ffac9 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] Returning 404 to user: Instance dc0e228e-55d2-4eaf-94fd-61213629df65 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:11:47.125899 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cf84640a-15d4-4358-9542-b57dc57ffac9 tempest-ServerAddressesNegativeTestJSON-859363046 tempest-ServerAddressesNegativeTestJSON-859363046-project] 10.222.0.35 "GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65" status: 404 len: 111 microversion: 2.1 time: 0.142384 Jun 10 18:11:47.126648 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2130/4150] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:46 2022] GET /compute/v2.1/servers/dc0e228e-55d2-4eaf-94fd-61213629df65 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:11:47.142797 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-3acafc62-8b57-4da1-a641-030d581031d4 req-832cedd4-dd29-48b3-8e3e-1142dae36fbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "911b33c1-545d-4bcb-9ca1-c42c7bda606b", "name": "network-vif-deleted", "tag": "a7249e1c-d1cb-43c4-9fa6-d68705a79807"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:11:47.181221 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-3acafc62-8b57-4da1-a641-030d581031d4 req-832cedd4-dd29-48b3-8e3e-1142dae36fbb service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:47.181674 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-3acafc62-8b57-4da1-a641-030d581031d4 req-832cedd4-dd29-48b3-8e3e-1142dae36fbb service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:47.229921 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-3acafc62-8b57-4da1-a641-030d581031d4 req-832cedd4-dd29-48b3-8e3e-1142dae36fbb service nova] Creating event network-vif-deleted:a7249e1c-d1cb-43c4-9fa6-d68705a79807 for instance 911b33c1-545d-4bcb-9ca1-c42c7bda606b on chh2-master-2 Jun 10 18:11:47.243117 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-3acafc62-8b57-4da1-a641-030d581031d4 req-832cedd4-dd29-48b3-8e3e-1142dae36fbb service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114236 Jun 10 18:11:47.248156 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2131/4151] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:11:47.264507 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a0152cfc-c92e-48d3-b94b-a5df4477b94a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1730863514", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:11:47.267936 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-a0152cfc-c92e-48d3-b94b-a5df4477b94a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a0152cfc-c92e-48d3-b94b-a5df4477b94a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 216 Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1730863514", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1730863514', 'imageRef': 'efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._validate_network_id( Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:47.280561 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:47.286286 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:47.286286 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:47.286286 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:47.286286 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:11:47.286286 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:11:47.286286 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jun 10 18:11:47.286286 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:47.286286 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a0152cfc-c92e-48d3-b94b-a5df4477b94a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:11:47.292789 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a0152cfc-c92e-48d3-b94b-a5df4477b94a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.042999 Jun 10 18:11:47.296818 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2132/4152] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:11:47 2022] POST /compute/v2.1/servers => generated 123 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:11:47.301654 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0c16afc6-0b44-4f8d-9a7c-48859216ea11 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:47.305741 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0c16afc6-0b44-4f8d-9a7c-48859216ea11 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:47.328365 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0c16afc6-0b44-4f8d-9a7c-48859216ea11 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:47.328952 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0c16afc6-0b44-4f8d-9a7c-48859216ea11 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:47.329645 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0c16afc6-0b44-4f8d-9a7c-48859216ea11 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:47.331239 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0c16afc6-0b44-4f8d-9a7c-48859216ea11 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:47.883677 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0c16afc6-0b44-4f8d-9a7c-48859216ea11 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:47.897352 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0c16afc6-0b44-4f8d-9a7c-48859216ea11 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.599330 Jun 10 18:11:47.897865 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2133/4153] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:47 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:47.927313 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8cfdec08-5cfd-41d5-b052-9274e6714692 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:47.927926 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8cfdec08-5cfd-41d5-b052-9274e6714692 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:47.934967 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8cfdec08-5cfd-41d5-b052-9274e6714692 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:47.935807 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8cfdec08-5cfd-41d5-b052-9274e6714692 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:47.936636 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8cfdec08-5cfd-41d5-b052-9274e6714692 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:47.939255 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8cfdec08-5cfd-41d5-b052-9274e6714692 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:48.562497 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8cfdec08-5cfd-41d5-b052-9274e6714692 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:48.569704 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8cfdec08-5cfd-41d5-b052-9274e6714692 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559" status: 200 len: 1511 microversion: 2.1 time: 0.658460 Jun 10 18:11:48.576470 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2134/4154] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:47 2022] GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 => generated 1511 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:48.591168 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fe5402f1-a788-4c25-b246-cb7584a49db3 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:48.592417 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fe5402f1-a788-4c25-b246-cb7584a49db3 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] [instance: 911b33c1-545d-4bcb-9ca1-c42c7bda606b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:48.611506 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fe5402f1-a788-4c25-b246-cb7584a49db3 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:48.611973 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fe5402f1-a788-4c25-b246-cb7584a49db3 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:48.612813 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fe5402f1-a788-4c25-b246-cb7584a49db3 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:48.618475 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fe5402f1-a788-4c25-b246-cb7584a49db3 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:48.664598 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-fe5402f1-a788-4c25-b246-cb7584a49db3 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] HTTP exception thrown: Instance 911b33c1-545d-4bcb-9ca1-c42c7bda606b could not be found. Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fe5402f1-a788-4c25-b246-cb7584a49db3 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Request method failure captured: Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b HTTP/1.1 Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4j4MT-Z4ESW-ZHH6v8qYBfWBshBMMUFsUuM8cUmod3OeulH_mDx0ocIcUj9YyynmHF_Z5imsjOxOdJVshTHuvrNGuSN8INlqRSjbYgIb6xukMFFk0_xl3e3vNEegzqVTqoWA_QJthN3aTiAPxlMFBlUt8a1ohNMLRH_qiRTq_4U9kI Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 38326c7c8786498a94e003d80740c5cf Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ImagesOneServerTestJSON-800511224 Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/38326c7c8786498a94e003d80740c5cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/38326c7c8786498a94e003d80740c5cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/38326c7c8786498a94e003d80740c5cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_38326c7c8786498a94e003d80740c5cf", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ImagesOneServerTestJSON-800511224 Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 38326c7c8786498a94e003d80740c5cf Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-800511224 Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ImagesOneServerTestJSON-800511224-project Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: cc673eee8339438cbb69ac8bc8df633e Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ImagesOneServerTestJSON-800511224-project Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 911b33c1-545d-4bcb-9ca1-c42c7bda606b could not be found. Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '911b33c1-545d-4bcb-9ca1-c42c7bda606b'} Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 911b33c1-545d-4bcb-9ca1-c42c7bda606b could not be found. Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 911b33c1-545d-4bcb-9ca1-c42c7bda606b could not be found. Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:48.673958 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:48.684110 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:48.684110 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:48.684110 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:48.684110 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:11:48.684110 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:11:48.684110 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 911b33c1-545d-4bcb-9ca1-c42c7bda606b could not be found. Jun 10 18:11:48.684110 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:48.684110 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fe5402f1-a788-4c25-b246-cb7584a49db3 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] Returning 404 to user: Instance 911b33c1-545d-4bcb-9ca1-c42c7bda606b could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:11:48.684110 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fe5402f1-a788-4c25-b246-cb7584a49db3 tempest-ImagesOneServerTestJSON-800511224 tempest-ImagesOneServerTestJSON-800511224-project] 10.222.0.35 "GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b" status: 404 len: 111 microversion: 2.1 time: 0.100698 Jun 10 18:11:48.684110 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2135/4155] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:48 2022] GET /compute/v2.1/servers/911b33c1-545d-4bcb-9ca1-c42c7bda606b => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:11:48.691625 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9b522aae-d29e-4830-bab2-3f62e5e7c132 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:48.692048 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9b522aae-d29e-4830-bab2-3f62e5e7c132 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:48.726294 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9b522aae-d29e-4830-bab2-3f62e5e7c132 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:48.727823 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9b522aae-d29e-4830-bab2-3f62e5e7c132 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:48.728710 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9b522aae-d29e-4830-bab2-3f62e5e7c132 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:48.729344 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9b522aae-d29e-4830-bab2-3f62e5e7c132 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:49.279724 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9b522aae-d29e-4830-bab2-3f62e5e7c132 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:49.293664 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9b522aae-d29e-4830-bab2-3f62e5e7c132 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.613549 Jun 10 18:11:49.300863 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2136/4156] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:48 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:49.529818 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4ec8129d-2b75-4ac7-8dbc-81ee588d1643 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1999075557", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "key_name": "tempest-key-1075108725", "networks": [{"uuid": "ec033079-44eb-425d-beee-8bccdd30063c"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:11:49.630353 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-4ec8129d-2b75-4ac7-8dbc-81ee588d1643 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] validate_networks() for [('ec033079-44eb-425d-beee-8bccdd30063c', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:11:50.080523 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5e38cb9e-f3b2-4961-9e07-47fb17c8c13b tempest-FloatingIPsTestJSON-765028900 tempest-FloatingIPsTestJSON-765028900-project] 10.222.0.35 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.838305 Jun 10 18:11:50.082179 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2021/4157] 10.222.0.35 () {60 vars in 1169 bytes} [Fri Jun 10 18:11:45 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4841 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:11:50.087568 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-667bebe2-09a9-436e-b734-18aa51e561e9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:50.088525 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-667bebe2-09a9-436e-b734-18aa51e561e9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:50.102994 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-667bebe2-09a9-436e-b734-18aa51e561e9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:50.105160 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-667bebe2-09a9-436e-b734-18aa51e561e9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:50.106532 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-667bebe2-09a9-436e-b734-18aa51e561e9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:50.112090 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-667bebe2-09a9-436e-b734-18aa51e561e9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:50.453758 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-667bebe2-09a9-436e-b734-18aa51e561e9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:50.465451 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-667bebe2-09a9-436e-b734-18aa51e561e9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559" status: 200 len: 1511 microversion: 2.1 time: 0.381997 Jun 10 18:11:50.474591 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2022/4158] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:50 2022] GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 => generated 1511 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:50.487696 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4276cafe-0d04-4fd6-a9fd-b9ebaff68757 tempest-FloatingIPsTestJSON-765028900 tempest-FloatingIPsTestJSON-765028900-project] Calling method '.version_select at 0x7f77c0616b80>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:50.550515 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-4ec8129d-2b75-4ac7-8dbc-81ee588d1643 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] HTTP exception thrown: Invalid key_name provided. Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4ec8129d-2b75-4ac7-8dbc-81ee588d1643 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 247 Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1999075557", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "key_name": "tempest-key-1075108725", "networks": [{"uuid": "ec033079-44eb-425d-beee-8bccdd30063c"}]}} Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: exception: Invalid key_name provided. Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1999075557', 'imageRef': 'efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8', 'flavorRef': '452', 'key_name': 'tempest-key-1075108725', 'networks': [{'uuid': 'ec033079-44eb-425d-beee-8bccdd30063c'}]}}} Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1075, in _validate_and_build_base_options Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1075108725 not found for user 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:50.560231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:50.571432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:50.571432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:11:50.571432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:11:50.571432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:11:50.571432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:11:50.571432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:11:50.571432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:11:50.571432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:11:50.571432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:11:50.571432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:11:50.571432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:11:50.571432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 10 18:11:50.571432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Jun 10 18:11:50.571432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jun 10 18:11:50.571432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Jun 10 18:11:50.571432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:50.571432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:50.571432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:50.571432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:50.571432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:50.571432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:50.571432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:11:50.571432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:11:50.571432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Jun 10 18:11:50.571432 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:50.571432 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4ec8129d-2b75-4ac7-8dbc-81ee588d1643 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 400 to user: Invalid key_name provided. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:11:50.571432 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4ec8129d-2b75-4ac7-8dbc-81ee588d1643 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.039347 Jun 10 18:11:50.571432 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2137/4159] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:11:49 2022] POST /compute/v2.1/servers => generated 70 bytes in 1042 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 10 18:11:50.573605 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0982d4a8-b129-4ad7-805d-2a8dcbb59396 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:50.574059 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0982d4a8-b129-4ad7-805d-2a8dcbb59396 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:50.596653 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0982d4a8-b129-4ad7-805d-2a8dcbb59396 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:50.597538 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0982d4a8-b129-4ad7-805d-2a8dcbb59396 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:50.598998 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0982d4a8-b129-4ad7-805d-2a8dcbb59396 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:50.600823 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0982d4a8-b129-4ad7-805d-2a8dcbb59396 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:50.883735 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4276cafe-0d04-4fd6-a9fd-b9ebaff68757 tempest-FloatingIPsTestJSON-765028900 tempest-FloatingIPsTestJSON-765028900-project] 10.222.0.35 "GET /compute/v2.1/os-floating-ips/092ac4db-0f6e-475e-b07d-a1d2b9e55785" status: 200 len: 142 microversion: 2.1 time: 0.407740 Jun 10 18:11:50.884756 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2023/4160] 10.222.0.35 () {58 vars in 1259 bytes} [Fri Jun 10 18:11:50 2022] GET /compute/v2.1/os-floating-ips/092ac4db-0f6e-475e-b07d-a1d2b9e55785 => generated 142 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:11:50.897066 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9d3352f7-c38b-48da-b697-f5eec5f2398d tempest-FloatingIPsTestJSON-765028900 tempest-FloatingIPsTestJSON-765028900-project] Calling method '.version_select at 0x7f77c144bb80>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:51.359985 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9d3352f7-c38b-48da-b697-f5eec5f2398d tempest-FloatingIPsTestJSON-765028900 tempest-FloatingIPsTestJSON-765028900-project] 10.222.0.35 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.468709 Jun 10 18:11:51.361263 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2024/4161] 10.222.0.35 () {58 vars in 1148 bytes} [Fri Jun 10 18:11:50 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:11:51.374683 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2bd1c60d-a904-4428-8183-0bfedbca21ea tempest-FloatingIPsTestJSON-765028900 tempest-FloatingIPsTestJSON-765028900-project] Calling method '.version_select at 0x7f77c015d670>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:51.642023 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0982d4a8-b129-4ad7-805d-2a8dcbb59396 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:51.656362 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0982d4a8-b129-4ad7-805d-2a8dcbb59396 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 1.087357 Jun 10 18:11:51.659241 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2138/4162] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:50 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:51.672902 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-36c30d41-7ac1-41f1-b7e9-cec593480e1d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:51.673538 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-36c30d41-7ac1-41f1-b7e9-cec593480e1d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:51.685059 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-36c30d41-7ac1-41f1-b7e9-cec593480e1d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:51.687837 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-36c30d41-7ac1-41f1-b7e9-cec593480e1d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:51.689871 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-36c30d41-7ac1-41f1-b7e9-cec593480e1d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:51.691185 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-36c30d41-7ac1-41f1-b7e9-cec593480e1d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:51.926778 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-36c30d41-7ac1-41f1-b7e9-cec593480e1d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:51.935839 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-36c30d41-7ac1-41f1-b7e9-cec593480e1d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559" status: 200 len: 1511 microversion: 2.1 time: 0.275335 Jun 10 18:11:51.948672 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2139/4163] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:51 2022] GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 => generated 1511 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:51.961997 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ec56078f-8204-4b0a-823f-7b3bb5ae5fb1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:51.962851 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ec56078f-8204-4b0a-823f-7b3bb5ae5fb1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:51.976692 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec56078f-8204-4b0a-823f-7b3bb5ae5fb1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:51.977896 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec56078f-8204-4b0a-823f-7b3bb5ae5fb1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:51.978403 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec56078f-8204-4b0a-823f-7b3bb5ae5fb1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:51.979075 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec56078f-8204-4b0a-823f-7b3bb5ae5fb1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:52.263602 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ec56078f-8204-4b0a-823f-7b3bb5ae5fb1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:52.275124 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ec56078f-8204-4b0a-823f-7b3bb5ae5fb1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.322244 Jun 10 18:11:52.276122 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2140/4164] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:51 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:52.604032 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2bd1c60d-a904-4428-8183-0bfedbca21ea tempest-FloatingIPsTestJSON-765028900 tempest-FloatingIPsTestJSON-765028900-project] 10.222.0.35 "DELETE /compute/v2.1/os-floating-ips/092ac4db-0f6e-475e-b07d-a1d2b9e55785" status: 202 len: 0 microversion: 2.1 time: 1.235732 Jun 10 18:11:52.609423 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2025/4165] 10.222.0.35 () {58 vars in 1262 bytes} [Fri Jun 10 18:11:51 2022] DELETE /compute/v2.1/os-floating-ips/092ac4db-0f6e-475e-b07d-a1d2b9e55785 => generated 0 bytes in 1242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 18:11:52.620173 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-96f8705a-cde7-456f-afce-5294236bf919 tempest-FloatingIPsTestJSON-765028900 tempest-FloatingIPsTestJSON-765028900-project] Action: 'create', calling method: .version_select at 0x7f77c093eca0>, body: {"pool": null} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:11:52.730563 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9f01ded8-4da4-48f4-add2-707ba8fe4704 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2068223995", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "ec033079-44eb-425d-beee-8bccdd30063c"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:11:52.899899 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.security_group_api [None req-9f01ded8-4da4-48f4-add2-707ba8fe4704 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Neutron security group does_not_exist not found {{(pid=126595) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Jun 10 18:11:52.900531 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-9f01ded8-4da4-48f4-add2-707ba8fe4704 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9f01ded8-4da4-48f4-add2-707ba8fe4704 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 258 Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2068223995", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "ec033079-44eb-425d-beee-8bccdd30063c"}]}} Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: exception: Unable to find security_group with name or id 'does_not_exist' Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2068223995', 'imageRef': 'efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'ec033079-44eb-425d-beee-8bccdd30063c'}]}}} Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Jun 10 18:11:52.937898 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1060, in _validate_and_build_base_options Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 507, in _check_requested_secgroups Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:52.943113 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9f01ded8-4da4-48f4-add2-707ba8fe4704 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:11:52.948397 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9f01ded8-4da4-48f4-add2-707ba8fe4704 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.203288 Jun 10 18:11:52.948397 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2026/4166] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:11:52 2022] POST /compute/v2.1/servers => generated 106 bytes in 205 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 10 18:11:52.975034 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c6547be6-621d-47e8-baeb-a7430c6f5761 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:52.975034 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c6547be6-621d-47e8-baeb-a7430c6f5761 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:52.991212 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c6547be6-621d-47e8-baeb-a7430c6f5761 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:52.991870 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c6547be6-621d-47e8-baeb-a7430c6f5761 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:52.992714 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c6547be6-621d-47e8-baeb-a7430c6f5761 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:52.993171 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c6547be6-621d-47e8-baeb-a7430c6f5761 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:53.188247 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c6547be6-621d-47e8-baeb-a7430c6f5761 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:53.192725 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:11:53.205077 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c6547be6-621d-47e8-baeb-a7430c6f5761 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.272447 Jun 10 18:11:53.213904 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2027/4167] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:52 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:53.240695 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6c78c68f-c490-4954-98be-b55e6aa895c4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:53.241538 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6c78c68f-c490-4954-98be-b55e6aa895c4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:53.266055 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6c78c68f-c490-4954-98be-b55e6aa895c4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:53.269790 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6c78c68f-c490-4954-98be-b55e6aa895c4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:53.271654 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6c78c68f-c490-4954-98be-b55e6aa895c4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:53.274608 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6c78c68f-c490-4954-98be-b55e6aa895c4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:53.526474 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6c78c68f-c490-4954-98be-b55e6aa895c4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:53.540566 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6c78c68f-c490-4954-98be-b55e6aa895c4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559" status: 200 len: 1511 microversion: 2.1 time: 0.322630 Jun 10 18:11:53.541135 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2028/4168] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:53 2022] GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 => generated 1511 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:53.562101 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1e9dfd6c-e109-4594-b5b6-d32afef61511 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:53.563814 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1e9dfd6c-e109-4594-b5b6-d32afef61511 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:53.585507 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1e9dfd6c-e109-4594-b5b6-d32afef61511 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:53.585903 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1e9dfd6c-e109-4594-b5b6-d32afef61511 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:53.587195 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1e9dfd6c-e109-4594-b5b6-d32afef61511 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:53.590200 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1e9dfd6c-e109-4594-b5b6-d32afef61511 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:53.940662 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1e9dfd6c-e109-4594-b5b6-d32afef61511 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:53.959100 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1e9dfd6c-e109-4594-b5b6-d32afef61511 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.415706 Jun 10 18:11:53.962996 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2029/4169] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:53 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:53.979575 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b837aa73-543c-4196-a428-285d2f806a3e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:53.980088 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b837aa73-543c-4196-a428-285d2f806a3e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: e9561f8e-7e89-4432-8b75-a787a0a01d72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:53.988452 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-b837aa73-543c-4196-a428-285d2f806a3e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] HTTP exception thrown: Instance e9561f8e-7e89-4432-8b75-a787a0a01d72 could not be found. Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b837aa73-543c-4196-a428-285d2f806a3e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/e9561f8e-7e89-4432-8b75-a787a0a01d72 HTTP/1.1 Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: exception: Instance e9561f8e-7e89-4432-8b75-a787a0a01d72 could not be found. Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'e9561f8e-7e89-4432-8b75-a787a0a01d72'} Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9561f8e-7e89-4432-8b75-a787a0a01d72 could not be found. Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9561f8e-7e89-4432-8b75-a787a0a01d72 could not be found. Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:53.993035 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:53.997121 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:53.997121 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:53.997121 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:53.997121 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:53.997121 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:11:53.997121 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:11:53.997121 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9561f8e-7e89-4432-8b75-a787a0a01d72 could not be found. Jun 10 18:11:53.997121 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:54.005017 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b837aa73-543c-4196-a428-285d2f806a3e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 404 to user: Instance e9561f8e-7e89-4432-8b75-a787a0a01d72 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:11:54.007515 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b837aa73-543c-4196-a428-285d2f806a3e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "DELETE /compute/v2.1/servers/e9561f8e-7e89-4432-8b75-a787a0a01d72" status: 404 len: 111 microversion: 2.1 time: 0.032316 Jun 10 18:11:54.017346 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2030/4170] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:11:53 2022] DELETE /compute/v2.1/servers/e9561f8e-7e89-4432-8b75-a787a0a01d72 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:11:54.027137 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-438f8417-7c03-4c0d-82b1-909417fe0ea0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:54.031929 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-438f8417-7c03-4c0d-82b1-909417fe0ea0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:54.048915 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-438f8417-7c03-4c0d-82b1-909417fe0ea0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:54.055133 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-438f8417-7c03-4c0d-82b1-909417fe0ea0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:54.063072 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-438f8417-7c03-4c0d-82b1-909417fe0ea0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:54.063831 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-438f8417-7c03-4c0d-82b1-909417fe0ea0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:54.437880 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-438f8417-7c03-4c0d-82b1-909417fe0ea0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:54.455214 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-438f8417-7c03-4c0d-82b1-909417fe0ea0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.430149 Jun 10 18:11:54.457749 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2031/4171] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:54 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:54.479461 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5ac71404-ea7e-43ab-ba54-ae67a907c603 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:54.480333 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5ac71404-ea7e-43ab-ba54-ae67a907c603 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:54.490524 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ac71404-ea7e-43ab-ba54-ae67a907c603 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:54.493561 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ac71404-ea7e-43ab-ba54-ae67a907c603 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:54.496771 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ac71404-ea7e-43ab-ba54-ae67a907c603 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:54.497868 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ac71404-ea7e-43ab-ba54-ae67a907c603 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:54.845786 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5ac71404-ea7e-43ab-ba54-ae67a907c603 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:54.863745 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5ac71404-ea7e-43ab-ba54-ae67a907c603 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.388433 Jun 10 18:11:54.865535 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2032/4172] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:54 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:54.875218 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4a7649dc-d6da-4ede-84e2-47d6a7e2f343 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:54.877296 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4a7649dc-d6da-4ede-84e2-47d6a7e2f343 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:54.891998 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a7649dc-d6da-4ede-84e2-47d6a7e2f343 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:54.893330 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a7649dc-d6da-4ede-84e2-47d6a7e2f343 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:54.894879 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a7649dc-d6da-4ede-84e2-47d6a7e2f343 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:54.895537 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a7649dc-d6da-4ede-84e2-47d6a7e2f343 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:55.236320 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4a7649dc-d6da-4ede-84e2-47d6a7e2f343 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:55.252766 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4a7649dc-d6da-4ede-84e2-47d6a7e2f343 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559" status: 200 len: 1511 microversion: 2.1 time: 0.380443 Jun 10 18:11:55.253632 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2033/4173] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:54 2022] GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 => generated 1511 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:55.270688 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a5550a5a-ecd8-4d02-8faa-79598de892b1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a5550a5a-ecd8-4d02-8faa-79598de892b1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Failed to fetch instance by id 9223372036854775808 {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-a5550a5a-ecd8-4d02-8faa-79598de892b1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a5550a5a-ecd8-4d02-8faa-79598de892b1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 9223372036854775808 could not be found. Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '9223372036854775808'} Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:11:55.277674 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:11:55.282441 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:11:55.282441 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Jun 10 18:11:55.282441 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:55.282441 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:55.282441 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:55.282441 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:55.282441 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:55.282441 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:55.282441 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:11:55.282441 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:11:55.282441 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Jun 10 18:11:55.282441 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:55.282441 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a5550a5a-ecd8-4d02-8faa-79598de892b1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:11:55.282441 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a5550a5a-ecd8-4d02-8faa-79598de892b1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.023726 Jun 10 18:11:55.284106 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2034/4174] 10.222.0.35 () {58 vars in 1187 bytes} [Fri Jun 10 18:11:55 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:11:55.294434 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7b5ad01e-b5a3-43ad-b32a-c3b712a26e80 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:55.295979 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7b5ad01e-b5a3-43ad-b32a-c3b712a26e80 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:55.309461 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b5ad01e-b5a3-43ad-b32a-c3b712a26e80 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:55.309932 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b5ad01e-b5a3-43ad-b32a-c3b712a26e80 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:55.311097 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b5ad01e-b5a3-43ad-b32a-c3b712a26e80 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:55.311555 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b5ad01e-b5a3-43ad-b32a-c3b712a26e80 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:55.776933 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7b5ad01e-b5a3-43ad-b32a-c3b712a26e80 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:55.786681 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7b5ad01e-b5a3-43ad-b32a-c3b712a26e80 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.502028 Jun 10 18:11:55.787294 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2035/4175] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:55 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:55.809678 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c020af54-1319-40e9-ab84-e75a62f76179 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:55.810310 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c020af54-1319-40e9-ab84-e75a62f76179 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:55.832489 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c020af54-1319-40e9-ab84-e75a62f76179 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:55.832489 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c020af54-1319-40e9-ab84-e75a62f76179 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:55.832489 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c020af54-1319-40e9-ab84-e75a62f76179 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:55.834085 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c020af54-1319-40e9-ab84-e75a62f76179 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:56.102967 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-96f8705a-cde7-456f-afce-5294236bf919 tempest-FloatingIPsTestJSON-765028900 tempest-FloatingIPsTestJSON-765028900-project] 10.222.0.35 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.484442 Jun 10 18:11:56.104423 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2141/4176] 10.222.0.35 () {60 vars in 1169 bytes} [Fri Jun 10 18:11:52 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:11:56.123906 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fa40db67-3150-468d-a82a-26dd10925397 tempest-FloatingIPsTestJSON-765028900 tempest-FloatingIPsTestJSON-765028900-project] Calling method '.version_select at 0x7f77c0b655e0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:56.190406 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c020af54-1319-40e9-ab84-e75a62f76179 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:56.205115 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c020af54-1319-40e9-ab84-e75a62f76179 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.399877 Jun 10 18:11:56.205896 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2036/4177] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:55 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:11:56.221762 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ee468fdd-43a8-426f-bc33-a07e77720013 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:56.222448 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ee468fdd-43a8-426f-bc33-a07e77720013 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Failed to fetch instance by id -1 {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 10 18:11:56.223214 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-ee468fdd-43a8-426f-bc33-a07e77720013 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] HTTP exception thrown: Instance -1 could not be found. Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ee468fdd-43a8-426f-bc33-a07e77720013 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: exception: Instance -1 could not be found. Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '-1'} Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:56.224791 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:56.231950 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:11:56.231950 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:11:56.231950 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Jun 10 18:11:56.231950 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:11:56.265418 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ee468fdd-43a8-426f-bc33-a07e77720013 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 404 to user: Instance -1 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:11:56.268182 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ee468fdd-43a8-426f-bc33-a07e77720013 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.048556 Jun 10 18:11:56.276569 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2037/4178] 10.222.0.35 () {58 vars in 1136 bytes} [Fri Jun 10 18:11:56 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 10 18:11:56.286297 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b98c97a6-de6e-4679-81ff-ff6a6a102a71 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:56.286932 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b98c97a6-de6e-4679-81ff-ff6a6a102a71 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:56.357579 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b98c97a6-de6e-4679-81ff-ff6a6a102a71 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:56.357579 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b98c97a6-de6e-4679-81ff-ff6a6a102a71 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:56.357579 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b98c97a6-de6e-4679-81ff-ff6a6a102a71 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:56.359382 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b98c97a6-de6e-4679-81ff-ff6a6a102a71 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:56.875901 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b98c97a6-de6e-4679-81ff-ff6a6a102a71 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:56.901948 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b98c97a6-de6e-4679-81ff-ff6a6a102a71 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559" status: 200 len: 1511 microversion: 2.1 time: 0.624012 Jun 10 18:11:56.903575 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2038/4179] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:56 2022] GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 => generated 1511 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:56.912782 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8467045f-5cad-4652-a72d-c2a82f2f1514 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:56.913910 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8467045f-5cad-4652-a72d-c2a82f2f1514 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:56.940595 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8467045f-5cad-4652-a72d-c2a82f2f1514 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:56.942149 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8467045f-5cad-4652-a72d-c2a82f2f1514 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:56.955701 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8467045f-5cad-4652-a72d-c2a82f2f1514 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:56.956498 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8467045f-5cad-4652-a72d-c2a82f2f1514 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:57.358251 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8467045f-5cad-4652-a72d-c2a82f2f1514 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:57.378459 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8467045f-5cad-4652-a72d-c2a82f2f1514 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.473396 Jun 10 18:11:57.381050 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2039/4180] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:56 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:57.672269 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-41c998df-fee0-4dcb-b304-4ccd674a8698 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-545204047", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "c26f6a24-00dc-4e29-8478-7c9e6523a0cf"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:11:57.758936 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-41c998df-fee0-4dcb-b304-4ccd674a8698 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] validate_networks() for [('c26f6a24-00dc-4e29-8478-7c9e6523a0cf', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:11:58.474438 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fa40db67-3150-468d-a82a-26dd10925397 tempest-FloatingIPsTestJSON-765028900 tempest-FloatingIPsTestJSON-765028900-project] 10.222.0.35 "DELETE /compute/v2.1/os-floating-ips/a3ab62fa-e9e9-4698-9f11-3a58e29e5468" status: 202 len: 0 microversion: 2.1 time: 2.362252 Jun 10 18:11:58.476858 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2142/4181] 10.222.0.35 () {58 vars in 1262 bytes} [Fri Jun 10 18:11:56 2022] DELETE /compute/v2.1/os-floating-ips/a3ab62fa-e9e9-4698-9f11-3a58e29e5468 => generated 0 bytes in 2364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:11:58.488496 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4add0612-9633-42e4-8dec-61c44fb3ff63 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:58.489121 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4add0612-9633-42e4-8dec-61c44fb3ff63 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:58.507121 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4add0612-9633-42e4-8dec-61c44fb3ff63 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:58.507951 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-41c998df-fee0-4dcb-b304-4ccd674a8698 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:11:58.508416 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4add0612-9633-42e4-8dec-61c44fb3ff63 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:58.508518 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-41c998df-fee0-4dcb-b304-4ccd674a8698 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:11:58.508887 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-41c998df-fee0-4dcb-b304-4ccd674a8698 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:11:58.509336 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-41c998df-fee0-4dcb-b304-4ccd674a8698 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:11:58.509854 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4add0612-9633-42e4-8dec-61c44fb3ff63 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:58.510383 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4add0612-9633-42e4-8dec-61c44fb3ff63 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:58.512882 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-41c998df-fee0-4dcb-b304-4ccd674a8698 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:11:58.528543 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41c998df-fee0-4dcb-b304-4ccd674a8698 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:58.529216 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41c998df-fee0-4dcb-b304-4ccd674a8698 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:58.530193 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41c998df-fee0-4dcb-b304-4ccd674a8698 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:58.532285 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41c998df-fee0-4dcb-b304-4ccd674a8698 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:58.562486 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-41c998df-fee0-4dcb-b304-4ccd674a8698 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Getting quotas for project dc6ea0e4d347491eb23c3af053313211. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:11:58.570547 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-41c998df-fee0-4dcb-b304-4ccd674a8698 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Getting quotas for user 8e6b5cd42b2144a69590680e5ef156fa and project dc6ea0e4d347491eb23c3af053313211. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:11:58.588453 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-41c998df-fee0-4dcb-b304-4ccd674a8698 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:11:58.591078 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-41c998df-fee0-4dcb-b304-4ccd674a8698 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 3a5ac7a5-efdb-4191-85ed-237a1d2f7666] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:11:58.738743 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4add0612-9633-42e4-8dec-61c44fb3ff63 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:58.749077 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4add0612-9633-42e4-8dec-61c44fb3ff63 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.271758 Jun 10 18:11:58.761104 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2143/4182] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:58 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:58.768053 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-18b0a313-9c65-4dbe-8019-8cf456c6381c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:58.768970 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-18b0a313-9c65-4dbe-8019-8cf456c6381c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:58.777072 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-18b0a313-9c65-4dbe-8019-8cf456c6381c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:58.777776 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-18b0a313-9c65-4dbe-8019-8cf456c6381c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:58.778804 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-18b0a313-9c65-4dbe-8019-8cf456c6381c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:58.779411 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-18b0a313-9c65-4dbe-8019-8cf456c6381c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:58.798445 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-41c998df-fee0-4dcb-b304-4ccd674a8698 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.413000 Jun 10 18:11:58.800470 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2040/4183] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:11:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1419 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:11:59.181485 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a4561b1f-fa8b-4867-b993-db67c022d9f7 tempest-ServerGroup264TestJSON-1000335924 tempest-ServerGroup264TestJSON-1000335924-project] Action: 'create', calling method: .version_select at 0x7f77c60844c0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:11:59.218813 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-a4561b1f-fa8b-4867-b993-db67c022d9f7 tempest-ServerGroup264TestJSON-1000335924 tempest-ServerGroup264TestJSON-1000335924-project] Getting quotas for project cd3a8f834eb3490aa097fa568886fef5. Resources: {'server_groups'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:11:59.235550 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-a4561b1f-fa8b-4867-b993-db67c022d9f7 tempest-ServerGroup264TestJSON-1000335924 tempest-ServerGroup264TestJSON-1000335924-project] Getting quotas for user 9dedbfb7a2834af0bc001706d511dff9 and project cd3a8f834eb3490aa097fa568886fef5. Resources: {'server_groups'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:11:59.237158 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-18b0a313-9c65-4dbe-8019-8cf456c6381c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:59.241907 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:11:59.243254 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:11:59.258723 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-18b0a313-9c65-4dbe-8019-8cf456c6381c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559" status: 200 len: 1511 microversion: 2.1 time: 0.493305 Jun 10 18:11:59.261056 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2144/4184] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:58 2022] GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 => generated 1511 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:59.276625 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3c5c485e-801d-4169-a160-a77d81684402 tempest-FloatingIPsTestJSON-765028900 tempest-FloatingIPsTestJSON-765028900-project] Calling method '.version_select at 0x7f77c0365d30>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:59.341257 chdv-master-2 devstack@n-api.service[126594]: DEBUG neutronclient.v2_0.client [None req-3c5c485e-801d-4169-a160-a77d81684402 tempest-FloatingIPsTestJSON-765028900 tempest-FloatingIPsTestJSON-765028900-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a3ab62fa-e9e9-4698-9f11-3a58e29e5468 could not be found", "detail": ""}} {{(pid=126594) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 10 18:11:59.342248 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-3c5c485e-801d-4169-a160-a77d81684402 tempest-FloatingIPsTestJSON-765028900 tempest-FloatingIPsTestJSON-765028900-project] HTTP exception thrown: Floating IP not found for ID a3ab62fa-e9e9-4698-9f11-3a58e29e5468 Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3c5c485e-801d-4169-a160-a77d81684402 tempest-FloatingIPsTestJSON-765028900 tempest-FloatingIPsTestJSON-765028900-project] Request method failure captured: Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/os-floating-ips/a3ab62fa-e9e9-4698-9f11-3a58e29e5468 HTTP/1.1 Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4lgrJx6JR96LiYpl3ArXTId8ykieMcboxPdICxUcMw9MN-ANRnIHycpfOd35iftPercY0AY9oxsLM3HEPwhYlYW_N0BfGwT01iSxuqxib6WsD_vhiVqoJFEghNL9be4e_mNlwjOzOKDw0VHEREfe8QPVBHnVaOXDdUlYTKVn2W-dFE Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 7b0560dd5f8243bb8681ab952755261f Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-FloatingIPsTestJSON-765028900 Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/7b0560dd5f8243bb8681ab952755261f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7b0560dd5f8243bb8681ab952755261f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7b0560dd5f8243bb8681ab952755261f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_7b0560dd5f8243bb8681ab952755261f", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-FloatingIPsTestJSON-765028900 Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 7b0560dd5f8243bb8681ab952755261f Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-FloatingIPsTestJSON-765028900 Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-FloatingIPsTestJSON-765028900-project Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: a221b1333c144a9e887098251e9db379 Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-FloatingIPsTestJSON-765028900-project Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: exception: Floating IP not found for ID a3ab62fa-e9e9-4698-9f11-3a58e29e5468 Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'a3ab62fa-e9e9-4698-9f11-3a58e29e5468'} Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2810, in get_floating_ip Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a3ab62fa-e9e9-4698-9f11-3a58e29e5468 could not be found Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-90714651-a90e-4ec6-a84d-b7fb5a34bc16'] Jun 10 18:11:59.345012 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:59.350396 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:59.350396 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:59.350396 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:59.350396 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jun 10 18:11:59.350396 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jun 10 18:11:59.350396 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2813, in get_floating_ip Jun 10 18:11:59.350396 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jun 10 18:11:59.350396 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a3ab62fa-e9e9-4698-9f11-3a58e29e5468. Jun 10 18:11:59.350396 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:59.350396 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:59.350396 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:59.350396 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:59.350396 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:59.350396 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:59.350396 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:11:59.350396 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:11:59.350396 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:11:59.350396 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:11:59.350396 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:11:59.350396 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:11:59.350396 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jun 10 18:11:59.350396 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 10 18:11:59.350396 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a3ab62fa-e9e9-4698-9f11-3a58e29e5468 Jun 10 18:11:59.350396 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:59.350396 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:59.350396 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:59.350396 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:59.350396 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:59.350396 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:59.350396 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:11:59.350396 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:11:59.350396 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a3ab62fa-e9e9-4698-9f11-3a58e29e5468 Jun 10 18:11:59.350396 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:59.350396 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3c5c485e-801d-4169-a160-a77d81684402 tempest-FloatingIPsTestJSON-765028900 tempest-FloatingIPsTestJSON-765028900-project] Returning 404 to user: Floating IP not found for ID a3ab62fa-e9e9-4698-9f11-3a58e29e5468 {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:11:59.350396 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3c5c485e-801d-4169-a160-a77d81684402 tempest-FloatingIPsTestJSON-765028900 tempest-FloatingIPsTestJSON-765028900-project] 10.222.0.35 "GET /compute/v2.1/os-floating-ips/a3ab62fa-e9e9-4698-9f11-3a58e29e5468" status: 404 len: 111 microversion: 2.1 time: 0.083982 Jun 10 18:11:59.350396 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2145/4185] 10.222.0.35 () {58 vars in 1259 bytes} [Fri Jun 10 18:11:59 2022] GET /compute/v2.1/os-floating-ips/a3ab62fa-e9e9-4698-9f11-3a58e29e5468 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:11:59.361564 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3e6c8289-29e2-409c-a245-17a27d4d5396 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:11:59.361564 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3e6c8289-29e2-409c-a245-17a27d4d5396 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: d6126ad5-ab0d-454b-9021-9a12f390542e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:59.371826 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-3e6c8289-29e2-409c-a245-17a27d4d5396 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] HTTP exception thrown: Instance d6126ad5-ab0d-454b-9021-9a12f390542e could not be found. Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3e6c8289-29e2-409c-a245-17a27d4d5396 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/servers/d6126ad5-ab0d-454b-9021-9a12f390542e/action HTTP/1.1 Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 19 Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: {"forceDelete": {}} Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: exception: Instance d6126ad5-ab0d-454b-9021-9a12f390542e could not be found. Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'd6126ad5-ab0d-454b-9021-9a12f390542e', 'body': {'forceDelete': {}}} Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6126ad5-ab0d-454b-9021-9a12f390542e could not be found. Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6126ad5-ab0d-454b-9021-9a12f390542e could not be found. Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:59.385149 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:59.395626 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:11:59.395626 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:11:59.395626 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6126ad5-ab0d-454b-9021-9a12f390542e could not be found. Jun 10 18:11:59.395626 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:59.395626 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3e6c8289-29e2-409c-a245-17a27d4d5396 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 404 to user: Instance d6126ad5-ab0d-454b-9021-9a12f390542e could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:11:59.395626 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3e6c8289-29e2-409c-a245-17a27d4d5396 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "POST /compute/v2.1/servers/d6126ad5-ab0d-454b-9021-9a12f390542e/action" status: 404 len: 111 microversion: 2.1 time: 0.034485 Jun 10 18:11:59.395626 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2146/4186] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:11:59 2022] POST /compute/v2.1/servers/d6126ad5-ab0d-454b-9021-9a12f390542e/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:11:59.398903 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4576e744-ba77-4d72-ae9b-daeaa6a7da0b tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:59.399543 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4576e744-ba77-4d72-ae9b-daeaa6a7da0b tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 3a5ac7a5-efdb-4191-85ed-237a1d2f7666] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:59.434610 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-a4561b1f-fa8b-4867-b993-db67c022d9f7 tempest-ServerGroup264TestJSON-1000335924 tempest-ServerGroup264TestJSON-1000335924-project] Getting quotas for project cd3a8f834eb3490aa097fa568886fef5. Resources: {'server_groups'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:11:59.442916 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-a4561b1f-fa8b-4867-b993-db67c022d9f7 tempest-ServerGroup264TestJSON-1000335924 tempest-ServerGroup264TestJSON-1000335924-project] Getting quotas for user 9dedbfb7a2834af0bc001706d511dff9 and project cd3a8f834eb3490aa097fa568886fef5. Resources: {'server_groups'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:11:59.467531 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4576e744-ba77-4d72-ae9b-daeaa6a7da0b tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:59.475330 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4576e744-ba77-4d72-ae9b-daeaa6a7da0b tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666" status: 200 len: 1224 microversion: 2.1 time: 0.081282 Jun 10 18:11:59.477970 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2147/4187] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:59 2022] GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:59.480636 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a4561b1f-fa8b-4867-b993-db67c022d9f7 tempest-ServerGroup264TestJSON-1000335924 tempest-ServerGroup264TestJSON-1000335924-project] 10.222.0.35 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.672560 Jun 10 18:11:59.483587 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2041/4188] 10.222.0.35 () {62 vars in 1213 bytes} [Fri Jun 10 18:11:58 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:11:59.484508 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7ac1b1ad-1e4e-427d-b7ec-460cbc64cd6f tempest-FloatingIPsTestJSON-765028900 tempest-FloatingIPsTestJSON-765028900-project] Calling method '.version_select at 0x7f77c09271f0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:59.487325 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e603f2fd-1e35-4d22-bbda-444a56b3d3bd tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:59.488111 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e603f2fd-1e35-4d22-bbda-444a56b3d3bd tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:59.495335 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e603f2fd-1e35-4d22-bbda-444a56b3d3bd tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:59.496278 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e603f2fd-1e35-4d22-bbda-444a56b3d3bd tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:59.497242 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e603f2fd-1e35-4d22-bbda-444a56b3d3bd tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:59.497849 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e603f2fd-1e35-4d22-bbda-444a56b3d3bd tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:59.547215 chdv-master-2 devstack@n-api.service[126594]: DEBUG neutronclient.v2_0.client [None req-7ac1b1ad-1e4e-427d-b7ec-460cbc64cd6f tempest-FloatingIPsTestJSON-765028900 tempest-FloatingIPsTestJSON-765028900-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a3ab62fa-e9e9-4698-9f11-3a58e29e5468 could not be found", "detail": ""}} {{(pid=126594) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-7ac1b1ad-1e4e-427d-b7ec-460cbc64cd6f tempest-FloatingIPsTestJSON-765028900 tempest-FloatingIPsTestJSON-765028900-project] HTTP exception thrown: Floating IP not found for ID a3ab62fa-e9e9-4698-9f11-3a58e29e5468 Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7ac1b1ad-1e4e-427d-b7ec-460cbc64cd6f tempest-FloatingIPsTestJSON-765028900 tempest-FloatingIPsTestJSON-765028900-project] Request method failure captured: Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: request: DELETE /compute/v2.1/os-floating-ips/a3ab62fa-e9e9-4698-9f11-3a58e29e5468 HTTP/1.1 Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4lgrJx6JR96LiYpl3ArXTId8ykieMcboxPdICxUcMw9MN-ANRnIHycpfOd35iftPercY0AY9oxsLM3HEPwhYlYW_N0BfGwT01iSxuqxib6WsD_vhiVqoJFEghNL9be4e_mNlwjOzOKDw0VHEREfe8QPVBHnVaOXDdUlYTKVn2W-dFE Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 7b0560dd5f8243bb8681ab952755261f Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-FloatingIPsTestJSON-765028900 Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/7b0560dd5f8243bb8681ab952755261f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7b0560dd5f8243bb8681ab952755261f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7b0560dd5f8243bb8681ab952755261f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_7b0560dd5f8243bb8681ab952755261f", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-FloatingIPsTestJSON-765028900 Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 7b0560dd5f8243bb8681ab952755261f Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-FloatingIPsTestJSON-765028900 Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-FloatingIPsTestJSON-765028900-project Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: a221b1333c144a9e887098251e9db379 Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-FloatingIPsTestJSON-765028900-project Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: exception: Floating IP not found for ID a3ab62fa-e9e9-4698-9f11-3a58e29e5468 Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'a3ab62fa-e9e9-4698-9f11-3a58e29e5468'} Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2810, in get_floating_ip Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 10 18:11:59.552555 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 10 18:11:59.559483 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a3ab62fa-e9e9-4698-9f11-3a58e29e5468 could not be found Jun 10 18:11:59.559483 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2814e934-cbc3-4d3b-877d-297b3af36c95'] Jun 10 18:11:59.559483 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:59.559483 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:59.559483 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:59.559483 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:59.559483 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jun 10 18:11:59.559483 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jun 10 18:11:59.559483 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2813, in get_floating_ip Jun 10 18:11:59.559483 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jun 10 18:11:59.559483 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a3ab62fa-e9e9-4698-9f11-3a58e29e5468. Jun 10 18:11:59.559483 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:59.559483 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:59.559483 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:59.559483 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:59.559483 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:59.559483 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:59.559483 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:11:59.559483 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:11:59.559483 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:11:59.559483 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:11:59.559483 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:11:59.559483 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:11:59.559483 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jun 10 18:11:59.559483 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 10 18:11:59.559483 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a3ab62fa-e9e9-4698-9f11-3a58e29e5468 Jun 10 18:11:59.559483 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:59.559483 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:59.559483 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:59.559483 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:59.559483 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:59.559483 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:59.559483 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:11:59.559483 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:11:59.559483 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a3ab62fa-e9e9-4698-9f11-3a58e29e5468 Jun 10 18:11:59.559483 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:59.559483 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7ac1b1ad-1e4e-427d-b7ec-460cbc64cd6f tempest-FloatingIPsTestJSON-765028900 tempest-FloatingIPsTestJSON-765028900-project] Returning 404 to user: Floating IP not found for ID a3ab62fa-e9e9-4698-9f11-3a58e29e5468 {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:11:59.559483 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7ac1b1ad-1e4e-427d-b7ec-460cbc64cd6f tempest-FloatingIPsTestJSON-765028900 tempest-FloatingIPsTestJSON-765028900-project] 10.222.0.35 "DELETE /compute/v2.1/os-floating-ips/a3ab62fa-e9e9-4698-9f11-3a58e29e5468" status: 404 len: 111 microversion: 2.1 time: 0.071671 Jun 10 18:11:59.559483 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2148/4189] 10.222.0.35 () {58 vars in 1262 bytes} [Fri Jun 10 18:11:59 2022] DELETE /compute/v2.1/os-floating-ips/a3ab62fa-e9e9-4698-9f11-3a58e29e5468 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:11:59.567204 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bc44fd5b-276b-4a61-814a-8cd989bfa3f0 tempest-ServerGroup264TestJSON-1000335924 tempest-ServerGroup264TestJSON-1000335924-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:59.574889 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bc44fd5b-276b-4a61-814a-8cd989bfa3f0 tempest-ServerGroup264TestJSON-1000335924 tempest-ServerGroup264TestJSON-1000335924-project] 10.222.0.35 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.021489 Jun 10 18:11:59.575471 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2149/4190] 10.222.0.35 () {60 vars in 1192 bytes} [Fri Jun 10 18:11:59 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:11:59.586705 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-884ab18f-0251-4f35-9ef9-23e66ad4412d tempest-ServerGroup264TestJSON-1000335924 tempest-ServerGroup264TestJSON-1000335924-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:59.598883 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-884ab18f-0251-4f35-9ef9-23e66ad4412d tempest-ServerGroup264TestJSON-1000335924 tempest-ServerGroup264TestJSON-1000335924-project] 10.222.0.35 "GET /compute/v2.1/os-server-groups/9481ab86-4a42-4af9-8494-fdb4df939100" status: 200 len: 235 microversion: 2.64 time: 0.017238 Jun 10 18:11:59.606982 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2150/4191] 10.222.0.35 () {60 vars in 1303 bytes} [Fri Jun 10 18:11:59 2022] GET /compute/v2.1/os-server-groups/9481ab86-4a42-4af9-8494-fdb4df939100 => generated 235 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 10 18:11:59.614753 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a2a9ea88-28ad-439f-a6aa-0a0f6d7006a7 tempest-ServerGroup264TestJSON-1000335924 tempest-ServerGroup264TestJSON-1000335924-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:59.727341 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a2a9ea88-28ad-439f-a6aa-0a0f6d7006a7 tempest-ServerGroup264TestJSON-1000335924 tempest-ServerGroup264TestJSON-1000335924-project] 10.222.0.35 "DELETE /compute/v2.1/os-server-groups/9481ab86-4a42-4af9-8494-fdb4df939100" status: 204 len: 0 microversion: 2.64 time: 0.118403 Jun 10 18:11:59.728659 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2151/4192] 10.222.0.35 () {60 vars in 1306 bytes} [Fri Jun 10 18:11:59 2022] DELETE /compute/v2.1/os-server-groups/9481ab86-4a42-4af9-8494-fdb4df939100 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 10 18:11:59.738472 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6fcf94ec-fc04-452f-8175-1038e4e5dccd tempest-ServerGroup264TestJSON-1000335924 tempest-ServerGroup264TestJSON-1000335924-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:59.749577 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-6fcf94ec-fc04-452f-8175-1038e4e5dccd tempest-ServerGroup264TestJSON-1000335924 tempest-ServerGroup264TestJSON-1000335924-project] HTTP exception thrown: Instance group 9481ab86-4a42-4af9-8494-fdb4df939100 could not be found. Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6fcf94ec-fc04-452f-8175-1038e4e5dccd tempest-ServerGroup264TestJSON-1000335924 tempest-ServerGroup264TestJSON-1000335924-project] Request method failure captured: Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: request: DELETE /compute/v2.1/os-server-groups/9481ab86-4a42-4af9-8494-fdb4df939100 HTTP/1.1 Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4ltea3Tv_46sIUo8NBxk4_fYSBgGvnimo3kLNITgNZxb9clnmZypo1dZcBngAuieLcHKJHqM8FMikFN-xv8Bvy8f50CgRUHGVcnNWjE93rZZgZnf46fOhoJm_I2ISa3QJeF2jhfahwzQjiBZCnwq_miOUMoNhRIGo8TLOQkXmcp3cs Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: X-Openstack-Nova-Api-Version: 2.64 Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: cd3a8f834eb3490aa097fa568886fef5 Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServerGroup264TestJSON-1000335924 Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/cd3a8f834eb3490aa097fa568886fef5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/cd3a8f834eb3490aa097fa568886fef5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/cd3a8f834eb3490aa097fa568886fef5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_cd3a8f834eb3490aa097fa568886fef5", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServerGroup264TestJSON-1000335924 Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: cd3a8f834eb3490aa097fa568886fef5 Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1000335924 Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServerGroup264TestJSON-1000335924-project Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 9dedbfb7a2834af0bc001706d511dff9 Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServerGroup264TestJSON-1000335924-project Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: exception: Instance group 9481ab86-4a42-4af9-8494-fdb4df939100 could not be found. Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '9481ab86-4a42-4af9-8494-fdb4df939100'} Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 9481ab86-4a42-4af9-8494-fdb4df939100 could not be found. Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 9481ab86-4a42-4af9-8494-fdb4df939100 could not be found. Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:59.753205 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:11:59.765070 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:11:59.765070 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:11:59.765070 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:11:59.765070 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:11:59.765070 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 9481ab86-4a42-4af9-8494-fdb4df939100 could not be found. Jun 10 18:11:59.765070 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:11:59.765070 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6fcf94ec-fc04-452f-8175-1038e4e5dccd tempest-ServerGroup264TestJSON-1000335924 tempest-ServerGroup264TestJSON-1000335924-project] Returning 404 to user: Instance group 9481ab86-4a42-4af9-8494-fdb4df939100 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:11:59.765070 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6fcf94ec-fc04-452f-8175-1038e4e5dccd tempest-ServerGroup264TestJSON-1000335924 tempest-ServerGroup264TestJSON-1000335924-project] 10.222.0.35 "DELETE /compute/v2.1/os-server-groups/9481ab86-4a42-4af9-8494-fdb4df939100" status: 404 len: 117 microversion: 2.64 time: 0.021302 Jun 10 18:11:59.765070 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2152/4193] 10.222.0.35 () {60 vars in 1306 bytes} [Fri Jun 10 18:11:59 2022] DELETE /compute/v2.1/os-server-groups/9481ab86-4a42-4af9-8494-fdb4df939100 => generated 117 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 10 18:11:59.917827 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e603f2fd-1e35-4d22-bbda-444a56b3d3bd tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:11:59.931996 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e603f2fd-1e35-4d22-bbda-444a56b3d3bd tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.448328 Jun 10 18:11:59.935635 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2042/4194] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:59 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:11:59.957898 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4c1e874f-a3c8-493a-891e-455214ed751d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:11:59.959243 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4c1e874f-a3c8-493a-891e-455214ed751d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:11:59.967297 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4c1e874f-a3c8-493a-891e-455214ed751d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:59.967762 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4c1e874f-a3c8-493a-891e-455214ed751d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:11:59.978406 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4c1e874f-a3c8-493a-891e-455214ed751d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:11:59.980661 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4c1e874f-a3c8-493a-891e-455214ed751d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:00.279009 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cfa81a2d-523a-4fcc-b982-4a50e78edc0b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:00.282873 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cfa81a2d-523a-4fcc-b982-4a50e78edc0b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:00.293258 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cfa81a2d-523a-4fcc-b982-4a50e78edc0b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:00.296135 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cfa81a2d-523a-4fcc-b982-4a50e78edc0b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:00.300170 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cfa81a2d-523a-4fcc-b982-4a50e78edc0b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:00.300474 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cfa81a2d-523a-4fcc-b982-4a50e78edc0b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:00.340330 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4c1e874f-a3c8-493a-891e-455214ed751d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:00.350944 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4c1e874f-a3c8-493a-891e-455214ed751d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.396809 Jun 10 18:12:00.352164 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2153/4195] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:11:59 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:00.371264 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-71965493-10a0-4bb3-b61b-d68714105ca5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:00.375944 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-71965493-10a0-4bb3-b61b-d68714105ca5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 420b1fbb-a71d-411d-9197-a6e857b8c9fd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:00.390409 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-71965493-10a0-4bb3-b61b-d68714105ca5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] HTTP exception thrown: Instance 420b1fbb-a71d-411d-9197-a6e857b8c9fd could not be found. Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-71965493-10a0-4bb3-b61b-d68714105ca5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/servers/420b1fbb-a71d-411d-9197-a6e857b8c9fd/action HTTP/1.1 Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 39 Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: {"os-getConsoleOutput": {"length": 10}} Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 420b1fbb-a71d-411d-9197-a6e857b8c9fd could not be found. Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '420b1fbb-a71d-411d-9197-a6e857b8c9fd', 'body': {'os-getConsoleOutput': {'length': 10}}} Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 420b1fbb-a71d-411d-9197-a6e857b8c9fd could not be found. Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 420b1fbb-a71d-411d-9197-a6e857b8c9fd could not be found. Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:00.393389 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:00.398322 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:00.398322 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:00.398322 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:12:00.398322 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:12:00.398322 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 420b1fbb-a71d-411d-9197-a6e857b8c9fd could not be found. Jun 10 18:12:00.398322 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:00.401070 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-71965493-10a0-4bb3-b61b-d68714105ca5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 404 to user: Instance 420b1fbb-a71d-411d-9197-a6e857b8c9fd could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:12:00.402192 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-71965493-10a0-4bb3-b61b-d68714105ca5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "POST /compute/v2.1/servers/420b1fbb-a71d-411d-9197-a6e857b8c9fd/action" status: 404 len: 111 microversion: 2.1 time: 0.036842 Jun 10 18:12:00.404574 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2154/4196] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:12:00 2022] POST /compute/v2.1/servers/420b1fbb-a71d-411d-9197-a6e857b8c9fd/action => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:12:00.418677 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a4c7f7dc-b06c-417e-97c7-addfd1ac9654 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:00.419330 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a4c7f7dc-b06c-417e-97c7-addfd1ac9654 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:00.429952 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a4c7f7dc-b06c-417e-97c7-addfd1ac9654 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:00.434297 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a4c7f7dc-b06c-417e-97c7-addfd1ac9654 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:00.434297 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a4c7f7dc-b06c-417e-97c7-addfd1ac9654 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:00.434297 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a4c7f7dc-b06c-417e-97c7-addfd1ac9654 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:00.805048 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cfa81a2d-523a-4fcc-b982-4a50e78edc0b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:00.817420 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cfa81a2d-523a-4fcc-b982-4a50e78edc0b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559" status: 200 len: 1511 microversion: 2.1 time: 0.545749 Jun 10 18:12:00.831622 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2043/4197] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:00 2022] GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 => generated 1511 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:00.845091 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-25876bdb-b898-4f43-897f-f96ea75b6767 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:00.847131 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-25876bdb-b898-4f43-897f-f96ea75b6767 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 3a5ac7a5-efdb-4191-85ed-237a1d2f7666] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:00.864330 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-25876bdb-b898-4f43-897f-f96ea75b6767 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:00.864330 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-25876bdb-b898-4f43-897f-f96ea75b6767 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:00.864529 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a4c7f7dc-b06c-417e-97c7-addfd1ac9654 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:00.868569 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-25876bdb-b898-4f43-897f-f96ea75b6767 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:00.869233 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-25876bdb-b898-4f43-897f-f96ea75b6767 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:00.876359 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a4c7f7dc-b06c-417e-97c7-addfd1ac9654 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.467113 Jun 10 18:12:00.883869 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2155/4198] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:00 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:00.905846 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-08c3bc2b-1cd5-4143-bf31-75c2df430cd2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:00.907029 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-08c3bc2b-1cd5-4143-bf31-75c2df430cd2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:00.918327 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-08c3bc2b-1cd5-4143-bf31-75c2df430cd2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:00.918327 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-08c3bc2b-1cd5-4143-bf31-75c2df430cd2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:00.918327 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-08c3bc2b-1cd5-4143-bf31-75c2df430cd2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:00.927741 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-08c3bc2b-1cd5-4143-bf31-75c2df430cd2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:01.114287 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-25876bdb-b898-4f43-897f-f96ea75b6767 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:01.165532 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-25876bdb-b898-4f43-897f-f96ea75b6767 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666" status: 200 len: 1220 microversion: 2.1 time: 0.332687 Jun 10 18:12:01.167522 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2044/4199] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:00 2022] GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666 => generated 1220 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:01.454765 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-08c3bc2b-1cd5-4143-bf31-75c2df430cd2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:01.475422 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-08c3bc2b-1cd5-4143-bf31-75c2df430cd2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.573980 Jun 10 18:12:01.477070 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2156/4200] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:00 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:01.492808 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e786d68a-0b4a-4cc8-841c-f6ecc566ce44 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:01.493474 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e786d68a-0b4a-4cc8-841c-f6ecc566ce44 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: aa6538e0-34bb-4f54-a94b-ca7aaff7089a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:01.506756 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-e786d68a-0b4a-4cc8-841c-f6ecc566ce44 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] HTTP exception thrown: Instance aa6538e0-34bb-4f54-a94b-ca7aaff7089a could not be found. Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e786d68a-0b4a-4cc8-841c-f6ecc566ce44 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/aa6538e0-34bb-4f54-a94b-ca7aaff7089a HTTP/1.1 Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: exception: Instance aa6538e0-34bb-4f54-a94b-ca7aaff7089a could not be found. Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'aa6538e0-34bb-4f54-a94b-ca7aaff7089a'} Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa6538e0-34bb-4f54-a94b-ca7aaff7089a could not be found. Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa6538e0-34bb-4f54-a94b-ca7aaff7089a could not be found. Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:01.512030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:01.518232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:01.518232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:12:01.518232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:12:01.518232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa6538e0-34bb-4f54-a94b-ca7aaff7089a could not be found. Jun 10 18:12:01.518232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:01.521121 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e786d68a-0b4a-4cc8-841c-f6ecc566ce44 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 404 to user: Instance aa6538e0-34bb-4f54-a94b-ca7aaff7089a could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:12:01.522311 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e786d68a-0b4a-4cc8-841c-f6ecc566ce44 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/aa6538e0-34bb-4f54-a94b-ca7aaff7089a" status: 404 len: 111 microversion: 2.1 time: 0.033933 Jun 10 18:12:01.523508 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2045/4201] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:01 2022] GET /compute/v2.1/servers/aa6538e0-34bb-4f54-a94b-ca7aaff7089a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:12:01.532942 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-628092ee-3a12-47ee-94a3-0961736ec0b2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:01.533587 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-628092ee-3a12-47ee-94a3-0961736ec0b2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:01.549608 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-628092ee-3a12-47ee-94a3-0961736ec0b2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:01.553193 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-628092ee-3a12-47ee-94a3-0961736ec0b2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:01.554786 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-628092ee-3a12-47ee-94a3-0961736ec0b2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:01.556619 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-628092ee-3a12-47ee-94a3-0961736ec0b2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:01.839484 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5aeefe9c-2b3d-4b47-b615-f25882bef1d6 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:01.847636 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5aeefe9c-2b3d-4b47-b615-f25882bef1d6 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:01.856043 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5aeefe9c-2b3d-4b47-b615-f25882bef1d6 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:01.856747 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5aeefe9c-2b3d-4b47-b615-f25882bef1d6 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:01.861454 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5aeefe9c-2b3d-4b47-b615-f25882bef1d6 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:01.862059 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5aeefe9c-2b3d-4b47-b615-f25882bef1d6 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:02.088865 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-628092ee-3a12-47ee-94a3-0961736ec0b2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:02.099815 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-628092ee-3a12-47ee-94a3-0961736ec0b2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.571229 Jun 10 18:12:02.101617 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2157/4202] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:01 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:02.123617 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d5767684-6133-4f58-b7f4-06295393fbdf tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:02.124262 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d5767684-6133-4f58-b7f4-06295393fbdf tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:02.149777 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d5767684-6133-4f58-b7f4-06295393fbdf tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:02.149777 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d5767684-6133-4f58-b7f4-06295393fbdf tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:02.149777 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d5767684-6133-4f58-b7f4-06295393fbdf tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:02.149777 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d5767684-6133-4f58-b7f4-06295393fbdf tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:02.394222 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5aeefe9c-2b3d-4b47-b615-f25882bef1d6 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:02.403323 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5aeefe9c-2b3d-4b47-b615-f25882bef1d6 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559" status: 200 len: 1511 microversion: 2.1 time: 0.568167 Jun 10 18:12:02.409433 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2046/4203] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:01 2022] GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 => generated 1511 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:12:02.417734 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4863fbbc-4a71-4644-b4bb-7dda4a018ad7 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:02.421159 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4863fbbc-4a71-4644-b4bb-7dda4a018ad7 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 3a5ac7a5-efdb-4191-85ed-237a1d2f7666] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:02.427891 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4863fbbc-4a71-4644-b4bb-7dda4a018ad7 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:02.428388 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4863fbbc-4a71-4644-b4bb-7dda4a018ad7 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:02.429506 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4863fbbc-4a71-4644-b4bb-7dda4a018ad7 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:02.430156 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4863fbbc-4a71-4644-b4bb-7dda4a018ad7 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:02.486756 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d5767684-6133-4f58-b7f4-06295393fbdf tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:02.506051 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d5767684-6133-4f58-b7f4-06295393fbdf tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.389483 Jun 10 18:12:02.507416 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2158/4204] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:02 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:12:02.553358 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4863fbbc-4a71-4644-b4bb-7dda4a018ad7 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:02.564258 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4863fbbc-4a71-4644-b4bb-7dda4a018ad7 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666" status: 200 len: 1282 microversion: 2.1 time: 0.151462 Jun 10 18:12:02.565150 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2047/4205] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:02 2022] GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666 => generated 1282 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:02.854041 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a9819704-d02f-4266-9e92-a5953e525855 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-803951218", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "ec033079-44eb-425d-beee-8bccdd30063c"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a9819704-d02f-4266-9e92-a5953e525855 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 237 Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-803951218", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "ec033079-44eb-425d-beee-8bccdd30063c"}]}} Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-803951218', 'imageRef': 'efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'ec033079-44eb-425d-beee-8bccdd30063c'}]}}} Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise error Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 10 18:12:02.858360 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 10 18:12:02.863660 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 10 18:12:02.863660 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 10 18:12:02.863660 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jun 10 18:12:02.863660 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:02.863660 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:02.863660 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:02.863660 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:02.863660 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:02.863660 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:02.863660 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 10 18:12:02.863660 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 10 18:12:02.863660 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jun 10 18:12:02.863660 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:02.867033 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a9819704-d02f-4266-9e92-a5953e525855 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:12:02.872564 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a9819704-d02f-4266-9e92-a5953e525855 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.022465 Jun 10 18:12:02.873932 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2159/4206] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:12:02 2022] POST /compute/v2.1/servers => generated 139 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:12:02.882421 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d914094b-497b-411f-9a4c-487648d310e3 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:02.883050 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d914094b-497b-411f-9a4c-487648d310e3 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:02.892226 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d914094b-497b-411f-9a4c-487648d310e3 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:02.893011 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d914094b-497b-411f-9a4c-487648d310e3 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:02.894155 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d914094b-497b-411f-9a4c-487648d310e3 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:02.894945 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d914094b-497b-411f-9a4c-487648d310e3 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:03.426750 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f4ca9ff9-d3f0-4677-8a33-3910c71bd093 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:03.427904 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f4ca9ff9-d3f0-4677-8a33-3910c71bd093 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:03.449596 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4ca9ff9-d3f0-4677-8a33-3910c71bd093 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:03.450051 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4ca9ff9-d3f0-4677-8a33-3910c71bd093 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:03.450844 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4ca9ff9-d3f0-4677-8a33-3910c71bd093 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:03.451286 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4ca9ff9-d3f0-4677-8a33-3910c71bd093 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:03.948622 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f4ca9ff9-d3f0-4677-8a33-3910c71bd093 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:03.960911 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f4ca9ff9-d3f0-4677-8a33-3910c71bd093 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559" status: 200 len: 1511 microversion: 2.1 time: 0.537179 Jun 10 18:12:03.971707 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2160/4207] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:03 2022] GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 => generated 1511 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:03.977966 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f6d3c864-40a1-4c1a-9850-4b1dc30d1768 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:03.978953 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f6d3c864-40a1-4c1a-9850-4b1dc30d1768 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 3a5ac7a5-efdb-4191-85ed-237a1d2f7666] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:03.986843 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d914094b-497b-411f-9a4c-487648d310e3 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:03.990566 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f6d3c864-40a1-4c1a-9850-4b1dc30d1768 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:03.991310 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f6d3c864-40a1-4c1a-9850-4b1dc30d1768 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:03.999347 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d914094b-497b-411f-9a4c-487648d310e3 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 1.121327 Jun 10 18:12:04.003139 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2048/4208] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:02 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:04.003466 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f6d3c864-40a1-4c1a-9850-4b1dc30d1768 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:04.004124 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f6d3c864-40a1-4c1a-9850-4b1dc30d1768 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:04.027486 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ebafdd4e-9ca2-4714-9c76-d8d5d50b6bf8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:04.028566 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ebafdd4e-9ca2-4714-9c76-d8d5d50b6bf8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:04.040754 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ebafdd4e-9ca2-4714-9c76-d8d5d50b6bf8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:04.045962 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ebafdd4e-9ca2-4714-9c76-d8d5d50b6bf8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:04.047359 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ebafdd4e-9ca2-4714-9c76-d8d5d50b6bf8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:04.047984 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ebafdd4e-9ca2-4714-9c76-d8d5d50b6bf8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:04.333430 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f6d3c864-40a1-4c1a-9850-4b1dc30d1768 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:04.347066 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f6d3c864-40a1-4c1a-9850-4b1dc30d1768 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666" status: 200 len: 1282 microversion: 2.1 time: 0.370605 Jun 10 18:12:04.350994 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2161/4209] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:03 2022] GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666 => generated 1282 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:04.543681 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ebafdd4e-9ca2-4714-9c76-d8d5d50b6bf8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:04.551894 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ebafdd4e-9ca2-4714-9c76-d8d5d50b6bf8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.530639 Jun 10 18:12:04.573712 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2049/4210] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:04 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:12:04.805480 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f474f397-2d46-4d99-b856-fb0aa4dee4e0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1601425444", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "ec033079-44eb-425d-beee-8bccdd30063c"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f474f397-2d46-4d99-b856-fb0aa4dee4e0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 235 Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1601425444", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "ec033079-44eb-425d-beee-8bccdd30063c"}]}} Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1601425444', 'imageRef': 'efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'ec033079-44eb-425d-beee-8bccdd30063c'}]}}} Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = func(instance) Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/_format.py", line 210, in is_ipv6 Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return socket.inet_pton(socket.AF_INET6, instance) Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi OSError: illegal IP address string passed to inet_pton Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise error Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi 'notvalid' Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:12:04.825751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:12:04.830941 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:12:04.830941 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:12:04.830941 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:12:04.830941 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:12:04.830941 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 10 18:12:04.830941 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 10 18:12:04.830941 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 10 18:12:04.830941 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 10 18:12:04.830941 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 10 18:12:04.830941 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 10 18:12:04.830941 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jun 10 18:12:04.830941 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:04.830941 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:04.830941 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:04.830941 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:04.830941 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:04.830941 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:04.830941 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 10 18:12:04.830941 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 10 18:12:04.830941 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jun 10 18:12:04.830941 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:04.834119 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f474f397-2d46-4d99-b856-fb0aa4dee4e0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:12:04.835726 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f474f397-2d46-4d99-b856-fb0aa4dee4e0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.034631 Jun 10 18:12:04.836898 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2162/4211] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:12:04 2022] POST /compute/v2.1/servers => generated 133 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:12:04.847721 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fd8018d3-9ac7-47fc-8679-742b574c8c5b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:04.849037 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fd8018d3-9ac7-47fc-8679-742b574c8c5b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:04.860407 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd8018d3-9ac7-47fc-8679-742b574c8c5b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:04.862272 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd8018d3-9ac7-47fc-8679-742b574c8c5b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:04.865119 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd8018d3-9ac7-47fc-8679-742b574c8c5b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:04.866444 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd8018d3-9ac7-47fc-8679-742b574c8c5b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:04.878242 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:12:04.980343 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6a932f6d-a4ee-4fef-8bc4-ec7d391f3585 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:04.981130 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6a932f6d-a4ee-4fef-8bc4-ec7d391f3585 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:04.995265 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6a932f6d-a4ee-4fef-8bc4-ec7d391f3585 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:04.998310 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6a932f6d-a4ee-4fef-8bc4-ec7d391f3585 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:04.998310 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6a932f6d-a4ee-4fef-8bc4-ec7d391f3585 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:04.998310 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6a932f6d-a4ee-4fef-8bc4-ec7d391f3585 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:05.321056 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fd8018d3-9ac7-47fc-8679-742b574c8c5b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:05.339197 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fd8018d3-9ac7-47fc-8679-742b574c8c5b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.497399 Jun 10 18:12:05.339838 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2050/4212] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:04 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:05.357691 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-26992c6a-cf38-42d2-b9e3-53d20dc2fdac tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:05.363970 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-26992c6a-cf38-42d2-b9e3-53d20dc2fdac tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:05.378779 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-26992c6a-cf38-42d2-b9e3-53d20dc2fdac tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:05.379294 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-26992c6a-cf38-42d2-b9e3-53d20dc2fdac tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:05.380132 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-26992c6a-cf38-42d2-b9e3-53d20dc2fdac tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:05.380606 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-26992c6a-cf38-42d2-b9e3-53d20dc2fdac tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:05.528478 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6a932f6d-a4ee-4fef-8bc4-ec7d391f3585 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:05.537518 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6a932f6d-a4ee-4fef-8bc4-ec7d391f3585 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559" status: 200 len: 1511 microversion: 2.1 time: 0.562649 Jun 10 18:12:05.553640 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2163/4213] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:04 2022] GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 => generated 1511 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:05.565748 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c6bbb6db-e726-4e34-a9e0-f427faed2e53 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:05.567660 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c6bbb6db-e726-4e34-a9e0-f427faed2e53 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 3a5ac7a5-efdb-4191-85ed-237a1d2f7666] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:05.591337 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c6bbb6db-e726-4e34-a9e0-f427faed2e53 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:05.591803 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c6bbb6db-e726-4e34-a9e0-f427faed2e53 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:05.595711 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c6bbb6db-e726-4e34-a9e0-f427faed2e53 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:05.596174 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c6bbb6db-e726-4e34-a9e0-f427faed2e53 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:06.076704 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-26992c6a-cf38-42d2-b9e3-53d20dc2fdac tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:06.089278 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-26992c6a-cf38-42d2-b9e3-53d20dc2fdac tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.736061 Jun 10 18:12:06.089874 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2051/4214] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:05 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:12:06.106064 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1c95eef9-4678-4978-9090-dd83eba0aab8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:06.107017 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1c95eef9-4678-4978-9090-dd83eba0aab8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: b63ef6b2-2c45-486f-8c7e-043358521662] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:06.118190 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-1c95eef9-4678-4978-9090-dd83eba0aab8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] HTTP exception thrown: Instance b63ef6b2-2c45-486f-8c7e-043358521662 could not be found. Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1c95eef9-4678-4978-9090-dd83eba0aab8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers/b63ef6b2-2c45-486f-8c7e-043358521662/action HTTP/1.1 Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 13 Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: {"pause": {}} Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: exception: Instance b63ef6b2-2c45-486f-8c7e-043358521662 could not be found. Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'b63ef6b2-2c45-486f-8c7e-043358521662', 'body': {'pause': {}}} Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b63ef6b2-2c45-486f-8c7e-043358521662 could not be found. Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b63ef6b2-2c45-486f-8c7e-043358521662 could not be found. Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:06.127226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:06.132591 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:12:06.132591 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:12:06.132591 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b63ef6b2-2c45-486f-8c7e-043358521662 could not be found. Jun 10 18:12:06.132591 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:06.133328 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1c95eef9-4678-4978-9090-dd83eba0aab8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 404 to user: Instance b63ef6b2-2c45-486f-8c7e-043358521662 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:12:06.134242 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1c95eef9-4678-4978-9090-dd83eba0aab8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "POST /compute/v2.1/servers/b63ef6b2-2c45-486f-8c7e-043358521662/action" status: 404 len: 111 microversion: 2.1 time: 0.032238 Jun 10 18:12:06.135061 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2052/4215] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:12:06 2022] POST /compute/v2.1/servers/b63ef6b2-2c45-486f-8c7e-043358521662/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:12:06.143242 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0f8f911b-3247-42a2-98c4-5c041673ef25 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:06.149116 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0f8f911b-3247-42a2-98c4-5c041673ef25 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:06.166962 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0f8f911b-3247-42a2-98c4-5c041673ef25 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:06.167838 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0f8f911b-3247-42a2-98c4-5c041673ef25 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:06.168958 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0f8f911b-3247-42a2-98c4-5c041673ef25 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:06.169654 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0f8f911b-3247-42a2-98c4-5c041673ef25 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:06.502398 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c6bbb6db-e726-4e34-a9e0-f427faed2e53 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:06.539567 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c6bbb6db-e726-4e34-a9e0-f427faed2e53 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666" status: 200 len: 1324 microversion: 2.1 time: 0.980493 Jun 10 18:12:06.542805 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2164/4216] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:05 2022] GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666 => generated 1324 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:06.558640 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f129435f-6be6-4d77-b001-6ed07c043772 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:06.559668 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f129435f-6be6-4d77-b001-6ed07c043772 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:06.570282 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f129435f-6be6-4d77-b001-6ed07c043772 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:06.570282 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f129435f-6be6-4d77-b001-6ed07c043772 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:06.570282 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f129435f-6be6-4d77-b001-6ed07c043772 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:06.570282 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f129435f-6be6-4d77-b001-6ed07c043772 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:06.827328 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0f8f911b-3247-42a2-98c4-5c041673ef25 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:06.840037 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0f8f911b-3247-42a2-98c4-5c041673ef25 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.699513 Jun 10 18:12:06.841786 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2053/4217] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:06 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:12:06.862087 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4eed5aa1-23d2-498f-bc85-8bd5e3662bf6 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:06.869934 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4eed5aa1-23d2-498f-bc85-8bd5e3662bf6 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:06.886328 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4eed5aa1-23d2-498f-bc85-8bd5e3662bf6 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:06.887225 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4eed5aa1-23d2-498f-bc85-8bd5e3662bf6 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:06.891582 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4eed5aa1-23d2-498f-bc85-8bd5e3662bf6 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:06.892290 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4eed5aa1-23d2-498f-bc85-8bd5e3662bf6 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:06.943087 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f129435f-6be6-4d77-b001-6ed07c043772 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:06.955444 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f129435f-6be6-4d77-b001-6ed07c043772 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559" status: 200 len: 1488 microversion: 2.1 time: 0.401736 Jun 10 18:12:06.956129 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2165/4218] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:06 2022] GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 => generated 1488 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:06.975348 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ab9f69db-ec97-4c6b-981b-b89950ae2ab9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:06.979772 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ab9f69db-ec97-4c6b-981b-b89950ae2ab9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:06.987740 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ab9f69db-ec97-4c6b-981b-b89950ae2ab9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:06.995847 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ab9f69db-ec97-4c6b-981b-b89950ae2ab9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:06.997649 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ab9f69db-ec97-4c6b-981b-b89950ae2ab9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:06.998394 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ab9f69db-ec97-4c6b-981b-b89950ae2ab9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:07.115917 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ab9f69db-ec97-4c6b-981b-b89950ae2ab9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:12:07.443467 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4eed5aa1-23d2-498f-bc85-8bd5e3662bf6 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:07.453157 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4eed5aa1-23d2-498f-bc85-8bd5e3662bf6 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.599181 Jun 10 18:12:07.464768 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2054/4219] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:06 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:12:07.470486 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4d13fd7e-277c-41a3-a27f-8f743f8de5dc tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:07.471445 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4d13fd7e-277c-41a3-a27f-8f743f8de5dc tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:07.479815 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d13fd7e-277c-41a3-a27f-8f743f8de5dc tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:07.480552 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d13fd7e-277c-41a3-a27f-8f743f8de5dc tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:07.481667 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d13fd7e-277c-41a3-a27f-8f743f8de5dc tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:07.482492 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d13fd7e-277c-41a3-a27f-8f743f8de5dc tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:07.701201 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ab9f69db-ec97-4c6b-981b-b89950ae2ab9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "DELETE /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559" status: 204 len: 0 microversion: 2.1 time: 0.729429 Jun 10 18:12:07.701865 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2166/4220] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:12:06 2022] DELETE /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 => generated 0 bytes in 731 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:12:07.707537 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4d13fd7e-277c-41a3-a27f-8f743f8de5dc tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "POST /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644/action" status: 202 len: 0 microversion: 2.1 time: 0.240837 Jun 10 18:12:07.713055 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2055/4221] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:12:07 2022] POST /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:12:07.720089 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9c2f75b3-2a21-452b-b69a-a50db5d0ff64 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:07.722250 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9c2f75b3-2a21-452b-b69a-a50db5d0ff64 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:07.734815 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9c2f75b3-2a21-452b-b69a-a50db5d0ff64 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:07.734815 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9c2f75b3-2a21-452b-b69a-a50db5d0ff64 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:07.734815 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9c2f75b3-2a21-452b-b69a-a50db5d0ff64 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:07.734815 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9c2f75b3-2a21-452b-b69a-a50db5d0ff64 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:07.735161 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a5b3796f-addf-4201-a1eb-a1bf27b84f01 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:07.738358 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a5b3796f-addf-4201-a1eb-a1bf27b84f01 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 3a5ac7a5-efdb-4191-85ed-237a1d2f7666] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:07.751156 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a5b3796f-addf-4201-a1eb-a1bf27b84f01 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:07.751611 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a5b3796f-addf-4201-a1eb-a1bf27b84f01 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:07.752429 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a5b3796f-addf-4201-a1eb-a1bf27b84f01 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:07.754574 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a5b3796f-addf-4201-a1eb-a1bf27b84f01 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:08.144691 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a5b3796f-addf-4201-a1eb-a1bf27b84f01 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:08.178266 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a5b3796f-addf-4201-a1eb-a1bf27b84f01 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666" status: 200 len: 1324 microversion: 2.1 time: 0.458122 Jun 10 18:12:08.180971 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2167/4222] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:07 2022] GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666 => generated 1324 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:08.198472 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c5921981-9b31-4c80-a2cb-bd5c6d2550ae tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:08.199886 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c5921981-9b31-4c80-a2cb-bd5c6d2550ae tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:08.232551 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5921981-9b31-4c80-a2cb-bd5c6d2550ae tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:08.234289 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5921981-9b31-4c80-a2cb-bd5c6d2550ae tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:08.242166 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5921981-9b31-4c80-a2cb-bd5c6d2550ae tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:08.243080 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5921981-9b31-4c80-a2cb-bd5c6d2550ae tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:08.542860 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:12:08.554047 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c5921981-9b31-4c80-a2cb-bd5c6d2550ae tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:08.566680 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c5921981-9b31-4c80-a2cb-bd5c6d2550ae tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1491 microversion: 2.1 time: 0.384229 Jun 10 18:12:08.568493 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2168/4223] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:08 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1491 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:08.585274 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-251a3074-ea61-42fd-be3b-5b68f32a0954 req-1ae6df04-c06a-4d05-99ba-ceb0a6bb91b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a5ac7a5-efdb-4191-85ed-237a1d2f7666", "tag": "15f0ae4c-fe9e-4811-a8ca-da49e03476bd"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:08.597870 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-251a3074-ea61-42fd-be3b-5b68f32a0954 req-1ae6df04-c06a-4d05-99ba-ceb0a6bb91b8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:08.601235 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-251a3074-ea61-42fd-be3b-5b68f32a0954 req-1ae6df04-c06a-4d05-99ba-ceb0a6bb91b8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:08.665189 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9c2f75b3-2a21-452b-b69a-a50db5d0ff64 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:08.671067 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-251a3074-ea61-42fd-be3b-5b68f32a0954 req-1ae6df04-c06a-4d05-99ba-ceb0a6bb91b8 service nova] Creating event network-changed:15f0ae4c-fe9e-4811-a8ca-da49e03476bd for instance 3a5ac7a5-efdb-4191-85ed-237a1d2f7666 on chh1-master-2 Jun 10 18:12:08.686763 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-251a3074-ea61-42fd-be3b-5b68f32a0954 req-1ae6df04-c06a-4d05-99ba-ceb0a6bb91b8 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112803 Jun 10 18:12:08.688692 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2169/4224] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:12:08.701422 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9c2f75b3-2a21-452b-b69a-a50db5d0ff64 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559" status: 200 len: 1494 microversion: 2.1 time: 0.986810 Jun 10 18:12:08.702441 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2056/4225] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:07 2022] GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 => generated 1494 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:08.711976 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c2c791be-2cbc-4ad6-8a49-882e3cee18c0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:08.711976 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c2c791be-2cbc-4ad6-8a49-882e3cee18c0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:08.722711 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c2c791be-2cbc-4ad6-8a49-882e3cee18c0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:08.724299 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c2c791be-2cbc-4ad6-8a49-882e3cee18c0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:08.728119 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c2c791be-2cbc-4ad6-8a49-882e3cee18c0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:08.728712 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c2c791be-2cbc-4ad6-8a49-882e3cee18c0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-c2c791be-2cbc-4ad6-8a49-882e3cee18c0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] HTTP exception thrown: Cannot 'pause' instance 57a377b2-f75e-4a0c-8401-090db42db644 while it is in vm_state paused Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c2c791be-2cbc-4ad6-8a49-882e3cee18c0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644/action HTTP/1.1 Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 13 Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: {"pause": {}} Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: exception: Cannot 'pause' instance 57a377b2-f75e-4a0c-8401-090db42db644 while it is in vm_state paused Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '57a377b2-f75e-4a0c-8401-090db42db644', 'body': {'pause': {}}} Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 57a377b2-f75e-4a0c-8401-090db42db644 in vm_state paused. Cannot pause while the instance is in this state. Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 57a377b2-f75e-4a0c-8401-090db42db644 while it is in vm_state paused Jun 10 18:12:08.783411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:08.789028 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:08.789028 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:08.789028 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:08.789028 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:08.789028 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:08.789028 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:12:08.789028 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:12:08.789028 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 57a377b2-f75e-4a0c-8401-090db42db644 while it is in vm_state paused Jun 10 18:12:08.789028 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:08.789028 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c2c791be-2cbc-4ad6-8a49-882e3cee18c0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 409 to user: Cannot 'pause' instance 57a377b2-f75e-4a0c-8401-090db42db644 while it is in vm_state paused {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:12:08.811376 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c2c791be-2cbc-4ad6-8a49-882e3cee18c0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "POST /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644/action" status: 409 len: 143 microversion: 2.1 time: 0.087385 Jun 10 18:12:08.811376 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2170/4226] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:12:08 2022] POST /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644/action => generated 143 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:12:08.811876 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ca355275-6d23-4e8a-a711-86a554116d63 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:08.811876 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ca355275-6d23-4e8a-a711-86a554116d63 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:08.824003 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ca355275-6d23-4e8a-a711-86a554116d63 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:08.824656 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ca355275-6d23-4e8a-a711-86a554116d63 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:08.825546 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ca355275-6d23-4e8a-a711-86a554116d63 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:08.826085 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ca355275-6d23-4e8a-a711-86a554116d63 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:09.132824 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ca355275-6d23-4e8a-a711-86a554116d63 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "POST /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644/action" status: 202 len: 0 microversion: 2.1 time: 0.325655 Jun 10 18:12:09.142569 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-065fabc5-5dba-4d0c-973f-ac2604804fc4 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:09.143304 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-065fabc5-5dba-4d0c-973f-ac2604804fc4 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:09.145061 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2057/4227] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:12:08 2022] POST /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644/action => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:12:09.153905 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-065fabc5-5dba-4d0c-973f-ac2604804fc4 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:09.153905 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-065fabc5-5dba-4d0c-973f-ac2604804fc4 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:09.153905 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-065fabc5-5dba-4d0c-973f-ac2604804fc4 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:09.153905 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-065fabc5-5dba-4d0c-973f-ac2604804fc4 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:09.197177 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-10905961-b902-4247-897f-8f0190e63a73 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:09.198901 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-10905961-b902-4247-897f-8f0190e63a73 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 3a5ac7a5-efdb-4191-85ed-237a1d2f7666] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:09.208901 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10905961-b902-4247-897f-8f0190e63a73 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:09.209616 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10905961-b902-4247-897f-8f0190e63a73 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:09.211051 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10905961-b902-4247-897f-8f0190e63a73 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:09.211597 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10905961-b902-4247-897f-8f0190e63a73 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:09.473768 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=14 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:12:09.474660 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:12:09.567423 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-065fabc5-5dba-4d0c-973f-ac2604804fc4 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:09.572618 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:12:09.581819 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-065fabc5-5dba-4d0c-973f-ac2604804fc4 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1498 microversion: 2.1 time: 0.443791 Jun 10 18:12:09.586346 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2171/4228] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:09 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1498 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:12:09.721967 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ff0a94d2-a17f-42ac-aecd-9e851ec71b4e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:09.723389 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ff0a94d2-a17f-42ac-aecd-9e851ec71b4e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:09.729239 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:12:09.745315 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ff0a94d2-a17f-42ac-aecd-9e851ec71b4e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:09.748827 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ff0a94d2-a17f-42ac-aecd-9e851ec71b4e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:09.753354 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ff0a94d2-a17f-42ac-aecd-9e851ec71b4e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:09.753354 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ff0a94d2-a17f-42ac-aecd-9e851ec71b4e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:09.767347 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-10905961-b902-4247-897f-8f0190e63a73 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:09.779333 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-10905961-b902-4247-897f-8f0190e63a73 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666" status: 200 len: 1324 microversion: 2.1 time: 0.586352 Jun 10 18:12:09.793668 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2058/4229] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:09 2022] GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666 => generated 1324 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:12:10.031614 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ff0a94d2-a17f-42ac-aecd-9e851ec71b4e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:10.043778 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ff0a94d2-a17f-42ac-aecd-9e851ec71b4e tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559" status: 200 len: 1494 microversion: 2.1 time: 0.326791 Jun 10 18:12:10.044411 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2172/4230] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:09 2022] GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 => generated 1494 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:10.608984 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1e466193-dfe7-40f8-9927-b0e69cf913df tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:10.609980 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1e466193-dfe7-40f8-9927-b0e69cf913df tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:10.626838 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1e466193-dfe7-40f8-9927-b0e69cf913df tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:10.627369 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1e466193-dfe7-40f8-9927-b0e69cf913df tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:10.629513 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1e466193-dfe7-40f8-9927-b0e69cf913df tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:10.629976 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1e466193-dfe7-40f8-9927-b0e69cf913df tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:10.802100 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4792cc8a-90cd-4bb5-a5b3-889b41f21218 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:10.807068 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4792cc8a-90cd-4bb5-a5b3-889b41f21218 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 3a5ac7a5-efdb-4191-85ed-237a1d2f7666] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:10.833123 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4792cc8a-90cd-4bb5-a5b3-889b41f21218 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:10.838397 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4792cc8a-90cd-4bb5-a5b3-889b41f21218 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:10.839736 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4792cc8a-90cd-4bb5-a5b3-889b41f21218 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:10.841483 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4792cc8a-90cd-4bb5-a5b3-889b41f21218 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:11.122882 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4792cc8a-90cd-4bb5-a5b3-889b41f21218 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:11.149921 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4792cc8a-90cd-4bb5-a5b3-889b41f21218 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666" status: 200 len: 1324 microversion: 2.1 time: 0.353421 Jun 10 18:12:11.150891 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2173/4231] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:10 2022] GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666 => generated 1324 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:12:11.176067 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e333635b-3ae4-4348-9722-c351bbb9e2e0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:11.176756 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e333635b-3ae4-4348-9722-c351bbb9e2e0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:11.194786 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e333635b-3ae4-4348-9722-c351bbb9e2e0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:11.200658 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e333635b-3ae4-4348-9722-c351bbb9e2e0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:11.200658 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e333635b-3ae4-4348-9722-c351bbb9e2e0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:11.200658 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e333635b-3ae4-4348-9722-c351bbb9e2e0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:11.432880 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1e466193-dfe7-40f8-9927-b0e69cf913df tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:11.445470 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1e466193-dfe7-40f8-9927-b0e69cf913df tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.844659 Jun 10 18:12:11.447334 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2059/4232] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:10 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:11.457512 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-48c78ffd-2ac8-4c30-bb2e-7acf335fbff7 req-8cceaf6d-b7a4-45db-a8bb-ab0ab942164f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f0a3407-710b-426e-8909-3395a119f559", "name": "network-vif-deleted", "tag": "0c597e2d-7c45-426d-937e-7f012531a187"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:11.468551 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e333635b-3ae4-4348-9722-c351bbb9e2e0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:11.476591 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-48c78ffd-2ac8-4c30-bb2e-7acf335fbff7 req-8cceaf6d-b7a4-45db-a8bb-ab0ab942164f service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:11.483958 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-48c78ffd-2ac8-4c30-bb2e-7acf335fbff7 req-8cceaf6d-b7a4-45db-a8bb-ab0ab942164f service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:11.484190 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e333635b-3ae4-4348-9722-c351bbb9e2e0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559" status: 200 len: 1452 microversion: 2.1 time: 0.326530 Jun 10 18:12:11.484816 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2174/4233] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:11 2022] GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 => generated 1452 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:11.495942 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e6ee47f0-8a54-4894-a1ce-9e967b7b5417 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:11.504540 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e6ee47f0-8a54-4894-a1ce-9e967b7b5417 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:11.512941 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-48c78ffd-2ac8-4c30-bb2e-7acf335fbff7 req-8cceaf6d-b7a4-45db-a8bb-ab0ab942164f service nova] Creating event network-vif-deleted:0c597e2d-7c45-426d-937e-7f012531a187 for instance 4f0a3407-710b-426e-8909-3395a119f559 on chh2-master-2 Jun 10 18:12:11.514505 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e6ee47f0-8a54-4894-a1ce-9e967b7b5417 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:11.515925 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e6ee47f0-8a54-4894-a1ce-9e967b7b5417 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:11.520866 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e6ee47f0-8a54-4894-a1ce-9e967b7b5417 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:11.521525 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e6ee47f0-8a54-4894-a1ce-9e967b7b5417 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:11.526321 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-48c78ffd-2ac8-4c30-bb2e-7acf335fbff7 req-8cceaf6d-b7a4-45db-a8bb-ab0ab942164f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078990 Jun 10 18:12:11.526944 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2060/4234] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:12:11.911243 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e6ee47f0-8a54-4894-a1ce-9e967b7b5417 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:11.927005 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e6ee47f0-8a54-4894-a1ce-9e967b7b5417 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.441056 Jun 10 18:12:11.936038 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2175/4235] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:11 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:11.958766 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-896aea53-2a3d-453c-99ab-da0935739e18 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:11.961071 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-896aea53-2a3d-453c-99ab-da0935739e18 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 74e411c5-d389-4307-99fd-a6cf439f1c61] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:11.991316 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-896aea53-2a3d-453c-99ab-da0935739e18 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:11.991867 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-896aea53-2a3d-453c-99ab-da0935739e18 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:11.992713 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-896aea53-2a3d-453c-99ab-da0935739e18 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:11.993154 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-896aea53-2a3d-453c-99ab-da0935739e18 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:12.044187 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-896aea53-2a3d-453c-99ab-da0935739e18 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] HTTP exception thrown: Instance 74e411c5-d389-4307-99fd-a6cf439f1c61 could not be found. Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-896aea53-2a3d-453c-99ab-da0935739e18 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61/action HTTP/1.1 Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 28 Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: {"reboot": {"type": "SOFT"}} Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 74e411c5-d389-4307-99fd-a6cf439f1c61 could not be found. Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '74e411c5-d389-4307-99fd-a6cf439f1c61', 'body': {'reboot': {'type': 'SOFT'}}} Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74e411c5-d389-4307-99fd-a6cf439f1c61 could not be found. Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:12:12.064528 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:12:12.069882 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74e411c5-d389-4307-99fd-a6cf439f1c61 could not be found. Jun 10 18:12:12.069882 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:12.069882 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:12.069882 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:12.069882 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:12.069882 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:12.069882 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:12.069882 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:12:12.069882 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:12:12.069882 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74e411c5-d389-4307-99fd-a6cf439f1c61 could not be found. Jun 10 18:12:12.069882 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:12.069882 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-896aea53-2a3d-453c-99ab-da0935739e18 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 404 to user: Instance 74e411c5-d389-4307-99fd-a6cf439f1c61 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:12:12.069882 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-896aea53-2a3d-453c-99ab-da0935739e18 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "POST /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61/action" status: 404 len: 111 microversion: 2.1 time: 0.116054 Jun 10 18:12:12.081475 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2e7f6c40-9f85-44c6-9516-e5d6c4466450 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:12.081475 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2e7f6c40-9f85-44c6-9516-e5d6c4466450 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:12.081700 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2061/4236] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:12:11 2022] POST /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61/action => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:12:12.093896 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2e7f6c40-9f85-44c6-9516-e5d6c4466450 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:12.110153 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2e7f6c40-9f85-44c6-9516-e5d6c4466450 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:12.110153 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2e7f6c40-9f85-44c6-9516-e5d6c4466450 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:12.110153 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2e7f6c40-9f85-44c6-9516-e5d6c4466450 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:12.167522 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-299d9871-f83a-4e25-9838-8cfd8b7a8029 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:12.168815 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-299d9871-f83a-4e25-9838-8cfd8b7a8029 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 3a5ac7a5-efdb-4191-85ed-237a1d2f7666] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:12.176401 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-299d9871-f83a-4e25-9838-8cfd8b7a8029 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:12.176871 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-299d9871-f83a-4e25-9838-8cfd8b7a8029 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:12.177658 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-299d9871-f83a-4e25-9838-8cfd8b7a8029 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:12.189957 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-299d9871-f83a-4e25-9838-8cfd8b7a8029 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:12.715397 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2e7f6c40-9f85-44c6-9516-e5d6c4466450 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:12.729024 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2e7f6c40-9f85-44c6-9516-e5d6c4466450 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.656571 Jun 10 18:12:12.730287 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2176/4237] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:12 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:12.737150 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d2d5a55e-1a46-407c-ab62-052f508c99c1 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:12.738071 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d2d5a55e-1a46-407c-ab62-052f508c99c1 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:12.752128 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d2d5a55e-1a46-407c-ab62-052f508c99c1 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:12.752963 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d2d5a55e-1a46-407c-ab62-052f508c99c1 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:12.754319 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d2d5a55e-1a46-407c-ab62-052f508c99c1 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:12.755264 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d2d5a55e-1a46-407c-ab62-052f508c99c1 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:12.777977 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-d2d5a55e-1a46-407c-ab62-052f508c99c1 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] HTTP exception thrown: Instance 4f0a3407-710b-426e-8909-3395a119f559 could not be found. Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d2d5a55e-1a46-407c-ab62-052f508c99c1 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Request method failure captured: Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 HTTP/1.1 Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4h5IGwn2s1svunn67FxK1RLA1ZXNP7yhKtLh1eaKFO5RiF1I7YeJHWcfSjdUGMBWYC3nFgfMdv1-bfem3ewEozYf-uHKxgVE7ziplyuJN8iPaP89LX8AXS1cyKZcnxByDcQMqTPs4bimJxM1lNaVEmx4VPDZsfMeZBdbBH4r5hYsr8 Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/457c4a300936498b9e8b61645e655751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "tempest-type-1142384015", "name": "tempest-service-1838487701", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_457c4a300936498b9e8b61645e655751", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 8166793f60ee479689b4a21457b71d07 Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 4f0a3407-710b-426e-8909-3395a119f559 could not be found. Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '4f0a3407-710b-426e-8909-3395a119f559'} Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f0a3407-710b-426e-8909-3395a119f559 could not be found. Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f0a3407-710b-426e-8909-3395a119f559 could not be found. Jun 10 18:12:12.780025 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:12.801769 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:12.801769 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:12.801769 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:12.801769 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:12.801769 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:12.801769 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:12:12.801769 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:12:12.801769 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f0a3407-710b-426e-8909-3395a119f559 could not be found. Jun 10 18:12:12.801769 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:12.801769 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d2d5a55e-1a46-407c-ab62-052f508c99c1 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Returning 404 to user: Instance 4f0a3407-710b-426e-8909-3395a119f559 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:12:12.801769 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d2d5a55e-1a46-407c-ab62-052f508c99c1 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559" status: 404 len: 111 microversion: 2.1 time: 0.053890 Jun 10 18:12:12.801769 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2177/4238] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:12 2022] GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:12:12.801769 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3fa3125c-85a5-44f4-ac51-7b160c4925cf tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:12.801769 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3fa3125c-85a5-44f4-ac51-7b160c4925cf tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:12.822280 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3fa3125c-85a5-44f4-ac51-7b160c4925cf tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:12.822740 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3fa3125c-85a5-44f4-ac51-7b160c4925cf tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:12.830526 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3fa3125c-85a5-44f4-ac51-7b160c4925cf tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:12.831008 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3fa3125c-85a5-44f4-ac51-7b160c4925cf tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:13.042485 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-299d9871-f83a-4e25-9838-8cfd8b7a8029 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:13.055880 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-299d9871-f83a-4e25-9838-8cfd8b7a8029 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666" status: 200 len: 1324 microversion: 2.1 time: 0.890506 Jun 10 18:12:13.058392 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2062/4239] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:12 2022] GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666 => generated 1324 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:13.075423 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-98eb0a6c-0e6e-40ed-9ac0-05bfe4b906fe tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1033265609", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "01d41899-bf8f-45ad-9aa1-db371d9cd1c4"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:13.115382 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3fa3125c-85a5-44f4-ac51-7b160c4925cf tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:13.125974 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3fa3125c-85a5-44f4-ac51-7b160c4925cf tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.335092 Jun 10 18:12:13.127455 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2178/4240] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:12 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:13.144865 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a4bece9b-cb8e-4938-bc1e-7732ba1dfb33 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:13.145937 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a4bece9b-cb8e-4938-bc1e-7732ba1dfb33 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: bd7b5d57-63f3-46f8-8950-462bff756d90] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:13.157876 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-a4bece9b-cb8e-4938-bc1e-7732ba1dfb33 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] HTTP exception thrown: Instance bd7b5d57-63f3-46f8-8950-462bff756d90 could not be found. Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a4bece9b-cb8e-4938-bc1e-7732ba1dfb33 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/servers/bd7b5d57-63f3-46f8-8950-462bff756d90/action HTTP/1.1 Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 28 Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: {"reboot": {"type": "SOFT"}} Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: exception: Instance bd7b5d57-63f3-46f8-8950-462bff756d90 could not be found. Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'bd7b5d57-63f3-46f8-8950-462bff756d90', 'body': {'reboot': {'type': 'SOFT'}}} Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd7b5d57-63f3-46f8-8950-462bff756d90 could not be found. Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd7b5d57-63f3-46f8-8950-462bff756d90 could not be found. Jun 10 18:12:13.161112 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:13.165128 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:13.165128 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:13.165128 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:13.165128 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:13.165128 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:13.165128 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:12:13.165128 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:12:13.165128 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd7b5d57-63f3-46f8-8950-462bff756d90 could not be found. Jun 10 18:12:13.165128 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:13.165128 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a4bece9b-cb8e-4938-bc1e-7732ba1dfb33 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 404 to user: Instance bd7b5d57-63f3-46f8-8950-462bff756d90 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:12:13.165128 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a4bece9b-cb8e-4938-bc1e-7732ba1dfb33 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "POST /compute/v2.1/servers/bd7b5d57-63f3-46f8-8950-462bff756d90/action" status: 404 len: 111 microversion: 2.1 time: 0.023551 Jun 10 18:12:13.171406 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2179/4241] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:12:13 2022] POST /compute/v2.1/servers/bd7b5d57-63f3-46f8-8950-462bff756d90/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:12:13.183638 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-155697c0-86d5-405d-be0b-772e8927f84a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:13.186586 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-155697c0-86d5-405d-be0b-772e8927f84a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:13.188384 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-98eb0a6c-0e6e-40ed-9ac0-05bfe4b906fe tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] validate_networks() for [('01d41899-bf8f-45ad-9aa1-db371d9cd1c4', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:12:13.203114 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-155697c0-86d5-405d-be0b-772e8927f84a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:13.203584 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-155697c0-86d5-405d-be0b-772e8927f84a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:13.205024 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-155697c0-86d5-405d-be0b-772e8927f84a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:13.206636 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-155697c0-86d5-405d-be0b-772e8927f84a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:13.410972 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-155697c0-86d5-405d-be0b-772e8927f84a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:13.422386 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-155697c0-86d5-405d-be0b-772e8927f84a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.247181 Jun 10 18:12:13.436539 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2180/4242] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:13 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:13.442425 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-39ff62c4-459f-42c9-bea1-bfb0f89a02fb tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:13.443558 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-39ff62c4-459f-42c9-bea1-bfb0f89a02fb tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:13.470541 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-39ff62c4-459f-42c9-bea1-bfb0f89a02fb tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:13.471453 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-39ff62c4-459f-42c9-bea1-bfb0f89a02fb tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:13.472791 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-39ff62c4-459f-42c9-bea1-bfb0f89a02fb tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:13.473644 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-39ff62c4-459f-42c9-bea1-bfb0f89a02fb tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:13.751061 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-39ff62c4-459f-42c9-bea1-bfb0f89a02fb tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:13.763595 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-39ff62c4-459f-42c9-bea1-bfb0f89a02fb tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.325794 Jun 10 18:12:13.768772 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2181/4243] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:13 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:12:13.782218 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a777ac52-ef9d-4ec6-8a7c-fde77cd7d902 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:13.785392 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a777ac52-ef9d-4ec6-8a7c-fde77cd7d902 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 74e411c5-d389-4307-99fd-a6cf439f1c61] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:13.793651 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a777ac52-ef9d-4ec6-8a7c-fde77cd7d902 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:13.794369 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a777ac52-ef9d-4ec6-8a7c-fde77cd7d902 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:13.795334 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a777ac52-ef9d-4ec6-8a7c-fde77cd7d902 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:13.795999 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a777ac52-ef9d-4ec6-8a7c-fde77cd7d902 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:13.813274 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-a777ac52-ef9d-4ec6-8a7c-fde77cd7d902 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] HTTP exception thrown: Instance 74e411c5-d389-4307-99fd-a6cf439f1c61 could not be found. Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a777ac52-ef9d-4ec6-8a7c-fde77cd7d902 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61/action HTTP/1.1 Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 65 Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: {"rebuild": {"imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8"}} Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 74e411c5-d389-4307-99fd-a6cf439f1c61 could not be found. Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '74e411c5-d389-4307-99fd-a6cf439f1c61', 'body': {'rebuild': {'imageRef': 'efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8'}}} Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74e411c5-d389-4307-99fd-a6cf439f1c61 could not be found. Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jun 10 18:12:13.815446 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jun 10 18:12:13.819905 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 10 18:12:13.819905 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:12:13.819905 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:12:13.819905 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:12:13.819905 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:12:13.819905 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74e411c5-d389-4307-99fd-a6cf439f1c61 could not be found. Jun 10 18:12:13.819905 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:13.819905 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:13.819905 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:13.819905 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:13.819905 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:13.819905 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:13.819905 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:12:13.819905 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:12:13.819905 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74e411c5-d389-4307-99fd-a6cf439f1c61 could not be found. Jun 10 18:12:13.819905 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:13.823287 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a777ac52-ef9d-4ec6-8a7c-fde77cd7d902 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 404 to user: Instance 74e411c5-d389-4307-99fd-a6cf439f1c61 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:12:13.824602 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a777ac52-ef9d-4ec6-8a7c-fde77cd7d902 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "POST /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61/action" status: 404 len: 111 microversion: 2.1 time: 0.046817 Jun 10 18:12:13.828752 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2182/4244] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:12:13 2022] POST /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61/action => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:12:13.834398 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7f52cc08-0d38-4ff7-b3ae-8f8d04975098 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:13.835182 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7f52cc08-0d38-4ff7-b3ae-8f8d04975098 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:13.844336 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7f52cc08-0d38-4ff7-b3ae-8f8d04975098 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:13.844844 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7f52cc08-0d38-4ff7-b3ae-8f8d04975098 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:13.848736 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7f52cc08-0d38-4ff7-b3ae-8f8d04975098 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:13.848736 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7f52cc08-0d38-4ff7-b3ae-8f8d04975098 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:14.048932 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7f52cc08-0d38-4ff7-b3ae-8f8d04975098 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:14.065637 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7f52cc08-0d38-4ff7-b3ae-8f8d04975098 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.229518 Jun 10 18:12:14.067734 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2183/4245] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:13 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:14.072779 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4c6ee76f-8fd3-4ebb-a3ff-c22366fc9731 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:14.073404 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4c6ee76f-8fd3-4ebb-a3ff-c22366fc9731 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 3a5ac7a5-efdb-4191-85ed-237a1d2f7666] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:14.089233 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4c6ee76f-8fd3-4ebb-a3ff-c22366fc9731 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:14.089700 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4c6ee76f-8fd3-4ebb-a3ff-c22366fc9731 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:14.097571 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4c6ee76f-8fd3-4ebb-a3ff-c22366fc9731 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:14.098513 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4c6ee76f-8fd3-4ebb-a3ff-c22366fc9731 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:14.342558 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4c6ee76f-8fd3-4ebb-a3ff-c22366fc9731 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:14.351895 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4c6ee76f-8fd3-4ebb-a3ff-c22366fc9731 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666" status: 200 len: 1324 microversion: 2.1 time: 0.282963 Jun 10 18:12:14.353901 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2184/4246] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:14 2022] GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666 => generated 1324 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:12:14.359814 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f66fec5c-2c58-49f5-802e-ef7afb1d2f35 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:14.360848 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f66fec5c-2c58-49f5-802e-ef7afb1d2f35 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:14.395668 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f66fec5c-2c58-49f5-802e-ef7afb1d2f35 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:14.396421 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f66fec5c-2c58-49f5-802e-ef7afb1d2f35 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:14.398258 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f66fec5c-2c58-49f5-802e-ef7afb1d2f35 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:14.399999 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f66fec5c-2c58-49f5-802e-ef7afb1d2f35 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:14.624738 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f66fec5c-2c58-49f5-802e-ef7afb1d2f35 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:14.636471 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f66fec5c-2c58-49f5-802e-ef7afb1d2f35 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.281129 Jun 10 18:12:14.640346 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2185/4247] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:14 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:14.653772 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ea728604-c523-422d-92b7-aa5aa9bfa50b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:14.655159 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ea728604-c523-422d-92b7-aa5aa9bfa50b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: a008f6ff-6fbc-4690-9ff6-027c110ad185] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:14.662836 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-ea728604-c523-422d-92b7-aa5aa9bfa50b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] HTTP exception thrown: Instance a008f6ff-6fbc-4690-9ff6-027c110ad185 could not be found. Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ea728604-c523-422d-92b7-aa5aa9bfa50b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/servers/a008f6ff-6fbc-4690-9ff6-027c110ad185/action HTTP/1.1 Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 65 Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: {"rebuild": {"imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8"}} Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: exception: Instance a008f6ff-6fbc-4690-9ff6-027c110ad185 could not be found. Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'a008f6ff-6fbc-4690-9ff6-027c110ad185', 'body': {'rebuild': {'imageRef': 'efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8'}}} Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a008f6ff-6fbc-4690-9ff6-027c110ad185 could not be found. Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 10 18:12:14.664649 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:12:14.669804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:12:14.669804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:12:14.669804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:12:14.669804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a008f6ff-6fbc-4690-9ff6-027c110ad185 could not be found. Jun 10 18:12:14.669804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:14.669804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:14.669804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:14.669804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:14.669804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:14.669804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:14.669804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:12:14.669804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:12:14.669804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a008f6ff-6fbc-4690-9ff6-027c110ad185 could not be found. Jun 10 18:12:14.669804 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:14.669804 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ea728604-c523-422d-92b7-aa5aa9bfa50b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 404 to user: Instance a008f6ff-6fbc-4690-9ff6-027c110ad185 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:12:14.669804 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ea728604-c523-422d-92b7-aa5aa9bfa50b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "POST /compute/v2.1/servers/a008f6ff-6fbc-4690-9ff6-027c110ad185/action" status: 404 len: 111 microversion: 2.1 time: 0.016662 Jun 10 18:12:14.671544 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2186/4248] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:12:14 2022] POST /compute/v2.1/servers/a008f6ff-6fbc-4690-9ff6-027c110ad185/action => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:12:14.676439 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-82deed84-1a6e-4e65-a595-a38012aaeb91 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:14.677061 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-82deed84-1a6e-4e65-a595-a38012aaeb91 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:14.684972 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-82deed84-1a6e-4e65-a595-a38012aaeb91 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:14.685659 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-82deed84-1a6e-4e65-a595-a38012aaeb91 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:14.686749 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-82deed84-1a6e-4e65-a595-a38012aaeb91 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:14.687423 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-82deed84-1a6e-4e65-a595-a38012aaeb91 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:15.001193 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-82deed84-1a6e-4e65-a595-a38012aaeb91 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:15.011255 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-82deed84-1a6e-4e65-a595-a38012aaeb91 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.338618 Jun 10 18:12:15.013106 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2187/4249] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:14 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:15.029959 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a42f5920-2d1e-448c-9ae5-87f581e2200e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:15.031117 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a42f5920-2d1e-448c-9ae5-87f581e2200e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:15.037388 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a42f5920-2d1e-448c-9ae5-87f581e2200e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:15.037973 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a42f5920-2d1e-448c-9ae5-87f581e2200e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:15.042847 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a42f5920-2d1e-448c-9ae5-87f581e2200e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:15.043549 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a42f5920-2d1e-448c-9ae5-87f581e2200e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:15.391768 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-98eb0a6c-0e6e-40ed-9ac0-05bfe4b906fe tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:12:15.392492 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-98eb0a6c-0e6e-40ed-9ac0-05bfe4b906fe tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:12:15.392714 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-98eb0a6c-0e6e-40ed-9ac0-05bfe4b906fe tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:12:15.393700 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-98eb0a6c-0e6e-40ed-9ac0-05bfe4b906fe tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:12:15.394333 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-98eb0a6c-0e6e-40ed-9ac0-05bfe4b906fe tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:12:15.414671 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-98eb0a6c-0e6e-40ed-9ac0-05bfe4b906fe tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:15.415390 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-98eb0a6c-0e6e-40ed-9ac0-05bfe4b906fe tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:15.416551 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-98eb0a6c-0e6e-40ed-9ac0-05bfe4b906fe tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:15.417201 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-98eb0a6c-0e6e-40ed-9ac0-05bfe4b906fe tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:15.449726 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-98eb0a6c-0e6e-40ed-9ac0-05bfe4b906fe tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Getting quotas for project 457c4a300936498b9e8b61645e655751. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:12:15.458343 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-98eb0a6c-0e6e-40ed-9ac0-05bfe4b906fe tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Getting quotas for user 8166793f60ee479689b4a21457b71d07 and project 457c4a300936498b9e8b61645e655751. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:12:15.489809 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a42f5920-2d1e-448c-9ae5-87f581e2200e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:15.494341 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-98eb0a6c-0e6e-40ed-9ac0-05bfe4b906fe tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:12:15.505437 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-98eb0a6c-0e6e-40ed-9ac0-05bfe4b906fe tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: aff760b6-7b66-40e8-b266-dcfa79ca41b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:12:15.506044 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a42f5920-2d1e-448c-9ae5-87f581e2200e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.479596 Jun 10 18:12:15.519812 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2188/4250] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:15 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:12:15.530318 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c6b760b1-7a95-4651-942f-cdc025352f37 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:15.532741 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c6b760b1-7a95-4651-942f-cdc025352f37 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 3a5ac7a5-efdb-4191-85ed-237a1d2f7666] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:15.556331 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c6b760b1-7a95-4651-942f-cdc025352f37 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:15.562355 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c6b760b1-7a95-4651-942f-cdc025352f37 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:15.565181 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c6b760b1-7a95-4651-942f-cdc025352f37 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:15.569578 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c6b760b1-7a95-4651-942f-cdc025352f37 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:15.722995 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-98eb0a6c-0e6e-40ed-9ac0-05bfe4b906fe tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.654202 Jun 10 18:12:15.729528 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2063/4251] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:12:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 10 18:12:15.740225 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a9f14d3b-6c6e-44e2-8ab3-1043e904375b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:15.741129 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a9f14d3b-6c6e-44e2-8ab3-1043e904375b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 5f854424-5db9-4be2-8914-9b3f64f03672] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:15.748999 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-a9f14d3b-6c6e-44e2-8ab3-1043e904375b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] HTTP exception thrown: Instance 5f854424-5db9-4be2-8914-9b3f64f03672 could not be found. Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a9f14d3b-6c6e-44e2-8ab3-1043e904375b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers/5f854424-5db9-4be2-8914-9b3f64f03672/action HTTP/1.1 Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 15 Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: {"restore": {}} Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 5f854424-5db9-4be2-8914-9b3f64f03672 could not be found. Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '5f854424-5db9-4be2-8914-9b3f64f03672', 'body': {'restore': {}}} Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f854424-5db9-4be2-8914-9b3f64f03672 could not be found. Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f854424-5db9-4be2-8914-9b3f64f03672 could not be found. Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:15.751352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:15.763078 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:12:15.763078 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:12:15.763078 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f854424-5db9-4be2-8914-9b3f64f03672 could not be found. Jun 10 18:12:15.763078 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:15.763078 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a9f14d3b-6c6e-44e2-8ab3-1043e904375b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 404 to user: Instance 5f854424-5db9-4be2-8914-9b3f64f03672 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:12:15.763078 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a9f14d3b-6c6e-44e2-8ab3-1043e904375b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "POST /compute/v2.1/servers/5f854424-5db9-4be2-8914-9b3f64f03672/action" status: 404 len: 111 microversion: 2.1 time: 0.026482 Jun 10 18:12:15.763078 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2064/4252] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:12:15 2022] POST /compute/v2.1/servers/5f854424-5db9-4be2-8914-9b3f64f03672/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:12:15.773974 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7c212b15-a2fb-4a3f-8b48-e30103479def tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:15.778294 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7c212b15-a2fb-4a3f-8b48-e30103479def tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: aff760b6-7b66-40e8-b266-dcfa79ca41b5] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:16.020946 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c6b760b1-7a95-4651-942f-cdc025352f37 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:16.035909 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c6b760b1-7a95-4651-942f-cdc025352f37 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666" status: 200 len: 1324 microversion: 2.1 time: 0.514371 Jun 10 18:12:16.036792 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2189/4253] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:15 2022] GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666 => generated 1324 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:16.064787 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-21ab449f-aece-493b-9c95-c6247d810957 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:16.065426 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-21ab449f-aece-493b-9c95-c6247d810957 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:16.086458 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-21ab449f-aece-493b-9c95-c6247d810957 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:16.087762 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-21ab449f-aece-493b-9c95-c6247d810957 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:16.088961 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-21ab449f-aece-493b-9c95-c6247d810957 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:16.089675 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-21ab449f-aece-493b-9c95-c6247d810957 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:16.104928 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7c212b15-a2fb-4a3f-8b48-e30103479def tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:16.117109 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7c212b15-a2fb-4a3f-8b48-e30103479def tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5" status: 200 len: 1215 microversion: 2.1 time: 0.346862 Jun 10 18:12:16.122456 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2065/4254] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:15 2022] GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5 => generated 1215 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:16.332872 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-21ab449f-aece-493b-9c95-c6247d810957 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:16.343959 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-21ab449f-aece-493b-9c95-c6247d810957 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.289073 Jun 10 18:12:16.344581 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2190/4255] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:16 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:16.365496 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2717723b-f7c3-4d97-b719-d924d4273339 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:16.366502 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2717723b-f7c3-4d97-b719-d924d4273339 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:16.376130 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2717723b-f7c3-4d97-b719-d924d4273339 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:16.379614 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2717723b-f7c3-4d97-b719-d924d4273339 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:16.389970 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2717723b-f7c3-4d97-b719-d924d4273339 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:16.390986 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2717723b-f7c3-4d97-b719-d924d4273339 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:17.049604 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2717723b-f7c3-4d97-b719-d924d4273339 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:17.059328 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3d19ffec-d529-4c9b-ac31-d27136821cc9 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:17.060233 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3d19ffec-d529-4c9b-ac31-d27136821cc9 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 3a5ac7a5-efdb-4191-85ed-237a1d2f7666] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:17.062260 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2717723b-f7c3-4d97-b719-d924d4273339 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.701044 Jun 10 18:12:17.064027 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2066/4256] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:16 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:17.078025 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3d19ffec-d529-4c9b-ac31-d27136821cc9 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:17.078737 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3d19ffec-d529-4c9b-ac31-d27136821cc9 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:17.081703 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3d19ffec-d529-4c9b-ac31-d27136821cc9 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:17.082356 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3d19ffec-d529-4c9b-ac31-d27136821cc9 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:17.089467 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e1822122-c2db-4e40-bc94-bbe180ffe12c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:17.091968 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e1822122-c2db-4e40-bc94-bbe180ffe12c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:17.106142 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e1822122-c2db-4e40-bc94-bbe180ffe12c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:17.108797 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e1822122-c2db-4e40-bc94-bbe180ffe12c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:17.109958 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e1822122-c2db-4e40-bc94-bbe180ffe12c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:17.111665 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e1822122-c2db-4e40-bc94-bbe180ffe12c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:17.176220 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-e1822122-c2db-4e40-bc94-bbe180ffe12c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] HTTP exception thrown: Cannot 'restore' instance 57a377b2-f75e-4a0c-8401-090db42db644 while it is in vm_state active Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e1822122-c2db-4e40-bc94-bbe180ffe12c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644/action HTTP/1.1 Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 15 Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: {"restore": {}} Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: exception: Cannot 'restore' instance 57a377b2-f75e-4a0c-8401-090db42db644 while it is in vm_state active Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '57a377b2-f75e-4a0c-8401-090db42db644', 'body': {'restore': {}}} Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 57a377b2-f75e-4a0c-8401-090db42db644 in vm_state active. Cannot restore while the instance is in this state. Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 57a377b2-f75e-4a0c-8401-090db42db644 while it is in vm_state active Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:17.182692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:17.190580 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:17.190580 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:12:17.190580 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:12:17.190580 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 57a377b2-f75e-4a0c-8401-090db42db644 while it is in vm_state active Jun 10 18:12:17.190580 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:17.192697 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e1822122-c2db-4e40-bc94-bbe180ffe12c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 409 to user: Cannot 'restore' instance 57a377b2-f75e-4a0c-8401-090db42db644 while it is in vm_state active {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:12:17.193886 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e1822122-c2db-4e40-bc94-bbe180ffe12c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "POST /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644/action" status: 409 len: 145 microversion: 2.1 time: 0.113060 Jun 10 18:12:17.196982 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2067/4257] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:12:17 2022] POST /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644/action => generated 145 bytes in 117 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:12:17.203749 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-61526b38-eef5-43f9-8840-06e73732d6b8 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:17.210840 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-61526b38-eef5-43f9-8840-06e73732d6b8 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: aff760b6-7b66-40e8-b266-dcfa79ca41b5] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:17.399263 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-61526b38-eef5-43f9-8840-06e73732d6b8 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:17.410803 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-61526b38-eef5-43f9-8840-06e73732d6b8 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5" status: 200 len: 1215 microversion: 2.1 time: 0.207005 Jun 10 18:12:17.411837 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2068/4258] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:17 2022] GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5 => generated 1215 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:17.417621 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-49c346ea-45cd-4715-92fd-9683a3125b6d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:17.418544 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-49c346ea-45cd-4715-92fd-9683a3125b6d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:17.445946 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-49c346ea-45cd-4715-92fd-9683a3125b6d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:17.446794 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-49c346ea-45cd-4715-92fd-9683a3125b6d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:17.452667 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3d19ffec-d529-4c9b-ac31-d27136821cc9 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:17.456132 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:12:17.463484 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3d19ffec-d529-4c9b-ac31-d27136821cc9 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666" status: 200 len: 1324 microversion: 2.1 time: 0.413457 Jun 10 18:12:17.464077 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2191/4259] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:17 2022] GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666 => generated 1324 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:17.465115 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-49c346ea-45cd-4715-92fd-9683a3125b6d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:17.466670 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-49c346ea-45cd-4715-92fd-9683a3125b6d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:17.744618 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-49c346ea-45cd-4715-92fd-9683a3125b6d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:17.757790 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-49c346ea-45cd-4715-92fd-9683a3125b6d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.344119 Jun 10 18:12:17.770666 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2069/4260] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:17 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:17.778310 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-df245fac-9313-4c32-bbcb-79013d28d432 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:17.778946 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-df245fac-9313-4c32-bbcb-79013d28d432 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:17.787488 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-df245fac-9313-4c32-bbcb-79013d28d432 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:17.787988 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-df245fac-9313-4c32-bbcb-79013d28d432 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:17.788757 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-df245fac-9313-4c32-bbcb-79013d28d432 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:17.789326 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-df245fac-9313-4c32-bbcb-79013d28d432 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:18.049000 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-df245fac-9313-4c32-bbcb-79013d28d432 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:18.060163 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-df245fac-9313-4c32-bbcb-79013d28d432 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.286151 Jun 10 18:12:18.060898 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2192/4261] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:17 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:18.078340 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3e98e0ef-d0dd-4f1e-a643-a78fb3c08bc4 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:18.079687 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3e98e0ef-d0dd-4f1e-a643-a78fb3c08bc4 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: a76ce025-87e4-4c7d-9a0a-4f5cb7ecd604] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:18.093153 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-3e98e0ef-d0dd-4f1e-a643-a78fb3c08bc4 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] HTTP exception thrown: Instance a76ce025-87e4-4c7d-9a0a-4f5cb7ecd604 could not be found. Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3e98e0ef-d0dd-4f1e-a643-a78fb3c08bc4 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers/a76ce025-87e4-4c7d-9a0a-4f5cb7ecd604/action HTTP/1.1 Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 14 Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: {"resume": {}} Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: exception: Instance a76ce025-87e4-4c7d-9a0a-4f5cb7ecd604 could not be found. Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'a76ce025-87e4-4c7d-9a0a-4f5cb7ecd604', 'body': {'resume': {}}} Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a76ce025-87e4-4c7d-9a0a-4f5cb7ecd604 could not be found. Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a76ce025-87e4-4c7d-9a0a-4f5cb7ecd604 could not be found. Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:18.100363 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:18.105529 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:12:18.105529 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:12:18.105529 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a76ce025-87e4-4c7d-9a0a-4f5cb7ecd604 could not be found. Jun 10 18:12:18.105529 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:18.106935 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3e98e0ef-d0dd-4f1e-a643-a78fb3c08bc4 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 404 to user: Instance a76ce025-87e4-4c7d-9a0a-4f5cb7ecd604 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:12:18.107997 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3e98e0ef-d0dd-4f1e-a643-a78fb3c08bc4 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "POST /compute/v2.1/servers/a76ce025-87e4-4c7d-9a0a-4f5cb7ecd604/action" status: 404 len: 111 microversion: 2.1 time: 0.034445 Jun 10 18:12:18.116927 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2070/4262] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:12:18 2022] POST /compute/v2.1/servers/a76ce025-87e4-4c7d-9a0a-4f5cb7ecd604/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:12:18.123948 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4606f527-aec5-4c18-a714-28534761f9d5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:18.125060 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4606f527-aec5-4c18-a714-28534761f9d5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:18.140384 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4606f527-aec5-4c18-a714-28534761f9d5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:18.143335 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4606f527-aec5-4c18-a714-28534761f9d5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:18.145483 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4606f527-aec5-4c18-a714-28534761f9d5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:18.146123 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4606f527-aec5-4c18-a714-28534761f9d5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:18.430845 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2c89ae46-caeb-4c0a-ac99-359d4f6a2173 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:18.431850 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2c89ae46-caeb-4c0a-ac99-359d4f6a2173 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: aff760b6-7b66-40e8-b266-dcfa79ca41b5] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:18.458335 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c89ae46-caeb-4c0a-ac99-359d4f6a2173 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:18.459068 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c89ae46-caeb-4c0a-ac99-359d4f6a2173 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:18.516461 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c89ae46-caeb-4c0a-ac99-359d4f6a2173 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:18.520125 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c89ae46-caeb-4c0a-ac99-359d4f6a2173 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.056s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:18.561698 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4606f527-aec5-4c18-a714-28534761f9d5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:18.576341 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4606f527-aec5-4c18-a714-28534761f9d5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.458374 Jun 10 18:12:18.589830 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2193/4263] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:18 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:18.617631 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-70397bc1-9da8-4d33-ba86-c113915ad4ae tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:18.622616 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-70397bc1-9da8-4d33-ba86-c113915ad4ae tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 3a5ac7a5-efdb-4191-85ed-237a1d2f7666] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:18.627003 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-70397bc1-9da8-4d33-ba86-c113915ad4ae tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:18.627846 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-70397bc1-9da8-4d33-ba86-c113915ad4ae tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:18.629258 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-70397bc1-9da8-4d33-ba86-c113915ad4ae tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:18.630006 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-70397bc1-9da8-4d33-ba86-c113915ad4ae tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:18.962953 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-70397bc1-9da8-4d33-ba86-c113915ad4ae tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:18.971358 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-70397bc1-9da8-4d33-ba86-c113915ad4ae tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666" status: 200 len: 1324 microversion: 2.1 time: 0.378483 Jun 10 18:12:18.982384 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2c89ae46-caeb-4c0a-ac99-359d4f6a2173 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:18.982549 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2194/4264] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:18 2022] GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666 => generated 1324 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:18.989811 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2c89ae46-caeb-4c0a-ac99-359d4f6a2173 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5" status: 200 len: 1211 microversion: 2.1 time: 0.563384 Jun 10 18:12:18.990567 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-46f72f40-9347-4768-a82c-8dfd5af76966 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:18.991207 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-46f72f40-9347-4768-a82c-8dfd5af76966 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:19.003362 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2071/4265] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:18 2022] GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5 => generated 1211 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:19.007244 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-46f72f40-9347-4768-a82c-8dfd5af76966 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:19.007737 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-46f72f40-9347-4768-a82c-8dfd5af76966 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:19.008603 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-46f72f40-9347-4768-a82c-8dfd5af76966 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:19.009041 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-46f72f40-9347-4768-a82c-8dfd5af76966 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:19.050339 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-e478f7d9-6acf-44c8-a559-6d59fefd8c1d req-e94f64a7-ec84-4023-b2c1-41e8fc0a4670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a5ac7a5-efdb-4191-85ed-237a1d2f7666", "name": "network-vif-plugged", "status": "completed", "tag": "15f0ae4c-fe9e-4811-a8ca-da49e03476bd"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:19.072249 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-e478f7d9-6acf-44c8-a559-6d59fefd8c1d req-e94f64a7-ec84-4023-b2c1-41e8fc0a4670 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:19.076428 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-e478f7d9-6acf-44c8-a559-6d59fefd8c1d req-e94f64a7-ec84-4023-b2c1-41e8fc0a4670 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:19.111947 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:12:19.122648 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-e478f7d9-6acf-44c8-a559-6d59fefd8c1d req-e94f64a7-ec84-4023-b2c1-41e8fc0a4670 service nova] Creating event network-vif-plugged:15f0ae4c-fe9e-4811-a8ca-da49e03476bd for instance 3a5ac7a5-efdb-4191-85ed-237a1d2f7666 on chh1-master-2 Jun 10 18:12:19.145458 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-e478f7d9-6acf-44c8-a559-6d59fefd8c1d req-e94f64a7-ec84-4023-b2c1-41e8fc0a4670 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089628 Jun 10 18:12:19.145458 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2072/4266] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:12:19.422937 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-46f72f40-9347-4768-a82c-8dfd5af76966 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:19.433324 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-46f72f40-9347-4768-a82c-8dfd5af76966 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.450726 Jun 10 18:12:19.433324 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2195/4267] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:18 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:19.473234 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e0b0d4b9-071a-4c85-8761-232b4c8e889b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:19.473897 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e0b0d4b9-071a-4c85-8761-232b4c8e889b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:19.516392 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:12:19.530233 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e0b0d4b9-071a-4c85-8761-232b4c8e889b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:19.530700 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e0b0d4b9-071a-4c85-8761-232b4c8e889b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:19.531514 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e0b0d4b9-071a-4c85-8761-232b4c8e889b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:19.531944 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e0b0d4b9-071a-4c85-8761-232b4c8e889b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:19.713743 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-e0b0d4b9-071a-4c85-8761-232b4c8e889b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] HTTP exception thrown: Cannot 'resume' instance 57a377b2-f75e-4a0c-8401-090db42db644 while it is in vm_state active Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e0b0d4b9-071a-4c85-8761-232b4c8e889b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644/action HTTP/1.1 Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 14 Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: {"resume": {}} Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: exception: Cannot 'resume' instance 57a377b2-f75e-4a0c-8401-090db42db644 while it is in vm_state active Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '57a377b2-f75e-4a0c-8401-090db42db644', 'body': {'resume': {}}} Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 57a377b2-f75e-4a0c-8401-090db42db644 in vm_state active. Cannot resume while the instance is in this state. Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 57a377b2-f75e-4a0c-8401-090db42db644 while it is in vm_state active Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:19.722016 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:19.729611 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:19.729611 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:12:19.729611 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:12:19.729611 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 57a377b2-f75e-4a0c-8401-090db42db644 while it is in vm_state active Jun 10 18:12:19.729611 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:19.729611 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e0b0d4b9-071a-4c85-8761-232b4c8e889b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 409 to user: Cannot 'resume' instance 57a377b2-f75e-4a0c-8401-090db42db644 while it is in vm_state active {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:12:19.729611 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e0b0d4b9-071a-4c85-8761-232b4c8e889b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "POST /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644/action" status: 409 len: 144 microversion: 2.1 time: 0.273523 Jun 10 18:12:19.732809 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2073/4268] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:12:19 2022] POST /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644/action => generated 144 bytes in 281 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:12:19.739000 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b2902703-bd88-4ab1-abbf-080cb7afcaa5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:19.739729 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b2902703-bd88-4ab1-abbf-080cb7afcaa5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:19.763170 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b2902703-bd88-4ab1-abbf-080cb7afcaa5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:19.767089 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b2902703-bd88-4ab1-abbf-080cb7afcaa5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:19.770703 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b2902703-bd88-4ab1-abbf-080cb7afcaa5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:19.774050 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b2902703-bd88-4ab1-abbf-080cb7afcaa5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:20.250501 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-748f89f5-a3de-41f4-9b0d-d54e47bc4d70 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-358794222", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:20.284196 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b2902703-bd88-4ab1-abbf-080cb7afcaa5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:20.294670 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b2902703-bd88-4ab1-abbf-080cb7afcaa5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.560309 Jun 10 18:12:20.304200 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2196/4269] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:19 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:20.304200 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b5266dc8-10f0-42fd-b5ba-ac4aa5715dce tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:20.304736 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b5266dc8-10f0-42fd-b5ba-ac4aa5715dce tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 3a5ac7a5-efdb-4191-85ed-237a1d2f7666] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:20.327536 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5266dc8-10f0-42fd-b5ba-ac4aa5715dce tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:20.328131 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5266dc8-10f0-42fd-b5ba-ac4aa5715dce tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:20.331738 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5266dc8-10f0-42fd-b5ba-ac4aa5715dce tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:20.332376 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5266dc8-10f0-42fd-b5ba-ac4aa5715dce tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:20.379080 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-748f89f5-a3de-41f4-9b0d-d54e47bc4d70 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] validate_networks() for None {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:12:20.608455 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b5266dc8-10f0-42fd-b5ba-ac4aa5715dce tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:20.625586 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b5266dc8-10f0-42fd-b5ba-ac4aa5715dce tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666" status: 200 len: 1324 microversion: 2.1 time: 0.325876 Jun 10 18:12:20.631223 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2197/4270] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:20 2022] GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666 => generated 1324 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:20.649586 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-df878b52-3e3b-4c33-8648-ff8338c57518 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:20.652068 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-df878b52-3e3b-4c33-8648-ff8338c57518 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: aff760b6-7b66-40e8-b266-dcfa79ca41b5] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:20.720563 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-df878b52-3e3b-4c33-8648-ff8338c57518 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:20.721673 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-df878b52-3e3b-4c33-8648-ff8338c57518 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:20.725678 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-df878b52-3e3b-4c33-8648-ff8338c57518 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:20.728962 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-df878b52-3e3b-4c33-8648-ff8338c57518 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:20.946260 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-df878b52-3e3b-4c33-8648-ff8338c57518 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:20.963462 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-df878b52-3e3b-4c33-8648-ff8338c57518 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5" status: 200 len: 1273 microversion: 2.1 time: 0.329609 Jun 10 18:12:20.964075 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2198/4271] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:20 2022] GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5 => generated 1273 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:20.985576 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-415b6b54-f3f0-456d-9943-cb5fa0519e6a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:20.986207 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-415b6b54-f3f0-456d-9943-cb5fa0519e6a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:20.996846 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-415b6b54-f3f0-456d-9943-cb5fa0519e6a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:20.997223 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-415b6b54-f3f0-456d-9943-cb5fa0519e6a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:20.998923 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-415b6b54-f3f0-456d-9943-cb5fa0519e6a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:20.999404 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-415b6b54-f3f0-456d-9943-cb5fa0519e6a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:21.367412 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-415b6b54-f3f0-456d-9943-cb5fa0519e6a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:21.375770 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-415b6b54-f3f0-456d-9943-cb5fa0519e6a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.409592 Jun 10 18:12:21.377695 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2199/4272] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:20 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:21.582139 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-79285b03-8331-4c62-bed6-51fe0464894f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "ec033079-44eb-425d-beee-8bccdd30063c"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-79285b03-8331-4c62-bed6-51fe0464894f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 160 Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: {"server": {"name": "", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "ec033079-44eb-425d-beee-8bccdd30063c"}]}} Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: exception: Invalid input for field/attribute name. Value: . '' is too short Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: action_args: {'body': {'server': {'name': '', 'imageRef': 'efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8', 'flavorRef': '452', 'networks': [{'uuid': 'ec033079-44eb-425d-beee-8bccdd30063c'}]}}} Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise error Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi '' Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 10 18:12:21.585448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 10 18:12:21.590915 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 10 18:12:21.590915 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jun 10 18:12:21.590915 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:21.590915 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:21.590915 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:21.590915 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:21.590915 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:21.590915 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:21.590915 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 10 18:12:21.590915 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 10 18:12:21.590915 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jun 10 18:12:21.590915 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:21.592891 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-79285b03-8331-4c62-bed6-51fe0464894f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:12:21.596128 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-79285b03-8331-4c62-bed6-51fe0464894f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.018449 Jun 10 18:12:21.597977 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2200/4273] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:12:21 2022] POST /compute/v2.1/servers => generated 108 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 10 18:12:21.619796 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5c052acd-eb4e-453b-ab1f-77a704d288c8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:21.621258 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5c052acd-eb4e-453b-ab1f-77a704d288c8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:21.630996 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5c052acd-eb4e-453b-ab1f-77a704d288c8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:21.631854 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5c052acd-eb4e-453b-ab1f-77a704d288c8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:21.633813 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5c052acd-eb4e-453b-ab1f-77a704d288c8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:21.634497 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5c052acd-eb4e-453b-ab1f-77a704d288c8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:21.832959 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5c052acd-eb4e-453b-ab1f-77a704d288c8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:21.850934 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5c052acd-eb4e-453b-ab1f-77a704d288c8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.246368 Jun 10 18:12:21.854488 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2201/4274] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:21 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:21.881517 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2207a81a-5f80-4740-8b57-844d8f082390 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:21.882262 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2207a81a-5f80-4740-8b57-844d8f082390 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 3a5ac7a5-efdb-4191-85ed-237a1d2f7666] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:21.902058 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2207a81a-5f80-4740-8b57-844d8f082390 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:21.902521 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2207a81a-5f80-4740-8b57-844d8f082390 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:21.913380 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2207a81a-5f80-4740-8b57-844d8f082390 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:21.913380 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2207a81a-5f80-4740-8b57-844d8f082390 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:22.171641 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2207a81a-5f80-4740-8b57-844d8f082390 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:22.189380 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2207a81a-5f80-4740-8b57-844d8f082390 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666" status: 200 len: 1520 microversion: 2.1 time: 0.331148 Jun 10 18:12:22.189380 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2202/4275] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:21 2022] GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666 => generated 1520 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:22.196100 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8469e488-24e1-4a49-be3a-20ca705e2563 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:22.197021 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8469e488-24e1-4a49-be3a-20ca705e2563 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:22.249675 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8469e488-24e1-4a49-be3a-20ca705e2563 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:22.250583 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8469e488-24e1-4a49-be3a-20ca705e2563 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:22.251667 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8469e488-24e1-4a49-be3a-20ca705e2563 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:22.252357 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8469e488-24e1-4a49-be3a-20ca705e2563 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:22.581790 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8469e488-24e1-4a49-be3a-20ca705e2563 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:22.598168 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8469e488-24e1-4a49-be3a-20ca705e2563 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.409832 Jun 10 18:12:22.599729 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2203/4276] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:22 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:22.605331 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-dd97b54f-28a6-4779-9a79-b518e43cc6d3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:22.606330 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-dd97b54f-28a6-4779-9a79-b518e43cc6d3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: aff760b6-7b66-40e8-b266-dcfa79ca41b5] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:22.618818 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dd97b54f-28a6-4779-9a79-b518e43cc6d3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:22.620406 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dd97b54f-28a6-4779-9a79-b518e43cc6d3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:22.623155 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dd97b54f-28a6-4779-9a79-b518e43cc6d3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:22.624524 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dd97b54f-28a6-4779-9a79-b518e43cc6d3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:22.724843 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-748f89f5-a3de-41f4-9b0d-d54e47bc4d70 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:12:22.728216 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-748f89f5-a3de-41f4-9b0d-d54e47bc4d70 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:12:22.729633 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-748f89f5-a3de-41f4-9b0d-d54e47bc4d70 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:12:22.730834 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-748f89f5-a3de-41f4-9b0d-d54e47bc4d70 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:12:22.745977 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-748f89f5-a3de-41f4-9b0d-d54e47bc4d70 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:12:22.789972 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-748f89f5-a3de-41f4-9b0d-d54e47bc4d70 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:22.791895 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-748f89f5-a3de-41f4-9b0d-d54e47bc4d70 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:22.796812 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-748f89f5-a3de-41f4-9b0d-d54e47bc4d70 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:22.799621 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-748f89f5-a3de-41f4-9b0d-d54e47bc4d70 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:22.802826 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-dd97b54f-28a6-4779-9a79-b518e43cc6d3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:22.826834 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-dd97b54f-28a6-4779-9a79-b518e43cc6d3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5" status: 200 len: 1273 microversion: 2.1 time: 0.225434 Jun 10 18:12:22.827441 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2204/4277] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:22 2022] GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5 => generated 1273 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:22.843114 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e7ce7f37-3a39-4943-8641-f310bddd8c11 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:22.855960 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e7ce7f37-3a39-4943-8641-f310bddd8c11 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 3a5ac7a5-efdb-4191-85ed-237a1d2f7666] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:22.860956 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-748f89f5-a3de-41f4-9b0d-d54e47bc4d70 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Getting quotas for project 534acf4edf9247dea63a9387e0cd0e7b. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:12:22.868076 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-748f89f5-a3de-41f4-9b0d-d54e47bc4d70 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Getting quotas for user b2fe556bf10c4d69a86a325d60da6aa7 and project 534acf4edf9247dea63a9387e0cd0e7b. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:12:22.879406 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7ce7f37-3a39-4943-8641-f310bddd8c11 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:22.879406 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7ce7f37-3a39-4943-8641-f310bddd8c11 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:22.879406 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7ce7f37-3a39-4943-8641-f310bddd8c11 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:22.880260 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7ce7f37-3a39-4943-8641-f310bddd8c11 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:22.884874 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-748f89f5-a3de-41f4-9b0d-d54e47bc4d70 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:12:22.888166 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-748f89f5-a3de-41f4-9b0d-d54e47bc4d70 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] [instance: 07a5fadb-9316-44c9-9c5e-c8f26050d4d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:12:23.038571 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-748f89f5-a3de-41f4-9b0d-d54e47bc4d70 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.052573 Jun 10 18:12:23.045490 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2074/4278] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:12:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 3061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:12:23.052031 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a38908e5-4ae6-46aa-a6bb-86a8611518e1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:23.052601 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a38908e5-4ae6-46aa-a6bb-86a8611518e1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: bd38f320-b657-4b06-81e9-89699b9dee5f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:23.069554 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-a38908e5-4ae6-46aa-a6bb-86a8611518e1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] HTTP exception thrown: Instance bd38f320-b657-4b06-81e9-89699b9dee5f could not be found. Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a38908e5-4ae6-46aa-a6bb-86a8611518e1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers/bd38f320-b657-4b06-81e9-89699b9dee5f/action HTTP/1.1 Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 14 Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: {"shelve": {}} Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: exception: Instance bd38f320-b657-4b06-81e9-89699b9dee5f could not be found. Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'bd38f320-b657-4b06-81e9-89699b9dee5f', 'body': {'shelve': {}}} Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd38f320-b657-4b06-81e9-89699b9dee5f could not be found. Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd38f320-b657-4b06-81e9-89699b9dee5f could not be found. Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:23.078180 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:23.082884 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:12:23.082884 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:12:23.082884 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd38f320-b657-4b06-81e9-89699b9dee5f could not be found. Jun 10 18:12:23.082884 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:23.082884 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a38908e5-4ae6-46aa-a6bb-86a8611518e1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 404 to user: Instance bd38f320-b657-4b06-81e9-89699b9dee5f could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:12:23.082884 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a38908e5-4ae6-46aa-a6bb-86a8611518e1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "POST /compute/v2.1/servers/bd38f320-b657-4b06-81e9-89699b9dee5f/action" status: 404 len: 111 microversion: 2.1 time: 0.031966 Jun 10 18:12:23.082884 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2075/4279] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:12:23 2022] POST /compute/v2.1/servers/bd38f320-b657-4b06-81e9-89699b9dee5f/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:12:23.089092 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-665137a1-bedc-4964-88fd-4bb2580c1b99 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:23.091319 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-665137a1-bedc-4964-88fd-4bb2580c1b99 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] [instance: 07a5fadb-9316-44c9-9c5e-c8f26050d4d2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:23.117812 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e7ce7f37-3a39-4943-8641-f310bddd8c11 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:23.133809 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e7ce7f37-3a39-4943-8641-f310bddd8c11 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666" status: 200 len: 1520 microversion: 2.1 time: 0.305283 Jun 10 18:12:23.135260 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2205/4280] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:22 2022] GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666 => generated 1520 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:23.150604 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c042d7fd-5970-4766-b4c1-3cfb83a95154 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:23.154458 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c042d7fd-5970-4766-b4c1-3cfb83a95154 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:23.175330 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c042d7fd-5970-4766-b4c1-3cfb83a95154 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:23.175854 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c042d7fd-5970-4766-b4c1-3cfb83a95154 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:23.176795 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c042d7fd-5970-4766-b4c1-3cfb83a95154 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:23.177243 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c042d7fd-5970-4766-b4c1-3cfb83a95154 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:23.381499 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-665137a1-bedc-4964-88fd-4bb2580c1b99 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2fe556bf10c4d69a86a325d60da6aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534acf4edf9247dea63a9387e0cd0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:23.392269 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-665137a1-bedc-4964-88fd-4bb2580c1b99 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] 10.222.0.35 "GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2" status: 200 len: 1215 microversion: 2.1 time: 0.309830 Jun 10 18:12:23.394559 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2076/4281] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:23 2022] GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2 => generated 1215 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:23.419554 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-66b71a48-513d-470c-b699-92977794c03b tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1236475604", "metadata": {"": ""}}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-66b71a48-513d-470c-b699-92977794c03b tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Request method failure captured: Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666/action HTTP/1.1 Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 107 Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4lsfzX-ZssLhBeRERA250Allr9sy5j_9WvmWWrmV8OKGfGLWtKo7IkZmvrlgadYYrKiCJiGv3V0W6WUpTPzvczOtcJBE7CxOiD9g_bSlYjPmyz5JBO2nqOTXPUSYGg7_D3Rbko1iq-cS8Cxtg3C-XqYzZtQdMv47S3ncw5oU530j6g Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: dc6ea0e4d347491eb23c3af053313211 Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-582167706 Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/dc6ea0e4d347491eb23c3af053313211"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/dc6ea0e4d347491eb23c3af053313211"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/dc6ea0e4d347491eb23c3af053313211"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_dc6ea0e4d347491eb23c3af053313211", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-582167706 Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: dc6ea0e4d347491eb23c3af053313211 Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-582167706 Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ImagesOneServerNegativeTestJSON-582167706-project Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 8e6b5cd42b2144a69590680e5ef156fa Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-582167706-project Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1236475604", "metadata": {"": ""}}} Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '3a5ac7a5-efdb-4191-85ed-237a1d2f7666', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1236475604', 'metadata': {'': ''}}}} Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise error Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi {'': ''} Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:12:23.438111 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 10 18:12:23.445874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 10 18:12:23.445874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 10 18:12:23.445874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 10 18:12:23.445874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 10 18:12:23.445874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 10 18:12:23.445874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 10 18:12:23.445874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:23.445874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:23.445874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:23.445874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:23.445874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:23.445874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:23.445874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 10 18:12:23.445874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 10 18:12:23.445874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 10 18:12:23.445874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:23.445874 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-66b71a48-513d-470c-b699-92977794c03b tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:12:23.452379 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-66b71a48-513d-470c-b699-92977794c03b tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "POST /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666/action" status: 400 len: 170 microversion: 2.1 time: 0.043865 Jun 10 18:12:23.455621 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2077/4282] 10.222.0.35 () {60 vars in 1278 bytes} [Fri Jun 10 18:12:23 2022] POST /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666/action => generated 170 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:12:23.470875 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6ddd6339-5b72-4a54-91b9-6a3e3e9c56ed tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:23.475627 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6ddd6339-5b72-4a54-91b9-6a3e3e9c56ed tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 3a5ac7a5-efdb-4191-85ed-237a1d2f7666] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:23.489483 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6ddd6339-5b72-4a54-91b9-6a3e3e9c56ed tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:23.489948 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6ddd6339-5b72-4a54-91b9-6a3e3e9c56ed tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:23.491278 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6ddd6339-5b72-4a54-91b9-6a3e3e9c56ed tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:23.508230 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6ddd6339-5b72-4a54-91b9-6a3e3e9c56ed tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:23.522691 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c042d7fd-5970-4766-b4c1-3cfb83a95154 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:23.539610 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c042d7fd-5970-4766-b4c1-3cfb83a95154 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.402527 Jun 10 18:12:23.548413 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2206/4283] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:23 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:23.560035 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9fc1df66-be85-4315-b3f3-9cb01cde67de tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:23.560882 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9fc1df66-be85-4315-b3f3-9cb01cde67de tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:23.572691 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9fc1df66-be85-4315-b3f3-9cb01cde67de tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:23.573747 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9fc1df66-be85-4315-b3f3-9cb01cde67de tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:23.574895 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9fc1df66-be85-4315-b3f3-9cb01cde67de tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:23.575932 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9fc1df66-be85-4315-b3f3-9cb01cde67de tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:23.907014 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9fc1df66-be85-4315-b3f3-9cb01cde67de tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:23.908297 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9fc1df66-be85-4315-b3f3-9cb01cde67de tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.352950 Jun 10 18:12:23.910294 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2207/4284] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:23 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:23.929503 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c1a45eaf-4198-4939-b4cb-836db0c4a481 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:23.930909 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c1a45eaf-4198-4939-b4cb-836db0c4a481 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: aff760b6-7b66-40e8-b266-dcfa79ca41b5] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:23.938786 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c1a45eaf-4198-4939-b4cb-836db0c4a481 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:23.939551 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c1a45eaf-4198-4939-b4cb-836db0c4a481 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:23.941313 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c1a45eaf-4198-4939-b4cb-836db0c4a481 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:23.942154 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c1a45eaf-4198-4939-b4cb-836db0c4a481 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:24.055511 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6ddd6339-5b72-4a54-91b9-6a3e3e9c56ed tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:24.067848 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6ddd6339-5b72-4a54-91b9-6a3e3e9c56ed tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666" status: 200 len: 1520 microversion: 2.1 time: 0.606277 Jun 10 18:12:24.082953 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2078/4285] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:23 2022] GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666 => generated 1520 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:24.090478 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6a20f0f6-1a28-4d68-bf69-f6437e15d685 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:24.091347 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6a20f0f6-1a28-4d68-bf69-f6437e15d685 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:24.100631 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a20f0f6-1a28-4d68-bf69-f6437e15d685 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:24.101363 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a20f0f6-1a28-4d68-bf69-f6437e15d685 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:24.104576 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a20f0f6-1a28-4d68-bf69-f6437e15d685 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:24.105379 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a20f0f6-1a28-4d68-bf69-f6437e15d685 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:24.149817 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c1a45eaf-4198-4939-b4cb-836db0c4a481 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:24.160944 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c1a45eaf-4198-4939-b4cb-836db0c4a481 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5" status: 200 len: 1315 microversion: 2.1 time: 0.245904 Jun 10 18:12:24.166969 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2208/4286] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:23 2022] GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:24.167192 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-6a20f0f6-1a28-4d68-bf69-f6437e15d685 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lazy-loading 'flavor' on Instance uuid 57a377b2-f75e-4a0c-8401-090db42db644 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:12:24.185702 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-316c5dad-780d-4174-a112-07270aa69caa tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:24.187537 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-316c5dad-780d-4174-a112-07270aa69caa tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 3a5ac7a5-efdb-4191-85ed-237a1d2f7666] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:24.209990 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-316c5dad-780d-4174-a112-07270aa69caa tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:24.211774 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-316c5dad-780d-4174-a112-07270aa69caa tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:24.214045 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-316c5dad-780d-4174-a112-07270aa69caa tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:24.215482 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-316c5dad-780d-4174-a112-07270aa69caa tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:24.298681 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:12:24.510148 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-316c5dad-780d-4174-a112-07270aa69caa tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:24.522081 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-316c5dad-780d-4174-a112-07270aa69caa tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666" status: 200 len: 1520 microversion: 2.1 time: 0.357136 Jun 10 18:12:24.523278 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2209/4287] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:24 2022] GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666 => generated 1520 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:24.572294 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2b062aa1-b51e-41d8-8f83-e1e1d35d25ab tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:24.574132 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2b062aa1-b51e-41d8-8f83-e1e1d35d25ab tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] [instance: 07a5fadb-9316-44c9-9c5e-c8f26050d4d2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:24.592969 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2b062aa1-b51e-41d8-8f83-e1e1d35d25ab tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:24.593430 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2b062aa1-b51e-41d8-8f83-e1e1d35d25ab tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:24.594220 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2b062aa1-b51e-41d8-8f83-e1e1d35d25ab tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:24.603271 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2b062aa1-b51e-41d8-8f83-e1e1d35d25ab tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:24.713918 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2b062aa1-b51e-41d8-8f83-e1e1d35d25ab tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2fe556bf10c4d69a86a325d60da6aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534acf4edf9247dea63a9387e0cd0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:24.750850 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2b062aa1-b51e-41d8-8f83-e1e1d35d25ab tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] 10.222.0.35 "GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2" status: 200 len: 1219 microversion: 2.1 time: 0.219738 Jun 10 18:12:24.767216 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2210/4288] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:24 2022] GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2 => generated 1219 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:24.774908 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-69c6e3df-8412-483b-80ee-1cbc04a1774d tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1965845909", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:24.778184 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-69c6e3df-8412-483b-80ee-1cbc04a1774d tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Request method failure captured: Jun 10 18:12:24.778184 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666/action HTTP/1.1 Jun 10 18:12:24.778184 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:12:24.778184 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:12:24.778184 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:12:24.778184 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 619 Jun 10 18:12:24.778184 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:12:24.778184 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:12:24.778184 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:12:24.778184 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:12:24.778184 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4lsfzX-ZssLhBeRERA250Allr9sy5j_9WvmWWrmV8OKGfGLWtKo7IkZmvrlgadYYrKiCJiGv3V0W6WUpTPzvczOtcJBE7CxOiD9g_bSlYjPmyz5JBO2nqOTXPUSYGg7_D3Rbko1iq-cS8Cxtg3C-XqYzZtQdMv47S3ncw5oU530j6g Jun 10 18:12:24.778184 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:12:24.778184 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:12:24.778184 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:12:24.778184 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:12:24.778184 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:12:24.778184 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:12:24.778184 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: dc6ea0e4d347491eb23c3af053313211 Jun 10 18:12:24.778184 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-582167706 Jun 10 18:12:24.778184 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:12:24.778184 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:12:24.778184 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/dc6ea0e4d347491eb23c3af053313211"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/dc6ea0e4d347491eb23c3af053313211"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/dc6ea0e4d347491eb23c3af053313211"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_dc6ea0e4d347491eb23c3af053313211", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:12:24.778184 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-582167706 Jun 10 18:12:24.778184 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: dc6ea0e4d347491eb23c3af053313211 Jun 10 18:12:24.778184 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-582167706 Jun 10 18:12:24.778184 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ImagesOneServerNegativeTestJSON-582167706-project Jun 10 18:12:24.778184 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:12:24.778184 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:12:24.778184 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 8e6b5cd42b2144a69590680e5ef156fa Jun 10 18:12:24.778184 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-582167706-project Jun 10 18:12:24.778184 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:12:24.778184 chdv-master-2 devstack@n-api.service[126594]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1965845909", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Jun 10 18:12:24.778184 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:12:24.778184 chdv-master-2 devstack@n-api.service[126594]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 10 18:12:24.778184 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '3a5ac7a5-efdb-4191-85ed-237a1d2f7666', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1965845909', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Jun 10 18:12:24.778184 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:12:24.778184 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:24.778184 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 10 18:12:24.778184 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 10 18:12:24.778184 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 10 18:12:24.778184 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise error Jun 10 18:12:24.781090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 10 18:12:24.781090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:24.781090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jun 10 18:12:24.781090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 10 18:12:24.781090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 10 18:12:24.781090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 10 18:12:24.781090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 10 18:12:24.781090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:24.781090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jun 10 18:12:24.781090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Jun 10 18:12:24.781090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:24.781090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:24.781090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:24.781090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:24.781090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:24.781090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:24.781090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:12:24.781090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:12:24.781090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:12:24.781090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:12:24.781090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:12:24.781090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:12:24.781090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 10 18:12:24.781090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 10 18:12:24.781090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 10 18:12:24.781090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 10 18:12:24.781090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 10 18:12:24.781090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 10 18:12:24.781090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 10 18:12:24.781090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:24.781090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:24.781090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:24.781090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:24.781090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:24.781090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:24.781090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 10 18:12:24.781090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 10 18:12:24.781090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 10 18:12:24.781090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:24.784877 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-69c6e3df-8412-483b-80ee-1cbc04a1774d tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:12:24.785430 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-69c6e3df-8412-483b-80ee-1cbc04a1774d tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "POST /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666/action" status: 400 len: 938 microversion: 2.1 time: 0.013425 Jun 10 18:12:24.786876 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2211/4289] 10.222.0.35 () {60 vars in 1278 bytes} [Fri Jun 10 18:12:24 2022] POST /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666/action => generated 938 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:12:24.814936 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9d54a09e-aff4-42d2-a1c8-e32b8878bec2 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:24.816468 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9d54a09e-aff4-42d2-a1c8-e32b8878bec2 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 3a5ac7a5-efdb-4191-85ed-237a1d2f7666] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:24.850217 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9d54a09e-aff4-42d2-a1c8-e32b8878bec2 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:24.851108 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9d54a09e-aff4-42d2-a1c8-e32b8878bec2 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:24.857427 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9d54a09e-aff4-42d2-a1c8-e32b8878bec2 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:24.857427 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9d54a09e-aff4-42d2-a1c8-e32b8878bec2 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:25.039365 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6a20f0f6-1a28-4d68-bf69-f6437e15d685 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "POST /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644/action" status: 202 len: 0 microversion: 2.1 time: 0.951480 Jun 10 18:12:25.045822 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2079/4290] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:12:24 2022] POST /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644/action => generated 0 bytes in 962 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:12:25.059888 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c965714c-0343-41ee-826b-3cf1f5f4367b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:25.065441 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c965714c-0343-41ee-826b-3cf1f5f4367b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:25.078326 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c965714c-0343-41ee-826b-3cf1f5f4367b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:25.078794 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c965714c-0343-41ee-826b-3cf1f5f4367b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:25.079588 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c965714c-0343-41ee-826b-3cf1f5f4367b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:25.080032 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c965714c-0343-41ee-826b-3cf1f5f4367b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:25.196586 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9d54a09e-aff4-42d2-a1c8-e32b8878bec2 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:25.215701 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9d54a09e-aff4-42d2-a1c8-e32b8878bec2 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666" status: 200 len: 1520 microversion: 2.1 time: 0.415392 Jun 10 18:12:25.217819 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2212/4291] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:24 2022] GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666 => generated 1520 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:25.226585 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-167a5a9d-17d5-458c-826a-3adeae6f2f7d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:25.228999 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-167a5a9d-17d5-458c-826a-3adeae6f2f7d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: aff760b6-7b66-40e8-b266-dcfa79ca41b5] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:25.236625 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-167a5a9d-17d5-458c-826a-3adeae6f2f7d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:25.237103 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-167a5a9d-17d5-458c-826a-3adeae6f2f7d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:25.237879 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-167a5a9d-17d5-458c-826a-3adeae6f2f7d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:25.238325 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-167a5a9d-17d5-458c-826a-3adeae6f2f7d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:25.501936 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-167a5a9d-17d5-458c-826a-3adeae6f2f7d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:25.520524 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-167a5a9d-17d5-458c-826a-3adeae6f2f7d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5" status: 200 len: 1315 microversion: 2.1 time: 0.301255 Jun 10 18:12:25.521368 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2213/4292] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:25 2022] GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5 => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:25.527452 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e7b067cb-47be-4e68-a1a8-d61ec84f122f tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:25.528458 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e7b067cb-47be-4e68-a1a8-d61ec84f122f tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 3a5ac7a5-efdb-4191-85ed-237a1d2f7666] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:25.535989 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7b067cb-47be-4e68-a1a8-d61ec84f122f tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:25.536664 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7b067cb-47be-4e68-a1a8-d61ec84f122f tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:25.538510 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7b067cb-47be-4e68-a1a8-d61ec84f122f tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:25.542750 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c965714c-0343-41ee-826b-3cf1f5f4367b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:25.543042 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7b067cb-47be-4e68-a1a8-d61ec84f122f tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:25.557890 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c965714c-0343-41ee-826b-3cf1f5f4367b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1512 microversion: 2.1 time: 0.510692 Jun 10 18:12:25.560821 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2080/4293] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:25 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1512 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:25.769532 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-36194c47-bf1e-4034-8e22-22075756bf4b tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:25.770150 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-36194c47-bf1e-4034-8e22-22075756bf4b tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] [instance: 07a5fadb-9316-44c9-9c5e-c8f26050d4d2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:25.798724 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-36194c47-bf1e-4034-8e22-22075756bf4b tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:25.798724 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-36194c47-bf1e-4034-8e22-22075756bf4b tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:25.798724 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-36194c47-bf1e-4034-8e22-22075756bf4b tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:25.798724 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-36194c47-bf1e-4034-8e22-22075756bf4b tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:25.974837 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e7b067cb-47be-4e68-a1a8-d61ec84f122f tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:25.989975 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e7b067cb-47be-4e68-a1a8-d61ec84f122f tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666" status: 200 len: 1520 microversion: 2.1 time: 0.466631 Jun 10 18:12:25.991414 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2214/4294] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:25 2022] GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666 => generated 1520 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:26.030662 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-36194c47-bf1e-4034-8e22-22075756bf4b tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2fe556bf10c4d69a86a325d60da6aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534acf4edf9247dea63a9387e0cd0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:26.050505 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-36194c47-bf1e-4034-8e22-22075756bf4b tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] 10.222.0.35 "GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2" status: 200 len: 1267 microversion: 2.1 time: 0.280779 Jun 10 18:12:26.050505 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2081/4295] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:25 2022] GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2 => generated 1267 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:12:26.055143 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-48927241-4bf1-4e2e-a8a3-b082d8fb9089 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-48927241-4bf1-4e2e-a8a3-b082d8fb9089 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Request method failure captured: Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666/action HTTP/1.1 Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 285 Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4lsfzX-ZssLhBeRERA250Allr9sy5j_9WvmWWrmV8OKGfGLWtKo7IkZmvrlgadYYrKiCJiGv3V0W6WUpTPzvczOtcJBE7CxOiD9g_bSlYjPmyz5JBO2nqOTXPUSYGg7_D3Rbko1iq-cS8Cxtg3C-XqYzZtQdMv47S3ncw5oU530j6g Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: dc6ea0e4d347491eb23c3af053313211 Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-582167706 Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/dc6ea0e4d347491eb23c3af053313211"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/dc6ea0e4d347491eb23c3af053313211"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/dc6ea0e4d347491eb23c3af053313211"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_dc6ea0e4d347491eb23c3af053313211", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-582167706 Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: dc6ea0e4d347491eb23c3af053313211 Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-582167706 Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ImagesOneServerNegativeTestJSON-582167706-project Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 8e6b5cd42b2144a69590680e5ef156fa Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-582167706-project Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '3a5ac7a5-efdb-4191-85ed-237a1d2f7666', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise error Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:26.067776 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:26.072974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:26.072974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:26.072974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:12:26.072974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:12:26.072974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:12:26.072974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:12:26.072974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:12:26.072974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:12:26.072974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 10 18:12:26.072974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 10 18:12:26.072974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 10 18:12:26.072974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 10 18:12:26.072974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 10 18:12:26.072974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 10 18:12:26.072974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 10 18:12:26.072974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:26.072974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:26.072974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:26.072974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:26.072974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:26.072974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:26.072974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 10 18:12:26.072974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 10 18:12:26.072974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 10 18:12:26.072974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:26.081486 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-48927241-4bf1-4e2e-a8a3-b082d8fb9089 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:12:26.083373 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-48927241-4bf1-4e2e-a8a3-b082d8fb9089 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "POST /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666/action" status: 400 len: 619 microversion: 2.1 time: 0.035338 Jun 10 18:12:26.084160 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2082/4296] 10.222.0.35 () {60 vars in 1278 bytes} [Fri Jun 10 18:12:26 2022] POST /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666/action => generated 619 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:12:26.129217 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-69af9d39-0b74-4e20-a539-971808c946fd tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:26.129936 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-69af9d39-0b74-4e20-a539-971808c946fd tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 3a5ac7a5-efdb-4191-85ed-237a1d2f7666] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:26.156846 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-69af9d39-0b74-4e20-a539-971808c946fd tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:26.157568 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-69af9d39-0b74-4e20-a539-971808c946fd tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:26.158562 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-69af9d39-0b74-4e20-a539-971808c946fd tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:26.161167 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-69af9d39-0b74-4e20-a539-971808c946fd tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:26.276612 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bcccdffd-ff1d-4e02-b319-63dd1c2f0179 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-514886586", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:26.397905 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-bcccdffd-ff1d-4e02-b319-63dd1c2f0179 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] validate_networks() for [('0b4456f3-4e1c-4005-adf5-626a892b6b68', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:12:26.553294 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-69af9d39-0b74-4e20-a539-971808c946fd tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:26.567451 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-69af9d39-0b74-4e20-a539-971808c946fd tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666" status: 200 len: 1520 microversion: 2.1 time: 0.468026 Jun 10 18:12:26.570660 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2083/4297] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:26 2022] GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666 => generated 1520 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:26.587628 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-08c9404d-e642-4206-9273-2f2c6d7acf4e req-4bb84a7a-e847-4d36-b258-59e26e6149ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aff760b6-7b66-40e8-b266-dcfa79ca41b5", "tag": "bfa33665-db46-494c-8f4a-886c29dba2fb"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:26.606940 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-08c9404d-e642-4206-9273-2f2c6d7acf4e req-4bb84a7a-e847-4d36-b258-59e26e6149ea service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:26.607560 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-08c9404d-e642-4206-9273-2f2c6d7acf4e req-4bb84a7a-e847-4d36-b258-59e26e6149ea service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:26.644203 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-08c9404d-e642-4206-9273-2f2c6d7acf4e req-4bb84a7a-e847-4d36-b258-59e26e6149ea service nova] Creating event network-changed:bfa33665-db46-494c-8f4a-886c29dba2fb for instance aff760b6-7b66-40e8-b266-dcfa79ca41b5 on chh2-master-2 Jun 10 18:12:26.657944 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-08c9404d-e642-4206-9273-2f2c6d7acf4e req-4bb84a7a-e847-4d36-b258-59e26e6149ea service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084682 Jun 10 18:12:26.659125 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2084/4298] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:12:26.682559 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-117ab613-22f4-4692-b2c1-d66802a1cd80 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:26.683578 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-117ab613-22f4-4692-b2c1-d66802a1cd80 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: aff760b6-7b66-40e8-b266-dcfa79ca41b5] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:26.702046 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-117ab613-22f4-4692-b2c1-d66802a1cd80 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:26.706366 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-117ab613-22f4-4692-b2c1-d66802a1cd80 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:26.706731 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-117ab613-22f4-4692-b2c1-d66802a1cd80 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:26.707522 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-117ab613-22f4-4692-b2c1-d66802a1cd80 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:27.219073 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-117ab613-22f4-4692-b2c1-d66802a1cd80 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:27.236291 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-117ab613-22f4-4692-b2c1-d66802a1cd80 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5" status: 200 len: 1315 microversion: 2.1 time: 0.575702 Jun 10 18:12:27.239108 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2085/4299] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:26 2022] GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5 => generated 1315 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:27.255769 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e34c72ba-164f-429d-bd73-5d20432f34d8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:27.268506 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e34c72ba-164f-429d-bd73-5d20432f34d8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:27.289202 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e34c72ba-164f-429d-bd73-5d20432f34d8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:27.289669 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e34c72ba-164f-429d-bd73-5d20432f34d8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:27.290478 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e34c72ba-164f-429d-bd73-5d20432f34d8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:27.290916 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e34c72ba-164f-429d-bd73-5d20432f34d8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:27.544819 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-bcccdffd-ff1d-4e02-b319-63dd1c2f0179 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:12:27.549315 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-bcccdffd-ff1d-4e02-b319-63dd1c2f0179 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:12:27.549315 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-bcccdffd-ff1d-4e02-b319-63dd1c2f0179 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:12:27.549315 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-bcccdffd-ff1d-4e02-b319-63dd1c2f0179 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:12:27.549315 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-bcccdffd-ff1d-4e02-b319-63dd1c2f0179 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:12:27.556570 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bcccdffd-ff1d-4e02-b319-63dd1c2f0179 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:27.557026 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bcccdffd-ff1d-4e02-b319-63dd1c2f0179 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:27.557829 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bcccdffd-ff1d-4e02-b319-63dd1c2f0179 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:27.558268 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bcccdffd-ff1d-4e02-b319-63dd1c2f0179 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:27.586688 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-bcccdffd-ff1d-4e02-b319-63dd1c2f0179 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Getting quotas for project 2f3f65ee123043bb9c888cc5adffce37. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:12:27.592291 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-bcccdffd-ff1d-4e02-b319-63dd1c2f0179 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Getting quotas for user 6aa40a915e4e43cd8d493dc593a73028 and project 2f3f65ee123043bb9c888cc5adffce37. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:12:27.605738 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bcccdffd-ff1d-4e02-b319-63dd1c2f0179 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:12:27.609408 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bcccdffd-ff1d-4e02-b319-63dd1c2f0179 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:12:27.796842 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bcccdffd-ff1d-4e02-b319-63dd1c2f0179 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.803936 Jun 10 18:12:27.799996 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2215/4300] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:12:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 1808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:12:27.806447 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8e4c735d-ffa5-4068-a913-63c26360f8f3 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:27.807517 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8e4c735d-ffa5-4068-a913-63c26360f8f3 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 3a5ac7a5-efdb-4191-85ed-237a1d2f7666] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:27.817697 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8e4c735d-ffa5-4068-a913-63c26360f8f3 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:27.819145 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8e4c735d-ffa5-4068-a913-63c26360f8f3 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:27.820213 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8e4c735d-ffa5-4068-a913-63c26360f8f3 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:27.820871 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8e4c735d-ffa5-4068-a913-63c26360f8f3 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:27.980218 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e34c72ba-164f-429d-bd73-5d20432f34d8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:27.988814 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e34c72ba-164f-429d-bd73-5d20432f34d8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1512 microversion: 2.1 time: 0.750841 Jun 10 18:12:27.989410 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2086/4301] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:27 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1512 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:28.025635 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c095ff8a-dc1c-4605-b1d6-8c3833e44b47 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:28.027008 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c095ff8a-dc1c-4605-b1d6-8c3833e44b47 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] [instance: 07a5fadb-9316-44c9-9c5e-c8f26050d4d2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:28.050095 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c095ff8a-dc1c-4605-b1d6-8c3833e44b47 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:28.050564 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c095ff8a-dc1c-4605-b1d6-8c3833e44b47 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:28.051406 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c095ff8a-dc1c-4605-b1d6-8c3833e44b47 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:28.051769 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c095ff8a-dc1c-4605-b1d6-8c3833e44b47 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:28.158475 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8e4c735d-ffa5-4068-a913-63c26360f8f3 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:28.174537 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8e4c735d-ffa5-4068-a913-63c26360f8f3 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666" status: 200 len: 1520 microversion: 2.1 time: 0.373180 Jun 10 18:12:28.178952 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2216/4302] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:27 2022] GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666 => generated 1520 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:28.188574 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d0312978-4a3e-46f7-8a55-3948af12ea14 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:28.189214 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d0312978-4a3e-46f7-8a55-3948af12ea14 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:28.194409 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:12:28.287943 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d0312978-4a3e-46f7-8a55-3948af12ea14 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:28.319225 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d0312978-4a3e-46f7-8a55-3948af12ea14 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e" status: 200 len: 1221 microversion: 2.1 time: 0.141609 Jun 10 18:12:28.321541 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2217/4303] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:28 2022] GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e => generated 1221 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:28.330466 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-23466211-f1f3-469c-b6e3-7a099a7ec43f tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1459325391"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:28.337092 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-23466211-f1f3-469c-b6e3-7a099a7ec43f tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 3a5ac7a5-efdb-4191-85ed-237a1d2f7666] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:28.352996 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-23466211-f1f3-469c-b6e3-7a099a7ec43f tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:28.359735 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-23466211-f1f3-469c-b6e3-7a099a7ec43f tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:28.361156 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-23466211-f1f3-469c-b6e3-7a099a7ec43f tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:28.362018 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-23466211-f1f3-469c-b6e3-7a099a7ec43f tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:28.417475 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c095ff8a-dc1c-4605-b1d6-8c3833e44b47 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2fe556bf10c4d69a86a325d60da6aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534acf4edf9247dea63a9387e0cd0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:28.431047 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c095ff8a-dc1c-4605-b1d6-8c3833e44b47 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] 10.222.0.35 "GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2" status: 200 len: 1273 microversion: 2.1 time: 0.440562 Jun 10 18:12:28.436467 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2087/4304] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:27 2022] GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2 => generated 1273 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:28.442753 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8dd0c0fa-cbe1-4416-ae18-f640ea63e9c0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:28.446932 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8dd0c0fa-cbe1-4416-ae18-f640ea63e9c0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: aff760b6-7b66-40e8-b266-dcfa79ca41b5] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:28.459798 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8dd0c0fa-cbe1-4416-ae18-f640ea63e9c0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:28.460610 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8dd0c0fa-cbe1-4416-ae18-f640ea63e9c0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:28.461679 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8dd0c0fa-cbe1-4416-ae18-f640ea63e9c0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:28.462420 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8dd0c0fa-cbe1-4416-ae18-f640ea63e9c0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:29.175566 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8dd0c0fa-cbe1-4416-ae18-f640ea63e9c0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:29.191339 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8dd0c0fa-cbe1-4416-ae18-f640ea63e9c0 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5" status: 200 len: 1315 microversion: 2.1 time: 0.753294 Jun 10 18:12:29.194227 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2088/4305] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:28 2022] GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5 => generated 1315 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:29.207781 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-89296513-5172-4bc1-9a7b-94a7a7262f39 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-625230243", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:29.347383 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-23466211-f1f3-469c-b6e3-7a099a7ec43f tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "POST /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666/action" status: 202 len: 0 microversion: 2.1 time: 1.024320 Jun 10 18:12:29.349366 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2218/4306] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:12:28 2022] POST /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666/action => generated 0 bytes in 1027 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 10 18:12:29.356932 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9c4f011b-7063-4954-9d62-8cd9cb6edbef tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:29.361881 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9c4f011b-7063-4954-9d62-8cd9cb6edbef tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:29.367015 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9c4f011b-7063-4954-9d62-8cd9cb6edbef tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:29.367798 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9c4f011b-7063-4954-9d62-8cd9cb6edbef tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:29.368926 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9c4f011b-7063-4954-9d62-8cd9cb6edbef tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:29.369628 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9c4f011b-7063-4954-9d62-8cd9cb6edbef tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:29.440533 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-89296513-5172-4bc1-9a7b-94a7a7262f39 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] validate_networks() for [('0b4456f3-4e1c-4005-adf5-626a892b6b68', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:12:29.996590 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9c4f011b-7063-4954-9d62-8cd9cb6edbef tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:29.996590 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9c4f011b-7063-4954-9d62-8cd9cb6edbef tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1512 microversion: 2.1 time: 0.415304 Jun 10 18:12:29.996590 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2219/4307] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:29 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1512 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:29.996590 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c0cbf894-e342-4d2d-9614-69c3a54a0860 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1021496022"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:29.996590 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c0cbf894-e342-4d2d-9614-69c3a54a0860 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 3a5ac7a5-efdb-4191-85ed-237a1d2f7666] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:29.996590 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c0cbf894-e342-4d2d-9614-69c3a54a0860 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:29.996590 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c0cbf894-e342-4d2d-9614-69c3a54a0860 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:29.996590 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c0cbf894-e342-4d2d-9614-69c3a54a0860 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:29.996590 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c0cbf894-e342-4d2d-9614-69c3a54a0860 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:29.996590 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-c0cbf894-e342-4d2d-9614-69c3a54a0860 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] HTTP exception thrown: Cannot 'createImage' instance 3a5ac7a5-efdb-4191-85ed-237a1d2f7666 while it is in task_state image_snapshot_pending Jun 10 18:12:29.996590 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c0cbf894-e342-4d2d-9614-69c3a54a0860 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Request method failure captured: Jun 10 18:12:29.996590 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666/action HTTP/1.1 Jun 10 18:12:29.996590 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:12:29.996590 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:12:29.996590 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:12:29.996590 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 85 Jun 10 18:12:29.996590 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:12:29.996590 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:12:29.996590 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:12:29.996590 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:12:29.996590 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4lsfzX-ZssLhBeRERA250Allr9sy5j_9WvmWWrmV8OKGfGLWtKo7IkZmvrlgadYYrKiCJiGv3V0W6WUpTPzvczOtcJBE7CxOiD9g_bSlYjPmyz5JBO2nqOTXPUSYGg7_D3Rbko1iq-cS8Cxtg3C-XqYzZtQdMv47S3ncw5oU530j6g Jun 10 18:12:29.996590 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:12:29.996590 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:12:29.996590 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:12:29.996590 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:12:29.996590 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:12:29.996590 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:12:29.996590 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: dc6ea0e4d347491eb23c3af053313211 Jun 10 18:12:29.996590 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-582167706 Jun 10 18:12:29.996590 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:12:29.996590 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/dc6ea0e4d347491eb23c3af053313211"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/dc6ea0e4d347491eb23c3af053313211"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/dc6ea0e4d347491eb23c3af053313211"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_dc6ea0e4d347491eb23c3af053313211", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-582167706 Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: dc6ea0e4d347491eb23c3af053313211 Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-582167706 Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ImagesOneServerNegativeTestJSON-582167706-project Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 8e6b5cd42b2144a69590680e5ef156fa Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-582167706-project Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1021496022"}} Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: exception: Cannot 'createImage' instance 3a5ac7a5-efdb-4191-85ed-237a1d2f7666 while it is in task_state image_snapshot_pending Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '3a5ac7a5-efdb-4191-85ed-237a1d2f7666', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1021496022'}}} Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3a5ac7a5-efdb-4191-85ed-237a1d2f7666 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 3a5ac7a5-efdb-4191-85ed-237a1d2f7666 while it is in task_state image_snapshot_pending Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 3a5ac7a5-efdb-4191-85ed-237a1d2f7666 while it is in task_state image_snapshot_pending Jun 10 18:12:30.004858 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:30.013882 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c0cbf894-e342-4d2d-9614-69c3a54a0860 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Returning 409 to user: Cannot 'createImage' instance 3a5ac7a5-efdb-4191-85ed-237a1d2f7666 while it is in task_state image_snapshot_pending {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:12:30.013882 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c0cbf894-e342-4d2d-9614-69c3a54a0860 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "POST /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666/action" status: 409 len: 167 microversion: 2.1 time: 0.064120 Jun 10 18:12:30.013882 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2220/4308] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:12:29 2022] POST /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666/action => generated 167 bytes in 71 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:12:30.013882 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a8b822cf-687e-485b-805b-ba836e3c4b39 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:30.013882 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a8b822cf-687e-485b-805b-ba836e3c4b39 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] [instance: 07a5fadb-9316-44c9-9c5e-c8f26050d4d2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:30.013882 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a8b822cf-687e-485b-805b-ba836e3c4b39 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:30.013882 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a8b822cf-687e-485b-805b-ba836e3c4b39 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:30.013882 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a8b822cf-687e-485b-805b-ba836e3c4b39 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:30.013882 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a8b822cf-687e-485b-805b-ba836e3c4b39 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:30.013882 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a8b822cf-687e-485b-805b-ba836e3c4b39 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2fe556bf10c4d69a86a325d60da6aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534acf4edf9247dea63a9387e0cd0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:30.013882 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a8b822cf-687e-485b-805b-ba836e3c4b39 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] 10.222.0.35 "GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2" status: 200 len: 1273 microversion: 2.1 time: 0.106767 Jun 10 18:12:30.013882 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2221/4309] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:29 2022] GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2 => generated 1273 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:30.013882 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b03804ab-7486-408d-b66d-7fda1c29ee18 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '.version_select at 0x7f77b3c24f70>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:30.648582 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-89296513-5172-4bc1-9a7b-94a7a7262f39 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:12:30.649387 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-89296513-5172-4bc1-9a7b-94a7a7262f39 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:12:30.649767 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-89296513-5172-4bc1-9a7b-94a7a7262f39 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:12:30.650187 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-89296513-5172-4bc1-9a7b-94a7a7262f39 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:12:30.650620 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-89296513-5172-4bc1-9a7b-94a7a7262f39 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:12:30.666535 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-89296513-5172-4bc1-9a7b-94a7a7262f39 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:30.667248 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-89296513-5172-4bc1-9a7b-94a7a7262f39 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:30.669573 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-89296513-5172-4bc1-9a7b-94a7a7262f39 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:30.670414 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-89296513-5172-4bc1-9a7b-94a7a7262f39 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:30.757040 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-89296513-5172-4bc1-9a7b-94a7a7262f39 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Getting quotas for project 2f3f65ee123043bb9c888cc5adffce37. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:12:30.772967 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-89296513-5172-4bc1-9a7b-94a7a7262f39 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Getting quotas for user 6aa40a915e4e43cd8d493dc593a73028 and project 2f3f65ee123043bb9c888cc5adffce37. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:12:30.795778 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-89296513-5172-4bc1-9a7b-94a7a7262f39 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:12:30.799171 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-89296513-5172-4bc1-9a7b-94a7a7262f39 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:12:30.871959 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b03804ab-7486-408d-b66d-7fda1c29ee18 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "DELETE /compute/v2.1/images/274bdbc9-ecc7-42e1-ba82-52839bc53bdc" status: 204 len: 0 microversion: 2.1 time: 0.886639 Jun 10 18:12:30.875658 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2222/4310] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:29 2022] DELETE /compute/v2.1/images/274bdbc9-ecc7-42e1-ba82-52839bc53bdc => generated 0 bytes in 889 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 18:12:30.885798 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6a04558d-c80a-49cb-91da-7e7244ab9358 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:30.887130 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6a04558d-c80a-49cb-91da-7e7244ab9358 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: aff760b6-7b66-40e8-b266-dcfa79ca41b5] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:30.908235 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6a04558d-c80a-49cb-91da-7e7244ab9358 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:30.909153 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6a04558d-c80a-49cb-91da-7e7244ab9358 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:30.911520 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6a04558d-c80a-49cb-91da-7e7244ab9358 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:30.913668 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6a04558d-c80a-49cb-91da-7e7244ab9358 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:31.005223 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-89296513-5172-4bc1-9a7b-94a7a7262f39 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.801243 Jun 10 18:12:31.012979 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2089/4311] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:12:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 1818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:12:31.047122 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-66b8ae7f-e90f-4980-a566-16be09a5ab82 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:31.047871 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-66b8ae7f-e90f-4980-a566-16be09a5ab82 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 3a5ac7a5-efdb-4191-85ed-237a1d2f7666] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:31.087888 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-66b8ae7f-e90f-4980-a566-16be09a5ab82 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:31.090401 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-66b8ae7f-e90f-4980-a566-16be09a5ab82 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:31.091481 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-66b8ae7f-e90f-4980-a566-16be09a5ab82 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:31.095531 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-66b8ae7f-e90f-4980-a566-16be09a5ab82 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:31.542165 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6a04558d-c80a-49cb-91da-7e7244ab9358 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:31.558361 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6a04558d-c80a-49cb-91da-7e7244ab9358 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5" status: 200 len: 1315 microversion: 2.1 time: 0.678010 Jun 10 18:12:31.559122 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2223/4312] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:30 2022] GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5 => generated 1315 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:31.581798 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6cc060e5-bcfb-4761-b5c1-07f07212349c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:31.583144 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6cc060e5-bcfb-4761-b5c1-07f07212349c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:31.592149 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6cc060e5-bcfb-4761-b5c1-07f07212349c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:31.593289 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6cc060e5-bcfb-4761-b5c1-07f07212349c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:31.596452 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6cc060e5-bcfb-4761-b5c1-07f07212349c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:31.597310 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6cc060e5-bcfb-4761-b5c1-07f07212349c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:31.782064 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6cc060e5-bcfb-4761-b5c1-07f07212349c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:31.793306 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6cc060e5-bcfb-4761-b5c1-07f07212349c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1533 microversion: 2.1 time: 0.232149 Jun 10 18:12:31.805367 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2224/4313] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:31 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1533 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:31.807050 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d94f7f39-c6a3-40eb-8654-9f16206da6a1 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:31.807685 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d94f7f39-c6a3-40eb-8654-9f16206da6a1 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] [instance: 07a5fadb-9316-44c9-9c5e-c8f26050d4d2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:31.814080 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d94f7f39-c6a3-40eb-8654-9f16206da6a1 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:31.814782 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d94f7f39-c6a3-40eb-8654-9f16206da6a1 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:31.816450 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d94f7f39-c6a3-40eb-8654-9f16206da6a1 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:31.816450 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d94f7f39-c6a3-40eb-8654-9f16206da6a1 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:32.059135 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d94f7f39-c6a3-40eb-8654-9f16206da6a1 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2fe556bf10c4d69a86a325d60da6aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534acf4edf9247dea63a9387e0cd0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:32.067607 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d94f7f39-c6a3-40eb-8654-9f16206da6a1 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] 10.222.0.35 "GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2" status: 200 len: 1315 microversion: 2.1 time: 0.265649 Jun 10 18:12:32.069589 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2225/4314] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:31 2022] GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2 => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:32.076015 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-657fd607-52e2-4996-bfe2-f5879180f40e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:32.076967 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-657fd607-52e2-4996-bfe2-f5879180f40e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:32.157239 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-657fd607-52e2-4996-bfe2-f5879180f40e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:32.173869 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-657fd607-52e2-4996-bfe2-f5879180f40e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca" status: 200 len: 1221 microversion: 2.1 time: 0.095289 Jun 10 18:12:32.173869 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2226/4315] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:32 2022] GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca => generated 1221 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:32.177185 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-66b8ae7f-e90f-4980-a566-16be09a5ab82 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:32.194203 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-66b8ae7f-e90f-4980-a566-16be09a5ab82 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666" status: 200 len: 1532 microversion: 2.1 time: 1.174759 Jun 10 18:12:32.195901 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2090/4316] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:31 2022] GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666 => generated 1532 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:32.578166 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0bf41bd5-22d9-47b3-af6a-b3d5e1664d4f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:32.578806 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0bf41bd5-22d9-47b3-af6a-b3d5e1664d4f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: aff760b6-7b66-40e8-b266-dcfa79ca41b5] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:32.601052 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0bf41bd5-22d9-47b3-af6a-b3d5e1664d4f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:32.601824 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0bf41bd5-22d9-47b3-af6a-b3d5e1664d4f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:32.602845 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0bf41bd5-22d9-47b3-af6a-b3d5e1664d4f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:32.603568 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0bf41bd5-22d9-47b3-af6a-b3d5e1664d4f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:32.812979 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b6312782-02e6-4f82-af69-ee1fc76181e2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:32.813981 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b6312782-02e6-4f82-af69-ee1fc76181e2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:32.823130 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0bf41bd5-22d9-47b3-af6a-b3d5e1664d4f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:32.823679 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b6312782-02e6-4f82-af69-ee1fc76181e2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:32.824464 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b6312782-02e6-4f82-af69-ee1fc76181e2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:32.825758 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b6312782-02e6-4f82-af69-ee1fc76181e2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:32.826564 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b6312782-02e6-4f82-af69-ee1fc76181e2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:32.832657 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0bf41bd5-22d9-47b3-af6a-b3d5e1664d4f tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5" status: 200 len: 1315 microversion: 2.1 time: 0.260695 Jun 10 18:12:32.838292 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2227/4317] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:32 2022] GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:33.086644 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-46c57321-740e-4504-be59-415ce9e4d8bc tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:33.088021 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-46c57321-740e-4504-be59-415ce9e4d8bc tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] [instance: 07a5fadb-9316-44c9-9c5e-c8f26050d4d2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:33.095209 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-46c57321-740e-4504-be59-415ce9e4d8bc tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:33.095908 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-46c57321-740e-4504-be59-415ce9e4d8bc tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:33.097824 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-46c57321-740e-4504-be59-415ce9e4d8bc tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:33.097824 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-46c57321-740e-4504-be59-415ce9e4d8bc tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:33.215640 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b6312782-02e6-4f82-af69-ee1fc76181e2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:33.228904 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b6312782-02e6-4f82-af69-ee1fc76181e2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1533 microversion: 2.1 time: 0.420326 Jun 10 18:12:33.229831 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2091/4318] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:32 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1533 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:12:33.234482 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7d7378a8-34a2-4589-9b9b-083303e02031 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:33.235017 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7d7378a8-34a2-4589-9b9b-083303e02031 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:33.246711 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7d7378a8-34a2-4589-9b9b-083303e02031 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:33.253203 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7d7378a8-34a2-4589-9b9b-083303e02031 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:33.253203 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7d7378a8-34a2-4589-9b9b-083303e02031 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:33.253203 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7d7378a8-34a2-4589-9b9b-083303e02031 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:33.335204 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-46c57321-740e-4504-be59-415ce9e4d8bc tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2fe556bf10c4d69a86a325d60da6aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534acf4edf9247dea63a9387e0cd0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:33.345549 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-46c57321-740e-4504-be59-415ce9e4d8bc tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] 10.222.0.35 "GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2" status: 200 len: 1315 microversion: 2.1 time: 0.262768 Jun 10 18:12:33.358638 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2228/4319] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:33 2022] GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2 => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:12:33.363332 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-375130e1-85aa-4b37-bb3f-8b90ca740c6a tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:33.363998 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-375130e1-85aa-4b37-bb3f-8b90ca740c6a tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 3a5ac7a5-efdb-4191-85ed-237a1d2f7666] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:33.371945 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-375130e1-85aa-4b37-bb3f-8b90ca740c6a tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:33.372476 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-375130e1-85aa-4b37-bb3f-8b90ca740c6a tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:33.373264 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-375130e1-85aa-4b37-bb3f-8b90ca740c6a tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:33.373779 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-375130e1-85aa-4b37-bb3f-8b90ca740c6a tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:33.402303 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:12:33.493092 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7d7378a8-34a2-4589-9b9b-083303e02031 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:33.507438 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7d7378a8-34a2-4589-9b9b-083303e02031 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca" status: 200 len: 1273 microversion: 2.1 time: 0.274337 Jun 10 18:12:33.508081 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2092/4320] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:33 2022] GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca => generated 1273 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:33.610710 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-375130e1-85aa-4b37-bb3f-8b90ca740c6a tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:33.630067 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-375130e1-85aa-4b37-bb3f-8b90ca740c6a tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666" status: 200 len: 1538 microversion: 2.1 time: 0.278144 Jun 10 18:12:33.643326 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2229/4321] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:33 2022] GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666 => generated 1538 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:33.856964 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-be1355bd-f5b0-48de-a3e2-d8152ad28026 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:33.857518 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-be1355bd-f5b0-48de-a3e2-d8152ad28026 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: aff760b6-7b66-40e8-b266-dcfa79ca41b5] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:33.867056 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-be1355bd-f5b0-48de-a3e2-d8152ad28026 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:33.869658 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-be1355bd-f5b0-48de-a3e2-d8152ad28026 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:33.872205 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-be1355bd-f5b0-48de-a3e2-d8152ad28026 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:33.878999 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-be1355bd-f5b0-48de-a3e2-d8152ad28026 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:34.251449 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d375d84a-5f83-44f2-bd06-2ec46aa328e5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:34.252223 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d375d84a-5f83-44f2-bd06-2ec46aa328e5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:34.276133 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d375d84a-5f83-44f2-bd06-2ec46aa328e5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:34.284432 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d375d84a-5f83-44f2-bd06-2ec46aa328e5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:34.286946 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d375d84a-5f83-44f2-bd06-2ec46aa328e5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:34.290596 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d375d84a-5f83-44f2-bd06-2ec46aa328e5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:35.122489 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-be1355bd-f5b0-48de-a3e2-d8152ad28026 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:35.127661 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:12:35.137504 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-be1355bd-f5b0-48de-a3e2-d8152ad28026 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5" status: 200 len: 1315 microversion: 2.1 time: 1.283963 Jun 10 18:12:35.140333 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2093/4322] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:33 2022] GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5 => generated 1315 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:35.163152 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d375d84a-5f83-44f2-bd06-2ec46aa328e5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:35.172902 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d375d84a-5f83-44f2-bd06-2ec46aa328e5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1528 microversion: 2.1 time: 0.929467 Jun 10 18:12:35.174306 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2230/4323] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:34 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1528 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:35.189388 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-68936fc2-984e-498e-87d5-070f89d8970b req-d1982e22-e018-4284-957c-88084ce00ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07a5fadb-9316-44c9-9c5e-c8f26050d4d2", "tag": "4e6d3802-ba65-4c7d-a7e9-c731019ecea3"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:35.215272 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-68936fc2-984e-498e-87d5-070f89d8970b req-d1982e22-e018-4284-957c-88084ce00ec1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:35.215843 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-68936fc2-984e-498e-87d5-070f89d8970b req-d1982e22-e018-4284-957c-88084ce00ec1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:35.223340 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-58734100-d8d3-4b91-8b89-380386e3af75 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:35.223990 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-58734100-d8d3-4b91-8b89-380386e3af75 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] [instance: 07a5fadb-9316-44c9-9c5e-c8f26050d4d2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:35.237985 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-68936fc2-984e-498e-87d5-070f89d8970b req-d1982e22-e018-4284-957c-88084ce00ec1 service nova] Creating event network-changed:4e6d3802-ba65-4c7d-a7e9-c731019ecea3 for instance 07a5fadb-9316-44c9-9c5e-c8f26050d4d2 on chh2-master-2 Jun 10 18:12:35.256813 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-68936fc2-984e-498e-87d5-070f89d8970b req-d1982e22-e018-4284-957c-88084ce00ec1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081028 Jun 10 18:12:35.257490 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2231/4324] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:12:35.269668 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ea48c6c8-1442-470d-84cc-6a4031fb5857 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:35.272549 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ea48c6c8-1442-470d-84cc-6a4031fb5857 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:35.280715 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-58734100-d8d3-4b91-8b89-380386e3af75 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:35.281272 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-58734100-d8d3-4b91-8b89-380386e3af75 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:35.287909 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ea48c6c8-1442-470d-84cc-6a4031fb5857 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:35.292380 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ea48c6c8-1442-470d-84cc-6a4031fb5857 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:35.294555 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-58734100-d8d3-4b91-8b89-380386e3af75 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:35.295037 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-58734100-d8d3-4b91-8b89-380386e3af75 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:35.298456 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ea48c6c8-1442-470d-84cc-6a4031fb5857 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:35.299119 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ea48c6c8-1442-470d-84cc-6a4031fb5857 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:35.555020 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ea48c6c8-1442-470d-84cc-6a4031fb5857 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:35.564768 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ea48c6c8-1442-470d-84cc-6a4031fb5857 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca" status: 200 len: 1279 microversion: 2.1 time: 0.305149 Jun 10 18:12:35.565513 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2232/4325] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:35 2022] GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca => generated 1279 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:35.586625 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8cfd6ee9-cae9-4394-9883-635e4ae03300 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:35.587316 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8cfd6ee9-cae9-4394-9883-635e4ae03300 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 3a5ac7a5-efdb-4191-85ed-237a1d2f7666] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:35.613250 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8cfd6ee9-cae9-4394-9883-635e4ae03300 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:35.613722 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8cfd6ee9-cae9-4394-9883-635e4ae03300 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:35.614525 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8cfd6ee9-cae9-4394-9883-635e4ae03300 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:35.615008 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8cfd6ee9-cae9-4394-9883-635e4ae03300 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:35.989098 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-58734100-d8d3-4b91-8b89-380386e3af75 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2fe556bf10c4d69a86a325d60da6aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534acf4edf9247dea63a9387e0cd0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:35.998444 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-58734100-d8d3-4b91-8b89-380386e3af75 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] 10.222.0.35 "GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2" status: 200 len: 1315 microversion: 2.1 time: 0.856300 Jun 10 18:12:35.999040 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2094/4326] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:35 2022] GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2 => generated 1315 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:36.035733 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8cfd6ee9-cae9-4394-9883-635e4ae03300 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:36.055884 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8cfd6ee9-cae9-4394-9883-635e4ae03300 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666" status: 200 len: 1520 microversion: 2.1 time: 0.485201 Jun 10 18:12:36.060087 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2233/4327] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:35 2022] GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666 => generated 1520 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:36.081816 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e8d40cd8-fc75-4ade-96ef-8b6e03cd80a8 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:36.086039 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e8d40cd8-fc75-4ade-96ef-8b6e03cd80a8 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 3a5ac7a5-efdb-4191-85ed-237a1d2f7666] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:36.105655 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e8d40cd8-fc75-4ade-96ef-8b6e03cd80a8 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:36.114260 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e8d40cd8-fc75-4ade-96ef-8b6e03cd80a8 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:36.119979 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e8d40cd8-fc75-4ade-96ef-8b6e03cd80a8 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:36.122427 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e8d40cd8-fc75-4ade-96ef-8b6e03cd80a8 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:36.156053 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-be9b7acd-856b-4879-bdfc-20188e0b9793 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:36.157180 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-be9b7acd-856b-4879-bdfc-20188e0b9793 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: aff760b6-7b66-40e8-b266-dcfa79ca41b5] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:36.176978 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be9b7acd-856b-4879-bdfc-20188e0b9793 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:36.182204 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be9b7acd-856b-4879-bdfc-20188e0b9793 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:36.189944 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be9b7acd-856b-4879-bdfc-20188e0b9793 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:36.191203 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be9b7acd-856b-4879-bdfc-20188e0b9793 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:36.277094 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e8d40cd8-fc75-4ade-96ef-8b6e03cd80a8 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 3a5ac7a5-efdb-4191-85ed-237a1d2f7666] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:12:36.617782 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-be9b7acd-856b-4879-bdfc-20188e0b9793 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:36.626952 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-be9b7acd-856b-4879-bdfc-20188e0b9793 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5" status: 200 len: 1315 microversion: 2.1 time: 0.475676 Jun 10 18:12:36.639595 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2234/4328] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:36 2022] GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5 => generated 1315 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:36.667883 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c96e6532-abd9-4c1b-bd18-3c93195d88f6 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:36.672740 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c96e6532-abd9-4c1b-bd18-3c93195d88f6 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:36.702558 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c96e6532-abd9-4c1b-bd18-3c93195d88f6 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:36.710309 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c96e6532-abd9-4c1b-bd18-3c93195d88f6 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:36.714293 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c96e6532-abd9-4c1b-bd18-3c93195d88f6 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:36.718577 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c96e6532-abd9-4c1b-bd18-3c93195d88f6 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:36.745425 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e8d40cd8-fc75-4ade-96ef-8b6e03cd80a8 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "DELETE /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666" status: 204 len: 0 microversion: 2.1 time: 0.672628 Jun 10 18:12:36.747161 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2095/4329] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:12:36 2022] DELETE /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:12:36.752898 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6874728c-092b-40e3-a2f9-a7426f288943 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:36.755622 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6874728c-092b-40e3-a2f9-a7426f288943 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:36.771859 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6874728c-092b-40e3-a2f9-a7426f288943 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:36.774588 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6874728c-092b-40e3-a2f9-a7426f288943 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:36.775823 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6874728c-092b-40e3-a2f9-a7426f288943 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:36.776986 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6874728c-092b-40e3-a2f9-a7426f288943 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:37.370405 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c96e6532-abd9-4c1b-bd18-3c93195d88f6 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:37.382229 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c96e6532-abd9-4c1b-bd18-3c93195d88f6 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1528 microversion: 2.1 time: 0.741079 Jun 10 18:12:37.388825 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2235/4330] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:36 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1528 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:37.408367 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6f1b1bce-b4d0-4049-b4ad-da4ead29c310 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:37.411503 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6f1b1bce-b4d0-4049-b4ad-da4ead29c310 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 3a5ac7a5-efdb-4191-85ed-237a1d2f7666] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:37.435298 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6f1b1bce-b4d0-4049-b4ad-da4ead29c310 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:37.438819 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6f1b1bce-b4d0-4049-b4ad-da4ead29c310 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:37.439991 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6f1b1bce-b4d0-4049-b4ad-da4ead29c310 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:37.442520 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6f1b1bce-b4d0-4049-b4ad-da4ead29c310 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:37.577209 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:12:37.679869 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6874728c-092b-40e3-a2f9-a7426f288943 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:37.679869 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6874728c-092b-40e3-a2f9-a7426f288943 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca" status: 200 len: 1321 microversion: 2.1 time: 0.910352 Jun 10 18:12:37.679869 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2096/4331] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:36 2022] GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca => generated 1321 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:37.680687 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fa9e5cc3-5a51-435c-8e43-b26224ca9c61 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:37.681204 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fa9e5cc3-5a51-435c-8e43-b26224ca9c61 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] [instance: 07a5fadb-9316-44c9-9c5e-c8f26050d4d2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:37.690067 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa9e5cc3-5a51-435c-8e43-b26224ca9c61 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:37.690531 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa9e5cc3-5a51-435c-8e43-b26224ca9c61 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:37.691314 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa9e5cc3-5a51-435c-8e43-b26224ca9c61 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:37.691976 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa9e5cc3-5a51-435c-8e43-b26224ca9c61 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:37.916198 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6f1b1bce-b4d0-4049-b4ad-da4ead29c310 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:37.916198 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6f1b1bce-b4d0-4049-b4ad-da4ead29c310 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666" status: 200 len: 1526 microversion: 2.1 time: 0.494865 Jun 10 18:12:37.916198 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2236/4332] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:37 2022] GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666 => generated 1526 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:37.916198 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7c611855-fc72-4710-9d81-64079943d3bf tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:37.916198 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7c611855-fc72-4710-9d81-64079943d3bf tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: aff760b6-7b66-40e8-b266-dcfa79ca41b5] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:37.925941 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7c611855-fc72-4710-9d81-64079943d3bf tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:37.935210 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7c611855-fc72-4710-9d81-64079943d3bf tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:37.936240 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7c611855-fc72-4710-9d81-64079943d3bf tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:37.936786 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7c611855-fc72-4710-9d81-64079943d3bf tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:37.981469 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fa9e5cc3-5a51-435c-8e43-b26224ca9c61 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2fe556bf10c4d69a86a325d60da6aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534acf4edf9247dea63a9387e0cd0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:37.991259 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fa9e5cc3-5a51-435c-8e43-b26224ca9c61 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] 10.222.0.35 "GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2" status: 200 len: 1315 microversion: 2.1 time: 0.318709 Jun 10 18:12:37.993168 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2097/4333] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:37 2022] GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2 => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:38.195198 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7c611855-fc72-4710-9d81-64079943d3bf tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:38.204929 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7c611855-fc72-4710-9d81-64079943d3bf tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5" status: 200 len: 1315 microversion: 2.1 time: 0.316670 Jun 10 18:12:38.205705 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2237/4334] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:37 2022] GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5 => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:38.424627 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8ccf6488-1134-4723-89e0-661c99dc1ab3 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:38.431970 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-050e4169-c7a3-46ff-bd8f-8688e8b41560 req-9732f5a0-5ce9-4be9-8bff-3f3f26ca6b08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e", "tag": "bd1f8f99-545c-4e7b-89b2-c24069d1acc2"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:38.435370 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8ccf6488-1134-4723-89e0-661c99dc1ab3 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:38.456592 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8ccf6488-1134-4723-89e0-661c99dc1ab3 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:38.463609 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-050e4169-c7a3-46ff-bd8f-8688e8b41560 req-9732f5a0-5ce9-4be9-8bff-3f3f26ca6b08 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:38.469653 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8ccf6488-1134-4723-89e0-661c99dc1ab3 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:38.471870 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-050e4169-c7a3-46ff-bd8f-8688e8b41560 req-9732f5a0-5ce9-4be9-8bff-3f3f26ca6b08 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:38.473584 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8ccf6488-1134-4723-89e0-661c99dc1ab3 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:38.482543 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8ccf6488-1134-4723-89e0-661c99dc1ab3 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:38.586654 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-050e4169-c7a3-46ff-bd8f-8688e8b41560 req-9732f5a0-5ce9-4be9-8bff-3f3f26ca6b08 service nova] Creating event network-changed:bd1f8f99-545c-4e7b-89b2-c24069d1acc2 for instance b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e on chh1-master-2 Jun 10 18:12:38.614401 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-050e4169-c7a3-46ff-bd8f-8688e8b41560 req-9732f5a0-5ce9-4be9-8bff-3f3f26ca6b08 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186921 Jun 10 18:12:38.623846 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2238/4335] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:12:38.676731 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d0706a1e-0308-4ced-9b49-e88b31640441 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:38.677719 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d0706a1e-0308-4ced-9b49-e88b31640441 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:38.697920 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d0706a1e-0308-4ced-9b49-e88b31640441 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:38.716012 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d0706a1e-0308-4ced-9b49-e88b31640441 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:38.719511 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d0706a1e-0308-4ced-9b49-e88b31640441 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:38.736793 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d0706a1e-0308-4ced-9b49-e88b31640441 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:39.274633 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d0706a1e-0308-4ced-9b49-e88b31640441 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:39.283508 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d0706a1e-0308-4ced-9b49-e88b31640441 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca" status: 200 len: 1321 microversion: 2.1 time: 0.612188 Jun 10 18:12:39.288510 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2239/4336] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:38 2022] GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca => generated 1321 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:12:39.312032 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-85c3c224-4ad9-43be-ba0b-3c856ec8d985 req-23bbf733-76a2-444d-82ea-646c1122cef1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aff760b6-7b66-40e8-b266-dcfa79ca41b5", "name": "network-vif-plugged", "status": "completed", "tag": "bfa33665-db46-494c-8f4a-886c29dba2fb"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:39.363275 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-85c3c224-4ad9-43be-ba0b-3c856ec8d985 req-23bbf733-76a2-444d-82ea-646c1122cef1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:39.363865 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-85c3c224-4ad9-43be-ba0b-3c856ec8d985 req-23bbf733-76a2-444d-82ea-646c1122cef1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:39.411174 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-85c3c224-4ad9-43be-ba0b-3c856ec8d985 req-23bbf733-76a2-444d-82ea-646c1122cef1 service nova] Creating event network-vif-plugged:bfa33665-db46-494c-8f4a-886c29dba2fb for instance aff760b6-7b66-40e8-b266-dcfa79ca41b5 on chh2-master-2 Jun 10 18:12:39.459616 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-85c3c224-4ad9-43be-ba0b-3c856ec8d985 req-23bbf733-76a2-444d-82ea-646c1122cef1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166389 Jun 10 18:12:39.462191 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8ccf6488-1134-4723-89e0-661c99dc1ab3 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:39.468420 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2240/4337] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:12:39.470314 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8ccf6488-1134-4723-89e0-661c99dc1ab3 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1528 microversion: 2.1 time: 1.064396 Jun 10 18:12:39.473850 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7933a918-f1e7-42f9-a582-c1176eb80a2c tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:39.481538 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2098/4338] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:38 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1528 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:39.499302 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a059e767-36b2-44fd-8d96-f6a4a4fa44df tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:39.501197 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a059e767-36b2-44fd-8d96-f6a4a4fa44df tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] [instance: 07a5fadb-9316-44c9-9c5e-c8f26050d4d2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:39.506920 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7933a918-f1e7-42f9-a582-c1176eb80a2c tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 3a5ac7a5-efdb-4191-85ed-237a1d2f7666] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:39.509178 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a059e767-36b2-44fd-8d96-f6a4a4fa44df tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:39.509895 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a059e767-36b2-44fd-8d96-f6a4a4fa44df tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:39.510913 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a059e767-36b2-44fd-8d96-f6a4a4fa44df tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:39.511601 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a059e767-36b2-44fd-8d96-f6a4a4fa44df tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:39.526853 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7933a918-f1e7-42f9-a582-c1176eb80a2c tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:39.527314 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7933a918-f1e7-42f9-a582-c1176eb80a2c tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:39.528108 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7933a918-f1e7-42f9-a582-c1176eb80a2c tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:39.528585 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7933a918-f1e7-42f9-a582-c1176eb80a2c tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:40.219604 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a059e767-36b2-44fd-8d96-f6a4a4fa44df tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2fe556bf10c4d69a86a325d60da6aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534acf4edf9247dea63a9387e0cd0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:40.228881 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a059e767-36b2-44fd-8d96-f6a4a4fa44df tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] 10.222.0.35 "GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2" status: 200 len: 1315 microversion: 2.1 time: 0.745831 Jun 10 18:12:40.231373 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2099/4339] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:39 2022] GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2 => generated 1315 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:40.243534 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4a0813e7-1f86-4a8c-a96e-1335be926f3c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:40.245132 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4a0813e7-1f86-4a8c-a96e-1335be926f3c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: aff760b6-7b66-40e8-b266-dcfa79ca41b5] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:40.265011 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a0813e7-1f86-4a8c-a96e-1335be926f3c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:40.265808 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a0813e7-1f86-4a8c-a96e-1335be926f3c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:40.268872 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a0813e7-1f86-4a8c-a96e-1335be926f3c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:40.269655 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a0813e7-1f86-4a8c-a96e-1335be926f3c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:40.459405 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7933a918-f1e7-42f9-a582-c1176eb80a2c tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:40.469703 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7933a918-f1e7-42f9-a582-c1176eb80a2c tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666" status: 200 len: 1526 microversion: 2.1 time: 0.997746 Jun 10 18:12:40.481393 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2241/4340] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:39 2022] GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666 => generated 1526 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:40.491532 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-bec20b46-2233-4922-a167-25d50347bfd4 req-51ed7ba3-ebac-44a4-b9db-4f0f0bbf96e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ffbc900-46ac-470d-9773-9b0118c6dbca", "tag": "7ddef814-3da5-4e0c-97c5-f653e35b3352"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:40.513951 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-bec20b46-2233-4922-a167-25d50347bfd4 req-51ed7ba3-ebac-44a4-b9db-4f0f0bbf96e5 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:40.514728 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-bec20b46-2233-4922-a167-25d50347bfd4 req-51ed7ba3-ebac-44a4-b9db-4f0f0bbf96e5 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:40.531039 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-bec20b46-2233-4922-a167-25d50347bfd4 req-51ed7ba3-ebac-44a4-b9db-4f0f0bbf96e5 service nova] Creating event network-changed:7ddef814-3da5-4e0c-97c5-f653e35b3352 for instance 3ffbc900-46ac-470d-9773-9b0118c6dbca on chh1-master-2 Jun 10 18:12:40.554495 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-bec20b46-2233-4922-a167-25d50347bfd4 req-51ed7ba3-ebac-44a4-b9db-4f0f0bbf96e5 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071697 Jun 10 18:12:40.556988 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2242/4341] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:12:40.564467 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-603eee90-51f7-4d6b-881a-8e6584a16bf4 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:40.565441 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-603eee90-51f7-4d6b-881a-8e6584a16bf4 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:40.576004 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-603eee90-51f7-4d6b-881a-8e6584a16bf4 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:40.576004 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-603eee90-51f7-4d6b-881a-8e6584a16bf4 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:40.576004 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-603eee90-51f7-4d6b-881a-8e6584a16bf4 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:40.576004 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-603eee90-51f7-4d6b-881a-8e6584a16bf4 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:40.706282 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=6 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:12:40.789824 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=24 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:12:41.012626 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-603eee90-51f7-4d6b-881a-8e6584a16bf4 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:41.037018 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-603eee90-51f7-4d6b-881a-8e6584a16bf4 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca" status: 200 len: 1321 microversion: 2.1 time: 0.474473 Jun 10 18:12:41.037987 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2243/4342] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:40 2022] GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca => generated 1321 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:41.051989 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-512d6e69-62ba-4d02-8c9d-2b041e926ad9 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:41.052959 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-512d6e69-62ba-4d02-8c9d-2b041e926ad9 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:41.070341 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-512d6e69-62ba-4d02-8c9d-2b041e926ad9 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:41.073212 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-512d6e69-62ba-4d02-8c9d-2b041e926ad9 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:41.074363 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-512d6e69-62ba-4d02-8c9d-2b041e926ad9 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:41.076975 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-512d6e69-62ba-4d02-8c9d-2b041e926ad9 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:41.441229 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-512d6e69-62ba-4d02-8c9d-2b041e926ad9 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:41.459489 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-512d6e69-62ba-4d02-8c9d-2b041e926ad9 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1528 microversion: 2.1 time: 0.417515 Jun 10 18:12:41.460514 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2244/4343] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:41 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1528 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:41.471362 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-05048330-882b-4169-9b1b-069c60637434 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:41.475855 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-05048330-882b-4169-9b1b-069c60637434 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] [instance: 07a5fadb-9316-44c9-9c5e-c8f26050d4d2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:41.493646 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-05048330-882b-4169-9b1b-069c60637434 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:41.494598 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-05048330-882b-4169-9b1b-069c60637434 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:41.502637 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-05048330-882b-4169-9b1b-069c60637434 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:41.502637 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-05048330-882b-4169-9b1b-069c60637434 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:41.795975 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4a0813e7-1f86-4a8c-a96e-1335be926f3c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:41.810983 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-05048330-882b-4169-9b1b-069c60637434 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2fe556bf10c4d69a86a325d60da6aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534acf4edf9247dea63a9387e0cd0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:41.823901 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-05048330-882b-4169-9b1b-069c60637434 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] 10.222.0.35 "GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2" status: 200 len: 1315 microversion: 2.1 time: 0.359902 Jun 10 18:12:41.825271 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2245/4344] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:41 2022] GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2 => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:41.828681 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4a0813e7-1f86-4a8c-a96e-1335be926f3c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5" status: 200 len: 1315 microversion: 2.1 time: 1.580403 Jun 10 18:12:41.829405 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2100/4345] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:40 2022] GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5 => generated 1315 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:41.846639 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6502f8d6-d5a6-4c01-b178-970a9d49cfe2 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:41.847535 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6502f8d6-d5a6-4c01-b178-970a9d49cfe2 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 3a5ac7a5-efdb-4191-85ed-237a1d2f7666] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:41.850973 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-b6a4417b-ba4e-4ccf-b3c0-af8637ed9bd0 req-f3b1a610-51b0-49b6-9937-5c72a5bd92af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57a377b2-f75e-4a0c-8401-090db42db644", "name": "network-vif-plugged", "status": "completed", "tag": "ea23750f-0e21-482f-b68f-6361eeb3c636"}, {"server_uuid": "3a5ac7a5-efdb-4191-85ed-237a1d2f7666", "name": "network-vif-plugged", "status": "completed", "tag": "15f0ae4c-fe9e-4811-a8ca-da49e03476bd"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:41.861334 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6502f8d6-d5a6-4c01-b178-970a9d49cfe2 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:41.862214 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6502f8d6-d5a6-4c01-b178-970a9d49cfe2 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:41.863626 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6502f8d6-d5a6-4c01-b178-970a9d49cfe2 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:41.865058 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6502f8d6-d5a6-4c01-b178-970a9d49cfe2 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:41.873004 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-b6a4417b-ba4e-4ccf-b3c0-af8637ed9bd0 req-f3b1a610-51b0-49b6-9937-5c72a5bd92af service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:41.876488 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-b6a4417b-ba4e-4ccf-b3c0-af8637ed9bd0 req-f3b1a610-51b0-49b6-9937-5c72a5bd92af service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:41.907370 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-b6a4417b-ba4e-4ccf-b3c0-af8637ed9bd0 req-f3b1a610-51b0-49b6-9937-5c72a5bd92af service nova] Creating event network-vif-plugged:ea23750f-0e21-482f-b68f-6361eeb3c636 for instance 57a377b2-f75e-4a0c-8401-090db42db644 on chh1-master-2 Jun 10 18:12:41.908660 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-b6a4417b-ba4e-4ccf-b3c0-af8637ed9bd0 req-f3b1a610-51b0-49b6-9937-5c72a5bd92af service nova] Creating event network-vif-plugged:15f0ae4c-fe9e-4811-a8ca-da49e03476bd for instance 3a5ac7a5-efdb-4191-85ed-237a1d2f7666 on chh1-master-2 Jun 10 18:12:41.927491 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-b6a4417b-ba4e-4ccf-b3c0-af8637ed9bd0 req-f3b1a610-51b0-49b6-9937-5c72a5bd92af service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.096800 Jun 10 18:12:41.928426 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2101/4346] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:12:41.941306 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-ed9f668b-d24b-4b50-9caa-f65193808f32 req-e3e7d2d5-8c75-42e6-94e2-559200c58d7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a5ac7a5-efdb-4191-85ed-237a1d2f7666", "name": "network-vif-deleted", "tag": "15f0ae4c-fe9e-4811-a8ca-da49e03476bd"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:41.965862 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-ed9f668b-d24b-4b50-9caa-f65193808f32 req-e3e7d2d5-8c75-42e6-94e2-559200c58d7b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:41.966318 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-ed9f668b-d24b-4b50-9caa-f65193808f32 req-e3e7d2d5-8c75-42e6-94e2-559200c58d7b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:41.991404 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6502f8d6-d5a6-4c01-b178-970a9d49cfe2 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:42.000801 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-ed9f668b-d24b-4b50-9caa-f65193808f32 req-e3e7d2d5-8c75-42e6-94e2-559200c58d7b service nova] Creating event network-vif-deleted:15f0ae4c-fe9e-4811-a8ca-da49e03476bd for instance 3a5ac7a5-efdb-4191-85ed-237a1d2f7666 on chh1-master-2 Jun 10 18:12:42.005539 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6502f8d6-d5a6-4c01-b178-970a9d49cfe2 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666" status: 200 len: 1484 microversion: 2.1 time: 0.178452 Jun 10 18:12:42.009648 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2246/4347] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:41 2022] GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666 => generated 1484 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:42.011880 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-ed9f668b-d24b-4b50-9caa-f65193808f32 req-e3e7d2d5-8c75-42e6-94e2-559200c58d7b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080974 Jun 10 18:12:42.012519 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2102/4348] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:12:42.056545 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-456319bb-0e05-4abb-abd3-e9f05e4b75ba tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:42.057527 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-456319bb-0e05-4abb-abd3-e9f05e4b75ba tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:42.075490 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-456319bb-0e05-4abb-abd3-e9f05e4b75ba tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:42.075943 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-456319bb-0e05-4abb-abd3-e9f05e4b75ba tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:42.076847 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-456319bb-0e05-4abb-abd3-e9f05e4b75ba tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:42.077367 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-456319bb-0e05-4abb-abd3-e9f05e4b75ba tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:42.165985 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=10 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:12:42.355768 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-456319bb-0e05-4abb-abd3-e9f05e4b75ba tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:42.364834 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-456319bb-0e05-4abb-abd3-e9f05e4b75ba tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca" status: 200 len: 1321 microversion: 2.1 time: 0.313664 Jun 10 18:12:42.371851 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2247/4349] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:42 2022] GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca => generated 1321 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:42.479490 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ab799c4a-c2c0-4608-bc21-f1e713154b07 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:42.481108 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ab799c4a-c2c0-4608-bc21-f1e713154b07 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:42.521640 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ab799c4a-c2c0-4608-bc21-f1e713154b07 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:42.523070 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ab799c4a-c2c0-4608-bc21-f1e713154b07 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:42.525220 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ab799c4a-c2c0-4608-bc21-f1e713154b07 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:42.525842 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ab799c4a-c2c0-4608-bc21-f1e713154b07 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:42.877079 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-86d34315-5b1f-4784-a3e4-117921576967 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:42.877079 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-86d34315-5b1f-4784-a3e4-117921576967 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: aff760b6-7b66-40e8-b266-dcfa79ca41b5] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:42.877079 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-86d34315-5b1f-4784-a3e4-117921576967 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:42.877079 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-86d34315-5b1f-4784-a3e4-117921576967 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:42.884264 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-86d34315-5b1f-4784-a3e4-117921576967 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:42.884900 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-86d34315-5b1f-4784-a3e4-117921576967 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:43.169377 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ab799c4a-c2c0-4608-bc21-f1e713154b07 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:43.178854 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ab799c4a-c2c0-4608-bc21-f1e713154b07 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1528 microversion: 2.1 time: 0.705418 Jun 10 18:12:43.187194 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2103/4350] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:42 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1528 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:43.209420 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a4581d99-6189-4766-96b2-cf537e50683a tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:43.210063 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a4581d99-6189-4766-96b2-cf537e50683a tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] [instance: 07a5fadb-9316-44c9-9c5e-c8f26050d4d2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:43.226987 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a4581d99-6189-4766-96b2-cf537e50683a tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:43.227511 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a4581d99-6189-4766-96b2-cf537e50683a tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:43.228392 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a4581d99-6189-4766-96b2-cf537e50683a tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:43.236671 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a4581d99-6189-4766-96b2-cf537e50683a tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:43.274457 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-86d34315-5b1f-4784-a3e4-117921576967 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:43.281064 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:12:43.284511 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-86d34315-5b1f-4784-a3e4-117921576967 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5" status: 200 len: 1315 microversion: 2.1 time: 0.441133 Jun 10 18:12:43.289623 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2248/4351] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:42 2022] GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5 => generated 1315 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:43.297572 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4842a495-8172-4635-8378-405a09b9e0cb tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:43.303102 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4842a495-8172-4635-8378-405a09b9e0cb tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 3a5ac7a5-efdb-4191-85ed-237a1d2f7666] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:43.315683 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4842a495-8172-4635-8378-405a09b9e0cb tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:43.318282 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4842a495-8172-4635-8378-405a09b9e0cb tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:43.319131 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4842a495-8172-4635-8378-405a09b9e0cb tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:43.327051 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4842a495-8172-4635-8378-405a09b9e0cb tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:43.421726 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4842a495-8172-4635-8378-405a09b9e0cb tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:43.422263 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4842a495-8172-4635-8378-405a09b9e0cb tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:43.422743 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-4842a495-8172-4635-8378-405a09b9e0cb tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lazy-loading 'fault' on Instance uuid 3a5ac7a5-efdb-4191-85ed-237a1d2f7666 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:12:43.489273 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4842a495-8172-4635-8378-405a09b9e0cb tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:43.502407 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4842a495-8172-4635-8378-405a09b9e0cb tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666" status: 200 len: 1314 microversion: 2.1 time: 0.211199 Jun 10 18:12:43.502659 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2249/4352] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:43 2022] GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:43.533059 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d9d22cf7-17f7-433d-bf22-45f3e547711e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:43.534325 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d9d22cf7-17f7-433d-bf22-45f3e547711e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:43.558626 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d9d22cf7-17f7-433d-bf22-45f3e547711e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:43.561609 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d9d22cf7-17f7-433d-bf22-45f3e547711e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:43.561609 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d9d22cf7-17f7-433d-bf22-45f3e547711e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:43.562231 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d9d22cf7-17f7-433d-bf22-45f3e547711e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:43.785620 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d9d22cf7-17f7-433d-bf22-45f3e547711e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:43.800785 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d9d22cf7-17f7-433d-bf22-45f3e547711e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca" status: 200 len: 1321 microversion: 2.1 time: 0.279296 Jun 10 18:12:43.803444 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2250/4353] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:43 2022] GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca => generated 1321 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:43.910626 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a4581d99-6189-4766-96b2-cf537e50683a tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2fe556bf10c4d69a86a325d60da6aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534acf4edf9247dea63a9387e0cd0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:43.940361 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a4581d99-6189-4766-96b2-cf537e50683a tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] 10.222.0.35 "GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2" status: 200 len: 1315 microversion: 2.1 time: 0.751875 Jun 10 18:12:43.944885 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2104/4354] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:43 2022] GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2 => generated 1315 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:44.198375 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f2edd5b1-4aba-4d90-82e6-277d443e9190 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:44.202294 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f2edd5b1-4aba-4d90-82e6-277d443e9190 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:44.219753 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f2edd5b1-4aba-4d90-82e6-277d443e9190 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:44.221913 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f2edd5b1-4aba-4d90-82e6-277d443e9190 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:44.224785 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f2edd5b1-4aba-4d90-82e6-277d443e9190 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:44.225504 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f2edd5b1-4aba-4d90-82e6-277d443e9190 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:44.303087 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4563dfd2-fd46-49c1-b281-4686676c12f7 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:44.303907 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4563dfd2-fd46-49c1-b281-4686676c12f7 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: aff760b6-7b66-40e8-b266-dcfa79ca41b5] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:44.314184 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4563dfd2-fd46-49c1-b281-4686676c12f7 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:44.314841 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4563dfd2-fd46-49c1-b281-4686676c12f7 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:44.315829 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4563dfd2-fd46-49c1-b281-4686676c12f7 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:44.316517 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4563dfd2-fd46-49c1-b281-4686676c12f7 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:44.560174 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f2edd5b1-4aba-4d90-82e6-277d443e9190 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:44.570216 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f2edd5b1-4aba-4d90-82e6-277d443e9190 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1528 microversion: 2.1 time: 0.377053 Jun 10 18:12:44.574054 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2251/4355] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:44 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1528 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:44.577515 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-173c8db8-10b9-48f8-90ef-acaf3853198e req-da3bfd7e-2ebc-43cd-abf1-29144b73af72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07a5fadb-9316-44c9-9c5e-c8f26050d4d2", "name": "network-vif-plugged", "status": "completed", "tag": "4e6d3802-ba65-4c7d-a7e9-c731019ecea3"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:44.587851 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-173c8db8-10b9-48f8-90ef-acaf3853198e req-da3bfd7e-2ebc-43cd-abf1-29144b73af72 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:44.588884 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-173c8db8-10b9-48f8-90ef-acaf3853198e req-da3bfd7e-2ebc-43cd-abf1-29144b73af72 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:44.607828 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-173c8db8-10b9-48f8-90ef-acaf3853198e req-da3bfd7e-2ebc-43cd-abf1-29144b73af72 service nova] Creating event network-vif-plugged:4e6d3802-ba65-4c7d-a7e9-c731019ecea3 for instance 07a5fadb-9316-44c9-9c5e-c8f26050d4d2 on chh2-master-2 Jun 10 18:12:44.613510 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-173c8db8-10b9-48f8-90ef-acaf3853198e req-da3bfd7e-2ebc-43cd-abf1-29144b73af72 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039631 Jun 10 18:12:44.614649 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2252/4356] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:12:44.620361 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fda47a4f-9200-4e60-8dfe-6792cd9845a8 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:44.621142 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fda47a4f-9200-4e60-8dfe-6792cd9845a8 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 3a5ac7a5-efdb-4191-85ed-237a1d2f7666] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:44.628990 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fda47a4f-9200-4e60-8dfe-6792cd9845a8 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:44.629452 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fda47a4f-9200-4e60-8dfe-6792cd9845a8 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:44.630835 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fda47a4f-9200-4e60-8dfe-6792cd9845a8 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:44.631950 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fda47a4f-9200-4e60-8dfe-6792cd9845a8 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:44.671184 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-fda47a4f-9200-4e60-8dfe-6792cd9845a8 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] HTTP exception thrown: Instance 3a5ac7a5-efdb-4191-85ed-237a1d2f7666 could not be found. Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fda47a4f-9200-4e60-8dfe-6792cd9845a8 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Request method failure captured: Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666 HTTP/1.1 Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4lsfzX-ZssLhBeRERA250Allr9sy5j_9WvmWWrmV8OKGfGLWtKo7IkZmvrlgadYYrKiCJiGv3V0W6WUpTPzvczOtcJBE7CxOiD9g_bSlYjPmyz5JBO2nqOTXPUSYGg7_D3Rbko1iq-cS8Cxtg3C-XqYzZtQdMv47S3ncw5oU530j6g Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: dc6ea0e4d347491eb23c3af053313211 Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-582167706 Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/dc6ea0e4d347491eb23c3af053313211"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/dc6ea0e4d347491eb23c3af053313211"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/dc6ea0e4d347491eb23c3af053313211"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_dc6ea0e4d347491eb23c3af053313211", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-582167706 Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: dc6ea0e4d347491eb23c3af053313211 Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-582167706 Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ImagesOneServerNegativeTestJSON-582167706-project Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 8e6b5cd42b2144a69590680e5ef156fa Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-582167706-project Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 3a5ac7a5-efdb-4191-85ed-237a1d2f7666 could not be found. Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '3a5ac7a5-efdb-4191-85ed-237a1d2f7666'} Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a5ac7a5-efdb-4191-85ed-237a1d2f7666 could not be found. Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a5ac7a5-efdb-4191-85ed-237a1d2f7666 could not be found. Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:44.677462 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:44.685503 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:44.685503 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:44.685503 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:44.685503 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:44.685503 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:12:44.685503 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:12:44.685503 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a5ac7a5-efdb-4191-85ed-237a1d2f7666 could not be found. Jun 10 18:12:44.685503 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:44.685503 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fda47a4f-9200-4e60-8dfe-6792cd9845a8 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Returning 404 to user: Instance 3a5ac7a5-efdb-4191-85ed-237a1d2f7666 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:12:44.685503 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fda47a4f-9200-4e60-8dfe-6792cd9845a8 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666" status: 404 len: 111 microversion: 2.1 time: 0.063074 Jun 10 18:12:44.685503 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2253/4357] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:44 2022] GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:12:44.704868 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-dfc6c178-cfb8-4d39-b3d8-88df40dd6e1b tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Action: 'create', calling method: .version_select at 0x7f77c09cee50>, body: {"keypair": {"name": "tempest-keypair-910344317", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjsMvIiTs10/Zosx7fPFzrw137RSs0JTRelQYI3bPdc7y40duTZkk4E+KtoX3z1ugu/k+ADqFf7AtGBJKn9iSmmjaw/p8tMnIRHPk5xmm72F8qWvceg6Xhtqe3uk8I6gg=="}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:44.775400 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-dfc6c178-cfb8-4d39-b3d8-88df40dd6e1b tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Getting quotas for project dc6ea0e4d347491eb23c3af053313211. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:12:44.813580 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-dfc6c178-cfb8-4d39-b3d8-88df40dd6e1b tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Getting quotas for user 8e6b5cd42b2144a69590680e5ef156fa and project dc6ea0e4d347491eb23c3af053313211. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:12:44.968068 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-dfc6c178-cfb8-4d39-b3d8-88df40dd6e1b tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.265910 Jun 10 18:12:44.968068 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2254/4358] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 18:12:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:12:44.968068 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-540bfa82-9d8e-42b1-b122-61c818605e6f tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:44.968068 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-540bfa82-9d8e-42b1-b122-61c818605e6f tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:45.009586 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-540bfa82-9d8e-42b1-b122-61c818605e6f tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:45.010396 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-540bfa82-9d8e-42b1-b122-61c818605e6f tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:45.013829 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-540bfa82-9d8e-42b1-b122-61c818605e6f tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:45.015968 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-540bfa82-9d8e-42b1-b122-61c818605e6f tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:45.181583 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4563dfd2-fd46-49c1-b281-4686676c12f7 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:45.194197 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4563dfd2-fd46-49c1-b281-4686676c12f7 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5" status: 200 len: 1502 microversion: 2.1 time: 0.896398 Jun 10 18:12:45.195239 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2105/4359] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:44 2022] GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5 => generated 1502 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:12:45.201329 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6e6a21c3-2f90-4cbd-98a1-3bbc6e3aed6d tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:45.201962 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6e6a21c3-2f90-4cbd-98a1-3bbc6e3aed6d tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] [instance: 07a5fadb-9316-44c9-9c5e-c8f26050d4d2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:45.209830 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6e6a21c3-2f90-4cbd-98a1-3bbc6e3aed6d tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:45.211602 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6e6a21c3-2f90-4cbd-98a1-3bbc6e3aed6d tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:45.212681 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6e6a21c3-2f90-4cbd-98a1-3bbc6e3aed6d tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:45.213145 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6e6a21c3-2f90-4cbd-98a1-3bbc6e3aed6d tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:45.509110 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-540bfa82-9d8e-42b1-b122-61c818605e6f tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:45.519530 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-540bfa82-9d8e-42b1-b122-61c818605e6f tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca" status: 200 len: 1321 microversion: 2.1 time: 0.561481 Jun 10 18:12:45.519530 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2255/4360] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:44 2022] GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca => generated 1321 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:45.524113 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e8f83055-931e-4c25-93c7-4d80b7edba10 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:45.555471 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e8f83055-931e-4c25-93c7-4d80b7edba10 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: aff760b6-7b66-40e8-b266-dcfa79ca41b5] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:45.556341 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6e6a21c3-2f90-4cbd-98a1-3bbc6e3aed6d tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2fe556bf10c4d69a86a325d60da6aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534acf4edf9247dea63a9387e0cd0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:45.585007 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6e6a21c3-2f90-4cbd-98a1-3bbc6e3aed6d tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] 10.222.0.35 "GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2" status: 200 len: 1315 microversion: 2.1 time: 0.388441 Jun 10 18:12:45.589106 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2106/4361] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:45 2022] GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2 => generated 1315 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:45.600775 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e8f83055-931e-4c25-93c7-4d80b7edba10 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:45.604231 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e8f83055-931e-4c25-93c7-4d80b7edba10 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:45.605120 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e8f83055-931e-4c25-93c7-4d80b7edba10 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:45.605568 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e8f83055-931e-4c25-93c7-4d80b7edba10 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:45.608392 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f53d9e3c-c110-4d19-b49b-7538e30e9c7f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:45.608516 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f53d9e3c-c110-4d19-b49b-7538e30e9c7f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:45.630285 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:12:45.650248 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f53d9e3c-c110-4d19-b49b-7538e30e9c7f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:45.653382 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f53d9e3c-c110-4d19-b49b-7538e30e9c7f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:45.655609 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f53d9e3c-c110-4d19-b49b-7538e30e9c7f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:45.660420 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f53d9e3c-c110-4d19-b49b-7538e30e9c7f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:45.733454 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-e8f83055-931e-4c25-93c7-4d80b7edba10 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lazy-loading 'flavor' on Instance uuid aff760b6-7b66-40e8-b266-dcfa79ca41b5 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:12:45.903532 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f53d9e3c-c110-4d19-b49b-7538e30e9c7f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:45.927572 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f53d9e3c-c110-4d19-b49b-7538e30e9c7f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1528 microversion: 2.1 time: 0.335540 Jun 10 18:12:45.932369 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2107/4362] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:45 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1528 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:46.161371 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e8f83055-931e-4c25-93c7-4d80b7edba10 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "POST /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5/action" status: 202 len: 0 microversion: 2.1 time: 0.640569 Jun 10 18:12:46.164290 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2256/4363] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:12:45 2022] POST /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5/action => generated 0 bytes in 642 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:12:46.171487 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6fcdc88a-2b3e-45f7-878b-76de5aadd1d9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:46.172576 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6fcdc88a-2b3e-45f7-878b-76de5aadd1d9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: aff760b6-7b66-40e8-b266-dcfa79ca41b5] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:46.184945 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6fcdc88a-2b3e-45f7-878b-76de5aadd1d9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:46.185729 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6fcdc88a-2b3e-45f7-878b-76de5aadd1d9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:46.188171 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6fcdc88a-2b3e-45f7-878b-76de5aadd1d9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:46.189907 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6fcdc88a-2b3e-45f7-878b-76de5aadd1d9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:46.424209 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6fcdc88a-2b3e-45f7-878b-76de5aadd1d9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:46.433720 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6fcdc88a-2b3e-45f7-878b-76de5aadd1d9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5" status: 200 len: 1510 microversion: 2.1 time: 0.266942 Jun 10 18:12:46.442156 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2108/4364] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:46 2022] GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5 => generated 1510 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:46.537787 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5729c2a7-efe1-42cf-805c-be95c93f59ac tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:46.538511 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5729c2a7-efe1-42cf-805c-be95c93f59ac tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:46.553496 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5729c2a7-efe1-42cf-805c-be95c93f59ac tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:46.560103 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5729c2a7-efe1-42cf-805c-be95c93f59ac tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:46.561218 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5729c2a7-efe1-42cf-805c-be95c93f59ac tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:46.561834 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5729c2a7-efe1-42cf-805c-be95c93f59ac tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:46.607140 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a419ddd1-d0ce-4702-9909-940061a2d178 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:46.608976 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a419ddd1-d0ce-4702-9909-940061a2d178 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] [instance: 07a5fadb-9316-44c9-9c5e-c8f26050d4d2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:46.620706 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a419ddd1-d0ce-4702-9909-940061a2d178 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:46.622497 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a419ddd1-d0ce-4702-9909-940061a2d178 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:46.625466 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a419ddd1-d0ce-4702-9909-940061a2d178 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:46.626942 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a419ddd1-d0ce-4702-9909-940061a2d178 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:46.937660 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a419ddd1-d0ce-4702-9909-940061a2d178 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2fe556bf10c4d69a86a325d60da6aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534acf4edf9247dea63a9387e0cd0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:46.961340 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a419ddd1-d0ce-4702-9909-940061a2d178 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] 10.222.0.35 "GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2" status: 200 len: 1315 microversion: 2.1 time: 0.358153 Jun 10 18:12:46.971401 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2109/4365] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:46 2022] GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2 => generated 1315 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:46.990906 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5729c2a7-efe1-42cf-805c-be95c93f59ac tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:46.994255 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-df6efb93-fabf-4a27-9313-86a0420488f9 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:47.000097 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-df6efb93-fabf-4a27-9313-86a0420488f9 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:47.003444 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5729c2a7-efe1-42cf-805c-be95c93f59ac tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca" status: 200 len: 1321 microversion: 2.1 time: 0.470816 Jun 10 18:12:47.004043 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2257/4366] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:46 2022] GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca => generated 1321 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:12:47.033870 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df6efb93-fabf-4a27-9313-86a0420488f9 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:47.041908 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df6efb93-fabf-4a27-9313-86a0420488f9 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:47.046150 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df6efb93-fabf-4a27-9313-86a0420488f9 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:47.046777 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df6efb93-fabf-4a27-9313-86a0420488f9 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:47.057610 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:12:47.449312 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-ff1e131e-755c-4cb2-891f-d39c2eaa44fd req-be2e3390-0c3d-4c0f-b9fa-5ea22d6d9772 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ffbc900-46ac-470d-9773-9b0118c6dbca", "name": "network-vif-plugged", "status": "completed", "tag": "7ddef814-3da5-4e0c-97c5-f653e35b3352"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:47.466187 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-ff1e131e-755c-4cb2-891f-d39c2eaa44fd req-be2e3390-0c3d-4c0f-b9fa-5ea22d6d9772 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:47.466922 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-ff1e131e-755c-4cb2-891f-d39c2eaa44fd req-be2e3390-0c3d-4c0f-b9fa-5ea22d6d9772 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:47.488502 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-ff1e131e-755c-4cb2-891f-d39c2eaa44fd req-be2e3390-0c3d-4c0f-b9fa-5ea22d6d9772 service nova] Creating event network-vif-plugged:7ddef814-3da5-4e0c-97c5-f653e35b3352 for instance 3ffbc900-46ac-470d-9773-9b0118c6dbca on chh1-master-2 Jun 10 18:12:47.495651 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-ff1e131e-755c-4cb2-891f-d39c2eaa44fd req-be2e3390-0c3d-4c0f-b9fa-5ea22d6d9772 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050702 Jun 10 18:12:47.500449 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2258/4367] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:12:47.506622 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-68982033-e519-429b-8094-3c0140118ade tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:47.509012 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-68982033-e519-429b-8094-3c0140118ade tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: aff760b6-7b66-40e8-b266-dcfa79ca41b5] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:47.523259 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-68982033-e519-429b-8094-3c0140118ade tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:47.524597 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-68982033-e519-429b-8094-3c0140118ade tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:47.525722 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-68982033-e519-429b-8094-3c0140118ade tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:47.526332 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-68982033-e519-429b-8094-3c0140118ade tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:47.704352 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-df6efb93-fabf-4a27-9313-86a0420488f9 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:47.717256 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-df6efb93-fabf-4a27-9313-86a0420488f9 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1528 microversion: 2.1 time: 0.737608 Jun 10 18:12:47.719187 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2110/4368] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:46 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1528 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:47.863015 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-68982033-e519-429b-8094-3c0140118ade tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:47.871582 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-68982033-e519-429b-8094-3c0140118ade tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5" status: 200 len: 1493 microversion: 2.1 time: 0.369624 Jun 10 18:12:47.872534 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2259/4369] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:47 2022] GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5 => generated 1493 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:47.888726 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-74d83976-e70b-466b-9641-0b6246bdd062 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:47.892793 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-74d83976-e70b-466b-9641-0b6246bdd062 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: aff760b6-7b66-40e8-b266-dcfa79ca41b5] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:47.921772 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-74d83976-e70b-466b-9641-0b6246bdd062 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:47.921772 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-74d83976-e70b-466b-9641-0b6246bdd062 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:47.921772 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-74d83976-e70b-466b-9641-0b6246bdd062 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:47.921772 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-74d83976-e70b-466b-9641-0b6246bdd062 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:47.994040 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bca51757-70ba-4be2-95e1-c2c6ac49e262 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:47.994821 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bca51757-70ba-4be2-95e1-c2c6ac49e262 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] [instance: 07a5fadb-9316-44c9-9c5e-c8f26050d4d2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:47.998260 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:12:48.007278 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bca51757-70ba-4be2-95e1-c2c6ac49e262 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:48.015102 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bca51757-70ba-4be2-95e1-c2c6ac49e262 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:48.016294 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bca51757-70ba-4be2-95e1-c2c6ac49e262 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:48.017001 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bca51757-70ba-4be2-95e1-c2c6ac49e262 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:48.022772 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-74d83976-e70b-466b-9641-0b6246bdd062 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: aff760b6-7b66-40e8-b266-dcfa79ca41b5] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:12:48.360730 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bca51757-70ba-4be2-95e1-c2c6ac49e262 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2fe556bf10c4d69a86a325d60da6aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534acf4edf9247dea63a9387e0cd0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:48.381442 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bca51757-70ba-4be2-95e1-c2c6ac49e262 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] 10.222.0.35 "GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2" status: 200 len: 1465 microversion: 2.1 time: 0.392504 Jun 10 18:12:48.382052 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2260/4370] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:47 2022] GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2 => generated 1465 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:12:48.396705 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6b458ef9-07d4-4e57-857a-5867f94445c0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:48.396705 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6b458ef9-07d4-4e57-857a-5867f94445c0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:48.401359 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6b458ef9-07d4-4e57-857a-5867f94445c0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:48.404702 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6b458ef9-07d4-4e57-857a-5867f94445c0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:48.404702 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6b458ef9-07d4-4e57-857a-5867f94445c0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:48.404702 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6b458ef9-07d4-4e57-857a-5867f94445c0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:48.511271 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-74d83976-e70b-466b-9641-0b6246bdd062 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "DELETE /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5" status: 204 len: 0 microversion: 2.1 time: 0.626384 Jun 10 18:12:48.512439 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2111/4371] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:12:47 2022] DELETE /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:12:48.522499 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0af07bbb-fed7-4158-8c25-0c08481e1c08 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:48.526114 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0af07bbb-fed7-4158-8c25-0c08481e1c08 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] [instance: 07a5fadb-9316-44c9-9c5e-c8f26050d4d2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:48.544981 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0af07bbb-fed7-4158-8c25-0c08481e1c08 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:48.545811 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0af07bbb-fed7-4158-8c25-0c08481e1c08 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:48.546853 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0af07bbb-fed7-4158-8c25-0c08481e1c08 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:48.547745 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0af07bbb-fed7-4158-8c25-0c08481e1c08 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:48.596686 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0af07bbb-fed7-4158-8c25-0c08481e1c08 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] [instance: 07a5fadb-9316-44c9-9c5e-c8f26050d4d2] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:12:48.688243 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6b458ef9-07d4-4e57-857a-5867f94445c0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:48.727753 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6b458ef9-07d4-4e57-857a-5867f94445c0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca" status: 200 len: 1321 microversion: 2.1 time: 0.344572 Jun 10 18:12:48.729670 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2261/4372] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:48 2022] GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca => generated 1321 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:48.751939 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5f6f5774-b62f-47fc-bfcf-5ecc4ee0fdc7 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:48.757131 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5f6f5774-b62f-47fc-bfcf-5ecc4ee0fdc7 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: aff760b6-7b66-40e8-b266-dcfa79ca41b5] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:48.779046 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f6f5774-b62f-47fc-bfcf-5ecc4ee0fdc7 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:48.779599 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f6f5774-b62f-47fc-bfcf-5ecc4ee0fdc7 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:48.780454 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f6f5774-b62f-47fc-bfcf-5ecc4ee0fdc7 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:48.780947 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f6f5774-b62f-47fc-bfcf-5ecc4ee0fdc7 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:48.967931 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0af07bbb-fed7-4158-8c25-0c08481e1c08 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] 10.222.0.35 "DELETE /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2" status: 204 len: 0 microversion: 2.1 time: 0.453017 Jun 10 18:12:48.969569 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2112/4373] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:12:48 2022] DELETE /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:12:48.977573 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c4652392-562a-45f0-a81c-0e3e21ba1151 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:48.978674 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c4652392-562a-45f0-a81c-0e3e21ba1151 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:48.997306 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c4652392-562a-45f0-a81c-0e3e21ba1151 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:49.000641 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c4652392-562a-45f0-a81c-0e3e21ba1151 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:49.000641 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c4652392-562a-45f0-a81c-0e3e21ba1151 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:49.000641 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c4652392-562a-45f0-a81c-0e3e21ba1151 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:49.127390 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5f6f5774-b62f-47fc-bfcf-5ecc4ee0fdc7 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:49.153435 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5f6f5774-b62f-47fc-bfcf-5ecc4ee0fdc7 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5" status: 200 len: 1499 microversion: 2.1 time: 0.391478 Jun 10 18:12:49.153435 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2262/4374] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:48 2022] GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5 => generated 1499 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:49.165782 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9af3a5b0-9de2-40fe-b596-2e1f7b3a715f tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:49.168544 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9af3a5b0-9de2-40fe-b596-2e1f7b3a715f tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] [instance: 07a5fadb-9316-44c9-9c5e-c8f26050d4d2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:49.178257 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9af3a5b0-9de2-40fe-b596-2e1f7b3a715f tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:49.178907 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9af3a5b0-9de2-40fe-b596-2e1f7b3a715f tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:49.181776 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9af3a5b0-9de2-40fe-b596-2e1f7b3a715f tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:49.181776 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9af3a5b0-9de2-40fe-b596-2e1f7b3a715f tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:49.503079 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c4652392-562a-45f0-a81c-0e3e21ba1151 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:49.517842 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c4652392-562a-45f0-a81c-0e3e21ba1151 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1528 microversion: 2.1 time: 0.543565 Jun 10 18:12:49.522577 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2113/4375] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:48 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1528 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:49.537238 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-6374fe23-b38c-4561-89cf-f0cdb11c8af3 req-ab35e799-9e8d-44c8-9739-c895eff13812 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e", "name": "network-vif-plugged", "status": "completed", "tag": "bd1f8f99-545c-4e7b-89b2-c24069d1acc2"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:49.555784 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9af3a5b0-9de2-40fe-b596-2e1f7b3a715f tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2fe556bf10c4d69a86a325d60da6aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534acf4edf9247dea63a9387e0cd0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:49.559058 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-6374fe23-b38c-4561-89cf-f0cdb11c8af3 req-ab35e799-9e8d-44c8-9739-c895eff13812 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:49.559982 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-6374fe23-b38c-4561-89cf-f0cdb11c8af3 req-ab35e799-9e8d-44c8-9739-c895eff13812 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:49.563758 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9af3a5b0-9de2-40fe-b596-2e1f7b3a715f tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] 10.222.0.35 "GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2" status: 200 len: 1471 microversion: 2.1 time: 0.412513 Jun 10 18:12:49.565398 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2263/4376] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:49 2022] GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2 => generated 1471 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:49.588410 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-6374fe23-b38c-4561-89cf-f0cdb11c8af3 req-ab35e799-9e8d-44c8-9739-c895eff13812 service nova] Creating event network-vif-plugged:bd1f8f99-545c-4e7b-89b2-c24069d1acc2 for instance b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e on chh1-master-2 Jun 10 18:12:49.594621 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-6374fe23-b38c-4561-89cf-f0cdb11c8af3 req-ab35e799-9e8d-44c8-9739-c895eff13812 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066331 Jun 10 18:12:49.595381 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2114/4377] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:12:49.748453 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0676e3ca-5467-47c5-ba8c-88cc9b762e56 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:49.749327 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0676e3ca-5467-47c5-ba8c-88cc9b762e56 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:49.763603 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0676e3ca-5467-47c5-ba8c-88cc9b762e56 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:49.764070 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0676e3ca-5467-47c5-ba8c-88cc9b762e56 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:49.768058 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0676e3ca-5467-47c5-ba8c-88cc9b762e56 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:49.768592 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0676e3ca-5467-47c5-ba8c-88cc9b762e56 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:50.080448 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0676e3ca-5467-47c5-ba8c-88cc9b762e56 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:50.140539 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0676e3ca-5467-47c5-ba8c-88cc9b762e56 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca" status: 200 len: 1513 microversion: 2.1 time: 0.369221 Jun 10 18:12:50.140539 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2264/4378] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:49 2022] GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca => generated 1513 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:50.158817 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5c41a0db-b3fe-47ab-90ab-7314559d13fc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:50.160057 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5c41a0db-b3fe-47ab-90ab-7314559d13fc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:50.169420 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e557018b-29b2-453c-869f-cb94b5d40c82 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:50.170327 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e557018b-29b2-453c-869f-cb94b5d40c82 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: aff760b6-7b66-40e8-b266-dcfa79ca41b5] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:50.179159 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e557018b-29b2-453c-869f-cb94b5d40c82 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:50.191594 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e557018b-29b2-453c-869f-cb94b5d40c82 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:50.193013 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e557018b-29b2-453c-869f-cb94b5d40c82 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:50.193559 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e557018b-29b2-453c-869f-cb94b5d40c82 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:50.198493 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5c41a0db-b3fe-47ab-90ab-7314559d13fc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:50.199311 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5c41a0db-b3fe-47ab-90ab-7314559d13fc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:50.200387 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5c41a0db-b3fe-47ab-90ab-7314559d13fc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:50.201041 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5c41a0db-b3fe-47ab-90ab-7314559d13fc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:50.243592 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-5c41a0db-b3fe-47ab-90ab-7314559d13fc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lazy-loading 'flavor' on Instance uuid 3ffbc900-46ac-470d-9773-9b0118c6dbca {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:12:50.452483 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e557018b-29b2-453c-869f-cb94b5d40c82 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:50.467642 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e557018b-29b2-453c-869f-cb94b5d40c82 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5" status: 200 len: 1499 microversion: 2.1 time: 0.300059 Jun 10 18:12:50.479092 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2265/4379] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:50 2022] GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5 => generated 1499 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:50.539546 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8f2b6b4e-2aeb-4e81-9f00-85368bf3eea1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:50.540158 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8f2b6b4e-2aeb-4e81-9f00-85368bf3eea1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:50.547137 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8f2b6b4e-2aeb-4e81-9f00-85368bf3eea1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:50.547580 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8f2b6b4e-2aeb-4e81-9f00-85368bf3eea1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:50.554056 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8f2b6b4e-2aeb-4e81-9f00-85368bf3eea1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:50.554513 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8f2b6b4e-2aeb-4e81-9f00-85368bf3eea1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:50.580821 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:12:50.754846 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8f2b6b4e-2aeb-4e81-9f00-85368bf3eea1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:50.764331 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8f2b6b4e-2aeb-4e81-9f00-85368bf3eea1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1528 microversion: 2.1 time: 0.229130 Jun 10 18:12:50.764963 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2266/4380] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:50 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1528 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:12:50.785403 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2f434296-50c0-413e-b072-6309dd988a22 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:50.786670 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2f434296-50c0-413e-b072-6309dd988a22 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] [instance: 07a5fadb-9316-44c9-9c5e-c8f26050d4d2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:50.797864 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2f434296-50c0-413e-b072-6309dd988a22 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:50.798327 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2f434296-50c0-413e-b072-6309dd988a22 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:50.799217 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2f434296-50c0-413e-b072-6309dd988a22 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:50.799713 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2f434296-50c0-413e-b072-6309dd988a22 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:50.994248 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2f434296-50c0-413e-b072-6309dd988a22 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2fe556bf10c4d69a86a325d60da6aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534acf4edf9247dea63a9387e0cd0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:51.020727 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2f434296-50c0-413e-b072-6309dd988a22 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] 10.222.0.35 "GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2" status: 200 len: 1471 microversion: 2.1 time: 0.240036 Jun 10 18:12:51.021871 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2267/4381] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:50 2022] GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2 => generated 1471 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:51.029487 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5c41a0db-b3fe-47ab-90ab-7314559d13fc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "POST /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca/action" status: 200 len: 32 microversion: 2.1 time: 0.875113 Jun 10 18:12:51.030305 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2115/4382] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:12:50 2022] POST /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca/action => generated 32 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:12:51.039544 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0adbe713-94f1-4116-831c-e8997f2264df tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-746434243", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:51.042631 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-025fd888-cdd8-49e4-98c0-f235f79ed7f1 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:51.043627 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-025fd888-cdd8-49e4-98c0-f235f79ed7f1 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:51.055322 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-025fd888-cdd8-49e4-98c0-f235f79ed7f1 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:51.056181 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-025fd888-cdd8-49e4-98c0-f235f79ed7f1 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:51.057317 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-025fd888-cdd8-49e4-98c0-f235f79ed7f1 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:51.058045 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-025fd888-cdd8-49e4-98c0-f235f79ed7f1 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:51.332324 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-0adbe713-94f1-4116-831c-e8997f2264df tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] validate_networks() for [('c26f6a24-00dc-4e29-8478-7c9e6523a0cf', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:12:51.428734 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-025fd888-cdd8-49e4-98c0-f235f79ed7f1 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:51.440399 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-025fd888-cdd8-49e4-98c0-f235f79ed7f1 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca" status: 200 len: 1519 microversion: 2.1 time: 0.402052 Jun 10 18:12:51.441604 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2116/4383] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:51 2022] GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca => generated 1519 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:51.486672 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b01dd262-837a-4256-8049-f501c37c5087 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:51.488117 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b01dd262-837a-4256-8049-f501c37c5087 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: aff760b6-7b66-40e8-b266-dcfa79ca41b5] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:51.497158 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b01dd262-837a-4256-8049-f501c37c5087 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:51.497944 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b01dd262-837a-4256-8049-f501c37c5087 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:51.500394 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b01dd262-837a-4256-8049-f501c37c5087 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:51.501123 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b01dd262-837a-4256-8049-f501c37c5087 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:51.805535 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-0adbe713-94f1-4116-831c-e8997f2264df tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:12:51.805981 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-0adbe713-94f1-4116-831c-e8997f2264df tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:12:51.806455 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-0adbe713-94f1-4116-831c-e8997f2264df tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:12:51.806869 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-0adbe713-94f1-4116-831c-e8997f2264df tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:12:51.807578 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-0adbe713-94f1-4116-831c-e8997f2264df tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:12:51.821782 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0adbe713-94f1-4116-831c-e8997f2264df tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:51.823075 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0adbe713-94f1-4116-831c-e8997f2264df tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:51.824983 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0adbe713-94f1-4116-831c-e8997f2264df tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:51.825788 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0adbe713-94f1-4116-831c-e8997f2264df tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:51.847933 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-0adbe713-94f1-4116-831c-e8997f2264df tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Getting quotas for project dc6ea0e4d347491eb23c3af053313211. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:12:51.856582 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-0adbe713-94f1-4116-831c-e8997f2264df tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Getting quotas for user 8e6b5cd42b2144a69590680e5ef156fa and project dc6ea0e4d347491eb23c3af053313211. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:12:51.870526 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0adbe713-94f1-4116-831c-e8997f2264df tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:12:51.872824 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0adbe713-94f1-4116-831c-e8997f2264df tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 551856e9-a45b-412d-979d-b14039d74fea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:12:52.090341 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0adbe713-94f1-4116-831c-e8997f2264df tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.064064 Jun 10 18:12:52.091121 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2268/4384] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:12:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 1065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:12:52.100628 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-96f111be-7975-4c63-8975-284c3f2acb77 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:52.101388 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-96f111be-7975-4c63-8975-284c3f2acb77 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:52.110771 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-96f111be-7975-4c63-8975-284c3f2acb77 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:52.111561 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-96f111be-7975-4c63-8975-284c3f2acb77 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:52.112719 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-96f111be-7975-4c63-8975-284c3f2acb77 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:52.113572 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-96f111be-7975-4c63-8975-284c3f2acb77 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:52.380294 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-96f111be-7975-4c63-8975-284c3f2acb77 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:52.396747 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-96f111be-7975-4c63-8975-284c3f2acb77 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1528 microversion: 2.1 time: 0.299515 Jun 10 18:12:52.396747 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2269/4385] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:52 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1528 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:52.405090 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5dbbd1f4-d1aa-4c99-8e9e-6b461609117f tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:52.405704 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5dbbd1f4-d1aa-4c99-8e9e-6b461609117f tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] [instance: 07a5fadb-9316-44c9-9c5e-c8f26050d4d2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:52.412605 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5dbbd1f4-d1aa-4c99-8e9e-6b461609117f tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:52.413067 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5dbbd1f4-d1aa-4c99-8e9e-6b461609117f tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:52.421327 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5dbbd1f4-d1aa-4c99-8e9e-6b461609117f tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:52.428365 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5dbbd1f4-d1aa-4c99-8e9e-6b461609117f tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:52.480508 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b01dd262-837a-4256-8049-f501c37c5087 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:52.488096 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b01dd262-837a-4256-8049-f501c37c5087 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5" status: 200 len: 1499 microversion: 2.1 time: 1.005238 Jun 10 18:12:52.501253 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2117/4386] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:51 2022] GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5 => generated 1499 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:52.506878 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1eb6f640-f7b2-4ee8-ad36-1117ff2ad75e tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:52.507751 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1eb6f640-f7b2-4ee8-ad36-1117ff2ad75e tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 551856e9-a45b-412d-979d-b14039d74fea] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:52.720786 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5dbbd1f4-d1aa-4c99-8e9e-6b461609117f tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2fe556bf10c4d69a86a325d60da6aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534acf4edf9247dea63a9387e0cd0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:52.736905 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5dbbd1f4-d1aa-4c99-8e9e-6b461609117f tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] 10.222.0.35 "GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2" status: 200 len: 1471 microversion: 2.1 time: 0.335626 Jun 10 18:12:52.743983 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2270/4387] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:52 2022] GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2 => generated 1471 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:52.743983 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-18039e1f-d26a-4f6d-9e50-6db374774636 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:52.743983 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-18039e1f-d26a-4f6d-9e50-6db374774636 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:52.762118 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1eb6f640-f7b2-4ee8-ad36-1117ff2ad75e tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:52.762852 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-18039e1f-d26a-4f6d-9e50-6db374774636 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:52.763308 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-18039e1f-d26a-4f6d-9e50-6db374774636 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:52.764089 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-18039e1f-d26a-4f6d-9e50-6db374774636 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:52.764618 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-18039e1f-d26a-4f6d-9e50-6db374774636 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:52.771277 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1eb6f640-f7b2-4ee8-ad36-1117ff2ad75e tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea" status: 200 len: 1224 microversion: 2.1 time: 0.268698 Jun 10 18:12:52.776295 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2118/4388] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:52 2022] GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea => generated 1224 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:53.044949 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-18039e1f-d26a-4f6d-9e50-6db374774636 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:53.054411 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-18039e1f-d26a-4f6d-9e50-6db374774636 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca" status: 200 len: 1519 microversion: 2.1 time: 0.315668 Jun 10 18:12:53.056059 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2271/4389] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:52 2022] GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca => generated 1519 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:53.417747 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-df0c6281-cbfb-4bdb-a33a-f13076f6266a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:53.419948 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-df0c6281-cbfb-4bdb-a33a-f13076f6266a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:53.433622 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df0c6281-cbfb-4bdb-a33a-f13076f6266a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:53.435029 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df0c6281-cbfb-4bdb-a33a-f13076f6266a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:53.437379 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df0c6281-cbfb-4bdb-a33a-f13076f6266a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:53.439855 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df0c6281-cbfb-4bdb-a33a-f13076f6266a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:53.518271 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8206bbe2-69a7-47fa-89ff-fef251760e72 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:53.519656 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8206bbe2-69a7-47fa-89ff-fef251760e72 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: aff760b6-7b66-40e8-b266-dcfa79ca41b5] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:53.526579 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8206bbe2-69a7-47fa-89ff-fef251760e72 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:53.527051 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8206bbe2-69a7-47fa-89ff-fef251760e72 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:53.527839 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8206bbe2-69a7-47fa-89ff-fef251760e72 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:53.530034 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8206bbe2-69a7-47fa-89ff-fef251760e72 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:53.672566 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8206bbe2-69a7-47fa-89ff-fef251760e72 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:53.686767 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8206bbe2-69a7-47fa-89ff-fef251760e72 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5" status: 200 len: 1457 microversion: 2.1 time: 0.172552 Jun 10 18:12:53.687641 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2272/4390] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:53 2022] GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5 => generated 1457 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:12:54.194230 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-df0c6281-cbfb-4bdb-a33a-f13076f6266a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:54.194230 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-df0c6281-cbfb-4bdb-a33a-f13076f6266a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1528 microversion: 2.1 time: 0.530308 Jun 10 18:12:54.194230 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2119/4391] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:53 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1528 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:54.194230 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-46f6bb9b-e045-4b90-8e69-e18aaa252ec4 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:54.194230 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-46f6bb9b-e045-4b90-8e69-e18aaa252ec4 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] [instance: 07a5fadb-9316-44c9-9c5e-c8f26050d4d2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:54.194230 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-46f6bb9b-e045-4b90-8e69-e18aaa252ec4 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:54.194230 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-46f6bb9b-e045-4b90-8e69-e18aaa252ec4 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:54.194230 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-46f6bb9b-e045-4b90-8e69-e18aaa252ec4 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:54.194230 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-46f6bb9b-e045-4b90-8e69-e18aaa252ec4 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:54.197977 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-5cc7b94f-bc8b-4f01-a780-05e6582b2a45 req-eeba7dc6-93a4-4996-8eb6-6a194025239d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aff760b6-7b66-40e8-b266-dcfa79ca41b5", "name": "network-vif-deleted", "tag": "bfa33665-db46-494c-8f4a-886c29dba2fb"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:54.198473 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-46f6bb9b-e045-4b90-8e69-e18aaa252ec4 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2fe556bf10c4d69a86a325d60da6aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534acf4edf9247dea63a9387e0cd0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:54.199493 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-5cc7b94f-bc8b-4f01-a780-05e6582b2a45 req-eeba7dc6-93a4-4996-8eb6-6a194025239d service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:54.199771 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-46f6bb9b-e045-4b90-8e69-e18aaa252ec4 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] 10.222.0.35 "GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2" status: 200 len: 1429 microversion: 2.1 time: 0.218226 Jun 10 18:12:54.199771 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2120/4392] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:53 2022] GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2 => generated 1429 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:54.199968 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-5cc7b94f-bc8b-4f01-a780-05e6582b2a45 req-eeba7dc6-93a4-4996-8eb6-6a194025239d service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:54.200071 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a2fa0f68-712b-43a6-a112-7eddbea86d55 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:54.200071 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a2fa0f68-712b-43a6-a112-7eddbea86d55 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 551856e9-a45b-412d-979d-b14039d74fea] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:54.200265 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-5cc7b94f-bc8b-4f01-a780-05e6582b2a45 req-eeba7dc6-93a4-4996-8eb6-6a194025239d service nova] Creating event network-vif-deleted:bfa33665-db46-494c-8f4a-886c29dba2fb for instance aff760b6-7b66-40e8-b266-dcfa79ca41b5 on chh2-master-2 Jun 10 18:12:54.204676 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-5cc7b94f-bc8b-4f01-a780-05e6582b2a45 req-eeba7dc6-93a4-4996-8eb6-6a194025239d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.498654 Jun 10 18:12:54.208808 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2273/4393] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:12:54.214775 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7746bb9a-0372-4fb3-8e44-a1983e587129 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:54.215735 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7746bb9a-0372-4fb3-8e44-a1983e587129 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:54.226232 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7746bb9a-0372-4fb3-8e44-a1983e587129 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:54.227109 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7746bb9a-0372-4fb3-8e44-a1983e587129 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:54.228228 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7746bb9a-0372-4fb3-8e44-a1983e587129 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:54.229053 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7746bb9a-0372-4fb3-8e44-a1983e587129 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:54.282571 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a2fa0f68-712b-43a6-a112-7eddbea86d55 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:54.303858 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a2fa0f68-712b-43a6-a112-7eddbea86d55 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea" status: 200 len: 1224 microversion: 2.1 time: 0.135555 Jun 10 18:12:54.317762 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2121/4394] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:54 2022] GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea => generated 1224 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:54.498678 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7746bb9a-0372-4fb3-8e44-a1983e587129 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:54.508704 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7746bb9a-0372-4fb3-8e44-a1983e587129 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca" status: 200 len: 1519 microversion: 2.1 time: 0.298319 Jun 10 18:12:54.519861 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2274/4395] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:54 2022] GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca => generated 1519 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:54.710035 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-28d6dd0d-0a8b-4d35-ab47-2e56233358b1 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:54.710959 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-28d6dd0d-0a8b-4d35-ab47-2e56233358b1 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: aff760b6-7b66-40e8-b266-dcfa79ca41b5] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:54.725240 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-28d6dd0d-0a8b-4d35-ab47-2e56233358b1 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:54.726513 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-28d6dd0d-0a8b-4d35-ab47-2e56233358b1 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:54.731119 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-28d6dd0d-0a8b-4d35-ab47-2e56233358b1 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:54.731119 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-28d6dd0d-0a8b-4d35-ab47-2e56233358b1 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:54.775160 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-28d6dd0d-0a8b-4d35-ab47-2e56233358b1 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:54.776040 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-28d6dd0d-0a8b-4d35-ab47-2e56233358b1 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:54.777219 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-28d6dd0d-0a8b-4d35-ab47-2e56233358b1 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lazy-loading 'fault' on Instance uuid aff760b6-7b66-40e8-b266-dcfa79ca41b5 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:12:54.838108 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-28d6dd0d-0a8b-4d35-ab47-2e56233358b1 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8166793f60ee479689b4a21457b71d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457c4a300936498b9e8b61645e655751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:54.847983 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-28d6dd0d-0a8b-4d35-ab47-2e56233358b1 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5" status: 200 len: 1305 microversion: 2.1 time: 0.143864 Jun 10 18:12:54.858899 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2122/4396] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:54 2022] GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5 => generated 1305 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:12:55.212149 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-aaf128b1-f821-4bc2-98c0-605b268df02c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:55.212718 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-871167ef-2d7a-436f-b4ee-b6c830d573f1 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:55.213349 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-871167ef-2d7a-436f-b4ee-b6c830d573f1 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] [instance: 07a5fadb-9316-44c9-9c5e-c8f26050d4d2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:55.214485 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-aaf128b1-f821-4bc2-98c0-605b268df02c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:55.224425 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-871167ef-2d7a-436f-b4ee-b6c830d573f1 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:55.224780 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-871167ef-2d7a-436f-b4ee-b6c830d573f1 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:55.225573 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-871167ef-2d7a-436f-b4ee-b6c830d573f1 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:55.226025 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-871167ef-2d7a-436f-b4ee-b6c830d573f1 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:55.227383 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aaf128b1-f821-4bc2-98c0-605b268df02c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:55.228081 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aaf128b1-f821-4bc2-98c0-605b268df02c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:55.229559 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aaf128b1-f821-4bc2-98c0-605b268df02c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:55.230471 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aaf128b1-f821-4bc2-98c0-605b268df02c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:55.303016 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-871167ef-2d7a-436f-b4ee-b6c830d573f1 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:55.303752 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-871167ef-2d7a-436f-b4ee-b6c830d573f1 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:55.304411 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-871167ef-2d7a-436f-b4ee-b6c830d573f1 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lazy-loading 'fault' on Instance uuid 07a5fadb-9316-44c9-9c5e-c8f26050d4d2 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:12:55.307988 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:12:55.356296 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-871167ef-2d7a-436f-b4ee-b6c830d573f1 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2fe556bf10c4d69a86a325d60da6aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534acf4edf9247dea63a9387e0cd0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:55.366814 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-871167ef-2d7a-436f-b4ee-b6c830d573f1 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] 10.222.0.35 "GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2" status: 200 len: 1305 microversion: 2.1 time: 0.163872 Jun 10 18:12:55.367669 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2123/4397] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:55 2022] GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2 => generated 1305 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:55.387760 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d8c8d681-06d0-4632-b1f2-0cccf972c186 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:55.402664 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d8c8d681-06d0-4632-b1f2-0cccf972c186 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 551856e9-a45b-412d-979d-b14039d74fea] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:55.432768 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d8c8d681-06d0-4632-b1f2-0cccf972c186 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:55.433566 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d8c8d681-06d0-4632-b1f2-0cccf972c186 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:55.435210 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d8c8d681-06d0-4632-b1f2-0cccf972c186 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:55.435210 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d8c8d681-06d0-4632-b1f2-0cccf972c186 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:55.451604 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-aaf128b1-f821-4bc2-98c0-605b268df02c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:55.460294 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-aaf128b1-f821-4bc2-98c0-605b268df02c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1528 microversion: 2.1 time: 0.255874 Jun 10 18:12:55.461533 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2275/4398] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:55 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1528 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:55.527487 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-03128f7d-ed9d-4863-8384-d10a36b3345a tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:55.528208 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-03128f7d-ed9d-4863-8384-d10a36b3345a tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:55.539314 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d8c8d681-06d0-4632-b1f2-0cccf972c186 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:55.550398 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-03128f7d-ed9d-4863-8384-d10a36b3345a tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:55.559641 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-03128f7d-ed9d-4863-8384-d10a36b3345a tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:55.559641 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-03128f7d-ed9d-4863-8384-d10a36b3345a tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:55.559641 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-03128f7d-ed9d-4863-8384-d10a36b3345a tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:55.560000 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d8c8d681-06d0-4632-b1f2-0cccf972c186 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea" status: 200 len: 1220 microversion: 2.1 time: 0.183691 Jun 10 18:12:55.560000 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2124/4399] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:55 2022] GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea => generated 1220 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:55.774725 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-03128f7d-ed9d-4863-8384-d10a36b3345a tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:55.784778 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-03128f7d-ed9d-4863-8384-d10a36b3345a tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca" status: 200 len: 1519 microversion: 2.1 time: 0.261192 Jun 10 18:12:55.786149 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2276/4400] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:55 2022] GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca => generated 1519 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:55.866251 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-98aaa424-8b46-4809-93a3-ab885c4d67e9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:55.867262 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-98aaa424-8b46-4809-93a3-ab885c4d67e9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: aff760b6-7b66-40e8-b266-dcfa79ca41b5] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:55.876949 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-98aaa424-8b46-4809-93a3-ab885c4d67e9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:55.878136 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-98aaa424-8b46-4809-93a3-ab885c4d67e9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:55.879191 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-98aaa424-8b46-4809-93a3-ab885c4d67e9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:55.880360 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-98aaa424-8b46-4809-93a3-ab885c4d67e9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:55.898347 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-98aaa424-8b46-4809-93a3-ab885c4d67e9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] HTTP exception thrown: Instance aff760b6-7b66-40e8-b266-dcfa79ca41b5 could not be found. Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-98aaa424-8b46-4809-93a3-ab885c4d67e9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Request method failure captured: Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5 HTTP/1.1 Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4h5IGwn2s1svunn67FxK1RLA1ZXNP7yhKtLh1eaKFO5RiF1I7YeJHWcfSjdUGMBWYC3nFgfMdv1-bfem3ewEozYf-uHKxgVE7ziplyuJN8iPaP89LX8AXS1cyKZcnxByDcQMqTPs4bimJxM1lNaVEmx4VPDZsfMeZBdbBH4r5hYsr8 Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/457c4a300936498b9e8b61645e655751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "tempest-type-1142384015", "name": "tempest-service-1838487701", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_457c4a300936498b9e8b61645e655751", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 8166793f60ee479689b4a21457b71d07 Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: exception: Instance aff760b6-7b66-40e8-b266-dcfa79ca41b5 could not be found. Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'aff760b6-7b66-40e8-b266-dcfa79ca41b5'} Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aff760b6-7b66-40e8-b266-dcfa79ca41b5 could not be found. Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aff760b6-7b66-40e8-b266-dcfa79ca41b5 could not be found. Jun 10 18:12:55.911027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:55.918027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:55.918027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:55.918027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:55.918027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:55.918027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:55.918027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:12:55.918027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:12:55.918027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aff760b6-7b66-40e8-b266-dcfa79ca41b5 could not be found. Jun 10 18:12:55.918027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:55.918027 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-98aaa424-8b46-4809-93a3-ab885c4d67e9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Returning 404 to user: Instance aff760b6-7b66-40e8-b266-dcfa79ca41b5 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:12:55.918027 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-98aaa424-8b46-4809-93a3-ab885c4d67e9 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5" status: 404 len: 111 microversion: 2.1 time: 0.040171 Jun 10 18:12:55.918027 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2125/4401] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:55 2022] GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:12:55.919732 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-659d8d80-464e-4b3b-a970-4bdd3e2bbab6 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:55.920505 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-659d8d80-464e-4b3b-a970-4bdd3e2bbab6 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: aff760b6-7b66-40e8-b266-dcfa79ca41b5] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:55.933217 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-659d8d80-464e-4b3b-a970-4bdd3e2bbab6 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:55.933884 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-659d8d80-464e-4b3b-a970-4bdd3e2bbab6 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:55.937716 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-659d8d80-464e-4b3b-a970-4bdd3e2bbab6 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:55.938289 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-659d8d80-464e-4b3b-a970-4bdd3e2bbab6 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:55.960526 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-659d8d80-464e-4b3b-a970-4bdd3e2bbab6 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] HTTP exception thrown: Instance aff760b6-7b66-40e8-b266-dcfa79ca41b5 could not be found. Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-659d8d80-464e-4b3b-a970-4bdd3e2bbab6 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Request method failure captured: Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: request: DELETE /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5 HTTP/1.1 Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4h5IGwn2s1svunn67FxK1RLA1ZXNP7yhKtLh1eaKFO5RiF1I7YeJHWcfSjdUGMBWYC3nFgfMdv1-bfem3ewEozYf-uHKxgVE7ziplyuJN8iPaP89LX8AXS1cyKZcnxByDcQMqTPs4bimJxM1lNaVEmx4VPDZsfMeZBdbBH4r5hYsr8 Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/457c4a300936498b9e8b61645e655751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "tempest-type-1142384015", "name": "tempest-service-1838487701", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_457c4a300936498b9e8b61645e655751", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 8166793f60ee479689b4a21457b71d07 Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: exception: Instance aff760b6-7b66-40e8-b266-dcfa79ca41b5 could not be found. Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'aff760b6-7b66-40e8-b266-dcfa79ca41b5'} Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aff760b6-7b66-40e8-b266-dcfa79ca41b5 could not be found. Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:12:55.962518 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:12:55.966872 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aff760b6-7b66-40e8-b266-dcfa79ca41b5 could not be found. Jun 10 18:12:55.966872 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:55.966872 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:55.966872 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:55.966872 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:55.966872 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:55.966872 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:55.966872 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:12:55.966872 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:12:55.966872 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aff760b6-7b66-40e8-b266-dcfa79ca41b5 could not be found. Jun 10 18:12:55.966872 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:55.966872 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-659d8d80-464e-4b3b-a970-4bdd3e2bbab6 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Returning 404 to user: Instance aff760b6-7b66-40e8-b266-dcfa79ca41b5 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:12:55.966872 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-659d8d80-464e-4b3b-a970-4bdd3e2bbab6 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "DELETE /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5" status: 404 len: 111 microversion: 2.1 time: 0.054196 Jun 10 18:12:55.966872 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2277/4402] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:12:55 2022] DELETE /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:12:55.974672 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-10f691f8-09af-4993-94c3-6bdeefd0e4d2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:55.975192 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-10f691f8-09af-4993-94c3-6bdeefd0e4d2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: aff760b6-7b66-40e8-b266-dcfa79ca41b5] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:55.984718 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10f691f8-09af-4993-94c3-6bdeefd0e4d2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:55.985370 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10f691f8-09af-4993-94c3-6bdeefd0e4d2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:55.995080 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10f691f8-09af-4993-94c3-6bdeefd0e4d2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:55.995080 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10f691f8-09af-4993-94c3-6bdeefd0e4d2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:56.008239 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-10f691f8-09af-4993-94c3-6bdeefd0e4d2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] HTTP exception thrown: Instance aff760b6-7b66-40e8-b266-dcfa79ca41b5 could not be found. Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-10f691f8-09af-4993-94c3-6bdeefd0e4d2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Request method failure captured: Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5 HTTP/1.1 Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4h5IGwn2s1svunn67FxK1RLA1ZXNP7yhKtLh1eaKFO5RiF1I7YeJHWcfSjdUGMBWYC3nFgfMdv1-bfem3ewEozYf-uHKxgVE7ziplyuJN8iPaP89LX8AXS1cyKZcnxByDcQMqTPs4bimJxM1lNaVEmx4VPDZsfMeZBdbBH4r5hYsr8 Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/457c4a300936498b9e8b61645e655751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "tempest-type-1142384015", "name": "tempest-service-1838487701", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_457c4a300936498b9e8b61645e655751", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 8166793f60ee479689b4a21457b71d07 Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: exception: Instance aff760b6-7b66-40e8-b266-dcfa79ca41b5 could not be found. Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'aff760b6-7b66-40e8-b266-dcfa79ca41b5'} Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aff760b6-7b66-40e8-b266-dcfa79ca41b5 could not be found. Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aff760b6-7b66-40e8-b266-dcfa79ca41b5 could not be found. Jun 10 18:12:56.010047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.014905 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:56.014905 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.014905 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.014905 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:56.014905 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:56.014905 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:12:56.014905 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:12:56.014905 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aff760b6-7b66-40e8-b266-dcfa79ca41b5 could not be found. Jun 10 18:12:56.014905 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.014905 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-10f691f8-09af-4993-94c3-6bdeefd0e4d2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Returning 404 to user: Instance aff760b6-7b66-40e8-b266-dcfa79ca41b5 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:12:56.014905 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-10f691f8-09af-4993-94c3-6bdeefd0e4d2 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5" status: 404 len: 111 microversion: 2.1 time: 0.043954 Jun 10 18:12:56.016601 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2126/4403] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:55 2022] GET /compute/v2.1/servers/aff760b6-7b66-40e8-b266-dcfa79ca41b5 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:12:56.030233 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0bdf797e-f36b-4881-bf49-8eaf07a8ae84 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:56.033051 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0bdf797e-f36b-4881-bf49-8eaf07a8ae84 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:56.038999 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0bdf797e-f36b-4881-bf49-8eaf07a8ae84 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:56.039634 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0bdf797e-f36b-4881-bf49-8eaf07a8ae84 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:56.040730 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0bdf797e-f36b-4881-bf49-8eaf07a8ae84 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:56.041453 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0bdf797e-f36b-4881-bf49-8eaf07a8ae84 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:56.060211 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-0bdf797e-f36b-4881-bf49-8eaf07a8ae84 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] HTTP exception thrown: Instance 4f0a3407-710b-426e-8909-3395a119f559 could not be found. Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0bdf797e-f36b-4881-bf49-8eaf07a8ae84 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Request method failure captured: Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: request: DELETE /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 HTTP/1.1 Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4h5IGwn2s1svunn67FxK1RLA1ZXNP7yhKtLh1eaKFO5RiF1I7YeJHWcfSjdUGMBWYC3nFgfMdv1-bfem3ewEozYf-uHKxgVE7ziplyuJN8iPaP89LX8AXS1cyKZcnxByDcQMqTPs4bimJxM1lNaVEmx4VPDZsfMeZBdbBH4r5hYsr8 Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/457c4a300936498b9e8b61645e655751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "tempest-type-1142384015", "name": "tempest-service-1838487701", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_457c4a300936498b9e8b61645e655751", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 8166793f60ee479689b4a21457b71d07 Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 4f0a3407-710b-426e-8909-3395a119f559 could not be found. Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '4f0a3407-710b-426e-8909-3395a119f559'} Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f0a3407-710b-426e-8909-3395a119f559 could not be found. Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:12:56.063416 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:12:56.068826 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f0a3407-710b-426e-8909-3395a119f559 could not be found. Jun 10 18:12:56.068826 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.068826 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:56.068826 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.068826 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.068826 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:56.068826 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:56.068826 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:12:56.068826 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:12:56.068826 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f0a3407-710b-426e-8909-3395a119f559 could not be found. Jun 10 18:12:56.068826 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.068826 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0bdf797e-f36b-4881-bf49-8eaf07a8ae84 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Returning 404 to user: Instance 4f0a3407-710b-426e-8909-3395a119f559 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:12:56.068826 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0bdf797e-f36b-4881-bf49-8eaf07a8ae84 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "DELETE /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559" status: 404 len: 111 microversion: 2.1 time: 0.043974 Jun 10 18:12:56.068826 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2278/4404] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:12:56 2022] DELETE /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:12:56.077112 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0cdbfbf5-1f87-4510-a52f-6424ca080a9c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:56.077835 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0cdbfbf5-1f87-4510-a52f-6424ca080a9c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 4f0a3407-710b-426e-8909-3395a119f559] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:56.085792 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0cdbfbf5-1f87-4510-a52f-6424ca080a9c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:56.086767 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0cdbfbf5-1f87-4510-a52f-6424ca080a9c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:56.087940 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0cdbfbf5-1f87-4510-a52f-6424ca080a9c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:56.088686 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0cdbfbf5-1f87-4510-a52f-6424ca080a9c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:56.109374 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-0cdbfbf5-1f87-4510-a52f-6424ca080a9c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] HTTP exception thrown: Instance 4f0a3407-710b-426e-8909-3395a119f559 could not be found. Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0cdbfbf5-1f87-4510-a52f-6424ca080a9c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Request method failure captured: Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 HTTP/1.1 Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4h5IGwn2s1svunn67FxK1RLA1ZXNP7yhKtLh1eaKFO5RiF1I7YeJHWcfSjdUGMBWYC3nFgfMdv1-bfem3ewEozYf-uHKxgVE7ziplyuJN8iPaP89LX8AXS1cyKZcnxByDcQMqTPs4bimJxM1lNaVEmx4VPDZsfMeZBdbBH4r5hYsr8 Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/457c4a300936498b9e8b61645e655751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "tempest-type-1142384015", "name": "tempest-service-1838487701", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_457c4a300936498b9e8b61645e655751", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 8166793f60ee479689b4a21457b71d07 Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 4f0a3407-710b-426e-8909-3395a119f559 could not be found. Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '4f0a3407-710b-426e-8909-3395a119f559'} Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f0a3407-710b-426e-8909-3395a119f559 could not be found. Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f0a3407-710b-426e-8909-3395a119f559 could not be found. Jun 10 18:12:56.111781 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.121719 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:56.121719 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.121719 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.121719 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:56.121719 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:56.121719 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:12:56.121719 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:12:56.121719 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f0a3407-710b-426e-8909-3395a119f559 could not be found. Jun 10 18:12:56.121719 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.121719 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0cdbfbf5-1f87-4510-a52f-6424ca080a9c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Returning 404 to user: Instance 4f0a3407-710b-426e-8909-3395a119f559 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:12:56.121719 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0cdbfbf5-1f87-4510-a52f-6424ca080a9c tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559" status: 404 len: 111 microversion: 2.1 time: 0.041453 Jun 10 18:12:56.121719 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2127/4405] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:56 2022] GET /compute/v2.1/servers/4f0a3407-710b-426e-8909-3395a119f559 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:12:56.126703 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b5cf9c92-31dc-49a5-95de-b6b2ea04ace3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:56.127607 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b5cf9c92-31dc-49a5-95de-b6b2ea04ace3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:56.135479 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5cf9c92-31dc-49a5-95de-b6b2ea04ace3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:56.135951 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5cf9c92-31dc-49a5-95de-b6b2ea04ace3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:56.137556 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5cf9c92-31dc-49a5-95de-b6b2ea04ace3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:56.138012 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5cf9c92-31dc-49a5-95de-b6b2ea04ace3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:56.161115 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-b5cf9c92-31dc-49a5-95de-b6b2ea04ace3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] HTTP exception thrown: Instance 7d514aab-bc5c-462a-a759-6182effadcbe could not be found. Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b5cf9c92-31dc-49a5-95de-b6b2ea04ace3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Request method failure captured: Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: request: DELETE /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe HTTP/1.1 Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4h5IGwn2s1svunn67FxK1RLA1ZXNP7yhKtLh1eaKFO5RiF1I7YeJHWcfSjdUGMBWYC3nFgfMdv1-bfem3ewEozYf-uHKxgVE7ziplyuJN8iPaP89LX8AXS1cyKZcnxByDcQMqTPs4bimJxM1lNaVEmx4VPDZsfMeZBdbBH4r5hYsr8 Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/457c4a300936498b9e8b61645e655751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "tempest-type-1142384015", "name": "tempest-service-1838487701", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_457c4a300936498b9e8b61645e655751", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 8166793f60ee479689b4a21457b71d07 Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 7d514aab-bc5c-462a-a759-6182effadcbe could not be found. Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '7d514aab-bc5c-462a-a759-6182effadcbe'} Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d514aab-bc5c-462a-a759-6182effadcbe could not be found. Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:12:56.162874 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:12:56.167782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d514aab-bc5c-462a-a759-6182effadcbe could not be found. Jun 10 18:12:56.167782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.167782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:56.167782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.167782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.167782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:56.167782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:56.167782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:12:56.167782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:12:56.167782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d514aab-bc5c-462a-a759-6182effadcbe could not be found. Jun 10 18:12:56.167782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.167782 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b5cf9c92-31dc-49a5-95de-b6b2ea04ace3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Returning 404 to user: Instance 7d514aab-bc5c-462a-a759-6182effadcbe could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:12:56.169675 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b5cf9c92-31dc-49a5-95de-b6b2ea04ace3 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "DELETE /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 404 len: 111 microversion: 2.1 time: 0.050170 Jun 10 18:12:56.170361 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2279/4406] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:12:56 2022] DELETE /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:12:56.183640 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-98e630ce-15cb-455d-8eed-90b496925e2d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:56.187666 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-98e630ce-15cb-455d-8eed-90b496925e2d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: 7d514aab-bc5c-462a-a759-6182effadcbe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:56.195749 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-98e630ce-15cb-455d-8eed-90b496925e2d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:56.196663 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-98e630ce-15cb-455d-8eed-90b496925e2d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:56.198423 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-98e630ce-15cb-455d-8eed-90b496925e2d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:56.199248 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-98e630ce-15cb-455d-8eed-90b496925e2d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:56.216272 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-98e630ce-15cb-455d-8eed-90b496925e2d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] HTTP exception thrown: Instance 7d514aab-bc5c-462a-a759-6182effadcbe could not be found. Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-98e630ce-15cb-455d-8eed-90b496925e2d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Request method failure captured: Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe HTTP/1.1 Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4h5IGwn2s1svunn67FxK1RLA1ZXNP7yhKtLh1eaKFO5RiF1I7YeJHWcfSjdUGMBWYC3nFgfMdv1-bfem3ewEozYf-uHKxgVE7ziplyuJN8iPaP89LX8AXS1cyKZcnxByDcQMqTPs4bimJxM1lNaVEmx4VPDZsfMeZBdbBH4r5hYsr8 Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/457c4a300936498b9e8b61645e655751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "tempest-type-1142384015", "name": "tempest-service-1838487701", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_457c4a300936498b9e8b61645e655751", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 8166793f60ee479689b4a21457b71d07 Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 7d514aab-bc5c-462a-a759-6182effadcbe could not be found. Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '7d514aab-bc5c-462a-a759-6182effadcbe'} Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d514aab-bc5c-462a-a759-6182effadcbe could not be found. Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d514aab-bc5c-462a-a759-6182effadcbe could not be found. Jun 10 18:12:56.221807 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.227175 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:56.227175 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.227175 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.227175 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:56.227175 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:56.227175 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:12:56.227175 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:12:56.227175 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d514aab-bc5c-462a-a759-6182effadcbe could not be found. Jun 10 18:12:56.227175 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.227175 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-98e630ce-15cb-455d-8eed-90b496925e2d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Returning 404 to user: Instance 7d514aab-bc5c-462a-a759-6182effadcbe could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:12:56.227175 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-98e630ce-15cb-455d-8eed-90b496925e2d tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe" status: 404 len: 111 microversion: 2.1 time: 0.047856 Jun 10 18:12:56.228712 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2128/4407] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:56 2022] GET /compute/v2.1/servers/7d514aab-bc5c-462a-a759-6182effadcbe => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:12:56.229443 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-5f623d91-26fb-4117-8186-ef9f1deb6bb2 req-7106d23a-8f17-44b7-b370-1d55ee3f8a6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07a5fadb-9316-44c9-9c5e-c8f26050d4d2", "name": "network-vif-deleted", "tag": "4e6d3802-ba65-4c7d-a7e9-c731019ecea3"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:56.233578 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8852ad7c-a5e0-4513-b183-87d87d3b725b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:56.234253 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8852ad7c-a5e0-4513-b183-87d87d3b725b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: db7ba61a-bb40-4246-91fb-426ccc9da491] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:56.244929 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8852ad7c-a5e0-4513-b183-87d87d3b725b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:56.245449 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8852ad7c-a5e0-4513-b183-87d87d3b725b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:56.246181 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8852ad7c-a5e0-4513-b183-87d87d3b725b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:56.246681 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8852ad7c-a5e0-4513-b183-87d87d3b725b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:56.252659 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-5f623d91-26fb-4117-8186-ef9f1deb6bb2 req-7106d23a-8f17-44b7-b370-1d55ee3f8a6d service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:56.253236 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-5f623d91-26fb-4117-8186-ef9f1deb6bb2 req-7106d23a-8f17-44b7-b370-1d55ee3f8a6d service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:56.268279 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-5f623d91-26fb-4117-8186-ef9f1deb6bb2 req-7106d23a-8f17-44b7-b370-1d55ee3f8a6d service nova] Creating event network-vif-deleted:4e6d3802-ba65-4c7d-a7e9-c731019ecea3 for instance 07a5fadb-9316-44c9-9c5e-c8f26050d4d2 on chh2-master-2 Jun 10 18:12:56.271563 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-8852ad7c-a5e0-4513-b183-87d87d3b725b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] HTTP exception thrown: Instance db7ba61a-bb40-4246-91fb-426ccc9da491 could not be found. Jun 10 18:12:56.273999 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-5f623d91-26fb-4117-8186-ef9f1deb6bb2 req-7106d23a-8f17-44b7-b370-1d55ee3f8a6d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055778 Jun 10 18:12:56.274889 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2280/4408] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8852ad7c-a5e0-4513-b183-87d87d3b725b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Request method failure captured: Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491 HTTP/1.1 Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4h5IGwn2s1svunn67FxK1RLA1ZXNP7yhKtLh1eaKFO5RiF1I7YeJHWcfSjdUGMBWYC3nFgfMdv1-bfem3ewEozYf-uHKxgVE7ziplyuJN8iPaP89LX8AXS1cyKZcnxByDcQMqTPs4bimJxM1lNaVEmx4VPDZsfMeZBdbBH4r5hYsr8 Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/457c4a300936498b9e8b61645e655751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "tempest-type-1142384015", "name": "tempest-service-1838487701", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_457c4a300936498b9e8b61645e655751", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 8166793f60ee479689b4a21457b71d07 Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: exception: Instance db7ba61a-bb40-4246-91fb-426ccc9da491 could not be found. Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'db7ba61a-bb40-4246-91fb-426ccc9da491'} Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db7ba61a-bb40-4246-91fb-426ccc9da491 could not be found. Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:12:56.276249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:12:56.280355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db7ba61a-bb40-4246-91fb-426ccc9da491 could not be found. Jun 10 18:12:56.280355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.280355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:56.280355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.280355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.280355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:56.280355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:56.280355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:12:56.280355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:12:56.280355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db7ba61a-bb40-4246-91fb-426ccc9da491 could not be found. Jun 10 18:12:56.280355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.280355 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8852ad7c-a5e0-4513-b183-87d87d3b725b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Returning 404 to user: Instance db7ba61a-bb40-4246-91fb-426ccc9da491 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:12:56.280355 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8852ad7c-a5e0-4513-b183-87d87d3b725b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "DELETE /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491" status: 404 len: 111 microversion: 2.1 time: 0.049014 Jun 10 18:12:56.280355 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2129/4409] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:12:56 2022] DELETE /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:12:56.290238 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9fe1d8f5-3c49-452e-873b-2552e1c6f2f4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:56.306795 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9fe1d8f5-3c49-452e-873b-2552e1c6f2f4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: db7ba61a-bb40-4246-91fb-426ccc9da491] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:56.306795 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9fe1d8f5-3c49-452e-873b-2552e1c6f2f4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:56.306795 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9fe1d8f5-3c49-452e-873b-2552e1c6f2f4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:56.306795 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9fe1d8f5-3c49-452e-873b-2552e1c6f2f4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:56.306795 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9fe1d8f5-3c49-452e-873b-2552e1c6f2f4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:56.336389 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-9fe1d8f5-3c49-452e-873b-2552e1c6f2f4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] HTTP exception thrown: Instance db7ba61a-bb40-4246-91fb-426ccc9da491 could not be found. Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9fe1d8f5-3c49-452e-873b-2552e1c6f2f4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Request method failure captured: Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491 HTTP/1.1 Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4h5IGwn2s1svunn67FxK1RLA1ZXNP7yhKtLh1eaKFO5RiF1I7YeJHWcfSjdUGMBWYC3nFgfMdv1-bfem3ewEozYf-uHKxgVE7ziplyuJN8iPaP89LX8AXS1cyKZcnxByDcQMqTPs4bimJxM1lNaVEmx4VPDZsfMeZBdbBH4r5hYsr8 Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/457c4a300936498b9e8b61645e655751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "tempest-type-1142384015", "name": "tempest-service-1838487701", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_457c4a300936498b9e8b61645e655751", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 8166793f60ee479689b4a21457b71d07 Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: exception: Instance db7ba61a-bb40-4246-91fb-426ccc9da491 could not be found. Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'db7ba61a-bb40-4246-91fb-426ccc9da491'} Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db7ba61a-bb40-4246-91fb-426ccc9da491 could not be found. Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db7ba61a-bb40-4246-91fb-426ccc9da491 could not be found. Jun 10 18:12:56.338597 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.343405 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:56.343405 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.343405 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.343405 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:56.343405 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:56.343405 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:12:56.343405 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:12:56.343405 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db7ba61a-bb40-4246-91fb-426ccc9da491 could not be found. Jun 10 18:12:56.343405 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.345091 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9fe1d8f5-3c49-452e-873b-2552e1c6f2f4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Returning 404 to user: Instance db7ba61a-bb40-4246-91fb-426ccc9da491 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:12:56.346169 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9fe1d8f5-3c49-452e-873b-2552e1c6f2f4 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491" status: 404 len: 111 microversion: 2.1 time: 0.060941 Jun 10 18:12:56.365645 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-953defba-7013-4882-90ec-4ae404132376 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:56.365645 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-953defba-7013-4882-90ec-4ae404132376 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: f8f45b46-fa33-45f4-8361-a67a3734b084] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:56.365869 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2281/4410] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:56 2022] GET /compute/v2.1/servers/db7ba61a-bb40-4246-91fb-426ccc9da491 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-953defba-7013-4882-90ec-4ae404132376 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] HTTP exception thrown: Instance f8f45b46-fa33-45f4-8361-a67a3734b084 could not be found. Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-953defba-7013-4882-90ec-4ae404132376 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Request method failure captured: Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/f8f45b46-fa33-45f4-8361-a67a3734b084 HTTP/1.1 Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4h5IGwn2s1svunn67FxK1RLA1ZXNP7yhKtLh1eaKFO5RiF1I7YeJHWcfSjdUGMBWYC3nFgfMdv1-bfem3ewEozYf-uHKxgVE7ziplyuJN8iPaP89LX8AXS1cyKZcnxByDcQMqTPs4bimJxM1lNaVEmx4VPDZsfMeZBdbBH4r5hYsr8 Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/457c4a300936498b9e8b61645e655751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "tempest-type-1142384015", "name": "tempest-service-1838487701", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_457c4a300936498b9e8b61645e655751", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 8166793f60ee479689b4a21457b71d07 Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: exception: Instance f8f45b46-fa33-45f4-8361-a67a3734b084 could not be found. Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'f8f45b46-fa33-45f4-8361-a67a3734b084'} Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8f45b46-fa33-45f4-8361-a67a3734b084 could not be found. Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:12:56.365968 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:12:56.370726 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:12:56.370726 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8f45b46-fa33-45f4-8361-a67a3734b084 could not be found. Jun 10 18:12:56.370726 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.370726 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:56.370726 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.370726 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.370726 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:56.370726 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:56.370726 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:12:56.370726 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:12:56.370726 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8f45b46-fa33-45f4-8361-a67a3734b084 could not be found. Jun 10 18:12:56.370726 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.370726 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-953defba-7013-4882-90ec-4ae404132376 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Returning 404 to user: Instance f8f45b46-fa33-45f4-8361-a67a3734b084 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:12:56.370726 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-953defba-7013-4882-90ec-4ae404132376 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "DELETE /compute/v2.1/servers/f8f45b46-fa33-45f4-8361-a67a3734b084" status: 404 len: 111 microversion: 2.1 time: 0.015502 Jun 10 18:12:56.375842 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9de160e0-6ca6-4d3e-b1ba-854947c0f234 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:56.376769 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9de160e0-6ca6-4d3e-b1ba-854947c0f234 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: f8f45b46-fa33-45f4-8361-a67a3734b084] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:56.379161 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2130/4411] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:12:56 2022] DELETE /compute/v2.1/servers/f8f45b46-fa33-45f4-8361-a67a3734b084 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:12:56.400196 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2e20b294-4ecb-4d52-af82-8d69cc9ae074 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:56.400934 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2e20b294-4ecb-4d52-af82-8d69cc9ae074 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] [instance: 07a5fadb-9316-44c9-9c5e-c8f26050d4d2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:56.402716 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-9de160e0-6ca6-4d3e-b1ba-854947c0f234 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] HTTP exception thrown: Instance f8f45b46-fa33-45f4-8361-a67a3734b084 could not be found. Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9de160e0-6ca6-4d3e-b1ba-854947c0f234 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Request method failure captured: Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/f8f45b46-fa33-45f4-8361-a67a3734b084 HTTP/1.1 Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4h5IGwn2s1svunn67FxK1RLA1ZXNP7yhKtLh1eaKFO5RiF1I7YeJHWcfSjdUGMBWYC3nFgfMdv1-bfem3ewEozYf-uHKxgVE7ziplyuJN8iPaP89LX8AXS1cyKZcnxByDcQMqTPs4bimJxM1lNaVEmx4VPDZsfMeZBdbBH4r5hYsr8 Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/457c4a300936498b9e8b61645e655751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "tempest-type-1142384015", "name": "tempest-service-1838487701", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_457c4a300936498b9e8b61645e655751", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 8166793f60ee479689b4a21457b71d07 Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: exception: Instance f8f45b46-fa33-45f4-8361-a67a3734b084 could not be found. Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'f8f45b46-fa33-45f4-8361-a67a3734b084'} Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8f45b46-fa33-45f4-8361-a67a3734b084 could not be found. Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8f45b46-fa33-45f4-8361-a67a3734b084 could not be found. Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.406335 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.411400 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:56.411400 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:56.411400 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:12:56.411400 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:12:56.411400 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8f45b46-fa33-45f4-8361-a67a3734b084 could not be found. Jun 10 18:12:56.411400 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.414446 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9de160e0-6ca6-4d3e-b1ba-854947c0f234 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Returning 404 to user: Instance f8f45b46-fa33-45f4-8361-a67a3734b084 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:12:56.415537 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9de160e0-6ca6-4d3e-b1ba-854947c0f234 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/f8f45b46-fa33-45f4-8361-a67a3734b084" status: 404 len: 111 microversion: 2.1 time: 0.043632 Jun 10 18:12:56.416557 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e20b294-4ecb-4d52-af82-8d69cc9ae074 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:56.417036 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e20b294-4ecb-4d52-af82-8d69cc9ae074 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:56.418077 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2282/4412] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:56 2022] GET /compute/v2.1/servers/f8f45b46-fa33-45f4-8361-a67a3734b084 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:12:56.421403 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e20b294-4ecb-4d52-af82-8d69cc9ae074 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:56.421403 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e20b294-4ecb-4d52-af82-8d69cc9ae074 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:56.478536 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-04b7b748-4e1d-4fce-8868-dafc183c2e9f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:56.479493 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-04b7b748-4e1d-4fce-8868-dafc183c2e9f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:56.504768 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-04b7b748-4e1d-4fce-8868-dafc183c2e9f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:56.505905 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-04b7b748-4e1d-4fce-8868-dafc183c2e9f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:56.508213 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-04b7b748-4e1d-4fce-8868-dafc183c2e9f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:56.508886 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-04b7b748-4e1d-4fce-8868-dafc183c2e9f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:56.529125 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-2e20b294-4ecb-4d52-af82-8d69cc9ae074 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] HTTP exception thrown: Instance 07a5fadb-9316-44c9-9c5e-c8f26050d4d2 could not be found. Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2e20b294-4ecb-4d52-af82-8d69cc9ae074 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Request method failure captured: Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2 HTTP/1.1 Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4mDL9yJ7GY6jnWZxRakPLGzcxOPjhgI4QfqHNV_8o00rPC6KvG1D54vV4Y6UOSWJfeWGU_Xgi7BAwqYJ_BOL835xS4vtcAwe25kxxHYUd9R8EjkROfEQVziBNbRsjQ1hVZKbIbodzMZHnozgz_23ra-NQ_3Ls6up8K9lBPRWd2mSTA Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 534acf4edf9247dea63a9387e0cd0e7b Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ImagesNegativeTestJSON-1161356122 Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/534acf4edf9247dea63a9387e0cd0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/534acf4edf9247dea63a9387e0cd0e7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/534acf4edf9247dea63a9387e0cd0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_534acf4edf9247dea63a9387e0cd0e7b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ImagesNegativeTestJSON-1161356122 Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 534acf4edf9247dea63a9387e0cd0e7b Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1161356122 Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ImagesNegativeTestJSON-1161356122-project Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: b2fe556bf10c4d69a86a325d60da6aa7 Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ImagesNegativeTestJSON-1161356122-project Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 07a5fadb-9316-44c9-9c5e-c8f26050d4d2 could not be found. Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '07a5fadb-9316-44c9-9c5e-c8f26050d4d2'} Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07a5fadb-9316-44c9-9c5e-c8f26050d4d2 could not be found. Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07a5fadb-9316-44c9-9c5e-c8f26050d4d2 could not be found. Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:56.535005 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.542906 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.542906 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:56.542906 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:56.542906 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:12:56.542906 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:12:56.542906 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07a5fadb-9316-44c9-9c5e-c8f26050d4d2 could not be found. Jun 10 18:12:56.542906 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.542906 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2e20b294-4ecb-4d52-af82-8d69cc9ae074 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Returning 404 to user: Instance 07a5fadb-9316-44c9-9c5e-c8f26050d4d2 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:12:56.547251 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2e20b294-4ecb-4d52-af82-8d69cc9ae074 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] 10.222.0.35 "GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2" status: 404 len: 111 microversion: 2.1 time: 0.160484 Jun 10 18:12:56.547251 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2131/4413] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:56 2022] GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2 => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:12:56.557084 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-97c36fbc-798c-422b-8df2-56037e118479 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-630796762", "metadata": {"image_type": "test"}}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:56.560353 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-97c36fbc-798c-422b-8df2-56037e118479 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] [instance: 07a5fadb-9316-44c9-9c5e-c8f26050d4d2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:56.572533 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-97c36fbc-798c-422b-8df2-56037e118479 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:56.578508 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-97c36fbc-798c-422b-8df2-56037e118479 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:56.579830 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-97c36fbc-798c-422b-8df2-56037e118479 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:56.581300 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-97c36fbc-798c-422b-8df2-56037e118479 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:56.601862 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-97c36fbc-798c-422b-8df2-56037e118479 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] HTTP exception thrown: Instance 07a5fadb-9316-44c9-9c5e-c8f26050d4d2 could not be found. Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-97c36fbc-798c-422b-8df2-56037e118479 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Request method failure captured: Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2/action HTTP/1.1 Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 111 Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4mDL9yJ7GY6jnWZxRakPLGzcxOPjhgI4QfqHNV_8o00rPC6KvG1D54vV4Y6UOSWJfeWGU_Xgi7BAwqYJ_BOL835xS4vtcAwe25kxxHYUd9R8EjkROfEQVziBNbRsjQ1hVZKbIbodzMZHnozgz_23ra-NQ_3Ls6up8K9lBPRWd2mSTA Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 534acf4edf9247dea63a9387e0cd0e7b Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ImagesNegativeTestJSON-1161356122 Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/534acf4edf9247dea63a9387e0cd0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/534acf4edf9247dea63a9387e0cd0e7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/534acf4edf9247dea63a9387e0cd0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_534acf4edf9247dea63a9387e0cd0e7b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ImagesNegativeTestJSON-1161356122 Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 534acf4edf9247dea63a9387e0cd0e7b Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1161356122 Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ImagesNegativeTestJSON-1161356122-project Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: b2fe556bf10c4d69a86a325d60da6aa7 Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ImagesNegativeTestJSON-1161356122-project Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-630796762", "metadata": {"image_type": "test"}}} Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 07a5fadb-9316-44c9-9c5e-c8f26050d4d2 could not be found. Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '07a5fadb-9316-44c9-9c5e-c8f26050d4d2', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-630796762', 'metadata': {'image_type': 'test'}}}} Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07a5fadb-9316-44c9-9c5e-c8f26050d4d2 could not be found. Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 10 18:12:56.603569 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:12:56.608239 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:12:56.608239 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:12:56.608239 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:12:56.608239 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07a5fadb-9316-44c9-9c5e-c8f26050d4d2 could not be found. Jun 10 18:12:56.608239 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.608239 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:56.608239 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.608239 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.608239 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:56.608239 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:56.608239 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:12:56.608239 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:12:56.608239 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07a5fadb-9316-44c9-9c5e-c8f26050d4d2 could not be found. Jun 10 18:12:56.608239 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.608239 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-97c36fbc-798c-422b-8df2-56037e118479 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Returning 404 to user: Instance 07a5fadb-9316-44c9-9c5e-c8f26050d4d2 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:12:56.608239 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-97c36fbc-798c-422b-8df2-56037e118479 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] 10.222.0.35 "POST /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2/action" status: 404 len: 111 microversion: 2.1 time: 0.052140 Jun 10 18:12:56.611649 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2132/4414] 10.222.0.35 () {60 vars in 1278 bytes} [Fri Jun 10 18:12:56 2022] POST /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2/action => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:12:56.625236 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0516b133-34d3-4339-ac52-12bfc308015d tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:56.626127 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0516b133-34d3-4339-ac52-12bfc308015d tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 551856e9-a45b-412d-979d-b14039d74fea] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:56.635292 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0516b133-34d3-4339-ac52-12bfc308015d tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:56.639007 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0516b133-34d3-4339-ac52-12bfc308015d tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:56.639007 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0516b133-34d3-4339-ac52-12bfc308015d tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:56.639007 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0516b133-34d3-4339-ac52-12bfc308015d tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:56.749377 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-04b7b748-4e1d-4fce-8868-dafc183c2e9f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:56.758958 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-04b7b748-4e1d-4fce-8868-dafc183c2e9f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1528 microversion: 2.1 time: 0.284590 Jun 10 18:12:56.762638 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0516b133-34d3-4339-ac52-12bfc308015d tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:56.768717 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2283/4415] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:56 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1528 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:56.774990 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7b2ef071-69e3-402d-ad8f-51b3f8f71952 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1180825961", "metadata": {"image_type": "test"}}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:56.776299 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7b2ef071-69e3-402d-ad8f-51b3f8f71952 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Failed to fetch instance by id tempest-invalid-487659893 {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 10 18:12:56.777014 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-7b2ef071-69e3-402d-ad8f-51b3f8f71952 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] HTTP exception thrown: Instance tempest-invalid-487659893 could not be found. Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7b2ef071-69e3-402d-ad8f-51b3f8f71952 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Request method failure captured: Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/servers/tempest-invalid-487659893/action HTTP/1.1 Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 112 Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4mDL9yJ7GY6jnWZxRakPLGzcxOPjhgI4QfqHNV_8o00rPC6KvG1D54vV4Y6UOSWJfeWGU_Xgi7BAwqYJ_BOL835xS4vtcAwe25kxxHYUd9R8EjkROfEQVziBNbRsjQ1hVZKbIbodzMZHnozgz_23ra-NQ_3Ls6up8K9lBPRWd2mSTA Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 534acf4edf9247dea63a9387e0cd0e7b Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ImagesNegativeTestJSON-1161356122 Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/534acf4edf9247dea63a9387e0cd0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/534acf4edf9247dea63a9387e0cd0e7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/534acf4edf9247dea63a9387e0cd0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_534acf4edf9247dea63a9387e0cd0e7b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ImagesNegativeTestJSON-1161356122 Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 534acf4edf9247dea63a9387e0cd0e7b Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1161356122 Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ImagesNegativeTestJSON-1161356122-project Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: b2fe556bf10c4d69a86a325d60da6aa7 Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ImagesNegativeTestJSON-1161356122-project Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1180825961", "metadata": {"image_type": "test"}}} Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: exception: Instance tempest-invalid-487659893 could not be found. Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'tempest-invalid-487659893', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1180825961', 'metadata': {'image_type': 'test'}}}} Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-487659893 could not be found. Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:12:56.778726 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-487659893 could not be found. Jun 10 18:12:56.783456 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.783456 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:56.783456 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.783456 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.783456 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:56.783456 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:56.783456 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:12:56.783456 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:12:56.783456 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-487659893 could not be found. Jun 10 18:12:56.783456 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.785055 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7b2ef071-69e3-402d-ad8f-51b3f8f71952 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Returning 404 to user: Instance tempest-invalid-487659893 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:12:56.786652 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7b2ef071-69e3-402d-ad8f-51b3f8f71952 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] 10.222.0.35 "POST /compute/v2.1/servers/tempest-invalid-487659893/action" status: 404 len: 100 microversion: 2.1 time: 0.016599 Jun 10 18:12:56.787240 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2284/4416] 10.222.0.35 () {60 vars in 1245 bytes} [Fri Jun 10 18:12:56 2022] POST /compute/v2.1/servers/tempest-invalid-487659893/action => generated 100 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:12:56.793327 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0516b133-34d3-4339-ac52-12bfc308015d tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea" status: 200 len: 1284 microversion: 2.1 time: 0.180758 Jun 10 18:12:56.804254 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2133/4417] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:56 2022] GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea => generated 1284 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:56.806994 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3b4084a0-ccdc-481e-ba90-f756f1ccfd88 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-905489339"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:56.807382 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e848250b-3711-448f-bf05-e2c2223cb6a0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:56.808044 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3b4084a0-ccdc-481e-ba90-f756f1ccfd88 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 10 18:12:56.808176 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e848250b-3711-448f-bf05-e2c2223cb6a0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:56.808587 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-3b4084a0-ccdc-481e-ba90-f756f1ccfd88 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3b4084a0-ccdc-481e-ba90-f756f1ccfd88 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Request method failure captured: Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 56 Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4mDL9yJ7GY6jnWZxRakPLGzcxOPjhgI4QfqHNV_8o00rPC6KvG1D54vV4Y6UOSWJfeWGU_Xgi7BAwqYJ_BOL835xS4vtcAwe25kxxHYUd9R8EjkROfEQVziBNbRsjQ1hVZKbIbodzMZHnozgz_23ra-NQ_3Ls6up8K9lBPRWd2mSTA Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 534acf4edf9247dea63a9387e0cd0e7b Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ImagesNegativeTestJSON-1161356122 Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/534acf4edf9247dea63a9387e0cd0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/534acf4edf9247dea63a9387e0cd0e7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/534acf4edf9247dea63a9387e0cd0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_534acf4edf9247dea63a9387e0cd0e7b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ImagesNegativeTestJSON-1161356122 Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 534acf4edf9247dea63a9387e0cd0e7b Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1161356122 Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ImagesNegativeTestJSON-1161356122-project Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: b2fe556bf10c4d69a86a325d60da6aa7 Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ImagesNegativeTestJSON-1161356122-project Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: {"createImage": {"name": "tempest-test-snap-905489339"}} Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-905489339'}}} Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 10 18:12:56.810116 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.823058 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:56.823058 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.823058 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.823058 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:56.823058 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:56.823058 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:12:56.823058 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:12:56.823058 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 10 18:12:56.823058 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.823058 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3b4084a0-ccdc-481e-ba90-f756f1ccfd88 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:12:56.823058 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3b4084a0-ccdc-481e-ba90-f756f1ccfd88 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] 10.222.0.35 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.021525 Jun 10 18:12:56.823058 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2285/4418] 10.222.0.35 () {60 vars in 1274 bytes} [Fri Jun 10 18:12:56 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:12:56.824164 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e848250b-3711-448f-bf05-e2c2223cb6a0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:56.824164 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e848250b-3711-448f-bf05-e2c2223cb6a0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:56.824164 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e848250b-3711-448f-bf05-e2c2223cb6a0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:56.824164 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e848250b-3711-448f-bf05-e2c2223cb6a0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:56.828999 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6b7d5443-bf2a-46bd-bfa5-78d57a3973b2 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1070231527"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:12:56.829696 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6b7d5443-bf2a-46bd-bfa5-78d57a3973b2 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 10 18:12:56.830373 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-6b7d5443-bf2a-46bd-bfa5-78d57a3973b2 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6b7d5443-bf2a-46bd-bfa5-78d57a3973b2 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Request method failure captured: Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 57 Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4mDL9yJ7GY6jnWZxRakPLGzcxOPjhgI4QfqHNV_8o00rPC6KvG1D54vV4Y6UOSWJfeWGU_Xgi7BAwqYJ_BOL835xS4vtcAwe25kxxHYUd9R8EjkROfEQVziBNbRsjQ1hVZKbIbodzMZHnozgz_23ra-NQ_3Ls6up8K9lBPRWd2mSTA Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 534acf4edf9247dea63a9387e0cd0e7b Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ImagesNegativeTestJSON-1161356122 Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/534acf4edf9247dea63a9387e0cd0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/534acf4edf9247dea63a9387e0cd0e7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/534acf4edf9247dea63a9387e0cd0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_534acf4edf9247dea63a9387e0cd0e7b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ImagesNegativeTestJSON-1161356122 Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 534acf4edf9247dea63a9387e0cd0e7b Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1161356122 Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ImagesNegativeTestJSON-1161356122-project Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: b2fe556bf10c4d69a86a325d60da6aa7 Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ImagesNegativeTestJSON-1161356122-project Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: {"createImage": {"name": "tempest-test-snap-1070231527"}} Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1070231527'}}} Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 10 18:12:56.831879 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.839579 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:56.839579 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.839579 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.839579 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:56.839579 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:56.839579 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:12:56.839579 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:12:56.839579 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 10 18:12:56.839579 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.839579 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6b7d5443-bf2a-46bd-bfa5-78d57a3973b2 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:12:56.839579 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6b7d5443-bf2a-46bd-bfa5-78d57a3973b2 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] 10.222.0.35 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.011371 Jun 10 18:12:56.839579 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2286/4419] 10.222.0.35 () {60 vars in 1280 bytes} [Fri Jun 10 18:12:56 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:12:56.846354 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ea25a983-bf62-4852-bef8-7e23ff2d905f tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:56.846354 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ea25a983-bf62-4852-bef8-7e23ff2d905f tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] [instance: 07a5fadb-9316-44c9-9c5e-c8f26050d4d2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:56.850508 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ea25a983-bf62-4852-bef8-7e23ff2d905f tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:56.850972 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ea25a983-bf62-4852-bef8-7e23ff2d905f tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:56.851747 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ea25a983-bf62-4852-bef8-7e23ff2d905f tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:56.852189 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ea25a983-bf62-4852-bef8-7e23ff2d905f tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-ea25a983-bf62-4852-bef8-7e23ff2d905f tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] HTTP exception thrown: Instance 07a5fadb-9316-44c9-9c5e-c8f26050d4d2 could not be found. Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ea25a983-bf62-4852-bef8-7e23ff2d905f tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Request method failure captured: Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: request: DELETE /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2 HTTP/1.1 Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4mDL9yJ7GY6jnWZxRakPLGzcxOPjhgI4QfqHNV_8o00rPC6KvG1D54vV4Y6UOSWJfeWGU_Xgi7BAwqYJ_BOL835xS4vtcAwe25kxxHYUd9R8EjkROfEQVziBNbRsjQ1hVZKbIbodzMZHnozgz_23ra-NQ_3Ls6up8K9lBPRWd2mSTA Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 534acf4edf9247dea63a9387e0cd0e7b Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ImagesNegativeTestJSON-1161356122 Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/534acf4edf9247dea63a9387e0cd0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/534acf4edf9247dea63a9387e0cd0e7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/534acf4edf9247dea63a9387e0cd0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_534acf4edf9247dea63a9387e0cd0e7b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ImagesNegativeTestJSON-1161356122 Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 534acf4edf9247dea63a9387e0cd0e7b Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1161356122 Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ImagesNegativeTestJSON-1161356122-project Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: b2fe556bf10c4d69a86a325d60da6aa7 Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ImagesNegativeTestJSON-1161356122-project Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 07a5fadb-9316-44c9-9c5e-c8f26050d4d2 could not be found. Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '07a5fadb-9316-44c9-9c5e-c8f26050d4d2'} Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07a5fadb-9316-44c9-9c5e-c8f26050d4d2 could not be found. Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:12:56.876125 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:12:56.881048 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:12:56.881048 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:12:56.881048 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07a5fadb-9316-44c9-9c5e-c8f26050d4d2 could not be found. Jun 10 18:12:56.881048 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.881048 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:56.881048 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.881048 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.881048 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:56.881048 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:56.881048 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:12:56.881048 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:12:56.881048 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07a5fadb-9316-44c9-9c5e-c8f26050d4d2 could not be found. Jun 10 18:12:56.881048 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.881048 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ea25a983-bf62-4852-bef8-7e23ff2d905f tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Returning 404 to user: Instance 07a5fadb-9316-44c9-9c5e-c8f26050d4d2 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:12:56.882272 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ea25a983-bf62-4852-bef8-7e23ff2d905f tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] 10.222.0.35 "DELETE /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2" status: 404 len: 111 microversion: 2.1 time: 0.042226 Jun 10 18:12:56.884475 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2287/4420] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:12:56 2022] DELETE /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:12:56.891957 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c3947064-32b4-467c-a7d1-e2ef935aee84 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:56.892589 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c3947064-32b4-467c-a7d1-e2ef935aee84 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] [instance: 07a5fadb-9316-44c9-9c5e-c8f26050d4d2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:56.900859 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c3947064-32b4-467c-a7d1-e2ef935aee84 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:56.901888 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c3947064-32b4-467c-a7d1-e2ef935aee84 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:56.902603 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c3947064-32b4-467c-a7d1-e2ef935aee84 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:56.903050 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c3947064-32b4-467c-a7d1-e2ef935aee84 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:56.934330 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-c3947064-32b4-467c-a7d1-e2ef935aee84 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] HTTP exception thrown: Instance 07a5fadb-9316-44c9-9c5e-c8f26050d4d2 could not be found. Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c3947064-32b4-467c-a7d1-e2ef935aee84 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Request method failure captured: Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2 HTTP/1.1 Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4mDL9yJ7GY6jnWZxRakPLGzcxOPjhgI4QfqHNV_8o00rPC6KvG1D54vV4Y6UOSWJfeWGU_Xgi7BAwqYJ_BOL835xS4vtcAwe25kxxHYUd9R8EjkROfEQVziBNbRsjQ1hVZKbIbodzMZHnozgz_23ra-NQ_3Ls6up8K9lBPRWd2mSTA Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 534acf4edf9247dea63a9387e0cd0e7b Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ImagesNegativeTestJSON-1161356122 Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/534acf4edf9247dea63a9387e0cd0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/534acf4edf9247dea63a9387e0cd0e7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/534acf4edf9247dea63a9387e0cd0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_534acf4edf9247dea63a9387e0cd0e7b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ImagesNegativeTestJSON-1161356122 Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 534acf4edf9247dea63a9387e0cd0e7b Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1161356122 Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ImagesNegativeTestJSON-1161356122-project Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: b2fe556bf10c4d69a86a325d60da6aa7 Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ImagesNegativeTestJSON-1161356122-project Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 07a5fadb-9316-44c9-9c5e-c8f26050d4d2 could not be found. Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '07a5fadb-9316-44c9-9c5e-c8f26050d4d2'} Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07a5fadb-9316-44c9-9c5e-c8f26050d4d2 could not be found. Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07a5fadb-9316-44c9-9c5e-c8f26050d4d2 could not be found. Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:12:56.936097 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.941159 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:12:56.941159 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:12:56.941159 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:12:56.941159 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:12:56.941159 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:12:56.941159 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07a5fadb-9316-44c9-9c5e-c8f26050d4d2 could not be found. Jun 10 18:12:56.941159 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:12:56.944099 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c3947064-32b4-467c-a7d1-e2ef935aee84 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] Returning 404 to user: Instance 07a5fadb-9316-44c9-9c5e-c8f26050d4d2 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:12:56.945013 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c3947064-32b4-467c-a7d1-e2ef935aee84 tempest-ImagesNegativeTestJSON-1161356122 tempest-ImagesNegativeTestJSON-1161356122-project] 10.222.0.35 "GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2" status: 404 len: 111 microversion: 2.1 time: 0.058724 Jun 10 18:12:56.945613 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2288/4421] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:56 2022] GET /compute/v2.1/servers/07a5fadb-9316-44c9-9c5e-c8f26050d4d2 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:12:57.146831 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e848250b-3711-448f-bf05-e2c2223cb6a0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:57.197787 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e848250b-3711-448f-bf05-e2c2223cb6a0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca" status: 200 len: 1519 microversion: 2.1 time: 0.397568 Jun 10 18:12:57.202024 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2134/4422] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:56 2022] GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca => generated 1519 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:57.777713 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-37b9574d-0dd8-432a-a971-f9efafa8a76c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:57.778692 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-37b9574d-0dd8-432a-a971-f9efafa8a76c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:57.794375 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-37b9574d-0dd8-432a-a971-f9efafa8a76c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:57.795178 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-37b9574d-0dd8-432a-a971-f9efafa8a76c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:57.800916 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-37b9574d-0dd8-432a-a971-f9efafa8a76c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:57.801775 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-37b9574d-0dd8-432a-a971-f9efafa8a76c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:57.837903 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-478f6912-0940-4608-9153-d7aeea9bbd17 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:57.841049 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-478f6912-0940-4608-9153-d7aeea9bbd17 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 551856e9-a45b-412d-979d-b14039d74fea] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:57.872890 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-478f6912-0940-4608-9153-d7aeea9bbd17 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:57.874190 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-478f6912-0940-4608-9153-d7aeea9bbd17 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:57.877400 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-478f6912-0940-4608-9153-d7aeea9bbd17 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:57.877400 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-478f6912-0940-4608-9153-d7aeea9bbd17 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:57.962440 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-478f6912-0940-4608-9153-d7aeea9bbd17 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:57.973928 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-478f6912-0940-4608-9153-d7aeea9bbd17 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea" status: 200 len: 1282 microversion: 2.1 time: 0.164552 Jun 10 18:12:57.975116 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2135/4423] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:57 2022] GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea => generated 1282 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:58.119749 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-37b9574d-0dd8-432a-a971-f9efafa8a76c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:58.131691 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-37b9574d-0dd8-432a-a971-f9efafa8a76c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1528 microversion: 2.1 time: 0.358920 Jun 10 18:12:58.133815 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2289/4424] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:57 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1528 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:58.231303 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-67a26534-b754-4471-b3c4-5adc5be305ee tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:58.232610 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-67a26534-b754-4471-b3c4-5adc5be305ee tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:58.253997 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-67a26534-b754-4471-b3c4-5adc5be305ee tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:58.259301 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-67a26534-b754-4471-b3c4-5adc5be305ee tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:58.260923 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-67a26534-b754-4471-b3c4-5adc5be305ee tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:58.262824 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-67a26534-b754-4471-b3c4-5adc5be305ee tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:58.527726 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-67a26534-b754-4471-b3c4-5adc5be305ee tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:58.540015 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-67a26534-b754-4471-b3c4-5adc5be305ee tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca" status: 200 len: 1519 microversion: 2.1 time: 0.320990 Jun 10 18:12:58.540937 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2136/4425] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:58 2022] GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca => generated 1519 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:59.002235 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3f16b45f-ca4e-4cc2-8a6c-c12be3742147 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:59.002235 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3f16b45f-ca4e-4cc2-8a6c-c12be3742147 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 551856e9-a45b-412d-979d-b14039d74fea] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:59.002235 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f16b45f-ca4e-4cc2-8a6c-c12be3742147 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:59.002235 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f16b45f-ca4e-4cc2-8a6c-c12be3742147 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:59.002235 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f16b45f-ca4e-4cc2-8a6c-c12be3742147 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:59.002235 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f16b45f-ca4e-4cc2-8a6c-c12be3742147 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:59.150876 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-81678cc6-4f4d-4e74-959b-16194814c392 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:59.161615 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-81678cc6-4f4d-4e74-959b-16194814c392 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:59.162829 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-81678cc6-4f4d-4e74-959b-16194814c392 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:59.172792 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-81678cc6-4f4d-4e74-959b-16194814c392 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:59.173488 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-81678cc6-4f4d-4e74-959b-16194814c392 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:59.173950 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-81678cc6-4f4d-4e74-959b-16194814c392 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:59.309275 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3f16b45f-ca4e-4cc2-8a6c-c12be3742147 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:59.320124 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3f16b45f-ca4e-4cc2-8a6c-c12be3742147 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea" status: 200 len: 1324 microversion: 2.1 time: 0.332567 Jun 10 18:12:59.327049 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2290/4426] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:58 2022] GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea => generated 1324 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:59.559301 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3021e0c8-5591-41de-afa7-fb83ed694606 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:12:59.559916 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3021e0c8-5591-41de-afa7-fb83ed694606 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:12:59.572885 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-81678cc6-4f4d-4e74-959b-16194814c392 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:59.582661 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3021e0c8-5591-41de-afa7-fb83ed694606 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:59.587857 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3021e0c8-5591-41de-afa7-fb83ed694606 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:59.588274 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-81678cc6-4f4d-4e74-959b-16194814c392 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1528 microversion: 2.1 time: 0.439006 Jun 10 18:12:59.590006 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3021e0c8-5591-41de-afa7-fb83ed694606 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:12:59.591584 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2137/4427] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:59 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1528 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:12:59.594731 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3021e0c8-5591-41de-afa7-fb83ed694606 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:12:59.783467 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3021e0c8-5591-41de-afa7-fb83ed694606 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:12:59.792605 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3021e0c8-5591-41de-afa7-fb83ed694606 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca" status: 200 len: 1519 microversion: 2.1 time: 0.238156 Jun 10 18:12:59.793227 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2291/4428] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:12:59 2022] GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca => generated 1519 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:13:00.288853 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-c8da9ab9-2953-43b6-bfe9-6ebf9adf8e6e req-37794a35-a3b7-427b-b494-8211aef2d1d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "551856e9-a45b-412d-979d-b14039d74fea", "tag": "1859187f-370b-4ada-a7b6-04d61eec3731"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:13:00.316610 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-c8da9ab9-2953-43b6-bfe9-6ebf9adf8e6e req-37794a35-a3b7-427b-b494-8211aef2d1d8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:00.318083 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-c8da9ab9-2953-43b6-bfe9-6ebf9adf8e6e req-37794a35-a3b7-427b-b494-8211aef2d1d8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:00.343332 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ef0be9d3-cd8e-4e9c-bef5-3b6f305e1bad tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:00.343973 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ef0be9d3-cd8e-4e9c-bef5-3b6f305e1bad tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 551856e9-a45b-412d-979d-b14039d74fea] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:00.363316 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ef0be9d3-cd8e-4e9c-bef5-3b6f305e1bad tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:00.365079 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ef0be9d3-cd8e-4e9c-bef5-3b6f305e1bad tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:00.367836 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ef0be9d3-cd8e-4e9c-bef5-3b6f305e1bad tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:00.370007 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-c8da9ab9-2953-43b6-bfe9-6ebf9adf8e6e req-37794a35-a3b7-427b-b494-8211aef2d1d8 service nova] Creating event network-changed:1859187f-370b-4ada-a7b6-04d61eec3731 for instance 551856e9-a45b-412d-979d-b14039d74fea on chh2-master-2 Jun 10 18:13:00.370694 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ef0be9d3-cd8e-4e9c-bef5-3b6f305e1bad tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:00.387332 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-c8da9ab9-2953-43b6-bfe9-6ebf9adf8e6e req-37794a35-a3b7-427b-b494-8211aef2d1d8 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103651 Jun 10 18:13:00.403085 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2138/4429] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:13:00.614412 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0c7002a0-9869-4c37-b177-329b55c85f35 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:00.616568 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0c7002a0-9869-4c37-b177-329b55c85f35 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:00.630884 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0c7002a0-9869-4c37-b177-329b55c85f35 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:00.633062 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0c7002a0-9869-4c37-b177-329b55c85f35 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:00.644271 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0c7002a0-9869-4c37-b177-329b55c85f35 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:00.646585 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0c7002a0-9869-4c37-b177-329b55c85f35 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:00.742556 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ef0be9d3-cd8e-4e9c-bef5-3b6f305e1bad tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:00.755120 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ef0be9d3-cd8e-4e9c-bef5-3b6f305e1bad tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea" status: 200 len: 1324 microversion: 2.1 time: 0.415924 Jun 10 18:13:00.757386 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2292/4430] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:00 2022] GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea => generated 1324 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:00.811111 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c4c75b04-8c9a-4c41-b631-9939f0d5b42c tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:00.811815 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c4c75b04-8c9a-4c41-b631-9939f0d5b42c tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:00.824197 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c4c75b04-8c9a-4c41-b631-9939f0d5b42c tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:00.824720 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c4c75b04-8c9a-4c41-b631-9939f0d5b42c tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:00.827279 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c4c75b04-8c9a-4c41-b631-9939f0d5b42c tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:00.831581 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c4c75b04-8c9a-4c41-b631-9939f0d5b42c tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:00.870393 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:13:00.970608 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0c7002a0-9869-4c37-b177-329b55c85f35 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:00.983111 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0c7002a0-9869-4c37-b177-329b55c85f35 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1510 microversion: 2.1 time: 0.379001 Jun 10 18:13:00.984787 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2139/4431] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:00 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1510 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:13:01.027366 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c4c75b04-8c9a-4c41-b631-9939f0d5b42c tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:01.035248 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c4c75b04-8c9a-4c41-b631-9939f0d5b42c tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca" status: 200 len: 1519 microversion: 2.1 time: 0.228452 Jun 10 18:13:01.036448 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2293/4432] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:00 2022] GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca => generated 1519 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:13:01.766708 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2fae6f64-6f2a-48d3-938a-a566fb0ad69b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:01.767934 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2fae6f64-6f2a-48d3-938a-a566fb0ad69b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: ea345031-5220-43d0-9971-ada561720697] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:01.776743 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c61388e5-e01f-4f4b-8c8a-7a5e2e3ddac3 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:01.777598 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c61388e5-e01f-4f4b-8c8a-7a5e2e3ddac3 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 551856e9-a45b-412d-979d-b14039d74fea] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:01.782550 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2fae6f64-6f2a-48d3-938a-a566fb0ad69b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:01.787342 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2fae6f64-6f2a-48d3-938a-a566fb0ad69b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:01.788917 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c61388e5-e01f-4f4b-8c8a-7a5e2e3ddac3 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:01.796897 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c61388e5-e01f-4f4b-8c8a-7a5e2e3ddac3 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:01.797054 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2fae6f64-6f2a-48d3-938a-a566fb0ad69b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:01.797152 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c61388e5-e01f-4f4b-8c8a-7a5e2e3ddac3 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:01.797260 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2fae6f64-6f2a-48d3-938a-a566fb0ad69b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:01.797427 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c61388e5-e01f-4f4b-8c8a-7a5e2e3ddac3 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:01.807341 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-2fae6f64-6f2a-48d3-938a-a566fb0ad69b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] HTTP exception thrown: Instance ea345031-5220-43d0-9971-ada561720697 could not be found. Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2fae6f64-6f2a-48d3-938a-a566fb0ad69b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Request method failure captured: Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697 HTTP/1.1 Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4h5IGwn2s1svunn67FxK1RLA1ZXNP7yhKtLh1eaKFO5RiF1I7YeJHWcfSjdUGMBWYC3nFgfMdv1-bfem3ewEozYf-uHKxgVE7ziplyuJN8iPaP89LX8AXS1cyKZcnxByDcQMqTPs4bimJxM1lNaVEmx4VPDZsfMeZBdbBH4r5hYsr8 Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/457c4a300936498b9e8b61645e655751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_457c4a300936498b9e8b61645e655751", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 8166793f60ee479689b4a21457b71d07 Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: exception: Instance ea345031-5220-43d0-9971-ada561720697 could not be found. Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'ea345031-5220-43d0-9971-ada561720697'} Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea345031-5220-43d0-9971-ada561720697 could not be found. Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:13:01.809243 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:13:01.814513 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea345031-5220-43d0-9971-ada561720697 could not be found. Jun 10 18:13:01.814513 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:01.814513 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:13:01.814513 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:01.814513 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:13:01.814513 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:13:01.814513 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:13:01.814513 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:13:01.814513 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:13:01.814513 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea345031-5220-43d0-9971-ada561720697 could not be found. Jun 10 18:13:01.814513 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:01.814513 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2fae6f64-6f2a-48d3-938a-a566fb0ad69b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Returning 404 to user: Instance ea345031-5220-43d0-9971-ada561720697 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:13:01.814513 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2fae6f64-6f2a-48d3-938a-a566fb0ad69b tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "DELETE /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697" status: 404 len: 111 microversion: 2.1 time: 0.048416 Jun 10 18:13:01.814513 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2140/4433] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:13:01 2022] DELETE /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:13:01.819791 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f71187b8-b67e-4204-aedb-03f3986f4ba8 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:01.820465 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f71187b8-b67e-4204-aedb-03f3986f4ba8 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: ea345031-5220-43d0-9971-ada561720697] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:01.826965 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f71187b8-b67e-4204-aedb-03f3986f4ba8 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:01.827586 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f71187b8-b67e-4204-aedb-03f3986f4ba8 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:01.828481 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f71187b8-b67e-4204-aedb-03f3986f4ba8 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:01.829230 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f71187b8-b67e-4204-aedb-03f3986f4ba8 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:01.840233 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:13:01.844164 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-f71187b8-b67e-4204-aedb-03f3986f4ba8 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] HTTP exception thrown: Instance ea345031-5220-43d0-9971-ada561720697 could not be found. Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f71187b8-b67e-4204-aedb-03f3986f4ba8 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Request method failure captured: Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697 HTTP/1.1 Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4h5IGwn2s1svunn67FxK1RLA1ZXNP7yhKtLh1eaKFO5RiF1I7YeJHWcfSjdUGMBWYC3nFgfMdv1-bfem3ewEozYf-uHKxgVE7ziplyuJN8iPaP89LX8AXS1cyKZcnxByDcQMqTPs4bimJxM1lNaVEmx4VPDZsfMeZBdbBH4r5hYsr8 Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/457c4a300936498b9e8b61645e655751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_457c4a300936498b9e8b61645e655751", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 8166793f60ee479689b4a21457b71d07 Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: exception: Instance ea345031-5220-43d0-9971-ada561720697 could not be found. Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'ea345031-5220-43d0-9971-ada561720697'} Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea345031-5220-43d0-9971-ada561720697 could not be found. Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea345031-5220-43d0-9971-ada561720697 could not be found. Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:13:01.845763 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:01.851173 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:13:01.851173 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:13:01.851173 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:13:01.851173 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:13:01.851173 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:13:01.851173 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea345031-5220-43d0-9971-ada561720697 could not be found. Jun 10 18:13:01.851173 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:01.851173 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f71187b8-b67e-4204-aedb-03f3986f4ba8 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Returning 404 to user: Instance ea345031-5220-43d0-9971-ada561720697 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:13:01.851173 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f71187b8-b67e-4204-aedb-03f3986f4ba8 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697" status: 404 len: 111 microversion: 2.1 time: 0.031886 Jun 10 18:13:01.851173 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2141/4434] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:01 2022] GET /compute/v2.1/servers/ea345031-5220-43d0-9971-ada561720697 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:13:01.855979 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-214a8841-6f7a-4b7a-b67e-ae37fdd69158 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:01.871042 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-214a8841-6f7a-4b7a-b67e-ae37fdd69158 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: a6779f56-7475-4ea6-8bd0-91feb2a3c36c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:01.871341 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=10 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:13:01.871471 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-214a8841-6f7a-4b7a-b67e-ae37fdd69158 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:01.871471 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-214a8841-6f7a-4b7a-b67e-ae37fdd69158 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:01.871471 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-214a8841-6f7a-4b7a-b67e-ae37fdd69158 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:01.871471 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-214a8841-6f7a-4b7a-b67e-ae37fdd69158 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:01.885512 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-214a8841-6f7a-4b7a-b67e-ae37fdd69158 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] HTTP exception thrown: Instance a6779f56-7475-4ea6-8bd0-91feb2a3c36c could not be found. Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-214a8841-6f7a-4b7a-b67e-ae37fdd69158 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Request method failure captured: Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/a6779f56-7475-4ea6-8bd0-91feb2a3c36c HTTP/1.1 Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4h5IGwn2s1svunn67FxK1RLA1ZXNP7yhKtLh1eaKFO5RiF1I7YeJHWcfSjdUGMBWYC3nFgfMdv1-bfem3ewEozYf-uHKxgVE7ziplyuJN8iPaP89LX8AXS1cyKZcnxByDcQMqTPs4bimJxM1lNaVEmx4VPDZsfMeZBdbBH4r5hYsr8 Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/457c4a300936498b9e8b61645e655751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_457c4a300936498b9e8b61645e655751", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 8166793f60ee479689b4a21457b71d07 Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: exception: Instance a6779f56-7475-4ea6-8bd0-91feb2a3c36c could not be found. Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'a6779f56-7475-4ea6-8bd0-91feb2a3c36c'} Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6779f56-7475-4ea6-8bd0-91feb2a3c36c could not be found. Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:13:01.887530 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:13:01.892397 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6779f56-7475-4ea6-8bd0-91feb2a3c36c could not be found. Jun 10 18:13:01.892397 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:01.892397 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:13:01.892397 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:01.892397 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:13:01.892397 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:13:01.892397 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:13:01.892397 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:13:01.892397 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:13:01.892397 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6779f56-7475-4ea6-8bd0-91feb2a3c36c could not be found. Jun 10 18:13:01.892397 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:01.895824 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-214a8841-6f7a-4b7a-b67e-ae37fdd69158 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Returning 404 to user: Instance a6779f56-7475-4ea6-8bd0-91feb2a3c36c could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:13:01.896745 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-214a8841-6f7a-4b7a-b67e-ae37fdd69158 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "DELETE /compute/v2.1/servers/a6779f56-7475-4ea6-8bd0-91feb2a3c36c" status: 404 len: 111 microversion: 2.1 time: 0.044527 Jun 10 18:13:01.897336 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2142/4435] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:13:01 2022] DELETE /compute/v2.1/servers/a6779f56-7475-4ea6-8bd0-91feb2a3c36c => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:13:01.910837 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1cbadaf8-cd9e-4e50-8138-b59ca622b323 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:01.910837 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1cbadaf8-cd9e-4e50-8138-b59ca622b323 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] [instance: a6779f56-7475-4ea6-8bd0-91feb2a3c36c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:01.913291 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1cbadaf8-cd9e-4e50-8138-b59ca622b323 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:01.913757 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1cbadaf8-cd9e-4e50-8138-b59ca622b323 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:01.914552 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1cbadaf8-cd9e-4e50-8138-b59ca622b323 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:01.915000 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1cbadaf8-cd9e-4e50-8138-b59ca622b323 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:01.929580 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-1cbadaf8-cd9e-4e50-8138-b59ca622b323 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] HTTP exception thrown: Instance a6779f56-7475-4ea6-8bd0-91feb2a3c36c could not be found. Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1cbadaf8-cd9e-4e50-8138-b59ca622b323 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Request method failure captured: Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/a6779f56-7475-4ea6-8bd0-91feb2a3c36c HTTP/1.1 Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4h5IGwn2s1svunn67FxK1RLA1ZXNP7yhKtLh1eaKFO5RiF1I7YeJHWcfSjdUGMBWYC3nFgfMdv1-bfem3ewEozYf-uHKxgVE7ziplyuJN8iPaP89LX8AXS1cyKZcnxByDcQMqTPs4bimJxM1lNaVEmx4VPDZsfMeZBdbBH4r5hYsr8 Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/457c4a300936498b9e8b61645e655751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/457c4a300936498b9e8b61645e655751"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_457c4a300936498b9e8b61645e655751", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 457c4a300936498b9e8b61645e655751 Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058632279 Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 8166793f60ee479689b4a21457b71d07 Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-DeleteServersTestJSON-1058632279-project Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: exception: Instance a6779f56-7475-4ea6-8bd0-91feb2a3c36c could not be found. Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'a6779f56-7475-4ea6-8bd0-91feb2a3c36c'} Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6779f56-7475-4ea6-8bd0-91feb2a3c36c could not be found. Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6779f56-7475-4ea6-8bd0-91feb2a3c36c could not be found. Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:13:01.931242 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:01.936541 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:13:01.936541 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:13:01.936541 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:13:01.936541 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:13:01.936541 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:13:01.936541 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6779f56-7475-4ea6-8bd0-91feb2a3c36c could not be found. Jun 10 18:13:01.936541 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:01.936541 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1cbadaf8-cd9e-4e50-8138-b59ca622b323 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] Returning 404 to user: Instance a6779f56-7475-4ea6-8bd0-91feb2a3c36c could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:13:01.936541 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1cbadaf8-cd9e-4e50-8138-b59ca622b323 tempest-DeleteServersTestJSON-1058632279 tempest-DeleteServersTestJSON-1058632279-project] 10.222.0.35 "GET /compute/v2.1/servers/a6779f56-7475-4ea6-8bd0-91feb2a3c36c" status: 404 len: 111 microversion: 2.1 time: 0.031747 Jun 10 18:13:01.936541 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2143/4436] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:01 2022] GET /compute/v2.1/servers/a6779f56-7475-4ea6-8bd0-91feb2a3c36c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:13:01.967293 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c61388e5-e01f-4f4b-8c8a-7a5e2e3ddac3 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:01.977719 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c61388e5-e01f-4f4b-8c8a-7a5e2e3ddac3 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea" status: 200 len: 1324 microversion: 2.1 time: 0.206567 Jun 10 18:13:01.978314 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2294/4437] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:01 2022] GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea => generated 1324 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:02.003850 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-32812454-52fa-4873-8f6c-ff550b1ca275 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:02.005244 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-32812454-52fa-4873-8f6c-ff550b1ca275 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:02.017415 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-32812454-52fa-4873-8f6c-ff550b1ca275 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:02.018161 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-32812454-52fa-4873-8f6c-ff550b1ca275 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:02.019058 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-32812454-52fa-4873-8f6c-ff550b1ca275 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:02.020677 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-32812454-52fa-4873-8f6c-ff550b1ca275 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:02.056531 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f4fbbda4-a452-457d-b399-40aaf095b131 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:02.057358 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f4fbbda4-a452-457d-b399-40aaf095b131 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:02.069264 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4fbbda4-a452-457d-b399-40aaf095b131 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:02.070249 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4fbbda4-a452-457d-b399-40aaf095b131 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:02.072448 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4fbbda4-a452-457d-b399-40aaf095b131 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:02.073145 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4fbbda4-a452-457d-b399-40aaf095b131 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:02.274374 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f4fbbda4-a452-457d-b399-40aaf095b131 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:02.285261 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f4fbbda4-a452-457d-b399-40aaf095b131 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca" status: 200 len: 1519 microversion: 2.1 time: 0.234275 Jun 10 18:13:02.286019 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2295/4438] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:02 2022] GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca => generated 1519 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:13:02.334458 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-32812454-52fa-4873-8f6c-ff550b1ca275 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:02.342816 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-32812454-52fa-4873-8f6c-ff550b1ca275 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1510 microversion: 2.1 time: 0.342876 Jun 10 18:13:02.350152 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2144/4439] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:01 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1510 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:02.857467 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-f796c154-026b-4076-8351-ff3a14c1a502 req-98d3f477-cec2-4628-8bc5-35c5fdc38b64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57a377b2-f75e-4a0c-8401-090db42db644", "name": "network-vif-unplugged", "status": "completed", "tag": "ea23750f-0e21-482f-b68f-6361eeb3c636"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:13:02.868104 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-f796c154-026b-4076-8351-ff3a14c1a502 req-98d3f477-cec2-4628-8bc5-35c5fdc38b64 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:02.868636 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-f796c154-026b-4076-8351-ff3a14c1a502 req-98d3f477-cec2-4628-8bc5-35c5fdc38b64 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:02.888147 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-f796c154-026b-4076-8351-ff3a14c1a502 req-98d3f477-cec2-4628-8bc5-35c5fdc38b64 service nova] Creating event network-vif-unplugged:ea23750f-0e21-482f-b68f-6361eeb3c636 for instance 57a377b2-f75e-4a0c-8401-090db42db644 on chh1-master-2 Jun 10 18:13:02.896157 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-f796c154-026b-4076-8351-ff3a14c1a502 req-98d3f477-cec2-4628-8bc5-35c5fdc38b64 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042020 Jun 10 18:13:02.898428 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2296/4440] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:13:02.997962 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-114cc90f-5722-4ef1-8fc1-db30d3d3d2de tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:02.999651 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-114cc90f-5722-4ef1-8fc1-db30d3d3d2de tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 551856e9-a45b-412d-979d-b14039d74fea] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:03.008970 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-114cc90f-5722-4ef1-8fc1-db30d3d3d2de tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:03.009906 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-114cc90f-5722-4ef1-8fc1-db30d3d3d2de tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:03.011228 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-114cc90f-5722-4ef1-8fc1-db30d3d3d2de tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:03.012649 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-114cc90f-5722-4ef1-8fc1-db30d3d3d2de tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:03.204259 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-114cc90f-5722-4ef1-8fc1-db30d3d3d2de tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:03.218607 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-114cc90f-5722-4ef1-8fc1-db30d3d3d2de tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea" status: 200 len: 1324 microversion: 2.1 time: 0.226812 Jun 10 18:13:03.221740 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2145/4441] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:02 2022] GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea => generated 1324 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:03.304114 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d74f265c-efe7-4a93-81a0-a5b8a0146659 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:03.305160 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d74f265c-efe7-4a93-81a0-a5b8a0146659 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:03.315160 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d74f265c-efe7-4a93-81a0-a5b8a0146659 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:03.316460 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d74f265c-efe7-4a93-81a0-a5b8a0146659 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:03.317995 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d74f265c-efe7-4a93-81a0-a5b8a0146659 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:03.318593 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d74f265c-efe7-4a93-81a0-a5b8a0146659 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:03.361059 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9de3e4b0-bac4-45c9-855d-868eea6f0701 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:03.362091 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9de3e4b0-bac4-45c9-855d-868eea6f0701 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:03.386518 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9de3e4b0-bac4-45c9-855d-868eea6f0701 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:03.387371 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9de3e4b0-bac4-45c9-855d-868eea6f0701 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:03.407990 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9de3e4b0-bac4-45c9-855d-868eea6f0701 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:03.408576 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9de3e4b0-bac4-45c9-855d-868eea6f0701 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:03.635951 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9de3e4b0-bac4-45c9-855d-868eea6f0701 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:03.648289 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9de3e4b0-bac4-45c9-855d-868eea6f0701 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1513 microversion: 2.1 time: 0.292052 Jun 10 18:13:03.657638 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2146/4442] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:03 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1513 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:03.676973 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7f35292b-f57f-48e6-aae0-2551f86bd1ae tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c1725310>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:03.680986 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d74f265c-efe7-4a93-81a0-a5b8a0146659 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:03.690534 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d74f265c-efe7-4a93-81a0-a5b8a0146659 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca" status: 200 len: 1519 microversion: 2.1 time: 0.391922 Jun 10 18:13:03.702546 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2297/4443] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:03 2022] GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca => generated 1519 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:03.709149 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ce23ad30-92c6-4101-ab66-f5cd24aed999 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:03.710396 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ce23ad30-92c6-4101-ab66-f5cd24aed999 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:03.738304 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ce23ad30-92c6-4101-ab66-f5cd24aed999 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:03.739645 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ce23ad30-92c6-4101-ab66-f5cd24aed999 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:03.740958 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ce23ad30-92c6-4101-ab66-f5cd24aed999 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:03.741592 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ce23ad30-92c6-4101-ab66-f5cd24aed999 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:03.782496 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7f35292b-f57f-48e6-aae0-2551f86bd1ae tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/aee08346-4b62-4826-a43f-15229e36ace1" status: 200 len: 661 microversion: 2.1 time: 0.120469 Jun 10 18:13:03.783360 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2147/4444] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:13:03 2022] GET /compute/v2.1/images/aee08346-4b62-4826-a43f-15229e36ace1 => generated 661 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:13:03.800614 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b63ac78f-b3f5-4114-8f8e-be968d35d0ef tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c0fd13a0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:03.871678 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b63ac78f-b3f5-4114-8f8e-be968d35d0ef tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/aee08346-4b62-4826-a43f-15229e36ace1" status: 200 len: 661 microversion: 2.1 time: 0.075402 Jun 10 18:13:03.880329 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2148/4445] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:13:03 2022] GET /compute/v2.1/images/aee08346-4b62-4826-a43f-15229e36ace1 => generated 661 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:13:03.979620 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ce23ad30-92c6-4101-ab66-f5cd24aed999 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:03.990234 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ce23ad30-92c6-4101-ab66-f5cd24aed999 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1513 microversion: 2.1 time: 0.286137 Jun 10 18:13:03.991238 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2298/4446] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:03 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1513 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:04.114310 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7f61b1c6-29fb-4572-b7f5-e0d4c1ed43d5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:13:04.114889 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7f61b1c6-29fb-4572-b7f5-e0d4c1ed43d5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:04.122306 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:13:04.136110 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7f61b1c6-29fb-4572-b7f5-e0d4c1ed43d5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:04.136110 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7f61b1c6-29fb-4572-b7f5-e0d4c1ed43d5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:04.136110 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7f61b1c6-29fb-4572-b7f5-e0d4c1ed43d5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:04.136999 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7f61b1c6-29fb-4572-b7f5-e0d4c1ed43d5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:04.202878 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-7f61b1c6-29fb-4572-b7f5-e0d4c1ed43d5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lazy-loading 'flavor' on Instance uuid 57a377b2-f75e-4a0c-8401-090db42db644 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:13:04.231748 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-7f61b1c6-29fb-4572-b7f5-e0d4c1ed43d5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] HTTP exception thrown: Cannot 'shelve' instance 57a377b2-f75e-4a0c-8401-090db42db644 while it is in vm_state shelved_offloaded Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7f61b1c6-29fb-4572-b7f5-e0d4c1ed43d5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644/action HTTP/1.1 Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 14 Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: {"shelve": {}} Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: exception: Cannot 'shelve' instance 57a377b2-f75e-4a0c-8401-090db42db644 while it is in vm_state shelved_offloaded Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '57a377b2-f75e-4a0c-8401-090db42db644', 'body': {'shelve': {}}} Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 57a377b2-f75e-4a0c-8401-090db42db644 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Jun 10 18:13:04.235267 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 10 18:13:04.240808 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 10 18:13:04.240808 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 10 18:13:04.240808 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 57a377b2-f75e-4a0c-8401-090db42db644 while it is in vm_state shelved_offloaded Jun 10 18:13:04.240808 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:04.240808 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:13:04.240808 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:04.240808 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:13:04.240808 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:13:04.240808 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:13:04.240808 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:13:04.240808 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:13:04.240808 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 57a377b2-f75e-4a0c-8401-090db42db644 while it is in vm_state shelved_offloaded Jun 10 18:13:04.240808 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:04.247277 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b1e20196-d36b-44b6-8259-2bbeb2c04e83 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:04.247667 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7f61b1c6-29fb-4572-b7f5-e0d4c1ed43d5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 409 to user: Cannot 'shelve' instance 57a377b2-f75e-4a0c-8401-090db42db644 while it is in vm_state shelved_offloaded {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:13:04.247907 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b1e20196-d36b-44b6-8259-2bbeb2c04e83 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 551856e9-a45b-412d-979d-b14039d74fea] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:04.248938 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7f61b1c6-29fb-4572-b7f5-e0d4c1ed43d5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "POST /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644/action" status: 409 len: 155 microversion: 2.1 time: 0.141812 Jun 10 18:13:04.254149 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2149/4447] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:13:04 2022] POST /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644/action => generated 155 bytes in 148 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:13:04.259586 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b1e20196-d36b-44b6-8259-2bbeb2c04e83 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:04.261419 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b1e20196-d36b-44b6-8259-2bbeb2c04e83 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:04.263531 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b1e20196-d36b-44b6-8259-2bbeb2c04e83 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:04.264976 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b1e20196-d36b-44b6-8259-2bbeb2c04e83 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:04.267446 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fc229c91-ab1d-4d30-85ce-0bdc153f258d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:13:04.268043 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fc229c91-ab1d-4d30-85ce-0bdc153f258d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:04.276252 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fc229c91-ab1d-4d30-85ce-0bdc153f258d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:04.276559 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fc229c91-ab1d-4d30-85ce-0bdc153f258d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:04.277354 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fc229c91-ab1d-4d30-85ce-0bdc153f258d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:04.277807 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fc229c91-ab1d-4d30-85ce-0bdc153f258d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:04.343673 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:13:04.434077 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:13:04.512175 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b1e20196-d36b-44b6-8259-2bbeb2c04e83 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:04.523817 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b1e20196-d36b-44b6-8259-2bbeb2c04e83 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea" status: 200 len: 1324 microversion: 2.1 time: 0.288532 Jun 10 18:13:04.525180 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2299/4448] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:04 2022] GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea => generated 1324 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:04.647401 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fc229c91-ab1d-4d30-85ce-0bdc153f258d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "POST /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644/action" status: 202 len: 0 microversion: 2.1 time: 0.384552 Jun 10 18:13:04.651255 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2150/4449] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:13:04 2022] POST /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644/action => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:13:04.664514 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d12eba09-aa7f-46b9-bf0d-d2047df2d4c8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:04.665539 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d12eba09-aa7f-46b9-bf0d-d2047df2d4c8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:04.684643 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d12eba09-aa7f-46b9-bf0d-d2047df2d4c8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:04.686322 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d12eba09-aa7f-46b9-bf0d-d2047df2d4c8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:04.689069 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d12eba09-aa7f-46b9-bf0d-d2047df2d4c8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:04.690596 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d12eba09-aa7f-46b9-bf0d-d2047df2d4c8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:04.708027 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-98d268b5-7e7f-4000-9094-e8ba8f591a4d tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:04.708694 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-98d268b5-7e7f-4000-9094-e8ba8f591a4d tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:04.724086 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-98d268b5-7e7f-4000-9094-e8ba8f591a4d tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:04.724608 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-98d268b5-7e7f-4000-9094-e8ba8f591a4d tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:04.725503 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-98d268b5-7e7f-4000-9094-e8ba8f591a4d tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:04.727094 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-98d268b5-7e7f-4000-9094-e8ba8f591a4d tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:04.989244 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d12eba09-aa7f-46b9-bf0d-d2047df2d4c8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:04.998284 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d12eba09-aa7f-46b9-bf0d-d2047df2d4c8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1461 microversion: 2.1 time: 0.338534 Jun 10 18:13:04.998890 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2300/4450] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:04 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1461 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:05.020565 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-98d268b5-7e7f-4000-9094-e8ba8f591a4d tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:05.029644 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-98d268b5-7e7f-4000-9094-e8ba8f591a4d tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca" status: 200 len: 1519 microversion: 2.1 time: 0.325230 Jun 10 18:13:05.030380 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2151/4451] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:04 2022] GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca => generated 1519 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:05.542416 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c893c577-8f4f-49c9-b1f3-43befd00c07a tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:05.543235 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c893c577-8f4f-49c9-b1f3-43befd00c07a tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 551856e9-a45b-412d-979d-b14039d74fea] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:05.549881 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c893c577-8f4f-49c9-b1f3-43befd00c07a tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:05.550526 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c893c577-8f4f-49c9-b1f3-43befd00c07a tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:05.551523 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c893c577-8f4f-49c9-b1f3-43befd00c07a tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:05.552127 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c893c577-8f4f-49c9-b1f3-43befd00c07a tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:05.777510 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c893c577-8f4f-49c9-b1f3-43befd00c07a tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:05.787250 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c893c577-8f4f-49c9-b1f3-43befd00c07a tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea" status: 200 len: 1324 microversion: 2.1 time: 0.248801 Jun 10 18:13:05.787833 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2301/4452] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:05 2022] GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea => generated 1324 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:06.017889 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-897a6115-e4bb-49c5-b15e-047b9f8189b0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:06.019158 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-897a6115-e4bb-49c5-b15e-047b9f8189b0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:06.032867 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-897a6115-e4bb-49c5-b15e-047b9f8189b0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:06.035146 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-897a6115-e4bb-49c5-b15e-047b9f8189b0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:06.038021 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-897a6115-e4bb-49c5-b15e-047b9f8189b0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:06.038809 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-897a6115-e4bb-49c5-b15e-047b9f8189b0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:06.048702 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c41aa1d2-7c5b-44e4-9eaf-34bdcefda605 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:06.049319 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c41aa1d2-7c5b-44e4-9eaf-34bdcefda605 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:06.067756 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c41aa1d2-7c5b-44e4-9eaf-34bdcefda605 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:06.068460 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c41aa1d2-7c5b-44e4-9eaf-34bdcefda605 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:06.072451 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c41aa1d2-7c5b-44e4-9eaf-34bdcefda605 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:06.074348 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c41aa1d2-7c5b-44e4-9eaf-34bdcefda605 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:06.368964 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c41aa1d2-7c5b-44e4-9eaf-34bdcefda605 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:06.388486 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c41aa1d2-7c5b-44e4-9eaf-34bdcefda605 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca" status: 200 len: 1519 microversion: 2.1 time: 0.344846 Jun 10 18:13:06.404711 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2302/4453] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:06 2022] GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca => generated 1519 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:13:06.421854 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-897a6115-e4bb-49c5-b15e-047b9f8189b0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:06.422873 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b70c51f3-3ec1-48a3-9f8c-111d637b7e50 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3a903a0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:06.431174 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-897a6115-e4bb-49c5-b15e-047b9f8189b0 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1461 microversion: 2.1 time: 0.419881 Jun 10 18:13:06.435442 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2152/4454] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:06 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1461 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:06.498585 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b70c51f3-3ec1-48a3-9f8c-111d637b7e50 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/7e9a5b58-a876-4bde-88e1-dca7e152cc89" status: 200 len: 661 microversion: 2.1 time: 0.092201 Jun 10 18:13:06.499181 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2303/4455] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:13:06 2022] GET /compute/v2.1/images/7e9a5b58-a876-4bde-88e1-dca7e152cc89 => generated 661 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:13:06.512583 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8be62b84-411d-4291-88a2-30dab7a83ef6 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c181eee0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:06.573156 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8be62b84-411d-4291-88a2-30dab7a83ef6 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/7e9a5b58-a876-4bde-88e1-dca7e152cc89" status: 200 len: 661 microversion: 2.1 time: 0.065620 Jun 10 18:13:06.574540 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2153/4456] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:13:06 2022] GET /compute/v2.1/images/7e9a5b58-a876-4bde-88e1-dca7e152cc89 => generated 661 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:13:06.805618 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f7619e13-6cdf-40e8-8e54-eee514b1d868 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:06.806501 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f7619e13-6cdf-40e8-8e54-eee514b1d868 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 551856e9-a45b-412d-979d-b14039d74fea] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:06.820148 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f7619e13-6cdf-40e8-8e54-eee514b1d868 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:06.822244 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f7619e13-6cdf-40e8-8e54-eee514b1d868 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:06.823164 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f7619e13-6cdf-40e8-8e54-eee514b1d868 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:06.823694 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f7619e13-6cdf-40e8-8e54-eee514b1d868 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:07.031542 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f7619e13-6cdf-40e8-8e54-eee514b1d868 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:07.050270 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f7619e13-6cdf-40e8-8e54-eee514b1d868 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea" status: 200 len: 1324 microversion: 2.1 time: 0.249625 Jun 10 18:13:07.057514 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2304/4457] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:06 2022] GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea => generated 1324 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:07.411149 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3c3748ea-0cab-4161-add0-3bd0d84f2333 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:07.411743 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3c3748ea-0cab-4161-add0-3bd0d84f2333 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:07.425355 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3c3748ea-0cab-4161-add0-3bd0d84f2333 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:07.430290 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3c3748ea-0cab-4161-add0-3bd0d84f2333 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:07.431421 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3c3748ea-0cab-4161-add0-3bd0d84f2333 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:07.431866 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3c3748ea-0cab-4161-add0-3bd0d84f2333 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:07.456051 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0b29a2dd-3976-46e6-b7bd-5a09763fb98c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:07.456988 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0b29a2dd-3976-46e6-b7bd-5a09763fb98c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:07.474352 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0b29a2dd-3976-46e6-b7bd-5a09763fb98c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:07.474740 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0b29a2dd-3976-46e6-b7bd-5a09763fb98c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:07.475748 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0b29a2dd-3976-46e6-b7bd-5a09763fb98c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:07.476189 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0b29a2dd-3976-46e6-b7bd-5a09763fb98c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:07.732519 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0b29a2dd-3976-46e6-b7bd-5a09763fb98c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:07.736924 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0b29a2dd-3976-46e6-b7bd-5a09763fb98c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1463 microversion: 2.1 time: 0.285640 Jun 10 18:13:07.737539 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2305/4458] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:07 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1463 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:07.800725 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3c3748ea-0cab-4161-add0-3bd0d84f2333 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:07.809519 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3c3748ea-0cab-4161-add0-3bd0d84f2333 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca" status: 200 len: 1519 microversion: 2.1 time: 0.403212 Jun 10 18:13:07.819429 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2154/4459] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:07 2022] GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca => generated 1519 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:08.067956 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7c757b5d-f440-4b88-87ad-6d84c6fd0ca5 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:08.069559 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7c757b5d-f440-4b88-87ad-6d84c6fd0ca5 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 551856e9-a45b-412d-979d-b14039d74fea] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:08.081093 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7c757b5d-f440-4b88-87ad-6d84c6fd0ca5 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:08.084566 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7c757b5d-f440-4b88-87ad-6d84c6fd0ca5 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:08.085743 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7c757b5d-f440-4b88-87ad-6d84c6fd0ca5 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:08.086419 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7c757b5d-f440-4b88-87ad-6d84c6fd0ca5 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:08.362830 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7c757b5d-f440-4b88-87ad-6d84c6fd0ca5 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:08.373221 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7c757b5d-f440-4b88-87ad-6d84c6fd0ca5 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea" status: 200 len: 1324 microversion: 2.1 time: 0.309849 Jun 10 18:13:08.378387 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2306/4460] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:08 2022] GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea => generated 1324 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:08.696908 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-b2935ab0-bd1f-44a7-941f-5dbee6944276 req-12e72e92-925e-49b1-9425-f25ba55ff90b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "551856e9-a45b-412d-979d-b14039d74fea", "name": "network-vif-plugged", "status": "completed", "tag": "1859187f-370b-4ada-a7b6-04d61eec3731"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:13:08.716607 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-b2935ab0-bd1f-44a7-941f-5dbee6944276 req-12e72e92-925e-49b1-9425-f25ba55ff90b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:08.717048 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-b2935ab0-bd1f-44a7-941f-5dbee6944276 req-12e72e92-925e-49b1-9425-f25ba55ff90b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:08.729730 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-b2935ab0-bd1f-44a7-941f-5dbee6944276 req-12e72e92-925e-49b1-9425-f25ba55ff90b service nova] Creating event network-vif-plugged:1859187f-370b-4ada-a7b6-04d61eec3731 for instance 551856e9-a45b-412d-979d-b14039d74fea on chh2-master-2 Jun 10 18:13:08.735891 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-b2935ab0-bd1f-44a7-941f-5dbee6944276 req-12e72e92-925e-49b1-9425-f25ba55ff90b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.226804 Jun 10 18:13:08.736886 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2155/4461] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:13:08.756035 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fb1b788b-6479-4cb2-9b46-3c16e3153a0f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:08.756689 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fb1b788b-6479-4cb2-9b46-3c16e3153a0f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:08.762688 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:13:08.766788 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fb1b788b-6479-4cb2-9b46-3c16e3153a0f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:08.767366 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fb1b788b-6479-4cb2-9b46-3c16e3153a0f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:08.778417 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fb1b788b-6479-4cb2-9b46-3c16e3153a0f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:08.778906 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fb1b788b-6479-4cb2-9b46-3c16e3153a0f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:08.833566 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5b30452b-326c-47d0-821f-a626417feb0e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:08.835790 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5b30452b-326c-47d0-821f-a626417feb0e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:08.845516 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5b30452b-326c-47d0-821f-a626417feb0e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:08.846257 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5b30452b-326c-47d0-821f-a626417feb0e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:08.847421 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5b30452b-326c-47d0-821f-a626417feb0e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:08.851112 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5b30452b-326c-47d0-821f-a626417feb0e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:08.967569 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fb1b788b-6479-4cb2-9b46-3c16e3153a0f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:08.977887 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fb1b788b-6479-4cb2-9b46-3c16e3153a0f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1519 microversion: 2.1 time: 0.225722 Jun 10 18:13:08.987699 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2307/4462] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:08 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1519 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:09.038026 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-93938614-0ec6-49fd-a06a-8345bd0fee65 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3a958b0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:09.096630 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-93938614-0ec6-49fd-a06a-8345bd0fee65 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/be6118bb-b7b8-4366-bdca-3db93ccdc708" status: 200 len: 662 microversion: 2.1 time: 0.062601 Jun 10 18:13:09.097542 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2308/4463] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:13:09 2022] GET /compute/v2.1/images/be6118bb-b7b8-4366-bdca-3db93ccdc708 => generated 662 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:13:09.108136 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ceed3576-8ee2-4d9c-b333-540d06670f40 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3c65160>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:09.168588 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ceed3576-8ee2-4d9c-b333-540d06670f40 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/be6118bb-b7b8-4366-bdca-3db93ccdc708" status: 200 len: 662 microversion: 2.1 time: 0.064071 Jun 10 18:13:09.172353 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2309/4464] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:13:09 2022] GET /compute/v2.1/images/be6118bb-b7b8-4366-bdca-3db93ccdc708 => generated 662 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:13:09.284940 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3fc24c29-7158-4e06-acb9-a22970013648 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1043181882", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:13:09.343098 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-3fc24c29-7158-4e06-acb9-a22970013648 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] validate_networks() for None {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:13:09.373709 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5b30452b-326c-47d0-821f-a626417feb0e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:09.383053 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5b30452b-326c-47d0-821f-a626417feb0e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca" status: 200 len: 1519 microversion: 2.1 time: 0.559845 Jun 10 18:13:09.398504 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2156/4465] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:08 2022] GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca => generated 1519 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:09.442741 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-db27f8c8-de11-4b95-bf9c-ea6766411ecd tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:09.447878 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-db27f8c8-de11-4b95-bf9c-ea6766411ecd tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 551856e9-a45b-412d-979d-b14039d74fea] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:09.458065 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-db27f8c8-de11-4b95-bf9c-ea6766411ecd tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:09.459867 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-db27f8c8-de11-4b95-bf9c-ea6766411ecd tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:09.462645 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-db27f8c8-de11-4b95-bf9c-ea6766411ecd tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:09.464433 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-db27f8c8-de11-4b95-bf9c-ea6766411ecd tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:09.767217 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-3fc24c29-7158-4e06-acb9-a22970013648 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:13:09.771215 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-3fc24c29-7158-4e06-acb9-a22970013648 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:13:09.772247 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-3fc24c29-7158-4e06-acb9-a22970013648 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:13:09.776342 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-3fc24c29-7158-4e06-acb9-a22970013648 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:13:09.777148 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-3fc24c29-7158-4e06-acb9-a22970013648 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:13:09.803355 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3fc24c29-7158-4e06-acb9-a22970013648 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:09.803818 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3fc24c29-7158-4e06-acb9-a22970013648 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:09.804739 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3fc24c29-7158-4e06-acb9-a22970013648 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:09.805419 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3fc24c29-7158-4e06-acb9-a22970013648 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:09.825962 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-db27f8c8-de11-4b95-bf9c-ea6766411ecd tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:09.830368 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-3fc24c29-7158-4e06-acb9-a22970013648 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Getting quotas for project 6575b0846dca493f9e99ee122930972d. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:13:09.835219 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-db27f8c8-de11-4b95-bf9c-ea6766411ecd tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea" status: 200 len: 1324 microversion: 2.1 time: 0.435269 Jun 10 18:13:09.842371 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-3fc24c29-7158-4e06-acb9-a22970013648 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Getting quotas for user d404e4ab55af470fa464b94f9f0cd2bc and project 6575b0846dca493f9e99ee122930972d. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:13:09.852743 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2157/4466] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:09 2022] GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea => generated 1324 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:09.889997 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3fc24c29-7158-4e06-acb9-a22970013648 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:13:09.893215 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3fc24c29-7158-4e06-acb9-a22970013648 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 72eaef23-30d6-4755-a9b7-9547856075b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:13:09.994649 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-419d86c5-ba65-42b5-899b-6a193f1aed62 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:09.995743 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-419d86c5-ba65-42b5-899b-6a193f1aed62 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:10.008725 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-419d86c5-ba65-42b5-899b-6a193f1aed62 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:10.009455 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-419d86c5-ba65-42b5-899b-6a193f1aed62 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:10.010420 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-419d86c5-ba65-42b5-899b-6a193f1aed62 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:10.011110 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-419d86c5-ba65-42b5-899b-6a193f1aed62 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:10.035947 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3fc24c29-7158-4e06-acb9-a22970013648 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.754971 Jun 10 18:13:10.041152 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2310/4467] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:13:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 10 18:13:10.107727 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5515997e-3dcb-46a5-91c7-dd6dc67dd498 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1709968968", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:13:10.223198 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-5515997e-3dcb-46a5-91c7-dd6dc67dd498 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] validate_networks() for None {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:13:10.556859 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-419d86c5-ba65-42b5-899b-6a193f1aed62 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:10.564917 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-419d86c5-ba65-42b5-899b-6a193f1aed62 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1519 microversion: 2.1 time: 0.574779 Jun 10 18:13:10.565638 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2158/4468] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:09 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1519 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:13:10.573754 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-17f11310-529e-4ee8-966f-c0116d3fdc08 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:10.624583 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-17f11310-529e-4ee8-966f-c0116d3fdc08 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:10.660555 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-17f11310-529e-4ee8-966f-c0116d3fdc08 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:10.661040 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-17f11310-529e-4ee8-966f-c0116d3fdc08 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:10.661841 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-17f11310-529e-4ee8-966f-c0116d3fdc08 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:10.662287 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-17f11310-529e-4ee8-966f-c0116d3fdc08 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:11.017498 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-5515997e-3dcb-46a5-91c7-dd6dc67dd498 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:13:11.018346 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-5515997e-3dcb-46a5-91c7-dd6dc67dd498 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:13:11.019140 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-5515997e-3dcb-46a5-91c7-dd6dc67dd498 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:13:11.020287 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-5515997e-3dcb-46a5-91c7-dd6dc67dd498 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:13:11.021244 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-5515997e-3dcb-46a5-91c7-dd6dc67dd498 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:13:11.043649 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5515997e-3dcb-46a5-91c7-dd6dc67dd498 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:11.044159 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5515997e-3dcb-46a5-91c7-dd6dc67dd498 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:11.046575 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5515997e-3dcb-46a5-91c7-dd6dc67dd498 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:11.047038 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5515997e-3dcb-46a5-91c7-dd6dc67dd498 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:11.110303 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-5515997e-3dcb-46a5-91c7-dd6dc67dd498 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Getting quotas for project 6575b0846dca493f9e99ee122930972d. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:13:11.118041 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-5515997e-3dcb-46a5-91c7-dd6dc67dd498 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Getting quotas for user d404e4ab55af470fa464b94f9f0cd2bc and project 6575b0846dca493f9e99ee122930972d. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:13:11.141073 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5515997e-3dcb-46a5-91c7-dd6dc67dd498 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:13:11.145880 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5515997e-3dcb-46a5-91c7-dd6dc67dd498 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 89cea229-7bfb-43e4-a855-e9c6ae81d37b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:13:11.234573 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-17f11310-529e-4ee8-966f-c0116d3fdc08 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:11.246905 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-17f11310-529e-4ee8-966f-c0116d3fdc08 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca" status: 200 len: 1519 microversion: 2.1 time: 0.680256 Jun 10 18:13:11.248464 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2159/4469] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:10 2022] GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca => generated 1519 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:11.255533 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-55475ee0-0447-4348-b0ae-6552ba6d85cb tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:11.256388 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-55475ee0-0447-4348-b0ae-6552ba6d85cb tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 551856e9-a45b-412d-979d-b14039d74fea] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:11.272789 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-55475ee0-0447-4348-b0ae-6552ba6d85cb tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:11.273529 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-55475ee0-0447-4348-b0ae-6552ba6d85cb tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:11.274542 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-55475ee0-0447-4348-b0ae-6552ba6d85cb tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:11.275221 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-55475ee0-0447-4348-b0ae-6552ba6d85cb tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:11.388720 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5515997e-3dcb-46a5-91c7-dd6dc67dd498 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.286736 Jun 10 18:13:11.389968 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2311/4470] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:13:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1289 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 10 18:13:11.395268 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-370b31b4-da36-4d87-93af-057a59d9ff95 req-af64eb8b-eace-45c7-919a-74036894b294 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57a377b2-f75e-4a0c-8401-090db42db644", "tag": "ea23750f-0e21-482f-b68f-6361eeb3c636"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:13:11.430214 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-370b31b4-da36-4d87-93af-057a59d9ff95 req-af64eb8b-eace-45c7-919a-74036894b294 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:11.430871 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-370b31b4-da36-4d87-93af-057a59d9ff95 req-af64eb8b-eace-45c7-919a-74036894b294 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:11.469044 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-370b31b4-da36-4d87-93af-057a59d9ff95 req-af64eb8b-eace-45c7-919a-74036894b294 service nova] Creating event network-changed:ea23750f-0e21-482f-b68f-6361eeb3c636 for instance 57a377b2-f75e-4a0c-8401-090db42db644 on chh2-master-2 Jun 10 18:13:11.482655 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-370b31b4-da36-4d87-93af-057a59d9ff95 req-af64eb8b-eace-45c7-919a-74036894b294 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091215 Jun 10 18:13:11.484656 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2312/4471] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:13:11.495709 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0d94ae89-ea8a-4b62-8a9d-4ff8be19b476 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:11.498922 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0d94ae89-ea8a-4b62-8a9d-4ff8be19b476 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 89cea229-7bfb-43e4-a855-e9c6ae81d37b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:11.809291 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0d94ae89-ea8a-4b62-8a9d-4ff8be19b476 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd404e4ab55af470fa464b94f9f0cd2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6575b0846dca493f9e99ee122930972d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:11.817881 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0d94ae89-ea8a-4b62-8a9d-4ff8be19b476 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b" status: 200 len: 1218 microversion: 2.1 time: 0.331780 Jun 10 18:13:11.833112 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2313/4472] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:11 2022] GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b => generated 1218 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:11.842884 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d27378b3-994b-47e6-b9af-d03a7e8e0d7d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:11.856555 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d27378b3-994b-47e6-b9af-d03a7e8e0d7d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:11.870888 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d27378b3-994b-47e6-b9af-d03a7e8e0d7d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:11.871340 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d27378b3-994b-47e6-b9af-d03a7e8e0d7d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:11.872692 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d27378b3-994b-47e6-b9af-d03a7e8e0d7d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:11.873198 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d27378b3-994b-47e6-b9af-d03a7e8e0d7d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:11.970442 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-55475ee0-0447-4348-b0ae-6552ba6d85cb tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:11.994929 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-55475ee0-0447-4348-b0ae-6552ba6d85cb tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea" status: 200 len: 1520 microversion: 2.1 time: 0.743038 Jun 10 18:13:12.005793 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2160/4473] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:11 2022] GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea => generated 1520 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:12.022218 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a8afa40c-5512-46a6-af73-742ef52c23c3 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:12.025100 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a8afa40c-5512-46a6-af73-742ef52c23c3 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 551856e9-a45b-412d-979d-b14039d74fea] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:12.032367 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a8afa40c-5512-46a6-af73-742ef52c23c3 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:12.033099 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a8afa40c-5512-46a6-af73-742ef52c23c3 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:12.034065 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a8afa40c-5512-46a6-af73-742ef52c23c3 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:12.034720 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a8afa40c-5512-46a6-af73-742ef52c23c3 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:12.331446 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d27378b3-994b-47e6-b9af-d03a7e8e0d7d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:12.340847 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d27378b3-994b-47e6-b9af-d03a7e8e0d7d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1519 microversion: 2.1 time: 0.506029 Jun 10 18:13:12.341444 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2314/4474] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:11 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1519 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:12.346128 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d9719d6e-74a3-4fb6-aeef-8a1177b8c9b0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:12.346743 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d9719d6e-74a3-4fb6-aeef-8a1177b8c9b0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:12.370531 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d9719d6e-74a3-4fb6-aeef-8a1177b8c9b0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:12.372232 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d9719d6e-74a3-4fb6-aeef-8a1177b8c9b0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:12.375757 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d9719d6e-74a3-4fb6-aeef-8a1177b8c9b0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:12.377818 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d9719d6e-74a3-4fb6-aeef-8a1177b8c9b0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:12.568430 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a8afa40c-5512-46a6-af73-742ef52c23c3 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:12.615509 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a8afa40c-5512-46a6-af73-742ef52c23c3 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea" status: 200 len: 1520 microversion: 2.1 time: 0.594776 Jun 10 18:13:12.617088 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2161/4475] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:12 2022] GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea => generated 1520 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:13:12.643203 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a43d30aa-437a-45f0-bf45-3dc773a994d6 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-47339351"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:13:12.643203 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a43d30aa-437a-45f0-bf45-3dc773a994d6 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 551856e9-a45b-412d-979d-b14039d74fea] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:12.651440 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a43d30aa-437a-45f0-bf45-3dc773a994d6 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:12.652394 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a43d30aa-437a-45f0-bf45-3dc773a994d6 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:12.653419 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a43d30aa-437a-45f0-bf45-3dc773a994d6 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:12.653992 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d9719d6e-74a3-4fb6-aeef-8a1177b8c9b0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:12.656072 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a43d30aa-437a-45f0-bf45-3dc773a994d6 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:12.663750 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d9719d6e-74a3-4fb6-aeef-8a1177b8c9b0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca" status: 200 len: 1519 microversion: 2.1 time: 0.321248 Jun 10 18:13:12.665848 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2315/4476] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:12 2022] GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca => generated 1519 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:12.836117 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e0df8ab5-c009-47e5-85fc-de2400800daf tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:12.836845 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e0df8ab5-c009-47e5-85fc-de2400800daf tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 89cea229-7bfb-43e4-a855-e9c6ae81d37b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:13.021600 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e0df8ab5-c009-47e5-85fc-de2400800daf tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd404e4ab55af470fa464b94f9f0cd2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6575b0846dca493f9e99ee122930972d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:13.029417 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e0df8ab5-c009-47e5-85fc-de2400800daf tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b" status: 200 len: 1218 microversion: 2.1 time: 0.197037 Jun 10 18:13:13.040857 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2316/4477] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:12 2022] GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b => generated 1218 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:13.358391 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a654d45b-a07f-4984-97e8-4b715d3dcfca tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:13.359843 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a654d45b-a07f-4984-97e8-4b715d3dcfca tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:13.379660 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a654d45b-a07f-4984-97e8-4b715d3dcfca tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:13.380583 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a654d45b-a07f-4984-97e8-4b715d3dcfca tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:13.381690 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a654d45b-a07f-4984-97e8-4b715d3dcfca tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:13.382134 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a654d45b-a07f-4984-97e8-4b715d3dcfca tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:13.420077 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:13:13.479610 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a43d30aa-437a-45f0-bf45-3dc773a994d6 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "POST /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea/action" status: 202 len: 0 microversion: 2.1 time: 0.845727 Jun 10 18:13:13.482519 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2162/4478] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:13:12 2022] POST /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea/action => generated 0 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 10 18:13:13.527723 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b0f113aa-5994-4fea-ae6c-45d2810a7d1b tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '.version_select at 0x7f77c116d160>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:13.867169 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a654d45b-a07f-4984-97e8-4b715d3dcfca tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:13.881973 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a654d45b-a07f-4984-97e8-4b715d3dcfca tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1519 microversion: 2.1 time: 0.527357 Jun 10 18:13:13.884732 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2317/4479] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:13 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1519 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:13:13.899601 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c9126939-b5db-4080-bdc9-f92fd558b128 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:13.902783 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c9126939-b5db-4080-bdc9-f92fd558b128 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:13.915329 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c9126939-b5db-4080-bdc9-f92fd558b128 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:13.917052 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c9126939-b5db-4080-bdc9-f92fd558b128 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:13.921130 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c9126939-b5db-4080-bdc9-f92fd558b128 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:13.924893 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c9126939-b5db-4080-bdc9-f92fd558b128 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:14.130669 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b0f113aa-5994-4fea-ae6c-45d2810a7d1b tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "DELETE /compute/v2.1/images/4867bcde-9417-4a41-b013-b5991d4d5d2b" status: 204 len: 0 microversion: 2.1 time: 0.641273 Jun 10 18:13:14.132409 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2163/4480] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:13 2022] DELETE /compute/v2.1/images/4867bcde-9417-4a41-b013-b5991d4d5d2b => generated 0 bytes in 644 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:13:14.148773 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c4da4507-7cd7-4cb8-a319-201897b51428 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:14.155584 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c4da4507-7cd7-4cb8-a319-201897b51428 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 89cea229-7bfb-43e4-a855-e9c6ae81d37b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:14.189756 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c4da4507-7cd7-4cb8-a319-201897b51428 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:14.192385 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c4da4507-7cd7-4cb8-a319-201897b51428 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:14.195477 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c4da4507-7cd7-4cb8-a319-201897b51428 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:14.198624 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c4da4507-7cd7-4cb8-a319-201897b51428 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:14.612585 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c4da4507-7cd7-4cb8-a319-201897b51428 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd404e4ab55af470fa464b94f9f0cd2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6575b0846dca493f9e99ee122930972d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:14.628113 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c4da4507-7cd7-4cb8-a319-201897b51428 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b" status: 200 len: 1270 microversion: 2.1 time: 0.488195 Jun 10 18:13:14.629241 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2164/4481] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:14 2022] GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b => generated 1270 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:14.651065 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-673f8d70-5150-4d8a-a6eb-3d052f781e64 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '.version_select at 0x7f77c0cb65e0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:14.705168 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-673f8d70-5150-4d8a-a6eb-3d052f781e64 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] HTTP exception thrown: Image not found. Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-673f8d70-5150-4d8a-a6eb-3d052f781e64 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Request method failure captured: Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/images/4867bcde-9417-4a41-b013-b5991d4d5d2b HTTP/1.1 Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4lsfzX-ZssLhBeRERA250Allr9sy5j_9WvmWWrmV8OKGfGLWtKo7IkZmvrlgadYYrKiCJiGv3V0W6WUpTPzvczOtcJBE7CxOiD9g_bSlYjPmyz5JBO2nqOTXPUSYGg7_D3Rbko1iq-cS8Cxtg3C-XqYzZtQdMv47S3ncw5oU530j6g Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: dc6ea0e4d347491eb23c3af053313211 Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-582167706 Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/dc6ea0e4d347491eb23c3af053313211"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/dc6ea0e4d347491eb23c3af053313211"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/dc6ea0e4d347491eb23c3af053313211"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_dc6ea0e4d347491eb23c3af053313211", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-582167706 Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: dc6ea0e4d347491eb23c3af053313211 Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-582167706 Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ImagesOneServerNegativeTestJSON-582167706-project Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 8e6b5cd42b2144a69590680e5ef156fa Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-582167706-project Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: exception: Image not found. Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '4867bcde-9417-4a41-b013-b5991d4d5d2b'} Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4867bcde-9417-4a41-b013-b5991d4d5d2b Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 10 18:13:14.708400 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4867bcde-9417-4a41-b013-b5991d4d5d2b could not be found. Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-673f8d70-5150-4d8a-a6eb-3d052f781e64 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Returning 404 to user: Image not found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-673f8d70-5150-4d8a-a6eb-3d052f781e64 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/images/4867bcde-9417-4a41-b013-b5991d4d5d2b" status: 404 len: 62 microversion: 2.1 time: 0.077639 Jun 10 18:13:14.713819 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2165/4482] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:13:14 2022] GET /compute/v2.1/images/4867bcde-9417-4a41-b013-b5991d4d5d2b => generated 62 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:13:14.738870 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-156e2856-223c-4547-80e3-b24ff5360939 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:14.738870 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-156e2856-223c-4547-80e3-b24ff5360939 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 551856e9-a45b-412d-979d-b14039d74fea] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:14.750598 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-156e2856-223c-4547-80e3-b24ff5360939 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:14.751053 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-156e2856-223c-4547-80e3-b24ff5360939 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:14.751842 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-156e2856-223c-4547-80e3-b24ff5360939 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:14.752337 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-156e2856-223c-4547-80e3-b24ff5360939 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:15.081102 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-156e2856-223c-4547-80e3-b24ff5360939 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:15.093761 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-156e2856-223c-4547-80e3-b24ff5360939 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea" status: 200 len: 1532 microversion: 2.1 time: 0.375666 Jun 10 18:13:15.114112 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c9126939-b5db-4080-bdc9-f92fd558b128 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:15.116400 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2166/4483] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:14 2022] GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea => generated 1532 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:15.123596 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dcdfcb52-14d3-44dc-a998-2a3e4f6db5c5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:15.124867 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dcdfcb52-14d3-44dc-a998-2a3e4f6db5c5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:15.127309 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c9126939-b5db-4080-bdc9-f92fd558b128 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca" status: 200 len: 1519 microversion: 2.1 time: 1.237756 Jun 10 18:13:15.127945 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2318/4484] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:13 2022] GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca => generated 1519 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:15.135632 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dcdfcb52-14d3-44dc-a998-2a3e4f6db5c5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:15.136687 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dcdfcb52-14d3-44dc-a998-2a3e4f6db5c5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:15.137630 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dcdfcb52-14d3-44dc-a998-2a3e4f6db5c5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:15.138261 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dcdfcb52-14d3-44dc-a998-2a3e4f6db5c5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:15.647261 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-08eae7ca-65ff-4ee2-b222-39ec41de39ef tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:15.648392 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-08eae7ca-65ff-4ee2-b222-39ec41de39ef tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 89cea229-7bfb-43e4-a855-e9c6ae81d37b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:15.658939 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-08eae7ca-65ff-4ee2-b222-39ec41de39ef tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:15.665017 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-08eae7ca-65ff-4ee2-b222-39ec41de39ef tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:15.666146 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-08eae7ca-65ff-4ee2-b222-39ec41de39ef tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:15.670277 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-08eae7ca-65ff-4ee2-b222-39ec41de39ef tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:15.952065 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-08eae7ca-65ff-4ee2-b222-39ec41de39ef tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd404e4ab55af470fa464b94f9f0cd2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6575b0846dca493f9e99ee122930972d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:15.966568 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-08eae7ca-65ff-4ee2-b222-39ec41de39ef tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b" status: 200 len: 1288 microversion: 2.1 time: 0.324157 Jun 10 18:13:15.969262 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2319/4485] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:15 2022] GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b => generated 1288 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:13:16.111797 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-901a4ecf-3e97-4fe0-a7ca-8ac3604a1245 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:16.112581 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-901a4ecf-3e97-4fe0-a7ca-8ac3604a1245 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 551856e9-a45b-412d-979d-b14039d74fea] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:16.127158 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-901a4ecf-3e97-4fe0-a7ca-8ac3604a1245 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:16.127824 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-901a4ecf-3e97-4fe0-a7ca-8ac3604a1245 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:16.133297 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-901a4ecf-3e97-4fe0-a7ca-8ac3604a1245 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:16.136958 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-901a4ecf-3e97-4fe0-a7ca-8ac3604a1245 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:16.143505 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-dcdfcb52-14d3-44dc-a998-2a3e4f6db5c5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:16.153592 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dcdfcb52-14d3-44dc-a998-2a3e4f6db5c5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1519 microversion: 2.1 time: 1.035862 Jun 10 18:13:16.157295 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2167/4486] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:15 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1519 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:16.175023 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7988af4c-65e5-4f53-b416-26ceac8bb4b5 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:16.178042 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7988af4c-65e5-4f53-b416-26ceac8bb4b5 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:16.202232 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7988af4c-65e5-4f53-b416-26ceac8bb4b5 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:16.203088 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7988af4c-65e5-4f53-b416-26ceac8bb4b5 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:16.207640 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7988af4c-65e5-4f53-b416-26ceac8bb4b5 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:16.208403 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7988af4c-65e5-4f53-b416-26ceac8bb4b5 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:16.568056 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7988af4c-65e5-4f53-b416-26ceac8bb4b5 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:16.595887 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7988af4c-65e5-4f53-b416-26ceac8bb4b5 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca" status: 200 len: 1519 microversion: 2.1 time: 0.434750 Jun 10 18:13:16.598677 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2168/4487] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:16 2022] GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca => generated 1519 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:16.985860 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dfffdeb3-30eb-47ee-805a-107eb66368bd tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:16.990001 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dfffdeb3-30eb-47ee-805a-107eb66368bd tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 89cea229-7bfb-43e4-a855-e9c6ae81d37b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:16.998336 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dfffdeb3-30eb-47ee-805a-107eb66368bd tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:17.002793 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-901a4ecf-3e97-4fe0-a7ca-8ac3604a1245 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:17.004117 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dfffdeb3-30eb-47ee-805a-107eb66368bd tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:17.009442 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dfffdeb3-30eb-47ee-805a-107eb66368bd tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:17.010634 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-901a4ecf-3e97-4fe0-a7ca-8ac3604a1245 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea" status: 200 len: 1532 microversion: 2.1 time: 0.903116 Jun 10 18:13:17.011155 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dfffdeb3-30eb-47ee-805a-107eb66368bd tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:17.014114 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2320/4488] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:16 2022] GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea => generated 1532 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:17.031121 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:13:17.173883 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8d046d6e-940f-4276-b021-ba6092a4289e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:17.174508 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8d046d6e-940f-4276-b021-ba6092a4289e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:17.185618 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8d046d6e-940f-4276-b021-ba6092a4289e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:17.186073 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8d046d6e-940f-4276-b021-ba6092a4289e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:17.186896 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8d046d6e-940f-4276-b021-ba6092a4289e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:17.187342 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8d046d6e-940f-4276-b021-ba6092a4289e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:17.379772 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-dfffdeb3-30eb-47ee-805a-107eb66368bd tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd404e4ab55af470fa464b94f9f0cd2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6575b0846dca493f9e99ee122930972d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:17.398522 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dfffdeb3-30eb-47ee-805a-107eb66368bd tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b" status: 200 len: 1276 microversion: 2.1 time: 0.417108 Jun 10 18:13:17.406300 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2169/4489] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:16 2022] GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b => generated 1276 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:13:17.620033 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b85290c8-2d74-4f0b-94b6-d6fd220f8f9d tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:17.621415 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b85290c8-2d74-4f0b-94b6-d6fd220f8f9d tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:17.643757 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b85290c8-2d74-4f0b-94b6-d6fd220f8f9d tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:17.645248 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b85290c8-2d74-4f0b-94b6-d6fd220f8f9d tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:17.650518 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b85290c8-2d74-4f0b-94b6-d6fd220f8f9d tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:17.651632 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b85290c8-2d74-4f0b-94b6-d6fd220f8f9d tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:17.818838 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8d046d6e-940f-4276-b021-ba6092a4289e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:17.835192 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8d046d6e-940f-4276-b021-ba6092a4289e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1519 microversion: 2.1 time: 0.665070 Jun 10 18:13:17.850803 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2321/4490] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:17 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1519 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:18.033167 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e8f03c7b-859f-49cc-9316-8f9df763a78a tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:18.034326 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e8f03c7b-859f-49cc-9316-8f9df763a78a tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 551856e9-a45b-412d-979d-b14039d74fea] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:18.060769 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e8f03c7b-859f-49cc-9316-8f9df763a78a tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:18.061971 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e8f03c7b-859f-49cc-9316-8f9df763a78a tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:18.063056 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e8f03c7b-859f-49cc-9316-8f9df763a78a tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:18.063818 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e8f03c7b-859f-49cc-9316-8f9df763a78a tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:18.423117 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b85290c8-2d74-4f0b-94b6-d6fd220f8f9d tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:18.450926 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b85290c8-2d74-4f0b-94b6-d6fd220f8f9d tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca" status: 200 len: 1519 microversion: 2.1 time: 0.838704 Jun 10 18:13:18.461590 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2170/4491] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:17 2022] GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca => generated 1519 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:18.474573 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9afa2ff9-93b4-4d85-ad3f-23999294fcd9 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:18.509199 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9afa2ff9-93b4-4d85-ad3f-23999294fcd9 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 89cea229-7bfb-43e4-a855-e9c6ae81d37b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:18.564027 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9afa2ff9-93b4-4d85-ad3f-23999294fcd9 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:18.564759 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9afa2ff9-93b4-4d85-ad3f-23999294fcd9 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:18.579505 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9afa2ff9-93b4-4d85-ad3f-23999294fcd9 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:18.580175 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9afa2ff9-93b4-4d85-ad3f-23999294fcd9 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:18.892116 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9afa2ff9-93b4-4d85-ad3f-23999294fcd9 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd404e4ab55af470fa464b94f9f0cd2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6575b0846dca493f9e99ee122930972d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:18.900452 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9afa2ff9-93b4-4d85-ad3f-23999294fcd9 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b" status: 200 len: 1276 microversion: 2.1 time: 0.444609 Jun 10 18:13:18.907510 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2171/4492] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:18 2022] GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b => generated 1276 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:18.928346 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7c44a4ea-2e0d-48ef-b6ec-260644737631 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:18.930572 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7c44a4ea-2e0d-48ef-b6ec-260644737631 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:18.954522 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7c44a4ea-2e0d-48ef-b6ec-260644737631 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:18.954994 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7c44a4ea-2e0d-48ef-b6ec-260644737631 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:18.955803 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7c44a4ea-2e0d-48ef-b6ec-260644737631 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:18.956255 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7c44a4ea-2e0d-48ef-b6ec-260644737631 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:19.199219 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e8f03c7b-859f-49cc-9316-8f9df763a78a tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:19.211856 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e8f03c7b-859f-49cc-9316-8f9df763a78a tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea" status: 200 len: 1538 microversion: 2.1 time: 1.188779 Jun 10 18:13:19.215535 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2322/4493] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:18 2022] GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea => generated 1538 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:19.482443 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9c1276d9-6659-46b7-a554-d3f405930efa tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:19.483089 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9c1276d9-6659-46b7-a554-d3f405930efa tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:19.494537 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9c1276d9-6659-46b7-a554-d3f405930efa tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:19.498782 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9c1276d9-6659-46b7-a554-d3f405930efa tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:19.501756 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9c1276d9-6659-46b7-a554-d3f405930efa tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:19.503647 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9c1276d9-6659-46b7-a554-d3f405930efa tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:19.746672 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7c44a4ea-2e0d-48ef-b6ec-260644737631 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:19.765227 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7c44a4ea-2e0d-48ef-b6ec-260644737631 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1519 microversion: 2.1 time: 0.851264 Jun 10 18:13:19.769853 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2172/4494] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:18 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1519 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:19.926524 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1804644b-7ba9-44f7-8718-1b6940b5d4b7 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:19.928233 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1804644b-7ba9-44f7-8718-1b6940b5d4b7 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 89cea229-7bfb-43e4-a855-e9c6ae81d37b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:19.982976 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1804644b-7ba9-44f7-8718-1b6940b5d4b7 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:19.986354 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1804644b-7ba9-44f7-8718-1b6940b5d4b7 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:19.993009 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1804644b-7ba9-44f7-8718-1b6940b5d4b7 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:19.993009 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1804644b-7ba9-44f7-8718-1b6940b5d4b7 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:20.056234 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9c1276d9-6659-46b7-a554-d3f405930efa tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:20.069794 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9c1276d9-6659-46b7-a554-d3f405930efa tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca" status: 200 len: 1519 microversion: 2.1 time: 0.602387 Jun 10 18:13:20.073596 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2323/4495] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:19 2022] GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca => generated 1519 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:13:20.110909 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1804644b-7ba9-44f7-8718-1b6940b5d4b7 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd404e4ab55af470fa464b94f9f0cd2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6575b0846dca493f9e99ee122930972d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:20.122267 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1804644b-7ba9-44f7-8718-1b6940b5d4b7 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b" status: 200 len: 1276 microversion: 2.1 time: 0.201830 Jun 10 18:13:20.124921 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2173/4496] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:19 2022] GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b => generated 1276 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:20.238646 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a6ee3ad1-a638-42d1-96b5-e2c665dc56f7 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:20.241708 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a6ee3ad1-a638-42d1-96b5-e2c665dc56f7 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 551856e9-a45b-412d-979d-b14039d74fea] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:20.255255 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a6ee3ad1-a638-42d1-96b5-e2c665dc56f7 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:20.256419 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a6ee3ad1-a638-42d1-96b5-e2c665dc56f7 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:20.258070 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a6ee3ad1-a638-42d1-96b5-e2c665dc56f7 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:20.258849 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a6ee3ad1-a638-42d1-96b5-e2c665dc56f7 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:20.795307 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5107f580-32f0-411d-9800-7730500870c7 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:20.801507 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5107f580-32f0-411d-9800-7730500870c7 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:20.830146 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5107f580-32f0-411d-9800-7730500870c7 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:20.831339 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5107f580-32f0-411d-9800-7730500870c7 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:20.835528 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5107f580-32f0-411d-9800-7730500870c7 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:20.839152 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5107f580-32f0-411d-9800-7730500870c7 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:21.089336 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=4 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:13:21.558462 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5107f580-32f0-411d-9800-7730500870c7 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:21.575937 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5107f580-32f0-411d-9800-7730500870c7 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1519 microversion: 2.1 time: 0.788792 Jun 10 18:13:21.577908 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2174/4497] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:20 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1519 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:21.593650 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dc7d16db-db58-4edd-8875-ff1f4d3c3b93 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:21.605997 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dc7d16db-db58-4edd-8875-ff1f4d3c3b93 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:21.612537 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc7d16db-db58-4edd-8875-ff1f4d3c3b93 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:21.619361 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc7d16db-db58-4edd-8875-ff1f4d3c3b93 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:21.621659 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc7d16db-db58-4edd-8875-ff1f4d3c3b93 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:21.622331 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc7d16db-db58-4edd-8875-ff1f4d3c3b93 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:21.949532 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a6ee3ad1-a638-42d1-96b5-e2c665dc56f7 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:21.993816 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a6ee3ad1-a638-42d1-96b5-e2c665dc56f7 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea" status: 200 len: 1538 microversion: 2.1 time: 1.755832 Jun 10 18:13:21.997087 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2324/4498] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:20 2022] GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea => generated 1538 bytes in 1769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:22.006858 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4bcfc5d8-8142-4495-bb3c-cb1a1a42f6cd tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:22.009970 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4bcfc5d8-8142-4495-bb3c-cb1a1a42f6cd tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 89cea229-7bfb-43e4-a855-e9c6ae81d37b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:22.022524 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4bcfc5d8-8142-4495-bb3c-cb1a1a42f6cd tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:22.022983 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4bcfc5d8-8142-4495-bb3c-cb1a1a42f6cd tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:22.023823 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4bcfc5d8-8142-4495-bb3c-cb1a1a42f6cd tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:22.029012 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4bcfc5d8-8142-4495-bb3c-cb1a1a42f6cd tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:22.072381 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-dc7d16db-db58-4edd-8875-ff1f4d3c3b93 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:22.082124 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dc7d16db-db58-4edd-8875-ff1f4d3c3b93 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca" status: 200 len: 1519 microversion: 2.1 time: 0.501986 Jun 10 18:13:22.086144 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2175/4499] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:21 2022] GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca => generated 1519 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:22.367344 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-1409c365-8646-4f28-b57a-d9ef345cc39c req-0a05c265-fd96-4f37-85c5-a818e51559c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72eaef23-30d6-4755-a9b7-9547856075b3", "tag": "777ebce0-6591-4ee2-b139-f87b2964f3fb"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:13:22.396014 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-1409c365-8646-4f28-b57a-d9ef345cc39c req-0a05c265-fd96-4f37-85c5-a818e51559c8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:22.396842 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-1409c365-8646-4f28-b57a-d9ef345cc39c req-0a05c265-fd96-4f37-85c5-a818e51559c8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:22.492496 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-1409c365-8646-4f28-b57a-d9ef345cc39c req-0a05c265-fd96-4f37-85c5-a818e51559c8 service nova] Creating event network-changed:777ebce0-6591-4ee2-b139-f87b2964f3fb for instance 72eaef23-30d6-4755-a9b7-9547856075b3 on chh2-master-2 Jun 10 18:13:22.513449 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-1409c365-8646-4f28-b57a-d9ef345cc39c req-0a05c265-fd96-4f37-85c5-a818e51559c8 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140574 Jun 10 18:13:22.522369 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2176/4500] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:13:22.597072 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-427e6253-b8bc-42fc-8210-363a84323bce tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:22.599329 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-427e6253-b8bc-42fc-8210-363a84323bce tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:22.621119 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-427e6253-b8bc-42fc-8210-363a84323bce tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:22.621848 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-427e6253-b8bc-42fc-8210-363a84323bce tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:22.622866 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-427e6253-b8bc-42fc-8210-363a84323bce tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:22.624029 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-427e6253-b8bc-42fc-8210-363a84323bce tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:23.030323 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=16 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:13:23.317952 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-427e6253-b8bc-42fc-8210-363a84323bce tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:23.361840 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-427e6253-b8bc-42fc-8210-363a84323bce tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1519 microversion: 2.1 time: 0.769786 Jun 10 18:13:23.364221 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2177/4501] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:22 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1519 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:23.389903 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-a3bd8a78-d026-4de5-9af8-220ff54288d6 req-0a95c7ff-b51e-4c93-9073-e1e7017cfa10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "551856e9-a45b-412d-979d-b14039d74fea", "name": "network-vif-plugged", "status": "completed", "tag": "1859187f-370b-4ada-a7b6-04d61eec3731"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:13:23.419867 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4bcfc5d8-8142-4495-bb3c-cb1a1a42f6cd tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd404e4ab55af470fa464b94f9f0cd2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6575b0846dca493f9e99ee122930972d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:23.425569 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-a3bd8a78-d026-4de5-9af8-220ff54288d6 req-0a95c7ff-b51e-4c93-9073-e1e7017cfa10 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:23.429309 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-a3bd8a78-d026-4de5-9af8-220ff54288d6 req-0a95c7ff-b51e-4c93-9073-e1e7017cfa10 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:23.452636 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4bcfc5d8-8142-4495-bb3c-cb1a1a42f6cd tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b" status: 200 len: 1318 microversion: 2.1 time: 1.451759 Jun 10 18:13:23.453251 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2325/4502] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:21 2022] GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b => generated 1318 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:23.468394 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6be37a82-652b-40de-8577-4fc9d822e5ae tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:23.469049 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6be37a82-652b-40de-8577-4fc9d822e5ae tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 551856e9-a45b-412d-979d-b14039d74fea] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:23.474515 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-a3bd8a78-d026-4de5-9af8-220ff54288d6 req-0a95c7ff-b51e-4c93-9073-e1e7017cfa10 service nova] Creating event network-vif-plugged:1859187f-370b-4ada-a7b6-04d61eec3731 for instance 551856e9-a45b-412d-979d-b14039d74fea on chh2-master-2 Jun 10 18:13:23.481254 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6be37a82-652b-40de-8577-4fc9d822e5ae tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:23.483745 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6be37a82-652b-40de-8577-4fc9d822e5ae tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:23.484631 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6be37a82-652b-40de-8577-4fc9d822e5ae tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:23.485077 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6be37a82-652b-40de-8577-4fc9d822e5ae tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:23.491152 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-a3bd8a78-d026-4de5-9af8-220ff54288d6 req-0a95c7ff-b51e-4c93-9073-e1e7017cfa10 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113151 Jun 10 18:13:23.493890 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2178/4503] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:13:23.501611 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f5b62078-7227-46fc-82db-9532ac07ba12 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:23.503247 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f5b62078-7227-46fc-82db-9532ac07ba12 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:23.514079 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f5b62078-7227-46fc-82db-9532ac07ba12 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:23.514992 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f5b62078-7227-46fc-82db-9532ac07ba12 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:23.534130 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f5b62078-7227-46fc-82db-9532ac07ba12 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:23.537373 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f5b62078-7227-46fc-82db-9532ac07ba12 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:23.992147 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f5b62078-7227-46fc-82db-9532ac07ba12 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:24.021114 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f5b62078-7227-46fc-82db-9532ac07ba12 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca" status: 200 len: 1519 microversion: 2.1 time: 0.522126 Jun 10 18:13:24.026595 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2179/4504] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:23 2022] GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca => generated 1519 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:24.379470 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-248d42df-fc4c-41b2-80ef-0c3a49e64004 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:24.380027 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-248d42df-fc4c-41b2-80ef-0c3a49e64004 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:24.406172 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-248d42df-fc4c-41b2-80ef-0c3a49e64004 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:24.406901 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-248d42df-fc4c-41b2-80ef-0c3a49e64004 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:24.445099 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-248d42df-fc4c-41b2-80ef-0c3a49e64004 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:24.446556 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-248d42df-fc4c-41b2-80ef-0c3a49e64004 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:24.692260 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-248d42df-fc4c-41b2-80ef-0c3a49e64004 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:24.703959 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-248d42df-fc4c-41b2-80ef-0c3a49e64004 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1519 microversion: 2.1 time: 0.328166 Jun 10 18:13:24.705007 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2180/4505] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:24 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1519 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:13:24.710514 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b73454fe-4f26-4a07-bec9-f0f79a9fcafe tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:24.711361 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b73454fe-4f26-4a07-bec9-f0f79a9fcafe tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 89cea229-7bfb-43e4-a855-e9c6ae81d37b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:24.722986 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b73454fe-4f26-4a07-bec9-f0f79a9fcafe tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:24.722986 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b73454fe-4f26-4a07-bec9-f0f79a9fcafe tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:24.724262 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b73454fe-4f26-4a07-bec9-f0f79a9fcafe tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:24.725422 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b73454fe-4f26-4a07-bec9-f0f79a9fcafe tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:24.930916 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b73454fe-4f26-4a07-bec9-f0f79a9fcafe tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd404e4ab55af470fa464b94f9f0cd2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6575b0846dca493f9e99ee122930972d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:24.947955 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b73454fe-4f26-4a07-bec9-f0f79a9fcafe tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b" status: 200 len: 1318 microversion: 2.1 time: 0.239864 Jun 10 18:13:24.965936 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2181/4506] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:24 2022] GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:25.037557 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6be37a82-652b-40de-8577-4fc9d822e5ae tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:25.045740 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e33f4ef1-1c64-4e3c-b8da-d95a916a959c tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:25.046730 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e33f4ef1-1c64-4e3c-b8da-d95a916a959c tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:25.051519 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6be37a82-652b-40de-8577-4fc9d822e5ae tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea" status: 200 len: 1520 microversion: 2.1 time: 1.597122 Jun 10 18:13:25.060732 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e33f4ef1-1c64-4e3c-b8da-d95a916a959c tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:25.061514 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e33f4ef1-1c64-4e3c-b8da-d95a916a959c tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:25.063023 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e33f4ef1-1c64-4e3c-b8da-d95a916a959c tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:25.063767 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e33f4ef1-1c64-4e3c-b8da-d95a916a959c tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:25.068040 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2326/4507] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:23 2022] GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea => generated 1520 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:25.074180 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b94d93ba-533e-4a6d-8efa-0b89ec8f1ae9 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:25.086598 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b94d93ba-533e-4a6d-8efa-0b89ec8f1ae9 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 551856e9-a45b-412d-979d-b14039d74fea] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:25.086598 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b94d93ba-533e-4a6d-8efa-0b89ec8f1ae9 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:25.086598 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b94d93ba-533e-4a6d-8efa-0b89ec8f1ae9 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:25.086598 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b94d93ba-533e-4a6d-8efa-0b89ec8f1ae9 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:25.086598 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b94d93ba-533e-4a6d-8efa-0b89ec8f1ae9 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:25.119101 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b94d93ba-533e-4a6d-8efa-0b89ec8f1ae9 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 551856e9-a45b-412d-979d-b14039d74fea] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:13:25.226330 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e33f4ef1-1c64-4e3c-b8da-d95a916a959c tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:25.234083 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e33f4ef1-1c64-4e3c-b8da-d95a916a959c tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca" status: 200 len: 1519 microversion: 2.1 time: 0.194655 Jun 10 18:13:25.234673 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2182/4508] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:25 2022] GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca => generated 1519 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:25.722423 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9738333a-5347-4872-80d9-b45b180a2965 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:25.723402 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9738333a-5347-4872-80d9-b45b180a2965 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:25.730127 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b94d93ba-533e-4a6d-8efa-0b89ec8f1ae9 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "DELETE /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea" status: 204 len: 0 microversion: 2.1 time: 0.659028 Jun 10 18:13:25.733085 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2327/4509] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:13:25 2022] DELETE /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea => generated 0 bytes in 664 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:13:25.741019 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9738333a-5347-4872-80d9-b45b180a2965 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:25.741900 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9738333a-5347-4872-80d9-b45b180a2965 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:25.743795 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9738333a-5347-4872-80d9-b45b180a2965 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:25.745701 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9738333a-5347-4872-80d9-b45b180a2965 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:25.768047 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2ce2eda3-b570-4366-a021-e672c833896c tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:25.775202 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2ce2eda3-b570-4366-a021-e672c833896c tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 551856e9-a45b-412d-979d-b14039d74fea] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:25.794393 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2ce2eda3-b570-4366-a021-e672c833896c tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:25.801980 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2ce2eda3-b570-4366-a021-e672c833896c tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:25.804011 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2ce2eda3-b570-4366-a021-e672c833896c tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:25.804537 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2ce2eda3-b570-4366-a021-e672c833896c tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:26.119377 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9738333a-5347-4872-80d9-b45b180a2965 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:26.127641 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9738333a-5347-4872-80d9-b45b180a2965 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1519 microversion: 2.1 time: 0.409298 Jun 10 18:13:26.133911 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2183/4510] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:25 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1519 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:26.139023 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4a052999-597e-4dc2-8b4e-4c7581b4bbdf tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:26.149310 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4a052999-597e-4dc2-8b4e-4c7581b4bbdf tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 89cea229-7bfb-43e4-a855-e9c6ae81d37b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:26.155806 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a052999-597e-4dc2-8b4e-4c7581b4bbdf tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:26.156514 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a052999-597e-4dc2-8b4e-4c7581b4bbdf tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:26.160115 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a052999-597e-4dc2-8b4e-4c7581b4bbdf tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:26.160814 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a052999-597e-4dc2-8b4e-4c7581b4bbdf tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:26.218930 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2ce2eda3-b570-4366-a021-e672c833896c tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:26.229796 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2ce2eda3-b570-4366-a021-e672c833896c tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea" status: 200 len: 1526 microversion: 2.1 time: 0.490951 Jun 10 18:13:26.230392 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2328/4511] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:25 2022] GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea => generated 1526 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:26.253395 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c768ab5a-2d2d-4b41-98fe-fe5e81e9e8fe tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:26.253395 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c768ab5a-2d2d-4b41-98fe-fe5e81e9e8fe tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:26.267065 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c768ab5a-2d2d-4b41-98fe-fe5e81e9e8fe tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:26.267538 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c768ab5a-2d2d-4b41-98fe-fe5e81e9e8fe tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:26.268369 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c768ab5a-2d2d-4b41-98fe-fe5e81e9e8fe tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:26.269364 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c768ab5a-2d2d-4b41-98fe-fe5e81e9e8fe tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:26.458237 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4a052999-597e-4dc2-8b4e-4c7581b4bbdf tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd404e4ab55af470fa464b94f9f0cd2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6575b0846dca493f9e99ee122930972d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:26.468631 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4a052999-597e-4dc2-8b4e-4c7581b4bbdf tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b" status: 200 len: 1318 microversion: 2.1 time: 0.333235 Jun 10 18:13:26.472826 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2184/4512] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:26 2022] GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b => generated 1318 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:27.434366 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c768ab5a-2d2d-4b41-98fe-fe5e81e9e8fe tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:27.448930 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c768ab5a-2d2d-4b41-98fe-fe5e81e9e8fe tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca" status: 200 len: 1519 microversion: 2.1 time: 1.200142 Jun 10 18:13:27.464397 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2329/4513] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:26 2022] GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca => generated 1519 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:13:27.479214 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0aed037b-a441-4f5a-942c-89a887fd12a5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:27.485430 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0aed037b-a441-4f5a-942c-89a887fd12a5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:27.501188 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0aed037b-a441-4f5a-942c-89a887fd12a5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:27.501777 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0aed037b-a441-4f5a-942c-89a887fd12a5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:27.502700 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0aed037b-a441-4f5a-942c-89a887fd12a5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:27.504779 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0aed037b-a441-4f5a-942c-89a887fd12a5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:27.512830 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-d39aec95-d53a-44e1-8626-5833bf61e7a7 req-478a6a27-515a-40f3-8acc-49f78e438e9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89cea229-7bfb-43e4-a855-e9c6ae81d37b", "tag": "6aa82b06-065f-4482-b2de-d6771acbe4bb"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:13:27.528460 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-d39aec95-d53a-44e1-8626-5833bf61e7a7 req-478a6a27-515a-40f3-8acc-49f78e438e9c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:27.528923 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-d39aec95-d53a-44e1-8626-5833bf61e7a7 req-478a6a27-515a-40f3-8acc-49f78e438e9c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:27.553911 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-d39aec95-d53a-44e1-8626-5833bf61e7a7 req-478a6a27-515a-40f3-8acc-49f78e438e9c service nova] Creating event network-changed:6aa82b06-065f-4482-b2de-d6771acbe4bb for instance 89cea229-7bfb-43e4-a855-e9c6ae81d37b on chh2-master-2 Jun 10 18:13:27.573142 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-d39aec95-d53a-44e1-8626-5833bf61e7a7 req-478a6a27-515a-40f3-8acc-49f78e438e9c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.617361 Jun 10 18:13:27.579769 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2185/4514] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:13:27.587472 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a663ed8b-37be-404e-8672-bd4ccbde442c tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:27.588592 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a663ed8b-37be-404e-8672-bd4ccbde442c tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 551856e9-a45b-412d-979d-b14039d74fea] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:27.610283 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a663ed8b-37be-404e-8672-bd4ccbde442c tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:27.610753 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a663ed8b-37be-404e-8672-bd4ccbde442c tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:27.611553 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a663ed8b-37be-404e-8672-bd4ccbde442c tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:27.612006 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a663ed8b-37be-404e-8672-bd4ccbde442c tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:27.776602 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0aed037b-a441-4f5a-942c-89a887fd12a5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:27.789477 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0aed037b-a441-4f5a-942c-89a887fd12a5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1519 microversion: 2.1 time: 0.319482 Jun 10 18:13:27.791228 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2330/4515] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:27 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1519 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:27.796513 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-099ec4f0-eefc-412b-b485-6b4ef9aa1149 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:27.797499 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-099ec4f0-eefc-412b-b485-6b4ef9aa1149 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 89cea229-7bfb-43e4-a855-e9c6ae81d37b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:27.805603 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-099ec4f0-eefc-412b-b485-6b4ef9aa1149 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:27.806341 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-099ec4f0-eefc-412b-b485-6b4ef9aa1149 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:27.808500 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-099ec4f0-eefc-412b-b485-6b4ef9aa1149 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:27.809237 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-099ec4f0-eefc-412b-b485-6b4ef9aa1149 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:27.889958 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a663ed8b-37be-404e-8672-bd4ccbde442c tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:27.922005 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a663ed8b-37be-404e-8672-bd4ccbde442c tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea" status: 200 len: 1526 microversion: 2.1 time: 0.329185 Jun 10 18:13:27.922005 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2186/4516] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:27 2022] GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea => generated 1526 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:27.926140 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-15e26d38-31ff-444b-8ae9-a892b2d56a07 req-5718228f-1d20-4e74-b916-e583af5f5384 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "551856e9-a45b-412d-979d-b14039d74fea", "name": "network-vif-unplugged", "status": "completed", "tag": "1859187f-370b-4ada-a7b6-04d61eec3731"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:13:27.951918 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-15e26d38-31ff-444b-8ae9-a892b2d56a07 req-5718228f-1d20-4e74-b916-e583af5f5384 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:27.957227 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-15e26d38-31ff-444b-8ae9-a892b2d56a07 req-5718228f-1d20-4e74-b916-e583af5f5384 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:27.993600 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-15e26d38-31ff-444b-8ae9-a892b2d56a07 req-5718228f-1d20-4e74-b916-e583af5f5384 service nova] Creating event network-vif-unplugged:1859187f-370b-4ada-a7b6-04d61eec3731 for instance 551856e9-a45b-412d-979d-b14039d74fea on chh2-master-2 Jun 10 18:13:28.008191 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-15e26d38-31ff-444b-8ae9-a892b2d56a07 req-5718228f-1d20-4e74-b916-e583af5f5384 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094805 Jun 10 18:13:28.009728 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2187/4517] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:13:28.467801 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-62eb1899-692e-41c4-8080-38ce206442ed tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:28.468869 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-62eb1899-692e-41c4-8080-38ce206442ed tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:28.477574 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-62eb1899-692e-41c4-8080-38ce206442ed tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:28.485967 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-62eb1899-692e-41c4-8080-38ce206442ed tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:28.486600 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-099ec4f0-eefc-412b-b485-6b4ef9aa1149 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd404e4ab55af470fa464b94f9f0cd2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6575b0846dca493f9e99ee122930972d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:28.500268 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-099ec4f0-eefc-412b-b485-6b4ef9aa1149 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b" status: 200 len: 1318 microversion: 2.1 time: 0.705143 Jun 10 18:13:28.502568 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2331/4518] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:27 2022] GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b => generated 1318 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:28.509158 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-62eb1899-692e-41c4-8080-38ce206442ed tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:28.512944 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-62eb1899-692e-41c4-8080-38ce206442ed tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:28.577947 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:13:28.807146 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6fe23a6b-afa9-49a3-8865-3e2790b93200 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:28.807778 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6fe23a6b-afa9-49a3-8865-3e2790b93200 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:28.824911 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6fe23a6b-afa9-49a3-8865-3e2790b93200 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:28.825404 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6fe23a6b-afa9-49a3-8865-3e2790b93200 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:28.826174 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6fe23a6b-afa9-49a3-8865-3e2790b93200 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:28.830149 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6fe23a6b-afa9-49a3-8865-3e2790b93200 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:28.881206 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:13:29.272647 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-62eb1899-692e-41c4-8080-38ce206442ed tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:29.286126 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-62eb1899-692e-41c4-8080-38ce206442ed tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca" status: 200 len: 1499 microversion: 2.1 time: 0.822742 Jun 10 18:13:29.297750 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2188/4519] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:28 2022] GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca => generated 1499 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:29.311893 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6accb885-7233-4767-949b-32434e687076 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:29.313552 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6accb885-7233-4767-949b-32434e687076 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 551856e9-a45b-412d-979d-b14039d74fea] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:29.351364 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6accb885-7233-4767-949b-32434e687076 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:29.356290 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6accb885-7233-4767-949b-32434e687076 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:29.359424 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6accb885-7233-4767-949b-32434e687076 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:29.361299 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6accb885-7233-4767-949b-32434e687076 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:29.443799 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6fe23a6b-afa9-49a3-8865-3e2790b93200 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:29.451924 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6fe23a6b-afa9-49a3-8865-3e2790b93200 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1519 microversion: 2.1 time: 0.648641 Jun 10 18:13:29.452555 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2332/4520] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:28 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1519 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:13:29.467877 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6a91ec14-0050-47d8-8f74-7198b0a31f9d tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:29.468561 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6a91ec14-0050-47d8-8f74-7198b0a31f9d tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:29.502744 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6a91ec14-0050-47d8-8f74-7198b0a31f9d tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:29.503478 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6a91ec14-0050-47d8-8f74-7198b0a31f9d tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:29.504045 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6a91ec14-0050-47d8-8f74-7198b0a31f9d tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:29.504529 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6a91ec14-0050-47d8-8f74-7198b0a31f9d tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:29.974414 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6a91ec14-0050-47d8-8f74-7198b0a31f9d tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:29.983793 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6a91ec14-0050-47d8-8f74-7198b0a31f9d tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e" status: 200 len: 1513 microversion: 2.1 time: 0.530131 Jun 10 18:13:29.987832 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2333/4521] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:29 2022] GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e => generated 1513 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:30.007959 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c5a2afdb-0988-4153-a26d-a068415f99aa tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:30.028985 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c5a2afdb-0988-4153-a26d-a068415f99aa tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 89cea229-7bfb-43e4-a855-e9c6ae81d37b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:30.028985 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5a2afdb-0988-4153-a26d-a068415f99aa tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:30.028985 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5a2afdb-0988-4153-a26d-a068415f99aa tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:30.028985 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5a2afdb-0988-4153-a26d-a068415f99aa tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:30.028985 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5a2afdb-0988-4153-a26d-a068415f99aa tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:30.326837 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6accb885-7233-4767-949b-32434e687076 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:30.345252 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6accb885-7233-4767-949b-32434e687076 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea" status: 200 len: 1526 microversion: 2.1 time: 1.045654 Jun 10 18:13:30.353347 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2189/4522] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:29 2022] GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea => generated 1526 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:30.387967 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-882afe31-4696-479a-b2c3-79c903a99fdc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:13:30.406263 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-882afe31-4696-479a-b2c3-79c903a99fdc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 96750a58-f2fd-44cc-abdf-fb5d7086fdfe] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:30.440120 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-882afe31-4696-479a-b2c3-79c903a99fdc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] HTTP exception thrown: Instance 96750a58-f2fd-44cc-abdf-fb5d7086fdfe could not be found. Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-882afe31-4696-479a-b2c3-79c903a99fdc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Request method failure captured: Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers/96750a58-f2fd-44cc-abdf-fb5d7086fdfe/action HTTP/1.1 Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 14 Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4mJVVxHNAdkChvziQm-6Dxnwt9XHWD1Xe5b1Hij0GEvfTbtqXkBFxRnvK3XB7O0DqEYSiSFM3wVQFcGEtNf0ziHJxG92MJ3ikztDB6TtOzEB2x0AYpNNaCzzkfUNZyHohCw21rjVL9kE9UGR_qvtvfAasaLdvNaa6Nct_8khdQAOeU Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 2f3f65ee123043bb9c888cc5adffce37 Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-779166786 Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/2f3f65ee123043bb9c888cc5adffce37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2f3f65ee123043bb9c888cc5adffce37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2f3f65ee123043bb9c888cc5adffce37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_2f3f65ee123043bb9c888cc5adffce37", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServerRescueNegativeTestJSON-779166786 Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 2f3f65ee123043bb9c888cc5adffce37 Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-779166786 Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServerRescueNegativeTestJSON-779166786-project Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 6aa40a915e4e43cd8d493dc593a73028 Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServerRescueNegativeTestJSON-779166786-project Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: {"rescue": {}} Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 96750a58-f2fd-44cc-abdf-fb5d7086fdfe could not be found. Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '96750a58-f2fd-44cc-abdf-fb5d7086fdfe', 'body': {'rescue': {}}} Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96750a58-f2fd-44cc-abdf-fb5d7086fdfe could not be found. Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96750a58-f2fd-44cc-abdf-fb5d7086fdfe could not be found. Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:30.473361 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:13:30.479235 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:13:30.479235 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:13:30.479235 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:13:30.479235 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:13:30.479235 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96750a58-f2fd-44cc-abdf-fb5d7086fdfe could not be found. Jun 10 18:13:30.479235 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:30.481507 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-882afe31-4696-479a-b2c3-79c903a99fdc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Returning 404 to user: Instance 96750a58-f2fd-44cc-abdf-fb5d7086fdfe could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:13:30.483929 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-882afe31-4696-479a-b2c3-79c903a99fdc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "POST /compute/v2.1/servers/96750a58-f2fd-44cc-abdf-fb5d7086fdfe/action" status: 404 len: 111 microversion: 2.1 time: 0.128753 Jun 10 18:13:30.495240 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2190/4523] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:13:30 2022] POST /compute/v2.1/servers/96750a58-f2fd-44cc-abdf-fb5d7086fdfe/action => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:13:30.509862 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b0535148-aedc-466d-8fd5-af58bf248bdf tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:30.511219 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b0535148-aedc-466d-8fd5-af58bf248bdf tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:30.538466 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b0535148-aedc-466d-8fd5-af58bf248bdf tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:30.540636 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b0535148-aedc-466d-8fd5-af58bf248bdf tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:30.541746 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b0535148-aedc-466d-8fd5-af58bf248bdf tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:30.546980 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b0535148-aedc-466d-8fd5-af58bf248bdf tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:30.754000 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c5a2afdb-0988-4153-a26d-a068415f99aa tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd404e4ab55af470fa464b94f9f0cd2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6575b0846dca493f9e99ee122930972d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:30.769315 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c5a2afdb-0988-4153-a26d-a068415f99aa tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b" status: 200 len: 1318 microversion: 2.1 time: 0.771124 Jun 10 18:13:30.786610 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2334/4524] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:29 2022] GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b => generated 1318 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:30.798456 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a5dfd366-aef7-4535-8089-3d58096e01c0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:13:30.799001 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a5dfd366-aef7-4535-8089-3d58096e01c0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:30.833100 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a5dfd366-aef7-4535-8089-3d58096e01c0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:30.836599 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a5dfd366-aef7-4535-8089-3d58096e01c0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:30.842267 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a5dfd366-aef7-4535-8089-3d58096e01c0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:30.843784 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a5dfd366-aef7-4535-8089-3d58096e01c0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:31.704478 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b0535148-aedc-466d-8fd5-af58bf248bdf tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:31.713947 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b0535148-aedc-466d-8fd5-af58bf248bdf tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1519 microversion: 2.1 time: 1.217324 Jun 10 18:13:31.718686 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2191/4525] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:30 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1519 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:31.723775 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-912a8cb0-0e6e-40a9-bdf4-fc521619df17 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:31.733213 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-912a8cb0-0e6e-40a9-bdf4-fc521619df17 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 551856e9-a45b-412d-979d-b14039d74fea] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:31.745210 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-912a8cb0-0e6e-40a9-bdf4-fc521619df17 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:31.748921 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-912a8cb0-0e6e-40a9-bdf4-fc521619df17 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:31.749975 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-912a8cb0-0e6e-40a9-bdf4-fc521619df17 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:31.750866 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-912a8cb0-0e6e-40a9-bdf4-fc521619df17 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:31.997072 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a5dfd366-aef7-4535-8089-3d58096e01c0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "POST /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e/action" status: 202 len: 0 microversion: 2.1 time: 1.208581 Jun 10 18:13:32.000756 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2335/4526] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:13:30 2022] POST /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e/action => generated 0 bytes in 1213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:13:32.040708 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bf30656f-03c6-417a-8d42-768bd24b5255 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:32.041476 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bf30656f-03c6-417a-8d42-768bd24b5255 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 89cea229-7bfb-43e4-a855-e9c6ae81d37b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:32.067863 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bf30656f-03c6-417a-8d42-768bd24b5255 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:32.068165 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bf30656f-03c6-417a-8d42-768bd24b5255 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:32.080677 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bf30656f-03c6-417a-8d42-768bd24b5255 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:32.081404 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bf30656f-03c6-417a-8d42-768bd24b5255 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:32.639685 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bf30656f-03c6-417a-8d42-768bd24b5255 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd404e4ab55af470fa464b94f9f0cd2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6575b0846dca493f9e99ee122930972d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:32.653485 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bf30656f-03c6-417a-8d42-768bd24b5255 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b" status: 200 len: 1318 microversion: 2.1 time: 0.646202 Jun 10 18:13:32.660490 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2336/4527] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:32 2022] GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b => generated 1318 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:32.666768 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b531b926-083d-4dba-9eb2-7475f98be4ec tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:32.667714 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b531b926-083d-4dba-9eb2-7475f98be4ec tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:32.678067 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-912a8cb0-0e6e-40a9-bdf4-fc521619df17 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:32.689237 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b531b926-083d-4dba-9eb2-7475f98be4ec tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:32.690879 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-912a8cb0-0e6e-40a9-bdf4-fc521619df17 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea" status: 200 len: 1526 microversion: 2.1 time: 0.970343 Jun 10 18:13:32.691969 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2192/4528] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:31 2022] GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea => generated 1526 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:32.710057 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b531b926-083d-4dba-9eb2-7475f98be4ec tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:32.714101 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b531b926-083d-4dba-9eb2-7475f98be4ec tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:32.714278 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-186faf82-ddfd-4dbc-a9c6-6e9533db592f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Action: 'create', calling method: .version_select at 0x7f77c610c280>, body: {"keypair": {"name": "tempest-keypair-130455017", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyiRmaomAYLNqpo0FT2ahfTnKQgXpt7BUicAxKuk5BqdrrHCfYIK/fUhdonF3/LgtWR1k49tknK6Igi7uUbJN8Ta2Dhy4nXN2cVkADsc3t1ndOCwjaP/w7XFle78j9giQ=="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:13:32.715454 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b531b926-083d-4dba-9eb2-7475f98be4ec tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:32.787770 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-186faf82-ddfd-4dbc-a9c6-6e9533db592f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Getting quotas for project bedaf8a0acb148ec9a671abf0a548fdb. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:13:32.803593 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-186faf82-ddfd-4dbc-a9c6-6e9533db592f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Getting quotas for user 0c101ac379c94319baca4c2c9781030f and project bedaf8a0acb148ec9a671abf0a548fdb. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:13:32.984854 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-186faf82-ddfd-4dbc-a9c6-6e9533db592f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.291543 Jun 10 18:13:32.985813 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2193/4529] 10.222.0.35 () {62 vars in 1199 bytes} [Fri Jun 10 18:13:32 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 293 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 10 18:13:32.991488 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f63e2c96-0151-4cc7-81b0-3bb78d6a10d5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:32.994418 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f63e2c96-0151-4cc7-81b0-3bb78d6a10d5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:33.013220 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f63e2c96-0151-4cc7-81b0-3bb78d6a10d5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:33.013220 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f63e2c96-0151-4cc7-81b0-3bb78d6a10d5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:33.013220 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f63e2c96-0151-4cc7-81b0-3bb78d6a10d5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:33.013220 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f63e2c96-0151-4cc7-81b0-3bb78d6a10d5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:33.156684 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b531b926-083d-4dba-9eb2-7475f98be4ec tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:33.172989 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b531b926-083d-4dba-9eb2-7475f98be4ec tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e" status: 200 len: 1498 microversion: 2.1 time: 0.508517 Jun 10 18:13:33.189945 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2337/4530] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:32 2022] GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e => generated 1498 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:33.205087 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-e76b47eb-98c6-4995-be19-423661dd00b6 req-6d4899d3-7592-4d93-bd57-cd9821c43cb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "551856e9-a45b-412d-979d-b14039d74fea", "name": "network-vif-deleted", "tag": "1859187f-370b-4ada-a7b6-04d61eec3731"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:13:33.234582 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-e76b47eb-98c6-4995-be19-423661dd00b6 req-6d4899d3-7592-4d93-bd57-cd9821c43cb6 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:33.235038 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-e76b47eb-98c6-4995-be19-423661dd00b6 req-6d4899d3-7592-4d93-bd57-cd9821c43cb6 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:33.274044 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-e76b47eb-98c6-4995-be19-423661dd00b6 req-6d4899d3-7592-4d93-bd57-cd9821c43cb6 service nova] Creating event network-vif-deleted:1859187f-370b-4ada-a7b6-04d61eec3731 for instance 551856e9-a45b-412d-979d-b14039d74fea on chh2-master-2 Jun 10 18:13:33.286330 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-e76b47eb-98c6-4995-be19-423661dd00b6 req-6d4899d3-7592-4d93-bd57-cd9821c43cb6 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091538 Jun 10 18:13:33.287114 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2338/4531] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:13:33.297278 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a54a2ee3-f740-44b9-8c9a-1042280907e4 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:13:33.303636 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a54a2ee3-f740-44b9-8c9a-1042280907e4 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:33.311019 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a54a2ee3-f740-44b9-8c9a-1042280907e4 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:33.311837 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a54a2ee3-f740-44b9-8c9a-1042280907e4 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:33.313020 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a54a2ee3-f740-44b9-8c9a-1042280907e4 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:33.313790 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a54a2ee3-f740-44b9-8c9a-1042280907e4 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:33.351445 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-a54a2ee3-f740-44b9-8c9a-1042280907e4 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lazy-loading 'flavor' on Instance uuid b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:13:33.391172 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-a54a2ee3-f740-44b9-8c9a-1042280907e4 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] HTTP exception thrown: Cannot 'rescue' instance b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e while it is in vm_state paused Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a54a2ee3-f740-44b9-8c9a-1042280907e4 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Request method failure captured: Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e/action HTTP/1.1 Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 14 Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4mJVVxHNAdkChvziQm-6Dxnwt9XHWD1Xe5b1Hij0GEvfTbtqXkBFxRnvK3XB7O0DqEYSiSFM3wVQFcGEtNf0ziHJxG92MJ3ikztDB6TtOzEB2x0AYpNNaCzzkfUNZyHohCw21rjVL9kE9UGR_qvtvfAasaLdvNaa6Nct_8khdQAOeU Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 2f3f65ee123043bb9c888cc5adffce37 Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-779166786 Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/2f3f65ee123043bb9c888cc5adffce37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2f3f65ee123043bb9c888cc5adffce37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2f3f65ee123043bb9c888cc5adffce37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_2f3f65ee123043bb9c888cc5adffce37", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServerRescueNegativeTestJSON-779166786 Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 2f3f65ee123043bb9c888cc5adffce37 Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-779166786 Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServerRescueNegativeTestJSON-779166786-project Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 6aa40a915e4e43cd8d493dc593a73028 Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServerRescueNegativeTestJSON-779166786-project Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: {"rescue": {}} Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: exception: Cannot 'rescue' instance b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e while it is in vm_state paused Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e', 'body': {'rescue': {}}} Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e in vm_state paused. Cannot rescue while the instance is in this state. Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e while it is in vm_state paused Jun 10 18:13:33.396976 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:13:33.402059 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:13:33.402059 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:13:33.402059 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:13:33.402059 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:13:33.402059 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:13:33.402059 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:13:33.402059 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:13:33.402059 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e while it is in vm_state paused Jun 10 18:13:33.402059 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:13:33.404515 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a54a2ee3-f740-44b9-8c9a-1042280907e4 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Returning 409 to user: Cannot 'rescue' instance b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e while it is in vm_state paused {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:13:33.407168 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a54a2ee3-f740-44b9-8c9a-1042280907e4 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "POST /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e/action" status: 409 len: 144 microversion: 2.1 time: 0.118928 Jun 10 18:13:33.413083 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2339/4532] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:13:33 2022] POST /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e/action => generated 144 bytes in 125 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:13:33.426337 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b48afe76-8a31-4b94-b177-f57bce9739ee tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:13:33.429761 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b48afe76-8a31-4b94-b177-f57bce9739ee tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:33.440125 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:13:33.452499 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b48afe76-8a31-4b94-b177-f57bce9739ee tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:33.452993 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b48afe76-8a31-4b94-b177-f57bce9739ee tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:33.453949 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b48afe76-8a31-4b94-b177-f57bce9739ee tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:33.454257 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b48afe76-8a31-4b94-b177-f57bce9739ee tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:33.810088 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b48afe76-8a31-4b94-b177-f57bce9739ee tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "POST /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e/action" status: 202 len: 0 microversion: 2.1 time: 0.392138 Jun 10 18:13:33.814216 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2340/4533] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:13:33 2022] POST /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e/action => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:13:33.819559 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-10fd10a4-3a3c-40a1-b714-fd3d3e4b3ce3 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:33.822983 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-10fd10a4-3a3c-40a1-b714-fd3d3e4b3ce3 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 89cea229-7bfb-43e4-a855-e9c6ae81d37b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:33.835868 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-10fd10a4-3a3c-40a1-b714-fd3d3e4b3ce3 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:33.839003 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-10fd10a4-3a3c-40a1-b714-fd3d3e4b3ce3 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:33.839995 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-10fd10a4-3a3c-40a1-b714-fd3d3e4b3ce3 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:33.840486 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-10fd10a4-3a3c-40a1-b714-fd3d3e4b3ce3 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:34.084594 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-10fd10a4-3a3c-40a1-b714-fd3d3e4b3ce3 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd404e4ab55af470fa464b94f9f0cd2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6575b0846dca493f9e99ee122930972d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:34.100112 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-10fd10a4-3a3c-40a1-b714-fd3d3e4b3ce3 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b" status: 200 len: 1318 microversion: 2.1 time: 0.287938 Jun 10 18:13:34.103070 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2341/4534] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:33 2022] GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:34.111710 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d795e38c-4f28-4ddf-bad2-6c22ba32a17d tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:34.114878 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d795e38c-4f28-4ddf-bad2-6c22ba32a17d tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 551856e9-a45b-412d-979d-b14039d74fea] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:34.130899 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d795e38c-4f28-4ddf-bad2-6c22ba32a17d tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:34.133058 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d795e38c-4f28-4ddf-bad2-6c22ba32a17d tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:34.135029 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d795e38c-4f28-4ddf-bad2-6c22ba32a17d tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:34.155221 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d795e38c-4f28-4ddf-bad2-6c22ba32a17d tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:34.266586 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f63e2c96-0151-4cc7-81b0-3bb78d6a10d5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:34.278836 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f63e2c96-0151-4cc7-81b0-3bb78d6a10d5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1519 microversion: 2.1 time: 1.291745 Jun 10 18:13:34.279452 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2194/4535] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:32 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1519 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:34.296875 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a9a50f11-96c3-45b9-919b-e375400eeb63 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:34.308394 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a9a50f11-96c3-45b9-919b-e375400eeb63 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:34.324498 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a9a50f11-96c3-45b9-919b-e375400eeb63 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:34.331441 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a9a50f11-96c3-45b9-919b-e375400eeb63 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:34.332947 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a9a50f11-96c3-45b9-919b-e375400eeb63 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:34.333597 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a9a50f11-96c3-45b9-919b-e375400eeb63 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:34.334098 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d795e38c-4f28-4ddf-bad2-6c22ba32a17d tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:34.363160 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d795e38c-4f28-4ddf-bad2-6c22ba32a17d tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea" status: 200 len: 1484 microversion: 2.1 time: 0.239785 Jun 10 18:13:34.363160 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2342/4536] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:34 2022] GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea => generated 1484 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:34.387028 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-9e75d055-04fc-4533-a316-3f235eee3ce5 req-abead72a-04ee-44b8-8c8d-047a7684e3d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72eaef23-30d6-4755-a9b7-9547856075b3", "name": "network-vif-plugged", "status": "completed", "tag": "777ebce0-6591-4ee2-b139-f87b2964f3fb"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:13:34.415339 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-9e75d055-04fc-4533-a316-3f235eee3ce5 req-abead72a-04ee-44b8-8c8d-047a7684e3d0 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:34.419259 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-9e75d055-04fc-4533-a316-3f235eee3ce5 req-abead72a-04ee-44b8-8c8d-047a7684e3d0 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:34.476278 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-9e75d055-04fc-4533-a316-3f235eee3ce5 req-abead72a-04ee-44b8-8c8d-047a7684e3d0 service nova] Creating event network-vif-plugged:777ebce0-6591-4ee2-b139-f87b2964f3fb for instance 72eaef23-30d6-4755-a9b7-9547856075b3 on chh2-master-2 Jun 10 18:13:34.483400 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-9e75d055-04fc-4533-a316-3f235eee3ce5 req-abead72a-04ee-44b8-8c8d-047a7684e3d0 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108496 Jun 10 18:13:34.485562 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2343/4537] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:13:35.126199 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a9a50f11-96c3-45b9-919b-e375400eeb63 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:35.131434 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e2ea5ed4-c210-43b5-aa28-6efde73f71fa tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:35.132157 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e2ea5ed4-c210-43b5-aa28-6efde73f71fa tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 89cea229-7bfb-43e4-a855-e9c6ae81d37b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:35.152274 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e2ea5ed4-c210-43b5-aa28-6efde73f71fa tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:35.153051 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e2ea5ed4-c210-43b5-aa28-6efde73f71fa tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:35.154023 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e2ea5ed4-c210-43b5-aa28-6efde73f71fa tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:35.156199 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a9a50f11-96c3-45b9-919b-e375400eeb63 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e" status: 200 len: 1513 microversion: 2.1 time: 0.869951 Jun 10 18:13:35.156568 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e2ea5ed4-c210-43b5-aa28-6efde73f71fa tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:35.166346 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2195/4538] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:34 2022] GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e => generated 1513 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:35.296103 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bd53d68b-224c-4fd9-b0e3-335be25b47e9 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:35.296840 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bd53d68b-224c-4fd9-b0e3-335be25b47e9 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:35.302047 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:13:35.314909 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bd53d68b-224c-4fd9-b0e3-335be25b47e9 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:35.315421 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bd53d68b-224c-4fd9-b0e3-335be25b47e9 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:35.316281 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bd53d68b-224c-4fd9-b0e3-335be25b47e9 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:35.316764 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bd53d68b-224c-4fd9-b0e3-335be25b47e9 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:35.515968 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bd53d68b-224c-4fd9-b0e3-335be25b47e9 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:35.526825 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bd53d68b-224c-4fd9-b0e3-335be25b47e9 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1519 microversion: 2.1 time: 0.235229 Jun 10 18:13:35.539117 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2196/4539] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:35 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1519 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:13:35.545775 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a84d170b-c6b0-44b4-b532-edc0c9539222 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:35.546949 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a84d170b-c6b0-44b4-b532-edc0c9539222 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 551856e9-a45b-412d-979d-b14039d74fea] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:35.554850 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a84d170b-c6b0-44b4-b532-edc0c9539222 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:35.555553 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a84d170b-c6b0-44b4-b532-edc0c9539222 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:35.558124 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a84d170b-c6b0-44b4-b532-edc0c9539222 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:35.560532 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a84d170b-c6b0-44b4-b532-edc0c9539222 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:35.635449 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a84d170b-c6b0-44b4-b532-edc0c9539222 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:35.635916 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a84d170b-c6b0-44b4-b532-edc0c9539222 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:35.636511 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-a84d170b-c6b0-44b4-b532-edc0c9539222 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lazy-loading 'fault' on Instance uuid 551856e9-a45b-412d-979d-b14039d74fea {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:13:35.704296 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a84d170b-c6b0-44b4-b532-edc0c9539222 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:35.716337 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a84d170b-c6b0-44b4-b532-edc0c9539222 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea" status: 200 len: 1314 microversion: 2.1 time: 0.175449 Jun 10 18:13:35.717579 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2197/4540] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:35 2022] GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:35.756507 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e2ea5ed4-c210-43b5-aa28-6efde73f71fa tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd404e4ab55af470fa464b94f9f0cd2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6575b0846dca493f9e99ee122930972d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:35.773104 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e2ea5ed4-c210-43b5-aa28-6efde73f71fa tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b" status: 200 len: 1318 microversion: 2.1 time: 0.657479 Jun 10 18:13:35.775882 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2344/4541] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:35 2022] GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b => generated 1318 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:13:36.546693 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-05a52e1b-943a-4c77-814c-a7a8770ac606 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:36.547242 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-05a52e1b-943a-4c77-814c-a7a8770ac606 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:36.568054 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05a52e1b-943a-4c77-814c-a7a8770ac606 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:36.570137 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05a52e1b-943a-4c77-814c-a7a8770ac606 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:36.577639 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05a52e1b-943a-4c77-814c-a7a8770ac606 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:36.577639 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05a52e1b-943a-4c77-814c-a7a8770ac606 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:36.734307 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-466612d2-eaf5-43bd-bf60-54b84522ee49 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:36.738062 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-466612d2-eaf5-43bd-bf60-54b84522ee49 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 551856e9-a45b-412d-979d-b14039d74fea] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:36.754856 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-466612d2-eaf5-43bd-bf60-54b84522ee49 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:36.755667 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-466612d2-eaf5-43bd-bf60-54b84522ee49 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:36.759385 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-466612d2-eaf5-43bd-bf60-54b84522ee49 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:36.760636 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-466612d2-eaf5-43bd-bf60-54b84522ee49 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:36.890560 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-466612d2-eaf5-43bd-bf60-54b84522ee49 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:36.891048 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-466612d2-eaf5-43bd-bf60-54b84522ee49 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:36.891518 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-466612d2-eaf5-43bd-bf60-54b84522ee49 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lazy-loading 'fault' on Instance uuid 551856e9-a45b-412d-979d-b14039d74fea {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:13:37.020533 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-05a52e1b-943a-4c77-814c-a7a8770ac606 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:37.029274 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-05a52e1b-943a-4c77-814c-a7a8770ac606 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1519 microversion: 2.1 time: 0.486971 Jun 10 18:13:37.029875 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2198/4542] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:36 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1519 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:37.039622 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4d388c47-5a3f-4a0d-91fe-1f8485c0444f tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:37.051935 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4d388c47-5a3f-4a0d-91fe-1f8485c0444f tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 89cea229-7bfb-43e4-a855-e9c6ae81d37b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:37.070753 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d388c47-5a3f-4a0d-91fe-1f8485c0444f tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:37.071221 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d388c47-5a3f-4a0d-91fe-1f8485c0444f tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:37.072022 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d388c47-5a3f-4a0d-91fe-1f8485c0444f tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:37.072514 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d388c47-5a3f-4a0d-91fe-1f8485c0444f tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:37.371491 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4d388c47-5a3f-4a0d-91fe-1f8485c0444f tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd404e4ab55af470fa464b94f9f0cd2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6575b0846dca493f9e99ee122930972d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:37.387834 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4d388c47-5a3f-4a0d-91fe-1f8485c0444f tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b" status: 200 len: 1318 microversion: 2.1 time: 0.351784 Jun 10 18:13:37.388464 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2199/4543] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:37 2022] GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b => generated 1318 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:37.403062 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-466612d2-eaf5-43bd-bf60-54b84522ee49 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:37.410845 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-466612d2-eaf5-43bd-bf60-54b84522ee49 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea" status: 200 len: 1314 microversion: 2.1 time: 0.680630 Jun 10 18:13:37.425952 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2345/4544] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:36 2022] GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea => generated 1314 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:13:38.046801 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-044514f8-406b-4c7d-9e72-65598be6a558 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:38.050724 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-044514f8-406b-4c7d-9e72-65598be6a558 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:38.064773 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-044514f8-406b-4c7d-9e72-65598be6a558 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:38.065504 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-044514f8-406b-4c7d-9e72-65598be6a558 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:38.066910 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-044514f8-406b-4c7d-9e72-65598be6a558 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:38.067654 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-044514f8-406b-4c7d-9e72-65598be6a558 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:38.338022 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-58412f91-6b7a-41e8-b6fb-4f1bbd625259 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:13:38.339038 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-58412f91-6b7a-41e8-b6fb-4f1bbd625259 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:38.356800 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-58412f91-6b7a-41e8-b6fb-4f1bbd625259 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:38.357269 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-58412f91-6b7a-41e8-b6fb-4f1bbd625259 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:38.360044 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-58412f91-6b7a-41e8-b6fb-4f1bbd625259 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:38.360567 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-58412f91-6b7a-41e8-b6fb-4f1bbd625259 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:38.405155 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-58412f91-6b7a-41e8-b6fb-4f1bbd625259 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lazy-loading 'flavor' on Instance uuid b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:13:38.507724 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-044514f8-406b-4c7d-9e72-65598be6a558 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:38.522175 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-044514f8-406b-4c7d-9e72-65598be6a558 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1519 microversion: 2.1 time: 0.479642 Jun 10 18:13:38.535667 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2200/4545] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:38 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1519 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:38.547588 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8f0a6f8b-c565-41df-8db7-416e2e5f79ec tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:38.548873 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8f0a6f8b-c565-41df-8db7-416e2e5f79ec tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 89cea229-7bfb-43e4-a855-e9c6ae81d37b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:38.557122 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8f0a6f8b-c565-41df-8db7-416e2e5f79ec tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:38.558140 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8f0a6f8b-c565-41df-8db7-416e2e5f79ec tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:38.559588 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8f0a6f8b-c565-41df-8db7-416e2e5f79ec tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:38.560213 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8f0a6f8b-c565-41df-8db7-416e2e5f79ec tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:38.591712 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:13:38.809294 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-58412f91-6b7a-41e8-b6fb-4f1bbd625259 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "POST /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e/action" status: 200 len: 32 microversion: 2.1 time: 0.479454 Jun 10 18:13:38.810530 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2346/4546] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:13:38 2022] POST /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e/action => generated 32 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 10 18:13:38.851381 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-455a7c87-c10d-49da-85e0-261ca38e805b tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:38.853370 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-455a7c87-c10d-49da-85e0-261ca38e805b tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 551856e9-a45b-412d-979d-b14039d74fea] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:38.899272 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8f0a6f8b-c565-41df-8db7-416e2e5f79ec tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd404e4ab55af470fa464b94f9f0cd2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6575b0846dca493f9e99ee122930972d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:38.900038 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-455a7c87-c10d-49da-85e0-261ca38e805b tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:38.900642 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-455a7c87-c10d-49da-85e0-261ca38e805b tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:38.904134 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-455a7c87-c10d-49da-85e0-261ca38e805b tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:38.904134 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-455a7c87-c10d-49da-85e0-261ca38e805b tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:38.913717 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8f0a6f8b-c565-41df-8db7-416e2e5f79ec tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b" status: 200 len: 1318 microversion: 2.1 time: 0.374740 Jun 10 18:13:38.926147 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2201/4547] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:38 2022] GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b => generated 1318 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:38.938308 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ea9182d9-518c-48b5-84cc-a15dee68b27f tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:38.941436 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ea9182d9-518c-48b5-84cc-a15dee68b27f tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:38.960232 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ea9182d9-518c-48b5-84cc-a15dee68b27f tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:38.965295 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ea9182d9-518c-48b5-84cc-a15dee68b27f tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:38.966392 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ea9182d9-518c-48b5-84cc-a15dee68b27f tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:38.969570 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ea9182d9-518c-48b5-84cc-a15dee68b27f tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:38.990333 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-455a7c87-c10d-49da-85e0-261ca38e805b tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] HTTP exception thrown: Instance 551856e9-a45b-412d-979d-b14039d74fea could not be found. Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-455a7c87-c10d-49da-85e0-261ca38e805b tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Request method failure captured: Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea HTTP/1.1 Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4lsfzX-ZssLhBeRERA250Allr9sy5j_9WvmWWrmV8OKGfGLWtKo7IkZmvrlgadYYrKiCJiGv3V0W6WUpTPzvczOtcJBE7CxOiD9g_bSlYjPmyz5JBO2nqOTXPUSYGg7_D3Rbko1iq-cS8Cxtg3C-XqYzZtQdMv47S3ncw5oU530j6g Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: dc6ea0e4d347491eb23c3af053313211 Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-582167706 Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/dc6ea0e4d347491eb23c3af053313211"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/dc6ea0e4d347491eb23c3af053313211"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/dc6ea0e4d347491eb23c3af053313211"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_dc6ea0e4d347491eb23c3af053313211", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-582167706 Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: dc6ea0e4d347491eb23c3af053313211 Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-582167706 Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ImagesOneServerNegativeTestJSON-582167706-project Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 8e6b5cd42b2144a69590680e5ef156fa Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-582167706-project Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 551856e9-a45b-412d-979d-b14039d74fea could not be found. Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '551856e9-a45b-412d-979d-b14039d74fea'} Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 551856e9-a45b-412d-979d-b14039d74fea could not be found. Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 551856e9-a45b-412d-979d-b14039d74fea could not be found. Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:13:38.992943 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:13:38.999307 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:13:38.999307 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:13:38.999307 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:13:38.999307 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:13:38.999307 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:13:38.999307 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:13:38.999307 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 551856e9-a45b-412d-979d-b14039d74fea could not be found. Jun 10 18:13:38.999307 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:13:38.999307 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-455a7c87-c10d-49da-85e0-261ca38e805b tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Returning 404 to user: Instance 551856e9-a45b-412d-979d-b14039d74fea could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:13:38.999307 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-455a7c87-c10d-49da-85e0-261ca38e805b tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea" status: 404 len: 111 microversion: 2.1 time: 0.183759 Jun 10 18:13:39.000127 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2347/4548] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:38 2022] GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea => generated 111 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:13:39.021741 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1062c7b3-09cc-4a28-a034-50845b09709b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1838839025", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "3b7dba70-fc16-4230-ab0d-49ec174ffcb6"}, {"port": "dc174283-6e08-4d60-9f00-a5de6cfc1f16", "tag": "port-1"}, {"port": "bfc7ec9b-4f8d-4dcb-8a97-a81d140faa36", "tag": "port-2"}, {"uuid": "ecea5242-dfc6-4699-aecb-5edb7aaa5cdd", "tag": "net-1"}, {"uuid": "ecea5242-dfc6-4699-aecb-5edb7aaa5cdd"}, {"uuid": "91fa9307-f297-4a15-babe-7db8e50ce626", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "91fa9307-f297-4a15-babe-7db8e50ce626", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "0a22130f-d1af-4319-ab33-dd947e0a1d74", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "3572b223-5a84-4b50-9610-04ff779d1abf", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "6a4710af-e2d4-4f16-b612-bffe4c8d9f97", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--712711869"}], "key_name": "tempest-keypair-130455017", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:13:39.289656 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-1062c7b3-09cc-4a28-a034-50845b09709b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] validate_networks() for [('3b7dba70-fc16-4230-ab0d-49ec174ffcb6', None, None, None, None, None), (None, None, 'dc174283-6e08-4d60-9f00-a5de6cfc1f16', None, None, None), (None, None, 'bfc7ec9b-4f8d-4dcb-8a97-a81d140faa36', None, None, None), ('ecea5242-dfc6-4699-aecb-5edb7aaa5cdd', None, None, None, None, None), ('ecea5242-dfc6-4699-aecb-5edb7aaa5cdd', None, None, None, None, None), ('91fa9307-f297-4a15-babe-7db8e50ce626', '10.2.2.100', None, None, None, None), ('91fa9307-f297-4a15-babe-7db8e50ce626', '10.2.2.200', None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:13:39.515323 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ea9182d9-518c-48b5-84cc-a15dee68b27f tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:39.527371 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ea9182d9-518c-48b5-84cc-a15dee68b27f tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e" status: 200 len: 1519 microversion: 2.1 time: 0.599560 Jun 10 18:13:39.528983 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2202/4549] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:38 2022] GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e => generated 1519 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:39.537425 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-25427024-0032-484b-9c44-a02eb6bf8315 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-840498685", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:13:39.608067 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-25427024-0032-484b-9c44-a02eb6bf8315 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] validate_networks() for [('c26f6a24-00dc-4e29-8478-7c9e6523a0cf', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:13:40.966788 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-25427024-0032-484b-9c44-a02eb6bf8315 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:13:40.966788 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-25427024-0032-484b-9c44-a02eb6bf8315 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:13:40.966788 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-25427024-0032-484b-9c44-a02eb6bf8315 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:13:40.966788 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-25427024-0032-484b-9c44-a02eb6bf8315 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:13:40.966788 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-25427024-0032-484b-9c44-a02eb6bf8315 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:13:40.966788 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-25427024-0032-484b-9c44-a02eb6bf8315 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:40.966788 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-25427024-0032-484b-9c44-a02eb6bf8315 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:40.966788 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-25427024-0032-484b-9c44-a02eb6bf8315 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:40.966788 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-25427024-0032-484b-9c44-a02eb6bf8315 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:40.966788 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-25427024-0032-484b-9c44-a02eb6bf8315 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Getting quotas for project dc6ea0e4d347491eb23c3af053313211. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:13:40.972119 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-25427024-0032-484b-9c44-a02eb6bf8315 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Getting quotas for user 8e6b5cd42b2144a69590680e5ef156fa and project dc6ea0e4d347491eb23c3af053313211. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:13:41.013678 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-25427024-0032-484b-9c44-a02eb6bf8315 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:13:41.019625 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-25427024-0032-484b-9c44-a02eb6bf8315 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 2b41be5a-d334-477b-a99d-a15eb9ecb5b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:13:41.234192 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-25427024-0032-484b-9c44-a02eb6bf8315 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.702618 Jun 10 18:13:41.236093 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2203/4550] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:13:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 1706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:13:41.255366 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-3cf72ada-db17-4d4d-8b59-a1b2a1dc909d req-9ab46547-d654-4766-bff1-ea11ae0975f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89cea229-7bfb-43e4-a855-e9c6ae81d37b", "name": "network-vif-plugged", "status": "completed", "tag": "6aa82b06-065f-4482-b2de-d6771acbe4bb"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:13:41.296472 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-3cf72ada-db17-4d4d-8b59-a1b2a1dc909d req-9ab46547-d654-4766-bff1-ea11ae0975f7 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:41.297340 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-3cf72ada-db17-4d4d-8b59-a1b2a1dc909d req-9ab46547-d654-4766-bff1-ea11ae0975f7 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:41.319698 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-3cf72ada-db17-4d4d-8b59-a1b2a1dc909d req-9ab46547-d654-4766-bff1-ea11ae0975f7 service nova] Creating event network-vif-plugged:6aa82b06-065f-4482-b2de-d6771acbe4bb for instance 89cea229-7bfb-43e4-a855-e9c6ae81d37b on chh2-master-2 Jun 10 18:13:41.336332 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-3cf72ada-db17-4d4d-8b59-a1b2a1dc909d req-9ab46547-d654-4766-bff1-ea11ae0975f7 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098166 Jun 10 18:13:41.337276 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2204/4551] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:13:41.351244 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0a0822e9-0da3-4ef1-b8ac-ad56fcaef5ae tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:41.352707 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0a0822e9-0da3-4ef1-b8ac-ad56fcaef5ae tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:41.362540 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0a0822e9-0da3-4ef1-b8ac-ad56fcaef5ae tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:41.364388 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0a0822e9-0da3-4ef1-b8ac-ad56fcaef5ae tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:41.366173 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0a0822e9-0da3-4ef1-b8ac-ad56fcaef5ae tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:41.367097 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0a0822e9-0da3-4ef1-b8ac-ad56fcaef5ae tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:41.709344 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0a0822e9-0da3-4ef1-b8ac-ad56fcaef5ae tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:41.720460 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0a0822e9-0da3-4ef1-b8ac-ad56fcaef5ae tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1519 microversion: 2.1 time: 0.380485 Jun 10 18:13:41.724247 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2205/4552] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:41 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1519 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:41.731221 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e669e5a5-f3dd-4666-ac25-0adb0cbde076 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:41.732521 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e669e5a5-f3dd-4666-ac25-0adb0cbde076 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 89cea229-7bfb-43e4-a855-e9c6ae81d37b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:41.742465 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e669e5a5-f3dd-4666-ac25-0adb0cbde076 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:41.743317 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e669e5a5-f3dd-4666-ac25-0adb0cbde076 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:41.746529 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e669e5a5-f3dd-4666-ac25-0adb0cbde076 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:41.747082 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e669e5a5-f3dd-4666-ac25-0adb0cbde076 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:41.992888 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e669e5a5-f3dd-4666-ac25-0adb0cbde076 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd404e4ab55af470fa464b94f9f0cd2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6575b0846dca493f9e99ee122930972d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:42.005436 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e669e5a5-f3dd-4666-ac25-0adb0cbde076 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b" status: 200 len: 1318 microversion: 2.1 time: 0.279933 Jun 10 18:13:42.006284 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2206/4553] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:41 2022] GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:42.023825 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9389b180-89f1-47bb-8aae-7ae05fd0d797 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:42.024505 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9389b180-89f1-47bb-8aae-7ae05fd0d797 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:42.040721 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9389b180-89f1-47bb-8aae-7ae05fd0d797 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:42.042587 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9389b180-89f1-47bb-8aae-7ae05fd0d797 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:42.046597 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9389b180-89f1-47bb-8aae-7ae05fd0d797 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:42.047079 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9389b180-89f1-47bb-8aae-7ae05fd0d797 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:42.261222 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9389b180-89f1-47bb-8aae-7ae05fd0d797 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:42.273766 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9389b180-89f1-47bb-8aae-7ae05fd0d797 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e" status: 200 len: 1519 microversion: 2.1 time: 0.257484 Jun 10 18:13:42.277595 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2207/4554] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:42 2022] GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e => generated 1519 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:42.289863 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-56ba7cc5-bf3e-40d6-8063-225e5b2c8be9 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:42.293605 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-56ba7cc5-bf3e-40d6-8063-225e5b2c8be9 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 2b41be5a-d334-477b-a99d-a15eb9ecb5b6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:42.365528 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-56ba7cc5-bf3e-40d6-8063-225e5b2c8be9 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:42.373715 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-56ba7cc5-bf3e-40d6-8063-225e5b2c8be9 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/2b41be5a-d334-477b-a99d-a15eb9ecb5b6" status: 200 len: 1224 microversion: 2.1 time: 0.090449 Jun 10 18:13:42.375215 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2208/4555] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:42 2022] GET /compute/v2.1/servers/2b41be5a-d334-477b-a99d-a15eb9ecb5b6 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:42.740701 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fd4214d5-23c3-4a17-ae67-efdbd024edb1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:42.741348 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fd4214d5-23c3-4a17-ae67-efdbd024edb1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:42.747821 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd4214d5-23c3-4a17-ae67-efdbd024edb1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:42.749207 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd4214d5-23c3-4a17-ae67-efdbd024edb1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:42.750247 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd4214d5-23c3-4a17-ae67-efdbd024edb1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:42.750945 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd4214d5-23c3-4a17-ae67-efdbd024edb1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:42.757906 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:13:42.939489 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fd4214d5-23c3-4a17-ae67-efdbd024edb1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:42.955033 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fd4214d5-23c3-4a17-ae67-efdbd024edb1 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1519 microversion: 2.1 time: 0.219165 Jun 10 18:13:42.955681 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2209/4556] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:42 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1519 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:13:43.022376 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3d8c732c-c23e-4897-a2ad-6d63ceb71b2b tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:43.027146 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3d8c732c-c23e-4897-a2ad-6d63ceb71b2b tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 89cea229-7bfb-43e4-a855-e9c6ae81d37b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:43.037350 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3d8c732c-c23e-4897-a2ad-6d63ceb71b2b tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:43.038397 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3d8c732c-c23e-4897-a2ad-6d63ceb71b2b tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:43.039047 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3d8c732c-c23e-4897-a2ad-6d63ceb71b2b tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:43.039654 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3d8c732c-c23e-4897-a2ad-6d63ceb71b2b tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:43.270378 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3d8c732c-c23e-4897-a2ad-6d63ceb71b2b tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd404e4ab55af470fa464b94f9f0cd2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6575b0846dca493f9e99ee122930972d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:43.281666 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3d8c732c-c23e-4897-a2ad-6d63ceb71b2b tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b" status: 200 len: 1318 microversion: 2.1 time: 0.263006 Jun 10 18:13:43.282294 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2210/4557] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:43 2022] GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:43.306056 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2ba4d7bf-7077-4cb6-8704-b082e658c5e5 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:43.306711 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2ba4d7bf-7077-4cb6-8704-b082e658c5e5 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:43.314924 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2ba4d7bf-7077-4cb6-8704-b082e658c5e5 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:43.315587 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2ba4d7bf-7077-4cb6-8704-b082e658c5e5 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:43.316583 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2ba4d7bf-7077-4cb6-8704-b082e658c5e5 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:43.317524 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2ba4d7bf-7077-4cb6-8704-b082e658c5e5 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:43.567238 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2ba4d7bf-7077-4cb6-8704-b082e658c5e5 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:43.576643 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2ba4d7bf-7077-4cb6-8704-b082e658c5e5 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e" status: 200 len: 1519 microversion: 2.1 time: 0.282263 Jun 10 18:13:43.579462 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2211/4558] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:43 2022] GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e => generated 1519 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:13:43.584046 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2ee0ac82-7154-44cc-9fef-599c4a2d62df tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:43.584703 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2ee0ac82-7154-44cc-9fef-599c4a2d62df tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 2b41be5a-d334-477b-a99d-a15eb9ecb5b6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:43.592010 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2ee0ac82-7154-44cc-9fef-599c4a2d62df tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:43.592497 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2ee0ac82-7154-44cc-9fef-599c4a2d62df tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:43.593294 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2ee0ac82-7154-44cc-9fef-599c4a2d62df tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:43.593740 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2ee0ac82-7154-44cc-9fef-599c4a2d62df tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:43.682919 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2ee0ac82-7154-44cc-9fef-599c4a2d62df tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:43.691161 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2ee0ac82-7154-44cc-9fef-599c4a2d62df tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/2b41be5a-d334-477b-a99d-a15eb9ecb5b6" status: 200 len: 1276 microversion: 2.1 time: 0.112341 Jun 10 18:13:43.696513 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2212/4559] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:43 2022] GET /compute/v2.1/servers/2b41be5a-d334-477b-a99d-a15eb9ecb5b6 => generated 1276 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:43.720214 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-a4ce9e62-ca2e-4450-8c5a-c59239439069 req-0e5c3810-7410-4abb-b6f5-e1b6429e9d3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57a377b2-f75e-4a0c-8401-090db42db644", "name": "network-vif-plugged", "status": "completed", "tag": "ea23750f-0e21-482f-b68f-6361eeb3c636"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:13:43.736490 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-a4ce9e62-ca2e-4450-8c5a-c59239439069 req-0e5c3810-7410-4abb-b6f5-e1b6429e9d3c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:43.736966 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-a4ce9e62-ca2e-4450-8c5a-c59239439069 req-0e5c3810-7410-4abb-b6f5-e1b6429e9d3c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:43.799244 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-a4ce9e62-ca2e-4450-8c5a-c59239439069 req-0e5c3810-7410-4abb-b6f5-e1b6429e9d3c service nova] Creating event network-vif-plugged:ea23750f-0e21-482f-b68f-6361eeb3c636 for instance 57a377b2-f75e-4a0c-8401-090db42db644 on chh2-master-2 Jun 10 18:13:43.807155 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-a4ce9e62-ca2e-4450-8c5a-c59239439069 req-0e5c3810-7410-4abb-b6f5-e1b6429e9d3c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113150 Jun 10 18:13:43.808360 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2213/4560] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:13:43.972797 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-94ff64bb-2b45-4f9e-afb7-3f58284f22fa tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:43.973688 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-94ff64bb-2b45-4f9e-afb7-3f58284f22fa tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:43.988977 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-94ff64bb-2b45-4f9e-afb7-3f58284f22fa tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:43.989469 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-94ff64bb-2b45-4f9e-afb7-3f58284f22fa tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:43.990298 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-94ff64bb-2b45-4f9e-afb7-3f58284f22fa tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:43.994014 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-94ff64bb-2b45-4f9e-afb7-3f58284f22fa tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:44.362353 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-94ff64bb-2b45-4f9e-afb7-3f58284f22fa tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:44.377973 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-94ff64bb-2b45-4f9e-afb7-3f58284f22fa tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1519 microversion: 2.1 time: 0.408448 Jun 10 18:13:44.381070 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2214/4561] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:43 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1519 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:44.396132 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b81bc658-7d89-4330-9585-e2d3ae9f4159 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:44.397123 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b81bc658-7d89-4330-9585-e2d3ae9f4159 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 89cea229-7bfb-43e4-a855-e9c6ae81d37b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:44.406740 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b81bc658-7d89-4330-9585-e2d3ae9f4159 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:44.415024 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b81bc658-7d89-4330-9585-e2d3ae9f4159 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:44.415024 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b81bc658-7d89-4330-9585-e2d3ae9f4159 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:44.415024 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b81bc658-7d89-4330-9585-e2d3ae9f4159 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:44.708341 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b81bc658-7d89-4330-9585-e2d3ae9f4159 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd404e4ab55af470fa464b94f9f0cd2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6575b0846dca493f9e99ee122930972d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:44.719523 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b81bc658-7d89-4330-9585-e2d3ae9f4159 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b" status: 200 len: 1467 microversion: 2.1 time: 0.337045 Jun 10 18:13:44.722210 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2215/4562] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:44 2022] GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b => generated 1467 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:44.729571 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b4e07b2b-92b5-47b4-b9c9-2524d561949b tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:44.730199 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b4e07b2b-92b5-47b4-b9c9-2524d561949b tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:44.741869 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b4e07b2b-92b5-47b4-b9c9-2524d561949b tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:44.745738 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b4e07b2b-92b5-47b4-b9c9-2524d561949b tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:44.745738 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b4e07b2b-92b5-47b4-b9c9-2524d561949b tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:44.745738 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b4e07b2b-92b5-47b4-b9c9-2524d561949b tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:45.058813 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b4e07b2b-92b5-47b4-b9c9-2524d561949b tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:45.072480 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b4e07b2b-92b5-47b4-b9c9-2524d561949b tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e" status: 200 len: 1519 microversion: 2.1 time: 0.344921 Jun 10 18:13:45.072978 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2216/4563] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:44 2022] GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e => generated 1519 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:45.079922 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5fa97d98-085d-4fad-8d66-537a9045d881 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:45.084476 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5fa97d98-085d-4fad-8d66-537a9045d881 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 2b41be5a-d334-477b-a99d-a15eb9ecb5b6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:45.098668 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5fa97d98-085d-4fad-8d66-537a9045d881 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:45.106376 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5fa97d98-085d-4fad-8d66-537a9045d881 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:45.106376 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5fa97d98-085d-4fad-8d66-537a9045d881 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:45.106376 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5fa97d98-085d-4fad-8d66-537a9045d881 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:45.252567 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5fa97d98-085d-4fad-8d66-537a9045d881 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:45.269952 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5fa97d98-085d-4fad-8d66-537a9045d881 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/2b41be5a-d334-477b-a99d-a15eb9ecb5b6" status: 200 len: 1282 microversion: 2.1 time: 0.195697 Jun 10 18:13:45.282508 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2217/4564] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:45 2022] GET /compute/v2.1/servers/2b41be5a-d334-477b-a99d-a15eb9ecb5b6 => generated 1282 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:45.289490 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-28277c60-87ae-46c0-81b8-41339f760e64 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:45.290522 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-28277c60-87ae-46c0-81b8-41339f760e64 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 72eaef23-30d6-4755-a9b7-9547856075b3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:45.302050 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-28277c60-87ae-46c0-81b8-41339f760e64 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:45.302864 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-28277c60-87ae-46c0-81b8-41339f760e64 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:45.303864 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-28277c60-87ae-46c0-81b8-41339f760e64 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:45.304516 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-28277c60-87ae-46c0-81b8-41339f760e64 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:45.653501 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-28277c60-87ae-46c0-81b8-41339f760e64 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd404e4ab55af470fa464b94f9f0cd2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6575b0846dca493f9e99ee122930972d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:45.664604 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-28277c60-87ae-46c0-81b8-41339f760e64 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/servers/72eaef23-30d6-4755-a9b7-9547856075b3" status: 200 len: 1467 microversion: 2.1 time: 0.378644 Jun 10 18:13:45.665211 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2218/4565] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:45 2022] GET /compute/v2.1/servers/72eaef23-30d6-4755-a9b7-9547856075b3 => generated 1467 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:45.671494 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e8ea7c69-925a-4b2e-b7d2-a291a483bf86 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:45.672394 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e8ea7c69-925a-4b2e-b7d2-a291a483bf86 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:45.679939 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e8ea7c69-925a-4b2e-b7d2-a291a483bf86 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:45.680793 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e8ea7c69-925a-4b2e-b7d2-a291a483bf86 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:45.681756 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e8ea7c69-925a-4b2e-b7d2-a291a483bf86 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:45.682477 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e8ea7c69-925a-4b2e-b7d2-a291a483bf86 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:45.864714 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-1062c7b3-09cc-4a28-a034-50845b09709b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:13:45.866215 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-1062c7b3-09cc-4a28-a034-50845b09709b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:13:45.866851 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-1062c7b3-09cc-4a28-a034-50845b09709b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:13:45.867372 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-1062c7b3-09cc-4a28-a034-50845b09709b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:13:45.868380 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-1062c7b3-09cc-4a28-a034-50845b09709b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:13:45.887829 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1062c7b3-09cc-4a28-a034-50845b09709b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:45.889377 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1062c7b3-09cc-4a28-a034-50845b09709b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:45.891888 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1062c7b3-09cc-4a28-a034-50845b09709b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:45.895412 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1062c7b3-09cc-4a28-a034-50845b09709b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:45.967346 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-1062c7b3-09cc-4a28-a034-50845b09709b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Getting quotas for project bedaf8a0acb148ec9a671abf0a548fdb. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:13:45.974738 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-1062c7b3-09cc-4a28-a034-50845b09709b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Getting quotas for user 0c101ac379c94319baca4c2c9781030f and project bedaf8a0acb148ec9a671abf0a548fdb. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:13:46.025203 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e8ea7c69-925a-4b2e-b7d2-a291a483bf86 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:46.037371 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e8ea7c69-925a-4b2e-b7d2-a291a483bf86 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1519 microversion: 2.1 time: 0.369275 Jun 10 18:13:46.039664 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2219/4566] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:45 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1519 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:46.067157 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-aa66e3a4-a2e5-44c2-9004-dda55d05147c tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-61721804"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:13:46.070879 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-aa66e3a4-a2e5-44c2-9004-dda55d05147c tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 72eaef23-30d6-4755-a9b7-9547856075b3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:46.089191 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aa66e3a4-a2e5-44c2-9004-dda55d05147c tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:46.114467 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aa66e3a4-a2e5-44c2-9004-dda55d05147c tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:46.117948 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aa66e3a4-a2e5-44c2-9004-dda55d05147c tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:46.118499 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aa66e3a4-a2e5-44c2-9004-dda55d05147c tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:46.469234 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1062c7b3-09cc-4a28-a034-50845b09709b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:13:46.472224 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1062c7b3-09cc-4a28-a034-50845b09709b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='0a22130f-d1af-4319-ab33-dd947e0a1d74',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='3572b223-5a84-4b50-9610-04ff779d1abf',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6a4710af-e2d4-4f16-b612-bffe4c8d9f97',volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:13:47.313198 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-aa66e3a4-a2e5-44c2-9004-dda55d05147c tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "POST /compute/v2.1/servers/72eaef23-30d6-4755-a9b7-9547856075b3/action" status: 202 len: 0 microversion: 2.1 time: 1.247535 Jun 10 18:13:47.313198 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2220/4567] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:13:46 2022] POST /compute/v2.1/servers/72eaef23-30d6-4755-a9b7-9547856075b3/action => generated 0 bytes in 1251 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 10 18:13:47.313198 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7dad47a9-b16c-4d0a-88b7-d735e6da920e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:47.313198 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7dad47a9-b16c-4d0a-88b7-d735e6da920e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:47.313198 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7dad47a9-b16c-4d0a-88b7-d735e6da920e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:47.313198 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7dad47a9-b16c-4d0a-88b7-d735e6da920e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:47.313198 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7dad47a9-b16c-4d0a-88b7-d735e6da920e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:47.313198 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7dad47a9-b16c-4d0a-88b7-d735e6da920e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:47.544366 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7dad47a9-b16c-4d0a-88b7-d735e6da920e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:47.556047 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7dad47a9-b16c-4d0a-88b7-d735e6da920e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e" status: 200 len: 1519 microversion: 2.1 time: 0.262833 Jun 10 18:13:47.557364 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2221/4568] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:47 2022] GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e => generated 1519 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:47.585365 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-464acbfe-a18a-452c-bff6-6be5a7df0d33 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:47.590402 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-464acbfe-a18a-452c-bff6-6be5a7df0d33 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 2b41be5a-d334-477b-a99d-a15eb9ecb5b6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:47.603501 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-464acbfe-a18a-452c-bff6-6be5a7df0d33 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:47.606411 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-464acbfe-a18a-452c-bff6-6be5a7df0d33 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:47.607604 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-464acbfe-a18a-452c-bff6-6be5a7df0d33 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:47.608243 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-464acbfe-a18a-452c-bff6-6be5a7df0d33 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:48.085523 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-464acbfe-a18a-452c-bff6-6be5a7df0d33 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:48.095454 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-464acbfe-a18a-452c-bff6-6be5a7df0d33 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/2b41be5a-d334-477b-a99d-a15eb9ecb5b6" status: 200 len: 1324 microversion: 2.1 time: 0.536887 Jun 10 18:13:48.098124 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2222/4569] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:47 2022] GET /compute/v2.1/servers/2b41be5a-d334-477b-a99d-a15eb9ecb5b6 => generated 1324 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:48.106566 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-67e57010-e9f7-40cc-a185-3616cd872605 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:48.120160 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-67e57010-e9f7-40cc-a185-3616cd872605 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:48.133927 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-67e57010-e9f7-40cc-a185-3616cd872605 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:48.134648 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-67e57010-e9f7-40cc-a185-3616cd872605 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:48.146798 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-67e57010-e9f7-40cc-a185-3616cd872605 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:48.147289 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-67e57010-e9f7-40cc-a185-3616cd872605 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:48.379764 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1062c7b3-09cc-4a28-a034-50845b09709b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 9.377181 Jun 10 18:13:48.383137 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2348/4570] 10.222.0.35 () {62 vars in 1188 bytes} [Fri Jun 10 18:13:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 9381 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 10 18:13:48.427684 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-14ae00ca-1180-4843-b322-3255d62d5b57 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3a653a0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:48.431652 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-67e57010-e9f7-40cc-a185-3616cd872605 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:48.443669 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-67e57010-e9f7-40cc-a185-3616cd872605 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1519 microversion: 2.1 time: 0.344183 Jun 10 18:13:48.448408 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2223/4571] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:48 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1519 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:48.453411 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-eac743d0-770d-4c13-a423-98f379158345 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:48.454029 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-eac743d0-770d-4c13-a423-98f379158345 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:48.566568 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-eac743d0-770d-4c13-a423-98f379158345 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:48.578360 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-eac743d0-770d-4c13-a423-98f379158345 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:48.585190 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-eac743d0-770d-4c13-a423-98f379158345 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:48.586483 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-eac743d0-770d-4c13-a423-98f379158345 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1285 microversion: 2.42 time: 0.136902 Jun 10 18:13:48.587479 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2224/4572] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:13:48 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1285 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:13:48.596145 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-e55376f9-bef6-4241-ab2d-7c630e1d2a72 req-54dd0b37-1472-4f94-bca0-df48a0e28edb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b41be5a-d334-477b-a99d-a15eb9ecb5b6", "tag": "9dbf3d0f-8140-40e8-8125-09306b810a6f"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:13:48.628177 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-e55376f9-bef6-4241-ab2d-7c630e1d2a72 req-54dd0b37-1472-4f94-bca0-df48a0e28edb service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:48.628964 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-e55376f9-bef6-4241-ab2d-7c630e1d2a72 req-54dd0b37-1472-4f94-bca0-df48a0e28edb service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:48.659993 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-e55376f9-bef6-4241-ab2d-7c630e1d2a72 req-54dd0b37-1472-4f94-bca0-df48a0e28edb service nova] Creating event network-changed:9dbf3d0f-8140-40e8-8125-09306b810a6f for instance 2b41be5a-d334-477b-a99d-a15eb9ecb5b6 on chh1-master-2 Jun 10 18:13:48.670713 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-e55376f9-bef6-4241-ab2d-7c630e1d2a72 req-54dd0b37-1472-4f94-bca0-df48a0e28edb service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078109 Jun 10 18:13:48.671358 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2225/4573] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:13:48.695155 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ea5b7263-b59f-4225-adc0-e526383b1c87 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:48.695155 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ea5b7263-b59f-4225-adc0-e526383b1c87 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:48.707798 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ea5b7263-b59f-4225-adc0-e526383b1c87 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:48.708428 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ea5b7263-b59f-4225-adc0-e526383b1c87 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:48.709092 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ea5b7263-b59f-4225-adc0-e526383b1c87 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:48.725273 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ea5b7263-b59f-4225-adc0-e526383b1c87 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:48.881135 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-14ae00ca-1180-4843-b322-3255d62d5b57 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/63662839-4647-44e5-8390-303920cc5c18" status: 200 len: 1451 microversion: 2.1 time: 0.498723 Jun 10 18:13:48.882028 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2349/4574] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:13:48 2022] GET /compute/v2.1/images/63662839-4647-44e5-8390-303920cc5c18 => generated 1451 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:49.053287 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ea5b7263-b59f-4225-adc0-e526383b1c87 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:49.059615 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:13:49.063970 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ea5b7263-b59f-4225-adc0-e526383b1c87 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e" status: 200 len: 1519 microversion: 2.1 time: 0.389748 Jun 10 18:13:49.066038 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2226/4575] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:48 2022] GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e => generated 1519 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:49.126291 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-db995eff-7634-409a-beb6-efe731ec72f9 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:49.126291 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-db995eff-7634-409a-beb6-efe731ec72f9 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 2b41be5a-d334-477b-a99d-a15eb9ecb5b6] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:49.126291 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-db995eff-7634-409a-beb6-efe731ec72f9 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:49.126291 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-db995eff-7634-409a-beb6-efe731ec72f9 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:49.126291 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-db995eff-7634-409a-beb6-efe731ec72f9 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:49.126291 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-db995eff-7634-409a-beb6-efe731ec72f9 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:49.468650 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5d50e37d-c333-4525-ab01-2a0254a4faf3 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:49.472961 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5d50e37d-c333-4525-ab01-2a0254a4faf3 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:49.494371 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5d50e37d-c333-4525-ab01-2a0254a4faf3 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:49.495134 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5d50e37d-c333-4525-ab01-2a0254a4faf3 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:49.496154 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5d50e37d-c333-4525-ab01-2a0254a4faf3 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:49.496874 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5d50e37d-c333-4525-ab01-2a0254a4faf3 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:49.793875 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5d50e37d-c333-4525-ab01-2a0254a4faf3 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:49.805399 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5d50e37d-c333-4525-ab01-2a0254a4faf3 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.342887 Jun 10 18:13:49.816972 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2227/4576] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:49 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:13:49.841464 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7a1912da-0430-4479-bff2-55d0a39e3019 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:49.841464 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7a1912da-0430-4479-bff2-55d0a39e3019 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:49.864025 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-db995eff-7634-409a-beb6-efe731ec72f9 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:49.884658 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-db995eff-7634-409a-beb6-efe731ec72f9 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/2b41be5a-d334-477b-a99d-a15eb9ecb5b6" status: 200 len: 1324 microversion: 2.1 time: 0.764185 Jun 10 18:13:49.884658 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2350/4577] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:49 2022] GET /compute/v2.1/servers/2b41be5a-d334-477b-a99d-a15eb9ecb5b6 => generated 1324 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:49.891544 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-39d92e17-610a-489e-9e96-57b1b73b17e5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:49.892189 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-39d92e17-610a-489e-9e96-57b1b73b17e5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:49.900208 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-39d92e17-610a-489e-9e96-57b1b73b17e5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:49.900726 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-39d92e17-610a-489e-9e96-57b1b73b17e5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:49.901675 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-39d92e17-610a-489e-9e96-57b1b73b17e5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:49.902796 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-39d92e17-610a-489e-9e96-57b1b73b17e5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:49.939723 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7a1912da-0430-4479-bff2-55d0a39e3019 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:49.967282 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7a1912da-0430-4479-bff2-55d0a39e3019 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:49.969845 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7a1912da-0430-4479-bff2-55d0a39e3019 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:49.972688 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7a1912da-0430-4479-bff2-55d0a39e3019 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1285 microversion: 2.42 time: 0.153540 Jun 10 18:13:49.975630 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2228/4578] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:13:49 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1285 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:13:49.980487 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-17680b37-f657-4383-9665-76441bdfe082 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c11d3430>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:50.030875 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-17680b37-f657-4383-9665-76441bdfe082 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/63662839-4647-44e5-8390-303920cc5c18" status: 200 len: 1451 microversion: 2.1 time: 0.054070 Jun 10 18:13:50.032063 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2229/4579] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:13:49 2022] GET /compute/v2.1/images/63662839-4647-44e5-8390-303920cc5c18 => generated 1451 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:50.083171 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b9b2a5bf-1a32-4786-a036-cc204cd888e6 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:50.084092 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b9b2a5bf-1a32-4786-a036-cc204cd888e6 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:50.092028 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9b2a5bf-1a32-4786-a036-cc204cd888e6 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:50.094604 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9b2a5bf-1a32-4786-a036-cc204cd888e6 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:50.094604 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9b2a5bf-1a32-4786-a036-cc204cd888e6 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:50.094604 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9b2a5bf-1a32-4786-a036-cc204cd888e6 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:50.193391 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-39d92e17-610a-489e-9e96-57b1b73b17e5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:50.205576 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-39d92e17-610a-489e-9e96-57b1b73b17e5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.325702 Jun 10 18:13:50.207858 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2351/4580] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:49 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:50.237795 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9fd96282-7b5f-40b0-a286-a13e3774e694 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:50.238942 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9fd96282-7b5f-40b0-a286-a13e3774e694 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:50.249196 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9fd96282-7b5f-40b0-a286-a13e3774e694 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:50.250233 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9fd96282-7b5f-40b0-a286-a13e3774e694 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:50.253773 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9fd96282-7b5f-40b0-a286-a13e3774e694 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:50.253773 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9fd96282-7b5f-40b0-a286-a13e3774e694 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:50.298503 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b9b2a5bf-1a32-4786-a036-cc204cd888e6 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:50.316629 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b9b2a5bf-1a32-4786-a036-cc204cd888e6 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e" status: 200 len: 1519 microversion: 2.1 time: 0.237587 Jun 10 18:13:50.318092 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2230/4581] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:50 2022] GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e => generated 1519 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:13:50.523007 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9fd96282-7b5f-40b0-a286-a13e3774e694 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:50.532360 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9fd96282-7b5f-40b0-a286-a13e3774e694 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.298882 Jun 10 18:13:50.548686 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2352/4582] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:50 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:50.576524 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1efd04eb-c50d-40ae-b2fd-12ce140bef82 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:13:50.586601 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-1efd04eb-c50d-40ae-b2fd-12ce140bef82 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] HTTP exception thrown: Instance 75e1388b-140d-411a-8182-dfeabece8fb6 has no mapping to a cell. Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1efd04eb-c50d-40ae-b2fd-12ce140bef82 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers/75e1388b-140d-411a-8182-dfeabece8fb6/action HTTP/1.1 Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 15 Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: {"os-stop": {}} Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 75e1388b-140d-411a-8182-dfeabece8fb6 has no mapping to a cell. Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '75e1388b-140d-411a-8182-dfeabece8fb6', 'body': {'os-stop': {}}} Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 75e1388b-140d-411a-8182-dfeabece8fb6 has no mapping to a cell. Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:13:50.601047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75e1388b-140d-411a-8182-dfeabece8fb6 has no mapping to a cell. Jun 10 18:13:50.609030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:50.609030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:13:50.609030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:50.609030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:13:50.609030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:13:50.609030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:13:50.609030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:13:50.609030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:13:50.609030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75e1388b-140d-411a-8182-dfeabece8fb6 has no mapping to a cell. Jun 10 18:13:50.609030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:50.609030 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1efd04eb-c50d-40ae-b2fd-12ce140bef82 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 404 to user: Instance 75e1388b-140d-411a-8182-dfeabece8fb6 has no mapping to a cell. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:13:50.609030 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1efd04eb-c50d-40ae-b2fd-12ce140bef82 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "POST /compute/v2.1/servers/75e1388b-140d-411a-8182-dfeabece8fb6/action" status: 404 len: 117 microversion: 2.1 time: 0.038854 Jun 10 18:13:50.609030 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2231/4583] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:13:50 2022] POST /compute/v2.1/servers/75e1388b-140d-411a-8182-dfeabece8fb6/action => generated 117 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:13:50.613561 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-43c7a6d0-6420-4f0d-9136-397947f5117c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:50.616466 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-43c7a6d0-6420-4f0d-9136-397947f5117c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:50.628217 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-43c7a6d0-6420-4f0d-9136-397947f5117c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:50.629350 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-43c7a6d0-6420-4f0d-9136-397947f5117c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:50.630449 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-43c7a6d0-6420-4f0d-9136-397947f5117c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:50.630908 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-43c7a6d0-6420-4f0d-9136-397947f5117c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:50.891076 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-10c752b0-0f3b-4556-871f-960189d17591 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:50.892046 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-10c752b0-0f3b-4556-871f-960189d17591 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 2b41be5a-d334-477b-a99d-a15eb9ecb5b6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:50.912752 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-43c7a6d0-6420-4f0d-9136-397947f5117c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:50.925147 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:13:50.927700 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-43c7a6d0-6420-4f0d-9136-397947f5117c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.319003 Jun 10 18:13:50.930605 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2353/4584] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:50 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:50.948566 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3e11a94c-0765-43d7-a6a0-0291f336b01e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:50.953035 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3e11a94c-0765-43d7-a6a0-0291f336b01e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:50.954354 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10c752b0-0f3b-4556-871f-960189d17591 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:50.955586 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10c752b0-0f3b-4556-871f-960189d17591 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:50.956653 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10c752b0-0f3b-4556-871f-960189d17591 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:50.957425 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10c752b0-0f3b-4556-871f-960189d17591 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:50.968157 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3e11a94c-0765-43d7-a6a0-0291f336b01e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:50.970257 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3e11a94c-0765-43d7-a6a0-0291f336b01e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:50.972601 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3e11a94c-0765-43d7-a6a0-0291f336b01e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:50.974032 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3e11a94c-0765-43d7-a6a0-0291f336b01e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:51.293692 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-10c752b0-0f3b-4556-871f-960189d17591 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:51.307183 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-10c752b0-0f3b-4556-871f-960189d17591 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/2b41be5a-d334-477b-a99d-a15eb9ecb5b6" status: 200 len: 1324 microversion: 2.1 time: 0.419796 Jun 10 18:13:51.309266 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2232/4585] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:50 2022] GET /compute/v2.1/servers/2b41be5a-d334-477b-a99d-a15eb9ecb5b6 => generated 1324 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:13:51.314830 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b6e15d19-14b8-4aa2-8e62-8320f6b6398c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:51.315453 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b6e15d19-14b8-4aa2-8e62-8320f6b6398c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:51.325431 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b6e15d19-14b8-4aa2-8e62-8320f6b6398c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:51.326379 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b6e15d19-14b8-4aa2-8e62-8320f6b6398c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:51.327557 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b6e15d19-14b8-4aa2-8e62-8320f6b6398c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:51.328493 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b6e15d19-14b8-4aa2-8e62-8320f6b6398c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:51.426763 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b6e15d19-14b8-4aa2-8e62-8320f6b6398c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:51.440987 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b6e15d19-14b8-4aa2-8e62-8320f6b6398c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:51.444233 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b6e15d19-14b8-4aa2-8e62-8320f6b6398c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:51.447632 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b6e15d19-14b8-4aa2-8e62-8320f6b6398c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1527 microversion: 2.42 time: 0.136748 Jun 10 18:13:51.448664 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2233/4586] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:13:51 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1527 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:13:51.454448 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e7336cae-f3f8-4fac-b889-d401d71761c8 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c610c9d0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:51.515427 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3e11a94c-0765-43d7-a6a0-0291f336b01e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:51.528267 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3e11a94c-0765-43d7-a6a0-0291f336b01e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.586024 Jun 10 18:13:51.529178 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2354/4587] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:50 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:13:51.529875 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e7336cae-f3f8-4fac-b889-d401d71761c8 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/63662839-4647-44e5-8390-303920cc5c18" status: 200 len: 1451 microversion: 2.1 time: 0.073911 Jun 10 18:13:51.534651 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2234/4588] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:13:51 2022] GET /compute/v2.1/images/63662839-4647-44e5-8390-303920cc5c18 => generated 1451 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:51.535991 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9cc6dae0-8416-4b74-b2cb-621d0b7dcf9b tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:51.536935 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9cc6dae0-8416-4b74-b2cb-621d0b7dcf9b tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:51.546151 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9cc6dae0-8416-4b74-b2cb-621d0b7dcf9b tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:51.546321 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1964a225-615f-4196-aec7-40d792237583 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:13:51.547032 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9cc6dae0-8416-4b74-b2cb-621d0b7dcf9b tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:51.547165 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1964a225-615f-4196-aec7-40d792237583 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: c9703673-47ff-424e-84df-c48c26bcff81] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:51.548218 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9cc6dae0-8416-4b74-b2cb-621d0b7dcf9b tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:51.549003 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9cc6dae0-8416-4b74-b2cb-621d0b7dcf9b tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:51.555650 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-1964a225-615f-4196-aec7-40d792237583 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] HTTP exception thrown: Instance c9703673-47ff-424e-84df-c48c26bcff81 could not be found. Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1964a225-615f-4196-aec7-40d792237583 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers/c9703673-47ff-424e-84df-c48c26bcff81/action HTTP/1.1 Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 15 Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: {"suspend": {}} Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: exception: Instance c9703673-47ff-424e-84df-c48c26bcff81 could not be found. Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'c9703673-47ff-424e-84df-c48c26bcff81', 'body': {'suspend': {}}} Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9703673-47ff-424e-84df-c48c26bcff81 could not be found. Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9703673-47ff-424e-84df-c48c26bcff81 could not be found. Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:13:51.558194 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:13:51.563032 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:13:51.563032 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:13:51.563032 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9703673-47ff-424e-84df-c48c26bcff81 could not be found. Jun 10 18:13:51.563032 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:13:51.566608 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1964a225-615f-4196-aec7-40d792237583 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 404 to user: Instance c9703673-47ff-424e-84df-c48c26bcff81 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:13:51.568590 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1964a225-615f-4196-aec7-40d792237583 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "POST /compute/v2.1/servers/c9703673-47ff-424e-84df-c48c26bcff81/action" status: 404 len: 111 microversion: 2.1 time: 0.026429 Jun 10 18:13:51.570193 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2235/4589] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:13:51 2022] POST /compute/v2.1/servers/c9703673-47ff-424e-84df-c48c26bcff81/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:13:51.583165 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6427f0e3-255a-41b6-b1ed-7907e919aa7f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:51.587092 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6427f0e3-255a-41b6-b1ed-7907e919aa7f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:51.608022 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6427f0e3-255a-41b6-b1ed-7907e919aa7f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:51.610265 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6427f0e3-255a-41b6-b1ed-7907e919aa7f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:51.611417 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6427f0e3-255a-41b6-b1ed-7907e919aa7f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:51.612344 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6427f0e3-255a-41b6-b1ed-7907e919aa7f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:51.836825 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6427f0e3-255a-41b6-b1ed-7907e919aa7f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:51.847236 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6427f0e3-255a-41b6-b1ed-7907e919aa7f tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.270471 Jun 10 18:13:51.848502 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2236/4590] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:51 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:51.881331 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-45ef9f00-58cf-471b-87e8-b7a790616d85 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:51.882849 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-45ef9f00-58cf-471b-87e8-b7a790616d85 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:51.887952 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9cc6dae0-8416-4b74-b2cb-621d0b7dcf9b tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:51.893877 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:13:51.897895 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9cc6dae0-8416-4b74-b2cb-621d0b7dcf9b tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e" status: 200 len: 1519 microversion: 2.1 time: 0.367262 Jun 10 18:13:51.898362 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45ef9f00-58cf-471b-87e8-b7a790616d85 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:51.898978 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45ef9f00-58cf-471b-87e8-b7a790616d85 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:51.899357 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2355/4591] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:51 2022] GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e => generated 1519 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:51.910893 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45ef9f00-58cf-471b-87e8-b7a790616d85 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:51.911749 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45ef9f00-58cf-471b-87e8-b7a790616d85 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:52.116607 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-45ef9f00-58cf-471b-87e8-b7a790616d85 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:52.133068 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-45ef9f00-58cf-471b-87e8-b7a790616d85 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.269543 Jun 10 18:13:52.134406 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2237/4592] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:51 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:52.151291 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ceb8f11f-6ab4-43d2-865f-f95dcaa581a2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:13:52.155053 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ceb8f11f-6ab4-43d2-865f-f95dcaa581a2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:52.183727 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ceb8f11f-6ab4-43d2-865f-f95dcaa581a2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:52.184847 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ceb8f11f-6ab4-43d2-865f-f95dcaa581a2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:52.185724 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ceb8f11f-6ab4-43d2-865f-f95dcaa581a2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:52.186367 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ceb8f11f-6ab4-43d2-865f-f95dcaa581a2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:52.216901 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-ceb8f11f-6ab4-43d2-865f-f95dcaa581a2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lazy-loading 'flavor' on Instance uuid 57a377b2-f75e-4a0c-8401-090db42db644 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:13:52.327120 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1cd94e27-937d-44f2-bf0d-de6b961ac94e tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:52.327996 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1cd94e27-937d-44f2-bf0d-de6b961ac94e tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 2b41be5a-d334-477b-a99d-a15eb9ecb5b6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:52.338141 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1cd94e27-937d-44f2-bf0d-de6b961ac94e tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:52.338944 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1cd94e27-937d-44f2-bf0d-de6b961ac94e tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:52.354208 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1cd94e27-937d-44f2-bf0d-de6b961ac94e tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:52.365942 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1cd94e27-937d-44f2-bf0d-de6b961ac94e tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:52.905758 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1cd94e27-937d-44f2-bf0d-de6b961ac94e tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:52.914422 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1cd94e27-937d-44f2-bf0d-de6b961ac94e tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/2b41be5a-d334-477b-a99d-a15eb9ecb5b6" status: 200 len: 1324 microversion: 2.1 time: 0.591713 Jun 10 18:13:52.915010 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2238/4593] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:52 2022] GET /compute/v2.1/servers/2b41be5a-d334-477b-a99d-a15eb9ecb5b6 => generated 1324 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:13:52.919910 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d7648f6d-2872-46a2-8634-9f7cb101a949 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:52.920754 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d7648f6d-2872-46a2-8634-9f7cb101a949 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:52.927650 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d7648f6d-2872-46a2-8634-9f7cb101a949 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:52.928110 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d7648f6d-2872-46a2-8634-9f7cb101a949 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:52.929241 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d7648f6d-2872-46a2-8634-9f7cb101a949 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:52.929687 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d7648f6d-2872-46a2-8634-9f7cb101a949 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:53.031105 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d7648f6d-2872-46a2-8634-9f7cb101a949 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:53.041864 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d7648f6d-2872-46a2-8634-9f7cb101a949 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:53.044024 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d7648f6d-2872-46a2-8634-9f7cb101a949 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:53.045675 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d7648f6d-2872-46a2-8634-9f7cb101a949 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1575 microversion: 2.42 time: 0.129470 Jun 10 18:13:53.046451 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2239/4594] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:13:52 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1575 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:13:53.052591 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b04809f6-76c4-490b-869a-e908a92a3844 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c048f0d0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:53.120713 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b04809f6-76c4-490b-869a-e908a92a3844 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/63662839-4647-44e5-8390-303920cc5c18" status: 200 len: 1451 microversion: 2.1 time: 0.072724 Jun 10 18:13:53.125216 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2240/4595] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:13:53 2022] GET /compute/v2.1/images/63662839-4647-44e5-8390-303920cc5c18 => generated 1451 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:53.130909 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6302d4ef-d89f-4b09-8e2f-a21b1b6c4494 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:53.132016 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6302d4ef-d89f-4b09-8e2f-a21b1b6c4494 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:53.146005 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6302d4ef-d89f-4b09-8e2f-a21b1b6c4494 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:53.146749 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6302d4ef-d89f-4b09-8e2f-a21b1b6c4494 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:53.148468 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6302d4ef-d89f-4b09-8e2f-a21b1b6c4494 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:53.148934 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6302d4ef-d89f-4b09-8e2f-a21b1b6c4494 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:53.288954 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ceb8f11f-6ab4-43d2-865f-f95dcaa581a2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "POST /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644/action" status: 202 len: 0 microversion: 2.1 time: 1.132552 Jun 10 18:13:53.288954 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2356/4596] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:13:52 2022] POST /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644/action => generated 0 bytes in 1135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 18:13:53.308396 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b6ca58e1-e54d-42ca-8570-1ba03620b5d8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:53.311293 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b6ca58e1-e54d-42ca-8570-1ba03620b5d8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:53.326779 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b6ca58e1-e54d-42ca-8570-1ba03620b5d8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:53.326779 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b6ca58e1-e54d-42ca-8570-1ba03620b5d8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:53.327844 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b6ca58e1-e54d-42ca-8570-1ba03620b5d8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:53.328500 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b6ca58e1-e54d-42ca-8570-1ba03620b5d8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:53.455584 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6302d4ef-d89f-4b09-8e2f-a21b1b6c4494 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:53.469280 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6302d4ef-d89f-4b09-8e2f-a21b1b6c4494 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e" status: 200 len: 1519 microversion: 2.1 time: 0.339583 Jun 10 18:13:53.479965 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2241/4597] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:53 2022] GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e => generated 1519 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:53.586184 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-2579c70c-d51c-446d-b9b5-e382a53a3161 req-0a504b6d-4c2a-4056-8cd4-81f57151673a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b41be5a-d334-477b-a99d-a15eb9ecb5b6", "name": "network-vif-plugged", "status": "completed", "tag": "9dbf3d0f-8140-40e8-8125-09306b810a6f"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:13:53.596914 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-2579c70c-d51c-446d-b9b5-e382a53a3161 req-0a504b6d-4c2a-4056-8cd4-81f57151673a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:53.597831 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-2579c70c-d51c-446d-b9b5-e382a53a3161 req-0a504b6d-4c2a-4056-8cd4-81f57151673a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:53.615522 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-2579c70c-d51c-446d-b9b5-e382a53a3161 req-0a504b6d-4c2a-4056-8cd4-81f57151673a service nova] Creating event network-vif-plugged:9dbf3d0f-8140-40e8-8125-09306b810a6f for instance 2b41be5a-d334-477b-a99d-a15eb9ecb5b6 on chh1-master-2 Jun 10 18:13:53.624552 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-2579c70c-d51c-446d-b9b5-e382a53a3161 req-0a504b6d-4c2a-4056-8cd4-81f57151673a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042381 Jun 10 18:13:53.626310 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2242/4598] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:13:53.738147 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b6ca58e1-e54d-42ca-8570-1ba03620b5d8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:53.746379 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b6ca58e1-e54d-42ca-8570-1ba03620b5d8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1514 microversion: 2.1 time: 0.458942 Jun 10 18:13:53.746978 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2357/4599] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:53 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1514 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:53.933683 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2b6b91e7-d362-4eb5-a1f7-47401839a07c tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:53.935426 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2b6b91e7-d362-4eb5-a1f7-47401839a07c tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 2b41be5a-d334-477b-a99d-a15eb9ecb5b6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:53.949698 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2b6b91e7-d362-4eb5-a1f7-47401839a07c tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:53.950457 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2b6b91e7-d362-4eb5-a1f7-47401839a07c tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:53.952661 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2b6b91e7-d362-4eb5-a1f7-47401839a07c tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:53.955798 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2b6b91e7-d362-4eb5-a1f7-47401839a07c tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:54.081684 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3dedb431-ad0d-414f-af1a-0c5928acfbe3 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:54.083190 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3dedb431-ad0d-414f-af1a-0c5928acfbe3 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:54.090706 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3dedb431-ad0d-414f-af1a-0c5928acfbe3 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:54.094491 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3dedb431-ad0d-414f-af1a-0c5928acfbe3 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:54.094491 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3dedb431-ad0d-414f-af1a-0c5928acfbe3 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:54.094491 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3dedb431-ad0d-414f-af1a-0c5928acfbe3 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:54.190011 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2b6b91e7-d362-4eb5-a1f7-47401839a07c tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:54.198233 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2b6b91e7-d362-4eb5-a1f7-47401839a07c tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/2b41be5a-d334-477b-a99d-a15eb9ecb5b6" status: 200 len: 1324 microversion: 2.1 time: 0.268858 Jun 10 18:13:54.209393 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2243/4600] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:53 2022] GET /compute/v2.1/servers/2b41be5a-d334-477b-a99d-a15eb9ecb5b6 => generated 1324 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:54.219695 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2153f605-c08d-4743-a500-888d1fbec6fc tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c04245e0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:54.249950 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3dedb431-ad0d-414f-af1a-0c5928acfbe3 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:54.275100 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3dedb431-ad0d-414f-af1a-0c5928acfbe3 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:54.277422 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3dedb431-ad0d-414f-af1a-0c5928acfbe3 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:54.279720 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3dedb431-ad0d-414f-af1a-0c5928acfbe3 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1593 microversion: 2.42 time: 0.204260 Jun 10 18:13:54.280841 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2358/4601] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:13:54 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1593 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:13:54.286208 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2153f605-c08d-4743-a500-888d1fbec6fc tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/63662839-4647-44e5-8390-303920cc5c18" status: 200 len: 1451 microversion: 2.1 time: 0.074525 Jun 10 18:13:54.286821 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2244/4602] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:13:54 2022] GET /compute/v2.1/images/63662839-4647-44e5-8390-303920cc5c18 => generated 1451 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:54.488069 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4dc6453c-b6fe-430a-9104-ecb0756aa660 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:54.498967 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4dc6453c-b6fe-430a-9104-ecb0756aa660 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:54.518487 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4dc6453c-b6fe-430a-9104-ecb0756aa660 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:54.519280 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4dc6453c-b6fe-430a-9104-ecb0756aa660 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:54.520710 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4dc6453c-b6fe-430a-9104-ecb0756aa660 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:54.521469 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4dc6453c-b6fe-430a-9104-ecb0756aa660 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:54.768339 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-617a0355-c7c0-49be-ace4-a8e270d4c01a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:54.770361 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-617a0355-c7c0-49be-ace4-a8e270d4c01a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:54.780288 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-617a0355-c7c0-49be-ace4-a8e270d4c01a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:54.785483 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-617a0355-c7c0-49be-ace4-a8e270d4c01a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:54.786599 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-617a0355-c7c0-49be-ace4-a8e270d4c01a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:54.787255 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-617a0355-c7c0-49be-ace4-a8e270d4c01a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:54.812321 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4dc6453c-b6fe-430a-9104-ecb0756aa660 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:54.822403 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4dc6453c-b6fe-430a-9104-ecb0756aa660 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e" status: 200 len: 1519 microversion: 2.1 time: 0.339046 Jun 10 18:13:54.830277 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2359/4603] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:54 2022] GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e => generated 1519 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:55.144128 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-617a0355-c7c0-49be-ace4-a8e270d4c01a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:55.153534 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-617a0355-c7c0-49be-ace4-a8e270d4c01a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1497 microversion: 2.1 time: 0.390711 Jun 10 18:13:55.154148 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2245/4604] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:54 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1497 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:55.178840 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6d792a82-d98c-4a3f-8807-20cf37903b8e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:13:55.179387 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6d792a82-d98c-4a3f-8807-20cf37903b8e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:55.186400 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6d792a82-d98c-4a3f-8807-20cf37903b8e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:55.186858 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6d792a82-d98c-4a3f-8807-20cf37903b8e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:55.187785 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6d792a82-d98c-4a3f-8807-20cf37903b8e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:55.188512 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6d792a82-d98c-4a3f-8807-20cf37903b8e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:55.216005 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3848509d-6bf0-4ab5-a746-d5f90c085e1f tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:55.216707 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3848509d-6bf0-4ab5-a746-d5f90c085e1f tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 2b41be5a-d334-477b-a99d-a15eb9ecb5b6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:55.227933 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3848509d-6bf0-4ab5-a746-d5f90c085e1f tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:55.231127 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3848509d-6bf0-4ab5-a746-d5f90c085e1f tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:55.234337 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3848509d-6bf0-4ab5-a746-d5f90c085e1f tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:55.237439 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3848509d-6bf0-4ab5-a746-d5f90c085e1f tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:55.264932 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-6d792a82-d98c-4a3f-8807-20cf37903b8e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lazy-loading 'flavor' on Instance uuid 57a377b2-f75e-4a0c-8401-090db42db644 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:13:55.288199 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-6d792a82-d98c-4a3f-8807-20cf37903b8e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] HTTP exception thrown: Cannot 'suspend' instance 57a377b2-f75e-4a0c-8401-090db42db644 while it is in vm_state suspended Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6d792a82-d98c-4a3f-8807-20cf37903b8e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644/action HTTP/1.1 Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 15 Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: {"suspend": {}} Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: exception: Cannot 'suspend' instance 57a377b2-f75e-4a0c-8401-090db42db644 while it is in vm_state suspended Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '57a377b2-f75e-4a0c-8401-090db42db644', 'body': {'suspend': {}}} Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 57a377b2-f75e-4a0c-8401-090db42db644 in vm_state suspended. Cannot suspend while the instance is in this state. Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Jun 10 18:13:55.324509 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 10 18:13:55.329782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 10 18:13:55.329782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 10 18:13:55.329782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 57a377b2-f75e-4a0c-8401-090db42db644 while it is in vm_state suspended Jun 10 18:13:55.329782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:13:55.329782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:13:55.329782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:13:55.329782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:13:55.329782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:13:55.329782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:13:55.329782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:13:55.329782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:13:55.329782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 57a377b2-f75e-4a0c-8401-090db42db644 while it is in vm_state suspended Jun 10 18:13:55.329782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:13:55.335063 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6d792a82-d98c-4a3f-8807-20cf37903b8e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 409 to user: Cannot 'suspend' instance 57a377b2-f75e-4a0c-8401-090db42db644 while it is in vm_state suspended {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:13:55.343089 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6d792a82-d98c-4a3f-8807-20cf37903b8e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "POST /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644/action" status: 409 len: 148 microversion: 2.1 time: 0.165001 Jun 10 18:13:55.343089 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2360/4605] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:13:55 2022] POST /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644/action => generated 148 bytes in 166 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:13:55.364707 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0b934111-d6b0-49f3-9524-dfc41ca722e4 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3c65d30>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:55.739486 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3848509d-6bf0-4ab5-a746-d5f90c085e1f tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:55.752609 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3848509d-6bf0-4ab5-a746-d5f90c085e1f tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/2b41be5a-d334-477b-a99d-a15eb9ecb5b6" status: 200 len: 1324 microversion: 2.1 time: 0.540563 Jun 10 18:13:55.753252 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2246/4606] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:55 2022] GET /compute/v2.1/servers/2b41be5a-d334-477b-a99d-a15eb9ecb5b6 => generated 1324 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:55.766511 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0a0224a0-6121-456f-9b2f-48bea813ed6d tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:55.767275 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0a0224a0-6121-456f-9b2f-48bea813ed6d tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:55.783964 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0a0224a0-6121-456f-9b2f-48bea813ed6d tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:55.784463 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0a0224a0-6121-456f-9b2f-48bea813ed6d tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:55.785256 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0a0224a0-6121-456f-9b2f-48bea813ed6d tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:55.791104 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0a0224a0-6121-456f-9b2f-48bea813ed6d tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:55.935342 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:13:56.014629 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=6 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:13:56.206005 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0a0224a0-6121-456f-9b2f-48bea813ed6d tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:56.228851 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0a0224a0-6121-456f-9b2f-48bea813ed6d tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:56.228851 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0a0224a0-6121-456f-9b2f-48bea813ed6d tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:56.228851 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0a0224a0-6121-456f-9b2f-48bea813ed6d tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1660 microversion: 2.42 time: 0.472345 Jun 10 18:13:56.237807 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2247/4607] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:13:55 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1660 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:13:56.262349 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fe8a92e5-60ca-4211-ac5c-b9f6f983493c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:13:56.263294 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fe8a92e5-60ca-4211-ac5c-b9f6f983493c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:56.302271 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fe8a92e5-60ca-4211-ac5c-b9f6f983493c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:56.305695 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fe8a92e5-60ca-4211-ac5c-b9f6f983493c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:56.309060 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fe8a92e5-60ca-4211-ac5c-b9f6f983493c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:56.311636 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fe8a92e5-60ca-4211-ac5c-b9f6f983493c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:56.734149 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fe8a92e5-60ca-4211-ac5c-b9f6f983493c tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "POST /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644/action" status: 202 len: 0 microversion: 2.1 time: 0.493670 Jun 10 18:13:56.737960 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2248/4608] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:13:56 2022] POST /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644/action => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:13:56.745989 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-0295caca-5279-4882-9afc-cd3f2a72ec68 req-e84311e3-07db-43f9-9bcb-591f29ad2553 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72eaef23-30d6-4755-a9b7-9547856075b3", "name": "network-vif-plugged", "status": "completed", "tag": "777ebce0-6591-4ee2-b139-f87b2964f3fb"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:13:56.772573 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-0295caca-5279-4882-9afc-cd3f2a72ec68 req-e84311e3-07db-43f9-9bcb-591f29ad2553 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:56.785813 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-0295caca-5279-4882-9afc-cd3f2a72ec68 req-e84311e3-07db-43f9-9bcb-591f29ad2553 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:56.824488 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-0295caca-5279-4882-9afc-cd3f2a72ec68 req-e84311e3-07db-43f9-9bcb-591f29ad2553 service nova] Creating event network-vif-plugged:777ebce0-6591-4ee2-b139-f87b2964f3fb for instance 72eaef23-30d6-4755-a9b7-9547856075b3 on chh2-master-2 Jun 10 18:13:56.850234 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-0295caca-5279-4882-9afc-cd3f2a72ec68 req-e84311e3-07db-43f9-9bcb-591f29ad2553 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110112 Jun 10 18:13:56.851026 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2249/4609] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:13:56.859171 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-204f4cd3-ffb0-4fd0-9aa7-962fc57d5cab tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:56.864231 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-204f4cd3-ffb0-4fd0-9aa7-962fc57d5cab tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:56.878382 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-204f4cd3-ffb0-4fd0-9aa7-962fc57d5cab tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:56.884131 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-204f4cd3-ffb0-4fd0-9aa7-962fc57d5cab tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:56.885226 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-204f4cd3-ffb0-4fd0-9aa7-962fc57d5cab tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:56.885849 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-204f4cd3-ffb0-4fd0-9aa7-962fc57d5cab tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:58.104792 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-204f4cd3-ffb0-4fd0-9aa7-962fc57d5cab tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:58.111348 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:13:58.123340 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-204f4cd3-ffb0-4fd0-9aa7-962fc57d5cab tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e" status: 200 len: 1519 microversion: 2.1 time: 1.270378 Jun 10 18:13:58.138458 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2250/4610] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:56 2022] GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e => generated 1519 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:58.138458 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ac61e1ef-ff15-4a1e-8d5d-9a7f8aa78c7b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:58.138458 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ac61e1ef-ff15-4a1e-8d5d-9a7f8aa78c7b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:58.141082 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ac61e1ef-ff15-4a1e-8d5d-9a7f8aa78c7b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:58.141810 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ac61e1ef-ff15-4a1e-8d5d-9a7f8aa78c7b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:58.143584 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ac61e1ef-ff15-4a1e-8d5d-9a7f8aa78c7b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:58.144552 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ac61e1ef-ff15-4a1e-8d5d-9a7f8aa78c7b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:58.723824 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ac61e1ef-ff15-4a1e-8d5d-9a7f8aa78c7b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:58.740393 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ac61e1ef-ff15-4a1e-8d5d-9a7f8aa78c7b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1503 microversion: 2.1 time: 0.614072 Jun 10 18:13:58.745886 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2251/4611] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:58 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1503 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:58.760082 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b2d3aecd-b252-44b4-8bf0-d65556c2cd89 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:58.763082 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b2d3aecd-b252-44b4-8bf0-d65556c2cd89 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 2b41be5a-d334-477b-a99d-a15eb9ecb5b6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:58.776202 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b2d3aecd-b252-44b4-8bf0-d65556c2cd89 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:58.777138 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b2d3aecd-b252-44b4-8bf0-d65556c2cd89 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:58.778295 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b2d3aecd-b252-44b4-8bf0-d65556c2cd89 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:58.779024 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b2d3aecd-b252-44b4-8bf0-d65556c2cd89 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:59.280081 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b2d3aecd-b252-44b4-8bf0-d65556c2cd89 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:59.290206 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b2d3aecd-b252-44b4-8bf0-d65556c2cd89 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/2b41be5a-d334-477b-a99d-a15eb9ecb5b6" status: 200 len: 1520 microversion: 2.1 time: 0.543018 Jun 10 18:13:59.294613 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2252/4612] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:58 2022] GET /compute/v2.1/servers/2b41be5a-d334-477b-a99d-a15eb9ecb5b6 => generated 1520 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:13:59.325007 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-309ece06-9c37-4e7c-acbf-b124de727a56 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:59.331563 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-309ece06-9c37-4e7c-acbf-b124de727a56 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:59.360752 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-309ece06-9c37-4e7c-acbf-b124de727a56 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:59.362869 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-309ece06-9c37-4e7c-acbf-b124de727a56 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:59.365187 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-309ece06-9c37-4e7c-acbf-b124de727a56 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:59.366181 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-309ece06-9c37-4e7c-acbf-b124de727a56 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:59.771808 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-309ece06-9c37-4e7c-acbf-b124de727a56 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:59.786381 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-309ece06-9c37-4e7c-acbf-b124de727a56 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:59.789098 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-309ece06-9c37-4e7c-acbf-b124de727a56 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:13:59.790838 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-309ece06-9c37-4e7c-acbf-b124de727a56 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1706 microversion: 2.42 time: 0.494693 Jun 10 18:13:59.792462 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2253/4613] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:13:59 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1706 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:13:59.799231 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-76f6f545-b07e-41e9-a566-9fb84d9e722f tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:13:59.800140 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-76f6f545-b07e-41e9-a566-9fb84d9e722f tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:13:59.807722 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-76f6f545-b07e-41e9-a566-9fb84d9e722f tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:59.808545 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-76f6f545-b07e-41e9-a566-9fb84d9e722f tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:59.809696 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-76f6f545-b07e-41e9-a566-9fb84d9e722f tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:13:59.810500 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-76f6f545-b07e-41e9-a566-9fb84d9e722f tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:13:59.944094 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=16 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:14:00.043918 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-76f6f545-b07e-41e9-a566-9fb84d9e722f tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:00.047548 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-76f6f545-b07e-41e9-a566-9fb84d9e722f tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e" status: 200 len: 1499 microversion: 2.1 time: 0.253655 Jun 10 18:14:00.050296 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2254/4614] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:13:59 2022] GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e => generated 1499 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:00.055536 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6efda031-96cf-4588-baef-5b2eccfe2539 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:00.056041 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6efda031-96cf-4588-baef-5b2eccfe2539 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 2b41be5a-d334-477b-a99d-a15eb9ecb5b6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:00.062900 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6efda031-96cf-4588-baef-5b2eccfe2539 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:00.063370 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6efda031-96cf-4588-baef-5b2eccfe2539 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:00.064904 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6efda031-96cf-4588-baef-5b2eccfe2539 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:00.065221 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6efda031-96cf-4588-baef-5b2eccfe2539 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:00.100281 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6efda031-96cf-4588-baef-5b2eccfe2539 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 2b41be5a-d334-477b-a99d-a15eb9ecb5b6] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:14:00.519269 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6efda031-96cf-4588-baef-5b2eccfe2539 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "DELETE /compute/v2.1/servers/2b41be5a-d334-477b-a99d-a15eb9ecb5b6" status: 204 len: 0 microversion: 2.1 time: 0.467110 Jun 10 18:14:00.520201 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2255/4615] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:14:00 2022] DELETE /compute/v2.1/servers/2b41be5a-d334-477b-a99d-a15eb9ecb5b6 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:14:00.527134 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4a38afa7-764e-432a-b974-b8f61a58490b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:00.529031 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4a38afa7-764e-432a-b974-b8f61a58490b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:00.554202 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a38afa7-764e-432a-b974-b8f61a58490b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:00.562838 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a38afa7-764e-432a-b974-b8f61a58490b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:00.562838 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a38afa7-764e-432a-b974-b8f61a58490b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:00.562838 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a38afa7-764e-432a-b974-b8f61a58490b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:00.920947 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4a38afa7-764e-432a-b974-b8f61a58490b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:00.933286 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4a38afa7-764e-432a-b974-b8f61a58490b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1503 microversion: 2.1 time: 0.411548 Jun 10 18:14:00.934018 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2256/4616] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:00 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1503 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:00.979520 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3233cc17-610c-46cb-b54d-9d21441e8894 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1f750b7-3981-4332-9546-30550d930ce2"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:14:00.986955 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3233cc17-610c-46cb-b54d-9d21441e8894 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:01.008963 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3233cc17-610c-46cb-b54d-9d21441e8894 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:01.017477 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3233cc17-610c-46cb-b54d-9d21441e8894 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:01.017477 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3233cc17-610c-46cb-b54d-9d21441e8894 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:01.017477 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3233cc17-610c-46cb-b54d-9d21441e8894 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:01.121194 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-3233cc17-610c-46cb-b54d-9d21441e8894 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] HTTP exception thrown: Cannot 'attach_volume' instance b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e while it is in vm_state rescued Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3233cc17-610c-46cb-b54d-9d21441e8894 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Request method failure captured: Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e/os-volume_attachments HTTP/1.1 Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 74 Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4mJVVxHNAdkChvziQm-6Dxnwt9XHWD1Xe5b1Hij0GEvfTbtqXkBFxRnvK3XB7O0DqEYSiSFM3wVQFcGEtNf0ziHJxG92MJ3ikztDB6TtOzEB2x0AYpNNaCzzkfUNZyHohCw21rjVL9kE9UGR_qvtvfAasaLdvNaa6Nct_8khdQAOeU Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 2f3f65ee123043bb9c888cc5adffce37 Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-779166786 Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/2f3f65ee123043bb9c888cc5adffce37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2f3f65ee123043bb9c888cc5adffce37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2f3f65ee123043bb9c888cc5adffce37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_2f3f65ee123043bb9c888cc5adffce37", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServerRescueNegativeTestJSON-779166786 Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 2f3f65ee123043bb9c888cc5adffce37 Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-779166786 Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServerRescueNegativeTestJSON-779166786-project Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 6aa40a915e4e43cd8d493dc593a73028 Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServerRescueNegativeTestJSON-779166786-project Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: {"volumeAttachment": {"volumeId": "b1f750b7-3981-4332-9546-30550d930ce2"}} Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: exception: Cannot 'attach_volume' instance b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e while it is in vm_state rescued Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: action_args: {'server_id': 'b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e', 'body': {'volumeAttachment': {'volumeId': 'b1f750b7-3981-4332-9546-30550d930ce2'}}} Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 10 18:14:01.127150 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 10 18:14:01.132710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 10 18:14:01.132710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 10 18:14:01.132710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e while it is in vm_state rescued Jun 10 18:14:01.132710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:01.132710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:01.132710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:01.132710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:01.132710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:01.132710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:01.132710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:14:01.132710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:14:01.132710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e while it is in vm_state rescued Jun 10 18:14:01.132710 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:01.132710 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3233cc17-610c-46cb-b54d-9d21441e8894 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Returning 409 to user: Cannot 'attach_volume' instance b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e while it is in vm_state rescued {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:14:01.135745 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3233cc17-610c-46cb-b54d-9d21441e8894 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "POST /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.181855 Jun 10 18:14:01.138446 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2257/4617] 10.222.0.35 () {60 vars in 1322 bytes} [Fri Jun 10 18:14:00 2022] POST /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e/os-volume_attachments => generated 152 bytes in 192 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:14:01.145865 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-692df58f-1448-484b-8f0a-597f91207b42 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:01.145865 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-692df58f-1448-484b-8f0a-597f91207b42 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 2b41be5a-d334-477b-a99d-a15eb9ecb5b6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:01.161526 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-692df58f-1448-484b-8f0a-597f91207b42 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:01.161988 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-692df58f-1448-484b-8f0a-597f91207b42 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:01.162791 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-692df58f-1448-484b-8f0a-597f91207b42 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:01.163236 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-692df58f-1448-484b-8f0a-597f91207b42 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:01.451406 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-692df58f-1448-484b-8f0a-597f91207b42 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:01.464789 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-692df58f-1448-484b-8f0a-597f91207b42 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/2b41be5a-d334-477b-a99d-a15eb9ecb5b6" status: 200 len: 1526 microversion: 2.1 time: 0.324901 Jun 10 18:14:01.472071 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2258/4618] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:01 2022] GET /compute/v2.1/servers/2b41be5a-d334-477b-a99d-a15eb9ecb5b6 => generated 1526 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:01.484079 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a1694560-4cc6-485a-ac05-5877515f5a53 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:01.487194 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a1694560-4cc6-485a-ac05-5877515f5a53 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:01.504745 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a1694560-4cc6-485a-ac05-5877515f5a53 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:01.505635 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a1694560-4cc6-485a-ac05-5877515f5a53 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:01.506742 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a1694560-4cc6-485a-ac05-5877515f5a53 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:01.507442 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a1694560-4cc6-485a-ac05-5877515f5a53 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:01.756053 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a1694560-4cc6-485a-ac05-5877515f5a53 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:01.779062 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a1694560-4cc6-485a-ac05-5877515f5a53 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:01.784015 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a1694560-4cc6-485a-ac05-5877515f5a53 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:01.786890 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a1694560-4cc6-485a-ac05-5877515f5a53 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1752 microversion: 2.42 time: 0.312677 Jun 10 18:14:01.788184 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2259/4619] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:14:01 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1752 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:14:01.793696 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-eda6d203-07ac-4cf3-956d-5a5edb6bf012 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:14:01.794558 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-eda6d203-07ac-4cf3-956d-5a5edb6bf012 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:01.802223 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eda6d203-07ac-4cf3-956d-5a5edb6bf012 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:01.802691 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eda6d203-07ac-4cf3-956d-5a5edb6bf012 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:01.803792 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eda6d203-07ac-4cf3-956d-5a5edb6bf012 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:01.804557 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eda6d203-07ac-4cf3-956d-5a5edb6bf012 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:02.164904 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-eda6d203-07ac-4cf3-956d-5a5edb6bf012 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "POST /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e/action" status: 202 len: 0 microversion: 2.1 time: 0.375160 Jun 10 18:14:02.168901 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2260/4620] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:14:01 2022] POST /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e/action => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:14:02.190917 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-31a2df3b-24d1-48b5-ae27-3704b7be9dc8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:02.191657 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-31a2df3b-24d1-48b5-ae27-3704b7be9dc8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:02.248775 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-31a2df3b-24d1-48b5-ae27-3704b7be9dc8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:02.249248 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-31a2df3b-24d1-48b5-ae27-3704b7be9dc8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:02.250059 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-31a2df3b-24d1-48b5-ae27-3704b7be9dc8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:02.267557 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-31a2df3b-24d1-48b5-ae27-3704b7be9dc8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:02.676043 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-31a2df3b-24d1-48b5-ae27-3704b7be9dc8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:02.698610 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-31a2df3b-24d1-48b5-ae27-3704b7be9dc8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.529218 Jun 10 18:14:02.699690 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2261/4621] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:02 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:02.711996 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ffe1d8b6-ddeb-4349-b7cd-8cb107de44bc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:02.714856 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ffe1d8b6-ddeb-4349-b7cd-8cb107de44bc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:02.729847 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ffe1d8b6-ddeb-4349-b7cd-8cb107de44bc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:02.733577 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ffe1d8b6-ddeb-4349-b7cd-8cb107de44bc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:02.733577 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ffe1d8b6-ddeb-4349-b7cd-8cb107de44bc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:02.733577 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ffe1d8b6-ddeb-4349-b7cd-8cb107de44bc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:03.828443 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ffe1d8b6-ddeb-4349-b7cd-8cb107de44bc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:03.868439 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ffe1d8b6-ddeb-4349-b7cd-8cb107de44bc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e" status: 200 len: 1507 microversion: 2.1 time: 1.156525 Jun 10 18:14:03.868439 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2262/4622] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:02 2022] GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e => generated 1507 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:03.877230 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9b8794e2-0974-4959-b1ed-2878ab40f914 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:03.879121 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9b8794e2-0974-4959-b1ed-2878ab40f914 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 2b41be5a-d334-477b-a99d-a15eb9ecb5b6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:03.892768 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b8794e2-0974-4959-b1ed-2878ab40f914 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:03.905801 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b8794e2-0974-4959-b1ed-2878ab40f914 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:03.905801 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b8794e2-0974-4959-b1ed-2878ab40f914 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:03.905801 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b8794e2-0974-4959-b1ed-2878ab40f914 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:04.228014 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9b8794e2-0974-4959-b1ed-2878ab40f914 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:04.236968 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9b8794e2-0974-4959-b1ed-2878ab40f914 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/2b41be5a-d334-477b-a99d-a15eb9ecb5b6" status: 200 len: 1484 microversion: 2.1 time: 0.374527 Jun 10 18:14:04.245406 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2263/4623] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:03 2022] GET /compute/v2.1/servers/2b41be5a-d334-477b-a99d-a15eb9ecb5b6 => generated 1484 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:04.262430 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a5998e58-b22d-4b29-bdbe-7fac0fe75cf7 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:04.275061 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a5998e58-b22d-4b29-bdbe-7fac0fe75cf7 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:04.294329 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a5998e58-b22d-4b29-bdbe-7fac0fe75cf7 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:04.295202 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a5998e58-b22d-4b29-bdbe-7fac0fe75cf7 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:04.296246 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a5998e58-b22d-4b29-bdbe-7fac0fe75cf7 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:04.299856 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a5998e58-b22d-4b29-bdbe-7fac0fe75cf7 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:04.810047 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a5998e58-b22d-4b29-bdbe-7fac0fe75cf7 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:04.840890 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a5998e58-b22d-4b29-bdbe-7fac0fe75cf7 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.588222 Jun 10 18:14:04.842200 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2264/4624] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:04 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:04.876269 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-72a18724-d627-4db4-8c26-31a84e7faa7f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:04.885823 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-72a18724-d627-4db4-8c26-31a84e7faa7f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:04.936684 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72a18724-d627-4db4-8c26-31a84e7faa7f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:04.946661 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72a18724-d627-4db4-8c26-31a84e7faa7f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:04.947093 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72a18724-d627-4db4-8c26-31a84e7faa7f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:04.951152 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72a18724-d627-4db4-8c26-31a84e7faa7f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:05.073034 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:14:05.186294 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:14:05.290324 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=79,nova_cell1:INSERT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:14:05.570591 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-72a18724-d627-4db4-8c26-31a84e7faa7f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:05.592897 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-72a18724-d627-4db4-8c26-31a84e7faa7f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:05.592897 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-72a18724-d627-4db4-8c26-31a84e7faa7f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:05.592897 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-72a18724-d627-4db4-8c26-31a84e7faa7f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1844 microversion: 2.42 time: 0.746616 Jun 10 18:14:05.612347 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2265/4625] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:14:04 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1844 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:14:05.617155 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-9ff351f3-4f34-4095-af49-1c1aa7405286 req-7a49ab9e-5610-4519-a5d0-b0fa56a20f10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b41be5a-d334-477b-a99d-a15eb9ecb5b6", "name": "network-vif-deleted", "tag": "9dbf3d0f-8140-40e8-8125-09306b810a6f"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:14:05.674894 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-9ff351f3-4f34-4095-af49-1c1aa7405286 req-7a49ab9e-5610-4519-a5d0-b0fa56a20f10 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:05.675360 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-9ff351f3-4f34-4095-af49-1c1aa7405286 req-7a49ab9e-5610-4519-a5d0-b0fa56a20f10 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:05.706592 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-9ff351f3-4f34-4095-af49-1c1aa7405286 req-7a49ab9e-5610-4519-a5d0-b0fa56a20f10 service nova] Creating event network-vif-deleted:9dbf3d0f-8140-40e8-8125-09306b810a6f for instance 2b41be5a-d334-477b-a99d-a15eb9ecb5b6 on chh1-master-2 Jun 10 18:14:05.770956 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-9ff351f3-4f34-4095-af49-1c1aa7405286 req-7a49ab9e-5610-4519-a5d0-b0fa56a20f10 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152060 Jun 10 18:14:05.770956 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2266/4626] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:14:05.792119 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ff3e2d0a-63fa-48a7-acb3-32cfbd539192 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:14:05.795985 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ff3e2d0a-63fa-48a7-acb3-32cfbd539192 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 40327749-81a8-406d-bf1f-78d91be3bfce] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:05.825621 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-ff3e2d0a-63fa-48a7-acb3-32cfbd539192 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] HTTP exception thrown: Instance 40327749-81a8-406d-bf1f-78d91be3bfce could not be found. Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ff3e2d0a-63fa-48a7-acb3-32cfbd539192 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers/40327749-81a8-406d-bf1f-78d91be3bfce/action HTTP/1.1 Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 15 Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: {"unpause": {}} Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 40327749-81a8-406d-bf1f-78d91be3bfce could not be found. Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '40327749-81a8-406d-bf1f-78d91be3bfce', 'body': {'unpause': {}}} Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40327749-81a8-406d-bf1f-78d91be3bfce could not be found. Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40327749-81a8-406d-bf1f-78d91be3bfce could not be found. Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:05.830053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:05.836021 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:14:05.836021 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:14:05.836021 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40327749-81a8-406d-bf1f-78d91be3bfce could not be found. Jun 10 18:14:05.836021 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:05.842606 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ff3e2d0a-63fa-48a7-acb3-32cfbd539192 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 404 to user: Instance 40327749-81a8-406d-bf1f-78d91be3bfce could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:14:05.844235 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ff3e2d0a-63fa-48a7-acb3-32cfbd539192 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "POST /compute/v2.1/servers/40327749-81a8-406d-bf1f-78d91be3bfce/action" status: 404 len: 111 microversion: 2.1 time: 0.076743 Jun 10 18:14:05.851011 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2267/4627] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:14:05 2022] POST /compute/v2.1/servers/40327749-81a8-406d-bf1f-78d91be3bfce/action => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:14:05.878703 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e5f19c6b-3b8f-40c5-8bad-ef19ccedcc3a tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:05.884456 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e5f19c6b-3b8f-40c5-8bad-ef19ccedcc3a tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:05.924048 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e5f19c6b-3b8f-40c5-8bad-ef19ccedcc3a tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:05.929789 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e5f19c6b-3b8f-40c5-8bad-ef19ccedcc3a tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:05.933947 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e5f19c6b-3b8f-40c5-8bad-ef19ccedcc3a tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:05.937049 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e5f19c6b-3b8f-40c5-8bad-ef19ccedcc3a tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:06.501951 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e5f19c6b-3b8f-40c5-8bad-ef19ccedcc3a tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:06.520106 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e5f19c6b-3b8f-40c5-8bad-ef19ccedcc3a tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e" status: 200 len: 1507 microversion: 2.1 time: 0.662277 Jun 10 18:14:06.520748 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2268/4628] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:05 2022] GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e => generated 1507 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:06.535819 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-04014186-bb0c-46bd-b125-aafa23683637 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:06.538942 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-04014186-bb0c-46bd-b125-aafa23683637 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 2b41be5a-d334-477b-a99d-a15eb9ecb5b6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:06.574952 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-04014186-bb0c-46bd-b125-aafa23683637 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:06.576660 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-04014186-bb0c-46bd-b125-aafa23683637 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:06.578778 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-04014186-bb0c-46bd-b125-aafa23683637 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:06.580155 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-04014186-bb0c-46bd-b125-aafa23683637 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:06.665730 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-04014186-bb0c-46bd-b125-aafa23683637 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:06.667827 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-04014186-bb0c-46bd-b125-aafa23683637 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:06.669364 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-04014186-bb0c-46bd-b125-aafa23683637 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lazy-loading 'fault' on Instance uuid 2b41be5a-d334-477b-a99d-a15eb9ecb5b6 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:14:06.777342 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-04014186-bb0c-46bd-b125-aafa23683637 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e6b5cd42b2144a69590680e5ef156fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ea0e4d347491eb23c3af053313211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:06.804887 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-04014186-bb0c-46bd-b125-aafa23683637 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/2b41be5a-d334-477b-a99d-a15eb9ecb5b6" status: 200 len: 1314 microversion: 2.1 time: 0.280477 Jun 10 18:14:06.805503 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2269/4629] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:06 2022] GET /compute/v2.1/servers/2b41be5a-d334-477b-a99d-a15eb9ecb5b6 => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:06.817241 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5bfc6afb-5a39-4e5e-aa72-a67c73835921 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:06.818284 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5bfc6afb-5a39-4e5e-aa72-a67c73835921 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:06.825695 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5bfc6afb-5a39-4e5e-aa72-a67c73835921 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:06.826411 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5bfc6afb-5a39-4e5e-aa72-a67c73835921 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:06.827372 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5bfc6afb-5a39-4e5e-aa72-a67c73835921 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:06.827987 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5bfc6afb-5a39-4e5e-aa72-a67c73835921 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:07.040970 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5bfc6afb-5a39-4e5e-aa72-a67c73835921 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:07.060288 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5bfc6afb-5a39-4e5e-aa72-a67c73835921 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.250607 Jun 10 18:14:07.065085 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2270/4630] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:06 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:07.072770 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-99ca2e70-a6e3-467e-b20e-592b1e4ca6b6 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:07.072770 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-99ca2e70-a6e3-467e-b20e-592b1e4ca6b6 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:07.108828 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99ca2e70-a6e3-467e-b20e-592b1e4ca6b6 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:07.112180 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99ca2e70-a6e3-467e-b20e-592b1e4ca6b6 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:07.114566 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99ca2e70-a6e3-467e-b20e-592b1e4ca6b6 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:07.116939 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99ca2e70-a6e3-467e-b20e-592b1e4ca6b6 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:07.433588 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-99ca2e70-a6e3-467e-b20e-592b1e4ca6b6 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:07.446112 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-99ca2e70-a6e3-467e-b20e-592b1e4ca6b6 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:07.448607 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-99ca2e70-a6e3-467e-b20e-592b1e4ca6b6 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:07.450379 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-99ca2e70-a6e3-467e-b20e-592b1e4ca6b6 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1844 microversion: 2.42 time: 0.384038 Jun 10 18:14:07.459658 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2271/4631] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:14:07 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1844 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:14:07.482265 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c579a545-5922-4815-a7ad-85983342d1e8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:07.485618 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c579a545-5922-4815-a7ad-85983342d1e8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:07.500943 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c579a545-5922-4815-a7ad-85983342d1e8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:07.501527 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c579a545-5922-4815-a7ad-85983342d1e8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:07.504182 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c579a545-5922-4815-a7ad-85983342d1e8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:07.506649 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c579a545-5922-4815-a7ad-85983342d1e8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:07.725559 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c579a545-5922-4815-a7ad-85983342d1e8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:07.734519 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c579a545-5922-4815-a7ad-85983342d1e8 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.273597 Jun 10 18:14:07.746556 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2272/4632] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:07 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:07.751719 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-87d7a8cb-087c-4e11-b080-a17e07424567 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:07.752533 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-87d7a8cb-087c-4e11-b080-a17e07424567 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:07.760115 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-87d7a8cb-087c-4e11-b080-a17e07424567 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:07.763331 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-87d7a8cb-087c-4e11-b080-a17e07424567 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:07.763331 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-87d7a8cb-087c-4e11-b080-a17e07424567 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:07.763331 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-87d7a8cb-087c-4e11-b080-a17e07424567 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:07.985512 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-87d7a8cb-087c-4e11-b080-a17e07424567 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:07.994588 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-87d7a8cb-087c-4e11-b080-a17e07424567 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e" status: 200 len: 1513 microversion: 2.1 time: 0.246714 Jun 10 18:14:07.996560 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2273/4633] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:07 2022] GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e => generated 1513 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:08.002267 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a03ca91d-996e-4756-8793-461fc20435b2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:14:08.003033 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a03ca91d-996e-4756-8793-461fc20435b2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:08.029756 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a03ca91d-996e-4756-8793-461fc20435b2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:08.030505 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a03ca91d-996e-4756-8793-461fc20435b2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:08.033021 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a03ca91d-996e-4756-8793-461fc20435b2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:08.034697 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a03ca91d-996e-4756-8793-461fc20435b2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:08.121330 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-a03ca91d-996e-4756-8793-461fc20435b2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] HTTP exception thrown: Cannot 'unpause' instance 57a377b2-f75e-4a0c-8401-090db42db644 while it is in vm_state active Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a03ca91d-996e-4756-8793-461fc20435b2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644/action HTTP/1.1 Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 15 Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: {"unpause": {}} Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: exception: Cannot 'unpause' instance 57a377b2-f75e-4a0c-8401-090db42db644 while it is in vm_state active Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '57a377b2-f75e-4a0c-8401-090db42db644', 'body': {'unpause': {}}} Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 57a377b2-f75e-4a0c-8401-090db42db644 in vm_state active. Cannot unpause while the instance is in this state. Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 57a377b2-f75e-4a0c-8401-090db42db644 while it is in vm_state active Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:08.127136 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:08.132861 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:08.132861 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:14:08.132861 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:14:08.132861 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 57a377b2-f75e-4a0c-8401-090db42db644 while it is in vm_state active Jun 10 18:14:08.132861 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:08.142501 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a03ca91d-996e-4756-8793-461fc20435b2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 409 to user: Cannot 'unpause' instance 57a377b2-f75e-4a0c-8401-090db42db644 while it is in vm_state active {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:14:08.145127 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a03ca91d-996e-4756-8793-461fc20435b2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "POST /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644/action" status: 409 len: 145 microversion: 2.1 time: 0.147331 Jun 10 18:14:08.149533 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2274/4634] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:14:07 2022] POST /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644/action => generated 145 bytes in 150 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:14:08.159664 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-525d4078-3cea-47e5-99d5-dce35eac8f11 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:08.160949 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-525d4078-3cea-47e5-99d5-dce35eac8f11 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 2b41be5a-d334-477b-a99d-a15eb9ecb5b6] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:08.188191 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-525d4078-3cea-47e5-99d5-dce35eac8f11 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:08.201773 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-525d4078-3cea-47e5-99d5-dce35eac8f11 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:08.201773 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-525d4078-3cea-47e5-99d5-dce35eac8f11 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:08.201773 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-525d4078-3cea-47e5-99d5-dce35eac8f11 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:08.240294 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-525d4078-3cea-47e5-99d5-dce35eac8f11 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] HTTP exception thrown: Instance 2b41be5a-d334-477b-a99d-a15eb9ecb5b6 could not be found. Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-525d4078-3cea-47e5-99d5-dce35eac8f11 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Request method failure captured: Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/2b41be5a-d334-477b-a99d-a15eb9ecb5b6 HTTP/1.1 Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4lsfzX-ZssLhBeRERA250Allr9sy5j_9WvmWWrmV8OKGfGLWtKo7IkZmvrlgadYYrKiCJiGv3V0W6WUpTPzvczOtcJBE7CxOiD9g_bSlYjPmyz5JBO2nqOTXPUSYGg7_D3Rbko1iq-cS8Cxtg3C-XqYzZtQdMv47S3ncw5oU530j6g Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: dc6ea0e4d347491eb23c3af053313211 Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-582167706 Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/dc6ea0e4d347491eb23c3af053313211"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/dc6ea0e4d347491eb23c3af053313211"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/dc6ea0e4d347491eb23c3af053313211"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_dc6ea0e4d347491eb23c3af053313211", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-582167706 Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: dc6ea0e4d347491eb23c3af053313211 Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-582167706 Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ImagesOneServerNegativeTestJSON-582167706-project Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 8e6b5cd42b2144a69590680e5ef156fa Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-582167706-project Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 2b41be5a-d334-477b-a99d-a15eb9ecb5b6 could not be found. Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '2b41be5a-d334-477b-a99d-a15eb9ecb5b6'} Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b41be5a-d334-477b-a99d-a15eb9ecb5b6 could not be found. Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b41be5a-d334-477b-a99d-a15eb9ecb5b6 could not be found. Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:08.242695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:08.253323 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:08.253323 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:08.253323 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:08.253323 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:08.253323 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:14:08.253323 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:14:08.253323 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b41be5a-d334-477b-a99d-a15eb9ecb5b6 could not be found. Jun 10 18:14:08.253323 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:08.253323 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-525d4078-3cea-47e5-99d5-dce35eac8f11 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Returning 404 to user: Instance 2b41be5a-d334-477b-a99d-a15eb9ecb5b6 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:14:08.253323 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-525d4078-3cea-47e5-99d5-dce35eac8f11 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/2b41be5a-d334-477b-a99d-a15eb9ecb5b6" status: 404 len: 111 microversion: 2.1 time: 0.095163 Jun 10 18:14:08.258872 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2275/4635] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:08 2022] GET /compute/v2.1/servers/2b41be5a-d334-477b-a99d-a15eb9ecb5b6 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:14:08.269134 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6ec4784d-d59a-4c63-a0c6-46e7d262e41b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:08.270706 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6ec4784d-d59a-4c63-a0c6-46e7d262e41b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:08.284046 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6ec4784d-d59a-4c63-a0c6-46e7d262e41b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:08.287455 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6ec4784d-d59a-4c63-a0c6-46e7d262e41b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:08.290133 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6ec4784d-d59a-4c63-a0c6-46e7d262e41b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:08.290796 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6ec4784d-d59a-4c63-a0c6-46e7d262e41b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:08.800721 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6ec4784d-d59a-4c63-a0c6-46e7d262e41b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:08.813521 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6ec4784d-d59a-4c63-a0c6-46e7d262e41b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.552288 Jun 10 18:14:08.820666 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2276/4636] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:08 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:08.834180 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-24048a94-2b2a-49ba-8bbd-7c5f77ce47aa tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '.version_select at 0x7f77c610ce50>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:11.244356 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0b934111-d6b0-49f3-9524-dfc41ca722e4 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/63662839-4647-44e5-8390-303920cc5c18" status: 200 len: 1451 microversion: 2.1 time: 15.897113 Jun 10 18:14:11.245364 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2361/4637] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:13:55 2022] GET /compute/v2.1/images/63662839-4647-44e5-8390-303920cc5c18 => generated 1451 bytes in 15905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:11.260361 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-06d21c6f-5255-455c-87a0-faa6527b81b3 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:11.263115 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-06d21c6f-5255-455c-87a0-faa6527b81b3 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:11.275827 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-06d21c6f-5255-455c-87a0-faa6527b81b3 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:11.283709 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-24048a94-2b2a-49ba-8bbd-7c5f77ce47aa tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] HTTP exception thrown: Image not found. Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-24048a94-2b2a-49ba-8bbd-7c5f77ce47aa tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Request method failure captured: Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/images/4867bcde-9417-4a41-b013-b5991d4d5d2b HTTP/1.1 Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4lsfzX-ZssLhBeRERA250Allr9sy5j_9WvmWWrmV8OKGfGLWtKo7IkZmvrlgadYYrKiCJiGv3V0W6WUpTPzvczOtcJBE7CxOiD9g_bSlYjPmyz5JBO2nqOTXPUSYGg7_D3Rbko1iq-cS8Cxtg3C-XqYzZtQdMv47S3ncw5oU530j6g Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: dc6ea0e4d347491eb23c3af053313211 Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-582167706 Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/dc6ea0e4d347491eb23c3af053313211"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/dc6ea0e4d347491eb23c3af053313211"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/dc6ea0e4d347491eb23c3af053313211"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_dc6ea0e4d347491eb23c3af053313211", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-582167706 Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: dc6ea0e4d347491eb23c3af053313211 Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-582167706 Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ImagesOneServerNegativeTestJSON-582167706-project Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 8e6b5cd42b2144a69590680e5ef156fa Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-582167706-project Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: exception: Image not found. Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '4867bcde-9417-4a41-b013-b5991d4d5d2b'} Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4867bcde-9417-4a41-b013-b5991d4d5d2b to delete Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4867bcde-9417-4a41-b013-b5991d4d5d2b could not be found. Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:11.288423 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:11.294764 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:11.294764 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:11.294764 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:11.294764 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:14:11.294764 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:14:11.294764 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:14:11.294764 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:14:11.294764 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:14:11.294764 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:14:11.294764 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 10 18:14:11.294764 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 10 18:14:11.294764 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 10 18:14:11.294764 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:11.294764 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:11.294764 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:11.294764 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:11.294764 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:11.294764 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:11.294764 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:14:11.294764 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:14:11.294764 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 10 18:14:11.294764 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:11.294764 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-24048a94-2b2a-49ba-8bbd-7c5f77ce47aa tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Returning 404 to user: Image not found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:14:11.294764 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-24048a94-2b2a-49ba-8bbd-7c5f77ce47aa tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "DELETE /compute/v2.1/images/4867bcde-9417-4a41-b013-b5991d4d5d2b" status: 404 len: 62 microversion: 2.1 time: 2.463766 Jun 10 18:14:11.303385 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2277/4638] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:08 2022] DELETE /compute/v2.1/images/4867bcde-9417-4a41-b013-b5991d4d5d2b => generated 62 bytes in 2482 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:14:11.306182 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-06d21c6f-5255-455c-87a0-faa6527b81b3 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:11.311449 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-06d21c6f-5255-455c-87a0-faa6527b81b3 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:11.311449 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-06d21c6f-5255-455c-87a0-faa6527b81b3 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:11.316756 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c4b2167c-b9b8-4ccd-84b9-54d9e2c17629 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:11.320151 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c4b2167c-b9b8-4ccd-84b9-54d9e2c17629 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:11.333794 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c4b2167c-b9b8-4ccd-84b9-54d9e2c17629 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:11.334719 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c4b2167c-b9b8-4ccd-84b9-54d9e2c17629 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:11.358006 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c4b2167c-b9b8-4ccd-84b9-54d9e2c17629 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:11.358871 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c4b2167c-b9b8-4ccd-84b9-54d9e2c17629 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:11.655895 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-06d21c6f-5255-455c-87a0-faa6527b81b3 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:11.677418 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-06d21c6f-5255-455c-87a0-faa6527b81b3 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:11.677418 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-06d21c6f-5255-455c-87a0-faa6527b81b3 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:11.677418 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-06d21c6f-5255-455c-87a0-faa6527b81b3 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1865 microversion: 2.42 time: 0.430423 Jun 10 18:14:11.689054 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2362/4639] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:14:11 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1865 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:14:11.691076 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-dd442153-e9d8-4f21-901c-a77e5fc5aa77 req-a434f59a-696e-4626-8d69-d8f5f19500c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ceaaf7b-0972-4fe5-bd63-5534a71f80d3", "tag": "67581347-173d-48a0-b450-4ad516d4f8af"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:14:11.710341 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-dd442153-e9d8-4f21-901c-a77e5fc5aa77 req-a434f59a-696e-4626-8d69-d8f5f19500c4 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:11.710792 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-dd442153-e9d8-4f21-901c-a77e5fc5aa77 req-a434f59a-696e-4626-8d69-d8f5f19500c4 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:11.744538 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-dd442153-e9d8-4f21-901c-a77e5fc5aa77 req-a434f59a-696e-4626-8d69-d8f5f19500c4 service nova] Creating event network-changed:67581347-173d-48a0-b450-4ad516d4f8af for instance 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 on chh2-master-2 Jun 10 18:14:11.750499 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-dd442153-e9d8-4f21-901c-a77e5fc5aa77 req-a434f59a-696e-4626-8d69-d8f5f19500c4 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063023 Jun 10 18:14:11.751163 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2363/4640] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:14:11.775064 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9f9392cf-ef8f-4372-bc48-5304066557cc tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:11.775675 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9f9392cf-ef8f-4372-bc48-5304066557cc tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 551856e9-a45b-412d-979d-b14039d74fea] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:11.810245 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9f9392cf-ef8f-4372-bc48-5304066557cc tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:11.810706 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9f9392cf-ef8f-4372-bc48-5304066557cc tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:11.811496 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9f9392cf-ef8f-4372-bc48-5304066557cc tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:11.811935 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9f9392cf-ef8f-4372-bc48-5304066557cc tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:11.850203 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-9f9392cf-ef8f-4372-bc48-5304066557cc tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] HTTP exception thrown: Instance 551856e9-a45b-412d-979d-b14039d74fea could not be found. Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9f9392cf-ef8f-4372-bc48-5304066557cc tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Request method failure captured: Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: request: DELETE /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea HTTP/1.1 Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4lsfzX-ZssLhBeRERA250Allr9sy5j_9WvmWWrmV8OKGfGLWtKo7IkZmvrlgadYYrKiCJiGv3V0W6WUpTPzvczOtcJBE7CxOiD9g_bSlYjPmyz5JBO2nqOTXPUSYGg7_D3Rbko1iq-cS8Cxtg3C-XqYzZtQdMv47S3ncw5oU530j6g Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: dc6ea0e4d347491eb23c3af053313211 Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-582167706 Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/dc6ea0e4d347491eb23c3af053313211"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/dc6ea0e4d347491eb23c3af053313211"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/dc6ea0e4d347491eb23c3af053313211"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_dc6ea0e4d347491eb23c3af053313211", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-582167706 Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: dc6ea0e4d347491eb23c3af053313211 Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-582167706 Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ImagesOneServerNegativeTestJSON-582167706-project Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 8e6b5cd42b2144a69590680e5ef156fa Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-582167706-project Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 551856e9-a45b-412d-979d-b14039d74fea could not be found. Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '551856e9-a45b-412d-979d-b14039d74fea'} Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 551856e9-a45b-412d-979d-b14039d74fea could not be found. Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:14:11.852146 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:14:11.856665 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 551856e9-a45b-412d-979d-b14039d74fea could not be found. Jun 10 18:14:11.856665 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:14:11.856665 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:11.856665 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:14:11.856665 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:11.856665 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:11.856665 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:11.856665 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:14:11.856665 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:14:11.856665 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 551856e9-a45b-412d-979d-b14039d74fea could not be found. Jun 10 18:14:11.856665 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:14:11.856665 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9f9392cf-ef8f-4372-bc48-5304066557cc tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Returning 404 to user: Instance 551856e9-a45b-412d-979d-b14039d74fea could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:14:11.856665 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9f9392cf-ef8f-4372-bc48-5304066557cc tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "DELETE /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea" status: 404 len: 111 microversion: 2.1 time: 0.099255 Jun 10 18:14:11.856665 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2364/4641] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:14:11 2022] DELETE /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:14:11.866591 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c75ac0f6-6a58-49a9-ab12-3cc0e195bbdb tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:11.867595 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c75ac0f6-6a58-49a9-ab12-3cc0e195bbdb tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 551856e9-a45b-412d-979d-b14039d74fea] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:11.887334 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c75ac0f6-6a58-49a9-ab12-3cc0e195bbdb tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:11.888056 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c75ac0f6-6a58-49a9-ab12-3cc0e195bbdb tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:11.889238 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c75ac0f6-6a58-49a9-ab12-3cc0e195bbdb tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:11.898124 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c75ac0f6-6a58-49a9-ab12-3cc0e195bbdb tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:11.937833 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-c75ac0f6-6a58-49a9-ab12-3cc0e195bbdb tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] HTTP exception thrown: Instance 551856e9-a45b-412d-979d-b14039d74fea could not be found. Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c75ac0f6-6a58-49a9-ab12-3cc0e195bbdb tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Request method failure captured: Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea HTTP/1.1 Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4lsfzX-ZssLhBeRERA250Allr9sy5j_9WvmWWrmV8OKGfGLWtKo7IkZmvrlgadYYrKiCJiGv3V0W6WUpTPzvczOtcJBE7CxOiD9g_bSlYjPmyz5JBO2nqOTXPUSYGg7_D3Rbko1iq-cS8Cxtg3C-XqYzZtQdMv47S3ncw5oU530j6g Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: dc6ea0e4d347491eb23c3af053313211 Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-582167706 Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/dc6ea0e4d347491eb23c3af053313211"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/dc6ea0e4d347491eb23c3af053313211"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/dc6ea0e4d347491eb23c3af053313211"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_dc6ea0e4d347491eb23c3af053313211", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-582167706 Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: dc6ea0e4d347491eb23c3af053313211 Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-582167706 Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ImagesOneServerNegativeTestJSON-582167706-project Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 8e6b5cd42b2144a69590680e5ef156fa Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-582167706-project Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 551856e9-a45b-412d-979d-b14039d74fea could not be found. Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '551856e9-a45b-412d-979d-b14039d74fea'} Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 551856e9-a45b-412d-979d-b14039d74fea could not be found. Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 551856e9-a45b-412d-979d-b14039d74fea could not be found. Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:14:11.940570 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:11.946955 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:14:11.946955 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:11.946955 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:11.946955 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:11.946955 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:14:11.946955 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:14:11.946955 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 551856e9-a45b-412d-979d-b14039d74fea could not be found. Jun 10 18:14:11.946955 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:14:11.950830 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c75ac0f6-6a58-49a9-ab12-3cc0e195bbdb tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Returning 404 to user: Instance 551856e9-a45b-412d-979d-b14039d74fea could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:14:11.952918 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c75ac0f6-6a58-49a9-ab12-3cc0e195bbdb tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea" status: 404 len: 111 microversion: 2.1 time: 0.090177 Jun 10 18:14:11.963855 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2365/4642] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:11 2022] GET /compute/v2.1/servers/551856e9-a45b-412d-979d-b14039d74fea => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:14:11.971077 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a714212d-9aec-43c4-bb65-50588d9919b8 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '.version_select at 0x7f77b3a4a430>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:12.032830 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c4b2167c-b9b8-4ccd-84b9-54d9e2c17629 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:12.044176 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c4b2167c-b9b8-4ccd-84b9-54d9e2c17629 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.738452 Jun 10 18:14:12.053129 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2278/4643] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:11 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:12.068430 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a714212d-9aec-43c4-bb65-50588d9919b8 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-910344317" status: 202 len: 0 microversion: 2.1 time: 0.102356 Jun 10 18:14:12.070276 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0bdff1c2-3c34-403e-83df-bf8caea97db6 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:14:12.071096 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0bdff1c2-3c34-403e-83df-bf8caea97db6 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: a9e9a0d9-eccf-4e47-b077-a96e63b7a600] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:12.072708 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2366/4644] 10.222.0.35 () {58 vars in 1217 bytes} [Fri Jun 10 18:14:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-910344317 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:14:12.087989 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-0bdff1c2-3c34-403e-83df-bf8caea97db6 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] HTTP exception thrown: Instance a9e9a0d9-eccf-4e47-b077-a96e63b7a600 could not be found. Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0bdff1c2-3c34-403e-83df-bf8caea97db6 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers/a9e9a0d9-eccf-4e47-b077-a96e63b7a600/action HTTP/1.1 Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 18 Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: {"unshelve": null} Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: exception: Instance a9e9a0d9-eccf-4e47-b077-a96e63b7a600 could not be found. Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'a9e9a0d9-eccf-4e47-b077-a96e63b7a600', 'body': {'unshelve': None}} Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9e9a0d9-eccf-4e47-b077-a96e63b7a600 could not be found. Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 94, in _unshelve Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9e9a0d9-eccf-4e47-b077-a96e63b7a600 could not be found. Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:12.090865 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:12.096479 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:12.096479 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:12.096479 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:14:12.096479 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:14:12.096479 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9e9a0d9-eccf-4e47-b077-a96e63b7a600 could not be found. Jun 10 18:14:12.096479 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:12.098849 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0bdff1c2-3c34-403e-83df-bf8caea97db6 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 404 to user: Instance a9e9a0d9-eccf-4e47-b077-a96e63b7a600 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:14:12.099982 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0bdff1c2-3c34-403e-83df-bf8caea97db6 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "POST /compute/v2.1/servers/a9e9a0d9-eccf-4e47-b077-a96e63b7a600/action" status: 404 len: 111 microversion: 2.1 time: 0.034518 Jun 10 18:14:12.109928 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2279/4645] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:14:12 2022] POST /compute/v2.1/servers/a9e9a0d9-eccf-4e47-b077-a96e63b7a600/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:14:12.110463 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-76b3537b-14b5-4f43-9138-7bf4bde53aee tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:12.111193 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-76b3537b-14b5-4f43-9138-7bf4bde53aee tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:12.123969 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-76b3537b-14b5-4f43-9138-7bf4bde53aee tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:12.124458 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-76b3537b-14b5-4f43-9138-7bf4bde53aee tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:12.125262 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-76b3537b-14b5-4f43-9138-7bf4bde53aee tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:12.129112 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-76b3537b-14b5-4f43-9138-7bf4bde53aee tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:12.262139 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8900ad6c-f806-49a9-a5ce-19b0b68fe3f9 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c03b2ee0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:12.344292 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8900ad6c-f806-49a9-a5ce-19b0b68fe3f9 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/63662839-4647-44e5-8390-303920cc5c18" status: 200 len: 1451 microversion: 2.1 time: 0.090824 Jun 10 18:14:12.345367 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2280/4646] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:14:12 2022] GET /compute/v2.1/images/63662839-4647-44e5-8390-303920cc5c18 => generated 1451 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:14:12.359023 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4a565ce5-2869-4c2b-8bf7-ab4cca3684fa tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Action: 'create', calling method: .version_select at 0x7f77c610c4c0>, body: {"keypair": {"name": "tempest-keypair-768287569", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOmpKdZ53hdaHzKa+V4NP4wxeLRR6G33NyNRL80JCJh8xREdXB5g+ogwsiv7zmt/UZvzU72zIbSPGyWvEU8SG1hkXRRrBHR0nTrRBDBXsrImHmVtgbEeM+OQeacTNSOZmg=="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:14:12.451569 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-4a565ce5-2869-4c2b-8bf7-ab4cca3684fa tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Getting quotas for project 2f3f65ee123043bb9c888cc5adffce37. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:14:12.474589 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-4a565ce5-2869-4c2b-8bf7-ab4cca3684fa tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Getting quotas for user 6aa40a915e4e43cd8d493dc593a73028 and project 2f3f65ee123043bb9c888cc5adffce37. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:14:12.618758 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-76b3537b-14b5-4f43-9138-7bf4bde53aee tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:12.628295 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-76b3537b-14b5-4f43-9138-7bf4bde53aee tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.522810 Jun 10 18:14:12.632416 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2367/4647] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:12 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:14:12.649903 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-791e15a0-5907-4a9d-970e-ca608e6c46c6 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:12.651049 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-791e15a0-5907-4a9d-970e-ca608e6c46c6 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:12.661949 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4a565ce5-2869-4c2b-8bf7-ab4cca3684fa tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.311227 Jun 10 18:14:12.666435 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2281/4648] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 18:14:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:14:12.667048 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-791e15a0-5907-4a9d-970e-ca608e6c46c6 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:12.667712 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-791e15a0-5907-4a9d-970e-ca608e6c46c6 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:12.669145 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-791e15a0-5907-4a9d-970e-ca608e6c46c6 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:12.670968 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-791e15a0-5907-4a9d-970e-ca608e6c46c6 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:12.698945 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-99fe3a7d-104f-49e3-8915-1c9ab46b2329 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:12.699828 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-99fe3a7d-104f-49e3-8915-1c9ab46b2329 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:12.718140 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:14:12.731717 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99fe3a7d-104f-49e3-8915-1c9ab46b2329 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:12.733909 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99fe3a7d-104f-49e3-8915-1c9ab46b2329 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:12.739321 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99fe3a7d-104f-49e3-8915-1c9ab46b2329 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:12.743692 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99fe3a7d-104f-49e3-8915-1c9ab46b2329 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:13.286963 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-99fe3a7d-104f-49e3-8915-1c9ab46b2329 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:13.297392 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-99fe3a7d-104f-49e3-8915-1c9ab46b2329 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:13.306428 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-99fe3a7d-104f-49e3-8915-1c9ab46b2329 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:13.309000 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-99fe3a7d-104f-49e3-8915-1c9ab46b2329 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1865 microversion: 2.42 time: 0.616141 Jun 10 18:14:13.311409 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2282/4649] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:14:12 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1865 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:14:13.363549 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-39d09d30-6f75-4eaa-ae0d-bc4286800712 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c03cd5e0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:13.457028 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-39d09d30-6f75-4eaa-ae0d-bc4286800712 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/63662839-4647-44e5-8390-303920cc5c18" status: 200 len: 1451 microversion: 2.1 time: 0.099812 Jun 10 18:14:13.457645 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2283/4650] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:14:13 2022] GET /compute/v2.1/images/63662839-4647-44e5-8390-303920cc5c18 => generated 1451 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:13.561269 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-791e15a0-5907-4a9d-970e-ca608e6c46c6 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:13.573325 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-791e15a0-5907-4a9d-970e-ca608e6c46c6 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.927404 Jun 10 18:14:13.573998 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2368/4651] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:12 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:14:13.593298 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-92fe6ea2-820b-4f95-9007-738db8c2fc03 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:14:13.594177 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-92fe6ea2-820b-4f95-9007-738db8c2fc03 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:13.606068 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-92fe6ea2-820b-4f95-9007-738db8c2fc03 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:13.607702 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-92fe6ea2-820b-4f95-9007-738db8c2fc03 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:13.621450 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-92fe6ea2-820b-4f95-9007-738db8c2fc03 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:13.627886 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-92fe6ea2-820b-4f95-9007-738db8c2fc03 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:13.719276 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-92fe6ea2-820b-4f95-9007-738db8c2fc03 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] HTTP exception thrown: Cannot 'unshelve' instance 57a377b2-f75e-4a0c-8401-090db42db644 while it is in vm_state active Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-92fe6ea2-820b-4f95-9007-738db8c2fc03 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644/action HTTP/1.1 Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 18 Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: {"unshelve": null} Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: exception: Cannot 'unshelve' instance 57a377b2-f75e-4a0c-8401-090db42db644 while it is in vm_state active Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '57a377b2-f75e-4a0c-8401-090db42db644', 'body': {'unshelve': None}} Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 105, in _unshelve Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve(context, instance, new_az=new_az) Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 57a377b2-f75e-4a0c-8401-090db42db644 in vm_state active. Cannot unshelve while the instance is in this state. Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 111, in _unshelve Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 10 18:14:13.730053 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 57a377b2-f75e-4a0c-8401-090db42db644 while it is in vm_state active Jun 10 18:14:13.737049 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:13.737049 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:13.737049 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:13.737049 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:13.737049 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:13.737049 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:13.737049 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:14:13.737049 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:14:13.737049 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 57a377b2-f75e-4a0c-8401-090db42db644 while it is in vm_state active Jun 10 18:14:13.737049 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:13.749277 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-92fe6ea2-820b-4f95-9007-738db8c2fc03 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 409 to user: Cannot 'unshelve' instance 57a377b2-f75e-4a0c-8401-090db42db644 while it is in vm_state active {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:14:13.750525 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-92fe6ea2-820b-4f95-9007-738db8c2fc03 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "POST /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644/action" status: 409 len: 146 microversion: 2.1 time: 0.161438 Jun 10 18:14:13.761823 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2284/4652] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:14:13 2022] POST /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644/action => generated 146 bytes in 173 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:14:13.770674 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-dbf5d801-3dfd-4a76-854d-a57c49a6df1a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:13.771299 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-dbf5d801-3dfd-4a76-854d-a57c49a6df1a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:13.787819 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dbf5d801-3dfd-4a76-854d-a57c49a6df1a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:13.787819 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dbf5d801-3dfd-4a76-854d-a57c49a6df1a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:13.787819 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dbf5d801-3dfd-4a76-854d-a57c49a6df1a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:13.787819 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dbf5d801-3dfd-4a76-854d-a57c49a6df1a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:13.871856 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-fb15d1fc-6004-4fa7-a900-55dd2a22e501 req-ec90fb17-d202-4f30-a7e3-a633ced56d70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ceaaf7b-0972-4fe5-bd63-5534a71f80d3", "tag": "dc174283-6e08-4d60-9f00-a5de6cfc1f16"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:14:13.882413 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-fb15d1fc-6004-4fa7-a900-55dd2a22e501 req-ec90fb17-d202-4f30-a7e3-a633ced56d70 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:13.882873 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-fb15d1fc-6004-4fa7-a900-55dd2a22e501 req-ec90fb17-d202-4f30-a7e3-a633ced56d70 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:13.929023 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-fb15d1fc-6004-4fa7-a900-55dd2a22e501 req-ec90fb17-d202-4f30-a7e3-a633ced56d70 service nova] Creating event network-changed:dc174283-6e08-4d60-9f00-a5de6cfc1f16 for instance 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 on chh2-master-2 Jun 10 18:14:13.944776 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-fb15d1fc-6004-4fa7-a900-55dd2a22e501 req-ec90fb17-d202-4f30-a7e3-a633ced56d70 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075745 Jun 10 18:14:13.945903 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2285/4653] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:14:14.330407 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0992420c-c4c4-4246-ad84-6b0925c9a4b5 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:14.331120 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0992420c-c4c4-4246-ad84-6b0925c9a4b5 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:14.346636 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0992420c-c4c4-4246-ad84-6b0925c9a4b5 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:14.347095 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0992420c-c4c4-4246-ad84-6b0925c9a4b5 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:14.348095 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0992420c-c4c4-4246-ad84-6b0925c9a4b5 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:14.358088 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0992420c-c4c4-4246-ad84-6b0925c9a4b5 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:15.340536 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-dbf5d801-3dfd-4a76-854d-a57c49a6df1a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:15.348760 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-dbf5d801-3dfd-4a76-854d-a57c49a6df1a tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 1.582645 Jun 10 18:14:15.353566 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2369/4654] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:13 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:15.374025 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-38de4bbc-6209-41c2-88c8-5c0809972659 req-d56241ee-2bce-40bb-965d-5098b1d2dbc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ceaaf7b-0972-4fe5-bd63-5534a71f80d3", "tag": "bfc7ec9b-4f8d-4dcb-8a97-a81d140faa36"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:14:15.395183 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-38de4bbc-6209-41c2-88c8-5c0809972659 req-d56241ee-2bce-40bb-965d-5098b1d2dbc6 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:15.396048 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-38de4bbc-6209-41c2-88c8-5c0809972659 req-d56241ee-2bce-40bb-965d-5098b1d2dbc6 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:15.434583 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-38de4bbc-6209-41c2-88c8-5c0809972659 req-d56241ee-2bce-40bb-965d-5098b1d2dbc6 service nova] Creating event network-changed:bfc7ec9b-4f8d-4dcb-8a97-a81d140faa36 for instance 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 on chh2-master-2 Jun 10 18:14:15.448073 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-38de4bbc-6209-41c2-88c8-5c0809972659 req-d56241ee-2bce-40bb-965d-5098b1d2dbc6 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092187 Jun 10 18:14:15.450691 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2370/4655] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:14:15.455359 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-41e90821-76a5-4982-8f20-9cee151747ba tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3a65dc0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:15.534780 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-41e90821-76a5-4982-8f20-9cee151747ba tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/63662839-4647-44e5-8390-303920cc5c18" status: 200 len: 1451 microversion: 2.1 time: 0.084390 Jun 10 18:14:15.535630 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2371/4656] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:14:15 2022] GET /compute/v2.1/images/63662839-4647-44e5-8390-303920cc5c18 => generated 1451 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:15.547503 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8149454a-8999-4b93-a4e7-84c0662bd98b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:15.563766 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8149454a-8999-4b93-a4e7-84c0662bd98b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:15.577025 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8149454a-8999-4b93-a4e7-84c0662bd98b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:15.582818 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8149454a-8999-4b93-a4e7-84c0662bd98b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:15.593756 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8149454a-8999-4b93-a4e7-84c0662bd98b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:15.594530 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8149454a-8999-4b93-a4e7-84c0662bd98b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:15.762707 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0992420c-c4c4-4246-ad84-6b0925c9a4b5 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:15.775312 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0992420c-c4c4-4246-ad84-6b0925c9a4b5 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:15.778233 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0992420c-c4c4-4246-ad84-6b0925c9a4b5 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:15.780216 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0992420c-c4c4-4246-ad84-6b0925c9a4b5 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1886 microversion: 2.42 time: 1.454204 Jun 10 18:14:15.782130 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2286/4657] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:14:14 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1886 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:14:15.788141 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-46846c7a-d544-47bf-b370-f2d06a9572ab tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '.version_select at 0x7f77c02283a0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:15.819574 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-46846c7a-d544-47bf-b370-f2d06a9572ab tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] HTTP exception thrown: Image not found. Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-46846c7a-d544-47bf-b370-f2d06a9572ab tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Request method failure captured: Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/images/274bdbc9-ecc7-42e1-ba82-52839bc53bdc HTTP/1.1 Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4lsfzX-ZssLhBeRERA250Allr9sy5j_9WvmWWrmV8OKGfGLWtKo7IkZmvrlgadYYrKiCJiGv3V0W6WUpTPzvczOtcJBE7CxOiD9g_bSlYjPmyz5JBO2nqOTXPUSYGg7_D3Rbko1iq-cS8Cxtg3C-XqYzZtQdMv47S3ncw5oU530j6g Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: dc6ea0e4d347491eb23c3af053313211 Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-582167706 Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/dc6ea0e4d347491eb23c3af053313211"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/dc6ea0e4d347491eb23c3af053313211"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/dc6ea0e4d347491eb23c3af053313211"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_dc6ea0e4d347491eb23c3af053313211", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-582167706 Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: dc6ea0e4d347491eb23c3af053313211 Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-582167706 Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ImagesOneServerNegativeTestJSON-582167706-project Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 8e6b5cd42b2144a69590680e5ef156fa Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-582167706-project Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: exception: Image not found. Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '274bdbc9-ecc7-42e1-ba82-52839bc53bdc'} Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 274bdbc9-ecc7-42e1-ba82-52839bc53bdc to delete Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 274bdbc9-ecc7-42e1-ba82-52839bc53bdc could not be found. Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:15.821532 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:15.833974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:15.833974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:15.833974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:15.833974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:14:15.833974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:14:15.833974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:14:15.833974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:14:15.833974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:14:15.833974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:14:15.833974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 10 18:14:15.833974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 10 18:14:15.833974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 10 18:14:15.833974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:15.833974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:15.833974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:15.833974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:15.833974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:15.833974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:15.833974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:14:15.833974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:14:15.833974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 10 18:14:15.833974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:15.833974 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-46846c7a-d544-47bf-b370-f2d06a9572ab tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Returning 404 to user: Image not found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:14:15.833974 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-46846c7a-d544-47bf-b370-f2d06a9572ab tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "DELETE /compute/v2.1/images/274bdbc9-ecc7-42e1-ba82-52839bc53bdc" status: 404 len: 62 microversion: 2.1 time: 0.039583 Jun 10 18:14:15.833974 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2287/4658] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:15 2022] DELETE /compute/v2.1/images/274bdbc9-ecc7-42e1-ba82-52839bc53bdc => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:14:15.833974 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-434781d4-7c35-407f-9153-b626d3361624 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:15.836334 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-434781d4-7c35-407f-9153-b626d3361624 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 3a5ac7a5-efdb-4191-85ed-237a1d2f7666] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:15.865521 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-434781d4-7c35-407f-9153-b626d3361624 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:15.865521 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-434781d4-7c35-407f-9153-b626d3361624 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:15.865521 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-434781d4-7c35-407f-9153-b626d3361624 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:15.865521 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-434781d4-7c35-407f-9153-b626d3361624 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:15.887917 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-434781d4-7c35-407f-9153-b626d3361624 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] HTTP exception thrown: Instance 3a5ac7a5-efdb-4191-85ed-237a1d2f7666 could not be found. Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-434781d4-7c35-407f-9153-b626d3361624 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Request method failure captured: Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666 HTTP/1.1 Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4lsfzX-ZssLhBeRERA250Allr9sy5j_9WvmWWrmV8OKGfGLWtKo7IkZmvrlgadYYrKiCJiGv3V0W6WUpTPzvczOtcJBE7CxOiD9g_bSlYjPmyz5JBO2nqOTXPUSYGg7_D3Rbko1iq-cS8Cxtg3C-XqYzZtQdMv47S3ncw5oU530j6g Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: dc6ea0e4d347491eb23c3af053313211 Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-582167706 Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/dc6ea0e4d347491eb23c3af053313211"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/dc6ea0e4d347491eb23c3af053313211"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/dc6ea0e4d347491eb23c3af053313211"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_dc6ea0e4d347491eb23c3af053313211", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-582167706 Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: dc6ea0e4d347491eb23c3af053313211 Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-582167706 Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ImagesOneServerNegativeTestJSON-582167706-project Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 8e6b5cd42b2144a69590680e5ef156fa Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-582167706-project Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 3a5ac7a5-efdb-4191-85ed-237a1d2f7666 could not be found. Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '3a5ac7a5-efdb-4191-85ed-237a1d2f7666'} Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a5ac7a5-efdb-4191-85ed-237a1d2f7666 could not be found. Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:14:15.890904 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:14:15.903272 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a5ac7a5-efdb-4191-85ed-237a1d2f7666 could not be found. Jun 10 18:14:15.903272 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:15.903272 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:15.903272 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:15.903272 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:15.903272 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:15.903272 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:15.903272 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:14:15.903272 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:14:15.903272 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a5ac7a5-efdb-4191-85ed-237a1d2f7666 could not be found. Jun 10 18:14:15.903272 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:15.903272 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-434781d4-7c35-407f-9153-b626d3361624 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Returning 404 to user: Instance 3a5ac7a5-efdb-4191-85ed-237a1d2f7666 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:14:15.903272 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-434781d4-7c35-407f-9153-b626d3361624 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "DELETE /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666" status: 404 len: 111 microversion: 2.1 time: 0.071416 Jun 10 18:14:15.905639 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2288/4659] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:14:15 2022] DELETE /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:14:15.913961 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2ed3bdcd-eb1e-4d78-bb96-cf066885f184 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:15.914860 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2ed3bdcd-eb1e-4d78-bb96-cf066885f184 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] [instance: 3a5ac7a5-efdb-4191-85ed-237a1d2f7666] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:15.933415 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2ed3bdcd-eb1e-4d78-bb96-cf066885f184 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:15.935312 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2ed3bdcd-eb1e-4d78-bb96-cf066885f184 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:15.936171 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2ed3bdcd-eb1e-4d78-bb96-cf066885f184 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:15.937187 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2ed3bdcd-eb1e-4d78-bb96-cf066885f184 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:15.965250 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-2ed3bdcd-eb1e-4d78-bb96-cf066885f184 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] HTTP exception thrown: Instance 3a5ac7a5-efdb-4191-85ed-237a1d2f7666 could not be found. Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2ed3bdcd-eb1e-4d78-bb96-cf066885f184 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Request method failure captured: Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666 HTTP/1.1 Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4lsfzX-ZssLhBeRERA250Allr9sy5j_9WvmWWrmV8OKGfGLWtKo7IkZmvrlgadYYrKiCJiGv3V0W6WUpTPzvczOtcJBE7CxOiD9g_bSlYjPmyz5JBO2nqOTXPUSYGg7_D3Rbko1iq-cS8Cxtg3C-XqYzZtQdMv47S3ncw5oU530j6g Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: dc6ea0e4d347491eb23c3af053313211 Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-582167706 Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/dc6ea0e4d347491eb23c3af053313211"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/dc6ea0e4d347491eb23c3af053313211"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/dc6ea0e4d347491eb23c3af053313211"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_dc6ea0e4d347491eb23c3af053313211", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-582167706 Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: dc6ea0e4d347491eb23c3af053313211 Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-582167706 Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ImagesOneServerNegativeTestJSON-582167706-project Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 8e6b5cd42b2144a69590680e5ef156fa Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-582167706-project Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 3a5ac7a5-efdb-4191-85ed-237a1d2f7666 could not be found. Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '3a5ac7a5-efdb-4191-85ed-237a1d2f7666'} Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a5ac7a5-efdb-4191-85ed-237a1d2f7666 could not be found. Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a5ac7a5-efdb-4191-85ed-237a1d2f7666 could not be found. Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:15.967844 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:15.972435 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:15.972435 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:15.972435 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:15.972435 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:15.972435 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:14:15.972435 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:14:15.972435 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a5ac7a5-efdb-4191-85ed-237a1d2f7666 could not be found. Jun 10 18:14:15.972435 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:15.972435 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2ed3bdcd-eb1e-4d78-bb96-cf066885f184 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] Returning 404 to user: Instance 3a5ac7a5-efdb-4191-85ed-237a1d2f7666 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:14:15.972435 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2ed3bdcd-eb1e-4d78-bb96-cf066885f184 tempest-ImagesOneServerNegativeTestJSON-582167706 tempest-ImagesOneServerNegativeTestJSON-582167706-project] 10.222.0.35 "GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666" status: 404 len: 111 microversion: 2.1 time: 0.062995 Jun 10 18:14:15.973758 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2289/4660] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:15 2022] GET /compute/v2.1/servers/3a5ac7a5-efdb-4191-85ed-237a1d2f7666 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:14:16.548949 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2c43c626-ce81-40eb-975a-64ede33a57eb tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c03641f0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:16.649194 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2c43c626-ce81-40eb-975a-64ede33a57eb tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/63662839-4647-44e5-8390-303920cc5c18" status: 200 len: 1451 microversion: 2.1 time: 0.105123 Jun 10 18:14:16.649791 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2290/4661] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:14:16 2022] GET /compute/v2.1/images/63662839-4647-44e5-8390-303920cc5c18 => generated 1451 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:14:16.770330 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8149454a-8999-4b93-a4e7-84c0662bd98b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:16.783983 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8149454a-8999-4b93-a4e7-84c0662bd98b tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 1.246433 Jun 10 18:14:16.784896 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2372/4662] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:15 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:16.816450 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c94fc0f4-e33a-4e06-ad94-4724480a522f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:16.816450 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c94fc0f4-e33a-4e06-ad94-4724480a522f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:16.816790 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-aae874ca-6f23-4cf9-aa1c-1b1fcc692e08 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1432735619_updated"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:14:16.816790 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-aae874ca-6f23-4cf9-aa1c-1b1fcc692e08 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 2203a323-0cd8-4af4-9a09-29588563b1da] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:16.824997 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-aae874ca-6f23-4cf9-aa1c-1b1fcc692e08 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] HTTP exception thrown: Instance 2203a323-0cd8-4af4-9a09-29588563b1da could not be found. Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-aae874ca-6f23-4cf9-aa1c-1b1fcc692e08 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: request: PUT /compute/v2.1/servers/2203a323-0cd8-4af4-9a09-29588563b1da HTTP/1.1 Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 81 Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1432735619_updated"}} Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 2203a323-0cd8-4af4-9a09-29588563b1da could not be found. Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '2203a323-0cd8-4af4-9a09-29588563b1da', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1432735619_updated'}}} Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2203a323-0cd8-4af4-9a09-29588563b1da could not be found. Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jun 10 18:14:16.826635 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:14:16.832732 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:14:16.832732 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:14:16.832732 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:14:16.832732 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2203a323-0cd8-4af4-9a09-29588563b1da could not be found. Jun 10 18:14:16.832732 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:16.832732 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:16.832732 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:16.832732 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:16.832732 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:16.832732 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:16.832732 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:14:16.832732 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:14:16.832732 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2203a323-0cd8-4af4-9a09-29588563b1da could not be found. Jun 10 18:14:16.832732 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:16.833684 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c94fc0f4-e33a-4e06-ad94-4724480a522f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:16.833684 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c94fc0f4-e33a-4e06-ad94-4724480a522f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:16.833684 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c94fc0f4-e33a-4e06-ad94-4724480a522f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:16.833684 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c94fc0f4-e33a-4e06-ad94-4724480a522f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:16.839807 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-aae874ca-6f23-4cf9-aa1c-1b1fcc692e08 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 404 to user: Instance 2203a323-0cd8-4af4-9a09-29588563b1da could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:14:16.841276 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-aae874ca-6f23-4cf9-aa1c-1b1fcc692e08 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "PUT /compute/v2.1/servers/2203a323-0cd8-4af4-9a09-29588563b1da" status: 404 len: 111 microversion: 2.1 time: 0.041627 Jun 10 18:14:16.849443 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2291/4663] 10.222.0.35 () {60 vars in 1255 bytes} [Fri Jun 10 18:14:16 2022] PUT /compute/v2.1/servers/2203a323-0cd8-4af4-9a09-29588563b1da => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:14:16.862332 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9d64dd49-be52-43e2-9063-154544116265 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:16.862978 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9d64dd49-be52-43e2-9063-154544116265 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:16.907737 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9d64dd49-be52-43e2-9063-154544116265 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:16.908084 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9d64dd49-be52-43e2-9063-154544116265 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:16.908931 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9d64dd49-be52-43e2-9063-154544116265 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:16.909377 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9d64dd49-be52-43e2-9063-154544116265 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:17.325799 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9d64dd49-be52-43e2-9063-154544116265 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:17.337815 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9d64dd49-be52-43e2-9063-154544116265 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.487270 Jun 10 18:14:17.339175 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2292/4664] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:16 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:17.355644 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fbd51e1a-e56b-40ca-9e3c-29d75fccee14 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:17.356576 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fbd51e1a-e56b-40ca-9e3c-29d75fccee14 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:17.369346 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fbd51e1a-e56b-40ca-9e3c-29d75fccee14 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:17.370104 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fbd51e1a-e56b-40ca-9e3c-29d75fccee14 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:17.371087 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fbd51e1a-e56b-40ca-9e3c-29d75fccee14 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:17.372961 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fbd51e1a-e56b-40ca-9e3c-29d75fccee14 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:17.831485 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fbd51e1a-e56b-40ca-9e3c-29d75fccee14 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:17.844819 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fbd51e1a-e56b-40ca-9e3c-29d75fccee14 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.492412 Jun 10 18:14:17.845432 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2293/4665] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:17 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:17.869355 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-c87c6739-7c71-4323-aad4-c87744e64d64 req-cc9d041c-9253-4136-a7e1-f59d5e3133dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ceaaf7b-0972-4fe5-bd63-5534a71f80d3", "tag": "637baac4-b034-4d97-98de-e1137a57f487"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:14:17.889843 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-c87c6739-7c71-4323-aad4-c87744e64d64 req-cc9d041c-9253-4136-a7e1-f59d5e3133dc service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:17.890115 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-c87c6739-7c71-4323-aad4-c87744e64d64 req-cc9d041c-9253-4136-a7e1-f59d5e3133dc service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:17.932625 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-c87c6739-7c71-4323-aad4-c87744e64d64 req-cc9d041c-9253-4136-a7e1-f59d5e3133dc service nova] Creating event network-changed:637baac4-b034-4d97-98de-e1137a57f487 for instance 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 on chh2-master-2 Jun 10 18:14:17.944037 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-c87c6739-7c71-4323-aad4-c87744e64d64 req-cc9d041c-9253-4136-a7e1-f59d5e3133dc service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080794 Jun 10 18:14:17.952887 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2294/4666] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:14:17.958684 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-299bf5b9-2313-45fe-a01d-f60b42393df6 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c0364670>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:17.972992 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c94fc0f4-e33a-4e06-ad94-4724480a522f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:17.996194 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c94fc0f4-e33a-4e06-ad94-4724480a522f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:17.996194 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c94fc0f4-e33a-4e06-ad94-4724480a522f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:17.998225 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c94fc0f4-e33a-4e06-ad94-4724480a522f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1886 microversion: 2.42 time: 1.190454 Jun 10 18:14:17.999012 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2373/4667] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:14:16 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1886 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:14:18.011279 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fd8ea2c3-9727-422e-82a6-4e57cbeb75c5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fd8ea2c3-9727-422e-82a6-4e57cbeb75c5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: request: PUT /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 HTTP/1.1 Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 280 Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '57a377b2-f75e-4a0c-8401-090db42db644', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise error Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:14:18.019622 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:18.028134 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:18.028134 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:18.028134 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:14:18.028134 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:14:18.028134 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:14:18.028134 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:14:18.028134 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:14:18.028134 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:14:18.028134 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 10 18:14:18.028134 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 10 18:14:18.028134 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 10 18:14:18.028134 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 10 18:14:18.028134 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 10 18:14:18.028134 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 10 18:14:18.028134 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 10 18:14:18.028134 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:14:18.028134 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:18.028134 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:14:18.028134 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:18.028134 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:18.028134 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:18.028134 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 10 18:14:18.028134 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 10 18:14:18.028134 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 10 18:14:18.028134 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:14:18.028134 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fd8ea2c3-9727-422e-82a6-4e57cbeb75c5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:14:18.028134 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fd8ea2c3-9727-422e-82a6-4e57cbeb75c5 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "PUT /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 400 len: 619 microversion: 2.1 time: 0.020355 Jun 10 18:14:18.030631 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2374/4668] 10.222.0.35 () {60 vars in 1256 bytes} [Fri Jun 10 18:14:18 2022] PUT /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 619 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:14:18.041520 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-56505b09-a3a7-4b0c-b30b-ae404345a3be tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:18.044271 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-56505b09-a3a7-4b0c-b30b-ae404345a3be tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:18.079457 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-299bf5b9-2313-45fe-a01d-f60b42393df6 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/63662839-4647-44e5-8390-303920cc5c18" status: 200 len: 1451 microversion: 2.1 time: 0.130025 Jun 10 18:14:18.080114 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2295/4669] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:14:17 2022] GET /compute/v2.1/images/63662839-4647-44e5-8390-303920cc5c18 => generated 1451 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:18.085341 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-56505b09-a3a7-4b0c-b30b-ae404345a3be tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:18.094824 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-56505b09-a3a7-4b0c-b30b-ae404345a3be tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:18.099937 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-56505b09-a3a7-4b0c-b30b-ae404345a3be tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:18.102214 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-56505b09-a3a7-4b0c-b30b-ae404345a3be tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:18.528778 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-56505b09-a3a7-4b0c-b30b-ae404345a3be tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:18.541980 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-56505b09-a3a7-4b0c-b30b-ae404345a3be tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.509897 Jun 10 18:14:18.542607 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2375/4670] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:18 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:18.562224 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d345a7f2-5ef8-4f89-9745-94b71fbafd88 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:18.564641 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d345a7f2-5ef8-4f89-9745-94b71fbafd88 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:18.576764 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d345a7f2-5ef8-4f89-9745-94b71fbafd88 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:18.581733 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d345a7f2-5ef8-4f89-9745-94b71fbafd88 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:18.582636 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d345a7f2-5ef8-4f89-9745-94b71fbafd88 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:18.583347 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d345a7f2-5ef8-4f89-9745-94b71fbafd88 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:18.591953 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:14:19.020575 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-68b3017d-bcc7-4213-8f11-6f8055daa47b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:19.021823 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-68b3017d-bcc7-4213-8f11-6f8055daa47b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:19.041065 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-68b3017d-bcc7-4213-8f11-6f8055daa47b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:19.041857 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-68b3017d-bcc7-4213-8f11-6f8055daa47b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:19.042957 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-68b3017d-bcc7-4213-8f11-6f8055daa47b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:19.043713 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-68b3017d-bcc7-4213-8f11-6f8055daa47b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:19.273954 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d345a7f2-5ef8-4f89-9745-94b71fbafd88 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:19.286467 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d345a7f2-5ef8-4f89-9745-94b71fbafd88 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.729209 Jun 10 18:14:19.288318 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2296/4671] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:18 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:19.300499 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-867ee385-77ac-42e2-ad00-86e781b19f2a tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c03b0dc0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:19.375500 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-867ee385-77ac-42e2-ad00-86e781b19f2a tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/63662839-4647-44e5-8390-303920cc5c18" status: 200 len: 1451 microversion: 2.1 time: 0.084300 Jun 10 18:14:19.376459 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2297/4672] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:14:19 2022] GET /compute/v2.1/images/63662839-4647-44e5-8390-303920cc5c18 => generated 1451 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:19.381293 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dc1a4f75-7e41-402f-b149-bf7bb4b0f05d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dc1a4f75-7e41-402f-b149-bf7bb4b0f05d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: request: PUT /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 HTTP/1.1 Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 24 Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: {"server": {"name": ""}} Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: exception: Invalid input for field/attribute name. Value: . '' is too short Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '57a377b2-f75e-4a0c-8401-090db42db644', 'body': {'server': {'name': ''}}} Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise error Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi '' Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 10 18:14:19.395196 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jun 10 18:14:19.400974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:19.400974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:19.400974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:19.400974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:19.400974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:19.400974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:19.400974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 10 18:14:19.400974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 10 18:14:19.400974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jun 10 18:14:19.400974 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:19.421249 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dc1a4f75-7e41-402f-b149-bf7bb4b0f05d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:14:19.422651 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dc1a4f75-7e41-402f-b149-bf7bb4b0f05d tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "PUT /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 400 len: 108 microversion: 2.1 time: 0.044788 Jun 10 18:14:19.423858 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2298/4673] 10.222.0.35 () {60 vars in 1255 bytes} [Fri Jun 10 18:14:19 2022] PUT /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 108 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:14:19.431430 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f497ad89-a080-4129-a774-5aba503bfc98 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:19.441390 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f497ad89-a080-4129-a774-5aba503bfc98 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:19.449205 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f497ad89-a080-4129-a774-5aba503bfc98 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:19.449902 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f497ad89-a080-4129-a774-5aba503bfc98 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:19.460599 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f497ad89-a080-4129-a774-5aba503bfc98 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:19.461324 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f497ad89-a080-4129-a774-5aba503bfc98 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:19.814218 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-68b3017d-bcc7-4213-8f11-6f8055daa47b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:19.845654 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-68b3017d-bcc7-4213-8f11-6f8055daa47b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:19.849335 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-68b3017d-bcc7-4213-8f11-6f8055daa47b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:19.854563 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-68b3017d-bcc7-4213-8f11-6f8055daa47b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1886 microversion: 2.42 time: 0.839124 Jun 10 18:14:19.858604 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2376/4674] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:14:19 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1886 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:14:20.141859 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f497ad89-a080-4129-a774-5aba503bfc98 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:20.153078 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f497ad89-a080-4129-a774-5aba503bfc98 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1506 microversion: 2.1 time: 0.725369 Jun 10 18:14:20.167449 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2299/4675] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:19 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1506 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:14:20.389344 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0276ad33-f7da-4561-85ae-f677c35c7228 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3a950d0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:20.514779 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-7f9af835-0393-4337-9a7c-2150ff523c1d req-b7259ba6-182f-4c0d-b9c3-ef3edae34599 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ceaaf7b-0972-4fe5-bd63-5534a71f80d3", "tag": "1eec4f25-edb7-4e8d-872d-3f31321f8bf5"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:14:20.540485 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-7f9af835-0393-4337-9a7c-2150ff523c1d req-b7259ba6-182f-4c0d-b9c3-ef3edae34599 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:20.541267 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-7f9af835-0393-4337-9a7c-2150ff523c1d req-b7259ba6-182f-4c0d-b9c3-ef3edae34599 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:20.575963 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-7f9af835-0393-4337-9a7c-2150ff523c1d req-b7259ba6-182f-4c0d-b9c3-ef3edae34599 service nova] Creating event network-changed:1eec4f25-edb7-4e8d-872d-3f31321f8bf5 for instance 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 on chh2-master-2 Jun 10 18:14:20.591126 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-7f9af835-0393-4337-9a7c-2150ff523c1d req-b7259ba6-182f-4c0d-b9c3-ef3edae34599 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079867 Jun 10 18:14:20.593457 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2300/4676] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:14:20.600412 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0276ad33-f7da-4561-85ae-f677c35c7228 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/63662839-4647-44e5-8390-303920cc5c18" status: 200 len: 1451 microversion: 2.1 time: 0.190148 Jun 10 18:14:20.601813 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2377/4677] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:14:20 2022] GET /compute/v2.1/images/63662839-4647-44e5-8390-303920cc5c18 => generated 1451 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:20.879455 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ae800eb7-6e98-40c5-8414-31c8c9073bfd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:20.879455 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ae800eb7-6e98-40c5-8414-31c8c9073bfd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:20.899069 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ae800eb7-6e98-40c5-8414-31c8c9073bfd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:20.899597 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ae800eb7-6e98-40c5-8414-31c8c9073bfd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:20.900404 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ae800eb7-6e98-40c5-8414-31c8c9073bfd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:20.900829 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ae800eb7-6e98-40c5-8414-31c8c9073bfd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:21.382513 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ae800eb7-6e98-40c5-8414-31c8c9073bfd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:21.395834 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ae800eb7-6e98-40c5-8414-31c8c9073bfd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:21.404069 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ae800eb7-6e98-40c5-8414-31c8c9073bfd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:21.405591 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ae800eb7-6e98-40c5-8414-31c8c9073bfd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1886 microversion: 2.42 time: 0.533851 Jun 10 18:14:21.408985 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2301/4678] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:14:20 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1886 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:14:21.614952 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-51c3e04b-c0e7-498d-a0a6-73eea5b9b4b8 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3a5fe50>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:21.684249 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-51c3e04b-c0e7-498d-a0a6-73eea5b9b4b8 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/63662839-4647-44e5-8390-303920cc5c18" status: 200 len: 1460 microversion: 2.1 time: 0.074523 Jun 10 18:14:21.692363 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2378/4679] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:14:21 2022] GET /compute/v2.1/images/63662839-4647-44e5-8390-303920cc5c18 => generated 1460 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:21.697775 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d31afd4c-937c-4ed0-b776-965df9bc2a7c tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c0301b80>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:21.770217 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d31afd4c-937c-4ed0-b776-965df9bc2a7c tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/63662839-4647-44e5-8390-303920cc5c18" status: 200 len: 1460 microversion: 2.1 time: 0.076393 Jun 10 18:14:21.770955 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2302/4680] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:14:21 2022] GET /compute/v2.1/images/63662839-4647-44e5-8390-303920cc5c18 => generated 1460 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:21.783282 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1fe1506c-306f-4129-8fae-01d51c51abc0 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:21.783505 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1fe1506c-306f-4129-8fae-01d51c51abc0 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 72eaef23-30d6-4755-a9b7-9547856075b3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:21.793147 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1fe1506c-306f-4129-8fae-01d51c51abc0 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:21.796500 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1fe1506c-306f-4129-8fae-01d51c51abc0 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:21.798366 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1fe1506c-306f-4129-8fae-01d51c51abc0 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:21.800929 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1fe1506c-306f-4129-8fae-01d51c51abc0 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:22.338857 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1fe1506c-306f-4129-8fae-01d51c51abc0 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd404e4ab55af470fa464b94f9f0cd2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6575b0846dca493f9e99ee122930972d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:22.351387 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1fe1506c-306f-4129-8fae-01d51c51abc0 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/servers/72eaef23-30d6-4755-a9b7-9547856075b3" status: 200 len: 1480 microversion: 2.1 time: 0.572410 Jun 10 18:14:22.352100 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2379/4681] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:21 2022] GET /compute/v2.1/servers/72eaef23-30d6-4755-a9b7-9547856075b3 => generated 1480 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:22.427062 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b7a2088c-365c-494a-932c-95afe061cd9f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:22.428238 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b7a2088c-365c-494a-932c-95afe061cd9f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:22.435373 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b7a2088c-365c-494a-932c-95afe061cd9f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:22.436052 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b7a2088c-365c-494a-932c-95afe061cd9f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:22.437119 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b7a2088c-365c-494a-932c-95afe061cd9f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:22.437767 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b7a2088c-365c-494a-932c-95afe061cd9f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:22.506918 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:14:22.661707 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b2e02955-f09d-4d66-bfee-3b39d5073c96 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-949074534", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0b4456f3-4e1c-4005-adf5-626a892b6b68"}], "security_groups": [{"name": "tempest-securitygroup--104096248"}], "key_name": "tempest-keypair-768287569", "user_data": "}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:14:22.950095 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b7a2088c-365c-494a-932c-95afe061cd9f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:22.975800 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b7a2088c-365c-494a-932c-95afe061cd9f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:22.980776 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b7a2088c-365c-494a-932c-95afe061cd9f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:22.984387 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b7a2088c-365c-494a-932c-95afe061cd9f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1886 microversion: 2.42 time: 0.559095 Jun 10 18:14:23.002514 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2303/4682] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:14:22 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1886 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:14:23.013540 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-6f8358d6-c640-410b-8b39-8f637d8cf64a req-a5f7a259-24bc-43f8-9de6-2edf275d0146 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ceaaf7b-0972-4fe5-bd63-5534a71f80d3", "tag": "a18991bb-a2c4-4f74-89e1-81c2c3fb3a0b"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:14:23.025243 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-6f8358d6-c640-410b-8b39-8f637d8cf64a req-a5f7a259-24bc-43f8-9de6-2edf275d0146 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:23.026054 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-6f8358d6-c640-410b-8b39-8f637d8cf64a req-a5f7a259-24bc-43f8-9de6-2edf275d0146 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:23.086680 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-6f8358d6-c640-410b-8b39-8f637d8cf64a req-a5f7a259-24bc-43f8-9de6-2edf275d0146 service nova] Creating event network-changed:a18991bb-a2c4-4f74-89e1-81c2c3fb3a0b for instance 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 on chh2-master-2 Jun 10 18:14:23.101872 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-6f8358d6-c640-410b-8b39-8f637d8cf64a req-a5f7a259-24bc-43f8-9de6-2edf275d0146 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095969 Jun 10 18:14:23.105424 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2304/4683] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:14:23.456435 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e83f0e8e-08d6-4d17-9406-5640bae3414c tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] Action: 'create', calling method: .version_select at 0x7f77c11ede50>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3/EC0YLg1Lk3CVoZ+lvILPextBv7nULByePgg00+rMgl2eOkENPjh8zZYR0JJEpeCY6+lKHgooimrcppeHtESJzFpO3zxfOIJOMXaw5GgYxWeu4ZErJWDifbLhiN6xXA=="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:14:23.464872 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-e83f0e8e-08d6-4d17-9406-5640bae3414c tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e83f0e8e-08d6-4d17-9406-5640bae3414c tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] Request method failure captured: Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 257 Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4n-GwmH9PtK-2Tn_NNwS62BvUOa0CUV6F5FBas0mIPbOmZoslO6eTq6Pf8dl3-fe-mQ-1lfdtG-6NaBDpmysBlTjut5McxcJP68FuPvmsmjV-v9WCy_qRcrMUsnrH3cMQWdw-Ysy5JkuIWw1dvEhgrv6D9ex3ExsEl0rbOTpTcTdko Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 680617eda8724f4a9c44434e61b2c650 Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1891563707 Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/680617eda8724f4a9c44434e61b2c650"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/680617eda8724f4a9c44434e61b2c650"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/680617eda8724f4a9c44434e61b2c650"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_680617eda8724f4a9c44434e61b2c650", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1891563707 Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 680617eda8724f4a9c44434e61b2c650 Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1891563707 Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-KeyPairsNegativeTestJSON-1891563707-project Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 2a98f6d39dcf491fa0442fe7c027c13a Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1891563707-project Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3/EC0YLg1Lk3CVoZ+lvILPextBv7nULByePgg00+rMgl2eOkENPjh8zZYR0JJEpeCY6+lKHgooimrcppeHtESJzFpO3zxfOIJOMXaw5GgYxWeu4ZErJWDifbLhiN6xXA=="}} Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: exception: Keypair data is invalid: Keypair name contains unsafe characters Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3/EC0YLg1Lk3CVoZ+lvILPextBv7nULByePgg00+rMgl2eOkENPjh8zZYR0JJEpeCY6+lKHgooimrcppeHtESJzFpO3zxfOIJOMXaw5GgYxWeu4ZErJWDifbLhiN6xXA=='}}} Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in import_key_pair Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in _validate_new_key_pair Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:14:23.476086 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:14:23.482316 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:14:23.482316 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:14:23.482316 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:14:23.482316 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:14:23.482316 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:14:23.482316 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:14:23.482316 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jun 10 18:14:23.482316 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jun 10 18:14:23.482316 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jun 10 18:14:23.482316 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jun 10 18:14:23.482316 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters Jun 10 18:14:23.482316 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:23.482316 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:23.482316 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:23.482316 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:23.482316 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:23.482316 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:23.482316 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:14:23.482316 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:14:23.482316 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters Jun 10 18:14:23.482316 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:23.488883 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e83f0e8e-08d6-4d17-9406-5640bae3414c tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:14:23.490079 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e83f0e8e-08d6-4d17-9406-5640bae3414c tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.317582 Jun 10 18:14:23.491242 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2305/4684] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 18:14:23 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 319 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 10 18:14:23.502630 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b97a9bb5-abd0-41b6-9af3-11745b86ec66 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:23.505946 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b97a9bb5-abd0-41b6-9af3-11745b86ec66 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 72eaef23-30d6-4755-a9b7-9547856075b3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:23.534024 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b97a9bb5-abd0-41b6-9af3-11745b86ec66 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:23.534483 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b97a9bb5-abd0-41b6-9af3-11745b86ec66 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:23.535271 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b97a9bb5-abd0-41b6-9af3-11745b86ec66 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:23.535708 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b97a9bb5-abd0-41b6-9af3-11745b86ec66 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:23.739485 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-b2e02955-f09d-4d66-bfee-3b39d5073c96 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] validate_networks() for [('0b4456f3-4e1c-4005-adf5-626a892b6b68', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:14:23.981306 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b97a9bb5-abd0-41b6-9af3-11745b86ec66 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd404e4ab55af470fa464b94f9f0cd2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6575b0846dca493f9e99ee122930972d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:23.991102 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b97a9bb5-abd0-41b6-9af3-11745b86ec66 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/servers/72eaef23-30d6-4755-a9b7-9547856075b3" status: 200 len: 1467 microversion: 2.1 time: 0.498485 Jun 10 18:14:23.995645 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2306/4685] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:23 2022] GET /compute/v2.1/servers/72eaef23-30d6-4755-a9b7-9547856075b3 => generated 1467 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:24.007476 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bd015f81-2d21-46b9-81bc-efdc6f1a3682 tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] Action: 'create', calling method: .version_select at 0x7f77c03b2940>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1477519022", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:14:24.042657 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-bd015f81-2d21-46b9-81bc-efdc6f1a3682 tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] Getting quotas for project 680617eda8724f4a9c44434e61b2c650. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:14:24.054051 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-bd015f81-2d21-46b9-81bc-efdc6f1a3682 tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] Getting quotas for user 2a98f6d39dcf491fa0442fe7c027c13a and project 680617eda8724f4a9c44434e61b2c650. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:14:24.073692 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-bd015f81-2d21-46b9-81bc-efdc6f1a3682 tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jun 10 18:14:24.105921 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bd015f81-2d21-46b9-81bc-efdc6f1a3682 tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] Request method failure captured: Jun 10 18:14:24.105921 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 10 18:14:24.105921 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:14:24.105921 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:14:24.105921 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:14:24.105921 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 2167 Jun 10 18:14:24.105921 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:14:24.105921 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:14:24.105921 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:14:24.105921 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:14:24.105921 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4n-GwmH9PtK-2Tn_NNwS62BvUOa0CUV6F5FBas0mIPbOmZoslO6eTq6Pf8dl3-fe-mQ-1lfdtG-6NaBDpmysBlTjut5McxcJP68FuPvmsmjV-v9WCy_qRcrMUsnrH3cMQWdw-Ysy5JkuIWw1dvEhgrv6D9ex3ExsEl0rbOTpTcTdko Jun 10 18:14:24.105921 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:14:24.105921 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:14:24.105921 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:14:24.105921 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:14:24.105921 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:14:24.105921 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:14:24.105921 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 680617eda8724f4a9c44434e61b2c650 Jun 10 18:14:24.105921 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1891563707 Jun 10 18:14:24.105921 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:14:24.105921 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:14:24.105921 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/680617eda8724f4a9c44434e61b2c650"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/680617eda8724f4a9c44434e61b2c650"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/680617eda8724f4a9c44434e61b2c650"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_680617eda8724f4a9c44434e61b2c650", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:14:24.105921 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1891563707 Jun 10 18:14:24.105921 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 680617eda8724f4a9c44434e61b2c650 Jun 10 18:14:24.105921 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1891563707 Jun 10 18:14:24.105921 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-KeyPairsNegativeTestJSON-1891563707-project Jun 10 18:14:24.105921 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:14:24.105921 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:14:24.105921 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 2a98f6d39dcf491fa0442fe7c027c13a Jun 10 18:14:24.105921 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1891563707-project Jun 10 18:14:24.105921 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:14:24.105921 chdv-master-2 devstack@n-api.service[126595]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1477519022", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Jun 10 18:14:24.105921 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:14:24.105921 chdv-master-2 devstack@n-api.service[126595]: exception: Keypair data is invalid: failed to generate fingerprint Jun 10 18:14:24.109026 chdv-master-2 devstack@n-api.service[126595]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1477519022', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Jun 10 18:14:24.109026 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:14:24.109026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:24.109026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jun 10 18:14:24.109026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jun 10 18:14:24.109026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Jun 10 18:14:24.109026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Jun 10 18:14:24.109026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Jun 10 18:14:24.109026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:24.109026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:24.109026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:24.109026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:24.109026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jun 10 18:14:24.109026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jun 10 18:14:24.109026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 10 18:14:24.109026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 10 18:14:24.109026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 18:14:24.109026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 18:14:24.109026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 18:14:24.109026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 18:14:24.109026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 10 18:14:24.109026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 10 18:14:24.109026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jun 10 18:14:24.109026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jun 10 18:14:24.109026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jun 10 18:14:24.109026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jun 10 18:14:24.109026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jun 10 18:14:24.109026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jun 10 18:14:24.109026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jun 10 18:14:24.109026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:24.109026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:24.109026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:24.109026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:24.109026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:24.109026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:24.109026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:14:24.109026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:14:24.109026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:14:24.109026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:14:24.109026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:14:24.109026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:14:24.113010 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:14:24.113010 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:14:24.113010 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:14:24.113010 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:14:24.113010 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jun 10 18:14:24.113010 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jun 10 18:14:24.113010 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jun 10 18:14:24.113010 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jun 10 18:14:24.113010 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jun 10 18:14:24.113010 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:24.113010 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:24.113010 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:24.113010 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:24.113010 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:24.113010 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:24.113010 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:14:24.113010 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:14:24.113010 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jun 10 18:14:24.113010 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:24.118053 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bd015f81-2d21-46b9-81bc-efdc6f1a3682 tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:14:24.118053 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bd015f81-2d21-46b9-81bc-efdc6f1a3682 tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.118595 Jun 10 18:14:24.118053 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2307/4686] 10.222.0.35 () {60 vars in 1159 bytes} [Fri Jun 10 18:14:23 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 121 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 10 18:14:24.121921 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-31797d4a-52bc-4a44-b790-138fac911adc tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:24.122792 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-31797d4a-52bc-4a44-b790-138fac911adc tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:24.137146 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-31797d4a-52bc-4a44-b790-138fac911adc tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:24.139426 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-31797d4a-52bc-4a44-b790-138fac911adc tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:24.140509 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-31797d4a-52bc-4a44-b790-138fac911adc tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:24.142332 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-31797d4a-52bc-4a44-b790-138fac911adc tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:24.769904 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-31797d4a-52bc-4a44-b790-138fac911adc tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:24.790941 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-31797d4a-52bc-4a44-b790-138fac911adc tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:24.793728 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-31797d4a-52bc-4a44-b790-138fac911adc tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:24.797675 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-31797d4a-52bc-4a44-b790-138fac911adc tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1886 microversion: 2.42 time: 0.679729 Jun 10 18:14:24.809348 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2308/4687] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:14:24 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1886 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:14:24.827813 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2cd0a86a-bc97-40df-a080-237627d1e435 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-202915702"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:14:24.834847 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2cd0a86a-bc97-40df-a080-237627d1e435 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 89cea229-7bfb-43e4-a855-e9c6ae81d37b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:24.848814 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2cd0a86a-bc97-40df-a080-237627d1e435 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:24.848814 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2cd0a86a-bc97-40df-a080-237627d1e435 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:24.850208 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2cd0a86a-bc97-40df-a080-237627d1e435 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:24.851497 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2cd0a86a-bc97-40df-a080-237627d1e435 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:24.895282 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-b2e02955-f09d-4d66-bfee-3b39d5073c96 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:14:24.895737 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-b2e02955-f09d-4d66-bfee-3b39d5073c96 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:14:24.896184 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-b2e02955-f09d-4d66-bfee-3b39d5073c96 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:14:24.896770 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-b2e02955-f09d-4d66-bfee-3b39d5073c96 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:14:24.897190 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-b2e02955-f09d-4d66-bfee-3b39d5073c96 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:14:24.912792 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b2e02955-f09d-4d66-bfee-3b39d5073c96 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:24.914906 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b2e02955-f09d-4d66-bfee-3b39d5073c96 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:24.915555 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b2e02955-f09d-4d66-bfee-3b39d5073c96 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:24.917082 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b2e02955-f09d-4d66-bfee-3b39d5073c96 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:24.952020 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-b2e02955-f09d-4d66-bfee-3b39d5073c96 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Getting quotas for project 2f3f65ee123043bb9c888cc5adffce37. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:14:24.959769 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-b2e02955-f09d-4d66-bfee-3b39d5073c96 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Getting quotas for user 6aa40a915e4e43cd8d493dc593a73028 and project 2f3f65ee123043bb9c888cc5adffce37. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:14:25.005149 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b2e02955-f09d-4d66-bfee-3b39d5073c96 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:14:25.024542 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b2e02955-f09d-4d66-bfee-3b39d5073c96 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:14:25.224083 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b2e02955-f09d-4d66-bfee-3b39d5073c96 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.568090 Jun 10 18:14:25.230176 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2380/4688] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:14:22 2022] POST /compute/v2.1/servers => generated 408 bytes in 2575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 10 18:14:25.235298 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0828174b-5c73-48a9-b5ed-5a005b2ada44 tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] Action: 'create', calling method: .version_select at 0x7f77b3a95820>, body: {"keypair": {"name": "tempest-keypair-102690638", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPUSH3XFvOiHLek1CNOwdAtiYctjJy8QHmd4kxL4DC0uXLl9AD9+UIC4HgGZKbF91kdoWjQYKO/Py7ZYLxk4b+RLjecp4fx3/W5RIWe+QS32hAIafr5JmgSSMMTOU3fjQ=="}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:14:25.266550 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-0828174b-5c73-48a9-b5ed-5a005b2ada44 tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] Getting quotas for project 680617eda8724f4a9c44434e61b2c650. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:14:25.292901 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-0828174b-5c73-48a9-b5ed-5a005b2ada44 tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] Getting quotas for user 2a98f6d39dcf491fa0442fe7c027c13a and project 680617eda8724f4a9c44434e61b2c650. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:14:25.494332 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0828174b-5c73-48a9-b5ed-5a005b2ada44 tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.262659 Jun 10 18:14:25.495316 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2381/4689] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 18:14:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:14:25.505773 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-149a30b4-92bb-4b00-be07-3137685ba954 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:25.507776 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-149a30b4-92bb-4b00-be07-3137685ba954 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:25.649196 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-149a30b4-92bb-4b00-be07-3137685ba954 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:25.658551 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-149a30b4-92bb-4b00-be07-3137685ba954 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1244 microversion: 2.1 time: 0.160672 Jun 10 18:14:25.667096 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2382/4690] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:25 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1244 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:25.674686 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f62e7288-c16f-4def-94cc-56ef1de84c4e tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] Action: 'create', calling method: .version_select at 0x7f77b3a65040>, body: {"keypair": {"name": "tempest-keypair-102690638", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgyDHxt8j1WltYLnMG69cXL0Y1b2pocs+vrQk6xkNUzTWJJCa4/Nt3l5JzzYoauTeEivSNHJ1suWfz2FQOVMjIW8N6NK0zk3Ccl3jVP8MNnBe7igOzIC0FnSBB16xqoGA=="}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:14:25.744357 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2cd0a86a-bc97-40df-a080-237627d1e435 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "POST /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b/action" status: 202 len: 0 microversion: 2.1 time: 0.936563 Jun 10 18:14:25.747430 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2309/4691] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:14:24 2022] POST /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b/action => generated 0 bytes in 947 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 10 18:14:25.799260 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-f62e7288-c16f-4def-94cc-56ef1de84c4e tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] Getting quotas for project 680617eda8724f4a9c44434e61b2c650. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:14:25.804793 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-a7d5dec6-c94c-4750-b4ae-9155aad0992a req-540b726c-a0a3-41d0-a5f7-268b6d1be9e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72eaef23-30d6-4755-a9b7-9547856075b3", "name": "network-vif-unplugged", "status": "completed", "tag": "777ebce0-6591-4ee2-b139-f87b2964f3fb"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:14:25.829912 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-f62e7288-c16f-4def-94cc-56ef1de84c4e tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] Getting quotas for user 2a98f6d39dcf491fa0442fe7c027c13a and project 680617eda8724f4a9c44434e61b2c650. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:14:25.843276 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-a7d5dec6-c94c-4750-b4ae-9155aad0992a req-540b726c-a0a3-41d0-a5f7-268b6d1be9e5 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:25.845727 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-a7d5dec6-c94c-4750-b4ae-9155aad0992a req-540b726c-a0a3-41d0-a5f7-268b6d1be9e5 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:25.878310 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-a7d5dec6-c94c-4750-b4ae-9155aad0992a req-540b726c-a0a3-41d0-a5f7-268b6d1be9e5 service nova] Creating event network-vif-unplugged:777ebce0-6591-4ee2-b139-f87b2964f3fb for instance 72eaef23-30d6-4755-a9b7-9547856075b3 on chh2-master-2 Jun 10 18:14:25.897032 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-a7d5dec6-c94c-4750-b4ae-9155aad0992a req-540b726c-a0a3-41d0-a5f7-268b6d1be9e5 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117520 Jun 10 18:14:25.900970 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2310/4692] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:14:25.925147 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f4e4372f-079d-4620-a96c-a06294050223 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c02f94c0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:25.961335 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-f62e7288-c16f-4def-94cc-56ef1de84c4e tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] HTTP exception thrown: Key pair 'tempest-keypair-102690638' already exists. Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f62e7288-c16f-4def-94cc-56ef1de84c4e tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] Request method failure captured: Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 272 Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4n-GwmH9PtK-2Tn_NNwS62BvUOa0CUV6F5FBas0mIPbOmZoslO6eTq6Pf8dl3-fe-mQ-1lfdtG-6NaBDpmysBlTjut5McxcJP68FuPvmsmjV-v9WCy_qRcrMUsnrH3cMQWdw-Ysy5JkuIWw1dvEhgrv6D9ex3ExsEl0rbOTpTcTdko Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 680617eda8724f4a9c44434e61b2c650 Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1891563707 Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/680617eda8724f4a9c44434e61b2c650"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/680617eda8724f4a9c44434e61b2c650"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/680617eda8724f4a9c44434e61b2c650"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_680617eda8724f4a9c44434e61b2c650", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1891563707 Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 680617eda8724f4a9c44434e61b2c650 Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1891563707 Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-KeyPairsNegativeTestJSON-1891563707-project Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 2a98f6d39dcf491fa0442fe7c027c13a Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1891563707-project Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: {"keypair": {"name": "tempest-keypair-102690638", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgyDHxt8j1WltYLnMG69cXL0Y1b2pocs+vrQk6xkNUzTWJJCa4/Nt3l5JzzYoauTeEivSNHJ1suWfz2FQOVMjIW8N6NK0zk3Ccl3jVP8MNnBe7igOzIC0FnSBB16xqoGA=="}} Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: exception: Key pair 'tempest-keypair-102690638' already exists. Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-102690638', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgyDHxt8j1WltYLnMG69cXL0Y1b2pocs+vrQk6xkNUzTWJJCa4/Nt3l5JzzYoauTeEivSNHJ1suWfz2FQOVMjIW8N6NK0zk3Ccl3jVP8MNnBe7igOzIC0FnSBB16xqoGA=='}}} Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result.read() Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '2a98f6d39dcf491fa0442fe7c027c13a-tempest-keypair-102690638' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jun 10 18:14:25.989089 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi kp.save(context.session) Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi session.flush() Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._flush(objects) Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi compat.raise_( Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi flush_context.execute() Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi rec.execute(self) Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi result.read() Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 10 18:14:25.994647 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '2a98f6d39dcf491fa0442fe7c027c13a-tempest-keypair-102690638' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 6, 10, 18, 14, 25, 883279), 'updated_at': None, 'name': 'tempest-keypair-102690638', 'user_id': '2a98f6d39dcf491fa0442fe7c027c13a', 'fingerprint': '7d:b0:18:68:a3:21:42:4d:00:51:7d:45:43:d8:04:4c', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgyDHxt8j1WltYLnMG69cXL0Y1b2pocs+vrQk6xkNUzTWJJCa4/Nt3l5JzzYoauTeEivSNHJ1suWfz2FQOVMjIW8N6NK0zk3Ccl3jVP8MNnBe7igOzIC0FnSBB16xqoGA==', 'type': 'ssh'}] Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6661, in import_key_pair Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi keypair.create() Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._create() Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-102690638' already exists. Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Jun 10 18:14:26.000049 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-102690638' already exists. Jun 10 18:14:26.007166 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:14:26.007166 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:26.007166 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:14:26.007166 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:26.007166 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:26.007166 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:26.007166 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:14:26.007166 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:14:26.007166 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-102690638' already exists. Jun 10 18:14:26.007166 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:14:26.007166 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f62e7288-c16f-4def-94cc-56ef1de84c4e tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] Returning 409 to user: Key pair 'tempest-keypair-102690638' already exists. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:14:26.007166 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f62e7288-c16f-4def-94cc-56ef1de84c4e tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.322393 Jun 10 18:14:26.007166 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2383/4693] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 18:14:25 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 336 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:14:26.034019 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f4e4372f-079d-4620-a96c-a06294050223 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856" status: 200 len: 1452 microversion: 2.1 time: 0.126234 Jun 10 18:14:26.035189 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2311/4694] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:14:25 2022] GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856 => generated 1452 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:26.035673 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0360857e-bf29-4a63-8393-fa8529e9503c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:26.036553 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0360857e-bf29-4a63-8393-fa8529e9503c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:26.058118 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e8aa3c76-448b-4b37-8e88-bf6b3d7a1de9 tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] Calling method '.version_select at 0x7f77c04241f0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:26.066081 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0360857e-bf29-4a63-8393-fa8529e9503c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:26.066853 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0360857e-bf29-4a63-8393-fa8529e9503c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:26.070641 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0360857e-bf29-4a63-8393-fa8529e9503c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:26.071400 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0360857e-bf29-4a63-8393-fa8529e9503c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:26.227872 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e8aa3c76-448b-4b37-8e88-bf6b3d7a1de9 tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-102690638" status: 202 len: 0 microversion: 2.1 time: 0.189939 Jun 10 18:14:26.228504 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2312/4695] 10.222.0.35 () {58 vars in 1217 bytes} [Fri Jun 10 18:14:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-102690638 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:14:26.241064 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6dae13f1-f888-4678-b870-9311f85f676f tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] Action: 'create', calling method: .version_select at 0x7f77c03b23a0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDTShods0wBAzM26+vFxpV1tUZPSaRIwcxvJdxpE5fkgZorQXZ2hadFcvQhfm7HWb4HrBoScoasFgv+e/LePWFgO/c1ZDwf0zMBJI4ikNS0IVkhOZ2TciDWtegk4aHH5hQ=="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6dae13f1-f888-4678-b870-9311f85f676f tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] Request method failure captured: Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 247 Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4n-GwmH9PtK-2Tn_NNwS62BvUOa0CUV6F5FBas0mIPbOmZoslO6eTq6Pf8dl3-fe-mQ-1lfdtG-6NaBDpmysBlTjut5McxcJP68FuPvmsmjV-v9WCy_qRcrMUsnrH3cMQWdw-Ysy5JkuIWw1dvEhgrv6D9ex3ExsEl0rbOTpTcTdko Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 680617eda8724f4a9c44434e61b2c650 Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1891563707 Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/680617eda8724f4a9c44434e61b2c650"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/680617eda8724f4a9c44434e61b2c650"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/680617eda8724f4a9c44434e61b2c650"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_680617eda8724f4a9c44434e61b2c650", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1891563707 Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 680617eda8724f4a9c44434e61b2c650 Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1891563707 Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-KeyPairsNegativeTestJSON-1891563707-project Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 2a98f6d39dcf491fa0442fe7c027c13a Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1891563707-project Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDTShods0wBAzM26+vFxpV1tUZPSaRIwcxvJdxpE5fkgZorQXZ2hadFcvQhfm7HWb4HrBoScoasFgv+e/LePWFgO/c1ZDwf0zMBJI4ikNS0IVkhOZ2TciDWtegk4aHH5hQ=="}} Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: exception: Invalid input for field/attribute name. Value: . '' is too short Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDTShods0wBAzM26+vFxpV1tUZPSaRIwcxvJdxpE5fkgZorQXZ2hadFcvQhfm7HWb4HrBoScoasFgv+e/LePWFgO/c1ZDwf0zMBJI4ikNS0IVkhOZ2TciDWtegk4aHH5hQ=='}}} Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise error Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi '' Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 10 18:14:26.243692 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 10 18:14:26.249446 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 10 18:14:26.249446 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 10 18:14:26.249446 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 10 18:14:26.249446 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 10 18:14:26.249446 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jun 10 18:14:26.249446 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:26.249446 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:26.249446 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:26.249446 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:26.249446 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:26.249446 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:26.249446 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 10 18:14:26.249446 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 10 18:14:26.249446 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jun 10 18:14:26.249446 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:26.249446 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6dae13f1-f888-4678-b870-9311f85f676f tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:14:26.249446 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6dae13f1-f888-4678-b870-9311f85f676f tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.010959 Jun 10 18:14:26.251732 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2313/4696] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 18:14:26 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 10 18:14:26.276263 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-183e6866-b705-44bf-beb0-123170501fdf tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] Action: 'create', calling method: .version_select at 0x7f77c048f310>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2050952199", "public_key": " "}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:14:26.317226 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-183e6866-b705-44bf-beb0-123170501fdf tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] Getting quotas for project 680617eda8724f4a9c44434e61b2c650. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:14:26.327948 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-183e6866-b705-44bf-beb0-123170501fdf tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] Getting quotas for user 2a98f6d39dcf491fa0442fe7c027c13a and project 680617eda8724f4a9c44434e61b2c650. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:14:26.348976 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-183e6866-b705-44bf-beb0-123170501fdf tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-183e6866-b705-44bf-beb0-123170501fdf tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] Request method failure captured: Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 95 Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4n-GwmH9PtK-2Tn_NNwS62BvUOa0CUV6F5FBas0mIPbOmZoslO6eTq6Pf8dl3-fe-mQ-1lfdtG-6NaBDpmysBlTjut5McxcJP68FuPvmsmjV-v9WCy_qRcrMUsnrH3cMQWdw-Ysy5JkuIWw1dvEhgrv6D9ex3ExsEl0rbOTpTcTdko Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 680617eda8724f4a9c44434e61b2c650 Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1891563707 Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/680617eda8724f4a9c44434e61b2c650"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/680617eda8724f4a9c44434e61b2c650"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/680617eda8724f4a9c44434e61b2c650"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_680617eda8724f4a9c44434e61b2c650", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1891563707 Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 680617eda8724f4a9c44434e61b2c650 Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1891563707 Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-KeyPairsNegativeTestJSON-1891563707-project Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 2a98f6d39dcf491fa0442fe7c027c13a Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1891563707-project Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2050952199", "public_key": " "}} Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: exception: Keypair data is invalid: failed to generate fingerprint Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-2050952199', 'public_key': ' '}}} Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:26.351224 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:26.356897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:26.356897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:26.356897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:26.356897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:14:26.356897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:14:26.356897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:14:26.356897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:14:26.356897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:14:26.356897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:14:26.356897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:14:26.356897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:14:26.356897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:14:26.356897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:14:26.356897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jun 10 18:14:26.356897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jun 10 18:14:26.356897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jun 10 18:14:26.356897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jun 10 18:14:26.356897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jun 10 18:14:26.356897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:26.356897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:26.356897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:26.356897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:26.356897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:26.356897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:26.356897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:14:26.356897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:14:26.356897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jun 10 18:14:26.356897 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:26.361511 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-183e6866-b705-44bf-beb0-123170501fdf tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:14:26.362688 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-183e6866-b705-44bf-beb0-123170501fdf tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.106165 Jun 10 18:14:26.363781 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2314/4697] 10.222.0.35 () {60 vars in 1157 bytes} [Fri Jun 10 18:14:26 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 10 18:14:26.384106 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-afde2ef0-c639-4299-b937-61f581b5359f tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] Action: 'create', calling method: .version_select at 0x7f77c04241f0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSx8S05+tUJxAjf6qbAczUfDJvOqrNme9hU3iUhagaoKs6UulYTFOqMRmILcIG9sl3kxfuRPowpgL4XvFC0y+FxL+ekQl1ROUTC3LE8qCw9Us/nEmwd7c77vVvLmja2JA=="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-afde2ef0-c639-4299-b937-61f581b5359f tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] Request method failure captured: Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 507 Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4n-GwmH9PtK-2Tn_NNwS62BvUOa0CUV6F5FBas0mIPbOmZoslO6eTq6Pf8dl3-fe-mQ-1lfdtG-6NaBDpmysBlTjut5McxcJP68FuPvmsmjV-v9WCy_qRcrMUsnrH3cMQWdw-Ysy5JkuIWw1dvEhgrv6D9ex3ExsEl0rbOTpTcTdko Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 680617eda8724f4a9c44434e61b2c650 Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1891563707 Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/680617eda8724f4a9c44434e61b2c650"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/680617eda8724f4a9c44434e61b2c650"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/680617eda8724f4a9c44434e61b2c650"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_680617eda8724f4a9c44434e61b2c650", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1891563707 Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 680617eda8724f4a9c44434e61b2c650 Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1891563707 Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-KeyPairsNegativeTestJSON-1891563707-project Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 2a98f6d39dcf491fa0442fe7c027c13a Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1891563707-project Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSx8S05+tUJxAjf6qbAczUfDJvOqrNme9hU3iUhagaoKs6UulYTFOqMRmILcIG9sl3kxfuRPowpgL4XvFC0y+FxL+ekQl1ROUTC3LE8qCw9Us/nEmwd7c77vVvLmja2JA=="}} Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSx8S05+tUJxAjf6qbAczUfDJvOqrNme9hU3iUhagaoKs6UulYTFOqMRmILcIG9sl3kxfuRPowpgL4XvFC0y+FxL+ekQl1ROUTC3LE8qCw9Us/nEmwd7c77vVvLmja2JA=='}}} Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise error Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Jun 10 18:14:26.393210 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:26.404903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:26.404903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:26.404903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:26.404903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:26.404903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:26.404903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:14:26.404903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:14:26.404903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:14:26.404903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:14:26.404903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:14:26.404903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:14:26.404903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:14:26.404903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:14:26.404903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 10 18:14:26.404903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 10 18:14:26.404903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 10 18:14:26.404903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 10 18:14:26.404903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 10 18:14:26.404903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 10 18:14:26.404903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jun 10 18:14:26.404903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:26.404903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:26.404903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:26.404903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:26.404903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:26.404903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:26.404903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 10 18:14:26.404903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 10 18:14:26.404903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jun 10 18:14:26.404903 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:26.421313 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-afde2ef0-c639-4299-b937-61f581b5359f tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:14:26.422505 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-afde2ef0-c639-4299-b937-61f581b5359f tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.049401 Jun 10 18:14:26.425733 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2315/4698] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 18:14:26 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:14:26.439768 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9dea5994-3d6e-4fbb-8b37-333bd5af7b0f tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] Action: 'create', calling method: .version_select at 0x7f77c02f94c0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1551038010", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:14:26.477751 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-9dea5994-3d6e-4fbb-8b37-333bd5af7b0f tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] Getting quotas for project 680617eda8724f4a9c44434e61b2c650. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:14:26.501906 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-9dea5994-3d6e-4fbb-8b37-333bd5af7b0f tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] Getting quotas for user 2a98f6d39dcf491fa0442fe7c027c13a and project 680617eda8724f4a9c44434e61b2c650. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:14:26.520018 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-9dea5994-3d6e-4fbb-8b37-333bd5af7b0f tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9dea5994-3d6e-4fbb-8b37-333bd5af7b0f tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] Request method failure captured: Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 118 Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4n-GwmH9PtK-2Tn_NNwS62BvUOa0CUV6F5FBas0mIPbOmZoslO6eTq6Pf8dl3-fe-mQ-1lfdtG-6NaBDpmysBlTjut5McxcJP68FuPvmsmjV-v9WCy_qRcrMUsnrH3cMQWdw-Ysy5JkuIWw1dvEhgrv6D9ex3ExsEl0rbOTpTcTdko Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 680617eda8724f4a9c44434e61b2c650 Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1891563707 Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/680617eda8724f4a9c44434e61b2c650"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/680617eda8724f4a9c44434e61b2c650"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/680617eda8724f4a9c44434e61b2c650"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_680617eda8724f4a9c44434e61b2c650", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1891563707 Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 680617eda8724f4a9c44434e61b2c650 Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1891563707 Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-KeyPairsNegativeTestJSON-1891563707-project Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 2a98f6d39dcf491fa0442fe7c027c13a Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1891563707-project Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1551038010", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: exception: Keypair data is invalid: failed to generate fingerprint Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1551038010', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jun 10 18:14:26.522505 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jun 10 18:14:26.528095 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jun 10 18:14:26.528095 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jun 10 18:14:26.528095 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jun 10 18:14:26.528095 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:26.528095 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:26.528095 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:26.528095 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:26.528095 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:26.528095 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:26.528095 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:14:26.528095 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:14:26.528095 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:14:26.528095 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:14:26.528095 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:14:26.528095 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:14:26.528095 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:14:26.528095 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:14:26.528095 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:14:26.528095 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:14:26.528095 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jun 10 18:14:26.528095 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jun 10 18:14:26.528095 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jun 10 18:14:26.528095 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jun 10 18:14:26.528095 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jun 10 18:14:26.528095 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:26.528095 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:26.528095 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:26.528095 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:26.528095 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:26.528095 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:26.528095 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:14:26.528095 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:14:26.528095 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jun 10 18:14:26.528095 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:26.533736 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9dea5994-3d6e-4fbb-8b37-333bd5af7b0f tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:14:26.534084 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9dea5994-3d6e-4fbb-8b37-333bd5af7b0f tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.100652 Jun 10 18:14:26.535356 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2316/4699] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 18:14:26 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 10 18:14:26.547233 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f0e11d96-53a4-4e51-ba22-f7313a983b50 tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] Calling method '.version_select at 0x7f77c02f9940>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:26.556088 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0360857e-bf29-4a63-8393-fa8529e9503c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:26.566776 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0360857e-bf29-4a63-8393-fa8529e9503c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:26.585552 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-f0e11d96-53a4-4e51-ba22-f7313a983b50 tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-448438144 not found for user 2a98f6d39dcf491fa0442fe7c027c13a Jun 10 18:14:26.585907 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0360857e-bf29-4a63-8393-fa8529e9503c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:26.585907 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0360857e-bf29-4a63-8393-fa8529e9503c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1886 microversion: 2.42 time: 0.568913 Jun 10 18:14:26.585907 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2384/4700] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:14:26 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1886 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f0e11d96-53a4-4e51-ba22-f7313a983b50 tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] Request method failure captured: Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-448438144 HTTP/1.1 Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4n-GwmH9PtK-2Tn_NNwS62BvUOa0CUV6F5FBas0mIPbOmZoslO6eTq6Pf8dl3-fe-mQ-1lfdtG-6NaBDpmysBlTjut5McxcJP68FuPvmsmjV-v9WCy_qRcrMUsnrH3cMQWdw-Ysy5JkuIWw1dvEhgrv6D9ex3ExsEl0rbOTpTcTdko Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 680617eda8724f4a9c44434e61b2c650 Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1891563707 Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/680617eda8724f4a9c44434e61b2c650"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/680617eda8724f4a9c44434e61b2c650"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/680617eda8724f4a9c44434e61b2c650"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_680617eda8724f4a9c44434e61b2c650", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1891563707 Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 680617eda8724f4a9c44434e61b2c650 Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1891563707 Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-KeyPairsNegativeTestJSON-1891563707-project Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 2a98f6d39dcf491fa0442fe7c027c13a Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1891563707-project Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: exception: Keypair tempest-keypair-non-existent-448438144 not found for user 2a98f6d39dcf491fa0442fe7c027c13a Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'tempest-keypair-non-existent-448438144'} Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise self.value Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-448438144 not found for user 2a98f6d39dcf491fa0442fe7c027c13a Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:26.588236 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:26.594060 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:26.594060 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:26.594060 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:26.594060 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:26.594060 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:14:26.594060 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:14:26.594060 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:14:26.594060 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:14:26.594060 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 10 18:14:26.594060 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:14:26.594060 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:14:26.594060 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:14:26.594060 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jun 10 18:14:26.594060 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jun 10 18:14:26.594060 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jun 10 18:14:26.594060 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jun 10 18:14:26.594060 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-448438144 not found for user 2a98f6d39dcf491fa0442fe7c027c13a Jun 10 18:14:26.594060 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:26.594060 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:26.594060 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:26.594060 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:26.594060 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:26.594060 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:26.594060 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:14:26.594060 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:14:26.594060 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-448438144 not found for user 2a98f6d39dcf491fa0442fe7c027c13a Jun 10 18:14:26.594060 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:26.606867 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f0e11d96-53a4-4e51-ba22-f7313a983b50 tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] Returning 404 to user: Keypair tempest-keypair-non-existent-448438144 not found for user 2a98f6d39dcf491fa0442fe7c027c13a {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:14:26.606867 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f0e11d96-53a4-4e51-ba22-f7313a983b50 tempest-KeyPairsNegativeTestJSON-1891563707 tempest-KeyPairsNegativeTestJSON-1891563707-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-448438144" status: 404 len: 144 microversion: 2.1 time: 0.063580 Jun 10 18:14:26.608478 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2317/4701] 10.222.0.35 () {58 vars in 1256 bytes} [Fri Jun 10 18:14:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-448438144 => generated 144 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:14:26.677586 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1bba3432-2eb2-48f9-8dfe-c026b5491074 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:26.678493 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1bba3432-2eb2-48f9-8dfe-c026b5491074 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:26.744720 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-dac0838e-6afd-49de-a99d-fb8b04ee3275 req-54b516da-5c60-49b1-9bbd-b09b6a22059f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ceaaf7b-0972-4fe5-bd63-5534a71f80d3", "tag": "2fae9b12-2883-43bb-8d97-3bb827dd8497"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:14:26.799237 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-dac0838e-6afd-49de-a99d-fb8b04ee3275 req-54b516da-5c60-49b1-9bbd-b09b6a22059f service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:26.801635 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-dac0838e-6afd-49de-a99d-fb8b04ee3275 req-54b516da-5c60-49b1-9bbd-b09b6a22059f service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:26.863966 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-dac0838e-6afd-49de-a99d-fb8b04ee3275 req-54b516da-5c60-49b1-9bbd-b09b6a22059f service nova] Creating event network-changed:2fae9b12-2883-43bb-8d97-3bb827dd8497 for instance 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 on chh2-master-2 Jun 10 18:14:26.903957 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1bba3432-2eb2-48f9-8dfe-c026b5491074 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:26.904738 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-dac0838e-6afd-49de-a99d-fb8b04ee3275 req-54b516da-5c60-49b1-9bbd-b09b6a22059f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162803 Jun 10 18:14:26.908815 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2318/4702] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:14:26.914183 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1bba3432-2eb2-48f9-8dfe-c026b5491074 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1244 microversion: 2.1 time: 0.241609 Jun 10 18:14:26.915324 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2385/4703] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:26 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1244 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:27.048631 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ae3bec53-cd09-46c0-95fa-3cfd1c68038b tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c03b28b0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:27.177167 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ae3bec53-cd09-46c0-95fa-3cfd1c68038b tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856" status: 200 len: 1452 microversion: 2.1 time: 0.133261 Jun 10 18:14:27.184248 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2319/4704] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:14:27 2022] GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856 => generated 1452 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:27.596154 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5016ad76-44d0-4414-a567-4656a9522fe7 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:27.597369 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5016ad76-44d0-4414-a567-4656a9522fe7 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:27.634402 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5016ad76-44d0-4414-a567-4656a9522fe7 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:27.634866 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5016ad76-44d0-4414-a567-4656a9522fe7 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:27.635666 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5016ad76-44d0-4414-a567-4656a9522fe7 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:27.636117 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5016ad76-44d0-4414-a567-4656a9522fe7 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:27.936130 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4c07ce5c-39dd-407c-9cb2-78716ee4a1ac tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:27.940436 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4c07ce5c-39dd-407c-9cb2-78716ee4a1ac tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:27.962559 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4c07ce5c-39dd-407c-9cb2-78716ee4a1ac tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:27.969719 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4c07ce5c-39dd-407c-9cb2-78716ee4a1ac tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:27.970828 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4c07ce5c-39dd-407c-9cb2-78716ee4a1ac tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:27.971450 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4c07ce5c-39dd-407c-9cb2-78716ee4a1ac tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:28.294300 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5016ad76-44d0-4414-a567-4656a9522fe7 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:28.294862 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4c07ce5c-39dd-407c-9cb2-78716ee4a1ac tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:28.305144 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4c07ce5c-39dd-407c-9cb2-78716ee4a1ac tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1240 microversion: 2.1 time: 0.373974 Jun 10 18:14:28.308631 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2320/4705] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:27 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1240 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:28.327680 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-77ee71db-7dfd-4ee7-8efa-de9a1a04ac4d tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c6175670>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:28.330874 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5016ad76-44d0-4414-a567-4656a9522fe7 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:28.338069 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5016ad76-44d0-4414-a567-4656a9522fe7 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:28.346690 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5016ad76-44d0-4414-a567-4656a9522fe7 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1886 microversion: 2.42 time: 0.750722 Jun 10 18:14:28.347378 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2386/4706] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:14:27 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1886 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:14:28.408409 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-77ee71db-7dfd-4ee7-8efa-de9a1a04ac4d tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856" status: 200 len: 1452 microversion: 2.1 time: 0.098360 Jun 10 18:14:28.412964 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2321/4707] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:14:28 2022] GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856 => generated 1452 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:29.323761 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9cb21008-f2df-4253-97ab-21c1249f834a tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:29.326840 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9cb21008-f2df-4253-97ab-21c1249f834a tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:29.372210 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-29ff21a0-6dbe-47ab-90d9-66df681e2248 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:29.378373 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-29ff21a0-6dbe-47ab-90d9-66df681e2248 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:29.403532 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9cb21008-f2df-4253-97ab-21c1249f834a tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:29.407758 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9cb21008-f2df-4253-97ab-21c1249f834a tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:29.411172 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9cb21008-f2df-4253-97ab-21c1249f834a tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:29.415295 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9cb21008-f2df-4253-97ab-21c1249f834a tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:29.421865 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-29ff21a0-6dbe-47ab-90d9-66df681e2248 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:29.433023 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-29ff21a0-6dbe-47ab-90d9-66df681e2248 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:29.434786 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-29ff21a0-6dbe-47ab-90d9-66df681e2248 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:29.444550 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-29ff21a0-6dbe-47ab-90d9-66df681e2248 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:29.562363 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9cb21008-f2df-4253-97ab-21c1249f834a tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:29.574352 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9cb21008-f2df-4253-97ab-21c1249f834a tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1314 microversion: 2.1 time: 0.254764 Jun 10 18:14:29.574954 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2387/4708] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:29 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:29.580288 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-30ac7fa0-febc-4e0a-bfaa-6f57ff80bc47 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3c65dc0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:29.639537 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-30ac7fa0-febc-4e0a-bfaa-6f57ff80bc47 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856" status: 200 len: 1452 microversion: 2.1 time: 0.063116 Jun 10 18:14:29.640185 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2388/4709] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:14:29 2022] GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856 => generated 1452 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:30.249621 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-29ff21a0-6dbe-47ab-90d9-66df681e2248 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:30.263948 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-29ff21a0-6dbe-47ab-90d9-66df681e2248 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:30.267890 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-29ff21a0-6dbe-47ab-90d9-66df681e2248 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:30.269168 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-29ff21a0-6dbe-47ab-90d9-66df681e2248 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1886 microversion: 2.42 time: 0.906747 Jun 10 18:14:30.269743 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2322/4710] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:14:29 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1886 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:14:30.309465 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0bb315f4-46ce-438a-8449-ccdb3c63ab99 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:30.309974 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0bb315f4-46ce-438a-8449-ccdb3c63ab99 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 74e411c5-d389-4307-99fd-a6cf439f1c61] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:30.326405 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0bb315f4-46ce-438a-8449-ccdb3c63ab99 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:30.327115 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0bb315f4-46ce-438a-8449-ccdb3c63ab99 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:30.327774 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0bb315f4-46ce-438a-8449-ccdb3c63ab99 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:30.328818 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0bb315f4-46ce-438a-8449-ccdb3c63ab99 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:30.361753 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-0bb315f4-46ce-438a-8449-ccdb3c63ab99 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] HTTP exception thrown: Instance 74e411c5-d389-4307-99fd-a6cf439f1c61 could not be found. Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0bb315f4-46ce-438a-8449-ccdb3c63ab99 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: request: DELETE /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61 HTTP/1.1 Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 74e411c5-d389-4307-99fd-a6cf439f1c61 could not be found. Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '74e411c5-d389-4307-99fd-a6cf439f1c61'} Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74e411c5-d389-4307-99fd-a6cf439f1c61 could not be found. Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:14:30.363496 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:14:30.368391 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74e411c5-d389-4307-99fd-a6cf439f1c61 could not be found. Jun 10 18:14:30.368391 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:14:30.368391 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:30.368391 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:14:30.368391 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:30.368391 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:30.368391 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:30.368391 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:14:30.368391 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:14:30.368391 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74e411c5-d389-4307-99fd-a6cf439f1c61 could not be found. Jun 10 18:14:30.368391 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:14:30.368391 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0bb315f4-46ce-438a-8449-ccdb3c63ab99 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 404 to user: Instance 74e411c5-d389-4307-99fd-a6cf439f1c61 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:14:30.368391 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0bb315f4-46ce-438a-8449-ccdb3c63ab99 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "DELETE /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61" status: 404 len: 111 microversion: 2.1 time: 0.059599 Jun 10 18:14:30.368391 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2389/4711] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:14:30 2022] DELETE /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:14:30.374202 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-877b1eea-caef-4ecf-903a-ce967a920c6e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:30.374796 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-877b1eea-caef-4ecf-903a-ce967a920c6e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 74e411c5-d389-4307-99fd-a6cf439f1c61] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:30.385008 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-877b1eea-caef-4ecf-903a-ce967a920c6e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:30.385471 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-877b1eea-caef-4ecf-903a-ce967a920c6e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:30.386280 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-877b1eea-caef-4ecf-903a-ce967a920c6e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:30.386814 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-877b1eea-caef-4ecf-903a-ce967a920c6e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:30.438748 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-877b1eea-caef-4ecf-903a-ce967a920c6e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] HTTP exception thrown: Instance 74e411c5-d389-4307-99fd-a6cf439f1c61 could not be found. Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-877b1eea-caef-4ecf-903a-ce967a920c6e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61 HTTP/1.1 Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 74e411c5-d389-4307-99fd-a6cf439f1c61 could not be found. Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '74e411c5-d389-4307-99fd-a6cf439f1c61'} Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74e411c5-d389-4307-99fd-a6cf439f1c61 could not be found. Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74e411c5-d389-4307-99fd-a6cf439f1c61 could not be found. Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:30.441145 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:30.447138 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:30.447138 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:30.447138 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:30.447138 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:14:30.447138 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:14:30.447138 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74e411c5-d389-4307-99fd-a6cf439f1c61 could not be found. Jun 10 18:14:30.447138 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:14:30.449463 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-877b1eea-caef-4ecf-903a-ce967a920c6e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 404 to user: Instance 74e411c5-d389-4307-99fd-a6cf439f1c61 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:14:30.451432 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-877b1eea-caef-4ecf-903a-ce967a920c6e tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61" status: 404 len: 111 microversion: 2.1 time: 0.080817 Jun 10 18:14:30.452597 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2323/4712] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:30 2022] GET /compute/v2.1/servers/74e411c5-d389-4307-99fd-a6cf439f1c61 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:14:30.461790 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-90c26f31-b649-4e54-89bc-3757347c6bbf tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:30.462178 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-90c26f31-b649-4e54-89bc-3757347c6bbf tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:30.474975 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90c26f31-b649-4e54-89bc-3757347c6bbf tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:30.475447 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90c26f31-b649-4e54-89bc-3757347c6bbf tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:30.476260 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90c26f31-b649-4e54-89bc-3757347c6bbf tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:30.476721 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90c26f31-b649-4e54-89bc-3757347c6bbf tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:30.530977 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-90c26f31-b649-4e54-89bc-3757347c6bbf tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:14:30.599368 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-084c3d40-bb25-48e4-b2f5-f0d94463a475 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:30.599997 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-084c3d40-bb25-48e4-b2f5-f0d94463a475 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:30.617289 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-084c3d40-bb25-48e4-b2f5-f0d94463a475 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:30.617748 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-084c3d40-bb25-48e4-b2f5-f0d94463a475 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:30.618534 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-084c3d40-bb25-48e4-b2f5-f0d94463a475 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:30.618976 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-084c3d40-bb25-48e4-b2f5-f0d94463a475 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:30.795195 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:14:30.993872 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-084c3d40-bb25-48e4-b2f5-f0d94463a475 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:31.004850 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-084c3d40-bb25-48e4-b2f5-f0d94463a475 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1302 microversion: 2.1 time: 0.409528 Jun 10 18:14:31.005391 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2324/4713] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:30 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1302 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:14:31.032837 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0bc23739-feab-4683-aff5-9da9b8c66f2e tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c0301820>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:31.096958 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0bc23739-feab-4683-aff5-9da9b8c66f2e tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856" status: 200 len: 1452 microversion: 2.1 time: 0.090463 Jun 10 18:14:31.097550 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2325/4714] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:14:31 2022] GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856 => generated 1452 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:31.097876 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-90c26f31-b649-4e54-89bc-3757347c6bbf tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "DELETE /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 204 len: 0 microversion: 2.1 time: 0.640029 Jun 10 18:14:31.103149 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2390/4715] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:14:30 2022] DELETE /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:14:31.108840 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8b5793e0-1d0f-44b9-8d29-d1ae366e5af2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:31.110825 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8b5793e0-1d0f-44b9-8d29-d1ae366e5af2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:31.126415 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8b5793e0-1d0f-44b9-8d29-d1ae366e5af2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:31.127856 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8b5793e0-1d0f-44b9-8d29-d1ae366e5af2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:31.130747 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8b5793e0-1d0f-44b9-8d29-d1ae366e5af2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:31.131828 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8b5793e0-1d0f-44b9-8d29-d1ae366e5af2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:31.299002 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a21b6cb5-96ff-495a-8ca1-33eff8339674 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:31.299749 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a21b6cb5-96ff-495a-8ca1-33eff8339674 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:31.319317 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a21b6cb5-96ff-495a-8ca1-33eff8339674 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:31.319787 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a21b6cb5-96ff-495a-8ca1-33eff8339674 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:31.320648 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a21b6cb5-96ff-495a-8ca1-33eff8339674 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:31.321099 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a21b6cb5-96ff-495a-8ca1-33eff8339674 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:31.559484 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8b5793e0-1d0f-44b9-8d29-d1ae366e5af2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:31.574448 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8b5793e0-1d0f-44b9-8d29-d1ae366e5af2 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1512 microversion: 2.1 time: 0.470701 Jun 10 18:14:31.575334 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2391/4716] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:31 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1512 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:32.024297 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5472b84a-8f6a-433d-8058-2daf39602e66 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:32.025192 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5472b84a-8f6a-433d-8058-2daf39602e66 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:32.030657 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:14:32.040789 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5472b84a-8f6a-433d-8058-2daf39602e66 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:32.045359 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5472b84a-8f6a-433d-8058-2daf39602e66 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:32.045359 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5472b84a-8f6a-433d-8058-2daf39602e66 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:32.047614 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5472b84a-8f6a-433d-8058-2daf39602e66 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:32.188898 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5472b84a-8f6a-433d-8058-2daf39602e66 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:32.201706 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5472b84a-8f6a-433d-8058-2daf39602e66 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1302 microversion: 2.1 time: 0.182834 Jun 10 18:14:32.202303 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2392/4717] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:32 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1302 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:14:32.225149 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-200b6365-e6d7-4878-aa92-ff03ca23bb9d tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3afff70>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:32.324234 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-200b6365-e6d7-4878-aa92-ff03ca23bb9d tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856" status: 200 len: 1452 microversion: 2.1 time: 0.110552 Jun 10 18:14:32.325125 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2393/4718] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:14:32 2022] GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856 => generated 1452 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:32.537361 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a21b6cb5-96ff-495a-8ca1-33eff8339674 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:32.547627 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a21b6cb5-96ff-495a-8ca1-33eff8339674 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:32.556217 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a21b6cb5-96ff-495a-8ca1-33eff8339674 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:32.557578 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a21b6cb5-96ff-495a-8ca1-33eff8339674 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1886 microversion: 2.42 time: 1.264427 Jun 10 18:14:32.559948 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2326/4719] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:14:31 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1886 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:14:32.596444 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-16033773-0014-466c-942a-0a59f3ba0c04 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:32.597160 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-16033773-0014-466c-942a-0a59f3ba0c04 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:32.658048 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-16033773-0014-466c-942a-0a59f3ba0c04 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:32.663310 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-16033773-0014-466c-942a-0a59f3ba0c04 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:32.664186 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-16033773-0014-466c-942a-0a59f3ba0c04 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:32.667747 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-16033773-0014-466c-942a-0a59f3ba0c04 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:33.062167 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-16033773-0014-466c-942a-0a59f3ba0c04 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:33.079420 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-16033773-0014-466c-942a-0a59f3ba0c04 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1512 microversion: 2.1 time: 0.491021 Jun 10 18:14:33.081476 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2394/4720] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:32 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1512 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:33.220524 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b0290897-1c58-47fa-963c-a977dc0f3995 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:33.222890 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b0290897-1c58-47fa-963c-a977dc0f3995 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:33.231627 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b0290897-1c58-47fa-963c-a977dc0f3995 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:33.236461 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b0290897-1c58-47fa-963c-a977dc0f3995 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:33.237691 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b0290897-1c58-47fa-963c-a977dc0f3995 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:33.238145 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b0290897-1c58-47fa-963c-a977dc0f3995 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:33.338471 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cba82622-846c-4aa1-9a54-7c2e07efedd0 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3aa24c0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:33.447546 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cba82622-846c-4aa1-9a54-7c2e07efedd0 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856" status: 200 len: 1452 microversion: 2.1 time: 0.113620 Jun 10 18:14:33.458706 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2395/4721] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:14:33 2022] GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856 => generated 1452 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:14:33.582221 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-929200ca-e5cb-481c-9c18-1d425aac89c7 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:33.583589 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-929200ca-e5cb-481c-9c18-1d425aac89c7 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:33.601708 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-929200ca-e5cb-481c-9c18-1d425aac89c7 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:33.603024 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-929200ca-e5cb-481c-9c18-1d425aac89c7 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:33.605253 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-929200ca-e5cb-481c-9c18-1d425aac89c7 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:33.606373 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-929200ca-e5cb-481c-9c18-1d425aac89c7 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:33.952085 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b0290897-1c58-47fa-963c-a977dc0f3995 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:33.965391 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b0290897-1c58-47fa-963c-a977dc0f3995 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1369 microversion: 2.1 time: 0.750061 Jun 10 18:14:33.966027 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2327/4722] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:33 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1369 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:34.099349 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4b370412-6204-4a0d-9b92-3ffea98c3347 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:34.100190 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4b370412-6204-4a0d-9b92-3ffea98c3347 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:34.115939 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4b370412-6204-4a0d-9b92-3ffea98c3347 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:34.116709 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4b370412-6204-4a0d-9b92-3ffea98c3347 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:34.118922 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4b370412-6204-4a0d-9b92-3ffea98c3347 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:34.126635 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4b370412-6204-4a0d-9b92-3ffea98c3347 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:34.205501 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-929200ca-e5cb-481c-9c18-1d425aac89c7 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:34.219088 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-929200ca-e5cb-481c-9c18-1d425aac89c7 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:34.230167 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-929200ca-e5cb-481c-9c18-1d425aac89c7 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:34.231753 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-929200ca-e5cb-481c-9c18-1d425aac89c7 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1886 microversion: 2.42 time: 0.656736 Jun 10 18:14:34.237475 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2396/4723] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:14:33 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1886 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:14:34.246482 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-70df09a9-96e1-41c7-9acd-f8b35ca954fa req-26102c3f-6f80-4da6-9f1a-8ee4f6526713 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89cea229-7bfb-43e4-a855-e9c6ae81d37b", "name": "network-vif-plugged", "status": "completed", "tag": "6aa82b06-065f-4482-b2de-d6771acbe4bb"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:14:34.267966 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-70df09a9-96e1-41c7-9acd-f8b35ca954fa req-26102c3f-6f80-4da6-9f1a-8ee4f6526713 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:34.271820 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-70df09a9-96e1-41c7-9acd-f8b35ca954fa req-26102c3f-6f80-4da6-9f1a-8ee4f6526713 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:34.323340 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-70df09a9-96e1-41c7-9acd-f8b35ca954fa req-26102c3f-6f80-4da6-9f1a-8ee4f6526713 service nova] Creating event network-vif-plugged:6aa82b06-065f-4482-b2de-d6771acbe4bb for instance 89cea229-7bfb-43e4-a855-e9c6ae81d37b on chh2-master-2 Jun 10 18:14:34.340706 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-70df09a9-96e1-41c7-9acd-f8b35ca954fa req-26102c3f-6f80-4da6-9f1a-8ee4f6526713 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105726 Jun 10 18:14:34.342910 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2397/4724] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:14:34.467457 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3eba1bdc-d659-4729-96a3-1e917f526632 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3ab6430>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:34.546201 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3eba1bdc-d659-4729-96a3-1e917f526632 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856" status: 200 len: 1452 microversion: 2.1 time: 0.088454 Jun 10 18:14:34.547044 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2398/4725] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:14:34 2022] GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856 => generated 1452 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:34.979619 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:14:34.990413 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cdb5101a-f1e1-4352-bf97-1b07437b6648 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:34.992179 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cdb5101a-f1e1-4352-bf97-1b07437b6648 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:35.009471 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cdb5101a-f1e1-4352-bf97-1b07437b6648 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:35.009935 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cdb5101a-f1e1-4352-bf97-1b07437b6648 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:35.010730 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cdb5101a-f1e1-4352-bf97-1b07437b6648 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:35.011250 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cdb5101a-f1e1-4352-bf97-1b07437b6648 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:35.235175 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4b370412-6204-4a0d-9b92-3ffea98c3347 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824b7a76a5641b7b6f338ee052f6e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1089f87ad8fc4f1ca82ee23dfd567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:35.253500 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4b370412-6204-4a0d-9b92-3ffea98c3347 tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 200 len: 1512 microversion: 2.1 time: 1.158324 Jun 10 18:14:35.254338 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2328/4726] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:34 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 1512 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:35.260255 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-b1d45451-8e7e-4681-97b6-8d1f051565cd req-20835cd9-0c92-4461-8c3f-c2354dcb47a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57a377b2-f75e-4a0c-8401-090db42db644", "name": "network-vif-deleted", "tag": "ea23750f-0e21-482f-b68f-6361eeb3c636"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:14:35.270878 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-b1d45451-8e7e-4681-97b6-8d1f051565cd req-20835cd9-0c92-4461-8c3f-c2354dcb47a0 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:35.271462 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-b1d45451-8e7e-4681-97b6-8d1f051565cd req-20835cd9-0c92-4461-8c3f-c2354dcb47a0 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:35.288577 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-b1d45451-8e7e-4681-97b6-8d1f051565cd req-20835cd9-0c92-4461-8c3f-c2354dcb47a0 service nova] Creating event network-vif-deleted:ea23750f-0e21-482f-b68f-6361eeb3c636 for instance 57a377b2-f75e-4a0c-8401-090db42db644 on chh2-master-2 Jun 10 18:14:35.295679 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-b1d45451-8e7e-4681-97b6-8d1f051565cd req-20835cd9-0c92-4461-8c3f-c2354dcb47a0 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039512 Jun 10 18:14:35.296409 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2329/4727] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:14:35.304491 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1ff8c0e9-faf2-410e-87a8-3ff913c2eccd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:35.305428 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1ff8c0e9-faf2-410e-87a8-3ff913c2eccd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:35.312882 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1ff8c0e9-faf2-410e-87a8-3ff913c2eccd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:35.313635 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1ff8c0e9-faf2-410e-87a8-3ff913c2eccd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:35.314732 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1ff8c0e9-faf2-410e-87a8-3ff913c2eccd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:35.315406 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1ff8c0e9-faf2-410e-87a8-3ff913c2eccd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:35.339713 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:14:35.508148 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cdb5101a-f1e1-4352-bf97-1b07437b6648 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:35.527743 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cdb5101a-f1e1-4352-bf97-1b07437b6648 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1369 microversion: 2.1 time: 0.549602 Jun 10 18:14:35.534645 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2399/4728] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:34 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1369 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:35.560466 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0d89108a-140a-44e7-8cfb-0f473d3174a4 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3aa2550>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:35.653190 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0d89108a-140a-44e7-8cfb-0f473d3174a4 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856" status: 200 len: 1452 microversion: 2.1 time: 0.097877 Jun 10 18:14:35.654292 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2400/4729] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:14:35 2022] GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856 => generated 1452 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:14:36.020335 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1ff8c0e9-faf2-410e-87a8-3ff913c2eccd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:36.030892 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1ff8c0e9-faf2-410e-87a8-3ff913c2eccd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:36.061527 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1ff8c0e9-faf2-410e-87a8-3ff913c2eccd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:36.070012 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1ff8c0e9-faf2-410e-87a8-3ff913c2eccd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1886 microversion: 2.42 time: 0.772029 Jun 10 18:14:36.070550 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2330/4730] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:14:35 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1886 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:14:36.288730 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1f9431dc-8b95-43d7-8e50-9c3dc073d1aa tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:36.290207 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1f9431dc-8b95-43d7-8e50-9c3dc073d1aa tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] [instance: 57a377b2-f75e-4a0c-8401-090db42db644] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:36.320616 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1f9431dc-8b95-43d7-8e50-9c3dc073d1aa tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:36.324964 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1f9431dc-8b95-43d7-8e50-9c3dc073d1aa tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:36.325890 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1f9431dc-8b95-43d7-8e50-9c3dc073d1aa tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:36.331538 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1f9431dc-8b95-43d7-8e50-9c3dc073d1aa tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:36.381510 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-1f9431dc-8b95-43d7-8e50-9c3dc073d1aa tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] HTTP exception thrown: Instance 57a377b2-f75e-4a0c-8401-090db42db644 could not be found. Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1f9431dc-8b95-43d7-8e50-9c3dc073d1aa tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Request method failure captured: Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 HTTP/1.1 Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4kYqBtcAar0l9MvhEXHHJkBCZJCle4pj6F-9AKLrjQYzf7QIx-0KkUHARTxg_IWWBx0x-gnzq0nvlolBrO2Z7xHDBEu7pkz4c63R8Tj1kQoPWhUeDBM0nmyEZWDdsAAcYRYe0uhuda1x_Sgg9B5hbqPu8aL8ZGcu8gpddnQ2_OZPP8 Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1089f87ad8fc4f1ca82ee23dfd567b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1089f87ad8fc4f1ca82ee23dfd567b1b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 1089f87ad8fc4f1ca82ee23dfd567b1b Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1784199196 Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 3824b7a76a5641b7b6f338ee052f6e94 Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersNegativeTestJSON-1784199196-project Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 57a377b2-f75e-4a0c-8401-090db42db644 could not be found. Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '57a377b2-f75e-4a0c-8401-090db42db644'} Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57a377b2-f75e-4a0c-8401-090db42db644 could not be found. Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57a377b2-f75e-4a0c-8401-090db42db644 could not be found. Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:14:36.405615 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:14:36.411824 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:14:36.411824 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:14:36.411824 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:14:36.411824 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:14:36.411824 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:14:36.411824 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57a377b2-f75e-4a0c-8401-090db42db644 could not be found. Jun 10 18:14:36.411824 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:14:36.426016 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1f9431dc-8b95-43d7-8e50-9c3dc073d1aa tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] Returning 404 to user: Instance 57a377b2-f75e-4a0c-8401-090db42db644 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:14:36.427932 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1f9431dc-8b95-43d7-8e50-9c3dc073d1aa tempest-ServersNegativeTestJSON-1784199196 tempest-ServersNegativeTestJSON-1784199196-project] 10.222.0.35 "GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644" status: 404 len: 111 microversion: 2.1 time: 0.157747 Jun 10 18:14:36.428702 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2401/4731] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:36 2022] GET /compute/v2.1/servers/57a377b2-f75e-4a0c-8401-090db42db644 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:14:36.546341 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-878a752b-1c34-41c0-af64-b6c173b687f7 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:36.547917 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-878a752b-1c34-41c0-af64-b6c173b687f7 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:36.565840 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=12 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:14:36.576923 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-878a752b-1c34-41c0-af64-b6c173b687f7 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:36.576923 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-878a752b-1c34-41c0-af64-b6c173b687f7 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:36.576923 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-878a752b-1c34-41c0-af64-b6c173b687f7 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:36.576923 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-878a752b-1c34-41c0-af64-b6c173b687f7 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:36.666111 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a82936b2-900f-4e6a-bcc7-23b2d362c1e7 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3a4f280>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:36.750155 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a82936b2-900f-4e6a-bcc7-23b2d362c1e7 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856" status: 200 len: 1452 microversion: 2.1 time: 0.087574 Jun 10 18:14:36.755563 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2402/4732] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:14:36 2022] GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856 => generated 1452 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:14:37.086088 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=18 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:14:37.091218 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9e17e248-35e4-4a5c-87b4-20835f95b7a2 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:37.092102 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9e17e248-35e4-4a5c-87b4-20835f95b7a2 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:37.103264 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9e17e248-35e4-4a5c-87b4-20835f95b7a2 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:37.107146 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9e17e248-35e4-4a5c-87b4-20835f95b7a2 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:37.110119 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9e17e248-35e4-4a5c-87b4-20835f95b7a2 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:37.116863 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9e17e248-35e4-4a5c-87b4-20835f95b7a2 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:37.648966 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9e17e248-35e4-4a5c-87b4-20835f95b7a2 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:37.670457 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9e17e248-35e4-4a5c-87b4-20835f95b7a2 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:37.673505 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9e17e248-35e4-4a5c-87b4-20835f95b7a2 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:37.685056 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9e17e248-35e4-4a5c-87b4-20835f95b7a2 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1874 microversion: 2.42 time: 0.592126 Jun 10 18:14:37.688221 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2403/4733] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:14:37 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1874 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:14:37.765262 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bfaa3141-a757-42b3-b610-76b29968cae2 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3a4a040>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:37.850387 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bfaa3141-a757-42b3-b610-76b29968cae2 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856" status: 200 len: 1452 microversion: 2.1 time: 0.090939 Jun 10 18:14:37.851787 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2404/4734] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:14:37 2022] GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856 => generated 1452 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:14:38.068953 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-878a752b-1c34-41c0-af64-b6c173b687f7 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:38.080500 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-878a752b-1c34-41c0-af64-b6c173b687f7 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1369 microversion: 2.1 time: 1.538442 Jun 10 18:14:38.081831 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2331/4735] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:36 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1369 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:38.582052 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-9c8ae1ba-a27d-4e08-8934-7da9a7ca4ed7 req-b0e22c68-e148-4d92-89e3-e54b08505f69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0732433-a140-4237-9d7f-7dd24c7dbb79", "tag": "f3cd9e4d-9709-4d83-9727-349dd9939d0e"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:14:38.601409 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-9c8ae1ba-a27d-4e08-8934-7da9a7ca4ed7 req-b0e22c68-e148-4d92-89e3-e54b08505f69 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:38.602153 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-9c8ae1ba-a27d-4e08-8934-7da9a7ca4ed7 req-b0e22c68-e148-4d92-89e3-e54b08505f69 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:38.626567 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-9c8ae1ba-a27d-4e08-8934-7da9a7ca4ed7 req-b0e22c68-e148-4d92-89e3-e54b08505f69 service nova] Creating event network-changed:f3cd9e4d-9709-4d83-9727-349dd9939d0e for instance f0732433-a140-4237-9d7f-7dd24c7dbb79 on chh1-master-2 Jun 10 18:14:38.645877 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-9c8ae1ba-a27d-4e08-8934-7da9a7ca4ed7 req-b0e22c68-e148-4d92-89e3-e54b08505f69 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070667 Jun 10 18:14:38.647208 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2405/4736] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:14:38.708061 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e396a0e5-0580-466a-a45e-d8a9a70521fd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:38.709194 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e396a0e5-0580-466a-a45e-d8a9a70521fd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:38.718818 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e396a0e5-0580-466a-a45e-d8a9a70521fd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:38.721596 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e396a0e5-0580-466a-a45e-d8a9a70521fd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:38.722651 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e396a0e5-0580-466a-a45e-d8a9a70521fd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:38.725063 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e396a0e5-0580-466a-a45e-d8a9a70521fd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:38.868690 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-90aba02f-9a13-4846-b1ab-191ff4ffbdb0 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3a4faf0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:38.960624 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-90aba02f-9a13-4846-b1ab-191ff4ffbdb0 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856" status: 200 len: 1452 microversion: 2.1 time: 0.095499 Jun 10 18:14:38.960624 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2406/4737] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:14:38 2022] GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856 => generated 1452 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:39.099781 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d25bb170-d8f9-4d3c-97c9-bf0a472e3045 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:39.100719 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d25bb170-d8f9-4d3c-97c9-bf0a472e3045 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:39.129343 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d25bb170-d8f9-4d3c-97c9-bf0a472e3045 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:39.131677 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d25bb170-d8f9-4d3c-97c9-bf0a472e3045 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:39.133464 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d25bb170-d8f9-4d3c-97c9-bf0a472e3045 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:39.134155 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d25bb170-d8f9-4d3c-97c9-bf0a472e3045 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:39.477802 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d25bb170-d8f9-4d3c-97c9-bf0a472e3045 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:39.487076 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d25bb170-d8f9-4d3c-97c9-bf0a472e3045 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1369 microversion: 2.1 time: 0.391642 Jun 10 18:14:39.487652 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2407/4738] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:39 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1369 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:39.974600 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-aff82365-fd6b-4b0d-91c1-842333879846 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3a28550>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:40.058116 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-aff82365-fd6b-4b0d-91c1-842333879846 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856" status: 200 len: 1452 microversion: 2.1 time: 0.087200 Jun 10 18:14:40.059105 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2408/4739] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:14:39 2022] GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856 => generated 1452 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:40.144060 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e396a0e5-0580-466a-a45e-d8a9a70521fd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:40.182865 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e396a0e5-0580-466a-a45e-d8a9a70521fd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:40.193679 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e396a0e5-0580-466a-a45e-d8a9a70521fd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:40.198455 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e396a0e5-0580-466a-a45e-d8a9a70521fd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1874 microversion: 2.42 time: 1.495381 Jun 10 18:14:40.205286 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2332/4740] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:14:38 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1874 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:14:40.503623 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cdb15ac7-c4be-45e7-b4c0-e2347fea3544 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:40.504333 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cdb15ac7-c4be-45e7-b4c0-e2347fea3544 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:40.517142 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cdb15ac7-c4be-45e7-b4c0-e2347fea3544 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:40.518014 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cdb15ac7-c4be-45e7-b4c0-e2347fea3544 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:40.527074 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cdb15ac7-c4be-45e7-b4c0-e2347fea3544 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:40.528067 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cdb15ac7-c4be-45e7-b4c0-e2347fea3544 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:40.953624 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cdb15ac7-c4be-45e7-b4c0-e2347fea3544 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:40.970445 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cdb15ac7-c4be-45e7-b4c0-e2347fea3544 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1369 microversion: 2.1 time: 0.468757 Jun 10 18:14:40.972499 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2409/4741] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:40 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1369 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:41.075822 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c127a616-ec40-4d76-9d0a-ea82eb9c9a8d tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c02c3a60>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:41.226886 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-226c1481-f630-4cc9-b70a-79872e78df8e tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:41.229008 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c127a616-ec40-4d76-9d0a-ea82eb9c9a8d tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856" status: 200 len: 1452 microversion: 2.1 time: 0.155441 Jun 10 18:14:41.235549 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2333/4742] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:14:41 2022] GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856 => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:41.243153 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-226c1481-f630-4cc9-b70a-79872e78df8e tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:41.272128 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-226c1481-f630-4cc9-b70a-79872e78df8e tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:41.274339 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-226c1481-f630-4cc9-b70a-79872e78df8e tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:41.287197 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-226c1481-f630-4cc9-b70a-79872e78df8e tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:41.287197 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-226c1481-f630-4cc9-b70a-79872e78df8e tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:41.990467 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-466aed4b-d031-423c-a051-34d7a10e081b tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:41.991718 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-466aed4b-d031-423c-a051-34d7a10e081b tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:42.002649 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:14:42.010330 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-466aed4b-d031-423c-a051-34d7a10e081b tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:42.010330 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-466aed4b-d031-423c-a051-34d7a10e081b tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:42.010330 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-466aed4b-d031-423c-a051-34d7a10e081b tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:42.010330 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-466aed4b-d031-423c-a051-34d7a10e081b tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:42.461129 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-466aed4b-d031-423c-a051-34d7a10e081b tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:42.471591 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-466aed4b-d031-423c-a051-34d7a10e081b tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1369 microversion: 2.1 time: 0.487762 Jun 10 18:14:42.474199 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2334/4743] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:41 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1369 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:42.480022 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2b5e8f42-a52c-4183-bf2a-7d31e005ad98 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c02c30d0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:42.495411 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-226c1481-f630-4cc9-b70a-79872e78df8e tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:42.524539 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-226c1481-f630-4cc9-b70a-79872e78df8e tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:42.530809 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-226c1481-f630-4cc9-b70a-79872e78df8e tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:42.553258 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-226c1481-f630-4cc9-b70a-79872e78df8e tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1874 microversion: 2.42 time: 1.336872 Jun 10 18:14:42.563746 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2410/4744] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:14:41 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1874 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:14:42.564446 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2b5e8f42-a52c-4183-bf2a-7d31e005ad98 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856" status: 200 len: 1452 microversion: 2.1 time: 0.088003 Jun 10 18:14:42.565459 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2335/4745] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:14:42 2022] GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856 => generated 1452 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:43.504915 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-aea7b2bf-929c-4e5c-97c5-d45f34497172 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:43.504915 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-aea7b2bf-929c-4e5c-97c5-d45f34497172 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:43.522047 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aea7b2bf-929c-4e5c-97c5-d45f34497172 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:43.522434 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aea7b2bf-929c-4e5c-97c5-d45f34497172 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:43.530495 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aea7b2bf-929c-4e5c-97c5-d45f34497172 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:43.535616 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aea7b2bf-929c-4e5c-97c5-d45f34497172 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:43.575481 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-abb8421f-061f-45c0-8465-7b6c4342bfeb tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:43.576105 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-abb8421f-061f-45c0-8465-7b6c4342bfeb tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:43.614386 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-abb8421f-061f-45c0-8465-7b6c4342bfeb tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:43.615397 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-abb8421f-061f-45c0-8465-7b6c4342bfeb tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:43.620545 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-abb8421f-061f-45c0-8465-7b6c4342bfeb tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:43.622486 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-abb8421f-061f-45c0-8465-7b6c4342bfeb tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:44.335306 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-abb8421f-061f-45c0-8465-7b6c4342bfeb tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:44.345179 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-abb8421f-061f-45c0-8465-7b6c4342bfeb tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:44.347104 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-abb8421f-061f-45c0-8465-7b6c4342bfeb tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:44.348872 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-abb8421f-061f-45c0-8465-7b6c4342bfeb tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1874 microversion: 2.42 time: 0.778363 Jun 10 18:14:44.364130 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2336/4746] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:14:43 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1874 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:14:44.369201 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3a6c2acc-90a4-4640-bb2f-175e8adca165 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c02c3c10>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:44.376693 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-aea7b2bf-929c-4e5c-97c5-d45f34497172 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:44.390399 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-aea7b2bf-929c-4e5c-97c5-d45f34497172 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1369 microversion: 2.1 time: 0.902823 Jun 10 18:14:44.394866 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2411/4747] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:43 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1369 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:44.495106 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3a6c2acc-90a4-4640-bb2f-175e8adca165 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856" status: 200 len: 1452 microversion: 2.1 time: 0.129746 Jun 10 18:14:44.498140 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2337/4748] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:14:44 2022] GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856 => generated 1452 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:45.368897 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c0bfca27-9dd6-4a0e-84ae-654cca4ff1ee tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:45.369590 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c0bfca27-9dd6-4a0e-84ae-654cca4ff1ee tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:45.383132 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c0bfca27-9dd6-4a0e-84ae-654cca4ff1ee tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:45.383859 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c0bfca27-9dd6-4a0e-84ae-654cca4ff1ee tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:45.384878 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c0bfca27-9dd6-4a0e-84ae-654cca4ff1ee tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:45.385500 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c0bfca27-9dd6-4a0e-84ae-654cca4ff1ee tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:45.410836 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-25af3c55-2ea7-40fb-90b4-853ec99a03e2 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:45.412283 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-25af3c55-2ea7-40fb-90b4-853ec99a03e2 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:45.426578 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-25af3c55-2ea7-40fb-90b4-853ec99a03e2 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:45.427429 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-25af3c55-2ea7-40fb-90b4-853ec99a03e2 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:45.434243 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-25af3c55-2ea7-40fb-90b4-853ec99a03e2 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:45.434968 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-25af3c55-2ea7-40fb-90b4-853ec99a03e2 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:45.850473 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c0bfca27-9dd6-4a0e-84ae-654cca4ff1ee tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:45.869088 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c0bfca27-9dd6-4a0e-84ae-654cca4ff1ee tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:45.870905 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c0bfca27-9dd6-4a0e-84ae-654cca4ff1ee tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:45.877819 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c0bfca27-9dd6-4a0e-84ae-654cca4ff1ee tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1874 microversion: 2.42 time: 0.512661 Jun 10 18:14:45.878609 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2412/4749] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:14:45 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1874 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:14:45.895257 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-97deea9a-0157-4eb9-ad1b-2ac89c358be1 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3ab6280>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:45.979636 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-97deea9a-0157-4eb9-ad1b-2ac89c358be1 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856" status: 200 len: 1452 microversion: 2.1 time: 0.099755 Jun 10 18:14:45.980485 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2413/4750] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:14:45 2022] GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856 => generated 1452 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:46.300250 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-25af3c55-2ea7-40fb-90b4-853ec99a03e2 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:46.309359 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-25af3c55-2ea7-40fb-90b4-853ec99a03e2 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1369 microversion: 2.1 time: 0.904693 Jun 10 18:14:46.333135 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2338/4751] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:45 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1369 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:46.900757 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9cb4f26c-83be-4510-af0e-6bc92621afbc tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:46.902097 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9cb4f26c-83be-4510-af0e-6bc92621afbc tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:46.918012 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9cb4f26c-83be-4510-af0e-6bc92621afbc tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:46.929443 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9cb4f26c-83be-4510-af0e-6bc92621afbc tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:46.929443 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9cb4f26c-83be-4510-af0e-6bc92621afbc tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:46.929443 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9cb4f26c-83be-4510-af0e-6bc92621afbc tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:46.993854 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5c2e8673-5f36-4355-bea9-757c24275b45 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c02c3dc0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:47.089750 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5c2e8673-5f36-4355-bea9-757c24275b45 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856" status: 200 len: 1452 microversion: 2.1 time: 0.099854 Jun 10 18:14:47.095868 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2339/4752] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:14:46 2022] GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856 => generated 1452 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:14:47.185463 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5c2e8673-5f36-4355-bea9-757c24275b45 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:47.187524 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5c2e8673-5f36-4355-bea9-757c24275b45 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001815 Jun 10 18:14:47.188370 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2340/4753] 10.222.0.35 () {56 vars in 885 bytes} [Fri Jun 10 18:14:47 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jun 10 18:14:47.463046 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9cb4f26c-83be-4510-af0e-6bc92621afbc tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:47.478111 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9cb4f26c-83be-4510-af0e-6bc92621afbc tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:47.480888 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9cb4f26c-83be-4510-af0e-6bc92621afbc tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:47.482692 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9cb4f26c-83be-4510-af0e-6bc92621afbc tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1874 microversion: 2.42 time: 0.588910 Jun 10 18:14:47.485504 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2414/4754] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:14:46 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1874 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:14:47.514207 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5da88d2e-d424-49a4-8b82-38e83ff36fe8 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:47.515269 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5da88d2e-d424-49a4-8b82-38e83ff36fe8 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:47.522659 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5da88d2e-d424-49a4-8b82-38e83ff36fe8 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:47.523525 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5da88d2e-d424-49a4-8b82-38e83ff36fe8 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:47.524358 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bdd9f930-d1cf-40b6-88d0-76d7f8c2d293 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Action: 'create', calling method: .version_select at 0x7f77c03b23a0>, body: {"keypair": {"name": "tempest-keypair-1160784072", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXS6F6HhefFU4Q7T9il4RwrKO2tRuwHa2+oHAQp1Xg5ze9PiGLFY0W3hTawueTFUqidUyKEba4ScfB8x6hed4jFRh60PwX8wf7Q7zWVfc+rPEhCdKmthX6T+2kMn9qwyg=="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:14:47.524776 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5da88d2e-d424-49a4-8b82-38e83ff36fe8 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:47.525391 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5da88d2e-d424-49a4-8b82-38e83ff36fe8 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:47.565699 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-bdd9f930-d1cf-40b6-88d0-76d7f8c2d293 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Getting quotas for project 788bce6c44d543f899d18531b1a80ce4. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:14:47.582192 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-bdd9f930-d1cf-40b6-88d0-76d7f8c2d293 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Getting quotas for user df9db2e8931d4dfdbefae0cd8de8b81f and project 788bce6c44d543f899d18531b1a80ce4. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:14:47.727556 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bdd9f930-d1cf-40b6-88d0-76d7f8c2d293 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.497621 Jun 10 18:14:47.729072 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2341/4755] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 18:14:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:14:47.792753 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5da88d2e-d424-49a4-8b82-38e83ff36fe8 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:47.816451 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5da88d2e-d424-49a4-8b82-38e83ff36fe8 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1369 microversion: 2.1 time: 0.329770 Jun 10 18:14:47.818510 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2415/4756] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:47 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1369 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:48.106178 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-95fa5ebd-f912-44cd-931a-16370e90b61e tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c02c3040>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:48.198256 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-95fa5ebd-f912-44cd-931a-16370e90b61e tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856" status: 200 len: 1452 microversion: 2.1 time: 0.098688 Jun 10 18:14:48.205679 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2342/4757] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:14:48 2022] GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856 => generated 1452 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:48.425597 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-386b73fb-aa0e-46db-a861-a2e99b0e9f08 req-92175a79-091f-439c-bebe-9c5e2ae22e9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0732433-a140-4237-9d7f-7dd24c7dbb79", "name": "network-vif-plugged", "status": "completed", "tag": "f3cd9e4d-9709-4d83-9727-349dd9939d0e"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:14:48.441364 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-386b73fb-aa0e-46db-a861-a2e99b0e9f08 req-92175a79-091f-439c-bebe-9c5e2ae22e9c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:48.441816 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-386b73fb-aa0e-46db-a861-a2e99b0e9f08 req-92175a79-091f-439c-bebe-9c5e2ae22e9c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:48.509478 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f100f7d0-3bf2-444e-bf7f-db15e8c60e6b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:48.513631 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f100f7d0-3bf2-444e-bf7f-db15e8c60e6b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:48.535331 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f100f7d0-3bf2-444e-bf7f-db15e8c60e6b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:48.535936 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f100f7d0-3bf2-444e-bf7f-db15e8c60e6b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:48.536827 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f100f7d0-3bf2-444e-bf7f-db15e8c60e6b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:48.537277 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f100f7d0-3bf2-444e-bf7f-db15e8c60e6b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:49.050815 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-386b73fb-aa0e-46db-a861-a2e99b0e9f08 req-92175a79-091f-439c-bebe-9c5e2ae22e9c service nova] Creating event network-vif-plugged:f3cd9e4d-9709-4d83-9727-349dd9939d0e for instance f0732433-a140-4237-9d7f-7dd24c7dbb79 on chh1-master-2 Jun 10 18:14:49.056397 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-386b73fb-aa0e-46db-a861-a2e99b0e9f08 req-92175a79-091f-439c-bebe-9c5e2ae22e9c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.646913 Jun 10 18:14:49.057751 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2416/4758] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:14:49.065767 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5b318f6e-10c3-49fa-97da-54359b1573cf tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:49.066936 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5b318f6e-10c3-49fa-97da-54359b1573cf tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:49.074979 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5b318f6e-10c3-49fa-97da-54359b1573cf tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:49.076641 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5b318f6e-10c3-49fa-97da-54359b1573cf tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:49.077681 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5b318f6e-10c3-49fa-97da-54359b1573cf tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:49.078513 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5b318f6e-10c3-49fa-97da-54359b1573cf tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:49.357287 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5b318f6e-10c3-49fa-97da-54359b1573cf tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:49.372395 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5b318f6e-10c3-49fa-97da-54359b1573cf tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1369 microversion: 2.1 time: 0.312311 Jun 10 18:14:49.374366 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2417/4759] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:49 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1369 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:49.404662 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2be9e1bf-c4c5-4b71-a069-62dec7387c49 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3aa2940>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:49.496545 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2be9e1bf-c4c5-4b71-a069-62dec7387c49 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856" status: 200 len: 1452 microversion: 2.1 time: 0.119575 Jun 10 18:14:49.502405 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2418/4760] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:14:49 2022] GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856 => generated 1452 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:49.562055 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f100f7d0-3bf2-444e-bf7f-db15e8c60e6b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:49.575015 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f100f7d0-3bf2-444e-bf7f-db15e8c60e6b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:49.581180 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f100f7d0-3bf2-444e-bf7f-db15e8c60e6b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:49.583495 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f100f7d0-3bf2-444e-bf7f-db15e8c60e6b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1874 microversion: 2.42 time: 1.084636 Jun 10 18:14:49.599049 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2343/4761] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:14:48 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1874 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:14:50.391524 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-14ba566f-8788-463e-a8b4-241f76c6d8b0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:50.392139 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-14ba566f-8788-463e-a8b4-241f76c6d8b0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:50.436116 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-14ba566f-8788-463e-a8b4-241f76c6d8b0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:50.440655 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-14ba566f-8788-463e-a8b4-241f76c6d8b0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:50.441540 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-14ba566f-8788-463e-a8b4-241f76c6d8b0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:50.445407 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-14ba566f-8788-463e-a8b4-241f76c6d8b0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:50.510537 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6b8369be-4abe-403e-acf4-7dca46b2a06c tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c0261700>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:50.647326 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6b8369be-4abe-403e-acf4-7dca46b2a06c tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856" status: 200 len: 1452 microversion: 2.1 time: 0.141383 Jun 10 18:14:50.650953 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2344/4762] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:14:50 2022] GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856 => generated 1452 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:50.679610 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ce1d5219-5c8b-4932-ba03-9193c23aea2d tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:50.684203 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ce1d5219-5c8b-4932-ba03-9193c23aea2d tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:50.720080 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ce1d5219-5c8b-4932-ba03-9193c23aea2d tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:50.722730 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ce1d5219-5c8b-4932-ba03-9193c23aea2d tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:50.725567 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ce1d5219-5c8b-4932-ba03-9193c23aea2d tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:50.731595 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ce1d5219-5c8b-4932-ba03-9193c23aea2d tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:51.000660 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-14ba566f-8788-463e-a8b4-241f76c6d8b0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:51.013692 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-14ba566f-8788-463e-a8b4-241f76c6d8b0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1369 microversion: 2.1 time: 0.626222 Jun 10 18:14:51.017327 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2419/4763] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:50 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1369 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:51.416226 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ce1d5219-5c8b-4932-ba03-9193c23aea2d tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:51.430161 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ce1d5219-5c8b-4932-ba03-9193c23aea2d tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:51.433344 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ce1d5219-5c8b-4932-ba03-9193c23aea2d tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:51.436254 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ce1d5219-5c8b-4932-ba03-9193c23aea2d tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1874 microversion: 2.42 time: 0.783196 Jun 10 18:14:51.450157 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2345/4764] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:14:50 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1874 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:14:51.666192 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d384b67e-3011-4ff7-b023-84d4b03b33a0 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3c74040>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:51.767222 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d384b67e-3011-4ff7-b023-84d4b03b33a0 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856" status: 200 len: 1452 microversion: 2.1 time: 0.104130 Jun 10 18:14:51.767731 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2420/4765] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:14:51 2022] GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856 => generated 1452 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:52.036622 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fa4fc291-decb-48c5-97bb-3ceb71d2b71a tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:52.037320 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fa4fc291-decb-48c5-97bb-3ceb71d2b71a tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:52.050212 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa4fc291-decb-48c5-97bb-3ceb71d2b71a tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:52.050840 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa4fc291-decb-48c5-97bb-3ceb71d2b71a tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:52.052454 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa4fc291-decb-48c5-97bb-3ceb71d2b71a tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:52.054294 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa4fc291-decb-48c5-97bb-3ceb71d2b71a tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:52.464286 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e2441150-533f-451a-8495-6cd2b495b77c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:52.465784 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e2441150-533f-451a-8495-6cd2b495b77c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:52.487436 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e2441150-533f-451a-8495-6cd2b495b77c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:52.488409 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e2441150-533f-451a-8495-6cd2b495b77c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:52.489648 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e2441150-533f-451a-8495-6cd2b495b77c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:52.492099 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e2441150-533f-451a-8495-6cd2b495b77c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:52.544462 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:14:52.784014 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fa4fc291-decb-48c5-97bb-3ceb71d2b71a tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:52.803697 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fa4fc291-decb-48c5-97bb-3ceb71d2b71a tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1561 microversion: 2.1 time: 0.763781 Jun 10 18:14:52.897333 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2346/4766] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:52 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1561 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:52.897333 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d5c6ff45-976d-411a-9ab3-7c482c61c608 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c02611f0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:52.897333 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d5c6ff45-976d-411a-9ab3-7c482c61c608 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856" status: 200 len: 1452 microversion: 2.1 time: 0.083439 Jun 10 18:14:52.902494 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2347/4767] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:14:52 2022] GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856 => generated 1452 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:52.920010 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a4c32f42-069c-4b93-8120-9463d5e3e387 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1374585061", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "bd21ae0f-9ac3-4170-8881-1d04eaccdc17"}], "security_groups": [{"name": "tempest-securitygroup--92791242"}], "key_name": "tempest-keypair-1160784072", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:14:53.139235 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e2441150-533f-451a-8495-6cd2b495b77c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:53.158476 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e2441150-533f-451a-8495-6cd2b495b77c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:53.163270 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e2441150-533f-451a-8495-6cd2b495b77c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:53.181431 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e2441150-533f-451a-8495-6cd2b495b77c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1874 microversion: 2.42 time: 0.723618 Jun 10 18:14:53.196056 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2421/4768] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:14:52 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1874 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:14:53.207266 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5139bd3c-486b-4f65-8366-f1e680a3b6ed tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:53.208055 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5139bd3c-486b-4f65-8366-f1e680a3b6ed tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:53.232596 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5139bd3c-486b-4f65-8366-f1e680a3b6ed tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:53.233066 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5139bd3c-486b-4f65-8366-f1e680a3b6ed tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:53.234397 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5139bd3c-486b-4f65-8366-f1e680a3b6ed tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:53.234847 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5139bd3c-486b-4f65-8366-f1e680a3b6ed tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:53.492801 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-a4c32f42-069c-4b93-8120-9463d5e3e387 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] validate_networks() for [('bd21ae0f-9ac3-4170-8881-1d04eaccdc17', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:14:53.623205 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5139bd3c-486b-4f65-8366-f1e680a3b6ed tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.417918 Jun 10 18:14:53.627415 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2422/4769] 10.222.0.35 () {58 vars in 1274 bytes} [Fri Jun 10 18:14:53 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79/os-interface => generated 284 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:14:53.916706 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0ef6f826-0d3b-4515-8fa2-1e833fcd4f70 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3adf700>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:54.014058 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0ef6f826-0d3b-4515-8fa2-1e833fcd4f70 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856" status: 200 len: 1452 microversion: 2.1 time: 0.102878 Jun 10 18:14:54.016779 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2423/4770] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:14:53 2022] GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856 => generated 1452 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:54.213739 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a60ec72d-0af7-4366-a1a7-4a397cc3daab tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:54.215067 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a60ec72d-0af7-4366-a1a7-4a397cc3daab tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:54.231455 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a60ec72d-0af7-4366-a1a7-4a397cc3daab tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:54.232406 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a60ec72d-0af7-4366-a1a7-4a397cc3daab tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:54.234074 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a60ec72d-0af7-4366-a1a7-4a397cc3daab tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:54.236938 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a60ec72d-0af7-4366-a1a7-4a397cc3daab tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:56.340192 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-a4c32f42-069c-4b93-8120-9463d5e3e387 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Getting quotas for project 788bce6c44d543f899d18531b1a80ce4. Resources: dict_keys(['metadata_items']) {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:14:56.362667 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-a4c32f42-069c-4b93-8120-9463d5e3e387 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Getting quotas for user df9db2e8931d4dfdbefae0cd8de8b81f and project 788bce6c44d543f899d18531b1a80ce4. Resources: dict_keys(['metadata_items']) {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:14:56.416765 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-a4c32f42-069c-4b93-8120-9463d5e3e387 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:14:56.422290 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-a4c32f42-069c-4b93-8120-9463d5e3e387 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:14:56.425096 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-a4c32f42-069c-4b93-8120-9463d5e3e387 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:14:56.426140 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-a4c32f42-069c-4b93-8120-9463d5e3e387 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:14:56.433057 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-a4c32f42-069c-4b93-8120-9463d5e3e387 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:14:56.457755 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a4c32f42-069c-4b93-8120-9463d5e3e387 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:56.460040 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a4c32f42-069c-4b93-8120-9463d5e3e387 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:56.464605 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a4c32f42-069c-4b93-8120-9463d5e3e387 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:56.465313 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a4c32f42-069c-4b93-8120-9463d5e3e387 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:56.537345 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-a4c32f42-069c-4b93-8120-9463d5e3e387 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Getting quotas for project 788bce6c44d543f899d18531b1a80ce4. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:14:56.558172 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-a4c32f42-069c-4b93-8120-9463d5e3e387 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Getting quotas for user df9db2e8931d4dfdbefae0cd8de8b81f and project 788bce6c44d543f899d18531b1a80ce4. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:14:56.609882 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a4c32f42-069c-4b93-8120-9463d5e3e387 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:14:56.619493 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a4c32f42-069c-4b93-8120-9463d5e3e387 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] [instance: d3621da7-8dd5-4829-b488-57c111e1d51e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:14:56.837576 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a4c32f42-069c-4b93-8120-9463d5e3e387 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.925690 Jun 10 18:14:56.844661 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2348/4771] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:14:52 2022] POST /compute/v2.1/servers => generated 407 bytes in 3934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:14:56.858092 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a2d87d0c-f15a-4d50-9e97-9ad0ba1a0a94 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c03b2040>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:56.973578 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a60ec72d-0af7-4366-a1a7-4a397cc3daab tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:56.990936 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a60ec72d-0af7-4366-a1a7-4a397cc3daab tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:56.999580 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a2d87d0c-f15a-4d50-9e97-9ad0ba1a0a94 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856" status: 200 len: 1452 microversion: 2.1 time: 0.151958 Jun 10 18:14:57.001530 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a60ec72d-0af7-4366-a1a7-4a397cc3daab tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:57.008524 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2349/4772] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:14:56 2022] GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856 => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:57.019126 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a60ec72d-0af7-4366-a1a7-4a397cc3daab tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1874 microversion: 2.42 time: 2.806287 Jun 10 18:14:57.025257 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3f5b5f51-41fd-4c7f-bde6-a77f510c8737 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:57.026717 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3f5b5f51-41fd-4c7f-bde6-a77f510c8737 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] [instance: d3621da7-8dd5-4829-b488-57c111e1d51e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:57.033151 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2424/4773] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:14:54 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1874 bytes in 2834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:14:57.048260 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fa4e5c7a-d332-4a99-9532-a92bc8c6b4aa tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Action: 'create', calling method: .version_select at 0x7f77b3afb4c0>, body: {"keypair": {"name": "tempest-keypair-861949454", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMLekq9vIQ/alMT76716TSExCFZ096GO8T0tUNQ+u/bROpOCxsguqQFcNOTHLC5lVScLV3Yaykiv0zX0JyZHAAbxbCLnyWGSsi43ulJTOnx1vGStN8m1lcLorJFD57bN7Q=="}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:14:57.078264 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-fa4e5c7a-d332-4a99-9532-a92bc8c6b4aa tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Getting quotas for project 0433689ccdd84ef9be7c8e2a1e553ce6. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:14:57.110911 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-fa4e5c7a-d332-4a99-9532-a92bc8c6b4aa tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Getting quotas for user a0fdd982d9e7413cae6a453b90de2e86 and project 0433689ccdd84ef9be7c8e2a1e553ce6. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:14:57.191024 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3f5b5f51-41fd-4c7f-bde6-a77f510c8737 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9db2e8931d4dfdbefae0cd8de8b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788bce6c44d543f899d18531b1a80ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:57.201075 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3f5b5f51-41fd-4c7f-bde6-a77f510c8737 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] 10.222.0.35 "GET /compute/v2.1/servers/d3621da7-8dd5-4829-b488-57c111e1d51e" status: 200 len: 1278 microversion: 2.1 time: 0.189340 Jun 10 18:14:57.202292 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2350/4774] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:57 2022] GET /compute/v2.1/servers/d3621da7-8dd5-4829-b488-57c111e1d51e => generated 1278 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:57.217471 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fa4e5c7a-d332-4a99-9532-a92bc8c6b4aa tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.181030 Jun 10 18:14:57.218237 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2425/4775] 10.222.0.35 () {62 vars in 1199 bytes} [Fri Jun 10 18:14:57 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 184 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 10 18:14:58.016610 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-79806e3b-1ea6-445b-b091-02af8bb77ef8 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c0261e50>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:58.048838 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4cc69977-99eb-4647-af33-30eacc4f1383 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:58.059294 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4cc69977-99eb-4647-af33-30eacc4f1383 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:58.096347 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4cc69977-99eb-4647-af33-30eacc4f1383 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:58.100135 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4cc69977-99eb-4647-af33-30eacc4f1383 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:58.107535 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4cc69977-99eb-4647-af33-30eacc4f1383 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:58.110620 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4cc69977-99eb-4647-af33-30eacc4f1383 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:58.172544 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-79806e3b-1ea6-445b-b091-02af8bb77ef8 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856" status: 200 len: 1452 microversion: 2.1 time: 0.159126 Jun 10 18:14:58.173177 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2351/4776] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:14:58 2022] GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856 => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:58.202632 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-a2304298-e2c9-4c61-86c6-4fde458f7db0 req-70252e48-3294-465b-baaa-528d6439509c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0732433-a140-4237-9d7f-7dd24c7dbb79", "tag": "f3cd9e4d-9709-4d83-9727-349dd9939d0e"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:14:58.249650 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-a2304298-e2c9-4c61-86c6-4fde458f7db0 req-70252e48-3294-465b-baaa-528d6439509c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:58.250267 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-a2304298-e2c9-4c61-86c6-4fde458f7db0 req-70252e48-3294-465b-baaa-528d6439509c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:58.302607 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-a2304298-e2c9-4c61-86c6-4fde458f7db0 req-70252e48-3294-465b-baaa-528d6439509c service nova] Creating event network-changed:f3cd9e4d-9709-4d83-9727-349dd9939d0e for instance f0732433-a140-4237-9d7f-7dd24c7dbb79 on chh1-master-2 Jun 10 18:14:58.310838 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-a2304298-e2c9-4c61-86c6-4fde458f7db0 req-70252e48-3294-465b-baaa-528d6439509c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136245 Jun 10 18:14:58.314423 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2352/4777] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:14:58.376328 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e63dd9d9-c251-4249-90d3-fffaa8a41ce4 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:58.379420 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e63dd9d9-c251-4249-90d3-fffaa8a41ce4 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] [instance: d3621da7-8dd5-4829-b488-57c111e1d51e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:58.657857 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e63dd9d9-c251-4249-90d3-fffaa8a41ce4 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9db2e8931d4dfdbefae0cd8de8b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788bce6c44d543f899d18531b1a80ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:58.667002 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e63dd9d9-c251-4249-90d3-fffaa8a41ce4 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] 10.222.0.35 "GET /compute/v2.1/servers/d3621da7-8dd5-4829-b488-57c111e1d51e" status: 200 len: 1278 microversion: 2.1 time: 0.349183 Jun 10 18:14:58.667639 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2353/4778] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:58 2022] GET /compute/v2.1/servers/d3621da7-8dd5-4829-b488-57c111e1d51e => generated 1278 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:58.724515 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4cc69977-99eb-4647-af33-30eacc4f1383 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:58.742547 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4cc69977-99eb-4647-af33-30eacc4f1383 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:58.751387 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4cc69977-99eb-4647-af33-30eacc4f1383 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:14:58.754774 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4cc69977-99eb-4647-af33-30eacc4f1383 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1874 microversion: 2.42 time: 0.717791 Jun 10 18:14:58.757905 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2426/4779] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:14:58 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1874 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:14:59.194290 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d1f1b66b-d135-45ee-afc4-3572a2a67133 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c03773a0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:59.330818 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d1f1b66b-d135-45ee-afc4-3572a2a67133 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856" status: 200 len: 1452 microversion: 2.1 time: 0.147714 Jun 10 18:14:59.335951 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2354/4780] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:14:59 2022] GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:14:59.690545 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-874133d7-55c1-4b4f-8b8a-84dc7165734e tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:59.695524 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-874133d7-55c1-4b4f-8b8a-84dc7165734e tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] [instance: d3621da7-8dd5-4829-b488-57c111e1d51e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:59.703867 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-874133d7-55c1-4b4f-8b8a-84dc7165734e tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:59.707464 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-874133d7-55c1-4b4f-8b8a-84dc7165734e tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:59.708330 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-874133d7-55c1-4b4f-8b8a-84dc7165734e tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:59.713893 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-874133d7-55c1-4b4f-8b8a-84dc7165734e tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:59.776736 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-75b0c5eb-102f-4882-bc5c-9953f7dcf19c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:14:59.777662 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-75b0c5eb-102f-4882-bc5c-9953f7dcf19c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:14:59.788900 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-75b0c5eb-102f-4882-bc5c-9953f7dcf19c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:59.789359 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-75b0c5eb-102f-4882-bc5c-9953f7dcf19c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:14:59.790158 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-75b0c5eb-102f-4882-bc5c-9953f7dcf19c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:14:59.797055 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-75b0c5eb-102f-4882-bc5c-9953f7dcf19c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:00.040005 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-874133d7-55c1-4b4f-8b8a-84dc7165734e tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9db2e8931d4dfdbefae0cd8de8b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788bce6c44d543f899d18531b1a80ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:00.062914 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-874133d7-55c1-4b4f-8b8a-84dc7165734e tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] 10.222.0.35 "GET /compute/v2.1/servers/d3621da7-8dd5-4829-b488-57c111e1d51e" status: 200 len: 1330 microversion: 2.1 time: 0.381444 Jun 10 18:15:00.065752 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2427/4781] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:14:59 2022] GET /compute/v2.1/servers/d3621da7-8dd5-4829-b488-57c111e1d51e => generated 1330 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:00.352349 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bf8a7ac7-8c90-402d-8902-bcf45698cca7 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3aa2550>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:00.452702 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bf8a7ac7-8c90-402d-8902-bcf45698cca7 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856" status: 200 len: 1452 microversion: 2.1 time: 0.105380 Jun 10 18:15:00.453616 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2428/4782] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:00 2022] GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856 => generated 1452 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:00.813996 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-75b0c5eb-102f-4882-bc5c-9953f7dcf19c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:00.837292 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-75b0c5eb-102f-4882-bc5c-9953f7dcf19c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:00.839755 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-75b0c5eb-102f-4882-bc5c-9953f7dcf19c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:00.841847 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-75b0c5eb-102f-4882-bc5c-9953f7dcf19c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1874 microversion: 2.42 time: 1.069726 Jun 10 18:15:00.847740 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2355/4783] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:14:59 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1874 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:15:01.086839 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-aa8775bc-7bb5-44f8-a4e3-f241b6dce4b1 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:01.088801 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-aa8775bc-7bb5-44f8-a4e3-f241b6dce4b1 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] [instance: d3621da7-8dd5-4829-b488-57c111e1d51e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:01.109371 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aa8775bc-7bb5-44f8-a4e3-f241b6dce4b1 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:01.109829 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aa8775bc-7bb5-44f8-a4e3-f241b6dce4b1 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:01.110623 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aa8775bc-7bb5-44f8-a4e3-f241b6dce4b1 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:01.111068 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aa8775bc-7bb5-44f8-a4e3-f241b6dce4b1 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:01.303370 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-aa8775bc-7bb5-44f8-a4e3-f241b6dce4b1 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9db2e8931d4dfdbefae0cd8de8b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788bce6c44d543f899d18531b1a80ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:01.311992 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-aa8775bc-7bb5-44f8-a4e3-f241b6dce4b1 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] 10.222.0.35 "GET /compute/v2.1/servers/d3621da7-8dd5-4829-b488-57c111e1d51e" status: 200 len: 1336 microversion: 2.1 time: 0.229308 Jun 10 18:15:01.312533 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2429/4784] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:15:01 2022] GET /compute/v2.1/servers/d3621da7-8dd5-4829-b488-57c111e1d51e => generated 1336 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:01.466779 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8cccee21-eba6-46f2-ae89-f896302fc974 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c0223670>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:01.571333 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8cccee21-eba6-46f2-ae89-f896302fc974 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856" status: 200 len: 1452 microversion: 2.1 time: 0.108427 Jun 10 18:15:01.574830 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2356/4785] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:01 2022] GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856 => generated 1452 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:01.867272 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e1b65f77-4631-4d87-b566-2dfb24ffb9d6 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:01.868247 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e1b65f77-4631-4d87-b566-2dfb24ffb9d6 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:01.877577 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e1b65f77-4631-4d87-b566-2dfb24ffb9d6 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:01.878294 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e1b65f77-4631-4d87-b566-2dfb24ffb9d6 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:01.880675 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e1b65f77-4631-4d87-b566-2dfb24ffb9d6 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:01.881609 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e1b65f77-4631-4d87-b566-2dfb24ffb9d6 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:02.333204 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fa65f194-838f-473f-8e61-09cc283fffba tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:02.334479 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fa65f194-838f-473f-8e61-09cc283fffba tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] [instance: d3621da7-8dd5-4829-b488-57c111e1d51e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:02.347756 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa65f194-838f-473f-8e61-09cc283fffba tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:02.349640 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e1b65f77-4631-4d87-b566-2dfb24ffb9d6 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:02.350636 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa65f194-838f-473f-8e61-09cc283fffba tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:02.353121 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa65f194-838f-473f-8e61-09cc283fffba tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:02.355083 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa65f194-838f-473f-8e61-09cc283fffba tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:02.366452 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e1b65f77-4631-4d87-b566-2dfb24ffb9d6 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:02.370032 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e1b65f77-4631-4d87-b566-2dfb24ffb9d6 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:02.371956 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e1b65f77-4631-4d87-b566-2dfb24ffb9d6 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1874 microversion: 2.42 time: 0.509373 Jun 10 18:15:02.373145 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2430/4786] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:01 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1874 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:15:02.586274 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6cb9f6eb-5e29-4dcf-b03a-d2a1d474ac63 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3c24af0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:02.603187 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fa65f194-838f-473f-8e61-09cc283fffba tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9db2e8931d4dfdbefae0cd8de8b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788bce6c44d543f899d18531b1a80ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:02.620856 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fa65f194-838f-473f-8e61-09cc283fffba tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] 10.222.0.35 "GET /compute/v2.1/servers/d3621da7-8dd5-4829-b488-57c111e1d51e" status: 200 len: 1402 microversion: 2.1 time: 0.291488 Jun 10 18:15:02.628161 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2357/4787] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:15:02 2022] GET /compute/v2.1/servers/d3621da7-8dd5-4829-b488-57c111e1d51e => generated 1402 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:02.670089 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6cb9f6eb-5e29-4dcf-b03a-d2a1d474ac63 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856" status: 200 len: 1452 microversion: 2.1 time: 0.089042 Jun 10 18:15:02.671307 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2431/4788] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:02 2022] GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856 => generated 1452 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:15:03.393724 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ce4e5418-82a7-4e2d-bb43-6f5a7a0e0b20 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:03.394920 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ce4e5418-82a7-4e2d-bb43-6f5a7a0e0b20 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:03.420981 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ce4e5418-82a7-4e2d-bb43-6f5a7a0e0b20 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:03.425790 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ce4e5418-82a7-4e2d-bb43-6f5a7a0e0b20 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:03.430329 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ce4e5418-82a7-4e2d-bb43-6f5a7a0e0b20 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:03.434080 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ce4e5418-82a7-4e2d-bb43-6f5a7a0e0b20 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:03.636181 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-950acbcc-82d2-4317-ab82-19f5bbbbf1e3 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1151429610", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "8a593213-8c6e-49fb-8258-07550b6969ad"}, {"port": "bb35e8a5-b2ef-4ac9-a736-ea6b3c77f079", "tag": "port-1"}, {"port": "aca0b4a9-2d21-42c4-a9e4-19c74885c3e4", "tag": "port-2"}, {"uuid": "ba838b87-17bd-4798-8943-94883720f015", "tag": "net-1"}, {"uuid": "ba838b87-17bd-4798-8943-94883720f015"}, {"uuid": "742c2240-3705-498d-bf6e-1e3e4bc59b71", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "742c2240-3705-498d-bf6e-1e3e4bc59b71", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "ba3ad3d7-8d90-475e-be48-4f5b100529f1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "43ae9750-b0cd-43c8-b25e-e81bd14fed46", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "08ed5590-86d7-4df7-82dd-4184721bae3f", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--2145100184"}], "key_name": "tempest-keypair-861949454", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:15:04.080779 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ce4e5418-82a7-4e2d-bb43-6f5a7a0e0b20 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:04.081208 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-950acbcc-82d2-4317-ab82-19f5bbbbf1e3 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] validate_networks() for [('8a593213-8c6e-49fb-8258-07550b6969ad', None, None, None, None, None), (None, None, 'bb35e8a5-b2ef-4ac9-a736-ea6b3c77f079', None, None, None), (None, None, 'aca0b4a9-2d21-42c4-a9e4-19c74885c3e4', None, None, None), ('ba838b87-17bd-4798-8943-94883720f015', None, None, None, None, None), ('ba838b87-17bd-4798-8943-94883720f015', None, None, None, None, None), ('742c2240-3705-498d-bf6e-1e3e4bc59b71', '10.2.2.100', None, None, None, None), ('742c2240-3705-498d-bf6e-1e3e4bc59b71', '10.2.2.200', None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:15:04.090342 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ce4e5418-82a7-4e2d-bb43-6f5a7a0e0b20 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:04.104644 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ce4e5418-82a7-4e2d-bb43-6f5a7a0e0b20 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:04.107001 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ce4e5418-82a7-4e2d-bb43-6f5a7a0e0b20 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1874 microversion: 2.42 time: 0.718723 Jun 10 18:15:04.107468 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2358/4789] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:03 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1874 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:15:04.140728 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cbd05a5f-1148-40ac-bcfc-5adde563ec3f tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:04.141866 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cbd05a5f-1148-40ac-bcfc-5adde563ec3f tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] [instance: d3621da7-8dd5-4829-b488-57c111e1d51e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:04.166472 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cbd05a5f-1148-40ac-bcfc-5adde563ec3f tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:04.166931 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cbd05a5f-1148-40ac-bcfc-5adde563ec3f tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:04.167740 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cbd05a5f-1148-40ac-bcfc-5adde563ec3f tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:04.168711 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cbd05a5f-1148-40ac-bcfc-5adde563ec3f tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:04.391333 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cbd05a5f-1148-40ac-bcfc-5adde563ec3f tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9db2e8931d4dfdbefae0cd8de8b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788bce6c44d543f899d18531b1a80ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:04.418822 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cbd05a5f-1148-40ac-bcfc-5adde563ec3f tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] 10.222.0.35 "GET /compute/v2.1/servers/d3621da7-8dd5-4829-b488-57c111e1d51e" status: 200 len: 1402 microversion: 2.1 time: 0.293980 Jun 10 18:15:04.429006 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2359/4790] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:15:04 2022] GET /compute/v2.1/servers/d3621da7-8dd5-4829-b488-57c111e1d51e => generated 1402 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:04.429954 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8218ed12-94c0-4b06-ade5-a395ccc90394 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c02b6430>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:04.548017 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8218ed12-94c0-4b06-ade5-a395ccc90394 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856" status: 200 len: 1452 microversion: 2.1 time: 0.122211 Jun 10 18:15:04.548582 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2360/4791] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:04 2022] GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856 => generated 1452 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:04.565025 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-67d6562f-d0b7-4a49-87a0-03c527a94a96 req-47fdd184-d820-4c3a-8086-c3a737fe343e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3621da7-8dd5-4829-b488-57c111e1d51e", "tag": "fcf26aeb-af7b-4182-90e2-0b31e69fed36"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:15:04.606227 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-67d6562f-d0b7-4a49-87a0-03c527a94a96 req-47fdd184-d820-4c3a-8086-c3a737fe343e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:04.617151 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-67d6562f-d0b7-4a49-87a0-03c527a94a96 req-47fdd184-d820-4c3a-8086-c3a737fe343e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:04.631212 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-67d6562f-d0b7-4a49-87a0-03c527a94a96 req-47fdd184-d820-4c3a-8086-c3a737fe343e service nova] Creating event network-changed:fcf26aeb-af7b-4182-90e2-0b31e69fed36 for instance d3621da7-8dd5-4829-b488-57c111e1d51e on chh1-master-2 Jun 10 18:15:04.646036 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-67d6562f-d0b7-4a49-87a0-03c527a94a96 req-47fdd184-d820-4c3a-8086-c3a737fe343e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096213 Jun 10 18:15:04.647030 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2361/4792] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:15:05.126893 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-11c33888-2dd5-43aa-8785-b55156c52dcb tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:05.127861 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-11c33888-2dd5-43aa-8785-b55156c52dcb tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:05.135365 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-11c33888-2dd5-43aa-8785-b55156c52dcb tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:05.149089 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-11c33888-2dd5-43aa-8785-b55156c52dcb tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:05.150243 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-11c33888-2dd5-43aa-8785-b55156c52dcb tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:05.150866 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-11c33888-2dd5-43aa-8785-b55156c52dcb tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:05.445564 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-11c33888-2dd5-43aa-8785-b55156c52dcb tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:05.455039 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-11c33888-2dd5-43aa-8785-b55156c52dcb tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:05.456726 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-11c33888-2dd5-43aa-8785-b55156c52dcb tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:05.467502 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-11c33888-2dd5-43aa-8785-b55156c52dcb tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1874 microversion: 2.42 time: 0.335938 Jun 10 18:15:05.467502 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2362/4793] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:05 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1874 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:15:05.467502 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-55a28ec2-d9f7-4882-ac85-14aa21084eaa tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:05.467502 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-55a28ec2-d9f7-4882-ac85-14aa21084eaa tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] [instance: d3621da7-8dd5-4829-b488-57c111e1d51e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:05.473474 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-55a28ec2-d9f7-4882-ac85-14aa21084eaa tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:05.473935 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-55a28ec2-d9f7-4882-ac85-14aa21084eaa tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:05.474749 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-55a28ec2-d9f7-4882-ac85-14aa21084eaa tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:05.475246 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-55a28ec2-d9f7-4882-ac85-14aa21084eaa tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:05.651691 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-55a28ec2-d9f7-4882-ac85-14aa21084eaa tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9db2e8931d4dfdbefae0cd8de8b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788bce6c44d543f899d18531b1a80ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:05.660448 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-55a28ec2-d9f7-4882-ac85-14aa21084eaa tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] 10.222.0.35 "GET /compute/v2.1/servers/d3621da7-8dd5-4829-b488-57c111e1d51e" status: 200 len: 1402 microversion: 2.1 time: 0.200985 Jun 10 18:15:05.661470 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2363/4794] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:15:05 2022] GET /compute/v2.1/servers/d3621da7-8dd5-4829-b488-57c111e1d51e => generated 1402 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:05.667961 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e7f13627-99e9-496a-aea2-303d83ab19af tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c0431b80>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:05.721720 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e7f13627-99e9-496a-aea2-303d83ab19af tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856" status: 200 len: 1461 microversion: 2.1 time: 0.058923 Jun 10 18:15:05.722385 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2364/4795] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:05 2022] GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856 => generated 1461 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:05.736367 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-06bb1a1d-8e0b-48eb-8d3a-9472adb5dbc5 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c02b6a60>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:05.740895 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:15:05.803536 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-06bb1a1d-8e0b-48eb-8d3a-9472adb5dbc5 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856" status: 200 len: 1461 microversion: 2.1 time: 0.071884 Jun 10 18:15:05.812052 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2365/4796] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:05 2022] GET /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856 => generated 1461 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:05.822203 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c9c5fd0e-e79d-4334-9032-e812e7cdbec4 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:05.824813 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c9c5fd0e-e79d-4334-9032-e812e7cdbec4 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 89cea229-7bfb-43e4-a855-e9c6ae81d37b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:05.835439 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9c5fd0e-e79d-4334-9032-e812e7cdbec4 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:05.836196 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9c5fd0e-e79d-4334-9032-e812e7cdbec4 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:05.837407 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9c5fd0e-e79d-4334-9032-e812e7cdbec4 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:05.838685 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9c5fd0e-e79d-4334-9032-e812e7cdbec4 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:06.079835 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c9c5fd0e-e79d-4334-9032-e812e7cdbec4 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd404e4ab55af470fa464b94f9f0cd2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6575b0846dca493f9e99ee122930972d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:06.129411 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c9c5fd0e-e79d-4334-9032-e812e7cdbec4 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b" status: 200 len: 1467 microversion: 2.1 time: 0.315855 Jun 10 18:15:06.134515 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2366/4797] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:15:05 2022] GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b => generated 1467 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:06.164813 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8466a187-c58e-4700-9972-84973971855c tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1482932549"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:15:06.166676 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8466a187-c58e-4700-9972-84973971855c tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 72eaef23-30d6-4755-a9b7-9547856075b3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:06.177164 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8466a187-c58e-4700-9972-84973971855c tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:06.177847 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8466a187-c58e-4700-9972-84973971855c tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:06.179425 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8466a187-c58e-4700-9972-84973971855c tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:06.180066 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8466a187-c58e-4700-9972-84973971855c tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:06.186544 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:15:06.497531 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:15:06.825463 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8466a187-c58e-4700-9972-84973971855c tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "POST /compute/v2.1/servers/72eaef23-30d6-4755-a9b7-9547856075b3/action" status: 202 len: 0 microversion: 2.1 time: 0.676302 Jun 10 18:15:06.831500 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2367/4798] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:15:06 2022] POST /compute/v2.1/servers/72eaef23-30d6-4755-a9b7-9547856075b3/action => generated 0 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jun 10 18:15:06.837584 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-052f0d7e-99b7-438d-ae7a-e4c8b5705cb2 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:06.839316 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-052f0d7e-99b7-438d-ae7a-e4c8b5705cb2 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:06.846845 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-052f0d7e-99b7-438d-ae7a-e4c8b5705cb2 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:06.847524 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-052f0d7e-99b7-438d-ae7a-e4c8b5705cb2 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:06.848588 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-052f0d7e-99b7-438d-ae7a-e4c8b5705cb2 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:06.849216 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-052f0d7e-99b7-438d-ae7a-e4c8b5705cb2 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:07.124493 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=4 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:15:07.416084 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-052f0d7e-99b7-438d-ae7a-e4c8b5705cb2 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:07.433605 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-052f0d7e-99b7-438d-ae7a-e4c8b5705cb2 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:07.435391 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-052f0d7e-99b7-438d-ae7a-e4c8b5705cb2 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:07.440390 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-052f0d7e-99b7-438d-ae7a-e4c8b5705cb2 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1874 microversion: 2.42 time: 0.603819 Jun 10 18:15:07.441116 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2368/4799] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:06 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1874 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:15:07.452839 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-885fb5cd-9e11-4b6e-9f76-23c6576bcdfe tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:07.452839 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-885fb5cd-9e11-4b6e-9f76-23c6576bcdfe tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] [instance: d3621da7-8dd5-4829-b488-57c111e1d51e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:07.467858 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-885fb5cd-9e11-4b6e-9f76-23c6576bcdfe tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:07.468484 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-885fb5cd-9e11-4b6e-9f76-23c6576bcdfe tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:07.469339 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-885fb5cd-9e11-4b6e-9f76-23c6576bcdfe tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:07.470365 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-885fb5cd-9e11-4b6e-9f76-23c6576bcdfe tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:07.875412 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-885fb5cd-9e11-4b6e-9f76-23c6576bcdfe tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9db2e8931d4dfdbefae0cd8de8b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788bce6c44d543f899d18531b1a80ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:07.892352 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-885fb5cd-9e11-4b6e-9f76-23c6576bcdfe tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] 10.222.0.35 "GET /compute/v2.1/servers/d3621da7-8dd5-4829-b488-57c111e1d51e" status: 200 len: 1402 microversion: 2.1 time: 0.449316 Jun 10 18:15:07.894563 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2369/4800] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:15:07 2022] GET /compute/v2.1/servers/d3621da7-8dd5-4829-b488-57c111e1d51e => generated 1402 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:07.913070 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1864a6b6-3bbe-456a-a7c8-2fa1e27c513c tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c03015e0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:07.997772 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1864a6b6-3bbe-456a-a7c8-2fa1e27c513c tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2" status: 200 len: 1453 microversion: 2.1 time: 0.101178 Jun 10 18:15:08.003419 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2370/4801] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:07 2022] GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2 => generated 1453 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:08.283583 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-950acbcc-82d2-4317-ab82-19f5bbbbf1e3 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:15:08.284110 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-950acbcc-82d2-4317-ab82-19f5bbbbf1e3 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:15:08.284555 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-950acbcc-82d2-4317-ab82-19f5bbbbf1e3 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:15:08.284986 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-950acbcc-82d2-4317-ab82-19f5bbbbf1e3 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:15:08.285413 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-950acbcc-82d2-4317-ab82-19f5bbbbf1e3 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:15:08.300269 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-950acbcc-82d2-4317-ab82-19f5bbbbf1e3 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:08.304932 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-950acbcc-82d2-4317-ab82-19f5bbbbf1e3 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:08.304932 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-950acbcc-82d2-4317-ab82-19f5bbbbf1e3 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:08.304932 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-950acbcc-82d2-4317-ab82-19f5bbbbf1e3 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:08.328747 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-950acbcc-82d2-4317-ab82-19f5bbbbf1e3 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Getting quotas for project 0433689ccdd84ef9be7c8e2a1e553ce6. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:15:08.346481 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-950acbcc-82d2-4317-ab82-19f5bbbbf1e3 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Getting quotas for user a0fdd982d9e7413cae6a453b90de2e86 and project 0433689ccdd84ef9be7c8e2a1e553ce6. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:15:08.461764 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4ef585fd-c021-473f-a794-7320843bab5a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:08.463141 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4ef585fd-c021-473f-a794-7320843bab5a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:08.471345 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ef585fd-c021-473f-a794-7320843bab5a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:08.472003 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ef585fd-c021-473f-a794-7320843bab5a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:08.473280 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ef585fd-c021-473f-a794-7320843bab5a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:08.473727 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ef585fd-c021-473f-a794-7320843bab5a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:08.604441 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-950acbcc-82d2-4317-ab82-19f5bbbbf1e3 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:15:08.607164 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-950acbcc-82d2-4317-ab82-19f5bbbbf1e3 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='ba3ad3d7-8d90-475e-be48-4f5b100529f1',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='43ae9750-b0cd-43c8-b25e-e81bd14fed46',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='08ed5590-86d7-4df7-82dd-4184721bae3f',volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:15:08.664168 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=18 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:15:08.800275 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4ef585fd-c021-473f-a794-7320843bab5a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:08.835871 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4ef585fd-c021-473f-a794-7320843bab5a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:08.837502 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4ef585fd-c021-473f-a794-7320843bab5a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:08.849270 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4ef585fd-c021-473f-a794-7320843bab5a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1874 microversion: 2.42 time: 0.382796 Jun 10 18:15:08.849270 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2371/4802] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:08 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1874 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:15:08.913245 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8743f3e1-1db5-4d89-aee3-465105f4ede8 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:08.917196 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8743f3e1-1db5-4d89-aee3-465105f4ede8 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] [instance: d3621da7-8dd5-4829-b488-57c111e1d51e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:08.925876 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8743f3e1-1db5-4d89-aee3-465105f4ede8 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:08.926552 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8743f3e1-1db5-4d89-aee3-465105f4ede8 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:08.927553 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8743f3e1-1db5-4d89-aee3-465105f4ede8 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:08.927993 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8743f3e1-1db5-4d89-aee3-465105f4ede8 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:09.148216 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8743f3e1-1db5-4d89-aee3-465105f4ede8 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9db2e8931d4dfdbefae0cd8de8b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788bce6c44d543f899d18531b1a80ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:09.157712 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8743f3e1-1db5-4d89-aee3-465105f4ede8 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] 10.222.0.35 "GET /compute/v2.1/servers/d3621da7-8dd5-4829-b488-57c111e1d51e" status: 200 len: 1402 microversion: 2.1 time: 0.250764 Jun 10 18:15:09.170106 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2372/4803] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:15:08 2022] GET /compute/v2.1/servers/d3621da7-8dd5-4829-b488-57c111e1d51e => generated 1402 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:15:09.177313 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8a40d959-91d2-40e2-b6e1-713d7bc7b039 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c02e3940>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:09.254598 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8a40d959-91d2-40e2-b6e1-713d7bc7b039 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2" status: 200 len: 1453 microversion: 2.1 time: 0.085314 Jun 10 18:15:09.256620 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2373/4804] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:09 2022] GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2 => generated 1453 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:09.468569 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-4d20a5e6-def2-4c80-ad8e-43e188072e3b req-87409a7d-711e-4575-9171-d0975ec14b7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3621da7-8dd5-4829-b488-57c111e1d51e", "name": "network-vif-plugged", "status": "completed", "tag": "fcf26aeb-af7b-4182-90e2-0b31e69fed36"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:15:09.484643 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-4d20a5e6-def2-4c80-ad8e-43e188072e3b req-87409a7d-711e-4575-9171-d0975ec14b7e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:09.484643 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-4d20a5e6-def2-4c80-ad8e-43e188072e3b req-87409a7d-711e-4575-9171-d0975ec14b7e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:09.495980 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-4d20a5e6-def2-4c80-ad8e-43e188072e3b req-87409a7d-711e-4575-9171-d0975ec14b7e service nova] Creating event network-vif-plugged:fcf26aeb-af7b-4182-90e2-0b31e69fed36 for instance d3621da7-8dd5-4829-b488-57c111e1d51e on chh1-master-2 Jun 10 18:15:09.512027 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-4d20a5e6-def2-4c80-ad8e-43e188072e3b req-87409a7d-711e-4575-9171-d0975ec14b7e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061811 Jun 10 18:15:09.516519 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2374/4805] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:15:09.834531 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-950acbcc-82d2-4317-ab82-19f5bbbbf1e3 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 6.203315 Jun 10 18:15:09.836527 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2432/4806] 10.222.0.35 () {62 vars in 1188 bytes} [Fri Jun 10 18:15:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 6206 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 10 18:15:09.847585 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1ffeaaf8-c456-48ce-992f-40a07254e248 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:09.848298 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1ffeaaf8-c456-48ce-992f-40a07254e248 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:09.880558 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-aec71467-f962-4f0e-b196-17b34e8524cc tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:09.880558 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-aec71467-f962-4f0e-b196-17b34e8524cc tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:09.884966 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aec71467-f962-4f0e-b196-17b34e8524cc tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:09.885688 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aec71467-f962-4f0e-b196-17b34e8524cc tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:09.886808 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aec71467-f962-4f0e-b196-17b34e8524cc tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:09.887458 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aec71467-f962-4f0e-b196-17b34e8524cc tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:09.920504 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1ffeaaf8-c456-48ce-992f-40a07254e248 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:09.932953 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1ffeaaf8-c456-48ce-992f-40a07254e248 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:09.934390 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1ffeaaf8-c456-48ce-992f-40a07254e248 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:09.936089 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1ffeaaf8-c456-48ce-992f-40a07254e248 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1285 microversion: 2.32 time: 0.092852 Jun 10 18:15:09.938140 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2375/4807] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:09 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:15:10.176094 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ff475288-229f-4888-8c1e-ef6d2ad5ce43 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:10.176944 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ff475288-229f-4888-8c1e-ef6d2ad5ce43 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] [instance: d3621da7-8dd5-4829-b488-57c111e1d51e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:10.184032 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ff475288-229f-4888-8c1e-ef6d2ad5ce43 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:10.184580 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ff475288-229f-4888-8c1e-ef6d2ad5ce43 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:10.185339 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ff475288-229f-4888-8c1e-ef6d2ad5ce43 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:10.185803 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ff475288-229f-4888-8c1e-ef6d2ad5ce43 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:10.292476 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-aec71467-f962-4f0e-b196-17b34e8524cc tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:10.302925 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-aec71467-f962-4f0e-b196-17b34e8524cc tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:10.304678 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-aec71467-f962-4f0e-b196-17b34e8524cc tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:10.306428 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-aec71467-f962-4f0e-b196-17b34e8524cc tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1874 microversion: 2.42 time: 0.442101 Jun 10 18:15:10.307505 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2433/4808] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:09 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1874 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:15:10.312700 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5c9dfbec-0e07-4a8b-aa37-813ba8f484aa tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3aa2820>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:10.380082 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ff475288-229f-4888-8c1e-ef6d2ad5ce43 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9db2e8931d4dfdbefae0cd8de8b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788bce6c44d543f899d18531b1a80ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:10.383877 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5c9dfbec-0e07-4a8b-aa37-813ba8f484aa tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2" status: 200 len: 1453 microversion: 2.1 time: 0.074890 Jun 10 18:15:10.392793 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2434/4809] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:10 2022] GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2 => generated 1453 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:10.395948 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ff475288-229f-4888-8c1e-ef6d2ad5ce43 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] 10.222.0.35 "GET /compute/v2.1/servers/d3621da7-8dd5-4829-b488-57c111e1d51e" status: 200 len: 1402 microversion: 2.1 time: 0.224509 Jun 10 18:15:10.396972 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2376/4810] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:15:10 2022] GET /compute/v2.1/servers/d3621da7-8dd5-4829-b488-57c111e1d51e => generated 1402 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:15:10.957732 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-86acd336-d72b-4a9c-b7ea-27ec0f0cb488 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:10.960208 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-86acd336-d72b-4a9c-b7ea-27ec0f0cb488 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:11.329832 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-45c108ac-c9b5-43e2-a0b6-6d68f14df2da tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:11.331073 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-45c108ac-c9b5-43e2-a0b6-6d68f14df2da tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:11.348689 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45c108ac-c9b5-43e2-a0b6-6d68f14df2da tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:11.349750 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45c108ac-c9b5-43e2-a0b6-6d68f14df2da tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:11.350919 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45c108ac-c9b5-43e2-a0b6-6d68f14df2da tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:11.352555 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45c108ac-c9b5-43e2-a0b6-6d68f14df2da tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:11.509036 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-86acd336-d72b-4a9c-b7ea-27ec0f0cb488 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:11.526287 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-86acd336-d72b-4a9c-b7ea-27ec0f0cb488 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:11.529719 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-86acd336-d72b-4a9c-b7ea-27ec0f0cb488 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:11.533518 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-86acd336-d72b-4a9c-b7ea-27ec0f0cb488 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1285 microversion: 2.32 time: 0.580778 Jun 10 18:15:11.755716 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2435/4811] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:10 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1285 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:15:11.755716 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-50334f1e-04b8-4333-bd55-c116fba7a5b6 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3adf700>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:11.755716 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-50334f1e-04b8-4333-bd55-c116fba7a5b6 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2" status: 200 len: 1453 microversion: 2.1 time: 0.081522 Jun 10 18:15:11.755716 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2436/4812] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:11 2022] GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2 => generated 1453 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:11.755716 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-04fe24fb-2ff2-4696-9ab1-e3619dc65ff1 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:11.755716 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-04fe24fb-2ff2-4696-9ab1-e3619dc65ff1 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] [instance: d3621da7-8dd5-4829-b488-57c111e1d51e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:11.755716 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-04fe24fb-2ff2-4696-9ab1-e3619dc65ff1 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:11.755716 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-04fe24fb-2ff2-4696-9ab1-e3619dc65ff1 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:11.755716 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-04fe24fb-2ff2-4696-9ab1-e3619dc65ff1 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:11.755716 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-04fe24fb-2ff2-4696-9ab1-e3619dc65ff1 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:11.759911 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-45c108ac-c9b5-43e2-a0b6-6d68f14df2da tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:11.759911 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-45c108ac-c9b5-43e2-a0b6-6d68f14df2da tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:11.759911 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-45c108ac-c9b5-43e2-a0b6-6d68f14df2da tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:11.759911 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-45c108ac-c9b5-43e2-a0b6-6d68f14df2da tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1874 microversion: 2.42 time: 0.369922 Jun 10 18:15:11.759911 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2377/4813] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:11 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1874 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:15:11.759911 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-7a7c853c-cc36-4e44-9887-49c0c20b907d req-77fe317a-548e-4632-8c5b-8aff41cb2654 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ceaaf7b-0972-4fe5-bd63-5534a71f80d3", "name": "network-vif-plugged", "status": "completed", "tag": "bfc7ec9b-4f8d-4dcb-8a97-a81d140faa36"}, {"server_uuid": "8ceaaf7b-0972-4fe5-bd63-5534a71f80d3", "name": "network-vif-plugged", "status": "completed", "tag": "2fae9b12-2883-43bb-8d97-3bb827dd8497"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:15:11.759911 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-7a7c853c-cc36-4e44-9887-49c0c20b907d req-77fe317a-548e-4632-8c5b-8aff41cb2654 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:11.759911 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-7a7c853c-cc36-4e44-9887-49c0c20b907d req-77fe317a-548e-4632-8c5b-8aff41cb2654 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:11.759911 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-7a7c853c-cc36-4e44-9887-49c0c20b907d req-77fe317a-548e-4632-8c5b-8aff41cb2654 service nova] Creating event network-vif-plugged:bfc7ec9b-4f8d-4dcb-8a97-a81d140faa36 for instance 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 on chh2-master-2 Jun 10 18:15:11.759911 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-7a7c853c-cc36-4e44-9887-49c0c20b907d req-77fe317a-548e-4632-8c5b-8aff41cb2654 service nova] Creating event network-vif-plugged:2fae9b12-2883-43bb-8d97-3bb827dd8497 for instance 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 on chh2-master-2 Jun 10 18:15:11.759911 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-7a7c853c-cc36-4e44-9887-49c0c20b907d req-77fe317a-548e-4632-8c5b-8aff41cb2654 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038275 Jun 10 18:15:11.759911 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2378/4814] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:15:11.896623 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-04fe24fb-2ff2-4696-9ab1-e3619dc65ff1 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9db2e8931d4dfdbefae0cd8de8b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788bce6c44d543f899d18531b1a80ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:11.905342 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-04fe24fb-2ff2-4696-9ab1-e3619dc65ff1 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] 10.222.0.35 "GET /compute/v2.1/servers/d3621da7-8dd5-4829-b488-57c111e1d51e" status: 200 len: 1590 microversion: 2.1 time: 0.285417 Jun 10 18:15:11.905919 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2437/4815] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:15:11 2022] GET /compute/v2.1/servers/d3621da7-8dd5-4829-b488-57c111e1d51e => generated 1590 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:11.923267 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-89cc913e-b85b-4b3b-b845-87c198d89f75 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:11.923875 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-89cc913e-b85b-4b3b-b845-87c198d89f75 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] [instance: d3621da7-8dd5-4829-b488-57c111e1d51e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:11.930226 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-89cc913e-b85b-4b3b-b845-87c198d89f75 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:11.930675 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-89cc913e-b85b-4b3b-b845-87c198d89f75 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:11.931437 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-89cc913e-b85b-4b3b-b845-87c198d89f75 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:11.931879 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-89cc913e-b85b-4b3b-b845-87c198d89f75 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:12.024516 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-89cc913e-b85b-4b3b-b845-87c198d89f75 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] 10.222.0.35 "GET /compute/v2.1/servers/d3621da7-8dd5-4829-b488-57c111e1d51e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.105604 Jun 10 18:15:12.025124 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2379/4816] 10.222.0.35 () {58 vars in 1274 bytes} [Fri Jun 10 18:15:11 2022] GET /compute/v2.1/servers/d3621da7-8dd5-4829-b488-57c111e1d51e/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:15:12.555086 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-597b8cd0-595d-4d47-83e2-46999ea16e08 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:12.556361 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-597b8cd0-595d-4d47-83e2-46999ea16e08 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:12.637470 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-52fd0cfe-d815-44c5-aa05-22d69ce92d4f tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c0377280>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:12.641009 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-597b8cd0-595d-4d47-83e2-46999ea16e08 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:12.669167 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-597b8cd0-595d-4d47-83e2-46999ea16e08 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:12.675120 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-597b8cd0-595d-4d47-83e2-46999ea16e08 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:12.684380 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-597b8cd0-595d-4d47-83e2-46999ea16e08 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1285 microversion: 2.32 time: 0.132768 Jun 10 18:15:12.684380 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2438/4817] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:12 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1285 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:15:12.714016 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-52fd0cfe-d815-44c5-aa05-22d69ce92d4f tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2" status: 200 len: 1453 microversion: 2.1 time: 0.086029 Jun 10 18:15:12.714719 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2380/4818] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:12 2022] GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2 => generated 1453 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:12.726026 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c5a31381-144c-46a6-978b-1d3845378837 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:12.729859 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c5a31381-144c-46a6-978b-1d3845378837 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:12.738543 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5a31381-144c-46a6-978b-1d3845378837 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:12.739049 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5a31381-144c-46a6-978b-1d3845378837 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:12.740135 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5a31381-144c-46a6-978b-1d3845378837 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:12.740722 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5a31381-144c-46a6-978b-1d3845378837 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:13.072526 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c5a31381-144c-46a6-978b-1d3845378837 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:13.082365 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c5a31381-144c-46a6-978b-1d3845378837 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:13.084136 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c5a31381-144c-46a6-978b-1d3845378837 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:13.085529 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c5a31381-144c-46a6-978b-1d3845378837 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1874 microversion: 2.42 time: 0.371037 Jun 10 18:15:13.086977 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2439/4819] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:12 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1874 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:15:13.529904 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c56faa5a-2b0e-41bd-85b1-f60a6e830676 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:13.529904 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c56faa5a-2b0e-41bd-85b1-f60a6e830676 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] [instance: d3621da7-8dd5-4829-b488-57c111e1d51e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:13.530962 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:15:13.539946 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c56faa5a-2b0e-41bd-85b1-f60a6e830676 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:13.543601 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c56faa5a-2b0e-41bd-85b1-f60a6e830676 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:13.546440 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c56faa5a-2b0e-41bd-85b1-f60a6e830676 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:13.547170 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c56faa5a-2b0e-41bd-85b1-f60a6e830676 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:13.573928 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-20c20769-6d16-4756-8cf8-24d4e063ee75 req-08145797-db5f-461a-8088-4f792eeb696b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3621da7-8dd5-4829-b488-57c111e1d51e", "tag": "fcf26aeb-af7b-4182-90e2-0b31e69fed36"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:15:13.598849 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-20c20769-6d16-4756-8cf8-24d4e063ee75 req-08145797-db5f-461a-8088-4f792eeb696b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:13.599723 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-20c20769-6d16-4756-8cf8-24d4e063ee75 req-08145797-db5f-461a-8088-4f792eeb696b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:13.621848 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-20c20769-6d16-4756-8cf8-24d4e063ee75 req-08145797-db5f-461a-8088-4f792eeb696b service nova] Creating event network-changed:fcf26aeb-af7b-4182-90e2-0b31e69fed36 for instance d3621da7-8dd5-4829-b488-57c111e1d51e on chh1-master-2 Jun 10 18:15:13.632119 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-20c20769-6d16-4756-8cf8-24d4e063ee75 req-08145797-db5f-461a-8088-4f792eeb696b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079060 Jun 10 18:15:13.633845 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2440/4820] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:15:13.703247 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-77dd45ca-4be8-4c20-98b7-00c6889782fb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:13.704391 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-77dd45ca-4be8-4c20-98b7-00c6889782fb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:13.715086 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-77dd45ca-4be8-4c20-98b7-00c6889782fb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:13.720644 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-77dd45ca-4be8-4c20-98b7-00c6889782fb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:13.720644 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-77dd45ca-4be8-4c20-98b7-00c6889782fb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:13.720644 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-77dd45ca-4be8-4c20-98b7-00c6889782fb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:13.809793 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-77dd45ca-4be8-4c20-98b7-00c6889782fb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:13.819409 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-77dd45ca-4be8-4c20-98b7-00c6889782fb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:13.820970 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-77dd45ca-4be8-4c20-98b7-00c6889782fb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:13.822386 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-77dd45ca-4be8-4c20-98b7-00c6889782fb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1575 microversion: 2.32 time: 0.124480 Jun 10 18:15:13.823518 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2441/4821] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:13 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1575 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:15:13.828344 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8415d3e6-7a1c-4f74-b7f5-45d043d30755 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3c745e0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:13.883139 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8415d3e6-7a1c-4f74-b7f5-45d043d30755 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2" status: 200 len: 1453 microversion: 2.1 time: 0.058286 Jun 10 18:15:13.914368 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2442/4822] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:13 2022] GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2 => generated 1453 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:13.928654 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-dafaa45a-4081-4c9f-a058-265fa62b7f72 req-2c89fabe-28c8-4b93-b132-1823fb02fd5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ceaaf7b-0972-4fe5-bd63-5534a71f80d3", "name": "network-vif-plugged", "status": "completed", "tag": "a18991bb-a2c4-4f74-89e1-81c2c3fb3a0b"}, {"server_uuid": "8ceaaf7b-0972-4fe5-bd63-5534a71f80d3", "name": "network-vif-plugged", "status": "completed", "tag": "1eec4f25-edb7-4e8d-872d-3f31321f8bf5"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:15:13.942991 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-dafaa45a-4081-4c9f-a058-265fa62b7f72 req-2c89fabe-28c8-4b93-b132-1823fb02fd5b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:13.950202 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-dafaa45a-4081-4c9f-a058-265fa62b7f72 req-2c89fabe-28c8-4b93-b132-1823fb02fd5b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:13.961950 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-dafaa45a-4081-4c9f-a058-265fa62b7f72 req-2c89fabe-28c8-4b93-b132-1823fb02fd5b service nova] Creating event network-vif-plugged:a18991bb-a2c4-4f74-89e1-81c2c3fb3a0b for instance 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 on chh2-master-2 Jun 10 18:15:13.962468 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-dafaa45a-4081-4c9f-a058-265fa62b7f72 req-2c89fabe-28c8-4b93-b132-1823fb02fd5b service nova] Creating event network-vif-plugged:1eec4f25-edb7-4e8d-872d-3f31321f8bf5 for instance 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 on chh2-master-2 Jun 10 18:15:13.971221 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-dafaa45a-4081-4c9f-a058-265fa62b7f72 req-2c89fabe-28c8-4b93-b132-1823fb02fd5b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.055403 Jun 10 18:15:13.975856 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2443/4823] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:15:14.129257 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b441e713-9335-4002-8940-32b5f6e910fa tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:14.130383 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b441e713-9335-4002-8940-32b5f6e910fa tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:14.161648 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b441e713-9335-4002-8940-32b5f6e910fa tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:14.164941 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b441e713-9335-4002-8940-32b5f6e910fa tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:14.171595 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b441e713-9335-4002-8940-32b5f6e910fa tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:14.172975 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b441e713-9335-4002-8940-32b5f6e910fa tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:14.371540 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c56faa5a-2b0e-41bd-85b1-f60a6e830676 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9db2e8931d4dfdbefae0cd8de8b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788bce6c44d543f899d18531b1a80ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:14.387206 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c56faa5a-2b0e-41bd-85b1-f60a6e830676 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] 10.222.0.35 "GET /compute/v2.1/servers/d3621da7-8dd5-4829-b488-57c111e1d51e" status: 200 len: 1590 microversion: 2.1 time: 0.862817 Jun 10 18:15:14.398111 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2381/4824] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:15:13 2022] GET /compute/v2.1/servers/d3621da7-8dd5-4829-b488-57c111e1d51e => generated 1590 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:14.489609 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b441e713-9335-4002-8940-32b5f6e910fa tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:14.505013 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b441e713-9335-4002-8940-32b5f6e910fa tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:14.507132 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b441e713-9335-4002-8940-32b5f6e910fa tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:14.508501 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b441e713-9335-4002-8940-32b5f6e910fa tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1874 microversion: 2.42 time: 0.405495 Jun 10 18:15:14.524619 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2444/4825] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:14 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1874 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:15:14.842235 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dc039a18-edd8-496d-987e-ce97b3f70123 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:14.845306 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dc039a18-edd8-496d-987e-ce97b3f70123 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:14.859292 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc039a18-edd8-496d-987e-ce97b3f70123 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:14.859745 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc039a18-edd8-496d-987e-ce97b3f70123 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:14.860557 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc039a18-edd8-496d-987e-ce97b3f70123 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:14.861014 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc039a18-edd8-496d-987e-ce97b3f70123 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:14.897061 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1536d237-5a63-40e9-9511-006b7ed896cb tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3c74160>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:14.979487 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1536d237-5a63-40e9-9511-006b7ed896cb tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2" status: 200 len: 1453 microversion: 2.1 time: 0.086743 Jun 10 18:15:14.980189 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2445/4826] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:14 2022] GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2 => generated 1453 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:15:15.099559 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-dc039a18-edd8-496d-987e-ce97b3f70123 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:15.128162 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-dc039a18-edd8-496d-987e-ce97b3f70123 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:15.131242 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-dc039a18-edd8-496d-987e-ce97b3f70123 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:15.134144 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dc039a18-edd8-496d-987e-ce97b3f70123 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1583 microversion: 2.32 time: 0.294942 Jun 10 18:15:15.136167 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2382/4827] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:14 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1583 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:15:15.528099 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fb46b050-e062-4a7f-9902-251e9df0cb71 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:15.528893 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fb46b050-e062-4a7f-9902-251e9df0cb71 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:15.548819 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fb46b050-e062-4a7f-9902-251e9df0cb71 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:15.551187 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fb46b050-e062-4a7f-9902-251e9df0cb71 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:15.553717 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fb46b050-e062-4a7f-9902-251e9df0cb71 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:15.554482 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fb46b050-e062-4a7f-9902-251e9df0cb71 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:15.993366 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7654e9b5-3f2c-4ad9-ba95-35429c1baee2 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c6108ca0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:16.074065 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7654e9b5-3f2c-4ad9-ba95-35429c1baee2 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2" status: 200 len: 1453 microversion: 2.1 time: 0.084325 Jun 10 18:15:16.075163 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2383/4828] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:15 2022] GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2 => generated 1453 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:16.080516 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-683000ec-1a54-439e-b2b2-cd0faa12dbbd req-1353948f-0fcb-4684-b9f5-eb4bcfe61d55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ceaaf7b-0972-4fe5-bd63-5534a71f80d3", "name": "network-vif-plugged", "status": "completed", "tag": "dc174283-6e08-4d60-9f00-a5de6cfc1f16"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:15:16.109223 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-683000ec-1a54-439e-b2b2-cd0faa12dbbd req-1353948f-0fcb-4684-b9f5-eb4bcfe61d55 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:16.109954 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-683000ec-1a54-439e-b2b2-cd0faa12dbbd req-1353948f-0fcb-4684-b9f5-eb4bcfe61d55 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:16.141382 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-683000ec-1a54-439e-b2b2-cd0faa12dbbd req-1353948f-0fcb-4684-b9f5-eb4bcfe61d55 service nova] Creating event network-vif-plugged:dc174283-6e08-4d60-9f00-a5de6cfc1f16 for instance 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 on chh2-master-2 Jun 10 18:15:16.151503 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-683000ec-1a54-439e-b2b2-cd0faa12dbbd req-1353948f-0fcb-4684-b9f5-eb4bcfe61d55 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070080 Jun 10 18:15:16.151503 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2384/4829] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:15:16.162076 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3c875928-dc56-4fac-b837-ba1d9d581ca0 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:16.166858 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3c875928-dc56-4fac-b837-ba1d9d581ca0 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:16.178752 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3c875928-dc56-4fac-b837-ba1d9d581ca0 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:16.180584 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3c875928-dc56-4fac-b837-ba1d9d581ca0 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:16.183190 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3c875928-dc56-4fac-b837-ba1d9d581ca0 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:16.184769 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3c875928-dc56-4fac-b837-ba1d9d581ca0 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:16.226469 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fb46b050-e062-4a7f-9902-251e9df0cb71 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:16.242668 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fb46b050-e062-4a7f-9902-251e9df0cb71 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:16.246262 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fb46b050-e062-4a7f-9902-251e9df0cb71 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:16.248719 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fb46b050-e062-4a7f-9902-251e9df0cb71 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1874 microversion: 2.42 time: 0.724162 Jun 10 18:15:16.271816 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2446/4830] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:15 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1874 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:15:16.370618 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3c875928-dc56-4fac-b837-ba1d9d581ca0 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:16.388200 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3c875928-dc56-4fac-b837-ba1d9d581ca0 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:16.393520 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3c875928-dc56-4fac-b837-ba1d9d581ca0 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:16.395612 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3c875928-dc56-4fac-b837-ba1d9d581ca0 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1593 microversion: 2.32 time: 0.238883 Jun 10 18:15:16.398282 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2385/4831] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:16 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1593 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:15:17.091660 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8e475bf8-e6d6-403e-ba16-36becac65295 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3afbdc0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:17.186787 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8e475bf8-e6d6-403e-ba16-36becac65295 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2" status: 200 len: 1453 microversion: 2.1 time: 0.102165 Jun 10 18:15:17.188215 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2447/4832] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:17 2022] GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2 => generated 1453 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:17.285814 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cc3c8227-57ab-4e87-8314-788980419be7 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:17.290660 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cc3c8227-57ab-4e87-8314-788980419be7 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:17.308124 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc3c8227-57ab-4e87-8314-788980419be7 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:17.314795 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc3c8227-57ab-4e87-8314-788980419be7 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:17.314795 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc3c8227-57ab-4e87-8314-788980419be7 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:17.314795 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc3c8227-57ab-4e87-8314-788980419be7 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:17.420444 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5486cecd-8cc1-4447-9a9e-03c7362c197e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:17.421969 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5486cecd-8cc1-4447-9a9e-03c7362c197e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:17.461255 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5486cecd-8cc1-4447-9a9e-03c7362c197e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:17.471112 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5486cecd-8cc1-4447-9a9e-03c7362c197e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:17.473555 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5486cecd-8cc1-4447-9a9e-03c7362c197e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:17.473828 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5486cecd-8cc1-4447-9a9e-03c7362c197e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:17.842216 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cc3c8227-57ab-4e87-8314-788980419be7 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:17.853850 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cc3c8227-57ab-4e87-8314-788980419be7 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:17.855932 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cc3c8227-57ab-4e87-8314-788980419be7 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:17.858683 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cc3c8227-57ab-4e87-8314-788980419be7 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1874 microversion: 2.42 time: 0.586395 Jun 10 18:15:17.874009 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2386/4833] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:17 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1874 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:15:18.202771 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7e7c0823-2488-438d-88e6-7b3f96669ce4 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c0328280>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:18.563273 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5486cecd-8cc1-4447-9a9e-03c7362c197e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:18.563273 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5486cecd-8cc1-4447-9a9e-03c7362c197e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:18.563273 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5486cecd-8cc1-4447-9a9e-03c7362c197e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:18.563273 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5486cecd-8cc1-4447-9a9e-03c7362c197e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1661 microversion: 2.32 time: 0.870202 Jun 10 18:15:18.563273 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2448/4834] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:17 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1661 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:15:18.567837 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7e7c0823-2488-438d-88e6-7b3f96669ce4 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2" status: 200 len: 1453 microversion: 2.1 time: 0.121788 Jun 10 18:15:18.567837 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2387/4835] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:18 2022] GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2 => generated 1453 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:15:18.568954 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-cd89a9f2-fe36-4902-8955-db57d8bd841b req-09406e7f-8b88-4c0a-9324-65617f816f17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ceaaf7b-0972-4fe5-bd63-5534a71f80d3", "name": "network-vif-plugged", "status": "completed", "tag": "637baac4-b034-4d97-98de-e1137a57f487"}, {"server_uuid": "8ceaaf7b-0972-4fe5-bd63-5534a71f80d3", "name": "network-vif-plugged", "status": "completed", "tag": "67581347-173d-48a0-b450-4ad516d4f8af"}, {"server_uuid": "89cea229-7bfb-43e4-a855-e9c6ae81d37b", "name": "network-vif-unplugged", "status": "completed", "tag": "6aa82b06-065f-4482-b2de-d6771acbe4bb"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:15:18.568954 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:15:18.568954 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-cd89a9f2-fe36-4902-8955-db57d8bd841b req-09406e7f-8b88-4c0a-9324-65617f816f17 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:18.568954 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-cd89a9f2-fe36-4902-8955-db57d8bd841b req-09406e7f-8b88-4c0a-9324-65617f816f17 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:18.568954 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-cd89a9f2-fe36-4902-8955-db57d8bd841b req-09406e7f-8b88-4c0a-9324-65617f816f17 service nova] Creating event network-vif-plugged:637baac4-b034-4d97-98de-e1137a57f487 for instance 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 on chh2-master-2 Jun 10 18:15:18.568954 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-cd89a9f2-fe36-4902-8955-db57d8bd841b req-09406e7f-8b88-4c0a-9324-65617f816f17 service nova] Creating event network-vif-plugged:67581347-173d-48a0-b450-4ad516d4f8af for instance 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 on chh2-master-2 Jun 10 18:15:18.568954 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-cd89a9f2-fe36-4902-8955-db57d8bd841b req-09406e7f-8b88-4c0a-9324-65617f816f17 service nova] Creating event network-vif-unplugged:6aa82b06-065f-4482-b2de-d6771acbe4bb for instance 89cea229-7bfb-43e4-a855-e9c6ae81d37b on chh2-master-2 Jun 10 18:15:18.568954 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-cd89a9f2-fe36-4902-8955-db57d8bd841b req-09406e7f-8b88-4c0a-9324-65617f816f17 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.099281 Jun 10 18:15:18.568954 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2449/4836] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:15:18.879414 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a9f51063-2957-4f16-9434-51ce4569b4fd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:18.880258 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a9f51063-2957-4f16-9434-51ce4569b4fd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:18.894296 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a9f51063-2957-4f16-9434-51ce4569b4fd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:18.894754 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a9f51063-2957-4f16-9434-51ce4569b4fd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:18.895553 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a9f51063-2957-4f16-9434-51ce4569b4fd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:18.896018 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a9f51063-2957-4f16-9434-51ce4569b4fd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:19.307139 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7e43eb1d-8af6-4ea5-b61e-90c2081f49ef tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:19.307853 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7e43eb1d-8af6-4ea5-b61e-90c2081f49ef tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:19.332460 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7e43eb1d-8af6-4ea5-b61e-90c2081f49ef tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:19.332945 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7e43eb1d-8af6-4ea5-b61e-90c2081f49ef tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:19.333717 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7e43eb1d-8af6-4ea5-b61e-90c2081f49ef tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:19.334161 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7e43eb1d-8af6-4ea5-b61e-90c2081f49ef tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:19.539951 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a9f51063-2957-4f16-9434-51ce4569b4fd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:19.550612 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a9f51063-2957-4f16-9434-51ce4569b4fd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:19.552157 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a9f51063-2957-4f16-9434-51ce4569b4fd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:19.574269 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a9f51063-2957-4f16-9434-51ce4569b4fd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1874 microversion: 2.42 time: 0.697122 Jun 10 18:15:19.579446 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2388/4837] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:18 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1874 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:15:19.592260 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b9e281ee-08bc-43c1-bb6c-e4ffc918ca33 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c040a940>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:19.716486 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b9e281ee-08bc-43c1-bb6c-e4ffc918ca33 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2" status: 200 len: 1453 microversion: 2.1 time: 0.134427 Jun 10 18:15:19.716486 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2389/4838] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:19 2022] GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2 => generated 1453 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:20.047677 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7e43eb1d-8af6-4ea5-b61e-90c2081f49ef tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:20.074545 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7e43eb1d-8af6-4ea5-b61e-90c2081f49ef tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:20.084804 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7e43eb1d-8af6-4ea5-b61e-90c2081f49ef tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:20.088047 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7e43eb1d-8af6-4ea5-b61e-90c2081f49ef tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1661 microversion: 2.32 time: 0.785351 Jun 10 18:15:20.092632 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2450/4839] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:19 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1661 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:15:20.434016 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:15:20.440115 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-5c770d29-e4d3-408e-9a12-ce7033cc2c8c req-2cac586d-477b-4a8b-b35a-99d8d5a698a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72eaef23-30d6-4755-a9b7-9547856075b3", "name": "network-vif-plugged", "status": "completed", "tag": "777ebce0-6591-4ee2-b139-f87b2964f3fb"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:15:20.472351 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-5c770d29-e4d3-408e-9a12-ce7033cc2c8c req-2cac586d-477b-4a8b-b35a-99d8d5a698a4 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:20.475130 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-5c770d29-e4d3-408e-9a12-ce7033cc2c8c req-2cac586d-477b-4a8b-b35a-99d8d5a698a4 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:20.486878 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-5c770d29-e4d3-408e-9a12-ce7033cc2c8c req-2cac586d-477b-4a8b-b35a-99d8d5a698a4 service nova] Creating event network-vif-plugged:777ebce0-6591-4ee2-b139-f87b2964f3fb for instance 72eaef23-30d6-4755-a9b7-9547856075b3 on chh2-master-2 Jun 10 18:15:20.492479 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-5c770d29-e4d3-408e-9a12-ce7033cc2c8c req-2cac586d-477b-4a8b-b35a-99d8d5a698a4 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059252 Jun 10 18:15:20.493317 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2390/4840] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:15:20.598447 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-43076bff-35f1-47fa-8750-5de6f4caf00b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:20.602044 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-43076bff-35f1-47fa-8750-5de6f4caf00b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:20.619146 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-43076bff-35f1-47fa-8750-5de6f4caf00b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:20.619899 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-43076bff-35f1-47fa-8750-5de6f4caf00b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:20.620947 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-43076bff-35f1-47fa-8750-5de6f4caf00b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:20.621532 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-43076bff-35f1-47fa-8750-5de6f4caf00b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:20.729630 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5fb615c8-d424-4aae-b5ab-ab97abad9ddc tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c0064040>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:20.814335 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5fb615c8-d424-4aae-b5ab-ab97abad9ddc tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2" status: 200 len: 1453 microversion: 2.1 time: 0.089343 Jun 10 18:15:20.818579 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2391/4841] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:20 2022] GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2 => generated 1453 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:21.125163 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d381ca89-d2c5-475e-8bc9-2cebba9b473d tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:21.126140 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d381ca89-d2c5-475e-8bc9-2cebba9b473d tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:21.132844 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d381ca89-d2c5-475e-8bc9-2cebba9b473d tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:21.136889 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d381ca89-d2c5-475e-8bc9-2cebba9b473d tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:21.138100 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d381ca89-d2c5-475e-8bc9-2cebba9b473d tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:21.139200 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d381ca89-d2c5-475e-8bc9-2cebba9b473d tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:21.171995 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-43076bff-35f1-47fa-8750-5de6f4caf00b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:21.177326 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:15:21.197604 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-43076bff-35f1-47fa-8750-5de6f4caf00b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:21.201749 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-43076bff-35f1-47fa-8750-5de6f4caf00b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:21.207982 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-43076bff-35f1-47fa-8750-5de6f4caf00b tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1874 microversion: 2.42 time: 0.611613 Jun 10 18:15:21.209269 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2451/4842] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:20 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1874 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:15:21.628050 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d381ca89-d2c5-475e-8bc9-2cebba9b473d tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:21.641698 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d381ca89-d2c5-475e-8bc9-2cebba9b473d tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:21.720895 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d381ca89-d2c5-475e-8bc9-2cebba9b473d tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:21.722372 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d381ca89-d2c5-475e-8bc9-2cebba9b473d tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1708 microversion: 2.32 time: 0.619211 Jun 10 18:15:21.725629 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2392/4843] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:21 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1708 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:15:21.828688 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b8b480e2-e518-4f23-bb87-3b72c8a72251 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3e96dc0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:21.926938 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b8b480e2-e518-4f23-bb87-3b72c8a72251 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2" status: 200 len: 1453 microversion: 2.1 time: 0.102651 Jun 10 18:15:21.929296 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2452/4844] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:21 2022] GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2 => generated 1453 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:22.229178 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-90955f5a-b8e0-4a76-a357-85da9116f215 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:22.230405 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-90955f5a-b8e0-4a76-a357-85da9116f215 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:22.243232 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-90955f5a-b8e0-4a76-a357-85da9116f215 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:22.247203 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-90955f5a-b8e0-4a76-a357-85da9116f215 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:22.248924 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-90955f5a-b8e0-4a76-a357-85da9116f215 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:22.249566 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-90955f5a-b8e0-4a76-a357-85da9116f215 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:22.320767 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:15:22.738332 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=10 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:15:22.743144 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-310026bf-ae69-42c3-89a7-49119696ff1a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:22.743638 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-310026bf-ae69-42c3-89a7-49119696ff1a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:22.784296 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-310026bf-ae69-42c3-89a7-49119696ff1a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:22.785448 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-310026bf-ae69-42c3-89a7-49119696ff1a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:22.788237 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-310026bf-ae69-42c3-89a7-49119696ff1a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:22.788750 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-310026bf-ae69-42c3-89a7-49119696ff1a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:23.006896 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-90955f5a-b8e0-4a76-a357-85da9116f215 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:23.031843 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-90955f5a-b8e0-4a76-a357-85da9116f215 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:23.038562 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-90955f5a-b8e0-4a76-a357-85da9116f215 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:23.040274 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-90955f5a-b8e0-4a76-a357-85da9116f215 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 2831 microversion: 2.42 time: 0.814982 Jun 10 18:15:23.045500 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2393/4845] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:22 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 2831 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:15:23.058544 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-972a474a-cead-47ec-aa9b-9a750edf6c82 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c03281f0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:23.192521 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-972a474a-cead-47ec-aa9b-9a750edf6c82 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2" status: 200 len: 1453 microversion: 2.1 time: 0.143471 Jun 10 18:15:23.194505 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2394/4846] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:23 2022] GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2 => generated 1453 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:23.208151 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-59eb39e3-1ca2-492d-98d9-b23cd74c45c6 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:23.212299 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-59eb39e3-1ca2-492d-98d9-b23cd74c45c6 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:23.228151 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-59eb39e3-1ca2-492d-98d9-b23cd74c45c6 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:23.228806 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-59eb39e3-1ca2-492d-98d9-b23cd74c45c6 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:23.229823 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-59eb39e3-1ca2-492d-98d9-b23cd74c45c6 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:23.232270 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-59eb39e3-1ca2-492d-98d9-b23cd74c45c6 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:23.480994 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-59eb39e3-1ca2-492d-98d9-b23cd74c45c6 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.285131 Jun 10 18:15:23.482219 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2395/4847] 10.222.0.35 () {60 vars in 1315 bytes} [Fri Jun 10 18:15:23 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3/os-interface => generated 1831 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:15:23.790363 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-310026bf-ae69-42c3-89a7-49119696ff1a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:23.817742 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-310026bf-ae69-42c3-89a7-49119696ff1a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:23.827855 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-310026bf-ae69-42c3-89a7-49119696ff1a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:23.844690 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-310026bf-ae69-42c3-89a7-49119696ff1a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1755 microversion: 2.32 time: 1.096964 Jun 10 18:15:23.850567 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2453/4848] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:22 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1755 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:15:24.207893 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3b54b658-edd5-4a0e-8f3d-094c9ec01dd8 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c0064160>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:24.280060 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3b54b658-edd5-4a0e-8f3d-094c9ec01dd8 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2" status: 200 len: 1453 microversion: 2.1 time: 0.074792 Jun 10 18:15:24.281393 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2396/4849] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:24 2022] GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2 => generated 1453 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:24.856354 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1bf8f55d-9a19-4286-ae1a-46793aec6f32 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:24.857524 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1bf8f55d-9a19-4286-ae1a-46793aec6f32 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:24.876683 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1bf8f55d-9a19-4286-ae1a-46793aec6f32 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:24.878289 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1bf8f55d-9a19-4286-ae1a-46793aec6f32 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:24.880774 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1bf8f55d-9a19-4286-ae1a-46793aec6f32 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:24.882034 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1bf8f55d-9a19-4286-ae1a-46793aec6f32 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:25.271887 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1bf8f55d-9a19-4286-ae1a-46793aec6f32 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:25.296186 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d64ec3d0-052c-4616-aa48-1e12fe406263 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c02c39d0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:25.307128 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1bf8f55d-9a19-4286-ae1a-46793aec6f32 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:25.323973 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1bf8f55d-9a19-4286-ae1a-46793aec6f32 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:25.332548 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1bf8f55d-9a19-4286-ae1a-46793aec6f32 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1802 microversion: 2.32 time: 0.479182 Jun 10 18:15:25.334074 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2454/4850] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:24 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1802 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:15:25.371807 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d64ec3d0-052c-4616-aa48-1e12fe406263 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2" status: 200 len: 1453 microversion: 2.1 time: 0.082895 Jun 10 18:15:25.379276 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2397/4851] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:25 2022] GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2 => generated 1453 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:15:26.358202 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-609cc0e6-23ff-461f-bd5d-6c8335a0e781 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:26.359148 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-609cc0e6-23ff-461f-bd5d-6c8335a0e781 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:26.368493 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-609cc0e6-23ff-461f-bd5d-6c8335a0e781 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:26.369864 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-609cc0e6-23ff-461f-bd5d-6c8335a0e781 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:26.370770 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-609cc0e6-23ff-461f-bd5d-6c8335a0e781 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:26.371325 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-609cc0e6-23ff-461f-bd5d-6c8335a0e781 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:26.402074 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cfb16fbc-9f20-4b9c-9677-66dd25df65c8 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c03cd310>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:26.459006 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cfb16fbc-9f20-4b9c-9677-66dd25df65c8 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2" status: 200 len: 1453 microversion: 2.1 time: 0.076943 Jun 10 18:15:26.461288 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2398/4852] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:26 2022] GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2 => generated 1453 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:26.564365 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-609cc0e6-23ff-461f-bd5d-6c8335a0e781 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:26.581170 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-609cc0e6-23ff-461f-bd5d-6c8335a0e781 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:26.582709 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-609cc0e6-23ff-461f-bd5d-6c8335a0e781 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:26.583925 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-609cc0e6-23ff-461f-bd5d-6c8335a0e781 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1849 microversion: 2.32 time: 0.232136 Jun 10 18:15:26.596169 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2455/4853] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:26 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1849 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:15:27.481014 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6381a3a7-a9ac-4ca4-8b69-a16e45899751 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c03b28b0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:27.572554 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-f947dad1-1f75-4e18-9d67-59f3d03b7669 req-ea957fb9-e34c-488b-b687-9219f6cc87a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39300115-c0d6-485c-a610-543bdf470fae", "tag": "90ddcb49-417f-4027-b8fd-8e4f78ccc8ba"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:15:27.590569 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6381a3a7-a9ac-4ca4-8b69-a16e45899751 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2" status: 200 len: 1453 microversion: 2.1 time: 0.116227 Jun 10 18:15:27.591732 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2399/4854] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:27 2022] GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2 => generated 1453 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:27.592989 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-f947dad1-1f75-4e18-9d67-59f3d03b7669 req-ea957fb9-e34c-488b-b687-9219f6cc87a3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:27.597214 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-f947dad1-1f75-4e18-9d67-59f3d03b7669 req-ea957fb9-e34c-488b-b687-9219f6cc87a3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:27.603888 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a3b21b15-dfc5-4dce-8d01-1d41e5a6c8fb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:27.625318 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a3b21b15-dfc5-4dce-8d01-1d41e5a6c8fb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:27.628411 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-f947dad1-1f75-4e18-9d67-59f3d03b7669 req-ea957fb9-e34c-488b-b687-9219f6cc87a3 service nova] Creating event network-changed:90ddcb49-417f-4027-b8fd-8e4f78ccc8ba for instance 39300115-c0d6-485c-a610-543bdf470fae on chh2-master-2 Jun 10 18:15:27.650014 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-f947dad1-1f75-4e18-9d67-59f3d03b7669 req-ea957fb9-e34c-488b-b687-9219f6cc87a3 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078211 Jun 10 18:15:27.656352 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2456/4855] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:15:27.658803 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a3b21b15-dfc5-4dce-8d01-1d41e5a6c8fb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:27.659286 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a3b21b15-dfc5-4dce-8d01-1d41e5a6c8fb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:27.660083 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a3b21b15-dfc5-4dce-8d01-1d41e5a6c8fb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:27.663990 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a3b21b15-dfc5-4dce-8d01-1d41e5a6c8fb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:28.125553 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-2ae7db34-bb8b-4c70-80c9-fe5a2242908c req-da174839-3ba6-4454-98c8-92e84b737e3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ceaaf7b-0972-4fe5-bd63-5534a71f80d3", "tag": "67581347-173d-48a0-b450-4ad516d4f8af"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:15:28.155008 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-2ae7db34-bb8b-4c70-80c9-fe5a2242908c req-da174839-3ba6-4454-98c8-92e84b737e3f service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:28.158431 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-2ae7db34-bb8b-4c70-80c9-fe5a2242908c req-da174839-3ba6-4454-98c8-92e84b737e3f service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:28.208968 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a3b21b15-dfc5-4dce-8d01-1d41e5a6c8fb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:28.213763 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-2ae7db34-bb8b-4c70-80c9-fe5a2242908c req-da174839-3ba6-4454-98c8-92e84b737e3f service nova] Creating event network-changed:67581347-173d-48a0-b450-4ad516d4f8af for instance 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 on chh2-master-2 Jun 10 18:15:28.236549 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a3b21b15-dfc5-4dce-8d01-1d41e5a6c8fb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:28.251112 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a3b21b15-dfc5-4dce-8d01-1d41e5a6c8fb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:28.257419 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a3b21b15-dfc5-4dce-8d01-1d41e5a6c8fb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1849 microversion: 2.32 time: 0.657082 Jun 10 18:15:28.269068 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2400/4856] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:27 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1849 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:15:28.280816 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-2ae7db34-bb8b-4c70-80c9-fe5a2242908c req-da174839-3ba6-4454-98c8-92e84b737e3f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160842 Jun 10 18:15:28.284126 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2457/4857] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:15:28.607084 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4222f654-60d1-42c7-b15d-bc686adef995 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c0261f70>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:28.733361 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4222f654-60d1-42c7-b15d-bc686adef995 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2" status: 200 len: 1453 microversion: 2.1 time: 0.132741 Jun 10 18:15:28.735087 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2401/4858] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:28 2022] GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2 => generated 1453 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:29.287728 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-67dc52b2-200b-443d-ae9e-ae6105390019 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:29.291437 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-67dc52b2-200b-443d-ae9e-ae6105390019 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:29.301854 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-67dc52b2-200b-443d-ae9e-ae6105390019 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:29.302320 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-67dc52b2-200b-443d-ae9e-ae6105390019 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:29.303123 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-67dc52b2-200b-443d-ae9e-ae6105390019 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:29.303571 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-67dc52b2-200b-443d-ae9e-ae6105390019 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:29.748473 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9e836153-d33b-4a10-ad99-9ee2fcb563ca tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3fd75e0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:29.858277 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9e836153-d33b-4a10-ad99-9ee2fcb563ca tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2" status: 200 len: 1453 microversion: 2.1 time: 0.114628 Jun 10 18:15:29.863809 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2402/4859] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:29 2022] GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2 => generated 1453 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:30.039678 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-67dc52b2-200b-443d-ae9e-ae6105390019 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:30.061685 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-67dc52b2-200b-443d-ae9e-ae6105390019 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:30.077623 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-67dc52b2-200b-443d-ae9e-ae6105390019 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:30.079671 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-67dc52b2-200b-443d-ae9e-ae6105390019 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1870 microversion: 2.32 time: 0.797073 Jun 10 18:15:30.102109 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2458/4860] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:29 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1870 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:15:30.288579 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-d0a75687-634a-48c9-8d07-87736bcdefe3 req-7b2ff6b2-17d6-4676-b6fc-411d65a1b279 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39300115-c0d6-485c-a610-543bdf470fae", "tag": "bb35e8a5-b2ef-4ac9-a736-ea6b3c77f079"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:15:30.312751 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-d0a75687-634a-48c9-8d07-87736bcdefe3 req-7b2ff6b2-17d6-4676-b6fc-411d65a1b279 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:30.313124 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-d0a75687-634a-48c9-8d07-87736bcdefe3 req-7b2ff6b2-17d6-4676-b6fc-411d65a1b279 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:30.351159 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-d0a75687-634a-48c9-8d07-87736bcdefe3 req-7b2ff6b2-17d6-4676-b6fc-411d65a1b279 service nova] Creating event network-changed:bb35e8a5-b2ef-4ac9-a736-ea6b3c77f079 for instance 39300115-c0d6-485c-a610-543bdf470fae on chh2-master-2 Jun 10 18:15:30.361158 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-d0a75687-634a-48c9-8d07-87736bcdefe3 req-7b2ff6b2-17d6-4676-b6fc-411d65a1b279 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075521 Jun 10 18:15:30.370429 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2403/4861] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:15:30.593357 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c4a77d17-97db-4718-860a-c161bf6fdbdc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c379ac9-637a-4642-8d39-94a97e5b6da8"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:15:30.595996 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c4a77d17-97db-4718-860a-c161bf6fdbdc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:30.613353 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c4a77d17-97db-4718-860a-c161bf6fdbdc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:30.614104 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c4a77d17-97db-4718-860a-c161bf6fdbdc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:30.620283 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c4a77d17-97db-4718-860a-c161bf6fdbdc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:30.620927 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c4a77d17-97db-4718-860a-c161bf6fdbdc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:30.873999 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a8c8974c-eeb0-47af-8a9c-0a439cf0140a tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c0377ca0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:30.967988 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a8c8974c-eeb0-47af-8a9c-0a439cf0140a tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2" status: 200 len: 1453 microversion: 2.1 time: 0.099215 Jun 10 18:15:30.969550 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2404/4862] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:30 2022] GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2 => generated 1453 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:31.098376 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f1717cd5-c82e-41b1-b267-5b34e8254c9e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:31.099094 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f1717cd5-c82e-41b1-b267-5b34e8254c9e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:31.111901 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f1717cd5-c82e-41b1-b267-5b34e8254c9e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:31.112387 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f1717cd5-c82e-41b1-b267-5b34e8254c9e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:31.113179 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f1717cd5-c82e-41b1-b267-5b34e8254c9e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:31.113649 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f1717cd5-c82e-41b1-b267-5b34e8254c9e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:31.770129 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c4a77d17-97db-4718-860a-c161bf6fdbdc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "POST /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.181978 Jun 10 18:15:31.771195 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2459/4863] 10.222.0.35 () {60 vars in 1322 bytes} [Fri Jun 10 18:15:30 2022] POST /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79/os-volume_attachments => generated 194 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:15:32.001149 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-580022c7-574c-4f83-8034-9ff4427b3da3 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3f1c1f0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:32.222551 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-580022c7-574c-4f83-8034-9ff4427b3da3 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2" status: 200 len: 1453 microversion: 2.1 time: 0.158733 Jun 10 18:15:32.222551 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2460/4864] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:31 2022] GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2 => generated 1453 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:15:32.534574 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f1717cd5-c82e-41b1-b267-5b34e8254c9e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:32.564533 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f1717cd5-c82e-41b1-b267-5b34e8254c9e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:32.580692 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f1717cd5-c82e-41b1-b267-5b34e8254c9e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:32.593108 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f1717cd5-c82e-41b1-b267-5b34e8254c9e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1870 microversion: 2.32 time: 1.498785 Jun 10 18:15:32.595032 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2405/4865] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:31 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1870 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:15:33.232824 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5d6b6bf2-b5c8-4f3d-8c7c-c22fbc34ff63 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3ed6ca0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:33.342831 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5d6b6bf2-b5c8-4f3d-8c7c-c22fbc34ff63 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2" status: 200 len: 1453 microversion: 2.1 time: 0.133753 Jun 10 18:15:33.348948 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2461/4866] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:33 2022] GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2 => generated 1453 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:33.616496 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-da3cbafc-c8ff-436d-99de-bdcdefb701d9 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:33.617150 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-da3cbafc-c8ff-436d-99de-bdcdefb701d9 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:33.632173 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-da3cbafc-c8ff-436d-99de-bdcdefb701d9 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:33.639387 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-da3cbafc-c8ff-436d-99de-bdcdefb701d9 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:33.640498 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-da3cbafc-c8ff-436d-99de-bdcdefb701d9 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:33.641034 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-da3cbafc-c8ff-436d-99de-bdcdefb701d9 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:34.359673 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-546fa5eb-61ea-40b8-a45a-865fb3d8aede tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3f1c430>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:34.481952 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-546fa5eb-61ea-40b8-a45a-865fb3d8aede tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2" status: 200 len: 1453 microversion: 2.1 time: 0.126068 Jun 10 18:15:34.484634 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2462/4867] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:34 2022] GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2 => generated 1453 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:34.750097 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-da3cbafc-c8ff-436d-99de-bdcdefb701d9 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:34.761699 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-da3cbafc-c8ff-436d-99de-bdcdefb701d9 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:34.773402 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-da3cbafc-c8ff-436d-99de-bdcdefb701d9 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:34.776721 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-da3cbafc-c8ff-436d-99de-bdcdefb701d9 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1891 microversion: 2.32 time: 1.164053 Jun 10 18:15:34.779916 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2406/4868] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:33 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1891 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:15:35.081057 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-2c2c814a-8358-4219-930a-44c577a23a72 req-c3efec01-e878-42d9-8c1b-887a347989cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39300115-c0d6-485c-a610-543bdf470fae", "tag": "aca0b4a9-2d21-42c4-a9e4-19c74885c3e4"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:15:35.111344 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-2c2c814a-8358-4219-930a-44c577a23a72 req-c3efec01-e878-42d9-8c1b-887a347989cd service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:35.118046 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-2c2c814a-8358-4219-930a-44c577a23a72 req-c3efec01-e878-42d9-8c1b-887a347989cd service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:35.169769 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-2c2c814a-8358-4219-930a-44c577a23a72 req-c3efec01-e878-42d9-8c1b-887a347989cd service nova] Creating event network-changed:aca0b4a9-2d21-42c4-a9e4-19c74885c3e4 for instance 39300115-c0d6-485c-a610-543bdf470fae on chh2-master-2 Jun 10 18:15:35.199011 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-2c2c814a-8358-4219-930a-44c577a23a72 req-c3efec01-e878-42d9-8c1b-887a347989cd service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125458 Jun 10 18:15:35.205638 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2463/4869] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:15:35.494995 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4a1d5f54-9af0-4a13-ba89-290d1a215681 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c0377ca0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:35.592147 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4a1d5f54-9af0-4a13-ba89-290d1a215681 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2" status: 200 len: 1453 microversion: 2.1 time: 0.100922 Jun 10 18:15:35.598018 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2407/4870] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:35 2022] GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2 => generated 1453 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:35.798207 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e76bc30a-4d30-451d-8f16-fb3f4f95de3b tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:35.799643 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e76bc30a-4d30-451d-8f16-fb3f4f95de3b tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:35.807273 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e76bc30a-4d30-451d-8f16-fb3f4f95de3b tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:35.808062 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e76bc30a-4d30-451d-8f16-fb3f4f95de3b tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:35.809707 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e76bc30a-4d30-451d-8f16-fb3f4f95de3b tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:35.810365 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e76bc30a-4d30-451d-8f16-fb3f4f95de3b tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:36.381729 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e76bc30a-4d30-451d-8f16-fb3f4f95de3b tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:36.391402 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e76bc30a-4d30-451d-8f16-fb3f4f95de3b tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:36.393337 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e76bc30a-4d30-451d-8f16-fb3f4f95de3b tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:36.396586 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e76bc30a-4d30-451d-8f16-fb3f4f95de3b tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1891 microversion: 2.32 time: 0.602646 Jun 10 18:15:36.397381 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2464/4871] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:35 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1891 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:15:36.609724 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-26e329ac-38bd-444e-aa16-81c79d172c28 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c0261e50>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:36.684035 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-26e329ac-38bd-444e-aa16-81c79d172c28 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2" status: 200 len: 1453 microversion: 2.1 time: 0.082039 Jun 10 18:15:36.685140 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2408/4872] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:36 2022] GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2 => generated 1453 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:37.416060 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ddc68b07-6322-4e8f-91b2-73cd0f8ffb45 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:37.421366 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ddc68b07-6322-4e8f-91b2-73cd0f8ffb45 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:37.431195 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:15:37.441751 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ddc68b07-6322-4e8f-91b2-73cd0f8ffb45 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:37.447945 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ddc68b07-6322-4e8f-91b2-73cd0f8ffb45 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:37.451593 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ddc68b07-6322-4e8f-91b2-73cd0f8ffb45 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:37.452078 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ddc68b07-6322-4e8f-91b2-73cd0f8ffb45 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:37.505696 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-fdb78fc6-b269-476a-8765-d6f465038bc4 req-55d94f35-fe6d-48c0-9d42-fbe6d0dcaa8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39300115-c0d6-485c-a610-543bdf470fae", "tag": "048d307e-e1dc-483a-9306-cdb9189fa940"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:15:37.516290 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-fdb78fc6-b269-476a-8765-d6f465038bc4 req-55d94f35-fe6d-48c0-9d42-fbe6d0dcaa8e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:37.517117 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-fdb78fc6-b269-476a-8765-d6f465038bc4 req-55d94f35-fe6d-48c0-9d42-fbe6d0dcaa8e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:37.528929 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-fdb78fc6-b269-476a-8765-d6f465038bc4 req-55d94f35-fe6d-48c0-9d42-fbe6d0dcaa8e service nova] Creating event network-changed:048d307e-e1dc-483a-9306-cdb9189fa940 for instance 39300115-c0d6-485c-a610-543bdf470fae on chh2-master-2 Jun 10 18:15:37.537390 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-fdb78fc6-b269-476a-8765-d6f465038bc4 req-55d94f35-fe6d-48c0-9d42-fbe6d0dcaa8e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036666 Jun 10 18:15:37.540528 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2409/4873] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:15:37.702850 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-021f3a07-17de-4ea5-bf28-bd6d52059726 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c0328ee0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:37.816115 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-021f3a07-17de-4ea5-bf28-bd6d52059726 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2" status: 200 len: 1453 microversion: 2.1 time: 0.121864 Jun 10 18:15:37.827354 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2410/4874] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:37 2022] GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2 => generated 1453 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:15:38.383745 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ddc68b07-6322-4e8f-91b2-73cd0f8ffb45 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:38.408160 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ddc68b07-6322-4e8f-91b2-73cd0f8ffb45 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:38.418138 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ddc68b07-6322-4e8f-91b2-73cd0f8ffb45 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:38.424501 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ddc68b07-6322-4e8f-91b2-73cd0f8ffb45 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1891 microversion: 2.32 time: 1.012107 Jun 10 18:15:38.425142 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2465/4875] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:37 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1891 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:15:38.837214 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-00dbd3e0-ebc1-4b3c-a3a4-20125768274a tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c0377af0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:38.927575 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-00dbd3e0-ebc1-4b3c-a3a4-20125768274a tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2" status: 200 len: 1453 microversion: 2.1 time: 0.094577 Jun 10 18:15:38.928889 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2411/4876] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:38 2022] GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2 => generated 1453 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:39.449153 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e639d251-eede-4e86-b0ac-fe9b0d952699 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:39.449153 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e639d251-eede-4e86-b0ac-fe9b0d952699 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:39.468835 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e639d251-eede-4e86-b0ac-fe9b0d952699 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:39.472114 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e639d251-eede-4e86-b0ac-fe9b0d952699 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:39.472114 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e639d251-eede-4e86-b0ac-fe9b0d952699 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:39.472114 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e639d251-eede-4e86-b0ac-fe9b0d952699 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:39.897117 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-9f162dae-05e0-4d7d-a648-742d6d799e9e req-e33aa82e-b70a-41e3-996b-d533a6e2caad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39300115-c0d6-485c-a610-543bdf470fae", "tag": "63a4b943-cacf-4b7e-9faa-97d4b5e9dbb6"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:15:39.921842 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-9f162dae-05e0-4d7d-a648-742d6d799e9e req-e33aa82e-b70a-41e3-996b-d533a6e2caad service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:39.926715 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-9f162dae-05e0-4d7d-a648-742d6d799e9e req-e33aa82e-b70a-41e3-996b-d533a6e2caad service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:39.954692 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-9f162dae-05e0-4d7d-a648-742d6d799e9e req-e33aa82e-b70a-41e3-996b-d533a6e2caad service nova] Creating event network-changed:63a4b943-cacf-4b7e-9faa-97d4b5e9dbb6 for instance 39300115-c0d6-485c-a610-543bdf470fae on chh2-master-2 Jun 10 18:15:39.980565 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-9f162dae-05e0-4d7d-a648-742d6d799e9e req-e33aa82e-b70a-41e3-996b-d533a6e2caad service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088849 Jun 10 18:15:39.985541 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2412/4877] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:15:39.998990 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a1462d10-d339-410d-a3a1-2f362a499d49 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c02618b0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:40.118973 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a1462d10-d339-410d-a3a1-2f362a499d49 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2" status: 200 len: 1453 microversion: 2.1 time: 0.130999 Jun 10 18:15:40.119730 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2413/4878] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:39 2022] GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2 => generated 1453 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:40.648801 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e639d251-eede-4e86-b0ac-fe9b0d952699 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:40.723914 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e639d251-eede-4e86-b0ac-fe9b0d952699 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:40.727380 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e639d251-eede-4e86-b0ac-fe9b0d952699 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:40.731012 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e639d251-eede-4e86-b0ac-fe9b0d952699 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1891 microversion: 2.32 time: 1.289757 Jun 10 18:15:40.732245 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2466/4879] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:39 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1891 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:15:41.166770 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-11e3b113-1e8c-4e8b-9cb6-8a7696db44e7 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c0328a60>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:41.257885 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-11e3b113-1e8c-4e8b-9cb6-8a7696db44e7 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2" status: 200 len: 1453 microversion: 2.1 time: 0.096676 Jun 10 18:15:41.273358 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2414/4880] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:41 2022] GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2 => generated 1453 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:41.751508 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2fbd2a5f-c2fb-4d74-a044-999c8caf9741 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:41.752295 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2fbd2a5f-c2fb-4d74-a044-999c8caf9741 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:41.766702 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2fbd2a5f-c2fb-4d74-a044-999c8caf9741 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:41.766702 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2fbd2a5f-c2fb-4d74-a044-999c8caf9741 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:41.766702 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2fbd2a5f-c2fb-4d74-a044-999c8caf9741 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:41.767197 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2fbd2a5f-c2fb-4d74-a044-999c8caf9741 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:42.039433 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-12111c5a-2b0b-4c78-bc6a-c66881f4a3a3 req-ddb54b6f-ee5d-4d70-97d8-8adbeb6ff417 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39300115-c0d6-485c-a610-543bdf470fae", "tag": "f706de66-4e9b-4a6d-9fca-27a9fc2c6121"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:15:42.062644 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-12111c5a-2b0b-4c78-bc6a-c66881f4a3a3 req-ddb54b6f-ee5d-4d70-97d8-8adbeb6ff417 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:42.063095 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-12111c5a-2b0b-4c78-bc6a-c66881f4a3a3 req-ddb54b6f-ee5d-4d70-97d8-8adbeb6ff417 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:42.110527 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-12111c5a-2b0b-4c78-bc6a-c66881f4a3a3 req-ddb54b6f-ee5d-4d70-97d8-8adbeb6ff417 service nova] Creating event network-changed:f706de66-4e9b-4a6d-9fca-27a9fc2c6121 for instance 39300115-c0d6-485c-a610-543bdf470fae on chh2-master-2 Jun 10 18:15:42.122379 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-12111c5a-2b0b-4c78-bc6a-c66881f4a3a3 req-ddb54b6f-ee5d-4d70-97d8-8adbeb6ff417 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090342 Jun 10 18:15:42.124622 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2415/4881] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:15:42.288654 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ac1d5375-c721-484a-a6ef-69fed6810550 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c0431af0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:42.388122 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ac1d5375-c721-484a-a6ef-69fed6810550 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2" status: 200 len: 1453 microversion: 2.1 time: 0.102858 Jun 10 18:15:42.404811 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2416/4882] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:42 2022] GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2 => generated 1453 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:42.656617 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2fbd2a5f-c2fb-4d74-a044-999c8caf9741 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:42.675840 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2fbd2a5f-c2fb-4d74-a044-999c8caf9741 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:42.677468 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2fbd2a5f-c2fb-4d74-a044-999c8caf9741 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:42.678688 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2fbd2a5f-c2fb-4d74-a044-999c8caf9741 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1891 microversion: 2.32 time: 0.932248 Jun 10 18:15:42.680900 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2467/4883] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:41 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1891 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:15:43.416635 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-08baae67-d9f6-4faa-976f-b4083ffca9a8 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3ff4dc0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:43.499910 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-08baae67-d9f6-4faa-976f-b4083ffca9a8 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2" status: 200 len: 1453 microversion: 2.1 time: 0.102876 Jun 10 18:15:43.501534 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2417/4884] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:43 2022] GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2 => generated 1453 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:43.698896 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3fbac3c1-4669-462c-9389-4687f517ddcb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:43.700931 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3fbac3c1-4669-462c-9389-4687f517ddcb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:43.721046 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3fbac3c1-4669-462c-9389-4687f517ddcb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:43.721512 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3fbac3c1-4669-462c-9389-4687f517ddcb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:43.722334 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3fbac3c1-4669-462c-9389-4687f517ddcb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:43.722796 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3fbac3c1-4669-462c-9389-4687f517ddcb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:44.162083 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-f8670a33-7f35-4869-87c4-0d595c4c1ea5 req-8ccb1666-8630-47b3-9ec8-396d5df15e2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39300115-c0d6-485c-a610-543bdf470fae", "tag": "622a83e2-85f5-435d-8d26-2bce252a0f1b"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:15:44.191202 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-f8670a33-7f35-4869-87c4-0d595c4c1ea5 req-8ccb1666-8630-47b3-9ec8-396d5df15e2c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:44.192077 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-f8670a33-7f35-4869-87c4-0d595c4c1ea5 req-8ccb1666-8630-47b3-9ec8-396d5df15e2c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:44.217469 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-f8670a33-7f35-4869-87c4-0d595c4c1ea5 req-8ccb1666-8630-47b3-9ec8-396d5df15e2c service nova] Creating event network-changed:622a83e2-85f5-435d-8d26-2bce252a0f1b for instance 39300115-c0d6-485c-a610-543bdf470fae on chh2-master-2 Jun 10 18:15:44.228713 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-f8670a33-7f35-4869-87c4-0d595c4c1ea5 req-8ccb1666-8630-47b3-9ec8-396d5df15e2c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070627 Jun 10 18:15:44.230138 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2418/4885] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:15:44.524564 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-17664476-9a0a-4641-9d2f-1fedd9cbc222 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3fc59d0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:44.600218 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-17664476-9a0a-4641-9d2f-1fedd9cbc222 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2" status: 200 len: 1453 microversion: 2.1 time: 0.087713 Jun 10 18:15:44.609533 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2419/4886] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:44 2022] GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2 => generated 1453 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:15:44.665105 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3fbac3c1-4669-462c-9389-4687f517ddcb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:44.677369 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3fbac3c1-4669-462c-9389-4687f517ddcb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:44.679617 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3fbac3c1-4669-462c-9389-4687f517ddcb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:44.681628 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3fbac3c1-4669-462c-9389-4687f517ddcb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1891 microversion: 2.32 time: 0.987370 Jun 10 18:15:44.685254 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2468/4887] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:43 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1891 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:15:45.636270 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8dec1cea-2431-4f5e-98b9-18f16d6c5850 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c02b6820>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:45.704028 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f08dadce-d0f7-4a9c-b1bc-8536dc3d8388 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:45.707786 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f08dadce-d0f7-4a9c-b1bc-8536dc3d8388 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:45.721842 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8dec1cea-2431-4f5e-98b9-18f16d6c5850 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2" status: 200 len: 1453 microversion: 2.1 time: 0.103727 Jun 10 18:15:45.723483 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2420/4888] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:45 2022] GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2 => generated 1453 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:45.735682 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f08dadce-d0f7-4a9c-b1bc-8536dc3d8388 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:45.737711 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f08dadce-d0f7-4a9c-b1bc-8536dc3d8388 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:45.740275 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f08dadce-d0f7-4a9c-b1bc-8536dc3d8388 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:45.742378 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f08dadce-d0f7-4a9c-b1bc-8536dc3d8388 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:46.140273 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f08dadce-d0f7-4a9c-b1bc-8536dc3d8388 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:46.153179 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f08dadce-d0f7-4a9c-b1bc-8536dc3d8388 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:46.154997 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f08dadce-d0f7-4a9c-b1bc-8536dc3d8388 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:46.158083 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f08dadce-d0f7-4a9c-b1bc-8536dc3d8388 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1891 microversion: 2.32 time: 0.459068 Jun 10 18:15:46.159205 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2469/4889] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:45 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1891 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:15:46.735564 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-20935a6e-f379-45a7-8aa1-0e2b9de35571 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3fe45e0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:46.829297 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-20935a6e-f379-45a7-8aa1-0e2b9de35571 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2" status: 200 len: 1453 microversion: 2.1 time: 0.097568 Jun 10 18:15:46.834659 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2421/4890] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:46 2022] GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2 => generated 1453 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:47.183103 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-280ff1dd-2d5a-4df0-80d5-1d34fb432f6b tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:47.185760 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-280ff1dd-2d5a-4df0-80d5-1d34fb432f6b tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:47.205418 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-280ff1dd-2d5a-4df0-80d5-1d34fb432f6b tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:47.205982 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-280ff1dd-2d5a-4df0-80d5-1d34fb432f6b tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:47.206987 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-280ff1dd-2d5a-4df0-80d5-1d34fb432f6b tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:47.207606 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-280ff1dd-2d5a-4df0-80d5-1d34fb432f6b tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:47.469721 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-280ff1dd-2d5a-4df0-80d5-1d34fb432f6b tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:47.482869 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-280ff1dd-2d5a-4df0-80d5-1d34fb432f6b tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:47.485452 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-280ff1dd-2d5a-4df0-80d5-1d34fb432f6b tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:47.486937 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-280ff1dd-2d5a-4df0-80d5-1d34fb432f6b tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1891 microversion: 2.32 time: 0.310655 Jun 10 18:15:47.487681 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2470/4891] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:47 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1891 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:15:47.844667 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9cb301cf-9e32-4080-98be-a36dd10263fd tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c0064160>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:47.899755 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9cb301cf-9e32-4080-98be-a36dd10263fd tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2" status: 200 len: 1462 microversion: 2.1 time: 0.060877 Jun 10 18:15:47.900996 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2422/4892] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:47 2022] GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2 => generated 1462 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:47.912820 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-05691d4d-2a24-4ba5-9ad0-1456a7d6f16c tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3e96af0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:47.974065 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-05691d4d-2a24-4ba5-9ad0-1456a7d6f16c tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2" status: 200 len: 1462 microversion: 2.1 time: 0.065097 Jun 10 18:15:47.989567 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2471/4893] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:47 2022] GET /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2 => generated 1462 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:48.010642 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2a92f9f1-4130-45ae-94cb-b92ffc4debf0 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:48.014536 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2a92f9f1-4130-45ae-94cb-b92ffc4debf0 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 72eaef23-30d6-4755-a9b7-9547856075b3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:48.038695 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=36 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:15:48.049352 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2a92f9f1-4130-45ae-94cb-b92ffc4debf0 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:48.049815 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2a92f9f1-4130-45ae-94cb-b92ffc4debf0 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:48.050607 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2a92f9f1-4130-45ae-94cb-b92ffc4debf0 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:48.054646 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2a92f9f1-4130-45ae-94cb-b92ffc4debf0 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:48.423651 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2a92f9f1-4130-45ae-94cb-b92ffc4debf0 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd404e4ab55af470fa464b94f9f0cd2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6575b0846dca493f9e99ee122930972d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:48.435726 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2a92f9f1-4130-45ae-94cb-b92ffc4debf0 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/servers/72eaef23-30d6-4755-a9b7-9547856075b3" status: 200 len: 1467 microversion: 2.1 time: 0.437855 Jun 10 18:15:48.436350 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2423/4894] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:15:47 2022] GET /compute/v2.1/servers/72eaef23-30d6-4755-a9b7-9547856075b3 => generated 1467 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:48.455903 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5ea727c2-e046-4985-9c96-2827262d08a5 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c093e3a0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:48.512956 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-20ec9ccd-6a9a-4292-8d1a-d8d5b138d9d9 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:48.513741 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-20ec9ccd-6a9a-4292-8d1a-d8d5b138d9d9 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:48.523908 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-20ec9ccd-6a9a-4292-8d1a-d8d5b138d9d9 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:48.526759 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-20ec9ccd-6a9a-4292-8d1a-d8d5b138d9d9 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:48.528202 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-20ec9ccd-6a9a-4292-8d1a-d8d5b138d9d9 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:48.529451 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-20ec9ccd-6a9a-4292-8d1a-d8d5b138d9d9 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:48.660946 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5ea727c2-e046-4985-9c96-2827262d08a5 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images?changes-since=2022-06-10T18%3A13%3A07Z" status: 200 len: 1901 microversion: 2.1 time: 0.211287 Jun 10 18:15:48.671777 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2472/4895] 10.222.0.35 () {58 vars in 1198 bytes} [Fri Jun 10 18:15:48 2022] GET /compute/v2.1/images?changes-since=2022-06-10T18%3A13%3A07Z => generated 1901 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:48.679438 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-665bb05f-815b-45ec-a31f-637a091e20f3 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3e96310>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:48.767769 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-665bb05f-815b-45ec-a31f-637a091e20f3 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-787855657" status: 200 len: 484 microversion: 2.1 time: 0.091105 Jun 10 18:15:48.768675 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2473/4896] 10.222.0.35 () {58 vars in 1228 bytes} [Fri Jun 10 18:15:48 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-787855657 => generated 484 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:15:48.792176 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f2c0a7e6-130c-4d06-8280-287cc6da241f tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3f8e550>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:49.022723 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f2c0a7e6-130c-4d06-8280-287cc6da241f tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images?server=72eaef23-30d6-4755-a9b7-9547856075b3" status: 200 len: 956 microversion: 2.1 time: 0.246371 Jun 10 18:15:49.024386 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2474/4897] 10.222.0.35 () {58 vars in 1208 bytes} [Fri Jun 10 18:15:48 2022] GET /compute/v2.1/images?server=72eaef23-30d6-4755-a9b7-9547856075b3 => generated 956 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:15:49.039356 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9d297783-fa3b-4f08-9718-ca19c110a501 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3ee4e50>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:49.136474 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9d297783-fa3b-4f08-9718-ca19c110a501 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.35%2Fcompute%2Fv2.1%2Fservers%2F89cea229-7bfb-43e4-a855-e9c6ae81d37b" status: 200 len: 484 microversion: 2.1 time: 0.103111 Jun 10 18:15:49.137747 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2475/4898] 10.222.0.35 () {58 vars in 1316 bytes} [Fri Jun 10 18:15:49 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.35%2Fcompute%2Fv2.1%2Fservers%2F89cea229-7bfb-43e4-a855-e9c6ae81d37b => generated 484 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:15:49.143965 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-20ec9ccd-6a9a-4292-8d1a-d8d5b138d9d9 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:49.150748 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-84aea857-3916-479f-b556-4ccd4db764fd tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3ed6e50>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:49.156746 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-20ec9ccd-6a9a-4292-8d1a-d8d5b138d9d9 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:49.159013 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-20ec9ccd-6a9a-4292-8d1a-d8d5b138d9d9 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:49.160417 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-20ec9ccd-6a9a-4292-8d1a-d8d5b138d9d9 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1891 microversion: 2.32 time: 0.657036 Jun 10 18:15:49.181383 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2424/4899] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:48 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1891 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:15:49.247218 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-84aea857-3916-479f-b556-4ccd4db764fd tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.35%2Fcompute%2Fservers%2F89cea229-7bfb-43e4-a855-e9c6ae81d37b" status: 200 len: 484 microversion: 2.1 time: 0.101693 Jun 10 18:15:49.248234 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2476/4900] 10.222.0.35 () {58 vars in 1302 bytes} [Fri Jun 10 18:15:49 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.35%2Fcompute%2Fservers%2F89cea229-7bfb-43e4-a855-e9c6ae81d37b => generated 484 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:15:49.262766 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d6b6648c-ae7e-48fc-b7ed-327960376d29 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3ff4f70>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:49.474187 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d6b6648c-ae7e-48fc-b7ed-327960376d29 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3278 microversion: 2.1 time: 0.218823 Jun 10 18:15:49.475236 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2425/4901] 10.222.0.35 () {58 vars in 1148 bytes} [Fri Jun 10 18:15:49 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3278 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:49.489863 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-37c483df-b73c-469e-b1f8-12bcb383f2ab tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3f8e550>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:49.621232 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-37c483df-b73c-469e-b1f8-12bcb383f2ab tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1428 microversion: 2.1 time: 0.136591 Jun 10 18:15:49.622240 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2477/4902] 10.222.0.35 () {58 vars in 1148 bytes} [Fri Jun 10 18:15:49 2022] GET /compute/v2.1/images?type=snapshot => generated 1428 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:49.643220 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d1fb2ad5-237c-4bd5-b304-ec0924b83122 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c040a9d0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:49.750293 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d1fb2ad5-237c-4bd5-b304-ec0924b83122 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.120559 Jun 10 18:15:49.758680 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2426/4903] 10.222.0.35 () {58 vars in 1136 bytes} [Fri Jun 10 18:15:49 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:15:49.764959 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6ec9969f-f903-44c1-b839-e50f0ef49dd7 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3e96280>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:49.981164 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6ec9969f-f903-44c1-b839-e50f0ef49dd7 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/detail?changes-since=2022-06-10T18%3A13%3A01Z" status: 200 len: 6325 microversion: 2.1 time: 0.222618 Jun 10 18:15:49.983252 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2478/4904] 10.222.0.35 () {58 vars in 1219 bytes} [Fri Jun 10 18:15:49 2022] GET /compute/v2.1/images/detail?changes-since=2022-06-10T18%3A13%3A01Z => generated 6325 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:50.001370 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1c13a989-8c64-42da-b5d3-cc3ee3d5b90e tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c0301430>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:50.067538 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1c13a989-8c64-42da-b5d3-cc3ee3d5b90e tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-787855657" status: 200 len: 664 microversion: 2.1 time: 0.070620 Jun 10 18:15:50.068670 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2427/4905] 10.222.0.35 () {58 vars in 1249 bytes} [Fri Jun 10 18:15:49 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-787855657 => generated 664 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:15:50.089314 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b3cf6be5-ce8b-4f1f-9938-bf1dcd7c9a93 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3ab6670>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:50.181495 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2691ddd6-0dd9-4653-97f1-a4cb40836987 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:50.182647 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2691ddd6-0dd9-4653-97f1-a4cb40836987 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:50.194711 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b3cf6be5-ce8b-4f1f-9938-bf1dcd7c9a93 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.35%2Fcompute%2Fv2.1%2Fservers%2F89cea229-7bfb-43e4-a855-e9c6ae81d37b" status: 200 len: 1464 microversion: 2.1 time: 0.109163 Jun 10 18:15:50.206533 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2479/4906] 10.222.0.35 () {58 vars in 1337 bytes} [Fri Jun 10 18:15:50 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.35%2Fcompute%2Fv2.1%2Fservers%2F89cea229-7bfb-43e4-a855-e9c6ae81d37b => generated 1464 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:50.208502 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2691ddd6-0dd9-4653-97f1-a4cb40836987 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:50.209140 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2691ddd6-0dd9-4653-97f1-a4cb40836987 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:50.218943 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2691ddd6-0dd9-4653-97f1-a4cb40836987 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:50.219407 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2691ddd6-0dd9-4653-97f1-a4cb40836987 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:50.223646 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-7620b5f8-5dfc-4335-ab6f-b98ddcd5fc8e req-1e9366a8-eeee-4458-9840-8c1c9e5c8d7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72eaef23-30d6-4755-a9b7-9547856075b3", "name": "network-vif-unplugged", "status": "completed", "tag": "777ebce0-6591-4ee2-b139-f87b2964f3fb"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:15:50.235023 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-7620b5f8-5dfc-4335-ab6f-b98ddcd5fc8e req-1e9366a8-eeee-4458-9840-8c1c9e5c8d7b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:50.235715 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-7620b5f8-5dfc-4335-ab6f-b98ddcd5fc8e req-1e9366a8-eeee-4458-9840-8c1c9e5c8d7b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:50.248436 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-7620b5f8-5dfc-4335-ab6f-b98ddcd5fc8e req-1e9366a8-eeee-4458-9840-8c1c9e5c8d7b service nova] Creating event network-vif-unplugged:777ebce0-6591-4ee2-b139-f87b2964f3fb for instance 72eaef23-30d6-4755-a9b7-9547856075b3 on chh2-master-2 Jun 10 18:15:50.254837 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-7620b5f8-5dfc-4335-ab6f-b98ddcd5fc8e req-1e9366a8-eeee-4458-9840-8c1c9e5c8d7b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047052 Jun 10 18:15:50.260666 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2480/4907] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:15:50.262190 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8f4e0204-72e1-4079-902e-67782328d786 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3ed6c10>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:50.335308 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8f4e0204-72e1-4079-902e-67782328d786 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.35%2Fcompute%2Fservers%2F89cea229-7bfb-43e4-a855-e9c6ae81d37b" status: 200 len: 1464 microversion: 2.1 time: 0.077310 Jun 10 18:15:50.336130 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2481/4908] 10.222.0.35 () {58 vars in 1323 bytes} [Fri Jun 10 18:15:50 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.35%2Fcompute%2Fservers%2F89cea229-7bfb-43e4-a855-e9c6ae81d37b => generated 1464 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:50.359428 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-797be10f-ee68-4f74-83c8-196ede031f6e tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3ab65e0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:50.523779 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-797be10f-ee68-4f74-83c8-196ede031f6e tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7100 microversion: 2.1 time: 0.175365 Jun 10 18:15:50.525250 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2482/4909] 10.222.0.35 () {58 vars in 1169 bytes} [Fri Jun 10 18:15:50 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7100 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:50.547526 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-dbeed4c9-5982-4883-bcab-24d3a882e063 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c093ee50>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:50.633053 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-dbeed4c9-5982-4883-bcab-24d3a882e063 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4368 microversion: 2.1 time: 0.092660 Jun 10 18:15:50.634584 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2483/4910] 10.222.0.35 () {58 vars in 1169 bytes} [Fri Jun 10 18:15:50 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:15:50.648798 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-19ed422a-88f8-4639-8bf3-77145976dfdb tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c0365ca0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:50.770814 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-19ed422a-88f8-4639-8bf3-77145976dfdb tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8" status: 200 len: 784 microversion: 2.1 time: 0.127086 Jun 10 18:15:50.774715 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2484/4911] 10.222.0.35 () {58 vars in 1232 bytes} [Fri Jun 10 18:15:50 2022] GET /compute/v2.1/images/efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8 => generated 784 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:15:50.778213 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7073a8ad-5c51-4b6d-ac29-c9399cc4ab57 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:50.782392 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7073a8ad-5c51-4b6d-ac29-c9399cc4ab57 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'df9db2e8931d4dfdbefae0cd8de8b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788bce6c44d543f899d18531b1a80ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:50.782964 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2691ddd6-0dd9-4653-97f1-a4cb40836987 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:50.784098 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7073a8ad-5c51-4b6d-ac29-c9399cc4ab57 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Searching by: {'deleted': False, 'project_id': '788bce6c44d543f899d18531b1a80ce4'} {{(pid=126594) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 18:15:50.796585 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7073a8ad-5c51-4b6d-ac29-c9399cc4ab57 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:50.797403 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7073a8ad-5c51-4b6d-ac29-c9399cc4ab57 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:50.798227 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7073a8ad-5c51-4b6d-ac29-c9399cc4ab57 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:50.798671 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7073a8ad-5c51-4b6d-ac29-c9399cc4ab57 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:50.801848 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2691ddd6-0dd9-4653-97f1-a4cb40836987 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:50.805035 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2691ddd6-0dd9-4653-97f1-a4cb40836987 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:50.811801 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2691ddd6-0dd9-4653-97f1-a4cb40836987 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1891 microversion: 2.32 time: 0.634248 Jun 10 18:15:50.829352 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2428/4912] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:50 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1891 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:15:50.836883 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-401e8521-4274-483b-a36e-65aded5f19c0 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c02f9820>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:50.866179 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.multi_cell_list [None req-7073a8ad-5c51-4b6d-ac29-c9399cc4ab57 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126594) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 10 18:15:50.901508 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-401e8521-4274-483b-a36e-65aded5f19c0 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1609 microversion: 2.1 time: 0.070557 Jun 10 18:15:50.905290 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2429/4913] 10.222.0.35 () {58 vars in 1157 bytes} [Fri Jun 10 18:15:50 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1609 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:50.922849 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-84d6693d-3198-4989-975d-38b169f6e294 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77c03288b0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:50.936652 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7073a8ad-5c51-4b6d-ac29-c9399cc4ab57 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] 10.222.0.35 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.159673 Jun 10 18:15:50.937547 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2485/4914] 10.222.0.35 () {58 vars in 1124 bytes} [Fri Jun 10 18:15:50 2022] GET /compute/v2.1/servers => generated 340 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:15:50.948868 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a06d15a9-a9fb-4547-b650-84637a2bd4eb tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:50.961852 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a06d15a9-a9fb-4547-b650-84637a2bd4eb tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'df9db2e8931d4dfdbefae0cd8de8b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788bce6c44d543f899d18531b1a80ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:50.965494 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a06d15a9-a9fb-4547-b650-84637a2bd4eb tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Searching by: {'deleted': False, 'project_id': '788bce6c44d543f899d18531b1a80ce4'} {{(pid=126594) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 18:15:50.981065 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a06d15a9-a9fb-4547-b650-84637a2bd4eb tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:50.981525 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a06d15a9-a9fb-4547-b650-84637a2bd4eb tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:50.982400 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a06d15a9-a9fb-4547-b650-84637a2bd4eb tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:50.986978 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a06d15a9-a9fb-4547-b650-84637a2bd4eb tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:51.080139 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.multi_cell_list [None req-a06d15a9-a9fb-4547-b650-84637a2bd4eb tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126594) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 10 18:15:51.167818 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:15:51.188086 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a06d15a9-a9fb-4547-b650-84637a2bd4eb tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9db2e8931d4dfdbefae0cd8de8b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788bce6c44d543f899d18531b1a80ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:51.204207 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a06d15a9-a9fb-4547-b650-84637a2bd4eb tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:51.204717 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a06d15a9-a9fb-4547-b650-84637a2bd4eb tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:51.489188 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a06d15a9-a9fb-4547-b650-84637a2bd4eb tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] 10.222.0.35 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 0.544346 Jun 10 18:15:51.491071 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2486/4915] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 18:15:50 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:51.509860 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-93ab337d-17f8-4f74-8342-e2ee78c5ca6c tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:51.521089 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-93ab337d-17f8-4f74-8342-e2ee78c5ca6c tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] 10.222.0.35 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015218 Jun 10 18:15:51.527503 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2487/4916] 10.222.0.35 () {58 vars in 1136 bytes} [Fri Jun 10 18:15:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:15:51.833229 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b03079a8-434d-448d-a70a-4a42b3639505 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:51.837100 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b03079a8-434d-448d-a70a-4a42b3639505 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:51.852102 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b03079a8-434d-448d-a70a-4a42b3639505 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:51.853695 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b03079a8-434d-448d-a70a-4a42b3639505 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:51.858055 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b03079a8-434d-448d-a70a-4a42b3639505 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:51.859131 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b03079a8-434d-448d-a70a-4a42b3639505 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:52.134054 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b03079a8-434d-448d-a70a-4a42b3639505 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:52.146293 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b03079a8-434d-448d-a70a-4a42b3639505 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:52.148035 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b03079a8-434d-448d-a70a-4a42b3639505 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:52.149488 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b03079a8-434d-448d-a70a-4a42b3639505 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1891 microversion: 2.32 time: 0.322162 Jun 10 18:15:52.150577 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2488/4917] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:51 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1891 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:15:52.169597 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-11353457-730f-4a7e-bcd1-e699c308acc0 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:52.170398 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-11353457-730f-4a7e-bcd1-e699c308acc0 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] [instance: d3621da7-8dd5-4829-b488-57c111e1d51e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:52.178460 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-11353457-730f-4a7e-bcd1-e699c308acc0 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:52.179174 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-11353457-730f-4a7e-bcd1-e699c308acc0 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:52.180189 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-11353457-730f-4a7e-bcd1-e699c308acc0 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:52.180931 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-11353457-730f-4a7e-bcd1-e699c308acc0 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:52.239119 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-11353457-730f-4a7e-bcd1-e699c308acc0 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] [instance: d3621da7-8dd5-4829-b488-57c111e1d51e] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:15:52.676068 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-11353457-730f-4a7e-bcd1-e699c308acc0 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] 10.222.0.35 "DELETE /compute/v2.1/servers/d3621da7-8dd5-4829-b488-57c111e1d51e" status: 204 len: 0 microversion: 2.1 time: 0.523776 Jun 10 18:15:52.679917 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2489/4918] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:15:52 2022] DELETE /compute/v2.1/servers/d3621da7-8dd5-4829-b488-57c111e1d51e => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:15:52.685589 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-69b0aeff-c17c-4380-89fa-0554fcc26bc1 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:52.686498 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-69b0aeff-c17c-4380-89fa-0554fcc26bc1 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] [instance: d3621da7-8dd5-4829-b488-57c111e1d51e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:52.693110 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-69b0aeff-c17c-4380-89fa-0554fcc26bc1 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:52.693774 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-69b0aeff-c17c-4380-89fa-0554fcc26bc1 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:52.694715 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-69b0aeff-c17c-4380-89fa-0554fcc26bc1 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:52.695308 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-69b0aeff-c17c-4380-89fa-0554fcc26bc1 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:52.925366 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-69b0aeff-c17c-4380-89fa-0554fcc26bc1 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9db2e8931d4dfdbefae0cd8de8b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788bce6c44d543f899d18531b1a80ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:52.934398 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-69b0aeff-c17c-4380-89fa-0554fcc26bc1 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] 10.222.0.35 "GET /compute/v2.1/servers/d3621da7-8dd5-4829-b488-57c111e1d51e" status: 200 len: 1715 microversion: 2.1 time: 0.252350 Jun 10 18:15:52.935272 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2490/4919] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:15:52 2022] GET /compute/v2.1/servers/d3621da7-8dd5-4829-b488-57c111e1d51e => generated 1715 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:53.058283 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-84d6693d-3198-4989-975d-38b169f6e294 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "DELETE /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2" status: 204 len: 0 microversion: 2.1 time: 2.140524 Jun 10 18:15:53.060381 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2430/4920] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:15:50 2022] DELETE /compute/v2.1/images/8ad14785-feb3-4551-b34b-d03702b38af2 => generated 0 bytes in 2143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:15:53.069872 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1e6242e3-a34b-4317-950d-2469cbfc05f0 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3c74dc0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:53.173379 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-207a73eb-7ba8-4092-bb9b-2d157426f5a8 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:53.174013 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-207a73eb-7ba8-4092-bb9b-2d157426f5a8 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:53.216374 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-207a73eb-7ba8-4092-bb9b-2d157426f5a8 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:53.216838 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-207a73eb-7ba8-4092-bb9b-2d157426f5a8 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:53.218740 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-207a73eb-7ba8-4092-bb9b-2d157426f5a8 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:53.221695 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-207a73eb-7ba8-4092-bb9b-2d157426f5a8 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:53.229881 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=53 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:15:53.579473 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-207a73eb-7ba8-4092-bb9b-2d157426f5a8 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:53.590244 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-207a73eb-7ba8-4092-bb9b-2d157426f5a8 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:53.591763 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-207a73eb-7ba8-4092-bb9b-2d157426f5a8 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:53.593077 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-207a73eb-7ba8-4092-bb9b-2d157426f5a8 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1891 microversion: 2.32 time: 0.428526 Jun 10 18:15:53.593640 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2431/4921] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:53 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1891 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:15:53.951927 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f4924ab2-222d-4c42-90af-c91511a332ae tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:53.952563 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f4924ab2-222d-4c42-90af-c91511a332ae tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] [instance: d3621da7-8dd5-4829-b488-57c111e1d51e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:53.960478 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f4924ab2-222d-4c42-90af-c91511a332ae tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:53.961163 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f4924ab2-222d-4c42-90af-c91511a332ae tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:53.962446 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f4924ab2-222d-4c42-90af-c91511a332ae tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:53.962959 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f4924ab2-222d-4c42-90af-c91511a332ae tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:54.353142 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f4924ab2-222d-4c42-90af-c91511a332ae tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9db2e8931d4dfdbefae0cd8de8b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788bce6c44d543f899d18531b1a80ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:54.366928 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f4924ab2-222d-4c42-90af-c91511a332ae tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] 10.222.0.35 "GET /compute/v2.1/servers/d3621da7-8dd5-4829-b488-57c111e1d51e" status: 200 len: 1715 microversion: 2.1 time: 0.419686 Jun 10 18:15:54.367886 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2432/4922] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:15:53 2022] GET /compute/v2.1/servers/d3621da7-8dd5-4829-b488-57c111e1d51e => generated 1715 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:15:54.614611 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e02c3e7b-55d1-42e2-b4e5-d035ad69ab5f tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:54.615194 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e02c3e7b-55d1-42e2-b4e5-d035ad69ab5f tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:54.623450 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e02c3e7b-55d1-42e2-b4e5-d035ad69ab5f tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:54.623916 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e02c3e7b-55d1-42e2-b4e5-d035ad69ab5f tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:54.624909 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e02c3e7b-55d1-42e2-b4e5-d035ad69ab5f tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:54.625170 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e02c3e7b-55d1-42e2-b4e5-d035ad69ab5f tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:55.002219 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1e6242e3-a34b-4317-950d-2469cbfc05f0 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "DELETE /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856" status: 204 len: 0 microversion: 2.1 time: 1.936158 Jun 10 18:15:55.003478 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2491/4923] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:15:53 2022] DELETE /compute/v2.1/images/ca23c9dc-5418-4ed4-87b4-7954d2fd4856 => generated 0 bytes in 1939 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:15:55.011458 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ab718aa4-c51d-441d-abcb-0b0c6eb91be1 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3f8ee50>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:55.065822 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e02c3e7b-55d1-42e2-b4e5-d035ad69ab5f tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:55.082124 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e02c3e7b-55d1-42e2-b4e5-d035ad69ab5f tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:55.084885 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e02c3e7b-55d1-42e2-b4e5-d035ad69ab5f tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:55.091926 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e02c3e7b-55d1-42e2-b4e5-d035ad69ab5f tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1879 microversion: 2.32 time: 0.483160 Jun 10 18:15:55.102066 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2433/4924] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:54 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1879 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:15:55.387607 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9f01fc0a-9cf7-4c6c-967b-87b8c391bb89 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:55.388322 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9f01fc0a-9cf7-4c6c-967b-87b8c391bb89 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] [instance: d3621da7-8dd5-4829-b488-57c111e1d51e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:55.400535 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f01fc0a-9cf7-4c6c-967b-87b8c391bb89 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:55.403943 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f01fc0a-9cf7-4c6c-967b-87b8c391bb89 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:55.405810 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f01fc0a-9cf7-4c6c-967b-87b8c391bb89 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:55.407598 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f01fc0a-9cf7-4c6c-967b-87b8c391bb89 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:55.589273 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9f01fc0a-9cf7-4c6c-967b-87b8c391bb89 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9db2e8931d4dfdbefae0cd8de8b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788bce6c44d543f899d18531b1a80ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:55.599629 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9f01fc0a-9cf7-4c6c-967b-87b8c391bb89 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] 10.222.0.35 "GET /compute/v2.1/servers/d3621da7-8dd5-4829-b488-57c111e1d51e" status: 200 len: 1649 microversion: 2.1 time: 0.217574 Jun 10 18:15:55.600920 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2434/4925] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:15:55 2022] GET /compute/v2.1/servers/d3621da7-8dd5-4829-b488-57c111e1d51e => generated 1649 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:56.111801 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e370df35-da3d-48d3-ae9d-0016c9d19364 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:56.112579 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e370df35-da3d-48d3-ae9d-0016c9d19364 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:56.120509 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e370df35-da3d-48d3-ae9d-0016c9d19364 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:56.121694 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e370df35-da3d-48d3-ae9d-0016c9d19364 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:56.122879 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e370df35-da3d-48d3-ae9d-0016c9d19364 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:56.123329 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e370df35-da3d-48d3-ae9d-0016c9d19364 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:56.528337 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e370df35-da3d-48d3-ae9d-0016c9d19364 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:56.567681 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e370df35-da3d-48d3-ae9d-0016c9d19364 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:56.570841 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e370df35-da3d-48d3-ae9d-0016c9d19364 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:56.573559 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e370df35-da3d-48d3-ae9d-0016c9d19364 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1879 microversion: 2.32 time: 0.466252 Jun 10 18:15:56.576336 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2435/4926] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:56 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1879 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:15:56.593676 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-28a93c9a-df9b-4c65-9c3d-90058b5a8984 req-9f4b52ed-c4a5-48c2-a8a9-c28251f85ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3621da7-8dd5-4829-b488-57c111e1d51e", "name": "network-vif-deleted", "tag": "fcf26aeb-af7b-4182-90e2-0b31e69fed36"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:15:56.625707 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-28a93c9a-df9b-4c65-9c3d-90058b5a8984 req-9f4b52ed-c4a5-48c2-a8a9-c28251f85ef5 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:56.627659 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-28a93c9a-df9b-4c65-9c3d-90058b5a8984 req-9f4b52ed-c4a5-48c2-a8a9-c28251f85ef5 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:56.674669 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-28a93c9a-df9b-4c65-9c3d-90058b5a8984 req-9f4b52ed-c4a5-48c2-a8a9-c28251f85ef5 service nova] Creating event network-vif-deleted:fcf26aeb-af7b-4182-90e2-0b31e69fed36 for instance d3621da7-8dd5-4829-b488-57c111e1d51e on chh1-master-2 Jun 10 18:15:56.717630 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-28a93c9a-df9b-4c65-9c3d-90058b5a8984 req-9f4b52ed-c4a5-48c2-a8a9-c28251f85ef5 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110253 Jun 10 18:15:56.718338 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2436/4927] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:15:56.732123 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-73c3f427-4bc9-40c1-a6e5-1521d56fc952 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:56.734560 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-73c3f427-4bc9-40c1-a6e5-1521d56fc952 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] [instance: d3621da7-8dd5-4829-b488-57c111e1d51e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:56.748545 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-73c3f427-4bc9-40c1-a6e5-1521d56fc952 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:56.750771 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-73c3f427-4bc9-40c1-a6e5-1521d56fc952 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:56.753435 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-73c3f427-4bc9-40c1-a6e5-1521d56fc952 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:56.754105 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-73c3f427-4bc9-40c1-a6e5-1521d56fc952 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:56.854479 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-73c3f427-4bc9-40c1-a6e5-1521d56fc952 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9db2e8931d4dfdbefae0cd8de8b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788bce6c44d543f899d18531b1a80ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:56.864104 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-73c3f427-4bc9-40c1-a6e5-1521d56fc952 tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] 10.222.0.35 "GET /compute/v2.1/servers/d3621da7-8dd5-4829-b488-57c111e1d51e" status: 200 len: 1363 microversion: 2.1 time: 0.144317 Jun 10 18:15:56.864938 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2437/4928] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:15:56 2022] GET /compute/v2.1/servers/d3621da7-8dd5-4829-b488-57c111e1d51e => generated 1363 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:57.164544 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ab718aa4-c51d-441d-abcb-0b0c6eb91be1 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "DELETE /compute/v2.1/images/63662839-4647-44e5-8390-303920cc5c18" status: 204 len: 0 microversion: 2.1 time: 2.156956 Jun 10 18:15:57.166618 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2492/4929] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:15:55 2022] DELETE /compute/v2.1/images/63662839-4647-44e5-8390-303920cc5c18 => generated 0 bytes in 2159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:15:57.177077 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-13d0017e-8724-41d2-b941-786a78233582 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:57.177603 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-13d0017e-8724-41d2-b941-786a78233582 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 89cea229-7bfb-43e4-a855-e9c6ae81d37b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:57.218163 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-13d0017e-8724-41d2-b941-786a78233582 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:57.218638 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-13d0017e-8724-41d2-b941-786a78233582 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:57.223653 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-13d0017e-8724-41d2-b941-786a78233582 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:57.224592 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-13d0017e-8724-41d2-b941-786a78233582 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:57.288865 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-13d0017e-8724-41d2-b941-786a78233582 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 89cea229-7bfb-43e4-a855-e9c6ae81d37b] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:15:57.595292 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d8c3e279-97d2-444f-9294-cfff292b8dfd tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:57.596012 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d8c3e279-97d2-444f-9294-cfff292b8dfd tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:57.602459 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d8c3e279-97d2-444f-9294-cfff292b8dfd tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:57.602911 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d8c3e279-97d2-444f-9294-cfff292b8dfd tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:57.603675 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d8c3e279-97d2-444f-9294-cfff292b8dfd tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:57.604115 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d8c3e279-97d2-444f-9294-cfff292b8dfd tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:57.908777 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-13d0017e-8724-41d2-b941-786a78233582 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "DELETE /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b" status: 204 len: 0 microversion: 2.1 time: 0.735526 Jun 10 18:15:57.909472 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2438/4930] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:15:57 2022] DELETE /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b => generated 0 bytes in 739 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:15:57.923370 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a6aba2aa-2ffa-4fb7-beab-f735b8a5eb44 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:15:57.925193 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a6aba2aa-2ffa-4fb7-beab-f735b8a5eb44 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:57.932192 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a6aba2aa-2ffa-4fb7-beab-f735b8a5eb44 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:57.932749 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a6aba2aa-2ffa-4fb7-beab-f735b8a5eb44 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:57.934386 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a6aba2aa-2ffa-4fb7-beab-f735b8a5eb44 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:57.934901 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a6aba2aa-2ffa-4fb7-beab-f735b8a5eb44 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:57.963184 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-a6aba2aa-2ffa-4fb7-beab-f735b8a5eb44 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lazy-loading 'flavor' on Instance uuid f0732433-a140-4237-9d7f-7dd24c7dbb79 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:15:58.046414 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d8c3e279-97d2-444f-9294-cfff292b8dfd tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:58.062213 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d8c3e279-97d2-444f-9294-cfff292b8dfd tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:58.063705 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d8c3e279-97d2-444f-9294-cfff292b8dfd tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:58.065181 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d8c3e279-97d2-444f-9294-cfff292b8dfd tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1879 microversion: 2.32 time: 0.474171 Jun 10 18:15:58.065737 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2493/4931] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:57 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1879 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:15:58.081084 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-eed33920-ee13-4e0c-82d4-6ff55d94efcd tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:58.081698 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-eed33920-ee13-4e0c-82d4-6ff55d94efcd tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] [instance: d3621da7-8dd5-4829-b488-57c111e1d51e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:58.087913 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eed33920-ee13-4e0c-82d4-6ff55d94efcd tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:58.088444 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eed33920-ee13-4e0c-82d4-6ff55d94efcd tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:58.089230 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eed33920-ee13-4e0c-82d4-6ff55d94efcd tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:58.090296 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eed33920-ee13-4e0c-82d4-6ff55d94efcd tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:58.104687 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-eed33920-ee13-4e0c-82d4-6ff55d94efcd tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] HTTP exception thrown: Instance d3621da7-8dd5-4829-b488-57c111e1d51e could not be found. Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-eed33920-ee13-4e0c-82d4-6ff55d94efcd tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Request method failure captured: Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/d3621da7-8dd5-4829-b488-57c111e1d51e HTTP/1.1 Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4oXdBDd8x-zf0CR_vaP2xRawAzzswUNUlYCI7QqUfwraoHWNBb1J23zZo20GsPUmAzmUw50XxK_xHL4nCKfbOx-1TuF5z-HC3ea_xQEf_dBxjs2AGikQy_xAhDDmQsn-bTEcyx9qdo3DWbc47Ls4zhlNA9_0okx8DFaoCSjxz_Iquw Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 788bce6c44d543f899d18531b1a80ce4 Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersTestManualDisk-834079974 Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/788bce6c44d543f899d18531b1a80ce4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/788bce6c44d543f899d18531b1a80ce4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/788bce6c44d543f899d18531b1a80ce4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_788bce6c44d543f899d18531b1a80ce4", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersTestManualDisk-834079974 Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 788bce6c44d543f899d18531b1a80ce4 Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersTestManualDisk-834079974 Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersTestManualDisk-834079974-project Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: df9db2e8931d4dfdbefae0cd8de8b81f Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersTestManualDisk-834079974-project Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: exception: Instance d3621da7-8dd5-4829-b488-57c111e1d51e could not be found. Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'd3621da7-8dd5-4829-b488-57c111e1d51e'} Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3621da7-8dd5-4829-b488-57c111e1d51e could not be found. Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3621da7-8dd5-4829-b488-57c111e1d51e could not be found. Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:15:58.106982 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:15:58.110376 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:15:58.110376 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:15:58.110376 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:15:58.110376 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:15:58.110376 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:15:58.110376 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3621da7-8dd5-4829-b488-57c111e1d51e could not be found. Jun 10 18:15:58.110376 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:15:58.110376 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-eed33920-ee13-4e0c-82d4-6ff55d94efcd tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Returning 404 to user: Instance d3621da7-8dd5-4829-b488-57c111e1d51e could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:15:58.110376 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-eed33920-ee13-4e0c-82d4-6ff55d94efcd tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] 10.222.0.35 "GET /compute/v2.1/servers/d3621da7-8dd5-4829-b488-57c111e1d51e" status: 404 len: 111 microversion: 2.1 time: 0.041723 Jun 10 18:15:58.110376 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2494/4932] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:15:58 2022] GET /compute/v2.1/servers/d3621da7-8dd5-4829-b488-57c111e1d51e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:15:58.115147 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-34957ce1-5e7c-4638-bc0f-acd4c2611059 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:58.115147 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-34957ce1-5e7c-4638-bc0f-acd4c2611059 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 89cea229-7bfb-43e4-a855-e9c6ae81d37b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:58.132977 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-34957ce1-5e7c-4638-bc0f-acd4c2611059 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:58.134007 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-34957ce1-5e7c-4638-bc0f-acd4c2611059 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:58.135033 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-34957ce1-5e7c-4638-bc0f-acd4c2611059 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:58.135710 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-34957ce1-5e7c-4638-bc0f-acd4c2611059 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:58.393099 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-34957ce1-5e7c-4638-bc0f-acd4c2611059 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd404e4ab55af470fa464b94f9f0cd2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6575b0846dca493f9e99ee122930972d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:58.401378 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-34957ce1-5e7c-4638-bc0f-acd4c2611059 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b" status: 200 len: 1473 microversion: 2.1 time: 0.291019 Jun 10 18:15:58.402898 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2495/4933] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:15:58 2022] GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b => generated 1473 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:15:58.407682 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4645660c-f397-442e-9554-7ef95c45566b tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] Calling method '.version_select at 0x7f77b3f8eca0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:58.483506 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a6aba2aa-2ffa-4fb7-beab-f735b8a5eb44 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "POST /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79/action" status: 200 len: 32 microversion: 2.1 time: 0.565499 Jun 10 18:15:58.484184 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2439/4934] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:15:57 2022] POST /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79/action => generated 32 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:15:58.493949 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a4a3453f-397a-40cf-a6a4-b065bb20ee4f tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:58.494654 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a4a3453f-397a-40cf-a6a4-b065bb20ee4f tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:58.501056 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a4a3453f-397a-40cf-a6a4-b065bb20ee4f tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:58.501507 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a4a3453f-397a-40cf-a6a4-b065bb20ee4f tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:58.502267 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a4a3453f-397a-40cf-a6a4-b065bb20ee4f tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:58.502700 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a4a3453f-397a-40cf-a6a4-b065bb20ee4f tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:58.531770 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4645660c-f397-442e-9554-7ef95c45566b tempest-ServersTestManualDisk-834079974 tempest-ServersTestManualDisk-834079974-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1160784072" status: 202 len: 0 microversion: 2.1 time: 0.127664 Jun 10 18:15:58.532607 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2496/4935] 10.222.0.35 () {58 vars in 1220 bytes} [Fri Jun 10 18:15:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1160784072 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:15:58.812988 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a4a3453f-397a-40cf-a6a4-b065bb20ee4f tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:58.822286 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a4a3453f-397a-40cf-a6a4-b065bb20ee4f tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1731 microversion: 2.1 time: 0.332331 Jun 10 18:15:58.823091 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2440/4936] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:15:58 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1731 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:15:59.085367 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-593612c0-4338-4d4e-b085-b3ec1cbf2ccb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:59.086445 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-593612c0-4338-4d4e-b085-b3ec1cbf2ccb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:59.095580 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-593612c0-4338-4d4e-b085-b3ec1cbf2ccb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:59.096479 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-593612c0-4338-4d4e-b085-b3ec1cbf2ccb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:59.097479 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-593612c0-4338-4d4e-b085-b3ec1cbf2ccb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:59.098082 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-593612c0-4338-4d4e-b085-b3ec1cbf2ccb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:59.347118 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-593612c0-4338-4d4e-b085-b3ec1cbf2ccb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:59.361108 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-593612c0-4338-4d4e-b085-b3ec1cbf2ccb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:59.362706 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-593612c0-4338-4d4e-b085-b3ec1cbf2ccb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:15:59.364051 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-593612c0-4338-4d4e-b085-b3ec1cbf2ccb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1879 microversion: 2.32 time: 0.283729 Jun 10 18:15:59.365178 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2497/4937] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:15:59 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1879 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:15:59.421475 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5b14fb21-5af0-4237-b162-42c73f76494a tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:59.422684 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5b14fb21-5af0-4237-b162-42c73f76494a tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 89cea229-7bfb-43e4-a855-e9c6ae81d37b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:59.433899 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5b14fb21-5af0-4237-b162-42c73f76494a tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:59.442364 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5b14fb21-5af0-4237-b162-42c73f76494a tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:59.443240 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5b14fb21-5af0-4237-b162-42c73f76494a tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:59.443690 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5b14fb21-5af0-4237-b162-42c73f76494a tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:59.841527 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ebe014f3-5a20-4045-8a78-23421dd82365 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:15:59.842205 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ebe014f3-5a20-4045-8a78-23421dd82365 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:15:59.851774 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ebe014f3-5a20-4045-8a78-23421dd82365 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:59.851774 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ebe014f3-5a20-4045-8a78-23421dd82365 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:59.851774 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ebe014f3-5a20-4045-8a78-23421dd82365 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:15:59.851774 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ebe014f3-5a20-4045-8a78-23421dd82365 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:15:59.994128 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ebe014f3-5a20-4045-8a78-23421dd82365 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:00.003632 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ebe014f3-5a20-4045-8a78-23421dd82365 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1731 microversion: 2.1 time: 0.166152 Jun 10 18:16:00.004446 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2498/4938] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:15:59 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:16:00.351313 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5b14fb21-5af0-4237-b162-42c73f76494a tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd404e4ab55af470fa464b94f9f0cd2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6575b0846dca493f9e99ee122930972d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:00.362571 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5b14fb21-5af0-4237-b162-42c73f76494a tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b" status: 200 len: 1473 microversion: 2.1 time: 0.947205 Jun 10 18:16:00.363174 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2441/4939] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:15:59 2022] GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b => generated 1473 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:00.383382 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5a4f9970-7877-45ab-9a1d-91b7882bf8d7 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:00.384036 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5a4f9970-7877-45ab-9a1d-91b7882bf8d7 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:00.408295 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5a4f9970-7877-45ab-9a1d-91b7882bf8d7 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:00.409356 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5a4f9970-7877-45ab-9a1d-91b7882bf8d7 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:00.412593 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5a4f9970-7877-45ab-9a1d-91b7882bf8d7 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:00.413554 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5a4f9970-7877-45ab-9a1d-91b7882bf8d7 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:00.614825 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5a4f9970-7877-45ab-9a1d-91b7882bf8d7 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:00.627155 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5a4f9970-7877-45ab-9a1d-91b7882bf8d7 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:00.628708 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5a4f9970-7877-45ab-9a1d-91b7882bf8d7 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:00.630242 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5a4f9970-7877-45ab-9a1d-91b7882bf8d7 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1879 microversion: 2.32 time: 0.251099 Jun 10 18:16:00.632098 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2499/4940] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:16:00 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1879 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:16:01.021156 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2d3e208d-d18b-46fd-994a-26b5426e59f1 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:01.023531 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2d3e208d-d18b-46fd-994a-26b5426e59f1 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:01.031543 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2d3e208d-d18b-46fd-994a-26b5426e59f1 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:01.032561 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2d3e208d-d18b-46fd-994a-26b5426e59f1 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:01.033594 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2d3e208d-d18b-46fd-994a-26b5426e59f1 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:01.034254 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2d3e208d-d18b-46fd-994a-26b5426e59f1 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:01.348842 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2d3e208d-d18b-46fd-994a-26b5426e59f1 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:01.361179 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2d3e208d-d18b-46fd-994a-26b5426e59f1 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1731 microversion: 2.1 time: 0.343898 Jun 10 18:16:01.361990 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2442/4941] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:01 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1731 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:01.379194 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ce21d03d-4afa-44f6-9883-a223b00444fa tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:01.379820 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ce21d03d-4afa-44f6-9883-a223b00444fa tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 89cea229-7bfb-43e4-a855-e9c6ae81d37b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:01.381884 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=4 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:16:01.382742 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:16:01.402869 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ce21d03d-4afa-44f6-9883-a223b00444fa tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:01.403376 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ce21d03d-4afa-44f6-9883-a223b00444fa tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:01.404969 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ce21d03d-4afa-44f6-9883-a223b00444fa tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:01.405458 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ce21d03d-4afa-44f6-9883-a223b00444fa tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:01.532131 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-9d476c09-bd86-410b-9dbe-4a31580b5924 req-633ce1d6-a11f-49aa-b26e-caba44518a55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89cea229-7bfb-43e4-a855-e9c6ae81d37b", "name": "network-vif-deleted", "tag": "6aa82b06-065f-4482-b2de-d6771acbe4bb"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:16:01.541639 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-9d476c09-bd86-410b-9dbe-4a31580b5924 req-633ce1d6-a11f-49aa-b26e-caba44518a55 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:01.542098 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-9d476c09-bd86-410b-9dbe-4a31580b5924 req-633ce1d6-a11f-49aa-b26e-caba44518a55 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:01.555959 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ce21d03d-4afa-44f6-9883-a223b00444fa tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd404e4ab55af470fa464b94f9f0cd2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6575b0846dca493f9e99ee122930972d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:01.561722 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-9d476c09-bd86-410b-9dbe-4a31580b5924 req-633ce1d6-a11f-49aa-b26e-caba44518a55 service nova] Creating event network-vif-deleted:6aa82b06-065f-4482-b2de-d6771acbe4bb for instance 89cea229-7bfb-43e4-a855-e9c6ae81d37b on chh2-master-2 Jun 10 18:16:01.567149 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ce21d03d-4afa-44f6-9883-a223b00444fa tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b" status: 200 len: 1431 microversion: 2.1 time: 0.191578 Jun 10 18:16:01.577825 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2500/4942] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:01 2022] GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b => generated 1431 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:01.578359 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-9d476c09-bd86-410b-9dbe-4a31580b5924 req-633ce1d6-a11f-49aa-b26e-caba44518a55 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040761 Jun 10 18:16:01.578359 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2443/4943] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:16:01.658768 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5669a5ac-ef1b-45b6-b9dd-4b9a0322d0e9 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:01.658768 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5669a5ac-ef1b-45b6-b9dd-4b9a0322d0e9 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:01.690056 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5669a5ac-ef1b-45b6-b9dd-4b9a0322d0e9 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:01.691880 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5669a5ac-ef1b-45b6-b9dd-4b9a0322d0e9 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:01.694811 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5669a5ac-ef1b-45b6-b9dd-4b9a0322d0e9 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:01.696017 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5669a5ac-ef1b-45b6-b9dd-4b9a0322d0e9 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:02.044908 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5669a5ac-ef1b-45b6-b9dd-4b9a0322d0e9 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:02.056762 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5669a5ac-ef1b-45b6-b9dd-4b9a0322d0e9 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:02.059019 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5669a5ac-ef1b-45b6-b9dd-4b9a0322d0e9 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:02.068076 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5669a5ac-ef1b-45b6-b9dd-4b9a0322d0e9 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1879 microversion: 2.32 time: 0.415236 Jun 10 18:16:02.068076 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2501/4944] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:16:01 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1879 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:16:02.381554 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1176bfa8-e002-4368-8e41-66f5530509e4 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:02.382971 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1176bfa8-e002-4368-8e41-66f5530509e4 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:02.401810 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1176bfa8-e002-4368-8e41-66f5530509e4 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:02.402570 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1176bfa8-e002-4368-8e41-66f5530509e4 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:02.403422 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1176bfa8-e002-4368-8e41-66f5530509e4 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:02.403873 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1176bfa8-e002-4368-8e41-66f5530509e4 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:02.587556 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-33ab1add-f5a9-4dab-aec6-bc0445b30939 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:02.588894 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-33ab1add-f5a9-4dab-aec6-bc0445b30939 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 89cea229-7bfb-43e4-a855-e9c6ae81d37b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:02.603478 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-33ab1add-f5a9-4dab-aec6-bc0445b30939 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:02.604545 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-33ab1add-f5a9-4dab-aec6-bc0445b30939 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:02.606487 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-33ab1add-f5a9-4dab-aec6-bc0445b30939 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:02.607347 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-33ab1add-f5a9-4dab-aec6-bc0445b30939 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:02.633722 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1176bfa8-e002-4368-8e41-66f5530509e4 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:02.643076 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1176bfa8-e002-4368-8e41-66f5530509e4 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1731 microversion: 2.1 time: 0.267906 Jun 10 18:16:02.653319 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-33ab1add-f5a9-4dab-aec6-bc0445b30939 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:02.653319 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-33ab1add-f5a9-4dab-aec6-bc0445b30939 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:02.653319 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-33ab1add-f5a9-4dab-aec6-bc0445b30939 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lazy-loading 'fault' on Instance uuid 89cea229-7bfb-43e4-a855-e9c6ae81d37b {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:16:02.654408 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2444/4945] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:02 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1731 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:02.761308 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-33ab1add-f5a9-4dab-aec6-bc0445b30939 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd404e4ab55af470fa464b94f9f0cd2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6575b0846dca493f9e99ee122930972d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:02.770137 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-33ab1add-f5a9-4dab-aec6-bc0445b30939 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b" status: 200 len: 1308 microversion: 2.1 time: 0.188187 Jun 10 18:16:02.771316 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2502/4946] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:02 2022] GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b => generated 1308 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:03.089940 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6b29205b-8b31-4734-a58d-8b2bc8b41dea tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:03.089940 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6b29205b-8b31-4734-a58d-8b2bc8b41dea tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:03.096870 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6b29205b-8b31-4734-a58d-8b2bc8b41dea tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:03.097333 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6b29205b-8b31-4734-a58d-8b2bc8b41dea tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:03.100615 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6b29205b-8b31-4734-a58d-8b2bc8b41dea tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:03.101110 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6b29205b-8b31-4734-a58d-8b2bc8b41dea tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:03.139965 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:16:03.441121 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6b29205b-8b31-4734-a58d-8b2bc8b41dea tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:03.464133 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6b29205b-8b31-4734-a58d-8b2bc8b41dea tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:03.472853 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6b29205b-8b31-4734-a58d-8b2bc8b41dea tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:03.475212 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6b29205b-8b31-4734-a58d-8b2bc8b41dea tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1879 microversion: 2.32 time: 0.393497 Jun 10 18:16:03.476011 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2445/4947] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:16:03 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1879 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:16:03.660506 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-32bbe229-0a68-43b3-a4b7-7c556ed9f8fa tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:03.661284 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-32bbe229-0a68-43b3-a4b7-7c556ed9f8fa tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:03.671430 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-32bbe229-0a68-43b3-a4b7-7c556ed9f8fa tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:03.674299 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-32bbe229-0a68-43b3-a4b7-7c556ed9f8fa tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:03.676190 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-32bbe229-0a68-43b3-a4b7-7c556ed9f8fa tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:03.677292 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-32bbe229-0a68-43b3-a4b7-7c556ed9f8fa tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:03.788728 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-de4c6379-d213-4526-b1fc-7484eab935c6 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:03.789351 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-de4c6379-d213-4526-b1fc-7484eab935c6 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 89cea229-7bfb-43e4-a855-e9c6ae81d37b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:03.796715 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de4c6379-d213-4526-b1fc-7484eab935c6 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:03.797662 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de4c6379-d213-4526-b1fc-7484eab935c6 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:03.798600 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de4c6379-d213-4526-b1fc-7484eab935c6 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:03.799214 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de4c6379-d213-4526-b1fc-7484eab935c6 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:03.818171 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-de4c6379-d213-4526-b1fc-7484eab935c6 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] HTTP exception thrown: Instance 89cea229-7bfb-43e4-a855-e9c6ae81d37b could not be found. Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-de4c6379-d213-4526-b1fc-7484eab935c6 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Request method failure captured: Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b HTTP/1.1 Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4msWg4KAdLs5ab6ELB3osMe80fX3GWq2sxT8vcF1PgZ5ypgDxs5pamK0Pgkv76tuvpTtcBBiG3ptWEHqaobELmQJKDqmec2rWokbMvkRGSB7cNor9hS5An2PsVCEFoaq6nHrjOattfwEtyGrXAs-cXbKEEHAGdk7qosLLvyZ10SsOA Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 6575b0846dca493f9e99ee122930972d Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ListImageFiltersTestJSON-792365018 Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/6575b0846dca493f9e99ee122930972d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/6575b0846dca493f9e99ee122930972d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/6575b0846dca493f9e99ee122930972d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_6575b0846dca493f9e99ee122930972d", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ListImageFiltersTestJSON-792365018 Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 6575b0846dca493f9e99ee122930972d Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-792365018 Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ListImageFiltersTestJSON-792365018-project Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: d404e4ab55af470fa464b94f9f0cd2bc Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ListImageFiltersTestJSON-792365018-project Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 89cea229-7bfb-43e4-a855-e9c6ae81d37b could not be found. Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '89cea229-7bfb-43e4-a855-e9c6ae81d37b'} Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89cea229-7bfb-43e4-a855-e9c6ae81d37b could not be found. Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89cea229-7bfb-43e4-a855-e9c6ae81d37b could not be found. Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:16:03.820612 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:16:03.824970 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:16:03.824970 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:16:03.824970 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:16:03.824970 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:16:03.824970 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:16:03.824970 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89cea229-7bfb-43e4-a855-e9c6ae81d37b could not be found. Jun 10 18:16:03.824970 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:16:03.825943 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-de4c6379-d213-4526-b1fc-7484eab935c6 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Returning 404 to user: Instance 89cea229-7bfb-43e4-a855-e9c6ae81d37b could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:16:03.827109 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-de4c6379-d213-4526-b1fc-7484eab935c6 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b" status: 404 len: 111 microversion: 2.1 time: 0.042893 Jun 10 18:16:03.827956 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2446/4948] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:03 2022] GET /compute/v2.1/servers/89cea229-7bfb-43e4-a855-e9c6ae81d37b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:16:03.838837 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d246aafb-a556-413e-af0f-1cf3208ab05a tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:03.839921 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d246aafb-a556-413e-af0f-1cf3208ab05a tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 72eaef23-30d6-4755-a9b7-9547856075b3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:03.847433 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d246aafb-a556-413e-af0f-1cf3208ab05a tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:03.848100 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d246aafb-a556-413e-af0f-1cf3208ab05a tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:03.849222 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d246aafb-a556-413e-af0f-1cf3208ab05a tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:03.849831 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d246aafb-a556-413e-af0f-1cf3208ab05a tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:03.887590 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d246aafb-a556-413e-af0f-1cf3208ab05a tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 72eaef23-30d6-4755-a9b7-9547856075b3] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:16:04.189488 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-32bbe229-0a68-43b3-a4b7-7c556ed9f8fa tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:04.201415 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-32bbe229-0a68-43b3-a4b7-7c556ed9f8fa tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1731 microversion: 2.1 time: 0.545001 Jun 10 18:16:04.201927 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2503/4949] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:03 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1731 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:04.317925 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d246aafb-a556-413e-af0f-1cf3208ab05a tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "DELETE /compute/v2.1/servers/72eaef23-30d6-4755-a9b7-9547856075b3" status: 204 len: 0 microversion: 2.1 time: 0.483499 Jun 10 18:16:04.318634 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2447/4950] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:16:03 2022] DELETE /compute/v2.1/servers/72eaef23-30d6-4755-a9b7-9547856075b3 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:16:04.326779 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-459c45c6-e0bb-4ecc-8d62-34de2b225c61 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:04.327407 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-459c45c6-e0bb-4ecc-8d62-34de2b225c61 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 72eaef23-30d6-4755-a9b7-9547856075b3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:04.340431 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-459c45c6-e0bb-4ecc-8d62-34de2b225c61 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:04.343249 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-459c45c6-e0bb-4ecc-8d62-34de2b225c61 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:04.343249 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-459c45c6-e0bb-4ecc-8d62-34de2b225c61 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:04.349062 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-459c45c6-e0bb-4ecc-8d62-34de2b225c61 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:04.494919 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a5987df5-a39f-4ac2-90d2-47fc81ea42f1 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:04.503326 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a5987df5-a39f-4ac2-90d2-47fc81ea42f1 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:04.510041 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a5987df5-a39f-4ac2-90d2-47fc81ea42f1 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:04.510725 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a5987df5-a39f-4ac2-90d2-47fc81ea42f1 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:04.512542 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a5987df5-a39f-4ac2-90d2-47fc81ea42f1 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:04.513139 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a5987df5-a39f-4ac2-90d2-47fc81ea42f1 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:04.632639 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-459c45c6-e0bb-4ecc-8d62-34de2b225c61 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd404e4ab55af470fa464b94f9f0cd2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6575b0846dca493f9e99ee122930972d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:04.659864 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-459c45c6-e0bb-4ecc-8d62-34de2b225c61 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/servers/72eaef23-30d6-4755-a9b7-9547856075b3" status: 200 len: 1473 microversion: 2.1 time: 0.337077 Jun 10 18:16:04.660485 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2504/4951] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:04 2022] GET /compute/v2.1/servers/72eaef23-30d6-4755-a9b7-9547856075b3 => generated 1473 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:05.047871 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a5987df5-a39f-4ac2-90d2-47fc81ea42f1 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:05.058961 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a5987df5-a39f-4ac2-90d2-47fc81ea42f1 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:05.060668 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a5987df5-a39f-4ac2-90d2-47fc81ea42f1 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:05.062111 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a5987df5-a39f-4ac2-90d2-47fc81ea42f1 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1879 microversion: 2.32 time: 0.571386 Jun 10 18:16:05.062672 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2448/4952] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:16:04 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1879 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:16:05.219121 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-87136f09-98c2-4dab-82b5-6cf2516750b1 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:05.220335 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-87136f09-98c2-4dab-82b5-6cf2516750b1 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:05.227431 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-87136f09-98c2-4dab-82b5-6cf2516750b1 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:05.227892 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-87136f09-98c2-4dab-82b5-6cf2516750b1 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:05.228881 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-87136f09-98c2-4dab-82b5-6cf2516750b1 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:05.229335 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-87136f09-98c2-4dab-82b5-6cf2516750b1 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:05.258312 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:16:05.453591 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-87136f09-98c2-4dab-82b5-6cf2516750b1 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:05.468947 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-87136f09-98c2-4dab-82b5-6cf2516750b1 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1731 microversion: 2.1 time: 0.253624 Jun 10 18:16:05.470480 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2505/4953] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:05 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1731 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:05.682856 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5736b7a4-40c0-4d55-b2ec-47295678d209 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:05.682856 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5736b7a4-40c0-4d55-b2ec-47295678d209 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 72eaef23-30d6-4755-a9b7-9547856075b3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:05.688273 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5736b7a4-40c0-4d55-b2ec-47295678d209 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:05.689006 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5736b7a4-40c0-4d55-b2ec-47295678d209 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:05.690364 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5736b7a4-40c0-4d55-b2ec-47295678d209 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:05.690809 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5736b7a4-40c0-4d55-b2ec-47295678d209 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:06.033206 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5736b7a4-40c0-4d55-b2ec-47295678d209 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd404e4ab55af470fa464b94f9f0cd2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6575b0846dca493f9e99ee122930972d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:06.041945 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5736b7a4-40c0-4d55-b2ec-47295678d209 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/servers/72eaef23-30d6-4755-a9b7-9547856075b3" status: 200 len: 1473 microversion: 2.1 time: 0.368138 Jun 10 18:16:06.049351 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2449/4954] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:05 2022] GET /compute/v2.1/servers/72eaef23-30d6-4755-a9b7-9547856075b3 => generated 1473 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:06.087628 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-dd5da674-916d-440b-ad5e-f2b32f2678b5 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:06.090485 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-dd5da674-916d-440b-ad5e-f2b32f2678b5 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:06.098339 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dd5da674-916d-440b-ad5e-f2b32f2678b5 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:06.098816 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dd5da674-916d-440b-ad5e-f2b32f2678b5 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:06.120685 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dd5da674-916d-440b-ad5e-f2b32f2678b5 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:06.120685 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dd5da674-916d-440b-ad5e-f2b32f2678b5 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:06.399809 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-dd5da674-916d-440b-ad5e-f2b32f2678b5 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:06.456116 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-dd5da674-916d-440b-ad5e-f2b32f2678b5 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:06.457927 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-dd5da674-916d-440b-ad5e-f2b32f2678b5 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:06.472711 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-dd5da674-916d-440b-ad5e-f2b32f2678b5 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1879 microversion: 2.32 time: 0.381935 Jun 10 18:16:06.472711 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2506/4955] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:16:06 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1879 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:16:06.496057 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-17ba0f86-c93c-449a-9841-691dcc9b322e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:06.496057 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-17ba0f86-c93c-449a-9841-691dcc9b322e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:06.496057 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-17ba0f86-c93c-449a-9841-691dcc9b322e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:06.496352 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-17ba0f86-c93c-449a-9841-691dcc9b322e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:06.496906 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-17ba0f86-c93c-449a-9841-691dcc9b322e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:06.498060 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-17ba0f86-c93c-449a-9841-691dcc9b322e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:06.872350 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-17ba0f86-c93c-449a-9841-691dcc9b322e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:06.886090 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-17ba0f86-c93c-449a-9841-691dcc9b322e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1731 microversion: 2.1 time: 0.400671 Jun 10 18:16:06.886845 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2450/4956] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:06 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1731 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:07.058635 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-960d56ad-8f26-4133-95d1-5b3c3ada6a5e tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:07.059524 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-960d56ad-8f26-4133-95d1-5b3c3ada6a5e tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 72eaef23-30d6-4755-a9b7-9547856075b3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:07.071284 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-960d56ad-8f26-4133-95d1-5b3c3ada6a5e tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:07.073925 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-960d56ad-8f26-4133-95d1-5b3c3ada6a5e tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:07.078500 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-960d56ad-8f26-4133-95d1-5b3c3ada6a5e tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:07.079315 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-960d56ad-8f26-4133-95d1-5b3c3ada6a5e tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:07.369090 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-960d56ad-8f26-4133-95d1-5b3c3ada6a5e tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd404e4ab55af470fa464b94f9f0cd2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6575b0846dca493f9e99ee122930972d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:07.379268 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-960d56ad-8f26-4133-95d1-5b3c3ada6a5e tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/servers/72eaef23-30d6-4755-a9b7-9547856075b3" status: 200 len: 1473 microversion: 2.1 time: 0.324567 Jun 10 18:16:07.384225 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2507/4957] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:07 2022] GET /compute/v2.1/servers/72eaef23-30d6-4755-a9b7-9547856075b3 => generated 1473 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:07.488270 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-56337ff3-a7ce-496f-965f-08e3601adc48 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:07.488986 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-56337ff3-a7ce-496f-965f-08e3601adc48 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:07.508159 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-56337ff3-a7ce-496f-965f-08e3601adc48 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:07.512509 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-56337ff3-a7ce-496f-965f-08e3601adc48 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:07.513306 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-56337ff3-a7ce-496f-965f-08e3601adc48 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:07.513765 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-56337ff3-a7ce-496f-965f-08e3601adc48 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:07.904419 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9f0212e7-d9f4-4b48-8874-7957d95f1ec7 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:07.905940 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9f0212e7-d9f4-4b48-8874-7957d95f1ec7 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:07.912525 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:16:07.914600 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9f0212e7-d9f4-4b48-8874-7957d95f1ec7 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:07.915518 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9f0212e7-d9f4-4b48-8874-7957d95f1ec7 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:07.916684 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9f0212e7-d9f4-4b48-8874-7957d95f1ec7 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:07.917324 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9f0212e7-d9f4-4b48-8874-7957d95f1ec7 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:08.090616 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-56337ff3-a7ce-496f-965f-08e3601adc48 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:08.108668 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-56337ff3-a7ce-496f-965f-08e3601adc48 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:08.110507 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-56337ff3-a7ce-496f-965f-08e3601adc48 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:08.111873 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-56337ff3-a7ce-496f-965f-08e3601adc48 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1879 microversion: 2.32 time: 0.629097 Jun 10 18:16:08.114454 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2451/4958] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:16:07 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1879 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:16:08.240158 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9f0212e7-d9f4-4b48-8874-7957d95f1ec7 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:08.253440 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9f0212e7-d9f4-4b48-8874-7957d95f1ec7 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1731 microversion: 2.1 time: 0.354076 Jun 10 18:16:08.257584 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2508/4959] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:07 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1731 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:08.403695 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e911f7fb-2ef6-4220-b6bb-50c7d52c2b58 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:08.404362 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e911f7fb-2ef6-4220-b6bb-50c7d52c2b58 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 72eaef23-30d6-4755-a9b7-9547856075b3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:08.425480 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e911f7fb-2ef6-4220-b6bb-50c7d52c2b58 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:08.425887 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e911f7fb-2ef6-4220-b6bb-50c7d52c2b58 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:08.426678 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e911f7fb-2ef6-4220-b6bb-50c7d52c2b58 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:08.427116 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e911f7fb-2ef6-4220-b6bb-50c7d52c2b58 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:08.632411 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-fec337c5-741a-412f-9def-e4499a072044 req-6edb7d60-a92f-4291-9783-9c40d7ea7175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72eaef23-30d6-4755-a9b7-9547856075b3", "name": "network-vif-deleted", "tag": "777ebce0-6591-4ee2-b139-f87b2964f3fb"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:16:08.632411 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-fec337c5-741a-412f-9def-e4499a072044 req-6edb7d60-a92f-4291-9783-9c40d7ea7175 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:08.632411 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-fec337c5-741a-412f-9def-e4499a072044 req-6edb7d60-a92f-4291-9783-9c40d7ea7175 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:08.632411 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-fec337c5-741a-412f-9def-e4499a072044 req-6edb7d60-a92f-4291-9783-9c40d7ea7175 service nova] Creating event network-vif-deleted:777ebce0-6591-4ee2-b139-f87b2964f3fb for instance 72eaef23-30d6-4755-a9b7-9547856075b3 on chh2-master-2 Jun 10 18:16:08.632411 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-fec337c5-741a-412f-9def-e4499a072044 req-6edb7d60-a92f-4291-9783-9c40d7ea7175 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045217 Jun 10 18:16:08.632411 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2509/4960] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:16:08.635882 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e911f7fb-2ef6-4220-b6bb-50c7d52c2b58 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd404e4ab55af470fa464b94f9f0cd2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6575b0846dca493f9e99ee122930972d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:08.635882 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e911f7fb-2ef6-4220-b6bb-50c7d52c2b58 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/servers/72eaef23-30d6-4755-a9b7-9547856075b3" status: 200 len: 1431 microversion: 2.1 time: 0.180031 Jun 10 18:16:08.635882 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2452/4961] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:08 2022] GET /compute/v2.1/servers/72eaef23-30d6-4755-a9b7-9547856075b3 => generated 1431 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:09.137529 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-49b39d6f-baa8-4a95-b350-278a3b41204c tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:09.138240 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-49b39d6f-baa8-4a95-b350-278a3b41204c tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:09.145223 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-49b39d6f-baa8-4a95-b350-278a3b41204c tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:09.145682 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-49b39d6f-baa8-4a95-b350-278a3b41204c tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:09.146635 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-49b39d6f-baa8-4a95-b350-278a3b41204c tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:09.147301 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-49b39d6f-baa8-4a95-b350-278a3b41204c tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:09.274359 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e3e95a54-82af-41e4-b49c-4dad8de2a381 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:09.275673 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e3e95a54-82af-41e4-b49c-4dad8de2a381 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:09.289828 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e3e95a54-82af-41e4-b49c-4dad8de2a381 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:09.290306 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e3e95a54-82af-41e4-b49c-4dad8de2a381 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:09.291117 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e3e95a54-82af-41e4-b49c-4dad8de2a381 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:09.291568 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e3e95a54-82af-41e4-b49c-4dad8de2a381 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:09.478604 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-49b39d6f-baa8-4a95-b350-278a3b41204c tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:09.494164 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-49b39d6f-baa8-4a95-b350-278a3b41204c tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:09.498799 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-49b39d6f-baa8-4a95-b350-278a3b41204c tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:09.500144 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-49b39d6f-baa8-4a95-b350-278a3b41204c tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1879 microversion: 2.32 time: 0.367033 Jun 10 18:16:09.500603 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e3e95a54-82af-41e4-b49c-4dad8de2a381 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:09.513996 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2510/4962] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:16:09 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1879 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:16:09.514433 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e3e95a54-82af-41e4-b49c-4dad8de2a381 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1731 microversion: 2.1 time: 0.245335 Jun 10 18:16:09.515050 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2453/4963] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:09 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1731 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:09.599876 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5af34ebc-5a4c-44bb-9287-e96c3a2011de tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:09.600684 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5af34ebc-5a4c-44bb-9287-e96c3a2011de tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 72eaef23-30d6-4755-a9b7-9547856075b3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:09.610477 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5af34ebc-5a4c-44bb-9287-e96c3a2011de tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:09.611447 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5af34ebc-5a4c-44bb-9287-e96c3a2011de tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:09.612561 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5af34ebc-5a4c-44bb-9287-e96c3a2011de tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:09.613204 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5af34ebc-5a4c-44bb-9287-e96c3a2011de tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:09.660183 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5af34ebc-5a4c-44bb-9287-e96c3a2011de tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:09.660955 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5af34ebc-5a4c-44bb-9287-e96c3a2011de tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:09.661615 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-5af34ebc-5a4c-44bb-9287-e96c3a2011de tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lazy-loading 'fault' on Instance uuid 72eaef23-30d6-4755-a9b7-9547856075b3 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:16:09.754082 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5af34ebc-5a4c-44bb-9287-e96c3a2011de tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd404e4ab55af470fa464b94f9f0cd2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6575b0846dca493f9e99ee122930972d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:09.765685 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5af34ebc-5a4c-44bb-9287-e96c3a2011de tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/servers/72eaef23-30d6-4755-a9b7-9547856075b3" status: 200 len: 1308 microversion: 2.1 time: 0.173983 Jun 10 18:16:09.767071 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2511/4964] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:09 2022] GET /compute/v2.1/servers/72eaef23-30d6-4755-a9b7-9547856075b3 => generated 1308 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:10.519128 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-65b73381-7edc-453c-a9bc-de4fa1c6ea52 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:10.519745 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-65b73381-7edc-453c-a9bc-de4fa1c6ea52 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:10.531378 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-65b73381-7edc-453c-a9bc-de4fa1c6ea52 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:10.532119 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-65b73381-7edc-453c-a9bc-de4fa1c6ea52 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:10.532949 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-65b73381-7edc-453c-a9bc-de4fa1c6ea52 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:10.533785 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8440a771-cb95-409e-b64f-7404d5059632 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:10.535106 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8440a771-cb95-409e-b64f-7404d5059632 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:10.537032 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-65b73381-7edc-453c-a9bc-de4fa1c6ea52 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:10.546573 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8440a771-cb95-409e-b64f-7404d5059632 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:10.547581 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8440a771-cb95-409e-b64f-7404d5059632 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:10.548728 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8440a771-cb95-409e-b64f-7404d5059632 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:10.549393 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8440a771-cb95-409e-b64f-7404d5059632 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:10.826710 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8440a771-cb95-409e-b64f-7404d5059632 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:10.835094 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8440a771-cb95-409e-b64f-7404d5059632 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1731 microversion: 2.1 time: 0.305954 Jun 10 18:16:10.845092 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2512/4965] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:10 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1731 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:10.850185 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-207f7bb8-23c3-4070-b681-02d1ae101dda tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:10.850796 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-207f7bb8-23c3-4070-b681-02d1ae101dda tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] [instance: 72eaef23-30d6-4755-a9b7-9547856075b3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:10.857304 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-207f7bb8-23c3-4070-b681-02d1ae101dda tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:10.858131 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-207f7bb8-23c3-4070-b681-02d1ae101dda tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:10.859073 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-207f7bb8-23c3-4070-b681-02d1ae101dda tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:10.859806 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-207f7bb8-23c3-4070-b681-02d1ae101dda tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-207f7bb8-23c3-4070-b681-02d1ae101dda tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] HTTP exception thrown: Instance 72eaef23-30d6-4755-a9b7-9547856075b3 could not be found. Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-207f7bb8-23c3-4070-b681-02d1ae101dda tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Request method failure captured: Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/72eaef23-30d6-4755-a9b7-9547856075b3 HTTP/1.1 Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4msWg4KAdLs5ab6ELB3osMe80fX3GWq2sxT8vcF1PgZ5ypgDxs5pamK0Pgkv76tuvpTtcBBiG3ptWEHqaobELmQJKDqmec2rWokbMvkRGSB7cNor9hS5An2PsVCEFoaq6nHrjOattfwEtyGrXAs-cXbKEEHAGdk7qosLLvyZ10SsOA Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 6575b0846dca493f9e99ee122930972d Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ListImageFiltersTestJSON-792365018 Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/6575b0846dca493f9e99ee122930972d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/6575b0846dca493f9e99ee122930972d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/6575b0846dca493f9e99ee122930972d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_6575b0846dca493f9e99ee122930972d", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ListImageFiltersTestJSON-792365018 Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 6575b0846dca493f9e99ee122930972d Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-792365018 Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ListImageFiltersTestJSON-792365018-project Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: d404e4ab55af470fa464b94f9f0cd2bc Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ListImageFiltersTestJSON-792365018-project Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 72eaef23-30d6-4755-a9b7-9547856075b3 could not be found. Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '72eaef23-30d6-4755-a9b7-9547856075b3'} Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72eaef23-30d6-4755-a9b7-9547856075b3 could not be found. Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:16:10.878864 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:16:10.882556 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72eaef23-30d6-4755-a9b7-9547856075b3 could not be found. Jun 10 18:16:10.882556 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:16:10.882556 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:16:10.882556 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:16:10.882556 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:16:10.882556 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:16:10.882556 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:16:10.882556 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:16:10.882556 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:16:10.882556 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72eaef23-30d6-4755-a9b7-9547856075b3 could not be found. Jun 10 18:16:10.882556 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:16:10.882556 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-207f7bb8-23c3-4070-b681-02d1ae101dda tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Returning 404 to user: Instance 72eaef23-30d6-4755-a9b7-9547856075b3 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:16:10.882556 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-207f7bb8-23c3-4070-b681-02d1ae101dda tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "GET /compute/v2.1/servers/72eaef23-30d6-4755-a9b7-9547856075b3" status: 404 len: 111 microversion: 2.1 time: 0.031904 Jun 10 18:16:10.882556 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2513/4966] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:10 2022] GET /compute/v2.1/servers/72eaef23-30d6-4755-a9b7-9547856075b3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:16:10.889576 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-65b73381-7edc-453c-a9bc-de4fa1c6ea52 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:10.902019 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-65b73381-7edc-453c-a9bc-de4fa1c6ea52 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:10.902468 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4e64c45f-d145-439c-b60b-748fb09a0c1a tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3f1c8b0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:10.908446 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-65b73381-7edc-453c-a9bc-de4fa1c6ea52 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:10.910676 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-65b73381-7edc-453c-a9bc-de4fa1c6ea52 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1879 microversion: 2.32 time: 0.395561 Jun 10 18:16:10.924717 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2454/4967] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:16:10 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1879 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:16:11.852786 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bca9c869-1daa-46e5-8def-34f8cc91a2c4 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:11.853487 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bca9c869-1daa-46e5-8def-34f8cc91a2c4 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:11.861522 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bca9c869-1daa-46e5-8def-34f8cc91a2c4 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:11.861987 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bca9c869-1daa-46e5-8def-34f8cc91a2c4 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:11.862763 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bca9c869-1daa-46e5-8def-34f8cc91a2c4 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:11.863368 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bca9c869-1daa-46e5-8def-34f8cc91a2c4 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:11.909956 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4e64c45f-d145-439c-b60b-748fb09a0c1a tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "DELETE /compute/v2.1/images/be6118bb-b7b8-4366-bdca-3db93ccdc708" status: 204 len: 0 microversion: 2.1 time: 1.023415 Jun 10 18:16:11.909956 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2514/4968] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:10 2022] DELETE /compute/v2.1/images/be6118bb-b7b8-4366-bdca-3db93ccdc708 => generated 0 bytes in 1025 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:16:11.919697 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-dda36277-f5ff-40ca-aac1-88b652315ef8 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b39c0430>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:12.152642 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bca9c869-1daa-46e5-8def-34f8cc91a2c4 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:12.160948 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bca9c869-1daa-46e5-8def-34f8cc91a2c4 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1731 microversion: 2.1 time: 0.312318 Jun 10 18:16:12.161541 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2455/4969] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:11 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1731 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:16:12.170604 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1dd0c949-b8db-4e77-8b44-4c0e67f89a67 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:12.171468 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1dd0c949-b8db-4e77-8b44-4c0e67f89a67 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:12.180853 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1dd0c949-b8db-4e77-8b44-4c0e67f89a67 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:12.180853 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1dd0c949-b8db-4e77-8b44-4c0e67f89a67 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:12.180853 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1dd0c949-b8db-4e77-8b44-4c0e67f89a67 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:12.182239 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1dd0c949-b8db-4e77-8b44-4c0e67f89a67 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:12.491291 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-dda36277-f5ff-40ca-aac1-88b652315ef8 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "DELETE /compute/v2.1/images/7e9a5b58-a876-4bde-88e1-dca7e152cc89" status: 204 len: 0 microversion: 2.1 time: 0.576705 Jun 10 18:16:12.491864 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2515/4970] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:11 2022] DELETE /compute/v2.1/images/7e9a5b58-a876-4bde-88e1-dca7e152cc89 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:16:12.502510 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e1537df1-df0c-4efa-8395-d986a3d42340 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] Calling method '.version_select at 0x7f77b3f8eca0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:12.506960 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1dd0c949-b8db-4e77-8b44-4c0e67f89a67 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:12.520025 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1dd0c949-b8db-4e77-8b44-4c0e67f89a67 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:12.526557 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1dd0c949-b8db-4e77-8b44-4c0e67f89a67 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:12.527747 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1dd0c949-b8db-4e77-8b44-4c0e67f89a67 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1879 microversion: 2.32 time: 0.365284 Jun 10 18:16:12.528473 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2456/4971] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:16:12 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1879 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:16:13.121253 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e1537df1-df0c-4efa-8395-d986a3d42340 tempest-ListImageFiltersTestJSON-792365018 tempest-ListImageFiltersTestJSON-792365018-project] 10.222.0.35 "DELETE /compute/v2.1/images/aee08346-4b62-4826-a43f-15229e36ace1" status: 204 len: 0 microversion: 2.1 time: 0.624211 Jun 10 18:16:13.121907 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2516/4972] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:12 2022] DELETE /compute/v2.1/images/aee08346-4b62-4826-a43f-15229e36ace1 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:16:13.178847 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-66daff27-ccbd-4122-b6d0-85423250fbcc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:13.180089 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-66daff27-ccbd-4122-b6d0-85423250fbcc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:13.193732 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-66daff27-ccbd-4122-b6d0-85423250fbcc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:13.196991 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-66daff27-ccbd-4122-b6d0-85423250fbcc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:13.202282 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-66daff27-ccbd-4122-b6d0-85423250fbcc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:13.202282 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-66daff27-ccbd-4122-b6d0-85423250fbcc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:13.440830 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-66daff27-ccbd-4122-b6d0-85423250fbcc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:13.450571 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-66daff27-ccbd-4122-b6d0-85423250fbcc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1731 microversion: 2.1 time: 0.275869 Jun 10 18:16:13.464701 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2457/4973] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:13 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1731 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:13.556612 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a31c55bd-f2c1-4ba6-b775-66647cf3a654 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:13.557337 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a31c55bd-f2c1-4ba6-b775-66647cf3a654 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:13.564529 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a31c55bd-f2c1-4ba6-b775-66647cf3a654 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:13.565325 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a31c55bd-f2c1-4ba6-b775-66647cf3a654 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:13.566414 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a31c55bd-f2c1-4ba6-b775-66647cf3a654 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:13.567123 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a31c55bd-f2c1-4ba6-b775-66647cf3a654 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:14.279203 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a31c55bd-f2c1-4ba6-b775-66647cf3a654 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:14.291261 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a31c55bd-f2c1-4ba6-b775-66647cf3a654 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:14.293906 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a31c55bd-f2c1-4ba6-b775-66647cf3a654 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:14.295288 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a31c55bd-f2c1-4ba6-b775-66647cf3a654 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1879 microversion: 2.32 time: 0.743953 Jun 10 18:16:14.296589 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2517/4974] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:16:13 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1879 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:16:14.469074 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f3435c6c-8f5e-4909-974c-29e0444fae06 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:14.473441 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f3435c6c-8f5e-4909-974c-29e0444fae06 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:14.475942 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f3435c6c-8f5e-4909-974c-29e0444fae06 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:14.476434 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f3435c6c-8f5e-4909-974c-29e0444fae06 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:14.477219 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f3435c6c-8f5e-4909-974c-29e0444fae06 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:14.477736 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f3435c6c-8f5e-4909-974c-29e0444fae06 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:14.997337 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f3435c6c-8f5e-4909-974c-29e0444fae06 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:15.016463 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f3435c6c-8f5e-4909-974c-29e0444fae06 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1731 microversion: 2.1 time: 0.552025 Jun 10 18:16:15.017856 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2458/4975] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:14 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1731 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:15.315337 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3041be52-4b33-45f4-bb2e-6a3a5bf004c5 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:15.317021 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3041be52-4b33-45f4-bb2e-6a3a5bf004c5 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:15.335471 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3041be52-4b33-45f4-bb2e-6a3a5bf004c5 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:15.336266 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3041be52-4b33-45f4-bb2e-6a3a5bf004c5 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:15.343997 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3041be52-4b33-45f4-bb2e-6a3a5bf004c5 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:15.343997 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3041be52-4b33-45f4-bb2e-6a3a5bf004c5 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:15.956767 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3041be52-4b33-45f4-bb2e-6a3a5bf004c5 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:15.966640 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3041be52-4b33-45f4-bb2e-6a3a5bf004c5 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:15.975588 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3041be52-4b33-45f4-bb2e-6a3a5bf004c5 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:15.977308 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3041be52-4b33-45f4-bb2e-6a3a5bf004c5 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1879 microversion: 2.32 time: 0.666638 Jun 10 18:16:15.978047 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2518/4976] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:16:15 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1879 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:16:16.037632 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d119f780-ba5d-4204-941c-d07f7c1b4e7e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:16.038402 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d119f780-ba5d-4204-941c-d07f7c1b4e7e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:16.052205 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d119f780-ba5d-4204-941c-d07f7c1b4e7e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:16.055022 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d119f780-ba5d-4204-941c-d07f7c1b4e7e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:16.056882 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d119f780-ba5d-4204-941c-d07f7c1b4e7e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:16.058127 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d119f780-ba5d-4204-941c-d07f7c1b4e7e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:16.389024 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d119f780-ba5d-4204-941c-d07f7c1b4e7e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:16.409826 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d119f780-ba5d-4204-941c-d07f7c1b4e7e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1731 microversion: 2.1 time: 0.372488 Jun 10 18:16:16.411274 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2459/4977] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:16 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1731 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:16.997636 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b5d37a0c-565b-445b-9e99-d5d6abead8b2 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:16.998857 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b5d37a0c-565b-445b-9e99-d5d6abead8b2 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:17.008082 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5d37a0c-565b-445b-9e99-d5d6abead8b2 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:17.013600 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5d37a0c-565b-445b-9e99-d5d6abead8b2 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:17.014732 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5d37a0c-565b-445b-9e99-d5d6abead8b2 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:17.015034 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5d37a0c-565b-445b-9e99-d5d6abead8b2 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:17.431037 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8a3695e5-4e38-4b93-9e37-9991811a6c4a tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:17.432791 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8a3695e5-4e38-4b93-9e37-9991811a6c4a tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:17.442436 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b5d37a0c-565b-445b-9e99-d5d6abead8b2 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:17.447158 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8a3695e5-4e38-4b93-9e37-9991811a6c4a tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:17.448434 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8a3695e5-4e38-4b93-9e37-9991811a6c4a tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:17.453058 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8a3695e5-4e38-4b93-9e37-9991811a6c4a tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:17.455224 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8a3695e5-4e38-4b93-9e37-9991811a6c4a tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:17.461808 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b5d37a0c-565b-445b-9e99-d5d6abead8b2 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:17.465085 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b5d37a0c-565b-445b-9e99-d5d6abead8b2 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:17.466625 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b5d37a0c-565b-445b-9e99-d5d6abead8b2 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1879 microversion: 2.32 time: 0.473567 Jun 10 18:16:17.469901 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2519/4978] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:16:16 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1879 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:16:17.765120 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8a3695e5-4e38-4b93-9e37-9991811a6c4a tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:17.785373 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8a3695e5-4e38-4b93-9e37-9991811a6c4a tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1731 microversion: 2.1 time: 0.359365 Jun 10 18:16:17.785982 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2460/4979] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:17 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1731 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:18.495286 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3280cda3-436b-4c6f-8083-80b2fa792b04 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:18.501634 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3280cda3-436b-4c6f-8083-80b2fa792b04 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:18.513742 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3280cda3-436b-4c6f-8083-80b2fa792b04 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:18.516210 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3280cda3-436b-4c6f-8083-80b2fa792b04 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:18.517233 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3280cda3-436b-4c6f-8083-80b2fa792b04 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:18.518239 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3280cda3-436b-4c6f-8083-80b2fa792b04 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:18.804633 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-45017d2b-d39e-42d4-ba0d-8eba3aa8b19c tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:18.806105 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-45017d2b-d39e-42d4-ba0d-8eba3aa8b19c tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:18.818710 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:16:18.822793 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45017d2b-d39e-42d4-ba0d-8eba3aa8b19c tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:18.830457 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45017d2b-d39e-42d4-ba0d-8eba3aa8b19c tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:18.835362 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45017d2b-d39e-42d4-ba0d-8eba3aa8b19c tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:18.836134 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45017d2b-d39e-42d4-ba0d-8eba3aa8b19c tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:18.839603 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:16:19.255565 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-45017d2b-d39e-42d4-ba0d-8eba3aa8b19c tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:19.300509 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-45017d2b-d39e-42d4-ba0d-8eba3aa8b19c tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1711 microversion: 2.1 time: 0.496457 Jun 10 18:16:19.312129 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2461/4980] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:18 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1711 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:16:19.542589 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3280cda3-436b-4c6f-8083-80b2fa792b04 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:19.558363 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3280cda3-436b-4c6f-8083-80b2fa792b04 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:19.564625 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3280cda3-436b-4c6f-8083-80b2fa792b04 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:19.567801 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3280cda3-436b-4c6f-8083-80b2fa792b04 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1879 microversion: 2.32 time: 1.084534 Jun 10 18:16:19.574577 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2520/4981] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:16:18 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1879 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:16:19.586538 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-99805bc3-b504-4c0f-88aa-1611262e8afd tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:19.587048 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-99805bc3-b504-4c0f-88aa-1611262e8afd tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:19.609078 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-99805bc3-b504-4c0f-88aa-1611262e8afd tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:19.609078 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-99805bc3-b504-4c0f-88aa-1611262e8afd tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:19.609305 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-99805bc3-b504-4c0f-88aa-1611262e8afd tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:19.609784 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-99805bc3-b504-4c0f-88aa-1611262e8afd tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:19.637388 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f4f88f68-205e-4690-acf1-3763045eabc2 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-275560618", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "e3b69e07-2f4e-447d-b1e5-3bd1ad7f0f2c"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:16:19.743485 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-f4f88f68-205e-4690-acf1-3763045eabc2 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] validate_networks() for [('e3b69e07-2f4e-447d-b1e5-3bd1ad7f0f2c', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:16:19.761893 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-99805bc3-b504-4c0f-88aa-1611262e8afd tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] HTTP exception thrown: Cannot 'detach_volume' instance f0732433-a140-4237-9d7f-7dd24c7dbb79 while it is in vm_state rescued Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-99805bc3-b504-4c0f-88aa-1611262e8afd tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Request method failure captured: Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: request: DELETE /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79/os-volume_attachments/3c379ac9-637a-4642-8d39-94a97e5b6da8 HTTP/1.1 Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4mJVVxHNAdkChvziQm-6Dxnwt9XHWD1Xe5b1Hij0GEvfTbtqXkBFxRnvK3XB7O0DqEYSiSFM3wVQFcGEtNf0ziHJxG92MJ3ikztDB6TtOzEB2x0AYpNNaCzzkfUNZyHohCw21rjVL9kE9UGR_qvtvfAasaLdvNaa6Nct_8khdQAOeU Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 2f3f65ee123043bb9c888cc5adffce37 Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-779166786 Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/2f3f65ee123043bb9c888cc5adffce37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2f3f65ee123043bb9c888cc5adffce37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2f3f65ee123043bb9c888cc5adffce37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_2f3f65ee123043bb9c888cc5adffce37", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServerRescueNegativeTestJSON-779166786 Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 2f3f65ee123043bb9c888cc5adffce37 Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-779166786 Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServerRescueNegativeTestJSON-779166786-project Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 6aa40a915e4e43cd8d493dc593a73028 Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServerRescueNegativeTestJSON-779166786-project Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: exception: Cannot 'detach_volume' instance f0732433-a140-4237-9d7f-7dd24c7dbb79 while it is in vm_state rescued Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: action_args: {'server_id': 'f0732433-a140-4237-9d7f-7dd24c7dbb79', 'id': '3c379ac9-637a-4642-8d39-94a97e5b6da8'} Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f0732433-a140-4237-9d7f-7dd24c7dbb79 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f0732433-a140-4237-9d7f-7dd24c7dbb79 while it is in vm_state rescued Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:16:19.764528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:16:19.768542 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:16:19.768542 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:16:19.768542 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:16:19.768542 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:16:19.768542 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f0732433-a140-4237-9d7f-7dd24c7dbb79 while it is in vm_state rescued Jun 10 18:16:19.768542 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:16:19.770763 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-99805bc3-b504-4c0f-88aa-1611262e8afd tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Returning 409 to user: Cannot 'detach_volume' instance f0732433-a140-4237-9d7f-7dd24c7dbb79 while it is in vm_state rescued {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:16:19.777865 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-99805bc3-b504-4c0f-88aa-1611262e8afd tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "DELETE /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79/os-volume_attachments/3c379ac9-637a-4642-8d39-94a97e5b6da8" status: 409 len: 152 microversion: 2.1 time: 0.196579 Jun 10 18:16:19.778796 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2521/4982] 10.222.0.35 () {58 vars in 1415 bytes} [Fri Jun 10 18:16:19 2022] DELETE /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79/os-volume_attachments/3c379ac9-637a-4642-8d39-94a97e5b6da8 => generated 152 bytes in 204 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:16:19.793372 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d268f7c5-1baa-420a-8a1b-690596329670 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:16:19.795200 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d268f7c5-1baa-420a-8a1b-690596329670 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:19.812845 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d268f7c5-1baa-420a-8a1b-690596329670 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:19.813316 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d268f7c5-1baa-420a-8a1b-690596329670 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:19.814540 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d268f7c5-1baa-420a-8a1b-690596329670 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:19.814992 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d268f7c5-1baa-420a-8a1b-690596329670 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:20.170498 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d268f7c5-1baa-420a-8a1b-690596329670 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "POST /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79/action" status: 202 len: 0 microversion: 2.1 time: 0.385769 Jun 10 18:16:20.171235 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2522/4983] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:16:19 2022] POST /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 18:16:20.181481 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d48a1b4d-a867-4d7f-b50e-da93f8dbde19 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:20.183160 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d48a1b4d-a867-4d7f-b50e-da93f8dbde19 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:20.211320 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d48a1b4d-a867-4d7f-b50e-da93f8dbde19 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:20.213042 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d48a1b4d-a867-4d7f-b50e-da93f8dbde19 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:20.214200 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d48a1b4d-a867-4d7f-b50e-da93f8dbde19 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:20.216752 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d48a1b4d-a867-4d7f-b50e-da93f8dbde19 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:20.736555 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d48a1b4d-a867-4d7f-b50e-da93f8dbde19 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:20.767631 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d48a1b4d-a867-4d7f-b50e-da93f8dbde19 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1719 microversion: 2.1 time: 0.591114 Jun 10 18:16:20.784851 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2523/4984] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:20 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1719 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:20.913335 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b9eb06ee-f9a8-46f8-b4f7-d7f580e2c06d tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1392526321", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:16:21.023266 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-b9eb06ee-f9a8-46f8-b4f7-d7f580e2c06d tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] validate_networks() for [('072cec36-1536-487b-9c37-7b529a5b95f4', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:16:21.028102 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-f4f88f68-205e-4690-acf1-3763045eabc2 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:16:21.029195 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-f4f88f68-205e-4690-acf1-3763045eabc2 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:16:21.029852 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-f4f88f68-205e-4690-acf1-3763045eabc2 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:16:21.035233 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-f4f88f68-205e-4690-acf1-3763045eabc2 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:16:21.035233 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-f4f88f68-205e-4690-acf1-3763045eabc2 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:16:21.050360 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f4f88f68-205e-4690-acf1-3763045eabc2 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:21.051064 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f4f88f68-205e-4690-acf1-3763045eabc2 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:21.058050 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f4f88f68-205e-4690-acf1-3763045eabc2 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:21.058050 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f4f88f68-205e-4690-acf1-3763045eabc2 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:21.082202 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-f4f88f68-205e-4690-acf1-3763045eabc2 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Getting quotas for project 521cf003cd094fc694df09a09a245873. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:16:21.089471 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-f4f88f68-205e-4690-acf1-3763045eabc2 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Getting quotas for user 5525621bc3c24269a872f95acf423ac3 and project 521cf003cd094fc694df09a09a245873. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:16:21.103340 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f4f88f68-205e-4690-acf1-3763045eabc2 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Going to run 2 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:16:21.105901 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f4f88f68-205e-4690-acf1-3763045eabc2 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: bc902e78-98fd-4c7b-8ff9-86d75c4bfaba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:16:21.249582 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f4f88f68-205e-4690-acf1-3763045eabc2 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: 140792ef-79c8-4a4d-b268-324caa480a9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=bc902e78-98fd-4c7b-8ff9-86d75c4bfaba,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:16:21.483777 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f4f88f68-205e-4690-acf1-3763045eabc2 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.165390 Jun 10 18:16:21.485302 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2462/4985] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:16:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2172 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:16:21.496040 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-16140172-6653-4a3f-a3ff-3b5ddee714b2 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:21.502300 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-16140172-6653-4a3f-a3ff-3b5ddee714b2 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:21.515802 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-16140172-6653-4a3f-a3ff-3b5ddee714b2 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:21.517458 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-16140172-6653-4a3f-a3ff-3b5ddee714b2 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:21.519219 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-16140172-6653-4a3f-a3ff-3b5ddee714b2 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:21.522060 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-16140172-6653-4a3f-a3ff-3b5ddee714b2 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:21.908934 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-b9eb06ee-f9a8-46f8-b4f7-d7f580e2c06d tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:16:21.909489 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-b9eb06ee-f9a8-46f8-b4f7-d7f580e2c06d tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:16:21.910009 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-b9eb06ee-f9a8-46f8-b4f7-d7f580e2c06d tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:16:21.911154 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-b9eb06ee-f9a8-46f8-b4f7-d7f580e2c06d tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:16:21.911653 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-b9eb06ee-f9a8-46f8-b4f7-d7f580e2c06d tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:16:21.924051 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9eb06ee-f9a8-46f8-b4f7-d7f580e2c06d tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:21.924772 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9eb06ee-f9a8-46f8-b4f7-d7f580e2c06d tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:21.925815 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9eb06ee-f9a8-46f8-b4f7-d7f580e2c06d tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:21.926285 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-16140172-6653-4a3f-a3ff-3b5ddee714b2 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:21.926771 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9eb06ee-f9a8-46f8-b4f7-d7f580e2c06d tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:21.937958 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-16140172-6653-4a3f-a3ff-3b5ddee714b2 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:21.940256 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-16140172-6653-4a3f-a3ff-3b5ddee714b2 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:21.941565 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-16140172-6653-4a3f-a3ff-3b5ddee714b2 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1879 microversion: 2.32 time: 0.455070 Jun 10 18:16:21.943060 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2463/4986] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:16:21 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1879 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:16:21.952976 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-b9eb06ee-f9a8-46f8-b4f7-d7f580e2c06d tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Getting quotas for project 38108fc8596d4cb7912297aaea361563. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:16:21.957023 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-64c69ef0-ff45-4611-a221-498d1463f294 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:21.963870 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-64c69ef0-ff45-4611-a221-498d1463f294 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5525621bc3c24269a872f95acf423ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cf003cd094fc694df09a09a245873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:21.965079 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-64c69ef0-ff45-4611-a221-498d1463f294 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Searching by: {'deleted': False, 'project_id': '521cf003cd094fc694df09a09a245873'} {{(pid=126595) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 18:16:21.965941 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-b9eb06ee-f9a8-46f8-b4f7-d7f580e2c06d tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Getting quotas for user 7508153af7c5491ab75d41dde00498e5 and project 38108fc8596d4cb7912297aaea361563. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:16:21.990674 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-64c69ef0-ff45-4611-a221-498d1463f294 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:21.991600 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-64c69ef0-ff45-4611-a221-498d1463f294 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:21.993119 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-64c69ef0-ff45-4611-a221-498d1463f294 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:21.994278 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-64c69ef0-ff45-4611-a221-498d1463f294 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:21.999574 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b9eb06ee-f9a8-46f8-b4f7-d7f580e2c06d tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:16:22.006353 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b9eb06ee-f9a8-46f8-b4f7-d7f580e2c06d tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:16:22.050440 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-64c69ef0-ff45-4611-a221-498d1463f294 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.106065 Jun 10 18:16:22.052327 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2464/4987] 10.222.0.35 () {58 vars in 1124 bytes} [Fri Jun 10 18:16:21 2022] GET /compute/v2.1/servers => generated 675 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:16:22.060272 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-56d37403-6880-41a4-833b-77d93f825cea tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:22.060948 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-56d37403-6880-41a4-833b-77d93f825cea tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:22.070161 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-56d37403-6880-41a4-833b-77d93f825cea tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:22.070562 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-56d37403-6880-41a4-833b-77d93f825cea tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:22.071349 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-56d37403-6880-41a4-833b-77d93f825cea tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:22.071839 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-56d37403-6880-41a4-833b-77d93f825cea tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:22.240817 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b9eb06ee-f9a8-46f8-b4f7-d7f580e2c06d tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.462134 Jun 10 18:16:22.247333 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2524/4988] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:16:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 1472 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:16:22.261053 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-6a5f5385-aca9-4d89-b730-63b52abe25e3 req-98d1acbc-693f-4d5a-ad4e-8dadb9717301 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39300115-c0d6-485c-a610-543bdf470fae", "name": "network-vif-plugged", "status": "completed", "tag": "90ddcb49-417f-4027-b8fd-8e4f78ccc8ba"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:16:22.292252 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-6a5f5385-aca9-4d89-b730-63b52abe25e3 req-98d1acbc-693f-4d5a-ad4e-8dadb9717301 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:22.293741 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-6a5f5385-aca9-4d89-b730-63b52abe25e3 req-98d1acbc-693f-4d5a-ad4e-8dadb9717301 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:22.320461 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-6a5f5385-aca9-4d89-b730-63b52abe25e3 req-98d1acbc-693f-4d5a-ad4e-8dadb9717301 service nova] Creating event network-vif-plugged:90ddcb49-417f-4027-b8fd-8e4f78ccc8ba for instance 39300115-c0d6-485c-a610-543bdf470fae on chh2-master-2 Jun 10 18:16:22.334963 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-6a5f5385-aca9-4d89-b730-63b52abe25e3 req-98d1acbc-693f-4d5a-ad4e-8dadb9717301 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086212 Jun 10 18:16:22.340878 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2525/4989] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:16:22.367832 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-45e9acda-3308-4af2-b87d-b175d2ca642a tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:22.368617 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-45e9acda-3308-4af2-b87d-b175d2ca642a tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: 140792ef-79c8-4a4d-b268-324caa480a9b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:22.461022 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-56d37403-6880-41a4-833b-77d93f825cea tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:22.475565 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-56d37403-6880-41a4-833b-77d93f825cea tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1719 microversion: 2.1 time: 0.421995 Jun 10 18:16:22.481625 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2465/4990] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:22 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1719 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:22.490673 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e3996e6f-56de-476a-8b80-f7bb1298d07a tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:22.494149 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e3996e6f-56de-476a-8b80-f7bb1298d07a tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:22.499432 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-45e9acda-3308-4af2-b87d-b175d2ca642a tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525621bc3c24269a872f95acf423ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cf003cd094fc694df09a09a245873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:22.538730 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-45e9acda-3308-4af2-b87d-b175d2ca642a tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers/140792ef-79c8-4a4d-b268-324caa480a9b" status: 200 len: 1219 microversion: 2.1 time: 0.183400 Jun 10 18:16:22.539839 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2526/4991] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:22 2022] GET /compute/v2.1/servers/140792ef-79c8-4a4d-b268-324caa480a9b => generated 1219 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:22.641293 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e3996e6f-56de-476a-8b80-f7bb1298d07a tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:22.652536 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e3996e6f-56de-476a-8b80-f7bb1298d07a tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1223 microversion: 2.1 time: 0.167316 Jun 10 18:16:22.654059 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2466/4992] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:22 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1223 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:22.961368 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4981cfe5-14fa-436a-a218-e73cfb5551cd tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:22.963853 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4981cfe5-14fa-436a-a218-e73cfb5551cd tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:22.972548 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4981cfe5-14fa-436a-a218-e73cfb5551cd tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:22.973324 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4981cfe5-14fa-436a-a218-e73cfb5551cd tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:22.974316 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4981cfe5-14fa-436a-a218-e73cfb5551cd tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:22.974967 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4981cfe5-14fa-436a-a218-e73cfb5551cd tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:22.980229 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:16:23.328604 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4981cfe5-14fa-436a-a218-e73cfb5551cd tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:23.342099 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4981cfe5-14fa-436a-a218-e73cfb5551cd tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:23.344215 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4981cfe5-14fa-436a-a218-e73cfb5551cd tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:23.345879 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4981cfe5-14fa-436a-a218-e73cfb5551cd tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1879 microversion: 2.32 time: 0.388650 Jun 10 18:16:23.346798 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2527/4993] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:16:22 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1879 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:16:23.498202 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-71e60196-00b6-4df0-bc74-2d1814e883bc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:23.498960 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-71e60196-00b6-4df0-bc74-2d1814e883bc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:23.509288 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-71e60196-00b6-4df0-bc74-2d1814e883bc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:23.509288 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-71e60196-00b6-4df0-bc74-2d1814e883bc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:23.509879 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-71e60196-00b6-4df0-bc74-2d1814e883bc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:23.510864 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-71e60196-00b6-4df0-bc74-2d1814e883bc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:23.558137 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0f40731a-a816-4c24-9cf3-37919b0210ef tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:23.559011 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0f40731a-a816-4c24-9cf3-37919b0210ef tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: 140792ef-79c8-4a4d-b268-324caa480a9b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:23.664468 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0f40731a-a816-4c24-9cf3-37919b0210ef tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525621bc3c24269a872f95acf423ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cf003cd094fc694df09a09a245873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:23.677344 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0f40731a-a816-4c24-9cf3-37919b0210ef tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers/140792ef-79c8-4a4d-b268-324caa480a9b" status: 200 len: 1219 microversion: 2.1 time: 0.123435 Jun 10 18:16:23.678582 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2528/4994] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:23 2022] GET /compute/v2.1/servers/140792ef-79c8-4a4d-b268-324caa480a9b => generated 1219 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:23.686205 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8f32b42d-ab92-481f-888d-44ba0415e021 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:23.687259 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8f32b42d-ab92-481f-888d-44ba0415e021 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:23.772334 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8f32b42d-ab92-481f-888d-44ba0415e021 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:23.796242 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8f32b42d-ab92-481f-888d-44ba0415e021 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1223 microversion: 2.1 time: 0.116315 Jun 10 18:16:23.798562 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2529/4995] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:23 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1223 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:23.912884 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-71e60196-00b6-4df0-bc74-2d1814e883bc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:23.949851 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-71e60196-00b6-4df0-bc74-2d1814e883bc tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1719 microversion: 2.1 time: 0.455466 Jun 10 18:16:23.951371 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2467/4996] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:23 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1719 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:24.365661 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a5a4e85d-d2a1-43b3-abe6-e40b297f34b6 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:24.366298 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a5a4e85d-d2a1-43b3-abe6-e40b297f34b6 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:24.377732 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a5a4e85d-d2a1-43b3-abe6-e40b297f34b6 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:24.379826 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-ac77791e-1601-4ec8-881c-125a260dec8b req-b77ead1f-be31-4f3d-8eac-6d57e86c2f54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39300115-c0d6-485c-a610-543bdf470fae", "name": "network-vif-plugged", "status": "completed", "tag": "bb35e8a5-b2ef-4ac9-a736-ea6b3c77f079"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:16:24.395515 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-ac77791e-1601-4ec8-881c-125a260dec8b req-b77ead1f-be31-4f3d-8eac-6d57e86c2f54 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:24.396421 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-ac77791e-1601-4ec8-881c-125a260dec8b req-b77ead1f-be31-4f3d-8eac-6d57e86c2f54 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:24.398500 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a5a4e85d-d2a1-43b3-abe6-e40b297f34b6 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:24.399061 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a5a4e85d-d2a1-43b3-abe6-e40b297f34b6 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:24.399522 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a5a4e85d-d2a1-43b3-abe6-e40b297f34b6 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:24.415438 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-ac77791e-1601-4ec8-881c-125a260dec8b req-b77ead1f-be31-4f3d-8eac-6d57e86c2f54 service nova] Creating event network-vif-plugged:bb35e8a5-b2ef-4ac9-a736-ea6b3c77f079 for instance 39300115-c0d6-485c-a610-543bdf470fae on chh2-master-2 Jun 10 18:16:24.423206 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-ac77791e-1601-4ec8-881c-125a260dec8b req-b77ead1f-be31-4f3d-8eac-6d57e86c2f54 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047701 Jun 10 18:16:24.424544 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2468/4997] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:16:24.698857 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7918ae70-0a29-49fc-85b2-16cd0c1faaec tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:24.699626 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7918ae70-0a29-49fc-85b2-16cd0c1faaec tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: 140792ef-79c8-4a4d-b268-324caa480a9b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:24.717404 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7918ae70-0a29-49fc-85b2-16cd0c1faaec tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:24.718394 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7918ae70-0a29-49fc-85b2-16cd0c1faaec tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:24.722222 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7918ae70-0a29-49fc-85b2-16cd0c1faaec tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:24.722222 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7918ae70-0a29-49fc-85b2-16cd0c1faaec tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:24.842398 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7918ae70-0a29-49fc-85b2-16cd0c1faaec tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525621bc3c24269a872f95acf423ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cf003cd094fc694df09a09a245873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:24.856121 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7918ae70-0a29-49fc-85b2-16cd0c1faaec tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers/140792ef-79c8-4a4d-b268-324caa480a9b" status: 200 len: 1223 microversion: 2.1 time: 0.161691 Jun 10 18:16:24.873194 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a5a4e85d-d2a1-43b3-abe6-e40b297f34b6 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:24.877647 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2469/4998] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:24 2022] GET /compute/v2.1/servers/140792ef-79c8-4a4d-b268-324caa480a9b => generated 1223 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:24.883017 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a5a4e85d-d2a1-43b3-abe6-e40b297f34b6 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:24.884595 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a5a4e85d-d2a1-43b3-abe6-e40b297f34b6 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:24.887351 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a5a4e85d-d2a1-43b3-abe6-e40b297f34b6 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1879 microversion: 2.32 time: 0.526786 Jun 10 18:16:24.888439 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2530/4999] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:16:24 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1879 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:16:24.889630 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5ef5da96-14ca-4ff5-bf69-7caceadb319a tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:24.890420 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5ef5da96-14ca-4ff5-bf69-7caceadb319a tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:24.897141 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ef5da96-14ca-4ff5-bf69-7caceadb319a tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:24.899821 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ef5da96-14ca-4ff5-bf69-7caceadb319a tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:24.901369 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ef5da96-14ca-4ff5-bf69-7caceadb319a tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:24.902537 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ef5da96-14ca-4ff5-bf69-7caceadb319a tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:24.968615 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c3d25cb7-a72f-4d1e-bfec-6860a497ad25 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:24.969481 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c3d25cb7-a72f-4d1e-bfec-6860a497ad25 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:24.976534 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c3d25cb7-a72f-4d1e-bfec-6860a497ad25 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:24.977972 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c3d25cb7-a72f-4d1e-bfec-6860a497ad25 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:24.984802 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c3d25cb7-a72f-4d1e-bfec-6860a497ad25 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:24.984802 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c3d25cb7-a72f-4d1e-bfec-6860a497ad25 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:24.986532 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5ef5da96-14ca-4ff5-bf69-7caceadb319a tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:24.997821 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5ef5da96-14ca-4ff5-bf69-7caceadb319a tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1227 microversion: 2.1 time: 0.118510 Jun 10 18:16:25.007695 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2470/5000] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:24 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1227 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:25.287291 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c3d25cb7-a72f-4d1e-bfec-6860a497ad25 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:25.295537 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c3d25cb7-a72f-4d1e-bfec-6860a497ad25 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1725 microversion: 2.1 time: 0.331038 Jun 10 18:16:25.317766 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2531/5001] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:24 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1725 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:16:25.329956 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3333b060-81e6-4d81-83d8-b3907ff67ba9 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:25.330530 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3333b060-81e6-4d81-83d8-b3907ff67ba9 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:25.338389 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3333b060-81e6-4d81-83d8-b3907ff67ba9 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:25.338773 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3333b060-81e6-4d81-83d8-b3907ff67ba9 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:25.339797 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3333b060-81e6-4d81-83d8-b3907ff67ba9 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:25.340375 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3333b060-81e6-4d81-83d8-b3907ff67ba9 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:25.575869 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3333b060-81e6-4d81-83d8-b3907ff67ba9 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.250837 Jun 10 18:16:25.584910 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2471/5002] 10.222.0.35 () {58 vars in 1274 bytes} [Fri Jun 10 18:16:25 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79/os-interface => generated 284 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:16:25.874697 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d50b585c-ff5f-4f85-b7d3-1e1d9471b3e2 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:25.875319 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d50b585c-ff5f-4f85-b7d3-1e1d9471b3e2 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: 140792ef-79c8-4a4d-b268-324caa480a9b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:25.883236 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d50b585c-ff5f-4f85-b7d3-1e1d9471b3e2 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:25.883992 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d50b585c-ff5f-4f85-b7d3-1e1d9471b3e2 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:25.885400 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d50b585c-ff5f-4f85-b7d3-1e1d9471b3e2 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:25.886057 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d50b585c-ff5f-4f85-b7d3-1e1d9471b3e2 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:25.909369 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d7b60934-d3ff-4b13-90ab-82762d95e246 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:25.909971 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d7b60934-d3ff-4b13-90ab-82762d95e246 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:25.929511 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d7b60934-d3ff-4b13-90ab-82762d95e246 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:25.930295 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d7b60934-d3ff-4b13-90ab-82762d95e246 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:25.932444 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d7b60934-d3ff-4b13-90ab-82762d95e246 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:25.933407 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d7b60934-d3ff-4b13-90ab-82762d95e246 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:26.101817 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d50b585c-ff5f-4f85-b7d3-1e1d9471b3e2 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525621bc3c24269a872f95acf423ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cf003cd094fc694df09a09a245873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:26.140977 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d50b585c-ff5f-4f85-b7d3-1e1d9471b3e2 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers/140792ef-79c8-4a4d-b268-324caa480a9b" status: 200 len: 1271 microversion: 2.1 time: 0.267433 Jun 10 18:16:26.142325 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2532/5003] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:25 2022] GET /compute/v2.1/servers/140792ef-79c8-4a4d-b268-324caa480a9b => generated 1271 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:26.156472 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0c87e53d-d38f-42de-8d2b-49714e1bec75 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:26.182514 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0c87e53d-d38f-42de-8d2b-49714e1bec75 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:26.212048 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0c87e53d-d38f-42de-8d2b-49714e1bec75 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:26.214134 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0c87e53d-d38f-42de-8d2b-49714e1bec75 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:26.216884 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0c87e53d-d38f-42de-8d2b-49714e1bec75 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:26.221206 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0c87e53d-d38f-42de-8d2b-49714e1bec75 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:26.383632 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d7b60934-d3ff-4b13-90ab-82762d95e246 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:26.401332 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d7b60934-d3ff-4b13-90ab-82762d95e246 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:26.401715 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0c87e53d-d38f-42de-8d2b-49714e1bec75 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:26.403379 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d7b60934-d3ff-4b13-90ab-82762d95e246 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:26.404596 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d7b60934-d3ff-4b13-90ab-82762d95e246 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1879 microversion: 2.32 time: 0.500989 Jun 10 18:16:26.405165 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2472/5004] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:16:25 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1879 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:16:26.424344 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0c87e53d-d38f-42de-8d2b-49714e1bec75 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1275 microversion: 2.1 time: 0.278524 Jun 10 18:16:26.425161 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2533/5005] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:26 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1275 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:27.171441 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0960acb4-cb9a-4619-b821-5df41b4d7cca tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:27.172752 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0960acb4-cb9a-4619-b821-5df41b4d7cca tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: 140792ef-79c8-4a4d-b268-324caa480a9b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:27.218465 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0960acb4-cb9a-4619-b821-5df41b4d7cca tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:27.218888 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0960acb4-cb9a-4619-b821-5df41b4d7cca tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:27.219784 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0960acb4-cb9a-4619-b821-5df41b4d7cca tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:27.221398 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0960acb4-cb9a-4619-b821-5df41b4d7cca tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:27.296016 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-264fc963-ba36-4e4b-8615-582de28c9c11 req-4c295356-e44a-4f8e-9e6c-2d02a10e1d57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39300115-c0d6-485c-a610-543bdf470fae", "name": "network-vif-plugged", "status": "completed", "tag": "622a83e2-85f5-435d-8d26-2bce252a0f1b"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:16:27.312526 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-264fc963-ba36-4e4b-8615-582de28c9c11 req-4c295356-e44a-4f8e-9e6c-2d02a10e1d57 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:27.313871 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-264fc963-ba36-4e4b-8615-582de28c9c11 req-4c295356-e44a-4f8e-9e6c-2d02a10e1d57 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:27.326980 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0960acb4-cb9a-4619-b821-5df41b4d7cca tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525621bc3c24269a872f95acf423ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cf003cd094fc694df09a09a245873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:27.340454 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0960acb4-cb9a-4619-b821-5df41b4d7cca tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers/140792ef-79c8-4a4d-b268-324caa480a9b" status: 200 len: 1277 microversion: 2.1 time: 0.184605 Jun 10 18:16:27.344431 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2473/5006] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:27 2022] GET /compute/v2.1/servers/140792ef-79c8-4a4d-b268-324caa480a9b => generated 1277 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:27.347015 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-264fc963-ba36-4e4b-8615-582de28c9c11 req-4c295356-e44a-4f8e-9e6c-2d02a10e1d57 service nova] Creating event network-vif-plugged:622a83e2-85f5-435d-8d26-2bce252a0f1b for instance 39300115-c0d6-485c-a610-543bdf470fae on chh2-master-2 Jun 10 18:16:27.352883 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-264fc963-ba36-4e4b-8615-582de28c9c11 req-4c295356-e44a-4f8e-9e6c-2d02a10e1d57 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063160 Jun 10 18:16:27.354298 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2534/5007] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:16:27.430938 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-df496072-303a-49f3-80dc-e07bfe96b6c1 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:27.432439 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-df496072-303a-49f3-80dc-e07bfe96b6c1 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:27.460039 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df496072-303a-49f3-80dc-e07bfe96b6c1 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:27.461993 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df496072-303a-49f3-80dc-e07bfe96b6c1 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:27.464969 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df496072-303a-49f3-80dc-e07bfe96b6c1 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:27.467194 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df496072-303a-49f3-80dc-e07bfe96b6c1 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:27.491101 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-68cfcf27-181e-41d3-b039-3217e5d836cd tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:27.494782 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-68cfcf27-181e-41d3-b039-3217e5d836cd tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:27.511548 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-68cfcf27-181e-41d3-b039-3217e5d836cd tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:27.515817 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-68cfcf27-181e-41d3-b039-3217e5d836cd tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:27.516956 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-68cfcf27-181e-41d3-b039-3217e5d836cd tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:27.517575 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-68cfcf27-181e-41d3-b039-3217e5d836cd tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:27.836963 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-68cfcf27-181e-41d3-b039-3217e5d836cd tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:27.855354 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-68cfcf27-181e-41d3-b039-3217e5d836cd tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1281 microversion: 2.1 time: 0.412435 Jun 10 18:16:27.855972 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2535/5008] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:27 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1281 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:27.926477 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-df496072-303a-49f3-80dc-e07bfe96b6c1 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:27.942102 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-df496072-303a-49f3-80dc-e07bfe96b6c1 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:27.942756 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-df496072-303a-49f3-80dc-e07bfe96b6c1 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:27.946254 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-df496072-303a-49f3-80dc-e07bfe96b6c1 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1879 microversion: 2.32 time: 0.524864 Jun 10 18:16:27.947140 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2474/5009] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:16:27 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1879 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:16:28.311798 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-5d1b7f3f-985e-46f0-a4ea-947c38d1f778 req-4e1bb6e0-f09a-4666-829b-adf818f6d6a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0732433-a140-4237-9d7f-7dd24c7dbb79", "tag": "f3cd9e4d-9709-4d83-9727-349dd9939d0e"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:16:28.324945 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-5d1b7f3f-985e-46f0-a4ea-947c38d1f778 req-4e1bb6e0-f09a-4666-829b-adf818f6d6a3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:28.325704 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-5d1b7f3f-985e-46f0-a4ea-947c38d1f778 req-4e1bb6e0-f09a-4666-829b-adf818f6d6a3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:28.340015 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-5d1b7f3f-985e-46f0-a4ea-947c38d1f778 req-4e1bb6e0-f09a-4666-829b-adf818f6d6a3 service nova] Creating event network-changed:f3cd9e4d-9709-4d83-9727-349dd9939d0e for instance f0732433-a140-4237-9d7f-7dd24c7dbb79 on chh1-master-2 Jun 10 18:16:28.346596 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-5d1b7f3f-985e-46f0-a4ea-947c38d1f778 req-4e1bb6e0-f09a-4666-829b-adf818f6d6a3 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038582 Jun 10 18:16:28.349088 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2536/5010] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:16:28.362132 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1c93b31a-c7db-47dd-9534-0b3a1ff031c2 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:28.363946 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1c93b31a-c7db-47dd-9534-0b3a1ff031c2 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: 140792ef-79c8-4a4d-b268-324caa480a9b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:28.377268 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1c93b31a-c7db-47dd-9534-0b3a1ff031c2 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:28.377965 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1c93b31a-c7db-47dd-9534-0b3a1ff031c2 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:28.378895 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1c93b31a-c7db-47dd-9534-0b3a1ff031c2 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:28.379485 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1c93b31a-c7db-47dd-9534-0b3a1ff031c2 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:28.576718 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1c93b31a-c7db-47dd-9534-0b3a1ff031c2 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525621bc3c24269a872f95acf423ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cf003cd094fc694df09a09a245873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:28.591595 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1c93b31a-c7db-47dd-9534-0b3a1ff031c2 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers/140792ef-79c8-4a4d-b268-324caa480a9b" status: 200 len: 1277 microversion: 2.1 time: 0.237869 Jun 10 18:16:28.593922 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2475/5011] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:28 2022] GET /compute/v2.1/servers/140792ef-79c8-4a4d-b268-324caa480a9b => generated 1277 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:28.879625 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-853983b0-2b6f-405b-8a90-c0d1bfcd15e0 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:28.886840 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-853983b0-2b6f-405b-8a90-c0d1bfcd15e0 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:28.920601 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-853983b0-2b6f-405b-8a90-c0d1bfcd15e0 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:28.920601 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-853983b0-2b6f-405b-8a90-c0d1bfcd15e0 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:28.924953 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-853983b0-2b6f-405b-8a90-c0d1bfcd15e0 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:28.924953 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-853983b0-2b6f-405b-8a90-c0d1bfcd15e0 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:28.966404 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e84c7f46-8605-48bd-9280-bacb1d215e80 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:28.967874 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e84c7f46-8605-48bd-9280-bacb1d215e80 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:28.980244 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e84c7f46-8605-48bd-9280-bacb1d215e80 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:28.982456 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e84c7f46-8605-48bd-9280-bacb1d215e80 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:28.985502 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e84c7f46-8605-48bd-9280-bacb1d215e80 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:28.988072 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e84c7f46-8605-48bd-9280-bacb1d215e80 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:29.614308 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e84c7f46-8605-48bd-9280-bacb1d215e80 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:29.629749 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e84c7f46-8605-48bd-9280-bacb1d215e80 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:29.635043 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e84c7f46-8605-48bd-9280-bacb1d215e80 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:29.638880 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e84c7f46-8605-48bd-9280-bacb1d215e80 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1879 microversion: 2.32 time: 0.676622 Jun 10 18:16:29.639797 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2476/5012] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:16:28 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1879 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:16:29.642466 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-853983b0-2b6f-405b-8a90-c0d1bfcd15e0 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:29.654971 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-853983b0-2b6f-405b-8a90-c0d1bfcd15e0 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1323 microversion: 2.1 time: 0.784580 Jun 10 18:16:29.656678 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-32dce0d7-dbc2-4d11-a643-777a3a8ca716 req-0751c74f-1adb-4f6a-9b2e-0d0f31856f1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39300115-c0d6-485c-a610-543bdf470fae", "name": "network-vif-plugged", "status": "completed", "tag": "f706de66-4e9b-4a6d-9fca-27a9fc2c6121"}, {"server_uuid": "39300115-c0d6-485c-a610-543bdf470fae", "name": "network-vif-plugged", "status": "completed", "tag": "048d307e-e1dc-483a-9306-cdb9189fa940"}, {"server_uuid": "39300115-c0d6-485c-a610-543bdf470fae", "name": "network-vif-plugged", "status": "completed", "tag": "63a4b943-cacf-4b7e-9faa-97d4b5e9dbb6"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:16:29.659923 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2537/5013] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:28 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1323 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:29.674055 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8673c31e-6aa3-4f22-97bc-68f920f8a511 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:29.677847 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8673c31e-6aa3-4f22-97bc-68f920f8a511 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: 140792ef-79c8-4a4d-b268-324caa480a9b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:29.679808 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-32dce0d7-dbc2-4d11-a643-777a3a8ca716 req-0751c74f-1adb-4f6a-9b2e-0d0f31856f1a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:29.680265 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-32dce0d7-dbc2-4d11-a643-777a3a8ca716 req-0751c74f-1adb-4f6a-9b2e-0d0f31856f1a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:29.694440 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8673c31e-6aa3-4f22-97bc-68f920f8a511 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:29.695018 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8673c31e-6aa3-4f22-97bc-68f920f8a511 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:29.701099 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8673c31e-6aa3-4f22-97bc-68f920f8a511 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:29.702046 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8673c31e-6aa3-4f22-97bc-68f920f8a511 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:29.716592 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-32dce0d7-dbc2-4d11-a643-777a3a8ca716 req-0751c74f-1adb-4f6a-9b2e-0d0f31856f1a service nova] Creating event network-vif-plugged:f706de66-4e9b-4a6d-9fca-27a9fc2c6121 for instance 39300115-c0d6-485c-a610-543bdf470fae on chh2-master-2 Jun 10 18:16:29.718115 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-32dce0d7-dbc2-4d11-a643-777a3a8ca716 req-0751c74f-1adb-4f6a-9b2e-0d0f31856f1a service nova] Creating event network-vif-plugged:048d307e-e1dc-483a-9306-cdb9189fa940 for instance 39300115-c0d6-485c-a610-543bdf470fae on chh2-master-2 Jun 10 18:16:29.718878 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-32dce0d7-dbc2-4d11-a643-777a3a8ca716 req-0751c74f-1adb-4f6a-9b2e-0d0f31856f1a service nova] Creating event network-vif-plugged:63a4b943-cacf-4b7e-9faa-97d4b5e9dbb6 for instance 39300115-c0d6-485c-a610-543bdf470fae on chh2-master-2 Jun 10 18:16:29.729338 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-32dce0d7-dbc2-4d11-a643-777a3a8ca716 req-0751c74f-1adb-4f6a-9b2e-0d0f31856f1a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.087652 Jun 10 18:16:29.740808 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2477/5014] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:16:29.802935 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8673c31e-6aa3-4f22-97bc-68f920f8a511 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525621bc3c24269a872f95acf423ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cf003cd094fc694df09a09a245873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:29.810836 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8673c31e-6aa3-4f22-97bc-68f920f8a511 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers/140792ef-79c8-4a4d-b268-324caa480a9b" status: 200 len: 1277 microversion: 2.1 time: 0.149533 Jun 10 18:16:29.811429 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2538/5015] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:29 2022] GET /compute/v2.1/servers/140792ef-79c8-4a4d-b268-324caa480a9b => generated 1277 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:30.389386 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-8839dfe5-ebec-47a7-895c-2ccae0daa0d0 req-f442d6ef-933c-4c8e-9c6b-e6845a402bd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0732433-a140-4237-9d7f-7dd24c7dbb79", "tag": "f3cd9e4d-9709-4d83-9727-349dd9939d0e"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:16:30.407105 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-8839dfe5-ebec-47a7-895c-2ccae0daa0d0 req-f442d6ef-933c-4c8e-9c6b-e6845a402bd2 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:30.407621 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-8839dfe5-ebec-47a7-895c-2ccae0daa0d0 req-f442d6ef-933c-4c8e-9c6b-e6845a402bd2 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:30.438406 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-8839dfe5-ebec-47a7-895c-2ccae0daa0d0 req-f442d6ef-933c-4c8e-9c6b-e6845a402bd2 service nova] Creating event network-changed:f3cd9e4d-9709-4d83-9727-349dd9939d0e for instance f0732433-a140-4237-9d7f-7dd24c7dbb79 on chh1-master-2 Jun 10 18:16:30.444676 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-8839dfe5-ebec-47a7-895c-2ccae0daa0d0 req-f442d6ef-933c-4c8e-9c6b-e6845a402bd2 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060420 Jun 10 18:16:30.445551 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2478/5016] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:16:30.661994 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-13791391-9b31-4599-b7f0-6d9501ac075a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:30.664008 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-13791391-9b31-4599-b7f0-6d9501ac075a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:30.675962 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-13791391-9b31-4599-b7f0-6d9501ac075a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:30.676702 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-13791391-9b31-4599-b7f0-6d9501ac075a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:30.677856 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-13791391-9b31-4599-b7f0-6d9501ac075a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:30.678088 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-aeb58641-6b2d-4d1c-a14c-a1ca72fcbee2 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:30.679112 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-13791391-9b31-4599-b7f0-6d9501ac075a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:30.679223 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-aeb58641-6b2d-4d1c-a14c-a1ca72fcbee2 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:30.704661 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aeb58641-6b2d-4d1c-a14c-a1ca72fcbee2 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:30.706463 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aeb58641-6b2d-4d1c-a14c-a1ca72fcbee2 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:30.707465 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aeb58641-6b2d-4d1c-a14c-a1ca72fcbee2 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:30.707954 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aeb58641-6b2d-4d1c-a14c-a1ca72fcbee2 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:31.242942 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-aeb58641-6b2d-4d1c-a14c-a1ca72fcbee2 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:31.257133 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-aeb58641-6b2d-4d1c-a14c-a1ca72fcbee2 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1323 microversion: 2.1 time: 0.584092 Jun 10 18:16:31.258046 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2479/5017] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:30 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1323 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:31.263273 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0b560d3d-900b-4dea-bfeb-4ab6793ebe21 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:31.263891 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0b560d3d-900b-4dea-bfeb-4ab6793ebe21 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: 140792ef-79c8-4a4d-b268-324caa480a9b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:31.277767 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0b560d3d-900b-4dea-bfeb-4ab6793ebe21 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:31.280569 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0b560d3d-900b-4dea-bfeb-4ab6793ebe21 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:31.280569 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0b560d3d-900b-4dea-bfeb-4ab6793ebe21 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:31.280569 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0b560d3d-900b-4dea-bfeb-4ab6793ebe21 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:31.335487 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-13791391-9b31-4599-b7f0-6d9501ac075a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:31.349516 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-13791391-9b31-4599-b7f0-6d9501ac075a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:31.351205 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-13791391-9b31-4599-b7f0-6d9501ac075a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:31.352442 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-13791391-9b31-4599-b7f0-6d9501ac075a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1879 microversion: 2.32 time: 0.695584 Jun 10 18:16:31.371512 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2539/5018] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:16:30 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1879 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:16:31.707274 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0b560d3d-900b-4dea-bfeb-4ab6793ebe21 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525621bc3c24269a872f95acf423ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cf003cd094fc694df09a09a245873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:31.717670 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0b560d3d-900b-4dea-bfeb-4ab6793ebe21 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers/140792ef-79c8-4a4d-b268-324caa480a9b" status: 200 len: 1319 microversion: 2.1 time: 0.457965 Jun 10 18:16:31.718263 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2480/5019] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:31 2022] GET /compute/v2.1/servers/140792ef-79c8-4a4d-b268-324caa480a9b => generated 1319 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:31.747350 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-6e30f2ab-d487-478f-865c-99b4d28a753e req-54f807b7-8219-4855-8586-7e75f3aeca09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39300115-c0d6-485c-a610-543bdf470fae", "name": "network-vif-plugged", "status": "completed", "tag": "aca0b4a9-2d21-42c4-a9e4-19c74885c3e4"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:16:31.761436 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-6e30f2ab-d487-478f-865c-99b4d28a753e req-54f807b7-8219-4855-8586-7e75f3aeca09 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:31.762247 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-6e30f2ab-d487-478f-865c-99b4d28a753e req-54f807b7-8219-4855-8586-7e75f3aeca09 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:31.778088 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-6e30f2ab-d487-478f-865c-99b4d28a753e req-54f807b7-8219-4855-8586-7e75f3aeca09 service nova] Creating event network-vif-plugged:aca0b4a9-2d21-42c4-a9e4-19c74885c3e4 for instance 39300115-c0d6-485c-a610-543bdf470fae on chh2-master-2 Jun 10 18:16:31.784988 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-6e30f2ab-d487-478f-865c-99b4d28a753e req-54f807b7-8219-4855-8586-7e75f3aeca09 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041223 Jun 10 18:16:31.790306 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2540/5020] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:16:32.004160 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-3344cc8f-432f-46a5-a5da-fbe7c2f7c0d7 req-34fe3017-dc08-45fa-8b35-b85ef96a3cb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8", "tag": "2ee7eb96-d569-4b56-80d8-7ca0fb5164f6"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:16:32.014060 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-3344cc8f-432f-46a5-a5da-fbe7c2f7c0d7 req-34fe3017-dc08-45fa-8b35-b85ef96a3cb6 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:32.014715 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-3344cc8f-432f-46a5-a5da-fbe7c2f7c0d7 req-34fe3017-dc08-45fa-8b35-b85ef96a3cb6 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:32.027047 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-3344cc8f-432f-46a5-a5da-fbe7c2f7c0d7 req-34fe3017-dc08-45fa-8b35-b85ef96a3cb6 service nova] Creating event network-changed:2ee7eb96-d569-4b56-80d8-7ca0fb5164f6 for instance 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 on chh1-master-2 Jun 10 18:16:32.032522 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-3344cc8f-432f-46a5-a5da-fbe7c2f7c0d7 req-34fe3017-dc08-45fa-8b35-b85ef96a3cb6 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031869 Jun 10 18:16:32.035069 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2481/5021] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:16:32.277266 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-810da561-092b-4b28-94a6-22ad7c1cca79 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:32.278028 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-810da561-092b-4b28-94a6-22ad7c1cca79 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:32.280008 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:16:32.285268 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-810da561-092b-4b28-94a6-22ad7c1cca79 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:32.286143 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-810da561-092b-4b28-94a6-22ad7c1cca79 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:32.287141 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-810da561-092b-4b28-94a6-22ad7c1cca79 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:32.287593 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-810da561-092b-4b28-94a6-22ad7c1cca79 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:32.380297 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-387f29b9-84d2-4ebe-9345-a04e5ddc26f4 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:32.381439 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-387f29b9-84d2-4ebe-9345-a04e5ddc26f4 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:32.387440 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:16:32.389637 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-387f29b9-84d2-4ebe-9345-a04e5ddc26f4 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:32.390352 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-387f29b9-84d2-4ebe-9345-a04e5ddc26f4 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:32.391341 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-387f29b9-84d2-4ebe-9345-a04e5ddc26f4 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:32.392014 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-387f29b9-84d2-4ebe-9345-a04e5ddc26f4 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:32.652054 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=8 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:16:32.742552 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-810da561-092b-4b28-94a6-22ad7c1cca79 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:32.753280 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-810da561-092b-4b28-94a6-22ad7c1cca79 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1323 microversion: 2.1 time: 0.482078 Jun 10 18:16:32.756749 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2541/5022] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:32 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1323 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:32.764107 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-72e91702-87ba-408f-a64d-bd8d74387512 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:32.766905 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-72e91702-87ba-408f-a64d-bd8d74387512 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: 140792ef-79c8-4a4d-b268-324caa480a9b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:32.785373 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-72e91702-87ba-408f-a64d-bd8d74387512 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:32.786148 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-72e91702-87ba-408f-a64d-bd8d74387512 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:32.787102 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-72e91702-87ba-408f-a64d-bd8d74387512 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:32.789103 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-72e91702-87ba-408f-a64d-bd8d74387512 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:33.128329 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-72e91702-87ba-408f-a64d-bd8d74387512 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525621bc3c24269a872f95acf423ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cf003cd094fc694df09a09a245873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:33.138756 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-72e91702-87ba-408f-a64d-bd8d74387512 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers/140792ef-79c8-4a4d-b268-324caa480a9b" status: 200 len: 1319 microversion: 2.1 time: 0.380426 Jun 10 18:16:33.139754 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2542/5023] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:32 2022] GET /compute/v2.1/servers/140792ef-79c8-4a4d-b268-324caa480a9b => generated 1319 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:33.308646 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-387f29b9-84d2-4ebe-9345-a04e5ddc26f4 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:33.329612 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-387f29b9-84d2-4ebe-9345-a04e5ddc26f4 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:33.332014 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-387f29b9-84d2-4ebe-9345-a04e5ddc26f4 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:33.333575 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-387f29b9-84d2-4ebe-9345-a04e5ddc26f4 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1879 microversion: 2.32 time: 0.958302 Jun 10 18:16:33.334455 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2482/5024] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:16:32 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1879 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:16:33.770441 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9fe33c8f-eb3d-48be-bcc4-5b02e4f06499 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:33.771794 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9fe33c8f-eb3d-48be-bcc4-5b02e4f06499 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:33.782932 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9fe33c8f-eb3d-48be-bcc4-5b02e4f06499 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:33.783392 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9fe33c8f-eb3d-48be-bcc4-5b02e4f06499 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:33.784179 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9fe33c8f-eb3d-48be-bcc4-5b02e4f06499 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:33.793470 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9fe33c8f-eb3d-48be-bcc4-5b02e4f06499 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:33.794688 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=12 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:16:34.054564 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-d0f545a5-ad01-429b-99d2-8410196cd898 req-95cee72d-bd35-413b-b7e8-15acf32161c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc902e78-98fd-4c7b-8ff9-86d75c4bfaba", "tag": "bcb0ee94-5986-450d-83a1-fff197a51be4"}, {"name": "network-changed", "server_uuid": "140792ef-79c8-4a4d-b268-324caa480a9b", "tag": "546114d6-748a-4f18-b136-0daa7b66c8b9"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:16:34.064583 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-d0f545a5-ad01-429b-99d2-8410196cd898 req-95cee72d-bd35-413b-b7e8-15acf32161c3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:34.065206 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-d0f545a5-ad01-429b-99d2-8410196cd898 req-95cee72d-bd35-413b-b7e8-15acf32161c3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:34.069181 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:16:34.078126 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9fe33c8f-eb3d-48be-bcc4-5b02e4f06499 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:34.087354 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9fe33c8f-eb3d-48be-bcc4-5b02e4f06499 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1323 microversion: 2.1 time: 0.320708 Jun 10 18:16:34.089331 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2543/5025] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:33 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1323 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:34.110758 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-d0f545a5-ad01-429b-99d2-8410196cd898 req-95cee72d-bd35-413b-b7e8-15acf32161c3 service nova] Creating event network-changed:bcb0ee94-5986-450d-83a1-fff197a51be4 for instance bc902e78-98fd-4c7b-8ff9-86d75c4bfaba on chh1-master-2 Jun 10 18:16:34.111336 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-d0f545a5-ad01-429b-99d2-8410196cd898 req-95cee72d-bd35-413b-b7e8-15acf32161c3 service nova] Creating event network-changed:546114d6-748a-4f18-b136-0daa7b66c8b9 for instance 140792ef-79c8-4a4d-b268-324caa480a9b on chh2-master-2 Jun 10 18:16:34.123927 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-d0f545a5-ad01-429b-99d2-8410196cd898 req-95cee72d-bd35-413b-b7e8-15acf32161c3 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.072640 Jun 10 18:16:34.124865 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2483/5026] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:16:34.157365 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5c958f0d-ec30-4aeb-a0da-dce2ce0bb236 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:34.158450 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5c958f0d-ec30-4aeb-a0da-dce2ce0bb236 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: 140792ef-79c8-4a4d-b268-324caa480a9b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:34.168554 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5c958f0d-ec30-4aeb-a0da-dce2ce0bb236 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:34.169129 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5c958f0d-ec30-4aeb-a0da-dce2ce0bb236 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:34.170445 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5c958f0d-ec30-4aeb-a0da-dce2ce0bb236 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:34.171238 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5c958f0d-ec30-4aeb-a0da-dce2ce0bb236 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:34.356627 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-06962baf-49e4-47a1-983f-17520d43b515 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:34.357474 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-06962baf-49e4-47a1-983f-17520d43b515 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:34.365495 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-06962baf-49e4-47a1-983f-17520d43b515 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:34.365928 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-06962baf-49e4-47a1-983f-17520d43b515 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:34.367184 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-06962baf-49e4-47a1-983f-17520d43b515 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:34.376620 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-06962baf-49e4-47a1-983f-17520d43b515 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:34.457763 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5c958f0d-ec30-4aeb-a0da-dce2ce0bb236 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525621bc3c24269a872f95acf423ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cf003cd094fc694df09a09a245873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:34.470618 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5c958f0d-ec30-4aeb-a0da-dce2ce0bb236 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers/140792ef-79c8-4a4d-b268-324caa480a9b" status: 200 len: 1319 microversion: 2.1 time: 0.317883 Jun 10 18:16:34.471985 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2544/5027] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:34 2022] GET /compute/v2.1/servers/140792ef-79c8-4a4d-b268-324caa480a9b => generated 1319 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:34.612232 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-06962baf-49e4-47a1-983f-17520d43b515 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:34.621922 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-06962baf-49e4-47a1-983f-17520d43b515 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:34.623919 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-06962baf-49e4-47a1-983f-17520d43b515 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:34.625228 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-06962baf-49e4-47a1-983f-17520d43b515 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1879 microversion: 2.32 time: 0.274466 Jun 10 18:16:34.626083 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2484/5028] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:16:34 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1879 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:16:35.106936 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cc65358c-fead-4f9c-b263-82afe379751a tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:35.107596 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cc65358c-fead-4f9c-b263-82afe379751a tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:35.121325 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cc65358c-fead-4f9c-b263-82afe379751a tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:35.123987 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cc65358c-fead-4f9c-b263-82afe379751a tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:35.125022 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cc65358c-fead-4f9c-b263-82afe379751a tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:35.127240 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cc65358c-fead-4f9c-b263-82afe379751a tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:35.346980 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cc65358c-fead-4f9c-b263-82afe379751a tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:35.356930 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cc65358c-fead-4f9c-b263-82afe379751a tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1323 microversion: 2.1 time: 0.255231 Jun 10 18:16:35.359269 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2545/5029] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:35 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1323 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:35.490225 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-943b0392-b538-4363-b62d-eb164bf95a18 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:35.490916 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-943b0392-b538-4363-b62d-eb164bf95a18 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: 140792ef-79c8-4a4d-b268-324caa480a9b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:35.499757 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-943b0392-b538-4363-b62d-eb164bf95a18 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:35.500266 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-943b0392-b538-4363-b62d-eb164bf95a18 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:35.501162 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-943b0392-b538-4363-b62d-eb164bf95a18 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:35.501609 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-943b0392-b538-4363-b62d-eb164bf95a18 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:35.646568 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ad930635-f28b-4fdf-aa5a-bfa213bbd84e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:35.647668 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ad930635-f28b-4fdf-aa5a-bfa213bbd84e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:35.661541 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-943b0392-b538-4363-b62d-eb164bf95a18 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525621bc3c24269a872f95acf423ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cf003cd094fc694df09a09a245873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:35.674731 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-943b0392-b538-4363-b62d-eb164bf95a18 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers/140792ef-79c8-4a4d-b268-324caa480a9b" status: 200 len: 1319 microversion: 2.1 time: 0.189795 Jun 10 18:16:35.676803 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ad930635-f28b-4fdf-aa5a-bfa213bbd84e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:35.677338 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ad930635-f28b-4fdf-aa5a-bfa213bbd84e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:35.677819 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2485/5030] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:35 2022] GET /compute/v2.1/servers/140792ef-79c8-4a4d-b268-324caa480a9b => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:35.681421 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ad930635-f28b-4fdf-aa5a-bfa213bbd84e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:35.683302 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ad930635-f28b-4fdf-aa5a-bfa213bbd84e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:35.961135 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ad930635-f28b-4fdf-aa5a-bfa213bbd84e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:35.973054 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ad930635-f28b-4fdf-aa5a-bfa213bbd84e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:35.974966 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ad930635-f28b-4fdf-aa5a-bfa213bbd84e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:35.976742 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ad930635-f28b-4fdf-aa5a-bfa213bbd84e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 2831 microversion: 2.32 time: 0.335454 Jun 10 18:16:35.977753 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2546/5031] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:16:35 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 2831 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:16:35.996196 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dd8f87af-ef6e-48b7-95ec-6e27c67698d7 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:35.996722 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dd8f87af-ef6e-48b7-95ec-6e27c67698d7 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:36.003226 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd8f87af-ef6e-48b7-95ec-6e27c67698d7 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:36.003920 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd8f87af-ef6e-48b7-95ec-6e27c67698d7 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:36.004903 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd8f87af-ef6e-48b7-95ec-6e27c67698d7 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:36.005404 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd8f87af-ef6e-48b7-95ec-6e27c67698d7 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:36.198942 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dd8f87af-ef6e-48b7-95ec-6e27c67698d7 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.205904 Jun 10 18:16:36.200745 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2486/5032] 10.222.0.35 () {60 vars in 1315 bytes} [Fri Jun 10 18:16:35 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae/os-interface => generated 1831 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:16:36.379748 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2da733e2-9379-4209-80c0-80ae0bca7b8a tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:36.380624 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2da733e2-9379-4209-80c0-80ae0bca7b8a tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:36.404614 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2da733e2-9379-4209-80c0-80ae0bca7b8a tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:36.405097 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2da733e2-9379-4209-80c0-80ae0bca7b8a tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:36.406000 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2da733e2-9379-4209-80c0-80ae0bca7b8a tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:36.406541 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2da733e2-9379-4209-80c0-80ae0bca7b8a tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:36.694673 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4b4d148e-7a0a-481c-b30f-9649c5c60b55 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:36.695984 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4b4d148e-7a0a-481c-b30f-9649c5c60b55 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: 140792ef-79c8-4a4d-b268-324caa480a9b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:36.702815 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4b4d148e-7a0a-481c-b30f-9649c5c60b55 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:36.703528 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4b4d148e-7a0a-481c-b30f-9649c5c60b55 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:36.704639 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4b4d148e-7a0a-481c-b30f-9649c5c60b55 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:36.705279 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4b4d148e-7a0a-481c-b30f-9649c5c60b55 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:36.801838 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2da733e2-9379-4209-80c0-80ae0bca7b8a tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:36.808155 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:16:36.815168 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2da733e2-9379-4209-80c0-80ae0bca7b8a tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1323 microversion: 2.1 time: 0.444144 Jun 10 18:16:36.820393 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2547/5033] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:36 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1323 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:37.017784 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4b4d148e-7a0a-481c-b30f-9649c5c60b55 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525621bc3c24269a872f95acf423ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cf003cd094fc694df09a09a245873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:37.039390 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4b4d148e-7a0a-481c-b30f-9649c5c60b55 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers/140792ef-79c8-4a4d-b268-324caa480a9b" status: 200 len: 1319 microversion: 2.1 time: 0.348420 Jun 10 18:16:37.040045 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2487/5034] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:36 2022] GET /compute/v2.1/servers/140792ef-79c8-4a4d-b268-324caa480a9b => generated 1319 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:16:37.744213 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-6f4b7631-6d4f-48ae-887f-5f2da8ca6726 req-be06a936-ed98-4f81-b2b4-2b53832f541b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39300115-c0d6-485c-a610-543bdf470fae", "tag": "90ddcb49-417f-4027-b8fd-8e4f78ccc8ba"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:16:37.757757 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-6f4b7631-6d4f-48ae-887f-5f2da8ca6726 req-be06a936-ed98-4f81-b2b4-2b53832f541b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:37.757757 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-6f4b7631-6d4f-48ae-887f-5f2da8ca6726 req-be06a936-ed98-4f81-b2b4-2b53832f541b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:37.780700 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-6f4b7631-6d4f-48ae-887f-5f2da8ca6726 req-be06a936-ed98-4f81-b2b4-2b53832f541b service nova] Creating event network-changed:90ddcb49-417f-4027-b8fd-8e4f78ccc8ba for instance 39300115-c0d6-485c-a610-543bdf470fae on chh2-master-2 Jun 10 18:16:37.789759 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-6f4b7631-6d4f-48ae-887f-5f2da8ca6726 req-be06a936-ed98-4f81-b2b4-2b53832f541b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049403 Jun 10 18:16:37.791149 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2548/5035] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:16:37.833953 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-eb539fd7-0358-4f4b-b2cc-2f4260a65ed1 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:37.836593 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-eb539fd7-0358-4f4b-b2cc-2f4260a65ed1 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:37.852070 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eb539fd7-0358-4f4b-b2cc-2f4260a65ed1 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:37.855038 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eb539fd7-0358-4f4b-b2cc-2f4260a65ed1 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:37.856157 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eb539fd7-0358-4f4b-b2cc-2f4260a65ed1 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:37.856854 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eb539fd7-0358-4f4b-b2cc-2f4260a65ed1 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:38.060258 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1f1a62a1-7045-4f9e-9d3d-8a1854ce80da tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:38.061181 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1f1a62a1-7045-4f9e-9d3d-8a1854ce80da tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: 140792ef-79c8-4a4d-b268-324caa480a9b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:38.074709 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1f1a62a1-7045-4f9e-9d3d-8a1854ce80da tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:38.076867 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1f1a62a1-7045-4f9e-9d3d-8a1854ce80da tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:38.080437 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1f1a62a1-7045-4f9e-9d3d-8a1854ce80da tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:38.080437 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1f1a62a1-7045-4f9e-9d3d-8a1854ce80da tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:38.100210 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-eb539fd7-0358-4f4b-b2cc-2f4260a65ed1 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:38.112732 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-eb539fd7-0358-4f4b-b2cc-2f4260a65ed1 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1323 microversion: 2.1 time: 0.282991 Jun 10 18:16:38.125638 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2488/5036] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:37 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1323 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:38.386628 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1f1a62a1-7045-4f9e-9d3d-8a1854ce80da tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525621bc3c24269a872f95acf423ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cf003cd094fc694df09a09a245873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:38.404018 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1f1a62a1-7045-4f9e-9d3d-8a1854ce80da tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers/140792ef-79c8-4a4d-b268-324caa480a9b" status: 200 len: 1319 microversion: 2.1 time: 0.350672 Jun 10 18:16:38.416848 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2549/5037] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:38 2022] GET /compute/v2.1/servers/140792ef-79c8-4a4d-b268-324caa480a9b => generated 1319 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:39.131488 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f70ba18f-aad7-4a72-b377-8ebe063bf154 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:39.132906 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f70ba18f-aad7-4a72-b377-8ebe063bf154 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:39.153477 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f70ba18f-aad7-4a72-b377-8ebe063bf154 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:39.154414 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f70ba18f-aad7-4a72-b377-8ebe063bf154 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:39.155470 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f70ba18f-aad7-4a72-b377-8ebe063bf154 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:39.156728 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f70ba18f-aad7-4a72-b377-8ebe063bf154 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:39.351414 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f70ba18f-aad7-4a72-b377-8ebe063bf154 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:39.359419 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f70ba18f-aad7-4a72-b377-8ebe063bf154 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1323 microversion: 2.1 time: 0.232018 Jun 10 18:16:39.360041 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2489/5038] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:39 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1323 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:39.423263 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-67697a1b-e94d-484c-bc77-5c754b18593f tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:39.424061 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-67697a1b-e94d-484c-bc77-5c754b18593f tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: 140792ef-79c8-4a4d-b268-324caa480a9b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:39.430360 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:16:39.432841 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-67697a1b-e94d-484c-bc77-5c754b18593f tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:39.434605 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-67697a1b-e94d-484c-bc77-5c754b18593f tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:39.435621 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-67697a1b-e94d-484c-bc77-5c754b18593f tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:39.441248 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-67697a1b-e94d-484c-bc77-5c754b18593f tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:39.798322 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-67697a1b-e94d-484c-bc77-5c754b18593f tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525621bc3c24269a872f95acf423ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cf003cd094fc694df09a09a245873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:39.807386 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-67697a1b-e94d-484c-bc77-5c754b18593f tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers/140792ef-79c8-4a4d-b268-324caa480a9b" status: 200 len: 1319 microversion: 2.1 time: 0.388166 Jun 10 18:16:39.817548 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2550/5039] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:39 2022] GET /compute/v2.1/servers/140792ef-79c8-4a4d-b268-324caa480a9b => generated 1319 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:40.190259 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-e6e9d16b-bbd6-425f-943f-1bd41a965928 req-77bc0510-86a6-4a75-94e5-47b6101eb4ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc902e78-98fd-4c7b-8ff9-86d75c4bfaba", "name": "network-vif-plugged", "status": "completed", "tag": "bcb0ee94-5986-450d-83a1-fff197a51be4"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:16:40.208266 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-e6e9d16b-bbd6-425f-943f-1bd41a965928 req-77bc0510-86a6-4a75-94e5-47b6101eb4ce service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:40.208762 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-e6e9d16b-bbd6-425f-943f-1bd41a965928 req-77bc0510-86a6-4a75-94e5-47b6101eb4ce service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:40.239818 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-e6e9d16b-bbd6-425f-943f-1bd41a965928 req-77bc0510-86a6-4a75-94e5-47b6101eb4ce service nova] Creating event network-vif-plugged:bcb0ee94-5986-450d-83a1-fff197a51be4 for instance bc902e78-98fd-4c7b-8ff9-86d75c4bfaba on chh1-master-2 Jun 10 18:16:40.245757 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-e6e9d16b-bbd6-425f-943f-1bd41a965928 req-77bc0510-86a6-4a75-94e5-47b6101eb4ce service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059305 Jun 10 18:16:40.247015 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2490/5040] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:16:40.376567 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0f557f77-b355-4f94-9423-1ffdfb70d7a0 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:40.377437 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0f557f77-b355-4f94-9423-1ffdfb70d7a0 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:40.386649 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0f557f77-b355-4f94-9423-1ffdfb70d7a0 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:40.395571 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0f557f77-b355-4f94-9423-1ffdfb70d7a0 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:40.396874 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0f557f77-b355-4f94-9423-1ffdfb70d7a0 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:40.397687 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0f557f77-b355-4f94-9423-1ffdfb70d7a0 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:40.732064 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0f557f77-b355-4f94-9423-1ffdfb70d7a0 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:40.743596 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0f557f77-b355-4f94-9423-1ffdfb70d7a0 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1323 microversion: 2.1 time: 0.370840 Jun 10 18:16:40.744211 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2551/5041] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:40 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1323 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:40.825743 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8640d415-f94a-43cc-be86-ef95e3c6b4db tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:40.826590 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8640d415-f94a-43cc-be86-ef95e3c6b4db tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: 140792ef-79c8-4a4d-b268-324caa480a9b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:40.832886 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8640d415-f94a-43cc-be86-ef95e3c6b4db tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:40.833286 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8640d415-f94a-43cc-be86-ef95e3c6b4db tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:40.834056 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8640d415-f94a-43cc-be86-ef95e3c6b4db tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:40.834500 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8640d415-f94a-43cc-be86-ef95e3c6b4db tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:41.074117 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8640d415-f94a-43cc-be86-ef95e3c6b4db tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525621bc3c24269a872f95acf423ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cf003cd094fc694df09a09a245873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:41.082624 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8640d415-f94a-43cc-be86-ef95e3c6b4db tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers/140792ef-79c8-4a4d-b268-324caa480a9b" status: 200 len: 1319 microversion: 2.1 time: 0.261664 Jun 10 18:16:41.096140 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2491/5042] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:40 2022] GET /compute/v2.1/servers/140792ef-79c8-4a4d-b268-324caa480a9b => generated 1319 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:41.760880 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-664bddf9-54fc-41cc-834c-86c2ffe1a23e tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:41.761589 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-664bddf9-54fc-41cc-834c-86c2ffe1a23e tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:41.770947 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-664bddf9-54fc-41cc-834c-86c2ffe1a23e tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:41.771401 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-664bddf9-54fc-41cc-834c-86c2ffe1a23e tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:41.772175 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-664bddf9-54fc-41cc-834c-86c2ffe1a23e tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:41.772640 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-664bddf9-54fc-41cc-834c-86c2ffe1a23e tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:42.100001 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4575d378-22a2-4472-aad3-6efd421ac5b5 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:42.100722 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4575d378-22a2-4472-aad3-6efd421ac5b5 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: 140792ef-79c8-4a4d-b268-324caa480a9b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:42.108455 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4575d378-22a2-4472-aad3-6efd421ac5b5 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:42.108910 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4575d378-22a2-4472-aad3-6efd421ac5b5 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:42.109686 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4575d378-22a2-4472-aad3-6efd421ac5b5 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:42.110121 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4575d378-22a2-4472-aad3-6efd421ac5b5 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:42.290667 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4575d378-22a2-4472-aad3-6efd421ac5b5 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525621bc3c24269a872f95acf423ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cf003cd094fc694df09a09a245873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:42.303104 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4575d378-22a2-4472-aad3-6efd421ac5b5 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers/140792ef-79c8-4a4d-b268-324caa480a9b" status: 200 len: 1319 microversion: 2.1 time: 0.207664 Jun 10 18:16:42.304427 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2492/5043] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:42 2022] GET /compute/v2.1/servers/140792ef-79c8-4a4d-b268-324caa480a9b => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:16:42.318560 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-32421d2d-e5d4-4123-9190-6017e269db0d req-050cefef-501e-40b0-a2dd-4baeb8f399bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8", "name": "network-vif-plugged", "status": "completed", "tag": "2ee7eb96-d569-4b56-80d8-7ca0fb5164f6"}, {"server_uuid": "140792ef-79c8-4a4d-b268-324caa480a9b", "name": "network-vif-plugged", "status": "completed", "tag": "546114d6-748a-4f18-b136-0daa7b66c8b9"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:16:42.324446 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-664bddf9-54fc-41cc-834c-86c2ffe1a23e tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:42.335807 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-664bddf9-54fc-41cc-834c-86c2ffe1a23e tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1323 microversion: 2.1 time: 0.579221 Jun 10 18:16:42.336421 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2552/5044] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:41 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1323 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:42.349000 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-32421d2d-e5d4-4123-9190-6017e269db0d req-050cefef-501e-40b0-a2dd-4baeb8f399bf service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:42.349000 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-32421d2d-e5d4-4123-9190-6017e269db0d req-050cefef-501e-40b0-a2dd-4baeb8f399bf service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:42.357634 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-32421d2d-e5d4-4123-9190-6017e269db0d req-050cefef-501e-40b0-a2dd-4baeb8f399bf service nova] Creating event network-vif-plugged:2ee7eb96-d569-4b56-80d8-7ca0fb5164f6 for instance 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 on chh1-master-2 Jun 10 18:16:42.358143 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-32421d2d-e5d4-4123-9190-6017e269db0d req-050cefef-501e-40b0-a2dd-4baeb8f399bf service nova] Creating event network-vif-plugged:546114d6-748a-4f18-b136-0daa7b66c8b9 for instance 140792ef-79c8-4a4d-b268-324caa480a9b on chh2-master-2 Jun 10 18:16:42.366805 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-32421d2d-e5d4-4123-9190-6017e269db0d req-050cefef-501e-40b0-a2dd-4baeb8f399bf service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.059686 Jun 10 18:16:42.367488 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2493/5045] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:16:43.322063 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c6b3409d-c053-4d7c-9247-07ebb73ef5f5 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:43.322991 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c6b3409d-c053-4d7c-9247-07ebb73ef5f5 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: 140792ef-79c8-4a4d-b268-324caa480a9b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:43.330884 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c6b3409d-c053-4d7c-9247-07ebb73ef5f5 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:43.331229 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c6b3409d-c053-4d7c-9247-07ebb73ef5f5 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:43.332015 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c6b3409d-c053-4d7c-9247-07ebb73ef5f5 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:43.332486 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c6b3409d-c053-4d7c-9247-07ebb73ef5f5 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:43.354398 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c9b50358-5b88-41b7-bbb4-b579e6827c3c tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:43.356424 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c9b50358-5b88-41b7-bbb4-b579e6827c3c tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:43.380786 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9b50358-5b88-41b7-bbb4-b579e6827c3c tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:43.381245 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9b50358-5b88-41b7-bbb4-b579e6827c3c tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:43.382652 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9b50358-5b88-41b7-bbb4-b579e6827c3c tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:43.383119 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9b50358-5b88-41b7-bbb4-b579e6827c3c tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:43.548554 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c6b3409d-c053-4d7c-9247-07ebb73ef5f5 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525621bc3c24269a872f95acf423ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cf003cd094fc694df09a09a245873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:43.556432 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c6b3409d-c053-4d7c-9247-07ebb73ef5f5 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers/140792ef-79c8-4a4d-b268-324caa480a9b" status: 200 len: 1319 microversion: 2.1 time: 0.238948 Jun 10 18:16:43.557023 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2553/5046] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:43 2022] GET /compute/v2.1/servers/140792ef-79c8-4a4d-b268-324caa480a9b => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:43.694521 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c9b50358-5b88-41b7-bbb4-b579e6827c3c tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:43.707692 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c9b50358-5b88-41b7-bbb4-b579e6827c3c tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1323 microversion: 2.1 time: 0.353990 Jun 10 18:16:43.707692 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2494/5047] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:43 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1323 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:16:44.573000 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-da8c12e2-cfd2-40e9-9184-87c5994fa5a8 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:44.573628 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-da8c12e2-cfd2-40e9-9184-87c5994fa5a8 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: 140792ef-79c8-4a4d-b268-324caa480a9b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:44.582260 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-da8c12e2-cfd2-40e9-9184-87c5994fa5a8 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:44.582963 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-da8c12e2-cfd2-40e9-9184-87c5994fa5a8 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:44.583783 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-da8c12e2-cfd2-40e9-9184-87c5994fa5a8 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:44.584215 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-da8c12e2-cfd2-40e9-9184-87c5994fa5a8 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:44.721532 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6ebfd0ac-769b-4bb3-bc07-f7ece963c9af tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:44.722314 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6ebfd0ac-769b-4bb3-bc07-f7ece963c9af tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:44.731000 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6ebfd0ac-769b-4bb3-bc07-f7ece963c9af tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:44.731547 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6ebfd0ac-769b-4bb3-bc07-f7ece963c9af tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:44.732646 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6ebfd0ac-769b-4bb3-bc07-f7ece963c9af tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:44.733239 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6ebfd0ac-769b-4bb3-bc07-f7ece963c9af tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:44.903685 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-da8c12e2-cfd2-40e9-9184-87c5994fa5a8 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525621bc3c24269a872f95acf423ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cf003cd094fc694df09a09a245873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:44.916763 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6ebfd0ac-769b-4bb3-bc07-f7ece963c9af tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:44.918154 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-da8c12e2-cfd2-40e9-9184-87c5994fa5a8 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers/140792ef-79c8-4a4d-b268-324caa480a9b" status: 200 len: 1507 microversion: 2.1 time: 0.349159 Jun 10 18:16:44.926836 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6ebfd0ac-769b-4bb3-bc07-f7ece963c9af tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1518 microversion: 2.1 time: 0.209095 Jun 10 18:16:44.933087 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2554/5048] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:44 2022] GET /compute/v2.1/servers/140792ef-79c8-4a4d-b268-324caa480a9b => generated 1507 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:16:44.938718 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2495/5049] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:44 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1518 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:44.942062 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a117a19b-e4d2-42ce-8ff7-69ed724ef091 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:44.944080 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a117a19b-e4d2-42ce-8ff7-69ed724ef091 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: bc902e78-98fd-4c7b-8ff9-86d75c4bfaba] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:44.948507 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a25c9935-6c1f-4b8a-bdb4-4a93e45cf3fa tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:16:44.949608 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a25c9935-6c1f-4b8a-bdb4-4a93e45cf3fa tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:44.954227 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a117a19b-e4d2-42ce-8ff7-69ed724ef091 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:44.954794 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a117a19b-e4d2-42ce-8ff7-69ed724ef091 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:44.955587 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a117a19b-e4d2-42ce-8ff7-69ed724ef091 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:44.956373 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a117a19b-e4d2-42ce-8ff7-69ed724ef091 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:44.962919 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a25c9935-6c1f-4b8a-bdb4-4a93e45cf3fa tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:44.963359 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a25c9935-6c1f-4b8a-bdb4-4a93e45cf3fa tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:44.964146 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a25c9935-6c1f-4b8a-bdb4-4a93e45cf3fa tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:44.964622 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a25c9935-6c1f-4b8a-bdb4-4a93e45cf3fa tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:45.007540 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-a25c9935-6c1f-4b8a-bdb4-4a93e45cf3fa tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lazy-loading 'flavor' on Instance uuid 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:16:45.289152 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a117a19b-e4d2-42ce-8ff7-69ed724ef091 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525621bc3c24269a872f95acf423ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cf003cd094fc694df09a09a245873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:45.300330 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a117a19b-e4d2-42ce-8ff7-69ed724ef091 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers/bc902e78-98fd-4c7b-8ff9-86d75c4bfaba" status: 200 len: 1506 microversion: 2.1 time: 0.364957 Jun 10 18:16:45.302424 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2555/5050] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:44 2022] GET /compute/v2.1/servers/bc902e78-98fd-4c7b-8ff9-86d75c4bfaba => generated 1506 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:45.317854 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7e2b05be-ed6c-4846-8027-747817e596b9 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:45.318361 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7e2b05be-ed6c-4846-8027-747817e596b9 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: bc902e78-98fd-4c7b-8ff9-86d75c4bfaba] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:45.325426 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7e2b05be-ed6c-4846-8027-747817e596b9 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:45.326019 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7e2b05be-ed6c-4846-8027-747817e596b9 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:45.326943 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7e2b05be-ed6c-4846-8027-747817e596b9 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:45.327327 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7e2b05be-ed6c-4846-8027-747817e596b9 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:45.354707 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7e2b05be-ed6c-4846-8027-747817e596b9 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: bc902e78-98fd-4c7b-8ff9-86d75c4bfaba] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:16:45.429953 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a25c9935-6c1f-4b8a-bdb4-4a93e45cf3fa tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "POST /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8/action" status: 200 len: 32 microversion: 2.1 time: 0.489395 Jun 10 18:16:45.431719 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2496/5051] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:16:44 2022] POST /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8/action => generated 32 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 10 18:16:45.442227 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d45659f8-3c62-491b-816a-6538a1d6b00d tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:45.443286 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d45659f8-3c62-491b-816a-6538a1d6b00d tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:45.451614 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d45659f8-3c62-491b-816a-6538a1d6b00d tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:45.452210 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d45659f8-3c62-491b-816a-6538a1d6b00d tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:45.453131 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d45659f8-3c62-491b-816a-6538a1d6b00d tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:45.453826 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d45659f8-3c62-491b-816a-6538a1d6b00d tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:45.705424 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d45659f8-3c62-491b-816a-6538a1d6b00d tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:45.717697 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d45659f8-3c62-491b-816a-6538a1d6b00d tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1524 microversion: 2.1 time: 0.280094 Jun 10 18:16:45.719011 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2497/5052] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:45 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1524 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:45.799107 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7e2b05be-ed6c-4846-8027-747817e596b9 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "DELETE /compute/v2.1/servers/bc902e78-98fd-4c7b-8ff9-86d75c4bfaba" status: 204 len: 0 microversion: 2.1 time: 0.484885 Jun 10 18:16:45.804654 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2556/5053] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:16:45 2022] DELETE /compute/v2.1/servers/bc902e78-98fd-4c7b-8ff9-86d75c4bfaba => generated 0 bytes in 492 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 18:16:45.813761 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-41496e2a-5816-429b-bc49-2a6c5a9c52e0 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:45.814217 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-41496e2a-5816-429b-bc49-2a6c5a9c52e0 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: 140792ef-79c8-4a4d-b268-324caa480a9b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:45.822707 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41496e2a-5816-429b-bc49-2a6c5a9c52e0 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:45.823006 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41496e2a-5816-429b-bc49-2a6c5a9c52e0 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:45.833600 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41496e2a-5816-429b-bc49-2a6c5a9c52e0 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:45.834146 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41496e2a-5816-429b-bc49-2a6c5a9c52e0 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:45.885203 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-41496e2a-5816-429b-bc49-2a6c5a9c52e0 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: 140792ef-79c8-4a4d-b268-324caa480a9b] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:16:46.075357 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:16:46.287888 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:16:46.425717 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-41496e2a-5816-429b-bc49-2a6c5a9c52e0 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "DELETE /compute/v2.1/servers/140792ef-79c8-4a4d-b268-324caa480a9b" status: 204 len: 0 microversion: 2.1 time: 0.616122 Jun 10 18:16:46.429215 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2498/5054] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:16:45 2022] DELETE /compute/v2.1/servers/140792ef-79c8-4a4d-b268-324caa480a9b => generated 0 bytes in 621 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 18:16:46.658507 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-dde329cd-1afa-4bd2-ade1-5a61e1123498 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-649926066", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "e3b69e07-2f4e-447d-b1e5-3bd1ad7f0f2c"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:16:46.724355 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-dde329cd-1afa-4bd2-ade1-5a61e1123498 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] validate_networks() for [('e3b69e07-2f4e-447d-b1e5-3bd1ad7f0f2c', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:16:46.737679 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-32a64e17-d7ec-4c4f-845c-2c4cef6c051d tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:46.738480 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-32a64e17-d7ec-4c4f-845c-2c4cef6c051d tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:46.746827 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-32a64e17-d7ec-4c4f-845c-2c4cef6c051d tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:46.747324 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-32a64e17-d7ec-4c4f-845c-2c4cef6c051d tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:46.748285 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-32a64e17-d7ec-4c4f-845c-2c4cef6c051d tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:46.749087 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-32a64e17-d7ec-4c4f-845c-2c4cef6c051d tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:47.034931 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-32a64e17-d7ec-4c4f-845c-2c4cef6c051d tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:47.047358 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-32a64e17-d7ec-4c4f-845c-2c4cef6c051d tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1524 microversion: 2.1 time: 0.314610 Jun 10 18:16:47.048790 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2499/5055] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:46 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1524 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:16:47.960474 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-dde329cd-1afa-4bd2-ade1-5a61e1123498 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:16:47.960942 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-dde329cd-1afa-4bd2-ade1-5a61e1123498 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:16:47.964995 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-dde329cd-1afa-4bd2-ade1-5a61e1123498 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:16:47.964995 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-dde329cd-1afa-4bd2-ade1-5a61e1123498 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:16:47.964995 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-dde329cd-1afa-4bd2-ade1-5a61e1123498 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:16:47.977459 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dde329cd-1afa-4bd2-ade1-5a61e1123498 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:47.978673 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dde329cd-1afa-4bd2-ade1-5a61e1123498 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:47.979663 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dde329cd-1afa-4bd2-ade1-5a61e1123498 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:47.983044 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dde329cd-1afa-4bd2-ade1-5a61e1123498 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:48.005683 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-dde329cd-1afa-4bd2-ade1-5a61e1123498 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Getting quotas for project 521cf003cd094fc694df09a09a245873. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:16:48.029766 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-dde329cd-1afa-4bd2-ade1-5a61e1123498 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Getting quotas for user 5525621bc3c24269a872f95acf423ac3 and project 521cf003cd094fc694df09a09a245873. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:16:48.059682 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-dde329cd-1afa-4bd2-ade1-5a61e1123498 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Going to run 2 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:16:48.068498 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-171f81a1-06f1-4602-abe2-bcabc75c778f tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:48.070328 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-171f81a1-06f1-4602-abe2-bcabc75c778f tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:48.070463 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-dde329cd-1afa-4bd2-ade1-5a61e1123498 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: d5abbc99-8e30-4cf1-9fe2-89d9eb6753dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:16:48.093644 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-171f81a1-06f1-4602-abe2-bcabc75c778f tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:48.094103 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-171f81a1-06f1-4602-abe2-bcabc75c778f tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:48.100656 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-171f81a1-06f1-4602-abe2-bcabc75c778f tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:48.101359 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-171f81a1-06f1-4602-abe2-bcabc75c778f tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:48.245572 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-dde329cd-1afa-4bd2-ade1-5a61e1123498 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: d232ff14-3a4d-47c5-8f3e-3f909ec17c5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=d5abbc99-8e30-4cf1-9fe2-89d9eb6753dd,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:16:48.449195 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-dde329cd-1afa-4bd2-ade1-5a61e1123498 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.796085 Jun 10 18:16:48.453479 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2557/5056] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:16:46 2022] POST /compute/v2.1/servers => generated 32 bytes in 1801 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jun 10 18:16:48.460025 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0ae75415-c808-402d-9444-efeb313f77d8 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:48.465081 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0ae75415-c808-402d-9444-efeb313f77d8 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5525621bc3c24269a872f95acf423ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cf003cd094fc694df09a09a245873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:48.466138 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0ae75415-c808-402d-9444-efeb313f77d8 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Searching by: {'deleted': False, 'project_id': '521cf003cd094fc694df09a09a245873'} {{(pid=126594) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 18:16:48.490173 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0ae75415-c808-402d-9444-efeb313f77d8 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:48.490962 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0ae75415-c808-402d-9444-efeb313f77d8 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:48.492397 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0ae75415-c808-402d-9444-efeb313f77d8 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:48.494233 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0ae75415-c808-402d-9444-efeb313f77d8 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:48.566365 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.multi_cell_list [None req-0ae75415-c808-402d-9444-efeb313f77d8 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=126594) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 10 18:16:48.613452 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0ae75415-c808-402d-9444-efeb313f77d8 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers" status: 200 len: 1333 microversion: 2.1 time: 0.157687 Jun 10 18:16:48.614216 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2558/5057] 10.222.0.35 () {58 vars in 1124 bytes} [Fri Jun 10 18:16:48 2022] GET /compute/v2.1/servers => generated 1333 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:48.639282 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3b93a90c-dd84-4b19-a25d-d35745a29f18 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:48.642552 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3b93a90c-dd84-4b19-a25d-d35745a29f18 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: d232ff14-3a4d-47c5-8f3e-3f909ec17c5e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:48.750827 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3b93a90c-dd84-4b19-a25d-d35745a29f18 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525621bc3c24269a872f95acf423ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cf003cd094fc694df09a09a245873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:48.764490 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3b93a90c-dd84-4b19-a25d-d35745a29f18 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers/d232ff14-3a4d-47c5-8f3e-3f909ec17c5e" status: 200 len: 1217 microversion: 2.1 time: 0.139524 Jun 10 18:16:48.774719 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2559/5058] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:48 2022] GET /compute/v2.1/servers/d232ff14-3a4d-47c5-8f3e-3f909ec17c5e => generated 1217 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:48.785524 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-b54c1030-464b-4db7-a09e-e9a7ef7dc076 req-3b1f9d1c-6542-4874-9748-3febda700455 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc902e78-98fd-4c7b-8ff9-86d75c4bfaba", "name": "network-vif-deleted", "tag": "bcb0ee94-5986-450d-83a1-fff197a51be4"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:16:48.833975 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-b54c1030-464b-4db7-a09e-e9a7ef7dc076 req-3b1f9d1c-6542-4874-9748-3febda700455 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:48.833975 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-b54c1030-464b-4db7-a09e-e9a7ef7dc076 req-3b1f9d1c-6542-4874-9748-3febda700455 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:48.860029 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-b54c1030-464b-4db7-a09e-e9a7ef7dc076 req-3b1f9d1c-6542-4874-9748-3febda700455 service nova] Creating event network-vif-deleted:bcb0ee94-5986-450d-83a1-fff197a51be4 for instance bc902e78-98fd-4c7b-8ff9-86d75c4bfaba on chh1-master-2 Jun 10 18:16:48.898785 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-b54c1030-464b-4db7-a09e-e9a7ef7dc076 req-3b1f9d1c-6542-4874-9748-3febda700455 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124882 Jun 10 18:16:48.901813 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2560/5059] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:16:48.931884 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-171f81a1-06f1-4602-abe2-bcabc75c778f tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:48.953759 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-171f81a1-06f1-4602-abe2-bcabc75c778f tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1524 microversion: 2.1 time: 0.891325 Jun 10 18:16:48.957166 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2500/5060] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:48 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1524 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:16:49.790796 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a0e80267-ecdc-437a-9ff5-a4a04b1ebd82 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:49.796050 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a0e80267-ecdc-437a-9ff5-a4a04b1ebd82 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: d232ff14-3a4d-47c5-8f3e-3f909ec17c5e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:49.939975 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a0e80267-ecdc-437a-9ff5-a4a04b1ebd82 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525621bc3c24269a872f95acf423ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cf003cd094fc694df09a09a245873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:49.948720 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a0e80267-ecdc-437a-9ff5-a4a04b1ebd82 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers/d232ff14-3a4d-47c5-8f3e-3f909ec17c5e" status: 200 len: 1217 microversion: 2.1 time: 0.170540 Jun 10 18:16:49.949301 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2561/5061] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:49 2022] GET /compute/v2.1/servers/d232ff14-3a4d-47c5-8f3e-3f909ec17c5e => generated 1217 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:49.975684 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8c5d07ab-c998-49b5-a4ef-3a0fc11530d5 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:49.976414 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8c5d07ab-c998-49b5-a4ef-3a0fc11530d5 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:49.984248 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8c5d07ab-c998-49b5-a4ef-3a0fc11530d5 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:49.984764 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8c5d07ab-c998-49b5-a4ef-3a0fc11530d5 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:49.985654 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8c5d07ab-c998-49b5-a4ef-3a0fc11530d5 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:49.986071 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8c5d07ab-c998-49b5-a4ef-3a0fc11530d5 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:50.240881 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8c5d07ab-c998-49b5-a4ef-3a0fc11530d5 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:50.249543 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8c5d07ab-c998-49b5-a4ef-3a0fc11530d5 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1524 microversion: 2.1 time: 0.280887 Jun 10 18:16:50.250140 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2501/5062] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:49 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1524 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:50.942294 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-4437be69-e7c1-4513-804d-9f9d7558ae50 req-6be7109d-fc6b-4c80-aa5b-68d2cb2263c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "140792ef-79c8-4a4d-b268-324caa480a9b", "name": "network-vif-deleted", "tag": "546114d6-748a-4f18-b136-0daa7b66c8b9"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:16:50.954676 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-4437be69-e7c1-4513-804d-9f9d7558ae50 req-6be7109d-fc6b-4c80-aa5b-68d2cb2263c9 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:50.955304 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-4437be69-e7c1-4513-804d-9f9d7558ae50 req-6be7109d-fc6b-4c80-aa5b-68d2cb2263c9 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:50.969001 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-4437be69-e7c1-4513-804d-9f9d7558ae50 req-6be7109d-fc6b-4c80-aa5b-68d2cb2263c9 service nova] Creating event network-vif-deleted:546114d6-748a-4f18-b136-0daa7b66c8b9 for instance 140792ef-79c8-4a4d-b268-324caa480a9b on chh2-master-2 Jun 10 18:16:50.973925 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-def893b6-7e67-4183-97a6-a3206fb99a8e tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:50.974377 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-4437be69-e7c1-4513-804d-9f9d7558ae50 req-6be7109d-fc6b-4c80-aa5b-68d2cb2263c9 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036461 Jun 10 18:16:50.974614 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-def893b6-7e67-4183-97a6-a3206fb99a8e tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: d232ff14-3a4d-47c5-8f3e-3f909ec17c5e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:50.976530 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2562/5063] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:16:51.039636 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-def893b6-7e67-4183-97a6-a3206fb99a8e tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525621bc3c24269a872f95acf423ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cf003cd094fc694df09a09a245873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:51.048513 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-def893b6-7e67-4183-97a6-a3206fb99a8e tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers/d232ff14-3a4d-47c5-8f3e-3f909ec17c5e" status: 200 len: 1217 microversion: 2.1 time: 0.085011 Jun 10 18:16:51.049118 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2502/5064] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:50 2022] GET /compute/v2.1/servers/d232ff14-3a4d-47c5-8f3e-3f909ec17c5e => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:51.267292 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-618cd8df-e500-4ddb-8f07-d01a1e45fbfe tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:51.268016 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-618cd8df-e500-4ddb-8f07-d01a1e45fbfe tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:51.275153 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-618cd8df-e500-4ddb-8f07-d01a1e45fbfe tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:51.275612 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-618cd8df-e500-4ddb-8f07-d01a1e45fbfe tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:51.276644 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-618cd8df-e500-4ddb-8f07-d01a1e45fbfe tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:51.277243 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-618cd8df-e500-4ddb-8f07-d01a1e45fbfe tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:51.498169 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-618cd8df-e500-4ddb-8f07-d01a1e45fbfe tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:51.511481 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-618cd8df-e500-4ddb-8f07-d01a1e45fbfe tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1524 microversion: 2.1 time: 0.248939 Jun 10 18:16:51.512483 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2563/5065] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:51 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1524 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:52.065785 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-57a1a08d-9160-44bf-a7ee-fef7c148f3e5 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:52.067032 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-57a1a08d-9160-44bf-a7ee-fef7c148f3e5 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: d232ff14-3a4d-47c5-8f3e-3f909ec17c5e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:52.080145 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-57a1a08d-9160-44bf-a7ee-fef7c148f3e5 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:52.080635 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-57a1a08d-9160-44bf-a7ee-fef7c148f3e5 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:52.081599 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-57a1a08d-9160-44bf-a7ee-fef7c148f3e5 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:52.082219 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-57a1a08d-9160-44bf-a7ee-fef7c148f3e5 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:52.171171 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-57a1a08d-9160-44bf-a7ee-fef7c148f3e5 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525621bc3c24269a872f95acf423ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cf003cd094fc694df09a09a245873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:52.181587 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-57a1a08d-9160-44bf-a7ee-fef7c148f3e5 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers/d232ff14-3a4d-47c5-8f3e-3f909ec17c5e" status: 200 len: 1269 microversion: 2.1 time: 0.120026 Jun 10 18:16:52.183571 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2503/5066] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:52 2022] GET /compute/v2.1/servers/d232ff14-3a4d-47c5-8f3e-3f909ec17c5e => generated 1269 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:52.532781 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6ecf3354-c819-430b-9b3a-327321b326eb tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:52.535713 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6ecf3354-c819-430b-9b3a-327321b326eb tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:52.554659 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6ecf3354-c819-430b-9b3a-327321b326eb tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:52.558771 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6ecf3354-c819-430b-9b3a-327321b326eb tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:52.558771 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6ecf3354-c819-430b-9b3a-327321b326eb tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:52.558771 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6ecf3354-c819-430b-9b3a-327321b326eb tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:52.800605 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6ecf3354-c819-430b-9b3a-327321b326eb tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:52.815871 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6ecf3354-c819-430b-9b3a-327321b326eb tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1524 microversion: 2.1 time: 0.290955 Jun 10 18:16:52.822123 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2564/5067] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:52 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1524 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:53.199861 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-23a363d1-3487-473d-a2b7-398212a03e0e tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:53.200661 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-23a363d1-3487-473d-a2b7-398212a03e0e tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: d232ff14-3a4d-47c5-8f3e-3f909ec17c5e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:53.209231 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-23a363d1-3487-473d-a2b7-398212a03e0e tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:53.210004 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-23a363d1-3487-473d-a2b7-398212a03e0e tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:53.210902 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-23a363d1-3487-473d-a2b7-398212a03e0e tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:53.211531 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-23a363d1-3487-473d-a2b7-398212a03e0e tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:53.325352 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-23a363d1-3487-473d-a2b7-398212a03e0e tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525621bc3c24269a872f95acf423ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cf003cd094fc694df09a09a245873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:53.336057 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-23a363d1-3487-473d-a2b7-398212a03e0e tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers/d232ff14-3a4d-47c5-8f3e-3f909ec17c5e" status: 200 len: 1275 microversion: 2.1 time: 0.140292 Jun 10 18:16:53.336951 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2504/5068] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:53 2022] GET /compute/v2.1/servers/d232ff14-3a4d-47c5-8f3e-3f909ec17c5e => generated 1275 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:53.833938 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d1af2765-80e5-49ae-bb26-3384af0b3981 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:53.834675 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d1af2765-80e5-49ae-bb26-3384af0b3981 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:53.843325 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d1af2765-80e5-49ae-bb26-3384af0b3981 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:53.844129 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d1af2765-80e5-49ae-bb26-3384af0b3981 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:53.845537 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d1af2765-80e5-49ae-bb26-3384af0b3981 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:53.846230 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d1af2765-80e5-49ae-bb26-3384af0b3981 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:54.077489 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d1af2765-80e5-49ae-bb26-3384af0b3981 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:54.086674 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d1af2765-80e5-49ae-bb26-3384af0b3981 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1524 microversion: 2.1 time: 0.256589 Jun 10 18:16:54.090140 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2565/5069] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:53 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1524 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:54.363300 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-428c271b-7ed9-43f8-b544-62bd310b8c1f tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:54.363300 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-428c271b-7ed9-43f8-b544-62bd310b8c1f tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: d232ff14-3a4d-47c5-8f3e-3f909ec17c5e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:54.363300 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-428c271b-7ed9-43f8-b544-62bd310b8c1f tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:54.363300 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-428c271b-7ed9-43f8-b544-62bd310b8c1f tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:54.364027 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-428c271b-7ed9-43f8-b544-62bd310b8c1f tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:54.364543 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-428c271b-7ed9-43f8-b544-62bd310b8c1f tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:54.617600 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-428c271b-7ed9-43f8-b544-62bd310b8c1f tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525621bc3c24269a872f95acf423ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cf003cd094fc694df09a09a245873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:54.628039 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-428c271b-7ed9-43f8-b544-62bd310b8c1f tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers/d232ff14-3a4d-47c5-8f3e-3f909ec17c5e" status: 200 len: 1317 microversion: 2.1 time: 0.278643 Jun 10 18:16:54.629990 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2505/5070] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:54 2022] GET /compute/v2.1/servers/d232ff14-3a4d-47c5-8f3e-3f909ec17c5e => generated 1317 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:55.117447 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-2620d42a-7ab7-404c-95b3-91e4d5f04f80 req-edc356b6-a3a6-4f5d-a875-4af0287b0706 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5abbc99-8e30-4cf1-9fe2-89d9eb6753dd", "tag": "dedbba7d-fc0e-4f17-b053-adb7df18e450"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:16:55.120955 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-46b33104-5d45-44c2-a387-b7731d0b8c5e tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:55.121586 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-46b33104-5d45-44c2-a387-b7731d0b8c5e tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:55.141078 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-2620d42a-7ab7-404c-95b3-91e4d5f04f80 req-edc356b6-a3a6-4f5d-a875-4af0287b0706 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:55.143464 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-46b33104-5d45-44c2-a387-b7731d0b8c5e tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:55.143939 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-2620d42a-7ab7-404c-95b3-91e4d5f04f80 req-edc356b6-a3a6-4f5d-a875-4af0287b0706 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:55.145173 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-46b33104-5d45-44c2-a387-b7731d0b8c5e tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:55.146045 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-46b33104-5d45-44c2-a387-b7731d0b8c5e tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:55.146459 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-46b33104-5d45-44c2-a387-b7731d0b8c5e tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:55.176533 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-2620d42a-7ab7-404c-95b3-91e4d5f04f80 req-edc356b6-a3a6-4f5d-a875-4af0287b0706 service nova] Creating event network-changed:dedbba7d-fc0e-4f17-b053-adb7df18e450 for instance d5abbc99-8e30-4cf1-9fe2-89d9eb6753dd on chh2-master-2 Jun 10 18:16:55.184524 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-2620d42a-7ab7-404c-95b3-91e4d5f04f80 req-edc356b6-a3a6-4f5d-a875-4af0287b0706 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073560 Jun 10 18:16:55.185523 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2506/5071] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:16:55.417928 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-46b33104-5d45-44c2-a387-b7731d0b8c5e tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:55.433408 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-46b33104-5d45-44c2-a387-b7731d0b8c5e tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1524 microversion: 2.1 time: 0.332789 Jun 10 18:16:55.434572 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2566/5072] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:55 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1524 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:55.493596 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-70e36960-aebf-4bd6-8afa-db740ec73119 req-83b5a75c-a843-41cf-b9be-0452f28055e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d232ff14-3a4d-47c5-8f3e-3f909ec17c5e", "tag": "18fce613-9afd-4dc6-bf38-e2acf4633313"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:16:55.511149 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-70e36960-aebf-4bd6-8afa-db740ec73119 req-83b5a75c-a843-41cf-b9be-0452f28055e1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:55.511611 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-70e36960-aebf-4bd6-8afa-db740ec73119 req-83b5a75c-a843-41cf-b9be-0452f28055e1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:55.538242 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-70e36960-aebf-4bd6-8afa-db740ec73119 req-83b5a75c-a843-41cf-b9be-0452f28055e1 service nova] Creating event network-changed:18fce613-9afd-4dc6-bf38-e2acf4633313 for instance d232ff14-3a4d-47c5-8f3e-3f909ec17c5e on chh1-master-2 Jun 10 18:16:55.554629 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-70e36960-aebf-4bd6-8afa-db740ec73119 req-83b5a75c-a843-41cf-b9be-0452f28055e1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066091 Jun 10 18:16:55.555288 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2507/5073] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:16:55.648571 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-53443e88-6622-4b6a-a109-f3285c99dab5 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:55.649954 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-53443e88-6622-4b6a-a109-f3285c99dab5 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: d232ff14-3a4d-47c5-8f3e-3f909ec17c5e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:55.663941 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-53443e88-6622-4b6a-a109-f3285c99dab5 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:55.664523 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-53443e88-6622-4b6a-a109-f3285c99dab5 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:55.665422 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-53443e88-6622-4b6a-a109-f3285c99dab5 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:55.666741 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-53443e88-6622-4b6a-a109-f3285c99dab5 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:55.680520 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:16:56.254559 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-53443e88-6622-4b6a-a109-f3285c99dab5 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525621bc3c24269a872f95acf423ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cf003cd094fc694df09a09a245873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:56.269181 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-53443e88-6622-4b6a-a109-f3285c99dab5 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers/d232ff14-3a4d-47c5-8f3e-3f909ec17c5e" status: 200 len: 1317 microversion: 2.1 time: 0.625209 Jun 10 18:16:56.271684 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2567/5074] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:55 2022] GET /compute/v2.1/servers/d232ff14-3a4d-47c5-8f3e-3f909ec17c5e => generated 1317 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:56.452598 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-851ef53a-b06e-45a3-83fc-6bf9d4349c16 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:56.453703 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-851ef53a-b06e-45a3-83fc-6bf9d4349c16 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:56.461854 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-851ef53a-b06e-45a3-83fc-6bf9d4349c16 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:56.462305 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-851ef53a-b06e-45a3-83fc-6bf9d4349c16 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:56.463072 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-851ef53a-b06e-45a3-83fc-6bf9d4349c16 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:56.465976 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-851ef53a-b06e-45a3-83fc-6bf9d4349c16 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:56.862882 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-851ef53a-b06e-45a3-83fc-6bf9d4349c16 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:56.871316 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-851ef53a-b06e-45a3-83fc-6bf9d4349c16 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1524 microversion: 2.1 time: 0.423841 Jun 10 18:16:56.872024 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2508/5075] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:56 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1524 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:57.286355 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-910b4ad8-8f00-45b9-a568-07b5280fb83d tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:57.286971 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-910b4ad8-8f00-45b9-a568-07b5280fb83d tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: d232ff14-3a4d-47c5-8f3e-3f909ec17c5e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:57.294521 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-910b4ad8-8f00-45b9-a568-07b5280fb83d tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:57.294964 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-910b4ad8-8f00-45b9-a568-07b5280fb83d tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:57.295577 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-27afb018-534f-4b90-890e-6744405bcfbf tempest-PortsAdminExtendedAttrsTestJSON-1204585224 tempest-PortsAdminExtendedAttrsTestJSON-1204585224-project-admin] Calling method '.version_select at 0x7f77c00a6790>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:57.296417 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-910b4ad8-8f00-45b9-a568-07b5280fb83d tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:57.296559 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:16:57.296559 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 18:16:57.297206 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-910b4ad8-8f00-45b9-a568-07b5280fb83d tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:57.297729 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27afb018-534f-4b90-890e-6744405bcfbf tempest-PortsAdminExtendedAttrsTestJSON-1204585224 tempest-PortsAdminExtendedAttrsTestJSON-1204585224-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:57.298406 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27afb018-534f-4b90-890e-6744405bcfbf tempest-PortsAdminExtendedAttrsTestJSON-1204585224 tempest-PortsAdminExtendedAttrsTestJSON-1204585224-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:57.319256 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27afb018-534f-4b90-890e-6744405bcfbf tempest-PortsAdminExtendedAttrsTestJSON-1204585224 tempest-PortsAdminExtendedAttrsTestJSON-1204585224-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:57.319256 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27afb018-534f-4b90-890e-6744405bcfbf tempest-PortsAdminExtendedAttrsTestJSON-1204585224 tempest-PortsAdminExtendedAttrsTestJSON-1204585224-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:57.333031 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27afb018-534f-4b90-890e-6744405bcfbf tempest-PortsAdminExtendedAttrsTestJSON-1204585224 tempest-PortsAdminExtendedAttrsTestJSON-1204585224-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:57.333720 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27afb018-534f-4b90-890e-6744405bcfbf tempest-PortsAdminExtendedAttrsTestJSON-1204585224 tempest-PortsAdminExtendedAttrsTestJSON-1204585224-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:57.342624 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-27afb018-534f-4b90-890e-6744405bcfbf tempest-PortsAdminExtendedAttrsTestJSON-1204585224 tempest-PortsAdminExtendedAttrsTestJSON-1204585224-project-admin] 10.222.0.35 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.194045 Jun 10 18:16:57.348282 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2568/5076] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 18:16:57 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:16:57.450916 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-910b4ad8-8f00-45b9-a568-07b5280fb83d tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525621bc3c24269a872f95acf423ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cf003cd094fc694df09a09a245873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:57.458877 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-910b4ad8-8f00-45b9-a568-07b5280fb83d tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers/d232ff14-3a4d-47c5-8f3e-3f909ec17c5e" status: 200 len: 1317 microversion: 2.1 time: 0.176819 Jun 10 18:16:57.459514 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2509/5077] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:57 2022] GET /compute/v2.1/servers/d232ff14-3a4d-47c5-8f3e-3f909ec17c5e => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:16:57.888167 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b944692d-ed95-47f7-88da-7b8e7ff5f597 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:57.889243 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b944692d-ed95-47f7-88da-7b8e7ff5f597 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:57.895948 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b944692d-ed95-47f7-88da-7b8e7ff5f597 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:57.896521 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b944692d-ed95-47f7-88da-7b8e7ff5f597 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:57.897793 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b944692d-ed95-47f7-88da-7b8e7ff5f597 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:57.898514 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b944692d-ed95-47f7-88da-7b8e7ff5f597 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:58.037466 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b944692d-ed95-47f7-88da-7b8e7ff5f597 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:58.045835 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b944692d-ed95-47f7-88da-7b8e7ff5f597 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1524 microversion: 2.1 time: 0.161778 Jun 10 18:16:58.046595 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2569/5078] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:57 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1524 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:58.475808 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-748c1035-d252-4454-ab05-2c4c0cfb6b14 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:58.477146 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-748c1035-d252-4454-ab05-2c4c0cfb6b14 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: d232ff14-3a4d-47c5-8f3e-3f909ec17c5e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:58.485408 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-748c1035-d252-4454-ab05-2c4c0cfb6b14 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:58.490397 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-748c1035-d252-4454-ab05-2c4c0cfb6b14 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:58.490397 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-748c1035-d252-4454-ab05-2c4c0cfb6b14 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:58.490397 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-748c1035-d252-4454-ab05-2c4c0cfb6b14 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:58.625408 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-748c1035-d252-4454-ab05-2c4c0cfb6b14 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525621bc3c24269a872f95acf423ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cf003cd094fc694df09a09a245873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:58.633328 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-748c1035-d252-4454-ab05-2c4c0cfb6b14 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers/d232ff14-3a4d-47c5-8f3e-3f909ec17c5e" status: 200 len: 1317 microversion: 2.1 time: 0.161402 Jun 10 18:16:58.634118 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2510/5079] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:58 2022] GET /compute/v2.1/servers/d232ff14-3a4d-47c5-8f3e-3f909ec17c5e => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:59.062926 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-50fc4e9a-b7da-432d-b3fc-a5e2055f07a7 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:59.064073 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-50fc4e9a-b7da-432d-b3fc-a5e2055f07a7 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:59.071411 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=4 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:16:59.074566 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-50fc4e9a-b7da-432d-b3fc-a5e2055f07a7 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:59.075236 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-50fc4e9a-b7da-432d-b3fc-a5e2055f07a7 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:59.076033 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-50fc4e9a-b7da-432d-b3fc-a5e2055f07a7 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:59.076798 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-50fc4e9a-b7da-432d-b3fc-a5e2055f07a7 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:59.295197 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-50fc4e9a-b7da-432d-b3fc-a5e2055f07a7 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:59.302828 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-50fc4e9a-b7da-432d-b3fc-a5e2055f07a7 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1524 microversion: 2.1 time: 0.244063 Jun 10 18:16:59.304005 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2570/5080] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:59 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1524 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:16:59.652931 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e758dd69-3a63-4bcd-b589-bace0f464d11 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:16:59.654840 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e758dd69-3a63-4bcd-b589-bace0f464d11 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: d232ff14-3a4d-47c5-8f3e-3f909ec17c5e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:16:59.664280 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e758dd69-3a63-4bcd-b589-bace0f464d11 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:59.665023 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e758dd69-3a63-4bcd-b589-bace0f464d11 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:59.667034 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e758dd69-3a63-4bcd-b589-bace0f464d11 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:16:59.667767 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e758dd69-3a63-4bcd-b589-bace0f464d11 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:16:59.922339 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e758dd69-3a63-4bcd-b589-bace0f464d11 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525621bc3c24269a872f95acf423ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cf003cd094fc694df09a09a245873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:16:59.931617 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e758dd69-3a63-4bcd-b589-bace0f464d11 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers/d232ff14-3a4d-47c5-8f3e-3f909ec17c5e" status: 200 len: 1317 microversion: 2.1 time: 0.285168 Jun 10 18:16:59.936480 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2511/5081] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:16:59 2022] GET /compute/v2.1/servers/d232ff14-3a4d-47c5-8f3e-3f909ec17c5e => generated 1317 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:17:00.320531 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-14494506-d373-4fbe-a9b4-3fcf32ca7d64 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:00.321824 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-14494506-d373-4fbe-a9b4-3fcf32ca7d64 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:00.328136 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=10 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:17:00.334343 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-14494506-d373-4fbe-a9b4-3fcf32ca7d64 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:00.335360 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-14494506-d373-4fbe-a9b4-3fcf32ca7d64 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:00.337101 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-14494506-d373-4fbe-a9b4-3fcf32ca7d64 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:00.337839 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-14494506-d373-4fbe-a9b4-3fcf32ca7d64 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:00.644083 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-14494506-d373-4fbe-a9b4-3fcf32ca7d64 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:00.652822 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-14494506-d373-4fbe-a9b4-3fcf32ca7d64 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1524 microversion: 2.1 time: 0.335886 Jun 10 18:17:00.657397 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2571/5082] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:00 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1524 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:17:00.788222 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-83cb8eed-e4f2-4be0-8941-87a00acf6fdf tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:00.789584 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-83cb8eed-e4f2-4be0-8941-87a00acf6fdf tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:00.798476 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83cb8eed-e4f2-4be0-8941-87a00acf6fdf tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:00.798945 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83cb8eed-e4f2-4be0-8941-87a00acf6fdf tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:00.799738 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83cb8eed-e4f2-4be0-8941-87a00acf6fdf tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:00.802039 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83cb8eed-e4f2-4be0-8941-87a00acf6fdf tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:00.926574 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-83cb8eed-e4f2-4be0-8941-87a00acf6fdf tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lazy-loading 'services' on Instance uuid f0732433-a140-4237-9d7f-7dd24c7dbb79 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:17:00.950547 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cab3939c-fe0b-4db3-a803-b3d4ce47e639 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:00.951170 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cab3939c-fe0b-4db3-a803-b3d4ce47e639 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: d232ff14-3a4d-47c5-8f3e-3f909ec17c5e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:00.965251 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cab3939c-fe0b-4db3-a803-b3d4ce47e639 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:00.965758 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cab3939c-fe0b-4db3-a803-b3d4ce47e639 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:00.966815 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cab3939c-fe0b-4db3-a803-b3d4ce47e639 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:00.967258 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cab3939c-fe0b-4db3-a803-b3d4ce47e639 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:01.048550 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:17:01.192945 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cab3939c-fe0b-4db3-a803-b3d4ce47e639 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525621bc3c24269a872f95acf423ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cf003cd094fc694df09a09a245873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:01.210386 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cab3939c-fe0b-4db3-a803-b3d4ce47e639 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers/d232ff14-3a4d-47c5-8f3e-3f909ec17c5e" status: 200 len: 1317 microversion: 2.1 time: 0.262106 Jun 10 18:17:01.211609 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2572/5083] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:00 2022] GET /compute/v2.1/servers/d232ff14-3a4d-47c5-8f3e-3f909ec17c5e => generated 1317 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:17:01.303319 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-83cb8eed-e4f2-4be0-8941-87a00acf6fdf tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "DELETE /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79/os-volume_attachments/3c379ac9-637a-4642-8d39-94a97e5b6da8" status: 202 len: 0 microversion: 2.1 time: 0.519959 Jun 10 18:17:01.307790 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2512/5084] 10.222.0.35 () {58 vars in 1415 bytes} [Fri Jun 10 18:17:00 2022] DELETE /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79/os-volume_attachments/3c379ac9-637a-4642-8d39-94a97e5b6da8 => generated 0 bytes in 522 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:17:01.314518 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3f1cbac7-e419-4fe1-ab75-e83981132e00 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:01.315871 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3f1cbac7-e419-4fe1-ab75-e83981132e00 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:01.324142 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f1cbac7-e419-4fe1-ab75-e83981132e00 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:01.324991 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f1cbac7-e419-4fe1-ab75-e83981132e00 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:01.325787 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f1cbac7-e419-4fe1-ab75-e83981132e00 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:01.326509 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f1cbac7-e419-4fe1-ab75-e83981132e00 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:01.359147 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3f1cbac7-e419-4fe1-ab75-e83981132e00 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049086 Jun 10 18:17:01.359787 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2573/5085] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:17:01 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:17:01.672595 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-59ea0b65-9b92-4ed1-897b-478c2f2e02f4 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:01.673697 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-59ea0b65-9b92-4ed1-897b-478c2f2e02f4 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:01.680385 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-59ea0b65-9b92-4ed1-897b-478c2f2e02f4 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:01.680854 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-59ea0b65-9b92-4ed1-897b-478c2f2e02f4 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:01.681633 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-59ea0b65-9b92-4ed1-897b-478c2f2e02f4 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:01.682284 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-59ea0b65-9b92-4ed1-897b-478c2f2e02f4 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:01.868560 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-59ea0b65-9b92-4ed1-897b-478c2f2e02f4 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:01.879226 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-59ea0b65-9b92-4ed1-897b-478c2f2e02f4 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1524 microversion: 2.1 time: 0.211133 Jun 10 18:17:01.880155 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2513/5086] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:01 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1524 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:17:02.003497 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-5e3a7f3f-ea58-4c38-b31d-94ab692b08d6 req-9c673b19-42bf-42c3-ae6b-7c6a535007ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d232ff14-3a4d-47c5-8f3e-3f909ec17c5e", "name": "network-vif-plugged", "status": "completed", "tag": "18fce613-9afd-4dc6-bf38-e2acf4633313"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:17:02.023401 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-5e3a7f3f-ea58-4c38-b31d-94ab692b08d6 req-9c673b19-42bf-42c3-ae6b-7c6a535007ec service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:02.023861 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-5e3a7f3f-ea58-4c38-b31d-94ab692b08d6 req-9c673b19-42bf-42c3-ae6b-7c6a535007ec service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:02.036135 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-5e3a7f3f-ea58-4c38-b31d-94ab692b08d6 req-9c673b19-42bf-42c3-ae6b-7c6a535007ec service nova] Creating event network-vif-plugged:18fce613-9afd-4dc6-bf38-e2acf4633313 for instance d232ff14-3a4d-47c5-8f3e-3f909ec17c5e on chh1-master-2 Jun 10 18:17:02.042121 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-5e3a7f3f-ea58-4c38-b31d-94ab692b08d6 req-9c673b19-42bf-42c3-ae6b-7c6a535007ec service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043146 Jun 10 18:17:02.042935 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2574/5087] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:17:02.234750 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b3d458d9-577b-40c2-ac83-76eb91470629 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:02.235986 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b3d458d9-577b-40c2-ac83-76eb91470629 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: d232ff14-3a4d-47c5-8f3e-3f909ec17c5e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:02.245467 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b3d458d9-577b-40c2-ac83-76eb91470629 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:02.246281 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b3d458d9-577b-40c2-ac83-76eb91470629 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:02.247632 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b3d458d9-577b-40c2-ac83-76eb91470629 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:02.248582 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b3d458d9-577b-40c2-ac83-76eb91470629 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:02.375086 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d2a0939a-6e94-449d-a889-7bd6317b7c7b tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:02.399921 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d2a0939a-6e94-449d-a889-7bd6317b7c7b tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:02.427491 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d2a0939a-6e94-449d-a889-7bd6317b7c7b tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:02.427971 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d2a0939a-6e94-449d-a889-7bd6317b7c7b tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:02.428805 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d2a0939a-6e94-449d-a889-7bd6317b7c7b tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:02.429940 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d2a0939a-6e94-449d-a889-7bd6317b7c7b tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:02.458393 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b3d458d9-577b-40c2-ac83-76eb91470629 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525621bc3c24269a872f95acf423ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cf003cd094fc694df09a09a245873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:02.468636 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b3d458d9-577b-40c2-ac83-76eb91470629 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers/d232ff14-3a4d-47c5-8f3e-3f909ec17c5e" status: 200 len: 1317 microversion: 2.1 time: 0.238912 Jun 10 18:17:02.469875 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2514/5088] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:02 2022] GET /compute/v2.1/servers/d232ff14-3a4d-47c5-8f3e-3f909ec17c5e => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:17:02.556722 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d2a0939a-6e94-449d-a889-7bd6317b7c7b tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127224 Jun 10 18:17:02.556722 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2575/5089] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:17:02 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:17:02.897333 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-795fbbd7-d72e-46d8-b5b2-9f79356b15be tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:02.897929 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-795fbbd7-d72e-46d8-b5b2-9f79356b15be tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:02.906027 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-795fbbd7-d72e-46d8-b5b2-9f79356b15be tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:02.906767 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-795fbbd7-d72e-46d8-b5b2-9f79356b15be tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:02.907713 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-795fbbd7-d72e-46d8-b5b2-9f79356b15be tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:02.908324 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-795fbbd7-d72e-46d8-b5b2-9f79356b15be tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:03.159522 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-795fbbd7-d72e-46d8-b5b2-9f79356b15be tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:03.171694 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-795fbbd7-d72e-46d8-b5b2-9f79356b15be tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1524 microversion: 2.1 time: 0.277894 Jun 10 18:17:03.175511 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2515/5090] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:02 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1524 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:17:03.489521 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5cd3a2af-4e8d-4c86-8aea-4ed43c43bb06 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:03.496683 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5cd3a2af-4e8d-4c86-8aea-4ed43c43bb06 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: d232ff14-3a4d-47c5-8f3e-3f909ec17c5e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:03.506038 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5cd3a2af-4e8d-4c86-8aea-4ed43c43bb06 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:03.518628 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5cd3a2af-4e8d-4c86-8aea-4ed43c43bb06 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:03.518628 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5cd3a2af-4e8d-4c86-8aea-4ed43c43bb06 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:03.518628 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5cd3a2af-4e8d-4c86-8aea-4ed43c43bb06 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:03.564128 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ec689f7f-80c7-4ad2-87da-fa5bb9665e4e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:03.570048 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ec689f7f-80c7-4ad2-87da-fa5bb9665e4e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:03.583821 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ec689f7f-80c7-4ad2-87da-fa5bb9665e4e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:03.584978 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ec689f7f-80c7-4ad2-87da-fa5bb9665e4e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:03.588465 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ec689f7f-80c7-4ad2-87da-fa5bb9665e4e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:03.589102 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ec689f7f-80c7-4ad2-87da-fa5bb9665e4e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:03.652126 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:17:03.657658 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ec689f7f-80c7-4ad2-87da-fa5bb9665e4e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098500 Jun 10 18:17:03.662102 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2516/5091] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:17:03 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:17:03.796002 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5cd3a2af-4e8d-4c86-8aea-4ed43c43bb06 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525621bc3c24269a872f95acf423ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cf003cd094fc694df09a09a245873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:03.805822 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5cd3a2af-4e8d-4c86-8aea-4ed43c43bb06 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers/d232ff14-3a4d-47c5-8f3e-3f909ec17c5e" status: 200 len: 1317 microversion: 2.1 time: 0.319596 Jun 10 18:17:03.806427 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2576/5092] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:03 2022] GET /compute/v2.1/servers/d232ff14-3a4d-47c5-8f3e-3f909ec17c5e => generated 1317 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:17:04.060840 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-f74c4409-d5c7-49e3-9388-1022f1902158 req-3cde211f-6e86-4e46-8aea-fee674a12894 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5abbc99-8e30-4cf1-9fe2-89d9eb6753dd", "name": "network-vif-plugged", "status": "completed", "tag": "dedbba7d-fc0e-4f17-b053-adb7df18e450"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:17:04.079931 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-f74c4409-d5c7-49e3-9388-1022f1902158 req-3cde211f-6e86-4e46-8aea-fee674a12894 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:04.080417 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-f74c4409-d5c7-49e3-9388-1022f1902158 req-3cde211f-6e86-4e46-8aea-fee674a12894 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:04.107525 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-f74c4409-d5c7-49e3-9388-1022f1902158 req-3cde211f-6e86-4e46-8aea-fee674a12894 service nova] Creating event network-vif-plugged:dedbba7d-fc0e-4f17-b053-adb7df18e450 for instance d5abbc99-8e30-4cf1-9fe2-89d9eb6753dd on chh2-master-2 Jun 10 18:17:04.115211 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-f74c4409-d5c7-49e3-9388-1022f1902158 req-3cde211f-6e86-4e46-8aea-fee674a12894 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057939 Jun 10 18:17:04.121629 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2517/5093] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:17:04.198995 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d369839b-19be-4c94-b7c2-83ee3c1f7c32 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:04.201878 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d369839b-19be-4c94-b7c2-83ee3c1f7c32 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:04.230069 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d369839b-19be-4c94-b7c2-83ee3c1f7c32 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:04.230559 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d369839b-19be-4c94-b7c2-83ee3c1f7c32 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:04.231380 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d369839b-19be-4c94-b7c2-83ee3c1f7c32 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:04.234734 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d369839b-19be-4c94-b7c2-83ee3c1f7c32 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:04.603172 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d369839b-19be-4c94-b7c2-83ee3c1f7c32 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:04.616263 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d369839b-19be-4c94-b7c2-83ee3c1f7c32 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1524 microversion: 2.1 time: 0.429137 Jun 10 18:17:04.626004 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2577/5094] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:04 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1524 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:17:04.677752 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0bf4f4be-303c-47c5-9319-b9ec3cb3dc96 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:04.680456 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0bf4f4be-303c-47c5-9319-b9ec3cb3dc96 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:04.690376 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0bf4f4be-303c-47c5-9319-b9ec3cb3dc96 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:04.695035 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0bf4f4be-303c-47c5-9319-b9ec3cb3dc96 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:04.695035 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0bf4f4be-303c-47c5-9319-b9ec3cb3dc96 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:04.695035 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0bf4f4be-303c-47c5-9319-b9ec3cb3dc96 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:04.735796 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0bf4f4be-303c-47c5-9319-b9ec3cb3dc96 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068889 Jun 10 18:17:04.749584 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2518/5095] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:17:04 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:17:04.825438 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b58f2fc4-671d-4d24-afe3-35fd7b5acbb7 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:04.826848 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b58f2fc4-671d-4d24-afe3-35fd7b5acbb7 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: d232ff14-3a4d-47c5-8f3e-3f909ec17c5e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:04.839622 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b58f2fc4-671d-4d24-afe3-35fd7b5acbb7 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:04.840381 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b58f2fc4-671d-4d24-afe3-35fd7b5acbb7 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:04.841403 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b58f2fc4-671d-4d24-afe3-35fd7b5acbb7 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:04.843597 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b58f2fc4-671d-4d24-afe3-35fd7b5acbb7 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:05.047868 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b58f2fc4-671d-4d24-afe3-35fd7b5acbb7 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525621bc3c24269a872f95acf423ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cf003cd094fc694df09a09a245873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:05.061620 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b58f2fc4-671d-4d24-afe3-35fd7b5acbb7 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers/d232ff14-3a4d-47c5-8f3e-3f909ec17c5e" status: 200 len: 1504 microversion: 2.1 time: 0.242135 Jun 10 18:17:05.063384 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2578/5096] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:04 2022] GET /compute/v2.1/servers/d232ff14-3a4d-47c5-8f3e-3f909ec17c5e => generated 1504 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:17:05.079505 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d575fdc6-88f6-4290-afa6-34a30c7a60f5 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:05.080761 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d575fdc6-88f6-4290-afa6-34a30c7a60f5 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: d5abbc99-8e30-4cf1-9fe2-89d9eb6753dd] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:05.088109 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d575fdc6-88f6-4290-afa6-34a30c7a60f5 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:05.088792 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d575fdc6-88f6-4290-afa6-34a30c7a60f5 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:05.089742 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d575fdc6-88f6-4290-afa6-34a30c7a60f5 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:05.090346 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d575fdc6-88f6-4290-afa6-34a30c7a60f5 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:05.310172 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d575fdc6-88f6-4290-afa6-34a30c7a60f5 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525621bc3c24269a872f95acf423ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cf003cd094fc694df09a09a245873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:05.320035 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d575fdc6-88f6-4290-afa6-34a30c7a60f5 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers/d5abbc99-8e30-4cf1-9fe2-89d9eb6753dd" status: 200 len: 1317 microversion: 2.1 time: 0.244220 Jun 10 18:17:05.320906 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2519/5097] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:05 2022] GET /compute/v2.1/servers/d5abbc99-8e30-4cf1-9fe2-89d9eb6753dd => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:17:05.633432 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a866cc57-393d-4dc4-beb5-435af5f205dc tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:05.633988 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a866cc57-393d-4dc4-beb5-435af5f205dc tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:05.641571 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a866cc57-393d-4dc4-beb5-435af5f205dc tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:05.642114 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a866cc57-393d-4dc4-beb5-435af5f205dc tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:05.642902 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a866cc57-393d-4dc4-beb5-435af5f205dc tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:05.643348 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a866cc57-393d-4dc4-beb5-435af5f205dc tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:05.762763 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3071e913-8e40-41f9-841c-e8a7de6988da tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:05.762763 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3071e913-8e40-41f9-841c-e8a7de6988da tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:05.765555 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3071e913-8e40-41f9-841c-e8a7de6988da tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:05.766258 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3071e913-8e40-41f9-841c-e8a7de6988da tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:05.767714 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3071e913-8e40-41f9-841c-e8a7de6988da tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:05.768334 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3071e913-8e40-41f9-841c-e8a7de6988da tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:05.809234 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3071e913-8e40-41f9-841c-e8a7de6988da tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056866 Jun 10 18:17:05.814515 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2520/5098] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:17:05 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:17:05.868114 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a866cc57-393d-4dc4-beb5-435af5f205dc tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:05.880815 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a866cc57-393d-4dc4-beb5-435af5f205dc tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1524 microversion: 2.1 time: 0.251200 Jun 10 18:17:05.882028 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2579/5099] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:05 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1524 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:17:06.338552 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9f4cf166-77c4-4b75-a362-14cfc1d3cebc tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:06.339175 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9f4cf166-77c4-4b75-a362-14cfc1d3cebc tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: d5abbc99-8e30-4cf1-9fe2-89d9eb6753dd] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:06.354194 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f4cf166-77c4-4b75-a362-14cfc1d3cebc tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:06.354657 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f4cf166-77c4-4b75-a362-14cfc1d3cebc tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:06.355452 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f4cf166-77c4-4b75-a362-14cfc1d3cebc tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:06.355898 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f4cf166-77c4-4b75-a362-14cfc1d3cebc tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:06.593365 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9f4cf166-77c4-4b75-a362-14cfc1d3cebc tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525621bc3c24269a872f95acf423ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cf003cd094fc694df09a09a245873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:06.601264 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9f4cf166-77c4-4b75-a362-14cfc1d3cebc tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers/d5abbc99-8e30-4cf1-9fe2-89d9eb6753dd" status: 200 len: 1504 microversion: 2.1 time: 0.266736 Jun 10 18:17:06.602454 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2521/5100] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:06 2022] GET /compute/v2.1/servers/d5abbc99-8e30-4cf1-9fe2-89d9eb6753dd => generated 1504 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:17:06.626271 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e9e1c163-e2fe-4a63-884b-39588eb16c29 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:06.626996 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e9e1c163-e2fe-4a63-884b-39588eb16c29 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: d5abbc99-8e30-4cf1-9fe2-89d9eb6753dd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:06.634015 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e9e1c163-e2fe-4a63-884b-39588eb16c29 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:06.635268 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e9e1c163-e2fe-4a63-884b-39588eb16c29 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:06.636558 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e9e1c163-e2fe-4a63-884b-39588eb16c29 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:06.637174 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e9e1c163-e2fe-4a63-884b-39588eb16c29 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:06.669618 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e9e1c163-e2fe-4a63-884b-39588eb16c29 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: d5abbc99-8e30-4cf1-9fe2-89d9eb6753dd] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:17:06.823037 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c646e275-f340-482d-8c7b-df79c52de829 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:06.824586 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c646e275-f340-482d-8c7b-df79c52de829 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:06.832453 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c646e275-f340-482d-8c7b-df79c52de829 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:06.833304 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c646e275-f340-482d-8c7b-df79c52de829 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:06.834370 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c646e275-f340-482d-8c7b-df79c52de829 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:06.836217 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c646e275-f340-482d-8c7b-df79c52de829 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:06.886529 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c646e275-f340-482d-8c7b-df79c52de829 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068525 Jun 10 18:17:06.887459 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2522/5101] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:17:06 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:17:06.904005 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ca6ec2f6-dd21-4cdb-9d83-148a2e6e781e tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:06.905059 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ca6ec2f6-dd21-4cdb-9d83-148a2e6e781e tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:06.912422 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ca6ec2f6-dd21-4cdb-9d83-148a2e6e781e tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:06.913352 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ca6ec2f6-dd21-4cdb-9d83-148a2e6e781e tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:06.914770 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ca6ec2f6-dd21-4cdb-9d83-148a2e6e781e tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:06.915443 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ca6ec2f6-dd21-4cdb-9d83-148a2e6e781e tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:07.085623 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ca6ec2f6-dd21-4cdb-9d83-148a2e6e781e tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:07.110404 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ca6ec2f6-dd21-4cdb-9d83-148a2e6e781e tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1524 microversion: 2.1 time: 0.213106 Jun 10 18:17:07.111691 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2523/5102] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:06 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1524 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:17:07.167548 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e9e1c163-e2fe-4a63-884b-39588eb16c29 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "DELETE /compute/v2.1/servers/d5abbc99-8e30-4cf1-9fe2-89d9eb6753dd" status: 204 len: 0 microversion: 2.1 time: 0.544074 Jun 10 18:17:07.168633 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2580/5103] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:17:06 2022] DELETE /compute/v2.1/servers/d5abbc99-8e30-4cf1-9fe2-89d9eb6753dd => generated 0 bytes in 547 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:17:07.179304 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-faa57f68-eb96-4eef-8037-9212fc9580c0 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:07.180296 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-faa57f68-eb96-4eef-8037-9212fc9580c0 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: d232ff14-3a4d-47c5-8f3e-3f909ec17c5e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:07.204027 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-faa57f68-eb96-4eef-8037-9212fc9580c0 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:07.206974 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-faa57f68-eb96-4eef-8037-9212fc9580c0 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:07.208019 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-faa57f68-eb96-4eef-8037-9212fc9580c0 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:07.209980 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-faa57f68-eb96-4eef-8037-9212fc9580c0 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:07.283495 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-faa57f68-eb96-4eef-8037-9212fc9580c0 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: d232ff14-3a4d-47c5-8f3e-3f909ec17c5e] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:17:07.706721 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-faa57f68-eb96-4eef-8037-9212fc9580c0 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "DELETE /compute/v2.1/servers/d232ff14-3a4d-47c5-8f3e-3f909ec17c5e" status: 204 len: 0 microversion: 2.1 time: 0.533166 Jun 10 18:17:07.708794 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2524/5104] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:17:07 2022] DELETE /compute/v2.1/servers/d232ff14-3a4d-47c5-8f3e-3f909ec17c5e => generated 0 bytes in 536 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:17:07.718433 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c7f3e38d-dadb-4fd6-917c-20c4bc29ef14 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:07.720154 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c7f3e38d-dadb-4fd6-917c-20c4bc29ef14 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: d5abbc99-8e30-4cf1-9fe2-89d9eb6753dd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:07.730366 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c7f3e38d-dadb-4fd6-917c-20c4bc29ef14 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:07.731203 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c7f3e38d-dadb-4fd6-917c-20c4bc29ef14 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:07.732248 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c7f3e38d-dadb-4fd6-917c-20c4bc29ef14 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:07.732867 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c7f3e38d-dadb-4fd6-917c-20c4bc29ef14 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:07.899274 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2c44c687-928c-41f5-9333-96f436efd57d tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:07.900599 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2c44c687-928c-41f5-9333-96f436efd57d tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:07.907012 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c44c687-928c-41f5-9333-96f436efd57d tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:07.907952 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c44c687-928c-41f5-9333-96f436efd57d tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:07.908691 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c44c687-928c-41f5-9333-96f436efd57d tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:07.909332 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c44c687-928c-41f5-9333-96f436efd57d tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:07.945101 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2c44c687-928c-41f5-9333-96f436efd57d tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050321 Jun 10 18:17:07.946446 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2525/5105] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:17:07 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 10 18:17:07.958779 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c7f3e38d-dadb-4fd6-917c-20c4bc29ef14 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525621bc3c24269a872f95acf423ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cf003cd094fc694df09a09a245873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:07.972912 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c7f3e38d-dadb-4fd6-917c-20c4bc29ef14 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers/d5abbc99-8e30-4cf1-9fe2-89d9eb6753dd" status: 200 len: 1510 microversion: 2.1 time: 0.259338 Jun 10 18:17:07.973494 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2581/5106] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:07 2022] GET /compute/v2.1/servers/d5abbc99-8e30-4cf1-9fe2-89d9eb6753dd => generated 1510 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:17:08.034742 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b5b6e694-e93e-4a22-bb3a-3aeedef711af tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:17:08.035733 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b5b6e694-e93e-4a22-bb3a-3aeedef711af tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:08.042151 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5b6e694-e93e-4a22-bb3a-3aeedef711af tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:08.042605 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5b6e694-e93e-4a22-bb3a-3aeedef711af tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:08.043376 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5b6e694-e93e-4a22-bb3a-3aeedef711af tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:08.044054 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5b6e694-e93e-4a22-bb3a-3aeedef711af tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:08.074806 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-b5b6e694-e93e-4a22-bb3a-3aeedef711af tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] HTTP exception thrown: Cannot 'reboot' instance 3ffbc900-46ac-470d-9773-9b0118c6dbca while it is in vm_state rescued Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b5b6e694-e93e-4a22-bb3a-3aeedef711af tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Request method failure captured: Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca/action HTTP/1.1 Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 28 Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4mJVVxHNAdkChvziQm-6Dxnwt9XHWD1Xe5b1Hij0GEvfTbtqXkBFxRnvK3XB7O0DqEYSiSFM3wVQFcGEtNf0ziHJxG92MJ3ikztDB6TtOzEB2x0AYpNNaCzzkfUNZyHohCw21rjVL9kE9UGR_qvtvfAasaLdvNaa6Nct_8khdQAOeU Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 2f3f65ee123043bb9c888cc5adffce37 Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-779166786 Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/2f3f65ee123043bb9c888cc5adffce37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2f3f65ee123043bb9c888cc5adffce37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2f3f65ee123043bb9c888cc5adffce37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_2f3f65ee123043bb9c888cc5adffce37", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServerRescueNegativeTestJSON-779166786 Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 2f3f65ee123043bb9c888cc5adffce37 Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-779166786 Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServerRescueNegativeTestJSON-779166786-project Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 6aa40a915e4e43cd8d493dc593a73028 Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServerRescueNegativeTestJSON-779166786-project Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: {"reboot": {"type": "HARD"}} Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: exception: Cannot 'reboot' instance 3ffbc900-46ac-470d-9773-9b0118c6dbca while it is in vm_state rescued Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '3ffbc900-46ac-470d-9773-9b0118c6dbca', 'body': {'reboot': {'type': 'HARD'}}} Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3497, in reboot Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3ffbc900-46ac-470d-9773-9b0118c6dbca in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 10 18:17:08.076543 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 10 18:17:08.085186 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 3ffbc900-46ac-470d-9773-9b0118c6dbca while it is in vm_state rescued Jun 10 18:17:08.085186 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:17:08.085186 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:17:08.085186 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:17:08.085186 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:17:08.085186 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:17:08.085186 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:17:08.085186 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:17:08.085186 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:17:08.085186 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 3ffbc900-46ac-470d-9773-9b0118c6dbca while it is in vm_state rescued Jun 10 18:17:08.085186 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:17:08.085186 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b5b6e694-e93e-4a22-bb3a-3aeedef711af tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Returning 409 to user: Cannot 'reboot' instance 3ffbc900-46ac-470d-9773-9b0118c6dbca while it is in vm_state rescued {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:17:08.085186 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b5b6e694-e93e-4a22-bb3a-3aeedef711af tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "POST /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca/action" status: 409 len: 145 microversion: 2.1 time: 0.047864 Jun 10 18:17:08.085186 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2526/5107] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:17:08 2022] POST /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca/action => generated 145 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:17:08.092275 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1eaa182a-815c-46b0-b56e-60ac7b13b7a6 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:17:08.093977 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1eaa182a-815c-46b0-b56e-60ac7b13b7a6 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:08.096492 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:17:08.101710 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1eaa182a-815c-46b0-b56e-60ac7b13b7a6 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:08.102265 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1eaa182a-815c-46b0-b56e-60ac7b13b7a6 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:08.103048 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1eaa182a-815c-46b0-b56e-60ac7b13b7a6 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:08.103488 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1eaa182a-815c-46b0-b56e-60ac7b13b7a6 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:08.128180 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f037474b-926d-458e-8ebd-fabba30bb95f tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:08.128825 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f037474b-926d-458e-8ebd-fabba30bb95f tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:08.134424 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-1eaa182a-815c-46b0-b56e-60ac7b13b7a6 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] HTTP exception thrown: Cannot 'rebuild' instance 3ffbc900-46ac-470d-9773-9b0118c6dbca while it is in vm_state rescued Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1eaa182a-815c-46b0-b56e-60ac7b13b7a6 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Request method failure captured: Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca/action HTTP/1.1 Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 65 Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4mJVVxHNAdkChvziQm-6Dxnwt9XHWD1Xe5b1Hij0GEvfTbtqXkBFxRnvK3XB7O0DqEYSiSFM3wVQFcGEtNf0ziHJxG92MJ3ikztDB6TtOzEB2x0AYpNNaCzzkfUNZyHohCw21rjVL9kE9UGR_qvtvfAasaLdvNaa6Nct_8khdQAOeU Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 2f3f65ee123043bb9c888cc5adffce37 Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-779166786 Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/2f3f65ee123043bb9c888cc5adffce37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2f3f65ee123043bb9c888cc5adffce37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2f3f65ee123043bb9c888cc5adffce37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_2f3f65ee123043bb9c888cc5adffce37", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServerRescueNegativeTestJSON-779166786 Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 2f3f65ee123043bb9c888cc5adffce37 Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-779166786 Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServerRescueNegativeTestJSON-779166786-project Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 6aa40a915e4e43cd8d493dc593a73028 Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServerRescueNegativeTestJSON-779166786-project Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: {"rebuild": {"imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8"}} Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: exception: Cannot 'rebuild' instance 3ffbc900-46ac-470d-9773-9b0118c6dbca while it is in vm_state rescued Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '3ffbc900-46ac-470d-9773-9b0118c6dbca', 'body': {'rebuild': {'imageRef': 'efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8'}}} Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3ffbc900-46ac-470d-9773-9b0118c6dbca in vm_state rescued. Cannot rebuild while the instance is in this state. Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:17:08.138008 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:17:08.142023 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:17:08.142023 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jun 10 18:17:08.142023 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Jun 10 18:17:08.142023 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 10 18:17:08.142023 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 10 18:17:08.142023 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 10 18:17:08.142023 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 3ffbc900-46ac-470d-9773-9b0118c6dbca while it is in vm_state rescued Jun 10 18:17:08.142023 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:17:08.142023 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:17:08.142023 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:17:08.142023 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:17:08.142023 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:17:08.142023 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:17:08.142023 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:17:08.142023 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:17:08.142023 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 3ffbc900-46ac-470d-9773-9b0118c6dbca while it is in vm_state rescued Jun 10 18:17:08.142023 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:17:08.142023 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1eaa182a-815c-46b0-b56e-60ac7b13b7a6 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Returning 409 to user: Cannot 'rebuild' instance 3ffbc900-46ac-470d-9773-9b0118c6dbca while it is in vm_state rescued {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:17:08.143186 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f037474b-926d-458e-8ebd-fabba30bb95f tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:08.143186 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f037474b-926d-458e-8ebd-fabba30bb95f tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:08.143418 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1eaa182a-815c-46b0-b56e-60ac7b13b7a6 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "POST /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca/action" status: 409 len: 146 microversion: 2.1 time: 0.051945 Jun 10 18:17:08.143512 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f037474b-926d-458e-8ebd-fabba30bb95f tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:08.143597 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2582/5108] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:17:08 2022] POST /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca/action => generated 146 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:17:08.145288 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f037474b-926d-458e-8ebd-fabba30bb95f tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:08.153904 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7ef0be0e-b812-4205-a073-bec25576289d tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:08.153904 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7ef0be0e-b812-4205-a073-bec25576289d tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:08.161546 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ef0be0e-b812-4205-a073-bec25576289d tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:08.162214 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ef0be0e-b812-4205-a073-bec25576289d tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:08.163172 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ef0be0e-b812-4205-a073-bec25576289d tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:08.163774 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ef0be0e-b812-4205-a073-bec25576289d tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:08.193584 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:17:08.198633 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7ef0be0e-b812-4205-a073-bec25576289d tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:17:08.386528 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f037474b-926d-458e-8ebd-fabba30bb95f tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:08.399369 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f037474b-926d-458e-8ebd-fabba30bb95f tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1524 microversion: 2.1 time: 0.275815 Jun 10 18:17:08.399961 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2527/5109] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:08 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1524 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:17:08.552296 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7ef0be0e-b812-4205-a073-bec25576289d tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "DELETE /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 204 len: 0 microversion: 2.1 time: 0.405562 Jun 10 18:17:08.554949 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2583/5110] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:17:08 2022] DELETE /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 18:17:08.565186 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fd57fade-1ab1-420e-b7ae-4ffbffb3b81b tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:08.567539 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fd57fade-1ab1-420e-b7ae-4ffbffb3b81b tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:08.577526 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd57fade-1ab1-420e-b7ae-4ffbffb3b81b tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:08.578078 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd57fade-1ab1-420e-b7ae-4ffbffb3b81b tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:08.578981 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd57fade-1ab1-420e-b7ae-4ffbffb3b81b tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:08.579651 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd57fade-1ab1-420e-b7ae-4ffbffb3b81b tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:08.722491 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fd57fade-1ab1-420e-b7ae-4ffbffb3b81b tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:08.731212 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fd57fade-1ab1-420e-b7ae-4ffbffb3b81b tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1685 microversion: 2.1 time: 0.172080 Jun 10 18:17:08.731798 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2528/5111] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:08 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1685 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:17:08.994510 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-27508c72-57e4-4627-a539-28ca511f8b46 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:08.999168 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-27508c72-57e4-4627-a539-28ca511f8b46 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: d5abbc99-8e30-4cf1-9fe2-89d9eb6753dd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:09.010127 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27508c72-57e4-4627-a539-28ca511f8b46 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:09.015733 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27508c72-57e4-4627-a539-28ca511f8b46 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:09.026512 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27508c72-57e4-4627-a539-28ca511f8b46 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:09.026512 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27508c72-57e4-4627-a539-28ca511f8b46 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:09.210001 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-27508c72-57e4-4627-a539-28ca511f8b46 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525621bc3c24269a872f95acf423ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cf003cd094fc694df09a09a245873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:09.216673 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-27508c72-57e4-4627-a539-28ca511f8b46 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers/d5abbc99-8e30-4cf1-9fe2-89d9eb6753dd" status: 200 len: 1510 microversion: 2.1 time: 0.229232 Jun 10 18:17:09.217248 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2584/5112] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:08 2022] GET /compute/v2.1/servers/d5abbc99-8e30-4cf1-9fe2-89d9eb6753dd => generated 1510 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:17:09.322651 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-e93aa4ba-4d9e-426b-9e90-45e2c0479928 req-3a27bc6f-979e-463b-a072-7f5369b41788 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5abbc99-8e30-4cf1-9fe2-89d9eb6753dd", "name": "network-vif-deleted", "tag": "dedbba7d-fc0e-4f17-b053-adb7df18e450"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:17:09.331660 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-e93aa4ba-4d9e-426b-9e90-45e2c0479928 req-3a27bc6f-979e-463b-a072-7f5369b41788 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:09.332107 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-e93aa4ba-4d9e-426b-9e90-45e2c0479928 req-3a27bc6f-979e-463b-a072-7f5369b41788 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:09.343622 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-e93aa4ba-4d9e-426b-9e90-45e2c0479928 req-3a27bc6f-979e-463b-a072-7f5369b41788 service nova] Creating event network-vif-deleted:dedbba7d-fc0e-4f17-b053-adb7df18e450 for instance d5abbc99-8e30-4cf1-9fe2-89d9eb6753dd on chh2-master-2 Jun 10 18:17:09.350275 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-e93aa4ba-4d9e-426b-9e90-45e2c0479928 req-3a27bc6f-979e-463b-a072-7f5369b41788 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031556 Jun 10 18:17:09.351089 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2529/5113] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:17:09.383555 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b58bb174-7489-4c6c-9535-21bedd306efe tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:09.384476 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b58bb174-7489-4c6c-9535-21bedd306efe tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:09.390829 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b58bb174-7489-4c6c-9535-21bedd306efe tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:09.391538 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b58bb174-7489-4c6c-9535-21bedd306efe tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:09.392584 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b58bb174-7489-4c6c-9535-21bedd306efe tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:09.393009 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b58bb174-7489-4c6c-9535-21bedd306efe tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:09.416129 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dd2fbb16-c85e-4428-bfd6-c3052a7c5de2 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:09.416879 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dd2fbb16-c85e-4428-bfd6-c3052a7c5de2 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:09.427318 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd2fbb16-c85e-4428-bfd6-c3052a7c5de2 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:09.427902 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd2fbb16-c85e-4428-bfd6-c3052a7c5de2 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:09.428846 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd2fbb16-c85e-4428-bfd6-c3052a7c5de2 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:09.431270 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd2fbb16-c85e-4428-bfd6-c3052a7c5de2 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:09.663849 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-dd2fbb16-c85e-4428-bfd6-c3052a7c5de2 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:09.680991 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dd2fbb16-c85e-4428-bfd6-c3052a7c5de2 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1524 microversion: 2.1 time: 0.269160 Jun 10 18:17:09.681585 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2530/5114] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:09 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1524 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:17:09.749280 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-62ae0100-15d5-4432-b97e-14797844ca05 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:09.749864 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b58bb174-7489-4c6c-9535-21bedd306efe tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:09.750043 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-62ae0100-15d5-4432-b97e-14797844ca05 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:09.756273 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-62ae0100-15d5-4432-b97e-14797844ca05 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:09.756846 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-62ae0100-15d5-4432-b97e-14797844ca05 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:09.757921 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-62ae0100-15d5-4432-b97e-14797844ca05 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:09.758369 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-62ae0100-15d5-4432-b97e-14797844ca05 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:09.770815 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b58bb174-7489-4c6c-9535-21bedd306efe tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:09.772720 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b58bb174-7489-4c6c-9535-21bedd306efe tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:09.774034 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b58bb174-7489-4c6c-9535-21bedd306efe tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 2950 microversion: 2.42 time: 0.395496 Jun 10 18:17:09.775680 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2585/5115] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:17:09 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 2950 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:17:09.802749 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-031ac2d8-519f-4f66-a8d5-f33726488758 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:09.803579 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-031ac2d8-519f-4f66-a8d5-f33726488758 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:09.821372 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-031ac2d8-519f-4f66-a8d5-f33726488758 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:09.822130 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-031ac2d8-519f-4f66-a8d5-f33726488758 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:09.823569 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-031ac2d8-519f-4f66-a8d5-f33726488758 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:09.824047 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-031ac2d8-519f-4f66-a8d5-f33726488758 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:09.920019 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-62ae0100-15d5-4432-b97e-14797844ca05 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:09.928163 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-62ae0100-15d5-4432-b97e-14797844ca05 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1685 microversion: 2.1 time: 0.182967 Jun 10 18:17:09.930340 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2531/5116] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:09 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1685 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:17:09.955175 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-031ac2d8-519f-4f66-a8d5-f33726488758 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.157682 Jun 10 18:17:09.955816 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2586/5117] 10.222.0.35 () {60 vars in 1315 bytes} [Fri Jun 10 18:17:09 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3/os-interface => generated 1831 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:17:10.234018 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1e76cded-a8f2-4a81-b7d0-426583a91734 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:10.243465 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1e76cded-a8f2-4a81-b7d0-426583a91734 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: d5abbc99-8e30-4cf1-9fe2-89d9eb6753dd] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:10.243465 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1e76cded-a8f2-4a81-b7d0-426583a91734 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:10.243465 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1e76cded-a8f2-4a81-b7d0-426583a91734 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:10.243465 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1e76cded-a8f2-4a81-b7d0-426583a91734 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:10.243465 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1e76cded-a8f2-4a81-b7d0-426583a91734 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:10.274478 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1e76cded-a8f2-4a81-b7d0-426583a91734 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:10.274851 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1e76cded-a8f2-4a81-b7d0-426583a91734 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:10.275293 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-1e76cded-a8f2-4a81-b7d0-426583a91734 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lazy-loading 'fault' on Instance uuid d5abbc99-8e30-4cf1-9fe2-89d9eb6753dd {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:17:10.317566 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1e76cded-a8f2-4a81-b7d0-426583a91734 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525621bc3c24269a872f95acf423ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cf003cd094fc694df09a09a245873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:10.326720 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1e76cded-a8f2-4a81-b7d0-426583a91734 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers/d5abbc99-8e30-4cf1-9fe2-89d9eb6753dd" status: 200 len: 1307 microversion: 2.1 time: 0.096092 Jun 10 18:17:10.326720 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2532/5118] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:10 2022] GET /compute/v2.1/servers/d5abbc99-8e30-4cf1-9fe2-89d9eb6753dd => generated 1307 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:17:10.701411 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cb0b1ac8-e160-40f7-8940-94bd125531e0 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:10.702736 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cb0b1ac8-e160-40f7-8940-94bd125531e0 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:10.709966 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cb0b1ac8-e160-40f7-8940-94bd125531e0 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:10.710427 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cb0b1ac8-e160-40f7-8940-94bd125531e0 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:10.711882 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cb0b1ac8-e160-40f7-8940-94bd125531e0 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:10.712698 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cb0b1ac8-e160-40f7-8940-94bd125531e0 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:10.872626 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cb0b1ac8-e160-40f7-8940-94bd125531e0 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:10.880416 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cb0b1ac8-e160-40f7-8940-94bd125531e0 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1524 microversion: 2.1 time: 0.184961 Jun 10 18:17:10.880980 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2587/5119] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:10 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1524 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:17:10.946624 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-65c3095a-c263-47c9-ab47-aaff15e5d313 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:10.948065 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-65c3095a-c263-47c9-ab47-aaff15e5d313 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:10.955443 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-65c3095a-c263-47c9-ab47-aaff15e5d313 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:10.955918 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-65c3095a-c263-47c9-ab47-aaff15e5d313 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:10.956903 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-65c3095a-c263-47c9-ab47-aaff15e5d313 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:10.957350 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-65c3095a-c263-47c9-ab47-aaff15e5d313 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:10.960284 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:17:11.105364 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-65c3095a-c263-47c9-ab47-aaff15e5d313 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:11.114616 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-65c3095a-c263-47c9-ab47-aaff15e5d313 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1685 microversion: 2.1 time: 0.172008 Jun 10 18:17:11.115530 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2533/5120] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:10 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1685 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:17:11.354495 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6da6582e-3c29-4ec9-b205-c463985a4958 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:11.355123 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6da6582e-3c29-4ec9-b205-c463985a4958 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: d5abbc99-8e30-4cf1-9fe2-89d9eb6753dd] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:11.362914 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6da6582e-3c29-4ec9-b205-c463985a4958 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:11.367285 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6da6582e-3c29-4ec9-b205-c463985a4958 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:11.368229 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6da6582e-3c29-4ec9-b205-c463985a4958 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:11.369150 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6da6582e-3c29-4ec9-b205-c463985a4958 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:11.385094 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-6da6582e-3c29-4ec9-b205-c463985a4958 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] HTTP exception thrown: Instance d5abbc99-8e30-4cf1-9fe2-89d9eb6753dd could not be found. Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6da6582e-3c29-4ec9-b205-c463985a4958 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Request method failure captured: Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/d5abbc99-8e30-4cf1-9fe2-89d9eb6753dd HTTP/1.1 Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4pyfPpnWV67OEWcVFwiNfrvFM530mT9qlBF7xxVP0lw1yw-pwCK72_FDfafz_BJlpVQGgXv_n8y33URUetOn8443wOHlxP3fpPiZMOtV5tGKaKISrOdcXFXTQI9YDLTkXwW8zTZjX-h2RkeJK43lOvTQM0S3JeIrukRgQ1YyK6Fdds Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 521cf003cd094fc694df09a09a245873 Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-MultipleCreateTestJSON-724487644 Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/521cf003cd094fc694df09a09a245873"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/521cf003cd094fc694df09a09a245873"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/521cf003cd094fc694df09a09a245873"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_521cf003cd094fc694df09a09a245873", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-MultipleCreateTestJSON-724487644 Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 521cf003cd094fc694df09a09a245873 Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-MultipleCreateTestJSON-724487644 Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-MultipleCreateTestJSON-724487644-project Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 5525621bc3c24269a872f95acf423ac3 Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-MultipleCreateTestJSON-724487644-project Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: exception: Instance d5abbc99-8e30-4cf1-9fe2-89d9eb6753dd could not be found. Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'd5abbc99-8e30-4cf1-9fe2-89d9eb6753dd'} Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5abbc99-8e30-4cf1-9fe2-89d9eb6753dd could not be found. Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5abbc99-8e30-4cf1-9fe2-89d9eb6753dd could not be found. Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:17:11.387138 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:17:11.398106 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:17:11.398106 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:17:11.398106 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:17:11.398106 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:17:11.398106 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:17:11.398106 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5abbc99-8e30-4cf1-9fe2-89d9eb6753dd could not be found. Jun 10 18:17:11.398106 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:17:11.398106 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6da6582e-3c29-4ec9-b205-c463985a4958 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Returning 404 to user: Instance d5abbc99-8e30-4cf1-9fe2-89d9eb6753dd could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:17:11.398106 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6da6582e-3c29-4ec9-b205-c463985a4958 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers/d5abbc99-8e30-4cf1-9fe2-89d9eb6753dd" status: 404 len: 111 microversion: 2.1 time: 0.048705 Jun 10 18:17:11.398106 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2588/5121] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:11 2022] GET /compute/v2.1/servers/d5abbc99-8e30-4cf1-9fe2-89d9eb6753dd => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:17:11.406176 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7e9b16ae-d16a-4866-b7aa-8d5ca01ce937 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:11.406838 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7e9b16ae-d16a-4866-b7aa-8d5ca01ce937 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: d232ff14-3a4d-47c5-8f3e-3f909ec17c5e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:11.414319 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e9b16ae-d16a-4866-b7aa-8d5ca01ce937 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:11.414857 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e9b16ae-d16a-4866-b7aa-8d5ca01ce937 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:11.415777 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e9b16ae-d16a-4866-b7aa-8d5ca01ce937 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:11.416285 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e9b16ae-d16a-4866-b7aa-8d5ca01ce937 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:11.556189 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7e9b16ae-d16a-4866-b7aa-8d5ca01ce937 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525621bc3c24269a872f95acf423ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cf003cd094fc694df09a09a245873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:11.564278 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7e9b16ae-d16a-4866-b7aa-8d5ca01ce937 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers/d232ff14-3a4d-47c5-8f3e-3f909ec17c5e" status: 200 len: 1510 microversion: 2.1 time: 0.168118 Jun 10 18:17:11.570721 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2534/5122] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:11 2022] GET /compute/v2.1/servers/d232ff14-3a4d-47c5-8f3e-3f909ec17c5e => generated 1510 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:17:11.906216 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-eb342063-50df-4b32-bb1e-db41b3c76ab6 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:11.907160 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-eb342063-50df-4b32-bb1e-db41b3c76ab6 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:11.914901 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eb342063-50df-4b32-bb1e-db41b3c76ab6 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:11.915354 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eb342063-50df-4b32-bb1e-db41b3c76ab6 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:11.916134 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eb342063-50df-4b32-bb1e-db41b3c76ab6 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:11.916619 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eb342063-50df-4b32-bb1e-db41b3c76ab6 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:12.059445 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-eb342063-50df-4b32-bb1e-db41b3c76ab6 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:12.069827 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-eb342063-50df-4b32-bb1e-db41b3c76ab6 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1524 microversion: 2.1 time: 0.167970 Jun 10 18:17:12.070957 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2589/5123] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:11 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1524 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:17:12.133618 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-11fb2560-ddcc-4e79-99e5-85a27aaa06f8 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:12.134317 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-11fb2560-ddcc-4e79-99e5-85a27aaa06f8 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:12.151112 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-11fb2560-ddcc-4e79-99e5-85a27aaa06f8 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:12.151583 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-11fb2560-ddcc-4e79-99e5-85a27aaa06f8 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:12.152480 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-11fb2560-ddcc-4e79-99e5-85a27aaa06f8 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:12.153836 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-11fb2560-ddcc-4e79-99e5-85a27aaa06f8 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:12.504732 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-11fb2560-ddcc-4e79-99e5-85a27aaa06f8 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:12.513968 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-11fb2560-ddcc-4e79-99e5-85a27aaa06f8 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1685 microversion: 2.1 time: 0.385196 Jun 10 18:17:12.535210 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2535/5124] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:12 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1685 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:17:12.583694 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-39c4ebcb-542b-41a6-bb9f-e2a6c73672f4 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:12.584378 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-39c4ebcb-542b-41a6-bb9f-e2a6c73672f4 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: d232ff14-3a4d-47c5-8f3e-3f909ec17c5e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:12.592501 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-39c4ebcb-542b-41a6-bb9f-e2a6c73672f4 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:12.594162 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-39c4ebcb-542b-41a6-bb9f-e2a6c73672f4 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:12.594332 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-39c4ebcb-542b-41a6-bb9f-e2a6c73672f4 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:12.595330 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-39c4ebcb-542b-41a6-bb9f-e2a6c73672f4 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:12.888371 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-39c4ebcb-542b-41a6-bb9f-e2a6c73672f4 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525621bc3c24269a872f95acf423ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cf003cd094fc694df09a09a245873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:12.906293 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-39c4ebcb-542b-41a6-bb9f-e2a6c73672f4 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers/d232ff14-3a4d-47c5-8f3e-3f909ec17c5e" status: 200 len: 1510 microversion: 2.1 time: 0.327224 Jun 10 18:17:12.918412 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2590/5125] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:12 2022] GET /compute/v2.1/servers/d232ff14-3a4d-47c5-8f3e-3f909ec17c5e => generated 1510 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:17:13.002960 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-7925201d-2ecd-43ba-becc-003b2015b4b3 req-60404327-f0ec-4337-b463-1d7116edf4ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d232ff14-3a4d-47c5-8f3e-3f909ec17c5e", "name": "network-vif-deleted", "tag": "18fce613-9afd-4dc6-bf38-e2acf4633313"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:17:13.019608 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-7925201d-2ecd-43ba-becc-003b2015b4b3 req-60404327-f0ec-4337-b463-1d7116edf4ca service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:13.020065 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-7925201d-2ecd-43ba-becc-003b2015b4b3 req-60404327-f0ec-4337-b463-1d7116edf4ca service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:13.045039 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-7925201d-2ecd-43ba-becc-003b2015b4b3 req-60404327-f0ec-4337-b463-1d7116edf4ca service nova] Creating event network-vif-deleted:18fce613-9afd-4dc6-bf38-e2acf4633313 for instance d232ff14-3a4d-47c5-8f3e-3f909ec17c5e on chh1-master-2 Jun 10 18:17:13.051607 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-7925201d-2ecd-43ba-becc-003b2015b4b3 req-60404327-f0ec-4337-b463-1d7116edf4ca service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054259 Jun 10 18:17:13.052577 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2536/5126] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:17:13.087621 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6e46c5b1-acc0-4634-a514-274e4d16b6e1 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:13.088338 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6e46c5b1-acc0-4634-a514-274e4d16b6e1 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:13.101123 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6e46c5b1-acc0-4634-a514-274e4d16b6e1 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:13.102160 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6e46c5b1-acc0-4634-a514-274e4d16b6e1 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:13.102977 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6e46c5b1-acc0-4634-a514-274e4d16b6e1 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:13.103479 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6e46c5b1-acc0-4634-a514-274e4d16b6e1 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:13.319264 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6e46c5b1-acc0-4634-a514-274e4d16b6e1 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:13.331641 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6e46c5b1-acc0-4634-a514-274e4d16b6e1 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1524 microversion: 2.1 time: 0.246495 Jun 10 18:17:13.332912 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2591/5127] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:13 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1524 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:17:13.533268 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b42a963d-fbe8-449e-9184-f3606103ffaa tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:13.533980 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b42a963d-fbe8-449e-9184-f3606103ffaa tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:13.554868 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b42a963d-fbe8-449e-9184-f3606103ffaa tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:13.555527 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b42a963d-fbe8-449e-9184-f3606103ffaa tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:13.556338 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b42a963d-fbe8-449e-9184-f3606103ffaa tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:13.556943 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b42a963d-fbe8-449e-9184-f3606103ffaa tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:13.654692 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b42a963d-fbe8-449e-9184-f3606103ffaa tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:13.665719 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b42a963d-fbe8-449e-9184-f3606103ffaa tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1618 microversion: 2.1 time: 0.138068 Jun 10 18:17:13.667763 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2537/5128] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:13 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1618 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:17:13.931861 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-807c3dcb-0378-4ff4-998c-7ccb28b72a0c tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:13.932335 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-807c3dcb-0378-4ff4-998c-7ccb28b72a0c tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: d232ff14-3a4d-47c5-8f3e-3f909ec17c5e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:13.964965 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-807c3dcb-0378-4ff4-998c-7ccb28b72a0c tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:13.965440 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-807c3dcb-0378-4ff4-998c-7ccb28b72a0c tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:13.969313 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-807c3dcb-0378-4ff4-998c-7ccb28b72a0c tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:13.969313 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-807c3dcb-0378-4ff4-998c-7ccb28b72a0c tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:14.038089 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-807c3dcb-0378-4ff4-998c-7ccb28b72a0c tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:14.038606 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-807c3dcb-0378-4ff4-998c-7ccb28b72a0c tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:14.039310 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-807c3dcb-0378-4ff4-998c-7ccb28b72a0c tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lazy-loading 'fault' on Instance uuid d232ff14-3a4d-47c5-8f3e-3f909ec17c5e {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:17:14.085946 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-807c3dcb-0378-4ff4-998c-7ccb28b72a0c tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525621bc3c24269a872f95acf423ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521cf003cd094fc694df09a09a245873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:14.097551 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-807c3dcb-0378-4ff4-998c-7ccb28b72a0c tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers/d232ff14-3a4d-47c5-8f3e-3f909ec17c5e" status: 200 len: 1307 microversion: 2.1 time: 0.172941 Jun 10 18:17:14.098976 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2592/5129] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:13 2022] GET /compute/v2.1/servers/d232ff14-3a4d-47c5-8f3e-3f909ec17c5e => generated 1307 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:17:14.351754 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2d99d998-0aa6-4433-9425-997ff078907e tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:14.352436 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2d99d998-0aa6-4433-9425-997ff078907e tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:14.360358 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2d99d998-0aa6-4433-9425-997ff078907e tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:14.360885 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2d99d998-0aa6-4433-9425-997ff078907e tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:14.362027 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2d99d998-0aa6-4433-9425-997ff078907e tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:14.362662 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2d99d998-0aa6-4433-9425-997ff078907e tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:14.528176 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2d99d998-0aa6-4433-9425-997ff078907e tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:14.537042 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2d99d998-0aa6-4433-9425-997ff078907e tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1524 microversion: 2.1 time: 0.190747 Jun 10 18:17:14.537618 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2538/5130] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:14 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1524 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:17:14.683286 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f5b35098-3d8d-40b4-b606-d35944809803 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:14.688015 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f5b35098-3d8d-40b4-b606-d35944809803 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:14.691270 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f5b35098-3d8d-40b4-b606-d35944809803 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:14.691813 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f5b35098-3d8d-40b4-b606-d35944809803 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:14.692691 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f5b35098-3d8d-40b4-b606-d35944809803 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:14.693200 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f5b35098-3d8d-40b4-b606-d35944809803 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:14.728041 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f5b35098-3d8d-40b4-b606-d35944809803 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:14.728557 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f5b35098-3d8d-40b4-b606-d35944809803 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:14.729032 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-f5b35098-3d8d-40b4-b606-d35944809803 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lazy-loading 'fault' on Instance uuid f0732433-a140-4237-9d7f-7dd24c7dbb79 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:17:14.774559 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f5b35098-3d8d-40b4-b606-d35944809803 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:14.782540 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f5b35098-3d8d-40b4-b606-d35944809803 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 200 len: 1334 microversion: 2.1 time: 0.103230 Jun 10 18:17:14.783117 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2593/5131] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:14 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 1334 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:17:15.072186 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-115996f2-7662-47ed-8061-ac896b8be7bf req-ac9c8ab9-e5e2-4f79-8bfe-54aa2023f641 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0732433-a140-4237-9d7f-7dd24c7dbb79", "name": "network-vif-deleted", "tag": "f3cd9e4d-9709-4d83-9727-349dd9939d0e"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:17:15.081842 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-115996f2-7662-47ed-8061-ac896b8be7bf req-ac9c8ab9-e5e2-4f79-8bfe-54aa2023f641 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:15.082417 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-115996f2-7662-47ed-8061-ac896b8be7bf req-ac9c8ab9-e5e2-4f79-8bfe-54aa2023f641 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:15.096919 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-115996f2-7662-47ed-8061-ac896b8be7bf req-ac9c8ab9-e5e2-4f79-8bfe-54aa2023f641 service nova] Creating event network-vif-deleted:f3cd9e4d-9709-4d83-9727-349dd9939d0e for instance f0732433-a140-4237-9d7f-7dd24c7dbb79 on chh1-master-2 Jun 10 18:17:15.102047 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-115996f2-7662-47ed-8061-ac896b8be7bf req-ac9c8ab9-e5e2-4f79-8bfe-54aa2023f641 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035174 Jun 10 18:17:15.105258 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2539/5132] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:17:15.118068 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d1f52a85-84ca-45d0-b000-d0c9d390ade2 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:15.118691 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d1f52a85-84ca-45d0-b000-d0c9d390ade2 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] [instance: d232ff14-3a4d-47c5-8f3e-3f909ec17c5e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:15.128988 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d1f52a85-84ca-45d0-b000-d0c9d390ade2 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:15.128988 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d1f52a85-84ca-45d0-b000-d0c9d390ade2 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:15.129809 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d1f52a85-84ca-45d0-b000-d0c9d390ade2 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:15.130280 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d1f52a85-84ca-45d0-b000-d0c9d390ade2 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:15.149761 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-d1f52a85-84ca-45d0-b000-d0c9d390ade2 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] HTTP exception thrown: Instance d232ff14-3a4d-47c5-8f3e-3f909ec17c5e could not be found. Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d1f52a85-84ca-45d0-b000-d0c9d390ade2 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Request method failure captured: Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/d232ff14-3a4d-47c5-8f3e-3f909ec17c5e HTTP/1.1 Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4pyfPpnWV67OEWcVFwiNfrvFM530mT9qlBF7xxVP0lw1yw-pwCK72_FDfafz_BJlpVQGgXv_n8y33URUetOn8443wOHlxP3fpPiZMOtV5tGKaKISrOdcXFXTQI9YDLTkXwW8zTZjX-h2RkeJK43lOvTQM0S3JeIrukRgQ1YyK6Fdds Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 521cf003cd094fc694df09a09a245873 Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-MultipleCreateTestJSON-724487644 Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/521cf003cd094fc694df09a09a245873"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/521cf003cd094fc694df09a09a245873"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/521cf003cd094fc694df09a09a245873"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_521cf003cd094fc694df09a09a245873", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-MultipleCreateTestJSON-724487644 Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 521cf003cd094fc694df09a09a245873 Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-MultipleCreateTestJSON-724487644 Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-MultipleCreateTestJSON-724487644-project Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 5525621bc3c24269a872f95acf423ac3 Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-MultipleCreateTestJSON-724487644-project Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: exception: Instance d232ff14-3a4d-47c5-8f3e-3f909ec17c5e could not be found. Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'd232ff14-3a4d-47c5-8f3e-3f909ec17c5e'} Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d232ff14-3a4d-47c5-8f3e-3f909ec17c5e could not be found. Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d232ff14-3a4d-47c5-8f3e-3f909ec17c5e could not be found. Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:17:15.151896 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:17:15.159411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:17:15.159411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:17:15.159411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:17:15.159411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:17:15.159411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:17:15.159411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d232ff14-3a4d-47c5-8f3e-3f909ec17c5e could not be found. Jun 10 18:17:15.159411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:17:15.159411 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d1f52a85-84ca-45d0-b000-d0c9d390ade2 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] Returning 404 to user: Instance d232ff14-3a4d-47c5-8f3e-3f909ec17c5e could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:17:15.159411 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d1f52a85-84ca-45d0-b000-d0c9d390ade2 tempest-MultipleCreateTestJSON-724487644 tempest-MultipleCreateTestJSON-724487644-project] 10.222.0.35 "GET /compute/v2.1/servers/d232ff14-3a4d-47c5-8f3e-3f909ec17c5e" status: 404 len: 111 microversion: 2.1 time: 0.039589 Jun 10 18:17:15.159411 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2594/5133] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:15 2022] GET /compute/v2.1/servers/d232ff14-3a4d-47c5-8f3e-3f909ec17c5e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:17:15.572036 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bdd9ca1b-744f-43ff-af93-d12afd46b038 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:15.572036 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bdd9ca1b-744f-43ff-af93-d12afd46b038 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:15.572036 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bdd9ca1b-744f-43ff-af93-d12afd46b038 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:15.572036 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bdd9ca1b-744f-43ff-af93-d12afd46b038 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:15.572036 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bdd9ca1b-744f-43ff-af93-d12afd46b038 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:15.572036 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bdd9ca1b-744f-43ff-af93-d12afd46b038 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:15.785630 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bdd9ca1b-744f-43ff-af93-d12afd46b038 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:15.795823 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bdd9ca1b-744f-43ff-af93-d12afd46b038 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1524 microversion: 2.1 time: 0.243040 Jun 10 18:17:15.796715 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2540/5134] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:15 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1524 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:17:15.808980 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9116fc05-accf-426f-9f0e-368c34468eb5 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:15.809648 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9116fc05-accf-426f-9f0e-368c34468eb5 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: f0732433-a140-4237-9d7f-7dd24c7dbb79] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:15.817111 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9116fc05-accf-426f-9f0e-368c34468eb5 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:15.817781 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9116fc05-accf-426f-9f0e-368c34468eb5 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:15.818766 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9116fc05-accf-426f-9f0e-368c34468eb5 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:15.819214 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9116fc05-accf-426f-9f0e-368c34468eb5 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:15.834863 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-9116fc05-accf-426f-9f0e-368c34468eb5 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] HTTP exception thrown: Instance f0732433-a140-4237-9d7f-7dd24c7dbb79 could not be found. Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9116fc05-accf-426f-9f0e-368c34468eb5 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Request method failure captured: Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 HTTP/1.1 Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4mJVVxHNAdkChvziQm-6Dxnwt9XHWD1Xe5b1Hij0GEvfTbtqXkBFxRnvK3XB7O0DqEYSiSFM3wVQFcGEtNf0ziHJxG92MJ3ikztDB6TtOzEB2x0AYpNNaCzzkfUNZyHohCw21rjVL9kE9UGR_qvtvfAasaLdvNaa6Nct_8khdQAOeU Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 2f3f65ee123043bb9c888cc5adffce37 Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-779166786 Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/2f3f65ee123043bb9c888cc5adffce37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2f3f65ee123043bb9c888cc5adffce37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2f3f65ee123043bb9c888cc5adffce37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_2f3f65ee123043bb9c888cc5adffce37", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServerRescueNegativeTestJSON-779166786 Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 2f3f65ee123043bb9c888cc5adffce37 Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-779166786 Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServerRescueNegativeTestJSON-779166786-project Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 6aa40a915e4e43cd8d493dc593a73028 Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServerRescueNegativeTestJSON-779166786-project Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: exception: Instance f0732433-a140-4237-9d7f-7dd24c7dbb79 could not be found. Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'f0732433-a140-4237-9d7f-7dd24c7dbb79'} Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0732433-a140-4237-9d7f-7dd24c7dbb79 could not be found. Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0732433-a140-4237-9d7f-7dd24c7dbb79 could not be found. Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:17:15.836452 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:17:15.843630 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:17:15.843630 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:17:15.843630 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:17:15.843630 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:17:15.843630 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:17:15.843630 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0732433-a140-4237-9d7f-7dd24c7dbb79 could not be found. Jun 10 18:17:15.843630 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:17:15.843630 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9116fc05-accf-426f-9f0e-368c34468eb5 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Returning 404 to user: Instance f0732433-a140-4237-9d7f-7dd24c7dbb79 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:17:15.843630 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9116fc05-accf-426f-9f0e-368c34468eb5 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79" status: 404 len: 111 microversion: 2.1 time: 0.036282 Jun 10 18:17:15.843630 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2595/5135] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:15 2022] GET /compute/v2.1/servers/f0732433-a140-4237-9d7f-7dd24c7dbb79 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:17:15.847991 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ad000ed1-1836-44e0-bd4d-66af5d4a9df2 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '.version_select at 0x7f77c03b28b0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:15.956139 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ad000ed1-1836-44e0-bd4d-66af5d4a9df2 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-768287569" status: 202 len: 0 microversion: 2.1 time: 0.112943 Jun 10 18:17:15.958038 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2541/5136] 10.222.0.35 () {58 vars in 1217 bytes} [Fri Jun 10 18:17:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-768287569 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:17:16.821601 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-89a7737c-a634-4a74-aada-ecbfdc11b96b tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:16.822890 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-89a7737c-a634-4a74-aada-ecbfdc11b96b tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:16.833851 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-89a7737c-a634-4a74-aada-ecbfdc11b96b tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:16.834731 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-89a7737c-a634-4a74-aada-ecbfdc11b96b tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:16.835742 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-89a7737c-a634-4a74-aada-ecbfdc11b96b tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:16.836371 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-89a7737c-a634-4a74-aada-ecbfdc11b96b tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:17.281689 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-89a7737c-a634-4a74-aada-ecbfdc11b96b tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:17.290759 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-89a7737c-a634-4a74-aada-ecbfdc11b96b tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1524 microversion: 2.1 time: 0.479314 Jun 10 18:17:17.291400 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2596/5137] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:16 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1524 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:17:18.308150 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cba4a755-8975-48de-9d95-fc9c28132eb8 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:18.312388 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cba4a755-8975-48de-9d95-fc9c28132eb8 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:18.316689 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:17:18.327422 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cba4a755-8975-48de-9d95-fc9c28132eb8 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:18.328068 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cba4a755-8975-48de-9d95-fc9c28132eb8 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:18.328905 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cba4a755-8975-48de-9d95-fc9c28132eb8 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:18.329366 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cba4a755-8975-48de-9d95-fc9c28132eb8 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:18.561872 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cba4a755-8975-48de-9d95-fc9c28132eb8 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:18.575719 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cba4a755-8975-48de-9d95-fc9c28132eb8 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1524 microversion: 2.1 time: 0.272024 Jun 10 18:17:18.576405 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2542/5138] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:18 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1524 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:17:19.593889 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e833f779-2507-4e16-aee7-43187ab99cc4 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:19.595480 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e833f779-2507-4e16-aee7-43187ab99cc4 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:19.614013 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e833f779-2507-4e16-aee7-43187ab99cc4 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:19.621403 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e833f779-2507-4e16-aee7-43187ab99cc4 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:19.622556 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e833f779-2507-4e16-aee7-43187ab99cc4 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:19.623129 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e833f779-2507-4e16-aee7-43187ab99cc4 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:19.972014 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e833f779-2507-4e16-aee7-43187ab99cc4 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:19.984654 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e833f779-2507-4e16-aee7-43187ab99cc4 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1524 microversion: 2.1 time: 0.392258 Jun 10 18:17:19.984654 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2597/5139] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:19 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1524 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:17:20.998514 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7e5bc35d-78be-45be-a96b-b203ab9360f4 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:21.001332 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7e5bc35d-78be-45be-a96b-b203ab9360f4 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:21.009220 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e5bc35d-78be-45be-a96b-b203ab9360f4 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:21.009679 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e5bc35d-78be-45be-a96b-b203ab9360f4 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:21.010478 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e5bc35d-78be-45be-a96b-b203ab9360f4 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:21.017493 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e5bc35d-78be-45be-a96b-b203ab9360f4 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:21.215227 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7e5bc35d-78be-45be-a96b-b203ab9360f4 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:21.224259 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7e5bc35d-78be-45be-a96b-b203ab9360f4 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1504 microversion: 2.1 time: 0.229612 Jun 10 18:17:21.224972 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2543/5140] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:20 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1504 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:17:21.252124 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f056b6fe-25ed-4b10-bac5-90c694245a48 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Action: 'create', calling method: .version_select at 0x7f77c09cdaf0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1934243143", "description": "tempest-description-1748777167"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:17:21.972730 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f056b6fe-25ed-4b10-bac5-90c694245a48 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.730054 Jun 10 18:17:21.974395 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2598/5141] 10.222.0.35 () {60 vars in 1179 bytes} [Fri Jun 10 18:17:21 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:17:21.985883 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-39f99bbe-3b52-4b85-b376-eb8a86a9c47f tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1934243143"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:17:21.986437 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-39f99bbe-3b52-4b85-b376-eb8a86a9c47f tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:21.998185 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-39f99bbe-3b52-4b85-b376-eb8a86a9c47f tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:21.999013 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-39f99bbe-3b52-4b85-b376-eb8a86a9c47f tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:22.007606 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-39f99bbe-3b52-4b85-b376-eb8a86a9c47f tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:22.012359 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-39f99bbe-3b52-4b85-b376-eb8a86a9c47f tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:22.769088 chdv-master-2 devstack@n-api.service[126595]: INFO nova.network.security_group_api [None req-39f99bbe-3b52-4b85-b376-eb8a86a9c47f tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Adding security group c785e712-04cc-4ab7-b941-a24b7ba4dfcb to port 2ee7eb96-d569-4b56-80d8-7ca0fb5164f6 Jun 10 18:17:23.634219 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-39f99bbe-3b52-4b85-b376-eb8a86a9c47f tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "POST /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8/action" status: 202 len: 0 microversion: 2.1 time: 1.652962 Jun 10 18:17:23.635208 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2544/5142] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:17:21 2022] POST /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8/action => generated 0 bytes in 1655 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:17:23.644721 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3e10303b-ea0b-4d96-9983-c3a3adcba695 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1934243143"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:17:23.648159 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3e10303b-ea0b-4d96-9983-c3a3adcba695 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:23.653972 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-bf9e0ad1-80c2-4a46-9c45-998052fb4c09 req-c604908d-8371-4abd-9a4a-6806b59600dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8", "tag": "2ee7eb96-d569-4b56-80d8-7ca0fb5164f6"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:17:23.671870 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3e10303b-ea0b-4d96-9983-c3a3adcba695 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:23.672466 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3e10303b-ea0b-4d96-9983-c3a3adcba695 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:23.674637 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-bf9e0ad1-80c2-4a46-9c45-998052fb4c09 req-c604908d-8371-4abd-9a4a-6806b59600dc service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:23.675095 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-bf9e0ad1-80c2-4a46-9c45-998052fb4c09 req-c604908d-8371-4abd-9a4a-6806b59600dc service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:23.677962 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3e10303b-ea0b-4d96-9983-c3a3adcba695 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:23.678939 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3e10303b-ea0b-4d96-9983-c3a3adcba695 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:23.693977 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-bf9e0ad1-80c2-4a46-9c45-998052fb4c09 req-c604908d-8371-4abd-9a4a-6806b59600dc service nova] Creating event network-changed:2ee7eb96-d569-4b56-80d8-7ca0fb5164f6 for instance 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 on chh1-master-2 Jun 10 18:17:23.705414 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-bf9e0ad1-80c2-4a46-9c45-998052fb4c09 req-c604908d-8371-4abd-9a4a-6806b59600dc service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054463 Jun 10 18:17:23.705848 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2545/5143] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:17:24.119024 chdv-master-2 devstack@n-api.service[126594]: INFO nova.network.security_group_api [None req-3e10303b-ea0b-4d96-9983-c3a3adcba695 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Removing security group c785e712-04cc-4ab7-b941-a24b7ba4dfcb from port 2ee7eb96-d569-4b56-80d8-7ca0fb5164f6 Jun 10 18:17:24.863608 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3e10303b-ea0b-4d96-9983-c3a3adcba695 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "POST /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8/action" status: 202 len: 0 microversion: 2.1 time: 1.224448 Jun 10 18:17:24.864279 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2599/5144] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:17:23 2022] POST /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8/action => generated 0 bytes in 1226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:17:24.876258 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-126f90b8-bb78-4348-bb92-6ca193528eef tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Action: 'create', calling method: .version_select at 0x7f77b3eedaf0>, body: {"pool": null} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:17:24.900019 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-912902cb-1c6a-4b7d-b096-4ff41664efe0 req-d04a7a19-fb39-451c-96c1-80257f777b93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8", "tag": "2ee7eb96-d569-4b56-80d8-7ca0fb5164f6"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:17:24.920516 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-912902cb-1c6a-4b7d-b096-4ff41664efe0 req-d04a7a19-fb39-451c-96c1-80257f777b93 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:24.926657 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-912902cb-1c6a-4b7d-b096-4ff41664efe0 req-d04a7a19-fb39-451c-96c1-80257f777b93 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:24.940965 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-912902cb-1c6a-4b7d-b096-4ff41664efe0 req-d04a7a19-fb39-451c-96c1-80257f777b93 service nova] Creating event network-changed:2ee7eb96-d569-4b56-80d8-7ca0fb5164f6 for instance 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 on chh1-master-2 Jun 10 18:17:24.947814 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-912902cb-1c6a-4b7d-b096-4ff41664efe0 req-d04a7a19-fb39-451c-96c1-80257f777b93 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060197 Jun 10 18:17:24.959044 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2600/5145] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:17:26.783522 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9944922b-dea3-43bc-aa5a-2a925e4db9f7 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:26.784108 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9944922b-dea3-43bc-aa5a-2a925e4db9f7 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:26.798607 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9944922b-dea3-43bc-aa5a-2a925e4db9f7 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:26.804250 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9944922b-dea3-43bc-aa5a-2a925e4db9f7 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:26.804250 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9944922b-dea3-43bc-aa5a-2a925e4db9f7 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:26.804250 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9944922b-dea3-43bc-aa5a-2a925e4db9f7 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:26.859908 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9944922b-dea3-43bc-aa5a-2a925e4db9f7 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:17:26.869418 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:17:27.286595 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9944922b-dea3-43bc-aa5a-2a925e4db9f7 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "DELETE /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca" status: 204 len: 0 microversion: 2.1 time: 0.507825 Jun 10 18:17:27.287246 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2601/5146] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:17:26 2022] DELETE /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca => generated 0 bytes in 510 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 18:17:27.295920 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-50ab83e3-4002-417e-a572-a02fd5290094 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:27.296655 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-50ab83e3-4002-417e-a572-a02fd5290094 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:27.311400 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-50ab83e3-4002-417e-a572-a02fd5290094 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:27.313952 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-50ab83e3-4002-417e-a572-a02fd5290094 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:27.315246 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-50ab83e3-4002-417e-a572-a02fd5290094 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:27.315804 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-50ab83e3-4002-417e-a572-a02fd5290094 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:27.643901 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-50ab83e3-4002-417e-a572-a02fd5290094 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:27.653682 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-50ab83e3-4002-417e-a572-a02fd5290094 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca" status: 200 len: 1505 microversion: 2.1 time: 0.362111 Jun 10 18:17:27.654624 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2602/5147] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:27 2022] GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca => generated 1505 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:17:28.207356 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-126f90b8-bb78-4348-bb92-6ca193528eef tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.335398 Jun 10 18:17:28.208152 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2546/5148] 10.222.0.35 () {60 vars in 1169 bytes} [Fri Jun 10 18:17:24 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:17:28.220707 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c5706c26-2539-4134-9aa0-d6bc6d3004c2 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.39.7.136"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:17:28.221881 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c5706c26-2539-4134-9aa0-d6bc6d3004c2 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:28.231135 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5706c26-2539-4134-9aa0-d6bc6d3004c2 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:28.235441 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5706c26-2539-4134-9aa0-d6bc6d3004c2 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:28.235441 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5706c26-2539-4134-9aa0-d6bc6d3004c2 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:28.235441 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5706c26-2539-4134-9aa0-d6bc6d3004c2 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:28.267139 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5706c26-2539-4134-9aa0-d6bc6d3004c2 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Acquired lock "refresh_cache-0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" {{(pid=126594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 10 18:17:28.671406 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dda00f65-8c8d-4d3f-a838-ff515faff7a5 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:28.672252 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dda00f65-8c8d-4d3f-a838-ff515faff7a5 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:28.680969 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dda00f65-8c8d-4d3f-a838-ff515faff7a5 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:28.685202 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dda00f65-8c8d-4d3f-a838-ff515faff7a5 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:28.686389 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dda00f65-8c8d-4d3f-a838-ff515faff7a5 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:28.687888 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dda00f65-8c8d-4d3f-a838-ff515faff7a5 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:28.969475 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-dda00f65-8c8d-4d3f-a838-ff515faff7a5 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:28.981558 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dda00f65-8c8d-4d3f-a838-ff515faff7a5 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca" status: 200 len: 1505 microversion: 2.1 time: 0.311069 Jun 10 18:17:28.982355 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2547/5149] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:28 2022] GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca => generated 1505 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:17:29.811380 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-c5706c26-2539-4134-9aa0-d6bc6d3004c2 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Building network info cache for instance {{(pid=126594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} Jun 10 18:17:29.824000 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-bb5951c8-55c0-439d-baca-59ffddeffa9e req-8ce6d180-6171-4146-a3c9-8342affd4e77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8", "tag": "2ee7eb96-d569-4b56-80d8-7ca0fb5164f6"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:17:29.862133 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-bb5951c8-55c0-439d-baca-59ffddeffa9e req-8ce6d180-6171-4146-a3c9-8342affd4e77 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:29.865556 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-bb5951c8-55c0-439d-baca-59ffddeffa9e req-8ce6d180-6171-4146-a3c9-8342affd4e77 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:29.889231 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-bb5951c8-55c0-439d-baca-59ffddeffa9e req-8ce6d180-6171-4146-a3c9-8342affd4e77 service nova] Creating event network-changed:2ee7eb96-d569-4b56-80d8-7ca0fb5164f6 for instance 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 on chh1-master-2 Jun 10 18:17:29.895932 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-bb5951c8-55c0-439d-baca-59ffddeffa9e req-8ce6d180-6171-4146-a3c9-8342affd4e77 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077809 Jun 10 18:17:29.899206 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2548/5150] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:17:30.001666 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e2f79778-484b-46b1-9e08-d18959df8b47 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:30.005803 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e2f79778-484b-46b1-9e08-d18959df8b47 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:30.032479 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e2f79778-484b-46b1-9e08-d18959df8b47 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:30.033182 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e2f79778-484b-46b1-9e08-d18959df8b47 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:30.034254 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e2f79778-484b-46b1-9e08-d18959df8b47 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:30.035038 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e2f79778-484b-46b1-9e08-d18959df8b47 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:31.058034 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-c5706c26-2539-4134-9aa0-d6bc6d3004c2 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Updating instance_info_cache with network_info: [{"id": "2ee7eb96-d569-4b56-80d8-7ca0fb5164f6", "address": "fa:16:3e:ab:ea:09", "network": {"id": "072cec36-1536-487b-9c37-7b529a5b95f4", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-711223119-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.39.7.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "38108fc8596d4cb7912297aaea361563", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap2ee7eb96-d5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 10 18:17:31.130742 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5706c26-2539-4134-9aa0-d6bc6d3004c2 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Releasing lock "refresh_cache-0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" {{(pid=126594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 10 18:17:31.131727 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c5706c26-2539-4134-9aa0-d6bc6d3004c2 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "POST /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8/action" status: 202 len: 0 microversion: 2.1 time: 2.915509 Jun 10 18:17:31.133255 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2603/5151] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:17:28 2022] POST /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8/action => generated 0 bytes in 2917 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 10 18:17:31.141186 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-eb855313-9853-406f-9456-49462cb7671c tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.39.7.136"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:17:31.471393 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e2f79778-484b-46b1-9e08-d18959df8b47 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:31.492708 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e2f79778-484b-46b1-9e08-d18959df8b47 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca" status: 200 len: 1505 microversion: 2.1 time: 1.494020 Jun 10 18:17:31.493881 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2549/5152] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:29 2022] GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca => generated 1505 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:17:31.610540 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-3397a077-0420-4605-8545-bcb253d0f471 req-9057adbb-7072-4239-befd-3c78baa9838a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ffbc900-46ac-470d-9773-9b0118c6dbca", "name": "network-vif-deleted", "tag": "7ddef814-3da5-4e0c-97c5-f653e35b3352"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:17:31.627003 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-3397a077-0420-4605-8545-bcb253d0f471 req-9057adbb-7072-4239-befd-3c78baa9838a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:31.627743 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-3397a077-0420-4605-8545-bcb253d0f471 req-9057adbb-7072-4239-befd-3c78baa9838a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:31.659736 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-3397a077-0420-4605-8545-bcb253d0f471 req-9057adbb-7072-4239-befd-3c78baa9838a service nova] Creating event network-vif-deleted:7ddef814-3da5-4e0c-97c5-f653e35b3352 for instance 3ffbc900-46ac-470d-9773-9b0118c6dbca on chh1-master-2 Jun 10 18:17:31.690489 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-3397a077-0420-4605-8545-bcb253d0f471 req-9057adbb-7072-4239-befd-3c78baa9838a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083430 Jun 10 18:17:31.692795 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2550/5153] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:17:31.978381 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-eb855313-9853-406f-9456-49462cb7671c tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:31.986511 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eb855313-9853-406f-9456-49462cb7671c tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:31.986980 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eb855313-9853-406f-9456-49462cb7671c tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:31.987786 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eb855313-9853-406f-9456-49462cb7671c tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:31.988234 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eb855313-9853-406f-9456-49462cb7671c tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:32.424244 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eb855313-9853-406f-9456-49462cb7671c tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Acquired lock "refresh_cache-0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" {{(pid=126594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 10 18:17:32.509399 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6d088c84-7531-4665-984f-09f90a4478fb tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:32.511292 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6d088c84-7531-4665-984f-09f90a4478fb tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:32.525016 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d088c84-7531-4665-984f-09f90a4478fb tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:32.525483 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d088c84-7531-4665-984f-09f90a4478fb tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:32.526283 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d088c84-7531-4665-984f-09f90a4478fb tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:32.526730 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d088c84-7531-4665-984f-09f90a4478fb tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:32.637271 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d088c84-7531-4665-984f-09f90a4478fb tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:32.637730 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d088c84-7531-4665-984f-09f90a4478fb tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:32.638260 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-6d088c84-7531-4665-984f-09f90a4478fb tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lazy-loading 'fault' on Instance uuid 3ffbc900-46ac-470d-9773-9b0118c6dbca {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:17:32.827603 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6d088c84-7531-4665-984f-09f90a4478fb tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:32.848594 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6d088c84-7531-4665-984f-09f90a4478fb tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca" status: 200 len: 1311 microversion: 2.1 time: 0.338734 Jun 10 18:17:32.849070 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2551/5154] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:32 2022] GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca => generated 1311 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:17:33.861652 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3601feda-6537-40ed-8a40-4e63c29d0181 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:33.862357 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3601feda-6537-40ed-8a40-4e63c29d0181 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: 3ffbc900-46ac-470d-9773-9b0118c6dbca] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:33.871861 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3601feda-6537-40ed-8a40-4e63c29d0181 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:33.893126 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3601feda-6537-40ed-8a40-4e63c29d0181 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:33.893126 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3601feda-6537-40ed-8a40-4e63c29d0181 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:33.893126 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3601feda-6537-40ed-8a40-4e63c29d0181 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:34.004120 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-3601feda-6537-40ed-8a40-4e63c29d0181 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] HTTP exception thrown: Instance 3ffbc900-46ac-470d-9773-9b0118c6dbca could not be found. Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3601feda-6537-40ed-8a40-4e63c29d0181 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Request method failure captured: Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca HTTP/1.1 Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4mJVVxHNAdkChvziQm-6Dxnwt9XHWD1Xe5b1Hij0GEvfTbtqXkBFxRnvK3XB7O0DqEYSiSFM3wVQFcGEtNf0ziHJxG92MJ3ikztDB6TtOzEB2x0AYpNNaCzzkfUNZyHohCw21rjVL9kE9UGR_qvtvfAasaLdvNaa6Nct_8khdQAOeU Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 2f3f65ee123043bb9c888cc5adffce37 Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-779166786 Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/2f3f65ee123043bb9c888cc5adffce37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2f3f65ee123043bb9c888cc5adffce37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2f3f65ee123043bb9c888cc5adffce37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_2f3f65ee123043bb9c888cc5adffce37", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServerRescueNegativeTestJSON-779166786 Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 2f3f65ee123043bb9c888cc5adffce37 Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-779166786 Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServerRescueNegativeTestJSON-779166786-project Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 6aa40a915e4e43cd8d493dc593a73028 Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServerRescueNegativeTestJSON-779166786-project Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 3ffbc900-46ac-470d-9773-9b0118c6dbca could not be found. Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '3ffbc900-46ac-470d-9773-9b0118c6dbca'} Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ffbc900-46ac-470d-9773-9b0118c6dbca could not be found. Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ffbc900-46ac-470d-9773-9b0118c6dbca could not be found. Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:17:34.006305 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:17:34.011157 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:17:34.011157 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:17:34.011157 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:17:34.011157 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:17:34.011157 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:17:34.011157 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ffbc900-46ac-470d-9773-9b0118c6dbca could not be found. Jun 10 18:17:34.011157 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:17:34.013652 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3601feda-6537-40ed-8a40-4e63c29d0181 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Returning 404 to user: Instance 3ffbc900-46ac-470d-9773-9b0118c6dbca could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:17:34.015709 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3601feda-6537-40ed-8a40-4e63c29d0181 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca" status: 404 len: 111 microversion: 2.1 time: 0.157221 Jun 10 18:17:34.021833 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2552/5155] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:33 2022] GET /compute/v2.1/servers/3ffbc900-46ac-470d-9773-9b0118c6dbca => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:17:34.029086 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c0a5c3e6-511e-400a-8da3-b78ab708f151 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:34.030072 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c0a5c3e6-511e-400a-8da3-b78ab708f151 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:34.040856 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c0a5c3e6-511e-400a-8da3-b78ab708f151 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:34.042932 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c0a5c3e6-511e-400a-8da3-b78ab708f151 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:34.044821 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c0a5c3e6-511e-400a-8da3-b78ab708f151 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:34.047313 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c0a5c3e6-511e-400a-8da3-b78ab708f151 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:34.096074 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c0a5c3e6-511e-400a-8da3-b78ab708f151 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:17:34.193460 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-eb855313-9853-406f-9456-49462cb7671c tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Building network info cache for instance {{(pid=126594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} Jun 10 18:17:34.754520 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c0a5c3e6-511e-400a-8da3-b78ab708f151 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "DELETE /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e" status: 204 len: 0 microversion: 2.1 time: 0.732979 Jun 10 18:17:34.755117 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2553/5156] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:17:34 2022] DELETE /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e => generated 0 bytes in 735 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:17:34.762800 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-dc4cf9dd-1202-4692-a57c-8c35f24864c8 req-60f240f6-b195-42f4-b4c4-5d49ca904fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8", "tag": "2ee7eb96-d569-4b56-80d8-7ca0fb5164f6"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:17:34.794994 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-dc4cf9dd-1202-4692-a57c-8c35f24864c8 req-60f240f6-b195-42f4-b4c4-5d49ca904fe2 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:34.796980 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-dc4cf9dd-1202-4692-a57c-8c35f24864c8 req-60f240f6-b195-42f4-b4c4-5d49ca904fe2 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:34.814042 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:17:34.831482 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-dc4cf9dd-1202-4692-a57c-8c35f24864c8 req-60f240f6-b195-42f4-b4c4-5d49ca904fe2 service nova] Creating event network-changed:2ee7eb96-d569-4b56-80d8-7ca0fb5164f6 for instance 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 on chh1-master-2 Jun 10 18:17:34.849075 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-dc4cf9dd-1202-4692-a57c-8c35f24864c8 req-60f240f6-b195-42f4-b4c4-5d49ca904fe2 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091925 Jun 10 18:17:34.852350 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2554/5157] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:17:34.864938 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dbdcedb2-95ae-41ef-92ca-0a9d356b47e6 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:34.868063 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dbdcedb2-95ae-41ef-92ca-0a9d356b47e6 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:34.893260 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dbdcedb2-95ae-41ef-92ca-0a9d356b47e6 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:34.896655 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dbdcedb2-95ae-41ef-92ca-0a9d356b47e6 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:34.902103 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dbdcedb2-95ae-41ef-92ca-0a9d356b47e6 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:34.902870 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dbdcedb2-95ae-41ef-92ca-0a9d356b47e6 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:35.446896 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-eb855313-9853-406f-9456-49462cb7671c tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Updating instance_info_cache with network_info: [{"id": "2ee7eb96-d569-4b56-80d8-7ca0fb5164f6", "address": "fa:16:3e:ab:ea:09", "network": {"id": "072cec36-1536-487b-9c37-7b529a5b95f4", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-711223119-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "38108fc8596d4cb7912297aaea361563", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap2ee7eb96-d5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 10 18:17:35.530498 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eb855313-9853-406f-9456-49462cb7671c tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Releasing lock "refresh_cache-0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" {{(pid=126594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 10 18:17:35.530498 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-eb855313-9853-406f-9456-49462cb7671c tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "POST /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8/action" status: 202 len: 0 microversion: 2.1 time: 4.382887 Jun 10 18:17:35.530498 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2604/5158] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:17:31 2022] POST /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8/action => generated 0 bytes in 4385 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 10 18:17:35.530498 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6d76c588-c9cf-4601-9da9-1bc201d0cf80 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '.version_select at 0x7f77c08f5940>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:35.663929 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-dbdcedb2-95ae-41ef-92ca-0a9d356b47e6 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:35.676741 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dbdcedb2-95ae-41ef-92ca-0a9d356b47e6 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e" status: 200 len: 1519 microversion: 2.1 time: 0.821640 Jun 10 18:17:35.679677 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2555/5159] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:34 2022] GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e => generated 1519 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:17:36.704327 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dd975ecc-d6f1-456b-bcd1-9041070eabf0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:36.704327 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dd975ecc-d6f1-456b-bcd1-9041070eabf0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:36.715713 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd975ecc-d6f1-456b-bcd1-9041070eabf0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:36.717442 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd975ecc-d6f1-456b-bcd1-9041070eabf0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:36.718466 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd975ecc-d6f1-456b-bcd1-9041070eabf0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:36.719164 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd975ecc-d6f1-456b-bcd1-9041070eabf0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:36.942413 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-dd975ecc-d6f1-456b-bcd1-9041070eabf0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:36.952334 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dd975ecc-d6f1-456b-bcd1-9041070eabf0 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e" status: 200 len: 1519 microversion: 2.1 time: 0.257850 Jun 10 18:17:36.958286 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2556/5160] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:36 2022] GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e => generated 1519 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:17:37.514946 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6d76c588-c9cf-4601-9da9-1bc201d0cf80 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "DELETE /compute/v2.1/os-floating-ips/394102ce-a69e-4b53-ada1-e91e2e670dd1" status: 202 len: 0 microversion: 2.1 time: 1.989334 Jun 10 18:17:37.515847 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2605/5161] 10.222.0.35 () {58 vars in 1262 bytes} [Fri Jun 10 18:17:35 2022] DELETE /compute/v2.1/os-floating-ips/394102ce-a69e-4b53-ada1-e91e2e670dd1 => generated 0 bytes in 1991 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:17:37.525726 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-83f4bb15-139b-42db-967c-75e615fd83e5 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '.version_select at 0x7f77c02c3e50>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:37.971581 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b4ceb5a1-61b2-4a97-991c-75419e743900 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:37.972805 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b4ceb5a1-61b2-4a97-991c-75419e743900 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:37.986067 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b4ceb5a1-61b2-4a97-991c-75419e743900 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:37.986540 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b4ceb5a1-61b2-4a97-991c-75419e743900 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:37.987346 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b4ceb5a1-61b2-4a97-991c-75419e743900 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:37.987791 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b4ceb5a1-61b2-4a97-991c-75419e743900 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:38.329732 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b4ceb5a1-61b2-4a97-991c-75419e743900 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:38.339442 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b4ceb5a1-61b2-4a97-991c-75419e743900 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e" status: 200 len: 1519 microversion: 2.1 time: 0.373012 Jun 10 18:17:38.355162 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2606/5162] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:37 2022] GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e => generated 1519 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:17:38.527976 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-83f4bb15-139b-42db-967c-75e615fd83e5 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "DELETE /compute/v2.1/os-security-groups/c785e712-04cc-4ab7-b941-a24b7ba4dfcb" status: 202 len: 0 microversion: 2.1 time: 1.006673 Jun 10 18:17:38.529557 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2557/5163] 10.222.0.35 () {58 vars in 1271 bytes} [Fri Jun 10 18:17:37 2022] DELETE /compute/v2.1/os-security-groups/c785e712-04cc-4ab7-b941-a24b7ba4dfcb => generated 0 bytes in 1009 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:17:38.538292 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0157e3ce-1993-4c75-9795-6a739f945459 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:38.539469 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0157e3ce-1993-4c75-9795-6a739f945459 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:38.546130 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0157e3ce-1993-4c75-9795-6a739f945459 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:38.546705 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0157e3ce-1993-4c75-9795-6a739f945459 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:38.547762 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0157e3ce-1993-4c75-9795-6a739f945459 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:38.548342 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0157e3ce-1993-4c75-9795-6a739f945459 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:38.583246 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0157e3ce-1993-4c75-9795-6a739f945459 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:17:39.033841 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0157e3ce-1993-4c75-9795-6a739f945459 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "DELETE /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 204 len: 0 microversion: 2.1 time: 0.500196 Jun 10 18:17:39.034445 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2607/5164] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:17:38 2022] DELETE /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 18:17:39.045617 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a1463b65-8ae9-4b84-9485-0be74bcfab9a tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:39.046378 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a1463b65-8ae9-4b84-9485-0be74bcfab9a tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:39.058073 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a1463b65-8ae9-4b84-9485-0be74bcfab9a tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:39.058655 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a1463b65-8ae9-4b84-9485-0be74bcfab9a tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:39.059515 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a1463b65-8ae9-4b84-9485-0be74bcfab9a tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:39.060026 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a1463b65-8ae9-4b84-9485-0be74bcfab9a tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:39.373883 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5f9bfca5-9c58-4d40-a329-aceacf9ad2ff tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:39.374601 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5f9bfca5-9c58-4d40-a329-aceacf9ad2ff tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:39.387882 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f9bfca5-9c58-4d40-a329-aceacf9ad2ff tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:39.390334 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f9bfca5-9c58-4d40-a329-aceacf9ad2ff tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:39.391535 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f9bfca5-9c58-4d40-a329-aceacf9ad2ff tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:39.391987 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f9bfca5-9c58-4d40-a329-aceacf9ad2ff tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:39.447197 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a1463b65-8ae9-4b84-9485-0be74bcfab9a tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:39.462490 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a1463b65-8ae9-4b84-9485-0be74bcfab9a tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1510 microversion: 2.1 time: 0.420072 Jun 10 18:17:39.473170 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2558/5165] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:39 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1510 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:17:39.531415 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5f9bfca5-9c58-4d40-a329-aceacf9ad2ff tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:39.546364 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5f9bfca5-9c58-4d40-a329-aceacf9ad2ff tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e" status: 200 len: 1477 microversion: 2.1 time: 0.170689 Jun 10 18:17:39.546364 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2608/5166] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:39 2022] GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e => generated 1477 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:17:39.717530 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-4a8eafa2-d02c-4259-9948-416e12be02a6 req-beef2c32-ac92-49cd-8ca7-8a48c6f17655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e", "name": "network-vif-deleted", "tag": "bd1f8f99-545c-4e7b-89b2-c24069d1acc2"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:17:39.733771 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-4a8eafa2-d02c-4259-9948-416e12be02a6 req-beef2c32-ac92-49cd-8ca7-8a48c6f17655 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:39.734650 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-4a8eafa2-d02c-4259-9948-416e12be02a6 req-beef2c32-ac92-49cd-8ca7-8a48c6f17655 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:39.749471 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-4a8eafa2-d02c-4259-9948-416e12be02a6 req-beef2c32-ac92-49cd-8ca7-8a48c6f17655 service nova] Creating event network-vif-deleted:bd1f8f99-545c-4e7b-89b2-c24069d1acc2 for instance b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e on chh1-master-2 Jun 10 18:17:39.755917 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-4a8eafa2-d02c-4259-9948-416e12be02a6 req-beef2c32-ac92-49cd-8ca7-8a48c6f17655 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045954 Jun 10 18:17:39.759845 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2559/5167] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:17:40.480873 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-495414d3-6945-4111-90a1-54bb4319cef5 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:40.483056 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-495414d3-6945-4111-90a1-54bb4319cef5 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:40.492489 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-495414d3-6945-4111-90a1-54bb4319cef5 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:40.506435 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-495414d3-6945-4111-90a1-54bb4319cef5 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:40.509824 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-495414d3-6945-4111-90a1-54bb4319cef5 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:40.511315 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-495414d3-6945-4111-90a1-54bb4319cef5 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:40.561954 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f9ce8e49-1891-4b82-9188-509937906b85 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:40.562659 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f9ce8e49-1891-4b82-9188-509937906b85 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:40.579611 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f9ce8e49-1891-4b82-9188-509937906b85 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:40.579930 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f9ce8e49-1891-4b82-9188-509937906b85 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:40.586975 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f9ce8e49-1891-4b82-9188-509937906b85 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:40.590162 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f9ce8e49-1891-4b82-9188-509937906b85 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:40.780925 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f9ce8e49-1891-4b82-9188-509937906b85 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:40.793865 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f9ce8e49-1891-4b82-9188-509937906b85 tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e" status: 200 len: 1477 microversion: 2.1 time: 0.236393 Jun 10 18:17:40.797494 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2560/5168] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:40 2022] GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e => generated 1477 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:17:41.796516 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-495414d3-6945-4111-90a1-54bb4319cef5 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:41.809477 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-495414d3-6945-4111-90a1-54bb4319cef5 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1510 microversion: 2.1 time: 1.332349 Jun 10 18:17:41.810957 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2609/5169] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:40 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1510 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:17:41.812835 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d1ce79d6-2dad-4e4a-a3ee-4f8e3aa73a6c tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:41.813470 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d1ce79d6-2dad-4e4a-a3ee-4f8e3aa73a6c tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:41.828524 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d1ce79d6-2dad-4e4a-a3ee-4f8e3aa73a6c tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:41.829044 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d1ce79d6-2dad-4e4a-a3ee-4f8e3aa73a6c tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:41.831459 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d1ce79d6-2dad-4e4a-a3ee-4f8e3aa73a6c tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:41.831922 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d1ce79d6-2dad-4e4a-a3ee-4f8e3aa73a6c tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:41.908005 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d1ce79d6-2dad-4e4a-a3ee-4f8e3aa73a6c tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:41.909713 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d1ce79d6-2dad-4e4a-a3ee-4f8e3aa73a6c tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:41.910388 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-d1ce79d6-2dad-4e4a-a3ee-4f8e3aa73a6c tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lazy-loading 'fault' on Instance uuid b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:17:42.029560 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d1ce79d6-2dad-4e4a-a3ee-4f8e3aa73a6c tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa40a915e4e43cd8d493dc593a73028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f3f65ee123043bb9c888cc5adffce37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:42.042189 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d1ce79d6-2dad-4e4a-a3ee-4f8e3aa73a6c tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e" status: 200 len: 1311 microversion: 2.1 time: 0.233759 Jun 10 18:17:42.058760 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2561/5170] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:41 2022] GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e => generated 1311 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:17:42.351150 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-3a2c1e3b-f59e-4d8b-bf6f-e0c8198e5e85 req-fc147d43-e7f5-40f3-8d11-35cc6be6a600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8", "name": "network-vif-deleted", "tag": "2ee7eb96-d569-4b56-80d8-7ca0fb5164f6"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:17:42.363366 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=3 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:17:42.370033 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-3a2c1e3b-f59e-4d8b-bf6f-e0c8198e5e85 req-fc147d43-e7f5-40f3-8d11-35cc6be6a600 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:42.374240 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-3a2c1e3b-f59e-4d8b-bf6f-e0c8198e5e85 req-fc147d43-e7f5-40f3-8d11-35cc6be6a600 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:42.386145 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-3a2c1e3b-f59e-4d8b-bf6f-e0c8198e5e85 req-fc147d43-e7f5-40f3-8d11-35cc6be6a600 service nova] Creating event network-vif-deleted:2ee7eb96-d569-4b56-80d8-7ca0fb5164f6 for instance 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 on chh1-master-2 Jun 10 18:17:42.406991 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-3a2c1e3b-f59e-4d8b-bf6f-e0c8198e5e85 req-fc147d43-e7f5-40f3-8d11-35cc6be6a600 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060296 Jun 10 18:17:42.411450 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2610/5171] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:17:42.827215 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-565ae59c-5202-4242-81df-1e9e0a1824a5 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:42.827832 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-565ae59c-5202-4242-81df-1e9e0a1824a5 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:42.836114 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-565ae59c-5202-4242-81df-1e9e0a1824a5 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:42.836650 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-565ae59c-5202-4242-81df-1e9e0a1824a5 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:42.837499 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-565ae59c-5202-4242-81df-1e9e0a1824a5 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:42.838031 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-565ae59c-5202-4242-81df-1e9e0a1824a5 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:42.875760 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-565ae59c-5202-4242-81df-1e9e0a1824a5 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:42.877149 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-565ae59c-5202-4242-81df-1e9e0a1824a5 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:42.877841 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-565ae59c-5202-4242-81df-1e9e0a1824a5 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lazy-loading 'fault' on Instance uuid 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:17:42.939427 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-565ae59c-5202-4242-81df-1e9e0a1824a5 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508153af7c5491ab75d41dde00498e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38108fc8596d4cb7912297aaea361563', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:17:42.948087 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-565ae59c-5202-4242-81df-1e9e0a1824a5 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 200 len: 1313 microversion: 2.1 time: 0.124977 Jun 10 18:17:42.948929 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2562/5172] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:42 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 1313 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:17:43.069682 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-92c22882-9b82-4b3e-a0ce-0703a05e7b6e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:43.070447 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-92c22882-9b82-4b3e-a0ce-0703a05e7b6e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] [instance: b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:43.078243 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-92c22882-9b82-4b3e-a0ce-0703a05e7b6e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:43.078698 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-92c22882-9b82-4b3e-a0ce-0703a05e7b6e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:43.079483 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-92c22882-9b82-4b3e-a0ce-0703a05e7b6e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:43.079926 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-92c22882-9b82-4b3e-a0ce-0703a05e7b6e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:43.095325 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-92c22882-9b82-4b3e-a0ce-0703a05e7b6e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] HTTP exception thrown: Instance b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e could not be found. Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-92c22882-9b82-4b3e-a0ce-0703a05e7b6e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Request method failure captured: Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e HTTP/1.1 Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4mJVVxHNAdkChvziQm-6Dxnwt9XHWD1Xe5b1Hij0GEvfTbtqXkBFxRnvK3XB7O0DqEYSiSFM3wVQFcGEtNf0ziHJxG92MJ3ikztDB6TtOzEB2x0AYpNNaCzzkfUNZyHohCw21rjVL9kE9UGR_qvtvfAasaLdvNaa6Nct_8khdQAOeU Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 2f3f65ee123043bb9c888cc5adffce37 Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-779166786 Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/2f3f65ee123043bb9c888cc5adffce37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2f3f65ee123043bb9c888cc5adffce37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2f3f65ee123043bb9c888cc5adffce37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_2f3f65ee123043bb9c888cc5adffce37", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServerRescueNegativeTestJSON-779166786 Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 2f3f65ee123043bb9c888cc5adffce37 Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-779166786 Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServerRescueNegativeTestJSON-779166786-project Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 6aa40a915e4e43cd8d493dc593a73028 Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServerRescueNegativeTestJSON-779166786-project Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: exception: Instance b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e could not be found. Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e'} Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e could not be found. Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e could not be found. Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:17:43.096929 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:17:43.101468 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:17:43.101468 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:17:43.101468 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:17:43.101468 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:17:43.101468 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:17:43.101468 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e could not be found. Jun 10 18:17:43.101468 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:17:43.101468 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-92c22882-9b82-4b3e-a0ce-0703a05e7b6e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] Returning 404 to user: Instance b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:17:43.101468 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-92c22882-9b82-4b3e-a0ce-0703a05e7b6e tempest-ServerRescueNegativeTestJSON-779166786 tempest-ServerRescueNegativeTestJSON-779166786-project] 10.222.0.35 "GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e" status: 404 len: 111 microversion: 2.1 time: 0.034977 Jun 10 18:17:43.101468 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2611/5173] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:43 2022] GET /compute/v2.1/servers/b1ed50b3-fe0a-4a21-95e8-36c9fc696e1e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:17:43.981240 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bd3543d0-3a45-4700-9899-7c00640b8f25 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:43.985773 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bd3543d0-3a45-4700-9899-7c00640b8f25 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] [instance: 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:17:44.001695 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bd3543d0-3a45-4700-9899-7c00640b8f25 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:44.003986 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bd3543d0-3a45-4700-9899-7c00640b8f25 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:44.006160 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bd3543d0-3a45-4700-9899-7c00640b8f25 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:17:44.006824 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bd3543d0-3a45-4700-9899-7c00640b8f25 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:17:44.031434 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-bd3543d0-3a45-4700-9899-7c00640b8f25 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] HTTP exception thrown: Instance 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 could not be found. Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bd3543d0-3a45-4700-9899-7c00640b8f25 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Request method failure captured: Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 HTTP/1.1 Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4p0zWxaoWx2k4IiATHFN9yH9dpi3NN266lpdNCxNGMKCZxdEC2c9hB9waDsctWPJ9hphOOcsZg3hd4uKsuFuYgKqFydtpPNptGdsPCEYCQAAfgG-qaUH1X70tpBB1f9Mt24IzunajlIPVzbpEhig01IaALr0nLmgz_XS1gGAr6MTEw Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 38108fc8596d4cb7912297aaea361563 Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1136756738 Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/38108fc8596d4cb7912297aaea361563"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/38108fc8596d4cb7912297aaea361563"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/38108fc8596d4cb7912297aaea361563"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_38108fc8596d4cb7912297aaea361563", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1136756738 Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 38108fc8596d4cb7912297aaea361563 Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1136756738 Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServerRescueTestJSONUnderV235-1136756738-project Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 7508153af7c5491ab75d41dde00498e5 Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1136756738-project Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 could not be found. Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8'} Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 could not be found. Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 could not be found. Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:17:44.033452 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:17:44.038635 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:17:44.038635 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:17:44.038635 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:17:44.038635 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:17:44.038635 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:17:44.038635 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:17:44.038635 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 could not be found. Jun 10 18:17:44.038635 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:17:44.038635 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bd3543d0-3a45-4700-9899-7c00640b8f25 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] Returning 404 to user: Instance 0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:17:44.038635 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bd3543d0-3a45-4700-9899-7c00640b8f25 tempest-ServerRescueTestJSONUnderV235-1136756738 tempest-ServerRescueTestJSONUnderV235-1136756738-project] 10.222.0.35 "GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8" status: 404 len: 111 microversion: 2.1 time: 0.064316 Jun 10 18:17:44.039680 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2563/5174] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:17:43 2022] GET /compute/v2.1/servers/0de8f61f-d2ae-4e2a-a60e-a9c6c4d9baa8 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:17:58.207586 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:17:58.708592 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-337925ae-a2d2-4b5a-ae3c-7445d785823e tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] Action: 'create', calling method: .version_select at 0x7f77c09379d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-679348387"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:17:58.868141 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:17:58.869820 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=45 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:17:59.000044 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4cf45c63-1a3c-4466-82b3-a26d3ed3cfb3 tempest-QuotasTestJSON-1011602790 tempest-QuotasTestJSON-1011602790-project] Calling method '.version_select at 0x7f77b3e065e0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:59.124357 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4cf45c63-1a3c-4466-82b3-a26d3ed3cfb3 tempest-QuotasTestJSON-1011602790 tempest-QuotasTestJSON-1011602790-project] 10.222.0.35 "GET /compute/v2.1/os-quota-sets/fbe43cdbeef14312ba7d2107c737ba32/defaults" status: 200 len: 371 microversion: 2.1 time: 0.279547 Jun 10 18:17:59.125371 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2564/5175] 10.222.0.35 () {58 vars in 1268 bytes} [Fri Jun 10 18:17:58 2022] GET /compute/v2.1/os-quota-sets/fbe43cdbeef14312ba7d2107c737ba32/defaults => generated 371 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:17:59.145782 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-72ac7da2-f42d-4a1e-8a97-b20405bd9347 tempest-QuotasTestJSON-1011602790 tempest-QuotasTestJSON-1011602790-project] Calling method '.version_select at 0x7f77b3e06430>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:59.314394 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-72ac7da2-f42d-4a1e-8a97-b20405bd9347 tempest-QuotasTestJSON-1011602790 tempest-QuotasTestJSON-1011602790-project] 10.222.0.35 "GET /compute/v2.1/os-quota-sets/fbe43cdbeef14312ba7d2107c737ba32" status: 200 len: 371 microversion: 2.1 time: 0.177015 Jun 10 18:17:59.314996 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2565/5176] 10.222.0.35 () {58 vars in 1241 bytes} [Fri Jun 10 18:17:59 2022] GET /compute/v2.1/os-quota-sets/fbe43cdbeef14312ba7d2107c737ba32 => generated 371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:17:59.335477 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-64d57e81-988d-4446-aa58-6b0e1bbfebe3 tempest-QuotasTestJSON-1011602790 tempest-QuotasTestJSON-1011602790-project] Calling method '.version_select at 0x7f77b3e98af0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:59.438648 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-64d57e81-988d-4446-aa58-6b0e1bbfebe3 tempest-QuotasTestJSON-1011602790 tempest-QuotasTestJSON-1011602790-project] 10.222.0.35 "GET /compute/v2.1/os-quota-sets/fbe43cdbeef14312ba7d2107c737ba32/defaults" status: 200 len: 371 microversion: 2.1 time: 0.108545 Jun 10 18:17:59.439788 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2566/5177] 10.222.0.35 () {58 vars in 1268 bytes} [Fri Jun 10 18:17:59 2022] GET /compute/v2.1/os-quota-sets/fbe43cdbeef14312ba7d2107c737ba32/defaults => generated 371 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:17:59.454656 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-13317b32-333d-4c42-846b-5444ad41618d tempest-QuotasTestJSON-1011602790 tempest-QuotasTestJSON-1011602790-project] Calling method '.version_select at 0x7f77b3fb6b80>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:59.563024 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-13317b32-333d-4c42-846b-5444ad41618d tempest-QuotasTestJSON-1011602790 tempest-QuotasTestJSON-1011602790-project] 10.222.0.35 "GET /compute/v2.1/os-quota-sets/fbe43cdbeef14312ba7d2107c737ba32" status: 200 len: 371 microversion: 2.1 time: 0.112371 Jun 10 18:17:59.563603 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2567/5178] 10.222.0.35 () {58 vars in 1241 bytes} [Fri Jun 10 18:17:59 2022] GET /compute/v2.1/os-quota-sets/fbe43cdbeef14312ba7d2107c737ba32 => generated 371 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:17:59.582070 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f497a7b4-0a11-422e-9ec7-cbe9f58c1a74 tempest-QuotasTestJSON-1011602790 tempest-QuotasTestJSON-1011602790-project] Calling method '.version_select at 0x7f77c02c30d0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:17:59.713145 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f497a7b4-0a11-422e-9ec7-cbe9f58c1a74 tempest-QuotasTestJSON-1011602790 tempest-QuotasTestJSON-1011602790-project] 10.222.0.35 "GET /compute/v2.1/os-quota-sets/fbe43cdbeef14312ba7d2107c737ba32?user_id=34ee93e739d6498c94aaa5be4875beef" status: 200 len: 371 microversion: 2.1 time: 0.139575 Jun 10 18:17:59.716452 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2568/5179] 10.222.0.35 () {58 vars in 1322 bytes} [Fri Jun 10 18:17:59 2022] GET /compute/v2.1/os-quota-sets/fbe43cdbeef14312ba7d2107c737ba32?user_id=34ee93e739d6498c94aaa5be4875beef => generated 371 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:18:00.009558 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-337925ae-a2d2-4b5a-ae3c-7445d785823e tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] 10.222.0.35 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.808597 Jun 10 18:18:00.011280 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2612/5180] 10.222.0.35 () {60 vars in 1154 bytes} [Fri Jun 10 18:17:58 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1811 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 10 18:18:00.022562 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f6e51bee-8463-4622-808e-e3b8df9aacaa tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] Calling method '.version_select at 0x7f77b3e06f70>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:18:00.147159 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f6e51bee-8463-4622-808e-e3b8df9aacaa tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/3c8e15ad-128a-4389-bf3e-fd7d32320eb9" status: 200 len: 344 microversion: 2.1 time: 0.129551 Jun 10 18:18:00.152371 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2569/5181] 10.222.0.35 () {58 vars in 1244 bytes} [Fri Jun 10 18:18:00 2022] GET /compute/v2.1/os-volumes/3c8e15ad-128a-4389-bf3e-fd7d32320eb9 => generated 344 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:18:01.160675 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d3d8e0dc-ea31-49a9-b986-a2e72aa7a95c tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] Calling method '.version_select at 0x7f77c030c1f0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:18:01.295773 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d3d8e0dc-ea31-49a9-b986-a2e72aa7a95c tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/3c8e15ad-128a-4389-bf3e-fd7d32320eb9" status: 200 len: 344 microversion: 2.1 time: 0.140512 Jun 10 18:18:01.297036 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2613/5182] 10.222.0.35 () {58 vars in 1244 bytes} [Fri Jun 10 18:18:01 2022] GET /compute/v2.1/os-volumes/3c8e15ad-128a-4389-bf3e-fd7d32320eb9 => generated 344 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:18:02.309604 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fabd3142-3368-46b8-a6d0-cadefcee5f3e tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] Calling method '.version_select at 0x7f77b3e71e50>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:18:02.412775 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fabd3142-3368-46b8-a6d0-cadefcee5f3e tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/3c8e15ad-128a-4389-bf3e-fd7d32320eb9" status: 200 len: 344 microversion: 2.1 time: 0.102924 Jun 10 18:18:02.412775 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2570/5183] 10.222.0.35 () {58 vars in 1244 bytes} [Fri Jun 10 18:18:02 2022] GET /compute/v2.1/os-volumes/3c8e15ad-128a-4389-bf3e-fd7d32320eb9 => generated 344 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:18:03.423147 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-92029693-7bad-4dee-875b-15f71b5fd503 tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] Calling method '.version_select at 0x7f77c094f0d0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:18:03.539640 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-92029693-7bad-4dee-875b-15f71b5fd503 tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/3c8e15ad-128a-4389-bf3e-fd7d32320eb9" status: 200 len: 345 microversion: 2.1 time: 0.122046 Jun 10 18:18:03.541544 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2614/5184] 10.222.0.35 () {58 vars in 1244 bytes} [Fri Jun 10 18:18:03 2022] GET /compute/v2.1/os-volumes/3c8e15ad-128a-4389-bf3e-fd7d32320eb9 => generated 345 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:18:03.554125 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-64ac139b-3371-4191-8e25-9042464039ea tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] Action: 'create', calling method: .version_select at 0x7f77b3e71b80>, body: {"snapshot": {"volume_id": "3c8e15ad-128a-4389-bf3e-fd7d32320eb9", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-890996552"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:18:04.642939 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-64ac139b-3371-4191-8e25-9042464039ea tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] 10.222.0.35 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 1.094271 Jun 10 18:18:04.644017 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2571/5185] 10.222.0.35 () {60 vars in 1161 bytes} [Fri Jun 10 18:18:03 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:18:04.656953 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-863bc0ec-e9cd-4901-a48a-645ecb094881 tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] Calling method '.version_select at 0x7f77c6082550>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:18:04.780101 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-863bc0ec-e9cd-4901-a48a-645ecb094881 tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/6a7dccd6-dc29-40c4-b35a-5a6a45184a05" status: 200 len: 286 microversion: 2.1 time: 0.129682 Jun 10 18:18:04.781365 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2615/5186] 10.222.0.35 () {58 vars in 1250 bytes} [Fri Jun 10 18:18:04 2022] GET /compute/v2.1/os-snapshots/6a7dccd6-dc29-40c4-b35a-5a6a45184a05 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:18:04.793338 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-632d1d45-aa32-49fa-80bf-b46c92156773 tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] Calling method '.version_select at 0x7f77b3e07f70>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:18:04.889923 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-632d1d45-aa32-49fa-80bf-b46c92156773 tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.102407 Jun 10 18:18:04.890654 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2572/5187] 10.222.0.35 () {58 vars in 1139 bytes} [Fri Jun 10 18:18:04 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:18:04.904468 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5c5ebaee-e732-4066-97f2-d41dfaad7a7b tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] Calling method '.version_select at 0x7f77c61b35e0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:18:05.105020 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5c5ebaee-e732-4066-97f2-d41dfaad7a7b tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/6a7dccd6-dc29-40c4-b35a-5a6a45184a05" status: 200 len: 286 microversion: 2.1 time: 0.206866 Jun 10 18:18:05.114264 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2616/5188] 10.222.0.35 () {58 vars in 1250 bytes} [Fri Jun 10 18:18:04 2022] GET /compute/v2.1/os-snapshots/6a7dccd6-dc29-40c4-b35a-5a6a45184a05 => generated 286 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:18:06.121774 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7ab75a28-22ea-4699-96dc-0a74e6c9a61c tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] Calling method '.version_select at 0x7f77b3fb69d0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:18:06.197519 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7ab75a28-22ea-4699-96dc-0a74e6c9a61c tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/6a7dccd6-dc29-40c4-b35a-5a6a45184a05" status: 200 len: 286 microversion: 2.1 time: 0.079482 Jun 10 18:18:06.198351 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2573/5189] 10.222.0.35 () {58 vars in 1250 bytes} [Fri Jun 10 18:18:06 2022] GET /compute/v2.1/os-snapshots/6a7dccd6-dc29-40c4-b35a-5a6a45184a05 => generated 286 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:18:07.217130 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0f920617-f025-4640-b1a1-0aa74b1f311b tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] Calling method '.version_select at 0x7f77c61b35e0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:18:07.325497 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0f920617-f025-4640-b1a1-0aa74b1f311b tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/6a7dccd6-dc29-40c4-b35a-5a6a45184a05" status: 200 len: 286 microversion: 2.1 time: 0.120008 Jun 10 18:18:07.326106 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2617/5190] 10.222.0.35 () {58 vars in 1250 bytes} [Fri Jun 10 18:18:07 2022] GET /compute/v2.1/os-snapshots/6a7dccd6-dc29-40c4-b35a-5a6a45184a05 => generated 286 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:18:08.338165 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ecf0f482-da89-439d-b48c-0211643d0391 tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] Calling method '.version_select at 0x7f77b3e25b80>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:18:08.399745 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ecf0f482-da89-439d-b48c-0211643d0391 tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/6a7dccd6-dc29-40c4-b35a-5a6a45184a05" status: 200 len: 286 microversion: 2.1 time: 0.065268 Jun 10 18:18:08.400420 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2574/5191] 10.222.0.35 () {58 vars in 1250 bytes} [Fri Jun 10 18:18:08 2022] GET /compute/v2.1/os-snapshots/6a7dccd6-dc29-40c4-b35a-5a6a45184a05 => generated 286 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:18:09.409031 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=3 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:18:09.414185 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1c412998-2cb4-40a3-84e3-25b8cd4a83b1 tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] Calling method '.version_select at 0x7f77c622edc0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:18:09.472864 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1c412998-2cb4-40a3-84e3-25b8cd4a83b1 tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/6a7dccd6-dc29-40c4-b35a-5a6a45184a05" status: 200 len: 287 microversion: 2.1 time: 0.065487 Jun 10 18:18:09.474627 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2618/5192] 10.222.0.35 () {58 vars in 1250 bytes} [Fri Jun 10 18:18:09 2022] GET /compute/v2.1/os-snapshots/6a7dccd6-dc29-40c4-b35a-5a6a45184a05 => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:18:09.491593 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0c10bb16-a582-4b19-b9bd-32c10a3b1423 tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] Calling method '.version_select at 0x7f77b3e25040>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:18:09.645363 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0c10bb16-a582-4b19-b9bd-32c10a3b1423 tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] 10.222.0.35 "DELETE /compute/v2.1/os-snapshots/6a7dccd6-dc29-40c4-b35a-5a6a45184a05" status: 202 len: 0 microversion: 2.1 time: 0.158978 Jun 10 18:18:09.646131 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2575/5193] 10.222.0.35 () {58 vars in 1253 bytes} [Fri Jun 10 18:18:09 2022] DELETE /compute/v2.1/os-snapshots/6a7dccd6-dc29-40c4-b35a-5a6a45184a05 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:18:09.655309 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b6a82576-9fca-4997-b6ee-6f39d771cf6e tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] Calling method '.version_select at 0x7f77c0937ca0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:18:09.698679 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b6a82576-9fca-4997-b6ee-6f39d771cf6e tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/6a7dccd6-dc29-40c4-b35a-5a6a45184a05" status: 200 len: 286 microversion: 2.1 time: 0.047934 Jun 10 18:18:09.699689 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2619/5194] 10.222.0.35 () {58 vars in 1250 bytes} [Fri Jun 10 18:18:09 2022] GET /compute/v2.1/os-snapshots/6a7dccd6-dc29-40c4-b35a-5a6a45184a05 => generated 286 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:18:10.715179 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f5818856-567d-4290-a2eb-f4038bd085c9 tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] Calling method '.version_select at 0x7f77b3e75550>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:18:10.741743 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=8 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:18:10.744863 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=18 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:18:10.815364 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f5818856-567d-4290-a2eb-f4038bd085c9 tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/6a7dccd6-dc29-40c4-b35a-5a6a45184a05" status: 200 len: 286 microversion: 2.1 time: 0.108353 Jun 10 18:18:10.819752 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2576/5195] 10.222.0.35 () {58 vars in 1250 bytes} [Fri Jun 10 18:18:10 2022] GET /compute/v2.1/os-snapshots/6a7dccd6-dc29-40c4-b35a-5a6a45184a05 => generated 286 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:18:11.847456 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-77959ec5-a0c3-4263-904f-0cbcebe6de5b tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] Calling method '.version_select at 0x7f77c033bdc0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:18:11.966008 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-77959ec5-a0c3-4263-904f-0cbcebe6de5b tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/6a7dccd6-dc29-40c4-b35a-5a6a45184a05" status: 200 len: 286 microversion: 2.1 time: 0.138456 Jun 10 18:18:11.967143 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2620/5196] 10.222.0.35 () {58 vars in 1250 bytes} [Fri Jun 10 18:18:11 2022] GET /compute/v2.1/os-snapshots/6a7dccd6-dc29-40c4-b35a-5a6a45184a05 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:18:12.981419 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-13c62283-1ef9-41f7-8dcf-180388e4d6bb tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] Calling method '.version_select at 0x7f77b3e231f0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:18:13.044957 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-13c62283-1ef9-41f7-8dcf-180388e4d6bb tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] HTTP exception thrown: Snapshot 6a7dccd6-dc29-40c4-b35a-5a6a45184a05 could not be found. Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-13c62283-1ef9-41f7-8dcf-180388e4d6bb tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] Request method failure captured: Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/os-snapshots/6a7dccd6-dc29-40c4-b35a-5a6a45184a05 HTTP/1.1 Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4rWzwKqRk9dDQG8RxkRPEErF29yYTO2kF1MpsOS-XzYBASlH9jLAFhEovf0iTu31MvDbobKc38pFrhB1RX2WR8R_QB61Xib-wwKKyRRG91vj2GmAKRRMeE9CCIpijkC5r6qP5czL7n0cSGZB3nG1aKlTn413cxA4AAmiOibXf7oz_w Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: bb4479d723874683b3aea0fabc72c1f1 Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-217415373 Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/bb4479d723874683b3aea0fabc72c1f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bb4479d723874683b3aea0fabc72c1f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bb4479d723874683b3aea0fabc72c1f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_bb4479d723874683b3aea0fabc72c1f1", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-VolumesSnapshotsTestJSON-217415373 Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: bb4479d723874683b3aea0fabc72c1f1 Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-217415373 Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-VolumesSnapshotsTestJSON-217415373-project Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 94eafbe98c84496da5a1651de0299431 Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-VolumesSnapshotsTestJSON-217415373-project Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: exception: Snapshot 6a7dccd6-dc29-40c4-b35a-5a6a45184a05 could not be found. Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '6a7dccd6-dc29-40c4-b35a-5a6a45184a05'} Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 6a7dccd6-dc29-40c4-b35a-5a6a45184a05 could not be found. (HTTP 404) (Request-ID: req-91389f7a-da6d-4018-b996-40608e385c29) Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 10 18:18:13.101779 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 10 18:18:13.105552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 10 18:18:13.105552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 10 18:18:13.105552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 10 18:18:13.105552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 10 18:18:13.105552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 10 18:18:13.105552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 10 18:18:13.105552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 10 18:18:13.105552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 10 18:18:13.105552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 10 18:18:13.105552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 10 18:18:13.105552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 10 18:18:13.105552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 10 18:18:13.105552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 10 18:18:13.105552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 10 18:18:13.105552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 6a7dccd6-dc29-40c4-b35a-5a6a45184a05 could not be found. Jun 10 18:18:13.105552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:18:13.105552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:18:13.105552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:18:13.105552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:18:13.105552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:18:13.105552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:18:13.105552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:18:13.105552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:18:13.105552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:18:13.105552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:18:13.105552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:18:13.105552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:18:13.105552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 10 18:18:13.105552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:18:13.105552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 6a7dccd6-dc29-40c4-b35a-5a6a45184a05 could not be found. Jun 10 18:18:13.105552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:18:13.105552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:18:13.105552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:18:13.105552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:18:13.105552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:18:13.105552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:18:13.105552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:18:13.105552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:18:13.105552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 6a7dccd6-dc29-40c4-b35a-5a6a45184a05 could not be found. Jun 10 18:18:13.105552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:18:13.105552 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-13c62283-1ef9-41f7-8dcf-180388e4d6bb tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] Returning 404 to user: Snapshot 6a7dccd6-dc29-40c4-b35a-5a6a45184a05 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:18:13.105552 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-13c62283-1ef9-41f7-8dcf-180388e4d6bb tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/6a7dccd6-dc29-40c4-b35a-5a6a45184a05" status: 404 len: 111 microversion: 2.1 time: 0.124897 Jun 10 18:18:13.105552 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2577/5197] 10.222.0.35 () {58 vars in 1250 bytes} [Fri Jun 10 18:18:12 2022] GET /compute/v2.1/os-snapshots/6a7dccd6-dc29-40c4-b35a-5a6a45184a05 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:18:13.108695 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ab5e7061-f33d-46df-bf87-6ef0949ec791 tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] Calling method '.version_select at 0x7f77c61b34c0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:18:13.430881 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ab5e7061-f33d-46df-bf87-6ef0949ec791 tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/3c8e15ad-128a-4389-bf3e-fd7d32320eb9" status: 202 len: 0 microversion: 2.1 time: 0.326784 Jun 10 18:18:13.431716 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2621/5198] 10.222.0.35 () {58 vars in 1247 bytes} [Fri Jun 10 18:18:13 2022] DELETE /compute/v2.1/os-volumes/3c8e15ad-128a-4389-bf3e-fd7d32320eb9 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:18:13.441504 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8014cb20-aa99-4330-b85f-0d3a47367f5f tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] Calling method '.version_select at 0x7f77b3fe49d0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:18:13.561380 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8014cb20-aa99-4330-b85f-0d3a47367f5f tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/3c8e15ad-128a-4389-bf3e-fd7d32320eb9" status: 200 len: 344 microversion: 2.1 time: 0.124647 Jun 10 18:18:13.568953 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2578/5199] 10.222.0.35 () {58 vars in 1244 bytes} [Fri Jun 10 18:18:13 2022] GET /compute/v2.1/os-volumes/3c8e15ad-128a-4389-bf3e-fd7d32320eb9 => generated 344 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:18:14.575116 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e88466d8-25db-475e-be07-294bc4369792 tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] Calling method '.version_select at 0x7f77c622ec10>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:18:14.712731 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e88466d8-25db-475e-be07-294bc4369792 tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/3c8e15ad-128a-4389-bf3e-fd7d32320eb9" status: 200 len: 344 microversion: 2.1 time: 0.142294 Jun 10 18:18:14.713725 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2622/5200] 10.222.0.35 () {58 vars in 1244 bytes} [Fri Jun 10 18:18:14 2022] GET /compute/v2.1/os-volumes/3c8e15ad-128a-4389-bf3e-fd7d32320eb9 => generated 344 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:18:15.725742 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b5ae4fef-ab08-457a-a25c-ff3ecaafc821 tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] Calling method '.version_select at 0x7f77b3e23040>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:18:15.815887 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b5ae4fef-ab08-457a-a25c-ff3ecaafc821 tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/3c8e15ad-128a-4389-bf3e-fd7d32320eb9" status: 200 len: 344 microversion: 2.1 time: 0.094090 Jun 10 18:18:15.818340 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2579/5201] 10.222.0.35 () {58 vars in 1244 bytes} [Fri Jun 10 18:18:15 2022] GET /compute/v2.1/os-volumes/3c8e15ad-128a-4389-bf3e-fd7d32320eb9 => generated 344 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:18:16.830518 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fcf0ea71-c0c9-462d-a2df-b2f9fb6e201b tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] Calling method '.version_select at 0x7f77b3de3430>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:18:16.922827 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2954ead1-0799-4cf7-bf70-9c59b3ba09e8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Action: 'create', calling method: .version_select at 0x7f77c61b34c0>, body: {"keypair": {"name": "tempest-keypair-1642033248", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGgUrj/+P5pI7Twjkk4d+FAFvr1PhyvvsCbJjp8/fZYjVzvp3IdhrbAEzQwGjv3Iu+F+Fgn7tG4804tmBJdILclUC68I9E2M80DjOC8UIIdJ290tXeamiNOk9hx65cA3g=="}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:18:16.960027 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-2954ead1-0799-4cf7-bf70-9c59b3ba09e8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Getting quotas for project 9eb43e14768646f1bd2bdfc3bdf67406. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:18:16.966448 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-2954ead1-0799-4cf7-bf70-9c59b3ba09e8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Getting quotas for user a86d300d66fd47a0b870b5ca879a03e8 and project 9eb43e14768646f1bd2bdfc3bdf67406. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:18:16.977825 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fcf0ea71-c0c9-462d-a2df-b2f9fb6e201b tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/3c8e15ad-128a-4389-bf3e-fd7d32320eb9" status: 200 len: 344 microversion: 2.1 time: 0.151363 Jun 10 18:18:16.978605 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2580/5202] 10.222.0.35 () {58 vars in 1244 bytes} [Fri Jun 10 18:18:16 2022] GET /compute/v2.1/os-volumes/3c8e15ad-128a-4389-bf3e-fd7d32320eb9 => generated 344 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:18:16.994510 chdv-master-2 devstack@n-api.service[126594]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2954ead1-0799-4cf7-bf70-9c59b3ba09e8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [84ecbbac-7305-4eda-a9a1-ecb412032192] AMQP server on 10.222.0.35:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 10 18:18:17.992870 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4780fff9-e9ff-4bb6-b823-8c2b2356fb74 tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] Calling method '.version_select at 0x7f77b3e239d0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:18:18.001545 chdv-master-2 devstack@n-api.service[126594]: INFO oslo.messaging._drivers.impl_rabbit [None req-2954ead1-0799-4cf7-bf70-9c59b3ba09e8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [84ecbbac-7305-4eda-a9a1-ecb412032192] Reconnected to AMQP server on 10.222.0.35:5672 via [amqp] client with port 39280. Jun 10 18:18:18.037435 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-4780fff9-e9ff-4bb6-b823-8c2b2356fb74 tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] HTTP exception thrown: Volume 3c8e15ad-128a-4389-bf3e-fd7d32320eb9 could not be found. Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4780fff9-e9ff-4bb6-b823-8c2b2356fb74 tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] Request method failure captured: Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/os-volumes/3c8e15ad-128a-4389-bf3e-fd7d32320eb9 HTTP/1.1 Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4rWzwKqRk9dDQG8RxkRPEErF29yYTO2kF1MpsOS-XzYBASlH9jLAFhEovf0iTu31MvDbobKc38pFrhB1RX2WR8R_QB61Xib-wwKKyRRG91vj2GmAKRRMeE9CCIpijkC5r6qP5czL7n0cSGZB3nG1aKlTn413cxA4AAmiOibXf7oz_w Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: bb4479d723874683b3aea0fabc72c1f1 Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-217415373 Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/bb4479d723874683b3aea0fabc72c1f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bb4479d723874683b3aea0fabc72c1f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bb4479d723874683b3aea0fabc72c1f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_bb4479d723874683b3aea0fabc72c1f1", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-VolumesSnapshotsTestJSON-217415373 Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: bb4479d723874683b3aea0fabc72c1f1 Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-217415373 Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-VolumesSnapshotsTestJSON-217415373-project Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 94eafbe98c84496da5a1651de0299431 Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-VolumesSnapshotsTestJSON-217415373-project Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: exception: Volume 3c8e15ad-128a-4389-bf3e-fd7d32320eb9 could not be found. Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '3c8e15ad-128a-4389-bf3e-fd7d32320eb9'} Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3c8e15ad-128a-4389-bf3e-fd7d32320eb9 could not be found. (HTTP 404) (Request-ID: req-17a63d77-69ec-4f26-a06d-88e189f9cbef) Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 10 18:18:18.043661 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 10 18:18:18.048389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 10 18:18:18.048389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 10 18:18:18.048389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 10 18:18:18.048389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 10 18:18:18.048389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 10 18:18:18.048389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 10 18:18:18.048389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 10 18:18:18.048389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 10 18:18:18.048389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 10 18:18:18.048389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 10 18:18:18.048389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 10 18:18:18.048389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 10 18:18:18.048389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 10 18:18:18.048389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3c8e15ad-128a-4389-bf3e-fd7d32320eb9 could not be found. Jun 10 18:18:18.048389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:18:18.048389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:18:18.048389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:18:18.048389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:18:18.048389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:18:18.048389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:18:18.048389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:18:18.048389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:18:18.048389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:18:18.048389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:18:18.048389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:18:18.048389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:18:18.048389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 10 18:18:18.048389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:18:18.048389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3c8e15ad-128a-4389-bf3e-fd7d32320eb9 could not be found. Jun 10 18:18:18.048389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:18:18.048389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:18:18.048389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:18:18.048389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:18:18.048389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:18:18.048389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:18:18.048389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:18:18.048389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:18:18.048389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3c8e15ad-128a-4389-bf3e-fd7d32320eb9 could not be found. Jun 10 18:18:18.048389 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:18:18.048389 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4780fff9-e9ff-4bb6-b823-8c2b2356fb74 tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] Returning 404 to user: Volume 3c8e15ad-128a-4389-bf3e-fd7d32320eb9 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:18:18.048389 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4780fff9-e9ff-4bb6-b823-8c2b2356fb74 tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/3c8e15ad-128a-4389-bf3e-fd7d32320eb9" status: 404 len: 109 microversion: 2.1 time: 0.060279 Jun 10 18:18:18.058546 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2581/5203] 10.222.0.35 () {58 vars in 1244 bytes} [Fri Jun 10 18:18:17 2022] GET /compute/v2.1/os-volumes/3c8e15ad-128a-4389-bf3e-fd7d32320eb9 => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:18:18.066427 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e31dc971-836b-4b0a-a0f4-a1c25bc0a138 tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] Calling method '.version_select at 0x7f77b3e3edc0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:18:18.125693 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-e31dc971-836b-4b0a-a0f4-a1c25bc0a138 tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] HTTP exception thrown: Volume 3c8e15ad-128a-4389-bf3e-fd7d32320eb9 could not be found. Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e31dc971-836b-4b0a-a0f4-a1c25bc0a138 tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] Request method failure captured: Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/os-volumes/3c8e15ad-128a-4389-bf3e-fd7d32320eb9 HTTP/1.1 Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4rWzwKqRk9dDQG8RxkRPEErF29yYTO2kF1MpsOS-XzYBASlH9jLAFhEovf0iTu31MvDbobKc38pFrhB1RX2WR8R_QB61Xib-wwKKyRRG91vj2GmAKRRMeE9CCIpijkC5r6qP5czL7n0cSGZB3nG1aKlTn413cxA4AAmiOibXf7oz_w Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: bb4479d723874683b3aea0fabc72c1f1 Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-217415373 Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/bb4479d723874683b3aea0fabc72c1f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bb4479d723874683b3aea0fabc72c1f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bb4479d723874683b3aea0fabc72c1f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_bb4479d723874683b3aea0fabc72c1f1", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-VolumesSnapshotsTestJSON-217415373 Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: bb4479d723874683b3aea0fabc72c1f1 Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-217415373 Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-VolumesSnapshotsTestJSON-217415373-project Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 94eafbe98c84496da5a1651de0299431 Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-VolumesSnapshotsTestJSON-217415373-project Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: exception: Volume 3c8e15ad-128a-4389-bf3e-fd7d32320eb9 could not be found. Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '3c8e15ad-128a-4389-bf3e-fd7d32320eb9'} Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3c8e15ad-128a-4389-bf3e-fd7d32320eb9 could not be found. (HTTP 404) (Request-ID: req-777878bc-94f2-4f2c-afc7-a2f05d3b2f80) Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 10 18:18:18.140594 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 10 18:18:18.146874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 10 18:18:18.146874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 10 18:18:18.146874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 10 18:18:18.146874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 10 18:18:18.146874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 10 18:18:18.146874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 10 18:18:18.146874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 10 18:18:18.146874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 10 18:18:18.146874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 10 18:18:18.146874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 10 18:18:18.146874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 10 18:18:18.146874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 10 18:18:18.146874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 10 18:18:18.146874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3c8e15ad-128a-4389-bf3e-fd7d32320eb9 could not be found. Jun 10 18:18:18.146874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:18:18.146874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:18:18.146874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:18:18.146874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:18:18.146874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:18:18.146874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:18:18.146874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:18:18.146874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:18:18.146874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:18:18.146874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:18:18.146874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:18:18.146874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:18:18.146874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 10 18:18:18.146874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:18:18.146874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3c8e15ad-128a-4389-bf3e-fd7d32320eb9 could not be found. Jun 10 18:18:18.146874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:18:18.146874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:18:18.146874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:18:18.146874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:18:18.146874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:18:18.146874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:18:18.146874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:18:18.146874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:18:18.146874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3c8e15ad-128a-4389-bf3e-fd7d32320eb9 could not be found. Jun 10 18:18:18.146874 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:18:18.151462 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2954ead1-0799-4cf7-bf70-9c59b3ba09e8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.450004 Jun 10 18:18:18.151462 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2623/5204] 10.222.0.35 () {62 vars in 1199 bytes} [Fri Jun 10 18:18:16 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1453 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 10 18:18:18.153394 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e31dc971-836b-4b0a-a0f4-a1c25bc0a138 tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] Returning 404 to user: Volume 3c8e15ad-128a-4389-bf3e-fd7d32320eb9 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:18:18.154665 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e31dc971-836b-4b0a-a0f4-a1c25bc0a138 tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/3c8e15ad-128a-4389-bf3e-fd7d32320eb9" status: 404 len: 109 microversion: 2.1 time: 0.098691 Jun 10 18:18:18.155744 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2582/5205] 10.222.0.35 () {58 vars in 1247 bytes} [Fri Jun 10 18:18:18 2022] DELETE /compute/v2.1/os-volumes/3c8e15ad-128a-4389-bf3e-fd7d32320eb9 => generated 109 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:18:18.165620 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-922137a6-f9b1-4f54-afef-64424dba5a86 tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] Calling method '.version_select at 0x7f77c09c30d0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:18:18.222222 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-922137a6-f9b1-4f54-afef-64424dba5a86 tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] HTTP exception thrown: Volume 3c8e15ad-128a-4389-bf3e-fd7d32320eb9 could not be found. Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-922137a6-f9b1-4f54-afef-64424dba5a86 tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] Request method failure captured: Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/os-volumes/3c8e15ad-128a-4389-bf3e-fd7d32320eb9 HTTP/1.1 Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4rWzwKqRk9dDQG8RxkRPEErF29yYTO2kF1MpsOS-XzYBASlH9jLAFhEovf0iTu31MvDbobKc38pFrhB1RX2WR8R_QB61Xib-wwKKyRRG91vj2GmAKRRMeE9CCIpijkC5r6qP5czL7n0cSGZB3nG1aKlTn413cxA4AAmiOibXf7oz_w Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: bb4479d723874683b3aea0fabc72c1f1 Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-217415373 Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/bb4479d723874683b3aea0fabc72c1f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bb4479d723874683b3aea0fabc72c1f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bb4479d723874683b3aea0fabc72c1f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_bb4479d723874683b3aea0fabc72c1f1", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-VolumesSnapshotsTestJSON-217415373 Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: bb4479d723874683b3aea0fabc72c1f1 Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-217415373 Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-VolumesSnapshotsTestJSON-217415373-project Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 94eafbe98c84496da5a1651de0299431 Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-VolumesSnapshotsTestJSON-217415373-project Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: exception: Volume 3c8e15ad-128a-4389-bf3e-fd7d32320eb9 could not be found. Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '3c8e15ad-128a-4389-bf3e-fd7d32320eb9'} Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3c8e15ad-128a-4389-bf3e-fd7d32320eb9 could not be found. (HTTP 404) (Request-ID: req-f9559f64-ea51-4e4c-b1d2-1c3649ca92c3) Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 10 18:18:18.226747 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 10 18:18:18.231552 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 10 18:18:18.231552 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 10 18:18:18.231552 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 10 18:18:18.231552 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 10 18:18:18.231552 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 10 18:18:18.231552 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 10 18:18:18.231552 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 10 18:18:18.231552 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 10 18:18:18.231552 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 10 18:18:18.231552 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 10 18:18:18.231552 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 10 18:18:18.231552 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 10 18:18:18.231552 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 10 18:18:18.231552 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3c8e15ad-128a-4389-bf3e-fd7d32320eb9 could not be found. Jun 10 18:18:18.231552 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:18:18.231552 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:18:18.231552 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:18:18.231552 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:18:18.231552 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:18:18.231552 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:18:18.231552 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:18:18.231552 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:18:18.231552 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:18:18.231552 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:18:18.231552 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:18:18.231552 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:18:18.231552 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 10 18:18:18.231552 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:18:18.231552 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3c8e15ad-128a-4389-bf3e-fd7d32320eb9 could not be found. Jun 10 18:18:18.231552 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:18:18.231552 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:18:18.231552 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:18:18.231552 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:18:18.231552 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:18:18.231552 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:18:18.231552 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:18:18.231552 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:18:18.231552 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3c8e15ad-128a-4389-bf3e-fd7d32320eb9 could not be found. Jun 10 18:18:18.231552 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:18:18.236076 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-922137a6-f9b1-4f54-afef-64424dba5a86 tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] Returning 404 to user: Volume 3c8e15ad-128a-4389-bf3e-fd7d32320eb9 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:18:18.237175 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-922137a6-f9b1-4f54-afef-64424dba5a86 tempest-VolumesSnapshotsTestJSON-217415373 tempest-VolumesSnapshotsTestJSON-217415373-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/3c8e15ad-128a-4389-bf3e-fd7d32320eb9" status: 404 len: 109 microversion: 2.1 time: 0.077525 Jun 10 18:18:18.238248 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2624/5206] 10.222.0.35 () {58 vars in 1244 bytes} [Fri Jun 10 18:18:18 2022] GET /compute/v2.1/os-volumes/3c8e15ad-128a-4389-bf3e-fd7d32320eb9 => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:18:24.034737 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-01107060-9620-402b-8b8e-7727e2188963 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:18:24.035404 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-01107060-9620-402b-8b8e-7727e2188963 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:18:24.049785 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-01107060-9620-402b-8b8e-7727e2188963 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:18:24.055549 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-01107060-9620-402b-8b8e-7727e2188963 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:18:24.055549 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-01107060-9620-402b-8b8e-7727e2188963 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:18:24.055549 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-01107060-9620-402b-8b8e-7727e2188963 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:18:24.367999 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-01107060-9620-402b-8b8e-7727e2188963 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:18:24.378392 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-01107060-9620-402b-8b8e-7727e2188963 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:18:24.380898 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-01107060-9620-402b-8b8e-7727e2188963 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:18:24.382404 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-01107060-9620-402b-8b8e-7727e2188963 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 2950 microversion: 2.32 time: 0.353071 Jun 10 18:18:24.382969 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2583/5207] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:18:24 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 2950 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:18:24.410513 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-94c959c5-8428-49ef-88ca-fbab3ef6236d tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:18:24.436828 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-94c959c5-8428-49ef-88ca-fbab3ef6236d tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:18:24.436828 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-94c959c5-8428-49ef-88ca-fbab3ef6236d tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:18:24.436828 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-94c959c5-8428-49ef-88ca-fbab3ef6236d tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:18:24.436828 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-94c959c5-8428-49ef-88ca-fbab3ef6236d tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:18:24.436828 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-94c959c5-8428-49ef-88ca-fbab3ef6236d tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:18:24.581411 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-94c959c5-8428-49ef-88ca-fbab3ef6236d tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.173725 Jun 10 18:18:24.581411 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2625/5208] 10.222.0.35 () {60 vars in 1315 bytes} [Fri Jun 10 18:18:24 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae/os-interface => generated 1831 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:18:25.324952 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7c780fb8-58de-4688-85c5-7675fd9bee78 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1881023892", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cb27907a-0290-49c3-bbe7-9c976861e4b0"}], "security_groups": [{"name": "tempest-securitygroup--556732764"}], "key_name": "tempest-keypair-1642033248", "user_data": "}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:18:25.476430 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-7c780fb8-58de-4688-85c5-7675fd9bee78 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] validate_networks() for [('cb27907a-0290-49c3-bbe7-9c976861e4b0', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:18:25.939025 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-7c780fb8-58de-4688-85c5-7675fd9bee78 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:18:25.939455 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-7c780fb8-58de-4688-85c5-7675fd9bee78 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:18:25.939930 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-7c780fb8-58de-4688-85c5-7675fd9bee78 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:18:25.940357 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-7c780fb8-58de-4688-85c5-7675fd9bee78 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:18:25.940769 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-7c780fb8-58de-4688-85c5-7675fd9bee78 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:18:25.951481 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7c780fb8-58de-4688-85c5-7675fd9bee78 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:18:25.951963 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7c780fb8-58de-4688-85c5-7675fd9bee78 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:18:25.952818 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7c780fb8-58de-4688-85c5-7675fd9bee78 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:18:25.953260 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7c780fb8-58de-4688-85c5-7675fd9bee78 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:18:25.971071 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-7c780fb8-58de-4688-85c5-7675fd9bee78 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Getting quotas for project 9eb43e14768646f1bd2bdfc3bdf67406. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:18:25.976736 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-7c780fb8-58de-4688-85c5-7675fd9bee78 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Getting quotas for user a86d300d66fd47a0b870b5ca879a03e8 and project 9eb43e14768646f1bd2bdfc3bdf67406. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:18:25.990369 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7c780fb8-58de-4688-85c5-7675fd9bee78 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:18:25.992861 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7c780fb8-58de-4688-85c5-7675fd9bee78 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:18:26.183357 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7c780fb8-58de-4688-85c5-7675fd9bee78 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.863215 Jun 10 18:18:26.186836 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2584/5209] 10.222.0.35 () {62 vars in 1187 bytes} [Fri Jun 10 18:18:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 868 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 10 18:18:26.199168 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4b996dfb-4095-4eb8-830a-281a40ce623b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:18:26.199875 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4b996dfb-4095-4eb8-830a-281a40ce623b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:18:26.326776 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4b996dfb-4095-4eb8-830a-281a40ce623b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:18:26.351696 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4b996dfb-4095-4eb8-830a-281a40ce623b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:18:26.356116 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4b996dfb-4095-4eb8-830a-281a40ce623b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:18:26.358109 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4b996dfb-4095-4eb8-830a-281a40ce623b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1282 microversion: 2.20 time: 0.164607 Jun 10 18:18:26.373629 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2626/5210] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:18:26 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1282 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:18:27.377816 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-49aff34f-07ec-452e-83f0-e996e6ed5a03 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:18:27.379613 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-49aff34f-07ec-452e-83f0-e996e6ed5a03 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:18:27.546371 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-49aff34f-07ec-452e-83f0-e996e6ed5a03 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:18:27.560687 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-49aff34f-07ec-452e-83f0-e996e6ed5a03 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:18:27.564524 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-49aff34f-07ec-452e-83f0-e996e6ed5a03 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:18:27.571255 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-49aff34f-07ec-452e-83f0-e996e6ed5a03 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1282 microversion: 2.20 time: 0.192659 Jun 10 18:18:27.585181 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2585/5211] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:18:27 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1282 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:18:28.594415 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ed746893-2235-4760-b156-384b22e7ca76 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:18:28.596887 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ed746893-2235-4760-b156-384b22e7ca76 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:18:28.624546 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ed746893-2235-4760-b156-384b22e7ca76 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:18:28.627862 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ed746893-2235-4760-b156-384b22e7ca76 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:18:28.629611 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ed746893-2235-4760-b156-384b22e7ca76 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:18:28.633596 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ed746893-2235-4760-b156-384b22e7ca76 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:18:28.765102 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ed746893-2235-4760-b156-384b22e7ca76 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:18:28.798139 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ed746893-2235-4760-b156-384b22e7ca76 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:18:28.798139 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ed746893-2235-4760-b156-384b22e7ca76 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:18:28.802473 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ed746893-2235-4760-b156-384b22e7ca76 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1286 microversion: 2.20 time: 0.211109 Jun 10 18:18:28.803786 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2627/5212] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:18:28 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1286 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:18:29.820687 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-411e7089-8d52-4f46-9b40-597946e978db tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:18:29.821295 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-411e7089-8d52-4f46-9b40-597946e978db tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:18:29.833458 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-411e7089-8d52-4f46-9b40-597946e978db tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:18:29.833907 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-411e7089-8d52-4f46-9b40-597946e978db tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:18:29.834675 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-411e7089-8d52-4f46-9b40-597946e978db tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:18:29.835117 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-411e7089-8d52-4f46-9b40-597946e978db tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:18:29.967533 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-411e7089-8d52-4f46-9b40-597946e978db tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:18:29.976791 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-411e7089-8d52-4f46-9b40-597946e978db tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:18:29.978752 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-411e7089-8d52-4f46-9b40-597946e978db tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:18:29.980087 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-411e7089-8d52-4f46-9b40-597946e978db tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1334 microversion: 2.20 time: 0.163250 Jun 10 18:18:29.981139 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2586/5213] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:18:29 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1334 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:18:30.998671 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-71c5e800-29be-4742-8b68-14d05f6d5dcb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:18:30.999689 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-71c5e800-29be-4742-8b68-14d05f6d5dcb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:18:31.012048 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-71c5e800-29be-4742-8b68-14d05f6d5dcb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:18:31.012682 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-71c5e800-29be-4742-8b68-14d05f6d5dcb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:18:31.014129 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-71c5e800-29be-4742-8b68-14d05f6d5dcb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:18:31.016776 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-71c5e800-29be-4742-8b68-14d05f6d5dcb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:18:31.136165 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-71c5e800-29be-4742-8b68-14d05f6d5dcb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:18:31.150077 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-71c5e800-29be-4742-8b68-14d05f6d5dcb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:18:31.155246 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-71c5e800-29be-4742-8b68-14d05f6d5dcb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:18:31.163718 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-71c5e800-29be-4742-8b68-14d05f6d5dcb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1340 microversion: 2.20 time: 0.165009 Jun 10 18:18:31.167315 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2628/5214] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:18:30 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1340 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:18:32.186051 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cf404863-3dc2-4ccb-bd91-c1481a5a9c48 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:18:32.186890 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cf404863-3dc2-4ccb-bd91-c1481a5a9c48 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:18:32.207773 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cf404863-3dc2-4ccb-bd91-c1481a5a9c48 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:18:32.208466 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cf404863-3dc2-4ccb-bd91-c1481a5a9c48 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:18:32.209295 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cf404863-3dc2-4ccb-bd91-c1481a5a9c48 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:18:32.212115 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cf404863-3dc2-4ccb-bd91-c1481a5a9c48 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:18:32.467295 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cf404863-3dc2-4ccb-bd91-c1481a5a9c48 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:18:32.479037 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cf404863-3dc2-4ccb-bd91-c1481a5a9c48 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:18:32.482086 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cf404863-3dc2-4ccb-bd91-c1481a5a9c48 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:18:32.491149 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cf404863-3dc2-4ccb-bd91-c1481a5a9c48 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1407 microversion: 2.20 time: 0.305380 Jun 10 18:18:32.492330 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2587/5215] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:18:32 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1407 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:18:33.512369 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-88065428-148b-418c-a4a9-317559b4197a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:18:33.513926 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-88065428-148b-418c-a4a9-317559b4197a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:18:33.531308 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-88065428-148b-418c-a4a9-317559b4197a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:18:33.532113 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-88065428-148b-418c-a4a9-317559b4197a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:18:33.533030 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-88065428-148b-418c-a4a9-317559b4197a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:18:33.533496 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-88065428-148b-418c-a4a9-317559b4197a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:18:33.871105 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-88065428-148b-418c-a4a9-317559b4197a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:18:33.892236 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-88065428-148b-418c-a4a9-317559b4197a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:18:33.894107 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-88065428-148b-418c-a4a9-317559b4197a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:18:33.895450 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-88065428-148b-418c-a4a9-317559b4197a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1407 microversion: 2.20 time: 0.389151 Jun 10 18:18:33.905997 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2629/5216] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:18:33 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1407 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:18:34.499288 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-78073cf0-6ee4-4c9c-9fa5-d676729cfe62 req-03767248-d7e1-481b-bbf2-8c406cfa6bda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "580e911e-a112-4bfa-9d78-b6a24178fae8", "tag": "7237a573-4c3c-4d85-9aaa-2a8f34ab9485"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:18:34.509278 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-78073cf0-6ee4-4c9c-9fa5-d676729cfe62 req-03767248-d7e1-481b-bbf2-8c406cfa6bda service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:18:34.509278 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-78073cf0-6ee4-4c9c-9fa5-d676729cfe62 req-03767248-d7e1-481b-bbf2-8c406cfa6bda service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:18:34.530697 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-78073cf0-6ee4-4c9c-9fa5-d676729cfe62 req-03767248-d7e1-481b-bbf2-8c406cfa6bda service nova] Creating event network-changed:7237a573-4c3c-4d85-9aaa-2a8f34ab9485 for instance 580e911e-a112-4bfa-9d78-b6a24178fae8 on chh1-master-2 Jun 10 18:18:34.541774 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-78073cf0-6ee4-4c9c-9fa5-d676729cfe62 req-03767248-d7e1-481b-bbf2-8c406cfa6bda service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.450685 Jun 10 18:18:34.542501 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2588/5217] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:18:34.915578 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-aea1d720-9b33-4342-9cfb-4cfdcc833333 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:18:34.916497 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-aea1d720-9b33-4342-9cfb-4cfdcc833333 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:18:34.924773 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aea1d720-9b33-4342-9cfb-4cfdcc833333 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:18:34.926295 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aea1d720-9b33-4342-9cfb-4cfdcc833333 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:18:34.927662 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aea1d720-9b33-4342-9cfb-4cfdcc833333 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:18:34.928296 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aea1d720-9b33-4342-9cfb-4cfdcc833333 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:18:35.201469 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-aea1d720-9b33-4342-9cfb-4cfdcc833333 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:18:35.213646 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-aea1d720-9b33-4342-9cfb-4cfdcc833333 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:18:35.216209 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-aea1d720-9b33-4342-9cfb-4cfdcc833333 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:18:35.218593 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-aea1d720-9b33-4342-9cfb-4cfdcc833333 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1407 microversion: 2.20 time: 0.308394 Jun 10 18:18:35.231557 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2630/5218] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:18:34 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1407 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:18:36.236290 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:18:36.241506 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a1766bd9-0332-4f9c-91d2-904d89cceb04 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:18:36.242715 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a1766bd9-0332-4f9c-91d2-904d89cceb04 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:18:36.263016 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a1766bd9-0332-4f9c-91d2-904d89cceb04 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:18:36.263901 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a1766bd9-0332-4f9c-91d2-904d89cceb04 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:18:36.267219 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a1766bd9-0332-4f9c-91d2-904d89cceb04 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:18:36.267842 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a1766bd9-0332-4f9c-91d2-904d89cceb04 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:18:37.045019 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a1766bd9-0332-4f9c-91d2-904d89cceb04 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:18:37.066778 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a1766bd9-0332-4f9c-91d2-904d89cceb04 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:18:37.068799 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a1766bd9-0332-4f9c-91d2-904d89cceb04 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:18:37.075449 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a1766bd9-0332-4f9c-91d2-904d89cceb04 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1407 microversion: 2.20 time: 0.838815 Jun 10 18:18:37.076481 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2589/5219] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:18:36 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1407 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:18:38.103404 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0ac2f3e6-aa60-4e19-a3b4-4a2351a92e99 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:18:38.105674 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0ac2f3e6-aa60-4e19-a3b4-4a2351a92e99 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:18:38.110971 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=6 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:18:38.122304 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0ac2f3e6-aa60-4e19-a3b4-4a2351a92e99 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:18:38.123653 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0ac2f3e6-aa60-4e19-a3b4-4a2351a92e99 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:18:38.125062 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0ac2f3e6-aa60-4e19-a3b4-4a2351a92e99 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:18:38.126459 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0ac2f3e6-aa60-4e19-a3b4-4a2351a92e99 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:18:38.825669 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0ac2f3e6-aa60-4e19-a3b4-4a2351a92e99 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:18:38.835528 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0ac2f3e6-aa60-4e19-a3b4-4a2351a92e99 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:18:38.838489 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0ac2f3e6-aa60-4e19-a3b4-4a2351a92e99 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:18:38.839682 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0ac2f3e6-aa60-4e19-a3b4-4a2351a92e99 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1407 microversion: 2.20 time: 0.746753 Jun 10 18:18:38.850551 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2631/5220] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:18:38 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1407 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:18:39.863233 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f0f8f569-7365-423f-a269-d009e9b23c6c tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:18:39.863989 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f0f8f569-7365-423f-a269-d009e9b23c6c tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:18:39.867357 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=8 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:18:39.873388 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f0f8f569-7365-423f-a269-d009e9b23c6c tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:18:39.879800 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f0f8f569-7365-423f-a269-d009e9b23c6c tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:18:39.879800 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f0f8f569-7365-423f-a269-d009e9b23c6c tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:18:39.879800 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f0f8f569-7365-423f-a269-d009e9b23c6c tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:18:40.430004 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f0f8f569-7365-423f-a269-d009e9b23c6c tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:18:40.439235 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f0f8f569-7365-423f-a269-d009e9b23c6c tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:18:40.442393 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f0f8f569-7365-423f-a269-d009e9b23c6c tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:18:40.443925 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f0f8f569-7365-423f-a269-d009e9b23c6c tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1407 microversion: 2.20 time: 0.585793 Jun 10 18:18:40.455503 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2590/5221] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:18:39 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1407 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:18:40.733919 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-acc6f870-fc8c-4ce5-8512-f7cb263783f3 req-e36a983a-db5c-4aca-8ef0-143e05216573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "580e911e-a112-4bfa-9d78-b6a24178fae8", "name": "network-vif-plugged", "status": "completed", "tag": "7237a573-4c3c-4d85-9aaa-2a8f34ab9485"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:18:40.742606 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-acc6f870-fc8c-4ce5-8512-f7cb263783f3 req-e36a983a-db5c-4aca-8ef0-143e05216573 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:18:40.743065 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-acc6f870-fc8c-4ce5-8512-f7cb263783f3 req-e36a983a-db5c-4aca-8ef0-143e05216573 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:18:40.754908 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-acc6f870-fc8c-4ce5-8512-f7cb263783f3 req-e36a983a-db5c-4aca-8ef0-143e05216573 service nova] Creating event network-vif-plugged:7237a573-4c3c-4d85-9aaa-2a8f34ab9485 for instance 580e911e-a112-4bfa-9d78-b6a24178fae8 on chh1-master-2 Jun 10 18:18:40.760061 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-acc6f870-fc8c-4ce5-8512-f7cb263783f3 req-e36a983a-db5c-4aca-8ef0-143e05216573 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.347351 Jun 10 18:18:40.760949 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2632/5222] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:18:41.462817 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b9f642ee-554d-4dd9-b361-97e0ef34783a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:18:41.464027 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b9f642ee-554d-4dd9-b361-97e0ef34783a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:18:41.473393 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9f642ee-554d-4dd9-b361-97e0ef34783a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:18:41.473847 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9f642ee-554d-4dd9-b361-97e0ef34783a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:18:41.474656 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9f642ee-554d-4dd9-b361-97e0ef34783a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:18:41.475278 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9f642ee-554d-4dd9-b361-97e0ef34783a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:18:41.710487 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b9f642ee-554d-4dd9-b361-97e0ef34783a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:18:41.718899 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b9f642ee-554d-4dd9-b361-97e0ef34783a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:18:41.720502 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b9f642ee-554d-4dd9-b361-97e0ef34783a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:18:41.721620 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b9f642ee-554d-4dd9-b361-97e0ef34783a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1407 microversion: 2.20 time: 0.263701 Jun 10 18:18:41.722891 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2591/5223] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:18:41 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1407 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:18:42.743364 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a22f2154-f59d-461a-bc40-6b60eb2331c8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:18:42.744243 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a22f2154-f59d-461a-bc40-6b60eb2331c8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:18:42.753108 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:18:42.763940 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a22f2154-f59d-461a-bc40-6b60eb2331c8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:18:42.765107 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a22f2154-f59d-461a-bc40-6b60eb2331c8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:18:42.767346 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a22f2154-f59d-461a-bc40-6b60eb2331c8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:18:42.767800 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a22f2154-f59d-461a-bc40-6b60eb2331c8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:18:43.279860 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a22f2154-f59d-461a-bc40-6b60eb2331c8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:18:43.297972 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a22f2154-f59d-461a-bc40-6b60eb2331c8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:18:43.301550 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a22f2154-f59d-461a-bc40-6b60eb2331c8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:18:43.308645 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a22f2154-f59d-461a-bc40-6b60eb2331c8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1600 microversion: 2.20 time: 0.565802 Jun 10 18:18:43.308645 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2633/5224] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:18:42 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1600 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:18:43.321740 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-10d9053e-dde6-4127-8de8-0066af937c85 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:18:43.322297 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-10d9053e-dde6-4127-8de8-0066af937c85 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:18:43.338552 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10d9053e-dde6-4127-8de8-0066af937c85 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:18:43.339022 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10d9053e-dde6-4127-8de8-0066af937c85 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:18:43.339820 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10d9053e-dde6-4127-8de8-0066af937c85 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:18:43.340259 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10d9053e-dde6-4127-8de8-0066af937c85 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:18:44.022009 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-10d9053e-dde6-4127-8de8-0066af937c85 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.704607 Jun 10 18:18:44.022962 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2592/5225] 10.222.0.35 () {60 vars in 1315 bytes} [Fri Jun 10 18:18:43 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8/os-interface => generated 285 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:18:47.135976 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-93141ac3-0bab-48bc-89c4-f7db3ef43a21 req-ba6264d4-467c-4cac-828d-60a06e389a9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "580e911e-a112-4bfa-9d78-b6a24178fae8", "tag": "7237a573-4c3c-4d85-9aaa-2a8f34ab9485"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:18:47.147777 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-93141ac3-0bab-48bc-89c4-f7db3ef43a21 req-ba6264d4-467c-4cac-828d-60a06e389a9b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:18:47.148842 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-93141ac3-0bab-48bc-89c4-f7db3ef43a21 req-ba6264d4-467c-4cac-828d-60a06e389a9b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:18:47.152907 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=43 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:18:47.163214 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-93141ac3-0bab-48bc-89c4-f7db3ef43a21 req-ba6264d4-467c-4cac-828d-60a06e389a9b service nova] Creating event network-changed:7237a573-4c3c-4d85-9aaa-2a8f34ab9485 for instance 580e911e-a112-4bfa-9d78-b6a24178fae8 on chh1-master-2 Jun 10 18:18:47.171080 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-93141ac3-0bab-48bc-89c4-f7db3ef43a21 req-ba6264d4-467c-4cac-828d-60a06e389a9b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040133 Jun 10 18:18:47.171715 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2634/5226] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:19:15.088096 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:19:15.089204 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=44 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:19:15.366224 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6327b5be-0045-430c-8254-fd60d8ce7e5d tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:15.366821 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6327b5be-0045-430c-8254-fd60d8ce7e5d tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:15.373709 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6327b5be-0045-430c-8254-fd60d8ce7e5d tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:15.375454 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6327b5be-0045-430c-8254-fd60d8ce7e5d tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:15.377929 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6327b5be-0045-430c-8254-fd60d8ce7e5d tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:15.380784 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6327b5be-0045-430c-8254-fd60d8ce7e5d tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:15.432420 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6327b5be-0045-430c-8254-fd60d8ce7e5d tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:19:15.766501 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6327b5be-0045-430c-8254-fd60d8ce7e5d tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "DELETE /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 204 len: 0 microversion: 2.42 time: 0.680207 Jun 10 18:19:15.767770 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2593/5227] 10.222.0.35 () {60 vars in 1279 bytes} [Fri Jun 10 18:19:15 2022] DELETE /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 10 18:19:15.780154 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-37855353-aad2-41ac-bb13-db0d5e6dc84e tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:15.780906 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-37855353-aad2-41ac-bb13-db0d5e6dc84e tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:15.788049 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-37855353-aad2-41ac-bb13-db0d5e6dc84e tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:15.788564 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-37855353-aad2-41ac-bb13-db0d5e6dc84e tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:15.792706 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-37855353-aad2-41ac-bb13-db0d5e6dc84e tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:15.792706 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-37855353-aad2-41ac-bb13-db0d5e6dc84e tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:16.111576 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-37855353-aad2-41ac-bb13-db0d5e6dc84e tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:16.122530 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-37855353-aad2-41ac-bb13-db0d5e6dc84e tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:16.132515 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-37855353-aad2-41ac-bb13-db0d5e6dc84e tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:16.132515 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-37855353-aad2-41ac-bb13-db0d5e6dc84e tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 2956 microversion: 2.42 time: 0.352055 Jun 10 18:19:16.132515 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2635/5228] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:15 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 2956 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:17.149482 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-77f16453-b42c-41e8-aadf-a6e0ffbbf434 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:17.150896 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-77f16453-b42c-41e8-aadf-a6e0ffbbf434 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:17.164058 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-77f16453-b42c-41e8-aadf-a6e0ffbbf434 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:17.165058 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-77f16453-b42c-41e8-aadf-a6e0ffbbf434 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:17.166045 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-77f16453-b42c-41e8-aadf-a6e0ffbbf434 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:17.166814 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-77f16453-b42c-41e8-aadf-a6e0ffbbf434 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:17.631278 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-77f16453-b42c-41e8-aadf-a6e0ffbbf434 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:17.649164 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-77f16453-b42c-41e8-aadf-a6e0ffbbf434 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:17.656907 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-77f16453-b42c-41e8-aadf-a6e0ffbbf434 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:17.657391 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-77f16453-b42c-41e8-aadf-a6e0ffbbf434 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 2956 microversion: 2.42 time: 0.513657 Jun 10 18:19:17.659435 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2594/5229] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:17 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 2956 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:18.679765 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d097b195-deef-48c4-82d7-bf975b3a482a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:18.681080 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d097b195-deef-48c4-82d7-bf975b3a482a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:18.692984 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d097b195-deef-48c4-82d7-bf975b3a482a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:18.695657 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d097b195-deef-48c4-82d7-bf975b3a482a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:18.696697 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d097b195-deef-48c4-82d7-bf975b3a482a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:18.697309 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d097b195-deef-48c4-82d7-bf975b3a482a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:19.031375 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d097b195-deef-48c4-82d7-bf975b3a482a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:19.043894 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d097b195-deef-48c4-82d7-bf975b3a482a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:19.045949 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d097b195-deef-48c4-82d7-bf975b3a482a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:19.052428 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d097b195-deef-48c4-82d7-bf975b3a482a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 2956 microversion: 2.42 time: 0.376684 Jun 10 18:19:19.053467 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2636/5230] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:18 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 2956 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:19.585512 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b8ee43e9-66fd-49a0-985a-151534f72ec7 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:19.588078 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b8ee43e9-66fd-49a0-985a-151534f72ec7 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:19.599701 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b8ee43e9-66fd-49a0-985a-151534f72ec7 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:19.600155 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b8ee43e9-66fd-49a0-985a-151534f72ec7 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:19.601005 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b8ee43e9-66fd-49a0-985a-151534f72ec7 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:19.606230 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b8ee43e9-66fd-49a0-985a-151534f72ec7 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:19.644532 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b8ee43e9-66fd-49a0-985a-151534f72ec7 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8/ips" status: 200 len: 153 microversion: 2.20 time: 0.063840 Jun 10 18:19:19.645613 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2595/5231] 10.222.0.35 () {60 vars in 1288 bytes} [Fri Jun 10 18:19:19 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8/ips => generated 153 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:19:20.074182 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-92c8e373-1145-440b-944f-9d1d90ad1bce tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:20.074991 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-92c8e373-1145-440b-944f-9d1d90ad1bce tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:20.083405 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-92c8e373-1145-440b-944f-9d1d90ad1bce tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:20.084102 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-92c8e373-1145-440b-944f-9d1d90ad1bce tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:20.085062 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-92c8e373-1145-440b-944f-9d1d90ad1bce tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:20.085657 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-92c8e373-1145-440b-944f-9d1d90ad1bce tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:20.486559 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-92c8e373-1145-440b-944f-9d1d90ad1bce tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:20.521126 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-92c8e373-1145-440b-944f-9d1d90ad1bce tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:20.526511 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-92c8e373-1145-440b-944f-9d1d90ad1bce tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:20.533241 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-92c8e373-1145-440b-944f-9d1d90ad1bce tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 2935 microversion: 2.42 time: 0.459656 Jun 10 18:19:20.537961 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2637/5232] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:20 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 2935 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:21.570191 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9b0889e7-26f2-4220-9b8a-4d778848f4c8 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:21.570191 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9b0889e7-26f2-4220-9b8a-4d778848f4c8 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:21.579844 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b0889e7-26f2-4220-9b8a-4d778848f4c8 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:21.580660 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b0889e7-26f2-4220-9b8a-4d778848f4c8 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:21.582737 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b0889e7-26f2-4220-9b8a-4d778848f4c8 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:21.583951 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b0889e7-26f2-4220-9b8a-4d778848f4c8 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:21.914523 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9b0889e7-26f2-4220-9b8a-4d778848f4c8 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:21.928117 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9b0889e7-26f2-4220-9b8a-4d778848f4c8 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:21.950129 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9b0889e7-26f2-4220-9b8a-4d778848f4c8 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:21.954440 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9b0889e7-26f2-4220-9b8a-4d778848f4c8 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 2914 microversion: 2.42 time: 0.397589 Jun 10 18:19:21.954440 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2596/5233] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:21 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 2914 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:22.972871 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-df5953b4-bc15-41d5-829e-4599e6674b90 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:22.974044 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-df5953b4-bc15-41d5-829e-4599e6674b90 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:22.983947 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-df5953b4-bc15-41d5-829e-4599e6674b90 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:22.994135 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-df5953b4-bc15-41d5-829e-4599e6674b90 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:22.997607 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-df5953b4-bc15-41d5-829e-4599e6674b90 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:22.997607 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-df5953b4-bc15-41d5-829e-4599e6674b90 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:23.279248 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f1e5d7a6-c489-4c26-9302-9b8e23c0bb1a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:19:23.280153 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f1e5d7a6-c489-4c26-9302-9b8e23c0bb1a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:23.290195 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f1e5d7a6-c489-4c26-9302-9b8e23c0bb1a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:23.296297 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f1e5d7a6-c489-4c26-9302-9b8e23c0bb1a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:23.308667 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f1e5d7a6-c489-4c26-9302-9b8e23c0bb1a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:23.308667 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f1e5d7a6-c489-4c26-9302-9b8e23c0bb1a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:23.330564 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-f1e5d7a6-c489-4c26-9302-9b8e23c0bb1a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lazy-loading 'flavor' on Instance uuid 580e911e-a112-4bfa-9d78-b6a24178fae8 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:19:23.590614 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-df5953b4-bc15-41d5-829e-4599e6674b90 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:23.603284 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-df5953b4-bc15-41d5-829e-4599e6674b90 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:23.605699 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-df5953b4-bc15-41d5-829e-4599e6674b90 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:23.610096 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-df5953b4-bc15-41d5-829e-4599e6674b90 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 2868 microversion: 2.42 time: 0.641514 Jun 10 18:19:23.618007 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2638/5234] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:22 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 2868 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:23.625385 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-902293d2-1aec-4d26-a1bd-7a1094ad0788 req-cd3a5a66-062a-4143-a62e-27561cc04129 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ceaaf7b-0972-4fe5-bd63-5534a71f80d3", "name": "network-vif-unplugged", "status": "completed", "tag": "2fae9b12-2883-43bb-8d97-3bb827dd8497"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:19:23.634814 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-902293d2-1aec-4d26-a1bd-7a1094ad0788 req-cd3a5a66-062a-4143-a62e-27561cc04129 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:23.635475 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-902293d2-1aec-4d26-a1bd-7a1094ad0788 req-cd3a5a66-062a-4143-a62e-27561cc04129 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:23.649406 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-902293d2-1aec-4d26-a1bd-7a1094ad0788 req-cd3a5a66-062a-4143-a62e-27561cc04129 service nova] Creating event network-vif-unplugged:2fae9b12-2883-43bb-8d97-3bb827dd8497 for instance 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 on chh2-master-2 Jun 10 18:19:23.655353 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-902293d2-1aec-4d26-a1bd-7a1094ad0788 req-cd3a5a66-062a-4143-a62e-27561cc04129 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036047 Jun 10 18:19:23.656351 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2639/5235] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:19:24.432679 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-4de4e0d1-2058-4ba6-94a0-c6406a7ac265 req-e634a7ab-1af5-4064-8e88-f3bb21252ade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ceaaf7b-0972-4fe5-bd63-5534a71f80d3", "name": "network-vif-deleted", "tag": "67581347-173d-48a0-b450-4ad516d4f8af"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:19:24.467033 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-4de4e0d1-2058-4ba6-94a0-c6406a7ac265 req-e634a7ab-1af5-4064-8e88-f3bb21252ade service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:24.467914 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-4de4e0d1-2058-4ba6-94a0-c6406a7ac265 req-e634a7ab-1af5-4064-8e88-f3bb21252ade service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:24.487171 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f1e5d7a6-c489-4c26-9302-9b8e23c0bb1a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "POST /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8/action" status: 202 len: 0 microversion: 2.20 time: 1.212045 Jun 10 18:19:24.489410 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2597/5236] 10.222.0.35 () {62 vars in 1318 bytes} [Fri Jun 10 18:19:23 2022] POST /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8/action => generated 0 bytes in 1215 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:19:24.502351 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-32874ebc-114a-4784-9b3f-eaa297e4d01e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:24.507473 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-4de4e0d1-2058-4ba6-94a0-c6406a7ac265 req-e634a7ab-1af5-4064-8e88-f3bb21252ade service nova] Creating event network-vif-deleted:67581347-173d-48a0-b450-4ad516d4f8af for instance 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 on chh2-master-2 Jun 10 18:19:24.507647 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-32874ebc-114a-4784-9b3f-eaa297e4d01e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:24.514452 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-32874ebc-114a-4784-9b3f-eaa297e4d01e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:24.516377 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-32874ebc-114a-4784-9b3f-eaa297e4d01e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:24.517942 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-32874ebc-114a-4784-9b3f-eaa297e4d01e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:24.519118 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-32874ebc-114a-4784-9b3f-eaa297e4d01e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:24.522834 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-4de4e0d1-2058-4ba6-94a0-c6406a7ac265 req-e634a7ab-1af5-4064-8e88-f3bb21252ade service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.706978 Jun 10 18:19:24.523987 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2640/5237] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:19:24.633038 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d447dd59-8f77-4853-a6da-c9a8e112ced5 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:24.644494 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d447dd59-8f77-4853-a6da-c9a8e112ced5 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:24.671487 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d447dd59-8f77-4853-a6da-c9a8e112ced5 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:24.671487 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d447dd59-8f77-4853-a6da-c9a8e112ced5 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:24.673346 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d447dd59-8f77-4853-a6da-c9a8e112ced5 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:24.680298 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d447dd59-8f77-4853-a6da-c9a8e112ced5 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:25.119335 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-32874ebc-114a-4784-9b3f-eaa297e4d01e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:25.153566 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-32874ebc-114a-4784-9b3f-eaa297e4d01e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:25.163646 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-32874ebc-114a-4784-9b3f-eaa297e4d01e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:25.165224 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-32874ebc-114a-4784-9b3f-eaa297e4d01e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1725 microversion: 2.20 time: 0.671089 Jun 10 18:19:25.171400 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2598/5238] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:24 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1725 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:25.688928 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d447dd59-8f77-4853-a6da-c9a8e112ced5 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:25.722503 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d447dd59-8f77-4853-a6da-c9a8e112ced5 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:25.727819 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d447dd59-8f77-4853-a6da-c9a8e112ced5 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:25.729868 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d447dd59-8f77-4853-a6da-c9a8e112ced5 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 2868 microversion: 2.42 time: 1.102105 Jun 10 18:19:25.736318 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-583036f0-b5b0-4640-8d69-d2c75fd65cd9 req-0a1d976b-fb49-4e0f-87bd-f7646db3e196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ceaaf7b-0972-4fe5-bd63-5534a71f80d3", "name": "network-vif-unplugged", "status": "completed", "tag": "a18991bb-a2c4-4f74-89e1-81c2c3fb3a0b"}, {"server_uuid": "8ceaaf7b-0972-4fe5-bd63-5534a71f80d3", "name": "network-vif-unplugged", "status": "completed", "tag": "637baac4-b034-4d97-98de-e1137a57f487"}, {"server_uuid": "8ceaaf7b-0972-4fe5-bd63-5534a71f80d3", "name": "network-vif-unplugged", "status": "completed", "tag": "1eec4f25-edb7-4e8d-872d-3f31321f8bf5"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:19:25.739337 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2641/5239] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:24 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 2868 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:25.758295 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-583036f0-b5b0-4640-8d69-d2c75fd65cd9 req-0a1d976b-fb49-4e0f-87bd-f7646db3e196 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:25.758786 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-583036f0-b5b0-4640-8d69-d2c75fd65cd9 req-0a1d976b-fb49-4e0f-87bd-f7646db3e196 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:25.797628 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-583036f0-b5b0-4640-8d69-d2c75fd65cd9 req-0a1d976b-fb49-4e0f-87bd-f7646db3e196 service nova] Creating event network-vif-unplugged:a18991bb-a2c4-4f74-89e1-81c2c3fb3a0b for instance 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 on chh2-master-2 Jun 10 18:19:25.804848 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-583036f0-b5b0-4640-8d69-d2c75fd65cd9 req-0a1d976b-fb49-4e0f-87bd-f7646db3e196 service nova] Creating event network-vif-unplugged:637baac4-b034-4d97-98de-e1137a57f487 for instance 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 on chh2-master-2 Jun 10 18:19:25.805714 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-583036f0-b5b0-4640-8d69-d2c75fd65cd9 req-0a1d976b-fb49-4e0f-87bd-f7646db3e196 service nova] Creating event network-vif-unplugged:1eec4f25-edb7-4e8d-872d-3f31321f8bf5 for instance 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 on chh2-master-2 Jun 10 18:19:25.818221 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-583036f0-b5b0-4640-8d69-d2c75fd65cd9 req-0a1d976b-fb49-4e0f-87bd-f7646db3e196 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.085618 Jun 10 18:19:25.825329 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2599/5240] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:19:26.186059 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-53a01695-dd1f-4b24-8b8f-49e9a970d02e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:26.187080 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-53a01695-dd1f-4b24-8b8f-49e9a970d02e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:26.218368 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-53a01695-dd1f-4b24-8b8f-49e9a970d02e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:26.218974 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-53a01695-dd1f-4b24-8b8f-49e9a970d02e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:26.220373 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-53a01695-dd1f-4b24-8b8f-49e9a970d02e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:26.238468 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-53a01695-dd1f-4b24-8b8f-49e9a970d02e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:26.624088 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-7cd690d3-9f0e-4b36-bdb6-2366929f9535 req-28be8ed7-6bbf-4aa6-aaa7-32e3b1c02a14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ceaaf7b-0972-4fe5-bd63-5534a71f80d3", "name": "network-vif-deleted", "tag": "637baac4-b034-4d97-98de-e1137a57f487"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:19:26.673444 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-7cd690d3-9f0e-4b36-bdb6-2366929f9535 req-28be8ed7-6bbf-4aa6-aaa7-32e3b1c02a14 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:26.676286 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-7cd690d3-9f0e-4b36-bdb6-2366929f9535 req-28be8ed7-6bbf-4aa6-aaa7-32e3b1c02a14 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:26.700643 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-53a01695-dd1f-4b24-8b8f-49e9a970d02e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:26.710105 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-53a01695-dd1f-4b24-8b8f-49e9a970d02e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:26.711641 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-53a01695-dd1f-4b24-8b8f-49e9a970d02e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:26.712921 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-53a01695-dd1f-4b24-8b8f-49e9a970d02e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1725 microversion: 2.20 time: 0.530894 Jun 10 18:19:26.724167 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-7cd690d3-9f0e-4b36-bdb6-2366929f9535 req-28be8ed7-6bbf-4aa6-aaa7-32e3b1c02a14 service nova] Creating event network-vif-deleted:637baac4-b034-4d97-98de-e1137a57f487 for instance 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 on chh2-master-2 Jun 10 18:19:26.726993 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2642/5241] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:26 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1725 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:26.737117 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-7cd690d3-9f0e-4b36-bdb6-2366929f9535 req-28be8ed7-6bbf-4aa6-aaa7-32e3b1c02a14 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139894 Jun 10 18:19:26.737117 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2600/5242] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:19:26.759130 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ccd52135-05d0-402b-980d-4dc97611e76e tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:26.759959 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ccd52135-05d0-402b-980d-4dc97611e76e tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:26.774794 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ccd52135-05d0-402b-980d-4dc97611e76e tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:26.775469 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ccd52135-05d0-402b-980d-4dc97611e76e tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:26.776262 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ccd52135-05d0-402b-980d-4dc97611e76e tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:26.776909 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ccd52135-05d0-402b-980d-4dc97611e76e tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:27.219056 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ccd52135-05d0-402b-980d-4dc97611e76e tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:27.238583 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ccd52135-05d0-402b-980d-4dc97611e76e tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:27.241491 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ccd52135-05d0-402b-980d-4dc97611e76e tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:27.245396 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ccd52135-05d0-402b-980d-4dc97611e76e tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 2483 microversion: 2.42 time: 0.490091 Jun 10 18:19:27.273193 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2643/5243] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:26 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 2483 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:27.744932 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6ba31e40-494d-4ceb-a933-d2bf19075e4e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:27.746980 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6ba31e40-494d-4ceb-a933-d2bf19075e4e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:27.780369 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6ba31e40-494d-4ceb-a933-d2bf19075e4e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:27.780848 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6ba31e40-494d-4ceb-a933-d2bf19075e4e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:27.781712 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6ba31e40-494d-4ceb-a933-d2bf19075e4e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:27.783242 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6ba31e40-494d-4ceb-a933-d2bf19075e4e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:28.029804 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6ba31e40-494d-4ceb-a933-d2bf19075e4e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:28.041887 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6ba31e40-494d-4ceb-a933-d2bf19075e4e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:28.043922 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6ba31e40-494d-4ceb-a933-d2bf19075e4e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:28.046578 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6ba31e40-494d-4ceb-a933-d2bf19075e4e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1725 microversion: 2.20 time: 0.305559 Jun 10 18:19:28.048130 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2601/5244] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:27 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1725 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:28.284224 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e187fc5e-1bdd-4a5c-91a1-ffdd2dd2cc7a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:28.284902 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e187fc5e-1bdd-4a5c-91a1-ffdd2dd2cc7a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:28.299974 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e187fc5e-1bdd-4a5c-91a1-ffdd2dd2cc7a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:28.303322 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e187fc5e-1bdd-4a5c-91a1-ffdd2dd2cc7a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:28.303322 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e187fc5e-1bdd-4a5c-91a1-ffdd2dd2cc7a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:28.303986 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e187fc5e-1bdd-4a5c-91a1-ffdd2dd2cc7a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:29.065994 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a2769897-a91c-4924-b613-2be4e5a868ea tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:29.066596 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a2769897-a91c-4924-b613-2be4e5a868ea tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:29.076278 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a2769897-a91c-4924-b613-2be4e5a868ea tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:29.085563 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a2769897-a91c-4924-b613-2be4e5a868ea tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:29.086745 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a2769897-a91c-4924-b613-2be4e5a868ea tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:29.087482 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a2769897-a91c-4924-b613-2be4e5a868ea tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:29.253137 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e187fc5e-1bdd-4a5c-91a1-ffdd2dd2cc7a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:29.265067 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e187fc5e-1bdd-4a5c-91a1-ffdd2dd2cc7a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:29.268249 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e187fc5e-1bdd-4a5c-91a1-ffdd2dd2cc7a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:29.270964 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e187fc5e-1bdd-4a5c-91a1-ffdd2dd2cc7a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 2323 microversion: 2.42 time: 0.994717 Jun 10 18:19:29.286154 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2644/5245] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:28 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 2323 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:29.297208 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-a9b49a14-387b-4654-a026-b32e2f29f8d1 req-6426edfc-f114-478d-8496-7c3f85ddc582 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ceaaf7b-0972-4fe5-bd63-5534a71f80d3", "name": "network-vif-deleted", "tag": "2fae9b12-2883-43bb-8d97-3bb827dd8497"}, {"server_uuid": "8ceaaf7b-0972-4fe5-bd63-5534a71f80d3", "name": "network-vif-deleted", "tag": "1eec4f25-edb7-4e8d-872d-3f31321f8bf5"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:19:29.312205 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-a9b49a14-387b-4654-a026-b32e2f29f8d1 req-6426edfc-f114-478d-8496-7c3f85ddc582 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:29.313001 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-a9b49a14-387b-4654-a026-b32e2f29f8d1 req-6426edfc-f114-478d-8496-7c3f85ddc582 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:29.353411 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-a9b49a14-387b-4654-a026-b32e2f29f8d1 req-6426edfc-f114-478d-8496-7c3f85ddc582 service nova] Creating event network-vif-deleted:2fae9b12-2883-43bb-8d97-3bb827dd8497 for instance 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 on chh2-master-2 Jun 10 18:19:29.354531 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-a9b49a14-387b-4654-a026-b32e2f29f8d1 req-6426edfc-f114-478d-8496-7c3f85ddc582 service nova] Creating event network-vif-deleted:1eec4f25-edb7-4e8d-872d-3f31321f8bf5 for instance 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 on chh2-master-2 Jun 10 18:19:29.362882 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-a9b49a14-387b-4654-a026-b32e2f29f8d1 req-6426edfc-f114-478d-8496-7c3f85ddc582 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.072655 Jun 10 18:19:29.363929 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2645/5246] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:19:29.391633 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a2769897-a91c-4924-b613-2be4e5a868ea tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:29.424822 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a2769897-a91c-4924-b613-2be4e5a868ea tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:29.425987 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a2769897-a91c-4924-b613-2be4e5a868ea tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:29.430987 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a2769897-a91c-4924-b613-2be4e5a868ea tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1725 microversion: 2.20 time: 0.369339 Jun 10 18:19:29.434898 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2602/5247] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:29 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1725 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:19:30.292477 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-79ab212f-67d7-4e09-a999-38886664b161 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:30.293317 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-79ab212f-67d7-4e09-a999-38886664b161 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:30.305931 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-79ab212f-67d7-4e09-a999-38886664b161 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:30.306913 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-79ab212f-67d7-4e09-a999-38886664b161 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:30.307953 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-79ab212f-67d7-4e09-a999-38886664b161 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:30.309491 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-79ab212f-67d7-4e09-a999-38886664b161 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:30.436923 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-79ab212f-67d7-4e09-a999-38886664b161 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:30.451290 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ba6d77a6-8f71-4629-971d-b5de84532a26 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:30.453016 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ba6d77a6-8f71-4629-971d-b5de84532a26 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:30.467337 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ba6d77a6-8f71-4629-971d-b5de84532a26 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:30.467569 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-79ab212f-67d7-4e09-a999-38886664b161 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:30.468216 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ba6d77a6-8f71-4629-971d-b5de84532a26 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:30.469049 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-79ab212f-67d7-4e09-a999-38886664b161 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:30.469477 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ba6d77a6-8f71-4629-971d-b5de84532a26 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:30.470140 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ba6d77a6-8f71-4629-971d-b5de84532a26 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:30.475212 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-79ab212f-67d7-4e09-a999-38886664b161 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 2029 microversion: 2.42 time: 0.182926 Jun 10 18:19:30.480372 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2646/5248] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:30 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 2029 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:30.832380 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ba6d77a6-8f71-4629-971d-b5de84532a26 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:30.849159 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ba6d77a6-8f71-4629-971d-b5de84532a26 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:30.851195 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ba6d77a6-8f71-4629-971d-b5de84532a26 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:30.854727 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ba6d77a6-8f71-4629-971d-b5de84532a26 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1725 microversion: 2.20 time: 0.408111 Jun 10 18:19:30.866211 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2603/5249] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:30 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1725 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:31.400865 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-40a63751-674a-4447-a19e-a0c396efa175 req-353492ec-af40-4544-ac6c-80b5ccecfa1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ceaaf7b-0972-4fe5-bd63-5534a71f80d3", "name": "network-vif-deleted", "tag": "a18991bb-a2c4-4f74-89e1-81c2c3fb3a0b"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:19:31.411519 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-40a63751-674a-4447-a19e-a0c396efa175 req-353492ec-af40-4544-ac6c-80b5ccecfa1e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:31.411990 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-40a63751-674a-4447-a19e-a0c396efa175 req-353492ec-af40-4544-ac6c-80b5ccecfa1e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:31.439078 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-40a63751-674a-4447-a19e-a0c396efa175 req-353492ec-af40-4544-ac6c-80b5ccecfa1e service nova] Creating event network-vif-deleted:a18991bb-a2c4-4f74-89e1-81c2c3fb3a0b for instance 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 on chh2-master-2 Jun 10 18:19:31.461424 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-40a63751-674a-4447-a19e-a0c396efa175 req-353492ec-af40-4544-ac6c-80b5ccecfa1e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071511 Jun 10 18:19:31.462331 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2647/5250] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:19:31.499868 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8a561f89-fa6f-4212-8538-932344001a2f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:31.501964 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8a561f89-fa6f-4212-8538-932344001a2f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:31.510267 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8a561f89-fa6f-4212-8538-932344001a2f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:31.510267 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8a561f89-fa6f-4212-8538-932344001a2f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:31.511006 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8a561f89-fa6f-4212-8538-932344001a2f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:31.512062 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8a561f89-fa6f-4212-8538-932344001a2f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:31.707167 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8a561f89-fa6f-4212-8538-932344001a2f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:31.729570 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8a561f89-fa6f-4212-8538-932344001a2f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:31.740118 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8a561f89-fa6f-4212-8538-932344001a2f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:31.740118 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8a561f89-fa6f-4212-8538-932344001a2f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1604 microversion: 2.42 time: 0.242355 Jun 10 18:19:31.745443 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2604/5251] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:31 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1604 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:31.878282 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6775edd6-069a-402c-9cd0-cf4ef1c4e5e0 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:31.879318 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6775edd6-069a-402c-9cd0-cf4ef1c4e5e0 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:31.893412 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6775edd6-069a-402c-9cd0-cf4ef1c4e5e0 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:31.893883 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6775edd6-069a-402c-9cd0-cf4ef1c4e5e0 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:31.901038 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6775edd6-069a-402c-9cd0-cf4ef1c4e5e0 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:31.903053 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6775edd6-069a-402c-9cd0-cf4ef1c4e5e0 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:32.620528 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6775edd6-069a-402c-9cd0-cf4ef1c4e5e0 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:32.632862 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6775edd6-069a-402c-9cd0-cf4ef1c4e5e0 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:32.635455 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6775edd6-069a-402c-9cd0-cf4ef1c4e5e0 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:32.639708 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6775edd6-069a-402c-9cd0-cf4ef1c4e5e0 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1725 microversion: 2.20 time: 0.767442 Jun 10 18:19:32.644979 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2648/5252] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:31 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1725 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:32.758922 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4910062a-163b-4544-8f90-2f85cecbc150 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:32.765864 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4910062a-163b-4544-8f90-2f85cecbc150 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:32.781538 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4910062a-163b-4544-8f90-2f85cecbc150 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:32.782278 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4910062a-163b-4544-8f90-2f85cecbc150 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:32.783258 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4910062a-163b-4544-8f90-2f85cecbc150 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:32.785465 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4910062a-163b-4544-8f90-2f85cecbc150 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:32.938532 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4910062a-163b-4544-8f90-2f85cecbc150 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:32.950395 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4910062a-163b-4544-8f90-2f85cecbc150 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:32.953909 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4910062a-163b-4544-8f90-2f85cecbc150 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:32.960183 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4910062a-163b-4544-8f90-2f85cecbc150 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1604 microversion: 2.42 time: 0.205798 Jun 10 18:19:32.961255 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2605/5253] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:32 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1604 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:33.663378 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-18c7aeac-457b-4fed-971a-1493bdbbbccb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:33.663378 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-18c7aeac-457b-4fed-971a-1493bdbbbccb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:33.695091 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-18c7aeac-457b-4fed-971a-1493bdbbbccb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:33.695551 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-18c7aeac-457b-4fed-971a-1493bdbbbccb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:33.698362 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-18c7aeac-457b-4fed-971a-1493bdbbbccb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:33.698993 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-18c7aeac-457b-4fed-971a-1493bdbbbccb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:33.951466 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-18c7aeac-457b-4fed-971a-1493bdbbbccb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:33.960332 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-18c7aeac-457b-4fed-971a-1493bdbbbccb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:33.961909 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-18c7aeac-457b-4fed-971a-1493bdbbbccb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:33.963295 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-18c7aeac-457b-4fed-971a-1493bdbbbccb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1725 microversion: 2.20 time: 0.304997 Jun 10 18:19:33.964028 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2649/5254] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:33 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1725 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:33.987695 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-39ced829-99a2-4d1c-89af-6d35e03aed0c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:33.996949 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-39ced829-99a2-4d1c-89af-6d35e03aed0c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:34.011535 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-39ced829-99a2-4d1c-89af-6d35e03aed0c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:34.014844 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-39ced829-99a2-4d1c-89af-6d35e03aed0c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:34.015830 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-39ced829-99a2-4d1c-89af-6d35e03aed0c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:34.019275 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-39ced829-99a2-4d1c-89af-6d35e03aed0c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:34.738686 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-39ced829-99a2-4d1c-89af-6d35e03aed0c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:34.758067 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-39ced829-99a2-4d1c-89af-6d35e03aed0c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:34.761872 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-39ced829-99a2-4d1c-89af-6d35e03aed0c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:34.763149 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-39ced829-99a2-4d1c-89af-6d35e03aed0c tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1604 microversion: 2.42 time: 0.783804 Jun 10 18:19:34.763900 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2606/5255] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:33 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1604 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:34.983821 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6af82da6-0e9f-404f-9105-b8dc1b3e06fd tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:34.985283 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6af82da6-0e9f-404f-9105-b8dc1b3e06fd tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:35.000606 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6af82da6-0e9f-404f-9105-b8dc1b3e06fd tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:35.003622 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6af82da6-0e9f-404f-9105-b8dc1b3e06fd tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:35.006160 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6af82da6-0e9f-404f-9105-b8dc1b3e06fd tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:35.008031 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6af82da6-0e9f-404f-9105-b8dc1b3e06fd tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:35.543569 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6af82da6-0e9f-404f-9105-b8dc1b3e06fd tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:35.555527 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6af82da6-0e9f-404f-9105-b8dc1b3e06fd tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:35.561128 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6af82da6-0e9f-404f-9105-b8dc1b3e06fd tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:35.564782 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6af82da6-0e9f-404f-9105-b8dc1b3e06fd tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1725 microversion: 2.20 time: 0.586891 Jun 10 18:19:35.569026 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2650/5256] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:34 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1725 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:35.791215 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4f16ca9c-eb3e-49c2-99e4-5dbb71d94aec tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:35.791215 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4f16ca9c-eb3e-49c2-99e4-5dbb71d94aec tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:35.794642 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f16ca9c-eb3e-49c2-99e4-5dbb71d94aec tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:35.795100 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f16ca9c-eb3e-49c2-99e4-5dbb71d94aec tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:35.795885 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f16ca9c-eb3e-49c2-99e4-5dbb71d94aec tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:35.796348 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f16ca9c-eb3e-49c2-99e4-5dbb71d94aec tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:35.870237 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:19:36.006822 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4f16ca9c-eb3e-49c2-99e4-5dbb71d94aec tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:36.022624 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4f16ca9c-eb3e-49c2-99e4-5dbb71d94aec tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:36.032344 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4f16ca9c-eb3e-49c2-99e4-5dbb71d94aec tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:36.036077 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4f16ca9c-eb3e-49c2-99e4-5dbb71d94aec tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1604 microversion: 2.42 time: 0.255645 Jun 10 18:19:36.037897 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2607/5257] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:35 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1604 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:36.587057 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1fbafc6a-7eb9-4b18-97a4-b9fae1d897c8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:36.587677 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1fbafc6a-7eb9-4b18-97a4-b9fae1d897c8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:36.609502 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1fbafc6a-7eb9-4b18-97a4-b9fae1d897c8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:36.610665 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1fbafc6a-7eb9-4b18-97a4-b9fae1d897c8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:36.613580 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1fbafc6a-7eb9-4b18-97a4-b9fae1d897c8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:36.617053 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1fbafc6a-7eb9-4b18-97a4-b9fae1d897c8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:36.944421 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1fbafc6a-7eb9-4b18-97a4-b9fae1d897c8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:36.952950 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1fbafc6a-7eb9-4b18-97a4-b9fae1d897c8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:36.958103 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1fbafc6a-7eb9-4b18-97a4-b9fae1d897c8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:36.960057 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1fbafc6a-7eb9-4b18-97a4-b9fae1d897c8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1746 microversion: 2.20 time: 0.377046 Jun 10 18:19:36.971371 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2651/5258] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:36 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1746 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:37.056327 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-19ef5acb-1bce-4e12-8273-dbf75032281a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:37.063460 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-19ef5acb-1bce-4e12-8273-dbf75032281a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:37.083682 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-19ef5acb-1bce-4e12-8273-dbf75032281a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:37.087325 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-19ef5acb-1bce-4e12-8273-dbf75032281a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:37.090311 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-19ef5acb-1bce-4e12-8273-dbf75032281a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:37.090787 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-19ef5acb-1bce-4e12-8273-dbf75032281a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:37.270167 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-19ef5acb-1bce-4e12-8273-dbf75032281a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:37.284135 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-19ef5acb-1bce-4e12-8273-dbf75032281a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:37.289220 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-19ef5acb-1bce-4e12-8273-dbf75032281a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:37.290472 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-19ef5acb-1bce-4e12-8273-dbf75032281a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1604 microversion: 2.42 time: 0.239289 Jun 10 18:19:37.291032 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2608/5259] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:37 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1604 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:37.985957 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-75775327-4e63-4c9b-8f64-0687e9cfdaeb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:37.986586 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-75775327-4e63-4c9b-8f64-0687e9cfdaeb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:37.999151 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-75775327-4e63-4c9b-8f64-0687e9cfdaeb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:37.999623 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-75775327-4e63-4c9b-8f64-0687e9cfdaeb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:38.003162 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-75775327-4e63-4c9b-8f64-0687e9cfdaeb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:38.003634 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-75775327-4e63-4c9b-8f64-0687e9cfdaeb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:38.319393 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7b2853e0-ba50-4239-b9e8-f674b8a9cdb5 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:38.322338 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7b2853e0-ba50-4239-b9e8-f674b8a9cdb5 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:38.336293 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b2853e0-ba50-4239-b9e8-f674b8a9cdb5 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:38.337093 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b2853e0-ba50-4239-b9e8-f674b8a9cdb5 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:38.339255 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b2853e0-ba50-4239-b9e8-f674b8a9cdb5 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:38.339890 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b2853e0-ba50-4239-b9e8-f674b8a9cdb5 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:38.400526 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-75775327-4e63-4c9b-8f64-0687e9cfdaeb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:38.431413 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-75775327-4e63-4c9b-8f64-0687e9cfdaeb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:38.439233 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-75775327-4e63-4c9b-8f64-0687e9cfdaeb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:38.442862 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-75775327-4e63-4c9b-8f64-0687e9cfdaeb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1741 microversion: 2.20 time: 0.460022 Jun 10 18:19:38.444182 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2652/5260] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:37 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1741 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:38.576451 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7b2853e0-ba50-4239-b9e8-f674b8a9cdb5 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:38.585644 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7b2853e0-ba50-4239-b9e8-f674b8a9cdb5 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:38.597623 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7b2853e0-ba50-4239-b9e8-f674b8a9cdb5 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:38.600914 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7b2853e0-ba50-4239-b9e8-f674b8a9cdb5 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1604 microversion: 2.42 time: 0.295496 Jun 10 18:19:38.601505 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2609/5261] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:38 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1604 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:38.737549 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-0485e88c-3498-4fce-801e-a347d4ccd804 req-665aa4dc-7180-4cdb-bfc9-e6b6c98ac483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "580e911e-a112-4bfa-9d78-b6a24178fae8", "name": "network-vif-plugged", "status": "completed", "tag": "7237a573-4c3c-4d85-9aaa-2a8f34ab9485"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:19:38.761600 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-0485e88c-3498-4fce-801e-a347d4ccd804 req-665aa4dc-7180-4cdb-bfc9-e6b6c98ac483 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:38.761600 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-0485e88c-3498-4fce-801e-a347d4ccd804 req-665aa4dc-7180-4cdb-bfc9-e6b6c98ac483 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:38.795042 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-0485e88c-3498-4fce-801e-a347d4ccd804 req-665aa4dc-7180-4cdb-bfc9-e6b6c98ac483 service nova] Creating event network-vif-plugged:7237a573-4c3c-4d85-9aaa-2a8f34ab9485 for instance 580e911e-a112-4bfa-9d78-b6a24178fae8 on chh1-master-2 Jun 10 18:19:38.809227 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-0485e88c-3498-4fce-801e-a347d4ccd804 req-665aa4dc-7180-4cdb-bfc9-e6b6c98ac483 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076794 Jun 10 18:19:38.811175 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2653/5262] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:19:39.473336 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-aa5640cd-9bfe-4508-8f31-fc73dab438c5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:39.473929 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-aa5640cd-9bfe-4508-8f31-fc73dab438c5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:39.519456 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aa5640cd-9bfe-4508-8f31-fc73dab438c5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:39.520269 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aa5640cd-9bfe-4508-8f31-fc73dab438c5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:39.524589 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aa5640cd-9bfe-4508-8f31-fc73dab438c5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:39.525045 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aa5640cd-9bfe-4508-8f31-fc73dab438c5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:39.620957 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1b2a458a-451b-421c-b0ff-9782c725c08e tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:39.621715 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1b2a458a-451b-421c-b0ff-9782c725c08e tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:39.642306 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1b2a458a-451b-421c-b0ff-9782c725c08e tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:39.664991 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1b2a458a-451b-421c-b0ff-9782c725c08e tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:39.672085 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1b2a458a-451b-421c-b0ff-9782c725c08e tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:39.672771 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1b2a458a-451b-421c-b0ff-9782c725c08e tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:39.813995 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-aa5640cd-9bfe-4508-8f31-fc73dab438c5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:39.824883 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-aa5640cd-9bfe-4508-8f31-fc73dab438c5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:39.827017 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-aa5640cd-9bfe-4508-8f31-fc73dab438c5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:39.829076 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-aa5640cd-9bfe-4508-8f31-fc73dab438c5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1741 microversion: 2.20 time: 0.365410 Jun 10 18:19:39.830189 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2610/5263] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:39 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1741 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:39.912407 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1b2a458a-451b-421c-b0ff-9782c725c08e tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:39.914746 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:19:39.925409 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1b2a458a-451b-421c-b0ff-9782c725c08e tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:39.930205 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1b2a458a-451b-421c-b0ff-9782c725c08e tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:39.931987 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1b2a458a-451b-421c-b0ff-9782c725c08e tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1604 microversion: 2.42 time: 0.315576 Jun 10 18:19:39.933123 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2654/5264] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:39 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1604 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:19:40.847517 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cf842be8-9174-489c-ab12-02e09a715dfc tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:40.848576 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cf842be8-9174-489c-ab12-02e09a715dfc tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:40.861512 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cf842be8-9174-489c-ab12-02e09a715dfc tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:40.864838 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cf842be8-9174-489c-ab12-02e09a715dfc tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:40.865706 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cf842be8-9174-489c-ab12-02e09a715dfc tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:40.866176 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cf842be8-9174-489c-ab12-02e09a715dfc tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:40.952471 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4c7d1ab7-c6ec-4daf-94ff-a1d2ecbdf95a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:40.954173 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4c7d1ab7-c6ec-4daf-94ff-a1d2ecbdf95a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:40.967007 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4c7d1ab7-c6ec-4daf-94ff-a1d2ecbdf95a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:40.970796 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4c7d1ab7-c6ec-4daf-94ff-a1d2ecbdf95a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:40.971794 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4c7d1ab7-c6ec-4daf-94ff-a1d2ecbdf95a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:40.973183 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4c7d1ab7-c6ec-4daf-94ff-a1d2ecbdf95a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:41.207517 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cf842be8-9174-489c-ab12-02e09a715dfc tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:41.231406 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cf842be8-9174-489c-ab12-02e09a715dfc tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:41.242569 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cf842be8-9174-489c-ab12-02e09a715dfc tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:41.250949 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cf842be8-9174-489c-ab12-02e09a715dfc tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1741 microversion: 2.20 time: 0.401681 Jun 10 18:19:41.260629 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2611/5265] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:40 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1741 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:41.349948 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4c7d1ab7-c6ec-4daf-94ff-a1d2ecbdf95a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:41.364170 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4c7d1ab7-c6ec-4daf-94ff-a1d2ecbdf95a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:41.367989 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4c7d1ab7-c6ec-4daf-94ff-a1d2ecbdf95a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:41.372372 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4c7d1ab7-c6ec-4daf-94ff-a1d2ecbdf95a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1604 microversion: 2.42 time: 0.424713 Jun 10 18:19:41.375688 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2655/5266] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:40 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1604 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:42.271031 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5ff6f329-1d1f-48bc-91d9-bcba62e628eb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:42.271640 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5ff6f329-1d1f-48bc-91d9-bcba62e628eb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:42.294963 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ff6f329-1d1f-48bc-91d9-bcba62e628eb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:42.305105 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ff6f329-1d1f-48bc-91d9-bcba62e628eb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:42.306462 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ff6f329-1d1f-48bc-91d9-bcba62e628eb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:42.308257 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ff6f329-1d1f-48bc-91d9-bcba62e628eb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:42.393907 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-543a52ed-c05f-470d-9dfc-e5b87aac3a02 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:42.394598 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-543a52ed-c05f-470d-9dfc-e5b87aac3a02 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:42.405763 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-543a52ed-c05f-470d-9dfc-e5b87aac3a02 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:42.406801 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-543a52ed-c05f-470d-9dfc-e5b87aac3a02 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:42.412907 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-543a52ed-c05f-470d-9dfc-e5b87aac3a02 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:42.413377 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-543a52ed-c05f-470d-9dfc-e5b87aac3a02 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:42.627694 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-543a52ed-c05f-470d-9dfc-e5b87aac3a02 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:42.647911 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-543a52ed-c05f-470d-9dfc-e5b87aac3a02 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:42.649481 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-543a52ed-c05f-470d-9dfc-e5b87aac3a02 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:42.654666 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-543a52ed-c05f-470d-9dfc-e5b87aac3a02 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1604 microversion: 2.42 time: 0.265752 Jun 10 18:19:42.657639 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2656/5267] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:42 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1604 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:43.209536 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5ff6f329-1d1f-48bc-91d9-bcba62e628eb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:43.218012 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5ff6f329-1d1f-48bc-91d9-bcba62e628eb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:43.219588 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5ff6f329-1d1f-48bc-91d9-bcba62e628eb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:43.223345 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5ff6f329-1d1f-48bc-91d9-bcba62e628eb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1741 microversion: 2.20 time: 0.956161 Jun 10 18:19:43.223930 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2612/5268] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:42 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1741 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:43.677831 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-16b08492-8a5e-4c49-9cfb-9fcde3a5c773 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:43.678482 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-16b08492-8a5e-4c49-9cfb-9fcde3a5c773 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:43.692863 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-16b08492-8a5e-4c49-9cfb-9fcde3a5c773 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:43.693512 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-16b08492-8a5e-4c49-9cfb-9fcde3a5c773 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:43.694681 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-16b08492-8a5e-4c49-9cfb-9fcde3a5c773 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:43.695298 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-16b08492-8a5e-4c49-9cfb-9fcde3a5c773 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:44.245649 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b266984d-1cb5-4bdb-85d2-042f58bf1603 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:44.245649 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b266984d-1cb5-4bdb-85d2-042f58bf1603 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:44.259699 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b266984d-1cb5-4bdb-85d2-042f58bf1603 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:44.260460 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b266984d-1cb5-4bdb-85d2-042f58bf1603 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:44.269753 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b266984d-1cb5-4bdb-85d2-042f58bf1603 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:44.270564 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b266984d-1cb5-4bdb-85d2-042f58bf1603 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:44.299506 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-16b08492-8a5e-4c49-9cfb-9fcde3a5c773 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:44.315655 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-16b08492-8a5e-4c49-9cfb-9fcde3a5c773 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:44.322657 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-16b08492-8a5e-4c49-9cfb-9fcde3a5c773 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:44.334489 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-16b08492-8a5e-4c49-9cfb-9fcde3a5c773 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1604 microversion: 2.42 time: 0.660382 Jun 10 18:19:44.342978 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2657/5269] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:43 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1604 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:44.884610 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b266984d-1cb5-4bdb-85d2-042f58bf1603 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:44.897488 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b266984d-1cb5-4bdb-85d2-042f58bf1603 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:44.899164 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b266984d-1cb5-4bdb-85d2-042f58bf1603 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:44.901220 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b266984d-1cb5-4bdb-85d2-042f58bf1603 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1741 microversion: 2.20 time: 0.663513 Jun 10 18:19:44.905250 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2613/5270] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:44 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1741 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:45.359548 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6f2781f9-1f58-497b-a471-343967ac72c1 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:45.363128 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6f2781f9-1f58-497b-a471-343967ac72c1 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:45.400898 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6f2781f9-1f58-497b-a471-343967ac72c1 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:45.403538 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6f2781f9-1f58-497b-a471-343967ac72c1 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:45.405791 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6f2781f9-1f58-497b-a471-343967ac72c1 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:45.415289 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6f2781f9-1f58-497b-a471-343967ac72c1 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:45.764038 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6f2781f9-1f58-497b-a471-343967ac72c1 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:45.788350 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6f2781f9-1f58-497b-a471-343967ac72c1 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:45.792821 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6f2781f9-1f58-497b-a471-343967ac72c1 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:45.797643 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6f2781f9-1f58-497b-a471-343967ac72c1 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1604 microversion: 2.42 time: 0.440837 Jun 10 18:19:45.800919 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2658/5271] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:45 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1604 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:45.926921 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5d9a7e27-c919-4ae2-aa24-41cc466dafcb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:45.929178 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5d9a7e27-c919-4ae2-aa24-41cc466dafcb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:45.957012 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5d9a7e27-c919-4ae2-aa24-41cc466dafcb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:45.957838 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5d9a7e27-c919-4ae2-aa24-41cc466dafcb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:45.958877 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5d9a7e27-c919-4ae2-aa24-41cc466dafcb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:45.959648 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5d9a7e27-c919-4ae2-aa24-41cc466dafcb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:46.713817 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5d9a7e27-c919-4ae2-aa24-41cc466dafcb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:46.725966 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5d9a7e27-c919-4ae2-aa24-41cc466dafcb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:46.727499 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5d9a7e27-c919-4ae2-aa24-41cc466dafcb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:46.729017 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5d9a7e27-c919-4ae2-aa24-41cc466dafcb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1741 microversion: 2.20 time: 0.810768 Jun 10 18:19:46.730122 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2614/5272] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:45 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1741 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:46.821371 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-42f9a8a3-7549-46d1-a659-345071999fbe tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:46.822024 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-42f9a8a3-7549-46d1-a659-345071999fbe tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:46.836967 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=52 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:19:46.846309 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-42f9a8a3-7549-46d1-a659-345071999fbe tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:46.847043 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-42f9a8a3-7549-46d1-a659-345071999fbe tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:46.850086 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-42f9a8a3-7549-46d1-a659-345071999fbe tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:46.851622 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-42f9a8a3-7549-46d1-a659-345071999fbe tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:47.001857 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-42f9a8a3-7549-46d1-a659-345071999fbe tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:47.030697 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-42f9a8a3-7549-46d1-a659-345071999fbe tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:47.040808 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-42f9a8a3-7549-46d1-a659-345071999fbe tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:47.045999 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-42f9a8a3-7549-46d1-a659-345071999fbe tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1604 microversion: 2.42 time: 0.231389 Jun 10 18:19:47.047766 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2659/5273] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:46 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1604 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:19:47.747483 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-34427e30-bd83-42e0-8474-7cdc95616b97 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:47.748115 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-34427e30-bd83-42e0-8474-7cdc95616b97 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:47.786401 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-34427e30-bd83-42e0-8474-7cdc95616b97 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:47.790963 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-34427e30-bd83-42e0-8474-7cdc95616b97 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:47.792478 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-34427e30-bd83-42e0-8474-7cdc95616b97 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:47.795830 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-34427e30-bd83-42e0-8474-7cdc95616b97 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:48.067393 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8c455e97-fb18-45b2-8ea8-55d175d136af tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:48.069808 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8c455e97-fb18-45b2-8ea8-55d175d136af tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:48.100221 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8c455e97-fb18-45b2-8ea8-55d175d136af tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:48.104842 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8c455e97-fb18-45b2-8ea8-55d175d136af tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:48.107971 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8c455e97-fb18-45b2-8ea8-55d175d136af tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:48.111255 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8c455e97-fb18-45b2-8ea8-55d175d136af tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:48.317940 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8c455e97-fb18-45b2-8ea8-55d175d136af tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:48.377309 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8c455e97-fb18-45b2-8ea8-55d175d136af tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:48.385634 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8c455e97-fb18-45b2-8ea8-55d175d136af tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:48.393112 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8c455e97-fb18-45b2-8ea8-55d175d136af tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1604 microversion: 2.42 time: 0.329412 Jun 10 18:19:48.407158 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2660/5274] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:48 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1604 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:19:48.407272 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-34427e30-bd83-42e0-8474-7cdc95616b97 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:48.431678 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-34427e30-bd83-42e0-8474-7cdc95616b97 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:48.431678 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-34427e30-bd83-42e0-8474-7cdc95616b97 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:48.431678 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-34427e30-bd83-42e0-8474-7cdc95616b97 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1741 microversion: 2.20 time: 0.683501 Jun 10 18:19:48.431678 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2615/5275] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:47 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1741 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:49.414949 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fac388f8-a37b-4741-95d7-fb4d0dae2169 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:49.416388 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fac388f8-a37b-4741-95d7-fb4d0dae2169 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:49.440869 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fac388f8-a37b-4741-95d7-fb4d0dae2169 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:49.441523 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fac388f8-a37b-4741-95d7-fb4d0dae2169 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:49.448683 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5435369f-5fa2-4b27-9b0b-a517ab7bc5d8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:49.449660 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fac388f8-a37b-4741-95d7-fb4d0dae2169 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:49.450341 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fac388f8-a37b-4741-95d7-fb4d0dae2169 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:49.450784 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5435369f-5fa2-4b27-9b0b-a517ab7bc5d8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:49.473276 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5435369f-5fa2-4b27-9b0b-a517ab7bc5d8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:49.475813 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5435369f-5fa2-4b27-9b0b-a517ab7bc5d8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:49.477195 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5435369f-5fa2-4b27-9b0b-a517ab7bc5d8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:49.483411 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5435369f-5fa2-4b27-9b0b-a517ab7bc5d8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:49.739875 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5435369f-5fa2-4b27-9b0b-a517ab7bc5d8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:49.752747 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5435369f-5fa2-4b27-9b0b-a517ab7bc5d8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:49.754700 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5435369f-5fa2-4b27-9b0b-a517ab7bc5d8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:49.756636 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5435369f-5fa2-4b27-9b0b-a517ab7bc5d8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1741 microversion: 2.20 time: 0.312410 Jun 10 18:19:49.759144 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2616/5276] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:49 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1741 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:49.781943 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fac388f8-a37b-4741-95d7-fb4d0dae2169 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:49.807427 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fac388f8-a37b-4741-95d7-fb4d0dae2169 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:49.808993 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fac388f8-a37b-4741-95d7-fb4d0dae2169 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:49.814439 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fac388f8-a37b-4741-95d7-fb4d0dae2169 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1604 microversion: 2.42 time: 0.403523 Jun 10 18:19:49.826562 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2661/5277] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:49 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1604 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:50.779517 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4ba4f4d7-ed41-4982-858a-409a629f9f91 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:50.782521 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4ba4f4d7-ed41-4982-858a-409a629f9f91 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:50.795266 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:19:50.800585 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ba4f4d7-ed41-4982-858a-409a629f9f91 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:50.804791 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ba4f4d7-ed41-4982-858a-409a629f9f91 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:50.811778 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ba4f4d7-ed41-4982-858a-409a629f9f91 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:50.813022 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ba4f4d7-ed41-4982-858a-409a629f9f91 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:50.836467 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-32789088-fd6f-4274-ae8b-c146b6d3e385 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:50.836467 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-32789088-fd6f-4274-ae8b-c146b6d3e385 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:50.859689 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-32789088-fd6f-4274-ae8b-c146b6d3e385 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:50.860496 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-32789088-fd6f-4274-ae8b-c146b6d3e385 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:50.864161 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-32789088-fd6f-4274-ae8b-c146b6d3e385 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:50.865091 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-32789088-fd6f-4274-ae8b-c146b6d3e385 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:51.106906 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-32789088-fd6f-4274-ae8b-c146b6d3e385 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:51.144486 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-32789088-fd6f-4274-ae8b-c146b6d3e385 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:51.159299 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-32789088-fd6f-4274-ae8b-c146b6d3e385 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:51.165033 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-32789088-fd6f-4274-ae8b-c146b6d3e385 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1604 microversion: 2.42 time: 0.333891 Jun 10 18:19:51.169856 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2662/5278] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:50 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1604 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:51.312927 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4ba4f4d7-ed41-4982-858a-409a629f9f91 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:51.321821 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4ba4f4d7-ed41-4982-858a-409a629f9f91 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:51.331110 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4ba4f4d7-ed41-4982-858a-409a629f9f91 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:51.332661 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4ba4f4d7-ed41-4982-858a-409a629f9f91 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1741 microversion: 2.20 time: 0.558776 Jun 10 18:19:51.333467 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2617/5279] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:50 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1741 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:52.208174 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-69af0405-6886-4c4f-8ce0-b6858e36a33a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:52.208174 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-69af0405-6886-4c4f-8ce0-b6858e36a33a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:52.208174 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-69af0405-6886-4c4f-8ce0-b6858e36a33a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:52.208174 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-69af0405-6886-4c4f-8ce0-b6858e36a33a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:52.225801 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-69af0405-6886-4c4f-8ce0-b6858e36a33a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:52.233005 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-69af0405-6886-4c4f-8ce0-b6858e36a33a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:52.351307 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9c02f034-89fb-4c87-8c48-186abf189fc8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:52.352623 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9c02f034-89fb-4c87-8c48-186abf189fc8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:52.380234 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9c02f034-89fb-4c87-8c48-186abf189fc8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:52.380971 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9c02f034-89fb-4c87-8c48-186abf189fc8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:52.382045 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9c02f034-89fb-4c87-8c48-186abf189fc8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:52.382640 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9c02f034-89fb-4c87-8c48-186abf189fc8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:52.462696 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-69af0405-6886-4c4f-8ce0-b6858e36a33a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:52.483284 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-69af0405-6886-4c4f-8ce0-b6858e36a33a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:52.492850 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-69af0405-6886-4c4f-8ce0-b6858e36a33a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:52.492850 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-69af0405-6886-4c4f-8ce0-b6858e36a33a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1604 microversion: 2.42 time: 0.295670 Jun 10 18:19:52.492850 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2663/5280] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:52 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1604 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:53.451231 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9c02f034-89fb-4c87-8c48-186abf189fc8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:53.465537 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9c02f034-89fb-4c87-8c48-186abf189fc8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:53.473439 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9c02f034-89fb-4c87-8c48-186abf189fc8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:53.474775 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9c02f034-89fb-4c87-8c48-186abf189fc8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1741 microversion: 2.20 time: 1.127687 Jun 10 18:19:53.495943 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2618/5281] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:52 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1741 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:19:53.509767 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6bd8b188-9df0-495f-985c-65ff6c44b33a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:53.510377 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6bd8b188-9df0-495f-985c-65ff6c44b33a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:53.540569 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6bd8b188-9df0-495f-985c-65ff6c44b33a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:53.545184 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6bd8b188-9df0-495f-985c-65ff6c44b33a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:53.551635 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6bd8b188-9df0-495f-985c-65ff6c44b33a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:53.555900 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6bd8b188-9df0-495f-985c-65ff6c44b33a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:53.949466 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6bd8b188-9df0-495f-985c-65ff6c44b33a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:53.971694 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6bd8b188-9df0-495f-985c-65ff6c44b33a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:53.974885 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6bd8b188-9df0-495f-985c-65ff6c44b33a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:53.979014 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6bd8b188-9df0-495f-985c-65ff6c44b33a tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1604 microversion: 2.42 time: 0.476768 Jun 10 18:19:53.983759 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2664/5282] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:53 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1604 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:54.504244 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-875e21d5-0e29-4784-ac60-4720a33598bf tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:54.505118 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-875e21d5-0e29-4784-ac60-4720a33598bf tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:54.515622 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-875e21d5-0e29-4784-ac60-4720a33598bf tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:54.520937 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-875e21d5-0e29-4784-ac60-4720a33598bf tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:54.521917 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-875e21d5-0e29-4784-ac60-4720a33598bf tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:54.524883 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-875e21d5-0e29-4784-ac60-4720a33598bf tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:55.001734 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-89423c26-e687-45e6-8693-e58f65a443a8 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:55.003633 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-89423c26-e687-45e6-8693-e58f65a443a8 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:55.035285 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-89423c26-e687-45e6-8693-e58f65a443a8 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:55.038026 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-89423c26-e687-45e6-8693-e58f65a443a8 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:55.045852 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-875e21d5-0e29-4784-ac60-4720a33598bf tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:55.053354 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-89423c26-e687-45e6-8693-e58f65a443a8 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:55.057956 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-89423c26-e687-45e6-8693-e58f65a443a8 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:55.074251 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-875e21d5-0e29-4784-ac60-4720a33598bf tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:55.085496 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-875e21d5-0e29-4784-ac60-4720a33598bf tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:55.087039 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-875e21d5-0e29-4784-ac60-4720a33598bf tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1741 microversion: 2.20 time: 0.587978 Jun 10 18:19:55.088100 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2619/5283] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:54 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1741 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:55.346018 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-89423c26-e687-45e6-8693-e58f65a443a8 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:55.356827 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-89423c26-e687-45e6-8693-e58f65a443a8 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:55.363724 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-89423c26-e687-45e6-8693-e58f65a443a8 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:55.367478 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-89423c26-e687-45e6-8693-e58f65a443a8 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1604 microversion: 2.42 time: 0.371959 Jun 10 18:19:55.368900 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2665/5284] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:54 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1604 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:19:56.106776 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1589ca68-0ae8-4b32-a2f2-b46a6b951722 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:56.107402 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1589ca68-0ae8-4b32-a2f2-b46a6b951722 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:56.137209 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1589ca68-0ae8-4b32-a2f2-b46a6b951722 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:56.138101 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1589ca68-0ae8-4b32-a2f2-b46a6b951722 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:56.139140 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1589ca68-0ae8-4b32-a2f2-b46a6b951722 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:56.141455 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1589ca68-0ae8-4b32-a2f2-b46a6b951722 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:56.389159 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5c298331-baa6-4c0e-8af6-1a9d8ba1cd27 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:56.391176 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5c298331-baa6-4c0e-8af6-1a9d8ba1cd27 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:56.406729 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5c298331-baa6-4c0e-8af6-1a9d8ba1cd27 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:56.410525 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5c298331-baa6-4c0e-8af6-1a9d8ba1cd27 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:56.411303 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5c298331-baa6-4c0e-8af6-1a9d8ba1cd27 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:56.414490 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5c298331-baa6-4c0e-8af6-1a9d8ba1cd27 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:56.444744 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1589ca68-0ae8-4b32-a2f2-b46a6b951722 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:56.458673 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1589ca68-0ae8-4b32-a2f2-b46a6b951722 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:56.476909 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1589ca68-0ae8-4b32-a2f2-b46a6b951722 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:56.478332 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1589ca68-0ae8-4b32-a2f2-b46a6b951722 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1741 microversion: 2.20 time: 0.376059 Jun 10 18:19:56.479409 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2620/5285] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:56 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1741 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:56.618424 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5c298331-baa6-4c0e-8af6-1a9d8ba1cd27 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:56.633779 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5c298331-baa6-4c0e-8af6-1a9d8ba1cd27 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:56.650321 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5c298331-baa6-4c0e-8af6-1a9d8ba1cd27 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:56.650321 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5c298331-baa6-4c0e-8af6-1a9d8ba1cd27 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1604 microversion: 2.42 time: 0.252275 Jun 10 18:19:56.650321 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2666/5286] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:56 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1604 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:57.501449 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0cdc9eaf-695e-42af-9f17-6292fe7d8fc2 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:57.501449 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0cdc9eaf-695e-42af-9f17-6292fe7d8fc2 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:57.519414 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0cdc9eaf-695e-42af-9f17-6292fe7d8fc2 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:57.520130 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0cdc9eaf-695e-42af-9f17-6292fe7d8fc2 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:57.523329 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0cdc9eaf-695e-42af-9f17-6292fe7d8fc2 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:57.523329 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0cdc9eaf-695e-42af-9f17-6292fe7d8fc2 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:57.659250 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-35efb682-9a21-480d-82b1-f44d751a5f04 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:57.661866 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-35efb682-9a21-480d-82b1-f44d751a5f04 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:57.678283 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-35efb682-9a21-480d-82b1-f44d751a5f04 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:57.678959 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-35efb682-9a21-480d-82b1-f44d751a5f04 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:57.680179 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-35efb682-9a21-480d-82b1-f44d751a5f04 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:57.680797 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-35efb682-9a21-480d-82b1-f44d751a5f04 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:57.942992 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-35efb682-9a21-480d-82b1-f44d751a5f04 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:57.973221 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-35efb682-9a21-480d-82b1-f44d751a5f04 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:57.980449 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-35efb682-9a21-480d-82b1-f44d751a5f04 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:57.981924 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-35efb682-9a21-480d-82b1-f44d751a5f04 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1604 microversion: 2.42 time: 0.326743 Jun 10 18:19:57.997867 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2667/5287] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:57 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1604 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:58.344868 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0cdc9eaf-695e-42af-9f17-6292fe7d8fc2 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:58.383853 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0cdc9eaf-695e-42af-9f17-6292fe7d8fc2 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:58.386746 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0cdc9eaf-695e-42af-9f17-6292fe7d8fc2 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:58.396752 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0cdc9eaf-695e-42af-9f17-6292fe7d8fc2 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1741 microversion: 2.20 time: 0.897555 Jun 10 18:19:58.398005 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2621/5288] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:57 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1741 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:59.009688 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3b6eb154-b752-4317-9263-1ed0704358d5 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:59.011659 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3b6eb154-b752-4317-9263-1ed0704358d5 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:59.019346 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3b6eb154-b752-4317-9263-1ed0704358d5 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:59.019920 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3b6eb154-b752-4317-9263-1ed0704358d5 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:59.023241 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3b6eb154-b752-4317-9263-1ed0704358d5 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:59.023702 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3b6eb154-b752-4317-9263-1ed0704358d5 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:59.321555 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3b6eb154-b752-4317-9263-1ed0704358d5 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:59.350174 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3b6eb154-b752-4317-9263-1ed0704358d5 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:59.353325 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3b6eb154-b752-4317-9263-1ed0704358d5 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:59.357624 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3b6eb154-b752-4317-9263-1ed0704358d5 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1604 microversion: 2.42 time: 0.356401 Jun 10 18:19:59.362425 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2668/5289] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:58 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1604 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:19:59.416226 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e3574a14-0824-4960-91fd-d08fc2fa09a8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:19:59.416871 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e3574a14-0824-4960-91fd-d08fc2fa09a8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:19:59.431590 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e3574a14-0824-4960-91fd-d08fc2fa09a8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:59.443791 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e3574a14-0824-4960-91fd-d08fc2fa09a8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:59.444805 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e3574a14-0824-4960-91fd-d08fc2fa09a8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:19:59.445341 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e3574a14-0824-4960-91fd-d08fc2fa09a8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:19:59.783216 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e3574a14-0824-4960-91fd-d08fc2fa09a8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:59.792003 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e3574a14-0824-4960-91fd-d08fc2fa09a8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:59.796472 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e3574a14-0824-4960-91fd-d08fc2fa09a8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:19:59.801610 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e3574a14-0824-4960-91fd-d08fc2fa09a8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1741 microversion: 2.20 time: 0.385405 Jun 10 18:19:59.801610 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2622/5290] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:19:59 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1741 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:20:00.398641 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8ddd504c-dcd4-4786-82f9-b504b5f68705 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:00.398641 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8ddd504c-dcd4-4786-82f9-b504b5f68705 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:00.429382 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8ddd504c-dcd4-4786-82f9-b504b5f68705 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:00.430969 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8ddd504c-dcd4-4786-82f9-b504b5f68705 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:00.435172 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8ddd504c-dcd4-4786-82f9-b504b5f68705 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:00.435914 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8ddd504c-dcd4-4786-82f9-b504b5f68705 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:00.516640 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8ddd504c-dcd4-4786-82f9-b504b5f68705 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:00.532420 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8ddd504c-dcd4-4786-82f9-b504b5f68705 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:00.533659 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-8ddd504c-dcd4-4786-82f9-b504b5f68705 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lazy-loading 'fault' on Instance uuid 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:20:00.641490 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8ddd504c-dcd4-4786-82f9-b504b5f68705 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:00.654082 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8ddd504c-dcd4-4786-82f9-b504b5f68705 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:00.668876 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8ddd504c-dcd4-4786-82f9-b504b5f68705 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c101ac379c94319baca4c2c9781030f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedaf8a0acb148ec9a671abf0a548fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:00.668876 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8ddd504c-dcd4-4786-82f9-b504b5f68705 tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 200 len: 1371 microversion: 2.42 time: 0.281669 Jun 10 18:20:00.668876 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2669/5291] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:00 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 1371 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:20:00.817844 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4d2d2b19-5336-4857-a12b-71aa394b325b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:00.819055 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4d2d2b19-5336-4857-a12b-71aa394b325b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:00.827149 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d2d2b19-5336-4857-a12b-71aa394b325b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:00.830306 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d2d2b19-5336-4857-a12b-71aa394b325b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:00.830306 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d2d2b19-5336-4857-a12b-71aa394b325b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:00.830306 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d2d2b19-5336-4857-a12b-71aa394b325b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:01.693126 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-be2f5613-ff3f-4bb3-900a-de52165d4bbd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:01.694763 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-be2f5613-ff3f-4bb3-900a-de52165d4bbd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:01.720469 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be2f5613-ff3f-4bb3-900a-de52165d4bbd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:01.721112 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be2f5613-ff3f-4bb3-900a-de52165d4bbd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:01.722245 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be2f5613-ff3f-4bb3-900a-de52165d4bbd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:01.722845 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be2f5613-ff3f-4bb3-900a-de52165d4bbd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:01.781703 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-be2f5613-ff3f-4bb3-900a-de52165d4bbd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] HTTP exception thrown: Instance 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 could not be found. Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-be2f5613-ff3f-4bb3-900a-de52165d4bbd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Request method failure captured: Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 HTTP/1.1 Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4luYH_fzOnxACFdP8vLI1ZmzG7jigO3bYL9GQiX6GUv7Vhv4ps38sDLHzQjfSYr6vAGxz5qUiQLuxeJBowlWmW2rEAOIwc2_03soD_UWNXW5JHQKrcT9o9A0bXSLga-3gNytk8ED17lJuaFb1FJufEfQG0JDZjnx1uGbVkBM992rmc Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: X-Openstack-Nova-Api-Version: 2.42 Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: bedaf8a0acb148ec9a671abf0a548fdb Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-780375299 Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/bedaf8a0acb148ec9a671abf0a548fdb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bedaf8a0acb148ec9a671abf0a548fdb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bedaf8a0acb148ec9a671abf0a548fdb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_bedaf8a0acb148ec9a671abf0a548fdb", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-TaggedBootDevicesTest_v242-780375299 Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: bedaf8a0acb148ec9a671abf0a548fdb Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-780375299 Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-TaggedBootDevicesTest_v242-780375299-project Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 0c101ac379c94319baca4c2c9781030f Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-TaggedBootDevicesTest_v242-780375299-project Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 could not be found. Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '8ceaaf7b-0972-4fe5-bd63-5534a71f80d3'} Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 could not be found. Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 could not be found. Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:20:01.783713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:20:01.794021 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:20:01.794021 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:20:01.794021 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:20:01.794021 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:20:01.794021 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:20:01.794021 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:20:01.794021 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 could not be found. Jun 10 18:20:01.794021 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:20:01.794021 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-be2f5613-ff3f-4bb3-900a-de52165d4bbd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Returning 404 to user: Instance 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:20:01.794021 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-be2f5613-ff3f-4bb3-900a-de52165d4bbd tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 404 len: 111 microversion: 2.42 time: 0.098561 Jun 10 18:20:01.817655 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2670/5292] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:01 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:20:01.825536 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-00860ff9-b0a7-409c-8f3e-3d467c7f6dca tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '.version_select at 0x7f77c612f160>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:01.964145 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-00860ff9-b0a7-409c-8f3e-3d467c7f6dca tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-130455017" status: 204 len: 0 microversion: 2.42 time: 0.144831 Jun 10 18:20:01.969025 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2671/5293] 10.222.0.35 () {60 vars in 1258 bytes} [Fri Jun 10 18:20:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-130455017 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 10 18:20:02.138954 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4d2d2b19-5336-4857-a12b-71aa394b325b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:02.170345 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4d2d2b19-5336-4857-a12b-71aa394b325b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:02.184007 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4d2d2b19-5336-4857-a12b-71aa394b325b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:02.194064 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4d2d2b19-5336-4857-a12b-71aa394b325b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1741 microversion: 2.20 time: 1.371870 Jun 10 18:20:02.195159 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2623/5294] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:00 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1741 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:20:03.213421 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-06344858-9feb-41d8-a91d-92a9fbee5a4e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:03.214157 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-06344858-9feb-41d8-a91d-92a9fbee5a4e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:03.231591 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-06344858-9feb-41d8-a91d-92a9fbee5a4e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:03.231591 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-06344858-9feb-41d8-a91d-92a9fbee5a4e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:03.231591 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-06344858-9feb-41d8-a91d-92a9fbee5a4e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:03.231591 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-06344858-9feb-41d8-a91d-92a9fbee5a4e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:04.232556 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-06344858-9feb-41d8-a91d-92a9fbee5a4e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:04.235027 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:20:04.263088 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-06344858-9feb-41d8-a91d-92a9fbee5a4e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:04.275379 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-06344858-9feb-41d8-a91d-92a9fbee5a4e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:04.280778 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-06344858-9feb-41d8-a91d-92a9fbee5a4e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1741 microversion: 2.20 time: 1.066505 Jun 10 18:20:04.284086 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2672/5295] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:03 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1741 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:20:05.313919 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ec417adb-0125-410f-9f91-1a90944584bc tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:05.314522 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ec417adb-0125-410f-9f91-1a90944584bc tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:05.329132 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ec417adb-0125-410f-9f91-1a90944584bc tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:05.329518 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ec417adb-0125-410f-9f91-1a90944584bc tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:05.330325 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ec417adb-0125-410f-9f91-1a90944584bc tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:05.337899 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ec417adb-0125-410f-9f91-1a90944584bc tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:05.433810 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:20:06.082406 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ec417adb-0125-410f-9f91-1a90944584bc tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:06.100940 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ec417adb-0125-410f-9f91-1a90944584bc tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:06.109798 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ec417adb-0125-410f-9f91-1a90944584bc tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:06.117074 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ec417adb-0125-410f-9f91-1a90944584bc tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1741 microversion: 2.20 time: 0.807440 Jun 10 18:20:06.120239 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2624/5296] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:05 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1741 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:20:07.135671 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-03371780-b086-4f51-bf2b-c49608acd6e5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:07.136258 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-03371780-b086-4f51-bf2b-c49608acd6e5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:07.153553 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-03371780-b086-4f51-bf2b-c49608acd6e5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:07.157052 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-03371780-b086-4f51-bf2b-c49608acd6e5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:07.161366 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-03371780-b086-4f51-bf2b-c49608acd6e5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:07.165724 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-03371780-b086-4f51-bf2b-c49608acd6e5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:07.578187 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-03371780-b086-4f51-bf2b-c49608acd6e5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:07.590013 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-03371780-b086-4f51-bf2b-c49608acd6e5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:07.591986 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-03371780-b086-4f51-bf2b-c49608acd6e5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:07.594044 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-03371780-b086-4f51-bf2b-c49608acd6e5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1741 microversion: 2.20 time: 0.462835 Jun 10 18:20:07.595237 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2673/5297] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:07 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1741 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:20:08.614574 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ad1db3b4-9639-4207-b3f6-e1645508d383 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:08.615370 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ad1db3b4-9639-4207-b3f6-e1645508d383 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:08.635668 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad1db3b4-9639-4207-b3f6-e1645508d383 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:08.635668 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad1db3b4-9639-4207-b3f6-e1645508d383 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:08.635668 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad1db3b4-9639-4207-b3f6-e1645508d383 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:08.635668 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad1db3b4-9639-4207-b3f6-e1645508d383 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:09.393835 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ad1db3b4-9639-4207-b3f6-e1645508d383 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:09.413604 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ad1db3b4-9639-4207-b3f6-e1645508d383 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:09.415160 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ad1db3b4-9639-4207-b3f6-e1645508d383 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:09.416404 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ad1db3b4-9639-4207-b3f6-e1645508d383 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1741 microversion: 2.20 time: 0.806452 Jun 10 18:20:09.424530 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2625/5298] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:08 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1741 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:20:10.435015 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f4b63d10-2e15-4b6e-813a-d45105e8a75f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:10.435845 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f4b63d10-2e15-4b6e-813a-d45105e8a75f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:10.444501 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4b63d10-2e15-4b6e-813a-d45105e8a75f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:10.462876 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4b63d10-2e15-4b6e-813a-d45105e8a75f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:10.464523 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4b63d10-2e15-4b6e-813a-d45105e8a75f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:10.471274 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4b63d10-2e15-4b6e-813a-d45105e8a75f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:11.033163 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f4b63d10-2e15-4b6e-813a-d45105e8a75f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:11.042195 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f4b63d10-2e15-4b6e-813a-d45105e8a75f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:11.044235 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f4b63d10-2e15-4b6e-813a-d45105e8a75f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:11.051086 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f4b63d10-2e15-4b6e-813a-d45105e8a75f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1723 microversion: 2.20 time: 0.620023 Jun 10 18:20:11.058303 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2674/5299] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:10 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1723 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:20:12.077405 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-40ecaf53-0574-4e3d-b3e0-359434351118 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:12.079224 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-40ecaf53-0574-4e3d-b3e0-359434351118 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:12.116351 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-40ecaf53-0574-4e3d-b3e0-359434351118 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:12.119854 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-40ecaf53-0574-4e3d-b3e0-359434351118 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:12.120989 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-40ecaf53-0574-4e3d-b3e0-359434351118 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:12.121640 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-40ecaf53-0574-4e3d-b3e0-359434351118 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:12.441036 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-40ecaf53-0574-4e3d-b3e0-359434351118 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:12.452710 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-40ecaf53-0574-4e3d-b3e0-359434351118 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:12.460068 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-40ecaf53-0574-4e3d-b3e0-359434351118 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:12.473253 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-40ecaf53-0574-4e3d-b3e0-359434351118 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1723 microversion: 2.20 time: 0.388990 Jun 10 18:20:12.473253 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2626/5300] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:12 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1723 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:20:12.899761 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-1c95b53c-18e9-4857-8cb9-ff0701c35f77 req-25f50b8a-8020-4566-bd50-ae196a0e9059 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "580e911e-a112-4bfa-9d78-b6a24178fae8", "name": "network-vif-unplugged", "status": "completed", "tag": "7237a573-4c3c-4d85-9aaa-2a8f34ab9485"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:20:12.925530 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-1c95b53c-18e9-4857-8cb9-ff0701c35f77 req-25f50b8a-8020-4566-bd50-ae196a0e9059 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:12.925984 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-1c95b53c-18e9-4857-8cb9-ff0701c35f77 req-25f50b8a-8020-4566-bd50-ae196a0e9059 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:12.945761 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-1c95b53c-18e9-4857-8cb9-ff0701c35f77 req-25f50b8a-8020-4566-bd50-ae196a0e9059 service nova] Creating event network-vif-unplugged:7237a573-4c3c-4d85-9aaa-2a8f34ab9485 for instance 580e911e-a112-4bfa-9d78-b6a24178fae8 on chh1-master-2 Jun 10 18:20:12.983555 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-1c95b53c-18e9-4857-8cb9-ff0701c35f77 req-25f50b8a-8020-4566-bd50-ae196a0e9059 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087681 Jun 10 18:20:12.995089 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2675/5301] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:20:13.480992 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ca066462-ba03-45de-8f8e-0584cec80b53 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:13.482325 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ca066462-ba03-45de-8f8e-0584cec80b53 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:13.500564 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ca066462-ba03-45de-8f8e-0584cec80b53 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:13.501078 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ca066462-ba03-45de-8f8e-0584cec80b53 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:13.502593 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ca066462-ba03-45de-8f8e-0584cec80b53 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:13.504830 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ca066462-ba03-45de-8f8e-0584cec80b53 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:14.016504 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ca066462-ba03-45de-8f8e-0584cec80b53 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:14.027151 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ca066462-ba03-45de-8f8e-0584cec80b53 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:14.031090 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ca066462-ba03-45de-8f8e-0584cec80b53 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:14.031444 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ca066462-ba03-45de-8f8e-0584cec80b53 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1726 microversion: 2.20 time: 0.554310 Jun 10 18:20:14.051699 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2627/5302] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:13 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1726 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:20:14.056085 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4719c7e1-ff19-4e2a-9886-6eeb1576daa2 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e911036-0710-48e4-aec6-3b9eaf4656ad"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:20:14.057426 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4719c7e1-ff19-4e2a-9886-6eeb1576daa2 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:14.079212 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4719c7e1-ff19-4e2a-9886-6eeb1576daa2 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:14.082461 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4719c7e1-ff19-4e2a-9886-6eeb1576daa2 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:14.094515 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4719c7e1-ff19-4e2a-9886-6eeb1576daa2 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:14.095385 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4719c7e1-ff19-4e2a-9886-6eeb1576daa2 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:14.170917 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d964736b-4a61-4103-a43f-9aa82af0d1eb tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:14.171720 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d964736b-4a61-4103-a43f-9aa82af0d1eb tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:14.181941 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d964736b-4a61-4103-a43f-9aa82af0d1eb tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:14.182643 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d964736b-4a61-4103-a43f-9aa82af0d1eb tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:14.185249 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d964736b-4a61-4103-a43f-9aa82af0d1eb tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:14.185995 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d964736b-4a61-4103-a43f-9aa82af0d1eb tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:14.236885 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-d964736b-4a61-4103-a43f-9aa82af0d1eb tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] HTTP exception thrown: Instance 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 could not be found. Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d964736b-4a61-4103-a43f-9aa82af0d1eb tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Request method failure captured: Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 HTTP/1.1 Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4luYH_fzOnxACFdP8vLI1ZmzG7jigO3bYL9GQiX6GUv7Vhv4ps38sDLHzQjfSYr6vAGxz5qUiQLuxeJBowlWmW2rEAOIwc2_03soD_UWNXW5JHQKrcT9o9A0bXSLga-3gNytk8ED17lJuaFb1FJufEfQG0JDZjnx1uGbVkBM992rmc Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: X-Openstack-Nova-Api-Version: 2.42 Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: bedaf8a0acb148ec9a671abf0a548fdb Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-780375299 Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/bedaf8a0acb148ec9a671abf0a548fdb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bedaf8a0acb148ec9a671abf0a548fdb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bedaf8a0acb148ec9a671abf0a548fdb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_bedaf8a0acb148ec9a671abf0a548fdb", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-TaggedBootDevicesTest_v242-780375299 Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: bedaf8a0acb148ec9a671abf0a548fdb Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-780375299 Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-TaggedBootDevicesTest_v242-780375299-project Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 0c101ac379c94319baca4c2c9781030f Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-TaggedBootDevicesTest_v242-780375299-project Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 could not be found. Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '8ceaaf7b-0972-4fe5-bd63-5534a71f80d3'} Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 could not be found. Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:20:14.240703 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:20:14.245836 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 could not be found. Jun 10 18:20:14.245836 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:20:14.245836 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:20:14.245836 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:20:14.245836 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:20:14.245836 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:20:14.245836 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:20:14.245836 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:20:14.245836 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:20:14.245836 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 could not be found. Jun 10 18:20:14.245836 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:20:14.249519 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d964736b-4a61-4103-a43f-9aa82af0d1eb tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Returning 404 to user: Instance 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:20:14.251881 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d964736b-4a61-4103-a43f-9aa82af0d1eb tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "DELETE /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 404 len: 111 microversion: 2.42 time: 0.089955 Jun 10 18:20:14.254079 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2628/5303] 10.222.0.35 () {60 vars in 1279 bytes} [Fri Jun 10 18:20:14 2022] DELETE /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:20:14.262365 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9f7473a2-5053-4f0f-8598-83baf7a51f6f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:14.263163 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9f7473a2-5053-4f0f-8598-83baf7a51f6f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] [instance: 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:14.271291 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f7473a2-5053-4f0f-8598-83baf7a51f6f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:14.278812 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f7473a2-5053-4f0f-8598-83baf7a51f6f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:14.278812 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f7473a2-5053-4f0f-8598-83baf7a51f6f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:14.278812 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f7473a2-5053-4f0f-8598-83baf7a51f6f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:14.297162 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-9f7473a2-5053-4f0f-8598-83baf7a51f6f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] HTTP exception thrown: Instance 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 could not be found. Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9f7473a2-5053-4f0f-8598-83baf7a51f6f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Request method failure captured: Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 HTTP/1.1 Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4luYH_fzOnxACFdP8vLI1ZmzG7jigO3bYL9GQiX6GUv7Vhv4ps38sDLHzQjfSYr6vAGxz5qUiQLuxeJBowlWmW2rEAOIwc2_03soD_UWNXW5JHQKrcT9o9A0bXSLga-3gNytk8ED17lJuaFb1FJufEfQG0JDZjnx1uGbVkBM992rmc Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: X-Openstack-Nova-Api-Version: 2.42 Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: bedaf8a0acb148ec9a671abf0a548fdb Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-780375299 Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/bedaf8a0acb148ec9a671abf0a548fdb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bedaf8a0acb148ec9a671abf0a548fdb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/bedaf8a0acb148ec9a671abf0a548fdb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_bedaf8a0acb148ec9a671abf0a548fdb", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-TaggedBootDevicesTest_v242-780375299 Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: bedaf8a0acb148ec9a671abf0a548fdb Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-780375299 Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-TaggedBootDevicesTest_v242-780375299-project Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 0c101ac379c94319baca4c2c9781030f Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-TaggedBootDevicesTest_v242-780375299-project Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 could not be found. Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '8ceaaf7b-0972-4fe5-bd63-5534a71f80d3'} Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 could not be found. Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 could not be found. Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:20:14.299785 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:20:14.304875 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:20:14.304875 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:20:14.304875 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:20:14.304875 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:20:14.304875 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:20:14.304875 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:20:14.304875 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 could not be found. Jun 10 18:20:14.304875 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:20:14.307194 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9f7473a2-5053-4f0f-8598-83baf7a51f6f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] Returning 404 to user: Instance 8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:20:14.308327 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9f7473a2-5053-4f0f-8598-83baf7a51f6f tempest-TaggedBootDevicesTest_v242-780375299 tempest-TaggedBootDevicesTest_v242-780375299-project] 10.222.0.35 "GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3" status: 404 len: 111 microversion: 2.42 time: 0.051099 Jun 10 18:20:14.309555 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2629/5304] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:14 2022] GET /compute/v2.1/servers/8ceaaf7b-0972-4fe5-bd63-5534a71f80d3 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:20:15.660101 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4719c7e1-ff19-4e2a-9886-6eeb1576daa2 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "POST /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.610607 Jun 10 18:20:15.661742 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2676/5305] 10.222.0.35 () {62 vars in 1363 bytes} [Fri Jun 10 18:20:14 2022] POST /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8/os-volume_attachments => generated 188 bytes in 1613 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 10 18:20:15.927000 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-88631b75-dd88-4721-810b-88a127e2ed72 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:20:15.927577 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-88631b75-dd88-4721-810b-88a127e2ed72 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:15.943128 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-88631b75-dd88-4721-810b-88a127e2ed72 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:15.943588 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-88631b75-dd88-4721-810b-88a127e2ed72 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:15.949289 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-88631b75-dd88-4721-810b-88a127e2ed72 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:15.949751 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-88631b75-dd88-4721-810b-88a127e2ed72 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:16.308141 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-88631b75-dd88-4721-810b-88a127e2ed72 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "POST /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8/action" status: 202 len: 0 microversion: 2.20 time: 0.385586 Jun 10 18:20:16.309273 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2630/5306] 10.222.0.35 () {62 vars in 1318 bytes} [Fri Jun 10 18:20:15 2022] POST /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8/action => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:20:16.330542 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-580f8ec1-b4b2-4141-9c7b-06cef59de084 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:16.334206 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-580f8ec1-b4b2-4141-9c7b-06cef59de084 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:16.354178 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-580f8ec1-b4b2-4141-9c7b-06cef59de084 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:16.355286 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-580f8ec1-b4b2-4141-9c7b-06cef59de084 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:16.356824 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-580f8ec1-b4b2-4141-9c7b-06cef59de084 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:16.357512 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-580f8ec1-b4b2-4141-9c7b-06cef59de084 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:17.231272 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-580f8ec1-b4b2-4141-9c7b-06cef59de084 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:17.253077 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-580f8ec1-b4b2-4141-9c7b-06cef59de084 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:17.270900 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-580f8ec1-b4b2-4141-9c7b-06cef59de084 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:17.274619 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-580f8ec1-b4b2-4141-9c7b-06cef59de084 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1752 microversion: 2.20 time: 0.961166 Jun 10 18:20:17.277311 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2677/5307] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:16 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1752 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:20:18.335578 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ceb06dc8-551f-4a55-96fc-88cb25b6dd80 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:18.337017 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ceb06dc8-551f-4a55-96fc-88cb25b6dd80 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:18.370459 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ceb06dc8-551f-4a55-96fc-88cb25b6dd80 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:18.372342 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ceb06dc8-551f-4a55-96fc-88cb25b6dd80 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:18.373588 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ceb06dc8-551f-4a55-96fc-88cb25b6dd80 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:18.376578 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ceb06dc8-551f-4a55-96fc-88cb25b6dd80 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:19.284073 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ceb06dc8-551f-4a55-96fc-88cb25b6dd80 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:19.299024 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ceb06dc8-551f-4a55-96fc-88cb25b6dd80 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:19.303880 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ceb06dc8-551f-4a55-96fc-88cb25b6dd80 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:19.308467 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ceb06dc8-551f-4a55-96fc-88cb25b6dd80 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1752 microversion: 2.20 time: 1.014628 Jun 10 18:20:19.350282 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2631/5308] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:18 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1752 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:20:20.352041 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6f286d9e-309e-42d7-b571-d9e1eb10b66e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:20.354011 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6f286d9e-309e-42d7-b571-d9e1eb10b66e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:20.361134 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:20:20.371967 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6f286d9e-309e-42d7-b571-d9e1eb10b66e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:20.374025 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6f286d9e-309e-42d7-b571-d9e1eb10b66e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:20.375375 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6f286d9e-309e-42d7-b571-d9e1eb10b66e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:20.377094 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6f286d9e-309e-42d7-b571-d9e1eb10b66e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:20.644378 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6f286d9e-309e-42d7-b571-d9e1eb10b66e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:20.658747 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6f286d9e-309e-42d7-b571-d9e1eb10b66e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:20.664163 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6f286d9e-309e-42d7-b571-d9e1eb10b66e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:20.666030 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6f286d9e-309e-42d7-b571-d9e1eb10b66e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1752 microversion: 2.20 time: 0.320649 Jun 10 18:20:20.693101 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2678/5309] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:20 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1752 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:20:21.710971 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-238d5f81-4061-43bd-8026-b3f60059f401 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:21.712282 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-238d5f81-4061-43bd-8026-b3f60059f401 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:21.722516 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-238d5f81-4061-43bd-8026-b3f60059f401 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:21.729587 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-238d5f81-4061-43bd-8026-b3f60059f401 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:21.731258 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-238d5f81-4061-43bd-8026-b3f60059f401 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:21.732058 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-238d5f81-4061-43bd-8026-b3f60059f401 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:22.660664 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-238d5f81-4061-43bd-8026-b3f60059f401 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:22.674275 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-238d5f81-4061-43bd-8026-b3f60059f401 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:22.678514 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-238d5f81-4061-43bd-8026-b3f60059f401 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:22.685320 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-238d5f81-4061-43bd-8026-b3f60059f401 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1754 microversion: 2.20 time: 0.978557 Jun 10 18:20:22.686835 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2632/5310] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:21 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1754 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:20:23.706692 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b6794fa3-584f-408d-84be-be39902bba99 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:23.707518 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b6794fa3-584f-408d-84be-be39902bba99 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:23.727576 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b6794fa3-584f-408d-84be-be39902bba99 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:23.731134 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b6794fa3-584f-408d-84be-be39902bba99 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:23.733619 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b6794fa3-584f-408d-84be-be39902bba99 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:23.734757 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b6794fa3-584f-408d-84be-be39902bba99 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:24.884408 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b6794fa3-584f-408d-84be-be39902bba99 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:24.964620 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b6794fa3-584f-408d-84be-be39902bba99 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:24.973841 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b6794fa3-584f-408d-84be-be39902bba99 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:24.977815 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b6794fa3-584f-408d-84be-be39902bba99 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1754 microversion: 2.20 time: 1.275834 Jun 10 18:20:24.979616 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2679/5311] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:23 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1754 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:20:25.999541 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b35f9142-db06-4d91-8d42-d5d6bb4c9749 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:26.000787 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b35f9142-db06-4d91-8d42-d5d6bb4c9749 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:26.008198 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=34 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:20:26.010794 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b35f9142-db06-4d91-8d42-d5d6bb4c9749 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:26.010794 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b35f9142-db06-4d91-8d42-d5d6bb4c9749 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:26.011560 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b35f9142-db06-4d91-8d42-d5d6bb4c9749 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:26.012514 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b35f9142-db06-4d91-8d42-d5d6bb4c9749 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:26.578347 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b35f9142-db06-4d91-8d42-d5d6bb4c9749 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:26.595753 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b35f9142-db06-4d91-8d42-d5d6bb4c9749 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:26.604195 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b35f9142-db06-4d91-8d42-d5d6bb4c9749 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:26.606741 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b35f9142-db06-4d91-8d42-d5d6bb4c9749 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1754 microversion: 2.20 time: 0.612015 Jun 10 18:20:26.610291 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2633/5312] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:25 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1754 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:20:27.634499 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-82ca75a5-136f-4fd0-b85a-d07956920f17 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:27.636924 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-82ca75a5-136f-4fd0-b85a-d07956920f17 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:27.654041 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-82ca75a5-136f-4fd0-b85a-d07956920f17 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:27.658766 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-82ca75a5-136f-4fd0-b85a-d07956920f17 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:27.659784 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-82ca75a5-136f-4fd0-b85a-d07956920f17 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:27.660477 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-82ca75a5-136f-4fd0-b85a-d07956920f17 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:28.038721 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-14e5907c-a244-4d40-b212-506b4cae3646 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1365531631 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1365531631-project-admin] Calling method '.version_select at 0x7f77b3ea13a0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:28.038721 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:20:28.038721 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 18:20:28.038721 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-14e5907c-a244-4d40-b212-506b4cae3646 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1365531631 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1365531631-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:28.039391 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-14e5907c-a244-4d40-b212-506b4cae3646 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1365531631 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1365531631-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:28.087126 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-14e5907c-a244-4d40-b212-506b4cae3646 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1365531631 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1365531631-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:28.087580 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-14e5907c-a244-4d40-b212-506b4cae3646 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1365531631 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1365531631-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:28.115925 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-14e5907c-a244-4d40-b212-506b4cae3646 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1365531631 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1365531631-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:28.116426 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-14e5907c-a244-4d40-b212-506b4cae3646 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1365531631 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1365531631-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:28.130828 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-14e5907c-a244-4d40-b212-506b4cae3646 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1365531631 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1365531631-project-admin] 10.222.0.35 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.402784 Jun 10 18:20:28.136214 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2634/5313] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 18:20:27 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:20:28.212820 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-82ca75a5-136f-4fd0-b85a-d07956920f17 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:28.228077 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-82ca75a5-136f-4fd0-b85a-d07956920f17 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:28.229650 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-82ca75a5-136f-4fd0-b85a-d07956920f17 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:28.230846 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-82ca75a5-136f-4fd0-b85a-d07956920f17 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1754 microversion: 2.20 time: 0.607871 Jun 10 18:20:28.231410 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2680/5314] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:27 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1754 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:20:29.255166 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fb7091fa-3f61-430f-9acc-8ed7ecc89061 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:29.256614 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fb7091fa-3f61-430f-9acc-8ed7ecc89061 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:29.292680 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fb7091fa-3f61-430f-9acc-8ed7ecc89061 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:29.297102 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fb7091fa-3f61-430f-9acc-8ed7ecc89061 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:29.297102 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fb7091fa-3f61-430f-9acc-8ed7ecc89061 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:29.297534 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fb7091fa-3f61-430f-9acc-8ed7ecc89061 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:30.013468 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fb7091fa-3f61-430f-9acc-8ed7ecc89061 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:30.030793 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fb7091fa-3f61-430f-9acc-8ed7ecc89061 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:30.035055 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fb7091fa-3f61-430f-9acc-8ed7ecc89061 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:30.039559 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fb7091fa-3f61-430f-9acc-8ed7ecc89061 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1754 microversion: 2.20 time: 0.789696 Jun 10 18:20:30.063354 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2635/5315] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:29 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1754 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:20:30.136050 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fa9411f2-00a6-46ec-aa98-9ea1780b4966 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-73648393", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:20:30.222557 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-fa9411f2-00a6-46ec-aa98-9ea1780b4966 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] validate_networks() for None {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:20:31.135436 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9c044b9a-2003-4889-b6c3-73def69ab3f7 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:31.136792 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9c044b9a-2003-4889-b6c3-73def69ab3f7 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:31.151286 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9c044b9a-2003-4889-b6c3-73def69ab3f7 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:31.151777 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9c044b9a-2003-4889-b6c3-73def69ab3f7 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:31.154671 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9c044b9a-2003-4889-b6c3-73def69ab3f7 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:31.156620 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9c044b9a-2003-4889-b6c3-73def69ab3f7 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:31.241511 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9c044b9a-2003-4889-b6c3-73def69ab3f7 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:20:31.646618 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9c044b9a-2003-4889-b6c3-73def69ab3f7 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "DELETE /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 204 len: 0 microversion: 2.32 time: 0.797572 Jun 10 18:20:31.647227 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2636/5316] 10.222.0.35 () {60 vars in 1279 bytes} [Fri Jun 10 18:20:30 2022] DELETE /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 0 bytes in 800 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 10 18:20:31.656850 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ba2e534e-52ea-48f9-9a8d-0e65be30df3d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:31.659633 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ba2e534e-52ea-48f9-9a8d-0e65be30df3d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:31.689947 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ba2e534e-52ea-48f9-9a8d-0e65be30df3d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:31.691919 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ba2e534e-52ea-48f9-9a8d-0e65be30df3d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:31.694131 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ba2e534e-52ea-48f9-9a8d-0e65be30df3d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:31.694594 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ba2e534e-52ea-48f9-9a8d-0e65be30df3d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:31.806085 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-fa9411f2-00a6-46ec-aa98-9ea1780b4966 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:20:31.808214 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-fa9411f2-00a6-46ec-aa98-9ea1780b4966 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:20:31.808214 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-fa9411f2-00a6-46ec-aa98-9ea1780b4966 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:20:31.808214 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-fa9411f2-00a6-46ec-aa98-9ea1780b4966 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:20:31.808214 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-fa9411f2-00a6-46ec-aa98-9ea1780b4966 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:20:31.825069 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fa9411f2-00a6-46ec-aa98-9ea1780b4966 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:31.826391 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fa9411f2-00a6-46ec-aa98-9ea1780b4966 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:31.838327 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fa9411f2-00a6-46ec-aa98-9ea1780b4966 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:31.838825 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fa9411f2-00a6-46ec-aa98-9ea1780b4966 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:31.892314 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-fa9411f2-00a6-46ec-aa98-9ea1780b4966 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Getting quotas for project 618acb9c019f429ea00544496d3d20bd. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:20:31.902221 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-fa9411f2-00a6-46ec-aa98-9ea1780b4966 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Getting quotas for user cb1ae263cdca4d5ebd7384e39ea2e345 and project 618acb9c019f429ea00544496d3d20bd. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:20:31.933801 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fa9411f2-00a6-46ec-aa98-9ea1780b4966 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:20:31.936883 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fa9411f2-00a6-46ec-aa98-9ea1780b4966 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] [instance: 5c01ab04-2d71-48a4-a6e9-cb4416ad7024] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:20:32.143055 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fa9411f2-00a6-46ec-aa98-9ea1780b4966 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.013646 Jun 10 18:20:32.150132 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2681/5317] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:20:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2022 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:20:32.162661 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-75bf4615-a53b-419c-871e-f023a09383da tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:32.162661 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-75bf4615-a53b-419c-871e-f023a09383da tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:32.187913 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-75bf4615-a53b-419c-871e-f023a09383da tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:32.191072 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-75bf4615-a53b-419c-871e-f023a09383da tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:32.196975 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-75bf4615-a53b-419c-871e-f023a09383da tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:32.196975 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-75bf4615-a53b-419c-871e-f023a09383da tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:32.658185 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ba2e534e-52ea-48f9-9a8d-0e65be30df3d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:32.671530 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ba2e534e-52ea-48f9-9a8d-0e65be30df3d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:32.673182 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ba2e534e-52ea-48f9-9a8d-0e65be30df3d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:32.680658 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ba2e534e-52ea-48f9-9a8d-0e65be30df3d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1754 microversion: 2.20 time: 1.025542 Jun 10 18:20:32.681335 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2637/5318] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:31 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1754 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:20:32.686691 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7be280c4-952c-4aea-b30b-a409f9ad9fb9 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:32.687312 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7be280c4-952c-4aea-b30b-a409f9ad9fb9 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] [instance: 5c01ab04-2d71-48a4-a6e9-cb4416ad7024] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:32.825203 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7be280c4-952c-4aea-b30b-a409f9ad9fb9 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1ae263cdca4d5ebd7384e39ea2e345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618acb9c019f429ea00544496d3d20bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:32.840130 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7be280c4-952c-4aea-b30b-a409f9ad9fb9 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] 10.222.0.35 "GET /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024" status: 200 len: 1212 microversion: 2.1 time: 0.151498 Jun 10 18:20:32.853594 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2638/5319] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:20:32 2022] GET /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024 => generated 1212 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:20:32.901227 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-75bf4615-a53b-419c-871e-f023a09383da tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:32.917853 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-75bf4615-a53b-419c-871e-f023a09383da tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:32.920185 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-75bf4615-a53b-419c-871e-f023a09383da tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:32.921699 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-75bf4615-a53b-419c-871e-f023a09383da tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 2956 microversion: 2.32 time: 0.770558 Jun 10 18:20:32.922271 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2682/5320] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:32 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 2956 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:20:33.702130 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3a8a396e-7eae-4645-b190-cedd88fb510d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:33.703887 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3a8a396e-7eae-4645-b190-cedd88fb510d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:33.726664 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3a8a396e-7eae-4645-b190-cedd88fb510d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:33.728156 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3a8a396e-7eae-4645-b190-cedd88fb510d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:33.729346 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3a8a396e-7eae-4645-b190-cedd88fb510d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:33.732718 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3a8a396e-7eae-4645-b190-cedd88fb510d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:33.871327 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-face783b-dad5-4763-a03f-8747898370c0 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:33.875193 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-face783b-dad5-4763-a03f-8747898370c0 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] [instance: 5c01ab04-2d71-48a4-a6e9-cb4416ad7024] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:33.908644 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-face783b-dad5-4763-a03f-8747898370c0 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:33.913738 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-face783b-dad5-4763-a03f-8747898370c0 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:33.914629 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-face783b-dad5-4763-a03f-8747898370c0 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:33.915085 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-face783b-dad5-4763-a03f-8747898370c0 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:34.101773 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3a8a396e-7eae-4645-b190-cedd88fb510d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:34.117795 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3a8a396e-7eae-4645-b190-cedd88fb510d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:34.119895 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3a8a396e-7eae-4645-b190-cedd88fb510d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:34.122948 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3a8a396e-7eae-4645-b190-cedd88fb510d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1754 microversion: 2.20 time: 0.426209 Jun 10 18:20:34.124145 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2639/5321] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:33 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1754 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:20:34.131153 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-720e46fb-3640-4dfb-ae72-d3e87f79e20f tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:34.132119 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-720e46fb-3640-4dfb-ae72-d3e87f79e20f tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:34.153474 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-720e46fb-3640-4dfb-ae72-d3e87f79e20f tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:34.156464 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-720e46fb-3640-4dfb-ae72-d3e87f79e20f tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:34.165247 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-720e46fb-3640-4dfb-ae72-d3e87f79e20f tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:34.166114 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-720e46fb-3640-4dfb-ae72-d3e87f79e20f tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:34.238399 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:20:34.249448 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-face783b-dad5-4763-a03f-8747898370c0 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1ae263cdca4d5ebd7384e39ea2e345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618acb9c019f429ea00544496d3d20bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:34.324570 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-face783b-dad5-4763-a03f-8747898370c0 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] 10.222.0.35 "GET /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024" status: 200 len: 1216 microversion: 2.1 time: 0.460638 Jun 10 18:20:34.331744 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2683/5322] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:20:33 2022] GET /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024 => generated 1216 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:20:34.693337 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-720e46fb-3640-4dfb-ae72-d3e87f79e20f tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:34.746334 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-720e46fb-3640-4dfb-ae72-d3e87f79e20f tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:34.755840 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-720e46fb-3640-4dfb-ae72-d3e87f79e20f tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:34.757603 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-720e46fb-3640-4dfb-ae72-d3e87f79e20f tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 2956 microversion: 2.32 time: 0.632219 Jun 10 18:20:34.772765 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2640/5323] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:34 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 2956 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:20:35.143632 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2a3ccda3-1b18-44b0-aae4-7ae528df1e9a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:35.144261 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2a3ccda3-1b18-44b0-aae4-7ae528df1e9a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:35.155627 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2a3ccda3-1b18-44b0-aae4-7ae528df1e9a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:35.156098 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2a3ccda3-1b18-44b0-aae4-7ae528df1e9a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:35.156934 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2a3ccda3-1b18-44b0-aae4-7ae528df1e9a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:35.157386 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2a3ccda3-1b18-44b0-aae4-7ae528df1e9a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:35.345276 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-83e689e9-e522-4b3b-bd4e-ec2f06d5b77d tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:35.346065 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-83e689e9-e522-4b3b-bd4e-ec2f06d5b77d tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] [instance: 5c01ab04-2d71-48a4-a6e9-cb4416ad7024] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:35.360109 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83e689e9-e522-4b3b-bd4e-ec2f06d5b77d tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:35.362248 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83e689e9-e522-4b3b-bd4e-ec2f06d5b77d tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:35.376884 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83e689e9-e522-4b3b-bd4e-ec2f06d5b77d tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:35.377775 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83e689e9-e522-4b3b-bd4e-ec2f06d5b77d tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:35.595081 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-83e689e9-e522-4b3b-bd4e-ec2f06d5b77d tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1ae263cdca4d5ebd7384e39ea2e345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618acb9c019f429ea00544496d3d20bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:35.604982 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-83e689e9-e522-4b3b-bd4e-ec2f06d5b77d tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] 10.222.0.35 "GET /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024" status: 200 len: 1264 microversion: 2.1 time: 0.263599 Jun 10 18:20:35.607213 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2641/5324] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:20:35 2022] GET /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024 => generated 1264 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:20:35.779439 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-95a83866-b717-4c9b-8963-21c1776eb190 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:35.780921 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-95a83866-b717-4c9b-8963-21c1776eb190 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:35.789900 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-95a83866-b717-4c9b-8963-21c1776eb190 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:35.797666 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-95a83866-b717-4c9b-8963-21c1776eb190 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:35.798994 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-95a83866-b717-4c9b-8963-21c1776eb190 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:35.799668 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-95a83866-b717-4c9b-8963-21c1776eb190 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:36.237467 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2a3ccda3-1b18-44b0-aae4-7ae528df1e9a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:36.247380 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2a3ccda3-1b18-44b0-aae4-7ae528df1e9a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:36.249794 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2a3ccda3-1b18-44b0-aae4-7ae528df1e9a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:36.259299 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2a3ccda3-1b18-44b0-aae4-7ae528df1e9a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1810 microversion: 2.20 time: 1.112571 Jun 10 18:20:36.260474 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2684/5325] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:35 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1810 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:20:36.537659 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-95a83866-b717-4c9b-8963-21c1776eb190 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:36.561523 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-95a83866-b717-4c9b-8963-21c1776eb190 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:36.569533 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-95a83866-b717-4c9b-8963-21c1776eb190 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:36.575152 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-95a83866-b717-4c9b-8963-21c1776eb190 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 2956 microversion: 2.32 time: 0.796966 Jun 10 18:20:36.600379 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2642/5326] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:35 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 2956 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:20:36.633808 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-81e0fd3a-77a5-4a30-9a3d-b36b91babf79 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:36.633808 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-81e0fd3a-77a5-4a30-9a3d-b36b91babf79 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] [instance: 5c01ab04-2d71-48a4-a6e9-cb4416ad7024] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:36.639294 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-81e0fd3a-77a5-4a30-9a3d-b36b91babf79 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:36.640935 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-81e0fd3a-77a5-4a30-9a3d-b36b91babf79 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:36.644994 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-81e0fd3a-77a5-4a30-9a3d-b36b91babf79 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:36.645477 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-81e0fd3a-77a5-4a30-9a3d-b36b91babf79 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:36.880703 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-81e0fd3a-77a5-4a30-9a3d-b36b91babf79 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1ae263cdca4d5ebd7384e39ea2e345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618acb9c019f429ea00544496d3d20bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:36.900717 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-81e0fd3a-77a5-4a30-9a3d-b36b91babf79 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] 10.222.0.35 "GET /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024" status: 200 len: 1270 microversion: 2.1 time: 0.275495 Jun 10 18:20:36.911437 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2685/5327] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:20:36 2022] GET /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024 => generated 1270 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:20:37.278742 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bbe90629-cabb-4d32-9b64-ef6dbf85623b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:37.280187 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bbe90629-cabb-4d32-9b64-ef6dbf85623b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:37.293094 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bbe90629-cabb-4d32-9b64-ef6dbf85623b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:37.293719 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bbe90629-cabb-4d32-9b64-ef6dbf85623b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:37.295172 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bbe90629-cabb-4d32-9b64-ef6dbf85623b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:37.298837 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bbe90629-cabb-4d32-9b64-ef6dbf85623b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:37.601288 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5f765632-adf8-44ed-8f2f-168c352371cf tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:37.607365 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5f765632-adf8-44ed-8f2f-168c352371cf tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:37.624884 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f765632-adf8-44ed-8f2f-168c352371cf tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:37.630205 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f765632-adf8-44ed-8f2f-168c352371cf tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:37.630205 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f765632-adf8-44ed-8f2f-168c352371cf tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:37.630205 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5f765632-adf8-44ed-8f2f-168c352371cf tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:37.677727 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:20:38.059899 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bbe90629-cabb-4d32-9b64-ef6dbf85623b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:38.076744 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bbe90629-cabb-4d32-9b64-ef6dbf85623b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:38.079530 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bbe90629-cabb-4d32-9b64-ef6dbf85623b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:38.081497 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bbe90629-cabb-4d32-9b64-ef6dbf85623b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1810 microversion: 2.20 time: 0.806784 Jun 10 18:20:38.094583 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2643/5328] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:37 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1810 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:20:38.100482 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a8c377a7-1c75-4a95-896b-8b09d081a288 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:38.101428 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a8c377a7-1c75-4a95-896b-8b09d081a288 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] [instance: 5c01ab04-2d71-48a4-a6e9-cb4416ad7024] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:38.109349 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a8c377a7-1c75-4a95-896b-8b09d081a288 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:38.110120 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a8c377a7-1c75-4a95-896b-8b09d081a288 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:38.111090 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a8c377a7-1c75-4a95-896b-8b09d081a288 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:38.111716 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a8c377a7-1c75-4a95-896b-8b09d081a288 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:38.161522 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5f765632-adf8-44ed-8f2f-168c352371cf tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:38.175291 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5f765632-adf8-44ed-8f2f-168c352371cf tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:38.176935 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5f765632-adf8-44ed-8f2f-168c352371cf tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:38.178486 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5f765632-adf8-44ed-8f2f-168c352371cf tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 2935 microversion: 2.32 time: 0.583083 Jun 10 18:20:38.182894 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2686/5329] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:37 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 2935 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:20:38.337983 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a8c377a7-1c75-4a95-896b-8b09d081a288 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1ae263cdca4d5ebd7384e39ea2e345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618acb9c019f429ea00544496d3d20bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:38.365337 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a8c377a7-1c75-4a95-896b-8b09d081a288 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] 10.222.0.35 "GET /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024" status: 200 len: 1270 microversion: 2.1 time: 0.269132 Jun 10 18:20:38.376126 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2644/5330] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:20:38 2022] GET /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024 => generated 1270 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:20:39.107791 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c3c47c99-5320-4853-8009-8dd298c4eaa0 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:39.109104 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c3c47c99-5320-4853-8009-8dd298c4eaa0 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:39.125977 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c3c47c99-5320-4853-8009-8dd298c4eaa0 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:39.126663 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c3c47c99-5320-4853-8009-8dd298c4eaa0 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:39.128052 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c3c47c99-5320-4853-8009-8dd298c4eaa0 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:39.128738 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c3c47c99-5320-4853-8009-8dd298c4eaa0 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:39.203588 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a1bdd121-0016-4c9c-9942-6e60f893cfac tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:39.204559 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a1bdd121-0016-4c9c-9942-6e60f893cfac tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:39.217243 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a1bdd121-0016-4c9c-9942-6e60f893cfac tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:39.221461 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a1bdd121-0016-4c9c-9942-6e60f893cfac tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:39.222526 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a1bdd121-0016-4c9c-9942-6e60f893cfac tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:39.227199 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a1bdd121-0016-4c9c-9942-6e60f893cfac tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:39.839791 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c3c47c99-5320-4853-8009-8dd298c4eaa0 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:39.856830 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c3c47c99-5320-4853-8009-8dd298c4eaa0 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:39.864527 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c3c47c99-5320-4853-8009-8dd298c4eaa0 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:39.866108 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c3c47c99-5320-4853-8009-8dd298c4eaa0 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1810 microversion: 2.20 time: 0.769428 Jun 10 18:20:39.871711 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2687/5331] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:39 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1810 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:20:39.884727 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0d031214-8d64-4ef0-8486-31303154a24d tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:39.885642 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0d031214-8d64-4ef0-8486-31303154a24d tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] [instance: 5c01ab04-2d71-48a4-a6e9-cb4416ad7024] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:39.903267 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0d031214-8d64-4ef0-8486-31303154a24d tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:39.908875 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0d031214-8d64-4ef0-8486-31303154a24d tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:39.910133 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0d031214-8d64-4ef0-8486-31303154a24d tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:39.911962 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0d031214-8d64-4ef0-8486-31303154a24d tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:40.729291 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0d031214-8d64-4ef0-8486-31303154a24d tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1ae263cdca4d5ebd7384e39ea2e345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618acb9c019f429ea00544496d3d20bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:40.738320 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0d031214-8d64-4ef0-8486-31303154a24d tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] 10.222.0.35 "GET /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024" status: 200 len: 1312 microversion: 2.1 time: 0.864547 Jun 10 18:20:40.761482 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2688/5332] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:20:39 2022] GET /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024 => generated 1312 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:20:40.777204 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-84c7a111-dfa8-4f63-96a3-7adb2e29ec65 req-08f30291-57cc-4b43-b223-ca015624ab5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39300115-c0d6-485c-a610-543bdf470fae", "name": "network-vif-unplugged", "status": "completed", "tag": "622a83e2-85f5-435d-8d26-2bce252a0f1b"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:20:40.819003 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-84c7a111-dfa8-4f63-96a3-7adb2e29ec65 req-08f30291-57cc-4b43-b223-ca015624ab5a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:40.819866 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-84c7a111-dfa8-4f63-96a3-7adb2e29ec65 req-08f30291-57cc-4b43-b223-ca015624ab5a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:40.862665 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-84c7a111-dfa8-4f63-96a3-7adb2e29ec65 req-08f30291-57cc-4b43-b223-ca015624ab5a service nova] Creating event network-vif-unplugged:622a83e2-85f5-435d-8d26-2bce252a0f1b for instance 39300115-c0d6-485c-a610-543bdf470fae on chh2-master-2 Jun 10 18:20:40.904859 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-84c7a111-dfa8-4f63-96a3-7adb2e29ec65 req-08f30291-57cc-4b43-b223-ca015624ab5a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.134231 Jun 10 18:20:40.908763 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2689/5333] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:20:40.945826 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-1acc7199-8af7-4cdb-a875-426aa1758bf0 req-55179b34-c663-4316-8ef6-fa6c4a92ba19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39300115-c0d6-485c-a610-543bdf470fae", "name": "network-vif-deleted", "tag": "048d307e-e1dc-483a-9306-cdb9189fa940"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:20:40.979334 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-1acc7199-8af7-4cdb-a875-426aa1758bf0 req-55179b34-c663-4316-8ef6-fa6c4a92ba19 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:40.989054 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-1acc7199-8af7-4cdb-a875-426aa1758bf0 req-55179b34-c663-4316-8ef6-fa6c4a92ba19 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:41.033310 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-1acc7199-8af7-4cdb-a875-426aa1758bf0 req-55179b34-c663-4316-8ef6-fa6c4a92ba19 service nova] Creating event network-vif-deleted:048d307e-e1dc-483a-9306-cdb9189fa940 for instance 39300115-c0d6-485c-a610-543bdf470fae on chh2-master-2 Jun 10 18:20:41.064152 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-1acc7199-8af7-4cdb-a875-426aa1758bf0 req-55179b34-c663-4316-8ef6-fa6c4a92ba19 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142547 Jun 10 18:20:41.068957 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2690/5334] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:20:41.074803 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1beeefb3-ae04-40bd-b658-0a45e196aced tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:41.089548 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1beeefb3-ae04-40bd-b658-0a45e196aced tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:41.105027 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a1bdd121-0016-4c9c-9942-6e60f893cfac tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:41.110256 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1beeefb3-ae04-40bd-b658-0a45e196aced tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:41.113029 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1beeefb3-ae04-40bd-b658-0a45e196aced tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:41.120384 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a1bdd121-0016-4c9c-9942-6e60f893cfac tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:41.122552 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1beeefb3-ae04-40bd-b658-0a45e196aced tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:41.124520 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a1bdd121-0016-4c9c-9942-6e60f893cfac tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:41.128723 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1beeefb3-ae04-40bd-b658-0a45e196aced tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:41.155979 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a1bdd121-0016-4c9c-9942-6e60f893cfac tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 2867 microversion: 2.32 time: 1.956414 Jun 10 18:20:41.179830 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2645/5335] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:39 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 2867 bytes in 1981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:20:41.756624 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-84c71ddd-ff97-43e8-91b6-d8e6e736dfc5 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:41.758280 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-84c71ddd-ff97-43e8-91b6-d8e6e736dfc5 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] [instance: 5c01ab04-2d71-48a4-a6e9-cb4416ad7024] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:41.771546 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-84c71ddd-ff97-43e8-91b6-d8e6e736dfc5 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:41.776448 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-84c71ddd-ff97-43e8-91b6-d8e6e736dfc5 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:41.783159 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-84c71ddd-ff97-43e8-91b6-d8e6e736dfc5 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:41.787589 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-84c71ddd-ff97-43e8-91b6-d8e6e736dfc5 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:41.848960 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:20:41.916036 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=6 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:20:42.344729 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1beeefb3-ae04-40bd-b658-0a45e196aced tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:42.384327 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1beeefb3-ae04-40bd-b658-0a45e196aced tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:42.406900 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1beeefb3-ae04-40bd-b658-0a45e196aced tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:42.409719 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1beeefb3-ae04-40bd-b658-0a45e196aced tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1810 microversion: 2.20 time: 1.339068 Jun 10 18:20:42.424124 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2691/5336] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:41 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1810 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:20:42.453261 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8a5fd9e2-a244-414c-99da-d8e7bb298614 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:42.458127 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8a5fd9e2-a244-414c-99da-d8e7bb298614 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:42.488611 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8a5fd9e2-a244-414c-99da-d8e7bb298614 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:42.491272 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8a5fd9e2-a244-414c-99da-d8e7bb298614 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:42.493525 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8a5fd9e2-a244-414c-99da-d8e7bb298614 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:42.494139 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8a5fd9e2-a244-414c-99da-d8e7bb298614 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:42.833315 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:20:43.726875 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-84c71ddd-ff97-43e8-91b6-d8e6e736dfc5 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1ae263cdca4d5ebd7384e39ea2e345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618acb9c019f429ea00544496d3d20bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:43.735380 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-84c71ddd-ff97-43e8-91b6-d8e6e736dfc5 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] 10.222.0.35 "GET /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024" status: 200 len: 1312 microversion: 2.1 time: 1.983063 Jun 10 18:20:43.735979 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2646/5337] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:20:41 2022] GET /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024 => generated 1312 bytes in 1984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:20:43.743207 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-0364abff-6f9b-4f05-b3aa-5fafccc49401 req-5b546516-386b-4076-b85c-e09a27e6c13f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39300115-c0d6-485c-a610-543bdf470fae", "name": "network-vif-unplugged", "status": "completed", "tag": "f706de66-4e9b-4a6d-9fca-27a9fc2c6121"}, {"server_uuid": "39300115-c0d6-485c-a610-543bdf470fae", "name": "network-vif-unplugged", "status": "completed", "tag": "90ddcb49-417f-4027-b8fd-8e4f78ccc8ba"}, {"server_uuid": "39300115-c0d6-485c-a610-543bdf470fae", "name": "network-vif-unplugged", "status": "completed", "tag": "63a4b943-cacf-4b7e-9faa-97d4b5e9dbb6"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:20:43.781914 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-0364abff-6f9b-4f05-b3aa-5fafccc49401 req-5b546516-386b-4076-b85c-e09a27e6c13f service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:43.782377 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-0364abff-6f9b-4f05-b3aa-5fafccc49401 req-5b546516-386b-4076-b85c-e09a27e6c13f service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:43.806055 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-0364abff-6f9b-4f05-b3aa-5fafccc49401 req-5b546516-386b-4076-b85c-e09a27e6c13f service nova] Creating event network-vif-unplugged:f706de66-4e9b-4a6d-9fca-27a9fc2c6121 for instance 39300115-c0d6-485c-a610-543bdf470fae on chh2-master-2 Jun 10 18:20:43.806929 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-0364abff-6f9b-4f05-b3aa-5fafccc49401 req-5b546516-386b-4076-b85c-e09a27e6c13f service nova] Creating event network-vif-unplugged:90ddcb49-417f-4027-b8fd-8e4f78ccc8ba for instance 39300115-c0d6-485c-a610-543bdf470fae on chh2-master-2 Jun 10 18:20:43.807672 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-0364abff-6f9b-4f05-b3aa-5fafccc49401 req-5b546516-386b-4076-b85c-e09a27e6c13f service nova] Creating event network-vif-unplugged:63a4b943-cacf-4b7e-9faa-97d4b5e9dbb6 for instance 39300115-c0d6-485c-a610-543bdf470fae on chh2-master-2 Jun 10 18:20:43.816520 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-0364abff-6f9b-4f05-b3aa-5fafccc49401 req-5b546516-386b-4076-b85c-e09a27e6c13f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.079147 Jun 10 18:20:43.818482 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2647/5338] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:20:43.824199 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-471905a2-094f-4991-b0e6-dcbef3bb2743 req-c3cfbf32-a24f-4d71-8ae1-0a3727aa62d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39300115-c0d6-485c-a610-543bdf470fae", "name": "network-vif-deleted", "tag": "f706de66-4e9b-4a6d-9fca-27a9fc2c6121"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:20:43.837818 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-471905a2-094f-4991-b0e6-dcbef3bb2743 req-c3cfbf32-a24f-4d71-8ae1-0a3727aa62d5 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:43.839309 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-471905a2-094f-4991-b0e6-dcbef3bb2743 req-c3cfbf32-a24f-4d71-8ae1-0a3727aa62d5 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:43.861518 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-471905a2-094f-4991-b0e6-dcbef3bb2743 req-c3cfbf32-a24f-4d71-8ae1-0a3727aa62d5 service nova] Creating event network-vif-deleted:f706de66-4e9b-4a6d-9fca-27a9fc2c6121 for instance 39300115-c0d6-485c-a610-543bdf470fae on chh2-master-2 Jun 10 18:20:43.867860 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-471905a2-094f-4991-b0e6-dcbef3bb2743 req-c3cfbf32-a24f-4d71-8ae1-0a3727aa62d5 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047686 Jun 10 18:20:43.869112 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2648/5339] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:20:43.876496 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-41e2e575-cff9-43bb-b4cb-3df38cd56495 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:43.877637 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-41e2e575-cff9-43bb-b4cb-3df38cd56495 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:43.885529 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41e2e575-cff9-43bb-b4cb-3df38cd56495 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:43.886305 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41e2e575-cff9-43bb-b4cb-3df38cd56495 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:43.888073 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41e2e575-cff9-43bb-b4cb-3df38cd56495 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:43.888884 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41e2e575-cff9-43bb-b4cb-3df38cd56495 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:44.251332 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8a5fd9e2-a244-414c-99da-d8e7bb298614 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:44.282103 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8a5fd9e2-a244-414c-99da-d8e7bb298614 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:44.285727 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8a5fd9e2-a244-414c-99da-d8e7bb298614 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:44.287066 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8a5fd9e2-a244-414c-99da-d8e7bb298614 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 2706 microversion: 2.32 time: 1.855718 Jun 10 18:20:44.287640 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2692/5340] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:42 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 2706 bytes in 1877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:20:44.753482 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d5a030a6-d857-4309-a5a4-52e800cdd58c tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:44.754440 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d5a030a6-d857-4309-a5a4-52e800cdd58c tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] [instance: 5c01ab04-2d71-48a4-a6e9-cb4416ad7024] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:44.765389 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d5a030a6-d857-4309-a5a4-52e800cdd58c tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:44.765852 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d5a030a6-d857-4309-a5a4-52e800cdd58c tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:44.766659 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d5a030a6-d857-4309-a5a4-52e800cdd58c tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:44.767101 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d5a030a6-d857-4309-a5a4-52e800cdd58c tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:45.579967 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d5a030a6-d857-4309-a5a4-52e800cdd58c tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1ae263cdca4d5ebd7384e39ea2e345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618acb9c019f429ea00544496d3d20bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:45.603503 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d5a030a6-d857-4309-a5a4-52e800cdd58c tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] 10.222.0.35 "GET /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024" status: 200 len: 1312 microversion: 2.1 time: 0.854120 Jun 10 18:20:45.615536 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2693/5341] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:20:44 2022] GET /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024 => generated 1312 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:20:45.635131 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c8338389-7e9e-46a0-a394-f78aeff1273e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:45.642325 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c8338389-7e9e-46a0-a394-f78aeff1273e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:45.657541 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c8338389-7e9e-46a0-a394-f78aeff1273e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:45.662617 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c8338389-7e9e-46a0-a394-f78aeff1273e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:45.663966 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c8338389-7e9e-46a0-a394-f78aeff1273e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:45.664811 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c8338389-7e9e-46a0-a394-f78aeff1273e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:45.686647 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-41e2e575-cff9-43bb-b4cb-3df38cd56495 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:45.721415 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-41e2e575-cff9-43bb-b4cb-3df38cd56495 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:45.728746 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-41e2e575-cff9-43bb-b4cb-3df38cd56495 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:45.738166 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-41e2e575-cff9-43bb-b4cb-3df38cd56495 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1810 microversion: 2.20 time: 1.866538 Jun 10 18:20:45.739149 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2649/5342] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:43 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1810 bytes in 1869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:20:46.626197 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6d97a9e9-007b-4165-abe6-0e587455dc78 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:46.627121 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6d97a9e9-007b-4165-abe6-0e587455dc78 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] [instance: 5c01ab04-2d71-48a4-a6e9-cb4416ad7024] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:46.649498 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d97a9e9-007b-4165-abe6-0e587455dc78 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:46.650156 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d97a9e9-007b-4165-abe6-0e587455dc78 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:46.651267 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d97a9e9-007b-4165-abe6-0e587455dc78 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:46.651882 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d97a9e9-007b-4165-abe6-0e587455dc78 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:46.878350 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c8338389-7e9e-46a0-a394-f78aeff1273e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:46.892422 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c8338389-7e9e-46a0-a394-f78aeff1273e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:46.894025 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c8338389-7e9e-46a0-a394-f78aeff1273e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:46.925702 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c8338389-7e9e-46a0-a394-f78aeff1273e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 2545 microversion: 2.32 time: 1.285071 Jun 10 18:20:46.928206 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2694/5343] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:45 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 2545 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:20:46.963260 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-c30f8deb-101c-41e7-b287-141026437a17 req-ae2b784f-45f5-4983-98de-5d01cb95daed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39300115-c0d6-485c-a610-543bdf470fae", "name": "network-vif-deleted", "tag": "622a83e2-85f5-435d-8d26-2bce252a0f1b"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:20:47.011057 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-c30f8deb-101c-41e7-b287-141026437a17 req-ae2b784f-45f5-4983-98de-5d01cb95daed service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:47.011665 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-c30f8deb-101c-41e7-b287-141026437a17 req-ae2b784f-45f5-4983-98de-5d01cb95daed service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:47.038927 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-c30f8deb-101c-41e7-b287-141026437a17 req-ae2b784f-45f5-4983-98de-5d01cb95daed service nova] Creating event network-vif-deleted:622a83e2-85f5-435d-8d26-2bce252a0f1b for instance 39300115-c0d6-485c-a610-543bdf470fae on chh2-master-2 Jun 10 18:20:47.050151 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-c30f8deb-101c-41e7-b287-141026437a17 req-ae2b784f-45f5-4983-98de-5d01cb95daed service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118395 Jun 10 18:20:47.051303 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2695/5344] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:20:47.058343 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-424d0d5b-40d3-49bd-8f06-0557d09782ae tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:47.065217 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-424d0d5b-40d3-49bd-8f06-0557d09782ae tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:47.088844 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-424d0d5b-40d3-49bd-8f06-0557d09782ae tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:47.089515 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-424d0d5b-40d3-49bd-8f06-0557d09782ae tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:47.091822 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-424d0d5b-40d3-49bd-8f06-0557d09782ae tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:47.092504 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-424d0d5b-40d3-49bd-8f06-0557d09782ae tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:47.813248 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6d97a9e9-007b-4165-abe6-0e587455dc78 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1ae263cdca4d5ebd7384e39ea2e345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618acb9c019f429ea00544496d3d20bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:47.823557 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6d97a9e9-007b-4165-abe6-0e587455dc78 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] 10.222.0.35 "GET /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024" status: 200 len: 1312 microversion: 2.1 time: 1.204361 Jun 10 18:20:47.833830 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2650/5345] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:20:46 2022] GET /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024 => generated 1312 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:20:47.837024 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-e81e613c-4243-40a3-8d73-c37a40ac6b50 req-3395d404-720d-4e1c-959c-292b6c7d3924 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c01ab04-2d71-48a4-a6e9-cb4416ad7024", "tag": "c826ab58-b14d-4f40-88dc-1c92b882bf90"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:20:47.865360 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-e81e613c-4243-40a3-8d73-c37a40ac6b50 req-3395d404-720d-4e1c-959c-292b6c7d3924 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:47.866239 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-e81e613c-4243-40a3-8d73-c37a40ac6b50 req-3395d404-720d-4e1c-959c-292b6c7d3924 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:47.882094 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-e81e613c-4243-40a3-8d73-c37a40ac6b50 req-3395d404-720d-4e1c-959c-292b6c7d3924 service nova] Creating event network-changed:c826ab58-b14d-4f40-88dc-1c92b882bf90 for instance 5c01ab04-2d71-48a4-a6e9-cb4416ad7024 on chh1-master-2 Jun 10 18:20:47.892002 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-e81e613c-4243-40a3-8d73-c37a40ac6b50 req-3395d404-720d-4e1c-959c-292b6c7d3924 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058371 Jun 10 18:20:47.893903 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2651/5346] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:20:47.949391 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-47741c16-2d7e-4f27-8fe2-e9ac8716c2bb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:47.951200 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-47741c16-2d7e-4f27-8fe2-e9ac8716c2bb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:47.962461 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-47741c16-2d7e-4f27-8fe2-e9ac8716c2bb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:47.962925 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-47741c16-2d7e-4f27-8fe2-e9ac8716c2bb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:47.963722 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-47741c16-2d7e-4f27-8fe2-e9ac8716c2bb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:47.964168 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-47741c16-2d7e-4f27-8fe2-e9ac8716c2bb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:48.160512 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-424d0d5b-40d3-49bd-8f06-0557d09782ae tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:48.176981 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-424d0d5b-40d3-49bd-8f06-0557d09782ae tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:48.183618 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-424d0d5b-40d3-49bd-8f06-0557d09782ae tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:48.185976 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-424d0d5b-40d3-49bd-8f06-0557d09782ae tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1810 microversion: 2.20 time: 1.132995 Jun 10 18:20:48.189038 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2696/5347] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:47 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1810 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:20:48.567713 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-47741c16-2d7e-4f27-8fe2-e9ac8716c2bb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:48.603558 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-47741c16-2d7e-4f27-8fe2-e9ac8716c2bb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:48.610387 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-47741c16-2d7e-4f27-8fe2-e9ac8716c2bb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:48.617030 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-47741c16-2d7e-4f27-8fe2-e9ac8716c2bb tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 2388 microversion: 2.32 time: 0.668599 Jun 10 18:20:48.631993 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2652/5348] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:47 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 2388 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:20:48.842251 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-afc4badb-af1f-44c4-88ff-f44074234eeb tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:48.842982 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-afc4badb-af1f-44c4-88ff-f44074234eeb tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] [instance: 5c01ab04-2d71-48a4-a6e9-cb4416ad7024] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:48.858587 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-afc4badb-af1f-44c4-88ff-f44074234eeb tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:48.859098 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-afc4badb-af1f-44c4-88ff-f44074234eeb tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:48.859958 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-afc4badb-af1f-44c4-88ff-f44074234eeb tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:48.860653 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-afc4badb-af1f-44c4-88ff-f44074234eeb tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:49.213356 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5b8485b8-fb2f-4cdd-867a-82b403a93bf4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:49.216143 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5b8485b8-fb2f-4cdd-867a-82b403a93bf4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:49.235127 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5b8485b8-fb2f-4cdd-867a-82b403a93bf4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:49.235830 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5b8485b8-fb2f-4cdd-867a-82b403a93bf4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:49.237024 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5b8485b8-fb2f-4cdd-867a-82b403a93bf4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:49.238168 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5b8485b8-fb2f-4cdd-867a-82b403a93bf4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:49.288504 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-afc4badb-af1f-44c4-88ff-f44074234eeb tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1ae263cdca4d5ebd7384e39ea2e345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618acb9c019f429ea00544496d3d20bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:49.321138 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-afc4badb-af1f-44c4-88ff-f44074234eeb tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] 10.222.0.35 "GET /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024" status: 200 len: 1312 microversion: 2.1 time: 0.483242 Jun 10 18:20:49.322126 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2697/5349] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:20:48 2022] GET /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024 => generated 1312 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:20:49.639219 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-25d58362-9969-4b33-924f-8ef621f3759a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:49.640147 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-25d58362-9969-4b33-924f-8ef621f3759a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:49.656423 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-25d58362-9969-4b33-924f-8ef621f3759a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:49.657161 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-25d58362-9969-4b33-924f-8ef621f3759a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:49.658799 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-25d58362-9969-4b33-924f-8ef621f3759a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:49.666332 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-25d58362-9969-4b33-924f-8ef621f3759a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:50.000245 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5b8485b8-fb2f-4cdd-867a-82b403a93bf4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:50.014495 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5b8485b8-fb2f-4cdd-867a-82b403a93bf4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:50.016612 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5b8485b8-fb2f-4cdd-867a-82b403a93bf4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:50.020538 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5b8485b8-fb2f-4cdd-867a-82b403a93bf4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1810 microversion: 2.20 time: 0.811415 Jun 10 18:20:50.022558 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2653/5350] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:49 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1810 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:20:50.338522 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b077c1d4-0f9e-48d0-8b11-1d71be91a0fc tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:50.339849 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b077c1d4-0f9e-48d0-8b11-1d71be91a0fc tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] [instance: 5c01ab04-2d71-48a4-a6e9-cb4416ad7024] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:50.347418 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b077c1d4-0f9e-48d0-8b11-1d71be91a0fc tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:50.348127 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b077c1d4-0f9e-48d0-8b11-1d71be91a0fc tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:50.349130 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b077c1d4-0f9e-48d0-8b11-1d71be91a0fc tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:50.349762 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b077c1d4-0f9e-48d0-8b11-1d71be91a0fc tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:50.369650 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-25d58362-9969-4b33-924f-8ef621f3759a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:50.387014 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-25d58362-9969-4b33-924f-8ef621f3759a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:50.388898 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-25d58362-9969-4b33-924f-8ef621f3759a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:50.393684 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-25d58362-9969-4b33-924f-8ef621f3759a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 2341 microversion: 2.32 time: 0.755944 Jun 10 18:20:50.404078 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2698/5351] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:49 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 2341 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:20:51.046418 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3b5f0d7b-5760-4f8f-b32b-b3276fa3b868 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:51.046418 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3b5f0d7b-5760-4f8f-b32b-b3276fa3b868 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:51.056636 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3b5f0d7b-5760-4f8f-b32b-b3276fa3b868 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:51.057937 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3b5f0d7b-5760-4f8f-b32b-b3276fa3b868 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:51.067835 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3b5f0d7b-5760-4f8f-b32b-b3276fa3b868 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:51.068619 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3b5f0d7b-5760-4f8f-b32b-b3276fa3b868 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:52.051717 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b077c1d4-0f9e-48d0-8b11-1d71be91a0fc tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1ae263cdca4d5ebd7384e39ea2e345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618acb9c019f429ea00544496d3d20bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:52.067598 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b077c1d4-0f9e-48d0-8b11-1d71be91a0fc tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] 10.222.0.35 "GET /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024" status: 200 len: 1312 microversion: 2.1 time: 1.731534 Jun 10 18:20:52.080407 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2654/5352] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:20:50 2022] GET /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024 => generated 1312 bytes in 1746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:20:52.086421 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-d3d43f55-5381-4730-bdb7-4fd66f278879 req-c28e5da6-aa6d-4078-b717-ef8bc1d75374 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39300115-c0d6-485c-a610-543bdf470fae", "name": "network-vif-deleted", "tag": "90ddcb49-417f-4027-b8fd-8e4f78ccc8ba"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:20:52.097439 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-d3d43f55-5381-4730-bdb7-4fd66f278879 req-c28e5da6-aa6d-4078-b717-ef8bc1d75374 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:52.098211 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-d3d43f55-5381-4730-bdb7-4fd66f278879 req-c28e5da6-aa6d-4078-b717-ef8bc1d75374 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:52.116016 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-d3d43f55-5381-4730-bdb7-4fd66f278879 req-c28e5da6-aa6d-4078-b717-ef8bc1d75374 service nova] Creating event network-vif-deleted:90ddcb49-417f-4027-b8fd-8e4f78ccc8ba for instance 39300115-c0d6-485c-a610-543bdf470fae on chh2-master-2 Jun 10 18:20:52.140539 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-d3d43f55-5381-4730-bdb7-4fd66f278879 req-c28e5da6-aa6d-4078-b717-ef8bc1d75374 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058028 Jun 10 18:20:52.145311 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2655/5353] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:20:52.158329 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-18c7c89d-5549-48cd-94cc-76219ab47011 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:52.161798 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-18c7c89d-5549-48cd-94cc-76219ab47011 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:52.175843 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-18c7c89d-5549-48cd-94cc-76219ab47011 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:52.178814 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-18c7c89d-5549-48cd-94cc-76219ab47011 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:52.179953 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-18c7c89d-5549-48cd-94cc-76219ab47011 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:52.180678 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-18c7c89d-5549-48cd-94cc-76219ab47011 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:52.361601 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3b5f0d7b-5760-4f8f-b32b-b3276fa3b868 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:52.381712 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3b5f0d7b-5760-4f8f-b32b-b3276fa3b868 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:52.385539 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3b5f0d7b-5760-4f8f-b32b-b3276fa3b868 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:52.386981 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3b5f0d7b-5760-4f8f-b32b-b3276fa3b868 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1810 microversion: 2.20 time: 1.351766 Jun 10 18:20:52.390366 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2699/5354] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:51 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1810 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:20:53.092749 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-78da1d91-ec1f-41e3-a72b-32da9c1f6bcb tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:53.093598 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-78da1d91-ec1f-41e3-a72b-32da9c1f6bcb tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] [instance: 5c01ab04-2d71-48a4-a6e9-cb4416ad7024] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:53.113076 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-78da1d91-ec1f-41e3-a72b-32da9c1f6bcb tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:53.113682 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-78da1d91-ec1f-41e3-a72b-32da9c1f6bcb tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:53.114575 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-78da1d91-ec1f-41e3-a72b-32da9c1f6bcb tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:53.115032 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-78da1d91-ec1f-41e3-a72b-32da9c1f6bcb tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:53.144283 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-18c7c89d-5549-48cd-94cc-76219ab47011 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:53.158667 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-18c7c89d-5549-48cd-94cc-76219ab47011 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:53.165607 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-18c7c89d-5549-48cd-94cc-76219ab47011 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:53.167539 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-18c7c89d-5549-48cd-94cc-76219ab47011 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 2341 microversion: 2.32 time: 1.019822 Jun 10 18:20:53.170702 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2656/5355] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:52 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 2341 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:20:53.418662 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fd3be220-cdd8-4eed-a8f2-06027aeb71f5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:53.421466 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fd3be220-cdd8-4eed-a8f2-06027aeb71f5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:53.444459 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd3be220-cdd8-4eed-a8f2-06027aeb71f5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:53.446741 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd3be220-cdd8-4eed-a8f2-06027aeb71f5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:53.455549 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd3be220-cdd8-4eed-a8f2-06027aeb71f5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:53.457088 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd3be220-cdd8-4eed-a8f2-06027aeb71f5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:53.494365 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-78da1d91-ec1f-41e3-a72b-32da9c1f6bcb tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1ae263cdca4d5ebd7384e39ea2e345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618acb9c019f429ea00544496d3d20bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:53.510897 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-78da1d91-ec1f-41e3-a72b-32da9c1f6bcb tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] 10.222.0.35 "GET /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024" status: 200 len: 1312 microversion: 2.1 time: 0.428232 Jun 10 18:20:53.512673 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2700/5356] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:20:53 2022] GET /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024 => generated 1312 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:20:53.857682 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fd3be220-cdd8-4eed-a8f2-06027aeb71f5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:53.871153 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fd3be220-cdd8-4eed-a8f2-06027aeb71f5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:53.879615 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fd3be220-cdd8-4eed-a8f2-06027aeb71f5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:53.882196 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fd3be220-cdd8-4eed-a8f2-06027aeb71f5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1810 microversion: 2.20 time: 0.474756 Jun 10 18:20:53.886032 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2657/5357] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:53 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1810 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:20:54.189648 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ff352276-ad66-4528-8c1b-5b655cbd6180 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:54.191479 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ff352276-ad66-4528-8c1b-5b655cbd6180 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:54.201585 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:20:54.213503 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ff352276-ad66-4528-8c1b-5b655cbd6180 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:54.222398 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ff352276-ad66-4528-8c1b-5b655cbd6180 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:54.226107 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ff352276-ad66-4528-8c1b-5b655cbd6180 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:54.227178 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ff352276-ad66-4528-8c1b-5b655cbd6180 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:54.409369 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-505a2a95-1642-4f32-a07d-33c64889e8a9 req-8c261f97-240e-47c7-aaa1-a1f92c470e59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39300115-c0d6-485c-a610-543bdf470fae", "name": "network-vif-deleted", "tag": "63a4b943-cacf-4b7e-9faa-97d4b5e9dbb6"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:20:54.427362 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-505a2a95-1642-4f32-a07d-33c64889e8a9 req-8c261f97-240e-47c7-aaa1-a1f92c470e59 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:54.432677 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-505a2a95-1642-4f32-a07d-33c64889e8a9 req-8c261f97-240e-47c7-aaa1-a1f92c470e59 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:54.457694 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-505a2a95-1642-4f32-a07d-33c64889e8a9 req-8c261f97-240e-47c7-aaa1-a1f92c470e59 service nova] Creating event network-vif-deleted:63a4b943-cacf-4b7e-9faa-97d4b5e9dbb6 for instance 39300115-c0d6-485c-a610-543bdf470fae on chh2-master-2 Jun 10 18:20:54.470224 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-505a2a95-1642-4f32-a07d-33c64889e8a9 req-8c261f97-240e-47c7-aaa1-a1f92c470e59 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064595 Jun 10 18:20:54.471413 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2658/5358] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:20:54.506212 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ff352276-ad66-4528-8c1b-5b655cbd6180 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:54.533405 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ff352276-ad66-4528-8c1b-5b655cbd6180 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:54.533605 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6a7bd60d-4442-49c6-a585-58965f1ae4f8 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:54.533605 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6a7bd60d-4442-49c6-a585-58965f1ae4f8 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] [instance: 5c01ab04-2d71-48a4-a6e9-cb4416ad7024] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:54.545998 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ff352276-ad66-4528-8c1b-5b655cbd6180 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:54.545998 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ff352276-ad66-4528-8c1b-5b655cbd6180 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1604 microversion: 2.32 time: 0.347791 Jun 10 18:20:54.545998 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2701/5359] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:54 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1604 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:20:54.561851 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a7bd60d-4442-49c6-a585-58965f1ae4f8 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:54.563647 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a7bd60d-4442-49c6-a585-58965f1ae4f8 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:54.563647 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a7bd60d-4442-49c6-a585-58965f1ae4f8 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:54.566142 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a7bd60d-4442-49c6-a585-58965f1ae4f8 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:54.907388 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5691f23f-36f4-447d-a605-ffc7c6172e4e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:54.908231 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5691f23f-36f4-447d-a605-ffc7c6172e4e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:54.922092 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5691f23f-36f4-447d-a605-ffc7c6172e4e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:54.922092 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5691f23f-36f4-447d-a605-ffc7c6172e4e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:54.932910 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5691f23f-36f4-447d-a605-ffc7c6172e4e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:54.937040 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5691f23f-36f4-447d-a605-ffc7c6172e4e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:55.139296 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6a7bd60d-4442-49c6-a585-58965f1ae4f8 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1ae263cdca4d5ebd7384e39ea2e345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618acb9c019f429ea00544496d3d20bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:55.149585 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6a7bd60d-4442-49c6-a585-58965f1ae4f8 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] 10.222.0.35 "GET /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024" status: 200 len: 1312 microversion: 2.1 time: 0.624219 Jun 10 18:20:55.152661 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2659/5360] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:20:54 2022] GET /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024 => generated 1312 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:20:55.555046 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a4e83eda-4a2c-42c5-a182-d8a630681dce tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:55.556386 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a4e83eda-4a2c-42c5-a182-d8a630681dce tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:55.573018 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a4e83eda-4a2c-42c5-a182-d8a630681dce tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:55.574111 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a4e83eda-4a2c-42c5-a182-d8a630681dce tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:55.576354 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a4e83eda-4a2c-42c5-a182-d8a630681dce tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:55.578451 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a4e83eda-4a2c-42c5-a182-d8a630681dce tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:55.623792 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:20:55.699056 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5691f23f-36f4-447d-a605-ffc7c6172e4e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:55.711002 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5691f23f-36f4-447d-a605-ffc7c6172e4e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:55.712914 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5691f23f-36f4-447d-a605-ffc7c6172e4e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:55.714398 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5691f23f-36f4-447d-a605-ffc7c6172e4e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1810 microversion: 2.20 time: 0.811495 Jun 10 18:20:55.715979 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2702/5361] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:54 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1810 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:20:55.798785 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a4e83eda-4a2c-42c5-a182-d8a630681dce tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:55.811885 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a4e83eda-4a2c-42c5-a182-d8a630681dce tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:55.819401 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a4e83eda-4a2c-42c5-a182-d8a630681dce tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:55.821898 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a4e83eda-4a2c-42c5-a182-d8a630681dce tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1604 microversion: 2.32 time: 0.274632 Jun 10 18:20:55.837652 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2660/5362] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:55 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1604 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:20:56.169226 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a26edfd0-b84d-494b-97b9-65a2630cb1b7 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:56.172663 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a26edfd0-b84d-494b-97b9-65a2630cb1b7 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] [instance: 5c01ab04-2d71-48a4-a6e9-cb4416ad7024] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:56.184730 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a26edfd0-b84d-494b-97b9-65a2630cb1b7 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:56.186697 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a26edfd0-b84d-494b-97b9-65a2630cb1b7 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:56.190109 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a26edfd0-b84d-494b-97b9-65a2630cb1b7 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:56.196829 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a26edfd0-b84d-494b-97b9-65a2630cb1b7 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:56.735185 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-48ca62ba-d3ae-4f18-92f0-487d30952cfb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:56.735858 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-48ca62ba-d3ae-4f18-92f0-487d30952cfb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:56.747892 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:20:56.763879 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-48ca62ba-d3ae-4f18-92f0-487d30952cfb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:56.768927 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-48ca62ba-d3ae-4f18-92f0-487d30952cfb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:56.771378 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-48ca62ba-d3ae-4f18-92f0-487d30952cfb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:56.774763 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-48ca62ba-d3ae-4f18-92f0-487d30952cfb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:56.909773 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a26edfd0-b84d-494b-97b9-65a2630cb1b7 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1ae263cdca4d5ebd7384e39ea2e345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618acb9c019f429ea00544496d3d20bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:56.920583 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a26edfd0-b84d-494b-97b9-65a2630cb1b7 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] 10.222.0.35 "GET /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024" status: 200 len: 1312 microversion: 2.1 time: 0.755100 Jun 10 18:20:56.922328 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2703/5363] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:20:56 2022] GET /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024 => generated 1312 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:20:56.937945 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6678d115-e66f-40ad-a3c4-dbc6b1f58fe7 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:56.938818 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6678d115-e66f-40ad-a3c4-dbc6b1f58fe7 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:56.949184 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6678d115-e66f-40ad-a3c4-dbc6b1f58fe7 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:56.950183 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6678d115-e66f-40ad-a3c4-dbc6b1f58fe7 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:56.951215 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6678d115-e66f-40ad-a3c4-dbc6b1f58fe7 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:56.952112 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6678d115-e66f-40ad-a3c4-dbc6b1f58fe7 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:57.255002 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-48ca62ba-d3ae-4f18-92f0-487d30952cfb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:57.284476 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-48ca62ba-d3ae-4f18-92f0-487d30952cfb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:57.287697 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-48ca62ba-d3ae-4f18-92f0-487d30952cfb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:57.291737 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-48ca62ba-d3ae-4f18-92f0-487d30952cfb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1810 microversion: 2.20 time: 0.560018 Jun 10 18:20:57.291737 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2661/5364] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:56 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1810 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:20:57.846346 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-abefd0ca-7d8d-4b80-b5e6-3e3a32ceb2c5 req-3fb31986-3c81-4c9b-8f2b-b95726a125d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c01ab04-2d71-48a4-a6e9-cb4416ad7024", "name": "network-vif-plugged", "status": "completed", "tag": "c826ab58-b14d-4f40-88dc-1c92b882bf90"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:20:57.854143 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6678d115-e66f-40ad-a3c4-dbc6b1f58fe7 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:57.857851 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:20:57.869747 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-abefd0ca-7d8d-4b80-b5e6-3e3a32ceb2c5 req-3fb31986-3c81-4c9b-8f2b-b95726a125d6 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:57.870503 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-abefd0ca-7d8d-4b80-b5e6-3e3a32ceb2c5 req-3fb31986-3c81-4c9b-8f2b-b95726a125d6 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:57.873799 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6678d115-e66f-40ad-a3c4-dbc6b1f58fe7 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:57.881127 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6678d115-e66f-40ad-a3c4-dbc6b1f58fe7 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:57.884328 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6678d115-e66f-40ad-a3c4-dbc6b1f58fe7 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1604 microversion: 2.32 time: 0.959218 Jun 10 18:20:57.884328 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2704/5365] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:56 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1604 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:20:57.890062 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-abefd0ca-7d8d-4b80-b5e6-3e3a32ceb2c5 req-3fb31986-3c81-4c9b-8f2b-b95726a125d6 service nova] Creating event network-vif-plugged:c826ab58-b14d-4f40-88dc-1c92b882bf90 for instance 5c01ab04-2d71-48a4-a6e9-cb4416ad7024 on chh1-master-2 Jun 10 18:20:57.899715 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-abefd0ca-7d8d-4b80-b5e6-3e3a32ceb2c5 req-3fb31986-3c81-4c9b-8f2b-b95726a125d6 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057023 Jun 10 18:20:57.901199 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2662/5366] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:20:57.940553 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bcf23d17-1902-4b51-8c83-2166b4134c0a tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:57.941979 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bcf23d17-1902-4b51-8c83-2166b4134c0a tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] [instance: 5c01ab04-2d71-48a4-a6e9-cb4416ad7024] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:57.955013 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bcf23d17-1902-4b51-8c83-2166b4134c0a tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:57.956429 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bcf23d17-1902-4b51-8c83-2166b4134c0a tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:57.959779 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bcf23d17-1902-4b51-8c83-2166b4134c0a tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:57.962601 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bcf23d17-1902-4b51-8c83-2166b4134c0a tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:58.314898 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-73e0ac2d-7e0e-4d66-b118-1c524678b063 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:58.315735 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-73e0ac2d-7e0e-4d66-b118-1c524678b063 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:58.330673 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-73e0ac2d-7e0e-4d66-b118-1c524678b063 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:58.331436 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-73e0ac2d-7e0e-4d66-b118-1c524678b063 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:58.332236 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-73e0ac2d-7e0e-4d66-b118-1c524678b063 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:58.332722 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-73e0ac2d-7e0e-4d66-b118-1c524678b063 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:58.386569 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bcf23d17-1902-4b51-8c83-2166b4134c0a tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1ae263cdca4d5ebd7384e39ea2e345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618acb9c019f429ea00544496d3d20bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:58.405576 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bcf23d17-1902-4b51-8c83-2166b4134c0a tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] 10.222.0.35 "GET /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024" status: 200 len: 1312 microversion: 2.1 time: 0.469976 Jun 10 18:20:58.406797 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2705/5367] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:20:57 2022] GET /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024 => generated 1312 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:20:58.693862 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-73e0ac2d-7e0e-4d66-b118-1c524678b063 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:58.711486 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-73e0ac2d-7e0e-4d66-b118-1c524678b063 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:58.713152 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-73e0ac2d-7e0e-4d66-b118-1c524678b063 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:58.722547 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-73e0ac2d-7e0e-4d66-b118-1c524678b063 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1810 microversion: 2.20 time: 0.415121 Jun 10 18:20:58.723319 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2663/5368] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:58 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1810 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:20:58.903192 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f6407e8a-43b0-47ad-b1cf-a033197d294a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:58.903817 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f6407e8a-43b0-47ad-b1cf-a033197d294a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:58.914449 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f6407e8a-43b0-47ad-b1cf-a033197d294a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:58.914914 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f6407e8a-43b0-47ad-b1cf-a033197d294a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:58.915704 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f6407e8a-43b0-47ad-b1cf-a033197d294a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:58.916144 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f6407e8a-43b0-47ad-b1cf-a033197d294a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:59.119718 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f6407e8a-43b0-47ad-b1cf-a033197d294a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:59.160240 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f6407e8a-43b0-47ad-b1cf-a033197d294a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:59.162268 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f6407e8a-43b0-47ad-b1cf-a033197d294a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:59.182171 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f6407e8a-43b0-47ad-b1cf-a033197d294a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1604 microversion: 2.32 time: 0.264827 Jun 10 18:20:59.186935 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2706/5369] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:58 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1604 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:20:59.425591 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4857cfe4-6947-4b9c-88d9-5915f7f0d0c6 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:59.426220 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4857cfe4-6947-4b9c-88d9-5915f7f0d0c6 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] [instance: 5c01ab04-2d71-48a4-a6e9-cb4416ad7024] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:59.438154 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4857cfe4-6947-4b9c-88d9-5915f7f0d0c6 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:59.440922 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4857cfe4-6947-4b9c-88d9-5915f7f0d0c6 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:59.441907 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4857cfe4-6947-4b9c-88d9-5915f7f0d0c6 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:59.445053 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4857cfe4-6947-4b9c-88d9-5915f7f0d0c6 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:59.743353 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-104c481b-d824-4448-b5d8-197bf24bd938 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:20:59.743855 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-104c481b-d824-4448-b5d8-197bf24bd938 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:20:59.755341 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-104c481b-d824-4448-b5d8-197bf24bd938 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:59.758412 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-104c481b-d824-4448-b5d8-197bf24bd938 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:59.760113 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-104c481b-d824-4448-b5d8-197bf24bd938 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:20:59.760830 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-104c481b-d824-4448-b5d8-197bf24bd938 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:20:59.943033 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4857cfe4-6947-4b9c-88d9-5915f7f0d0c6 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1ae263cdca4d5ebd7384e39ea2e345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618acb9c019f429ea00544496d3d20bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:20:59.952551 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4857cfe4-6947-4b9c-88d9-5915f7f0d0c6 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] 10.222.0.35 "GET /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024" status: 200 len: 1312 microversion: 2.1 time: 0.531117 Jun 10 18:20:59.953138 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2664/5370] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:20:59 2022] GET /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024 => generated 1312 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:21:00.206185 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5fd0e482-7123-4333-9045-9e51c2e91c0e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:00.206831 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5fd0e482-7123-4333-9045-9e51c2e91c0e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:00.224574 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5fd0e482-7123-4333-9045-9e51c2e91c0e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:00.224734 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5fd0e482-7123-4333-9045-9e51c2e91c0e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:00.227633 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5fd0e482-7123-4333-9045-9e51c2e91c0e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:00.228298 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5fd0e482-7123-4333-9045-9e51c2e91c0e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:00.389461 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-104c481b-d824-4448-b5d8-197bf24bd938 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:00.406792 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-104c481b-d824-4448-b5d8-197bf24bd938 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:00.415532 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-104c481b-d824-4448-b5d8-197bf24bd938 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:00.417529 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-104c481b-d824-4448-b5d8-197bf24bd938 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1810 microversion: 2.20 time: 0.678504 Jun 10 18:21:00.420619 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2707/5371] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:20:59 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1810 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:21:00.525732 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5fd0e482-7123-4333-9045-9e51c2e91c0e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:00.550340 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5fd0e482-7123-4333-9045-9e51c2e91c0e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:00.559528 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5fd0e482-7123-4333-9045-9e51c2e91c0e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:00.561131 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5fd0e482-7123-4333-9045-9e51c2e91c0e tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1604 microversion: 2.32 time: 0.358729 Jun 10 18:21:00.567345 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2665/5372] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:21:00 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1604 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:21:00.970852 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8b5319e1-f2a7-40a8-ae53-7b8b2e013ab5 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:00.972488 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8b5319e1-f2a7-40a8-ae53-7b8b2e013ab5 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] [instance: 5c01ab04-2d71-48a4-a6e9-cb4416ad7024] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:00.984565 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8b5319e1-f2a7-40a8-ae53-7b8b2e013ab5 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:00.985553 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8b5319e1-f2a7-40a8-ae53-7b8b2e013ab5 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:00.986505 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8b5319e1-f2a7-40a8-ae53-7b8b2e013ab5 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:00.988002 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8b5319e1-f2a7-40a8-ae53-7b8b2e013ab5 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:01.316832 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8b5319e1-f2a7-40a8-ae53-7b8b2e013ab5 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1ae263cdca4d5ebd7384e39ea2e345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618acb9c019f429ea00544496d3d20bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:01.325098 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8b5319e1-f2a7-40a8-ae53-7b8b2e013ab5 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] 10.222.0.35 "GET /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024" status: 200 len: 1462 microversion: 2.1 time: 0.359033 Jun 10 18:21:01.333996 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2708/5373] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:21:00 2022] GET /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024 => generated 1462 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:21:01.352972 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-47961402-7912-4bd4-8f05-3c766c3d43ac tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a8c2c39-2ec8-4100-9fdf-8f8e55d211c2", "device": "/dev/sdb"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:21:01.356415 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-47961402-7912-4bd4-8f05-3c766c3d43ac tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] [instance: 5c01ab04-2d71-48a4-a6e9-cb4416ad7024] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:01.370828 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-47961402-7912-4bd4-8f05-3c766c3d43ac tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:01.373397 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-47961402-7912-4bd4-8f05-3c766c3d43ac tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:01.375619 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-47961402-7912-4bd4-8f05-3c766c3d43ac tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:01.376085 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-47961402-7912-4bd4-8f05-3c766c3d43ac tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:01.436840 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0414fd19-a806-443f-b987-4aececefd73f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:01.437582 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0414fd19-a806-443f-b987-4aececefd73f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:01.452185 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0414fd19-a806-443f-b987-4aececefd73f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:01.459314 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0414fd19-a806-443f-b987-4aececefd73f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:01.460477 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0414fd19-a806-443f-b987-4aececefd73f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:01.461006 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0414fd19-a806-443f-b987-4aececefd73f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:01.882199 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0414fd19-a806-443f-b987-4aececefd73f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:01.894437 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0414fd19-a806-443f-b987-4aececefd73f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:01.895975 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0414fd19-a806-443f-b987-4aececefd73f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:01.897236 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0414fd19-a806-443f-b987-4aececefd73f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1810 microversion: 2.20 time: 0.464500 Jun 10 18:21:01.900270 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2709/5374] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:21:01 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1810 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:21:01.910011 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-be6cd949-921d-43ed-bf6a-fb42c152c3c1 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:01.914662 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-be6cd949-921d-43ed-bf6a-fb42c152c3c1 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:01.931244 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be6cd949-921d-43ed-bf6a-fb42c152c3c1 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:01.931931 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be6cd949-921d-43ed-bf6a-fb42c152c3c1 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:01.933153 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be6cd949-921d-43ed-bf6a-fb42c152c3c1 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:01.946529 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be6cd949-921d-43ed-bf6a-fb42c152c3c1 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:02.152015 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-be6cd949-921d-43ed-bf6a-fb42c152c3c1 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:02.167498 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-be6cd949-921d-43ed-bf6a-fb42c152c3c1 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:02.187844 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-be6cd949-921d-43ed-bf6a-fb42c152c3c1 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:02.189307 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-be6cd949-921d-43ed-bf6a-fb42c152c3c1 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1604 microversion: 2.32 time: 0.283186 Jun 10 18:21:02.200601 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2710/5375] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:21:01 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1604 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:21:02.463601 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-47961402-7912-4bd4-8f05-3c766c3d43ac tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] 10.222.0.35 "POST /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.115736 Jun 10 18:21:02.465743 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2666/5376] 10.222.0.35 () {60 vars in 1322 bytes} [Fri Jun 10 18:21:01 2022] POST /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024/os-volume_attachments => generated 194 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:21:02.915114 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f99fb6ab-0042-48e3-bf3d-e59eaed961f2 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:02.915912 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f99fb6ab-0042-48e3-bf3d-e59eaed961f2 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:02.931824 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f99fb6ab-0042-48e3-bf3d-e59eaed961f2 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:02.934030 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f99fb6ab-0042-48e3-bf3d-e59eaed961f2 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:02.937832 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f99fb6ab-0042-48e3-bf3d-e59eaed961f2 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:02.938753 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f99fb6ab-0042-48e3-bf3d-e59eaed961f2 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:03.216529 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8f2eb766-4b63-4222-bae7-aa5098f8c176 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:03.217882 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8f2eb766-4b63-4222-bae7-aa5098f8c176 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:03.260473 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8f2eb766-4b63-4222-bae7-aa5098f8c176 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:03.263653 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8f2eb766-4b63-4222-bae7-aa5098f8c176 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:03.264603 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8f2eb766-4b63-4222-bae7-aa5098f8c176 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:03.273306 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8f2eb766-4b63-4222-bae7-aa5098f8c176 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:03.744552 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8f2eb766-4b63-4222-bae7-aa5098f8c176 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:03.761604 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8f2eb766-4b63-4222-bae7-aa5098f8c176 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:03.769429 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8f2eb766-4b63-4222-bae7-aa5098f8c176 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:03.771322 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8f2eb766-4b63-4222-bae7-aa5098f8c176 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1604 microversion: 2.32 time: 0.562745 Jun 10 18:21:03.785488 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2667/5377] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:21:03 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1604 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:21:04.199806 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f99fb6ab-0042-48e3-bf3d-e59eaed961f2 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:04.210252 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f99fb6ab-0042-48e3-bf3d-e59eaed961f2 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:04.223691 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f99fb6ab-0042-48e3-bf3d-e59eaed961f2 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:04.225816 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f99fb6ab-0042-48e3-bf3d-e59eaed961f2 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1810 microversion: 2.20 time: 1.314606 Jun 10 18:21:04.237015 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2711/5378] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:21:02 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1810 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:21:04.794938 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a0a344db-91d6-482e-ac73-93f750c8bdd1 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:04.795900 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a0a344db-91d6-482e-ac73-93f750c8bdd1 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:04.807408 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a0a344db-91d6-482e-ac73-93f750c8bdd1 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:04.812273 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a0a344db-91d6-482e-ac73-93f750c8bdd1 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:04.813424 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a0a344db-91d6-482e-ac73-93f750c8bdd1 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:04.813927 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a0a344db-91d6-482e-ac73-93f750c8bdd1 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:04.982507 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a0a344db-91d6-482e-ac73-93f750c8bdd1 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:05.002853 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a0a344db-91d6-482e-ac73-93f750c8bdd1 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:05.004696 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a0a344db-91d6-482e-ac73-93f750c8bdd1 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:05.006072 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a0a344db-91d6-482e-ac73-93f750c8bdd1 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1604 microversion: 2.32 time: 0.215553 Jun 10 18:21:05.018324 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2668/5379] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:21:04 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1604 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:21:05.245228 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1390720a-f1a6-4265-8bf4-90980b0e2ec1 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:05.245902 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1390720a-f1a6-4265-8bf4-90980b0e2ec1 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:05.260448 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1390720a-f1a6-4265-8bf4-90980b0e2ec1 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:05.261119 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1390720a-f1a6-4265-8bf4-90980b0e2ec1 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:05.262157 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1390720a-f1a6-4265-8bf4-90980b0e2ec1 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:05.263101 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1390720a-f1a6-4265-8bf4-90980b0e2ec1 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:05.656321 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1390720a-f1a6-4265-8bf4-90980b0e2ec1 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:05.671732 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1390720a-f1a6-4265-8bf4-90980b0e2ec1 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:05.677853 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1390720a-f1a6-4265-8bf4-90980b0e2ec1 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:05.679194 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1390720a-f1a6-4265-8bf4-90980b0e2ec1 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1810 microversion: 2.20 time: 0.438256 Jun 10 18:21:05.680162 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2712/5380] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:21:05 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1810 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:21:06.026996 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4d6b65b6-0ac5-4ce8-8acb-2294a6dc1481 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:06.028219 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4d6b65b6-0ac5-4ce8-8acb-2294a6dc1481 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:06.039414 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d6b65b6-0ac5-4ce8-8acb-2294a6dc1481 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:06.041238 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d6b65b6-0ac5-4ce8-8acb-2294a6dc1481 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:06.045991 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d6b65b6-0ac5-4ce8-8acb-2294a6dc1481 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:06.046683 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d6b65b6-0ac5-4ce8-8acb-2294a6dc1481 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:06.183895 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4d6b65b6-0ac5-4ce8-8acb-2294a6dc1481 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:06.202464 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4d6b65b6-0ac5-4ce8-8acb-2294a6dc1481 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:06.204248 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4d6b65b6-0ac5-4ce8-8acb-2294a6dc1481 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:06.205707 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4d6b65b6-0ac5-4ce8-8acb-2294a6dc1481 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1604 microversion: 2.32 time: 0.183896 Jun 10 18:21:06.218698 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2669/5381] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:21:06 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1604 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:21:06.697322 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6eabb1e3-1094-4bc1-9fce-d839221d8319 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:06.697947 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6eabb1e3-1094-4bc1-9fce-d839221d8319 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:06.707469 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6eabb1e3-1094-4bc1-9fce-d839221d8319 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:06.709483 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6eabb1e3-1094-4bc1-9fce-d839221d8319 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:06.710686 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6eabb1e3-1094-4bc1-9fce-d839221d8319 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:06.711567 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6eabb1e3-1094-4bc1-9fce-d839221d8319 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:07.148434 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6eabb1e3-1094-4bc1-9fce-d839221d8319 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:07.169776 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6eabb1e3-1094-4bc1-9fce-d839221d8319 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:07.171633 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6eabb1e3-1094-4bc1-9fce-d839221d8319 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:07.173086 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6eabb1e3-1094-4bc1-9fce-d839221d8319 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1810 microversion: 2.20 time: 0.479676 Jun 10 18:21:07.179422 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2713/5382] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:21:06 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1810 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:21:07.225643 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7b8219cc-e19b-4617-84ab-40ae1d5ec9f8 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:07.226251 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7b8219cc-e19b-4617-84ab-40ae1d5ec9f8 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:07.243294 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b8219cc-e19b-4617-84ab-40ae1d5ec9f8 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:07.243926 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b8219cc-e19b-4617-84ab-40ae1d5ec9f8 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:07.244931 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b8219cc-e19b-4617-84ab-40ae1d5ec9f8 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:07.245879 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b8219cc-e19b-4617-84ab-40ae1d5ec9f8 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:07.355113 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7b8219cc-e19b-4617-84ab-40ae1d5ec9f8 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:07.366662 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7b8219cc-e19b-4617-84ab-40ae1d5ec9f8 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:07.368760 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7b8219cc-e19b-4617-84ab-40ae1d5ec9f8 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:07.370283 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7b8219cc-e19b-4617-84ab-40ae1d5ec9f8 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1604 microversion: 2.32 time: 0.149550 Jun 10 18:21:07.382780 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2670/5383] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:21:07 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1604 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:21:07.468750 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-6461b44d-44e4-42c4-aedd-38a54e988d73 req-bc8f7094-155b-4e69-9562-b3ff5e47d946 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "580e911e-a112-4bfa-9d78-b6a24178fae8", "name": "network-vif-plugged", "status": "completed", "tag": "7237a573-4c3c-4d85-9aaa-2a8f34ab9485"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:21:07.484568 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-6461b44d-44e4-42c4-aedd-38a54e988d73 req-bc8f7094-155b-4e69-9562-b3ff5e47d946 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:07.488286 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-6461b44d-44e4-42c4-aedd-38a54e988d73 req-bc8f7094-155b-4e69-9562-b3ff5e47d946 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:07.513763 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-6461b44d-44e4-42c4-aedd-38a54e988d73 req-bc8f7094-155b-4e69-9562-b3ff5e47d946 service nova] Creating event network-vif-plugged:7237a573-4c3c-4d85-9aaa-2a8f34ab9485 for instance 580e911e-a112-4bfa-9d78-b6a24178fae8 on chh1-master-2 Jun 10 18:21:07.534812 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-6461b44d-44e4-42c4-aedd-38a54e988d73 req-bc8f7094-155b-4e69-9562-b3ff5e47d946 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070387 Jun 10 18:21:07.535900 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2714/5384] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:21:08.197232 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0f56a600-dabd-44f7-84c1-61c7a39d932d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:08.198203 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0f56a600-dabd-44f7-84c1-61c7a39d932d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:08.206084 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0f56a600-dabd-44f7-84c1-61c7a39d932d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:08.206870 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0f56a600-dabd-44f7-84c1-61c7a39d932d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:08.207886 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0f56a600-dabd-44f7-84c1-61c7a39d932d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:08.208580 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0f56a600-dabd-44f7-84c1-61c7a39d932d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:08.392402 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e48da728-d234-4beb-ae75-96014820728a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:08.393874 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e48da728-d234-4beb-ae75-96014820728a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:08.406432 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e48da728-d234-4beb-ae75-96014820728a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:08.409419 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e48da728-d234-4beb-ae75-96014820728a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:08.410484 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e48da728-d234-4beb-ae75-96014820728a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:08.413420 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e48da728-d234-4beb-ae75-96014820728a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:08.780035 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e48da728-d234-4beb-ae75-96014820728a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:08.780035 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e48da728-d234-4beb-ae75-96014820728a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:08.780035 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e48da728-d234-4beb-ae75-96014820728a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:08.780035 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e48da728-d234-4beb-ae75-96014820728a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1604 microversion: 2.32 time: 0.260362 Jun 10 18:21:08.780035 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2715/5385] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:21:08 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1604 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:21:08.785616 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0f56a600-dabd-44f7-84c1-61c7a39d932d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:08.800503 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0f56a600-dabd-44f7-84c1-61c7a39d932d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:08.808945 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0f56a600-dabd-44f7-84c1-61c7a39d932d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:08.812834 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0f56a600-dabd-44f7-84c1-61c7a39d932d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1810 microversion: 2.20 time: 0.619850 Jun 10 18:21:08.817183 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2671/5386] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:21:08 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1810 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:21:09.664267 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-68588800-b139-4b8f-91df-e9482cddb84f tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:09.665083 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-68588800-b139-4b8f-91df-e9482cddb84f tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:09.679384 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-68588800-b139-4b8f-91df-e9482cddb84f tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:09.684179 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-68588800-b139-4b8f-91df-e9482cddb84f tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:09.684179 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-68588800-b139-4b8f-91df-e9482cddb84f tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:09.684179 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-68588800-b139-4b8f-91df-e9482cddb84f tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:09.834477 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-04126f3c-e68e-4757-ae07-fb972729d72a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:09.835094 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-04126f3c-e68e-4757-ae07-fb972729d72a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:09.853577 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-04126f3c-e68e-4757-ae07-fb972729d72a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:09.854049 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-04126f3c-e68e-4757-ae07-fb972729d72a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:09.854867 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-04126f3c-e68e-4757-ae07-fb972729d72a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:09.855316 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-04126f3c-e68e-4757-ae07-fb972729d72a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:10.038993 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-68588800-b139-4b8f-91df-e9482cddb84f tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:10.062127 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-68588800-b139-4b8f-91df-e9482cddb84f tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:10.063867 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-68588800-b139-4b8f-91df-e9482cddb84f tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:10.065340 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-68588800-b139-4b8f-91df-e9482cddb84f tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1604 microversion: 2.32 time: 0.405043 Jun 10 18:21:10.066550 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2716/5387] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:21:09 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1604 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:21:10.315921 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-04126f3c-e68e-4757-ae07-fb972729d72a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:10.331239 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-04126f3c-e68e-4757-ae07-fb972729d72a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:10.340587 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-04126f3c-e68e-4757-ae07-fb972729d72a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:10.345546 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-04126f3c-e68e-4757-ae07-fb972729d72a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1810 microversion: 2.20 time: 0.513757 Jun 10 18:21:10.357157 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2672/5388] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:21:09 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1810 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:21:11.089830 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-21eb2c46-3759-4308-b122-b12b101ef472 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:11.089830 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-21eb2c46-3759-4308-b122-b12b101ef472 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:11.112985 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-21eb2c46-3759-4308-b122-b12b101ef472 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:11.129733 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-21eb2c46-3759-4308-b122-b12b101ef472 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:11.131065 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-21eb2c46-3759-4308-b122-b12b101ef472 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:11.131685 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-21eb2c46-3759-4308-b122-b12b101ef472 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:11.251168 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-21eb2c46-3759-4308-b122-b12b101ef472 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:11.266916 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-21eb2c46-3759-4308-b122-b12b101ef472 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:11.271668 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-21eb2c46-3759-4308-b122-b12b101ef472 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:11.276188 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-21eb2c46-3759-4308-b122-b12b101ef472 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1604 microversion: 2.32 time: 0.192964 Jun 10 18:21:11.280355 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2717/5389] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:21:11 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1604 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:21:11.364712 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5e85579c-b807-403a-b204-470a2e94ada3 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:11.365336 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5e85579c-b807-403a-b204-470a2e94ada3 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:11.380678 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5e85579c-b807-403a-b204-470a2e94ada3 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:11.386988 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5e85579c-b807-403a-b204-470a2e94ada3 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:11.390052 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5e85579c-b807-403a-b204-470a2e94ada3 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:11.390052 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5e85579c-b807-403a-b204-470a2e94ada3 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:11.732494 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5e85579c-b807-403a-b204-470a2e94ada3 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:11.747990 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5e85579c-b807-403a-b204-470a2e94ada3 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:11.754348 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5e85579c-b807-403a-b204-470a2e94ada3 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:11.755951 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5e85579c-b807-403a-b204-470a2e94ada3 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1810 microversion: 2.20 time: 0.395177 Jun 10 18:21:11.757513 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2673/5390] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:21:11 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1810 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:21:12.295410 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7f51f160-f579-4f0c-ad21-8e649767d679 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:12.300718 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7f51f160-f579-4f0c-ad21-8e649767d679 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:12.318522 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7f51f160-f579-4f0c-ad21-8e649767d679 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:12.319710 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7f51f160-f579-4f0c-ad21-8e649767d679 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:12.323284 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7f51f160-f579-4f0c-ad21-8e649767d679 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:12.324526 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7f51f160-f579-4f0c-ad21-8e649767d679 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:12.547252 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7f51f160-f579-4f0c-ad21-8e649767d679 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:12.564474 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7f51f160-f579-4f0c-ad21-8e649767d679 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:12.568951 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7f51f160-f579-4f0c-ad21-8e649767d679 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:12.570848 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7f51f160-f579-4f0c-ad21-8e649767d679 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1604 microversion: 2.32 time: 0.279492 Jun 10 18:21:12.577490 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2718/5391] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:21:12 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1604 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:21:12.776346 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-826300a7-5226-4681-a1e7-beecc8bbea33 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:12.777085 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-826300a7-5226-4681-a1e7-beecc8bbea33 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:12.788971 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-826300a7-5226-4681-a1e7-beecc8bbea33 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:12.791234 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-826300a7-5226-4681-a1e7-beecc8bbea33 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:12.792518 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-826300a7-5226-4681-a1e7-beecc8bbea33 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:12.794996 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-826300a7-5226-4681-a1e7-beecc8bbea33 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:13.102302 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-826300a7-5226-4681-a1e7-beecc8bbea33 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:13.118877 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-826300a7-5226-4681-a1e7-beecc8bbea33 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:13.124038 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-826300a7-5226-4681-a1e7-beecc8bbea33 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:13.129381 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-826300a7-5226-4681-a1e7-beecc8bbea33 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1797 microversion: 2.20 time: 0.358205 Jun 10 18:21:13.132219 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2674/5392] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:21:12 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1797 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:21:13.594145 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8ad9fde9-c97e-4794-9721-fbdf54702acc tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:13.595510 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8ad9fde9-c97e-4794-9721-fbdf54702acc tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:13.610411 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8ad9fde9-c97e-4794-9721-fbdf54702acc tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:13.611299 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8ad9fde9-c97e-4794-9721-fbdf54702acc tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:13.613853 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8ad9fde9-c97e-4794-9721-fbdf54702acc tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:13.622073 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8ad9fde9-c97e-4794-9721-fbdf54702acc tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:13.783434 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8ad9fde9-c97e-4794-9721-fbdf54702acc tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:13.799916 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8ad9fde9-c97e-4794-9721-fbdf54702acc tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:13.803996 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8ad9fde9-c97e-4794-9721-fbdf54702acc tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:13.803996 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8ad9fde9-c97e-4794-9721-fbdf54702acc tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1604 microversion: 2.32 time: 0.214458 Jun 10 18:21:13.804817 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2719/5393] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:21:13 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1604 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:21:14.822655 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9163f4c2-d6ef-445b-9823-f629419f4f76 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:14.823912 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9163f4c2-d6ef-445b-9823-f629419f4f76 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:14.831855 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9163f4c2-d6ef-445b-9823-f629419f4f76 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:14.832339 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9163f4c2-d6ef-445b-9823-f629419f4f76 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:14.833145 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9163f4c2-d6ef-445b-9823-f629419f4f76 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:14.833602 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9163f4c2-d6ef-445b-9823-f629419f4f76 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:14.938354 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9163f4c2-d6ef-445b-9823-f629419f4f76 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:14.978985 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9163f4c2-d6ef-445b-9823-f629419f4f76 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:14.983445 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9163f4c2-d6ef-445b-9823-f629419f4f76 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:14.999340 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9163f4c2-d6ef-445b-9823-f629419f4f76 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1604 microversion: 2.32 time: 0.180839 Jun 10 18:21:14.999944 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2675/5394] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:21:14 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1604 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:21:16.020247 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-36ed4772-1e76-4bcd-abb4-16ef4f5ae8e4 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:16.020836 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-36ed4772-1e76-4bcd-abb4-16ef4f5ae8e4 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:16.036116 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-36ed4772-1e76-4bcd-abb4-16ef4f5ae8e4 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:16.036619 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-36ed4772-1e76-4bcd-abb4-16ef4f5ae8e4 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:16.037622 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-36ed4772-1e76-4bcd-abb4-16ef4f5ae8e4 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:16.037868 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-36ed4772-1e76-4bcd-abb4-16ef4f5ae8e4 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:16.276633 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-36ed4772-1e76-4bcd-abb4-16ef4f5ae8e4 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:16.292723 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-36ed4772-1e76-4bcd-abb4-16ef4f5ae8e4 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:16.294242 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-36ed4772-1e76-4bcd-abb4-16ef4f5ae8e4 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:16.295445 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-36ed4772-1e76-4bcd-abb4-16ef4f5ae8e4 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1604 microversion: 2.32 time: 0.280824 Jun 10 18:21:16.296012 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2720/5395] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:21:16 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1604 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:21:17.315082 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0c2ce862-4350-40fd-86a7-e72fb14ab796 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:17.315969 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0c2ce862-4350-40fd-86a7-e72fb14ab796 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:17.328706 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0c2ce862-4350-40fd-86a7-e72fb14ab796 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:17.335874 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0c2ce862-4350-40fd-86a7-e72fb14ab796 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:17.335874 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0c2ce862-4350-40fd-86a7-e72fb14ab796 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:17.335874 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0c2ce862-4350-40fd-86a7-e72fb14ab796 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:17.391566 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:21:17.697280 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0c2ce862-4350-40fd-86a7-e72fb14ab796 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:17.714430 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0c2ce862-4350-40fd-86a7-e72fb14ab796 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:17.717045 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0c2ce862-4350-40fd-86a7-e72fb14ab796 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:17.722205 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0c2ce862-4350-40fd-86a7-e72fb14ab796 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1604 microversion: 2.32 time: 0.411831 Jun 10 18:21:17.724641 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2676/5396] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:21:17 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1604 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:21:18.749713 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5a4b94cc-64f0-491b-a2df-47148e0d5db6 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:18.750528 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5a4b94cc-64f0-491b-a2df-47148e0d5db6 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:18.772197 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5a4b94cc-64f0-491b-a2df-47148e0d5db6 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:18.776609 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5a4b94cc-64f0-491b-a2df-47148e0d5db6 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:18.778863 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5a4b94cc-64f0-491b-a2df-47148e0d5db6 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:18.781317 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5a4b94cc-64f0-491b-a2df-47148e0d5db6 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:19.048591 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5a4b94cc-64f0-491b-a2df-47148e0d5db6 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:19.060939 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5a4b94cc-64f0-491b-a2df-47148e0d5db6 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:19.063081 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5a4b94cc-64f0-491b-a2df-47148e0d5db6 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:19.064618 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5a4b94cc-64f0-491b-a2df-47148e0d5db6 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1604 microversion: 2.32 time: 0.322388 Jun 10 18:21:19.065634 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2721/5397] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:21:18 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1604 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:21:20.084654 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8eb935cc-f134-403d-b291-4397cfdaa756 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:20.085446 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8eb935cc-f134-403d-b291-4397cfdaa756 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:20.102426 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8eb935cc-f134-403d-b291-4397cfdaa756 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:20.103146 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8eb935cc-f134-403d-b291-4397cfdaa756 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:20.104143 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8eb935cc-f134-403d-b291-4397cfdaa756 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:20.105246 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8eb935cc-f134-403d-b291-4397cfdaa756 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:20.254715 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8eb935cc-f134-403d-b291-4397cfdaa756 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:20.271403 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8eb935cc-f134-403d-b291-4397cfdaa756 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:20.278521 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8eb935cc-f134-403d-b291-4397cfdaa756 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:20.279795 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8eb935cc-f134-403d-b291-4397cfdaa756 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1604 microversion: 2.32 time: 0.199238 Jun 10 18:21:20.280398 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2677/5398] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:21:20 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1604 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:21:21.305738 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a7d26801-8c5d-4e11-afed-ff3ab7e85a9a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:21.306656 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a7d26801-8c5d-4e11-afed-ff3ab7e85a9a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:21.319525 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a7d26801-8c5d-4e11-afed-ff3ab7e85a9a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:21.325738 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a7d26801-8c5d-4e11-afed-ff3ab7e85a9a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:21.326893 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a7d26801-8c5d-4e11-afed-ff3ab7e85a9a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:21.327518 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a7d26801-8c5d-4e11-afed-ff3ab7e85a9a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:21.475891 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a7d26801-8c5d-4e11-afed-ff3ab7e85a9a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:21.487247 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a7d26801-8c5d-4e11-afed-ff3ab7e85a9a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:21.493597 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a7d26801-8c5d-4e11-afed-ff3ab7e85a9a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:21.498753 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a7d26801-8c5d-4e11-afed-ff3ab7e85a9a tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1604 microversion: 2.32 time: 0.197165 Jun 10 18:21:21.499534 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2678/5399] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:21:21 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1604 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:21:21.842101 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-681276be-517e-4272-81b1-b25550794dd4 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-804570446", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "625335d9-3dff-4504-8d88-fd5faedf18ef"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:21:21.923588 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-681276be-517e-4272-81b1-b25550794dd4 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] validate_networks() for [('625335d9-3dff-4504-8d88-fd5faedf18ef', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:21:22.522120 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-49a16362-7211-48e0-9458-2637527bbdfe tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:22.523200 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-49a16362-7211-48e0-9458-2637527bbdfe tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:22.535609 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-49a16362-7211-48e0-9458-2637527bbdfe tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:22.536261 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-49a16362-7211-48e0-9458-2637527bbdfe tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:22.538355 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-49a16362-7211-48e0-9458-2637527bbdfe tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:22.540604 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-49a16362-7211-48e0-9458-2637527bbdfe tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:22.657437 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-49a16362-7211-48e0-9458-2637527bbdfe tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:22.670883 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-49a16362-7211-48e0-9458-2637527bbdfe tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:22.684699 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-49a16362-7211-48e0-9458-2637527bbdfe tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:22.689779 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-49a16362-7211-48e0-9458-2637527bbdfe tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1604 microversion: 2.32 time: 0.174574 Jun 10 18:21:22.692695 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2679/5400] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:21:22 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1604 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:21:22.965228 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-681276be-517e-4272-81b1-b25550794dd4 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:21:22.966636 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-681276be-517e-4272-81b1-b25550794dd4 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:21:22.967327 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-681276be-517e-4272-81b1-b25550794dd4 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:21:22.967750 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-681276be-517e-4272-81b1-b25550794dd4 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:21:22.968507 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-681276be-517e-4272-81b1-b25550794dd4 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:21:23.004454 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-681276be-517e-4272-81b1-b25550794dd4 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:23.004454 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-681276be-517e-4272-81b1-b25550794dd4 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:23.004454 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-681276be-517e-4272-81b1-b25550794dd4 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:23.004873 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-681276be-517e-4272-81b1-b25550794dd4 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:23.032870 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:21:23.065752 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-681276be-517e-4272-81b1-b25550794dd4 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Getting quotas for project 0b8923e3e9c4462497ca3032e56de12d. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:21:23.074283 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-681276be-517e-4272-81b1-b25550794dd4 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Getting quotas for user da6d9192dc524f7bb81aeaee99daa19b and project 0b8923e3e9c4462497ca3032e56de12d. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:21:23.098806 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-681276be-517e-4272-81b1-b25550794dd4 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:21:23.102266 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-681276be-517e-4272-81b1-b25550794dd4 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] [instance: 2ef803cd-f02f-41f5-928a-c0d72dcbf25d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:21:23.299704 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-681276be-517e-4272-81b1-b25550794dd4 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.039157 Jun 10 18:21:23.300321 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2722/5401] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:21:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2041 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:21:23.312274 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9eddbda0-070f-46c9-9ab2-69ec51f48cda tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:23.312927 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9eddbda0-070f-46c9-9ab2-69ec51f48cda tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] [instance: 2ef803cd-f02f-41f5-928a-c0d72dcbf25d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:23.420034 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9eddbda0-070f-46c9-9ab2-69ec51f48cda tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da6d9192dc524f7bb81aeaee99daa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8923e3e9c4462497ca3032e56de12d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:23.427195 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9eddbda0-070f-46c9-9ab2-69ec51f48cda tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] 10.222.0.35 "GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d" status: 200 len: 1216 microversion: 2.1 time: 0.120342 Jun 10 18:21:23.427779 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2680/5402] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:21:23 2022] GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d => generated 1216 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:21:23.709869 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4fc1cff4-9049-474a-8911-bb94d5a80edf tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:23.710499 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4fc1cff4-9049-474a-8911-bb94d5a80edf tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:23.727118 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4fc1cff4-9049-474a-8911-bb94d5a80edf tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:23.727578 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4fc1cff4-9049-474a-8911-bb94d5a80edf tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:23.728414 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4fc1cff4-9049-474a-8911-bb94d5a80edf tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:23.729002 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4fc1cff4-9049-474a-8911-bb94d5a80edf tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:23.889520 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4fc1cff4-9049-474a-8911-bb94d5a80edf tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:23.909183 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4fc1cff4-9049-474a-8911-bb94d5a80edf tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:23.909183 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4fc1cff4-9049-474a-8911-bb94d5a80edf tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:23.910454 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4fc1cff4-9049-474a-8911-bb94d5a80edf tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1604 microversion: 2.32 time: 0.204854 Jun 10 18:21:23.922276 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2723/5403] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:21:23 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1604 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:21:24.450266 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cef6e328-f314-4230-918b-29ccb942bb36 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:24.451860 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cef6e328-f314-4230-918b-29ccb942bb36 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] [instance: 2ef803cd-f02f-41f5-928a-c0d72dcbf25d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:24.553511 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cef6e328-f314-4230-918b-29ccb942bb36 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da6d9192dc524f7bb81aeaee99daa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8923e3e9c4462497ca3032e56de12d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:24.562625 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cef6e328-f314-4230-918b-29ccb942bb36 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] 10.222.0.35 "GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d" status: 200 len: 1216 microversion: 2.1 time: 0.119407 Jun 10 18:21:24.564797 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2681/5404] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:21:24 2022] GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d => generated 1216 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:21:24.942298 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8643c027-a320-439e-9805-6c43bbea5d82 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:24.943686 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8643c027-a320-439e-9805-6c43bbea5d82 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:24.953487 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:21:24.970984 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8643c027-a320-439e-9805-6c43bbea5d82 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:24.971863 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8643c027-a320-439e-9805-6c43bbea5d82 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:24.974884 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8643c027-a320-439e-9805-6c43bbea5d82 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:24.979251 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8643c027-a320-439e-9805-6c43bbea5d82 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:25.129007 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8643c027-a320-439e-9805-6c43bbea5d82 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:25.150528 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8643c027-a320-439e-9805-6c43bbea5d82 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:25.155635 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8643c027-a320-439e-9805-6c43bbea5d82 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:25.157255 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8643c027-a320-439e-9805-6c43bbea5d82 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1604 microversion: 2.32 time: 0.225866 Jun 10 18:21:25.169497 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2724/5405] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:21:24 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1604 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:21:25.580167 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-43f8848c-f3f0-485b-abc6-841a440c11e1 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:25.580902 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-43f8848c-f3f0-485b-abc6-841a440c11e1 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] [instance: 2ef803cd-f02f-41f5-928a-c0d72dcbf25d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:25.608017 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-43f8848c-f3f0-485b-abc6-841a440c11e1 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:25.614171 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-43f8848c-f3f0-485b-abc6-841a440c11e1 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:25.614171 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-43f8848c-f3f0-485b-abc6-841a440c11e1 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:25.614171 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-43f8848c-f3f0-485b-abc6-841a440c11e1 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:26.009429 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-43f8848c-f3f0-485b-abc6-841a440c11e1 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da6d9192dc524f7bb81aeaee99daa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8923e3e9c4462497ca3032e56de12d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:26.019326 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-43f8848c-f3f0-485b-abc6-841a440c11e1 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] 10.222.0.35 "GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d" status: 200 len: 1212 microversion: 2.1 time: 0.442748 Jun 10 18:21:26.034553 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2682/5406] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:21:25 2022] GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d => generated 1212 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:21:26.179646 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c4dc00f2-0dac-4a07-8632-7042363627d6 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:26.180278 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c4dc00f2-0dac-4a07-8632-7042363627d6 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:26.196400 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c4dc00f2-0dac-4a07-8632-7042363627d6 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:26.196925 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c4dc00f2-0dac-4a07-8632-7042363627d6 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:26.204884 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c4dc00f2-0dac-4a07-8632-7042363627d6 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:26.205476 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c4dc00f2-0dac-4a07-8632-7042363627d6 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:26.676641 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c4dc00f2-0dac-4a07-8632-7042363627d6 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:26.690950 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c4dc00f2-0dac-4a07-8632-7042363627d6 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:26.692532 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c4dc00f2-0dac-4a07-8632-7042363627d6 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:26.693760 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c4dc00f2-0dac-4a07-8632-7042363627d6 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1604 microversion: 2.32 time: 0.520869 Jun 10 18:21:26.694342 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2725/5407] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:21:26 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1604 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:21:27.042524 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-251be787-0041-4005-9859-14f2c413bb78 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:27.044929 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-251be787-0041-4005-9859-14f2c413bb78 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] [instance: 2ef803cd-f02f-41f5-928a-c0d72dcbf25d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:27.052254 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=48 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:21:27.054294 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-251be787-0041-4005-9859-14f2c413bb78 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:27.054950 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-251be787-0041-4005-9859-14f2c413bb78 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:27.055919 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-251be787-0041-4005-9859-14f2c413bb78 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:27.056556 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-251be787-0041-4005-9859-14f2c413bb78 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:27.182369 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-251be787-0041-4005-9859-14f2c413bb78 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da6d9192dc524f7bb81aeaee99daa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8923e3e9c4462497ca3032e56de12d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:27.192279 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-251be787-0041-4005-9859-14f2c413bb78 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] 10.222.0.35 "GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d" status: 200 len: 1268 microversion: 2.1 time: 0.154158 Jun 10 18:21:27.195188 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2683/5408] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:21:27 2022] GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d => generated 1268 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:21:27.712903 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9a2e6cbc-b032-4fcb-8118-34f494c53dab tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:27.714369 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9a2e6cbc-b032-4fcb-8118-34f494c53dab tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:27.725988 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9a2e6cbc-b032-4fcb-8118-34f494c53dab tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:27.730962 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9a2e6cbc-b032-4fcb-8118-34f494c53dab tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:27.732105 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9a2e6cbc-b032-4fcb-8118-34f494c53dab tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:27.732742 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9a2e6cbc-b032-4fcb-8118-34f494c53dab tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:28.010124 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9a2e6cbc-b032-4fcb-8118-34f494c53dab tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:28.025554 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9a2e6cbc-b032-4fcb-8118-34f494c53dab tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:28.039846 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9a2e6cbc-b032-4fcb-8118-34f494c53dab tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0fdd982d9e7413cae6a453b90de2e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0433689ccdd84ef9be7c8e2a1e553ce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:28.042036 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9a2e6cbc-b032-4fcb-8118-34f494c53dab tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 200 len: 1604 microversion: 2.32 time: 0.332501 Jun 10 18:21:28.054143 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2726/5409] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:21:27 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 1604 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:21:28.212792 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6beb64bc-1610-4ce0-91e0-a8d97f5b70fc tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:28.214269 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6beb64bc-1610-4ce0-91e0-a8d97f5b70fc tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] [instance: 2ef803cd-f02f-41f5-928a-c0d72dcbf25d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:28.236246 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6beb64bc-1610-4ce0-91e0-a8d97f5b70fc tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:28.236907 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6beb64bc-1610-4ce0-91e0-a8d97f5b70fc tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:28.242029 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6beb64bc-1610-4ce0-91e0-a8d97f5b70fc tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:28.242583 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6beb64bc-1610-4ce0-91e0-a8d97f5b70fc tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:28.624368 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6beb64bc-1610-4ce0-91e0-a8d97f5b70fc tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da6d9192dc524f7bb81aeaee99daa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8923e3e9c4462497ca3032e56de12d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:28.638655 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6beb64bc-1610-4ce0-91e0-a8d97f5b70fc tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] 10.222.0.35 "GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d" status: 200 len: 1274 microversion: 2.1 time: 0.429684 Jun 10 18:21:28.638655 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2684/5410] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:21:28 2022] GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d => generated 1274 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:21:29.061281 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7780c7d9-6cc0-4e03-95c9-e4fb8559ed28 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:29.061740 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7780c7d9-6cc0-4e03-95c9-e4fb8559ed28 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:29.071808 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7780c7d9-6cc0-4e03-95c9-e4fb8559ed28 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:29.074888 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7780c7d9-6cc0-4e03-95c9-e4fb8559ed28 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:29.075888 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7780c7d9-6cc0-4e03-95c9-e4fb8559ed28 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:29.083556 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7780c7d9-6cc0-4e03-95c9-e4fb8559ed28 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:29.120062 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-7780c7d9-6cc0-4e03-95c9-e4fb8559ed28 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] HTTP exception thrown: Instance 39300115-c0d6-485c-a610-543bdf470fae could not be found. Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7780c7d9-6cc0-4e03-95c9-e4fb8559ed28 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Request method failure captured: Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae HTTP/1.1 Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4nEZshcKGxgPZmNM4yzwVezctPuScGheNiSfnqr4P8eamvtc7PV07nlbyrCnlHXjC__MII3PgT_uopfQXUERaA4H3QQ-lQDsacKcwscUbJnaa05QSRAFD8rmRGSdaDNIQPGC4fY-ovbZ2Vz7obqsHJMC4ijEZakc8us-U-CwnqdRAI Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: X-Openstack-Nova-Api-Version: 2.32 Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 0433689ccdd84ef9be7c8e2a1e553ce6 Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-TaggedBootDevicesTest-97114029 Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/0433689ccdd84ef9be7c8e2a1e553ce6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/0433689ccdd84ef9be7c8e2a1e553ce6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/0433689ccdd84ef9be7c8e2a1e553ce6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_0433689ccdd84ef9be7c8e2a1e553ce6", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-TaggedBootDevicesTest-97114029 Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 0433689ccdd84ef9be7c8e2a1e553ce6 Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-TaggedBootDevicesTest-97114029 Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-TaggedBootDevicesTest-97114029-project Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: a0fdd982d9e7413cae6a453b90de2e86 Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-TaggedBootDevicesTest-97114029-project Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 39300115-c0d6-485c-a610-543bdf470fae could not be found. Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '39300115-c0d6-485c-a610-543bdf470fae'} Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39300115-c0d6-485c-a610-543bdf470fae could not be found. Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39300115-c0d6-485c-a610-543bdf470fae could not be found. Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:21:29.122079 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:21:29.127522 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:21:29.127522 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:21:29.127522 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:21:29.127522 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:21:29.127522 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:21:29.127522 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39300115-c0d6-485c-a610-543bdf470fae could not be found. Jun 10 18:21:29.127522 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:21:29.127522 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7780c7d9-6cc0-4e03-95c9-e4fb8559ed28 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Returning 404 to user: Instance 39300115-c0d6-485c-a610-543bdf470fae could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:21:29.127522 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7780c7d9-6cc0-4e03-95c9-e4fb8559ed28 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 404 len: 111 microversion: 2.32 time: 0.067061 Jun 10 18:21:29.128106 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2727/5411] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:21:29 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:21:29.140636 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3e52c356-a7aa-452c-bf4d-aea463b0eb31 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '.version_select at 0x7f77c0499310>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:29.296767 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3e52c356-a7aa-452c-bf4d-aea463b0eb31 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-861949454" status: 204 len: 0 microversion: 2.32 time: 0.167249 Jun 10 18:21:29.300746 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2685/5412] 10.222.0.35 () {60 vars in 1258 bytes} [Fri Jun 10 18:21:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-861949454 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 10 18:21:29.654416 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-86256d46-87a8-482f-adf3-344e81901b40 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:29.655388 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-86256d46-87a8-482f-adf3-344e81901b40 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] [instance: 2ef803cd-f02f-41f5-928a-c0d72dcbf25d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:29.672872 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-86256d46-87a8-482f-adf3-344e81901b40 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:29.675769 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-86256d46-87a8-482f-adf3-344e81901b40 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:29.677530 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-86256d46-87a8-482f-adf3-344e81901b40 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:29.679649 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-86256d46-87a8-482f-adf3-344e81901b40 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:30.096502 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-86256d46-87a8-482f-adf3-344e81901b40 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da6d9192dc524f7bb81aeaee99daa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8923e3e9c4462497ca3032e56de12d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:30.109391 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-86256d46-87a8-482f-adf3-344e81901b40 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] 10.222.0.35 "GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d" status: 200 len: 1316 microversion: 2.1 time: 0.457880 Jun 10 18:21:30.119219 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2728/5413] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:21:29 2022] GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d => generated 1316 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:21:30.814420 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-4045ca6a-c53b-45fc-9dce-d76ec5c245ce req-52221580-8c71-4925-ae1f-32338ee6f225 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ef803cd-f02f-41f5-928a-c0d72dcbf25d", "tag": "84dcf3ea-913c-47a7-a31c-9cf29bf090d6"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:21:30.831280 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-4045ca6a-c53b-45fc-9dce-d76ec5c245ce req-52221580-8c71-4925-ae1f-32338ee6f225 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:30.831771 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-4045ca6a-c53b-45fc-9dce-d76ec5c245ce req-52221580-8c71-4925-ae1f-32338ee6f225 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:30.859544 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-4045ca6a-c53b-45fc-9dce-d76ec5c245ce req-52221580-8c71-4925-ae1f-32338ee6f225 service nova] Creating event network-changed:84dcf3ea-913c-47a7-a31c-9cf29bf090d6 for instance 2ef803cd-f02f-41f5-928a-c0d72dcbf25d on chh2-master-2 Jun 10 18:21:30.872895 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-4045ca6a-c53b-45fc-9dce-d76ec5c245ce req-52221580-8c71-4925-ae1f-32338ee6f225 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061866 Jun 10 18:21:30.883409 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2686/5414] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:21:31.127039 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cbfe236b-3516-4ec4-bb3e-7ea7c7e02329 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:31.127674 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cbfe236b-3516-4ec4-bb3e-7ea7c7e02329 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] [instance: 2ef803cd-f02f-41f5-928a-c0d72dcbf25d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:31.135564 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cbfe236b-3516-4ec4-bb3e-7ea7c7e02329 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:31.136326 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cbfe236b-3516-4ec4-bb3e-7ea7c7e02329 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:31.137503 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cbfe236b-3516-4ec4-bb3e-7ea7c7e02329 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:31.138111 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cbfe236b-3516-4ec4-bb3e-7ea7c7e02329 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:31.459589 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cbfe236b-3516-4ec4-bb3e-7ea7c7e02329 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da6d9192dc524f7bb81aeaee99daa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8923e3e9c4462497ca3032e56de12d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:31.472017 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cbfe236b-3516-4ec4-bb3e-7ea7c7e02329 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] 10.222.0.35 "GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d" status: 200 len: 1316 microversion: 2.1 time: 0.347883 Jun 10 18:21:31.486106 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2729/5415] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:21:31 2022] GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d => generated 1316 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:21:32.507940 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9208cd84-5974-492c-8ec2-ff989cee5cbc tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:32.508946 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9208cd84-5974-492c-8ec2-ff989cee5cbc tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] [instance: 2ef803cd-f02f-41f5-928a-c0d72dcbf25d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:32.519511 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9208cd84-5974-492c-8ec2-ff989cee5cbc tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:32.522889 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9208cd84-5974-492c-8ec2-ff989cee5cbc tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:32.522889 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9208cd84-5974-492c-8ec2-ff989cee5cbc tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:32.522889 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9208cd84-5974-492c-8ec2-ff989cee5cbc tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:33.250797 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9208cd84-5974-492c-8ec2-ff989cee5cbc tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da6d9192dc524f7bb81aeaee99daa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8923e3e9c4462497ca3032e56de12d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:33.261752 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9208cd84-5974-492c-8ec2-ff989cee5cbc tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] 10.222.0.35 "GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d" status: 200 len: 1316 microversion: 2.1 time: 0.761630 Jun 10 18:21:33.263098 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2687/5416] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:21:32 2022] GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d => generated 1316 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:21:34.281409 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fa21fe97-75e9-4785-b27c-9c55ad764c5d tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:34.284297 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fa21fe97-75e9-4785-b27c-9c55ad764c5d tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] [instance: 2ef803cd-f02f-41f5-928a-c0d72dcbf25d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:34.296271 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:21:34.297145 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=6 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:21:34.315164 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fa21fe97-75e9-4785-b27c-9c55ad764c5d tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:34.320648 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fa21fe97-75e9-4785-b27c-9c55ad764c5d tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:34.322121 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fa21fe97-75e9-4785-b27c-9c55ad764c5d tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:34.324406 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fa21fe97-75e9-4785-b27c-9c55ad764c5d tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:34.710427 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fa21fe97-75e9-4785-b27c-9c55ad764c5d tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da6d9192dc524f7bb81aeaee99daa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8923e3e9c4462497ca3032e56de12d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:34.722466 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fa21fe97-75e9-4785-b27c-9c55ad764c5d tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] 10.222.0.35 "GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d" status: 200 len: 1316 microversion: 2.1 time: 0.447177 Jun 10 18:21:34.723593 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2730/5417] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:21:34 2022] GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d => generated 1316 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:21:35.739192 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-50ee409f-ae97-4889-9120-6c8e4566dc26 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:35.739793 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-50ee409f-ae97-4889-9120-6c8e4566dc26 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] [instance: 2ef803cd-f02f-41f5-928a-c0d72dcbf25d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:35.750247 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:21:35.751914 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-50ee409f-ae97-4889-9120-6c8e4566dc26 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:35.755297 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-50ee409f-ae97-4889-9120-6c8e4566dc26 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:35.756170 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-50ee409f-ae97-4889-9120-6c8e4566dc26 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:35.760257 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-50ee409f-ae97-4889-9120-6c8e4566dc26 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:36.146496 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-50ee409f-ae97-4889-9120-6c8e4566dc26 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da6d9192dc524f7bb81aeaee99daa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8923e3e9c4462497ca3032e56de12d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:36.156673 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-50ee409f-ae97-4889-9120-6c8e4566dc26 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] 10.222.0.35 "GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d" status: 200 len: 1316 microversion: 2.1 time: 0.421404 Jun 10 18:21:36.159688 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2688/5418] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:21:35 2022] GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d => generated 1316 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:21:37.181146 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-90944da3-6d06-44fb-95ea-d3c99446150b tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:37.181146 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-90944da3-6d06-44fb-95ea-d3c99446150b tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] [instance: 2ef803cd-f02f-41f5-928a-c0d72dcbf25d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:37.186944 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90944da3-6d06-44fb-95ea-d3c99446150b tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:37.187421 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90944da3-6d06-44fb-95ea-d3c99446150b tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:37.192057 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90944da3-6d06-44fb-95ea-d3c99446150b tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:37.192765 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90944da3-6d06-44fb-95ea-d3c99446150b tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:37.670168 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-90944da3-6d06-44fb-95ea-d3c99446150b tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da6d9192dc524f7bb81aeaee99daa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8923e3e9c4462497ca3032e56de12d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:37.683718 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-90944da3-6d06-44fb-95ea-d3c99446150b tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] 10.222.0.35 "GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d" status: 200 len: 1316 microversion: 2.1 time: 0.513992 Jun 10 18:21:37.692333 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2731/5419] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:21:37 2022] GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d => generated 1316 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:21:38.707308 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-42d7e903-2738-4632-906a-26df4ea12fde tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:38.708715 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-42d7e903-2738-4632-906a-26df4ea12fde tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] [instance: 2ef803cd-f02f-41f5-928a-c0d72dcbf25d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:38.726782 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42d7e903-2738-4632-906a-26df4ea12fde tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:38.728036 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42d7e903-2738-4632-906a-26df4ea12fde tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:38.728942 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42d7e903-2738-4632-906a-26df4ea12fde tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:38.730097 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42d7e903-2738-4632-906a-26df4ea12fde tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:39.076778 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ce222650-34f5-4bd4-a894-63c79e6e83e4 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:39.076778 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ce222650-34f5-4bd4-a894-63c79e6e83e4 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:39.092543 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ce222650-34f5-4bd4-a894-63c79e6e83e4 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:39.092543 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ce222650-34f5-4bd4-a894-63c79e6e83e4 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:39.098072 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ce222650-34f5-4bd4-a894-63c79e6e83e4 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:39.098072 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ce222650-34f5-4bd4-a894-63c79e6e83e4 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:39.177298 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-ce222650-34f5-4bd4-a894-63c79e6e83e4 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] HTTP exception thrown: Instance 39300115-c0d6-485c-a610-543bdf470fae could not be found. Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ce222650-34f5-4bd4-a894-63c79e6e83e4 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Request method failure captured: Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: request: DELETE /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae HTTP/1.1 Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4nEZshcKGxgPZmNM4yzwVezctPuScGheNiSfnqr4P8eamvtc7PV07nlbyrCnlHXjC__MII3PgT_uopfQXUERaA4H3QQ-lQDsacKcwscUbJnaa05QSRAFD8rmRGSdaDNIQPGC4fY-ovbZ2Vz7obqsHJMC4ijEZakc8us-U-CwnqdRAI Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: X-Openstack-Nova-Api-Version: 2.32 Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 0433689ccdd84ef9be7c8e2a1e553ce6 Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-TaggedBootDevicesTest-97114029 Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/0433689ccdd84ef9be7c8e2a1e553ce6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/0433689ccdd84ef9be7c8e2a1e553ce6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/0433689ccdd84ef9be7c8e2a1e553ce6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_0433689ccdd84ef9be7c8e2a1e553ce6", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-TaggedBootDevicesTest-97114029 Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 0433689ccdd84ef9be7c8e2a1e553ce6 Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-TaggedBootDevicesTest-97114029 Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-TaggedBootDevicesTest-97114029-project Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: a0fdd982d9e7413cae6a453b90de2e86 Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-TaggedBootDevicesTest-97114029-project Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 39300115-c0d6-485c-a610-543bdf470fae could not be found. Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '39300115-c0d6-485c-a610-543bdf470fae'} Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39300115-c0d6-485c-a610-543bdf470fae could not be found. Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:21:39.191418 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:21:39.196460 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39300115-c0d6-485c-a610-543bdf470fae could not be found. Jun 10 18:21:39.196460 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:21:39.196460 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:21:39.196460 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:21:39.196460 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:21:39.196460 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:21:39.196460 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:21:39.196460 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:21:39.196460 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:21:39.196460 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39300115-c0d6-485c-a610-543bdf470fae could not be found. Jun 10 18:21:39.196460 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:21:39.198299 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ce222650-34f5-4bd4-a894-63c79e6e83e4 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Returning 404 to user: Instance 39300115-c0d6-485c-a610-543bdf470fae could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:21:39.199637 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ce222650-34f5-4bd4-a894-63c79e6e83e4 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "DELETE /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 404 len: 111 microversion: 2.32 time: 0.131800 Jun 10 18:21:39.209183 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2732/5420] 10.222.0.35 () {60 vars in 1279 bytes} [Fri Jun 10 18:21:39 2022] DELETE /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:21:39.220972 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3a5112ed-b6d9-4afa-83e0-45e1e1193603 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:39.225131 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3a5112ed-b6d9-4afa-83e0-45e1e1193603 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] [instance: 39300115-c0d6-485c-a610-543bdf470fae] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:39.233168 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-42d7e903-2738-4632-906a-26df4ea12fde tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da6d9192dc524f7bb81aeaee99daa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8923e3e9c4462497ca3032e56de12d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:39.249788 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3a5112ed-b6d9-4afa-83e0-45e1e1193603 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:39.250407 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3a5112ed-b6d9-4afa-83e0-45e1e1193603 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:39.253927 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3a5112ed-b6d9-4afa-83e0-45e1e1193603 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:39.254503 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3a5112ed-b6d9-4afa-83e0-45e1e1193603 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:39.255197 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-42d7e903-2738-4632-906a-26df4ea12fde tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] 10.222.0.35 "GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d" status: 200 len: 1316 microversion: 2.1 time: 0.551344 Jun 10 18:21:39.255810 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2689/5421] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:21:38 2022] GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d => generated 1316 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:21:39.318371 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-3a5112ed-b6d9-4afa-83e0-45e1e1193603 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] HTTP exception thrown: Instance 39300115-c0d6-485c-a610-543bdf470fae could not be found. Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3a5112ed-b6d9-4afa-83e0-45e1e1193603 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Request method failure captured: Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae HTTP/1.1 Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4nEZshcKGxgPZmNM4yzwVezctPuScGheNiSfnqr4P8eamvtc7PV07nlbyrCnlHXjC__MII3PgT_uopfQXUERaA4H3QQ-lQDsacKcwscUbJnaa05QSRAFD8rmRGSdaDNIQPGC4fY-ovbZ2Vz7obqsHJMC4ijEZakc8us-U-CwnqdRAI Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: X-Openstack-Nova-Api-Version: 2.32 Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 0433689ccdd84ef9be7c8e2a1e553ce6 Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-TaggedBootDevicesTest-97114029 Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/0433689ccdd84ef9be7c8e2a1e553ce6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/0433689ccdd84ef9be7c8e2a1e553ce6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/0433689ccdd84ef9be7c8e2a1e553ce6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_0433689ccdd84ef9be7c8e2a1e553ce6", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-TaggedBootDevicesTest-97114029 Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 0433689ccdd84ef9be7c8e2a1e553ce6 Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-TaggedBootDevicesTest-97114029 Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-TaggedBootDevicesTest-97114029-project Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: a0fdd982d9e7413cae6a453b90de2e86 Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-TaggedBootDevicesTest-97114029-project Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 39300115-c0d6-485c-a610-543bdf470fae could not be found. Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '39300115-c0d6-485c-a610-543bdf470fae'} Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39300115-c0d6-485c-a610-543bdf470fae could not be found. Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39300115-c0d6-485c-a610-543bdf470fae could not be found. Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:21:39.323739 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:21:39.331648 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:21:39.331648 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:21:39.331648 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:21:39.331648 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:21:39.331648 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:21:39.331648 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39300115-c0d6-485c-a610-543bdf470fae could not be found. Jun 10 18:21:39.331648 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:21:39.333198 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3a5112ed-b6d9-4afa-83e0-45e1e1193603 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] Returning 404 to user: Instance 39300115-c0d6-485c-a610-543bdf470fae could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:21:39.336220 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3a5112ed-b6d9-4afa-83e0-45e1e1193603 tempest-TaggedBootDevicesTest-97114029 tempest-TaggedBootDevicesTest-97114029-project] 10.222.0.35 "GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae" status: 404 len: 111 microversion: 2.32 time: 0.120229 Jun 10 18:21:39.341250 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2733/5422] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:21:39 2022] GET /compute/v2.1/servers/39300115-c0d6-485c-a610-543bdf470fae => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:21:40.278964 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-46f7043b-21d1-41e6-a5f8-d62acfb908ba tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:40.279433 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-46f7043b-21d1-41e6-a5f8-d62acfb908ba tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] [instance: 2ef803cd-f02f-41f5-928a-c0d72dcbf25d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:40.303423 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-46f7043b-21d1-41e6-a5f8-d62acfb908ba tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:40.303894 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-46f7043b-21d1-41e6-a5f8-d62acfb908ba tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:40.308242 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-46f7043b-21d1-41e6-a5f8-d62acfb908ba tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:40.308981 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-46f7043b-21d1-41e6-a5f8-d62acfb908ba tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:40.823463 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-46f7043b-21d1-41e6-a5f8-d62acfb908ba tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da6d9192dc524f7bb81aeaee99daa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8923e3e9c4462497ca3032e56de12d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:40.847147 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-46f7043b-21d1-41e6-a5f8-d62acfb908ba tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] 10.222.0.35 "GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d" status: 200 len: 1316 microversion: 2.1 time: 0.572778 Jun 10 18:21:40.849350 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2690/5423] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:21:40 2022] GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d => generated 1316 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:21:41.868047 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d630db88-9fc5-4efd-97d1-f652939ed6ac tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:41.869848 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d630db88-9fc5-4efd-97d1-f652939ed6ac tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] [instance: 2ef803cd-f02f-41f5-928a-c0d72dcbf25d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:41.893397 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d630db88-9fc5-4efd-97d1-f652939ed6ac tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:41.895082 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d630db88-9fc5-4efd-97d1-f652939ed6ac tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:41.895905 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d630db88-9fc5-4efd-97d1-f652939ed6ac tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:41.903772 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d630db88-9fc5-4efd-97d1-f652939ed6ac tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:42.350688 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d630db88-9fc5-4efd-97d1-f652939ed6ac tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da6d9192dc524f7bb81aeaee99daa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8923e3e9c4462497ca3032e56de12d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:42.362449 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d630db88-9fc5-4efd-97d1-f652939ed6ac tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] 10.222.0.35 "GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d" status: 200 len: 1316 microversion: 2.1 time: 0.497447 Jun 10 18:21:42.366202 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2734/5424] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:21:41 2022] GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d => generated 1316 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:21:42.564511 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-82fc15ef-da93-4d35-83f9-80104fc60462 req-6b7026df-5073-4872-a1e7-beb82107368c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ef803cd-f02f-41f5-928a-c0d72dcbf25d", "name": "network-vif-plugged", "status": "completed", "tag": "84dcf3ea-913c-47a7-a31c-9cf29bf090d6"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:21:42.589926 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-82fc15ef-da93-4d35-83f9-80104fc60462 req-6b7026df-5073-4872-a1e7-beb82107368c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:42.592964 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-82fc15ef-da93-4d35-83f9-80104fc60462 req-6b7026df-5073-4872-a1e7-beb82107368c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:42.622466 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-82fc15ef-da93-4d35-83f9-80104fc60462 req-6b7026df-5073-4872-a1e7-beb82107368c service nova] Creating event network-vif-plugged:84dcf3ea-913c-47a7-a31c-9cf29bf090d6 for instance 2ef803cd-f02f-41f5-928a-c0d72dcbf25d on chh2-master-2 Jun 10 18:21:42.642327 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-82fc15ef-da93-4d35-83f9-80104fc60462 req-6b7026df-5073-4872-a1e7-beb82107368c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081462 Jun 10 18:21:42.645329 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2691/5425] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:21:43.385314 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c87a5a12-81d1-415e-aedf-afaee4e2d875 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:43.387235 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c87a5a12-81d1-415e-aedf-afaee4e2d875 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] [instance: 2ef803cd-f02f-41f5-928a-c0d72dcbf25d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:43.407989 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c87a5a12-81d1-415e-aedf-afaee4e2d875 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:43.409470 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c87a5a12-81d1-415e-aedf-afaee4e2d875 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:43.413487 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c87a5a12-81d1-415e-aedf-afaee4e2d875 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:43.417129 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c87a5a12-81d1-415e-aedf-afaee4e2d875 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:43.697415 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c87a5a12-81d1-415e-aedf-afaee4e2d875 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da6d9192dc524f7bb81aeaee99daa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8923e3e9c4462497ca3032e56de12d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:43.706450 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c87a5a12-81d1-415e-aedf-afaee4e2d875 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] 10.222.0.35 "GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d" status: 200 len: 1316 microversion: 2.1 time: 0.327122 Jun 10 18:21:43.716427 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2735/5426] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:21:43 2022] GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d => generated 1316 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:21:44.725657 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-61c14bbf-bedd-4b03-bc06-c7806825af2b tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:44.729447 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-61c14bbf-bedd-4b03-bc06-c7806825af2b tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] [instance: 2ef803cd-f02f-41f5-928a-c0d72dcbf25d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:44.754257 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-61c14bbf-bedd-4b03-bc06-c7806825af2b tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:44.756460 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-61c14bbf-bedd-4b03-bc06-c7806825af2b tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:44.760455 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-61c14bbf-bedd-4b03-bc06-c7806825af2b tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:44.762826 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-61c14bbf-bedd-4b03-bc06-c7806825af2b tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:45.390736 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8da14a77-c9a8-4082-a1a4-43ef1ea5527e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:45.391309 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8da14a77-c9a8-4082-a1a4-43ef1ea5527e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:45.406942 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8da14a77-c9a8-4082-a1a4-43ef1ea5527e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:45.409771 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8da14a77-c9a8-4082-a1a4-43ef1ea5527e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:45.423265 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8da14a77-c9a8-4082-a1a4-43ef1ea5527e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:45.424802 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8da14a77-c9a8-4082-a1a4-43ef1ea5527e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:45.482795 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-61c14bbf-bedd-4b03-bc06-c7806825af2b tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da6d9192dc524f7bb81aeaee99daa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8923e3e9c4462497ca3032e56de12d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:45.504376 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-61c14bbf-bedd-4b03-bc06-c7806825af2b tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] 10.222.0.35 "GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d" status: 200 len: 1316 microversion: 2.1 time: 0.770692 Jun 10 18:21:45.504376 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2692/5427] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:21:44 2022] GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d => generated 1316 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:21:45.545702 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8da14a77-c9a8-4082-a1a4-43ef1ea5527e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8/os-volume_attachments/0e911036-0710-48e4-aec6-3b9eaf4656ad" status: 200 len: 194 microversion: 2.20 time: 0.154388 Jun 10 18:21:45.547063 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2736/5428] 10.222.0.35 () {60 vars in 1453 bytes} [Fri Jun 10 18:21:45 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8/os-volume_attachments/0e911036-0710-48e4-aec6-3b9eaf4656ad => generated 194 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 10 18:21:45.692696 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a6ebbe62-e7da-4224-991f-234af220a233 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:45.693538 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a6ebbe62-e7da-4224-991f-234af220a233 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:45.706316 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a6ebbe62-e7da-4224-991f-234af220a233 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:45.711698 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a6ebbe62-e7da-4224-991f-234af220a233 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:45.724078 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a6ebbe62-e7da-4224-991f-234af220a233 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:45.724843 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a6ebbe62-e7da-4224-991f-234af220a233 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:45.909499 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-a6ebbe62-e7da-4224-991f-234af220a233 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lazy-loading 'services' on Instance uuid 580e911e-a112-4bfa-9d78-b6a24178fae8 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:21:46.189221 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a6ebbe62-e7da-4224-991f-234af220a233 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "DELETE /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8/os-volume_attachments/0e911036-0710-48e4-aec6-3b9eaf4656ad" status: 202 len: 0 microversion: 2.20 time: 0.510522 Jun 10 18:21:46.193808 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2693/5429] 10.222.0.35 () {60 vars in 1456 bytes} [Fri Jun 10 18:21:45 2022] DELETE /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8/os-volume_attachments/0e911036-0710-48e4-aec6-3b9eaf4656ad => generated 0 bytes in 517 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:21:46.201543 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7a40bbef-2506-4dca-942f-932497e34f4b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:46.202550 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7a40bbef-2506-4dca-942f-932497e34f4b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:46.429803 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7a40bbef-2506-4dca-942f-932497e34f4b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:46.429803 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7a40bbef-2506-4dca-942f-932497e34f4b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:46.429803 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7a40bbef-2506-4dca-942f-932497e34f4b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:46.429803 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7a40bbef-2506-4dca-942f-932497e34f4b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:46.524745 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-015c2c59-1321-4657-8874-b0954a644ca9 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:46.527021 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-015c2c59-1321-4657-8874-b0954a644ca9 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] [instance: 2ef803cd-f02f-41f5-928a-c0d72dcbf25d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:46.575520 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-015c2c59-1321-4657-8874-b0954a644ca9 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:46.581071 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-015c2c59-1321-4657-8874-b0954a644ca9 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:46.586062 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-015c2c59-1321-4657-8874-b0954a644ca9 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:46.602247 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-015c2c59-1321-4657-8874-b0954a644ca9 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:46.611879 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7a40bbef-2506-4dca-942f-932497e34f4b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.410647 Jun 10 18:21:46.632346 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2737/5430] 10.222.0.35 () {60 vars in 1342 bytes} [Fri Jun 10 18:21:46 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8/os-volume_attachments => generated 197 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:21:46.988773 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-015c2c59-1321-4657-8874-b0954a644ca9 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da6d9192dc524f7bb81aeaee99daa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8923e3e9c4462497ca3032e56de12d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:47.004580 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-015c2c59-1321-4657-8874-b0954a644ca9 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] 10.222.0.35 "GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d" status: 200 len: 1505 microversion: 2.1 time: 0.493298 Jun 10 18:21:47.005533 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2694/5431] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:21:46 2022] GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d => generated 1505 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:21:47.022545 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2c2760a8-cc49-48ce-9d76-585a833aea06 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:47.023240 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2c2760a8-cc49-48ce-9d76-585a833aea06 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] [instance: 2ef803cd-f02f-41f5-928a-c0d72dcbf25d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:47.032935 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2c2760a8-cc49-48ce-9d76-585a833aea06 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:47.037902 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2c2760a8-cc49-48ce-9d76-585a833aea06 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:47.039174 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2c2760a8-cc49-48ce-9d76-585a833aea06 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:47.040921 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2c2760a8-cc49-48ce-9d76-585a833aea06 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:47.111926 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2c2760a8-cc49-48ce-9d76-585a833aea06 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] 10.222.0.35 "GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d/ips" status: 200 len: 109 microversion: 2.1 time: 0.093969 Jun 10 18:21:47.112937 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2738/5432] 10.222.0.35 () {58 vars in 1247 bytes} [Fri Jun 10 18:21:47 2022] GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d/ips => generated 109 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:21:47.126579 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8d85e3b9-f6cb-479a-9ca8-3359434cd4fe tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:47.127475 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8d85e3b9-f6cb-479a-9ca8-3359434cd4fe tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] [instance: 2ef803cd-f02f-41f5-928a-c0d72dcbf25d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:47.137553 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8d85e3b9-f6cb-479a-9ca8-3359434cd4fe tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:47.138010 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8d85e3b9-f6cb-479a-9ca8-3359434cd4fe tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:47.138778 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8d85e3b9-f6cb-479a-9ca8-3359434cd4fe tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:47.139217 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8d85e3b9-f6cb-479a-9ca8-3359434cd4fe tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:47.211839 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8d85e3b9-f6cb-479a-9ca8-3359434cd4fe tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] 10.222.0.35 "GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d/ips" status: 200 len: 109 microversion: 2.1 time: 0.089978 Jun 10 18:21:47.212927 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2695/5433] 10.222.0.35 () {58 vars in 1247 bytes} [Fri Jun 10 18:21:47 2022] GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d/ips => generated 109 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:21:47.223352 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4b6b29fd-66b8-47a1-aa41-f42820c2dcca tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:47.223999 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4b6b29fd-66b8-47a1-aa41-f42820c2dcca tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] [instance: 2ef803cd-f02f-41f5-928a-c0d72dcbf25d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:47.240080 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4b6b29fd-66b8-47a1-aa41-f42820c2dcca tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:47.240646 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4b6b29fd-66b8-47a1-aa41-f42820c2dcca tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:47.241469 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4b6b29fd-66b8-47a1-aa41-f42820c2dcca tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:47.252828 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4b6b29fd-66b8-47a1-aa41-f42820c2dcca tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:47.354370 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4b6b29fd-66b8-47a1-aa41-f42820c2dcca tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] 10.222.0.35 "GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d/ips/tempest-ServerAddressesTestJSON-615820490-network" status: 200 len: 94 microversion: 2.1 time: 0.108842 Jun 10 18:21:47.373370 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2739/5434] 10.222.0.35 () {58 vars in 1397 bytes} [Fri Jun 10 18:21:47 2022] GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d/ips/tempest-ServerAddressesTestJSON-615820490-network => generated 94 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:21:47.373771 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-df854619-2afe-46d1-b3eb-e3d97c2d6026 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:47.373771 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-df854619-2afe-46d1-b3eb-e3d97c2d6026 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] [instance: 2ef803cd-f02f-41f5-928a-c0d72dcbf25d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:47.378852 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df854619-2afe-46d1-b3eb-e3d97c2d6026 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:47.379969 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df854619-2afe-46d1-b3eb-e3d97c2d6026 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:47.381566 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df854619-2afe-46d1-b3eb-e3d97c2d6026 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:47.382227 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df854619-2afe-46d1-b3eb-e3d97c2d6026 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:47.453246 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-df854619-2afe-46d1-b3eb-e3d97c2d6026 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] [instance: 2ef803cd-f02f-41f5-928a-c0d72dcbf25d] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:21:47.517700 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:21:47.643323 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c2799793-98b2-4732-9130-851ae352b641 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:47.644886 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c2799793-98b2-4732-9130-851ae352b641 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:47.655038 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c2799793-98b2-4732-9130-851ae352b641 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:47.659792 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c2799793-98b2-4732-9130-851ae352b641 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:47.661118 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c2799793-98b2-4732-9130-851ae352b641 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:47.661754 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c2799793-98b2-4732-9130-851ae352b641 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:47.746772 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c2799793-98b2-4732-9130-851ae352b641 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.107593 Jun 10 18:21:47.751104 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2740/5435] 10.222.0.35 () {60 vars in 1342 bytes} [Fri Jun 10 18:21:47 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 10 18:21:48.086401 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-df854619-2afe-46d1-b3eb-e3d97c2d6026 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] 10.222.0.35 "DELETE /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d" status: 204 len: 0 microversion: 2.1 time: 0.721665 Jun 10 18:21:48.088225 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2696/5436] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:21:47 2022] DELETE /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d => generated 0 bytes in 725 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:21:48.096344 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-154072dd-cc61-46bd-a09b-321e375dbb8e tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:48.097121 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-154072dd-cc61-46bd-a09b-321e375dbb8e tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] [instance: 2ef803cd-f02f-41f5-928a-c0d72dcbf25d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:48.114069 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-154072dd-cc61-46bd-a09b-321e375dbb8e tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:48.116118 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-154072dd-cc61-46bd-a09b-321e375dbb8e tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:48.117341 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-154072dd-cc61-46bd-a09b-321e375dbb8e tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:48.122964 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-154072dd-cc61-46bd-a09b-321e375dbb8e tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:48.677740 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-154072dd-cc61-46bd-a09b-321e375dbb8e tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da6d9192dc524f7bb81aeaee99daa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8923e3e9c4462497ca3032e56de12d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:48.689797 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-154072dd-cc61-46bd-a09b-321e375dbb8e tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] 10.222.0.35 "GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d" status: 200 len: 1511 microversion: 2.1 time: 0.597107 Jun 10 18:21:48.690911 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2741/5437] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:21:48 2022] GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d => generated 1511 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:21:48.772406 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-88428d97-e4b9-450d-b5a2-dd0419632395 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:48.773595 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-88428d97-e4b9-450d-b5a2-dd0419632395 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:48.785845 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-88428d97-e4b9-450d-b5a2-dd0419632395 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:48.787369 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-88428d97-e4b9-450d-b5a2-dd0419632395 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:48.789301 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-88428d97-e4b9-450d-b5a2-dd0419632395 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:48.793060 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-88428d97-e4b9-450d-b5a2-dd0419632395 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:48.899315 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-88428d97-e4b9-450d-b5a2-dd0419632395 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.143524 Jun 10 18:21:48.908916 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2697/5438] 10.222.0.35 () {60 vars in 1342 bytes} [Fri Jun 10 18:21:48 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:21:49.707608 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-76536a2d-cb1e-48de-99c0-c8073bae3308 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:49.708909 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-76536a2d-cb1e-48de-99c0-c8073bae3308 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] [instance: 2ef803cd-f02f-41f5-928a-c0d72dcbf25d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:49.731072 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-76536a2d-cb1e-48de-99c0-c8073bae3308 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:49.731831 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-76536a2d-cb1e-48de-99c0-c8073bae3308 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:49.732832 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-76536a2d-cb1e-48de-99c0-c8073bae3308 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:49.749204 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-76536a2d-cb1e-48de-99c0-c8073bae3308 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:49.765063 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:21:49.916159 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-55417eb9-0fff-4c11-8c07-dd47fbb61d9d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:49.917710 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-55417eb9-0fff-4c11-8c07-dd47fbb61d9d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:49.933613 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-55417eb9-0fff-4c11-8c07-dd47fbb61d9d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:49.936953 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-55417eb9-0fff-4c11-8c07-dd47fbb61d9d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:49.938840 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-55417eb9-0fff-4c11-8c07-dd47fbb61d9d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:49.945724 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-55417eb9-0fff-4c11-8c07-dd47fbb61d9d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:50.042412 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-55417eb9-0fff-4c11-8c07-dd47fbb61d9d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.130229 Jun 10 18:21:50.046681 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2698/5439] 10.222.0.35 () {60 vars in 1342 bytes} [Fri Jun 10 18:21:49 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:21:51.068431 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fb16d5e3-a3bf-4664-a853-88ddc062f056 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:51.069404 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fb16d5e3-a3bf-4664-a853-88ddc062f056 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:51.095646 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fb16d5e3-a3bf-4664-a853-88ddc062f056 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:51.097736 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fb16d5e3-a3bf-4664-a853-88ddc062f056 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:51.099271 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fb16d5e3-a3bf-4664-a853-88ddc062f056 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:51.101905 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fb16d5e3-a3bf-4664-a853-88ddc062f056 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:51.301369 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fb16d5e3-a3bf-4664-a853-88ddc062f056 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.247706 Jun 10 18:21:51.302225 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2699/5440] 10.222.0.35 () {60 vars in 1342 bytes} [Fri Jun 10 18:21:51 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8/os-volume_attachments => generated 197 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:21:51.407341 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-76536a2d-cb1e-48de-99c0-c8073bae3308 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da6d9192dc524f7bb81aeaee99daa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8923e3e9c4462497ca3032e56de12d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:51.438723 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-76536a2d-cb1e-48de-99c0-c8073bae3308 tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] 10.222.0.35 "GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d" status: 200 len: 1511 microversion: 2.1 time: 1.735059 Jun 10 18:21:51.451149 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2742/5441] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:21:49 2022] GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d => generated 1511 bytes in 1748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:21:51.574066 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-170290e4-19dc-40bc-956f-c7b316e322de req-c2647b68-07c3-4f4c-b10f-c0e756fd4ede service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ef803cd-f02f-41f5-928a-c0d72dcbf25d", "name": "network-vif-deleted", "tag": "84dcf3ea-913c-47a7-a31c-9cf29bf090d6"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:21:51.594833 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-170290e4-19dc-40bc-956f-c7b316e322de req-c2647b68-07c3-4f4c-b10f-c0e756fd4ede service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:51.595590 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-170290e4-19dc-40bc-956f-c7b316e322de req-c2647b68-07c3-4f4c-b10f-c0e756fd4ede service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:51.622429 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-170290e4-19dc-40bc-956f-c7b316e322de req-c2647b68-07c3-4f4c-b10f-c0e756fd4ede service nova] Creating event network-vif-deleted:84dcf3ea-913c-47a7-a31c-9cf29bf090d6 for instance 2ef803cd-f02f-41f5-928a-c0d72dcbf25d on chh2-master-2 Jun 10 18:21:51.635301 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-170290e4-19dc-40bc-956f-c7b316e322de req-c2647b68-07c3-4f4c-b10f-c0e756fd4ede service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060877 Jun 10 18:21:51.635301 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2700/5442] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:21:52.318715 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6e560988-d8bc-4769-8bd5-a981bcc50fd9 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:52.320044 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6e560988-d8bc-4769-8bd5-a981bcc50fd9 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:52.376588 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6e560988-d8bc-4769-8bd5-a981bcc50fd9 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:52.377249 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6e560988-d8bc-4769-8bd5-a981bcc50fd9 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:52.378990 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6e560988-d8bc-4769-8bd5-a981bcc50fd9 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:52.380489 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6e560988-d8bc-4769-8bd5-a981bcc50fd9 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:52.460534 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d12bfb1e-efec-4a91-8724-c4e46e8fe9ce tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:52.461271 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d12bfb1e-efec-4a91-8724-c4e46e8fe9ce tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] [instance: 2ef803cd-f02f-41f5-928a-c0d72dcbf25d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:52.487254 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d12bfb1e-efec-4a91-8724-c4e46e8fe9ce tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:52.487722 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d12bfb1e-efec-4a91-8724-c4e46e8fe9ce tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:52.488554 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d12bfb1e-efec-4a91-8724-c4e46e8fe9ce tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:52.489005 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d12bfb1e-efec-4a91-8724-c4e46e8fe9ce tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:52.508951 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6e560988-d8bc-4769-8bd5-a981bcc50fd9 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.199191 Jun 10 18:21:52.509934 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2743/5443] 10.222.0.35 () {60 vars in 1342 bytes} [Fri Jun 10 18:21:52 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:21:52.592273 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d12bfb1e-efec-4a91-8724-c4e46e8fe9ce tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:52.593602 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d12bfb1e-efec-4a91-8724-c4e46e8fe9ce tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:52.594302 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-d12bfb1e-efec-4a91-8724-c4e46e8fe9ce tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lazy-loading 'fault' on Instance uuid 2ef803cd-f02f-41f5-928a-c0d72dcbf25d {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:21:52.788071 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d12bfb1e-efec-4a91-8724-c4e46e8fe9ce tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da6d9192dc524f7bb81aeaee99daa19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8923e3e9c4462497ca3032e56de12d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:52.812853 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d12bfb1e-efec-4a91-8724-c4e46e8fe9ce tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] 10.222.0.35 "GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d" status: 200 len: 1306 microversion: 2.1 time: 0.356296 Jun 10 18:21:52.822984 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2701/5444] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:21:52 2022] GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d => generated 1306 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:21:53.520929 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6fdeb063-aff9-4716-ba6a-28b14635e69d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:53.526262 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6fdeb063-aff9-4716-ba6a-28b14635e69d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:53.537617 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6fdeb063-aff9-4716-ba6a-28b14635e69d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:53.538403 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6fdeb063-aff9-4716-ba6a-28b14635e69d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:53.539939 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6fdeb063-aff9-4716-ba6a-28b14635e69d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:53.541171 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6fdeb063-aff9-4716-ba6a-28b14635e69d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:53.623254 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6fdeb063-aff9-4716-ba6a-28b14635e69d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.106551 Jun 10 18:21:53.626217 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2744/5445] 10.222.0.35 () {60 vars in 1342 bytes} [Fri Jun 10 18:21:53 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:21:53.837788 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b57012c8-b364-4fe1-8b18-350e738e5cbc tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:53.839054 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b57012c8-b364-4fe1-8b18-350e738e5cbc tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] [instance: 2ef803cd-f02f-41f5-928a-c0d72dcbf25d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:53.878661 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b57012c8-b364-4fe1-8b18-350e738e5cbc tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:53.880094 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b57012c8-b364-4fe1-8b18-350e738e5cbc tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:53.883142 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b57012c8-b364-4fe1-8b18-350e738e5cbc tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:53.883815 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b57012c8-b364-4fe1-8b18-350e738e5cbc tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:53.920804 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-b57012c8-b364-4fe1-8b18-350e738e5cbc tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] HTTP exception thrown: Instance 2ef803cd-f02f-41f5-928a-c0d72dcbf25d could not be found. Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b57012c8-b364-4fe1-8b18-350e738e5cbc tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Request method failure captured: Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d HTTP/1.1 Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4ugQkpI2beSquc3_3UN1jKRj-h0Vy9Q7l-vbRLpaB6WS61rSfjBvPEyOEjAA6Ht4x_QNZFBD4BQ-ETEb9FV4ZFB7x8yjTCK4cAxlaYOUlkb0fbGP7PL8uO7lhUlB51-q-W90EP07gdT9eOgdHkN14WBHwH5j54X-BrBHEtCliNOlbo Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 0b8923e3e9c4462497ca3032e56de12d Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServerAddressesTestJSON-2062234711 Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/0b8923e3e9c4462497ca3032e56de12d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/0b8923e3e9c4462497ca3032e56de12d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/0b8923e3e9c4462497ca3032e56de12d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_0b8923e3e9c4462497ca3032e56de12d", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServerAddressesTestJSON-2062234711 Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 0b8923e3e9c4462497ca3032e56de12d Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServerAddressesTestJSON-2062234711 Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServerAddressesTestJSON-2062234711-project Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: da6d9192dc524f7bb81aeaee99daa19b Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServerAddressesTestJSON-2062234711-project Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 2ef803cd-f02f-41f5-928a-c0d72dcbf25d could not be found. Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '2ef803cd-f02f-41f5-928a-c0d72dcbf25d'} Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ef803cd-f02f-41f5-928a-c0d72dcbf25d could not be found. Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ef803cd-f02f-41f5-928a-c0d72dcbf25d could not be found. Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:21:53.922784 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:21:53.927441 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:21:53.927441 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:21:53.927441 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:21:53.927441 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:21:53.927441 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:21:53.927441 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ef803cd-f02f-41f5-928a-c0d72dcbf25d could not be found. Jun 10 18:21:53.927441 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:21:53.929385 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b57012c8-b364-4fe1-8b18-350e738e5cbc tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] Returning 404 to user: Instance 2ef803cd-f02f-41f5-928a-c0d72dcbf25d could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:21:53.930513 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b57012c8-b364-4fe1-8b18-350e738e5cbc tempest-ServerAddressesTestJSON-2062234711 tempest-ServerAddressesTestJSON-2062234711-project] 10.222.0.35 "GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d" status: 404 len: 111 microversion: 2.1 time: 0.096853 Jun 10 18:21:53.931733 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2702/5446] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:21:53 2022] GET /compute/v2.1/servers/2ef803cd-f02f-41f5-928a-c0d72dcbf25d => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:21:54.643998 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5c47abc3-a01d-46f3-94ce-c5c593121baf tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:54.645304 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5c47abc3-a01d-46f3-94ce-c5c593121baf tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:54.670045 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5c47abc3-a01d-46f3-94ce-c5c593121baf tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:54.670625 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5c47abc3-a01d-46f3-94ce-c5c593121baf tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:54.684190 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5c47abc3-a01d-46f3-94ce-c5c593121baf tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:54.684706 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5c47abc3-a01d-46f3-94ce-c5c593121baf tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:54.760712 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5c47abc3-a01d-46f3-94ce-c5c593121baf tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.127667 Jun 10 18:21:54.792667 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2745/5447] 10.222.0.35 () {60 vars in 1342 bytes} [Fri Jun 10 18:21:54 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:21:55.789570 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0a54fb29-4665-42e0-968b-c7b104026431 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:55.791665 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0a54fb29-4665-42e0-968b-c7b104026431 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:55.826262 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0a54fb29-4665-42e0-968b-c7b104026431 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:55.841804 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0a54fb29-4665-42e0-968b-c7b104026431 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:55.866822 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0a54fb29-4665-42e0-968b-c7b104026431 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:55.873026 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0a54fb29-4665-42e0-968b-c7b104026431 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:55.973222 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0a54fb29-4665-42e0-968b-c7b104026431 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.199038 Jun 10 18:21:55.977685 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2703/5448] 10.222.0.35 () {60 vars in 1342 bytes} [Fri Jun 10 18:21:55 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8/os-volume_attachments => generated 197 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:21:56.987849 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-63fecfc0-60bb-4599-8b2c-ddd08e228376 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:56.989046 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-63fecfc0-60bb-4599-8b2c-ddd08e228376 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:57.011097 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=44 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:21:57.012785 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-63fecfc0-60bb-4599-8b2c-ddd08e228376 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:57.013250 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-63fecfc0-60bb-4599-8b2c-ddd08e228376 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:57.027761 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-63fecfc0-60bb-4599-8b2c-ddd08e228376 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:57.028528 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-63fecfc0-60bb-4599-8b2c-ddd08e228376 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:57.125464 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-63fecfc0-60bb-4599-8b2c-ddd08e228376 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.140746 Jun 10 18:21:57.125464 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2746/5449] 10.222.0.35 () {60 vars in 1342 bytes} [Fri Jun 10 18:21:56 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8/os-volume_attachments => generated 25 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:21:57.212896 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9e073878-2e07-48c1-beb8-4c322b2eba44 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:57.213406 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9e073878-2e07-48c1-beb8-4c322b2eba44 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:57.225182 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9e073878-2e07-48c1-beb8-4c322b2eba44 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:57.225674 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9e073878-2e07-48c1-beb8-4c322b2eba44 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:57.226499 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9e073878-2e07-48c1-beb8-4c322b2eba44 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:57.226946 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9e073878-2e07-48c1-beb8-4c322b2eba44 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:57.304584 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9e073878-2e07-48c1-beb8-4c322b2eba44 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:21:57.764594 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9e073878-2e07-48c1-beb8-4c322b2eba44 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "DELETE /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 204 len: 0 microversion: 2.20 time: 0.555611 Jun 10 18:21:57.769784 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2704/5450] 10.222.0.35 () {60 vars in 1279 bytes} [Fri Jun 10 18:21:57 2022] DELETE /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 10 18:21:57.783272 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cddfa640-fdee-4de3-853a-ff470b7eb57a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:57.785672 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cddfa640-fdee-4de3-853a-ff470b7eb57a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:57.813965 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cddfa640-fdee-4de3-853a-ff470b7eb57a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:57.813965 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cddfa640-fdee-4de3-853a-ff470b7eb57a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:57.813965 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cddfa640-fdee-4de3-853a-ff470b7eb57a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:57.819177 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cddfa640-fdee-4de3-853a-ff470b7eb57a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:58.166450 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cddfa640-fdee-4de3-853a-ff470b7eb57a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:58.196826 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cddfa640-fdee-4de3-853a-ff470b7eb57a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:58.201038 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cddfa640-fdee-4de3-853a-ff470b7eb57a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:21:58.227812 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cddfa640-fdee-4de3-853a-ff470b7eb57a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1725 microversion: 2.20 time: 0.430880 Jun 10 18:21:58.227812 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2747/5451] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:21:57 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1725 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:21:59.247710 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6dcbba1d-9e1b-4ad6-9317-c58c115e239b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:21:59.249394 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6dcbba1d-9e1b-4ad6-9317-c58c115e239b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:21:59.256863 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:21:59.285394 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6dcbba1d-9e1b-4ad6-9317-c58c115e239b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:59.286353 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6dcbba1d-9e1b-4ad6-9317-c58c115e239b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:21:59.288275 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6dcbba1d-9e1b-4ad6-9317-c58c115e239b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:21:59.289319 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6dcbba1d-9e1b-4ad6-9317-c58c115e239b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:00.116816 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6dcbba1d-9e1b-4ad6-9317-c58c115e239b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:00.131684 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6dcbba1d-9e1b-4ad6-9317-c58c115e239b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:00.133210 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6dcbba1d-9e1b-4ad6-9317-c58c115e239b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:00.134428 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6dcbba1d-9e1b-4ad6-9317-c58c115e239b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1725 microversion: 2.20 time: 0.893200 Jun 10 18:22:00.154103 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2705/5452] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:21:59 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1725 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:22:01.151799 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cd07a5c9-2e21-44f8-82ed-bfd11fc36457 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:01.152866 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cd07a5c9-2e21-44f8-82ed-bfd11fc36457 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:01.174390 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cd07a5c9-2e21-44f8-82ed-bfd11fc36457 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:01.175116 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cd07a5c9-2e21-44f8-82ed-bfd11fc36457 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:01.175935 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cd07a5c9-2e21-44f8-82ed-bfd11fc36457 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:01.176435 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cd07a5c9-2e21-44f8-82ed-bfd11fc36457 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:01.743095 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cd07a5c9-2e21-44f8-82ed-bfd11fc36457 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:01.752022 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cd07a5c9-2e21-44f8-82ed-bfd11fc36457 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:01.753598 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cd07a5c9-2e21-44f8-82ed-bfd11fc36457 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:01.754791 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cd07a5c9-2e21-44f8-82ed-bfd11fc36457 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1725 microversion: 2.20 time: 0.607337 Jun 10 18:22:01.755722 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2748/5453] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:22:01 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1725 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:22:02.774103 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4a06f17d-0efa-477b-ab68-e0ab7327aad7 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:02.775423 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4a06f17d-0efa-477b-ab68-e0ab7327aad7 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:02.785849 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a06f17d-0efa-477b-ab68-e0ab7327aad7 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:02.790976 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a06f17d-0efa-477b-ab68-e0ab7327aad7 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:02.792080 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a06f17d-0efa-477b-ab68-e0ab7327aad7 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:02.794972 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a06f17d-0efa-477b-ab68-e0ab7327aad7 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:03.540718 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4a06f17d-0efa-477b-ab68-e0ab7327aad7 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:03.555244 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4a06f17d-0efa-477b-ab68-e0ab7327aad7 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:03.563019 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4a06f17d-0efa-477b-ab68-e0ab7327aad7 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:03.564430 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4a06f17d-0efa-477b-ab68-e0ab7327aad7 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1658 microversion: 2.20 time: 0.794230 Jun 10 18:22:03.576125 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2706/5454] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:22:02 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1658 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:22:03.726940 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-3347988f-46c6-4d0d-892b-a25bb4d8bd33 req-9f811b8b-fdb9-4e13-a850-4c0fd99cc000 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "580e911e-a112-4bfa-9d78-b6a24178fae8", "name": "network-vif-deleted", "tag": "7237a573-4c3c-4d85-9aaa-2a8f34ab9485"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:22:03.745719 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-3347988f-46c6-4d0d-892b-a25bb4d8bd33 req-9f811b8b-fdb9-4e13-a850-4c0fd99cc000 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:03.746159 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-3347988f-46c6-4d0d-892b-a25bb4d8bd33 req-9f811b8b-fdb9-4e13-a850-4c0fd99cc000 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:03.795287 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-3347988f-46c6-4d0d-892b-a25bb4d8bd33 req-9f811b8b-fdb9-4e13-a850-4c0fd99cc000 service nova] Creating event network-vif-deleted:7237a573-4c3c-4d85-9aaa-2a8f34ab9485 for instance 580e911e-a112-4bfa-9d78-b6a24178fae8 on chh1-master-2 Jun 10 18:22:03.823050 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-3347988f-46c6-4d0d-892b-a25bb4d8bd33 req-9f811b8b-fdb9-4e13-a850-4c0fd99cc000 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092142 Jun 10 18:22:03.829015 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2749/5455] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:22:04.583031 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-eef173ee-05ca-4378-bb3a-af3f15f48dff tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:04.583655 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-eef173ee-05ca-4378-bb3a-af3f15f48dff tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:04.608773 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eef173ee-05ca-4378-bb3a-af3f15f48dff tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:04.609280 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eef173ee-05ca-4378-bb3a-af3f15f48dff tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:04.609946 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eef173ee-05ca-4378-bb3a-af3f15f48dff tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:04.610397 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eef173ee-05ca-4378-bb3a-af3f15f48dff tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:04.722119 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eef173ee-05ca-4378-bb3a-af3f15f48dff tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:04.728111 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eef173ee-05ca-4378-bb3a-af3f15f48dff tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:04.732917 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-eef173ee-05ca-4378-bb3a-af3f15f48dff tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lazy-loading 'fault' on Instance uuid 580e911e-a112-4bfa-9d78-b6a24178fae8 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:22:05.041486 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-eef173ee-05ca-4378-bb3a-af3f15f48dff tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:05.059926 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-eef173ee-05ca-4378-bb3a-af3f15f48dff tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:05.061630 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-eef173ee-05ca-4378-bb3a-af3f15f48dff tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:05.062875 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-eef173ee-05ca-4378-bb3a-af3f15f48dff tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 200 len: 1372 microversion: 2.20 time: 0.483758 Jun 10 18:22:05.063456 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2707/5456] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:22:04 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 1372 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:22:06.086773 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d3270c43-0100-4512-bbee-65f61182ccff tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:06.088616 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d3270c43-0100-4512-bbee-65f61182ccff tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:06.111876 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d3270c43-0100-4512-bbee-65f61182ccff tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:06.112733 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d3270c43-0100-4512-bbee-65f61182ccff tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:06.115192 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d3270c43-0100-4512-bbee-65f61182ccff tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:06.120158 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d3270c43-0100-4512-bbee-65f61182ccff tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:06.178168 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-d3270c43-0100-4512-bbee-65f61182ccff tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] HTTP exception thrown: Instance 580e911e-a112-4bfa-9d78-b6a24178fae8 could not be found. Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d3270c43-0100-4512-bbee-65f61182ccff tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Request method failure captured: Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 HTTP/1.1 Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4roeABfU0LDjd4sEIHYTQC0IMae7J6Mra9Vy_1xOzbnXN2jSxDIko8tF1vxJtK8z5AlpLQsMdpqsdVt7qDN9xgkF0h7lXTCksN1VCW7wfK_1JTXkE0WDTNVyA_ld53tbtKPpriCbL00j4PS8vcye8EaA8CPfrFlWG5YNEqmbA88B3A Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: X-Openstack-Nova-Api-Version: 2.20 Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 9eb43e14768646f1bd2bdfc3bdf67406 Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-207035434 Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/9eb43e14768646f1bd2bdfc3bdf67406"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9eb43e14768646f1bd2bdfc3bdf67406"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9eb43e14768646f1bd2bdfc3bdf67406"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_9eb43e14768646f1bd2bdfc3bdf67406", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-AttachVolumeShelveTestJSON-207035434 Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 9eb43e14768646f1bd2bdfc3bdf67406 Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-207035434 Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-AttachVolumeShelveTestJSON-207035434-project Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: a86d300d66fd47a0b870b5ca879a03e8 Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-AttachVolumeShelveTestJSON-207035434-project Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 580e911e-a112-4bfa-9d78-b6a24178fae8 could not be found. Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '580e911e-a112-4bfa-9d78-b6a24178fae8'} Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 580e911e-a112-4bfa-9d78-b6a24178fae8 could not be found. Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 580e911e-a112-4bfa-9d78-b6a24178fae8 could not be found. Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:22:06.182231 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:22:06.202670 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:22:06.202670 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:22:06.202670 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:22:06.202670 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:22:06.202670 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:22:06.202670 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:22:06.202670 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 580e911e-a112-4bfa-9d78-b6a24178fae8 could not be found. Jun 10 18:22:06.202670 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:22:06.202670 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d3270c43-0100-4512-bbee-65f61182ccff tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Returning 404 to user: Instance 580e911e-a112-4bfa-9d78-b6a24178fae8 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:22:06.202670 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d3270c43-0100-4512-bbee-65f61182ccff tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 404 len: 111 microversion: 2.20 time: 0.105352 Jun 10 18:22:06.202670 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2750/5457] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:22:06 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:22:06.203506 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-68e2f0ab-cacc-4b3a-863e-85622c83675f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '.version_select at 0x7f77c0b889d0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:06.403123 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-68e2f0ab-cacc-4b3a-863e-85622c83675f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1642033248" status: 204 len: 0 microversion: 2.20 time: 0.212527 Jun 10 18:22:06.407577 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2708/5458] 10.222.0.35 () {60 vars in 1261 bytes} [Fri Jun 10 18:22:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1642033248 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 10 18:22:08.965675 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-97c5c4fc-247f-455d-a04f-efd1b712bf79 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Action: 'create', calling method: .version_select at 0x7f77c11cc8b0>, body: {"keypair": {"name": "tempest-keypair-1739777705", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2m99uTyANc9pRZwJ3VOHXifGaAxYHbZy1bHq5gUTsTdgUcWNAhLKd7ezYLkZeuRzWjM7bIUANoDXUO6HgUeT+hDr8TVHy96PDb+0ysl+2QRRKgrU7x27g25DJEFAWbHw=="}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:22:09.033547 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-97c5c4fc-247f-455d-a04f-efd1b712bf79 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Getting quotas for project 9eb43e14768646f1bd2bdfc3bdf67406. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:22:09.052008 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-97c5c4fc-247f-455d-a04f-efd1b712bf79 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Getting quotas for user a86d300d66fd47a0b870b5ca879a03e8 and project 9eb43e14768646f1bd2bdfc3bdf67406. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:22:09.162211 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-97c5c4fc-247f-455d-a04f-efd1b712bf79 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.204779 Jun 10 18:22:09.163313 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2751/5459] 10.222.0.35 () {62 vars in 1199 bytes} [Fri Jun 10 18:22:08 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 207 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 10 18:22:18.521684 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-604fe965-949e-4756-af17-017c48f442f5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1400511563", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cb27907a-0290-49c3-bbe7-9c976861e4b0"}], "security_groups": [{"name": "tempest-securitygroup--1511349102"}], "key_name": "tempest-keypair-1739777705", "user_data": "}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:22:18.615535 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:22:18.619112 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:22:19.700707 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-604fe965-949e-4756-af17-017c48f442f5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] validate_networks() for [('cb27907a-0290-49c3-bbe7-9c976861e4b0', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:22:21.843098 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-604fe965-949e-4756-af17-017c48f442f5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:22:21.844058 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-604fe965-949e-4756-af17-017c48f442f5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:22:21.844644 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-604fe965-949e-4756-af17-017c48f442f5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:22:21.845336 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-604fe965-949e-4756-af17-017c48f442f5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:22:21.846266 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-604fe965-949e-4756-af17-017c48f442f5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:22:21.901593 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-604fe965-949e-4756-af17-017c48f442f5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:21.901593 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-604fe965-949e-4756-af17-017c48f442f5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:21.901593 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-604fe965-949e-4756-af17-017c48f442f5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:21.902362 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-604fe965-949e-4756-af17-017c48f442f5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:21.967630 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-604fe965-949e-4756-af17-017c48f442f5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Getting quotas for project 9eb43e14768646f1bd2bdfc3bdf67406. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:22:21.992655 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-604fe965-949e-4756-af17-017c48f442f5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Getting quotas for user a86d300d66fd47a0b870b5ca879a03e8 and project 9eb43e14768646f1bd2bdfc3bdf67406. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:22:22.045942 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-604fe965-949e-4756-af17-017c48f442f5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:22:22.055648 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-604fe965-949e-4756-af17-017c48f442f5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:22:22.277912 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-604fe965-949e-4756-af17-017c48f442f5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.782709 Jun 10 18:22:22.279896 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2709/5460] 10.222.0.35 () {62 vars in 1187 bytes} [Fri Jun 10 18:22:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 3785 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 10 18:22:22.286738 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=45 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:22:22.288067 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=4 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:22:22.290605 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:22:22.296269 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b5d81c31-a8f4-40bf-bf67-c0a184ff7c35 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:22.299550 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b5d81c31-a8f4-40bf-bf67-c0a184ff7c35 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:22.612989 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b5d81c31-a8f4-40bf-bf67-c0a184ff7c35 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:22.644580 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b5d81c31-a8f4-40bf-bf67-c0a184ff7c35 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:22.647463 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b5d81c31-a8f4-40bf-bf67-c0a184ff7c35 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:22.662161 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b5d81c31-a8f4-40bf-bf67-c0a184ff7c35 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1282 microversion: 2.20 time: 0.376943 Jun 10 18:22:22.666447 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2752/5461] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:22:22 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1282 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:22:23.219433 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-04e99111-f615-4494-bca6-6097bcb5f392 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-53222086", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:22:23.334932 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-04e99111-f615-4494-bca6-6097bcb5f392 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] validate_networks() for [('b5b5a132-276a-4ea4-9242-6c73502fe4f7', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:22:23.686064 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8a9fe488-2074-4b65-a083-9198cf1d28a3 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:23.689224 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8a9fe488-2074-4b65-a083-9198cf1d28a3 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:23.706843 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8a9fe488-2074-4b65-a083-9198cf1d28a3 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:23.713207 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8a9fe488-2074-4b65-a083-9198cf1d28a3 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:23.718286 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8a9fe488-2074-4b65-a083-9198cf1d28a3 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:23.725509 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8a9fe488-2074-4b65-a083-9198cf1d28a3 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:24.034370 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8a9fe488-2074-4b65-a083-9198cf1d28a3 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:24.045637 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8a9fe488-2074-4b65-a083-9198cf1d28a3 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:24.050319 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8a9fe488-2074-4b65-a083-9198cf1d28a3 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:24.052027 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8a9fe488-2074-4b65-a083-9198cf1d28a3 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1286 microversion: 2.20 time: 0.372478 Jun 10 18:22:24.061490 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2753/5462] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:22:23 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1286 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:22:24.793098 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-04e99111-f615-4494-bca6-6097bcb5f392 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:22:24.794185 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-04e99111-f615-4494-bca6-6097bcb5f392 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:22:24.794824 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-04e99111-f615-4494-bca6-6097bcb5f392 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:22:24.795603 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-04e99111-f615-4494-bca6-6097bcb5f392 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:22:24.796231 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-04e99111-f615-4494-bca6-6097bcb5f392 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:22:24.827069 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-04e99111-f615-4494-bca6-6097bcb5f392 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:24.828723 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-04e99111-f615-4494-bca6-6097bcb5f392 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:24.831560 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-04e99111-f615-4494-bca6-6097bcb5f392 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:24.834233 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-04e99111-f615-4494-bca6-6097bcb5f392 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:24.945443 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-04e99111-f615-4494-bca6-6097bcb5f392 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Getting quotas for project 8b028adbad274995a55ea5761e28c4a0. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:22:24.965530 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-04e99111-f615-4494-bca6-6097bcb5f392 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Getting quotas for user b72693ea306f4789970cbb6257e96241 and project 8b028adbad274995a55ea5761e28c4a0. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:22:24.985963 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-04e99111-f615-4494-bca6-6097bcb5f392 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:22:24.988669 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-04e99111-f615-4494-bca6-6097bcb5f392 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:22:25.082528 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d163b325-6f6e-45e3-8532-6406a1a01dd9 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:25.084408 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d163b325-6f6e-45e3-8532-6406a1a01dd9 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:25.116334 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d163b325-6f6e-45e3-8532-6406a1a01dd9 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:25.118291 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d163b325-6f6e-45e3-8532-6406a1a01dd9 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:25.127371 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d163b325-6f6e-45e3-8532-6406a1a01dd9 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:25.129586 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d163b325-6f6e-45e3-8532-6406a1a01dd9 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:25.223233 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-04e99111-f615-4494-bca6-6097bcb5f392 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.293404 Jun 10 18:22:25.223233 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2710/5463] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:22:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 2300 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:22:25.252437 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f7390ce9-7c31-439c-b1b8-31cd3e5075e5 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:25.256636 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f7390ce9-7c31-439c-b1b8-31cd3e5075e5 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:25.655442 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f7390ce9-7c31-439c-b1b8-31cd3e5075e5 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:25.673336 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f7390ce9-7c31-439c-b1b8-31cd3e5075e5 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214" status: 200 len: 1212 microversion: 2.1 time: 0.448145 Jun 10 18:22:25.678673 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2711/5464] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:22:25 2022] GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 => generated 1212 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:22:25.701592 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d163b325-6f6e-45e3-8532-6406a1a01dd9 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:25.715303 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d163b325-6f6e-45e3-8532-6406a1a01dd9 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:25.719054 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d163b325-6f6e-45e3-8532-6406a1a01dd9 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:25.724176 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d163b325-6f6e-45e3-8532-6406a1a01dd9 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1334 microversion: 2.20 time: 0.647062 Jun 10 18:22:25.726368 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2754/5465] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:22:25 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1334 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:22:26.696390 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c62c747f-8dc5-423b-9a18-5cac5c2342b1 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:26.698903 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c62c747f-8dc5-423b-9a18-5cac5c2342b1 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:26.742203 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8a95f689-a7f4-4ed7-9409-c4714d20f46f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:26.743671 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8a95f689-a7f4-4ed7-9409-c4714d20f46f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:26.751849 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8a95f689-a7f4-4ed7-9409-c4714d20f46f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:26.769084 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8a95f689-a7f4-4ed7-9409-c4714d20f46f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:26.770065 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8a95f689-a7f4-4ed7-9409-c4714d20f46f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:26.771463 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8a95f689-a7f4-4ed7-9409-c4714d20f46f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:26.952166 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8a95f689-a7f4-4ed7-9409-c4714d20f46f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:26.964679 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8a95f689-a7f4-4ed7-9409-c4714d20f46f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:26.966230 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8a95f689-a7f4-4ed7-9409-c4714d20f46f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:26.972380 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8a95f689-a7f4-4ed7-9409-c4714d20f46f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1340 microversion: 2.20 time: 0.233946 Jun 10 18:22:26.973603 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2755/5466] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:22:26 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1340 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:22:27.076723 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c62c747f-8dc5-423b-9a18-5cac5c2342b1 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:27.091866 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c62c747f-8dc5-423b-9a18-5cac5c2342b1 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214" status: 200 len: 1212 microversion: 2.1 time: 0.392388 Jun 10 18:22:27.091866 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2712/5467] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:22:26 2022] GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 => generated 1212 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:22:27.990858 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fff4612b-2d08-4b42-ad0a-5866e8a3d80b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:27.991604 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fff4612b-2d08-4b42-ad0a-5866e8a3d80b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:28.000246 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fff4612b-2d08-4b42-ad0a-5866e8a3d80b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:28.000770 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fff4612b-2d08-4b42-ad0a-5866e8a3d80b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:28.001567 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fff4612b-2d08-4b42-ad0a-5866e8a3d80b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:28.002013 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fff4612b-2d08-4b42-ad0a-5866e8a3d80b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:28.104897 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-19074c3d-6f15-48c9-b7c5-34f2d9e776cf tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:28.105749 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-19074c3d-6f15-48c9-b7c5-34f2d9e776cf tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:28.129483 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-19074c3d-6f15-48c9-b7c5-34f2d9e776cf tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:28.130134 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-19074c3d-6f15-48c9-b7c5-34f2d9e776cf tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:28.133117 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-19074c3d-6f15-48c9-b7c5-34f2d9e776cf tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:28.135152 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-19074c3d-6f15-48c9-b7c5-34f2d9e776cf tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:28.256149 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fff4612b-2d08-4b42-ad0a-5866e8a3d80b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:28.269404 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fff4612b-2d08-4b42-ad0a-5866e8a3d80b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:28.270927 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fff4612b-2d08-4b42-ad0a-5866e8a3d80b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:28.272070 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fff4612b-2d08-4b42-ad0a-5866e8a3d80b tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1340 microversion: 2.20 time: 0.285181 Jun 10 18:22:28.286244 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2756/5468] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:22:27 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1340 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:22:28.513022 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-19074c3d-6f15-48c9-b7c5-34f2d9e776cf tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:28.534489 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-19074c3d-6f15-48c9-b7c5-34f2d9e776cf tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214" status: 200 len: 1264 microversion: 2.1 time: 0.435110 Jun 10 18:22:28.535812 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2713/5469] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:22:28 2022] GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 => generated 1264 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:22:29.304753 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c4b34c66-a293-4472-852f-3698a9c8e514 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:29.306039 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c4b34c66-a293-4472-852f-3698a9c8e514 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:29.319681 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c4b34c66-a293-4472-852f-3698a9c8e514 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:29.326368 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c4b34c66-a293-4472-852f-3698a9c8e514 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:29.330667 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c4b34c66-a293-4472-852f-3698a9c8e514 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:29.335854 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c4b34c66-a293-4472-852f-3698a9c8e514 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:29.552994 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-afa440e7-f658-4626-bb34-487a7db01ba7 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:29.553660 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-afa440e7-f658-4626-bb34-487a7db01ba7 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:29.591490 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-afa440e7-f658-4626-bb34-487a7db01ba7 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:29.592987 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-afa440e7-f658-4626-bb34-487a7db01ba7 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:29.594758 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-afa440e7-f658-4626-bb34-487a7db01ba7 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:29.596527 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-afa440e7-f658-4626-bb34-487a7db01ba7 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:29.716723 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-afa440e7-f658-4626-bb34-487a7db01ba7 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:29.727553 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-afa440e7-f658-4626-bb34-487a7db01ba7 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214" status: 200 len: 1270 microversion: 2.1 time: 0.178185 Jun 10 18:22:29.732485 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2714/5470] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:22:29 2022] GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 => generated 1270 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:22:30.199427 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c4b34c66-a293-4472-852f-3698a9c8e514 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:30.211182 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c4b34c66-a293-4472-852f-3698a9c8e514 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:30.216601 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c4b34c66-a293-4472-852f-3698a9c8e514 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:30.220026 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c4b34c66-a293-4472-852f-3698a9c8e514 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1408 microversion: 2.20 time: 0.920284 Jun 10 18:22:30.221684 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2757/5471] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:22:29 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1408 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:22:30.753136 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7d65bbad-f869-48c7-9e7f-ba72c98213c6 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:30.757621 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7d65bbad-f869-48c7-9e7f-ba72c98213c6 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:30.781383 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7d65bbad-f869-48c7-9e7f-ba72c98213c6 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:30.784105 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7d65bbad-f869-48c7-9e7f-ba72c98213c6 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:30.786444 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7d65bbad-f869-48c7-9e7f-ba72c98213c6 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:30.791435 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7d65bbad-f869-48c7-9e7f-ba72c98213c6 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:30.994469 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7d65bbad-f869-48c7-9e7f-ba72c98213c6 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:31.006887 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7d65bbad-f869-48c7-9e7f-ba72c98213c6 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214" status: 200 len: 1270 microversion: 2.1 time: 0.257662 Jun 10 18:22:31.008677 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2715/5472] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:22:30 2022] GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 => generated 1270 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:22:31.242027 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7a94bbac-5628-4b0f-871b-baceac1bfbab tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:31.244101 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7a94bbac-5628-4b0f-871b-baceac1bfbab tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:31.262835 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7a94bbac-5628-4b0f-871b-baceac1bfbab tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:31.266804 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7a94bbac-5628-4b0f-871b-baceac1bfbab tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:31.270115 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7a94bbac-5628-4b0f-871b-baceac1bfbab tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:31.273160 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7a94bbac-5628-4b0f-871b-baceac1bfbab tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:32.025884 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-553615d5-cd1c-4280-ac7c-fe3bf6cf503d tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:32.026514 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-553615d5-cd1c-4280-ac7c-fe3bf6cf503d tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:32.057172 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-553615d5-cd1c-4280-ac7c-fe3bf6cf503d tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:32.057719 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-553615d5-cd1c-4280-ac7c-fe3bf6cf503d tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:32.058607 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-553615d5-cd1c-4280-ac7c-fe3bf6cf503d tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:32.076012 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-553615d5-cd1c-4280-ac7c-fe3bf6cf503d tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:32.587683 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-553615d5-cd1c-4280-ac7c-fe3bf6cf503d tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:32.603579 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-553615d5-cd1c-4280-ac7c-fe3bf6cf503d tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214" status: 200 len: 1312 microversion: 2.1 time: 0.582680 Jun 10 18:22:32.609365 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2716/5473] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:22:32 2022] GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 => generated 1312 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:22:33.548092 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7a94bbac-5628-4b0f-871b-baceac1bfbab tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:33.566897 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7a94bbac-5628-4b0f-871b-baceac1bfbab tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:33.575830 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7a94bbac-5628-4b0f-871b-baceac1bfbab tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:33.577172 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7a94bbac-5628-4b0f-871b-baceac1bfbab tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1408 microversion: 2.20 time: 2.340994 Jun 10 18:22:33.581237 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2758/5474] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:22:31 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1408 bytes in 2346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:22:33.627122 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a2b62527-aa60-4eef-8e8e-afd00f3f4291 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:33.628466 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a2b62527-aa60-4eef-8e8e-afd00f3f4291 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:33.640283 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a2b62527-aa60-4eef-8e8e-afd00f3f4291 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:33.645802 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a2b62527-aa60-4eef-8e8e-afd00f3f4291 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:33.646980 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a2b62527-aa60-4eef-8e8e-afd00f3f4291 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:33.651663 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a2b62527-aa60-4eef-8e8e-afd00f3f4291 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:34.599001 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a9ec6f66-ebdf-4f9f-96f7-dd4403314890 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:34.601396 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a9ec6f66-ebdf-4f9f-96f7-dd4403314890 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:34.609744 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:22:34.615906 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a9ec6f66-ebdf-4f9f-96f7-dd4403314890 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:34.615906 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a9ec6f66-ebdf-4f9f-96f7-dd4403314890 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:34.615906 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a9ec6f66-ebdf-4f9f-96f7-dd4403314890 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:34.615906 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a9ec6f66-ebdf-4f9f-96f7-dd4403314890 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:34.914343 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:22:35.035123 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a2b62527-aa60-4eef-8e8e-afd00f3f4291 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:35.057308 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a2b62527-aa60-4eef-8e8e-afd00f3f4291 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214" status: 200 len: 1312 microversion: 2.1 time: 1.433911 Jun 10 18:22:35.059703 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2717/5475] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:22:33 2022] GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 => generated 1312 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:22:35.816140 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-7bb38f22-23af-4dff-8ef3-1d4d929ec0f1 req-bbb56237-a2e9-4a7e-a318-24fb5cf8130a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214", "tag": "66a07031-42d8-4cc1-82f2-2c29619df620"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:22:35.849925 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-7bb38f22-23af-4dff-8ef3-1d4d929ec0f1 req-bbb56237-a2e9-4a7e-a318-24fb5cf8130a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:35.855807 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-7bb38f22-23af-4dff-8ef3-1d4d929ec0f1 req-bbb56237-a2e9-4a7e-a318-24fb5cf8130a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:35.887410 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-7bb38f22-23af-4dff-8ef3-1d4d929ec0f1 req-bbb56237-a2e9-4a7e-a318-24fb5cf8130a service nova] Creating event network-changed:66a07031-42d8-4cc1-82f2-2c29619df620 for instance 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 on chh1-master-2 Jun 10 18:22:35.894311 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-7bb38f22-23af-4dff-8ef3-1d4d929ec0f1 req-bbb56237-a2e9-4a7e-a318-24fb5cf8130a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084137 Jun 10 18:22:35.896331 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2718/5476] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:22:36.007333 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-293d8d6b-a41b-4d17-9e62-ff8eb4a169b3 req-3cf7a049-a82c-409c-a835-dbd294f6bdda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6a3eb83-4aef-446a-a9d5-96d09acb1aaa", "tag": "64ec13e5-9fd3-4a96-981b-a6206cef5996"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:22:36.039956 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-293d8d6b-a41b-4d17-9e62-ff8eb4a169b3 req-3cf7a049-a82c-409c-a835-dbd294f6bdda service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:36.039956 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-293d8d6b-a41b-4d17-9e62-ff8eb4a169b3 req-3cf7a049-a82c-409c-a835-dbd294f6bdda service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:36.072028 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a9ec6f66-ebdf-4f9f-96f7-dd4403314890 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:36.078546 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a9ec6f66-ebdf-4f9f-96f7-dd4403314890 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:36.080061 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a9ec6f66-ebdf-4f9f-96f7-dd4403314890 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:36.081339 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a9ec6f66-ebdf-4f9f-96f7-dd4403314890 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1408 microversion: 2.20 time: 1.486189 Jun 10 18:22:36.089437 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2759/5477] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:22:34 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1408 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:22:36.093914 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-293d8d6b-a41b-4d17-9e62-ff8eb4a169b3 req-3cf7a049-a82c-409c-a835-dbd294f6bdda service nova] Creating event network-changed:64ec13e5-9fd3-4a96-981b-a6206cef5996 for instance b6a3eb83-4aef-446a-a9d5-96d09acb1aaa on chh2-master-2 Jun 10 18:22:36.099708 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-adb5cf73-7eec-4504-9908-e6cedd2f36e5 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:36.101535 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-adb5cf73-7eec-4504-9908-e6cedd2f36e5 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:36.136323 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-adb5cf73-7eec-4504-9908-e6cedd2f36e5 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:36.142714 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-adb5cf73-7eec-4504-9908-e6cedd2f36e5 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:36.142885 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-293d8d6b-a41b-4d17-9e62-ff8eb4a169b3 req-3cf7a049-a82c-409c-a835-dbd294f6bdda service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142300 Jun 10 18:22:36.150434 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-adb5cf73-7eec-4504-9908-e6cedd2f36e5 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:36.151151 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-adb5cf73-7eec-4504-9908-e6cedd2f36e5 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:36.158059 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2719/5478] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:22:36.809067 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-adb5cf73-7eec-4504-9908-e6cedd2f36e5 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:36.820911 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-adb5cf73-7eec-4504-9908-e6cedd2f36e5 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214" status: 200 len: 1312 microversion: 2.1 time: 0.730136 Jun 10 18:22:36.821569 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2760/5479] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:22:36 2022] GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 => generated 1312 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:22:37.105847 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=16 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:22:37.116734 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-83b60028-b3ab-4c24-aff0-709c6c218f8f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:37.117917 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-83b60028-b3ab-4c24-aff0-709c6c218f8f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:37.144588 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83b60028-b3ab-4c24-aff0-709c6c218f8f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:37.146628 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83b60028-b3ab-4c24-aff0-709c6c218f8f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:37.168726 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83b60028-b3ab-4c24-aff0-709c6c218f8f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:37.169558 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83b60028-b3ab-4c24-aff0-709c6c218f8f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:37.295694 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-640c1f7b-8352-4c65-bbf1-b66e61ddfac4 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Action: 'create', calling method: .version_select at 0x7f77c6257040>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-370767049", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIThp5R+l297ADE4NFNn55XKKe3A0s+i3c2J0QuIFTF3UE1zmpFDr9zPQGRSPRAk0I8vXJdK/0Ay79tjpPEOMmoAfK6/IeMfDvlAZfugaHWYsfJb4PDbik3QJWpXXozhLA=="}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:22:37.318892 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-640c1f7b-8352-4c65-bbf1-b66e61ddfac4 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Getting quotas for project 0e251487dbdd4ceea1446f703b8b1e92. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:22:37.322841 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-640c1f7b-8352-4c65-bbf1-b66e61ddfac4 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Getting quotas for user bc2d5bd2da034c0a916c92cfada76f28 and project 0e251487dbdd4ceea1446f703b8b1e92. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:22:37.444800 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-640c1f7b-8352-4c65-bbf1-b66e61ddfac4 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.153243 Jun 10 18:22:37.446354 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2761/5480] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 18:22:37 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:22:37.840028 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9374ca70-ac89-410b-b4d9-bac1eb7fd75d tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:37.840700 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9374ca70-ac89-410b-b4d9-bac1eb7fd75d tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:37.864837 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9374ca70-ac89-410b-b4d9-bac1eb7fd75d tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:37.864837 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9374ca70-ac89-410b-b4d9-bac1eb7fd75d tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:37.864837 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9374ca70-ac89-410b-b4d9-bac1eb7fd75d tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:37.866587 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9374ca70-ac89-410b-b4d9-bac1eb7fd75d tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:38.279241 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-83b60028-b3ab-4c24-aff0-709c6c218f8f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:38.300731 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-83b60028-b3ab-4c24-aff0-709c6c218f8f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:38.309265 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-83b60028-b3ab-4c24-aff0-709c6c218f8f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:38.312860 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-83b60028-b3ab-4c24-aff0-709c6c218f8f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1408 microversion: 2.20 time: 1.209714 Jun 10 18:22:38.317697 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2720/5481] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:22:37 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1408 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:22:38.325994 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9374ca70-ac89-410b-b4d9-bac1eb7fd75d tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:38.336561 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9374ca70-ac89-410b-b4d9-bac1eb7fd75d tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214" status: 200 len: 1312 microversion: 2.1 time: 0.502369 Jun 10 18:22:38.337877 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2762/5482] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:22:37 2022] GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 => generated 1312 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:22:39.341925 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a2dd37c4-4d64-40d0-a049-3a041f36f2bd tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:39.342536 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a2dd37c4-4d64-40d0-a049-3a041f36f2bd tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:39.353690 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-347857ab-1f79-45a0-8eb5-cfddebe3ea84 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:39.354910 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-347857ab-1f79-45a0-8eb5-cfddebe3ea84 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:39.366129 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a2dd37c4-4d64-40d0-a049-3a041f36f2bd tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:39.369362 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-347857ab-1f79-45a0-8eb5-cfddebe3ea84 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:39.370225 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-347857ab-1f79-45a0-8eb5-cfddebe3ea84 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:39.370418 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a2dd37c4-4d64-40d0-a049-3a041f36f2bd tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:39.374256 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a2dd37c4-4d64-40d0-a049-3a041f36f2bd tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:39.375834 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-347857ab-1f79-45a0-8eb5-cfddebe3ea84 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:39.376585 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-347857ab-1f79-45a0-8eb5-cfddebe3ea84 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:39.377381 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a2dd37c4-4d64-40d0-a049-3a041f36f2bd tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:39.930649 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-347857ab-1f79-45a0-8eb5-cfddebe3ea84 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:39.943700 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-347857ab-1f79-45a0-8eb5-cfddebe3ea84 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214" status: 200 len: 1312 microversion: 2.1 time: 0.589184 Jun 10 18:22:39.954197 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2763/5483] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:22:39 2022] GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 => generated 1312 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:22:40.513838 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a2dd37c4-4d64-40d0-a049-3a041f36f2bd tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:40.527256 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a2dd37c4-4d64-40d0-a049-3a041f36f2bd tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:40.534211 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a2dd37c4-4d64-40d0-a049-3a041f36f2bd tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:40.534211 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a2dd37c4-4d64-40d0-a049-3a041f36f2bd tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1408 microversion: 2.20 time: 1.193508 Jun 10 18:22:40.534211 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2721/5484] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:22:39 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1408 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:22:40.963546 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-eaeea97f-bc7a-4a29-8705-8ef67a4f2aa2 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:40.964164 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-eaeea97f-bc7a-4a29-8705-8ef67a4f2aa2 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:40.980953 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eaeea97f-bc7a-4a29-8705-8ef67a4f2aa2 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:40.982087 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eaeea97f-bc7a-4a29-8705-8ef67a4f2aa2 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:40.982928 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eaeea97f-bc7a-4a29-8705-8ef67a4f2aa2 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:40.983373 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eaeea97f-bc7a-4a29-8705-8ef67a4f2aa2 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:41.564187 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8f8d4112-36f2-428d-a060-62f45829e47f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:41.564187 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8f8d4112-36f2-428d-a060-62f45829e47f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:41.578022 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8f8d4112-36f2-428d-a060-62f45829e47f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:41.578798 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8f8d4112-36f2-428d-a060-62f45829e47f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:41.586018 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8f8d4112-36f2-428d-a060-62f45829e47f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:41.590043 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8f8d4112-36f2-428d-a060-62f45829e47f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:41.618754 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-eaeea97f-bc7a-4a29-8705-8ef67a4f2aa2 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:41.632281 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-eaeea97f-bc7a-4a29-8705-8ef67a4f2aa2 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214" status: 200 len: 1312 microversion: 2.1 time: 0.674728 Jun 10 18:22:41.642578 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2764/5485] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:22:40 2022] GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 => generated 1312 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:22:42.363505 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8f8d4112-36f2-428d-a060-62f45829e47f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:42.373092 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8f8d4112-36f2-428d-a060-62f45829e47f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:42.374611 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8f8d4112-36f2-428d-a060-62f45829e47f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:42.375752 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8f8d4112-36f2-428d-a060-62f45829e47f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1408 microversion: 2.20 time: 0.829055 Jun 10 18:22:42.391897 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2722/5486] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:22:41 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1408 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:22:42.651105 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b1554222-a188-4ed4-a074-32f6ca5ab910 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:42.651900 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b1554222-a188-4ed4-a074-32f6ca5ab910 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:42.672461 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b1554222-a188-4ed4-a074-32f6ca5ab910 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:42.673210 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b1554222-a188-4ed4-a074-32f6ca5ab910 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:42.678919 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b1554222-a188-4ed4-a074-32f6ca5ab910 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:42.682384 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b1554222-a188-4ed4-a074-32f6ca5ab910 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:43.306637 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b1554222-a188-4ed4-a074-32f6ca5ab910 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:43.333937 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b1554222-a188-4ed4-a074-32f6ca5ab910 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214" status: 200 len: 1312 microversion: 2.1 time: 0.688020 Jun 10 18:22:43.347298 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2765/5487] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:22:42 2022] GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 => generated 1312 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:22:43.407382 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-03c012e4-7162-47fb-9600-c6efa8da2ccc tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:43.407977 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-03c012e4-7162-47fb-9600-c6efa8da2ccc tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:43.450999 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03c012e4-7162-47fb-9600-c6efa8da2ccc tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:43.454423 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03c012e4-7162-47fb-9600-c6efa8da2ccc tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:43.456219 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03c012e4-7162-47fb-9600-c6efa8da2ccc tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:43.457955 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03c012e4-7162-47fb-9600-c6efa8da2ccc tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:43.892395 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-03c012e4-7162-47fb-9600-c6efa8da2ccc tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:43.904092 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-03c012e4-7162-47fb-9600-c6efa8da2ccc tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:43.909195 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-03c012e4-7162-47fb-9600-c6efa8da2ccc tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:43.914689 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-03c012e4-7162-47fb-9600-c6efa8da2ccc tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1408 microversion: 2.20 time: 0.523425 Jun 10 18:22:43.928442 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2723/5488] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:22:43 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1408 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:22:44.052874 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-5f567f84-f073-49b1-b7f3-12cfbe5b73fb req-23812d61-ca64-4da5-b5d2-ac4d5076a388 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214", "name": "network-vif-plugged", "status": "completed", "tag": "66a07031-42d8-4cc1-82f2-2c29619df620"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:22:44.081765 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-5f567f84-f073-49b1-b7f3-12cfbe5b73fb req-23812d61-ca64-4da5-b5d2-ac4d5076a388 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:44.084940 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-5f567f84-f073-49b1-b7f3-12cfbe5b73fb req-23812d61-ca64-4da5-b5d2-ac4d5076a388 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:44.114899 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-5f567f84-f073-49b1-b7f3-12cfbe5b73fb req-23812d61-ca64-4da5-b5d2-ac4d5076a388 service nova] Creating event network-vif-plugged:66a07031-42d8-4cc1-82f2-2c29619df620 for instance 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 on chh1-master-2 Jun 10 18:22:44.133931 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-5f567f84-f073-49b1-b7f3-12cfbe5b73fb req-23812d61-ca64-4da5-b5d2-ac4d5076a388 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087884 Jun 10 18:22:44.134888 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2766/5489] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:22:44.365007 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-02f5240f-9ca6-4352-8283-23d040770d4c tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:44.366161 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-02f5240f-9ca6-4352-8283-23d040770d4c tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:44.380042 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02f5240f-9ca6-4352-8283-23d040770d4c tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:44.381982 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02f5240f-9ca6-4352-8283-23d040770d4c tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:44.383536 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02f5240f-9ca6-4352-8283-23d040770d4c tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:44.384990 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02f5240f-9ca6-4352-8283-23d040770d4c tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:44.783769 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-02f5240f-9ca6-4352-8283-23d040770d4c tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:44.794186 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-80f51a5c-0ff3-47dd-908a-8284cb085ed1 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-709644740", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "2b37d276-bbbf-484a-bb08-28576863c77d", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-370767049", "security_groups": [{"name": "tempest-secgroup-smoke-165833767"}], "networks": [{"uuid": "b81fc7ab-11b7-4100-8f86-f4723a8a414f"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:22:44.807284 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-02f5240f-9ca6-4352-8283-23d040770d4c tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214" status: 200 len: 1312 microversion: 2.1 time: 0.451342 Jun 10 18:22:44.815052 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2724/5490] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:22:44 2022] GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 => generated 1312 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:22:44.916035 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-02f5240f-9ca6-4352-8283-23d040770d4c tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:44.918270 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-02f5240f-9ca6-4352-8283-23d040770d4c tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003751 Jun 10 18:22:44.918740 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2725/5491] 10.222.0.35 () {56 vars in 885 bytes} [Fri Jun 10 18:22:44 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Jun 10 18:22:44.933961 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-12fa72e1-92c3-4b92-9769-00484b61770a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:44.935182 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-12fa72e1-92c3-4b92-9769-00484b61770a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:44.952211 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-12fa72e1-92c3-4b92-9769-00484b61770a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:44.953991 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-12fa72e1-92c3-4b92-9769-00484b61770a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:44.958545 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-12fa72e1-92c3-4b92-9769-00484b61770a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:44.959750 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-12fa72e1-92c3-4b92-9769-00484b61770a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:45.142650 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-80f51a5c-0ff3-47dd-908a-8284cb085ed1 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] validate_networks() for [('b81fc7ab-11b7-4100-8f86-f4723a8a414f', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:22:45.229640 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-12fa72e1-92c3-4b92-9769-00484b61770a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:45.245183 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-12fa72e1-92c3-4b92-9769-00484b61770a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:45.246990 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-12fa72e1-92c3-4b92-9769-00484b61770a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:45.248620 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-12fa72e1-92c3-4b92-9769-00484b61770a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1408 microversion: 2.20 time: 0.320269 Jun 10 18:22:45.264510 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2726/5492] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:22:44 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1408 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:22:45.831463 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dc2d25a9-db42-41ab-b8d9-3def591cded1 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:45.837313 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dc2d25a9-db42-41ab-b8d9-3def591cded1 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:45.848962 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc2d25a9-db42-41ab-b8d9-3def591cded1 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:45.851640 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc2d25a9-db42-41ab-b8d9-3def591cded1 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:45.853749 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc2d25a9-db42-41ab-b8d9-3def591cded1 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:45.863494 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc2d25a9-db42-41ab-b8d9-3def591cded1 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:45.890383 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-80f51a5c-0ff3-47dd-908a-8284cb085ed1 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:22:45.890383 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-80f51a5c-0ff3-47dd-908a-8284cb085ed1 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:22:45.890383 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-80f51a5c-0ff3-47dd-908a-8284cb085ed1 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:22:45.890383 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-80f51a5c-0ff3-47dd-908a-8284cb085ed1 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:22:45.890383 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-80f51a5c-0ff3-47dd-908a-8284cb085ed1 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:22:45.916011 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-80f51a5c-0ff3-47dd-908a-8284cb085ed1 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:45.916823 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-80f51a5c-0ff3-47dd-908a-8284cb085ed1 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:45.918130 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-80f51a5c-0ff3-47dd-908a-8284cb085ed1 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:45.918789 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-80f51a5c-0ff3-47dd-908a-8284cb085ed1 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:45.942045 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-80f51a5c-0ff3-47dd-908a-8284cb085ed1 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Getting quotas for project 0e251487dbdd4ceea1446f703b8b1e92. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:22:45.948141 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-80f51a5c-0ff3-47dd-908a-8284cb085ed1 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Getting quotas for user bc2d5bd2da034c0a916c92cfada76f28 and project 0e251487dbdd4ceea1446f703b8b1e92. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:22:46.021430 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-80f51a5c-0ff3-47dd-908a-8284cb085ed1 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:22:46.021430 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-80f51a5c-0ff3-47dd-908a-8284cb085ed1 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] [instance: 1c3ad389-7452-4525-a7b3-02b207d522a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2b37d276-bbbf-484a-bb08-28576863c77d',volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:22:46.263798 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-dc2d25a9-db42-41ab-b8d9-3def591cded1 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:46.276659 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dc2d25a9-db42-41ab-b8d9-3def591cded1 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214" status: 200 len: 1497 microversion: 2.1 time: 0.448633 Jun 10 18:22:46.278454 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2727/5493] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:22:45 2022] GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 => generated 1497 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:22:46.293772 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-c95bfe6a-7b92-48ff-af24-6225339eaa7a req-ad1af675-7c00-4810-ab04-502bb03959a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6a3eb83-4aef-446a-a9d5-96d09acb1aaa", "name": "network-vif-plugged", "status": "completed", "tag": "64ec13e5-9fd3-4a96-981b-a6206cef5996"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:22:46.318202 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-c95bfe6a-7b92-48ff-af24-6225339eaa7a req-ad1af675-7c00-4810-ab04-502bb03959a1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:46.318834 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-c95bfe6a-7b92-48ff-af24-6225339eaa7a req-ad1af675-7c00-4810-ab04-502bb03959a1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:46.356287 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-c95bfe6a-7b92-48ff-af24-6225339eaa7a req-ad1af675-7c00-4810-ab04-502bb03959a1 service nova] Creating event network-vif-plugged:64ec13e5-9fd3-4a96-981b-a6206cef5996 for instance b6a3eb83-4aef-446a-a9d5-96d09acb1aaa on chh2-master-2 Jun 10 18:22:46.364873 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-c95bfe6a-7b92-48ff-af24-6225339eaa7a req-ad1af675-7c00-4810-ab04-502bb03959a1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082892 Jun 10 18:22:46.365276 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2728/5494] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:22:46.373929 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c9040a05-fe96-4468-a1bc-4568c97b39f4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:46.374862 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c9040a05-fe96-4468-a1bc-4568c97b39f4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:46.409338 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9040a05-fe96-4468-a1bc-4568c97b39f4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:46.409864 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9040a05-fe96-4468-a1bc-4568c97b39f4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:46.410687 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9040a05-fe96-4468-a1bc-4568c97b39f4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:46.411485 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9040a05-fe96-4468-a1bc-4568c97b39f4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:46.609211 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-80f51a5c-0ff3-47dd-908a-8284cb085ed1 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.834257 Jun 10 18:22:46.616495 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2767/5495] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:22:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 1842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 10 18:22:46.625958 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-aa0ed74a-4939-4a89-a662-b4b4e0d4b92c tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:22:46.630876 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-aa0ed74a-4939-4a89-a662-b4b4e0d4b92c tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:46.660861 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aa0ed74a-4939-4a89-a662-b4b4e0d4b92c tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:46.666525 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aa0ed74a-4939-4a89-a662-b4b4e0d4b92c tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:46.667887 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aa0ed74a-4939-4a89-a662-b4b4e0d4b92c tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:46.668915 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aa0ed74a-4939-4a89-a662-b4b4e0d4b92c tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:46.744209 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-aa0ed74a-4939-4a89-a662-b4b4e0d4b92c tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lazy-loading 'flavor' on Instance uuid 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:22:47.098117 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-aa0ed74a-4939-4a89-a662-b4b4e0d4b92c tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "POST /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214/action" status: 200 len: 32 microversion: 2.1 time: 0.479877 Jun 10 18:22:47.099025 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2768/5496] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:22:46 2022] POST /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214/action => generated 32 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:22:47.104825 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7b10298e-1562-411f-9898-3d7e7d18b3b0 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:47.106782 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7b10298e-1562-411f-9898-3d7e7d18b3b0 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] [instance: 1c3ad389-7452-4525-a7b3-02b207d522a7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:47.170919 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7b10298e-1562-411f-9898-3d7e7d18b3b0 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d5bd2da034c0a916c92cfada76f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e251487dbdd4ceea1446f703b8b1e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:47.179660 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7b10298e-1562-411f-9898-3d7e7d18b3b0 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] 10.222.0.35 "GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7" status: 200 len: 1097 microversion: 2.1 time: 0.079270 Jun 10 18:22:47.180572 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2769/5497] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:22:47 2022] GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7 => generated 1097 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:22:47.185729 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ed1a1798-bc98-4e75-8e08-ef0eb9332e77 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:47.186535 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ed1a1798-bc98-4e75-8e08-ef0eb9332e77 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:47.194574 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ed1a1798-bc98-4e75-8e08-ef0eb9332e77 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:47.195033 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ed1a1798-bc98-4e75-8e08-ef0eb9332e77 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:47.195813 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ed1a1798-bc98-4e75-8e08-ef0eb9332e77 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:47.196255 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ed1a1798-bc98-4e75-8e08-ef0eb9332e77 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:47.399180 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ed1a1798-bc98-4e75-8e08-ef0eb9332e77 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:47.404520 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:22:47.410256 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ed1a1798-bc98-4e75-8e08-ef0eb9332e77 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214" status: 200 len: 1503 microversion: 2.1 time: 0.227856 Jun 10 18:22:47.411060 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2770/5498] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:22:47 2022] GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 => generated 1503 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:22:47.703000 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c9040a05-fe96-4468-a1bc-4568c97b39f4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:47.711439 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c9040a05-fe96-4468-a1bc-4568c97b39f4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:47.712996 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c9040a05-fe96-4468-a1bc-4568c97b39f4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:47.714133 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c9040a05-fe96-4468-a1bc-4568c97b39f4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1408 microversion: 2.20 time: 1.347205 Jun 10 18:22:47.714899 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2729/5499] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:22:46 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1408 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:22:48.206521 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-19881346-101f-4b4b-94e1-03d5f100d056 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:48.207838 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-19881346-101f-4b4b-94e1-03d5f100d056 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] [instance: 1c3ad389-7452-4525-a7b3-02b207d522a7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:48.379548 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-19881346-101f-4b4b-94e1-03d5f100d056 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d5bd2da034c0a916c92cfada76f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e251487dbdd4ceea1446f703b8b1e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:48.419530 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-19881346-101f-4b4b-94e1-03d5f100d056 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] 10.222.0.35 "GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7" status: 200 len: 1097 microversion: 2.1 time: 0.220317 Jun 10 18:22:48.429589 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2771/5500] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:22:48 2022] GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7 => generated 1097 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:22:48.437124 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3ddaccb0-06a6-43bf-8230-d1a1204d1776 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:48.437742 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3ddaccb0-06a6-43bf-8230-d1a1204d1776 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:48.455519 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3ddaccb0-06a6-43bf-8230-d1a1204d1776 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:48.455980 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3ddaccb0-06a6-43bf-8230-d1a1204d1776 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:48.456804 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3ddaccb0-06a6-43bf-8230-d1a1204d1776 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:48.457247 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3ddaccb0-06a6-43bf-8230-d1a1204d1776 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:48.735096 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b9962f36-6536-4dce-80d7-9f4d02fa3761 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:48.735917 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b9962f36-6536-4dce-80d7-9f4d02fa3761 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:48.744427 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9962f36-6536-4dce-80d7-9f4d02fa3761 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:48.746784 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9962f36-6536-4dce-80d7-9f4d02fa3761 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:48.746784 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9962f36-6536-4dce-80d7-9f4d02fa3761 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:48.746784 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9962f36-6536-4dce-80d7-9f4d02fa3761 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:48.961909 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b9962f36-6536-4dce-80d7-9f4d02fa3761 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:48.970251 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b9962f36-6536-4dce-80d7-9f4d02fa3761 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:48.972083 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b9962f36-6536-4dce-80d7-9f4d02fa3761 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:48.973615 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b9962f36-6536-4dce-80d7-9f4d02fa3761 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1601 microversion: 2.20 time: 0.242361 Jun 10 18:22:48.988035 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2772/5501] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:22:48 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1601 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:22:48.995544 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f694907b-6188-4aa1-b261-52348b5991eb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:48.996396 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f694907b-6188-4aa1-b261-52348b5991eb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:49.004226 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f694907b-6188-4aa1-b261-52348b5991eb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:49.006677 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f694907b-6188-4aa1-b261-52348b5991eb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:49.008097 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f694907b-6188-4aa1-b261-52348b5991eb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:49.008808 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f694907b-6188-4aa1-b261-52348b5991eb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:49.151296 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f694907b-6188-4aa1-b261-52348b5991eb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.158787 Jun 10 18:22:49.151296 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2773/5502] 10.222.0.35 () {60 vars in 1315 bytes} [Fri Jun 10 18:22:48 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa/os-interface => generated 285 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:22:49.336890 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3ddaccb0-06a6-43bf-8230-d1a1204d1776 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:49.360353 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3ddaccb0-06a6-43bf-8230-d1a1204d1776 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214" status: 200 len: 1503 microversion: 2.1 time: 0.936297 Jun 10 18:22:49.366562 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2730/5503] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:22:48 2022] GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 => generated 1503 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:22:49.442128 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d4a2cca0-a6bd-4f43-8223-f66aa246986e tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:49.443337 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d4a2cca0-a6bd-4f43-8223-f66aa246986e tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] [instance: 1c3ad389-7452-4525-a7b3-02b207d522a7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:49.487929 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d4a2cca0-a6bd-4f43-8223-f66aa246986e tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:49.487929 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d4a2cca0-a6bd-4f43-8223-f66aa246986e tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:49.487929 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d4a2cca0-a6bd-4f43-8223-f66aa246986e tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:49.493121 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d4a2cca0-a6bd-4f43-8223-f66aa246986e tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:49.771382 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d4a2cca0-a6bd-4f43-8223-f66aa246986e tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d5bd2da034c0a916c92cfada76f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e251487dbdd4ceea1446f703b8b1e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:49.803756 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d4a2cca0-a6bd-4f43-8223-f66aa246986e tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] 10.222.0.35 "GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7" status: 200 len: 1139 microversion: 2.1 time: 0.367264 Jun 10 18:22:49.805114 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2774/5504] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:22:49 2022] GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7 => generated 1139 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:22:50.385286 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-acc661a1-4be3-46e4-9e9c-61521f3ded59 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:50.386778 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-acc661a1-4be3-46e4-9e9c-61521f3ded59 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:50.395189 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:22:50.397529 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-acc661a1-4be3-46e4-9e9c-61521f3ded59 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:50.398666 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-acc661a1-4be3-46e4-9e9c-61521f3ded59 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:50.399818 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-acc661a1-4be3-46e4-9e9c-61521f3ded59 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:50.400560 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-acc661a1-4be3-46e4-9e9c-61521f3ded59 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:50.411033 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=95 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:22:50.793134 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-acc661a1-4be3-46e4-9e9c-61521f3ded59 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:50.808384 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-acc661a1-4be3-46e4-9e9c-61521f3ded59 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214" status: 200 len: 1503 microversion: 2.1 time: 0.427757 Jun 10 18:22:50.809004 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2731/5505] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:22:50 2022] GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 => generated 1503 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:22:50.825897 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3991cca1-000d-458d-b65a-000a96f09a21 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:50.826658 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3991cca1-000d-458d-b65a-000a96f09a21 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] [instance: 1c3ad389-7452-4525-a7b3-02b207d522a7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:50.844237 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3991cca1-000d-458d-b65a-000a96f09a21 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:50.845020 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3991cca1-000d-458d-b65a-000a96f09a21 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:50.845996 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3991cca1-000d-458d-b65a-000a96f09a21 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:50.846603 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3991cca1-000d-458d-b65a-000a96f09a21 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:51.152333 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3991cca1-000d-458d-b65a-000a96f09a21 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d5bd2da034c0a916c92cfada76f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e251487dbdd4ceea1446f703b8b1e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:51.164409 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3991cca1-000d-458d-b65a-000a96f09a21 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] 10.222.0.35 "GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7" status: 200 len: 1203 microversion: 2.1 time: 0.342469 Jun 10 18:22:51.167150 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2775/5506] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:22:50 2022] GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7 => generated 1203 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:22:51.828886 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-995bc064-d458-4013-95b0-9ec95e2a1fa2 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:51.829509 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-995bc064-d458-4013-95b0-9ec95e2a1fa2 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:51.847067 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-995bc064-d458-4013-95b0-9ec95e2a1fa2 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:51.850318 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-995bc064-d458-4013-95b0-9ec95e2a1fa2 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:51.851404 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-995bc064-d458-4013-95b0-9ec95e2a1fa2 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:51.851871 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-995bc064-d458-4013-95b0-9ec95e2a1fa2 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:52.183374 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8fb61e92-f67b-4105-bdd6-4fe968fb777e tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:52.184162 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8fb61e92-f67b-4105-bdd6-4fe968fb777e tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] [instance: 1c3ad389-7452-4525-a7b3-02b207d522a7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:52.200463 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8fb61e92-f67b-4105-bdd6-4fe968fb777e tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:52.201194 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8fb61e92-f67b-4105-bdd6-4fe968fb777e tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:52.202413 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8fb61e92-f67b-4105-bdd6-4fe968fb777e tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:52.203820 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8fb61e92-f67b-4105-bdd6-4fe968fb777e tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:52.441051 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8fb61e92-f67b-4105-bdd6-4fe968fb777e tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d5bd2da034c0a916c92cfada76f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e251487dbdd4ceea1446f703b8b1e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:52.446926 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8fb61e92-f67b-4105-bdd6-4fe968fb777e tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] 10.222.0.35 "GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7" status: 200 len: 1213 microversion: 2.1 time: 0.267555 Jun 10 18:22:52.447937 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2776/5507] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:22:52 2022] GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7 => generated 1213 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:22:52.796857 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-f34f6526-c4d5-4cc1-86bd-533d82662cf1 req-22405551-d6ca-436a-a311-617500ccaf97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6a3eb83-4aef-446a-a9d5-96d09acb1aaa", "tag": "64ec13e5-9fd3-4a96-981b-a6206cef5996"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:22:52.813969 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-f34f6526-c4d5-4cc1-86bd-533d82662cf1 req-22405551-d6ca-436a-a311-617500ccaf97 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:52.814553 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-f34f6526-c4d5-4cc1-86bd-533d82662cf1 req-22405551-d6ca-436a-a311-617500ccaf97 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:52.844048 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-f34f6526-c4d5-4cc1-86bd-533d82662cf1 req-22405551-d6ca-436a-a311-617500ccaf97 service nova] Creating event network-changed:64ec13e5-9fd3-4a96-981b-a6206cef5996 for instance b6a3eb83-4aef-446a-a9d5-96d09acb1aaa on chh2-master-2 Jun 10 18:22:52.876133 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-f34f6526-c4d5-4cc1-86bd-533d82662cf1 req-22405551-d6ca-436a-a311-617500ccaf97 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069916 Jun 10 18:22:52.876133 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2777/5508] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:22:53.130526 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-995bc064-d458-4013-95b0-9ec95e2a1fa2 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:53.144107 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-995bc064-d458-4013-95b0-9ec95e2a1fa2 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214" status: 200 len: 1503 microversion: 2.1 time: 1.321759 Jun 10 18:22:53.149547 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2732/5509] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:22:51 2022] GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 => generated 1503 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:22:53.467498 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-41eac464-8fad-445e-925f-fc55953f046d tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:53.468295 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-41eac464-8fad-445e-925f-fc55953f046d tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] [instance: 1c3ad389-7452-4525-a7b3-02b207d522a7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:53.489130 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-41eac464-8fad-445e-925f-fc55953f046d tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:53.490689 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-41eac464-8fad-445e-925f-fc55953f046d tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:53.492014 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-41eac464-8fad-445e-925f-fc55953f046d tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:53.492756 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-41eac464-8fad-445e-925f-fc55953f046d tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:53.708647 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-41eac464-8fad-445e-925f-fc55953f046d tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d5bd2da034c0a916c92cfada76f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e251487dbdd4ceea1446f703b8b1e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:53.724557 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-41eac464-8fad-445e-925f-fc55953f046d tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] 10.222.0.35 "GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7" status: 200 len: 1213 microversion: 2.1 time: 0.263647 Jun 10 18:22:53.732799 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2778/5510] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:22:53 2022] GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7 => generated 1213 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:22:53.801027 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f43cadae-673c-4fdf-b22e-0efcdf48f800 tempest-ComputeTenantNetworksTest-1975548862 tempest-ComputeTenantNetworksTest-1975548862-project] Calling method '.version_select at 0x7f77b3fb6b80>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:54.168553 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7b3fa695-e4ed-47f8-83c1-ccd2b3672406 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:54.169187 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7b3fa695-e4ed-47f8-83c1-ccd2b3672406 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:54.184496 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f43cadae-673c-4fdf-b22e-0efcdf48f800 tempest-ComputeTenantNetworksTest-1975548862 tempest-ComputeTenantNetworksTest-1975548862-project] 10.222.0.35 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.701964 Jun 10 18:22:54.185095 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2733/5511] 10.222.0.35 () {58 vars in 1157 bytes} [Fri Jun 10 18:22:53 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:22:54.195644 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ae1d6de8-d671-414e-b574-5d31808a807c tempest-ComputeTenantNetworksTest-1975548862 tempest-ComputeTenantNetworksTest-1975548862-project] Calling method '.version_select at 0x7f77c02e3160>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:54.205246 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=4 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:22:54.207055 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7b3fa695-e4ed-47f8-83c1-ccd2b3672406 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:54.207513 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7b3fa695-e4ed-47f8-83c1-ccd2b3672406 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:54.208320 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7b3fa695-e4ed-47f8-83c1-ccd2b3672406 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:54.208816 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7b3fa695-e4ed-47f8-83c1-ccd2b3672406 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:54.569487 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ae1d6de8-d671-414e-b574-5d31808a807c tempest-ComputeTenantNetworksTest-1975548862 tempest-ComputeTenantNetworksTest-1975548862-project] 10.222.0.35 "GET /compute/v2.1/os-tenant-networks/9aaf36d9-20a0-4a16-be3e-3ccf69a1ec47" status: 200 len: 139 microversion: 2.1 time: 0.378211 Jun 10 18:22:54.570312 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2734/5512] 10.222.0.35 () {58 vars in 1268 bytes} [Fri Jun 10 18:22:54 2022] GET /compute/v2.1/os-tenant-networks/9aaf36d9-20a0-4a16-be3e-3ccf69a1ec47 => generated 139 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:22:54.748054 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-47484261-6821-4080-83ca-6c95cf2fc416 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:54.748847 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-47484261-6821-4080-83ca-6c95cf2fc416 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] [instance: 1c3ad389-7452-4525-a7b3-02b207d522a7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:54.760205 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-47484261-6821-4080-83ca-6c95cf2fc416 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:54.769708 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-47484261-6821-4080-83ca-6c95cf2fc416 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:54.770557 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-47484261-6821-4080-83ca-6c95cf2fc416 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:54.776276 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-47484261-6821-4080-83ca-6c95cf2fc416 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:55.339356 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7b3fa695-e4ed-47f8-83c1-ccd2b3672406 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:55.355222 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7b3fa695-e4ed-47f8-83c1-ccd2b3672406 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214" status: 200 len: 1503 microversion: 2.1 time: 1.191987 Jun 10 18:22:55.358226 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2779/5513] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:22:54 2022] GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 => generated 1503 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:22:55.704981 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-47484261-6821-4080-83ca-6c95cf2fc416 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d5bd2da034c0a916c92cfada76f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e251487dbdd4ceea1446f703b8b1e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:55.716191 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-47484261-6821-4080-83ca-6c95cf2fc416 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] 10.222.0.35 "GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7" status: 200 len: 1280 microversion: 2.1 time: 0.971869 Jun 10 18:22:55.726781 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2735/5514] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:22:54 2022] GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7 => generated 1280 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:22:56.383408 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f0b28ff6-8bb1-407e-88d8-69bac885b45c tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:56.384946 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f0b28ff6-8bb1-407e-88d8-69bac885b45c tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:56.397416 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:22:56.406621 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f0b28ff6-8bb1-407e-88d8-69bac885b45c tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:56.410123 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f0b28ff6-8bb1-407e-88d8-69bac885b45c tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:56.413668 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f0b28ff6-8bb1-407e-88d8-69bac885b45c tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:56.415997 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f0b28ff6-8bb1-407e-88d8-69bac885b45c tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:56.734693 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e5032ae1-ea36-414c-bc7f-33caa8ad7efe tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:56.735344 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e5032ae1-ea36-414c-bc7f-33caa8ad7efe tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] [instance: 1c3ad389-7452-4525-a7b3-02b207d522a7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:56.749355 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e5032ae1-ea36-414c-bc7f-33caa8ad7efe tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:56.753953 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e5032ae1-ea36-414c-bc7f-33caa8ad7efe tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:56.761662 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e5032ae1-ea36-414c-bc7f-33caa8ad7efe tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:56.763912 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e5032ae1-ea36-414c-bc7f-33caa8ad7efe tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:57.291250 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f0b28ff6-8bb1-407e-88d8-69bac885b45c tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:57.308742 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f0b28ff6-8bb1-407e-88d8-69bac885b45c tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214" status: 200 len: 1503 microversion: 2.1 time: 0.923194 Jun 10 18:22:57.309707 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2780/5515] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:22:56 2022] GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 => generated 1503 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:22:57.385972 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e5032ae1-ea36-414c-bc7f-33caa8ad7efe tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d5bd2da034c0a916c92cfada76f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e251487dbdd4ceea1446f703b8b1e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:57.408409 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e5032ae1-ea36-414c-bc7f-33caa8ad7efe tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] 10.222.0.35 "GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7" status: 200 len: 1280 microversion: 2.1 time: 0.676327 Jun 10 18:22:57.408409 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2736/5516] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:22:56 2022] GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7 => generated 1280 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:22:57.888911 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-5bcc8e5c-a36f-4d77-8b6b-70486cb653e4 req-9823a9e5-0b18-4893-9eb3-8e522f603665 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c3ad389-7452-4525-a7b3-02b207d522a7", "tag": "8a575c3a-d4a6-48bb-827e-0f068f5806e1"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:22:57.908044 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-5bcc8e5c-a36f-4d77-8b6b-70486cb653e4 req-9823a9e5-0b18-4893-9eb3-8e522f603665 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:57.908956 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-5bcc8e5c-a36f-4d77-8b6b-70486cb653e4 req-9823a9e5-0b18-4893-9eb3-8e522f603665 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:57.941942 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-5bcc8e5c-a36f-4d77-8b6b-70486cb653e4 req-9823a9e5-0b18-4893-9eb3-8e522f603665 service nova] Creating event network-changed:8a575c3a-d4a6-48bb-827e-0f068f5806e1 for instance 1c3ad389-7452-4525-a7b3-02b207d522a7 on chh2-master-2 Jun 10 18:22:57.953519 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-5bcc8e5c-a36f-4d77-8b6b-70486cb653e4 req-9823a9e5-0b18-4893-9eb3-8e522f603665 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069878 Jun 10 18:22:57.954973 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2781/5517] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:22:58.335343 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5ff66369-ca29-4392-a7e1-9dc633d27c54 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:58.336744 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5ff66369-ca29-4392-a7e1-9dc633d27c54 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:58.346821 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ff66369-ca29-4392-a7e1-9dc633d27c54 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:58.352030 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ff66369-ca29-4392-a7e1-9dc633d27c54 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:58.353204 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ff66369-ca29-4392-a7e1-9dc633d27c54 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:58.354951 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ff66369-ca29-4392-a7e1-9dc633d27c54 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:58.422636 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=14 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:22:58.428419 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8646cdd7-d1b0-496e-9108-15387713010c tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:58.429146 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8646cdd7-d1b0-496e-9108-15387713010c tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] [instance: 1c3ad389-7452-4525-a7b3-02b207d522a7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:58.446761 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8646cdd7-d1b0-496e-9108-15387713010c tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:58.447230 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8646cdd7-d1b0-496e-9108-15387713010c tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:58.448027 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8646cdd7-d1b0-496e-9108-15387713010c tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:58.448707 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8646cdd7-d1b0-496e-9108-15387713010c tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:58.879006 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5ff66369-ca29-4392-a7e1-9dc633d27c54 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:58.891905 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5ff66369-ca29-4392-a7e1-9dc633d27c54 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214" status: 200 len: 1503 microversion: 2.1 time: 0.558931 Jun 10 18:22:58.897143 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2737/5518] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:22:58 2022] GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 => generated 1503 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:22:59.448215 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8646cdd7-d1b0-496e-9108-15387713010c tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d5bd2da034c0a916c92cfada76f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e251487dbdd4ceea1446f703b8b1e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:22:59.457483 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8646cdd7-d1b0-496e-9108-15387713010c tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] 10.222.0.35 "GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7" status: 200 len: 1280 microversion: 2.1 time: 1.035896 Jun 10 18:22:59.467267 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2782/5519] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:22:58 2022] GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7 => generated 1280 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:22:59.912827 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6a9d321e-b275-4b9d-bec3-01cff7456abd tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:22:59.913446 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6a9d321e-b275-4b9d-bec3-01cff7456abd tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:22:59.934387 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a9d321e-b275-4b9d-bec3-01cff7456abd tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:59.934831 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a9d321e-b275-4b9d-bec3-01cff7456abd tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:22:59.944459 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a9d321e-b275-4b9d-bec3-01cff7456abd tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:22:59.945815 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a9d321e-b275-4b9d-bec3-01cff7456abd tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:00.574093 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6a9d321e-b275-4b9d-bec3-01cff7456abd tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:00.591590 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6a9d321e-b275-4b9d-bec3-01cff7456abd tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214" status: 200 len: 1503 microversion: 2.1 time: 0.679571 Jun 10 18:23:00.601840 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2738/5520] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:22:59 2022] GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 => generated 1503 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:01.038819 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9a73486a-fb61-480a-b617-f644548717dc tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:01.039472 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9a73486a-fb61-480a-b617-f644548717dc tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] [instance: 1c3ad389-7452-4525-a7b3-02b207d522a7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:01.050543 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9a73486a-fb61-480a-b617-f644548717dc tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:01.052867 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9a73486a-fb61-480a-b617-f644548717dc tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:01.053695 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9a73486a-fb61-480a-b617-f644548717dc tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:01.054152 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9a73486a-fb61-480a-b617-f644548717dc tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:01.480728 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9a73486a-fb61-480a-b617-f644548717dc tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d5bd2da034c0a916c92cfada76f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e251487dbdd4ceea1446f703b8b1e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:01.503255 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9a73486a-fb61-480a-b617-f644548717dc tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] 10.222.0.35 "GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7" status: 200 len: 1280 microversion: 2.1 time: 1.031495 Jun 10 18:23:01.517456 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2783/5521] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:00 2022] GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7 => generated 1280 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:01.618307 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-571c4c17-fa90-4222-bbf3-d2199eb8f7ba tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:01.619521 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-571c4c17-fa90-4222-bbf3-d2199eb8f7ba tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:01.636265 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-571c4c17-fa90-4222-bbf3-d2199eb8f7ba tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:01.638197 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-571c4c17-fa90-4222-bbf3-d2199eb8f7ba tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:01.639623 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-571c4c17-fa90-4222-bbf3-d2199eb8f7ba tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:01.642749 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-571c4c17-fa90-4222-bbf3-d2199eb8f7ba tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:02.180060 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-571c4c17-fa90-4222-bbf3-d2199eb8f7ba tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:02.189001 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-571c4c17-fa90-4222-bbf3-d2199eb8f7ba tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214" status: 200 len: 1503 microversion: 2.1 time: 0.573859 Jun 10 18:23:02.191419 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2739/5522] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:01 2022] GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 => generated 1503 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:02.522427 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-19ddb60e-c3e3-42a7-8028-2ff2ddc8d6c1 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:02.523804 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-19ddb60e-c3e3-42a7-8028-2ff2ddc8d6c1 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] [instance: 1c3ad389-7452-4525-a7b3-02b207d522a7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:02.535693 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-19ddb60e-c3e3-42a7-8028-2ff2ddc8d6c1 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:02.538415 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-19ddb60e-c3e3-42a7-8028-2ff2ddc8d6c1 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:02.539565 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-19ddb60e-c3e3-42a7-8028-2ff2ddc8d6c1 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:02.541026 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-19ddb60e-c3e3-42a7-8028-2ff2ddc8d6c1 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:02.836238 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-19ddb60e-c3e3-42a7-8028-2ff2ddc8d6c1 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d5bd2da034c0a916c92cfada76f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e251487dbdd4ceea1446f703b8b1e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:02.849288 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-19ddb60e-c3e3-42a7-8028-2ff2ddc8d6c1 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] 10.222.0.35 "GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7" status: 200 len: 1268 microversion: 2.1 time: 0.330637 Jun 10 18:23:02.853264 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2784/5523] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:02 2022] GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7 => generated 1268 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:03.206818 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3d5d9bbc-4dfe-4c1e-b57f-f860b2e7fd70 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:03.207437 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3d5d9bbc-4dfe-4c1e-b57f-f860b2e7fd70 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:03.220708 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3d5d9bbc-4dfe-4c1e-b57f-f860b2e7fd70 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:03.221166 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3d5d9bbc-4dfe-4c1e-b57f-f860b2e7fd70 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:03.221951 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3d5d9bbc-4dfe-4c1e-b57f-f860b2e7fd70 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:03.233252 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3d5d9bbc-4dfe-4c1e-b57f-f860b2e7fd70 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:03.779101 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3d5d9bbc-4dfe-4c1e-b57f-f860b2e7fd70 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:03.790242 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3d5d9bbc-4dfe-4c1e-b57f-f860b2e7fd70 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214" status: 200 len: 1503 microversion: 2.1 time: 0.587383 Jun 10 18:23:03.800157 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2740/5524] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:03 2022] GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 => generated 1503 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:03.867910 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-aa3dfe70-0063-4835-985a-25a45a273fc4 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:03.870127 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-aa3dfe70-0063-4835-985a-25a45a273fc4 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] [instance: 1c3ad389-7452-4525-a7b3-02b207d522a7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:03.880201 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aa3dfe70-0063-4835-985a-25a45a273fc4 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:03.881808 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aa3dfe70-0063-4835-985a-25a45a273fc4 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:03.882707 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aa3dfe70-0063-4835-985a-25a45a273fc4 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:03.887583 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aa3dfe70-0063-4835-985a-25a45a273fc4 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:04.202333 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-aa3dfe70-0063-4835-985a-25a45a273fc4 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d5bd2da034c0a916c92cfada76f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e251487dbdd4ceea1446f703b8b1e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:04.217921 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-aa3dfe70-0063-4835-985a-25a45a273fc4 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] 10.222.0.35 "GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7" status: 200 len: 1268 microversion: 2.1 time: 0.353741 Jun 10 18:23:04.218720 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2785/5525] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:03 2022] GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7 => generated 1268 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:04.809589 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b3b48078-c5dd-49f5-8ba4-40ba837d41bb tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:04.810382 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b3b48078-c5dd-49f5-8ba4-40ba837d41bb tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:04.825708 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b3b48078-c5dd-49f5-8ba4-40ba837d41bb tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:04.830461 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b3b48078-c5dd-49f5-8ba4-40ba837d41bb tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:04.831394 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b3b48078-c5dd-49f5-8ba4-40ba837d41bb tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:04.833521 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b3b48078-c5dd-49f5-8ba4-40ba837d41bb tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:05.241254 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e9b5b5f7-27c1-4411-8c15-fd6fff160218 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:05.242691 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e9b5b5f7-27c1-4411-8c15-fd6fff160218 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] [instance: 1c3ad389-7452-4525-a7b3-02b207d522a7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:05.257197 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e9b5b5f7-27c1-4411-8c15-fd6fff160218 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:05.258306 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e9b5b5f7-27c1-4411-8c15-fd6fff160218 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:05.262598 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e9b5b5f7-27c1-4411-8c15-fd6fff160218 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:05.268055 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b3b48078-c5dd-49f5-8ba4-40ba837d41bb tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:05.268823 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e9b5b5f7-27c1-4411-8c15-fd6fff160218 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:05.288565 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b3b48078-c5dd-49f5-8ba4-40ba837d41bb tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214" status: 200 len: 1503 microversion: 2.1 time: 0.484060 Jun 10 18:23:05.289175 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2741/5526] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:04 2022] GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 => generated 1503 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:05.526111 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e9b5b5f7-27c1-4411-8c15-fd6fff160218 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d5bd2da034c0a916c92cfada76f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e251487dbdd4ceea1446f703b8b1e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:05.535077 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e9b5b5f7-27c1-4411-8c15-fd6fff160218 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] 10.222.0.35 "GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7" status: 200 len: 1268 microversion: 2.1 time: 0.299890 Jun 10 18:23:05.536103 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2786/5527] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:05 2022] GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7 => generated 1268 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:23:06.307620 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3343581b-da26-4f38-93c8-c5e46ebe22b4 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:06.308250 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3343581b-da26-4f38-93c8-c5e46ebe22b4 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:06.325133 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3343581b-da26-4f38-93c8-c5e46ebe22b4 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:06.329947 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3343581b-da26-4f38-93c8-c5e46ebe22b4 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:06.330834 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3343581b-da26-4f38-93c8-c5e46ebe22b4 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:06.333659 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3343581b-da26-4f38-93c8-c5e46ebe22b4 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:06.556711 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-66b747a6-f5b9-4288-ac21-509543efa70d tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:06.558094 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-66b747a6-f5b9-4288-ac21-509543efa70d tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] [instance: 1c3ad389-7452-4525-a7b3-02b207d522a7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:06.579475 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-66b747a6-f5b9-4288-ac21-509543efa70d tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:06.581160 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-66b747a6-f5b9-4288-ac21-509543efa70d tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:06.582385 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-66b747a6-f5b9-4288-ac21-509543efa70d tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:06.583004 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-66b747a6-f5b9-4288-ac21-509543efa70d tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:06.828135 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-66b747a6-f5b9-4288-ac21-509543efa70d tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d5bd2da034c0a916c92cfada76f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e251487dbdd4ceea1446f703b8b1e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:06.853658 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3343581b-da26-4f38-93c8-c5e46ebe22b4 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:06.855389 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-66b747a6-f5b9-4288-ac21-509543efa70d tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] 10.222.0.35 "GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7" status: 200 len: 1268 microversion: 2.1 time: 0.304556 Jun 10 18:23:06.858904 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2787/5528] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:06 2022] GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7 => generated 1268 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:23:06.864014 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3343581b-da26-4f38-93c8-c5e46ebe22b4 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214" status: 200 len: 1503 microversion: 2.1 time: 0.562083 Jun 10 18:23:06.877464 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2742/5529] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:06 2022] GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 => generated 1503 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:07.875775 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8eb65a5b-4c0c-42c1-a818-31c9e0251b2c tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:07.876533 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8eb65a5b-4c0c-42c1-a818-31c9e0251b2c tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] [instance: 1c3ad389-7452-4525-a7b3-02b207d522a7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:07.882463 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-49ccf353-30df-4051-94cf-98f75e71757b tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:07.883784 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-49ccf353-30df-4051-94cf-98f75e71757b tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:07.894340 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8eb65a5b-4c0c-42c1-a818-31c9e0251b2c tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:07.894773 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8eb65a5b-4c0c-42c1-a818-31c9e0251b2c tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:07.895611 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8eb65a5b-4c0c-42c1-a818-31c9e0251b2c tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:07.896067 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8eb65a5b-4c0c-42c1-a818-31c9e0251b2c tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:07.927435 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-49ccf353-30df-4051-94cf-98f75e71757b tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:07.929980 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-49ccf353-30df-4051-94cf-98f75e71757b tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:07.934308 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-49ccf353-30df-4051-94cf-98f75e71757b tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:07.934308 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-49ccf353-30df-4051-94cf-98f75e71757b tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:08.337373 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8eb65a5b-4c0c-42c1-a818-31c9e0251b2c tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d5bd2da034c0a916c92cfada76f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e251487dbdd4ceea1446f703b8b1e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:08.348700 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8eb65a5b-4c0c-42c1-a818-31c9e0251b2c tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] 10.222.0.35 "GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7" status: 200 len: 1268 microversion: 2.1 time: 0.477456 Jun 10 18:23:08.349810 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2788/5530] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:07 2022] GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7 => generated 1268 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:08.788689 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-49ccf353-30df-4051-94cf-98f75e71757b tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:08.802651 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-49ccf353-30df-4051-94cf-98f75e71757b tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214" status: 200 len: 1503 microversion: 2.1 time: 0.924706 Jun 10 18:23:08.803900 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2743/5531] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:07 2022] GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 => generated 1503 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:09.368637 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f776fc79-cada-421c-a0fe-95aa672cf905 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:09.377465 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f776fc79-cada-421c-a0fe-95aa672cf905 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] [instance: 1c3ad389-7452-4525-a7b3-02b207d522a7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:09.377836 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f776fc79-cada-421c-a0fe-95aa672cf905 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:09.378516 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f776fc79-cada-421c-a0fe-95aa672cf905 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:09.379505 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f776fc79-cada-421c-a0fe-95aa672cf905 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:09.380221 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f776fc79-cada-421c-a0fe-95aa672cf905 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:09.670725 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f776fc79-cada-421c-a0fe-95aa672cf905 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d5bd2da034c0a916c92cfada76f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e251487dbdd4ceea1446f703b8b1e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:09.703765 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f776fc79-cada-421c-a0fe-95aa672cf905 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] 10.222.0.35 "GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7" status: 200 len: 1268 microversion: 2.1 time: 0.331523 Jun 10 18:23:09.703765 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2789/5532] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:09 2022] GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7 => generated 1268 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:09.828583 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-40dd4f44-f46e-439e-8891-20f594756986 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:09.829228 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-40dd4f44-f46e-439e-8891-20f594756986 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:09.846364 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-40dd4f44-f46e-439e-8891-20f594756986 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:09.849235 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-40dd4f44-f46e-439e-8891-20f594756986 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:09.851179 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-40dd4f44-f46e-439e-8891-20f594756986 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:09.851818 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-40dd4f44-f46e-439e-8891-20f594756986 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:10.339018 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-40dd4f44-f46e-439e-8891-20f594756986 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:10.349567 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-40dd4f44-f46e-439e-8891-20f594756986 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214" status: 200 len: 1503 microversion: 2.1 time: 0.531670 Jun 10 18:23:10.356712 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2744/5533] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:09 2022] GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 => generated 1503 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:10.711029 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c50ba05b-1a09-443d-bf47-c9dddda78930 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:10.711651 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c50ba05b-1a09-443d-bf47-c9dddda78930 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] [instance: 1c3ad389-7452-4525-a7b3-02b207d522a7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:10.731221 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c50ba05b-1a09-443d-bf47-c9dddda78930 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:10.731693 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c50ba05b-1a09-443d-bf47-c9dddda78930 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:10.732528 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c50ba05b-1a09-443d-bf47-c9dddda78930 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:10.732982 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c50ba05b-1a09-443d-bf47-c9dddda78930 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:10.742002 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:23:11.257314 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c50ba05b-1a09-443d-bf47-c9dddda78930 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d5bd2da034c0a916c92cfada76f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e251487dbdd4ceea1446f703b8b1e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:11.266092 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c50ba05b-1a09-443d-bf47-c9dddda78930 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] 10.222.0.35 "GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7" status: 200 len: 1268 microversion: 2.1 time: 0.558927 Jun 10 18:23:11.276684 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2790/5534] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:10 2022] GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7 => generated 1268 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:11.366596 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a89c4f18-23dc-47dd-aae1-ceb61d3450f5 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:11.367426 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a89c4f18-23dc-47dd-aae1-ceb61d3450f5 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:11.381648 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a89c4f18-23dc-47dd-aae1-ceb61d3450f5 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:11.382110 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a89c4f18-23dc-47dd-aae1-ceb61d3450f5 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:11.390859 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a89c4f18-23dc-47dd-aae1-ceb61d3450f5 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:11.391463 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a89c4f18-23dc-47dd-aae1-ceb61d3450f5 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:11.880535 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a89c4f18-23dc-47dd-aae1-ceb61d3450f5 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:11.892779 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a89c4f18-23dc-47dd-aae1-ceb61d3450f5 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214" status: 200 len: 1503 microversion: 2.1 time: 0.530283 Jun 10 18:23:11.908234 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2745/5535] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:11 2022] GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 => generated 1503 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:12.290235 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e46a7ae9-9871-429e-b295-d4f1f243124f tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:12.291023 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e46a7ae9-9871-429e-b295-d4f1f243124f tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] [instance: 1c3ad389-7452-4525-a7b3-02b207d522a7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:12.301260 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e46a7ae9-9871-429e-b295-d4f1f243124f tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:12.302280 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e46a7ae9-9871-429e-b295-d4f1f243124f tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:12.308537 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e46a7ae9-9871-429e-b295-d4f1f243124f tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:12.309177 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e46a7ae9-9871-429e-b295-d4f1f243124f tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:12.599307 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e46a7ae9-9871-429e-b295-d4f1f243124f tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d5bd2da034c0a916c92cfada76f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e251487dbdd4ceea1446f703b8b1e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:12.622375 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e46a7ae9-9871-429e-b295-d4f1f243124f tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] 10.222.0.35 "GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7" status: 200 len: 1268 microversion: 2.1 time: 0.341777 Jun 10 18:23:12.624257 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2791/5536] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:12 2022] GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7 => generated 1268 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:12.916565 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f60aa07c-c34d-43de-8206-8a739a5f26dc tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:12.917499 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f60aa07c-c34d-43de-8206-8a739a5f26dc tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:12.935800 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f60aa07c-c34d-43de-8206-8a739a5f26dc tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:12.936361 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f60aa07c-c34d-43de-8206-8a739a5f26dc tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:12.938684 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f60aa07c-c34d-43de-8206-8a739a5f26dc tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:12.939176 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f60aa07c-c34d-43de-8206-8a739a5f26dc tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:13.447729 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f60aa07c-c34d-43de-8206-8a739a5f26dc tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:13.457548 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f60aa07c-c34d-43de-8206-8a739a5f26dc tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214" status: 200 len: 1503 microversion: 2.1 time: 0.546303 Jun 10 18:23:13.458824 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2746/5537] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:12 2022] GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 => generated 1503 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:13.641271 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1feafc1e-49ab-4902-8eee-0375cd263433 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:13.641898 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1feafc1e-49ab-4902-8eee-0375cd263433 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] [instance: 1c3ad389-7452-4525-a7b3-02b207d522a7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:13.668807 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1feafc1e-49ab-4902-8eee-0375cd263433 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:13.669278 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1feafc1e-49ab-4902-8eee-0375cd263433 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:13.670088 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1feafc1e-49ab-4902-8eee-0375cd263433 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:13.675679 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1feafc1e-49ab-4902-8eee-0375cd263433 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:13.985401 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1feafc1e-49ab-4902-8eee-0375cd263433 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d5bd2da034c0a916c92cfada76f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e251487dbdd4ceea1446f703b8b1e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:14.004549 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1feafc1e-49ab-4902-8eee-0375cd263433 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] 10.222.0.35 "GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7" status: 200 len: 1268 microversion: 2.1 time: 0.369271 Jun 10 18:23:14.019606 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2792/5538] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:13 2022] GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7 => generated 1268 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:14.478862 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-92666c13-e0a2-421c-ad73-cab6585300f1 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:14.480261 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-92666c13-e0a2-421c-ad73-cab6585300f1 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:14.510890 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-92666c13-e0a2-421c-ad73-cab6585300f1 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:14.512216 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-92666c13-e0a2-421c-ad73-cab6585300f1 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:14.514544 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-92666c13-e0a2-421c-ad73-cab6585300f1 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:14.515851 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-92666c13-e0a2-421c-ad73-cab6585300f1 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:14.749776 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0cb15f39-fc43-4840-b54c-ddc1993ff42e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Action: 'create', calling method: .version_select at 0x7f77c627e4c0>, body: {"keypair": {"name": "tempest-keypair-1544651428", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzLN2PyQYeJ/TXMKhG4xwBHmH/VAk5ypUmUu9ksmtAl7sOlh4BZcvjQqJpVZgNChWlAB8OxJUl+a/KbR++S1zNIcsQHc4ChD9GHace9tB0mmibH3jfAq/lGzK2bs+TBEw=="}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:23:14.784466 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-0cb15f39-fc43-4840-b54c-ddc1993ff42e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Getting quotas for project 886b72a54e9b4ee7aa3cc21da4145cbb. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:23:14.792629 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-0cb15f39-fc43-4840-b54c-ddc1993ff42e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Getting quotas for user f62326a9deb140e891c07529dc021d11 and project 886b72a54e9b4ee7aa3cc21da4145cbb. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:23:14.922524 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0cb15f39-fc43-4840-b54c-ddc1993ff42e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.433120 Jun 10 18:23:14.929711 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2793/5539] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 18:23:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:23:14.959590 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-92666c13-e0a2-421c-ad73-cab6585300f1 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:14.979567 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-92666c13-e0a2-421c-ad73-cab6585300f1 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214" status: 200 len: 1503 microversion: 2.1 time: 0.506787 Jun 10 18:23:14.982555 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2747/5540] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:14 2022] GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 => generated 1503 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:15.027522 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b255b8cc-6040-4743-bd87-b99472e0352b tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:15.028181 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b255b8cc-6040-4743-bd87-b99472e0352b tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] [instance: 1c3ad389-7452-4525-a7b3-02b207d522a7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:15.034907 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b255b8cc-6040-4743-bd87-b99472e0352b tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:15.035020 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b255b8cc-6040-4743-bd87-b99472e0352b tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:15.036420 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b255b8cc-6040-4743-bd87-b99472e0352b tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:15.036764 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b255b8cc-6040-4743-bd87-b99472e0352b tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:15.339206 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b255b8cc-6040-4743-bd87-b99472e0352b tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d5bd2da034c0a916c92cfada76f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e251487dbdd4ceea1446f703b8b1e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:15.355293 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b255b8cc-6040-4743-bd87-b99472e0352b tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] 10.222.0.35 "GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7" status: 200 len: 1268 microversion: 2.1 time: 0.331743 Jun 10 18:23:15.357699 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2794/5541] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:15 2022] GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7 => generated 1268 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:16.001705 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4e2bd273-aa80-4b93-b7d6-483e197da2c9 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:16.002339 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4e2bd273-aa80-4b93-b7d6-483e197da2c9 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:16.015353 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e2bd273-aa80-4b93-b7d6-483e197da2c9 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:16.015915 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e2bd273-aa80-4b93-b7d6-483e197da2c9 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:16.021197 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e2bd273-aa80-4b93-b7d6-483e197da2c9 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:16.024833 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e2bd273-aa80-4b93-b7d6-483e197da2c9 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:16.311042 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4e2bd273-aa80-4b93-b7d6-483e197da2c9 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:16.322060 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4e2bd273-aa80-4b93-b7d6-483e197da2c9 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214" status: 200 len: 1503 microversion: 2.1 time: 0.325537 Jun 10 18:23:16.322663 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2748/5542] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:15 2022] GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 => generated 1503 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:16.386498 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f97bcece-ae80-4cad-92a2-62356edb65ca tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:16.386498 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f97bcece-ae80-4cad-92a2-62356edb65ca tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] [instance: 1c3ad389-7452-4525-a7b3-02b207d522a7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:16.396815 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f97bcece-ae80-4cad-92a2-62356edb65ca tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:16.397796 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f97bcece-ae80-4cad-92a2-62356edb65ca tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:16.399307 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f97bcece-ae80-4cad-92a2-62356edb65ca tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:16.399993 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f97bcece-ae80-4cad-92a2-62356edb65ca tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:17.184040 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f97bcece-ae80-4cad-92a2-62356edb65ca tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d5bd2da034c0a916c92cfada76f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e251487dbdd4ceea1446f703b8b1e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:17.218432 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f97bcece-ae80-4cad-92a2-62356edb65ca tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] 10.222.0.35 "GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7" status: 200 len: 1268 microversion: 2.1 time: 0.846375 Jun 10 18:23:17.221673 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2795/5543] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:16 2022] GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7 => generated 1268 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:17.339781 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c3039c13-4031-4439-8245-72e6a93749e4 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:17.344185 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c3039c13-4031-4439-8245-72e6a93749e4 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:17.355683 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c3039c13-4031-4439-8245-72e6a93749e4 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:17.357510 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c3039c13-4031-4439-8245-72e6a93749e4 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:17.358546 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c3039c13-4031-4439-8245-72e6a93749e4 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:17.359936 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c3039c13-4031-4439-8245-72e6a93749e4 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:17.759673 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c3039c13-4031-4439-8245-72e6a93749e4 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:17.763880 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:23:17.782013 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c3039c13-4031-4439-8245-72e6a93749e4 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214" status: 200 len: 1483 microversion: 2.1 time: 0.446569 Jun 10 18:23:17.782621 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2749/5544] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:17 2022] GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 => generated 1483 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:18.226725 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-01493744-96b8-414f-a9fc-93566c78f28f tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1960900190", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:23:18.249620 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-936eaefa-9688-477f-ba27-c3843cb99892 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:18.250328 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-936eaefa-9688-477f-ba27-c3843cb99892 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] [instance: 1c3ad389-7452-4525-a7b3-02b207d522a7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:18.266247 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-936eaefa-9688-477f-ba27-c3843cb99892 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:18.266711 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-936eaefa-9688-477f-ba27-c3843cb99892 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:18.274001 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-936eaefa-9688-477f-ba27-c3843cb99892 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:18.274622 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-936eaefa-9688-477f-ba27-c3843cb99892 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:18.337918 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-01493744-96b8-414f-a9fc-93566c78f28f tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] validate_networks() for [('b5b5a132-276a-4ea4-9242-6c73502fe4f7', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:23:19.691580 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-01493744-96b8-414f-a9fc-93566c78f28f tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:23:19.693219 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-01493744-96b8-414f-a9fc-93566c78f28f tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:23:19.693900 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-01493744-96b8-414f-a9fc-93566c78f28f tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:23:19.694488 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-01493744-96b8-414f-a9fc-93566c78f28f tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:23:19.695106 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-01493744-96b8-414f-a9fc-93566c78f28f tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:23:19.715143 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-01493744-96b8-414f-a9fc-93566c78f28f tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:19.719537 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-01493744-96b8-414f-a9fc-93566c78f28f tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:19.720895 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-01493744-96b8-414f-a9fc-93566c78f28f tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:19.721544 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-01493744-96b8-414f-a9fc-93566c78f28f tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:19.753766 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-01493744-96b8-414f-a9fc-93566c78f28f tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Getting quotas for project 8b028adbad274995a55ea5761e28c4a0. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:23:19.767975 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-01493744-96b8-414f-a9fc-93566c78f28f tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Getting quotas for user b72693ea306f4789970cbb6257e96241 and project 8b028adbad274995a55ea5761e28c4a0. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:23:19.809741 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-01493744-96b8-414f-a9fc-93566c78f28f tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:23:19.820071 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-01493744-96b8-414f-a9fc-93566c78f28f tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:23:20.037368 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-01493744-96b8-414f-a9fc-93566c78f28f tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.819866 Jun 10 18:23:20.041212 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2796/5545] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:23:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 1825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:23:20.054056 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-95e0f232-e678-445e-b6c3-c7ce7882b2d9 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:20.063311 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-95e0f232-e678-445e-b6c3-c7ce7882b2d9 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:20.272966 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-95e0f232-e678-445e-b6c3-c7ce7882b2d9 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:20.281083 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-95e0f232-e678-445e-b6c3-c7ce7882b2d9 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 200 len: 1214 microversion: 2.1 time: 0.231600 Jun 10 18:23:20.290196 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2797/5546] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:20 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 1214 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:20.311890 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-206e5f89-b561-42ee-a3b7-a412995f1325 req-a459ce77-9942-4473-a9b3-485c452cf42a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3ad389-7452-4525-a7b3-02b207d522a7", "name": "network-vif-plugged", "status": "completed", "tag": "8a575c3a-d4a6-48bb-827e-0f068f5806e1"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:23:20.336537 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-206e5f89-b561-42ee-a3b7-a412995f1325 req-a459ce77-9942-4473-a9b3-485c452cf42a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:20.346898 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-206e5f89-b561-42ee-a3b7-a412995f1325 req-a459ce77-9942-4473-a9b3-485c452cf42a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:20.367273 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-206e5f89-b561-42ee-a3b7-a412995f1325 req-a459ce77-9942-4473-a9b3-485c452cf42a service nova] Creating event network-vif-plugged:8a575c3a-d4a6-48bb-827e-0f068f5806e1 for instance 1c3ad389-7452-4525-a7b3-02b207d522a7 on chh2-master-2 Jun 10 18:23:20.376001 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-206e5f89-b561-42ee-a3b7-a412995f1325 req-a459ce77-9942-4473-a9b3-485c452cf42a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082456 Jun 10 18:23:20.384016 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2798/5547] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:23:20.497816 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-936eaefa-9688-477f-ba27-c3843cb99892 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d5bd2da034c0a916c92cfada76f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e251487dbdd4ceea1446f703b8b1e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:20.517855 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-936eaefa-9688-477f-ba27-c3843cb99892 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] 10.222.0.35 "GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7" status: 200 len: 1268 microversion: 2.1 time: 2.283233 Jun 10 18:23:20.522079 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2750/5548] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:18 2022] GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7 => generated 1268 bytes in 2288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:21.306949 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ca387d41-f24e-4773-8527-7ea26bfa2fbb tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:21.308583 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ca387d41-f24e-4773-8527-7ea26bfa2fbb tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:21.417256 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ca387d41-f24e-4773-8527-7ea26bfa2fbb tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:21.427083 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ca387d41-f24e-4773-8527-7ea26bfa2fbb tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 200 len: 1214 microversion: 2.1 time: 0.124184 Jun 10 18:23:21.430263 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2799/5549] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:21 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 1214 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:21.538549 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ee1aff9f-f666-437a-a9fc-3f0dd5dc5c5e tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:21.540784 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ee1aff9f-f666-437a-a9fc-3f0dd5dc5c5e tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] [instance: 1c3ad389-7452-4525-a7b3-02b207d522a7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:21.548665 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee1aff9f-f666-437a-a9fc-3f0dd5dc5c5e tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:21.549466 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee1aff9f-f666-437a-a9fc-3f0dd5dc5c5e tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:21.550494 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee1aff9f-f666-437a-a9fc-3f0dd5dc5c5e tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:21.551204 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee1aff9f-f666-437a-a9fc-3f0dd5dc5c5e tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:21.941248 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ee1aff9f-f666-437a-a9fc-3f0dd5dc5c5e tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d5bd2da034c0a916c92cfada76f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e251487dbdd4ceea1446f703b8b1e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:21.954104 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ee1aff9f-f666-437a-a9fc-3f0dd5dc5c5e tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] 10.222.0.35 "GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7" status: 200 len: 1268 microversion: 2.1 time: 0.417214 Jun 10 18:23:21.963872 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2751/5550] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:21 2022] GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7 => generated 1268 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:22.109954 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-48fcd6e2-2dc8-486e-80a6-1458e357c273 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1165951204", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bc4d74bc-8446-4d8c-a25b-248884836510"}], "security_groups": [{"name": "tempest-securitygroup--1817605026"}], "key_name": "tempest-keypair-1544651428", "user_data": "}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:23:22.445337 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-345241c1-3898-4d84-a981-82fa7bd48891 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:22.451205 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-345241c1-3898-4d84-a981-82fa7bd48891 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:22.463616 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=38 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:23:22.476537 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-345241c1-3898-4d84-a981-82fa7bd48891 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:22.477016 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-345241c1-3898-4d84-a981-82fa7bd48891 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:22.481310 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-345241c1-3898-4d84-a981-82fa7bd48891 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:22.483698 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-345241c1-3898-4d84-a981-82fa7bd48891 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:22.677249 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-345241c1-3898-4d84-a981-82fa7bd48891 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:22.733962 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-345241c1-3898-4d84-a981-82fa7bd48891 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 200 len: 1210 microversion: 2.1 time: 0.283389 Jun 10 18:23:22.737305 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2752/5551] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:22 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 1210 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:22.746694 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-48fcd6e2-2dc8-486e-80a6-1458e357c273 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] validate_networks() for [('bc4d74bc-8446-4d8c-a25b-248884836510', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:23:22.972212 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ff6fe680-e4c3-4390-aa9c-65835c7a3dd7 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:22.973461 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ff6fe680-e4c3-4390-aa9c-65835c7a3dd7 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] [instance: 1c3ad389-7452-4525-a7b3-02b207d522a7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:22.982946 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ff6fe680-e4c3-4390-aa9c-65835c7a3dd7 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:23.008485 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ff6fe680-e4c3-4390-aa9c-65835c7a3dd7 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:23.009598 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ff6fe680-e4c3-4390-aa9c-65835c7a3dd7 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:23.010064 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ff6fe680-e4c3-4390-aa9c-65835c7a3dd7 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:23.464449 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ff6fe680-e4c3-4390-aa9c-65835c7a3dd7 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d5bd2da034c0a916c92cfada76f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e251487dbdd4ceea1446f703b8b1e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:23.479767 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ff6fe680-e4c3-4390-aa9c-65835c7a3dd7 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] 10.222.0.35 "GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7" status: 200 len: 1457 microversion: 2.1 time: 0.512418 Jun 10 18:23:23.494898 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2753/5552] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:22 2022] GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7 => generated 1457 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:23.505708 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a9565a1d-bd28-47b8-af49-44007601d271 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:23.509552 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a9565a1d-bd28-47b8-af49-44007601d271 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] [instance: 1c3ad389-7452-4525-a7b3-02b207d522a7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:23.532073 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a9565a1d-bd28-47b8-af49-44007601d271 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:23.532568 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a9565a1d-bd28-47b8-af49-44007601d271 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:23.533359 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a9565a1d-bd28-47b8-af49-44007601d271 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:23.545015 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a9565a1d-bd28-47b8-af49-44007601d271 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:23.681923 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-48fcd6e2-2dc8-486e-80a6-1458e357c273 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:23:23.683861 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-48fcd6e2-2dc8-486e-80a6-1458e357c273 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:23:23.684488 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-48fcd6e2-2dc8-486e-80a6-1458e357c273 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:23:23.685035 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-48fcd6e2-2dc8-486e-80a6-1458e357c273 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:23:23.690412 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-48fcd6e2-2dc8-486e-80a6-1458e357c273 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:23:23.711559 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-48fcd6e2-2dc8-486e-80a6-1458e357c273 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:23.712018 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-48fcd6e2-2dc8-486e-80a6-1458e357c273 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:23.715575 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-48fcd6e2-2dc8-486e-80a6-1458e357c273 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:23.716041 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-48fcd6e2-2dc8-486e-80a6-1458e357c273 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:23.735480 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-48fcd6e2-2dc8-486e-80a6-1458e357c273 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Getting quotas for project 886b72a54e9b4ee7aa3cc21da4145cbb. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:23:23.741393 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-48fcd6e2-2dc8-486e-80a6-1458e357c273 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Getting quotas for user f62326a9deb140e891c07529dc021d11 and project 886b72a54e9b4ee7aa3cc21da4145cbb. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:23:23.776270 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-48fcd6e2-2dc8-486e-80a6-1458e357c273 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:23:23.783704 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-48fcd6e2-2dc8-486e-80a6-1458e357c273 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:23:23.928909 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-48fcd6e2-2dc8-486e-80a6-1458e357c273 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.827789 Jun 10 18:23:23.930209 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2800/5553] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:23:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 1831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:23:23.935722 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4907482b-588e-4b88-9ec2-584368aa9b2a tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:23.938435 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4907482b-588e-4b88-9ec2-584368aa9b2a tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:23.946190 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4907482b-588e-4b88-9ec2-584368aa9b2a tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:23.947940 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4907482b-588e-4b88-9ec2-584368aa9b2a tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:23.949684 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4907482b-588e-4b88-9ec2-584368aa9b2a tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:23.950391 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4907482b-588e-4b88-9ec2-584368aa9b2a tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:24.123345 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a9565a1d-bd28-47b8-af49-44007601d271 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d5bd2da034c0a916c92cfada76f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e251487dbdd4ceea1446f703b8b1e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:24.140444 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a9565a1d-bd28-47b8-af49-44007601d271 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] 10.222.0.35 "GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7" status: 200 len: 1457 microversion: 2.1 time: 0.639358 Jun 10 18:23:24.141642 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2754/5554] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:23 2022] GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7 => generated 1457 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:24.157666 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c7ef7542-5e84-4c8c-8920-13c27d57c4fb tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:24.160045 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c7ef7542-5e84-4c8c-8920-13c27d57c4fb tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:24.186343 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4907482b-588e-4b88-9ec2-584368aa9b2a tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:24.205859 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4907482b-588e-4b88-9ec2-584368aa9b2a tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 200 len: 1272 microversion: 2.1 time: 0.270061 Jun 10 18:23:24.209248 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2801/5555] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:23 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 1272 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:24.342744 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c7ef7542-5e84-4c8c-8920-13c27d57c4fb tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:24.353751 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c7ef7542-5e84-4c8c-8920-13c27d57c4fb tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2" status: 200 len: 1242 microversion: 2.1 time: 0.199803 Jun 10 18:23:24.354359 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2755/5556] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:24 2022] GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2 => generated 1242 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:25.223663 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-332d6b8a-f35b-42dd-9145-ebec9c0b6380 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:25.225906 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-332d6b8a-f35b-42dd-9145-ebec9c0b6380 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:25.235787 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:23:25.238867 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-332d6b8a-f35b-42dd-9145-ebec9c0b6380 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:25.242397 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-332d6b8a-f35b-42dd-9145-ebec9c0b6380 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:25.245414 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-332d6b8a-f35b-42dd-9145-ebec9c0b6380 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:25.246174 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-332d6b8a-f35b-42dd-9145-ebec9c0b6380 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:25.371493 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-93ebce5a-a20c-4d61-bb6c-a9b61597b0d3 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:25.380104 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-93ebce5a-a20c-4d61-bb6c-a9b61597b0d3 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:25.421690 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-332d6b8a-f35b-42dd-9145-ebec9c0b6380 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:25.442480 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-332d6b8a-f35b-42dd-9145-ebec9c0b6380 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 200 len: 1272 microversion: 2.1 time: 0.220776 Jun 10 18:23:25.466460 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2802/5557] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:25 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 1272 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:25.652808 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-93ebce5a-a20c-4d61-bb6c-a9b61597b0d3 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:25.662382 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-93ebce5a-a20c-4d61-bb6c-a9b61597b0d3 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2" status: 200 len: 1242 microversion: 2.1 time: 0.294684 Jun 10 18:23:25.664982 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2756/5558] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:25 2022] GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2 => generated 1242 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:26.462748 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a50e1cec-e766-4d8d-a5c4-02e065ba2358 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:26.463515 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a50e1cec-e766-4d8d-a5c4-02e065ba2358 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:26.475251 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a50e1cec-e766-4d8d-a5c4-02e065ba2358 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:26.475718 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a50e1cec-e766-4d8d-a5c4-02e065ba2358 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:26.481076 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a50e1cec-e766-4d8d-a5c4-02e065ba2358 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:26.481532 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a50e1cec-e766-4d8d-a5c4-02e065ba2358 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:26.683466 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c1a942fe-c451-437f-bf62-7540ab632c73 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:26.684089 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c1a942fe-c451-437f-bf62-7540ab632c73 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:26.705603 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c1a942fe-c451-437f-bf62-7540ab632c73 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:26.706370 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c1a942fe-c451-437f-bf62-7540ab632c73 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:26.707612 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c1a942fe-c451-437f-bf62-7540ab632c73 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:26.708270 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c1a942fe-c451-437f-bf62-7540ab632c73 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:26.890415 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c1a942fe-c451-437f-bf62-7540ab632c73 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:26.896347 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c1a942fe-c451-437f-bf62-7540ab632c73 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2" status: 200 len: 1294 microversion: 2.1 time: 0.217315 Jun 10 18:23:26.896945 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2757/5559] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:26 2022] GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2 => generated 1294 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:23:27.359704 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a50e1cec-e766-4d8d-a5c4-02e065ba2358 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:27.369114 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a50e1cec-e766-4d8d-a5c4-02e065ba2358 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 200 len: 1314 microversion: 2.1 time: 0.910196 Jun 10 18:23:27.373149 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2803/5560] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:26 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 1314 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:27.916121 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-063b8bb8-9fcb-4240-a69b-3012ed538544 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:27.921878 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-063b8bb8-9fcb-4240-a69b-3012ed538544 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:27.942634 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-063b8bb8-9fcb-4240-a69b-3012ed538544 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:27.943488 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-063b8bb8-9fcb-4240-a69b-3012ed538544 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:27.948015 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-063b8bb8-9fcb-4240-a69b-3012ed538544 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:27.961217 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-063b8bb8-9fcb-4240-a69b-3012ed538544 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:28.253489 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-063b8bb8-9fcb-4240-a69b-3012ed538544 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:28.284771 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-063b8bb8-9fcb-4240-a69b-3012ed538544 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2" status: 200 len: 1300 microversion: 2.1 time: 0.366376 Jun 10 18:23:28.305844 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2758/5561] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:27 2022] GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2 => generated 1300 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:28.389928 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b9749b7c-13d0-412d-8f34-12bdf701a52e tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:28.391375 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b9749b7c-13d0-412d-8f34-12bdf701a52e tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:28.414857 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9749b7c-13d0-412d-8f34-12bdf701a52e tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:28.420722 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9749b7c-13d0-412d-8f34-12bdf701a52e tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:28.424798 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9749b7c-13d0-412d-8f34-12bdf701a52e tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:28.425510 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9749b7c-13d0-412d-8f34-12bdf701a52e tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:29.304852 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b7a4ed11-0cf9-4223-aaf0-d2f03e5f328d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:29.306038 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b7a4ed11-0cf9-4223-aaf0-d2f03e5f328d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:29.324379 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b7a4ed11-0cf9-4223-aaf0-d2f03e5f328d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:29.330775 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b7a4ed11-0cf9-4223-aaf0-d2f03e5f328d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:29.332741 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b7a4ed11-0cf9-4223-aaf0-d2f03e5f328d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:29.333361 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b7a4ed11-0cf9-4223-aaf0-d2f03e5f328d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:29.380257 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b9749b7c-13d0-412d-8f34-12bdf701a52e tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:29.427860 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b9749b7c-13d0-412d-8f34-12bdf701a52e tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 200 len: 1314 microversion: 2.1 time: 1.024522 Jun 10 18:23:29.430528 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2804/5562] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:28 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 1314 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:29.551458 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b7a4ed11-0cf9-4223-aaf0-d2f03e5f328d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:29.564185 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b7a4ed11-0cf9-4223-aaf0-d2f03e5f328d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2" status: 200 len: 1300 microversion: 2.1 time: 0.262042 Jun 10 18:23:29.565839 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2759/5563] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:29 2022] GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2 => generated 1300 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:23:29.789240 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-450c5b57-2588-4053-9139-e3eecc294047 req-e82794ff-ed0a-43dc-b457-2a7e10680d23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3d8c0db-4887-474c-84be-3e1185919607", "tag": "805f38ac-b9e3-44e6-9b01-743b5b810530"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:23:29.811553 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-450c5b57-2588-4053-9139-e3eecc294047 req-e82794ff-ed0a-43dc-b457-2a7e10680d23 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:29.817495 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-450c5b57-2588-4053-9139-e3eecc294047 req-e82794ff-ed0a-43dc-b457-2a7e10680d23 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:29.901259 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-450c5b57-2588-4053-9139-e3eecc294047 req-e82794ff-ed0a-43dc-b457-2a7e10680d23 service nova] Creating event network-changed:805f38ac-b9e3-44e6-9b01-743b5b810530 for instance e3d8c0db-4887-474c-84be-3e1185919607 on chh1-master-2 Jun 10 18:23:29.922325 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-450c5b57-2588-4053-9139-e3eecc294047 req-e82794ff-ed0a-43dc-b457-2a7e10680d23 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142276 Jun 10 18:23:29.924065 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2805/5564] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:23:30.447930 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c2d6e214-f990-419b-bc03-3b41dbf6025b tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:30.448702 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c2d6e214-f990-419b-bc03-3b41dbf6025b tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:30.459874 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c2d6e214-f990-419b-bc03-3b41dbf6025b tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:30.460361 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c2d6e214-f990-419b-bc03-3b41dbf6025b tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:30.464174 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c2d6e214-f990-419b-bc03-3b41dbf6025b tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:30.464174 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c2d6e214-f990-419b-bc03-3b41dbf6025b tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:30.587425 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-47a1f774-3434-435b-ad42-127aaa1ed3b1 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:30.588146 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-47a1f774-3434-435b-ad42-127aaa1ed3b1 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:30.605639 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-47a1f774-3434-435b-ad42-127aaa1ed3b1 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:30.606301 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-47a1f774-3434-435b-ad42-127aaa1ed3b1 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:30.607943 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-47a1f774-3434-435b-ad42-127aaa1ed3b1 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:30.608815 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-47a1f774-3434-435b-ad42-127aaa1ed3b1 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:30.786034 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-47a1f774-3434-435b-ad42-127aaa1ed3b1 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:30.802949 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-47a1f774-3434-435b-ad42-127aaa1ed3b1 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2" status: 200 len: 1300 microversion: 2.1 time: 0.220162 Jun 10 18:23:30.803812 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2806/5565] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:30 2022] GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2 => generated 1300 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:23:31.680962 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c2d6e214-f990-419b-bc03-3b41dbf6025b tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:31.696668 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c2d6e214-f990-419b-bc03-3b41dbf6025b tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 200 len: 1314 microversion: 2.1 time: 1.252775 Jun 10 18:23:31.706961 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2760/5566] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:30 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 1314 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:31.833893 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6d784c85-cd14-41c5-a3ea-ff371f983c46 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:31.837365 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6d784c85-cd14-41c5-a3ea-ff371f983c46 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:31.852433 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6d784c85-cd14-41c5-a3ea-ff371f983c46 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:31.853834 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6d784c85-cd14-41c5-a3ea-ff371f983c46 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:31.855595 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6d784c85-cd14-41c5-a3ea-ff371f983c46 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:31.856263 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6d784c85-cd14-41c5-a3ea-ff371f983c46 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:32.070081 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6d784c85-cd14-41c5-a3ea-ff371f983c46 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:32.085986 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6d784c85-cd14-41c5-a3ea-ff371f983c46 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2" status: 200 len: 1300 microversion: 2.1 time: 0.266626 Jun 10 18:23:32.088202 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2807/5567] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:31 2022] GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2 => generated 1300 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:32.131801 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-9698c27c-5b8e-4a5e-8bdd-bc324c390963 req-49d278b1-3ac0-4c38-a3af-fc67c8208d18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c3ad389-7452-4525-a7b3-02b207d522a7", "tag": "8a575c3a-d4a6-48bb-827e-0f068f5806e1"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:23:32.143610 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-9698c27c-5b8e-4a5e-8bdd-bc324c390963 req-49d278b1-3ac0-4c38-a3af-fc67c8208d18 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:32.148473 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-9698c27c-5b8e-4a5e-8bdd-bc324c390963 req-49d278b1-3ac0-4c38-a3af-fc67c8208d18 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:32.175636 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-9698c27c-5b8e-4a5e-8bdd-bc324c390963 req-49d278b1-3ac0-4c38-a3af-fc67c8208d18 service nova] Creating event network-changed:8a575c3a-d4a6-48bb-827e-0f068f5806e1 for instance 1c3ad389-7452-4525-a7b3-02b207d522a7 on chh2-master-2 Jun 10 18:23:32.185737 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-9698c27c-5b8e-4a5e-8bdd-bc324c390963 req-49d278b1-3ac0-4c38-a3af-fc67c8208d18 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058012 Jun 10 18:23:32.188716 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2761/5568] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:23:32.716198 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cd92da96-02fc-4d1b-aee9-f92b52761729 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:32.717778 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cd92da96-02fc-4d1b-aee9-f92b52761729 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:32.736031 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cd92da96-02fc-4d1b-aee9-f92b52761729 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:32.741300 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cd92da96-02fc-4d1b-aee9-f92b52761729 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:32.742632 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cd92da96-02fc-4d1b-aee9-f92b52761729 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:32.743363 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cd92da96-02fc-4d1b-aee9-f92b52761729 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:33.106604 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-628fb19f-0a18-430f-8b1c-dba9128be39c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:33.107356 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-628fb19f-0a18-430f-8b1c-dba9128be39c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:33.124683 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-628fb19f-0a18-430f-8b1c-dba9128be39c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:33.143752 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-628fb19f-0a18-430f-8b1c-dba9128be39c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:33.143752 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-628fb19f-0a18-430f-8b1c-dba9128be39c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:33.143752 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-628fb19f-0a18-430f-8b1c-dba9128be39c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:33.725086 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=4 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:23:33.762046 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=20 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:23:34.058438 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cd92da96-02fc-4d1b-aee9-f92b52761729 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:34.071456 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cd92da96-02fc-4d1b-aee9-f92b52761729 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 200 len: 1314 microversion: 2.1 time: 1.360896 Jun 10 18:23:34.086229 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2808/5569] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:32 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 1314 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:34.460840 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-628fb19f-0a18-430f-8b1c-dba9128be39c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:34.477687 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-628fb19f-0a18-430f-8b1c-dba9128be39c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2" status: 200 len: 1368 microversion: 2.1 time: 1.375242 Jun 10 18:23:34.489912 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2762/5570] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:33 2022] GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2 => generated 1368 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:35.092890 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7ff3e999-e6b9-4bd6-8ea1-9cdf2092806b tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:35.094840 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7ff3e999-e6b9-4bd6-8ea1-9cdf2092806b tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:35.112052 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ff3e999-e6b9-4bd6-8ea1-9cdf2092806b tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:35.114051 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ff3e999-e6b9-4bd6-8ea1-9cdf2092806b tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:35.115099 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ff3e999-e6b9-4bd6-8ea1-9cdf2092806b tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:35.115724 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ff3e999-e6b9-4bd6-8ea1-9cdf2092806b tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:35.595825 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-552ab128-d590-44af-ab84-a86bfdea87e6 req-4855845f-214a-4f53-ac13-9865044c165d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c3ad389-7452-4525-a7b3-02b207d522a7", "tag": "8a575c3a-d4a6-48bb-827e-0f068f5806e1"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:23:35.618317 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-552ab128-d590-44af-ab84-a86bfdea87e6 req-4855845f-214a-4f53-ac13-9865044c165d service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:35.618916 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-552ab128-d590-44af-ab84-a86bfdea87e6 req-4855845f-214a-4f53-ac13-9865044c165d service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:35.659078 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-552ab128-d590-44af-ab84-a86bfdea87e6 req-4855845f-214a-4f53-ac13-9865044c165d service nova] Creating event network-changed:8a575c3a-d4a6-48bb-827e-0f068f5806e1 for instance 1c3ad389-7452-4525-a7b3-02b207d522a7 on chh2-master-2 Jun 10 18:23:35.667224 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:23:35.674576 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-552ab128-d590-44af-ab84-a86bfdea87e6 req-4855845f-214a-4f53-ac13-9865044c165d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.251099 Jun 10 18:23:35.676677 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2763/5571] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:23:35.694330 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3a7d9496-f202-4825-ae6b-04e37045e508 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:35.697006 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3a7d9496-f202-4825-ae6b-04e37045e508 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:35.717090 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3a7d9496-f202-4825-ae6b-04e37045e508 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:35.718794 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3a7d9496-f202-4825-ae6b-04e37045e508 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:35.719844 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3a7d9496-f202-4825-ae6b-04e37045e508 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:35.722859 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3a7d9496-f202-4825-ae6b-04e37045e508 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:36.080960 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7ff3e999-e6b9-4bd6-8ea1-9cdf2092806b tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:36.100482 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7ff3e999-e6b9-4bd6-8ea1-9cdf2092806b tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 200 len: 1314 microversion: 2.1 time: 1.010318 Jun 10 18:23:36.103645 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2809/5572] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:35 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 1314 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:36.790522 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3a7d9496-f202-4825-ae6b-04e37045e508 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:36.798625 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3a7d9496-f202-4825-ae6b-04e37045e508 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2" status: 200 len: 1368 microversion: 2.1 time: 1.119020 Jun 10 18:23:36.805441 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2764/5573] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:35 2022] GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2 => generated 1368 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:37.121078 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-06f4a5d5-d873-4d30-ab22-9a5ca078e1d2 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:37.122721 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-06f4a5d5-d873-4d30-ab22-9a5ca078e1d2 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:37.146507 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-06f4a5d5-d873-4d30-ab22-9a5ca078e1d2 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:37.146507 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-06f4a5d5-d873-4d30-ab22-9a5ca078e1d2 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:37.146962 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-06f4a5d5-d873-4d30-ab22-9a5ca078e1d2 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:37.147299 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-06f4a5d5-d873-4d30-ab22-9a5ca078e1d2 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:37.463157 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-1ce95e1b-50bb-494d-a25e-46eafe4282b2 req-790e24e3-6a70-4faf-b546-ffa5f66f48e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fa247cf-f328-4ddf-b72c-2cde38330ed2", "tag": "886ad63d-8536-4a5b-9f2e-587adedcb8b4"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:23:37.482719 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-1ce95e1b-50bb-494d-a25e-46eafe4282b2 req-790e24e3-6a70-4faf-b546-ffa5f66f48e3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:37.489984 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-1ce95e1b-50bb-494d-a25e-46eafe4282b2 req-790e24e3-6a70-4faf-b546-ffa5f66f48e3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:37.553070 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-1ce95e1b-50bb-494d-a25e-46eafe4282b2 req-790e24e3-6a70-4faf-b546-ffa5f66f48e3 service nova] Creating event network-changed:886ad63d-8536-4a5b-9f2e-587adedcb8b4 for instance 0fa247cf-f328-4ddf-b72c-2cde38330ed2 on chh2-master-2 Jun 10 18:23:37.557231 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-1ce95e1b-50bb-494d-a25e-46eafe4282b2 req-790e24e3-6a70-4faf-b546-ffa5f66f48e3 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098271 Jun 10 18:23:37.561727 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2765/5574] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:23:37.823715 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b90cf6e1-5a5a-4064-87ba-796e6d1c17ff tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:37.833428 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b90cf6e1-5a5a-4064-87ba-796e6d1c17ff tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:37.841742 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b90cf6e1-5a5a-4064-87ba-796e6d1c17ff tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:37.845353 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b90cf6e1-5a5a-4064-87ba-796e6d1c17ff tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:37.849198 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b90cf6e1-5a5a-4064-87ba-796e6d1c17ff tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:37.849873 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b90cf6e1-5a5a-4064-87ba-796e6d1c17ff tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:38.382818 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b90cf6e1-5a5a-4064-87ba-796e6d1c17ff tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:38.391990 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b90cf6e1-5a5a-4064-87ba-796e6d1c17ff tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2" status: 200 len: 1368 microversion: 2.1 time: 0.573723 Jun 10 18:23:38.403103 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2766/5575] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:37 2022] GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2 => generated 1368 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:23:38.417080 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-f6037e60-1b65-46b4-935b-966c6c7c1093 req-c3032299-cd4a-4184-88bf-8ac94cbc56cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c3ad389-7452-4525-a7b3-02b207d522a7", "tag": "8a575c3a-d4a6-48bb-827e-0f068f5806e1"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:23:38.468299 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-f6037e60-1b65-46b4-935b-966c6c7c1093 req-c3032299-cd4a-4184-88bf-8ac94cbc56cd service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:38.469984 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-f6037e60-1b65-46b4-935b-966c6c7c1093 req-c3032299-cd4a-4184-88bf-8ac94cbc56cd service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:38.496640 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-06f4a5d5-d873-4d30-ab22-9a5ca078e1d2 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:38.510624 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-f6037e60-1b65-46b4-935b-966c6c7c1093 req-c3032299-cd4a-4184-88bf-8ac94cbc56cd service nova] Creating event network-changed:8a575c3a-d4a6-48bb-827e-0f068f5806e1 for instance 1c3ad389-7452-4525-a7b3-02b207d522a7 on chh2-master-2 Jun 10 18:23:38.513587 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-06f4a5d5-d873-4d30-ab22-9a5ca078e1d2 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 200 len: 1314 microversion: 2.1 time: 1.394238 Jun 10 18:23:38.515047 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2810/5576] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:37 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 1314 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:38.521944 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-f6037e60-1b65-46b4-935b-966c6c7c1093 req-c3032299-cd4a-4184-88bf-8ac94cbc56cd service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117462 Jun 10 18:23:38.526285 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2767/5577] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:23:38.621299 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-fe83cd58-7c46-4410-a089-b812ebaa0d5e req-ee042ac3-c9df-4449-b622-7ac774da191d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3d8c0db-4887-474c-84be-3e1185919607", "name": "network-vif-plugged", "status": "completed", "tag": "805f38ac-b9e3-44e6-9b01-743b5b810530"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:23:38.636167 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-fe83cd58-7c46-4410-a089-b812ebaa0d5e req-ee042ac3-c9df-4449-b622-7ac774da191d service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:38.638473 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-fe83cd58-7c46-4410-a089-b812ebaa0d5e req-ee042ac3-c9df-4449-b622-7ac774da191d service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:38.665951 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-fe83cd58-7c46-4410-a089-b812ebaa0d5e req-ee042ac3-c9df-4449-b622-7ac774da191d service nova] Creating event network-vif-plugged:805f38ac-b9e3-44e6-9b01-743b5b810530 for instance e3d8c0db-4887-474c-84be-3e1185919607 on chh1-master-2 Jun 10 18:23:38.675231 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-fe83cd58-7c46-4410-a089-b812ebaa0d5e req-ee042ac3-c9df-4449-b622-7ac774da191d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059466 Jun 10 18:23:38.678706 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2811/5578] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:23:39.425733 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0097b358-4848-42d6-b6f9-604c7792c292 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:39.427722 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0097b358-4848-42d6-b6f9-604c7792c292 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:39.452882 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0097b358-4848-42d6-b6f9-604c7792c292 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:39.453559 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0097b358-4848-42d6-b6f9-604c7792c292 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:39.454453 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0097b358-4848-42d6-b6f9-604c7792c292 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:39.455104 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0097b358-4848-42d6-b6f9-604c7792c292 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:39.536296 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c0cad684-d4f7-4406-a12d-ff4a5014330c tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:39.537042 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c0cad684-d4f7-4406-a12d-ff4a5014330c tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:39.548449 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c0cad684-d4f7-4406-a12d-ff4a5014330c tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:39.549118 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c0cad684-d4f7-4406-a12d-ff4a5014330c tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:39.550117 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c0cad684-d4f7-4406-a12d-ff4a5014330c tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:39.551355 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c0cad684-d4f7-4406-a12d-ff4a5014330c tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:39.768689 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c0cad684-d4f7-4406-a12d-ff4a5014330c tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:39.791162 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c0cad684-d4f7-4406-a12d-ff4a5014330c tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 200 len: 1314 microversion: 2.1 time: 0.262922 Jun 10 18:23:39.792013 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2812/5579] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:39 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:40.019809 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0097b358-4848-42d6-b6f9-604c7792c292 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:40.028441 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0097b358-4848-42d6-b6f9-604c7792c292 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2" status: 200 len: 1368 microversion: 2.1 time: 0.609631 Jun 10 18:23:40.037368 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2768/5580] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:39 2022] GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2 => generated 1368 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:40.809599 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-25fe3df4-cb68-425b-909d-0b7316e6c759 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:40.810931 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-25fe3df4-cb68-425b-909d-0b7316e6c759 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:40.825913 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-25fe3df4-cb68-425b-909d-0b7316e6c759 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:40.826823 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-25fe3df4-cb68-425b-909d-0b7316e6c759 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:40.827866 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-25fe3df4-cb68-425b-909d-0b7316e6c759 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:40.830016 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-25fe3df4-cb68-425b-909d-0b7316e6c759 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:40.904361 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:23:41.046355 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-faf32d83-cc4e-4eb6-a9e0-02ff75930357 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:41.047354 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-faf32d83-cc4e-4eb6-a9e0-02ff75930357 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:41.060125 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-faf32d83-cc4e-4eb6-a9e0-02ff75930357 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:41.064017 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-faf32d83-cc4e-4eb6-a9e0-02ff75930357 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:41.064017 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-faf32d83-cc4e-4eb6-a9e0-02ff75930357 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:41.066625 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-faf32d83-cc4e-4eb6-a9e0-02ff75930357 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:41.228013 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-25fe3df4-cb68-425b-909d-0b7316e6c759 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:41.239394 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-25fe3df4-cb68-425b-909d-0b7316e6c759 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 200 len: 1500 microversion: 2.1 time: 0.433548 Jun 10 18:23:41.240342 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2813/5581] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:40 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 1500 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:41.258112 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-57f80945-405c-450c-9721-1a5833dc14c9 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:23:41.259776 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-57f80945-405c-450c-9721-1a5833dc14c9 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:41.279033 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-57f80945-405c-450c-9721-1a5833dc14c9 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:41.280518 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-57f80945-405c-450c-9721-1a5833dc14c9 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:41.283135 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-57f80945-405c-450c-9721-1a5833dc14c9 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:41.283823 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-57f80945-405c-450c-9721-1a5833dc14c9 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:41.348258 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-57f80945-405c-450c-9721-1a5833dc14c9 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lazy-loading 'flavor' on Instance uuid e3d8c0db-4887-474c-84be-3e1185919607 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:23:41.716030 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-57f80945-405c-450c-9721-1a5833dc14c9 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "POST /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607/action" status: 200 len: 32 microversion: 2.1 time: 0.459297 Jun 10 18:23:41.717334 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2814/5582] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:23:41 2022] POST /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607/action => generated 32 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:23:41.753889 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a68f0f78-f259-4c73-b30b-4389c9c1e28c tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:41.754799 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a68f0f78-f259-4c73-b30b-4389c9c1e28c tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:41.777966 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a68f0f78-f259-4c73-b30b-4389c9c1e28c tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:41.778431 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a68f0f78-f259-4c73-b30b-4389c9c1e28c tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:41.779519 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a68f0f78-f259-4c73-b30b-4389c9c1e28c tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:41.780144 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a68f0f78-f259-4c73-b30b-4389c9c1e28c tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:42.281899 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a68f0f78-f259-4c73-b30b-4389c9c1e28c tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:42.291540 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a68f0f78-f259-4c73-b30b-4389c9c1e28c tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 200 len: 1506 microversion: 2.1 time: 0.566305 Jun 10 18:23:42.292897 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2815/5583] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:41 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 1506 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:42.331474 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-faf32d83-cc4e-4eb6-a9e0-02ff75930357 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:42.339870 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-faf32d83-cc4e-4eb6-a9e0-02ff75930357 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2" status: 200 len: 1368 microversion: 2.1 time: 1.297662 Jun 10 18:23:42.344295 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2769/5584] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:41 2022] GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2 => generated 1368 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:23:43.321680 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ea671e32-d4df-4195-82f7-1975bc51bd0a tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:43.324410 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ea671e32-d4df-4195-82f7-1975bc51bd0a tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:43.339833 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ea671e32-d4df-4195-82f7-1975bc51bd0a tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:43.341249 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ea671e32-d4df-4195-82f7-1975bc51bd0a tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:43.355996 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ea671e32-d4df-4195-82f7-1975bc51bd0a tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:43.355996 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ea671e32-d4df-4195-82f7-1975bc51bd0a tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:43.372032 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0b09e976-4e86-4214-a274-e9db8eaed784 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:43.375413 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0b09e976-4e86-4214-a274-e9db8eaed784 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:43.387338 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0b09e976-4e86-4214-a274-e9db8eaed784 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:43.388065 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0b09e976-4e86-4214-a274-e9db8eaed784 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:43.391374 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0b09e976-4e86-4214-a274-e9db8eaed784 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:43.392025 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0b09e976-4e86-4214-a274-e9db8eaed784 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:43.598082 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0b09e976-4e86-4214-a274-e9db8eaed784 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:43.611302 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0b09e976-4e86-4214-a274-e9db8eaed784 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2" status: 200 len: 1368 microversion: 2.1 time: 0.249871 Jun 10 18:23:43.611916 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2770/5585] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:43 2022] GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2 => generated 1368 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:43.686745 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ea671e32-d4df-4195-82f7-1975bc51bd0a tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:43.695437 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ea671e32-d4df-4195-82f7-1975bc51bd0a tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 200 len: 1506 microversion: 2.1 time: 0.383099 Jun 10 18:23:43.696025 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2816/5586] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:43 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 1506 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:44.630179 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2f0de3f9-4ae2-4e35-ad2a-c1add8e220ef tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:44.631388 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2f0de3f9-4ae2-4e35-ad2a-c1add8e220ef tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:44.643526 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2f0de3f9-4ae2-4e35-ad2a-c1add8e220ef tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:44.644602 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2f0de3f9-4ae2-4e35-ad2a-c1add8e220ef tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:44.645381 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2f0de3f9-4ae2-4e35-ad2a-c1add8e220ef tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:44.645850 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2f0de3f9-4ae2-4e35-ad2a-c1add8e220ef tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:44.649402 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:23:44.714568 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7224432f-5e40-4358-be0b-a522b5660f34 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:44.719671 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7224432f-5e40-4358-be0b-a522b5660f34 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:44.724532 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7224432f-5e40-4358-be0b-a522b5660f34 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:44.725006 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7224432f-5e40-4358-be0b-a522b5660f34 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:44.725810 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7224432f-5e40-4358-be0b-a522b5660f34 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:44.729788 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7224432f-5e40-4358-be0b-a522b5660f34 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:44.925510 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2f0de3f9-4ae2-4e35-ad2a-c1add8e220ef tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:44.937507 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2f0de3f9-4ae2-4e35-ad2a-c1add8e220ef tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2" status: 200 len: 1368 microversion: 2.1 time: 0.311688 Jun 10 18:23:44.946037 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2771/5587] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:44 2022] GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2 => generated 1368 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:23:45.111215 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7224432f-5e40-4358-be0b-a522b5660f34 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:45.123049 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7224432f-5e40-4358-be0b-a522b5660f34 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 200 len: 1506 microversion: 2.1 time: 0.413153 Jun 10 18:23:45.124122 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2817/5588] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:44 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 1506 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:45.961706 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6c8f7323-5677-4b95-8da4-a315d9e8ec83 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:45.962528 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6c8f7323-5677-4b95-8da4-a315d9e8ec83 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:45.975401 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6c8f7323-5677-4b95-8da4-a315d9e8ec83 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:45.983129 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6c8f7323-5677-4b95-8da4-a315d9e8ec83 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:45.983129 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6c8f7323-5677-4b95-8da4-a315d9e8ec83 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:45.983129 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6c8f7323-5677-4b95-8da4-a315d9e8ec83 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:46.141296 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-49b5cdce-1176-4042-b264-bed07b30c30a tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:46.142050 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-49b5cdce-1176-4042-b264-bed07b30c30a tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:46.149616 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-49b5cdce-1176-4042-b264-bed07b30c30a tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:46.150133 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-49b5cdce-1176-4042-b264-bed07b30c30a tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:46.151290 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-49b5cdce-1176-4042-b264-bed07b30c30a tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:46.153187 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-49b5cdce-1176-4042-b264-bed07b30c30a tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:46.178291 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6c8f7323-5677-4b95-8da4-a315d9e8ec83 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:46.187666 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6c8f7323-5677-4b95-8da4-a315d9e8ec83 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2" status: 200 len: 1368 microversion: 2.1 time: 0.234279 Jun 10 18:23:46.190678 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2772/5589] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:45 2022] GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2 => generated 1368 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:46.333872 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-49b5cdce-1176-4042-b264-bed07b30c30a tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:46.344125 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-49b5cdce-1176-4042-b264-bed07b30c30a tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 200 len: 1506 microversion: 2.1 time: 0.206864 Jun 10 18:23:46.345672 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2818/5590] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:46 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 1506 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:23:46.867373 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-7e1e4fb9-b669-4b8d-8ae9-42fcc1b2e1ae req-df30249f-07db-4f86-a109-bbc5ee2b923b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fa247cf-f328-4ddf-b72c-2cde38330ed2", "name": "network-vif-plugged", "status": "completed", "tag": "886ad63d-8536-4a5b-9f2e-587adedcb8b4"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:23:46.877233 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-7e1e4fb9-b669-4b8d-8ae9-42fcc1b2e1ae req-df30249f-07db-4f86-a109-bbc5ee2b923b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:46.879966 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-7e1e4fb9-b669-4b8d-8ae9-42fcc1b2e1ae req-df30249f-07db-4f86-a109-bbc5ee2b923b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:46.895118 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-7e1e4fb9-b669-4b8d-8ae9-42fcc1b2e1ae req-df30249f-07db-4f86-a109-bbc5ee2b923b service nova] Creating event network-vif-plugged:886ad63d-8536-4a5b-9f2e-587adedcb8b4 for instance 0fa247cf-f328-4ddf-b72c-2cde38330ed2 on chh2-master-2 Jun 10 18:23:46.901394 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-7e1e4fb9-b669-4b8d-8ae9-42fcc1b2e1ae req-df30249f-07db-4f86-a109-bbc5ee2b923b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107931 Jun 10 18:23:46.902897 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2773/5591] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:23:47.207249 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6a3503d8-4dec-470a-bf26-7dcc3b40872e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:47.215104 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6a3503d8-4dec-470a-bf26-7dcc3b40872e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:47.224039 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6a3503d8-4dec-470a-bf26-7dcc3b40872e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:47.225313 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6a3503d8-4dec-470a-bf26-7dcc3b40872e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:47.226476 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6a3503d8-4dec-470a-bf26-7dcc3b40872e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:47.227411 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6a3503d8-4dec-470a-bf26-7dcc3b40872e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:47.365391 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2b304877-829a-494b-98ae-a0271f8c09c8 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:47.366279 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2b304877-829a-494b-98ae-a0271f8c09c8 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:47.374775 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2b304877-829a-494b-98ae-a0271f8c09c8 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:47.378681 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2b304877-829a-494b-98ae-a0271f8c09c8 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:47.378681 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2b304877-829a-494b-98ae-a0271f8c09c8 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:47.378681 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2b304877-829a-494b-98ae-a0271f8c09c8 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:47.393145 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6a3503d8-4dec-470a-bf26-7dcc3b40872e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:47.416366 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6a3503d8-4dec-470a-bf26-7dcc3b40872e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2" status: 200 len: 1368 microversion: 2.1 time: 0.215107 Jun 10 18:23:47.417733 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2819/5592] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:47 2022] GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2 => generated 1368 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:47.689953 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2b304877-829a-494b-98ae-a0271f8c09c8 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:47.699964 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2b304877-829a-494b-98ae-a0271f8c09c8 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 200 len: 1506 microversion: 2.1 time: 0.341482 Jun 10 18:23:47.706140 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2774/5593] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:47 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 1506 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:23:48.435041 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2cb96351-ab35-4307-9e72-b495176184bf tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:48.435980 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2cb96351-ab35-4307-9e72-b495176184bf tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:48.474215 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2cb96351-ab35-4307-9e72-b495176184bf tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:48.475139 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2cb96351-ab35-4307-9e72-b495176184bf tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:48.479087 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2cb96351-ab35-4307-9e72-b495176184bf tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:48.479087 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2cb96351-ab35-4307-9e72-b495176184bf tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:48.647933 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2cb96351-ab35-4307-9e72-b495176184bf tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:48.662361 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2cb96351-ab35-4307-9e72-b495176184bf tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2" status: 200 len: 1368 microversion: 2.1 time: 0.231421 Jun 10 18:23:48.673464 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2820/5594] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:48 2022] GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2 => generated 1368 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:48.727346 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6ed3a63f-ee60-43b5-80f9-1b9173b264db tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:48.728560 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6ed3a63f-ee60-43b5-80f9-1b9173b264db tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:48.738169 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6ed3a63f-ee60-43b5-80f9-1b9173b264db tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:48.738589 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6ed3a63f-ee60-43b5-80f9-1b9173b264db tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:48.739480 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6ed3a63f-ee60-43b5-80f9-1b9173b264db tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:48.740088 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6ed3a63f-ee60-43b5-80f9-1b9173b264db tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:49.173346 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6ed3a63f-ee60-43b5-80f9-1b9173b264db tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:49.187191 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6ed3a63f-ee60-43b5-80f9-1b9173b264db tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 200 len: 1506 microversion: 2.1 time: 0.469076 Jun 10 18:23:49.189144 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2775/5595] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:48 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 1506 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:49.683423 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-46c651e1-0007-448c-9963-412d72aab55c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:49.684019 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-46c651e1-0007-448c-9963-412d72aab55c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:49.692003 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-46c651e1-0007-448c-9963-412d72aab55c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:49.692779 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-46c651e1-0007-448c-9963-412d72aab55c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:49.693933 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-46c651e1-0007-448c-9963-412d72aab55c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:49.694385 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-46c651e1-0007-448c-9963-412d72aab55c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:49.870921 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-46c651e1-0007-448c-9963-412d72aab55c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:49.880417 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-46c651e1-0007-448c-9963-412d72aab55c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2" status: 200 len: 1559 microversion: 2.1 time: 0.201344 Jun 10 18:23:49.881560 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2821/5596] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:49 2022] GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2 => generated 1559 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:49.900941 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8e77f17b-d1e4-4572-ae3c-8cb8d8e02afa tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:49.902266 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8e77f17b-d1e4-4572-ae3c-8cb8d8e02afa tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:49.910873 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8e77f17b-d1e4-4572-ae3c-8cb8d8e02afa tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:49.911311 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8e77f17b-d1e4-4572-ae3c-8cb8d8e02afa tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:49.912092 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8e77f17b-d1e4-4572-ae3c-8cb8d8e02afa tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:49.912564 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8e77f17b-d1e4-4572-ae3c-8cb8d8e02afa tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:50.091489 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8e77f17b-d1e4-4572-ae3c-8cb8d8e02afa tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.196370 Jun 10 18:23:50.093910 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2776/5597] 10.222.0.35 () {58 vars in 1274 bytes} [Fri Jun 10 18:23:49 2022] GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2/os-interface => generated 285 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:23:50.205865 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ec26a2ce-b5ff-44b1-86a3-e9de145542a4 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:50.206903 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ec26a2ce-b5ff-44b1-86a3-e9de145542a4 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:50.216233 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec26a2ce-b5ff-44b1-86a3-e9de145542a4 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:50.216891 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec26a2ce-b5ff-44b1-86a3-e9de145542a4 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:50.218036 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec26a2ce-b5ff-44b1-86a3-e9de145542a4 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:50.224161 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec26a2ce-b5ff-44b1-86a3-e9de145542a4 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:51.118862 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ec26a2ce-b5ff-44b1-86a3-e9de145542a4 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:51.132040 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ec26a2ce-b5ff-44b1-86a3-e9de145542a4 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 200 len: 1506 microversion: 2.1 time: 0.929455 Jun 10 18:23:51.133789 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2822/5598] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:50 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 1506 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:51.569947 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-743e32bf-1140-431b-80c3-c86db54ec519 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:51.571130 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-743e32bf-1140-431b-80c3-c86db54ec519 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] [instance: 5c01ab04-2d71-48a4-a6e9-cb4416ad7024] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:51.579979 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-743e32bf-1140-431b-80c3-c86db54ec519 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:51.586418 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-743e32bf-1140-431b-80c3-c86db54ec519 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:51.586418 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-743e32bf-1140-431b-80c3-c86db54ec519 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:51.586418 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-743e32bf-1140-431b-80c3-c86db54ec519 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:51.691913 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-743e32bf-1140-431b-80c3-c86db54ec519 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lazy-loading 'services' on Instance uuid 5c01ab04-2d71-48a4-a6e9-cb4416ad7024 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:23:51.997255 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-743e32bf-1140-431b-80c3-c86db54ec519 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] 10.222.0.35 "DELETE /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024/os-volume_attachments/9a8c2c39-2ec8-4100-9fdf-8f8e55d211c2" status: 202 len: 0 microversion: 2.1 time: 0.431834 Jun 10 18:23:51.998051 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2777/5599] 10.222.0.35 () {58 vars in 1415 bytes} [Fri Jun 10 18:23:51 2022] DELETE /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024/os-volume_attachments/9a8c2c39-2ec8-4100-9fdf-8f8e55d211c2 => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:23:52.161713 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c335f591-e3d5-428d-b4b7-bd51008ffc14 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:52.163732 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c335f591-e3d5-428d-b4b7-bd51008ffc14 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:52.173176 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c335f591-e3d5-428d-b4b7-bd51008ffc14 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:52.174068 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c335f591-e3d5-428d-b4b7-bd51008ffc14 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:52.176357 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c335f591-e3d5-428d-b4b7-bd51008ffc14 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:52.177736 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c335f591-e3d5-428d-b4b7-bd51008ffc14 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:52.456873 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c335f591-e3d5-428d-b4b7-bd51008ffc14 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:52.474254 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c335f591-e3d5-428d-b4b7-bd51008ffc14 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 200 len: 1506 microversion: 2.1 time: 0.326065 Jun 10 18:23:52.477728 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2823/5600] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:52 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 1506 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:52.499116 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-bd851270-70bf-412d-84f2-c72635a2862a req-4fda980e-cd5b-469e-913c-ed37a9f5b3a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fa247cf-f328-4ddf-b72c-2cde38330ed2", "tag": "886ad63d-8536-4a5b-9f2e-587adedcb8b4"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:23:52.510985 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-bd851270-70bf-412d-84f2-c72635a2862a req-4fda980e-cd5b-469e-913c-ed37a9f5b3a3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:52.511734 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-bd851270-70bf-412d-84f2-c72635a2862a req-4fda980e-cd5b-469e-913c-ed37a9f5b3a3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:52.529054 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-bd851270-70bf-412d-84f2-c72635a2862a req-4fda980e-cd5b-469e-913c-ed37a9f5b3a3 service nova] Creating event network-changed:886ad63d-8536-4a5b-9f2e-587adedcb8b4 for instance 0fa247cf-f328-4ddf-b72c-2cde38330ed2 on chh2-master-2 Jun 10 18:23:52.537319 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-bd851270-70bf-412d-84f2-c72635a2862a req-4fda980e-cd5b-469e-913c-ed37a9f5b3a3 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046097 Jun 10 18:23:52.540999 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2778/5601] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:23:53.495734 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-210a312b-3aa4-452e-8f15-44559c66e513 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:53.496374 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-210a312b-3aa4-452e-8f15-44559c66e513 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:53.505859 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-210a312b-3aa4-452e-8f15-44559c66e513 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:53.506612 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-210a312b-3aa4-452e-8f15-44559c66e513 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:53.513765 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-210a312b-3aa4-452e-8f15-44559c66e513 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:53.513765 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-210a312b-3aa4-452e-8f15-44559c66e513 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:54.753753 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-210a312b-3aa4-452e-8f15-44559c66e513 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:54.764298 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-210a312b-3aa4-452e-8f15-44559c66e513 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 200 len: 1506 microversion: 2.1 time: 1.273620 Jun 10 18:23:54.774794 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2824/5602] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:53 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 1506 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:55.784470 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5261f551-2c75-4b5d-b1b6-c2cb26d56b66 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:55.785137 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5261f551-2c75-4b5d-b1b6-c2cb26d56b66 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:55.792635 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=58 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:23:55.799354 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5261f551-2c75-4b5d-b1b6-c2cb26d56b66 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:55.799820 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5261f551-2c75-4b5d-b1b6-c2cb26d56b66 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:55.804522 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5261f551-2c75-4b5d-b1b6-c2cb26d56b66 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:55.806980 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5261f551-2c75-4b5d-b1b6-c2cb26d56b66 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:56.083214 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5261f551-2c75-4b5d-b1b6-c2cb26d56b66 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:56.093856 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5261f551-2c75-4b5d-b1b6-c2cb26d56b66 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 200 len: 1506 microversion: 2.1 time: 0.314791 Jun 10 18:23:56.094818 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2779/5603] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:55 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 1506 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:57.115007 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-abce2c72-a4b5-4a96-80e6-ce1a6ed8041d tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:57.115766 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-abce2c72-a4b5-4a96-80e6-ce1a6ed8041d tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:57.119659 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=46 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:23:57.123988 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-abce2c72-a4b5-4a96-80e6-ce1a6ed8041d tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:57.124502 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-abce2c72-a4b5-4a96-80e6-ce1a6ed8041d tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:57.125281 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-abce2c72-a4b5-4a96-80e6-ce1a6ed8041d tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:57.125937 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-abce2c72-a4b5-4a96-80e6-ce1a6ed8041d tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:57.392977 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-abce2c72-a4b5-4a96-80e6-ce1a6ed8041d tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:57.410727 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-abce2c72-a4b5-4a96-80e6-ce1a6ed8041d tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 200 len: 1506 microversion: 2.1 time: 0.303510 Jun 10 18:23:57.412263 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2825/5604] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:57 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 1506 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:58.431570 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-807ea1d8-670f-4abe-8e7e-3b0fd6d39ba8 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:58.432403 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-807ea1d8-670f-4abe-8e7e-3b0fd6d39ba8 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:58.453188 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-807ea1d8-670f-4abe-8e7e-3b0fd6d39ba8 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:58.453672 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-807ea1d8-670f-4abe-8e7e-3b0fd6d39ba8 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:58.454583 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-807ea1d8-670f-4abe-8e7e-3b0fd6d39ba8 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:58.455054 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-807ea1d8-670f-4abe-8e7e-3b0fd6d39ba8 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:58.843314 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-807ea1d8-670f-4abe-8e7e-3b0fd6d39ba8 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:23:58.858603 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-807ea1d8-670f-4abe-8e7e-3b0fd6d39ba8 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 200 len: 1506 microversion: 2.1 time: 0.428999 Jun 10 18:23:58.860260 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2780/5605] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:58 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 1506 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:23:59.793901 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-eff61e9a-5d46-41e2-9326-b51c8410bd5a tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:59.794745 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-eff61e9a-5d46-41e2-9326-b51c8410bd5a tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] [instance: 5c01ab04-2d71-48a4-a6e9-cb4416ad7024] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:59.828709 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eff61e9a-5d46-41e2-9326-b51c8410bd5a tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:59.829295 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eff61e9a-5d46-41e2-9326-b51c8410bd5a tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:59.830269 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eff61e9a-5d46-41e2-9326-b51c8410bd5a tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:59.830749 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eff61e9a-5d46-41e2-9326-b51c8410bd5a tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:59.887390 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-50fea1f1-f85a-4b86-82db-487a2d0f6471 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:23:59.888618 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-50fea1f1-f85a-4b86-82db-487a2d0f6471 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:23:59.915695 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-50fea1f1-f85a-4b86-82db-487a2d0f6471 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:59.920246 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-50fea1f1-f85a-4b86-82db-487a2d0f6471 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:59.920246 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-50fea1f1-f85a-4b86-82db-487a2d0f6471 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:23:59.920246 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-50fea1f1-f85a-4b86-82db-487a2d0f6471 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:23:59.921674 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-eff61e9a-5d46-41e2-9326-b51c8410bd5a tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] [instance: 5c01ab04-2d71-48a4-a6e9-cb4416ad7024] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:24:00.063798 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:24:00.230199 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-50fea1f1-f85a-4b86-82db-487a2d0f6471 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:00.244571 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-50fea1f1-f85a-4b86-82db-487a2d0f6471 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 200 len: 1506 microversion: 2.1 time: 0.366391 Jun 10 18:24:00.245438 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2781/5606] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:23:59 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 1506 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:24:00.426870 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-eff61e9a-5d46-41e2-9326-b51c8410bd5a tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] 10.222.0.35 "DELETE /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024" status: 204 len: 0 microversion: 2.1 time: 0.636531 Jun 10 18:24:00.429255 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2826/5607] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:23:59 2022] DELETE /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:24:00.437648 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e5b68c31-69e3-4675-9572-e1e6af053e34 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:00.438275 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e5b68c31-69e3-4675-9572-e1e6af053e34 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] [instance: 5c01ab04-2d71-48a4-a6e9-cb4416ad7024] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:00.447019 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e5b68c31-69e3-4675-9572-e1e6af053e34 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:00.454898 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e5b68c31-69e3-4675-9572-e1e6af053e34 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:00.454898 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e5b68c31-69e3-4675-9572-e1e6af053e34 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:00.454898 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e5b68c31-69e3-4675-9572-e1e6af053e34 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:00.652447 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e5b68c31-69e3-4675-9572-e1e6af053e34 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1ae263cdca4d5ebd7384e39ea2e345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618acb9c019f429ea00544496d3d20bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:00.661985 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e5b68c31-69e3-4675-9572-e1e6af053e34 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] 10.222.0.35 "GET /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024" status: 200 len: 1468 microversion: 2.1 time: 0.228423 Jun 10 18:24:00.671923 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2782/5608] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:24:00 2022] GET /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024 => generated 1468 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:24:01.264657 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b8014916-24b8-4396-9bfc-fdf406d145ce tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:01.265386 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b8014916-24b8-4396-9bfc-fdf406d145ce tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:01.275383 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b8014916-24b8-4396-9bfc-fdf406d145ce tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:01.275857 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b8014916-24b8-4396-9bfc-fdf406d145ce tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:01.277460 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b8014916-24b8-4396-9bfc-fdf406d145ce tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:01.277460 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b8014916-24b8-4396-9bfc-fdf406d145ce tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:01.649111 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b8014916-24b8-4396-9bfc-fdf406d145ce tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:01.657070 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b8014916-24b8-4396-9bfc-fdf406d145ce tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 200 len: 1506 microversion: 2.1 time: 0.397816 Jun 10 18:24:01.660048 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2827/5609] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:24:01 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 1506 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:24:01.679738 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-935e8231-fa25-4076-ba4f-c5515a2e5d94 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:01.681042 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-935e8231-fa25-4076-ba4f-c5515a2e5d94 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] [instance: 5c01ab04-2d71-48a4-a6e9-cb4416ad7024] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:01.691329 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-935e8231-fa25-4076-ba4f-c5515a2e5d94 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:01.691799 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-935e8231-fa25-4076-ba4f-c5515a2e5d94 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:01.692639 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-935e8231-fa25-4076-ba4f-c5515a2e5d94 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:01.696721 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-935e8231-fa25-4076-ba4f-c5515a2e5d94 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:02.290227 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-935e8231-fa25-4076-ba4f-c5515a2e5d94 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1ae263cdca4d5ebd7384e39ea2e345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618acb9c019f429ea00544496d3d20bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:02.301816 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-935e8231-fa25-4076-ba4f-c5515a2e5d94 tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] 10.222.0.35 "GET /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024" status: 200 len: 1468 microversion: 2.1 time: 0.626090 Jun 10 18:24:02.306289 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2783/5610] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:24:01 2022] GET /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024 => generated 1468 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:24:02.681268 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f8433bf8-861a-43f4-851f-fe07e8d8bb2f tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:02.714490 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f8433bf8-861a-43f4-851f-fe07e8d8bb2f tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:02.736586 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f8433bf8-861a-43f4-851f-fe07e8d8bb2f tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:02.738296 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f8433bf8-861a-43f4-851f-fe07e8d8bb2f tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:02.739278 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f8433bf8-861a-43f4-851f-fe07e8d8bb2f tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:02.742643 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f8433bf8-861a-43f4-851f-fe07e8d8bb2f tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:03.011411 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f8433bf8-861a-43f4-851f-fe07e8d8bb2f tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:03.048748 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f8433bf8-861a-43f4-851f-fe07e8d8bb2f tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 200 len: 1506 microversion: 2.1 time: 0.373530 Jun 10 18:24:03.060462 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2828/5611] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:24:02 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 1506 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:24:03.095485 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-26d0459f-96fd-48a4-ac8a-497d46d547c9 req-7b0c396c-827e-4355-aac7-a426e8606a9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c01ab04-2d71-48a4-a6e9-cb4416ad7024", "name": "network-vif-deleted", "tag": "c826ab58-b14d-4f40-88dc-1c92b882bf90"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:24:03.116993 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-26d0459f-96fd-48a4-ac8a-497d46d547c9 req-7b0c396c-827e-4355-aac7-a426e8606a9c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:03.117858 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-26d0459f-96fd-48a4-ac8a-497d46d547c9 req-7b0c396c-827e-4355-aac7-a426e8606a9c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:03.150247 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-26d0459f-96fd-48a4-ac8a-497d46d547c9 req-7b0c396c-827e-4355-aac7-a426e8606a9c service nova] Creating event network-vif-deleted:c826ab58-b14d-4f40-88dc-1c92b882bf90 for instance 5c01ab04-2d71-48a4-a6e9-cb4416ad7024 on chh1-master-2 Jun 10 18:24:03.155474 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-26d0459f-96fd-48a4-ac8a-497d46d547c9 req-7b0c396c-827e-4355-aac7-a426e8606a9c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064494 Jun 10 18:24:03.159946 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2784/5612] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:24:03.333201 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-890ea64f-5baf-4d3c-a71c-0a42e8c17abb tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:03.334301 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-890ea64f-5baf-4d3c-a71c-0a42e8c17abb tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] [instance: 5c01ab04-2d71-48a4-a6e9-cb4416ad7024] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:03.345590 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-890ea64f-5baf-4d3c-a71c-0a42e8c17abb tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:03.347076 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-890ea64f-5baf-4d3c-a71c-0a42e8c17abb tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:03.365411 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-890ea64f-5baf-4d3c-a71c-0a42e8c17abb tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:03.368715 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-890ea64f-5baf-4d3c-a71c-0a42e8c17abb tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:03.554315 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-890ea64f-5baf-4d3c-a71c-0a42e8c17abb tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1ae263cdca4d5ebd7384e39ea2e345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618acb9c019f429ea00544496d3d20bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:03.594265 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-890ea64f-5baf-4d3c-a71c-0a42e8c17abb tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] 10.222.0.35 "GET /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024" status: 200 len: 1297 microversion: 2.1 time: 0.242240 Jun 10 18:24:03.604533 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2829/5613] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:24:03 2022] GET /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024 => generated 1297 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:24:04.079854 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b10a6ebb-dbe5-484a-bd6b-d77730574a23 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:04.079854 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b10a6ebb-dbe5-484a-bd6b-d77730574a23 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:04.095111 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b10a6ebb-dbe5-484a-bd6b-d77730574a23 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:04.095505 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b10a6ebb-dbe5-484a-bd6b-d77730574a23 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:04.096869 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b10a6ebb-dbe5-484a-bd6b-d77730574a23 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:04.097423 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b10a6ebb-dbe5-484a-bd6b-d77730574a23 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:04.562330 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b10a6ebb-dbe5-484a-bd6b-d77730574a23 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:04.580961 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b10a6ebb-dbe5-484a-bd6b-d77730574a23 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 200 len: 1506 microversion: 2.1 time: 0.504068 Jun 10 18:24:04.583213 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2785/5614] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:24:04 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 1506 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:24:04.618664 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-80ecd24b-0279-40ef-8707-56b04d95584b tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:04.619289 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-80ecd24b-0279-40ef-8707-56b04d95584b tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] [instance: 5c01ab04-2d71-48a4-a6e9-cb4416ad7024] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:04.629475 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-80ecd24b-0279-40ef-8707-56b04d95584b tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:04.630079 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-80ecd24b-0279-40ef-8707-56b04d95584b tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:04.631024 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-80ecd24b-0279-40ef-8707-56b04d95584b tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:04.631743 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-80ecd24b-0279-40ef-8707-56b04d95584b tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:04.648270 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-80ecd24b-0279-40ef-8707-56b04d95584b tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] HTTP exception thrown: Instance 5c01ab04-2d71-48a4-a6e9-cb4416ad7024 could not be found. Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-80ecd24b-0279-40ef-8707-56b04d95584b tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Request method failure captured: Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024 HTTP/1.1 Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4tqrtVaOzSST4pghbgUbgpRJlHeOtkKmLXj9bxJr78NuQ9zavG2DgsEkxlBOg-H9wPMUofJ3GZtQUCxqtdhY5m2efXDV_hmjxFOcIu8AY6fMs0AhoyY5TjNqT0JHPE1e0eAZ7jXtmHgYUHGX9bXyWD8qMtbQcTicLOEYchqRGEXM5I Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 618acb9c019f429ea00544496d3d20bd Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-VolumesBackupsTest-722346105 Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/618acb9c019f429ea00544496d3d20bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/618acb9c019f429ea00544496d3d20bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/618acb9c019f429ea00544496d3d20bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_618acb9c019f429ea00544496d3d20bd", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-VolumesBackupsTest-722346105 Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 618acb9c019f429ea00544496d3d20bd Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-VolumesBackupsTest-722346105 Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-VolumesBackupsTest-722346105-project Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: cb1ae263cdca4d5ebd7384e39ea2e345 Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-VolumesBackupsTest-722346105-project Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 5c01ab04-2d71-48a4-a6e9-cb4416ad7024 could not be found. Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '5c01ab04-2d71-48a4-a6e9-cb4416ad7024'} Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c01ab04-2d71-48a4-a6e9-cb4416ad7024 could not be found. Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c01ab04-2d71-48a4-a6e9-cb4416ad7024 could not be found. Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:24:04.649551 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:24:04.655397 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:24:04.655397 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:24:04.655397 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:24:04.655397 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:24:04.655397 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:24:04.655397 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c01ab04-2d71-48a4-a6e9-cb4416ad7024 could not be found. Jun 10 18:24:04.655397 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:24:04.655397 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-80ecd24b-0279-40ef-8707-56b04d95584b tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] Returning 404 to user: Instance 5c01ab04-2d71-48a4-a6e9-cb4416ad7024 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:24:04.655397 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-80ecd24b-0279-40ef-8707-56b04d95584b tempest-VolumesBackupsTest-722346105 tempest-VolumesBackupsTest-722346105-project] 10.222.0.35 "GET /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024" status: 404 len: 111 microversion: 2.1 time: 0.036313 Jun 10 18:24:04.655397 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2830/5615] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:24:04 2022] GET /compute/v2.1/servers/5c01ab04-2d71-48a4-a6e9-cb4416ad7024 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:24:04.980338 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5913d6ac-c4b3-4c3f-a480-46751dbe0b19 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:04.981305 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5913d6ac-c4b3-4c3f-a480-46751dbe0b19 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:04.991747 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5913d6ac-c4b3-4c3f-a480-46751dbe0b19 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:04.992798 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5913d6ac-c4b3-4c3f-a480-46751dbe0b19 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:04.993872 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5913d6ac-c4b3-4c3f-a480-46751dbe0b19 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:04.994480 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5913d6ac-c4b3-4c3f-a480-46751dbe0b19 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:05.031813 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5913d6ac-c4b3-4c3f-a480-46751dbe0b19 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa/ips" status: 200 len: 152 microversion: 2.20 time: 0.240191 Jun 10 18:24:05.033247 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2786/5616] 10.222.0.35 () {60 vars in 1288 bytes} [Fri Jun 10 18:24:04 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa/ips => generated 152 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:24:05.600629 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-59bf716b-1a7c-4c4f-8e80-75e39867bebb tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:05.601253 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-59bf716b-1a7c-4c4f-8e80-75e39867bebb tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:05.615384 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-59bf716b-1a7c-4c4f-8e80-75e39867bebb tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:05.615862 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-59bf716b-1a7c-4c4f-8e80-75e39867bebb tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:05.619057 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-59bf716b-1a7c-4c4f-8e80-75e39867bebb tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:05.620160 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-59bf716b-1a7c-4c4f-8e80-75e39867bebb tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:05.945067 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-59bf716b-1a7c-4c4f-8e80-75e39867bebb tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:05.956511 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-59bf716b-1a7c-4c4f-8e80-75e39867bebb tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 200 len: 1506 microversion: 2.1 time: 0.360468 Jun 10 18:24:05.957497 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2831/5617] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:24:05 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 1506 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:24:06.983717 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-40bf606a-43f7-4147-b851-e898e7349c8a tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:06.984446 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-40bf606a-43f7-4147-b851-e898e7349c8a tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:06.992992 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-40bf606a-43f7-4147-b851-e898e7349c8a tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:06.993721 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-40bf606a-43f7-4147-b851-e898e7349c8a tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:06.997365 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-40bf606a-43f7-4147-b851-e898e7349c8a tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:06.997365 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-40bf606a-43f7-4147-b851-e898e7349c8a tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:07.385841 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-40bf606a-43f7-4147-b851-e898e7349c8a tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:07.407384 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-40bf606a-43f7-4147-b851-e898e7349c8a tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 200 len: 1506 microversion: 2.1 time: 0.435624 Jun 10 18:24:07.437432 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2787/5618] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:24:06 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 1506 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:24:08.442031 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9e120eb8-1218-443a-8590-bf2c71086fd5 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:08.442657 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9e120eb8-1218-443a-8590-bf2c71086fd5 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:08.454964 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9e120eb8-1218-443a-8590-bf2c71086fd5 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:08.455428 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9e120eb8-1218-443a-8590-bf2c71086fd5 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:08.456254 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9e120eb8-1218-443a-8590-bf2c71086fd5 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:08.456732 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9e120eb8-1218-443a-8590-bf2c71086fd5 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:08.565390 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2e5ee00d-7cc9-4729-afa3-c7f8745cf813 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:24:08.566670 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2e5ee00d-7cc9-4729-afa3-c7f8745cf813 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:08.574698 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e5ee00d-7cc9-4729-afa3-c7f8745cf813 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:08.575442 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e5ee00d-7cc9-4729-afa3-c7f8745cf813 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:08.576507 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e5ee00d-7cc9-4729-afa3-c7f8745cf813 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:08.577322 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e5ee00d-7cc9-4729-afa3-c7f8745cf813 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:08.607753 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-2e5ee00d-7cc9-4729-afa3-c7f8745cf813 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lazy-loading 'flavor' on Instance uuid b6a3eb83-4aef-446a-a9d5-96d09acb1aaa {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:24:08.639261 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9e120eb8-1218-443a-8590-bf2c71086fd5 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:08.667726 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9e120eb8-1218-443a-8590-bf2c71086fd5 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 200 len: 1506 microversion: 2.1 time: 0.229844 Jun 10 18:24:08.668123 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2832/5619] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:24:08 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 1506 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:24:08.758168 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:24:09.436201 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2e5ee00d-7cc9-4729-afa3-c7f8745cf813 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "POST /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa/action" status: 202 len: 0 microversion: 2.20 time: 0.874703 Jun 10 18:24:09.448174 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2431997d-ddee-415d-b45d-14502a1d0968 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:09.449440 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2431997d-ddee-415d-b45d-14502a1d0968 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:09.452261 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2788/5620] 10.222.0.35 () {62 vars in 1318 bytes} [Fri Jun 10 18:24:08 2022] POST /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa/action => generated 0 bytes in 889 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:24:09.463133 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2431997d-ddee-415d-b45d-14502a1d0968 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:09.466336 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2431997d-ddee-415d-b45d-14502a1d0968 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:09.467801 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2431997d-ddee-415d-b45d-14502a1d0968 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:09.469755 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2431997d-ddee-415d-b45d-14502a1d0968 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:09.691506 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4c083c8e-451b-4777-b699-6449596e4e5e tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:09.694722 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4c083c8e-451b-4777-b699-6449596e4e5e tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:09.709121 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4c083c8e-451b-4777-b699-6449596e4e5e tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:09.709578 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4c083c8e-451b-4777-b699-6449596e4e5e tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:09.710355 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4c083c8e-451b-4777-b699-6449596e4e5e tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:09.710793 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4c083c8e-451b-4777-b699-6449596e4e5e tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:09.876172 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2431997d-ddee-415d-b45d-14502a1d0968 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:09.890583 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2431997d-ddee-415d-b45d-14502a1d0968 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:09.904692 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2431997d-ddee-415d-b45d-14502a1d0968 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:09.904692 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2431997d-ddee-415d-b45d-14502a1d0968 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1725 microversion: 2.20 time: 0.458064 Jun 10 18:24:09.904692 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2833/5621] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:24:09 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1725 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:24:09.986871 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4c083c8e-451b-4777-b699-6449596e4e5e tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:10.003308 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4c083c8e-451b-4777-b699-6449596e4e5e tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 200 len: 1506 microversion: 2.1 time: 0.316839 Jun 10 18:24:10.004556 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2789/5622] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:24:09 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 1506 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:24:10.924909 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-708065b5-23d2-4082-a155-178a291fd042 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:10.926118 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-708065b5-23d2-4082-a155-178a291fd042 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:10.934099 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-708065b5-23d2-4082-a155-178a291fd042 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:10.934558 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-708065b5-23d2-4082-a155-178a291fd042 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:10.935332 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-708065b5-23d2-4082-a155-178a291fd042 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:10.936240 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-708065b5-23d2-4082-a155-178a291fd042 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:11.025501 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-05a780a5-5058-4f9f-bcbf-587075a59395 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:11.026712 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-05a780a5-5058-4f9f-bcbf-587075a59395 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:11.037491 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05a780a5-5058-4f9f-bcbf-587075a59395 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:11.038587 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05a780a5-5058-4f9f-bcbf-587075a59395 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:11.039773 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05a780a5-5058-4f9f-bcbf-587075a59395 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:11.040424 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05a780a5-5058-4f9f-bcbf-587075a59395 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:11.185706 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-708065b5-23d2-4082-a155-178a291fd042 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:11.194151 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-708065b5-23d2-4082-a155-178a291fd042 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:11.195647 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-708065b5-23d2-4082-a155-178a291fd042 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:11.196904 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-708065b5-23d2-4082-a155-178a291fd042 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1725 microversion: 2.20 time: 0.278708 Jun 10 18:24:11.197800 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2834/5623] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:24:10 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1725 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:24:11.333402 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-05a780a5-5058-4f9f-bcbf-587075a59395 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:11.346581 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-05a780a5-5058-4f9f-bcbf-587075a59395 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 200 len: 1506 microversion: 2.1 time: 0.324450 Jun 10 18:24:11.348544 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2790/5624] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:24:11 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 1506 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:24:12.221494 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bfd9c470-74ee-46cc-afbb-cf5980da758f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:12.228859 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bfd9c470-74ee-46cc-afbb-cf5980da758f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:12.241745 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bfd9c470-74ee-46cc-afbb-cf5980da758f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:12.242647 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bfd9c470-74ee-46cc-afbb-cf5980da758f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:12.244482 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bfd9c470-74ee-46cc-afbb-cf5980da758f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:12.245491 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bfd9c470-74ee-46cc-afbb-cf5980da758f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:12.370885 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-138a5079-1e9f-4b40-a486-ff6dc3558c2e tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:12.372484 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-138a5079-1e9f-4b40-a486-ff6dc3558c2e tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:12.382032 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-138a5079-1e9f-4b40-a486-ff6dc3558c2e tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:12.383140 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-138a5079-1e9f-4b40-a486-ff6dc3558c2e tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:12.384595 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-138a5079-1e9f-4b40-a486-ff6dc3558c2e tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:12.385223 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-138a5079-1e9f-4b40-a486-ff6dc3558c2e tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:12.426040 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bfd9c470-74ee-46cc-afbb-cf5980da758f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:12.440441 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bfd9c470-74ee-46cc-afbb-cf5980da758f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:12.441887 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bfd9c470-74ee-46cc-afbb-cf5980da758f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:12.443076 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bfd9c470-74ee-46cc-afbb-cf5980da758f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1725 microversion: 2.20 time: 0.230255 Jun 10 18:24:12.443676 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2835/5625] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:24:12 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1725 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:24:12.544169 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-138a5079-1e9f-4b40-a486-ff6dc3558c2e tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:12.553615 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-138a5079-1e9f-4b40-a486-ff6dc3558c2e tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 200 len: 1486 microversion: 2.1 time: 0.193664 Jun 10 18:24:12.554199 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2791/5626] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:24:12 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 1486 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:24:12.570068 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1ea30423-4225-4e90-ac26-e109e4c3a4b1 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:24:12.570729 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1ea30423-4225-4e90-ac26-e109e4c3a4b1 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:12.577629 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1ea30423-4225-4e90-ac26-e109e4c3a4b1 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:12.578138 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1ea30423-4225-4e90-ac26-e109e4c3a4b1 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:12.578941 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1ea30423-4225-4e90-ac26-e109e4c3a4b1 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:12.579392 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1ea30423-4225-4e90-ac26-e109e4c3a4b1 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:12.854397 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1ea30423-4225-4e90-ac26-e109e4c3a4b1 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "POST /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607/action" status: 202 len: 0 microversion: 2.1 time: 0.287981 Jun 10 18:24:12.855461 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2836/5627] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:24:12 2022] POST /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:24:12.867082 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c81dc7f3-d587-4b69-88c9-3d105b499bca tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:12.867772 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c81dc7f3-d587-4b69-88c9-3d105b499bca tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:12.874830 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c81dc7f3-d587-4b69-88c9-3d105b499bca tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:12.875532 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c81dc7f3-d587-4b69-88c9-3d105b499bca tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:12.881089 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c81dc7f3-d587-4b69-88c9-3d105b499bca tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:12.881089 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c81dc7f3-d587-4b69-88c9-3d105b499bca tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:13.335571 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c81dc7f3-d587-4b69-88c9-3d105b499bca tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:13.358822 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c81dc7f3-d587-4b69-88c9-3d105b499bca tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 200 len: 1494 microversion: 2.1 time: 0.497374 Jun 10 18:24:13.360255 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2792/5628] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:24:12 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 1494 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:24:13.462827 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f72d096c-5ef1-4c75-8f91-4e4b723a5d80 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:13.465557 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f72d096c-5ef1-4c75-8f91-4e4b723a5d80 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:13.478582 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f72d096c-5ef1-4c75-8f91-4e4b723a5d80 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:13.479645 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f72d096c-5ef1-4c75-8f91-4e4b723a5d80 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:13.480742 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f72d096c-5ef1-4c75-8f91-4e4b723a5d80 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:13.481419 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f72d096c-5ef1-4c75-8f91-4e4b723a5d80 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:13.714553 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f72d096c-5ef1-4c75-8f91-4e4b723a5d80 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:13.726908 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f72d096c-5ef1-4c75-8f91-4e4b723a5d80 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:13.729772 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f72d096c-5ef1-4c75-8f91-4e4b723a5d80 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:13.731498 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f72d096c-5ef1-4c75-8f91-4e4b723a5d80 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1725 microversion: 2.20 time: 0.274117 Jun 10 18:24:13.732343 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2837/5629] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:24:13 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1725 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:24:14.377548 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-93865a99-ab96-4a4e-9f3e-dae715bd18e1 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:14.378889 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-93865a99-ab96-4a4e-9f3e-dae715bd18e1 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:14.387962 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93865a99-ab96-4a4e-9f3e-dae715bd18e1 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:14.399361 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93865a99-ab96-4a4e-9f3e-dae715bd18e1 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:14.399361 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93865a99-ab96-4a4e-9f3e-dae715bd18e1 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:14.399361 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93865a99-ab96-4a4e-9f3e-dae715bd18e1 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:14.667063 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-93865a99-ab96-4a4e-9f3e-dae715bd18e1 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:14.698073 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-93865a99-ab96-4a4e-9f3e-dae715bd18e1 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 200 len: 1494 microversion: 2.1 time: 0.324937 Jun 10 18:24:14.700049 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2793/5630] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:24:14 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 1494 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:24:14.750924 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-98894d21-b1ff-45f5-a572-284e93dae025 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:14.752363 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-98894d21-b1ff-45f5-a572-284e93dae025 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:14.760391 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-98894d21-b1ff-45f5-a572-284e93dae025 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:14.761344 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-98894d21-b1ff-45f5-a572-284e93dae025 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:14.762319 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-98894d21-b1ff-45f5-a572-284e93dae025 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:14.762935 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-98894d21-b1ff-45f5-a572-284e93dae025 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:14.943387 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-98894d21-b1ff-45f5-a572-284e93dae025 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:14.955273 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-98894d21-b1ff-45f5-a572-284e93dae025 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:14.959495 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-98894d21-b1ff-45f5-a572-284e93dae025 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:14.962184 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-98894d21-b1ff-45f5-a572-284e93dae025 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1725 microversion: 2.20 time: 0.215157 Jun 10 18:24:14.972130 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2838/5631] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:24:14 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1725 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:24:15.718194 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-09687c30-f9e1-493f-b5fc-b95620be2dbf tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:15.719857 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-09687c30-f9e1-493f-b5fc-b95620be2dbf tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:15.732655 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-09687c30-f9e1-493f-b5fc-b95620be2dbf tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:15.740222 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-09687c30-f9e1-493f-b5fc-b95620be2dbf tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:15.740222 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-09687c30-f9e1-493f-b5fc-b95620be2dbf tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:15.740222 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-09687c30-f9e1-493f-b5fc-b95620be2dbf tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:15.997176 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-62dfea80-5d52-4c08-97e1-d2d5a47e47e8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:15.997802 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-62dfea80-5d52-4c08-97e1-d2d5a47e47e8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:16.011345 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-62dfea80-5d52-4c08-97e1-d2d5a47e47e8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:16.012971 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-62dfea80-5d52-4c08-97e1-d2d5a47e47e8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:16.012971 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-62dfea80-5d52-4c08-97e1-d2d5a47e47e8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:16.024333 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-62dfea80-5d52-4c08-97e1-d2d5a47e47e8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:16.598664 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-09687c30-f9e1-493f-b5fc-b95620be2dbf tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:16.601050 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-62dfea80-5d52-4c08-97e1-d2d5a47e47e8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:16.615697 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-62dfea80-5d52-4c08-97e1-d2d5a47e47e8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:16.616790 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-09687c30-f9e1-493f-b5fc-b95620be2dbf tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 200 len: 1500 microversion: 2.1 time: 0.903527 Jun 10 18:24:16.618031 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-62dfea80-5d52-4c08-97e1-d2d5a47e47e8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:16.619580 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-62dfea80-5d52-4c08-97e1-d2d5a47e47e8 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1725 microversion: 2.20 time: 0.628895 Jun 10 18:24:16.620710 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2839/5632] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:24:15 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1725 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:24:16.636702 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2794/5633] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:24:15 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 1500 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:24:16.651308 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-50cd5395-4ab2-4bca-a860-88deec956d3b tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:16.652496 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-50cd5395-4ab2-4bca-a860-88deec956d3b tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:16.662432 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-50cd5395-4ab2-4bca-a860-88deec956d3b tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:16.662978 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-50cd5395-4ab2-4bca-a860-88deec956d3b tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:16.664046 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-50cd5395-4ab2-4bca-a860-88deec956d3b tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:16.664605 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-50cd5395-4ab2-4bca-a860-88deec956d3b tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:16.703740 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-50cd5395-4ab2-4bca-a860-88deec956d3b tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:24:16.922310 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:24:17.200778 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-50cd5395-4ab2-4bca-a860-88deec956d3b tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "DELETE /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 204 len: 0 microversion: 2.1 time: 0.554580 Jun 10 18:24:17.208161 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2840/5634] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:24:16 2022] DELETE /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:24:17.213536 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-02263d77-e076-4cc9-b482-3dc8d5374ee3 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:17.214165 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-02263d77-e076-4cc9-b482-3dc8d5374ee3 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:17.230813 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02263d77-e076-4cc9-b482-3dc8d5374ee3 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:17.233787 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02263d77-e076-4cc9-b482-3dc8d5374ee3 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:17.241794 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02263d77-e076-4cc9-b482-3dc8d5374ee3 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:17.242331 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02263d77-e076-4cc9-b482-3dc8d5374ee3 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:17.529454 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-02263d77-e076-4cc9-b482-3dc8d5374ee3 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:17.540773 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-02263d77-e076-4cc9-b482-3dc8d5374ee3 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 200 len: 1506 microversion: 2.1 time: 0.333074 Jun 10 18:24:17.544732 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2795/5635] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:24:17 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 1506 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:24:17.641817 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-887130d9-aa4c-48b0-91bb-5c69355c7331 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:17.642908 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-887130d9-aa4c-48b0-91bb-5c69355c7331 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:17.655343 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-887130d9-aa4c-48b0-91bb-5c69355c7331 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:17.656344 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-887130d9-aa4c-48b0-91bb-5c69355c7331 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:17.661885 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-887130d9-aa4c-48b0-91bb-5c69355c7331 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:17.662402 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-887130d9-aa4c-48b0-91bb-5c69355c7331 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:18.030638 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-887130d9-aa4c-48b0-91bb-5c69355c7331 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:18.047769 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-887130d9-aa4c-48b0-91bb-5c69355c7331 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:18.050094 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-887130d9-aa4c-48b0-91bb-5c69355c7331 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:18.051887 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-887130d9-aa4c-48b0-91bb-5c69355c7331 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1725 microversion: 2.20 time: 0.415777 Jun 10 18:24:18.054133 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2841/5636] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:24:17 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1725 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:24:18.561479 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0c4d7069-461f-4764-a390-b5acfc7ec6c9 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:18.562105 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0c4d7069-461f-4764-a390-b5acfc7ec6c9 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:18.571348 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0c4d7069-461f-4764-a390-b5acfc7ec6c9 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:18.572096 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0c4d7069-461f-4764-a390-b5acfc7ec6c9 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:18.573228 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0c4d7069-461f-4764-a390-b5acfc7ec6c9 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:18.574536 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0c4d7069-461f-4764-a390-b5acfc7ec6c9 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:18.831204 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0c4d7069-461f-4764-a390-b5acfc7ec6c9 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:18.841063 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0c4d7069-461f-4764-a390-b5acfc7ec6c9 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 200 len: 1506 microversion: 2.1 time: 0.283718 Jun 10 18:24:18.842482 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2796/5637] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:24:18 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 1506 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:24:19.071125 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3caecfb8-3e00-4bec-9e13-e376385a3015 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:19.080046 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3caecfb8-3e00-4bec-9e13-e376385a3015 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:19.091396 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3caecfb8-3e00-4bec-9e13-e376385a3015 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:19.101236 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3caecfb8-3e00-4bec-9e13-e376385a3015 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:19.102986 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3caecfb8-3e00-4bec-9e13-e376385a3015 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:19.107150 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3caecfb8-3e00-4bec-9e13-e376385a3015 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:19.312807 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3caecfb8-3e00-4bec-9e13-e376385a3015 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:19.322825 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3caecfb8-3e00-4bec-9e13-e376385a3015 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:19.324416 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3caecfb8-3e00-4bec-9e13-e376385a3015 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:19.326348 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3caecfb8-3e00-4bec-9e13-e376385a3015 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1725 microversion: 2.20 time: 0.259133 Jun 10 18:24:19.327495 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2842/5638] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:24:19 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1725 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:24:19.863537 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-42fcf36f-9921-47b0-97fe-3fcc62f9bfc5 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:19.864889 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-42fcf36f-9921-47b0-97fe-3fcc62f9bfc5 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:19.881059 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42fcf36f-9921-47b0-97fe-3fcc62f9bfc5 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:19.882093 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42fcf36f-9921-47b0-97fe-3fcc62f9bfc5 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:19.885076 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42fcf36f-9921-47b0-97fe-3fcc62f9bfc5 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:19.885741 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42fcf36f-9921-47b0-97fe-3fcc62f9bfc5 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:20.161898 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-42fcf36f-9921-47b0-97fe-3fcc62f9bfc5 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:20.170649 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-42fcf36f-9921-47b0-97fe-3fcc62f9bfc5 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 200 len: 1506 microversion: 2.1 time: 0.311327 Jun 10 18:24:20.183741 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2797/5639] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:24:19 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 1506 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:24:20.361782 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-34e70a98-590a-4b1a-a12c-d9106fb67052 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:20.363702 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-34e70a98-590a-4b1a-a12c-d9106fb67052 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:20.375268 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-34e70a98-590a-4b1a-a12c-d9106fb67052 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:20.376902 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-34e70a98-590a-4b1a-a12c-d9106fb67052 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:20.378289 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-34e70a98-590a-4b1a-a12c-d9106fb67052 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:20.381307 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-34e70a98-590a-4b1a-a12c-d9106fb67052 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:20.635925 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-34e70a98-590a-4b1a-a12c-d9106fb67052 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:20.646029 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-34e70a98-590a-4b1a-a12c-d9106fb67052 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:20.647974 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-34e70a98-590a-4b1a-a12c-d9106fb67052 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:20.649572 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-34e70a98-590a-4b1a-a12c-d9106fb67052 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1725 microversion: 2.20 time: 0.307442 Jun 10 18:24:20.650785 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2843/5640] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:24:20 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1725 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:24:21.200506 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7dcf1cc1-3d40-48a6-8a16-e6cd761559cd tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:21.200506 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7dcf1cc1-3d40-48a6-8a16-e6cd761559cd tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:21.204951 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7dcf1cc1-3d40-48a6-8a16-e6cd761559cd tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:21.205620 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7dcf1cc1-3d40-48a6-8a16-e6cd761559cd tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:21.206604 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7dcf1cc1-3d40-48a6-8a16-e6cd761559cd tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:21.207268 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7dcf1cc1-3d40-48a6-8a16-e6cd761559cd tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:21.353839 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7dcf1cc1-3d40-48a6-8a16-e6cd761559cd tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:21.380654 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7dcf1cc1-3d40-48a6-8a16-e6cd761559cd tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 200 len: 1464 microversion: 2.1 time: 0.193049 Jun 10 18:24:21.384757 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2798/5641] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:24:21 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 1464 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:24:21.517210 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-d8a09b3c-a5fe-4f09-a2a1-2640c0e0d155 req-9f81d5b8-8807-4d2b-bab0-69c28f206ed5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3d8c0db-4887-474c-84be-3e1185919607", "name": "network-vif-deleted", "tag": "805f38ac-b9e3-44e6-9b01-743b5b810530"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:24:21.557296 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-d8a09b3c-a5fe-4f09-a2a1-2640c0e0d155 req-9f81d5b8-8807-4d2b-bab0-69c28f206ed5 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:21.558254 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-d8a09b3c-a5fe-4f09-a2a1-2640c0e0d155 req-9f81d5b8-8807-4d2b-bab0-69c28f206ed5 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:21.574168 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-d8a09b3c-a5fe-4f09-a2a1-2640c0e0d155 req-9f81d5b8-8807-4d2b-bab0-69c28f206ed5 service nova] Creating event network-vif-deleted:805f38ac-b9e3-44e6-9b01-743b5b810530 for instance e3d8c0db-4887-474c-84be-3e1185919607 on chh1-master-2 Jun 10 18:24:21.586253 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-d8a09b3c-a5fe-4f09-a2a1-2640c0e0d155 req-9f81d5b8-8807-4d2b-bab0-69c28f206ed5 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077615 Jun 10 18:24:21.587474 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2844/5642] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:24:21.678559 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-80f88116-9035-4d7c-b843-b1a631ee14ba tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:21.679203 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-80f88116-9035-4d7c-b843-b1a631ee14ba tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:21.690227 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-80f88116-9035-4d7c-b843-b1a631ee14ba tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:21.690678 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-80f88116-9035-4d7c-b843-b1a631ee14ba tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:21.694395 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-80f88116-9035-4d7c-b843-b1a631ee14ba tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:21.697578 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-80f88116-9035-4d7c-b843-b1a631ee14ba tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:22.056541 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-80f88116-9035-4d7c-b843-b1a631ee14ba tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:22.067133 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-80f88116-9035-4d7c-b843-b1a631ee14ba tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:22.069558 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-80f88116-9035-4d7c-b843-b1a631ee14ba tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:22.073998 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-80f88116-9035-4d7c-b843-b1a631ee14ba tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1746 microversion: 2.20 time: 0.402230 Jun 10 18:24:22.087359 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2799/5643] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:24:21 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1746 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:24:22.406404 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-03f22f30-78a9-4cfc-97f2-e66d580af6bb tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:22.407129 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-03f22f30-78a9-4cfc-97f2-e66d580af6bb tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:22.421652 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-03f22f30-78a9-4cfc-97f2-e66d580af6bb tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:22.424358 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-03f22f30-78a9-4cfc-97f2-e66d580af6bb tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:22.425120 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-03f22f30-78a9-4cfc-97f2-e66d580af6bb tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:22.428447 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-03f22f30-78a9-4cfc-97f2-e66d580af6bb tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:22.577008 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-03f22f30-78a9-4cfc-97f2-e66d580af6bb tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:22.584849 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-03f22f30-78a9-4cfc-97f2-e66d580af6bb tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:22.585733 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-03f22f30-78a9-4cfc-97f2-e66d580af6bb tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lazy-loading 'fault' on Instance uuid e3d8c0db-4887-474c-84be-3e1185919607 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:24:22.657331 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-03f22f30-78a9-4cfc-97f2-e66d580af6bb tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:22.667654 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-03f22f30-78a9-4cfc-97f2-e66d580af6bb tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 200 len: 1304 microversion: 2.1 time: 0.263936 Jun 10 18:24:22.670367 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2845/5644] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:24:22 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 1304 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:24:23.092908 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7a05bb8d-3d8c-470b-afb5-50ef4e3f1f23 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:23.094260 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7a05bb8d-3d8c-470b-afb5-50ef4e3f1f23 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:23.105400 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7a05bb8d-3d8c-470b-afb5-50ef4e3f1f23 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:23.110083 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7a05bb8d-3d8c-470b-afb5-50ef4e3f1f23 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:23.110083 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7a05bb8d-3d8c-470b-afb5-50ef4e3f1f23 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:23.110083 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7a05bb8d-3d8c-470b-afb5-50ef4e3f1f23 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:23.690990 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-92ea2e30-4db8-4a80-814f-f8dc6a036785 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:23.691675 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-92ea2e30-4db8-4a80-814f-f8dc6a036785 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: e3d8c0db-4887-474c-84be-3e1185919607] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:23.699663 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-92ea2e30-4db8-4a80-814f-f8dc6a036785 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:23.706420 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-92ea2e30-4db8-4a80-814f-f8dc6a036785 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:23.707638 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-92ea2e30-4db8-4a80-814f-f8dc6a036785 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:23.709632 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-92ea2e30-4db8-4a80-814f-f8dc6a036785 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:23.738397 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-92ea2e30-4db8-4a80-814f-f8dc6a036785 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] HTTP exception thrown: Instance e3d8c0db-4887-474c-84be-3e1185919607 could not be found. Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-92ea2e30-4db8-4a80-814f-f8dc6a036785 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Request method failure captured: Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 HTTP/1.1 Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4vevo2WAPvdrz8Ce6GG3aGZNOrbJFrUpjYE2ONtmrngWsPNVmka6c1jLGPKTScpG7c9SGREBa8VeQYMOFyl-rJ-J2DVSri2UjdFCGD_mCiSwb3tf1_J8T2XPo9YCODBuql2U4Zu0wpAb35uNQAHJX_J7KXNm6raQ-XnNPF64hcFvuE Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 8b028adbad274995a55ea5761e28c4a0 Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServerRescueTestJSON-1659926315 Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/8b028adbad274995a55ea5761e28c4a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8b028adbad274995a55ea5761e28c4a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8b028adbad274995a55ea5761e28c4a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_8b028adbad274995a55ea5761e28c4a0", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServerRescueTestJSON-1659926315 Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 8b028adbad274995a55ea5761e28c4a0 Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServerRescueTestJSON-1659926315 Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServerRescueTestJSON-1659926315-project Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: b72693ea306f4789970cbb6257e96241 Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServerRescueTestJSON-1659926315-project Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: exception: Instance e3d8c0db-4887-474c-84be-3e1185919607 could not be found. Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'e3d8c0db-4887-474c-84be-3e1185919607'} Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3d8c0db-4887-474c-84be-3e1185919607 could not be found. Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3d8c0db-4887-474c-84be-3e1185919607 could not be found. Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:24:23.740374 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:24:23.747451 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:24:23.747451 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:24:23.747451 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:24:23.747451 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:24:23.747451 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:24:23.747451 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3d8c0db-4887-474c-84be-3e1185919607 could not be found. Jun 10 18:24:23.747451 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:24:23.747451 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-92ea2e30-4db8-4a80-814f-f8dc6a036785 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Returning 404 to user: Instance e3d8c0db-4887-474c-84be-3e1185919607 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:24:23.747451 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-92ea2e30-4db8-4a80-814f-f8dc6a036785 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607" status: 404 len: 111 microversion: 2.1 time: 0.054746 Jun 10 18:24:23.747451 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2846/5645] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:24:23 2022] GET /compute/v2.1/servers/e3d8c0db-4887-474c-84be-3e1185919607 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:24:23.759518 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c30a4d9d-c311-4d40-bb0f-729c1a1991ec tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:23.760100 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c30a4d9d-c311-4d40-bb0f-729c1a1991ec tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:23.767036 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c30a4d9d-c311-4d40-bb0f-729c1a1991ec tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:23.815446 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c30a4d9d-c311-4d40-bb0f-729c1a1991ec tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:23.815446 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c30a4d9d-c311-4d40-bb0f-729c1a1991ec tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:23.815446 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c30a4d9d-c311-4d40-bb0f-729c1a1991ec tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:23.815446 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c30a4d9d-c311-4d40-bb0f-729c1a1991ec tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:24:23.972048 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7a05bb8d-3d8c-470b-afb5-50ef4e3f1f23 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:23.985127 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7a05bb8d-3d8c-470b-afb5-50ef4e3f1f23 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:23.987479 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7a05bb8d-3d8c-470b-afb5-50ef4e3f1f23 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:23.990666 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7a05bb8d-3d8c-470b-afb5-50ef4e3f1f23 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1746 microversion: 2.20 time: 0.900952 Jun 10 18:24:23.993952 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2800/5646] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:24:23 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1746 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:24:24.315166 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c30a4d9d-c311-4d40-bb0f-729c1a1991ec tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "DELETE /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214" status: 204 len: 0 microversion: 2.1 time: 0.565008 Jun 10 18:24:24.316493 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2847/5647] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:24:23 2022] DELETE /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:24:24.325848 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-96987c1c-d0b6-4da6-b54c-af01f55ae70d tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:24.327101 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-96987c1c-d0b6-4da6-b54c-af01f55ae70d tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:24.337155 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-96987c1c-d0b6-4da6-b54c-af01f55ae70d tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:24.337707 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-96987c1c-d0b6-4da6-b54c-af01f55ae70d tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:24.339261 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-96987c1c-d0b6-4da6-b54c-af01f55ae70d tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:24.339930 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-96987c1c-d0b6-4da6-b54c-af01f55ae70d tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:24.516755 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-96987c1c-d0b6-4da6-b54c-af01f55ae70d tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:24.527788 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-96987c1c-d0b6-4da6-b54c-af01f55ae70d tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214" status: 200 len: 1489 microversion: 2.1 time: 0.206801 Jun 10 18:24:24.529061 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2801/5648] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:24:24 2022] GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 => generated 1489 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:24:24.607962 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-94466cd3-3749-4822-b210-88d928642fe2 req-0a15df9f-716a-4827-b4a6-456b4aba167c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6a3eb83-4aef-446a-a9d5-96d09acb1aaa", "name": "network-vif-plugged", "status": "completed", "tag": "64ec13e5-9fd3-4a96-981b-a6206cef5996"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:24:24.631110 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-94466cd3-3749-4822-b210-88d928642fe2 req-0a15df9f-716a-4827-b4a6-456b4aba167c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:24.632192 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-94466cd3-3749-4822-b210-88d928642fe2 req-0a15df9f-716a-4827-b4a6-456b4aba167c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:24.650891 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-94466cd3-3749-4822-b210-88d928642fe2 req-0a15df9f-716a-4827-b4a6-456b4aba167c service nova] Creating event network-vif-plugged:64ec13e5-9fd3-4a96-981b-a6206cef5996 for instance b6a3eb83-4aef-446a-a9d5-96d09acb1aaa on chh2-master-2 Jun 10 18:24:24.658666 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-94466cd3-3749-4822-b210-88d928642fe2 req-0a15df9f-716a-4827-b4a6-456b4aba167c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054825 Jun 10 18:24:24.660101 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2848/5649] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:24:25.010826 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-62f749d0-afb8-49ad-a560-dc3ced4e6d24 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:25.011448 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-62f749d0-afb8-49ad-a560-dc3ced4e6d24 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:25.019217 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-62f749d0-afb8-49ad-a560-dc3ced4e6d24 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:25.022186 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-62f749d0-afb8-49ad-a560-dc3ced4e6d24 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:25.022186 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-62f749d0-afb8-49ad-a560-dc3ced4e6d24 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:25.022186 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-62f749d0-afb8-49ad-a560-dc3ced4e6d24 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:25.199059 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-62f749d0-afb8-49ad-a560-dc3ced4e6d24 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:25.209435 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-62f749d0-afb8-49ad-a560-dc3ced4e6d24 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:25.210957 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-62f749d0-afb8-49ad-a560-dc3ced4e6d24 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:25.215055 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-62f749d0-afb8-49ad-a560-dc3ced4e6d24 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1746 microversion: 2.20 time: 0.207332 Jun 10 18:24:25.216653 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2802/5650] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:24:25 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1746 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:24:25.567554 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e9e316b0-bcfa-4a7e-ac72-3bb73751feb8 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:25.577540 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e9e316b0-bcfa-4a7e-ac72-3bb73751feb8 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:25.577540 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e9e316b0-bcfa-4a7e-ac72-3bb73751feb8 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:25.577540 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e9e316b0-bcfa-4a7e-ac72-3bb73751feb8 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:25.577940 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e9e316b0-bcfa-4a7e-ac72-3bb73751feb8 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:25.578547 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e9e316b0-bcfa-4a7e-ac72-3bb73751feb8 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:25.844251 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e9e316b0-bcfa-4a7e-ac72-3bb73751feb8 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:25.852418 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e9e316b0-bcfa-4a7e-ac72-3bb73751feb8 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214" status: 200 len: 1489 microversion: 2.1 time: 0.309549 Jun 10 18:24:25.859238 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2849/5651] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:24:25 2022] GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 => generated 1489 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:24:26.237131 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b6c4e143-c49f-41f1-9eab-c7badfdd1190 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:26.238085 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b6c4e143-c49f-41f1-9eab-c7badfdd1190 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:26.242729 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=48 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:24:26.249283 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b6c4e143-c49f-41f1-9eab-c7badfdd1190 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:26.249283 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b6c4e143-c49f-41f1-9eab-c7badfdd1190 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:26.249283 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b6c4e143-c49f-41f1-9eab-c7badfdd1190 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:26.249600 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b6c4e143-c49f-41f1-9eab-c7badfdd1190 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:26.521085 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b6c4e143-c49f-41f1-9eab-c7badfdd1190 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:26.536636 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b6c4e143-c49f-41f1-9eab-c7badfdd1190 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:26.538610 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b6c4e143-c49f-41f1-9eab-c7badfdd1190 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:26.558973 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b6c4e143-c49f-41f1-9eab-c7badfdd1190 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1746 microversion: 2.20 time: 0.307420 Jun 10 18:24:26.573235 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2803/5652] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:24:26 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1746 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:24:26.910278 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ee87ad9e-329c-469c-8cb6-45f75d923fe9 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:26.912216 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ee87ad9e-329c-469c-8cb6-45f75d923fe9 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:26.934977 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ee87ad9e-329c-469c-8cb6-45f75d923fe9 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:26.968524 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ee87ad9e-329c-469c-8cb6-45f75d923fe9 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:26.980720 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ee87ad9e-329c-469c-8cb6-45f75d923fe9 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:26.982895 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ee87ad9e-329c-469c-8cb6-45f75d923fe9 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:27.112233 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ee87ad9e-329c-469c-8cb6-45f75d923fe9 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:27.121526 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ee87ad9e-329c-469c-8cb6-45f75d923fe9 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214" status: 200 len: 1447 microversion: 2.1 time: 0.234107 Jun 10 18:24:27.129333 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2850/5653] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:24:26 2022] GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 => generated 1447 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:24:27.236396 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-4ad36f76-d438-4178-a7fb-cda24f4c4c3f req-7c4fa446-1a7e-4bf4-a940-dd3059124a23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214", "name": "network-vif-deleted", "tag": "66a07031-42d8-4cc1-82f2-2c29619df620"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:24:27.246761 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-4ad36f76-d438-4178-a7fb-cda24f4c4c3f req-7c4fa446-1a7e-4bf4-a940-dd3059124a23 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:27.248597 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-4ad36f76-d438-4178-a7fb-cda24f4c4c3f req-7c4fa446-1a7e-4bf4-a940-dd3059124a23 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:27.262379 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-4ad36f76-d438-4178-a7fb-cda24f4c4c3f req-7c4fa446-1a7e-4bf4-a940-dd3059124a23 service nova] Creating event network-vif-deleted:66a07031-42d8-4cc1-82f2-2c29619df620 for instance 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 on chh1-master-2 Jun 10 18:24:27.269282 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-4ad36f76-d438-4178-a7fb-cda24f4c4c3f req-7c4fa446-1a7e-4bf4-a940-dd3059124a23 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038226 Jun 10 18:24:27.270118 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2804/5654] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:24:27.584039 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-01e8f764-911a-4545-ab25-3ade48b50b84 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:27.585072 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-01e8f764-911a-4545-ab25-3ade48b50b84 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:27.589520 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=3 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:24:27.596648 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-01e8f764-911a-4545-ab25-3ade48b50b84 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:27.597434 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-01e8f764-911a-4545-ab25-3ade48b50b84 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:27.598446 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-01e8f764-911a-4545-ab25-3ade48b50b84 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:27.598901 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-01e8f764-911a-4545-ab25-3ade48b50b84 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:27.915589 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-01e8f764-911a-4545-ab25-3ade48b50b84 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:27.915589 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-01e8f764-911a-4545-ab25-3ade48b50b84 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:27.915589 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-01e8f764-911a-4545-ab25-3ade48b50b84 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:27.915589 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-01e8f764-911a-4545-ab25-3ade48b50b84 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1741 microversion: 2.20 time: 0.227674 Jun 10 18:24:27.915589 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2851/5655] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:24:27 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1741 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:24:28.139705 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-168697d8-5a2a-418e-a47d-57618391aed4 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:28.140690 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-168697d8-5a2a-418e-a47d-57618391aed4 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:28.148035 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-168697d8-5a2a-418e-a47d-57618391aed4 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:28.148522 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-168697d8-5a2a-418e-a47d-57618391aed4 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:28.149296 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-168697d8-5a2a-418e-a47d-57618391aed4 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:28.149740 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-168697d8-5a2a-418e-a47d-57618391aed4 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:28.152502 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:24:28.234098 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-168697d8-5a2a-418e-a47d-57618391aed4 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:28.242413 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-168697d8-5a2a-418e-a47d-57618391aed4 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214" status: 200 len: 1283 microversion: 2.1 time: 0.107030 Jun 10 18:24:28.243001 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2805/5656] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:24:28 2022] GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 => generated 1283 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:24:28.829279 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c538682e-0cde-4b0d-899d-52589ccd0019 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:28.830304 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c538682e-0cde-4b0d-899d-52589ccd0019 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:28.839303 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c538682e-0cde-4b0d-899d-52589ccd0019 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:28.848598 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c538682e-0cde-4b0d-899d-52589ccd0019 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:28.849918 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c538682e-0cde-4b0d-899d-52589ccd0019 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:28.850502 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c538682e-0cde-4b0d-899d-52589ccd0019 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:29.158523 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c538682e-0cde-4b0d-899d-52589ccd0019 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:29.175518 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c538682e-0cde-4b0d-899d-52589ccd0019 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:29.179286 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c538682e-0cde-4b0d-899d-52589ccd0019 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:29.180881 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c538682e-0cde-4b0d-899d-52589ccd0019 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1741 microversion: 2.20 time: 0.358768 Jun 10 18:24:29.181560 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2852/5657] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:24:28 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1741 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:24:29.259443 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-675f0cc0-41b8-418f-a847-cfa25726f9a8 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:29.260050 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-675f0cc0-41b8-418f-a847-cfa25726f9a8 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:29.267833 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-675f0cc0-41b8-418f-a847-cfa25726f9a8 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:29.268293 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-675f0cc0-41b8-418f-a847-cfa25726f9a8 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:29.269099 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-675f0cc0-41b8-418f-a847-cfa25726f9a8 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:29.283384 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-675f0cc0-41b8-418f-a847-cfa25726f9a8 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:29.326669 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-675f0cc0-41b8-418f-a847-cfa25726f9a8 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:29.329177 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-675f0cc0-41b8-418f-a847-cfa25726f9a8 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:29.329835 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-675f0cc0-41b8-418f-a847-cfa25726f9a8 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lazy-loading 'fault' on Instance uuid 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:24:29.466908 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-675f0cc0-41b8-418f-a847-cfa25726f9a8 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72693ea306f4789970cbb6257e96241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b028adbad274995a55ea5761e28c4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:29.474602 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-675f0cc0-41b8-418f-a847-cfa25726f9a8 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214" status: 200 len: 1302 microversion: 2.1 time: 0.219332 Jun 10 18:24:29.491774 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2806/5658] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:24:29 2022] GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 => generated 1302 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:24:30.203475 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-65778294-3a33-492e-9940-c7abe0323067 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:30.209173 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-65778294-3a33-492e-9940-c7abe0323067 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:30.237672 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-65778294-3a33-492e-9940-c7abe0323067 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:30.239297 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-65778294-3a33-492e-9940-c7abe0323067 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:30.240465 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-65778294-3a33-492e-9940-c7abe0323067 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:30.241816 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-65778294-3a33-492e-9940-c7abe0323067 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:30.502355 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-df4d6320-f0a2-4eaa-933c-9e9c693fb445 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:30.503627 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-df4d6320-f0a2-4eaa-933c-9e9c693fb445 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] [instance: 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:30.512824 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df4d6320-f0a2-4eaa-933c-9e9c693fb445 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:30.514085 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df4d6320-f0a2-4eaa-933c-9e9c693fb445 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:30.514615 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df4d6320-f0a2-4eaa-933c-9e9c693fb445 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:30.515259 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df4d6320-f0a2-4eaa-933c-9e9c693fb445 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:30.538082 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-df4d6320-f0a2-4eaa-933c-9e9c693fb445 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] HTTP exception thrown: Instance 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 could not be found. Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-df4d6320-f0a2-4eaa-933c-9e9c693fb445 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Request method failure captured: Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 HTTP/1.1 Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4vevo2WAPvdrz8Ce6GG3aGZNOrbJFrUpjYE2ONtmrngWsPNVmka6c1jLGPKTScpG7c9SGREBa8VeQYMOFyl-rJ-J2DVSri2UjdFCGD_mCiSwb3tf1_J8T2XPo9YCODBuql2U4Zu0wpAb35uNQAHJX_J7KXNm6raQ-XnNPF64hcFvuE Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 8b028adbad274995a55ea5761e28c4a0 Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServerRescueTestJSON-1659926315 Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/8b028adbad274995a55ea5761e28c4a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8b028adbad274995a55ea5761e28c4a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/8b028adbad274995a55ea5761e28c4a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_8b028adbad274995a55ea5761e28c4a0", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServerRescueTestJSON-1659926315 Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 8b028adbad274995a55ea5761e28c4a0 Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServerRescueTestJSON-1659926315 Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServerRescueTestJSON-1659926315-project Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: b72693ea306f4789970cbb6257e96241 Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServerRescueTestJSON-1659926315-project Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 could not be found. Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214'} Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 could not be found. Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 could not be found. Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:24:30.542551 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:24:30.546131 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:24:30.546131 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:24:30.546131 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:24:30.546131 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:24:30.546131 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:24:30.546131 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 could not be found. Jun 10 18:24:30.546131 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:24:30.547709 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-df4d6320-f0a2-4eaa-933c-9e9c693fb445 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] Returning 404 to user: Instance 13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:24:30.548786 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-df4d6320-f0a2-4eaa-933c-9e9c693fb445 tempest-ServerRescueTestJSON-1659926315 tempest-ServerRescueTestJSON-1659926315-project] 10.222.0.35 "GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214" status: 404 len: 111 microversion: 2.1 time: 0.053801 Jun 10 18:24:30.561257 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2807/5659] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:24:30 2022] GET /compute/v2.1/servers/13b8f0c9-ad2a-40bd-8b95-deb0ad0a8214 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:24:30.597519 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-65778294-3a33-492e-9940-c7abe0323067 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:30.624558 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-65778294-3a33-492e-9940-c7abe0323067 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:30.629277 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-65778294-3a33-492e-9940-c7abe0323067 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:30.632442 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-65778294-3a33-492e-9940-c7abe0323067 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1741 microversion: 2.20 time: 0.433020 Jun 10 18:24:30.633294 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2853/5660] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:24:30 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1741 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:24:31.654001 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ce5de0e3-b638-4910-a303-2606eb560170 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:31.654647 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ce5de0e3-b638-4910-a303-2606eb560170 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:31.685239 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ce5de0e3-b638-4910-a303-2606eb560170 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:31.685899 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ce5de0e3-b638-4910-a303-2606eb560170 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:31.687595 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ce5de0e3-b638-4910-a303-2606eb560170 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:31.688801 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ce5de0e3-b638-4910-a303-2606eb560170 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:32.011908 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ce5de0e3-b638-4910-a303-2606eb560170 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:32.025597 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ce5de0e3-b638-4910-a303-2606eb560170 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:32.029518 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ce5de0e3-b638-4910-a303-2606eb560170 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:32.034054 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ce5de0e3-b638-4910-a303-2606eb560170 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1741 microversion: 2.20 time: 0.385298 Jun 10 18:24:32.036385 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2808/5661] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:24:31 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1741 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:24:33.056205 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d55e8b65-0411-4988-910c-2927f803254a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:33.056838 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d55e8b65-0411-4988-910c-2927f803254a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:33.066777 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d55e8b65-0411-4988-910c-2927f803254a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:33.067234 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d55e8b65-0411-4988-910c-2927f803254a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:33.074234 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d55e8b65-0411-4988-910c-2927f803254a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:33.074703 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d55e8b65-0411-4988-910c-2927f803254a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:34.015857 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d55e8b65-0411-4988-910c-2927f803254a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:34.038565 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d55e8b65-0411-4988-910c-2927f803254a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:34.046858 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d55e8b65-0411-4988-910c-2927f803254a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:34.059209 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d55e8b65-0411-4988-910c-2927f803254a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1741 microversion: 2.20 time: 0.996207 Jun 10 18:24:34.061277 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2854/5662] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:24:33 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1741 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:24:35.116976 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-80d8d59a-712c-4d70-b398-948bd7c32b93 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:35.117591 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-80d8d59a-712c-4d70-b398-948bd7c32b93 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:35.125437 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-80d8d59a-712c-4d70-b398-948bd7c32b93 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:35.126405 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-80d8d59a-712c-4d70-b398-948bd7c32b93 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:35.127546 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-80d8d59a-712c-4d70-b398-948bd7c32b93 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:35.129766 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-80d8d59a-712c-4d70-b398-948bd7c32b93 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:35.411852 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-80d8d59a-712c-4d70-b398-948bd7c32b93 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:35.411852 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-80d8d59a-712c-4d70-b398-948bd7c32b93 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:35.411852 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-80d8d59a-712c-4d70-b398-948bd7c32b93 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:35.411852 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-80d8d59a-712c-4d70-b398-948bd7c32b93 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1741 microversion: 2.20 time: 0.268458 Jun 10 18:24:35.411852 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2809/5663] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:24:35 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1741 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:24:36.363455 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-dabd7c7e-2745-4738-b7d0-daaeb3dbfc27 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:36.364021 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-dabd7c7e-2745-4738-b7d0-daaeb3dbfc27 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:36.390211 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dabd7c7e-2745-4738-b7d0-daaeb3dbfc27 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:36.390677 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dabd7c7e-2745-4738-b7d0-daaeb3dbfc27 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:36.392968 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dabd7c7e-2745-4738-b7d0-daaeb3dbfc27 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:36.393386 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dabd7c7e-2745-4738-b7d0-daaeb3dbfc27 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:37.071955 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-dabd7c7e-2745-4738-b7d0-daaeb3dbfc27 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:37.076108 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-dabd7c7e-2745-4738-b7d0-daaeb3dbfc27 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:37.077657 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-dabd7c7e-2745-4738-b7d0-daaeb3dbfc27 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:37.079631 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-dabd7c7e-2745-4738-b7d0-daaeb3dbfc27 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1741 microversion: 2.20 time: 0.721077 Jun 10 18:24:37.092936 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2855/5664] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:24:36 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1741 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:24:38.099818 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6fc4e091-2abd-4231-ad2c-8149f842db29 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:38.100616 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6fc4e091-2abd-4231-ad2c-8149f842db29 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:38.119938 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6fc4e091-2abd-4231-ad2c-8149f842db29 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:38.121939 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6fc4e091-2abd-4231-ad2c-8149f842db29 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:38.124713 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6fc4e091-2abd-4231-ad2c-8149f842db29 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:38.128904 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6fc4e091-2abd-4231-ad2c-8149f842db29 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:38.902686 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6fc4e091-2abd-4231-ad2c-8149f842db29 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:38.916188 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6fc4e091-2abd-4231-ad2c-8149f842db29 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:38.921837 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6fc4e091-2abd-4231-ad2c-8149f842db29 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:38.928526 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6fc4e091-2abd-4231-ad2c-8149f842db29 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1741 microversion: 2.20 time: 0.833219 Jun 10 18:24:38.944802 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2810/5665] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:24:38 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1741 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:24:39.959281 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d60b5533-42ca-4bba-91ef-f9c91d172f42 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:39.959281 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d60b5533-42ca-4bba-91ef-f9c91d172f42 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:39.971760 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d60b5533-42ca-4bba-91ef-f9c91d172f42 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:39.972466 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d60b5533-42ca-4bba-91ef-f9c91d172f42 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:39.975073 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d60b5533-42ca-4bba-91ef-f9c91d172f42 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:39.975707 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d60b5533-42ca-4bba-91ef-f9c91d172f42 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:40.467950 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d60b5533-42ca-4bba-91ef-f9c91d172f42 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:40.482412 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d60b5533-42ca-4bba-91ef-f9c91d172f42 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:40.485431 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d60b5533-42ca-4bba-91ef-f9c91d172f42 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:40.486721 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d60b5533-42ca-4bba-91ef-f9c91d172f42 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1741 microversion: 2.20 time: 0.537258 Jun 10 18:24:40.507073 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2856/5666] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:24:39 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1741 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:24:41.511653 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3ee13464-0455-4979-92e0-50b4864a7c7e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:41.512803 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3ee13464-0455-4979-92e0-50b4864a7c7e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:41.528439 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3ee13464-0455-4979-92e0-50b4864a7c7e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:41.530602 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3ee13464-0455-4979-92e0-50b4864a7c7e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:41.536540 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3ee13464-0455-4979-92e0-50b4864a7c7e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:41.538240 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3ee13464-0455-4979-92e0-50b4864a7c7e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:41.828017 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3ee13464-0455-4979-92e0-50b4864a7c7e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:41.837495 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3ee13464-0455-4979-92e0-50b4864a7c7e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:41.839023 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3ee13464-0455-4979-92e0-50b4864a7c7e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:41.846180 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3ee13464-0455-4979-92e0-50b4864a7c7e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1741 microversion: 2.20 time: 0.333565 Jun 10 18:24:41.849770 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2811/5667] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:24:41 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1741 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:24:42.870116 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-53051f72-b282-4954-8a45-bada28d59448 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:42.871024 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-53051f72-b282-4954-8a45-bada28d59448 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:42.896939 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-53051f72-b282-4954-8a45-bada28d59448 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:42.897656 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-53051f72-b282-4954-8a45-bada28d59448 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:42.898611 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-53051f72-b282-4954-8a45-bada28d59448 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:42.901368 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-53051f72-b282-4954-8a45-bada28d59448 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:42.991204 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:24:43.704443 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-53051f72-b282-4954-8a45-bada28d59448 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:43.713813 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-53051f72-b282-4954-8a45-bada28d59448 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:43.723211 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-53051f72-b282-4954-8a45-bada28d59448 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:43.728819 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-53051f72-b282-4954-8a45-bada28d59448 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1741 microversion: 2.20 time: 0.860565 Jun 10 18:24:43.728819 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2857/5668] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:24:42 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1741 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:24:44.747503 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0d6d34c1-a3b0-4761-8e2e-963c51d84705 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:44.748280 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0d6d34c1-a3b0-4761-8e2e-963c51d84705 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:44.756026 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0d6d34c1-a3b0-4761-8e2e-963c51d84705 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:44.756611 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0d6d34c1-a3b0-4761-8e2e-963c51d84705 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:44.757568 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0d6d34c1-a3b0-4761-8e2e-963c51d84705 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:44.758232 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0d6d34c1-a3b0-4761-8e2e-963c51d84705 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:44.990593 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0d6d34c1-a3b0-4761-8e2e-963c51d84705 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:45.002732 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0d6d34c1-a3b0-4761-8e2e-963c51d84705 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:45.008741 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0d6d34c1-a3b0-4761-8e2e-963c51d84705 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:45.013931 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0d6d34c1-a3b0-4761-8e2e-963c51d84705 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1741 microversion: 2.20 time: 0.270727 Jun 10 18:24:45.020531 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2812/5669] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:24:44 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1741 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:24:46.039958 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d6ec3512-0f84-43b4-8692-df642733bdb7 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:46.040724 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d6ec3512-0f84-43b4-8692-df642733bdb7 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:46.070937 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d6ec3512-0f84-43b4-8692-df642733bdb7 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:46.073047 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d6ec3512-0f84-43b4-8692-df642733bdb7 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:46.075149 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d6ec3512-0f84-43b4-8692-df642733bdb7 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:46.076415 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d6ec3512-0f84-43b4-8692-df642733bdb7 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:46.646472 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d6ec3512-0f84-43b4-8692-df642733bdb7 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:46.666257 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d6ec3512-0f84-43b4-8692-df642733bdb7 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:46.672660 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d6ec3512-0f84-43b4-8692-df642733bdb7 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:46.676863 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d6ec3512-0f84-43b4-8692-df642733bdb7 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1741 microversion: 2.20 time: 0.639471 Jun 10 18:24:46.679233 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2858/5670] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:24:46 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1741 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:24:47.536092 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fde8f580-7ab9-4eb3-a09d-53068aac1803 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:47.536651 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fde8f580-7ab9-4eb3-a09d-53068aac1803 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] [instance: 1c3ad389-7452-4525-a7b3-02b207d522a7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:47.544711 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-4b954fac-77b3-4a51-a539-1d1f32d5567d req-176c7f79-021b-413a-87d1-8a6049df50aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c3ad389-7452-4525-a7b3-02b207d522a7", "tag": "8a575c3a-d4a6-48bb-827e-0f068f5806e1"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:24:47.560697 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-4b954fac-77b3-4a51-a539-1d1f32d5567d req-176c7f79-021b-413a-87d1-8a6049df50aa service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:47.561497 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-4b954fac-77b3-4a51-a539-1d1f32d5567d req-176c7f79-021b-413a-87d1-8a6049df50aa service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:47.570473 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fde8f580-7ab9-4eb3-a09d-53068aac1803 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:47.570934 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fde8f580-7ab9-4eb3-a09d-53068aac1803 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:47.577703 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-4b954fac-77b3-4a51-a539-1d1f32d5567d req-176c7f79-021b-413a-87d1-8a6049df50aa service nova] Creating event network-changed:8a575c3a-d4a6-48bb-827e-0f068f5806e1 for instance 1c3ad389-7452-4525-a7b3-02b207d522a7 on chh2-master-2 Jun 10 18:24:47.589810 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fde8f580-7ab9-4eb3-a09d-53068aac1803 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:47.590030 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fde8f580-7ab9-4eb3-a09d-53068aac1803 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:47.591761 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-4b954fac-77b3-4a51-a539-1d1f32d5567d req-176c7f79-021b-413a-87d1-8a6049df50aa service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047406 Jun 10 18:24:47.625345 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2859/5671] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:24:47.702597 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4680970b-d0e6-494d-b92b-ba6bca089464 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:47.703930 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4680970b-d0e6-494d-b92b-ba6bca089464 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:47.725167 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4680970b-d0e6-494d-b92b-ba6bca089464 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:47.727055 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4680970b-d0e6-494d-b92b-ba6bca089464 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:47.727984 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4680970b-d0e6-494d-b92b-ba6bca089464 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:47.730277 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4680970b-d0e6-494d-b92b-ba6bca089464 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:47.765285 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fde8f580-7ab9-4eb3-a09d-53068aac1803 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] [instance: 1c3ad389-7452-4525-a7b3-02b207d522a7] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:24:48.294275 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fde8f580-7ab9-4eb3-a09d-53068aac1803 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] 10.222.0.35 "DELETE /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7" status: 204 len: 0 microversion: 2.1 time: 0.762672 Jun 10 18:24:48.295874 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2813/5672] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:24:47 2022] DELETE /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7 => generated 0 bytes in 765 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:24:48.311203 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-89b65087-ce1d-4a29-a058-c834efaa4057 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:48.311929 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-89b65087-ce1d-4a29-a058-c834efaa4057 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] [instance: 1c3ad389-7452-4525-a7b3-02b207d522a7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:48.338026 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-89b65087-ce1d-4a29-a058-c834efaa4057 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:48.338494 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-89b65087-ce1d-4a29-a058-c834efaa4057 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:48.351420 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-89b65087-ce1d-4a29-a058-c834efaa4057 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:48.353775 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-89b65087-ce1d-4a29-a058-c834efaa4057 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:48.906935 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-89b65087-ce1d-4a29-a058-c834efaa4057 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d5bd2da034c0a916c92cfada76f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e251487dbdd4ceea1446f703b8b1e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:48.921426 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-89b65087-ce1d-4a29-a058-c834efaa4057 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] 10.222.0.35 "GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7" status: 200 len: 1581 microversion: 2.1 time: 0.617765 Jun 10 18:24:48.930401 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2814/5673] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:24:48 2022] GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7 => generated 1581 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:24:49.350412 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4680970b-d0e6-494d-b92b-ba6bca089464 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:49.367374 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4680970b-d0e6-494d-b92b-ba6bca089464 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:49.372251 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4680970b-d0e6-494d-b92b-ba6bca089464 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:49.381645 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4680970b-d0e6-494d-b92b-ba6bca089464 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1741 microversion: 2.20 time: 1.683841 Jun 10 18:24:49.385625 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2860/5674] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:24:47 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1741 bytes in 1689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:24:49.681500 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d54b6058-b4eb-4469-82d1-f47b2d48e291 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-163455872", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "2f7bc1c1-b9ab-43b7-b2b2-9469ae30555e"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:24:49.760853 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-d54b6058-b4eb-4469-82d1-f47b2d48e291 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] validate_networks() for [('2f7bc1c1-b9ab-43b7-b2b2-9469ae30555e', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:24:49.950017 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e791f0e1-09e5-4ed7-8fca-ad2b60d8a104 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:49.950815 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e791f0e1-09e5-4ed7-8fca-ad2b60d8a104 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] [instance: 1c3ad389-7452-4525-a7b3-02b207d522a7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:49.962741 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e791f0e1-09e5-4ed7-8fca-ad2b60d8a104 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:49.970813 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e791f0e1-09e5-4ed7-8fca-ad2b60d8a104 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:49.973317 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e791f0e1-09e5-4ed7-8fca-ad2b60d8a104 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:49.974756 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e791f0e1-09e5-4ed7-8fca-ad2b60d8a104 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:50.495364 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e791f0e1-09e5-4ed7-8fca-ad2b60d8a104 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d5bd2da034c0a916c92cfada76f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e251487dbdd4ceea1446f703b8b1e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:50.549993 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e791f0e1-09e5-4ed7-8fca-ad2b60d8a104 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] 10.222.0.35 "GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7" status: 200 len: 1581 microversion: 2.1 time: 0.585770 Jun 10 18:24:50.559509 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2861/5675] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:24:49 2022] GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7 => generated 1581 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:24:50.559509 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-81bcdfca-456a-4563-b9b8-540083e18951 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:50.559509 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-81bcdfca-456a-4563-b9b8-540083e18951 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:50.579803 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-81bcdfca-456a-4563-b9b8-540083e18951 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:50.583448 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-81bcdfca-456a-4563-b9b8-540083e18951 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:50.583448 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-81bcdfca-456a-4563-b9b8-540083e18951 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:50.583448 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-81bcdfca-456a-4563-b9b8-540083e18951 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:50.934981 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-d54b6058-b4eb-4469-82d1-f47b2d48e291 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:24:50.936001 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-d54b6058-b4eb-4469-82d1-f47b2d48e291 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:24:50.937029 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-d54b6058-b4eb-4469-82d1-f47b2d48e291 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:24:50.937592 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-d54b6058-b4eb-4469-82d1-f47b2d48e291 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:24:50.939185 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-d54b6058-b4eb-4469-82d1-f47b2d48e291 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:24:50.976488 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d54b6058-b4eb-4469-82d1-f47b2d48e291 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:50.977358 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d54b6058-b4eb-4469-82d1-f47b2d48e291 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:50.980415 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d54b6058-b4eb-4469-82d1-f47b2d48e291 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:50.984186 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d54b6058-b4eb-4469-82d1-f47b2d48e291 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:51.048692 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-d54b6058-b4eb-4469-82d1-f47b2d48e291 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Getting quotas for project 6eb2c32e921a41a185e2e3b7dfa70d3c. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:24:51.068839 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-d54b6058-b4eb-4469-82d1-f47b2d48e291 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Getting quotas for user 5e680050c69144e79f5d99633725f06a and project 6eb2c32e921a41a185e2e3b7dfa70d3c. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:24:51.110491 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d54b6058-b4eb-4469-82d1-f47b2d48e291 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:24:51.118465 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d54b6058-b4eb-4469-82d1-f47b2d48e291 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] [instance: 14781343-216b-44e9-9a93-b4d318f2531c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:24:51.329876 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-81bcdfca-456a-4563-b9b8-540083e18951 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:51.338417 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-81bcdfca-456a-4563-b9b8-540083e18951 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:51.339997 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-81bcdfca-456a-4563-b9b8-540083e18951 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:51.343655 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-81bcdfca-456a-4563-b9b8-540083e18951 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1741 microversion: 2.20 time: 0.790874 Jun 10 18:24:51.351151 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2862/5676] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:24:50 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1741 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:24:51.422426 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d54b6058-b4eb-4469-82d1-f47b2d48e291 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.367471 Jun 10 18:24:51.423831 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2815/5677] 10.222.0.35 () {62 vars in 1187 bytes} [Fri Jun 10 18:24:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2378 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 10 18:24:51.434020 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-56269375-6441-4ed3-81db-bd90f53f37a3 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:51.434952 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-56269375-6441-4ed3-81db-bd90f53f37a3 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] [instance: 14781343-216b-44e9-9a93-b4d318f2531c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:51.566730 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-9a3350b0-9b02-4148-8fe9-fb6b9aa5c3c2 req-e80a30eb-f859-4fc5-914a-8b4be7eb1371 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3ad389-7452-4525-a7b3-02b207d522a7", "name": "network-vif-deleted", "tag": "8a575c3a-d4a6-48bb-827e-0f068f5806e1"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:24:51.586859 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-9a3350b0-9b02-4148-8fe9-fb6b9aa5c3c2 req-e80a30eb-f859-4fc5-914a-8b4be7eb1371 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:51.587567 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-9a3350b0-9b02-4148-8fe9-fb6b9aa5c3c2 req-e80a30eb-f859-4fc5-914a-8b4be7eb1371 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:51.602098 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-9a3350b0-9b02-4148-8fe9-fb6b9aa5c3c2 req-e80a30eb-f859-4fc5-914a-8b4be7eb1371 service nova] Creating event network-vif-deleted:8a575c3a-d4a6-48bb-827e-0f068f5806e1 for instance 1c3ad389-7452-4525-a7b3-02b207d522a7 on chh2-master-2 Jun 10 18:24:51.608236 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-9a3350b0-9b02-4148-8fe9-fb6b9aa5c3c2 req-e80a30eb-f859-4fc5-914a-8b4be7eb1371 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046117 Jun 10 18:24:51.610402 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2816/5678] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:24:51.615184 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-56269375-6441-4ed3-81db-bd90f53f37a3 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:51.627728 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-56269375-6441-4ed3-81db-bd90f53f37a3 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:51.631917 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-56269375-6441-4ed3-81db-bd90f53f37a3 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:51.633974 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6242887d-20eb-4cc2-bb8c-88ab0cf5b8ec tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:51.637985 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-56269375-6441-4ed3-81db-bd90f53f37a3 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] 10.222.0.35 "GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c" status: 200 len: 1261 microversion: 2.26 time: 0.208349 Jun 10 18:24:51.641895 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6242887d-20eb-4cc2-bb8c-88ab0cf5b8ec tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] [instance: 1c3ad389-7452-4525-a7b3-02b207d522a7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:51.649451 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2863/5679] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:24:51 2022] GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c => generated 1261 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:24:51.680274 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6242887d-20eb-4cc2-bb8c-88ab0cf5b8ec tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:51.680788 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6242887d-20eb-4cc2-bb8c-88ab0cf5b8ec tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:51.683085 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6242887d-20eb-4cc2-bb8c-88ab0cf5b8ec tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:51.684080 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6242887d-20eb-4cc2-bb8c-88ab0cf5b8ec tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:51.915766 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6242887d-20eb-4cc2-bb8c-88ab0cf5b8ec tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d5bd2da034c0a916c92cfada76f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e251487dbdd4ceea1446f703b8b1e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:51.947817 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6242887d-20eb-4cc2-bb8c-88ab0cf5b8ec tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] 10.222.0.35 "GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7" status: 200 len: 1396 microversion: 2.1 time: 0.334862 Jun 10 18:24:51.956674 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2817/5680] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:24:51 2022] GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7 => generated 1396 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:24:52.380128 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-deb2e16d-8d8a-4d88-af63-598f5d52b6ce tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:52.381434 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-deb2e16d-8d8a-4d88-af63-598f5d52b6ce tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:52.410066 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-deb2e16d-8d8a-4d88-af63-598f5d52b6ce tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:52.411777 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-deb2e16d-8d8a-4d88-af63-598f5d52b6ce tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:52.412968 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-deb2e16d-8d8a-4d88-af63-598f5d52b6ce tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:52.413568 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-deb2e16d-8d8a-4d88-af63-598f5d52b6ce tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:52.677548 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ff33b31c-0668-41e2-a4bd-2147109f6833 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:52.678584 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ff33b31c-0668-41e2-a4bd-2147109f6833 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] [instance: 14781343-216b-44e9-9a93-b4d318f2531c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:52.848280 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-deb2e16d-8d8a-4d88-af63-598f5d52b6ce tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:52.866011 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-deb2e16d-8d8a-4d88-af63-598f5d52b6ce tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:52.867910 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-deb2e16d-8d8a-4d88-af63-598f5d52b6ce tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:52.869380 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-deb2e16d-8d8a-4d88-af63-598f5d52b6ce tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1741 microversion: 2.20 time: 0.511158 Jun 10 18:24:52.882949 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2864/5681] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:24:52 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1741 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:24:52.961764 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ff33b31c-0668-41e2-a4bd-2147109f6833 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:52.978808 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-97967248-2526-4a13-b37c-5be59b80580c tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:52.979436 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-97967248-2526-4a13-b37c-5be59b80580c tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] [instance: 1c3ad389-7452-4525-a7b3-02b207d522a7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:52.987982 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-97967248-2526-4a13-b37c-5be59b80580c tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:52.988832 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-97967248-2526-4a13-b37c-5be59b80580c tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:52.990437 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-97967248-2526-4a13-b37c-5be59b80580c tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:52.991111 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-97967248-2526-4a13-b37c-5be59b80580c tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:53.006958 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ff33b31c-0668-41e2-a4bd-2147109f6833 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:53.008525 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ff33b31c-0668-41e2-a4bd-2147109f6833 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:53.009727 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ff33b31c-0668-41e2-a4bd-2147109f6833 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] 10.222.0.35 "GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c" status: 200 len: 1261 microversion: 2.26 time: 0.338075 Jun 10 18:24:53.010301 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2818/5682] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:24:52 2022] GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c => generated 1261 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:24:53.128028 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-97967248-2526-4a13-b37c-5be59b80580c tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d5bd2da034c0a916c92cfada76f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e251487dbdd4ceea1446f703b8b1e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:53.146332 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-97967248-2526-4a13-b37c-5be59b80580c tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] 10.222.0.35 "GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7" status: 200 len: 1228 microversion: 2.1 time: 0.166342 Jun 10 18:24:53.149245 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2865/5683] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:24:52 2022] GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7 => generated 1228 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:24:53.889455 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-74e363cf-3be1-4854-b167-452552b9d08f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:53.892088 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-74e363cf-3be1-4854-b167-452552b9d08f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:53.914399 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-74e363cf-3be1-4854-b167-452552b9d08f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:53.914872 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-74e363cf-3be1-4854-b167-452552b9d08f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:53.919536 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-74e363cf-3be1-4854-b167-452552b9d08f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:53.920551 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-74e363cf-3be1-4854-b167-452552b9d08f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:54.030165 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-60c93c43-b8ea-4d0b-85be-5790db7d9cad tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:54.031970 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-60c93c43-b8ea-4d0b-85be-5790db7d9cad tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] [instance: 14781343-216b-44e9-9a93-b4d318f2531c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:54.154235 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-60c93c43-b8ea-4d0b-85be-5790db7d9cad tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:54.166437 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-60c93c43-b8ea-4d0b-85be-5790db7d9cad tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:54.170110 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-60c93c43-b8ea-4d0b-85be-5790db7d9cad tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:54.192111 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-60c93c43-b8ea-4d0b-85be-5790db7d9cad tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] 10.222.0.35 "GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c" status: 200 len: 1261 microversion: 2.26 time: 0.166031 Jun 10 18:24:54.207021 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2866/5684] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:24:54 2022] GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c => generated 1261 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:24:54.222251 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2292bcca-696f-4379-95d0-3e9a9a07bd4a tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:54.223140 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2292bcca-696f-4379-95d0-3e9a9a07bd4a tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] [instance: 1c3ad389-7452-4525-a7b3-02b207d522a7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:54.251858 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2292bcca-696f-4379-95d0-3e9a9a07bd4a tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:54.251858 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2292bcca-696f-4379-95d0-3e9a9a07bd4a tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:54.251858 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2292bcca-696f-4379-95d0-3e9a9a07bd4a tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:54.251858 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2292bcca-696f-4379-95d0-3e9a9a07bd4a tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:54.459273 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2292bcca-696f-4379-95d0-3e9a9a07bd4a tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d5bd2da034c0a916c92cfada76f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e251487dbdd4ceea1446f703b8b1e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:54.464857 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2292bcca-696f-4379-95d0-3e9a9a07bd4a tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] 10.222.0.35 "GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7" status: 200 len: 1228 microversion: 2.1 time: 0.256359 Jun 10 18:24:54.465462 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2867/5685] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:24:54 2022] GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7 => generated 1228 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:24:54.661261 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-74e363cf-3be1-4854-b167-452552b9d08f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:54.679356 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-74e363cf-3be1-4854-b167-452552b9d08f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:54.690947 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-74e363cf-3be1-4854-b167-452552b9d08f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:54.690947 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-74e363cf-3be1-4854-b167-452552b9d08f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1741 microversion: 2.20 time: 0.801734 Jun 10 18:24:54.702875 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2819/5686] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:24:53 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1741 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:24:55.236841 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a3bc93fe-2ee6-4b15-920a-c3a6b372d49f tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:55.238183 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a3bc93fe-2ee6-4b15-920a-c3a6b372d49f tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] [instance: 14781343-216b-44e9-9a93-b4d318f2531c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:55.326976 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3bc93fe-2ee6-4b15-920a-c3a6b372d49f tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:55.333359 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3bc93fe-2ee6-4b15-920a-c3a6b372d49f tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:55.333359 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3bc93fe-2ee6-4b15-920a-c3a6b372d49f tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:55.358520 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3bc93fe-2ee6-4b15-920a-c3a6b372d49f tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:55.488143 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9f45e515-1b6c-4697-9351-2421c176fce9 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:55.488143 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9f45e515-1b6c-4697-9351-2421c176fce9 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] [instance: 1c3ad389-7452-4525-a7b3-02b207d522a7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:55.496808 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f45e515-1b6c-4697-9351-2421c176fce9 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:55.511616 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f45e515-1b6c-4697-9351-2421c176fce9 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:55.517548 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f45e515-1b6c-4697-9351-2421c176fce9 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:55.526384 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f45e515-1b6c-4697-9351-2421c176fce9 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:55.743871 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a3bc93fe-2ee6-4b15-920a-c3a6b372d49f tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:55.766390 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a3bc93fe-2ee6-4b15-920a-c3a6b372d49f tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:55.769439 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a3bc93fe-2ee6-4b15-920a-c3a6b372d49f tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:55.770660 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a3bc93fe-2ee6-4b15-920a-c3a6b372d49f tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] 10.222.0.35 "GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c" status: 200 len: 1257 microversion: 2.26 time: 0.542863 Jun 10 18:24:55.807326 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2868/5687] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:24:55 2022] GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c => generated 1257 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:24:55.821479 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-91752681-5f57-42eb-99ca-962d34ba1ca6 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:55.828421 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-91752681-5f57-42eb-99ca-962d34ba1ca6 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:55.861324 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-91752681-5f57-42eb-99ca-962d34ba1ca6 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:55.862398 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-91752681-5f57-42eb-99ca-962d34ba1ca6 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:55.865343 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-91752681-5f57-42eb-99ca-962d34ba1ca6 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:55.870153 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-91752681-5f57-42eb-99ca-962d34ba1ca6 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:56.067094 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9f45e515-1b6c-4697-9351-2421c176fce9 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d5bd2da034c0a916c92cfada76f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e251487dbdd4ceea1446f703b8b1e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:56.076023 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9f45e515-1b6c-4697-9351-2421c176fce9 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] 10.222.0.35 "GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7" status: 200 len: 1228 microversion: 2.1 time: 0.598078 Jun 10 18:24:56.097384 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2820/5688] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:24:55 2022] GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7 => generated 1228 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:24:56.425905 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-91752681-5f57-42eb-99ca-962d34ba1ca6 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:56.442562 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-91752681-5f57-42eb-99ca-962d34ba1ca6 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:56.451089 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-91752681-5f57-42eb-99ca-962d34ba1ca6 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:56.452786 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-91752681-5f57-42eb-99ca-962d34ba1ca6 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1741 microversion: 2.20 time: 0.644223 Jun 10 18:24:56.460559 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2869/5689] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:24:55 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1741 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:24:56.800735 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-264bc48d-9459-4377-9492-9a2ce816b4b0 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:56.801435 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-264bc48d-9459-4377-9492-9a2ce816b4b0 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] [instance: 14781343-216b-44e9-9a93-b4d318f2531c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:56.818817 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-264bc48d-9459-4377-9492-9a2ce816b4b0 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:56.821612 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-264bc48d-9459-4377-9492-9a2ce816b4b0 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:56.823022 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-264bc48d-9459-4377-9492-9a2ce816b4b0 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:56.824908 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-264bc48d-9459-4377-9492-9a2ce816b4b0 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:57.041519 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-264bc48d-9459-4377-9492-9a2ce816b4b0 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:57.058370 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-264bc48d-9459-4377-9492-9a2ce816b4b0 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:57.064337 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-264bc48d-9459-4377-9492-9a2ce816b4b0 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:57.073380 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-264bc48d-9459-4377-9492-9a2ce816b4b0 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] 10.222.0.35 "GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c" status: 200 len: 1331 microversion: 2.26 time: 0.273020 Jun 10 18:24:57.078325 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2821/5690] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:24:56 2022] GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c => generated 1331 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:24:57.116122 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e240a8b8-3610-4222-9ab8-7876e8f1c828 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:57.117075 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e240a8b8-3610-4222-9ab8-7876e8f1c828 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] [instance: 1c3ad389-7452-4525-a7b3-02b207d522a7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:57.132770 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e240a8b8-3610-4222-9ab8-7876e8f1c828 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:57.142120 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e240a8b8-3610-4222-9ab8-7876e8f1c828 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:57.143522 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e240a8b8-3610-4222-9ab8-7876e8f1c828 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:57.147578 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e240a8b8-3610-4222-9ab8-7876e8f1c828 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:57.375692 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e240a8b8-3610-4222-9ab8-7876e8f1c828 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d5bd2da034c0a916c92cfada76f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e251487dbdd4ceea1446f703b8b1e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:57.408343 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e240a8b8-3610-4222-9ab8-7876e8f1c828 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] 10.222.0.35 "GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7" status: 200 len: 1228 microversion: 2.1 time: 0.293932 Jun 10 18:24:57.411490 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2870/5691] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:24:57 2022] GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7 => generated 1228 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:24:57.475889 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b7210a0d-cf47-4f42-91ee-5625181c21b3 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:57.476530 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b7210a0d-cf47-4f42-91ee-5625181c21b3 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:57.479667 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:24:57.489813 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b7210a0d-cf47-4f42-91ee-5625181c21b3 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:57.491853 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b7210a0d-cf47-4f42-91ee-5625181c21b3 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:57.492823 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b7210a0d-cf47-4f42-91ee-5625181c21b3 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:57.493283 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b7210a0d-cf47-4f42-91ee-5625181c21b3 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:58.101431 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e140e303-7b0d-4bfc-9298-837872e84f63 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:58.102143 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e140e303-7b0d-4bfc-9298-837872e84f63 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] [instance: 14781343-216b-44e9-9a93-b4d318f2531c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:58.145182 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e140e303-7b0d-4bfc-9298-837872e84f63 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:58.146492 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e140e303-7b0d-4bfc-9298-837872e84f63 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:58.149088 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e140e303-7b0d-4bfc-9298-837872e84f63 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:58.150742 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e140e303-7b0d-4bfc-9298-837872e84f63 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:58.298402 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b7210a0d-cf47-4f42-91ee-5625181c21b3 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:58.309565 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:24:58.326025 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b7210a0d-cf47-4f42-91ee-5625181c21b3 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:58.331006 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b7210a0d-cf47-4f42-91ee-5625181c21b3 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:58.334808 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b7210a0d-cf47-4f42-91ee-5625181c21b3 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1741 microversion: 2.20 time: 0.864572 Jun 10 18:24:58.336202 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2822/5692] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:24:57 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1741 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:24:58.440239 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0d1edf55-bfed-417a-9463-747617cfaf9f tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:58.441101 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0d1edf55-bfed-417a-9463-747617cfaf9f tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] [instance: 1c3ad389-7452-4525-a7b3-02b207d522a7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:58.456226 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0d1edf55-bfed-417a-9463-747617cfaf9f tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:58.459203 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0d1edf55-bfed-417a-9463-747617cfaf9f tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:58.461096 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0d1edf55-bfed-417a-9463-747617cfaf9f tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:58.462506 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0d1edf55-bfed-417a-9463-747617cfaf9f tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:58.554459 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e140e303-7b0d-4bfc-9298-837872e84f63 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:58.571081 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e140e303-7b0d-4bfc-9298-837872e84f63 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:58.577019 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e140e303-7b0d-4bfc-9298-837872e84f63 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:58.579414 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e140e303-7b0d-4bfc-9298-837872e84f63 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] 10.222.0.35 "GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c" status: 200 len: 1361 microversion: 2.26 time: 0.486389 Jun 10 18:24:58.604333 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2871/5693] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:24:58 2022] GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c => generated 1361 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:24:58.624466 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0d1edf55-bfed-417a-9463-747617cfaf9f tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d5bd2da034c0a916c92cfada76f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e251487dbdd4ceea1446f703b8b1e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:24:58.629983 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0d1edf55-bfed-417a-9463-747617cfaf9f tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] 10.222.0.35 "GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7" status: 200 len: 1228 microversion: 2.1 time: 0.204679 Jun 10 18:24:58.633829 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2823/5694] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:24:58 2022] GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7 => generated 1228 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:24:59.355135 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-831b314f-3792-46ba-9f81-7732abeaa4d4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:59.356436 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-831b314f-3792-46ba-9f81-7732abeaa4d4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:59.373039 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-831b314f-3792-46ba-9f81-7732abeaa4d4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:59.373721 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-831b314f-3792-46ba-9f81-7732abeaa4d4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:59.377706 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-831b314f-3792-46ba-9f81-7732abeaa4d4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:59.378382 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-831b314f-3792-46ba-9f81-7732abeaa4d4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:59.610036 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fbd3e716-fb06-4ea3-84ca-fb3c45b9f80d tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:24:59.611480 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fbd3e716-fb06-4ea3-84ca-fb3c45b9f80d tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] [instance: 14781343-216b-44e9-9a93-b4d318f2531c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:24:59.631189 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fbd3e716-fb06-4ea3-84ca-fb3c45b9f80d tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:59.632277 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fbd3e716-fb06-4ea3-84ca-fb3c45b9f80d tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:24:59.633467 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fbd3e716-fb06-4ea3-84ca-fb3c45b9f80d tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:24:59.634134 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fbd3e716-fb06-4ea3-84ca-fb3c45b9f80d tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:00.181669 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-831b314f-3792-46ba-9f81-7732abeaa4d4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:00.202052 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-831b314f-3792-46ba-9f81-7732abeaa4d4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:00.210773 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-831b314f-3792-46ba-9f81-7732abeaa4d4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:00.212196 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-831b314f-3792-46ba-9f81-7732abeaa4d4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1723 microversion: 2.20 time: 0.861952 Jun 10 18:25:00.214327 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2872/5695] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:24:59 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1723 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:25:00.229719 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8c44da0d-bd25-4e54-983b-fa21fe213d5c tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:00.235769 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8c44da0d-bd25-4e54-983b-fa21fe213d5c tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] [instance: 1c3ad389-7452-4525-a7b3-02b207d522a7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:00.245417 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=48 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:25:00.248915 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8c44da0d-bd25-4e54-983b-fa21fe213d5c tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:00.252749 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8c44da0d-bd25-4e54-983b-fa21fe213d5c tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:00.254898 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8c44da0d-bd25-4e54-983b-fa21fe213d5c tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:00.256348 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8c44da0d-bd25-4e54-983b-fa21fe213d5c tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:00.305887 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fbd3e716-fb06-4ea3-84ca-fb3c45b9f80d tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:00.315204 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fbd3e716-fb06-4ea3-84ca-fb3c45b9f80d tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:00.320710 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fbd3e716-fb06-4ea3-84ca-fb3c45b9f80d tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:00.324645 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fbd3e716-fb06-4ea3-84ca-fb3c45b9f80d tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] 10.222.0.35 "GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c" status: 200 len: 1361 microversion: 2.26 time: 0.719099 Jun 10 18:25:00.329268 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2824/5696] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:24:59 2022] GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c => generated 1361 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:25:00.793070 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8c44da0d-bd25-4e54-983b-fa21fe213d5c tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d5bd2da034c0a916c92cfada76f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e251487dbdd4ceea1446f703b8b1e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:00.806769 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8c44da0d-bd25-4e54-983b-fa21fe213d5c tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] 10.222.0.35 "GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7" status: 200 len: 1228 microversion: 2.1 time: 0.591242 Jun 10 18:25:00.820537 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2873/5697] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:25:00 2022] GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7 => generated 1228 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:25:00.887840 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-ecfd3145-ec02-4c16-a6a4-b02773b47937 req-8881490a-fbdd-4c78-af7b-3730c005210c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14781343-216b-44e9-9a93-b4d318f2531c", "tag": "b5e0a08f-0448-4601-a199-0ce443b00a70"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:25:00.912186 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-ecfd3145-ec02-4c16-a6a4-b02773b47937 req-8881490a-fbdd-4c78-af7b-3730c005210c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:00.912713 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-ecfd3145-ec02-4c16-a6a4-b02773b47937 req-8881490a-fbdd-4c78-af7b-3730c005210c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:00.964056 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-ecfd3145-ec02-4c16-a6a4-b02773b47937 req-8881490a-fbdd-4c78-af7b-3730c005210c service nova] Creating event network-changed:b5e0a08f-0448-4601-a199-0ce443b00a70 for instance 14781343-216b-44e9-9a93-b4d318f2531c on chh1-master-2 Jun 10 18:25:00.975984 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-ecfd3145-ec02-4c16-a6a4-b02773b47937 req-8881490a-fbdd-4c78-af7b-3730c005210c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092099 Jun 10 18:25:00.980705 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2825/5698] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:25:01.250166 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f4b762ca-d93c-494f-bdf1-ed88e4a494fb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:01.251054 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f4b762ca-d93c-494f-bdf1-ed88e4a494fb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:01.269386 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4b762ca-d93c-494f-bdf1-ed88e4a494fb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:01.269982 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4b762ca-d93c-494f-bdf1-ed88e4a494fb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:01.275302 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4b762ca-d93c-494f-bdf1-ed88e4a494fb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:01.284160 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4b762ca-d93c-494f-bdf1-ed88e4a494fb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:01.351204 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3acbfac5-004c-4d4c-9a15-c5c9ea86b6b5 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:01.352392 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3acbfac5-004c-4d4c-9a15-c5c9ea86b6b5 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] [instance: 14781343-216b-44e9-9a93-b4d318f2531c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:01.367008 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:25:01.376600 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3acbfac5-004c-4d4c-9a15-c5c9ea86b6b5 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:01.376600 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3acbfac5-004c-4d4c-9a15-c5c9ea86b6b5 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:01.376600 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3acbfac5-004c-4d4c-9a15-c5c9ea86b6b5 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:01.376600 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3acbfac5-004c-4d4c-9a15-c5c9ea86b6b5 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:01.820534 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3acbfac5-004c-4d4c-9a15-c5c9ea86b6b5 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:01.837719 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3acbfac5-004c-4d4c-9a15-c5c9ea86b6b5 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:01.849260 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3acbfac5-004c-4d4c-9a15-c5c9ea86b6b5 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:01.853069 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3acbfac5-004c-4d4c-9a15-c5c9ea86b6b5 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] 10.222.0.35 "GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c" status: 200 len: 1361 microversion: 2.26 time: 0.505404 Jun 10 18:25:01.853691 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2826/5699] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:25:01 2022] GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c => generated 1361 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:25:01.873091 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-970d504e-cd3d-4476-add4-5eb0d3c51577 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:01.874478 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-970d504e-cd3d-4476-add4-5eb0d3c51577 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] [instance: 1c3ad389-7452-4525-a7b3-02b207d522a7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:01.903470 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-970d504e-cd3d-4476-add4-5eb0d3c51577 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:01.907796 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-970d504e-cd3d-4476-add4-5eb0d3c51577 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:01.909083 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-970d504e-cd3d-4476-add4-5eb0d3c51577 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:01.909677 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-970d504e-cd3d-4476-add4-5eb0d3c51577 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:01.923609 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f4b762ca-d93c-494f-bdf1-ed88e4a494fb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:01.945890 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f4b762ca-d93c-494f-bdf1-ed88e4a494fb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:01.956292 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f4b762ca-d93c-494f-bdf1-ed88e4a494fb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:01.960593 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f4b762ca-d93c-494f-bdf1-ed88e4a494fb tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1723 microversion: 2.20 time: 0.727376 Jun 10 18:25:01.969156 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2874/5700] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:25:01 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1723 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:25:02.133186 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-970d504e-cd3d-4476-add4-5eb0d3c51577 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d5bd2da034c0a916c92cfada76f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e251487dbdd4ceea1446f703b8b1e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:02.142392 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-970d504e-cd3d-4476-add4-5eb0d3c51577 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] 10.222.0.35 "GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7" status: 200 len: 1228 microversion: 2.1 time: 0.287628 Jun 10 18:25:02.156622 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2827/5701] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:25:01 2022] GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7 => generated 1228 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:25:02.867997 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-c923238a-dfff-4ed3-8873-f5f955da2d3c req-debac844-d03c-4b7c-98d5-ae207169682b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6a3eb83-4aef-446a-a9d5-96d09acb1aaa", "name": "network-vif-unplugged", "status": "completed", "tag": "64ec13e5-9fd3-4a96-981b-a6206cef5996"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:25:02.875156 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8a7d5570-04bb-48d0-8952-d2647414f480 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:02.876207 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8a7d5570-04bb-48d0-8952-d2647414f480 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] [instance: 14781343-216b-44e9-9a93-b4d318f2531c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:02.883427 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8a7d5570-04bb-48d0-8952-d2647414f480 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:02.884648 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8a7d5570-04bb-48d0-8952-d2647414f480 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:02.884989 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-c923238a-dfff-4ed3-8873-f5f955da2d3c req-debac844-d03c-4b7c-98d5-ae207169682b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:02.885967 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-c923238a-dfff-4ed3-8873-f5f955da2d3c req-debac844-d03c-4b7c-98d5-ae207169682b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:02.886939 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8a7d5570-04bb-48d0-8952-d2647414f480 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:02.887661 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8a7d5570-04bb-48d0-8952-d2647414f480 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:02.919217 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-c923238a-dfff-4ed3-8873-f5f955da2d3c req-debac844-d03c-4b7c-98d5-ae207169682b service nova] Creating event network-vif-unplugged:64ec13e5-9fd3-4a96-981b-a6206cef5996 for instance b6a3eb83-4aef-446a-a9d5-96d09acb1aaa on chh2-master-2 Jun 10 18:25:02.929399 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-c923238a-dfff-4ed3-8873-f5f955da2d3c req-debac844-d03c-4b7c-98d5-ae207169682b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067184 Jun 10 18:25:02.933722 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2875/5702] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:25:02.984978 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7b5f430e-4c78-4407-aa56-ec94af09b5ad tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:02.986868 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7b5f430e-4c78-4407-aa56-ec94af09b5ad tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:03.036998 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7b5f430e-4c78-4407-aa56-ec94af09b5ad tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:03.058566 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=8 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:25:03.059511 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7b5f430e-4c78-4407-aa56-ec94af09b5ad tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:03.060514 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7b5f430e-4c78-4407-aa56-ec94af09b5ad tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:03.060980 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7b5f430e-4c78-4407-aa56-ec94af09b5ad tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:03.686064 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7b5f430e-4c78-4407-aa56-ec94af09b5ad tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:03.716357 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7b5f430e-4c78-4407-aa56-ec94af09b5ad tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:03.721472 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7b5f430e-4c78-4407-aa56-ec94af09b5ad tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:03.724917 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7b5f430e-4c78-4407-aa56-ec94af09b5ad tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1723 microversion: 2.20 time: 0.746895 Jun 10 18:25:03.725694 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2876/5703] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:25:02 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1723 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:25:03.760604 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-66b4b041-968e-4db0-9cb8-f6f7aaf603fc tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:03.760604 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-66b4b041-968e-4db0-9cb8-f6f7aaf603fc tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] [instance: 1c3ad389-7452-4525-a7b3-02b207d522a7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:03.765971 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8a7d5570-04bb-48d0-8952-d2647414f480 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:03.775086 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8a7d5570-04bb-48d0-8952-d2647414f480 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:03.784154 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-66b4b041-968e-4db0-9cb8-f6f7aaf603fc tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:03.784850 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-66b4b041-968e-4db0-9cb8-f6f7aaf603fc tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:03.785814 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-66b4b041-968e-4db0-9cb8-f6f7aaf603fc tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:03.786400 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-66b4b041-968e-4db0-9cb8-f6f7aaf603fc tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:03.788036 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8a7d5570-04bb-48d0-8952-d2647414f480 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:03.791420 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8a7d5570-04bb-48d0-8952-d2647414f480 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] 10.222.0.35 "GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c" status: 200 len: 1361 microversion: 2.26 time: 0.919913 Jun 10 18:25:03.806894 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2828/5704] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:25:02 2022] GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c => generated 1361 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:25:03.846258 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:25:03.894512 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-66b4b041-968e-4db0-9cb8-f6f7aaf603fc tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:03.894969 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-66b4b041-968e-4db0-9cb8-f6f7aaf603fc tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:03.895419 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-66b4b041-968e-4db0-9cb8-f6f7aaf603fc tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lazy-loading 'fault' on Instance uuid 1c3ad389-7452-4525-a7b3-02b207d522a7 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:25:04.163654 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=4 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:25:04.185633 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-66b4b041-968e-4db0-9cb8-f6f7aaf603fc tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d5bd2da034c0a916c92cfada76f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e251487dbdd4ceea1446f703b8b1e92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:04.204036 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-66b4b041-968e-4db0-9cb8-f6f7aaf603fc tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] 10.222.0.35 "GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7" status: 200 len: 1233 microversion: 2.1 time: 0.464066 Jun 10 18:25:04.209653 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2877/5705] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:25:03 2022] GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7 => generated 1233 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:25:04.746857 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-788ba4f5-3795-469a-9107-78bd33a52448 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:04.747512 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-788ba4f5-3795-469a-9107-78bd33a52448 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:04.770166 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-788ba4f5-3795-469a-9107-78bd33a52448 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:04.772008 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-788ba4f5-3795-469a-9107-78bd33a52448 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:04.777735 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-788ba4f5-3795-469a-9107-78bd33a52448 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:04.780191 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-788ba4f5-3795-469a-9107-78bd33a52448 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:04.813954 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-18a19784-739b-4d9d-b229-1d16d0702b06 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:04.816635 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-18a19784-739b-4d9d-b229-1d16d0702b06 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] [instance: 14781343-216b-44e9-9a93-b4d318f2531c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:04.831998 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-18a19784-739b-4d9d-b229-1d16d0702b06 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:04.832750 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-18a19784-739b-4d9d-b229-1d16d0702b06 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:04.834756 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-18a19784-739b-4d9d-b229-1d16d0702b06 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:04.836392 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-18a19784-739b-4d9d-b229-1d16d0702b06 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:05.326010 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-788ba4f5-3795-469a-9107-78bd33a52448 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:05.356598 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-788ba4f5-3795-469a-9107-78bd33a52448 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:05.370315 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-788ba4f5-3795-469a-9107-78bd33a52448 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:05.377051 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-788ba4f5-3795-469a-9107-78bd33a52448 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1666 microversion: 2.20 time: 0.635221 Jun 10 18:25:05.402454 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2829/5706] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:25:04 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1666 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:25:05.413555 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-26c3ad02-6f6e-4693-b11b-a9830e827845 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:05.414188 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-26c3ad02-6f6e-4693-b11b-a9830e827845 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] [instance: 1c3ad389-7452-4525-a7b3-02b207d522a7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:05.438828 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-26c3ad02-6f6e-4693-b11b-a9830e827845 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:05.439322 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-26c3ad02-6f6e-4693-b11b-a9830e827845 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:05.450364 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-26c3ad02-6f6e-4693-b11b-a9830e827845 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:05.450860 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-26c3ad02-6f6e-4693-b11b-a9830e827845 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:05.505400 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-26c3ad02-6f6e-4693-b11b-a9830e827845 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] HTTP exception thrown: Instance 1c3ad389-7452-4525-a7b3-02b207d522a7 could not be found. Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-26c3ad02-6f6e-4693-b11b-a9830e827845 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Request method failure captured: Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7 HTTP/1.1 Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4rKtxYJwOFP7pn52GN9IX8YRRL01Q9CWh9Ulq0spPSWV7QqB0QQxg_sBPi2BsVn0vvSjntQ7U1qQJp_63TJBxwrb2CdKzwAeyf8O3VFmj3hhnBfSGCNPxnfUKiqBxIl8qgGW8IRCu6c_eNxG1R03dCg4XX3jHQwoEnoBvkoqDGc_8M Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 0e251487dbdd4ceea1446f703b8b1e92 Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-TestVolumeBackupRestore-2110513361 Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/0e251487dbdd4ceea1446f703b8b1e92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/0e251487dbdd4ceea1446f703b8b1e92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/0e251487dbdd4ceea1446f703b8b1e92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_0e251487dbdd4ceea1446f703b8b1e92", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-TestVolumeBackupRestore-2110513361 Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 0e251487dbdd4ceea1446f703b8b1e92 Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-TestVolumeBackupRestore-2110513361 Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-TestVolumeBackupRestore-2110513361-project Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: bc2d5bd2da034c0a916c92cfada76f28 Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-TestVolumeBackupRestore-2110513361-project Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 1c3ad389-7452-4525-a7b3-02b207d522a7 could not be found. Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '1c3ad389-7452-4525-a7b3-02b207d522a7'} Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c3ad389-7452-4525-a7b3-02b207d522a7 could not be found. Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c3ad389-7452-4525-a7b3-02b207d522a7 could not be found. Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:25:05.509473 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:25:05.528343 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:25:05.528343 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:25:05.528343 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:25:05.528343 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:25:05.528343 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:25:05.528343 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c3ad389-7452-4525-a7b3-02b207d522a7 could not be found. Jun 10 18:25:05.528343 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:25:05.528343 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-26c3ad02-6f6e-4693-b11b-a9830e827845 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Returning 404 to user: Instance 1c3ad389-7452-4525-a7b3-02b207d522a7 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:25:05.528343 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-26c3ad02-6f6e-4693-b11b-a9830e827845 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] 10.222.0.35 "GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7" status: 404 len: 111 microversion: 2.1 time: 0.107452 Jun 10 18:25:05.534100 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2830/5707] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:25:05 2022] GET /compute/v2.1/servers/1c3ad389-7452-4525-a7b3-02b207d522a7 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:25:05.542781 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e0e2fee3-3ea4-413b-a2c4-f017ce238ef6 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "634bb73c-0c06-4bf4-82b7-72af2468332e"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:25:05.544089 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e0e2fee3-3ea4-413b-a2c4-f017ce238ef6 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:05.555208 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e0e2fee3-3ea4-413b-a2c4-f017ce238ef6 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:05.556064 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e0e2fee3-3ea4-413b-a2c4-f017ce238ef6 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:05.562662 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e0e2fee3-3ea4-413b-a2c4-f017ce238ef6 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:05.562662 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e0e2fee3-3ea4-413b-a2c4-f017ce238ef6 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:05.604167 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-18a19784-739b-4d9d-b229-1d16d0702b06 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:05.620185 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-18a19784-739b-4d9d-b229-1d16d0702b06 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:05.624524 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-18a19784-739b-4d9d-b229-1d16d0702b06 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:05.630067 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-18a19784-739b-4d9d-b229-1d16d0702b06 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] 10.222.0.35 "GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c" status: 200 len: 1361 microversion: 2.26 time: 0.820772 Jun 10 18:25:05.631306 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2878/5708] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:25:04 2022] GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c => generated 1361 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:25:06.158625 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7ace2454-e550-47d3-91b6-a1f08a2ebee0 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] Calling method '.version_select at 0x7f77c6257790>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:06.329778 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7ace2454-e550-47d3-91b6-a1f08a2ebee0 tempest-TestVolumeBackupRestore-2110513361 tempest-TestVolumeBackupRestore-2110513361-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-370767049" status: 202 len: 0 microversion: 2.1 time: 0.176275 Jun 10 18:25:06.330563 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2879/5709] 10.222.0.35 () {58 vars in 1265 bytes} [Fri Jun 10 18:25:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-370767049 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 18:25:06.654189 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d5755752-7798-40b4-a456-18a3e33c5a65 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:06.655548 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d5755752-7798-40b4-a456-18a3e33c5a65 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] [instance: 14781343-216b-44e9-9a93-b4d318f2531c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:06.664856 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d5755752-7798-40b4-a456-18a3e33c5a65 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:06.665534 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d5755752-7798-40b4-a456-18a3e33c5a65 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:06.666770 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d5755752-7798-40b4-a456-18a3e33c5a65 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:06.667374 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d5755752-7798-40b4-a456-18a3e33c5a65 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:07.036533 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d5755752-7798-40b4-a456-18a3e33c5a65 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:07.050007 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d5755752-7798-40b4-a456-18a3e33c5a65 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:07.051725 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d5755752-7798-40b4-a456-18a3e33c5a65 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:07.056179 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d5755752-7798-40b4-a456-18a3e33c5a65 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] 10.222.0.35 "GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c" status: 200 len: 1361 microversion: 2.26 time: 0.405738 Jun 10 18:25:07.058358 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2880/5710] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:25:06 2022] GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c => generated 1361 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:25:07.662158 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e0e2fee3-3ea4-413b-a2c4-f017ce238ef6 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "POST /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 2.120256 Jun 10 18:25:07.672667 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2831/5711] 10.222.0.35 () {62 vars in 1363 bytes} [Fri Jun 10 18:25:05 2022] POST /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa/os-volume_attachments => generated 188 bytes in 2140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:25:08.014881 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-926006e3-142d-429d-a9df-cec4edc0904a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:08.015517 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-926006e3-142d-429d-a9df-cec4edc0904a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:08.050260 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-926006e3-142d-429d-a9df-cec4edc0904a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:08.059933 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-926006e3-142d-429d-a9df-cec4edc0904a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:08.060867 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-926006e3-142d-429d-a9df-cec4edc0904a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:08.061887 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-926006e3-142d-429d-a9df-cec4edc0904a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:08.084092 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-094d6703-81d9-4ed6-9586-423e367a30bb tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:08.084778 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-094d6703-81d9-4ed6-9586-423e367a30bb tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] [instance: 14781343-216b-44e9-9a93-b4d318f2531c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:08.111939 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-094d6703-81d9-4ed6-9586-423e367a30bb tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:08.112652 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-094d6703-81d9-4ed6-9586-423e367a30bb tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:08.113630 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-094d6703-81d9-4ed6-9586-423e367a30bb tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:08.116041 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-094d6703-81d9-4ed6-9586-423e367a30bb tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:09.431331 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-926006e3-142d-429d-a9df-cec4edc0904a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "DELETE /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa/os-volume_attachments/634bb73c-0c06-4bf4-82b7-72af2468332e" status: 202 len: 0 microversion: 2.20 time: 1.412359 Jun 10 18:25:09.431331 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2881/5712] 10.222.0.35 () {60 vars in 1456 bytes} [Fri Jun 10 18:25:08 2022] DELETE /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa/os-volume_attachments/634bb73c-0c06-4bf4-82b7-72af2468332e => generated 0 bytes in 1416 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:25:09.432695 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-107ac114-ea60-4967-a755-5b74be632151 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:09.432695 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-107ac114-ea60-4967-a755-5b74be632151 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:09.446834 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-107ac114-ea60-4967-a755-5b74be632151 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:09.447592 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-107ac114-ea60-4967-a755-5b74be632151 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:09.452860 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-107ac114-ea60-4967-a755-5b74be632151 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:09.456597 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-107ac114-ea60-4967-a755-5b74be632151 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:09.585525 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-107ac114-ea60-4967-a755-5b74be632151 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2/ips" status: 200 len: 150 microversion: 2.1 time: 0.158868 Jun 10 18:25:09.617783 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2882/5713] 10.222.0.35 () {58 vars in 1247 bytes} [Fri Jun 10 18:25:09 2022] GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2/ips => generated 150 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:25:09.623204 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f62383c7-4738-4825-982e-54144d845f2d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:25:09.629008 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f62383c7-4738-4825-982e-54144d845f2d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:09.647713 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f62383c7-4738-4825-982e-54144d845f2d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:09.655321 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f62383c7-4738-4825-982e-54144d845f2d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:09.655321 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f62383c7-4738-4825-982e-54144d845f2d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:09.655321 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f62383c7-4738-4825-982e-54144d845f2d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:09.690424 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-094d6703-81d9-4ed6-9586-423e367a30bb tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:09.707577 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-094d6703-81d9-4ed6-9586-423e367a30bb tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:09.710167 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-094d6703-81d9-4ed6-9586-423e367a30bb tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:09.711350 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-094d6703-81d9-4ed6-9586-423e367a30bb tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] 10.222.0.35 "GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c" status: 200 len: 1361 microversion: 2.26 time: 1.638402 Jun 10 18:25:09.712458 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2832/5714] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:25:08 2022] GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c => generated 1361 bytes in 1640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:25:10.356441 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f62383c7-4738-4825-982e-54144d845f2d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "POST /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa/action" status: 202 len: 0 microversion: 2.20 time: 0.739296 Jun 10 18:25:10.364077 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2883/5715] 10.222.0.35 () {62 vars in 1318 bytes} [Fri Jun 10 18:25:09 2022] POST /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa/action => generated 0 bytes in 748 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:25:10.369238 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-36997fd5-85c0-4a13-b54c-0db2afa51205 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:10.369854 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-36997fd5-85c0-4a13-b54c-0db2afa51205 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:10.395153 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-36997fd5-85c0-4a13-b54c-0db2afa51205 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:10.395623 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-36997fd5-85c0-4a13-b54c-0db2afa51205 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:10.400369 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-36997fd5-85c0-4a13-b54c-0db2afa51205 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:10.401956 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-36997fd5-85c0-4a13-b54c-0db2afa51205 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:10.731252 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9d2c1dd5-90ec-41b9-a5ad-14caad8387bf tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:10.732566 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9d2c1dd5-90ec-41b9-a5ad-14caad8387bf tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] [instance: 14781343-216b-44e9-9a93-b4d318f2531c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:10.749021 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9d2c1dd5-90ec-41b9-a5ad-14caad8387bf tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:10.765324 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9d2c1dd5-90ec-41b9-a5ad-14caad8387bf tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:10.770785 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9d2c1dd5-90ec-41b9-a5ad-14caad8387bf tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:10.770785 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9d2c1dd5-90ec-41b9-a5ad-14caad8387bf tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:11.390142 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-36997fd5-85c0-4a13-b54c-0db2afa51205 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:11.457739 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9d2c1dd5-90ec-41b9-a5ad-14caad8387bf tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:11.466479 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9d2c1dd5-90ec-41b9-a5ad-14caad8387bf tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:11.473917 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9d2c1dd5-90ec-41b9-a5ad-14caad8387bf tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:11.480792 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-36997fd5-85c0-4a13-b54c-0db2afa51205 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:11.487124 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-36997fd5-85c0-4a13-b54c-0db2afa51205 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:11.490026 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9d2c1dd5-90ec-41b9-a5ad-14caad8387bf tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] 10.222.0.35 "GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c" status: 200 len: 1361 microversion: 2.26 time: 0.762778 Jun 10 18:25:11.494714 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-36997fd5-85c0-4a13-b54c-0db2afa51205 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1674 microversion: 2.20 time: 1.130616 Jun 10 18:25:11.496699 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2884/5716] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:25:10 2022] GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c => generated 1361 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:25:11.512515 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2833/5717] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:25:10 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1674 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:25:11.838934 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-9c602918-cc51-4c32-a40e-261fecc2afc6 req-48eb736a-07a3-4c67-95a1-e08fca572f17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14781343-216b-44e9-9a93-b4d318f2531c", "name": "network-vif-plugged", "status": "completed", "tag": "b5e0a08f-0448-4601-a199-0ce443b00a70"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:25:11.862330 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-9c602918-cc51-4c32-a40e-261fecc2afc6 req-48eb736a-07a3-4c67-95a1-e08fca572f17 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:11.862785 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-9c602918-cc51-4c32-a40e-261fecc2afc6 req-48eb736a-07a3-4c67-95a1-e08fca572f17 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:11.918581 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-9c602918-cc51-4c32-a40e-261fecc2afc6 req-48eb736a-07a3-4c67-95a1-e08fca572f17 service nova] Creating event network-vif-plugged:b5e0a08f-0448-4601-a199-0ce443b00a70 for instance 14781343-216b-44e9-9a93-b4d318f2531c on chh1-master-2 Jun 10 18:25:11.934436 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-9c602918-cc51-4c32-a40e-261fecc2afc6 req-48eb736a-07a3-4c67-95a1-e08fca572f17 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099057 Jun 10 18:25:11.956804 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2885/5718] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:25:12.508882 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1031be76-781c-4ec0-9402-e5a6913f654a tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:12.509381 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1031be76-781c-4ec0-9402-e5a6913f654a tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] [instance: 14781343-216b-44e9-9a93-b4d318f2531c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:12.522832 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-99304abc-b6e7-44d4-ab3e-420057a7371f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:12.523642 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-99304abc-b6e7-44d4-ab3e-420057a7371f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:12.538602 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1031be76-781c-4ec0-9402-e5a6913f654a tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:12.558986 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-99304abc-b6e7-44d4-ab3e-420057a7371f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:12.559494 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-99304abc-b6e7-44d4-ab3e-420057a7371f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:12.560336 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-99304abc-b6e7-44d4-ab3e-420057a7371f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:12.560787 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-99304abc-b6e7-44d4-ab3e-420057a7371f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:12.562644 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1031be76-781c-4ec0-9402-e5a6913f654a tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:12.563777 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1031be76-781c-4ec0-9402-e5a6913f654a tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:12.564245 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1031be76-781c-4ec0-9402-e5a6913f654a tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:13.469140 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-99304abc-b6e7-44d4-ab3e-420057a7371f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:13.485516 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-99304abc-b6e7-44d4-ab3e-420057a7371f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:13.494608 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-99304abc-b6e7-44d4-ab3e-420057a7371f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:13.496140 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-99304abc-b6e7-44d4-ab3e-420057a7371f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1674 microversion: 2.20 time: 0.984810 Jun 10 18:25:13.504746 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2886/5719] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:25:12 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1674 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:25:13.531695 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1031be76-781c-4ec0-9402-e5a6913f654a tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:13.559803 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1031be76-781c-4ec0-9402-e5a6913f654a tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:13.561699 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1031be76-781c-4ec0-9402-e5a6913f654a tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:13.562915 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1031be76-781c-4ec0-9402-e5a6913f654a tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] 10.222.0.35 "GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c" status: 200 len: 1361 microversion: 2.26 time: 1.058141 Jun 10 18:25:13.568912 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2834/5720] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:25:12 2022] GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c => generated 1361 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:25:14.515683 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-134f104a-75cc-4985-b0a5-fda679b153fd tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:14.517213 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-134f104a-75cc-4985-b0a5-fda679b153fd tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:14.532027 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-134f104a-75cc-4985-b0a5-fda679b153fd tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:14.533791 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-134f104a-75cc-4985-b0a5-fda679b153fd tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:14.542228 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5b5be91f-5c2e-4db3-875d-33fd78369cfa tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d979c9aa-ce7b-48a7-90be-9aeb4d0e1f51"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:25:14.543375 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5b5be91f-5c2e-4db3-875d-33fd78369cfa tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:14.553472 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-134f104a-75cc-4985-b0a5-fda679b153fd tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:14.554064 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-134f104a-75cc-4985-b0a5-fda679b153fd tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:14.570956 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5b5be91f-5c2e-4db3-875d-33fd78369cfa tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:14.571408 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5b5be91f-5c2e-4db3-875d-33fd78369cfa tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:14.572194 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5b5be91f-5c2e-4db3-875d-33fd78369cfa tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:14.593866 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5b5be91f-5c2e-4db3-875d-33fd78369cfa tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:15.336699 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-134f104a-75cc-4985-b0a5-fda679b153fd tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:15.346518 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-134f104a-75cc-4985-b0a5-fda679b153fd tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:15.349871 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-134f104a-75cc-4985-b0a5-fda679b153fd tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:15.351441 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-134f104a-75cc-4985-b0a5-fda679b153fd tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1674 microversion: 2.20 time: 0.840683 Jun 10 18:25:15.354811 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2887/5721] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:25:14 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1674 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:25:15.362367 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d5c7a7b3-e81f-44bd-abee-4b7c38728101 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:15.364841 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d5c7a7b3-e81f-44bd-abee-4b7c38728101 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] [instance: 14781343-216b-44e9-9a93-b4d318f2531c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:15.372125 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d5c7a7b3-e81f-44bd-abee-4b7c38728101 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:15.372903 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d5c7a7b3-e81f-44bd-abee-4b7c38728101 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:15.374389 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d5c7a7b3-e81f-44bd-abee-4b7c38728101 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:15.375143 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d5c7a7b3-e81f-44bd-abee-4b7c38728101 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:15.823289 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5b5be91f-5c2e-4db3-875d-33fd78369cfa tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "POST /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.285274 Jun 10 18:25:15.823926 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2835/5722] 10.222.0.35 () {60 vars in 1322 bytes} [Fri Jun 10 18:25:14 2022] POST /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2/os-volume_attachments => generated 194 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:25:16.006233 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d5c7a7b3-e81f-44bd-abee-4b7c38728101 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:16.027173 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d5c7a7b3-e81f-44bd-abee-4b7c38728101 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:16.032041 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d5c7a7b3-e81f-44bd-abee-4b7c38728101 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:16.050150 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d5c7a7b3-e81f-44bd-abee-4b7c38728101 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] 10.222.0.35 "GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c" status: 200 len: 1545 microversion: 2.26 time: 0.678565 Jun 10 18:25:16.096240 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2888/5723] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:25:15 2022] GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c => generated 1545 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:25:16.100458 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b618a9d5-4fe5-4e21-a2f7-a4591fb42977 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Calling method '.version_select at 0x7f77c17fc670>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:16.112682 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b618a9d5-4fe5-4e21-a2f7-a4591fb42977 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:16.124979 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b618a9d5-4fe5-4e21-a2f7-a4591fb42977 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:16.124979 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b618a9d5-4fe5-4e21-a2f7-a4591fb42977 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] [instance: 14781343-216b-44e9-9a93-b4d318f2531c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:16.149711 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b618a9d5-4fe5-4e21-a2f7-a4591fb42977 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:16.150522 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b618a9d5-4fe5-4e21-a2f7-a4591fb42977 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:16.159425 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b618a9d5-4fe5-4e21-a2f7-a4591fb42977 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:16.160556 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b618a9d5-4fe5-4e21-a2f7-a4591fb42977 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:16.236064 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b618a9d5-4fe5-4e21-a2f7-a4591fb42977 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:16.238267 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b618a9d5-4fe5-4e21-a2f7-a4591fb42977 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:16.253154 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:25:16.301903 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b618a9d5-4fe5-4e21-a2f7-a4591fb42977 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:16.302376 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b618a9d5-4fe5-4e21-a2f7-a4591fb42977 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:16.375148 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6c5797de-9946-401b-aa37-19bb90fbb1d7 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:16.376021 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6c5797de-9946-401b-aa37-19bb90fbb1d7 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:16.387958 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6c5797de-9946-401b-aa37-19bb90fbb1d7 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:16.389517 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6c5797de-9946-401b-aa37-19bb90fbb1d7 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:16.390636 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6c5797de-9946-401b-aa37-19bb90fbb1d7 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:16.393283 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6c5797de-9946-401b-aa37-19bb90fbb1d7 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:16.444103 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-b618a9d5-4fe5-4e21-a2f7-a4591fb42977 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lazy-loading 'flavor' on Instance uuid 14781343-216b-44e9-9a93-b4d318f2531c {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:25:16.483040 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b618a9d5-4fe5-4e21-a2f7-a4591fb42977 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] 10.222.0.35 "PUT /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c/tags/tempest-tag-1404588570" status: 201 len: 0 microversion: 2.26 time: 0.386814 Jun 10 18:25:16.485233 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2836/5724] 10.222.0.35 () {62 vars in 1379 bytes} [Fri Jun 10 18:25:16 2022] PUT /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c/tags/tempest-tag-1404588570 => generated 0 bytes in 390 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Jun 10 18:25:16.499447 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c6d7e3bf-6fa3-42b8-bb8e-03947b227d4d tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Calling method '.version_select at 0x7f77c122e550>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:16.534721 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c6d7e3bf-6fa3-42b8-bb8e-03947b227d4d tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:16.539244 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c6d7e3bf-6fa3-42b8-bb8e-03947b227d4d tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:16.586355 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c6d7e3bf-6fa3-42b8-bb8e-03947b227d4d tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] 10.222.0.35 "GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c/tags/tempest-tag-1404588570" status: 204 len: 0 microversion: 2.26 time: 0.096853 Jun 10 18:25:16.591660 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2837/5725] 10.222.0.35 () {60 vars in 1360 bytes} [Fri Jun 10 18:25:16 2022] GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c/tags/tempest-tag-1404588570 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 10 18:25:16.611294 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-43fcff9e-22db-4d03-8c00-65617c4d4709 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Calling method '.version_select at 0x7f77c122e1f0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:16.629369 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-43fcff9e-22db-4d03-8c00-65617c4d4709 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:16.629831 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-43fcff9e-22db-4d03-8c00-65617c4d4709 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:16.630326 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-43fcff9e-22db-4d03-8c00-65617c4d4709 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] [instance: 14781343-216b-44e9-9a93-b4d318f2531c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:16.665527 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-43fcff9e-22db-4d03-8c00-65617c4d4709 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:16.668583 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-43fcff9e-22db-4d03-8c00-65617c4d4709 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:16.669505 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-43fcff9e-22db-4d03-8c00-65617c4d4709 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:16.670489 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-43fcff9e-22db-4d03-8c00-65617c4d4709 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:16.753440 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-43fcff9e-22db-4d03-8c00-65617c4d4709 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:16.753440 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-43fcff9e-22db-4d03-8c00-65617c4d4709 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:16.819651 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6c5797de-9946-401b-aa37-19bb90fbb1d7 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:16.837685 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6c5797de-9946-401b-aa37-19bb90fbb1d7 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:16.843377 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6c5797de-9946-401b-aa37-19bb90fbb1d7 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:16.844824 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6c5797de-9946-401b-aa37-19bb90fbb1d7 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1732 microversion: 2.20 time: 0.475431 Jun 10 18:25:16.861094 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2889/5726] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:25:16 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1732 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:25:16.877208 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-43fcff9e-22db-4d03-8c00-65617c4d4709 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lazy-loading 'flavor' on Instance uuid 14781343-216b-44e9-9a93-b4d318f2531c {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:25:16.906319 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-43fcff9e-22db-4d03-8c00-65617c4d4709 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] 10.222.0.35 "DELETE /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c/tags" status: 204 len: 0 microversion: 2.26 time: 0.309840 Jun 10 18:25:16.907569 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2838/5727] 10.222.0.35 () {60 vars in 1294 bytes} [Fri Jun 10 18:25:16 2022] DELETE /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c/tags => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 10 18:25:16.917002 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ea1b4c8a-c099-4457-ade0-dc4758b36474 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Calling method '.version_select at 0x7f77c62579d0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:16.933285 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ea1b4c8a-c099-4457-ade0-dc4758b36474 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:16.935914 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ea1b4c8a-c099-4457-ade0-dc4758b36474 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:16.973646 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ea1b4c8a-c099-4457-ade0-dc4758b36474 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] 10.222.0.35 "GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c/tags" status: 200 len: 12 microversion: 2.26 time: 0.060952 Jun 10 18:25:16.974862 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2890/5728] 10.222.0.35 () {60 vars in 1291 bytes} [Fri Jun 10 18:25:16 2022] GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c/tags => generated 12 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:25:16.987439 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d2525cb0-abfa-48cb-8886-977bbc9fbbf1 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Calling method '.version_select at 0x7f77c11755e0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:17.003743 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d2525cb0-abfa-48cb-8886-977bbc9fbbf1 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:17.005648 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d2525cb0-abfa-48cb-8886-977bbc9fbbf1 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:17.006315 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d2525cb0-abfa-48cb-8886-977bbc9fbbf1 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] [instance: 14781343-216b-44e9-9a93-b4d318f2531c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:17.027685 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d2525cb0-abfa-48cb-8886-977bbc9fbbf1 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:17.028121 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d2525cb0-abfa-48cb-8886-977bbc9fbbf1 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:17.028957 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d2525cb0-abfa-48cb-8886-977bbc9fbbf1 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:17.029944 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d2525cb0-abfa-48cb-8886-977bbc9fbbf1 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:17.099278 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d2525cb0-abfa-48cb-8886-977bbc9fbbf1 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:17.100016 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d2525cb0-abfa-48cb-8886-977bbc9fbbf1 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:17.126315 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d2525cb0-abfa-48cb-8886-977bbc9fbbf1 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:17.126315 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d2525cb0-abfa-48cb-8886-977bbc9fbbf1 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:17.262734 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-d2525cb0-abfa-48cb-8886-977bbc9fbbf1 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lazy-loading 'flavor' on Instance uuid 14781343-216b-44e9-9a93-b4d318f2531c {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:25:17.321137 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d2525cb0-abfa-48cb-8886-977bbc9fbbf1 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] 10.222.0.35 "PUT /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c/tags/tempest-tag-173333337" status: 201 len: 0 microversion: 2.26 time: 0.340462 Jun 10 18:25:17.329821 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2839/5729] 10.222.0.35 () {62 vars in 1376 bytes} [Fri Jun 10 18:25:16 2022] PUT /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c/tags/tempest-tag-173333337 => generated 0 bytes in 346 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jun 10 18:25:17.340230 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e6feadad-421d-491f-8172-afb3ac4c2c22 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Calling method '.version_select at 0x7f77b3a5fe50>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:17.354311 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e6feadad-421d-491f-8172-afb3ac4c2c22 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:17.354774 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e6feadad-421d-491f-8172-afb3ac4c2c22 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:17.379581 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e6feadad-421d-491f-8172-afb3ac4c2c22 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] 10.222.0.35 "GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c/tags" status: 200 len: 35 microversion: 2.26 time: 0.047784 Jun 10 18:25:17.381475 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2891/5730] 10.222.0.35 () {60 vars in 1291 bytes} [Fri Jun 10 18:25:17 2022] GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c/tags => generated 35 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:25:17.402459 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-436f2525-a1ba-497e-a092-b2f9fbfa4e1e tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Calling method '.version_select at 0x7f77c1251e50>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:17.427229 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-436f2525-a1ba-497e-a092-b2f9fbfa4e1e tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:17.431211 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-436f2525-a1ba-497e-a092-b2f9fbfa4e1e tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:17.432952 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-436f2525-a1ba-497e-a092-b2f9fbfa4e1e tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] [instance: 14781343-216b-44e9-9a93-b4d318f2531c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:17.459844 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-436f2525-a1ba-497e-a092-b2f9fbfa4e1e tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:17.460445 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-436f2525-a1ba-497e-a092-b2f9fbfa4e1e tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:17.461624 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-436f2525-a1ba-497e-a092-b2f9fbfa4e1e tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:17.462254 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-436f2525-a1ba-497e-a092-b2f9fbfa4e1e tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:17.538166 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-436f2525-a1ba-497e-a092-b2f9fbfa4e1e tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:17.544987 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-436f2525-a1ba-497e-a092-b2f9fbfa4e1e tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:17.661371 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-436f2525-a1ba-497e-a092-b2f9fbfa4e1e tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lazy-loading 'flavor' on Instance uuid 14781343-216b-44e9-9a93-b4d318f2531c {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:25:17.702255 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-436f2525-a1ba-497e-a092-b2f9fbfa4e1e tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] 10.222.0.35 "DELETE /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c/tags/tempest-tag-173333337" status: 204 len: 0 microversion: 2.26 time: 0.314941 Jun 10 18:25:17.703318 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2840/5731] 10.222.0.35 () {60 vars in 1360 bytes} [Fri Jun 10 18:25:17 2022] DELETE /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c/tags/tempest-tag-173333337 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 10 18:25:17.714933 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-133c9673-1f8a-4c5e-959b-fd598ab325a1 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Calling method '.version_select at 0x7f77b3b893a0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:17.738426 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-133c9673-1f8a-4c5e-959b-fd598ab325a1 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:17.738929 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-133c9673-1f8a-4c5e-959b-fd598ab325a1 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:17.764703 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-133c9673-1f8a-4c5e-959b-fd598ab325a1 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] 10.222.0.35 "GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c/tags" status: 200 len: 12 microversion: 2.26 time: 0.055666 Jun 10 18:25:17.765282 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2892/5732] 10.222.0.35 () {60 vars in 1291 bytes} [Fri Jun 10 18:25:17 2022] GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c/tags => generated 12 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:25:17.776537 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-526290e6-e0cf-45b8-bad5-45e68d9d329a tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Calling method '.version_select at 0x7f77c162bca0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:17.794713 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-526290e6-e0cf-45b8-bad5-45e68d9d329a tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:17.795405 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-526290e6-e0cf-45b8-bad5-45e68d9d329a tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:17.797179 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-526290e6-e0cf-45b8-bad5-45e68d9d329a tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] [instance: 14781343-216b-44e9-9a93-b4d318f2531c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:17.819188 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-526290e6-e0cf-45b8-bad5-45e68d9d329a tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:17.819903 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-526290e6-e0cf-45b8-bad5-45e68d9d329a tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:17.820893 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-526290e6-e0cf-45b8-bad5-45e68d9d329a tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:17.821484 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-526290e6-e0cf-45b8-bad5-45e68d9d329a tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:17.864710 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2c4a2405-234c-4fbb-acf7-1f77c27c6dfa tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:17.865797 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2c4a2405-234c-4fbb-acf7-1f77c27c6dfa tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:17.876565 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2c4a2405-234c-4fbb-acf7-1f77c27c6dfa tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:17.881809 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-526290e6-e0cf-45b8-bad5-45e68d9d329a tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:17.883156 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2c4a2405-234c-4fbb-acf7-1f77c27c6dfa tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:17.890023 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2c4a2405-234c-4fbb-acf7-1f77c27c6dfa tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:17.891786 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2c4a2405-234c-4fbb-acf7-1f77c27c6dfa tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:17.897160 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-526290e6-e0cf-45b8-bad5-45e68d9d329a tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:17.924578 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-526290e6-e0cf-45b8-bad5-45e68d9d329a tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lazy-loading 'flavor' on Instance uuid 14781343-216b-44e9-9a93-b4d318f2531c {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:25:17.976812 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-526290e6-e0cf-45b8-bad5-45e68d9d329a tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] 10.222.0.35 "DELETE /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c/tags" status: 204 len: 0 microversion: 2.26 time: 0.205007 Jun 10 18:25:17.980165 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2841/5733] 10.222.0.35 () {60 vars in 1294 bytes} [Fri Jun 10 18:25:17 2022] DELETE /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c/tags => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 10 18:25:17.991614 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-428c4500-dbad-468e-a30b-0537225394d9 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Calling method '.version_select at 0x7f77c17fc310>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:18.026011 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-428c4500-dbad-468e-a30b-0537225394d9 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:18.040989 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-428c4500-dbad-468e-a30b-0537225394d9 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:18.044226 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-428c4500-dbad-468e-a30b-0537225394d9 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] [instance: 14781343-216b-44e9-9a93-b4d318f2531c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:18.077840 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-428c4500-dbad-468e-a30b-0537225394d9 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:18.083830 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-428c4500-dbad-468e-a30b-0537225394d9 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:18.087551 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-428c4500-dbad-468e-a30b-0537225394d9 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:18.088021 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-428c4500-dbad-468e-a30b-0537225394d9 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:18.159059 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-428c4500-dbad-468e-a30b-0537225394d9 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:18.160007 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-428c4500-dbad-468e-a30b-0537225394d9 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:18.176187 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-428c4500-dbad-468e-a30b-0537225394d9 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:18.201242 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-428c4500-dbad-468e-a30b-0537225394d9 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:18.383055 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-428c4500-dbad-468e-a30b-0537225394d9 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lazy-loading 'flavor' on Instance uuid 14781343-216b-44e9-9a93-b4d318f2531c {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:25:18.394425 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2c4a2405-234c-4fbb-acf7-1f77c27c6dfa tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:18.399159 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:25:18.413861 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2c4a2405-234c-4fbb-acf7-1f77c27c6dfa tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:18.426162 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-428c4500-dbad-468e-a30b-0537225394d9 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] 10.222.0.35 "PUT /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c/tags/tempest-tag-1363254035" status: 201 len: 0 microversion: 2.26 time: 0.439198 Jun 10 18:25:18.432662 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2842/5734] 10.222.0.35 () {62 vars in 1379 bytes} [Fri Jun 10 18:25:17 2022] PUT /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c/tags/tempest-tag-1363254035 => generated 0 bytes in 446 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jun 10 18:25:18.441569 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7d5f378b-f2f6-49f9-8392-1424c896cfa0 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Calling method '.version_select at 0x7f77c6108f70>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:18.441832 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2c4a2405-234c-4fbb-acf7-1f77c27c6dfa tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:18.454111 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2c4a2405-234c-4fbb-acf7-1f77c27c6dfa tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1732 microversion: 2.20 time: 0.583853 Jun 10 18:25:18.457619 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2893/5735] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:25:17 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1732 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:25:18.493937 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7d5f378b-f2f6-49f9-8392-1424c896cfa0 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:18.502961 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7d5f378b-f2f6-49f9-8392-1424c896cfa0 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:18.502961 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7d5f378b-f2f6-49f9-8392-1424c896cfa0 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] [instance: 14781343-216b-44e9-9a93-b4d318f2531c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:18.547423 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7d5f378b-f2f6-49f9-8392-1424c896cfa0 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:18.548976 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7d5f378b-f2f6-49f9-8392-1424c896cfa0 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:18.554111 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7d5f378b-f2f6-49f9-8392-1424c896cfa0 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:18.556335 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7d5f378b-f2f6-49f9-8392-1424c896cfa0 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:18.637165 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7d5f378b-f2f6-49f9-8392-1424c896cfa0 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:18.640447 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7d5f378b-f2f6-49f9-8392-1424c896cfa0 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:18.683408 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7d5f378b-f2f6-49f9-8392-1424c896cfa0 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:18.683889 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7d5f378b-f2f6-49f9-8392-1424c896cfa0 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:18.806612 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-7d5f378b-f2f6-49f9-8392-1424c896cfa0 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lazy-loading 'flavor' on Instance uuid 14781343-216b-44e9-9a93-b4d318f2531c {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:25:18.849805 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7d5f378b-f2f6-49f9-8392-1424c896cfa0 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] 10.222.0.35 "PUT /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c/tags/tempest-tag-1842271003" status: 201 len: 0 microversion: 2.26 time: 0.412693 Jun 10 18:25:18.857674 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2843/5736] 10.222.0.35 () {62 vars in 1379 bytes} [Fri Jun 10 18:25:18 2022] PUT /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c/tags/tempest-tag-1842271003 => generated 0 bytes in 417 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jun 10 18:25:18.865485 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4ea31691-0d7f-40a2-82ba-a0fbf0017cb1 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Calling method '.version_select at 0x7f77b3ba24c0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:18.888150 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4ea31691-0d7f-40a2-82ba-a0fbf0017cb1 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:18.888374 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4ea31691-0d7f-40a2-82ba-a0fbf0017cb1 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:18.890974 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4ea31691-0d7f-40a2-82ba-a0fbf0017cb1 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] [instance: 14781343-216b-44e9-9a93-b4d318f2531c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:18.910158 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4ea31691-0d7f-40a2-82ba-a0fbf0017cb1 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:18.910843 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4ea31691-0d7f-40a2-82ba-a0fbf0017cb1 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:18.914532 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4ea31691-0d7f-40a2-82ba-a0fbf0017cb1 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:18.916444 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4ea31691-0d7f-40a2-82ba-a0fbf0017cb1 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:18.984443 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4ea31691-0d7f-40a2-82ba-a0fbf0017cb1 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:18.986874 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4ea31691-0d7f-40a2-82ba-a0fbf0017cb1 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:19.109211 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-4ea31691-0d7f-40a2-82ba-a0fbf0017cb1 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lazy-loading 'flavor' on Instance uuid 14781343-216b-44e9-9a93-b4d318f2531c {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:25:19.175612 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4ea31691-0d7f-40a2-82ba-a0fbf0017cb1 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] 10.222.0.35 "DELETE /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c/tags" status: 204 len: 0 microversion: 2.26 time: 0.315760 Jun 10 18:25:19.176257 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2894/5737] 10.222.0.35 () {60 vars in 1294 bytes} [Fri Jun 10 18:25:18 2022] DELETE /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c/tags => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 10 18:25:19.186653 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-debc34eb-84a6-474d-804e-33fd11953049 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Calling method '.version_select at 0x7f77c12c31f0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:19.221479 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-debc34eb-84a6-474d-804e-33fd11953049 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:19.227223 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-debc34eb-84a6-474d-804e-33fd11953049 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:19.272553 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-debc34eb-84a6-474d-804e-33fd11953049 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] 10.222.0.35 "GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c/tags" status: 200 len: 12 microversion: 2.26 time: 0.090376 Jun 10 18:25:19.279499 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2844/5738] 10.222.0.35 () {60 vars in 1291 bytes} [Fri Jun 10 18:25:19 2022] GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c/tags => generated 12 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:25:19.284562 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c2a34ca2-7d4d-40bb-ac13-fc2c5ab24ba0 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Calling method '.version_select at 0x7f77b3c41790>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:19.294611 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c2a34ca2-7d4d-40bb-ac13-fc2c5ab24ba0 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:19.304787 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c2a34ca2-7d4d-40bb-ac13-fc2c5ab24ba0 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:19.304787 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c2a34ca2-7d4d-40bb-ac13-fc2c5ab24ba0 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] [instance: 14781343-216b-44e9-9a93-b4d318f2531c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:19.327946 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c2a34ca2-7d4d-40bb-ac13-fc2c5ab24ba0 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:19.327946 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c2a34ca2-7d4d-40bb-ac13-fc2c5ab24ba0 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:19.328593 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c2a34ca2-7d4d-40bb-ac13-fc2c5ab24ba0 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:19.334260 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c2a34ca2-7d4d-40bb-ac13-fc2c5ab24ba0 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:19.399861 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c2a34ca2-7d4d-40bb-ac13-fc2c5ab24ba0 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:19.411240 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c2a34ca2-7d4d-40bb-ac13-fc2c5ab24ba0 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:19.452030 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-c2a34ca2-7d4d-40bb-ac13-fc2c5ab24ba0 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lazy-loading 'flavor' on Instance uuid 14781343-216b-44e9-9a93-b4d318f2531c {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:25:19.474482 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-86ba6fac-3a4e-405a-9a31-537f3dc512de tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:19.475386 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-86ba6fac-3a4e-405a-9a31-537f3dc512de tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:19.486055 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86ba6fac-3a4e-405a-9a31-537f3dc512de tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:19.487366 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86ba6fac-3a4e-405a-9a31-537f3dc512de tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:19.488115 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c2a34ca2-7d4d-40bb-ac13-fc2c5ab24ba0 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] 10.222.0.35 "DELETE /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c/tags" status: 204 len: 0 microversion: 2.26 time: 0.207721 Jun 10 18:25:19.490399 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2895/5739] 10.222.0.35 () {60 vars in 1294 bytes} [Fri Jun 10 18:25:19 2022] DELETE /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c/tags => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 10 18:25:19.498054 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86ba6fac-3a4e-405a-9a31-537f3dc512de tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:19.502391 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f188c18c-db77-427b-9d87-c82b8f219517 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Calling method '.version_select at 0x7f77b3ab8700>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:19.521232 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86ba6fac-3a4e-405a-9a31-537f3dc512de tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:19.533902 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f188c18c-db77-427b-9d87-c82b8f219517 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:19.541401 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f188c18c-db77-427b-9d87-c82b8f219517 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:19.546311 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f188c18c-db77-427b-9d87-c82b8f219517 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] [instance: 14781343-216b-44e9-9a93-b4d318f2531c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:19.559728 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f188c18c-db77-427b-9d87-c82b8f219517 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:19.561964 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f188c18c-db77-427b-9d87-c82b8f219517 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:19.565547 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f188c18c-db77-427b-9d87-c82b8f219517 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:19.566616 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f188c18c-db77-427b-9d87-c82b8f219517 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:19.622157 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=85,nova_cell1:SAVEPOINT=4,nova_cell1:INSERT=4,nova_cell1:RELEASE=4,nova_cell1:DELETE=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:25:19.645777 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f188c18c-db77-427b-9d87-c82b8f219517 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:19.646439 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f188c18c-db77-427b-9d87-c82b8f219517 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:19.681932 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f188c18c-db77-427b-9d87-c82b8f219517 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:19.682418 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f188c18c-db77-427b-9d87-c82b8f219517 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:19.825270 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-f188c18c-db77-427b-9d87-c82b8f219517 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lazy-loading 'flavor' on Instance uuid 14781343-216b-44e9-9a93-b4d318f2531c {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:25:19.869315 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f188c18c-db77-427b-9d87-c82b8f219517 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] 10.222.0.35 "PUT /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c/tags/tempest-tag-2064533795" status: 201 len: 0 microversion: 2.26 time: 0.373504 Jun 10 18:25:19.878076 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2896/5740] 10.222.0.35 () {62 vars in 1379 bytes} [Fri Jun 10 18:25:19 2022] PUT /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c/tags/tempest-tag-2064533795 => generated 0 bytes in 382 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jun 10 18:25:19.888446 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9622d8b4-53a1-4732-8878-eca327cf28c5 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Calling method '.version_select at 0x7f77b3ae6f70>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:19.908664 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9622d8b4-53a1-4732-8878-eca327cf28c5 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:19.912979 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9622d8b4-53a1-4732-8878-eca327cf28c5 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:19.913747 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9622d8b4-53a1-4732-8878-eca327cf28c5 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] [instance: 14781343-216b-44e9-9a93-b4d318f2531c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:19.936271 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9622d8b4-53a1-4732-8878-eca327cf28c5 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:19.937773 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9622d8b4-53a1-4732-8878-eca327cf28c5 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:19.938617 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9622d8b4-53a1-4732-8878-eca327cf28c5 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:19.944926 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9622d8b4-53a1-4732-8878-eca327cf28c5 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:20.024154 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9622d8b4-53a1-4732-8878-eca327cf28c5 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:20.026972 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9622d8b4-53a1-4732-8878-eca327cf28c5 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:20.056543 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9622d8b4-53a1-4732-8878-eca327cf28c5 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:20.057041 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9622d8b4-53a1-4732-8878-eca327cf28c5 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:20.195987 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-9622d8b4-53a1-4732-8878-eca327cf28c5 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lazy-loading 'flavor' on Instance uuid 14781343-216b-44e9-9a93-b4d318f2531c {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:25:20.253160 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9622d8b4-53a1-4732-8878-eca327cf28c5 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] 10.222.0.35 "PUT /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c/tags/tempest-tag-1565206526" status: 201 len: 0 microversion: 2.26 time: 0.371624 Jun 10 18:25:20.262937 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2897/5741] 10.222.0.35 () {62 vars in 1379 bytes} [Fri Jun 10 18:25:19 2022] PUT /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c/tags/tempest-tag-1565206526 => generated 0 bytes in 384 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jun 10 18:25:20.282388 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-aa3076a6-4c00-4c98-b546-e770362c2179 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Action: 'update_all', calling method: .version_select at 0x7f77b3ba2040>, body: {"tags": ["tempest-tag-1368956111", "tempest-tag-1054077119"]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:25:20.315846 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aa3076a6-4c00-4c98-b546-e770362c2179 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:20.316341 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aa3076a6-4c00-4c98-b546-e770362c2179 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:20.320794 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-aa3076a6-4c00-4c98-b546-e770362c2179 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] [instance: 14781343-216b-44e9-9a93-b4d318f2531c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:20.345722 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aa3076a6-4c00-4c98-b546-e770362c2179 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:20.346195 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aa3076a6-4c00-4c98-b546-e770362c2179 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:20.347007 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aa3076a6-4c00-4c98-b546-e770362c2179 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:20.347457 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aa3076a6-4c00-4c98-b546-e770362c2179 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:20.446383 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aa3076a6-4c00-4c98-b546-e770362c2179 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:20.446981 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aa3076a6-4c00-4c98-b546-e770362c2179 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:20.638166 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-aa3076a6-4c00-4c98-b546-e770362c2179 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lazy-loading 'flavor' on Instance uuid 14781343-216b-44e9-9a93-b4d318f2531c {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:25:20.698028 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-aa3076a6-4c00-4c98-b546-e770362c2179 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] 10.222.0.35 "PUT /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c/tags" status: 200 len: 62 microversion: 2.26 time: 0.430246 Jun 10 18:25:20.712685 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2898/5742] 10.222.0.35 () {62 vars in 1311 bytes} [Fri Jun 10 18:25:20 2022] PUT /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c/tags => generated 62 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:25:20.741986 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-208ee0cb-811e-434a-b2c8-433b5d455586 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Calling method '.version_select at 0x7f77c0d00ca0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:20.789641 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-208ee0cb-811e-434a-b2c8-433b5d455586 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:20.791321 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-208ee0cb-811e-434a-b2c8-433b5d455586 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:20.820566 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-208ee0cb-811e-434a-b2c8-433b5d455586 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] 10.222.0.35 "GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c/tags" status: 200 len: 62 microversion: 2.26 time: 0.106673 Jun 10 18:25:20.834525 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2899/5743] 10.222.0.35 () {60 vars in 1291 bytes} [Fri Jun 10 18:25:20 2022] GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c/tags => generated 62 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:25:20.839565 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1135ba7e-38fa-4704-b957-7b4e271f3527 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Calling method '.version_select at 0x7f77c033b670>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:20.879750 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1135ba7e-38fa-4704-b957-7b4e271f3527 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:20.880266 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1135ba7e-38fa-4704-b957-7b4e271f3527 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:20.880976 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1135ba7e-38fa-4704-b957-7b4e271f3527 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] [instance: 14781343-216b-44e9-9a93-b4d318f2531c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:20.921097 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1135ba7e-38fa-4704-b957-7b4e271f3527 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:20.921827 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1135ba7e-38fa-4704-b957-7b4e271f3527 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:20.929375 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1135ba7e-38fa-4704-b957-7b4e271f3527 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:20.943142 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1135ba7e-38fa-4704-b957-7b4e271f3527 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:21.000708 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1135ba7e-38fa-4704-b957-7b4e271f3527 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:21.001168 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1135ba7e-38fa-4704-b957-7b4e271f3527 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:21.082939 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-1135ba7e-38fa-4704-b957-7b4e271f3527 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lazy-loading 'flavor' on Instance uuid 14781343-216b-44e9-9a93-b4d318f2531c {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:25:21.120762 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1135ba7e-38fa-4704-b957-7b4e271f3527 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] 10.222.0.35 "DELETE /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c/tags" status: 204 len: 0 microversion: 2.26 time: 0.284987 Jun 10 18:25:21.126146 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2900/5744] 10.222.0.35 () {60 vars in 1294 bytes} [Fri Jun 10 18:25:20 2022] DELETE /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c/tags => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 10 18:25:21.135675 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5d9d7517-9f16-46d5-aedc-66ab40c2ba95 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:21.136196 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5d9d7517-9f16-46d5-aedc-66ab40c2ba95 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] [instance: 14781343-216b-44e9-9a93-b4d318f2531c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:21.186439 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5d9d7517-9f16-46d5-aedc-66ab40c2ba95 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:21.186439 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5d9d7517-9f16-46d5-aedc-66ab40c2ba95 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:21.186750 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5d9d7517-9f16-46d5-aedc-66ab40c2ba95 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:21.188413 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5d9d7517-9f16-46d5-aedc-66ab40c2ba95 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:21.306363 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5d9d7517-9f16-46d5-aedc-66ab40c2ba95 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] [instance: 14781343-216b-44e9-9a93-b4d318f2531c] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:25:21.446820 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-86ba6fac-3a4e-405a-9a31-537f3dc512de tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:21.457500 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-86ba6fac-3a4e-405a-9a31-537f3dc512de tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:21.494103 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-86ba6fac-3a4e-405a-9a31-537f3dc512de tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:21.496082 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-86ba6fac-3a4e-405a-9a31-537f3dc512de tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1732 microversion: 2.20 time: 2.026786 Jun 10 18:25:21.509266 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2845/5745] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:25:19 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1732 bytes in 2040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:25:21.721021 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5d9d7517-9f16-46d5-aedc-66ab40c2ba95 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] 10.222.0.35 "DELETE /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c" status: 204 len: 0 microversion: 2.26 time: 0.583485 Jun 10 18:25:21.721021 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2901/5746] 10.222.0.35 () {60 vars in 1279 bytes} [Fri Jun 10 18:25:21 2022] DELETE /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c => generated 0 bytes in 585 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 10 18:25:21.725827 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f8b1847c-1276-4ea9-afa4-1910e833a81f tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:21.726633 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f8b1847c-1276-4ea9-afa4-1910e833a81f tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] [instance: 14781343-216b-44e9-9a93-b4d318f2531c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:21.744244 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8b1847c-1276-4ea9-afa4-1910e833a81f tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:21.753026 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8b1847c-1276-4ea9-afa4-1910e833a81f tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:21.764552 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8b1847c-1276-4ea9-afa4-1910e833a81f tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:21.777093 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8b1847c-1276-4ea9-afa4-1910e833a81f tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:22.428884 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f8b1847c-1276-4ea9-afa4-1910e833a81f tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:22.453323 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f8b1847c-1276-4ea9-afa4-1910e833a81f tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:22.455698 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f8b1847c-1276-4ea9-afa4-1910e833a81f tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:22.457309 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f8b1847c-1276-4ea9-afa4-1910e833a81f tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] 10.222.0.35 "GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c" status: 200 len: 1551 microversion: 2.26 time: 0.736194 Jun 10 18:25:22.464453 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2846/5747] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:25:21 2022] GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c => generated 1551 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:25:22.525870 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7e6f3ad1-d945-4f4d-a16a-d5c464220528 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:22.526686 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7e6f3ad1-d945-4f4d-a16a-d5c464220528 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:22.551456 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7e6f3ad1-d945-4f4d-a16a-d5c464220528 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:22.552013 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7e6f3ad1-d945-4f4d-a16a-d5c464220528 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:22.552923 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7e6f3ad1-d945-4f4d-a16a-d5c464220528 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:22.553378 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7e6f3ad1-d945-4f4d-a16a-d5c464220528 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:23.480567 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cd6ae302-495e-41c6-a3d7-ee28aa3d69c2 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:23.481188 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cd6ae302-495e-41c6-a3d7-ee28aa3d69c2 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] [instance: 14781343-216b-44e9-9a93-b4d318f2531c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:23.528728 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd6ae302-495e-41c6-a3d7-ee28aa3d69c2 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:23.535143 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd6ae302-495e-41c6-a3d7-ee28aa3d69c2 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:23.541738 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd6ae302-495e-41c6-a3d7-ee28aa3d69c2 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:23.546107 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd6ae302-495e-41c6-a3d7-ee28aa3d69c2 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:23.630810 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7e6f3ad1-d945-4f4d-a16a-d5c464220528 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:23.644356 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7e6f3ad1-d945-4f4d-a16a-d5c464220528 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:23.650783 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7e6f3ad1-d945-4f4d-a16a-d5c464220528 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:23.653092 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7e6f3ad1-d945-4f4d-a16a-d5c464220528 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1732 microversion: 2.20 time: 1.133424 Jun 10 18:25:23.658958 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2902/5748] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:25:22 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1732 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:25:24.671796 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-624711e8-b250-47da-9f8e-eeeee13563a5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:24.672606 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-624711e8-b250-47da-9f8e-eeeee13563a5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:24.705873 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-624711e8-b250-47da-9f8e-eeeee13563a5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:24.708579 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-624711e8-b250-47da-9f8e-eeeee13563a5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:24.709432 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-624711e8-b250-47da-9f8e-eeeee13563a5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:24.709882 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-624711e8-b250-47da-9f8e-eeeee13563a5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:24.737829 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=87,nova_cell1:DELETE=4,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=4,nova_cell1:RELEASE=2,nova_cell1:UPDATE=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:25:25.471677 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cd6ae302-495e-41c6-a3d7-ee28aa3d69c2 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:25.526899 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cd6ae302-495e-41c6-a3d7-ee28aa3d69c2 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:25.543553 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cd6ae302-495e-41c6-a3d7-ee28aa3d69c2 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:25.547466 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cd6ae302-495e-41c6-a3d7-ee28aa3d69c2 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] 10.222.0.35 "GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c" status: 200 len: 1551 microversion: 2.26 time: 2.071163 Jun 10 18:25:25.548278 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2847/5749] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:25:23 2022] GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c => generated 1551 bytes in 2073 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:25:26.568538 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a937a0c0-4540-4ec6-aee3-b69b19d24a6f tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:26.569201 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a937a0c0-4540-4ec6-aee3-b69b19d24a6f tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] [instance: 14781343-216b-44e9-9a93-b4d318f2531c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:26.593230 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a937a0c0-4540-4ec6-aee3-b69b19d24a6f tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:26.596225 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a937a0c0-4540-4ec6-aee3-b69b19d24a6f tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:26.601594 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a937a0c0-4540-4ec6-aee3-b69b19d24a6f tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:26.605588 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a937a0c0-4540-4ec6-aee3-b69b19d24a6f tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:26.838930 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-624711e8-b250-47da-9f8e-eeeee13563a5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:26.858573 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-624711e8-b250-47da-9f8e-eeeee13563a5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:26.863294 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-624711e8-b250-47da-9f8e-eeeee13563a5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:26.865980 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-624711e8-b250-47da-9f8e-eeeee13563a5 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1732 microversion: 2.20 time: 2.198609 Jun 10 18:25:26.869128 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2903/5750] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:25:24 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1732 bytes in 2202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:25:27.891073 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-302987a0-29d1-407c-979f-66cc43fae042 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:27.891845 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-302987a0-29d1-407c-979f-66cc43fae042 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:27.902703 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-302987a0-29d1-407c-979f-66cc43fae042 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:27.911004 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-302987a0-29d1-407c-979f-66cc43fae042 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:27.913935 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-302987a0-29d1-407c-979f-66cc43fae042 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:27.918855 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-302987a0-29d1-407c-979f-66cc43fae042 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:27.994419 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a937a0c0-4540-4ec6-aee3-b69b19d24a6f tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:28.067823 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a937a0c0-4540-4ec6-aee3-b69b19d24a6f tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:28.074327 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a937a0c0-4540-4ec6-aee3-b69b19d24a6f tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:28.088492 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a937a0c0-4540-4ec6-aee3-b69b19d24a6f tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] 10.222.0.35 "GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c" status: 200 len: 1551 microversion: 2.26 time: 1.519511 Jun 10 18:25:28.097673 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2848/5751] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:25:26 2022] GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c => generated 1551 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:25:28.121594 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-e6f21093-13c8-4713-b313-70ff6c8cd3d4 req-728ddc51-7475-49fb-82aa-0d2ee778898f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14781343-216b-44e9-9a93-b4d318f2531c", "name": "network-vif-deleted", "tag": "b5e0a08f-0448-4601-a199-0ce443b00a70"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:25:28.170905 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=68 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:25:28.177145 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-e6f21093-13c8-4713-b313-70ff6c8cd3d4 req-728ddc51-7475-49fb-82aa-0d2ee778898f service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:28.179627 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-e6f21093-13c8-4713-b313-70ff6c8cd3d4 req-728ddc51-7475-49fb-82aa-0d2ee778898f service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:28.257067 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-e6f21093-13c8-4713-b313-70ff6c8cd3d4 req-728ddc51-7475-49fb-82aa-0d2ee778898f service nova] Creating event network-vif-deleted:b5e0a08f-0448-4601-a199-0ce443b00a70 for instance 14781343-216b-44e9-9a93-b4d318f2531c on chh1-master-2 Jun 10 18:25:28.283338 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-e6f21093-13c8-4713-b313-70ff6c8cd3d4 req-728ddc51-7475-49fb-82aa-0d2ee778898f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165479 Jun 10 18:25:28.294059 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2849/5752] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:25:28.588464 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-302987a0-29d1-407c-979f-66cc43fae042 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:28.597797 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-302987a0-29d1-407c-979f-66cc43fae042 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:28.599672 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-302987a0-29d1-407c-979f-66cc43fae042 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:28.602287 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-302987a0-29d1-407c-979f-66cc43fae042 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1732 microversion: 2.20 time: 0.718308 Jun 10 18:25:28.605289 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2904/5753] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:25:27 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1732 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:25:29.128764 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-220a3712-7542-4020-98a5-f4057f62aeb9 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:29.131835 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-220a3712-7542-4020-98a5-f4057f62aeb9 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] [instance: 14781343-216b-44e9-9a93-b4d318f2531c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:29.163254 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-220a3712-7542-4020-98a5-f4057f62aeb9 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:29.165965 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-220a3712-7542-4020-98a5-f4057f62aeb9 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:29.167862 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-220a3712-7542-4020-98a5-f4057f62aeb9 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:29.169630 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-220a3712-7542-4020-98a5-f4057f62aeb9 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:29.261285 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-220a3712-7542-4020-98a5-f4057f62aeb9 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:29.262005 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-220a3712-7542-4020-98a5-f4057f62aeb9 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:29.262642 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-220a3712-7542-4020-98a5-f4057f62aeb9 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lazy-loading 'fault' on Instance uuid 14781343-216b-44e9-9a93-b4d318f2531c {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:25:29.627106 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d7b66f5f-2cf3-4a6d-9152-caaaa031d5ff tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:29.627765 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d7b66f5f-2cf3-4a6d-9152-caaaa031d5ff tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:29.654719 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d7b66f5f-2cf3-4a6d-9152-caaaa031d5ff tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:29.655532 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d7b66f5f-2cf3-4a6d-9152-caaaa031d5ff tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:29.656587 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d7b66f5f-2cf3-4a6d-9152-caaaa031d5ff tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:29.657227 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d7b66f5f-2cf3-4a6d-9152-caaaa031d5ff tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:29.723282 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-220a3712-7542-4020-98a5-f4057f62aeb9 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:29.732897 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-220a3712-7542-4020-98a5-f4057f62aeb9 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:29.745452 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-220a3712-7542-4020-98a5-f4057f62aeb9 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e680050c69144e79f5d99633725f06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb2c32e921a41a185e2e3b7dfa70d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:29.747320 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-220a3712-7542-4020-98a5-f4057f62aeb9 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] 10.222.0.35 "GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c" status: 200 len: 1351 microversion: 2.26 time: 0.633809 Jun 10 18:25:29.766029 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2850/5754] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:25:29 2022] GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c => generated 1351 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:25:30.479974 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d7b66f5f-2cf3-4a6d-9152-caaaa031d5ff tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:30.492144 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d7b66f5f-2cf3-4a6d-9152-caaaa031d5ff tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:30.497470 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d7b66f5f-2cf3-4a6d-9152-caaaa031d5ff tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:30.502022 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d7b66f5f-2cf3-4a6d-9152-caaaa031d5ff tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1732 microversion: 2.20 time: 0.881890 Jun 10 18:25:30.508931 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2905/5755] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:25:29 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1732 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:25:30.775053 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-41ffb6cb-f1ce-41bc-9115-f959b24a3947 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:30.776736 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-41ffb6cb-f1ce-41bc-9115-f959b24a3947 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] [instance: 14781343-216b-44e9-9a93-b4d318f2531c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:30.803722 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41ffb6cb-f1ce-41bc-9115-f959b24a3947 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:30.804199 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41ffb6cb-f1ce-41bc-9115-f959b24a3947 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:30.805065 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41ffb6cb-f1ce-41bc-9115-f959b24a3947 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:30.805518 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41ffb6cb-f1ce-41bc-9115-f959b24a3947 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:30.854465 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-41ffb6cb-f1ce-41bc-9115-f959b24a3947 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] HTTP exception thrown: Instance 14781343-216b-44e9-9a93-b4d318f2531c could not be found. Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-41ffb6cb-f1ce-41bc-9115-f959b24a3947 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Request method failure captured: Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c HTTP/1.1 Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4xwnudSfxCCrPRvTl2jpbwO126CVF9_papHmANEo1gVHJn7FwynKa10nSgoHUTkDnfOeF8AdJ8dzIihatCGfDDcJdUwVs8YVuYBQ4AHGRkqE70fk85fFmNQF0UV3-cyz2Kdw-wk8yVpGm4nTl9BCl2t2tGdycoxVypH6zvjqP_nEJI Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: X-Openstack-Nova-Api-Version: 2.26 Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 6eb2c32e921a41a185e2e3b7dfa70d3c Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServerTagsTestJSON-1280259665 Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/6eb2c32e921a41a185e2e3b7dfa70d3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/6eb2c32e921a41a185e2e3b7dfa70d3c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/6eb2c32e921a41a185e2e3b7dfa70d3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_6eb2c32e921a41a185e2e3b7dfa70d3c", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServerTagsTestJSON-1280259665 Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 6eb2c32e921a41a185e2e3b7dfa70d3c Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServerTagsTestJSON-1280259665 Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServerTagsTestJSON-1280259665-project Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 5e680050c69144e79f5d99633725f06a Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServerTagsTestJSON-1280259665-project Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 14781343-216b-44e9-9a93-b4d318f2531c could not be found. Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '14781343-216b-44e9-9a93-b4d318f2531c'} Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14781343-216b-44e9-9a93-b4d318f2531c could not be found. Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14781343-216b-44e9-9a93-b4d318f2531c could not be found. Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:25:30.860284 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:25:30.864689 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:25:30.864689 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:25:30.864689 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:25:30.864689 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:25:30.864689 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:25:30.864689 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14781343-216b-44e9-9a93-b4d318f2531c could not be found. Jun 10 18:25:30.864689 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:25:30.868827 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-41ffb6cb-f1ce-41bc-9115-f959b24a3947 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] Returning 404 to user: Instance 14781343-216b-44e9-9a93-b4d318f2531c could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:25:30.871298 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-41ffb6cb-f1ce-41bc-9115-f959b24a3947 tempest-ServerTagsTestJSON-1280259665 tempest-ServerTagsTestJSON-1280259665-project] 10.222.0.35 "GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c" status: 404 len: 111 microversion: 2.26 time: 0.103719 Jun 10 18:25:30.879911 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2851/5756] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:25:30 2022] GET /compute/v2.1/servers/14781343-216b-44e9-9a93-b4d318f2531c => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:25:31.526716 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e118a99c-6038-48ad-b163-4a8068090844 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:31.527407 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e118a99c-6038-48ad-b163-4a8068090844 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:31.549079 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:25:31.564370 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e118a99c-6038-48ad-b163-4a8068090844 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:31.565244 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e118a99c-6038-48ad-b163-4a8068090844 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:31.569758 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e118a99c-6038-48ad-b163-4a8068090844 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:31.570384 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e118a99c-6038-48ad-b163-4a8068090844 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:32.635217 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e118a99c-6038-48ad-b163-4a8068090844 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:32.649359 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e118a99c-6038-48ad-b163-4a8068090844 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:32.650945 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e118a99c-6038-48ad-b163-4a8068090844 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:32.652067 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e118a99c-6038-48ad-b163-4a8068090844 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1732 microversion: 2.20 time: 1.130499 Jun 10 18:25:32.656762 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2906/5757] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:25:31 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1732 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:25:33.676403 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4cc45153-50fd-4c92-91c4-02165e287779 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:33.677502 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4cc45153-50fd-4c92-91c4-02165e287779 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:33.690813 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4cc45153-50fd-4c92-91c4-02165e287779 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:33.691316 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4cc45153-50fd-4c92-91c4-02165e287779 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:33.695301 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4cc45153-50fd-4c92-91c4-02165e287779 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:33.696057 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4cc45153-50fd-4c92-91c4-02165e287779 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:34.034901 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4cc45153-50fd-4c92-91c4-02165e287779 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:34.054181 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4cc45153-50fd-4c92-91c4-02165e287779 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:34.064636 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4cc45153-50fd-4c92-91c4-02165e287779 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:34.071434 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4cc45153-50fd-4c92-91c4-02165e287779 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1732 microversion: 2.20 time: 0.400132 Jun 10 18:25:34.074751 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2852/5758] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:25:33 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1732 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:25:35.091702 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c21f1b4d-e7cd-4335-9c54-a5e12305d193 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:35.092353 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c21f1b4d-e7cd-4335-9c54-a5e12305d193 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:35.102190 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c21f1b4d-e7cd-4335-9c54-a5e12305d193 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:35.121192 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c21f1b4d-e7cd-4335-9c54-a5e12305d193 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:35.131396 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c21f1b4d-e7cd-4335-9c54-a5e12305d193 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:35.137139 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c21f1b4d-e7cd-4335-9c54-a5e12305d193 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:36.448503 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c21f1b4d-e7cd-4335-9c54-a5e12305d193 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:36.475406 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c21f1b4d-e7cd-4335-9c54-a5e12305d193 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:36.493513 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c21f1b4d-e7cd-4335-9c54-a5e12305d193 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:36.496076 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c21f1b4d-e7cd-4335-9c54-a5e12305d193 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1732 microversion: 2.20 time: 1.408547 Jun 10 18:25:36.498943 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2907/5759] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:25:35 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1732 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:25:37.517546 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-401e4c9d-a2ea-40d4-978f-435e122f7435 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:37.518247 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-401e4c9d-a2ea-40d4-978f-435e122f7435 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:37.536889 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-401e4c9d-a2ea-40d4-978f-435e122f7435 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:37.538207 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-401e4c9d-a2ea-40d4-978f-435e122f7435 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:37.539934 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-401e4c9d-a2ea-40d4-978f-435e122f7435 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:37.541057 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-401e4c9d-a2ea-40d4-978f-435e122f7435 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:38.596796 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-401e4c9d-a2ea-40d4-978f-435e122f7435 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:38.614220 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-401e4c9d-a2ea-40d4-978f-435e122f7435 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:38.624671 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-401e4c9d-a2ea-40d4-978f-435e122f7435 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:38.626009 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-401e4c9d-a2ea-40d4-978f-435e122f7435 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1732 microversion: 2.20 time: 1.113482 Jun 10 18:25:38.642488 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2853/5760] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:25:37 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1732 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:25:39.498987 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7a3c6527-e8ec-406c-a81f-e2533ef12470 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Action: 'create', calling method: .version_select at 0x7f77b39ed430>, body: {"keypair": {"name": "tempest-keypair-1420083637", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4r6N5AoPvvcjIBvHLIE0Q/FtksL4xhF9OOWkhwMfSSGdFHI1Os+RmUyhPdYFefq6rOXmnya75CDDfNaLDsSWjy0b+zhy1q7ZlQ4VV63Qk1yw1mROR94PHr/SGLI7wCmw=="}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:25:39.549287 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-7a3c6527-e8ec-406c-a81f-e2533ef12470 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Getting quotas for project 886b72a54e9b4ee7aa3cc21da4145cbb. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:25:39.573013 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-7a3c6527-e8ec-406c-a81f-e2533ef12470 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Getting quotas for user f62326a9deb140e891c07529dc021d11 and project 886b72a54e9b4ee7aa3cc21da4145cbb. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:25:39.662084 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2c6bb6ce-178d-4091-8b1b-0787944b1818 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:39.663443 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2c6bb6ce-178d-4091-8b1b-0787944b1818 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:39.691375 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c6bb6ce-178d-4091-8b1b-0787944b1818 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:39.691851 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c6bb6ce-178d-4091-8b1b-0787944b1818 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:39.703437 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c6bb6ce-178d-4091-8b1b-0787944b1818 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:39.703437 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c6bb6ce-178d-4091-8b1b-0787944b1818 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:39.727825 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7a3c6527-e8ec-406c-a81f-e2533ef12470 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.233497 Jun 10 18:25:39.728901 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2908/5761] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 18:25:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:25:40.289226 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2c6bb6ce-178d-4091-8b1b-0787944b1818 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:40.297963 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2c6bb6ce-178d-4091-8b1b-0787944b1818 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:40.305249 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2c6bb6ce-178d-4091-8b1b-0787944b1818 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:40.306762 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2c6bb6ce-178d-4091-8b1b-0787944b1818 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1732 microversion: 2.20 time: 0.648714 Jun 10 18:25:40.323707 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2854/5762] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:25:39 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1732 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:25:41.326209 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-227c50aa-d282-4f45-8692-741ff0a9dfa4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:41.327652 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-227c50aa-d282-4f45-8692-741ff0a9dfa4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:41.341814 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-227c50aa-d282-4f45-8692-741ff0a9dfa4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:41.348917 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-227c50aa-d282-4f45-8692-741ff0a9dfa4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:41.349996 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-227c50aa-d282-4f45-8692-741ff0a9dfa4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:41.355760 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-227c50aa-d282-4f45-8692-741ff0a9dfa4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:41.612329 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-227c50aa-d282-4f45-8692-741ff0a9dfa4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:41.628597 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-227c50aa-d282-4f45-8692-741ff0a9dfa4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:41.631048 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-227c50aa-d282-4f45-8692-741ff0a9dfa4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:41.632613 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-227c50aa-d282-4f45-8692-741ff0a9dfa4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1732 microversion: 2.20 time: 0.310974 Jun 10 18:25:41.634170 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2909/5763] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:25:41 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1732 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:25:42.526395 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5ec2b0f6-214c-4dd8-8c66-b990296bab93 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-2040815546", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "940d65ec-437e-4f98-a601-e2ba4906c363"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:25:42.627472 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-5ec2b0f6-214c-4dd8-8c66-b990296bab93 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] validate_networks() for [('940d65ec-437e-4f98-a601-e2ba4906c363', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:25:42.651898 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-33496e13-f171-44ea-82c6-f0bdc692c81a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:42.652608 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-33496e13-f171-44ea-82c6-f0bdc692c81a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:42.669109 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-33496e13-f171-44ea-82c6-f0bdc692c81a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:42.669727 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-33496e13-f171-44ea-82c6-f0bdc692c81a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:42.670562 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-33496e13-f171-44ea-82c6-f0bdc692c81a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:42.671036 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-33496e13-f171-44ea-82c6-f0bdc692c81a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:42.961781 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-33496e13-f171-44ea-82c6-f0bdc692c81a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:42.975248 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-33496e13-f171-44ea-82c6-f0bdc692c81a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:42.980494 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-33496e13-f171-44ea-82c6-f0bdc692c81a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:42.986046 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-33496e13-f171-44ea-82c6-f0bdc692c81a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1732 microversion: 2.20 time: 0.338255 Jun 10 18:25:42.987375 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2910/5764] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:25:42 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1732 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:25:44.009499 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9350294b-a5b6-4254-a8b4-87a80c9601e4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:44.010569 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9350294b-a5b6-4254-a8b4-87a80c9601e4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:44.021013 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9350294b-a5b6-4254-a8b4-87a80c9601e4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:44.021013 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9350294b-a5b6-4254-a8b4-87a80c9601e4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:44.021013 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9350294b-a5b6-4254-a8b4-87a80c9601e4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:44.024247 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9350294b-a5b6-4254-a8b4-87a80c9601e4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:44.237388 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9350294b-a5b6-4254-a8b4-87a80c9601e4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:44.246373 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9350294b-a5b6-4254-a8b4-87a80c9601e4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:44.247931 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9350294b-a5b6-4254-a8b4-87a80c9601e4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:44.249209 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9350294b-a5b6-4254-a8b4-87a80c9601e4 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1732 microversion: 2.20 time: 0.247686 Jun 10 18:25:44.250085 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2911/5765] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:25:44 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1732 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:25:44.659999 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-5ec2b0f6-214c-4dd8-8c66-b990296bab93 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:25:44.661049 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-5ec2b0f6-214c-4dd8-8c66-b990296bab93 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:25:44.661877 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-5ec2b0f6-214c-4dd8-8c66-b990296bab93 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:25:44.662459 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-5ec2b0f6-214c-4dd8-8c66-b990296bab93 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:25:44.662876 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-5ec2b0f6-214c-4dd8-8c66-b990296bab93 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:25:44.682275 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ec2b0f6-214c-4dd8-8c66-b990296bab93 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:44.682732 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ec2b0f6-214c-4dd8-8c66-b990296bab93 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:44.683534 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ec2b0f6-214c-4dd8-8c66-b990296bab93 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:44.683963 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ec2b0f6-214c-4dd8-8c66-b990296bab93 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:44.725219 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-5ec2b0f6-214c-4dd8-8c66-b990296bab93 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Getting quotas for project ded497d3d91b4e22bc2daa72d6f75d18. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:25:44.738902 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-5ec2b0f6-214c-4dd8-8c66-b990296bab93 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Getting quotas for user d37f560237d9489e96ddee21d9f5e6c6 and project ded497d3d91b4e22bc2daa72d6f75d18. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:25:44.770306 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5ec2b0f6-214c-4dd8-8c66-b990296bab93 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:25:44.772996 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5ec2b0f6-214c-4dd8-8c66-b990296bab93 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: e81a6dfe-0b14-44e1-9d1c-58d543f32faf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:25:44.969027 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5ec2b0f6-214c-4dd8-8c66-b990296bab93 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.809619 Jun 10 18:25:44.973592 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2855/5766] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:25:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:25:44.982187 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0d1796ef-6612-4695-bfbd-4eb8c06c2489 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:44.982975 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0d1796ef-6612-4695-bfbd-4eb8c06c2489 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: e81a6dfe-0b14-44e1-9d1c-58d543f32faf] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:45.154766 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0d1796ef-6612-4695-bfbd-4eb8c06c2489 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:45.163090 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0d1796ef-6612-4695-bfbd-4eb8c06c2489 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/e81a6dfe-0b14-44e1-9d1c-58d543f32faf" status: 200 len: 1193 microversion: 2.1 time: 0.187155 Jun 10 18:25:45.169797 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2912/5767] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:25:44 2022] GET /compute/v2.1/servers/e81a6dfe-0b14-44e1-9d1c-58d543f32faf => generated 1193 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:25:45.275464 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c51766ef-ac35-4f82-9a26-11e4fb68a95d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:45.276344 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c51766ef-ac35-4f82-9a26-11e4fb68a95d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:45.295823 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c51766ef-ac35-4f82-9a26-11e4fb68a95d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:45.295823 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c51766ef-ac35-4f82-9a26-11e4fb68a95d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:45.296998 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c51766ef-ac35-4f82-9a26-11e4fb68a95d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:45.299253 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c51766ef-ac35-4f82-9a26-11e4fb68a95d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:45.938795 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c51766ef-ac35-4f82-9a26-11e4fb68a95d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:45.947806 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c51766ef-ac35-4f82-9a26-11e4fb68a95d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:45.963590 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c51766ef-ac35-4f82-9a26-11e4fb68a95d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:45.963590 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c51766ef-ac35-4f82-9a26-11e4fb68a95d tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1732 microversion: 2.20 time: 0.694278 Jun 10 18:25:45.963590 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2856/5768] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:25:45 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1732 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:25:46.194743 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4ea1f1e3-f549-47e8-ba59-ca23181355ff tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:46.207817 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4ea1f1e3-f549-47e8-ba59-ca23181355ff tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: e81a6dfe-0b14-44e1-9d1c-58d543f32faf] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:46.394342 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4ea1f1e3-f549-47e8-ba59-ca23181355ff tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:46.435778 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4ea1f1e3-f549-47e8-ba59-ca23181355ff tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/e81a6dfe-0b14-44e1-9d1c-58d543f32faf" status: 200 len: 1193 microversion: 2.1 time: 0.250769 Jun 10 18:25:46.438420 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2913/5769] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:25:46 2022] GET /compute/v2.1/servers/e81a6dfe-0b14-44e1-9d1c-58d543f32faf => generated 1193 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:25:46.983566 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f0ebb6af-caf3-4288-8867-dd5c0a41850c tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:46.984195 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f0ebb6af-caf3-4288-8867-dd5c0a41850c tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:46.996071 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f0ebb6af-caf3-4288-8867-dd5c0a41850c tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:46.996592 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f0ebb6af-caf3-4288-8867-dd5c0a41850c tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:46.997392 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f0ebb6af-caf3-4288-8867-dd5c0a41850c tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:47.000082 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f0ebb6af-caf3-4288-8867-dd5c0a41850c tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:47.466090 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e5d69523-67eb-4997-959d-0674d701b415 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:47.466090 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e5d69523-67eb-4997-959d-0674d701b415 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: e81a6dfe-0b14-44e1-9d1c-58d543f32faf] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:47.479950 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e5d69523-67eb-4997-959d-0674d701b415 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:47.481225 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e5d69523-67eb-4997-959d-0674d701b415 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:47.482306 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e5d69523-67eb-4997-959d-0674d701b415 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:47.485141 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e5d69523-67eb-4997-959d-0674d701b415 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:47.604363 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f0ebb6af-caf3-4288-8867-dd5c0a41850c tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:47.613482 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f0ebb6af-caf3-4288-8867-dd5c0a41850c tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:47.620588 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f0ebb6af-caf3-4288-8867-dd5c0a41850c tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:47.620588 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f0ebb6af-caf3-4288-8867-dd5c0a41850c tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1732 microversion: 2.20 time: 0.642035 Jun 10 18:25:47.620588 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2857/5770] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:25:46 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1732 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:25:47.908983 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e5d69523-67eb-4997-959d-0674d701b415 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:47.921293 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e5d69523-67eb-4997-959d-0674d701b415 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/e81a6dfe-0b14-44e1-9d1c-58d543f32faf" status: 200 len: 1245 microversion: 2.1 time: 0.469604 Jun 10 18:25:47.922638 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2914/5771] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:25:47 2022] GET /compute/v2.1/servers/e81a6dfe-0b14-44e1-9d1c-58d543f32faf => generated 1245 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:25:48.639807 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-409aa713-e72e-4b17-8300-ce3b07098cfa tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:48.640512 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-409aa713-e72e-4b17-8300-ce3b07098cfa tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:48.651209 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-409aa713-e72e-4b17-8300-ce3b07098cfa tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:48.655965 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-409aa713-e72e-4b17-8300-ce3b07098cfa tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:48.657382 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-409aa713-e72e-4b17-8300-ce3b07098cfa tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:48.657946 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-409aa713-e72e-4b17-8300-ce3b07098cfa tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:48.949443 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bbbecd0e-cc6b-4b77-b414-fd4702a776fe tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:48.951530 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bbbecd0e-cc6b-4b77-b414-fd4702a776fe tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: e81a6dfe-0b14-44e1-9d1c-58d543f32faf] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:48.968870 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bbbecd0e-cc6b-4b77-b414-fd4702a776fe tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:48.981053 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bbbecd0e-cc6b-4b77-b414-fd4702a776fe tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:48.981053 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bbbecd0e-cc6b-4b77-b414-fd4702a776fe tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:48.981053 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bbbecd0e-cc6b-4b77-b414-fd4702a776fe tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:49.089625 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bbbecd0e-cc6b-4b77-b414-fd4702a776fe tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:49.104892 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bbbecd0e-cc6b-4b77-b414-fd4702a776fe tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/e81a6dfe-0b14-44e1-9d1c-58d543f32faf" status: 200 len: 1263 microversion: 2.1 time: 0.169788 Jun 10 18:25:49.106373 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2915/5772] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:25:48 2022] GET /compute/v2.1/servers/e81a6dfe-0b14-44e1-9d1c-58d543f32faf => generated 1263 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:25:49.113267 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-56dc2d05-9589-472e-8137-ccbdf4565c46 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1768707792", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bc4d74bc-8446-4d8c-a25b-248884836510"}], "security_groups": [{"name": "tempest-securitygroup--1294317497"}], "key_name": "tempest-keypair-1420083637", "user_data": "}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:25:49.351292 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-56dc2d05-9589-472e-8137-ccbdf4565c46 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] validate_networks() for [('bc4d74bc-8446-4d8c-a25b-248884836510', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:25:49.843826 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-409aa713-e72e-4b17-8300-ce3b07098cfa tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:49.859849 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-409aa713-e72e-4b17-8300-ce3b07098cfa tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:49.863748 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-409aa713-e72e-4b17-8300-ce3b07098cfa tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:49.865596 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-409aa713-e72e-4b17-8300-ce3b07098cfa tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1732 microversion: 2.20 time: 1.231099 Jun 10 18:25:49.889858 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2858/5773] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:25:48 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1732 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:25:49.954616 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-81981f6e-47c5-4b0f-bb57-f2a99816b821 req-942da8be-82d4-4367-984c-58c8250d2d7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6a3eb83-4aef-446a-a9d5-96d09acb1aaa", "name": "network-vif-plugged", "status": "completed", "tag": "64ec13e5-9fd3-4a96-981b-a6206cef5996"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:25:49.954616 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-81981f6e-47c5-4b0f-bb57-f2a99816b821 req-942da8be-82d4-4367-984c-58c8250d2d7b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:49.954616 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-81981f6e-47c5-4b0f-bb57-f2a99816b821 req-942da8be-82d4-4367-984c-58c8250d2d7b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:49.954616 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-81981f6e-47c5-4b0f-bb57-f2a99816b821 req-942da8be-82d4-4367-984c-58c8250d2d7b service nova] Creating event network-vif-plugged:64ec13e5-9fd3-4a96-981b-a6206cef5996 for instance b6a3eb83-4aef-446a-a9d5-96d09acb1aaa on chh2-master-2 Jun 10 18:25:49.954616 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-81981f6e-47c5-4b0f-bb57-f2a99816b821 req-942da8be-82d4-4367-984c-58c8250d2d7b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044625 Jun 10 18:25:49.954616 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2859/5774] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:25:50.125080 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-18af797f-f482-4516-bc71-5a2e26634f0b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:50.126068 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-18af797f-f482-4516-bc71-5a2e26634f0b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: e81a6dfe-0b14-44e1-9d1c-58d543f32faf] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:50.138215 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-18af797f-f482-4516-bc71-5a2e26634f0b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:50.143777 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-18af797f-f482-4516-bc71-5a2e26634f0b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:50.143777 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-18af797f-f482-4516-bc71-5a2e26634f0b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:50.143777 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-18af797f-f482-4516-bc71-5a2e26634f0b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:50.191757 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=76 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:25:50.314965 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-18af797f-f482-4516-bc71-5a2e26634f0b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:50.339726 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-18af797f-f482-4516-bc71-5a2e26634f0b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/e81a6dfe-0b14-44e1-9d1c-58d543f32faf" status: 200 len: 1251 microversion: 2.1 time: 0.217089 Jun 10 18:25:50.350460 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2860/5775] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:25:50 2022] GET /compute/v2.1/servers/e81a6dfe-0b14-44e1-9d1c-58d543f32faf => generated 1251 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:25:50.540605 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-56dc2d05-9589-472e-8137-ccbdf4565c46 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:25:50.541170 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-56dc2d05-9589-472e-8137-ccbdf4565c46 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:25:50.541499 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-56dc2d05-9589-472e-8137-ccbdf4565c46 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:25:50.541925 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-56dc2d05-9589-472e-8137-ccbdf4565c46 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:25:50.543950 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-56dc2d05-9589-472e-8137-ccbdf4565c46 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:25:50.561631 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-56dc2d05-9589-472e-8137-ccbdf4565c46 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:50.566183 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-56dc2d05-9589-472e-8137-ccbdf4565c46 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:50.566183 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-56dc2d05-9589-472e-8137-ccbdf4565c46 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:50.566183 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-56dc2d05-9589-472e-8137-ccbdf4565c46 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:50.597602 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-56dc2d05-9589-472e-8137-ccbdf4565c46 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Getting quotas for project 886b72a54e9b4ee7aa3cc21da4145cbb. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:25:50.604538 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-56dc2d05-9589-472e-8137-ccbdf4565c46 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Getting quotas for user f62326a9deb140e891c07529dc021d11 and project 886b72a54e9b4ee7aa3cc21da4145cbb. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:25:50.621061 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-56dc2d05-9589-472e-8137-ccbdf4565c46 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:25:50.625627 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-56dc2d05-9589-472e-8137-ccbdf4565c46 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: e57747ec-57b8-46a6-92c2-8a57830524f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:25:50.791987 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-56dc2d05-9589-472e-8137-ccbdf4565c46 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.684141 Jun 10 18:25:50.793251 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2916/5776] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:25:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 1686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:25:50.818004 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8ea6ffb6-b329-4de1-ac6b-b18b7ccfd5e5 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:50.818785 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8ea6ffb6-b329-4de1-ac6b-b18b7ccfd5e5 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: e57747ec-57b8-46a6-92c2-8a57830524f7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:50.895240 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b28a71f5-137c-4f17-881f-3697fb30c9e9 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:50.895874 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b28a71f5-137c-4f17-881f-3697fb30c9e9 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:50.906705 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b28a71f5-137c-4f17-881f-3697fb30c9e9 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:50.907169 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b28a71f5-137c-4f17-881f-3697fb30c9e9 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:50.907968 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b28a71f5-137c-4f17-881f-3697fb30c9e9 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:50.908447 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b28a71f5-137c-4f17-881f-3697fb30c9e9 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:51.197475 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8ea6ffb6-b329-4de1-ac6b-b18b7ccfd5e5 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:51.207637 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8ea6ffb6-b329-4de1-ac6b-b18b7ccfd5e5 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7" status: 200 len: 1242 microversion: 2.1 time: 0.407102 Jun 10 18:25:51.209106 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2861/5777] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:25:50 2022] GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7 => generated 1242 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:25:51.296361 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b28a71f5-137c-4f17-881f-3697fb30c9e9 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:51.314305 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b28a71f5-137c-4f17-881f-3697fb30c9e9 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:51.320484 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b28a71f5-137c-4f17-881f-3697fb30c9e9 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:51.321744 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b28a71f5-137c-4f17-881f-3697fb30c9e9 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1732 microversion: 2.20 time: 0.430638 Jun 10 18:25:51.335813 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2917/5778] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:25:50 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1732 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:25:51.379867 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-752de33a-ee22-40e7-a665-94a3895c1903 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:51.387225 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-752de33a-ee22-40e7-a665-94a3895c1903 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: e81a6dfe-0b14-44e1-9d1c-58d543f32faf] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:51.431562 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-752de33a-ee22-40e7-a665-94a3895c1903 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:51.432137 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-752de33a-ee22-40e7-a665-94a3895c1903 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:51.433230 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-752de33a-ee22-40e7-a665-94a3895c1903 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:51.433729 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-752de33a-ee22-40e7-a665-94a3895c1903 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:52.187928 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-752de33a-ee22-40e7-a665-94a3895c1903 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:52.215908 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-752de33a-ee22-40e7-a665-94a3895c1903 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/e81a6dfe-0b14-44e1-9d1c-58d543f32faf" status: 200 len: 1293 microversion: 2.1 time: 0.841822 Jun 10 18:25:52.221875 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2862/5779] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:25:51 2022] GET /compute/v2.1/servers/e81a6dfe-0b14-44e1-9d1c-58d543f32faf => generated 1293 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:25:52.233695 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1bc22f33-240d-4799-b8d9-5b0ada7b3b06 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:52.234983 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1bc22f33-240d-4799-b8d9-5b0ada7b3b06 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: e57747ec-57b8-46a6-92c2-8a57830524f7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:52.266737 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1bc22f33-240d-4799-b8d9-5b0ada7b3b06 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:52.268069 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1bc22f33-240d-4799-b8d9-5b0ada7b3b06 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:52.270922 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1bc22f33-240d-4799-b8d9-5b0ada7b3b06 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:52.273451 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1bc22f33-240d-4799-b8d9-5b0ada7b3b06 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:52.351100 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9903f50a-9c49-4054-afe9-8d19c0d98317 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:52.351854 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9903f50a-9c49-4054-afe9-8d19c0d98317 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:52.373231 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9903f50a-9c49-4054-afe9-8d19c0d98317 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:52.373967 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9903f50a-9c49-4054-afe9-8d19c0d98317 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:52.378464 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9903f50a-9c49-4054-afe9-8d19c0d98317 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:52.385729 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9903f50a-9c49-4054-afe9-8d19c0d98317 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:52.608896 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1bc22f33-240d-4799-b8d9-5b0ada7b3b06 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:52.621303 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1bc22f33-240d-4799-b8d9-5b0ada7b3b06 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7" status: 200 len: 1246 microversion: 2.1 time: 0.392618 Jun 10 18:25:52.633893 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2918/5780] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:25:52 2022] GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7 => generated 1246 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:25:53.245946 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-66320552-3939-4d0a-abb3-6f43e1c3e3ee tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:53.253127 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-66320552-3939-4d0a-abb3-6f43e1c3e3ee tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: e81a6dfe-0b14-44e1-9d1c-58d543f32faf] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:53.273503 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-66320552-3939-4d0a-abb3-6f43e1c3e3ee tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:53.274290 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-66320552-3939-4d0a-abb3-6f43e1c3e3ee tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:53.275738 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-66320552-3939-4d0a-abb3-6f43e1c3e3ee tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:53.276460 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-66320552-3939-4d0a-abb3-6f43e1c3e3ee tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:53.688033 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9903f50a-9c49-4054-afe9-8d19c0d98317 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:53.699910 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9903f50a-9c49-4054-afe9-8d19c0d98317 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:53.707993 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9903f50a-9c49-4054-afe9-8d19c0d98317 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:53.707993 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9903f50a-9c49-4054-afe9-8d19c0d98317 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1732 microversion: 2.20 time: 1.360144 Jun 10 18:25:53.718929 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2863/5781] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:25:52 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1732 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:25:53.727794 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-63a0998f-f72e-41ef-9bf8-dcd1ac6e09a3 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:53.733604 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-63a0998f-f72e-41ef-9bf8-dcd1ac6e09a3 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: e57747ec-57b8-46a6-92c2-8a57830524f7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:53.767062 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-63a0998f-f72e-41ef-9bf8-dcd1ac6e09a3 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:53.767773 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-63a0998f-f72e-41ef-9bf8-dcd1ac6e09a3 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:53.768767 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-63a0998f-f72e-41ef-9bf8-dcd1ac6e09a3 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:53.769368 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-63a0998f-f72e-41ef-9bf8-dcd1ac6e09a3 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:53.779616 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-66320552-3939-4d0a-abb3-6f43e1c3e3ee tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:53.791779 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-66320552-3939-4d0a-abb3-6f43e1c3e3ee tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/e81a6dfe-0b14-44e1-9d1c-58d543f32faf" status: 200 len: 1293 microversion: 2.1 time: 0.560643 Jun 10 18:25:53.795173 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2919/5782] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:25:53 2022] GET /compute/v2.1/servers/e81a6dfe-0b14-44e1-9d1c-58d543f32faf => generated 1293 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:25:54.035335 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-63a0998f-f72e-41ef-9bf8-dcd1ac6e09a3 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:54.047182 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-63a0998f-f72e-41ef-9bf8-dcd1ac6e09a3 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7" status: 200 len: 1294 microversion: 2.1 time: 0.329195 Jun 10 18:25:54.056469 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2864/5783] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:25:53 2022] GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7 => generated 1294 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:25:54.729771 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6c5b2b52-9fd4-4f34-8204-c6bb792a0344 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:54.731053 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6c5b2b52-9fd4-4f34-8204-c6bb792a0344 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:54.768989 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6c5b2b52-9fd4-4f34-8204-c6bb792a0344 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:54.769686 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6c5b2b52-9fd4-4f34-8204-c6bb792a0344 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:54.770717 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6c5b2b52-9fd4-4f34-8204-c6bb792a0344 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:54.771324 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6c5b2b52-9fd4-4f34-8204-c6bb792a0344 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:54.812178 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-051f04b4-6746-49ef-837a-29b8a1e888da tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:54.813504 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-051f04b4-6746-49ef-837a-29b8a1e888da tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: e81a6dfe-0b14-44e1-9d1c-58d543f32faf] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:54.816329 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:25:54.832217 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-051f04b4-6746-49ef-837a-29b8a1e888da tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:54.833041 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-051f04b4-6746-49ef-837a-29b8a1e888da tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:54.835686 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-051f04b4-6746-49ef-837a-29b8a1e888da tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:54.839163 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-051f04b4-6746-49ef-837a-29b8a1e888da tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:55.498761 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6c5b2b52-9fd4-4f34-8204-c6bb792a0344 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:55.514422 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6c5b2b52-9fd4-4f34-8204-c6bb792a0344 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:55.519364 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6c5b2b52-9fd4-4f34-8204-c6bb792a0344 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:55.521792 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6c5b2b52-9fd4-4f34-8204-c6bb792a0344 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1732 microversion: 2.20 time: 0.796557 Jun 10 18:25:55.522800 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2920/5784] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:25:54 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1732 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:25:55.530836 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ec695e6b-ecc3-4bba-bb2e-fc448e7c52b8 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:55.531831 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ec695e6b-ecc3-4bba-bb2e-fc448e7c52b8 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: e57747ec-57b8-46a6-92c2-8a57830524f7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:55.556736 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec695e6b-ecc3-4bba-bb2e-fc448e7c52b8 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:55.557296 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec695e6b-ecc3-4bba-bb2e-fc448e7c52b8 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:55.561327 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec695e6b-ecc3-4bba-bb2e-fc448e7c52b8 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:55.561327 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec695e6b-ecc3-4bba-bb2e-fc448e7c52b8 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:55.677705 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=85 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:25:55.875284 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ec695e6b-ecc3-4bba-bb2e-fc448e7c52b8 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:55.890926 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ec695e6b-ecc3-4bba-bb2e-fc448e7c52b8 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7" status: 200 len: 1300 microversion: 2.1 time: 0.366837 Jun 10 18:25:55.891530 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2921/5785] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:25:55 2022] GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7 => generated 1300 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:25:55.896008 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-bfbc23c5-cc06-454a-abe8-d07a57484a74 req-64050e4b-b8f4-4baa-899c-aff3f2e789c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e81a6dfe-0b14-44e1-9d1c-58d543f32faf", "tag": "2b5203dd-df2f-4988-b40a-11600acbe1f4"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:25:55.922279 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-bfbc23c5-cc06-454a-abe8-d07a57484a74 req-64050e4b-b8f4-4baa-899c-aff3f2e789c2 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:55.922279 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-bfbc23c5-cc06-454a-abe8-d07a57484a74 req-64050e4b-b8f4-4baa-899c-aff3f2e789c2 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:55.936558 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-bfbc23c5-cc06-454a-abe8-d07a57484a74 req-64050e4b-b8f4-4baa-899c-aff3f2e789c2 service nova] Creating event network-changed:2b5203dd-df2f-4988-b40a-11600acbe1f4 for instance e81a6dfe-0b14-44e1-9d1c-58d543f32faf on chh1-master-2 Jun 10 18:25:55.956589 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-bfbc23c5-cc06-454a-abe8-d07a57484a74 req-64050e4b-b8f4-4baa-899c-aff3f2e789c2 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063794 Jun 10 18:25:55.957450 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2922/5786] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:25:56.544808 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fc6c5e40-d4c9-4a80-8415-fb92196450fa tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:56.546053 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fc6c5e40-d4c9-4a80-8415-fb92196450fa tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:56.561780 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fc6c5e40-d4c9-4a80-8415-fb92196450fa tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:56.562242 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fc6c5e40-d4c9-4a80-8415-fb92196450fa tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:56.563034 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fc6c5e40-d4c9-4a80-8415-fb92196450fa tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:56.563483 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fc6c5e40-d4c9-4a80-8415-fb92196450fa tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:56.804997 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-051f04b4-6746-49ef-837a-29b8a1e888da tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:56.816880 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-051f04b4-6746-49ef-837a-29b8a1e888da tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/e81a6dfe-0b14-44e1-9d1c-58d543f32faf" status: 200 len: 1293 microversion: 2.1 time: 2.007862 Jun 10 18:25:56.817762 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2865/5787] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:25:54 2022] GET /compute/v2.1/servers/e81a6dfe-0b14-44e1-9d1c-58d543f32faf => generated 1293 bytes in 2011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:25:56.908753 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c3e450ce-6761-407a-ab42-95d7d8b571ed tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:56.909543 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c3e450ce-6761-407a-ab42-95d7d8b571ed tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: e57747ec-57b8-46a6-92c2-8a57830524f7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:56.920000 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c3e450ce-6761-407a-ab42-95d7d8b571ed tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:56.923479 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c3e450ce-6761-407a-ab42-95d7d8b571ed tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:56.923479 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c3e450ce-6761-407a-ab42-95d7d8b571ed tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:56.923479 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c3e450ce-6761-407a-ab42-95d7d8b571ed tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:57.068219 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c3e450ce-6761-407a-ab42-95d7d8b571ed tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:57.081391 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c3e450ce-6761-407a-ab42-95d7d8b571ed tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7" status: 200 len: 1300 microversion: 2.1 time: 0.175360 Jun 10 18:25:57.084327 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2866/5788] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:25:56 2022] GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7 => generated 1300 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:25:57.159842 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fc6c5e40-d4c9-4a80-8415-fb92196450fa tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:57.168861 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fc6c5e40-d4c9-4a80-8415-fb92196450fa tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:57.170729 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fc6c5e40-d4c9-4a80-8415-fb92196450fa tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:57.172803 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fc6c5e40-d4c9-4a80-8415-fb92196450fa tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1719 microversion: 2.20 time: 0.633969 Jun 10 18:25:57.173934 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2923/5789] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:25:56 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1719 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:25:57.834284 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-84b86c57-5448-4043-976e-ff2df0a74596 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:57.835505 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-84b86c57-5448-4043-976e-ff2df0a74596 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: e81a6dfe-0b14-44e1-9d1c-58d543f32faf] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:57.852949 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-84b86c57-5448-4043-976e-ff2df0a74596 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:57.853418 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-84b86c57-5448-4043-976e-ff2df0a74596 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:57.854230 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-84b86c57-5448-4043-976e-ff2df0a74596 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:57.854688 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-84b86c57-5448-4043-976e-ff2df0a74596 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:58.100009 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0a2f3e3e-c5fe-4b1f-adb2-67bab6be6d9f tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:58.101143 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0a2f3e3e-c5fe-4b1f-adb2-67bab6be6d9f tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: e57747ec-57b8-46a6-92c2-8a57830524f7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:58.122430 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0a2f3e3e-c5fe-4b1f-adb2-67bab6be6d9f tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:58.124157 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0a2f3e3e-c5fe-4b1f-adb2-67bab6be6d9f tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:58.129572 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0a2f3e3e-c5fe-4b1f-adb2-67bab6be6d9f tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:58.133507 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0a2f3e3e-c5fe-4b1f-adb2-67bab6be6d9f tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:58.378540 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-84b86c57-5448-4043-976e-ff2df0a74596 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:58.393269 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-84b86c57-5448-4043-976e-ff2df0a74596 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/e81a6dfe-0b14-44e1-9d1c-58d543f32faf" status: 200 len: 1293 microversion: 2.1 time: 0.562706 Jun 10 18:25:58.398956 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2867/5790] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:25:57 2022] GET /compute/v2.1/servers/e81a6dfe-0b14-44e1-9d1c-58d543f32faf => generated 1293 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:25:58.653569 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0a2f3e3e-c5fe-4b1f-adb2-67bab6be6d9f tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:58.666804 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0a2f3e3e-c5fe-4b1f-adb2-67bab6be6d9f tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7" status: 200 len: 1368 microversion: 2.1 time: 0.570576 Jun 10 18:25:58.668621 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2924/5791] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:25:58 2022] GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7 => generated 1368 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:25:59.411158 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-735a3f5e-b9a4-4af2-9a5f-50b70544e09f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:59.411784 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-735a3f5e-b9a4-4af2-9a5f-50b70544e09f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: e81a6dfe-0b14-44e1-9d1c-58d543f32faf] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:59.415219 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:25:59.426454 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-735a3f5e-b9a4-4af2-9a5f-50b70544e09f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:59.428734 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-735a3f5e-b9a4-4af2-9a5f-50b70544e09f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:59.429698 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-735a3f5e-b9a4-4af2-9a5f-50b70544e09f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:59.430305 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-735a3f5e-b9a4-4af2-9a5f-50b70544e09f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:59.687581 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8670b044-563d-4460-8bfe-1a38833f1d86 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:25:59.690104 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8670b044-563d-4460-8bfe-1a38833f1d86 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: e57747ec-57b8-46a6-92c2-8a57830524f7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:25:59.706038 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8670b044-563d-4460-8bfe-1a38833f1d86 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:59.707030 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8670b044-563d-4460-8bfe-1a38833f1d86 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:59.710066 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8670b044-563d-4460-8bfe-1a38833f1d86 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:25:59.710686 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8670b044-563d-4460-8bfe-1a38833f1d86 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:25:59.875327 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-735a3f5e-b9a4-4af2-9a5f-50b70544e09f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:25:59.888940 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-735a3f5e-b9a4-4af2-9a5f-50b70544e09f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/e81a6dfe-0b14-44e1-9d1c-58d543f32faf" status: 200 len: 1293 microversion: 2.1 time: 0.481460 Jun 10 18:25:59.895870 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2868/5792] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:25:59 2022] GET /compute/v2.1/servers/e81a6dfe-0b14-44e1-9d1c-58d543f32faf => generated 1293 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:00.055937 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8670b044-563d-4460-8bfe-1a38833f1d86 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:00.072710 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8670b044-563d-4460-8bfe-1a38833f1d86 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7" status: 200 len: 1368 microversion: 2.1 time: 0.391583 Jun 10 18:26:00.073888 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2925/5793] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:25:59 2022] GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7 => generated 1368 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:00.819505 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-c74e338d-9a15-44ad-8e04-531d4c77c8fd req-80bb70c9-d9d0-4d84-8152-13ed591c5b0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e57747ec-57b8-46a6-92c2-8a57830524f7", "tag": "88584f5c-4452-438a-bb12-e9709663cd5d"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:26:00.836446 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-c74e338d-9a15-44ad-8e04-531d4c77c8fd req-80bb70c9-d9d0-4d84-8152-13ed591c5b0d service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:00.838762 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-c74e338d-9a15-44ad-8e04-531d4c77c8fd req-80bb70c9-d9d0-4d84-8152-13ed591c5b0d service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:00.863364 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-c74e338d-9a15-44ad-8e04-531d4c77c8fd req-80bb70c9-d9d0-4d84-8152-13ed591c5b0d service nova] Creating event network-changed:88584f5c-4452-438a-bb12-e9709663cd5d for instance e57747ec-57b8-46a6-92c2-8a57830524f7 on chh2-master-2 Jun 10 18:26:00.871273 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-c74e338d-9a15-44ad-8e04-531d4c77c8fd req-80bb70c9-d9d0-4d84-8152-13ed591c5b0d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.510213 Jun 10 18:26:00.876637 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2869/5794] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:26:00.909953 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-761b6e8a-4572-469d-b069-daa115500490 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:00.911213 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-761b6e8a-4572-469d-b069-daa115500490 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: e81a6dfe-0b14-44e1-9d1c-58d543f32faf] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:00.915603 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:26:00.918691 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=14 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:26:00.931512 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-761b6e8a-4572-469d-b069-daa115500490 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:00.932216 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-761b6e8a-4572-469d-b069-daa115500490 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:00.934356 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-761b6e8a-4572-469d-b069-daa115500490 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:00.954261 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-761b6e8a-4572-469d-b069-daa115500490 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:01.091501 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1b5bb105-0118-4c1a-b2b8-08d9b6b8ead7 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:01.092680 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1b5bb105-0118-4c1a-b2b8-08d9b6b8ead7 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: e57747ec-57b8-46a6-92c2-8a57830524f7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:01.105477 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1b5bb105-0118-4c1a-b2b8-08d9b6b8ead7 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:01.106116 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1b5bb105-0118-4c1a-b2b8-08d9b6b8ead7 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:01.113267 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1b5bb105-0118-4c1a-b2b8-08d9b6b8ead7 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:01.113855 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1b5bb105-0118-4c1a-b2b8-08d9b6b8ead7 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:01.208000 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=8 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:26:01.580728 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1b5bb105-0118-4c1a-b2b8-08d9b6b8ead7 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:01.589348 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1b5bb105-0118-4c1a-b2b8-08d9b6b8ead7 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7" status: 200 len: 1368 microversion: 2.1 time: 0.502667 Jun 10 18:26:01.599959 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2870/5795] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:01 2022] GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7 => generated 1368 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:01.668945 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-761b6e8a-4572-469d-b069-daa115500490 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:01.681791 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-761b6e8a-4572-469d-b069-daa115500490 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/e81a6dfe-0b14-44e1-9d1c-58d543f32faf" status: 200 len: 1293 microversion: 2.1 time: 0.775950 Jun 10 18:26:01.682403 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2926/5796] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:00 2022] GET /compute/v2.1/servers/e81a6dfe-0b14-44e1-9d1c-58d543f32faf => generated 1293 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:02.619303 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4d4037ca-b713-406f-86d9-c1fa72c9d523 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:02.623040 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4d4037ca-b713-406f-86d9-c1fa72c9d523 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: e57747ec-57b8-46a6-92c2-8a57830524f7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:02.631878 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d4037ca-b713-406f-86d9-c1fa72c9d523 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:02.632478 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d4037ca-b713-406f-86d9-c1fa72c9d523 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:02.633760 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d4037ca-b713-406f-86d9-c1fa72c9d523 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:02.635426 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d4037ca-b713-406f-86d9-c1fa72c9d523 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:02.702297 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3d4bcc82-dc36-4eeb-b8c1-4a862773e62a tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:02.703597 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3d4bcc82-dc36-4eeb-b8c1-4a862773e62a tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: e81a6dfe-0b14-44e1-9d1c-58d543f32faf] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:02.712146 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:26:02.714404 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3d4bcc82-dc36-4eeb-b8c1-4a862773e62a tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:02.715081 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3d4bcc82-dc36-4eeb-b8c1-4a862773e62a tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:02.716331 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3d4bcc82-dc36-4eeb-b8c1-4a862773e62a tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:02.717348 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3d4bcc82-dc36-4eeb-b8c1-4a862773e62a tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:02.898065 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4d4037ca-b713-406f-86d9-c1fa72c9d523 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:02.923856 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4d4037ca-b713-406f-86d9-c1fa72c9d523 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7" status: 200 len: 1368 microversion: 2.1 time: 0.318978 Jun 10 18:26:02.950192 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2871/5797] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:02 2022] GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7 => generated 1368 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:03.299296 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-8062222e-8e33-4636-b747-5d69be53ef5f req-beb86215-0aad-4a4e-a4ab-a4c6562acc85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e81a6dfe-0b14-44e1-9d1c-58d543f32faf", "name": "network-vif-plugged", "status": "completed", "tag": "2b5203dd-df2f-4988-b40a-11600acbe1f4"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:26:03.309311 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-8062222e-8e33-4636-b747-5d69be53ef5f req-beb86215-0aad-4a4e-a4ab-a4c6562acc85 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:03.310235 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-8062222e-8e33-4636-b747-5d69be53ef5f req-beb86215-0aad-4a4e-a4ab-a4c6562acc85 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:03.322474 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-8062222e-8e33-4636-b747-5d69be53ef5f req-beb86215-0aad-4a4e-a4ab-a4c6562acc85 service nova] Creating event network-vif-plugged:2b5203dd-df2f-4988-b40a-11600acbe1f4 for instance e81a6dfe-0b14-44e1-9d1c-58d543f32faf on chh1-master-2 Jun 10 18:26:03.331406 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-8062222e-8e33-4636-b747-5d69be53ef5f req-beb86215-0aad-4a4e-a4ab-a4c6562acc85 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034573 Jun 10 18:26:03.332077 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2872/5798] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:26:03.432568 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3d4bcc82-dc36-4eeb-b8c1-4a862773e62a tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:03.446477 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3d4bcc82-dc36-4eeb-b8c1-4a862773e62a tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/e81a6dfe-0b14-44e1-9d1c-58d543f32faf" status: 200 len: 1293 microversion: 2.1 time: 0.750451 Jun 10 18:26:03.447286 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2927/5799] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:02 2022] GET /compute/v2.1/servers/e81a6dfe-0b14-44e1-9d1c-58d543f32faf => generated 1293 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:26:03.953233 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ba669f41-689e-4b27-bebb-ad3da5b9f5c0 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:03.954844 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ba669f41-689e-4b27-bebb-ad3da5b9f5c0 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: e57747ec-57b8-46a6-92c2-8a57830524f7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:03.970964 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ba669f41-689e-4b27-bebb-ad3da5b9f5c0 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:03.971674 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ba669f41-689e-4b27-bebb-ad3da5b9f5c0 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:03.974771 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ba669f41-689e-4b27-bebb-ad3da5b9f5c0 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:03.975398 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ba669f41-689e-4b27-bebb-ad3da5b9f5c0 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:04.355450 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ba669f41-689e-4b27-bebb-ad3da5b9f5c0 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:04.369094 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ba669f41-689e-4b27-bebb-ad3da5b9f5c0 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7" status: 200 len: 1368 microversion: 2.1 time: 0.419455 Jun 10 18:26:04.371299 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2873/5800] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:03 2022] GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7 => generated 1368 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:04.469735 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-dc0a8317-4c51-4160-84d2-9a41f92caaef tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:04.470364 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-dc0a8317-4c51-4160-84d2-9a41f92caaef tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: e81a6dfe-0b14-44e1-9d1c-58d543f32faf] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:04.483400 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dc0a8317-4c51-4160-84d2-9a41f92caaef tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:04.483861 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dc0a8317-4c51-4160-84d2-9a41f92caaef tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:04.487290 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dc0a8317-4c51-4160-84d2-9a41f92caaef tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:04.487784 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dc0a8317-4c51-4160-84d2-9a41f92caaef tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:04.821206 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-dc0a8317-4c51-4160-84d2-9a41f92caaef tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:04.844077 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-dc0a8317-4c51-4160-84d2-9a41f92caaef tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/e81a6dfe-0b14-44e1-9d1c-58d543f32faf" status: 200 len: 1293 microversion: 2.1 time: 0.378181 Jun 10 18:26:04.846061 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2928/5801] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:04 2022] GET /compute/v2.1/servers/e81a6dfe-0b14-44e1-9d1c-58d543f32faf => generated 1293 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:05.391355 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-80a5c5ca-64aa-4011-a560-ffa307d566db tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:05.392007 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-80a5c5ca-64aa-4011-a560-ffa307d566db tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: e57747ec-57b8-46a6-92c2-8a57830524f7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:05.412254 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-80a5c5ca-64aa-4011-a560-ffa307d566db tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:05.412731 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-80a5c5ca-64aa-4011-a560-ffa307d566db tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:05.419039 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-80a5c5ca-64aa-4011-a560-ffa307d566db tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:05.419039 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-80a5c5ca-64aa-4011-a560-ffa307d566db tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:05.649311 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-80a5c5ca-64aa-4011-a560-ffa307d566db tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:05.678117 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-80a5c5ca-64aa-4011-a560-ffa307d566db tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7" status: 200 len: 1368 microversion: 2.1 time: 0.291771 Jun 10 18:26:05.679286 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2874/5802] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:05 2022] GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7 => generated 1368 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:05.862473 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fe4db777-215f-49de-b089-ee53a0d19145 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:05.863076 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fe4db777-215f-49de-b089-ee53a0d19145 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: e81a6dfe-0b14-44e1-9d1c-58d543f32faf] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:05.877162 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fe4db777-215f-49de-b089-ee53a0d19145 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:05.879036 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fe4db777-215f-49de-b089-ee53a0d19145 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:05.882719 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fe4db777-215f-49de-b089-ee53a0d19145 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:05.883845 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fe4db777-215f-49de-b089-ee53a0d19145 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:06.252861 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fe4db777-215f-49de-b089-ee53a0d19145 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:06.261973 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fe4db777-215f-49de-b089-ee53a0d19145 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/e81a6dfe-0b14-44e1-9d1c-58d543f32faf" status: 200 len: 1473 microversion: 2.1 time: 0.403353 Jun 10 18:26:06.262553 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2929/5803] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:05 2022] GET /compute/v2.1/servers/e81a6dfe-0b14-44e1-9d1c-58d543f32faf => generated 1473 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:06.484276 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f176a900-983e-40dd-92f1-0b5361581205 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1854219700", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:26:06.589075 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-f176a900-983e-40dd-92f1-0b5361581205 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] validate_networks() for [('940d65ec-437e-4f98-a601-e2ba4906c363', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:26:06.696203 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4a976a30-c093-4eed-91ed-1e248627e9ac tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:06.696988 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4a976a30-c093-4eed-91ed-1e248627e9ac tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: e57747ec-57b8-46a6-92c2-8a57830524f7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:06.704209 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4a976a30-c093-4eed-91ed-1e248627e9ac tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:06.705021 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4a976a30-c093-4eed-91ed-1e248627e9ac tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:06.707331 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4a976a30-c093-4eed-91ed-1e248627e9ac tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:06.708014 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4a976a30-c093-4eed-91ed-1e248627e9ac tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:06.910092 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4a976a30-c093-4eed-91ed-1e248627e9ac tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:06.925793 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4a976a30-c093-4eed-91ed-1e248627e9ac tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7" status: 200 len: 1368 microversion: 2.1 time: 0.234324 Jun 10 18:26:06.927324 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2930/5804] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:06 2022] GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7 => generated 1368 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:07.401889 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-c9912df8-23ad-4ecd-9611-73afe876c867 req-a3ac8175-973e-400a-8182-795c1b7eb616 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e57747ec-57b8-46a6-92c2-8a57830524f7", "name": "network-vif-plugged", "status": "completed", "tag": "88584f5c-4452-438a-bb12-e9709663cd5d"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:26:07.420092 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-c9912df8-23ad-4ecd-9611-73afe876c867 req-a3ac8175-973e-400a-8182-795c1b7eb616 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:07.422138 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-c9912df8-23ad-4ecd-9611-73afe876c867 req-a3ac8175-973e-400a-8182-795c1b7eb616 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:07.455072 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-c9912df8-23ad-4ecd-9611-73afe876c867 req-a3ac8175-973e-400a-8182-795c1b7eb616 service nova] Creating event network-vif-plugged:88584f5c-4452-438a-bb12-e9709663cd5d for instance e57747ec-57b8-46a6-92c2-8a57830524f7 on chh2-master-2 Jun 10 18:26:07.463746 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-c9912df8-23ad-4ecd-9611-73afe876c867 req-a3ac8175-973e-400a-8182-795c1b7eb616 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067161 Jun 10 18:26:07.465268 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2931/5805] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:26:07.517067 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-f176a900-983e-40dd-92f1-0b5361581205 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:26:07.517865 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-f176a900-983e-40dd-92f1-0b5361581205 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:26:07.518351 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-f176a900-983e-40dd-92f1-0b5361581205 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:26:07.518762 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-f176a900-983e-40dd-92f1-0b5361581205 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:26:07.519176 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-f176a900-983e-40dd-92f1-0b5361581205 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:26:07.532152 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f176a900-983e-40dd-92f1-0b5361581205 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:07.532637 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f176a900-983e-40dd-92f1-0b5361581205 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:07.538828 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f176a900-983e-40dd-92f1-0b5361581205 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:07.539541 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f176a900-983e-40dd-92f1-0b5361581205 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:07.591731 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-f176a900-983e-40dd-92f1-0b5361581205 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Getting quotas for project ded497d3d91b4e22bc2daa72d6f75d18. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:26:07.603153 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-f176a900-983e-40dd-92f1-0b5361581205 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Getting quotas for user d37f560237d9489e96ddee21d9f5e6c6 and project ded497d3d91b4e22bc2daa72d6f75d18. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:26:07.624856 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f176a900-983e-40dd-92f1-0b5361581205 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:26:07.628087 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f176a900-983e-40dd-92f1-0b5361581205 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 45960e22-dd06-483d-868a-f9b5b9f95957] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:26:07.785196 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f176a900-983e-40dd-92f1-0b5361581205 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.306928 Jun 10 18:26:07.786122 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2875/5806] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:26:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1310 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:26:07.798026 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bc766cbf-d1b0-42eb-904e-00a1e519cf29 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:07.798885 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bc766cbf-d1b0-42eb-904e-00a1e519cf29 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 45960e22-dd06-483d-868a-f9b5b9f95957] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:07.846630 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bc766cbf-d1b0-42eb-904e-00a1e519cf29 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 45960e22-dd06-483d-868a-f9b5b9f95957] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:26:07.943785 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f582735f-013b-48cc-b467-f4308ba6b080 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:07.945238 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f582735f-013b-48cc-b467-f4308ba6b080 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: e57747ec-57b8-46a6-92c2-8a57830524f7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:07.956357 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f582735f-013b-48cc-b467-f4308ba6b080 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:07.956357 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f582735f-013b-48cc-b467-f4308ba6b080 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:07.956357 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f582735f-013b-48cc-b467-f4308ba6b080 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:07.956357 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f582735f-013b-48cc-b467-f4308ba6b080 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:08.304237 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f582735f-013b-48cc-b467-f4308ba6b080 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:08.324344 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f582735f-013b-48cc-b467-f4308ba6b080 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7" status: 200 len: 1368 microversion: 2.1 time: 0.383715 Jun 10 18:26:08.337621 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2876/5807] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:07 2022] GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7 => generated 1368 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:09.117125 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bc766cbf-d1b0-42eb-904e-00a1e519cf29 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "DELETE /compute/v2.1/servers/45960e22-dd06-483d-868a-f9b5b9f95957" status: 204 len: 0 microversion: 2.1 time: 1.323522 Jun 10 18:26:09.117732 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2932/5808] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:26:07 2022] DELETE /compute/v2.1/servers/45960e22-dd06-483d-868a-f9b5b9f95957 => generated 0 bytes in 1326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:26:09.128638 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-12d0179b-66b8-4138-9208-5f1d172bbf18 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:09.129185 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-12d0179b-66b8-4138-9208-5f1d172bbf18 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 45960e22-dd06-483d-868a-f9b5b9f95957] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:09.177258 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-12d0179b-66b8-4138-9208-5f1d172bbf18 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] HTTP exception thrown: Instance 45960e22-dd06-483d-868a-f9b5b9f95957 could not be found. Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-12d0179b-66b8-4138-9208-5f1d172bbf18 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Request method failure captured: Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/45960e22-dd06-483d-868a-f9b5b9f95957 HTTP/1.1 Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4ylUNGY8VKO5jLVY6McXmkU53BpB453bvCKmrvaQGLJAZV-lieSSXu8nUaF6yxU0RZxSma5kvfEU2IFgDObEl38j4CHosWLE8jUTpbhfPjW3XqChWMzwgLKa4BS5Yox1cN_jUzeYnin3TOSxn98enTacAe1cvDVZ2oUSAgL46qFPsc Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ded497d3d91b4e22bc2daa72d6f75d18", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersTestJSON-1873283063 Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersTestJSON-1873283063-project Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: d37f560237d9489e96ddee21d9f5e6c6 Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersTestJSON-1873283063-project Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 45960e22-dd06-483d-868a-f9b5b9f95957 could not be found. Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '45960e22-dd06-483d-868a-f9b5b9f95957'} Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2877, in _get_instance Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 45960e22-dd06-483d-868a-f9b5b9f95957 Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2889, in _get_instance Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45960e22-dd06-483d-868a-f9b5b9f95957 could not be found. Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:26:09.180099 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:26:09.189777 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:26:09.189777 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:26:09.189777 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:26:09.189777 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:26:09.189777 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:26:09.189777 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:26:09.189777 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:26:09.189777 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:26:09.189777 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:26:09.189777 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:26:09.189777 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45960e22-dd06-483d-868a-f9b5b9f95957 could not be found. Jun 10 18:26:09.189777 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:26:09.189777 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:26:09.189777 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:26:09.189777 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:26:09.189777 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:26:09.189777 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:26:09.189777 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:26:09.189777 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:26:09.189777 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45960e22-dd06-483d-868a-f9b5b9f95957 could not be found. Jun 10 18:26:09.189777 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:26:09.189777 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-12d0179b-66b8-4138-9208-5f1d172bbf18 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Returning 404 to user: Instance 45960e22-dd06-483d-868a-f9b5b9f95957 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:26:09.189777 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-12d0179b-66b8-4138-9208-5f1d172bbf18 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/45960e22-dd06-483d-868a-f9b5b9f95957" status: 404 len: 111 microversion: 2.1 time: 0.060086 Jun 10 18:26:09.207014 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2877/5809] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:09 2022] GET /compute/v2.1/servers/45960e22-dd06-483d-868a-f9b5b9f95957 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:26:09.348886 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-054b7622-0527-4a9a-bb1f-e8211480a036 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:09.349666 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-054b7622-0527-4a9a-bb1f-e8211480a036 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: e57747ec-57b8-46a6-92c2-8a57830524f7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:09.353203 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d5d328d5-91f1-4bdd-9a7a-0e92b9a863b7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-704850397", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "940d65ec-437e-4f98-a601-e2ba4906c363"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:26:09.367026 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-054b7622-0527-4a9a-bb1f-e8211480a036 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:09.367616 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-054b7622-0527-4a9a-bb1f-e8211480a036 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:09.370392 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-054b7622-0527-4a9a-bb1f-e8211480a036 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:09.371864 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-054b7622-0527-4a9a-bb1f-e8211480a036 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:09.478630 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-d5d328d5-91f1-4bdd-9a7a-0e92b9a863b7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] validate_networks() for [('940d65ec-437e-4f98-a601-e2ba4906c363', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:26:09.643005 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-054b7622-0527-4a9a-bb1f-e8211480a036 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:09.652775 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-054b7622-0527-4a9a-bb1f-e8211480a036 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7" status: 200 len: 1368 microversion: 2.1 time: 0.312538 Jun 10 18:26:09.655378 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2933/5810] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:09 2022] GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7 => generated 1368 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:10.570966 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-d5d328d5-91f1-4bdd-9a7a-0e92b9a863b7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:26:10.571761 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-d5d328d5-91f1-4bdd-9a7a-0e92b9a863b7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:26:10.572556 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-d5d328d5-91f1-4bdd-9a7a-0e92b9a863b7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:26:10.573187 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-d5d328d5-91f1-4bdd-9a7a-0e92b9a863b7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:26:10.573765 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-d5d328d5-91f1-4bdd-9a7a-0e92b9a863b7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:26:10.587790 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d5d328d5-91f1-4bdd-9a7a-0e92b9a863b7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:10.590216 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d5d328d5-91f1-4bdd-9a7a-0e92b9a863b7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:10.590216 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d5d328d5-91f1-4bdd-9a7a-0e92b9a863b7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:10.593069 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d5d328d5-91f1-4bdd-9a7a-0e92b9a863b7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:10.620875 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-d5d328d5-91f1-4bdd-9a7a-0e92b9a863b7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Getting quotas for project ded497d3d91b4e22bc2daa72d6f75d18. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:26:10.640259 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-d5d328d5-91f1-4bdd-9a7a-0e92b9a863b7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Getting quotas for user d37f560237d9489e96ddee21d9f5e6c6 and project ded497d3d91b4e22bc2daa72d6f75d18. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:26:10.658291 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d5d328d5-91f1-4bdd-9a7a-0e92b9a863b7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:26:10.660637 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d5d328d5-91f1-4bdd-9a7a-0e92b9a863b7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: a0a1cfa6-b42a-43f1-87d7-8564b895dbcb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:26:10.671777 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4f049f02-5a6f-4df2-8e45-8c18de9c0571 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:10.673183 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4f049f02-5a6f-4df2-8e45-8c18de9c0571 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: e57747ec-57b8-46a6-92c2-8a57830524f7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:10.680699 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4f049f02-5a6f-4df2-8e45-8c18de9c0571 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:10.681160 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4f049f02-5a6f-4df2-8e45-8c18de9c0571 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:10.681929 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4f049f02-5a6f-4df2-8e45-8c18de9c0571 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:10.682377 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4f049f02-5a6f-4df2-8e45-8c18de9c0571 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:10.853032 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d5d328d5-91f1-4bdd-9a7a-0e92b9a863b7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.504328 Jun 10 18:26:10.865800 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2878/5811] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:26:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:26:10.870505 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-55b1e333-6a1f-46b2-99d4-b63b944c08db tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:10.871664 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-55b1e333-6a1f-46b2-99d4-b63b944c08db tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: a0a1cfa6-b42a-43f1-87d7-8564b895dbcb] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:11.034061 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-55b1e333-6a1f-46b2-99d4-b63b944c08db tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:11.042931 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-55b1e333-6a1f-46b2-99d4-b63b944c08db tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb" status: 200 len: 1220 microversion: 2.1 time: 0.177840 Jun 10 18:26:11.050591 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2879/5812] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:10 2022] GET /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb => generated 1220 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:26:11.079370 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4f049f02-5a6f-4df2-8e45-8c18de9c0571 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:11.093045 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4f049f02-5a6f-4df2-8e45-8c18de9c0571 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7" status: 200 len: 1558 microversion: 2.1 time: 0.425324 Jun 10 18:26:11.095680 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2934/5813] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:10 2022] GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7 => generated 1558 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:26:11.112575 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-44a0e374-c443-4933-909a-42f9565176a3 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:11.113895 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-44a0e374-c443-4933-909a-42f9565176a3 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: e57747ec-57b8-46a6-92c2-8a57830524f7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:11.119411 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44a0e374-c443-4933-909a-42f9565176a3 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:11.125649 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44a0e374-c443-4933-909a-42f9565176a3 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:11.126209 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44a0e374-c443-4933-909a-42f9565176a3 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:11.126655 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44a0e374-c443-4933-909a-42f9565176a3 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:11.250647 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-44a0e374-c443-4933-909a-42f9565176a3 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.142134 Jun 10 18:26:11.251244 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2880/5814] 10.222.0.35 () {58 vars in 1274 bytes} [Fri Jun 10 18:26:11 2022] GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7/os-interface => generated 284 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:26:12.063942 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3ad71556-08ff-4006-b0db-5ac86da123e7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:12.064755 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3ad71556-08ff-4006-b0db-5ac86da123e7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: a0a1cfa6-b42a-43f1-87d7-8564b895dbcb] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:12.225968 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3ad71556-08ff-4006-b0db-5ac86da123e7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:12.238832 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3ad71556-08ff-4006-b0db-5ac86da123e7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb" status: 200 len: 1220 microversion: 2.1 time: 0.180123 Jun 10 18:26:12.250940 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2935/5815] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:12 2022] GET /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb => generated 1220 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:13.148971 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-90f1cdb5-2cd4-4889-83ea-d7702b5bfa3a req-bdf966ef-811f-419c-85a2-4c74dccc3dcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e57747ec-57b8-46a6-92c2-8a57830524f7", "tag": "88584f5c-4452-438a-bb12-e9709663cd5d"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:26:13.181524 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-90f1cdb5-2cd4-4889-83ea-d7702b5bfa3a req-bdf966ef-811f-419c-85a2-4c74dccc3dcc service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:13.187989 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-90f1cdb5-2cd4-4889-83ea-d7702b5bfa3a req-bdf966ef-811f-419c-85a2-4c74dccc3dcc service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:13.212794 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-90f1cdb5-2cd4-4889-83ea-d7702b5bfa3a req-bdf966ef-811f-419c-85a2-4c74dccc3dcc service nova] Creating event network-changed:88584f5c-4452-438a-bb12-e9709663cd5d for instance e57747ec-57b8-46a6-92c2-8a57830524f7 on chh2-master-2 Jun 10 18:26:13.219600 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-90f1cdb5-2cd4-4889-83ea-d7702b5bfa3a req-bdf966ef-811f-419c-85a2-4c74dccc3dcc service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074556 Jun 10 18:26:13.220777 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2881/5816] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:26:13.264679 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4b3e9ed5-028a-4a2e-bfed-9e19ee4eba06 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:13.266073 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4b3e9ed5-028a-4a2e-bfed-9e19ee4eba06 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: a0a1cfa6-b42a-43f1-87d7-8564b895dbcb] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:13.285541 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4b3e9ed5-028a-4a2e-bfed-9e19ee4eba06 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:13.298906 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4b3e9ed5-028a-4a2e-bfed-9e19ee4eba06 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:13.305220 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4b3e9ed5-028a-4a2e-bfed-9e19ee4eba06 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:13.306082 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4b3e9ed5-028a-4a2e-bfed-9e19ee4eba06 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:13.468673 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4b3e9ed5-028a-4a2e-bfed-9e19ee4eba06 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:13.482839 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4b3e9ed5-028a-4a2e-bfed-9e19ee4eba06 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb" status: 200 len: 1272 microversion: 2.1 time: 0.222328 Jun 10 18:26:13.483839 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2936/5817] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:13 2022] GET /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb => generated 1272 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:14.507088 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8d3c8e82-eed8-41b5-beb3-d05299dcc302 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:14.509060 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8d3c8e82-eed8-41b5-beb3-d05299dcc302 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: a0a1cfa6-b42a-43f1-87d7-8564b895dbcb] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:14.535980 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8d3c8e82-eed8-41b5-beb3-d05299dcc302 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:14.536684 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8d3c8e82-eed8-41b5-beb3-d05299dcc302 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:14.541609 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8d3c8e82-eed8-41b5-beb3-d05299dcc302 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:14.542267 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8d3c8e82-eed8-41b5-beb3-d05299dcc302 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:14.713915 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8d3c8e82-eed8-41b5-beb3-d05299dcc302 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:14.725357 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8d3c8e82-eed8-41b5-beb3-d05299dcc302 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb" status: 200 len: 1278 microversion: 2.1 time: 0.224279 Jun 10 18:26:14.727851 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2882/5818] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:14 2022] GET /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb => generated 1278 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:15.748088 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1927d71e-d337-4a14-aea6-e83ebb568367 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:15.748915 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1927d71e-d337-4a14-aea6-e83ebb568367 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: a0a1cfa6-b42a-43f1-87d7-8564b895dbcb] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:15.771000 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1927d71e-d337-4a14-aea6-e83ebb568367 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:15.773446 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1927d71e-d337-4a14-aea6-e83ebb568367 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:15.775426 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1927d71e-d337-4a14-aea6-e83ebb568367 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:15.790232 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1927d71e-d337-4a14-aea6-e83ebb568367 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:15.961712 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1927d71e-d337-4a14-aea6-e83ebb568367 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:15.971406 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1927d71e-d337-4a14-aea6-e83ebb568367 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb" status: 200 len: 1278 microversion: 2.1 time: 0.227150 Jun 10 18:26:15.976669 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2937/5819] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:15 2022] GET /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb => generated 1278 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:16.990076 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-40694a9a-5452-49d4-972d-d232d99edb14 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:16.991375 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-40694a9a-5452-49d4-972d-d232d99edb14 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: a0a1cfa6-b42a-43f1-87d7-8564b895dbcb] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:17.006391 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-40694a9a-5452-49d4-972d-d232d99edb14 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:17.006816 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-40694a9a-5452-49d4-972d-d232d99edb14 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:17.007605 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-40694a9a-5452-49d4-972d-d232d99edb14 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:17.008044 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-40694a9a-5452-49d4-972d-d232d99edb14 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:17.036738 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:26:17.241100 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-40694a9a-5452-49d4-972d-d232d99edb14 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:17.241100 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-40694a9a-5452-49d4-972d-d232d99edb14 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb" status: 200 len: 1320 microversion: 2.1 time: 0.252962 Jun 10 18:26:17.241100 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2883/5820] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:16 2022] GET /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb => generated 1320 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:17.697089 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-21246617-95a2-42f5-abab-6f6862fd9289 req-22fd6563-ecb4-4592-aaaf-1d318a099ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0a1cfa6-b42a-43f1-87d7-8564b895dbcb", "tag": "c5ce3452-94cd-481c-9bed-026c52c805c4"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:26:17.712968 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-21246617-95a2-42f5-abab-6f6862fd9289 req-22fd6563-ecb4-4592-aaaf-1d318a099ba7 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:17.713493 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-21246617-95a2-42f5-abab-6f6862fd9289 req-22fd6563-ecb4-4592-aaaf-1d318a099ba7 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:17.731525 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-21246617-95a2-42f5-abab-6f6862fd9289 req-22fd6563-ecb4-4592-aaaf-1d318a099ba7 service nova] Creating event network-changed:c5ce3452-94cd-481c-9bed-026c52c805c4 for instance a0a1cfa6-b42a-43f1-87d7-8564b895dbcb on chh1-master-2 Jun 10 18:26:17.741377 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-21246617-95a2-42f5-abab-6f6862fd9289 req-22fd6563-ecb4-4592-aaaf-1d318a099ba7 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049429 Jun 10 18:26:17.742265 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2938/5821] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:26:18.262961 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-57ba1477-1eba-46a1-9dd8-63c41476755b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:18.263616 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-57ba1477-1eba-46a1-9dd8-63c41476755b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: a0a1cfa6-b42a-43f1-87d7-8564b895dbcb] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:18.283041 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-57ba1477-1eba-46a1-9dd8-63c41476755b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:18.283893 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-57ba1477-1eba-46a1-9dd8-63c41476755b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:18.285367 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-57ba1477-1eba-46a1-9dd8-63c41476755b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:18.286262 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-57ba1477-1eba-46a1-9dd8-63c41476755b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:18.538079 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-57ba1477-1eba-46a1-9dd8-63c41476755b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:18.546862 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-57ba1477-1eba-46a1-9dd8-63c41476755b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb" status: 200 len: 1320 microversion: 2.1 time: 0.288961 Jun 10 18:26:18.562761 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2884/5822] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:18 2022] GET /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb => generated 1320 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:19.566665 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-502daf5b-b7d8-4f66-8323-504d1151b4e9 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:19.567149 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-502daf5b-b7d8-4f66-8323-504d1151b4e9 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: a0a1cfa6-b42a-43f1-87d7-8564b895dbcb] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:19.580950 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-502daf5b-b7d8-4f66-8323-504d1151b4e9 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:19.581460 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-502daf5b-b7d8-4f66-8323-504d1151b4e9 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:19.582403 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-502daf5b-b7d8-4f66-8323-504d1151b4e9 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:19.582711 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-502daf5b-b7d8-4f66-8323-504d1151b4e9 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:19.736051 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-502daf5b-b7d8-4f66-8323-504d1151b4e9 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:19.745386 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-502daf5b-b7d8-4f66-8323-504d1151b4e9 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb" status: 200 len: 1320 microversion: 2.1 time: 0.183906 Jun 10 18:26:19.756061 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2939/5823] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:19 2022] GET /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb => generated 1320 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:20.763294 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fdd245ad-edf4-4614-8d99-65848b4b3cc3 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:20.764663 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fdd245ad-edf4-4614-8d99-65848b4b3cc3 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: a0a1cfa6-b42a-43f1-87d7-8564b895dbcb] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:20.771106 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:26:20.783414 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fdd245ad-edf4-4614-8d99-65848b4b3cc3 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:20.783414 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fdd245ad-edf4-4614-8d99-65848b4b3cc3 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:20.783414 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fdd245ad-edf4-4614-8d99-65848b4b3cc3 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:20.783414 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fdd245ad-edf4-4614-8d99-65848b4b3cc3 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:21.042419 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=14 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:26:21.080150 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fdd245ad-edf4-4614-8d99-65848b4b3cc3 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:21.091337 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fdd245ad-edf4-4614-8d99-65848b4b3cc3 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb" status: 200 len: 1320 microversion: 2.1 time: 0.331581 Jun 10 18:26:21.093283 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2885/5824] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:20 2022] GET /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb => generated 1320 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:22.111443 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d64913ae-7406-4a66-a663-2314e5e5f8e1 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:22.112075 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d64913ae-7406-4a66-a663-2314e5e5f8e1 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: a0a1cfa6-b42a-43f1-87d7-8564b895dbcb] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:22.128234 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d64913ae-7406-4a66-a663-2314e5e5f8e1 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:22.128234 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d64913ae-7406-4a66-a663-2314e5e5f8e1 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:22.128871 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d64913ae-7406-4a66-a663-2314e5e5f8e1 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:22.129598 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d64913ae-7406-4a66-a663-2314e5e5f8e1 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:22.237527 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=4 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:26:22.289268 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d64913ae-7406-4a66-a663-2314e5e5f8e1 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:22.297626 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d64913ae-7406-4a66-a663-2314e5e5f8e1 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb" status: 200 len: 1320 microversion: 2.1 time: 0.190225 Jun 10 18:26:22.298541 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2940/5825] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:22 2022] GET /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb => generated 1320 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:23.316744 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7eb8e249-c03f-480f-9396-1ef7ad34ebdb tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:23.317369 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7eb8e249-c03f-480f-9396-1ef7ad34ebdb tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: a0a1cfa6-b42a-43f1-87d7-8564b895dbcb] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:23.327401 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7eb8e249-c03f-480f-9396-1ef7ad34ebdb tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:23.327866 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7eb8e249-c03f-480f-9396-1ef7ad34ebdb tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:23.332767 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7eb8e249-c03f-480f-9396-1ef7ad34ebdb tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:23.333232 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7eb8e249-c03f-480f-9396-1ef7ad34ebdb tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:23.585085 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7eb8e249-c03f-480f-9396-1ef7ad34ebdb tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:23.595876 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7eb8e249-c03f-480f-9396-1ef7ad34ebdb tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb" status: 200 len: 1320 microversion: 2.1 time: 0.284455 Jun 10 18:26:23.606165 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2886/5826] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:23 2022] GET /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb => generated 1320 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:24.616079 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-79ac63ec-7410-4704-a1e3-c1091027cd8e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:24.617361 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-79ac63ec-7410-4704-a1e3-c1091027cd8e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: a0a1cfa6-b42a-43f1-87d7-8564b895dbcb] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:24.624772 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-79ac63ec-7410-4704-a1e3-c1091027cd8e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:24.625539 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-79ac63ec-7410-4704-a1e3-c1091027cd8e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:24.626505 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-79ac63ec-7410-4704-a1e3-c1091027cd8e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:24.626957 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-79ac63ec-7410-4704-a1e3-c1091027cd8e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:24.888595 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-79ac63ec-7410-4704-a1e3-c1091027cd8e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:24.895979 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:26:24.905429 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-79ac63ec-7410-4704-a1e3-c1091027cd8e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb" status: 200 len: 1320 microversion: 2.1 time: 0.291341 Jun 10 18:26:24.908518 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2941/5827] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:24 2022] GET /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb => generated 1320 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:25.228568 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-0a4b6401-d239-4906-a4e8-fc2fdec7a335 req-d24bdaf0-2ef4-4756-8960-21fa9a4bb817 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a1cfa6-b42a-43f1-87d7-8564b895dbcb", "name": "network-vif-plugged", "status": "completed", "tag": "c5ce3452-94cd-481c-9bed-026c52c805c4"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:26:25.240215 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-0a4b6401-d239-4906-a4e8-fc2fdec7a335 req-d24bdaf0-2ef4-4756-8960-21fa9a4bb817 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:25.242835 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-0a4b6401-d239-4906-a4e8-fc2fdec7a335 req-d24bdaf0-2ef4-4756-8960-21fa9a4bb817 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:25.257717 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-0a4b6401-d239-4906-a4e8-fc2fdec7a335 req-d24bdaf0-2ef4-4756-8960-21fa9a4bb817 service nova] Creating event network-vif-plugged:c5ce3452-94cd-481c-9bed-026c52c805c4 for instance a0a1cfa6-b42a-43f1-87d7-8564b895dbcb on chh1-master-2 Jun 10 18:26:25.267683 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-0a4b6401-d239-4906-a4e8-fc2fdec7a335 req-d24bdaf0-2ef4-4756-8960-21fa9a4bb817 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041272 Jun 10 18:26:25.267683 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2887/5828] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:26:25.925328 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a37e34af-5da8-4adb-9acd-f4ea6c05439e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:25.925957 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a37e34af-5da8-4adb-9acd-f4ea6c05439e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: a0a1cfa6-b42a-43f1-87d7-8564b895dbcb] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:25.933410 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a37e34af-5da8-4adb-9acd-f4ea6c05439e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:25.933874 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a37e34af-5da8-4adb-9acd-f4ea6c05439e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:25.934693 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a37e34af-5da8-4adb-9acd-f4ea6c05439e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:25.935134 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a37e34af-5da8-4adb-9acd-f4ea6c05439e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:26.118195 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a37e34af-5da8-4adb-9acd-f4ea6c05439e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:26.126916 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a37e34af-5da8-4adb-9acd-f4ea6c05439e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb" status: 200 len: 1320 microversion: 2.1 time: 0.206211 Jun 10 18:26:26.128000 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2942/5829] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:25 2022] GET /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb => generated 1320 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:27.146053 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6f989799-0c89-416e-aa49-ab244e2488fd tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:27.146925 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6f989799-0c89-416e-aa49-ab244e2488fd tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: a0a1cfa6-b42a-43f1-87d7-8564b895dbcb] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:27.162687 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6f989799-0c89-416e-aa49-ab244e2488fd tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:27.163421 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6f989799-0c89-416e-aa49-ab244e2488fd tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:27.164212 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6f989799-0c89-416e-aa49-ab244e2488fd tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:27.164761 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6f989799-0c89-416e-aa49-ab244e2488fd tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:27.849793 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6f989799-0c89-416e-aa49-ab244e2488fd tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:27.861086 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6f989799-0c89-416e-aa49-ab244e2488fd tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb" status: 200 len: 1500 microversion: 2.1 time: 0.719652 Jun 10 18:26:27.873988 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2888/5830] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:27 2022] GET /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb => generated 1500 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:27.880267 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b435095b-9acb-4735-8d4a-df3c49b0b062 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:27.881638 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b435095b-9acb-4735-8d4a-df3c49b0b062 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: a0a1cfa6-b42a-43f1-87d7-8564b895dbcb] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:27.890190 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b435095b-9acb-4735-8d4a-df3c49b0b062 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:27.890817 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b435095b-9acb-4735-8d4a-df3c49b0b062 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:27.891755 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b435095b-9acb-4735-8d4a-df3c49b0b062 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:27.892377 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b435095b-9acb-4735-8d4a-df3c49b0b062 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:28.150364 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b435095b-9acb-4735-8d4a-df3c49b0b062 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:28.161530 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b435095b-9acb-4735-8d4a-df3c49b0b062 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb" status: 200 len: 1500 microversion: 2.1 time: 0.286079 Jun 10 18:26:28.162443 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2943/5831] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:27 2022] GET /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb => generated 1500 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:28.179662 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f8ba2459-f233-4a3e-aab6-08df92447cf0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:28.180059 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f8ba2459-f233-4a3e-aab6-08df92447cf0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: a0a1cfa6-b42a-43f1-87d7-8564b895dbcb] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:28.202745 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8ba2459-f233-4a3e-aab6-08df92447cf0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:28.203314 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8ba2459-f233-4a3e-aab6-08df92447cf0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:28.206925 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8ba2459-f233-4a3e-aab6-08df92447cf0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:28.207301 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8ba2459-f233-4a3e-aab6-08df92447cf0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:28.238097 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f8ba2459-f233-4a3e-aab6-08df92447cf0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: a0a1cfa6-b42a-43f1-87d7-8564b895dbcb] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:26:28.744987 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f8ba2459-f233-4a3e-aab6-08df92447cf0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "DELETE /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb" status: 204 len: 0 microversion: 2.1 time: 0.568635 Jun 10 18:26:28.746133 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2889/5832] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:26:28 2022] DELETE /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb => generated 0 bytes in 571 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:26:28.755247 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c01a5d5e-917c-41a0-b44d-e1cc7fe0f054 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:28.755863 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c01a5d5e-917c-41a0-b44d-e1cc7fe0f054 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: a0a1cfa6-b42a-43f1-87d7-8564b895dbcb] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:28.763076 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c01a5d5e-917c-41a0-b44d-e1cc7fe0f054 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:28.763526 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c01a5d5e-917c-41a0-b44d-e1cc7fe0f054 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:28.764755 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c01a5d5e-917c-41a0-b44d-e1cc7fe0f054 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:28.765197 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c01a5d5e-917c-41a0-b44d-e1cc7fe0f054 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:28.943036 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c01a5d5e-917c-41a0-b44d-e1cc7fe0f054 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:28.955033 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c01a5d5e-917c-41a0-b44d-e1cc7fe0f054 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb" status: 200 len: 1506 microversion: 2.1 time: 0.204243 Jun 10 18:26:28.960334 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2944/5833] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:28 2022] GET /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb => generated 1506 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:29.980871 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-530715b6-f55f-4d46-92c0-82594ce28b04 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:29.981817 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-530715b6-f55f-4d46-92c0-82594ce28b04 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: a0a1cfa6-b42a-43f1-87d7-8564b895dbcb] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:30.000380 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:26:30.055987 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-530715b6-f55f-4d46-92c0-82594ce28b04 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:30.059024 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-530715b6-f55f-4d46-92c0-82594ce28b04 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.044s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:30.059988 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-530715b6-f55f-4d46-92c0-82594ce28b04 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:30.060629 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-530715b6-f55f-4d46-92c0-82594ce28b04 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:30.613749 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-530715b6-f55f-4d46-92c0-82594ce28b04 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:30.620338 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-530715b6-f55f-4d46-92c0-82594ce28b04 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb" status: 200 len: 1506 microversion: 2.1 time: 0.648789 Jun 10 18:26:30.621285 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2890/5834] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:29 2022] GET /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb => generated 1506 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:31.216232 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-2bd104a7-0cbe-4cd9-942d-afc9730da9b3 req-c5c5a792-951a-4970-95c6-bcafeb37687d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a1cfa6-b42a-43f1-87d7-8564b895dbcb", "name": "network-vif-deleted", "tag": "c5ce3452-94cd-481c-9bed-026c52c805c4"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:26:31.239112 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-2bd104a7-0cbe-4cd9-942d-afc9730da9b3 req-c5c5a792-951a-4970-95c6-bcafeb37687d service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:31.246272 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-2bd104a7-0cbe-4cd9-942d-afc9730da9b3 req-c5c5a792-951a-4970-95c6-bcafeb37687d service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:31.264975 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-2bd104a7-0cbe-4cd9-942d-afc9730da9b3 req-c5c5a792-951a-4970-95c6-bcafeb37687d service nova] Creating event network-vif-deleted:c5ce3452-94cd-481c-9bed-026c52c805c4 for instance a0a1cfa6-b42a-43f1-87d7-8564b895dbcb on chh1-master-2 Jun 10 18:26:31.270754 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-2bd104a7-0cbe-4cd9-942d-afc9730da9b3 req-c5c5a792-951a-4970-95c6-bcafeb37687d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058718 Jun 10 18:26:31.271870 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2945/5835] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:26:31.640723 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-de9d5781-f912-463e-8731-3d578a9fc51b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:31.641306 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-de9d5781-f912-463e-8731-3d578a9fc51b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: a0a1cfa6-b42a-43f1-87d7-8564b895dbcb] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:31.650005 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de9d5781-f912-463e-8731-3d578a9fc51b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:31.650533 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de9d5781-f912-463e-8731-3d578a9fc51b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:31.652051 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de9d5781-f912-463e-8731-3d578a9fc51b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:31.652718 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de9d5781-f912-463e-8731-3d578a9fc51b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:31.722410 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de9d5781-f912-463e-8731-3d578a9fc51b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:31.723399 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de9d5781-f912-463e-8731-3d578a9fc51b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:31.724454 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-de9d5781-f912-463e-8731-3d578a9fc51b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lazy-loading 'fault' on Instance uuid a0a1cfa6-b42a-43f1-87d7-8564b895dbcb {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:26:31.824441 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-de9d5781-f912-463e-8731-3d578a9fc51b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:31.835467 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-de9d5781-f912-463e-8731-3d578a9fc51b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb" status: 200 len: 1310 microversion: 2.1 time: 0.200584 Jun 10 18:26:31.837116 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2891/5836] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:31 2022] GET /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb => generated 1310 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:32.856446 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-22f6e37f-72d7-4d26-8cb0-ab3b2fff0b83 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:32.857808 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-22f6e37f-72d7-4d26-8cb0-ab3b2fff0b83 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: a0a1cfa6-b42a-43f1-87d7-8564b895dbcb] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:32.873274 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-22f6e37f-72d7-4d26-8cb0-ab3b2fff0b83 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:32.876079 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-22f6e37f-72d7-4d26-8cb0-ab3b2fff0b83 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:32.876928 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-22f6e37f-72d7-4d26-8cb0-ab3b2fff0b83 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:32.879163 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-22f6e37f-72d7-4d26-8cb0-ab3b2fff0b83 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:32.907449 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-22f6e37f-72d7-4d26-8cb0-ab3b2fff0b83 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] HTTP exception thrown: Instance a0a1cfa6-b42a-43f1-87d7-8564b895dbcb could not be found. Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-22f6e37f-72d7-4d26-8cb0-ab3b2fff0b83 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Request method failure captured: Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb HTTP/1.1 Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4ylUNGY8VKO5jLVY6McXmkU53BpB453bvCKmrvaQGLJAZV-lieSSXu8nUaF6yxU0RZxSma5kvfEU2IFgDObEl38j4CHosWLE8jUTpbhfPjW3XqChWMzwgLKa4BS5Yox1cN_jUzeYnin3TOSxn98enTacAe1cvDVZ2oUSAgL46qFPsc Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ded497d3d91b4e22bc2daa72d6f75d18", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersTestJSON-1873283063 Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersTestJSON-1873283063-project Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: d37f560237d9489e96ddee21d9f5e6c6 Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersTestJSON-1873283063-project Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: exception: Instance a0a1cfa6-b42a-43f1-87d7-8564b895dbcb could not be found. Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'a0a1cfa6-b42a-43f1-87d7-8564b895dbcb'} Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0a1cfa6-b42a-43f1-87d7-8564b895dbcb could not be found. Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0a1cfa6-b42a-43f1-87d7-8564b895dbcb could not be found. Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:26:32.917294 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:26:32.921379 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:26:32.921379 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:26:32.921379 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:26:32.921379 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:26:32.921379 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0a1cfa6-b42a-43f1-87d7-8564b895dbcb could not be found. Jun 10 18:26:32.921379 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:26:32.922570 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-22f6e37f-72d7-4d26-8cb0-ab3b2fff0b83 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Returning 404 to user: Instance a0a1cfa6-b42a-43f1-87d7-8564b895dbcb could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:26:32.923457 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-22f6e37f-72d7-4d26-8cb0-ab3b2fff0b83 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb" status: 404 len: 111 microversion: 2.1 time: 0.073170 Jun 10 18:26:32.931703 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2946/5837] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:32 2022] GET /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:26:32.938706 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-21590244-b3a1-4b48-93a9-075ba7c5ec09 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Action: 'create', calling method: .version_select at 0x7f77c16eea60>, body: {"keypair": {"name": "tempest-key-1455260034", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEz86EESaL3eWH6N20rZLHSg0F8xasVLbmZeTme1CPtYOHivcuWYsvY37ekz1QQSyoBI8fopE1fdTuDYGO2hXz336QECWZvVMbME2Y/lbc4KuK6xFgQP+FCgMLJ/03+nQ=="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:26:32.959370 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-21590244-b3a1-4b48-93a9-075ba7c5ec09 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Getting quotas for project ded497d3d91b4e22bc2daa72d6f75d18. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:26:32.966716 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-21590244-b3a1-4b48-93a9-075ba7c5ec09 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Getting quotas for user d37f560237d9489e96ddee21d9f5e6c6 and project ded497d3d91b4e22bc2daa72d6f75d18. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:26:33.106071 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-21590244-b3a1-4b48-93a9-075ba7c5ec09 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.172804 Jun 10 18:26:33.107104 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2892/5838] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 18:26:32 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:26:33.116805 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9a13be48-f7b2-493d-9ced-c0c8be3b1c3e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '.version_select at 0x7f77b3a29820>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:33.119848 chdv-master-2 devstack@n-api.service[126594]: WARNING oslo_db.sqlalchemy.utils [None req-9a13be48-f7b2-493d-9ced-c0c8be3b1c3e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Unique keys not in sort_keys. The sorting order may be unstable. Jun 10 18:26:33.122732 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:26:33.127934 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9a13be48-f7b2-493d-9ced-c0c8be3b1c3e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.015166 Jun 10 18:26:33.137063 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2947/5839] 10.222.0.35 () {58 vars in 1136 bytes} [Fri Jun 10 18:26:33 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:26:33.238152 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f568b513-baa5-4f77-8b3a-fd624cd407f3 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1051720545", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "key_name": "tempest-key-1455260034", "networks": [{"uuid": "940d65ec-437e-4f98-a601-e2ba4906c363"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:26:33.305948 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-f568b513-baa5-4f77-8b3a-fd624cd407f3 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] validate_networks() for [('940d65ec-437e-4f98-a601-e2ba4906c363', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:26:34.609936 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-f568b513-baa5-4f77-8b3a-fd624cd407f3 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:26:34.610644 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-f568b513-baa5-4f77-8b3a-fd624cd407f3 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:26:34.611188 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-f568b513-baa5-4f77-8b3a-fd624cd407f3 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:26:34.611667 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-f568b513-baa5-4f77-8b3a-fd624cd407f3 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:26:34.612111 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-f568b513-baa5-4f77-8b3a-fd624cd407f3 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:26:34.630120 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f568b513-baa5-4f77-8b3a-fd624cd407f3 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:34.638976 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f568b513-baa5-4f77-8b3a-fd624cd407f3 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:34.641532 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f568b513-baa5-4f77-8b3a-fd624cd407f3 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:34.645977 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f568b513-baa5-4f77-8b3a-fd624cd407f3 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:34.703947 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-f568b513-baa5-4f77-8b3a-fd624cd407f3 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Getting quotas for project ded497d3d91b4e22bc2daa72d6f75d18. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:26:34.717919 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-f568b513-baa5-4f77-8b3a-fd624cd407f3 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Getting quotas for user d37f560237d9489e96ddee21d9f5e6c6 and project ded497d3d91b4e22bc2daa72d6f75d18. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:26:34.735603 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f568b513-baa5-4f77-8b3a-fd624cd407f3 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:26:34.738129 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f568b513-baa5-4f77-8b3a-fd624cd407f3 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: b71f4f7b-6184-4758-8234-76b63770a27c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:26:34.918198 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f568b513-baa5-4f77-8b3a-fd624cd407f3 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.684448 Jun 10 18:26:34.919454 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2893/5840] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:26:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:26:34.930610 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3093af18-1367-4758-9442-a85f5ad8553b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:34.946908 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3093af18-1367-4758-9442-a85f5ad8553b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: b71f4f7b-6184-4758-8234-76b63770a27c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:35.067397 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3093af18-1367-4758-9442-a85f5ad8553b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:35.073709 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3093af18-1367-4758-9442-a85f5ad8553b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c" status: 200 len: 1229 microversion: 2.1 time: 0.147236 Jun 10 18:26:35.074277 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2948/5841] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:34 2022] GET /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c => generated 1229 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:36.091652 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-97db1f98-e3c3-4328-b8e3-d33bbc427107 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:36.092265 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-97db1f98-e3c3-4328-b8e3-d33bbc427107 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: b71f4f7b-6184-4758-8234-76b63770a27c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:36.108785 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-97db1f98-e3c3-4328-b8e3-d33bbc427107 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:36.109859 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-97db1f98-e3c3-4328-b8e3-d33bbc427107 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:36.110482 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-97db1f98-e3c3-4328-b8e3-d33bbc427107 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:36.111084 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-97db1f98-e3c3-4328-b8e3-d33bbc427107 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:36.330154 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-97db1f98-e3c3-4328-b8e3-d33bbc427107 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:36.350029 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-97db1f98-e3c3-4328-b8e3-d33bbc427107 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c" status: 200 len: 1233 microversion: 2.1 time: 0.263770 Jun 10 18:26:36.350636 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2894/5842] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:36 2022] GET /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c => generated 1233 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:37.371231 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-406d1c22-d873-4a67-a1aa-0788fa55f9d2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:37.372704 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-406d1c22-d873-4a67-a1aa-0788fa55f9d2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: b71f4f7b-6184-4758-8234-76b63770a27c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:37.390231 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-406d1c22-d873-4a67-a1aa-0788fa55f9d2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:37.401525 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-406d1c22-d873-4a67-a1aa-0788fa55f9d2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:37.405347 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-406d1c22-d873-4a67-a1aa-0788fa55f9d2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:37.405995 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-406d1c22-d873-4a67-a1aa-0788fa55f9d2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:37.630059 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-406d1c22-d873-4a67-a1aa-0788fa55f9d2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:37.648061 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-406d1c22-d873-4a67-a1aa-0788fa55f9d2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c" status: 200 len: 1289 microversion: 2.1 time: 0.282908 Jun 10 18:26:37.672851 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2949/5843] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:37 2022] GET /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c => generated 1289 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:38.668728 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-229e5301-8baa-404c-9203-6e08e65a0b5c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:38.670136 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-229e5301-8baa-404c-9203-6e08e65a0b5c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: b71f4f7b-6184-4758-8234-76b63770a27c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:38.686747 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-229e5301-8baa-404c-9203-6e08e65a0b5c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:38.691020 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-229e5301-8baa-404c-9203-6e08e65a0b5c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:38.716023 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-229e5301-8baa-404c-9203-6e08e65a0b5c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:38.716545 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-229e5301-8baa-404c-9203-6e08e65a0b5c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:39.111985 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-229e5301-8baa-404c-9203-6e08e65a0b5c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:39.136239 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-229e5301-8baa-404c-9203-6e08e65a0b5c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c" status: 200 len: 1329 microversion: 2.1 time: 0.474148 Jun 10 18:26:39.139986 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2895/5844] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:38 2022] GET /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c => generated 1329 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:40.157982 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fecc7993-d833-41e1-84bd-114f99e7b2d5 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:40.164536 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fecc7993-d833-41e1-84bd-114f99e7b2d5 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: b71f4f7b-6184-4758-8234-76b63770a27c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:40.173530 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fecc7993-d833-41e1-84bd-114f99e7b2d5 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:40.174489 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fecc7993-d833-41e1-84bd-114f99e7b2d5 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:40.175405 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fecc7993-d833-41e1-84bd-114f99e7b2d5 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:40.175966 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fecc7993-d833-41e1-84bd-114f99e7b2d5 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:40.429224 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fecc7993-d833-41e1-84bd-114f99e7b2d5 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:40.438914 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fecc7993-d833-41e1-84bd-114f99e7b2d5 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c" status: 200 len: 1329 microversion: 2.1 time: 0.286310 Jun 10 18:26:40.439515 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2950/5845] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:40 2022] GET /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c => generated 1329 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:40.864493 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-bbf44cff-0c35-4ec8-bd0d-ad1d29a93b85 req-a9d1f438-e2f9-4216-a7c3-3aeb504342dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b71f4f7b-6184-4758-8234-76b63770a27c", "tag": "a74d6d14-db91-4dfd-9d6f-c69c8b0e8d39"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:26:40.901353 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-bbf44cff-0c35-4ec8-bd0d-ad1d29a93b85 req-a9d1f438-e2f9-4216-a7c3-3aeb504342dd service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:40.902326 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-bbf44cff-0c35-4ec8-bd0d-ad1d29a93b85 req-a9d1f438-e2f9-4216-a7c3-3aeb504342dd service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:40.925096 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-bbf44cff-0c35-4ec8-bd0d-ad1d29a93b85 req-a9d1f438-e2f9-4216-a7c3-3aeb504342dd service nova] Creating event network-changed:a74d6d14-db91-4dfd-9d6f-c69c8b0e8d39 for instance b71f4f7b-6184-4758-8234-76b63770a27c on chh1-master-2 Jun 10 18:26:40.932709 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-bbf44cff-0c35-4ec8-bd0d-ad1d29a93b85 req-a9d1f438-e2f9-4216-a7c3-3aeb504342dd service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077097 Jun 10 18:26:40.933861 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2896/5846] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:26:41.461180 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-01bf8587-8c71-4472-a468-6dddde6a155b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:41.461865 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-01bf8587-8c71-4472-a468-6dddde6a155b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: b71f4f7b-6184-4758-8234-76b63770a27c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:41.471753 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-01bf8587-8c71-4472-a468-6dddde6a155b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:41.472929 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-01bf8587-8c71-4472-a468-6dddde6a155b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:41.474747 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-01bf8587-8c71-4472-a468-6dddde6a155b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:41.475400 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-01bf8587-8c71-4472-a468-6dddde6a155b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:41.694484 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-01bf8587-8c71-4472-a468-6dddde6a155b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:41.704821 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-01bf8587-8c71-4472-a468-6dddde6a155b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c" status: 200 len: 1329 microversion: 2.1 time: 0.252541 Jun 10 18:26:41.706197 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2951/5847] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:41 2022] GET /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c => generated 1329 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:42.723843 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7e890bea-78db-41ff-9a7c-a958ffdd0624 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:42.724714 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7e890bea-78db-41ff-9a7c-a958ffdd0624 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: b71f4f7b-6184-4758-8234-76b63770a27c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:42.737923 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e890bea-78db-41ff-9a7c-a958ffdd0624 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:42.738600 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e890bea-78db-41ff-9a7c-a958ffdd0624 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:42.739681 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e890bea-78db-41ff-9a7c-a958ffdd0624 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:42.741618 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e890bea-78db-41ff-9a7c-a958ffdd0624 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:43.065340 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7e890bea-78db-41ff-9a7c-a958ffdd0624 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:43.076218 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7e890bea-78db-41ff-9a7c-a958ffdd0624 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c" status: 200 len: 1329 microversion: 2.1 time: 0.357429 Jun 10 18:26:43.077217 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2897/5848] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:42 2022] GET /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c => generated 1329 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:44.093773 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b2bb987a-b2bf-47e3-b20c-e1110fb87214 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:44.095038 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b2bb987a-b2bf-47e3-b20c-e1110fb87214 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: b71f4f7b-6184-4758-8234-76b63770a27c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:44.105680 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b2bb987a-b2bf-47e3-b20c-e1110fb87214 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:44.110951 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b2bb987a-b2bf-47e3-b20c-e1110fb87214 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:44.113128 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b2bb987a-b2bf-47e3-b20c-e1110fb87214 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:44.117944 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b2bb987a-b2bf-47e3-b20c-e1110fb87214 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:44.929104 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b2bb987a-b2bf-47e3-b20c-e1110fb87214 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:44.939510 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b2bb987a-b2bf-47e3-b20c-e1110fb87214 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c" status: 200 len: 1329 microversion: 2.1 time: 0.849512 Jun 10 18:26:44.943079 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2952/5849] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:44 2022] GET /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c => generated 1329 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:45.966840 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9e9dd585-fb1a-4a46-b851-6e14aeae6e94 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:45.967448 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9e9dd585-fb1a-4a46-b851-6e14aeae6e94 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: b71f4f7b-6184-4758-8234-76b63770a27c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:45.970804 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:26:45.973936 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=10 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:26:45.982413 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9e9dd585-fb1a-4a46-b851-6e14aeae6e94 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:45.991084 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9e9dd585-fb1a-4a46-b851-6e14aeae6e94 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:45.995204 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9e9dd585-fb1a-4a46-b851-6e14aeae6e94 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:45.996827 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9e9dd585-fb1a-4a46-b851-6e14aeae6e94 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:46.253612 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9e9dd585-fb1a-4a46-b851-6e14aeae6e94 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:46.263398 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9e9dd585-fb1a-4a46-b851-6e14aeae6e94 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c" status: 200 len: 1329 microversion: 2.1 time: 0.307230 Jun 10 18:26:46.268446 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2898/5850] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:45 2022] GET /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c => generated 1329 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:47.300330 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-46cd55f2-d950-44fc-9b47-913bf02727a5 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:47.300330 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-46cd55f2-d950-44fc-9b47-913bf02727a5 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: b71f4f7b-6184-4758-8234-76b63770a27c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:47.311470 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:26:47.314610 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-46cd55f2-d950-44fc-9b47-913bf02727a5 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:47.315419 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-46cd55f2-d950-44fc-9b47-913bf02727a5 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:47.322353 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-46cd55f2-d950-44fc-9b47-913bf02727a5 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:47.324698 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-46cd55f2-d950-44fc-9b47-913bf02727a5 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:47.602117 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-46cd55f2-d950-44fc-9b47-913bf02727a5 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:47.611605 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-46cd55f2-d950-44fc-9b47-913bf02727a5 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c" status: 200 len: 1329 microversion: 2.1 time: 0.334564 Jun 10 18:26:47.615047 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2953/5851] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:47 2022] GET /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c => generated 1329 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:48.628921 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fc0b824a-cc17-4f9d-95d7-0d5f14d1cc2f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:48.629537 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fc0b824a-cc17-4f9d-95d7-0d5f14d1cc2f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: b71f4f7b-6184-4758-8234-76b63770a27c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:48.649899 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fc0b824a-cc17-4f9d-95d7-0d5f14d1cc2f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:48.650398 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fc0b824a-cc17-4f9d-95d7-0d5f14d1cc2f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:48.651199 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fc0b824a-cc17-4f9d-95d7-0d5f14d1cc2f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:48.651640 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fc0b824a-cc17-4f9d-95d7-0d5f14d1cc2f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:48.662546 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:26:48.957082 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fc0b824a-cc17-4f9d-95d7-0d5f14d1cc2f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:48.981588 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fc0b824a-cc17-4f9d-95d7-0d5f14d1cc2f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c" status: 200 len: 1329 microversion: 2.1 time: 0.351652 Jun 10 18:26:48.982240 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2899/5852] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:48 2022] GET /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c => generated 1329 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:49.369850 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-1be5a7f4-e569-489c-ab7d-44a46f884e63 req-6b55ab2c-b072-47ce-8c55-b664c92eedf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b71f4f7b-6184-4758-8234-76b63770a27c", "name": "network-vif-plugged", "status": "completed", "tag": "a74d6d14-db91-4dfd-9d6f-c69c8b0e8d39"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:26:49.386971 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-1be5a7f4-e569-489c-ab7d-44a46f884e63 req-6b55ab2c-b072-47ce-8c55-b664c92eedf5 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:49.389797 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-1be5a7f4-e569-489c-ab7d-44a46f884e63 req-6b55ab2c-b072-47ce-8c55-b664c92eedf5 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:49.433324 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-1be5a7f4-e569-489c-ab7d-44a46f884e63 req-6b55ab2c-b072-47ce-8c55-b664c92eedf5 service nova] Creating event network-vif-plugged:a74d6d14-db91-4dfd-9d6f-c69c8b0e8d39 for instance b71f4f7b-6184-4758-8234-76b63770a27c on chh1-master-2 Jun 10 18:26:49.444723 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-1be5a7f4-e569-489c-ab7d-44a46f884e63 req-6b55ab2c-b072-47ce-8c55-b664c92eedf5 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076199 Jun 10 18:26:49.445584 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2954/5853] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:26:49.999443 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-95ee183c-c00e-4645-99b9-b85a0d469022 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:50.000365 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-95ee183c-c00e-4645-99b9-b85a0d469022 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: b71f4f7b-6184-4758-8234-76b63770a27c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:50.008258 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-95ee183c-c00e-4645-99b9-b85a0d469022 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:50.012040 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-95ee183c-c00e-4645-99b9-b85a0d469022 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:50.013179 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-95ee183c-c00e-4645-99b9-b85a0d469022 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:50.016878 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-95ee183c-c00e-4645-99b9-b85a0d469022 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:50.342807 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-95ee183c-c00e-4645-99b9-b85a0d469022 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:50.358001 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-95ee183c-c00e-4645-99b9-b85a0d469022 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c" status: 200 len: 1329 microversion: 2.1 time: 0.362234 Jun 10 18:26:50.359180 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2900/5854] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:49 2022] GET /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c => generated 1329 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:51.376503 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d7b2ba16-1a7c-49fe-8592-eb8c734ae2ad tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:51.377439 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d7b2ba16-1a7c-49fe-8592-eb8c734ae2ad tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: b71f4f7b-6184-4758-8234-76b63770a27c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:51.402846 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d7b2ba16-1a7c-49fe-8592-eb8c734ae2ad tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:51.404560 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d7b2ba16-1a7c-49fe-8592-eb8c734ae2ad tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:51.408618 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d7b2ba16-1a7c-49fe-8592-eb8c734ae2ad tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:51.409160 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d7b2ba16-1a7c-49fe-8592-eb8c734ae2ad tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:51.646788 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d7b2ba16-1a7c-49fe-8592-eb8c734ae2ad tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:51.673623 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d7b2ba16-1a7c-49fe-8592-eb8c734ae2ad tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c" status: 200 len: 1509 microversion: 2.1 time: 0.301714 Jun 10 18:26:51.674935 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2955/5855] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:51 2022] GET /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c => generated 1509 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:51.695374 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7531eccf-0f15-444a-a46d-dcfc44e93ed1 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:51.696603 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7531eccf-0f15-444a-a46d-dcfc44e93ed1 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: b71f4f7b-6184-4758-8234-76b63770a27c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:51.709809 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7531eccf-0f15-444a-a46d-dcfc44e93ed1 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:51.720224 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7531eccf-0f15-444a-a46d-dcfc44e93ed1 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:51.722881 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7531eccf-0f15-444a-a46d-dcfc44e93ed1 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:51.723663 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7531eccf-0f15-444a-a46d-dcfc44e93ed1 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:52.195684 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7531eccf-0f15-444a-a46d-dcfc44e93ed1 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:52.247403 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7531eccf-0f15-444a-a46d-dcfc44e93ed1 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c" status: 200 len: 1509 microversion: 2.1 time: 0.555977 Jun 10 18:26:52.254185 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2901/5856] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:51 2022] GET /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c => generated 1509 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:52.274777 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d92e7299-679f-4a26-9c8f-331ce2ba7cd0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:52.276450 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d92e7299-679f-4a26-9c8f-331ce2ba7cd0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: b71f4f7b-6184-4758-8234-76b63770a27c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:52.323217 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d92e7299-679f-4a26-9c8f-331ce2ba7cd0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:52.323217 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d92e7299-679f-4a26-9c8f-331ce2ba7cd0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:52.342356 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d92e7299-679f-4a26-9c8f-331ce2ba7cd0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:52.342356 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d92e7299-679f-4a26-9c8f-331ce2ba7cd0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:52.479395 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d92e7299-679f-4a26-9c8f-331ce2ba7cd0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: b71f4f7b-6184-4758-8234-76b63770a27c] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:26:52.972611 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d92e7299-679f-4a26-9c8f-331ce2ba7cd0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "DELETE /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c" status: 204 len: 0 microversion: 2.1 time: 0.706501 Jun 10 18:26:52.973633 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2956/5857] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:26:52 2022] DELETE /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c => generated 0 bytes in 709 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:26:52.982924 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9b165126-3c39-4214-afdf-f47381d19a00 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:52.983611 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9b165126-3c39-4214-afdf-f47381d19a00 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: b71f4f7b-6184-4758-8234-76b63770a27c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:53.006135 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b165126-3c39-4214-afdf-f47381d19a00 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:53.010460 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b165126-3c39-4214-afdf-f47381d19a00 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:53.013275 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b165126-3c39-4214-afdf-f47381d19a00 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:53.016139 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b165126-3c39-4214-afdf-f47381d19a00 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:53.928830 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9b165126-3c39-4214-afdf-f47381d19a00 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:53.938776 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9b165126-3c39-4214-afdf-f47381d19a00 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c" status: 200 len: 1515 microversion: 2.1 time: 0.960659 Jun 10 18:26:53.949276 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2902/5858] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:52 2022] GET /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c => generated 1515 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:54.966382 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d7bd5290-15eb-4d09-9d2a-2f8593bdc0e0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:54.979235 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d7bd5290-15eb-4d09-9d2a-2f8593bdc0e0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: b71f4f7b-6184-4758-8234-76b63770a27c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:55.008171 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d7bd5290-15eb-4d09-9d2a-2f8593bdc0e0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:55.008665 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d7bd5290-15eb-4d09-9d2a-2f8593bdc0e0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:55.013301 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d7bd5290-15eb-4d09-9d2a-2f8593bdc0e0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:55.013762 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d7bd5290-15eb-4d09-9d2a-2f8593bdc0e0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:55.247413 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d7bd5290-15eb-4d09-9d2a-2f8593bdc0e0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:55.255457 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d7bd5290-15eb-4d09-9d2a-2f8593bdc0e0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c" status: 200 len: 1515 microversion: 2.1 time: 0.301183 Jun 10 18:26:55.268604 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2957/5859] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:54 2022] GET /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c => generated 1515 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:56.041939 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-7aca606f-a8dc-426e-8cac-298a804af3db req-f1fdcd55-8892-4e73-ae0c-7b33e2fada35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b71f4f7b-6184-4758-8234-76b63770a27c", "name": "network-vif-deleted", "tag": "a74d6d14-db91-4dfd-9d6f-c69c8b0e8d39"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:26:56.072954 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-7aca606f-a8dc-426e-8cac-298a804af3db req-f1fdcd55-8892-4e73-ae0c-7b33e2fada35 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:56.072954 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-7aca606f-a8dc-426e-8cac-298a804af3db req-f1fdcd55-8892-4e73-ae0c-7b33e2fada35 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:56.095270 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-7aca606f-a8dc-426e-8cac-298a804af3db req-f1fdcd55-8892-4e73-ae0c-7b33e2fada35 service nova] Creating event network-vif-deleted:a74d6d14-db91-4dfd-9d6f-c69c8b0e8d39 for instance b71f4f7b-6184-4758-8234-76b63770a27c on chh1-master-2 Jun 10 18:26:56.102883 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-7aca606f-a8dc-426e-8cac-298a804af3db req-f1fdcd55-8892-4e73-ae0c-7b33e2fada35 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065457 Jun 10 18:26:56.104593 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2903/5860] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:26:56.286549 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2d0c64b4-66c1-4fe2-91d1-36be690e8c8f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:56.287412 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2d0c64b4-66c1-4fe2-91d1-36be690e8c8f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: b71f4f7b-6184-4758-8234-76b63770a27c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:56.303757 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2d0c64b4-66c1-4fe2-91d1-36be690e8c8f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:56.304221 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2d0c64b4-66c1-4fe2-91d1-36be690e8c8f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:56.305040 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2d0c64b4-66c1-4fe2-91d1-36be690e8c8f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:56.305490 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2d0c64b4-66c1-4fe2-91d1-36be690e8c8f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:56.318140 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:26:56.563710 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2d0c64b4-66c1-4fe2-91d1-36be690e8c8f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:56.617798 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2d0c64b4-66c1-4fe2-91d1-36be690e8c8f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c" status: 200 len: 1314 microversion: 2.1 time: 0.334014 Jun 10 18:26:56.627695 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2958/5861] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:56 2022] GET /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:26:57.637502 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2045f5d6-79e2-4367-aee0-4dd2c6f63719 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:57.638727 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2045f5d6-79e2-4367-aee0-4dd2c6f63719 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: b71f4f7b-6184-4758-8234-76b63770a27c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:57.652956 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2045f5d6-79e2-4367-aee0-4dd2c6f63719 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:57.653520 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2045f5d6-79e2-4367-aee0-4dd2c6f63719 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:57.654214 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2045f5d6-79e2-4367-aee0-4dd2c6f63719 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:57.654630 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2045f5d6-79e2-4367-aee0-4dd2c6f63719 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:57.676786 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-2045f5d6-79e2-4367-aee0-4dd2c6f63719 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] HTTP exception thrown: Instance b71f4f7b-6184-4758-8234-76b63770a27c could not be found. Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2045f5d6-79e2-4367-aee0-4dd2c6f63719 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Request method failure captured: Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c HTTP/1.1 Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4ylUNGY8VKO5jLVY6McXmkU53BpB453bvCKmrvaQGLJAZV-lieSSXu8nUaF6yxU0RZxSma5kvfEU2IFgDObEl38j4CHosWLE8jUTpbhfPjW3XqChWMzwgLKa4BS5Yox1cN_jUzeYnin3TOSxn98enTacAe1cvDVZ2oUSAgL46qFPsc Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ded497d3d91b4e22bc2daa72d6f75d18", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersTestJSON-1873283063 Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersTestJSON-1873283063-project Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: d37f560237d9489e96ddee21d9f5e6c6 Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersTestJSON-1873283063-project Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: exception: Instance b71f4f7b-6184-4758-8234-76b63770a27c could not be found. Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'b71f4f7b-6184-4758-8234-76b63770a27c'} Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b71f4f7b-6184-4758-8234-76b63770a27c could not be found. Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b71f4f7b-6184-4758-8234-76b63770a27c could not be found. Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:26:57.679356 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:26:57.685128 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:26:57.685128 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:26:57.685128 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:26:57.685128 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:26:57.685128 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b71f4f7b-6184-4758-8234-76b63770a27c could not be found. Jun 10 18:26:57.685128 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:26:57.685128 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2045f5d6-79e2-4367-aee0-4dd2c6f63719 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Returning 404 to user: Instance b71f4f7b-6184-4758-8234-76b63770a27c could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:26:57.685128 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2045f5d6-79e2-4367-aee0-4dd2c6f63719 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c" status: 404 len: 111 microversion: 2.1 time: 0.052026 Jun 10 18:26:57.685128 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2904/5862] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:57 2022] GET /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:26:57.693174 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-13e2d834-72b2-4b33-b023-ea5620d495a7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '.version_select at 0x7f77b39a48b0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:57.784328 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-13e2d834-72b2-4b33-b023-ea5620d495a7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-key-1455260034" status: 202 len: 0 microversion: 2.1 time: 0.095510 Jun 10 18:26:57.785066 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2959/5863] 10.222.0.35 () {58 vars in 1208 bytes} [Fri Jun 10 18:26:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1455260034 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:26:57.987733 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7929f571-8d7f-47da-b223-d425649fa278 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1972829433", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "940d65ec-437e-4f98-a601-e2ba4906c363"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:26:58.081621 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-7929f571-8d7f-47da-b223-d425649fa278 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] validate_networks() for [('940d65ec-437e-4f98-a601-e2ba4906c363', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:26:58.836083 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-7929f571-8d7f-47da-b223-d425649fa278 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:26:58.836807 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-7929f571-8d7f-47da-b223-d425649fa278 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:26:58.837073 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-7929f571-8d7f-47da-b223-d425649fa278 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:26:58.837521 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-7929f571-8d7f-47da-b223-d425649fa278 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:26:58.838115 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-7929f571-8d7f-47da-b223-d425649fa278 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:26:58.858080 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7929f571-8d7f-47da-b223-d425649fa278 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:58.858642 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7929f571-8d7f-47da-b223-d425649fa278 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:58.859561 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7929f571-8d7f-47da-b223-d425649fa278 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:26:58.860113 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7929f571-8d7f-47da-b223-d425649fa278 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:26:58.903591 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-7929f571-8d7f-47da-b223-d425649fa278 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Getting quotas for project ded497d3d91b4e22bc2daa72d6f75d18. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:26:58.909553 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-7929f571-8d7f-47da-b223-d425649fa278 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Getting quotas for user d37f560237d9489e96ddee21d9f5e6c6 and project ded497d3d91b4e22bc2daa72d6f75d18. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:26:58.955683 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7929f571-8d7f-47da-b223-d425649fa278 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:26:58.958983 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7929f571-8d7f-47da-b223-d425649fa278 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 607be5b9-5b8b-4d26-ad0b-15cb39df1e06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:26:59.097608 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7929f571-8d7f-47da-b223-d425649fa278 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.113936 Jun 10 18:26:59.099166 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2905/5864] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:26:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:26:59.110051 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-18dd4ecb-e753-4869-b406-66ef6cf48d0c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:26:59.111261 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-18dd4ecb-e753-4869-b406-66ef6cf48d0c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 607be5b9-5b8b-4d26-ad0b-15cb39df1e06] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:26:59.218662 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-18dd4ecb-e753-4869-b406-66ef6cf48d0c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:26:59.229588 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-18dd4ecb-e753-4869-b406-66ef6cf48d0c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06" status: 200 len: 1209 microversion: 2.1 time: 0.124140 Jun 10 18:26:59.230508 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2960/5865] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:26:59 2022] GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06 => generated 1209 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:00.252186 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-32684891-6c63-4acd-ba0a-041a618c59dc tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:00.253780 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-32684891-6c63-4acd-ba0a-041a618c59dc tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 607be5b9-5b8b-4d26-ad0b-15cb39df1e06] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:00.258192 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=7 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:27:00.266426 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-32684891-6c63-4acd-ba0a-041a618c59dc tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:00.267251 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-32684891-6c63-4acd-ba0a-041a618c59dc tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:00.268708 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-32684891-6c63-4acd-ba0a-041a618c59dc tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:00.269355 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-32684891-6c63-4acd-ba0a-041a618c59dc tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:00.385476 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-32684891-6c63-4acd-ba0a-041a618c59dc tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:00.397521 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-32684891-6c63-4acd-ba0a-041a618c59dc tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06" status: 200 len: 1213 microversion: 2.1 time: 0.148249 Jun 10 18:27:00.407326 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2906/5866] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:00 2022] GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06 => generated 1213 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:01.035678 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-99e0293a-ac9e-4f58-ac19-245b11383643 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:01.036920 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-99e0293a-ac9e-4f58-ac19-245b11383643 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:01.053151 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-99e0293a-ac9e-4f58-ac19-245b11383643 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:01.053828 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-99e0293a-ac9e-4f58-ac19-245b11383643 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:01.054845 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-99e0293a-ac9e-4f58-ac19-245b11383643 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:01.055464 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-99e0293a-ac9e-4f58-ac19-245b11383643 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:01.136625 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-99e0293a-ac9e-4f58-ac19-245b11383643 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.103722 Jun 10 18:27:01.137250 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2961/5867] 10.222.0.35 () {60 vars in 1342 bytes} [Fri Jun 10 18:27:01 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa/os-volume_attachments => generated 25 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:01.223201 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ffa46cbf-6cf5-4f49-bc40-22e758ff7c9f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:01.226263 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ffa46cbf-6cf5-4f49-bc40-22e758ff7c9f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:01.235002 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ffa46cbf-6cf5-4f49-bc40-22e758ff7c9f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:01.235471 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ffa46cbf-6cf5-4f49-bc40-22e758ff7c9f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:01.236272 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ffa46cbf-6cf5-4f49-bc40-22e758ff7c9f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:01.236750 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ffa46cbf-6cf5-4f49-bc40-22e758ff7c9f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:01.327130 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ffa46cbf-6cf5-4f49-bc40-22e758ff7c9f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:27:01.417422 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e9579eea-5f59-4e76-9c6c-08c84f30b82c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:01.417838 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e9579eea-5f59-4e76-9c6c-08c84f30b82c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 607be5b9-5b8b-4d26-ad0b-15cb39df1e06] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:01.431729 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e9579eea-5f59-4e76-9c6c-08c84f30b82c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:01.434572 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e9579eea-5f59-4e76-9c6c-08c84f30b82c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:01.436674 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e9579eea-5f59-4e76-9c6c-08c84f30b82c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:01.440071 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e9579eea-5f59-4e76-9c6c-08c84f30b82c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:01.554693 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e9579eea-5f59-4e76-9c6c-08c84f30b82c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:01.565246 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e9579eea-5f59-4e76-9c6c-08c84f30b82c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06" status: 200 len: 1261 microversion: 2.1 time: 0.153331 Jun 10 18:27:01.565838 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2962/5868] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:01 2022] GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:27:01.766529 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ffa46cbf-6cf5-4f49-bc40-22e758ff7c9f tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "DELETE /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 204 len: 0 microversion: 2.20 time: 0.550156 Jun 10 18:27:01.785496 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2907/5869] 10.222.0.35 () {60 vars in 1279 bytes} [Fri Jun 10 18:27:01 2022] DELETE /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 0 bytes in 561 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 10 18:27:01.785889 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a4aca4c0-1a44-44a7-9936-e0ae411a0606 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:01.797048 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a4aca4c0-1a44-44a7-9936-e0ae411a0606 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:01.823856 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a4aca4c0-1a44-44a7-9936-e0ae411a0606 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:01.826595 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a4aca4c0-1a44-44a7-9936-e0ae411a0606 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:01.831421 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a4aca4c0-1a44-44a7-9936-e0ae411a0606 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:01.831421 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a4aca4c0-1a44-44a7-9936-e0ae411a0606 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:02.587987 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6bef332d-989c-406e-bd35-fdb24e9ca525 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:02.592438 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6bef332d-989c-406e-bd35-fdb24e9ca525 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 607be5b9-5b8b-4d26-ad0b-15cb39df1e06] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:02.611229 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6bef332d-989c-406e-bd35-fdb24e9ca525 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:02.611955 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6bef332d-989c-406e-bd35-fdb24e9ca525 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:02.615107 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6bef332d-989c-406e-bd35-fdb24e9ca525 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:02.615785 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6bef332d-989c-406e-bd35-fdb24e9ca525 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:02.704520 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6bef332d-989c-406e-bd35-fdb24e9ca525 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:02.715002 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6bef332d-989c-406e-bd35-fdb24e9ca525 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06" status: 200 len: 1267 microversion: 2.1 time: 0.131423 Jun 10 18:27:02.725817 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2908/5870] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:02 2022] GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06 => generated 1267 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:27:03.031367 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a4aca4c0-1a44-44a7-9936-e0ae411a0606 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:03.045548 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a4aca4c0-1a44-44a7-9936-e0ae411a0606 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:03.047263 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a4aca4c0-1a44-44a7-9936-e0ae411a0606 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:03.048559 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a4aca4c0-1a44-44a7-9936-e0ae411a0606 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1725 microversion: 2.20 time: 1.267805 Jun 10 18:27:03.052278 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2963/5871] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:27:01 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1725 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 10 18:27:03.732866 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c67d515f-8bb5-4d8d-ad13-0036ff68f1b0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:03.733632 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c67d515f-8bb5-4d8d-ad13-0036ff68f1b0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 607be5b9-5b8b-4d26-ad0b-15cb39df1e06] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:03.752163 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c67d515f-8bb5-4d8d-ad13-0036ff68f1b0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:03.763959 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c67d515f-8bb5-4d8d-ad13-0036ff68f1b0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:03.770361 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c67d515f-8bb5-4d8d-ad13-0036ff68f1b0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:03.770964 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c67d515f-8bb5-4d8d-ad13-0036ff68f1b0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:04.068352 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b6a9cf27-ae0c-4197-be3d-e7174bf18cc9 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:04.069748 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b6a9cf27-ae0c-4197-be3d-e7174bf18cc9 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:04.081877 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b6a9cf27-ae0c-4197-be3d-e7174bf18cc9 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:04.086462 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b6a9cf27-ae0c-4197-be3d-e7174bf18cc9 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:04.092650 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b6a9cf27-ae0c-4197-be3d-e7174bf18cc9 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:04.093323 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b6a9cf27-ae0c-4197-be3d-e7174bf18cc9 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:04.174246 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c67d515f-8bb5-4d8d-ad13-0036ff68f1b0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:04.191778 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c67d515f-8bb5-4d8d-ad13-0036ff68f1b0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06" status: 200 len: 1309 microversion: 2.1 time: 0.461901 Jun 10 18:27:04.210420 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2909/5872] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:03 2022] GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06 => generated 1309 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:04.627269 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b6a9cf27-ae0c-4197-be3d-e7174bf18cc9 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:04.653145 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b6a9cf27-ae0c-4197-be3d-e7174bf18cc9 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:04.656388 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b6a9cf27-ae0c-4197-be3d-e7174bf18cc9 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:04.659078 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b6a9cf27-ae0c-4197-be3d-e7174bf18cc9 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1725 microversion: 2.20 time: 0.595315 Jun 10 18:27:04.678548 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2964/5873] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:27:04 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1725 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:27:05.224291 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3465f23b-6855-4419-8e7c-15efea1e680c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:05.227848 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3465f23b-6855-4419-8e7c-15efea1e680c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 607be5b9-5b8b-4d26-ad0b-15cb39df1e06] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:05.249632 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3465f23b-6855-4419-8e7c-15efea1e680c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:05.259897 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3465f23b-6855-4419-8e7c-15efea1e680c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:05.259897 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3465f23b-6855-4419-8e7c-15efea1e680c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:05.259897 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3465f23b-6855-4419-8e7c-15efea1e680c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:05.486975 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3465f23b-6855-4419-8e7c-15efea1e680c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:05.514759 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3465f23b-6855-4419-8e7c-15efea1e680c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06" status: 200 len: 1309 microversion: 2.1 time: 0.285463 Jun 10 18:27:05.515428 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2910/5874] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:05 2022] GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06 => generated 1309 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:05.702641 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-50a288cd-ef9e-4d22-8a93-9c54de00ac71 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:05.705773 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-50a288cd-ef9e-4d22-8a93-9c54de00ac71 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:05.725174 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-50a288cd-ef9e-4d22-8a93-9c54de00ac71 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:05.726700 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-50a288cd-ef9e-4d22-8a93-9c54de00ac71 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:05.729297 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-50a288cd-ef9e-4d22-8a93-9c54de00ac71 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:05.729930 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-50a288cd-ef9e-4d22-8a93-9c54de00ac71 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:05.812379 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-0eae882c-6486-45d8-a511-46b77d24eed6 req-aba01d40-0e57-4bb1-8a52-2efb9fdfc6af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6a3eb83-4aef-446a-a9d5-96d09acb1aaa", "name": "network-vif-deleted", "tag": "64ec13e5-9fd3-4a96-981b-a6206cef5996"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:27:05.827815 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-0eae882c-6486-45d8-a511-46b77d24eed6 req-aba01d40-0e57-4bb1-8a52-2efb9fdfc6af service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:05.828591 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-0eae882c-6486-45d8-a511-46b77d24eed6 req-aba01d40-0e57-4bb1-8a52-2efb9fdfc6af service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:05.854609 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-0eae882c-6486-45d8-a511-46b77d24eed6 req-aba01d40-0e57-4bb1-8a52-2efb9fdfc6af service nova] Creating event network-vif-deleted:64ec13e5-9fd3-4a96-981b-a6206cef5996 for instance b6a3eb83-4aef-446a-a9d5-96d09acb1aaa on chh2-master-2 Jun 10 18:27:05.862602 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-0eae882c-6486-45d8-a511-46b77d24eed6 req-aba01d40-0e57-4bb1-8a52-2efb9fdfc6af service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055038 Jun 10 18:27:05.865836 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2911/5875] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:27:06.019204 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-50a288cd-ef9e-4d22-8a93-9c54de00ac71 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:06.025046 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-50a288cd-ef9e-4d22-8a93-9c54de00ac71 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:06.026712 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-50a288cd-ef9e-4d22-8a93-9c54de00ac71 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:06.027898 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-50a288cd-ef9e-4d22-8a93-9c54de00ac71 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1657 microversion: 2.20 time: 0.341690 Jun 10 18:27:06.070946 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2965/5876] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:27:05 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1657 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:27:06.158367 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-50f36d45-ce5d-4340-bfd8-34f01086785c req-6cf6ccfd-39a4-48dd-834f-9748342e1e84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "607be5b9-5b8b-4d26-ad0b-15cb39df1e06", "tag": "3a26c571-b577-4fe1-9e24-71b4ef692562"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:27:06.175485 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-50f36d45-ce5d-4340-bfd8-34f01086785c req-6cf6ccfd-39a4-48dd-834f-9748342e1e84 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:06.182003 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-50f36d45-ce5d-4340-bfd8-34f01086785c req-6cf6ccfd-39a4-48dd-834f-9748342e1e84 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:06.213670 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-50f36d45-ce5d-4340-bfd8-34f01086785c req-6cf6ccfd-39a4-48dd-834f-9748342e1e84 service nova] Creating event network-changed:3a26c571-b577-4fe1-9e24-71b4ef692562 for instance 607be5b9-5b8b-4d26-ad0b-15cb39df1e06 on chh1-master-2 Jun 10 18:27:06.227966 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-50f36d45-ce5d-4340-bfd8-34f01086785c req-6cf6ccfd-39a4-48dd-834f-9748342e1e84 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068918 Jun 10 18:27:06.227966 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2912/5877] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:27:06.534314 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b7949372-abac-4d3f-814d-a4b1fc2d9b12 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:06.535124 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b7949372-abac-4d3f-814d-a4b1fc2d9b12 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 607be5b9-5b8b-4d26-ad0b-15cb39df1e06] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:06.563701 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b7949372-abac-4d3f-814d-a4b1fc2d9b12 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:06.563701 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b7949372-abac-4d3f-814d-a4b1fc2d9b12 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:06.563701 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b7949372-abac-4d3f-814d-a4b1fc2d9b12 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:06.563701 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b7949372-abac-4d3f-814d-a4b1fc2d9b12 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:06.994429 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b7949372-abac-4d3f-814d-a4b1fc2d9b12 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:07.003364 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b7949372-abac-4d3f-814d-a4b1fc2d9b12 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06" status: 200 len: 1309 microversion: 2.1 time: 0.474383 Jun 10 18:27:07.004339 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2966/5878] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:06 2022] GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06 => generated 1309 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:07.090546 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-51ca399c-2ad0-4921-890e-666433f51fe0 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:07.091528 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-51ca399c-2ad0-4921-890e-666433f51fe0 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:07.114371 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-51ca399c-2ad0-4921-890e-666433f51fe0 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:07.114660 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-51ca399c-2ad0-4921-890e-666433f51fe0 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:07.126593 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-51ca399c-2ad0-4921-890e-666433f51fe0 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:07.127197 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-51ca399c-2ad0-4921-890e-666433f51fe0 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:07.280012 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-51ca399c-2ad0-4921-890e-666433f51fe0 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:07.281309 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-51ca399c-2ad0-4921-890e-666433f51fe0 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:07.281954 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-51ca399c-2ad0-4921-890e-666433f51fe0 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lazy-loading 'fault' on Instance uuid b6a3eb83-4aef-446a-a9d5-96d09acb1aaa {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:27:07.363430 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-51ca399c-2ad0-4921-890e-666433f51fe0 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:07.379174 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-51ca399c-2ad0-4921-890e-666433f51fe0 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:07.389911 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-51ca399c-2ad0-4921-890e-666433f51fe0 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a86d300d66fd47a0b870b5ca879a03e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb43e14768646f1bd2bdfc3bdf67406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:07.391097 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-51ca399c-2ad0-4921-890e-666433f51fe0 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 200 len: 1372 microversion: 2.20 time: 0.305773 Jun 10 18:27:07.398545 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2913/5879] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:27:07 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 1372 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 10 18:27:08.022667 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-643bebff-dd4e-45ad-bc13-4668a7894547 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:08.023309 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-643bebff-dd4e-45ad-bc13-4668a7894547 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 607be5b9-5b8b-4d26-ad0b-15cb39df1e06] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:08.041804 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:27:08.056249 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-643bebff-dd4e-45ad-bc13-4668a7894547 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:08.056249 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-643bebff-dd4e-45ad-bc13-4668a7894547 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:08.056249 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-643bebff-dd4e-45ad-bc13-4668a7894547 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:08.056249 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-643bebff-dd4e-45ad-bc13-4668a7894547 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:08.409567 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c663422a-f1f9-4bc3-a678-8c45ccd84a9a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:08.410756 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c663422a-f1f9-4bc3-a678-8c45ccd84a9a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:08.426097 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c663422a-f1f9-4bc3-a678-8c45ccd84a9a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:08.426559 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c663422a-f1f9-4bc3-a678-8c45ccd84a9a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:08.427355 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c663422a-f1f9-4bc3-a678-8c45ccd84a9a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:08.427782 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c663422a-f1f9-4bc3-a678-8c45ccd84a9a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:08.456347 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-643bebff-dd4e-45ad-bc13-4668a7894547 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:08.464605 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-c663422a-f1f9-4bc3-a678-8c45ccd84a9a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] HTTP exception thrown: Instance b6a3eb83-4aef-446a-a9d5-96d09acb1aaa could not be found. Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c663422a-f1f9-4bc3-a678-8c45ccd84a9a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Request method failure captured: Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa HTTP/1.1 Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4roeABfU0LDjd4sEIHYTQC0IMae7J6Mra9Vy_1xOzbnXN2jSxDIko8tF1vxJtK8z5AlpLQsMdpqsdVt7qDN9xgkF0h7lXTCksN1VCW7wfK_1JTXkE0WDTNVyA_ld53tbtKPpriCbL00j4PS8vcye8EaA8CPfrFlWG5YNEqmbA88B3A Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: X-Openstack-Nova-Api-Version: 2.20 Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 9eb43e14768646f1bd2bdfc3bdf67406 Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-207035434 Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/9eb43e14768646f1bd2bdfc3bdf67406"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9eb43e14768646f1bd2bdfc3bdf67406"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9eb43e14768646f1bd2bdfc3bdf67406"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_9eb43e14768646f1bd2bdfc3bdf67406", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-AttachVolumeShelveTestJSON-207035434 Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 9eb43e14768646f1bd2bdfc3bdf67406 Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-207035434 Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-AttachVolumeShelveTestJSON-207035434-project Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: a86d300d66fd47a0b870b5ca879a03e8 Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-AttachVolumeShelveTestJSON-207035434-project Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: exception: Instance b6a3eb83-4aef-446a-a9d5-96d09acb1aaa could not be found. Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'b6a3eb83-4aef-446a-a9d5-96d09acb1aaa'} Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6a3eb83-4aef-446a-a9d5-96d09acb1aaa could not be found. Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6a3eb83-4aef-446a-a9d5-96d09acb1aaa could not be found. Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:27:08.467353 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:27:08.471838 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:27:08.471838 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:27:08.471838 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:27:08.471838 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:27:08.471838 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:27:08.471838 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:27:08.471838 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6a3eb83-4aef-446a-a9d5-96d09acb1aaa could not be found. Jun 10 18:27:08.471838 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:27:08.472400 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-643bebff-dd4e-45ad-bc13-4668a7894547 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06" status: 200 len: 1309 microversion: 2.1 time: 0.453825 Jun 10 18:27:08.473867 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c663422a-f1f9-4bc3-a678-8c45ccd84a9a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Returning 404 to user: Instance b6a3eb83-4aef-446a-a9d5-96d09acb1aaa could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:27:08.475560 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c663422a-f1f9-4bc3-a678-8c45ccd84a9a tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 404 len: 111 microversion: 2.20 time: 0.069946 Jun 10 18:27:08.476131 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2914/5880] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:27:08 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:27:08.483579 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2967/5881] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:08 2022] GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06 => generated 1309 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:08.491183 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-793eeb5d-7293-4a3b-9a60-b6e17bff881e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '.version_select at 0x7f77c00b4ee0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:08.573271 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-793eeb5d-7293-4a3b-9a60-b6e17bff881e tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1739777705" status: 204 len: 0 microversion: 2.20 time: 0.092354 Jun 10 18:27:08.588172 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2915/5882] 10.222.0.35 () {60 vars in 1261 bytes} [Fri Jun 10 18:27:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1739777705 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 10 18:27:09.489586 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e889efdd-a20f-4d35-bfe2-612eaf148f39 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:09.497646 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e889efdd-a20f-4d35-bfe2-612eaf148f39 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 607be5b9-5b8b-4d26-ad0b-15cb39df1e06] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:09.497646 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:27:09.505794 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e889efdd-a20f-4d35-bfe2-612eaf148f39 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:09.506537 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e889efdd-a20f-4d35-bfe2-612eaf148f39 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:09.507530 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e889efdd-a20f-4d35-bfe2-612eaf148f39 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:09.507985 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e889efdd-a20f-4d35-bfe2-612eaf148f39 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:10.045491 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e889efdd-a20f-4d35-bfe2-612eaf148f39 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:10.058885 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e889efdd-a20f-4d35-bfe2-612eaf148f39 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06" status: 200 len: 1309 microversion: 2.1 time: 0.573163 Jun 10 18:27:10.067010 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2968/5883] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:09 2022] GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06 => generated 1309 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:11.079769 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b1ae7c24-6ad7-408a-baa9-1acdbbcfb9c2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:11.081939 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b1ae7c24-6ad7-408a-baa9-1acdbbcfb9c2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 607be5b9-5b8b-4d26-ad0b-15cb39df1e06] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:11.097498 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:27:11.101660 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=6 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:27:11.101660 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b1ae7c24-6ad7-408a-baa9-1acdbbcfb9c2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:11.101660 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b1ae7c24-6ad7-408a-baa9-1acdbbcfb9c2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:11.105244 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b1ae7c24-6ad7-408a-baa9-1acdbbcfb9c2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:11.105752 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b1ae7c24-6ad7-408a-baa9-1acdbbcfb9c2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:11.602686 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b1ae7c24-6ad7-408a-baa9-1acdbbcfb9c2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:11.613574 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b1ae7c24-6ad7-408a-baa9-1acdbbcfb9c2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06" status: 200 len: 1309 microversion: 2.1 time: 0.537542 Jun 10 18:27:11.617357 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2916/5884] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:11 2022] GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06 => generated 1309 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:12.635380 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1ee59823-7e30-45a5-b815-c59372d38fc8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:12.636042 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1ee59823-7e30-45a5-b815-c59372d38fc8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 607be5b9-5b8b-4d26-ad0b-15cb39df1e06] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:12.662540 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1ee59823-7e30-45a5-b815-c59372d38fc8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:12.663210 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1ee59823-7e30-45a5-b815-c59372d38fc8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:12.664167 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1ee59823-7e30-45a5-b815-c59372d38fc8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:12.664817 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1ee59823-7e30-45a5-b815-c59372d38fc8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:12.942962 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1ee59823-7e30-45a5-b815-c59372d38fc8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:12.951945 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1ee59823-7e30-45a5-b815-c59372d38fc8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06" status: 200 len: 1309 microversion: 2.1 time: 0.320966 Jun 10 18:27:12.952973 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2969/5885] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:12 2022] GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06 => generated 1309 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:13.969777 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-65f99ca8-1bc2-40dc-afc1-fde8b6827d8f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:13.970955 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-65f99ca8-1bc2-40dc-afc1-fde8b6827d8f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 607be5b9-5b8b-4d26-ad0b-15cb39df1e06] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:13.985234 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-65f99ca8-1bc2-40dc-afc1-fde8b6827d8f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:13.985927 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-65f99ca8-1bc2-40dc-afc1-fde8b6827d8f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:13.986862 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-65f99ca8-1bc2-40dc-afc1-fde8b6827d8f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:13.987452 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-65f99ca8-1bc2-40dc-afc1-fde8b6827d8f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:14.345200 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-65f99ca8-1bc2-40dc-afc1-fde8b6827d8f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:14.353807 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-65f99ca8-1bc2-40dc-afc1-fde8b6827d8f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06" status: 200 len: 1309 microversion: 2.1 time: 0.388028 Jun 10 18:27:14.358381 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2917/5886] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:13 2022] GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06 => generated 1309 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:15.375307 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-09c3f5c7-7edb-4081-9d94-10ea76632cb7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:15.376872 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-09c3f5c7-7edb-4081-9d94-10ea76632cb7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 607be5b9-5b8b-4d26-ad0b-15cb39df1e06] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:15.397109 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-09c3f5c7-7edb-4081-9d94-10ea76632cb7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:15.398260 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-09c3f5c7-7edb-4081-9d94-10ea76632cb7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:15.400128 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-09c3f5c7-7edb-4081-9d94-10ea76632cb7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:15.406838 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-09c3f5c7-7edb-4081-9d94-10ea76632cb7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:15.563506 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-f9b4dd2c-9029-4277-b6fa-9f55ffeae006 req-b235f821-cc94-4326-8ec2-a5299dbafa39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "607be5b9-5b8b-4d26-ad0b-15cb39df1e06", "name": "network-vif-plugged", "status": "completed", "tag": "3a26c571-b577-4fe1-9e24-71b4ef692562"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:27:15.577936 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-f9b4dd2c-9029-4277-b6fa-9f55ffeae006 req-b235f821-cc94-4326-8ec2-a5299dbafa39 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:15.578416 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-f9b4dd2c-9029-4277-b6fa-9f55ffeae006 req-b235f821-cc94-4326-8ec2-a5299dbafa39 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:15.620866 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-f9b4dd2c-9029-4277-b6fa-9f55ffeae006 req-b235f821-cc94-4326-8ec2-a5299dbafa39 service nova] Creating event network-vif-plugged:3a26c571-b577-4fe1-9e24-71b4ef692562 for instance 607be5b9-5b8b-4d26-ad0b-15cb39df1e06 on chh1-master-2 Jun 10 18:27:15.634515 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-f9b4dd2c-9029-4277-b6fa-9f55ffeae006 req-b235f821-cc94-4326-8ec2-a5299dbafa39 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079525 Jun 10 18:27:15.637695 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2918/5887] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:27:15.655621 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3615dfe4-4b7e-4c8a-9440-e8448c4a7288 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:15.657044 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3615dfe4-4b7e-4c8a-9440-e8448c4a7288 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:15.678972 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3615dfe4-4b7e-4c8a-9440-e8448c4a7288 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:15.679582 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3615dfe4-4b7e-4c8a-9440-e8448c4a7288 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:15.683269 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3615dfe4-4b7e-4c8a-9440-e8448c4a7288 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:15.684708 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3615dfe4-4b7e-4c8a-9440-e8448c4a7288 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:15.732663 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-3615dfe4-4b7e-4c8a-9440-e8448c4a7288 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] HTTP exception thrown: Instance b6a3eb83-4aef-446a-a9d5-96d09acb1aaa could not be found. Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3615dfe4-4b7e-4c8a-9440-e8448c4a7288 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Request method failure captured: Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa HTTP/1.1 Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4roeABfU0LDjd4sEIHYTQC0IMae7J6Mra9Vy_1xOzbnXN2jSxDIko8tF1vxJtK8z5AlpLQsMdpqsdVt7qDN9xgkF0h7lXTCksN1VCW7wfK_1JTXkE0WDTNVyA_ld53tbtKPpriCbL00j4PS8vcye8EaA8CPfrFlWG5YNEqmbA88B3A Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: X-Openstack-Nova-Api-Version: 2.20 Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 9eb43e14768646f1bd2bdfc3bdf67406 Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-207035434 Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/9eb43e14768646f1bd2bdfc3bdf67406"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9eb43e14768646f1bd2bdfc3bdf67406"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9eb43e14768646f1bd2bdfc3bdf67406"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_9eb43e14768646f1bd2bdfc3bdf67406", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-AttachVolumeShelveTestJSON-207035434 Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 9eb43e14768646f1bd2bdfc3bdf67406 Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-207035434 Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-AttachVolumeShelveTestJSON-207035434-project Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: a86d300d66fd47a0b870b5ca879a03e8 Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-AttachVolumeShelveTestJSON-207035434-project Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: exception: Instance b6a3eb83-4aef-446a-a9d5-96d09acb1aaa could not be found. Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'b6a3eb83-4aef-446a-a9d5-96d09acb1aaa'} Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6a3eb83-4aef-446a-a9d5-96d09acb1aaa could not be found. Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:27:15.736031 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:27:15.750216 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6a3eb83-4aef-446a-a9d5-96d09acb1aaa could not be found. Jun 10 18:27:15.750216 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:27:15.750216 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:27:15.750216 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:27:15.750216 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:27:15.750216 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:27:15.750216 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:27:15.750216 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:27:15.750216 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:27:15.750216 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6a3eb83-4aef-446a-a9d5-96d09acb1aaa could not be found. Jun 10 18:27:15.750216 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:27:15.750216 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3615dfe4-4b7e-4c8a-9440-e8448c4a7288 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Returning 404 to user: Instance b6a3eb83-4aef-446a-a9d5-96d09acb1aaa could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:27:15.750216 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3615dfe4-4b7e-4c8a-9440-e8448c4a7288 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "DELETE /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 404 len: 111 microversion: 2.20 time: 0.096670 Jun 10 18:27:15.750216 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2919/5888] 10.222.0.35 () {60 vars in 1279 bytes} [Fri Jun 10 18:27:15 2022] DELETE /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:27:15.757765 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2c17db1a-7a50-4666-94aa-ed6fce08f992 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:15.760444 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2c17db1a-7a50-4666-94aa-ed6fce08f992 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: b6a3eb83-4aef-446a-a9d5-96d09acb1aaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:15.776215 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c17db1a-7a50-4666-94aa-ed6fce08f992 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:15.782222 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c17db1a-7a50-4666-94aa-ed6fce08f992 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:15.782222 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c17db1a-7a50-4666-94aa-ed6fce08f992 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:15.782222 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c17db1a-7a50-4666-94aa-ed6fce08f992 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:15.840250 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:27:15.844933 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-2c17db1a-7a50-4666-94aa-ed6fce08f992 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] HTTP exception thrown: Instance b6a3eb83-4aef-446a-a9d5-96d09acb1aaa could not be found. Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2c17db1a-7a50-4666-94aa-ed6fce08f992 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Request method failure captured: Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa HTTP/1.1 Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4roeABfU0LDjd4sEIHYTQC0IMae7J6Mra9Vy_1xOzbnXN2jSxDIko8tF1vxJtK8z5AlpLQsMdpqsdVt7qDN9xgkF0h7lXTCksN1VCW7wfK_1JTXkE0WDTNVyA_ld53tbtKPpriCbL00j4PS8vcye8EaA8CPfrFlWG5YNEqmbA88B3A Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: X-Openstack-Nova-Api-Version: 2.20 Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 9eb43e14768646f1bd2bdfc3bdf67406 Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-207035434 Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/9eb43e14768646f1bd2bdfc3bdf67406"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9eb43e14768646f1bd2bdfc3bdf67406"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9eb43e14768646f1bd2bdfc3bdf67406"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_9eb43e14768646f1bd2bdfc3bdf67406", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-AttachVolumeShelveTestJSON-207035434 Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 9eb43e14768646f1bd2bdfc3bdf67406 Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-207035434 Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-AttachVolumeShelveTestJSON-207035434-project Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: a86d300d66fd47a0b870b5ca879a03e8 Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-AttachVolumeShelveTestJSON-207035434-project Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: exception: Instance b6a3eb83-4aef-446a-a9d5-96d09acb1aaa could not be found. Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'b6a3eb83-4aef-446a-a9d5-96d09acb1aaa'} Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6a3eb83-4aef-446a-a9d5-96d09acb1aaa could not be found. Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6a3eb83-4aef-446a-a9d5-96d09acb1aaa could not be found. Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:27:15.852469 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:27:15.859279 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:27:15.859279 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:27:15.859279 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:27:15.859279 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:27:15.859279 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:27:15.859279 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:27:15.859279 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6a3eb83-4aef-446a-a9d5-96d09acb1aaa could not be found. Jun 10 18:27:15.859279 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:27:15.862390 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2c17db1a-7a50-4666-94aa-ed6fce08f992 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Returning 404 to user: Instance b6a3eb83-4aef-446a-a9d5-96d09acb1aaa could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:27:15.866140 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2c17db1a-7a50-4666-94aa-ed6fce08f992 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa" status: 404 len: 111 microversion: 2.20 time: 0.117219 Jun 10 18:27:15.874154 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2920/5889] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:27:15 2022] GET /compute/v2.1/servers/b6a3eb83-4aef-446a-a9d5-96d09acb1aaa => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 10 18:27:15.918411 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-09c3f5c7-7edb-4081-9d94-10ea76632cb7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:15.933343 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-09c3f5c7-7edb-4081-9d94-10ea76632cb7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06" status: 200 len: 1309 microversion: 2.1 time: 0.562112 Jun 10 18:27:15.934890 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2970/5890] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:15 2022] GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06 => generated 1309 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:16.951957 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b8cb9fbd-7310-4ca0-a669-78f46882d181 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:16.958735 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b8cb9fbd-7310-4ca0-a669-78f46882d181 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 607be5b9-5b8b-4d26-ad0b-15cb39df1e06] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:16.986896 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b8cb9fbd-7310-4ca0-a669-78f46882d181 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:16.987353 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b8cb9fbd-7310-4ca0-a669-78f46882d181 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:16.988136 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b8cb9fbd-7310-4ca0-a669-78f46882d181 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:16.988610 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b8cb9fbd-7310-4ca0-a669-78f46882d181 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:17.474706 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b8cb9fbd-7310-4ca0-a669-78f46882d181 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:17.488170 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b8cb9fbd-7310-4ca0-a669-78f46882d181 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06" status: 200 len: 1309 microversion: 2.1 time: 0.540169 Jun 10 18:27:17.499235 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2921/5891] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:16 2022] GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06 => generated 1309 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:18.513393 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b01c7c8a-97fd-4231-b151-9d40a156fd8f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:18.514810 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b01c7c8a-97fd-4231-b151-9d40a156fd8f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 607be5b9-5b8b-4d26-ad0b-15cb39df1e06] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:18.524888 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b01c7c8a-97fd-4231-b151-9d40a156fd8f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:18.525604 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b01c7c8a-97fd-4231-b151-9d40a156fd8f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:18.526580 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b01c7c8a-97fd-4231-b151-9d40a156fd8f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:18.527240 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b01c7c8a-97fd-4231-b151-9d40a156fd8f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:18.793645 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b01c7c8a-97fd-4231-b151-9d40a156fd8f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:18.803982 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b01c7c8a-97fd-4231-b151-9d40a156fd8f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06" status: 200 len: 1489 microversion: 2.1 time: 0.298254 Jun 10 18:27:18.816904 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2971/5892] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:18 2022] GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06 => generated 1489 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:18.935392 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d24392ac-6ffa-432a-81e4-83b2e6fb56c4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1972829433", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "940d65ec-437e-4f98-a601-e2ba4906c363"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:27:19.017065 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-d24392ac-6ffa-432a-81e4-83b2e6fb56c4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] validate_networks() for [('940d65ec-437e-4f98-a601-e2ba4906c363', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:27:19.728589 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-d24392ac-6ffa-432a-81e4-83b2e6fb56c4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:27:19.729029 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-d24392ac-6ffa-432a-81e4-83b2e6fb56c4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:27:19.732099 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-d24392ac-6ffa-432a-81e4-83b2e6fb56c4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:27:19.732697 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-d24392ac-6ffa-432a-81e4-83b2e6fb56c4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:27:19.733197 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-d24392ac-6ffa-432a-81e4-83b2e6fb56c4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:27:19.770462 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d24392ac-6ffa-432a-81e4-83b2e6fb56c4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:19.771885 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d24392ac-6ffa-432a-81e4-83b2e6fb56c4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:19.775716 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d24392ac-6ffa-432a-81e4-83b2e6fb56c4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:19.776902 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d24392ac-6ffa-432a-81e4-83b2e6fb56c4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:19.859986 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-d24392ac-6ffa-432a-81e4-83b2e6fb56c4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Getting quotas for project ded497d3d91b4e22bc2daa72d6f75d18. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:27:19.876592 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-d24392ac-6ffa-432a-81e4-83b2e6fb56c4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Getting quotas for user d37f560237d9489e96ddee21d9f5e6c6 and project ded497d3d91b4e22bc2daa72d6f75d18. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:27:19.902997 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d24392ac-6ffa-432a-81e4-83b2e6fb56c4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:27:19.911652 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d24392ac-6ffa-432a-81e4-83b2e6fb56c4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 3f397ccc-6368-4b37-82bb-12910169404f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:27:20.141731 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d24392ac-6ffa-432a-81e4-83b2e6fb56c4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.212201 Jun 10 18:27:20.144157 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2922/5893] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:27:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1215 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:27:20.159733 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5eaca5e8-21c2-41f4-b293-949fa6e49c7c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:20.161349 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5eaca5e8-21c2-41f4-b293-949fa6e49c7c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 3f397ccc-6368-4b37-82bb-12910169404f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:20.301496 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5eaca5e8-21c2-41f4-b293-949fa6e49c7c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:20.314979 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5eaca5e8-21c2-41f4-b293-949fa6e49c7c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f" status: 200 len: 1209 microversion: 2.1 time: 0.164156 Jun 10 18:27:20.315579 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2972/5894] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:20 2022] GET /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f => generated 1209 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:21.333437 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-eae74de5-1fe5-4034-9a32-4d5aed651c6e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:21.334049 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-eae74de5-1fe5-4034-9a32-4d5aed651c6e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 3f397ccc-6368-4b37-82bb-12910169404f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:21.346397 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eae74de5-1fe5-4034-9a32-4d5aed651c6e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:21.347211 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eae74de5-1fe5-4034-9a32-4d5aed651c6e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:21.348245 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eae74de5-1fe5-4034-9a32-4d5aed651c6e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:21.357905 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eae74de5-1fe5-4034-9a32-4d5aed651c6e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:21.480748 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-eae74de5-1fe5-4034-9a32-4d5aed651c6e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:21.495597 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-eae74de5-1fe5-4034-9a32-4d5aed651c6e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f" status: 200 len: 1213 microversion: 2.1 time: 0.167105 Jun 10 18:27:21.505222 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2923/5895] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:21 2022] GET /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f => generated 1213 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:22.514113 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-93aa9e62-8892-4993-bc60-8bb19ca67456 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:22.517023 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-93aa9e62-8892-4993-bc60-8bb19ca67456 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 3f397ccc-6368-4b37-82bb-12910169404f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:23.066227 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-57d274a4-f500-4a31-999c-14a9854d66b6 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:23.066879 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-57d274a4-f500-4a31-999c-14a9854d66b6 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:23.084760 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-57d274a4-f500-4a31-999c-14a9854d66b6 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:23.085221 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-57d274a4-f500-4a31-999c-14a9854d66b6 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:23.086059 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-57d274a4-f500-4a31-999c-14a9854d66b6 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:23.097550 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-57d274a4-f500-4a31-999c-14a9854d66b6 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:23.148344 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-57d274a4-f500-4a31-999c-14a9854d66b6 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] HTTP exception thrown: Instance 580e911e-a112-4bfa-9d78-b6a24178fae8 could not be found. Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-57d274a4-f500-4a31-999c-14a9854d66b6 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Request method failure captured: Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 HTTP/1.1 Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4roeABfU0LDjd4sEIHYTQC0IMae7J6Mra9Vy_1xOzbnXN2jSxDIko8tF1vxJtK8z5AlpLQsMdpqsdVt7qDN9xgkF0h7lXTCksN1VCW7wfK_1JTXkE0WDTNVyA_ld53tbtKPpriCbL00j4PS8vcye8EaA8CPfrFlWG5YNEqmbA88B3A Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: X-Openstack-Nova-Api-Version: 2.20 Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 9eb43e14768646f1bd2bdfc3bdf67406 Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-207035434 Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/9eb43e14768646f1bd2bdfc3bdf67406"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9eb43e14768646f1bd2bdfc3bdf67406"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9eb43e14768646f1bd2bdfc3bdf67406"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_9eb43e14768646f1bd2bdfc3bdf67406", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-AttachVolumeShelveTestJSON-207035434 Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 9eb43e14768646f1bd2bdfc3bdf67406 Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-207035434 Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-AttachVolumeShelveTestJSON-207035434-project Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: a86d300d66fd47a0b870b5ca879a03e8 Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-AttachVolumeShelveTestJSON-207035434-project Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 580e911e-a112-4bfa-9d78-b6a24178fae8 could not be found. Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '580e911e-a112-4bfa-9d78-b6a24178fae8'} Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 580e911e-a112-4bfa-9d78-b6a24178fae8 could not be found. Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:27:23.161685 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:27:23.166078 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 580e911e-a112-4bfa-9d78-b6a24178fae8 could not be found. Jun 10 18:27:23.166078 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:27:23.166078 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:27:23.166078 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:27:23.166078 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:27:23.166078 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:27:23.166078 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:27:23.166078 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:27:23.166078 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:27:23.166078 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 580e911e-a112-4bfa-9d78-b6a24178fae8 could not be found. Jun 10 18:27:23.166078 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:27:23.179093 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-57d274a4-f500-4a31-999c-14a9854d66b6 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Returning 404 to user: Instance 580e911e-a112-4bfa-9d78-b6a24178fae8 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:27:23.187871 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-57d274a4-f500-4a31-999c-14a9854d66b6 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "DELETE /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 404 len: 111 microversion: 2.20 time: 0.125870 Jun 10 18:27:23.197422 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2924/5896] 10.222.0.35 () {60 vars in 1279 bytes} [Fri Jun 10 18:27:23 2022] DELETE /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 10 18:27:23.206432 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dedf30f7-263b-4c0d-b5f3-06af4ed49c05 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:23.209608 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dedf30f7-263b-4c0d-b5f3-06af4ed49c05 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] [instance: 580e911e-a112-4bfa-9d78-b6a24178fae8] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:23.232847 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dedf30f7-263b-4c0d-b5f3-06af4ed49c05 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:23.237969 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dedf30f7-263b-4c0d-b5f3-06af4ed49c05 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:23.239093 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dedf30f7-263b-4c0d-b5f3-06af4ed49c05 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:23.241124 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dedf30f7-263b-4c0d-b5f3-06af4ed49c05 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:23.282684 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-93aa9e62-8892-4993-bc60-8bb19ca67456 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:23.284891 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-93aa9e62-8892-4993-bc60-8bb19ca67456 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:23.286165 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-93aa9e62-8892-4993-bc60-8bb19ca67456 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:23.290749 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-93aa9e62-8892-4993-bc60-8bb19ca67456 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:23.291789 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-dedf30f7-263b-4c0d-b5f3-06af4ed49c05 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] HTTP exception thrown: Instance 580e911e-a112-4bfa-9d78-b6a24178fae8 could not be found. Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dedf30f7-263b-4c0d-b5f3-06af4ed49c05 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Request method failure captured: Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 HTTP/1.1 Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4roeABfU0LDjd4sEIHYTQC0IMae7J6Mra9Vy_1xOzbnXN2jSxDIko8tF1vxJtK8z5AlpLQsMdpqsdVt7qDN9xgkF0h7lXTCksN1VCW7wfK_1JTXkE0WDTNVyA_ld53tbtKPpriCbL00j4PS8vcye8EaA8CPfrFlWG5YNEqmbA88B3A Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: X-Openstack-Nova-Api-Version: 2.20 Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 9eb43e14768646f1bd2bdfc3bdf67406 Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-207035434 Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/9eb43e14768646f1bd2bdfc3bdf67406"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9eb43e14768646f1bd2bdfc3bdf67406"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9eb43e14768646f1bd2bdfc3bdf67406"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_9eb43e14768646f1bd2bdfc3bdf67406", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-AttachVolumeShelveTestJSON-207035434 Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 9eb43e14768646f1bd2bdfc3bdf67406 Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-207035434 Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-AttachVolumeShelveTestJSON-207035434-project Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: a86d300d66fd47a0b870b5ca879a03e8 Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-AttachVolumeShelveTestJSON-207035434-project Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 580e911e-a112-4bfa-9d78-b6a24178fae8 could not be found. Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '580e911e-a112-4bfa-9d78-b6a24178fae8'} Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 580e911e-a112-4bfa-9d78-b6a24178fae8 could not be found. Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 580e911e-a112-4bfa-9d78-b6a24178fae8 could not be found. Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:27:23.293502 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:27:23.297884 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:27:23.297884 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:27:23.297884 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:27:23.297884 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:27:23.297884 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:27:23.297884 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:27:23.297884 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 580e911e-a112-4bfa-9d78-b6a24178fae8 could not be found. Jun 10 18:27:23.297884 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:27:23.301173 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dedf30f7-263b-4c0d-b5f3-06af4ed49c05 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] Returning 404 to user: Instance 580e911e-a112-4bfa-9d78-b6a24178fae8 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:27:23.302846 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dedf30f7-263b-4c0d-b5f3-06af4ed49c05 tempest-AttachVolumeShelveTestJSON-207035434 tempest-AttachVolumeShelveTestJSON-207035434-project] 10.222.0.35 "GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8" status: 404 len: 111 microversion: 2.20 time: 0.100472 Jun 10 18:27:23.308268 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2925/5897] 10.222.0.35 () {60 vars in 1276 bytes} [Fri Jun 10 18:27:23 2022] GET /compute/v2.1/servers/580e911e-a112-4bfa-9d78-b6a24178fae8 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 10 18:27:23.558418 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-93aa9e62-8892-4993-bc60-8bb19ca67456 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:23.566387 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-93aa9e62-8892-4993-bc60-8bb19ca67456 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f" status: 200 len: 1269 microversion: 2.1 time: 1.056933 Jun 10 18:27:23.566977 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2973/5898] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:22 2022] GET /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f => generated 1269 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:24.589046 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8a734608-5d32-4726-bcf2-cf52e38247b2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:24.590356 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8a734608-5d32-4726-bcf2-cf52e38247b2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 3f397ccc-6368-4b37-82bb-12910169404f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:24.604034 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8a734608-5d32-4726-bcf2-cf52e38247b2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:24.604746 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8a734608-5d32-4726-bcf2-cf52e38247b2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:24.616447 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8a734608-5d32-4726-bcf2-cf52e38247b2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:24.617518 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8a734608-5d32-4726-bcf2-cf52e38247b2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:25.174808 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8a734608-5d32-4726-bcf2-cf52e38247b2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:25.196611 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8a734608-5d32-4726-bcf2-cf52e38247b2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f" status: 200 len: 1309 microversion: 2.1 time: 0.603172 Jun 10 18:27:25.199036 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2926/5899] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:24 2022] GET /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f => generated 1309 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:26.219377 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9be7154d-ac68-4ace-a35e-0f2229152c91 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:26.220704 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9be7154d-ac68-4ace-a35e-0f2229152c91 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 3f397ccc-6368-4b37-82bb-12910169404f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:26.228805 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9be7154d-ac68-4ace-a35e-0f2229152c91 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:26.229560 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9be7154d-ac68-4ace-a35e-0f2229152c91 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:26.230645 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9be7154d-ac68-4ace-a35e-0f2229152c91 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:26.231308 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9be7154d-ac68-4ace-a35e-0f2229152c91 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:26.579927 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9be7154d-ac68-4ace-a35e-0f2229152c91 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:26.589752 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9be7154d-ac68-4ace-a35e-0f2229152c91 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f" status: 200 len: 1309 microversion: 2.1 time: 0.376343 Jun 10 18:27:26.594958 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2974/5900] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:26 2022] GET /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f => generated 1309 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:27.012095 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-950635e2-b1c5-4693-b5ab-52cda61fee44 req-9eab8a18-af63-4db8-a75a-7532ac14297d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f397ccc-6368-4b37-82bb-12910169404f", "tag": "72d26e0e-bad5-41e5-bbd7-940808b1dba8"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:27:27.069797 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-950635e2-b1c5-4693-b5ab-52cda61fee44 req-9eab8a18-af63-4db8-a75a-7532ac14297d service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:27.075875 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-950635e2-b1c5-4693-b5ab-52cda61fee44 req-9eab8a18-af63-4db8-a75a-7532ac14297d service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:27.112725 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-950635e2-b1c5-4693-b5ab-52cda61fee44 req-9eab8a18-af63-4db8-a75a-7532ac14297d service nova] Creating event network-changed:72d26e0e-bad5-41e5-bbd7-940808b1dba8 for instance 3f397ccc-6368-4b37-82bb-12910169404f on chh2-master-2 Jun 10 18:27:27.119573 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-950635e2-b1c5-4693-b5ab-52cda61fee44 req-9eab8a18-af63-4db8-a75a-7532ac14297d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112118 Jun 10 18:27:27.121116 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2927/5901] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:27:27.546026 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7a04db60-f467-412c-8bc5-1112c2093fb6 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:27.547483 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7a04db60-f467-412c-8bc5-1112c2093fb6 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: e57747ec-57b8-46a6-92c2-8a57830524f7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:27.562033 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7a04db60-f467-412c-8bc5-1112c2093fb6 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:27.565515 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7a04db60-f467-412c-8bc5-1112c2093fb6 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:27.566620 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7a04db60-f467-412c-8bc5-1112c2093fb6 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:27.567295 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7a04db60-f467-412c-8bc5-1112c2093fb6 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:27.609493 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-303d504f-f00b-43bf-a5d7-65477a172514 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:27.610839 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-303d504f-f00b-43bf-a5d7-65477a172514 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 3f397ccc-6368-4b37-82bb-12910169404f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:27.626046 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-303d504f-f00b-43bf-a5d7-65477a172514 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:27.626533 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-303d504f-f00b-43bf-a5d7-65477a172514 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:27.627328 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-303d504f-f00b-43bf-a5d7-65477a172514 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:27.635570 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-303d504f-f00b-43bf-a5d7-65477a172514 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:27.644631 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7a04db60-f467-412c-8bc5-1112c2093fb6 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7/ips" status: 200 len: 149 microversion: 2.1 time: 0.101212 Jun 10 18:27:27.648382 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2975/5902] 10.222.0.35 () {58 vars in 1247 bytes} [Fri Jun 10 18:27:27 2022] GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7/ips => generated 149 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:27:27.666422 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b3c4889a-2481-4aea-a340-9660a6a8bfe8 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d979c9aa-ce7b-48a7-90be-9aeb4d0e1f51"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:27:27.668798 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b3c4889a-2481-4aea-a340-9660a6a8bfe8 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: e57747ec-57b8-46a6-92c2-8a57830524f7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:27.683387 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b3c4889a-2481-4aea-a340-9660a6a8bfe8 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:27.687078 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b3c4889a-2481-4aea-a340-9660a6a8bfe8 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:27.688279 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b3c4889a-2481-4aea-a340-9660a6a8bfe8 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:27.688920 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b3c4889a-2481-4aea-a340-9660a6a8bfe8 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=92 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-b3c4889a-2481-4aea-a340-9660a6a8bfe8 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] HTTP exception thrown: Invalid volume: volume d979c9aa-ce7b-48a7-90be-9aeb4d0e1f51 is already attached to instances: 0fa247cf-f328-4ddf-b72c-2cde38330ed2 Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b3c4889a-2481-4aea-a340-9660a6a8bfe8 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Request method failure captured: Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7/os-volume_attachments HTTP/1.1 Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 74 Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4wSsTbdAR5Qo9IVKF2KTe64dpp06ye4z8lPOT4uRhY2Oz0KMxQpxmr8KJzvNSTZtUIPPEgN2R6-CfUmf8CTAhd_IkVIfk-LuHrtE7255OYmbmFD6LLNrB7dKdWnCpSm8e4XDxNvfMbtjLHwd4svP6YGpBpPTncT2KN4jK3q3Q7l5ew Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 886b72a54e9b4ee7aa3cc21da4145cbb Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-AttachVolumeNegativeTest-545911130 Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/886b72a54e9b4ee7aa3cc21da4145cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/886b72a54e9b4ee7aa3cc21da4145cbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/886b72a54e9b4ee7aa3cc21da4145cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_886b72a54e9b4ee7aa3cc21da4145cbb", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-AttachVolumeNegativeTest-545911130 Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 886b72a54e9b4ee7aa3cc21da4145cbb Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-545911130 Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-AttachVolumeNegativeTest-545911130-project Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: f62326a9deb140e891c07529dc021d11 Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-AttachVolumeNegativeTest-545911130-project Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: {"volumeAttachment": {"volumeId": "d979c9aa-ce7b-48a7-90be-9aeb4d0e1f51"}} Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: exception: Invalid volume: volume d979c9aa-ce7b-48a7-90be-9aeb4d0e1f51 is already attached to instances: 0fa247cf-f328-4ddf-b72c-2cde38330ed2 Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: action_args: {'server_id': 'e57747ec-57b8-46a6-92c2-8a57830524f7', 'body': {'volumeAttachment': {'volumeId': 'd979c9aa-ce7b-48a7-90be-9aeb4d0e1f51'}}} Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d979c9aa-ce7b-48a7-90be-9aeb4d0e1f51 is already attached to instances: 0fa247cf-f328-4ddf-b72c-2cde38330ed2 Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:27:27.841189 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:27:27.845274 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:27:27.845274 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:27:27.845274 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:27:27.845274 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:27:27.845274 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:27:27.845274 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:27:27.845274 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:27:27.845274 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:27:27.845274 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 10 18:27:27.845274 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 10 18:27:27.845274 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d979c9aa-ce7b-48a7-90be-9aeb4d0e1f51 is already attached to instances: 0fa247cf-f328-4ddf-b72c-2cde38330ed2 Jun 10 18:27:27.845274 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:27:27.845274 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:27:27.845274 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:27:27.845274 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:27:27.845274 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:27:27.845274 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:27:27.845274 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:27:27.845274 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:27:27.845274 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d979c9aa-ce7b-48a7-90be-9aeb4d0e1f51 is already attached to instances: 0fa247cf-f328-4ddf-b72c-2cde38330ed2 Jun 10 18:27:27.845274 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:27:27.845274 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b3c4889a-2481-4aea-a340-9660a6a8bfe8 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Returning 400 to user: Invalid volume: volume d979c9aa-ce7b-48a7-90be-9aeb4d0e1f51 is already attached to instances: 0fa247cf-f328-4ddf-b72c-2cde38330ed2 {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:27:27.845274 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b3c4889a-2481-4aea-a340-9660a6a8bfe8 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "POST /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.187294 Jun 10 18:27:27.847399 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2976/5903] 10.222.0.35 () {60 vars in 1322 bytes} [Fri Jun 10 18:27:27 2022] POST /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7/os-volume_attachments => generated 174 bytes in 193 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:27:27.863899 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cf38f875-96e8-46c0-b400-0ccd7561b62b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:27.864899 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cf38f875-96e8-46c0-b400-0ccd7561b62b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: e57747ec-57b8-46a6-92c2-8a57830524f7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:27.877503 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf38f875-96e8-46c0-b400-0ccd7561b62b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:27.877971 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf38f875-96e8-46c0-b400-0ccd7561b62b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:27.878767 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf38f875-96e8-46c0-b400-0ccd7561b62b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:27.882476 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf38f875-96e8-46c0-b400-0ccd7561b62b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:27.949333 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cf38f875-96e8-46c0-b400-0ccd7561b62b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: e57747ec-57b8-46a6-92c2-8a57830524f7] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:27:28.078887 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-303d504f-f00b-43bf-a5d7-65477a172514 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:28.094729 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-303d504f-f00b-43bf-a5d7-65477a172514 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f" status: 200 len: 1309 microversion: 2.1 time: 0.488599 Jun 10 18:27:28.095388 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2928/5904] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:27 2022] GET /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f => generated 1309 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:27:28.446279 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cf38f875-96e8-46c0-b400-0ccd7561b62b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "DELETE /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7" status: 204 len: 0 microversion: 2.1 time: 0.593189 Jun 10 18:27:28.447330 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2977/5905] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:27:27 2022] DELETE /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:27:28.455865 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-023c753e-41ab-4f64-909a-2f72f1e27edd tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:28.463448 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-023c753e-41ab-4f64-909a-2f72f1e27edd tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: e57747ec-57b8-46a6-92c2-8a57830524f7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:28.465536 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-023c753e-41ab-4f64-909a-2f72f1e27edd tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:28.467616 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-023c753e-41ab-4f64-909a-2f72f1e27edd tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:28.468275 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-023c753e-41ab-4f64-909a-2f72f1e27edd tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:28.468754 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-023c753e-41ab-4f64-909a-2f72f1e27edd tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:28.869198 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-023c753e-41ab-4f64-909a-2f72f1e27edd tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:28.881267 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-023c753e-41ab-4f64-909a-2f72f1e27edd tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7" status: 200 len: 1682 microversion: 2.1 time: 0.427545 Jun 10 18:27:28.883042 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2929/5906] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:28 2022] GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7 => generated 1682 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:29.113666 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2131d7d4-30f0-45f1-9fe4-a301d29a101d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:29.116072 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2131d7d4-30f0-45f1-9fe4-a301d29a101d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 3f397ccc-6368-4b37-82bb-12910169404f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:29.149412 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2131d7d4-30f0-45f1-9fe4-a301d29a101d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:29.151989 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2131d7d4-30f0-45f1-9fe4-a301d29a101d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:29.155587 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2131d7d4-30f0-45f1-9fe4-a301d29a101d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:29.156292 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2131d7d4-30f0-45f1-9fe4-a301d29a101d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:29.657772 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2131d7d4-30f0-45f1-9fe4-a301d29a101d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:29.680368 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2131d7d4-30f0-45f1-9fe4-a301d29a101d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f" status: 200 len: 1309 microversion: 2.1 time: 0.570635 Jun 10 18:27:29.681162 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2978/5907] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:29 2022] GET /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f => generated 1309 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:29.901201 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e8dc354c-55e6-4555-aeb9-2ec7875c4cd4 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:29.905552 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e8dc354c-55e6-4555-aeb9-2ec7875c4cd4 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: e57747ec-57b8-46a6-92c2-8a57830524f7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:29.910917 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:27:29.911664 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=6 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:27:29.928676 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e8dc354c-55e6-4555-aeb9-2ec7875c4cd4 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:29.934336 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e8dc354c-55e6-4555-aeb9-2ec7875c4cd4 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:29.935670 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e8dc354c-55e6-4555-aeb9-2ec7875c4cd4 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:29.960085 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e8dc354c-55e6-4555-aeb9-2ec7875c4cd4 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:30.436908 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e8dc354c-55e6-4555-aeb9-2ec7875c4cd4 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:30.438167 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e8dc354c-55e6-4555-aeb9-2ec7875c4cd4 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7" status: 200 len: 1682 microversion: 2.1 time: 0.542276 Jun 10 18:27:30.443149 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2930/5908] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:29 2022] GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7 => generated 1682 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:30.698723 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-691bc755-8b67-4848-85e9-0aac44c24949 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:30.708015 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-691bc755-8b67-4848-85e9-0aac44c24949 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 3f397ccc-6368-4b37-82bb-12910169404f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:30.715335 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:27:30.722232 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-691bc755-8b67-4848-85e9-0aac44c24949 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:30.731897 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-691bc755-8b67-4848-85e9-0aac44c24949 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:30.735234 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-691bc755-8b67-4848-85e9-0aac44c24949 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:30.735880 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-691bc755-8b67-4848-85e9-0aac44c24949 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:31.176702 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-691bc755-8b67-4848-85e9-0aac44c24949 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:31.184745 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-691bc755-8b67-4848-85e9-0aac44c24949 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f" status: 200 len: 1309 microversion: 2.1 time: 0.491136 Jun 10 18:27:31.208008 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2979/5909] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:30 2022] GET /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f => generated 1309 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:31.457951 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7dac3ce2-af1e-42fd-b6df-f2548237547c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:31.459111 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7dac3ce2-af1e-42fd-b6df-f2548237547c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: e57747ec-57b8-46a6-92c2-8a57830524f7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:31.480065 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7dac3ce2-af1e-42fd-b6df-f2548237547c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:31.480808 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7dac3ce2-af1e-42fd-b6df-f2548237547c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:31.481915 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7dac3ce2-af1e-42fd-b6df-f2548237547c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:31.482519 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7dac3ce2-af1e-42fd-b6df-f2548237547c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:32.052704 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7dac3ce2-af1e-42fd-b6df-f2548237547c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:32.089279 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7dac3ce2-af1e-42fd-b6df-f2548237547c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7" status: 200 len: 1682 microversion: 2.1 time: 0.616708 Jun 10 18:27:32.089279 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2931/5910] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:31 2022] GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7 => generated 1682 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:32.214942 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-693450c5-1385-4c98-b551-390e7cdd530e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:32.215649 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-693450c5-1385-4c98-b551-390e7cdd530e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 3f397ccc-6368-4b37-82bb-12910169404f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:32.229112 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-693450c5-1385-4c98-b551-390e7cdd530e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:32.230213 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-693450c5-1385-4c98-b551-390e7cdd530e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:32.235065 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-693450c5-1385-4c98-b551-390e7cdd530e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:32.240755 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-693450c5-1385-4c98-b551-390e7cdd530e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:32.921458 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-693450c5-1385-4c98-b551-390e7cdd530e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:32.935764 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-693450c5-1385-4c98-b551-390e7cdd530e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f" status: 200 len: 1309 microversion: 2.1 time: 0.724513 Jun 10 18:27:32.950891 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2980/5911] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:32 2022] GET /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f => generated 1309 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:33.097959 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-453570f8-0ca9-43bc-a52c-79aa05f6a575 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:33.098591 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-453570f8-0ca9-43bc-a52c-79aa05f6a575 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: e57747ec-57b8-46a6-92c2-8a57830524f7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:33.113649 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:27:33.116105 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-453570f8-0ca9-43bc-a52c-79aa05f6a575 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:33.116635 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-453570f8-0ca9-43bc-a52c-79aa05f6a575 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:33.117434 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-453570f8-0ca9-43bc-a52c-79aa05f6a575 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:33.117876 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-453570f8-0ca9-43bc-a52c-79aa05f6a575 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:33.567924 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-453570f8-0ca9-43bc-a52c-79aa05f6a575 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:33.581379 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-453570f8-0ca9-43bc-a52c-79aa05f6a575 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7" status: 200 len: 1682 microversion: 2.1 time: 0.488296 Jun 10 18:27:33.582447 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2932/5912] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:33 2022] GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7 => generated 1682 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:33.959019 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-35d5d3af-3186-4353-a6f3-f5ef19de5f6c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:33.960956 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-35d5d3af-3186-4353-a6f3-f5ef19de5f6c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 3f397ccc-6368-4b37-82bb-12910169404f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:33.969621 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-35d5d3af-3186-4353-a6f3-f5ef19de5f6c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:33.970289 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-35d5d3af-3186-4353-a6f3-f5ef19de5f6c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:33.971314 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-35d5d3af-3186-4353-a6f3-f5ef19de5f6c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:33.971926 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-35d5d3af-3186-4353-a6f3-f5ef19de5f6c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:34.471068 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-49f94dc1-f495-41c7-bbd7-9aee530d557e req-86f4a870-4239-4f5e-a3b3-09403c568c7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e57747ec-57b8-46a6-92c2-8a57830524f7", "name": "network-vif-deleted", "tag": "88584f5c-4452-438a-bb12-e9709663cd5d"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:27:34.497461 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-49f94dc1-f495-41c7-bbd7-9aee530d557e req-86f4a870-4239-4f5e-a3b3-09403c568c7b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:34.499470 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-49f94dc1-f495-41c7-bbd7-9aee530d557e req-86f4a870-4239-4f5e-a3b3-09403c568c7b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:34.538297 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-49f94dc1-f495-41c7-bbd7-9aee530d557e req-86f4a870-4239-4f5e-a3b3-09403c568c7b service nova] Creating event network-vif-deleted:88584f5c-4452-438a-bb12-e9709663cd5d for instance e57747ec-57b8-46a6-92c2-8a57830524f7 on chh2-master-2 Jun 10 18:27:34.551381 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-35d5d3af-3186-4353-a6f3-f5ef19de5f6c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:34.551541 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-49f94dc1-f495-41c7-bbd7-9aee530d557e req-86f4a870-4239-4f5e-a3b3-09403c568c7b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082634 Jun 10 18:27:34.553348 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2933/5913] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:27:34.555213 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-35d5d3af-3186-4353-a6f3-f5ef19de5f6c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f" status: 200 len: 1309 microversion: 2.1 time: 0.600339 Jun 10 18:27:34.555796 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2981/5914] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:33 2022] GET /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f => generated 1309 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:34.607040 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dd3aa75a-1868-424d-8484-75e947033ccb tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:34.607760 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dd3aa75a-1868-424d-8484-75e947033ccb tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: e57747ec-57b8-46a6-92c2-8a57830524f7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:34.620719 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd3aa75a-1868-424d-8484-75e947033ccb tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:34.620719 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd3aa75a-1868-424d-8484-75e947033ccb tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:34.622546 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd3aa75a-1868-424d-8484-75e947033ccb tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:34.625527 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd3aa75a-1868-424d-8484-75e947033ccb tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:34.966404 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-dd3aa75a-1868-424d-8484-75e947033ccb tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:34.966404 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dd3aa75a-1868-424d-8484-75e947033ccb tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7" status: 200 len: 1614 microversion: 2.1 time: 0.304731 Jun 10 18:27:34.966404 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2934/5915] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:34 2022] GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7 => generated 1614 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:35.577973 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2d1d6722-ed69-4ae1-88ca-682473232991 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:35.579107 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2d1d6722-ed69-4ae1-88ca-682473232991 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 3f397ccc-6368-4b37-82bb-12910169404f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:35.591558 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2d1d6722-ed69-4ae1-88ca-682473232991 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:35.592707 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2d1d6722-ed69-4ae1-88ca-682473232991 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:35.595919 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2d1d6722-ed69-4ae1-88ca-682473232991 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:35.596615 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2d1d6722-ed69-4ae1-88ca-682473232991 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:35.932508 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-577e1c05-4e7d-4c6d-a250-e0e96bf05b22 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:35.938509 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-577e1c05-4e7d-4c6d-a250-e0e96bf05b22 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: e57747ec-57b8-46a6-92c2-8a57830524f7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:35.982314 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-577e1c05-4e7d-4c6d-a250-e0e96bf05b22 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:35.985191 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-577e1c05-4e7d-4c6d-a250-e0e96bf05b22 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:35.988327 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-577e1c05-4e7d-4c6d-a250-e0e96bf05b22 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:35.990318 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-577e1c05-4e7d-4c6d-a250-e0e96bf05b22 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:36.092360 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-577e1c05-4e7d-4c6d-a250-e0e96bf05b22 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:36.092832 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-577e1c05-4e7d-4c6d-a250-e0e96bf05b22 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:36.106163 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-577e1c05-4e7d-4c6d-a250-e0e96bf05b22 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lazy-loading 'fault' on Instance uuid e57747ec-57b8-46a6-92c2-8a57830524f7 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:27:36.408772 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-577e1c05-4e7d-4c6d-a250-e0e96bf05b22 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:36.445258 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-577e1c05-4e7d-4c6d-a250-e0e96bf05b22 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7" status: 200 len: 1332 microversion: 2.1 time: 0.516806 Jun 10 18:27:36.448249 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2935/5916] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:35 2022] GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7 => generated 1332 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:27:36.464553 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-6e8265a5-f23e-4ca5-8d70-380fd172f000 req-77b4d4d2-3421-47ae-aaa0-e676f8ae40a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f397ccc-6368-4b37-82bb-12910169404f", "name": "network-vif-plugged", "status": "completed", "tag": "72d26e0e-bad5-41e5-bbd7-940808b1dba8"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:27:36.484113 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-6e8265a5-f23e-4ca5-8d70-380fd172f000 req-77b4d4d2-3421-47ae-aaa0-e676f8ae40a9 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:36.484893 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-6e8265a5-f23e-4ca5-8d70-380fd172f000 req-77b4d4d2-3421-47ae-aaa0-e676f8ae40a9 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:36.510760 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2d1d6722-ed69-4ae1-88ca-682473232991 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:36.538955 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2d1d6722-ed69-4ae1-88ca-682473232991 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f" status: 200 len: 1309 microversion: 2.1 time: 0.965233 Jun 10 18:27:36.545376 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2982/5917] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:35 2022] GET /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f => generated 1309 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:36.557731 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-6e8265a5-f23e-4ca5-8d70-380fd172f000 req-77b4d4d2-3421-47ae-aaa0-e676f8ae40a9 service nova] Creating event network-vif-plugged:72d26e0e-bad5-41e5-bbd7-940808b1dba8 for instance 3f397ccc-6368-4b37-82bb-12910169404f on chh2-master-2 Jun 10 18:27:36.581671 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-6e8265a5-f23e-4ca5-8d70-380fd172f000 req-77b4d4d2-3421-47ae-aaa0-e676f8ae40a9 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131287 Jun 10 18:27:36.585218 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2936/5918] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:27:37.470380 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8f200e17-7ca8-4f20-ab2d-778980a5300f tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:37.471008 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8f200e17-7ca8-4f20-ab2d-778980a5300f tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: e57747ec-57b8-46a6-92c2-8a57830524f7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:37.483951 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8f200e17-7ca8-4f20-ab2d-778980a5300f tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:37.484444 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8f200e17-7ca8-4f20-ab2d-778980a5300f tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:37.485245 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8f200e17-7ca8-4f20-ab2d-778980a5300f tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:37.485692 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8f200e17-7ca8-4f20-ab2d-778980a5300f tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:37.508688 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-8f200e17-7ca8-4f20-ab2d-778980a5300f tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] HTTP exception thrown: Instance e57747ec-57b8-46a6-92c2-8a57830524f7 could not be found. Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8f200e17-7ca8-4f20-ab2d-778980a5300f tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Request method failure captured: Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7 HTTP/1.1 Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4wSsTbdAR5Qo9IVKF2KTe64dpp06ye4z8lPOT4uRhY2Oz0KMxQpxmr8KJzvNSTZtUIPPEgN2R6-CfUmf8CTAhd_IkVIfk-LuHrtE7255OYmbmFD6LLNrB7dKdWnCpSm8e4XDxNvfMbtjLHwd4svP6YGpBpPTncT2KN4jK3q3Q7l5ew Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 886b72a54e9b4ee7aa3cc21da4145cbb Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-AttachVolumeNegativeTest-545911130 Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/886b72a54e9b4ee7aa3cc21da4145cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/886b72a54e9b4ee7aa3cc21da4145cbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/886b72a54e9b4ee7aa3cc21da4145cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_886b72a54e9b4ee7aa3cc21da4145cbb", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-AttachVolumeNegativeTest-545911130 Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 886b72a54e9b4ee7aa3cc21da4145cbb Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-545911130 Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-AttachVolumeNegativeTest-545911130-project Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: f62326a9deb140e891c07529dc021d11 Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-AttachVolumeNegativeTest-545911130-project Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: exception: Instance e57747ec-57b8-46a6-92c2-8a57830524f7 could not be found. Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'e57747ec-57b8-46a6-92c2-8a57830524f7'} Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e57747ec-57b8-46a6-92c2-8a57830524f7 could not be found. Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e57747ec-57b8-46a6-92c2-8a57830524f7 could not be found. Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:27:37.509926 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:27:37.515137 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:27:37.515137 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:27:37.515137 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:27:37.515137 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:27:37.515137 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:27:37.515137 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e57747ec-57b8-46a6-92c2-8a57830524f7 could not be found. Jun 10 18:27:37.515137 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:27:37.515137 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8f200e17-7ca8-4f20-ab2d-778980a5300f tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Returning 404 to user: Instance e57747ec-57b8-46a6-92c2-8a57830524f7 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:27:37.515137 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8f200e17-7ca8-4f20-ab2d-778980a5300f tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7" status: 404 len: 111 microversion: 2.1 time: 0.045569 Jun 10 18:27:37.515137 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2983/5919] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:37 2022] GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:27:37.523059 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d808ad64-e5cd-4179-b370-66243469017c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '.version_select at 0x7f77c00a5e50>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:37.574890 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b476ac0f-68a9-4569-8850-70c5698b85e0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:37.576087 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b476ac0f-68a9-4569-8850-70c5698b85e0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 3f397ccc-6368-4b37-82bb-12910169404f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:37.585552 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b476ac0f-68a9-4569-8850-70c5698b85e0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:37.589192 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b476ac0f-68a9-4569-8850-70c5698b85e0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:37.589192 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b476ac0f-68a9-4569-8850-70c5698b85e0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:37.589192 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b476ac0f-68a9-4569-8850-70c5698b85e0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:37.681801 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d808ad64-e5cd-4179-b370-66243469017c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1420083637" status: 202 len: 0 microversion: 2.1 time: 0.162897 Jun 10 18:27:37.686503 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2937/5920] 10.222.0.35 () {58 vars in 1220 bytes} [Fri Jun 10 18:27:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1420083637 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:27:38.435575 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b476ac0f-68a9-4569-8850-70c5698b85e0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:38.453979 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b476ac0f-68a9-4569-8850-70c5698b85e0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f" status: 200 len: 1309 microversion: 2.1 time: 0.894629 Jun 10 18:27:38.469121 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2984/5921] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:37 2022] GET /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f => generated 1309 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:27:39.482470 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-90ff656e-19e9-4650-9334-420fe13405a6 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:39.483814 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-90ff656e-19e9-4650-9334-420fe13405a6 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 3f397ccc-6368-4b37-82bb-12910169404f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:39.498450 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-90ff656e-19e9-4650-9334-420fe13405a6 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:39.501427 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-90ff656e-19e9-4650-9334-420fe13405a6 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:39.507463 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-90ff656e-19e9-4650-9334-420fe13405a6 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:39.508241 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-90ff656e-19e9-4650-9334-420fe13405a6 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:39.885278 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-90ff656e-19e9-4650-9334-420fe13405a6 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:39.893043 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-90ff656e-19e9-4650-9334-420fe13405a6 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f" status: 200 len: 1489 microversion: 2.1 time: 0.417049 Jun 10 18:27:39.894618 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2938/5922] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:39 2022] GET /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f => generated 1489 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:39.918817 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ec41bd34-99da-4e55-9a40-1be58384d3b2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:39.919554 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ec41bd34-99da-4e55-9a40-1be58384d3b2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 607be5b9-5b8b-4d26-ad0b-15cb39df1e06] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:39.925288 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:27:39.929646 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec41bd34-99da-4e55-9a40-1be58384d3b2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:39.930110 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec41bd34-99da-4e55-9a40-1be58384d3b2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:39.930907 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec41bd34-99da-4e55-9a40-1be58384d3b2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:39.931354 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec41bd34-99da-4e55-9a40-1be58384d3b2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:40.310345 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ec41bd34-99da-4e55-9a40-1be58384d3b2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:40.326693 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ec41bd34-99da-4e55-9a40-1be58384d3b2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06" status: 200 len: 1489 microversion: 2.1 time: 0.415099 Jun 10 18:27:40.332908 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2985/5923] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:39 2022] GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06 => generated 1489 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:40.350032 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-201315ab-add1-4144-b565-f196a0b6f21c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:40.358970 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-201315ab-add1-4144-b565-f196a0b6f21c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 3f397ccc-6368-4b37-82bb-12910169404f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:40.422213 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-201315ab-add1-4144-b565-f196a0b6f21c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:40.422677 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-201315ab-add1-4144-b565-f196a0b6f21c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:40.423480 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-201315ab-add1-4144-b565-f196a0b6f21c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:40.428769 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-201315ab-add1-4144-b565-f196a0b6f21c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:40.681840 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ef23d625-751c-4010-b6f5-b0772f1f6ba0 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:40.682604 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ef23d625-751c-4010-b6f5-b0772f1f6ba0 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:40.692557 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ef23d625-751c-4010-b6f5-b0772f1f6ba0 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:40.695249 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ef23d625-751c-4010-b6f5-b0772f1f6ba0 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:40.696670 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ef23d625-751c-4010-b6f5-b0772f1f6ba0 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:40.700715 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ef23d625-751c-4010-b6f5-b0772f1f6ba0 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:40.880200 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-ef23d625-751c-4010-b6f5-b0772f1f6ba0 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lazy-loading 'services' on Instance uuid 0fa247cf-f328-4ddf-b72c-2cde38330ed2 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:27:41.038989 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-201315ab-add1-4144-b565-f196a0b6f21c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:41.064538 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-201315ab-add1-4144-b565-f196a0b6f21c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f" status: 200 len: 1489 microversion: 2.1 time: 0.718992 Jun 10 18:27:41.075514 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2939/5924] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:40 2022] GET /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f => generated 1489 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:41.103066 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d0354553-1a07-43f5-b776-d47cdf3e4fb4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:41.103574 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d0354553-1a07-43f5-b776-d47cdf3e4fb4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 3f397ccc-6368-4b37-82bb-12910169404f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:41.159120 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d0354553-1a07-43f5-b776-d47cdf3e4fb4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:41.162795 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d0354553-1a07-43f5-b776-d47cdf3e4fb4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:41.163886 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d0354553-1a07-43f5-b776-d47cdf3e4fb4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:41.169278 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d0354553-1a07-43f5-b776-d47cdf3e4fb4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:41.218903 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d0354553-1a07-43f5-b776-d47cdf3e4fb4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 3f397ccc-6368-4b37-82bb-12910169404f] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:27:41.273890 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ef23d625-751c-4010-b6f5-b0772f1f6ba0 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "DELETE /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2/os-volume_attachments/d979c9aa-ce7b-48a7-90be-9aeb4d0e1f51" status: 202 len: 0 microversion: 2.1 time: 0.588029 Jun 10 18:27:41.273890 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2986/5925] 10.222.0.35 () {58 vars in 1415 bytes} [Fri Jun 10 18:27:40 2022] DELETE /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2/os-volume_attachments/d979c9aa-ce7b-48a7-90be-9aeb4d0e1f51 => generated 0 bytes in 590 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:27:41.283708 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-31854029-93e1-4f19-bdfa-5dfe0a2a6ac4 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:41.285330 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-31854029-93e1-4f19-bdfa-5dfe0a2a6ac4 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:41.299173 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-31854029-93e1-4f19-bdfa-5dfe0a2a6ac4 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:41.301735 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-31854029-93e1-4f19-bdfa-5dfe0a2a6ac4 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:41.302664 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-31854029-93e1-4f19-bdfa-5dfe0a2a6ac4 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:41.304979 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-31854029-93e1-4f19-bdfa-5dfe0a2a6ac4 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:41.356157 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-31854029-93e1-4f19-bdfa-5dfe0a2a6ac4 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081812 Jun 10 18:27:41.358902 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2987/5926] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:27:41 2022] GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:27:41.542040 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:27:41.830953 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d0354553-1a07-43f5-b776-d47cdf3e4fb4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "DELETE /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f" status: 204 len: 0 microversion: 2.1 time: 0.732178 Jun 10 18:27:41.831973 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2940/5927] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:27:41 2022] DELETE /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f => generated 0 bytes in 734 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:27:41.841947 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-700c1192-c4d8-4546-b96e-379b39dd8b3c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:41.842950 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-700c1192-c4d8-4546-b96e-379b39dd8b3c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 3f397ccc-6368-4b37-82bb-12910169404f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:41.852534 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-700c1192-c4d8-4546-b96e-379b39dd8b3c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:41.857343 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-700c1192-c4d8-4546-b96e-379b39dd8b3c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:41.858384 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-700c1192-c4d8-4546-b96e-379b39dd8b3c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:41.858991 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-700c1192-c4d8-4546-b96e-379b39dd8b3c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:42.105581 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-700c1192-c4d8-4546-b96e-379b39dd8b3c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:42.130508 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-700c1192-c4d8-4546-b96e-379b39dd8b3c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f" status: 200 len: 1495 microversion: 2.1 time: 0.293198 Jun 10 18:27:42.138082 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2988/5928] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:41 2022] GET /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f => generated 1495 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:42.386350 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dc87ec45-d3fa-473f-a2a6-74b4d66d0127 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:42.387416 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dc87ec45-d3fa-473f-a2a6-74b4d66d0127 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:42.441263 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc87ec45-d3fa-473f-a2a6-74b4d66d0127 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:42.441730 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc87ec45-d3fa-473f-a2a6-74b4d66d0127 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:42.442527 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc87ec45-d3fa-473f-a2a6-74b4d66d0127 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:42.442973 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc87ec45-d3fa-473f-a2a6-74b4d66d0127 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:42.515533 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dc87ec45-d3fa-473f-a2a6-74b4d66d0127 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148810 Jun 10 18:27:42.520168 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2941/5929] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:27:42 2022] GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:27:43.156923 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f38c44da-0654-4d9b-af2e-0e0a3b9b6ac0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:43.165242 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f38c44da-0654-4d9b-af2e-0e0a3b9b6ac0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 3f397ccc-6368-4b37-82bb-12910169404f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:43.170456 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f38c44da-0654-4d9b-af2e-0e0a3b9b6ac0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:43.171168 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f38c44da-0654-4d9b-af2e-0e0a3b9b6ac0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:43.172195 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f38c44da-0654-4d9b-af2e-0e0a3b9b6ac0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:43.173919 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f38c44da-0654-4d9b-af2e-0e0a3b9b6ac0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:43.533121 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5ae78d84-277a-478b-94ea-aae4e7f46790 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:43.534136 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5ae78d84-277a-478b-94ea-aae4e7f46790 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:43.544874 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f38c44da-0654-4d9b-af2e-0e0a3b9b6ac0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:43.551663 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ae78d84-277a-478b-94ea-aae4e7f46790 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:43.552375 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ae78d84-277a-478b-94ea-aae4e7f46790 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:43.553366 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ae78d84-277a-478b-94ea-aae4e7f46790 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:43.554492 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ae78d84-277a-478b-94ea-aae4e7f46790 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:43.575088 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f38c44da-0654-4d9b-af2e-0e0a3b9b6ac0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f" status: 200 len: 1495 microversion: 2.1 time: 0.424695 Jun 10 18:27:43.575704 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2989/5930] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:43 2022] GET /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f => generated 1495 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:43.653362 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5ae78d84-277a-478b-94ea-aae4e7f46790 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126292 Jun 10 18:27:43.655473 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2942/5931] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:27:43 2022] GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:27:44.595624 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-946fcd39-a554-49c0-b28b-212bff538915 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:44.596251 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-946fcd39-a554-49c0-b28b-212bff538915 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 3f397ccc-6368-4b37-82bb-12910169404f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:44.622795 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-946fcd39-a554-49c0-b28b-212bff538915 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:44.623269 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-946fcd39-a554-49c0-b28b-212bff538915 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:44.624078 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-946fcd39-a554-49c0-b28b-212bff538915 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:44.624550 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-946fcd39-a554-49c0-b28b-212bff538915 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:44.670584 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fbb0e523-4f7f-4069-b0e8-4394d7113476 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:44.688955 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fbb0e523-4f7f-4069-b0e8-4394d7113476 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:44.698191 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fbb0e523-4f7f-4069-b0e8-4394d7113476 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:44.698712 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fbb0e523-4f7f-4069-b0e8-4394d7113476 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:44.699546 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fbb0e523-4f7f-4069-b0e8-4394d7113476 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:44.705778 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fbb0e523-4f7f-4069-b0e8-4394d7113476 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:44.823697 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fbb0e523-4f7f-4069-b0e8-4394d7113476 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.150414 Jun 10 18:27:44.827083 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2943/5932] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:27:44 2022] GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:27:44.834918 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-51a8391b-3aa4-4248-ba56-59281998d0e5 req-a3381a20-d0b1-46ac-b70d-bbfb88d660d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f397ccc-6368-4b37-82bb-12910169404f", "name": "network-vif-deleted", "tag": "72d26e0e-bad5-41e5-bbd7-940808b1dba8"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:27:44.856259 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-51a8391b-3aa4-4248-ba56-59281998d0e5 req-a3381a20-d0b1-46ac-b70d-bbfb88d660d7 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:44.860223 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-51a8391b-3aa4-4248-ba56-59281998d0e5 req-a3381a20-d0b1-46ac-b70d-bbfb88d660d7 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:44.886620 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-946fcd39-a554-49c0-b28b-212bff538915 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:44.924926 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-51a8391b-3aa4-4248-ba56-59281998d0e5 req-a3381a20-d0b1-46ac-b70d-bbfb88d660d7 service nova] Creating event network-vif-deleted:72d26e0e-bad5-41e5-bbd7-940808b1dba8 for instance 3f397ccc-6368-4b37-82bb-12910169404f on chh2-master-2 Jun 10 18:27:44.936982 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-51a8391b-3aa4-4248-ba56-59281998d0e5 req-a3381a20-d0b1-46ac-b70d-bbfb88d660d7 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108194 Jun 10 18:27:44.958633 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2944/5933] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:27:44.982132 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-946fcd39-a554-49c0-b28b-212bff538915 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f" status: 200 len: 1453 microversion: 2.1 time: 0.390733 Jun 10 18:27:44.995352 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2990/5934] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:44 2022] GET /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f => generated 1453 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:45.839722 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9f23c979-78aa-4ad0-926b-eaf8b8cb128d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:45.843912 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9f23c979-78aa-4ad0-926b-eaf8b8cb128d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:45.871190 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f23c979-78aa-4ad0-926b-eaf8b8cb128d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:45.872057 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f23c979-78aa-4ad0-926b-eaf8b8cb128d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:45.877964 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f23c979-78aa-4ad0-926b-eaf8b8cb128d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:45.877964 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f23c979-78aa-4ad0-926b-eaf8b8cb128d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:45.910769 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9f23c979-78aa-4ad0-926b-eaf8b8cb128d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079198 Jun 10 18:27:45.911985 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2945/5935] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:27:45 2022] GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:27:46.010585 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f568e6ad-1b62-4550-bfa1-f5460b05b164 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:46.012031 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f568e6ad-1b62-4550-bfa1-f5460b05b164 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 3f397ccc-6368-4b37-82bb-12910169404f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:46.029824 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f568e6ad-1b62-4550-bfa1-f5460b05b164 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:46.030294 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f568e6ad-1b62-4550-bfa1-f5460b05b164 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:46.031187 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f568e6ad-1b62-4550-bfa1-f5460b05b164 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:46.031697 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f568e6ad-1b62-4550-bfa1-f5460b05b164 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:46.118889 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f568e6ad-1b62-4550-bfa1-f5460b05b164 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:46.119696 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f568e6ad-1b62-4550-bfa1-f5460b05b164 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:46.120631 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-f568e6ad-1b62-4550-bfa1-f5460b05b164 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lazy-loading 'fault' on Instance uuid 3f397ccc-6368-4b37-82bb-12910169404f {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:27:46.128021 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:27:46.235249 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f568e6ad-1b62-4550-bfa1-f5460b05b164 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:46.245985 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f568e6ad-1b62-4550-bfa1-f5460b05b164 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f" status: 200 len: 1299 microversion: 2.1 time: 0.242253 Jun 10 18:27:46.262462 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2991/5936] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:46 2022] GET /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f => generated 1299 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:46.922310 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-30d2e442-157d-4d94-b991-8d1e0b8fa4c4 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:46.924365 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-30d2e442-157d-4d94-b991-8d1e0b8fa4c4 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:46.942115 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30d2e442-157d-4d94-b991-8d1e0b8fa4c4 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:46.943373 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30d2e442-157d-4d94-b991-8d1e0b8fa4c4 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:46.947363 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30d2e442-157d-4d94-b991-8d1e0b8fa4c4 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:46.948877 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30d2e442-157d-4d94-b991-8d1e0b8fa4c4 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:47.027263 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-30d2e442-157d-4d94-b991-8d1e0b8fa4c4 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108719 Jun 10 18:27:47.032661 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2946/5937] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:27:46 2022] GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:27:47.271957 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c5d3ece6-bdce-4a13-8845-4c09ada6d490 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:47.273190 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c5d3ece6-bdce-4a13-8845-4c09ada6d490 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 3f397ccc-6368-4b37-82bb-12910169404f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:47.352196 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5d3ece6-bdce-4a13-8845-4c09ada6d490 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:47.352708 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5d3ece6-bdce-4a13-8845-4c09ada6d490 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:47.353560 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5d3ece6-bdce-4a13-8845-4c09ada6d490 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:47.354013 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5d3ece6-bdce-4a13-8845-4c09ada6d490 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:47.426402 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-c5d3ece6-bdce-4a13-8845-4c09ada6d490 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] HTTP exception thrown: Instance 3f397ccc-6368-4b37-82bb-12910169404f could not be found. Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c5d3ece6-bdce-4a13-8845-4c09ada6d490 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Request method failure captured: Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f HTTP/1.1 Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4ylUNGY8VKO5jLVY6McXmkU53BpB453bvCKmrvaQGLJAZV-lieSSXu8nUaF6yxU0RZxSma5kvfEU2IFgDObEl38j4CHosWLE8jUTpbhfPjW3XqChWMzwgLKa4BS5Yox1cN_jUzeYnin3TOSxn98enTacAe1cvDVZ2oUSAgL46qFPsc Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ded497d3d91b4e22bc2daa72d6f75d18", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersTestJSON-1873283063 Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersTestJSON-1873283063-project Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: d37f560237d9489e96ddee21d9f5e6c6 Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersTestJSON-1873283063-project Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 3f397ccc-6368-4b37-82bb-12910169404f could not be found. Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '3f397ccc-6368-4b37-82bb-12910169404f'} Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f397ccc-6368-4b37-82bb-12910169404f could not be found. Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f397ccc-6368-4b37-82bb-12910169404f could not be found. Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:27:47.431652 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:27:47.436433 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:27:47.436433 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:27:47.436433 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:27:47.436433 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:27:47.436433 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f397ccc-6368-4b37-82bb-12910169404f could not be found. Jun 10 18:27:47.436433 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:27:47.436433 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c5d3ece6-bdce-4a13-8845-4c09ada6d490 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Returning 404 to user: Instance 3f397ccc-6368-4b37-82bb-12910169404f could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:27:47.440640 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c5d3ece6-bdce-4a13-8845-4c09ada6d490 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f" status: 404 len: 111 microversion: 2.1 time: 0.173575 Jun 10 18:27:47.445343 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2992/5938] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:47 2022] GET /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:27:47.450327 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3f34a793-03e8-4c20-a5ac-a9d6235a7788 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:47.452566 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3f34a793-03e8-4c20-a5ac-a9d6235a7788 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 607be5b9-5b8b-4d26-ad0b-15cb39df1e06] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:47.462067 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3f34a793-03e8-4c20-a5ac-a9d6235a7788 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:47.466180 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3f34a793-03e8-4c20-a5ac-a9d6235a7788 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:47.471575 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3f34a793-03e8-4c20-a5ac-a9d6235a7788 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:47.472163 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3f34a793-03e8-4c20-a5ac-a9d6235a7788 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:47.544980 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3f34a793-03e8-4c20-a5ac-a9d6235a7788 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 607be5b9-5b8b-4d26-ad0b-15cb39df1e06] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:27:47.964403 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3f34a793-03e8-4c20-a5ac-a9d6235a7788 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "DELETE /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06" status: 204 len: 0 microversion: 2.1 time: 0.511541 Jun 10 18:27:47.964403 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2947/5939] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:27:47 2022] DELETE /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 18:27:47.971350 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a939fb4a-0419-46fc-97ff-cb75c914002a tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:47.972239 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a939fb4a-0419-46fc-97ff-cb75c914002a tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 607be5b9-5b8b-4d26-ad0b-15cb39df1e06] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:47.980052 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a939fb4a-0419-46fc-97ff-cb75c914002a tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:47.980857 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a939fb4a-0419-46fc-97ff-cb75c914002a tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:47.982088 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a939fb4a-0419-46fc-97ff-cb75c914002a tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:47.982817 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a939fb4a-0419-46fc-97ff-cb75c914002a tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:48.043796 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-95e6e1f9-1622-413b-a563-9f2c5fb29905 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:48.045196 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-95e6e1f9-1622-413b-a563-9f2c5fb29905 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:48.062625 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-95e6e1f9-1622-413b-a563-9f2c5fb29905 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:48.063458 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-95e6e1f9-1622-413b-a563-9f2c5fb29905 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:48.064530 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-95e6e1f9-1622-413b-a563-9f2c5fb29905 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:48.065250 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-95e6e1f9-1622-413b-a563-9f2c5fb29905 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:48.156705 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-95e6e1f9-1622-413b-a563-9f2c5fb29905 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122057 Jun 10 18:27:48.157986 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2948/5940] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:27:48 2022] GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:27:48.294823 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a939fb4a-0419-46fc-97ff-cb75c914002a tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:48.323572 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a939fb4a-0419-46fc-97ff-cb75c914002a tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06" status: 200 len: 1495 microversion: 2.1 time: 0.356820 Jun 10 18:27:48.337233 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2993/5941] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:47 2022] GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06 => generated 1495 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:49.169492 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ee5cc5b1-a5f1-4ec5-b1b8-e7a6ca70e275 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:49.171206 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ee5cc5b1-a5f1-4ec5-b1b8-e7a6ca70e275 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:49.185884 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee5cc5b1-a5f1-4ec5-b1b8-e7a6ca70e275 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:49.194632 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee5cc5b1-a5f1-4ec5-b1b8-e7a6ca70e275 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:49.194632 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee5cc5b1-a5f1-4ec5-b1b8-e7a6ca70e275 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:49.194632 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee5cc5b1-a5f1-4ec5-b1b8-e7a6ca70e275 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:49.313155 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ee5cc5b1-a5f1-4ec5-b1b8-e7a6ca70e275 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147440 Jun 10 18:27:49.316652 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2949/5942] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:27:49 2022] GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:27:49.344587 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-07e33a29-27f5-430a-920f-82aaac1059a4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:49.345212 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-07e33a29-27f5-430a-920f-82aaac1059a4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 607be5b9-5b8b-4d26-ad0b-15cb39df1e06] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:49.375116 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-07e33a29-27f5-430a-920f-82aaac1059a4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:49.375593 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-07e33a29-27f5-430a-920f-82aaac1059a4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:49.380591 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-07e33a29-27f5-430a-920f-82aaac1059a4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:49.385957 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-07e33a29-27f5-430a-920f-82aaac1059a4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:50.098248 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-07e33a29-27f5-430a-920f-82aaac1059a4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:50.111349 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-07e33a29-27f5-430a-920f-82aaac1059a4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06" status: 200 len: 1495 microversion: 2.1 time: 0.768030 Jun 10 18:27:50.112514 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2994/5943] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:49 2022] GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06 => generated 1495 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:50.135159 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b7d0be79-6bf3-4cf4-9ce6-e913160d9aa8 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Action: 'create', calling method: .version_select at 0x7f77c613ed30>, body: {"keypair": {"name": "tempest-keypair-1557638046", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD54OPoXaG1dVqi5N3UCuRx1t4FIWHCqlsRVnY2e0LABeOzbkVsQe1qdzJknBFx9KkQCTt5Pr7jTAywmA1bhpCmnIM0lAGGyMPzeAFvkYhBntSm9/cGgfaZsM+1KyPKcXQ=="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:27:50.156791 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-b7d0be79-6bf3-4cf4-9ce6-e913160d9aa8 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Getting quotas for project 1be5a72204b8483590ce13d50170b117. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:27:50.165369 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-b7d0be79-6bf3-4cf4-9ce6-e913160d9aa8 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Getting quotas for user fe74aba3932c467e8124a888867d2112 and project 1be5a72204b8483590ce13d50170b117. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:27:50.275682 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b7d0be79-6bf3-4cf4-9ce6-e913160d9aa8 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.298252 Jun 10 18:27:50.282841 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2950/5944] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 18:27:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:27:50.325240 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-386b6f60-3e08-4cd8-b300-a924c130a79d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:50.327407 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-386b6f60-3e08-4cd8-b300-a924c130a79d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:50.344244 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-386b6f60-3e08-4cd8-b300-a924c130a79d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:50.344754 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-386b6f60-3e08-4cd8-b300-a924c130a79d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:50.345550 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-386b6f60-3e08-4cd8-b300-a924c130a79d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:50.345993 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-386b6f60-3e08-4cd8-b300-a924c130a79d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:50.493861 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-386b6f60-3e08-4cd8-b300-a924c130a79d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.172646 Jun 10 18:27:50.513985 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2995/5945] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:27:50 2022] GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2/os-volume_attachments => generated 197 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:27:51.131645 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f92575b9-6c06-4d20-a150-ad4ab3863a55 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:51.132747 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f92575b9-6c06-4d20-a150-ad4ab3863a55 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 607be5b9-5b8b-4d26-ad0b-15cb39df1e06] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:51.157433 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f92575b9-6c06-4d20-a150-ad4ab3863a55 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:51.159114 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f92575b9-6c06-4d20-a150-ad4ab3863a55 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:51.161639 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f92575b9-6c06-4d20-a150-ad4ab3863a55 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:51.164351 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f92575b9-6c06-4d20-a150-ad4ab3863a55 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:51.253280 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-4450df95-8cce-4f40-97ac-76c2dd791b23 req-907e2fed-25cb-43e2-91ad-db733ca7515a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "607be5b9-5b8b-4d26-ad0b-15cb39df1e06", "name": "network-vif-deleted", "tag": "3a26c571-b577-4fe1-9e24-71b4ef692562"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:27:51.277458 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-4450df95-8cce-4f40-97ac-76c2dd791b23 req-907e2fed-25cb-43e2-91ad-db733ca7515a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:51.277924 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-4450df95-8cce-4f40-97ac-76c2dd791b23 req-907e2fed-25cb-43e2-91ad-db733ca7515a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:51.361587 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-4450df95-8cce-4f40-97ac-76c2dd791b23 req-907e2fed-25cb-43e2-91ad-db733ca7515a service nova] Creating event network-vif-deleted:3a26c571-b577-4fe1-9e24-71b4ef692562 for instance 607be5b9-5b8b-4d26-ad0b-15cb39df1e06 on chh1-master-2 Jun 10 18:27:51.391412 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-4450df95-8cce-4f40-97ac-76c2dd791b23 req-907e2fed-25cb-43e2-91ad-db733ca7515a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140328 Jun 10 18:27:51.392255 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2996/5946] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:27:51.439018 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f92575b9-6c06-4d20-a150-ad4ab3863a55 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:51.466436 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f92575b9-6c06-4d20-a150-ad4ab3863a55 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06" status: 200 len: 1453 microversion: 2.1 time: 0.334499 Jun 10 18:27:51.481948 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2951/5947] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:51 2022] GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06 => generated 1453 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:51.515271 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-99ebb0a8-5a55-4c83-8bc9-458155b8adad tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:51.516358 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-99ebb0a8-5a55-4c83-8bc9-458155b8adad tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:51.538272 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-99ebb0a8-5a55-4c83-8bc9-458155b8adad tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:51.538737 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-99ebb0a8-5a55-4c83-8bc9-458155b8adad tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:51.539543 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-99ebb0a8-5a55-4c83-8bc9-458155b8adad tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:51.539994 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-99ebb0a8-5a55-4c83-8bc9-458155b8adad tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:51.612064 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-99ebb0a8-5a55-4c83-8bc9-458155b8adad tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108078 Jun 10 18:27:51.613394 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2997/5948] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:27:51 2022] GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:27:52.504838 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-97a36f52-6d59-4792-bdec-5a697d1b4895 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:52.505689 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-97a36f52-6d59-4792-bdec-5a697d1b4895 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 607be5b9-5b8b-4d26-ad0b-15cb39df1e06] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:52.538000 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-97a36f52-6d59-4792-bdec-5a697d1b4895 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:52.540546 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-97a36f52-6d59-4792-bdec-5a697d1b4895 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:52.542383 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-97a36f52-6d59-4792-bdec-5a697d1b4895 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:52.545144 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-97a36f52-6d59-4792-bdec-5a697d1b4895 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:52.629263 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e7fe8559-19f5-40ff-8854-653473e1ade4 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:52.631522 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e7fe8559-19f5-40ff-8854-653473e1ade4 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:52.647612 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7fe8559-19f5-40ff-8854-653473e1ade4 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:52.648359 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7fe8559-19f5-40ff-8854-653473e1ade4 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:52.650535 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7fe8559-19f5-40ff-8854-653473e1ade4 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:52.651324 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e7fe8559-19f5-40ff-8854-653473e1ade4 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:52.710991 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-97a36f52-6d59-4792-bdec-5a697d1b4895 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:52.712078 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-97a36f52-6d59-4792-bdec-5a697d1b4895 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:52.714589 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-97a36f52-6d59-4792-bdec-5a697d1b4895 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lazy-loading 'fault' on Instance uuid 607be5b9-5b8b-4d26-ad0b-15cb39df1e06 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:27:52.744557 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e7fe8559-19f5-40ff-8854-653473e1ade4 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.123033 Jun 10 18:27:52.745824 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2998/5949] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:27:52 2022] GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2/os-volume_attachments => generated 25 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:27:52.882971 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3b0bf1a1-2278-4190-9924-4fd90ad16068 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:52.882971 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3b0bf1a1-2278-4190-9924-4fd90ad16068 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:52.890364 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3b0bf1a1-2278-4190-9924-4fd90ad16068 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:52.890830 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3b0bf1a1-2278-4190-9924-4fd90ad16068 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:52.891635 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3b0bf1a1-2278-4190-9924-4fd90ad16068 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:52.898876 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3b0bf1a1-2278-4190-9924-4fd90ad16068 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:52.901470 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-97a36f52-6d59-4792-bdec-5a697d1b4895 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:52.910728 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-97a36f52-6d59-4792-bdec-5a697d1b4895 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06" status: 200 len: 1299 microversion: 2.1 time: 0.432635 Jun 10 18:27:52.932484 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2952/5950] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:52 2022] GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06 => generated 1299 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:53.001611 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3b0bf1a1-2278-4190-9924-4fd90ad16068 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:27:53.511345 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3b0bf1a1-2278-4190-9924-4fd90ad16068 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "DELETE /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2" status: 204 len: 0 microversion: 2.1 time: 0.632963 Jun 10 18:27:53.515358 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 2999/5951] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:27:52 2022] DELETE /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:27:53.520722 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0c38e582-8fdd-4b11-92ed-b733b92eb3ec tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:53.521433 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0c38e582-8fdd-4b11-92ed-b733b92eb3ec tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:53.536075 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0c38e582-8fdd-4b11-92ed-b733b92eb3ec tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:53.537784 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0c38e582-8fdd-4b11-92ed-b733b92eb3ec tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:53.538607 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0c38e582-8fdd-4b11-92ed-b733b92eb3ec tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:53.539059 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0c38e582-8fdd-4b11-92ed-b733b92eb3ec tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:53.876574 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0c38e582-8fdd-4b11-92ed-b733b92eb3ec tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:53.882003 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0c38e582-8fdd-4b11-92ed-b733b92eb3ec tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2" status: 200 len: 1683 microversion: 2.1 time: 0.365098 Jun 10 18:27:53.893172 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2953/5952] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:53 2022] GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2 => generated 1683 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:53.934225 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-61382eb2-149a-4051-9a2f-a27df305a652 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:53.935021 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-61382eb2-149a-4051-9a2f-a27df305a652 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 607be5b9-5b8b-4d26-ad0b-15cb39df1e06] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:53.948453 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-61382eb2-149a-4051-9a2f-a27df305a652 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:53.950562 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-61382eb2-149a-4051-9a2f-a27df305a652 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:53.952265 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-61382eb2-149a-4051-9a2f-a27df305a652 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:53.952833 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-61382eb2-149a-4051-9a2f-a27df305a652 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:54.039463 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-61382eb2-149a-4051-9a2f-a27df305a652 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] HTTP exception thrown: Instance 607be5b9-5b8b-4d26-ad0b-15cb39df1e06 could not be found. Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-61382eb2-149a-4051-9a2f-a27df305a652 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Request method failure captured: Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06 HTTP/1.1 Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4ylUNGY8VKO5jLVY6McXmkU53BpB453bvCKmrvaQGLJAZV-lieSSXu8nUaF6yxU0RZxSma5kvfEU2IFgDObEl38j4CHosWLE8jUTpbhfPjW3XqChWMzwgLKa4BS5Yox1cN_jUzeYnin3TOSxn98enTacAe1cvDVZ2oUSAgL46qFPsc Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ded497d3d91b4e22bc2daa72d6f75d18", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersTestJSON-1873283063 Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersTestJSON-1873283063-project Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: d37f560237d9489e96ddee21d9f5e6c6 Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersTestJSON-1873283063-project Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 607be5b9-5b8b-4d26-ad0b-15cb39df1e06 could not be found. Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '607be5b9-5b8b-4d26-ad0b-15cb39df1e06'} Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 607be5b9-5b8b-4d26-ad0b-15cb39df1e06 could not be found. Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 607be5b9-5b8b-4d26-ad0b-15cb39df1e06 could not be found. Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:27:54.049257 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:27:54.054334 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:27:54.054334 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:27:54.054334 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:27:54.054334 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:27:54.054334 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 607be5b9-5b8b-4d26-ad0b-15cb39df1e06 could not be found. Jun 10 18:27:54.054334 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:27:54.054334 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-61382eb2-149a-4051-9a2f-a27df305a652 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Returning 404 to user: Instance 607be5b9-5b8b-4d26-ad0b-15cb39df1e06 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:27:54.054334 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-61382eb2-149a-4051-9a2f-a27df305a652 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06" status: 404 len: 111 microversion: 2.1 time: 0.119478 Jun 10 18:27:54.058433 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3000/5953] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:53 2022] GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:27:54.359192 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-aa5b230e-4a24-47af-9cd3-f95714b734d8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-425270551", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "940d65ec-437e-4f98-a601-e2ba4906c363"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:27:54.437005 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-aa5b230e-4a24-47af-9cd3-f95714b734d8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] validate_networks() for [('940d65ec-437e-4f98-a601-e2ba4906c363', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:27:54.901264 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5245decc-d0c1-4e2c-908d-e546f5e85e91 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:54.902126 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5245decc-d0c1-4e2c-908d-e546f5e85e91 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:54.913876 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5245decc-d0c1-4e2c-908d-e546f5e85e91 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:54.918620 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5245decc-d0c1-4e2c-908d-e546f5e85e91 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:54.921477 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5245decc-d0c1-4e2c-908d-e546f5e85e91 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:54.922154 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5245decc-d0c1-4e2c-908d-e546f5e85e91 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:55.733979 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-aa5b230e-4a24-47af-9cd3-f95714b734d8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:27:55.734474 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-aa5b230e-4a24-47af-9cd3-f95714b734d8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:27:55.735270 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-aa5b230e-4a24-47af-9cd3-f95714b734d8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:27:55.735643 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-aa5b230e-4a24-47af-9cd3-f95714b734d8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:27:55.736238 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-aa5b230e-4a24-47af-9cd3-f95714b734d8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:27:55.751448 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aa5b230e-4a24-47af-9cd3-f95714b734d8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:55.752008 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aa5b230e-4a24-47af-9cd3-f95714b734d8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:55.762039 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aa5b230e-4a24-47af-9cd3-f95714b734d8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:55.763908 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aa5b230e-4a24-47af-9cd3-f95714b734d8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:55.801022 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-aa5b230e-4a24-47af-9cd3-f95714b734d8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Getting quotas for project ded497d3d91b4e22bc2daa72d6f75d18. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:27:55.824023 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-aa5b230e-4a24-47af-9cd3-f95714b734d8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Getting quotas for user d37f560237d9489e96ddee21d9f5e6c6 and project ded497d3d91b4e22bc2daa72d6f75d18. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:27:55.854339 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-aa5b230e-4a24-47af-9cd3-f95714b734d8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:27:55.874681 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-aa5b230e-4a24-47af-9cd3-f95714b734d8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 1eed2a2f-ea96-4f65-a5d8-3f9e07141143] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:27:56.122281 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-aa5b230e-4a24-47af-9cd3-f95714b734d8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.766250 Jun 10 18:27:56.130150 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2954/5954] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:27:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:27:56.142350 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-272644a0-a38d-4743-941f-1f0ca1e566bc tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:56.143883 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-272644a0-a38d-4743-941f-1f0ca1e566bc tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 1eed2a2f-ea96-4f65-a5d8-3f9e07141143] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:56.375103 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5245decc-d0c1-4e2c-908d-e546f5e85e91 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:56.408230 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5245decc-d0c1-4e2c-908d-e546f5e85e91 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2" status: 200 len: 1683 microversion: 2.1 time: 1.511540 Jun 10 18:27:56.413472 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3001/5955] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:54 2022] GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2 => generated 1683 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:56.468611 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-230b884a-b093-423b-9eef-efdd56b8fecf tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-751406266", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "97962275-cf8f-4dae-870e-900cd0b861eb"}], "security_groups": [{"name": "tempest-securitygroup--399055807"}], "key_name": "tempest-keypair-1557638046", "user_data": "}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:27:56.655827 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-272644a0-a38d-4743-941f-1f0ca1e566bc tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:56.670180 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-272644a0-a38d-4743-941f-1f0ca1e566bc tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143" status: 200 len: 1208 microversion: 2.1 time: 0.538027 Jun 10 18:27:56.674951 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2955/5956] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:56 2022] GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143 => generated 1208 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:56.815186 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-230b884a-b093-423b-9eef-efdd56b8fecf tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] validate_networks() for [('97962275-cf8f-4dae-870e-900cd0b861eb', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:27:57.428376 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b21b3c89-1bbc-4c91-bd78-b898b17e2d51 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:57.428740 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b21b3c89-1bbc-4c91-bd78-b898b17e2d51 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:57.450048 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b21b3c89-1bbc-4c91-bd78-b898b17e2d51 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:57.450878 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b21b3c89-1bbc-4c91-bd78-b898b17e2d51 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:57.451968 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b21b3c89-1bbc-4c91-bd78-b898b17e2d51 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:57.453595 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b21b3c89-1bbc-4c91-bd78-b898b17e2d51 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:58.123589 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b21b3c89-1bbc-4c91-bd78-b898b17e2d51 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:58.131166 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b21b3c89-1bbc-4c91-bd78-b898b17e2d51 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2" status: 200 len: 1683 microversion: 2.1 time: 0.706315 Jun 10 18:27:58.131800 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2956/5957] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:57 2022] GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2 => generated 1683 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:58.143996 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bebcbf1f-2b6d-4d01-9af9-2f2699a1299f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:58.151584 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bebcbf1f-2b6d-4d01-9af9-2f2699a1299f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 1eed2a2f-ea96-4f65-a5d8-3f9e07141143] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:58.217581 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bebcbf1f-2b6d-4d01-9af9-2f2699a1299f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:58.218333 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bebcbf1f-2b6d-4d01-9af9-2f2699a1299f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:58.219307 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bebcbf1f-2b6d-4d01-9af9-2f2699a1299f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:58.219916 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bebcbf1f-2b6d-4d01-9af9-2f2699a1299f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:58.329810 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bebcbf1f-2b6d-4d01-9af9-2f2699a1299f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:58.341521 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bebcbf1f-2b6d-4d01-9af9-2f2699a1299f tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143" status: 200 len: 1212 microversion: 2.1 time: 0.204004 Jun 10 18:27:58.342127 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2957/5958] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:58 2022] GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143 => generated 1212 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:59.070676 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-230b884a-b093-423b-9eef-efdd56b8fecf tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:27:59.071875 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-230b884a-b093-423b-9eef-efdd56b8fecf tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:27:59.072550 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-230b884a-b093-423b-9eef-efdd56b8fecf tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:27:59.073159 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-230b884a-b093-423b-9eef-efdd56b8fecf tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:27:59.074021 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-230b884a-b093-423b-9eef-efdd56b8fecf tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:27:59.092625 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-230b884a-b093-423b-9eef-efdd56b8fecf tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:59.092625 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-230b884a-b093-423b-9eef-efdd56b8fecf tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:59.095387 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-230b884a-b093-423b-9eef-efdd56b8fecf tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:59.098645 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-230b884a-b093-423b-9eef-efdd56b8fecf tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:59.148051 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-230b884a-b093-423b-9eef-efdd56b8fecf tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Getting quotas for project 1be5a72204b8483590ce13d50170b117. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:27:59.150283 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4c76a1bd-ed5a-4a72-b880-5cb5fa6ab42f tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:59.150906 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4c76a1bd-ed5a-4a72-b880-5cb5fa6ab42f tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:59.156680 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-230b884a-b093-423b-9eef-efdd56b8fecf tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Getting quotas for user fe74aba3932c467e8124a888867d2112 and project 1be5a72204b8483590ce13d50170b117. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:27:59.174892 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4c76a1bd-ed5a-4a72-b880-5cb5fa6ab42f tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:59.175347 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4c76a1bd-ed5a-4a72-b880-5cb5fa6ab42f tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:59.184129 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4c76a1bd-ed5a-4a72-b880-5cb5fa6ab42f tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:59.184129 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4c76a1bd-ed5a-4a72-b880-5cb5fa6ab42f tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:59.226541 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-230b884a-b093-423b-9eef-efdd56b8fecf tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:27:59.230045 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-230b884a-b093-423b-9eef-efdd56b8fecf tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:27:59.231371 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:27:59.431731 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4c76a1bd-ed5a-4a72-b880-5cb5fa6ab42f tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:59.448498 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4c76a1bd-ed5a-4a72-b880-5cb5fa6ab42f tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2" status: 200 len: 1615 microversion: 2.1 time: 0.299574 Jun 10 18:27:59.464674 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2958/5959] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:59 2022] GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2 => generated 1615 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:27:59.471964 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ec99ab35-823a-420f-b977-a8c185bf1ec2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:59.477071 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ec99ab35-823a-420f-b977-a8c185bf1ec2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 1eed2a2f-ea96-4f65-a5d8-3f9e07141143] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:59.493554 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ec99ab35-823a-420f-b977-a8c185bf1ec2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:59.493554 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ec99ab35-823a-420f-b977-a8c185bf1ec2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:59.494281 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ec99ab35-823a-420f-b977-a8c185bf1ec2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:59.494965 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ec99ab35-823a-420f-b977-a8c185bf1ec2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:59.498542 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-230b884a-b093-423b-9eef-efdd56b8fecf tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.083689 Jun 10 18:27:59.506951 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3002/5960] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:27:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 3090 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:27:59.530323 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cce5c6df-2baa-4965-be62-ac915bbbdf5f tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:27:59.536815 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cce5c6df-2baa-4965-be62-ac915bbbdf5f tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:27:59.796592 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cce5c6df-2baa-4965-be62-ac915bbbdf5f tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:27:59.804290 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cce5c6df-2baa-4965-be62-ac915bbbdf5f tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1237 microversion: 2.1 time: 0.295866 Jun 10 18:27:59.809688 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3003/5961] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:59 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1237 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:27:59.840247 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-f09fe4df-facd-499f-846b-aac170ea9d69 req-642dc723-ce14-4c84-aa2e-261a7da8dfea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fa247cf-f328-4ddf-b72c-2cde38330ed2", "name": "network-vif-deleted", "tag": "886ad63d-8536-4a5b-9f2e-587adedcb8b4"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:27:59.878624 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-f09fe4df-facd-499f-846b-aac170ea9d69 req-642dc723-ce14-4c84-aa2e-261a7da8dfea service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:27:59.881720 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-f09fe4df-facd-499f-846b-aac170ea9d69 req-642dc723-ce14-4c84-aa2e-261a7da8dfea service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:27:59.910097 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-f09fe4df-facd-499f-846b-aac170ea9d69 req-642dc723-ce14-4c84-aa2e-261a7da8dfea service nova] Creating event network-vif-deleted:886ad63d-8536-4a5b-9f2e-587adedcb8b4 for instance 0fa247cf-f328-4ddf-b72c-2cde38330ed2 on chh2-master-2 Jun 10 18:27:59.932355 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-f09fe4df-facd-499f-846b-aac170ea9d69 req-642dc723-ce14-4c84-aa2e-261a7da8dfea service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115691 Jun 10 18:27:59.945517 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3004/5962] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:28:00.463702 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-002dabc8-ac03-4449-a923-8cab581100fa tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:00.464543 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-002dabc8-ac03-4449-a923-8cab581100fa tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:00.477467 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-002dabc8-ac03-4449-a923-8cab581100fa tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:00.483670 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-002dabc8-ac03-4449-a923-8cab581100fa tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:00.485141 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-002dabc8-ac03-4449-a923-8cab581100fa tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:00.485775 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-002dabc8-ac03-4449-a923-8cab581100fa tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:00.522193 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-002dabc8-ac03-4449-a923-8cab581100fa tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:00.522649 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-002dabc8-ac03-4449-a923-8cab581100fa tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:00.523283 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-002dabc8-ac03-4449-a923-8cab581100fa tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lazy-loading 'fault' on Instance uuid 0fa247cf-f328-4ddf-b72c-2cde38330ed2 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:28:00.575506 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ec99ab35-823a-420f-b977-a8c185bf1ec2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:00.587431 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-002dabc8-ac03-4449-a923-8cab581100fa tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:00.588614 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ec99ab35-823a-420f-b977-a8c185bf1ec2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143" status: 200 len: 1268 microversion: 2.1 time: 1.122269 Jun 10 18:28:00.588614 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2959/5963] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:27:59 2022] GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143 => generated 1268 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:00.604262 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-002dabc8-ac03-4449-a923-8cab581100fa tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2" status: 200 len: 1332 microversion: 2.1 time: 0.145022 Jun 10 18:28:00.605195 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3005/5964] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:00 2022] GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2 => generated 1332 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:28:00.825692 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bd6bdfd0-355d-4dea-b9e9-ab65fb7e67ad tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:00.826485 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bd6bdfd0-355d-4dea-b9e9-ab65fb7e67ad tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:00.828624 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:28:01.076246 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bd6bdfd0-355d-4dea-b9e9-ab65fb7e67ad tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:01.110173 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bd6bdfd0-355d-4dea-b9e9-ab65fb7e67ad tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1237 microversion: 2.1 time: 0.288926 Jun 10 18:28:01.115496 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2960/5965] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:00 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1237 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:01.607357 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-16420d13-e477-49d4-be69-126f9066c8d4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:01.609207 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-16420d13-e477-49d4-be69-126f9066c8d4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 1eed2a2f-ea96-4f65-a5d8-3f9e07141143] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:01.625262 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-799bb80d-8afc-460a-8a87-0f7e0ffacadc tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:01.626067 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-799bb80d-8afc-460a-8a87-0f7e0ffacadc tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:01.632663 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-16420d13-e477-49d4-be69-126f9066c8d4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:01.632663 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-16420d13-e477-49d4-be69-126f9066c8d4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:01.632663 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-16420d13-e477-49d4-be69-126f9066c8d4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:01.632663 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-16420d13-e477-49d4-be69-126f9066c8d4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:01.650133 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-799bb80d-8afc-460a-8a87-0f7e0ffacadc tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:01.653236 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-799bb80d-8afc-460a-8a87-0f7e0ffacadc tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:01.657975 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-799bb80d-8afc-460a-8a87-0f7e0ffacadc tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:01.658769 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-799bb80d-8afc-460a-8a87-0f7e0ffacadc tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:01.692585 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-799bb80d-8afc-460a-8a87-0f7e0ffacadc tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] HTTP exception thrown: Instance 0fa247cf-f328-4ddf-b72c-2cde38330ed2 could not be found. Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-799bb80d-8afc-460a-8a87-0f7e0ffacadc tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Request method failure captured: Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2 HTTP/1.1 Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4wSsTbdAR5Qo9IVKF2KTe64dpp06ye4z8lPOT4uRhY2Oz0KMxQpxmr8KJzvNSTZtUIPPEgN2R6-CfUmf8CTAhd_IkVIfk-LuHrtE7255OYmbmFD6LLNrB7dKdWnCpSm8e4XDxNvfMbtjLHwd4svP6YGpBpPTncT2KN4jK3q3Q7l5ew Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 886b72a54e9b4ee7aa3cc21da4145cbb Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-AttachVolumeNegativeTest-545911130 Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/886b72a54e9b4ee7aa3cc21da4145cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/886b72a54e9b4ee7aa3cc21da4145cbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/886b72a54e9b4ee7aa3cc21da4145cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_886b72a54e9b4ee7aa3cc21da4145cbb", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-AttachVolumeNegativeTest-545911130 Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 886b72a54e9b4ee7aa3cc21da4145cbb Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-545911130 Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-AttachVolumeNegativeTest-545911130-project Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: f62326a9deb140e891c07529dc021d11 Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-AttachVolumeNegativeTest-545911130-project Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 0fa247cf-f328-4ddf-b72c-2cde38330ed2 could not be found. Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '0fa247cf-f328-4ddf-b72c-2cde38330ed2'} Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fa247cf-f328-4ddf-b72c-2cde38330ed2 could not be found. Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fa247cf-f328-4ddf-b72c-2cde38330ed2 could not be found. Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:28:01.718026 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:28:01.723045 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:28:01.723045 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:28:01.723045 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:28:01.723045 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:28:01.723045 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:28:01.723045 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fa247cf-f328-4ddf-b72c-2cde38330ed2 could not be found. Jun 10 18:28:01.723045 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:28:01.723045 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-799bb80d-8afc-460a-8a87-0f7e0ffacadc tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Returning 404 to user: Instance 0fa247cf-f328-4ddf-b72c-2cde38330ed2 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:28:01.725290 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-799bb80d-8afc-460a-8a87-0f7e0ffacadc tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2" status: 404 len: 111 microversion: 2.1 time: 0.102808 Jun 10 18:28:01.728962 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2961/5966] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:01 2022] GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:28:01.749007 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e53748d8-35f8-48f2-9fc7-db15e502a308 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '.version_select at 0x7f77c0261280>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:01.824523 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-16420d13-e477-49d4-be69-126f9066c8d4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:01.837050 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-16420d13-e477-49d4-be69-126f9066c8d4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143" status: 200 len: 1266 microversion: 2.1 time: 0.235794 Jun 10 18:28:01.838853 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3006/5967] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:01 2022] GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143 => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:01.924267 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e53748d8-35f8-48f2-9fc7-db15e502a308 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1544651428" status: 202 len: 0 microversion: 2.1 time: 0.191030 Jun 10 18:28:01.926505 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2962/5968] 10.222.0.35 () {58 vars in 1220 bytes} [Fri Jun 10 18:28:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1544651428 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:28:02.132789 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-43d321f9-dada-45a1-bad2-44c31d347233 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:02.133433 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-43d321f9-dada-45a1-bad2-44c31d347233 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:02.145767 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-43d321f9-dada-45a1-bad2-44c31d347233 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:02.146334 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-43d321f9-dada-45a1-bad2-44c31d347233 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:02.147076 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-43d321f9-dada-45a1-bad2-44c31d347233 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:02.147524 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-43d321f9-dada-45a1-bad2-44c31d347233 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:02.477563 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-43d321f9-dada-45a1-bad2-44c31d347233 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:02.492537 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-43d321f9-dada-45a1-bad2-44c31d347233 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1233 microversion: 2.1 time: 0.364056 Jun 10 18:28:02.495226 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3007/5969] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:02 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1233 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:02.858977 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-484e759e-b805-4ab6-871c-4baf23b341e5 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:02.860952 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-484e759e-b805-4ab6-871c-4baf23b341e5 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 1eed2a2f-ea96-4f65-a5d8-3f9e07141143] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:02.879751 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-484e759e-b805-4ab6-871c-4baf23b341e5 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:02.886264 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-484e759e-b805-4ab6-871c-4baf23b341e5 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:02.890418 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-484e759e-b805-4ab6-871c-4baf23b341e5 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:02.894235 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-484e759e-b805-4ab6-871c-4baf23b341e5 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:03.324970 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-484e759e-b805-4ab6-871c-4baf23b341e5 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:03.337878 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-484e759e-b805-4ab6-871c-4baf23b341e5 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143" status: 200 len: 1308 microversion: 2.1 time: 0.482736 Jun 10 18:28:03.338722 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2963/5970] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:02 2022] GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143 => generated 1308 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:03.512147 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9b5bcb01-5495-4edd-beb8-1add90ee2b9d tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:03.513799 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9b5bcb01-5495-4edd-beb8-1add90ee2b9d tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:03.528264 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9b5bcb01-5495-4edd-beb8-1add90ee2b9d tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:03.528782 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9b5bcb01-5495-4edd-beb8-1add90ee2b9d tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:03.593883 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9b5bcb01-5495-4edd-beb8-1add90ee2b9d tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:03.595159 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9b5bcb01-5495-4edd-beb8-1add90ee2b9d tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.055s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:04.006779 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9b5bcb01-5495-4edd-beb8-1add90ee2b9d tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:04.037575 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9b5bcb01-5495-4edd-beb8-1add90ee2b9d tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1295 microversion: 2.1 time: 0.511483 Jun 10 18:28:04.038788 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3008/5971] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:03 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1295 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:04.355752 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-99e06b74-f99d-4595-8c13-ed1b079d9805 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:04.356401 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-99e06b74-f99d-4595-8c13-ed1b079d9805 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 1eed2a2f-ea96-4f65-a5d8-3f9e07141143] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:04.370247 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99e06b74-f99d-4595-8c13-ed1b079d9805 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:04.370893 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99e06b74-f99d-4595-8c13-ed1b079d9805 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:04.371983 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99e06b74-f99d-4595-8c13-ed1b079d9805 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:04.372636 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99e06b74-f99d-4595-8c13-ed1b079d9805 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:05.062115 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-17079ea3-db69-435b-9057-016959a2beb1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:05.062749 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-17079ea3-db69-435b-9057-016959a2beb1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:05.071425 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-17079ea3-db69-435b-9057-016959a2beb1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:05.072111 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-17079ea3-db69-435b-9057-016959a2beb1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:05.073195 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-17079ea3-db69-435b-9057-016959a2beb1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:05.073991 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-17079ea3-db69-435b-9057-016959a2beb1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:05.096096 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-99e06b74-f99d-4595-8c13-ed1b079d9805 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:05.104965 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-99e06b74-f99d-4595-8c13-ed1b079d9805 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143" status: 200 len: 1308 microversion: 2.1 time: 0.753107 Jun 10 18:28:05.108739 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2964/5972] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:04 2022] GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143 => generated 1308 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:05.424822 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-17079ea3-db69-435b-9057-016959a2beb1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:05.443713 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-17079ea3-db69-435b-9057-016959a2beb1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1295 microversion: 2.1 time: 0.390102 Jun 10 18:28:05.446602 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3009/5973] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:05 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1295 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:05.494394 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5554717f-efc6-4003-b63c-6b0483ef6abc tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Action: 'create', calling method: .version_select at 0x7f77c122e700>, body: {"keypair": {"name": "tempest-keypair-2114136018", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8Oyk8+3ECnQt709uUuvOy25ie+/PdfNn8Vvbup6jg0r4zm54a8sh4TqFmYPKJ2teE/D8X899gxjmodYe9ZYrRHpY0Oio3JZ3QqX2u/9UgNBzgvaMqumZLOOiIojWwdEA=="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:28:05.552600 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-5554717f-efc6-4003-b63c-6b0483ef6abc tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Getting quotas for project 886b72a54e9b4ee7aa3cc21da4145cbb. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:28:05.569076 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-5554717f-efc6-4003-b63c-6b0483ef6abc tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Getting quotas for user f62326a9deb140e891c07529dc021d11 and project 886b72a54e9b4ee7aa3cc21da4145cbb. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:28:05.668351 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5554717f-efc6-4003-b63c-6b0483ef6abc tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.177795 Jun 10 18:28:05.676415 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2965/5974] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 18:28:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:28:06.063667 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-231b0576-2b4a-4e70-b8fa-f5420b52fe50 req-2c82f027-cb11-4d99-b470-8b8bebc40392 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eed2a2f-ea96-4f65-a5d8-3f9e07141143", "tag": "193b4c11-2f62-4090-8db2-14d2b2bef527"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:28:06.080060 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-231b0576-2b4a-4e70-b8fa-f5420b52fe50 req-2c82f027-cb11-4d99-b470-8b8bebc40392 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:06.087152 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-231b0576-2b4a-4e70-b8fa-f5420b52fe50 req-2c82f027-cb11-4d99-b470-8b8bebc40392 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:06.125845 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2a2e7ce1-3511-4a7a-8234-3d7b1209e3ff tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:06.127011 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2a2e7ce1-3511-4a7a-8234-3d7b1209e3ff tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 1eed2a2f-ea96-4f65-a5d8-3f9e07141143] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:06.129392 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:28:06.129595 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-231b0576-2b4a-4e70-b8fa-f5420b52fe50 req-2c82f027-cb11-4d99-b470-8b8bebc40392 service nova] Creating event network-changed:193b4c11-2f62-4090-8db2-14d2b2bef527 for instance 1eed2a2f-ea96-4f65-a5d8-3f9e07141143 on chh1-master-2 Jun 10 18:28:06.138899 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-231b0576-2b4a-4e70-b8fa-f5420b52fe50 req-2c82f027-cb11-4d99-b470-8b8bebc40392 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078451 Jun 10 18:28:06.140298 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3010/5975] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:28:06.164044 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2a2e7ce1-3511-4a7a-8234-3d7b1209e3ff tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:06.164835 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2a2e7ce1-3511-4a7a-8234-3d7b1209e3ff tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:06.166325 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2a2e7ce1-3511-4a7a-8234-3d7b1209e3ff tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:06.166794 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2a2e7ce1-3511-4a7a-8234-3d7b1209e3ff tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:06.467815 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-15fbfb7a-ef7a-48f3-bd6c-3c7efcdbbb3e tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:06.468714 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-15fbfb7a-ef7a-48f3-bd6c-3c7efcdbbb3e tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:06.478907 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-15fbfb7a-ef7a-48f3-bd6c-3c7efcdbbb3e tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:06.492701 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-15fbfb7a-ef7a-48f3-bd6c-3c7efcdbbb3e tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:06.493586 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-15fbfb7a-ef7a-48f3-bd6c-3c7efcdbbb3e tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:06.494047 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-15fbfb7a-ef7a-48f3-bd6c-3c7efcdbbb3e tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:06.506748 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:28:06.684593 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2a2e7ce1-3511-4a7a-8234-3d7b1209e3ff tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:06.695110 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2a2e7ce1-3511-4a7a-8234-3d7b1209e3ff tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143" status: 200 len: 1308 microversion: 2.1 time: 0.573207 Jun 10 18:28:06.696591 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2966/5976] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:06 2022] GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143 => generated 1308 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:06.915372 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-15fbfb7a-ef7a-48f3-bd6c-3c7efcdbbb3e tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:06.927854 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-15fbfb7a-ef7a-48f3-bd6c-3c7efcdbbb3e tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1362 microversion: 2.1 time: 0.463742 Jun 10 18:28:06.931982 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3011/5977] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:06 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1362 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:07.535191 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-eed0eaff-b519-457d-bca5-6e4e842ec2ae req-7d7297d4-20fd-4752-9ff2-a2f1a9c7ba6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb7d7b12-56ec-43ab-8327-488874922d7d", "tag": "fa032014-1fbf-4fd8-a8f9-eae194d73659"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:28:07.554348 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-eed0eaff-b519-457d-bca5-6e4e842ec2ae req-7d7297d4-20fd-4752-9ff2-a2f1a9c7ba6b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:07.554815 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-eed0eaff-b519-457d-bca5-6e4e842ec2ae req-7d7297d4-20fd-4752-9ff2-a2f1a9c7ba6b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:07.572498 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-eed0eaff-b519-457d-bca5-6e4e842ec2ae req-7d7297d4-20fd-4752-9ff2-a2f1a9c7ba6b service nova] Creating event network-changed:fa032014-1fbf-4fd8-a8f9-eae194d73659 for instance eb7d7b12-56ec-43ab-8327-488874922d7d on chh2-master-2 Jun 10 18:28:07.578116 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-eed0eaff-b519-457d-bca5-6e4e842ec2ae req-7d7297d4-20fd-4752-9ff2-a2f1a9c7ba6b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047240 Jun 10 18:28:07.579233 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2967/5978] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:28:07.714596 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cc200363-dd44-48ec-b208-c6fd939fc530 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:07.715232 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cc200363-dd44-48ec-b208-c6fd939fc530 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 1eed2a2f-ea96-4f65-a5d8-3f9e07141143] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:07.740996 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cc200363-dd44-48ec-b208-c6fd939fc530 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:07.742722 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cc200363-dd44-48ec-b208-c6fd939fc530 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:07.746324 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cc200363-dd44-48ec-b208-c6fd939fc530 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:07.747119 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cc200363-dd44-48ec-b208-c6fd939fc530 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:07.950354 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-df4b69ca-ced1-4fa7-9809-a12781dcb0d6 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:07.951948 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-df4b69ca-ced1-4fa7-9809-a12781dcb0d6 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:07.964822 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df4b69ca-ced1-4fa7-9809-a12781dcb0d6 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:07.968459 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df4b69ca-ced1-4fa7-9809-a12781dcb0d6 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:07.968459 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df4b69ca-ced1-4fa7-9809-a12781dcb0d6 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:07.968459 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df4b69ca-ced1-4fa7-9809-a12781dcb0d6 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:08.105704 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cc200363-dd44-48ec-b208-c6fd939fc530 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:08.115472 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cc200363-dd44-48ec-b208-c6fd939fc530 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143" status: 200 len: 1308 microversion: 2.1 time: 0.405197 Jun 10 18:28:08.127058 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3012/5979] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:07 2022] GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143 => generated 1308 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:08.442551 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b26458e9-ef9c-4ce1-ba9c-9840c756a64a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-881957441", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "c8f8c9a4-e16a-4cc5-80db-f447244a8c18"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:28:08.538018 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-b26458e9-ef9c-4ce1-ba9c-9840c756a64a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] validate_networks() for [('c8f8c9a4-e16a-4cc5-80db-f447244a8c18', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:28:08.821823 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-df4b69ca-ced1-4fa7-9809-a12781dcb0d6 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:08.862315 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-df4b69ca-ced1-4fa7-9809-a12781dcb0d6 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1362 microversion: 2.1 time: 0.915128 Jun 10 18:28:08.867441 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2968/5980] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:07 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1362 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:09.120734 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:28:09.131896 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3dec343a-7274-488b-90a3-599dd161ee8e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:09.132657 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3dec343a-7274-488b-90a3-599dd161ee8e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 1eed2a2f-ea96-4f65-a5d8-3f9e07141143] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:09.141489 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3dec343a-7274-488b-90a3-599dd161ee8e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:09.144793 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3dec343a-7274-488b-90a3-599dd161ee8e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:09.148943 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3dec343a-7274-488b-90a3-599dd161ee8e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:09.149993 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3dec343a-7274-488b-90a3-599dd161ee8e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:09.764886 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3dec343a-7274-488b-90a3-599dd161ee8e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:09.777068 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3dec343a-7274-488b-90a3-599dd161ee8e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143" status: 200 len: 1308 microversion: 2.1 time: 0.648676 Jun 10 18:28:09.788896 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2969/5981] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:09 2022] GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143 => generated 1308 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:09.797935 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-b26458e9-ef9c-4ce1-ba9c-9840c756a64a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:28:09.798378 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-b26458e9-ef9c-4ce1-ba9c-9840c756a64a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:28:09.798869 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-b26458e9-ef9c-4ce1-ba9c-9840c756a64a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:28:09.799292 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-b26458e9-ef9c-4ce1-ba9c-9840c756a64a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:28:09.799721 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-b26458e9-ef9c-4ce1-ba9c-9840c756a64a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:28:09.804421 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=8 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:28:09.810024 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b26458e9-ef9c-4ce1-ba9c-9840c756a64a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:09.810489 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b26458e9-ef9c-4ce1-ba9c-9840c756a64a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:09.811302 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b26458e9-ef9c-4ce1-ba9c-9840c756a64a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:09.811943 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b26458e9-ef9c-4ce1-ba9c-9840c756a64a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:09.832210 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-b26458e9-ef9c-4ce1-ba9c-9840c756a64a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Getting quotas for project eec0f8b847fd40c5a87823996d0cb811. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:28:09.839251 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-b26458e9-ef9c-4ce1-ba9c-9840c756a64a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Getting quotas for user 7708b6c6945d486294f66e4feb39484d and project eec0f8b847fd40c5a87823996d0cb811. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:28:09.859583 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b26458e9-ef9c-4ce1-ba9c-9840c756a64a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:28:09.862483 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b26458e9-ef9c-4ce1-ba9c-9840c756a64a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: 16cde621-ad89-4ebd-b414-9c3c8b68b1d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:28:09.884816 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-27f2b8e7-a1d3-4856-aac9-9fced62ebb74 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:09.885493 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-27f2b8e7-a1d3-4856-aac9-9fced62ebb74 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:09.893966 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-27f2b8e7-a1d3-4856-aac9-9fced62ebb74 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:09.894421 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-27f2b8e7-a1d3-4856-aac9-9fced62ebb74 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:09.895226 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-27f2b8e7-a1d3-4856-aac9-9fced62ebb74 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:09.895668 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-27f2b8e7-a1d3-4856-aac9-9fced62ebb74 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:09.998765 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b26458e9-ef9c-4ce1-ba9c-9840c756a64a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.566663 Jun 10 18:28:09.999911 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3013/5982] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:28:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 10 18:28:10.010600 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b4da431c-99c4-444a-a837-beed3e2425d9 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:10.011623 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b4da431c-99c4-444a-a837-beed3e2425d9 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: 16cde621-ad89-4ebd-b414-9c3c8b68b1d1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:10.017508 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:28:10.111651 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b4da431c-99c4-444a-a837-beed3e2425d9 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7708b6c6945d486294f66e4feb39484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec0f8b847fd40c5a87823996d0cb811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:10.119314 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b4da431c-99c4-444a-a837-beed3e2425d9 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] 10.222.0.35 "GET /compute/v2.1/servers/16cde621-ad89-4ebd-b414-9c3c8b68b1d1" status: 200 len: 1213 microversion: 2.1 time: 0.112673 Jun 10 18:28:10.122724 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3014/5983] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:10 2022] GET /compute/v2.1/servers/16cde621-ad89-4ebd-b414-9c3c8b68b1d1 => generated 1213 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:28:10.382843 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-27f2b8e7-a1d3-4856-aac9-9fced62ebb74 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:10.391329 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-27f2b8e7-a1d3-4856-aac9-9fced62ebb74 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1362 microversion: 2.1 time: 0.511192 Jun 10 18:28:10.394914 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2970/5984] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:09 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1362 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:28:10.813488 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8309c9eb-3668-4e2b-98e0-457e7907e219 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:10.813488 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8309c9eb-3668-4e2b-98e0-457e7907e219 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 1eed2a2f-ea96-4f65-a5d8-3f9e07141143] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:10.813488 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8309c9eb-3668-4e2b-98e0-457e7907e219 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:10.813488 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8309c9eb-3668-4e2b-98e0-457e7907e219 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:10.813488 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8309c9eb-3668-4e2b-98e0-457e7907e219 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:10.813488 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8309c9eb-3668-4e2b-98e0-457e7907e219 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:11.062707 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8309c9eb-3668-4e2b-98e0-457e7907e219 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:11.087619 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8309c9eb-3668-4e2b-98e0-457e7907e219 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143" status: 200 len: 1308 microversion: 2.1 time: 0.296456 Jun 10 18:28:11.089933 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3015/5985] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:10 2022] GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143 => generated 1308 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:11.140665 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d6a1ec66-82ce-4c6b-89b4-e53c2f93b572 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:11.142110 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d6a1ec66-82ce-4c6b-89b4-e53c2f93b572 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: 16cde621-ad89-4ebd-b414-9c3c8b68b1d1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:11.235746 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d6a1ec66-82ce-4c6b-89b4-e53c2f93b572 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7708b6c6945d486294f66e4feb39484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec0f8b847fd40c5a87823996d0cb811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:11.238294 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=19 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:28:11.243753 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d6a1ec66-82ce-4c6b-89b4-e53c2f93b572 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] 10.222.0.35 "GET /compute/v2.1/servers/16cde621-ad89-4ebd-b414-9c3c8b68b1d1" status: 200 len: 1213 microversion: 2.1 time: 0.107020 Jun 10 18:28:11.244607 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2971/5986] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:11 2022] GET /compute/v2.1/servers/16cde621-ad89-4ebd-b414-9c3c8b68b1d1 => generated 1213 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:11.411693 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e965fc99-47da-4304-8f5e-4940d4e4202b tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:11.422540 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e965fc99-47da-4304-8f5e-4940d4e4202b tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:11.437578 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e965fc99-47da-4304-8f5e-4940d4e4202b tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:11.438046 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e965fc99-47da-4304-8f5e-4940d4e4202b tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:11.442064 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e965fc99-47da-4304-8f5e-4940d4e4202b tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:11.443492 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e965fc99-47da-4304-8f5e-4940d4e4202b tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:11.704888 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5e4514b6-c458-47c3-9bf3-2a770c3ea1ef tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1907572645", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bc4d74bc-8446-4d8c-a25b-248884836510"}], "security_groups": [{"name": "tempest-securitygroup--64474159"}], "key_name": "tempest-keypair-2114136018", "user_data": "}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:28:11.746751 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e965fc99-47da-4304-8f5e-4940d4e4202b tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:11.758829 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e965fc99-47da-4304-8f5e-4940d4e4202b tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1362 microversion: 2.1 time: 0.351676 Jun 10 18:28:11.764202 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3016/5987] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:11 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1362 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:11.952290 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-5e4514b6-c458-47c3-9bf3-2a770c3ea1ef tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] validate_networks() for [('bc4d74bc-8446-4d8c-a25b-248884836510', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:28:12.107120 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bb3b7acb-9588-425a-9ad8-5c1b3058e583 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:12.107751 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bb3b7acb-9588-425a-9ad8-5c1b3058e583 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 1eed2a2f-ea96-4f65-a5d8-3f9e07141143] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:12.124681 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bb3b7acb-9588-425a-9ad8-5c1b3058e583 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:12.125252 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bb3b7acb-9588-425a-9ad8-5c1b3058e583 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:12.126252 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bb3b7acb-9588-425a-9ad8-5c1b3058e583 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:12.126865 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bb3b7acb-9588-425a-9ad8-5c1b3058e583 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:12.306121 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bb3b7acb-9588-425a-9ad8-5c1b3058e583 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:12.316874 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bb3b7acb-9588-425a-9ad8-5c1b3058e583 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143" status: 200 len: 1308 microversion: 2.1 time: 0.213057 Jun 10 18:28:12.318102 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3017/5988] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:12 2022] GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143 => generated 1308 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:28:12.325271 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3065ce30-a55f-4ddd-9d01-5d6854373091 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:12.326356 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3065ce30-a55f-4ddd-9d01-5d6854373091 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: 16cde621-ad89-4ebd-b414-9c3c8b68b1d1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:12.333683 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3065ce30-a55f-4ddd-9d01-5d6854373091 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:12.334504 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3065ce30-a55f-4ddd-9d01-5d6854373091 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:12.335560 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3065ce30-a55f-4ddd-9d01-5d6854373091 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:12.336123 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3065ce30-a55f-4ddd-9d01-5d6854373091 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:12.587197 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3065ce30-a55f-4ddd-9d01-5d6854373091 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7708b6c6945d486294f66e4feb39484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec0f8b847fd40c5a87823996d0cb811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:12.635883 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3065ce30-a55f-4ddd-9d01-5d6854373091 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] 10.222.0.35 "GET /compute/v2.1/servers/16cde621-ad89-4ebd-b414-9c3c8b68b1d1" status: 200 len: 1209 microversion: 2.1 time: 0.292244 Jun 10 18:28:12.635883 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3018/5989] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:12 2022] GET /compute/v2.1/servers/16cde621-ad89-4ebd-b414-9c3c8b68b1d1 => generated 1209 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:12.714241 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-5e4514b6-c458-47c3-9bf3-2a770c3ea1ef tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:28:12.715956 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-5e4514b6-c458-47c3-9bf3-2a770c3ea1ef tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:28:12.716905 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-5e4514b6-c458-47c3-9bf3-2a770c3ea1ef tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:28:12.717493 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-5e4514b6-c458-47c3-9bf3-2a770c3ea1ef tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:28:12.718326 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-5e4514b6-c458-47c3-9bf3-2a770c3ea1ef tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:28:12.732800 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5e4514b6-c458-47c3-9bf3-2a770c3ea1ef tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:12.733742 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5e4514b6-c458-47c3-9bf3-2a770c3ea1ef tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:12.734969 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5e4514b6-c458-47c3-9bf3-2a770c3ea1ef tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:12.736056 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5e4514b6-c458-47c3-9bf3-2a770c3ea1ef tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:12.763242 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-5e4514b6-c458-47c3-9bf3-2a770c3ea1ef tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Getting quotas for project 886b72a54e9b4ee7aa3cc21da4145cbb. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:28:12.771434 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-5e4514b6-c458-47c3-9bf3-2a770c3ea1ef tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Getting quotas for user f62326a9deb140e891c07529dc021d11 and project 886b72a54e9b4ee7aa3cc21da4145cbb. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:28:12.780396 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cfeb6a2a-2db2-41a6-863b-4c0d944cc520 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:12.781097 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cfeb6a2a-2db2-41a6-863b-4c0d944cc520 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:12.790899 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cfeb6a2a-2db2-41a6-863b-4c0d944cc520 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:12.791358 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cfeb6a2a-2db2-41a6-863b-4c0d944cc520 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:12.792160 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cfeb6a2a-2db2-41a6-863b-4c0d944cc520 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:12.792634 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cfeb6a2a-2db2-41a6-863b-4c0d944cc520 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:12.794086 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5e4514b6-c458-47c3-9bf3-2a770c3ea1ef tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:28:12.797441 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5e4514b6-c458-47c3-9bf3-2a770c3ea1ef tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 1c741087-7c53-4118-8b3d-9654a4f6ff48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:28:12.953303 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5e4514b6-c458-47c3-9bf3-2a770c3ea1ef tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.252586 Jun 10 18:28:12.957295 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2972/5990] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:28:11 2022] POST /compute/v2.1/servers => generated 400 bytes in 1259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:28:12.967582 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d1156245-2291-4c7a-8e4b-7f065657705c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:12.968334 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d1156245-2291-4c7a-8e4b-7f065657705c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 1c741087-7c53-4118-8b3d-9654a4f6ff48] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:13.100649 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d1156245-2291-4c7a-8e4b-7f065657705c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:13.110216 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d1156245-2291-4c7a-8e4b-7f065657705c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48" status: 200 len: 1242 microversion: 2.1 time: 0.146563 Jun 10 18:28:13.111383 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2973/5991] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:12 2022] GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48 => generated 1242 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:28:13.334145 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8be86910-7c69-4e96-b65e-e3dccd8af1d8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:13.335332 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8be86910-7c69-4e96-b65e-e3dccd8af1d8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 1eed2a2f-ea96-4f65-a5d8-3f9e07141143] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:13.358066 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8be86910-7c69-4e96-b65e-e3dccd8af1d8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:13.360586 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8be86910-7c69-4e96-b65e-e3dccd8af1d8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:13.361681 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8be86910-7c69-4e96-b65e-e3dccd8af1d8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:13.362598 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8be86910-7c69-4e96-b65e-e3dccd8af1d8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:13.567107 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cfeb6a2a-2db2-41a6-863b-4c0d944cc520 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:13.582951 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cfeb6a2a-2db2-41a6-863b-4c0d944cc520 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1362 microversion: 2.1 time: 0.806856 Jun 10 18:28:13.600989 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3019/5992] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:12 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1362 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:28:13.625294 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8be86910-7c69-4e96-b65e-e3dccd8af1d8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:13.635344 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8be86910-7c69-4e96-b65e-e3dccd8af1d8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143" status: 200 len: 1308 microversion: 2.1 time: 0.303586 Jun 10 18:28:13.636764 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2974/5993] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:13 2022] GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143 => generated 1308 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:28:13.638664 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-85036443-b84a-4bde-931c-366770b7917a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:13.639578 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-85036443-b84a-4bde-931c-366770b7917a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: 16cde621-ad89-4ebd-b414-9c3c8b68b1d1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:13.653622 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-85036443-b84a-4bde-931c-366770b7917a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:13.654995 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-85036443-b84a-4bde-931c-366770b7917a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:13.657127 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-85036443-b84a-4bde-931c-366770b7917a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:13.660607 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-85036443-b84a-4bde-931c-366770b7917a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:13.725262 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-0c5915ef-8d54-4f58-b49b-88926053854a req-4d70d17e-7d81-48af-bdef-0fc3f72cc956 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eed2a2f-ea96-4f65-a5d8-3f9e07141143", "name": "network-vif-plugged", "status": "completed", "tag": "193b4c11-2f62-4090-8db2-14d2b2bef527"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:28:13.745614 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-0c5915ef-8d54-4f58-b49b-88926053854a req-4d70d17e-7d81-48af-bdef-0fc3f72cc956 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:13.746092 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-0c5915ef-8d54-4f58-b49b-88926053854a req-4d70d17e-7d81-48af-bdef-0fc3f72cc956 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:13.773164 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-0c5915ef-8d54-4f58-b49b-88926053854a req-4d70d17e-7d81-48af-bdef-0fc3f72cc956 service nova] Creating event network-vif-plugged:193b4c11-2f62-4090-8db2-14d2b2bef527 for instance 1eed2a2f-ea96-4f65-a5d8-3f9e07141143 on chh1-master-2 Jun 10 18:28:13.779655 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-0c5915ef-8d54-4f58-b49b-88926053854a req-4d70d17e-7d81-48af-bdef-0fc3f72cc956 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066925 Jun 10 18:28:13.780931 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2975/5994] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:28:13.830068 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-85036443-b84a-4bde-931c-366770b7917a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7708b6c6945d486294f66e4feb39484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec0f8b847fd40c5a87823996d0cb811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:13.857876 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-85036443-b84a-4bde-931c-366770b7917a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] 10.222.0.35 "GET /compute/v2.1/servers/16cde621-ad89-4ebd-b414-9c3c8b68b1d1" status: 200 len: 1283 microversion: 2.1 time: 0.229996 Jun 10 18:28:13.858855 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3020/5995] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:13 2022] GET /compute/v2.1/servers/16cde621-ad89-4ebd-b414-9c3c8b68b1d1 => generated 1283 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:14.129110 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0907f7c3-5b12-434e-a104-67732f31bbe3 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:14.129829 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0907f7c3-5b12-434e-a104-67732f31bbe3 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 1c741087-7c53-4118-8b3d-9654a4f6ff48] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:14.393048 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0907f7c3-5b12-434e-a104-67732f31bbe3 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:14.406689 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0907f7c3-5b12-434e-a104-67732f31bbe3 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48" status: 200 len: 1242 microversion: 2.1 time: 0.281180 Jun 10 18:28:14.422994 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2976/5996] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:14 2022] GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48 => generated 1242 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:14.601858 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-af04fa91-df5f-47fa-bc7b-09d133f2f074 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:14.603290 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-af04fa91-df5f-47fa-bc7b-09d133f2f074 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:14.612698 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-af04fa91-df5f-47fa-bc7b-09d133f2f074 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:14.613359 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-af04fa91-df5f-47fa-bc7b-09d133f2f074 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:14.615000 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-af04fa91-df5f-47fa-bc7b-09d133f2f074 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:14.615866 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-af04fa91-df5f-47fa-bc7b-09d133f2f074 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:14.659711 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2da0e218-bc51-4fb3-bf07-0b629c62f282 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:14.659711 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2da0e218-bc51-4fb3-bf07-0b629c62f282 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 1eed2a2f-ea96-4f65-a5d8-3f9e07141143] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:14.667850 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2da0e218-bc51-4fb3-bf07-0b629c62f282 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:14.671339 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2da0e218-bc51-4fb3-bf07-0b629c62f282 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:14.673462 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2da0e218-bc51-4fb3-bf07-0b629c62f282 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:14.674202 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2da0e218-bc51-4fb3-bf07-0b629c62f282 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:14.966359 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2da0e218-bc51-4fb3-bf07-0b629c62f282 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:14.984341 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2da0e218-bc51-4fb3-bf07-0b629c62f282 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143" status: 200 len: 1308 microversion: 2.1 time: 0.335201 Jun 10 18:28:14.985193 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2977/5997] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:14 2022] GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143 => generated 1308 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:28:14.990957 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-15c1f6e7-cb72-461e-aaae-ab98628d0ab5 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:14.993642 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-15c1f6e7-cb72-461e-aaae-ab98628d0ab5 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: 16cde621-ad89-4ebd-b414-9c3c8b68b1d1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:15.007302 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-15c1f6e7-cb72-461e-aaae-ab98628d0ab5 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:15.008234 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-15c1f6e7-cb72-461e-aaae-ab98628d0ab5 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:15.009181 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-15c1f6e7-cb72-461e-aaae-ab98628d0ab5 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:15.009735 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-15c1f6e7-cb72-461e-aaae-ab98628d0ab5 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:15.147901 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-15c1f6e7-cb72-461e-aaae-ab98628d0ab5 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7708b6c6945d486294f66e4feb39484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec0f8b847fd40c5a87823996d0cb811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:15.169128 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-15c1f6e7-cb72-461e-aaae-ab98628d0ab5 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] 10.222.0.35 "GET /compute/v2.1/servers/16cde621-ad89-4ebd-b414-9c3c8b68b1d1" status: 200 len: 1271 microversion: 2.1 time: 0.180861 Jun 10 18:28:15.170297 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2978/5998] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:14 2022] GET /compute/v2.1/servers/16cde621-ad89-4ebd-b414-9c3c8b68b1d1 => generated 1271 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:15.199105 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-af04fa91-df5f-47fa-bc7b-09d133f2f074 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:15.214723 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-af04fa91-df5f-47fa-bc7b-09d133f2f074 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1362 microversion: 2.1 time: 0.613727 Jun 10 18:28:15.217486 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3021/5999] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:14 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1362 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:15.424894 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0a3728e6-41a9-45ec-a9e7-85b4b2291adf tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:15.427442 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0a3728e6-41a9-45ec-a9e7-85b4b2291adf tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 1c741087-7c53-4118-8b3d-9654a4f6ff48] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:15.470753 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0a3728e6-41a9-45ec-a9e7-85b4b2291adf tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:15.472149 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0a3728e6-41a9-45ec-a9e7-85b4b2291adf tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:15.477924 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0a3728e6-41a9-45ec-a9e7-85b4b2291adf tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:15.496039 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0a3728e6-41a9-45ec-a9e7-85b4b2291adf tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:15.703979 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0a3728e6-41a9-45ec-a9e7-85b4b2291adf tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:15.717729 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0a3728e6-41a9-45ec-a9e7-85b4b2291adf tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48" status: 200 len: 1294 microversion: 2.1 time: 0.297133 Jun 10 18:28:15.730791 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2979/6000] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:15 2022] GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48 => generated 1294 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:16.004039 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c6b8116b-0285-4a8a-bab2-a17299ee7d21 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:16.005856 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c6b8116b-0285-4a8a-bab2-a17299ee7d21 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 1eed2a2f-ea96-4f65-a5d8-3f9e07141143] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:16.017860 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c6b8116b-0285-4a8a-bab2-a17299ee7d21 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:16.018330 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c6b8116b-0285-4a8a-bab2-a17299ee7d21 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:16.022337 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c6b8116b-0285-4a8a-bab2-a17299ee7d21 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:16.022803 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c6b8116b-0285-4a8a-bab2-a17299ee7d21 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:16.189534 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7eb389e6-89a6-4722-88e9-54f76aa2a03a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:16.190595 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7eb389e6-89a6-4722-88e9-54f76aa2a03a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: 16cde621-ad89-4ebd-b414-9c3c8b68b1d1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:16.197695 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7eb389e6-89a6-4722-88e9-54f76aa2a03a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:16.198331 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7eb389e6-89a6-4722-88e9-54f76aa2a03a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:16.199345 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7eb389e6-89a6-4722-88e9-54f76aa2a03a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:16.199869 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7eb389e6-89a6-4722-88e9-54f76aa2a03a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:16.380020 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c6b8116b-0285-4a8a-bab2-a17299ee7d21 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:16.392377 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c6b8116b-0285-4a8a-bab2-a17299ee7d21 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143" status: 200 len: 1488 microversion: 2.1 time: 0.393947 Jun 10 18:28:16.394200 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3022/6001] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:15 2022] GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143 => generated 1488 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:16.401261 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1a966035-9c4f-4308-b2cc-5a42abe52414 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:16.402142 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1a966035-9c4f-4308-b2cc-5a42abe52414 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:16.418985 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1a966035-9c4f-4308-b2cc-5a42abe52414 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:16.419701 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1a966035-9c4f-4308-b2cc-5a42abe52414 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:16.420976 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1a966035-9c4f-4308-b2cc-5a42abe52414 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:16.421669 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1a966035-9c4f-4308-b2cc-5a42abe52414 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:16.601623 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7eb389e6-89a6-4722-88e9-54f76aa2a03a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7708b6c6945d486294f66e4feb39484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec0f8b847fd40c5a87823996d0cb811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:16.617657 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7eb389e6-89a6-4722-88e9-54f76aa2a03a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] 10.222.0.35 "GET /compute/v2.1/servers/16cde621-ad89-4ebd-b414-9c3c8b68b1d1" status: 200 len: 1313 microversion: 2.1 time: 0.430676 Jun 10 18:28:16.637170 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2980/6002] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:16 2022] GET /compute/v2.1/servers/16cde621-ad89-4ebd-b414-9c3c8b68b1d1 => generated 1313 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:28:16.642442 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ef8ecc00-5dca-4427-b667-10b34977a0c5 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:28:16.643675 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ef8ecc00-5dca-4427-b667-10b34977a0c5 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 1eed2a2f-ea96-4f65-a5d8-3f9e07141143] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:16.666538 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ef8ecc00-5dca-4427-b667-10b34977a0c5 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:16.667362 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ef8ecc00-5dca-4427-b667-10b34977a0c5 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:16.668682 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ef8ecc00-5dca-4427-b667-10b34977a0c5 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:16.669496 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ef8ecc00-5dca-4427-b667-10b34977a0c5 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:16.884629 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ef8ecc00-5dca-4427-b667-10b34977a0c5 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "PUT /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143" status: 200 len: 1083 microversion: 2.1 time: 0.245990 Jun 10 18:28:16.898501 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2981/6003] 10.222.0.35 () {60 vars in 1255 bytes} [Fri Jun 10 18:28:16 2022] PUT /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143 => generated 1083 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:16.898501 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-691f2169-9ec3-4110-89bb-2b12686d22a7 req-3ccfc0ba-1e13-46f5-995d-61dea8c05495 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb7d7b12-56ec-43ab-8327-488874922d7d", "name": "network-vif-plugged", "status": "completed", "tag": "fa032014-1fbf-4fd8-a8f9-eae194d73659"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:28:16.900568 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-691f2169-9ec3-4110-89bb-2b12686d22a7 req-3ccfc0ba-1e13-46f5-995d-61dea8c05495 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:16.901079 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-691f2169-9ec3-4110-89bb-2b12686d22a7 req-3ccfc0ba-1e13-46f5-995d-61dea8c05495 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:16.915176 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-691f2169-9ec3-4110-89bb-2b12686d22a7 req-3ccfc0ba-1e13-46f5-995d-61dea8c05495 service nova] Creating event network-vif-plugged:fa032014-1fbf-4fd8-a8f9-eae194d73659 for instance eb7d7b12-56ec-43ab-8327-488874922d7d on chh2-master-2 Jun 10 18:28:16.922963 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-691f2169-9ec3-4110-89bb-2b12686d22a7 req-3ccfc0ba-1e13-46f5-995d-61dea8c05495 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035662 Jun 10 18:28:16.924248 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2982/6004] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:28:16.930636 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9d1598bf-821d-47c1-afcf-e41ee30e4b30 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:16.931733 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9d1598bf-821d-47c1-afcf-e41ee30e4b30 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 1c741087-7c53-4118-8b3d-9654a4f6ff48] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:16.941993 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9d1598bf-821d-47c1-afcf-e41ee30e4b30 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:16.942559 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9d1598bf-821d-47c1-afcf-e41ee30e4b30 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:16.943572 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9d1598bf-821d-47c1-afcf-e41ee30e4b30 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:16.944079 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9d1598bf-821d-47c1-afcf-e41ee30e4b30 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:17.123142 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9d1598bf-821d-47c1-afcf-e41ee30e4b30 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:17.125822 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:28:17.135604 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9d1598bf-821d-47c1-afcf-e41ee30e4b30 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48" status: 200 len: 1300 microversion: 2.1 time: 0.209980 Jun 10 18:28:17.137729 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2983/6005] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:16 2022] GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48 => generated 1300 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:17.146011 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2cafc25d-176b-4675-90a8-603b746cee35 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:17.146880 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2cafc25d-176b-4675-90a8-603b746cee35 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 1eed2a2f-ea96-4f65-a5d8-3f9e07141143] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:17.169360 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2cafc25d-176b-4675-90a8-603b746cee35 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:17.169943 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2cafc25d-176b-4675-90a8-603b746cee35 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:17.170720 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2cafc25d-176b-4675-90a8-603b746cee35 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:17.174221 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2cafc25d-176b-4675-90a8-603b746cee35 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:17.315381 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1a966035-9c4f-4308-b2cc-5a42abe52414 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:17.327861 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1a966035-9c4f-4308-b2cc-5a42abe52414 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1362 microversion: 2.1 time: 0.932305 Jun 10 18:28:17.337966 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3023/6006] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:16 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1362 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:17.443099 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2cafc25d-176b-4675-90a8-603b746cee35 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:17.466038 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2cafc25d-176b-4675-90a8-603b746cee35 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143" status: 200 len: 1509 microversion: 2.1 time: 0.326853 Jun 10 18:28:17.467327 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2984/6007] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:17 2022] GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143 => generated 1509 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:17.512617 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-dc286fbd-e035-4a93-81b5-a004eeb562f3 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:17.513330 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-dc286fbd-e035-4a93-81b5-a004eeb562f3 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 1eed2a2f-ea96-4f65-a5d8-3f9e07141143] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:17.528841 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dc286fbd-e035-4a93-81b5-a004eeb562f3 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:17.529322 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dc286fbd-e035-4a93-81b5-a004eeb562f3 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:17.530863 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dc286fbd-e035-4a93-81b5-a004eeb562f3 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:17.531319 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dc286fbd-e035-4a93-81b5-a004eeb562f3 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:17.639212 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bbf19098-ff39-40e7-b9de-7f6f4c2293ca tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:17.639212 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bbf19098-ff39-40e7-b9de-7f6f4c2293ca tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: 16cde621-ad89-4ebd-b414-9c3c8b68b1d1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:17.644401 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bbf19098-ff39-40e7-b9de-7f6f4c2293ca tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:17.645140 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bbf19098-ff39-40e7-b9de-7f6f4c2293ca tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:17.646286 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bbf19098-ff39-40e7-b9de-7f6f4c2293ca tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:17.646985 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bbf19098-ff39-40e7-b9de-7f6f4c2293ca tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:17.867083 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-dc286fbd-e035-4a93-81b5-a004eeb562f3 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:17.876850 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-dc286fbd-e035-4a93-81b5-a004eeb562f3 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143" status: 200 len: 1509 microversion: 2.1 time: 0.397589 Jun 10 18:28:17.878334 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3024/6008] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:17 2022] GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143 => generated 1509 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:17.897910 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-14144a11-68b5-4811-978b-dd7548bf4ff0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:17.898352 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-14144a11-68b5-4811-978b-dd7548bf4ff0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 1eed2a2f-ea96-4f65-a5d8-3f9e07141143] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:17.905295 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-14144a11-68b5-4811-978b-dd7548bf4ff0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:17.906165 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-14144a11-68b5-4811-978b-dd7548bf4ff0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:17.907220 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-14144a11-68b5-4811-978b-dd7548bf4ff0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:17.908478 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-14144a11-68b5-4811-978b-dd7548bf4ff0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:17.945029 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-14144a11-68b5-4811-978b-dd7548bf4ff0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 1eed2a2f-ea96-4f65-a5d8-3f9e07141143] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:28:18.277264 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-14144a11-68b5-4811-978b-dd7548bf4ff0 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "DELETE /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143" status: 204 len: 0 microversion: 2.1 time: 0.385056 Jun 10 18:28:18.279094 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3025/6009] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:28:17 2022] DELETE /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:28:18.300505 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-bf422be9-5cec-4129-843b-d66a3e6d5348 req-07b5bdd6-3a8f-4dc2-9d47-328c71b5f665 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16cde621-ad89-4ebd-b414-9c3c8b68b1d1", "tag": "f4c4b914-7160-444b-af90-33150b523bc7"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:28:18.315630 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-bf422be9-5cec-4129-843b-d66a3e6d5348 req-07b5bdd6-3a8f-4dc2-9d47-328c71b5f665 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:18.318088 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-bf422be9-5cec-4129-843b-d66a3e6d5348 req-07b5bdd6-3a8f-4dc2-9d47-328c71b5f665 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:18.336293 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-bf422be9-5cec-4129-843b-d66a3e6d5348 req-07b5bdd6-3a8f-4dc2-9d47-328c71b5f665 service nova] Creating event network-changed:f4c4b914-7160-444b-af90-33150b523bc7 for instance 16cde621-ad89-4ebd-b414-9c3c8b68b1d1 on chh2-master-2 Jun 10 18:28:18.343133 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-bf422be9-5cec-4129-843b-d66a3e6d5348 req-07b5bdd6-3a8f-4dc2-9d47-328c71b5f665 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060886 Jun 10 18:28:18.344538 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3026/6010] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:28:18.350785 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a79df205-f589-4c6e-8171-9891a62c1a20 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:18.351790 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a79df205-f589-4c6e-8171-9891a62c1a20 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 1c741087-7c53-4118-8b3d-9654a4f6ff48] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:18.361119 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a79df205-f589-4c6e-8171-9891a62c1a20 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:18.365416 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a79df205-f589-4c6e-8171-9891a62c1a20 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:18.365416 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a79df205-f589-4c6e-8171-9891a62c1a20 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:18.365416 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a79df205-f589-4c6e-8171-9891a62c1a20 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:18.379550 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bbf19098-ff39-40e7-b9de-7f6f4c2293ca tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7708b6c6945d486294f66e4feb39484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec0f8b847fd40c5a87823996d0cb811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:18.392961 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bbf19098-ff39-40e7-b9de-7f6f4c2293ca tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] 10.222.0.35 "GET /compute/v2.1/servers/16cde621-ad89-4ebd-b414-9c3c8b68b1d1" status: 200 len: 1313 microversion: 2.1 time: 0.760721 Jun 10 18:28:18.393562 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2985/6011] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:17 2022] GET /compute/v2.1/servers/16cde621-ad89-4ebd-b414-9c3c8b68b1d1 => generated 1313 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:18.409861 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-73db03bf-cbb1-4b13-b085-f4627164972d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:18.409861 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-73db03bf-cbb1-4b13-b085-f4627164972d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 1eed2a2f-ea96-4f65-a5d8-3f9e07141143] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:18.425802 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-73db03bf-cbb1-4b13-b085-f4627164972d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:18.426464 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-73db03bf-cbb1-4b13-b085-f4627164972d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:18.431977 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-73db03bf-cbb1-4b13-b085-f4627164972d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:18.432837 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-73db03bf-cbb1-4b13-b085-f4627164972d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:18.703240 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-73db03bf-cbb1-4b13-b085-f4627164972d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:18.714065 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-73db03bf-cbb1-4b13-b085-f4627164972d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143" status: 200 len: 1515 microversion: 2.1 time: 0.308324 Jun 10 18:28:18.716002 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2986/6012] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:18 2022] GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143 => generated 1515 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:18.732559 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e094f187-d27c-4e0f-9755-c3cf7846e87e tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:18.736782 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e094f187-d27c-4e0f-9755-c3cf7846e87e tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:18.741603 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e094f187-d27c-4e0f-9755-c3cf7846e87e tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:18.742348 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e094f187-d27c-4e0f-9755-c3cf7846e87e tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:18.743410 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e094f187-d27c-4e0f-9755-c3cf7846e87e tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:18.744099 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e094f187-d27c-4e0f-9755-c3cf7846e87e tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:18.917104 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a79df205-f589-4c6e-8171-9891a62c1a20 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:18.936798 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a79df205-f589-4c6e-8171-9891a62c1a20 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48" status: 200 len: 1366 microversion: 2.1 time: 0.589080 Jun 10 18:28:18.936798 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3027/6013] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:18 2022] GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48 => generated 1366 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:18.990627 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e094f187-d27c-4e0f-9755-c3cf7846e87e tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:19.007758 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e094f187-d27c-4e0f-9755-c3cf7846e87e tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1362 microversion: 2.1 time: 0.279137 Jun 10 18:28:19.017538 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2987/6014] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:18 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1362 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:19.410863 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7c09a1a4-2a85-469e-983a-a2fa62c6dd2b tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:19.411421 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7c09a1a4-2a85-469e-983a-a2fa62c6dd2b tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: 16cde621-ad89-4ebd-b414-9c3c8b68b1d1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:19.424376 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7c09a1a4-2a85-469e-983a-a2fa62c6dd2b tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:19.428928 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7c09a1a4-2a85-469e-983a-a2fa62c6dd2b tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:19.429785 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7c09a1a4-2a85-469e-983a-a2fa62c6dd2b tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:19.430242 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7c09a1a4-2a85-469e-983a-a2fa62c6dd2b tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:19.461307 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:28:19.707220 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7c09a1a4-2a85-469e-983a-a2fa62c6dd2b tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7708b6c6945d486294f66e4feb39484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec0f8b847fd40c5a87823996d0cb811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:19.725202 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7c09a1a4-2a85-469e-983a-a2fa62c6dd2b tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] 10.222.0.35 "GET /compute/v2.1/servers/16cde621-ad89-4ebd-b414-9c3c8b68b1d1" status: 200 len: 1313 microversion: 2.1 time: 0.318272 Jun 10 18:28:19.727130 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3028/6015] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:19 2022] GET /compute/v2.1/servers/16cde621-ad89-4ebd-b414-9c3c8b68b1d1 => generated 1313 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:19.743613 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dbdb5dea-dde9-458a-95e8-0975215b2b1d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:19.745137 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dbdb5dea-dde9-458a-95e8-0975215b2b1d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 1eed2a2f-ea96-4f65-a5d8-3f9e07141143] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:19.752484 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dbdb5dea-dde9-458a-95e8-0975215b2b1d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:19.754241 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dbdb5dea-dde9-458a-95e8-0975215b2b1d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:19.755915 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dbdb5dea-dde9-458a-95e8-0975215b2b1d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:19.757432 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dbdb5dea-dde9-458a-95e8-0975215b2b1d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:19.951938 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-62353939-7e46-4034-b3a8-012219a4435d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:19.954507 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-62353939-7e46-4034-b3a8-012219a4435d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 1c741087-7c53-4118-8b3d-9654a4f6ff48] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:19.957122 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:28:19.963828 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-62353939-7e46-4034-b3a8-012219a4435d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:19.969896 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-62353939-7e46-4034-b3a8-012219a4435d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:19.969896 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-62353939-7e46-4034-b3a8-012219a4435d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:19.969896 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-62353939-7e46-4034-b3a8-012219a4435d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:20.080196 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-dbdb5dea-dde9-458a-95e8-0975215b2b1d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:20.096522 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dbdb5dea-dde9-458a-95e8-0975215b2b1d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143" status: 200 len: 1515 microversion: 2.1 time: 0.358387 Jun 10 18:28:20.097127 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2988/6016] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:19 2022] GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143 => generated 1515 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:20.105145 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e890da41-727f-4e51-814d-2b0f1b5816f1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:20.105765 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e890da41-727f-4e51-814d-2b0f1b5816f1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:20.116374 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=8 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:28:20.125783 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e890da41-727f-4e51-814d-2b0f1b5816f1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:20.128045 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e890da41-727f-4e51-814d-2b0f1b5816f1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:20.132286 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e890da41-727f-4e51-814d-2b0f1b5816f1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:20.132773 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e890da41-727f-4e51-814d-2b0f1b5816f1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:20.372795 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-62353939-7e46-4034-b3a8-012219a4435d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:20.386408 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-62353939-7e46-4034-b3a8-012219a4435d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48" status: 200 len: 1366 microversion: 2.1 time: 0.434396 Jun 10 18:28:20.387055 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3029/6017] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:19 2022] GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48 => generated 1366 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:28:20.640827 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e890da41-727f-4e51-814d-2b0f1b5816f1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:20.655013 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e890da41-727f-4e51-814d-2b0f1b5816f1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1548 microversion: 2.1 time: 0.554991 Jun 10 18:28:20.655626 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2989/6018] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:20 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1548 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:20.679664 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-65b0d23c-b2ad-4993-9b73-b61849f43fdd tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:20.682922 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-65b0d23c-b2ad-4993-9b73-b61849f43fdd tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:20.694695 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-65b0d23c-b2ad-4993-9b73-b61849f43fdd tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:20.699182 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-65b0d23c-b2ad-4993-9b73-b61849f43fdd tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:20.701608 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-65b0d23c-b2ad-4993-9b73-b61849f43fdd tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:20.702510 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-65b0d23c-b2ad-4993-9b73-b61849f43fdd tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:20.747321 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d3e2a435-9bea-4977-9638-4be9c1e32d2c tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:20.749643 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d3e2a435-9bea-4977-9638-4be9c1e32d2c tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: 16cde621-ad89-4ebd-b414-9c3c8b68b1d1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:20.769249 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d3e2a435-9bea-4977-9638-4be9c1e32d2c tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:20.769988 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d3e2a435-9bea-4977-9638-4be9c1e32d2c tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:20.772580 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d3e2a435-9bea-4977-9638-4be9c1e32d2c tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:20.775928 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d3e2a435-9bea-4977-9638-4be9c1e32d2c tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:20.965704 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-65b0d23c-b2ad-4993-9b73-b61849f43fdd tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.293586 Jun 10 18:28:20.966305 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3030/6019] 10.222.0.35 () {58 vars in 1274 bytes} [Fri Jun 10 18:28:20 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d/os-interface => generated 285 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:28:21.114950 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f0c95e2b-b085-4040-89d4-50ac8d7af86d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:21.115847 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f0c95e2b-b085-4040-89d4-50ac8d7af86d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 1eed2a2f-ea96-4f65-a5d8-3f9e07141143] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:21.135607 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f0c95e2b-b085-4040-89d4-50ac8d7af86d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:21.143338 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f0c95e2b-b085-4040-89d4-50ac8d7af86d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:21.145204 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f0c95e2b-b085-4040-89d4-50ac8d7af86d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:21.146672 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f0c95e2b-b085-4040-89d4-50ac8d7af86d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:21.382290 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f0c95e2b-b085-4040-89d4-50ac8d7af86d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:21.390174 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f0c95e2b-b085-4040-89d4-50ac8d7af86d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143" status: 200 len: 1473 microversion: 2.1 time: 0.279751 Jun 10 18:28:21.396616 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3031/6020] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:21 2022] GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143 => generated 1473 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:28:21.410263 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d3e2a435-9bea-4977-9638-4be9c1e32d2c tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7708b6c6945d486294f66e4feb39484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec0f8b847fd40c5a87823996d0cb811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:21.432855 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e04b4813-0404-4315-b19b-335e36aaf95b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:21.432855 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e04b4813-0404-4315-b19b-335e36aaf95b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 1c741087-7c53-4118-8b3d-9654a4f6ff48] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:21.433175 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d3e2a435-9bea-4977-9638-4be9c1e32d2c tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] 10.222.0.35 "GET /compute/v2.1/servers/16cde621-ad89-4ebd-b414-9c3c8b68b1d1" status: 200 len: 1313 microversion: 2.1 time: 0.684498 Jun 10 18:28:21.433175 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2990/6021] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:20 2022] GET /compute/v2.1/servers/16cde621-ad89-4ebd-b414-9c3c8b68b1d1 => generated 1313 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:21.452615 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e04b4813-0404-4315-b19b-335e36aaf95b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:21.453182 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e04b4813-0404-4315-b19b-335e36aaf95b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:21.453931 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e04b4813-0404-4315-b19b-335e36aaf95b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:21.455196 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e04b4813-0404-4315-b19b-335e36aaf95b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:21.470594 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-9fa7e8a4-e40c-48aa-8b17-962ad17a5b31 req-d9e26fae-12b8-4975-8366-62312c687ede service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c741087-7c53-4118-8b3d-9654a4f6ff48", "tag": "787dd400-65e8-4954-b2ba-0f271b49a3a0"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:28:21.488423 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-9fa7e8a4-e40c-48aa-8b17-962ad17a5b31 req-d9e26fae-12b8-4975-8366-62312c687ede service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:21.488928 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-9fa7e8a4-e40c-48aa-8b17-962ad17a5b31 req-d9e26fae-12b8-4975-8366-62312c687ede service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:21.502796 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-9fa7e8a4-e40c-48aa-8b17-962ad17a5b31 req-d9e26fae-12b8-4975-8366-62312c687ede service nova] Creating event network-changed:787dd400-65e8-4954-b2ba-0f271b49a3a0 for instance 1c741087-7c53-4118-8b3d-9654a4f6ff48 on chh1-master-2 Jun 10 18:28:21.509426 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-9fa7e8a4-e40c-48aa-8b17-962ad17a5b31 req-d9e26fae-12b8-4975-8366-62312c687ede service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068789 Jun 10 18:28:21.510883 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2991/6022] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:28:22.392947 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e04b4813-0404-4315-b19b-335e36aaf95b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:22.407343 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e04b4813-0404-4315-b19b-335e36aaf95b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48" status: 200 len: 1366 microversion: 2.1 time: 0.990986 Jun 10 18:28:22.414709 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fcfce693-723e-4e49-b5bb-6362c05b3183 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:22.417137 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fcfce693-723e-4e49-b5bb-6362c05b3183 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 1eed2a2f-ea96-4f65-a5d8-3f9e07141143] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:22.423757 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3032/6023] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:21 2022] GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48 => generated 1366 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:22.428498 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:28:22.434908 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fcfce693-723e-4e49-b5bb-6362c05b3183 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:22.434908 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fcfce693-723e-4e49-b5bb-6362c05b3183 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:22.434908 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fcfce693-723e-4e49-b5bb-6362c05b3183 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:22.434908 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fcfce693-723e-4e49-b5bb-6362c05b3183 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:22.449185 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2baf2042-b832-46e4-958d-7004bcd58786 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:22.449851 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2baf2042-b832-46e4-958d-7004bcd58786 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: 16cde621-ad89-4ebd-b414-9c3c8b68b1d1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:22.461070 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2baf2042-b832-46e4-958d-7004bcd58786 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:22.461545 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2baf2042-b832-46e4-958d-7004bcd58786 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:22.462381 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2baf2042-b832-46e4-958d-7004bcd58786 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:22.462833 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2baf2042-b832-46e4-958d-7004bcd58786 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:22.601582 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fcfce693-723e-4e49-b5bb-6362c05b3183 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:22.604601 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fcfce693-723e-4e49-b5bb-6362c05b3183 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:22.605303 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-fcfce693-723e-4e49-b5bb-6362c05b3183 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lazy-loading 'fault' on Instance uuid 1eed2a2f-ea96-4f65-a5d8-3f9e07141143 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:28:22.676694 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fcfce693-723e-4e49-b5bb-6362c05b3183 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:22.714006 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fcfce693-723e-4e49-b5bb-6362c05b3183 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143" status: 200 len: 1319 microversion: 2.1 time: 0.304164 Jun 10 18:28:22.732878 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2992/6024] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:22 2022] GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143 => generated 1319 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:22.939707 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2baf2042-b832-46e4-958d-7004bcd58786 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7708b6c6945d486294f66e4feb39484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec0f8b847fd40c5a87823996d0cb811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:22.957933 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2baf2042-b832-46e4-958d-7004bcd58786 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] 10.222.0.35 "GET /compute/v2.1/servers/16cde621-ad89-4ebd-b414-9c3c8b68b1d1" status: 200 len: 1313 microversion: 2.1 time: 0.511767 Jun 10 18:28:22.967861 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3033/6025] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:22 2022] GET /compute/v2.1/servers/16cde621-ad89-4ebd-b414-9c3c8b68b1d1 => generated 1313 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:23.473525 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3bf79679-bc44-4c36-9c1c-654430f33086 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:23.473525 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3bf79679-bc44-4c36-9c1c-654430f33086 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 1c741087-7c53-4118-8b3d-9654a4f6ff48] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:23.473525 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:28:23.473525 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3bf79679-bc44-4c36-9c1c-654430f33086 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:23.473525 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3bf79679-bc44-4c36-9c1c-654430f33086 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:23.473525 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3bf79679-bc44-4c36-9c1c-654430f33086 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:23.473525 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3bf79679-bc44-4c36-9c1c-654430f33086 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:23.610252 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-5e144482-da7f-45a2-af0d-9ec92543c824 req-b83fd85b-b547-4404-8539-f6b596243e0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eed2a2f-ea96-4f65-a5d8-3f9e07141143", "name": "network-vif-deleted", "tag": "193b4c11-2f62-4090-8db2-14d2b2bef527"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:28:23.621554 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-5e144482-da7f-45a2-af0d-9ec92543c824 req-b83fd85b-b547-4404-8539-f6b596243e0d service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:23.622608 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-5e144482-da7f-45a2-af0d-9ec92543c824 req-b83fd85b-b547-4404-8539-f6b596243e0d service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:23.639279 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-5e144482-da7f-45a2-af0d-9ec92543c824 req-b83fd85b-b547-4404-8539-f6b596243e0d service nova] Creating event network-vif-deleted:193b4c11-2f62-4090-8db2-14d2b2bef527 for instance 1eed2a2f-ea96-4f65-a5d8-3f9e07141143 on chh1-master-2 Jun 10 18:28:23.645196 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-5e144482-da7f-45a2-af0d-9ec92543c824 req-b83fd85b-b547-4404-8539-f6b596243e0d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039975 Jun 10 18:28:23.646529 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3034/6026] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:28:23.652869 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-fc4b0386-0144-460f-b846-5d4534405d30 req-302439b1-e8f8-4878-9134-4ae068600858 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb7d7b12-56ec-43ab-8327-488874922d7d", "tag": "fa032014-1fbf-4fd8-a8f9-eae194d73659"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:28:23.665059 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-fc4b0386-0144-460f-b846-5d4534405d30 req-302439b1-e8f8-4878-9134-4ae068600858 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:23.684756 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-fc4b0386-0144-460f-b846-5d4534405d30 req-302439b1-e8f8-4878-9134-4ae068600858 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:23.684756 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-fc4b0386-0144-460f-b846-5d4534405d30 req-302439b1-e8f8-4878-9134-4ae068600858 service nova] Creating event network-changed:fa032014-1fbf-4fd8-a8f9-eae194d73659 for instance eb7d7b12-56ec-43ab-8327-488874922d7d on chh2-master-2 Jun 10 18:28:23.684756 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-fc4b0386-0144-460f-b846-5d4534405d30 req-302439b1-e8f8-4878-9134-4ae068600858 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033953 Jun 10 18:28:23.684756 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3035/6027] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:28:23.694070 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3bf79679-bc44-4c36-9c1c-654430f33086 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:23.702945 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3bf79679-bc44-4c36-9c1c-654430f33086 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48" status: 200 len: 1366 microversion: 2.1 time: 0.266260 Jun 10 18:28:23.704210 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2993/6028] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:23 2022] GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48 => generated 1366 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:28:23.763969 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ca7236d4-f8c8-4689-a7a3-179669c64f66 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:23.763969 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ca7236d4-f8c8-4689-a7a3-179669c64f66 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 1eed2a2f-ea96-4f65-a5d8-3f9e07141143] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:23.763969 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ca7236d4-f8c8-4689-a7a3-179669c64f66 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:23.763969 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ca7236d4-f8c8-4689-a7a3-179669c64f66 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:23.763969 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ca7236d4-f8c8-4689-a7a3-179669c64f66 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:23.763969 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ca7236d4-f8c8-4689-a7a3-179669c64f66 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:23.773120 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-ca7236d4-f8c8-4689-a7a3-179669c64f66 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] HTTP exception thrown: Instance 1eed2a2f-ea96-4f65-a5d8-3f9e07141143 could not be found. Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ca7236d4-f8c8-4689-a7a3-179669c64f66 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Request method failure captured: Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143 HTTP/1.1 Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4ylUNGY8VKO5jLVY6McXmkU53BpB453bvCKmrvaQGLJAZV-lieSSXu8nUaF6yxU0RZxSma5kvfEU2IFgDObEl38j4CHosWLE8jUTpbhfPjW3XqChWMzwgLKa4BS5Yox1cN_jUzeYnin3TOSxn98enTacAe1cvDVZ2oUSAgL46qFPsc Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ded497d3d91b4e22bc2daa72d6f75d18", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersTestJSON-1873283063 Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersTestJSON-1873283063-project Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: d37f560237d9489e96ddee21d9f5e6c6 Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersTestJSON-1873283063-project Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 1eed2a2f-ea96-4f65-a5d8-3f9e07141143 could not be found. Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '1eed2a2f-ea96-4f65-a5d8-3f9e07141143'} Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eed2a2f-ea96-4f65-a5d8-3f9e07141143 could not be found. Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eed2a2f-ea96-4f65-a5d8-3f9e07141143 could not be found. Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:28:23.774945 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:28:23.779843 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:28:23.779843 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:28:23.779843 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:28:23.779843 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:28:23.779843 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eed2a2f-ea96-4f65-a5d8-3f9e07141143 could not be found. Jun 10 18:28:23.779843 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:28:23.779843 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ca7236d4-f8c8-4689-a7a3-179669c64f66 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Returning 404 to user: Instance 1eed2a2f-ea96-4f65-a5d8-3f9e07141143 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:28:23.779843 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ca7236d4-f8c8-4689-a7a3-179669c64f66 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143" status: 404 len: 111 microversion: 2.1 time: 0.042490 Jun 10 18:28:23.789483 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3036/6029] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:23 2022] GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:28:23.932888 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-683cb592-3f4f-4ba3-9a76-7437c9860c75 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1638706395", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "940d65ec-437e-4f98-a601-e2ba4906c363"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:28:23.979258 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e2d5d51a-9b58-42d4-80b9-3cfb502c567b tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:23.980232 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e2d5d51a-9b58-42d4-80b9-3cfb502c567b tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: 16cde621-ad89-4ebd-b414-9c3c8b68b1d1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:23.993494 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e2d5d51a-9b58-42d4-80b9-3cfb502c567b tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:23.994398 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e2d5d51a-9b58-42d4-80b9-3cfb502c567b tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:23.997264 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e2d5d51a-9b58-42d4-80b9-3cfb502c567b tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:23.998771 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e2d5d51a-9b58-42d4-80b9-3cfb502c567b tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:24.009437 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-683cb592-3f4f-4ba3-9a76-7437c9860c75 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] validate_networks() for [('940d65ec-437e-4f98-a601-e2ba4906c363', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:28:24.359567 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e2d5d51a-9b58-42d4-80b9-3cfb502c567b tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7708b6c6945d486294f66e4feb39484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec0f8b847fd40c5a87823996d0cb811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:24.371109 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e2d5d51a-9b58-42d4-80b9-3cfb502c567b tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] 10.222.0.35 "GET /compute/v2.1/servers/16cde621-ad89-4ebd-b414-9c3c8b68b1d1" status: 200 len: 1313 microversion: 2.1 time: 0.399208 Jun 10 18:28:24.371853 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3037/6030] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:23 2022] GET /compute/v2.1/servers/16cde621-ad89-4ebd-b414-9c3c8b68b1d1 => generated 1313 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:24.399837 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=11 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:28:24.720009 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2ffc194f-85ae-401c-b752-ee9aab7a5ae8 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:24.721287 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2ffc194f-85ae-401c-b752-ee9aab7a5ae8 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 1c741087-7c53-4118-8b3d-9654a4f6ff48] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:24.728462 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2ffc194f-85ae-401c-b752-ee9aab7a5ae8 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:24.729147 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2ffc194f-85ae-401c-b752-ee9aab7a5ae8 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:24.730137 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2ffc194f-85ae-401c-b752-ee9aab7a5ae8 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:24.730839 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2ffc194f-85ae-401c-b752-ee9aab7a5ae8 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:24.888239 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-683cb592-3f4f-4ba3-9a76-7437c9860c75 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:28:24.888836 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-683cb592-3f4f-4ba3-9a76-7437c9860c75 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:28:24.889179 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-683cb592-3f4f-4ba3-9a76-7437c9860c75 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:28:24.889602 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-683cb592-3f4f-4ba3-9a76-7437c9860c75 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:28:24.890026 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-683cb592-3f4f-4ba3-9a76-7437c9860c75 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:28:24.912442 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-683cb592-3f4f-4ba3-9a76-7437c9860c75 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:24.912907 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-683cb592-3f4f-4ba3-9a76-7437c9860c75 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:24.913731 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-683cb592-3f4f-4ba3-9a76-7437c9860c75 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:24.914224 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-683cb592-3f4f-4ba3-9a76-7437c9860c75 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:24.943886 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-683cb592-3f4f-4ba3-9a76-7437c9860c75 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Getting quotas for project ded497d3d91b4e22bc2daa72d6f75d18. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:28:24.952986 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-683cb592-3f4f-4ba3-9a76-7437c9860c75 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Getting quotas for user d37f560237d9489e96ddee21d9f5e6c6 and project ded497d3d91b4e22bc2daa72d6f75d18. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:28:24.971867 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-683cb592-3f4f-4ba3-9a76-7437c9860c75 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:28:24.974883 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-683cb592-3f4f-4ba3-9a76-7437c9860c75 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:28:24.979706 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2ffc194f-85ae-401c-b752-ee9aab7a5ae8 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:24.995997 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2ffc194f-85ae-401c-b752-ee9aab7a5ae8 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48" status: 200 len: 1366 microversion: 2.1 time: 0.279946 Jun 10 18:28:25.004126 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3038/6031] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:24 2022] GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48 => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:28:25.160529 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-683cb592-3f4f-4ba3-9a76-7437c9860c75 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.231683 Jun 10 18:28:25.161497 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2994/6032] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:28:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:28:25.174687 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-52cb2d5e-7931-4ced-b6b2-a8ff58987bad tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:25.175669 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-52cb2d5e-7931-4ced-b6b2-a8ff58987bad tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:25.305658 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-52cb2d5e-7931-4ced-b6b2-a8ff58987bad tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:25.332516 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-52cb2d5e-7931-4ced-b6b2-a8ff58987bad tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 200 len: 1209 microversion: 2.1 time: 0.159208 Jun 10 18:28:25.332516 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3039/6033] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:25 2022] GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 1209 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:25.390460 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-eef2b116-9219-4a12-8e48-e2754ae9292f tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:25.391343 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-eef2b116-9219-4a12-8e48-e2754ae9292f tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: 16cde621-ad89-4ebd-b414-9c3c8b68b1d1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:25.399386 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eef2b116-9219-4a12-8e48-e2754ae9292f tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:25.399850 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eef2b116-9219-4a12-8e48-e2754ae9292f tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:25.404363 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eef2b116-9219-4a12-8e48-e2754ae9292f tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:25.404363 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eef2b116-9219-4a12-8e48-e2754ae9292f tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:25.756714 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-eef2b116-9219-4a12-8e48-e2754ae9292f tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7708b6c6945d486294f66e4feb39484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec0f8b847fd40c5a87823996d0cb811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:25.761262 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-eef2b116-9219-4a12-8e48-e2754ae9292f tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] 10.222.0.35 "GET /compute/v2.1/servers/16cde621-ad89-4ebd-b414-9c3c8b68b1d1" status: 200 len: 1313 microversion: 2.1 time: 0.376745 Jun 10 18:28:25.782061 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2995/6034] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:25 2022] GET /compute/v2.1/servers/16cde621-ad89-4ebd-b414-9c3c8b68b1d1 => generated 1313 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:26.013453 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d3f2db9f-053a-47a6-acbe-16d912392831 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:26.014596 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d3f2db9f-053a-47a6-acbe-16d912392831 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 1c741087-7c53-4118-8b3d-9654a4f6ff48] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:26.025071 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d3f2db9f-053a-47a6-acbe-16d912392831 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:26.025543 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d3f2db9f-053a-47a6-acbe-16d912392831 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:26.026546 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d3f2db9f-053a-47a6-acbe-16d912392831 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:26.027013 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d3f2db9f-053a-47a6-acbe-16d912392831 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:26.247491 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d3f2db9f-053a-47a6-acbe-16d912392831 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:26.258473 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d3f2db9f-053a-47a6-acbe-16d912392831 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48" status: 200 len: 1366 microversion: 2.1 time: 0.248860 Jun 10 18:28:26.259729 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3040/6035] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:26 2022] GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48 => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:26.349150 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-830b73ba-290d-4ade-99e8-965052807b74 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:26.350705 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-830b73ba-290d-4ade-99e8-965052807b74 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:26.358288 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-830b73ba-290d-4ade-99e8-965052807b74 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:26.358813 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-830b73ba-290d-4ade-99e8-965052807b74 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:26.359834 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-830b73ba-290d-4ade-99e8-965052807b74 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:26.360725 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-830b73ba-290d-4ade-99e8-965052807b74 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:26.483246 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-830b73ba-290d-4ade-99e8-965052807b74 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:26.515367 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-830b73ba-290d-4ade-99e8-965052807b74 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 200 len: 1213 microversion: 2.1 time: 0.168712 Jun 10 18:28:26.519480 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2996/6036] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:26 2022] GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 1213 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:26.786513 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b0564269-ebb1-4105-bd63-ebc77ccc4f49 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:26.787607 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b0564269-ebb1-4105-bd63-ebc77ccc4f49 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: 16cde621-ad89-4ebd-b414-9c3c8b68b1d1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:26.798990 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b0564269-ebb1-4105-bd63-ebc77ccc4f49 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:26.798990 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b0564269-ebb1-4105-bd63-ebc77ccc4f49 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:26.798990 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b0564269-ebb1-4105-bd63-ebc77ccc4f49 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:26.798990 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b0564269-ebb1-4105-bd63-ebc77ccc4f49 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:26.979568 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b0564269-ebb1-4105-bd63-ebc77ccc4f49 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7708b6c6945d486294f66e4feb39484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec0f8b847fd40c5a87823996d0cb811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:26.994828 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b0564269-ebb1-4105-bd63-ebc77ccc4f49 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] 10.222.0.35 "GET /compute/v2.1/servers/16cde621-ad89-4ebd-b414-9c3c8b68b1d1" status: 200 len: 1313 microversion: 2.1 time: 0.209840 Jun 10 18:28:26.994828 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3041/6037] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:26 2022] GET /compute/v2.1/servers/16cde621-ad89-4ebd-b414-9c3c8b68b1d1 => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:27.277000 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-53013caf-381c-4921-8fa8-e5a50f97d073 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:27.277618 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-53013caf-381c-4921-8fa8-e5a50f97d073 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 1c741087-7c53-4118-8b3d-9654a4f6ff48] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:27.291143 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-53013caf-381c-4921-8fa8-e5a50f97d073 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:27.291808 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-53013caf-381c-4921-8fa8-e5a50f97d073 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:27.292916 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-53013caf-381c-4921-8fa8-e5a50f97d073 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:27.293559 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-53013caf-381c-4921-8fa8-e5a50f97d073 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:27.398985 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-8df26777-56db-47c8-820b-b899b6c02d70 req-e828b9e4-d5e3-42e0-924b-1c17cdf3481a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16cde621-ad89-4ebd-b414-9c3c8b68b1d1", "name": "network-vif-plugged", "status": "completed", "tag": "f4c4b914-7160-444b-af90-33150b523bc7"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:28:27.422165 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-8df26777-56db-47c8-820b-b899b6c02d70 req-e828b9e4-d5e3-42e0-924b-1c17cdf3481a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:27.455022 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-8df26777-56db-47c8-820b-b899b6c02d70 req-e828b9e4-d5e3-42e0-924b-1c17cdf3481a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:27.478452 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-8df26777-56db-47c8-820b-b899b6c02d70 req-e828b9e4-d5e3-42e0-924b-1c17cdf3481a service nova] Creating event network-vif-plugged:f4c4b914-7160-444b-af90-33150b523bc7 for instance 16cde621-ad89-4ebd-b414-9c3c8b68b1d1 on chh2-master-2 Jun 10 18:28:27.484176 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-8df26777-56db-47c8-820b-b899b6c02d70 req-e828b9e4-d5e3-42e0-924b-1c17cdf3481a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105574 Jun 10 18:28:27.488461 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3042/6038] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:28:27.534556 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6d08ae30-7c7c-4dca-8762-bea40561327a tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:27.536219 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6d08ae30-7c7c-4dca-8762-bea40561327a tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:27.550475 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6d08ae30-7c7c-4dca-8762-bea40561327a tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:27.564966 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6d08ae30-7c7c-4dca-8762-bea40561327a tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:27.564966 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6d08ae30-7c7c-4dca-8762-bea40561327a tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:27.564966 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6d08ae30-7c7c-4dca-8762-bea40561327a tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:27.565523 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-53013caf-381c-4921-8fa8-e5a50f97d073 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:27.573486 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-53013caf-381c-4921-8fa8-e5a50f97d073 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48" status: 200 len: 1366 microversion: 2.1 time: 0.300603 Jun 10 18:28:27.576395 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2997/6039] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:27 2022] GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48 => generated 1366 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:27.661050 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6d08ae30-7c7c-4dca-8762-bea40561327a tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:27.692904 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6d08ae30-7c7c-4dca-8762-bea40561327a tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 200 len: 1261 microversion: 2.1 time: 0.162143 Jun 10 18:28:27.697110 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3043/6040] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:27 2022] GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:28.005710 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-df9605ed-4c08-4756-a0fc-861e1d1afb58 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:28.006424 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-df9605ed-4c08-4756-a0fc-861e1d1afb58 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: 16cde621-ad89-4ebd-b414-9c3c8b68b1d1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:28.021322 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df9605ed-4c08-4756-a0fc-861e1d1afb58 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:28.024692 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df9605ed-4c08-4756-a0fc-861e1d1afb58 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:28.030622 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df9605ed-4c08-4756-a0fc-861e1d1afb58 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:28.030622 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df9605ed-4c08-4756-a0fc-861e1d1afb58 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:28.195230 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-df9605ed-4c08-4756-a0fc-861e1d1afb58 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7708b6c6945d486294f66e4feb39484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec0f8b847fd40c5a87823996d0cb811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:28.203565 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-df9605ed-4c08-4756-a0fc-861e1d1afb58 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] 10.222.0.35 "GET /compute/v2.1/servers/16cde621-ad89-4ebd-b414-9c3c8b68b1d1" status: 200 len: 1313 microversion: 2.1 time: 0.202489 Jun 10 18:28:28.204159 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2998/6041] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:27 2022] GET /compute/v2.1/servers/16cde621-ad89-4ebd-b414-9c3c8b68b1d1 => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:28.597673 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-dce6040f-9457-4abc-a40c-8d31c3ffa44d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:28.599948 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-dce6040f-9457-4abc-a40c-8d31c3ffa44d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 1c741087-7c53-4118-8b3d-9654a4f6ff48] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:28.624590 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dce6040f-9457-4abc-a40c-8d31c3ffa44d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:28.625377 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dce6040f-9457-4abc-a40c-8d31c3ffa44d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:28.626321 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dce6040f-9457-4abc-a40c-8d31c3ffa44d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:28.627226 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dce6040f-9457-4abc-a40c-8d31c3ffa44d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:28.711281 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a549b7c8-17a5-41d8-8da2-6b57f24b7a05 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:28.712695 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a549b7c8-17a5-41d8-8da2-6b57f24b7a05 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:28.720027 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a549b7c8-17a5-41d8-8da2-6b57f24b7a05 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:28.720754 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a549b7c8-17a5-41d8-8da2-6b57f24b7a05 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:28.721728 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a549b7c8-17a5-41d8-8da2-6b57f24b7a05 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:28.722471 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a549b7c8-17a5-41d8-8da2-6b57f24b7a05 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:28.820463 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-dce6040f-9457-4abc-a40c-8d31c3ffa44d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:28.830810 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-dce6040f-9457-4abc-a40c-8d31c3ffa44d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48" status: 200 len: 1366 microversion: 2.1 time: 0.240976 Jun 10 18:28:28.845034 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3044/6042] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:28 2022] GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48 => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:29.135723 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a549b7c8-17a5-41d8-8da2-6b57f24b7a05 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:29.145516 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a549b7c8-17a5-41d8-8da2-6b57f24b7a05 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 200 len: 1309 microversion: 2.1 time: 0.437325 Jun 10 18:28:29.147988 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 2999/6043] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:28 2022] GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 1309 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:29.222393 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2a42e51c-2863-49b2-b645-7b1d6bde44e6 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:29.224420 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2a42e51c-2863-49b2-b645-7b1d6bde44e6 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: 16cde621-ad89-4ebd-b414-9c3c8b68b1d1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:29.234282 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2a42e51c-2863-49b2-b645-7b1d6bde44e6 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:29.234282 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2a42e51c-2863-49b2-b645-7b1d6bde44e6 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:29.234968 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2a42e51c-2863-49b2-b645-7b1d6bde44e6 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:29.235919 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2a42e51c-2863-49b2-b645-7b1d6bde44e6 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:29.409054 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2a42e51c-2863-49b2-b645-7b1d6bde44e6 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7708b6c6945d486294f66e4feb39484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec0f8b847fd40c5a87823996d0cb811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:29.420697 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2a42e51c-2863-49b2-b645-7b1d6bde44e6 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] 10.222.0.35 "GET /compute/v2.1/servers/16cde621-ad89-4ebd-b414-9c3c8b68b1d1" status: 200 len: 1313 microversion: 2.1 time: 0.202665 Jun 10 18:28:29.422107 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3045/6044] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:29 2022] GET /compute/v2.1/servers/16cde621-ad89-4ebd-b414-9c3c8b68b1d1 => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:29.521218 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-9974f9a0-ea9b-4283-beab-548e30c70717 req-6fcddc9b-7856-4a6a-9de3-37be4ac0c888 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c741087-7c53-4118-8b3d-9654a4f6ff48", "name": "network-vif-plugged", "status": "completed", "tag": "787dd400-65e8-4954-b2ba-0f271b49a3a0"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:28:29.531902 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-9974f9a0-ea9b-4283-beab-548e30c70717 req-6fcddc9b-7856-4a6a-9de3-37be4ac0c888 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:29.532956 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-9974f9a0-ea9b-4283-beab-548e30c70717 req-6fcddc9b-7856-4a6a-9de3-37be4ac0c888 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:29.551284 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-9974f9a0-ea9b-4283-beab-548e30c70717 req-6fcddc9b-7856-4a6a-9de3-37be4ac0c888 service nova] Creating event network-vif-plugged:787dd400-65e8-4954-b2ba-0f271b49a3a0 for instance 1c741087-7c53-4118-8b3d-9654a4f6ff48 on chh1-master-2 Jun 10 18:28:29.556769 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-9974f9a0-ea9b-4283-beab-548e30c70717 req-6fcddc9b-7856-4a6a-9de3-37be4ac0c888 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040373 Jun 10 18:28:29.558006 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3000/6045] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:28:29.852482 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8f8c7320-614e-41a3-a8b7-d0e7d9fcd912 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:29.853778 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8f8c7320-614e-41a3-a8b7-d0e7d9fcd912 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 1c741087-7c53-4118-8b3d-9654a4f6ff48] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:29.861451 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8f8c7320-614e-41a3-a8b7-d0e7d9fcd912 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:29.861983 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8f8c7320-614e-41a3-a8b7-d0e7d9fcd912 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:29.862839 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8f8c7320-614e-41a3-a8b7-d0e7d9fcd912 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:29.863403 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8f8c7320-614e-41a3-a8b7-d0e7d9fcd912 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:30.047848 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8f8c7320-614e-41a3-a8b7-d0e7d9fcd912 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:30.057872 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8f8c7320-614e-41a3-a8b7-d0e7d9fcd912 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48" status: 200 len: 1366 microversion: 2.1 time: 0.210604 Jun 10 18:28:30.061527 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3046/6046] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:29 2022] GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:30.164169 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e5df8de2-79e7-4324-998f-efacfc7edbf4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:30.165638 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e5df8de2-79e7-4324-998f-efacfc7edbf4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:30.174286 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e5df8de2-79e7-4324-998f-efacfc7edbf4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:30.174913 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e5df8de2-79e7-4324-998f-efacfc7edbf4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:30.176530 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e5df8de2-79e7-4324-998f-efacfc7edbf4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:30.177135 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e5df8de2-79e7-4324-998f-efacfc7edbf4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:30.439583 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2cb2328e-55e0-4291-86c7-df4b30fbac86 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:30.440216 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2cb2328e-55e0-4291-86c7-df4b30fbac86 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: 16cde621-ad89-4ebd-b414-9c3c8b68b1d1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:30.450825 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e5df8de2-79e7-4324-998f-efacfc7edbf4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:30.453241 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2cb2328e-55e0-4291-86c7-df4b30fbac86 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:30.453885 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2cb2328e-55e0-4291-86c7-df4b30fbac86 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:30.458135 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2cb2328e-55e0-4291-86c7-df4b30fbac86 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:30.458849 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2cb2328e-55e0-4291-86c7-df4b30fbac86 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:30.471556 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e5df8de2-79e7-4324-998f-efacfc7edbf4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 200 len: 1309 microversion: 2.1 time: 0.311946 Jun 10 18:28:30.483980 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3001/6047] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:30 2022] GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 1309 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:31.103904 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-94ad878e-1a92-46d2-b0f2-18cbd71c78db tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:31.103904 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-94ad878e-1a92-46d2-b0f2-18cbd71c78db tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 1c741087-7c53-4118-8b3d-9654a4f6ff48] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:31.103904 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-94ad878e-1a92-46d2-b0f2-18cbd71c78db tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:31.103904 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-94ad878e-1a92-46d2-b0f2-18cbd71c78db tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:31.103904 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-94ad878e-1a92-46d2-b0f2-18cbd71c78db tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:31.103904 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-94ad878e-1a92-46d2-b0f2-18cbd71c78db tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:31.103904 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:28:31.140165 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2cb2328e-55e0-4291-86c7-df4b30fbac86 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7708b6c6945d486294f66e4feb39484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec0f8b847fd40c5a87823996d0cb811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:31.153919 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2cb2328e-55e0-4291-86c7-df4b30fbac86 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] 10.222.0.35 "GET /compute/v2.1/servers/16cde621-ad89-4ebd-b414-9c3c8b68b1d1" status: 200 len: 1497 microversion: 2.1 time: 0.719003 Jun 10 18:28:31.155340 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3047/6048] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:30 2022] GET /compute/v2.1/servers/16cde621-ad89-4ebd-b414-9c3c8b68b1d1 => generated 1497 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:31.253473 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-94ad878e-1a92-46d2-b0f2-18cbd71c78db tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:31.261456 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-94ad878e-1a92-46d2-b0f2-18cbd71c78db tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48" status: 200 len: 1366 microversion: 2.1 time: 0.190197 Jun 10 18:28:31.262122 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3002/6049] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:31 2022] GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48 => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:28:31.398360 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-51b45570-0fef-40df-9140-d8a81d1c2259 req-9274f696-81fb-4190-942e-cc83be65e4e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c8c17ac-552a-40e2-ae4f-bfd567d9168b", "tag": "c32c141d-5087-436c-ab0a-4928173b42da"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:28:31.407767 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-51b45570-0fef-40df-9140-d8a81d1c2259 req-9274f696-81fb-4190-942e-cc83be65e4e0 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:31.408223 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-51b45570-0fef-40df-9140-d8a81d1c2259 req-9274f696-81fb-4190-942e-cc83be65e4e0 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:31.422243 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-51b45570-0fef-40df-9140-d8a81d1c2259 req-9274f696-81fb-4190-942e-cc83be65e4e0 service nova] Creating event network-changed:c32c141d-5087-436c-ab0a-4928173b42da for instance 5c8c17ac-552a-40e2-ae4f-bfd567d9168b on chh1-master-2 Jun 10 18:28:31.427244 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-51b45570-0fef-40df-9140-d8a81d1c2259 req-9274f696-81fb-4190-942e-cc83be65e4e0 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033363 Jun 10 18:28:31.428055 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3048/6050] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:28:31.491945 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e4156195-30cd-44f8-8f25-c8d9bcc997ea tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:31.493352 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e4156195-30cd-44f8-8f25-c8d9bcc997ea tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:31.501455 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e4156195-30cd-44f8-8f25-c8d9bcc997ea tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:31.502275 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e4156195-30cd-44f8-8f25-c8d9bcc997ea tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:31.503110 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e4156195-30cd-44f8-8f25-c8d9bcc997ea tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:31.503673 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e4156195-30cd-44f8-8f25-c8d9bcc997ea tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:31.825236 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e4156195-30cd-44f8-8f25-c8d9bcc997ea tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:31.840247 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e4156195-30cd-44f8-8f25-c8d9bcc997ea tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 200 len: 1309 microversion: 2.1 time: 0.351785 Jun 10 18:28:31.850195 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3003/6051] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:31 2022] GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 1309 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:32.281346 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f4ee4f3f-75e8-47a1-a7be-3c23d0b1d05b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:32.283124 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f4ee4f3f-75e8-47a1-a7be-3c23d0b1d05b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 1c741087-7c53-4118-8b3d-9654a4f6ff48] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:32.295260 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4ee4f3f-75e8-47a1-a7be-3c23d0b1d05b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:32.296143 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4ee4f3f-75e8-47a1-a7be-3c23d0b1d05b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:32.297320 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4ee4f3f-75e8-47a1-a7be-3c23d0b1d05b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:32.297935 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4ee4f3f-75e8-47a1-a7be-3c23d0b1d05b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:32.525480 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-79503202-aa23-4b6e-95b4-f7f19bc3888d tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:32.526613 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-79503202-aa23-4b6e-95b4-f7f19bc3888d tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: 16cde621-ad89-4ebd-b414-9c3c8b68b1d1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:32.527315 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f4ee4f3f-75e8-47a1-a7be-3c23d0b1d05b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:32.533729 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:28:32.535855 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-79503202-aa23-4b6e-95b4-f7f19bc3888d tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:32.536569 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-79503202-aa23-4b6e-95b4-f7f19bc3888d tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:32.544438 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f4ee4f3f-75e8-47a1-a7be-3c23d0b1d05b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48" status: 200 len: 1557 microversion: 2.1 time: 0.261680 Jun 10 18:28:32.544573 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-79503202-aa23-4b6e-95b4-f7f19bc3888d tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:32.544658 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3049/6052] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:32 2022] GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48 => generated 1557 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:32.544733 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-79503202-aa23-4b6e-95b4-f7f19bc3888d tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:32.561636 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9ffec95b-daea-4ce2-bc4f-b5ef9fc5ee85 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:32.562431 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9ffec95b-daea-4ce2-bc4f-b5ef9fc5ee85 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 1c741087-7c53-4118-8b3d-9654a4f6ff48] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:32.569432 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9ffec95b-daea-4ce2-bc4f-b5ef9fc5ee85 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:32.569899 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9ffec95b-daea-4ce2-bc4f-b5ef9fc5ee85 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:32.570943 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9ffec95b-daea-4ce2-bc4f-b5ef9fc5ee85 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:32.571555 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9ffec95b-daea-4ce2-bc4f-b5ef9fc5ee85 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:32.582611 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-79503202-aa23-4b6e-95b4-f7f19bc3888d tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: 16cde621-ad89-4ebd-b414-9c3c8b68b1d1] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:28:32.664416 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9ffec95b-daea-4ce2-bc4f-b5ef9fc5ee85 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.108094 Jun 10 18:28:32.665936 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3050/6053] 10.222.0.35 () {58 vars in 1274 bytes} [Fri Jun 10 18:28:32 2022] GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:28:32.859068 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6d3b681d-946a-4645-931f-0a7b5fdb2c53 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:32.859816 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6d3b681d-946a-4645-931f-0a7b5fdb2c53 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:32.867610 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6d3b681d-946a-4645-931f-0a7b5fdb2c53 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:32.868069 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6d3b681d-946a-4645-931f-0a7b5fdb2c53 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:32.868905 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6d3b681d-946a-4645-931f-0a7b5fdb2c53 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:32.870756 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6d3b681d-946a-4645-931f-0a7b5fdb2c53 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:32.909688 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-79503202-aa23-4b6e-95b4-f7f19bc3888d tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] 10.222.0.35 "DELETE /compute/v2.1/servers/16cde621-ad89-4ebd-b414-9c3c8b68b1d1" status: 204 len: 0 microversion: 2.1 time: 0.388156 Jun 10 18:28:32.910487 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3004/6054] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:28:32 2022] DELETE /compute/v2.1/servers/16cde621-ad89-4ebd-b414-9c3c8b68b1d1 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 18:28:32.919028 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0150e6ee-a7e0-4149-a194-6f16261cdcc2 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:32.919989 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0150e6ee-a7e0-4149-a194-6f16261cdcc2 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: 16cde621-ad89-4ebd-b414-9c3c8b68b1d1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:32.926541 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0150e6ee-a7e0-4149-a194-6f16261cdcc2 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:32.927242 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0150e6ee-a7e0-4149-a194-6f16261cdcc2 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:32.928271 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0150e6ee-a7e0-4149-a194-6f16261cdcc2 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:32.928941 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0150e6ee-a7e0-4149-a194-6f16261cdcc2 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:33.138374 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0150e6ee-a7e0-4149-a194-6f16261cdcc2 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7708b6c6945d486294f66e4feb39484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec0f8b847fd40c5a87823996d0cb811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:33.157944 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0150e6ee-a7e0-4149-a194-6f16261cdcc2 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] 10.222.0.35 "GET /compute/v2.1/servers/16cde621-ad89-4ebd-b414-9c3c8b68b1d1" status: 200 len: 1503 microversion: 2.1 time: 0.242649 Jun 10 18:28:33.163403 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3005/6055] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:32 2022] GET /compute/v2.1/servers/16cde621-ad89-4ebd-b414-9c3c8b68b1d1 => generated 1503 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:33.206400 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6d3b681d-946a-4645-931f-0a7b5fdb2c53 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:33.216942 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6d3b681d-946a-4645-931f-0a7b5fdb2c53 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 200 len: 1309 microversion: 2.1 time: 0.363385 Jun 10 18:28:33.218489 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3051/6056] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:32 2022] GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 1309 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:28:33.991639 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-1ead1170-8df1-49b1-a3d4-a79969af6b02 req-e4ed52ec-4f63-449b-9b37-e9833e8285f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c741087-7c53-4118-8b3d-9654a4f6ff48", "tag": "787dd400-65e8-4954-b2ba-0f271b49a3a0"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:28:33.999256 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-1ead1170-8df1-49b1-a3d4-a79969af6b02 req-e4ed52ec-4f63-449b-9b37-e9833e8285f1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:33.999806 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-1ead1170-8df1-49b1-a3d4-a79969af6b02 req-e4ed52ec-4f63-449b-9b37-e9833e8285f1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:34.020000 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-1ead1170-8df1-49b1-a3d4-a79969af6b02 req-e4ed52ec-4f63-449b-9b37-e9833e8285f1 service nova] Creating event network-changed:787dd400-65e8-4954-b2ba-0f271b49a3a0 for instance 1c741087-7c53-4118-8b3d-9654a4f6ff48 on chh1-master-2 Jun 10 18:28:34.025309 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-1ead1170-8df1-49b1-a3d4-a79969af6b02 req-e4ed52ec-4f63-449b-9b37-e9833e8285f1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039835 Jun 10 18:28:34.026347 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3006/6057] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:28:34.177114 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c879f09f-52d7-4ffd-aecd-f5823ce15e3a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:34.177884 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c879f09f-52d7-4ffd-aecd-f5823ce15e3a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: 16cde621-ad89-4ebd-b414-9c3c8b68b1d1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:34.194625 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c879f09f-52d7-4ffd-aecd-f5823ce15e3a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:34.195272 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c879f09f-52d7-4ffd-aecd-f5823ce15e3a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:34.198629 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c879f09f-52d7-4ffd-aecd-f5823ce15e3a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:34.200463 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c879f09f-52d7-4ffd-aecd-f5823ce15e3a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:34.235198 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0e856a60-11df-4b9e-bace-3518efd723e2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:34.236264 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0e856a60-11df-4b9e-bace-3518efd723e2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:34.270172 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0e856a60-11df-4b9e-bace-3518efd723e2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:34.270660 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0e856a60-11df-4b9e-bace-3518efd723e2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:34.272955 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0e856a60-11df-4b9e-bace-3518efd723e2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:34.273407 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0e856a60-11df-4b9e-bace-3518efd723e2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:34.476841 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c879f09f-52d7-4ffd-aecd-f5823ce15e3a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7708b6c6945d486294f66e4feb39484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec0f8b847fd40c5a87823996d0cb811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:34.484933 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c879f09f-52d7-4ffd-aecd-f5823ce15e3a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] 10.222.0.35 "GET /compute/v2.1/servers/16cde621-ad89-4ebd-b414-9c3c8b68b1d1" status: 200 len: 1503 microversion: 2.1 time: 0.313860 Jun 10 18:28:34.509200 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3052/6058] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:34 2022] GET /compute/v2.1/servers/16cde621-ad89-4ebd-b414-9c3c8b68b1d1 => generated 1503 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:34.579557 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0e856a60-11df-4b9e-bace-3518efd723e2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:34.590664 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0e856a60-11df-4b9e-bace-3518efd723e2 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 200 len: 1309 microversion: 2.1 time: 0.359989 Jun 10 18:28:34.594201 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3007/6059] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:34 2022] GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 1309 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:35.502831 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bededec5-7ed5-4cc2-a779-f638dba0f191 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:35.504738 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bededec5-7ed5-4cc2-a779-f638dba0f191 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: 16cde621-ad89-4ebd-b414-9c3c8b68b1d1] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:35.507872 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:28:35.513433 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bededec5-7ed5-4cc2-a779-f638dba0f191 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:35.518151 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bededec5-7ed5-4cc2-a779-f638dba0f191 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:35.518151 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bededec5-7ed5-4cc2-a779-f638dba0f191 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:35.518151 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bededec5-7ed5-4cc2-a779-f638dba0f191 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:35.587651 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bededec5-7ed5-4cc2-a779-f638dba0f191 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7708b6c6945d486294f66e4feb39484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec0f8b847fd40c5a87823996d0cb811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:35.598534 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bededec5-7ed5-4cc2-a779-f638dba0f191 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] 10.222.0.35 "GET /compute/v2.1/servers/16cde621-ad89-4ebd-b414-9c3c8b68b1d1" status: 200 len: 1461 microversion: 2.1 time: 0.099717 Jun 10 18:28:35.618286 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ecef87b6-c975-4563-bd87-ecadbf709eff tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:35.620334 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ecef87b6-c975-4563-bd87-ecadbf709eff tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:35.626127 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3053/6060] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:35 2022] GET /compute/v2.1/servers/16cde621-ad89-4ebd-b414-9c3c8b68b1d1 => generated 1461 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:35.630144 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:28:35.637707 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=6 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:28:35.637707 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ecef87b6-c975-4563-bd87-ecadbf709eff tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:35.637707 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ecef87b6-c975-4563-bd87-ecadbf709eff tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:35.637707 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ecef87b6-c975-4563-bd87-ecadbf709eff tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:35.637707 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ecef87b6-c975-4563-bd87-ecadbf709eff tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:35.840036 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ecef87b6-c975-4563-bd87-ecadbf709eff tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:35.848469 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ecef87b6-c975-4563-bd87-ecadbf709eff tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 200 len: 1309 microversion: 2.1 time: 0.235509 Jun 10 18:28:35.849367 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3008/6061] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:35 2022] GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 1309 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:36.049923 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-6972a8e8-9de5-404a-a591-7be5a4905606 req-f439f89d-c80f-42ae-8652-960cc8fabca8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16cde621-ad89-4ebd-b414-9c3c8b68b1d1", "name": "network-vif-deleted", "tag": "f4c4b914-7160-444b-af90-33150b523bc7"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:28:36.061941 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-6972a8e8-9de5-404a-a591-7be5a4905606 req-f439f89d-c80f-42ae-8652-960cc8fabca8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:36.062708 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-6972a8e8-9de5-404a-a591-7be5a4905606 req-f439f89d-c80f-42ae-8652-960cc8fabca8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:36.076086 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-6972a8e8-9de5-404a-a591-7be5a4905606 req-f439f89d-c80f-42ae-8652-960cc8fabca8 service nova] Creating event network-vif-deleted:f4c4b914-7160-444b-af90-33150b523bc7 for instance 16cde621-ad89-4ebd-b414-9c3c8b68b1d1 on chh2-master-2 Jun 10 18:28:36.084740 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-6972a8e8-9de5-404a-a591-7be5a4905606 req-f439f89d-c80f-42ae-8652-960cc8fabca8 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042865 Jun 10 18:28:36.085614 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3054/6062] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:28:36.623817 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0f512ba6-c71c-4560-8fcf-f4a0b062e0b2 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:36.623817 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0f512ba6-c71c-4560-8fcf-f4a0b062e0b2 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: 16cde621-ad89-4ebd-b414-9c3c8b68b1d1] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:36.627087 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0f512ba6-c71c-4560-8fcf-f4a0b062e0b2 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:36.627549 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0f512ba6-c71c-4560-8fcf-f4a0b062e0b2 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:36.628622 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0f512ba6-c71c-4560-8fcf-f4a0b062e0b2 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:36.629833 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0f512ba6-c71c-4560-8fcf-f4a0b062e0b2 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:36.647045 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-0f512ba6-c71c-4560-8fcf-f4a0b062e0b2 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] HTTP exception thrown: Instance 16cde621-ad89-4ebd-b414-9c3c8b68b1d1 could not be found. Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0f512ba6-c71c-4560-8fcf-f4a0b062e0b2 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Request method failure captured: Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/16cde621-ad89-4ebd-b414-9c3c8b68b1d1 HTTP/1.1 Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio40z3g6UyOS4gseMgmb6yBnMrU_SBVB1EnxGgf5sGpbWYiqc-LW_Zfx6SibSzLO421TdPpewiN4sWTpX61xALC-bWFJhSYTQqPnvTskZ2ST8g8QnVZM_aHXlyvbvzTdlZc6iySFObsmI5m680poxgxX_lTywHumaiZ50TsbdXrEoWuE Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: eec0f8b847fd40c5a87823996d0cb811 Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-VolumesActionsTest-791386929 Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/eec0f8b847fd40c5a87823996d0cb811"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/eec0f8b847fd40c5a87823996d0cb811"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/eec0f8b847fd40c5a87823996d0cb811"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_eec0f8b847fd40c5a87823996d0cb811", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-VolumesActionsTest-791386929 Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: eec0f8b847fd40c5a87823996d0cb811 Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-VolumesActionsTest-791386929 Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-VolumesActionsTest-791386929-project Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 7708b6c6945d486294f66e4feb39484d Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-VolumesActionsTest-791386929-project Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 16cde621-ad89-4ebd-b414-9c3c8b68b1d1 could not be found. Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '16cde621-ad89-4ebd-b414-9c3c8b68b1d1'} Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16cde621-ad89-4ebd-b414-9c3c8b68b1d1 could not be found. Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16cde621-ad89-4ebd-b414-9c3c8b68b1d1 could not be found. Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:28:36.648770 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:28:36.652910 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:28:36.652910 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:28:36.652910 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:28:36.652910 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:28:36.652910 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:28:36.652910 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16cde621-ad89-4ebd-b414-9c3c8b68b1d1 could not be found. Jun 10 18:28:36.652910 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:28:36.654529 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0f512ba6-c71c-4560-8fcf-f4a0b062e0b2 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Returning 404 to user: Instance 16cde621-ad89-4ebd-b414-9c3c8b68b1d1 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:28:36.655559 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0f512ba6-c71c-4560-8fcf-f4a0b062e0b2 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] 10.222.0.35 "GET /compute/v2.1/servers/16cde621-ad89-4ebd-b414-9c3c8b68b1d1" status: 404 len: 111 microversion: 2.1 time: 0.041534 Jun 10 18:28:36.656136 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3009/6063] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:36 2022] GET /compute/v2.1/servers/16cde621-ad89-4ebd-b414-9c3c8b68b1d1 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:28:36.757655 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1e6f754a-2ac7-4178-8360-0b56b0080553 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-665881749", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "c8f8c9a4-e16a-4cc5-80db-f447244a8c18"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:28:36.813721 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-1e6f754a-2ac7-4178-8360-0b56b0080553 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] validate_networks() for [('c8f8c9a4-e16a-4cc5-80db-f447244a8c18', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:28:36.866577 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7b3a5428-5b50-4a4f-bb71-360db4ad6192 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:36.867660 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7b3a5428-5b50-4a4f-bb71-360db4ad6192 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:36.874305 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b3a5428-5b50-4a4f-bb71-360db4ad6192 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:36.874914 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b3a5428-5b50-4a4f-bb71-360db4ad6192 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:36.875812 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b3a5428-5b50-4a4f-bb71-360db4ad6192 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:36.876491 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b3a5428-5b50-4a4f-bb71-360db4ad6192 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:37.072927 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7b3a5428-5b50-4a4f-bb71-360db4ad6192 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:37.081426 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7b3a5428-5b50-4a4f-bb71-360db4ad6192 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 200 len: 1309 microversion: 2.1 time: 0.219416 Jun 10 18:28:37.082043 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3010/6064] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:36 2022] GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 1309 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:28:37.303034 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-1e6f754a-2ac7-4178-8360-0b56b0080553 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:28:37.303467 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-1e6f754a-2ac7-4178-8360-0b56b0080553 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:28:37.303946 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-1e6f754a-2ac7-4178-8360-0b56b0080553 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:28:37.304410 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-1e6f754a-2ac7-4178-8360-0b56b0080553 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:28:37.304824 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-1e6f754a-2ac7-4178-8360-0b56b0080553 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:28:37.314042 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1e6f754a-2ac7-4178-8360-0b56b0080553 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:37.314497 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1e6f754a-2ac7-4178-8360-0b56b0080553 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:37.315292 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1e6f754a-2ac7-4178-8360-0b56b0080553 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:37.315733 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1e6f754a-2ac7-4178-8360-0b56b0080553 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:37.333784 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-1e6f754a-2ac7-4178-8360-0b56b0080553 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Getting quotas for project eec0f8b847fd40c5a87823996d0cb811. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:28:37.339312 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-1e6f754a-2ac7-4178-8360-0b56b0080553 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Getting quotas for user 7708b6c6945d486294f66e4feb39484d and project eec0f8b847fd40c5a87823996d0cb811. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:28:37.341807 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:28:37.352840 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1e6f754a-2ac7-4178-8360-0b56b0080553 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:28:37.355211 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1e6f754a-2ac7-4178-8360-0b56b0080553 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: c0919f2f-4ef1-40db-a589-fa4146f50801] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:28:37.600373 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1e6f754a-2ac7-4178-8360-0b56b0080553 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.847308 Jun 10 18:28:37.601213 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3055/6065] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:28:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:28:37.611451 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f91bf583-e7a8-4bee-89c2-d6caf0db369f tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:37.612150 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f91bf583-e7a8-4bee-89c2-d6caf0db369f tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: c0919f2f-4ef1-40db-a589-fa4146f50801] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:37.699168 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f91bf583-e7a8-4bee-89c2-d6caf0db369f tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7708b6c6945d486294f66e4feb39484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec0f8b847fd40c5a87823996d0cb811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:37.708784 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f91bf583-e7a8-4bee-89c2-d6caf0db369f tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] 10.222.0.35 "GET /compute/v2.1/servers/c0919f2f-4ef1-40db-a589-fa4146f50801" status: 200 len: 1213 microversion: 2.1 time: 0.101463 Jun 10 18:28:37.719243 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3011/6066] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:37 2022] GET /compute/v2.1/servers/c0919f2f-4ef1-40db-a589-fa4146f50801 => generated 1213 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:37.794710 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-550b96de-7993-4f85-89ee-39e9b1f2789c req-c23f0280-3784-48dc-aff1-a227d02acbc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c8c17ac-552a-40e2-ae4f-bfd567d9168b", "name": "network-vif-plugged", "status": "completed", "tag": "c32c141d-5087-436c-ab0a-4928173b42da"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:28:37.807146 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-550b96de-7993-4f85-89ee-39e9b1f2789c req-c23f0280-3784-48dc-aff1-a227d02acbc0 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:37.808086 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-550b96de-7993-4f85-89ee-39e9b1f2789c req-c23f0280-3784-48dc-aff1-a227d02acbc0 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:37.821397 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-550b96de-7993-4f85-89ee-39e9b1f2789c req-c23f0280-3784-48dc-aff1-a227d02acbc0 service nova] Creating event network-vif-plugged:c32c141d-5087-436c-ab0a-4928173b42da for instance 5c8c17ac-552a-40e2-ae4f-bfd567d9168b on chh1-master-2 Jun 10 18:28:37.828840 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-550b96de-7993-4f85-89ee-39e9b1f2789c req-c23f0280-3784-48dc-aff1-a227d02acbc0 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040257 Jun 10 18:28:37.829459 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3056/6067] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:28:38.107641 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b917f9c2-3516-4db5-97b7-41df382b2558 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:38.108406 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b917f9c2-3516-4db5-97b7-41df382b2558 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:38.116012 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b917f9c2-3516-4db5-97b7-41df382b2558 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:38.116503 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b917f9c2-3516-4db5-97b7-41df382b2558 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:38.117300 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b917f9c2-3516-4db5-97b7-41df382b2558 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:38.117740 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b917f9c2-3516-4db5-97b7-41df382b2558 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:38.268584 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b917f9c2-3516-4db5-97b7-41df382b2558 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:38.279204 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b917f9c2-3516-4db5-97b7-41df382b2558 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 200 len: 1309 microversion: 2.1 time: 0.176097 Jun 10 18:28:38.289690 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3012/6068] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:38 2022] GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 1309 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:38.727622 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3110b52a-bbce-496e-9fdb-e49b47d37e40 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:38.728627 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3110b52a-bbce-496e-9fdb-e49b47d37e40 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: c0919f2f-4ef1-40db-a589-fa4146f50801] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:38.735138 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3110b52a-bbce-496e-9fdb-e49b47d37e40 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:38.735596 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3110b52a-bbce-496e-9fdb-e49b47d37e40 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:38.736408 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3110b52a-bbce-496e-9fdb-e49b47d37e40 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:38.736856 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3110b52a-bbce-496e-9fdb-e49b47d37e40 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:38.823003 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3110b52a-bbce-496e-9fdb-e49b47d37e40 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7708b6c6945d486294f66e4feb39484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec0f8b847fd40c5a87823996d0cb811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:38.833717 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3110b52a-bbce-496e-9fdb-e49b47d37e40 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] 10.222.0.35 "GET /compute/v2.1/servers/c0919f2f-4ef1-40db-a589-fa4146f50801" status: 200 len: 1217 microversion: 2.1 time: 0.110941 Jun 10 18:28:38.834408 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3057/6069] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:38 2022] GET /compute/v2.1/servers/c0919f2f-4ef1-40db-a589-fa4146f50801 => generated 1217 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:39.297224 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bb4d7232-ba28-4d36-8cf9-a6e25b0c805a tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:39.297782 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bb4d7232-ba28-4d36-8cf9-a6e25b0c805a tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:39.309582 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb4d7232-ba28-4d36-8cf9-a6e25b0c805a tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:39.310044 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb4d7232-ba28-4d36-8cf9-a6e25b0c805a tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:39.312280 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb4d7232-ba28-4d36-8cf9-a6e25b0c805a tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:39.312280 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb4d7232-ba28-4d36-8cf9-a6e25b0c805a tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:39.493049 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bb4d7232-ba28-4d36-8cf9-a6e25b0c805a tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:39.500786 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bb4d7232-ba28-4d36-8cf9-a6e25b0c805a tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 200 len: 1309 microversion: 2.1 time: 0.208070 Jun 10 18:28:39.504348 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3013/6070] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:39 2022] GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 1309 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:39.851444 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3c27090f-42fb-4950-896e-a5a37af363ee tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:39.852058 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3c27090f-42fb-4950-896e-a5a37af363ee tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: c0919f2f-4ef1-40db-a589-fa4146f50801] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:39.859763 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3c27090f-42fb-4950-896e-a5a37af363ee tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:39.860148 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3c27090f-42fb-4950-896e-a5a37af363ee tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:39.860956 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3c27090f-42fb-4950-896e-a5a37af363ee tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:39.861397 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3c27090f-42fb-4950-896e-a5a37af363ee tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:39.929178 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3c27090f-42fb-4950-896e-a5a37af363ee tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7708b6c6945d486294f66e4feb39484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec0f8b847fd40c5a87823996d0cb811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:39.936791 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3c27090f-42fb-4950-896e-a5a37af363ee tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] 10.222.0.35 "GET /compute/v2.1/servers/c0919f2f-4ef1-40db-a589-fa4146f50801" status: 200 len: 1265 microversion: 2.1 time: 0.089308 Jun 10 18:28:39.937396 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3058/6071] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:39 2022] GET /compute/v2.1/servers/c0919f2f-4ef1-40db-a589-fa4146f50801 => generated 1265 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:40.518288 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0eeef6ed-6c46-4bd8-821f-ab973bb34f4d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:40.518971 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0eeef6ed-6c46-4bd8-821f-ab973bb34f4d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:40.526620 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0eeef6ed-6c46-4bd8-821f-ab973bb34f4d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:40.527075 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0eeef6ed-6c46-4bd8-821f-ab973bb34f4d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:40.527857 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0eeef6ed-6c46-4bd8-821f-ab973bb34f4d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:40.528323 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0eeef6ed-6c46-4bd8-821f-ab973bb34f4d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:40.702399 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0eeef6ed-6c46-4bd8-821f-ab973bb34f4d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:40.732026 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0eeef6ed-6c46-4bd8-821f-ab973bb34f4d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 200 len: 1489 microversion: 2.1 time: 0.217520 Jun 10 18:28:40.735592 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3014/6072] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:40 2022] GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 1489 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:40.750528 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-30cd924d-aec7-486f-943e-7add7a85edd4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1769281511"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:28:40.752232 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-30cd924d-aec7-486f-943e-7add7a85edd4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:40.758564 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-30cd924d-aec7-486f-943e-7add7a85edd4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:40.759074 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-30cd924d-aec7-486f-943e-7add7a85edd4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:40.759882 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-30cd924d-aec7-486f-943e-7add7a85edd4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:40.760296 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-30cd924d-aec7-486f-943e-7add7a85edd4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:40.955114 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dc5a5646-dfd0-4d05-9278-4076de465633 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:40.955700 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dc5a5646-dfd0-4d05-9278-4076de465633 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: c0919f2f-4ef1-40db-a589-fa4146f50801] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:40.967539 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc5a5646-dfd0-4d05-9278-4076de465633 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:40.968791 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc5a5646-dfd0-4d05-9278-4076de465633 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:40.969799 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc5a5646-dfd0-4d05-9278-4076de465633 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:40.970263 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc5a5646-dfd0-4d05-9278-4076de465633 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:40.977143 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-30cd924d-aec7-486f-943e-7add7a85edd4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "PUT /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 200 len: 1074 microversion: 2.1 time: 0.230492 Jun 10 18:28:40.979041 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3059/6073] 10.222.0.35 () {60 vars in 1255 bytes} [Fri Jun 10 18:28:40 2022] PUT /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 1074 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:40.997827 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4367c02c-a645-439f-be39-afc87ab0e9cb tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:40.998463 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4367c02c-a645-439f-be39-afc87ab0e9cb tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:41.010773 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4367c02c-a645-439f-be39-afc87ab0e9cb tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:41.011539 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4367c02c-a645-439f-be39-afc87ab0e9cb tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:41.013385 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4367c02c-a645-439f-be39-afc87ab0e9cb tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:41.014377 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4367c02c-a645-439f-be39-afc87ab0e9cb tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:41.043396 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-dc5a5646-dfd0-4d05-9278-4076de465633 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7708b6c6945d486294f66e4feb39484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec0f8b847fd40c5a87823996d0cb811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:41.051465 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dc5a5646-dfd0-4d05-9278-4076de465633 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] 10.222.0.35 "GET /compute/v2.1/servers/c0919f2f-4ef1-40db-a589-fa4146f50801" status: 200 len: 1271 microversion: 2.1 time: 0.100512 Jun 10 18:28:41.058044 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3015/6074] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:40 2022] GET /compute/v2.1/servers/c0919f2f-4ef1-40db-a589-fa4146f50801 => generated 1271 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:28:41.320478 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4367c02c-a645-439f-be39-afc87ab0e9cb tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:41.328922 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4367c02c-a645-439f-be39-afc87ab0e9cb tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 200 len: 1500 microversion: 2.1 time: 0.339117 Jun 10 18:28:41.329613 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3060/6075] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:40 2022] GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 1500 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:41.346771 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-10454393-4455-42da-805c-cc67c6f388df tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:41.347727 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-10454393-4455-42da-805c-cc67c6f388df tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:41.354669 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10454393-4455-42da-805c-cc67c6f388df tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:41.357887 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10454393-4455-42da-805c-cc67c6f388df tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:41.357887 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10454393-4455-42da-805c-cc67c6f388df tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:41.357887 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10454393-4455-42da-805c-cc67c6f388df tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:41.519443 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-10454393-4455-42da-805c-cc67c6f388df tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:41.531114 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-10454393-4455-42da-805c-cc67c6f388df tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 200 len: 1500 microversion: 2.1 time: 0.187037 Jun 10 18:28:41.532587 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3016/6076] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:41 2022] GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 1500 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:41.548010 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-24ccaa4c-aa89-41d5-882f-df4cb6e367b8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:28:41.554985 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-24ccaa4c-aa89-41d5-882f-df4cb6e367b8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:41.555767 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-24ccaa4c-aa89-41d5-882f-df4cb6e367b8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:41.581548 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-24ccaa4c-aa89-41d5-882f-df4cb6e367b8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Going to try to stop instance {{(pid=126594) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 10 18:28:41.839738 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-24ccaa4c-aa89-41d5-882f-df4cb6e367b8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "POST /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b/action" status: 202 len: 0 microversion: 2.1 time: 0.295347 Jun 10 18:28:41.845617 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3061/6077] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:28:41 2022] POST /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:28:41.862030 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8d26e6b4-92ec-4b7d-87f1-9620e330cae4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:41.866958 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8d26e6b4-92ec-4b7d-87f1-9620e330cae4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:41.878601 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8d26e6b4-92ec-4b7d-87f1-9620e330cae4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:41.879183 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8d26e6b4-92ec-4b7d-87f1-9620e330cae4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:41.880178 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8d26e6b4-92ec-4b7d-87f1-9620e330cae4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:41.880734 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8d26e6b4-92ec-4b7d-87f1-9620e330cae4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:42.070595 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8d26e6b4-92ec-4b7d-87f1-9620e330cae4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:42.076490 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-093affd2-82f8-4d57-80f0-6ff499315ace tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:42.078006 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-093affd2-82f8-4d57-80f0-6ff499315ace tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: c0919f2f-4ef1-40db-a589-fa4146f50801] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:42.081982 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8d26e6b4-92ec-4b7d-87f1-9620e330cae4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 200 len: 1510 microversion: 2.1 time: 0.233571 Jun 10 18:28:42.083686 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3017/6078] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:41 2022] GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 1510 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:42.102250 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-093affd2-82f8-4d57-80f0-6ff499315ace tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:42.102790 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-093affd2-82f8-4d57-80f0-6ff499315ace tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:42.103658 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-093affd2-82f8-4d57-80f0-6ff499315ace tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:42.104448 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-093affd2-82f8-4d57-80f0-6ff499315ace tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:42.329216 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-093affd2-82f8-4d57-80f0-6ff499315ace tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7708b6c6945d486294f66e4feb39484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec0f8b847fd40c5a87823996d0cb811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:42.337551 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-093affd2-82f8-4d57-80f0-6ff499315ace tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] 10.222.0.35 "GET /compute/v2.1/servers/c0919f2f-4ef1-40db-a589-fa4146f50801" status: 200 len: 1313 microversion: 2.1 time: 0.267118 Jun 10 18:28:42.338134 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3062/6079] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:42 2022] GET /compute/v2.1/servers/c0919f2f-4ef1-40db-a589-fa4146f50801 => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:42.532782 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-88309b18-cc97-46dd-90fa-c529b69f13fa req-9ed114f1-db2c-47d1-aa93-586a6a39a846 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0919f2f-4ef1-40db-a589-fa4146f50801", "tag": "51d0b84d-9f8c-4a15-9661-444d54fd7386"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:28:42.550742 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-88309b18-cc97-46dd-90fa-c529b69f13fa req-9ed114f1-db2c-47d1-aa93-586a6a39a846 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:42.551834 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-88309b18-cc97-46dd-90fa-c529b69f13fa req-9ed114f1-db2c-47d1-aa93-586a6a39a846 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:42.563728 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-88309b18-cc97-46dd-90fa-c529b69f13fa req-9ed114f1-db2c-47d1-aa93-586a6a39a846 service nova] Creating event network-changed:51d0b84d-9f8c-4a15-9661-444d54fd7386 for instance c0919f2f-4ef1-40db-a589-fa4146f50801 on chh2-master-2 Jun 10 18:28:42.569255 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-88309b18-cc97-46dd-90fa-c529b69f13fa req-9ed114f1-db2c-47d1-aa93-586a6a39a846 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040522 Jun 10 18:28:42.570043 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3018/6080] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:28:43.103744 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ada06fb6-8d0e-4c50-9e56-a69c8dfaa91e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:43.104477 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ada06fb6-8d0e-4c50-9e56-a69c8dfaa91e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:43.113880 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ada06fb6-8d0e-4c50-9e56-a69c8dfaa91e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:43.114637 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ada06fb6-8d0e-4c50-9e56-a69c8dfaa91e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:43.115687 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ada06fb6-8d0e-4c50-9e56-a69c8dfaa91e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:43.116289 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ada06fb6-8d0e-4c50-9e56-a69c8dfaa91e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:43.356740 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-72e639fe-4ed2-4623-9732-c248be2b5b16 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:43.358345 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-72e639fe-4ed2-4623-9732-c248be2b5b16 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: c0919f2f-4ef1-40db-a589-fa4146f50801] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:43.368631 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72e639fe-4ed2-4623-9732-c248be2b5b16 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:43.369681 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72e639fe-4ed2-4623-9732-c248be2b5b16 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:43.370847 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72e639fe-4ed2-4623-9732-c248be2b5b16 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:43.371613 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72e639fe-4ed2-4623-9732-c248be2b5b16 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:43.617996 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-72e639fe-4ed2-4623-9732-c248be2b5b16 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7708b6c6945d486294f66e4feb39484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec0f8b847fd40c5a87823996d0cb811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:43.631721 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-72e639fe-4ed2-4623-9732-c248be2b5b16 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] 10.222.0.35 "GET /compute/v2.1/servers/c0919f2f-4ef1-40db-a589-fa4146f50801" status: 200 len: 1313 microversion: 2.1 time: 0.279678 Jun 10 18:28:43.632210 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3019/6081] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:43 2022] GET /compute/v2.1/servers/c0919f2f-4ef1-40db-a589-fa4146f50801 => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:43.749003 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ada06fb6-8d0e-4c50-9e56-a69c8dfaa91e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:43.759007 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ada06fb6-8d0e-4c50-9e56-a69c8dfaa91e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 200 len: 1510 microversion: 2.1 time: 0.662236 Jun 10 18:28:43.760349 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3063/6082] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:43 2022] GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 1510 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:44.647277 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ceceeb5a-cb10-4b26-bdf3-6ffd21618912 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:44.647890 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ceceeb5a-cb10-4b26-bdf3-6ffd21618912 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: c0919f2f-4ef1-40db-a589-fa4146f50801] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:44.655535 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ceceeb5a-cb10-4b26-bdf3-6ffd21618912 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:44.655994 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ceceeb5a-cb10-4b26-bdf3-6ffd21618912 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:44.656808 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ceceeb5a-cb10-4b26-bdf3-6ffd21618912 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:44.657518 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ceceeb5a-cb10-4b26-bdf3-6ffd21618912 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:44.660375 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:28:44.777439 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-125caf8f-c354-455d-ba69-8087ffb44879 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:44.781635 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-125caf8f-c354-455d-ba69-8087ffb44879 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:44.786888 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-125caf8f-c354-455d-ba69-8087ffb44879 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:44.787665 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-125caf8f-c354-455d-ba69-8087ffb44879 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:44.788867 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-125caf8f-c354-455d-ba69-8087ffb44879 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:44.789536 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-125caf8f-c354-455d-ba69-8087ffb44879 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:44.855132 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ceceeb5a-cb10-4b26-bdf3-6ffd21618912 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7708b6c6945d486294f66e4feb39484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec0f8b847fd40c5a87823996d0cb811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:44.865372 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ceceeb5a-cb10-4b26-bdf3-6ffd21618912 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] 10.222.0.35 "GET /compute/v2.1/servers/c0919f2f-4ef1-40db-a589-fa4146f50801" status: 200 len: 1313 microversion: 2.1 time: 0.222144 Jun 10 18:28:44.866219 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3020/6083] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:44 2022] GET /compute/v2.1/servers/c0919f2f-4ef1-40db-a589-fa4146f50801 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:45.003287 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-125caf8f-c354-455d-ba69-8087ffb44879 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:45.020993 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-125caf8f-c354-455d-ba69-8087ffb44879 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 200 len: 1510 microversion: 2.1 time: 0.247951 Jun 10 18:28:45.021965 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3064/6084] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:44 2022] GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 1510 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:28:45.888900 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8679c6c3-1591-47df-9a4c-0f155e53d3e8 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:45.888900 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8679c6c3-1591-47df-9a4c-0f155e53d3e8 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: c0919f2f-4ef1-40db-a589-fa4146f50801] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:45.893485 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8679c6c3-1591-47df-9a4c-0f155e53d3e8 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:45.900802 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8679c6c3-1591-47df-9a4c-0f155e53d3e8 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:45.902111 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8679c6c3-1591-47df-9a4c-0f155e53d3e8 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:45.902248 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8679c6c3-1591-47df-9a4c-0f155e53d3e8 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:46.039060 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a23343fa-5830-4fb6-b8b8-27a71293a902 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:46.039776 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a23343fa-5830-4fb6-b8b8-27a71293a902 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:46.049959 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a23343fa-5830-4fb6-b8b8-27a71293a902 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:46.050402 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a23343fa-5830-4fb6-b8b8-27a71293a902 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:46.051729 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a23343fa-5830-4fb6-b8b8-27a71293a902 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:46.052175 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a23343fa-5830-4fb6-b8b8-27a71293a902 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:46.056913 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8679c6c3-1591-47df-9a4c-0f155e53d3e8 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7708b6c6945d486294f66e4feb39484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec0f8b847fd40c5a87823996d0cb811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:46.065612 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8679c6c3-1591-47df-9a4c-0f155e53d3e8 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] 10.222.0.35 "GET /compute/v2.1/servers/c0919f2f-4ef1-40db-a589-fa4146f50801" status: 200 len: 1313 microversion: 2.1 time: 0.187026 Jun 10 18:28:46.066198 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3021/6085] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:45 2022] GET /compute/v2.1/servers/c0919f2f-4ef1-40db-a589-fa4146f50801 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:46.208707 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a23343fa-5830-4fb6-b8b8-27a71293a902 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:46.217086 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a23343fa-5830-4fb6-b8b8-27a71293a902 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 200 len: 1510 microversion: 2.1 time: 0.182194 Jun 10 18:28:46.217813 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3065/6086] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:46 2022] GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 1510 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:47.084288 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3c708c8f-36f0-4dce-9c3f-d7103c5316d0 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:47.085581 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3c708c8f-36f0-4dce-9c3f-d7103c5316d0 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: c0919f2f-4ef1-40db-a589-fa4146f50801] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:47.093756 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3c708c8f-36f0-4dce-9c3f-d7103c5316d0 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:47.094449 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3c708c8f-36f0-4dce-9c3f-d7103c5316d0 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:47.095866 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3c708c8f-36f0-4dce-9c3f-d7103c5316d0 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:47.096816 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3c708c8f-36f0-4dce-9c3f-d7103c5316d0 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:47.237028 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3c708c8f-36f0-4dce-9c3f-d7103c5316d0 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7708b6c6945d486294f66e4feb39484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec0f8b847fd40c5a87823996d0cb811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:47.238556 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-44680574-6139-46e1-a7be-8ca28972ba15 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:47.239765 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-44680574-6139-46e1-a7be-8ca28972ba15 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:47.246365 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3c708c8f-36f0-4dce-9c3f-d7103c5316d0 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] 10.222.0.35 "GET /compute/v2.1/servers/c0919f2f-4ef1-40db-a589-fa4146f50801" status: 200 len: 1313 microversion: 2.1 time: 0.166505 Jun 10 18:28:47.250896 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-44680574-6139-46e1-a7be-8ca28972ba15 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:47.251436 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-44680574-6139-46e1-a7be-8ca28972ba15 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:47.252601 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-44680574-6139-46e1-a7be-8ca28972ba15 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:47.253421 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-44680574-6139-46e1-a7be-8ca28972ba15 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:47.256080 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3022/6087] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:47 2022] GET /compute/v2.1/servers/c0919f2f-4ef1-40db-a589-fa4146f50801 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:47.324661 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:28:47.347020 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=6 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:28:47.397149 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-44680574-6139-46e1-a7be-8ca28972ba15 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:47.405728 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-44680574-6139-46e1-a7be-8ca28972ba15 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 200 len: 1510 microversion: 2.1 time: 0.172301 Jun 10 18:28:47.406313 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3066/6088] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:47 2022] GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 1510 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:28:48.263829 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8eeaa117-950d-4d8f-a8a8-7ee69b35a88a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:48.264509 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8eeaa117-950d-4d8f-a8a8-7ee69b35a88a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: c0919f2f-4ef1-40db-a589-fa4146f50801] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:48.266438 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:28:48.272937 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8eeaa117-950d-4d8f-a8a8-7ee69b35a88a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:48.273403 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8eeaa117-950d-4d8f-a8a8-7ee69b35a88a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:48.276445 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8eeaa117-950d-4d8f-a8a8-7ee69b35a88a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:48.276445 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8eeaa117-950d-4d8f-a8a8-7ee69b35a88a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:48.432053 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ba5fab13-26ad-47c2-a1dc-58b2337a35ce tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:48.433929 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ba5fab13-26ad-47c2-a1dc-58b2337a35ce tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:48.443415 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ba5fab13-26ad-47c2-a1dc-58b2337a35ce tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:48.444472 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ba5fab13-26ad-47c2-a1dc-58b2337a35ce tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:48.445543 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ba5fab13-26ad-47c2-a1dc-58b2337a35ce tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:48.446338 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ba5fab13-26ad-47c2-a1dc-58b2337a35ce tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:48.453377 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:28:48.609907 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ba5fab13-26ad-47c2-a1dc-58b2337a35ce tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:48.611989 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8eeaa117-950d-4d8f-a8a8-7ee69b35a88a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7708b6c6945d486294f66e4feb39484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec0f8b847fd40c5a87823996d0cb811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:48.617501 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ba5fab13-26ad-47c2-a1dc-58b2337a35ce tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 200 len: 1510 microversion: 2.1 time: 0.198105 Jun 10 18:28:48.618098 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3067/6089] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:48 2022] GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 1510 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:28:48.619764 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8eeaa117-950d-4d8f-a8a8-7ee69b35a88a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] 10.222.0.35 "GET /compute/v2.1/servers/c0919f2f-4ef1-40db-a589-fa4146f50801" status: 200 len: 1313 microversion: 2.1 time: 0.359924 Jun 10 18:28:48.620364 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3023/6090] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:48 2022] GET /compute/v2.1/servers/c0919f2f-4ef1-40db-a589-fa4146f50801 => generated 1313 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:49.635347 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d8fc907a-493d-4697-ba6c-6abb499b3fdf tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:49.636710 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d8fc907a-493d-4697-ba6c-6abb499b3fdf tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:49.641632 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f5fc0e41-8162-4048-9465-aa14ae681a20 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:49.642258 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f5fc0e41-8162-4048-9465-aa14ae681a20 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: c0919f2f-4ef1-40db-a589-fa4146f50801] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:49.645483 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d8fc907a-493d-4697-ba6c-6abb499b3fdf tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:49.646165 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d8fc907a-493d-4697-ba6c-6abb499b3fdf tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:49.647307 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d8fc907a-493d-4697-ba6c-6abb499b3fdf tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:49.647934 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d8fc907a-493d-4697-ba6c-6abb499b3fdf tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:49.653865 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f5fc0e41-8162-4048-9465-aa14ae681a20 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:49.654320 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f5fc0e41-8162-4048-9465-aa14ae681a20 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:49.655096 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f5fc0e41-8162-4048-9465-aa14ae681a20 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:49.655534 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f5fc0e41-8162-4048-9465-aa14ae681a20 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:49.811791 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d8fc907a-493d-4697-ba6c-6abb499b3fdf tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:49.819950 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d8fc907a-493d-4697-ba6c-6abb499b3fdf tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 200 len: 1510 microversion: 2.1 time: 0.188885 Jun 10 18:28:49.821098 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3068/6091] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:49 2022] GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 1510 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:49.823478 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f5fc0e41-8162-4048-9465-aa14ae681a20 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7708b6c6945d486294f66e4feb39484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec0f8b847fd40c5a87823996d0cb811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:49.833746 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f5fc0e41-8162-4048-9465-aa14ae681a20 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] 10.222.0.35 "GET /compute/v2.1/servers/c0919f2f-4ef1-40db-a589-fa4146f50801" status: 200 len: 1313 microversion: 2.1 time: 0.199088 Jun 10 18:28:49.836126 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3024/6092] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:49 2022] GET /compute/v2.1/servers/c0919f2f-4ef1-40db-a589-fa4146f50801 => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:50.838002 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cfbac5a3-f28b-4485-bce0-63cad3096ffe tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:50.838628 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cfbac5a3-f28b-4485-bce0-63cad3096ffe tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:50.846050 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cfbac5a3-f28b-4485-bce0-63cad3096ffe tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:50.847396 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cfbac5a3-f28b-4485-bce0-63cad3096ffe tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:50.848916 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cfbac5a3-f28b-4485-bce0-63cad3096ffe tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:50.849600 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cfbac5a3-f28b-4485-bce0-63cad3096ffe tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:50.854048 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-130887e2-a6c3-4cda-b5d0-8fe76458b4f8 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:50.856039 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-130887e2-a6c3-4cda-b5d0-8fe76458b4f8 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: c0919f2f-4ef1-40db-a589-fa4146f50801] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:50.871417 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-130887e2-a6c3-4cda-b5d0-8fe76458b4f8 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:50.872322 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-130887e2-a6c3-4cda-b5d0-8fe76458b4f8 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:50.878249 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-130887e2-a6c3-4cda-b5d0-8fe76458b4f8 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:50.878249 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-130887e2-a6c3-4cda-b5d0-8fe76458b4f8 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:51.063128 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-130887e2-a6c3-4cda-b5d0-8fe76458b4f8 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7708b6c6945d486294f66e4feb39484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec0f8b847fd40c5a87823996d0cb811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:51.063883 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cfbac5a3-f28b-4485-bce0-63cad3096ffe tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:51.072188 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cfbac5a3-f28b-4485-bce0-63cad3096ffe tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 200 len: 1510 microversion: 2.1 time: 0.238220 Jun 10 18:28:51.076811 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3069/6093] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:50 2022] GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 1510 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:51.084905 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-130887e2-a6c3-4cda-b5d0-8fe76458b4f8 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] 10.222.0.35 "GET /compute/v2.1/servers/c0919f2f-4ef1-40db-a589-fa4146f50801" status: 200 len: 1313 microversion: 2.1 time: 0.222768 Jun 10 18:28:51.086422 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3025/6094] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:50 2022] GET /compute/v2.1/servers/c0919f2f-4ef1-40db-a589-fa4146f50801 => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:51.428549 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-ece35529-a0c8-42e0-bad3-e9bf3e017581 req-9a487179-579c-452c-8d0a-4dcaacf83b16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0919f2f-4ef1-40db-a589-fa4146f50801", "name": "network-vif-plugged", "status": "completed", "tag": "51d0b84d-9f8c-4a15-9661-444d54fd7386"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:28:51.437408 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-ece35529-a0c8-42e0-bad3-e9bf3e017581 req-9a487179-579c-452c-8d0a-4dcaacf83b16 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:51.438216 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-ece35529-a0c8-42e0-bad3-e9bf3e017581 req-9a487179-579c-452c-8d0a-4dcaacf83b16 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:51.450873 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-ece35529-a0c8-42e0-bad3-e9bf3e017581 req-9a487179-579c-452c-8d0a-4dcaacf83b16 service nova] Creating event network-vif-plugged:51d0b84d-9f8c-4a15-9661-444d54fd7386 for instance c0919f2f-4ef1-40db-a589-fa4146f50801 on chh2-master-2 Jun 10 18:28:51.456663 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-ece35529-a0c8-42e0-bad3-e9bf3e017581 req-9a487179-579c-452c-8d0a-4dcaacf83b16 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.249464 Jun 10 18:28:51.457712 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3070/6095] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:28:52.090220 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-88ee88d2-3505-4ae3-a87a-3baa94d369ab tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:52.091433 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-88ee88d2-3505-4ae3-a87a-3baa94d369ab tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:52.099228 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-88ee88d2-3505-4ae3-a87a-3baa94d369ab tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:52.099973 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-88ee88d2-3505-4ae3-a87a-3baa94d369ab tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:52.100987 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-88ee88d2-3505-4ae3-a87a-3baa94d369ab tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:52.101702 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-88ee88d2-3505-4ae3-a87a-3baa94d369ab tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:52.105457 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-af48122b-bc4f-4693-9ea8-28e178521e54 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:52.106245 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-af48122b-bc4f-4693-9ea8-28e178521e54 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: c0919f2f-4ef1-40db-a589-fa4146f50801] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:52.125231 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-af48122b-bc4f-4693-9ea8-28e178521e54 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:52.125755 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-af48122b-bc4f-4693-9ea8-28e178521e54 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:52.126610 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-af48122b-bc4f-4693-9ea8-28e178521e54 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:52.127190 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-af48122b-bc4f-4693-9ea8-28e178521e54 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:52.296909 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-88ee88d2-3505-4ae3-a87a-3baa94d369ab tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:52.306141 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-88ee88d2-3505-4ae3-a87a-3baa94d369ab tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 200 len: 1510 microversion: 2.1 time: 0.220114 Jun 10 18:28:52.306759 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3026/6096] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:52 2022] GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 1510 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:52.361264 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-af48122b-bc4f-4693-9ea8-28e178521e54 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7708b6c6945d486294f66e4feb39484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec0f8b847fd40c5a87823996d0cb811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:52.373724 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-af48122b-bc4f-4693-9ea8-28e178521e54 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] 10.222.0.35 "GET /compute/v2.1/servers/c0919f2f-4ef1-40db-a589-fa4146f50801" status: 200 len: 1313 microversion: 2.1 time: 0.272968 Jun 10 18:28:52.376966 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3071/6097] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:52 2022] GET /compute/v2.1/servers/c0919f2f-4ef1-40db-a589-fa4146f50801 => generated 1313 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:28:53.324078 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-faace0b4-dc66-4733-af12-6a61399d4e2e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:53.324906 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-faace0b4-dc66-4733-af12-6a61399d4e2e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:53.356490 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-faace0b4-dc66-4733-af12-6a61399d4e2e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:53.356883 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-faace0b4-dc66-4733-af12-6a61399d4e2e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:53.358236 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-faace0b4-dc66-4733-af12-6a61399d4e2e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:53.359050 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-faace0b4-dc66-4733-af12-6a61399d4e2e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:53.399132 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e5c9198d-6e4d-4dc7-8e4a-fe24c9170a1c tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:53.399899 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e5c9198d-6e4d-4dc7-8e4a-fe24c9170a1c tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: c0919f2f-4ef1-40db-a589-fa4146f50801] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:53.411955 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e5c9198d-6e4d-4dc7-8e4a-fe24c9170a1c tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:53.414840 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e5c9198d-6e4d-4dc7-8e4a-fe24c9170a1c tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:53.415771 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e5c9198d-6e4d-4dc7-8e4a-fe24c9170a1c tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:53.417068 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e5c9198d-6e4d-4dc7-8e4a-fe24c9170a1c tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:53.545786 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-faace0b4-dc66-4733-af12-6a61399d4e2e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:53.557775 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-faace0b4-dc66-4733-af12-6a61399d4e2e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 200 len: 1510 microversion: 2.1 time: 0.237541 Jun 10 18:28:53.560213 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3027/6098] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:53 2022] GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 1510 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:53.585106 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e5c9198d-6e4d-4dc7-8e4a-fe24c9170a1c tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7708b6c6945d486294f66e4feb39484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec0f8b847fd40c5a87823996d0cb811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:53.594266 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e5c9198d-6e4d-4dc7-8e4a-fe24c9170a1c tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] 10.222.0.35 "GET /compute/v2.1/servers/c0919f2f-4ef1-40db-a589-fa4146f50801" status: 200 len: 1498 microversion: 2.1 time: 0.200574 Jun 10 18:28:53.594854 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3072/6099] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:53 2022] GET /compute/v2.1/servers/c0919f2f-4ef1-40db-a589-fa4146f50801 => generated 1498 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:28:54.484371 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-10a929bf-d10d-4230-9bc4-85ba58b0c3d4 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:54.485138 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-10a929bf-d10d-4230-9bc4-85ba58b0c3d4 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: c0919f2f-4ef1-40db-a589-fa4146f50801] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:54.487897 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:28:54.492749 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10a929bf-d10d-4230-9bc4-85ba58b0c3d4 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:54.493201 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10a929bf-d10d-4230-9bc4-85ba58b0c3d4 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:54.493966 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10a929bf-d10d-4230-9bc4-85ba58b0c3d4 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:54.494403 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10a929bf-d10d-4230-9bc4-85ba58b0c3d4 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:54.523609 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-10a929bf-d10d-4230-9bc4-85ba58b0c3d4 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: c0919f2f-4ef1-40db-a589-fa4146f50801] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:28:54.578023 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2a0e8102-81b4-4785-b6ab-fbddad6afc5d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:54.578662 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2a0e8102-81b4-4785-b6ab-fbddad6afc5d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:54.587491 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2a0e8102-81b4-4785-b6ab-fbddad6afc5d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:54.588217 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2a0e8102-81b4-4785-b6ab-fbddad6afc5d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:54.589211 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2a0e8102-81b4-4785-b6ab-fbddad6afc5d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:54.589900 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2a0e8102-81b4-4785-b6ab-fbddad6afc5d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:54.766097 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2a0e8102-81b4-4785-b6ab-fbddad6afc5d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:54.774564 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2a0e8102-81b4-4785-b6ab-fbddad6afc5d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 200 len: 1510 microversion: 2.1 time: 0.201239 Jun 10 18:28:54.782915 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-10a929bf-d10d-4230-9bc4-85ba58b0c3d4 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] 10.222.0.35 "DELETE /compute/v2.1/servers/c0919f2f-4ef1-40db-a589-fa4146f50801" status: 204 len: 0 microversion: 2.1 time: 0.302731 Jun 10 18:28:54.784515 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3028/6100] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:28:54 2022] DELETE /compute/v2.1/servers/c0919f2f-4ef1-40db-a589-fa4146f50801 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:28:54.787709 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3073/6101] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:54 2022] GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 1510 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:28:54.797681 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fa184bd6-5431-491f-a5fc-8797f39d6a8a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:54.799951 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fa184bd6-5431-491f-a5fc-8797f39d6a8a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: c0919f2f-4ef1-40db-a589-fa4146f50801] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:54.810592 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fa184bd6-5431-491f-a5fc-8797f39d6a8a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:54.811930 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fa184bd6-5431-491f-a5fc-8797f39d6a8a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:54.813148 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fa184bd6-5431-491f-a5fc-8797f39d6a8a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:54.814463 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fa184bd6-5431-491f-a5fc-8797f39d6a8a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:54.984640 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fa184bd6-5431-491f-a5fc-8797f39d6a8a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7708b6c6945d486294f66e4feb39484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec0f8b847fd40c5a87823996d0cb811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:54.984640 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fa184bd6-5431-491f-a5fc-8797f39d6a8a tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] 10.222.0.35 "GET /compute/v2.1/servers/c0919f2f-4ef1-40db-a589-fa4146f50801" status: 200 len: 1504 microversion: 2.1 time: 0.191823 Jun 10 18:28:54.984640 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3074/6102] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:54 2022] GET /compute/v2.1/servers/c0919f2f-4ef1-40db-a589-fa4146f50801 => generated 1504 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:55.796073 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-397c4888-b933-4ca0-b455-6f1a51e0c2f4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:55.797370 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-397c4888-b933-4ca0-b455-6f1a51e0c2f4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:55.809080 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-397c4888-b933-4ca0-b455-6f1a51e0c2f4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:55.809979 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-397c4888-b933-4ca0-b455-6f1a51e0c2f4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:55.811822 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-397c4888-b933-4ca0-b455-6f1a51e0c2f4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:55.813043 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-397c4888-b933-4ca0-b455-6f1a51e0c2f4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:55.961329 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-397c4888-b933-4ca0-b455-6f1a51e0c2f4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:55.969746 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-397c4888-b933-4ca0-b455-6f1a51e0c2f4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 200 len: 1510 microversion: 2.1 time: 0.181124 Jun 10 18:28:55.970518 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3029/6103] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:55 2022] GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 1510 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:56.002048 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-afa9e96d-28e2-4ded-93d1-2a5dae130197 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:56.009604 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-afa9e96d-28e2-4ded-93d1-2a5dae130197 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: c0919f2f-4ef1-40db-a589-fa4146f50801] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:56.010539 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-afa9e96d-28e2-4ded-93d1-2a5dae130197 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:56.011120 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-afa9e96d-28e2-4ded-93d1-2a5dae130197 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:56.012110 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-afa9e96d-28e2-4ded-93d1-2a5dae130197 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:56.012576 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-afa9e96d-28e2-4ded-93d1-2a5dae130197 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:56.204495 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-afa9e96d-28e2-4ded-93d1-2a5dae130197 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7708b6c6945d486294f66e4feb39484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec0f8b847fd40c5a87823996d0cb811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:56.214556 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-afa9e96d-28e2-4ded-93d1-2a5dae130197 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] 10.222.0.35 "GET /compute/v2.1/servers/c0919f2f-4ef1-40db-a589-fa4146f50801" status: 200 len: 1504 microversion: 2.1 time: 0.216343 Jun 10 18:28:56.215155 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3075/6104] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:55 2022] GET /compute/v2.1/servers/c0919f2f-4ef1-40db-a589-fa4146f50801 => generated 1504 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:28:56.986850 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b9a8cfcd-ebd7-46f2-8234-3ad0e9dad40b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:56.987563 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b9a8cfcd-ebd7-46f2-8234-3ad0e9dad40b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:56.995555 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-e90bd437-6113-48ff-bd6f-fbc99bde1790 req-37e8a3c8-3e0b-43b6-bad6-c9fc5e72682e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0919f2f-4ef1-40db-a589-fa4146f50801", "name": "network-vif-deleted", "tag": "51d0b84d-9f8c-4a15-9661-444d54fd7386"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:28:57.010467 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9a8cfcd-ebd7-46f2-8234-3ad0e9dad40b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:57.011544 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-e90bd437-6113-48ff-bd6f-fbc99bde1790 req-37e8a3c8-3e0b-43b6-bad6-c9fc5e72682e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:57.012237 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9a8cfcd-ebd7-46f2-8234-3ad0e9dad40b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:57.013304 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9a8cfcd-ebd7-46f2-8234-3ad0e9dad40b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:57.013598 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-e90bd437-6113-48ff-bd6f-fbc99bde1790 req-37e8a3c8-3e0b-43b6-bad6-c9fc5e72682e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:57.014659 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9a8cfcd-ebd7-46f2-8234-3ad0e9dad40b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:57.030442 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-e90bd437-6113-48ff-bd6f-fbc99bde1790 req-37e8a3c8-3e0b-43b6-bad6-c9fc5e72682e service nova] Creating event network-vif-deleted:51d0b84d-9f8c-4a15-9661-444d54fd7386 for instance c0919f2f-4ef1-40db-a589-fa4146f50801 on chh2-master-2 Jun 10 18:28:57.049105 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-e90bd437-6113-48ff-bd6f-fbc99bde1790 req-37e8a3c8-3e0b-43b6-bad6-c9fc5e72682e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057049 Jun 10 18:28:57.055543 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3076/6105] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:28:57.191326 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b9a8cfcd-ebd7-46f2-8234-3ad0e9dad40b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:57.201283 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b9a8cfcd-ebd7-46f2-8234-3ad0e9dad40b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 200 len: 1510 microversion: 2.1 time: 0.218149 Jun 10 18:28:57.201975 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3030/6106] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:56 2022] GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 1510 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:57.232476 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f53df516-efba-425e-8fee-b77a71f3207c tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:57.234140 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f53df516-efba-425e-8fee-b77a71f3207c tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: c0919f2f-4ef1-40db-a589-fa4146f50801] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:57.241241 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f53df516-efba-425e-8fee-b77a71f3207c tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:57.241950 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f53df516-efba-425e-8fee-b77a71f3207c tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:57.242962 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f53df516-efba-425e-8fee-b77a71f3207c tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:57.244189 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f53df516-efba-425e-8fee-b77a71f3207c tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:57.326787 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f53df516-efba-425e-8fee-b77a71f3207c tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7708b6c6945d486294f66e4feb39484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec0f8b847fd40c5a87823996d0cb811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:57.335087 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f53df516-efba-425e-8fee-b77a71f3207c tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] 10.222.0.35 "GET /compute/v2.1/servers/c0919f2f-4ef1-40db-a589-fa4146f50801" status: 200 len: 1298 microversion: 2.1 time: 0.107647 Jun 10 18:28:57.335739 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3077/6107] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:57 2022] GET /compute/v2.1/servers/c0919f2f-4ef1-40db-a589-fa4146f50801 => generated 1298 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:58.219426 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8679a12a-ea11-47a7-ab84-ab37b470c760 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:58.228253 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8679a12a-ea11-47a7-ab84-ab37b470c760 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:58.255277 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8679a12a-ea11-47a7-ab84-ab37b470c760 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:58.255277 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8679a12a-ea11-47a7-ab84-ab37b470c760 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:58.255277 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8679a12a-ea11-47a7-ab84-ab37b470c760 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:58.255277 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8679a12a-ea11-47a7-ab84-ab37b470c760 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:58.352539 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f5f950b3-cc5f-4310-8ca3-7e2add6a0bc9 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:58.353159 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f5f950b3-cc5f-4310-8ca3-7e2add6a0bc9 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] [instance: c0919f2f-4ef1-40db-a589-fa4146f50801] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:58.363871 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f5f950b3-cc5f-4310-8ca3-7e2add6a0bc9 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:58.365854 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f5f950b3-cc5f-4310-8ca3-7e2add6a0bc9 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:58.368334 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f5f950b3-cc5f-4310-8ca3-7e2add6a0bc9 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:58.370513 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f5f950b3-cc5f-4310-8ca3-7e2add6a0bc9 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:58.407490 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-f5f950b3-cc5f-4310-8ca3-7e2add6a0bc9 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] HTTP exception thrown: Instance c0919f2f-4ef1-40db-a589-fa4146f50801 could not be found. Jun 10 18:28:58.413510 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8679a12a-ea11-47a7-ab84-ab37b470c760 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:58.424541 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8679a12a-ea11-47a7-ab84-ab37b470c760 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 200 len: 1510 microversion: 2.1 time: 0.208964 Jun 10 18:28:58.433083 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3031/6108] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:58 2022] GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 1510 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f5f950b3-cc5f-4310-8ca3-7e2add6a0bc9 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Request method failure captured: Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/c0919f2f-4ef1-40db-a589-fa4146f50801 HTTP/1.1 Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio40z3g6UyOS4gseMgmb6yBnMrU_SBVB1EnxGgf5sGpbWYiqc-LW_Zfx6SibSzLO421TdPpewiN4sWTpX61xALC-bWFJhSYTQqPnvTskZ2ST8g8QnVZM_aHXlyvbvzTdlZc6iySFObsmI5m680poxgxX_lTywHumaiZ50TsbdXrEoWuE Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: eec0f8b847fd40c5a87823996d0cb811 Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-VolumesActionsTest-791386929 Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/eec0f8b847fd40c5a87823996d0cb811"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/eec0f8b847fd40c5a87823996d0cb811"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/eec0f8b847fd40c5a87823996d0cb811"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_eec0f8b847fd40c5a87823996d0cb811", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-VolumesActionsTest-791386929 Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: eec0f8b847fd40c5a87823996d0cb811 Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-VolumesActionsTest-791386929 Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-VolumesActionsTest-791386929-project Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 7708b6c6945d486294f66e4feb39484d Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-VolumesActionsTest-791386929-project Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: exception: Instance c0919f2f-4ef1-40db-a589-fa4146f50801 could not be found. Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'c0919f2f-4ef1-40db-a589-fa4146f50801'} Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0919f2f-4ef1-40db-a589-fa4146f50801 could not be found. Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0919f2f-4ef1-40db-a589-fa4146f50801 could not be found. Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:28:58.437173 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:28:58.441965 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:28:58.441965 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:28:58.441965 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:28:58.441965 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:28:58.441965 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:28:58.441965 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0919f2f-4ef1-40db-a589-fa4146f50801 could not be found. Jun 10 18:28:58.441965 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:28:58.444811 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f5f950b3-cc5f-4310-8ca3-7e2add6a0bc9 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] Returning 404 to user: Instance c0919f2f-4ef1-40db-a589-fa4146f50801 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:28:58.447588 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f5f950b3-cc5f-4310-8ca3-7e2add6a0bc9 tempest-VolumesActionsTest-791386929 tempest-VolumesActionsTest-791386929-project] 10.222.0.35 "GET /compute/v2.1/servers/c0919f2f-4ef1-40db-a589-fa4146f50801" status: 404 len: 111 microversion: 2.1 time: 0.100495 Jun 10 18:28:58.455214 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3078/6109] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:58 2022] GET /compute/v2.1/servers/c0919f2f-4ef1-40db-a589-fa4146f50801 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:28:59.443675 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-be9dae74-b3f5-49fb-b44c-8ee7c3b2f606 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:28:59.444296 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-be9dae74-b3f5-49fb-b44c-8ee7c3b2f606 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:28:59.455802 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-be9dae74-b3f5-49fb-b44c-8ee7c3b2f606 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:59.459819 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-be9dae74-b3f5-49fb-b44c-8ee7c3b2f606 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:59.461123 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-be9dae74-b3f5-49fb-b44c-8ee7c3b2f606 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:28:59.461627 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-be9dae74-b3f5-49fb-b44c-8ee7c3b2f606 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:28:59.724087 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-be9dae74-b3f5-49fb-b44c-8ee7c3b2f606 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:28:59.735248 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-be9dae74-b3f5-49fb-b44c-8ee7c3b2f606 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 200 len: 1510 microversion: 2.1 time: 0.295951 Jun 10 18:28:59.735787 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3032/6110] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:28:59 2022] GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 1510 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:29:00.754109 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7f0216c1-038c-4080-b1ea-c59f20725e4b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:00.755830 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7f0216c1-038c-4080-b1ea-c59f20725e4b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:00.766456 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7f0216c1-038c-4080-b1ea-c59f20725e4b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:00.767086 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7f0216c1-038c-4080-b1ea-c59f20725e4b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:00.768089 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7f0216c1-038c-4080-b1ea-c59f20725e4b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:00.768831 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7f0216c1-038c-4080-b1ea-c59f20725e4b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:00.941452 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7f0216c1-038c-4080-b1ea-c59f20725e4b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:29:00.952094 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7f0216c1-038c-4080-b1ea-c59f20725e4b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 200 len: 1510 microversion: 2.1 time: 0.202646 Jun 10 18:29:00.963017 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3079/6111] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:00 2022] GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 1510 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:29:01.970493 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-07b5f652-9d99-4513-8f6c-70b5295d1309 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:01.971925 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-07b5f652-9d99-4513-8f6c-70b5295d1309 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:01.991931 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-07b5f652-9d99-4513-8f6c-70b5295d1309 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:01.993239 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-07b5f652-9d99-4513-8f6c-70b5295d1309 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:01.994320 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-07b5f652-9d99-4513-8f6c-70b5295d1309 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:01.995230 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-07b5f652-9d99-4513-8f6c-70b5295d1309 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:02.363857 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-07b5f652-9d99-4513-8f6c-70b5295d1309 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:29:02.373104 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-07b5f652-9d99-4513-8f6c-70b5295d1309 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 200 len: 1510 microversion: 2.1 time: 0.406788 Jun 10 18:29:02.374232 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3033/6112] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:01 2022] GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 1510 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:29:03.390975 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d4c06cb7-4eac-4151-b2bc-d42e115817cf tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:03.391593 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d4c06cb7-4eac-4151-b2bc-d42e115817cf tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:03.403092 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d4c06cb7-4eac-4151-b2bc-d42e115817cf tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:03.403564 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d4c06cb7-4eac-4151-b2bc-d42e115817cf tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:03.404375 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d4c06cb7-4eac-4151-b2bc-d42e115817cf tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:03.410300 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d4c06cb7-4eac-4151-b2bc-d42e115817cf tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:03.752187 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d4c06cb7-4eac-4151-b2bc-d42e115817cf tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:29:03.762926 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d4c06cb7-4eac-4151-b2bc-d42e115817cf tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 200 len: 1510 microversion: 2.1 time: 0.374202 Jun 10 18:29:03.763922 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3080/6113] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:03 2022] GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 1510 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:29:04.780407 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-91dfe9dc-7bb7-46e5-acea-a534226ee513 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:04.781277 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-91dfe9dc-7bb7-46e5-acea-a534226ee513 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:04.791027 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-91dfe9dc-7bb7-46e5-acea-a534226ee513 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:04.794120 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-91dfe9dc-7bb7-46e5-acea-a534226ee513 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:04.795700 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-91dfe9dc-7bb7-46e5-acea-a534226ee513 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:04.796155 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-91dfe9dc-7bb7-46e5-acea-a534226ee513 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:05.139777 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-91dfe9dc-7bb7-46e5-acea-a534226ee513 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:29:05.154081 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-91dfe9dc-7bb7-46e5-acea-a534226ee513 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 200 len: 1510 microversion: 2.1 time: 0.377237 Jun 10 18:29:05.155627 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3034/6114] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:04 2022] GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 1510 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:29:06.173935 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f8e2c8e7-cb4c-4fba-89d4-e1661b9a2e03 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:06.174973 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f8e2c8e7-cb4c-4fba-89d4-e1661b9a2e03 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:06.189881 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f8e2c8e7-cb4c-4fba-89d4-e1661b9a2e03 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:06.194602 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f8e2c8e7-cb4c-4fba-89d4-e1661b9a2e03 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:06.198549 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f8e2c8e7-cb4c-4fba-89d4-e1661b9a2e03 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:06.200872 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f8e2c8e7-cb4c-4fba-89d4-e1661b9a2e03 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:06.402189 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bc1a1115-808b-498e-b919-7ff4f222d407 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:06.402759 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bc1a1115-808b-498e-b919-7ff4f222d407 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 1c741087-7c53-4118-8b3d-9654a4f6ff48] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:06.410663 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bc1a1115-808b-498e-b919-7ff4f222d407 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:06.411175 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bc1a1115-808b-498e-b919-7ff4f222d407 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:06.412133 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bc1a1115-808b-498e-b919-7ff4f222d407 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:06.412870 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bc1a1115-808b-498e-b919-7ff4f222d407 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:06.447906 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:29:06.456163 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bc1a1115-808b-498e-b919-7ff4f222d407 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48/ips" status: 200 len: 151 microversion: 2.1 time: 0.059043 Jun 10 18:29:06.456881 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3035/6115] 10.222.0.35 () {58 vars in 1247 bytes} [Fri Jun 10 18:29:06 2022] GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48/ips => generated 151 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:29:06.472570 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f8e2c8e7-cb4c-4fba-89d4-e1661b9a2e03 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:29:06.480178 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f8e2c8e7-cb4c-4fba-89d4-e1661b9a2e03 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 200 len: 1510 microversion: 2.1 time: 0.311675 Jun 10 18:29:06.480805 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3081/6116] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:06 2022] GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 1510 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:29:07.498340 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1a43d6ee-36f7-464d-8777-7b6e4d248781 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:07.499817 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1a43d6ee-36f7-464d-8777-7b6e4d248781 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:07.517655 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1a43d6ee-36f7-464d-8777-7b6e4d248781 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:07.519487 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1a43d6ee-36f7-464d-8777-7b6e4d248781 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:07.526279 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1a43d6ee-36f7-464d-8777-7b6e4d248781 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:07.526940 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1a43d6ee-36f7-464d-8777-7b6e4d248781 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:07.815402 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1a43d6ee-36f7-464d-8777-7b6e4d248781 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:29:07.845568 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1a43d6ee-36f7-464d-8777-7b6e4d248781 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 200 len: 1487 microversion: 2.1 time: 0.346110 Jun 10 18:29:07.846210 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3036/6117] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:07 2022] GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 1487 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:29:07.866897 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a943a030-7228-487c-9291-cc4e410ec519 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-2125943883"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:29:07.868692 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a943a030-7228-487c-9291-cc4e410ec519 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:07.891603 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a943a030-7228-487c-9291-cc4e410ec519 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:07.892068 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a943a030-7228-487c-9291-cc4e410ec519 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:07.894273 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a943a030-7228-487c-9291-cc4e410ec519 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:07.895068 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a943a030-7228-487c-9291-cc4e410ec519 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:08.069550 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a943a030-7228-487c-9291-cc4e410ec519 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "PUT /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 200 len: 1060 microversion: 2.1 time: 0.207530 Jun 10 18:29:08.070524 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3082/6118] 10.222.0.35 () {60 vars in 1255 bytes} [Fri Jun 10 18:29:07 2022] PUT /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 1060 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:29:08.087335 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5d15027b-3663-4a6a-b8c8-14ba1ecc8541 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:08.088473 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5d15027b-3663-4a6a-b8c8-14ba1ecc8541 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:08.096173 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5d15027b-3663-4a6a-b8c8-14ba1ecc8541 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:08.097472 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5d15027b-3663-4a6a-b8c8-14ba1ecc8541 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:08.101246 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5d15027b-3663-4a6a-b8c8-14ba1ecc8541 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:08.104098 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5d15027b-3663-4a6a-b8c8-14ba1ecc8541 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:08.541858 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5d15027b-3663-4a6a-b8c8-14ba1ecc8541 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:29:08.554845 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5d15027b-3663-4a6a-b8c8-14ba1ecc8541 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 200 len: 1487 microversion: 2.1 time: 0.470628 Jun 10 18:29:08.556126 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3037/6119] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:08 2022] GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 1487 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:29:08.571149 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8c512a35-a647-4281-b4dd-cd9899936640 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:08.571936 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8c512a35-a647-4281-b4dd-cd9899936640 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:08.589491 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8c512a35-a647-4281-b4dd-cd9899936640 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:08.589888 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8c512a35-a647-4281-b4dd-cd9899936640 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:08.596479 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8c512a35-a647-4281-b4dd-cd9899936640 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:08.597872 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8c512a35-a647-4281-b4dd-cd9899936640 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:08.939903 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8c512a35-a647-4281-b4dd-cd9899936640 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:29:08.949447 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8c512a35-a647-4281-b4dd-cd9899936640 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 200 len: 1487 microversion: 2.1 time: 0.382128 Jun 10 18:29:08.950033 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3083/6120] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:08 2022] GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 1487 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:29:08.966862 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-156bbe84-e33c-483e-90df-d07ad3eb44ec tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:08.967373 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-156bbe84-e33c-483e-90df-d07ad3eb44ec tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:08.977107 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-156bbe84-e33c-483e-90df-d07ad3eb44ec tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:08.977565 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-156bbe84-e33c-483e-90df-d07ad3eb44ec tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:08.978356 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-156bbe84-e33c-483e-90df-d07ad3eb44ec tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:08.978806 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-156bbe84-e33c-483e-90df-d07ad3eb44ec tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:09.047191 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-156bbe84-e33c-483e-90df-d07ad3eb44ec tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:29:09.417698 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-156bbe84-e33c-483e-90df-d07ad3eb44ec tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "DELETE /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 204 len: 0 microversion: 2.1 time: 0.449328 Jun 10 18:29:09.422915 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3038/6121] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:29:08 2022] DELETE /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:29:09.432133 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7d480d0c-6d51-4337-8378-be6a77438f76 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:09.433120 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7d480d0c-6d51-4337-8378-be6a77438f76 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:09.456584 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7d480d0c-6d51-4337-8378-be6a77438f76 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:09.465835 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7d480d0c-6d51-4337-8378-be6a77438f76 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:09.465835 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7d480d0c-6d51-4337-8378-be6a77438f76 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:09.466378 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7d480d0c-6d51-4337-8378-be6a77438f76 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:09.624589 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2ba01283-c7f2-45f9-b137-bbc3cbc154ea tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2133052-2714-4dc1-910d-676a2c9eb823"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:29:09.626925 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2ba01283-c7f2-45f9-b137-bbc3cbc154ea tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 1c741087-7c53-4118-8b3d-9654a4f6ff48] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:09.641442 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2ba01283-c7f2-45f9-b137-bbc3cbc154ea tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:09.642411 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2ba01283-c7f2-45f9-b137-bbc3cbc154ea tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:09.645826 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2ba01283-c7f2-45f9-b137-bbc3cbc154ea tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:09.646952 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2ba01283-c7f2-45f9-b137-bbc3cbc154ea tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:09.720011 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7d480d0c-6d51-4337-8378-be6a77438f76 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:29:09.728973 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7d480d0c-6d51-4337-8378-be6a77438f76 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 200 len: 1493 microversion: 2.1 time: 0.301080 Jun 10 18:29:09.730094 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3084/6122] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:09 2022] GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 1493 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:29:10.750734 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ece986ab-54bd-4ade-ba4c-e7fdcc46fd52 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:10.752102 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ece986ab-54bd-4ade-ba4c-e7fdcc46fd52 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:10.794779 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:29:10.801461 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ece986ab-54bd-4ade-ba4c-e7fdcc46fd52 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:10.805066 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ece986ab-54bd-4ade-ba4c-e7fdcc46fd52 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:10.809899 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ece986ab-54bd-4ade-ba4c-e7fdcc46fd52 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:10.811340 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ece986ab-54bd-4ade-ba4c-e7fdcc46fd52 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:10.881582 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:29:11.152813 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ece986ab-54bd-4ade-ba4c-e7fdcc46fd52 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:29:11.166175 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ece986ab-54bd-4ade-ba4c-e7fdcc46fd52 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 200 len: 1493 microversion: 2.1 time: 0.419429 Jun 10 18:29:11.168588 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3085/6123] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:10 2022] GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 1493 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:29:11.472948 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2ba01283-c7f2-45f9-b137-bbc3cbc154ea tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "POST /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.849844 Jun 10 18:29:11.489425 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3039/6124] 10.222.0.35 () {60 vars in 1322 bytes} [Fri Jun 10 18:29:09 2022] POST /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48/os-volume_attachments => generated 194 bytes in 1870 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:29:12.186172 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b473752f-bec7-49e8-b22f-f7370b47fc33 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:12.187259 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b473752f-bec7-49e8-b22f-f7370b47fc33 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:12.219621 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b473752f-bec7-49e8-b22f-f7370b47fc33 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:12.220058 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b473752f-bec7-49e8-b22f-f7370b47fc33 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:12.220945 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b473752f-bec7-49e8-b22f-f7370b47fc33 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:12.221386 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b473752f-bec7-49e8-b22f-f7370b47fc33 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:12.222648 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-3361453a-2215-4f03-8253-473866f99653 req-c567b95d-9771-4c82-a46e-962554d794e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c8c17ac-552a-40e2-ae4f-bfd567d9168b", "name": "network-vif-deleted", "tag": "c32c141d-5087-436c-ab0a-4928173b42da"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:29:12.246748 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-3361453a-2215-4f03-8253-473866f99653 req-c567b95d-9771-4c82-a46e-962554d794e1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:12.249760 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-3361453a-2215-4f03-8253-473866f99653 req-c567b95d-9771-4c82-a46e-962554d794e1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:12.309046 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-3361453a-2215-4f03-8253-473866f99653 req-c567b95d-9771-4c82-a46e-962554d794e1 service nova] Creating event network-vif-deleted:c32c141d-5087-436c-ab0a-4928173b42da for instance 5c8c17ac-552a-40e2-ae4f-bfd567d9168b on chh1-master-2 Jun 10 18:29:12.322331 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-3361453a-2215-4f03-8253-473866f99653 req-c567b95d-9771-4c82-a46e-962554d794e1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.453248 Jun 10 18:29:12.326240 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3086/6125] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:29:12.327885 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b473752f-bec7-49e8-b22f-f7370b47fc33 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:12.328509 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b473752f-bec7-49e8-b22f-f7370b47fc33 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:12.329143 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-b473752f-bec7-49e8-b22f-f7370b47fc33 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lazy-loading 'fault' on Instance uuid 5c8c17ac-552a-40e2-ae4f-bfd567d9168b {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:29:12.376817 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b473752f-bec7-49e8-b22f-f7370b47fc33 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:29:12.387649 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b473752f-bec7-49e8-b22f-f7370b47fc33 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 200 len: 1310 microversion: 2.1 time: 0.208117 Jun 10 18:29:12.388829 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3040/6126] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:12 2022] GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 1310 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:29:13.411572 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9c311cbe-0c67-42b2-b77f-149857a59aa7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:13.412416 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9c311cbe-0c67-42b2-b77f-149857a59aa7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:13.439482 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9c311cbe-0c67-42b2-b77f-149857a59aa7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:13.440776 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9c311cbe-0c67-42b2-b77f-149857a59aa7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:13.445252 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9c311cbe-0c67-42b2-b77f-149857a59aa7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:13.445870 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9c311cbe-0c67-42b2-b77f-149857a59aa7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:13.487740 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-9c311cbe-0c67-42b2-b77f-149857a59aa7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] HTTP exception thrown: Instance 5c8c17ac-552a-40e2-ae4f-bfd567d9168b could not be found. Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9c311cbe-0c67-42b2-b77f-149857a59aa7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Request method failure captured: Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b HTTP/1.1 Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4ylUNGY8VKO5jLVY6McXmkU53BpB453bvCKmrvaQGLJAZV-lieSSXu8nUaF6yxU0RZxSma5kvfEU2IFgDObEl38j4CHosWLE8jUTpbhfPjW3XqChWMzwgLKa4BS5Yox1cN_jUzeYnin3TOSxn98enTacAe1cvDVZ2oUSAgL46qFPsc Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ded497d3d91b4e22bc2daa72d6f75d18", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersTestJSON-1873283063 Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersTestJSON-1873283063-project Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: d37f560237d9489e96ddee21d9f5e6c6 Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersTestJSON-1873283063-project Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 5c8c17ac-552a-40e2-ae4f-bfd567d9168b could not be found. Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '5c8c17ac-552a-40e2-ae4f-bfd567d9168b'} Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c8c17ac-552a-40e2-ae4f-bfd567d9168b could not be found. Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c8c17ac-552a-40e2-ae4f-bfd567d9168b could not be found. Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:13.494052 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:13.500076 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:29:13.500076 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:29:13.500076 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:29:13.500076 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:29:13.500076 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c8c17ac-552a-40e2-ae4f-bfd567d9168b could not be found. Jun 10 18:29:13.500076 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:13.500076 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9c311cbe-0c67-42b2-b77f-149857a59aa7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Returning 404 to user: Instance 5c8c17ac-552a-40e2-ae4f-bfd567d9168b could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:29:13.500076 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9c311cbe-0c67-42b2-b77f-149857a59aa7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 404 len: 111 microversion: 2.1 time: 0.090698 Jun 10 18:29:13.504744 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3087/6127] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:13 2022] GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:29:13.518059 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2ece9a4f-79dd-4ec4-9291-35c25bf6cfdd tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:13.518604 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2ece9a4f-79dd-4ec4-9291-35c25bf6cfdd tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:13.539924 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2ece9a4f-79dd-4ec4-9291-35c25bf6cfdd tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:13.541114 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2ece9a4f-79dd-4ec4-9291-35c25bf6cfdd tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:13.541312 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2ece9a4f-79dd-4ec4-9291-35c25bf6cfdd tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:13.541765 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2ece9a4f-79dd-4ec4-9291-35c25bf6cfdd tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:13.589125 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-2ece9a4f-79dd-4ec4-9291-35c25bf6cfdd tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] HTTP exception thrown: Instance 5c8c17ac-552a-40e2-ae4f-bfd567d9168b could not be found. Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2ece9a4f-79dd-4ec4-9291-35c25bf6cfdd tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Request method failure captured: Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b HTTP/1.1 Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4ylUNGY8VKO5jLVY6McXmkU53BpB453bvCKmrvaQGLJAZV-lieSSXu8nUaF6yxU0RZxSma5kvfEU2IFgDObEl38j4CHosWLE8jUTpbhfPjW3XqChWMzwgLKa4BS5Yox1cN_jUzeYnin3TOSxn98enTacAe1cvDVZ2oUSAgL46qFPsc Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ded497d3d91b4e22bc2daa72d6f75d18", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersTestJSON-1873283063 Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersTestJSON-1873283063-project Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: d37f560237d9489e96ddee21d9f5e6c6 Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersTestJSON-1873283063-project Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 5c8c17ac-552a-40e2-ae4f-bfd567d9168b could not be found. Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '5c8c17ac-552a-40e2-ae4f-bfd567d9168b'} Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c8c17ac-552a-40e2-ae4f-bfd567d9168b could not be found. Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:29:13.590877 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c8c17ac-552a-40e2-ae4f-bfd567d9168b could not be found. Jun 10 18:29:13.594673 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:13.594673 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:29:13.594673 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:13.594673 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:13.594673 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:29:13.594673 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:29:13.594673 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:29:13.594673 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:29:13.594673 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c8c17ac-552a-40e2-ae4f-bfd567d9168b could not be found. Jun 10 18:29:13.594673 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:13.594673 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2ece9a4f-79dd-4ec4-9291-35c25bf6cfdd tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Returning 404 to user: Instance 5c8c17ac-552a-40e2-ae4f-bfd567d9168b could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:29:13.594673 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2ece9a4f-79dd-4ec4-9291-35c25bf6cfdd tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "DELETE /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 404 len: 111 microversion: 2.1 time: 0.078898 Jun 10 18:29:13.601971 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-345c8f70-6a50-43b3-a3af-a99ea8b28cf8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:13.602856 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-345c8f70-6a50-43b3-a3af-a99ea8b28cf8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 5c8c17ac-552a-40e2-ae4f-bfd567d9168b] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:13.604095 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3041/6128] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:29:13 2022] DELETE /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:29:13.611664 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-345c8f70-6a50-43b3-a3af-a99ea8b28cf8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:13.612147 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-345c8f70-6a50-43b3-a3af-a99ea8b28cf8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:13.629256 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-345c8f70-6a50-43b3-a3af-a99ea8b28cf8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:13.629725 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-345c8f70-6a50-43b3-a3af-a99ea8b28cf8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:13.687087 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-345c8f70-6a50-43b3-a3af-a99ea8b28cf8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] HTTP exception thrown: Instance 5c8c17ac-552a-40e2-ae4f-bfd567d9168b could not be found. Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-345c8f70-6a50-43b3-a3af-a99ea8b28cf8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Request method failure captured: Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b HTTP/1.1 Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4ylUNGY8VKO5jLVY6McXmkU53BpB453bvCKmrvaQGLJAZV-lieSSXu8nUaF6yxU0RZxSma5kvfEU2IFgDObEl38j4CHosWLE8jUTpbhfPjW3XqChWMzwgLKa4BS5Yox1cN_jUzeYnin3TOSxn98enTacAe1cvDVZ2oUSAgL46qFPsc Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ded497d3d91b4e22bc2daa72d6f75d18", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersTestJSON-1873283063 Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersTestJSON-1873283063-project Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: d37f560237d9489e96ddee21d9f5e6c6 Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersTestJSON-1873283063-project Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 5c8c17ac-552a-40e2-ae4f-bfd567d9168b could not be found. Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '5c8c17ac-552a-40e2-ae4f-bfd567d9168b'} Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c8c17ac-552a-40e2-ae4f-bfd567d9168b could not be found. Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c8c17ac-552a-40e2-ae4f-bfd567d9168b could not be found. Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:13.700822 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:13.706663 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:29:13.706663 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:29:13.706663 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:29:13.706663 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:29:13.706663 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c8c17ac-552a-40e2-ae4f-bfd567d9168b could not be found. Jun 10 18:29:13.706663 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:13.706663 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-345c8f70-6a50-43b3-a3af-a99ea8b28cf8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Returning 404 to user: Instance 5c8c17ac-552a-40e2-ae4f-bfd567d9168b could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:29:13.706663 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-345c8f70-6a50-43b3-a3af-a99ea8b28cf8 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b" status: 404 len: 111 microversion: 2.1 time: 0.104293 Jun 10 18:29:13.712255 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ebd28f3f-8aeb-44eb-b7eb-0d5e66fe054d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:13.713023 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ebd28f3f-8aeb-44eb-b7eb-0d5e66fe054d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 1eed2a2f-ea96-4f65-a5d8-3f9e07141143] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:13.715398 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3088/6129] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:13 2022] GET /compute/v2.1/servers/5c8c17ac-552a-40e2-ae4f-bfd567d9168b => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:29:13.725553 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ebd28f3f-8aeb-44eb-b7eb-0d5e66fe054d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:13.731972 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ebd28f3f-8aeb-44eb-b7eb-0d5e66fe054d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:13.735939 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ebd28f3f-8aeb-44eb-b7eb-0d5e66fe054d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:13.742055 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ebd28f3f-8aeb-44eb-b7eb-0d5e66fe054d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:13.795727 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-ebd28f3f-8aeb-44eb-b7eb-0d5e66fe054d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] HTTP exception thrown: Instance 1eed2a2f-ea96-4f65-a5d8-3f9e07141143 could not be found. Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ebd28f3f-8aeb-44eb-b7eb-0d5e66fe054d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Request method failure captured: Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143 HTTP/1.1 Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4ylUNGY8VKO5jLVY6McXmkU53BpB453bvCKmrvaQGLJAZV-lieSSXu8nUaF6yxU0RZxSma5kvfEU2IFgDObEl38j4CHosWLE8jUTpbhfPjW3XqChWMzwgLKa4BS5Yox1cN_jUzeYnin3TOSxn98enTacAe1cvDVZ2oUSAgL46qFPsc Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ded497d3d91b4e22bc2daa72d6f75d18", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersTestJSON-1873283063 Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersTestJSON-1873283063-project Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: d37f560237d9489e96ddee21d9f5e6c6 Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersTestJSON-1873283063-project Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 1eed2a2f-ea96-4f65-a5d8-3f9e07141143 could not be found. Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '1eed2a2f-ea96-4f65-a5d8-3f9e07141143'} Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eed2a2f-ea96-4f65-a5d8-3f9e07141143 could not be found. Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:29:13.808562 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eed2a2f-ea96-4f65-a5d8-3f9e07141143 could not be found. Jun 10 18:29:13.813301 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:13.813301 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:29:13.813301 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:13.813301 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:13.813301 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:29:13.813301 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:29:13.813301 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:29:13.813301 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:29:13.813301 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eed2a2f-ea96-4f65-a5d8-3f9e07141143 could not be found. Jun 10 18:29:13.813301 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:13.819885 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ebd28f3f-8aeb-44eb-b7eb-0d5e66fe054d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Returning 404 to user: Instance 1eed2a2f-ea96-4f65-a5d8-3f9e07141143 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:29:13.822250 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ebd28f3f-8aeb-44eb-b7eb-0d5e66fe054d tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "DELETE /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143" status: 404 len: 111 microversion: 2.1 time: 0.114720 Jun 10 18:29:13.840188 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4bf04805-a973-4ab3-9fe0-9b2c4c45783b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:13.840743 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3042/6130] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:29:13 2022] DELETE /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:29:13.840879 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4bf04805-a973-4ab3-9fe0-9b2c4c45783b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 1eed2a2f-ea96-4f65-a5d8-3f9e07141143] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:13.855539 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4bf04805-a973-4ab3-9fe0-9b2c4c45783b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:13.856004 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4bf04805-a973-4ab3-9fe0-9b2c4c45783b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:13.862484 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4bf04805-a973-4ab3-9fe0-9b2c4c45783b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:13.863671 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4bf04805-a973-4ab3-9fe0-9b2c4c45783b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:13.922746 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-4bf04805-a973-4ab3-9fe0-9b2c4c45783b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] HTTP exception thrown: Instance 1eed2a2f-ea96-4f65-a5d8-3f9e07141143 could not be found. Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4bf04805-a973-4ab3-9fe0-9b2c4c45783b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Request method failure captured: Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143 HTTP/1.1 Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4ylUNGY8VKO5jLVY6McXmkU53BpB453bvCKmrvaQGLJAZV-lieSSXu8nUaF6yxU0RZxSma5kvfEU2IFgDObEl38j4CHosWLE8jUTpbhfPjW3XqChWMzwgLKa4BS5Yox1cN_jUzeYnin3TOSxn98enTacAe1cvDVZ2oUSAgL46qFPsc Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ded497d3d91b4e22bc2daa72d6f75d18", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersTestJSON-1873283063 Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersTestJSON-1873283063-project Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: d37f560237d9489e96ddee21d9f5e6c6 Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersTestJSON-1873283063-project Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 1eed2a2f-ea96-4f65-a5d8-3f9e07141143 could not be found. Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '1eed2a2f-ea96-4f65-a5d8-3f9e07141143'} Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eed2a2f-ea96-4f65-a5d8-3f9e07141143 could not be found. Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eed2a2f-ea96-4f65-a5d8-3f9e07141143 could not be found. Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:13.924393 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:13.929023 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:29:13.929023 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:29:13.929023 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:29:13.929023 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:29:13.929023 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eed2a2f-ea96-4f65-a5d8-3f9e07141143 could not be found. Jun 10 18:29:13.929023 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:13.929023 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4bf04805-a973-4ab3-9fe0-9b2c4c45783b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Returning 404 to user: Instance 1eed2a2f-ea96-4f65-a5d8-3f9e07141143 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:29:13.929023 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4bf04805-a973-4ab3-9fe0-9b2c4c45783b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143" status: 404 len: 111 microversion: 2.1 time: 0.089735 Jun 10 18:29:13.934347 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3089/6131] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:13 2022] GET /compute/v2.1/servers/1eed2a2f-ea96-4f65-a5d8-3f9e07141143 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:29:13.934501 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3ec2cd5b-9ccb-4bdb-bb5e-e72051f3022b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:13.934997 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3ec2cd5b-9ccb-4bdb-bb5e-e72051f3022b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 3f397ccc-6368-4b37-82bb-12910169404f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:13.943124 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3ec2cd5b-9ccb-4bdb-bb5e-e72051f3022b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:13.943773 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3ec2cd5b-9ccb-4bdb-bb5e-e72051f3022b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:13.944589 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3ec2cd5b-9ccb-4bdb-bb5e-e72051f3022b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:13.945038 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3ec2cd5b-9ccb-4bdb-bb5e-e72051f3022b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:14.003297 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-3ec2cd5b-9ccb-4bdb-bb5e-e72051f3022b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] HTTP exception thrown: Instance 3f397ccc-6368-4b37-82bb-12910169404f could not be found. Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3ec2cd5b-9ccb-4bdb-bb5e-e72051f3022b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Request method failure captured: Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f HTTP/1.1 Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4ylUNGY8VKO5jLVY6McXmkU53BpB453bvCKmrvaQGLJAZV-lieSSXu8nUaF6yxU0RZxSma5kvfEU2IFgDObEl38j4CHosWLE8jUTpbhfPjW3XqChWMzwgLKa4BS5Yox1cN_jUzeYnin3TOSxn98enTacAe1cvDVZ2oUSAgL46qFPsc Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ded497d3d91b4e22bc2daa72d6f75d18", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersTestJSON-1873283063 Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersTestJSON-1873283063-project Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: d37f560237d9489e96ddee21d9f5e6c6 Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersTestJSON-1873283063-project Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 3f397ccc-6368-4b37-82bb-12910169404f could not be found. Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '3f397ccc-6368-4b37-82bb-12910169404f'} Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f397ccc-6368-4b37-82bb-12910169404f could not be found. Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:29:14.008369 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f397ccc-6368-4b37-82bb-12910169404f could not be found. Jun 10 18:29:14.013030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.013030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:29:14.013030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.013030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:14.013030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:29:14.013030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:29:14.013030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:29:14.013030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:29:14.013030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f397ccc-6368-4b37-82bb-12910169404f could not be found. Jun 10 18:29:14.013030 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.021674 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3ec2cd5b-9ccb-4bdb-bb5e-e72051f3022b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Returning 404 to user: Instance 3f397ccc-6368-4b37-82bb-12910169404f could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:29:14.038271 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3ec2cd5b-9ccb-4bdb-bb5e-e72051f3022b tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "DELETE /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f" status: 404 len: 111 microversion: 2.1 time: 0.095604 Jun 10 18:29:14.045331 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3043/6132] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:29:13 2022] DELETE /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:29:14.048564 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-24718565-dafc-4760-8d94-bc48fb6d424c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:14.049197 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-24718565-dafc-4760-8d94-bc48fb6d424c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 3f397ccc-6368-4b37-82bb-12910169404f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:14.061275 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-24718565-dafc-4760-8d94-bc48fb6d424c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:14.061723 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-24718565-dafc-4760-8d94-bc48fb6d424c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:14.063552 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-24718565-dafc-4760-8d94-bc48fb6d424c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:14.064006 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-24718565-dafc-4760-8d94-bc48fb6d424c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:14.121289 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-24718565-dafc-4760-8d94-bc48fb6d424c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] HTTP exception thrown: Instance 3f397ccc-6368-4b37-82bb-12910169404f could not be found. Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-24718565-dafc-4760-8d94-bc48fb6d424c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Request method failure captured: Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f HTTP/1.1 Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4ylUNGY8VKO5jLVY6McXmkU53BpB453bvCKmrvaQGLJAZV-lieSSXu8nUaF6yxU0RZxSma5kvfEU2IFgDObEl38j4CHosWLE8jUTpbhfPjW3XqChWMzwgLKa4BS5Yox1cN_jUzeYnin3TOSxn98enTacAe1cvDVZ2oUSAgL46qFPsc Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ded497d3d91b4e22bc2daa72d6f75d18", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersTestJSON-1873283063 Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersTestJSON-1873283063-project Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: d37f560237d9489e96ddee21d9f5e6c6 Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersTestJSON-1873283063-project Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 3f397ccc-6368-4b37-82bb-12910169404f could not be found. Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '3f397ccc-6368-4b37-82bb-12910169404f'} Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f397ccc-6368-4b37-82bb-12910169404f could not be found. Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f397ccc-6368-4b37-82bb-12910169404f could not be found. Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.122907 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:14.126802 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:29:14.126802 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:29:14.126802 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:29:14.126802 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:29:14.126802 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f397ccc-6368-4b37-82bb-12910169404f could not be found. Jun 10 18:29:14.126802 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.126802 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-24718565-dafc-4760-8d94-bc48fb6d424c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Returning 404 to user: Instance 3f397ccc-6368-4b37-82bb-12910169404f could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:29:14.126802 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-24718565-dafc-4760-8d94-bc48fb6d424c tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f" status: 404 len: 111 microversion: 2.1 time: 0.079800 Jun 10 18:29:14.130974 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3090/6133] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:14 2022] GET /compute/v2.1/servers/3f397ccc-6368-4b37-82bb-12910169404f => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:29:14.138962 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d0f2ae32-877d-4ca7-b53c-618374e8ea5e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:14.139468 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d0f2ae32-877d-4ca7-b53c-618374e8ea5e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 607be5b9-5b8b-4d26-ad0b-15cb39df1e06] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:14.154903 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d0f2ae32-877d-4ca7-b53c-618374e8ea5e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:14.155372 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d0f2ae32-877d-4ca7-b53c-618374e8ea5e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:14.156561 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d0f2ae32-877d-4ca7-b53c-618374e8ea5e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:14.157014 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d0f2ae32-877d-4ca7-b53c-618374e8ea5e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:14.181474 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-d0f2ae32-877d-4ca7-b53c-618374e8ea5e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] HTTP exception thrown: Instance 607be5b9-5b8b-4d26-ad0b-15cb39df1e06 could not be found. Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d0f2ae32-877d-4ca7-b53c-618374e8ea5e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Request method failure captured: Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06 HTTP/1.1 Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4ylUNGY8VKO5jLVY6McXmkU53BpB453bvCKmrvaQGLJAZV-lieSSXu8nUaF6yxU0RZxSma5kvfEU2IFgDObEl38j4CHosWLE8jUTpbhfPjW3XqChWMzwgLKa4BS5Yox1cN_jUzeYnin3TOSxn98enTacAe1cvDVZ2oUSAgL46qFPsc Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ded497d3d91b4e22bc2daa72d6f75d18", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersTestJSON-1873283063 Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersTestJSON-1873283063-project Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: d37f560237d9489e96ddee21d9f5e6c6 Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersTestJSON-1873283063-project Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 607be5b9-5b8b-4d26-ad0b-15cb39df1e06 could not be found. Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '607be5b9-5b8b-4d26-ad0b-15cb39df1e06'} Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 607be5b9-5b8b-4d26-ad0b-15cb39df1e06 could not be found. Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:29:14.183064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 607be5b9-5b8b-4d26-ad0b-15cb39df1e06 could not be found. Jun 10 18:29:14.188010 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.188010 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:29:14.188010 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.188010 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:14.188010 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:29:14.188010 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:29:14.188010 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:29:14.188010 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:29:14.188010 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 607be5b9-5b8b-4d26-ad0b-15cb39df1e06 could not be found. Jun 10 18:29:14.188010 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.188010 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d0f2ae32-877d-4ca7-b53c-618374e8ea5e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Returning 404 to user: Instance 607be5b9-5b8b-4d26-ad0b-15cb39df1e06 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:29:14.199267 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d0f2ae32-877d-4ca7-b53c-618374e8ea5e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "DELETE /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06" status: 404 len: 111 microversion: 2.1 time: 0.049438 Jun 10 18:29:14.201439 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3044/6134] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:29:14 2022] DELETE /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:29:14.218844 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5e24808a-ed8f-489d-af52-d01cbb9580ed tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:14.219471 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5e24808a-ed8f-489d-af52-d01cbb9580ed tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 607be5b9-5b8b-4d26-ad0b-15cb39df1e06] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:14.234732 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5e24808a-ed8f-489d-af52-d01cbb9580ed tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:14.237873 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5e24808a-ed8f-489d-af52-d01cbb9580ed tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:14.237873 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5e24808a-ed8f-489d-af52-d01cbb9580ed tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:14.237873 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5e24808a-ed8f-489d-af52-d01cbb9580ed tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:14.266471 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-5e24808a-ed8f-489d-af52-d01cbb9580ed tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] HTTP exception thrown: Instance 607be5b9-5b8b-4d26-ad0b-15cb39df1e06 could not be found. Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5e24808a-ed8f-489d-af52-d01cbb9580ed tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Request method failure captured: Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06 HTTP/1.1 Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4ylUNGY8VKO5jLVY6McXmkU53BpB453bvCKmrvaQGLJAZV-lieSSXu8nUaF6yxU0RZxSma5kvfEU2IFgDObEl38j4CHosWLE8jUTpbhfPjW3XqChWMzwgLKa4BS5Yox1cN_jUzeYnin3TOSxn98enTacAe1cvDVZ2oUSAgL46qFPsc Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ded497d3d91b4e22bc2daa72d6f75d18", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersTestJSON-1873283063 Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersTestJSON-1873283063-project Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: d37f560237d9489e96ddee21d9f5e6c6 Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersTestJSON-1873283063-project Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 607be5b9-5b8b-4d26-ad0b-15cb39df1e06 could not be found. Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '607be5b9-5b8b-4d26-ad0b-15cb39df1e06'} Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 607be5b9-5b8b-4d26-ad0b-15cb39df1e06 could not be found. Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 607be5b9-5b8b-4d26-ad0b-15cb39df1e06 could not be found. Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.268063 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:14.272884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:29:14.272884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:29:14.272884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:29:14.272884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:29:14.272884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 607be5b9-5b8b-4d26-ad0b-15cb39df1e06 could not be found. Jun 10 18:29:14.272884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.272884 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5e24808a-ed8f-489d-af52-d01cbb9580ed tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Returning 404 to user: Instance 607be5b9-5b8b-4d26-ad0b-15cb39df1e06 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:29:14.272884 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5e24808a-ed8f-489d-af52-d01cbb9580ed tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06" status: 404 len: 111 microversion: 2.1 time: 0.055155 Jun 10 18:29:14.272884 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3091/6135] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:14 2022] GET /compute/v2.1/servers/607be5b9-5b8b-4d26-ad0b-15cb39df1e06 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:29:14.278650 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-638452c5-f89d-4513-9503-fe00d9546428 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:14.280178 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-638452c5-f89d-4513-9503-fe00d9546428 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: b71f4f7b-6184-4758-8234-76b63770a27c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:14.294713 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-638452c5-f89d-4513-9503-fe00d9546428 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:14.297524 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-638452c5-f89d-4513-9503-fe00d9546428 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:14.297524 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-638452c5-f89d-4513-9503-fe00d9546428 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:14.297524 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-638452c5-f89d-4513-9503-fe00d9546428 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:14.325482 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-638452c5-f89d-4513-9503-fe00d9546428 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] HTTP exception thrown: Instance b71f4f7b-6184-4758-8234-76b63770a27c could not be found. Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-638452c5-f89d-4513-9503-fe00d9546428 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Request method failure captured: Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c HTTP/1.1 Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4ylUNGY8VKO5jLVY6McXmkU53BpB453bvCKmrvaQGLJAZV-lieSSXu8nUaF6yxU0RZxSma5kvfEU2IFgDObEl38j4CHosWLE8jUTpbhfPjW3XqChWMzwgLKa4BS5Yox1cN_jUzeYnin3TOSxn98enTacAe1cvDVZ2oUSAgL46qFPsc Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ded497d3d91b4e22bc2daa72d6f75d18", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersTestJSON-1873283063 Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersTestJSON-1873283063-project Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: d37f560237d9489e96ddee21d9f5e6c6 Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersTestJSON-1873283063-project Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: exception: Instance b71f4f7b-6184-4758-8234-76b63770a27c could not be found. Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'b71f4f7b-6184-4758-8234-76b63770a27c'} Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b71f4f7b-6184-4758-8234-76b63770a27c could not be found. Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:29:14.327226 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b71f4f7b-6184-4758-8234-76b63770a27c could not be found. Jun 10 18:29:14.331706 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.331706 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:29:14.331706 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.331706 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:14.331706 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:29:14.331706 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:29:14.331706 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:29:14.331706 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:29:14.331706 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b71f4f7b-6184-4758-8234-76b63770a27c could not be found. Jun 10 18:29:14.331706 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.331706 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-638452c5-f89d-4513-9503-fe00d9546428 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Returning 404 to user: Instance b71f4f7b-6184-4758-8234-76b63770a27c could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:29:14.331706 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-638452c5-f89d-4513-9503-fe00d9546428 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "DELETE /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c" status: 404 len: 111 microversion: 2.1 time: 0.053926 Jun 10 18:29:14.331706 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3045/6136] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:29:14 2022] DELETE /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:29:14.340062 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-51401956-115b-4183-9da8-b49d094a9ee5 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:14.340738 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-51401956-115b-4183-9da8-b49d094a9ee5 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: b71f4f7b-6184-4758-8234-76b63770a27c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:14.350168 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-51401956-115b-4183-9da8-b49d094a9ee5 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:14.350959 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-51401956-115b-4183-9da8-b49d094a9ee5 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:14.351991 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-51401956-115b-4183-9da8-b49d094a9ee5 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:14.357033 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-51401956-115b-4183-9da8-b49d094a9ee5 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:14.401912 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-51401956-115b-4183-9da8-b49d094a9ee5 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] HTTP exception thrown: Instance b71f4f7b-6184-4758-8234-76b63770a27c could not be found. Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-51401956-115b-4183-9da8-b49d094a9ee5 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Request method failure captured: Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c HTTP/1.1 Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4ylUNGY8VKO5jLVY6McXmkU53BpB453bvCKmrvaQGLJAZV-lieSSXu8nUaF6yxU0RZxSma5kvfEU2IFgDObEl38j4CHosWLE8jUTpbhfPjW3XqChWMzwgLKa4BS5Yox1cN_jUzeYnin3TOSxn98enTacAe1cvDVZ2oUSAgL46qFPsc Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ded497d3d91b4e22bc2daa72d6f75d18", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersTestJSON-1873283063 Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersTestJSON-1873283063-project Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: d37f560237d9489e96ddee21d9f5e6c6 Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersTestJSON-1873283063-project Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: exception: Instance b71f4f7b-6184-4758-8234-76b63770a27c could not be found. Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'b71f4f7b-6184-4758-8234-76b63770a27c'} Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b71f4f7b-6184-4758-8234-76b63770a27c could not be found. Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b71f4f7b-6184-4758-8234-76b63770a27c could not be found. Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.403882 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:14.408019 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:29:14.408019 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:29:14.408019 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:29:14.408019 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:29:14.408019 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b71f4f7b-6184-4758-8234-76b63770a27c could not be found. Jun 10 18:29:14.408019 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.421298 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-51401956-115b-4183-9da8-b49d094a9ee5 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Returning 404 to user: Instance b71f4f7b-6184-4758-8234-76b63770a27c could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:29:14.422914 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-51401956-115b-4183-9da8-b49d094a9ee5 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c" status: 404 len: 111 microversion: 2.1 time: 0.086884 Jun 10 18:29:14.424073 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3092/6137] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:14 2022] GET /compute/v2.1/servers/b71f4f7b-6184-4758-8234-76b63770a27c => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:29:14.436687 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f1b8eb51-9328-4cf6-a982-d39351ddc267 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:14.436687 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f1b8eb51-9328-4cf6-a982-d39351ddc267 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: a0a1cfa6-b42a-43f1-87d7-8564b895dbcb] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:14.442239 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f1b8eb51-9328-4cf6-a982-d39351ddc267 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:14.447221 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f1b8eb51-9328-4cf6-a982-d39351ddc267 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:14.448395 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f1b8eb51-9328-4cf6-a982-d39351ddc267 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:14.449075 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f1b8eb51-9328-4cf6-a982-d39351ddc267 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:14.489877 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-f1b8eb51-9328-4cf6-a982-d39351ddc267 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] HTTP exception thrown: Instance a0a1cfa6-b42a-43f1-87d7-8564b895dbcb could not be found. Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f1b8eb51-9328-4cf6-a982-d39351ddc267 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Request method failure captured: Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb HTTP/1.1 Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4ylUNGY8VKO5jLVY6McXmkU53BpB453bvCKmrvaQGLJAZV-lieSSXu8nUaF6yxU0RZxSma5kvfEU2IFgDObEl38j4CHosWLE8jUTpbhfPjW3XqChWMzwgLKa4BS5Yox1cN_jUzeYnin3TOSxn98enTacAe1cvDVZ2oUSAgL46qFPsc Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ded497d3d91b4e22bc2daa72d6f75d18", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersTestJSON-1873283063 Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersTestJSON-1873283063-project Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: d37f560237d9489e96ddee21d9f5e6c6 Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersTestJSON-1873283063-project Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: exception: Instance a0a1cfa6-b42a-43f1-87d7-8564b895dbcb could not be found. Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'a0a1cfa6-b42a-43f1-87d7-8564b895dbcb'} Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0a1cfa6-b42a-43f1-87d7-8564b895dbcb could not be found. Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:29:14.497973 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0a1cfa6-b42a-43f1-87d7-8564b895dbcb could not be found. Jun 10 18:29:14.501890 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.501890 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:29:14.501890 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.501890 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:14.501890 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:29:14.501890 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:29:14.501890 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:29:14.501890 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:29:14.501890 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0a1cfa6-b42a-43f1-87d7-8564b895dbcb could not be found. Jun 10 18:29:14.501890 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.505874 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f1b8eb51-9328-4cf6-a982-d39351ddc267 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Returning 404 to user: Instance a0a1cfa6-b42a-43f1-87d7-8564b895dbcb could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:29:14.507056 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f1b8eb51-9328-4cf6-a982-d39351ddc267 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "DELETE /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb" status: 404 len: 111 microversion: 2.1 time: 0.079009 Jun 10 18:29:14.508256 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3046/6138] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:29:14 2022] DELETE /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:29:14.516229 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-717a25d5-3c88-4c7f-a219-e9910f5687be tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:14.517222 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-717a25d5-3c88-4c7f-a219-e9910f5687be tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: a0a1cfa6-b42a-43f1-87d7-8564b895dbcb] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:14.538428 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-717a25d5-3c88-4c7f-a219-e9910f5687be tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:14.545393 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-717a25d5-3c88-4c7f-a219-e9910f5687be tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:14.546795 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-717a25d5-3c88-4c7f-a219-e9910f5687be tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:14.547833 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-717a25d5-3c88-4c7f-a219-e9910f5687be tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:14.608508 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-717a25d5-3c88-4c7f-a219-e9910f5687be tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] HTTP exception thrown: Instance a0a1cfa6-b42a-43f1-87d7-8564b895dbcb could not be found. Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-717a25d5-3c88-4c7f-a219-e9910f5687be tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Request method failure captured: Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb HTTP/1.1 Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4ylUNGY8VKO5jLVY6McXmkU53BpB453bvCKmrvaQGLJAZV-lieSSXu8nUaF6yxU0RZxSma5kvfEU2IFgDObEl38j4CHosWLE8jUTpbhfPjW3XqChWMzwgLKa4BS5Yox1cN_jUzeYnin3TOSxn98enTacAe1cvDVZ2oUSAgL46qFPsc Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ded497d3d91b4e22bc2daa72d6f75d18", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersTestJSON-1873283063 Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersTestJSON-1873283063-project Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: d37f560237d9489e96ddee21d9f5e6c6 Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersTestJSON-1873283063-project Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: exception: Instance a0a1cfa6-b42a-43f1-87d7-8564b895dbcb could not be found. Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'a0a1cfa6-b42a-43f1-87d7-8564b895dbcb'} Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0a1cfa6-b42a-43f1-87d7-8564b895dbcb could not be found. Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0a1cfa6-b42a-43f1-87d7-8564b895dbcb could not be found. Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.622965 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:14.627577 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:29:14.627577 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:29:14.627577 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:29:14.627577 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:29:14.627577 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0a1cfa6-b42a-43f1-87d7-8564b895dbcb could not be found. Jun 10 18:29:14.627577 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.636511 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-717a25d5-3c88-4c7f-a219-e9910f5687be tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Returning 404 to user: Instance a0a1cfa6-b42a-43f1-87d7-8564b895dbcb could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:29:14.641562 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-717a25d5-3c88-4c7f-a219-e9910f5687be tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb" status: 404 len: 111 microversion: 2.1 time: 0.129357 Jun 10 18:29:14.647661 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3093/6139] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:14 2022] GET /compute/v2.1/servers/a0a1cfa6-b42a-43f1-87d7-8564b895dbcb => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:29:14.653417 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6bb42632-ad39-4eef-bdfe-415e364c0deb tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:14.654895 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6bb42632-ad39-4eef-bdfe-415e364c0deb tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 45960e22-dd06-483d-868a-f9b5b9f95957] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:14.682498 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-6bb42632-ad39-4eef-bdfe-415e364c0deb tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] HTTP exception thrown: Instance 45960e22-dd06-483d-868a-f9b5b9f95957 could not be found. Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6bb42632-ad39-4eef-bdfe-415e364c0deb tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Request method failure captured: Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/45960e22-dd06-483d-868a-f9b5b9f95957 HTTP/1.1 Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4ylUNGY8VKO5jLVY6McXmkU53BpB453bvCKmrvaQGLJAZV-lieSSXu8nUaF6yxU0RZxSma5kvfEU2IFgDObEl38j4CHosWLE8jUTpbhfPjW3XqChWMzwgLKa4BS5Yox1cN_jUzeYnin3TOSxn98enTacAe1cvDVZ2oUSAgL46qFPsc Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ded497d3d91b4e22bc2daa72d6f75d18", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersTestJSON-1873283063 Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersTestJSON-1873283063-project Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: d37f560237d9489e96ddee21d9f5e6c6 Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersTestJSON-1873283063-project Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 45960e22-dd06-483d-868a-f9b5b9f95957 could not be found. Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '45960e22-dd06-483d-868a-f9b5b9f95957'} Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45960e22-dd06-483d-868a-f9b5b9f95957 could not be found. Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45960e22-dd06-483d-868a-f9b5b9f95957 could not be found. Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:29:14.692815 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.702119 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:14.702119 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:29:14.702119 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:29:14.702119 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:29:14.702119 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:29:14.702119 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45960e22-dd06-483d-868a-f9b5b9f95957 could not be found. Jun 10 18:29:14.702119 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.702119 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6bb42632-ad39-4eef-bdfe-415e364c0deb tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Returning 404 to user: Instance 45960e22-dd06-483d-868a-f9b5b9f95957 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:29:14.702119 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6bb42632-ad39-4eef-bdfe-415e364c0deb tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "DELETE /compute/v2.1/servers/45960e22-dd06-483d-868a-f9b5b9f95957" status: 404 len: 111 microversion: 2.1 time: 0.048261 Jun 10 18:29:14.709782 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3047/6140] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:29:14 2022] DELETE /compute/v2.1/servers/45960e22-dd06-483d-868a-f9b5b9f95957 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:29:14.717960 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3bb004cf-2a94-484f-8a5b-242884263696 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:14.724978 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3bb004cf-2a94-484f-8a5b-242884263696 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: 45960e22-dd06-483d-868a-f9b5b9f95957] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:14.741529 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-3bb004cf-2a94-484f-8a5b-242884263696 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] HTTP exception thrown: Instance 45960e22-dd06-483d-868a-f9b5b9f95957 could not be found. Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3bb004cf-2a94-484f-8a5b-242884263696 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Request method failure captured: Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/45960e22-dd06-483d-868a-f9b5b9f95957 HTTP/1.1 Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4ylUNGY8VKO5jLVY6McXmkU53BpB453bvCKmrvaQGLJAZV-lieSSXu8nUaF6yxU0RZxSma5kvfEU2IFgDObEl38j4CHosWLE8jUTpbhfPjW3XqChWMzwgLKa4BS5Yox1cN_jUzeYnin3TOSxn98enTacAe1cvDVZ2oUSAgL46qFPsc Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ded497d3d91b4e22bc2daa72d6f75d18", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersTestJSON-1873283063 Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersTestJSON-1873283063-project Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: d37f560237d9489e96ddee21d9f5e6c6 Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersTestJSON-1873283063-project Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 45960e22-dd06-483d-868a-f9b5b9f95957 could not be found. Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '45960e22-dd06-483d-868a-f9b5b9f95957'} Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45960e22-dd06-483d-868a-f9b5b9f95957 could not be found. Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45960e22-dd06-483d-868a-f9b5b9f95957 could not be found. Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:29:14.744713 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:29:14.749391 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:29:14.749391 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:29:14.749391 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45960e22-dd06-483d-868a-f9b5b9f95957 could not be found. Jun 10 18:29:14.749391 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:14.750805 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3bb004cf-2a94-484f-8a5b-242884263696 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Returning 404 to user: Instance 45960e22-dd06-483d-868a-f9b5b9f95957 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:29:14.752190 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3bb004cf-2a94-484f-8a5b-242884263696 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/45960e22-dd06-483d-868a-f9b5b9f95957" status: 404 len: 111 microversion: 2.1 time: 0.038049 Jun 10 18:29:14.753859 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3094/6141] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:14 2022] GET /compute/v2.1/servers/45960e22-dd06-483d-868a-f9b5b9f95957 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:29:14.764588 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-131bb6dc-ef2f-4d59-95f8-943f8862d0b7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:14.765223 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-131bb6dc-ef2f-4d59-95f8-943f8862d0b7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: e81a6dfe-0b14-44e1-9d1c-58d543f32faf] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:14.774784 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-131bb6dc-ef2f-4d59-95f8-943f8862d0b7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:14.775380 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-131bb6dc-ef2f-4d59-95f8-943f8862d0b7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:14.776491 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-131bb6dc-ef2f-4d59-95f8-943f8862d0b7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:14.779313 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-131bb6dc-ef2f-4d59-95f8-943f8862d0b7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:14.848967 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-131bb6dc-ef2f-4d59-95f8-943f8862d0b7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: e81a6dfe-0b14-44e1-9d1c-58d543f32faf] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:29:15.365217 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-131bb6dc-ef2f-4d59-95f8-943f8862d0b7 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "DELETE /compute/v2.1/servers/e81a6dfe-0b14-44e1-9d1c-58d543f32faf" status: 204 len: 0 microversion: 2.1 time: 0.605417 Jun 10 18:29:15.365825 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3048/6142] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:29:14 2022] DELETE /compute/v2.1/servers/e81a6dfe-0b14-44e1-9d1c-58d543f32faf => generated 0 bytes in 607 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:29:15.382270 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6ac7c2e9-83d6-464d-8224-f0033ed58009 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:15.383293 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6ac7c2e9-83d6-464d-8224-f0033ed58009 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: e81a6dfe-0b14-44e1-9d1c-58d543f32faf] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:15.398785 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6ac7c2e9-83d6-464d-8224-f0033ed58009 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:15.401194 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6ac7c2e9-83d6-464d-8224-f0033ed58009 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:15.402071 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6ac7c2e9-83d6-464d-8224-f0033ed58009 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:15.402793 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6ac7c2e9-83d6-464d-8224-f0033ed58009 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:15.750904 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6ac7c2e9-83d6-464d-8224-f0033ed58009 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:29:15.776609 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6ac7c2e9-83d6-464d-8224-f0033ed58009 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/e81a6dfe-0b14-44e1-9d1c-58d543f32faf" status: 200 len: 1479 microversion: 2.1 time: 0.384979 Jun 10 18:29:15.776609 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3095/6143] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:15 2022] GET /compute/v2.1/servers/e81a6dfe-0b14-44e1-9d1c-58d543f32faf => generated 1479 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:29:16.793855 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d24b20fc-490b-499c-9b5d-71cfae82d0b4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:16.794469 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d24b20fc-490b-499c-9b5d-71cfae82d0b4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: e81a6dfe-0b14-44e1-9d1c-58d543f32faf] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:16.802814 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d24b20fc-490b-499c-9b5d-71cfae82d0b4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:16.803270 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d24b20fc-490b-499c-9b5d-71cfae82d0b4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:16.822022 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d24b20fc-490b-499c-9b5d-71cfae82d0b4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:16.822022 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d24b20fc-490b-499c-9b5d-71cfae82d0b4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:17.547157 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d24b20fc-490b-499c-9b5d-71cfae82d0b4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:29:17.558556 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d24b20fc-490b-499c-9b5d-71cfae82d0b4 tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/e81a6dfe-0b14-44e1-9d1c-58d543f32faf" status: 200 len: 1479 microversion: 2.1 time: 0.768677 Jun 10 18:29:17.561514 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3049/6144] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:16 2022] GET /compute/v2.1/servers/e81a6dfe-0b14-44e1-9d1c-58d543f32faf => generated 1479 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:29:17.901531 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-85bd01ae-caa8-472b-b847-22779d912567 req-02255dd6-5ee9-4cab-bed0-ea7a672a71b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e81a6dfe-0b14-44e1-9d1c-58d543f32faf", "name": "network-vif-deleted", "tag": "2b5203dd-df2f-4988-b40a-11600acbe1f4"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:29:17.920046 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-85bd01ae-caa8-472b-b847-22779d912567 req-02255dd6-5ee9-4cab-bed0-ea7a672a71b4 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:17.920046 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-85bd01ae-caa8-472b-b847-22779d912567 req-02255dd6-5ee9-4cab-bed0-ea7a672a71b4 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:17.932525 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-85bd01ae-caa8-472b-b847-22779d912567 req-02255dd6-5ee9-4cab-bed0-ea7a672a71b4 service nova] Creating event network-vif-deleted:2b5203dd-df2f-4988-b40a-11600acbe1f4 for instance e81a6dfe-0b14-44e1-9d1c-58d543f32faf on chh1-master-2 Jun 10 18:29:17.945815 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-85bd01ae-caa8-472b-b847-22779d912567 req-02255dd6-5ee9-4cab-bed0-ea7a672a71b4 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047568 Jun 10 18:29:17.947340 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3096/6145] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:29:18.602596 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9e521a65-cf51-4994-bc62-0d785bea5dcb tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:18.606853 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9e521a65-cf51-4994-bc62-0d785bea5dcb tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: e81a6dfe-0b14-44e1-9d1c-58d543f32faf] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:18.668546 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9e521a65-cf51-4994-bc62-0d785bea5dcb tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:18.669020 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9e521a65-cf51-4994-bc62-0d785bea5dcb tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:18.672361 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9e521a65-cf51-4994-bc62-0d785bea5dcb tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:18.673552 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9e521a65-cf51-4994-bc62-0d785bea5dcb tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:18.812478 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9e521a65-cf51-4994-bc62-0d785bea5dcb tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:18.816747 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9e521a65-cf51-4994-bc62-0d785bea5dcb tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:18.817425 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-9e521a65-cf51-4994-bc62-0d785bea5dcb tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lazy-loading 'fault' on Instance uuid e81a6dfe-0b14-44e1-9d1c-58d543f32faf {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:29:18.923552 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9e521a65-cf51-4994-bc62-0d785bea5dcb tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37f560237d9489e96ddee21d9f5e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded497d3d91b4e22bc2daa72d6f75d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:29:18.936816 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9e521a65-cf51-4994-bc62-0d785bea5dcb tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/e81a6dfe-0b14-44e1-9d1c-58d543f32faf" status: 200 len: 1283 microversion: 2.1 time: 0.361743 Jun 10 18:29:18.938042 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3050/6146] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:18 2022] GET /compute/v2.1/servers/e81a6dfe-0b14-44e1-9d1c-58d543f32faf => generated 1283 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:29:19.994670 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3e87e915-ba0c-49de-b171-1d447b35092e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:19.994670 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3e87e915-ba0c-49de-b171-1d447b35092e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] [instance: e81a6dfe-0b14-44e1-9d1c-58d543f32faf] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:19.994670 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3e87e915-ba0c-49de-b171-1d447b35092e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:19.994670 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3e87e915-ba0c-49de-b171-1d447b35092e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:19.994670 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3e87e915-ba0c-49de-b171-1d447b35092e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:19.994670 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3e87e915-ba0c-49de-b171-1d447b35092e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:19.994670 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-3e87e915-ba0c-49de-b171-1d447b35092e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] HTTP exception thrown: Instance e81a6dfe-0b14-44e1-9d1c-58d543f32faf could not be found. Jun 10 18:29:19.994670 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3e87e915-ba0c-49de-b171-1d447b35092e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Request method failure captured: Jun 10 18:29:19.994670 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/e81a6dfe-0b14-44e1-9d1c-58d543f32faf HTTP/1.1 Jun 10 18:29:19.994670 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:29:19.994670 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:29:19.994670 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:29:19.994670 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:29:19.994670 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:29:19.994670 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:29:19.994670 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:29:19.994670 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:29:19.994670 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4ylUNGY8VKO5jLVY6McXmkU53BpB453bvCKmrvaQGLJAZV-lieSSXu8nUaF6yxU0RZxSma5kvfEU2IFgDObEl38j4CHosWLE8jUTpbhfPjW3XqChWMzwgLKa4BS5Yox1cN_jUzeYnin3TOSxn98enTacAe1cvDVZ2oUSAgL46qFPsc Jun 10 18:29:19.994670 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:29:19.994670 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:29:19.994670 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:29:19.994670 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:29:19.994670 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:29:19.994670 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:29:19.994670 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:29:19.994670 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:29:19.994670 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:29:19.994670 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:29:19.994670 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ded497d3d91b4e22bc2daa72d6f75d18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ded497d3d91b4e22bc2daa72d6f75d18", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:29:19.994670 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-ServersTestJSON-1873283063 Jun 10 18:29:19.994670 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: ded497d3d91b4e22bc2daa72d6f75d18 Jun 10 18:29:19.994670 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-ServersTestJSON-1873283063 Jun 10 18:29:19.994670 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-ServersTestJSON-1873283063-project Jun 10 18:29:19.994670 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:29:19.994670 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:29:19.994670 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: d37f560237d9489e96ddee21d9f5e6c6 Jun 10 18:29:19.994670 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-ServersTestJSON-1873283063-project Jun 10 18:29:19.994670 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:29:19.994670 chdv-master-2 devstack@n-api.service[126594]: exception: Instance e81a6dfe-0b14-44e1-9d1c-58d543f32faf could not be found. Jun 10 18:29:19.994670 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'e81a6dfe-0b14-44e1-9d1c-58d543f32faf'} Jun 10 18:29:19.994670 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:29:19.998749 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:19.998749 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:29:19.998749 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:29:19.998749 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:29:19.998749 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:29:19.998749 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:29:19.998749 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:29:19.998749 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:29:19.998749 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:29:19.998749 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e81a6dfe-0b14-44e1-9d1c-58d543f32faf could not be found. Jun 10 18:29:19.998749 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:19.998749 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:29:19.998749 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:19.998749 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:19.998749 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:29:19.998749 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:29:19.998749 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:29:19.998749 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:29:19.998749 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:29:19.998749 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:29:19.998749 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:29:19.998749 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:29:19.998749 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:29:19.998749 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:29:19.998749 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:29:19.998749 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:29:19.998749 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e81a6dfe-0b14-44e1-9d1c-58d543f32faf could not be found. Jun 10 18:29:19.998749 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:19.998749 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:29:19.998749 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:19.998749 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:19.998749 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:29:19.998749 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:29:19.998749 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:29:19.998749 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:29:19.998749 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e81a6dfe-0b14-44e1-9d1c-58d543f32faf could not be found. Jun 10 18:29:19.998749 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:29:19.998749 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3e87e915-ba0c-49de-b171-1d447b35092e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] Returning 404 to user: Instance e81a6dfe-0b14-44e1-9d1c-58d543f32faf could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:29:19.998749 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3e87e915-ba0c-49de-b171-1d447b35092e tempest-ServersTestJSON-1873283063 tempest-ServersTestJSON-1873283063-project] 10.222.0.35 "GET /compute/v2.1/servers/e81a6dfe-0b14-44e1-9d1c-58d543f32faf" status: 404 len: 111 microversion: 2.1 time: 0.034294 Jun 10 18:29:19.998749 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3097/6147] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:19 2022] GET /compute/v2.1/servers/e81a6dfe-0b14-44e1-9d1c-58d543f32faf => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:29:28.302547 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-65a72c6e-3811-4b49-946d-be3ce0f721dd tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2133052-2714-4dc1-910d-676a2c9eb823"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:29:28.303742 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-65a72c6e-3811-4b49-946d-be3ce0f721dd tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 1c741087-7c53-4118-8b3d-9654a4f6ff48] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:28.310326 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:29:28.321165 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-65a72c6e-3811-4b49-946d-be3ce0f721dd tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:28.321165 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-65a72c6e-3811-4b49-946d-be3ce0f721dd tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:28.321821 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-65a72c6e-3811-4b49-946d-be3ce0f721dd tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:28.322679 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-65a72c6e-3811-4b49-946d-be3ce0f721dd tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:28.499181 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:29:28.502505 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-65a72c6e-3811-4b49-946d-be3ce0f721dd tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] HTTP exception thrown: Invalid volume: volume e2133052-2714-4dc1-910d-676a2c9eb823 is already attached to instances: 1c741087-7c53-4118-8b3d-9654a4f6ff48 Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-65a72c6e-3811-4b49-946d-be3ce0f721dd tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Request method failure captured: Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48/os-volume_attachments HTTP/1.1 Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 74 Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4wSsTbdAR5Qo9IVKF2KTe64dpp06ye4z8lPOT4uRhY2Oz0KMxQpxmr8KJzvNSTZtUIPPEgN2R6-CfUmf8CTAhd_IkVIfk-LuHrtE7255OYmbmFD6LLNrB7dKdWnCpSm8e4XDxNvfMbtjLHwd4svP6YGpBpPTncT2KN4jK3q3Q7l5ew Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 886b72a54e9b4ee7aa3cc21da4145cbb Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-AttachVolumeNegativeTest-545911130 Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/886b72a54e9b4ee7aa3cc21da4145cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/886b72a54e9b4ee7aa3cc21da4145cbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/886b72a54e9b4ee7aa3cc21da4145cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_886b72a54e9b4ee7aa3cc21da4145cbb", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-AttachVolumeNegativeTest-545911130 Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 886b72a54e9b4ee7aa3cc21da4145cbb Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-545911130 Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-AttachVolumeNegativeTest-545911130-project Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: f62326a9deb140e891c07529dc021d11 Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-AttachVolumeNegativeTest-545911130-project Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: {"volumeAttachment": {"volumeId": "e2133052-2714-4dc1-910d-676a2c9eb823"}} Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: exception: Invalid volume: volume e2133052-2714-4dc1-910d-676a2c9eb823 is already attached to instances: 1c741087-7c53-4118-8b3d-9654a4f6ff48 Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: action_args: {'server_id': '1c741087-7c53-4118-8b3d-9654a4f6ff48', 'body': {'volumeAttachment': {'volumeId': 'e2133052-2714-4dc1-910d-676a2c9eb823'}}} Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e2133052-2714-4dc1-910d-676a2c9eb823 is already attached to instances: 1c741087-7c53-4118-8b3d-9654a4f6ff48 Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:29:28.507881 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:29:28.513027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:29:28.513027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:29:28.513027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 10 18:29:28.513027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 10 18:29:28.513027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e2133052-2714-4dc1-910d-676a2c9eb823 is already attached to instances: 1c741087-7c53-4118-8b3d-9654a4f6ff48 Jun 10 18:29:28.513027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:28.513027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:29:28.513027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:28.513027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:28.513027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:29:28.513027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:29:28.513027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:29:28.513027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:29:28.513027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e2133052-2714-4dc1-910d-676a2c9eb823 is already attached to instances: 1c741087-7c53-4118-8b3d-9654a4f6ff48 Jun 10 18:29:28.513027 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:28.519226 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-65a72c6e-3811-4b49-946d-be3ce0f721dd tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Returning 400 to user: Invalid volume: volume e2133052-2714-4dc1-910d-676a2c9eb823 is already attached to instances: 1c741087-7c53-4118-8b3d-9654a4f6ff48 {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:29:28.523651 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-65a72c6e-3811-4b49-946d-be3ce0f721dd tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "POST /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.224566 Jun 10 18:29:28.545266 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3051/6148] 10.222.0.35 () {60 vars in 1322 bytes} [Fri Jun 10 18:29:28 2022] POST /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48/os-volume_attachments => generated 174 bytes in 249 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:29:28.697275 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-289f1abf-7972-4b1f-b0e6-3185872947e8 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:28.707202 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-289f1abf-7972-4b1f-b0e6-3185872947e8 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 1c741087-7c53-4118-8b3d-9654a4f6ff48] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:28.734340 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-289f1abf-7972-4b1f-b0e6-3185872947e8 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:28.737191 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-289f1abf-7972-4b1f-b0e6-3185872947e8 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:28.739818 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-289f1abf-7972-4b1f-b0e6-3185872947e8 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:28.741128 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-289f1abf-7972-4b1f-b0e6-3185872947e8 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:28.893965 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-289f1abf-7972-4b1f-b0e6-3185872947e8 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lazy-loading 'services' on Instance uuid 1c741087-7c53-4118-8b3d-9654a4f6ff48 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:29:29.103567 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-27ad98ea-0766-4ea1-a8be-7b57de0a4298 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:29.104076 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-27ad98ea-0766-4ea1-a8be-7b57de0a4298 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:29.135230 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-27ad98ea-0766-4ea1-a8be-7b57de0a4298 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:29.135771 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-27ad98ea-0766-4ea1-a8be-7b57de0a4298 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:29.143502 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-27ad98ea-0766-4ea1-a8be-7b57de0a4298 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:29.147677 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-27ad98ea-0766-4ea1-a8be-7b57de0a4298 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:29.202439 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-27ad98ea-0766-4ea1-a8be-7b57de0a4298 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d/ips" status: 200 len: 146 microversion: 2.1 time: 0.109989 Jun 10 18:29:29.205233 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3052/6149] 10.222.0.35 () {58 vars in 1247 bytes} [Fri Jun 10 18:29:29 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d/ips => generated 146 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:29:29.231982 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-289f1abf-7972-4b1f-b0e6-3185872947e8 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "DELETE /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48/os-volume_attachments/e2133052-2714-4dc1-910d-676a2c9eb823" status: 202 len: 0 microversion: 2.1 time: 0.543893 Jun 10 18:29:29.233580 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3098/6150] 10.222.0.35 () {58 vars in 1415 bytes} [Fri Jun 10 18:29:28 2022] DELETE /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48/os-volume_attachments/e2133052-2714-4dc1-910d-676a2c9eb823 => generated 0 bytes in 548 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:29:29.258550 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2c9c87b6-cfe8-47c7-9906-ae4effc7cf48 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:29.265427 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2c9c87b6-cfe8-47c7-9906-ae4effc7cf48 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 1c741087-7c53-4118-8b3d-9654a4f6ff48] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:29.273524 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c9c87b6-cfe8-47c7-9906-ae4effc7cf48 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:29.274192 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c9c87b6-cfe8-47c7-9906-ae4effc7cf48 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:29.275173 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c9c87b6-cfe8-47c7-9906-ae4effc7cf48 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:29.275804 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c9c87b6-cfe8-47c7-9906-ae4effc7cf48 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:29.317923 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2c9c87b6-cfe8-47c7-9906-ae4effc7cf48 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068453 Jun 10 18:29:29.324096 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3053/6151] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:29:29 2022] GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:29:30.354476 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-327530db-6eeb-427d-abe8-0c50399200df tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:30.360669 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-327530db-6eeb-427d-abe8-0c50399200df tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 1c741087-7c53-4118-8b3d-9654a4f6ff48] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:30.374880 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-327530db-6eeb-427d-abe8-0c50399200df tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:30.375338 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-327530db-6eeb-427d-abe8-0c50399200df tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:30.376120 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-327530db-6eeb-427d-abe8-0c50399200df tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:30.393322 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-327530db-6eeb-427d-abe8-0c50399200df tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:30.457508 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-327530db-6eeb-427d-abe8-0c50399200df tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130103 Jun 10 18:29:30.464361 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3099/6152] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:29:30 2022] GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:29:31.475600 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ed0359df-a3e0-435b-aba1-e81659b7d70a tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:31.475600 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ed0359df-a3e0-435b-aba1-e81659b7d70a tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 1c741087-7c53-4118-8b3d-9654a4f6ff48] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:31.489154 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ed0359df-a3e0-435b-aba1-e81659b7d70a tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:31.489843 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ed0359df-a3e0-435b-aba1-e81659b7d70a tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:31.493878 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ed0359df-a3e0-435b-aba1-e81659b7d70a tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:31.494541 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ed0359df-a3e0-435b-aba1-e81659b7d70a tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:31.547484 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ed0359df-a3e0-435b-aba1-e81659b7d70a tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077952 Jun 10 18:29:31.548718 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3054/6153] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:29:31 2022] GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:29:32.570169 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6598045e-1f36-47b6-b523-e06fecb77241 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:32.570169 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6598045e-1f36-47b6-b523-e06fecb77241 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 1c741087-7c53-4118-8b3d-9654a4f6ff48] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:32.587161 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6598045e-1f36-47b6-b523-e06fecb77241 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:32.587515 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6598045e-1f36-47b6-b523-e06fecb77241 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:32.588327 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6598045e-1f36-47b6-b523-e06fecb77241 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:32.588767 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6598045e-1f36-47b6-b523-e06fecb77241 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:32.671856 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6598045e-1f36-47b6-b523-e06fecb77241 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113362 Jun 10 18:29:32.682965 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3100/6154] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:29:32 2022] GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:29:33.665445 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9e76db77-2c7d-4cc3-bb41-31d01a3d6471 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07db3ca2-b4e2-4fd7-b4f7-44d6180742fc"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:29:33.666579 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9e76db77-2c7d-4cc3-bb41-31d01a3d6471 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:33.683535 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9e76db77-2c7d-4cc3-bb41-31d01a3d6471 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:33.683918 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9e76db77-2c7d-4cc3-bb41-31d01a3d6471 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:33.684741 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9e76db77-2c7d-4cc3-bb41-31d01a3d6471 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:33.685181 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9e76db77-2c7d-4cc3-bb41-31d01a3d6471 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:33.686617 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-064658f0-7aaf-4d72-9e46-4af0082a291e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:33.687661 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-064658f0-7aaf-4d72-9e46-4af0082a291e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 1c741087-7c53-4118-8b3d-9654a4f6ff48] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:33.700849 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-064658f0-7aaf-4d72-9e46-4af0082a291e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:33.701620 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-064658f0-7aaf-4d72-9e46-4af0082a291e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:33.704848 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-064658f0-7aaf-4d72-9e46-4af0082a291e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:33.704848 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-064658f0-7aaf-4d72-9e46-4af0082a291e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:33.761658 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-064658f0-7aaf-4d72-9e46-4af0082a291e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080375 Jun 10 18:29:33.766257 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3101/6155] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:29:33 2022] GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:29:34.778375 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4f418030-b9cb-45c9-b8f1-0d8179117b44 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:34.779468 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4f418030-b9cb-45c9-b8f1-0d8179117b44 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 1c741087-7c53-4118-8b3d-9654a4f6ff48] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:34.788147 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4f418030-b9cb-45c9-b8f1-0d8179117b44 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:34.788637 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4f418030-b9cb-45c9-b8f1-0d8179117b44 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:34.789448 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4f418030-b9cb-45c9-b8f1-0d8179117b44 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:34.789899 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4f418030-b9cb-45c9-b8f1-0d8179117b44 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:34.809007 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9e76db77-2c7d-4cc3-bb41-31d01a3d6471 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "POST /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.147342 Jun 10 18:29:34.811010 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3055/6156] 10.222.0.35 () {60 vars in 1322 bytes} [Fri Jun 10 18:29:33 2022] POST /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d/os-volume_attachments => generated 194 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:29:34.825405 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4f418030-b9cb-45c9-b8f1-0d8179117b44 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051304 Jun 10 18:29:34.829224 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3102/6157] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:29:34 2022] GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:29:35.842343 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dd1a8229-31e3-4d80-89f0-0c58552734a3 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:35.844037 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dd1a8229-31e3-4d80-89f0-0c58552734a3 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 1c741087-7c53-4118-8b3d-9654a4f6ff48] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:35.854398 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd1a8229-31e3-4d80-89f0-0c58552734a3 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:35.861779 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd1a8229-31e3-4d80-89f0-0c58552734a3 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:35.861779 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd1a8229-31e3-4d80-89f0-0c58552734a3 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:35.861779 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd1a8229-31e3-4d80-89f0-0c58552734a3 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:35.971214 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dd1a8229-31e3-4d80-89f0-0c58552734a3 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137413 Jun 10 18:29:35.977264 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3056/6158] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:29:35 2022] GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:29:36.988899 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-035dc2bf-12b2-4b56-8c35-ac26aa91f6fe tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:36.999209 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-035dc2bf-12b2-4b56-8c35-ac26aa91f6fe tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 1c741087-7c53-4118-8b3d-9654a4f6ff48] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:36.999209 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-035dc2bf-12b2-4b56-8c35-ac26aa91f6fe tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:36.999209 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-035dc2bf-12b2-4b56-8c35-ac26aa91f6fe tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:36.999209 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-035dc2bf-12b2-4b56-8c35-ac26aa91f6fe tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:36.999621 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-035dc2bf-12b2-4b56-8c35-ac26aa91f6fe tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:37.046783 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-035dc2bf-12b2-4b56-8c35-ac26aa91f6fe tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065582 Jun 10 18:29:37.047957 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3103/6159] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:29:36 2022] GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:29:37.300146 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3a5c1815-4f37-44cf-b6bc-f8ffa8def1bf tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:37.304565 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3a5c1815-4f37-44cf-b6bc-f8ffa8def1bf tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 1c741087-7c53-4118-8b3d-9654a4f6ff48] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:37.312820 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3a5c1815-4f37-44cf-b6bc-f8ffa8def1bf tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:37.314640 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3a5c1815-4f37-44cf-b6bc-f8ffa8def1bf tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:37.315181 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3a5c1815-4f37-44cf-b6bc-f8ffa8def1bf tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:37.315809 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3a5c1815-4f37-44cf-b6bc-f8ffa8def1bf tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:37.350831 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3a5c1815-4f37-44cf-b6bc-f8ffa8def1bf tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 1c741087-7c53-4118-8b3d-9654a4f6ff48] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:29:37.781893 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3a5c1815-4f37-44cf-b6bc-f8ffa8def1bf tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "DELETE /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48" status: 204 len: 0 microversion: 2.1 time: 0.500780 Jun 10 18:29:37.786673 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3057/6160] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:29:37 2022] DELETE /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:29:37.792722 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7eedfc0e-2d4b-423e-8d9c-f9fac23d3b93 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:37.793348 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7eedfc0e-2d4b-423e-8d9c-f9fac23d3b93 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 1c741087-7c53-4118-8b3d-9654a4f6ff48] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:37.802344 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7eedfc0e-2d4b-423e-8d9c-f9fac23d3b93 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:37.805417 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7eedfc0e-2d4b-423e-8d9c-f9fac23d3b93 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:37.815487 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7eedfc0e-2d4b-423e-8d9c-f9fac23d3b93 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:37.815487 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7eedfc0e-2d4b-423e-8d9c-f9fac23d3b93 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:38.051282 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7eedfc0e-2d4b-423e-8d9c-f9fac23d3b93 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:29:38.064909 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7eedfc0e-2d4b-423e-8d9c-f9fac23d3b93 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48" status: 200 len: 1682 microversion: 2.1 time: 0.276434 Jun 10 18:29:38.076613 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3104/6161] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:37 2022] GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48 => generated 1682 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:29:39.086158 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1a10fd73-7325-4b6f-b46a-5e4c3e7b7910 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:39.086158 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1a10fd73-7325-4b6f-b46a-5e4c3e7b7910 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 1c741087-7c53-4118-8b3d-9654a4f6ff48] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:39.100554 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1a10fd73-7325-4b6f-b46a-5e4c3e7b7910 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:39.101021 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1a10fd73-7325-4b6f-b46a-5e4c3e7b7910 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:39.103339 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1a10fd73-7325-4b6f-b46a-5e4c3e7b7910 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:39.103786 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1a10fd73-7325-4b6f-b46a-5e4c3e7b7910 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:39.592591 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1a10fd73-7325-4b6f-b46a-5e4c3e7b7910 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:29:39.603195 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1a10fd73-7325-4b6f-b46a-5e4c3e7b7910 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48" status: 200 len: 1682 microversion: 2.1 time: 0.523761 Jun 10 18:29:39.616430 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3058/6162] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:39 2022] GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48 => generated 1682 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:29:40.625628 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c9d37fbf-2668-4b35-995a-125ce8fcf329 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:40.626044 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c9d37fbf-2668-4b35-995a-125ce8fcf329 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 1c741087-7c53-4118-8b3d-9654a4f6ff48] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:40.639607 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c9d37fbf-2668-4b35-995a-125ce8fcf329 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:40.641207 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c9d37fbf-2668-4b35-995a-125ce8fcf329 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:40.642775 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c9d37fbf-2668-4b35-995a-125ce8fcf329 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:40.644627 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c9d37fbf-2668-4b35-995a-125ce8fcf329 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:40.928039 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c9d37fbf-2668-4b35-995a-125ce8fcf329 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:29:40.936790 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c9d37fbf-2668-4b35-995a-125ce8fcf329 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48" status: 200 len: 1682 microversion: 2.1 time: 0.317506 Jun 10 18:29:40.940323 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3105/6163] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:40 2022] GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48 => generated 1682 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:29:41.960603 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d629e95f-f898-4119-b765-66955ade93dc tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:41.962213 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d629e95f-f898-4119-b765-66955ade93dc tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 1c741087-7c53-4118-8b3d-9654a4f6ff48] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:41.979821 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d629e95f-f898-4119-b765-66955ade93dc tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:41.983565 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d629e95f-f898-4119-b765-66955ade93dc tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:41.984184 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d629e95f-f898-4119-b765-66955ade93dc tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:41.985421 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d629e95f-f898-4119-b765-66955ade93dc tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:42.186230 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-c47c59be-2b74-4986-8f1f-8669d62cd836 req-e87504bd-874f-45a8-898f-6ea3ffb18a56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c741087-7c53-4118-8b3d-9654a4f6ff48", "name": "network-vif-deleted", "tag": "787dd400-65e8-4954-b2ba-0f271b49a3a0"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:29:42.192586 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=42 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:29:42.207736 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-c47c59be-2b74-4986-8f1f-8669d62cd836 req-e87504bd-874f-45a8-898f-6ea3ffb18a56 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:42.208510 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-c47c59be-2b74-4986-8f1f-8669d62cd836 req-e87504bd-874f-45a8-898f-6ea3ffb18a56 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:42.217363 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:29:42.235378 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-c47c59be-2b74-4986-8f1f-8669d62cd836 req-e87504bd-874f-45a8-898f-6ea3ffb18a56 service nova] Creating event network-vif-deleted:787dd400-65e8-4954-b2ba-0f271b49a3a0 for instance 1c741087-7c53-4118-8b3d-9654a4f6ff48 on chh1-master-2 Jun 10 18:29:42.242523 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-c47c59be-2b74-4986-8f1f-8669d62cd836 req-e87504bd-874f-45a8-898f-6ea3ffb18a56 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062144 Jun 10 18:29:42.243897 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3106/6164] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:29:42.297712 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d629e95f-f898-4119-b765-66955ade93dc tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:29:42.312141 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d629e95f-f898-4119-b765-66955ade93dc tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48" status: 200 len: 1616 microversion: 2.1 time: 0.356195 Jun 10 18:29:42.315297 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3059/6165] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:41 2022] GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48 => generated 1616 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:29:43.338402 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3bc7ba65-bac9-4e76-8e15-d57fe47855a9 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:43.339969 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3bc7ba65-bac9-4e76-8e15-d57fe47855a9 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 1c741087-7c53-4118-8b3d-9654a4f6ff48] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:43.364912 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3bc7ba65-bac9-4e76-8e15-d57fe47855a9 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:43.365407 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3bc7ba65-bac9-4e76-8e15-d57fe47855a9 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:43.369373 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3bc7ba65-bac9-4e76-8e15-d57fe47855a9 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:43.370641 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3bc7ba65-bac9-4e76-8e15-d57fe47855a9 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:43.433261 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3bc7ba65-bac9-4e76-8e15-d57fe47855a9 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:43.433779 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3bc7ba65-bac9-4e76-8e15-d57fe47855a9 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:43.434249 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-3bc7ba65-bac9-4e76-8e15-d57fe47855a9 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lazy-loading 'fault' on Instance uuid 1c741087-7c53-4118-8b3d-9654a4f6ff48 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:29:43.483788 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3bc7ba65-bac9-4e76-8e15-d57fe47855a9 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:29:43.491389 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3bc7ba65-bac9-4e76-8e15-d57fe47855a9 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48" status: 200 len: 1332 microversion: 2.1 time: 0.163095 Jun 10 18:29:43.493357 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3107/6166] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:43 2022] GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48 => generated 1332 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:29:44.510987 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1a77215f-9ae6-4dcf-a8f6-739217f62249 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:44.512248 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1a77215f-9ae6-4dcf-a8f6-739217f62249 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 1c741087-7c53-4118-8b3d-9654a4f6ff48] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:44.526858 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1a77215f-9ae6-4dcf-a8f6-739217f62249 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:44.527565 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1a77215f-9ae6-4dcf-a8f6-739217f62249 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:44.528572 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1a77215f-9ae6-4dcf-a8f6-739217f62249 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:44.529176 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1a77215f-9ae6-4dcf-a8f6-739217f62249 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:44.593630 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-1a77215f-9ae6-4dcf-a8f6-739217f62249 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] HTTP exception thrown: Instance 1c741087-7c53-4118-8b3d-9654a4f6ff48 could not be found. Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1a77215f-9ae6-4dcf-a8f6-739217f62249 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Request method failure captured: Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48 HTTP/1.1 Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4wSsTbdAR5Qo9IVKF2KTe64dpp06ye4z8lPOT4uRhY2Oz0KMxQpxmr8KJzvNSTZtUIPPEgN2R6-CfUmf8CTAhd_IkVIfk-LuHrtE7255OYmbmFD6LLNrB7dKdWnCpSm8e4XDxNvfMbtjLHwd4svP6YGpBpPTncT2KN4jK3q3Q7l5ew Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 886b72a54e9b4ee7aa3cc21da4145cbb Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-AttachVolumeNegativeTest-545911130 Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/886b72a54e9b4ee7aa3cc21da4145cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/886b72a54e9b4ee7aa3cc21da4145cbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/886b72a54e9b4ee7aa3cc21da4145cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_886b72a54e9b4ee7aa3cc21da4145cbb", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-AttachVolumeNegativeTest-545911130 Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 886b72a54e9b4ee7aa3cc21da4145cbb Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-545911130 Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-AttachVolumeNegativeTest-545911130-project Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: f62326a9deb140e891c07529dc021d11 Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-AttachVolumeNegativeTest-545911130-project Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 1c741087-7c53-4118-8b3d-9654a4f6ff48 could not be found. Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '1c741087-7c53-4118-8b3d-9654a4f6ff48'} Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c741087-7c53-4118-8b3d-9654a4f6ff48 could not be found. Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c741087-7c53-4118-8b3d-9654a4f6ff48 could not be found. Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:29:44.598139 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:44.606626 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:29:44.606626 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:29:44.606626 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:29:44.606626 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:29:44.606626 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:29:44.606626 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c741087-7c53-4118-8b3d-9654a4f6ff48 could not be found. Jun 10 18:29:44.606626 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:29:44.606626 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1a77215f-9ae6-4dcf-a8f6-739217f62249 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Returning 404 to user: Instance 1c741087-7c53-4118-8b3d-9654a4f6ff48 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:29:44.606626 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1a77215f-9ae6-4dcf-a8f6-739217f62249 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48" status: 404 len: 111 microversion: 2.1 time: 0.095515 Jun 10 18:29:44.609182 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3060/6167] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:44 2022] GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:29:44.611677 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4e1b7d9d-cbdd-4ac0-81d6-73e8a0a27d48 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '.version_select at 0x7f77b3d3e0d0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:44.708506 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4e1b7d9d-cbdd-4ac0-81d6-73e8a0a27d48 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2114136018" status: 202 len: 0 microversion: 2.1 time: 0.101629 Jun 10 18:29:44.709374 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3108/6168] 10.222.0.35 () {58 vars in 1220 bytes} [Fri Jun 10 18:29:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2114136018 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:29:45.964187 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-da4d92f5-a64a-4fd9-a6a9-8c48edc08c5a tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Action: 'create', calling method: .version_select at 0x7f77c00a55e0>, body: {"keypair": {"name": "tempest-keypair-488262302", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMjnRSvh9jPFMYpKcI1zbr90UDxYnIyEm26BBLT+qVmjmvbSut+z9k5ECsYcayB1g+eMqgw6Wuz4TvrQntbpYfcRj4R2gFKjfuWVIDqfW3WUf9KV6jcmwPzLLOVRHW6Dg=="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:29:45.980657 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-da4d92f5-a64a-4fd9-a6a9-8c48edc08c5a tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Getting quotas for project 886b72a54e9b4ee7aa3cc21da4145cbb. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:29:45.988484 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-da4d92f5-a64a-4fd9-a6a9-8c48edc08c5a tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Getting quotas for user f62326a9deb140e891c07529dc021d11 and project 886b72a54e9b4ee7aa3cc21da4145cbb. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:29:46.106633 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-da4d92f5-a64a-4fd9-a6a9-8c48edc08c5a tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.143903 Jun 10 18:29:46.106633 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3061/6169] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 18:29:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:29:48.646716 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-eaadb792-0b1f-42e6-85a1-3aa503b20c61 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-755949491", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:29:48.781100 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-eaadb792-0b1f-42e6-85a1-3aa503b20c61 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] validate_networks() for None {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:29:49.131145 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-900f9e21-791e-4e28-b378-d8517bc8022d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1972374876", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bc4d74bc-8446-4d8c-a25b-248884836510"}], "security_groups": [{"name": "tempest-securitygroup--1109355516"}], "key_name": "tempest-keypair-488262302", "user_data": "}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:29:49.278511 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-eaadb792-0b1f-42e6-85a1-3aa503b20c61 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:29:49.279480 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-eaadb792-0b1f-42e6-85a1-3aa503b20c61 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:29:49.280484 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-eaadb792-0b1f-42e6-85a1-3aa503b20c61 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:29:49.281269 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-eaadb792-0b1f-42e6-85a1-3aa503b20c61 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:29:49.282229 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-eaadb792-0b1f-42e6-85a1-3aa503b20c61 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:29:49.306185 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eaadb792-0b1f-42e6-85a1-3aa503b20c61 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:49.310262 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eaadb792-0b1f-42e6-85a1-3aa503b20c61 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:49.312234 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eaadb792-0b1f-42e6-85a1-3aa503b20c61 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:49.315163 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eaadb792-0b1f-42e6-85a1-3aa503b20c61 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:49.343637 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-eaadb792-0b1f-42e6-85a1-3aa503b20c61 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Getting quotas for project fc32fa0ade594d2ab39b527998aa0240. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:29:49.345283 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-900f9e21-791e-4e28-b378-d8517bc8022d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] validate_networks() for [('bc4d74bc-8446-4d8c-a25b-248884836510', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:29:49.351408 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-eaadb792-0b1f-42e6-85a1-3aa503b20c61 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Getting quotas for user 3a3386e31a2d46fd9687cfcbb293f847 and project fc32fa0ade594d2ab39b527998aa0240. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:29:49.368217 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-eaadb792-0b1f-42e6-85a1-3aa503b20c61 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:29:49.384120 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-eaadb792-0b1f-42e6-85a1-3aa503b20c61 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] [instance: 69d898d2-b350-4794-9718-abd5d6a2ab8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:29:49.544700 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-eaadb792-0b1f-42e6-85a1-3aa503b20c61 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.908021 Jun 10 18:29:49.545928 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3109/6170] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:29:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:29:49.562477 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-886d4ffe-1aaa-4c3a-9a18-01c9a51da3a1 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:49.562477 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-886d4ffe-1aaa-4c3a-9a18-01c9a51da3a1 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] [instance: 69d898d2-b350-4794-9718-abd5d6a2ab8a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:49.661570 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-886d4ffe-1aaa-4c3a-9a18-01c9a51da3a1 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3386e31a2d46fd9687cfcbb293f847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32fa0ade594d2ab39b527998aa0240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:29:49.671084 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-886d4ffe-1aaa-4c3a-9a18-01c9a51da3a1 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] 10.222.0.35 "GET /compute/v2.1/servers/69d898d2-b350-4794-9718-abd5d6a2ab8a" status: 200 len: 1214 microversion: 2.1 time: 0.116909 Jun 10 18:29:49.674138 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3110/6171] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:49 2022] GET /compute/v2.1/servers/69d898d2-b350-4794-9718-abd5d6a2ab8a => generated 1214 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:29:49.712427 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4bd84871-9a4d-4286-b9c5-4cc72dda015f tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:29:49.729554 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4bd84871-9a4d-4286-b9c5-4cc72dda015f tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:49.731679 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4bd84871-9a4d-4286-b9c5-4cc72dda015f tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:49.780609 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4bd84871-9a4d-4286-b9c5-4cc72dda015f tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Going to try to stop instance {{(pid=126594) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 10 18:29:49.973952 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4bd84871-9a4d-4286-b9c5-4cc72dda015f tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "POST /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d/action" status: 202 len: 0 microversion: 2.1 time: 0.270927 Jun 10 18:29:49.977896 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3111/6172] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:29:49 2022] POST /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:29:49.980626 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-900f9e21-791e-4e28-b378-d8517bc8022d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:29:49.981266 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-900f9e21-791e-4e28-b378-d8517bc8022d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:29:49.982709 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-900f9e21-791e-4e28-b378-d8517bc8022d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:29:49.983907 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b35622be-1636-4faf-b724-9200a437226e tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:49.984111 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-900f9e21-791e-4e28-b378-d8517bc8022d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:29:49.984731 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-900f9e21-791e-4e28-b378-d8517bc8022d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:29:49.984991 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b35622be-1636-4faf-b724-9200a437226e tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:49.991997 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b35622be-1636-4faf-b724-9200a437226e tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:49.992738 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b35622be-1636-4faf-b724-9200a437226e tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:49.993784 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b35622be-1636-4faf-b724-9200a437226e tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:49.994433 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b35622be-1636-4faf-b724-9200a437226e tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:49.995280 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-900f9e21-791e-4e28-b378-d8517bc8022d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:49.995727 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-900f9e21-791e-4e28-b378-d8517bc8022d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:49.996565 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-900f9e21-791e-4e28-b378-d8517bc8022d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:49.997002 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-900f9e21-791e-4e28-b378-d8517bc8022d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:50.015700 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-900f9e21-791e-4e28-b378-d8517bc8022d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Getting quotas for project 886b72a54e9b4ee7aa3cc21da4145cbb. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:29:50.021729 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-900f9e21-791e-4e28-b378-d8517bc8022d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Getting quotas for user f62326a9deb140e891c07529dc021d11 and project 886b72a54e9b4ee7aa3cc21da4145cbb. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:29:50.036168 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-900f9e21-791e-4e28-b378-d8517bc8022d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:29:50.038475 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-900f9e21-791e-4e28-b378-d8517bc8022d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:29:50.189840 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-900f9e21-791e-4e28-b378-d8517bc8022d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.065744 Jun 10 18:29:50.191776 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3062/6173] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:29:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 1068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:29:50.205120 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1b4ba194-a6c8-4736-9071-e8468474ddf6 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:50.206595 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1b4ba194-a6c8-4736-9071-e8468474ddf6 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:50.294245 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1b4ba194-a6c8-4736-9071-e8468474ddf6 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:29:50.298919 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1b4ba194-a6c8-4736-9071-e8468474ddf6 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9" status: 200 len: 1241 microversion: 2.1 time: 0.100777 Jun 10 18:29:50.301183 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3063/6174] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:50 2022] GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 => generated 1241 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:29:50.557940 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b35622be-1636-4faf-b724-9200a437226e tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:29:50.557940 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b35622be-1636-4faf-b724-9200a437226e tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1723 microversion: 2.1 time: 0.574179 Jun 10 18:29:50.568214 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3112/6175] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:49 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1723 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:29:50.691446 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1c76291c-a829-4f27-b0f8-0b1f0ea53726 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:50.692063 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1c76291c-a829-4f27-b0f8-0b1f0ea53726 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] [instance: 69d898d2-b350-4794-9718-abd5d6a2ab8a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:50.779490 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1c76291c-a829-4f27-b0f8-0b1f0ea53726 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3386e31a2d46fd9687cfcbb293f847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32fa0ade594d2ab39b527998aa0240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:29:50.797373 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1c76291c-a829-4f27-b0f8-0b1f0ea53726 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] 10.222.0.35 "GET /compute/v2.1/servers/69d898d2-b350-4794-9718-abd5d6a2ab8a" status: 200 len: 1214 microversion: 2.1 time: 0.110691 Jun 10 18:29:50.799000 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3064/6176] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:50 2022] GET /compute/v2.1/servers/69d898d2-b350-4794-9718-abd5d6a2ab8a => generated 1214 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:29:51.320649 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-34006a82-34c3-488c-a6c6-9410859f3851 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:51.321950 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-34006a82-34c3-488c-a6c6-9410859f3851 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:51.442625 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-34006a82-34c3-488c-a6c6-9410859f3851 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:29:51.453303 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-34006a82-34c3-488c-a6c6-9410859f3851 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9" status: 200 len: 1241 microversion: 2.1 time: 0.139504 Jun 10 18:29:51.463458 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3113/6177] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:51 2022] GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 => generated 1241 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:29:51.575194 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-487ee4a3-65b1-4af6-ac21-e481d962b49b tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:51.576458 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-487ee4a3-65b1-4af6-ac21-e481d962b49b tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:51.584656 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-487ee4a3-65b1-4af6-ac21-e481d962b49b tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:51.585220 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-487ee4a3-65b1-4af6-ac21-e481d962b49b tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:51.586069 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-487ee4a3-65b1-4af6-ac21-e481d962b49b tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:51.586577 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-487ee4a3-65b1-4af6-ac21-e481d962b49b tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:51.815901 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-afed8279-49c5-4338-b20f-452af23b8cd6 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:51.816570 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-afed8279-49c5-4338-b20f-452af23b8cd6 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] [instance: 69d898d2-b350-4794-9718-abd5d6a2ab8a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:51.825763 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-afed8279-49c5-4338-b20f-452af23b8cd6 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:51.826234 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-afed8279-49c5-4338-b20f-452af23b8cd6 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:51.827036 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-afed8279-49c5-4338-b20f-452af23b8cd6 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:51.845397 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-afed8279-49c5-4338-b20f-452af23b8cd6 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:51.872377 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-487ee4a3-65b1-4af6-ac21-e481d962b49b tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:29:51.899852 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-487ee4a3-65b1-4af6-ac21-e481d962b49b tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1723 microversion: 2.1 time: 0.326099 Jun 10 18:29:51.901821 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3065/6178] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:51 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1723 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:29:51.955684 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-afed8279-49c5-4338-b20f-452af23b8cd6 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3386e31a2d46fd9687cfcbb293f847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32fa0ade594d2ab39b527998aa0240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:29:51.965856 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-afed8279-49c5-4338-b20f-452af23b8cd6 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] 10.222.0.35 "GET /compute/v2.1/servers/69d898d2-b350-4794-9718-abd5d6a2ab8a" status: 200 len: 1266 microversion: 2.1 time: 0.154590 Jun 10 18:29:51.966449 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3114/6179] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:51 2022] GET /compute/v2.1/servers/69d898d2-b350-4794-9718-abd5d6a2ab8a => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:29:52.471606 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5b0706a8-f4f7-4d8d-b3b7-1716df00667c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:52.472390 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5b0706a8-f4f7-4d8d-b3b7-1716df00667c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:52.482300 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5b0706a8-f4f7-4d8d-b3b7-1716df00667c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:52.482769 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5b0706a8-f4f7-4d8d-b3b7-1716df00667c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:52.491013 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5b0706a8-f4f7-4d8d-b3b7-1716df00667c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:52.491013 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5b0706a8-f4f7-4d8d-b3b7-1716df00667c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:52.627870 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5b0706a8-f4f7-4d8d-b3b7-1716df00667c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:29:52.671794 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5b0706a8-f4f7-4d8d-b3b7-1716df00667c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9" status: 200 len: 1293 microversion: 2.1 time: 0.204693 Jun 10 18:29:52.680872 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3066/6180] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:52 2022] GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 => generated 1293 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:29:52.919271 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f2f32c2d-442b-46f1-a3e6-e999f2be4735 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:52.919985 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f2f32c2d-442b-46f1-a3e6-e999f2be4735 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:52.937913 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f2f32c2d-442b-46f1-a3e6-e999f2be4735 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:52.948099 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f2f32c2d-442b-46f1-a3e6-e999f2be4735 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:52.954882 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f2f32c2d-442b-46f1-a3e6-e999f2be4735 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:52.955514 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f2f32c2d-442b-46f1-a3e6-e999f2be4735 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:52.986617 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-44ffec9a-be26-4a4f-9817-a7fcf5065866 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:52.987463 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-44ffec9a-be26-4a4f-9817-a7fcf5065866 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] [instance: 69d898d2-b350-4794-9718-abd5d6a2ab8a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:53.001471 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44ffec9a-be26-4a4f-9817-a7fcf5065866 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:53.005210 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44ffec9a-be26-4a4f-9817-a7fcf5065866 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:53.007124 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44ffec9a-be26-4a4f-9817-a7fcf5065866 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:53.007901 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44ffec9a-be26-4a4f-9817-a7fcf5065866 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:53.211358 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-44ffec9a-be26-4a4f-9817-a7fcf5065866 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3386e31a2d46fd9687cfcbb293f847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32fa0ade594d2ab39b527998aa0240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:29:53.221381 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-44ffec9a-be26-4a4f-9817-a7fcf5065866 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] 10.222.0.35 "GET /compute/v2.1/servers/69d898d2-b350-4794-9718-abd5d6a2ab8a" status: 200 len: 1284 microversion: 2.1 time: 0.240468 Jun 10 18:29:53.229741 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3067/6181] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:52 2022] GET /compute/v2.1/servers/69d898d2-b350-4794-9718-abd5d6a2ab8a => generated 1284 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:29:53.330437 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f2f32c2d-442b-46f1-a3e6-e999f2be4735 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:29:53.341302 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f2f32c2d-442b-46f1-a3e6-e999f2be4735 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1723 microversion: 2.1 time: 0.426152 Jun 10 18:29:53.343374 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3115/6182] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:52 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1723 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:29:53.698879 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1ee45434-92a2-4217-ac5e-d37b93c809bd tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:53.699494 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1ee45434-92a2-4217-ac5e-d37b93c809bd tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:53.708865 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1ee45434-92a2-4217-ac5e-d37b93c809bd tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:53.709320 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1ee45434-92a2-4217-ac5e-d37b93c809bd tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:53.710103 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1ee45434-92a2-4217-ac5e-d37b93c809bd tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:53.710547 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1ee45434-92a2-4217-ac5e-d37b93c809bd tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:53.831797 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1ee45434-92a2-4217-ac5e-d37b93c809bd tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:29:53.864779 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1ee45434-92a2-4217-ac5e-d37b93c809bd tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9" status: 200 len: 1299 microversion: 2.1 time: 0.157922 Jun 10 18:29:53.864779 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3068/6183] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:53 2022] GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 => generated 1299 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:29:54.248018 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e9c213ac-91ff-4851-80a4-2b3e64fd4604 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:54.250247 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e9c213ac-91ff-4851-80a4-2b3e64fd4604 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] [instance: 69d898d2-b350-4794-9718-abd5d6a2ab8a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:54.270741 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e9c213ac-91ff-4851-80a4-2b3e64fd4604 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:54.271691 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e9c213ac-91ff-4851-80a4-2b3e64fd4604 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:54.272570 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e9c213ac-91ff-4851-80a4-2b3e64fd4604 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:54.273031 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e9c213ac-91ff-4851-80a4-2b3e64fd4604 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:54.342203 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e9c213ac-91ff-4851-80a4-2b3e64fd4604 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3386e31a2d46fd9687cfcbb293f847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32fa0ade594d2ab39b527998aa0240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:29:54.350031 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e9c213ac-91ff-4851-80a4-2b3e64fd4604 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] 10.222.0.35 "GET /compute/v2.1/servers/69d898d2-b350-4794-9718-abd5d6a2ab8a" status: 200 len: 1272 microversion: 2.1 time: 0.110852 Jun 10 18:29:54.350621 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3116/6184] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:54 2022] GET /compute/v2.1/servers/69d898d2-b350-4794-9718-abd5d6a2ab8a => generated 1272 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:29:54.358818 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-96ee4a79-00d6-495a-bd6f-7d973283ce30 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:54.359722 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-96ee4a79-00d6-495a-bd6f-7d973283ce30 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:54.367576 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-96ee4a79-00d6-495a-bd6f-7d973283ce30 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:54.368035 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-96ee4a79-00d6-495a-bd6f-7d973283ce30 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:54.368809 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-96ee4a79-00d6-495a-bd6f-7d973283ce30 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:54.369246 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-96ee4a79-00d6-495a-bd6f-7d973283ce30 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:54.710810 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-96ee4a79-00d6-495a-bd6f-7d973283ce30 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:29:54.720474 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-96ee4a79-00d6-495a-bd6f-7d973283ce30 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1723 microversion: 2.1 time: 0.364020 Jun 10 18:29:54.721354 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3069/6185] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:54 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1723 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:29:54.880196 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-740b0a56-45e5-4301-aee7-78108f946c91 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:54.881096 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-740b0a56-45e5-4301-aee7-78108f946c91 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:54.900216 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-740b0a56-45e5-4301-aee7-78108f946c91 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:54.900700 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-740b0a56-45e5-4301-aee7-78108f946c91 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:54.902004 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-740b0a56-45e5-4301-aee7-78108f946c91 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:54.905606 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-740b0a56-45e5-4301-aee7-78108f946c91 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:55.181000 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-740b0a56-45e5-4301-aee7-78108f946c91 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:29:55.192662 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-740b0a56-45e5-4301-aee7-78108f946c91 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9" status: 200 len: 1367 microversion: 2.1 time: 0.316172 Jun 10 18:29:55.193933 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3117/6186] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:54 2022] GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 => generated 1367 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:29:55.368265 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c53650c9-bdbc-403a-8cdc-e80846be9286 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:55.370665 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c53650c9-bdbc-403a-8cdc-e80846be9286 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] [instance: 69d898d2-b350-4794-9718-abd5d6a2ab8a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:55.380393 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c53650c9-bdbc-403a-8cdc-e80846be9286 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:55.383236 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c53650c9-bdbc-403a-8cdc-e80846be9286 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:55.384138 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c53650c9-bdbc-403a-8cdc-e80846be9286 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:55.385036 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c53650c9-bdbc-403a-8cdc-e80846be9286 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:55.423387 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:29:55.745307 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5d8b0ae6-0edf-472f-88f3-bf89d1ce5fce tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:55.745936 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5d8b0ae6-0edf-472f-88f3-bf89d1ce5fce tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:55.760604 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5d8b0ae6-0edf-472f-88f3-bf89d1ce5fce tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:55.761325 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5d8b0ae6-0edf-472f-88f3-bf89d1ce5fce tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:55.764926 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5d8b0ae6-0edf-472f-88f3-bf89d1ce5fce tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:55.766173 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5d8b0ae6-0edf-472f-88f3-bf89d1ce5fce tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:55.962244 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5d8b0ae6-0edf-472f-88f3-bf89d1ce5fce tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:29:55.974857 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5d8b0ae6-0edf-472f-88f3-bf89d1ce5fce tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1723 microversion: 2.1 time: 0.241261 Jun 10 18:29:55.975339 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c53650c9-bdbc-403a-8cdc-e80846be9286 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3386e31a2d46fd9687cfcbb293f847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32fa0ade594d2ab39b527998aa0240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:29:55.978235 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3118/6187] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:55 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:29:56.001468 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c53650c9-bdbc-403a-8cdc-e80846be9286 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] 10.222.0.35 "GET /compute/v2.1/servers/69d898d2-b350-4794-9718-abd5d6a2ab8a" status: 200 len: 1314 microversion: 2.1 time: 0.637581 Jun 10 18:29:56.002058 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3070/6188] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:55 2022] GET /compute/v2.1/servers/69d898d2-b350-4794-9718-abd5d6a2ab8a => generated 1314 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:29:56.211438 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7dfd325e-137d-42c8-8a3b-609f2ef747a1 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:56.212565 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7dfd325e-137d-42c8-8a3b-609f2ef747a1 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:56.222709 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7dfd325e-137d-42c8-8a3b-609f2ef747a1 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:56.223190 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7dfd325e-137d-42c8-8a3b-609f2ef747a1 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:56.224564 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7dfd325e-137d-42c8-8a3b-609f2ef747a1 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:56.225193 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7dfd325e-137d-42c8-8a3b-609f2ef747a1 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:56.584719 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7dfd325e-137d-42c8-8a3b-609f2ef747a1 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:29:56.598656 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7dfd325e-137d-42c8-8a3b-609f2ef747a1 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9" status: 200 len: 1367 microversion: 2.1 time: 0.392838 Jun 10 18:29:56.599523 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3119/6189] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:56 2022] GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 => generated 1367 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:29:57.001569 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-73373158-344a-40fa-beb8-3c01ac0643eb tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:57.001569 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-73373158-344a-40fa-beb8-3c01ac0643eb tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:57.021979 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-73373158-344a-40fa-beb8-3c01ac0643eb tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:57.022478 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-73373158-344a-40fa-beb8-3c01ac0643eb tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:57.023279 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-73373158-344a-40fa-beb8-3c01ac0643eb tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:57.023720 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-73373158-344a-40fa-beb8-3c01ac0643eb tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:57.031254 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3389d71c-db4c-4738-8bf2-33c6b0e4a8f5 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:57.033321 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3389d71c-db4c-4738-8bf2-33c6b0e4a8f5 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] [instance: 69d898d2-b350-4794-9718-abd5d6a2ab8a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:57.054272 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3389d71c-db4c-4738-8bf2-33c6b0e4a8f5 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:57.055054 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3389d71c-db4c-4738-8bf2-33c6b0e4a8f5 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:57.056254 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3389d71c-db4c-4738-8bf2-33c6b0e4a8f5 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:57.059142 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3389d71c-db4c-4738-8bf2-33c6b0e4a8f5 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:57.383066 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3389d71c-db4c-4738-8bf2-33c6b0e4a8f5 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3386e31a2d46fd9687cfcbb293f847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32fa0ade594d2ab39b527998aa0240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:29:57.393719 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3389d71c-db4c-4738-8bf2-33c6b0e4a8f5 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] 10.222.0.35 "GET /compute/v2.1/servers/69d898d2-b350-4794-9718-abd5d6a2ab8a" status: 200 len: 1314 microversion: 2.1 time: 0.373244 Jun 10 18:29:57.394345 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3120/6190] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:57 2022] GET /compute/v2.1/servers/69d898d2-b350-4794-9718-abd5d6a2ab8a => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:29:57.417718 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-d424a201-0bb2-4ad8-9695-ad7cfe52daa7 req-1627f8d4-9255-470c-9d90-963a085c6701 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f44873d-6e6d-4f55-ace2-4cfa0f2630d9", "tag": "6ada8c68-f20d-4937-9d47-4aff6bcfe56e"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:29:57.442191 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-d424a201-0bb2-4ad8-9695-ad7cfe52daa7 req-1627f8d4-9255-470c-9d90-963a085c6701 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:57.448747 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-d424a201-0bb2-4ad8-9695-ad7cfe52daa7 req-1627f8d4-9255-470c-9d90-963a085c6701 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:57.475377 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-d424a201-0bb2-4ad8-9695-ad7cfe52daa7 req-1627f8d4-9255-470c-9d90-963a085c6701 service nova] Creating event network-changed:6ada8c68-f20d-4937-9d47-4aff6bcfe56e for instance 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 on chh1-master-2 Jun 10 18:29:57.497486 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-d424a201-0bb2-4ad8-9695-ad7cfe52daa7 req-1627f8d4-9255-470c-9d90-963a085c6701 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101830 Jun 10 18:29:57.544749 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3121/6191] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:29:57.617742 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-dd24d5af-3ad0-4e82-a7c6-22a6b3ef87d1 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:57.618467 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-dd24d5af-3ad0-4e82-a7c6-22a6b3ef87d1 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:57.652563 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dd24d5af-3ad0-4e82-a7c6-22a6b3ef87d1 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:57.654172 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dd24d5af-3ad0-4e82-a7c6-22a6b3ef87d1 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:57.655292 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dd24d5af-3ad0-4e82-a7c6-22a6b3ef87d1 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:57.657413 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dd24d5af-3ad0-4e82-a7c6-22a6b3ef87d1 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:57.684345 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-73373158-344a-40fa-beb8-3c01ac0643eb tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:29:57.711546 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-73373158-344a-40fa-beb8-3c01ac0643eb tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1723 microversion: 2.1 time: 0.719430 Jun 10 18:29:57.714617 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3071/6192] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:56 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1723 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:29:57.936289 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-dd24d5af-3ad0-4e82-a7c6-22a6b3ef87d1 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:29:57.944365 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-dd24d5af-3ad0-4e82-a7c6-22a6b3ef87d1 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9" status: 200 len: 1367 microversion: 2.1 time: 0.331159 Jun 10 18:29:57.945174 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3122/6193] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:57 2022] GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 => generated 1367 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:29:58.417341 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-de55608b-38f3-4492-b1c6-b07a5b2f0f05 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:58.418149 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-de55608b-38f3-4492-b1c6-b07a5b2f0f05 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] [instance: 69d898d2-b350-4794-9718-abd5d6a2ab8a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:58.428618 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de55608b-38f3-4492-b1c6-b07a5b2f0f05 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:58.429391 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de55608b-38f3-4492-b1c6-b07a5b2f0f05 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:58.430381 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de55608b-38f3-4492-b1c6-b07a5b2f0f05 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:58.431237 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de55608b-38f3-4492-b1c6-b07a5b2f0f05 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:58.592515 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-de55608b-38f3-4492-b1c6-b07a5b2f0f05 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3386e31a2d46fd9687cfcbb293f847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32fa0ade594d2ab39b527998aa0240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:29:58.602113 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-de55608b-38f3-4492-b1c6-b07a5b2f0f05 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] 10.222.0.35 "GET /compute/v2.1/servers/69d898d2-b350-4794-9718-abd5d6a2ab8a" status: 200 len: 1314 microversion: 2.1 time: 0.188775 Jun 10 18:29:58.605902 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3072/6194] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:58 2022] GET /compute/v2.1/servers/69d898d2-b350-4794-9718-abd5d6a2ab8a => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:29:58.734138 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f38db1af-c3bd-4fdb-b589-177ea5d473c1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:58.736683 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f38db1af-c3bd-4fdb-b589-177ea5d473c1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:58.747502 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f38db1af-c3bd-4fdb-b589-177ea5d473c1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:58.747990 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f38db1af-c3bd-4fdb-b589-177ea5d473c1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:58.751784 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f38db1af-c3bd-4fdb-b589-177ea5d473c1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:58.752491 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f38db1af-c3bd-4fdb-b589-177ea5d473c1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:58.909237 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f38db1af-c3bd-4fdb-b589-177ea5d473c1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:29:58.920601 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f38db1af-c3bd-4fdb-b589-177ea5d473c1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1723 microversion: 2.1 time: 0.193171 Jun 10 18:29:58.933232 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3123/6195] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:58 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:29:58.963463 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-964bd7b7-8f1f-4ba5-8c50-a6bfe8244a02 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:58.964275 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-964bd7b7-8f1f-4ba5-8c50-a6bfe8244a02 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:58.973562 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-964bd7b7-8f1f-4ba5-8c50-a6bfe8244a02 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:58.973562 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-964bd7b7-8f1f-4ba5-8c50-a6bfe8244a02 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:58.973562 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-964bd7b7-8f1f-4ba5-8c50-a6bfe8244a02 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:58.973562 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-964bd7b7-8f1f-4ba5-8c50-a6bfe8244a02 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:59.206609 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-964bd7b7-8f1f-4ba5-8c50-a6bfe8244a02 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:29:59.216238 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-964bd7b7-8f1f-4ba5-8c50-a6bfe8244a02 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9" status: 200 len: 1367 microversion: 2.1 time: 0.257431 Jun 10 18:29:59.219757 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3073/6196] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:58 2022] GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 => generated 1367 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:29:59.556767 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-b8172230-a995-4bad-889c-866f66dc4b7d req-024413b8-d15c-46d6-8642-6953c731170f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69d898d2-b350-4794-9718-abd5d6a2ab8a", "tag": "b5d15fab-b5f3-4eca-9c73-f950ecfa484b"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:29:59.561447 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:29:59.569005 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-b8172230-a995-4bad-889c-866f66dc4b7d req-024413b8-d15c-46d6-8642-6953c731170f service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:59.569719 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-b8172230-a995-4bad-889c-866f66dc4b7d req-024413b8-d15c-46d6-8642-6953c731170f service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:59.619418 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-b8172230-a995-4bad-889c-866f66dc4b7d req-024413b8-d15c-46d6-8642-6953c731170f service nova] Creating event network-changed:b5d15fab-b5f3-4eca-9c73-f950ecfa484b for instance 69d898d2-b350-4794-9718-abd5d6a2ab8a on chh1-master-2 Jun 10 18:29:59.620806 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f7683911-c6a8-4c17-a179-07ade2754635 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:59.623204 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f7683911-c6a8-4c17-a179-07ade2754635 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] [instance: 69d898d2-b350-4794-9718-abd5d6a2ab8a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:59.626399 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:29:59.630320 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-b8172230-a995-4bad-889c-866f66dc4b7d req-024413b8-d15c-46d6-8642-6953c731170f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079106 Jun 10 18:29:59.630320 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3124/6197] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:29:59.640730 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f7683911-c6a8-4c17-a179-07ade2754635 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:59.641714 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f7683911-c6a8-4c17-a179-07ade2754635 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:59.647056 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f7683911-c6a8-4c17-a179-07ade2754635 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:59.647574 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f7683911-c6a8-4c17-a179-07ade2754635 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:59.882385 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f7683911-c6a8-4c17-a179-07ade2754635 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3386e31a2d46fd9687cfcbb293f847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32fa0ade594d2ab39b527998aa0240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:29:59.893556 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f7683911-c6a8-4c17-a179-07ade2754635 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] 10.222.0.35 "GET /compute/v2.1/servers/69d898d2-b350-4794-9718-abd5d6a2ab8a" status: 200 len: 1314 microversion: 2.1 time: 0.277959 Jun 10 18:29:59.894359 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3074/6198] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:59 2022] GET /compute/v2.1/servers/69d898d2-b350-4794-9718-abd5d6a2ab8a => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:29:59.940341 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-915b9a08-f613-4996-889d-90a3fa499558 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:29:59.941863 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-915b9a08-f613-4996-889d-90a3fa499558 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:29:59.950902 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-915b9a08-f613-4996-889d-90a3fa499558 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:59.960185 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-915b9a08-f613-4996-889d-90a3fa499558 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:29:59.960185 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-915b9a08-f613-4996-889d-90a3fa499558 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:29:59.960185 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-915b9a08-f613-4996-889d-90a3fa499558 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:00.231501 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-915b9a08-f613-4996-889d-90a3fa499558 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:00.234546 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c433ec5e-2ee5-4633-938e-46ae9ff9d4ef tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:00.240055 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c433ec5e-2ee5-4633-938e-46ae9ff9d4ef tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:00.242363 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:30:00.246402 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-915b9a08-f613-4996-889d-90a3fa499558 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1723 microversion: 2.1 time: 0.307764 Jun 10 18:30:00.248889 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3125/6199] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:29:59 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1723 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:30:00.274189 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c433ec5e-2ee5-4633-938e-46ae9ff9d4ef tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:00.274800 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c433ec5e-2ee5-4633-938e-46ae9ff9d4ef tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:00.275649 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c433ec5e-2ee5-4633-938e-46ae9ff9d4ef tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:00.276093 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c433ec5e-2ee5-4633-938e-46ae9ff9d4ef tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:00.795830 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=14 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:30:00.864140 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c433ec5e-2ee5-4633-938e-46ae9ff9d4ef tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:00.875724 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c433ec5e-2ee5-4633-938e-46ae9ff9d4ef tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9" status: 200 len: 1367 microversion: 2.1 time: 0.644090 Jun 10 18:30:00.877086 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3075/6200] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:00 2022] GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 => generated 1367 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:30:00.912805 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7976eb3c-3f56-42e4-922a-69e988e7cace tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:00.913433 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7976eb3c-3f56-42e4-922a-69e988e7cace tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] [instance: 69d898d2-b350-4794-9718-abd5d6a2ab8a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:00.920326 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7976eb3c-3f56-42e4-922a-69e988e7cace tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:00.923748 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7976eb3c-3f56-42e4-922a-69e988e7cace tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:00.923748 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7976eb3c-3f56-42e4-922a-69e988e7cace tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:00.923748 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7976eb3c-3f56-42e4-922a-69e988e7cace tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:01.161651 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7976eb3c-3f56-42e4-922a-69e988e7cace tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3386e31a2d46fd9687cfcbb293f847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32fa0ade594d2ab39b527998aa0240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:01.170928 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7976eb3c-3f56-42e4-922a-69e988e7cace tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] 10.222.0.35 "GET /compute/v2.1/servers/69d898d2-b350-4794-9718-abd5d6a2ab8a" status: 200 len: 1314 microversion: 2.1 time: 0.264007 Jun 10 18:30:01.180629 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3126/6201] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:00 2022] GET /compute/v2.1/servers/69d898d2-b350-4794-9718-abd5d6a2ab8a => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:30:01.271085 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-00d298a3-7b43-4885-bbf5-fcf011dc2a94 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:01.271085 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-00d298a3-7b43-4885-bbf5-fcf011dc2a94 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:01.278122 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-00d298a3-7b43-4885-bbf5-fcf011dc2a94 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:01.280587 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-00d298a3-7b43-4885-bbf5-fcf011dc2a94 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:01.281871 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-00d298a3-7b43-4885-bbf5-fcf011dc2a94 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:01.282570 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-00d298a3-7b43-4885-bbf5-fcf011dc2a94 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:01.600538 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-00d298a3-7b43-4885-bbf5-fcf011dc2a94 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:01.608961 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-00d298a3-7b43-4885-bbf5-fcf011dc2a94 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1723 microversion: 2.1 time: 0.346975 Jun 10 18:30:01.612829 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3076/6202] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:01 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1723 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:30:01.895290 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4dc6f134-855c-430a-9b89-693c1522fa16 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:01.897881 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4dc6f134-855c-430a-9b89-693c1522fa16 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:01.907756 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=10 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:30:01.910280 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4dc6f134-855c-430a-9b89-693c1522fa16 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:01.911254 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4dc6f134-855c-430a-9b89-693c1522fa16 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:01.912485 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4dc6f134-855c-430a-9b89-693c1522fa16 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:01.913109 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4dc6f134-855c-430a-9b89-693c1522fa16 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:01.922410 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:30:02.107769 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4dc6f134-855c-430a-9b89-693c1522fa16 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:02.116092 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4dc6f134-855c-430a-9b89-693c1522fa16 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9" status: 200 len: 1367 microversion: 2.1 time: 0.226690 Jun 10 18:30:02.117049 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3127/6203] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:01 2022] GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:30:02.198201 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3d0df480-a44e-4198-9b1a-c5882de5b1fa tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:02.199070 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3d0df480-a44e-4198-9b1a-c5882de5b1fa tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] [instance: 69d898d2-b350-4794-9718-abd5d6a2ab8a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:02.217088 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3d0df480-a44e-4198-9b1a-c5882de5b1fa tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:02.217549 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3d0df480-a44e-4198-9b1a-c5882de5b1fa tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:02.225432 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3d0df480-a44e-4198-9b1a-c5882de5b1fa tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:02.225936 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3d0df480-a44e-4198-9b1a-c5882de5b1fa tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:02.438507 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3d0df480-a44e-4198-9b1a-c5882de5b1fa tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3386e31a2d46fd9687cfcbb293f847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32fa0ade594d2ab39b527998aa0240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:02.449855 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3d0df480-a44e-4198-9b1a-c5882de5b1fa tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] 10.222.0.35 "GET /compute/v2.1/servers/69d898d2-b350-4794-9718-abd5d6a2ab8a" status: 200 len: 1314 microversion: 2.1 time: 0.264164 Jun 10 18:30:02.454125 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3077/6204] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:02 2022] GET /compute/v2.1/servers/69d898d2-b350-4794-9718-abd5d6a2ab8a => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:30:02.630151 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-436afec4-0675-4459-8460-44b887b68634 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:02.630786 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-436afec4-0675-4459-8460-44b887b68634 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:02.640061 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-436afec4-0675-4459-8460-44b887b68634 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:02.640596 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-436afec4-0675-4459-8460-44b887b68634 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:02.641411 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-436afec4-0675-4459-8460-44b887b68634 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:02.641854 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-436afec4-0675-4459-8460-44b887b68634 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:02.894754 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-436afec4-0675-4459-8460-44b887b68634 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:02.902967 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-436afec4-0675-4459-8460-44b887b68634 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1723 microversion: 2.1 time: 0.278306 Jun 10 18:30:02.904823 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3128/6205] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:02 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1723 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:30:03.134485 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-527cb3b3-7900-4520-904c-007932858c2b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:03.135045 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-527cb3b3-7900-4520-904c-007932858c2b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:03.142458 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-527cb3b3-7900-4520-904c-007932858c2b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:03.143684 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-527cb3b3-7900-4520-904c-007932858c2b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:03.144722 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-527cb3b3-7900-4520-904c-007932858c2b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:03.145358 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-527cb3b3-7900-4520-904c-007932858c2b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:03.373984 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-527cb3b3-7900-4520-904c-007932858c2b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:03.384892 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-527cb3b3-7900-4520-904c-007932858c2b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9" status: 200 len: 1367 microversion: 2.1 time: 0.255055 Jun 10 18:30:03.386185 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3078/6206] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:03 2022] GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 => generated 1367 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:30:03.470683 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-db11e6b8-1650-432f-bef9-0fe679481801 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:03.471311 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-db11e6b8-1650-432f-bef9-0fe679481801 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] [instance: 69d898d2-b350-4794-9718-abd5d6a2ab8a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:03.486385 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-db11e6b8-1650-432f-bef9-0fe679481801 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:03.487107 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-db11e6b8-1650-432f-bef9-0fe679481801 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:03.488074 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-db11e6b8-1650-432f-bef9-0fe679481801 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:03.488728 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-db11e6b8-1650-432f-bef9-0fe679481801 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:03.745720 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-db11e6b8-1650-432f-bef9-0fe679481801 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3386e31a2d46fd9687cfcbb293f847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32fa0ade594d2ab39b527998aa0240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:03.761741 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-db11e6b8-1650-432f-bef9-0fe679481801 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] 10.222.0.35 "GET /compute/v2.1/servers/69d898d2-b350-4794-9718-abd5d6a2ab8a" status: 200 len: 1314 microversion: 2.1 time: 0.292267 Jun 10 18:30:03.762719 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3129/6207] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:03 2022] GET /compute/v2.1/servers/69d898d2-b350-4794-9718-abd5d6a2ab8a => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:30:03.922784 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-aabbee83-b315-44da-aa34-67f5ada76416 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:03.923544 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-aabbee83-b315-44da-aa34-67f5ada76416 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:03.934194 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aabbee83-b315-44da-aa34-67f5ada76416 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:03.936877 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aabbee83-b315-44da-aa34-67f5ada76416 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:03.937286 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aabbee83-b315-44da-aa34-67f5ada76416 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:03.938450 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aabbee83-b315-44da-aa34-67f5ada76416 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:04.184193 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-aabbee83-b315-44da-aa34-67f5ada76416 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:04.196178 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-aabbee83-b315-44da-aa34-67f5ada76416 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1723 microversion: 2.1 time: 0.278215 Jun 10 18:30:04.197185 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3079/6208] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:03 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1723 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:30:04.405444 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-23831f66-151c-43f9-b6cf-9a4e2156714e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:04.406891 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-23831f66-151c-43f9-b6cf-9a4e2156714e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:04.444363 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-23831f66-151c-43f9-b6cf-9a4e2156714e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:04.444740 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-23831f66-151c-43f9-b6cf-9a4e2156714e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:04.446039 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-23831f66-151c-43f9-b6cf-9a4e2156714e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:04.448841 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-23831f66-151c-43f9-b6cf-9a4e2156714e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:04.663515 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-93650bfe-c8a0-4bd5-baa2-11324790d14d req-d09ae678-d291-4321-b6dc-e4ca329cafba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69d898d2-b350-4794-9718-abd5d6a2ab8a", "name": "network-vif-plugged", "status": "completed", "tag": "b5d15fab-b5f3-4eca-9c73-f950ecfa484b"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:30:04.680354 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-93650bfe-c8a0-4bd5-baa2-11324790d14d req-d09ae678-d291-4321-b6dc-e4ca329cafba service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:04.681043 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-93650bfe-c8a0-4bd5-baa2-11324790d14d req-d09ae678-d291-4321-b6dc-e4ca329cafba service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:04.707050 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-93650bfe-c8a0-4bd5-baa2-11324790d14d req-d09ae678-d291-4321-b6dc-e4ca329cafba service nova] Creating event network-vif-plugged:b5d15fab-b5f3-4eca-9c73-f950ecfa484b for instance 69d898d2-b350-4794-9718-abd5d6a2ab8a on chh1-master-2 Jun 10 18:30:04.712456 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-93650bfe-c8a0-4bd5-baa2-11324790d14d req-d09ae678-d291-4321-b6dc-e4ca329cafba service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053104 Jun 10 18:30:04.713398 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3080/6209] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:30:04.782877 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a173ddfa-5a3c-4e70-9567-131939e43475 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:04.797462 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a173ddfa-5a3c-4e70-9567-131939e43475 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] [instance: 69d898d2-b350-4794-9718-abd5d6a2ab8a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:04.821074 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a173ddfa-5a3c-4e70-9567-131939e43475 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:04.823085 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a173ddfa-5a3c-4e70-9567-131939e43475 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:04.823937 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a173ddfa-5a3c-4e70-9567-131939e43475 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:04.824970 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a173ddfa-5a3c-4e70-9567-131939e43475 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:04.978152 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-23831f66-151c-43f9-b6cf-9a4e2156714e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:04.987838 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-23831f66-151c-43f9-b6cf-9a4e2156714e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9" status: 200 len: 1367 microversion: 2.1 time: 0.586327 Jun 10 18:30:04.997108 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3130/6210] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:04 2022] GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 => generated 1367 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:30:05.215752 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fcf5886c-79e6-4481-b9b7-dd5722fd3744 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:05.218302 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fcf5886c-79e6-4481-b9b7-dd5722fd3744 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:05.227907 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fcf5886c-79e6-4481-b9b7-dd5722fd3744 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:05.228766 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fcf5886c-79e6-4481-b9b7-dd5722fd3744 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:05.229814 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fcf5886c-79e6-4481-b9b7-dd5722fd3744 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:05.230463 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fcf5886c-79e6-4481-b9b7-dd5722fd3744 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:05.465227 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a173ddfa-5a3c-4e70-9567-131939e43475 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3386e31a2d46fd9687cfcbb293f847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32fa0ade594d2ab39b527998aa0240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:05.476259 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a173ddfa-5a3c-4e70-9567-131939e43475 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] 10.222.0.35 "GET /compute/v2.1/servers/69d898d2-b350-4794-9718-abd5d6a2ab8a" status: 200 len: 1314 microversion: 2.1 time: 0.700517 Jun 10 18:30:05.477288 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fcf5886c-79e6-4481-b9b7-dd5722fd3744 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:05.486082 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3081/6211] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:04 2022] GET /compute/v2.1/servers/69d898d2-b350-4794-9718-abd5d6a2ab8a => generated 1314 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:30:05.489420 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fcf5886c-79e6-4481-b9b7-dd5722fd3744 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1723 microversion: 2.1 time: 0.278853 Jun 10 18:30:05.489927 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3131/6212] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:05 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1723 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:30:06.006044 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-63dd5a80-d106-4372-b97b-15686d6c5f44 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:06.006674 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-63dd5a80-d106-4372-b97b-15686d6c5f44 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:06.014338 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-63dd5a80-d106-4372-b97b-15686d6c5f44 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:06.014904 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-63dd5a80-d106-4372-b97b-15686d6c5f44 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:06.016506 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-63dd5a80-d106-4372-b97b-15686d6c5f44 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:06.017060 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-63dd5a80-d106-4372-b97b-15686d6c5f44 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:06.196081 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-63dd5a80-d106-4372-b97b-15686d6c5f44 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:06.209858 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-63dd5a80-d106-4372-b97b-15686d6c5f44 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9" status: 200 len: 1367 microversion: 2.1 time: 0.205295 Jun 10 18:30:06.211005 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3082/6213] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:05 2022] GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:30:06.504205 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f703d411-fc23-4b94-a420-54a00dbeb711 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:06.505397 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f703d411-fc23-4b94-a420-54a00dbeb711 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] [instance: 69d898d2-b350-4794-9718-abd5d6a2ab8a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:06.509432 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5d3c3877-f08f-4585-a033-4edfdeda8396 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:06.510061 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5d3c3877-f08f-4585-a033-4edfdeda8396 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:06.514222 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f703d411-fc23-4b94-a420-54a00dbeb711 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:06.514883 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f703d411-fc23-4b94-a420-54a00dbeb711 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:06.516797 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f703d411-fc23-4b94-a420-54a00dbeb711 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:06.516929 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5d3c3877-f08f-4585-a033-4edfdeda8396 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:06.517295 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5d3c3877-f08f-4585-a033-4edfdeda8396 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:06.517699 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f703d411-fc23-4b94-a420-54a00dbeb711 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:06.518224 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5d3c3877-f08f-4585-a033-4edfdeda8396 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:06.518920 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5d3c3877-f08f-4585-a033-4edfdeda8396 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:06.702686 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5d3c3877-f08f-4585-a033-4edfdeda8396 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:06.724179 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5d3c3877-f08f-4585-a033-4edfdeda8396 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1723 microversion: 2.1 time: 0.220872 Jun 10 18:30:06.724988 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3083/6214] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:06 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:30:06.748540 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f703d411-fc23-4b94-a420-54a00dbeb711 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3386e31a2d46fd9687cfcbb293f847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32fa0ade594d2ab39b527998aa0240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:06.749048 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-ba8191f1-705f-489c-b96c-f34c1fdf651a req-90e90f62-e8f2-468a-a4a3-7c2276abf24c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f44873d-6e6d-4f55-ace2-4cfa0f2630d9", "name": "network-vif-plugged", "status": "completed", "tag": "6ada8c68-f20d-4937-9d47-4aff6bcfe56e"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:30:06.757836 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-ba8191f1-705f-489c-b96c-f34c1fdf651a req-90e90f62-e8f2-468a-a4a3-7c2276abf24c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:06.758361 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-ba8191f1-705f-489c-b96c-f34c1fdf651a req-90e90f62-e8f2-468a-a4a3-7c2276abf24c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:06.768132 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f703d411-fc23-4b94-a420-54a00dbeb711 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] 10.222.0.35 "GET /compute/v2.1/servers/69d898d2-b350-4794-9718-abd5d6a2ab8a" status: 200 len: 1314 microversion: 2.1 time: 0.270124 Jun 10 18:30:06.768645 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3132/6215] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:06 2022] GET /compute/v2.1/servers/69d898d2-b350-4794-9718-abd5d6a2ab8a => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:30:06.771407 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-ba8191f1-705f-489c-b96c-f34c1fdf651a req-90e90f62-e8f2-468a-a4a3-7c2276abf24c service nova] Creating event network-vif-plugged:6ada8c68-f20d-4937-9d47-4aff6bcfe56e for instance 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 on chh1-master-2 Jun 10 18:30:06.777547 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-ba8191f1-705f-489c-b96c-f34c1fdf651a req-90e90f62-e8f2-468a-a4a3-7c2276abf24c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033333 Jun 10 18:30:06.783629 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3084/6216] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:30:07.229447 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-65d6b169-ab05-4b86-b70e-757f927e9d4c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:07.230150 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-65d6b169-ab05-4b86-b70e-757f927e9d4c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:07.237302 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-65d6b169-ab05-4b86-b70e-757f927e9d4c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:07.237854 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-65d6b169-ab05-4b86-b70e-757f927e9d4c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:07.238734 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-65d6b169-ab05-4b86-b70e-757f927e9d4c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:07.239611 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-65d6b169-ab05-4b86-b70e-757f927e9d4c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:07.421905 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-65d6b169-ab05-4b86-b70e-757f927e9d4c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:07.431284 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-65d6b169-ab05-4b86-b70e-757f927e9d4c tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9" status: 200 len: 1367 microversion: 2.1 time: 0.205826 Jun 10 18:30:07.432204 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3133/6217] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:07 2022] GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:30:07.757113 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a0c1d1e4-16f2-4745-aa6d-531707a350a0 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:07.759149 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a0c1d1e4-16f2-4745-aa6d-531707a350a0 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:07.769755 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a0c1d1e4-16f2-4745-aa6d-531707a350a0 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:07.770295 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a0c1d1e4-16f2-4745-aa6d-531707a350a0 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:07.771372 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a0c1d1e4-16f2-4745-aa6d-531707a350a0 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:07.771889 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a0c1d1e4-16f2-4745-aa6d-531707a350a0 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:07.788601 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1a5e4688-2c87-4d11-8aa2-e3290e0b52ab tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:07.789981 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1a5e4688-2c87-4d11-8aa2-e3290e0b52ab tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] [instance: 69d898d2-b350-4794-9718-abd5d6a2ab8a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:07.814166 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1a5e4688-2c87-4d11-8aa2-e3290e0b52ab tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:07.818996 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1a5e4688-2c87-4d11-8aa2-e3290e0b52ab tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:07.820438 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1a5e4688-2c87-4d11-8aa2-e3290e0b52ab tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:07.821165 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1a5e4688-2c87-4d11-8aa2-e3290e0b52ab tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:07.972081 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a0c1d1e4-16f2-4745-aa6d-531707a350a0 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:07.993036 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a0c1d1e4-16f2-4745-aa6d-531707a350a0 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1723 microversion: 2.1 time: 0.253519 Jun 10 18:30:07.994062 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3085/6218] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:07 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:30:08.068059 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1a5e4688-2c87-4d11-8aa2-e3290e0b52ab tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3386e31a2d46fd9687cfcbb293f847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32fa0ade594d2ab39b527998aa0240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:08.075630 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1a5e4688-2c87-4d11-8aa2-e3290e0b52ab tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] 10.222.0.35 "GET /compute/v2.1/servers/69d898d2-b350-4794-9718-abd5d6a2ab8a" status: 200 len: 1463 microversion: 2.1 time: 0.292787 Jun 10 18:30:08.076202 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3134/6219] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:07 2022] GET /compute/v2.1/servers/69d898d2-b350-4794-9718-abd5d6a2ab8a => generated 1463 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:30:08.128239 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-75534d9d-829d-47c3-a749-72d9aa54c5b2 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:08.128759 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-75534d9d-829d-47c3-a749-72d9aa54c5b2 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] [instance: 69d898d2-b350-4794-9718-abd5d6a2ab8a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:08.135193 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-75534d9d-829d-47c3-a749-72d9aa54c5b2 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:08.135889 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-75534d9d-829d-47c3-a749-72d9aa54c5b2 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:08.137484 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-75534d9d-829d-47c3-a749-72d9aa54c5b2 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:08.138233 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-75534d9d-829d-47c3-a749-72d9aa54c5b2 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:08.190005 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-75534d9d-829d-47c3-a749-72d9aa54c5b2 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] [instance: 69d898d2-b350-4794-9718-abd5d6a2ab8a] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:30:08.319647 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:30:08.454258 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-dc1f3ce2-1723-477a-bcc2-9774a0b8ab6f tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:08.454889 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-dc1f3ce2-1723-477a-bcc2-9774a0b8ab6f tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:08.461856 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dc1f3ce2-1723-477a-bcc2-9774a0b8ab6f tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:08.462319 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dc1f3ce2-1723-477a-bcc2-9774a0b8ab6f tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:08.463399 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dc1f3ce2-1723-477a-bcc2-9774a0b8ab6f tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:08.463848 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dc1f3ce2-1723-477a-bcc2-9774a0b8ab6f tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:08.483971 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-75534d9d-829d-47c3-a749-72d9aa54c5b2 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] 10.222.0.35 "DELETE /compute/v2.1/servers/69d898d2-b350-4794-9718-abd5d6a2ab8a" status: 204 len: 0 microversion: 2.1 time: 0.359252 Jun 10 18:30:08.490273 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3086/6220] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:30:08 2022] DELETE /compute/v2.1/servers/69d898d2-b350-4794-9718-abd5d6a2ab8a => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:30:08.500503 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3b123b7e-417c-4e57-ae03-715bda72fa23 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:08.502437 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3b123b7e-417c-4e57-ae03-715bda72fa23 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] [instance: 69d898d2-b350-4794-9718-abd5d6a2ab8a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:08.519057 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3b123b7e-417c-4e57-ae03-715bda72fa23 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:08.520983 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3b123b7e-417c-4e57-ae03-715bda72fa23 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:08.524151 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3b123b7e-417c-4e57-ae03-715bda72fa23 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:08.524918 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3b123b7e-417c-4e57-ae03-715bda72fa23 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:08.749324 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-dc1f3ce2-1723-477a-bcc2-9774a0b8ab6f tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:08.761486 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-dc1f3ce2-1723-477a-bcc2-9774a0b8ab6f tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9" status: 200 len: 1558 microversion: 2.1 time: 0.314615 Jun 10 18:30:08.763325 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3135/6221] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:08 2022] GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 => generated 1558 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:30:08.781741 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6fc8c5ee-2eb2-4e3d-8ea5-7e45f17484e4 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:08.784433 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6fc8c5ee-2eb2-4e3d-8ea5-7e45f17484e4 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:08.789132 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3b123b7e-417c-4e57-ae03-715bda72fa23 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3386e31a2d46fd9687cfcbb293f847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32fa0ade594d2ab39b527998aa0240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:08.791499 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6fc8c5ee-2eb2-4e3d-8ea5-7e45f17484e4 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:08.793946 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6fc8c5ee-2eb2-4e3d-8ea5-7e45f17484e4 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:08.795266 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6fc8c5ee-2eb2-4e3d-8ea5-7e45f17484e4 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:08.796006 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6fc8c5ee-2eb2-4e3d-8ea5-7e45f17484e4 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:08.797904 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3b123b7e-417c-4e57-ae03-715bda72fa23 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] 10.222.0.35 "GET /compute/v2.1/servers/69d898d2-b350-4794-9718-abd5d6a2ab8a" status: 200 len: 1469 microversion: 2.1 time: 0.304148 Jun 10 18:30:08.798494 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3087/6222] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:08 2022] GET /compute/v2.1/servers/69d898d2-b350-4794-9718-abd5d6a2ab8a => generated 1469 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:30:08.902476 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6fc8c5ee-2eb2-4e3d-8ea5-7e45f17484e4 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.126304 Jun 10 18:30:08.903511 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3136/6223] 10.222.0.35 () {58 vars in 1274 bytes} [Fri Jun 10 18:30:08 2022] GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9/os-interface => generated 285 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:30:09.049855 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5590664b-06ba-4bfe-965f-211604e232e9 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:09.052236 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5590664b-06ba-4bfe-965f-211604e232e9 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:09.064926 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5590664b-06ba-4bfe-965f-211604e232e9 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:09.065155 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5590664b-06ba-4bfe-965f-211604e232e9 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:09.066990 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5590664b-06ba-4bfe-965f-211604e232e9 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:09.067559 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5590664b-06ba-4bfe-965f-211604e232e9 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:09.538548 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5590664b-06ba-4bfe-965f-211604e232e9 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:09.548815 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5590664b-06ba-4bfe-965f-211604e232e9 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1723 microversion: 2.1 time: 0.532784 Jun 10 18:30:09.555895 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3088/6224] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:09 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1723 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:30:09.815443 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f898c8d8-e5bf-48cc-99a1-79df40bfd767 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:09.816423 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f898c8d8-e5bf-48cc-99a1-79df40bfd767 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] [instance: 69d898d2-b350-4794-9718-abd5d6a2ab8a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:09.826028 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f898c8d8-e5bf-48cc-99a1-79df40bfd767 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:09.826493 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f898c8d8-e5bf-48cc-99a1-79df40bfd767 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:09.829613 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f898c8d8-e5bf-48cc-99a1-79df40bfd767 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:09.835325 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f898c8d8-e5bf-48cc-99a1-79df40bfd767 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:10.063114 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f898c8d8-e5bf-48cc-99a1-79df40bfd767 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3386e31a2d46fd9687cfcbb293f847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32fa0ade594d2ab39b527998aa0240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:10.075176 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f898c8d8-e5bf-48cc-99a1-79df40bfd767 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] 10.222.0.35 "GET /compute/v2.1/servers/69d898d2-b350-4794-9718-abd5d6a2ab8a" status: 200 len: 1469 microversion: 2.1 time: 0.264492 Jun 10 18:30:10.075793 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3137/6225] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:09 2022] GET /compute/v2.1/servers/69d898d2-b350-4794-9718-abd5d6a2ab8a => generated 1469 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:30:10.575660 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1217ff92-acaf-464c-afa8-c3ee9cb25eb4 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:10.576253 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1217ff92-acaf-464c-afa8-c3ee9cb25eb4 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:10.588237 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1217ff92-acaf-464c-afa8-c3ee9cb25eb4 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:10.588729 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1217ff92-acaf-464c-afa8-c3ee9cb25eb4 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:10.589509 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1217ff92-acaf-464c-afa8-c3ee9cb25eb4 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:10.589948 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1217ff92-acaf-464c-afa8-c3ee9cb25eb4 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:10.877771 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1217ff92-acaf-464c-afa8-c3ee9cb25eb4 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:10.889207 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1217ff92-acaf-464c-afa8-c3ee9cb25eb4 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1723 microversion: 2.1 time: 0.326831 Jun 10 18:30:10.908097 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3089/6226] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:10 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1723 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:30:10.922535 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-8d40b4d7-dd45-4d12-8644-04708cdf179a req-36e073d8-f26c-4836-a42e-93e7c8b6354b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f44873d-6e6d-4f55-ace2-4cfa0f2630d9", "tag": "6ada8c68-f20d-4937-9d47-4aff6bcfe56e"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:30:10.933115 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-8d40b4d7-dd45-4d12-8644-04708cdf179a req-36e073d8-f26c-4836-a42e-93e7c8b6354b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:10.933624 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-8d40b4d7-dd45-4d12-8644-04708cdf179a req-36e073d8-f26c-4836-a42e-93e7c8b6354b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:10.946543 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-8d40b4d7-dd45-4d12-8644-04708cdf179a req-36e073d8-f26c-4836-a42e-93e7c8b6354b service nova] Creating event network-changed:6ada8c68-f20d-4937-9d47-4aff6bcfe56e for instance 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 on chh1-master-2 Jun 10 18:30:10.952386 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-8d40b4d7-dd45-4d12-8644-04708cdf179a req-36e073d8-f26c-4836-a42e-93e7c8b6354b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033674 Jun 10 18:30:10.954059 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3138/6227] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:30:11.102065 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-42dc0cfa-a90c-4ecb-be89-63ee5ff1762f tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:11.104293 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-42dc0cfa-a90c-4ecb-be89-63ee5ff1762f tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] [instance: 69d898d2-b350-4794-9718-abd5d6a2ab8a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:11.118018 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42dc0cfa-a90c-4ecb-be89-63ee5ff1762f tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:11.120042 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42dc0cfa-a90c-4ecb-be89-63ee5ff1762f tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:11.121545 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42dc0cfa-a90c-4ecb-be89-63ee5ff1762f tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:11.122350 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42dc0cfa-a90c-4ecb-be89-63ee5ff1762f tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:11.583600 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-42dc0cfa-a90c-4ecb-be89-63ee5ff1762f tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3386e31a2d46fd9687cfcbb293f847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32fa0ade594d2ab39b527998aa0240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:11.598468 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-42dc0cfa-a90c-4ecb-be89-63ee5ff1762f tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] 10.222.0.35 "GET /compute/v2.1/servers/69d898d2-b350-4794-9718-abd5d6a2ab8a" status: 200 len: 1427 microversion: 2.1 time: 0.503057 Jun 10 18:30:11.600645 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3090/6228] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:11 2022] GET /compute/v2.1/servers/69d898d2-b350-4794-9718-abd5d6a2ab8a => generated 1427 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:30:11.919462 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e3d755f4-eb7d-4e33-bb9b-8dc6691d9224 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:11.920379 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e3d755f4-eb7d-4e33-bb9b-8dc6691d9224 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:11.934090 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e3d755f4-eb7d-4e33-bb9b-8dc6691d9224 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:11.934090 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e3d755f4-eb7d-4e33-bb9b-8dc6691d9224 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:11.934090 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e3d755f4-eb7d-4e33-bb9b-8dc6691d9224 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:11.934090 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e3d755f4-eb7d-4e33-bb9b-8dc6691d9224 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:12.217925 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e3d755f4-eb7d-4e33-bb9b-8dc6691d9224 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:12.234588 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e3d755f4-eb7d-4e33-bb9b-8dc6691d9224 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1700 microversion: 2.1 time: 0.322980 Jun 10 18:30:12.236876 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3139/6229] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:11 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1700 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:30:12.258691 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-73804fa8-5b08-4037-8a65-252771202046 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:30:12.267959 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-73804fa8-5b08-4037-8a65-252771202046 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:12.268791 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-73804fa8-5b08-4037-8a65-252771202046 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:12.301431 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-73804fa8-5b08-4037-8a65-252771202046 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Going to try to start instance {{(pid=126595) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 10 18:30:12.617293 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b92ab1be-6ff7-490a-ae5a-871bd62d360b tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:12.623851 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b92ab1be-6ff7-490a-ae5a-871bd62d360b tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] [instance: 69d898d2-b350-4794-9718-abd5d6a2ab8a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:12.626072 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-73804fa8-5b08-4037-8a65-252771202046 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "POST /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d/action" status: 202 len: 0 microversion: 2.1 time: 0.369890 Jun 10 18:30:12.627976 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b92ab1be-6ff7-490a-ae5a-871bd62d360b tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:12.628411 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3091/6230] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:30:12 2022] POST /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d/action => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:30:12.636226 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b92ab1be-6ff7-490a-ae5a-871bd62d360b tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:12.637203 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b92ab1be-6ff7-490a-ae5a-871bd62d360b tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:12.638319 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b92ab1be-6ff7-490a-ae5a-871bd62d360b tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:12.640039 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9c80f181-d0bc-4e12-b822-0b63e34afcef tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:12.643759 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9c80f181-d0bc-4e12-b822-0b63e34afcef tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:12.662762 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9c80f181-d0bc-4e12-b822-0b63e34afcef tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:12.664500 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9c80f181-d0bc-4e12-b822-0b63e34afcef tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:12.667291 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9c80f181-d0bc-4e12-b822-0b63e34afcef tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:12.667934 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9c80f181-d0bc-4e12-b822-0b63e34afcef tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:12.695019 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b92ab1be-6ff7-490a-ae5a-871bd62d360b tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:12.695511 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b92ab1be-6ff7-490a-ae5a-871bd62d360b tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:12.696024 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-b92ab1be-6ff7-490a-ae5a-871bd62d360b tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lazy-loading 'fault' on Instance uuid 69d898d2-b350-4794-9718-abd5d6a2ab8a {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:30:12.880138 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b92ab1be-6ff7-490a-ae5a-871bd62d360b tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a3386e31a2d46fd9687cfcbb293f847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32fa0ade594d2ab39b527998aa0240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:12.918143 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9c80f181-d0bc-4e12-b822-0b63e34afcef tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:12.928280 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9c80f181-d0bc-4e12-b822-0b63e34afcef tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1709 microversion: 2.1 time: 0.295410 Jun 10 18:30:12.930201 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3092/6231] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:12 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1709 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:30:12.948649 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b92ab1be-6ff7-490a-ae5a-871bd62d360b tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] 10.222.0.35 "GET /compute/v2.1/servers/69d898d2-b350-4794-9718-abd5d6a2ab8a" status: 200 len: 1304 microversion: 2.1 time: 0.337213 Jun 10 18:30:12.954560 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3140/6232] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:12 2022] GET /compute/v2.1/servers/69d898d2-b350-4794-9718-abd5d6a2ab8a => generated 1304 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:30:12.974791 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-891c3ece-cd42-46ef-bf61-0aa363bdc6d4 req-082734f6-b538-4bf3-863a-c6458ba64853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69d898d2-b350-4794-9718-abd5d6a2ab8a", "name": "network-vif-deleted", "tag": "b5d15fab-b5f3-4eca-9c73-f950ecfa484b"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:30:12.986159 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-891c3ece-cd42-46ef-bf61-0aa363bdc6d4 req-082734f6-b538-4bf3-863a-c6458ba64853 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:12.986898 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-891c3ece-cd42-46ef-bf61-0aa363bdc6d4 req-082734f6-b538-4bf3-863a-c6458ba64853 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:13.001394 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-891c3ece-cd42-46ef-bf61-0aa363bdc6d4 req-082734f6-b538-4bf3-863a-c6458ba64853 service nova] Creating event network-vif-deleted:b5d15fab-b5f3-4eca-9c73-f950ecfa484b for instance 69d898d2-b350-4794-9718-abd5d6a2ab8a on chh1-master-2 Jun 10 18:30:13.007131 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-891c3ece-cd42-46ef-bf61-0aa363bdc6d4 req-082734f6-b538-4bf3-863a-c6458ba64853 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036690 Jun 10 18:30:13.008408 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3093/6233] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:30:13.946981 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-53b2238a-1bbf-44f6-b1a8-b3da88a2e1ad tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:13.947602 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-53b2238a-1bbf-44f6-b1a8-b3da88a2e1ad tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:13.951895 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:30:13.955968 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-53b2238a-1bbf-44f6-b1a8-b3da88a2e1ad tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:13.956457 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-53b2238a-1bbf-44f6-b1a8-b3da88a2e1ad tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:13.959176 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-53b2238a-1bbf-44f6-b1a8-b3da88a2e1ad tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:13.959176 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-53b2238a-1bbf-44f6-b1a8-b3da88a2e1ad tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:13.970070 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-18dc56ab-ec0b-4b40-a0d1-f54283fa5ab5 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:13.971381 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-18dc56ab-ec0b-4b40-a0d1-f54283fa5ab5 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] [instance: 69d898d2-b350-4794-9718-abd5d6a2ab8a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:13.999227 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-18dc56ab-ec0b-4b40-a0d1-f54283fa5ab5 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:14.001443 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-18dc56ab-ec0b-4b40-a0d1-f54283fa5ab5 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:14.007057 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-18dc56ab-ec0b-4b40-a0d1-f54283fa5ab5 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:14.007906 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-18dc56ab-ec0b-4b40-a0d1-f54283fa5ab5 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:14.026977 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-18dc56ab-ec0b-4b40-a0d1-f54283fa5ab5 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] HTTP exception thrown: Instance 69d898d2-b350-4794-9718-abd5d6a2ab8a could not be found. Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-18dc56ab-ec0b-4b40-a0d1-f54283fa5ab5 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Request method failure captured: Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/69d898d2-b350-4794-9718-abd5d6a2ab8a HTTP/1.1 Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio42YT23yzmb-WUB-uJzfsdZkC-Fzt4nHYCdxpwD14i3j2cw73QxLSuGqT_0e1WNN8O1VWylHmO7vnUZ8hLC9OcM4YzIZi5Vr89pAZ-9X4anjOhHQCdFfOqPJMEpTrAKl3rT0k_8rO2ws0svltvJsIE7idpUog6ttXYFd2ebY_9032pg Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: fc32fa0ade594d2ab39b527998aa0240 Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-VolumesNegativeTest-1688052002 Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/fc32fa0ade594d2ab39b527998aa0240"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/fc32fa0ade594d2ab39b527998aa0240"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/fc32fa0ade594d2ab39b527998aa0240"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_fc32fa0ade594d2ab39b527998aa0240", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-VolumesNegativeTest-1688052002 Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: fc32fa0ade594d2ab39b527998aa0240 Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-VolumesNegativeTest-1688052002 Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-VolumesNegativeTest-1688052002-project Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 3a3386e31a2d46fd9687cfcbb293f847 Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-VolumesNegativeTest-1688052002-project Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 69d898d2-b350-4794-9718-abd5d6a2ab8a could not be found. Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '69d898d2-b350-4794-9718-abd5d6a2ab8a'} Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69d898d2-b350-4794-9718-abd5d6a2ab8a could not be found. Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69d898d2-b350-4794-9718-abd5d6a2ab8a could not be found. Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:30:14.028961 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:30:14.035744 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:30:14.035744 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:30:14.035744 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:30:14.035744 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:30:14.035744 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:30:14.035744 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69d898d2-b350-4794-9718-abd5d6a2ab8a could not be found. Jun 10 18:30:14.035744 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:30:14.035744 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-18dc56ab-ec0b-4b40-a0d1-f54283fa5ab5 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] Returning 404 to user: Instance 69d898d2-b350-4794-9718-abd5d6a2ab8a could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:30:14.035744 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-18dc56ab-ec0b-4b40-a0d1-f54283fa5ab5 tempest-VolumesNegativeTest-1688052002 tempest-VolumesNegativeTest-1688052002-project] 10.222.0.35 "GET /compute/v2.1/servers/69d898d2-b350-4794-9718-abd5d6a2ab8a" status: 404 len: 111 microversion: 2.1 time: 0.065963 Jun 10 18:30:14.051646 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3094/6234] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:13 2022] GET /compute/v2.1/servers/69d898d2-b350-4794-9718-abd5d6a2ab8a => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:30:14.145723 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-53b2238a-1bbf-44f6-b1a8-b3da88a2e1ad tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:14.156826 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-53b2238a-1bbf-44f6-b1a8-b3da88a2e1ad tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1709 microversion: 2.1 time: 0.213456 Jun 10 18:30:14.158001 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3141/6235] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:13 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1709 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:30:15.183838 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d5e0dc12-ab69-47b4-ac21-55857f27e7f9 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:15.187531 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d5e0dc12-ab69-47b4-ac21-55857f27e7f9 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:15.195171 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d5e0dc12-ab69-47b4-ac21-55857f27e7f9 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:15.195855 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d5e0dc12-ab69-47b4-ac21-55857f27e7f9 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:15.196896 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d5e0dc12-ab69-47b4-ac21-55857f27e7f9 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:15.197510 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d5e0dc12-ab69-47b4-ac21-55857f27e7f9 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:15.410045 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d5e0dc12-ab69-47b4-ac21-55857f27e7f9 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:15.434388 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d5e0dc12-ab69-47b4-ac21-55857f27e7f9 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1713 microversion: 2.1 time: 0.258280 Jun 10 18:30:15.435458 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3095/6236] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:15 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1713 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:30:28.181410 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=85 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:30:28.601251 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5766e8d2-950a-415c-98f1-96ceea6ec0f6 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Action: 'create', calling method: .version_select at 0x7f77c60bf820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1024649623", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOJfvCekbOsBpnS3ZaGgtND0NZdFot5TMocUAUlE5f5xe1K934ZflRzk18KcrYY3lIjblTKDIaeikVAz8VNoPYBduG6xnPyimgqikUf42pXEm4pjrA2W0D9DcxJfJVW0w=="}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:30:28.640447 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-5766e8d2-950a-415c-98f1-96ceea6ec0f6 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Getting quotas for project 4089a2104afe4f1ab69f1b7983e4735d. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:30:28.649263 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-5766e8d2-950a-415c-98f1-96ceea6ec0f6 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Getting quotas for user 9d5fe9478d2b47e3b87cecc86d40773c and project 4089a2104afe4f1ab69f1b7983e4735d. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:30:28.766493 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5766e8d2-950a-415c-98f1-96ceea6ec0f6 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.590829 Jun 10 18:30:28.771378 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3142/6237] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 18:30:28 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:30:42.277154 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4c0c730e-257b-4ded-a236-c40b959178e8 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:42.280035 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4c0c730e-257b-4ded-a236-c40b959178e8 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:42.287569 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:30:42.288854 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=52,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:30:42.302626 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4c0c730e-257b-4ded-a236-c40b959178e8 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:42.312919 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4c0c730e-257b-4ded-a236-c40b959178e8 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:42.313876 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4c0c730e-257b-4ded-a236-c40b959178e8 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:42.314212 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4c0c730e-257b-4ded-a236-c40b959178e8 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:42.373141 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4c0c730e-257b-4ded-a236-c40b959178e8 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9/ips" status: 200 len: 150 microversion: 2.1 time: 0.097399 Jun 10 18:30:42.373141 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3096/6238] 10.222.0.35 () {58 vars in 1247 bytes} [Fri Jun 10 18:30:42 2022] GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9/ips => generated 150 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:30:44.075419 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-df1835e1-824b-4ca8-aaf2-785aeef964ad tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Action: 'create', calling method: .version_select at 0x7f77b3fb7550>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1507438089", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK72ZWImB5rY+oBcDHheRG8fJyMtjLk/5wlyXoi97i9tQmh0J40TLO3X1XfVtzPzBdN6Rp36kXFkiwOUpj/ggPcghpOHmITmtCinAFBYaoDZ2ylpsx2hsNRcrLhcinPm3Q=="}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:30:44.089091 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=4 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:30:44.146415 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-df1835e1-824b-4ca8-aaf2-785aeef964ad tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Getting quotas for project a52d669c461c4bb38e30dbd8ba0bd0a2. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:30:44.173647 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-df1835e1-824b-4ca8-aaf2-785aeef964ad tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Getting quotas for user cb110e0802174e1fb00d874f9e047b01 and project a52d669c461c4bb38e30dbd8ba0bd0a2. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:30:44.337702 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-df1835e1-824b-4ca8-aaf2-785aeef964ad tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.280285 Jun 10 18:30:44.339864 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3143/6239] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 18:30:44 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:30:45.165235 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5562f026-9a0b-44aa-abec-9d66a5851330 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1467252127", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "327d7036-be98-49ab-9830-2c1d0d70bacc"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1024649623", "security_groups": [{"name": "tempest-secgroup-smoke-551057455"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:30:46.361276 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-5562f026-9a0b-44aa-abec-9d66a5851330 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] validate_networks() for [('327d7036-be98-49ab-9830-2c1d0d70bacc', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:30:46.833899 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-295969e5-c97b-471e-869b-4d94f75bc329 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e0c9a38-0413-405a-9f1d-e1c1033fa983"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:30:46.835086 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-295969e5-c97b-471e-869b-4d94f75bc329 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:46.853185 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-295969e5-c97b-471e-869b-4d94f75bc329 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:46.860765 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-295969e5-c97b-471e-869b-4d94f75bc329 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:46.860765 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-295969e5-c97b-471e-869b-4d94f75bc329 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:46.860765 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-295969e5-c97b-471e-869b-4d94f75bc329 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:47.494310 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-5562f026-9a0b-44aa-abec-9d66a5851330 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:30:47.495353 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-5562f026-9a0b-44aa-abec-9d66a5851330 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:30:47.496065 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-5562f026-9a0b-44aa-abec-9d66a5851330 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:30:47.497822 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-5562f026-9a0b-44aa-abec-9d66a5851330 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:30:47.498538 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-5562f026-9a0b-44aa-abec-9d66a5851330 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:30:47.542568 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5562f026-9a0b-44aa-abec-9d66a5851330 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:47.556265 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5562f026-9a0b-44aa-abec-9d66a5851330 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:47.557654 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5562f026-9a0b-44aa-abec-9d66a5851330 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:47.558374 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5562f026-9a0b-44aa-abec-9d66a5851330 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:47.625281 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-5562f026-9a0b-44aa-abec-9d66a5851330 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Getting quotas for project 4089a2104afe4f1ab69f1b7983e4735d. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:30:47.636126 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-5562f026-9a0b-44aa-abec-9d66a5851330 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Getting quotas for user 9d5fe9478d2b47e3b87cecc86d40773c and project 4089a2104afe4f1ab69f1b7983e4735d. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:30:47.699837 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5562f026-9a0b-44aa-abec-9d66a5851330 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:30:47.731551 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5562f026-9a0b-44aa-abec-9d66a5851330 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:30:47.978133 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5562f026-9a0b-44aa-abec-9d66a5851330 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.818815 Jun 10 18:30:47.994006 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3097/6240] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:30:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 2825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:30:48.041539 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-43e211ca-81a9-4201-86f5-5cce5e731836 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:48.045456 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-43e211ca-81a9-4201-86f5-5cce5e731836 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:48.133556 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-295969e5-c97b-471e-869b-4d94f75bc329 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "POST /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.302408 Jun 10 18:30:48.136790 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3144/6241] 10.222.0.35 () {60 vars in 1322 bytes} [Fri Jun 10 18:30:46 2022] POST /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9/os-volume_attachments => generated 194 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:30:48.219803 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-43e211ca-81a9-4201-86f5-5cce5e731836 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:48.233258 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-43e211ca-81a9-4201-86f5-5cce5e731836 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1267 microversion: 2.1 time: 0.207524 Jun 10 18:30:48.235273 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3098/6242] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:48 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1267 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:30:49.257617 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3d5df7ba-636d-4075-8fb4-cdd3e23c1a41 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:49.260126 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3d5df7ba-636d-4075-8fb4-cdd3e23c1a41 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:49.486607 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3d5df7ba-636d-4075-8fb4-cdd3e23c1a41 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:49.497285 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3d5df7ba-636d-4075-8fb4-cdd3e23c1a41 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1267 microversion: 2.1 time: 0.248812 Jun 10 18:30:49.507509 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3145/6243] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:49 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1267 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:30:50.515814 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bfd5d3bf-177e-4d03-b4c4-00d338564e80 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:50.517128 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bfd5d3bf-177e-4d03-b4c4-00d338564e80 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:50.532199 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bfd5d3bf-177e-4d03-b4c4-00d338564e80 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:50.533038 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bfd5d3bf-177e-4d03-b4c4-00d338564e80 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:50.537018 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bfd5d3bf-177e-4d03-b4c4-00d338564e80 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:50.537018 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bfd5d3bf-177e-4d03-b4c4-00d338564e80 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:50.748479 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bfd5d3bf-177e-4d03-b4c4-00d338564e80 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:50.761648 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bfd5d3bf-177e-4d03-b4c4-00d338564e80 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1263 microversion: 2.1 time: 0.250289 Jun 10 18:30:50.763685 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3099/6244] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:50 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1263 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:30:51.095663 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-12e4b186-1ea1-461a-80c5-5e87050e4cc6 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-666647905", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "de83ea90-dd2c-4496-adbd-3d21962520a6"}], "key_name": "tempest-TestNetworkBasicOps-1507438089", "security_groups": [{"name": "tempest-secgroup-smoke-1247162727"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:30:51.292141 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-12e4b186-1ea1-461a-80c5-5e87050e4cc6 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] validate_networks() for [('de83ea90-dd2c-4496-adbd-3d21962520a6', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:30:51.790963 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6aca8257-0cdc-4ca3-b7ba-abe3a8ef3d5d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:51.791494 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6aca8257-0cdc-4ca3-b7ba-abe3a8ef3d5d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:51.798469 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6aca8257-0cdc-4ca3-b7ba-abe3a8ef3d5d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:51.798926 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6aca8257-0cdc-4ca3-b7ba-abe3a8ef3d5d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:51.802415 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6aca8257-0cdc-4ca3-b7ba-abe3a8ef3d5d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:51.804894 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6aca8257-0cdc-4ca3-b7ba-abe3a8ef3d5d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:51.954869 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6aca8257-0cdc-4ca3-b7ba-abe3a8ef3d5d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:51.966511 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6aca8257-0cdc-4ca3-b7ba-abe3a8ef3d5d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1327 microversion: 2.1 time: 0.188080 Jun 10 18:30:51.968058 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3100/6245] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:51 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1327 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:30:52.063561 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-12e4b186-1ea1-461a-80c5-5e87050e4cc6 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:30:52.064182 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-12e4b186-1ea1-461a-80c5-5e87050e4cc6 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:30:52.064911 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-12e4b186-1ea1-461a-80c5-5e87050e4cc6 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:30:52.065485 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-12e4b186-1ea1-461a-80c5-5e87050e4cc6 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:30:52.066061 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-12e4b186-1ea1-461a-80c5-5e87050e4cc6 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:30:52.086884 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-12e4b186-1ea1-461a-80c5-5e87050e4cc6 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:52.089340 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-12e4b186-1ea1-461a-80c5-5e87050e4cc6 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:52.090306 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-12e4b186-1ea1-461a-80c5-5e87050e4cc6 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:52.093796 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-12e4b186-1ea1-461a-80c5-5e87050e4cc6 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:52.177426 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-12e4b186-1ea1-461a-80c5-5e87050e4cc6 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Getting quotas for project a52d669c461c4bb38e30dbd8ba0bd0a2. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:30:52.186254 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-12e4b186-1ea1-461a-80c5-5e87050e4cc6 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Getting quotas for user cb110e0802174e1fb00d874f9e047b01 and project a52d669c461c4bb38e30dbd8ba0bd0a2. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:30:52.202361 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-12e4b186-1ea1-461a-80c5-5e87050e4cc6 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:30:52.205634 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-12e4b186-1ea1-461a-80c5-5e87050e4cc6 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: da9bceb9-4c3f-48ce-ae73-edc39b206e30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:30:52.715392 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-12e4b186-1ea1-461a-80c5-5e87050e4cc6 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.632066 Jun 10 18:30:52.722585 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3146/6246] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:30:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 1643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:30:52.739174 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-941066d7-4cbe-46b6-b68f-7c549e65cb28 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:52.740088 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-941066d7-4cbe-46b6-b68f-7c549e65cb28 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: da9bceb9-4c3f-48ce-ae73-edc39b206e30] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:52.994084 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6eb1855d-7945-4e2e-baf3-0fffd565803d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:53.007035 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6eb1855d-7945-4e2e-baf3-0fffd565803d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:53.014195 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6eb1855d-7945-4e2e-baf3-0fffd565803d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:53.014663 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6eb1855d-7945-4e2e-baf3-0fffd565803d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:53.015603 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6eb1855d-7945-4e2e-baf3-0fffd565803d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:53.016258 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6eb1855d-7945-4e2e-baf3-0fffd565803d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:53.119235 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6eb1855d-7945-4e2e-baf3-0fffd565803d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:53.128624 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6eb1855d-7945-4e2e-baf3-0fffd565803d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1325 microversion: 2.1 time: 0.149001 Jun 10 18:30:53.130593 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3147/6247] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:52 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1325 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:30:53.215445 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-941066d7-4cbe-46b6-b68f-7c549e65cb28 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:53.223033 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-941066d7-4cbe-46b6-b68f-7c549e65cb28 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30" status: 200 len: 1248 microversion: 2.1 time: 0.494507 Jun 10 18:30:53.223617 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3101/6248] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:52 2022] GET /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30 => generated 1248 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:30:54.149613 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-77ad57c7-c3f5-4fc3-a1d9-b2e5e9c51a3c tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:54.150245 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-77ad57c7-c3f5-4fc3-a1d9-b2e5e9c51a3c tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:54.164208 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-77ad57c7-c3f5-4fc3-a1d9-b2e5e9c51a3c tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:54.166764 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-77ad57c7-c3f5-4fc3-a1d9-b2e5e9c51a3c tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:54.167485 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-77ad57c7-c3f5-4fc3-a1d9-b2e5e9c51a3c tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:54.168483 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-77ad57c7-c3f5-4fc3-a1d9-b2e5e9c51a3c tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:54.241621 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-12edd6b5-848f-4912-be82-a238512c84a1 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:54.242347 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-12edd6b5-848f-4912-be82-a238512c84a1 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: da9bceb9-4c3f-48ce-ae73-edc39b206e30] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:54.464212 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-77ad57c7-c3f5-4fc3-a1d9-b2e5e9c51a3c tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:54.475726 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-77ad57c7-c3f5-4fc3-a1d9-b2e5e9c51a3c tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1392 microversion: 2.1 time: 0.328356 Jun 10 18:30:54.475726 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3148/6249] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:54 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1392 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:30:54.498336 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-12edd6b5-848f-4912-be82-a238512c84a1 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:54.507954 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-12edd6b5-848f-4912-be82-a238512c84a1 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30" status: 200 len: 1248 microversion: 2.1 time: 0.271670 Jun 10 18:30:54.508574 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3102/6250] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:54 2022] GET /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30 => generated 1248 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:30:55.462244 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-5ea3f0b9-d4c6-4931-9840-d20fb36c934e req-6c1c55ee-2b16-4dd6-8611-fbb42b56a9a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c36e064f-7f56-4f6b-81bf-45b449eda791", "tag": "e152d0f1-e50b-4888-9524-a46fb6cc5899"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:30:55.492560 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4208e98e-fe77-4ee8-8073-6a2182c8a28e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:55.493192 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4208e98e-fe77-4ee8-8073-6a2182c8a28e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:55.497968 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-5ea3f0b9-d4c6-4931-9840-d20fb36c934e req-6c1c55ee-2b16-4dd6-8611-fbb42b56a9a1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:55.498422 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-5ea3f0b9-d4c6-4931-9840-d20fb36c934e req-6c1c55ee-2b16-4dd6-8611-fbb42b56a9a1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:55.511827 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-5ea3f0b9-d4c6-4931-9840-d20fb36c934e req-6c1c55ee-2b16-4dd6-8611-fbb42b56a9a1 service nova] Creating event network-changed:e152d0f1-e50b-4888-9524-a46fb6cc5899 for instance c36e064f-7f56-4f6b-81bf-45b449eda791 on chh1-master-2 Jun 10 18:30:55.515245 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4208e98e-fe77-4ee8-8073-6a2182c8a28e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:55.520703 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-5ea3f0b9-d4c6-4931-9840-d20fb36c934e req-6c1c55ee-2b16-4dd6-8611-fbb42b56a9a1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060631 Jun 10 18:30:55.520866 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4208e98e-fe77-4ee8-8073-6a2182c8a28e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:55.520982 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3149/6251] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:30:55.521226 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4208e98e-fe77-4ee8-8073-6a2182c8a28e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:55.521726 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4208e98e-fe77-4ee8-8073-6a2182c8a28e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:55.534492 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8e91027e-0eb8-4c51-9452-498222372d23 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:55.534754 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8e91027e-0eb8-4c51-9452-498222372d23 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: da9bceb9-4c3f-48ce-ae73-edc39b206e30] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:55.566744 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8e91027e-0eb8-4c51-9452-498222372d23 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:55.568843 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8e91027e-0eb8-4c51-9452-498222372d23 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:55.569719 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8e91027e-0eb8-4c51-9452-498222372d23 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:55.585656 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8e91027e-0eb8-4c51-9452-498222372d23 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:55.827738 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8e91027e-0eb8-4c51-9452-498222372d23 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:55.841512 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8e91027e-0eb8-4c51-9452-498222372d23 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30" status: 200 len: 1244 microversion: 2.1 time: 0.310501 Jun 10 18:30:55.845626 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3150/6252] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:55 2022] GET /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30 => generated 1244 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:30:56.094026 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4208e98e-fe77-4ee8-8073-6a2182c8a28e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:56.123692 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4208e98e-fe77-4ee8-8073-6a2182c8a28e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1392 microversion: 2.1 time: 0.635391 Jun 10 18:30:56.124769 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3103/6253] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:55 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1392 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:30:56.864827 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-67608260-0f50-4513-91fd-bdaaf2e7c32e tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:56.865557 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-67608260-0f50-4513-91fd-bdaaf2e7c32e tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: da9bceb9-4c3f-48ce-ae73-edc39b206e30] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:56.895507 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-67608260-0f50-4513-91fd-bdaaf2e7c32e tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:56.895699 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-67608260-0f50-4513-91fd-bdaaf2e7c32e tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:56.896782 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-67608260-0f50-4513-91fd-bdaaf2e7c32e tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:56.900728 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-67608260-0f50-4513-91fd-bdaaf2e7c32e tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:57.019839 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-67608260-0f50-4513-91fd-bdaaf2e7c32e tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:57.036166 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-67608260-0f50-4513-91fd-bdaaf2e7c32e tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30" status: 200 len: 1308 microversion: 2.1 time: 0.174822 Jun 10 18:30:57.048374 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3151/6254] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:56 2022] GET /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30 => generated 1308 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:30:57.146304 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c39a8326-1f71-4b3f-a3cf-ffa915f65efd tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:57.149144 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c39a8326-1f71-4b3f-a3cf-ffa915f65efd tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:57.160035 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c39a8326-1f71-4b3f-a3cf-ffa915f65efd tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:57.160959 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c39a8326-1f71-4b3f-a3cf-ffa915f65efd tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:57.162295 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c39a8326-1f71-4b3f-a3cf-ffa915f65efd tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:57.163377 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c39a8326-1f71-4b3f-a3cf-ffa915f65efd tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:57.453292 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c39a8326-1f71-4b3f-a3cf-ffa915f65efd tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:57.465062 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c39a8326-1f71-4b3f-a3cf-ffa915f65efd tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1392 microversion: 2.1 time: 0.326963 Jun 10 18:30:57.467742 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3104/6255] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:57 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1392 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:30:58.058778 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-39509318-a8f2-46a1-a8bb-72c7b205e865 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:58.060684 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-39509318-a8f2-46a1-a8bb-72c7b205e865 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: da9bceb9-4c3f-48ce-ae73-edc39b206e30] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:58.104615 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-39509318-a8f2-46a1-a8bb-72c7b205e865 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:58.108814 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-39509318-a8f2-46a1-a8bb-72c7b205e865 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:58.109677 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-39509318-a8f2-46a1-a8bb-72c7b205e865 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:58.110202 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-39509318-a8f2-46a1-a8bb-72c7b205e865 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:58.484045 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-75a93f73-c194-4f5d-ae09-f8252dee175d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:58.484987 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-75a93f73-c194-4f5d-ae09-f8252dee175d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:58.487217 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:30:58.501790 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-75a93f73-c194-4f5d-ae09-f8252dee175d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:58.502398 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-75a93f73-c194-4f5d-ae09-f8252dee175d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:58.503330 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-75a93f73-c194-4f5d-ae09-f8252dee175d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:58.508533 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-75a93f73-c194-4f5d-ae09-f8252dee175d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:58.605534 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-39509318-a8f2-46a1-a8bb-72c7b205e865 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:58.618711 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-39509318-a8f2-46a1-a8bb-72c7b205e865 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30" status: 200 len: 1374 microversion: 2.1 time: 0.564640 Jun 10 18:30:58.619880 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3152/6256] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:58 2022] GET /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30 => generated 1374 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:30:58.805386 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-75a93f73-c194-4f5d-ae09-f8252dee175d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:30:58.816232 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-75a93f73-c194-4f5d-ae09-f8252dee175d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1392 microversion: 2.1 time: 0.336749 Jun 10 18:30:58.816889 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3105/6257] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:58 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1392 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:30:59.644805 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e9e37ce3-33aa-42dc-9eae-885cf981fd3f tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:59.645635 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e9e37ce3-33aa-42dc-9eae-885cf981fd3f tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: da9bceb9-4c3f-48ce-ae73-edc39b206e30] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:59.658152 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e9e37ce3-33aa-42dc-9eae-885cf981fd3f tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:59.659324 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e9e37ce3-33aa-42dc-9eae-885cf981fd3f tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:59.660569 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e9e37ce3-33aa-42dc-9eae-885cf981fd3f tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:59.662337 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e9e37ce3-33aa-42dc-9eae-885cf981fd3f tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:59.834009 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3e2d0a08-9f2b-45a1-9ab4-b34e5aacca3e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:30:59.834628 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3e2d0a08-9f2b-45a1-9ab4-b34e5aacca3e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:30:59.843513 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3e2d0a08-9f2b-45a1-9ab4-b34e5aacca3e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:59.844208 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3e2d0a08-9f2b-45a1-9ab4-b34e5aacca3e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:30:59.846068 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3e2d0a08-9f2b-45a1-9ab4-b34e5aacca3e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:30:59.846680 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3e2d0a08-9f2b-45a1-9ab4-b34e5aacca3e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:00.056915 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e9e37ce3-33aa-42dc-9eae-885cf981fd3f tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:00.066382 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e9e37ce3-33aa-42dc-9eae-885cf981fd3f tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30" status: 200 len: 1374 microversion: 2.1 time: 0.427653 Jun 10 18:31:00.070558 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3153/6258] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:59 2022] GET /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30 => generated 1374 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:00.150586 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-d439f4cc-3b09-48be-bc28-a4a968a0e52e req-d703f25c-6d26-410b-b14c-07216c446cae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da9bceb9-4c3f-48ce-ae73-edc39b206e30", "tag": "a132d174-b8c7-4288-bc57-365f90e9e289"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:31:00.162017 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-d439f4cc-3b09-48be-bc28-a4a968a0e52e req-d703f25c-6d26-410b-b14c-07216c446cae service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:00.163197 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-d439f4cc-3b09-48be-bc28-a4a968a0e52e req-d703f25c-6d26-410b-b14c-07216c446cae service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:00.180292 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-d439f4cc-3b09-48be-bc28-a4a968a0e52e req-d703f25c-6d26-410b-b14c-07216c446cae service nova] Creating event network-changed:a132d174-b8c7-4288-bc57-365f90e9e289 for instance da9bceb9-4c3f-48ce-ae73-edc39b206e30 on chh2-master-2 Jun 10 18:31:00.188113 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-d439f4cc-3b09-48be-bc28-a4a968a0e52e req-d703f25c-6d26-410b-b14c-07216c446cae service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042453 Jun 10 18:31:00.191051 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3154/6259] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:31:00.354774 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3e2d0a08-9f2b-45a1-9ab4-b34e5aacca3e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:00.365544 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3e2d0a08-9f2b-45a1-9ab4-b34e5aacca3e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1392 microversion: 2.1 time: 0.535357 Jun 10 18:31:00.377666 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3106/6260] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:30:59 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1392 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:01.086766 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c2b97a42-8fde-4f73-b9ba-14025b0a9215 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:01.087491 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c2b97a42-8fde-4f73-b9ba-14025b0a9215 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: da9bceb9-4c3f-48ce-ae73-edc39b206e30] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:01.096478 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c2b97a42-8fde-4f73-b9ba-14025b0a9215 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:01.096944 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c2b97a42-8fde-4f73-b9ba-14025b0a9215 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:01.097740 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c2b97a42-8fde-4f73-b9ba-14025b0a9215 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:01.098187 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c2b97a42-8fde-4f73-b9ba-14025b0a9215 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:01.381824 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-500d685d-7fab-4feb-b2ce-5118ee27890a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:01.382441 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-500d685d-7fab-4feb-b2ce-5118ee27890a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:01.393832 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-500d685d-7fab-4feb-b2ce-5118ee27890a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:01.394924 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-500d685d-7fab-4feb-b2ce-5118ee27890a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:01.396073 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-500d685d-7fab-4feb-b2ce-5118ee27890a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:01.396720 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-500d685d-7fab-4feb-b2ce-5118ee27890a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:01.491763 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c2b97a42-8fde-4f73-b9ba-14025b0a9215 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:01.508607 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c2b97a42-8fde-4f73-b9ba-14025b0a9215 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30" status: 200 len: 1374 microversion: 2.1 time: 0.425808 Jun 10 18:31:01.509076 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3155/6261] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:01 2022] GET /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30 => generated 1374 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:01.614073 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-500d685d-7fab-4feb-b2ce-5118ee27890a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:01.614073 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-500d685d-7fab-4feb-b2ce-5118ee27890a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1392 microversion: 2.1 time: 0.225372 Jun 10 18:31:01.614073 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3107/6262] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:01 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1392 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:02.530110 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f60f06ee-1ad9-4244-bcce-54d596253346 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:02.537319 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f60f06ee-1ad9-4244-bcce-54d596253346 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: da9bceb9-4c3f-48ce-ae73-edc39b206e30] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:02.552823 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:31:02.552823 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=12 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:31:02.557618 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f60f06ee-1ad9-4244-bcce-54d596253346 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:02.560721 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f60f06ee-1ad9-4244-bcce-54d596253346 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:02.561584 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f60f06ee-1ad9-4244-bcce-54d596253346 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:02.562035 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f60f06ee-1ad9-4244-bcce-54d596253346 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:02.620902 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1d023017-bec1-427b-b125-abaa76f9a271 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:02.641416 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1d023017-bec1-427b-b125-abaa76f9a271 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:02.662840 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d023017-bec1-427b-b125-abaa76f9a271 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:02.663346 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d023017-bec1-427b-b125-abaa76f9a271 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:02.664157 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d023017-bec1-427b-b125-abaa76f9a271 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:02.679545 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d023017-bec1-427b-b125-abaa76f9a271 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:02.805043 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f60f06ee-1ad9-4244-bcce-54d596253346 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:02.814125 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f60f06ee-1ad9-4244-bcce-54d596253346 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30" status: 200 len: 1374 microversion: 2.1 time: 0.292209 Jun 10 18:31:02.817837 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3156/6263] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:02 2022] GET /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30 => generated 1374 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:02.831385 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-1dfa3715-70bf-478e-9d91-e3a1acf19daa req-18c2aeca-f281-471a-b3e5-e45aaf61f528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c36e064f-7f56-4f6b-81bf-45b449eda791", "name": "network-vif-plugged", "status": "completed", "tag": "e152d0f1-e50b-4888-9524-a46fb6cc5899"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:31:02.865123 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-1dfa3715-70bf-478e-9d91-e3a1acf19daa req-18c2aeca-f281-471a-b3e5-e45aaf61f528 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:02.865123 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-1dfa3715-70bf-478e-9d91-e3a1acf19daa req-18c2aeca-f281-471a-b3e5-e45aaf61f528 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:02.881832 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-1dfa3715-70bf-478e-9d91-e3a1acf19daa req-18c2aeca-f281-471a-b3e5-e45aaf61f528 service nova] Creating event network-vif-plugged:e152d0f1-e50b-4888-9524-a46fb6cc5899 for instance c36e064f-7f56-4f6b-81bf-45b449eda791 on chh1-master-2 Jun 10 18:31:02.891577 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-1dfa3715-70bf-478e-9d91-e3a1acf19daa req-18c2aeca-f281-471a-b3e5-e45aaf61f528 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069951 Jun 10 18:31:02.891577 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3157/6264] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:31:03.037700 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e8e39cd2-a575-4b5b-b4fe-6f5ffc746295 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:03.041180 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e8e39cd2-a575-4b5b-b4fe-6f5ffc746295 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:03.048804 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e8e39cd2-a575-4b5b-b4fe-6f5ffc746295 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:03.050114 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e8e39cd2-a575-4b5b-b4fe-6f5ffc746295 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:03.051248 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e8e39cd2-a575-4b5b-b4fe-6f5ffc746295 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:03.051924 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e8e39cd2-a575-4b5b-b4fe-6f5ffc746295 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:03.221650 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-e8e39cd2-a575-4b5b-b4fe-6f5ffc746295 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lazy-loading 'services' on Instance uuid 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:31:03.366267 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1d023017-bec1-427b-b125-abaa76f9a271 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:03.374329 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1d023017-bec1-427b-b125-abaa76f9a271 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1392 microversion: 2.1 time: 0.757657 Jun 10 18:31:03.375212 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3108/6265] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:02 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1392 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:03.520442 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e8e39cd2-a575-4b5b-b4fe-6f5ffc746295 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "DELETE /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9/os-volume_attachments/4e0c9a38-0413-405a-9f1d-e1c1033fa983" status: 202 len: 0 microversion: 2.1 time: 0.487103 Jun 10 18:31:03.521068 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3158/6266] 10.222.0.35 () {58 vars in 1415 bytes} [Fri Jun 10 18:31:03 2022] DELETE /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9/os-volume_attachments/4e0c9a38-0413-405a-9f1d-e1c1033fa983 => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:31:03.545981 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d2c2de5b-663e-4e52-bd59-aa70d13d077e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:03.547092 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d2c2de5b-663e-4e52-bd59-aa70d13d077e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:03.580927 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d2c2de5b-663e-4e52-bd59-aa70d13d077e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:03.597913 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d2c2de5b-663e-4e52-bd59-aa70d13d077e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:03.603301 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d2c2de5b-663e-4e52-bd59-aa70d13d077e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:03.603476 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d2c2de5b-663e-4e52-bd59-aa70d13d077e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:03.676957 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d2c2de5b-663e-4e52-bd59-aa70d13d077e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.150367 Jun 10 18:31:03.677890 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3109/6267] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:31:03 2022] GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:31:03.840780 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-17cab799-d370-4996-b289-5a77021a0667 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:03.842842 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-17cab799-d370-4996-b289-5a77021a0667 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: da9bceb9-4c3f-48ce-ae73-edc39b206e30] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:03.858797 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-17cab799-d370-4996-b289-5a77021a0667 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:03.863705 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-17cab799-d370-4996-b289-5a77021a0667 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:03.865798 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-17cab799-d370-4996-b289-5a77021a0667 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:03.866276 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-17cab799-d370-4996-b289-5a77021a0667 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:04.070822 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-17cab799-d370-4996-b289-5a77021a0667 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:04.079337 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-17cab799-d370-4996-b289-5a77021a0667 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30" status: 200 len: 1374 microversion: 2.1 time: 0.245897 Jun 10 18:31:04.079936 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3159/6268] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:03 2022] GET /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30 => generated 1374 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:04.391919 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b9a9fb93-b66a-4fa4-8ae7-ac24c6e76fe8 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:04.393096 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b9a9fb93-b66a-4fa4-8ae7-ac24c6e76fe8 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:04.401089 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9a9fb93-b66a-4fa4-8ae7-ac24c6e76fe8 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:04.402043 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9a9fb93-b66a-4fa4-8ae7-ac24c6e76fe8 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:04.403871 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9a9fb93-b66a-4fa4-8ae7-ac24c6e76fe8 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:04.404575 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9a9fb93-b66a-4fa4-8ae7-ac24c6e76fe8 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:04.504884 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=12 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:31:04.689223 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ce908620-1447-473c-b5ad-878e9dd784f2 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:04.690541 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ce908620-1447-473c-b5ad-878e9dd784f2 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:04.698281 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ce908620-1447-473c-b5ad-878e9dd784f2 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:04.699048 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ce908620-1447-473c-b5ad-878e9dd784f2 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:04.700799 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ce908620-1447-473c-b5ad-878e9dd784f2 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:04.701423 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ce908620-1447-473c-b5ad-878e9dd784f2 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:04.747684 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ce908620-1447-473c-b5ad-878e9dd784f2 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063089 Jun 10 18:31:04.748966 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3160/6269] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:31:04 2022] GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:31:04.775158 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b9a9fb93-b66a-4fa4-8ae7-ac24c6e76fe8 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:04.795702 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b9a9fb93-b66a-4fa4-8ae7-ac24c6e76fe8 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1392 microversion: 2.1 time: 0.407786 Jun 10 18:31:04.796740 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3110/6270] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:04 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1392 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:05.095619 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5dab9c02-d2d3-4352-8285-02f855515cbd tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:05.096885 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5dab9c02-d2d3-4352-8285-02f855515cbd tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: da9bceb9-4c3f-48ce-ae73-edc39b206e30] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:05.104997 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5dab9c02-d2d3-4352-8285-02f855515cbd tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:05.105453 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5dab9c02-d2d3-4352-8285-02f855515cbd tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:05.106282 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5dab9c02-d2d3-4352-8285-02f855515cbd tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:05.106726 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5dab9c02-d2d3-4352-8285-02f855515cbd tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:05.310903 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5dab9c02-d2d3-4352-8285-02f855515cbd tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:05.320994 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5dab9c02-d2d3-4352-8285-02f855515cbd tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30" status: 200 len: 1374 microversion: 2.1 time: 0.229216 Jun 10 18:31:05.322114 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3161/6271] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:05 2022] GET /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30 => generated 1374 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:05.759531 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4edd4a07-f128-4031-8e36-5fecd5cec571 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:05.760875 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4edd4a07-f128-4031-8e36-5fecd5cec571 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:05.774572 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4edd4a07-f128-4031-8e36-5fecd5cec571 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:05.779068 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4edd4a07-f128-4031-8e36-5fecd5cec571 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:05.780735 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4edd4a07-f128-4031-8e36-5fecd5cec571 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:05.781430 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4edd4a07-f128-4031-8e36-5fecd5cec571 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:05.814795 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c71babec-f532-4e35-aa4b-c29fd51dc786 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:05.815428 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c71babec-f532-4e35-aa4b-c29fd51dc786 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:05.831303 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c71babec-f532-4e35-aa4b-c29fd51dc786 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:05.832023 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c71babec-f532-4e35-aa4b-c29fd51dc786 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:05.835249 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c71babec-f532-4e35-aa4b-c29fd51dc786 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:05.835895 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c71babec-f532-4e35-aa4b-c29fd51dc786 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:05.852703 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:31:05.853731 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4edd4a07-f128-4031-8e36-5fecd5cec571 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098249 Jun 10 18:31:05.854888 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3111/6272] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:31:05 2022] GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:31:06.341457 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-93aca17f-e631-42ae-b00b-cfa669ff4310 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:06.341964 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-93aca17f-e631-42ae-b00b-cfa669ff4310 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: da9bceb9-4c3f-48ce-ae73-edc39b206e30] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:06.350594 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93aca17f-e631-42ae-b00b-cfa669ff4310 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:06.351481 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93aca17f-e631-42ae-b00b-cfa669ff4310 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:06.352588 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93aca17f-e631-42ae-b00b-cfa669ff4310 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:06.353190 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93aca17f-e631-42ae-b00b-cfa669ff4310 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:06.549093 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c71babec-f532-4e35-aa4b-c29fd51dc786 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:06.558474 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c71babec-f532-4e35-aa4b-c29fd51dc786 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1564 microversion: 2.1 time: 0.747831 Jun 10 18:31:06.563923 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3162/6273] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:05 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1564 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:06.580233 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-014d4ff1-108b-486f-8d3b-6df90a741af1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:06.587631 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-014d4ff1-108b-486f-8d3b-6df90a741af1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:06.590162 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-014d4ff1-108b-486f-8d3b-6df90a741af1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:06.594740 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-014d4ff1-108b-486f-8d3b-6df90a741af1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:06.595583 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-014d4ff1-108b-486f-8d3b-6df90a741af1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:06.597710 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-014d4ff1-108b-486f-8d3b-6df90a741af1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:06.632971 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-93aca17f-e631-42ae-b00b-cfa669ff4310 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:06.641580 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-93aca17f-e631-42ae-b00b-cfa669ff4310 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30" status: 200 len: 1374 microversion: 2.1 time: 0.306635 Jun 10 18:31:06.646966 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3112/6274] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:06 2022] GET /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30 => generated 1374 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:31:06.866557 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fe829113-0f50-451e-bd25-e2e5c687f57b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:06.868196 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fe829113-0f50-451e-bd25-e2e5c687f57b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:06.875237 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fe829113-0f50-451e-bd25-e2e5c687f57b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:06.875921 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fe829113-0f50-451e-bd25-e2e5c687f57b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:06.876964 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fe829113-0f50-451e-bd25-e2e5c687f57b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:06.877577 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fe829113-0f50-451e-bd25-e2e5c687f57b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:06.911550 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fe829113-0f50-451e-bd25-e2e5c687f57b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049009 Jun 10 18:31:06.915715 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3113/6275] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:31:06 2022] GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:31:06.919676 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-014d4ff1-108b-486f-8d3b-6df90a741af1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:06.927483 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-014d4ff1-108b-486f-8d3b-6df90a741af1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1564 microversion: 2.1 time: 0.351316 Jun 10 18:31:06.928194 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3163/6276] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:06 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1564 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:31:07.669680 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ac59bd65-6e9a-45b9-a6b6-91569971c8dc tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:07.671213 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ac59bd65-6e9a-45b9-a6b6-91569971c8dc tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: da9bceb9-4c3f-48ce-ae73-edc39b206e30] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:07.678050 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ac59bd65-6e9a-45b9-a6b6-91569971c8dc tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:07.678769 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ac59bd65-6e9a-45b9-a6b6-91569971c8dc tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:07.679901 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ac59bd65-6e9a-45b9-a6b6-91569971c8dc tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:07.680470 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ac59bd65-6e9a-45b9-a6b6-91569971c8dc tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:07.874340 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-3ac75b1d-1b81-4b61-bb7d-0161d4552df3 req-93c8943b-8d00-473f-9fb1-775782fbfed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da9bceb9-4c3f-48ce-ae73-edc39b206e30", "name": "network-vif-plugged", "status": "completed", "tag": "a132d174-b8c7-4288-bc57-365f90e9e289"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:31:07.890922 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-3ac75b1d-1b81-4b61-bb7d-0161d4552df3 req-93c8943b-8d00-473f-9fb1-775782fbfed8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:07.891395 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-3ac75b1d-1b81-4b61-bb7d-0161d4552df3 req-93c8943b-8d00-473f-9fb1-775782fbfed8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:07.906361 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-3ac75b1d-1b81-4b61-bb7d-0161d4552df3 req-93c8943b-8d00-473f-9fb1-775782fbfed8 service nova] Creating event network-vif-plugged:a132d174-b8c7-4288-bc57-365f90e9e289 for instance da9bceb9-4c3f-48ce-ae73-edc39b206e30 on chh2-master-2 Jun 10 18:31:07.913966 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-3ac75b1d-1b81-4b61-bb7d-0161d4552df3 req-93c8943b-8d00-473f-9fb1-775782fbfed8 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048975 Jun 10 18:31:07.921121 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3164/6277] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:31:07.933087 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3626032c-35f5-4298-bf17-3da867f0c7cc tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:07.935230 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3626032c-35f5-4298-bf17-3da867f0c7cc tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:07.943157 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3626032c-35f5-4298-bf17-3da867f0c7cc tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:07.944617 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3626032c-35f5-4298-bf17-3da867f0c7cc tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:07.944617 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3626032c-35f5-4298-bf17-3da867f0c7cc tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:07.945213 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3626032c-35f5-4298-bf17-3da867f0c7cc tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:08.022641 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3626032c-35f5-4298-bf17-3da867f0c7cc tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093369 Jun 10 18:31:08.026664 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3165/6278] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:31:07 2022] GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:31:08.423467 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ac59bd65-6e9a-45b9-a6b6-91569971c8dc tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:08.432876 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ac59bd65-6e9a-45b9-a6b6-91569971c8dc tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30" status: 200 len: 1374 microversion: 2.1 time: 0.767198 Jun 10 18:31:08.435609 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3114/6279] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:07 2022] GET /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30 => generated 1374 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:31:09.036745 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d5e83cbb-7ff4-4dcf-b9a1-d0df977c0412 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:09.037901 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d5e83cbb-7ff4-4dcf-b9a1-d0df977c0412 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:09.046646 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d5e83cbb-7ff4-4dcf-b9a1-d0df977c0412 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:09.047103 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d5e83cbb-7ff4-4dcf-b9a1-d0df977c0412 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:09.048094 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d5e83cbb-7ff4-4dcf-b9a1-d0df977c0412 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:09.049598 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d5e83cbb-7ff4-4dcf-b9a1-d0df977c0412 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:09.083154 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d5e83cbb-7ff4-4dcf-b9a1-d0df977c0412 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050695 Jun 10 18:31:09.087404 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3166/6280] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:31:09 2022] GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:31:09.462319 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1fadbc44-76d3-4210-97d7-2bc5d56fd0f8 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:09.462319 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1fadbc44-76d3-4210-97d7-2bc5d56fd0f8 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: da9bceb9-4c3f-48ce-ae73-edc39b206e30] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:09.470045 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1fadbc44-76d3-4210-97d7-2bc5d56fd0f8 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:09.470849 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1fadbc44-76d3-4210-97d7-2bc5d56fd0f8 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:09.471741 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1fadbc44-76d3-4210-97d7-2bc5d56fd0f8 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:09.472249 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1fadbc44-76d3-4210-97d7-2bc5d56fd0f8 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:09.797187 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1fadbc44-76d3-4210-97d7-2bc5d56fd0f8 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:09.797383 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1fadbc44-76d3-4210-97d7-2bc5d56fd0f8 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30" status: 200 len: 1374 microversion: 2.1 time: 0.349873 Jun 10 18:31:09.807237 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3115/6281] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:09 2022] GET /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30 => generated 1374 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:09.908523 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e2c19b6e-82b4-4718-93ec-5d4cf305d8a2 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:09.909557 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e2c19b6e-82b4-4718-93ec-5d4cf305d8a2 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:09.925087 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e2c19b6e-82b4-4718-93ec-5d4cf305d8a2 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:09.926731 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e2c19b6e-82b4-4718-93ec-5d4cf305d8a2 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:09.926731 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e2c19b6e-82b4-4718-93ec-5d4cf305d8a2 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:09.933551 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e2c19b6e-82b4-4718-93ec-5d4cf305d8a2 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:09.935860 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-8baed9fd-5285-425e-83cc-36eecc9b5cfd req-2ffb3165-cacf-484f-bb3a-2b89fce097a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c36e064f-7f56-4f6b-81bf-45b449eda791", "tag": "e152d0f1-e50b-4888-9524-a46fb6cc5899"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:31:09.953664 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-8baed9fd-5285-425e-83cc-36eecc9b5cfd req-2ffb3165-cacf-484f-bb3a-2b89fce097a0 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:09.954214 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-8baed9fd-5285-425e-83cc-36eecc9b5cfd req-2ffb3165-cacf-484f-bb3a-2b89fce097a0 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:09.970004 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-8baed9fd-5285-425e-83cc-36eecc9b5cfd req-2ffb3165-cacf-484f-bb3a-2b89fce097a0 service nova] Creating event network-changed:e152d0f1-e50b-4888-9524-a46fb6cc5899 for instance c36e064f-7f56-4f6b-81bf-45b449eda791 on chh1-master-2 Jun 10 18:31:09.977463 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-8baed9fd-5285-425e-83cc-36eecc9b5cfd req-2ffb3165-cacf-484f-bb3a-2b89fce097a0 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046085 Jun 10 18:31:09.997665 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3116/6282] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:31:10.096736 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-46e2d6e5-7be9-4903-a575-9815701c9fa9 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:10.097768 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-46e2d6e5-7be9-4903-a575-9815701c9fa9 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:10.118479 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-46e2d6e5-7be9-4903-a575-9815701c9fa9 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:10.120642 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-46e2d6e5-7be9-4903-a575-9815701c9fa9 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:10.127974 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-46e2d6e5-7be9-4903-a575-9815701c9fa9 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:10.127974 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-46e2d6e5-7be9-4903-a575-9815701c9fa9 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:10.137582 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:31:10.305999 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-46e2d6e5-7be9-4903-a575-9815701c9fa9 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.213842 Jun 10 18:31:10.306609 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3117/6283] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:31:10 2022] GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9/os-volume_attachments => generated 197 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:31:10.578976 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e2c19b6e-82b4-4718-93ec-5d4cf305d8a2 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:10.599643 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e2c19b6e-82b4-4718-93ec-5d4cf305d8a2 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1564 microversion: 2.1 time: 0.696130 Jun 10 18:31:10.601814 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3167/6284] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:09 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1564 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:10.822293 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-01bdeab1-476d-4cd9-bc8a-447029177cda tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:10.822969 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-01bdeab1-476d-4cd9-bc8a-447029177cda tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: da9bceb9-4c3f-48ce-ae73-edc39b206e30] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:10.838574 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-01bdeab1-476d-4cd9-bc8a-447029177cda tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:10.852195 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-01bdeab1-476d-4cd9-bc8a-447029177cda tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:10.853117 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-01bdeab1-476d-4cd9-bc8a-447029177cda tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:10.853571 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-01bdeab1-476d-4cd9-bc8a-447029177cda tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:10.977614 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-abc4caa5-5b25-407f-b81b-f1b6ba49c82f tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:10.978400 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-abc4caa5-5b25-407f-b81b-f1b6ba49c82f tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:10.997061 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-abc4caa5-5b25-407f-b81b-f1b6ba49c82f tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:10.997640 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-abc4caa5-5b25-407f-b81b-f1b6ba49c82f tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:10.998589 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-abc4caa5-5b25-407f-b81b-f1b6ba49c82f tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:10.998933 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-abc4caa5-5b25-407f-b81b-f1b6ba49c82f tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:11.130793 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-01bdeab1-476d-4cd9-bc8a-447029177cda tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:11.144910 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-01bdeab1-476d-4cd9-bc8a-447029177cda tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30" status: 200 len: 1547 microversion: 2.1 time: 0.331338 Jun 10 18:31:11.144910 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3118/6285] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:10 2022] GET /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30 => generated 1547 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:11.160683 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-11c7bb73-0035-4029-9d5d-65c785626383 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:11.161435 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-11c7bb73-0035-4029-9d5d-65c785626383 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: da9bceb9-4c3f-48ce-ae73-edc39b206e30] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:11.176268 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-abc4caa5-5b25-407f-b81b-f1b6ba49c82f tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lazy-loading 'services' on Instance uuid eb7d7b12-56ec-43ab-8327-488874922d7d {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:31:11.190250 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-11c7bb73-0035-4029-9d5d-65c785626383 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:11.191465 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-11c7bb73-0035-4029-9d5d-65c785626383 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:11.192351 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-11c7bb73-0035-4029-9d5d-65c785626383 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:11.194358 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-11c7bb73-0035-4029-9d5d-65c785626383 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:11.425001 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-11c7bb73-0035-4029-9d5d-65c785626383 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:11.439776 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-11c7bb73-0035-4029-9d5d-65c785626383 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30" status: 200 len: 1547 microversion: 2.1 time: 0.280095 Jun 10 18:31:11.441265 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3119/6286] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:11 2022] GET /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30 => generated 1547 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:31:11.447637 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d97d0af4-188b-4e05-b3b7-7a46ca0bc55f tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:11.451388 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d97d0af4-188b-4e05-b3b7-7a46ca0bc55f tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:11.461389 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-abc4caa5-5b25-407f-b81b-f1b6ba49c82f tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "DELETE /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d/os-volume_attachments/07db3ca2-b4e2-4fd7-b4f7-44d6180742fc" status: 202 len: 0 microversion: 2.1 time: 0.487722 Jun 10 18:31:11.462788 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3168/6287] 10.222.0.35 () {58 vars in 1415 bytes} [Fri Jun 10 18:31:10 2022] DELETE /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d/os-volume_attachments/07db3ca2-b4e2-4fd7-b4f7-44d6180742fc => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 18:31:11.500124 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d97d0af4-188b-4e05-b3b7-7a46ca0bc55f tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:11.506114 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d97d0af4-188b-4e05-b3b7-7a46ca0bc55f tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:11.508822 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d97d0af4-188b-4e05-b3b7-7a46ca0bc55f tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:11.512461 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d97d0af4-188b-4e05-b3b7-7a46ca0bc55f tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:11.619401 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d97d0af4-188b-4e05-b3b7-7a46ca0bc55f tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.176686 Jun 10 18:31:11.620295 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3120/6288] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:31:11 2022] GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9/os-volume_attachments => generated 25 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:31:11.698769 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5a1d82a4-45e8-4268-a997-ea581a29bdee tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:11.699519 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5a1d82a4-45e8-4268-a997-ea581a29bdee tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:11.716623 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5a1d82a4-45e8-4268-a997-ea581a29bdee tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:11.720944 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5a1d82a4-45e8-4268-a997-ea581a29bdee tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:11.720944 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5a1d82a4-45e8-4268-a997-ea581a29bdee tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:11.720944 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5a1d82a4-45e8-4268-a997-ea581a29bdee tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:11.770605 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5a1d82a4-45e8-4268-a997-ea581a29bdee tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:31:12.082796 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:31:12.179457 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5a1d82a4-45e8-4268-a997-ea581a29bdee tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "DELETE /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9" status: 204 len: 0 microversion: 2.1 time: 0.489871 Jun 10 18:31:12.180065 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3169/6289] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:31:11 2022] DELETE /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:31:12.189928 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f0fe758d-24fd-4c1d-bec7-bc50aafd9d29 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:12.191291 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f0fe758d-24fd-4c1d-bec7-bc50aafd9d29 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:12.201511 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f0fe758d-24fd-4c1d-bec7-bc50aafd9d29 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:12.202352 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f0fe758d-24fd-4c1d-bec7-bc50aafd9d29 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:12.203510 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f0fe758d-24fd-4c1d-bec7-bc50aafd9d29 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:12.204259 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f0fe758d-24fd-4c1d-bec7-bc50aafd9d29 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:12.429402 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f0fe758d-24fd-4c1d-bec7-bc50aafd9d29 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:12.440883 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f0fe758d-24fd-4c1d-bec7-bc50aafd9d29 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9" status: 200 len: 1682 microversion: 2.1 time: 0.255918 Jun 10 18:31:12.441526 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3121/6290] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:12 2022] GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 => generated 1682 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:13.464631 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e61e80f3-0a91-4899-baa7-c3ede41a8acc tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:13.465942 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e61e80f3-0a91-4899-baa7-c3ede41a8acc tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:13.500743 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e61e80f3-0a91-4899-baa7-c3ede41a8acc tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:13.510508 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e61e80f3-0a91-4899-baa7-c3ede41a8acc tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:13.514654 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e61e80f3-0a91-4899-baa7-c3ede41a8acc tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:13.514654 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e61e80f3-0a91-4899-baa7-c3ede41a8acc tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:13.913013 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e61e80f3-0a91-4899-baa7-c3ede41a8acc tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:13.921879 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e61e80f3-0a91-4899-baa7-c3ede41a8acc tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9" status: 200 len: 1682 microversion: 2.1 time: 0.464438 Jun 10 18:31:13.928804 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3170/6291] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:13 2022] GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 => generated 1682 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:14.949970 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e1859e81-9f6d-4fa7-bb2f-ad1d8ca1435d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:14.951526 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e1859e81-9f6d-4fa7-bb2f-ad1d8ca1435d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:14.967399 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e1859e81-9f6d-4fa7-bb2f-ad1d8ca1435d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:14.968154 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e1859e81-9f6d-4fa7-bb2f-ad1d8ca1435d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:14.969400 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e1859e81-9f6d-4fa7-bb2f-ad1d8ca1435d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:14.970308 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e1859e81-9f6d-4fa7-bb2f-ad1d8ca1435d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:15.161479 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e1859e81-9f6d-4fa7-bb2f-ad1d8ca1435d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:15.198936 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e1859e81-9f6d-4fa7-bb2f-ad1d8ca1435d tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9" status: 200 len: 1614 microversion: 2.1 time: 0.261147 Jun 10 18:31:15.202649 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3122/6292] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:14 2022] GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 => generated 1614 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:16.220104 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-83e33821-8ac7-4818-8eba-435b159bb453 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:16.222027 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-83e33821-8ac7-4818-8eba-435b159bb453 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:16.242226 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:31:16.258410 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83e33821-8ac7-4818-8eba-435b159bb453 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:16.258872 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83e33821-8ac7-4818-8eba-435b159bb453 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:16.259665 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83e33821-8ac7-4818-8eba-435b159bb453 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:16.260109 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83e33821-8ac7-4818-8eba-435b159bb453 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:16.403246 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-7412a26a-ced5-4720-a6cb-d594303ea1aa req-2d39567c-c446-4462-8e7c-971813ce6e06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da9bceb9-4c3f-48ce-ae73-edc39b206e30", "tag": "a132d174-b8c7-4288-bc57-365f90e9e289"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:31:16.437470 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-7412a26a-ced5-4720-a6cb-d594303ea1aa req-2d39567c-c446-4462-8e7c-971813ce6e06 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:16.437933 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-7412a26a-ced5-4720-a6cb-d594303ea1aa req-2d39567c-c446-4462-8e7c-971813ce6e06 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:16.478782 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-83e33821-8ac7-4818-8eba-435b159bb453 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62326a9deb140e891c07529dc021d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886b72a54e9b4ee7aa3cc21da4145cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:16.485815 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-7412a26a-ced5-4720-a6cb-d594303ea1aa req-2d39567c-c446-4462-8e7c-971813ce6e06 service nova] Creating event network-changed:a132d174-b8c7-4288-bc57-365f90e9e289 for instance da9bceb9-4c3f-48ce-ae73-edc39b206e30 on chh2-master-2 Jun 10 18:31:16.492742 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-83e33821-8ac7-4818-8eba-435b159bb453 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9" status: 200 len: 1614 microversion: 2.1 time: 0.277896 Jun 10 18:31:16.512285 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3123/6293] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:16 2022] GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 => generated 1614 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:31:16.512646 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-7412a26a-ced5-4720-a6cb-d594303ea1aa req-2d39567c-c446-4462-8e7c-971813ce6e06 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.541175 Jun 10 18:31:16.512646 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3171/6294] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:31:16.513043 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-a2581cb7-e9e0-4841-90b0-0bf0e4dd5d25 req-354dc469-fbad-4cac-8de7-6e913f89c909 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f44873d-6e6d-4f55-ace2-4cfa0f2630d9", "name": "network-vif-deleted", "tag": "6ada8c68-f20d-4937-9d47-4aff6bcfe56e"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:31:16.519209 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-a2581cb7-e9e0-4841-90b0-0bf0e4dd5d25 req-354dc469-fbad-4cac-8de7-6e913f89c909 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:16.520127 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-a2581cb7-e9e0-4841-90b0-0bf0e4dd5d25 req-354dc469-fbad-4cac-8de7-6e913f89c909 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:16.537757 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-a2581cb7-e9e0-4841-90b0-0bf0e4dd5d25 req-354dc469-fbad-4cac-8de7-6e913f89c909 service nova] Creating event network-vif-deleted:6ada8c68-f20d-4937-9d47-4aff6bcfe56e for instance 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 on chh1-master-2 Jun 10 18:31:16.566726 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-a2581cb7-e9e0-4841-90b0-0bf0e4dd5d25 req-354dc469-fbad-4cac-8de7-6e913f89c909 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059246 Jun 10 18:31:16.568187 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3124/6295] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:31:17.513919 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-33900e36-8c8a-4f88-8929-9f7dd283a435 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:17.514699 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-33900e36-8c8a-4f88-8929-9f7dd283a435 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:17.542797 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-33900e36-8c8a-4f88-8929-9f7dd283a435 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:17.545844 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-33900e36-8c8a-4f88-8929-9f7dd283a435 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:17.549684 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-33900e36-8c8a-4f88-8929-9f7dd283a435 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:17.550979 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-33900e36-8c8a-4f88-8929-9f7dd283a435 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:17.597973 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-33900e36-8c8a-4f88-8929-9f7dd283a435 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] HTTP exception thrown: Instance 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 could not be found. Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-33900e36-8c8a-4f88-8929-9f7dd283a435 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Request method failure captured: Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 HTTP/1.1 Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4wSsTbdAR5Qo9IVKF2KTe64dpp06ye4z8lPOT4uRhY2Oz0KMxQpxmr8KJzvNSTZtUIPPEgN2R6-CfUmf8CTAhd_IkVIfk-LuHrtE7255OYmbmFD6LLNrB7dKdWnCpSm8e4XDxNvfMbtjLHwd4svP6YGpBpPTncT2KN4jK3q3Q7l5ew Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 886b72a54e9b4ee7aa3cc21da4145cbb Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-AttachVolumeNegativeTest-545911130 Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/886b72a54e9b4ee7aa3cc21da4145cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/886b72a54e9b4ee7aa3cc21da4145cbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/886b72a54e9b4ee7aa3cc21da4145cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_886b72a54e9b4ee7aa3cc21da4145cbb", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-AttachVolumeNegativeTest-545911130 Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 886b72a54e9b4ee7aa3cc21da4145cbb Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-545911130 Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-AttachVolumeNegativeTest-545911130-project Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: f62326a9deb140e891c07529dc021d11 Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-AttachVolumeNegativeTest-545911130-project Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 could not be found. Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '8f44873d-6e6d-4f55-ace2-4cfa0f2630d9'} Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 could not be found. Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 could not be found. Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:31:17.605131 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:31:17.611162 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:31:17.611162 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:31:17.611162 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:31:17.611162 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:31:17.611162 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:31:17.611162 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 could not be found. Jun 10 18:31:17.611162 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:31:17.616088 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-33900e36-8c8a-4f88-8929-9f7dd283a435 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Returning 404 to user: Instance 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:31:17.617136 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-33900e36-8c8a-4f88-8929-9f7dd283a435 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9" status: 404 len: 111 microversion: 2.1 time: 0.109145 Jun 10 18:31:17.621845 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3172/6296] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:17 2022] GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:31:17.628976 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-58f1014c-cfa0-443e-8ed7-ff9a4eaaecce tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '.version_select at 0x7f77b3f08790>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:17.759317 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-58f1014c-cfa0-443e-8ed7-ff9a4eaaecce tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-488262302" status: 202 len: 0 microversion: 2.1 time: 0.136054 Jun 10 18:31:17.760229 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3125/6297] 10.222.0.35 () {58 vars in 1217 bytes} [Fri Jun 10 18:31:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-488262302 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:31:18.722635 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4dc7be8a-30ae-46b4-b065-d17299e6d806 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-518760126", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "46741b25-67bf-4bd5-a980-a72ecc97683f"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:31:18.781265 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-4dc7be8a-30ae-46b4-b065-d17299e6d806 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] validate_networks() for [('46741b25-67bf-4bd5-a980-a72ecc97683f', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:31:19.362940 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-4dc7be8a-30ae-46b4-b065-d17299e6d806 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:31:19.363370 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-4dc7be8a-30ae-46b4-b065-d17299e6d806 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:31:19.363855 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-4dc7be8a-30ae-46b4-b065-d17299e6d806 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:31:19.364487 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-4dc7be8a-30ae-46b4-b065-d17299e6d806 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:31:19.364912 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-4dc7be8a-30ae-46b4-b065-d17299e6d806 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:31:19.376275 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4dc7be8a-30ae-46b4-b065-d17299e6d806 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:19.379215 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4dc7be8a-30ae-46b4-b065-d17299e6d806 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:19.379215 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4dc7be8a-30ae-46b4-b065-d17299e6d806 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:19.379215 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4dc7be8a-30ae-46b4-b065-d17299e6d806 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:19.419586 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-4dc7be8a-30ae-46b4-b065-d17299e6d806 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Getting quotas for project e2a8d819ba8844878f82cf60131df725. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:31:19.426752 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-4dc7be8a-30ae-46b4-b065-d17299e6d806 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Getting quotas for user 3aa5b7f650884ee59282ce97f48fc0e6 and project e2a8d819ba8844878f82cf60131df725. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:31:19.447786 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4dc7be8a-30ae-46b4-b065-d17299e6d806 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:31:19.447786 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4dc7be8a-30ae-46b4-b065-d17299e6d806 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] [instance: ecff1e1f-13e9-4a8c-96e0-4f423a31d69e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:31:19.588499 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4dc7be8a-30ae-46b4-b065-d17299e6d806 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.870556 Jun 10 18:31:19.589108 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3173/6298] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:31:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:31:19.600522 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2c17976f-6c8d-48ea-9c33-99050566901f tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:19.601415 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2c17976f-6c8d-48ea-9c33-99050566901f tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] [instance: ecff1e1f-13e9-4a8c-96e0-4f423a31d69e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:19.717896 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2c17976f-6c8d-48ea-9c33-99050566901f tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa5b7f650884ee59282ce97f48fc0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a8d819ba8844878f82cf60131df725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:19.725520 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2c17976f-6c8d-48ea-9c33-99050566901f tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] 10.222.0.35 "GET /compute/v2.1/servers/ecff1e1f-13e9-4a8c-96e0-4f423a31d69e" status: 200 len: 1218 microversion: 2.1 time: 0.129989 Jun 10 18:31:19.736210 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3126/6299] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:19 2022] GET /compute/v2.1/servers/ecff1e1f-13e9-4a8c-96e0-4f423a31d69e => generated 1218 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:20.395031 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4e1695a7-6003-4995-b088-e5bafb94e7a8 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:31:20.406155 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4e1695a7-6003-4995-b088-e5bafb94e7a8 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:20.406758 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4e1695a7-6003-4995-b088-e5bafb94e7a8 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:20.436828 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4e1695a7-6003-4995-b088-e5bafb94e7a8 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Going to try to stop instance {{(pid=126594) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 10 18:31:20.677872 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4e1695a7-6003-4995-b088-e5bafb94e7a8 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "POST /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d/action" status: 202 len: 0 microversion: 2.1 time: 0.287520 Jun 10 18:31:20.688670 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-290f2f45-7803-475d-a76b-6d711e4df4c4 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:20.689291 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-290f2f45-7803-475d-a76b-6d711e4df4c4 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:20.691508 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3174/6300] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:31:20 2022] POST /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:31:20.711171 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-290f2f45-7803-475d-a76b-6d711e4df4c4 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:20.712150 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-290f2f45-7803-475d-a76b-6d711e4df4c4 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:20.714688 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-290f2f45-7803-475d-a76b-6d711e4df4c4 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:20.718783 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-290f2f45-7803-475d-a76b-6d711e4df4c4 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:20.744700 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-49d3caf5-e30e-4cf7-afc9-9b5dccc1fd2b tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:20.746787 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-49d3caf5-e30e-4cf7-afc9-9b5dccc1fd2b tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] [instance: ecff1e1f-13e9-4a8c-96e0-4f423a31d69e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:20.855086 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-49d3caf5-e30e-4cf7-afc9-9b5dccc1fd2b tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa5b7f650884ee59282ce97f48fc0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a8d819ba8844878f82cf60131df725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:20.864564 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-49d3caf5-e30e-4cf7-afc9-9b5dccc1fd2b tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] 10.222.0.35 "GET /compute/v2.1/servers/ecff1e1f-13e9-4a8c-96e0-4f423a31d69e" status: 200 len: 1218 microversion: 2.1 time: 0.124302 Jun 10 18:31:20.866124 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3175/6301] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:20 2022] GET /compute/v2.1/servers/ecff1e1f-13e9-4a8c-96e0-4f423a31d69e => generated 1218 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:21.342243 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-290f2f45-7803-475d-a76b-6d711e4df4c4 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:21.353176 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-290f2f45-7803-475d-a76b-6d711e4df4c4 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1677 microversion: 2.1 time: 0.669991 Jun 10 18:31:21.354975 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3127/6302] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:20 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1677 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:21.897416 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-80f2fc2b-0754-4a12-85ad-2af0e7547bc1 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:21.898033 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-80f2fc2b-0754-4a12-85ad-2af0e7547bc1 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] [instance: ecff1e1f-13e9-4a8c-96e0-4f423a31d69e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:21.906751 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-80f2fc2b-0754-4a12-85ad-2af0e7547bc1 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:21.907209 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-80f2fc2b-0754-4a12-85ad-2af0e7547bc1 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:21.907992 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-80f2fc2b-0754-4a12-85ad-2af0e7547bc1 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:21.908479 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-80f2fc2b-0754-4a12-85ad-2af0e7547bc1 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:21.995340 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-80f2fc2b-0754-4a12-85ad-2af0e7547bc1 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa5b7f650884ee59282ce97f48fc0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a8d819ba8844878f82cf60131df725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:22.016865 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-80f2fc2b-0754-4a12-85ad-2af0e7547bc1 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] 10.222.0.35 "GET /compute/v2.1/servers/ecff1e1f-13e9-4a8c-96e0-4f423a31d69e" status: 200 len: 1270 microversion: 2.1 time: 0.123223 Jun 10 18:31:22.028152 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3176/6303] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:21 2022] GET /compute/v2.1/servers/ecff1e1f-13e9-4a8c-96e0-4f423a31d69e => generated 1270 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:22.371368 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d699537c-f61b-4e7b-9ed7-5773a73c5af4 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:22.371908 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d699537c-f61b-4e7b-9ed7-5773a73c5af4 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:22.381613 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d699537c-f61b-4e7b-9ed7-5773a73c5af4 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:22.382227 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d699537c-f61b-4e7b-9ed7-5773a73c5af4 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:22.383024 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d699537c-f61b-4e7b-9ed7-5773a73c5af4 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:22.383551 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d699537c-f61b-4e7b-9ed7-5773a73c5af4 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:22.636104 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d699537c-f61b-4e7b-9ed7-5773a73c5af4 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:22.656489 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d699537c-f61b-4e7b-9ed7-5773a73c5af4 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1677 microversion: 2.1 time: 0.289171 Jun 10 18:31:22.659918 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3128/6304] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:22 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1677 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:23.034972 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7383b3d4-26f0-4d09-8608-2efeaf0c6e5f tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:23.035604 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7383b3d4-26f0-4d09-8608-2efeaf0c6e5f tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] [instance: ecff1e1f-13e9-4a8c-96e0-4f423a31d69e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:23.047482 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7383b3d4-26f0-4d09-8608-2efeaf0c6e5f tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:23.047977 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7383b3d4-26f0-4d09-8608-2efeaf0c6e5f tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:23.048800 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7383b3d4-26f0-4d09-8608-2efeaf0c6e5f tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:23.049249 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7383b3d4-26f0-4d09-8608-2efeaf0c6e5f tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:23.313287 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7383b3d4-26f0-4d09-8608-2efeaf0c6e5f tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa5b7f650884ee59282ce97f48fc0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a8d819ba8844878f82cf60131df725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:23.340904 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7383b3d4-26f0-4d09-8608-2efeaf0c6e5f tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] 10.222.0.35 "GET /compute/v2.1/servers/ecff1e1f-13e9-4a8c-96e0-4f423a31d69e" status: 200 len: 1318 microversion: 2.1 time: 0.298077 Jun 10 18:31:23.343652 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3177/6305] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:23 2022] GET /compute/v2.1/servers/ecff1e1f-13e9-4a8c-96e0-4f423a31d69e => generated 1318 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:23.681558 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-05a3b15c-4787-4e52-a9b9-8b36985bcba8 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:23.681558 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-05a3b15c-4787-4e52-a9b9-8b36985bcba8 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:23.688627 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05a3b15c-4787-4e52-a9b9-8b36985bcba8 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:23.689450 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05a3b15c-4787-4e52-a9b9-8b36985bcba8 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:23.690478 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05a3b15c-4787-4e52-a9b9-8b36985bcba8 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:23.691177 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05a3b15c-4787-4e52-a9b9-8b36985bcba8 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:23.903591 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-685e22be-c448-49da-9905-4eb3d0fbd7f0 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:23.904298 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-685e22be-c448-49da-9905-4eb3d0fbd7f0 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:23.914338 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-685e22be-c448-49da-9905-4eb3d0fbd7f0 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:23.914994 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-685e22be-c448-49da-9905-4eb3d0fbd7f0 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:23.915944 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-685e22be-c448-49da-9905-4eb3d0fbd7f0 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:23.916576 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-685e22be-c448-49da-9905-4eb3d0fbd7f0 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:23.934385 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-685e22be-c448-49da-9905-4eb3d0fbd7f0 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] HTTP exception thrown: Instance 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 could not be found. Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-685e22be-c448-49da-9905-4eb3d0fbd7f0 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Request method failure captured: Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: request: DELETE /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 HTTP/1.1 Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4wSsTbdAR5Qo9IVKF2KTe64dpp06ye4z8lPOT4uRhY2Oz0KMxQpxmr8KJzvNSTZtUIPPEgN2R6-CfUmf8CTAhd_IkVIfk-LuHrtE7255OYmbmFD6LLNrB7dKdWnCpSm8e4XDxNvfMbtjLHwd4svP6YGpBpPTncT2KN4jK3q3Q7l5ew Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 886b72a54e9b4ee7aa3cc21da4145cbb Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-AttachVolumeNegativeTest-545911130 Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/886b72a54e9b4ee7aa3cc21da4145cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/886b72a54e9b4ee7aa3cc21da4145cbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/886b72a54e9b4ee7aa3cc21da4145cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_886b72a54e9b4ee7aa3cc21da4145cbb", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-AttachVolumeNegativeTest-545911130 Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 886b72a54e9b4ee7aa3cc21da4145cbb Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-545911130 Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-AttachVolumeNegativeTest-545911130-project Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: f62326a9deb140e891c07529dc021d11 Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-AttachVolumeNegativeTest-545911130-project Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 could not be found. Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '8f44873d-6e6d-4f55-ace2-4cfa0f2630d9'} Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 could not be found. Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:31:23.938827 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:31:23.944077 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 could not be found. Jun 10 18:31:23.944077 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:31:23.944077 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:31:23.944077 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:31:23.944077 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:31:23.944077 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:31:23.944077 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:31:23.944077 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:31:23.944077 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:31:23.944077 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 could not be found. Jun 10 18:31:23.944077 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:31:23.952096 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-05a3b15c-4787-4e52-a9b9-8b36985bcba8 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:23.961951 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-05a3b15c-4787-4e52-a9b9-8b36985bcba8 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1677 microversion: 2.1 time: 0.289047 Jun 10 18:31:23.962268 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-685e22be-c448-49da-9905-4eb3d0fbd7f0 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Returning 404 to user: Instance 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:31:23.965769 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-685e22be-c448-49da-9905-4eb3d0fbd7f0 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "DELETE /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9" status: 404 len: 111 microversion: 2.1 time: 0.065501 Jun 10 18:31:23.971406 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3129/6307] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:23 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1677 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:23.971616 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3178/6307] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:31:23 2022] DELETE /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:31:23.983077 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c6064671-fe82-4ab5-a07f-9d25a992577b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:23.985184 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c6064671-fe82-4ab5-a07f-9d25a992577b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:23.998308 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c6064671-fe82-4ab5-a07f-9d25a992577b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:23.998921 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c6064671-fe82-4ab5-a07f-9d25a992577b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:23.999960 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c6064671-fe82-4ab5-a07f-9d25a992577b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:24.000601 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c6064671-fe82-4ab5-a07f-9d25a992577b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:24.016169 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-c6064671-fe82-4ab5-a07f-9d25a992577b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] HTTP exception thrown: Instance 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 could not be found. Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c6064671-fe82-4ab5-a07f-9d25a992577b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Request method failure captured: Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 HTTP/1.1 Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4wSsTbdAR5Qo9IVKF2KTe64dpp06ye4z8lPOT4uRhY2Oz0KMxQpxmr8KJzvNSTZtUIPPEgN2R6-CfUmf8CTAhd_IkVIfk-LuHrtE7255OYmbmFD6LLNrB7dKdWnCpSm8e4XDxNvfMbtjLHwd4svP6YGpBpPTncT2KN4jK3q3Q7l5ew Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 886b72a54e9b4ee7aa3cc21da4145cbb Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-AttachVolumeNegativeTest-545911130 Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/886b72a54e9b4ee7aa3cc21da4145cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/886b72a54e9b4ee7aa3cc21da4145cbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/886b72a54e9b4ee7aa3cc21da4145cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_886b72a54e9b4ee7aa3cc21da4145cbb", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-AttachVolumeNegativeTest-545911130 Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 886b72a54e9b4ee7aa3cc21da4145cbb Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-545911130 Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-AttachVolumeNegativeTest-545911130-project Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: f62326a9deb140e891c07529dc021d11 Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-AttachVolumeNegativeTest-545911130-project Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 could not be found. Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '8f44873d-6e6d-4f55-ace2-4cfa0f2630d9'} Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 could not be found. Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 could not be found. Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:31:24.018283 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:31:24.026155 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:31:24.026155 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:31:24.026155 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:31:24.026155 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:31:24.026155 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:31:24.026155 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 could not be found. Jun 10 18:31:24.026155 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:31:24.026155 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c6064671-fe82-4ab5-a07f-9d25a992577b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Returning 404 to user: Instance 8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:31:24.026155 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c6064671-fe82-4ab5-a07f-9d25a992577b tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9" status: 404 len: 111 microversion: 2.1 time: 0.049289 Jun 10 18:31:24.026155 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3179/6308] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:23 2022] GET /compute/v2.1/servers/8f44873d-6e6d-4f55-ace2-4cfa0f2630d9 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:31:24.363287 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6334bbba-a0c9-4939-86d4-aed5037f2e9d tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:24.363905 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6334bbba-a0c9-4939-86d4-aed5037f2e9d tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] [instance: ecff1e1f-13e9-4a8c-96e0-4f423a31d69e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:24.379996 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6334bbba-a0c9-4939-86d4-aed5037f2e9d tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:24.380500 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6334bbba-a0c9-4939-86d4-aed5037f2e9d tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:24.381292 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6334bbba-a0c9-4939-86d4-aed5037f2e9d tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:24.381733 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6334bbba-a0c9-4939-86d4-aed5037f2e9d tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:24.551136 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-467276fe-628b-4357-9551-79a0cacde9e6 req-63288b3f-ae75-451a-bf57-9edc036648d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecff1e1f-13e9-4a8c-96e0-4f423a31d69e", "tag": "f17cf721-01c3-49f8-9a21-62c5127a40f4"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:31:24.575458 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-467276fe-628b-4357-9551-79a0cacde9e6 req-63288b3f-ae75-451a-bf57-9edc036648d1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:24.576563 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-467276fe-628b-4357-9551-79a0cacde9e6 req-63288b3f-ae75-451a-bf57-9edc036648d1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:24.593206 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-467276fe-628b-4357-9551-79a0cacde9e6 req-63288b3f-ae75-451a-bf57-9edc036648d1 service nova] Creating event network-changed:f17cf721-01c3-49f8-9a21-62c5127a40f4 for instance ecff1e1f-13e9-4a8c-96e0-4f423a31d69e on chh1-master-2 Jun 10 18:31:24.599523 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-467276fe-628b-4357-9551-79a0cacde9e6 req-63288b3f-ae75-451a-bf57-9edc036648d1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052855 Jun 10 18:31:24.601542 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3180/6309] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:31:24.643249 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6334bbba-a0c9-4939-86d4-aed5037f2e9d tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa5b7f650884ee59282ce97f48fc0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a8d819ba8844878f82cf60131df725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:24.660268 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6334bbba-a0c9-4939-86d4-aed5037f2e9d tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] 10.222.0.35 "GET /compute/v2.1/servers/ecff1e1f-13e9-4a8c-96e0-4f423a31d69e" status: 200 len: 1318 microversion: 2.1 time: 0.300739 Jun 10 18:31:24.660946 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3130/6310] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:24 2022] GET /compute/v2.1/servers/ecff1e1f-13e9-4a8c-96e0-4f423a31d69e => generated 1318 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:24.984706 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6cae3dd8-137f-424a-aeea-10795477a104 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:24.985438 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6cae3dd8-137f-424a-aeea-10795477a104 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:25.000603 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6cae3dd8-137f-424a-aeea-10795477a104 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:25.001075 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6cae3dd8-137f-424a-aeea-10795477a104 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:25.001891 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6cae3dd8-137f-424a-aeea-10795477a104 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:25.002337 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6cae3dd8-137f-424a-aeea-10795477a104 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:25.012893 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:31:25.304896 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6cae3dd8-137f-424a-aeea-10795477a104 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:25.313128 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6cae3dd8-137f-424a-aeea-10795477a104 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1677 microversion: 2.1 time: 0.333435 Jun 10 18:31:25.313703 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3181/6311] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:24 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1677 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:25.677372 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5a8135e0-3f51-4b99-8aaf-377eb75a92ce tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:25.678575 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5a8135e0-3f51-4b99-8aaf-377eb75a92ce tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] [instance: ecff1e1f-13e9-4a8c-96e0-4f423a31d69e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:25.689636 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5a8135e0-3f51-4b99-8aaf-377eb75a92ce tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:25.690674 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5a8135e0-3f51-4b99-8aaf-377eb75a92ce tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:25.691690 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5a8135e0-3f51-4b99-8aaf-377eb75a92ce tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:25.693760 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5a8135e0-3f51-4b99-8aaf-377eb75a92ce tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:25.857773 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5a8135e0-3f51-4b99-8aaf-377eb75a92ce tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa5b7f650884ee59282ce97f48fc0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a8d819ba8844878f82cf60131df725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:25.866954 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5a8135e0-3f51-4b99-8aaf-377eb75a92ce tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] 10.222.0.35 "GET /compute/v2.1/servers/ecff1e1f-13e9-4a8c-96e0-4f423a31d69e" status: 200 len: 1318 microversion: 2.1 time: 0.193440 Jun 10 18:31:25.876964 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3131/6312] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:25 2022] GET /compute/v2.1/servers/ecff1e1f-13e9-4a8c-96e0-4f423a31d69e => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:26.331055 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1b4b07bc-6e30-47df-a6c0-37ffa06a0c7f tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:26.331654 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1b4b07bc-6e30-47df-a6c0-37ffa06a0c7f tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:26.338879 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1b4b07bc-6e30-47df-a6c0-37ffa06a0c7f tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:26.339368 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1b4b07bc-6e30-47df-a6c0-37ffa06a0c7f tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:26.340163 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1b4b07bc-6e30-47df-a6c0-37ffa06a0c7f tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:26.340847 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1b4b07bc-6e30-47df-a6c0-37ffa06a0c7f tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:26.504429 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1b4b07bc-6e30-47df-a6c0-37ffa06a0c7f tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:26.516465 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1b4b07bc-6e30-47df-a6c0-37ffa06a0c7f tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1677 microversion: 2.1 time: 0.189768 Jun 10 18:31:26.517737 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3182/6313] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:26 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1677 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:26.884435 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b9c0da55-f2a9-44db-8240-103dedd40a4a tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:26.885086 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b9c0da55-f2a9-44db-8240-103dedd40a4a tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] [instance: ecff1e1f-13e9-4a8c-96e0-4f423a31d69e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:26.892495 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9c0da55-f2a9-44db-8240-103dedd40a4a tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:26.892959 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9c0da55-f2a9-44db-8240-103dedd40a4a tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:26.893742 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9c0da55-f2a9-44db-8240-103dedd40a4a tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:26.894189 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9c0da55-f2a9-44db-8240-103dedd40a4a tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:27.104369 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b9c0da55-f2a9-44db-8240-103dedd40a4a tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa5b7f650884ee59282ce97f48fc0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a8d819ba8844878f82cf60131df725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:27.116067 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b9c0da55-f2a9-44db-8240-103dedd40a4a tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] 10.222.0.35 "GET /compute/v2.1/servers/ecff1e1f-13e9-4a8c-96e0-4f423a31d69e" status: 200 len: 1318 microversion: 2.1 time: 0.235710 Jun 10 18:31:27.132138 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3132/6314] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:26 2022] GET /compute/v2.1/servers/ecff1e1f-13e9-4a8c-96e0-4f423a31d69e => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:27.535135 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c290b797-a774-47b1-abfc-496dd31e0589 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:27.536499 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c290b797-a774-47b1-abfc-496dd31e0589 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:27.546681 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c290b797-a774-47b1-abfc-496dd31e0589 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:27.547559 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c290b797-a774-47b1-abfc-496dd31e0589 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:27.550082 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c290b797-a774-47b1-abfc-496dd31e0589 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:27.551994 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c290b797-a774-47b1-abfc-496dd31e0589 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:27.701466 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c290b797-a774-47b1-abfc-496dd31e0589 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:27.709214 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c290b797-a774-47b1-abfc-496dd31e0589 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1677 microversion: 2.1 time: 0.178925 Jun 10 18:31:27.709830 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3183/6315] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:27 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:28.133334 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b08b18da-56b4-493c-83b8-afca3c9cc118 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:28.133811 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b08b18da-56b4-493c-83b8-afca3c9cc118 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] [instance: ecff1e1f-13e9-4a8c-96e0-4f423a31d69e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:28.152039 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b08b18da-56b4-493c-83b8-afca3c9cc118 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:28.153382 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b08b18da-56b4-493c-83b8-afca3c9cc118 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:28.153382 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b08b18da-56b4-493c-83b8-afca3c9cc118 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:28.153819 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b08b18da-56b4-493c-83b8-afca3c9cc118 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:28.425283 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b08b18da-56b4-493c-83b8-afca3c9cc118 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa5b7f650884ee59282ce97f48fc0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a8d819ba8844878f82cf60131df725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:28.437610 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b08b18da-56b4-493c-83b8-afca3c9cc118 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] 10.222.0.35 "GET /compute/v2.1/servers/ecff1e1f-13e9-4a8c-96e0-4f423a31d69e" status: 200 len: 1318 microversion: 2.1 time: 0.308387 Jun 10 18:31:28.438294 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3133/6316] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:28 2022] GET /compute/v2.1/servers/ecff1e1f-13e9-4a8c-96e0-4f423a31d69e => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:28.726378 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5d8b69cf-d410-4c26-9e5e-ee7b9d1f1900 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:28.726997 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5d8b69cf-d410-4c26-9e5e-ee7b9d1f1900 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:28.735847 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5d8b69cf-d410-4c26-9e5e-ee7b9d1f1900 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:28.737263 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5d8b69cf-d410-4c26-9e5e-ee7b9d1f1900 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:28.741007 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5d8b69cf-d410-4c26-9e5e-ee7b9d1f1900 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:28.741603 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5d8b69cf-d410-4c26-9e5e-ee7b9d1f1900 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:28.912855 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9a1ae565-039f-454d-af72-7dc43c529b09 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:28.918123 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9a1ae565-039f-454d-af72-7dc43c529b09 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 1c741087-7c53-4118-8b3d-9654a4f6ff48] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:28.931377 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5d8b69cf-d410-4c26-9e5e-ee7b9d1f1900 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:28.934244 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9a1ae565-039f-454d-af72-7dc43c529b09 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:28.934863 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9a1ae565-039f-454d-af72-7dc43c529b09 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:28.935685 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9a1ae565-039f-454d-af72-7dc43c529b09 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:28.936327 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9a1ae565-039f-454d-af72-7dc43c529b09 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:28.940429 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5d8b69cf-d410-4c26-9e5e-ee7b9d1f1900 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1677 microversion: 2.1 time: 0.218001 Jun 10 18:31:28.941588 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3184/6317] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:28 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1677 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:28.951755 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-9a1ae565-039f-454d-af72-7dc43c529b09 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] HTTP exception thrown: Instance 1c741087-7c53-4118-8b3d-9654a4f6ff48 could not be found. Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9a1ae565-039f-454d-af72-7dc43c529b09 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Request method failure captured: Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48 HTTP/1.1 Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4wSsTbdAR5Qo9IVKF2KTe64dpp06ye4z8lPOT4uRhY2Oz0KMxQpxmr8KJzvNSTZtUIPPEgN2R6-CfUmf8CTAhd_IkVIfk-LuHrtE7255OYmbmFD6LLNrB7dKdWnCpSm8e4XDxNvfMbtjLHwd4svP6YGpBpPTncT2KN4jK3q3Q7l5ew Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 886b72a54e9b4ee7aa3cc21da4145cbb Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-AttachVolumeNegativeTest-545911130 Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/886b72a54e9b4ee7aa3cc21da4145cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/886b72a54e9b4ee7aa3cc21da4145cbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/886b72a54e9b4ee7aa3cc21da4145cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_886b72a54e9b4ee7aa3cc21da4145cbb", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-AttachVolumeNegativeTest-545911130 Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 886b72a54e9b4ee7aa3cc21da4145cbb Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-545911130 Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-AttachVolumeNegativeTest-545911130-project Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: f62326a9deb140e891c07529dc021d11 Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-AttachVolumeNegativeTest-545911130-project Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 1c741087-7c53-4118-8b3d-9654a4f6ff48 could not be found. Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '1c741087-7c53-4118-8b3d-9654a4f6ff48'} Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c741087-7c53-4118-8b3d-9654a4f6ff48 could not be found. Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:31:28.953605 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:31:28.964626 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c741087-7c53-4118-8b3d-9654a4f6ff48 could not be found. Jun 10 18:31:28.964626 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:31:28.964626 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:31:28.964626 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:31:28.964626 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:31:28.964626 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:31:28.964626 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:31:28.964626 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:31:28.964626 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:31:28.964626 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c741087-7c53-4118-8b3d-9654a4f6ff48 could not be found. Jun 10 18:31:28.964626 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:31:28.964626 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9a1ae565-039f-454d-af72-7dc43c529b09 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Returning 404 to user: Instance 1c741087-7c53-4118-8b3d-9654a4f6ff48 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:31:28.964626 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9a1ae565-039f-454d-af72-7dc43c529b09 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "DELETE /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48" status: 404 len: 111 microversion: 2.1 time: 0.048819 Jun 10 18:31:28.964626 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3134/6318] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:31:28 2022] DELETE /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:31:28.971414 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e3198ea1-0333-4bd8-bfef-3d3710796283 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:28.972109 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e3198ea1-0333-4bd8-bfef-3d3710796283 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 1c741087-7c53-4118-8b3d-9654a4f6ff48] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:28.983517 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e3198ea1-0333-4bd8-bfef-3d3710796283 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:28.983741 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e3198ea1-0333-4bd8-bfef-3d3710796283 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:28.984509 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e3198ea1-0333-4bd8-bfef-3d3710796283 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:28.988645 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e3198ea1-0333-4bd8-bfef-3d3710796283 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:29.012838 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-e3198ea1-0333-4bd8-bfef-3d3710796283 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] HTTP exception thrown: Instance 1c741087-7c53-4118-8b3d-9654a4f6ff48 could not be found. Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e3198ea1-0333-4bd8-bfef-3d3710796283 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Request method failure captured: Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48 HTTP/1.1 Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4wSsTbdAR5Qo9IVKF2KTe64dpp06ye4z8lPOT4uRhY2Oz0KMxQpxmr8KJzvNSTZtUIPPEgN2R6-CfUmf8CTAhd_IkVIfk-LuHrtE7255OYmbmFD6LLNrB7dKdWnCpSm8e4XDxNvfMbtjLHwd4svP6YGpBpPTncT2KN4jK3q3Q7l5ew Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 886b72a54e9b4ee7aa3cc21da4145cbb Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-AttachVolumeNegativeTest-545911130 Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/886b72a54e9b4ee7aa3cc21da4145cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/886b72a54e9b4ee7aa3cc21da4145cbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/886b72a54e9b4ee7aa3cc21da4145cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_886b72a54e9b4ee7aa3cc21da4145cbb", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-AttachVolumeNegativeTest-545911130 Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 886b72a54e9b4ee7aa3cc21da4145cbb Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-545911130 Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-AttachVolumeNegativeTest-545911130-project Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: f62326a9deb140e891c07529dc021d11 Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-AttachVolumeNegativeTest-545911130-project Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 1c741087-7c53-4118-8b3d-9654a4f6ff48 could not be found. Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '1c741087-7c53-4118-8b3d-9654a4f6ff48'} Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c741087-7c53-4118-8b3d-9654a4f6ff48 could not be found. Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c741087-7c53-4118-8b3d-9654a4f6ff48 could not be found. Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:31:29.015204 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:31:29.020620 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:31:29.020620 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:31:29.020620 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:31:29.020620 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:31:29.020620 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:31:29.020620 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c741087-7c53-4118-8b3d-9654a4f6ff48 could not be found. Jun 10 18:31:29.020620 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:31:29.021626 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e3198ea1-0333-4bd8-bfef-3d3710796283 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Returning 404 to user: Instance 1c741087-7c53-4118-8b3d-9654a4f6ff48 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:31:29.022581 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e3198ea1-0333-4bd8-bfef-3d3710796283 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48" status: 404 len: 111 microversion: 2.1 time: 0.060773 Jun 10 18:31:29.023430 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3185/6319] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:28 2022] GET /compute/v2.1/servers/1c741087-7c53-4118-8b3d-9654a4f6ff48 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:31:29.034061 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-69843c64-4843-4766-96bf-ec6d8417277e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:29.034061 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-69843c64-4843-4766-96bf-ec6d8417277e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: e57747ec-57b8-46a6-92c2-8a57830524f7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:29.040139 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-69843c64-4843-4766-96bf-ec6d8417277e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:29.040713 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-69843c64-4843-4766-96bf-ec6d8417277e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:29.042039 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-69843c64-4843-4766-96bf-ec6d8417277e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:29.043027 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-69843c64-4843-4766-96bf-ec6d8417277e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:29.060342 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-69843c64-4843-4766-96bf-ec6d8417277e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] HTTP exception thrown: Instance e57747ec-57b8-46a6-92c2-8a57830524f7 could not be found. Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-69843c64-4843-4766-96bf-ec6d8417277e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Request method failure captured: Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7 HTTP/1.1 Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4wSsTbdAR5Qo9IVKF2KTe64dpp06ye4z8lPOT4uRhY2Oz0KMxQpxmr8KJzvNSTZtUIPPEgN2R6-CfUmf8CTAhd_IkVIfk-LuHrtE7255OYmbmFD6LLNrB7dKdWnCpSm8e4XDxNvfMbtjLHwd4svP6YGpBpPTncT2KN4jK3q3Q7l5ew Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 886b72a54e9b4ee7aa3cc21da4145cbb Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-AttachVolumeNegativeTest-545911130 Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/886b72a54e9b4ee7aa3cc21da4145cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/886b72a54e9b4ee7aa3cc21da4145cbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/886b72a54e9b4ee7aa3cc21da4145cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_886b72a54e9b4ee7aa3cc21da4145cbb", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-AttachVolumeNegativeTest-545911130 Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 886b72a54e9b4ee7aa3cc21da4145cbb Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-545911130 Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-AttachVolumeNegativeTest-545911130-project Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: f62326a9deb140e891c07529dc021d11 Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-AttachVolumeNegativeTest-545911130-project Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: exception: Instance e57747ec-57b8-46a6-92c2-8a57830524f7 could not be found. Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'e57747ec-57b8-46a6-92c2-8a57830524f7'} Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e57747ec-57b8-46a6-92c2-8a57830524f7 could not be found. Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:31:29.062943 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:31:29.068029 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e57747ec-57b8-46a6-92c2-8a57830524f7 could not be found. Jun 10 18:31:29.068029 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:31:29.068029 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:31:29.068029 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:31:29.068029 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:31:29.068029 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:31:29.068029 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:31:29.068029 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:31:29.068029 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:31:29.068029 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e57747ec-57b8-46a6-92c2-8a57830524f7 could not be found. Jun 10 18:31:29.068029 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:31:29.071324 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-69843c64-4843-4766-96bf-ec6d8417277e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Returning 404 to user: Instance e57747ec-57b8-46a6-92c2-8a57830524f7 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:31:29.071324 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-69843c64-4843-4766-96bf-ec6d8417277e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "DELETE /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7" status: 404 len: 111 microversion: 2.1 time: 0.042950 Jun 10 18:31:29.071324 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3135/6320] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:31:29 2022] DELETE /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:31:29.080976 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a7248c71-2f5b-4f43-b876-d7d28e271a93 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:29.081636 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a7248c71-2f5b-4f43-b876-d7d28e271a93 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: e57747ec-57b8-46a6-92c2-8a57830524f7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:29.104941 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a7248c71-2f5b-4f43-b876-d7d28e271a93 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:29.105387 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a7248c71-2f5b-4f43-b876-d7d28e271a93 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:29.106211 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a7248c71-2f5b-4f43-b876-d7d28e271a93 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:29.106662 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a7248c71-2f5b-4f43-b876-d7d28e271a93 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:29.178418 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-a7248c71-2f5b-4f43-b876-d7d28e271a93 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] HTTP exception thrown: Instance e57747ec-57b8-46a6-92c2-8a57830524f7 could not be found. Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a7248c71-2f5b-4f43-b876-d7d28e271a93 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Request method failure captured: Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7 HTTP/1.1 Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4wSsTbdAR5Qo9IVKF2KTe64dpp06ye4z8lPOT4uRhY2Oz0KMxQpxmr8KJzvNSTZtUIPPEgN2R6-CfUmf8CTAhd_IkVIfk-LuHrtE7255OYmbmFD6LLNrB7dKdWnCpSm8e4XDxNvfMbtjLHwd4svP6YGpBpPTncT2KN4jK3q3Q7l5ew Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 886b72a54e9b4ee7aa3cc21da4145cbb Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-AttachVolumeNegativeTest-545911130 Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/886b72a54e9b4ee7aa3cc21da4145cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/886b72a54e9b4ee7aa3cc21da4145cbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/886b72a54e9b4ee7aa3cc21da4145cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_886b72a54e9b4ee7aa3cc21da4145cbb", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-AttachVolumeNegativeTest-545911130 Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 886b72a54e9b4ee7aa3cc21da4145cbb Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-545911130 Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-AttachVolumeNegativeTest-545911130-project Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: f62326a9deb140e891c07529dc021d11 Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-AttachVolumeNegativeTest-545911130-project Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: exception: Instance e57747ec-57b8-46a6-92c2-8a57830524f7 could not be found. Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'e57747ec-57b8-46a6-92c2-8a57830524f7'} Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e57747ec-57b8-46a6-92c2-8a57830524f7 could not be found. Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e57747ec-57b8-46a6-92c2-8a57830524f7 could not be found. Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:31:29.181402 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:31:29.188801 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:31:29.188801 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:31:29.188801 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:31:29.188801 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:31:29.188801 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:31:29.188801 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e57747ec-57b8-46a6-92c2-8a57830524f7 could not be found. Jun 10 18:31:29.188801 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:31:29.196349 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a7248c71-2f5b-4f43-b876-d7d28e271a93 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Returning 404 to user: Instance e57747ec-57b8-46a6-92c2-8a57830524f7 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:31:29.201228 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a7248c71-2f5b-4f43-b876-d7d28e271a93 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7" status: 404 len: 111 microversion: 2.1 time: 0.125545 Jun 10 18:31:29.202377 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3186/6321] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:29 2022] GET /compute/v2.1/servers/e57747ec-57b8-46a6-92c2-8a57830524f7 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:31:29.458880 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-56a8b368-4f82-4843-93e2-b1ccc76239bd tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:29.459523 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-56a8b368-4f82-4843-93e2-b1ccc76239bd tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] [instance: ecff1e1f-13e9-4a8c-96e0-4f423a31d69e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:29.475429 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-56a8b368-4f82-4843-93e2-b1ccc76239bd tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:29.479729 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-56a8b368-4f82-4843-93e2-b1ccc76239bd tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:29.481153 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-56a8b368-4f82-4843-93e2-b1ccc76239bd tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:29.482499 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-56a8b368-4f82-4843-93e2-b1ccc76239bd tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:29.646457 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-56a8b368-4f82-4843-93e2-b1ccc76239bd tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa5b7f650884ee59282ce97f48fc0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a8d819ba8844878f82cf60131df725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:29.650487 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-56a8b368-4f82-4843-93e2-b1ccc76239bd tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] 10.222.0.35 "GET /compute/v2.1/servers/ecff1e1f-13e9-4a8c-96e0-4f423a31d69e" status: 200 len: 1318 microversion: 2.1 time: 0.199216 Jun 10 18:31:29.651091 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3136/6322] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:29 2022] GET /compute/v2.1/servers/ecff1e1f-13e9-4a8c-96e0-4f423a31d69e => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:29.957843 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f87f2157-c61b-415e-8841-2ab444183243 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:29.958466 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f87f2157-c61b-415e-8841-2ab444183243 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:29.960410 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:31:29.966237 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f87f2157-c61b-415e-8841-2ab444183243 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:29.966705 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f87f2157-c61b-415e-8841-2ab444183243 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:29.967482 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f87f2157-c61b-415e-8841-2ab444183243 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:29.967923 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f87f2157-c61b-415e-8841-2ab444183243 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:30.188249 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f87f2157-c61b-415e-8841-2ab444183243 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:30.196065 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f87f2157-c61b-415e-8841-2ab444183243 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1677 microversion: 2.1 time: 0.242059 Jun 10 18:31:30.201458 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3187/6323] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:29 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1677 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:30.669153 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c14bbb02-4447-4756-aad6-f8dfbdf53541 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:30.670411 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c14bbb02-4447-4756-aad6-f8dfbdf53541 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] [instance: ecff1e1f-13e9-4a8c-96e0-4f423a31d69e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:30.681166 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:31:30.683872 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c14bbb02-4447-4756-aad6-f8dfbdf53541 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:30.687288 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c14bbb02-4447-4756-aad6-f8dfbdf53541 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:30.688842 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c14bbb02-4447-4756-aad6-f8dfbdf53541 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:30.689545 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c14bbb02-4447-4756-aad6-f8dfbdf53541 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:30.795710 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-12647133-b1af-4630-8978-5ec8a49f72c5 req-f829aa73-a0b4-4380-a89f-fe393acf5b9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecff1e1f-13e9-4a8c-96e0-4f423a31d69e", "name": "network-vif-plugged", "status": "completed", "tag": "f17cf721-01c3-49f8-9a21-62c5127a40f4"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:31:30.822350 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-12647133-b1af-4630-8978-5ec8a49f72c5 req-f829aa73-a0b4-4380-a89f-fe393acf5b9b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:30.823008 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-12647133-b1af-4630-8978-5ec8a49f72c5 req-f829aa73-a0b4-4380-a89f-fe393acf5b9b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:30.858198 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-12647133-b1af-4630-8978-5ec8a49f72c5 req-f829aa73-a0b4-4380-a89f-fe393acf5b9b service nova] Creating event network-vif-plugged:f17cf721-01c3-49f8-9a21-62c5127a40f4 for instance ecff1e1f-13e9-4a8c-96e0-4f423a31d69e on chh1-master-2 Jun 10 18:31:30.864362 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-12647133-b1af-4630-8978-5ec8a49f72c5 req-f829aa73-a0b4-4380-a89f-fe393acf5b9b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072598 Jun 10 18:31:30.870159 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3188/6324] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:31:30.931411 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c14bbb02-4447-4756-aad6-f8dfbdf53541 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa5b7f650884ee59282ce97f48fc0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a8d819ba8844878f82cf60131df725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:30.936464 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:31:30.947505 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c14bbb02-4447-4756-aad6-f8dfbdf53541 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] 10.222.0.35 "GET /compute/v2.1/servers/ecff1e1f-13e9-4a8c-96e0-4f423a31d69e" status: 200 len: 1318 microversion: 2.1 time: 0.280890 Jun 10 18:31:30.948423 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3137/6325] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:30 2022] GET /compute/v2.1/servers/ecff1e1f-13e9-4a8c-96e0-4f423a31d69e => generated 1318 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:31.215469 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5555f532-d882-4e83-91a3-88848031980b tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:31.216518 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5555f532-d882-4e83-91a3-88848031980b tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:31.218649 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-241c9588-4c61-49e9-8633-e29ed001d99b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:31:31.219039 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=8 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:31:31.219686 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-241c9588-4c61-49e9-8633-e29ed001d99b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:31.231778 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5555f532-d882-4e83-91a3-88848031980b tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:31.233261 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5555f532-d882-4e83-91a3-88848031980b tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:31.241696 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5555f532-d882-4e83-91a3-88848031980b tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:31.241696 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5555f532-d882-4e83-91a3-88848031980b tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:31.241932 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-241c9588-4c61-49e9-8633-e29ed001d99b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:31.241932 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-241c9588-4c61-49e9-8633-e29ed001d99b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:31.241932 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-241c9588-4c61-49e9-8633-e29ed001d99b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:31.241932 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-241c9588-4c61-49e9-8633-e29ed001d99b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:31.335160 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-241c9588-4c61-49e9-8633-e29ed001d99b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "POST /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791/action" status: 200 len: 24551 microversion: 2.1 time: 0.120111 Jun 10 18:31:31.335829 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3138/6326] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:31:31 2022] POST /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791/action => generated 24551 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:31:31.598097 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5555f532-d882-4e83-91a3-88848031980b tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:31.607262 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5555f532-d882-4e83-91a3-88848031980b tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1677 microversion: 2.1 time: 0.396195 Jun 10 18:31:31.607848 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3189/6327] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:31 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1677 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:31.966744 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-40d281c8-ae90-4ec6-aa87-2e9190e29f22 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:31.967562 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-40d281c8-ae90-4ec6-aa87-2e9190e29f22 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] [instance: ecff1e1f-13e9-4a8c-96e0-4f423a31d69e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:31.975667 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-40d281c8-ae90-4ec6-aa87-2e9190e29f22 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:31.976219 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-40d281c8-ae90-4ec6-aa87-2e9190e29f22 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:31.977260 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-40d281c8-ae90-4ec6-aa87-2e9190e29f22 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:31.977768 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-40d281c8-ae90-4ec6-aa87-2e9190e29f22 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:32.124200 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-40d281c8-ae90-4ec6-aa87-2e9190e29f22 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa5b7f650884ee59282ce97f48fc0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a8d819ba8844878f82cf60131df725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:32.133408 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-40d281c8-ae90-4ec6-aa87-2e9190e29f22 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] 10.222.0.35 "GET /compute/v2.1/servers/ecff1e1f-13e9-4a8c-96e0-4f423a31d69e" status: 200 len: 1318 microversion: 2.1 time: 0.171640 Jun 10 18:31:32.134276 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3139/6328] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:31 2022] GET /compute/v2.1/servers/ecff1e1f-13e9-4a8c-96e0-4f423a31d69e => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:32.626386 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9a391a8a-d9ca-468f-b913-e031a6781816 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:32.627177 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9a391a8a-d9ca-468f-b913-e031a6781816 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:32.634870 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9a391a8a-d9ca-468f-b913-e031a6781816 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:32.635340 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9a391a8a-d9ca-468f-b913-e031a6781816 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:32.636129 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9a391a8a-d9ca-468f-b913-e031a6781816 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:32.636599 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9a391a8a-d9ca-468f-b913-e031a6781816 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:32.799609 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9a391a8a-d9ca-468f-b913-e031a6781816 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:32.807403 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9a391a8a-d9ca-468f-b913-e031a6781816 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1654 microversion: 2.1 time: 0.185642 Jun 10 18:31:32.808909 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3190/6329] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:32 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1654 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:31:32.824603 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-99261577-9e1f-4300-a123-e57407101a05 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:31:32.831382 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99261577-9e1f-4300-a123-e57407101a05 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:32.831837 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99261577-9e1f-4300-a123-e57407101a05 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:32.857348 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-99261577-9e1f-4300-a123-e57407101a05 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Going to try to start instance {{(pid=126595) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 10 18:31:33.060525 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-99261577-9e1f-4300-a123-e57407101a05 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "POST /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d/action" status: 202 len: 0 microversion: 2.1 time: 0.239924 Jun 10 18:31:33.069825 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-46872c32-09f3-49f5-9017-c3586f8193b3 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:33.070296 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-46872c32-09f3-49f5-9017-c3586f8193b3 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:33.072508 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3140/6330] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:31:32 2022] POST /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:31:33.076683 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-46872c32-09f3-49f5-9017-c3586f8193b3 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:33.077350 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-46872c32-09f3-49f5-9017-c3586f8193b3 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:33.078139 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-46872c32-09f3-49f5-9017-c3586f8193b3 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:33.078762 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-46872c32-09f3-49f5-9017-c3586f8193b3 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:33.152846 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-de110037-f3b8-4a97-97ae-79c0e104cd07 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:33.153920 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-de110037-f3b8-4a97-97ae-79c0e104cd07 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] [instance: ecff1e1f-13e9-4a8c-96e0-4f423a31d69e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:33.166174 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de110037-f3b8-4a97-97ae-79c0e104cd07 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:33.167189 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de110037-f3b8-4a97-97ae-79c0e104cd07 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:33.168725 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de110037-f3b8-4a97-97ae-79c0e104cd07 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:33.169646 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de110037-f3b8-4a97-97ae-79c0e104cd07 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:33.266262 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-46872c32-09f3-49f5-9017-c3586f8193b3 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:33.278752 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-46872c32-09f3-49f5-9017-c3586f8193b3 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1663 microversion: 2.1 time: 0.212757 Jun 10 18:31:33.279699 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3191/6331] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:33 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1663 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:31:33.373985 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-de110037-f3b8-4a97-97ae-79c0e104cd07 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa5b7f650884ee59282ce97f48fc0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a8d819ba8844878f82cf60131df725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:33.387612 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-de110037-f3b8-4a97-97ae-79c0e104cd07 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] 10.222.0.35 "GET /compute/v2.1/servers/ecff1e1f-13e9-4a8c-96e0-4f423a31d69e" status: 200 len: 1508 microversion: 2.1 time: 0.239747 Jun 10 18:31:33.390631 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3141/6332] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:33 2022] GET /compute/v2.1/servers/ecff1e1f-13e9-4a8c-96e0-4f423a31d69e => generated 1508 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:31:33.795261 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ec390ccc-ee9e-4732-92fb-9a21624acfc0 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:33.796521 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ec390ccc-ee9e-4732-92fb-9a21624acfc0 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:33.809753 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec390ccc-ee9e-4732-92fb-9a21624acfc0 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:33.810512 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec390ccc-ee9e-4732-92fb-9a21624acfc0 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:33.811597 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec390ccc-ee9e-4732-92fb-9a21624acfc0 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:33.812293 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec390ccc-ee9e-4732-92fb-9a21624acfc0 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:33.829596 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-ec390ccc-ee9e-4732-92fb-9a21624acfc0 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] HTTP exception thrown: Instance 0fa247cf-f328-4ddf-b72c-2cde38330ed2 could not be found. Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ec390ccc-ee9e-4732-92fb-9a21624acfc0 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Request method failure captured: Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: request: DELETE /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2 HTTP/1.1 Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4wSsTbdAR5Qo9IVKF2KTe64dpp06ye4z8lPOT4uRhY2Oz0KMxQpxmr8KJzvNSTZtUIPPEgN2R6-CfUmf8CTAhd_IkVIfk-LuHrtE7255OYmbmFD6LLNrB7dKdWnCpSm8e4XDxNvfMbtjLHwd4svP6YGpBpPTncT2KN4jK3q3Q7l5ew Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 886b72a54e9b4ee7aa3cc21da4145cbb Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-AttachVolumeNegativeTest-545911130 Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/886b72a54e9b4ee7aa3cc21da4145cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/886b72a54e9b4ee7aa3cc21da4145cbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/886b72a54e9b4ee7aa3cc21da4145cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_886b72a54e9b4ee7aa3cc21da4145cbb", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-AttachVolumeNegativeTest-545911130 Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 886b72a54e9b4ee7aa3cc21da4145cbb Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-545911130 Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-AttachVolumeNegativeTest-545911130-project Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: f62326a9deb140e891c07529dc021d11 Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-AttachVolumeNegativeTest-545911130-project Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 0fa247cf-f328-4ddf-b72c-2cde38330ed2 could not be found. Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '0fa247cf-f328-4ddf-b72c-2cde38330ed2'} Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fa247cf-f328-4ddf-b72c-2cde38330ed2 could not be found. Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:31:33.831751 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:31:33.842888 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fa247cf-f328-4ddf-b72c-2cde38330ed2 could not be found. Jun 10 18:31:33.842888 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:31:33.842888 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:31:33.842888 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:31:33.842888 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:31:33.842888 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:31:33.842888 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:31:33.842888 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:31:33.842888 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:31:33.842888 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fa247cf-f328-4ddf-b72c-2cde38330ed2 could not be found. Jun 10 18:31:33.842888 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:31:33.842888 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ec390ccc-ee9e-4732-92fb-9a21624acfc0 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Returning 404 to user: Instance 0fa247cf-f328-4ddf-b72c-2cde38330ed2 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:31:33.842888 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ec390ccc-ee9e-4732-92fb-9a21624acfc0 tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "DELETE /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2" status: 404 len: 111 microversion: 2.1 time: 0.043505 Jun 10 18:31:33.842888 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3192/6333] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:31:33 2022] DELETE /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:31:33.851382 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ee0fb493-67ae-4522-b10d-7858a7c09a2e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:33.852793 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ee0fb493-67ae-4522-b10d-7858a7c09a2e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] [instance: 0fa247cf-f328-4ddf-b72c-2cde38330ed2] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:33.862358 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee0fb493-67ae-4522-b10d-7858a7c09a2e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:33.869103 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee0fb493-67ae-4522-b10d-7858a7c09a2e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:33.869103 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee0fb493-67ae-4522-b10d-7858a7c09a2e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:33.869103 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee0fb493-67ae-4522-b10d-7858a7c09a2e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:33.881712 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-ee0fb493-67ae-4522-b10d-7858a7c09a2e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] HTTP exception thrown: Instance 0fa247cf-f328-4ddf-b72c-2cde38330ed2 could not be found. Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ee0fb493-67ae-4522-b10d-7858a7c09a2e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Request method failure captured: Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2 HTTP/1.1 Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio4wSsTbdAR5Qo9IVKF2KTe64dpp06ye4z8lPOT4uRhY2Oz0KMxQpxmr8KJzvNSTZtUIPPEgN2R6-CfUmf8CTAhd_IkVIfk-LuHrtE7255OYmbmFD6LLNrB7dKdWnCpSm8e4XDxNvfMbtjLHwd4svP6YGpBpPTncT2KN4jK3q3Q7l5ew Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 886b72a54e9b4ee7aa3cc21da4145cbb Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-AttachVolumeNegativeTest-545911130 Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/886b72a54e9b4ee7aa3cc21da4145cbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/886b72a54e9b4ee7aa3cc21da4145cbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/886b72a54e9b4ee7aa3cc21da4145cbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_886b72a54e9b4ee7aa3cc21da4145cbb", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-AttachVolumeNegativeTest-545911130 Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 886b72a54e9b4ee7aa3cc21da4145cbb Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-545911130 Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-AttachVolumeNegativeTest-545911130-project Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: f62326a9deb140e891c07529dc021d11 Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-AttachVolumeNegativeTest-545911130-project Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 0fa247cf-f328-4ddf-b72c-2cde38330ed2 could not be found. Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '0fa247cf-f328-4ddf-b72c-2cde38330ed2'} Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fa247cf-f328-4ddf-b72c-2cde38330ed2 could not be found. Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fa247cf-f328-4ddf-b72c-2cde38330ed2 could not be found. Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:31:33.883798 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:31:33.888751 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:31:33.888751 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:31:33.888751 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:31:33.888751 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:31:33.888751 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:31:33.888751 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fa247cf-f328-4ddf-b72c-2cde38330ed2 could not be found. Jun 10 18:31:33.888751 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:31:33.888751 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ee0fb493-67ae-4522-b10d-7858a7c09a2e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] Returning 404 to user: Instance 0fa247cf-f328-4ddf-b72c-2cde38330ed2 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:31:33.888751 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ee0fb493-67ae-4522-b10d-7858a7c09a2e tempest-AttachVolumeNegativeTest-545911130 tempest-AttachVolumeNegativeTest-545911130-project] 10.222.0.35 "GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2" status: 404 len: 111 microversion: 2.1 time: 0.042715 Jun 10 18:31:33.890583 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3142/6334] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:33 2022] GET /compute/v2.1/servers/0fa247cf-f328-4ddf-b72c-2cde38330ed2 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:31:34.297227 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-292ebfaa-d782-4098-a5aa-10106dffbbb2 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:34.304703 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-292ebfaa-d782-4098-a5aa-10106dffbbb2 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:34.308543 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-292ebfaa-d782-4098-a5aa-10106dffbbb2 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:34.308961 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-292ebfaa-d782-4098-a5aa-10106dffbbb2 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:34.321092 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-292ebfaa-d782-4098-a5aa-10106dffbbb2 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:34.328963 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-292ebfaa-d782-4098-a5aa-10106dffbbb2 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:34.567063 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-292ebfaa-d782-4098-a5aa-10106dffbbb2 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:34.576899 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-292ebfaa-d782-4098-a5aa-10106dffbbb2 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1663 microversion: 2.1 time: 0.283777 Jun 10 18:31:34.577500 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3193/6335] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:34 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1663 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:35.597713 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8884a859-566d-4b0d-9082-c9286eac1cf2 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:35.598336 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8884a859-566d-4b0d-9082-c9286eac1cf2 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:35.611815 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8884a859-566d-4b0d-9082-c9286eac1cf2 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:35.612377 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8884a859-566d-4b0d-9082-c9286eac1cf2 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:35.613165 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8884a859-566d-4b0d-9082-c9286eac1cf2 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:35.614329 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8884a859-566d-4b0d-9082-c9286eac1cf2 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:35.843029 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8884a859-566d-4b0d-9082-c9286eac1cf2 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:35.853243 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8884a859-566d-4b0d-9082-c9286eac1cf2 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1667 microversion: 2.1 time: 0.261672 Jun 10 18:31:35.854377 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3143/6336] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:35 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1667 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:40.933572 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fd880981-fece-4dbc-88eb-83d2f293d5e3 tempest-VolumesGetTestJSON-287396401 tempest-VolumesGetTestJSON-287396401-project] Action: 'create', calling method: .version_select at 0x7f77c6071940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-313305050", "metadata": {"Type": "work"}}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:31:41.786573 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fd880981-fece-4dbc-88eb-83d2f293d5e3 tempest-VolumesGetTestJSON-287396401 tempest-VolumesGetTestJSON-287396401-project] 10.222.0.35 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.082331 Jun 10 18:31:41.787496 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3194/6337] 10.222.0.35 () {60 vars in 1155 bytes} [Fri Jun 10 18:31:40 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1084 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 10 18:31:41.798950 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a030db52-10f9-440c-abc6-c8c926af2efc tempest-VolumesGetTestJSON-287396401 tempest-VolumesGetTestJSON-287396401-project] Calling method '.version_select at 0x7f77c010f040>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:41.882082 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a030db52-10f9-440c-abc6-c8c926af2efc tempest-VolumesGetTestJSON-287396401 tempest-VolumesGetTestJSON-287396401-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/084d6e2a-53c8-4ab2-9ea8-c99aaf4c102d" status: 200 len: 352 microversion: 2.1 time: 0.086893 Jun 10 18:31:41.888025 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3144/6338] 10.222.0.35 () {58 vars in 1244 bytes} [Fri Jun 10 18:31:41 2022] GET /compute/v2.1/os-volumes/084d6e2a-53c8-4ab2-9ea8-c99aaf4c102d => generated 352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:31:42.236186 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e19cc2a4-273b-4668-affc-3788c886642e tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:42.236627 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e19cc2a4-273b-4668-affc-3788c886642e tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:42.243701 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e19cc2a4-273b-4668-affc-3788c886642e tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:42.244362 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e19cc2a4-273b-4668-affc-3788c886642e tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:42.254898 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e19cc2a4-273b-4668-affc-3788c886642e tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:42.254898 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e19cc2a4-273b-4668-affc-3788c886642e tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:42.895154 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5f8d2ca6-4822-4ef0-8a9f-54cd6888941b tempest-VolumesGetTestJSON-287396401 tempest-VolumesGetTestJSON-287396401-project] Calling method '.version_select at 0x7f77c0099ee0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:43.038312 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5f8d2ca6-4822-4ef0-8a9f-54cd6888941b tempest-VolumesGetTestJSON-287396401 tempest-VolumesGetTestJSON-287396401-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/084d6e2a-53c8-4ab2-9ea8-c99aaf4c102d" status: 200 len: 352 microversion: 2.1 time: 0.147532 Jun 10 18:31:43.039116 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3145/6339] 10.222.0.35 () {58 vars in 1244 bytes} [Fri Jun 10 18:31:42 2022] GET /compute/v2.1/os-volumes/084d6e2a-53c8-4ab2-9ea8-c99aaf4c102d => generated 352 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:31:43.077550 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e19cc2a4-273b-4668-affc-3788c886642e tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1833 microversion: 2.1 time: 0.845055 Jun 10 18:31:43.078412 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3195/6340] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:42 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1833 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:43.095880 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d8473949-b7b8-4084-8e3e-92879692cbc1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:43.096545 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d8473949-b7b8-4084-8e3e-92879692cbc1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:43.105227 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d8473949-b7b8-4084-8e3e-92879692cbc1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:43.105690 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d8473949-b7b8-4084-8e3e-92879692cbc1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:43.106494 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d8473949-b7b8-4084-8e3e-92879692cbc1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:43.106958 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d8473949-b7b8-4084-8e3e-92879692cbc1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:43.333317 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d8473949-b7b8-4084-8e3e-92879692cbc1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:43.355422 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d8473949-b7b8-4084-8e3e-92879692cbc1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1682 microversion: 2.1 time: 0.251090 Jun 10 18:31:43.356930 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3146/6341] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:43 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1682 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:43.500837 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3f84a371-1f58-41b5-a2ae-c9cf04371009 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:31:43.506908 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3f84a371-1f58-41b5-a2ae-c9cf04371009 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:43.514109 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f84a371-1f58-41b5-a2ae-c9cf04371009 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:43.522089 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f84a371-1f58-41b5-a2ae-c9cf04371009 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:43.523522 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f84a371-1f58-41b5-a2ae-c9cf04371009 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:43.524485 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3f84a371-1f58-41b5-a2ae-c9cf04371009 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:43.600275 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3f84a371-1f58-41b5-a2ae-c9cf04371009 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "POST /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791/action" status: 200 len: 32624 microversion: 2.1 time: 0.108828 Jun 10 18:31:43.610450 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3196/6342] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:31:43 2022] POST /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791/action => generated 32624 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 10 18:31:43.701820 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a54ba6a0-aad5-4024-aed8-600bb759be2a tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:31:43.702401 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a54ba6a0-aad5-4024-aed8-600bb759be2a tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:43.708659 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a54ba6a0-aad5-4024-aed8-600bb759be2a tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:43.709125 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a54ba6a0-aad5-4024-aed8-600bb759be2a tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:43.709903 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a54ba6a0-aad5-4024-aed8-600bb759be2a tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:43.710350 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a54ba6a0-aad5-4024-aed8-600bb759be2a tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:43.801153 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a54ba6a0-aad5-4024-aed8-600bb759be2a tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4af44487b0794569b85591fcd6300bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71021080cdf64cc8a8c1c14900654b74', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:43.802174 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a54ba6a0-aad5-4024-aed8-600bb759be2a tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] flavor_id is None. Assuming migration. {{(pid=126595) resize /opt/stack/nova/nova/compute/api.py:4142}} Jun 10 18:31:43.802634 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a54ba6a0-aad5-4024-aed8-600bb759be2a tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=126595) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 10 18:31:44.053378 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3ff70dbe-ed74-47e7-8445-7601d8c31265 tempest-VolumesGetTestJSON-287396401 tempest-VolumesGetTestJSON-287396401-project] Calling method '.version_select at 0x7f77c60bfa60>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:44.120607 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3ff70dbe-ed74-47e7-8445-7601d8c31265 tempest-VolumesGetTestJSON-287396401 tempest-VolumesGetTestJSON-287396401-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/084d6e2a-53c8-4ab2-9ea8-c99aaf4c102d" status: 200 len: 353 microversion: 2.1 time: 0.071758 Jun 10 18:31:44.121398 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3197/6343] 10.222.0.35 () {58 vars in 1244 bytes} [Fri Jun 10 18:31:44 2022] GET /compute/v2.1/os-volumes/084d6e2a-53c8-4ab2-9ea8-c99aaf4c102d => generated 353 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:31:44.137175 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-46b406e7-ebbb-43bf-b698-69e376a71dc8 tempest-VolumesGetTestJSON-287396401 tempest-VolumesGetTestJSON-287396401-project] Calling method '.version_select at 0x7f77c08fcaf0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:44.195414 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-46b406e7-ebbb-43bf-b698-69e376a71dc8 tempest-VolumesGetTestJSON-287396401 tempest-VolumesGetTestJSON-287396401-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/084d6e2a-53c8-4ab2-9ea8-c99aaf4c102d" status: 200 len: 353 microversion: 2.1 time: 0.062735 Jun 10 18:31:44.196107 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3198/6344] 10.222.0.35 () {58 vars in 1244 bytes} [Fri Jun 10 18:31:44 2022] GET /compute/v2.1/os-volumes/084d6e2a-53c8-4ab2-9ea8-c99aaf4c102d => generated 353 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:31:44.208552 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-60ba0960-4ea0-450a-85db-e54024e2b6f5 tempest-VolumesGetTestJSON-287396401 tempest-VolumesGetTestJSON-287396401-project] Calling method '.version_select at 0x7f77b3c65280>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:44.434381 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-60ba0960-4ea0-450a-85db-e54024e2b6f5 tempest-VolumesGetTestJSON-287396401 tempest-VolumesGetTestJSON-287396401-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/084d6e2a-53c8-4ab2-9ea8-c99aaf4c102d" status: 202 len: 0 microversion: 2.1 time: 0.229867 Jun 10 18:31:44.435409 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3199/6345] 10.222.0.35 () {58 vars in 1247 bytes} [Fri Jun 10 18:31:44 2022] DELETE /compute/v2.1/os-volumes/084d6e2a-53c8-4ab2-9ea8-c99aaf4c102d => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 18:31:44.444719 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9eae39fb-18b7-4c2b-a66a-d62a0d4fc5ac tempest-VolumesGetTestJSON-287396401 tempest-VolumesGetTestJSON-287396401-project] Calling method '.version_select at 0x7f77c0322a60>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:44.515021 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9eae39fb-18b7-4c2b-a66a-d62a0d4fc5ac tempest-VolumesGetTestJSON-287396401 tempest-VolumesGetTestJSON-287396401-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/084d6e2a-53c8-4ab2-9ea8-c99aaf4c102d" status: 200 len: 352 microversion: 2.1 time: 0.075432 Jun 10 18:31:44.515726 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3200/6346] 10.222.0.35 () {58 vars in 1244 bytes} [Fri Jun 10 18:31:44 2022] GET /compute/v2.1/os-volumes/084d6e2a-53c8-4ab2-9ea8-c99aaf4c102d => generated 352 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:31:44.552245 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a54ba6a0-aad5-4024-aed8-600bb759be2a tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] 10.222.0.35 "POST /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791/action" status: 202 len: 0 microversion: 2.1 time: 0.852208 Jun 10 18:31:44.554191 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3147/6347] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:31:43 2022] POST /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791/action => generated 0 bytes in 858 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:31:44.565281 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bd4fb009-29b8-4db1-b694-8ec4d0f23c9e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:44.567017 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bd4fb009-29b8-4db1-b694-8ec4d0f23c9e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:44.571054 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:31:44.589953 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bd4fb009-29b8-4db1-b694-8ec4d0f23c9e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:44.593521 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bd4fb009-29b8-4db1-b694-8ec4d0f23c9e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:44.596596 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bd4fb009-29b8-4db1-b694-8ec4d0f23c9e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:44.597130 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bd4fb009-29b8-4db1-b694-8ec4d0f23c9e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:44.668606 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9b89f506-3a50-44ed-bc32-ffad6d023774 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:31:44.669872 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9b89f506-3a50-44ed-bc32-ffad6d023774 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: da9bceb9-4c3f-48ce-ae73-edc39b206e30] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:44.680701 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b89f506-3a50-44ed-bc32-ffad6d023774 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:44.681415 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b89f506-3a50-44ed-bc32-ffad6d023774 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:44.683180 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b89f506-3a50-44ed-bc32-ffad6d023774 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:44.683874 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b89f506-3a50-44ed-bc32-ffad6d023774 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:44.771052 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9b89f506-3a50-44ed-bc32-ffad6d023774 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "POST /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30/action" status: 200 len: 24575 microversion: 2.1 time: 0.112213 Jun 10 18:31:44.772120 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3148/6348] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:31:44 2022] POST /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30/action => generated 24575 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:31:44.965904 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bd4fb009-29b8-4db1-b694-8ec4d0f23c9e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:44.975576 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bd4fb009-29b8-4db1-b694-8ec4d0f23c9e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1691 microversion: 2.1 time: 0.415851 Jun 10 18:31:44.976219 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3201/6349] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:44 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1691 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:45.530413 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-66bd1335-89fb-4f5c-a4d1-8c3cb18f4dcd tempest-VolumesGetTestJSON-287396401 tempest-VolumesGetTestJSON-287396401-project] Calling method '.version_select at 0x7f77c00994c0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:45.612994 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-66bd1335-89fb-4f5c-a4d1-8c3cb18f4dcd tempest-VolumesGetTestJSON-287396401 tempest-VolumesGetTestJSON-287396401-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/084d6e2a-53c8-4ab2-9ea8-c99aaf4c102d" status: 200 len: 352 microversion: 2.1 time: 0.089270 Jun 10 18:31:45.615042 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3149/6350] 10.222.0.35 () {58 vars in 1244 bytes} [Fri Jun 10 18:31:45 2022] GET /compute/v2.1/os-volumes/084d6e2a-53c8-4ab2-9ea8-c99aaf4c102d => generated 352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:31:46.000417 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a3871758-2658-4f3d-aa4c-3803aabbc8ab tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:46.001407 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a3871758-2658-4f3d-aa4c-3803aabbc8ab tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:46.009518 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3871758-2658-4f3d-aa4c-3803aabbc8ab tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:46.009978 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3871758-2658-4f3d-aa4c-3803aabbc8ab tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:46.011043 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3871758-2658-4f3d-aa4c-3803aabbc8ab tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:46.011487 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a3871758-2658-4f3d-aa4c-3803aabbc8ab tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:46.285913 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a3871758-2658-4f3d-aa4c-3803aabbc8ab tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:46.293575 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a3871758-2658-4f3d-aa4c-3803aabbc8ab tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1691 microversion: 2.1 time: 0.297587 Jun 10 18:31:46.294646 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3202/6351] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:45 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1691 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:46.626940 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d54290a8-93f2-42d5-b3e1-b701032500c0 tempest-VolumesGetTestJSON-287396401 tempest-VolumesGetTestJSON-287396401-project] Calling method '.version_select at 0x7f77b3ef80d0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:46.687953 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d54290a8-93f2-42d5-b3e1-b701032500c0 tempest-VolumesGetTestJSON-287396401 tempest-VolumesGetTestJSON-287396401-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/084d6e2a-53c8-4ab2-9ea8-c99aaf4c102d" status: 200 len: 352 microversion: 2.1 time: 0.065731 Jun 10 18:31:46.689836 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3150/6352] 10.222.0.35 () {58 vars in 1244 bytes} [Fri Jun 10 18:31:46 2022] GET /compute/v2.1/os-volumes/084d6e2a-53c8-4ab2-9ea8-c99aaf4c102d => generated 352 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:31:47.313598 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fa76a249-3996-4488-8445-23051cf9c985 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:47.314440 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fa76a249-3996-4488-8445-23051cf9c985 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:47.323844 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fa76a249-3996-4488-8445-23051cf9c985 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:47.324495 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fa76a249-3996-4488-8445-23051cf9c985 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:47.325322 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fa76a249-3996-4488-8445-23051cf9c985 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:47.325764 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fa76a249-3996-4488-8445-23051cf9c985 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:47.565161 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fa76a249-3996-4488-8445-23051cf9c985 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:47.573689 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fa76a249-3996-4488-8445-23051cf9c985 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1691 microversion: 2.1 time: 0.266403 Jun 10 18:31:47.577759 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3203/6353] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:47 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1691 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:47.701832 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bdd0d527-63b7-4fdf-8dd9-ff107f6af429 tempest-VolumesGetTestJSON-287396401 tempest-VolumesGetTestJSON-287396401-project] Calling method '.version_select at 0x7f77c010f820>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:47.746766 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-bdd0d527-63b7-4fdf-8dd9-ff107f6af429 tempest-VolumesGetTestJSON-287396401 tempest-VolumesGetTestJSON-287396401-project] HTTP exception thrown: Volume 084d6e2a-53c8-4ab2-9ea8-c99aaf4c102d could not be found. Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bdd0d527-63b7-4fdf-8dd9-ff107f6af429 tempest-VolumesGetTestJSON-287396401 tempest-VolumesGetTestJSON-287396401-project] Request method failure captured: Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/os-volumes/084d6e2a-53c8-4ab2-9ea8-c99aaf4c102d HTTP/1.1 Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio44MFwEAwMX6r8Pv5Y4XEE_IeRjO2lTDi7OlmXA7K3fPBUf7rRkIFlI8fAixt0UhseUIGJHqv5h_4qH6kJGHOKBrH3AmQzfwKpG--7KnKDrmKjLYluBy-V4qI_i_U8NOzVk6Yi_KPsdKjuxnYPkjKET60Oavrs6VfD3TfIds9-7Ogh4 Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: fe64b0419fe94c49a0f1a5a2eaf98208 Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-VolumesGetTestJSON-287396401 Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/fe64b0419fe94c49a0f1a5a2eaf98208"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/fe64b0419fe94c49a0f1a5a2eaf98208"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/fe64b0419fe94c49a0f1a5a2eaf98208"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_fe64b0419fe94c49a0f1a5a2eaf98208", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-VolumesGetTestJSON-287396401 Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: fe64b0419fe94c49a0f1a5a2eaf98208 Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-VolumesGetTestJSON-287396401 Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-VolumesGetTestJSON-287396401-project Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 56a323ba54ca44639a98a2979e83165d Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-VolumesGetTestJSON-287396401-project Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: exception: Volume 084d6e2a-53c8-4ab2-9ea8-c99aaf4c102d could not be found. Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '084d6e2a-53c8-4ab2-9ea8-c99aaf4c102d'} Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 084d6e2a-53c8-4ab2-9ea8-c99aaf4c102d could not be found. (HTTP 404) (Request-ID: req-52b0c4b7-400c-4502-9df1-fb4b61c7ad42) Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 10 18:31:47.749133 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 10 18:31:47.754077 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 10 18:31:47.754077 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 10 18:31:47.754077 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 10 18:31:47.754077 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 10 18:31:47.754077 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 10 18:31:47.754077 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 10 18:31:47.754077 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 10 18:31:47.754077 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 10 18:31:47.754077 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 10 18:31:47.754077 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 10 18:31:47.754077 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 10 18:31:47.754077 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 10 18:31:47.754077 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 10 18:31:47.754077 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 084d6e2a-53c8-4ab2-9ea8-c99aaf4c102d could not be found. Jun 10 18:31:47.754077 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:31:47.754077 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:31:47.754077 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:31:47.754077 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:31:47.754077 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:31:47.754077 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:31:47.754077 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:31:47.754077 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:31:47.754077 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:31:47.754077 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:31:47.754077 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:31:47.754077 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:31:47.754077 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 10 18:31:47.754077 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:31:47.754077 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 084d6e2a-53c8-4ab2-9ea8-c99aaf4c102d could not be found. Jun 10 18:31:47.754077 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:31:47.754077 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:31:47.754077 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:31:47.754077 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:31:47.754077 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:31:47.754077 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:31:47.754077 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:31:47.754077 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:31:47.754077 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 084d6e2a-53c8-4ab2-9ea8-c99aaf4c102d could not be found. Jun 10 18:31:47.754077 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:31:47.754077 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bdd0d527-63b7-4fdf-8dd9-ff107f6af429 tempest-VolumesGetTestJSON-287396401 tempest-VolumesGetTestJSON-287396401-project] Returning 404 to user: Volume 084d6e2a-53c8-4ab2-9ea8-c99aaf4c102d could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:31:47.754077 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bdd0d527-63b7-4fdf-8dd9-ff107f6af429 tempest-VolumesGetTestJSON-287396401 tempest-VolumesGetTestJSON-287396401-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/084d6e2a-53c8-4ab2-9ea8-c99aaf4c102d" status: 404 len: 109 microversion: 2.1 time: 0.053266 Jun 10 18:31:47.758307 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3151/6354] 10.222.0.35 () {58 vars in 1244 bytes} [Fri Jun 10 18:31:47 2022] GET /compute/v2.1/os-volumes/084d6e2a-53c8-4ab2-9ea8-c99aaf4c102d => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:31:48.607292 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-aabb86af-3a07-461a-ba8d-4b3d5d13941b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:48.608889 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-aabb86af-3a07-461a-ba8d-4b3d5d13941b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:48.621565 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aabb86af-3a07-461a-ba8d-4b3d5d13941b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:48.622297 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aabb86af-3a07-461a-ba8d-4b3d5d13941b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:48.624285 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aabb86af-3a07-461a-ba8d-4b3d5d13941b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:48.625019 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aabb86af-3a07-461a-ba8d-4b3d5d13941b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:48.940100 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-aabb86af-3a07-461a-ba8d-4b3d5d13941b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:48.949188 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-aabb86af-3a07-461a-ba8d-4b3d5d13941b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1691 microversion: 2.1 time: 0.351066 Jun 10 18:31:48.955180 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3204/6355] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:48 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1691 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:49.978605 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-51751870-b9d9-4a56-88c5-f487185b1ff1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:49.984192 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-51751870-b9d9-4a56-88c5-f487185b1ff1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:49.987681 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:31:50.012786 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-51751870-b9d9-4a56-88c5-f487185b1ff1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:50.016625 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-51751870-b9d9-4a56-88c5-f487185b1ff1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:50.021556 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-51751870-b9d9-4a56-88c5-f487185b1ff1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:50.022286 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-51751870-b9d9-4a56-88c5-f487185b1ff1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:50.319046 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-51751870-b9d9-4a56-88c5-f487185b1ff1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:50.332014 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-51751870-b9d9-4a56-88c5-f487185b1ff1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1691 microversion: 2.1 time: 0.362085 Jun 10 18:31:50.341636 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3152/6356] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:49 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1691 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:51.350358 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-976eb2d3-5edd-4795-926c-4a04f51f722f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:51.351032 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-976eb2d3-5edd-4795-926c-4a04f51f722f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:51.359243 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-976eb2d3-5edd-4795-926c-4a04f51f722f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:51.359963 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-976eb2d3-5edd-4795-926c-4a04f51f722f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:51.361245 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-976eb2d3-5edd-4795-926c-4a04f51f722f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:51.361915 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-976eb2d3-5edd-4795-926c-4a04f51f722f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:51.563725 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-976eb2d3-5edd-4795-926c-4a04f51f722f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:51.563725 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:31:51.563725 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-976eb2d3-5edd-4795-926c-4a04f51f722f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1696 microversion: 2.1 time: 0.186416 Jun 10 18:31:51.563725 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3205/6357] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:51 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1696 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:52.565044 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1654d798-2dee-4de6-b358-0551bf729c82 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:52.571202 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1654d798-2dee-4de6-b358-0551bf729c82 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:52.599921 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1654d798-2dee-4de6-b358-0551bf729c82 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:52.599921 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1654d798-2dee-4de6-b358-0551bf729c82 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:52.605203 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1654d798-2dee-4de6-b358-0551bf729c82 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:52.606352 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1654d798-2dee-4de6-b358-0551bf729c82 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:53.016568 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1654d798-2dee-4de6-b358-0551bf729c82 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:53.035527 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1654d798-2dee-4de6-b358-0551bf729c82 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1696 microversion: 2.1 time: 0.474088 Jun 10 18:31:53.039725 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3153/6358] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:52 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1696 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:54.055465 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-79306637-1b5c-4af5-90be-c9f3de8e9594 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:54.059871 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-79306637-1b5c-4af5-90be-c9f3de8e9594 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:54.070078 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-79306637-1b5c-4af5-90be-c9f3de8e9594 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:54.073241 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-79306637-1b5c-4af5-90be-c9f3de8e9594 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:54.074297 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-79306637-1b5c-4af5-90be-c9f3de8e9594 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:54.076886 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-79306637-1b5c-4af5-90be-c9f3de8e9594 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:54.428629 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-79306637-1b5c-4af5-90be-c9f3de8e9594 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:54.438299 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-79306637-1b5c-4af5-90be-c9f3de8e9594 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1696 microversion: 2.1 time: 0.387134 Jun 10 18:31:54.448761 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3206/6359] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:54 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1696 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:55.456244 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7945eebf-0ff7-4e82-96aa-0029e6b86a6d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:55.462615 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7945eebf-0ff7-4e82-96aa-0029e6b86a6d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:55.467360 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7945eebf-0ff7-4e82-96aa-0029e6b86a6d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:55.468172 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7945eebf-0ff7-4e82-96aa-0029e6b86a6d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:55.471416 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7945eebf-0ff7-4e82-96aa-0029e6b86a6d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:55.472095 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7945eebf-0ff7-4e82-96aa-0029e6b86a6d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:55.764733 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7945eebf-0ff7-4e82-96aa-0029e6b86a6d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:55.774085 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7945eebf-0ff7-4e82-96aa-0029e6b86a6d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1696 microversion: 2.1 time: 0.321849 Jun 10 18:31:55.784519 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3154/6360] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:55 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1696 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:56.805389 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9fc5bf1c-e342-4d3a-9aa3-26024526c6ac tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:56.807294 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9fc5bf1c-e342-4d3a-9aa3-26024526c6ac tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:56.816221 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9fc5bf1c-e342-4d3a-9aa3-26024526c6ac tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:56.816816 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9fc5bf1c-e342-4d3a-9aa3-26024526c6ac tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:56.817845 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9fc5bf1c-e342-4d3a-9aa3-26024526c6ac tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:56.818622 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9fc5bf1c-e342-4d3a-9aa3-26024526c6ac tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:57.028984 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9fc5bf1c-e342-4d3a-9aa3-26024526c6ac tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:57.040056 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9fc5bf1c-e342-4d3a-9aa3-26024526c6ac tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1696 microversion: 2.1 time: 0.241200 Jun 10 18:31:57.052767 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3207/6361] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:56 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1696 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:58.061630 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-12fbfeea-17b4-4e12-a91a-e51d894432af tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:58.062310 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-12fbfeea-17b4-4e12-a91a-e51d894432af tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:58.076182 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-12fbfeea-17b4-4e12-a91a-e51d894432af tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:58.076663 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-12fbfeea-17b4-4e12-a91a-e51d894432af tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:58.077523 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-12fbfeea-17b4-4e12-a91a-e51d894432af tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:58.077980 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-12fbfeea-17b4-4e12-a91a-e51d894432af tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:58.344390 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-12fbfeea-17b4-4e12-a91a-e51d894432af tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:58.355537 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-12fbfeea-17b4-4e12-a91a-e51d894432af tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1696 microversion: 2.1 time: 0.296790 Jun 10 18:31:58.358758 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3155/6362] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:58 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1696 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:31:59.373641 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-aa114b2a-4391-4780-b8d0-0d616df429c3 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:31:59.374871 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-aa114b2a-4391-4780-b8d0-0d616df429c3 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:31:59.384056 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aa114b2a-4391-4780-b8d0-0d616df429c3 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:59.386087 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aa114b2a-4391-4780-b8d0-0d616df429c3 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:59.387050 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aa114b2a-4391-4780-b8d0-0d616df429c3 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:31:59.387508 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aa114b2a-4391-4780-b8d0-0d616df429c3 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:31:59.618306 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-aa114b2a-4391-4780-b8d0-0d616df429c3 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:31:59.635920 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-aa114b2a-4391-4780-b8d0-0d616df429c3 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1696 microversion: 2.1 time: 0.258733 Jun 10 18:31:59.635920 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3208/6363] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:31:59 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1696 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:32:00.644694 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4503d4a3-e5ef-429c-b1ef-65a724c993ae tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:00.645327 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4503d4a3-e5ef-429c-b1ef-65a724c993ae tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:00.657572 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4503d4a3-e5ef-429c-b1ef-65a724c993ae tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:00.658031 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4503d4a3-e5ef-429c-b1ef-65a724c993ae tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:00.662925 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4503d4a3-e5ef-429c-b1ef-65a724c993ae tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:00.664468 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4503d4a3-e5ef-429c-b1ef-65a724c993ae tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:00.938638 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4503d4a3-e5ef-429c-b1ef-65a724c993ae tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:00.951547 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4503d4a3-e5ef-429c-b1ef-65a724c993ae tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1696 microversion: 2.1 time: 0.306536 Jun 10 18:32:00.964373 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3156/6364] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:00 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1696 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:32:01.971979 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1aa887b3-84c2-483f-b7a9-d3de6154a54b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:01.972583 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1aa887b3-84c2-483f-b7a9-d3de6154a54b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:01.979805 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1aa887b3-84c2-483f-b7a9-d3de6154a54b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:01.980282 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1aa887b3-84c2-483f-b7a9-d3de6154a54b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:01.981106 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1aa887b3-84c2-483f-b7a9-d3de6154a54b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:01.981551 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1aa887b3-84c2-483f-b7a9-d3de6154a54b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:02.611189 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1aa887b3-84c2-483f-b7a9-d3de6154a54b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:02.619654 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1aa887b3-84c2-483f-b7a9-d3de6154a54b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1696 microversion: 2.1 time: 0.651109 Jun 10 18:32:02.620289 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3209/6365] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:01 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1696 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:32:03.637072 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a613e605-105a-42f0-8660-402084cb7f4e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:03.637685 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a613e605-105a-42f0-8660-402084cb7f4e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:03.645112 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a613e605-105a-42f0-8660-402084cb7f4e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:03.645572 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a613e605-105a-42f0-8660-402084cb7f4e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:03.646418 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a613e605-105a-42f0-8660-402084cb7f4e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:03.646863 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a613e605-105a-42f0-8660-402084cb7f4e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:03.651395 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:32:03.828053 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a613e605-105a-42f0-8660-402084cb7f4e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:03.836381 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a613e605-105a-42f0-8660-402084cb7f4e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1695 microversion: 2.1 time: 0.204129 Jun 10 18:32:03.846502 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3157/6366] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:03 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1695 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:32:03.974203 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-fff5d31f-3ad9-4c08-877d-ecf12d93e7ea req-66f64431-0c06-423f-8874-1e39a51fef4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c36e064f-7f56-4f6b-81bf-45b449eda791", "name": "network-vif-unplugged", "status": "completed", "tag": "e152d0f1-e50b-4888-9524-a46fb6cc5899"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:32:04.002140 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-fff5d31f-3ad9-4c08-877d-ecf12d93e7ea req-66f64431-0c06-423f-8874-1e39a51fef4f service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:04.002696 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-fff5d31f-3ad9-4c08-877d-ecf12d93e7ea req-66f64431-0c06-423f-8874-1e39a51fef4f service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:04.035226 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-fff5d31f-3ad9-4c08-877d-ecf12d93e7ea req-66f64431-0c06-423f-8874-1e39a51fef4f service nova] Creating event network-vif-unplugged:e152d0f1-e50b-4888-9524-a46fb6cc5899 for instance c36e064f-7f56-4f6b-81bf-45b449eda791 on chh2-master-2 Jun 10 18:32:04.057926 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [req-fff5d31f-3ad9-4c08-877d-ecf12d93e7ea req-66f64431-0c06-423f-8874-1e39a51fef4f service nova] Instance c36e064f-7f56-4f6b-81bf-45b449eda791 is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126594) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 18:32:04.074043 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-fff5d31f-3ad9-4c08-877d-ecf12d93e7ea req-66f64431-0c06-423f-8874-1e39a51fef4f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103624 Jun 10 18:32:04.075124 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3210/6367] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:32:04.856210 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d3d65edc-8eb4-4ab9-bc9f-d664fb18eb6f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:04.856864 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d3d65edc-8eb4-4ab9-bc9f-d664fb18eb6f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:04.869885 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d3d65edc-8eb4-4ab9-bc9f-d664fb18eb6f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:04.872648 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d3d65edc-8eb4-4ab9-bc9f-d664fb18eb6f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:04.881329 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d3d65edc-8eb4-4ab9-bc9f-d664fb18eb6f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:04.882056 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d3d65edc-8eb4-4ab9-bc9f-d664fb18eb6f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:05.186603 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d3d65edc-8eb4-4ab9-bc9f-d664fb18eb6f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:05.210443 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d3d65edc-8eb4-4ab9-bc9f-d664fb18eb6f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1695 microversion: 2.1 time: 0.352185 Jun 10 18:32:05.212201 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3158/6368] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:04 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1695 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:32:06.095277 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-3963b0c0-f16b-4423-b466-e06062c7f865 req-4601cc77-6ed5-466e-a9e7-16539b01ad4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c36e064f-7f56-4f6b-81bf-45b449eda791", "tag": "e152d0f1-e50b-4888-9524-a46fb6cc5899"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:32:06.104512 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-3963b0c0-f16b-4423-b466-e06062c7f865 req-4601cc77-6ed5-466e-a9e7-16539b01ad4e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:06.105552 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-3963b0c0-f16b-4423-b466-e06062c7f865 req-4601cc77-6ed5-466e-a9e7-16539b01ad4e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:06.117275 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-3963b0c0-f16b-4423-b466-e06062c7f865 req-4601cc77-6ed5-466e-a9e7-16539b01ad4e service nova] Creating event network-changed:e152d0f1-e50b-4888-9524-a46fb6cc5899 for instance c36e064f-7f56-4f6b-81bf-45b449eda791 on chh2-master-2 Jun 10 18:32:06.125560 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [req-3963b0c0-f16b-4423-b466-e06062c7f865 req-4601cc77-6ed5-466e-a9e7-16539b01ad4e service nova] Instance c36e064f-7f56-4f6b-81bf-45b449eda791 is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126594) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 18:32:06.138027 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-3963b0c0-f16b-4423-b466-e06062c7f865 req-4601cc77-6ed5-466e-a9e7-16539b01ad4e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047571 Jun 10 18:32:06.141651 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3211/6369] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:32:06.242180 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-87f2cba1-68a8-4999-810c-9387d1f52216 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:06.242800 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-87f2cba1-68a8-4999-810c-9387d1f52216 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:06.252789 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-87f2cba1-68a8-4999-810c-9387d1f52216 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:06.253590 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-87f2cba1-68a8-4999-810c-9387d1f52216 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:06.256849 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-87f2cba1-68a8-4999-810c-9387d1f52216 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:06.257521 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-87f2cba1-68a8-4999-810c-9387d1f52216 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:06.698428 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-87f2cba1-68a8-4999-810c-9387d1f52216 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:06.710189 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-87f2cba1-68a8-4999-810c-9387d1f52216 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1695 microversion: 2.1 time: 0.469954 Jun 10 18:32:06.710189 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3159/6370] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:06 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1695 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:32:06.753555 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-abf2ff09-7e69-4132-8df3-9c912fcb96bc tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81a4b2cb-2dec-40de-8300-6f083f756e2b", "device": "/dev/sdb"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:32:06.754791 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-abf2ff09-7e69-4132-8df3-9c912fcb96bc tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] [instance: ecff1e1f-13e9-4a8c-96e0-4f423a31d69e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:06.761402 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-abf2ff09-7e69-4132-8df3-9c912fcb96bc tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:06.762131 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-abf2ff09-7e69-4132-8df3-9c912fcb96bc tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:06.762950 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-abf2ff09-7e69-4132-8df3-9c912fcb96bc tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:06.763397 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-abf2ff09-7e69-4132-8df3-9c912fcb96bc tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:07.658154 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-abf2ff09-7e69-4132-8df3-9c912fcb96bc tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] 10.222.0.35 "POST /compute/v2.1/servers/ecff1e1f-13e9-4a8c-96e0-4f423a31d69e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.908845 Jun 10 18:32:07.666368 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3212/6371] 10.222.0.35 () {60 vars in 1322 bytes} [Fri Jun 10 18:32:06 2022] POST /compute/v2.1/servers/ecff1e1f-13e9-4a8c-96e0-4f423a31d69e/os-volume_attachments => generated 194 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:32:07.725985 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-121a05b5-1978-41d4-bf0f-77843e2d5769 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:07.726597 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-121a05b5-1978-41d4-bf0f-77843e2d5769 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:07.735993 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-121a05b5-1978-41d4-bf0f-77843e2d5769 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:07.735993 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-121a05b5-1978-41d4-bf0f-77843e2d5769 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:07.735993 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-121a05b5-1978-41d4-bf0f-77843e2d5769 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:07.735993 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-121a05b5-1978-41d4-bf0f-77843e2d5769 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:07.899571 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-121a05b5-1978-41d4-bf0f-77843e2d5769 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:07.916235 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-121a05b5-1978-41d4-bf0f-77843e2d5769 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1693 microversion: 2.1 time: 0.192143 Jun 10 18:32:07.917252 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3160/6372] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:07 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1693 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:32:08.938777 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-da0a1b75-e5a2-4d50-94d6-4b89aac858ac tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:08.941169 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-da0a1b75-e5a2-4d50-94d6-4b89aac858ac tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:08.954306 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-da0a1b75-e5a2-4d50-94d6-4b89aac858ac tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:08.955528 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-da0a1b75-e5a2-4d50-94d6-4b89aac858ac tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:08.957082 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-da0a1b75-e5a2-4d50-94d6-4b89aac858ac tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:08.958390 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-da0a1b75-e5a2-4d50-94d6-4b89aac858ac tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:09.160496 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-da0a1b75-e5a2-4d50-94d6-4b89aac858ac tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:09.171443 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-da0a1b75-e5a2-4d50-94d6-4b89aac858ac tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1693 microversion: 2.1 time: 0.240461 Jun 10 18:32:09.182869 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3213/6373] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:08 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1693 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:32:10.191395 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-775a198d-dbf4-43fa-8070-7f20cbb0d27c tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:10.192028 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-775a198d-dbf4-43fa-8070-7f20cbb0d27c tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:10.203767 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-775a198d-dbf4-43fa-8070-7f20cbb0d27c tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:10.204161 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-775a198d-dbf4-43fa-8070-7f20cbb0d27c tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:10.211052 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-775a198d-dbf4-43fa-8070-7f20cbb0d27c tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:10.212201 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-775a198d-dbf4-43fa-8070-7f20cbb0d27c tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:10.506661 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-775a198d-dbf4-43fa-8070-7f20cbb0d27c tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:10.515326 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-775a198d-dbf4-43fa-8070-7f20cbb0d27c tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1690 microversion: 2.1 time: 0.330000 Jun 10 18:32:10.516028 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3161/6374] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:10 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1690 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:32:10.533860 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-10db0807-2e8e-47ac-af6f-e2199d6388fc tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:32:10.535003 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-10db0807-2e8e-47ac-af6f-e2199d6388fc tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:10.542233 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-10db0807-2e8e-47ac-af6f-e2199d6388fc tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:10.542948 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-10db0807-2e8e-47ac-af6f-e2199d6388fc tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:10.543978 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-10db0807-2e8e-47ac-af6f-e2199d6388fc tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:10.544701 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-10db0807-2e8e-47ac-af6f-e2199d6388fc tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:10.778668 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-10db0807-2e8e-47ac-af6f-e2199d6388fc tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "POST /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791/action" status: 204 len: 0 microversion: 2.1 time: 0.249342 Jun 10 18:32:10.779176 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3214/6375] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:32:10 2022] POST /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791/action => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:32:10.787661 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-344bfab3-3913-4185-821d-00069c8e417f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:10.788283 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-344bfab3-3913-4185-821d-00069c8e417f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:10.803926 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-344bfab3-3913-4185-821d-00069c8e417f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:10.803926 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-344bfab3-3913-4185-821d-00069c8e417f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:10.804416 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-344bfab3-3913-4185-821d-00069c8e417f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:10.804911 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-344bfab3-3913-4185-821d-00069c8e417f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:11.229309 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-344bfab3-3913-4185-821d-00069c8e417f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:11.248267 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-344bfab3-3913-4185-821d-00069c8e417f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1690 microversion: 2.1 time: 0.464460 Jun 10 18:32:11.250167 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3162/6376] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:10 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1690 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:32:12.267123 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-3ec5f240-05c6-4a0d-a6d8-30cdca370536 req-eb652080-dbc6-4737-a2bd-0a50f87023ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c36e064f-7f56-4f6b-81bf-45b449eda791", "name": "network-vif-plugged", "status": "completed", "tag": "e152d0f1-e50b-4888-9524-a46fb6cc5899"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:32:12.274068 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3137ec3e-bf40-4f53-8c4e-b5ea2a22a0a9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:12.276122 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3137ec3e-bf40-4f53-8c4e-b5ea2a22a0a9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:12.284556 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-3ec5f240-05c6-4a0d-a6d8-30cdca370536 req-eb652080-dbc6-4737-a2bd-0a50f87023ad service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:12.288193 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-3ec5f240-05c6-4a0d-a6d8-30cdca370536 req-eb652080-dbc6-4737-a2bd-0a50f87023ad service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:12.291201 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3137ec3e-bf40-4f53-8c4e-b5ea2a22a0a9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:12.292197 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3137ec3e-bf40-4f53-8c4e-b5ea2a22a0a9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:12.293313 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3137ec3e-bf40-4f53-8c4e-b5ea2a22a0a9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:12.294161 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3137ec3e-bf40-4f53-8c4e-b5ea2a22a0a9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:12.326714 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-3ec5f240-05c6-4a0d-a6d8-30cdca370536 req-eb652080-dbc6-4737-a2bd-0a50f87023ad service nova] Creating event network-vif-plugged:e152d0f1-e50b-4888-9524-a46fb6cc5899 for instance c36e064f-7f56-4f6b-81bf-45b449eda791 on chh2-master-2 Jun 10 18:32:12.340399 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [req-3ec5f240-05c6-4a0d-a6d8-30cdca370536 req-eb652080-dbc6-4737-a2bd-0a50f87023ad service nova] Instance c36e064f-7f56-4f6b-81bf-45b449eda791 is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126594) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 18:32:12.361304 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-3ec5f240-05c6-4a0d-a6d8-30cdca370536 req-eb652080-dbc6-4737-a2bd-0a50f87023ad service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097874 Jun 10 18:32:12.370362 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3215/6377] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:32:12.538826 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3137ec3e-bf40-4f53-8c4e-b5ea2a22a0a9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:12.547253 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3137ec3e-bf40-4f53-8c4e-b5ea2a22a0a9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1690 microversion: 2.1 time: 0.277885 Jun 10 18:32:12.547935 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3163/6378] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:12 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1690 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:32:13.566979 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f1493e2a-5378-4c3a-8129-ee8fdea7378e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:13.568523 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f1493e2a-5378-4c3a-8129-ee8fdea7378e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:13.576220 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f1493e2a-5378-4c3a-8129-ee8fdea7378e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:13.576799 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f1493e2a-5378-4c3a-8129-ee8fdea7378e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:13.577599 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f1493e2a-5378-4c3a-8129-ee8fdea7378e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:13.578052 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f1493e2a-5378-4c3a-8129-ee8fdea7378e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:13.905608 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f1493e2a-5378-4c3a-8129-ee8fdea7378e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:13.917556 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f1493e2a-5378-4c3a-8129-ee8fdea7378e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1682 microversion: 2.1 time: 0.354975 Jun 10 18:32:13.930350 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3216/6379] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:13 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1682 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:32:21.549433 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b3c510ae-4aa0-4567-9bd7-d1d32c936bd8 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Action: 'create', calling method: .version_select at 0x7f77b3f089d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-666625350", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNS/HaTvp7/rcmrI/AHwgX4RShMk/zNxKmRLBRBqnuiYQMT7nxgDgzX5SDYL35qEBm8CoyTH5gd5NhcRfedNCMsOR+oydDkcyg39MfJ81i+C41uK80zWsCcUlaQDBflLhw=="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:32:21.561527 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=24 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:32:21.594897 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-b3c510ae-4aa0-4567-9bd7-d1d32c936bd8 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Getting quotas for project a52d669c461c4bb38e30dbd8ba0bd0a2. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:32:21.608039 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-b3c510ae-4aa0-4567-9bd7-d1d32c936bd8 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Getting quotas for user cb110e0802174e1fb00d874f9e047b01 and project a52d669c461c4bb38e30dbd8ba0bd0a2. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:32:21.719567 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b3c510ae-4aa0-4567-9bd7-d1d32c936bd8 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.172205 Jun 10 18:32:21.719567 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3164/6380] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 18:32:21 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:32:25.831298 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-747e17c8-cbd9-4fc4-8c03-5f0c8b428b3c tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-930389263", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "a2621d7e-62d1-4fd0-89cb-5f4db6bdd5e7"}], "key_name": "tempest-TestNetworkBasicOps-666625350", "security_groups": [{"name": "tempest-secgroup-smoke-1239597749"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:32:25.852267 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=31 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:32:25.857421 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:32:26.040372 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-747e17c8-cbd9-4fc4-8c03-5f0c8b428b3c tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] validate_networks() for [('a2621d7e-62d1-4fd0-89cb-5f4db6bdd5e7', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:32:26.624346 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-747e17c8-cbd9-4fc4-8c03-5f0c8b428b3c tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:32:26.626928 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-747e17c8-cbd9-4fc4-8c03-5f0c8b428b3c tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:32:26.626928 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-747e17c8-cbd9-4fc4-8c03-5f0c8b428b3c tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:32:26.626928 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-747e17c8-cbd9-4fc4-8c03-5f0c8b428b3c tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:32:26.626928 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-747e17c8-cbd9-4fc4-8c03-5f0c8b428b3c tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:32:26.634992 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-747e17c8-cbd9-4fc4-8c03-5f0c8b428b3c tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:26.635483 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-747e17c8-cbd9-4fc4-8c03-5f0c8b428b3c tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:26.636333 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-747e17c8-cbd9-4fc4-8c03-5f0c8b428b3c tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:26.636734 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-747e17c8-cbd9-4fc4-8c03-5f0c8b428b3c tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:26.659564 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-747e17c8-cbd9-4fc4-8c03-5f0c8b428b3c tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Getting quotas for project a52d669c461c4bb38e30dbd8ba0bd0a2. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:32:26.665459 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-747e17c8-cbd9-4fc4-8c03-5f0c8b428b3c tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Getting quotas for user cb110e0802174e1fb00d874f9e047b01 and project a52d669c461c4bb38e30dbd8ba0bd0a2. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:32:26.678489 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-747e17c8-cbd9-4fc4-8c03-5f0c8b428b3c tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:32:26.681418 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-747e17c8-cbd9-4fc4-8c03-5f0c8b428b3c tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 66557f04-2de0-41eb-b4a5-23bcbef9865f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:32:26.896551 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-747e17c8-cbd9-4fc4-8c03-5f0c8b428b3c tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.069526 Jun 10 18:32:26.898668 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3217/6381] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:32:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 1074 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:32:26.910225 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d74f1ceb-1000-4535-ae20-1322552783da tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:26.910849 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d74f1ceb-1000-4535-ae20-1322552783da tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 66557f04-2de0-41eb-b4a5-23bcbef9865f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:26.934889 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=41 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:32:27.021525 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d74f1ceb-1000-4535-ae20-1322552783da tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:27.045163 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d74f1ceb-1000-4535-ae20-1322552783da tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/66557f04-2de0-41eb-b4a5-23bcbef9865f" status: 200 len: 1247 microversion: 2.1 time: 0.139546 Jun 10 18:32:27.055670 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3165/6382] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:26 2022] GET /compute/v2.1/servers/66557f04-2de0-41eb-b4a5-23bcbef9865f => generated 1247 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:32:28.063543 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d01dbe6b-3497-4964-a000-817928760a92 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:28.064168 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d01dbe6b-3497-4964-a000-817928760a92 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 66557f04-2de0-41eb-b4a5-23bcbef9865f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:28.150037 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d01dbe6b-3497-4964-a000-817928760a92 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:28.169860 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d01dbe6b-3497-4964-a000-817928760a92 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/66557f04-2de0-41eb-b4a5-23bcbef9865f" status: 200 len: 1247 microversion: 2.1 time: 0.110614 Jun 10 18:32:28.171257 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3218/6383] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:28 2022] GET /compute/v2.1/servers/66557f04-2de0-41eb-b4a5-23bcbef9865f => generated 1247 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:32:29.193385 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ec99edbd-73c2-4006-b48f-6bcd7b3ec4a9 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:29.194066 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ec99edbd-73c2-4006-b48f-6bcd7b3ec4a9 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 66557f04-2de0-41eb-b4a5-23bcbef9865f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:29.210543 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ec99edbd-73c2-4006-b48f-6bcd7b3ec4a9 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:29.211294 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ec99edbd-73c2-4006-b48f-6bcd7b3ec4a9 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:29.212278 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ec99edbd-73c2-4006-b48f-6bcd7b3ec4a9 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:29.212919 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ec99edbd-73c2-4006-b48f-6bcd7b3ec4a9 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:29.381454 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ec99edbd-73c2-4006-b48f-6bcd7b3ec4a9 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:29.403079 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ec99edbd-73c2-4006-b48f-6bcd7b3ec4a9 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/66557f04-2de0-41eb-b4a5-23bcbef9865f" status: 200 len: 1299 microversion: 2.1 time: 0.208505 Jun 10 18:32:29.405315 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3166/6384] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:29 2022] GET /compute/v2.1/servers/66557f04-2de0-41eb-b4a5-23bcbef9865f => generated 1299 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:32:30.421669 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-990b73fd-023c-4b6a-aeed-fe6cc30a2124 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:30.422979 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-990b73fd-023c-4b6a-aeed-fe6cc30a2124 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 66557f04-2de0-41eb-b4a5-23bcbef9865f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:30.431721 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-990b73fd-023c-4b6a-aeed-fe6cc30a2124 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:30.432938 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-990b73fd-023c-4b6a-aeed-fe6cc30a2124 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:30.433744 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-990b73fd-023c-4b6a-aeed-fe6cc30a2124 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:30.438910 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-990b73fd-023c-4b6a-aeed-fe6cc30a2124 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:30.511883 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-990b73fd-023c-4b6a-aeed-fe6cc30a2124 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:30.521818 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-990b73fd-023c-4b6a-aeed-fe6cc30a2124 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/66557f04-2de0-41eb-b4a5-23bcbef9865f" status: 200 len: 1305 microversion: 2.1 time: 0.103960 Jun 10 18:32:30.522671 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3219/6385] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:30 2022] GET /compute/v2.1/servers/66557f04-2de0-41eb-b4a5-23bcbef9865f => generated 1305 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:32:31.539226 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e05719b9-faf7-4f7c-bfb0-ec7b7f18852e tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:31.540603 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e05719b9-faf7-4f7c-bfb0-ec7b7f18852e tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 66557f04-2de0-41eb-b4a5-23bcbef9865f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:31.549350 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e05719b9-faf7-4f7c-bfb0-ec7b7f18852e tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:31.550063 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e05719b9-faf7-4f7c-bfb0-ec7b7f18852e tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:31.551955 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e05719b9-faf7-4f7c-bfb0-ec7b7f18852e tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:31.552734 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e05719b9-faf7-4f7c-bfb0-ec7b7f18852e tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:32.148103 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e05719b9-faf7-4f7c-bfb0-ec7b7f18852e tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:32.157239 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e05719b9-faf7-4f7c-bfb0-ec7b7f18852e tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/66557f04-2de0-41eb-b4a5-23bcbef9865f" status: 200 len: 1373 microversion: 2.1 time: 0.621790 Jun 10 18:32:32.159933 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3167/6386] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:31 2022] GET /compute/v2.1/servers/66557f04-2de0-41eb-b4a5-23bcbef9865f => generated 1373 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:32:33.179073 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-0d76fd1a-72a7-43c4-8121-cb129df15952 req-2346a715-9e97-40c4-9fb5-8b6e67c4ee84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66557f04-2de0-41eb-b4a5-23bcbef9865f", "tag": "27415922-6bb8-4ff4-ac7d-20ccbf66eefd"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:32:33.185305 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3958977f-50da-461b-9338-e8962600c43b tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:33.188717 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3958977f-50da-461b-9338-e8962600c43b tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 66557f04-2de0-41eb-b4a5-23bcbef9865f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:33.195330 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3958977f-50da-461b-9338-e8962600c43b tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:33.195672 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3958977f-50da-461b-9338-e8962600c43b tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:33.197056 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3958977f-50da-461b-9338-e8962600c43b tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:33.197511 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3958977f-50da-461b-9338-e8962600c43b tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:33.210332 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-0d76fd1a-72a7-43c4-8121-cb129df15952 req-2346a715-9e97-40c4-9fb5-8b6e67c4ee84 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:33.213416 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-0d76fd1a-72a7-43c4-8121-cb129df15952 req-2346a715-9e97-40c4-9fb5-8b6e67c4ee84 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:33.276756 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-0d76fd1a-72a7-43c4-8121-cb129df15952 req-2346a715-9e97-40c4-9fb5-8b6e67c4ee84 service nova] Creating event network-changed:27415922-6bb8-4ff4-ac7d-20ccbf66eefd for instance 66557f04-2de0-41eb-b4a5-23bcbef9865f on chh1-master-2 Jun 10 18:32:33.290380 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-0d76fd1a-72a7-43c4-8121-cb129df15952 req-2346a715-9e97-40c4-9fb5-8b6e67c4ee84 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113184 Jun 10 18:32:33.293619 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3220/6387] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:32:33.752031 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3958977f-50da-461b-9338-e8962600c43b tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:33.763180 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3958977f-50da-461b-9338-e8962600c43b tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/66557f04-2de0-41eb-b4a5-23bcbef9865f" status: 200 len: 1373 microversion: 2.1 time: 0.580085 Jun 10 18:32:33.771507 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3168/6388] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:33 2022] GET /compute/v2.1/servers/66557f04-2de0-41eb-b4a5-23bcbef9865f => generated 1373 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:32:34.780977 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ca48c01f-daef-46c2-8c27-aee1a7efafd8 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:34.781833 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ca48c01f-daef-46c2-8c27-aee1a7efafd8 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 66557f04-2de0-41eb-b4a5-23bcbef9865f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:34.795823 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ca48c01f-daef-46c2-8c27-aee1a7efafd8 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:34.796291 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ca48c01f-daef-46c2-8c27-aee1a7efafd8 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:34.797112 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ca48c01f-daef-46c2-8c27-aee1a7efafd8 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:34.797551 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ca48c01f-daef-46c2-8c27-aee1a7efafd8 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:34.991927 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ca48c01f-daef-46c2-8c27-aee1a7efafd8 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:35.003854 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ca48c01f-daef-46c2-8c27-aee1a7efafd8 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/66557f04-2de0-41eb-b4a5-23bcbef9865f" status: 200 len: 1373 microversion: 2.1 time: 0.227953 Jun 10 18:32:35.005035 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3221/6389] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:34 2022] GET /compute/v2.1/servers/66557f04-2de0-41eb-b4a5-23bcbef9865f => generated 1373 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:32:35.071842 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a786020c-5064-4a5a-8b99-ab0f5c473858 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-239638256", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "7589893d-0a2c-4f72-ac54-74153ca6360f"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:32:35.148566 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-a786020c-5064-4a5a-8b99-ab0f5c473858 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] validate_networks() for [('7589893d-0a2c-4f72-ac54-74153ca6360f', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:32:35.911225 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-a786020c-5064-4a5a-8b99-ab0f5c473858 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:32:35.911648 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-a786020c-5064-4a5a-8b99-ab0f5c473858 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:32:35.912339 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-a786020c-5064-4a5a-8b99-ab0f5c473858 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:32:35.912766 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-a786020c-5064-4a5a-8b99-ab0f5c473858 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:32:35.913184 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-a786020c-5064-4a5a-8b99-ab0f5c473858 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:32:35.929948 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a786020c-5064-4a5a-8b99-ab0f5c473858 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:35.930764 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a786020c-5064-4a5a-8b99-ab0f5c473858 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:35.931837 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a786020c-5064-4a5a-8b99-ab0f5c473858 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:35.932540 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a786020c-5064-4a5a-8b99-ab0f5c473858 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:35.968246 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-a786020c-5064-4a5a-8b99-ab0f5c473858 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Getting quotas for project 4f7224d6e7eb4188b58412209e8d3c40. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:32:35.997078 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-a786020c-5064-4a5a-8b99-ab0f5c473858 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Getting quotas for user 20faf80443114211af1c7ea53724dd7d and project 4f7224d6e7eb4188b58412209e8d3c40. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:32:36.022311 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-87f41c57-1ace-4a54-b13e-65cddbc5077b tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:36.026292 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-87f41c57-1ace-4a54-b13e-65cddbc5077b tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 66557f04-2de0-41eb-b4a5-23bcbef9865f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:36.039429 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-87f41c57-1ace-4a54-b13e-65cddbc5077b tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:36.040910 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-87f41c57-1ace-4a54-b13e-65cddbc5077b tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:36.050914 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a786020c-5064-4a5a-8b99-ab0f5c473858 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:32:36.051523 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-87f41c57-1ace-4a54-b13e-65cddbc5077b tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:36.052240 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-87f41c57-1ace-4a54-b13e-65cddbc5077b tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:36.061674 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a786020c-5064-4a5a-8b99-ab0f5c473858 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] [instance: 0f203cb7-5930-44a8-83f0-075144d98aba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:32:36.274049 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a786020c-5064-4a5a-8b99-ab0f5c473858 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.441749 Jun 10 18:32:36.282016 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3169/6390] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:32:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1447 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:32:36.335939 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-15697a94-e2da-4c23-9750-73114ba2dc8b tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:36.337426 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-15697a94-e2da-4c23-9750-73114ba2dc8b tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] [instance: 0f203cb7-5930-44a8-83f0-075144d98aba] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:36.567290 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-15697a94-e2da-4c23-9750-73114ba2dc8b tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20faf80443114211af1c7ea53724dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7224d6e7eb4188b58412209e8d3c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:36.583545 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-15697a94-e2da-4c23-9750-73114ba2dc8b tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] 10.222.0.35 "GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba" status: 200 len: 1214 microversion: 2.1 time: 0.292292 Jun 10 18:32:36.589458 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-87f41c57-1ace-4a54-b13e-65cddbc5077b tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:36.591710 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3170/6391] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:36 2022] GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba => generated 1214 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:32:36.601810 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-87f41c57-1ace-4a54-b13e-65cddbc5077b tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/66557f04-2de0-41eb-b4a5-23bcbef9865f" status: 200 len: 1373 microversion: 2.1 time: 0.584157 Jun 10 18:32:36.604184 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3222/6392] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:36 2022] GET /compute/v2.1/servers/66557f04-2de0-41eb-b4a5-23bcbef9865f => generated 1373 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:32:37.605930 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9bca01d0-6d8c-455a-903d-689b8a76f028 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:37.608298 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9bca01d0-6d8c-455a-903d-689b8a76f028 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] [instance: 0f203cb7-5930-44a8-83f0-075144d98aba] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:37.620574 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8727a57d-a1ab-4891-9835-6cdeb543bf9a tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:37.622716 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8727a57d-a1ab-4891-9835-6cdeb543bf9a tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 66557f04-2de0-41eb-b4a5-23bcbef9865f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:37.638839 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:32:37.646733 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8727a57d-a1ab-4891-9835-6cdeb543bf9a tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:37.647125 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9bca01d0-6d8c-455a-903d-689b8a76f028 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:37.648924 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9bca01d0-6d8c-455a-903d-689b8a76f028 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:37.651222 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8727a57d-a1ab-4891-9835-6cdeb543bf9a tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:37.651792 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9bca01d0-6d8c-455a-903d-689b8a76f028 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:37.653126 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9bca01d0-6d8c-455a-903d-689b8a76f028 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:37.655524 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8727a57d-a1ab-4891-9835-6cdeb543bf9a tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:37.656265 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8727a57d-a1ab-4891-9835-6cdeb543bf9a tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:37.875744 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9bca01d0-6d8c-455a-903d-689b8a76f028 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20faf80443114211af1c7ea53724dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7224d6e7eb4188b58412209e8d3c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:37.887057 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9bca01d0-6d8c-455a-903d-689b8a76f028 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] 10.222.0.35 "GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba" status: 200 len: 1218 microversion: 2.1 time: 0.289723 Jun 10 18:32:37.892982 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3171/6393] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:37 2022] GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba => generated 1218 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:32:38.003147 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8727a57d-a1ab-4891-9835-6cdeb543bf9a tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:38.020437 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8727a57d-a1ab-4891-9835-6cdeb543bf9a tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/66557f04-2de0-41eb-b4a5-23bcbef9865f" status: 200 len: 1373 microversion: 2.1 time: 0.405490 Jun 10 18:32:38.022113 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3223/6394] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:37 2022] GET /compute/v2.1/servers/66557f04-2de0-41eb-b4a5-23bcbef9865f => generated 1373 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:32:38.905466 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1ce6a22c-fc7f-494a-b5aa-88c4ed644053 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:38.906134 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1ce6a22c-fc7f-494a-b5aa-88c4ed644053 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] [instance: 0f203cb7-5930-44a8-83f0-075144d98aba] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:38.925641 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1ce6a22c-fc7f-494a-b5aa-88c4ed644053 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:38.930968 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1ce6a22c-fc7f-494a-b5aa-88c4ed644053 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:38.934099 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1ce6a22c-fc7f-494a-b5aa-88c4ed644053 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:38.934099 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1ce6a22c-fc7f-494a-b5aa-88c4ed644053 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:39.041895 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1a584e75-c22d-463f-a42d-ec3f94a9c7cd tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:39.043295 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1a584e75-c22d-463f-a42d-ec3f94a9c7cd tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 66557f04-2de0-41eb-b4a5-23bcbef9865f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:39.063821 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=8 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:32:39.076290 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1a584e75-c22d-463f-a42d-ec3f94a9c7cd tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:39.076919 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1a584e75-c22d-463f-a42d-ec3f94a9c7cd tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:39.077854 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1a584e75-c22d-463f-a42d-ec3f94a9c7cd tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:39.080913 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1a584e75-c22d-463f-a42d-ec3f94a9c7cd tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:39.137394 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1ce6a22c-fc7f-494a-b5aa-88c4ed644053 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20faf80443114211af1c7ea53724dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7224d6e7eb4188b58412209e8d3c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:39.150244 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1ce6a22c-fc7f-494a-b5aa-88c4ed644053 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] 10.222.0.35 "GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba" status: 200 len: 1274 microversion: 2.1 time: 0.250120 Jun 10 18:32:39.162027 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3172/6395] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:38 2022] GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba => generated 1274 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:32:39.168256 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9c9a2c41-14ea-4048-85d4-dae93c32a258 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:39.169776 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9c9a2c41-14ea-4048-85d4-dae93c32a258 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:39.176980 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9c9a2c41-14ea-4048-85d4-dae93c32a258 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:39.177763 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9c9a2c41-14ea-4048-85d4-dae93c32a258 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:39.178816 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9c9a2c41-14ea-4048-85d4-dae93c32a258 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:39.179506 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9c9a2c41-14ea-4048-85d4-dae93c32a258 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:39.220494 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9c9a2c41-14ea-4048-85d4-dae93c32a258 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056846 Jun 10 18:32:39.222027 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3173/6396] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:32:39 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:32:39.332527 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-64f0cfcb-6362-4cb3-9b72-974710c343c0 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:39.333150 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-64f0cfcb-6362-4cb3-9b72-974710c343c0 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:39.353357 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-64f0cfcb-6362-4cb3-9b72-974710c343c0 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:39.354159 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-64f0cfcb-6362-4cb3-9b72-974710c343c0 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:39.355994 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-64f0cfcb-6362-4cb3-9b72-974710c343c0 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:39.357913 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-64f0cfcb-6362-4cb3-9b72-974710c343c0 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:39.457484 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-64f0cfcb-6362-4cb3-9b72-974710c343c0 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:32:39.528493 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1a584e75-c22d-463f-a42d-ec3f94a9c7cd tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:39.536080 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1a584e75-c22d-463f-a42d-ec3f94a9c7cd tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/66557f04-2de0-41eb-b4a5-23bcbef9865f" status: 200 len: 1373 microversion: 2.1 time: 0.500697 Jun 10 18:32:39.544853 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3224/6397] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:39 2022] GET /compute/v2.1/servers/66557f04-2de0-41eb-b4a5-23bcbef9865f => generated 1373 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:32:39.563331 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-0de3963a-c8fe-4ee2-ae69-6d86d7f6c904 req-ad0ba28c-de79-416b-836c-bf97c2d64e35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66557f04-2de0-41eb-b4a5-23bcbef9865f", "name": "network-vif-plugged", "status": "completed", "tag": "27415922-6bb8-4ff4-ac7d-20ccbf66eefd"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:32:39.574018 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-0de3963a-c8fe-4ee2-ae69-6d86d7f6c904 req-ad0ba28c-de79-416b-836c-bf97c2d64e35 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:39.574930 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-0de3963a-c8fe-4ee2-ae69-6d86d7f6c904 req-ad0ba28c-de79-416b-836c-bf97c2d64e35 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:39.598807 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-0de3963a-c8fe-4ee2-ae69-6d86d7f6c904 req-ad0ba28c-de79-416b-836c-bf97c2d64e35 service nova] Creating event network-vif-plugged:27415922-6bb8-4ff4-ac7d-20ccbf66eefd for instance 66557f04-2de0-41eb-b4a5-23bcbef9865f on chh1-master-2 Jun 10 18:32:39.610316 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-0de3963a-c8fe-4ee2-ae69-6d86d7f6c904 req-ad0ba28c-de79-416b-836c-bf97c2d64e35 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051927 Jun 10 18:32:39.611376 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3225/6398] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:32:39.875872 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-64f0cfcb-6362-4cb3-9b72-974710c343c0 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "DELETE /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 204 len: 0 microversion: 2.1 time: 0.547325 Jun 10 18:32:39.877547 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3174/6399] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:32:39 2022] DELETE /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 0 bytes in 550 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 18:32:39.889090 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ce42830a-ad09-498b-bb0b-92b18d98ebb6 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:39.890985 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ce42830a-ad09-498b-bb0b-92b18d98ebb6 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:39.909629 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ce42830a-ad09-498b-bb0b-92b18d98ebb6 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:39.910173 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ce42830a-ad09-498b-bb0b-92b18d98ebb6 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:39.911492 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ce42830a-ad09-498b-bb0b-92b18d98ebb6 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:39.912176 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ce42830a-ad09-498b-bb0b-92b18d98ebb6 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:40.170077 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f2c26b6d-a437-4552-8ad1-a122fb1c91a0 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:40.170792 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f2c26b6d-a437-4552-8ad1-a122fb1c91a0 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] [instance: 0f203cb7-5930-44a8-83f0-075144d98aba] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:40.178536 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f2c26b6d-a437-4552-8ad1-a122fb1c91a0 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:40.179416 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f2c26b6d-a437-4552-8ad1-a122fb1c91a0 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:40.180069 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f2c26b6d-a437-4552-8ad1-a122fb1c91a0 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:40.181772 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f2c26b6d-a437-4552-8ad1-a122fb1c91a0 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:40.258986 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f2c26b6d-a437-4552-8ad1-a122fb1c91a0 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20faf80443114211af1c7ea53724dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7224d6e7eb4188b58412209e8d3c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:40.267205 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f2c26b6d-a437-4552-8ad1-a122fb1c91a0 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] 10.222.0.35 "GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba" status: 200 len: 1272 microversion: 2.1 time: 0.101831 Jun 10 18:32:40.267839 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3175/6400] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:40 2022] GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba => generated 1272 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:32:40.562366 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-36382b41-b32f-4d76-9e6a-272f7c679de9 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:40.563099 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-36382b41-b32f-4d76-9e6a-272f7c679de9 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 66557f04-2de0-41eb-b4a5-23bcbef9865f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:40.572164 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-36382b41-b32f-4d76-9e6a-272f7c679de9 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:40.572924 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-36382b41-b32f-4d76-9e6a-272f7c679de9 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:40.573800 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-36382b41-b32f-4d76-9e6a-272f7c679de9 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:40.574332 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-36382b41-b32f-4d76-9e6a-272f7c679de9 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:40.678496 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ce42830a-ad09-498b-bb0b-92b18d98ebb6 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:40.689431 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ce42830a-ad09-498b-bb0b-92b18d98ebb6 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1673 microversion: 2.1 time: 0.807498 Jun 10 18:32:40.690840 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3226/6401] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:39 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1673 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:32:40.792804 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-36382b41-b32f-4d76-9e6a-272f7c679de9 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:40.816648 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-36382b41-b32f-4d76-9e6a-272f7c679de9 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/66557f04-2de0-41eb-b4a5-23bcbef9865f" status: 200 len: 1373 microversion: 2.1 time: 0.258545 Jun 10 18:32:40.817549 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3176/6402] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:40 2022] GET /compute/v2.1/servers/66557f04-2de0-41eb-b4a5-23bcbef9865f => generated 1373 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:32:41.079385 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2f61e2ce-f025-440d-bd23-ed62853df7b1 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:41.080108 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2f61e2ce-f025-440d-bd23-ed62853df7b1 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] [instance: ecff1e1f-13e9-4a8c-96e0-4f423a31d69e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:41.103983 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2f61e2ce-f025-440d-bd23-ed62853df7b1 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:41.104742 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2f61e2ce-f025-440d-bd23-ed62853df7b1 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:41.106788 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2f61e2ce-f025-440d-bd23-ed62853df7b1 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:41.107414 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2f61e2ce-f025-440d-bd23-ed62853df7b1 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:41.272546 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-2f61e2ce-f025-440d-bd23-ed62853df7b1 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lazy-loading 'services' on Instance uuid ecff1e1f-13e9-4a8c-96e0-4f423a31d69e {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:32:41.291036 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-11429584-9e99-496e-8e84-5555b70b8481 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:41.292489 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-11429584-9e99-496e-8e84-5555b70b8481 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] [instance: 0f203cb7-5930-44a8-83f0-075144d98aba] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:41.304706 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-11429584-9e99-496e-8e84-5555b70b8481 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:41.308913 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-11429584-9e99-496e-8e84-5555b70b8481 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:41.311919 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-11429584-9e99-496e-8e84-5555b70b8481 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:41.311919 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-11429584-9e99-496e-8e84-5555b70b8481 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:41.566307 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2f61e2ce-f025-440d-bd23-ed62853df7b1 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] 10.222.0.35 "DELETE /compute/v2.1/servers/ecff1e1f-13e9-4a8c-96e0-4f423a31d69e/os-volume_attachments/81a4b2cb-2dec-40de-8300-6f083f756e2b" status: 202 len: 0 microversion: 2.1 time: 0.495161 Jun 10 18:32:41.567174 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3227/6403] 10.222.0.35 () {58 vars in 1415 bytes} [Fri Jun 10 18:32:41 2022] DELETE /compute/v2.1/servers/ecff1e1f-13e9-4a8c-96e0-4f423a31d69e/os-volume_attachments/81a4b2cb-2dec-40de-8300-6f083f756e2b => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:32:41.613454 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-11429584-9e99-496e-8e84-5555b70b8481 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20faf80443114211af1c7ea53724dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7224d6e7eb4188b58412209e8d3c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:41.626578 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-11429584-9e99-496e-8e84-5555b70b8481 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] 10.222.0.35 "GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba" status: 200 len: 1314 microversion: 2.1 time: 0.340315 Jun 10 18:32:41.630282 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3177/6404] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:41 2022] GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:32:41.707842 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-22a4e5a7-f323-4cf2-900a-e60e95740652 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:41.708601 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-22a4e5a7-f323-4cf2-900a-e60e95740652 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:41.731361 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-22a4e5a7-f323-4cf2-900a-e60e95740652 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:41.731830 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-22a4e5a7-f323-4cf2-900a-e60e95740652 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:41.732663 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-22a4e5a7-f323-4cf2-900a-e60e95740652 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:41.733149 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-22a4e5a7-f323-4cf2-900a-e60e95740652 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:41.836272 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-219ae3ae-d2b9-44dd-aea8-216d31f7a51c tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:41.838630 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-219ae3ae-d2b9-44dd-aea8-216d31f7a51c tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 66557f04-2de0-41eb-b4a5-23bcbef9865f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:41.849177 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-219ae3ae-d2b9-44dd-aea8-216d31f7a51c tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:41.854236 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-219ae3ae-d2b9-44dd-aea8-216d31f7a51c tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:41.857111 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-219ae3ae-d2b9-44dd-aea8-216d31f7a51c tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:41.860442 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-219ae3ae-d2b9-44dd-aea8-216d31f7a51c tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:42.132369 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-22a4e5a7-f323-4cf2-900a-e60e95740652 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:42.149901 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-22a4e5a7-f323-4cf2-900a-e60e95740652 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1673 microversion: 2.1 time: 0.444494 Jun 10 18:32:42.156090 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3228/6405] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:41 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1673 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:32:42.647005 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-086b793c-f897-467a-99f5-809b30ee8443 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:42.649232 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-086b793c-f897-467a-99f5-809b30ee8443 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] [instance: 0f203cb7-5930-44a8-83f0-075144d98aba] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:42.658949 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-086b793c-f897-467a-99f5-809b30ee8443 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:42.660002 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-086b793c-f897-467a-99f5-809b30ee8443 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:42.661288 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-086b793c-f897-467a-99f5-809b30ee8443 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:42.661973 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-086b793c-f897-467a-99f5-809b30ee8443 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:42.725293 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-219ae3ae-d2b9-44dd-aea8-216d31f7a51c tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:42.738811 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-219ae3ae-d2b9-44dd-aea8-216d31f7a51c tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/66557f04-2de0-41eb-b4a5-23bcbef9865f" status: 200 len: 1546 microversion: 2.1 time: 0.908152 Jun 10 18:32:42.740381 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3178/6406] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:41 2022] GET /compute/v2.1/servers/66557f04-2de0-41eb-b4a5-23bcbef9865f => generated 1546 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:32:42.762158 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-10b345d2-deaa-4339-9dc7-3cf4a751a459 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:42.762990 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-10b345d2-deaa-4339-9dc7-3cf4a751a459 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 66557f04-2de0-41eb-b4a5-23bcbef9865f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:42.784221 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10b345d2-deaa-4339-9dc7-3cf4a751a459 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:42.785090 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10b345d2-deaa-4339-9dc7-3cf4a751a459 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:42.786181 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10b345d2-deaa-4339-9dc7-3cf4a751a459 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:42.787024 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10b345d2-deaa-4339-9dc7-3cf4a751a459 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:43.099270 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-10b345d2-deaa-4339-9dc7-3cf4a751a459 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:43.107889 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-10b345d2-deaa-4339-9dc7-3cf4a751a459 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/66557f04-2de0-41eb-b4a5-23bcbef9865f" status: 200 len: 1546 microversion: 2.1 time: 0.350377 Jun 10 18:32:43.108771 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3179/6407] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:42 2022] GET /compute/v2.1/servers/66557f04-2de0-41eb-b4a5-23bcbef9865f => generated 1546 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:32:43.125236 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-d048aee5-93f6-456c-b31b-2f9bb53560b3 req-2475548d-6553-4581-a44e-19161512a9a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f203cb7-5930-44a8-83f0-075144d98aba", "tag": "e6269383-a093-464d-9e51-5e773f32c17b"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:32:43.134158 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-d048aee5-93f6-456c-b31b-2f9bb53560b3 req-2475548d-6553-4581-a44e-19161512a9a1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:43.134906 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-d048aee5-93f6-456c-b31b-2f9bb53560b3 req-2475548d-6553-4581-a44e-19161512a9a1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:43.147241 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-d048aee5-93f6-456c-b31b-2f9bb53560b3 req-2475548d-6553-4581-a44e-19161512a9a1 service nova] Creating event network-changed:e6269383-a093-464d-9e51-5e773f32c17b for instance 0f203cb7-5930-44a8-83f0-075144d98aba on chh2-master-2 Jun 10 18:32:43.162290 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-d048aee5-93f6-456c-b31b-2f9bb53560b3 req-2475548d-6553-4581-a44e-19161512a9a1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040907 Jun 10 18:32:43.163107 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3180/6408] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:32:43.174258 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5799a93f-da2b-43e7-912b-51469779c976 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:43.175158 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5799a93f-da2b-43e7-912b-51469779c976 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:43.186083 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-086b793c-f897-467a-99f5-809b30ee8443 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20faf80443114211af1c7ea53724dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7224d6e7eb4188b58412209e8d3c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:43.192370 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5799a93f-da2b-43e7-912b-51469779c976 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:43.193089 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5799a93f-da2b-43e7-912b-51469779c976 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:43.194329 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5799a93f-da2b-43e7-912b-51469779c976 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:43.194944 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5799a93f-da2b-43e7-912b-51469779c976 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:43.205307 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-086b793c-f897-467a-99f5-809b30ee8443 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] 10.222.0.35 "GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba" status: 200 len: 1314 microversion: 2.1 time: 0.563660 Jun 10 18:32:43.217979 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3229/6409] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:42 2022] GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba => generated 1314 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:32:44.053081 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5799a93f-da2b-43e7-912b-51469779c976 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:44.065778 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5799a93f-da2b-43e7-912b-51469779c976 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1673 microversion: 2.1 time: 0.896690 Jun 10 18:32:44.066980 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3181/6410] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:43 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1673 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:32:44.194335 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5dabb513-8a07-473c-8daf-37d793e2f50c tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:32:44.195427 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5dabb513-8a07-473c-8daf-37d793e2f50c tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:44.213359 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5dabb513-8a07-473c-8daf-37d793e2f50c tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:44.216358 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5dabb513-8a07-473c-8daf-37d793e2f50c tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:44.217630 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5dabb513-8a07-473c-8daf-37d793e2f50c tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:44.221110 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5dabb513-8a07-473c-8daf-37d793e2f50c tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:44.225540 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0934481d-7a8f-4a78-9957-7481a2c5935b tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:44.226162 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0934481d-7a8f-4a78-9957-7481a2c5935b tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] [instance: 0f203cb7-5930-44a8-83f0-075144d98aba] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:44.239809 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0934481d-7a8f-4a78-9957-7481a2c5935b tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:44.240376 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0934481d-7a8f-4a78-9957-7481a2c5935b tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:44.241187 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0934481d-7a8f-4a78-9957-7481a2c5935b tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:44.241625 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0934481d-7a8f-4a78-9957-7481a2c5935b tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:44.701404 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0934481d-7a8f-4a78-9957-7481a2c5935b tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20faf80443114211af1c7ea53724dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7224d6e7eb4188b58412209e8d3c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:44.712591 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0934481d-7a8f-4a78-9957-7481a2c5935b tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] 10.222.0.35 "GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba" status: 200 len: 1314 microversion: 2.1 time: 0.491123 Jun 10 18:32:44.715495 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3182/6411] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:44 2022] GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba => generated 1314 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:32:45.086004 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1d84c5bb-06bd-4443-bac7-d50852a2ee1e tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:45.087887 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1d84c5bb-06bd-4443-bac7-d50852a2ee1e tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:45.100089 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d84c5bb-06bd-4443-bac7-d50852a2ee1e tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:45.100988 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d84c5bb-06bd-4443-bac7-d50852a2ee1e tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:45.102024 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d84c5bb-06bd-4443-bac7-d50852a2ee1e tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:45.103346 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d84c5bb-06bd-4443-bac7-d50852a2ee1e tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:45.112527 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:32:45.231893 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1d84c5bb-06bd-4443-bac7-d50852a2ee1e tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:45.243757 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1d84c5bb-06bd-4443-bac7-d50852a2ee1e tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1606 microversion: 2.1 time: 0.162174 Jun 10 18:32:45.247308 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3183/6412] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:45 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1606 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:32:45.486443 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-3f213485-92dd-42ee-b485-a348b3d6ecd4 req-bceef2c6-5a2f-41de-bacf-0a01b81c2403 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb7d7b12-56ec-43ab-8327-488874922d7d", "name": "network-vif-deleted", "tag": "fa032014-1fbf-4fd8-a8f9-eae194d73659"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:32:45.508623 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-3f213485-92dd-42ee-b485-a348b3d6ecd4 req-bceef2c6-5a2f-41de-bacf-0a01b81c2403 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:45.513683 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-3f213485-92dd-42ee-b485-a348b3d6ecd4 req-bceef2c6-5a2f-41de-bacf-0a01b81c2403 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:45.535744 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-3f213485-92dd-42ee-b485-a348b3d6ecd4 req-bceef2c6-5a2f-41de-bacf-0a01b81c2403 service nova] Creating event network-vif-deleted:fa032014-1fbf-4fd8-a8f9-eae194d73659 for instance eb7d7b12-56ec-43ab-8327-488874922d7d on chh2-master-2 Jun 10 18:32:45.553686 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-3f213485-92dd-42ee-b485-a348b3d6ecd4 req-bceef2c6-5a2f-41de-bacf-0a01b81c2403 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071829 Jun 10 18:32:45.554870 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3184/6413] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:32:45.730393 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c1bb333d-17b6-4217-8210-f85bd5e408e7 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:45.731157 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c1bb333d-17b6-4217-8210-f85bd5e408e7 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] [instance: 0f203cb7-5930-44a8-83f0-075144d98aba] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:45.738972 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c1bb333d-17b6-4217-8210-f85bd5e408e7 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:45.739828 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c1bb333d-17b6-4217-8210-f85bd5e408e7 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:45.741347 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c1bb333d-17b6-4217-8210-f85bd5e408e7 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:45.742065 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c1bb333d-17b6-4217-8210-f85bd5e408e7 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:45.937567 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5dabb513-8a07-473c-8daf-37d793e2f50c tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "POST /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791/action" status: 200 len: 24578 microversion: 2.1 time: 1.747844 Jun 10 18:32:45.938842 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3230/6414] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:32:44 2022] POST /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791/action => generated 24578 bytes in 1750 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:32:45.954858 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:32:46.263612 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cb0344d7-a902-4d1b-89ab-999cbe9a5180 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:46.265239 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cb0344d7-a902-4d1b-89ab-999cbe9a5180 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:46.281309 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cb0344d7-a902-4d1b-89ab-999cbe9a5180 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:46.282355 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cb0344d7-a902-4d1b-89ab-999cbe9a5180 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:46.283420 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cb0344d7-a902-4d1b-89ab-999cbe9a5180 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:46.284401 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cb0344d7-a902-4d1b-89ab-999cbe9a5180 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:46.299390 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c1bb333d-17b6-4217-8210-f85bd5e408e7 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20faf80443114211af1c7ea53724dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7224d6e7eb4188b58412209e8d3c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:46.313865 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c1bb333d-17b6-4217-8210-f85bd5e408e7 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] 10.222.0.35 "GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba" status: 200 len: 1314 microversion: 2.1 time: 0.587373 Jun 10 18:32:46.317545 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3185/6415] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:45 2022] GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba => generated 1314 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:32:46.362098 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cb0344d7-a902-4d1b-89ab-999cbe9a5180 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:46.362554 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cb0344d7-a902-4d1b-89ab-999cbe9a5180 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:46.363018 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-cb0344d7-a902-4d1b-89ab-999cbe9a5180 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lazy-loading 'fault' on Instance uuid eb7d7b12-56ec-43ab-8327-488874922d7d {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:32:46.905121 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cb0344d7-a902-4d1b-89ab-999cbe9a5180 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:46.914371 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cb0344d7-a902-4d1b-89ab-999cbe9a5180 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 200 len: 1327 microversion: 2.1 time: 0.654709 Jun 10 18:32:46.928560 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3231/6416] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:46 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 1327 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:32:47.333692 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-964b8873-6bd1-493d-9a5d-070dc2b38090 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:47.335012 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-964b8873-6bd1-493d-9a5d-070dc2b38090 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] [instance: 0f203cb7-5930-44a8-83f0-075144d98aba] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:47.341554 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=14 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:32:47.344160 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-964b8873-6bd1-493d-9a5d-070dc2b38090 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:47.345049 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-964b8873-6bd1-493d-9a5d-070dc2b38090 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:47.346389 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-964b8873-6bd1-493d-9a5d-070dc2b38090 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:47.347059 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-964b8873-6bd1-493d-9a5d-070dc2b38090 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:47.594226 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-964b8873-6bd1-493d-9a5d-070dc2b38090 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20faf80443114211af1c7ea53724dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7224d6e7eb4188b58412209e8d3c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:47.603527 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-964b8873-6bd1-493d-9a5d-070dc2b38090 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] 10.222.0.35 "GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba" status: 200 len: 1314 microversion: 2.1 time: 0.273177 Jun 10 18:32:47.604477 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3186/6417] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:47 2022] GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:32:47.939002 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-025c32e7-9cb1-4f7e-9c27-d90fcd70d7ad tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:47.940867 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-025c32e7-9cb1-4f7e-9c27-d90fcd70d7ad tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:47.950572 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-025c32e7-9cb1-4f7e-9c27-d90fcd70d7ad tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:47.951491 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-025c32e7-9cb1-4f7e-9c27-d90fcd70d7ad tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:47.952546 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-025c32e7-9cb1-4f7e-9c27-d90fcd70d7ad tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:47.953757 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-025c32e7-9cb1-4f7e-9c27-d90fcd70d7ad tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:47.977413 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-025c32e7-9cb1-4f7e-9c27-d90fcd70d7ad tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] HTTP exception thrown: Instance eb7d7b12-56ec-43ab-8327-488874922d7d could not be found. Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-025c32e7-9cb1-4f7e-9c27-d90fcd70d7ad tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Request method failure captured: Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d HTTP/1.1 Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio40ltn_2ByFbzyzAVu0QcFPuZdhey6Y1RzaanyIXWFbMA3jX27kd5QdQTkjdaPpNC3eHF8vjMWTW53ROHXMgqhb7cmKVmMJ0JxmAIwklDSmJ4lKTSAAeEDlgNHI_IPAeB-zYoB4LI3xPkB9jsdNHxjRbctCV4bBXBp--Rsr4WX1UBVQ Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 1be5a72204b8483590ce13d50170b117 Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-AttachVolumeTestJSON-1437428834 Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1be5a72204b8483590ce13d50170b117"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1be5a72204b8483590ce13d50170b117"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1be5a72204b8483590ce13d50170b117"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1be5a72204b8483590ce13d50170b117", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-AttachVolumeTestJSON-1437428834 Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 1be5a72204b8483590ce13d50170b117 Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1437428834 Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-AttachVolumeTestJSON-1437428834-project Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: fe74aba3932c467e8124a888867d2112 Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-AttachVolumeTestJSON-1437428834-project Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: exception: Instance eb7d7b12-56ec-43ab-8327-488874922d7d could not be found. Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'eb7d7b12-56ec-43ab-8327-488874922d7d'} Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb7d7b12-56ec-43ab-8327-488874922d7d could not be found. Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb7d7b12-56ec-43ab-8327-488874922d7d could not be found. Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:32:47.979355 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:32:47.986070 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:32:47.986070 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:32:47.986070 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:32:47.986070 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:32:47.986070 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:32:47.986070 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb7d7b12-56ec-43ab-8327-488874922d7d could not be found. Jun 10 18:32:47.986070 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:32:47.990853 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-025c32e7-9cb1-4f7e-9c27-d90fcd70d7ad tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Returning 404 to user: Instance eb7d7b12-56ec-43ab-8327-488874922d7d could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:32:47.992153 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-025c32e7-9cb1-4f7e-9c27-d90fcd70d7ad tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 404 len: 111 microversion: 2.1 time: 0.060836 Jun 10 18:32:47.997573 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3232/6418] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:47 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:32:48.006320 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e0987113-ff77-44c7-bbd7-d45e1d39f302 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '.version_select at 0x7f77c60cd040>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:48.111949 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e0987113-ff77-44c7-bbd7-d45e1d39f302 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1557638046" status: 202 len: 0 microversion: 2.1 time: 0.109997 Jun 10 18:32:48.115743 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3187/6419] 10.222.0.35 () {58 vars in 1220 bytes} [Fri Jun 10 18:32:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1557638046 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:32:48.641549 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8b37cb81-8291-41ae-bc12-e4d69822296e tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:48.641549 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8b37cb81-8291-41ae-bc12-e4d69822296e tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] [instance: 0f203cb7-5930-44a8-83f0-075144d98aba] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:48.641549 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8b37cb81-8291-41ae-bc12-e4d69822296e tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:48.641549 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8b37cb81-8291-41ae-bc12-e4d69822296e tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:48.641549 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8b37cb81-8291-41ae-bc12-e4d69822296e tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:48.642245 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8b37cb81-8291-41ae-bc12-e4d69822296e tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:48.897578 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8b37cb81-8291-41ae-bc12-e4d69822296e tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20faf80443114211af1c7ea53724dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7224d6e7eb4188b58412209e8d3c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:48.909279 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8b37cb81-8291-41ae-bc12-e4d69822296e tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] 10.222.0.35 "GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba" status: 200 len: 1314 microversion: 2.1 time: 0.291009 Jun 10 18:32:48.919846 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3233/6420] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:48 2022] GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:32:49.496020 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5e165858-55c3-4ef3-a8b7-a5f72711b749 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:49.499206 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5e165858-55c3-4ef3-a8b7-a5f72711b749 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] [instance: ecff1e1f-13e9-4a8c-96e0-4f423a31d69e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:49.506870 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5e165858-55c3-4ef3-a8b7-a5f72711b749 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:49.509193 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5e165858-55c3-4ef3-a8b7-a5f72711b749 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:49.510036 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5e165858-55c3-4ef3-a8b7-a5f72711b749 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:49.510489 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5e165858-55c3-4ef3-a8b7-a5f72711b749 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:49.554429 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5e165858-55c3-4ef3-a8b7-a5f72711b749 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] [instance: ecff1e1f-13e9-4a8c-96e0-4f423a31d69e] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:32:49.930600 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6176a92a-a894-44cf-9e8f-1b76b73c671a tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:49.932270 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6176a92a-a894-44cf-9e8f-1b76b73c671a tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] [instance: 0f203cb7-5930-44a8-83f0-075144d98aba] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:49.950884 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6176a92a-a894-44cf-9e8f-1b76b73c671a tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:49.951803 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6176a92a-a894-44cf-9e8f-1b76b73c671a tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:49.952822 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6176a92a-a894-44cf-9e8f-1b76b73c671a tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:49.956142 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6176a92a-a894-44cf-9e8f-1b76b73c671a tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:49.995683 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5e165858-55c3-4ef3-a8b7-a5f72711b749 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] 10.222.0.35 "DELETE /compute/v2.1/servers/ecff1e1f-13e9-4a8c-96e0-4f423a31d69e" status: 204 len: 0 microversion: 2.1 time: 0.504918 Jun 10 18:32:49.998673 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3188/6421] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:32:49 2022] DELETE /compute/v2.1/servers/ecff1e1f-13e9-4a8c-96e0-4f423a31d69e => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:32:50.004580 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-60efa899-7896-4513-85ab-9762f34ec1c8 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Action: 'create', calling method: .version_select at 0x7f77c00f6550>, body: {"keypair": {"name": "tempest-keypair-1450671754", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnEO0+gV9RjiA/bHY9NYYybYZ6miYSSqxMgPIyv1Sz5HeJexNrFNQK72vUI/tSYJA8Gy4hHPlKibf/9vQ0PfAkZIh+CsBs7j3Wmt6kFfFO+bI/d8fdf7EWDGaRb0GMYpQ=="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:32:50.020471 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-60efa899-7896-4513-85ab-9762f34ec1c8 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Getting quotas for project 1be5a72204b8483590ce13d50170b117. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:32:50.027687 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-60efa899-7896-4513-85ab-9762f34ec1c8 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Getting quotas for user fe74aba3932c467e8124a888867d2112 and project 1be5a72204b8483590ce13d50170b117. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:32:50.037805 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:32:50.125121 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-60efa899-7896-4513-85ab-9762f34ec1c8 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.124364 Jun 10 18:32:50.137166 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3189/6422] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 18:32:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:32:50.151247 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e15e58c5-f3d1-4fc8-805a-6167325bedda tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:50.152364 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e15e58c5-f3d1-4fc8-805a-6167325bedda tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] [instance: ecff1e1f-13e9-4a8c-96e0-4f423a31d69e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:50.163967 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e15e58c5-f3d1-4fc8-805a-6167325bedda tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:50.164710 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e15e58c5-f3d1-4fc8-805a-6167325bedda tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:50.165779 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e15e58c5-f3d1-4fc8-805a-6167325bedda tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:50.166418 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e15e58c5-f3d1-4fc8-805a-6167325bedda tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:50.296832 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6176a92a-a894-44cf-9e8f-1b76b73c671a tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20faf80443114211af1c7ea53724dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7224d6e7eb4188b58412209e8d3c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:50.308905 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6176a92a-a894-44cf-9e8f-1b76b73c671a tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] 10.222.0.35 "GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba" status: 200 len: 1314 microversion: 2.1 time: 0.383937 Jun 10 18:32:50.318303 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3234/6423] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:49 2022] GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:32:50.386542 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e15e58c5-f3d1-4fc8-805a-6167325bedda tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa5b7f650884ee59282ce97f48fc0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a8d819ba8844878f82cf60131df725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:50.405869 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e15e58c5-f3d1-4fc8-805a-6167325bedda tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] 10.222.0.35 "GET /compute/v2.1/servers/ecff1e1f-13e9-4a8c-96e0-4f423a31d69e" status: 200 len: 1514 microversion: 2.1 time: 0.267504 Jun 10 18:32:50.406592 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3190/6424] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:50 2022] GET /compute/v2.1/servers/ecff1e1f-13e9-4a8c-96e0-4f423a31d69e => generated 1514 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:32:50.637133 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-8bc1cc9f-7ee4-40fc-968d-b246f59d0f0d req-6a79fa4e-746a-45df-80ea-8240044d2c04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f203cb7-5930-44a8-83f0-075144d98aba", "name": "network-vif-plugged", "status": "completed", "tag": "e6269383-a093-464d-9e51-5e773f32c17b"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:32:50.651741 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-8bc1cc9f-7ee4-40fc-968d-b246f59d0f0d req-6a79fa4e-746a-45df-80ea-8240044d2c04 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:50.652286 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-8bc1cc9f-7ee4-40fc-968d-b246f59d0f0d req-6a79fa4e-746a-45df-80ea-8240044d2c04 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:50.686052 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-8bc1cc9f-7ee4-40fc-968d-b246f59d0f0d req-6a79fa4e-746a-45df-80ea-8240044d2c04 service nova] Creating event network-vif-plugged:e6269383-a093-464d-9e51-5e773f32c17b for instance 0f203cb7-5930-44a8-83f0-075144d98aba on chh2-master-2 Jun 10 18:32:50.716196 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-8bc1cc9f-7ee4-40fc-968d-b246f59d0f0d req-6a79fa4e-746a-45df-80ea-8240044d2c04 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080123 Jun 10 18:32:50.719254 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3235/6425] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:32:51.327720 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2e438a1c-d2ee-4750-8f4a-619aeccca271 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:51.328375 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2e438a1c-d2ee-4750-8f4a-619aeccca271 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] [instance: 0f203cb7-5930-44a8-83f0-075144d98aba] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:51.338215 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e438a1c-d2ee-4750-8f4a-619aeccca271 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:51.338867 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e438a1c-d2ee-4750-8f4a-619aeccca271 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:51.339673 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e438a1c-d2ee-4750-8f4a-619aeccca271 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:51.340113 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e438a1c-d2ee-4750-8f4a-619aeccca271 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:51.423689 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-46adb102-ecfc-44fb-8a07-f0ffbcba0079 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:51.424420 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-46adb102-ecfc-44fb-8a07-f0ffbcba0079 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] [instance: ecff1e1f-13e9-4a8c-96e0-4f423a31d69e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:51.432690 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-46adb102-ecfc-44fb-8a07-f0ffbcba0079 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:51.433150 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-46adb102-ecfc-44fb-8a07-f0ffbcba0079 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:51.433965 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-46adb102-ecfc-44fb-8a07-f0ffbcba0079 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:51.434374 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-46adb102-ecfc-44fb-8a07-f0ffbcba0079 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:51.670539 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-46adb102-ecfc-44fb-8a07-f0ffbcba0079 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa5b7f650884ee59282ce97f48fc0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a8d819ba8844878f82cf60131df725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:51.682965 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-46adb102-ecfc-44fb-8a07-f0ffbcba0079 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] 10.222.0.35 "GET /compute/v2.1/servers/ecff1e1f-13e9-4a8c-96e0-4f423a31d69e" status: 200 len: 1514 microversion: 2.1 time: 0.263384 Jun 10 18:32:51.686860 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3236/6426] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:51 2022] GET /compute/v2.1/servers/ecff1e1f-13e9-4a8c-96e0-4f423a31d69e => generated 1514 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:32:51.800395 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2e438a1c-d2ee-4750-8f4a-619aeccca271 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20faf80443114211af1c7ea53724dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7224d6e7eb4188b58412209e8d3c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:51.810791 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2e438a1c-d2ee-4750-8f4a-619aeccca271 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] 10.222.0.35 "GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba" status: 200 len: 1314 microversion: 2.1 time: 0.487485 Jun 10 18:32:51.811820 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3191/6427] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:51 2022] GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba => generated 1314 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:32:52.642437 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-6eab1919-b629-4fdc-aebb-2f16f224e261 req-fa8c9b6b-5aa4-4a1a-87e0-f317f431b545 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecff1e1f-13e9-4a8c-96e0-4f423a31d69e", "name": "network-vif-deleted", "tag": "f17cf721-01c3-49f8-9a21-62c5127a40f4"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:32:52.652709 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-6eab1919-b629-4fdc-aebb-2f16f224e261 req-fa8c9b6b-5aa4-4a1a-87e0-f317f431b545 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:52.653164 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-6eab1919-b629-4fdc-aebb-2f16f224e261 req-fa8c9b6b-5aa4-4a1a-87e0-f317f431b545 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:52.657377 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:32:52.668467 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-6eab1919-b629-4fdc-aebb-2f16f224e261 req-fa8c9b6b-5aa4-4a1a-87e0-f317f431b545 service nova] Creating event network-vif-deleted:f17cf721-01c3-49f8-9a21-62c5127a40f4 for instance ecff1e1f-13e9-4a8c-96e0-4f423a31d69e on chh1-master-2 Jun 10 18:32:52.673371 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-6eab1919-b629-4fdc-aebb-2f16f224e261 req-fa8c9b6b-5aa4-4a1a-87e0-f317f431b545 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035523 Jun 10 18:32:52.673979 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3237/6428] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:32:52.707891 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-aec44d19-4263-4863-9eef-c16a0949b573 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:52.710081 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-aec44d19-4263-4863-9eef-c16a0949b573 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] [instance: ecff1e1f-13e9-4a8c-96e0-4f423a31d69e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:52.716488 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aec44d19-4263-4863-9eef-c16a0949b573 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:52.716961 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aec44d19-4263-4863-9eef-c16a0949b573 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:52.717792 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aec44d19-4263-4863-9eef-c16a0949b573 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:52.718231 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aec44d19-4263-4863-9eef-c16a0949b573 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:52.813483 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-aec44d19-4263-4863-9eef-c16a0949b573 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa5b7f650884ee59282ce97f48fc0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a8d819ba8844878f82cf60131df725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:52.823047 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-aec44d19-4263-4863-9eef-c16a0949b573 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] 10.222.0.35 "GET /compute/v2.1/servers/ecff1e1f-13e9-4a8c-96e0-4f423a31d69e" status: 200 len: 1472 microversion: 2.1 time: 0.119407 Jun 10 18:32:52.823904 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3192/6429] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:52 2022] GET /compute/v2.1/servers/ecff1e1f-13e9-4a8c-96e0-4f423a31d69e => generated 1472 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:32:52.842265 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-dec50b1e-c1e0-474b-97d7-0f5051de3a62 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:52.845092 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-dec50b1e-c1e0-474b-97d7-0f5051de3a62 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] [instance: 0f203cb7-5930-44a8-83f0-075144d98aba] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:52.859144 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dec50b1e-c1e0-474b-97d7-0f5051de3a62 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:52.860763 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dec50b1e-c1e0-474b-97d7-0f5051de3a62 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:52.861972 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dec50b1e-c1e0-474b-97d7-0f5051de3a62 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:52.863394 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dec50b1e-c1e0-474b-97d7-0f5051de3a62 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:53.140183 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-dec50b1e-c1e0-474b-97d7-0f5051de3a62 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20faf80443114211af1c7ea53724dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7224d6e7eb4188b58412209e8d3c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:53.148648 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-dec50b1e-c1e0-474b-97d7-0f5051de3a62 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] 10.222.0.35 "GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba" status: 200 len: 1502 microversion: 2.1 time: 0.320949 Jun 10 18:32:53.149232 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3238/6430] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:52 2022] GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba => generated 1502 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:32:53.164988 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e92ce15a-4649-428d-8ca0-d6177d50b7b0 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:53.165697 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e92ce15a-4649-428d-8ca0-d6177d50b7b0 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] [instance: 0f203cb7-5930-44a8-83f0-075144d98aba] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:53.172103 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e92ce15a-4649-428d-8ca0-d6177d50b7b0 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:53.172824 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e92ce15a-4649-428d-8ca0-d6177d50b7b0 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:53.173600 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e92ce15a-4649-428d-8ca0-d6177d50b7b0 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:53.174212 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e92ce15a-4649-428d-8ca0-d6177d50b7b0 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:53.323051 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e92ce15a-4649-428d-8ca0-d6177d50b7b0 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20faf80443114211af1c7ea53724dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7224d6e7eb4188b58412209e8d3c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:53.331397 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e92ce15a-4649-428d-8ca0-d6177d50b7b0 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] 10.222.0.35 "GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba" status: 200 len: 1502 microversion: 2.1 time: 0.170254 Jun 10 18:32:53.332159 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3193/6431] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:53 2022] GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba => generated 1502 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:32:53.347897 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9c0daad3-261d-4fee-8c4c-01694d9f1d43 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:32:53.348358 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9c0daad3-261d-4fee-8c4c-01694d9f1d43 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] [instance: 0f203cb7-5930-44a8-83f0-075144d98aba] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:53.354939 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9c0daad3-261d-4fee-8c4c-01694d9f1d43 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:53.355392 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9c0daad3-261d-4fee-8c4c-01694d9f1d43 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:53.356168 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9c0daad3-261d-4fee-8c4c-01694d9f1d43 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:53.356649 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9c0daad3-261d-4fee-8c4c-01694d9f1d43 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:53.381386 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-9c0daad3-261d-4fee-8c4c-01694d9f1d43 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lazy-loading 'flavor' on Instance uuid 0f203cb7-5930-44a8-83f0-075144d98aba {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:32:53.789543 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9c0daad3-261d-4fee-8c4c-01694d9f1d43 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] 10.222.0.35 "POST /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba/action" status: 202 len: 0 microversion: 2.1 time: 0.445282 Jun 10 18:32:53.795524 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3239/6432] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:32:53 2022] POST /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba/action => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:32:53.803585 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-26e7cf51-ac58-4778-981b-e01bd739a78c tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:53.808963 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-26e7cf51-ac58-4778-981b-e01bd739a78c tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] [instance: 0f203cb7-5930-44a8-83f0-075144d98aba] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:53.820116 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-26e7cf51-ac58-4778-981b-e01bd739a78c tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:53.820925 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-26e7cf51-ac58-4778-981b-e01bd739a78c tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:53.821796 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-26e7cf51-ac58-4778-981b-e01bd739a78c tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:53.822238 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-26e7cf51-ac58-4778-981b-e01bd739a78c tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:53.851898 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0418a7ae-8c34-4745-8c32-25e7e4c14774 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:53.867490 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0418a7ae-8c34-4745-8c32-25e7e4c14774 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] [instance: ecff1e1f-13e9-4a8c-96e0-4f423a31d69e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:53.878560 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0418a7ae-8c34-4745-8c32-25e7e4c14774 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:53.879022 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0418a7ae-8c34-4745-8c32-25e7e4c14774 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:53.880780 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0418a7ae-8c34-4745-8c32-25e7e4c14774 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:53.881232 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0418a7ae-8c34-4745-8c32-25e7e4c14774 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:53.898453 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-0418a7ae-8c34-4745-8c32-25e7e4c14774 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] HTTP exception thrown: Instance ecff1e1f-13e9-4a8c-96e0-4f423a31d69e could not be found. Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0418a7ae-8c34-4745-8c32-25e7e4c14774 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Request method failure captured: Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/ecff1e1f-13e9-4a8c-96e0-4f423a31d69e HTTP/1.1 Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio41voBxnKdNcSWTzGKCKYykR4YCFkTyTrttx4im2hhdoOcOiK2xpD8zkcWcGqujci7pVnN_hpJfZazDA7m_nLDjNYXGHhrLnqzVQNOTzN0CyHDACUDEmHWg9sjhH0WH26ASUDXdfgHHPYNBldh2NDXiQ8Zsq62cFCHzdfiqdRCvx1QM Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: e2a8d819ba8844878f82cf60131df725 Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1780545508 Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/e2a8d819ba8844878f82cf60131df725"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/e2a8d819ba8844878f82cf60131df725"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/e2a8d819ba8844878f82cf60131df725"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_e2a8d819ba8844878f82cf60131df725", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-VolumesSnapshotTestJSON-1780545508 Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: e2a8d819ba8844878f82cf60131df725 Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1780545508 Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-VolumesSnapshotTestJSON-1780545508-project Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 3aa5b7f650884ee59282ce97f48fc0e6 Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-VolumesSnapshotTestJSON-1780545508-project Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: exception: Instance ecff1e1f-13e9-4a8c-96e0-4f423a31d69e could not be found. Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'ecff1e1f-13e9-4a8c-96e0-4f423a31d69e'} Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecff1e1f-13e9-4a8c-96e0-4f423a31d69e could not be found. Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecff1e1f-13e9-4a8c-96e0-4f423a31d69e could not be found. Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:32:53.900782 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:32:53.917034 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:32:53.917034 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:32:53.917034 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:32:53.917034 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:32:53.917034 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:32:53.917034 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecff1e1f-13e9-4a8c-96e0-4f423a31d69e could not be found. Jun 10 18:32:53.917034 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:32:53.917034 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0418a7ae-8c34-4745-8c32-25e7e4c14774 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Returning 404 to user: Instance ecff1e1f-13e9-4a8c-96e0-4f423a31d69e could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:32:53.917034 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0418a7ae-8c34-4745-8c32-25e7e4c14774 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] 10.222.0.35 "GET /compute/v2.1/servers/ecff1e1f-13e9-4a8c-96e0-4f423a31d69e" status: 404 len: 111 microversion: 2.1 time: 0.058441 Jun 10 18:32:53.917034 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3240/6433] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:53 2022] GET /compute/v2.1/servers/ecff1e1f-13e9-4a8c-96e0-4f423a31d69e => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:32:54.090276 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-26e7cf51-ac58-4778-981b-e01bd739a78c tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20faf80443114211af1c7ea53724dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7224d6e7eb4188b58412209e8d3c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:54.098073 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-26e7cf51-ac58-4778-981b-e01bd739a78c tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] 10.222.0.35 "GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba" status: 200 len: 1510 microversion: 2.1 time: 0.302738 Jun 10 18:32:54.098774 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3194/6434] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:53 2022] GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba => generated 1510 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:32:54.506354 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f5b2d8ae-0a8c-474c-970f-c72a163259c1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1491557820", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "97962275-cf8f-4dae-870e-900cd0b861eb"}], "security_groups": [{"name": "tempest-securitygroup--2110092188"}], "key_name": "tempest-keypair-1450671754", "user_data": "}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:32:54.630817 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-f5b2d8ae-0a8c-474c-970f-c72a163259c1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] validate_networks() for [('97962275-cf8f-4dae-870e-900cd0b861eb', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:32:55.121444 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-70297112-ee59-4d36-a469-133d00178ded tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:55.123538 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-70297112-ee59-4d36-a469-133d00178ded tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] [instance: 0f203cb7-5930-44a8-83f0-075144d98aba] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:55.129182 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70297112-ee59-4d36-a469-133d00178ded tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:55.129865 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70297112-ee59-4d36-a469-133d00178ded tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:55.130822 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70297112-ee59-4d36-a469-133d00178ded tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:55.131430 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70297112-ee59-4d36-a469-133d00178ded tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:55.513778 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-70297112-ee59-4d36-a469-133d00178ded tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20faf80443114211af1c7ea53724dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7224d6e7eb4188b58412209e8d3c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:55.529154 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-70297112-ee59-4d36-a469-133d00178ded tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] 10.222.0.35 "GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba" status: 200 len: 1493 microversion: 2.1 time: 0.412312 Jun 10 18:32:55.532744 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3195/6435] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:55 2022] GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba => generated 1493 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:32:55.547663 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4eaa5aa8-88d6-4ace-ade1-8aa19b8fd1ec tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:32:55.548650 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4eaa5aa8-88d6-4ace-ade1-8aa19b8fd1ec tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] [instance: 0f203cb7-5930-44a8-83f0-075144d98aba] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:55.555528 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4eaa5aa8-88d6-4ace-ade1-8aa19b8fd1ec tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:55.556335 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4eaa5aa8-88d6-4ace-ade1-8aa19b8fd1ec tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:55.557364 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4eaa5aa8-88d6-4ace-ade1-8aa19b8fd1ec tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:55.557988 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4eaa5aa8-88d6-4ace-ade1-8aa19b8fd1ec tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:55.667663 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-f5b2d8ae-0a8c-474c-970f-c72a163259c1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:32:55.669095 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-f5b2d8ae-0a8c-474c-970f-c72a163259c1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:32:55.669813 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-f5b2d8ae-0a8c-474c-970f-c72a163259c1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:32:55.670424 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-f5b2d8ae-0a8c-474c-970f-c72a163259c1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:32:55.671349 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-f5b2d8ae-0a8c-474c-970f-c72a163259c1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:32:55.685168 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f5b2d8ae-0a8c-474c-970f-c72a163259c1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:55.686023 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f5b2d8ae-0a8c-474c-970f-c72a163259c1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:55.687091 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f5b2d8ae-0a8c-474c-970f-c72a163259c1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:55.687772 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f5b2d8ae-0a8c-474c-970f-c72a163259c1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:55.713488 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-f5b2d8ae-0a8c-474c-970f-c72a163259c1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Getting quotas for project 1be5a72204b8483590ce13d50170b117. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:32:55.720663 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-f5b2d8ae-0a8c-474c-970f-c72a163259c1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Getting quotas for user fe74aba3932c467e8124a888867d2112 and project 1be5a72204b8483590ce13d50170b117. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:32:55.737163 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f5b2d8ae-0a8c-474c-970f-c72a163259c1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:32:55.740768 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f5b2d8ae-0a8c-474c-970f-c72a163259c1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: cf4aaf4f-5855-4034-a1a5-2bfb200ad546] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:32:55.857520 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4eaa5aa8-88d6-4ace-ade1-8aa19b8fd1ec tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] 10.222.0.35 "POST /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba/action" status: 202 len: 0 microversion: 2.1 time: 0.312925 Jun 10 18:32:55.858675 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3196/6436] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:32:55 2022] POST /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 18:32:55.871207 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-56fe3c15-1948-44ce-b7ea-c3dbac6edc19 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:55.872664 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-56fe3c15-1948-44ce-b7ea-c3dbac6edc19 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] [instance: 0f203cb7-5930-44a8-83f0-075144d98aba] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:55.883364 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-56fe3c15-1948-44ce-b7ea-c3dbac6edc19 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:55.889428 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-56fe3c15-1948-44ce-b7ea-c3dbac6edc19 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:55.902125 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-56fe3c15-1948-44ce-b7ea-c3dbac6edc19 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:55.904576 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-56fe3c15-1948-44ce-b7ea-c3dbac6edc19 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:55.929163 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f5b2d8ae-0a8c-474c-970f-c72a163259c1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.431344 Jun 10 18:32:55.930346 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3241/6437] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:32:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 1438 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:32:55.941665 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b83ff7e3-cd04-43a1-a653-56c327468d60 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:55.948691 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b83ff7e3-cd04-43a1-a653-56c327468d60 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: cf4aaf4f-5855-4034-a1a5-2bfb200ad546] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:56.153373 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b83ff7e3-cd04-43a1-a653-56c327468d60 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:56.166281 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b83ff7e3-cd04-43a1-a653-56c327468d60 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546" status: 200 len: 1238 microversion: 2.1 time: 0.228545 Jun 10 18:32:56.166988 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3242/6438] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:55 2022] GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546 => generated 1238 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:32:56.242270 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-56fe3c15-1948-44ce-b7ea-c3dbac6edc19 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20faf80443114211af1c7ea53724dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7224d6e7eb4188b58412209e8d3c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:56.257027 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-56fe3c15-1948-44ce-b7ea-c3dbac6edc19 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] 10.222.0.35 "GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba" status: 200 len: 1499 microversion: 2.1 time: 0.393156 Jun 10 18:32:56.257643 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3197/6439] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:55 2022] GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba => generated 1499 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:32:57.190417 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e49b2947-7a7b-4a1a-8b84-2680f77e1c1d tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:57.194026 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e49b2947-7a7b-4a1a-8b84-2680f77e1c1d tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: cf4aaf4f-5855-4034-a1a5-2bfb200ad546] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:57.205064 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:32:57.270543 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e49b2947-7a7b-4a1a-8b84-2680f77e1c1d tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:57.280361 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a976e6dd-1258-4f04-8c83-71435ac18fcd tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:57.281981 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a976e6dd-1258-4f04-8c83-71435ac18fcd tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] [instance: 0f203cb7-5930-44a8-83f0-075144d98aba] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:57.288929 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e49b2947-7a7b-4a1a-8b84-2680f77e1c1d tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546" status: 200 len: 1238 microversion: 2.1 time: 0.109497 Jun 10 18:32:57.289538 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3243/6440] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:57 2022] GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546 => generated 1238 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:32:57.291957 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a976e6dd-1258-4f04-8c83-71435ac18fcd tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:57.292448 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a976e6dd-1258-4f04-8c83-71435ac18fcd tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:57.293445 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a976e6dd-1258-4f04-8c83-71435ac18fcd tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:57.293887 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a976e6dd-1258-4f04-8c83-71435ac18fcd tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:57.577413 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a976e6dd-1258-4f04-8c83-71435ac18fcd tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20faf80443114211af1c7ea53724dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7224d6e7eb4188b58412209e8d3c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:57.586429 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a976e6dd-1258-4f04-8c83-71435ac18fcd tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] 10.222.0.35 "GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba" status: 200 len: 1499 microversion: 2.1 time: 0.314108 Jun 10 18:32:57.596265 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3198/6441] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:57 2022] GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba => generated 1499 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:32:58.305785 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-201ea471-2c35-4619-a46b-a7929e1f664f tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:58.307596 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-201ea471-2c35-4619-a46b-a7929e1f664f tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: cf4aaf4f-5855-4034-a1a5-2bfb200ad546] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:58.322275 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-201ea471-2c35-4619-a46b-a7929e1f664f tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:58.323036 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-201ea471-2c35-4619-a46b-a7929e1f664f tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:58.324027 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-201ea471-2c35-4619-a46b-a7929e1f664f tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:58.326853 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-201ea471-2c35-4619-a46b-a7929e1f664f tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:58.492668 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-201ea471-2c35-4619-a46b-a7929e1f664f tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:58.501689 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-201ea471-2c35-4619-a46b-a7929e1f664f tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546" status: 200 len: 1290 microversion: 2.1 time: 0.199692 Jun 10 18:32:58.503079 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3244/6442] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:58 2022] GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546 => generated 1290 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:32:58.605187 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-302afbe8-b538-4d6b-ad77-43cbfa14ac89 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:58.605752 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-302afbe8-b538-4d6b-ad77-43cbfa14ac89 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] [instance: 0f203cb7-5930-44a8-83f0-075144d98aba] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:58.621176 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-302afbe8-b538-4d6b-ad77-43cbfa14ac89 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:58.621639 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-302afbe8-b538-4d6b-ad77-43cbfa14ac89 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:58.622572 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-302afbe8-b538-4d6b-ad77-43cbfa14ac89 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:58.623211 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-302afbe8-b538-4d6b-ad77-43cbfa14ac89 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:58.967625 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-302afbe8-b538-4d6b-ad77-43cbfa14ac89 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20faf80443114211af1c7ea53724dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7224d6e7eb4188b58412209e8d3c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:58.971227 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:32:58.975721 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-302afbe8-b538-4d6b-ad77-43cbfa14ac89 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] 10.222.0.35 "GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba" status: 200 len: 1499 microversion: 2.1 time: 0.375770 Jun 10 18:32:58.976341 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3199/6443] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:58 2022] GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba => generated 1499 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:32:59.520726 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b3603166-95e6-4dc4-93f1-281507f8c9ca tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:59.521480 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b3603166-95e6-4dc4-93f1-281507f8c9ca tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: cf4aaf4f-5855-4034-a1a5-2bfb200ad546] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:32:59.539339 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b3603166-95e6-4dc4-93f1-281507f8c9ca tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:59.542339 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b3603166-95e6-4dc4-93f1-281507f8c9ca tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:59.546035 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b3603166-95e6-4dc4-93f1-281507f8c9ca tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:32:59.546035 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b3603166-95e6-4dc4-93f1-281507f8c9ca tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:32:59.706623 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b3603166-95e6-4dc4-93f1-281507f8c9ca tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:32:59.715162 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b3603166-95e6-4dc4-93f1-281507f8c9ca tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546" status: 200 len: 1296 microversion: 2.1 time: 0.199819 Jun 10 18:32:59.715906 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3245/6444] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:59 2022] GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546 => generated 1296 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:32:59.994006 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9bc6499d-a72d-49ee-a0c1-7ae406268b23 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:32:59.995334 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9bc6499d-a72d-49ee-a0c1-7ae406268b23 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] [instance: 0f203cb7-5930-44a8-83f0-075144d98aba] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:00.006998 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9bc6499d-a72d-49ee-a0c1-7ae406268b23 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:00.007689 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9bc6499d-a72d-49ee-a0c1-7ae406268b23 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:00.008596 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9bc6499d-a72d-49ee-a0c1-7ae406268b23 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:00.009149 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9bc6499d-a72d-49ee-a0c1-7ae406268b23 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:00.037843 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:33:00.293243 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9bc6499d-a72d-49ee-a0c1-7ae406268b23 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20faf80443114211af1c7ea53724dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7224d6e7eb4188b58412209e8d3c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:00.306937 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9bc6499d-a72d-49ee-a0c1-7ae406268b23 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] 10.222.0.35 "GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba" status: 200 len: 1502 microversion: 2.1 time: 0.318114 Jun 10 18:33:00.307543 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3200/6445] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:32:59 2022] GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba => generated 1502 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:00.323831 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b8ef5820-5e02-42fd-b031-f77a764ba144 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:33:00.324402 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b8ef5820-5e02-42fd-b031-f77a764ba144 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] [instance: 0f203cb7-5930-44a8-83f0-075144d98aba] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:00.341606 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b8ef5820-5e02-42fd-b031-f77a764ba144 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:00.342045 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b8ef5820-5e02-42fd-b031-f77a764ba144 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:00.342849 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b8ef5820-5e02-42fd-b031-f77a764ba144 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:00.343500 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b8ef5820-5e02-42fd-b031-f77a764ba144 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:00.370380 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-b8ef5820-5e02-42fd-b031-f77a764ba144 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lazy-loading 'flavor' on Instance uuid 0f203cb7-5930-44a8-83f0-075144d98aba {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:33:00.692849 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b8ef5820-5e02-42fd-b031-f77a764ba144 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] 10.222.0.35 "POST /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba/action" status: 202 len: 0 microversion: 2.1 time: 0.373035 Jun 10 18:33:00.704510 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3246/6446] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:33:00 2022] POST /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:33:00.704683 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a1a3e5d2-2366-4b86-895b-406fd4c16f56 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:00.705162 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a1a3e5d2-2366-4b86-895b-406fd4c16f56 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] [instance: 0f203cb7-5930-44a8-83f0-075144d98aba] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:00.724811 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a1a3e5d2-2366-4b86-895b-406fd4c16f56 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:00.725606 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a1a3e5d2-2366-4b86-895b-406fd4c16f56 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:00.736830 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a1a3e5d2-2366-4b86-895b-406fd4c16f56 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:00.737307 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a1a3e5d2-2366-4b86-895b-406fd4c16f56 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:00.738453 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-91d6549f-a350-4cb1-9f51-7dc3da2dd56a tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:00.739365 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-91d6549f-a350-4cb1-9f51-7dc3da2dd56a tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: cf4aaf4f-5855-4034-a1a5-2bfb200ad546] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:00.752871 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-91d6549f-a350-4cb1-9f51-7dc3da2dd56a tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:00.753339 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-91d6549f-a350-4cb1-9f51-7dc3da2dd56a tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:00.754141 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-91d6549f-a350-4cb1-9f51-7dc3da2dd56a tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:00.754595 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-91d6549f-a350-4cb1-9f51-7dc3da2dd56a tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:00.971733 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-91d6549f-a350-4cb1-9f51-7dc3da2dd56a tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:00.983833 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-91d6549f-a350-4cb1-9f51-7dc3da2dd56a tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546" status: 200 len: 1364 microversion: 2.1 time: 0.252803 Jun 10 18:33:00.984677 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3247/6447] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:00 2022] GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546 => generated 1364 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:01.513061 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a1a3e5d2-2366-4b86-895b-406fd4c16f56 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20faf80443114211af1c7ea53724dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7224d6e7eb4188b58412209e8d3c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:01.528175 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a1a3e5d2-2366-4b86-895b-406fd4c16f56 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] 10.222.0.35 "GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba" status: 200 len: 1510 microversion: 2.1 time: 0.828148 Jun 10 18:33:01.529644 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3201/6448] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:00 2022] GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba => generated 1510 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:02.002348 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f501c801-7b47-4b65-9751-0c176f6af863 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:02.003615 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f501c801-7b47-4b65-9751-0c176f6af863 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: cf4aaf4f-5855-4034-a1a5-2bfb200ad546] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:02.011469 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f501c801-7b47-4b65-9751-0c176f6af863 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:02.012361 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f501c801-7b47-4b65-9751-0c176f6af863 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:02.013198 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f501c801-7b47-4b65-9751-0c176f6af863 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:02.013830 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f501c801-7b47-4b65-9751-0c176f6af863 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:02.129454 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ed792458-1208-4809-8fe2-8caffc84725f tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:02.130366 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ed792458-1208-4809-8fe2-8caffc84725f tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:02.145673 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ed792458-1208-4809-8fe2-8caffc84725f tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:02.146452 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ed792458-1208-4809-8fe2-8caffc84725f tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:02.149173 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ed792458-1208-4809-8fe2-8caffc84725f tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:02.149884 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ed792458-1208-4809-8fe2-8caffc84725f tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:02.428088 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f501c801-7b47-4b65-9751-0c176f6af863 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:02.452908 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f501c801-7b47-4b65-9751-0c176f6af863 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546" status: 200 len: 1364 microversion: 2.1 time: 0.449404 Jun 10 18:33:02.453956 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3248/6449] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:01 2022] GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546 => generated 1364 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:02.546870 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ca38320d-c416-43d1-93c8-f634de0ab211 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:02.547416 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ca38320d-c416-43d1-93c8-f634de0ab211 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] [instance: 0f203cb7-5930-44a8-83f0-075144d98aba] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:02.556852 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ca38320d-c416-43d1-93c8-f634de0ab211 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:02.559458 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ca38320d-c416-43d1-93c8-f634de0ab211 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:02.561183 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ca38320d-c416-43d1-93c8-f634de0ab211 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:02.563083 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ca38320d-c416-43d1-93c8-f634de0ab211 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:02.834265 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ed792458-1208-4809-8fe2-8caffc84725f tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1833 microversion: 2.1 time: 0.707599 Jun 10 18:33:02.835487 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3202/6450] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:02 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1833 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:33:02.927116 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ca38320d-c416-43d1-93c8-f634de0ab211 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20faf80443114211af1c7ea53724dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7224d6e7eb4188b58412209e8d3c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:02.937412 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ca38320d-c416-43d1-93c8-f634de0ab211 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] 10.222.0.35 "GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba" status: 200 len: 1493 microversion: 2.1 time: 0.394800 Jun 10 18:33:02.938011 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3249/6451] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:02 2022] GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba => generated 1493 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:02.959172 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-14c54b5f-c1d3-4a78-a9e5-4d15c236a95b tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:33:02.960065 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-14c54b5f-c1d3-4a78-a9e5-4d15c236a95b tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] [instance: 0f203cb7-5930-44a8-83f0-075144d98aba] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:02.976032 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-14c54b5f-c1d3-4a78-a9e5-4d15c236a95b tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:02.976899 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-14c54b5f-c1d3-4a78-a9e5-4d15c236a95b tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:02.984683 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-14c54b5f-c1d3-4a78-a9e5-4d15c236a95b tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:02.985384 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-14c54b5f-c1d3-4a78-a9e5-4d15c236a95b tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:03.186728 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-e9fc448a-3d2f-476c-9347-3b5b53a8d112 req-04aaf685-1965-4311-ab66-659da40ef9df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf4aaf4f-5855-4034-a1a5-2bfb200ad546", "tag": "d943c54d-812b-4474-a394-0b5123af99b3"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:33:03.216271 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-e9fc448a-3d2f-476c-9347-3b5b53a8d112 req-04aaf685-1965-4311-ab66-659da40ef9df service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:03.217578 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-e9fc448a-3d2f-476c-9347-3b5b53a8d112 req-04aaf685-1965-4311-ab66-659da40ef9df service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:03.282325 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-e9fc448a-3d2f-476c-9347-3b5b53a8d112 req-04aaf685-1965-4311-ab66-659da40ef9df service nova] Creating event network-changed:d943c54d-812b-4474-a394-0b5123af99b3 for instance cf4aaf4f-5855-4034-a1a5-2bfb200ad546 on chh1-master-2 Jun 10 18:33:03.295465 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-14c54b5f-c1d3-4a78-a9e5-4d15c236a95b tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] 10.222.0.35 "POST /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba/action" status: 202 len: 0 microversion: 2.1 time: 0.342967 Jun 10 18:33:03.299601 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3203/6452] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:33:02 2022] POST /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:33:03.302106 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-e9fc448a-3d2f-476c-9347-3b5b53a8d112 req-04aaf685-1965-4311-ab66-659da40ef9df service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115222 Jun 10 18:33:03.306956 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3250/6453] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:33:03.316391 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d22390c3-21d7-4dcc-961d-73b29c910568 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:03.322497 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d22390c3-21d7-4dcc-961d-73b29c910568 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] [instance: 0f203cb7-5930-44a8-83f0-075144d98aba] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:03.357805 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d22390c3-21d7-4dcc-961d-73b29c910568 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:03.358740 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d22390c3-21d7-4dcc-961d-73b29c910568 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:03.366763 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d22390c3-21d7-4dcc-961d-73b29c910568 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:03.367354 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d22390c3-21d7-4dcc-961d-73b29c910568 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:03.484287 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8657c363-a2a9-4fb4-b3ac-b212946780fb tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:03.489007 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8657c363-a2a9-4fb4-b3ac-b212946780fb tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: cf4aaf4f-5855-4034-a1a5-2bfb200ad546] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:03.511556 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8657c363-a2a9-4fb4-b3ac-b212946780fb tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:03.516075 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8657c363-a2a9-4fb4-b3ac-b212946780fb tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:03.521361 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8657c363-a2a9-4fb4-b3ac-b212946780fb tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:03.524097 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8657c363-a2a9-4fb4-b3ac-b212946780fb tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:04.750342 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8657c363-a2a9-4fb4-b3ac-b212946780fb tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:04.768338 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8657c363-a2a9-4fb4-b3ac-b212946780fb tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546" status: 200 len: 1364 microversion: 2.1 time: 1.296173 Jun 10 18:33:04.778450 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3251/6454] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:03 2022] GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546 => generated 1364 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:33:04.811494 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d22390c3-21d7-4dcc-961d-73b29c910568 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20faf80443114211af1c7ea53724dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7224d6e7eb4188b58412209e8d3c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:04.827714 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d22390c3-21d7-4dcc-961d-73b29c910568 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] 10.222.0.35 "GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba" status: 200 len: 1499 microversion: 2.1 time: 1.525324 Jun 10 18:33:04.830071 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3204/6455] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:03 2022] GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba => generated 1499 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:05.810839 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-daa2dd84-dd78-4071-b73b-9aa9923c7303 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:05.811501 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-daa2dd84-dd78-4071-b73b-9aa9923c7303 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: cf4aaf4f-5855-4034-a1a5-2bfb200ad546] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:05.843670 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:33:05.849838 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-daa2dd84-dd78-4071-b73b-9aa9923c7303 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:05.850179 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-daa2dd84-dd78-4071-b73b-9aa9923c7303 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:05.851013 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-daa2dd84-dd78-4071-b73b-9aa9923c7303 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:05.854180 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-daa2dd84-dd78-4071-b73b-9aa9923c7303 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:05.857684 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a9c76044-549a-4769-970d-a19bd4531214 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:05.864148 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a9c76044-549a-4769-970d-a19bd4531214 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] [instance: 0f203cb7-5930-44a8-83f0-075144d98aba] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:05.877955 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a9c76044-549a-4769-970d-a19bd4531214 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:05.878428 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a9c76044-549a-4769-970d-a19bd4531214 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:05.886763 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a9c76044-549a-4769-970d-a19bd4531214 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:05.892867 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a9c76044-549a-4769-970d-a19bd4531214 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:06.774579 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-daa2dd84-dd78-4071-b73b-9aa9923c7303 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:06.786560 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-daa2dd84-dd78-4071-b73b-9aa9923c7303 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546" status: 200 len: 1364 microversion: 2.1 time: 1.003105 Jun 10 18:33:06.787160 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3252/6456] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:05 2022] GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546 => generated 1364 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:06.797222 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d4a418be-6dee-497e-b3f1-860e45dde097 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-553912979", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "46741b25-67bf-4bd5-a980-a72ecc97683f"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:33:06.914205 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-d4a418be-6dee-497e-b3f1-860e45dde097 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] validate_networks() for [('46741b25-67bf-4bd5-a980-a72ecc97683f', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:33:07.126836 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a9c76044-549a-4769-970d-a19bd4531214 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20faf80443114211af1c7ea53724dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7224d6e7eb4188b58412209e8d3c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:07.135629 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a9c76044-549a-4769-970d-a19bd4531214 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] 10.222.0.35 "GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba" status: 200 len: 1499 microversion: 2.1 time: 1.292320 Jun 10 18:33:07.144348 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3205/6457] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:05 2022] GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba => generated 1499 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:07.285589 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=10 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:33:07.536953 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6b44429c-b1d1-4954-8176-4d7dfd8b0980 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:07.537510 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6b44429c-b1d1-4954-8176-4d7dfd8b0980 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:07.545614 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6b44429c-b1d1-4954-8176-4d7dfd8b0980 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:07.549194 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6b44429c-b1d1-4954-8176-4d7dfd8b0980 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:07.550139 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6b44429c-b1d1-4954-8176-4d7dfd8b0980 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:07.550592 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6b44429c-b1d1-4954-8176-4d7dfd8b0980 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:07.631419 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6b44429c-b1d1-4954-8176-4d7dfd8b0980 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:33:07.956555 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6b44429c-b1d1-4954-8176-4d7dfd8b0980 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "DELETE /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 204 len: 0 microversion: 2.1 time: 0.425255 Jun 10 18:33:07.957471 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3206/6458] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:33:07 2022] DELETE /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:33:07.963770 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-9ff98150-4bee-4698-bea3-6f27fe34af1a req-e7b1ea2c-7f9c-4852-96fb-8aab0cc1512e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c36e064f-7f56-4f6b-81bf-45b449eda791", "tag": "e152d0f1-e50b-4888-9524-a46fb6cc5899"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:33:07.990602 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-9ff98150-4bee-4698-bea3-6f27fe34af1a req-e7b1ea2c-7f9c-4852-96fb-8aab0cc1512e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:07.990602 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-9ff98150-4bee-4698-bea3-6f27fe34af1a req-e7b1ea2c-7f9c-4852-96fb-8aab0cc1512e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:08.024131 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-9ff98150-4bee-4698-bea3-6f27fe34af1a req-e7b1ea2c-7f9c-4852-96fb-8aab0cc1512e service nova] Creating event network-changed:e152d0f1-e50b-4888-9524-a46fb6cc5899 for instance c36e064f-7f56-4f6b-81bf-45b449eda791 on chh2-master-2 Jun 10 18:33:08.032513 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-9ff98150-4bee-4698-bea3-6f27fe34af1a req-e7b1ea2c-7f9c-4852-96fb-8aab0cc1512e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073321 Jun 10 18:33:08.033659 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3207/6459] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:33:08.080250 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c267eda0-c028-4f17-97dd-1e704f62b1ff tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:08.085150 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c267eda0-c028-4f17-97dd-1e704f62b1ff tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: cf4aaf4f-5855-4034-a1a5-2bfb200ad546] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:08.098489 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-d4a418be-6dee-497e-b3f1-860e45dde097 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:33:08.099535 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-d4a418be-6dee-497e-b3f1-860e45dde097 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:33:08.100179 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-d4a418be-6dee-497e-b3f1-860e45dde097 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:33:08.100803 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-d4a418be-6dee-497e-b3f1-860e45dde097 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:33:08.101385 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-d4a418be-6dee-497e-b3f1-860e45dde097 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:33:08.126374 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c267eda0-c028-4f17-97dd-1e704f62b1ff tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:08.127164 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d4a418be-6dee-497e-b3f1-860e45dde097 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:08.127812 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d4a418be-6dee-497e-b3f1-860e45dde097 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:08.128689 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c267eda0-c028-4f17-97dd-1e704f62b1ff tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:08.129610 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d4a418be-6dee-497e-b3f1-860e45dde097 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:08.130224 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d4a418be-6dee-497e-b3f1-860e45dde097 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:08.131103 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c267eda0-c028-4f17-97dd-1e704f62b1ff tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:08.133944 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c267eda0-c028-4f17-97dd-1e704f62b1ff tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:08.154075 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-d4a418be-6dee-497e-b3f1-860e45dde097 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Getting quotas for project e2a8d819ba8844878f82cf60131df725. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:33:08.168295 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-d4a418be-6dee-497e-b3f1-860e45dde097 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Getting quotas for user 3aa5b7f650884ee59282ce97f48fc0e6 and project e2a8d819ba8844878f82cf60131df725. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:33:08.202027 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d4a418be-6dee-497e-b3f1-860e45dde097 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:33:08.206472 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d4a418be-6dee-497e-b3f1-860e45dde097 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] [instance: 32c2282f-8127-41a3-b616-ba0d58394128] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:33:08.383894 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d4a418be-6dee-497e-b3f1-860e45dde097 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.595395 Jun 10 18:33:08.399520 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3253/6460] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:33:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:33:08.411481 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-17a01e38-2e56-47ff-bf2b-a398d51f02d0 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:08.415418 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-17a01e38-2e56-47ff-bf2b-a398d51f02d0 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:08.452267 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-17a01e38-2e56-47ff-bf2b-a398d51f02d0 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:08.452975 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-17a01e38-2e56-47ff-bf2b-a398d51f02d0 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:08.454715 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-17a01e38-2e56-47ff-bf2b-a398d51f02d0 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:08.455365 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-17a01e38-2e56-47ff-bf2b-a398d51f02d0 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:08.623921 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c267eda0-c028-4f17-97dd-1e704f62b1ff tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:08.634548 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c267eda0-c028-4f17-97dd-1e704f62b1ff tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546" status: 200 len: 1364 microversion: 2.1 time: 0.599412 Jun 10 18:33:08.637320 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3208/6461] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:08 2022] GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546 => generated 1364 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:08.653577 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b1e8121f-4953-4207-91f6-b5e3bf1bb7c7 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:08.655166 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b1e8121f-4953-4207-91f6-b5e3bf1bb7c7 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] [instance: 0f203cb7-5930-44a8-83f0-075144d98aba] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:08.664046 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b1e8121f-4953-4207-91f6-b5e3bf1bb7c7 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:08.664808 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b1e8121f-4953-4207-91f6-b5e3bf1bb7c7 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:08.666411 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b1e8121f-4953-4207-91f6-b5e3bf1bb7c7 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:08.667048 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b1e8121f-4953-4207-91f6-b5e3bf1bb7c7 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:08.950775 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b1e8121f-4953-4207-91f6-b5e3bf1bb7c7 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20faf80443114211af1c7ea53724dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7224d6e7eb4188b58412209e8d3c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:08.977663 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b1e8121f-4953-4207-91f6-b5e3bf1bb7c7 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] 10.222.0.35 "GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba" status: 200 len: 1502 microversion: 2.1 time: 0.328483 Jun 10 18:33:08.980269 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3209/6462] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:08 2022] GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba => generated 1502 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:08.991066 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f7b950a8-9ff1-4a15-946a-4b1e6c28ef0b tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:08.993181 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f7b950a8-9ff1-4a15-946a-4b1e6c28ef0b tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] [instance: 32c2282f-8127-41a3-b616-ba0d58394128] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:08.996230 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-17a01e38-2e56-47ff-bf2b-a398d51f02d0 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:09.026092 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-17a01e38-2e56-47ff-bf2b-a398d51f02d0 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1688 microversion: 2.1 time: 0.617960 Jun 10 18:33:09.026092 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3254/6463] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:08 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1688 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:09.026092 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f9fc1a9c-8733-4ad0-b5a0-9bcafc523c08 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:09.026092 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f9fc1a9c-8733-4ad0-b5a0-9bcafc523c08 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] [instance: 0f203cb7-5930-44a8-83f0-075144d98aba] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:09.042194 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f9fc1a9c-8733-4ad0-b5a0-9bcafc523c08 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:09.047016 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f9fc1a9c-8733-4ad0-b5a0-9bcafc523c08 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:09.047016 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f9fc1a9c-8733-4ad0-b5a0-9bcafc523c08 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:09.047016 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f9fc1a9c-8733-4ad0-b5a0-9bcafc523c08 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:09.072374 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f9fc1a9c-8733-4ad0-b5a0-9bcafc523c08 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] [instance: 0f203cb7-5930-44a8-83f0-075144d98aba] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:33:09.075793 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:33:09.121907 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f7b950a8-9ff1-4a15-946a-4b1e6c28ef0b tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa5b7f650884ee59282ce97f48fc0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a8d819ba8844878f82cf60131df725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:09.130172 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f7b950a8-9ff1-4a15-946a-4b1e6c28ef0b tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] 10.222.0.35 "GET /compute/v2.1/servers/32c2282f-8127-41a3-b616-ba0d58394128" status: 200 len: 1218 microversion: 2.1 time: 0.148019 Jun 10 18:33:09.131960 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3210/6464] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:08 2022] GET /compute/v2.1/servers/32c2282f-8127-41a3-b616-ba0d58394128 => generated 1218 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:09.424189 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f9fc1a9c-8733-4ad0-b5a0-9bcafc523c08 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] 10.222.0.35 "DELETE /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba" status: 204 len: 0 microversion: 2.1 time: 0.408699 Jun 10 18:33:09.428192 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3255/6465] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:33:09 2022] DELETE /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:33:09.434998 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7b676614-81b1-4e4a-99e0-7ea81266bcc6 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:09.435615 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7b676614-81b1-4e4a-99e0-7ea81266bcc6 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] [instance: 0f203cb7-5930-44a8-83f0-075144d98aba] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:09.443106 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b676614-81b1-4e4a-99e0-7ea81266bcc6 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:09.446262 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b676614-81b1-4e4a-99e0-7ea81266bcc6 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:09.446262 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b676614-81b1-4e4a-99e0-7ea81266bcc6 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:09.446262 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b676614-81b1-4e4a-99e0-7ea81266bcc6 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:09.663152 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9136b6ee-86d3-41b5-beeb-58bee23ff2ab tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:09.664645 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9136b6ee-86d3-41b5-beeb-58bee23ff2ab tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: cf4aaf4f-5855-4034-a1a5-2bfb200ad546] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:09.679142 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9136b6ee-86d3-41b5-beeb-58bee23ff2ab tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:09.680610 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9136b6ee-86d3-41b5-beeb-58bee23ff2ab tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:09.682199 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9136b6ee-86d3-41b5-beeb-58bee23ff2ab tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:09.682861 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9136b6ee-86d3-41b5-beeb-58bee23ff2ab tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:09.729920 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7b676614-81b1-4e4a-99e0-7ea81266bcc6 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20faf80443114211af1c7ea53724dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7224d6e7eb4188b58412209e8d3c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:09.739518 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7b676614-81b1-4e4a-99e0-7ea81266bcc6 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] 10.222.0.35 "GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba" status: 200 len: 1508 microversion: 2.1 time: 0.308363 Jun 10 18:33:09.740670 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3211/6466] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:09 2022] GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba => generated 1508 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:10.033711 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2b1be54f-6bd7-4cfc-83ab-5072869ca34e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:10.036540 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2b1be54f-6bd7-4cfc-83ab-5072869ca34e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:10.043030 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2b1be54f-6bd7-4cfc-83ab-5072869ca34e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:10.044018 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2b1be54f-6bd7-4cfc-83ab-5072869ca34e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:10.046494 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2b1be54f-6bd7-4cfc-83ab-5072869ca34e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:10.047183 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2b1be54f-6bd7-4cfc-83ab-5072869ca34e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:10.364363 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2b1be54f-6bd7-4cfc-83ab-5072869ca34e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:10.373966 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2b1be54f-6bd7-4cfc-83ab-5072869ca34e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1688 microversion: 2.1 time: 0.344563 Jun 10 18:33:10.376623 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3212/6467] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:10 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1688 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:10.382495 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5f1d2d2e-63e9-4ddb-aa58-99ab6c52ba04 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:10.383379 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5f1d2d2e-63e9-4ddb-aa58-99ab6c52ba04 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] [instance: 32c2282f-8127-41a3-b616-ba0d58394128] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:10.391318 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5f1d2d2e-63e9-4ddb-aa58-99ab6c52ba04 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:10.391899 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5f1d2d2e-63e9-4ddb-aa58-99ab6c52ba04 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:10.396349 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5f1d2d2e-63e9-4ddb-aa58-99ab6c52ba04 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:10.396349 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5f1d2d2e-63e9-4ddb-aa58-99ab6c52ba04 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:10.486906 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5f1d2d2e-63e9-4ddb-aa58-99ab6c52ba04 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa5b7f650884ee59282ce97f48fc0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a8d819ba8844878f82cf60131df725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:10.495630 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5f1d2d2e-63e9-4ddb-aa58-99ab6c52ba04 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] 10.222.0.35 "GET /compute/v2.1/servers/32c2282f-8127-41a3-b616-ba0d58394128" status: 200 len: 1222 microversion: 2.1 time: 0.117167 Jun 10 18:33:10.495877 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3213/6468] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:10 2022] GET /compute/v2.1/servers/32c2282f-8127-41a3-b616-ba0d58394128 => generated 1222 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:10.508072 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9136b6ee-86d3-41b5-beeb-58bee23ff2ab tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:10.517277 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9136b6ee-86d3-41b5-beeb-58bee23ff2ab tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546" status: 200 len: 1364 microversion: 2.1 time: 0.866616 Jun 10 18:33:10.526892 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3256/6469] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:09 2022] GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546 => generated 1364 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:10.742001 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d550373f-b5bc-4072-97aa-272c06eef400 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:10.742794 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d550373f-b5bc-4072-97aa-272c06eef400 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 66557f04-2de0-41eb-b4a5-23bcbef9865f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:10.750081 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d550373f-b5bc-4072-97aa-272c06eef400 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:10.750739 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d550373f-b5bc-4072-97aa-272c06eef400 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:10.754403 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d550373f-b5bc-4072-97aa-272c06eef400 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:10.755012 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d550373f-b5bc-4072-97aa-272c06eef400 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:10.765411 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-359d8e7d-301f-42b8-91c1-4f8b024ab14d tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:10.766051 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-359d8e7d-301f-42b8-91c1-4f8b024ab14d tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] [instance: 0f203cb7-5930-44a8-83f0-075144d98aba] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:10.777127 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-359d8e7d-301f-42b8-91c1-4f8b024ab14d tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:10.777798 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-359d8e7d-301f-42b8-91c1-4f8b024ab14d tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:10.778705 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-359d8e7d-301f-42b8-91c1-4f8b024ab14d tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:10.779311 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-359d8e7d-301f-42b8-91c1-4f8b024ab14d tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:10.787118 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d550373f-b5bc-4072-97aa-272c06eef400 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 66557f04-2de0-41eb-b4a5-23bcbef9865f] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:33:10.836275 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:33:11.131790 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-359d8e7d-301f-42b8-91c1-4f8b024ab14d tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20faf80443114211af1c7ea53724dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7224d6e7eb4188b58412209e8d3c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:11.140647 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-359d8e7d-301f-42b8-91c1-4f8b024ab14d tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] 10.222.0.35 "GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba" status: 200 len: 1508 microversion: 2.1 time: 0.386277 Jun 10 18:33:11.145396 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3257/6470] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:10 2022] GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba => generated 1508 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:11.153218 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d550373f-b5bc-4072-97aa-272c06eef400 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "DELETE /compute/v2.1/servers/66557f04-2de0-41eb-b4a5-23bcbef9865f" status: 204 len: 0 microversion: 2.1 time: 0.414108 Jun 10 18:33:11.154086 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3214/6471] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:33:10 2022] DELETE /compute/v2.1/servers/66557f04-2de0-41eb-b4a5-23bcbef9865f => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:33:11.162469 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6e6d2aab-1f85-4f61-aba7-741b57ddc4a9 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:11.170553 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6e6d2aab-1f85-4f61-aba7-741b57ddc4a9 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 66557f04-2de0-41eb-b4a5-23bcbef9865f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:11.183393 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6e6d2aab-1f85-4f61-aba7-741b57ddc4a9 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:11.184774 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6e6d2aab-1f85-4f61-aba7-741b57ddc4a9 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:11.185895 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6e6d2aab-1f85-4f61-aba7-741b57ddc4a9 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:11.186603 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6e6d2aab-1f85-4f61-aba7-741b57ddc4a9 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:11.396330 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3cfb92ab-1fa5-405c-afc9-cf38db1a8632 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:11.397899 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3cfb92ab-1fa5-405c-afc9-cf38db1a8632 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:11.420930 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3cfb92ab-1fa5-405c-afc9-cf38db1a8632 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:11.427909 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3cfb92ab-1fa5-405c-afc9-cf38db1a8632 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:11.429359 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3cfb92ab-1fa5-405c-afc9-cf38db1a8632 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:11.432384 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3cfb92ab-1fa5-405c-afc9-cf38db1a8632 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:11.733389 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6e6d2aab-1f85-4f61-aba7-741b57ddc4a9 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:11.746213 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6e6d2aab-1f85-4f61-aba7-741b57ddc4a9 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/66557f04-2de0-41eb-b4a5-23bcbef9865f" status: 200 len: 1552 microversion: 2.1 time: 0.587705 Jun 10 18:33:11.746828 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3258/6472] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:11 2022] GET /compute/v2.1/servers/66557f04-2de0-41eb-b4a5-23bcbef9865f => generated 1552 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:11.751620 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a5596386-6ce7-4c4f-841d-acad7f1d7efd tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:11.752250 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a5596386-6ce7-4c4f-841d-acad7f1d7efd tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] [instance: 32c2282f-8127-41a3-b616-ba0d58394128] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:11.786343 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a5596386-6ce7-4c4f-841d-acad7f1d7efd tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:11.789924 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a5596386-6ce7-4c4f-841d-acad7f1d7efd tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:11.791117 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a5596386-6ce7-4c4f-841d-acad7f1d7efd tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:11.793667 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a5596386-6ce7-4c4f-841d-acad7f1d7efd tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:11.948523 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3cfb92ab-1fa5-405c-afc9-cf38db1a8632 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:11.962444 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3cfb92ab-1fa5-405c-afc9-cf38db1a8632 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1688 microversion: 2.1 time: 0.571606 Jun 10 18:33:11.965250 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3215/6473] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:11 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1688 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:11.988672 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8401732f-2c3b-48f8-8201-6b19b1fa15bb tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:11.988672 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8401732f-2c3b-48f8-8201-6b19b1fa15bb tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: cf4aaf4f-5855-4034-a1a5-2bfb200ad546] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:12.005666 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8401732f-2c3b-48f8-8201-6b19b1fa15bb tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:12.006140 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8401732f-2c3b-48f8-8201-6b19b1fa15bb tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:12.006935 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8401732f-2c3b-48f8-8201-6b19b1fa15bb tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:12.007386 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8401732f-2c3b-48f8-8201-6b19b1fa15bb tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:12.058720 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a5596386-6ce7-4c4f-841d-acad7f1d7efd tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa5b7f650884ee59282ce97f48fc0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a8d819ba8844878f82cf60131df725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:12.070884 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a5596386-6ce7-4c4f-841d-acad7f1d7efd tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] 10.222.0.35 "GET /compute/v2.1/servers/32c2282f-8127-41a3-b616-ba0d58394128" status: 200 len: 1214 microversion: 2.1 time: 0.322272 Jun 10 18:33:12.073038 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3259/6474] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:11 2022] GET /compute/v2.1/servers/32c2282f-8127-41a3-b616-ba0d58394128 => generated 1214 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:12.079536 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-b288340f-5d01-498c-abf3-fb872bf52a55 req-6053154a-8494-4b88-9fdb-04649dfd8446 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf4aaf4f-5855-4034-a1a5-2bfb200ad546", "name": "network-vif-plugged", "status": "completed", "tag": "d943c54d-812b-4474-a394-0b5123af99b3"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:33:12.091032 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-b288340f-5d01-498c-abf3-fb872bf52a55 req-6053154a-8494-4b88-9fdb-04649dfd8446 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:12.091494 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-b288340f-5d01-498c-abf3-fb872bf52a55 req-6053154a-8494-4b88-9fdb-04649dfd8446 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:12.108224 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-b288340f-5d01-498c-abf3-fb872bf52a55 req-6053154a-8494-4b88-9fdb-04649dfd8446 service nova] Creating event network-vif-plugged:d943c54d-812b-4474-a394-0b5123af99b3 for instance cf4aaf4f-5855-4034-a1a5-2bfb200ad546 on chh1-master-2 Jun 10 18:33:12.113742 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-b288340f-5d01-498c-abf3-fb872bf52a55 req-6053154a-8494-4b88-9fdb-04649dfd8446 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039344 Jun 10 18:33:12.115389 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3260/6475] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:33:12.159499 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-00ad4fba-08f1-4074-8549-8b5cf6a3d959 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:12.168726 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-00ad4fba-08f1-4074-8549-8b5cf6a3d959 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] [instance: 0f203cb7-5930-44a8-83f0-075144d98aba] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:12.184282 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-00ad4fba-08f1-4074-8549-8b5cf6a3d959 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:12.185272 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-00ad4fba-08f1-4074-8549-8b5cf6a3d959 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:12.188392 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-00ad4fba-08f1-4074-8549-8b5cf6a3d959 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:12.189047 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-00ad4fba-08f1-4074-8549-8b5cf6a3d959 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:12.541286 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-00ad4fba-08f1-4074-8549-8b5cf6a3d959 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20faf80443114211af1c7ea53724dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7224d6e7eb4188b58412209e8d3c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:12.550045 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-00ad4fba-08f1-4074-8549-8b5cf6a3d959 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] 10.222.0.35 "GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba" status: 200 len: 1508 microversion: 2.1 time: 0.395061 Jun 10 18:33:12.552975 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3261/6476] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:12 2022] GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba => generated 1508 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:12.763816 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3909615f-d53b-4b42-b7a3-6ca5769c2768 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:12.764721 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3909615f-d53b-4b42-b7a3-6ca5769c2768 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 66557f04-2de0-41eb-b4a5-23bcbef9865f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:12.774626 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3909615f-d53b-4b42-b7a3-6ca5769c2768 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:12.777766 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3909615f-d53b-4b42-b7a3-6ca5769c2768 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:12.778934 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3909615f-d53b-4b42-b7a3-6ca5769c2768 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:12.783201 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3909615f-d53b-4b42-b7a3-6ca5769c2768 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:12.954305 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8401732f-2c3b-48f8-8201-6b19b1fa15bb tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:12.963994 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8401732f-2c3b-48f8-8201-6b19b1fa15bb tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546" status: 200 len: 1364 microversion: 2.1 time: 0.996064 Jun 10 18:33:12.964865 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3216/6477] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:11 2022] GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546 => generated 1364 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:12.981752 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fc7daf8e-f125-4b31-9a8a-12fb1cd76d30 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:12.982462 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fc7daf8e-f125-4b31-9a8a-12fb1cd76d30 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:12.990693 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fc7daf8e-f125-4b31-9a8a-12fb1cd76d30 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:12.991386 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fc7daf8e-f125-4b31-9a8a-12fb1cd76d30 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:12.997322 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fc7daf8e-f125-4b31-9a8a-12fb1cd76d30 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:12.997322 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fc7daf8e-f125-4b31-9a8a-12fb1cd76d30 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:13.130298 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3909615f-d53b-4b42-b7a3-6ca5769c2768 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:13.138643 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3909615f-d53b-4b42-b7a3-6ca5769c2768 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/66557f04-2de0-41eb-b4a5-23bcbef9865f" status: 200 len: 1552 microversion: 2.1 time: 0.379078 Jun 10 18:33:13.139541 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3262/6478] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:12 2022] GET /compute/v2.1/servers/66557f04-2de0-41eb-b4a5-23bcbef9865f => generated 1552 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:33:13.144521 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bbcf2476-7743-4ef5-883d-745d11efaab6 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:13.145479 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bbcf2476-7743-4ef5-883d-745d11efaab6 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] [instance: 32c2282f-8127-41a3-b616-ba0d58394128] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:13.152866 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bbcf2476-7743-4ef5-883d-745d11efaab6 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:13.153642 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bbcf2476-7743-4ef5-883d-745d11efaab6 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:13.154828 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bbcf2476-7743-4ef5-883d-745d11efaab6 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:13.155367 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bbcf2476-7743-4ef5-883d-745d11efaab6 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:13.240755 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bbcf2476-7743-4ef5-883d-745d11efaab6 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa5b7f650884ee59282ce97f48fc0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a8d819ba8844878f82cf60131df725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:13.248472 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bbcf2476-7743-4ef5-883d-745d11efaab6 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] 10.222.0.35 "GET /compute/v2.1/servers/32c2282f-8127-41a3-b616-ba0d58394128" status: 200 len: 1276 microversion: 2.1 time: 0.107613 Jun 10 18:33:13.249054 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3263/6479] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:13 2022] GET /compute/v2.1/servers/32c2282f-8127-41a3-b616-ba0d58394128 => generated 1276 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:13.573205 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4d4a18d9-600f-475f-b72f-1bc281d5b157 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:13.574055 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4d4a18d9-600f-475f-b72f-1bc281d5b157 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] [instance: 0f203cb7-5930-44a8-83f0-075144d98aba] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:13.581334 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4d4a18d9-600f-475f-b72f-1bc281d5b157 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:13.581824 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4d4a18d9-600f-475f-b72f-1bc281d5b157 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:13.582588 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4d4a18d9-600f-475f-b72f-1bc281d5b157 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:13.583033 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4d4a18d9-600f-475f-b72f-1bc281d5b157 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:13.623808 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fc7daf8e-f125-4b31-9a8a-12fb1cd76d30 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:13.632520 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fc7daf8e-f125-4b31-9a8a-12fb1cd76d30 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1570 microversion: 2.1 time: 0.655027 Jun 10 18:33:13.633702 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3217/6480] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:12 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1570 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:33:13.713997 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-299d7caf-8cb6-487d-8c14-d56f548f80d2 req-1171cc67-f619-41a7-8edf-a79d73a5611e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c36e064f-7f56-4f6b-81bf-45b449eda791", "name": "network-vif-deleted", "tag": "e152d0f1-e50b-4888-9524-a46fb6cc5899"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:33:13.737969 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-299d7caf-8cb6-487d-8c14-d56f548f80d2 req-1171cc67-f619-41a7-8edf-a79d73a5611e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:13.741558 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-299d7caf-8cb6-487d-8c14-d56f548f80d2 req-1171cc67-f619-41a7-8edf-a79d73a5611e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:13.754296 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-299d7caf-8cb6-487d-8c14-d56f548f80d2 req-1171cc67-f619-41a7-8edf-a79d73a5611e service nova] Creating event network-vif-deleted:e152d0f1-e50b-4888-9524-a46fb6cc5899 for instance c36e064f-7f56-4f6b-81bf-45b449eda791 on chh2-master-2 Jun 10 18:33:13.759339 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-299d7caf-8cb6-487d-8c14-d56f548f80d2 req-1171cc67-f619-41a7-8edf-a79d73a5611e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055382 Jun 10 18:33:13.760729 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3218/6481] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:33:13.945753 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4d4a18d9-600f-475f-b72f-1bc281d5b157 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20faf80443114211af1c7ea53724dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7224d6e7eb4188b58412209e8d3c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:13.961973 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4d4a18d9-600f-475f-b72f-1bc281d5b157 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] 10.222.0.35 "GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba" status: 200 len: 1508 microversion: 2.1 time: 0.393166 Jun 10 18:33:13.964701 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3264/6482] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:13 2022] GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba => generated 1508 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:13.986129 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4f2dbdb0-7f88-4892-9dec-2f6097cea6bf tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:13.986864 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4f2dbdb0-7f88-4892-9dec-2f6097cea6bf tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: cf4aaf4f-5855-4034-a1a5-2bfb200ad546] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:14.000327 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f2dbdb0-7f88-4892-9dec-2f6097cea6bf tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:14.011498 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f2dbdb0-7f88-4892-9dec-2f6097cea6bf tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:14.017620 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f2dbdb0-7f88-4892-9dec-2f6097cea6bf tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:14.020600 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f2dbdb0-7f88-4892-9dec-2f6097cea6bf tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:14.157680 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cb4b4823-639c-4de6-8947-081a7d1a0851 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:14.158990 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cb4b4823-639c-4de6-8947-081a7d1a0851 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 66557f04-2de0-41eb-b4a5-23bcbef9865f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:14.171925 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cb4b4823-639c-4de6-8947-081a7d1a0851 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:14.172329 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cb4b4823-639c-4de6-8947-081a7d1a0851 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:14.173139 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cb4b4823-639c-4de6-8947-081a7d1a0851 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:14.173588 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cb4b4823-639c-4de6-8947-081a7d1a0851 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:14.669602 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4f2dbdb0-7f88-4892-9dec-2f6097cea6bf tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:14.679100 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4f2dbdb0-7f88-4892-9dec-2f6097cea6bf tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546" status: 200 len: 1364 microversion: 2.1 time: 0.701227 Jun 10 18:33:14.679801 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3219/6483] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:13 2022] GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546 => generated 1364 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:14.696196 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-773b915a-2367-4e72-b1f3-f2228e5a8add tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:14.696867 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-773b915a-2367-4e72-b1f3-f2228e5a8add tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] [instance: 32c2282f-8127-41a3-b616-ba0d58394128] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:14.703954 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-773b915a-2367-4e72-b1f3-f2228e5a8add tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:14.704719 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-773b915a-2367-4e72-b1f3-f2228e5a8add tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:14.705744 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-773b915a-2367-4e72-b1f3-f2228e5a8add tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:14.706350 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-773b915a-2367-4e72-b1f3-f2228e5a8add tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:14.924951 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cb4b4823-639c-4de6-8947-081a7d1a0851 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:14.939073 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cb4b4823-639c-4de6-8947-081a7d1a0851 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/66557f04-2de0-41eb-b4a5-23bcbef9865f" status: 200 len: 1552 microversion: 2.1 time: 0.785878 Jun 10 18:33:14.940415 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3265/6484] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:14 2022] GET /compute/v2.1/servers/66557f04-2de0-41eb-b4a5-23bcbef9865f => generated 1552 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:33:14.947775 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4d3a1b99-096c-4d8f-a655-53b580b8ffd2 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:14.950818 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4d3a1b99-096c-4d8f-a655-53b580b8ffd2 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:14.958491 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4d3a1b99-096c-4d8f-a655-53b580b8ffd2 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:14.959222 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4d3a1b99-096c-4d8f-a655-53b580b8ffd2 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:14.960491 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4d3a1b99-096c-4d8f-a655-53b580b8ffd2 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:14.962003 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4d3a1b99-096c-4d8f-a655-53b580b8ffd2 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:15.007562 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4d3a1b99-096c-4d8f-a655-53b580b8ffd2 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:15.008029 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4d3a1b99-096c-4d8f-a655-53b580b8ffd2 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:15.009097 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-4d3a1b99-096c-4d8f-a655-53b580b8ffd2 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lazy-loading 'fault' on Instance uuid c36e064f-7f56-4f6b-81bf-45b449eda791 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:33:15.049056 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-773b915a-2367-4e72-b1f3-f2228e5a8add tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa5b7f650884ee59282ce97f48fc0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a8d819ba8844878f82cf60131df725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:15.060823 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-773b915a-2367-4e72-b1f3-f2228e5a8add tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] 10.222.0.35 "GET /compute/v2.1/servers/32c2282f-8127-41a3-b616-ba0d58394128" status: 200 len: 1318 microversion: 2.1 time: 0.369514 Jun 10 18:33:15.061610 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3220/6485] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:14 2022] GET /compute/v2.1/servers/32c2282f-8127-41a3-b616-ba0d58394128 => generated 1318 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:15.067214 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a5e267de-6f6f-43cc-828d-248582835310 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:15.068622 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a5e267de-6f6f-43cc-828d-248582835310 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] [instance: 0f203cb7-5930-44a8-83f0-075144d98aba] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:15.077293 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a5e267de-6f6f-43cc-828d-248582835310 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:15.077293 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a5e267de-6f6f-43cc-828d-248582835310 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:15.078624 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a5e267de-6f6f-43cc-828d-248582835310 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:15.079135 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a5e267de-6f6f-43cc-828d-248582835310 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:15.086009 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4d3a1b99-096c-4d8f-a655-53b580b8ffd2 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:15.110205 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4d3a1b99-096c-4d8f-a655-53b580b8ffd2 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 200 len: 1357 microversion: 2.1 time: 0.165826 Jun 10 18:33:15.112905 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3266/6486] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:14 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:15.127099 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a5e267de-6f6f-43cc-828d-248582835310 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:15.127643 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a5e267de-6f6f-43cc-828d-248582835310 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:15.128201 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-a5e267de-6f6f-43cc-828d-248582835310 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lazy-loading 'fault' on Instance uuid 0f203cb7-5930-44a8-83f0-075144d98aba {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:33:15.177347 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a5e267de-6f6f-43cc-828d-248582835310 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20faf80443114211af1c7ea53724dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7224d6e7eb4188b58412209e8d3c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:15.198137 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a5e267de-6f6f-43cc-828d-248582835310 tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] 10.222.0.35 "GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba" status: 200 len: 1304 microversion: 2.1 time: 0.134822 Jun 10 18:33:15.201307 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3221/6487] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:15 2022] GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba => generated 1304 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:15.696031 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8d0b44a7-0209-464b-807e-6c9414b15f73 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:15.697304 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8d0b44a7-0209-464b-807e-6c9414b15f73 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: cf4aaf4f-5855-4034-a1a5-2bfb200ad546] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:15.704701 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8d0b44a7-0209-464b-807e-6c9414b15f73 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:15.705483 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8d0b44a7-0209-464b-807e-6c9414b15f73 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:15.706531 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8d0b44a7-0209-464b-807e-6c9414b15f73 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:15.708255 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8d0b44a7-0209-464b-807e-6c9414b15f73 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:15.822714 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-68491015-7e7a-46ec-b848-27114192fd75 req-619c2fa9-28dc-4a75-8045-977ac9292915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f203cb7-5930-44a8-83f0-075144d98aba", "name": "network-vif-deleted", "tag": "e6269383-a093-464d-9e51-5e773f32c17b"}, {"server_uuid": "66557f04-2de0-41eb-b4a5-23bcbef9865f", "name": "network-vif-deleted", "tag": "27415922-6bb8-4ff4-ac7d-20ccbf66eefd"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:33:15.841235 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-68491015-7e7a-46ec-b848-27114192fd75 req-619c2fa9-28dc-4a75-8045-977ac9292915 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:15.841691 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-68491015-7e7a-46ec-b848-27114192fd75 req-619c2fa9-28dc-4a75-8045-977ac9292915 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:15.875386 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-68491015-7e7a-46ec-b848-27114192fd75 req-619c2fa9-28dc-4a75-8045-977ac9292915 service nova] Creating event network-vif-deleted:e6269383-a093-464d-9e51-5e773f32c17b for instance 0f203cb7-5930-44a8-83f0-075144d98aba on chh2-master-2 Jun 10 18:33:15.876181 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-68491015-7e7a-46ec-b848-27114192fd75 req-619c2fa9-28dc-4a75-8045-977ac9292915 service nova] Creating event network-vif-deleted:27415922-6bb8-4ff4-ac7d-20ccbf66eefd for instance 66557f04-2de0-41eb-b4a5-23bcbef9865f on chh1-master-2 Jun 10 18:33:15.913181 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-68491015-7e7a-46ec-b848-27114192fd75 req-619c2fa9-28dc-4a75-8045-977ac9292915 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.094715 Jun 10 18:33:15.919175 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3222/6488] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:33:15.957596 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7671f31d-f60e-4666-b987-cea73084f3d7 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:15.958444 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7671f31d-f60e-4666-b987-cea73084f3d7 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 66557f04-2de0-41eb-b4a5-23bcbef9865f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:15.969789 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7671f31d-f60e-4666-b987-cea73084f3d7 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:15.974541 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7671f31d-f60e-4666-b987-cea73084f3d7 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:15.974541 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7671f31d-f60e-4666-b987-cea73084f3d7 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:15.974541 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7671f31d-f60e-4666-b987-cea73084f3d7 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:16.030502 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7671f31d-f60e-4666-b987-cea73084f3d7 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:16.030983 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7671f31d-f60e-4666-b987-cea73084f3d7 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:16.034558 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-7671f31d-f60e-4666-b987-cea73084f3d7 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lazy-loading 'fault' on Instance uuid 66557f04-2de0-41eb-b4a5-23bcbef9865f {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:33:16.063757 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8d0b44a7-0209-464b-807e-6c9414b15f73 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:16.077692 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8d0b44a7-0209-464b-807e-6c9414b15f73 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546" status: 200 len: 1549 microversion: 2.1 time: 0.385675 Jun 10 18:33:16.078291 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3267/6489] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:15 2022] GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546 => generated 1549 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:16.091935 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a8342cc7-c03f-4bc1-b4dc-2ca333fbe5c9 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:16.091935 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a8342cc7-c03f-4bc1-b4dc-2ca333fbe5c9 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] [instance: 32c2282f-8127-41a3-b616-ba0d58394128] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:16.091935 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a8342cc7-c03f-4bc1-b4dc-2ca333fbe5c9 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:16.091935 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a8342cc7-c03f-4bc1-b4dc-2ca333fbe5c9 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:16.092760 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a8342cc7-c03f-4bc1-b4dc-2ca333fbe5c9 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:16.093656 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a8342cc7-c03f-4bc1-b4dc-2ca333fbe5c9 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:16.109356 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7671f31d-f60e-4666-b987-cea73084f3d7 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:16.119390 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7671f31d-f60e-4666-b987-cea73084f3d7 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/66557f04-2de0-41eb-b4a5-23bcbef9865f" status: 200 len: 1337 microversion: 2.1 time: 0.166088 Jun 10 18:33:16.124042 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3223/6490] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:15 2022] GET /compute/v2.1/servers/66557f04-2de0-41eb-b4a5-23bcbef9865f => generated 1337 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:33:16.133470 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9cae5cd0-7193-4996-8d7d-2e29f1bdf52c tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:16.134234 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9cae5cd0-7193-4996-8d7d-2e29f1bdf52c tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: cf4aaf4f-5855-4034-a1a5-2bfb200ad546] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:16.143650 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9cae5cd0-7193-4996-8d7d-2e29f1bdf52c tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:16.147027 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9cae5cd0-7193-4996-8d7d-2e29f1bdf52c tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:16.147027 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9cae5cd0-7193-4996-8d7d-2e29f1bdf52c tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:16.147027 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9cae5cd0-7193-4996-8d7d-2e29f1bdf52c tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:16.267490 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9cae5cd0-7193-4996-8d7d-2e29f1bdf52c tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.141982 Jun 10 18:33:16.268267 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3224/6491] 10.222.0.35 () {58 vars in 1274 bytes} [Fri Jun 10 18:33:16 2022] GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546/os-interface => generated 284 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:33:16.274591 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-45b5ce8e-3116-4ec7-b3c8-940896b3ea24 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:16.276646 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-45b5ce8e-3116-4ec7-b3c8-940896b3ea24 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: c36e064f-7f56-4f6b-81bf-45b449eda791] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:16.282907 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45b5ce8e-3116-4ec7-b3c8-940896b3ea24 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:16.283369 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45b5ce8e-3116-4ec7-b3c8-940896b3ea24 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:16.284145 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45b5ce8e-3116-4ec7-b3c8-940896b3ea24 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:16.284623 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45b5ce8e-3116-4ec7-b3c8-940896b3ea24 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:16.299427 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-45b5ce8e-3116-4ec7-b3c8-940896b3ea24 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] HTTP exception thrown: Instance c36e064f-7f56-4f6b-81bf-45b449eda791 could not be found. Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-45b5ce8e-3116-4ec7-b3c8-940896b3ea24 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Request method failure captured: Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 HTTP/1.1 Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio43CIIZRNjb-0MeWb3vSViVXry-4quvMwA-hBljqKpiB6nnPbm4yr81WFzlQ2LY4R_BwzHI9K4qKlBZRuaAUhn7ebWvkqA-OmRlonhi_sWh_BF0eIBDo55Jeg8m_3Z24vWfOlNkH5Uyaf3Vs_VtyXvkIne8zHY4JCWnu-w0Ien9U850 Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 4089a2104afe4f1ab69f1b7983e4735d Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-88591049 Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/4089a2104afe4f1ab69f1b7983e4735d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/4089a2104afe4f1ab69f1b7983e4735d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/4089a2104afe4f1ab69f1b7983e4735d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_4089a2104afe4f1ab69f1b7983e4735d", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-TestNetworkAdvancedServerOps-88591049 Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 4089a2104afe4f1ab69f1b7983e4735d Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-88591049 Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-TestNetworkAdvancedServerOps-88591049-project Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 9d5fe9478d2b47e3b87cecc86d40773c Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-TestNetworkAdvancedServerOps-88591049-project Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: exception: Instance c36e064f-7f56-4f6b-81bf-45b449eda791 could not be found. Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'c36e064f-7f56-4f6b-81bf-45b449eda791'} Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c36e064f-7f56-4f6b-81bf-45b449eda791 could not be found. Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c36e064f-7f56-4f6b-81bf-45b449eda791 could not be found. Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:33:16.301080 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:33:16.308071 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:33:16.308071 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:33:16.308071 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:33:16.308071 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:33:16.308071 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:33:16.308071 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c36e064f-7f56-4f6b-81bf-45b449eda791 could not be found. Jun 10 18:33:16.308071 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:33:16.308071 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-45b5ce8e-3116-4ec7-b3c8-940896b3ea24 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Returning 404 to user: Instance c36e064f-7f56-4f6b-81bf-45b449eda791 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:33:16.308071 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-45b5ce8e-3116-4ec7-b3c8-940896b3ea24 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791" status: 404 len: 111 microversion: 2.1 time: 0.032802 Jun 10 18:33:16.308071 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3225/6492] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:16 2022] GET /compute/v2.1/servers/c36e064f-7f56-4f6b-81bf-45b449eda791 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:33:16.312536 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6ed57555-2eaf-4f84-9ede-fc6258689f2b tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:16.313163 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6ed57555-2eaf-4f84-9ede-fc6258689f2b tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] [instance: 0f203cb7-5930-44a8-83f0-075144d98aba] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:16.321409 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6ed57555-2eaf-4f84-9ede-fc6258689f2b tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:16.321885 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6ed57555-2eaf-4f84-9ede-fc6258689f2b tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:16.325548 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6ed57555-2eaf-4f84-9ede-fc6258689f2b tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:16.325548 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6ed57555-2eaf-4f84-9ede-fc6258689f2b tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:16.339238 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-6ed57555-2eaf-4f84-9ede-fc6258689f2b tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] HTTP exception thrown: Instance 0f203cb7-5930-44a8-83f0-075144d98aba could not be found. Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6ed57555-2eaf-4f84-9ede-fc6258689f2b tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Request method failure captured: Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba HTTP/1.1 Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio44_QxQn-5wukiSM6VyWPr46l-25LIwE6VN1OB4del7XuQQbqX22I-IATpLcPU6VfgSdlGhg_wwtWgOhohIs4qXU56AIDO9S2UQb3iBmLfMbAJ4UvCTYy1bCFz8TJuLR67rTNXb2hRecQ4W4iED-1Xa5TMSqflC53hNR-43nl78C7fA Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 4f7224d6e7eb4188b58412209e8d3c40 Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-TestServerAdvancedOps-1020149865 Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/4f7224d6e7eb4188b58412209e8d3c40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/4f7224d6e7eb4188b58412209e8d3c40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/4f7224d6e7eb4188b58412209e8d3c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_4f7224d6e7eb4188b58412209e8d3c40", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-TestServerAdvancedOps-1020149865 Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 4f7224d6e7eb4188b58412209e8d3c40 Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-TestServerAdvancedOps-1020149865 Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-TestServerAdvancedOps-1020149865-project Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 20faf80443114211af1c7ea53724dd7d Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-TestServerAdvancedOps-1020149865-project Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 0f203cb7-5930-44a8-83f0-075144d98aba could not be found. Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '0f203cb7-5930-44a8-83f0-075144d98aba'} Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f203cb7-5930-44a8-83f0-075144d98aba could not be found. Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f203cb7-5930-44a8-83f0-075144d98aba could not be found. Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:33:16.340859 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:33:16.346506 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:33:16.346506 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:33:16.346506 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:33:16.346506 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:33:16.346506 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:33:16.346506 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f203cb7-5930-44a8-83f0-075144d98aba could not be found. Jun 10 18:33:16.346506 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:33:16.348333 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6ed57555-2eaf-4f84-9ede-fc6258689f2b tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] Returning 404 to user: Instance 0f203cb7-5930-44a8-83f0-075144d98aba could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:33:16.349208 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6ed57555-2eaf-4f84-9ede-fc6258689f2b tempest-TestServerAdvancedOps-1020149865 tempest-TestServerAdvancedOps-1020149865-project] 10.222.0.35 "GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba" status: 404 len: 111 microversion: 2.1 time: 0.041044 Jun 10 18:33:16.349790 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3226/6493] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:16 2022] GET /compute/v2.1/servers/0f203cb7-5930-44a8-83f0-075144d98aba => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:33:16.393330 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-dd68c674-7fd6-4449-a295-4e762a4cdfc4 req-bfbe441d-f41c-414f-a3ea-253ff26dd905 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32c2282f-8127-41a3-b616-ba0d58394128", "tag": "1de44453-13e8-4a14-8524-32dced7611b9"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:33:16.403555 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-dd68c674-7fd6-4449-a295-4e762a4cdfc4 req-bfbe441d-f41c-414f-a3ea-253ff26dd905 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:16.405288 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-dd68c674-7fd6-4449-a295-4e762a4cdfc4 req-bfbe441d-f41c-414f-a3ea-253ff26dd905 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:16.430862 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-dd68c674-7fd6-4449-a295-4e762a4cdfc4 req-bfbe441d-f41c-414f-a3ea-253ff26dd905 service nova] Creating event network-changed:1de44453-13e8-4a14-8524-32dced7611b9 for instance 32c2282f-8127-41a3-b616-ba0d58394128 on chh2-master-2 Jun 10 18:33:16.435867 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-dd68c674-7fd6-4449-a295-4e762a4cdfc4 req-bfbe441d-f41c-414f-a3ea-253ff26dd905 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047244 Jun 10 18:33:16.436839 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3227/6494] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:33:16.584419 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a8342cc7-c03f-4bc1-b4dc-2ca333fbe5c9 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa5b7f650884ee59282ce97f48fc0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a8d819ba8844878f82cf60131df725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:16.609034 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a8342cc7-c03f-4bc1-b4dc-2ca333fbe5c9 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] 10.222.0.35 "GET /compute/v2.1/servers/32c2282f-8127-41a3-b616-ba0d58394128" status: 200 len: 1318 microversion: 2.1 time: 0.529476 Jun 10 18:33:16.609986 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3268/6495] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:16 2022] GET /compute/v2.1/servers/32c2282f-8127-41a3-b616-ba0d58394128 => generated 1318 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:17.138314 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-740653d6-4a2d-406e-9968-4ac1a50f104c tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:17.139017 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-740653d6-4a2d-406e-9968-4ac1a50f104c tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 66557f04-2de0-41eb-b4a5-23bcbef9865f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:17.148566 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-740653d6-4a2d-406e-9968-4ac1a50f104c tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:17.149836 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-740653d6-4a2d-406e-9968-4ac1a50f104c tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:17.151650 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-740653d6-4a2d-406e-9968-4ac1a50f104c tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:17.153755 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-740653d6-4a2d-406e-9968-4ac1a50f104c tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:17.178422 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-740653d6-4a2d-406e-9968-4ac1a50f104c tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] HTTP exception thrown: Instance 66557f04-2de0-41eb-b4a5-23bcbef9865f could not be found. Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-740653d6-4a2d-406e-9968-4ac1a50f104c tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Request method failure captured: Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/66557f04-2de0-41eb-b4a5-23bcbef9865f HTTP/1.1 Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio43DhZqgAJ1_6FGo_KnHaha-ugAuVO8_EqGRZFb-FqZYELhKvXgfD_lLw1ONRL1ucrz4STgXDDo1yirq6r-7PEGk3PGlyFjAYeN8cyoHKFFONmyhcyO87P3oTWzoS6hSOoR5XqXB1Y_FE98HaKU4kBOrltUSL84WZmsHskXY0jvMo7I Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: a52d669c461c4bb38e30dbd8ba0bd0a2 Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-TestNetworkBasicOps-426117710 Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/a52d669c461c4bb38e30dbd8ba0bd0a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a52d669c461c4bb38e30dbd8ba0bd0a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a52d669c461c4bb38e30dbd8ba0bd0a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_a52d669c461c4bb38e30dbd8ba0bd0a2", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-TestNetworkBasicOps-426117710 Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: a52d669c461c4bb38e30dbd8ba0bd0a2 Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-TestNetworkBasicOps-426117710 Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-TestNetworkBasicOps-426117710-project Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: cb110e0802174e1fb00d874f9e047b01 Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-TestNetworkBasicOps-426117710-project Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 66557f04-2de0-41eb-b4a5-23bcbef9865f could not be found. Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '66557f04-2de0-41eb-b4a5-23bcbef9865f'} Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66557f04-2de0-41eb-b4a5-23bcbef9865f could not be found. Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66557f04-2de0-41eb-b4a5-23bcbef9865f could not be found. Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:33:17.180632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:33:17.188181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:33:17.188181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:33:17.188181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:33:17.188181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:33:17.188181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:33:17.188181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66557f04-2de0-41eb-b4a5-23bcbef9865f could not be found. Jun 10 18:33:17.188181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:33:17.188181 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-740653d6-4a2d-406e-9968-4ac1a50f104c tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Returning 404 to user: Instance 66557f04-2de0-41eb-b4a5-23bcbef9865f could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:33:17.188181 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-740653d6-4a2d-406e-9968-4ac1a50f104c tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/66557f04-2de0-41eb-b4a5-23bcbef9865f" status: 404 len: 111 microversion: 2.1 time: 0.049286 Jun 10 18:33:17.189601 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3228/6496] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:17 2022] GET /compute/v2.1/servers/66557f04-2de0-41eb-b4a5-23bcbef9865f => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:33:17.629254 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9c99d8b2-eab1-47df-acd8-ba3b4013c13a tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:17.631181 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9c99d8b2-eab1-47df-acd8-ba3b4013c13a tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] [instance: 32c2282f-8127-41a3-b616-ba0d58394128] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:17.642395 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9c99d8b2-eab1-47df-acd8-ba3b4013c13a tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:17.642855 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9c99d8b2-eab1-47df-acd8-ba3b4013c13a tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:17.643876 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9c99d8b2-eab1-47df-acd8-ba3b4013c13a tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:17.644552 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9c99d8b2-eab1-47df-acd8-ba3b4013c13a tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:17.721080 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-02fe3613-67d5-42f7-a798-4952a99e161f tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '.version_select at 0x7f77c144b700>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:17.731579 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:33:17.827306 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-02fe3613-67d5-42f7-a798-4952a99e161f tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-666625350" status: 202 len: 0 microversion: 2.1 time: 0.115056 Jun 10 18:33:17.828473 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3229/6497] 10.222.0.35 () {58 vars in 1253 bytes} [Fri Jun 10 18:33:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-666625350 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:33:17.915210 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9c99d8b2-eab1-47df-acd8-ba3b4013c13a tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa5b7f650884ee59282ce97f48fc0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a8d819ba8844878f82cf60131df725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:17.925033 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9c99d8b2-eab1-47df-acd8-ba3b4013c13a tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] 10.222.0.35 "GET /compute/v2.1/servers/32c2282f-8127-41a3-b616-ba0d58394128" status: 200 len: 1318 microversion: 2.1 time: 0.301307 Jun 10 18:33:17.926007 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3269/6498] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:17 2022] GET /compute/v2.1/servers/32c2282f-8127-41a3-b616-ba0d58394128 => generated 1318 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:18.504674 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-8e0ebc37-255e-4556-b468-de275160bb67 req-cb1a224b-faaf-48be-a6fe-0f71196260e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf4aaf4f-5855-4034-a1a5-2bfb200ad546", "tag": "d943c54d-812b-4474-a394-0b5123af99b3"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:33:18.541274 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-8e0ebc37-255e-4556-b468-de275160bb67 req-cb1a224b-faaf-48be-a6fe-0f71196260e8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:18.541743 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-8e0ebc37-255e-4556-b468-de275160bb67 req-cb1a224b-faaf-48be-a6fe-0f71196260e8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:18.567112 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-8e0ebc37-255e-4556-b468-de275160bb67 req-cb1a224b-faaf-48be-a6fe-0f71196260e8 service nova] Creating event network-changed:d943c54d-812b-4474-a394-0b5123af99b3 for instance cf4aaf4f-5855-4034-a1a5-2bfb200ad546 on chh1-master-2 Jun 10 18:33:18.574977 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-8e0ebc37-255e-4556-b468-de275160bb67 req-cb1a224b-faaf-48be-a6fe-0f71196260e8 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077212 Jun 10 18:33:18.576351 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3230/6499] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:33:18.944529 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c6626f29-5420-4ec4-a013-911537acb837 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:18.945079 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c6626f29-5420-4ec4-a013-911537acb837 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] [instance: 32c2282f-8127-41a3-b616-ba0d58394128] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:18.949847 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:33:18.954052 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=6 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:33:18.967388 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c6626f29-5420-4ec4-a013-911537acb837 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:18.968811 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c6626f29-5420-4ec4-a013-911537acb837 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:18.970711 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c6626f29-5420-4ec4-a013-911537acb837 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:18.973440 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c6626f29-5420-4ec4-a013-911537acb837 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:19.984358 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c6626f29-5420-4ec4-a013-911537acb837 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa5b7f650884ee59282ce97f48fc0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a8d819ba8844878f82cf60131df725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:20.001241 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c6626f29-5420-4ec4-a013-911537acb837 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] 10.222.0.35 "GET /compute/v2.1/servers/32c2282f-8127-41a3-b616-ba0d58394128" status: 200 len: 1318 microversion: 2.1 time: 1.062331 Jun 10 18:33:20.018616 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3270/6500] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:18 2022] GET /compute/v2.1/servers/32c2282f-8127-41a3-b616-ba0d58394128 => generated 1318 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:21.021619 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ad2c08b0-5cb1-40e5-b9aa-b715de8a3f38 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:21.024569 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ad2c08b0-5cb1-40e5-b9aa-b715de8a3f38 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] [instance: 32c2282f-8127-41a3-b616-ba0d58394128] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:21.027552 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:33:21.037689 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad2c08b0-5cb1-40e5-b9aa-b715de8a3f38 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:21.042173 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad2c08b0-5cb1-40e5-b9aa-b715de8a3f38 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:21.042173 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad2c08b0-5cb1-40e5-b9aa-b715de8a3f38 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:21.042173 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad2c08b0-5cb1-40e5-b9aa-b715de8a3f38 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:21.505135 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ad2c08b0-5cb1-40e5-b9aa-b715de8a3f38 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa5b7f650884ee59282ce97f48fc0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a8d819ba8844878f82cf60131df725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:21.518067 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ad2c08b0-5cb1-40e5-b9aa-b715de8a3f38 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] 10.222.0.35 "GET /compute/v2.1/servers/32c2282f-8127-41a3-b616-ba0d58394128" status: 200 len: 1318 microversion: 2.1 time: 0.497213 Jun 10 18:33:21.518067 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3231/6501] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:21 2022] GET /compute/v2.1/servers/32c2282f-8127-41a3-b616-ba0d58394128 => generated 1318 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:22.272695 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-95323e70-81fa-4a3a-ab9e-93abe331eeda tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:22.274016 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-95323e70-81fa-4a3a-ab9e-93abe331eeda tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: da9bceb9-4c3f-48ce-ae73-edc39b206e30] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:22.277699 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-98f3ec6d-f188-41d0-9b40-ab11fd0a52f0 req-1db3ca3f-56d8-4829-a8a3-9fb670a1e374 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da9bceb9-4c3f-48ce-ae73-edc39b206e30", "tag": "a132d174-b8c7-4288-bc57-365f90e9e289"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:33:22.297610 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-98f3ec6d-f188-41d0-9b40-ab11fd0a52f0 req-1db3ca3f-56d8-4829-a8a3-9fb670a1e374 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:22.297610 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-98f3ec6d-f188-41d0-9b40-ab11fd0a52f0 req-1db3ca3f-56d8-4829-a8a3-9fb670a1e374 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:22.299810 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-95323e70-81fa-4a3a-ab9e-93abe331eeda tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:22.300565 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-95323e70-81fa-4a3a-ab9e-93abe331eeda tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:22.303378 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-95323e70-81fa-4a3a-ab9e-93abe331eeda tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:22.304107 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-95323e70-81fa-4a3a-ab9e-93abe331eeda tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:22.313140 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:33:22.325648 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-98f3ec6d-f188-41d0-9b40-ab11fd0a52f0 req-1db3ca3f-56d8-4829-a8a3-9fb670a1e374 service nova] Creating event network-changed:a132d174-b8c7-4288-bc57-365f90e9e289 for instance da9bceb9-4c3f-48ce-ae73-edc39b206e30 on chh2-master-2 Jun 10 18:33:22.332684 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-98f3ec6d-f188-41d0-9b40-ab11fd0a52f0 req-1db3ca3f-56d8-4829-a8a3-9fb670a1e374 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059705 Jun 10 18:33:22.337880 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3232/6502] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:33:22.347426 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-95323e70-81fa-4a3a-ab9e-93abe331eeda tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: da9bceb9-4c3f-48ce-ae73-edc39b206e30] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:33:22.530139 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-206df00c-d0df-4297-a3d0-9a5fb9057e1e tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:22.532762 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-206df00c-d0df-4297-a3d0-9a5fb9057e1e tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] [instance: 32c2282f-8127-41a3-b616-ba0d58394128] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:22.539231 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-206df00c-d0df-4297-a3d0-9a5fb9057e1e tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:22.539701 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-206df00c-d0df-4297-a3d0-9a5fb9057e1e tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:22.540531 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-206df00c-d0df-4297-a3d0-9a5fb9057e1e tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:22.541009 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-206df00c-d0df-4297-a3d0-9a5fb9057e1e tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:22.677775 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-95323e70-81fa-4a3a-ab9e-93abe331eeda tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "DELETE /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30" status: 204 len: 0 microversion: 2.1 time: 0.411215 Jun 10 18:33:22.678616 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3271/6503] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:33:22 2022] DELETE /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:33:22.688024 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f68dc4c7-1456-4384-866f-c3929bc781e4 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:22.689255 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f68dc4c7-1456-4384-866f-c3929bc781e4 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: da9bceb9-4c3f-48ce-ae73-edc39b206e30] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:22.703171 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f68dc4c7-1456-4384-866f-c3929bc781e4 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:22.703949 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f68dc4c7-1456-4384-866f-c3929bc781e4 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:22.704974 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f68dc4c7-1456-4384-866f-c3929bc781e4 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:22.705592 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f68dc4c7-1456-4384-866f-c3929bc781e4 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:23.045537 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f68dc4c7-1456-4384-866f-c3929bc781e4 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:23.054124 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f68dc4c7-1456-4384-866f-c3929bc781e4 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30" status: 200 len: 1672 microversion: 2.1 time: 0.370291 Jun 10 18:33:23.057518 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3272/6504] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:22 2022] GET /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30 => generated 1672 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:33:23.072939 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-206df00c-d0df-4297-a3d0-9a5fb9057e1e tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa5b7f650884ee59282ce97f48fc0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a8d819ba8844878f82cf60131df725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:23.085794 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-206df00c-d0df-4297-a3d0-9a5fb9057e1e tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] 10.222.0.35 "GET /compute/v2.1/servers/32c2282f-8127-41a3-b616-ba0d58394128" status: 200 len: 1318 microversion: 2.1 time: 0.559722 Jun 10 18:33:23.089035 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3233/6505] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:22 2022] GET /compute/v2.1/servers/32c2282f-8127-41a3-b616-ba0d58394128 => generated 1318 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:33:23.201330 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-e3fa49f6-b823-44e2-8135-ce76dba6f379 req-1e30e4fe-f057-4459-a6fb-6ae688a41864 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32c2282f-8127-41a3-b616-ba0d58394128", "name": "network-vif-plugged", "status": "completed", "tag": "1de44453-13e8-4a14-8524-32dced7611b9"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:33:23.217138 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-e3fa49f6-b823-44e2-8135-ce76dba6f379 req-1e30e4fe-f057-4459-a6fb-6ae688a41864 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:23.217599 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-e3fa49f6-b823-44e2-8135-ce76dba6f379 req-1e30e4fe-f057-4459-a6fb-6ae688a41864 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:23.238016 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-e3fa49f6-b823-44e2-8135-ce76dba6f379 req-1e30e4fe-f057-4459-a6fb-6ae688a41864 service nova] Creating event network-vif-plugged:1de44453-13e8-4a14-8524-32dced7611b9 for instance 32c2282f-8127-41a3-b616-ba0d58394128 on chh2-master-2 Jun 10 18:33:23.261224 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-e3fa49f6-b823-44e2-8135-ce76dba6f379 req-1e30e4fe-f057-4459-a6fb-6ae688a41864 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063448 Jun 10 18:33:23.261926 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3273/6506] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:33:24.076640 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b735736e-cb4f-4121-a5ce-724b4106e2c0 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:24.077261 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b735736e-cb4f-4121-a5ce-724b4106e2c0 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: da9bceb9-4c3f-48ce-ae73-edc39b206e30] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:24.106410 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b735736e-cb4f-4121-a5ce-724b4106e2c0 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:24.106978 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b735736e-cb4f-4121-a5ce-724b4106e2c0 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:24.107687 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3e399c5d-72f8-4559-b86a-c4d6c57cd681 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:24.112616 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b735736e-cb4f-4121-a5ce-724b4106e2c0 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:24.112616 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b735736e-cb4f-4121-a5ce-724b4106e2c0 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:24.113035 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3e399c5d-72f8-4559-b86a-c4d6c57cd681 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] [instance: 32c2282f-8127-41a3-b616-ba0d58394128] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:24.126402 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3e399c5d-72f8-4559-b86a-c4d6c57cd681 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:24.126889 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3e399c5d-72f8-4559-b86a-c4d6c57cd681 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:24.130278 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3e399c5d-72f8-4559-b86a-c4d6c57cd681 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:24.130774 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3e399c5d-72f8-4559-b86a-c4d6c57cd681 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:24.483353 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b735736e-cb4f-4121-a5ce-724b4106e2c0 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:24.498966 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b735736e-cb4f-4121-a5ce-724b4106e2c0 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30" status: 200 len: 1672 microversion: 2.1 time: 0.428635 Jun 10 18:33:24.499574 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3234/6507] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:24 2022] GET /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30 => generated 1672 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:24.901146 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3e399c5d-72f8-4559-b86a-c4d6c57cd681 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa5b7f650884ee59282ce97f48fc0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a8d819ba8844878f82cf60131df725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:24.927795 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3e399c5d-72f8-4559-b86a-c4d6c57cd681 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] 10.222.0.35 "GET /compute/v2.1/servers/32c2282f-8127-41a3-b616-ba0d58394128" status: 200 len: 1318 microversion: 2.1 time: 0.825845 Jun 10 18:33:24.940235 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3274/6508] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:24 2022] GET /compute/v2.1/servers/32c2282f-8127-41a3-b616-ba0d58394128 => generated 1318 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:25.519294 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c7cb262c-89cf-4ead-9be6-31ddc19ab7fa tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:25.519996 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c7cb262c-89cf-4ead-9be6-31ddc19ab7fa tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: da9bceb9-4c3f-48ce-ae73-edc39b206e30] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:25.532086 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c7cb262c-89cf-4ead-9be6-31ddc19ab7fa tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:25.534143 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c7cb262c-89cf-4ead-9be6-31ddc19ab7fa tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:25.534143 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c7cb262c-89cf-4ead-9be6-31ddc19ab7fa tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:25.534143 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c7cb262c-89cf-4ead-9be6-31ddc19ab7fa tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:25.905478 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c7cb262c-89cf-4ead-9be6-31ddc19ab7fa tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:25.918165 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c7cb262c-89cf-4ead-9be6-31ddc19ab7fa tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30" status: 200 len: 1672 microversion: 2.1 time: 0.402874 Jun 10 18:33:25.923700 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3235/6509] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:25 2022] GET /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30 => generated 1672 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:25.945644 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fd1b02bd-be9e-44a4-960d-3a0eb8661400 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:25.946919 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fd1b02bd-be9e-44a4-960d-3a0eb8661400 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] [instance: 32c2282f-8127-41a3-b616-ba0d58394128] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:25.955523 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fd1b02bd-be9e-44a4-960d-3a0eb8661400 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:25.956227 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fd1b02bd-be9e-44a4-960d-3a0eb8661400 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:25.967941 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fd1b02bd-be9e-44a4-960d-3a0eb8661400 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:25.972899 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fd1b02bd-be9e-44a4-960d-3a0eb8661400 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:26.253328 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-3c53aacc-9b60-4992-b590-048c62b07cf4 req-08237614-a087-43a6-a738-70f3254f6f87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da9bceb9-4c3f-48ce-ae73-edc39b206e30", "name": "network-vif-deleted", "tag": "a132d174-b8c7-4288-bc57-365f90e9e289"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:33:26.276255 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-3c53aacc-9b60-4992-b590-048c62b07cf4 req-08237614-a087-43a6-a738-70f3254f6f87 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:26.278193 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-3c53aacc-9b60-4992-b590-048c62b07cf4 req-08237614-a087-43a6-a738-70f3254f6f87 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:26.306186 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-3c53aacc-9b60-4992-b590-048c62b07cf4 req-08237614-a087-43a6-a738-70f3254f6f87 service nova] Creating event network-vif-deleted:a132d174-b8c7-4288-bc57-365f90e9e289 for instance da9bceb9-4c3f-48ce-ae73-edc39b206e30 on chh2-master-2 Jun 10 18:33:26.313448 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-3c53aacc-9b60-4992-b590-048c62b07cf4 req-08237614-a087-43a6-a738-70f3254f6f87 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064894 Jun 10 18:33:26.316835 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3236/6510] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:33:26.451566 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fd1b02bd-be9e-44a4-960d-3a0eb8661400 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa5b7f650884ee59282ce97f48fc0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a8d819ba8844878f82cf60131df725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:26.475296 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fd1b02bd-be9e-44a4-960d-3a0eb8661400 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] 10.222.0.35 "GET /compute/v2.1/servers/32c2282f-8127-41a3-b616-ba0d58394128" status: 200 len: 1507 microversion: 2.1 time: 0.527044 Jun 10 18:33:26.476045 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3275/6511] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:25 2022] GET /compute/v2.1/servers/32c2282f-8127-41a3-b616-ba0d58394128 => generated 1507 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:26.510165 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-03ea44a0-63f9-410a-9a49-adc4eac16078 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fdd27289-5a64-4d97-bdd5-7b7c8cee93e9", "device": "/dev/sdb"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:33:26.511870 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-03ea44a0-63f9-410a-9a49-adc4eac16078 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] [instance: 32c2282f-8127-41a3-b616-ba0d58394128] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:26.547563 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-483b8197-03db-489a-8290-b11dc0046593 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '.version_select at 0x7f77c62c75e0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:26.579778 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03ea44a0-63f9-410a-9a49-adc4eac16078 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:26.583289 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03ea44a0-63f9-410a-9a49-adc4eac16078 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:26.587806 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03ea44a0-63f9-410a-9a49-adc4eac16078 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:26.589921 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03ea44a0-63f9-410a-9a49-adc4eac16078 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:26.600061 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:33:26.696172 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-483b8197-03db-489a-8290-b11dc0046593 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1024649623" status: 202 len: 0 microversion: 2.1 time: 0.154576 Jun 10 18:33:26.698121 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3276/6512] 10.222.0.35 () {58 vars in 1283 bytes} [Fri Jun 10 18:33:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1024649623 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:33:26.742027 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4493ccef-6042-4161-a9d1-64003c9fc24b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Action: 'create', calling method: .version_select at 0x7f77b3ee4040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1513264815", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXI6KTh3hl+TqEgXB2Vkg1ACoHsqVL4d6J2fiehXZYIlJJ9G5Jb9eF1qIO7nZtIQzYfPdpQXHCeIfV9Dt0H5154PzfuT6foPoFlDzMd3+rgZWzYl/+744dk6J4erifVBg=="}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:33:26.756661 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:33:26.788061 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-4493ccef-6042-4161-a9d1-64003c9fc24b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Getting quotas for project 4089a2104afe4f1ab69f1b7983e4735d. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:33:26.803839 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-4493ccef-6042-4161-a9d1-64003c9fc24b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Getting quotas for user 9d5fe9478d2b47e3b87cecc86d40773c and project 4089a2104afe4f1ab69f1b7983e4735d. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:33:26.908128 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4493ccef-6042-4161-a9d1-64003c9fc24b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.172063 Jun 10 18:33:26.908880 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3277/6513] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 18:33:26 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:33:26.938066 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fb0627f5-b7d6-477b-9607-e54434740e8d tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:26.940108 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fb0627f5-b7d6-477b-9607-e54434740e8d tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: da9bceb9-4c3f-48ce-ae73-edc39b206e30] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:26.946674 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fb0627f5-b7d6-477b-9607-e54434740e8d tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:26.948276 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fb0627f5-b7d6-477b-9607-e54434740e8d tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:26.949327 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fb0627f5-b7d6-477b-9607-e54434740e8d tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:26.949836 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fb0627f5-b7d6-477b-9607-e54434740e8d tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:26.986295 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fb0627f5-b7d6-477b-9607-e54434740e8d tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:26.987126 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fb0627f5-b7d6-477b-9607-e54434740e8d tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:26.987778 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-fb0627f5-b7d6-477b-9607-e54434740e8d tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lazy-loading 'fault' on Instance uuid da9bceb9-4c3f-48ce-ae73-edc39b206e30 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:33:27.062374 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fb0627f5-b7d6-477b-9607-e54434740e8d tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:27.072122 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fb0627f5-b7d6-477b-9607-e54434740e8d tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30" status: 200 len: 1338 microversion: 2.1 time: 0.138650 Jun 10 18:33:27.074225 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3278/6514] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:26 2022] GET /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30 => generated 1338 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:27.780641 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-03ea44a0-63f9-410a-9a49-adc4eac16078 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] 10.222.0.35 "POST /compute/v2.1/servers/32c2282f-8127-41a3-b616-ba0d58394128/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.278771 Jun 10 18:33:27.784185 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3237/6515] 10.222.0.35 () {60 vars in 1322 bytes} [Fri Jun 10 18:33:26 2022] POST /compute/v2.1/servers/32c2282f-8127-41a3-b616-ba0d58394128/os-volume_attachments => generated 194 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:33:28.091932 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cac7203b-830c-4e6a-8bff-d0f198bfac84 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:28.092669 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cac7203b-830c-4e6a-8bff-d0f198bfac84 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: da9bceb9-4c3f-48ce-ae73-edc39b206e30] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:28.099962 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cac7203b-830c-4e6a-8bff-d0f198bfac84 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:28.111251 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cac7203b-830c-4e6a-8bff-d0f198bfac84 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:28.114122 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cac7203b-830c-4e6a-8bff-d0f198bfac84 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:28.115589 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cac7203b-830c-4e6a-8bff-d0f198bfac84 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:28.143203 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-cac7203b-830c-4e6a-8bff-d0f198bfac84 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] HTTP exception thrown: Instance da9bceb9-4c3f-48ce-ae73-edc39b206e30 could not be found. Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cac7203b-830c-4e6a-8bff-d0f198bfac84 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Request method failure captured: Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30 HTTP/1.1 Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio43DhZqgAJ1_6FGo_KnHaha-ugAuVO8_EqGRZFb-FqZYELhKvXgfD_lLw1ONRL1ucrz4STgXDDo1yirq6r-7PEGk3PGlyFjAYeN8cyoHKFFONmyhcyO87P3oTWzoS6hSOoR5XqXB1Y_FE98HaKU4kBOrltUSL84WZmsHskXY0jvMo7I Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: a52d669c461c4bb38e30dbd8ba0bd0a2 Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-TestNetworkBasicOps-426117710 Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/a52d669c461c4bb38e30dbd8ba0bd0a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a52d669c461c4bb38e30dbd8ba0bd0a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a52d669c461c4bb38e30dbd8ba0bd0a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_a52d669c461c4bb38e30dbd8ba0bd0a2", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-TestNetworkBasicOps-426117710 Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: a52d669c461c4bb38e30dbd8ba0bd0a2 Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-TestNetworkBasicOps-426117710 Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-TestNetworkBasicOps-426117710-project Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: cb110e0802174e1fb00d874f9e047b01 Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-TestNetworkBasicOps-426117710-project Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: exception: Instance da9bceb9-4c3f-48ce-ae73-edc39b206e30 could not be found. Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'da9bceb9-4c3f-48ce-ae73-edc39b206e30'} Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da9bceb9-4c3f-48ce-ae73-edc39b206e30 could not be found. Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da9bceb9-4c3f-48ce-ae73-edc39b206e30 could not be found. Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:33:28.144954 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:33:28.151415 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:33:28.151415 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:33:28.151415 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:33:28.151415 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:33:28.151415 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:33:28.151415 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da9bceb9-4c3f-48ce-ae73-edc39b206e30 could not be found. Jun 10 18:33:28.151415 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:33:28.151415 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cac7203b-830c-4e6a-8bff-d0f198bfac84 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Returning 404 to user: Instance da9bceb9-4c3f-48ce-ae73-edc39b206e30 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:33:28.151415 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cac7203b-830c-4e6a-8bff-d0f198bfac84 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30" status: 404 len: 111 microversion: 2.1 time: 0.059478 Jun 10 18:33:28.151415 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3279/6516] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:28 2022] GET /compute/v2.1/servers/da9bceb9-4c3f-48ce-ae73-edc39b206e30 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:33:28.467554 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f0bb8e75-6755-4a22-93c7-0fd16b8e1c5d tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '.version_select at 0x7f77c00a5040>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:28.558913 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f0bb8e75-6755-4a22-93c7-0fd16b8e1c5d tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1507438089" status: 202 len: 0 microversion: 2.1 time: 0.093544 Jun 10 18:33:28.558913 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3238/6517] 10.222.0.35 () {58 vars in 1256 bytes} [Fri Jun 10 18:33:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1507438089 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 18:33:41.501249 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-05145c01-c643-45d4-b966-10623cd7571f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-637830931", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "210834ea-185d-4bad-a188-012487728c60"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1513264815", "security_groups": [{"name": "tempest-secgroup-smoke-1650084467"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:33:41.552380 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=4 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:33:41.554785 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:33:42.009070 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-05145c01-c643-45d4-b966-10623cd7571f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] validate_networks() for [('210834ea-185d-4bad-a188-012487728c60', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:33:43.408672 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-05145c01-c643-45d4-b966-10623cd7571f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:33:43.410008 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-05145c01-c643-45d4-b966-10623cd7571f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:33:43.412120 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-05145c01-c643-45d4-b966-10623cd7571f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:33:43.412120 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-05145c01-c643-45d4-b966-10623cd7571f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:33:43.412120 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-05145c01-c643-45d4-b966-10623cd7571f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:33:43.436777 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-05145c01-c643-45d4-b966-10623cd7571f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:43.437245 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-05145c01-c643-45d4-b966-10623cd7571f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:43.440239 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-05145c01-c643-45d4-b966-10623cd7571f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:43.440722 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-05145c01-c643-45d4-b966-10623cd7571f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:43.490137 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-05145c01-c643-45d4-b966-10623cd7571f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Getting quotas for project 4089a2104afe4f1ab69f1b7983e4735d. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:33:43.506257 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-05145c01-c643-45d4-b966-10623cd7571f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Getting quotas for user 9d5fe9478d2b47e3b87cecc86d40773c and project 4089a2104afe4f1ab69f1b7983e4735d. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:33:43.545328 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-05145c01-c643-45d4-b966-10623cd7571f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:33:43.547671 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-05145c01-c643-45d4-b966-10623cd7571f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:33:43.796839 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-05145c01-c643-45d4-b966-10623cd7571f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.311199 Jun 10 18:33:43.799626 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3280/6518] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:33:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 2315 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:33:43.809808 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fdc9ac0b-bb43-4e54-8a0e-849bd3e69f1b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:43.810563 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fdc9ac0b-bb43-4e54-8a0e-849bd3e69f1b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:43.835519 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=9,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:33:43.847886 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:33:44.004038 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fdc9ac0b-bb43-4e54-8a0e-849bd3e69f1b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:44.022783 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fdc9ac0b-bb43-4e54-8a0e-849bd3e69f1b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1266 microversion: 2.1 time: 0.212807 Jun 10 18:33:44.023934 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3239/6519] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:43 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:45.047444 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8603d04d-a0ef-4a69-85b1-3ee6b6d41e76 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:45.049123 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8603d04d-a0ef-4a69-85b1-3ee6b6d41e76 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:45.177682 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8603d04d-a0ef-4a69-85b1-3ee6b6d41e76 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:45.189242 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8603d04d-a0ef-4a69-85b1-3ee6b6d41e76 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1266 microversion: 2.1 time: 0.151602 Jun 10 18:33:45.190255 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3281/6520] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:45 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:46.208476 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-32343d0a-0337-420a-89c1-16611e04873e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:46.210009 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-32343d0a-0337-420a-89c1-16611e04873e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:46.219574 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-32343d0a-0337-420a-89c1-16611e04873e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:46.220206 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-32343d0a-0337-420a-89c1-16611e04873e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:46.221580 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-32343d0a-0337-420a-89c1-16611e04873e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:46.222257 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-32343d0a-0337-420a-89c1-16611e04873e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:46.334594 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-32343d0a-0337-420a-89c1-16611e04873e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:46.345046 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-32343d0a-0337-420a-89c1-16611e04873e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1318 microversion: 2.1 time: 0.142064 Jun 10 18:33:46.357023 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3240/6521] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:46 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:47.362904 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-018d2a1c-1173-4e3f-a8c6-1a8f3da17e62 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:47.363522 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-018d2a1c-1173-4e3f-a8c6-1a8f3da17e62 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:47.380578 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-018d2a1c-1173-4e3f-a8c6-1a8f3da17e62 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:47.381042 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-018d2a1c-1173-4e3f-a8c6-1a8f3da17e62 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:47.381830 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-018d2a1c-1173-4e3f-a8c6-1a8f3da17e62 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:47.387910 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-018d2a1c-1173-4e3f-a8c6-1a8f3da17e62 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:47.577057 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-018d2a1c-1173-4e3f-a8c6-1a8f3da17e62 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:47.588709 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-018d2a1c-1173-4e3f-a8c6-1a8f3da17e62 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1324 microversion: 2.1 time: 0.225253 Jun 10 18:33:47.589357 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3282/6522] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:47 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1324 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:48.612055 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-30486813-3313-42de-9e0c-2462ca2d5120 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:48.616004 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-30486813-3313-42de-9e0c-2462ca2d5120 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:48.632635 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30486813-3313-42de-9e0c-2462ca2d5120 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:48.633691 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30486813-3313-42de-9e0c-2462ca2d5120 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:48.634859 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30486813-3313-42de-9e0c-2462ca2d5120 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:48.635608 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30486813-3313-42de-9e0c-2462ca2d5120 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:48.810356 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-30486813-3313-42de-9e0c-2462ca2d5120 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:48.825109 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-30486813-3313-42de-9e0c-2462ca2d5120 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1324 microversion: 2.1 time: 0.222167 Jun 10 18:33:48.825758 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3241/6523] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:48 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1324 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:49.842981 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cb44701d-e88d-4d14-bc90-4984378945ce tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:49.844645 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cb44701d-e88d-4d14-bc90-4984378945ce tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:49.880929 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cb44701d-e88d-4d14-bc90-4984378945ce tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:49.881394 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cb44701d-e88d-4d14-bc90-4984378945ce tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:49.882231 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cb44701d-e88d-4d14-bc90-4984378945ce tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:49.882688 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cb44701d-e88d-4d14-bc90-4984378945ce tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:51.178093 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a4f796df-9e2f-4d8e-86fe-203c7cb19b87 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Action: 'create', calling method: .version_select at 0x7f77c0051ca0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-321090491", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWN9HOB1WCoDROXODNf0Xc6MYB9LyKMaEuboNO8q0dEol9vy9vzhEt93i0TpOKeCimmZptO7PbNqf6zT2OWuBTJmfN11Wx3/9BoCUw7HolhLfVQIizts3n1ryVNIYwZmw=="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:33:51.263196 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-a4f796df-9e2f-4d8e-86fe-203c7cb19b87 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Getting quotas for project a52d669c461c4bb38e30dbd8ba0bd0a2. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:33:51.295105 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-a4f796df-9e2f-4d8e-86fe-203c7cb19b87 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Getting quotas for user cb110e0802174e1fb00d874f9e047b01 and project a52d669c461c4bb38e30dbd8ba0bd0a2. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:33:51.423266 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cb44701d-e88d-4d14-bc90-4984378945ce tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:51.432173 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cb44701d-e88d-4d14-bc90-4984378945ce tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1392 microversion: 2.1 time: 1.593816 Jun 10 18:33:51.445023 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3283/6524] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:49 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1392 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:51.467934 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a4f796df-9e2f-4d8e-86fe-203c7cb19b87 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.295949 Jun 10 18:33:51.468726 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3242/6525] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 18:33:51 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:33:51.763069 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-65aa497d-6bc9-4ec5-adbc-8d8bc081f7a0 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:51.763982 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-65aa497d-6bc9-4ec5-adbc-8d8bc081f7a0 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: cf4aaf4f-5855-4034-a1a5-2bfb200ad546] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:51.777556 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-65aa497d-6bc9-4ec5-adbc-8d8bc081f7a0 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:51.780492 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-65aa497d-6bc9-4ec5-adbc-8d8bc081f7a0 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:51.785575 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-65aa497d-6bc9-4ec5-adbc-8d8bc081f7a0 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:51.789885 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-65aa497d-6bc9-4ec5-adbc-8d8bc081f7a0 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:51.868083 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-65aa497d-6bc9-4ec5-adbc-8d8bc081f7a0 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546/ips" status: 200 len: 144 microversion: 2.1 time: 0.110099 Jun 10 18:33:51.876928 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3284/6526] 10.222.0.35 () {58 vars in 1247 bytes} [Fri Jun 10 18:33:51 2022] GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546/ips => generated 144 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:33:52.455652 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a7db0b11-cf79-4c96-b52e-8cb4c70b7ba8 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:52.459581 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a7db0b11-cf79-4c96-b52e-8cb4c70b7ba8 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:52.480151 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a7db0b11-cf79-4c96-b52e-8cb4c70b7ba8 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:52.485671 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a7db0b11-cf79-4c96-b52e-8cb4c70b7ba8 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:52.486660 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a7db0b11-cf79-4c96-b52e-8cb4c70b7ba8 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:52.487272 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a7db0b11-cf79-4c96-b52e-8cb4c70b7ba8 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:53.209018 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a7db0b11-cf79-4c96-b52e-8cb4c70b7ba8 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:53.227067 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a7db0b11-cf79-4c96-b52e-8cb4c70b7ba8 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1392 microversion: 2.1 time: 0.777368 Jun 10 18:33:53.241676 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3243/6527] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:52 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1392 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:54.159708 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-b6145e53-3211-43d7-a3c8-68e198d0e05c req-0c19795a-9315-430e-985f-d6fa2fc811d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22d96fe9-d755-452b-95a0-b0ce772fb72e", "tag": "ede2c1d8-e562-4758-9879-234ee389f99f"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:33:54.162612 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:33:54.170058 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-b6145e53-3211-43d7-a3c8-68e198d0e05c req-0c19795a-9315-430e-985f-d6fa2fc811d6 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:54.171127 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-b6145e53-3211-43d7-a3c8-68e198d0e05c req-0c19795a-9315-430e-985f-d6fa2fc811d6 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:54.200360 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-b6145e53-3211-43d7-a3c8-68e198d0e05c req-0c19795a-9315-430e-985f-d6fa2fc811d6 service nova] Creating event network-changed:ede2c1d8-e562-4758-9879-234ee389f99f for instance 22d96fe9-d755-452b-95a0-b0ce772fb72e on chh1-master-2 Jun 10 18:33:54.211312 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-b6145e53-3211-43d7-a3c8-68e198d0e05c req-0c19795a-9315-430e-985f-d6fa2fc811d6 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062737 Jun 10 18:33:54.212893 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3285/6528] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:33:54.245739 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-02d6b72c-8e6c-45b0-b765-c1e8eb1380c1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:54.247004 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-02d6b72c-8e6c-45b0-b765-c1e8eb1380c1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:54.257146 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02d6b72c-8e6c-45b0-b765-c1e8eb1380c1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:54.257804 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02d6b72c-8e6c-45b0-b765-c1e8eb1380c1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:54.258966 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02d6b72c-8e6c-45b0-b765-c1e8eb1380c1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:54.259707 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02d6b72c-8e6c-45b0-b765-c1e8eb1380c1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:54.837999 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-02d6b72c-8e6c-45b0-b765-c1e8eb1380c1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:54.844641 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-02d6b72c-8e6c-45b0-b765-c1e8eb1380c1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1392 microversion: 2.1 time: 0.602150 Jun 10 18:33:54.857394 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3244/6529] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:54 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1392 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:55.808510 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=8 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:33:55.813339 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7a2d0c34-ca24-4f70-9017-41e40358e2a1 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-319646926", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "f655edaf-7f1f-4dba-ac94-bb1146679731"}], "key_name": "tempest-TestNetworkBasicOps-321090491", "security_groups": [{"name": "tempest-secgroup-smoke-2064149843"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:33:55.864392 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cd0818c5-f8d9-4de3-8795-ae1fb980456b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:55.865024 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cd0818c5-f8d9-4de3-8795-ae1fb980456b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:55.895448 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd0818c5-f8d9-4de3-8795-ae1fb980456b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:55.895448 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd0818c5-f8d9-4de3-8795-ae1fb980456b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:55.895448 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd0818c5-f8d9-4de3-8795-ae1fb980456b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:55.895448 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd0818c5-f8d9-4de3-8795-ae1fb980456b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:56.025270 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-7a2d0c34-ca24-4f70-9017-41e40358e2a1 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] validate_networks() for [('f655edaf-7f1f-4dba-ac94-bb1146679731', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:33:56.139033 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cd0818c5-f8d9-4de3-8795-ae1fb980456b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:56.150598 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cd0818c5-f8d9-4de3-8795-ae1fb980456b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1392 microversion: 2.1 time: 0.291617 Jun 10 18:33:56.161611 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3245/6530] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:55 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1392 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:56.328139 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e1cdc8a9-a31e-45ed-9119-53e3a4601224 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a5c4431-651e-4be2-8e5a-f1558fbffca1"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:33:56.329285 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e1cdc8a9-a31e-45ed-9119-53e3a4601224 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: cf4aaf4f-5855-4034-a1a5-2bfb200ad546] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:56.342511 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e1cdc8a9-a31e-45ed-9119-53e3a4601224 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:56.343979 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e1cdc8a9-a31e-45ed-9119-53e3a4601224 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:56.349985 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e1cdc8a9-a31e-45ed-9119-53e3a4601224 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:56.350609 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e1cdc8a9-a31e-45ed-9119-53e3a4601224 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:56.983283 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-7a2d0c34-ca24-4f70-9017-41e40358e2a1 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:33:56.984298 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-7a2d0c34-ca24-4f70-9017-41e40358e2a1 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:33:56.985116 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-7a2d0c34-ca24-4f70-9017-41e40358e2a1 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:33:56.985733 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-7a2d0c34-ca24-4f70-9017-41e40358e2a1 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:33:56.986393 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-7a2d0c34-ca24-4f70-9017-41e40358e2a1 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:33:57.001565 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7a2d0c34-ca24-4f70-9017-41e40358e2a1 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:57.002231 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7a2d0c34-ca24-4f70-9017-41e40358e2a1 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:57.003243 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7a2d0c34-ca24-4f70-9017-41e40358e2a1 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:57.003863 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7a2d0c34-ca24-4f70-9017-41e40358e2a1 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:57.030866 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-7a2d0c34-ca24-4f70-9017-41e40358e2a1 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Getting quotas for project a52d669c461c4bb38e30dbd8ba0bd0a2. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:33:57.037576 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-7a2d0c34-ca24-4f70-9017-41e40358e2a1 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Getting quotas for user cb110e0802174e1fb00d874f9e047b01 and project a52d669c461c4bb38e30dbd8ba0bd0a2. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:33:57.076365 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7a2d0c34-ca24-4f70-9017-41e40358e2a1 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:33:57.078832 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7a2d0c34-ca24-4f70-9017-41e40358e2a1 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 12d8e153-a080-4789-825b-af419b843eaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:33:57.258545 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7a2d0c34-ca24-4f70-9017-41e40358e2a1 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.451419 Jun 10 18:33:57.263194 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3286/6531] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:33:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 1457 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:33:57.271851 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f266124c-77cf-4357-8dc8-87b8783b06e5 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:57.272769 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f266124c-77cf-4357-8dc8-87b8783b06e5 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:57.284261 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f266124c-77cf-4357-8dc8-87b8783b06e5 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:57.285038 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f266124c-77cf-4357-8dc8-87b8783b06e5 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:57.285983 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f266124c-77cf-4357-8dc8-87b8783b06e5 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:57.286559 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f266124c-77cf-4357-8dc8-87b8783b06e5 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:57.541688 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e1cdc8a9-a31e-45ed-9119-53e3a4601224 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "POST /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.223741 Jun 10 18:33:57.550272 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3246/6532] 10.222.0.35 () {60 vars in 1322 bytes} [Fri Jun 10 18:33:56 2022] POST /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546/os-volume_attachments => generated 194 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:33:57.571022 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7074b186-7ab8-4825-b746-21bdf3407d03 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:57.573562 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7074b186-7ab8-4825-b746-21bdf3407d03 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 12d8e153-a080-4789-825b-af419b843eaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:57.617179 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f266124c-77cf-4357-8dc8-87b8783b06e5 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:57.625619 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f266124c-77cf-4357-8dc8-87b8783b06e5 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1392 microversion: 2.1 time: 0.361020 Jun 10 18:33:57.626208 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3287/6533] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:57 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1392 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:57.681762 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7074b186-7ab8-4825-b746-21bdf3407d03 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:57.692055 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7074b186-7ab8-4825-b746-21bdf3407d03 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa" status: 200 len: 1247 microversion: 2.1 time: 0.148184 Jun 10 18:33:57.693939 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3247/6534] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:57 2022] GET /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa => generated 1247 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:58.648602 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fa0c4f3d-e097-485c-be13-29a1428a22bd tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:58.649559 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fa0c4f3d-e097-485c-be13-29a1428a22bd tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:58.657750 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fa0c4f3d-e097-485c-be13-29a1428a22bd tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:58.658655 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fa0c4f3d-e097-485c-be13-29a1428a22bd tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:58.659986 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fa0c4f3d-e097-485c-be13-29a1428a22bd tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:58.660604 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fa0c4f3d-e097-485c-be13-29a1428a22bd tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:58.715015 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ab4db030-daeb-4bed-91e0-43fe0c6f46fc tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:58.715635 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ab4db030-daeb-4bed-91e0-43fe0c6f46fc tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 12d8e153-a080-4789-825b-af419b843eaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:58.723744 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ab4db030-daeb-4bed-91e0-43fe0c6f46fc tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:58.724435 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ab4db030-daeb-4bed-91e0-43fe0c6f46fc tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:58.725386 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ab4db030-daeb-4bed-91e0-43fe0c6f46fc tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:58.725996 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ab4db030-daeb-4bed-91e0-43fe0c6f46fc tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:58.907248 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ab4db030-daeb-4bed-91e0-43fe0c6f46fc tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:58.933598 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ab4db030-daeb-4bed-91e0-43fe0c6f46fc tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa" status: 200 len: 1251 microversion: 2.1 time: 0.226208 Jun 10 18:33:58.939459 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fa0c4f3d-e097-485c-be13-29a1428a22bd tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:33:58.943667 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3248/6535] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:58 2022] GET /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa => generated 1251 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:33:58.955956 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fa0c4f3d-e097-485c-be13-29a1428a22bd tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1392 microversion: 2.1 time: 0.311482 Jun 10 18:33:58.972794 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3288/6536] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:58 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1392 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:33:59.653242 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-578f8a8e-61de-4c5d-b50f-e9cb84dc0289 req-5b232624-0020-4687-99cd-623946383836 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22d96fe9-d755-452b-95a0-b0ce772fb72e", "name": "network-vif-plugged", "status": "completed", "tag": "ede2c1d8-e562-4758-9879-234ee389f99f"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:33:59.665665 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-578f8a8e-61de-4c5d-b50f-e9cb84dc0289 req-5b232624-0020-4687-99cd-623946383836 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:59.666276 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-578f8a8e-61de-4c5d-b50f-e9cb84dc0289 req-5b232624-0020-4687-99cd-623946383836 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:59.693757 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-578f8a8e-61de-4c5d-b50f-e9cb84dc0289 req-5b232624-0020-4687-99cd-623946383836 service nova] Creating event network-vif-plugged:ede2c1d8-e562-4758-9879-234ee389f99f for instance 22d96fe9-d755-452b-95a0-b0ce772fb72e on chh1-master-2 Jun 10 18:33:59.703009 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-578f8a8e-61de-4c5d-b50f-e9cb84dc0289 req-5b232624-0020-4687-99cd-623946383836 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.298701 Jun 10 18:33:59.704202 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3249/6537] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:33:59.958837 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-147abe4c-5c83-4de2-a49e-898f8b6874b9 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:59.960093 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-147abe4c-5c83-4de2-a49e-898f8b6874b9 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 12d8e153-a080-4789-825b-af419b843eaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:59.975016 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-147abe4c-5c83-4de2-a49e-898f8b6874b9 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:59.975194 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6c2581c0-28be-4abe-9962-9234b4b806ce tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:33:59.975618 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-147abe4c-5c83-4de2-a49e-898f8b6874b9 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:59.975896 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6c2581c0-28be-4abe-9962-9234b4b806ce tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:33:59.976244 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-147abe4c-5c83-4de2-a49e-898f8b6874b9 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:59.976705 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-147abe4c-5c83-4de2-a49e-898f8b6874b9 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:59.994077 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6c2581c0-28be-4abe-9962-9234b4b806ce tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:59.996946 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6c2581c0-28be-4abe-9962-9234b4b806ce tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:33:59.997984 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6c2581c0-28be-4abe-9962-9234b4b806ce tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:33:59.998661 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6c2581c0-28be-4abe-9962-9234b4b806ce tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:00.112054 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-147abe4c-5c83-4de2-a49e-898f8b6874b9 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:00.130430 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-147abe4c-5c83-4de2-a49e-898f8b6874b9 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa" status: 200 len: 1307 microversion: 2.1 time: 0.182382 Jun 10 18:34:00.135748 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3289/6538] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:59 2022] GET /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa => generated 1307 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:34:00.858760 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6c2581c0-28be-4abe-9962-9234b4b806ce tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:00.874151 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6c2581c0-28be-4abe-9962-9234b4b806ce tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1392 microversion: 2.1 time: 0.903126 Jun 10 18:34:00.893442 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3250/6539] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:33:59 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1392 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:34:01.156664 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b1e2d97c-d9c0-47bd-bb05-48eb3c5f67a6 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:01.157388 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b1e2d97c-d9c0-47bd-bb05-48eb3c5f67a6 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 12d8e153-a080-4789-825b-af419b843eaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:01.164705 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b1e2d97c-d9c0-47bd-bb05-48eb3c5f67a6 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:01.165163 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b1e2d97c-d9c0-47bd-bb05-48eb3c5f67a6 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:01.165950 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b1e2d97c-d9c0-47bd-bb05-48eb3c5f67a6 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:01.166392 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b1e2d97c-d9c0-47bd-bb05-48eb3c5f67a6 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:01.363152 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b1e2d97c-d9c0-47bd-bb05-48eb3c5f67a6 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:01.371998 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b1e2d97c-d9c0-47bd-bb05-48eb3c5f67a6 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa" status: 200 len: 1305 microversion: 2.1 time: 0.219243 Jun 10 18:34:01.373120 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3290/6540] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:01 2022] GET /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa => generated 1305 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:34:01.894434 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7648543c-a41c-4455-ad71-34ece332d22b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:01.895564 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7648543c-a41c-4455-ad71-34ece332d22b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:01.912223 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7648543c-a41c-4455-ad71-34ece332d22b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:01.912737 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7648543c-a41c-4455-ad71-34ece332d22b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:01.913553 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7648543c-a41c-4455-ad71-34ece332d22b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:01.913996 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7648543c-a41c-4455-ad71-34ece332d22b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:02.140518 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-59be38e9-cc1c-40e8-afeb-30de75194796 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:02.141234 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-59be38e9-cc1c-40e8-afeb-30de75194796 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] [instance: 32c2282f-8127-41a3-b616-ba0d58394128] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:02.152815 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-59be38e9-cc1c-40e8-afeb-30de75194796 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:02.153429 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-59be38e9-cc1c-40e8-afeb-30de75194796 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:02.154590 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-59be38e9-cc1c-40e8-afeb-30de75194796 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:02.155244 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-59be38e9-cc1c-40e8-afeb-30de75194796 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:02.333993 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-59be38e9-cc1c-40e8-afeb-30de75194796 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lazy-loading 'services' on Instance uuid 32c2282f-8127-41a3-b616-ba0d58394128 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:34:02.514085 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7648543c-a41c-4455-ad71-34ece332d22b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:02.534293 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7648543c-a41c-4455-ad71-34ece332d22b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1564 microversion: 2.1 time: 0.645166 Jun 10 18:34:02.552916 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3251/6541] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:01 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1564 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:34:02.560585 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d7a0369d-8402-4f01-9d73-a90e3ecde2aa tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:02.561363 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d7a0369d-8402-4f01-9d73-a90e3ecde2aa tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 12d8e153-a080-4789-825b-af419b843eaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:02.574653 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d7a0369d-8402-4f01-9d73-a90e3ecde2aa tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:02.576222 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d7a0369d-8402-4f01-9d73-a90e3ecde2aa tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:02.578192 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d7a0369d-8402-4f01-9d73-a90e3ecde2aa tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:02.579895 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d7a0369d-8402-4f01-9d73-a90e3ecde2aa tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:02.801320 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-59be38e9-cc1c-40e8-afeb-30de75194796 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] 10.222.0.35 "DELETE /compute/v2.1/servers/32c2282f-8127-41a3-b616-ba0d58394128/os-volume_attachments/fdd27289-5a64-4d97-bdd5-7b7c8cee93e9" status: 202 len: 0 microversion: 2.1 time: 0.666950 Jun 10 18:34:02.802554 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3291/6542] 10.222.0.35 () {58 vars in 1415 bytes} [Fri Jun 10 18:34:02 2022] DELETE /compute/v2.1/servers/32c2282f-8127-41a3-b616-ba0d58394128/os-volume_attachments/fdd27289-5a64-4d97-bdd5-7b7c8cee93e9 => generated 0 bytes in 669 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:34:02.845683 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7ba683a2-8768-4d0d-ae08-e0c592369ecc tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:02.852862 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7ba683a2-8768-4d0d-ae08-e0c592369ecc tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:02.871996 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ba683a2-8768-4d0d-ae08-e0c592369ecc tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:02.872556 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ba683a2-8768-4d0d-ae08-e0c592369ecc tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:02.879523 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ba683a2-8768-4d0d-ae08-e0c592369ecc tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:02.879990 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ba683a2-8768-4d0d-ae08-e0c592369ecc tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:02.996496 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d7a0369d-8402-4f01-9d73-a90e3ecde2aa tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:03.008630 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d7a0369d-8402-4f01-9d73-a90e3ecde2aa tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa" status: 200 len: 1373 microversion: 2.1 time: 0.451933 Jun 10 18:34:03.012836 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3252/6543] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:02 2022] GET /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa => generated 1373 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:34:03.546947 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7ba683a2-8768-4d0d-ae08-e0c592369ecc tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:03.558233 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7ba683a2-8768-4d0d-ae08-e0c592369ecc tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1564 microversion: 2.1 time: 0.753421 Jun 10 18:34:03.560984 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3292/6544] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:02 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1564 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:34:04.036752 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-39d330e1-9c11-4b62-a120-2f153333da19 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:04.037872 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-39d330e1-9c11-4b62-a120-2f153333da19 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 12d8e153-a080-4789-825b-af419b843eaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:04.059328 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-39d330e1-9c11-4b62-a120-2f153333da19 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:04.061473 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-39d330e1-9c11-4b62-a120-2f153333da19 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:04.062430 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-39d330e1-9c11-4b62-a120-2f153333da19 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:04.065044 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-39d330e1-9c11-4b62-a120-2f153333da19 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:04.428196 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-4907eb89-5ddf-4b2c-976a-f1fa716bd264 req-1ebf8f45-6e4b-45e8-9314-7b0b46913ad4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12d8e153-a080-4789-825b-af419b843eaa", "tag": "fd8260c0-0773-4984-af80-4901ce0e7b3a"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:34:04.452690 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-4907eb89-5ddf-4b2c-976a-f1fa716bd264 req-1ebf8f45-6e4b-45e8-9314-7b0b46913ad4 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:04.453598 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-4907eb89-5ddf-4b2c-976a-f1fa716bd264 req-1ebf8f45-6e4b-45e8-9314-7b0b46913ad4 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:04.488980 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-4907eb89-5ddf-4b2c-976a-f1fa716bd264 req-1ebf8f45-6e4b-45e8-9314-7b0b46913ad4 service nova] Creating event network-changed:fd8260c0-0773-4984-af80-4901ce0e7b3a for instance 12d8e153-a080-4789-825b-af419b843eaa on chh2-master-2 Jun 10 18:34:04.496145 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-4907eb89-5ddf-4b2c-976a-f1fa716bd264 req-1ebf8f45-6e4b-45e8-9314-7b0b46913ad4 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072235 Jun 10 18:34:04.497562 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3293/6545] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:34:04.569178 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-39d330e1-9c11-4b62-a120-2f153333da19 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:04.585445 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-39d330e1-9c11-4b62-a120-2f153333da19 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa" status: 200 len: 1373 microversion: 2.1 time: 0.559196 Jun 10 18:34:04.593725 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3253/6546] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:04 2022] GET /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa => generated 1373 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:34:05.605779 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-628ab4ae-f8b3-4ac4-afe9-3e425682a628 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:05.606808 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-628ab4ae-f8b3-4ac4-afe9-3e425682a628 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 12d8e153-a080-4789-825b-af419b843eaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:05.617476 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-628ab4ae-f8b3-4ac4-afe9-3e425682a628 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:05.618294 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-628ab4ae-f8b3-4ac4-afe9-3e425682a628 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:05.619464 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-628ab4ae-f8b3-4ac4-afe9-3e425682a628 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:05.620749 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-628ab4ae-f8b3-4ac4-afe9-3e425682a628 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:05.863787 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-628ab4ae-f8b3-4ac4-afe9-3e425682a628 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:05.875651 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-628ab4ae-f8b3-4ac4-afe9-3e425682a628 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa" status: 200 len: 1373 microversion: 2.1 time: 0.275303 Jun 10 18:34:05.876238 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3294/6547] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:05 2022] GET /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa => generated 1373 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:34:06.896519 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8a45096c-4d66-452c-b7a2-4d838883af49 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:06.897994 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8a45096c-4d66-452c-b7a2-4d838883af49 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 12d8e153-a080-4789-825b-af419b843eaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:06.909133 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8a45096c-4d66-452c-b7a2-4d838883af49 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:06.909727 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8a45096c-4d66-452c-b7a2-4d838883af49 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:06.910688 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8a45096c-4d66-452c-b7a2-4d838883af49 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:06.911214 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8a45096c-4d66-452c-b7a2-4d838883af49 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:07.125827 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8a45096c-4d66-452c-b7a2-4d838883af49 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:07.143343 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8a45096c-4d66-452c-b7a2-4d838883af49 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa" status: 200 len: 1373 microversion: 2.1 time: 0.242390 Jun 10 18:34:07.143343 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3254/6548] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:06 2022] GET /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa => generated 1373 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:34:07.538869 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-566386b4-2df8-4eba-8f8e-188f967967fc req-3473e9b3-beb4-4568-908a-8aedd45f6dfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22d96fe9-d755-452b-95a0-b0ce772fb72e", "tag": "ede2c1d8-e562-4758-9879-234ee389f99f"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:34:07.539051 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bc01e53e-4ff1-47ed-ba63-cb3862cc8db8 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:07.539878 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bc01e53e-4ff1-47ed-ba63-cb3862cc8db8 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:07.544263 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:34:07.544975 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=6 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:34:07.552959 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-566386b4-2df8-4eba-8f8e-188f967967fc req-3473e9b3-beb4-4568-908a-8aedd45f6dfa service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:07.553427 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-566386b4-2df8-4eba-8f8e-188f967967fc req-3473e9b3-beb4-4568-908a-8aedd45f6dfa service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:07.560792 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bc01e53e-4ff1-47ed-ba63-cb3862cc8db8 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:07.561255 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bc01e53e-4ff1-47ed-ba63-cb3862cc8db8 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:07.562227 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bc01e53e-4ff1-47ed-ba63-cb3862cc8db8 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:07.562887 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bc01e53e-4ff1-47ed-ba63-cb3862cc8db8 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:07.572076 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-566386b4-2df8-4eba-8f8e-188f967967fc req-3473e9b3-beb4-4568-908a-8aedd45f6dfa service nova] Creating event network-changed:ede2c1d8-e562-4758-9879-234ee389f99f for instance 22d96fe9-d755-452b-95a0-b0ce772fb72e on chh1-master-2 Jun 10 18:34:07.581626 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-566386b4-2df8-4eba-8f8e-188f967967fc req-3473e9b3-beb4-4568-908a-8aedd45f6dfa service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046952 Jun 10 18:34:07.583513 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3255/6549] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:34:07.820762 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bc01e53e-4ff1-47ed-ba63-cb3862cc8db8 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:07.830075 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bc01e53e-4ff1-47ed-ba63-cb3862cc8db8 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1564 microversion: 2.1 time: 0.302188 Jun 10 18:34:07.834327 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3295/6550] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:07 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1564 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:34:08.155538 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=8 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:34:08.161208 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2f4e44cb-d234-44fb-91e6-76e2a03b8b7c tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:08.162094 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2f4e44cb-d234-44fb-91e6-76e2a03b8b7c tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 12d8e153-a080-4789-825b-af419b843eaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:08.171982 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2f4e44cb-d234-44fb-91e6-76e2a03b8b7c tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:08.176778 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2f4e44cb-d234-44fb-91e6-76e2a03b8b7c tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:08.179455 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2f4e44cb-d234-44fb-91e6-76e2a03b8b7c tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:08.180066 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2f4e44cb-d234-44fb-91e6-76e2a03b8b7c tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:08.499174 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2f4e44cb-d234-44fb-91e6-76e2a03b8b7c tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:08.514003 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2f4e44cb-d234-44fb-91e6-76e2a03b8b7c tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa" status: 200 len: 1373 microversion: 2.1 time: 0.359282 Jun 10 18:34:08.517091 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3256/6551] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:08 2022] GET /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa => generated 1373 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:34:09.535245 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e76e40d5-2fa2-48ce-9e18-af5b8321bee6 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:09.535911 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e76e40d5-2fa2-48ce-9e18-af5b8321bee6 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 12d8e153-a080-4789-825b-af419b843eaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:09.544651 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e76e40d5-2fa2-48ce-9e18-af5b8321bee6 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:09.545104 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e76e40d5-2fa2-48ce-9e18-af5b8321bee6 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:09.549415 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e76e40d5-2fa2-48ce-9e18-af5b8321bee6 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:09.549415 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e76e40d5-2fa2-48ce-9e18-af5b8321bee6 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:09.723034 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e76e40d5-2fa2-48ce-9e18-af5b8321bee6 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:09.731891 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e76e40d5-2fa2-48ce-9e18-af5b8321bee6 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa" status: 200 len: 1373 microversion: 2.1 time: 0.202116 Jun 10 18:34:09.733260 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3296/6552] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:09 2022] GET /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa => generated 1373 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:34:10.750086 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6be47c90-160f-4d55-b6c2-130670925171 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:10.751224 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6be47c90-160f-4d55-b6c2-130670925171 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 12d8e153-a080-4789-825b-af419b843eaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:10.764944 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6be47c90-160f-4d55-b6c2-130670925171 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:10.768790 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6be47c90-160f-4d55-b6c2-130670925171 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:10.777008 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6be47c90-160f-4d55-b6c2-130670925171 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:10.777008 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6be47c90-160f-4d55-b6c2-130670925171 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:10.786346 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1ad9d2ef-7df2-432e-be18-43cf2a8c4660 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:10.787258 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1ad9d2ef-7df2-432e-be18-43cf2a8c4660 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] [instance: 32c2282f-8127-41a3-b616-ba0d58394128] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:10.797699 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1ad9d2ef-7df2-432e-be18-43cf2a8c4660 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:10.798359 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1ad9d2ef-7df2-432e-be18-43cf2a8c4660 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:10.799379 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1ad9d2ef-7df2-432e-be18-43cf2a8c4660 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:10.799974 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1ad9d2ef-7df2-432e-be18-43cf2a8c4660 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:10.839693 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1ad9d2ef-7df2-432e-be18-43cf2a8c4660 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] [instance: 32c2282f-8127-41a3-b616-ba0d58394128] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:34:10.974051 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6be47c90-160f-4d55-b6c2-130670925171 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:10.985203 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6be47c90-160f-4d55-b6c2-130670925171 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa" status: 200 len: 1373 microversion: 2.1 time: 0.239835 Jun 10 18:34:10.986351 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3257/6553] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:10 2022] GET /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa => generated 1373 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:34:10.991329 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-adace43e-da35-4f10-b434-8bfc993d7176 req-f403d7fa-bd59-41ae-9c1a-3a9a8e648e69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12d8e153-a080-4789-825b-af419b843eaa", "name": "network-vif-plugged", "status": "completed", "tag": "fd8260c0-0773-4984-af80-4901ce0e7b3a"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:34:11.000688 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-adace43e-da35-4f10-b434-8bfc993d7176 req-f403d7fa-bd59-41ae-9c1a-3a9a8e648e69 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:11.001283 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-adace43e-da35-4f10-b434-8bfc993d7176 req-f403d7fa-bd59-41ae-9c1a-3a9a8e648e69 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:11.012795 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-adace43e-da35-4f10-b434-8bfc993d7176 req-f403d7fa-bd59-41ae-9c1a-3a9a8e648e69 service nova] Creating event network-vif-plugged:fd8260c0-0773-4984-af80-4901ce0e7b3a for instance 12d8e153-a080-4789-825b-af419b843eaa on chh2-master-2 Jun 10 18:34:11.018240 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-adace43e-da35-4f10-b434-8bfc993d7176 req-f403d7fa-bd59-41ae-9c1a-3a9a8e648e69 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030483 Jun 10 18:34:11.019106 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3258/6554] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:34:11.290027 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1ad9d2ef-7df2-432e-be18-43cf2a8c4660 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] 10.222.0.35 "DELETE /compute/v2.1/servers/32c2282f-8127-41a3-b616-ba0d58394128" status: 204 len: 0 microversion: 2.1 time: 0.508358 Jun 10 18:34:11.290562 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3297/6555] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:34:10 2022] DELETE /compute/v2.1/servers/32c2282f-8127-41a3-b616-ba0d58394128 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:34:11.299755 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-79ca04ca-9519-4d98-be18-77c8bdd9df26 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:11.300558 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-79ca04ca-9519-4d98-be18-77c8bdd9df26 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] [instance: 32c2282f-8127-41a3-b616-ba0d58394128] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:11.306997 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-79ca04ca-9519-4d98-be18-77c8bdd9df26 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:11.307968 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-79ca04ca-9519-4d98-be18-77c8bdd9df26 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:11.308922 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-79ca04ca-9519-4d98-be18-77c8bdd9df26 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:11.309321 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-79ca04ca-9519-4d98-be18-77c8bdd9df26 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:11.313444 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:34:11.458614 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-79ca04ca-9519-4d98-be18-77c8bdd9df26 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa5b7f650884ee59282ce97f48fc0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a8d819ba8844878f82cf60131df725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:11.466256 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-79ca04ca-9519-4d98-be18-77c8bdd9df26 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] 10.222.0.35 "GET /compute/v2.1/servers/32c2282f-8127-41a3-b616-ba0d58394128" status: 200 len: 1513 microversion: 2.1 time: 0.170910 Jun 10 18:34:11.466909 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3259/6556] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:11 2022] GET /compute/v2.1/servers/32c2282f-8127-41a3-b616-ba0d58394128 => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:34:12.003547 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f9fad41e-f7cc-4f8f-ad86-ca12adcfb650 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:12.004201 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f9fad41e-f7cc-4f8f-ad86-ca12adcfb650 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 12d8e153-a080-4789-825b-af419b843eaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:12.007181 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:34:12.016468 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f9fad41e-f7cc-4f8f-ad86-ca12adcfb650 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:12.017027 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f9fad41e-f7cc-4f8f-ad86-ca12adcfb650 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:12.018112 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f9fad41e-f7cc-4f8f-ad86-ca12adcfb650 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:12.018704 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f9fad41e-f7cc-4f8f-ad86-ca12adcfb650 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:12.043838 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:34:12.179991 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f9fad41e-f7cc-4f8f-ad86-ca12adcfb650 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:12.190135 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f9fad41e-f7cc-4f8f-ad86-ca12adcfb650 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa" status: 200 len: 1373 microversion: 2.1 time: 0.191164 Jun 10 18:34:12.190949 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3298/6557] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:11 2022] GET /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa => generated 1373 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:34:12.484879 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-94ad1072-0ee8-4797-a0fc-9994bd57b221 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:12.485490 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-94ad1072-0ee8-4797-a0fc-9994bd57b221 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] [instance: 32c2282f-8127-41a3-b616-ba0d58394128] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:12.493092 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-94ad1072-0ee8-4797-a0fc-9994bd57b221 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:12.493545 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-94ad1072-0ee8-4797-a0fc-9994bd57b221 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:12.494311 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-94ad1072-0ee8-4797-a0fc-9994bd57b221 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:12.494753 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-94ad1072-0ee8-4797-a0fc-9994bd57b221 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:12.627293 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-94ad1072-0ee8-4797-a0fc-9994bd57b221 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa5b7f650884ee59282ce97f48fc0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a8d819ba8844878f82cf60131df725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:12.635109 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-94ad1072-0ee8-4797-a0fc-9994bd57b221 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] 10.222.0.35 "GET /compute/v2.1/servers/32c2282f-8127-41a3-b616-ba0d58394128" status: 200 len: 1513 microversion: 2.1 time: 0.154414 Jun 10 18:34:12.636266 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3260/6558] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:12 2022] GET /compute/v2.1/servers/32c2282f-8127-41a3-b616-ba0d58394128 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:34:13.054817 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-359b3833-b5d2-4f7c-b086-ec82313a9088 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:13.055810 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-359b3833-b5d2-4f7c-b086-ec82313a9088 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: cf4aaf4f-5855-4034-a1a5-2bfb200ad546] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:13.071367 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-359b3833-b5d2-4f7c-b086-ec82313a9088 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:13.071835 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-359b3833-b5d2-4f7c-b086-ec82313a9088 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:13.072650 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-359b3833-b5d2-4f7c-b086-ec82313a9088 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:13.076429 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-359b3833-b5d2-4f7c-b086-ec82313a9088 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:13.105575 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-359b3833-b5d2-4f7c-b086-ec82313a9088 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055034 Jun 10 18:34:13.110775 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3299/6559] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:34:13 2022] GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:34:13.116072 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4d992992-251c-4fe5-8c86-e43c05069409 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:13.116584 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4d992992-251c-4fe5-8c86-e43c05069409 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: cf4aaf4f-5855-4034-a1a5-2bfb200ad546] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:13.124262 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d992992-251c-4fe5-8c86-e43c05069409 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:13.124755 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d992992-251c-4fe5-8c86-e43c05069409 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:13.127855 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d992992-251c-4fe5-8c86-e43c05069409 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:13.127855 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d992992-251c-4fe5-8c86-e43c05069409 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:13.157216 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4d992992-251c-4fe5-8c86-e43c05069409 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546/os-volume_attachments/0a5c4431-651e-4be2-8e5a-f1558fbffca1" status: 200 len: 194 microversion: 2.1 time: 0.044983 Jun 10 18:34:13.157854 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3261/6560] 10.222.0.35 () {58 vars in 1412 bytes} [Fri Jun 10 18:34:13 2022] GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546/os-volume_attachments/0a5c4431-651e-4be2-8e5a-f1558fbffca1 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:34:13.207117 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bf8a36e8-986d-4f69-b780-3d7b18a96610 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:13.207737 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bf8a36e8-986d-4f69-b780-3d7b18a96610 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 12d8e153-a080-4789-825b-af419b843eaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:13.215521 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bf8a36e8-986d-4f69-b780-3d7b18a96610 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:13.215982 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bf8a36e8-986d-4f69-b780-3d7b18a96610 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:13.216832 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bf8a36e8-986d-4f69-b780-3d7b18a96610 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:13.217281 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bf8a36e8-986d-4f69-b780-3d7b18a96610 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:13.371116 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bf8a36e8-986d-4f69-b780-3d7b18a96610 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:13.382103 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bf8a36e8-986d-4f69-b780-3d7b18a96610 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa" status: 200 len: 1373 microversion: 2.1 time: 0.178241 Jun 10 18:34:13.392438 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3300/6561] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:13 2022] GET /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa => generated 1373 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:34:13.653256 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fa0aebf4-8391-4d48-acbe-c5f8875b7a52 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:13.654564 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fa0aebf4-8391-4d48-acbe-c5f8875b7a52 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] [instance: 32c2282f-8127-41a3-b616-ba0d58394128] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:13.662061 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa0aebf4-8391-4d48-acbe-c5f8875b7a52 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:13.662852 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa0aebf4-8391-4d48-acbe-c5f8875b7a52 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:13.663913 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa0aebf4-8391-4d48-acbe-c5f8875b7a52 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:13.664660 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa0aebf4-8391-4d48-acbe-c5f8875b7a52 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:13.956468 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fa0aebf4-8391-4d48-acbe-c5f8875b7a52 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa5b7f650884ee59282ce97f48fc0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a8d819ba8844878f82cf60131df725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:13.967066 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fa0aebf4-8391-4d48-acbe-c5f8875b7a52 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] 10.222.0.35 "GET /compute/v2.1/servers/32c2282f-8127-41a3-b616-ba0d58394128" status: 200 len: 1513 microversion: 2.1 time: 0.318338 Jun 10 18:34:13.967683 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3262/6562] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:13 2022] GET /compute/v2.1/servers/32c2282f-8127-41a3-b616-ba0d58394128 => generated 1513 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:34:14.399738 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-63b677d9-fb6f-475e-b425-53a78e65422e tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:14.401754 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-63b677d9-fb6f-475e-b425-53a78e65422e tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 12d8e153-a080-4789-825b-af419b843eaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:14.420636 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-63b677d9-fb6f-475e-b425-53a78e65422e tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:14.421321 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-63b677d9-fb6f-475e-b425-53a78e65422e tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:14.422515 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-63b677d9-fb6f-475e-b425-53a78e65422e tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:14.423175 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-63b677d9-fb6f-475e-b425-53a78e65422e tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:14.695054 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-ec2b2aec-fedb-4692-9cc4-3fce0ea054aa req-aa88f574-3906-4ab8-9625-e36b2ac5d14a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32c2282f-8127-41a3-b616-ba0d58394128", "name": "network-vif-deleted", "tag": "1de44453-13e8-4a14-8524-32dced7611b9"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:34:14.704872 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-ec2b2aec-fedb-4692-9cc4-3fce0ea054aa req-aa88f574-3906-4ab8-9625-e36b2ac5d14a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:14.705379 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-ec2b2aec-fedb-4692-9cc4-3fce0ea054aa req-aa88f574-3906-4ab8-9625-e36b2ac5d14a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:14.717687 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-63b677d9-fb6f-475e-b425-53a78e65422e tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:14.724979 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-ec2b2aec-fedb-4692-9cc4-3fce0ea054aa req-aa88f574-3906-4ab8-9625-e36b2ac5d14a service nova] Creating event network-vif-deleted:1de44453-13e8-4a14-8524-32dced7611b9 for instance 32c2282f-8127-41a3-b616-ba0d58394128 on chh2-master-2 Jun 10 18:34:14.726105 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-63b677d9-fb6f-475e-b425-53a78e65422e tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa" status: 200 len: 1545 microversion: 2.1 time: 0.330138 Jun 10 18:34:14.727273 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3301/6563] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:14 2022] GET /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa => generated 1545 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:34:14.731945 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-ec2b2aec-fedb-4692-9cc4-3fce0ea054aa req-aa88f574-3906-4ab8-9625-e36b2ac5d14a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194288 Jun 10 18:34:14.737661 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3263/6564] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:34:14.746808 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ad19ba0c-081c-4842-ba4d-4db60aade213 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:14.747758 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ad19ba0c-081c-4842-ba4d-4db60aade213 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 12d8e153-a080-4789-825b-af419b843eaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:14.755154 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ad19ba0c-081c-4842-ba4d-4db60aade213 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:14.756331 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ad19ba0c-081c-4842-ba4d-4db60aade213 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:14.757365 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ad19ba0c-081c-4842-ba4d-4db60aade213 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:14.757963 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ad19ba0c-081c-4842-ba4d-4db60aade213 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:14.988889 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0cb05633-03b6-4f46-aaeb-c80a3b380af3 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:14.989045 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ad19ba0c-081c-4842-ba4d-4db60aade213 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:14.989463 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0cb05633-03b6-4f46-aaeb-c80a3b380af3 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] [instance: 32c2282f-8127-41a3-b616-ba0d58394128] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:15.003385 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0cb05633-03b6-4f46-aaeb-c80a3b380af3 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:15.007668 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0cb05633-03b6-4f46-aaeb-c80a3b380af3 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:15.007668 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0cb05633-03b6-4f46-aaeb-c80a3b380af3 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:15.007668 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0cb05633-03b6-4f46-aaeb-c80a3b380af3 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:15.008027 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ad19ba0c-081c-4842-ba4d-4db60aade213 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa" status: 200 len: 1545 microversion: 2.1 time: 0.265473 Jun 10 18:34:15.008027 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3302/6565] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:14 2022] GET /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa => generated 1545 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:34:15.092914 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0cb05633-03b6-4f46-aaeb-c80a3b380af3 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:15.096375 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0cb05633-03b6-4f46-aaeb-c80a3b380af3 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:15.097864 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-0cb05633-03b6-4f46-aaeb-c80a3b380af3 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lazy-loading 'fault' on Instance uuid 32c2282f-8127-41a3-b616-ba0d58394128 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:34:15.144225 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0cb05633-03b6-4f46-aaeb-c80a3b380af3 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa5b7f650884ee59282ce97f48fc0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a8d819ba8844878f82cf60131df725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:15.152702 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0cb05633-03b6-4f46-aaeb-c80a3b380af3 tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] 10.222.0.35 "GET /compute/v2.1/servers/32c2282f-8127-41a3-b616-ba0d58394128" status: 200 len: 1308 microversion: 2.1 time: 0.170368 Jun 10 18:34:15.153714 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3264/6566] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:14 2022] GET /compute/v2.1/servers/32c2282f-8127-41a3-b616-ba0d58394128 => generated 1308 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:34:15.876653 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f5d2fcd3-991d-499d-8c66-3bbd4df66ff1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c379a26-c95c-4fca-8f28-42867438d30d"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:34:15.878019 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f5d2fcd3-991d-499d-8c66-3bbd4df66ff1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: cf4aaf4f-5855-4034-a1a5-2bfb200ad546] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:15.884753 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f5d2fcd3-991d-499d-8c66-3bbd4df66ff1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:15.885215 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f5d2fcd3-991d-499d-8c66-3bbd4df66ff1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:15.886637 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f5d2fcd3-991d-499d-8c66-3bbd4df66ff1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:15.887246 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f5d2fcd3-991d-499d-8c66-3bbd4df66ff1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:16.170114 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-63b53f53-fae6-4164-85b8-ff3ee95f27af tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:16.170668 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-63b53f53-fae6-4164-85b8-ff3ee95f27af tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] [instance: 32c2282f-8127-41a3-b616-ba0d58394128] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:16.177607 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-63b53f53-fae6-4164-85b8-ff3ee95f27af tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:16.178055 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-63b53f53-fae6-4164-85b8-ff3ee95f27af tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:16.178814 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-63b53f53-fae6-4164-85b8-ff3ee95f27af tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:16.179251 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-63b53f53-fae6-4164-85b8-ff3ee95f27af tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:16.196710 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-63b53f53-fae6-4164-85b8-ff3ee95f27af tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] HTTP exception thrown: Instance 32c2282f-8127-41a3-b616-ba0d58394128 could not be found. Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-63b53f53-fae6-4164-85b8-ff3ee95f27af tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Request method failure captured: Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/32c2282f-8127-41a3-b616-ba0d58394128 HTTP/1.1 Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio41voBxnKdNcSWTzGKCKYykR4YCFkTyTrttx4im2hhdoOcOiK2xpD8zkcWcGqujci7pVnN_hpJfZazDA7m_nLDjNYXGHhrLnqzVQNOTzN0CyHDACUDEmHWg9sjhH0WH26ASUDXdfgHHPYNBldh2NDXiQ8Zsq62cFCHzdfiqdRCvx1QM Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: e2a8d819ba8844878f82cf60131df725 Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1780545508 Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/e2a8d819ba8844878f82cf60131df725"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/e2a8d819ba8844878f82cf60131df725"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/e2a8d819ba8844878f82cf60131df725"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_e2a8d819ba8844878f82cf60131df725", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-VolumesSnapshotTestJSON-1780545508 Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: e2a8d819ba8844878f82cf60131df725 Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1780545508 Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-VolumesSnapshotTestJSON-1780545508-project Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 3aa5b7f650884ee59282ce97f48fc0e6 Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-VolumesSnapshotTestJSON-1780545508-project Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 32c2282f-8127-41a3-b616-ba0d58394128 could not be found. Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '32c2282f-8127-41a3-b616-ba0d58394128'} Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32c2282f-8127-41a3-b616-ba0d58394128 could not be found. Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32c2282f-8127-41a3-b616-ba0d58394128 could not be found. Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:34:16.198434 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:34:16.202827 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:34:16.202827 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:34:16.202827 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:34:16.202827 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:34:16.202827 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:34:16.202827 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32c2282f-8127-41a3-b616-ba0d58394128 could not be found. Jun 10 18:34:16.202827 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:34:16.202827 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-63b53f53-fae6-4164-85b8-ff3ee95f27af tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] Returning 404 to user: Instance 32c2282f-8127-41a3-b616-ba0d58394128 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:34:16.202827 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-63b53f53-fae6-4164-85b8-ff3ee95f27af tempest-VolumesSnapshotTestJSON-1780545508 tempest-VolumesSnapshotTestJSON-1780545508-project] 10.222.0.35 "GET /compute/v2.1/servers/32c2282f-8127-41a3-b616-ba0d58394128" status: 404 len: 111 microversion: 2.1 time: 0.034342 Jun 10 18:34:16.202827 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3265/6567] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:16 2022] GET /compute/v2.1/servers/32c2282f-8127-41a3-b616-ba0d58394128 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:34:16.818599 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f5d2fcd3-991d-499d-8c66-3bbd4df66ff1 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "POST /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.945995 Jun 10 18:34:16.819425 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3303/6568] 10.222.0.35 () {60 vars in 1322 bytes} [Fri Jun 10 18:34:15 2022] POST /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546/os-volume_attachments => generated 194 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:34:17.324760 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-7122aa03-9f12-4365-b6d3-809e486dc190 req-1d890558-5ab3-4b4f-9d13-3c6743e6470a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12d8e153-a080-4789-825b-af419b843eaa", "tag": "fd8260c0-0773-4984-af80-4901ce0e7b3a"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:34:17.330344 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:34:17.345249 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-7122aa03-9f12-4365-b6d3-809e486dc190 req-1d890558-5ab3-4b4f-9d13-3c6743e6470a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:17.345249 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-7122aa03-9f12-4365-b6d3-809e486dc190 req-1d890558-5ab3-4b4f-9d13-3c6743e6470a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:17.363462 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-7122aa03-9f12-4365-b6d3-809e486dc190 req-1d890558-5ab3-4b4f-9d13-3c6743e6470a service nova] Creating event network-changed:fd8260c0-0773-4984-af80-4901ce0e7b3a for instance 12d8e153-a080-4789-825b-af419b843eaa on chh2-master-2 Jun 10 18:34:17.369225 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-7122aa03-9f12-4365-b6d3-809e486dc190 req-1d890558-5ab3-4b4f-9d13-3c6743e6470a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052679 Jun 10 18:34:17.374689 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3266/6569] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:34:26.188138 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=11 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:34:26.193138 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-03e0dc30-2e71-494a-856d-1c468596a231 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:34:26.194355 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-03e0dc30-2e71-494a-856d-1c468596a231 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:26.201261 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-03e0dc30-2e71-494a-856d-1c468596a231 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:26.201663 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-03e0dc30-2e71-494a-856d-1c468596a231 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:26.202432 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-03e0dc30-2e71-494a-856d-1c468596a231 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:26.202878 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-03e0dc30-2e71-494a-856d-1c468596a231 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:26.255308 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-03e0dc30-2e71-494a-856d-1c468596a231 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "POST /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e/action" status: 200 len: 24575 microversion: 2.1 time: 0.068874 Jun 10 18:34:26.256166 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3304/6570] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:34:26 2022] POST /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e/action => generated 24575 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:34:30.182729 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-31c29ed9-97db-4ddc-8614-ad187364c5e4 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:30.183896 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-31c29ed9-97db-4ddc-8614-ad187364c5e4 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: cf4aaf4f-5855-4034-a1a5-2bfb200ad546] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:30.187091 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=36 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:34:30.195994 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-31c29ed9-97db-4ddc-8614-ad187364c5e4 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:30.195994 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-31c29ed9-97db-4ddc-8614-ad187364c5e4 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:30.195994 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-31c29ed9-97db-4ddc-8614-ad187364c5e4 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:30.195994 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-31c29ed9-97db-4ddc-8614-ad187364c5e4 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:30.227028 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-31c29ed9-97db-4ddc-8614-ad187364c5e4 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048800 Jun 10 18:34:30.227599 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3267/6571] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:34:30 2022] GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:34:30.371557 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-43e987bd-56b4-4608-99e7-9b88d0710fed tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:30.373684 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-43e987bd-56b4-4608-99e7-9b88d0710fed tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: cf4aaf4f-5855-4034-a1a5-2bfb200ad546] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:30.380721 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-43e987bd-56b4-4608-99e7-9b88d0710fed tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:30.381100 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-43e987bd-56b4-4608-99e7-9b88d0710fed tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:30.381904 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-43e987bd-56b4-4608-99e7-9b88d0710fed tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:30.382336 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-43e987bd-56b4-4608-99e7-9b88d0710fed tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:30.417276 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-43e987bd-56b4-4608-99e7-9b88d0710fed tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546/os-volume_attachments/0a5c4431-651e-4be2-8e5a-f1558fbffca1" status: 200 len: 194 microversion: 2.1 time: 0.053224 Jun 10 18:34:30.418108 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3305/6572] 10.222.0.35 () {58 vars in 1412 bytes} [Fri Jun 10 18:34:30 2022] GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546/os-volume_attachments/0a5c4431-651e-4be2-8e5a-f1558fbffca1 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:34:30.428142 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-aefd9d3b-cc67-4dbc-b748-d302fe5b5989 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:30.429018 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-aefd9d3b-cc67-4dbc-b748-d302fe5b5989 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: cf4aaf4f-5855-4034-a1a5-2bfb200ad546] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:30.436357 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aefd9d3b-cc67-4dbc-b748-d302fe5b5989 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:30.436829 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aefd9d3b-cc67-4dbc-b748-d302fe5b5989 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:30.437787 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aefd9d3b-cc67-4dbc-b748-d302fe5b5989 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:30.438381 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aefd9d3b-cc67-4dbc-b748-d302fe5b5989 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:30.535760 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-aefd9d3b-cc67-4dbc-b748-d302fe5b5989 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lazy-loading 'services' on Instance uuid cf4aaf4f-5855-4034-a1a5-2bfb200ad546 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:34:30.871631 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-aefd9d3b-cc67-4dbc-b748-d302fe5b5989 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "DELETE /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546/os-volume_attachments/0a5c4431-651e-4be2-8e5a-f1558fbffca1" status: 202 len: 0 microversion: 2.1 time: 0.447437 Jun 10 18:34:30.872142 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3268/6573] 10.222.0.35 () {58 vars in 1415 bytes} [Fri Jun 10 18:34:30 2022] DELETE /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546/os-volume_attachments/0a5c4431-651e-4be2-8e5a-f1558fbffca1 => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:34:36.331120 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-15c58564-0247-4d7d-99e2-b2abe9467812 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:36.332175 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-15c58564-0247-4d7d-99e2-b2abe9467812 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: cf4aaf4f-5855-4034-a1a5-2bfb200ad546] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:36.339935 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-15c58564-0247-4d7d-99e2-b2abe9467812 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:36.340628 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-15c58564-0247-4d7d-99e2-b2abe9467812 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:36.341724 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-15c58564-0247-4d7d-99e2-b2abe9467812 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:36.342296 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-15c58564-0247-4d7d-99e2-b2abe9467812 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:36.376129 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-15c58564-0247-4d7d-99e2-b2abe9467812 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546/os-volume_attachments/2c379a26-c95c-4fca-8f28-42867438d30d" status: 200 len: 194 microversion: 2.1 time: 0.049226 Jun 10 18:34:36.380511 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3306/6574] 10.222.0.35 () {58 vars in 1412 bytes} [Fri Jun 10 18:34:36 2022] GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546/os-volume_attachments/2c379a26-c95c-4fca-8f28-42867438d30d => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:34:36.392336 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-79871112-1918-4416-bbdb-587c324785a2 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:36.393626 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-79871112-1918-4416-bbdb-587c324785a2 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: cf4aaf4f-5855-4034-a1a5-2bfb200ad546] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:36.401841 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-79871112-1918-4416-bbdb-587c324785a2 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:36.402546 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-79871112-1918-4416-bbdb-587c324785a2 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:36.412935 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-79871112-1918-4416-bbdb-587c324785a2 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:36.412935 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-79871112-1918-4416-bbdb-587c324785a2 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:36.529702 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-79871112-1918-4416-bbdb-587c324785a2 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lazy-loading 'services' on Instance uuid cf4aaf4f-5855-4034-a1a5-2bfb200ad546 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:34:36.773978 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-79871112-1918-4416-bbdb-587c324785a2 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "DELETE /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546/os-volume_attachments/2c379a26-c95c-4fca-8f28-42867438d30d" status: 202 len: 0 microversion: 2.1 time: 0.390908 Jun 10 18:34:36.774475 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3269/6575] 10.222.0.35 () {58 vars in 1415 bytes} [Fri Jun 10 18:34:36 2022] DELETE /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546/os-volume_attachments/2c379a26-c95c-4fca-8f28-42867438d30d => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:34:37.418015 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-52bdd5ed-0979-4037-9850-02dd290e6fea tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:37.419324 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-52bdd5ed-0979-4037-9850-02dd290e6fea tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:37.429372 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-52bdd5ed-0979-4037-9850-02dd290e6fea tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:37.435360 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-52bdd5ed-0979-4037-9850-02dd290e6fea tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:37.435360 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-52bdd5ed-0979-4037-9850-02dd290e6fea tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:37.435360 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-52bdd5ed-0979-4037-9850-02dd290e6fea tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:37.573198 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-52bdd5ed-0979-4037-9850-02dd290e6fea tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1834 microversion: 2.1 time: 0.158984 Jun 10 18:34:37.579614 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3307/6576] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:37 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1834 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:34:37.610072 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-331b1a90-ae17-4cb2-a2ae-04671eadc629 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:37.610072 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-331b1a90-ae17-4cb2-a2ae-04671eadc629 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:37.610072 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-331b1a90-ae17-4cb2-a2ae-04671eadc629 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:37.610072 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-331b1a90-ae17-4cb2-a2ae-04671eadc629 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:37.610072 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-331b1a90-ae17-4cb2-a2ae-04671eadc629 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:37.611441 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-331b1a90-ae17-4cb2-a2ae-04671eadc629 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:37.784475 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-331b1a90-ae17-4cb2-a2ae-04671eadc629 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:37.792681 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-331b1a90-ae17-4cb2-a2ae-04671eadc629 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1683 microversion: 2.1 time: 0.206374 Jun 10 18:34:37.797140 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3270/6577] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:37 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1683 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:34:37.909269 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5c544b5b-580a-46b8-8f34-a0335d95c534 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:34:37.910792 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5c544b5b-580a-46b8-8f34-a0335d95c534 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:37.917640 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5c544b5b-580a-46b8-8f34-a0335d95c534 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:37.918474 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5c544b5b-580a-46b8-8f34-a0335d95c534 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:37.918993 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5c544b5b-580a-46b8-8f34-a0335d95c534 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:37.919588 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5c544b5b-580a-46b8-8f34-a0335d95c534 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:37.980971 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5c544b5b-580a-46b8-8f34-a0335d95c534 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "POST /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e/action" status: 200 len: 32647 microversion: 2.1 time: 0.073726 Jun 10 18:34:37.994064 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3308/6578] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:34:37 2022] POST /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e/action => generated 32647 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:34:38.168760 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2f0b47f4-72e0-430c-b0d8-47a1b554bb8e tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:34:38.169717 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2f0b47f4-72e0-430c-b0d8-47a1b554bb8e tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:38.176858 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2f0b47f4-72e0-430c-b0d8-47a1b554bb8e tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:38.177674 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2f0b47f4-72e0-430c-b0d8-47a1b554bb8e tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:38.178265 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2f0b47f4-72e0-430c-b0d8-47a1b554bb8e tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:38.178863 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2f0b47f4-72e0-430c-b0d8-47a1b554bb8e tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:38.208784 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2f0b47f4-72e0-430c-b0d8-47a1b554bb8e tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4af44487b0794569b85591fcd6300bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71021080cdf64cc8a8c1c14900654b74', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:38.209556 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2f0b47f4-72e0-430c-b0d8-47a1b554bb8e tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] flavor_id is None. Assuming migration. {{(pid=126595) resize /opt/stack/nova/nova/compute/api.py:4142}} Jun 10 18:34:38.210068 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2f0b47f4-72e0-430c-b0d8-47a1b554bb8e tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=126595) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 10 18:34:38.494685 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2f0b47f4-72e0-430c-b0d8-47a1b554bb8e tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] 10.222.0.35 "POST /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e/action" status: 202 len: 0 microversion: 2.1 time: 0.331140 Jun 10 18:34:38.495836 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3271/6579] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:34:38 2022] POST /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:34:38.504677 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f86e415a-d800-4a84-a3c9-57f063c8d2c7 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:38.505950 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f86e415a-d800-4a84-a3c9-57f063c8d2c7 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:38.514330 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f86e415a-d800-4a84-a3c9-57f063c8d2c7 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:38.514955 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f86e415a-d800-4a84-a3c9-57f063c8d2c7 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:38.515880 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f86e415a-d800-4a84-a3c9-57f063c8d2c7 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:38.516499 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f86e415a-d800-4a84-a3c9-57f063c8d2c7 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:38.667372 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f86e415a-d800-4a84-a3c9-57f063c8d2c7 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:38.676586 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f86e415a-d800-4a84-a3c9-57f063c8d2c7 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1692 microversion: 2.1 time: 0.176005 Jun 10 18:34:38.677393 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3309/6580] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:38 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1692 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:34:39.696031 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cbb00d46-fadf-4484-926c-e7a1ffdfa642 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:39.697282 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cbb00d46-fadf-4484-926c-e7a1ffdfa642 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:39.706967 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cbb00d46-fadf-4484-926c-e7a1ffdfa642 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:39.707766 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cbb00d46-fadf-4484-926c-e7a1ffdfa642 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:39.708837 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cbb00d46-fadf-4484-926c-e7a1ffdfa642 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:39.709491 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cbb00d46-fadf-4484-926c-e7a1ffdfa642 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:39.951842 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cbb00d46-fadf-4484-926c-e7a1ffdfa642 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:39.975134 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cbb00d46-fadf-4484-926c-e7a1ffdfa642 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1692 microversion: 2.1 time: 0.282746 Jun 10 18:34:39.976026 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3272/6581] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:39 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1692 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:34:40.992538 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f5ab8546-ef49-4061-a8a0-ce1d9ab39635 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:40.993149 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f5ab8546-ef49-4061-a8a0-ce1d9ab39635 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:41.036297 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f5ab8546-ef49-4061-a8a0-ce1d9ab39635 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:41.036787 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f5ab8546-ef49-4061-a8a0-ce1d9ab39635 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:41.037758 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f5ab8546-ef49-4061-a8a0-ce1d9ab39635 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:41.038352 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f5ab8546-ef49-4061-a8a0-ce1d9ab39635 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:41.280702 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f5ab8546-ef49-4061-a8a0-ce1d9ab39635 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:41.290803 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f5ab8546-ef49-4061-a8a0-ce1d9ab39635 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1692 microversion: 2.1 time: 0.302149 Jun 10 18:34:41.306042 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3310/6582] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:40 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1692 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:34:42.308936 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e224cbac-916d-4319-bcb2-b64cb1547c22 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:42.314127 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e224cbac-916d-4319-bcb2-b64cb1547c22 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:42.365904 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e224cbac-916d-4319-bcb2-b64cb1547c22 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:42.371546 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e224cbac-916d-4319-bcb2-b64cb1547c22 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:42.377002 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e224cbac-916d-4319-bcb2-b64cb1547c22 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:42.378474 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e224cbac-916d-4319-bcb2-b64cb1547c22 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:42.763617 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e224cbac-916d-4319-bcb2-b64cb1547c22 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:42.783134 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e224cbac-916d-4319-bcb2-b64cb1547c22 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1692 microversion: 2.1 time: 0.473539 Jun 10 18:34:42.783134 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3273/6583] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:42 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1692 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:34:43.539853 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ef8bc3ab-3e3e-4416-b54d-4453b9217c82 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:43.541191 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ef8bc3ab-3e3e-4416-b54d-4453b9217c82 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: cf4aaf4f-5855-4034-a1a5-2bfb200ad546] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:43.564493 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ef8bc3ab-3e3e-4416-b54d-4453b9217c82 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:43.565056 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ef8bc3ab-3e3e-4416-b54d-4453b9217c82 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:43.565929 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ef8bc3ab-3e3e-4416-b54d-4453b9217c82 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:43.566469 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ef8bc3ab-3e3e-4416-b54d-4453b9217c82 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:43.571079 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:34:43.599655 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ef8bc3ab-3e3e-4416-b54d-4453b9217c82 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065776 Jun 10 18:34:43.600382 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3311/6584] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:34:43 2022] GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:34:43.711696 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-417044b6-8f2a-415c-9e13-63b6e8d3479c tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:43.711696 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-417044b6-8f2a-415c-9e13-63b6e8d3479c tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: cf4aaf4f-5855-4034-a1a5-2bfb200ad546] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:43.717095 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-417044b6-8f2a-415c-9e13-63b6e8d3479c tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:43.717561 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-417044b6-8f2a-415c-9e13-63b6e8d3479c tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:43.718335 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-417044b6-8f2a-415c-9e13-63b6e8d3479c tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:43.718944 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-417044b6-8f2a-415c-9e13-63b6e8d3479c tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:43.759458 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-417044b6-8f2a-415c-9e13-63b6e8d3479c tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055316 Jun 10 18:34:43.760060 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3274/6585] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 18:34:43 2022] GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 10 18:34:43.797698 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-91aa466d-4698-4ade-a718-4c60f00287e1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:43.798576 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-91aa466d-4698-4ade-a718-4c60f00287e1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:43.808004 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-91aa466d-4698-4ade-a718-4c60f00287e1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:43.808860 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-91aa466d-4698-4ade-a718-4c60f00287e1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:43.810451 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-91aa466d-4698-4ade-a718-4c60f00287e1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:43.811062 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-91aa466d-4698-4ade-a718-4c60f00287e1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:43.845014 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b0e7e67d-8dc0-4136-b2dc-36b89ce75743 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:43.845513 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b0e7e67d-8dc0-4136-b2dc-36b89ce75743 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: cf4aaf4f-5855-4034-a1a5-2bfb200ad546] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:43.853489 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b0e7e67d-8dc0-4136-b2dc-36b89ce75743 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:43.854179 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b0e7e67d-8dc0-4136-b2dc-36b89ce75743 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:43.855124 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b0e7e67d-8dc0-4136-b2dc-36b89ce75743 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:43.855716 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b0e7e67d-8dc0-4136-b2dc-36b89ce75743 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:43.884639 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b0e7e67d-8dc0-4136-b2dc-36b89ce75743 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: cf4aaf4f-5855-4034-a1a5-2bfb200ad546] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:34:43.983538 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-91aa466d-4698-4ade-a718-4c60f00287e1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:43.993252 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-91aa466d-4698-4ade-a718-4c60f00287e1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1697 microversion: 2.1 time: 0.200630 Jun 10 18:34:43.994408 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3312/6586] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:43 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1697 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:34:44.306791 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b0e7e67d-8dc0-4136-b2dc-36b89ce75743 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "DELETE /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546" status: 204 len: 0 microversion: 2.1 time: 0.465431 Jun 10 18:34:44.307392 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3275/6587] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:34:43 2022] DELETE /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:34:44.316539 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9fcb7a56-d9bf-4baf-8a86-3c1c074221d3 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:44.317379 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9fcb7a56-d9bf-4baf-8a86-3c1c074221d3 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: cf4aaf4f-5855-4034-a1a5-2bfb200ad546] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:44.325962 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9fcb7a56-d9bf-4baf-8a86-3c1c074221d3 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:44.326567 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9fcb7a56-d9bf-4baf-8a86-3c1c074221d3 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:44.327484 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9fcb7a56-d9bf-4baf-8a86-3c1c074221d3 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:44.327996 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9fcb7a56-d9bf-4baf-8a86-3c1c074221d3 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:44.478573 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9fcb7a56-d9bf-4baf-8a86-3c1c074221d3 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:44.491994 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9fcb7a56-d9bf-4baf-8a86-3c1c074221d3 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546" status: 200 len: 1673 microversion: 2.1 time: 0.180099 Jun 10 18:34:44.494033 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3313/6588] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:44 2022] GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546 => generated 1673 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:34:45.011629 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b146ff58-df41-4abe-b0b0-5a47834c4861 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:45.019735 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b146ff58-df41-4abe-b0b0-5a47834c4861 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:45.020134 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b146ff58-df41-4abe-b0b0-5a47834c4861 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:45.020611 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b146ff58-df41-4abe-b0b0-5a47834c4861 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:45.021535 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b146ff58-df41-4abe-b0b0-5a47834c4861 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:45.021976 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b146ff58-df41-4abe-b0b0-5a47834c4861 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:45.220704 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b146ff58-df41-4abe-b0b0-5a47834c4861 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:45.229315 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b146ff58-df41-4abe-b0b0-5a47834c4861 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1697 microversion: 2.1 time: 0.221920 Jun 10 18:34:45.232360 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3276/6589] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:45 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1697 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:34:45.510978 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-452ac908-abc8-4da3-aed4-62ab84f27b92 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:45.511595 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-452ac908-abc8-4da3-aed4-62ab84f27b92 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: cf4aaf4f-5855-4034-a1a5-2bfb200ad546] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:45.518730 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-452ac908-abc8-4da3-aed4-62ab84f27b92 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:45.519506 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-452ac908-abc8-4da3-aed4-62ab84f27b92 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:45.519966 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-452ac908-abc8-4da3-aed4-62ab84f27b92 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:45.520444 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-452ac908-abc8-4da3-aed4-62ab84f27b92 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:45.682705 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-452ac908-abc8-4da3-aed4-62ab84f27b92 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:45.693139 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-452ac908-abc8-4da3-aed4-62ab84f27b92 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546" status: 200 len: 1673 microversion: 2.1 time: 0.185938 Jun 10 18:34:45.694416 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3314/6590] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:45 2022] GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546 => generated 1673 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:34:46.247950 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3726be99-d9a3-4a69-97ba-70df11ce65f4 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:46.249120 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3726be99-d9a3-4a69-97ba-70df11ce65f4 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:46.262937 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3726be99-d9a3-4a69-97ba-70df11ce65f4 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:46.263791 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3726be99-d9a3-4a69-97ba-70df11ce65f4 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:46.267705 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3726be99-d9a3-4a69-97ba-70df11ce65f4 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:46.268419 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3726be99-d9a3-4a69-97ba-70df11ce65f4 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:46.599037 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3726be99-d9a3-4a69-97ba-70df11ce65f4 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:46.612869 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3726be99-d9a3-4a69-97ba-70df11ce65f4 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1697 microversion: 2.1 time: 0.367945 Jun 10 18:34:46.625745 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3277/6591] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:46 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1697 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:34:46.716416 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-27698059-9bd0-47e4-8ebf-80501ed96ccf tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:46.717647 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-27698059-9bd0-47e4-8ebf-80501ed96ccf tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: cf4aaf4f-5855-4034-a1a5-2bfb200ad546] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:46.724544 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27698059-9bd0-47e4-8ebf-80501ed96ccf tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:46.725174 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27698059-9bd0-47e4-8ebf-80501ed96ccf tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:46.726114 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27698059-9bd0-47e4-8ebf-80501ed96ccf tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:46.726713 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27698059-9bd0-47e4-8ebf-80501ed96ccf tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:46.938497 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-27698059-9bd0-47e4-8ebf-80501ed96ccf tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:46.951254 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-27698059-9bd0-47e4-8ebf-80501ed96ccf tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546" status: 200 len: 1673 microversion: 2.1 time: 0.240465 Jun 10 18:34:46.951254 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3315/6592] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:46 2022] GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546 => generated 1673 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:34:47.221055 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-cf9dee6b-c7bf-4f1a-99d0-eebc537b4642 req-9e208e35-bd70-4658-9f46-9993080822a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf4aaf4f-5855-4034-a1a5-2bfb200ad546", "name": "network-vif-deleted", "tag": "d943c54d-812b-4474-a394-0b5123af99b3"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:34:47.230743 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-cf9dee6b-c7bf-4f1a-99d0-eebc537b4642 req-9e208e35-bd70-4658-9f46-9993080822a0 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:47.240950 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-cf9dee6b-c7bf-4f1a-99d0-eebc537b4642 req-9e208e35-bd70-4658-9f46-9993080822a0 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:47.255015 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-cf9dee6b-c7bf-4f1a-99d0-eebc537b4642 req-9e208e35-bd70-4658-9f46-9993080822a0 service nova] Creating event network-vif-deleted:d943c54d-812b-4474-a394-0b5123af99b3 for instance cf4aaf4f-5855-4034-a1a5-2bfb200ad546 on chh1-master-2 Jun 10 18:34:47.260789 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-cf9dee6b-c7bf-4f1a-99d0-eebc537b4642 req-9e208e35-bd70-4658-9f46-9993080822a0 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043535 Jun 10 18:34:47.261917 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3278/6593] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:34:47.630065 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bb680c7c-dc59-4112-a648-c2ca19d85ecc tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:47.630687 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bb680c7c-dc59-4112-a648-c2ca19d85ecc tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:47.648028 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bb680c7c-dc59-4112-a648-c2ca19d85ecc tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:47.648515 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bb680c7c-dc59-4112-a648-c2ca19d85ecc tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:47.649312 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bb680c7c-dc59-4112-a648-c2ca19d85ecc tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:47.649761 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bb680c7c-dc59-4112-a648-c2ca19d85ecc tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:47.785490 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e775b56a-ad67-4ef6-8ec9-b4ad156609dc tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:34:47.786558 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e775b56a-ad67-4ef6-8ec9-b4ad156609dc tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 12d8e153-a080-4789-825b-af419b843eaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:47.795206 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e775b56a-ad67-4ef6-8ec9-b4ad156609dc tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:47.795664 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e775b56a-ad67-4ef6-8ec9-b4ad156609dc tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:47.811426 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e775b56a-ad67-4ef6-8ec9-b4ad156609dc tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:47.812252 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e775b56a-ad67-4ef6-8ec9-b4ad156609dc tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:47.836221 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:34:47.884430 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e775b56a-ad67-4ef6-8ec9-b4ad156609dc tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "POST /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa/action" status: 200 len: 24571 microversion: 2.1 time: 0.103180 Jun 10 18:34:47.886296 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3279/6594] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:34:47 2022] POST /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa/action => generated 24571 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 10 18:34:47.920628 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bb680c7c-dc59-4112-a648-c2ca19d85ecc tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:47.955738 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bb680c7c-dc59-4112-a648-c2ca19d85ecc tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1697 microversion: 2.1 time: 0.317377 Jun 10 18:34:47.966288 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-782153a2-573b-4a6e-a6c7-e02356c0b883 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:47.966519 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3316/6595] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:47 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1697 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:34:47.967081 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-782153a2-573b-4a6e-a6c7-e02356c0b883 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: cf4aaf4f-5855-4034-a1a5-2bfb200ad546] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:47.991519 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-782153a2-573b-4a6e-a6c7-e02356c0b883 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:47.991991 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-782153a2-573b-4a6e-a6c7-e02356c0b883 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:47.992804 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-782153a2-573b-4a6e-a6c7-e02356c0b883 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:47.993283 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-782153a2-573b-4a6e-a6c7-e02356c0b883 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:48.086912 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-782153a2-573b-4a6e-a6c7-e02356c0b883 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:48.087016 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-782153a2-573b-4a6e-a6c7-e02356c0b883 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:48.087462 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-782153a2-573b-4a6e-a6c7-e02356c0b883 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lazy-loading 'fault' on Instance uuid cf4aaf4f-5855-4034-a1a5-2bfb200ad546 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:34:48.159545 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-782153a2-573b-4a6e-a6c7-e02356c0b883 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe74aba3932c467e8124a888867d2112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be5a72204b8483590ce13d50170b117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:48.167520 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-782153a2-573b-4a6e-a6c7-e02356c0b883 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546" status: 200 len: 1328 microversion: 2.1 time: 0.205899 Jun 10 18:34:48.172290 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3280/6596] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:47 2022] GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546 => generated 1328 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:34:48.973076 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7af063eb-4f50-42cf-bf6a-7f8395381aaa tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:48.973699 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7af063eb-4f50-42cf-bf6a-7f8395381aaa tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:48.980764 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7af063eb-4f50-42cf-bf6a-7f8395381aaa tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:48.981774 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7af063eb-4f50-42cf-bf6a-7f8395381aaa tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:48.982553 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7af063eb-4f50-42cf-bf6a-7f8395381aaa tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:48.983003 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7af063eb-4f50-42cf-bf6a-7f8395381aaa tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:49.131889 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7af063eb-4f50-42cf-bf6a-7f8395381aaa tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:49.153169 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7af063eb-4f50-42cf-bf6a-7f8395381aaa tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1697 microversion: 2.1 time: 0.183968 Jun 10 18:34:49.163834 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3317/6597] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:48 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1697 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:34:49.186440 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0aee23e1-6b46-46d1-a4e1-3f5a0a21e44b tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:49.187054 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0aee23e1-6b46-46d1-a4e1-3f5a0a21e44b tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: cf4aaf4f-5855-4034-a1a5-2bfb200ad546] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:49.196342 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0aee23e1-6b46-46d1-a4e1-3f5a0a21e44b tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:49.196805 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0aee23e1-6b46-46d1-a4e1-3f5a0a21e44b tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:49.197588 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0aee23e1-6b46-46d1-a4e1-3f5a0a21e44b tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:49.198040 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0aee23e1-6b46-46d1-a4e1-3f5a0a21e44b tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:49.222379 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-0aee23e1-6b46-46d1-a4e1-3f5a0a21e44b tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] HTTP exception thrown: Instance cf4aaf4f-5855-4034-a1a5-2bfb200ad546 could not be found. Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0aee23e1-6b46-46d1-a4e1-3f5a0a21e44b tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Request method failure captured: Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546 HTTP/1.1 Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio40ltn_2ByFbzyzAVu0QcFPuZdhey6Y1RzaanyIXWFbMA3jX27kd5QdQTkjdaPpNC3eHF8vjMWTW53ROHXMgqhb7cmKVmMJ0JxmAIwklDSmJ4lKTSAAeEDlgNHI_IPAeB-zYoB4LI3xPkB9jsdNHxjRbctCV4bBXBp--Rsr4WX1UBVQ Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 1be5a72204b8483590ce13d50170b117 Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-AttachVolumeTestJSON-1437428834 Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1be5a72204b8483590ce13d50170b117"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1be5a72204b8483590ce13d50170b117"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1be5a72204b8483590ce13d50170b117"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1be5a72204b8483590ce13d50170b117", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-AttachVolumeTestJSON-1437428834 Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 1be5a72204b8483590ce13d50170b117 Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1437428834 Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-AttachVolumeTestJSON-1437428834-project Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: fe74aba3932c467e8124a888867d2112 Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-AttachVolumeTestJSON-1437428834-project Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: exception: Instance cf4aaf4f-5855-4034-a1a5-2bfb200ad546 could not be found. Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'cf4aaf4f-5855-4034-a1a5-2bfb200ad546'} Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf4aaf4f-5855-4034-a1a5-2bfb200ad546 could not be found. Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf4aaf4f-5855-4034-a1a5-2bfb200ad546 could not be found. Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:34:49.224221 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:34:49.228184 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:34:49.228184 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:34:49.228184 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:34:49.228184 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:34:49.228184 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:34:49.228184 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf4aaf4f-5855-4034-a1a5-2bfb200ad546 could not be found. Jun 10 18:34:49.228184 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:34:49.228184 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0aee23e1-6b46-46d1-a4e1-3f5a0a21e44b tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Returning 404 to user: Instance cf4aaf4f-5855-4034-a1a5-2bfb200ad546 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:34:49.228184 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0aee23e1-6b46-46d1-a4e1-3f5a0a21e44b tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546" status: 404 len: 111 microversion: 2.1 time: 0.044474 Jun 10 18:34:49.228184 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3281/6598] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:49 2022] GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:34:49.236126 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f500d808-4b65-460d-aa68-bd3839dec4f8 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '.version_select at 0x7f77b3cbda60>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:49.355355 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f500d808-4b65-460d-aa68-bd3839dec4f8 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1450671754" status: 202 len: 0 microversion: 2.1 time: 0.124274 Jun 10 18:34:49.355977 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3318/6599] 10.222.0.35 () {58 vars in 1220 bytes} [Fri Jun 10 18:34:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1450671754 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:34:50.170874 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a2e4d207-95dc-47ea-9880-5baada768bf6 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:50.171425 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a2e4d207-95dc-47ea-9880-5baada768bf6 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:50.179306 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a2e4d207-95dc-47ea-9880-5baada768bf6 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:50.180005 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a2e4d207-95dc-47ea-9880-5baada768bf6 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:50.180959 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a2e4d207-95dc-47ea-9880-5baada768bf6 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:50.186263 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a2e4d207-95dc-47ea-9880-5baada768bf6 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:50.354403 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a2e4d207-95dc-47ea-9880-5baada768bf6 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:50.364538 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a2e4d207-95dc-47ea-9880-5baada768bf6 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1697 microversion: 2.1 time: 0.198095 Jun 10 18:34:50.374575 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3282/6600] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:50 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1697 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:34:51.383357 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-756e7e14-5b2c-43c6-a1d2-36fadb29e835 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:51.384260 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-756e7e14-5b2c-43c6-a1d2-36fadb29e835 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:51.405791 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-756e7e14-5b2c-43c6-a1d2-36fadb29e835 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:51.406253 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-756e7e14-5b2c-43c6-a1d2-36fadb29e835 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:51.407070 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-756e7e14-5b2c-43c6-a1d2-36fadb29e835 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:51.407506 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-756e7e14-5b2c-43c6-a1d2-36fadb29e835 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:51.644245 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-756e7e14-5b2c-43c6-a1d2-36fadb29e835 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:51.657220 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-756e7e14-5b2c-43c6-a1d2-36fadb29e835 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1697 microversion: 2.1 time: 0.276746 Jun 10 18:34:51.658584 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3319/6601] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:51 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1697 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:34:52.675159 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-77dd7f08-394a-46cb-b01d-cb35bf401d19 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:52.676413 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-77dd7f08-394a-46cb-b01d-cb35bf401d19 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:52.693725 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-77dd7f08-394a-46cb-b01d-cb35bf401d19 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:52.694179 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-77dd7f08-394a-46cb-b01d-cb35bf401d19 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:52.697306 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-77dd7f08-394a-46cb-b01d-cb35bf401d19 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:52.697306 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-77dd7f08-394a-46cb-b01d-cb35bf401d19 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:52.960017 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-77dd7f08-394a-46cb-b01d-cb35bf401d19 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:52.974679 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-77dd7f08-394a-46cb-b01d-cb35bf401d19 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1697 microversion: 2.1 time: 0.297215 Jun 10 18:34:52.985112 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3283/6602] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:52 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1697 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:34:53.993597 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-567efd07-63e7-438b-938a-d01194cee41d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:53.994761 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-567efd07-63e7-438b-938a-d01194cee41d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:54.001859 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-567efd07-63e7-438b-938a-d01194cee41d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:54.002496 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-567efd07-63e7-438b-938a-d01194cee41d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:54.003434 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-567efd07-63e7-438b-938a-d01194cee41d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:54.004022 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-567efd07-63e7-438b-938a-d01194cee41d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:54.143082 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-567efd07-63e7-438b-938a-d01194cee41d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:54.150912 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-567efd07-63e7-438b-938a-d01194cee41d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1697 microversion: 2.1 time: 0.162268 Jun 10 18:34:54.151766 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3320/6603] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:53 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:34:55.170675 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0b0aa745-afbd-4a39-aaec-82fafdd2d58e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:55.171324 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0b0aa745-afbd-4a39-aaec-82fafdd2d58e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:55.181051 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0b0aa745-afbd-4a39-aaec-82fafdd2d58e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:55.181994 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0b0aa745-afbd-4a39-aaec-82fafdd2d58e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:55.183331 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0b0aa745-afbd-4a39-aaec-82fafdd2d58e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:55.184669 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0b0aa745-afbd-4a39-aaec-82fafdd2d58e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:55.474886 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0b0aa745-afbd-4a39-aaec-82fafdd2d58e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:55.484524 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0b0aa745-afbd-4a39-aaec-82fafdd2d58e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1697 microversion: 2.1 time: 0.319753 Jun 10 18:34:55.485773 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3284/6604] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:55 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1697 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:34:56.503394 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-536cc53c-2b38-4652-93f1-7cb2d242e8c4 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:56.504685 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-536cc53c-2b38-4652-93f1-7cb2d242e8c4 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:56.517556 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-536cc53c-2b38-4652-93f1-7cb2d242e8c4 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:56.519073 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-536cc53c-2b38-4652-93f1-7cb2d242e8c4 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:56.521638 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-536cc53c-2b38-4652-93f1-7cb2d242e8c4 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:56.523337 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-536cc53c-2b38-4652-93f1-7cb2d242e8c4 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:56.684024 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-8a498a0f-8b7b-45fe-b735-9222fe0a84b7 req-9a9bcfe8-787f-4b07-bde0-891ef47ba8ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22d96fe9-d755-452b-95a0-b0ce772fb72e", "name": "network-vif-unplugged", "status": "completed", "tag": "ede2c1d8-e562-4758-9879-234ee389f99f"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:34:56.707988 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-8a498a0f-8b7b-45fe-b735-9222fe0a84b7 req-9a9bcfe8-787f-4b07-bde0-891ef47ba8ce service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:56.708598 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-8a498a0f-8b7b-45fe-b735-9222fe0a84b7 req-9a9bcfe8-787f-4b07-bde0-891ef47ba8ce service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:56.728244 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-8a498a0f-8b7b-45fe-b735-9222fe0a84b7 req-9a9bcfe8-787f-4b07-bde0-891ef47ba8ce service nova] Creating event network-vif-unplugged:ede2c1d8-e562-4758-9879-234ee389f99f for instance 22d96fe9-d755-452b-95a0-b0ce772fb72e on chh2-master-2 Jun 10 18:34:56.735135 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [req-8a498a0f-8b7b-45fe-b735-9222fe0a84b7 req-9a9bcfe8-787f-4b07-bde0-891ef47ba8ce service nova] Instance 22d96fe9-d755-452b-95a0-b0ce772fb72e is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 18:34:56.752247 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-8a498a0f-8b7b-45fe-b735-9222fe0a84b7 req-9a9bcfe8-787f-4b07-bde0-891ef47ba8ce service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072478 Jun 10 18:34:56.758078 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3285/6605] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:34:56.823208 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-536cc53c-2b38-4652-93f1-7cb2d242e8c4 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:56.835234 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-536cc53c-2b38-4652-93f1-7cb2d242e8c4 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1696 microversion: 2.1 time: 0.336918 Jun 10 18:34:56.835861 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3321/6606] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:56 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1696 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:34:57.866908 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-449fffdf-14d0-4805-bf3d-25f70eeeb5ac tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:57.866908 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-449fffdf-14d0-4805-bf3d-25f70eeeb5ac tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:57.876383 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-449fffdf-14d0-4805-bf3d-25f70eeeb5ac tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:57.877201 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-449fffdf-14d0-4805-bf3d-25f70eeeb5ac tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:57.878142 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-449fffdf-14d0-4805-bf3d-25f70eeeb5ac tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:57.878748 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-449fffdf-14d0-4805-bf3d-25f70eeeb5ac tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:58.249733 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-449fffdf-14d0-4805-bf3d-25f70eeeb5ac tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:58.275336 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-449fffdf-14d0-4805-bf3d-25f70eeeb5ac tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1696 microversion: 2.1 time: 0.422635 Jun 10 18:34:58.275971 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3286/6607] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:57 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1696 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:34:59.223771 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-b32e6e88-7816-43e4-a956-4a05693cb2a8 req-2bd8f9e7-d17c-475c-9918-fceddfda4892 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22d96fe9-d755-452b-95a0-b0ce772fb72e", "tag": "ede2c1d8-e562-4758-9879-234ee389f99f"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:34:59.235121 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-b32e6e88-7816-43e4-a956-4a05693cb2a8 req-2bd8f9e7-d17c-475c-9918-fceddfda4892 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:59.236293 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-b32e6e88-7816-43e4-a956-4a05693cb2a8 req-2bd8f9e7-d17c-475c-9918-fceddfda4892 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:59.256724 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-b32e6e88-7816-43e4-a956-4a05693cb2a8 req-2bd8f9e7-d17c-475c-9918-fceddfda4892 service nova] Creating event network-changed:ede2c1d8-e562-4758-9879-234ee389f99f for instance 22d96fe9-d755-452b-95a0-b0ce772fb72e on chh2-master-2 Jun 10 18:34:59.265462 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [req-b32e6e88-7816-43e4-a956-4a05693cb2a8 req-2bd8f9e7-d17c-475c-9918-fceddfda4892 service nova] Instance 22d96fe9-d755-452b-95a0-b0ce772fb72e is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126594) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 18:34:59.286425 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-b32e6e88-7816-43e4-a956-4a05693cb2a8 req-2bd8f9e7-d17c-475c-9918-fceddfda4892 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066128 Jun 10 18:34:59.290977 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3322/6608] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:34:59.293584 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5043be6e-95e9-4b5e-849c-1122303433ff tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:59.294189 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5043be6e-95e9-4b5e-849c-1122303433ff tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:59.305932 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5043be6e-95e9-4b5e-849c-1122303433ff tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:59.306771 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5043be6e-95e9-4b5e-849c-1122303433ff tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:59.311436 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5043be6e-95e9-4b5e-849c-1122303433ff tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:59.311978 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5043be6e-95e9-4b5e-849c-1122303433ff tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:59.623494 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5043be6e-95e9-4b5e-849c-1122303433ff tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:34:59.637273 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5043be6e-95e9-4b5e-849c-1122303433ff tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1696 microversion: 2.1 time: 0.347555 Jun 10 18:34:59.638741 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3287/6609] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:34:59 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1696 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:34:59.895811 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6dac6ef1-a0e9-43b5-a6f7-b0ee01d45802 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:34:59.895811 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6dac6ef1-a0e9-43b5-a6f7-b0ee01d45802 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: cf4aaf4f-5855-4034-a1a5-2bfb200ad546] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:34:59.904874 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6dac6ef1-a0e9-43b5-a6f7-b0ee01d45802 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:59.929384 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6dac6ef1-a0e9-43b5-a6f7-b0ee01d45802 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:59.939222 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6dac6ef1-a0e9-43b5-a6f7-b0ee01d45802 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:34:59.941628 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6dac6ef1-a0e9-43b5-a6f7-b0ee01d45802 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:34:59.983133 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-6dac6ef1-a0e9-43b5-a6f7-b0ee01d45802 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] HTTP exception thrown: Instance cf4aaf4f-5855-4034-a1a5-2bfb200ad546 could not be found. Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6dac6ef1-a0e9-43b5-a6f7-b0ee01d45802 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Request method failure captured: Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: request: DELETE /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546 HTTP/1.1 Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio40ltn_2ByFbzyzAVu0QcFPuZdhey6Y1RzaanyIXWFbMA3jX27kd5QdQTkjdaPpNC3eHF8vjMWTW53ROHXMgqhb7cmKVmMJ0JxmAIwklDSmJ4lKTSAAeEDlgNHI_IPAeB-zYoB4LI3xPkB9jsdNHxjRbctCV4bBXBp--Rsr4WX1UBVQ Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 1be5a72204b8483590ce13d50170b117 Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-AttachVolumeTestJSON-1437428834 Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1be5a72204b8483590ce13d50170b117"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1be5a72204b8483590ce13d50170b117"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1be5a72204b8483590ce13d50170b117"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1be5a72204b8483590ce13d50170b117", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-AttachVolumeTestJSON-1437428834 Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 1be5a72204b8483590ce13d50170b117 Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1437428834 Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-AttachVolumeTestJSON-1437428834-project Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: fe74aba3932c467e8124a888867d2112 Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-AttachVolumeTestJSON-1437428834-project Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: exception: Instance cf4aaf4f-5855-4034-a1a5-2bfb200ad546 could not be found. Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'cf4aaf4f-5855-4034-a1a5-2bfb200ad546'} Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf4aaf4f-5855-4034-a1a5-2bfb200ad546 could not be found. Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:34:59.996559 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:35:00.006448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf4aaf4f-5855-4034-a1a5-2bfb200ad546 could not be found. Jun 10 18:35:00.006448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:35:00.006448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:35:00.006448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:35:00.006448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:35:00.006448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:35:00.006448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:35:00.006448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:35:00.006448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:35:00.006448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf4aaf4f-5855-4034-a1a5-2bfb200ad546 could not be found. Jun 10 18:35:00.006448 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:35:00.006448 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6dac6ef1-a0e9-43b5-a6f7-b0ee01d45802 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Returning 404 to user: Instance cf4aaf4f-5855-4034-a1a5-2bfb200ad546 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:35:00.006448 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6dac6ef1-a0e9-43b5-a6f7-b0ee01d45802 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "DELETE /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546" status: 404 len: 111 microversion: 2.1 time: 0.117891 Jun 10 18:35:00.016689 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8fe0c4c3-4a73-4273-8415-481fd10de3d5 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:35:00.023253 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8fe0c4c3-4a73-4273-8415-481fd10de3d5 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: cf4aaf4f-5855-4034-a1a5-2bfb200ad546] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:35:00.027159 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8fe0c4c3-4a73-4273-8415-481fd10de3d5 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:00.027518 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3323/6610] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:34:59 2022] DELETE /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:35:00.035624 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8fe0c4c3-4a73-4273-8415-481fd10de3d5 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:00.036657 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8fe0c4c3-4a73-4273-8415-481fd10de3d5 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:00.037008 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8fe0c4c3-4a73-4273-8415-481fd10de3d5 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:00.058388 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-8fe0c4c3-4a73-4273-8415-481fd10de3d5 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] HTTP exception thrown: Instance cf4aaf4f-5855-4034-a1a5-2bfb200ad546 could not be found. Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8fe0c4c3-4a73-4273-8415-481fd10de3d5 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Request method failure captured: Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546 HTTP/1.1 Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio40ltn_2ByFbzyzAVu0QcFPuZdhey6Y1RzaanyIXWFbMA3jX27kd5QdQTkjdaPpNC3eHF8vjMWTW53ROHXMgqhb7cmKVmMJ0JxmAIwklDSmJ4lKTSAAeEDlgNHI_IPAeB-zYoB4LI3xPkB9jsdNHxjRbctCV4bBXBp--Rsr4WX1UBVQ Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 1be5a72204b8483590ce13d50170b117 Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-AttachVolumeTestJSON-1437428834 Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1be5a72204b8483590ce13d50170b117"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1be5a72204b8483590ce13d50170b117"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1be5a72204b8483590ce13d50170b117"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1be5a72204b8483590ce13d50170b117", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-AttachVolumeTestJSON-1437428834 Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 1be5a72204b8483590ce13d50170b117 Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1437428834 Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-AttachVolumeTestJSON-1437428834-project Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: fe74aba3932c467e8124a888867d2112 Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-AttachVolumeTestJSON-1437428834-project Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: exception: Instance cf4aaf4f-5855-4034-a1a5-2bfb200ad546 could not be found. Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'cf4aaf4f-5855-4034-a1a5-2bfb200ad546'} Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf4aaf4f-5855-4034-a1a5-2bfb200ad546 could not be found. Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf4aaf4f-5855-4034-a1a5-2bfb200ad546 could not be found. Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:35:00.060354 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:35:00.063759 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:35:00.063759 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:35:00.063759 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:35:00.063759 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:35:00.063759 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:35:00.063759 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf4aaf4f-5855-4034-a1a5-2bfb200ad546 could not be found. Jun 10 18:35:00.063759 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:35:00.063759 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8fe0c4c3-4a73-4273-8415-481fd10de3d5 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Returning 404 to user: Instance cf4aaf4f-5855-4034-a1a5-2bfb200ad546 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:35:00.063759 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8fe0c4c3-4a73-4273-8415-481fd10de3d5 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546" status: 404 len: 111 microversion: 2.1 time: 0.053491 Jun 10 18:35:00.063759 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3288/6611] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:35:00 2022] GET /compute/v2.1/servers/cf4aaf4f-5855-4034-a1a5-2bfb200ad546 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:35:00.660374 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-192f5645-5751-4649-bbc8-68a7d989d3c5 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:35:00.661786 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-192f5645-5751-4649-bbc8-68a7d989d3c5 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:35:00.665619 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:35:00.684652 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-192f5645-5751-4649-bbc8-68a7d989d3c5 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:00.685698 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-192f5645-5751-4649-bbc8-68a7d989d3c5 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:00.686854 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-192f5645-5751-4649-bbc8-68a7d989d3c5 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:00.687476 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-192f5645-5751-4649-bbc8-68a7d989d3c5 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:00.956684 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-192f5645-5751-4649-bbc8-68a7d989d3c5 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:35:00.967830 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-192f5645-5751-4649-bbc8-68a7d989d3c5 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1694 microversion: 2.1 time: 0.315871 Jun 10 18:35:00.979285 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3324/6612] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:35:00 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1694 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:35:01.986544 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-958399ca-8120-4f96-872d-287371182385 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:35:01.987062 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-958399ca-8120-4f96-872d-287371182385 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:35:01.990217 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:35:01.999876 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-958399ca-8120-4f96-872d-287371182385 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:02.000348 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-958399ca-8120-4f96-872d-287371182385 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:02.002873 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-958399ca-8120-4f96-872d-287371182385 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:02.002873 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-958399ca-8120-4f96-872d-287371182385 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:02.194865 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-958399ca-8120-4f96-872d-287371182385 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:35:02.206387 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-958399ca-8120-4f96-872d-287371182385 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1694 microversion: 2.1 time: 0.223744 Jun 10 18:35:02.220404 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3289/6613] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:35:01 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1694 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:35:03.233848 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e3b8893f-07e9-4d0f-a75c-2d6ddc31f0a9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:35:03.235077 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e3b8893f-07e9-4d0f-a75c-2d6ddc31f0a9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:35:03.255671 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e3b8893f-07e9-4d0f-a75c-2d6ddc31f0a9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:03.257458 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e3b8893f-07e9-4d0f-a75c-2d6ddc31f0a9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:03.260071 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e3b8893f-07e9-4d0f-a75c-2d6ddc31f0a9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:03.273200 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e3b8893f-07e9-4d0f-a75c-2d6ddc31f0a9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:03.450837 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e3b8893f-07e9-4d0f-a75c-2d6ddc31f0a9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:35:03.460691 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e3b8893f-07e9-4d0f-a75c-2d6ddc31f0a9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1691 microversion: 2.1 time: 0.230176 Jun 10 18:35:03.461768 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3325/6614] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:35:03 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1691 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:35:03.483724 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5f0d37ac-9644-4ce8-bae2-dc5540637239 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:35:03.484990 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5f0d37ac-9644-4ce8-bae2-dc5540637239 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:35:03.499177 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5f0d37ac-9644-4ce8-bae2-dc5540637239 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:03.499899 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5f0d37ac-9644-4ce8-bae2-dc5540637239 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:03.501039 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5f0d37ac-9644-4ce8-bae2-dc5540637239 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:03.501641 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5f0d37ac-9644-4ce8-bae2-dc5540637239 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:04.115776 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5f0d37ac-9644-4ce8-bae2-dc5540637239 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "POST /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e/action" status: 202 len: 0 microversion: 2.1 time: 0.635819 Jun 10 18:35:04.121054 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3290/6615] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:35:03 2022] POST /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e/action => generated 0 bytes in 642 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:35:04.126561 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ab699bd3-4abb-4d68-913c-142c60b31f80 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:35:04.127516 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ab699bd3-4abb-4d68-913c-142c60b31f80 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:35:04.135574 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ab699bd3-4abb-4d68-913c-142c60b31f80 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:04.142031 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ab699bd3-4abb-4d68-913c-142c60b31f80 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:04.142031 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ab699bd3-4abb-4d68-913c-142c60b31f80 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:04.145812 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ab699bd3-4abb-4d68-913c-142c60b31f80 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:04.319091 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ab699bd3-4abb-4d68-913c-142c60b31f80 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:35:04.332772 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ab699bd3-4abb-4d68-913c-142c60b31f80 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1690 microversion: 2.1 time: 0.210814 Jun 10 18:35:04.345239 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3326/6616] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:35:04 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1690 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:35:05.017954 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-861ba045-e3b8-4977-a180-e6373eadc9aa req-bc82fb40-daa5-46c7-b6bb-ad1e161b4b51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22d96fe9-d755-452b-95a0-b0ce772fb72e", "name": "network-vif-plugged", "status": "completed", "tag": "ede2c1d8-e562-4758-9879-234ee389f99f"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:35:05.034939 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-861ba045-e3b8-4977-a180-e6373eadc9aa req-bc82fb40-daa5-46c7-b6bb-ad1e161b4b51 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:05.036059 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-861ba045-e3b8-4977-a180-e6373eadc9aa req-bc82fb40-daa5-46c7-b6bb-ad1e161b4b51 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:05.073106 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-861ba045-e3b8-4977-a180-e6373eadc9aa req-bc82fb40-daa5-46c7-b6bb-ad1e161b4b51 service nova] Creating event network-vif-plugged:ede2c1d8-e562-4758-9879-234ee389f99f for instance 22d96fe9-d755-452b-95a0-b0ce772fb72e on chh2-master-2 Jun 10 18:35:05.081766 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [req-861ba045-e3b8-4977-a180-e6373eadc9aa req-bc82fb40-daa5-46c7-b6bb-ad1e161b4b51 service nova] Instance 22d96fe9-d755-452b-95a0-b0ce772fb72e is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 18:35:05.098517 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-861ba045-e3b8-4977-a180-e6373eadc9aa req-bc82fb40-daa5-46c7-b6bb-ad1e161b4b51 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085138 Jun 10 18:35:05.099989 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3291/6617] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:35:05.368444 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-eb281d3b-bf79-4c1d-aa56-a70765f08b3c tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:35:05.369293 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-eb281d3b-bf79-4c1d-aa56-a70765f08b3c tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:35:05.420793 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eb281d3b-bf79-4c1d-aa56-a70765f08b3c tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:05.423752 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eb281d3b-bf79-4c1d-aa56-a70765f08b3c tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:05.427381 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eb281d3b-bf79-4c1d-aa56-a70765f08b3c tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:05.427848 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eb281d3b-bf79-4c1d-aa56-a70765f08b3c tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:05.733077 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-eb281d3b-bf79-4c1d-aa56-a70765f08b3c tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:35:05.742927 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-eb281d3b-bf79-4c1d-aa56-a70765f08b3c tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1690 microversion: 2.1 time: 0.394908 Jun 10 18:35:05.743729 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3327/6618] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:35:05 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1690 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:35:05.820684 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-651268ce-1147-441f-a4af-88990f358288 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:35:05.821554 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-651268ce-1147-441f-a4af-88990f358288 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:35:05.828077 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-651268ce-1147-441f-a4af-88990f358288 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:05.828875 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-651268ce-1147-441f-a4af-88990f358288 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:05.829883 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-651268ce-1147-441f-a4af-88990f358288 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:05.830539 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-651268ce-1147-441f-a4af-88990f358288 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:05.851780 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-651268ce-1147-441f-a4af-88990f358288 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] HTTP exception thrown: Instance eb7d7b12-56ec-43ab-8327-488874922d7d could not be found. Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-651268ce-1147-441f-a4af-88990f358288 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Request method failure captured: Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d HTTP/1.1 Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio40ltn_2ByFbzyzAVu0QcFPuZdhey6Y1RzaanyIXWFbMA3jX27kd5QdQTkjdaPpNC3eHF8vjMWTW53ROHXMgqhb7cmKVmMJ0JxmAIwklDSmJ4lKTSAAeEDlgNHI_IPAeB-zYoB4LI3xPkB9jsdNHxjRbctCV4bBXBp--Rsr4WX1UBVQ Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 1be5a72204b8483590ce13d50170b117 Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-AttachVolumeTestJSON-1437428834 Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1be5a72204b8483590ce13d50170b117"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1be5a72204b8483590ce13d50170b117"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1be5a72204b8483590ce13d50170b117"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1be5a72204b8483590ce13d50170b117", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-AttachVolumeTestJSON-1437428834 Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 1be5a72204b8483590ce13d50170b117 Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1437428834 Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-AttachVolumeTestJSON-1437428834-project Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: fe74aba3932c467e8124a888867d2112 Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-AttachVolumeTestJSON-1437428834-project Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: exception: Instance eb7d7b12-56ec-43ab-8327-488874922d7d could not be found. Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'eb7d7b12-56ec-43ab-8327-488874922d7d'} Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb7d7b12-56ec-43ab-8327-488874922d7d could not be found. Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:35:05.855767 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:35:05.859745 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb7d7b12-56ec-43ab-8327-488874922d7d could not be found. Jun 10 18:35:05.859745 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:35:05.859745 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:35:05.859745 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:35:05.859745 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:35:05.859745 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:35:05.859745 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:35:05.859745 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:35:05.859745 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:35:05.859745 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb7d7b12-56ec-43ab-8327-488874922d7d could not be found. Jun 10 18:35:05.859745 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:35:05.859745 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-651268ce-1147-441f-a4af-88990f358288 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Returning 404 to user: Instance eb7d7b12-56ec-43ab-8327-488874922d7d could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:35:05.859745 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-651268ce-1147-441f-a4af-88990f358288 tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "DELETE /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 404 len: 111 microversion: 2.1 time: 0.039174 Jun 10 18:35:05.860682 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3292/6619] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:35:05 2022] DELETE /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:35:05.865118 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d39fa86e-fe6b-47ee-af24-09db76de19de tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:35:05.865738 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d39fa86e-fe6b-47ee-af24-09db76de19de tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] [instance: eb7d7b12-56ec-43ab-8327-488874922d7d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:35:05.880112 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d39fa86e-fe6b-47ee-af24-09db76de19de tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:05.880856 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d39fa86e-fe6b-47ee-af24-09db76de19de tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:05.881863 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d39fa86e-fe6b-47ee-af24-09db76de19de tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:05.892292 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d39fa86e-fe6b-47ee-af24-09db76de19de tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:05.914929 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-d39fa86e-fe6b-47ee-af24-09db76de19de tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] HTTP exception thrown: Instance eb7d7b12-56ec-43ab-8327-488874922d7d could not be found. Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d39fa86e-fe6b-47ee-af24-09db76de19de tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Request method failure captured: Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d HTTP/1.1 Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio40ltn_2ByFbzyzAVu0QcFPuZdhey6Y1RzaanyIXWFbMA3jX27kd5QdQTkjdaPpNC3eHF8vjMWTW53ROHXMgqhb7cmKVmMJ0JxmAIwklDSmJ4lKTSAAeEDlgNHI_IPAeB-zYoB4LI3xPkB9jsdNHxjRbctCV4bBXBp--Rsr4WX1UBVQ Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 1be5a72204b8483590ce13d50170b117 Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-AttachVolumeTestJSON-1437428834 Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1be5a72204b8483590ce13d50170b117"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1be5a72204b8483590ce13d50170b117"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1be5a72204b8483590ce13d50170b117"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1be5a72204b8483590ce13d50170b117", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-AttachVolumeTestJSON-1437428834 Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 1be5a72204b8483590ce13d50170b117 Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1437428834 Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-AttachVolumeTestJSON-1437428834-project Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: fe74aba3932c467e8124a888867d2112 Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-AttachVolumeTestJSON-1437428834-project Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: exception: Instance eb7d7b12-56ec-43ab-8327-488874922d7d could not be found. Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'eb7d7b12-56ec-43ab-8327-488874922d7d'} Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb7d7b12-56ec-43ab-8327-488874922d7d could not be found. Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb7d7b12-56ec-43ab-8327-488874922d7d could not be found. Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:35:05.916539 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:35:05.921528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:35:05.921528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:35:05.921528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:35:05.921528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:35:05.921528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:35:05.921528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb7d7b12-56ec-43ab-8327-488874922d7d could not be found. Jun 10 18:35:05.921528 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:35:05.921528 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d39fa86e-fe6b-47ee-af24-09db76de19de tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] Returning 404 to user: Instance eb7d7b12-56ec-43ab-8327-488874922d7d could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:35:05.921528 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d39fa86e-fe6b-47ee-af24-09db76de19de tempest-AttachVolumeTestJSON-1437428834 tempest-AttachVolumeTestJSON-1437428834-project] 10.222.0.35 "GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d" status: 404 len: 111 microversion: 2.1 time: 0.057234 Jun 10 18:35:05.921528 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3328/6620] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:35:05 2022] GET /compute/v2.1/servers/eb7d7b12-56ec-43ab-8327-488874922d7d => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:35:06.766892 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-be8d2b47-62d0-465f-90d1-026ca564c1ee tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:35:06.768132 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-be8d2b47-62d0-465f-90d1-026ca564c1ee tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:35:06.799713 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-be8d2b47-62d0-465f-90d1-026ca564c1ee tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:06.805109 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-be8d2b47-62d0-465f-90d1-026ca564c1ee tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:06.805109 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-be8d2b47-62d0-465f-90d1-026ca564c1ee tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:06.805109 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-be8d2b47-62d0-465f-90d1-026ca564c1ee tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:07.228758 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-be8d2b47-62d0-465f-90d1-026ca564c1ee tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:35:07.245147 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-be8d2b47-62d0-465f-90d1-026ca564c1ee tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1690 microversion: 2.1 time: 0.484975 Jun 10 18:35:07.246097 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3293/6621] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:35:06 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1690 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:35:08.263635 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c1a72ae1-bf55-4cda-bdf2-ec70a6269f63 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:35:08.265122 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c1a72ae1-bf55-4cda-bdf2-ec70a6269f63 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:35:08.273957 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c1a72ae1-bf55-4cda-bdf2-ec70a6269f63 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:08.274420 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c1a72ae1-bf55-4cda-bdf2-ec70a6269f63 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:08.275216 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c1a72ae1-bf55-4cda-bdf2-ec70a6269f63 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:08.275664 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c1a72ae1-bf55-4cda-bdf2-ec70a6269f63 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:08.868721 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c1a72ae1-bf55-4cda-bdf2-ec70a6269f63 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:35:08.877653 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c1a72ae1-bf55-4cda-bdf2-ec70a6269f63 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1690 microversion: 2.1 time: 0.619509 Jun 10 18:35:08.880071 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3329/6622] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:35:08 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1690 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:35:09.239388 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-25a65134-f34a-4f83-95b5-380dfec1141a req-60ad4f23-bcaa-4a4c-afa9-437ef4421a9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22d96fe9-d755-452b-95a0-b0ce772fb72e", "name": "network-vif-unplugged", "status": "completed", "tag": "ede2c1d8-e562-4758-9879-234ee389f99f"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:35:09.250178 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-25a65134-f34a-4f83-95b5-380dfec1141a req-60ad4f23-bcaa-4a4c-afa9-437ef4421a9c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:09.250931 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-25a65134-f34a-4f83-95b5-380dfec1141a req-60ad4f23-bcaa-4a4c-afa9-437ef4421a9c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:09.268271 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-25a65134-f34a-4f83-95b5-380dfec1141a req-60ad4f23-bcaa-4a4c-afa9-437ef4421a9c service nova] Creating event network-vif-unplugged:ede2c1d8-e562-4758-9879-234ee389f99f for instance 22d96fe9-d755-452b-95a0-b0ce772fb72e on chh1-master-2 Jun 10 18:35:09.274107 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [req-25a65134-f34a-4f83-95b5-380dfec1141a req-60ad4f23-bcaa-4a4c-afa9-437ef4421a9c service nova] Instance 22d96fe9-d755-452b-95a0-b0ce772fb72e is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 18:35:09.285855 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-25a65134-f34a-4f83-95b5-380dfec1141a req-60ad4f23-bcaa-4a4c-afa9-437ef4421a9c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050204 Jun 10 18:35:09.286559 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3294/6623] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:35:09.895441 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f7db1cd0-2077-4645-8710-1fb3b5b8fda3 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:35:09.897790 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f7db1cd0-2077-4645-8710-1fb3b5b8fda3 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:35:09.904030 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f7db1cd0-2077-4645-8710-1fb3b5b8fda3 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:09.905402 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f7db1cd0-2077-4645-8710-1fb3b5b8fda3 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:09.906406 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f7db1cd0-2077-4645-8710-1fb3b5b8fda3 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:09.906912 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f7db1cd0-2077-4645-8710-1fb3b5b8fda3 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:09.928884 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:35:10.071592 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f7db1cd0-2077-4645-8710-1fb3b5b8fda3 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:35:10.080656 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f7db1cd0-2077-4645-8710-1fb3b5b8fda3 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1690 microversion: 2.1 time: 0.189064 Jun 10 18:35:10.081455 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3330/6624] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:35:09 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1690 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:35:11.102896 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-44f3b46f-5d91-42ca-8331-529982547932 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:35:11.104561 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-44f3b46f-5d91-42ca-8331-529982547932 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:35:11.120357 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44f3b46f-5d91-42ca-8331-529982547932 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:11.121213 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44f3b46f-5d91-42ca-8331-529982547932 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:11.123508 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44f3b46f-5d91-42ca-8331-529982547932 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:11.124181 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44f3b46f-5d91-42ca-8331-529982547932 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:11.328010 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-82847714-d66b-4d6e-b6fd-cbf2ad592e1e req-bdd3b3a8-0304-40ee-b742-e227b76fc45f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22d96fe9-d755-452b-95a0-b0ce772fb72e", "tag": "ede2c1d8-e562-4758-9879-234ee389f99f"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:35:11.343809 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-82847714-d66b-4d6e-b6fd-cbf2ad592e1e req-bdd3b3a8-0304-40ee-b742-e227b76fc45f service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:11.347582 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-82847714-d66b-4d6e-b6fd-cbf2ad592e1e req-bdd3b3a8-0304-40ee-b742-e227b76fc45f service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:11.368191 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-82847714-d66b-4d6e-b6fd-cbf2ad592e1e req-bdd3b3a8-0304-40ee-b742-e227b76fc45f service nova] Creating event network-changed:ede2c1d8-e562-4758-9879-234ee389f99f for instance 22d96fe9-d755-452b-95a0-b0ce772fb72e on chh1-master-2 Jun 10 18:35:11.375265 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [req-82847714-d66b-4d6e-b6fd-cbf2ad592e1e req-bdd3b3a8-0304-40ee-b742-e227b76fc45f service nova] Instance 22d96fe9-d755-452b-95a0-b0ce772fb72e is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126594) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 18:35:11.389136 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-82847714-d66b-4d6e-b6fd-cbf2ad592e1e req-bdd3b3a8-0304-40ee-b742-e227b76fc45f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065135 Jun 10 18:35:11.392791 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3331/6625] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:35:11.539503 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-44f3b46f-5d91-42ca-8331-529982547932 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:35:11.562745 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-44f3b46f-5d91-42ca-8331-529982547932 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1690 microversion: 2.1 time: 0.465707 Jun 10 18:35:11.574776 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3295/6626] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:35:11 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1690 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:35:12.596188 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bda55c0a-acd0-4fdd-96f8-4962706ba063 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:35:12.596953 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bda55c0a-acd0-4fdd-96f8-4962706ba063 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:35:12.604707 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bda55c0a-acd0-4fdd-96f8-4962706ba063 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:12.605182 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bda55c0a-acd0-4fdd-96f8-4962706ba063 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:12.605980 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bda55c0a-acd0-4fdd-96f8-4962706ba063 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:12.607056 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bda55c0a-acd0-4fdd-96f8-4962706ba063 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:12.828361 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bda55c0a-acd0-4fdd-96f8-4962706ba063 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:35:12.840268 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bda55c0a-acd0-4fdd-96f8-4962706ba063 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1690 microversion: 2.1 time: 0.249558 Jun 10 18:35:12.842544 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3332/6627] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:35:12 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1690 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:35:13.863536 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a5fcba43-d7eb-4a9e-903c-47ffaa8547ac tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:35:13.864336 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a5fcba43-d7eb-4a9e-903c-47ffaa8547ac tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:35:13.871702 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a5fcba43-d7eb-4a9e-903c-47ffaa8547ac tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:13.872806 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a5fcba43-d7eb-4a9e-903c-47ffaa8547ac tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:13.873586 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a5fcba43-d7eb-4a9e-903c-47ffaa8547ac tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:13.874056 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a5fcba43-d7eb-4a9e-903c-47ffaa8547ac tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:14.321841 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a5fcba43-d7eb-4a9e-903c-47ffaa8547ac tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:35:14.333567 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a5fcba43-d7eb-4a9e-903c-47ffaa8547ac tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1683 microversion: 2.1 time: 0.473863 Jun 10 18:35:14.334368 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3296/6628] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:35:13 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1683 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:35:17.727999 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-c77d2311-b38b-48d6-b21a-c24633e95a85 req-e2805a62-e45c-44c2-aa03-21da9830b205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22d96fe9-d755-452b-95a0-b0ce772fb72e", "name": "network-vif-plugged", "status": "completed", "tag": "ede2c1d8-e562-4758-9879-234ee389f99f"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:35:17.751365 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-c77d2311-b38b-48d6-b21a-c24633e95a85 req-e2805a62-e45c-44c2-aa03-21da9830b205 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:17.752093 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-c77d2311-b38b-48d6-b21a-c24633e95a85 req-e2805a62-e45c-44c2-aa03-21da9830b205 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:17.773182 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-c77d2311-b38b-48d6-b21a-c24633e95a85 req-e2805a62-e45c-44c2-aa03-21da9830b205 service nova] Creating event network-vif-plugged:ede2c1d8-e562-4758-9879-234ee389f99f for instance 22d96fe9-d755-452b-95a0-b0ce772fb72e on chh1-master-2 Jun 10 18:35:17.780949 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-c77d2311-b38b-48d6-b21a-c24633e95a85 req-e2805a62-e45c-44c2-aa03-21da9830b205 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056704 Jun 10 18:35:17.781885 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3333/6629] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:35:18.170791 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bec7f4a4-4b66-4dd6-b91f-703453e63e0a tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:35:18.171726 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bec7f4a4-4b66-4dd6-b91f-703453e63e0a tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 12d8e153-a080-4789-825b-af419b843eaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:35:18.181669 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bec7f4a4-4b66-4dd6-b91f-703453e63e0a tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:18.182086 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bec7f4a4-4b66-4dd6-b91f-703453e63e0a tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:18.183060 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bec7f4a4-4b66-4dd6-b91f-703453e63e0a tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:18.183502 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bec7f4a4-4b66-4dd6-b91f-703453e63e0a tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:18.198248 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:35:18.247410 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bec7f4a4-4b66-4dd6-b91f-703453e63e0a tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "POST /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa/action" status: 200 len: 32641 microversion: 2.1 time: 0.080413 Jun 10 18:35:18.255075 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3297/6630] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:35:18 2022] POST /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa/action => generated 32641 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:35:18.340561 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-041095df-13a4-475e-9d21-96a888ed7d5f tempest-VolumesTestJSON-456316406 tempest-VolumesTestJSON-456316406-project] Calling method '.version_select at 0x7f77c6150af0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:35:18.394960 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-041095df-13a4-475e-9d21-96a888ed7d5f tempest-VolumesTestJSON-456316406 tempest-VolumesTestJSON-456316406-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/c5aa635e-94a0-464e-9061-39fcf70864c8" status: 200 len: 351 microversion: 2.1 time: 0.058612 Jun 10 18:35:18.395663 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3334/6631] 10.222.0.35 () {58 vars in 1244 bytes} [Fri Jun 10 18:35:18 2022] GET /compute/v2.1/os-volumes/c5aa635e-94a0-464e-9061-39fcf70864c8 => generated 351 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:35:19.493010 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-fc507f58-3bfe-4d6f-94f7-34a02572c443 req-cc774603-a29e-416d-86ee-517617d60b24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12d8e153-a080-4789-825b-af419b843eaa", "tag": "fd8260c0-0773-4984-af80-4901ce0e7b3a"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:35:19.493665 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4a3f4ae7-651b-4917-ad70-5274d2a48e18 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:35:19.493665 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4a3f4ae7-651b-4917-ad70-5274d2a48e18 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 12d8e153-a080-4789-825b-af419b843eaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:35:19.504084 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-fc507f58-3bfe-4d6f-94f7-34a02572c443 req-cc774603-a29e-416d-86ee-517617d60b24 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:19.504596 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-fc507f58-3bfe-4d6f-94f7-34a02572c443 req-cc774603-a29e-416d-86ee-517617d60b24 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:19.509558 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a3f4ae7-651b-4917-ad70-5274d2a48e18 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:19.513199 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a3f4ae7-651b-4917-ad70-5274d2a48e18 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:19.514057 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a3f4ae7-651b-4917-ad70-5274d2a48e18 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:19.514514 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a3f4ae7-651b-4917-ad70-5274d2a48e18 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:19.515795 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-fc507f58-3bfe-4d6f-94f7-34a02572c443 req-cc774603-a29e-416d-86ee-517617d60b24 service nova] Creating event network-changed:fd8260c0-0773-4984-af80-4901ce0e7b3a for instance 12d8e153-a080-4789-825b-af419b843eaa on chh2-master-2 Jun 10 18:35:19.520877 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-fc507f58-3bfe-4d6f-94f7-34a02572c443 req-cc774603-a29e-416d-86ee-517617d60b24 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031344 Jun 10 18:35:19.524668 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3335/6632] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:35:19.575227 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4a3f4ae7-651b-4917-ad70-5274d2a48e18 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 12d8e153-a080-4789-825b-af419b843eaa] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:35:19.994687 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4a3f4ae7-651b-4917-ad70-5274d2a48e18 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "DELETE /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa" status: 204 len: 0 microversion: 2.1 time: 0.507219 Jun 10 18:35:19.998201 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3298/6633] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:35:19 2022] DELETE /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa => generated 0 bytes in 510 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:35:20.010897 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-260764ce-bcb0-4af5-951a-16838616df34 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:35:20.012114 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-260764ce-bcb0-4af5-951a-16838616df34 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 12d8e153-a080-4789-825b-af419b843eaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:35:20.025553 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-260764ce-bcb0-4af5-951a-16838616df34 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:20.026376 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-260764ce-bcb0-4af5-951a-16838616df34 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:20.029206 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-260764ce-bcb0-4af5-951a-16838616df34 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:20.032017 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-260764ce-bcb0-4af5-951a-16838616df34 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:20.307844 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-260764ce-bcb0-4af5-951a-16838616df34 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:35:20.320319 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-260764ce-bcb0-4af5-951a-16838616df34 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa" status: 200 len: 1670 microversion: 2.1 time: 0.314494 Jun 10 18:35:20.320921 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3336/6634] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:35:20 2022] GET /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa => generated 1670 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:35:21.349585 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bb28b716-834a-420f-9c2c-6adeace86cf2 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:35:21.351514 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bb28b716-834a-420f-9c2c-6adeace86cf2 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 12d8e153-a080-4789-825b-af419b843eaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:35:21.373706 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb28b716-834a-420f-9c2c-6adeace86cf2 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:21.374517 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb28b716-834a-420f-9c2c-6adeace86cf2 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:21.380763 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb28b716-834a-420f-9c2c-6adeace86cf2 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:21.380763 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb28b716-834a-420f-9c2c-6adeace86cf2 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:21.480908 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bcff9275-c9dc-4e00-926f-698438c2b429 tempest-VolumesTestJSON-456316406 tempest-VolumesTestJSON-456316406-project] Calling method '.version_select at 0x7f77b3c249d0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:35:21.586811 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bcff9275-c9dc-4e00-926f-698438c2b429 tempest-VolumesTestJSON-456316406 tempest-VolumesTestJSON-456316406-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/2227a618-5f62-4f99-982e-cf662e59cb7b" status: 200 len: 351 microversion: 2.1 time: 0.113554 Jun 10 18:35:21.605152 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3337/6635] 10.222.0.35 () {58 vars in 1244 bytes} [Fri Jun 10 18:35:21 2022] GET /compute/v2.1/os-volumes/2227a618-5f62-4f99-982e-cf662e59cb7b => generated 351 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:35:21.811870 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bb28b716-834a-420f-9c2c-6adeace86cf2 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:35:21.819948 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bb28b716-834a-420f-9c2c-6adeace86cf2 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa" status: 200 len: 1670 microversion: 2.1 time: 0.484775 Jun 10 18:35:21.821278 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3299/6636] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:35:21 2022] GET /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa => generated 1670 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:35:22.400357 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-22a9a83c-cdf9-4844-b305-8a47c3c6685b req-a17a5eb6-bd72-440f-9084-57824d2e46cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12d8e153-a080-4789-825b-af419b843eaa", "name": "network-vif-deleted", "tag": "fd8260c0-0773-4984-af80-4901ce0e7b3a"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:35:22.410317 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-22a9a83c-cdf9-4844-b305-8a47c3c6685b req-a17a5eb6-bd72-440f-9084-57824d2e46cd service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:22.413939 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-22a9a83c-cdf9-4844-b305-8a47c3c6685b req-a17a5eb6-bd72-440f-9084-57824d2e46cd service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:22.428614 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-22a9a83c-cdf9-4844-b305-8a47c3c6685b req-a17a5eb6-bd72-440f-9084-57824d2e46cd service nova] Creating event network-vif-deleted:fd8260c0-0773-4984-af80-4901ce0e7b3a for instance 12d8e153-a080-4789-825b-af419b843eaa on chh2-master-2 Jun 10 18:35:22.434375 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-22a9a83c-cdf9-4844-b305-8a47c3c6685b req-a17a5eb6-bd72-440f-9084-57824d2e46cd service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040488 Jun 10 18:35:22.435862 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3338/6637] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:35:22.839115 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-05bb9cfb-b94b-435d-a7c3-2854b6aec7e1 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:35:22.839795 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-05bb9cfb-b94b-435d-a7c3-2854b6aec7e1 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 12d8e153-a080-4789-825b-af419b843eaa] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:35:22.847428 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05bb9cfb-b94b-435d-a7c3-2854b6aec7e1 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:22.847845 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05bb9cfb-b94b-435d-a7c3-2854b6aec7e1 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:22.849014 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05bb9cfb-b94b-435d-a7c3-2854b6aec7e1 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:22.849456 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05bb9cfb-b94b-435d-a7c3-2854b6aec7e1 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:22.900438 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05bb9cfb-b94b-435d-a7c3-2854b6aec7e1 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:22.900905 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05bb9cfb-b94b-435d-a7c3-2854b6aec7e1 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:22.901371 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-05bb9cfb-b94b-435d-a7c3-2854b6aec7e1 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lazy-loading 'fault' on Instance uuid 12d8e153-a080-4789-825b-af419b843eaa {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:35:22.950435 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-05bb9cfb-b94b-435d-a7c3-2854b6aec7e1 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb110e0802174e1fb00d874f9e047b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52d669c461c4bb38e30dbd8ba0bd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:35:22.958574 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-05bb9cfb-b94b-435d-a7c3-2854b6aec7e1 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa" status: 200 len: 1337 microversion: 2.1 time: 0.123297 Jun 10 18:35:22.959140 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3300/6638] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:35:22 2022] GET /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa => generated 1337 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:35:23.990462 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1ec1ed2e-b31d-42b3-85cb-a0d5bc044da7 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:35:23.991156 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1ec1ed2e-b31d-42b3-85cb-a0d5bc044da7 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] [instance: 12d8e153-a080-4789-825b-af419b843eaa] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:35:24.009184 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1ec1ed2e-b31d-42b3-85cb-a0d5bc044da7 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:24.010103 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1ec1ed2e-b31d-42b3-85cb-a0d5bc044da7 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:24.011498 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1ec1ed2e-b31d-42b3-85cb-a0d5bc044da7 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:24.012161 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1ec1ed2e-b31d-42b3-85cb-a0d5bc044da7 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:24.033236 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-1ec1ed2e-b31d-42b3-85cb-a0d5bc044da7 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] HTTP exception thrown: Instance 12d8e153-a080-4789-825b-af419b843eaa could not be found. Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1ec1ed2e-b31d-42b3-85cb-a0d5bc044da7 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Request method failure captured: Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa HTTP/1.1 Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio43DhZqgAJ1_6FGo_KnHaha-ugAuVO8_EqGRZFb-FqZYELhKvXgfD_lLw1ONRL1ucrz4STgXDDo1yirq6r-7PEGk3PGlyFjAYeN8cyoHKFFONmyhcyO87P3oTWzoS6hSOoR5XqXB1Y_FE98HaKU4kBOrltUSL84WZmsHskXY0jvMo7I Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: a52d669c461c4bb38e30dbd8ba0bd0a2 Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-TestNetworkBasicOps-426117710 Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/a52d669c461c4bb38e30dbd8ba0bd0a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a52d669c461c4bb38e30dbd8ba0bd0a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a52d669c461c4bb38e30dbd8ba0bd0a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_a52d669c461c4bb38e30dbd8ba0bd0a2", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-TestNetworkBasicOps-426117710 Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: a52d669c461c4bb38e30dbd8ba0bd0a2 Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-TestNetworkBasicOps-426117710 Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-TestNetworkBasicOps-426117710-project Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: cb110e0802174e1fb00d874f9e047b01 Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-TestNetworkBasicOps-426117710-project Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 12d8e153-a080-4789-825b-af419b843eaa could not be found. Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '12d8e153-a080-4789-825b-af419b843eaa'} Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12d8e153-a080-4789-825b-af419b843eaa could not be found. Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12d8e153-a080-4789-825b-af419b843eaa could not be found. Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:35:24.035184 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:35:24.039676 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:35:24.039676 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:35:24.039676 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:35:24.039676 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:35:24.039676 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:35:24.039676 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12d8e153-a080-4789-825b-af419b843eaa could not be found. Jun 10 18:35:24.039676 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:35:24.041794 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1ec1ed2e-b31d-42b3-85cb-a0d5bc044da7 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Returning 404 to user: Instance 12d8e153-a080-4789-825b-af419b843eaa could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:35:24.044611 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1ec1ed2e-b31d-42b3-85cb-a0d5bc044da7 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "GET /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa" status: 404 len: 111 microversion: 2.1 time: 0.058769 Jun 10 18:35:24.048550 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3339/6639] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:35:23 2022] GET /compute/v2.1/servers/12d8e153-a080-4789-825b-af419b843eaa => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:35:24.331820 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-652b0938-0bff-4f54-adc5-0e6bc28c9496 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] Calling method '.version_select at 0x7f77c0ce40d0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:35:24.452364 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-05ab8cfd-e875-4ec6-8e05-59549491ada3 tempest-VolumesTestJSON-456316406 tempest-VolumesTestJSON-456316406-project] Calling method '.version_select at 0x7f77c0365e50>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:35:24.476046 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-652b0938-0bff-4f54-adc5-0e6bc28c9496 tempest-TestNetworkBasicOps-426117710 tempest-TestNetworkBasicOps-426117710-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-321090491" status: 202 len: 0 microversion: 2.1 time: 0.148110 Jun 10 18:35:24.476856 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3301/6640] 10.222.0.35 () {58 vars in 1253 bytes} [Fri Jun 10 18:35:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-321090491 => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:35:24.540346 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-05ab8cfd-e875-4ec6-8e05-59549491ada3 tempest-VolumesTestJSON-456316406 tempest-VolumesTestJSON-456316406-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/ccb59234-7899-41ba-96c0-986b3e816e61" status: 200 len: 351 microversion: 2.1 time: 0.091861 Jun 10 18:35:24.547729 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3340/6641] 10.222.0.35 () {58 vars in 1244 bytes} [Fri Jun 10 18:35:24 2022] GET /compute/v2.1/os-volumes/ccb59234-7899-41ba-96c0-986b3e816e61 => generated 351 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:35:24.552725 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6e8178bb-a883-479b-b620-bdb02d9cc354 tempest-VolumesTestJSON-456316406 tempest-VolumesTestJSON-456316406-project] Calling method '.version_select at 0x7f77c0115e50>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:35:24.664742 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6e8178bb-a883-479b-b620-bdb02d9cc354 tempest-VolumesTestJSON-456316406 tempest-VolumesTestJSON-456316406-project] 10.222.0.35 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.108016 Jun 10 18:35:24.664742 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3302/6642] 10.222.0.35 () {58 vars in 1133 bytes} [Fri Jun 10 18:35:24 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:35:24.671525 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3a3fac0d-ed03-483a-870d-d8e8376af56d tempest-VolumesTestJSON-456316406 tempest-VolumesTestJSON-456316406-project] Calling method '.version_select at 0x7f77b3f1cee0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:35:24.773365 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3a3fac0d-ed03-483a-870d-d8e8376af56d tempest-VolumesTestJSON-456316406 tempest-VolumesTestJSON-456316406-project] 10.222.0.35 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.098431 Jun 10 18:35:24.773365 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3341/6643] 10.222.0.35 () {58 vars in 1148 bytes} [Fri Jun 10 18:35:24 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:35:24.778848 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-36a26ff6-20e5-4887-96ec-1aa09824c6d6 tempest-VolumesTestJSON-456316406 tempest-VolumesTestJSON-456316406-project] Calling method '.version_select at 0x7f77c12c3040>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:35:24.885259 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-36a26ff6-20e5-4887-96ec-1aa09824c6d6 tempest-VolumesTestJSON-456316406 tempest-VolumesTestJSON-456316406-project] 10.222.0.35 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.111205 Jun 10 18:35:24.887079 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3303/6644] 10.222.0.35 () {58 vars in 1133 bytes} [Fri Jun 10 18:35:24 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:35:24.900006 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c26ae7a5-22d7-4c94-9267-0198e8bd05a7 tempest-VolumesTestJSON-456316406 tempest-VolumesTestJSON-456316406-project] Calling method '.version_select at 0x7f77b3a65280>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:35:25.009645 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c26ae7a5-22d7-4c94-9267-0198e8bd05a7 tempest-VolumesTestJSON-456316406 tempest-VolumesTestJSON-456316406-project] 10.222.0.35 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.113621 Jun 10 18:35:25.011647 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3342/6645] 10.222.0.35 () {58 vars in 1166 bytes} [Fri Jun 10 18:35:24 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:35:25.022817 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-781e4260-19e4-4eff-9b5d-fd8e942c59ec tempest-VolumesTestJSON-456316406 tempest-VolumesTestJSON-456316406-project] Calling method '.version_select at 0x7f77c01151f0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:35:25.111352 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-781e4260-19e4-4eff-9b5d-fd8e942c59ec tempest-VolumesTestJSON-456316406 tempest-VolumesTestJSON-456316406-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.092374 Jun 10 18:35:25.112408 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3304/6646] 10.222.0.35 () {58 vars in 1169 bytes} [Fri Jun 10 18:35:25 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:35:25.125885 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a7e02669-2d47-4804-942e-09dd4e0b9eee tempest-VolumesTestJSON-456316406 tempest-VolumesTestJSON-456316406-project] Calling method '.version_select at 0x7f77b3f1cd30>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:35:25.222686 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a7e02669-2d47-4804-942e-09dd4e0b9eee tempest-VolumesTestJSON-456316406 tempest-VolumesTestJSON-456316406-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.101531 Jun 10 18:35:25.223796 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3343/6647] 10.222.0.35 () {58 vars in 1154 bytes} [Fri Jun 10 18:35:25 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:35:25.236158 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f1a8a674-301e-470d-8251-0707af7adec5 tempest-VolumesTestJSON-456316406 tempest-VolumesTestJSON-456316406-project] Calling method '.version_select at 0x7f77c0ce4c10>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:35:25.327436 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f1a8a674-301e-470d-8251-0707af7adec5 tempest-VolumesTestJSON-456316406 tempest-VolumesTestJSON-456316406-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.093734 Jun 10 18:35:25.328269 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3305/6648] 10.222.0.35 () {58 vars in 1187 bytes} [Fri Jun 10 18:35:25 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:35:25.341709 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c2106122-98b1-4bd3-bb3d-14e323a2468a tempest-VolumesTestJSON-456316406 tempest-VolumesTestJSON-456316406-project] Calling method '.version_select at 0x7f77b3a654c0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:35:25.457091 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c2106122-98b1-4bd3-bb3d-14e323a2468a tempest-VolumesTestJSON-456316406 tempest-VolumesTestJSON-456316406-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.119961 Jun 10 18:35:25.457947 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3344/6649] 10.222.0.35 () {58 vars in 1154 bytes} [Fri Jun 10 18:35:25 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:35:38.564585 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:35:38.570452 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:35:38.956691 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-eb158e44-36f2-45b9-9179-a9a9e150ea52 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:35:38.957955 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-eb158e44-36f2-45b9-9179-a9a9e150ea52 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:35:38.967162 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eb158e44-36f2-45b9-9179-a9a9e150ea52 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:38.968106 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eb158e44-36f2-45b9-9179-a9a9e150ea52 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:38.969360 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eb158e44-36f2-45b9-9179-a9a9e150ea52 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:38.970130 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eb158e44-36f2-45b9-9179-a9a9e150ea52 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:39.077720 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-eb158e44-36f2-45b9-9179-a9a9e150ea52 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "POST /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e/action" status: 200 len: 63208 microversion: 2.1 time: 0.513624 Jun 10 18:35:39.087017 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3306/6650] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:35:38 2022] POST /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e/action => generated 63208 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:35:43.540422 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=27 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:35:43.542386 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=27 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:35:43.840594 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3aefe605-5db3-4530-ad8f-763fb1789b2a tempest-VolumesNegativeTest-325350324 tempest-VolumesNegativeTest-325350324-project] Action: 'create', calling method: .version_select at 0x7f77b3f1c1f0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1614935149", "metadata": {"Type": "work"}}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3aefe605-5db3-4530-ad8f-763fb1789b2a tempest-VolumesNegativeTest-325350324 tempest-VolumesNegativeTest-325350324-project] Request method failure captured: Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 122 Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio47_8VB-GGe3RaeDC9yG_setM2H44ibJhHNrQdR09Dfhy2kkbnsePW2-UecmIfs6_-9FCmN2HzXkN2rvjHih5-cgMiP2TfRMzK1wTuJzUEz-uZLH3VCNPGkliioIyyZG10J5gJYUSZRLRMN8z_go4JjXMieX9q4t-59C_m7gY6jGReo Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 7de6f35c26234298a34b3478076fdf1d Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-VolumesNegativeTest-325350324 Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/7de6f35c26234298a34b3478076fdf1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7de6f35c26234298a34b3478076fdf1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7de6f35c26234298a34b3478076fdf1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_7de6f35c26234298a34b3478076fdf1d", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-VolumesNegativeTest-325350324 Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 7de6f35c26234298a34b3478076fdf1d Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-VolumesNegativeTest-325350324 Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-VolumesNegativeTest-325350324-project Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: d4248f2ee7df4e1586cdb54bfd2963c6 Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-VolumesNegativeTest-325350324-project Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1614935149", "metadata": {"Type": "work"}}} Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1614935149', 'metadata': {'Type': 'work'}}}} Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise error Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi '#$%' Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 10 18:35:43.843855 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 10 18:35:43.851844 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 10 18:35:43.851844 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:35:43.851844 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:35:43.851844 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:35:43.851844 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:35:43.851844 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:35:43.851844 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:35:43.851844 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 10 18:35:43.851844 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 10 18:35:43.851844 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 10 18:35:43.851844 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:35:43.851844 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3aefe605-5db3-4530-ad8f-763fb1789b2a tempest-VolumesNegativeTest-325350324 tempest-VolumesNegativeTest-325350324-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:35:43.851844 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3aefe605-5db3-4530-ad8f-763fb1789b2a tempest-VolumesNegativeTest-325350324 tempest-VolumesNegativeTest-325350324-project] 10.222.0.35 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.306970 Jun 10 18:35:43.851844 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3345/6651] 10.222.0.35 () {60 vars in 1155 bytes} [Fri Jun 10 18:35:43 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 309 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:35:43.868369 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5344201b-bc96-4912-97d0-1242956eab23 tempest-VolumesNegativeTest-325350324 tempest-VolumesNegativeTest-325350324-project] Action: 'create', calling method: .version_select at 0x7f77c11cf280>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1432591848", "metadata": {"Type": "work"}}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5344201b-bc96-4912-97d0-1242956eab23 tempest-VolumesNegativeTest-325350324 tempest-VolumesNegativeTest-325350324-project] Request method failure captured: Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 120 Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio47_8VB-GGe3RaeDC9yG_setM2H44ibJhHNrQdR09Dfhy2kkbnsePW2-UecmIfs6_-9FCmN2HzXkN2rvjHih5-cgMiP2TfRMzK1wTuJzUEz-uZLH3VCNPGkliioIyyZG10J5gJYUSZRLRMN8z_go4JjXMieX9q4t-59C_m7gY6jGReo Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 7de6f35c26234298a34b3478076fdf1d Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-VolumesNegativeTest-325350324 Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/7de6f35c26234298a34b3478076fdf1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7de6f35c26234298a34b3478076fdf1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7de6f35c26234298a34b3478076fdf1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_7de6f35c26234298a34b3478076fdf1d", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-VolumesNegativeTest-325350324 Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 7de6f35c26234298a34b3478076fdf1d Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-VolumesNegativeTest-325350324 Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-VolumesNegativeTest-325350324-project Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: d4248f2ee7df4e1586cdb54bfd2963c6 Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-VolumesNegativeTest-325350324-project Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1432591848", "metadata": {"Type": "work"}}} Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1432591848', 'metadata': {'Type': 'work'}}}} Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise error Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi '0' Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 10 18:35:43.874593 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 10 18:35:43.884379 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 10 18:35:43.884379 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:35:43.884379 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:35:43.884379 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:35:43.884379 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:35:43.884379 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:35:43.884379 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:35:43.884379 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 10 18:35:43.884379 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 10 18:35:43.884379 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 10 18:35:43.884379 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:35:43.888668 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5344201b-bc96-4912-97d0-1242956eab23 tempest-VolumesNegativeTest-325350324 tempest-VolumesNegativeTest-325350324-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:35:43.889559 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5344201b-bc96-4912-97d0-1242956eab23 tempest-VolumesNegativeTest-325350324 tempest-VolumesNegativeTest-325350324-project] 10.222.0.35 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.037030 Jun 10 18:35:43.890153 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3307/6652] 10.222.0.35 () {60 vars in 1155 bytes} [Fri Jun 10 18:35:43 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 10 18:35:43.900110 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d3deed54-0181-4a9a-8b79-ddf39812a27f tempest-VolumesNegativeTest-325350324 tempest-VolumesNegativeTest-325350324-project] Action: 'create', calling method: .version_select at 0x7f77b3c24430>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1802504257", "metadata": {"Type": "work"}}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d3deed54-0181-4a9a-8b79-ddf39812a27f tempest-VolumesNegativeTest-325350324 tempest-VolumesNegativeTest-325350324-project] Request method failure captured: Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 119 Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio47_8VB-GGe3RaeDC9yG_setM2H44ibJhHNrQdR09Dfhy2kkbnsePW2-UecmIfs6_-9FCmN2HzXkN2rvjHih5-cgMiP2TfRMzK1wTuJzUEz-uZLH3VCNPGkliioIyyZG10J5gJYUSZRLRMN8z_go4JjXMieX9q4t-59C_m7gY6jGReo Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 7de6f35c26234298a34b3478076fdf1d Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-VolumesNegativeTest-325350324 Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/7de6f35c26234298a34b3478076fdf1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7de6f35c26234298a34b3478076fdf1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7de6f35c26234298a34b3478076fdf1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_7de6f35c26234298a34b3478076fdf1d", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-VolumesNegativeTest-325350324 Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 7de6f35c26234298a34b3478076fdf1d Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-VolumesNegativeTest-325350324 Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-VolumesNegativeTest-325350324-project Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: d4248f2ee7df4e1586cdb54bfd2963c6 Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-VolumesNegativeTest-325350324-project Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1802504257", "metadata": {"Type": "work"}}} Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1802504257', 'metadata': {'Type': 'work'}}}} Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise error Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi '' Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 10 18:35:43.902918 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 10 18:35:43.908883 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 10 18:35:43.908883 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:35:43.908883 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:35:43.908883 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:35:43.908883 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:35:43.908883 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:35:43.908883 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:35:43.908883 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 10 18:35:43.908883 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 10 18:35:43.908883 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 10 18:35:43.908883 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:35:43.908883 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d3deed54-0181-4a9a-8b79-ddf39812a27f tempest-VolumesNegativeTest-325350324 tempest-VolumesNegativeTest-325350324-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:35:43.908883 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d3deed54-0181-4a9a-8b79-ddf39812a27f tempest-VolumesNegativeTest-325350324 tempest-VolumesNegativeTest-325350324-project] 10.222.0.35 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008505 Jun 10 18:35:43.908883 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3346/6653] 10.222.0.35 () {60 vars in 1155 bytes} [Fri Jun 10 18:35:43 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 10 18:35:43.923072 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6efa958a-753a-4946-a2db-a42f90413969 tempest-VolumesNegativeTest-325350324 tempest-VolumesNegativeTest-325350324-project] Calling method '.version_select at 0x7f77c014cee0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:35:43.983147 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-6efa958a-753a-4946-a2db-a42f90413969 tempest-VolumesNegativeTest-325350324 tempest-VolumesNegativeTest-325350324-project] HTTP exception thrown: Volume tempest-invalid-637368194 could not be found. Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6efa958a-753a-4946-a2db-a42f90413969 tempest-VolumesNegativeTest-325350324 tempest-VolumesNegativeTest-325350324-project] Request method failure captured: Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-637368194 HTTP/1.1 Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio47_8VB-GGe3RaeDC9yG_setM2H44ibJhHNrQdR09Dfhy2kkbnsePW2-UecmIfs6_-9FCmN2HzXkN2rvjHih5-cgMiP2TfRMzK1wTuJzUEz-uZLH3VCNPGkliioIyyZG10J5gJYUSZRLRMN8z_go4JjXMieX9q4t-59C_m7gY6jGReo Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 7de6f35c26234298a34b3478076fdf1d Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-VolumesNegativeTest-325350324 Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/7de6f35c26234298a34b3478076fdf1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7de6f35c26234298a34b3478076fdf1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7de6f35c26234298a34b3478076fdf1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_7de6f35c26234298a34b3478076fdf1d", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-VolumesNegativeTest-325350324 Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 7de6f35c26234298a34b3478076fdf1d Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-VolumesNegativeTest-325350324 Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-VolumesNegativeTest-325350324-project Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: d4248f2ee7df4e1586cdb54bfd2963c6 Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-VolumesNegativeTest-325350324-project Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: exception: Volume tempest-invalid-637368194 could not be found. Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'tempest-invalid-637368194'} Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-637368194 could not be found. (HTTP 404) (Request-ID: req-e0af0d7c-b0d2-445a-ab4f-5792bf6a808c) Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 10 18:35:43.986050 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 10 18:35:43.989488 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 10 18:35:43.989488 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 10 18:35:43.989488 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 10 18:35:43.989488 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 10 18:35:43.989488 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 10 18:35:43.989488 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 10 18:35:43.989488 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 10 18:35:43.989488 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 10 18:35:43.989488 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 10 18:35:43.989488 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 10 18:35:43.989488 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 10 18:35:43.989488 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 10 18:35:43.989488 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-637368194 could not be found. Jun 10 18:35:43.989488 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:35:43.989488 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:35:43.989488 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:35:43.989488 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:35:43.989488 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:35:43.989488 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:35:43.989488 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:35:43.989488 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:35:43.989488 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:35:43.989488 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:35:43.989488 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:35:43.989488 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:35:43.989488 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 10 18:35:43.989488 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:35:43.989488 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-637368194 could not be found. Jun 10 18:35:43.989488 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:35:43.989488 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:35:43.989488 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:35:43.989488 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:35:43.989488 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:35:43.989488 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:35:43.989488 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:35:43.989488 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:35:43.989488 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-637368194 could not be found. Jun 10 18:35:43.989488 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:35:43.994618 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6efa958a-753a-4946-a2db-a42f90413969 tempest-VolumesNegativeTest-325350324 tempest-VolumesNegativeTest-325350324-project] Returning 404 to user: Volume tempest-invalid-637368194 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:35:43.996350 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6efa958a-753a-4946-a2db-a42f90413969 tempest-VolumesNegativeTest-325350324 tempest-VolumesNegativeTest-325350324-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/tempest-invalid-637368194" status: 404 len: 98 microversion: 2.1 time: 0.076691 Jun 10 18:35:44.000564 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3308/6654] 10.222.0.35 () {58 vars in 1214 bytes} [Fri Jun 10 18:35:43 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-637368194 => generated 98 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 10 18:35:44.007795 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-19d68f07-7d61-4248-a50c-9675575149eb tempest-VolumesNegativeTest-325350324 tempest-VolumesNegativeTest-325350324-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005408 Jun 10 18:35:44.012677 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3347/6655] 10.222.0.35 () {58 vars in 1139 bytes} [Fri Jun 10 18:35:44 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 10 18:35:44.020232 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d8ba0773-eaab-46eb-82bb-4f0e8d7f654d tempest-VolumesNegativeTest-325350324 tempest-VolumesNegativeTest-325350324-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005350 Jun 10 18:35:44.021101 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3309/6656] 10.222.0.35 () {58 vars in 1136 bytes} [Fri Jun 10 18:35:44 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 10 18:35:44.031259 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-26572de9-28bd-4e2b-9903-7745a52dcb11 tempest-VolumesNegativeTest-325350324 tempest-VolumesNegativeTest-325350324-project] Calling method '.version_select at 0x7f77b3c24ee0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:35:44.079063 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-26572de9-28bd-4e2b-9903-7745a52dcb11 tempest-VolumesNegativeTest-325350324 tempest-VolumesNegativeTest-325350324-project] HTTP exception thrown: Volume a77b263d-7e33-4b7a-91a3-e58fcc76a3d7 could not be found. Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-26572de9-28bd-4e2b-9903-7745a52dcb11 tempest-VolumesNegativeTest-325350324 tempest-VolumesNegativeTest-325350324-project] Request method failure captured: Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: request: DELETE /compute/v2.1/os-volumes/a77b263d-7e33-4b7a-91a3-e58fcc76a3d7 HTTP/1.1 Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio47_8VB-GGe3RaeDC9yG_setM2H44ibJhHNrQdR09Dfhy2kkbnsePW2-UecmIfs6_-9FCmN2HzXkN2rvjHih5-cgMiP2TfRMzK1wTuJzUEz-uZLH3VCNPGkliioIyyZG10J5gJYUSZRLRMN8z_go4JjXMieX9q4t-59C_m7gY6jGReo Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 7de6f35c26234298a34b3478076fdf1d Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-VolumesNegativeTest-325350324 Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/7de6f35c26234298a34b3478076fdf1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7de6f35c26234298a34b3478076fdf1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7de6f35c26234298a34b3478076fdf1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_7de6f35c26234298a34b3478076fdf1d", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-VolumesNegativeTest-325350324 Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 7de6f35c26234298a34b3478076fdf1d Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-VolumesNegativeTest-325350324 Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-VolumesNegativeTest-325350324-project Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: d4248f2ee7df4e1586cdb54bfd2963c6 Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-VolumesNegativeTest-325350324-project Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: method: Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: exception: Volume a77b263d-7e33-4b7a-91a3-e58fcc76a3d7 could not be found. Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'a77b263d-7e33-4b7a-91a3-e58fcc76a3d7'} Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a77b263d-7e33-4b7a-91a3-e58fcc76a3d7 could not be found. (HTTP 404) (Request-ID: req-072542cb-4e0b-477b-b980-dcb1066d68d6) Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 10 18:35:44.082598 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 10 18:35:44.086729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 10 18:35:44.086729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 10 18:35:44.086729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 10 18:35:44.086729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 10 18:35:44.086729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 10 18:35:44.086729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 10 18:35:44.086729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 10 18:35:44.086729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 10 18:35:44.086729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 10 18:35:44.086729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 10 18:35:44.086729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 10 18:35:44.086729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 10 18:35:44.086729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 10 18:35:44.086729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a77b263d-7e33-4b7a-91a3-e58fcc76a3d7 could not be found. Jun 10 18:35:44.086729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:35:44.086729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:35:44.086729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:35:44.086729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:35:44.086729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:35:44.086729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:35:44.086729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:35:44.086729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:35:44.086729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:35:44.086729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:35:44.086729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:35:44.086729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:35:44.086729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 10 18:35:44.086729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:35:44.086729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a77b263d-7e33-4b7a-91a3-e58fcc76a3d7 could not be found. Jun 10 18:35:44.086729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:35:44.086729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:35:44.086729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:35:44.086729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:35:44.086729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:35:44.086729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:35:44.086729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:35:44.086729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:35:44.086729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a77b263d-7e33-4b7a-91a3-e58fcc76a3d7 could not be found. Jun 10 18:35:44.086729 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:35:44.097196 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-26572de9-28bd-4e2b-9903-7745a52dcb11 tempest-VolumesNegativeTest-325350324 tempest-VolumesNegativeTest-325350324-project] Returning 404 to user: Volume a77b263d-7e33-4b7a-91a3-e58fcc76a3d7 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:35:44.097196 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-26572de9-28bd-4e2b-9903-7745a52dcb11 tempest-VolumesNegativeTest-325350324 tempest-VolumesNegativeTest-325350324-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/a77b263d-7e33-4b7a-91a3-e58fcc76a3d7" status: 404 len: 109 microversion: 2.1 time: 0.065382 Jun 10 18:35:44.097872 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3348/6657] 10.222.0.35 () {58 vars in 1247 bytes} [Fri Jun 10 18:35:44 2022] DELETE /compute/v2.1/os-volumes/a77b263d-7e33-4b7a-91a3-e58fcc76a3d7 => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:35:44.111120 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-318d528f-d355-4721-864c-175d80e283cc tempest-VolumesNegativeTest-325350324 tempest-VolumesNegativeTest-325350324-project] Calling method '.version_select at 0x7f77c051a0d0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:35:44.153402 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-318d528f-d355-4721-864c-175d80e283cc tempest-VolumesNegativeTest-325350324 tempest-VolumesNegativeTest-325350324-project] HTTP exception thrown: Volume ec0f630b-906d-4b03-a48c-686ffaaa60d5 could not be found. Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-318d528f-d355-4721-864c-175d80e283cc tempest-VolumesNegativeTest-325350324 tempest-VolumesNegativeTest-325350324-project] Request method failure captured: Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/os-volumes/ec0f630b-906d-4b03-a48c-686ffaaa60d5 HTTP/1.1 Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio47_8VB-GGe3RaeDC9yG_setM2H44ibJhHNrQdR09Dfhy2kkbnsePW2-UecmIfs6_-9FCmN2HzXkN2rvjHih5-cgMiP2TfRMzK1wTuJzUEz-uZLH3VCNPGkliioIyyZG10J5gJYUSZRLRMN8z_go4JjXMieX9q4t-59C_m7gY6jGReo Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 7de6f35c26234298a34b3478076fdf1d Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-VolumesNegativeTest-325350324 Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/7de6f35c26234298a34b3478076fdf1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7de6f35c26234298a34b3478076fdf1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7de6f35c26234298a34b3478076fdf1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_7de6f35c26234298a34b3478076fdf1d", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-VolumesNegativeTest-325350324 Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 7de6f35c26234298a34b3478076fdf1d Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-VolumesNegativeTest-325350324 Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-VolumesNegativeTest-325350324-project Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: d4248f2ee7df4e1586cdb54bfd2963c6 Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-VolumesNegativeTest-325350324-project Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: method: Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: exception: Volume ec0f630b-906d-4b03-a48c-686ffaaa60d5 could not be found. Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'ec0f630b-906d-4b03-a48c-686ffaaa60d5'} Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ec0f630b-906d-4b03-a48c-686ffaaa60d5 could not be found. (HTTP 404) (Request-ID: req-525a6889-9b4a-4acd-aa8d-f245dbc3da47) Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 10 18:35:44.156653 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 10 18:35:44.160352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 10 18:35:44.160352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 10 18:35:44.160352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 10 18:35:44.160352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 10 18:35:44.160352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 10 18:35:44.160352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 10 18:35:44.160352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 10 18:35:44.160352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 10 18:35:44.160352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 10 18:35:44.160352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 10 18:35:44.160352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 10 18:35:44.160352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 10 18:35:44.160352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 10 18:35:44.160352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ec0f630b-906d-4b03-a48c-686ffaaa60d5 could not be found. Jun 10 18:35:44.160352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:35:44.160352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:35:44.160352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:35:44.160352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:35:44.160352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:35:44.160352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:35:44.160352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:35:44.160352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:35:44.160352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 10 18:35:44.160352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 10 18:35:44.160352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:35:44.160352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:35:44.160352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 10 18:35:44.160352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:35:44.160352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ec0f630b-906d-4b03-a48c-686ffaaa60d5 could not be found. Jun 10 18:35:44.160352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:35:44.160352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:35:44.160352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:35:44.160352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:35:44.160352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:35:44.160352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:35:44.160352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:35:44.160352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:35:44.160352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ec0f630b-906d-4b03-a48c-686ffaaa60d5 could not be found. Jun 10 18:35:44.160352 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:35:44.160352 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-318d528f-d355-4721-864c-175d80e283cc tempest-VolumesNegativeTest-325350324 tempest-VolumesNegativeTest-325350324-project] Returning 404 to user: Volume ec0f630b-906d-4b03-a48c-686ffaaa60d5 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:35:44.160352 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-318d528f-d355-4721-864c-175d80e283cc tempest-VolumesNegativeTest-325350324 tempest-VolumesNegativeTest-325350324-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/ec0f630b-906d-4b03-a48c-686ffaaa60d5" status: 404 len: 109 microversion: 2.1 time: 0.060683 Jun 10 18:35:44.160352 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3310/6658] 10.222.0.35 () {58 vars in 1244 bytes} [Fri Jun 10 18:35:44 2022] GET /compute/v2.1/os-volumes/ec0f630b-906d-4b03-a48c-686ffaaa60d5 => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:35:45.716648 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d60c4c15-7189-4621-a283-81f003337ad7 tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:35:45.717248 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d60c4c15-7189-4621-a283-81f003337ad7 tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:35:45.728173 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d60c4c15-7189-4621-a283-81f003337ad7 tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:45.728658 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d60c4c15-7189-4621-a283-81f003337ad7 tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:45.729440 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d60c4c15-7189-4621-a283-81f003337ad7 tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:45.729882 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d60c4c15-7189-4621-a283-81f003337ad7 tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:45.926311 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d60c4c15-7189-4621-a283-81f003337ad7 tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1834 microversion: 2.1 time: 0.650965 Jun 10 18:35:45.941142 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3349/6659] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:35:45 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1834 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:35:47.863368 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9d358073-3783-494f-949a-d1eb6371afa1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:35:47.864005 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9d358073-3783-494f-949a-d1eb6371afa1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:35:47.878124 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-1ff4f5f6-32fb-454b-a93d-c2dc31d53a62 req-4eccfa4e-9466-4d35-ae86-4ee98a08c9e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22d96fe9-d755-452b-95a0-b0ce772fb72e", "tag": "ede2c1d8-e562-4758-9879-234ee389f99f"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:35:47.894531 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9d358073-3783-494f-949a-d1eb6371afa1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:47.896868 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-1ff4f5f6-32fb-454b-a93d-c2dc31d53a62 req-4eccfa4e-9466-4d35-ae86-4ee98a08c9e1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:47.897778 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-1ff4f5f6-32fb-454b-a93d-c2dc31d53a62 req-4eccfa4e-9466-4d35-ae86-4ee98a08c9e1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:47.899219 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9d358073-3783-494f-949a-d1eb6371afa1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:47.900800 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9d358073-3783-494f-949a-d1eb6371afa1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:47.901266 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9d358073-3783-494f-949a-d1eb6371afa1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:47.946209 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-1ff4f5f6-32fb-454b-a93d-c2dc31d53a62 req-4eccfa4e-9466-4d35-ae86-4ee98a08c9e1 service nova] Creating event network-changed:ede2c1d8-e562-4758-9879-234ee389f99f for instance 22d96fe9-d755-452b-95a0-b0ce772fb72e on chh1-master-2 Jun 10 18:35:47.961288 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-1ff4f5f6-32fb-454b-a93d-c2dc31d53a62 req-4eccfa4e-9466-4d35-ae86-4ee98a08c9e1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087635 Jun 10 18:35:47.964456 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3350/6660] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:35:47.979764 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9d358073-3783-494f-949a-d1eb6371afa1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:35:48.406012 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9d358073-3783-494f-949a-d1eb6371afa1 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "DELETE /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 204 len: 0 microversion: 2.1 time: 0.545225 Jun 10 18:35:48.409020 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3311/6661] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:35:47 2022] DELETE /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 0 bytes in 550 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:35:48.419003 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2e016f19-d832-4d0c-959d-746b6af291cb tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:35:48.420596 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2e016f19-d832-4d0c-959d-746b6af291cb tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:35:48.452773 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2e016f19-d832-4d0c-959d-746b6af291cb tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:48.453914 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2e016f19-d832-4d0c-959d-746b6af291cb tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:48.461175 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2e016f19-d832-4d0c-959d-746b6af291cb tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:48.461175 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2e016f19-d832-4d0c-959d-746b6af291cb tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:48.903762 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2e016f19-d832-4d0c-959d-746b6af291cb tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:35:48.912226 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2e016f19-d832-4d0c-959d-746b6af291cb tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1689 microversion: 2.1 time: 0.498917 Jun 10 18:35:48.917649 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3351/6662] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:35:48 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1689 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:35:49.937243 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6afd9d2b-133c-4da6-bc44-dc090f13050d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:35:49.938513 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6afd9d2b-133c-4da6-bc44-dc090f13050d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:35:49.956893 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6afd9d2b-133c-4da6-bc44-dc090f13050d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:49.957591 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6afd9d2b-133c-4da6-bc44-dc090f13050d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:49.960762 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6afd9d2b-133c-4da6-bc44-dc090f13050d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:49.961523 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6afd9d2b-133c-4da6-bc44-dc090f13050d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:51.065898 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6afd9d2b-133c-4da6-bc44-dc090f13050d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:35:51.077242 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6afd9d2b-133c-4da6-bc44-dc090f13050d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1689 microversion: 2.1 time: 1.145479 Jun 10 18:35:51.079926 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3312/6663] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:35:49 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1689 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:35:51.828269 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-9d56c12d-280c-457f-9216-1d5fd277820b req-6585bacf-9e4b-43ab-a190-d077e7be0b1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22d96fe9-d755-452b-95a0-b0ce772fb72e", "name": "network-vif-deleted", "tag": "ede2c1d8-e562-4758-9879-234ee389f99f"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:35:51.838314 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-9d56c12d-280c-457f-9216-1d5fd277820b req-6585bacf-9e4b-43ab-a190-d077e7be0b1b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:51.839098 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-9d56c12d-280c-457f-9216-1d5fd277820b req-6585bacf-9e4b-43ab-a190-d077e7be0b1b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:51.853235 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-9d56c12d-280c-457f-9216-1d5fd277820b req-6585bacf-9e4b-43ab-a190-d077e7be0b1b service nova] Creating event network-vif-deleted:ede2c1d8-e562-4758-9879-234ee389f99f for instance 22d96fe9-d755-452b-95a0-b0ce772fb72e on chh1-master-2 Jun 10 18:35:51.859032 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-9d56c12d-280c-457f-9216-1d5fd277820b req-6585bacf-9e4b-43ab-a190-d077e7be0b1b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035728 Jun 10 18:35:51.863914 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3352/6664] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:35:52.100998 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e8404f67-15a4-4df0-b289-38c79743a7d6 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:35:52.102923 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e8404f67-15a4-4df0-b289-38c79743a7d6 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:35:52.114213 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e8404f67-15a4-4df0-b289-38c79743a7d6 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:52.114669 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e8404f67-15a4-4df0-b289-38c79743a7d6 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:52.115620 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e8404f67-15a4-4df0-b289-38c79743a7d6 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:52.116228 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e8404f67-15a4-4df0-b289-38c79743a7d6 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:52.216782 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e8404f67-15a4-4df0-b289-38c79743a7d6 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:35:52.228770 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e8404f67-15a4-4df0-b289-38c79743a7d6 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 200 len: 1351 microversion: 2.1 time: 0.134506 Jun 10 18:35:52.230244 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3313/6665] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:35:52 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 1351 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:35:53.249585 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bea6e0b3-96eb-459e-9197-80c0c941cf06 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:35:53.250906 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bea6e0b3-96eb-459e-9197-80c0c941cf06 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 22d96fe9-d755-452b-95a0-b0ce772fb72e] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:35:53.261611 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bea6e0b3-96eb-459e-9197-80c0c941cf06 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:53.262382 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bea6e0b3-96eb-459e-9197-80c0c941cf06 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:53.264649 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bea6e0b3-96eb-459e-9197-80c0c941cf06 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:35:53.265238 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bea6e0b3-96eb-459e-9197-80c0c941cf06 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:35:53.289768 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-bea6e0b3-96eb-459e-9197-80c0c941cf06 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] HTTP exception thrown: Instance 22d96fe9-d755-452b-95a0-b0ce772fb72e could not be found. Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bea6e0b3-96eb-459e-9197-80c0c941cf06 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Request method failure captured: Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e HTTP/1.1 Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio43CIIZRNjb-0MeWb3vSViVXry-4quvMwA-hBljqKpiB6nnPbm4yr81WFzlQ2LY4R_BwzHI9K4qKlBZRuaAUhn7ebWvkqA-OmRlonhi_sWh_BF0eIBDo55Jeg8m_3Z24vWfOlNkH5Uyaf3Vs_VtyXvkIne8zHY4JCWnu-w0Ien9U850 Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 4089a2104afe4f1ab69f1b7983e4735d Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-88591049 Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/4089a2104afe4f1ab69f1b7983e4735d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/4089a2104afe4f1ab69f1b7983e4735d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/4089a2104afe4f1ab69f1b7983e4735d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_4089a2104afe4f1ab69f1b7983e4735d", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-TestNetworkAdvancedServerOps-88591049 Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 4089a2104afe4f1ab69f1b7983e4735d Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-88591049 Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-TestNetworkAdvancedServerOps-88591049-project Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 9d5fe9478d2b47e3b87cecc86d40773c Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-TestNetworkAdvancedServerOps-88591049-project Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 22d96fe9-d755-452b-95a0-b0ce772fb72e could not be found. Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '22d96fe9-d755-452b-95a0-b0ce772fb72e'} Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22d96fe9-d755-452b-95a0-b0ce772fb72e could not be found. Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22d96fe9-d755-452b-95a0-b0ce772fb72e could not be found. Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:35:53.296654 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:35:53.303903 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:35:53.303903 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:35:53.303903 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:35:53.303903 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:35:53.303903 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:35:53.303903 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22d96fe9-d755-452b-95a0-b0ce772fb72e could not be found. Jun 10 18:35:53.303903 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:35:53.303903 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bea6e0b3-96eb-459e-9197-80c0c941cf06 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Returning 404 to user: Instance 22d96fe9-d755-452b-95a0-b0ce772fb72e could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:35:53.303903 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bea6e0b3-96eb-459e-9197-80c0c941cf06 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e" status: 404 len: 111 microversion: 2.1 time: 0.055105 Jun 10 18:35:53.303903 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3353/6666] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:35:53 2022] GET /compute/v2.1/servers/22d96fe9-d755-452b-95a0-b0ce772fb72e => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:35:59.458048 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e0ffbeb0-2bcd-4ad7-b79a-f09537b0f2a0 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '.version_select at 0x7f77c617a0d0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:35:59.574545 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e0ffbeb0-2bcd-4ad7-b79a-f09537b0f2a0 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1513264815" status: 202 len: 0 microversion: 2.1 time: 0.120787 Jun 10 18:35:59.576751 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3314/6667] 10.222.0.35 () {58 vars in 1283 bytes} [Fri Jun 10 18:35:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1513264815 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:35:59.619482 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d3d7a6a2-29c9-42ef-9d8e-fca8d928dfca tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Action: 'create', calling method: .version_select at 0x7f77b3f9e550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-679419336", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfVlvrHT1ftGoDLcUdypiTn4kgPfQcl9URpAFO2+PzsuWXZPWr8QHEILpPCiGNElxSYrko9Fcuvu5ceQx+flAREck4tFo0AA8yKdiY/39VOFXOKo0Ill9FXFAbWXIgpwA=="}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:35:59.640047 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-d3d7a6a2-29c9-42ef-9d8e-fca8d928dfca tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Getting quotas for project 4089a2104afe4f1ab69f1b7983e4735d. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:35:59.646697 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-d3d7a6a2-29c9-42ef-9d8e-fca8d928dfca tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Getting quotas for user 9d5fe9478d2b47e3b87cecc86d40773c and project 4089a2104afe4f1ab69f1b7983e4735d. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:35:59.783725 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d3d7a6a2-29c9-42ef-9d8e-fca8d928dfca tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.169393 Jun 10 18:35:59.793879 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3354/6668] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 18:35:59 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:36:15.892422 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5c24ea6b-6828-4d77-b039-b3f205a0e898 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2067126143", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "8152fc43-6468-4dbc-b696-b619c6393e96"}], "key_name": "tempest-TestNetworkAdvancedServerOps-679419336", "security_groups": [{"name": "tempest-secgroup-smoke-859092633"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:36:15.923104 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:36:15.933775 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:36:16.450422 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-5c24ea6b-6828-4d77-b039-b3f205a0e898 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] validate_networks() for [('8152fc43-6468-4dbc-b696-b619c6393e96', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:36:17.742233 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=18 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:36:17.743879 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=4 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:36:17.749278 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:36:18.167963 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a02c4e1b-d05a-48f3-b774-c7f09e57402c tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Action: 'create', calling method: .version_select at 0x7f77b3f9e940>, body: {"keypair": {"name": "tempest-TestServerBasicOps-311876162", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPACSG5zuw9GJC2VoLC3wDgD+BstYTD0FJocrkdtNKHRp2WJb6Q5uOmedYx1KmI/cRlf6fObjMGRdZN1z6QmtdkZjLUrxBMeJDkFZqsP4sFbVFlLkef6QQGkULv7wkuKTA=="}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:36:18.189398 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-a02c4e1b-d05a-48f3-b774-c7f09e57402c tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Getting quotas for project 2e434b726f40467597916ecbcbc9b0fe. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:36:18.197446 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-a02c4e1b-d05a-48f3-b774-c7f09e57402c tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Getting quotas for user 00ca75cda41e44918bea52f718e316fa and project 2e434b726f40467597916ecbcbc9b0fe. Resources: {'key_pairs'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:36:18.299630 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a02c4e1b-d05a-48f3-b774-c7f09e57402c tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.573449 Jun 10 18:36:18.318140 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3355/6669] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 18:36:17 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:36:18.440956 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-5c24ea6b-6828-4d77-b039-b3f205a0e898 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:36:18.441418 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-5c24ea6b-6828-4d77-b039-b3f205a0e898 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:36:18.441875 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-5c24ea6b-6828-4d77-b039-b3f205a0e898 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:36:18.442290 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-5c24ea6b-6828-4d77-b039-b3f205a0e898 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:36:18.442879 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-5c24ea6b-6828-4d77-b039-b3f205a0e898 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:36:18.455468 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5c24ea6b-6828-4d77-b039-b3f205a0e898 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:18.457850 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5c24ea6b-6828-4d77-b039-b3f205a0e898 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:18.458950 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5c24ea6b-6828-4d77-b039-b3f205a0e898 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:18.459661 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5c24ea6b-6828-4d77-b039-b3f205a0e898 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:18.486493 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-5c24ea6b-6828-4d77-b039-b3f205a0e898 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Getting quotas for project 4089a2104afe4f1ab69f1b7983e4735d. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:36:18.492954 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-5c24ea6b-6828-4d77-b039-b3f205a0e898 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Getting quotas for user 9d5fe9478d2b47e3b87cecc86d40773c and project 4089a2104afe4f1ab69f1b7983e4735d. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:36:18.507343 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5c24ea6b-6828-4d77-b039-b3f205a0e898 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:36:18.510051 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5c24ea6b-6828-4d77-b039-b3f205a0e898 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 483bd251-8106-439e-83d7-d7209125bbe7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:36:18.671711 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5c24ea6b-6828-4d77-b039-b3f205a0e898 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.783115 Jun 10 18:36:18.674207 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3315/6670] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:36:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 2787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:36:18.684709 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0e18ddfa-5acb-4d3b-b3e1-539cb6375a50 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:18.685674 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0e18ddfa-5acb-4d3b-b3e1-539cb6375a50 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 483bd251-8106-439e-83d7-d7209125bbe7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:18.796408 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0e18ddfa-5acb-4d3b-b3e1-539cb6375a50 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:18.809260 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0e18ddfa-5acb-4d3b-b3e1-539cb6375a50 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7" status: 200 len: 1266 microversion: 2.1 time: 0.124892 Jun 10 18:36:18.813783 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3356/6671] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:18 2022] GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7 => generated 1266 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:36:19.830531 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6343c6d4-e93f-4f7f-b579-b5e26608fec6 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:19.831551 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6343c6d4-e93f-4f7f-b579-b5e26608fec6 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 483bd251-8106-439e-83d7-d7209125bbe7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:20.344680 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6343c6d4-e93f-4f7f-b579-b5e26608fec6 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:20.355091 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6343c6d4-e93f-4f7f-b579-b5e26608fec6 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7" status: 200 len: 1266 microversion: 2.1 time: 0.530318 Jun 10 18:36:20.365603 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3316/6672] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:19 2022] GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7 => generated 1266 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:36:21.374335 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fcf41e8d-02b5-4764-883d-cdce1da45428 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:21.375143 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fcf41e8d-02b5-4764-883d-cdce1da45428 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 483bd251-8106-439e-83d7-d7209125bbe7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:21.392203 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fcf41e8d-02b5-4764-883d-cdce1da45428 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:21.394443 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fcf41e8d-02b5-4764-883d-cdce1da45428 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:21.398588 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fcf41e8d-02b5-4764-883d-cdce1da45428 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:21.408015 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fcf41e8d-02b5-4764-883d-cdce1da45428 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:21.568970 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fcf41e8d-02b5-4764-883d-cdce1da45428 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:21.583995 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fcf41e8d-02b5-4764-883d-cdce1da45428 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7" status: 200 len: 1318 microversion: 2.1 time: 0.213904 Jun 10 18:36:21.585127 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3357/6673] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:21 2022] GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7 => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:36:22.602167 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2576d023-7954-4d4c-b562-bdcbb0bb4217 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:22.602951 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2576d023-7954-4d4c-b562-bdcbb0bb4217 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 483bd251-8106-439e-83d7-d7209125bbe7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:22.614193 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2576d023-7954-4d4c-b562-bdcbb0bb4217 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:22.617739 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2576d023-7954-4d4c-b562-bdcbb0bb4217 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:22.618676 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2576d023-7954-4d4c-b562-bdcbb0bb4217 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:22.621153 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2576d023-7954-4d4c-b562-bdcbb0bb4217 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:22.759153 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2576d023-7954-4d4c-b562-bdcbb0bb4217 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:22.768346 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2576d023-7954-4d4c-b562-bdcbb0bb4217 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7" status: 200 len: 1324 microversion: 2.1 time: 0.170798 Jun 10 18:36:22.773346 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3317/6674] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:22 2022] GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7 => generated 1324 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:36:23.074162 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-46848140-9c39-495f-bcc0-5f40a83a33fa tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-699111159", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-311876162", "security_groups": [{"name": "tempest-secgroup-smoke-222294315"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "97e1c17e-ec8c-4815-86fd-be50eb2748c8"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:36:23.370802 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-46848140-9c39-495f-bcc0-5f40a83a33fa tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] validate_networks() for [('97e1c17e-ec8c-4815-86fd-be50eb2748c8', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:36:23.801652 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5c8c1412-2820-4187-9e64-44c91d7ccda2 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:23.803578 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5c8c1412-2820-4187-9e64-44c91d7ccda2 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 483bd251-8106-439e-83d7-d7209125bbe7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:23.847784 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5c8c1412-2820-4187-9e64-44c91d7ccda2 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:23.849282 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5c8c1412-2820-4187-9e64-44c91d7ccda2 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:23.852123 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5c8c1412-2820-4187-9e64-44c91d7ccda2 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:23.852668 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5c8c1412-2820-4187-9e64-44c91d7ccda2 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:24.088021 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5c8c1412-2820-4187-9e64-44c91d7ccda2 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:24.105442 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5c8c1412-2820-4187-9e64-44c91d7ccda2 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7" status: 200 len: 1324 microversion: 2.1 time: 0.318871 Jun 10 18:36:24.118826 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3318/6675] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:23 2022] GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7 => generated 1324 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:36:24.997775 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-46848140-9c39-495f-bcc0-5f40a83a33fa tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Getting quotas for project 2e434b726f40467597916ecbcbc9b0fe. Resources: dict_keys(['metadata_items']) {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:36:25.007721 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-46848140-9c39-495f-bcc0-5f40a83a33fa tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Getting quotas for user 00ca75cda41e44918bea52f718e316fa and project 2e434b726f40467597916ecbcbc9b0fe. Resources: dict_keys(['metadata_items']) {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:36:25.062525 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-46848140-9c39-495f-bcc0-5f40a83a33fa tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:36:25.063143 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-46848140-9c39-495f-bcc0-5f40a83a33fa tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:36:25.063761 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-46848140-9c39-495f-bcc0-5f40a83a33fa tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:36:25.066902 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-46848140-9c39-495f-bcc0-5f40a83a33fa tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:36:25.067599 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-46848140-9c39-495f-bcc0-5f40a83a33fa tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:36:25.098133 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-46848140-9c39-495f-bcc0-5f40a83a33fa tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:25.098776 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-46848140-9c39-495f-bcc0-5f40a83a33fa tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:25.099587 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-46848140-9c39-495f-bcc0-5f40a83a33fa tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:25.104087 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-46848140-9c39-495f-bcc0-5f40a83a33fa tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:25.126509 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-65968e98-98d6-42ca-a30a-4aa3b98c29aa tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:25.127995 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-65968e98-98d6-42ca-a30a-4aa3b98c29aa tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 483bd251-8106-439e-83d7-d7209125bbe7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:25.146818 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-65968e98-98d6-42ca-a30a-4aa3b98c29aa tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:25.153669 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-65968e98-98d6-42ca-a30a-4aa3b98c29aa tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:25.165462 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-65968e98-98d6-42ca-a30a-4aa3b98c29aa tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:25.166039 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-65968e98-98d6-42ca-a30a-4aa3b98c29aa tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:25.174578 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-46848140-9c39-495f-bcc0-5f40a83a33fa tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Getting quotas for project 2e434b726f40467597916ecbcbc9b0fe. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:36:25.191816 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-46848140-9c39-495f-bcc0-5f40a83a33fa tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Getting quotas for user 00ca75cda41e44918bea52f718e316fa and project 2e434b726f40467597916ecbcbc9b0fe. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:36:25.221180 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-46848140-9c39-495f-bcc0-5f40a83a33fa tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:36:25.226241 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-46848140-9c39-495f-bcc0-5f40a83a33fa tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] [instance: 7408ba2e-3085-49c7-af8e-b66aee17b1c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:36:25.431145 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-46848140-9c39-495f-bcc0-5f40a83a33fa tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.361367 Jun 10 18:36:25.434212 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3358/6676] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:36:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 2365 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:36:25.449448 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6c8b83ed-2c58-47f2-aabf-a32c227261a7 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:25.449970 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6c8b83ed-2c58-47f2-aabf-a32c227261a7 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] [instance: 7408ba2e-3085-49c7-af8e-b66aee17b1c5] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:25.575939 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6c8b83ed-2c58-47f2-aabf-a32c227261a7 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ca75cda41e44918bea52f718e316fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e434b726f40467597916ecbcbc9b0fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:25.587300 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6c8b83ed-2c58-47f2-aabf-a32c227261a7 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] 10.222.0.35 "GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5" status: 200 len: 1301 microversion: 2.1 time: 0.146886 Jun 10 18:36:25.589164 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3359/6677] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:25 2022] GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5 => generated 1301 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:36:25.829211 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-65968e98-98d6-42ca-a30a-4aa3b98c29aa tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:25.842532 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-65968e98-98d6-42ca-a30a-4aa3b98c29aa tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7" status: 200 len: 1391 microversion: 2.1 time: 0.718868 Jun 10 18:36:25.844872 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3319/6678] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:25 2022] GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7 => generated 1391 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:36:26.607690 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-810b4635-5899-4640-a13c-3bd0dd8723b9 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:26.608527 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-810b4635-5899-4640-a13c-3bd0dd8723b9 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] [instance: 7408ba2e-3085-49c7-af8e-b66aee17b1c5] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:26.761539 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-810b4635-5899-4640-a13c-3bd0dd8723b9 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ca75cda41e44918bea52f718e316fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e434b726f40467597916ecbcbc9b0fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:26.771414 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-810b4635-5899-4640-a13c-3bd0dd8723b9 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] 10.222.0.35 "GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5" status: 200 len: 1301 microversion: 2.1 time: 0.169751 Jun 10 18:36:26.781142 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3360/6679] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:26 2022] GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5 => generated 1301 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:36:26.861900 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-954e663a-96c6-4c5b-8212-d45435948a75 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:26.862516 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-954e663a-96c6-4c5b-8212-d45435948a75 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 483bd251-8106-439e-83d7-d7209125bbe7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:26.871396 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-954e663a-96c6-4c5b-8212-d45435948a75 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:26.871868 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-954e663a-96c6-4c5b-8212-d45435948a75 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:26.873323 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-954e663a-96c6-4c5b-8212-d45435948a75 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:26.874550 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-954e663a-96c6-4c5b-8212-d45435948a75 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:27.087776 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-29dc593d-7a8e-4a4d-af22-383d9e792428 req-769c52a2-7f37-402c-a042-93f8f92f226c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "483bd251-8106-439e-83d7-d7209125bbe7", "tag": "ac70d592-697b-4f64-add0-1e44e2815260"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:36:27.131481 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-29dc593d-7a8e-4a4d-af22-383d9e792428 req-769c52a2-7f37-402c-a042-93f8f92f226c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:27.131975 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-29dc593d-7a8e-4a4d-af22-383d9e792428 req-769c52a2-7f37-402c-a042-93f8f92f226c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:27.162383 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-29dc593d-7a8e-4a4d-af22-383d9e792428 req-769c52a2-7f37-402c-a042-93f8f92f226c service nova] Creating event network-changed:ac70d592-697b-4f64-add0-1e44e2815260 for instance 483bd251-8106-439e-83d7-d7209125bbe7 on chh1-master-2 Jun 10 18:36:27.174031 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-29dc593d-7a8e-4a4d-af22-383d9e792428 req-769c52a2-7f37-402c-a042-93f8f92f226c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089940 Jun 10 18:36:27.175315 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3361/6680] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:36:27.228347 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-954e663a-96c6-4c5b-8212-d45435948a75 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:27.253475 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-954e663a-96c6-4c5b-8212-d45435948a75 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7" status: 200 len: 1391 microversion: 2.1 time: 0.395378 Jun 10 18:36:27.255256 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3320/6681] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:26 2022] GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7 => generated 1391 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:36:27.796027 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e4aa2436-d214-4fa3-bc3d-4625707e38e0 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:27.798361 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e4aa2436-d214-4fa3-bc3d-4625707e38e0 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] [instance: 7408ba2e-3085-49c7-af8e-b66aee17b1c5] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:27.830010 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e4aa2436-d214-4fa3-bc3d-4625707e38e0 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:27.834872 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e4aa2436-d214-4fa3-bc3d-4625707e38e0 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:27.840042 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e4aa2436-d214-4fa3-bc3d-4625707e38e0 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:27.842200 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e4aa2436-d214-4fa3-bc3d-4625707e38e0 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:28.014790 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e4aa2436-d214-4fa3-bc3d-4625707e38e0 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ca75cda41e44918bea52f718e316fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e434b726f40467597916ecbcbc9b0fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:28.025956 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e4aa2436-d214-4fa3-bc3d-4625707e38e0 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] 10.222.0.35 "GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5" status: 200 len: 1353 microversion: 2.1 time: 0.239332 Jun 10 18:36:28.028218 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3362/6682] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:27 2022] GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5 => generated 1353 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:36:28.275189 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-24eea69f-354d-4d8b-bce3-e0bd39f2b881 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:28.275814 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-24eea69f-354d-4d8b-bce3-e0bd39f2b881 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 483bd251-8106-439e-83d7-d7209125bbe7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:28.287647 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-24eea69f-354d-4d8b-bce3-e0bd39f2b881 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:28.288109 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-24eea69f-354d-4d8b-bce3-e0bd39f2b881 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:28.288932 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-24eea69f-354d-4d8b-bce3-e0bd39f2b881 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:28.289379 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-24eea69f-354d-4d8b-bce3-e0bd39f2b881 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:28.474788 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:36:28.936897 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-24eea69f-354d-4d8b-bce3-e0bd39f2b881 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:28.957562 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-24eea69f-354d-4d8b-bce3-e0bd39f2b881 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7" status: 200 len: 1391 microversion: 2.1 time: 0.689171 Jun 10 18:36:28.959514 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3321/6683] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:28 2022] GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7 => generated 1391 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:36:29.045890 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1b1eccfb-4fa2-44c5-a3ab-e117340f9bb6 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:29.046401 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1b1eccfb-4fa2-44c5-a3ab-e117340f9bb6 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] [instance: 7408ba2e-3085-49c7-af8e-b66aee17b1c5] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:29.055219 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1b1eccfb-4fa2-44c5-a3ab-e117340f9bb6 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:29.055924 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1b1eccfb-4fa2-44c5-a3ab-e117340f9bb6 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:29.056897 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1b1eccfb-4fa2-44c5-a3ab-e117340f9bb6 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:29.057524 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1b1eccfb-4fa2-44c5-a3ab-e117340f9bb6 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:29.193961 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1b1eccfb-4fa2-44c5-a3ab-e117340f9bb6 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ca75cda41e44918bea52f718e316fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e434b726f40467597916ecbcbc9b0fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:29.204136 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1b1eccfb-4fa2-44c5-a3ab-e117340f9bb6 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] 10.222.0.35 "GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5" status: 200 len: 1371 microversion: 2.1 time: 0.164034 Jun 10 18:36:29.214469 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3363/6684] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:29 2022] GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5 => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:36:29.976084 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1f0dbdf9-5af4-41ea-a120-0157b84e90a2 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:29.977590 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1f0dbdf9-5af4-41ea-a120-0157b84e90a2 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 483bd251-8106-439e-83d7-d7209125bbe7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:29.989527 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f0dbdf9-5af4-41ea-a120-0157b84e90a2 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:29.990124 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f0dbdf9-5af4-41ea-a120-0157b84e90a2 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:29.990994 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f0dbdf9-5af4-41ea-a120-0157b84e90a2 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:29.991536 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f0dbdf9-5af4-41ea-a120-0157b84e90a2 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:30.221669 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9cbbbf66-d1b4-4bdb-810a-9cd26ea03919 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:30.223066 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9cbbbf66-d1b4-4bdb-810a-9cd26ea03919 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] [instance: 7408ba2e-3085-49c7-af8e-b66aee17b1c5] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:30.245823 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9cbbbf66-d1b4-4bdb-810a-9cd26ea03919 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:30.246565 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9cbbbf66-d1b4-4bdb-810a-9cd26ea03919 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:30.248190 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9cbbbf66-d1b4-4bdb-810a-9cd26ea03919 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:30.252735 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9cbbbf66-d1b4-4bdb-810a-9cd26ea03919 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:30.274182 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1f0dbdf9-5af4-41ea-a120-0157b84e90a2 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:30.283943 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1f0dbdf9-5af4-41ea-a120-0157b84e90a2 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7" status: 200 len: 1391 microversion: 2.1 time: 0.312367 Jun 10 18:36:30.290773 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3322/6685] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:29 2022] GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7 => generated 1391 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:36:30.883379 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9cbbbf66-d1b4-4bdb-810a-9cd26ea03919 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ca75cda41e44918bea52f718e316fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e434b726f40467597916ecbcbc9b0fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:30.920416 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9cbbbf66-d1b4-4bdb-810a-9cd26ea03919 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] 10.222.0.35 "GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5" status: 200 len: 1426 microversion: 2.1 time: 0.699312 Jun 10 18:36:30.921635 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3364/6686] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:30 2022] GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5 => generated 1426 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:36:31.307311 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-92a0d630-0032-45e9-b733-2c972dd21319 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:31.308909 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-92a0d630-0032-45e9-b733-2c972dd21319 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 483bd251-8106-439e-83d7-d7209125bbe7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:31.311481 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=8 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:36:31.322430 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-92a0d630-0032-45e9-b733-2c972dd21319 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:31.323413 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-92a0d630-0032-45e9-b733-2c972dd21319 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:31.325030 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-92a0d630-0032-45e9-b733-2c972dd21319 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:31.326366 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-92a0d630-0032-45e9-b733-2c972dd21319 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:31.692234 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-92a0d630-0032-45e9-b733-2c972dd21319 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:31.701376 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-92a0d630-0032-45e9-b733-2c972dd21319 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7" status: 200 len: 1391 microversion: 2.1 time: 0.398155 Jun 10 18:36:31.706656 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3323/6687] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:31 2022] GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7 => generated 1391 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:36:31.947358 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c5b5f295-1364-4e7e-92e0-0902655673c6 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:31.948624 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c5b5f295-1364-4e7e-92e0-0902655673c6 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] [instance: 7408ba2e-3085-49c7-af8e-b66aee17b1c5] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:31.961425 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5b5f295-1364-4e7e-92e0-0902655673c6 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:31.961943 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5b5f295-1364-4e7e-92e0-0902655673c6 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:31.964773 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5b5f295-1364-4e7e-92e0-0902655673c6 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:31.965306 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c5b5f295-1364-4e7e-92e0-0902655673c6 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:32.256976 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c5b5f295-1364-4e7e-92e0-0902655673c6 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ca75cda41e44918bea52f718e316fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e434b726f40467597916ecbcbc9b0fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:32.265020 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c5b5f295-1364-4e7e-92e0-0902655673c6 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] 10.222.0.35 "GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5" status: 200 len: 1426 microversion: 2.1 time: 0.329735 Jun 10 18:36:32.265620 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3365/6688] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:31 2022] GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5 => generated 1426 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:36:32.701195 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-67f13af6-457f-482f-8c97-2800dd0cfe87 req-db1055db-08fd-43a7-bc89-3f1b286c408a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "483bd251-8106-439e-83d7-d7209125bbe7", "name": "network-vif-plugged", "status": "completed", "tag": "ac70d592-697b-4f64-add0-1e44e2815260"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:36:32.724961 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-67f13af6-457f-482f-8c97-2800dd0cfe87 req-db1055db-08fd-43a7-bc89-3f1b286c408a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:32.728255 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-67f13af6-457f-482f-8c97-2800dd0cfe87 req-db1055db-08fd-43a7-bc89-3f1b286c408a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:32.766568 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-67f13af6-457f-482f-8c97-2800dd0cfe87 req-db1055db-08fd-43a7-bc89-3f1b286c408a service nova] Creating event network-vif-plugged:ac70d592-697b-4f64-add0-1e44e2815260 for instance 483bd251-8106-439e-83d7-d7209125bbe7 on chh1-master-2 Jun 10 18:36:32.785651 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-67f13af6-457f-482f-8c97-2800dd0cfe87 req-db1055db-08fd-43a7-bc89-3f1b286c408a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089049 Jun 10 18:36:32.804053 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3366/6689] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:36:32.850143 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f60ca859-782c-461c-bddb-bbdc647c4378 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:32.852683 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f60ca859-782c-461c-bddb-bbdc647c4378 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 483bd251-8106-439e-83d7-d7209125bbe7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:32.880209 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f60ca859-782c-461c-bddb-bbdc647c4378 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:32.881142 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f60ca859-782c-461c-bddb-bbdc647c4378 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:32.884747 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f60ca859-782c-461c-bddb-bbdc647c4378 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:32.885324 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f60ca859-782c-461c-bddb-bbdc647c4378 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:32.889596 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-3d40706e-f92d-45b9-889e-1c099dcf4803 req-d0f8f310-dbea-4e1f-a688-b5435f6c7ff5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7408ba2e-3085-49c7-af8e-b66aee17b1c5", "tag": "6680d55a-5c20-4dcd-94bb-67d83b336345"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:36:32.912000 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-3d40706e-f92d-45b9-889e-1c099dcf4803 req-d0f8f310-dbea-4e1f-a688-b5435f6c7ff5 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:32.913944 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-3d40706e-f92d-45b9-889e-1c099dcf4803 req-d0f8f310-dbea-4e1f-a688-b5435f6c7ff5 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:32.943446 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-3d40706e-f92d-45b9-889e-1c099dcf4803 req-d0f8f310-dbea-4e1f-a688-b5435f6c7ff5 service nova] Creating event network-changed:6680d55a-5c20-4dcd-94bb-67d83b336345 for instance 7408ba2e-3085-49c7-af8e-b66aee17b1c5 on chh2-master-2 Jun 10 18:36:32.950945 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-3d40706e-f92d-45b9-889e-1c099dcf4803 req-d0f8f310-dbea-4e1f-a688-b5435f6c7ff5 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.549820 Jun 10 18:36:32.953667 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3324/6690] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:36:33.282559 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ad7702ee-17f5-4496-ba6e-32cd1cbb03f1 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:33.283825 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ad7702ee-17f5-4496-ba6e-32cd1cbb03f1 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] [instance: 7408ba2e-3085-49c7-af8e-b66aee17b1c5] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:33.297143 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad7702ee-17f5-4496-ba6e-32cd1cbb03f1 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:33.299932 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad7702ee-17f5-4496-ba6e-32cd1cbb03f1 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:33.299932 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad7702ee-17f5-4496-ba6e-32cd1cbb03f1 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:33.299932 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad7702ee-17f5-4496-ba6e-32cd1cbb03f1 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:33.349100 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f60ca859-782c-461c-bddb-bbdc647c4378 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:33.364525 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f60ca859-782c-461c-bddb-bbdc647c4378 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7" status: 200 len: 1391 microversion: 2.1 time: 0.550661 Jun 10 18:36:33.366375 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3367/6691] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:32 2022] GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7 => generated 1391 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:36:33.666514 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ad7702ee-17f5-4496-ba6e-32cd1cbb03f1 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ca75cda41e44918bea52f718e316fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e434b726f40467597916ecbcbc9b0fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:33.676119 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ad7702ee-17f5-4496-ba6e-32cd1cbb03f1 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] 10.222.0.35 "GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5" status: 200 len: 1426 microversion: 2.1 time: 0.398748 Jun 10 18:36:33.676829 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3325/6692] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:33 2022] GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5 => generated 1426 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:36:34.389710 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e42c451d-47d5-454a-8a33-772c4fd17188 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:34.393590 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e42c451d-47d5-454a-8a33-772c4fd17188 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 483bd251-8106-439e-83d7-d7209125bbe7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:34.399223 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e42c451d-47d5-454a-8a33-772c4fd17188 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:34.401047 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e42c451d-47d5-454a-8a33-772c4fd17188 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:34.401853 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e42c451d-47d5-454a-8a33-772c4fd17188 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:34.402465 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e42c451d-47d5-454a-8a33-772c4fd17188 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:34.658292 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e42c451d-47d5-454a-8a33-772c4fd17188 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:34.667867 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e42c451d-47d5-454a-8a33-772c4fd17188 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7" status: 200 len: 1391 microversion: 2.1 time: 0.289209 Jun 10 18:36:34.673880 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3368/6693] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:34 2022] GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7 => generated 1391 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:36:34.696166 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4536a4b0-143f-4b7e-95e1-5cb1d18ef932 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:34.697263 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4536a4b0-143f-4b7e-95e1-5cb1d18ef932 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] [instance: 7408ba2e-3085-49c7-af8e-b66aee17b1c5] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:34.723190 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4536a4b0-143f-4b7e-95e1-5cb1d18ef932 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:34.723574 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4536a4b0-143f-4b7e-95e1-5cb1d18ef932 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:34.724539 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4536a4b0-143f-4b7e-95e1-5cb1d18ef932 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:34.724962 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4536a4b0-143f-4b7e-95e1-5cb1d18ef932 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:34.932097 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4536a4b0-143f-4b7e-95e1-5cb1d18ef932 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ca75cda41e44918bea52f718e316fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e434b726f40467597916ecbcbc9b0fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:34.940609 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4536a4b0-143f-4b7e-95e1-5cb1d18ef932 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] 10.222.0.35 "GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5" status: 200 len: 1426 microversion: 2.1 time: 0.249519 Jun 10 18:36:34.941212 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3326/6694] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:34 2022] GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5 => generated 1426 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:36:35.685888 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-28e8fb2b-1ca1-49cc-8175-7ae7e6758c1b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:35.686508 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-28e8fb2b-1ca1-49cc-8175-7ae7e6758c1b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 483bd251-8106-439e-83d7-d7209125bbe7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:35.688550 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:36:35.695022 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-28e8fb2b-1ca1-49cc-8175-7ae7e6758c1b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:35.695520 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-28e8fb2b-1ca1-49cc-8175-7ae7e6758c1b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:35.696259 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-28e8fb2b-1ca1-49cc-8175-7ae7e6758c1b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:35.697064 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-28e8fb2b-1ca1-49cc-8175-7ae7e6758c1b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:35.947733 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-28e8fb2b-1ca1-49cc-8175-7ae7e6758c1b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:35.959209 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c69a3efb-089e-4d2b-aa8d-6652d0eb5154 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:35.960708 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-28e8fb2b-1ca1-49cc-8175-7ae7e6758c1b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7" status: 200 len: 1562 microversion: 2.1 time: 0.279544 Jun 10 18:36:35.961017 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c69a3efb-089e-4d2b-aa8d-6652d0eb5154 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] [instance: 7408ba2e-3085-49c7-af8e-b66aee17b1c5] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:35.961639 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3369/6695] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:35 2022] GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7 => generated 1562 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:36:35.969706 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c69a3efb-089e-4d2b-aa8d-6652d0eb5154 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:35.970713 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c69a3efb-089e-4d2b-aa8d-6652d0eb5154 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:35.972188 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c69a3efb-089e-4d2b-aa8d-6652d0eb5154 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:35.975492 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c69a3efb-089e-4d2b-aa8d-6652d0eb5154 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:35.994242 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a8b209c7-bfbd-4e42-8b19-86a61343c27a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:35.995729 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a8b209c7-bfbd-4e42-8b19-86a61343c27a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 483bd251-8106-439e-83d7-d7209125bbe7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:36.011588 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a8b209c7-bfbd-4e42-8b19-86a61343c27a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:36.012080 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a8b209c7-bfbd-4e42-8b19-86a61343c27a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:36.013947 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a8b209c7-bfbd-4e42-8b19-86a61343c27a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:36.014459 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a8b209c7-bfbd-4e42-8b19-86a61343c27a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:36.285571 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c69a3efb-089e-4d2b-aa8d-6652d0eb5154 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ca75cda41e44918bea52f718e316fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e434b726f40467597916ecbcbc9b0fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:36.302618 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c69a3efb-089e-4d2b-aa8d-6652d0eb5154 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] 10.222.0.35 "GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5" status: 200 len: 1426 microversion: 2.1 time: 0.344372 Jun 10 18:36:36.304075 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3327/6696] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:35 2022] GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5 => generated 1426 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:36:36.440284 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a8b209c7-bfbd-4e42-8b19-86a61343c27a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:36.454939 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a8b209c7-bfbd-4e42-8b19-86a61343c27a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7" status: 200 len: 1562 microversion: 2.1 time: 0.473074 Jun 10 18:36:36.456638 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3370/6697] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:35 2022] GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7 => generated 1562 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:36:37.322131 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-95ce3d6f-2afe-4dcd-acb7-4b242c59f915 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:37.323340 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-95ce3d6f-2afe-4dcd-acb7-4b242c59f915 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] [instance: 7408ba2e-3085-49c7-af8e-b66aee17b1c5] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:37.340472 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-95ce3d6f-2afe-4dcd-acb7-4b242c59f915 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:37.340472 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-95ce3d6f-2afe-4dcd-acb7-4b242c59f915 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:37.340472 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-95ce3d6f-2afe-4dcd-acb7-4b242c59f915 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:37.340472 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-95ce3d6f-2afe-4dcd-acb7-4b242c59f915 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:37.587588 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-95ce3d6f-2afe-4dcd-acb7-4b242c59f915 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ca75cda41e44918bea52f718e316fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e434b726f40467597916ecbcbc9b0fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:37.599852 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-95ce3d6f-2afe-4dcd-acb7-4b242c59f915 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] 10.222.0.35 "GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5" status: 200 len: 1426 microversion: 2.1 time: 0.282103 Jun 10 18:36:37.601349 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3328/6698] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:37 2022] GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5 => generated 1426 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:36:38.617504 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f7f334aa-8a1a-4cf6-9b76-e810a8cc8362 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:38.618050 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f7f334aa-8a1a-4cf6-9b76-e810a8cc8362 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] [instance: 7408ba2e-3085-49c7-af8e-b66aee17b1c5] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:38.622527 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=20 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:36:38.642658 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f7f334aa-8a1a-4cf6-9b76-e810a8cc8362 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:38.643135 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f7f334aa-8a1a-4cf6-9b76-e810a8cc8362 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:38.645318 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f7f334aa-8a1a-4cf6-9b76-e810a8cc8362 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:38.645957 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f7f334aa-8a1a-4cf6-9b76-e810a8cc8362 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:38.711765 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-02b8d2b0-b307-483b-bd95-e7eae4558c4e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-956509051", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "4daf7e78-a841-4bf9-b865-013f4cf4e95e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b7773285-a55f-44ca-92fc-1f9b6eadbe45"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:36:38.897388 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-02b8d2b0-b307-483b-bd95-e7eae4558c4e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] validate_networks() for [('b7773285-a55f-44ca-92fc-1f9b6eadbe45', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:36:38.960447 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f7f334aa-8a1a-4cf6-9b76-e810a8cc8362 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ca75cda41e44918bea52f718e316fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e434b726f40467597916ecbcbc9b0fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:38.969486 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f7f334aa-8a1a-4cf6-9b76-e810a8cc8362 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] 10.222.0.35 "GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5" status: 200 len: 1426 microversion: 2.1 time: 0.356046 Jun 10 18:36:38.970400 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3371/6699] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:38 2022] GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5 => generated 1426 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:36:39.461129 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-02b8d2b0-b307-483b-bd95-e7eae4558c4e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:36:39.461878 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-02b8d2b0-b307-483b-bd95-e7eae4558c4e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:36:39.462604 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-02b8d2b0-b307-483b-bd95-e7eae4558c4e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:36:39.463230 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-02b8d2b0-b307-483b-bd95-e7eae4558c4e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:36:39.463856 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-02b8d2b0-b307-483b-bd95-e7eae4558c4e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:36:39.473575 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02b8d2b0-b307-483b-bd95-e7eae4558c4e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:39.474428 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02b8d2b0-b307-483b-bd95-e7eae4558c4e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:39.475460 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02b8d2b0-b307-483b-bd95-e7eae4558c4e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:39.477496 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02b8d2b0-b307-483b-bd95-e7eae4558c4e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:39.508778 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-02b8d2b0-b307-483b-bd95-e7eae4558c4e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Getting quotas for project 7e9c656d484843ffb1f2de092730345b. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:36:39.516225 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-02b8d2b0-b307-483b-bd95-e7eae4558c4e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Getting quotas for user b469a8f9433d422aa98d22eea9df7071 and project 7e9c656d484843ffb1f2de092730345b. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:36:39.542092 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-cd3dcb90-7e05-4edc-ada0-e593508f4133 req-ca2305c3-2f0e-40f8-9b45-d3fada258637 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7408ba2e-3085-49c7-af8e-b66aee17b1c5", "name": "network-vif-plugged", "status": "completed", "tag": "6680d55a-5c20-4dcd-94bb-67d83b336345"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:36:39.558335 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-cd3dcb90-7e05-4edc-ada0-e593508f4133 req-ca2305c3-2f0e-40f8-9b45-d3fada258637 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:39.558789 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-cd3dcb90-7e05-4edc-ada0-e593508f4133 req-ca2305c3-2f0e-40f8-9b45-d3fada258637 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:39.589313 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-cd3dcb90-7e05-4edc-ada0-e593508f4133 req-ca2305c3-2f0e-40f8-9b45-d3fada258637 service nova] Creating event network-vif-plugged:6680d55a-5c20-4dcd-94bb-67d83b336345 for instance 7408ba2e-3085-49c7-af8e-b66aee17b1c5 on chh2-master-2 Jun 10 18:36:39.596407 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-cd3dcb90-7e05-4edc-ada0-e593508f4133 req-ca2305c3-2f0e-40f8-9b45-d3fada258637 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059679 Jun 10 18:36:39.603295 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3372/6700] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:36:39.641243 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-02b8d2b0-b307-483b-bd95-e7eae4558c4e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:36:39.643405 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-02b8d2b0-b307-483b-bd95-e7eae4558c4e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4daf7e78-a841-4bf9-b865-013f4cf4e95e',volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:36:39.987898 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-938592ff-64dc-4f2b-9738-c56fd18aa13f tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:39.989398 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-938592ff-64dc-4f2b-9738-c56fd18aa13f tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] [instance: 7408ba2e-3085-49c7-af8e-b66aee17b1c5] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:39.998662 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-938592ff-64dc-4f2b-9738-c56fd18aa13f tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:39.999884 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-938592ff-64dc-4f2b-9738-c56fd18aa13f tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:40.001185 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-938592ff-64dc-4f2b-9738-c56fd18aa13f tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:40.001849 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-938592ff-64dc-4f2b-9738-c56fd18aa13f tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:40.222067 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-02b8d2b0-b307-483b-bd95-e7eae4558c4e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.514718 Jun 10 18:36:40.224079 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3329/6701] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:36:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:36:40.253633 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-af025280-532a-45c2-8170-1c65318092c3 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:40.254626 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-af025280-532a-45c2-8170-1c65318092c3 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:40.262364 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-938592ff-64dc-4f2b-9738-c56fd18aa13f tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ca75cda41e44918bea52f718e316fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e434b726f40467597916ecbcbc9b0fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:40.270704 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-938592ff-64dc-4f2b-9738-c56fd18aa13f tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] 10.222.0.35 "GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5" status: 200 len: 1426 microversion: 2.1 time: 0.287019 Jun 10 18:36:40.271319 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3373/6702] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:39 2022] GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5 => generated 1426 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:36:40.345956 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-af025280-532a-45c2-8170-1c65318092c3 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:40.355189 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-af025280-532a-45c2-8170-1c65318092c3 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc" status: 200 len: 1056 microversion: 2.1 time: 0.118238 Jun 10 18:36:40.359073 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3330/6703] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:40 2022] GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc => generated 1056 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:36:40.715104 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-02a6ae94-1b32-4233-be3d-5b9ef9a8c188 req-041260dc-d227-4af9-bd8b-3719355f7c1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "483bd251-8106-439e-83d7-d7209125bbe7", "tag": "ac70d592-697b-4f64-add0-1e44e2815260"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:36:40.715104 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-02a6ae94-1b32-4233-be3d-5b9ef9a8c188 req-041260dc-d227-4af9-bd8b-3719355f7c1c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:40.715104 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-02a6ae94-1b32-4233-be3d-5b9ef9a8c188 req-041260dc-d227-4af9-bd8b-3719355f7c1c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:40.715104 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-02a6ae94-1b32-4233-be3d-5b9ef9a8c188 req-041260dc-d227-4af9-bd8b-3719355f7c1c service nova] Creating event network-changed:ac70d592-697b-4f64-add0-1e44e2815260 for instance 483bd251-8106-439e-83d7-d7209125bbe7 on chh1-master-2 Jun 10 18:36:40.716942 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-02a6ae94-1b32-4233-be3d-5b9ef9a8c188 req-041260dc-d227-4af9-bd8b-3719355f7c1c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028079 Jun 10 18:36:40.720620 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3374/6704] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:36:40.724788 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2c08c7a1-6b62-4b50-8156-4b9daabbc0da tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:40.726063 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2c08c7a1-6b62-4b50-8156-4b9daabbc0da tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 483bd251-8106-439e-83d7-d7209125bbe7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:40.733707 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c08c7a1-6b62-4b50-8156-4b9daabbc0da tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:40.734217 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c08c7a1-6b62-4b50-8156-4b9daabbc0da tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:40.735793 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c08c7a1-6b62-4b50-8156-4b9daabbc0da tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:40.737064 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c08c7a1-6b62-4b50-8156-4b9daabbc0da tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:40.958692 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2c08c7a1-6b62-4b50-8156-4b9daabbc0da tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:40.976815 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2c08c7a1-6b62-4b50-8156-4b9daabbc0da tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7" status: 200 len: 1562 microversion: 2.1 time: 0.257694 Jun 10 18:36:40.977340 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3331/6705] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:40 2022] GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7 => generated 1562 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:36:41.289844 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-92854713-402d-4a7a-8de0-b935e23404ec tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:41.291143 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-92854713-402d-4a7a-8de0-b935e23404ec tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] [instance: 7408ba2e-3085-49c7-af8e-b66aee17b1c5] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:41.302700 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-92854713-402d-4a7a-8de0-b935e23404ec tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:41.303434 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-92854713-402d-4a7a-8de0-b935e23404ec tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:41.304472 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-92854713-402d-4a7a-8de0-b935e23404ec tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:41.305138 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-92854713-402d-4a7a-8de0-b935e23404ec tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:41.376257 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0041dbe8-3f6a-46ed-880e-a10c31701be5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:41.377564 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0041dbe8-3f6a-46ed-880e-a10c31701be5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:41.532379 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0041dbe8-3f6a-46ed-880e-a10c31701be5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:41.537048 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-92854713-402d-4a7a-8de0-b935e23404ec tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ca75cda41e44918bea52f718e316fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e434b726f40467597916ecbcbc9b0fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:41.544968 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0041dbe8-3f6a-46ed-880e-a10c31701be5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc" status: 200 len: 1056 microversion: 2.1 time: 0.173252 Jun 10 18:36:41.547291 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3332/6706] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:41 2022] GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc => generated 1056 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:36:41.552544 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-92854713-402d-4a7a-8de0-b935e23404ec tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] 10.222.0.35 "GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5" status: 200 len: 1426 microversion: 2.1 time: 0.266868 Jun 10 18:36:41.553399 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3375/6707] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:41 2022] GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5 => generated 1426 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:36:42.562109 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c02a7aaf-88b2-428f-a111-610e12f974fb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:42.562726 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c02a7aaf-88b2-428f-a111-610e12f974fb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:42.570104 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9f694126-4711-47cd-9905-2a68ae338123 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:42.571371 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9f694126-4711-47cd-9905-2a68ae338123 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] [instance: 7408ba2e-3085-49c7-af8e-b66aee17b1c5] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:42.580443 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9f694126-4711-47cd-9905-2a68ae338123 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:42.585236 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9f694126-4711-47cd-9905-2a68ae338123 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:42.591768 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9f694126-4711-47cd-9905-2a68ae338123 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:42.591768 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9f694126-4711-47cd-9905-2a68ae338123 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:42.591996 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c02a7aaf-88b2-428f-a111-610e12f974fb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:42.591996 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c02a7aaf-88b2-428f-a111-610e12f974fb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:42.591996 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c02a7aaf-88b2-428f-a111-610e12f974fb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:42.592600 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c02a7aaf-88b2-428f-a111-610e12f974fb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:42.724443 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c02a7aaf-88b2-428f-a111-610e12f974fb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:42.737561 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c02a7aaf-88b2-428f-a111-610e12f974fb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc" status: 200 len: 1154 microversion: 2.1 time: 0.179417 Jun 10 18:36:42.739916 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3333/6708] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:42 2022] GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc => generated 1154 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:36:42.854343 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9f694126-4711-47cd-9905-2a68ae338123 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ca75cda41e44918bea52f718e316fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e434b726f40467597916ecbcbc9b0fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:42.872931 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9f694126-4711-47cd-9905-2a68ae338123 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] 10.222.0.35 "GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5" status: 200 len: 1605 microversion: 2.1 time: 0.305499 Jun 10 18:36:42.877954 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3376/6709] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:42 2022] GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5 => generated 1605 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:36:42.890695 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c9ddd9c7-4b76-4f6a-8442-2c13078f893c tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:42.891749 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c9ddd9c7-4b76-4f6a-8442-2c13078f893c tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] [instance: 7408ba2e-3085-49c7-af8e-b66aee17b1c5] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:42.902519 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9ddd9c7-4b76-4f6a-8442-2c13078f893c tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:42.903685 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9ddd9c7-4b76-4f6a-8442-2c13078f893c tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:42.904848 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9ddd9c7-4b76-4f6a-8442-2c13078f893c tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:42.905484 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9ddd9c7-4b76-4f6a-8442-2c13078f893c tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:43.127134 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c9ddd9c7-4b76-4f6a-8442-2c13078f893c tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ca75cda41e44918bea52f718e316fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e434b726f40467597916ecbcbc9b0fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:43.135222 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c9ddd9c7-4b76-4f6a-8442-2c13078f893c tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] 10.222.0.35 "GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5" status: 200 len: 1605 microversion: 2.1 time: 0.249419 Jun 10 18:36:43.142443 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3334/6710] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:42 2022] GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5 => generated 1605 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:36:43.156659 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-16fddd2f-4f27-4b8a-b6fd-f991981bcd5e tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:43.159938 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-16fddd2f-4f27-4b8a-b6fd-f991981bcd5e tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] [instance: 7408ba2e-3085-49c7-af8e-b66aee17b1c5] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:43.185266 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-16fddd2f-4f27-4b8a-b6fd-f991981bcd5e tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:43.188773 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-16fddd2f-4f27-4b8a-b6fd-f991981bcd5e tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:43.191079 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-16fddd2f-4f27-4b8a-b6fd-f991981bcd5e tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:43.194024 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-16fddd2f-4f27-4b8a-b6fd-f991981bcd5e tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:43.484730 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-16fddd2f-4f27-4b8a-b6fd-f991981bcd5e tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ca75cda41e44918bea52f718e316fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e434b726f40467597916ecbcbc9b0fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:43.498895 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-16fddd2f-4f27-4b8a-b6fd-f991981bcd5e tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] 10.222.0.35 "GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5" status: 200 len: 1605 microversion: 2.1 time: 0.350430 Jun 10 18:36:43.500957 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3377/6711] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:43 2022] GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5 => generated 1605 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:36:43.768164 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-185e664e-222c-4756-b2ba-f1b65ab6f3f4 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:43.777806 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-185e664e-222c-4756-b2ba-f1b65ab6f3f4 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:43.845266 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-185e664e-222c-4756-b2ba-f1b65ab6f3f4 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:43.848004 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-185e664e-222c-4756-b2ba-f1b65ab6f3f4 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:43.851091 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-185e664e-222c-4756-b2ba-f1b65ab6f3f4 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:43.857429 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-185e664e-222c-4756-b2ba-f1b65ab6f3f4 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:43.991558 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-185e664e-222c-4756-b2ba-f1b65ab6f3f4 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:44.009568 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-185e664e-222c-4756-b2ba-f1b65ab6f3f4 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc" status: 200 len: 1172 microversion: 2.1 time: 0.249501 Jun 10 18:36:44.019337 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3335/6712] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:43 2022] GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc => generated 1172 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:36:45.030995 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d13fa82c-d356-4254-81e6-d19529089a42 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:45.032254 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d13fa82c-d356-4254-81e6-d19529089a42 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:45.046318 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d13fa82c-d356-4254-81e6-d19529089a42 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:45.053108 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d13fa82c-d356-4254-81e6-d19529089a42 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:45.053108 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d13fa82c-d356-4254-81e6-d19529089a42 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:45.053108 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d13fa82c-d356-4254-81e6-d19529089a42 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:45.349894 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d13fa82c-d356-4254-81e6-d19529089a42 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:45.354138 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:36:45.377518 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d13fa82c-d356-4254-81e6-d19529089a42 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc" status: 200 len: 1214 microversion: 2.1 time: 0.350619 Jun 10 18:36:45.386551 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3378/6713] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:45 2022] GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc => generated 1214 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:36:46.403830 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-673d3c46-90c3-4430-a87f-7017d46f4540 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:46.405048 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-673d3c46-90c3-4430-a87f-7017d46f4540 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:46.423046 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-673d3c46-90c3-4430-a87f-7017d46f4540 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:46.423510 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-673d3c46-90c3-4430-a87f-7017d46f4540 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:46.424299 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-673d3c46-90c3-4430-a87f-7017d46f4540 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:46.424864 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-673d3c46-90c3-4430-a87f-7017d46f4540 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:46.458269 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:36:46.658227 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-673d3c46-90c3-4430-a87f-7017d46f4540 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:46.667267 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-673d3c46-90c3-4430-a87f-7017d46f4540 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc" status: 200 len: 1214 microversion: 2.1 time: 0.273912 Jun 10 18:36:46.667869 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3336/6714] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:46 2022] GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc => generated 1214 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:36:47.404586 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-5dba134e-5f30-4405-9d41-37945b297c9c req-a8ba3495-995a-44c4-ae19-4689f1f47852 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "471d0bde-ebc5-46f8-9dc3-cc705dc48fbc", "tag": "b3b59327-717a-45ef-a6f4-271483446a24"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:36:47.429443 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-5dba134e-5f30-4405-9d41-37945b297c9c req-a8ba3495-995a-44c4-ae19-4689f1f47852 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:47.430009 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-5dba134e-5f30-4405-9d41-37945b297c9c req-a8ba3495-995a-44c4-ae19-4689f1f47852 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:47.469084 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-5dba134e-5f30-4405-9d41-37945b297c9c req-a8ba3495-995a-44c4-ae19-4689f1f47852 service nova] Creating event network-changed:b3b59327-717a-45ef-a6f4-271483446a24 for instance 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc on chh1-master-2 Jun 10 18:36:47.477371 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-5dba134e-5f30-4405-9d41-37945b297c9c req-a8ba3495-995a-44c4-ae19-4689f1f47852 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079855 Jun 10 18:36:47.478999 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3379/6715] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:36:47.687132 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5358a6c1-7bc3-49b0-85da-a88fd6c7eff3 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:47.688697 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5358a6c1-7bc3-49b0-85da-a88fd6c7eff3 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:47.696028 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=6 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:36:47.698194 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5358a6c1-7bc3-49b0-85da-a88fd6c7eff3 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:47.699316 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5358a6c1-7bc3-49b0-85da-a88fd6c7eff3 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:47.700626 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5358a6c1-7bc3-49b0-85da-a88fd6c7eff3 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:47.710243 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5358a6c1-7bc3-49b0-85da-a88fd6c7eff3 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:48.473844 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5358a6c1-7bc3-49b0-85da-a88fd6c7eff3 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:48.485793 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5358a6c1-7bc3-49b0-85da-a88fd6c7eff3 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc" status: 200 len: 1214 microversion: 2.1 time: 0.803181 Jun 10 18:36:48.487789 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3337/6716] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:47 2022] GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc => generated 1214 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:36:49.505326 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-349170e0-6f45-445b-8059-c89849872dd7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:49.506890 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-349170e0-6f45-445b-8059-c89849872dd7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:49.519164 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-349170e0-6f45-445b-8059-c89849872dd7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:49.522219 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-349170e0-6f45-445b-8059-c89849872dd7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:49.525184 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-349170e0-6f45-445b-8059-c89849872dd7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:49.525984 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-349170e0-6f45-445b-8059-c89849872dd7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:49.620352 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-9bec95ff-b8ec-4899-a972-954ecd13e6bd req-ed772d89-5989-4c0e-8641-016c06d22ef8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7408ba2e-3085-49c7-af8e-b66aee17b1c5", "tag": "6680d55a-5c20-4dcd-94bb-67d83b336345"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:36:49.625410 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:36:49.631161 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-9bec95ff-b8ec-4899-a972-954ecd13e6bd req-ed772d89-5989-4c0e-8641-016c06d22ef8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:49.633725 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-9bec95ff-b8ec-4899-a972-954ecd13e6bd req-ed772d89-5989-4c0e-8641-016c06d22ef8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:49.651769 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-9bec95ff-b8ec-4899-a972-954ecd13e6bd req-ed772d89-5989-4c0e-8641-016c06d22ef8 service nova] Creating event network-changed:6680d55a-5c20-4dcd-94bb-67d83b336345 for instance 7408ba2e-3085-49c7-af8e-b66aee17b1c5 on chh2-master-2 Jun 10 18:36:49.671036 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-9bec95ff-b8ec-4899-a972-954ecd13e6bd req-ed772d89-5989-4c0e-8641-016c06d22ef8 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054338 Jun 10 18:36:49.672334 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3338/6717] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:36:49.899049 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-349170e0-6f45-445b-8059-c89849872dd7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:49.910428 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-349170e0-6f45-445b-8059-c89849872dd7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc" status: 200 len: 1214 microversion: 2.1 time: 0.410378 Jun 10 18:36:49.922018 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3380/6718] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:49 2022] GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc => generated 1214 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:36:50.927969 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2e956926-ab1c-4732-ac8a-49f006b8707f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:50.928702 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2e956926-ab1c-4732-ac8a-49f006b8707f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:50.938207 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e956926-ab1c-4732-ac8a-49f006b8707f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:50.938663 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e956926-ab1c-4732-ac8a-49f006b8707f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:50.939440 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e956926-ab1c-4732-ac8a-49f006b8707f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:50.939881 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e956926-ab1c-4732-ac8a-49f006b8707f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:51.144709 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2e956926-ab1c-4732-ac8a-49f006b8707f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:51.163402 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2e956926-ab1c-4732-ac8a-49f006b8707f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc" status: 200 len: 1214 microversion: 2.1 time: 0.239437 Jun 10 18:36:51.164996 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3339/6719] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:50 2022] GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc => generated 1214 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:36:52.180995 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-693c7250-d35a-4d90-a21f-2b073a319d9b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:52.182292 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-693c7250-d35a-4d90-a21f-2b073a319d9b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:52.193599 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:36:52.204463 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-693c7250-d35a-4d90-a21f-2b073a319d9b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:52.204463 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-693c7250-d35a-4d90-a21f-2b073a319d9b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:52.204463 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-693c7250-d35a-4d90-a21f-2b073a319d9b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:52.204463 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-693c7250-d35a-4d90-a21f-2b073a319d9b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:52.380017 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-693c7250-d35a-4d90-a21f-2b073a319d9b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:52.387795 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-693c7250-d35a-4d90-a21f-2b073a319d9b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc" status: 200 len: 1202 microversion: 2.1 time: 0.210932 Jun 10 18:36:52.388543 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3381/6720] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:52 2022] GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc => generated 1202 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:36:53.406133 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1608f76e-c28c-4a11-9d26-032b1c791839 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:53.406741 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1608f76e-c28c-4a11-9d26-032b1c791839 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:53.409234 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=10 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:36:53.415069 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1608f76e-c28c-4a11-9d26-032b1c791839 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:53.415679 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1608f76e-c28c-4a11-9d26-032b1c791839 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:53.416524 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1608f76e-c28c-4a11-9d26-032b1c791839 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:53.416969 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1608f76e-c28c-4a11-9d26-032b1c791839 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:53.560986 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1608f76e-c28c-4a11-9d26-032b1c791839 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:53.568917 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1608f76e-c28c-4a11-9d26-032b1c791839 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc" status: 200 len: 1202 microversion: 2.1 time: 0.167350 Jun 10 18:36:53.569503 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3340/6721] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:53 2022] GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc => generated 1202 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:36:54.587392 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-29f7d639-9723-4012-9024-1d216fb663b1 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:54.588010 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-29f7d639-9723-4012-9024-1d216fb663b1 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:54.596039 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-29f7d639-9723-4012-9024-1d216fb663b1 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:54.596480 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-29f7d639-9723-4012-9024-1d216fb663b1 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:54.597264 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-29f7d639-9723-4012-9024-1d216fb663b1 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:54.597920 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-29f7d639-9723-4012-9024-1d216fb663b1 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:54.737974 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-29f7d639-9723-4012-9024-1d216fb663b1 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:54.745529 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-29f7d639-9723-4012-9024-1d216fb663b1 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc" status: 200 len: 1202 microversion: 2.1 time: 0.162545 Jun 10 18:36:54.746110 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3382/6722] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:54 2022] GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc => generated 1202 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:36:55.762494 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4c3411b0-d9fa-4b6b-bcad-c0eee5b3fa91 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:55.763741 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4c3411b0-d9fa-4b6b-bcad-c0eee5b3fa91 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:55.770731 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4c3411b0-d9fa-4b6b-bcad-c0eee5b3fa91 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:55.771189 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4c3411b0-d9fa-4b6b-bcad-c0eee5b3fa91 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:55.771991 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4c3411b0-d9fa-4b6b-bcad-c0eee5b3fa91 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:55.772470 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4c3411b0-d9fa-4b6b-bcad-c0eee5b3fa91 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:55.951400 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4c3411b0-d9fa-4b6b-bcad-c0eee5b3fa91 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:55.951400 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4c3411b0-d9fa-4b6b-bcad-c0eee5b3fa91 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc" status: 200 len: 1202 microversion: 2.1 time: 0.163206 Jun 10 18:36:55.951400 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3341/6723] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:55 2022] GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc => generated 1202 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:36:56.967383 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4a8ee56e-459b-425f-b3e8-3478fbe2c901 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:56.967974 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4a8ee56e-459b-425f-b3e8-3478fbe2c901 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:56.974994 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4a8ee56e-459b-425f-b3e8-3478fbe2c901 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:56.975456 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4a8ee56e-459b-425f-b3e8-3478fbe2c901 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:56.976236 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4a8ee56e-459b-425f-b3e8-3478fbe2c901 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:56.976715 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4a8ee56e-459b-425f-b3e8-3478fbe2c901 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:57.118093 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4a8ee56e-459b-425f-b3e8-3478fbe2c901 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:57.126691 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4a8ee56e-459b-425f-b3e8-3478fbe2c901 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc" status: 200 len: 1202 microversion: 2.1 time: 0.163779 Jun 10 18:36:57.126994 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3383/6724] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:56 2022] GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc => generated 1202 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:36:58.144216 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5171a1ae-82bf-4bf1-946c-d044d3609949 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:58.145554 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5171a1ae-82bf-4bf1-946c-d044d3609949 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:58.153403 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5171a1ae-82bf-4bf1-946c-d044d3609949 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:58.154633 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5171a1ae-82bf-4bf1-946c-d044d3609949 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:58.155394 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5171a1ae-82bf-4bf1-946c-d044d3609949 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:58.155833 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5171a1ae-82bf-4bf1-946c-d044d3609949 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:58.368210 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5171a1ae-82bf-4bf1-946c-d044d3609949 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:58.378259 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5171a1ae-82bf-4bf1-946c-d044d3609949 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc" status: 200 len: 1202 microversion: 2.1 time: 0.238330 Jun 10 18:36:58.378948 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3342/6725] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:58 2022] GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc => generated 1202 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:36:59.396293 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-93abc810-2dd5-40cb-b461-64723ac751a2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:36:59.398503 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-93abc810-2dd5-40cb-b461-64723ac751a2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:59.408499 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-93abc810-2dd5-40cb-b461-64723ac751a2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:59.408965 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-93abc810-2dd5-40cb-b461-64723ac751a2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:59.409759 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-93abc810-2dd5-40cb-b461-64723ac751a2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:59.410209 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-93abc810-2dd5-40cb-b461-64723ac751a2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:59.526568 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a1220514-a4f3-41ea-a419-859885675e7e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:36:59.531643 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a1220514-a4f3-41ea-a419-859885675e7e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 483bd251-8106-439e-83d7-d7209125bbe7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:36:59.538705 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a1220514-a4f3-41ea-a419-859885675e7e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:59.539526 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a1220514-a4f3-41ea-a419-859885675e7e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:59.540941 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a1220514-a4f3-41ea-a419-859885675e7e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:36:59.541609 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a1220514-a4f3-41ea-a419-859885675e7e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:36:59.572014 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-93abc810-2dd5-40cb-b461-64723ac751a2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:36:59.581492 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-93abc810-2dd5-40cb-b461-64723ac751a2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc" status: 200 len: 1202 microversion: 2.1 time: 0.189580 Jun 10 18:36:59.582273 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3384/6726] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:36:59 2022] GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc => generated 1202 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:36:59.613251 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a1220514-a4f3-41ea-a419-859885675e7e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "POST /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7/action" status: 200 len: 24542 microversion: 2.1 time: 0.090565 Jun 10 18:36:59.613931 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3343/6727] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:36:59 2022] POST /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7/action => generated 24542 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 10 18:37:00.598464 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a95282e0-0aeb-4167-bea0-f40475c1735b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:00.599867 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a95282e0-0aeb-4167-bea0-f40475c1735b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:00.608346 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a95282e0-0aeb-4167-bea0-f40475c1735b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:00.609122 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a95282e0-0aeb-4167-bea0-f40475c1735b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:00.610295 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a95282e0-0aeb-4167-bea0-f40475c1735b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:00.610733 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a95282e0-0aeb-4167-bea0-f40475c1735b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:00.822640 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a95282e0-0aeb-4167-bea0-f40475c1735b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:37:00.832129 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a95282e0-0aeb-4167-bea0-f40475c1735b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc" status: 200 len: 1202 microversion: 2.1 time: 0.237595 Jun 10 18:37:00.833276 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3385/6728] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:00 2022] GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc => generated 1202 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:01.855895 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b5b484e6-51e8-42cc-ae93-e2412bd9a520 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:01.857334 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b5b484e6-51e8-42cc-ae93-e2412bd9a520 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:01.864996 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5b484e6-51e8-42cc-ae93-e2412bd9a520 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:01.865771 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5b484e6-51e8-42cc-ae93-e2412bd9a520 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:01.867040 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5b484e6-51e8-42cc-ae93-e2412bd9a520 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:01.867937 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5b484e6-51e8-42cc-ae93-e2412bd9a520 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:02.053943 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b5b484e6-51e8-42cc-ae93-e2412bd9a520 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:37:02.074394 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b5b484e6-51e8-42cc-ae93-e2412bd9a520 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc" status: 200 len: 1202 microversion: 2.1 time: 0.227109 Jun 10 18:37:02.078069 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3344/6729] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:01 2022] GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc => generated 1202 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:02.274031 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-99d0f40f-837e-4247-834c-31a04e13c816 req-9217865c-78d0-48b2-9cb3-96cbb8129ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "471d0bde-ebc5-46f8-9dc3-cc705dc48fbc", "name": "network-vif-plugged", "status": "completed", "tag": "b3b59327-717a-45ef-a6f4-271483446a24"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:37:02.292489 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-99d0f40f-837e-4247-834c-31a04e13c816 req-9217865c-78d0-48b2-9cb3-96cbb8129ce0 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:02.292489 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-99d0f40f-837e-4247-834c-31a04e13c816 req-9217865c-78d0-48b2-9cb3-96cbb8129ce0 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:02.314659 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-99d0f40f-837e-4247-834c-31a04e13c816 req-9217865c-78d0-48b2-9cb3-96cbb8129ce0 service nova] Creating event network-vif-plugged:b3b59327-717a-45ef-a6f4-271483446a24 for instance 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc on chh1-master-2 Jun 10 18:37:02.327842 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-99d0f40f-837e-4247-834c-31a04e13c816 req-9217865c-78d0-48b2-9cb3-96cbb8129ce0 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050864 Jun 10 18:37:02.327842 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3386/6730] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:37:03.093770 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7e304cce-1acf-427e-8b8d-aa893a398902 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:03.094622 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7e304cce-1acf-427e-8b8d-aa893a398902 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:03.101895 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e304cce-1acf-427e-8b8d-aa893a398902 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:03.115932 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e304cce-1acf-427e-8b8d-aa893a398902 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:03.118313 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e304cce-1acf-427e-8b8d-aa893a398902 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:03.120506 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e304cce-1acf-427e-8b8d-aa893a398902 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:03.707035 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7e304cce-1acf-427e-8b8d-aa893a398902 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:37:03.721177 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7e304cce-1acf-427e-8b8d-aa893a398902 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc" status: 200 len: 1202 microversion: 2.1 time: 0.632673 Jun 10 18:37:03.725647 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3345/6731] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:03 2022] GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc => generated 1202 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:04.740486 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1c7d9a07-cb49-4b40-bc8b-4fea3c168f58 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:04.741266 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1c7d9a07-cb49-4b40-bc8b-4fea3c168f58 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:04.751795 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1c7d9a07-cb49-4b40-bc8b-4fea3c168f58 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:04.752388 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1c7d9a07-cb49-4b40-bc8b-4fea3c168f58 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:04.753418 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1c7d9a07-cb49-4b40-bc8b-4fea3c168f58 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:04.753942 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1c7d9a07-cb49-4b40-bc8b-4fea3c168f58 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:05.010904 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1c7d9a07-cb49-4b40-bc8b-4fea3c168f58 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:37:05.019639 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1c7d9a07-cb49-4b40-bc8b-4fea3c168f58 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc" status: 200 len: 1389 microversion: 2.1 time: 0.284037 Jun 10 18:37:05.034431 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3387/6732] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:04 2022] GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc => generated 1389 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:05.040471 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-08322d5d-feee-40d3-8365-4fb21c4b0bc6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:05.041638 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-08322d5d-feee-40d3-8365-4fb21c4b0bc6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:05.049970 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-08322d5d-feee-40d3-8365-4fb21c4b0bc6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:05.050620 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-08322d5d-feee-40d3-8365-4fb21c4b0bc6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:05.051556 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-08322d5d-feee-40d3-8365-4fb21c4b0bc6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:05.052144 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-08322d5d-feee-40d3-8365-4fb21c4b0bc6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:05.211762 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-08322d5d-feee-40d3-8365-4fb21c4b0bc6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:37:05.233398 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-08322d5d-feee-40d3-8365-4fb21c4b0bc6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc" status: 200 len: 1389 microversion: 2.1 time: 0.196489 Jun 10 18:37:05.244849 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3346/6733] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:05 2022] GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc => generated 1389 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:05.249639 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-05dc6f24-d9ae-4cf4-b1d1-7212230aa95a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:05.250535 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-05dc6f24-d9ae-4cf4-b1d1-7212230aa95a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:05.263111 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-05dc6f24-d9ae-4cf4-b1d1-7212230aa95a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:05.263111 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-05dc6f24-d9ae-4cf4-b1d1-7212230aa95a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:05.263111 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-05dc6f24-d9ae-4cf4-b1d1-7212230aa95a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:05.263111 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-05dc6f24-d9ae-4cf4-b1d1-7212230aa95a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:05.532243 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-05dc6f24-d9ae-4cf4-b1d1-7212230aa95a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:37:05.553491 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-05dc6f24-d9ae-4cf4-b1d1-7212230aa95a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc" status: 200 len: 1389 microversion: 2.1 time: 0.307683 Jun 10 18:37:05.573901 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a6e87ba8-965c-4704-89c7-55eac76a9f0e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:05.574669 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a6e87ba8-965c-4704-89c7-55eac76a9f0e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:05.580097 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3388/6734] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:05 2022] GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc => generated 1389 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:37:05.585094 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a6e87ba8-965c-4704-89c7-55eac76a9f0e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:05.585094 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a6e87ba8-965c-4704-89c7-55eac76a9f0e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:05.585636 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a6e87ba8-965c-4704-89c7-55eac76a9f0e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:05.586302 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a6e87ba8-965c-4704-89c7-55eac76a9f0e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:05.621539 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a6e87ba8-965c-4704-89c7-55eac76a9f0e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:37:06.025247 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a6e87ba8-965c-4704-89c7-55eac76a9f0e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "DELETE /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc" status: 204 len: 0 microversion: 2.1 time: 0.456653 Jun 10 18:37:06.025826 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3347/6735] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:37:05 2022] DELETE /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:37:06.035838 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-af4a87c6-a5aa-4aa8-8fff-875d3e518cd7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:06.037088 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-af4a87c6-a5aa-4aa8-8fff-875d3e518cd7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:06.048170 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-af4a87c6-a5aa-4aa8-8fff-875d3e518cd7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:06.051358 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-af4a87c6-a5aa-4aa8-8fff-875d3e518cd7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:06.052167 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-af4a87c6-a5aa-4aa8-8fff-875d3e518cd7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:06.052644 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-af4a87c6-a5aa-4aa8-8fff-875d3e518cd7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:06.381313 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-af4a87c6-a5aa-4aa8-8fff-875d3e518cd7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:37:06.402314 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-af4a87c6-a5aa-4aa8-8fff-875d3e518cd7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc" status: 200 len: 1395 microversion: 2.1 time: 0.370491 Jun 10 18:37:06.402932 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3389/6736] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:06 2022] GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc => generated 1395 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:07.422318 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-abe5d0eb-ba7e-4721-a25d-2fa4a200dcc4 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:07.423296 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-abe5d0eb-ba7e-4721-a25d-2fa4a200dcc4 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:07.431706 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-abe5d0eb-ba7e-4721-a25d-2fa4a200dcc4 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:07.433598 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-abe5d0eb-ba7e-4721-a25d-2fa4a200dcc4 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:07.434454 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-abe5d0eb-ba7e-4721-a25d-2fa4a200dcc4 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:07.434945 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-abe5d0eb-ba7e-4721-a25d-2fa4a200dcc4 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:07.705082 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-abe5d0eb-ba7e-4721-a25d-2fa4a200dcc4 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:37:07.714626 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-abe5d0eb-ba7e-4721-a25d-2fa4a200dcc4 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc" status: 200 len: 1395 microversion: 2.1 time: 0.297415 Jun 10 18:37:07.715636 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3348/6737] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:07 2022] GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc => generated 1395 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:08.227324 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-1ddd114f-8c05-4fae-84f6-c39958b44402 req-c0fafaf4-200b-4c17-a283-bff9524ea3c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "471d0bde-ebc5-46f8-9dc3-cc705dc48fbc", "name": "network-vif-deleted", "tag": "b3b59327-717a-45ef-a6f4-271483446a24"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:37:08.250371 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-1ddd114f-8c05-4fae-84f6-c39958b44402 req-c0fafaf4-200b-4c17-a283-bff9524ea3c7 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:08.251160 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-1ddd114f-8c05-4fae-84f6-c39958b44402 req-c0fafaf4-200b-4c17-a283-bff9524ea3c7 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:08.291391 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-1ddd114f-8c05-4fae-84f6-c39958b44402 req-c0fafaf4-200b-4c17-a283-bff9524ea3c7 service nova] Creating event network-vif-deleted:b3b59327-717a-45ef-a6f4-271483446a24 for instance 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc on chh1-master-2 Jun 10 18:37:08.297196 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-1ddd114f-8c05-4fae-84f6-c39958b44402 req-c0fafaf4-200b-4c17-a283-bff9524ea3c7 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073858 Jun 10 18:37:08.299356 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3390/6738] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:37:08.734087 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-72e065bc-bf1d-498f-9b6b-0c03ecd9d0be tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:08.734710 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-72e065bc-bf1d-498f-9b6b-0c03ecd9d0be tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:08.751323 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72e065bc-bf1d-498f-9b6b-0c03ecd9d0be tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:08.751790 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72e065bc-bf1d-498f-9b6b-0c03ecd9d0be tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:08.752639 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72e065bc-bf1d-498f-9b6b-0c03ecd9d0be tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:08.753086 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72e065bc-bf1d-498f-9b6b-0c03ecd9d0be tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:08.862946 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-72e065bc-bf1d-498f-9b6b-0c03ecd9d0be tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:37:08.872370 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-72e065bc-bf1d-498f-9b6b-0c03ecd9d0be tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc" status: 200 len: 1187 microversion: 2.1 time: 0.143419 Jun 10 18:37:08.874566 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3349/6739] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:08 2022] GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc => generated 1187 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:09.896778 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-05659f5d-997d-4526-a1ae-4e06fe7fe600 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:09.898195 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-05659f5d-997d-4526-a1ae-4e06fe7fe600 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:09.907004 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-05659f5d-997d-4526-a1ae-4e06fe7fe600 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:09.907458 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-05659f5d-997d-4526-a1ae-4e06fe7fe600 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:09.910356 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-05659f5d-997d-4526-a1ae-4e06fe7fe600 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:09.910812 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-05659f5d-997d-4526-a1ae-4e06fe7fe600 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:10.002247 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-05659f5d-997d-4526-a1ae-4e06fe7fe600 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:37:10.026920 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-05659f5d-997d-4526-a1ae-4e06fe7fe600 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc" status: 200 len: 1187 microversion: 2.1 time: 0.137794 Jun 10 18:37:10.027552 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3391/6740] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:09 2022] GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc => generated 1187 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:10.545537 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d66e7507-0901-4877-a735-179cb0fd39b4 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:10.546259 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d66e7507-0901-4877-a735-179cb0fd39b4 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 483bd251-8106-439e-83d7-d7209125bbe7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:10.561455 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d66e7507-0901-4877-a735-179cb0fd39b4 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:10.564607 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d66e7507-0901-4877-a735-179cb0fd39b4 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:10.565742 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d66e7507-0901-4877-a735-179cb0fd39b4 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:10.567953 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d66e7507-0901-4877-a735-179cb0fd39b4 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:10.788578 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-34f042a0-a8b7-40e9-97b1-135458a7c1c4 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:10.790833 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:37:10.790833 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 18:37:10.791516 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-34f042a0-a8b7-40e9-97b1-135458a7c1c4 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:10.792403 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-34f042a0-a8b7-40e9-97b1-135458a7c1c4 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:10.793457 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-34f042a0-a8b7-40e9-97b1-135458a7c1c4 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:10.794120 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-34f042a0-a8b7-40e9-97b1-135458a7c1c4 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:10.841669 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-34f042a0-a8b7-40e9-97b1-135458a7c1c4 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.256248 Jun 10 18:37:10.842668 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3392/6741] 10.222.0.35 () {58 vars in 1184 bytes} [Fri Jun 10 18:37:10 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:37:10.882577 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d66e7507-0901-4877-a735-179cb0fd39b4 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:37:10.891808 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d66e7507-0901-4877-a735-179cb0fd39b4 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7" status: 200 len: 1681 microversion: 2.1 time: 0.351197 Jun 10 18:37:10.894063 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3350/6742] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:10 2022] GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7 => generated 1681 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:10.995686 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-63a122eb-75b1-4a37-9430-83ff79deb7fd tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-968163296", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "availability_zone": "nova:chh2-master-2", "networks": [{"uuid": "cbbed62a-d395-4d68-ae8a-ad516299041e"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:37:11.043960 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4a791b22-3672-4817-8e73-7a5d69325c7d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:11.045553 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4a791b22-3672-4817-8e73-7a5d69325c7d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:11.056970 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a791b22-3672-4817-8e73-7a5d69325c7d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:11.060521 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a791b22-3672-4817-8e73-7a5d69325c7d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:11.063373 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a791b22-3672-4817-8e73-7a5d69325c7d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:11.068535 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a791b22-3672-4817-8e73-7a5d69325c7d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:11.142403 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-63a122eb-75b1-4a37-9430-83ff79deb7fd tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] validate_networks() for [('cbbed62a-d395-4d68-ae8a-ad516299041e', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:37:11.188966 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4a791b22-3672-4817-8e73-7a5d69325c7d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:37:11.199993 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4a791b22-3672-4817-8e73-7a5d69325c7d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc" status: 200 len: 1187 microversion: 2.1 time: 0.158910 Jun 10 18:37:11.201404 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3351/6743] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:11 2022] GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc => generated 1187 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:37:11.207624 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b57fd463-315a-4eae-98fc-112593017823 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:37:11.208589 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b57fd463-315a-4eae-98fc-112593017823 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 483bd251-8106-439e-83d7-d7209125bbe7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:11.214856 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b57fd463-315a-4eae-98fc-112593017823 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:11.215317 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b57fd463-315a-4eae-98fc-112593017823 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:11.216222 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b57fd463-315a-4eae-98fc-112593017823 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:11.216637 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b57fd463-315a-4eae-98fc-112593017823 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:11.234819 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:37:11.278524 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b57fd463-315a-4eae-98fc-112593017823 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "POST /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7/action" status: 200 len: 32606 microversion: 2.1 time: 0.074887 Jun 10 18:37:11.280882 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3352/6744] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:37:11 2022] POST /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7/action => generated 32606 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:37:11.452041 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-086c0242-2229-4db7-8909-f3be1c69ea18 tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:11.452765 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-086c0242-2229-4db7-8909-f3be1c69ea18 tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] [instance: 483bd251-8106-439e-83d7-d7209125bbe7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:11.462299 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-086c0242-2229-4db7-8909-f3be1c69ea18 tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:11.463008 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-086c0242-2229-4db7-8909-f3be1c69ea18 tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:11.464574 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-086c0242-2229-4db7-8909-f3be1c69ea18 tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:11.465205 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-086c0242-2229-4db7-8909-f3be1c69ea18 tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:11.633280 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-086c0242-2229-4db7-8909-f3be1c69ea18 tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7" status: 200 len: 1832 microversion: 2.1 time: 0.185539 Jun 10 18:37:11.634242 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3353/6745] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:11 2022] GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7 => generated 1832 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:37:11.658465 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-78242042-fe34-4b2e-80cb-c061256d2f09 tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:37:11.659966 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-78242042-fe34-4b2e-80cb-c061256d2f09 tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] [instance: 483bd251-8106-439e-83d7-d7209125bbe7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:11.666570 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-78242042-fe34-4b2e-80cb-c061256d2f09 tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:11.667201 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-78242042-fe34-4b2e-80cb-c061256d2f09 tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:11.670324 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-78242042-fe34-4b2e-80cb-c061256d2f09 tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:11.670954 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-78242042-fe34-4b2e-80cb-c061256d2f09 tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:11.703562 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-78242042-fe34-4b2e-80cb-c061256d2f09 tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Lazy-loading 'flavor' on Instance uuid 483bd251-8106-439e-83d7-d7209125bbe7 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:37:11.704928 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-63a122eb-75b1-4a37-9430-83ff79deb7fd tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:37:11.705481 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-63a122eb-75b1-4a37-9430-83ff79deb7fd tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:37:11.708965 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-63a122eb-75b1-4a37-9430-83ff79deb7fd tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:37:11.708965 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-63a122eb-75b1-4a37-9430-83ff79deb7fd tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:37:11.708965 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-63a122eb-75b1-4a37-9430-83ff79deb7fd tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:37:11.721839 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-63a122eb-75b1-4a37-9430-83ff79deb7fd tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:11.722152 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-78242042-fe34-4b2e-80cb-c061256d2f09 tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] [instance: 483bd251-8106-439e-83d7-d7209125bbe7] Going to try to live migrate instance to another host {{(pid=126595) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 10 18:37:11.723632 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-63a122eb-75b1-4a37-9430-83ff79deb7fd tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:11.724943 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-63a122eb-75b1-4a37-9430-83ff79deb7fd tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:11.725613 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-63a122eb-75b1-4a37-9430-83ff79deb7fd tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:11.746975 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-63a122eb-75b1-4a37-9430-83ff79deb7fd tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Getting quotas for project e722d14caa21443b9d8015ac2f602d31. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:37:11.753044 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-63a122eb-75b1-4a37-9430-83ff79deb7fd tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Getting quotas for user 1377a3ad1eb84adda61246732b6a66f2 and project e722d14caa21443b9d8015ac2f602d31. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:37:11.765713 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-63a122eb-75b1-4a37-9430-83ff79deb7fd tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:37:11.768034 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-63a122eb-75b1-4a37-9430-83ff79deb7fd tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 7b36e988-f664-425e-b42d-9b45a7ac83ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:37:11.915741 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-63a122eb-75b1-4a37-9430-83ff79deb7fd tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.925855 Jun 10 18:37:11.917298 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3393/6746] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:37:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:37:11.927344 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-befff5f2-0b80-4e2f-b2b7-02023192d9f9 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:11.928540 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-befff5f2-0b80-4e2f-b2b7-02023192d9f9 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 7b36e988-f664-425e-b42d-9b45a7ac83ba] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:11.992544 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-befff5f2-0b80-4e2f-b2b7-02023192d9f9 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba" status: 200 len: 1328 microversion: 2.1 time: 0.068987 Jun 10 18:37:11.993572 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3394/6747] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:11 2022] GET /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba => generated 1328 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:12.218101 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-aa593dfa-a88a-4d1d-b836-bc2ba2c58cef tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:12.219433 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-aa593dfa-a88a-4d1d-b836-bc2ba2c58cef tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:12.230428 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aa593dfa-a88a-4d1d-b836-bc2ba2c58cef tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:12.233549 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aa593dfa-a88a-4d1d-b836-bc2ba2c58cef tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:12.233549 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aa593dfa-a88a-4d1d-b836-bc2ba2c58cef tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:12.233549 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aa593dfa-a88a-4d1d-b836-bc2ba2c58cef tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:12.319433 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-aa593dfa-a88a-4d1d-b836-bc2ba2c58cef tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:37:12.337279 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-aa593dfa-a88a-4d1d-b836-bc2ba2c58cef tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc" status: 200 len: 1187 microversion: 2.1 time: 0.122928 Jun 10 18:37:12.338022 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3395/6748] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:12 2022] GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc => generated 1187 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:13.021834 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e15e2f73-4a72-485b-9807-d46d51c39665 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:13.022738 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e15e2f73-4a72-485b-9807-d46d51c39665 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 7b36e988-f664-425e-b42d-9b45a7ac83ba] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:13.126961 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e15e2f73-4a72-485b-9807-d46d51c39665 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba" status: 200 len: 1328 microversion: 2.1 time: 0.120529 Jun 10 18:37:13.128432 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3396/6749] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:13 2022] GET /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba => generated 1328 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:13.355281 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-29fccd69-6dbf-45b5-ba5f-8574027df211 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:13.356764 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-29fccd69-6dbf-45b5-ba5f-8574027df211 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:13.373428 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-29fccd69-6dbf-45b5-ba5f-8574027df211 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:13.373902 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-29fccd69-6dbf-45b5-ba5f-8574027df211 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:13.378076 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-29fccd69-6dbf-45b5-ba5f-8574027df211 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:13.383156 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-29fccd69-6dbf-45b5-ba5f-8574027df211 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:13.511290 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-29fccd69-6dbf-45b5-ba5f-8574027df211 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:37:13.523234 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-29fccd69-6dbf-45b5-ba5f-8574027df211 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc" status: 200 len: 1187 microversion: 2.1 time: 0.172351 Jun 10 18:37:13.524099 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3397/6750] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:13 2022] GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc => generated 1187 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:14.144981 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b91f33f4-3be4-4e0e-a3c9-ac24e77e236f tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:14.145796 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b91f33f4-3be4-4e0e-a3c9-ac24e77e236f tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 7b36e988-f664-425e-b42d-9b45a7ac83ba] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:14.154175 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b91f33f4-3be4-4e0e-a3c9-ac24e77e236f tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:14.154792 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b91f33f4-3be4-4e0e-a3c9-ac24e77e236f tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:14.155880 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b91f33f4-3be4-4e0e-a3c9-ac24e77e236f tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:14.156576 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b91f33f4-3be4-4e0e-a3c9-ac24e77e236f tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:14.243070 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b91f33f4-3be4-4e0e-a3c9-ac24e77e236f tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba" status: 200 len: 1415 microversion: 2.1 time: 0.102314 Jun 10 18:37:14.251684 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3398/6751] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:14 2022] GET /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba => generated 1415 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:37:14.551058 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9cecbed0-a65a-40b9-821e-fe493ccc87d7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:14.552620 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9cecbed0-a65a-40b9-821e-fe493ccc87d7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:14.568884 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9cecbed0-a65a-40b9-821e-fe493ccc87d7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:14.573894 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9cecbed0-a65a-40b9-821e-fe493ccc87d7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:14.574900 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9cecbed0-a65a-40b9-821e-fe493ccc87d7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:14.575957 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9cecbed0-a65a-40b9-821e-fe493ccc87d7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:14.641796 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9cecbed0-a65a-40b9-821e-fe493ccc87d7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:14.642160 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9cecbed0-a65a-40b9-821e-fe493ccc87d7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:14.653079 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-9cecbed0-a65a-40b9-821e-fe493ccc87d7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lazy-loading 'fault' on Instance uuid 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:37:14.724103 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9cecbed0-a65a-40b9-821e-fe493ccc87d7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:37:14.737608 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9cecbed0-a65a-40b9-821e-fe493ccc87d7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc" status: 200 len: 1146 microversion: 2.1 time: 0.200360 Jun 10 18:37:14.748562 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3399/6752] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:14 2022] GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc => generated 1146 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:37:15.270550 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b961bc91-90a5-4cb5-b817-cb09c8dc5999 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:15.271486 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b961bc91-90a5-4cb5-b817-cb09c8dc5999 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 7b36e988-f664-425e-b42d-9b45a7ac83ba] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:15.280745 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b961bc91-90a5-4cb5-b817-cb09c8dc5999 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:15.281554 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b961bc91-90a5-4cb5-b817-cb09c8dc5999 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:15.282505 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b961bc91-90a5-4cb5-b817-cb09c8dc5999 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:15.287908 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b961bc91-90a5-4cb5-b817-cb09c8dc5999 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:15.327754 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:37:15.432888 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b961bc91-90a5-4cb5-b817-cb09c8dc5999 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba" status: 200 len: 1433 microversion: 2.1 time: 0.173862 Jun 10 18:37:15.433507 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3400/6753] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:15 2022] GET /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba => generated 1433 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:15.755644 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-19416c5e-5a7c-4180-9e5c-ab7b377fdccc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:15.756636 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-19416c5e-5a7c-4180-9e5c-ab7b377fdccc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:15.768956 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-19416c5e-5a7c-4180-9e5c-ab7b377fdccc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:15.769527 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-19416c5e-5a7c-4180-9e5c-ab7b377fdccc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:15.770946 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-19416c5e-5a7c-4180-9e5c-ab7b377fdccc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:15.771958 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-19416c5e-5a7c-4180-9e5c-ab7b377fdccc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:15.792089 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-19416c5e-5a7c-4180-9e5c-ab7b377fdccc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] HTTP exception thrown: Instance 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc could not be found. Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-19416c5e-5a7c-4180-9e5c-ab7b377fdccc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Request method failure captured: Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc HTTP/1.1 Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio48lCBpBlRizgNQmj6c6iu0oXkmc5Tm-q4miwv2Pj49f2pUTZFT27dYtKGefFULH5-gcByMQrPeG1d5YVOJ_GuLGrptrh59AcDYu37Uta2nd4eDA1xNIrohvrn1bdHxnfVCnt0fGjpM3LVpc7O3my-1igIi7pJV4HqsUallplG6Y66g Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 7e9c656d484843ffb1f2de092730345b Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_7e9c656d484843ffb1f2de092730345b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 7e9c656d484843ffb1f2de092730345b Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-TestVolumeBootPattern-1765437769-project Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: b469a8f9433d422aa98d22eea9df7071 Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-TestVolumeBootPattern-1765437769-project Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc could not be found. Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '471d0bde-ebc5-46f8-9dc3-cc705dc48fbc'} Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc could not be found. Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc could not be found. Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:37:15.794884 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:37:15.799138 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:37:15.799138 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:37:15.799138 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:37:15.799138 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:37:15.799138 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:37:15.799138 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc could not be found. Jun 10 18:37:15.799138 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:37:15.800154 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-19416c5e-5a7c-4180-9e5c-ab7b377fdccc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Returning 404 to user: Instance 471d0bde-ebc5-46f8-9dc3-cc705dc48fbc could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:37:15.801204 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-19416c5e-5a7c-4180-9e5c-ab7b377fdccc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc" status: 404 len: 111 microversion: 2.1 time: 0.050077 Jun 10 18:37:15.802518 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3401/6754] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:15 2022] GET /compute/v2.1/servers/471d0bde-ebc5-46f8-9dc3-cc705dc48fbc => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:37:16.111537 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-78242042-fe34-4b2e-80cb-c061256d2f09 tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] 10.222.0.35 "POST /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7/action" status: 202 len: 0 microversion: 2.1 time: 4.456776 Jun 10 18:37:16.116359 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3354/6755] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:37:11 2022] POST /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7/action => generated 0 bytes in 4462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:37:16.124444 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-135bd3bf-71b8-48de-8816-e75f43fd7e17 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:16.125624 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-135bd3bf-71b8-48de-8816-e75f43fd7e17 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 483bd251-8106-439e-83d7-d7209125bbe7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:16.138125 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-135bd3bf-71b8-48de-8816-e75f43fd7e17 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:16.138890 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-135bd3bf-71b8-48de-8816-e75f43fd7e17 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:16.139990 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-135bd3bf-71b8-48de-8816-e75f43fd7e17 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:16.140613 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-135bd3bf-71b8-48de-8816-e75f43fd7e17 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:16.450462 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-341a4e6a-e73a-4a28-a98f-c3b127e2b306 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:16.450959 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-341a4e6a-e73a-4a28-a98f-c3b127e2b306 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 7b36e988-f664-425e-b42d-9b45a7ac83ba] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:16.462955 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-341a4e6a-e73a-4a28-a98f-c3b127e2b306 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:16.463700 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-341a4e6a-e73a-4a28-a98f-c3b127e2b306 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:16.464725 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-341a4e6a-e73a-4a28-a98f-c3b127e2b306 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:16.465354 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-341a4e6a-e73a-4a28-a98f-c3b127e2b306 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:16.537283 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-135bd3bf-71b8-48de-8816-e75f43fd7e17 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:37:16.548923 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-135bd3bf-71b8-48de-8816-e75f43fd7e17 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7" status: 200 len: 1691 microversion: 2.1 time: 0.431559 Jun 10 18:37:16.550597 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3402/6756] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:16 2022] GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7 => generated 1691 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:16.711750 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-341a4e6a-e73a-4a28-a98f-c3b127e2b306 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba" status: 200 len: 1463 microversion: 2.1 time: 0.264497 Jun 10 18:37:16.713695 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3355/6757] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:16 2022] GET /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba => generated 1463 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:37:17.359774 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-96d53b5f-ef94-42db-a1eb-c1a62d478f49 req-6a4da591-2606-4838-b6b1-21906374650d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b36e988-f664-425e-b42d-9b45a7ac83ba", "tag": "63323a8e-81b6-470f-9946-869583b913f4"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:37:17.376911 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-96d53b5f-ef94-42db-a1eb-c1a62d478f49 req-6a4da591-2606-4838-b6b1-21906374650d service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:17.377371 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-96d53b5f-ef94-42db-a1eb-c1a62d478f49 req-6a4da591-2606-4838-b6b1-21906374650d service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:17.411749 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-96d53b5f-ef94-42db-a1eb-c1a62d478f49 req-6a4da591-2606-4838-b6b1-21906374650d service nova] Creating event network-changed:63323a8e-81b6-470f-9946-869583b913f4 for instance 7b36e988-f664-425e-b42d-9b45a7ac83ba on chh2-master-2 Jun 10 18:37:17.424862 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-96d53b5f-ef94-42db-a1eb-c1a62d478f49 req-6a4da591-2606-4838-b6b1-21906374650d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071555 Jun 10 18:37:17.425656 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3403/6758] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:37:17.571103 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-23bdf77e-a44a-4841-81ee-22fdbdbce9ea tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:17.572000 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-23bdf77e-a44a-4841-81ee-22fdbdbce9ea tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 483bd251-8106-439e-83d7-d7209125bbe7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:17.592766 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-23bdf77e-a44a-4841-81ee-22fdbdbce9ea tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:17.594902 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-23bdf77e-a44a-4841-81ee-22fdbdbce9ea tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:17.597153 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-23bdf77e-a44a-4841-81ee-22fdbdbce9ea tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:17.603307 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-23bdf77e-a44a-4841-81ee-22fdbdbce9ea tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:17.735703 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2405700f-5990-4911-a52b-e2ac75ce52b9 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:17.737421 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2405700f-5990-4911-a52b-e2ac75ce52b9 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 7b36e988-f664-425e-b42d-9b45a7ac83ba] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:17.756290 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2405700f-5990-4911-a52b-e2ac75ce52b9 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:17.757315 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2405700f-5990-4911-a52b-e2ac75ce52b9 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:17.758488 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2405700f-5990-4911-a52b-e2ac75ce52b9 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:17.759473 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2405700f-5990-4911-a52b-e2ac75ce52b9 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:17.862847 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-23bdf77e-a44a-4841-81ee-22fdbdbce9ea tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:37:17.871523 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-23bdf77e-a44a-4841-81ee-22fdbdbce9ea tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7" status: 200 len: 1691 microversion: 2.1 time: 0.305936 Jun 10 18:37:17.872221 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3356/6759] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:17 2022] GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7 => generated 1691 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:18.132531 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2405700f-5990-4911-a52b-e2ac75ce52b9 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba" status: 200 len: 1463 microversion: 2.1 time: 0.404210 Jun 10 18:37:18.134603 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3404/6760] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:17 2022] GET /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba => generated 1463 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:18.297352 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-fcc2746c-70c6-43aa-8edc-eac566da15af req-b898a06b-4a92-4a0f-bedd-96b8325c7623 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "483bd251-8106-439e-83d7-d7209125bbe7", "name": "network-vif-unplugged", "status": "completed", "tag": "ac70d592-697b-4f64-add0-1e44e2815260"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:37:18.301004 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:37:18.306301 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-fcc2746c-70c6-43aa-8edc-eac566da15af req-b898a06b-4a92-4a0f-bedd-96b8325c7623 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:18.306753 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-fcc2746c-70c6-43aa-8edc-eac566da15af req-b898a06b-4a92-4a0f-bedd-96b8325c7623 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:18.319045 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-fcc2746c-70c6-43aa-8edc-eac566da15af req-b898a06b-4a92-4a0f-bedd-96b8325c7623 service nova] Creating event network-vif-unplugged:ac70d592-697b-4f64-add0-1e44e2815260 for instance 483bd251-8106-439e-83d7-d7209125bbe7 on chh1-master-2 Jun 10 18:37:18.336003 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-fcc2746c-70c6-43aa-8edc-eac566da15af req-b898a06b-4a92-4a0f-bedd-96b8325c7623 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031331 Jun 10 18:37:18.338107 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3357/6761] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:37:18.891980 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-27000b8e-4435-4167-8670-f3d7f8908dc0 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:18.893719 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-27000b8e-4435-4167-8670-f3d7f8908dc0 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 483bd251-8106-439e-83d7-d7209125bbe7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:18.909975 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27000b8e-4435-4167-8670-f3d7f8908dc0 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:18.910482 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27000b8e-4435-4167-8670-f3d7f8908dc0 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:18.914820 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27000b8e-4435-4167-8670-f3d7f8908dc0 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:18.917143 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-27000b8e-4435-4167-8670-f3d7f8908dc0 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:19.170513 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-514c92ac-3ba7-450c-8fde-c91ee247acd4 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:19.171350 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-514c92ac-3ba7-450c-8fde-c91ee247acd4 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 7b36e988-f664-425e-b42d-9b45a7ac83ba] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:19.182566 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-514c92ac-3ba7-450c-8fde-c91ee247acd4 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:19.183597 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-514c92ac-3ba7-450c-8fde-c91ee247acd4 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:19.184694 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-514c92ac-3ba7-450c-8fde-c91ee247acd4 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:19.185914 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-514c92ac-3ba7-450c-8fde-c91ee247acd4 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:19.220265 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-27000b8e-4435-4167-8670-f3d7f8908dc0 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:37:19.239839 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-27000b8e-4435-4167-8670-f3d7f8908dc0 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7" status: 200 len: 1691 microversion: 2.1 time: 0.351143 Jun 10 18:37:19.242723 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3405/6762] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:18 2022] GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7 => generated 1691 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:19.444264 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-514c92ac-3ba7-450c-8fde-c91ee247acd4 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba" status: 200 len: 1463 microversion: 2.1 time: 0.296161 Jun 10 18:37:19.445202 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3358/6763] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:19 2022] GET /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba => generated 1463 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:37:20.258922 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-98e2af9f-709e-4e21-81ac-4de3060f138b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:20.259730 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-98e2af9f-709e-4e21-81ac-4de3060f138b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 483bd251-8106-439e-83d7-d7209125bbe7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:20.267713 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-98e2af9f-709e-4e21-81ac-4de3060f138b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:20.268156 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-98e2af9f-709e-4e21-81ac-4de3060f138b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:20.268960 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-98e2af9f-709e-4e21-81ac-4de3060f138b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:20.269403 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-98e2af9f-709e-4e21-81ac-4de3060f138b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:20.355789 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-dce0a0df-7f03-4a91-8580-a3e76e715f9c req-006d0d93-faea-4372-be00-3ab83231bc62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "483bd251-8106-439e-83d7-d7209125bbe7", "tag": "ac70d592-697b-4f64-add0-1e44e2815260"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:37:20.377759 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-dce0a0df-7f03-4a91-8580-a3e76e715f9c req-006d0d93-faea-4372-be00-3ab83231bc62 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:20.378430 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-dce0a0df-7f03-4a91-8580-a3e76e715f9c req-006d0d93-faea-4372-be00-3ab83231bc62 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:20.403091 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-dce0a0df-7f03-4a91-8580-a3e76e715f9c req-006d0d93-faea-4372-be00-3ab83231bc62 service nova] Creating event network-changed:ac70d592-697b-4f64-add0-1e44e2815260 for instance 483bd251-8106-439e-83d7-d7209125bbe7 on chh1-master-2 Jun 10 18:37:20.413562 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-dce0a0df-7f03-4a91-8580-a3e76e715f9c req-006d0d93-faea-4372-be00-3ab83231bc62 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064672 Jun 10 18:37:20.415446 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3359/6764] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:37:20.468286 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6e64c852-2154-438b-bfa7-1db245763685 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:20.468286 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6e64c852-2154-438b-bfa7-1db245763685 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 7b36e988-f664-425e-b42d-9b45a7ac83ba] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:20.477694 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6e64c852-2154-438b-bfa7-1db245763685 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:20.478148 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6e64c852-2154-438b-bfa7-1db245763685 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:20.478948 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6e64c852-2154-438b-bfa7-1db245763685 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:20.479398 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6e64c852-2154-438b-bfa7-1db245763685 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:20.506282 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-98e2af9f-709e-4e21-81ac-4de3060f138b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:37:20.520475 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-98e2af9f-709e-4e21-81ac-4de3060f138b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7" status: 200 len: 1691 microversion: 2.1 time: 0.264248 Jun 10 18:37:20.521088 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3406/6765] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:20 2022] GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7 => generated 1691 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:20.735633 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6e64c852-2154-438b-bfa7-1db245763685 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba" status: 200 len: 1463 microversion: 2.1 time: 0.277453 Jun 10 18:37:20.744398 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3360/6766] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:20 2022] GET /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba => generated 1463 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:37:21.542453 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d47471ab-5754-4eab-a38d-74bf1804641f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:21.542453 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d47471ab-5754-4eab-a38d-74bf1804641f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 483bd251-8106-439e-83d7-d7209125bbe7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:21.547021 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d47471ab-5754-4eab-a38d-74bf1804641f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:21.547592 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d47471ab-5754-4eab-a38d-74bf1804641f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:21.548509 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d47471ab-5754-4eab-a38d-74bf1804641f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:21.549023 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d47471ab-5754-4eab-a38d-74bf1804641f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:21.688190 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d47471ab-5754-4eab-a38d-74bf1804641f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:37:21.695843 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d47471ab-5754-4eab-a38d-74bf1804641f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7" status: 200 len: 1691 microversion: 2.1 time: 0.161828 Jun 10 18:37:21.696371 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3407/6767] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:21 2022] GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7 => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:21.752722 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bfa13c56-9ef9-4e51-ac22-87210cfef57a tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:21.753974 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bfa13c56-9ef9-4e51-ac22-87210cfef57a tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 7b36e988-f664-425e-b42d-9b45a7ac83ba] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:21.769858 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bfa13c56-9ef9-4e51-ac22-87210cfef57a tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:21.769858 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bfa13c56-9ef9-4e51-ac22-87210cfef57a tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:21.769858 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bfa13c56-9ef9-4e51-ac22-87210cfef57a tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:21.769858 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bfa13c56-9ef9-4e51-ac22-87210cfef57a tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:21.906447 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bfa13c56-9ef9-4e51-ac22-87210cfef57a tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba" status: 200 len: 1463 microversion: 2.1 time: 0.157295 Jun 10 18:37:21.907536 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3361/6768] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:21 2022] GET /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba => generated 1463 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:22.713096 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c12931d9-71f5-457e-a34f-73d95d26e9a9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:22.713954 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c12931d9-71f5-457e-a34f-73d95d26e9a9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 483bd251-8106-439e-83d7-d7209125bbe7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:22.716076 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=4 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:37:22.722918 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c12931d9-71f5-457e-a34f-73d95d26e9a9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:22.723377 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c12931d9-71f5-457e-a34f-73d95d26e9a9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:22.724361 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c12931d9-71f5-457e-a34f-73d95d26e9a9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:22.724812 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c12931d9-71f5-457e-a34f-73d95d26e9a9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:22.883244 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c12931d9-71f5-457e-a34f-73d95d26e9a9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:37:22.890944 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c12931d9-71f5-457e-a34f-73d95d26e9a9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7" status: 200 len: 1691 microversion: 2.1 time: 0.181827 Jun 10 18:37:22.891525 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3408/6769] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:22 2022] GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7 => generated 1691 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:22.923517 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-794bd171-381b-437b-8b87-56aedd855446 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:22.924113 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-794bd171-381b-437b-8b87-56aedd855446 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 7b36e988-f664-425e-b42d-9b45a7ac83ba] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:22.931943 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-794bd171-381b-437b-8b87-56aedd855446 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:22.932714 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-794bd171-381b-437b-8b87-56aedd855446 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:22.933557 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-794bd171-381b-437b-8b87-56aedd855446 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:22.934002 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-794bd171-381b-437b-8b87-56aedd855446 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:23.077559 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-794bd171-381b-437b-8b87-56aedd855446 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba" status: 200 len: 1463 microversion: 2.1 time: 0.158395 Jun 10 18:37:23.078159 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3362/6770] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:22 2022] GET /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba => generated 1463 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:23.908912 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cd992193-7884-4677-bab0-773ced5248cc tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:23.909628 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cd992193-7884-4677-bab0-773ced5248cc tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 483bd251-8106-439e-83d7-d7209125bbe7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:23.911511 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=10 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:37:23.917851 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cd992193-7884-4677-bab0-773ced5248cc tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:23.918310 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cd992193-7884-4677-bab0-773ced5248cc tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:23.919105 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cd992193-7884-4677-bab0-773ced5248cc tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:23.920141 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cd992193-7884-4677-bab0-773ced5248cc tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:24.065804 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cd992193-7884-4677-bab0-773ced5248cc tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:37:24.074411 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cd992193-7884-4677-bab0-773ced5248cc tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7" status: 200 len: 1691 microversion: 2.1 time: 0.169400 Jun 10 18:37:24.075161 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3409/6771] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:23 2022] GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7 => generated 1691 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:24.094812 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f985b816-216f-46d2-9297-c5d785d510de tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:24.095912 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f985b816-216f-46d2-9297-c5d785d510de tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 7b36e988-f664-425e-b42d-9b45a7ac83ba] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:24.104830 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f985b816-216f-46d2-9297-c5d785d510de tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:24.105741 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f985b816-216f-46d2-9297-c5d785d510de tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:24.106586 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f985b816-216f-46d2-9297-c5d785d510de tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:24.107701 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f985b816-216f-46d2-9297-c5d785d510de tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:24.277039 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f985b816-216f-46d2-9297-c5d785d510de tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba" status: 200 len: 1463 microversion: 2.1 time: 0.184234 Jun 10 18:37:24.279870 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3363/6772] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:24 2022] GET /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba => generated 1463 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:25.092994 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f10bb475-d93b-4521-b340-9819aa05a281 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:25.094111 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f10bb475-d93b-4521-b340-9819aa05a281 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 483bd251-8106-439e-83d7-d7209125bbe7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:25.102893 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f10bb475-d93b-4521-b340-9819aa05a281 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:25.103382 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f10bb475-d93b-4521-b340-9819aa05a281 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:25.104181 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f10bb475-d93b-4521-b340-9819aa05a281 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:25.104652 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f10bb475-d93b-4521-b340-9819aa05a281 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:25.287808 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f10bb475-d93b-4521-b340-9819aa05a281 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:37:25.298300 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3dcdf82c-143d-43a1-9d8b-5c676bad1c61 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:25.298890 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f10bb475-d93b-4521-b340-9819aa05a281 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7" status: 200 len: 1691 microversion: 2.1 time: 0.211570 Jun 10 18:37:25.299076 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3dcdf82c-143d-43a1-9d8b-5c676bad1c61 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 7b36e988-f664-425e-b42d-9b45a7ac83ba] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:25.299536 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3410/6773] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:25 2022] GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7 => generated 1691 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:25.309284 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3dcdf82c-143d-43a1-9d8b-5c676bad1c61 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:25.309893 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3dcdf82c-143d-43a1-9d8b-5c676bad1c61 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:25.310933 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3dcdf82c-143d-43a1-9d8b-5c676bad1c61 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:25.311446 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3dcdf82c-143d-43a1-9d8b-5c676bad1c61 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:25.478941 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3dcdf82c-143d-43a1-9d8b-5c676bad1c61 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba" status: 200 len: 1463 microversion: 2.1 time: 0.187258 Jun 10 18:37:25.481281 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3364/6774] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:25 2022] GET /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba => generated 1463 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:25.676663 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-e55526be-4d3d-4e86-8c86-f8243c4c6d6d req-e77c8950-9796-4400-80cd-ee9f6a071ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b36e988-f664-425e-b42d-9b45a7ac83ba", "name": "network-vif-plugged", "status": "completed", "tag": "63323a8e-81b6-470f-9946-869583b913f4"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:37:25.687519 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-e55526be-4d3d-4e86-8c86-f8243c4c6d6d req-e77c8950-9796-4400-80cd-ee9f6a071ed8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:25.687967 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-e55526be-4d3d-4e86-8c86-f8243c4c6d6d req-e77c8950-9796-4400-80cd-ee9f6a071ed8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:25.700990 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-e55526be-4d3d-4e86-8c86-f8243c4c6d6d req-e77c8950-9796-4400-80cd-ee9f6a071ed8 service nova] Creating event network-vif-plugged:63323a8e-81b6-470f-9946-869583b913f4 for instance 7b36e988-f664-425e-b42d-9b45a7ac83ba on chh2-master-2 Jun 10 18:37:25.706449 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-e55526be-4d3d-4e86-8c86-f8243c4c6d6d req-e77c8950-9796-4400-80cd-ee9f6a071ed8 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033800 Jun 10 18:37:25.707234 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3411/6775] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:37:26.315399 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2b76ce41-264f-4909-b29c-9ce7b8fe321a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:26.316014 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2b76ce41-264f-4909-b29c-9ce7b8fe321a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 483bd251-8106-439e-83d7-d7209125bbe7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:26.323430 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2b76ce41-264f-4909-b29c-9ce7b8fe321a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:26.323882 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2b76ce41-264f-4909-b29c-9ce7b8fe321a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:26.324690 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2b76ce41-264f-4909-b29c-9ce7b8fe321a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:26.325132 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2b76ce41-264f-4909-b29c-9ce7b8fe321a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:26.500488 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fb1afd3d-6c27-4517-981d-2635e444bfba tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:26.501471 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fb1afd3d-6c27-4517-981d-2635e444bfba tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 7b36e988-f664-425e-b42d-9b45a7ac83ba] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:26.502524 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2b76ce41-264f-4909-b29c-9ce7b8fe321a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:37:26.515517 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fb1afd3d-6c27-4517-981d-2635e444bfba tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:26.516994 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fb1afd3d-6c27-4517-981d-2635e444bfba tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:26.519316 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fb1afd3d-6c27-4517-981d-2635e444bfba tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:26.519772 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fb1afd3d-6c27-4517-981d-2635e444bfba tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:26.521753 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2b76ce41-264f-4909-b29c-9ce7b8fe321a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7" status: 200 len: 1691 microversion: 2.1 time: 0.206875 Jun 10 18:37:26.522660 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3365/6776] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:26 2022] GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7 => generated 1691 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:26.663223 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fb1afd3d-6c27-4517-981d-2635e444bfba tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba" status: 200 len: 1463 microversion: 2.1 time: 0.169494 Jun 10 18:37:26.663973 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3412/6777] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:26 2022] GET /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba => generated 1463 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:27.547484 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-53550179-9b48-4eea-9bbf-a04dbea87d68 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:27.549370 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-53550179-9b48-4eea-9bbf-a04dbea87d68 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 483bd251-8106-439e-83d7-d7209125bbe7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:27.557593 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-53550179-9b48-4eea-9bbf-a04dbea87d68 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:27.558319 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-53550179-9b48-4eea-9bbf-a04dbea87d68 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:27.559540 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-53550179-9b48-4eea-9bbf-a04dbea87d68 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:27.560684 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-53550179-9b48-4eea-9bbf-a04dbea87d68 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:27.683065 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f4bd7df7-d72e-45c1-8400-aa920a6151bf tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:27.683953 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f4bd7df7-d72e-45c1-8400-aa920a6151bf tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 7b36e988-f664-425e-b42d-9b45a7ac83ba] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:27.688271 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:37:27.701797 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4bd7df7-d72e-45c1-8400-aa920a6151bf tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:27.712603 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4bd7df7-d72e-45c1-8400-aa920a6151bf tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:27.714138 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4bd7df7-d72e-45c1-8400-aa920a6151bf tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:27.715346 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f4bd7df7-d72e-45c1-8400-aa920a6151bf tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:27.850938 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-53550179-9b48-4eea-9bbf-a04dbea87d68 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:37:27.870118 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-53550179-9b48-4eea-9bbf-a04dbea87d68 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7" status: 200 len: 1691 microversion: 2.1 time: 0.332181 Jun 10 18:37:27.871282 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3366/6778] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:27 2022] GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7 => generated 1691 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:27.889522 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-fa4d636a-7ab8-46a4-aeb7-b5dfe2825113 req-d718bc4c-dbe1-4b20-98cc-8947b80cd7fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "483bd251-8106-439e-83d7-d7209125bbe7", "name": "network-vif-unplugged", "status": "completed", "tag": "ac70d592-697b-4f64-add0-1e44e2815260"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:37:27.906955 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-fa4d636a-7ab8-46a4-aeb7-b5dfe2825113 req-d718bc4c-dbe1-4b20-98cc-8947b80cd7fa service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:27.906955 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-fa4d636a-7ab8-46a4-aeb7-b5dfe2825113 req-d718bc4c-dbe1-4b20-98cc-8947b80cd7fa service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:27.918793 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f4bd7df7-d72e-45c1-8400-aa920a6151bf tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba" status: 200 len: 1648 microversion: 2.1 time: 0.240158 Jun 10 18:37:27.920244 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3413/6779] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:27 2022] GET /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba => generated 1648 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:37:27.922546 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-fa4d636a-7ab8-46a4-aeb7-b5dfe2825113 req-d718bc4c-dbe1-4b20-98cc-8947b80cd7fa service nova] Creating event network-vif-unplugged:ac70d592-697b-4f64-add0-1e44e2815260 for instance 483bd251-8106-439e-83d7-d7209125bbe7 on chh1-master-2 Jun 10 18:37:27.927845 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-fa4d636a-7ab8-46a4-aeb7-b5dfe2825113 req-d718bc4c-dbe1-4b20-98cc-8947b80cd7fa service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052021 Jun 10 18:37:27.928927 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3367/6780] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:37:27.937924 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c49c0bf6-1946-450e-bfd1-8028c38b217f tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:27.938547 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c49c0bf6-1946-450e-bfd1-8028c38b217f tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 7b36e988-f664-425e-b42d-9b45a7ac83ba] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:27.945040 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c49c0bf6-1946-450e-bfd1-8028c38b217f tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:27.945686 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c49c0bf6-1946-450e-bfd1-8028c38b217f tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:27.946468 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c49c0bf6-1946-450e-bfd1-8028c38b217f tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:27.946913 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c49c0bf6-1946-450e-bfd1-8028c38b217f tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:28.097066 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c49c0bf6-1946-450e-bfd1-8028c38b217f tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba" status: 200 len: 1648 microversion: 2.1 time: 0.164994 Jun 10 18:37:28.097755 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3414/6781] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:27 2022] GET /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba => generated 1648 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:28.113848 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4a93fbb6-1fd2-4a8f-9e1f-fe0864999585 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:28.114836 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4a93fbb6-1fd2-4a8f-9e1f-fe0864999585 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 7b36e988-f664-425e-b42d-9b45a7ac83ba] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:28.121751 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a93fbb6-1fd2-4a8f-9e1f-fe0864999585 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:28.123036 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a93fbb6-1fd2-4a8f-9e1f-fe0864999585 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:28.123966 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a93fbb6-1fd2-4a8f-9e1f-fe0864999585 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:28.124447 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a93fbb6-1fd2-4a8f-9e1f-fe0864999585 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:28.394936 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4a93fbb6-1fd2-4a8f-9e1f-fe0864999585 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba" status: 200 len: 1648 microversion: 2.1 time: 0.285056 Jun 10 18:37:28.396480 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3368/6782] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:28 2022] GET /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba => generated 1648 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:28.551389 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f6b1dea6-4e0c-4df2-976c-99716acc0434 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1655271324", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "availability_zone": "nova:chh1-master-2", "networks": [{"uuid": "cbbed62a-d395-4d68-ae8a-ad516299041e"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:37:28.627303 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-f6b1dea6-4e0c-4df2-976c-99716acc0434 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] validate_networks() for [('cbbed62a-d395-4d68-ae8a-ad516299041e', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:37:28.894014 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3765e738-4f44-4edb-86e7-66801c3d45ec tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:28.894635 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3765e738-4f44-4edb-86e7-66801c3d45ec tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 483bd251-8106-439e-83d7-d7209125bbe7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:28.903548 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3765e738-4f44-4edb-86e7-66801c3d45ec tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:28.904999 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3765e738-4f44-4edb-86e7-66801c3d45ec tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:28.906403 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3765e738-4f44-4edb-86e7-66801c3d45ec tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:28.907293 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3765e738-4f44-4edb-86e7-66801c3d45ec tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:29.171964 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3765e738-4f44-4edb-86e7-66801c3d45ec tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:37:29.176920 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:37:29.182538 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3765e738-4f44-4edb-86e7-66801c3d45ec tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7" status: 200 len: 1691 microversion: 2.1 time: 0.297141 Jun 10 18:37:29.183890 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3369/6783] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:28 2022] GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7 => generated 1691 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:29.446001 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-f6b1dea6-4e0c-4df2-976c-99716acc0434 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:37:29.446001 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-f6b1dea6-4e0c-4df2-976c-99716acc0434 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:37:29.446001 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-f6b1dea6-4e0c-4df2-976c-99716acc0434 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:37:29.446001 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-f6b1dea6-4e0c-4df2-976c-99716acc0434 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:37:29.446001 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-f6b1dea6-4e0c-4df2-976c-99716acc0434 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:37:29.457121 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f6b1dea6-4e0c-4df2-976c-99716acc0434 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:29.457826 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f6b1dea6-4e0c-4df2-976c-99716acc0434 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:29.458784 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f6b1dea6-4e0c-4df2-976c-99716acc0434 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:29.460440 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f6b1dea6-4e0c-4df2-976c-99716acc0434 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:29.479770 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-f6b1dea6-4e0c-4df2-976c-99716acc0434 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Getting quotas for project e722d14caa21443b9d8015ac2f602d31. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:37:29.486546 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-f6b1dea6-4e0c-4df2-976c-99716acc0434 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Getting quotas for user 1377a3ad1eb84adda61246732b6a66f2 and project e722d14caa21443b9d8015ac2f602d31. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:37:29.500903 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f6b1dea6-4e0c-4df2-976c-99716acc0434 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:37:29.506717 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f6b1dea6-4e0c-4df2-976c-99716acc0434 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 841c4ff2-0dad-4d2b-86e1-569674fd3f54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:37:29.630029 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f6b1dea6-4e0c-4df2-976c-99716acc0434 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.082442 Jun 10 18:37:29.632187 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3415/6784] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:37:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1085 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:37:29.641955 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dcbdff7b-d488-4dba-8456-362301d2f38e tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:29.642894 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dcbdff7b-d488-4dba-8456-362301d2f38e tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 841c4ff2-0dad-4d2b-86e1-569674fd3f54] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:29.735949 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dcbdff7b-d488-4dba-8456-362301d2f38e tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/841c4ff2-0dad-4d2b-86e1-569674fd3f54" status: 200 len: 1329 microversion: 2.1 time: 0.096152 Jun 10 18:37:29.736922 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3370/6785] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:29 2022] GET /compute/v2.1/servers/841c4ff2-0dad-4d2b-86e1-569674fd3f54 => generated 1329 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:30.204056 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1052c60a-6c4b-4c58-869c-c95a9ee89fde tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:30.206651 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1052c60a-6c4b-4c58-869c-c95a9ee89fde tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 483bd251-8106-439e-83d7-d7209125bbe7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:30.215021 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1052c60a-6c4b-4c58-869c-c95a9ee89fde tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:30.216585 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1052c60a-6c4b-4c58-869c-c95a9ee89fde tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:30.217048 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1052c60a-6c4b-4c58-869c-c95a9ee89fde tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:30.217729 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1052c60a-6c4b-4c58-869c-c95a9ee89fde tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:30.456662 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1052c60a-6c4b-4c58-869c-c95a9ee89fde tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:37:30.476463 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1052c60a-6c4b-4c58-869c-c95a9ee89fde tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7" status: 200 len: 1691 microversion: 2.1 time: 0.272922 Jun 10 18:37:30.479916 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3416/6786] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:30 2022] GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7 => generated 1691 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:30.754985 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-67437808-5d5b-4609-ad42-a33b87a5e36e tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:30.755791 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-67437808-5d5b-4609-ad42-a33b87a5e36e tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 841c4ff2-0dad-4d2b-86e1-569674fd3f54] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:31.163949 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-67437808-5d5b-4609-ad42-a33b87a5e36e tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/841c4ff2-0dad-4d2b-86e1-569674fd3f54" status: 200 len: 1329 microversion: 2.1 time: 0.411332 Jun 10 18:37:31.165033 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3371/6787] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:30 2022] GET /compute/v2.1/servers/841c4ff2-0dad-4d2b-86e1-569674fd3f54 => generated 1329 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:37:31.494529 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4b1fccb5-0be7-46ec-a22d-8858447614ef tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:31.499818 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4b1fccb5-0be7-46ec-a22d-8858447614ef tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 483bd251-8106-439e-83d7-d7209125bbe7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:31.507773 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4b1fccb5-0be7-46ec-a22d-8858447614ef tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:31.508369 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4b1fccb5-0be7-46ec-a22d-8858447614ef tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:31.509430 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4b1fccb5-0be7-46ec-a22d-8858447614ef tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:31.510072 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4b1fccb5-0be7-46ec-a22d-8858447614ef tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:31.737154 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4b1fccb5-0be7-46ec-a22d-8858447614ef tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:37:31.746052 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4b1fccb5-0be7-46ec-a22d-8858447614ef tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7" status: 200 len: 1681 microversion: 2.1 time: 0.255271 Jun 10 18:37:31.747339 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3417/6788] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:31 2022] GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7 => generated 1681 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:31.764590 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-05ff5432-ac24-4047-a862-a37fdcaa6492 tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:31.766012 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-05ff5432-ac24-4047-a862-a37fdcaa6492 tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] [instance: 483bd251-8106-439e-83d7-d7209125bbe7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:31.773359 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05ff5432-ac24-4047-a862-a37fdcaa6492 tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:31.774097 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05ff5432-ac24-4047-a862-a37fdcaa6492 tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:31.774889 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05ff5432-ac24-4047-a862-a37fdcaa6492 tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:31.775334 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05ff5432-ac24-4047-a862-a37fdcaa6492 tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:31.939467 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-05ff5432-ac24-4047-a862-a37fdcaa6492 tempest-TestNetworkAdvancedServerOps-1927343348 tempest-TestNetworkAdvancedServerOps-1927343348-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7" status: 200 len: 1832 microversion: 2.1 time: 0.179912 Jun 10 18:37:31.940055 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3372/6789] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:31 2022] GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7 => generated 1832 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:31.957429 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5387797c-b6e6-4f47-950b-99c60e729529 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:31.961027 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5387797c-b6e6-4f47-950b-99c60e729529 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 483bd251-8106-439e-83d7-d7209125bbe7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:31.964842 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5387797c-b6e6-4f47-950b-99c60e729529 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:31.965555 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5387797c-b6e6-4f47-950b-99c60e729529 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:31.967186 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5387797c-b6e6-4f47-950b-99c60e729529 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:31.967903 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5387797c-b6e6-4f47-950b-99c60e729529 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:32.183656 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ad991860-2df9-4bec-bff1-a9c23eba6c7c tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:32.184542 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ad991860-2df9-4bec-bff1-a9c23eba6c7c tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 841c4ff2-0dad-4d2b-86e1-569674fd3f54] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:32.187455 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5387797c-b6e6-4f47-950b-99c60e729529 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:37:32.201048 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5387797c-b6e6-4f47-950b-99c60e729529 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7" status: 200 len: 1681 microversion: 2.1 time: 0.242909 Jun 10 18:37:32.201048 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3418/6790] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:31 2022] GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7 => generated 1681 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:32.206176 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad991860-2df9-4bec-bff1-a9c23eba6c7c tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:32.206782 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad991860-2df9-4bec-bff1-a9c23eba6c7c tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:32.207584 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad991860-2df9-4bec-bff1-a9c23eba6c7c tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:32.208029 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad991860-2df9-4bec-bff1-a9c23eba6c7c tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:32.408122 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ad991860-2df9-4bec-bff1-a9c23eba6c7c tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/841c4ff2-0dad-4d2b-86e1-569674fd3f54" status: 200 len: 1416 microversion: 2.1 time: 0.230714 Jun 10 18:37:32.412781 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3373/6791] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:32 2022] GET /compute/v2.1/servers/841c4ff2-0dad-4d2b-86e1-569674fd3f54 => generated 1416 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:37:33.435641 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-17cd7d47-42d6-444d-a98c-d9fab4cbf083 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:33.436442 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-17cd7d47-42d6-444d-a98c-d9fab4cbf083 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 841c4ff2-0dad-4d2b-86e1-569674fd3f54] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:33.456843 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-17cd7d47-42d6-444d-a98c-d9fab4cbf083 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:33.457348 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-17cd7d47-42d6-444d-a98c-d9fab4cbf083 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:33.458161 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-17cd7d47-42d6-444d-a98c-d9fab4cbf083 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:33.459752 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-17cd7d47-42d6-444d-a98c-d9fab4cbf083 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:33.692914 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=100 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:37:33.700529 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-17cd7d47-42d6-444d-a98c-d9fab4cbf083 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/841c4ff2-0dad-4d2b-86e1-569674fd3f54" status: 200 len: 1464 microversion: 2.1 time: 0.274235 Jun 10 18:37:33.702534 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3419/6792] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:33 2022] GET /compute/v2.1/servers/841c4ff2-0dad-4d2b-86e1-569674fd3f54 => generated 1464 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:34.360418 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1877e7e5-58e6-4b2f-8e9e-f6fb579a479f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:37:34.362178 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1877e7e5-58e6-4b2f-8e9e-f6fb579a479f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 483bd251-8106-439e-83d7-d7209125bbe7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:34.370139 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1877e7e5-58e6-4b2f-8e9e-f6fb579a479f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:34.370714 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1877e7e5-58e6-4b2f-8e9e-f6fb579a479f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:34.371500 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1877e7e5-58e6-4b2f-8e9e-f6fb579a479f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:34.372115 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1877e7e5-58e6-4b2f-8e9e-f6fb579a479f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:34.456741 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1877e7e5-58e6-4b2f-8e9e-f6fb579a479f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "POST /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7/action" status: 200 len: 38636 microversion: 2.1 time: 0.101603 Jun 10 18:37:34.460853 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3374/6793] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:37:34 2022] POST /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7/action => generated 38636 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:37:34.726859 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-dfa934aa-8e52-4be1-ad06-0a0f5e0c153d tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:34.728447 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-dfa934aa-8e52-4be1-ad06-0a0f5e0c153d tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 841c4ff2-0dad-4d2b-86e1-569674fd3f54] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:34.739092 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dfa934aa-8e52-4be1-ad06-0a0f5e0c153d tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:34.741787 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dfa934aa-8e52-4be1-ad06-0a0f5e0c153d tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:34.741787 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dfa934aa-8e52-4be1-ad06-0a0f5e0c153d tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:34.742446 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dfa934aa-8e52-4be1-ad06-0a0f5e0c153d tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:35.032208 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-dfa934aa-8e52-4be1-ad06-0a0f5e0c153d tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/841c4ff2-0dad-4d2b-86e1-569674fd3f54" status: 200 len: 1464 microversion: 2.1 time: 0.314782 Jun 10 18:37:35.041557 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3420/6794] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:34 2022] GET /compute/v2.1/servers/841c4ff2-0dad-4d2b-86e1-569674fd3f54 => generated 1464 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:35.823934 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-a8d6ee9f-8a83-424f-968d-3e147d216a9f req-273ec53e-06e5-42db-82e8-6f4963d3d66f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "841c4ff2-0dad-4d2b-86e1-569674fd3f54", "tag": "7532a933-0e82-4e40-a8d2-c49b910912b0"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:37:35.842445 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-a8d6ee9f-8a83-424f-968d-3e147d216a9f req-273ec53e-06e5-42db-82e8-6f4963d3d66f service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:35.843361 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-a8d6ee9f-8a83-424f-968d-3e147d216a9f req-273ec53e-06e5-42db-82e8-6f4963d3d66f service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:35.875454 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-a8d6ee9f-8a83-424f-968d-3e147d216a9f req-273ec53e-06e5-42db-82e8-6f4963d3d66f service nova] Creating event network-changed:7532a933-0e82-4e40-a8d2-c49b910912b0 for instance 841c4ff2-0dad-4d2b-86e1-569674fd3f54 on chh1-master-2 Jun 10 18:37:35.886230 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-a8d6ee9f-8a83-424f-968d-3e147d216a9f req-273ec53e-06e5-42db-82e8-6f4963d3d66f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063926 Jun 10 18:37:35.886230 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3375/6795] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:37:36.048551 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b5ee6b2d-bf44-4725-8bcb-464d19db9b36 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:36.049945 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b5ee6b2d-bf44-4725-8bcb-464d19db9b36 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 841c4ff2-0dad-4d2b-86e1-569674fd3f54] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:36.064727 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5ee6b2d-bf44-4725-8bcb-464d19db9b36 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:36.069349 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5ee6b2d-bf44-4725-8bcb-464d19db9b36 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:36.072455 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5ee6b2d-bf44-4725-8bcb-464d19db9b36 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:36.074179 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5ee6b2d-bf44-4725-8bcb-464d19db9b36 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:36.404194 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b5ee6b2d-bf44-4725-8bcb-464d19db9b36 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/841c4ff2-0dad-4d2b-86e1-569674fd3f54" status: 200 len: 1464 microversion: 2.1 time: 0.355836 Jun 10 18:37:36.405463 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3421/6796] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:36 2022] GET /compute/v2.1/servers/841c4ff2-0dad-4d2b-86e1-569674fd3f54 => generated 1464 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:36.571327 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-c1ccf092-c024-4387-8ff7-310002ae45f0 req-065d208d-415a-4ddb-ad9b-a22071eeffbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "483bd251-8106-439e-83d7-d7209125bbe7", "tag": "ac70d592-697b-4f64-add0-1e44e2815260"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:37:36.577613 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bb6c36cb-b066-47b9-bcfe-a431fc8d6c69 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:36.581828 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bb6c36cb-b066-47b9-bcfe-a431fc8d6c69 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 483bd251-8106-439e-83d7-d7209125bbe7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:36.597222 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-c1ccf092-c024-4387-8ff7-310002ae45f0 req-065d208d-415a-4ddb-ad9b-a22071eeffbe service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:36.597692 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-c1ccf092-c024-4387-8ff7-310002ae45f0 req-065d208d-415a-4ddb-ad9b-a22071eeffbe service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:36.599224 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb6c36cb-b066-47b9-bcfe-a431fc8d6c69 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:36.599685 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb6c36cb-b066-47b9-bcfe-a431fc8d6c69 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:36.600506 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb6c36cb-b066-47b9-bcfe-a431fc8d6c69 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:36.602456 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb6c36cb-b066-47b9-bcfe-a431fc8d6c69 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:36.634602 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-c1ccf092-c024-4387-8ff7-310002ae45f0 req-065d208d-415a-4ddb-ad9b-a22071eeffbe service nova] Creating event network-changed:ac70d592-697b-4f64-add0-1e44e2815260 for instance 483bd251-8106-439e-83d7-d7209125bbe7 on chh2-master-2 Jun 10 18:37:36.642892 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-c1ccf092-c024-4387-8ff7-310002ae45f0 req-065d208d-415a-4ddb-ad9b-a22071eeffbe service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074541 Jun 10 18:37:36.643988 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3422/6797] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:37:36.663946 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bb6c36cb-b066-47b9-bcfe-a431fc8d6c69 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 483bd251-8106-439e-83d7-d7209125bbe7] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:37:37.032168 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bb6c36cb-b066-47b9-bcfe-a431fc8d6c69 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "DELETE /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7" status: 204 len: 0 microversion: 2.1 time: 0.467995 Jun 10 18:37:37.033377 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3376/6798] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:37:36 2022] DELETE /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:37:37.048662 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5cc37bad-01b3-4493-afaf-acd7f90775be tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:37.048662 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5cc37bad-01b3-4493-afaf-acd7f90775be tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 483bd251-8106-439e-83d7-d7209125bbe7] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:37.052410 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5cc37bad-01b3-4493-afaf-acd7f90775be tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:37.053431 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5cc37bad-01b3-4493-afaf-acd7f90775be tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:37.054571 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5cc37bad-01b3-4493-afaf-acd7f90775be tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:37.056655 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5cc37bad-01b3-4493-afaf-acd7f90775be tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:37.425163 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-63ebd8d5-229a-428d-b9ad-626406780794 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:37.427753 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-63ebd8d5-229a-428d-b9ad-626406780794 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 841c4ff2-0dad-4d2b-86e1-569674fd3f54] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:37.444593 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-63ebd8d5-229a-428d-b9ad-626406780794 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:37.445054 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-63ebd8d5-229a-428d-b9ad-626406780794 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:37.445827 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-63ebd8d5-229a-428d-b9ad-626406780794 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:37.446270 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-63ebd8d5-229a-428d-b9ad-626406780794 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:37.696475 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5cc37bad-01b3-4493-afaf-acd7f90775be tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:37:37.710378 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5cc37bad-01b3-4493-afaf-acd7f90775be tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7" status: 200 len: 1687 microversion: 2.1 time: 0.670039 Jun 10 18:37:37.712696 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3423/6799] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:37 2022] GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7 => generated 1687 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:37:37.751477 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-63ebd8d5-229a-428d-b9ad-626406780794 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/841c4ff2-0dad-4d2b-86e1-569674fd3f54" status: 200 len: 1464 microversion: 2.1 time: 0.329817 Jun 10 18:37:37.759457 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3377/6800] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:37 2022] GET /compute/v2.1/servers/841c4ff2-0dad-4d2b-86e1-569674fd3f54 => generated 1464 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:38.676046 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-71cb6f33-1757-45eb-a736-4ce44c20e03c req-c94e6e14-c342-4daf-8bf7-735de9f9e0c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "483bd251-8106-439e-83d7-d7209125bbe7", "name": "network-vif-deleted", "tag": "ac70d592-697b-4f64-add0-1e44e2815260"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:37:38.684800 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-71cb6f33-1757-45eb-a736-4ce44c20e03c req-c94e6e14-c342-4daf-8bf7-735de9f9e0c2 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:38.685756 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-71cb6f33-1757-45eb-a736-4ce44c20e03c req-c94e6e14-c342-4daf-8bf7-735de9f9e0c2 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:38.696992 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-71cb6f33-1757-45eb-a736-4ce44c20e03c req-c94e6e14-c342-4daf-8bf7-735de9f9e0c2 service nova] Creating event network-vif-deleted:ac70d592-697b-4f64-add0-1e44e2815260 for instance 483bd251-8106-439e-83d7-d7209125bbe7 on chh2-master-2 Jun 10 18:37:38.701995 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-71cb6f33-1757-45eb-a736-4ce44c20e03c req-c94e6e14-c342-4daf-8bf7-735de9f9e0c2 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029821 Jun 10 18:37:38.702600 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3424/6801] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:37:38.733865 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c3403d03-6c06-449f-a8ab-f80e8384f8bd tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:38.734912 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c3403d03-6c06-449f-a8ab-f80e8384f8bd tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 483bd251-8106-439e-83d7-d7209125bbe7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:38.741784 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c3403d03-6c06-449f-a8ab-f80e8384f8bd tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:38.742169 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c3403d03-6c06-449f-a8ab-f80e8384f8bd tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:38.743022 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c3403d03-6c06-449f-a8ab-f80e8384f8bd tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:38.743543 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c3403d03-6c06-449f-a8ab-f80e8384f8bd tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:38.770417 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-dfa2b38f-da26-4054-82c8-f0732f7286cd tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:38.777463 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-dfa2b38f-da26-4054-82c8-f0732f7286cd tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 841c4ff2-0dad-4d2b-86e1-569674fd3f54] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:38.785631 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dfa2b38f-da26-4054-82c8-f0732f7286cd tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:38.793056 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dfa2b38f-da26-4054-82c8-f0732f7286cd tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:38.793931 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dfa2b38f-da26-4054-82c8-f0732f7286cd tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:38.797121 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-dfa2b38f-da26-4054-82c8-f0732f7286cd tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:38.846939 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c3403d03-6c06-449f-a8ab-f80e8384f8bd tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:37:38.860220 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c3403d03-6c06-449f-a8ab-f80e8384f8bd tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7" status: 200 len: 1501 microversion: 2.1 time: 0.131136 Jun 10 18:37:38.861169 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3378/6802] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:38 2022] GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7 => generated 1501 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:38.984628 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-dfa2b38f-da26-4054-82c8-f0732f7286cd tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/841c4ff2-0dad-4d2b-86e1-569674fd3f54" status: 200 len: 1464 microversion: 2.1 time: 0.219064 Jun 10 18:37:38.986307 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3425/6803] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:38 2022] GET /compute/v2.1/servers/841c4ff2-0dad-4d2b-86e1-569674fd3f54 => generated 1464 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:37:39.877994 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2e8367a3-7878-4d69-b3e6-58addef2ba71 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:39.878588 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2e8367a3-7878-4d69-b3e6-58addef2ba71 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 483bd251-8106-439e-83d7-d7209125bbe7] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:39.891108 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e8367a3-7878-4d69-b3e6-58addef2ba71 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:39.891108 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e8367a3-7878-4d69-b3e6-58addef2ba71 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:39.891108 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e8367a3-7878-4d69-b3e6-58addef2ba71 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:39.891108 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e8367a3-7878-4d69-b3e6-58addef2ba71 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:39.903080 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-2e8367a3-7878-4d69-b3e6-58addef2ba71 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] HTTP exception thrown: Instance 483bd251-8106-439e-83d7-d7209125bbe7 could not be found. Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2e8367a3-7878-4d69-b3e6-58addef2ba71 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Request method failure captured: Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7 HTTP/1.1 Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio43CIIZRNjb-0MeWb3vSViVXry-4quvMwA-hBljqKpiB6nnPbm4yr81WFzlQ2LY4R_BwzHI9K4qKlBZRuaAUhn7ebWvkqA-OmRlonhi_sWh_BF0eIBDo55Jeg8m_3Z24vWfOlNkH5Uyaf3Vs_VtyXvkIne8zHY4JCWnu-w0Ien9U850 Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 4089a2104afe4f1ab69f1b7983e4735d Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-88591049 Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/4089a2104afe4f1ab69f1b7983e4735d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/4089a2104afe4f1ab69f1b7983e4735d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/4089a2104afe4f1ab69f1b7983e4735d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_4089a2104afe4f1ab69f1b7983e4735d", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-TestNetworkAdvancedServerOps-88591049 Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 4089a2104afe4f1ab69f1b7983e4735d Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-88591049 Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-TestNetworkAdvancedServerOps-88591049-project Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 9d5fe9478d2b47e3b87cecc86d40773c Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-TestNetworkAdvancedServerOps-88591049-project Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 483bd251-8106-439e-83d7-d7209125bbe7 could not be found. Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '483bd251-8106-439e-83d7-d7209125bbe7'} Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 483bd251-8106-439e-83d7-d7209125bbe7 could not be found. Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 483bd251-8106-439e-83d7-d7209125bbe7 could not be found. Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:37:39.905105 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:37:39.908996 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:37:39.908996 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:37:39.908996 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:37:39.908996 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:37:39.908996 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:37:39.908996 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 483bd251-8106-439e-83d7-d7209125bbe7 could not be found. Jun 10 18:37:39.908996 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:37:39.908996 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2e8367a3-7878-4d69-b3e6-58addef2ba71 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Returning 404 to user: Instance 483bd251-8106-439e-83d7-d7209125bbe7 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:37:39.908996 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2e8367a3-7878-4d69-b3e6-58addef2ba71 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7" status: 404 len: 111 microversion: 2.1 time: 0.032384 Jun 10 18:37:39.908996 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3379/6804] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:39 2022] GET /compute/v2.1/servers/483bd251-8106-439e-83d7-d7209125bbe7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:37:40.002550 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-71bd16ec-7281-4fe6-83af-e96805de2841 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:40.003118 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-71bd16ec-7281-4fe6-83af-e96805de2841 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 841c4ff2-0dad-4d2b-86e1-569674fd3f54] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:40.005053 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:37:40.005982 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=6 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:37:40.011663 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-71bd16ec-7281-4fe6-83af-e96805de2841 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:40.012451 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-71bd16ec-7281-4fe6-83af-e96805de2841 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:40.013314 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-71bd16ec-7281-4fe6-83af-e96805de2841 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:40.013757 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-71bd16ec-7281-4fe6-83af-e96805de2841 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:40.172276 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-71bd16ec-7281-4fe6-83af-e96805de2841 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/841c4ff2-0dad-4d2b-86e1-569674fd3f54" status: 200 len: 1464 microversion: 2.1 time: 0.173579 Jun 10 18:37:40.173255 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3426/6805] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:39 2022] GET /compute/v2.1/servers/841c4ff2-0dad-4d2b-86e1-569674fd3f54 => generated 1464 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:41.189920 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-166468c0-5b7d-4f0a-81bd-1929c65c423c tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:41.190594 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-166468c0-5b7d-4f0a-81bd-1929c65c423c tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 841c4ff2-0dad-4d2b-86e1-569674fd3f54] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:41.193883 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:37:41.207408 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-166468c0-5b7d-4f0a-81bd-1929c65c423c tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:41.207865 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-166468c0-5b7d-4f0a-81bd-1929c65c423c tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:41.208689 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-166468c0-5b7d-4f0a-81bd-1929c65c423c tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:41.209132 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-166468c0-5b7d-4f0a-81bd-1929c65c423c tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:41.489773 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-166468c0-5b7d-4f0a-81bd-1929c65c423c tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/841c4ff2-0dad-4d2b-86e1-569674fd3f54" status: 200 len: 1464 microversion: 2.1 time: 0.303541 Jun 10 18:37:41.491181 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3380/6806] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:41 2022] GET /compute/v2.1/servers/841c4ff2-0dad-4d2b-86e1-569674fd3f54 => generated 1464 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:42.508766 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8097f551-c73d-4f28-9abe-2e2bf8d8f0b1 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:42.509543 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8097f551-c73d-4f28-9abe-2e2bf8d8f0b1 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 841c4ff2-0dad-4d2b-86e1-569674fd3f54] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:42.517220 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8097f551-c73d-4f28-9abe-2e2bf8d8f0b1 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:42.517762 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8097f551-c73d-4f28-9abe-2e2bf8d8f0b1 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:42.518555 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8097f551-c73d-4f28-9abe-2e2bf8d8f0b1 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:42.519212 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8097f551-c73d-4f28-9abe-2e2bf8d8f0b1 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:42.780204 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8097f551-c73d-4f28-9abe-2e2bf8d8f0b1 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/841c4ff2-0dad-4d2b-86e1-569674fd3f54" status: 200 len: 1464 microversion: 2.1 time: 0.276219 Jun 10 18:37:42.781195 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3427/6807] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:42 2022] GET /compute/v2.1/servers/841c4ff2-0dad-4d2b-86e1-569674fd3f54 => generated 1464 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:43.323183 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-114262e5-598a-414c-a70b-81ec8eafbf72 req-8b02a53a-17ab-44b9-8e0e-994d85f18e64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "841c4ff2-0dad-4d2b-86e1-569674fd3f54", "name": "network-vif-plugged", "status": "completed", "tag": "7532a933-0e82-4e40-a8d2-c49b910912b0"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:37:43.335508 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-114262e5-598a-414c-a70b-81ec8eafbf72 req-8b02a53a-17ab-44b9-8e0e-994d85f18e64 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:43.342223 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-114262e5-598a-414c-a70b-81ec8eafbf72 req-8b02a53a-17ab-44b9-8e0e-994d85f18e64 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:43.388987 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-114262e5-598a-414c-a70b-81ec8eafbf72 req-8b02a53a-17ab-44b9-8e0e-994d85f18e64 service nova] Creating event network-vif-plugged:7532a933-0e82-4e40-a8d2-c49b910912b0 for instance 841c4ff2-0dad-4d2b-86e1-569674fd3f54 on chh1-master-2 Jun 10 18:37:43.398074 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-114262e5-598a-414c-a70b-81ec8eafbf72 req-8b02a53a-17ab-44b9-8e0e-994d85f18e64 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079274 Jun 10 18:37:43.399428 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3381/6808] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:37:43.802822 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0dc0ec4e-3730-4486-86bb-5ccdeba0b653 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:43.803605 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0dc0ec4e-3730-4486-86bb-5ccdeba0b653 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 841c4ff2-0dad-4d2b-86e1-569674fd3f54] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:43.827250 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0dc0ec4e-3730-4486-86bb-5ccdeba0b653 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:43.827805 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0dc0ec4e-3730-4486-86bb-5ccdeba0b653 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:43.828551 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0dc0ec4e-3730-4486-86bb-5ccdeba0b653 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:43.829004 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0dc0ec4e-3730-4486-86bb-5ccdeba0b653 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:44.365025 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0dc0ec4e-3730-4486-86bb-5ccdeba0b653 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/841c4ff2-0dad-4d2b-86e1-569674fd3f54" status: 200 len: 1464 microversion: 2.1 time: 0.570390 Jun 10 18:37:44.365626 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3428/6809] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:43 2022] GET /compute/v2.1/servers/841c4ff2-0dad-4d2b-86e1-569674fd3f54 => generated 1464 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:45.352729 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-23ae02fd-bd02-4c07-9b6f-4465522e19eb tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '.version_select at 0x7f77c02f9c10>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:45.386270 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b5fc5a1a-8992-473f-bf87-d93bc4f7d5ed tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:45.387054 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b5fc5a1a-8992-473f-bf87-d93bc4f7d5ed tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 841c4ff2-0dad-4d2b-86e1-569674fd3f54] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:45.397945 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5fc5a1a-8992-473f-bf87-d93bc4f7d5ed tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:45.397945 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5fc5a1a-8992-473f-bf87-d93bc4f7d5ed tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:45.397945 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5fc5a1a-8992-473f-bf87-d93bc4f7d5ed tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:45.397945 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b5fc5a1a-8992-473f-bf87-d93bc4f7d5ed tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:45.469026 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-23ae02fd-bd02-4c07-9b6f-4465522e19eb tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-679419336" status: 202 len: 0 microversion: 2.1 time: 0.121612 Jun 10 18:37:45.470109 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3382/6810] 10.222.0.35 () {58 vars in 1280 bytes} [Fri Jun 10 18:37:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-679419336 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:37:45.512002 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f7a707d7-d541-4f6e-930c-7624f88045a0 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Action: 'create', calling method: .version_select at 0x7f77c04995e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2134666518", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFKJRHsmv9GquLTdAHJKgOsE2eNIc20RmKrOdcQNXfKvnEQOXAvUmHxjq1nbV3ee52TjTAC3v6/eaxToB2H1iBnpjXnPCqo99aIBzg5v9uSJorGMSe6rKcuxwEvuSwE5g=="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:37:45.533961 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-f7a707d7-d541-4f6e-930c-7624f88045a0 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Getting quotas for project 4089a2104afe4f1ab69f1b7983e4735d. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:37:45.539831 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-f7a707d7-d541-4f6e-930c-7624f88045a0 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Getting quotas for user 9d5fe9478d2b47e3b87cecc86d40773c and project 4089a2104afe4f1ab69f1b7983e4735d. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:37:45.561373 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b5fc5a1a-8992-473f-bf87-d93bc4f7d5ed tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/841c4ff2-0dad-4d2b-86e1-569674fd3f54" status: 200 len: 1650 microversion: 2.1 time: 0.182661 Jun 10 18:37:45.562208 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3429/6811] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:45 2022] GET /compute/v2.1/servers/841c4ff2-0dad-4d2b-86e1-569674fd3f54 => generated 1650 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:37:45.584159 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8059d38c-399e-4ae1-b193-d8f00804d383 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:45.585018 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8059d38c-399e-4ae1-b193-d8f00804d383 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 841c4ff2-0dad-4d2b-86e1-569674fd3f54] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:45.592116 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8059d38c-399e-4ae1-b193-d8f00804d383 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:45.599617 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8059d38c-399e-4ae1-b193-d8f00804d383 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:45.599617 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8059d38c-399e-4ae1-b193-d8f00804d383 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:45.599617 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8059d38c-399e-4ae1-b193-d8f00804d383 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:45.669159 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f7a707d7-d541-4f6e-930c-7624f88045a0 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.161728 Jun 10 18:37:45.670412 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3383/6812] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 18:37:45 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:37:45.737293 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8059d38c-399e-4ae1-b193-d8f00804d383 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/841c4ff2-0dad-4d2b-86e1-569674fd3f54" status: 200 len: 1650 microversion: 2.1 time: 0.158476 Jun 10 18:37:45.737904 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3430/6813] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:45 2022] GET /compute/v2.1/servers/841c4ff2-0dad-4d2b-86e1-569674fd3f54 => generated 1650 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:45.753457 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3e948367-8f39-443a-bcd9-e3295408fb98 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:45.754234 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3e948367-8f39-443a-bcd9-e3295408fb98 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 841c4ff2-0dad-4d2b-86e1-569674fd3f54] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:45.760669 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3e948367-8f39-443a-bcd9-e3295408fb98 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:45.761130 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3e948367-8f39-443a-bcd9-e3295408fb98 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:45.761905 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3e948367-8f39-443a-bcd9-e3295408fb98 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:45.762350 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3e948367-8f39-443a-bcd9-e3295408fb98 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:45.916032 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3e948367-8f39-443a-bcd9-e3295408fb98 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/841c4ff2-0dad-4d2b-86e1-569674fd3f54" status: 200 len: 1650 microversion: 2.1 time: 0.166215 Jun 10 18:37:45.916659 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3384/6814] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:45 2022] GET /compute/v2.1/servers/841c4ff2-0dad-4d2b-86e1-569674fd3f54 => generated 1650 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:45.933072 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f27a645a-7042-4cdf-a8aa-a5ce094ca5af tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:45.933491 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f27a645a-7042-4cdf-a8aa-a5ce094ca5af tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 841c4ff2-0dad-4d2b-86e1-569674fd3f54] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:45.940507 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f27a645a-7042-4cdf-a8aa-a5ce094ca5af tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:45.940968 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f27a645a-7042-4cdf-a8aa-a5ce094ca5af tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:45.941745 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f27a645a-7042-4cdf-a8aa-a5ce094ca5af tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:45.942337 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f27a645a-7042-4cdf-a8aa-a5ce094ca5af tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:45.972615 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f27a645a-7042-4cdf-a8aa-a5ce094ca5af tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 841c4ff2-0dad-4d2b-86e1-569674fd3f54] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:37:46.419968 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f27a645a-7042-4cdf-a8aa-a5ce094ca5af tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "DELETE /compute/v2.1/servers/841c4ff2-0dad-4d2b-86e1-569674fd3f54" status: 204 len: 0 microversion: 2.1 time: 0.489862 Jun 10 18:37:46.425004 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3431/6815] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:37:45 2022] DELETE /compute/v2.1/servers/841c4ff2-0dad-4d2b-86e1-569674fd3f54 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:37:46.431965 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-60a22d9c-d60f-462f-8251-c2d6071195b6 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:46.433216 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-60a22d9c-d60f-462f-8251-c2d6071195b6 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 841c4ff2-0dad-4d2b-86e1-569674fd3f54] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:46.442753 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-60a22d9c-d60f-462f-8251-c2d6071195b6 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:46.443215 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-60a22d9c-d60f-462f-8251-c2d6071195b6 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:46.444031 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-60a22d9c-d60f-462f-8251-c2d6071195b6 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:46.444511 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-60a22d9c-d60f-462f-8251-c2d6071195b6 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:46.617897 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-60a22d9c-d60f-462f-8251-c2d6071195b6 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/841c4ff2-0dad-4d2b-86e1-569674fd3f54" status: 200 len: 1656 microversion: 2.1 time: 0.189725 Jun 10 18:37:46.618473 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3385/6816] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:46 2022] GET /compute/v2.1/servers/841c4ff2-0dad-4d2b-86e1-569674fd3f54 => generated 1656 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:47.635981 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6cbaa14f-7c16-4928-8c2b-42192402ca25 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:47.636777 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6cbaa14f-7c16-4928-8c2b-42192402ca25 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 841c4ff2-0dad-4d2b-86e1-569674fd3f54] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:47.645091 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6cbaa14f-7c16-4928-8c2b-42192402ca25 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:47.645542 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6cbaa14f-7c16-4928-8c2b-42192402ca25 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:47.646396 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6cbaa14f-7c16-4928-8c2b-42192402ca25 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:47.646899 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6cbaa14f-7c16-4928-8c2b-42192402ca25 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:47.858577 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6cbaa14f-7c16-4928-8c2b-42192402ca25 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/841c4ff2-0dad-4d2b-86e1-569674fd3f54" status: 200 len: 1656 microversion: 2.1 time: 0.226907 Jun 10 18:37:47.859237 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3432/6817] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:47 2022] GET /compute/v2.1/servers/841c4ff2-0dad-4d2b-86e1-569674fd3f54 => generated 1656 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:48.329611 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-9ba9ce52-a182-41a0-baee-0d2edc37463b req-dedd5435-a3ce-429c-81c0-de5cd123a9ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "841c4ff2-0dad-4d2b-86e1-569674fd3f54", "name": "network-vif-deleted", "tag": "7532a933-0e82-4e40-a8d2-c49b910912b0"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:37:48.339419 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-9ba9ce52-a182-41a0-baee-0d2edc37463b req-dedd5435-a3ce-429c-81c0-de5cd123a9ec service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:48.339967 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-9ba9ce52-a182-41a0-baee-0d2edc37463b req-dedd5435-a3ce-429c-81c0-de5cd123a9ec service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:48.353666 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-9ba9ce52-a182-41a0-baee-0d2edc37463b req-dedd5435-a3ce-429c-81c0-de5cd123a9ec service nova] Creating event network-vif-deleted:7532a933-0e82-4e40-a8d2-c49b910912b0 for instance 841c4ff2-0dad-4d2b-86e1-569674fd3f54 on chh1-master-2 Jun 10 18:37:48.360844 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-9ba9ce52-a182-41a0-baee-0d2edc37463b req-dedd5435-a3ce-429c-81c0-de5cd123a9ec service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036707 Jun 10 18:37:48.361774 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3386/6818] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:37:48.875618 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d9f7b667-4cf5-494e-9a21-d1b94bded3d8 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:48.876282 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d9f7b667-4cf5-494e-9a21-d1b94bded3d8 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 841c4ff2-0dad-4d2b-86e1-569674fd3f54] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:48.883132 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d9f7b667-4cf5-494e-9a21-d1b94bded3d8 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:48.883585 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d9f7b667-4cf5-494e-9a21-d1b94bded3d8 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:48.884373 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d9f7b667-4cf5-494e-9a21-d1b94bded3d8 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:48.884811 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d9f7b667-4cf5-494e-9a21-d1b94bded3d8 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:48.915629 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d9f7b667-4cf5-494e-9a21-d1b94bded3d8 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:48.916076 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d9f7b667-4cf5-494e-9a21-d1b94bded3d8 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:48.916565 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-d9f7b667-4cf5-494e-9a21-d1b94bded3d8 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lazy-loading 'fault' on Instance uuid 841c4ff2-0dad-4d2b-86e1-569674fd3f54 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:37:48.964722 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d9f7b667-4cf5-494e-9a21-d1b94bded3d8 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/841c4ff2-0dad-4d2b-86e1-569674fd3f54" status: 200 len: 1454 microversion: 2.1 time: 0.092824 Jun 10 18:37:48.965298 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3433/6819] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:48 2022] GET /compute/v2.1/servers/841c4ff2-0dad-4d2b-86e1-569674fd3f54 => generated 1454 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:49.986545 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-61c9fe10-93ea-430b-b890-129133a2bfa7 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:49.986545 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-61c9fe10-93ea-430b-b890-129133a2bfa7 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 841c4ff2-0dad-4d2b-86e1-569674fd3f54] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:49.992815 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-61c9fe10-93ea-430b-b890-129133a2bfa7 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:49.993267 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-61c9fe10-93ea-430b-b890-129133a2bfa7 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:49.994043 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-61c9fe10-93ea-430b-b890-129133a2bfa7 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:49.994656 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-61c9fe10-93ea-430b-b890-129133a2bfa7 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:50.009288 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-61c9fe10-93ea-430b-b890-129133a2bfa7 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] HTTP exception thrown: Instance 841c4ff2-0dad-4d2b-86e1-569674fd3f54 could not be found. Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-61c9fe10-93ea-430b-b890-129133a2bfa7 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Request method failure captured: Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/841c4ff2-0dad-4d2b-86e1-569674fd3f54 HTTP/1.1 Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio49W8Jv2-28e_aAHz6nxNIoEKD_5hdr2HJACif5jAZn89yFqi1DXIAs9rMblKm3Q3Pu5iNB2S2ojMWATOQRh5cH19E9TZB7VBtx8oSgk15yvcNe0o5lHkBf3kC7S9rigjMAe221FhmrxH7EJ_pocA3mimlAqUfQjM3YUOBMeNyaLRVY Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: e722d14caa21443b9d8015ac2f602d31 Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-TestServerMultinode-963398908 Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member,admin Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member,admin Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/e722d14caa21443b9d8015ac2f602d31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/e722d14caa21443b9d8015ac2f602d31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/e722d14caa21443b9d8015ac2f602d31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_e722d14caa21443b9d8015ac2f602d31", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-TestServerMultinode-963398908 Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: e722d14caa21443b9d8015ac2f602d31 Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-TestServerMultinode-963398908 Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-TestServerMultinode-963398908-project-admin Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 1377a3ad1eb84adda61246732b6a66f2 Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-TestServerMultinode-963398908-project-admin Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 841c4ff2-0dad-4d2b-86e1-569674fd3f54 could not be found. Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '841c4ff2-0dad-4d2b-86e1-569674fd3f54'} Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 841c4ff2-0dad-4d2b-86e1-569674fd3f54 could not be found. Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 841c4ff2-0dad-4d2b-86e1-569674fd3f54 could not be found. Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:37:50.011717 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:37:50.016878 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:37:50.016878 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:37:50.016878 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:37:50.016878 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:37:50.016878 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:37:50.016878 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 841c4ff2-0dad-4d2b-86e1-569674fd3f54 could not be found. Jun 10 18:37:50.016878 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:37:50.016878 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-61c9fe10-93ea-430b-b890-129133a2bfa7 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Returning 404 to user: Instance 841c4ff2-0dad-4d2b-86e1-569674fd3f54 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:37:50.016878 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-61c9fe10-93ea-430b-b890-129133a2bfa7 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/841c4ff2-0dad-4d2b-86e1-569674fd3f54" status: 404 len: 111 microversion: 2.1 time: 0.033547 Jun 10 18:37:50.016878 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3387/6820] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:49 2022] GET /compute/v2.1/servers/841c4ff2-0dad-4d2b-86e1-569674fd3f54 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:37:50.021402 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-96a5a9d0-3379-46a0-86a9-9a36b4a26fea tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:50.021942 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-96a5a9d0-3379-46a0-86a9-9a36b4a26fea tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 7b36e988-f664-425e-b42d-9b45a7ac83ba] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:50.029881 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-96a5a9d0-3379-46a0-86a9-9a36b4a26fea tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:50.038242 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-96a5a9d0-3379-46a0-86a9-9a36b4a26fea tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:50.038242 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-96a5a9d0-3379-46a0-86a9-9a36b4a26fea tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:50.038242 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-96a5a9d0-3379-46a0-86a9-9a36b4a26fea tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:50.062304 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-96a5a9d0-3379-46a0-86a9-9a36b4a26fea tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 7b36e988-f664-425e-b42d-9b45a7ac83ba] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:37:50.114795 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:37:50.485049 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-96a5a9d0-3379-46a0-86a9-9a36b4a26fea tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "DELETE /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba" status: 204 len: 0 microversion: 2.1 time: 0.467067 Jun 10 18:37:50.485884 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3434/6821] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:37:50 2022] DELETE /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:37:50.493889 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3d0f746f-1574-4a47-92e3-51944d2f40d9 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:50.494509 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3d0f746f-1574-4a47-92e3-51944d2f40d9 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 7b36e988-f664-425e-b42d-9b45a7ac83ba] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:50.497095 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:37:50.502902 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3d0f746f-1574-4a47-92e3-51944d2f40d9 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:50.503663 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3d0f746f-1574-4a47-92e3-51944d2f40d9 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:50.504659 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3d0f746f-1574-4a47-92e3-51944d2f40d9 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:50.505267 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3d0f746f-1574-4a47-92e3-51944d2f40d9 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:50.686234 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3d0f746f-1574-4a47-92e3-51944d2f40d9 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba" status: 200 len: 1654 microversion: 2.1 time: 0.195924 Jun 10 18:37:50.686844 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3388/6822] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:50 2022] GET /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba => generated 1654 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:51.703994 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ecca0a26-7e65-4069-9947-168cdeb41526 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:51.704848 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ecca0a26-7e65-4069-9947-168cdeb41526 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 7b36e988-f664-425e-b42d-9b45a7ac83ba] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:51.713321 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ecca0a26-7e65-4069-9947-168cdeb41526 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:51.713707 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ecca0a26-7e65-4069-9947-168cdeb41526 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:51.714498 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ecca0a26-7e65-4069-9947-168cdeb41526 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:51.714938 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ecca0a26-7e65-4069-9947-168cdeb41526 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:51.856104 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ecca0a26-7e65-4069-9947-168cdeb41526 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba" status: 200 len: 1654 microversion: 2.1 time: 0.156507 Jun 10 18:37:51.866253 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3435/6823] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:51 2022] GET /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba => generated 1654 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:52.873533 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dccb7634-ef25-459a-adc8-a454a4005484 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:52.874749 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dccb7634-ef25-459a-adc8-a454a4005484 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 7b36e988-f664-425e-b42d-9b45a7ac83ba] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:52.882192 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dccb7634-ef25-459a-adc8-a454a4005484 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:52.882907 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dccb7634-ef25-459a-adc8-a454a4005484 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:52.883912 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dccb7634-ef25-459a-adc8-a454a4005484 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:52.884549 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dccb7634-ef25-459a-adc8-a454a4005484 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:53.004658 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dccb7634-ef25-459a-adc8-a454a4005484 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba" status: 200 len: 1612 microversion: 2.1 time: 0.135310 Jun 10 18:37:53.027875 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3389/6824] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:52 2022] GET /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba => generated 1612 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:53.085193 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-a0c28576-ea3e-4545-b1f6-e1a44723b78f req-a66b97fb-7756-4b75-be8e-06451d3b4525 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b36e988-f664-425e-b42d-9b45a7ac83ba", "name": "network-vif-deleted", "tag": "63323a8e-81b6-470f-9946-869583b913f4"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:37:53.100729 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-a0c28576-ea3e-4545-b1f6-e1a44723b78f req-a66b97fb-7756-4b75-be8e-06451d3b4525 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:53.102254 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-a0c28576-ea3e-4545-b1f6-e1a44723b78f req-a66b97fb-7756-4b75-be8e-06451d3b4525 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:53.116188 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-a0c28576-ea3e-4545-b1f6-e1a44723b78f req-a66b97fb-7756-4b75-be8e-06451d3b4525 service nova] Creating event network-vif-deleted:63323a8e-81b6-470f-9946-869583b913f4 for instance 7b36e988-f664-425e-b42d-9b45a7ac83ba on chh2-master-2 Jun 10 18:37:53.123318 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-a0c28576-ea3e-4545-b1f6-e1a44723b78f req-a66b97fb-7756-4b75-be8e-06451d3b4525 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041650 Jun 10 18:37:53.124121 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3436/6825] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:37:54.023685 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0223ca93-11bf-486e-b4a8-5ac1b367f000 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:54.024299 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0223ca93-11bf-486e-b4a8-5ac1b367f000 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 7b36e988-f664-425e-b42d-9b45a7ac83ba] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:54.039939 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0223ca93-11bf-486e-b4a8-5ac1b367f000 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:54.040970 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0223ca93-11bf-486e-b4a8-5ac1b367f000 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:54.041980 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0223ca93-11bf-486e-b4a8-5ac1b367f000 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:54.042576 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0223ca93-11bf-486e-b4a8-5ac1b367f000 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:54.081451 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0223ca93-11bf-486e-b4a8-5ac1b367f000 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:54.081899 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0223ca93-11bf-486e-b4a8-5ac1b367f000 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:54.082384 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-0223ca93-11bf-486e-b4a8-5ac1b367f000 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lazy-loading 'fault' on Instance uuid 7b36e988-f664-425e-b42d-9b45a7ac83ba {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:37:54.183663 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0223ca93-11bf-486e-b4a8-5ac1b367f000 tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba" status: 200 len: 1453 microversion: 2.1 time: 0.165594 Jun 10 18:37:54.184257 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3390/6826] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:54 2022] GET /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba => generated 1453 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:55.203732 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a9f3939f-ec67-4fb0-958d-e83dcc8d2abd tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:55.205180 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a9f3939f-ec67-4fb0-958d-e83dcc8d2abd tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] [instance: 7b36e988-f664-425e-b42d-9b45a7ac83ba] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:55.224150 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a9f3939f-ec67-4fb0-958d-e83dcc8d2abd tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:55.227372 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a9f3939f-ec67-4fb0-958d-e83dcc8d2abd tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:55.229480 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a9f3939f-ec67-4fb0-958d-e83dcc8d2abd tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:55.229980 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a9f3939f-ec67-4fb0-958d-e83dcc8d2abd tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:55.276549 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-a9f3939f-ec67-4fb0-958d-e83dcc8d2abd tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] HTTP exception thrown: Instance 7b36e988-f664-425e-b42d-9b45a7ac83ba could not be found. Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a9f3939f-ec67-4fb0-958d-e83dcc8d2abd tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Request method failure captured: Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba HTTP/1.1 Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio49W8Jv2-28e_aAHz6nxNIoEKD_5hdr2HJACif5jAZn89yFqi1DXIAs9rMblKm3Q3Pu5iNB2S2ojMWATOQRh5cH19E9TZB7VBtx8oSgk15yvcNe0o5lHkBf3kC7S9rigjMAe221FhmrxH7EJ_pocA3mimlAqUfQjM3YUOBMeNyaLRVY Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: e722d14caa21443b9d8015ac2f602d31 Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-TestServerMultinode-963398908 Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member,admin Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member,admin Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/e722d14caa21443b9d8015ac2f602d31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/e722d14caa21443b9d8015ac2f602d31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/e722d14caa21443b9d8015ac2f602d31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_e722d14caa21443b9d8015ac2f602d31", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-TestServerMultinode-963398908 Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: e722d14caa21443b9d8015ac2f602d31 Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-TestServerMultinode-963398908 Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-TestServerMultinode-963398908-project-admin Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 1377a3ad1eb84adda61246732b6a66f2 Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-TestServerMultinode-963398908-project-admin Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 7b36e988-f664-425e-b42d-9b45a7ac83ba could not be found. Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '7b36e988-f664-425e-b42d-9b45a7ac83ba'} Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b36e988-f664-425e-b42d-9b45a7ac83ba could not be found. Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b36e988-f664-425e-b42d-9b45a7ac83ba could not be found. Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:37:55.281721 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:37:55.286261 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:37:55.286261 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:37:55.286261 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:37:55.286261 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:37:55.286261 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:37:55.286261 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b36e988-f664-425e-b42d-9b45a7ac83ba could not be found. Jun 10 18:37:55.286261 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:37:55.286261 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a9f3939f-ec67-4fb0-958d-e83dcc8d2abd tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] Returning 404 to user: Instance 7b36e988-f664-425e-b42d-9b45a7ac83ba could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:37:55.288811 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a9f3939f-ec67-4fb0-958d-e83dcc8d2abd tempest-TestServerMultinode-963398908 tempest-TestServerMultinode-963398908-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba" status: 404 len: 111 microversion: 2.1 time: 0.086823 Jun 10 18:37:55.290302 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3437/6827] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:55 2022] GET /compute/v2.1/servers/7b36e988-f664-425e-b42d-9b45a7ac83ba => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:37:55.742036 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a876d655-f0cb-41a4-bc22-48a9abdae7a7 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:55.742528 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a876d655-f0cb-41a4-bc22-48a9abdae7a7 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] [instance: 7408ba2e-3085-49c7-af8e-b66aee17b1c5] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:55.750362 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:37:55.759475 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a876d655-f0cb-41a4-bc22-48a9abdae7a7 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:55.760270 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a876d655-f0cb-41a4-bc22-48a9abdae7a7 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:55.761290 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a876d655-f0cb-41a4-bc22-48a9abdae7a7 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:55.767774 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a876d655-f0cb-41a4-bc22-48a9abdae7a7 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:55.813505 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a876d655-f0cb-41a4-bc22-48a9abdae7a7 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] 10.222.0.35 "GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.073493 Jun 10 18:37:55.814628 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3391/6828] 10.222.0.35 () {58 vars in 1292 bytes} [Fri Jun 10 18:37:55 2022] GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5/os-server-password => generated 116 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:37:56.452065 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e1705878-368b-4234-beb5-4c2291134de9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1728417837", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "f429be83-14f9-44e1-a8b1-198a90b4e6c6", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "b7773285-a55f-44ca-92fc-1f9b6eadbe45"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:37:56.671100 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-e1705878-368b-4234-beb5-4c2291134de9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] validate_networks() for [('b7773285-a55f-44ca-92fc-1f9b6eadbe45', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:37:57.807858 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-e1705878-368b-4234-beb5-4c2291134de9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:37:57.809123 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-e1705878-368b-4234-beb5-4c2291134de9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:37:57.810427 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-e1705878-368b-4234-beb5-4c2291134de9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:37:57.811877 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-e1705878-368b-4234-beb5-4c2291134de9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:37:57.812584 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-e1705878-368b-4234-beb5-4c2291134de9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:37:57.834437 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e1705878-368b-4234-beb5-4c2291134de9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:57.834437 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e1705878-368b-4234-beb5-4c2291134de9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:57.834437 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e1705878-368b-4234-beb5-4c2291134de9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:57.834437 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e1705878-368b-4234-beb5-4c2291134de9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:57.863212 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-e1705878-368b-4234-beb5-4c2291134de9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Getting quotas for project 7e9c656d484843ffb1f2de092730345b. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:37:57.876270 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-e1705878-368b-4234-beb5-4c2291134de9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Getting quotas for user b469a8f9433d422aa98d22eea9df7071 and project 7e9c656d484843ffb1f2de092730345b. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:37:57.892222 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:37:57.894203 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e1705878-368b-4234-beb5-4c2291134de9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:37:57.896722 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e1705878-368b-4234-beb5-4c2291134de9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='f429be83-14f9-44e1-a8b1-198a90b4e6c6',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:37:58.114387 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e1705878-368b-4234-beb5-4c2291134de9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.671749 Jun 10 18:37:58.115043 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3438/6829] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:37:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:37:58.127480 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-92858b70-9307-4d2e-accf-e2fec766e0ec tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:58.128406 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-92858b70-9307-4d2e-accf-e2fec766e0ec tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:58.157668 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8004aa4d-f985-4220-8cba-dac27e8a4d5a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1820065573", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "b82671eb-c8be-4d8f-8e0e-1748d7178600"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2134666518", "security_groups": [{"name": "tempest-secgroup-smoke-934568007"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:37:58.253088 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-92858b70-9307-4d2e-accf-e2fec766e0ec tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:37:58.277856 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-92858b70-9307-4d2e-accf-e2fec766e0ec tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1057 microversion: 2.1 time: 0.152148 Jun 10 18:37:58.277856 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3392/6830] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:58 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1057 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:37:58.430989 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-8004aa4d-f985-4220-8cba-dac27e8a4d5a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] validate_networks() for [('b82671eb-c8be-4d8f-8e0e-1748d7178600', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:37:59.293794 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-436415f7-809c-40a8-8151-886e9b7ec016 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:59.295577 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-436415f7-809c-40a8-8151-886e9b7ec016 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:59.317730 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-436415f7-809c-40a8-8151-886e9b7ec016 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:59.318206 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-436415f7-809c-40a8-8151-886e9b7ec016 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:59.318998 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-436415f7-809c-40a8-8151-886e9b7ec016 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:59.327302 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-436415f7-809c-40a8-8151-886e9b7ec016 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:59.368735 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:37:59.400548 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-8004aa4d-f985-4220-8cba-dac27e8a4d5a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:37:59.401116 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-8004aa4d-f985-4220-8cba-dac27e8a4d5a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:37:59.401895 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-8004aa4d-f985-4220-8cba-dac27e8a4d5a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:37:59.402520 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-8004aa4d-f985-4220-8cba-dac27e8a4d5a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:37:59.403183 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-8004aa4d-f985-4220-8cba-dac27e8a4d5a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:37:59.425242 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8004aa4d-f985-4220-8cba-dac27e8a4d5a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:59.426815 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8004aa4d-f985-4220-8cba-dac27e8a4d5a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:59.427880 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8004aa4d-f985-4220-8cba-dac27e8a4d5a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:37:59.429586 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8004aa4d-f985-4220-8cba-dac27e8a4d5a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:37:59.500652 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-8004aa4d-f985-4220-8cba-dac27e8a4d5a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Getting quotas for project 4089a2104afe4f1ab69f1b7983e4735d. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:37:59.518106 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-8004aa4d-f985-4220-8cba-dac27e8a4d5a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Getting quotas for user 9d5fe9478d2b47e3b87cecc86d40773c and project 4089a2104afe4f1ab69f1b7983e4735d. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:37:59.555924 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8004aa4d-f985-4220-8cba-dac27e8a4d5a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:37:59.556616 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-436415f7-809c-40a8-8151-886e9b7ec016 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:37:59.562395 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8004aa4d-f985-4220-8cba-dac27e8a4d5a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:37:59.570925 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-436415f7-809c-40a8-8151-886e9b7ec016 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1061 microversion: 2.1 time: 0.282502 Jun 10 18:37:59.582047 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3393/6831] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:59 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1061 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:37:59.722701 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8004aa4d-f985-4220-8cba-dac27e8a4d5a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.569199 Jun 10 18:37:59.724149 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3439/6832] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:37:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 1572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:37:59.734365 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dafee414-87c6-43d8-b42f-d3fe4dfb66f8 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:37:59.735104 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dafee414-87c6-43d8-b42f-d3fe4dfb66f8 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:37:59.819644 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-dafee414-87c6-43d8-b42f-d3fe4dfb66f8 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:37:59.839134 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dafee414-87c6-43d8-b42f-d3fe4dfb66f8 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a" status: 200 len: 1267 microversion: 2.1 time: 0.105999 Jun 10 18:37:59.842058 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3394/6833] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:37:59 2022] GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a => generated 1267 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:00.597934 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8036f5bc-caa5-46a8-963c-ac3715078e75 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:00.599550 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8036f5bc-caa5-46a8-963c-ac3715078e75 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:00.619759 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8036f5bc-caa5-46a8-963c-ac3715078e75 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:00.620786 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8036f5bc-caa5-46a8-963c-ac3715078e75 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:00.623347 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8036f5bc-caa5-46a8-963c-ac3715078e75 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:00.625053 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8036f5bc-caa5-46a8-963c-ac3715078e75 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:00.735230 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8036f5bc-caa5-46a8-963c-ac3715078e75 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:00.747492 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8036f5bc-caa5-46a8-963c-ac3715078e75 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1117 microversion: 2.1 time: 0.162493 Jun 10 18:38:00.748357 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3440/6834] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:00 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1117 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:00.864376 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1e3304d4-92b0-4a06-ba2b-0b75b94a64b7 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:00.870633 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1e3304d4-92b0-4a06-ba2b-0b75b94a64b7 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:00.881763 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1e3304d4-92b0-4a06-ba2b-0b75b94a64b7 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:00.882371 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1e3304d4-92b0-4a06-ba2b-0b75b94a64b7 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:00.883264 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1e3304d4-92b0-4a06-ba2b-0b75b94a64b7 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:00.883839 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1e3304d4-92b0-4a06-ba2b-0b75b94a64b7 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:01.291991 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1e3304d4-92b0-4a06-ba2b-0b75b94a64b7 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:01.305465 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1e3304d4-92b0-4a06-ba2b-0b75b94a64b7 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a" status: 200 len: 1271 microversion: 2.1 time: 0.444923 Jun 10 18:38:01.306074 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3395/6835] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:00 2022] GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a => generated 1271 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:01.766755 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8d72ed14-45e2-4e19-87a6-52541bee01ac tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:01.769123 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8d72ed14-45e2-4e19-87a6-52541bee01ac tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:01.797101 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8d72ed14-45e2-4e19-87a6-52541bee01ac tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:01.800464 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8d72ed14-45e2-4e19-87a6-52541bee01ac tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:01.801903 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8d72ed14-45e2-4e19-87a6-52541bee01ac tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:01.802640 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8d72ed14-45e2-4e19-87a6-52541bee01ac tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:01.930443 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8d72ed14-45e2-4e19-87a6-52541bee01ac tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:01.985911 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8d72ed14-45e2-4e19-87a6-52541bee01ac tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1127 microversion: 2.1 time: 0.222773 Jun 10 18:38:02.000402 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3441/6836] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:01 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1127 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:02.325063 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-54fa26c3-e42e-4680-b0f1-488d935b0b61 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:02.326647 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-54fa26c3-e42e-4680-b0f1-488d935b0b61 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:02.334523 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-54fa26c3-e42e-4680-b0f1-488d935b0b61 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:02.335209 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-54fa26c3-e42e-4680-b0f1-488d935b0b61 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:02.336368 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-54fa26c3-e42e-4680-b0f1-488d935b0b61 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:02.336963 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-54fa26c3-e42e-4680-b0f1-488d935b0b61 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:02.501521 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-54fa26c3-e42e-4680-b0f1-488d935b0b61 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:02.512190 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-54fa26c3-e42e-4680-b0f1-488d935b0b61 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a" status: 200 len: 1327 microversion: 2.1 time: 0.192896 Jun 10 18:38:02.516416 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3396/6837] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:02 2022] GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a => generated 1327 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:03.005188 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fc357311-e555-40b6-ab4d-cb7d6af05751 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:03.006657 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fc357311-e555-40b6-ab4d-cb7d6af05751 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:03.019255 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fc357311-e555-40b6-ab4d-cb7d6af05751 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:03.020684 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fc357311-e555-40b6-ab4d-cb7d6af05751 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:03.021687 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fc357311-e555-40b6-ab4d-cb7d6af05751 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:03.022590 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-fc357311-e555-40b6-ab4d-cb7d6af05751 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:03.468483 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fc357311-e555-40b6-ab4d-cb7d6af05751 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:03.477052 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fc357311-e555-40b6-ab4d-cb7d6af05751 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1169 microversion: 2.1 time: 0.475868 Jun 10 18:38:03.487123 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3442/6838] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:02 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1169 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:03.551231 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6c513036-7cb6-4f6a-a13c-df528638bab4 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:03.551896 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6c513036-7cb6-4f6a-a13c-df528638bab4 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:03.564198 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6c513036-7cb6-4f6a-a13c-df528638bab4 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:03.564691 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6c513036-7cb6-4f6a-a13c-df528638bab4 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:03.565570 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6c513036-7cb6-4f6a-a13c-df528638bab4 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:03.567395 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6c513036-7cb6-4f6a-a13c-df528638bab4 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:03.940269 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6c513036-7cb6-4f6a-a13c-df528638bab4 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:03.954334 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6c513036-7cb6-4f6a-a13c-df528638bab4 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a" status: 200 len: 1325 microversion: 2.1 time: 0.406458 Jun 10 18:38:03.957090 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3397/6839] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:03 2022] GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a => generated 1325 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:04.499368 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-20385196-0d14-49e4-8211-46080a5452fd tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:04.500001 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-20385196-0d14-49e4-8211-46080a5452fd tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:04.514649 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-20385196-0d14-49e4-8211-46080a5452fd tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:04.515137 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-20385196-0d14-49e4-8211-46080a5452fd tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:04.524352 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-20385196-0d14-49e4-8211-46080a5452fd tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:04.524808 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-20385196-0d14-49e4-8211-46080a5452fd tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:04.980179 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-12fe8590-2bc4-4c22-bd89-441b0c06fdc3 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:04.985623 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-12fe8590-2bc4-4c22-bd89-441b0c06fdc3 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:05.004036 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-12fe8590-2bc4-4c22-bd89-441b0c06fdc3 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:05.004593 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-12fe8590-2bc4-4c22-bd89-441b0c06fdc3 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:05.005453 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-12fe8590-2bc4-4c22-bd89-441b0c06fdc3 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:05.005903 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-12fe8590-2bc4-4c22-bd89-441b0c06fdc3 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:05.492069 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-20385196-0d14-49e4-8211-46080a5452fd tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:05.503839 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-20385196-0d14-49e4-8211-46080a5452fd tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1169 microversion: 2.1 time: 1.012611 Jun 10 18:38:05.513232 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3443/6840] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:04 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1169 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:05.546984 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-12fe8590-2bc4-4c22-bd89-441b0c06fdc3 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:05.572404 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-12fe8590-2bc4-4c22-bd89-441b0c06fdc3 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a" status: 200 len: 1392 microversion: 2.1 time: 0.596089 Jun 10 18:38:05.573511 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3398/6841] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:04 2022] GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a => generated 1392 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:06.048691 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-ae69b024-fcde-4a99-9d13-9e0355525de0 req-ad311fb7-3708-471a-a28c-a7d6ffb1e03c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1facd35-ee11-47ae-9c44-ea67d49a267f", "tag": "e6ffbc29-6aa3-4650-9d49-91776ee727c2"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:38:06.060162 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-ae69b024-fcde-4a99-9d13-9e0355525de0 req-ad311fb7-3708-471a-a28c-a7d6ffb1e03c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:06.070447 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-ae69b024-fcde-4a99-9d13-9e0355525de0 req-ad311fb7-3708-471a-a28c-a7d6ffb1e03c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:06.096407 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-ae69b024-fcde-4a99-9d13-9e0355525de0 req-ad311fb7-3708-471a-a28c-a7d6ffb1e03c service nova] Creating event network-changed:e6ffbc29-6aa3-4650-9d49-91776ee727c2 for instance f1facd35-ee11-47ae-9c44-ea67d49a267f on chh1-master-2 Jun 10 18:38:06.106361 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-ae69b024-fcde-4a99-9d13-9e0355525de0 req-ad311fb7-3708-471a-a28c-a7d6ffb1e03c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061721 Jun 10 18:38:06.132825 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3444/6842] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:38:06.520501 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0e7b64c2-2236-4588-be78-85b76841eb03 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:06.521944 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0e7b64c2-2236-4588-be78-85b76841eb03 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:06.529820 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0e7b64c2-2236-4588-be78-85b76841eb03 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:06.530641 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0e7b64c2-2236-4588-be78-85b76841eb03 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:06.531821 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0e7b64c2-2236-4588-be78-85b76841eb03 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:06.532515 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0e7b64c2-2236-4588-be78-85b76841eb03 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:06.598144 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3bd7058a-82b9-4ac4-97e3-c4da8fa0b305 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:06.600509 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3bd7058a-82b9-4ac4-97e3-c4da8fa0b305 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:06.608347 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3bd7058a-82b9-4ac4-97e3-c4da8fa0b305 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:06.609219 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3bd7058a-82b9-4ac4-97e3-c4da8fa0b305 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:06.610255 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3bd7058a-82b9-4ac4-97e3-c4da8fa0b305 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:06.610908 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3bd7058a-82b9-4ac4-97e3-c4da8fa0b305 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:06.848642 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3bd7058a-82b9-4ac4-97e3-c4da8fa0b305 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:06.859207 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3bd7058a-82b9-4ac4-97e3-c4da8fa0b305 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a" status: 200 len: 1392 microversion: 2.1 time: 0.265468 Jun 10 18:38:06.860339 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3445/6843] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:06 2022] GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a => generated 1392 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:38:07.291001 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0e7b64c2-2236-4588-be78-85b76841eb03 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:07.302303 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0e7b64c2-2236-4588-be78-85b76841eb03 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1169 microversion: 2.1 time: 0.785169 Jun 10 18:38:07.302894 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3399/6844] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:06 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1169 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:07.877248 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c0c0a884-322c-4e88-b98e-74b387eb0bf0 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:07.877865 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c0c0a884-322c-4e88-b98e-74b387eb0bf0 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:07.886283 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c0c0a884-322c-4e88-b98e-74b387eb0bf0 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:07.886980 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c0c0a884-322c-4e88-b98e-74b387eb0bf0 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:07.888479 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c0c0a884-322c-4e88-b98e-74b387eb0bf0 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:07.889362 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c0c0a884-322c-4e88-b98e-74b387eb0bf0 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:08.040095 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c0c0a884-322c-4e88-b98e-74b387eb0bf0 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:08.048232 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c0c0a884-322c-4e88-b98e-74b387eb0bf0 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a" status: 200 len: 1392 microversion: 2.1 time: 0.174423 Jun 10 18:38:08.048733 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3446/6845] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:07 2022] GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:08.224380 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-447c7a08-854c-497f-8ed2-010a16ff124b req-a3122fc0-5630-43f2-b600-5e72ffb458f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a", "tag": "52404c9e-a5ad-4dd5-8bcd-f3725b19f0eb"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:38:08.234287 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-447c7a08-854c-497f-8ed2-010a16ff124b req-a3122fc0-5630-43f2-b600-5e72ffb458f9 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:08.234820 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-447c7a08-854c-497f-8ed2-010a16ff124b req-a3122fc0-5630-43f2-b600-5e72ffb458f9 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:08.253526 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-447c7a08-854c-497f-8ed2-010a16ff124b req-a3122fc0-5630-43f2-b600-5e72ffb458f9 service nova] Creating event network-changed:52404c9e-a5ad-4dd5-8bcd-f3725b19f0eb for instance 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a on chh1-master-2 Jun 10 18:38:08.258561 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-447c7a08-854c-497f-8ed2-010a16ff124b req-a3122fc0-5630-43f2-b600-5e72ffb458f9 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037836 Jun 10 18:38:08.259250 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3400/6846] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:38:08.323107 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c2c40627-fa25-455c-aa2d-1a7485def3bd tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:08.328188 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c2c40627-fa25-455c-aa2d-1a7485def3bd tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:08.365631 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c2c40627-fa25-455c-aa2d-1a7485def3bd tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:08.366096 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c2c40627-fa25-455c-aa2d-1a7485def3bd tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:08.367044 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c2c40627-fa25-455c-aa2d-1a7485def3bd tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:08.370002 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c2c40627-fa25-455c-aa2d-1a7485def3bd tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:08.575839 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c2c40627-fa25-455c-aa2d-1a7485def3bd tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:08.584397 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c2c40627-fa25-455c-aa2d-1a7485def3bd tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1169 microversion: 2.1 time: 0.267897 Jun 10 18:38:08.585297 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3447/6847] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:08 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1169 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:09.069064 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8903bbdf-dde4-4c56-a553-b86b58874071 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:09.070150 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8903bbdf-dde4-4c56-a553-b86b58874071 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:09.077170 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8903bbdf-dde4-4c56-a553-b86b58874071 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:09.077700 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8903bbdf-dde4-4c56-a553-b86b58874071 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:09.079335 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8903bbdf-dde4-4c56-a553-b86b58874071 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:09.079928 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8903bbdf-dde4-4c56-a553-b86b58874071 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:09.319556 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8903bbdf-dde4-4c56-a553-b86b58874071 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:09.331654 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8903bbdf-dde4-4c56-a553-b86b58874071 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a" status: 200 len: 1392 microversion: 2.1 time: 0.270235 Jun 10 18:38:09.343002 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3401/6848] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:09 2022] GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a => generated 1392 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:09.603048 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7ac85298-49b1-4076-bf38-7fa092a8442a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:09.603782 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7ac85298-49b1-4076-bf38-7fa092a8442a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:09.616416 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=4 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:38:09.617062 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=12 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:38:09.618776 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ac85298-49b1-4076-bf38-7fa092a8442a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:09.625435 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ac85298-49b1-4076-bf38-7fa092a8442a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:09.626500 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ac85298-49b1-4076-bf38-7fa092a8442a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:09.626941 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ac85298-49b1-4076-bf38-7fa092a8442a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:09.882971 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7ac85298-49b1-4076-bf38-7fa092a8442a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:09.891233 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7ac85298-49b1-4076-bf38-7fa092a8442a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1169 microversion: 2.1 time: 0.292301 Jun 10 18:38:09.891815 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3448/6849] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:09 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1169 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:10.344836 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:38:10.351662 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-240ad1fb-4b15-407f-9d1b-54d0e13a3900 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:10.352328 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-240ad1fb-4b15-407f-9d1b-54d0e13a3900 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:10.359463 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-240ad1fb-4b15-407f-9d1b-54d0e13a3900 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:10.359924 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-240ad1fb-4b15-407f-9d1b-54d0e13a3900 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:10.360745 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-240ad1fb-4b15-407f-9d1b-54d0e13a3900 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:10.361190 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-240ad1fb-4b15-407f-9d1b-54d0e13a3900 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:10.511096 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-240ad1fb-4b15-407f-9d1b-54d0e13a3900 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:10.516241 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-240ad1fb-4b15-407f-9d1b-54d0e13a3900 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a" status: 200 len: 1392 microversion: 2.1 time: 0.172405 Jun 10 18:38:10.516949 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3402/6850] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:10 2022] GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:10.908136 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f7845925-d575-4c1f-86f7-51e1957579cb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:10.910215 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f7845925-d575-4c1f-86f7-51e1957579cb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:10.918650 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f7845925-d575-4c1f-86f7-51e1957579cb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:10.919661 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f7845925-d575-4c1f-86f7-51e1957579cb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:10.920486 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f7845925-d575-4c1f-86f7-51e1957579cb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:10.920934 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f7845925-d575-4c1f-86f7-51e1957579cb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:11.079496 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f7845925-d575-4c1f-86f7-51e1957579cb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:11.086994 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f7845925-d575-4c1f-86f7-51e1957579cb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1169 microversion: 2.1 time: 0.183655 Jun 10 18:38:11.087572 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3449/6851] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:10 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1169 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:11.533330 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-189f0c67-0b3b-414e-92e6-efbc91e2374e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:11.533950 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-189f0c67-0b3b-414e-92e6-efbc91e2374e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:11.541580 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-189f0c67-0b3b-414e-92e6-efbc91e2374e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:11.542035 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-189f0c67-0b3b-414e-92e6-efbc91e2374e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:11.542806 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-189f0c67-0b3b-414e-92e6-efbc91e2374e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:11.543252 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-189f0c67-0b3b-414e-92e6-efbc91e2374e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:11.702262 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-189f0c67-0b3b-414e-92e6-efbc91e2374e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:11.710187 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-189f0c67-0b3b-414e-92e6-efbc91e2374e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a" status: 200 len: 1392 microversion: 2.1 time: 0.181638 Jun 10 18:38:11.710760 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3403/6852] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:11 2022] GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a => generated 1392 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:12.105587 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9fcbba99-385e-400c-819a-65868a2491d8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:12.107242 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9fcbba99-385e-400c-819a-65868a2491d8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:12.117753 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9fcbba99-385e-400c-819a-65868a2491d8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:12.122861 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9fcbba99-385e-400c-819a-65868a2491d8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:12.122861 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9fcbba99-385e-400c-819a-65868a2491d8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:12.122861 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9fcbba99-385e-400c-819a-65868a2491d8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:12.289732 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9fcbba99-385e-400c-819a-65868a2491d8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:12.303330 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9fcbba99-385e-400c-819a-65868a2491d8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1169 microversion: 2.1 time: 0.203090 Jun 10 18:38:12.304186 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3450/6853] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:12 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1169 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:12.727976 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fa517fcc-11ad-461d-a4b6-d705a098e013 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:12.729112 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fa517fcc-11ad-461d-a4b6-d705a098e013 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:12.737392 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa517fcc-11ad-461d-a4b6-d705a098e013 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:12.737995 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa517fcc-11ad-461d-a4b6-d705a098e013 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:12.739034 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa517fcc-11ad-461d-a4b6-d705a098e013 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:12.739578 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa517fcc-11ad-461d-a4b6-d705a098e013 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:12.947572 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fa517fcc-11ad-461d-a4b6-d705a098e013 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:12.955866 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fa517fcc-11ad-461d-a4b6-d705a098e013 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a" status: 200 len: 1392 microversion: 2.1 time: 0.232464 Jun 10 18:38:12.970489 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3404/6854] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:12 2022] GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a => generated 1392 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:13.322544 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bea071fe-3865-415b-be90-a9762d0124d9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:13.323166 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bea071fe-3865-415b-be90-a9762d0124d9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:13.330573 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bea071fe-3865-415b-be90-a9762d0124d9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:13.331121 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bea071fe-3865-415b-be90-a9762d0124d9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:13.331921 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bea071fe-3865-415b-be90-a9762d0124d9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:13.332382 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bea071fe-3865-415b-be90-a9762d0124d9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:13.477998 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bea071fe-3865-415b-be90-a9762d0124d9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:13.487516 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bea071fe-3865-415b-be90-a9762d0124d9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1169 microversion: 2.1 time: 0.168558 Jun 10 18:38:13.488242 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3451/6855] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:13 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1169 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:13.978487 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-50b2f69e-f978-4334-9417-f5002a1dc4d9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:13.979021 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-50b2f69e-f978-4334-9417-f5002a1dc4d9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:13.986365 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-50b2f69e-f978-4334-9417-f5002a1dc4d9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:13.986820 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-50b2f69e-f978-4334-9417-f5002a1dc4d9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:13.987595 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-50b2f69e-f978-4334-9417-f5002a1dc4d9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:13.988142 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-50b2f69e-f978-4334-9417-f5002a1dc4d9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:14.129784 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-50b2f69e-f978-4334-9417-f5002a1dc4d9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:14.138798 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-50b2f69e-f978-4334-9417-f5002a1dc4d9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a" status: 200 len: 1392 microversion: 2.1 time: 0.163933 Jun 10 18:38:14.139373 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3405/6856] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:13 2022] GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:14.505047 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d72886fc-f42d-4225-981a-9f307211df18 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:14.505701 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d72886fc-f42d-4225-981a-9f307211df18 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:14.513683 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d72886fc-f42d-4225-981a-9f307211df18 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:14.514140 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d72886fc-f42d-4225-981a-9f307211df18 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:14.516851 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d72886fc-f42d-4225-981a-9f307211df18 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:14.517304 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d72886fc-f42d-4225-981a-9f307211df18 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:14.677076 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d72886fc-f42d-4225-981a-9f307211df18 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:14.686266 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d72886fc-f42d-4225-981a-9f307211df18 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1169 microversion: 2.1 time: 0.184515 Jun 10 18:38:14.697791 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3452/6857] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:14 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1169 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:14.720381 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-d98f00ee-31ce-4ea3-b1e0-a837269a8e98 req-21e79243-d0a7-486f-ae92-761780b5ada5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a", "name": "network-vif-plugged", "status": "completed", "tag": "52404c9e-a5ad-4dd5-8bcd-f3725b19f0eb"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:38:14.729017 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-d98f00ee-31ce-4ea3-b1e0-a837269a8e98 req-21e79243-d0a7-486f-ae92-761780b5ada5 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:14.729568 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-d98f00ee-31ce-4ea3-b1e0-a837269a8e98 req-21e79243-d0a7-486f-ae92-761780b5ada5 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:14.741177 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-d98f00ee-31ce-4ea3-b1e0-a837269a8e98 req-21e79243-d0a7-486f-ae92-761780b5ada5 service nova] Creating event network-vif-plugged:52404c9e-a5ad-4dd5-8bcd-f3725b19f0eb for instance 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a on chh1-master-2 Jun 10 18:38:14.746130 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-d98f00ee-31ce-4ea3-b1e0-a837269a8e98 req-21e79243-d0a7-486f-ae92-761780b5ada5 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030268 Jun 10 18:38:14.746731 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3406/6858] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:38:15.155955 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3e6da856-99e3-43d2-b36e-e4b49b5d7fd6 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:15.156605 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3e6da856-99e3-43d2-b36e-e4b49b5d7fd6 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:15.162777 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3e6da856-99e3-43d2-b36e-e4b49b5d7fd6 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:15.163234 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3e6da856-99e3-43d2-b36e-e4b49b5d7fd6 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:15.164002 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3e6da856-99e3-43d2-b36e-e4b49b5d7fd6 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:15.164489 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3e6da856-99e3-43d2-b36e-e4b49b5d7fd6 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:15.311299 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3e6da856-99e3-43d2-b36e-e4b49b5d7fd6 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:15.318957 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3e6da856-99e3-43d2-b36e-e4b49b5d7fd6 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a" status: 200 len: 1392 microversion: 2.1 time: 0.167443 Jun 10 18:38:15.328250 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3453/6859] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:15 2022] GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:15.706765 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f7a29d8e-9a82-49e2-8bf7-9eedfa47f461 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:15.707397 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f7a29d8e-9a82-49e2-8bf7-9eedfa47f461 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:15.714872 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f7a29d8e-9a82-49e2-8bf7-9eedfa47f461 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:15.715433 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f7a29d8e-9a82-49e2-8bf7-9eedfa47f461 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:15.716764 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f7a29d8e-9a82-49e2-8bf7-9eedfa47f461 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:15.717211 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f7a29d8e-9a82-49e2-8bf7-9eedfa47f461 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:15.881758 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f7a29d8e-9a82-49e2-8bf7-9eedfa47f461 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:15.891262 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f7a29d8e-9a82-49e2-8bf7-9eedfa47f461 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1169 microversion: 2.1 time: 0.189638 Jun 10 18:38:15.897363 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3407/6860] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:15 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1169 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:16.338722 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-016adb00-6f8d-4728-bd2d-76b978a7950d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:16.339946 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-016adb00-6f8d-4728-bd2d-76b978a7950d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:16.353978 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-016adb00-6f8d-4728-bd2d-76b978a7950d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:16.354449 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-016adb00-6f8d-4728-bd2d-76b978a7950d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:16.355436 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-016adb00-6f8d-4728-bd2d-76b978a7950d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:16.355744 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-016adb00-6f8d-4728-bd2d-76b978a7950d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:16.362270 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:38:16.525677 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-016adb00-6f8d-4728-bd2d-76b978a7950d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:16.539017 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-016adb00-6f8d-4728-bd2d-76b978a7950d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a" status: 200 len: 1564 microversion: 2.1 time: 0.201627 Jun 10 18:38:16.539017 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3454/6861] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:16 2022] GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a => generated 1564 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:16.551819 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bbb0eaed-5697-4b49-9dc1-c573dbd96631 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:16.552604 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bbb0eaed-5697-4b49-9dc1-c573dbd96631 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:16.560248 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bbb0eaed-5697-4b49-9dc1-c573dbd96631 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:16.560821 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bbb0eaed-5697-4b49-9dc1-c573dbd96631 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:16.561765 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bbb0eaed-5697-4b49-9dc1-c573dbd96631 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:16.562343 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bbb0eaed-5697-4b49-9dc1-c573dbd96631 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:16.714016 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bbb0eaed-5697-4b49-9dc1-c573dbd96631 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:16.722425 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bbb0eaed-5697-4b49-9dc1-c573dbd96631 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a" status: 200 len: 1564 microversion: 2.1 time: 0.174376 Jun 10 18:38:16.723007 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3408/6862] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:16 2022] GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a => generated 1564 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:16.909965 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e07b3c7d-bafd-4d9b-9626-2118e7a99317 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:16.911360 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e07b3c7d-bafd-4d9b-9626-2118e7a99317 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:16.917853 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e07b3c7d-bafd-4d9b-9626-2118e7a99317 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:16.918702 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e07b3c7d-bafd-4d9b-9626-2118e7a99317 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:16.921057 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e07b3c7d-bafd-4d9b-9626-2118e7a99317 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:16.921512 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e07b3c7d-bafd-4d9b-9626-2118e7a99317 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:17.088499 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e07b3c7d-bafd-4d9b-9626-2118e7a99317 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:17.096463 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e07b3c7d-bafd-4d9b-9626-2118e7a99317 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1169 microversion: 2.1 time: 0.190563 Jun 10 18:38:17.106373 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3455/6863] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:16 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1169 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:18.114643 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0129eead-c776-4171-9300-8958284559e2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:18.115358 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0129eead-c776-4171-9300-8958284559e2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:18.124436 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0129eead-c776-4171-9300-8958284559e2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:18.124956 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0129eead-c776-4171-9300-8958284559e2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:18.128587 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0129eead-c776-4171-9300-8958284559e2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:18.128587 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0129eead-c776-4171-9300-8958284559e2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:18.336163 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0129eead-c776-4171-9300-8958284559e2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:18.345159 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0129eead-c776-4171-9300-8958284559e2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1169 microversion: 2.1 time: 0.234622 Jun 10 18:38:18.355107 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3409/6864] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:18 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1169 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:19.242016 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9f2acb67-d71a-40c2-aaeb-52d337b9b54b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:19.242908 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-55581581-c228-4970-8598-633bf94d4331 req-c1028e0f-1b47-437e-b87f-c2d6e1dd9aa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a", "tag": "52404c9e-a5ad-4dd5-8bcd-f3725b19f0eb"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:38:19.244212 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9f2acb67-d71a-40c2-aaeb-52d337b9b54b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:19.252764 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-55581581-c228-4970-8598-633bf94d4331 req-c1028e0f-1b47-437e-b87f-c2d6e1dd9aa0 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:19.253219 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-55581581-c228-4970-8598-633bf94d4331 req-c1028e0f-1b47-437e-b87f-c2d6e1dd9aa0 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:19.253801 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9f2acb67-d71a-40c2-aaeb-52d337b9b54b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:19.254344 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9f2acb67-d71a-40c2-aaeb-52d337b9b54b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:19.255201 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9f2acb67-d71a-40c2-aaeb-52d337b9b54b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:19.255781 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9f2acb67-d71a-40c2-aaeb-52d337b9b54b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:19.264919 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-55581581-c228-4970-8598-633bf94d4331 req-c1028e0f-1b47-437e-b87f-c2d6e1dd9aa0 service nova] Creating event network-changed:52404c9e-a5ad-4dd5-8bcd-f3725b19f0eb for instance 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a on chh1-master-2 Jun 10 18:38:19.270003 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-55581581-c228-4970-8598-633bf94d4331 req-c1028e0f-1b47-437e-b87f-c2d6e1dd9aa0 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030882 Jun 10 18:38:19.270998 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3410/6865] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:38:19.364616 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e4076c51-1399-4701-a94e-cfc56ded5873 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:19.365698 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e4076c51-1399-4701-a94e-cfc56ded5873 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:19.373161 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e4076c51-1399-4701-a94e-cfc56ded5873 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:19.373921 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e4076c51-1399-4701-a94e-cfc56ded5873 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:19.374917 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e4076c51-1399-4701-a94e-cfc56ded5873 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:19.375673 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e4076c51-1399-4701-a94e-cfc56ded5873 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:19.455446 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9f2acb67-d71a-40c2-aaeb-52d337b9b54b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:19.463513 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9f2acb67-d71a-40c2-aaeb-52d337b9b54b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a" status: 200 len: 1564 microversion: 2.1 time: 0.226291 Jun 10 18:38:19.464873 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3456/6866] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:19 2022] GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a => generated 1564 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:19.640900 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e4076c51-1399-4701-a94e-cfc56ded5873 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:19.653198 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e4076c51-1399-4701-a94e-cfc56ded5873 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1169 microversion: 2.1 time: 0.293874 Jun 10 18:38:19.660638 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3411/6867] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:19 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1169 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:20.672440 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5782c7f7-65fe-47b0-9d26-38388c4e23ef tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:20.672440 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5782c7f7-65fe-47b0-9d26-38388c4e23ef tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:20.682505 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5782c7f7-65fe-47b0-9d26-38388c4e23ef tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:20.683229 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5782c7f7-65fe-47b0-9d26-38388c4e23ef tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:20.683999 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5782c7f7-65fe-47b0-9d26-38388c4e23ef tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:20.684632 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5782c7f7-65fe-47b0-9d26-38388c4e23ef tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:20.827608 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5782c7f7-65fe-47b0-9d26-38388c4e23ef tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:20.835212 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5782c7f7-65fe-47b0-9d26-38388c4e23ef tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1169 microversion: 2.1 time: 0.168146 Jun 10 18:38:20.835786 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3457/6868] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:20 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1169 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:21.852539 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5dccf047-0acd-4bb7-9705-47bfcee4d5bc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:21.853853 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5dccf047-0acd-4bb7-9705-47bfcee4d5bc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:21.862829 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5dccf047-0acd-4bb7-9705-47bfcee4d5bc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:21.863282 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5dccf047-0acd-4bb7-9705-47bfcee4d5bc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:21.864345 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5dccf047-0acd-4bb7-9705-47bfcee4d5bc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:21.864816 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5dccf047-0acd-4bb7-9705-47bfcee4d5bc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:22.006019 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5dccf047-0acd-4bb7-9705-47bfcee4d5bc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:22.014771 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5dccf047-0acd-4bb7-9705-47bfcee4d5bc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1169 microversion: 2.1 time: 0.166114 Jun 10 18:38:22.015647 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3412/6869] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:21 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1169 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:23.033153 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9d4dbaf1-5b24-425e-9269-17e462f3165e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:23.033853 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9d4dbaf1-5b24-425e-9269-17e462f3165e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:23.040957 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9d4dbaf1-5b24-425e-9269-17e462f3165e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:23.041421 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9d4dbaf1-5b24-425e-9269-17e462f3165e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:23.042196 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9d4dbaf1-5b24-425e-9269-17e462f3165e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:23.042643 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9d4dbaf1-5b24-425e-9269-17e462f3165e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:23.200680 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9d4dbaf1-5b24-425e-9269-17e462f3165e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:23.209470 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9d4dbaf1-5b24-425e-9269-17e462f3165e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1169 microversion: 2.1 time: 0.180875 Jun 10 18:38:23.210072 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3458/6870] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:23 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1169 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:24.227726 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-651a902a-f26d-4245-a1b4-32022fa66f3c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:24.228804 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-651a902a-f26d-4245-a1b4-32022fa66f3c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:24.236644 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-651a902a-f26d-4245-a1b4-32022fa66f3c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:24.237213 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-651a902a-f26d-4245-a1b4-32022fa66f3c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:24.237986 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-651a902a-f26d-4245-a1b4-32022fa66f3c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:24.238425 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-651a902a-f26d-4245-a1b4-32022fa66f3c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:24.242640 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:38:24.381929 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-651a902a-f26d-4245-a1b4-32022fa66f3c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:24.389451 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-651a902a-f26d-4245-a1b4-32022fa66f3c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1169 microversion: 2.1 time: 0.166755 Jun 10 18:38:24.390577 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3413/6871] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:24 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1169 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:25.407256 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-03fd4cfb-b6e2-4bf5-90d0-7c362e100d7b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:25.407908 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-03fd4cfb-b6e2-4bf5-90d0-7c362e100d7b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:25.415303 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-03fd4cfb-b6e2-4bf5-90d0-7c362e100d7b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:25.415858 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-03fd4cfb-b6e2-4bf5-90d0-7c362e100d7b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:25.416755 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-03fd4cfb-b6e2-4bf5-90d0-7c362e100d7b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:25.417270 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-03fd4cfb-b6e2-4bf5-90d0-7c362e100d7b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:25.555716 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-03fd4cfb-b6e2-4bf5-90d0-7c362e100d7b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:25.564069 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-03fd4cfb-b6e2-4bf5-90d0-7c362e100d7b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1169 microversion: 2.1 time: 0.160581 Jun 10 18:38:25.564743 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3459/6872] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:25 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1169 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:26.582069 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-af2757f2-d5c2-48f8-a2b0-b9a4baae53b0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:26.582847 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-af2757f2-d5c2-48f8-a2b0-b9a4baae53b0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:26.589787 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-af2757f2-d5c2-48f8-a2b0-b9a4baae53b0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:26.590237 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-af2757f2-d5c2-48f8-a2b0-b9a4baae53b0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:26.591004 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-af2757f2-d5c2-48f8-a2b0-b9a4baae53b0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:26.591446 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-af2757f2-d5c2-48f8-a2b0-b9a4baae53b0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:26.726048 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-af2757f2-d5c2-48f8-a2b0-b9a4baae53b0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:26.733723 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-af2757f2-d5c2-48f8-a2b0-b9a4baae53b0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1169 microversion: 2.1 time: 0.156289 Jun 10 18:38:26.734306 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3414/6873] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:26 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1169 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:27.750997 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0e95caf9-f897-4592-91d6-b113a9ef83fc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:27.751665 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0e95caf9-f897-4592-91d6-b113a9ef83fc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:27.759093 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0e95caf9-f897-4592-91d6-b113a9ef83fc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:27.759682 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0e95caf9-f897-4592-91d6-b113a9ef83fc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:27.760509 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0e95caf9-f897-4592-91d6-b113a9ef83fc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:27.761022 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0e95caf9-f897-4592-91d6-b113a9ef83fc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:27.906009 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0e95caf9-f897-4592-91d6-b113a9ef83fc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:27.913821 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0e95caf9-f897-4592-91d6-b113a9ef83fc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1169 microversion: 2.1 time: 0.166729 Jun 10 18:38:27.914395 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3460/6874] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:27 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1169 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:28.931073 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8b0df40e-e81e-46d0-a1a9-e2e11f297fac tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:28.931640 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8b0df40e-e81e-46d0-a1a9-e2e11f297fac tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:28.934559 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=60 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:38:28.939882 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8b0df40e-e81e-46d0-a1a9-e2e11f297fac tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:28.940377 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8b0df40e-e81e-46d0-a1a9-e2e11f297fac tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:28.941149 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8b0df40e-e81e-46d0-a1a9-e2e11f297fac tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:28.941594 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8b0df40e-e81e-46d0-a1a9-e2e11f297fac tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:29.078089 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8b0df40e-e81e-46d0-a1a9-e2e11f297fac tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:29.085611 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8b0df40e-e81e-46d0-a1a9-e2e11f297fac tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1169 microversion: 2.1 time: 0.158543 Jun 10 18:38:29.087709 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3415/6875] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:28 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1169 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:30.103111 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-59f8d558-3e6f-48dd-8182-b979f30469d1 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:30.103754 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-59f8d558-3e6f-48dd-8182-b979f30469d1 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:30.106768 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=6 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:38:30.111572 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-59f8d558-3e6f-48dd-8182-b979f30469d1 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:30.112023 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-59f8d558-3e6f-48dd-8182-b979f30469d1 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:30.113186 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-59f8d558-3e6f-48dd-8182-b979f30469d1 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:30.113633 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-59f8d558-3e6f-48dd-8182-b979f30469d1 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:30.257570 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-59f8d558-3e6f-48dd-8182-b979f30469d1 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:30.268910 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-59f8d558-3e6f-48dd-8182-b979f30469d1 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1169 microversion: 2.1 time: 0.169896 Jun 10 18:38:30.269847 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3461/6876] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:30 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1169 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:31.286220 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-235aab70-38bf-4062-b664-34533efce476 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:31.286841 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-235aab70-38bf-4062-b664-34533efce476 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:31.295673 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-235aab70-38bf-4062-b664-34533efce476 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:31.296135 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-235aab70-38bf-4062-b664-34533efce476 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:31.296939 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-235aab70-38bf-4062-b664-34533efce476 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:31.297385 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-235aab70-38bf-4062-b664-34533efce476 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:31.440806 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-235aab70-38bf-4062-b664-34533efce476 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:31.448868 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-235aab70-38bf-4062-b664-34533efce476 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1169 microversion: 2.1 time: 0.167138 Jun 10 18:38:31.449448 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3416/6877] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:31 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1169 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:32.466291 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-30d20f27-f891-4642-a42e-98028b9d6073 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:32.467598 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-30d20f27-f891-4642-a42e-98028b9d6073 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:32.475147 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-30d20f27-f891-4642-a42e-98028b9d6073 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:32.475708 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-30d20f27-f891-4642-a42e-98028b9d6073 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:32.477144 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-30d20f27-f891-4642-a42e-98028b9d6073 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:32.477855 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-30d20f27-f891-4642-a42e-98028b9d6073 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:32.622491 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-30d20f27-f891-4642-a42e-98028b9d6073 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:32.631502 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-30d20f27-f891-4642-a42e-98028b9d6073 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1169 microversion: 2.1 time: 0.169154 Jun 10 18:38:32.632082 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3462/6878] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:32 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1169 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:33.649168 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f4012e4f-d234-4df0-88ef-cecf6f963472 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:33.649891 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f4012e4f-d234-4df0-88ef-cecf6f963472 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:33.657177 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f4012e4f-d234-4df0-88ef-cecf6f963472 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:33.657655 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f4012e4f-d234-4df0-88ef-cecf6f963472 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:33.658982 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f4012e4f-d234-4df0-88ef-cecf6f963472 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:33.659422 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f4012e4f-d234-4df0-88ef-cecf6f963472 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:33.850117 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f4012e4f-d234-4df0-88ef-cecf6f963472 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:33.858063 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f4012e4f-d234-4df0-88ef-cecf6f963472 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1169 microversion: 2.1 time: 0.212893 Jun 10 18:38:33.860248 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3417/6879] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:33 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1169 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:34.878038 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c7eae2eb-2963-4c78-9f8e-0f17834ba8a7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:34.878708 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c7eae2eb-2963-4c78-9f8e-0f17834ba8a7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:34.886074 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c7eae2eb-2963-4c78-9f8e-0f17834ba8a7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:34.886546 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c7eae2eb-2963-4c78-9f8e-0f17834ba8a7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:34.887496 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c7eae2eb-2963-4c78-9f8e-0f17834ba8a7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:34.887952 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c7eae2eb-2963-4c78-9f8e-0f17834ba8a7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:35.051847 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c7eae2eb-2963-4c78-9f8e-0f17834ba8a7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:35.062073 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c7eae2eb-2963-4c78-9f8e-0f17834ba8a7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1169 microversion: 2.1 time: 0.187955 Jun 10 18:38:35.062680 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3463/6880] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:34 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1169 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:36.081525 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5eef5744-b7bb-45b9-92c7-29b613404543 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:36.082161 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5eef5744-b7bb-45b9-92c7-29b613404543 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:36.088763 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5eef5744-b7bb-45b9-92c7-29b613404543 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:36.089217 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5eef5744-b7bb-45b9-92c7-29b613404543 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:36.089982 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5eef5744-b7bb-45b9-92c7-29b613404543 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:36.090419 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5eef5744-b7bb-45b9-92c7-29b613404543 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:36.224334 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5eef5744-b7bb-45b9-92c7-29b613404543 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:36.232645 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5eef5744-b7bb-45b9-92c7-29b613404543 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1203 microversion: 2.1 time: 0.154962 Jun 10 18:38:36.233140 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3418/6881] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:36 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:37.251202 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0b734d94-ff79-4bac-bb5b-4491c62c7a96 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:37.252926 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0b734d94-ff79-4bac-bb5b-4491c62c7a96 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:37.262070 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0b734d94-ff79-4bac-bb5b-4491c62c7a96 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:37.262604 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0b734d94-ff79-4bac-bb5b-4491c62c7a96 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:37.263440 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0b734d94-ff79-4bac-bb5b-4491c62c7a96 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:37.263899 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0b734d94-ff79-4bac-bb5b-4491c62c7a96 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:37.402648 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0b734d94-ff79-4bac-bb5b-4491c62c7a96 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:37.411102 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0b734d94-ff79-4bac-bb5b-4491c62c7a96 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1203 microversion: 2.1 time: 0.164463 Jun 10 18:38:37.411680 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3464/6882] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:37 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1203 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:38.428823 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-34f545de-f554-43a8-82c2-40d61ef411bf tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:38.429430 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-34f545de-f554-43a8-82c2-40d61ef411bf tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:38.436558 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-34f545de-f554-43a8-82c2-40d61ef411bf tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:38.437010 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-34f545de-f554-43a8-82c2-40d61ef411bf tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:38.437774 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-34f545de-f554-43a8-82c2-40d61ef411bf tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:38.438214 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-34f545de-f554-43a8-82c2-40d61ef411bf tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:38.567331 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-34f545de-f554-43a8-82c2-40d61ef411bf tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:38.576033 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-34f545de-f554-43a8-82c2-40d61ef411bf tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1203 microversion: 2.1 time: 0.150985 Jun 10 18:38:38.576653 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3419/6883] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:38 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1203 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:39.592727 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d0e16be8-2480-44ba-964e-07d1e76af808 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:39.595982 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d0e16be8-2480-44ba-964e-07d1e76af808 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:39.600321 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d0e16be8-2480-44ba-964e-07d1e76af808 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:39.601068 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d0e16be8-2480-44ba-964e-07d1e76af808 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:39.601961 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d0e16be8-2480-44ba-964e-07d1e76af808 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:39.602382 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d0e16be8-2480-44ba-964e-07d1e76af808 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:39.731000 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d0e16be8-2480-44ba-964e-07d1e76af808 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:39.739446 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d0e16be8-2480-44ba-964e-07d1e76af808 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1203 microversion: 2.1 time: 0.150696 Jun 10 18:38:39.740017 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3465/6884] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:39 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1203 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:40.756990 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bb6f8d4a-7afb-42dd-ae8e-a3f0cde87ff6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:40.757624 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bb6f8d4a-7afb-42dd-ae8e-a3f0cde87ff6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:40.765554 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb6f8d4a-7afb-42dd-ae8e-a3f0cde87ff6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:40.766005 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb6f8d4a-7afb-42dd-ae8e-a3f0cde87ff6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:40.766764 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb6f8d4a-7afb-42dd-ae8e-a3f0cde87ff6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:40.767878 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb6f8d4a-7afb-42dd-ae8e-a3f0cde87ff6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:40.905005 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bb6f8d4a-7afb-42dd-ae8e-a3f0cde87ff6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:40.912688 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bb6f8d4a-7afb-42dd-ae8e-a3f0cde87ff6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1203 microversion: 2.1 time: 0.159472 Jun 10 18:38:40.913295 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3420/6885] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:40 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1203 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:41.799763 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0cd38412-5742-4aaa-9e9f-f434d43498a6 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:38:41.800699 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0cd38412-5742-4aaa-9e9f-f434d43498a6 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:41.808056 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0cd38412-5742-4aaa-9e9f-f434d43498a6 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:41.808546 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0cd38412-5742-4aaa-9e9f-f434d43498a6 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:41.809310 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0cd38412-5742-4aaa-9e9f-f434d43498a6 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:41.809749 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0cd38412-5742-4aaa-9e9f-f434d43498a6 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:41.929364 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1a099b42-8def-48e4-b594-e66ce65ecb61 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:41.929970 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1a099b42-8def-48e4-b594-e66ce65ecb61 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:41.936866 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1a099b42-8def-48e4-b594-e66ce65ecb61 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:41.937312 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1a099b42-8def-48e4-b594-e66ce65ecb61 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:41.938069 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1a099b42-8def-48e4-b594-e66ce65ecb61 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:41.938510 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1a099b42-8def-48e4-b594-e66ce65ecb61 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:42.058875 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0cd38412-5742-4aaa-9e9f-f434d43498a6 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "POST /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a/action" status: 200 len: 24563 microversion: 2.1 time: 0.262824 Jun 10 18:38:42.059449 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3466/6886] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:38:41 2022] POST /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a/action => generated 24563 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:38:42.070148 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1a099b42-8def-48e4-b594-e66ce65ecb61 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:42.078232 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1a099b42-8def-48e4-b594-e66ce65ecb61 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1203 microversion: 2.1 time: 0.152643 Jun 10 18:38:42.078832 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3421/6887] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:41 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:38:43.096055 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8c0f0134-5774-4df5-998c-5deeed23613f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:43.096798 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8c0f0134-5774-4df5-998c-5deeed23613f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:43.104234 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8c0f0134-5774-4df5-998c-5deeed23613f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:43.104729 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8c0f0134-5774-4df5-998c-5deeed23613f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:43.105491 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8c0f0134-5774-4df5-998c-5deeed23613f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:43.105929 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8c0f0134-5774-4df5-998c-5deeed23613f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:43.287915 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8c0f0134-5774-4df5-998c-5deeed23613f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:43.295505 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8c0f0134-5774-4df5-998c-5deeed23613f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1203 microversion: 2.1 time: 0.204247 Jun 10 18:38:43.296067 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3467/6888] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:43 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1203 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:44.317060 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fe11383c-1cba-4270-b108-8661492e99d9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:44.319364 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fe11383c-1cba-4270-b108-8661492e99d9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:44.324476 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fe11383c-1cba-4270-b108-8661492e99d9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:44.325004 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fe11383c-1cba-4270-b108-8661492e99d9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:44.326057 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fe11383c-1cba-4270-b108-8661492e99d9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:44.326513 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fe11383c-1cba-4270-b108-8661492e99d9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:44.488728 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fe11383c-1cba-4270-b108-8661492e99d9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:44.496924 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fe11383c-1cba-4270-b108-8661492e99d9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1203 microversion: 2.1 time: 0.186030 Jun 10 18:38:44.499011 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3422/6889] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:44 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1203 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:38:45.513943 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8933839c-4cb3-44e0-b9e8-6affb62b639b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:45.514557 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8933839c-4cb3-44e0-b9e8-6affb62b639b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:45.521655 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8933839c-4cb3-44e0-b9e8-6affb62b639b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:45.522115 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8933839c-4cb3-44e0-b9e8-6affb62b639b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:45.522887 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8933839c-4cb3-44e0-b9e8-6affb62b639b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:45.523331 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8933839c-4cb3-44e0-b9e8-6affb62b639b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:45.655030 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8933839c-4cb3-44e0-b9e8-6affb62b639b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:45.662880 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8933839c-4cb3-44e0-b9e8-6affb62b639b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1203 microversion: 2.1 time: 0.152669 Jun 10 18:38:45.664507 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3468/6890] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:45 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:46.679634 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-28d79a05-24be-431c-b9ea-a520de4e9c54 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:46.680246 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-28d79a05-24be-431c-b9ea-a520de4e9c54 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:46.687409 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-28d79a05-24be-431c-b9ea-a520de4e9c54 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:46.687883 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-28d79a05-24be-431c-b9ea-a520de4e9c54 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:46.688684 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-28d79a05-24be-431c-b9ea-a520de4e9c54 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:46.689690 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-28d79a05-24be-431c-b9ea-a520de4e9c54 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:46.764790 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-5fbbb079-1ae6-43d8-b0d4-6a55ea62b08a req-2fe1abc0-1a27-44ff-b916-2a4220119162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1facd35-ee11-47ae-9c44-ea67d49a267f", "name": "network-vif-plugged", "status": "completed", "tag": "e6ffbc29-6aa3-4650-9d49-91776ee727c2"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:38:46.776760 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-5fbbb079-1ae6-43d8-b0d4-6a55ea62b08a req-2fe1abc0-1a27-44ff-b916-2a4220119162 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:46.777222 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-5fbbb079-1ae6-43d8-b0d4-6a55ea62b08a req-2fe1abc0-1a27-44ff-b916-2a4220119162 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:46.780366 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=87 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:38:46.789642 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-5fbbb079-1ae6-43d8-b0d4-6a55ea62b08a req-2fe1abc0-1a27-44ff-b916-2a4220119162 service nova] Creating event network-vif-plugged:e6ffbc29-6aa3-4650-9d49-91776ee727c2 for instance f1facd35-ee11-47ae-9c44-ea67d49a267f on chh1-master-2 Jun 10 18:38:46.794577 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-5fbbb079-1ae6-43d8-b0d4-6a55ea62b08a req-2fe1abc0-1a27-44ff-b916-2a4220119162 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033668 Jun 10 18:38:46.797760 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3469/6891] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:38:46.827135 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-28d79a05-24be-431c-b9ea-a520de4e9c54 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:46.835657 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-28d79a05-24be-431c-b9ea-a520de4e9c54 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1203 microversion: 2.1 time: 0.159886 Jun 10 18:38:46.836251 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3423/6892] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:46 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1203 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:47.854516 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a26a8ba5-2698-4803-bc67-392bb52dc7b7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:47.855146 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a26a8ba5-2698-4803-bc67-392bb52dc7b7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:47.861613 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a26a8ba5-2698-4803-bc67-392bb52dc7b7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:47.862075 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a26a8ba5-2698-4803-bc67-392bb52dc7b7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:47.862878 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a26a8ba5-2698-4803-bc67-392bb52dc7b7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:47.863325 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a26a8ba5-2698-4803-bc67-392bb52dc7b7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:47.998705 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a26a8ba5-2698-4803-bc67-392bb52dc7b7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:48.006499 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a26a8ba5-2698-4803-bc67-392bb52dc7b7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1203 microversion: 2.1 time: 0.157632 Jun 10 18:38:48.007107 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3470/6893] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:47 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:49.023053 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-68843a08-b112-4333-8836-b2e99a518a6f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:49.023662 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-68843a08-b112-4333-8836-b2e99a518a6f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:49.030793 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-68843a08-b112-4333-8836-b2e99a518a6f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:49.031239 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-68843a08-b112-4333-8836-b2e99a518a6f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:49.031988 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-68843a08-b112-4333-8836-b2e99a518a6f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:49.032449 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-68843a08-b112-4333-8836-b2e99a518a6f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:49.163822 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-68843a08-b112-4333-8836-b2e99a518a6f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:49.171558 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-68843a08-b112-4333-8836-b2e99a518a6f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1391 microversion: 2.1 time: 0.152389 Jun 10 18:38:49.172132 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3424/6894] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:49 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:49.188155 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8ce21ee2-1331-4615-ac19-d1a6e204d4c8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:49.188806 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8ce21ee2-1331-4615-ac19-d1a6e204d4c8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:49.195808 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8ce21ee2-1331-4615-ac19-d1a6e204d4c8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:49.196262 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8ce21ee2-1331-4615-ac19-d1a6e204d4c8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:49.197066 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8ce21ee2-1331-4615-ac19-d1a6e204d4c8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:49.197508 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8ce21ee2-1331-4615-ac19-d1a6e204d4c8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:49.328048 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8ce21ee2-1331-4615-ac19-d1a6e204d4c8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:49.336742 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8ce21ee2-1331-4615-ac19-d1a6e204d4c8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1391 microversion: 2.1 time: 0.152288 Jun 10 18:38:49.337387 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3471/6895] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:49 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:49.352745 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3eff87bd-c223-40ac-a125-6f4293f516f0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:49.353364 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3eff87bd-c223-40ac-a125-6f4293f516f0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:49.359442 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3eff87bd-c223-40ac-a125-6f4293f516f0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:49.359896 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3eff87bd-c223-40ac-a125-6f4293f516f0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:49.360692 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3eff87bd-c223-40ac-a125-6f4293f516f0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:49.361164 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3eff87bd-c223-40ac-a125-6f4293f516f0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:49.490911 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3eff87bd-c223-40ac-a125-6f4293f516f0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:49.498717 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3eff87bd-c223-40ac-a125-6f4293f516f0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1391 microversion: 2.1 time: 0.149717 Jun 10 18:38:49.499294 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3425/6896] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:49 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1391 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:49.570241 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e074c53d-a6c4-4c36-8958-49d90a14075e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:49.570806 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e074c53d-a6c4-4c36-8958-49d90a14075e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:49.576642 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e074c53d-a6c4-4c36-8958-49d90a14075e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:49.577089 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e074c53d-a6c4-4c36-8958-49d90a14075e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:49.577849 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e074c53d-a6c4-4c36-8958-49d90a14075e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:49.578279 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e074c53d-a6c4-4c36-8958-49d90a14075e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:49.602640 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e074c53d-a6c4-4c36-8958-49d90a14075e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:38:49.867185 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e074c53d-a6c4-4c36-8958-49d90a14075e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "DELETE /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 204 len: 0 microversion: 2.1 time: 0.300336 Jun 10 18:38:49.867709 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3472/6897] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:38:49 2022] DELETE /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:38:49.876051 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0689acbd-cc3b-4341-bdf0-b254ffe0ebdf tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:49.877199 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0689acbd-cc3b-4341-bdf0-b254ffe0ebdf tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:49.884154 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0689acbd-cc3b-4341-bdf0-b254ffe0ebdf tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:49.884647 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0689acbd-cc3b-4341-bdf0-b254ffe0ebdf tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:49.886103 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0689acbd-cc3b-4341-bdf0-b254ffe0ebdf tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:49.886545 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0689acbd-cc3b-4341-bdf0-b254ffe0ebdf tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:50.025950 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0689acbd-cc3b-4341-bdf0-b254ffe0ebdf tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:50.034651 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0689acbd-cc3b-4341-bdf0-b254ffe0ebdf tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1397 microversion: 2.1 time: 0.162735 Jun 10 18:38:50.035225 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3426/6898] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:49 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1397 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:51.051615 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e3590d2c-11ae-4d89-9701-925e35b9966b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:51.052248 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-e3590d2c-11ae-4d89-9701-925e35b9966b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:51.059331 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e3590d2c-11ae-4d89-9701-925e35b9966b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:51.059700 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e3590d2c-11ae-4d89-9701-925e35b9966b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:51.060528 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e3590d2c-11ae-4d89-9701-925e35b9966b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:51.060962 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-e3590d2c-11ae-4d89-9701-925e35b9966b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:51.204456 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-e3590d2c-11ae-4d89-9701-925e35b9966b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:51.212928 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e3590d2c-11ae-4d89-9701-925e35b9966b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1397 microversion: 2.1 time: 0.165639 Jun 10 18:38:51.226367 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3473/6899] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:51 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1397 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:52.230443 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0d2a5640-4a1a-44d0-a797-7dac84557d11 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:52.233449 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0d2a5640-4a1a-44d0-a797-7dac84557d11 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:52.248359 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0d2a5640-4a1a-44d0-a797-7dac84557d11 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:52.248828 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0d2a5640-4a1a-44d0-a797-7dac84557d11 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:52.249614 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0d2a5640-4a1a-44d0-a797-7dac84557d11 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:52.250058 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0d2a5640-4a1a-44d0-a797-7dac84557d11 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:52.294471 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-309fa22a-a56f-420c-bed9-bf0aad1612dd req-ebd115bc-2f8e-436d-8bfa-b3f98504133c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1facd35-ee11-47ae-9c44-ea67d49a267f", "name": "network-vif-deleted", "tag": "e6ffbc29-6aa3-4650-9d49-91776ee727c2"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:38:52.306270 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-309fa22a-a56f-420c-bed9-bf0aad1612dd req-ebd115bc-2f8e-436d-8bfa-b3f98504133c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:52.308600 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-309fa22a-a56f-420c-bed9-bf0aad1612dd req-ebd115bc-2f8e-436d-8bfa-b3f98504133c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:52.319539 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-309fa22a-a56f-420c-bed9-bf0aad1612dd req-ebd115bc-2f8e-436d-8bfa-b3f98504133c service nova] Creating event network-vif-deleted:e6ffbc29-6aa3-4650-9d49-91776ee727c2 for instance f1facd35-ee11-47ae-9c44-ea67d49a267f on chh1-master-2 Jun 10 18:38:52.324672 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-309fa22a-a56f-420c-bed9-bf0aad1612dd req-ebd115bc-2f8e-436d-8bfa-b3f98504133c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041210 Jun 10 18:38:52.325280 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3474/6900] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:38:52.340050 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0d2a5640-4a1a-44d0-a797-7dac84557d11 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:52.348722 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0d2a5640-4a1a-44d0-a797-7dac84557d11 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1355 microversion: 2.1 time: 0.122576 Jun 10 18:38:52.349313 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3427/6901] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:52 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1355 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:52.968165 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4fae7b9e-183f-4597-82fc-6b2d782e57f9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:38:52.969851 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4fae7b9e-183f-4597-82fc-6b2d782e57f9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:52.976715 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4fae7b9e-183f-4597-82fc-6b2d782e57f9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:52.977314 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4fae7b9e-183f-4597-82fc-6b2d782e57f9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:52.978215 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4fae7b9e-183f-4597-82fc-6b2d782e57f9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:52.978841 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4fae7b9e-183f-4597-82fc-6b2d782e57f9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:53.061633 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-4fae7b9e-183f-4597-82fc-6b2d782e57f9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:38:53.062172 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-4fae7b9e-183f-4597-82fc-6b2d782e57f9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:38:53.062861 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-4fae7b9e-183f-4597-82fc-6b2d782e57f9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:38:53.063344 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-4fae7b9e-183f-4597-82fc-6b2d782e57f9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:38:53.063827 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-4fae7b9e-183f-4597-82fc-6b2d782e57f9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:38:53.264476 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4fae7b9e-183f-4597-82fc-6b2d782e57f9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:53.271085 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4fae7b9e-183f-4597-82fc-6b2d782e57f9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:53.271836 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4fae7b9e-183f-4597-82fc-6b2d782e57f9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:53.272977 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4fae7b9e-183f-4597-82fc-6b2d782e57f9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:53.273613 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4fae7b9e-183f-4597-82fc-6b2d782e57f9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:53.304704 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4fae7b9e-183f-4597-82fc-6b2d782e57f9 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "POST /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a/action" status: 202 len: 1138 microversion: 2.1 time: 0.341345 Jun 10 18:38:53.306424 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3475/6902] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:38:52 2022] POST /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a/action => generated 1138 bytes in 344 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jun 10 18:38:53.322751 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0d19705a-dd43-4387-8246-687cc1e0ca7f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:53.329515 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0d19705a-dd43-4387-8246-687cc1e0ca7f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:53.330885 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0d19705a-dd43-4387-8246-687cc1e0ca7f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:53.331588 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0d19705a-dd43-4387-8246-687cc1e0ca7f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:53.332481 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0d19705a-dd43-4387-8246-687cc1e0ca7f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:53.333082 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0d19705a-dd43-4387-8246-687cc1e0ca7f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:53.368060 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1f3891dd-e6e6-40a5-aa27-a5a8a6be752f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:53.369408 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1f3891dd-e6e6-40a5-aa27-a5a8a6be752f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:53.377709 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1f3891dd-e6e6-40a5-aa27-a5a8a6be752f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:53.378498 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1f3891dd-e6e6-40a5-aa27-a5a8a6be752f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:53.379807 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1f3891dd-e6e6-40a5-aa27-a5a8a6be752f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:53.380509 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1f3891dd-e6e6-40a5-aa27-a5a8a6be752f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:53.492299 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1f3891dd-e6e6-40a5-aa27-a5a8a6be752f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:53.502122 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1f3891dd-e6e6-40a5-aa27-a5a8a6be752f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1188 microversion: 2.1 time: 0.138539 Jun 10 18:38:53.514906 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3476/6903] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:53 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1188 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:38:53.544490 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0d19705a-dd43-4387-8246-687cc1e0ca7f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:53.553713 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0d19705a-dd43-4387-8246-687cc1e0ca7f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a" status: 200 len: 1692 microversion: 2.1 time: 0.235976 Jun 10 18:38:53.563417 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3428/6904] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:53 2022] GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a => generated 1692 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:54.520034 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-508e18b0-bb44-468e-a6c6-a05d7bf4c0f1 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:54.520729 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-508e18b0-bb44-468e-a6c6-a05d7bf4c0f1 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:54.528267 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-508e18b0-bb44-468e-a6c6-a05d7bf4c0f1 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:54.528959 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-508e18b0-bb44-468e-a6c6-a05d7bf4c0f1 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:54.529748 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-508e18b0-bb44-468e-a6c6-a05d7bf4c0f1 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:54.530191 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-508e18b0-bb44-468e-a6c6-a05d7bf4c0f1 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:54.571314 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-041c349f-1593-48f3-ad3b-55fbba8f8d45 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:54.572536 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-041c349f-1593-48f3-ad3b-55fbba8f8d45 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:54.581359 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-041c349f-1593-48f3-ad3b-55fbba8f8d45 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:54.582521 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-041c349f-1593-48f3-ad3b-55fbba8f8d45 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:54.583450 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-041c349f-1593-48f3-ad3b-55fbba8f8d45 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:54.584464 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-041c349f-1593-48f3-ad3b-55fbba8f8d45 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:54.589337 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=95 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:38:54.609945 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-508e18b0-bb44-468e-a6c6-a05d7bf4c0f1 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:54.619269 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-508e18b0-bb44-468e-a6c6-a05d7bf4c0f1 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1188 microversion: 2.1 time: 0.103149 Jun 10 18:38:54.629702 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3477/6905] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:54 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1188 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:54.731579 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-041c349f-1593-48f3-ad3b-55fbba8f8d45 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:54.740447 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-041c349f-1593-48f3-ad3b-55fbba8f8d45 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a" status: 200 len: 1692 microversion: 2.1 time: 0.172878 Jun 10 18:38:54.741029 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3429/6906] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:54 2022] GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a => generated 1692 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:38:55.637403 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-22469c48-6aa6-4fc0-b36f-a21f997f3976 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:55.638225 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-22469c48-6aa6-4fc0-b36f-a21f997f3976 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:55.646502 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-22469c48-6aa6-4fc0-b36f-a21f997f3976 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:55.647108 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-22469c48-6aa6-4fc0-b36f-a21f997f3976 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:55.648050 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-22469c48-6aa6-4fc0-b36f-a21f997f3976 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:55.648558 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-22469c48-6aa6-4fc0-b36f-a21f997f3976 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:55.727021 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-22469c48-6aa6-4fc0-b36f-a21f997f3976 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:55.737951 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-22469c48-6aa6-4fc0-b36f-a21f997f3976 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1188 microversion: 2.1 time: 0.104652 Jun 10 18:38:55.744790 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3478/6907] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:55 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1188 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:55.770630 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-50634640-8447-4b72-8187-4eac63e7b831 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:55.775225 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-50634640-8447-4b72-8187-4eac63e7b831 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:55.780136 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-50634640-8447-4b72-8187-4eac63e7b831 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:55.780723 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-50634640-8447-4b72-8187-4eac63e7b831 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:55.781735 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-50634640-8447-4b72-8187-4eac63e7b831 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:55.782367 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-50634640-8447-4b72-8187-4eac63e7b831 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:55.949208 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-50634640-8447-4b72-8187-4eac63e7b831 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:55.959260 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-50634640-8447-4b72-8187-4eac63e7b831 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a" status: 200 len: 1692 microversion: 2.1 time: 0.195783 Jun 10 18:38:55.961177 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3430/6908] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:55 2022] GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a => generated 1692 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:56.755191 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f321c862-ee07-4876-b46c-5e8a8f6fde32 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:56.755886 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f321c862-ee07-4876-b46c-5e8a8f6fde32 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:56.763480 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f321c862-ee07-4876-b46c-5e8a8f6fde32 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:56.763975 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f321c862-ee07-4876-b46c-5e8a8f6fde32 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:56.764761 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f321c862-ee07-4876-b46c-5e8a8f6fde32 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:56.765212 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f321c862-ee07-4876-b46c-5e8a8f6fde32 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:56.837832 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f321c862-ee07-4876-b46c-5e8a8f6fde32 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:56.847234 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f321c862-ee07-4876-b46c-5e8a8f6fde32 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1188 microversion: 2.1 time: 0.095960 Jun 10 18:38:56.848423 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3479/6909] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:56 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1188 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:56.977050 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-532cad18-e1fc-4aeb-8da2-6ddd047ce20a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:56.977699 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-532cad18-e1fc-4aeb-8da2-6ddd047ce20a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:56.984258 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-532cad18-e1fc-4aeb-8da2-6ddd047ce20a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:56.984750 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-532cad18-e1fc-4aeb-8da2-6ddd047ce20a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:56.985560 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-532cad18-e1fc-4aeb-8da2-6ddd047ce20a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:56.986052 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-532cad18-e1fc-4aeb-8da2-6ddd047ce20a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:57.122135 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-532cad18-e1fc-4aeb-8da2-6ddd047ce20a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:57.130647 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-532cad18-e1fc-4aeb-8da2-6ddd047ce20a tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a" status: 200 len: 1692 microversion: 2.1 time: 0.157482 Jun 10 18:38:57.131391 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3431/6910] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:56 2022] GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:57.865406 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1ada6f37-288c-46b3-a83a-024dec9594f0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:57.866109 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1ada6f37-288c-46b3-a83a-024dec9594f0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:57.876151 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1ada6f37-288c-46b3-a83a-024dec9594f0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:57.876738 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1ada6f37-288c-46b3-a83a-024dec9594f0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:57.877833 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1ada6f37-288c-46b3-a83a-024dec9594f0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:57.878529 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1ada6f37-288c-46b3-a83a-024dec9594f0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:57.917935 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1ada6f37-288c-46b3-a83a-024dec9594f0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:57.918523 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1ada6f37-288c-46b3-a83a-024dec9594f0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:57.919073 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-1ada6f37-288c-46b3-a83a-024dec9594f0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lazy-loading 'fault' on Instance uuid f1facd35-ee11-47ae-9c44-ea67d49a267f {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:38:57.974989 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1ada6f37-288c-46b3-a83a-024dec9594f0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:57.988904 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1ada6f37-288c-46b3-a83a-024dec9594f0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 200 len: 1193 microversion: 2.1 time: 0.128319 Jun 10 18:38:57.998697 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3480/6911] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:57 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 1193 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:58.147941 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-06bb1121-1d71-4425-bc2d-4d674b10a93e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:58.148798 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-06bb1121-1d71-4425-bc2d-4d674b10a93e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:58.157401 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-06bb1121-1d71-4425-bc2d-4d674b10a93e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:58.158378 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-06bb1121-1d71-4425-bc2d-4d674b10a93e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:58.159318 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-06bb1121-1d71-4425-bc2d-4d674b10a93e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:58.160072 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-06bb1121-1d71-4425-bc2d-4d674b10a93e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:58.323658 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-06bb1121-1d71-4425-bc2d-4d674b10a93e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:58.334824 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-06bb1121-1d71-4425-bc2d-4d674b10a93e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a" status: 200 len: 1692 microversion: 2.1 time: 0.191519 Jun 10 18:38:58.335411 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3432/6912] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:58 2022] GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a => generated 1692 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:38:59.007211 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4b7de814-c35a-4202-b376-64f5408929d4 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:59.008135 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4b7de814-c35a-4202-b376-64f5408929d4 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:59.015277 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4b7de814-c35a-4202-b376-64f5408929d4 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:59.015743 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4b7de814-c35a-4202-b376-64f5408929d4 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:59.016550 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4b7de814-c35a-4202-b376-64f5408929d4 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:59.017003 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4b7de814-c35a-4202-b376-64f5408929d4 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:59.030865 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-4b7de814-c35a-4202-b376-64f5408929d4 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] HTTP exception thrown: Instance f1facd35-ee11-47ae-9c44-ea67d49a267f could not be found. Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4b7de814-c35a-4202-b376-64f5408929d4 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Request method failure captured: Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f HTTP/1.1 Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio48lCBpBlRizgNQmj6c6iu0oXkmc5Tm-q4miwv2Pj49f2pUTZFT27dYtKGefFULH5-gcByMQrPeG1d5YVOJ_GuLGrptrh59AcDYu37Uta2nd4eDA1xNIrohvrn1bdHxnfVCnt0fGjpM3LVpc7O3my-1igIi7pJV4HqsUallplG6Y66g Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 7e9c656d484843ffb1f2de092730345b Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_7e9c656d484843ffb1f2de092730345b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 7e9c656d484843ffb1f2de092730345b Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-TestVolumeBootPattern-1765437769-project Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: b469a8f9433d422aa98d22eea9df7071 Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-TestVolumeBootPattern-1765437769-project Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: exception: Instance f1facd35-ee11-47ae-9c44-ea67d49a267f could not be found. Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'f1facd35-ee11-47ae-9c44-ea67d49a267f'} Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1facd35-ee11-47ae-9c44-ea67d49a267f could not be found. Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1facd35-ee11-47ae-9c44-ea67d49a267f could not be found. Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:38:59.032564 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:38:59.038090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:38:59.038090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:38:59.038090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:38:59.038090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:38:59.038090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:38:59.038090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1facd35-ee11-47ae-9c44-ea67d49a267f could not be found. Jun 10 18:38:59.038090 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:38:59.038090 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4b7de814-c35a-4202-b376-64f5408929d4 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Returning 404 to user: Instance f1facd35-ee11-47ae-9c44-ea67d49a267f could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:38:59.038090 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4b7de814-c35a-4202-b376-64f5408929d4 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 404 len: 111 microversion: 2.1 time: 0.031148 Jun 10 18:38:59.038090 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3481/6913] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:59 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:38:59.351464 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-61cacdd0-742e-476d-9b5f-0472b7d10390 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:38:59.352111 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-61cacdd0-742e-476d-9b5f-0472b7d10390 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:38:59.354974 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=36 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:38:59.360244 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-61cacdd0-742e-476d-9b5f-0472b7d10390 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:59.361705 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-61cacdd0-742e-476d-9b5f-0472b7d10390 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:59.362514 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-61cacdd0-742e-476d-9b5f-0472b7d10390 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:38:59.362957 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-61cacdd0-742e-476d-9b5f-0472b7d10390 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:38:59.512006 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-61cacdd0-742e-476d-9b5f-0472b7d10390 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:38:59.521718 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-61cacdd0-742e-476d-9b5f-0472b7d10390 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a" status: 200 len: 1692 microversion: 2.1 time: 0.174070 Jun 10 18:38:59.529450 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3433/6914] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:38:59 2022] GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a => generated 1692 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:00.539068 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a8df30eb-4e36-4f75-93fa-d1a93654e4b4 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:00.539683 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a8df30eb-4e36-4f75-93fa-d1a93654e4b4 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:00.542601 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:39:00.547360 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a8df30eb-4e36-4f75-93fa-d1a93654e4b4 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:00.551806 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a8df30eb-4e36-4f75-93fa-d1a93654e4b4 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:00.551806 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a8df30eb-4e36-4f75-93fa-d1a93654e4b4 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:00.551806 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a8df30eb-4e36-4f75-93fa-d1a93654e4b4 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:00.688053 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a8df30eb-4e36-4f75-93fa-d1a93654e4b4 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:00.697100 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a8df30eb-4e36-4f75-93fa-d1a93654e4b4 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a" status: 200 len: 1692 microversion: 2.1 time: 0.161973 Jun 10 18:39:00.697689 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3482/6915] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:00 2022] GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:01.170121 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a69e9db4-84a1-444b-9ff1-d930153cf6e6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:01.170654 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a69e9db4-84a1-444b-9ff1-d930153cf6e6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:01.178473 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a69e9db4-84a1-444b-9ff1-d930153cf6e6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:01.178935 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a69e9db4-84a1-444b-9ff1-d930153cf6e6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:01.179711 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a69e9db4-84a1-444b-9ff1-d930153cf6e6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:01.180174 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a69e9db4-84a1-444b-9ff1-d930153cf6e6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:01.193740 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-a69e9db4-84a1-444b-9ff1-d930153cf6e6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] HTTP exception thrown: Instance f1facd35-ee11-47ae-9c44-ea67d49a267f could not be found. Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a69e9db4-84a1-444b-9ff1-d930153cf6e6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Request method failure captured: Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f HTTP/1.1 Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio48lCBpBlRizgNQmj6c6iu0oXkmc5Tm-q4miwv2Pj49f2pUTZFT27dYtKGefFULH5-gcByMQrPeG1d5YVOJ_GuLGrptrh59AcDYu37Uta2nd4eDA1xNIrohvrn1bdHxnfVCnt0fGjpM3LVpc7O3my-1igIi7pJV4HqsUallplG6Y66g Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 7e9c656d484843ffb1f2de092730345b Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_7e9c656d484843ffb1f2de092730345b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 7e9c656d484843ffb1f2de092730345b Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-TestVolumeBootPattern-1765437769-project Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: b469a8f9433d422aa98d22eea9df7071 Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-TestVolumeBootPattern-1765437769-project Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: exception: Instance f1facd35-ee11-47ae-9c44-ea67d49a267f could not be found. Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'f1facd35-ee11-47ae-9c44-ea67d49a267f'} Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1facd35-ee11-47ae-9c44-ea67d49a267f could not be found. Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:39:01.195431 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:39:01.203308 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1facd35-ee11-47ae-9c44-ea67d49a267f could not be found. Jun 10 18:39:01.203308 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:39:01.203308 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:39:01.203308 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:39:01.203308 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:39:01.203308 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:39:01.203308 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:39:01.203308 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:39:01.203308 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:39:01.203308 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1facd35-ee11-47ae-9c44-ea67d49a267f could not be found. Jun 10 18:39:01.203308 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:39:01.203308 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a69e9db4-84a1-444b-9ff1-d930153cf6e6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Returning 404 to user: Instance f1facd35-ee11-47ae-9c44-ea67d49a267f could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:39:01.203308 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a69e9db4-84a1-444b-9ff1-d930153cf6e6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "DELETE /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 404 len: 111 microversion: 2.1 time: 0.030785 Jun 10 18:39:01.203308 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3434/6916] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:39:01 2022] DELETE /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:39:01.210533 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0c5dda3c-3779-41be-a714-a377ef0f4b30 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:01.211346 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0c5dda3c-3779-41be-a714-a377ef0f4b30 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: f1facd35-ee11-47ae-9c44-ea67d49a267f] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:01.217709 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0c5dda3c-3779-41be-a714-a377ef0f4b30 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:01.218183 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0c5dda3c-3779-41be-a714-a377ef0f4b30 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:01.219045 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0c5dda3c-3779-41be-a714-a377ef0f4b30 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:01.219720 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0c5dda3c-3779-41be-a714-a377ef0f4b30 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:01.238012 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-0c5dda3c-3779-41be-a714-a377ef0f4b30 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] HTTP exception thrown: Instance f1facd35-ee11-47ae-9c44-ea67d49a267f could not be found. Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0c5dda3c-3779-41be-a714-a377ef0f4b30 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Request method failure captured: Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f HTTP/1.1 Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio48lCBpBlRizgNQmj6c6iu0oXkmc5Tm-q4miwv2Pj49f2pUTZFT27dYtKGefFULH5-gcByMQrPeG1d5YVOJ_GuLGrptrh59AcDYu37Uta2nd4eDA1xNIrohvrn1bdHxnfVCnt0fGjpM3LVpc7O3my-1igIi7pJV4HqsUallplG6Y66g Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 7e9c656d484843ffb1f2de092730345b Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_7e9c656d484843ffb1f2de092730345b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 7e9c656d484843ffb1f2de092730345b Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-TestVolumeBootPattern-1765437769-project Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: b469a8f9433d422aa98d22eea9df7071 Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-TestVolumeBootPattern-1765437769-project Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: exception: Instance f1facd35-ee11-47ae-9c44-ea67d49a267f could not be found. Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'f1facd35-ee11-47ae-9c44-ea67d49a267f'} Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1facd35-ee11-47ae-9c44-ea67d49a267f could not be found. Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1facd35-ee11-47ae-9c44-ea67d49a267f could not be found. Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:39:01.239558 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:39:01.243440 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:39:01.243440 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:39:01.243440 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:39:01.243440 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:39:01.243440 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:39:01.243440 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1facd35-ee11-47ae-9c44-ea67d49a267f could not be found. Jun 10 18:39:01.243440 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:39:01.243440 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0c5dda3c-3779-41be-a714-a377ef0f4b30 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Returning 404 to user: Instance f1facd35-ee11-47ae-9c44-ea67d49a267f could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:39:01.243440 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0c5dda3c-3779-41be-a714-a377ef0f4b30 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f" status: 404 len: 111 microversion: 2.1 time: 0.034801 Jun 10 18:39:01.243440 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3483/6917] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:01 2022] GET /compute/v2.1/servers/f1facd35-ee11-47ae-9c44-ea67d49a267f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:39:01.714315 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cd87879c-8bfb-48e4-9116-ffc202831a79 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:01.714927 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cd87879c-8bfb-48e4-9116-ffc202831a79 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:01.721194 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd87879c-8bfb-48e4-9116-ffc202831a79 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:01.721644 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd87879c-8bfb-48e4-9116-ffc202831a79 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:01.722601 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd87879c-8bfb-48e4-9116-ffc202831a79 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:01.723043 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd87879c-8bfb-48e4-9116-ffc202831a79 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:01.937161 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cd87879c-8bfb-48e4-9116-ffc202831a79 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:01.946964 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cd87879c-8bfb-48e4-9116-ffc202831a79 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a" status: 200 len: 1692 microversion: 2.1 time: 0.236390 Jun 10 18:39:01.948390 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3435/6918] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:01 2022] GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a => generated 1692 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:02.965475 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-06ec39e7-d0a7-4aa1-8324-ee12862a859d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:02.966082 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-06ec39e7-d0a7-4aa1-8324-ee12862a859d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:02.973797 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-06ec39e7-d0a7-4aa1-8324-ee12862a859d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:02.974349 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-06ec39e7-d0a7-4aa1-8324-ee12862a859d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:02.975154 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-06ec39e7-d0a7-4aa1-8324-ee12862a859d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:02.975598 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-06ec39e7-d0a7-4aa1-8324-ee12862a859d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:02.992048 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:39:03.130739 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-06ec39e7-d0a7-4aa1-8324-ee12862a859d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:03.141279 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-06ec39e7-d0a7-4aa1-8324-ee12862a859d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a" status: 200 len: 1692 microversion: 2.1 time: 0.180083 Jun 10 18:39:03.142731 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3484/6919] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:02 2022] GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a => generated 1692 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:04.166576 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4e7ef7f4-d0e8-48ca-809d-289a0c3d1fdb tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:04.167504 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4e7ef7f4-d0e8-48ca-809d-289a0c3d1fdb tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:04.181818 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e7ef7f4-d0e8-48ca-809d-289a0c3d1fdb tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:04.186614 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e7ef7f4-d0e8-48ca-809d-289a0c3d1fdb tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:04.188278 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e7ef7f4-d0e8-48ca-809d-289a0c3d1fdb tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:04.190106 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e7ef7f4-d0e8-48ca-809d-289a0c3d1fdb tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:04.445173 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4e7ef7f4-d0e8-48ca-809d-289a0c3d1fdb tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:04.453620 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4e7ef7f4-d0e8-48ca-809d-289a0c3d1fdb tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a" status: 200 len: 1692 microversion: 2.1 time: 0.291776 Jun 10 18:39:04.454275 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3436/6920] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:04 2022] GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a => generated 1692 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:05.471567 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d93c6940-f4f3-4323-b362-db4eacd8200c tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:05.472319 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d93c6940-f4f3-4323-b362-db4eacd8200c tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:05.480568 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d93c6940-f4f3-4323-b362-db4eacd8200c tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:05.481418 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d93c6940-f4f3-4323-b362-db4eacd8200c tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:05.481892 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d93c6940-f4f3-4323-b362-db4eacd8200c tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:05.482343 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d93c6940-f4f3-4323-b362-db4eacd8200c tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:05.640533 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d93c6940-f4f3-4323-b362-db4eacd8200c tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:05.657072 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d93c6940-f4f3-4323-b362-db4eacd8200c tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a" status: 200 len: 1692 microversion: 2.1 time: 0.189884 Jun 10 18:39:05.658197 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3485/6921] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:05 2022] GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a => generated 1692 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:06.675595 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b8a24f85-c3f2-4c3c-857b-676102bbb520 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:06.676351 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b8a24f85-c3f2-4c3c-857b-676102bbb520 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:06.683526 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b8a24f85-c3f2-4c3c-857b-676102bbb520 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:06.684069 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b8a24f85-c3f2-4c3c-857b-676102bbb520 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:06.684969 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b8a24f85-c3f2-4c3c-857b-676102bbb520 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:06.685485 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b8a24f85-c3f2-4c3c-857b-676102bbb520 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:06.831624 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b8a24f85-c3f2-4c3c-857b-676102bbb520 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:06.874303 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b8a24f85-c3f2-4c3c-857b-676102bbb520 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a" status: 200 len: 1692 microversion: 2.1 time: 0.202732 Jun 10 18:39:06.875488 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3437/6922] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:06 2022] GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a => generated 1692 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:07.891523 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9986968a-be76-4a2d-9cbd-bd8910602f21 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:07.892804 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9986968a-be76-4a2d-9cbd-bd8910602f21 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:07.899502 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9986968a-be76-4a2d-9cbd-bd8910602f21 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:07.899960 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9986968a-be76-4a2d-9cbd-bd8910602f21 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:07.900754 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9986968a-be76-4a2d-9cbd-bd8910602f21 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:07.901193 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9986968a-be76-4a2d-9cbd-bd8910602f21 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:08.013379 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1088e11c-c42d-4dd1-921b-3275a83a6070 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1042688629", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "f0dbfb53-da7d-4daa-83fd-d6858c374138"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:39:08.066197 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-1088e11c-c42d-4dd1-921b-3275a83a6070 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] validate_networks() for [('f0dbfb53-da7d-4daa-83fd-d6858c374138', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:39:08.067422 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9986968a-be76-4a2d-9cbd-bd8910602f21 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:08.075594 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9986968a-be76-4a2d-9cbd-bd8910602f21 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a" status: 200 len: 1692 microversion: 2.1 time: 0.188055 Jun 10 18:39:08.088894 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3438/6923] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:07 2022] GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a => generated 1692 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:39:08.539228 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-1088e11c-c42d-4dd1-921b-3275a83a6070 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:39:08.539651 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-1088e11c-c42d-4dd1-921b-3275a83a6070 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:39:08.540128 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-1088e11c-c42d-4dd1-921b-3275a83a6070 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:39:08.540572 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-1088e11c-c42d-4dd1-921b-3275a83a6070 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:39:08.540990 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-1088e11c-c42d-4dd1-921b-3275a83a6070 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:39:08.550267 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1088e11c-c42d-4dd1-921b-3275a83a6070 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:08.550731 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1088e11c-c42d-4dd1-921b-3275a83a6070 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:08.551532 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1088e11c-c42d-4dd1-921b-3275a83a6070 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:08.551975 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1088e11c-c42d-4dd1-921b-3275a83a6070 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:08.569626 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-1088e11c-c42d-4dd1-921b-3275a83a6070 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Getting quotas for project 3974cb13af3f49e680458452f7e902b3. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:39:08.575134 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-1088e11c-c42d-4dd1-921b-3275a83a6070 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Getting quotas for user c6d4f30deb0d4243b55a22118996049a and project 3974cb13af3f49e680458452f7e902b3. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:39:08.589335 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1088e11c-c42d-4dd1-921b-3275a83a6070 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:39:08.591668 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1088e11c-c42d-4dd1-921b-3275a83a6070 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] [instance: fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:39:08.749644 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1088e11c-c42d-4dd1-921b-3275a83a6070 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.896591 Jun 10 18:39:08.750700 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3486/6924] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:39:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:39:08.763551 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4d0eb6e0-ae77-499a-9ed3-e4e90de68b12 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:08.764240 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4d0eb6e0-ae77-499a-9ed3-e4e90de68b12 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] [instance: fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:08.820534 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4d0eb6e0-ae77-499a-9ed3-e4e90de68b12 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4f30deb0d4243b55a22118996049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3974cb13af3f49e680458452f7e902b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:08.827646 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4d0eb6e0-ae77-499a-9ed3-e4e90de68b12 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] 10.222.0.35 "GET /compute/v2.1/servers/fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c" status: 200 len: 1214 microversion: 2.1 time: 0.070344 Jun 10 18:39:08.828596 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3439/6925] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:08 2022] GET /compute/v2.1/servers/fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:09.101160 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cbd120d0-e074-4c09-8825-f932c890ff8e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:09.102278 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cbd120d0-e074-4c09-8825-f932c890ff8e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:09.109709 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cbd120d0-e074-4c09-8825-f932c890ff8e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:09.110370 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cbd120d0-e074-4c09-8825-f932c890ff8e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:09.112105 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cbd120d0-e074-4c09-8825-f932c890ff8e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:09.112572 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cbd120d0-e074-4c09-8825-f932c890ff8e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:09.255076 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cbd120d0-e074-4c09-8825-f932c890ff8e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:09.263156 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cbd120d0-e074-4c09-8825-f932c890ff8e tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a" status: 200 len: 1692 microversion: 2.1 time: 0.168427 Jun 10 18:39:09.263712 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3487/6926] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:09 2022] GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:09.844971 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1d8959f7-6ebb-4fa6-820b-c46d3953a491 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:09.845718 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1d8959f7-6ebb-4fa6-820b-c46d3953a491 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] [instance: fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:09.853476 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d8959f7-6ebb-4fa6-820b-c46d3953a491 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:09.853940 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d8959f7-6ebb-4fa6-820b-c46d3953a491 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:09.854721 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d8959f7-6ebb-4fa6-820b-c46d3953a491 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:09.855172 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d8959f7-6ebb-4fa6-820b-c46d3953a491 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:09.918678 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1d8959f7-6ebb-4fa6-820b-c46d3953a491 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4f30deb0d4243b55a22118996049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3974cb13af3f49e680458452f7e902b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:09.929906 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1d8959f7-6ebb-4fa6-820b-c46d3953a491 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] 10.222.0.35 "GET /compute/v2.1/servers/fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c" status: 200 len: 1218 microversion: 2.1 time: 0.088552 Jun 10 18:39:09.930786 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3440/6927] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:09 2022] GET /compute/v2.1/servers/fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:10.280760 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bf71a150-6428-4328-848b-971f3cf8008f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:10.281473 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-bf71a150-6428-4328-848b-971f3cf8008f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:10.288978 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bf71a150-6428-4328-848b-971f3cf8008f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:10.289647 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bf71a150-6428-4328-848b-971f3cf8008f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:10.290437 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bf71a150-6428-4328-848b-971f3cf8008f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:10.290887 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bf71a150-6428-4328-848b-971f3cf8008f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:10.431195 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-bf71a150-6428-4328-848b-971f3cf8008f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:10.439871 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bf71a150-6428-4328-848b-971f3cf8008f tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a" status: 200 len: 1692 microversion: 2.1 time: 0.163400 Jun 10 18:39:10.440651 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3488/6928] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:10 2022] GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:39:10.946987 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-13df92bc-edd9-4801-b5b7-1ea758f0d758 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:10.947599 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-13df92bc-edd9-4801-b5b7-1ea758f0d758 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] [instance: fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:10.956092 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-13df92bc-edd9-4801-b5b7-1ea758f0d758 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:10.956581 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-13df92bc-edd9-4801-b5b7-1ea758f0d758 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:10.960981 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-13df92bc-edd9-4801-b5b7-1ea758f0d758 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:10.960981 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-13df92bc-edd9-4801-b5b7-1ea758f0d758 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:11.023417 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-13df92bc-edd9-4801-b5b7-1ea758f0d758 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4f30deb0d4243b55a22118996049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3974cb13af3f49e680458452f7e902b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:11.031548 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-13df92bc-edd9-4801-b5b7-1ea758f0d758 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] 10.222.0.35 "GET /compute/v2.1/servers/fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c" status: 200 len: 1266 microversion: 2.1 time: 0.088422 Jun 10 18:39:11.032138 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3441/6929] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:10 2022] GET /compute/v2.1/servers/fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:11.456913 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b47724c5-28a3-43f0-bf44-a36f53b6b1b8 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:11.457522 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b47724c5-28a3-43f0-bf44-a36f53b6b1b8 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:11.466640 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b47724c5-28a3-43f0-bf44-a36f53b6b1b8 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:11.467093 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b47724c5-28a3-43f0-bf44-a36f53b6b1b8 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:11.468490 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b47724c5-28a3-43f0-bf44-a36f53b6b1b8 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:11.469109 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b47724c5-28a3-43f0-bf44-a36f53b6b1b8 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:11.616833 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b47724c5-28a3-43f0-bf44-a36f53b6b1b8 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:11.630132 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b47724c5-28a3-43f0-bf44-a36f53b6b1b8 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a" status: 200 len: 1698 microversion: 2.1 time: 0.176888 Jun 10 18:39:11.633215 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3489/6930] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:11 2022] GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a => generated 1698 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:12.051093 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3d4e2917-a978-4e36-9f54-3243c399fa4b tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:12.051761 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3d4e2917-a978-4e36-9f54-3243c399fa4b tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] [instance: fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:12.059318 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3d4e2917-a978-4e36-9f54-3243c399fa4b tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:12.059863 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3d4e2917-a978-4e36-9f54-3243c399fa4b tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:12.060680 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3d4e2917-a978-4e36-9f54-3243c399fa4b tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:12.061125 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3d4e2917-a978-4e36-9f54-3243c399fa4b tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:12.128690 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3d4e2917-a978-4e36-9f54-3243c399fa4b tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4f30deb0d4243b55a22118996049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3974cb13af3f49e680458452f7e902b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:12.136918 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3d4e2917-a978-4e36-9f54-3243c399fa4b tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] 10.222.0.35 "GET /compute/v2.1/servers/fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c" status: 200 len: 1266 microversion: 2.1 time: 0.089825 Jun 10 18:39:12.140182 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3442/6931] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:12 2022] GET /compute/v2.1/servers/fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:12.647594 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-94aa0b5d-b227-445e-8e13-825779fb3331 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:12.648611 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-94aa0b5d-b227-445e-8e13-825779fb3331 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:12.657818 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-94aa0b5d-b227-445e-8e13-825779fb3331 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:12.659266 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-94aa0b5d-b227-445e-8e13-825779fb3331 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:12.661232 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-94aa0b5d-b227-445e-8e13-825779fb3331 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:12.662192 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-94aa0b5d-b227-445e-8e13-825779fb3331 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:12.900254 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-94aa0b5d-b227-445e-8e13-825779fb3331 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:12.912839 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-94aa0b5d-b227-445e-8e13-825779fb3331 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a" status: 200 len: 1698 microversion: 2.1 time: 0.268650 Jun 10 18:39:12.929781 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3490/6932] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:12 2022] GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a => generated 1698 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:39:13.092387 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-eb8ee6f9-8b2c-4a54-8f80-b24403e6cbc1 req-94d1934e-1515-4135-85e7-be5574c7624c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a", "name": "network-vif-unplugged", "status": "completed", "tag": "52404c9e-a5ad-4dd5-8bcd-f3725b19f0eb"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:39:13.106531 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-eb8ee6f9-8b2c-4a54-8f80-b24403e6cbc1 req-94d1934e-1515-4135-85e7-be5574c7624c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:13.107134 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-eb8ee6f9-8b2c-4a54-8f80-b24403e6cbc1 req-94d1934e-1515-4135-85e7-be5574c7624c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:13.125872 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-eb8ee6f9-8b2c-4a54-8f80-b24403e6cbc1 req-94d1934e-1515-4135-85e7-be5574c7624c service nova] Creating event network-vif-unplugged:52404c9e-a5ad-4dd5-8bcd-f3725b19f0eb for instance 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a on chh1-master-2 Jun 10 18:39:13.134202 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-eb8ee6f9-8b2c-4a54-8f80-b24403e6cbc1 req-94d1934e-1515-4135-85e7-be5574c7624c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.130025 Jun 10 18:39:13.134202 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3443/6933] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:39:13.155952 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0bf2ae4a-a9a1-4cda-8a19-4d11483f9eb0 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:13.158152 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0bf2ae4a-a9a1-4cda-8a19-4d11483f9eb0 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] [instance: fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:13.165495 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0bf2ae4a-a9a1-4cda-8a19-4d11483f9eb0 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:13.165955 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0bf2ae4a-a9a1-4cda-8a19-4d11483f9eb0 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:13.166828 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0bf2ae4a-a9a1-4cda-8a19-4d11483f9eb0 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:13.167413 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0bf2ae4a-a9a1-4cda-8a19-4d11483f9eb0 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:13.237463 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0bf2ae4a-a9a1-4cda-8a19-4d11483f9eb0 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4f30deb0d4243b55a22118996049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3974cb13af3f49e680458452f7e902b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:13.247369 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0bf2ae4a-a9a1-4cda-8a19-4d11483f9eb0 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] 10.222.0.35 "GET /compute/v2.1/servers/fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c" status: 200 len: 1272 microversion: 2.1 time: 0.096734 Jun 10 18:39:13.247977 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3491/6934] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:13 2022] GET /compute/v2.1/servers/fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c => generated 1272 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:39:13.931998 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1fca2618-902d-40dd-b094-ede1d2704408 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:13.932738 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1fca2618-902d-40dd-b094-ede1d2704408 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:13.940159 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1fca2618-902d-40dd-b094-ede1d2704408 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:13.941297 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1fca2618-902d-40dd-b094-ede1d2704408 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:13.942088 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1fca2618-902d-40dd-b094-ede1d2704408 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:13.942538 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1fca2618-902d-40dd-b094-ede1d2704408 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:14.176364 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1fca2618-902d-40dd-b094-ede1d2704408 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:14.188355 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1fca2618-902d-40dd-b094-ede1d2704408 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a" status: 200 len: 1683 microversion: 2.1 time: 0.260818 Jun 10 18:39:14.190109 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3444/6935] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:13 2022] GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a => generated 1683 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:14.265422 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-09b47dd0-b585-4e93-920b-24a3a2fc68ee tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:14.267922 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-09b47dd0-b585-4e93-920b-24a3a2fc68ee tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] [instance: fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:14.276476 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-09b47dd0-b585-4e93-920b-24a3a2fc68ee tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:14.278957 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-09b47dd0-b585-4e93-920b-24a3a2fc68ee tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:14.278957 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-09b47dd0-b585-4e93-920b-24a3a2fc68ee tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:14.278957 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-09b47dd0-b585-4e93-920b-24a3a2fc68ee tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:14.443693 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-09b47dd0-b585-4e93-920b-24a3a2fc68ee tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4f30deb0d4243b55a22118996049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3974cb13af3f49e680458452f7e902b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:14.452179 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-09b47dd0-b585-4e93-920b-24a3a2fc68ee tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] 10.222.0.35 "GET /compute/v2.1/servers/fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c" status: 200 len: 1314 microversion: 2.1 time: 0.191746 Jun 10 18:39:14.453118 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3492/6936] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:14 2022] GET /compute/v2.1/servers/fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:14.717810 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-a4543449-c63a-4bef-acd8-2b01ab847995 req-03f8cd85-5384-4ce6-8fa8-db17574e1544 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c", "tag": "6bb40ce1-bee7-4ad1-bf9b-b548abd33c42"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:39:14.727608 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-a4543449-c63a-4bef-acd8-2b01ab847995 req-03f8cd85-5384-4ce6-8fa8-db17574e1544 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:14.729840 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-a4543449-c63a-4bef-acd8-2b01ab847995 req-03f8cd85-5384-4ce6-8fa8-db17574e1544 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:14.755552 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-a4543449-c63a-4bef-acd8-2b01ab847995 req-03f8cd85-5384-4ce6-8fa8-db17574e1544 service nova] Creating event network-changed:6bb40ce1-bee7-4ad1-bf9b-b548abd33c42 for instance fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c on chh1-master-2 Jun 10 18:39:14.761889 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-a4543449-c63a-4bef-acd8-2b01ab847995 req-03f8cd85-5384-4ce6-8fa8-db17574e1544 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126560 Jun 10 18:39:14.762680 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3445/6937] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:39:15.157206 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-69917b5a-a0a1-4367-9310-a4c51f9eec93 req-5966341d-eb34-42eb-b241-e4663a6fd85f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a", "name": "network-vif-plugged", "status": "completed", "tag": "52404c9e-a5ad-4dd5-8bcd-f3725b19f0eb"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:39:15.167701 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-69917b5a-a0a1-4367-9310-a4c51f9eec93 req-5966341d-eb34-42eb-b241-e4663a6fd85f service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:15.168442 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-69917b5a-a0a1-4367-9310-a4c51f9eec93 req-5966341d-eb34-42eb-b241-e4663a6fd85f service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:15.180562 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-69917b5a-a0a1-4367-9310-a4c51f9eec93 req-5966341d-eb34-42eb-b241-e4663a6fd85f service nova] Creating event network-vif-plugged:52404c9e-a5ad-4dd5-8bcd-f3725b19f0eb for instance 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a on chh1-master-2 Jun 10 18:39:15.188006 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-69917b5a-a0a1-4367-9310-a4c51f9eec93 req-5966341d-eb34-42eb-b241-e4663a6fd85f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032440 Jun 10 18:39:15.188006 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3493/6938] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:39:15.472234 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c2309242-82d0-4d75-bb79-bd1f37ee8c5d tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:15.472969 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c2309242-82d0-4d75-bb79-bd1f37ee8c5d tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] [instance: fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:15.479670 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c2309242-82d0-4d75-bb79-bd1f37ee8c5d tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:15.480210 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c2309242-82d0-4d75-bb79-bd1f37ee8c5d tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:15.481058 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c2309242-82d0-4d75-bb79-bd1f37ee8c5d tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:15.481504 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c2309242-82d0-4d75-bb79-bd1f37ee8c5d tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:15.628497 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c2309242-82d0-4d75-bb79-bd1f37ee8c5d tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4f30deb0d4243b55a22118996049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3974cb13af3f49e680458452f7e902b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:15.636567 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c2309242-82d0-4d75-bb79-bd1f37ee8c5d tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] 10.222.0.35 "GET /compute/v2.1/servers/fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c" status: 200 len: 1314 microversion: 2.1 time: 0.170176 Jun 10 18:39:15.637408 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3446/6939] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:15 2022] GET /compute/v2.1/servers/fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:16.655800 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-56a2d8f2-dfde-4cc5-b3fe-b9c1d288bf1c tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:16.656457 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-56a2d8f2-dfde-4cc5-b3fe-b9c1d288bf1c tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] [instance: fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:16.678408 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-56a2d8f2-dfde-4cc5-b3fe-b9c1d288bf1c tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:16.681515 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-56a2d8f2-dfde-4cc5-b3fe-b9c1d288bf1c tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:16.681515 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-56a2d8f2-dfde-4cc5-b3fe-b9c1d288bf1c tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:16.681515 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-56a2d8f2-dfde-4cc5-b3fe-b9c1d288bf1c tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:16.829731 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-56a2d8f2-dfde-4cc5-b3fe-b9c1d288bf1c tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4f30deb0d4243b55a22118996049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3974cb13af3f49e680458452f7e902b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:16.837441 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-56a2d8f2-dfde-4cc5-b3fe-b9c1d288bf1c tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] 10.222.0.35 "GET /compute/v2.1/servers/fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c" status: 200 len: 1314 microversion: 2.1 time: 0.187077 Jun 10 18:39:16.838026 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3494/6940] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:16 2022] GET /compute/v2.1/servers/fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:17.857351 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4f5612f3-c0de-4e69-8dcf-99a8b7ee5864 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:17.858082 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4f5612f3-c0de-4e69-8dcf-99a8b7ee5864 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] [instance: fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:17.867958 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f5612f3-c0de-4e69-8dcf-99a8b7ee5864 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:17.868665 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f5612f3-c0de-4e69-8dcf-99a8b7ee5864 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:17.869995 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f5612f3-c0de-4e69-8dcf-99a8b7ee5864 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:17.870439 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f5612f3-c0de-4e69-8dcf-99a8b7ee5864 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:18.010931 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4f5612f3-c0de-4e69-8dcf-99a8b7ee5864 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4f30deb0d4243b55a22118996049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3974cb13af3f49e680458452f7e902b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:18.018595 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4f5612f3-c0de-4e69-8dcf-99a8b7ee5864 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] 10.222.0.35 "GET /compute/v2.1/servers/fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c" status: 200 len: 1314 microversion: 2.1 time: 0.166976 Jun 10 18:39:18.019164 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3447/6941] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:17 2022] GET /compute/v2.1/servers/fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:19.035379 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9080b094-54fa-47a3-85e0-a003bb1de155 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:19.036167 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9080b094-54fa-47a3-85e0-a003bb1de155 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] [instance: fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:19.040403 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:39:19.041238 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=6 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:39:19.044909 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9080b094-54fa-47a3-85e0-a003bb1de155 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:19.045367 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9080b094-54fa-47a3-85e0-a003bb1de155 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:19.046187 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9080b094-54fa-47a3-85e0-a003bb1de155 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:19.046634 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9080b094-54fa-47a3-85e0-a003bb1de155 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:19.155675 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-172d88a7-bd36-43c2-afee-3df52c179759 req-22870c3c-7f2d-4698-a487-0e9e995dd831 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c", "name": "network-vif-plugged", "status": "completed", "tag": "6bb40ce1-bee7-4ad1-bf9b-b548abd33c42"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:39:19.161801 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:39:19.167191 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-172d88a7-bd36-43c2-afee-3df52c179759 req-22870c3c-7f2d-4698-a487-0e9e995dd831 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:19.169394 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-172d88a7-bd36-43c2-afee-3df52c179759 req-22870c3c-7f2d-4698-a487-0e9e995dd831 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:19.179420 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-172d88a7-bd36-43c2-afee-3df52c179759 req-22870c3c-7f2d-4698-a487-0e9e995dd831 service nova] Creating event network-vif-plugged:6bb40ce1-bee7-4ad1-bf9b-b548abd33c42 for instance fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c on chh1-master-2 Jun 10 18:39:19.184297 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-172d88a7-bd36-43c2-afee-3df52c179759 req-22870c3c-7f2d-4698-a487-0e9e995dd831 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033162 Jun 10 18:39:19.184932 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3448/6942] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:39:19.197053 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9080b094-54fa-47a3-85e0-a003bb1de155 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4f30deb0d4243b55a22118996049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3974cb13af3f49e680458452f7e902b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:19.206290 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9080b094-54fa-47a3-85e0-a003bb1de155 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] 10.222.0.35 "GET /compute/v2.1/servers/fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c" status: 200 len: 1314 microversion: 2.1 time: 0.174727 Jun 10 18:39:19.206893 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3495/6943] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:19 2022] GET /compute/v2.1/servers/fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:20.225248 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-713ae1ca-2fb2-4eb4-b950-4657daa9ab57 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:20.225945 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-713ae1ca-2fb2-4eb4-b950-4657daa9ab57 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] [instance: fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:20.232760 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-713ae1ca-2fb2-4eb4-b950-4657daa9ab57 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:20.233286 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-713ae1ca-2fb2-4eb4-b950-4657daa9ab57 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:20.234052 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-713ae1ca-2fb2-4eb4-b950-4657daa9ab57 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:20.234487 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-713ae1ca-2fb2-4eb4-b950-4657daa9ab57 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:20.249187 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:39:20.384057 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-713ae1ca-2fb2-4eb4-b950-4657daa9ab57 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4f30deb0d4243b55a22118996049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3974cb13af3f49e680458452f7e902b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:20.392851 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-713ae1ca-2fb2-4eb4-b950-4657daa9ab57 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] 10.222.0.35 "GET /compute/v2.1/servers/fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c" status: 200 len: 1314 microversion: 2.1 time: 0.172695 Jun 10 18:39:20.393765 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3449/6944] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:20 2022] GET /compute/v2.1/servers/fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:21.415189 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-879e5503-7e97-4fe9-b1d4-400b7296ce28 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:21.415189 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-879e5503-7e97-4fe9-b1d4-400b7296ce28 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] [instance: fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:21.423655 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-879e5503-7e97-4fe9-b1d4-400b7296ce28 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:21.424109 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-879e5503-7e97-4fe9-b1d4-400b7296ce28 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:21.424902 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-879e5503-7e97-4fe9-b1d4-400b7296ce28 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:21.425341 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-879e5503-7e97-4fe9-b1d4-400b7296ce28 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:21.557626 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-879e5503-7e97-4fe9-b1d4-400b7296ce28 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4f30deb0d4243b55a22118996049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3974cb13af3f49e680458452f7e902b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:21.566247 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-879e5503-7e97-4fe9-b1d4-400b7296ce28 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] 10.222.0.35 "GET /compute/v2.1/servers/fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c" status: 200 len: 1498 microversion: 2.1 time: 0.160010 Jun 10 18:39:21.566850 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3496/6945] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:21 2022] GET /compute/v2.1/servers/fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c => generated 1498 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:25.799969 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-573fcfcd-7b63-4746-8d30-51d64bb7d0d5 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:25.800545 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-573fcfcd-7b63-4746-8d30-51d64bb7d0d5 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] [instance: fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:25.807514 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-573fcfcd-7b63-4746-8d30-51d64bb7d0d5 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:25.807966 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-573fcfcd-7b63-4746-8d30-51d64bb7d0d5 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:25.808785 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-573fcfcd-7b63-4746-8d30-51d64bb7d0d5 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:25.809218 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-573fcfcd-7b63-4746-8d30-51d64bb7d0d5 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:25.834767 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-573fcfcd-7b63-4746-8d30-51d64bb7d0d5 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] [instance: fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:39:26.129864 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-573fcfcd-7b63-4746-8d30-51d64bb7d0d5 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] 10.222.0.35 "DELETE /compute/v2.1/servers/fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c" status: 204 len: 0 microversion: 2.1 time: 0.333844 Jun 10 18:39:26.130476 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3450/6946] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:39:25 2022] DELETE /compute/v2.1/servers/fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:39:26.138572 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-62116fa3-faf5-400d-91cd-dc1d6eb1b60a tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:26.142011 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-62116fa3-faf5-400d-91cd-dc1d6eb1b60a tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] [instance: fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:26.147513 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-62116fa3-faf5-400d-91cd-dc1d6eb1b60a tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:26.148071 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-62116fa3-faf5-400d-91cd-dc1d6eb1b60a tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:26.149158 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-62116fa3-faf5-400d-91cd-dc1d6eb1b60a tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:26.149599 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-62116fa3-faf5-400d-91cd-dc1d6eb1b60a tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:26.283087 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-62116fa3-faf5-400d-91cd-dc1d6eb1b60a tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4f30deb0d4243b55a22118996049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3974cb13af3f49e680458452f7e902b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:26.290727 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-62116fa3-faf5-400d-91cd-dc1d6eb1b60a tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] 10.222.0.35 "GET /compute/v2.1/servers/fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c" status: 200 len: 1504 microversion: 2.1 time: 0.156009 Jun 10 18:39:26.291316 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3497/6947] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:26 2022] GET /compute/v2.1/servers/fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:27.309462 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9fbf2ad7-857f-4454-a325-5c3a553bf502 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:27.310172 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9fbf2ad7-857f-4454-a325-5c3a553bf502 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] [instance: fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:27.318359 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9fbf2ad7-857f-4454-a325-5c3a553bf502 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:27.318822 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9fbf2ad7-857f-4454-a325-5c3a553bf502 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:27.319622 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9fbf2ad7-857f-4454-a325-5c3a553bf502 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:27.320068 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9fbf2ad7-857f-4454-a325-5c3a553bf502 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:27.458082 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9fbf2ad7-857f-4454-a325-5c3a553bf502 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4f30deb0d4243b55a22118996049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3974cb13af3f49e680458452f7e902b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:27.466095 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9fbf2ad7-857f-4454-a325-5c3a553bf502 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] 10.222.0.35 "GET /compute/v2.1/servers/fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c" status: 200 len: 1504 microversion: 2.1 time: 0.161246 Jun 10 18:39:27.466669 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3451/6948] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:27 2022] GET /compute/v2.1/servers/fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:28.183170 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-625498b3-6558-466d-978e-916fdc66174f req-218013cb-92d4-43af-92fe-5269125af387 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c", "name": "network-vif-deleted", "tag": "6bb40ce1-bee7-4ad1-bf9b-b548abd33c42"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:39:28.195092 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-625498b3-6558-466d-978e-916fdc66174f req-218013cb-92d4-43af-92fe-5269125af387 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:28.195634 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-625498b3-6558-466d-978e-916fdc66174f req-218013cb-92d4-43af-92fe-5269125af387 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:28.208536 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-625498b3-6558-466d-978e-916fdc66174f req-218013cb-92d4-43af-92fe-5269125af387 service nova] Creating event network-vif-deleted:6bb40ce1-bee7-4ad1-bf9b-b548abd33c42 for instance fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c on chh1-master-2 Jun 10 18:39:28.214009 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-625498b3-6558-466d-978e-916fdc66174f req-218013cb-92d4-43af-92fe-5269125af387 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034909 Jun 10 18:39:28.214883 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3498/6949] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:39:28.482340 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-aededc34-841c-4041-b797-3dc1eaa30faa tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:28.482947 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-aededc34-841c-4041-b797-3dc1eaa30faa tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] [instance: fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:28.490083 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aededc34-841c-4041-b797-3dc1eaa30faa tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:28.490538 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aededc34-841c-4041-b797-3dc1eaa30faa tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:28.491314 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aededc34-841c-4041-b797-3dc1eaa30faa tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:28.491854 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aededc34-841c-4041-b797-3dc1eaa30faa tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:28.526822 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aededc34-841c-4041-b797-3dc1eaa30faa tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:28.527308 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aededc34-841c-4041-b797-3dc1eaa30faa tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:28.527757 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-aededc34-841c-4041-b797-3dc1eaa30faa tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lazy-loading 'fault' on Instance uuid fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:39:28.569787 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-aededc34-841c-4041-b797-3dc1eaa30faa tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4f30deb0d4243b55a22118996049a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3974cb13af3f49e680458452f7e902b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:28.577578 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-aededc34-841c-4041-b797-3dc1eaa30faa tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] 10.222.0.35 "GET /compute/v2.1/servers/fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c" status: 200 len: 1304 microversion: 2.1 time: 0.099248 Jun 10 18:39:28.578157 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3452/6950] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:28 2022] GET /compute/v2.1/servers/fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:29.595982 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-38c4d460-91ee-413c-904e-1267fcb144d4 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:29.596638 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-38c4d460-91ee-413c-904e-1267fcb144d4 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] [instance: fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:29.604448 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-38c4d460-91ee-413c-904e-1267fcb144d4 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:29.604907 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-38c4d460-91ee-413c-904e-1267fcb144d4 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:29.605673 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-38c4d460-91ee-413c-904e-1267fcb144d4 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:29.606115 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-38c4d460-91ee-413c-904e-1267fcb144d4 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:29.619940 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-38c4d460-91ee-413c-904e-1267fcb144d4 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] HTTP exception thrown: Instance fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c could not be found. Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-38c4d460-91ee-413c-904e-1267fcb144d4 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Request method failure captured: Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c HTTP/1.1 Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio4_Jp-FsVLnhI-NRoBTHSeYNo5fZt_WSdffRsByFQjPXSIDGBptUu_gk3vhHV8qn17tDYm2Z4KFCxo0FWa8heRrDwpbC6IKoBvO1bV8pnjZ5uduRJNKY0DQowsjvD14gxLCqG3oYV_HHcpjjvt1PKA6P-emFkLTIo8W_LqBJxMOMEPI Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 3974cb13af3f49e680458452f7e902b3 Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-VolumesActionsTest-1174664037 Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/3974cb13af3f49e680458452f7e902b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3974cb13af3f49e680458452f7e902b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3974cb13af3f49e680458452f7e902b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_3974cb13af3f49e680458452f7e902b3", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-VolumesActionsTest-1174664037 Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 3974cb13af3f49e680458452f7e902b3 Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-VolumesActionsTest-1174664037 Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-VolumesActionsTest-1174664037-project Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: c6d4f30deb0d4243b55a22118996049a Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-VolumesActionsTest-1174664037-project Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: exception: Instance fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c could not be found. Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c'} Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c could not be found. Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c could not be found. Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:39:29.621576 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:39:29.626253 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:39:29.626253 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:39:29.626253 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:39:29.626253 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:39:29.626253 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:39:29.626253 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c could not be found. Jun 10 18:39:29.626253 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:39:29.626253 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-38c4d460-91ee-413c-904e-1267fcb144d4 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] Returning 404 to user: Instance fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:39:29.626253 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-38c4d460-91ee-413c-904e-1267fcb144d4 tempest-VolumesActionsTest-1174664037 tempest-VolumesActionsTest-1174664037-project] 10.222.0.35 "GET /compute/v2.1/servers/fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c" status: 404 len: 111 microversion: 2.1 time: 0.031395 Jun 10 18:39:29.626253 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3499/6951] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:29 2022] GET /compute/v2.1/servers/fa33c6fc-51e9-4fc9-b677-3f3ec53fcb5c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:39:29.976375 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-43545a39-d21b-44c0-865c-ab5a373735ce tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1220243096", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "38004506-ffab-4fb4-bf80-9261110a1bc5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "b7773285-a55f-44ca-92fc-1f9b6eadbe45"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:39:29.985025 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:39:30.037604 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-43545a39-d21b-44c0-865c-ab5a373735ce tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] validate_networks() for [('b7773285-a55f-44ca-92fc-1f9b6eadbe45', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:39:30.412130 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-43545a39-d21b-44c0-865c-ab5a373735ce tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:39:30.412638 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-43545a39-d21b-44c0-865c-ab5a373735ce tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:39:30.413123 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-43545a39-d21b-44c0-865c-ab5a373735ce tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:39:30.413812 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-43545a39-d21b-44c0-865c-ab5a373735ce tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:39:30.414234 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-43545a39-d21b-44c0-865c-ab5a373735ce tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:39:30.423525 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-43545a39-d21b-44c0-865c-ab5a373735ce tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:30.424001 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-43545a39-d21b-44c0-865c-ab5a373735ce tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:30.424850 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-43545a39-d21b-44c0-865c-ab5a373735ce tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:30.425296 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-43545a39-d21b-44c0-865c-ab5a373735ce tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:30.443464 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-43545a39-d21b-44c0-865c-ab5a373735ce tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Getting quotas for project 7e9c656d484843ffb1f2de092730345b. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:39:30.448971 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-43545a39-d21b-44c0-865c-ab5a373735ce tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Getting quotas for user b469a8f9433d422aa98d22eea9df7071 and project 7e9c656d484843ffb1f2de092730345b. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:39:30.508440 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-43545a39-d21b-44c0-865c-ab5a373735ce tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:39:30.510578 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-43545a39-d21b-44c0-865c-ab5a373735ce tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: cbc2dca9-8030-477a-bd3a-169c4a77059a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='38004506-ffab-4fb4-bf80-9261110a1bc5',volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:39:30.931373 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-43545a39-d21b-44c0-865c-ab5a373735ce tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.959591 Jun 10 18:39:30.932028 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3453/6952] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:39:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:39:30.942050 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-906ee8b0-898f-499d-80c2-2491ec56d2b7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:30.946801 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-906ee8b0-898f-499d-80c2-2491ec56d2b7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: cbc2dca9-8030-477a-bd3a-169c4a77059a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:30.946801 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:39:30.998605 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-906ee8b0-898f-499d-80c2-2491ec56d2b7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:31.006181 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-906ee8b0-898f-499d-80c2-2491ec56d2b7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a" status: 200 len: 1071 microversion: 2.1 time: 0.068000 Jun 10 18:39:31.006748 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3500/6953] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:30 2022] GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a => generated 1071 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:32.024587 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f2c8a319-d7a3-4638-bb30-0c2326d333c7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:32.025219 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f2c8a319-d7a3-4638-bb30-0c2326d333c7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: cbc2dca9-8030-477a-bd3a-169c4a77059a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:32.032363 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f2c8a319-d7a3-4638-bb30-0c2326d333c7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:32.032883 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f2c8a319-d7a3-4638-bb30-0c2326d333c7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:32.033737 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f2c8a319-d7a3-4638-bb30-0c2326d333c7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:32.034175 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f2c8a319-d7a3-4638-bb30-0c2326d333c7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:32.096100 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f2c8a319-d7a3-4638-bb30-0c2326d333c7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:32.104442 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f2c8a319-d7a3-4638-bb30-0c2326d333c7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a" status: 200 len: 1113 microversion: 2.1 time: 0.085185 Jun 10 18:39:32.105011 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3454/6954] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:32 2022] GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a => generated 1113 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:33.122972 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-40724fbb-387e-4fd6-a66e-7cefbbcfbd58 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:33.124595 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-40724fbb-387e-4fd6-a66e-7cefbbcfbd58 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: cbc2dca9-8030-477a-bd3a-169c4a77059a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:33.135650 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-40724fbb-387e-4fd6-a66e-7cefbbcfbd58 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:33.136026 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-40724fbb-387e-4fd6-a66e-7cefbbcfbd58 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:33.136850 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-40724fbb-387e-4fd6-a66e-7cefbbcfbd58 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:33.137609 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-40724fbb-387e-4fd6-a66e-7cefbbcfbd58 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:33.229645 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-40724fbb-387e-4fd6-a66e-7cefbbcfbd58 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:33.240138 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-40724fbb-387e-4fd6-a66e-7cefbbcfbd58 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a" status: 200 len: 1187 microversion: 2.1 time: 0.121922 Jun 10 18:39:33.241300 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3501/6955] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:33 2022] GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a => generated 1187 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:34.261560 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3aaabd2f-2dd2-4f00-b9dd-ea06b4127571 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:34.262342 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3aaabd2f-2dd2-4f00-b9dd-ea06b4127571 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: cbc2dca9-8030-477a-bd3a-169c4a77059a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:34.273088 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3aaabd2f-2dd2-4f00-b9dd-ea06b4127571 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:34.274046 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3aaabd2f-2dd2-4f00-b9dd-ea06b4127571 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:34.275290 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3aaabd2f-2dd2-4f00-b9dd-ea06b4127571 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:34.275973 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3aaabd2f-2dd2-4f00-b9dd-ea06b4127571 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:34.552755 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3aaabd2f-2dd2-4f00-b9dd-ea06b4127571 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:34.569493 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3aaabd2f-2dd2-4f00-b9dd-ea06b4127571 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a" status: 200 len: 1229 microversion: 2.1 time: 0.311955 Jun 10 18:39:34.570560 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3455/6956] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:34 2022] GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a => generated 1229 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:34.702977 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-4d37e3e5-141b-4840-81a6-b15c7da64941 req-b7bcd469-64c3-435f-b085-844643fd19bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbc2dca9-8030-477a-bd3a-169c4a77059a", "tag": "becfd114-449a-4d24-ab03-b2fd9d727a17"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:39:34.720382 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-4d37e3e5-141b-4840-81a6-b15c7da64941 req-b7bcd469-64c3-435f-b085-844643fd19bd service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:34.720847 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-4d37e3e5-141b-4840-81a6-b15c7da64941 req-b7bcd469-64c3-435f-b085-844643fd19bd service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:34.742132 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-4d37e3e5-141b-4840-81a6-b15c7da64941 req-b7bcd469-64c3-435f-b085-844643fd19bd service nova] Creating event network-changed:becfd114-449a-4d24-ab03-b2fd9d727a17 for instance cbc2dca9-8030-477a-bd3a-169c4a77059a on chh1-master-2 Jun 10 18:39:34.759405 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-4d37e3e5-141b-4840-81a6-b15c7da64941 req-b7bcd469-64c3-435f-b085-844643fd19bd service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053319 Jun 10 18:39:34.764100 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3502/6957] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:39:35.591151 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4a3e2379-7ecc-4cac-becf-53c20a1717c0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:35.592500 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4a3e2379-7ecc-4cac-becf-53c20a1717c0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: cbc2dca9-8030-477a-bd3a-169c4a77059a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:35.600695 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a3e2379-7ecc-4cac-becf-53c20a1717c0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:35.601256 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a3e2379-7ecc-4cac-becf-53c20a1717c0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:35.602276 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a3e2379-7ecc-4cac-becf-53c20a1717c0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:35.602864 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a3e2379-7ecc-4cac-becf-53c20a1717c0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:35.747083 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4a3e2379-7ecc-4cac-becf-53c20a1717c0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:35.755976 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4a3e2379-7ecc-4cac-becf-53c20a1717c0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a" status: 200 len: 1229 microversion: 2.1 time: 0.172372 Jun 10 18:39:35.762994 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3456/6958] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:35 2022] GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a => generated 1229 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:36.775074 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-18b47ac2-7796-4833-8435-47c5e08be43e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:36.776071 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-18b47ac2-7796-4833-8435-47c5e08be43e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: cbc2dca9-8030-477a-bd3a-169c4a77059a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:36.783037 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-18b47ac2-7796-4833-8435-47c5e08be43e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:36.783597 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-18b47ac2-7796-4833-8435-47c5e08be43e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:36.784498 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-18b47ac2-7796-4833-8435-47c5e08be43e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:36.785071 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-18b47ac2-7796-4833-8435-47c5e08be43e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:36.787871 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=86 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:39:36.927619 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-18b47ac2-7796-4833-8435-47c5e08be43e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:36.935484 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-18b47ac2-7796-4833-8435-47c5e08be43e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a" status: 200 len: 1229 microversion: 2.1 time: 0.166366 Jun 10 18:39:36.938863 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3503/6959] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:36 2022] GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a => generated 1229 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:37.952788 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c95a42df-fa4d-41e3-9ee7-7385c6b82ee2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:37.953353 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c95a42df-fa4d-41e3-9ee7-7385c6b82ee2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: cbc2dca9-8030-477a-bd3a-169c4a77059a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:37.960405 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c95a42df-fa4d-41e3-9ee7-7385c6b82ee2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:37.960865 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c95a42df-fa4d-41e3-9ee7-7385c6b82ee2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:37.961643 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c95a42df-fa4d-41e3-9ee7-7385c6b82ee2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:37.962096 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c95a42df-fa4d-41e3-9ee7-7385c6b82ee2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:38.093845 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c95a42df-fa4d-41e3-9ee7-7385c6b82ee2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:38.102052 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c95a42df-fa4d-41e3-9ee7-7385c6b82ee2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a" status: 200 len: 1229 microversion: 2.1 time: 0.153133 Jun 10 18:39:38.102653 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3457/6960] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:37 2022] GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a => generated 1229 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:38.461953 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-be9b87d3-d663-4133-83e1-ee56773867f5 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:39:38.462905 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-be9b87d3-d663-4133-83e1-ee56773867f5 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:38.469856 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be9b87d3-d663-4133-83e1-ee56773867f5 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:38.470287 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be9b87d3-d663-4133-83e1-ee56773867f5 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:38.471130 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be9b87d3-d663-4133-83e1-ee56773867f5 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:38.471513 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-be9b87d3-d663-4133-83e1-ee56773867f5 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:38.521426 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-be9b87d3-d663-4133-83e1-ee56773867f5 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "POST /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a/action" status: 200 len: 24570 microversion: 2.1 time: 0.063236 Jun 10 18:39:38.522379 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3504/6961] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:39:38 2022] POST /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a/action => generated 24570 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 10 18:39:39.118646 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-966c3a35-bb3a-4754-82dc-f43679e20801 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:39.119373 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-966c3a35-bb3a-4754-82dc-f43679e20801 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: cbc2dca9-8030-477a-bd3a-169c4a77059a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:39.126610 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-966c3a35-bb3a-4754-82dc-f43679e20801 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:39.127064 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-966c3a35-bb3a-4754-82dc-f43679e20801 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:39.128024 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-966c3a35-bb3a-4754-82dc-f43679e20801 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:39.129169 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-966c3a35-bb3a-4754-82dc-f43679e20801 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:39.258703 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-966c3a35-bb3a-4754-82dc-f43679e20801 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:39.266437 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-966c3a35-bb3a-4754-82dc-f43679e20801 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a" status: 200 len: 1217 microversion: 2.1 time: 0.151644 Jun 10 18:39:39.267002 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3458/6962] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:39 2022] GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a => generated 1217 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:40.285325 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2263e428-f626-4b62-88c9-01e2672b4c0b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:40.286069 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2263e428-f626-4b62-88c9-01e2672b4c0b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: cbc2dca9-8030-477a-bd3a-169c4a77059a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:40.293676 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2263e428-f626-4b62-88c9-01e2672b4c0b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:40.294121 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2263e428-f626-4b62-88c9-01e2672b4c0b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:40.294887 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2263e428-f626-4b62-88c9-01e2672b4c0b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:40.295326 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2263e428-f626-4b62-88c9-01e2672b4c0b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:40.442640 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2263e428-f626-4b62-88c9-01e2672b4c0b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:40.450297 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2263e428-f626-4b62-88c9-01e2672b4c0b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a" status: 200 len: 1217 microversion: 2.1 time: 0.169897 Jun 10 18:39:40.450876 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3505/6963] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:40 2022] GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a => generated 1217 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:41.467077 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-923dac49-4472-4ce4-ab84-dc5a35bfaf67 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:41.467816 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-923dac49-4472-4ce4-ab84-dc5a35bfaf67 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: cbc2dca9-8030-477a-bd3a-169c4a77059a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:41.470749 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:39:41.471486 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=6 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:39:41.476424 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-923dac49-4472-4ce4-ab84-dc5a35bfaf67 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:41.480173 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-923dac49-4472-4ce4-ab84-dc5a35bfaf67 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:41.480173 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-923dac49-4472-4ce4-ab84-dc5a35bfaf67 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:41.480173 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-923dac49-4472-4ce4-ab84-dc5a35bfaf67 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:41.617908 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-923dac49-4472-4ce4-ab84-dc5a35bfaf67 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:41.625461 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-923dac49-4472-4ce4-ab84-dc5a35bfaf67 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a" status: 200 len: 1217 microversion: 2.1 time: 0.162383 Jun 10 18:39:41.626041 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3459/6964] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:41 2022] GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a => generated 1217 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:42.643091 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1fd630ac-34d2-4455-97e8-0dd65964313c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:42.643827 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1fd630ac-34d2-4455-97e8-0dd65964313c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: cbc2dca9-8030-477a-bd3a-169c4a77059a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:42.647433 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:39:42.654961 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1fd630ac-34d2-4455-97e8-0dd65964313c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:42.659208 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1fd630ac-34d2-4455-97e8-0dd65964313c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:42.659208 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1fd630ac-34d2-4455-97e8-0dd65964313c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:42.659208 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1fd630ac-34d2-4455-97e8-0dd65964313c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:42.791619 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1fd630ac-34d2-4455-97e8-0dd65964313c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:42.799357 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1fd630ac-34d2-4455-97e8-0dd65964313c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a" status: 200 len: 1217 microversion: 2.1 time: 0.160239 Jun 10 18:39:42.799952 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3506/6965] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:42 2022] GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a => generated 1217 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:43.816398 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f4141dd3-ee1c-4ac5-bcaf-2b367fb18659 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:43.817007 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f4141dd3-ee1c-4ac5-bcaf-2b367fb18659 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: cbc2dca9-8030-477a-bd3a-169c4a77059a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:43.824038 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f4141dd3-ee1c-4ac5-bcaf-2b367fb18659 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:43.824592 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f4141dd3-ee1c-4ac5-bcaf-2b367fb18659 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:43.825417 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f4141dd3-ee1c-4ac5-bcaf-2b367fb18659 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:43.826280 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f4141dd3-ee1c-4ac5-bcaf-2b367fb18659 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:43.954920 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f4141dd3-ee1c-4ac5-bcaf-2b367fb18659 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:43.962442 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f4141dd3-ee1c-4ac5-bcaf-2b367fb18659 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a" status: 200 len: 1217 microversion: 2.1 time: 0.150525 Jun 10 18:39:43.963134 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3460/6966] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:43 2022] GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a => generated 1217 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:44.979186 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7068e372-1f27-4f59-9db3-dc13d1922e8d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:44.979791 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7068e372-1f27-4f59-9db3-dc13d1922e8d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: cbc2dca9-8030-477a-bd3a-169c4a77059a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:44.987190 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7068e372-1f27-4f59-9db3-dc13d1922e8d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:44.987670 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7068e372-1f27-4f59-9db3-dc13d1922e8d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:44.988496 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7068e372-1f27-4f59-9db3-dc13d1922e8d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:44.988944 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7068e372-1f27-4f59-9db3-dc13d1922e8d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:45.124335 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7068e372-1f27-4f59-9db3-dc13d1922e8d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:45.132677 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7068e372-1f27-4f59-9db3-dc13d1922e8d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a" status: 200 len: 1217 microversion: 2.1 time: 0.157303 Jun 10 18:39:45.133246 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3507/6967] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:44 2022] GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a => generated 1217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:46.150441 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6e6c39c2-a11d-49c4-a013-2e7ebd7ae0b9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:46.151053 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6e6c39c2-a11d-49c4-a013-2e7ebd7ae0b9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: cbc2dca9-8030-477a-bd3a-169c4a77059a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:46.158319 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6e6c39c2-a11d-49c4-a013-2e7ebd7ae0b9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:46.158772 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6e6c39c2-a11d-49c4-a013-2e7ebd7ae0b9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:46.160210 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6e6c39c2-a11d-49c4-a013-2e7ebd7ae0b9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:46.160692 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6e6c39c2-a11d-49c4-a013-2e7ebd7ae0b9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:46.300653 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6e6c39c2-a11d-49c4-a013-2e7ebd7ae0b9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:46.308495 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6e6c39c2-a11d-49c4-a013-2e7ebd7ae0b9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a" status: 200 len: 1217 microversion: 2.1 time: 0.161875 Jun 10 18:39:46.309083 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3461/6968] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:46 2022] GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a => generated 1217 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:47.329084 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ab2fae72-d972-458c-8d98-298b07761f3f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:47.329926 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ab2fae72-d972-458c-8d98-298b07761f3f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: cbc2dca9-8030-477a-bd3a-169c4a77059a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:47.338005 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ab2fae72-d972-458c-8d98-298b07761f3f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:47.338461 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ab2fae72-d972-458c-8d98-298b07761f3f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:47.339247 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ab2fae72-d972-458c-8d98-298b07761f3f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:47.339836 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ab2fae72-d972-458c-8d98-298b07761f3f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:47.475026 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ab2fae72-d972-458c-8d98-298b07761f3f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:47.482675 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ab2fae72-d972-458c-8d98-298b07761f3f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a" status: 200 len: 1217 microversion: 2.1 time: 0.158383 Jun 10 18:39:47.483249 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3508/6969] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:47 2022] GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a => generated 1217 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:48.499533 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4f81236e-4eb1-4d92-aa28-5b0a386f71ea tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:48.500144 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4f81236e-4eb1-4d92-aa28-5b0a386f71ea tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: cbc2dca9-8030-477a-bd3a-169c4a77059a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:48.507677 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f81236e-4eb1-4d92-aa28-5b0a386f71ea tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:48.508137 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f81236e-4eb1-4d92-aa28-5b0a386f71ea tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:48.508950 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f81236e-4eb1-4d92-aa28-5b0a386f71ea tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:48.509392 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f81236e-4eb1-4d92-aa28-5b0a386f71ea tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:48.655672 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4f81236e-4eb1-4d92-aa28-5b0a386f71ea tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:48.664211 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4f81236e-4eb1-4d92-aa28-5b0a386f71ea tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a" status: 200 len: 1217 microversion: 2.1 time: 0.168430 Jun 10 18:39:48.664846 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3462/6970] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:48 2022] GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a => generated 1217 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:48.998332 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-e22f34cb-37fc-4c36-aa44-80cc17b7acdf req-28684a5a-d197-48d3-a877-af488b0c3a2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbc2dca9-8030-477a-bd3a-169c4a77059a", "name": "network-vif-plugged", "status": "completed", "tag": "becfd114-449a-4d24-ab03-b2fd9d727a17"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:39:49.007587 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-e22f34cb-37fc-4c36-aa44-80cc17b7acdf req-28684a5a-d197-48d3-a877-af488b0c3a2b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:49.008048 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-e22f34cb-37fc-4c36-aa44-80cc17b7acdf req-28684a5a-d197-48d3-a877-af488b0c3a2b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:49.019105 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-e22f34cb-37fc-4c36-aa44-80cc17b7acdf req-28684a5a-d197-48d3-a877-af488b0c3a2b service nova] Creating event network-vif-plugged:becfd114-449a-4d24-ab03-b2fd9d727a17 for instance cbc2dca9-8030-477a-bd3a-169c4a77059a on chh1-master-2 Jun 10 18:39:49.024168 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-e22f34cb-37fc-4c36-aa44-80cc17b7acdf req-28684a5a-d197-48d3-a877-af488b0c3a2b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029931 Jun 10 18:39:49.024918 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3509/6971] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:39:49.681331 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c6a732b6-d863-4271-9519-763df7dc48cc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:49.681948 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c6a732b6-d863-4271-9519-763df7dc48cc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: cbc2dca9-8030-477a-bd3a-169c4a77059a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:49.689231 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c6a732b6-d863-4271-9519-763df7dc48cc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:49.690112 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c6a732b6-d863-4271-9519-763df7dc48cc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:49.691762 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c6a732b6-d863-4271-9519-763df7dc48cc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:49.692416 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c6a732b6-d863-4271-9519-763df7dc48cc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:49.848039 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c6a732b6-d863-4271-9519-763df7dc48cc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:49.856334 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c6a732b6-d863-4271-9519-763df7dc48cc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a" status: 200 len: 1217 microversion: 2.1 time: 0.178952 Jun 10 18:39:49.856999 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3463/6972] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:49 2022] GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a => generated 1217 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:50.873363 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d593ffc5-5005-4128-bcf8-6751ef6cd5b2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:50.874081 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d593ffc5-5005-4128-bcf8-6751ef6cd5b2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: cbc2dca9-8030-477a-bd3a-169c4a77059a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:50.882020 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d593ffc5-5005-4128-bcf8-6751ef6cd5b2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:50.882491 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d593ffc5-5005-4128-bcf8-6751ef6cd5b2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:50.883275 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d593ffc5-5005-4128-bcf8-6751ef6cd5b2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:50.883724 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d593ffc5-5005-4128-bcf8-6751ef6cd5b2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:50.911174 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e404c593-e391-42d0-81e2-160959141834 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:50.911708 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e404c593-e391-42d0-81e2-160959141834 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:50.919638 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e404c593-e391-42d0-81e2-160959141834 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:50.924489 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e404c593-e391-42d0-81e2-160959141834 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:50.924489 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e404c593-e391-42d0-81e2-160959141834 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:50.924489 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e404c593-e391-42d0-81e2-160959141834 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:50.925760 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:39:50.948637 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e404c593-e391-42d0-81e2-160959141834 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:39:51.040468 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d593ffc5-5005-4128-bcf8-6751ef6cd5b2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:51.048443 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d593ffc5-5005-4128-bcf8-6751ef6cd5b2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a" status: 200 len: 1404 microversion: 2.1 time: 0.179310 Jun 10 18:39:51.049024 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3510/6973] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:50 2022] GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a => generated 1404 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:51.055578 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-48b4207f-5737-4d91-9818-ef0110ed1e30 req-acaa79b4-e473-4494-b638-db8b6c12dcc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a", "tag": "52404c9e-a5ad-4dd5-8bcd-f3725b19f0eb"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:39:51.063069 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-48b4207f-5737-4d91-9818-ef0110ed1e30 req-acaa79b4-e473-4494-b638-db8b6c12dcc6 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:51.063663 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-48b4207f-5737-4d91-9818-ef0110ed1e30 req-acaa79b4-e473-4494-b638-db8b6c12dcc6 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:51.076288 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-48b4207f-5737-4d91-9818-ef0110ed1e30 req-acaa79b4-e473-4494-b638-db8b6c12dcc6 service nova] Creating event network-changed:52404c9e-a5ad-4dd5-8bcd-f3725b19f0eb for instance 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a on chh1-master-2 Jun 10 18:39:51.082174 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-48b4207f-5737-4d91-9818-ef0110ed1e30 req-acaa79b4-e473-4494-b638-db8b6c12dcc6 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031261 Jun 10 18:39:51.082841 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3511/6974] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:39:51.090858 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-aff567f5-f6e5-4a25-9f8b-b4077b6b46be tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:51.093675 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-aff567f5-f6e5-4a25-9f8b-b4077b6b46be tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: cbc2dca9-8030-477a-bd3a-169c4a77059a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:51.097911 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aff567f5-f6e5-4a25-9f8b-b4077b6b46be tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:51.098368 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aff567f5-f6e5-4a25-9f8b-b4077b6b46be tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:51.099140 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aff567f5-f6e5-4a25-9f8b-b4077b6b46be tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:51.099581 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aff567f5-f6e5-4a25-9f8b-b4077b6b46be tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:51.247813 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-aff567f5-f6e5-4a25-9f8b-b4077b6b46be tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:51.258727 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-aff567f5-f6e5-4a25-9f8b-b4077b6b46be tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a" status: 200 len: 1404 microversion: 2.1 time: 0.171767 Jun 10 18:39:51.261535 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3512/6975] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:51 2022] GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a => generated 1404 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:51.276191 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-666fd0d1-de09-4c77-ad63-60fed00b0712 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-596397628"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:39:51.277264 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-666fd0d1-de09-4c77-ad63-60fed00b0712 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: cbc2dca9-8030-477a-bd3a-169c4a77059a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:51.301961 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-666fd0d1-de09-4c77-ad63-60fed00b0712 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:51.301961 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-666fd0d1-de09-4c77-ad63-60fed00b0712 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:51.301961 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-666fd0d1-de09-4c77-ad63-60fed00b0712 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:51.301961 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-666fd0d1-de09-4c77-ad63-60fed00b0712 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:51.399211 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e404c593-e391-42d0-81e2-160959141834 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "DELETE /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a" status: 204 len: 0 microversion: 2.1 time: 0.492895 Jun 10 18:39:51.404208 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3464/6976] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:39:50 2022] DELETE /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a => generated 0 bytes in 495 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 18:39:51.411564 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-08a6a20e-2914-46d7-9b29-ec38e63c610b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:51.412414 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-08a6a20e-2914-46d7-9b29-ec38e63c610b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:51.425990 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-08a6a20e-2914-46d7-9b29-ec38e63c610b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:51.426518 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-08a6a20e-2914-46d7-9b29-ec38e63c610b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:51.427389 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-08a6a20e-2914-46d7-9b29-ec38e63c610b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:51.427842 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-08a6a20e-2914-46d7-9b29-ec38e63c610b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:51.428544 chdv-master-2 devstack@n-api.service[126594]: INFO nova.compute.api [None req-666fd0d1-de09-4c77-ad63-60fed00b0712 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: cbc2dca9-8030-477a-bd3a-169c4a77059a] Attempting to quiesce instance before volume snapshot. Jun 10 18:39:51.810260 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-08a6a20e-2914-46d7-9b29-ec38e63c610b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:51.818949 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-08a6a20e-2914-46d7-9b29-ec38e63c610b tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a" status: 200 len: 1689 microversion: 2.1 time: 0.413287 Jun 10 18:39:51.819813 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3465/6977] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:51 2022] GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a => generated 1689 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:52.343647 chdv-master-2 devstack@n-api.service[126594]: INFO nova.compute.api [None req-666fd0d1-de09-4c77-ad63-60fed00b0712 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: cbc2dca9-8030-477a-bd3a-169c4a77059a] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Jun 10 18:39:52.835732 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7e3321e6-9aa4-4fb3-b343-1ca38f661ce2 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:52.836491 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7e3321e6-9aa4-4fb3-b343-1ca38f661ce2 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:52.848189 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e3321e6-9aa4-4fb3-b343-1ca38f661ce2 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:52.855494 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-666fd0d1-de09-4c77-ad63-60fed00b0712 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: cbc2dca9-8030-477a-bd3a-169c4a77059a] Creating snapshot from volume 38004506-ffab-4fb4-bf80-9261110a1bc5. {{(pid=126594) snapshot_instance /opt/stack/nova/nova/compute/api.py:3454}} Jun 10 18:39:52.856207 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e3321e6-9aa4-4fb3-b343-1ca38f661ce2 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:52.857381 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e3321e6-9aa4-4fb3-b343-1ca38f661ce2 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:52.857997 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e3321e6-9aa4-4fb3-b343-1ca38f661ce2 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:53.175746 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7e3321e6-9aa4-4fb3-b343-1ca38f661ce2 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:53.184032 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7e3321e6-9aa4-4fb3-b343-1ca38f661ce2 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a" status: 200 len: 1689 microversion: 2.1 time: 0.352253 Jun 10 18:39:53.184705 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3466/6978] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:52 2022] GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a => generated 1689 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:39:53.271744 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-e8687d36-5637-4549-9a5c-ba12c1c52504 req-5d7c92bc-1985-499c-9202-c2040a89dc44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a", "name": "network-vif-deleted", "tag": "52404c9e-a5ad-4dd5-8bcd-f3725b19f0eb"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:39:53.280483 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-e8687d36-5637-4549-9a5c-ba12c1c52504 req-5d7c92bc-1985-499c-9202-c2040a89dc44 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:53.280941 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-e8687d36-5637-4549-9a5c-ba12c1c52504 req-5d7c92bc-1985-499c-9202-c2040a89dc44 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:53.301587 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-e8687d36-5637-4549-9a5c-ba12c1c52504 req-5d7c92bc-1985-499c-9202-c2040a89dc44 service nova] Creating event network-vif-deleted:52404c9e-a5ad-4dd5-8bcd-f3725b19f0eb for instance 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a on chh1-master-2 Jun 10 18:39:53.306748 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-e8687d36-5637-4549-9a5c-ba12c1c52504 req-5d7c92bc-1985-499c-9202-c2040a89dc44 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039505 Jun 10 18:39:53.307583 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3467/6979] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:39:54.202405 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-86fa7388-17df-446c-b20c-4c0490820b94 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:54.203104 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-86fa7388-17df-446c-b20c-4c0490820b94 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:54.209952 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86fa7388-17df-446c-b20c-4c0490820b94 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:54.210423 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86fa7388-17df-446c-b20c-4c0490820b94 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:54.211373 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86fa7388-17df-446c-b20c-4c0490820b94 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:54.211818 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86fa7388-17df-446c-b20c-4c0490820b94 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:54.246004 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86fa7388-17df-446c-b20c-4c0490820b94 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:54.246449 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86fa7388-17df-446c-b20c-4c0490820b94 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:54.246896 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-86fa7388-17df-446c-b20c-4c0490820b94 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lazy-loading 'fault' on Instance uuid 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:39:54.295754 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-86fa7388-17df-446c-b20c-4c0490820b94 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5fe9478d2b47e3b87cecc86d40773c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089a2104afe4f1ab69f1b7983e4735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:54.304602 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-86fa7388-17df-446c-b20c-4c0490820b94 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a" status: 200 len: 1357 microversion: 2.1 time: 0.107289 Jun 10 18:39:54.308271 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3468/6980] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:54 2022] GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a => generated 1357 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:39:54.879654 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-666fd0d1-de09-4c77-ad63-60fed00b0712 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "POST /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a/action" status: 202 len: 0 microversion: 2.1 time: 3.607371 Jun 10 18:39:54.880512 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3513/6981] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:39:51 2022] POST /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a/action => generated 0 bytes in 3609 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jun 10 18:39:55.326053 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2695f7b9-b93f-4a1e-95a5-77319250d142 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:55.326670 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2695f7b9-b93f-4a1e-95a5-77319250d142 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] [instance: 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:55.334375 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2695f7b9-b93f-4a1e-95a5-77319250d142 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:55.334776 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2695f7b9-b93f-4a1e-95a5-77319250d142 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:55.335536 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2695f7b9-b93f-4a1e-95a5-77319250d142 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:55.335978 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2695f7b9-b93f-4a1e-95a5-77319250d142 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:55.351550 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-2695f7b9-b93f-4a1e-95a5-77319250d142 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] HTTP exception thrown: Instance 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a could not be found. Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2695f7b9-b93f-4a1e-95a5-77319250d142 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Request method failure captured: Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a HTTP/1.1 Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio43CIIZRNjb-0MeWb3vSViVXry-4quvMwA-hBljqKpiB6nnPbm4yr81WFzlQ2LY4R_BwzHI9K4qKlBZRuaAUhn7ebWvkqA-OmRlonhi_sWh_BF0eIBDo55Jeg8m_3Z24vWfOlNkH5Uyaf3Vs_VtyXvkIne8zHY4JCWnu-w0Ien9U850 Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 4089a2104afe4f1ab69f1b7983e4735d Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-88591049 Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/4089a2104afe4f1ab69f1b7983e4735d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/4089a2104afe4f1ab69f1b7983e4735d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/4089a2104afe4f1ab69f1b7983e4735d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_4089a2104afe4f1ab69f1b7983e4735d", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-TestNetworkAdvancedServerOps-88591049 Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 4089a2104afe4f1ab69f1b7983e4735d Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-88591049 Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-TestNetworkAdvancedServerOps-88591049-project Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 9d5fe9478d2b47e3b87cecc86d40773c Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-TestNetworkAdvancedServerOps-88591049-project Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a could not be found. Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a'} Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a could not be found. Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a could not be found. Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:39:55.353470 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:39:55.358327 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:39:55.358327 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:39:55.358327 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:39:55.358327 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:39:55.358327 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:39:55.358327 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a could not be found. Jun 10 18:39:55.358327 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:39:55.358327 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2695f7b9-b93f-4a1e-95a5-77319250d142 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Returning 404 to user: Instance 7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:39:55.358327 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2695f7b9-b93f-4a1e-95a5-77319250d142 tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a" status: 404 len: 111 microversion: 2.1 time: 0.033894 Jun 10 18:39:55.358327 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3469/6982] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:55 2022] GET /compute/v2.1/servers/7c6cef21-bc2b-4bb6-ad4a-ce8e6dc3e14a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:39:56.043280 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ed70811b-95fd-4f03-a01c-35cd621b3e7a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1141734485", "imageRef": "806ca08a-c793-4723-8e02-52858ca3fa7b", "flavorRef": "452", "networks": [{"uuid": "b7773285-a55f-44ca-92fc-1f9b6eadbe45"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:39:56.104625 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-ed70811b-95fd-4f03-a01c-35cd621b3e7a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] validate_networks() for [('b7773285-a55f-44ca-92fc-1f9b6eadbe45', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:39:56.815833 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-ed70811b-95fd-4f03-a01c-35cd621b3e7a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:39:56.816274 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-ed70811b-95fd-4f03-a01c-35cd621b3e7a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:39:56.817067 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-ed70811b-95fd-4f03-a01c-35cd621b3e7a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:39:56.817667 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-ed70811b-95fd-4f03-a01c-35cd621b3e7a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:39:56.818269 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-ed70811b-95fd-4f03-a01c-35cd621b3e7a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:39:56.827418 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ed70811b-95fd-4f03-a01c-35cd621b3e7a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:56.827891 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ed70811b-95fd-4f03-a01c-35cd621b3e7a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:56.828755 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ed70811b-95fd-4f03-a01c-35cd621b3e7a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:56.829215 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ed70811b-95fd-4f03-a01c-35cd621b3e7a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:56.847026 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-ed70811b-95fd-4f03-a01c-35cd621b3e7a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Getting quotas for project 7e9c656d484843ffb1f2de092730345b. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:39:56.852918 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-ed70811b-95fd-4f03-a01c-35cd621b3e7a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Getting quotas for user b469a8f9433d422aa98d22eea9df7071 and project 7e9c656d484843ffb1f2de092730345b. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:39:56.865465 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ed70811b-95fd-4f03-a01c-35cd621b3e7a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:39:56.868075 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ed70811b-95fd-4f03-a01c-35cd621b3e7a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='cc926d2f-d518-44d3-880e-e0ae9cb3aa7a',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:39:57.000832 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ed70811b-95fd-4f03-a01c-35cd621b3e7a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.962587 Jun 10 18:39:57.001672 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3514/6983] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:39:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:39:57.011790 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-339d410e-da0c-41ad-9a6e-544b80fb5abc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:57.012429 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-339d410e-da0c-41ad-9a6e-544b80fb5abc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:57.076622 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-339d410e-da0c-41ad-9a6e-544b80fb5abc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:57.086259 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-339d410e-da0c-41ad-9a6e-544b80fb5abc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1230 microversion: 2.1 time: 0.078303 Jun 10 18:39:57.087314 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3470/6984] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:57 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1230 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:58.105376 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-18a43577-52b2-4338-8574-6f1854611ef1 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:58.106053 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-18a43577-52b2-4338-8574-6f1854611ef1 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:58.114353 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-18a43577-52b2-4338-8574-6f1854611ef1 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:58.115870 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-18a43577-52b2-4338-8574-6f1854611ef1 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:58.116878 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-18a43577-52b2-4338-8574-6f1854611ef1 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:58.117522 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-18a43577-52b2-4338-8574-6f1854611ef1 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:58.194238 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-18a43577-52b2-4338-8574-6f1854611ef1 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:58.202596 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-18a43577-52b2-4338-8574-6f1854611ef1 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1234 microversion: 2.1 time: 0.103167 Jun 10 18:39:58.203296 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3515/6985] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:58 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1234 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:59.219466 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bb97f085-89da-4f07-8883-32adc952e680 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:59.220087 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bb97f085-89da-4f07-8883-32adc952e680 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:39:59.234241 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb97f085-89da-4f07-8883-32adc952e680 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:59.234702 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb97f085-89da-4f07-8883-32adc952e680 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:59.235494 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb97f085-89da-4f07-8883-32adc952e680 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:39:59.236008 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb97f085-89da-4f07-8883-32adc952e680 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:39:59.301591 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0d810fae-5499-48a5-ba69-39a6ba0ca35d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] Calling method '.version_select at 0x7f77c03dfaf0>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:39:59.327322 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bb97f085-89da-4f07-8883-32adc952e680 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:39:59.337095 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bb97f085-89da-4f07-8883-32adc952e680 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1290 microversion: 2.1 time: 0.121922 Jun 10 18:39:59.338559 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3471/6986] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:39:59 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1290 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:39:59.417514 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0d810fae-5499-48a5-ba69-39a6ba0ca35d tempest-TestNetworkAdvancedServerOps-88591049 tempest-TestNetworkAdvancedServerOps-88591049-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2134666518" status: 202 len: 0 microversion: 2.1 time: 0.124080 Jun 10 18:39:59.421894 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3516/6987] 10.222.0.35 () {58 vars in 1283 bytes} [Fri Jun 10 18:39:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2134666518 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 18:40:00.355663 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-282dd657-aa9b-43dc-bc72-898f0325fd6c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:00.364296 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-282dd657-aa9b-43dc-bc72-898f0325fd6c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:00.396058 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:40:00.416547 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-282dd657-aa9b-43dc-bc72-898f0325fd6c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:00.419210 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-282dd657-aa9b-43dc-bc72-898f0325fd6c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:00.423014 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-282dd657-aa9b-43dc-bc72-898f0325fd6c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:00.424561 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-282dd657-aa9b-43dc-bc72-898f0325fd6c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:00.682464 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-282dd657-aa9b-43dc-bc72-898f0325fd6c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:00.695850 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-282dd657-aa9b-43dc-bc72-898f0325fd6c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1342 microversion: 2.1 time: 0.344120 Jun 10 18:40:00.697396 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3472/6988] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:00 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1342 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:01.292726 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-f1977461-fa8c-4ef9-8d28-e40bef07142b req-a09ccb35-93c9-435c-ab29-8b4f67e1f26a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afc5fef3-a4e6-4dcc-b072-d0d5be33bb98", "tag": "07b98efa-8b8f-4951-a2ae-1815a94ef466"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:40:01.323879 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-f1977461-fa8c-4ef9-8d28-e40bef07142b req-a09ccb35-93c9-435c-ab29-8b4f67e1f26a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:01.328237 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-f1977461-fa8c-4ef9-8d28-e40bef07142b req-a09ccb35-93c9-435c-ab29-8b4f67e1f26a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:01.339296 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-f1977461-fa8c-4ef9-8d28-e40bef07142b req-a09ccb35-93c9-435c-ab29-8b4f67e1f26a service nova] Creating event network-changed:07b98efa-8b8f-4951-a2ae-1815a94ef466 for instance afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 on chh1-master-2 Jun 10 18:40:01.347330 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-f1977461-fa8c-4ef9-8d28-e40bef07142b req-a09ccb35-93c9-435c-ab29-8b4f67e1f26a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060794 Jun 10 18:40:01.348670 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3517/6989] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:40:01.716424 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5359971e-b389-4d9b-b632-7f3aa0fa552c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:01.717243 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5359971e-b389-4d9b-b632-7f3aa0fa552c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:01.733504 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5359971e-b389-4d9b-b632-7f3aa0fa552c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:01.735896 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5359971e-b389-4d9b-b632-7f3aa0fa552c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:01.735896 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5359971e-b389-4d9b-b632-7f3aa0fa552c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:01.738272 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5359971e-b389-4d9b-b632-7f3aa0fa552c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:01.989697 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5359971e-b389-4d9b-b632-7f3aa0fa552c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:02.000470 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5359971e-b389-4d9b-b632-7f3aa0fa552c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1342 microversion: 2.1 time: 0.289032 Jun 10 18:40:02.001100 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3473/6990] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:01 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1342 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:03.018912 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b7bfd875-55d6-4a32-82ce-8791e2dc373f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:03.021427 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b7bfd875-55d6-4a32-82ce-8791e2dc373f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:03.032275 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b7bfd875-55d6-4a32-82ce-8791e2dc373f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:03.033131 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b7bfd875-55d6-4a32-82ce-8791e2dc373f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:03.034140 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b7bfd875-55d6-4a32-82ce-8791e2dc373f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:03.035271 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b7bfd875-55d6-4a32-82ce-8791e2dc373f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:03.247527 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b7bfd875-55d6-4a32-82ce-8791e2dc373f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:03.258451 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b7bfd875-55d6-4a32-82ce-8791e2dc373f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1342 microversion: 2.1 time: 0.244239 Jun 10 18:40:03.259726 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3518/6991] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:03 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1342 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:04.275863 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a514f5c3-eff9-4eaf-9448-4de7d88fd4fb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:04.277587 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a514f5c3-eff9-4eaf-9448-4de7d88fd4fb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:04.296116 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a514f5c3-eff9-4eaf-9448-4de7d88fd4fb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:04.297019 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a514f5c3-eff9-4eaf-9448-4de7d88fd4fb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:04.298198 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a514f5c3-eff9-4eaf-9448-4de7d88fd4fb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:04.298997 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a514f5c3-eff9-4eaf-9448-4de7d88fd4fb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:04.542770 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a514f5c3-eff9-4eaf-9448-4de7d88fd4fb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:04.551006 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a514f5c3-eff9-4eaf-9448-4de7d88fd4fb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1342 microversion: 2.1 time: 0.279130 Jun 10 18:40:04.552576 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3474/6992] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:04 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1342 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:05.568365 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1f730caa-bbf7-40a3-8783-0b9825c053cf tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:05.569008 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1f730caa-bbf7-40a3-8783-0b9825c053cf tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:05.571804 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:40:05.576917 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1f730caa-bbf7-40a3-8783-0b9825c053cf tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:05.577382 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1f730caa-bbf7-40a3-8783-0b9825c053cf tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:05.578365 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1f730caa-bbf7-40a3-8783-0b9825c053cf tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:05.578830 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1f730caa-bbf7-40a3-8783-0b9825c053cf tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:05.744145 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1f730caa-bbf7-40a3-8783-0b9825c053cf tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:05.752405 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1f730caa-bbf7-40a3-8783-0b9825c053cf tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1342 microversion: 2.1 time: 0.187685 Jun 10 18:40:05.754289 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3519/6993] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:05 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1342 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:06.771113 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ceecfa94-055c-4f34-b620-2e1f756bdba5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:06.771743 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ceecfa94-055c-4f34-b620-2e1f756bdba5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:06.779340 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ceecfa94-055c-4f34-b620-2e1f756bdba5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:06.779796 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ceecfa94-055c-4f34-b620-2e1f756bdba5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:06.780903 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ceecfa94-055c-4f34-b620-2e1f756bdba5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:06.781696 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ceecfa94-055c-4f34-b620-2e1f756bdba5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:06.933839 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ceecfa94-055c-4f34-b620-2e1f756bdba5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:06.942870 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ceecfa94-055c-4f34-b620-2e1f756bdba5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1342 microversion: 2.1 time: 0.176337 Jun 10 18:40:06.943457 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3475/6994] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:06 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1342 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:07.960632 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-85a94ebe-3242-4a07-b3c2-44362ffd7ce0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:07.962250 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-85a94ebe-3242-4a07-b3c2-44362ffd7ce0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:07.964774 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:40:07.968759 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=6 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:40:07.970400 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-85a94ebe-3242-4a07-b3c2-44362ffd7ce0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:07.970875 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-85a94ebe-3242-4a07-b3c2-44362ffd7ce0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:07.971717 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-85a94ebe-3242-4a07-b3c2-44362ffd7ce0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:07.972745 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-85a94ebe-3242-4a07-b3c2-44362ffd7ce0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:07.976673 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:40:08.114795 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-85a94ebe-3242-4a07-b3c2-44362ffd7ce0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:08.124628 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-85a94ebe-3242-4a07-b3c2-44362ffd7ce0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1342 microversion: 2.1 time: 0.168586 Jun 10 18:40:08.125219 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3520/6995] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:07 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1342 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:09.141878 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0067b9cc-b905-43f9-a39a-b470a23cc1c5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:09.144002 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0067b9cc-b905-43f9-a39a-b470a23cc1c5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:09.146246 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:40:09.152550 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0067b9cc-b905-43f9-a39a-b470a23cc1c5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:09.160020 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0067b9cc-b905-43f9-a39a-b470a23cc1c5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:09.160020 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0067b9cc-b905-43f9-a39a-b470a23cc1c5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:09.160020 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0067b9cc-b905-43f9-a39a-b470a23cc1c5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:09.301273 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0067b9cc-b905-43f9-a39a-b470a23cc1c5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:09.309849 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0067b9cc-b905-43f9-a39a-b470a23cc1c5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1342 microversion: 2.1 time: 0.172147 Jun 10 18:40:09.310530 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3476/6996] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:09 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1342 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:10.328165 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5180587c-2124-417c-b057-8a8ae2448e86 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:10.328965 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5180587c-2124-417c-b057-8a8ae2448e86 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:10.340067 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5180587c-2124-417c-b057-8a8ae2448e86 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:10.340702 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5180587c-2124-417c-b057-8a8ae2448e86 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:10.346040 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5180587c-2124-417c-b057-8a8ae2448e86 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:10.346040 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5180587c-2124-417c-b057-8a8ae2448e86 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:10.488680 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-5180587c-2124-417c-b057-8a8ae2448e86 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:10.496141 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5180587c-2124-417c-b057-8a8ae2448e86 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1342 microversion: 2.1 time: 0.172969 Jun 10 18:40:10.506698 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3521/6997] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:10 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1342 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:11.514131 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-64d07eb0-0cad-49d5-8fe0-ab44823d8ee3 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:11.514792 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-64d07eb0-0cad-49d5-8fe0-ab44823d8ee3 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:11.521771 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-64d07eb0-0cad-49d5-8fe0-ab44823d8ee3 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:11.526137 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-64d07eb0-0cad-49d5-8fe0-ab44823d8ee3 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:11.526137 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-64d07eb0-0cad-49d5-8fe0-ab44823d8ee3 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:11.526137 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-64d07eb0-0cad-49d5-8fe0-ab44823d8ee3 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:11.679465 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-64d07eb0-0cad-49d5-8fe0-ab44823d8ee3 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:11.689782 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-64d07eb0-0cad-49d5-8fe0-ab44823d8ee3 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1342 microversion: 2.1 time: 0.177737 Jun 10 18:40:11.690669 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3477/6998] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:11 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1342 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:12.707624 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f05a61ab-086d-4855-a2bc-231826d31f87 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:12.708526 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f05a61ab-086d-4855-a2bc-231826d31f87 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:12.719182 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f05a61ab-086d-4855-a2bc-231826d31f87 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:12.719808 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f05a61ab-086d-4855-a2bc-231826d31f87 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:12.720657 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f05a61ab-086d-4855-a2bc-231826d31f87 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:12.721151 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f05a61ab-086d-4855-a2bc-231826d31f87 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:12.854779 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f05a61ab-086d-4855-a2bc-231826d31f87 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:12.862424 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f05a61ab-086d-4855-a2bc-231826d31f87 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1342 microversion: 2.1 time: 0.158782 Jun 10 18:40:12.863210 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3522/6999] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:12 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1342 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:13.880774 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d85682a5-f64d-434f-afd8-06a28eba46c9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:13.881412 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d85682a5-f64d-434f-afd8-06a28eba46c9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:13.888587 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d85682a5-f64d-434f-afd8-06a28eba46c9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:13.889038 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d85682a5-f64d-434f-afd8-06a28eba46c9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:13.896253 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d85682a5-f64d-434f-afd8-06a28eba46c9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:13.896253 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d85682a5-f64d-434f-afd8-06a28eba46c9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:14.031352 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d85682a5-f64d-434f-afd8-06a28eba46c9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:14.038990 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d85682a5-f64d-434f-afd8-06a28eba46c9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1342 microversion: 2.1 time: 0.162784 Jun 10 18:40:14.039647 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3478/7000] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:13 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1342 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:15.056454 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2faff0c7-3d51-42db-b3a9-85f4f4944253 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:15.057016 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2faff0c7-3d51-42db-b3a9-85f4f4944253 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:15.067161 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2faff0c7-3d51-42db-b3a9-85f4f4944253 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:15.068166 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2faff0c7-3d51-42db-b3a9-85f4f4944253 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:15.069424 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2faff0c7-3d51-42db-b3a9-85f4f4944253 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:15.070256 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2faff0c7-3d51-42db-b3a9-85f4f4944253 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:15.221465 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2faff0c7-3d51-42db-b3a9-85f4f4944253 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:15.229648 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2faff0c7-3d51-42db-b3a9-85f4f4944253 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1342 microversion: 2.1 time: 0.177114 Jun 10 18:40:15.230252 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3523/7001] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:15 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1342 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:16.246854 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-30ed429d-c2e7-4d1f-88c7-5c9c2ef080df tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:16.247752 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-30ed429d-c2e7-4d1f-88c7-5c9c2ef080df tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:16.255304 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30ed429d-c2e7-4d1f-88c7-5c9c2ef080df tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:16.255751 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30ed429d-c2e7-4d1f-88c7-5c9c2ef080df tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:16.256557 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30ed429d-c2e7-4d1f-88c7-5c9c2ef080df tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:16.256999 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30ed429d-c2e7-4d1f-88c7-5c9c2ef080df tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:16.408327 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-30ed429d-c2e7-4d1f-88c7-5c9c2ef080df tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:16.417231 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-30ed429d-c2e7-4d1f-88c7-5c9c2ef080df tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1342 microversion: 2.1 time: 0.174123 Jun 10 18:40:16.417892 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3479/7002] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:16 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1342 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:17.435478 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f52e871e-40de-4b8c-9fd4-01c6606e7f75 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:17.436194 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f52e871e-40de-4b8c-9fd4-01c6606e7f75 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:17.444381 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f52e871e-40de-4b8c-9fd4-01c6606e7f75 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:17.444956 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f52e871e-40de-4b8c-9fd4-01c6606e7f75 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:17.445758 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f52e871e-40de-4b8c-9fd4-01c6606e7f75 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:17.446227 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f52e871e-40de-4b8c-9fd4-01c6606e7f75 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:17.602428 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f52e871e-40de-4b8c-9fd4-01c6606e7f75 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:17.610264 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f52e871e-40de-4b8c-9fd4-01c6606e7f75 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1342 microversion: 2.1 time: 0.179307 Jun 10 18:40:17.618941 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3524/7003] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:17 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1342 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:18.627852 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-38b240cc-4438-4a30-89ea-a1200d8d5ef0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:18.628506 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-38b240cc-4438-4a30-89ea-a1200d8d5ef0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:18.636092 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-38b240cc-4438-4a30-89ea-a1200d8d5ef0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:18.639186 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-38b240cc-4438-4a30-89ea-a1200d8d5ef0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:18.639186 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-38b240cc-4438-4a30-89ea-a1200d8d5ef0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:18.639186 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-38b240cc-4438-4a30-89ea-a1200d8d5ef0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:18.778093 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-38b240cc-4438-4a30-89ea-a1200d8d5ef0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:18.786132 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-38b240cc-4438-4a30-89ea-a1200d8d5ef0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1342 microversion: 2.1 time: 0.162445 Jun 10 18:40:18.787279 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3480/7004] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:18 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1342 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:19.803953 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-eedf9232-b39d-4302-b3f7-624304c5f7c7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:19.804626 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-eedf9232-b39d-4302-b3f7-624304c5f7c7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:19.811223 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eedf9232-b39d-4302-b3f7-624304c5f7c7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:19.811698 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eedf9232-b39d-4302-b3f7-624304c5f7c7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:19.812522 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eedf9232-b39d-4302-b3f7-624304c5f7c7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:19.812987 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-eedf9232-b39d-4302-b3f7-624304c5f7c7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:19.955723 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-eedf9232-b39d-4302-b3f7-624304c5f7c7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:19.966595 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-eedf9232-b39d-4302-b3f7-624304c5f7c7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1342 microversion: 2.1 time: 0.166959 Jun 10 18:40:19.970277 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3525/7005] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:19 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1342 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:20.983703 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-83047289-9b21-44ea-9fcb-c314d758d54f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:20.984243 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-83047289-9b21-44ea-9fcb-c314d758d54f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:21.008222 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83047289-9b21-44ea-9fcb-c314d758d54f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:21.008222 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83047289-9b21-44ea-9fcb-c314d758d54f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:21.008222 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83047289-9b21-44ea-9fcb-c314d758d54f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:21.008222 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-83047289-9b21-44ea-9fcb-c314d758d54f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:21.008222 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:40:21.130447 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-83047289-9b21-44ea-9fcb-c314d758d54f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:21.137872 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-83047289-9b21-44ea-9fcb-c314d758d54f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1342 microversion: 2.1 time: 0.158146 Jun 10 18:40:21.138443 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3481/7006] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:20 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1342 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:22.155801 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b1cf8d68-75e8-4e98-a36c-6aacf5c625d5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:22.156522 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b1cf8d68-75e8-4e98-a36c-6aacf5c625d5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:22.164736 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b1cf8d68-75e8-4e98-a36c-6aacf5c625d5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:22.165206 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b1cf8d68-75e8-4e98-a36c-6aacf5c625d5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:22.165994 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b1cf8d68-75e8-4e98-a36c-6aacf5c625d5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:22.166445 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b1cf8d68-75e8-4e98-a36c-6aacf5c625d5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:22.311923 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b1cf8d68-75e8-4e98-a36c-6aacf5c625d5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:22.319757 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b1cf8d68-75e8-4e98-a36c-6aacf5c625d5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1342 microversion: 2.1 time: 0.168456 Jun 10 18:40:22.320349 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3526/7007] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:22 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1342 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:40:23.338099 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-388d8214-c925-480d-a56d-7c63308c2a0f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:23.338721 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-388d8214-c925-480d-a56d-7c63308c2a0f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:23.345876 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-388d8214-c925-480d-a56d-7c63308c2a0f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:23.346329 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-388d8214-c925-480d-a56d-7c63308c2a0f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:23.347102 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-388d8214-c925-480d-a56d-7c63308c2a0f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:23.347540 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-388d8214-c925-480d-a56d-7c63308c2a0f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:23.486770 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-388d8214-c925-480d-a56d-7c63308c2a0f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:23.495363 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-388d8214-c925-480d-a56d-7c63308c2a0f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1342 microversion: 2.1 time: 0.161852 Jun 10 18:40:23.495946 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3482/7008] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:23 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1342 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:24.516962 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ed709eb7-a3d2-4b93-a179-161ad1a803e0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:24.526420 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ed709eb7-a3d2-4b93-a179-161ad1a803e0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:24.526420 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ed709eb7-a3d2-4b93-a179-161ad1a803e0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:24.567380 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ed709eb7-a3d2-4b93-a179-161ad1a803e0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:24.567380 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ed709eb7-a3d2-4b93-a179-161ad1a803e0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:24.567380 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ed709eb7-a3d2-4b93-a179-161ad1a803e0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:24.671900 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ed709eb7-a3d2-4b93-a179-161ad1a803e0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:24.680022 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ed709eb7-a3d2-4b93-a179-161ad1a803e0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1342 microversion: 2.1 time: 0.167265 Jun 10 18:40:24.680615 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3527/7009] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:24 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1342 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:25.702915 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0b5d4d1e-86b9-4d12-9716-67d03d9dd4c6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:25.703527 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0b5d4d1e-86b9-4d12-9716-67d03d9dd4c6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:25.710849 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0b5d4d1e-86b9-4d12-9716-67d03d9dd4c6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:25.716058 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0b5d4d1e-86b9-4d12-9716-67d03d9dd4c6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:25.716058 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0b5d4d1e-86b9-4d12-9716-67d03d9dd4c6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:25.716058 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0b5d4d1e-86b9-4d12-9716-67d03d9dd4c6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:25.850727 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0b5d4d1e-86b9-4d12-9716-67d03d9dd4c6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:25.858465 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0b5d4d1e-86b9-4d12-9716-67d03d9dd4c6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1342 microversion: 2.1 time: 0.159314 Jun 10 18:40:25.859045 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3483/7010] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:25 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1342 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:26.876601 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-349bcede-f9fd-4ff1-8f93-a598ffb7dc92 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:26.877513 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-349bcede-f9fd-4ff1-8f93-a598ffb7dc92 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:26.886278 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-349bcede-f9fd-4ff1-8f93-a598ffb7dc92 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:26.886614 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-349bcede-f9fd-4ff1-8f93-a598ffb7dc92 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:26.887603 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-349bcede-f9fd-4ff1-8f93-a598ffb7dc92 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:26.888121 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-349bcede-f9fd-4ff1-8f93-a598ffb7dc92 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:27.026977 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-349bcede-f9fd-4ff1-8f93-a598ffb7dc92 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:27.034796 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-349bcede-f9fd-4ff1-8f93-a598ffb7dc92 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1342 microversion: 2.1 time: 0.162372 Jun 10 18:40:27.035870 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3528/7011] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:26 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1342 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:28.052035 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fdc7cccd-0941-4485-91c5-4dff5734ff07 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:28.052839 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fdc7cccd-0941-4485-91c5-4dff5734ff07 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:28.060424 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fdc7cccd-0941-4485-91c5-4dff5734ff07 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:28.060880 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fdc7cccd-0941-4485-91c5-4dff5734ff07 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:28.061650 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fdc7cccd-0941-4485-91c5-4dff5734ff07 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:28.062088 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fdc7cccd-0941-4485-91c5-4dff5734ff07 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:28.204531 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fdc7cccd-0941-4485-91c5-4dff5734ff07 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:28.212225 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fdc7cccd-0941-4485-91c5-4dff5734ff07 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1342 microversion: 2.1 time: 0.164106 Jun 10 18:40:28.212828 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3484/7012] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:28 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1342 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:29.230174 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6dc37604-17bc-41a9-b4c5-527b7682a8fc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:29.230738 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6dc37604-17bc-41a9-b4c5-527b7682a8fc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:29.237724 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6dc37604-17bc-41a9-b4c5-527b7682a8fc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:29.238200 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6dc37604-17bc-41a9-b4c5-527b7682a8fc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:29.238988 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6dc37604-17bc-41a9-b4c5-527b7682a8fc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:29.239456 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6dc37604-17bc-41a9-b4c5-527b7682a8fc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:29.373946 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6dc37604-17bc-41a9-b4c5-527b7682a8fc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:29.382043 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6dc37604-17bc-41a9-b4c5-527b7682a8fc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1342 microversion: 2.1 time: 0.155951 Jun 10 18:40:29.382612 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3529/7013] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:29 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1342 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:30.399962 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-aaca7553-1ac2-4452-9fe3-69cd414ebc13 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:30.401494 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-aaca7553-1ac2-4452-9fe3-69cd414ebc13 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:30.409420 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aaca7553-1ac2-4452-9fe3-69cd414ebc13 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:30.410084 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aaca7553-1ac2-4452-9fe3-69cd414ebc13 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:30.411641 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aaca7553-1ac2-4452-9fe3-69cd414ebc13 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:30.412298 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aaca7553-1ac2-4452-9fe3-69cd414ebc13 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:30.548239 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-aaca7553-1ac2-4452-9fe3-69cd414ebc13 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:30.556133 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-aaca7553-1ac2-4452-9fe3-69cd414ebc13 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1342 microversion: 2.1 time: 0.160162 Jun 10 18:40:30.561423 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3485/7014] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:30 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1342 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:31.574025 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2265aa99-854a-40d0-99dd-20ca206ef06c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:31.574563 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2265aa99-854a-40d0-99dd-20ca206ef06c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:31.581526 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2265aa99-854a-40d0-99dd-20ca206ef06c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:31.585100 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2265aa99-854a-40d0-99dd-20ca206ef06c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:31.585100 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2265aa99-854a-40d0-99dd-20ca206ef06c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:31.585100 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2265aa99-854a-40d0-99dd-20ca206ef06c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:31.719170 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2265aa99-854a-40d0-99dd-20ca206ef06c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:31.727974 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2265aa99-854a-40d0-99dd-20ca206ef06c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1342 microversion: 2.1 time: 0.157928 Jun 10 18:40:31.728812 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3530/7015] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:31 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1342 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:32.746373 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f8f1ab00-eed0-4861-bf59-4a6e34983e94 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:32.746901 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f8f1ab00-eed0-4861-bf59-4a6e34983e94 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:32.749650 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=28 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:40:32.754518 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8f1ab00-eed0-4861-bf59-4a6e34983e94 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:32.755903 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8f1ab00-eed0-4861-bf59-4a6e34983e94 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:32.756706 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8f1ab00-eed0-4861-bf59-4a6e34983e94 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:32.757459 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8f1ab00-eed0-4861-bf59-4a6e34983e94 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:32.903056 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f8f1ab00-eed0-4861-bf59-4a6e34983e94 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:32.911100 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f8f1ab00-eed0-4861-bf59-4a6e34983e94 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1342 microversion: 2.1 time: 0.168937 Jun 10 18:40:32.911679 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3486/7016] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:32 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1342 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:33.928546 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4127146a-46b3-4a27-80c0-42a95f554689 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:33.929145 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4127146a-46b3-4a27-80c0-42a95f554689 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:33.936163 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4127146a-46b3-4a27-80c0-42a95f554689 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:33.936676 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4127146a-46b3-4a27-80c0-42a95f554689 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:33.937467 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4127146a-46b3-4a27-80c0-42a95f554689 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:33.937929 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4127146a-46b3-4a27-80c0-42a95f554689 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:34.078455 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4127146a-46b3-4a27-80c0-42a95f554689 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:34.087042 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4127146a-46b3-4a27-80c0-42a95f554689 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1342 microversion: 2.1 time: 0.163009 Jun 10 18:40:34.093493 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3531/7017] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:33 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1342 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:35.104559 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4f300240-9a5c-42ae-8444-0c4d00c9639f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:35.105171 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4f300240-9a5c-42ae-8444-0c4d00c9639f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:35.112708 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f300240-9a5c-42ae-8444-0c4d00c9639f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:35.113210 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f300240-9a5c-42ae-8444-0c4d00c9639f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:35.113964 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f300240-9a5c-42ae-8444-0c4d00c9639f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:35.114975 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f300240-9a5c-42ae-8444-0c4d00c9639f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:35.254989 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4f300240-9a5c-42ae-8444-0c4d00c9639f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:35.262987 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4f300240-9a5c-42ae-8444-0c4d00c9639f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1342 microversion: 2.1 time: 0.162346 Jun 10 18:40:35.263569 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3487/7018] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:35 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1342 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:36.280568 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ec63ba29-0b55-4764-bf6e-97b2c488f856 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:36.281491 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ec63ba29-0b55-4764-bf6e-97b2c488f856 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:36.284230 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=26 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:40:36.289639 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec63ba29-0b55-4764-bf6e-97b2c488f856 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:36.290108 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec63ba29-0b55-4764-bf6e-97b2c488f856 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:36.290896 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec63ba29-0b55-4764-bf6e-97b2c488f856 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:36.291352 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ec63ba29-0b55-4764-bf6e-97b2c488f856 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:36.433619 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ec63ba29-0b55-4764-bf6e-97b2c488f856 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:36.441230 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ec63ba29-0b55-4764-bf6e-97b2c488f856 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1342 microversion: 2.1 time: 0.165029 Jun 10 18:40:36.441802 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3532/7019] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:36 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1342 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:37.458678 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1b2e5215-036b-4fc4-b941-4b699237b9b9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:37.459360 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1b2e5215-036b-4fc4-b941-4b699237b9b9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:37.466765 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1b2e5215-036b-4fc4-b941-4b699237b9b9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:37.467329 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1b2e5215-036b-4fc4-b941-4b699237b9b9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:37.468227 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1b2e5215-036b-4fc4-b941-4b699237b9b9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:37.468948 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1b2e5215-036b-4fc4-b941-4b699237b9b9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:37.630949 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1b2e5215-036b-4fc4-b941-4b699237b9b9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:37.639210 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1b2e5215-036b-4fc4-b941-4b699237b9b9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1342 microversion: 2.1 time: 0.184821 Jun 10 18:40:37.639816 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3488/7020] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:37 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1342 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:38.657078 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ad531345-cf0b-4610-b71b-61959cecc9e3 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:38.658338 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ad531345-cf0b-4610-b71b-61959cecc9e3 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:38.667154 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ad531345-cf0b-4610-b71b-61959cecc9e3 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:38.667890 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ad531345-cf0b-4610-b71b-61959cecc9e3 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:38.669050 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ad531345-cf0b-4610-b71b-61959cecc9e3 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:38.669826 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ad531345-cf0b-4610-b71b-61959cecc9e3 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:38.809775 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ad531345-cf0b-4610-b71b-61959cecc9e3 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:38.817472 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ad531345-cf0b-4610-b71b-61959cecc9e3 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1342 microversion: 2.1 time: 0.165135 Jun 10 18:40:38.823665 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3533/7021] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:38 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1342 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:39.834619 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cc236a66-9695-49b5-ba4f-b48e68d20d95 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:39.835159 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cc236a66-9695-49b5-ba4f-b48e68d20d95 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:39.843097 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc236a66-9695-49b5-ba4f-b48e68d20d95 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:39.843558 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc236a66-9695-49b5-ba4f-b48e68d20d95 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:39.844574 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc236a66-9695-49b5-ba4f-b48e68d20d95 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:39.845183 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc236a66-9695-49b5-ba4f-b48e68d20d95 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:39.983466 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cc236a66-9695-49b5-ba4f-b48e68d20d95 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:39.991531 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cc236a66-9695-49b5-ba4f-b48e68d20d95 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1342 microversion: 2.1 time: 0.161579 Jun 10 18:40:39.992196 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3489/7022] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:39 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1342 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:41.009411 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7149779c-f697-4b02-8213-6526c062d785 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:41.010134 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7149779c-f697-4b02-8213-6526c062d785 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:41.017486 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7149779c-f697-4b02-8213-6526c062d785 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:41.018044 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7149779c-f697-4b02-8213-6526c062d785 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:41.018894 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7149779c-f697-4b02-8213-6526c062d785 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:41.019417 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7149779c-f697-4b02-8213-6526c062d785 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:41.022150 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=84 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:40:41.183903 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7149779c-f697-4b02-8213-6526c062d785 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:41.191927 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7149779c-f697-4b02-8213-6526c062d785 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1342 microversion: 2.1 time: 0.187135 Jun 10 18:40:41.200861 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3534/7023] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:41 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1342 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:42.210098 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-436521bc-6e61-44f8-be49-af332381ae6f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:42.210716 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-436521bc-6e61-44f8-be49-af332381ae6f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:42.217657 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-436521bc-6e61-44f8-be49-af332381ae6f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:42.218113 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-436521bc-6e61-44f8-be49-af332381ae6f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:42.218872 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-436521bc-6e61-44f8-be49-af332381ae6f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:42.219314 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-436521bc-6e61-44f8-be49-af332381ae6f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:42.359719 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-436521bc-6e61-44f8-be49-af332381ae6f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:42.367824 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-436521bc-6e61-44f8-be49-af332381ae6f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1342 microversion: 2.1 time: 0.162203 Jun 10 18:40:42.368450 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3490/7024] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:42 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1342 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:43.384668 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-614639f0-1a51-4d52-a8d2-107fabdc6d4a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:43.385250 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-614639f0-1a51-4d52-a8d2-107fabdc6d4a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:43.398540 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-614639f0-1a51-4d52-a8d2-107fabdc6d4a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:43.398540 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-614639f0-1a51-4d52-a8d2-107fabdc6d4a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:43.398540 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-614639f0-1a51-4d52-a8d2-107fabdc6d4a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:43.398540 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-614639f0-1a51-4d52-a8d2-107fabdc6d4a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:43.529861 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-614639f0-1a51-4d52-a8d2-107fabdc6d4a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:43.537429 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-614639f0-1a51-4d52-a8d2-107fabdc6d4a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1376 microversion: 2.1 time: 0.156735 Jun 10 18:40:43.538036 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3535/7025] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:43 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1376 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:44.555688 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b6c13035-5986-4fa9-8080-44d1da421c50 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:44.556298 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b6c13035-5986-4fa9-8080-44d1da421c50 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:44.563730 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b6c13035-5986-4fa9-8080-44d1da421c50 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:44.564175 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b6c13035-5986-4fa9-8080-44d1da421c50 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:44.564986 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b6c13035-5986-4fa9-8080-44d1da421c50 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:44.565424 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b6c13035-5986-4fa9-8080-44d1da421c50 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:44.699989 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b6c13035-5986-4fa9-8080-44d1da421c50 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:44.707655 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b6c13035-5986-4fa9-8080-44d1da421c50 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1376 microversion: 2.1 time: 0.156545 Jun 10 18:40:44.708789 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3491/7026] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:44 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1376 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:45.731303 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-92010668-4a83-49c2-b4f3-8b29621ea9cf tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:45.732251 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-92010668-4a83-49c2-b4f3-8b29621ea9cf tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:45.740578 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-92010668-4a83-49c2-b4f3-8b29621ea9cf tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:45.741044 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-92010668-4a83-49c2-b4f3-8b29621ea9cf tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:45.741837 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-92010668-4a83-49c2-b4f3-8b29621ea9cf tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:45.743032 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-92010668-4a83-49c2-b4f3-8b29621ea9cf tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:45.874860 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-92010668-4a83-49c2-b4f3-8b29621ea9cf tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:45.882654 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-92010668-4a83-49c2-b4f3-8b29621ea9cf tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1376 microversion: 2.1 time: 0.155550 Jun 10 18:40:45.886236 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3536/7027] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:45 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1376 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:46.899245 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-295c18d0-f33a-4f5f-b336-2ee090e100b5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:46.899851 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-295c18d0-f33a-4f5f-b336-2ee090e100b5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:46.907121 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-295c18d0-f33a-4f5f-b336-2ee090e100b5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:46.907572 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-295c18d0-f33a-4f5f-b336-2ee090e100b5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:46.908358 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-295c18d0-f33a-4f5f-b336-2ee090e100b5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:46.908798 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-295c18d0-f33a-4f5f-b336-2ee090e100b5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:47.042764 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-295c18d0-f33a-4f5f-b336-2ee090e100b5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:47.050565 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-295c18d0-f33a-4f5f-b336-2ee090e100b5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1376 microversion: 2.1 time: 0.155227 Jun 10 18:40:47.051139 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3492/7028] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:46 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1376 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:48.067973 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-614e87ab-ee60-47b2-815a-afee3b6040d4 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:48.068650 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-614e87ab-ee60-47b2-815a-afee3b6040d4 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:48.075741 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-614e87ab-ee60-47b2-815a-afee3b6040d4 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:48.076221 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-614e87ab-ee60-47b2-815a-afee3b6040d4 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:48.077181 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-614e87ab-ee60-47b2-815a-afee3b6040d4 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:48.077500 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-614e87ab-ee60-47b2-815a-afee3b6040d4 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:48.213835 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-614e87ab-ee60-47b2-815a-afee3b6040d4 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:48.221521 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-614e87ab-ee60-47b2-815a-afee3b6040d4 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1376 microversion: 2.1 time: 0.157518 Jun 10 18:40:48.222101 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3537/7029] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:48 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1376 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:49.238464 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fe94ff9e-1e2a-4096-9708-ec0d7f481cca tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:49.239078 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fe94ff9e-1e2a-4096-9708-ec0d7f481cca tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:49.246233 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fe94ff9e-1e2a-4096-9708-ec0d7f481cca tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:49.246743 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fe94ff9e-1e2a-4096-9708-ec0d7f481cca tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:49.247603 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fe94ff9e-1e2a-4096-9708-ec0d7f481cca tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:49.247947 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fe94ff9e-1e2a-4096-9708-ec0d7f481cca tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:49.382919 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fe94ff9e-1e2a-4096-9708-ec0d7f481cca tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:49.390616 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fe94ff9e-1e2a-4096-9708-ec0d7f481cca tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1376 microversion: 2.1 time: 0.156017 Jun 10 18:40:49.391201 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3493/7030] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:49 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1376 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:50.408688 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-160fb5f9-cc94-4ea3-9814-5d9cdb6bde41 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:50.409323 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-160fb5f9-cc94-4ea3-9814-5d9cdb6bde41 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:50.416494 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-160fb5f9-cc94-4ea3-9814-5d9cdb6bde41 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:50.416960 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-160fb5f9-cc94-4ea3-9814-5d9cdb6bde41 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:50.417773 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-160fb5f9-cc94-4ea3-9814-5d9cdb6bde41 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:50.418287 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-160fb5f9-cc94-4ea3-9814-5d9cdb6bde41 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:50.557502 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-160fb5f9-cc94-4ea3-9814-5d9cdb6bde41 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:50.565757 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-160fb5f9-cc94-4ea3-9814-5d9cdb6bde41 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1376 microversion: 2.1 time: 0.161038 Jun 10 18:40:50.566366 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3538/7031] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:50 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1376 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:50.931314 chdv-master-2 devstack@n-api.service[126595]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 18:40:50.931837 chdv-master-2 devstack@n-api.service[126595]: Fri Jun 10 18:40:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 10 18:40:51.587429 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9ab1eded-8182-4504-981e-6e9cbc18e215 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:51.588599 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9ab1eded-8182-4504-981e-6e9cbc18e215 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:51.603217 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9ab1eded-8182-4504-981e-6e9cbc18e215 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:51.603923 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9ab1eded-8182-4504-981e-6e9cbc18e215 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:51.604869 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9ab1eded-8182-4504-981e-6e9cbc18e215 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:51.605891 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9ab1eded-8182-4504-981e-6e9cbc18e215 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:51.770212 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9ab1eded-8182-4504-981e-6e9cbc18e215 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:51.778912 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9ab1eded-8182-4504-981e-6e9cbc18e215 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1376 microversion: 2.1 time: 0.197044 Jun 10 18:40:51.779574 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3494/7032] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:51 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1376 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:52.796152 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c43255c2-6560-4e6e-a04c-4e44a17d4375 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:52.796842 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c43255c2-6560-4e6e-a04c-4e44a17d4375 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:52.804637 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c43255c2-6560-4e6e-a04c-4e44a17d4375 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:52.805103 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c43255c2-6560-4e6e-a04c-4e44a17d4375 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:52.805896 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c43255c2-6560-4e6e-a04c-4e44a17d4375 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:52.806353 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c43255c2-6560-4e6e-a04c-4e44a17d4375 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:52.946701 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c43255c2-6560-4e6e-a04c-4e44a17d4375 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:52.954383 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c43255c2-6560-4e6e-a04c-4e44a17d4375 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1376 microversion: 2.1 time: 0.162350 Jun 10 18:40:52.954960 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3539/7033] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:52 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1376 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:53.340452 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-48c3cc2d-4099-4a94-96a8-76689b4b92c9 req-c235bd63-4890-4639-ac0d-63323f3741a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afc5fef3-a4e6-4dcc-b072-d0d5be33bb98", "name": "network-vif-plugged", "status": "completed", "tag": "07b98efa-8b8f-4951-a2ae-1815a94ef466"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:40:53.352078 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-48c3cc2d-4099-4a94-96a8-76689b4b92c9 req-c235bd63-4890-4639-ac0d-63323f3741a7 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:53.352851 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-48c3cc2d-4099-4a94-96a8-76689b4b92c9 req-c235bd63-4890-4639-ac0d-63323f3741a7 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:53.365091 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-48c3cc2d-4099-4a94-96a8-76689b4b92c9 req-c235bd63-4890-4639-ac0d-63323f3741a7 service nova] Creating event network-vif-plugged:07b98efa-8b8f-4951-a2ae-1815a94ef466 for instance afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 on chh1-master-2 Jun 10 18:40:53.370109 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-48c3cc2d-4099-4a94-96a8-76689b4b92c9 req-c235bd63-4890-4639-ac0d-63323f3741a7 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033355 Jun 10 18:40:53.371419 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3495/7034] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:40:53.970815 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-708924ef-97e9-4be7-8726-83ca78d62582 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:53.971441 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-708924ef-97e9-4be7-8726-83ca78d62582 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:53.978412 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-708924ef-97e9-4be7-8726-83ca78d62582 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:53.983182 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-708924ef-97e9-4be7-8726-83ca78d62582 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:53.983182 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-708924ef-97e9-4be7-8726-83ca78d62582 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:53.983182 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-708924ef-97e9-4be7-8726-83ca78d62582 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:54.115838 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-708924ef-97e9-4be7-8726-83ca78d62582 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:54.123732 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-708924ef-97e9-4be7-8726-83ca78d62582 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1376 microversion: 2.1 time: 0.156754 Jun 10 18:40:54.124323 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3540/7035] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:53 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1376 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:55.143996 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cac452a9-1bb2-4ff0-b499-be5581bd552d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:55.144748 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cac452a9-1bb2-4ff0-b499-be5581bd552d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:55.151617 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cac452a9-1bb2-4ff0-b499-be5581bd552d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:55.152064 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cac452a9-1bb2-4ff0-b499-be5581bd552d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:55.152858 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cac452a9-1bb2-4ff0-b499-be5581bd552d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:55.153549 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cac452a9-1bb2-4ff0-b499-be5581bd552d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:55.156171 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=86 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:40:55.612145 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cac452a9-1bb2-4ff0-b499-be5581bd552d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:55.620270 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cac452a9-1bb2-4ff0-b499-be5581bd552d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1563 microversion: 2.1 time: 0.481547 Jun 10 18:40:55.621077 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3496/7036] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:55 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1563 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:55.637116 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f133267a-52c1-4394-b83b-0d7386f61746 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:55.638869 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f133267a-52c1-4394-b83b-0d7386f61746 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:55.644941 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f133267a-52c1-4394-b83b-0d7386f61746 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:55.645406 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f133267a-52c1-4394-b83b-0d7386f61746 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:55.646184 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f133267a-52c1-4394-b83b-0d7386f61746 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:55.646637 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f133267a-52c1-4394-b83b-0d7386f61746 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:55.784773 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f133267a-52c1-4394-b83b-0d7386f61746 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:55.791798 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f133267a-52c1-4394-b83b-0d7386f61746 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1563 microversion: 2.1 time: 0.158492 Jun 10 18:40:55.792417 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3541/7037] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:55 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:55.863760 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-496760b4-b8d9-45ba-8b6c-bb9a2e9e58d7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:55.864256 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-496760b4-b8d9-45ba-8b6c-bb9a2e9e58d7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:55.870910 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-496760b4-b8d9-45ba-8b6c-bb9a2e9e58d7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:55.871357 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-496760b4-b8d9-45ba-8b6c-bb9a2e9e58d7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:55.872111 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-496760b4-b8d9-45ba-8b6c-bb9a2e9e58d7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:55.872567 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-496760b4-b8d9-45ba-8b6c-bb9a2e9e58d7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:55.901910 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-496760b4-b8d9-45ba-8b6c-bb9a2e9e58d7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:40:56.267818 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-496760b4-b8d9-45ba-8b6c-bb9a2e9e58d7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "DELETE /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 204 len: 0 microversion: 2.1 time: 0.407470 Jun 10 18:40:56.276357 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3497/7038] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:40:55 2022] DELETE /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:40:56.277115 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-a6908740-e1cc-4b2e-8fd3-7426b430ced0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:56.277909 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-a6908740-e1cc-4b2e-8fd3-7426b430ced0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:56.284953 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a6908740-e1cc-4b2e-8fd3-7426b430ced0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:56.285423 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a6908740-e1cc-4b2e-8fd3-7426b430ced0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:56.286221 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a6908740-e1cc-4b2e-8fd3-7426b430ced0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:56.286678 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-a6908740-e1cc-4b2e-8fd3-7426b430ced0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:56.419188 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-a6908740-e1cc-4b2e-8fd3-7426b430ced0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:56.427345 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-a6908740-e1cc-4b2e-8fd3-7426b430ced0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1569 microversion: 2.1 time: 0.154574 Jun 10 18:40:56.431535 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3542/7039] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:56 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:40:57.446514 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2b60af18-81d8-48f6-8d45-03c63b191488 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:57.447211 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2b60af18-81d8-48f6-8d45-03c63b191488 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:57.454868 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2b60af18-81d8-48f6-8d45-03c63b191488 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:57.455310 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2b60af18-81d8-48f6-8d45-03c63b191488 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:57.456099 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2b60af18-81d8-48f6-8d45-03c63b191488 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:57.456615 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2b60af18-81d8-48f6-8d45-03c63b191488 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:57.590351 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2b60af18-81d8-48f6-8d45-03c63b191488 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:57.601240 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2b60af18-81d8-48f6-8d45-03c63b191488 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1569 microversion: 2.1 time: 0.156527 Jun 10 18:40:57.601240 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3498/7040] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:57 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:58.277824 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-823ae79f-35cb-4dde-a4de-fae6892f5119 req-2026d646-b6c1-4a39-9cf1-fca2b718f054 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afc5fef3-a4e6-4dcc-b072-d0d5be33bb98", "name": "network-vif-deleted", "tag": "07b98efa-8b8f-4951-a2ae-1815a94ef466"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:40:58.289379 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-823ae79f-35cb-4dde-a4de-fae6892f5119 req-2026d646-b6c1-4a39-9cf1-fca2b718f054 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:58.289847 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-823ae79f-35cb-4dde-a4de-fae6892f5119 req-2026d646-b6c1-4a39-9cf1-fca2b718f054 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:58.305242 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-823ae79f-35cb-4dde-a4de-fae6892f5119 req-2026d646-b6c1-4a39-9cf1-fca2b718f054 service nova] Creating event network-vif-deleted:07b98efa-8b8f-4951-a2ae-1815a94ef466 for instance afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 on chh1-master-2 Jun 10 18:40:58.310540 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-823ae79f-35cb-4dde-a4de-fae6892f5119 req-2026d646-b6c1-4a39-9cf1-fca2b718f054 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036713 Jun 10 18:40:58.311267 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3543/7041] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:40:58.615952 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a01f4edf-011c-44f8-bdb2-b5daf82ebe5a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:58.617352 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a01f4edf-011c-44f8-bdb2-b5daf82ebe5a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:58.624618 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a01f4edf-011c-44f8-bdb2-b5daf82ebe5a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:58.625190 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a01f4edf-011c-44f8-bdb2-b5daf82ebe5a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:58.626072 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a01f4edf-011c-44f8-bdb2-b5daf82ebe5a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:58.626661 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a01f4edf-011c-44f8-bdb2-b5daf82ebe5a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:58.700440 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a01f4edf-011c-44f8-bdb2-b5daf82ebe5a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:58.708906 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a01f4edf-011c-44f8-bdb2-b5daf82ebe5a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1361 microversion: 2.1 time: 0.096771 Jun 10 18:40:58.709928 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3499/7042] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:58 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1361 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:40:59.727039 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7a906dce-436e-4c4f-9863-84575f1bcc52 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:40:59.728338 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7a906dce-436e-4c4f-9863-84575f1bcc52 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:40:59.736526 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7a906dce-436e-4c4f-9863-84575f1bcc52 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:59.737078 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7a906dce-436e-4c4f-9863-84575f1bcc52 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:59.738050 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7a906dce-436e-4c4f-9863-84575f1bcc52 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:40:59.738516 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7a906dce-436e-4c4f-9863-84575f1bcc52 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:40:59.815962 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7a906dce-436e-4c4f-9863-84575f1bcc52 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:40:59.824942 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7a906dce-436e-4c4f-9863-84575f1bcc52 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1361 microversion: 2.1 time: 0.102110 Jun 10 18:40:59.825628 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3544/7043] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:40:59 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1361 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:41:00.842374 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-55d5589c-e825-47ed-b7ca-7e9307db1df1 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:41:00.843102 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-55d5589c-e825-47ed-b7ca-7e9307db1df1 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:41:00.851012 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-55d5589c-e825-47ed-b7ca-7e9307db1df1 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:00.851468 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-55d5589c-e825-47ed-b7ca-7e9307db1df1 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:00.852233 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-55d5589c-e825-47ed-b7ca-7e9307db1df1 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:00.852713 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-55d5589c-e825-47ed-b7ca-7e9307db1df1 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:00.921890 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-55d5589c-e825-47ed-b7ca-7e9307db1df1 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:41:00.931436 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-55d5589c-e825-47ed-b7ca-7e9307db1df1 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1361 microversion: 2.1 time: 0.093078 Jun 10 18:41:00.932190 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3500/7044] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:41:00 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1361 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:41:01.949963 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6f7908be-66ef-4316-9415-8c9c71a9acd8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:41:01.950493 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6f7908be-66ef-4316-9415-8c9c71a9acd8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:41:01.957760 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6f7908be-66ef-4316-9415-8c9c71a9acd8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:01.958430 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6f7908be-66ef-4316-9415-8c9c71a9acd8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:01.959232 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6f7908be-66ef-4316-9415-8c9c71a9acd8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:01.959689 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6f7908be-66ef-4316-9415-8c9c71a9acd8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:02.025069 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6f7908be-66ef-4316-9415-8c9c71a9acd8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:41:02.033650 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6f7908be-66ef-4316-9415-8c9c71a9acd8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1361 microversion: 2.1 time: 0.088166 Jun 10 18:41:02.040120 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3545/7045] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:41:01 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1361 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:41:03.052572 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-de477711-efe1-4cc0-88a8-f44d0400d873 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:41:03.053251 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-de477711-efe1-4cc0-88a8-f44d0400d873 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:41:03.056529 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:41:03.062107 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de477711-efe1-4cc0-88a8-f44d0400d873 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:03.062107 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de477711-efe1-4cc0-88a8-f44d0400d873 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:03.062770 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de477711-efe1-4cc0-88a8-f44d0400d873 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:03.063212 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de477711-efe1-4cc0-88a8-f44d0400d873 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:03.106911 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de477711-efe1-4cc0-88a8-f44d0400d873 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:03.107680 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de477711-efe1-4cc0-88a8-f44d0400d873 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:03.107887 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-de477711-efe1-4cc0-88a8-f44d0400d873 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lazy-loading 'fault' on Instance uuid afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:41:03.159185 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-de477711-efe1-4cc0-88a8-f44d0400d873 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:41:03.169043 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-de477711-efe1-4cc0-88a8-f44d0400d873 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 200 len: 1366 microversion: 2.1 time: 0.121864 Jun 10 18:41:03.169664 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3501/7046] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:41:03 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 1366 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:41:04.187004 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-112149d6-8524-47e4-919f-35eb2077e2f8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:41:04.188660 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-112149d6-8524-47e4-919f-35eb2077e2f8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:41:04.203854 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-112149d6-8524-47e4-919f-35eb2077e2f8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:04.205260 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-112149d6-8524-47e4-919f-35eb2077e2f8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:04.206374 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-112149d6-8524-47e4-919f-35eb2077e2f8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:04.206852 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-112149d6-8524-47e4-919f-35eb2077e2f8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:04.223635 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-112149d6-8524-47e4-919f-35eb2077e2f8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] HTTP exception thrown: Instance afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 could not be found. Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-112149d6-8524-47e4-919f-35eb2077e2f8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Request method failure captured: Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 HTTP/1.1 Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio48lCBpBlRizgNQmj6c6iu0oXkmc5Tm-q4miwv2Pj49f2pUTZFT27dYtKGefFULH5-gcByMQrPeG1d5YVOJ_GuLGrptrh59AcDYu37Uta2nd4eDA1xNIrohvrn1bdHxnfVCnt0fGjpM3LVpc7O3my-1igIi7pJV4HqsUallplG6Y66g Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 7e9c656d484843ffb1f2de092730345b Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_7e9c656d484843ffb1f2de092730345b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 7e9c656d484843ffb1f2de092730345b Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-TestVolumeBootPattern-1765437769-project Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: b469a8f9433d422aa98d22eea9df7071 Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-TestVolumeBootPattern-1765437769-project Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: exception: Instance afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 could not be found. Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'afc5fef3-a4e6-4dcc-b072-d0d5be33bb98'} Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 could not be found. Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 could not be found. Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:41:04.225667 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:41:04.230761 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:41:04.230761 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:41:04.230761 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:41:04.230761 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:41:04.230761 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:41:04.230761 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 could not be found. Jun 10 18:41:04.230761 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:41:04.230761 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-112149d6-8524-47e4-919f-35eb2077e2f8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Returning 404 to user: Instance afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:41:04.230761 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-112149d6-8524-47e4-919f-35eb2077e2f8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 404 len: 111 microversion: 2.1 time: 0.045283 Jun 10 18:41:04.237850 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3546/7047] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:41:04 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:41:08.688719 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c138b9a5-67a3-4e7d-8b8c-6b2c8dc16466 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:41:08.688719 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c138b9a5-67a3-4e7d-8b8c-6b2c8dc16466 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: cbc2dca9-8030-477a-bd3a-169c4a77059a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:41:08.688719 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c138b9a5-67a3-4e7d-8b8c-6b2c8dc16466 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:08.688719 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c138b9a5-67a3-4e7d-8b8c-6b2c8dc16466 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:08.688719 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c138b9a5-67a3-4e7d-8b8c-6b2c8dc16466 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:08.688719 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c138b9a5-67a3-4e7d-8b8c-6b2c8dc16466 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:08.688719 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c138b9a5-67a3-4e7d-8b8c-6b2c8dc16466 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: cbc2dca9-8030-477a-bd3a-169c4a77059a] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:41:09.037242 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c138b9a5-67a3-4e7d-8b8c-6b2c8dc16466 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "DELETE /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a" status: 204 len: 0 microversion: 2.1 time: 0.446377 Jun 10 18:41:09.038345 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3502/7048] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:41:08 2022] DELETE /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:41:09.046674 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-412c6d16-473a-4449-95a3-7c87e14cf87d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:41:09.047499 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-412c6d16-473a-4449-95a3-7c87e14cf87d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: cbc2dca9-8030-477a-bd3a-169c4a77059a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:41:09.050207 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=30 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:41:09.056179 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-412c6d16-473a-4449-95a3-7c87e14cf87d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:09.057177 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-412c6d16-473a-4449-95a3-7c87e14cf87d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:09.058209 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-412c6d16-473a-4449-95a3-7c87e14cf87d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:09.058655 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-412c6d16-473a-4449-95a3-7c87e14cf87d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:09.198073 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-412c6d16-473a-4449-95a3-7c87e14cf87d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:41:09.206078 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-412c6d16-473a-4449-95a3-7c87e14cf87d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a" status: 200 len: 1410 microversion: 2.1 time: 0.163432 Jun 10 18:41:09.206579 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3547/7049] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:41:09 2022] GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a => generated 1410 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:41:10.223574 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fdec40d2-ea23-4ec2-b0ec-fa368d34a72c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:41:10.224326 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fdec40d2-ea23-4ec2-b0ec-fa368d34a72c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: cbc2dca9-8030-477a-bd3a-169c4a77059a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:41:10.231541 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fdec40d2-ea23-4ec2-b0ec-fa368d34a72c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:10.231995 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fdec40d2-ea23-4ec2-b0ec-fa368d34a72c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:10.232799 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fdec40d2-ea23-4ec2-b0ec-fa368d34a72c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:10.233235 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fdec40d2-ea23-4ec2-b0ec-fa368d34a72c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:10.372518 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fdec40d2-ea23-4ec2-b0ec-fa368d34a72c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:41:10.380122 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fdec40d2-ea23-4ec2-b0ec-fa368d34a72c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a" status: 200 len: 1410 microversion: 2.1 time: 0.160841 Jun 10 18:41:10.380747 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3503/7050] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:41:10 2022] GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a => generated 1410 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:41:11.060876 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-9476818a-cd46-4985-a73b-8167ab1dd773 req-f04748a5-dd6c-4d92-9ca6-c07ce2d4a296 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbc2dca9-8030-477a-bd3a-169c4a77059a", "name": "network-vif-deleted", "tag": "becfd114-449a-4d24-ab03-b2fd9d727a17"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:41:11.069811 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-9476818a-cd46-4985-a73b-8167ab1dd773 req-f04748a5-dd6c-4d92-9ca6-c07ce2d4a296 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:11.074450 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-9476818a-cd46-4985-a73b-8167ab1dd773 req-f04748a5-dd6c-4d92-9ca6-c07ce2d4a296 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:11.074450 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=76 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:41:11.081195 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-9476818a-cd46-4985-a73b-8167ab1dd773 req-f04748a5-dd6c-4d92-9ca6-c07ce2d4a296 service nova] Creating event network-vif-deleted:becfd114-449a-4d24-ab03-b2fd9d727a17 for instance cbc2dca9-8030-477a-bd3a-169c4a77059a on chh1-master-2 Jun 10 18:41:11.086725 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-9476818a-cd46-4985-a73b-8167ab1dd773 req-f04748a5-dd6c-4d92-9ca6-c07ce2d4a296 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029562 Jun 10 18:41:11.087305 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3548/7051] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:41:11.400456 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0cfef3ef-ef34-4ba2-88e6-c6e3a580c948 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:41:11.401093 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0cfef3ef-ef34-4ba2-88e6-c6e3a580c948 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: cbc2dca9-8030-477a-bd3a-169c4a77059a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:41:11.409614 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0cfef3ef-ef34-4ba2-88e6-c6e3a580c948 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:11.410205 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0cfef3ef-ef34-4ba2-88e6-c6e3a580c948 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:11.411259 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0cfef3ef-ef34-4ba2-88e6-c6e3a580c948 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:11.411774 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0cfef3ef-ef34-4ba2-88e6-c6e3a580c948 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:11.493623 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0cfef3ef-ef34-4ba2-88e6-c6e3a580c948 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:41:11.501843 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0cfef3ef-ef34-4ba2-88e6-c6e3a580c948 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a" status: 200 len: 1202 microversion: 2.1 time: 0.107647 Jun 10 18:41:11.502431 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3504/7052] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:41:11 2022] GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a => generated 1202 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:41:12.521639 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9cc7116f-757e-47d1-9f91-83ba7b584e77 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:41:12.523147 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9cc7116f-757e-47d1-9f91-83ba7b584e77 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: cbc2dca9-8030-477a-bd3a-169c4a77059a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:41:12.530069 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9cc7116f-757e-47d1-9f91-83ba7b584e77 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:12.534093 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9cc7116f-757e-47d1-9f91-83ba7b584e77 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:12.534093 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9cc7116f-757e-47d1-9f91-83ba7b584e77 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:12.534093 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9cc7116f-757e-47d1-9f91-83ba7b584e77 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:12.597686 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9cc7116f-757e-47d1-9f91-83ba7b584e77 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:41:12.606469 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9cc7116f-757e-47d1-9f91-83ba7b584e77 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a" status: 200 len: 1202 microversion: 2.1 time: 0.090535 Jun 10 18:41:12.608607 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3549/7053] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:41:12 2022] GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a => generated 1202 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:41:13.627209 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-19760ee0-f985-430a-b20d-004f29c8295d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:41:13.627209 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-19760ee0-f985-430a-b20d-004f29c8295d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: cbc2dca9-8030-477a-bd3a-169c4a77059a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:41:13.635308 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-19760ee0-f985-430a-b20d-004f29c8295d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:13.635867 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-19760ee0-f985-430a-b20d-004f29c8295d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:13.636901 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-19760ee0-f985-430a-b20d-004f29c8295d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:13.637474 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-19760ee0-f985-430a-b20d-004f29c8295d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:13.707635 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-19760ee0-f985-430a-b20d-004f29c8295d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:41:13.715899 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-19760ee0-f985-430a-b20d-004f29c8295d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a" status: 200 len: 1202 microversion: 2.1 time: 0.095773 Jun 10 18:41:13.716996 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3505/7054] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:41:13 2022] GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a => generated 1202 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:41:14.733662 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0bb4fe92-6d7b-4f4b-88d7-cb10a1d21dd6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:41:14.734530 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0bb4fe92-6d7b-4f4b-88d7-cb10a1d21dd6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: cbc2dca9-8030-477a-bd3a-169c4a77059a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:41:14.742507 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0bb4fe92-6d7b-4f4b-88d7-cb10a1d21dd6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:14.742978 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0bb4fe92-6d7b-4f4b-88d7-cb10a1d21dd6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:14.746069 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0bb4fe92-6d7b-4f4b-88d7-cb10a1d21dd6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:14.746069 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0bb4fe92-6d7b-4f4b-88d7-cb10a1d21dd6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:14.817484 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0bb4fe92-6d7b-4f4b-88d7-cb10a1d21dd6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:41:14.826458 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0bb4fe92-6d7b-4f4b-88d7-cb10a1d21dd6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a" status: 200 len: 1202 microversion: 2.1 time: 0.096825 Jun 10 18:41:14.827158 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3550/7055] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:41:14 2022] GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a => generated 1202 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:41:15.843042 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d0cce1c8-c7a9-4540-9c79-7cda43768107 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:41:15.843657 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d0cce1c8-c7a9-4540-9c79-7cda43768107 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: cbc2dca9-8030-477a-bd3a-169c4a77059a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:41:15.851158 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d0cce1c8-c7a9-4540-9c79-7cda43768107 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:15.851613 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d0cce1c8-c7a9-4540-9c79-7cda43768107 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:15.854008 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d0cce1c8-c7a9-4540-9c79-7cda43768107 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:15.854008 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d0cce1c8-c7a9-4540-9c79-7cda43768107 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:15.888460 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d0cce1c8-c7a9-4540-9c79-7cda43768107 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:15.888913 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d0cce1c8-c7a9-4540-9c79-7cda43768107 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:15.889358 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-d0cce1c8-c7a9-4540-9c79-7cda43768107 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lazy-loading 'fault' on Instance uuid cbc2dca9-8030-477a-bd3a-169c4a77059a {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:41:15.932051 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d0cce1c8-c7a9-4540-9c79-7cda43768107 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:41:15.940285 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d0cce1c8-c7a9-4540-9c79-7cda43768107 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a" status: 200 len: 1207 microversion: 2.1 time: 0.101218 Jun 10 18:41:15.940891 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3506/7056] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:41:15 2022] GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a => generated 1207 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:41:16.958078 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cd8c3064-614f-4cec-9de0-b2fcfeecfb23 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:41:16.958712 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cd8c3064-614f-4cec-9de0-b2fcfeecfb23 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: cbc2dca9-8030-477a-bd3a-169c4a77059a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:41:16.965516 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cd8c3064-614f-4cec-9de0-b2fcfeecfb23 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:16.965974 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cd8c3064-614f-4cec-9de0-b2fcfeecfb23 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:16.971335 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cd8c3064-614f-4cec-9de0-b2fcfeecfb23 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:16.971335 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cd8c3064-614f-4cec-9de0-b2fcfeecfb23 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:16.981293 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-cd8c3064-614f-4cec-9de0-b2fcfeecfb23 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] HTTP exception thrown: Instance cbc2dca9-8030-477a-bd3a-169c4a77059a could not be found. Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cd8c3064-614f-4cec-9de0-b2fcfeecfb23 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Request method failure captured: Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a HTTP/1.1 Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio48lCBpBlRizgNQmj6c6iu0oXkmc5Tm-q4miwv2Pj49f2pUTZFT27dYtKGefFULH5-gcByMQrPeG1d5YVOJ_GuLGrptrh59AcDYu37Uta2nd4eDA1xNIrohvrn1bdHxnfVCnt0fGjpM3LVpc7O3my-1igIi7pJV4HqsUallplG6Y66g Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 7e9c656d484843ffb1f2de092730345b Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_7e9c656d484843ffb1f2de092730345b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 7e9c656d484843ffb1f2de092730345b Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-TestVolumeBootPattern-1765437769-project Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: b469a8f9433d422aa98d22eea9df7071 Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-TestVolumeBootPattern-1765437769-project Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: exception: Instance cbc2dca9-8030-477a-bd3a-169c4a77059a could not be found. Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'cbc2dca9-8030-477a-bd3a-169c4a77059a'} Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbc2dca9-8030-477a-bd3a-169c4a77059a could not be found. Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbc2dca9-8030-477a-bd3a-169c4a77059a could not be found. Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:41:16.982973 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:41:16.987406 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:41:16.987406 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:41:16.987406 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:41:16.987406 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:41:16.987406 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:41:16.987406 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbc2dca9-8030-477a-bd3a-169c4a77059a could not be found. Jun 10 18:41:16.987406 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:41:16.987406 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cd8c3064-614f-4cec-9de0-b2fcfeecfb23 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Returning 404 to user: Instance cbc2dca9-8030-477a-bd3a-169c4a77059a could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:41:16.987406 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cd8c3064-614f-4cec-9de0-b2fcfeecfb23 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a" status: 404 len: 111 microversion: 2.1 time: 0.030508 Jun 10 18:41:16.987406 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3551/7057] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:41:16 2022] GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:41:19.116674 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-be20eecf-0225-4af0-b8a2-eb168dd50079 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:41:19.119872 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-be20eecf-0225-4af0-b8a2-eb168dd50079 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:41:19.124493 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-be20eecf-0225-4af0-b8a2-eb168dd50079 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:19.125026 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-be20eecf-0225-4af0-b8a2-eb168dd50079 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:19.125930 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-be20eecf-0225-4af0-b8a2-eb168dd50079 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:19.126433 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-be20eecf-0225-4af0-b8a2-eb168dd50079 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:19.140088 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-be20eecf-0225-4af0-b8a2-eb168dd50079 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] HTTP exception thrown: Instance afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 could not be found. Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-be20eecf-0225-4af0-b8a2-eb168dd50079 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Request method failure captured: Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 HTTP/1.1 Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio48lCBpBlRizgNQmj6c6iu0oXkmc5Tm-q4miwv2Pj49f2pUTZFT27dYtKGefFULH5-gcByMQrPeG1d5YVOJ_GuLGrptrh59AcDYu37Uta2nd4eDA1xNIrohvrn1bdHxnfVCnt0fGjpM3LVpc7O3my-1igIi7pJV4HqsUallplG6Y66g Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 7e9c656d484843ffb1f2de092730345b Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_7e9c656d484843ffb1f2de092730345b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 7e9c656d484843ffb1f2de092730345b Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-TestVolumeBootPattern-1765437769-project Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: b469a8f9433d422aa98d22eea9df7071 Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-TestVolumeBootPattern-1765437769-project Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: exception: Instance afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 could not be found. Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'afc5fef3-a4e6-4dcc-b072-d0d5be33bb98'} Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 could not be found. Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:41:19.142004 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:41:19.146681 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 could not be found. Jun 10 18:41:19.146681 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:41:19.146681 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:41:19.146681 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:41:19.146681 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:41:19.146681 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:41:19.146681 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:41:19.146681 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:41:19.146681 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:41:19.146681 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 could not be found. Jun 10 18:41:19.146681 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:41:19.146681 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-be20eecf-0225-4af0-b8a2-eb168dd50079 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Returning 404 to user: Instance afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:41:19.146681 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-be20eecf-0225-4af0-b8a2-eb168dd50079 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "DELETE /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 404 len: 111 microversion: 2.1 time: 0.032115 Jun 10 18:41:19.146681 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3507/7058] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:41:19 2022] DELETE /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:41:19.158708 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-90a63cf0-d960-4de0-ac57-547cc8a459c6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:41:19.159531 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-90a63cf0-d960-4de0-ac57-547cc8a459c6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: afc5fef3-a4e6-4dcc-b072-d0d5be33bb98] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:41:19.166464 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90a63cf0-d960-4de0-ac57-547cc8a459c6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:19.166939 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90a63cf0-d960-4de0-ac57-547cc8a459c6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:19.167727 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90a63cf0-d960-4de0-ac57-547cc8a459c6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:19.168181 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-90a63cf0-d960-4de0-ac57-547cc8a459c6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:19.182101 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-90a63cf0-d960-4de0-ac57-547cc8a459c6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] HTTP exception thrown: Instance afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 could not be found. Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-90a63cf0-d960-4de0-ac57-547cc8a459c6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Request method failure captured: Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 HTTP/1.1 Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio48lCBpBlRizgNQmj6c6iu0oXkmc5Tm-q4miwv2Pj49f2pUTZFT27dYtKGefFULH5-gcByMQrPeG1d5YVOJ_GuLGrptrh59AcDYu37Uta2nd4eDA1xNIrohvrn1bdHxnfVCnt0fGjpM3LVpc7O3my-1igIi7pJV4HqsUallplG6Y66g Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 7e9c656d484843ffb1f2de092730345b Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_7e9c656d484843ffb1f2de092730345b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 7e9c656d484843ffb1f2de092730345b Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-TestVolumeBootPattern-1765437769-project Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: b469a8f9433d422aa98d22eea9df7071 Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-TestVolumeBootPattern-1765437769-project Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: exception: Instance afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 could not be found. Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'afc5fef3-a4e6-4dcc-b072-d0d5be33bb98'} Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 could not be found. Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 could not be found. Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:41:19.183657 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:41:19.187879 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:41:19.187879 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:41:19.187879 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:41:19.187879 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:41:19.187879 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:41:19.187879 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 could not be found. Jun 10 18:41:19.187879 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:41:19.187879 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-90a63cf0-d960-4de0-ac57-547cc8a459c6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Returning 404 to user: Instance afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:41:19.187879 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-90a63cf0-d960-4de0-ac57-547cc8a459c6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98" status: 404 len: 111 microversion: 2.1 time: 0.031827 Jun 10 18:41:19.187879 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3552/7059] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:41:19 2022] GET /compute/v2.1/servers/afc5fef3-a4e6-4dcc-b072-d0d5be33bb98 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:41:20.026051 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-690e8337-639c-46c8-85a2-63e8f7ffa620 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:41:20.026578 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-690e8337-639c-46c8-85a2-63e8f7ffa620 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: cbc2dca9-8030-477a-bd3a-169c4a77059a] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:41:20.032895 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-690e8337-639c-46c8-85a2-63e8f7ffa620 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:20.033297 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-690e8337-639c-46c8-85a2-63e8f7ffa620 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:20.034049 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-690e8337-639c-46c8-85a2-63e8f7ffa620 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:20.034484 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-690e8337-639c-46c8-85a2-63e8f7ffa620 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:20.048423 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-690e8337-639c-46c8-85a2-63e8f7ffa620 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] HTTP exception thrown: Instance cbc2dca9-8030-477a-bd3a-169c4a77059a could not be found. Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-690e8337-639c-46c8-85a2-63e8f7ffa620 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Request method failure captured: Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a HTTP/1.1 Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio48lCBpBlRizgNQmj6c6iu0oXkmc5Tm-q4miwv2Pj49f2pUTZFT27dYtKGefFULH5-gcByMQrPeG1d5YVOJ_GuLGrptrh59AcDYu37Uta2nd4eDA1xNIrohvrn1bdHxnfVCnt0fGjpM3LVpc7O3my-1igIi7pJV4HqsUallplG6Y66g Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 7e9c656d484843ffb1f2de092730345b Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_7e9c656d484843ffb1f2de092730345b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 7e9c656d484843ffb1f2de092730345b Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-TestVolumeBootPattern-1765437769-project Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: b469a8f9433d422aa98d22eea9df7071 Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-TestVolumeBootPattern-1765437769-project Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: exception: Instance cbc2dca9-8030-477a-bd3a-169c4a77059a could not be found. Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'cbc2dca9-8030-477a-bd3a-169c4a77059a'} Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbc2dca9-8030-477a-bd3a-169c4a77059a could not be found. Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:41:20.049963 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:41:20.054465 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbc2dca9-8030-477a-bd3a-169c4a77059a could not be found. Jun 10 18:41:20.054465 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:41:20.054465 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:41:20.054465 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:41:20.054465 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:41:20.054465 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:41:20.054465 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:41:20.054465 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:41:20.054465 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:41:20.054465 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbc2dca9-8030-477a-bd3a-169c4a77059a could not be found. Jun 10 18:41:20.054465 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:41:20.054465 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-690e8337-639c-46c8-85a2-63e8f7ffa620 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Returning 404 to user: Instance cbc2dca9-8030-477a-bd3a-169c4a77059a could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:41:20.054465 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-690e8337-639c-46c8-85a2-63e8f7ffa620 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "DELETE /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a" status: 404 len: 111 microversion: 2.1 time: 0.029651 Jun 10 18:41:20.054465 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3508/7060] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:41:20 2022] DELETE /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:41:20.060179 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5d0a3f06-c6b9-4b56-8661-da16900a5636 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:41:20.060851 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-5d0a3f06-c6b9-4b56-8661-da16900a5636 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: cbc2dca9-8030-477a-bd3a-169c4a77059a] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:41:20.066957 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5d0a3f06-c6b9-4b56-8661-da16900a5636 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:20.067417 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5d0a3f06-c6b9-4b56-8661-da16900a5636 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:20.069931 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5d0a3f06-c6b9-4b56-8661-da16900a5636 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:20.069931 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-5d0a3f06-c6b9-4b56-8661-da16900a5636 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:20.082256 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-5d0a3f06-c6b9-4b56-8661-da16900a5636 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] HTTP exception thrown: Instance cbc2dca9-8030-477a-bd3a-169c4a77059a could not be found. Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5d0a3f06-c6b9-4b56-8661-da16900a5636 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Request method failure captured: Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a HTTP/1.1 Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio48lCBpBlRizgNQmj6c6iu0oXkmc5Tm-q4miwv2Pj49f2pUTZFT27dYtKGefFULH5-gcByMQrPeG1d5YVOJ_GuLGrptrh59AcDYu37Uta2nd4eDA1xNIrohvrn1bdHxnfVCnt0fGjpM3LVpc7O3my-1igIi7pJV4HqsUallplG6Y66g Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 7e9c656d484843ffb1f2de092730345b Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_7e9c656d484843ffb1f2de092730345b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 7e9c656d484843ffb1f2de092730345b Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-TestVolumeBootPattern-1765437769-project Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: b469a8f9433d422aa98d22eea9df7071 Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-TestVolumeBootPattern-1765437769-project Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: exception: Instance cbc2dca9-8030-477a-bd3a-169c4a77059a could not be found. Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'cbc2dca9-8030-477a-bd3a-169c4a77059a'} Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbc2dca9-8030-477a-bd3a-169c4a77059a could not be found. Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbc2dca9-8030-477a-bd3a-169c4a77059a could not be found. Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:41:20.083791 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:41:20.093249 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:41:20.093249 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:41:20.093249 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:41:20.093249 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:41:20.093249 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:41:20.093249 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbc2dca9-8030-477a-bd3a-169c4a77059a could not be found. Jun 10 18:41:20.093249 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:41:20.093249 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-5d0a3f06-c6b9-4b56-8661-da16900a5636 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Returning 404 to user: Instance cbc2dca9-8030-477a-bd3a-169c4a77059a could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:41:20.093249 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-5d0a3f06-c6b9-4b56-8661-da16900a5636 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a" status: 404 len: 111 microversion: 2.1 time: 0.029517 Jun 10 18:41:20.093249 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3553/7061] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:41:20 2022] GET /compute/v2.1/servers/cbc2dca9-8030-477a-bd3a-169c4a77059a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:41:20.166576 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-29fee187-c6b9-4669-8110-eec9633906f6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Action: 'create', calling method: .version_select at 0x7f77c1690f70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-905098910", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJsh0Ll4TYoinEVhZd6BAMyKm5ddqpk4B1MD0o4RLC1dh8W4euBY4q+jsauzSeCK/S0rmjL6Bgz4VI6Toi3ceHJLy1AR+LD/jl/U0GjqSGTFfpvopcnZpM8TuO4VH1ZiEg=="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:41:20.182656 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-29fee187-c6b9-4669-8110-eec9633906f6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Getting quotas for project 7e9c656d484843ffb1f2de092730345b. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:41:20.187810 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-29fee187-c6b9-4669-8110-eec9633906f6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Getting quotas for user b469a8f9433d422aa98d22eea9df7071 and project 7e9c656d484843ffb1f2de092730345b. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:41:20.269351 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-29fee187-c6b9-4669-8110-eec9633906f6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.107232 Jun 10 18:41:20.269969 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3509/7062] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 18:41:20 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:41:40.199747 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=13 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:41:40.200573 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=19 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:41:40.326833 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9ccb1c29-b183-4dfe-8bf5-86cc746c5a36 tempest-TestAggregatesBasicOps-345596607 tempest-TestAggregatesBasicOps-345596607-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-627079863", "availability_zone": "foo_zone"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:41:40.328931 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:41:40.328931 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 18:41:40.330213 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.aggregate [None req-9ccb1c29-b183-4dfe-8bf5-86cc746c5a36 tempest-TestAggregatesBasicOps-345596607 tempest-TestAggregatesBasicOps-345596607-project-admin] Generated uuid ef70de52-ed9d-41a7-bbd6-a8b831ee9982 for aggregate {{(pid=126594) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 10 18:41:40.425081 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9ccb1c29-b183-4dfe-8bf5-86cc746c5a36 tempest-TestAggregatesBasicOps-345596607 tempest-TestAggregatesBasicOps-345596607-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.232232 Jun 10 18:41:40.431947 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3554/7063] 10.222.0.35 () {60 vars in 1163 bytes} [Fri Jun 10 18:41:40 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:41:40.435838 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:41:40.436868 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:41:40.438431 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:41:40.446052 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-028a2056-95ea-4ecd-945f-706ab11651d3 tempest-TestAggregatesBasicOps-345596607 tempest-TestAggregatesBasicOps-345596607-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:41:40.447834 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:41:40.447834 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 18:41:40.570518 chdv-master-2 devstack@n-api.service[126595]: ERROR oslo.messaging._drivers.impl_rabbit [None req-028a2056-95ea-4ecd-945f-706ab11651d3 tempest-TestAggregatesBasicOps-345596607 tempest-TestAggregatesBasicOps-345596607-project-admin] [90af2232-4897-4e11-980a-6ee8c5db8484] AMQP server on 10.222.0.35:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 10 18:41:41.580734 chdv-master-2 devstack@n-api.service[126595]: INFO oslo.messaging._drivers.impl_rabbit [None req-028a2056-95ea-4ecd-945f-706ab11651d3 tempest-TestAggregatesBasicOps-345596607 tempest-TestAggregatesBasicOps-345596607-project-admin] [90af2232-4897-4e11-980a-6ee8c5db8484] Reconnected to AMQP server on 10.222.0.35:5672 via [amqp] client with port 42814. Jun 10 18:41:41.585783 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-028a2056-95ea-4ecd-945f-706ab11651d3 tempest-TestAggregatesBasicOps-345596607 tempest-TestAggregatesBasicOps-345596607-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 1.152541 Jun 10 18:41:41.586456 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3510/7064] 10.222.0.35 () {60 vars in 1193 bytes} [Fri Jun 10 18:41:40 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:41:41.597656 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-14df12b1-af6d-424b-8691-12b56e5cdabf tempest-TestAggregatesBasicOps-345596607 tempest-TestAggregatesBasicOps-345596607-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:41:41.598888 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:41:41.598888 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 18:41:41.600127 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-14df12b1-af6d-424b-8691-12b56e5cdabf tempest-TestAggregatesBasicOps-345596607 tempest-TestAggregatesBasicOps-345596607-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:41.600756 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-14df12b1-af6d-424b-8691-12b56e5cdabf tempest-TestAggregatesBasicOps-345596607 tempest-TestAggregatesBasicOps-345596607-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:41.601595 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-14df12b1-af6d-424b-8691-12b56e5cdabf tempest-TestAggregatesBasicOps-345596607 tempest-TestAggregatesBasicOps-345596607-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:41.602046 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-14df12b1-af6d-424b-8691-12b56e5cdabf tempest-TestAggregatesBasicOps-345596607 tempest-TestAggregatesBasicOps-345596607-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:41.627675 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-14df12b1-af6d-424b-8691-12b56e5cdabf tempest-TestAggregatesBasicOps-345596607 tempest-TestAggregatesBasicOps-345596607-project-admin] 10.222.0.35 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.034579 Jun 10 18:41:41.628318 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3555/7065] 10.222.0.35 () {58 vars in 1175 bytes} [Fri Jun 10 18:41:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:41:41.638912 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-00fbb04c-03b6-4aa6-b2c0-eced28609207 tempest-TestAggregatesBasicOps-345596607 tempest-TestAggregatesBasicOps-345596607-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:41:41.639747 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:41:41.639747 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 18:41:41.651955 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-00fbb04c-03b6-4aa6-b2c0-eced28609207 tempest-TestAggregatesBasicOps-345596607 tempest-TestAggregatesBasicOps-345596607-project-admin] 10.222.0.35 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.016627 Jun 10 18:41:41.653760 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3511/7066] 10.222.0.35 () {58 vars in 1142 bytes} [Fri Jun 10 18:41:41 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:41:41.669074 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-bd29ab44-63f9-48eb-80c6-228233ff9146 tempest-TestAggregatesBasicOps-345596607 tempest-TestAggregatesBasicOps-345596607-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "chh1-master-2"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:41:41.670311 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:41:41.670311 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 18:41:41.678875 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bd29ab44-63f9-48eb-80c6-228233ff9146 tempest-TestAggregatesBasicOps-345596607 tempest-TestAggregatesBasicOps-345596607-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:41.679335 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-bd29ab44-63f9-48eb-80c6-228233ff9146 tempest-TestAggregatesBasicOps-345596607 tempest-TestAggregatesBasicOps-345596607-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:42.055254 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-bd29ab44-63f9-48eb-80c6-228233ff9146 tempest-TestAggregatesBasicOps-345596607 tempest-TestAggregatesBasicOps-345596607-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.389942 Jun 10 18:41:42.055959 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3556/7067] 10.222.0.35 () {60 vars in 1193 bytes} [Fri Jun 10 18:41:41 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:41:42.065747 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c54677d8-0e96-4e52-a323-c19b3bc1fb47 tempest-TestAggregatesBasicOps-345596607 tempest-TestAggregatesBasicOps-345596607-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:41:42.066490 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:41:42.066490 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 18:41:42.082372 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c54677d8-0e96-4e52-a323-c19b3bc1fb47 tempest-TestAggregatesBasicOps-345596607 tempest-TestAggregatesBasicOps-345596607-project-admin] 10.222.0.35 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.020044 Jun 10 18:41:42.083248 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3512/7068] 10.222.0.35 () {58 vars in 1151 bytes} [Fri Jun 10 18:41:42 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:41:42.093992 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-86236ab6-7833-4786-bc78-67620e6e3de0 tempest-TestAggregatesBasicOps-345596607 tempest-TestAggregatesBasicOps-345596607-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-295763169", "availability_zone": "foo_zone"}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:41:42.095916 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:41:42.095916 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 18:41:42.214041 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-86236ab6-7833-4786-bc78-67620e6e3de0 tempest-TestAggregatesBasicOps-345596607 tempest-TestAggregatesBasicOps-345596607-project-admin] 10.222.0.35 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.124394 Jun 10 18:41:42.219389 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3557/7069] 10.222.0.35 () {60 vars in 1172 bytes} [Fri Jun 10 18:41:42 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:41:42.224381 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-af6c5591-4402-4367-b4e4-1e582aca2187 tempest-TestAggregatesBasicOps-345596607 tempest-TestAggregatesBasicOps-345596607-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:41:42.226326 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:41:42.226326 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 18:41:42.309244 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-af6c5591-4402-4367-b4e4-1e582aca2187 tempest-TestAggregatesBasicOps-345596607 tempest-TestAggregatesBasicOps-345596607-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.088477 Jun 10 18:41:42.309877 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3513/7070] 10.222.0.35 () {60 vars in 1193 bytes} [Fri Jun 10 18:41:42 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:41:42.319900 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3eebf8aa-e3a3-4e88-8496-8916a963d580 tempest-TestAggregatesBasicOps-345596607 tempest-TestAggregatesBasicOps-345596607-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:41:42.320640 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:41:42.320640 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 18:41:42.329152 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3eebf8aa-e3a3-4e88-8496-8916a963d580 tempest-TestAggregatesBasicOps-345596607 tempest-TestAggregatesBasicOps-345596607-project-admin] 10.222.0.35 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.013052 Jun 10 18:41:42.329718 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3558/7071] 10.222.0.35 () {58 vars in 1151 bytes} [Fri Jun 10 18:41:42 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:41:42.340833 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8db974f7-3b05-4101-b5ba-86d5503093f0 tempest-TestAggregatesBasicOps-345596607 tempest-TestAggregatesBasicOps-345596607-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "chh1-master-2"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:41:42.348054 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:41:42.348054 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 18:41:42.351549 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8db974f7-3b05-4101-b5ba-86d5503093f0 tempest-TestAggregatesBasicOps-345596607 tempest-TestAggregatesBasicOps-345596607-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:42.352024 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8db974f7-3b05-4101-b5ba-86d5503093f0 tempest-TestAggregatesBasicOps-345596607 tempest-TestAggregatesBasicOps-345596607-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:42.742819 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8db974f7-3b05-4101-b5ba-86d5503093f0 tempest-TestAggregatesBasicOps-345596607 tempest-TestAggregatesBasicOps-345596607-project-admin] 10.222.0.35 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.405925 Jun 10 18:41:42.743481 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3514/7072] 10.222.0.35 () {60 vars in 1193 bytes} [Fri Jun 10 18:41:42 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:41:42.753189 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-e8538172-1277-4606-9167-34e0ce3eccdd tempest-TestAggregatesBasicOps-345596607 tempest-TestAggregatesBasicOps-345596607-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:41:42.754012 chdv-master-2 devstack@n-api.service[126594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:41:42.754012 chdv-master-2 devstack@n-api.service[126594]: warnings.warn(msg) Jun 10 18:41:42.861723 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-e8538172-1277-4606-9167-34e0ce3eccdd tempest-TestAggregatesBasicOps-345596607 tempest-TestAggregatesBasicOps-345596607-project-admin] 10.222.0.35 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.112058 Jun 10 18:41:42.862324 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3559/7073] 10.222.0.35 () {58 vars in 1154 bytes} [Fri Jun 10 18:41:42 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 10 18:41:48.561290 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-81c60df4-c934-4bac-8b7c-1739d87e6c22 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2099871393", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-905098910", "security_groups": [{"name": "tempest-secgroup-smoke-2101708141"}], "block_device_mapping_v2": [{"uuid": "8ff86118-749b-48a1-b6e2-0a48e09b96eb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b7773285-a55f-44ca-92fc-1f9b6eadbe45"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:41:48.736064 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-81c60df4-c934-4bac-8b7c-1739d87e6c22 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] validate_networks() for [('b7773285-a55f-44ca-92fc-1f9b6eadbe45', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:41:49.450258 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-81c60df4-c934-4bac-8b7c-1739d87e6c22 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:41:49.450717 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-81c60df4-c934-4bac-8b7c-1739d87e6c22 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:41:49.451196 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-81c60df4-c934-4bac-8b7c-1739d87e6c22 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:41:49.451609 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-81c60df4-c934-4bac-8b7c-1739d87e6c22 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:41:49.452024 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-81c60df4-c934-4bac-8b7c-1739d87e6c22 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:41:49.461094 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-81c60df4-c934-4bac-8b7c-1739d87e6c22 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:49.461546 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-81c60df4-c934-4bac-8b7c-1739d87e6c22 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:49.462348 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-81c60df4-c934-4bac-8b7c-1739d87e6c22 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:49.462791 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-81c60df4-c934-4bac-8b7c-1739d87e6c22 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:49.480819 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-81c60df4-c934-4bac-8b7c-1739d87e6c22 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Getting quotas for project 7e9c656d484843ffb1f2de092730345b. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:41:49.486476 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-81c60df4-c934-4bac-8b7c-1739d87e6c22 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Getting quotas for user b469a8f9433d422aa98d22eea9df7071 and project 7e9c656d484843ffb1f2de092730345b. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:41:49.544137 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-81c60df4-c934-4bac-8b7c-1739d87e6c22 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:41:49.546296 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-81c60df4-c934-4bac-8b7c-1739d87e6c22 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: d44d141b-de49-4325-a2ec-170462103055] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8ff86118-749b-48a1-b6e2-0a48e09b96eb',volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:41:49.985804 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-81c60df4-c934-4bac-8b7c-1739d87e6c22 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.428418 Jun 10 18:41:49.992640 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3515/7074] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:41:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 1436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:41:49.997269 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-fa7ba384-afa5-4b65-bcc5-b118f0ab77cd tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:41:49.998593 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-fa7ba384-afa5-4b65-bcc5-b118f0ab77cd tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: d44d141b-de49-4325-a2ec-170462103055] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:41:50.094273 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-fa7ba384-afa5-4b65-bcc5-b118f0ab77cd tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:41:50.101869 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-fa7ba384-afa5-4b65-bcc5-b118f0ab77cd tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055" status: 200 len: 1094 microversion: 2.1 time: 0.108214 Jun 10 18:41:50.102246 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3560/7075] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:41:49 2022] GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055 => generated 1094 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:41:51.119925 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-760f4288-d02f-42a4-be01-3264b756ae1e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:41:51.120586 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-760f4288-d02f-42a4-be01-3264b756ae1e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: d44d141b-de49-4325-a2ec-170462103055] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:41:51.193961 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-760f4288-d02f-42a4-be01-3264b756ae1e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:41:51.201477 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-760f4288-d02f-42a4-be01-3264b756ae1e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055" status: 200 len: 1094 microversion: 2.1 time: 0.086397 Jun 10 18:41:51.202440 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3516/7076] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:41:51 2022] GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055 => generated 1094 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:41:52.219185 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-57754eab-1fcb-4804-9df6-dc2c82d1d77b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:41:52.219765 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-57754eab-1fcb-4804-9df6-dc2c82d1d77b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: d44d141b-de49-4325-a2ec-170462103055] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:41:52.222480 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:41:52.223181 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=6 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:41:52.282664 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-57754eab-1fcb-4804-9df6-dc2c82d1d77b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:41:52.290165 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-57754eab-1fcb-4804-9df6-dc2c82d1d77b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055" status: 200 len: 1094 microversion: 2.1 time: 0.075052 Jun 10 18:41:52.290795 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3561/7077] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:41:52 2022] GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055 => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:41:53.307359 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9fc86cf2-77ef-4125-a141-65a503a88cdc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:41:53.308000 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9fc86cf2-77ef-4125-a141-65a503a88cdc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: d44d141b-de49-4325-a2ec-170462103055] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:41:53.315479 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9fc86cf2-77ef-4125-a141-65a503a88cdc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:53.315933 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9fc86cf2-77ef-4125-a141-65a503a88cdc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:53.319617 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9fc86cf2-77ef-4125-a141-65a503a88cdc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:53.319617 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9fc86cf2-77ef-4125-a141-65a503a88cdc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:53.380484 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9fc86cf2-77ef-4125-a141-65a503a88cdc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:41:53.388090 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9fc86cf2-77ef-4125-a141-65a503a88cdc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055" status: 200 len: 1144 microversion: 2.1 time: 0.085243 Jun 10 18:41:53.388812 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3517/7078] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:41:53 2022] GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055 => generated 1144 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:41:54.405735 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-036e1016-8c19-4547-bdb8-0e3cea6190f0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:41:54.406655 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-036e1016-8c19-4547-bdb8-0e3cea6190f0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: d44d141b-de49-4325-a2ec-170462103055] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:41:54.414785 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-036e1016-8c19-4547-bdb8-0e3cea6190f0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:54.415504 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-036e1016-8c19-4547-bdb8-0e3cea6190f0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:54.416497 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-036e1016-8c19-4547-bdb8-0e3cea6190f0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:54.417109 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-036e1016-8c19-4547-bdb8-0e3cea6190f0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:54.479321 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-036e1016-8c19-4547-bdb8-0e3cea6190f0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:41:54.487063 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-036e1016-8c19-4547-bdb8-0e3cea6190f0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055" status: 200 len: 1136 microversion: 2.1 time: 0.086472 Jun 10 18:41:54.490741 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3562/7079] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:41:54 2022] GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055 => generated 1136 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:41:55.331267 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c0dfdcdb-f21f-4df0-85ab-4f507e8039a8 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Action: 'create', calling method: .version_select at 0x7f77c02b6820>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1067296451", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNHJ3hwoWfBlAQu8g87Iww0e982WCeZOhvn1sIZmPKqATSrf6T70FBdQkMH/DyOAYw+0JRF5NXHPWlGQrlqCGX2ZUHiGZ+mIsaabLMmfey9IivWQmJ2zcpL0yIoWzRF4dA=="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:41:55.345066 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-c0dfdcdb-f21f-4df0-85ab-4f507e8039a8 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Getting quotas for project ddb190411ca74bfcb764a92e9420d045. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:41:55.350747 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-c0dfdcdb-f21f-4df0-85ab-4f507e8039a8 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Getting quotas for user 0a5e94bc36b74ab7a3928e598cc18ccb and project ddb190411ca74bfcb764a92e9420d045. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:41:55.449353 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c0dfdcdb-f21f-4df0-85ab-4f507e8039a8 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.289767 Jun 10 18:41:55.450280 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3518/7080] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 18:41:55 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:41:55.504760 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c0225570-3636-46f2-bf7a-eca59a26c421 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:41:55.505393 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c0225570-3636-46f2-bf7a-eca59a26c421 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: d44d141b-de49-4325-a2ec-170462103055] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:41:55.512678 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c0225570-3636-46f2-bf7a-eca59a26c421 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:55.513140 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c0225570-3636-46f2-bf7a-eca59a26c421 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:55.513925 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c0225570-3636-46f2-bf7a-eca59a26c421 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:55.514405 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c0225570-3636-46f2-bf7a-eca59a26c421 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:55.601055 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c0225570-3636-46f2-bf7a-eca59a26c421 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:41:55.611509 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c0225570-3636-46f2-bf7a-eca59a26c421 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055" status: 200 len: 1200 microversion: 2.1 time: 0.110104 Jun 10 18:41:55.621536 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3563/7081] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:41:55 2022] GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055 => generated 1200 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:41:56.629822 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-44cb4abf-ab0b-4f7a-94a4-a75e3622655d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:41:56.632888 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-44cb4abf-ab0b-4f7a-94a4-a75e3622655d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: d44d141b-de49-4325-a2ec-170462103055] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:41:56.646214 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44cb4abf-ab0b-4f7a-94a4-a75e3622655d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:56.647060 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44cb4abf-ab0b-4f7a-94a4-a75e3622655d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:56.648941 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44cb4abf-ab0b-4f7a-94a4-a75e3622655d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:56.650203 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44cb4abf-ab0b-4f7a-94a4-a75e3622655d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:56.923418 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-44cb4abf-ab0b-4f7a-94a4-a75e3622655d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:41:56.955805 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-44cb4abf-ab0b-4f7a-94a4-a75e3622655d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055" status: 200 len: 1278 microversion: 2.1 time: 0.327143 Jun 10 18:41:56.957822 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3519/7082] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:41:56 2022] GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055 => generated 1278 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:41:57.450169 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-84d8af51-bf71-4885-9b17-3659307db407 req-68b53bdc-797e-4e96-b3dd-d44ed3909a6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d44d141b-de49-4325-a2ec-170462103055", "tag": "2306b447-a72c-4149-97fc-6ac7a7e80f2c"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:41:57.466062 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-84d8af51-bf71-4885-9b17-3659307db407 req-68b53bdc-797e-4e96-b3dd-d44ed3909a6a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:57.466696 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-84d8af51-bf71-4885-9b17-3659307db407 req-68b53bdc-797e-4e96-b3dd-d44ed3909a6a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:57.485881 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-84d8af51-bf71-4885-9b17-3659307db407 req-68b53bdc-797e-4e96-b3dd-d44ed3909a6a service nova] Creating event network-changed:2306b447-a72c-4149-97fc-6ac7a7e80f2c for instance d44d141b-de49-4325-a2ec-170462103055 on chh1-master-2 Jun 10 18:41:57.492108 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-84d8af51-bf71-4885-9b17-3659307db407 req-68b53bdc-797e-4e96-b3dd-d44ed3909a6a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171797 Jun 10 18:41:57.497348 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3564/7083] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:41:57.974332 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-780f23ba-a56b-4939-aed9-5351e8530115 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:41:57.975628 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-780f23ba-a56b-4939-aed9-5351e8530115 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: d44d141b-de49-4325-a2ec-170462103055] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:41:57.987732 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-780f23ba-a56b-4939-aed9-5351e8530115 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:57.988600 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-780f23ba-a56b-4939-aed9-5351e8530115 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:57.990770 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-780f23ba-a56b-4939-aed9-5351e8530115 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:57.992744 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-780f23ba-a56b-4939-aed9-5351e8530115 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:58.453511 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-780f23ba-a56b-4939-aed9-5351e8530115 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:41:58.464208 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-780f23ba-a56b-4939-aed9-5351e8530115 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055" status: 200 len: 1278 microversion: 2.1 time: 0.494075 Jun 10 18:41:58.465215 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3520/7084] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:41:57 2022] GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055 => generated 1278 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:41:59.481988 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fbdafa30-e791-4781-b35d-4784edd35f47 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:41:59.483416 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fbdafa30-e791-4781-b35d-4784edd35f47 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: d44d141b-de49-4325-a2ec-170462103055] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:41:59.492056 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:41:59.497485 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fbdafa30-e791-4781-b35d-4784edd35f47 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:59.498203 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fbdafa30-e791-4781-b35d-4784edd35f47 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:59.499218 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fbdafa30-e791-4781-b35d-4784edd35f47 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:59.500831 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fbdafa30-e791-4781-b35d-4784edd35f47 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:59.510167 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c6915a2d-528b-4479-ad71-dbf9c4620aac tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:41:59.511837 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c6915a2d-528b-4479-ad71-dbf9c4620aac tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] [instance: 7408ba2e-3085-49c7-af8e-b66aee17b1c5] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:41:59.523140 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c6915a2d-528b-4479-ad71-dbf9c4620aac tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:59.524126 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c6915a2d-528b-4479-ad71-dbf9c4620aac tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:59.525369 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c6915a2d-528b-4479-ad71-dbf9c4620aac tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:59.526411 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c6915a2d-528b-4479-ad71-dbf9c4620aac tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:59.561665 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c6915a2d-528b-4479-ad71-dbf9c4620aac tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] [instance: 7408ba2e-3085-49c7-af8e-b66aee17b1c5] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:41:59.689671 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fbdafa30-e791-4781-b35d-4784edd35f47 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:41:59.698188 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fbdafa30-e791-4781-b35d-4784edd35f47 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055" status: 200 len: 1278 microversion: 2.1 time: 0.220112 Jun 10 18:41:59.698791 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3521/7085] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:41:59 2022] GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055 => generated 1278 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:41:59.904927 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c6915a2d-528b-4479-ad71-dbf9c4620aac tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] 10.222.0.35 "DELETE /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5" status: 204 len: 0 microversion: 2.1 time: 0.547933 Jun 10 18:41:59.905785 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3565/7086] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:41:59 2022] DELETE /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:41:59.914387 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-62635642-42c2-47a6-b1a9-dc8523264ca2 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:41:59.917383 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-62635642-42c2-47a6-b1a9-dc8523264ca2 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] [instance: 7408ba2e-3085-49c7-af8e-b66aee17b1c5] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:41:59.924428 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-62635642-42c2-47a6-b1a9-dc8523264ca2 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:59.925181 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-62635642-42c2-47a6-b1a9-dc8523264ca2 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:41:59.926117 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-62635642-42c2-47a6-b1a9-dc8523264ca2 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:41:59.926718 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-62635642-42c2-47a6-b1a9-dc8523264ca2 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:00.125814 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-62635642-42c2-47a6-b1a9-dc8523264ca2 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ca75cda41e44918bea52f718e316fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e434b726f40467597916ecbcbc9b0fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:42:00.134010 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-62635642-42c2-47a6-b1a9-dc8523264ca2 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] 10.222.0.35 "GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5" status: 200 len: 1729 microversion: 2.1 time: 0.222866 Jun 10 18:42:00.135583 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3522/7087] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:41:59 2022] GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5 => generated 1729 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:42:00.716119 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b9c82145-fc14-48ff-b54c-a81ea147bc13 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:42:00.721079 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b9c82145-fc14-48ff-b54c-a81ea147bc13 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: d44d141b-de49-4325-a2ec-170462103055] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:42:00.730497 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9c82145-fc14-48ff-b54c-a81ea147bc13 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:00.730969 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9c82145-fc14-48ff-b54c-a81ea147bc13 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:00.731760 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9c82145-fc14-48ff-b54c-a81ea147bc13 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:00.732209 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b9c82145-fc14-48ff-b54c-a81ea147bc13 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:01.096749 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b9c82145-fc14-48ff-b54c-a81ea147bc13 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:42:01.111030 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b9c82145-fc14-48ff-b54c-a81ea147bc13 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055" status: 200 len: 1278 microversion: 2.1 time: 0.399149 Jun 10 18:42:01.122720 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3566/7088] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:42:00 2022] GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055 => generated 1278 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:42:01.158176 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a0999617-16fe-4b3d-9c82-264a4d842ea9 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:42:01.158874 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a0999617-16fe-4b3d-9c82-264a4d842ea9 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] [instance: 7408ba2e-3085-49c7-af8e-b66aee17b1c5] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:42:01.179795 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a0999617-16fe-4b3d-9c82-264a4d842ea9 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:01.179795 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a0999617-16fe-4b3d-9c82-264a4d842ea9 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:01.179795 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a0999617-16fe-4b3d-9c82-264a4d842ea9 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:01.179795 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a0999617-16fe-4b3d-9c82-264a4d842ea9 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:01.538697 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a0999617-16fe-4b3d-9c82-264a4d842ea9 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ca75cda41e44918bea52f718e316fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e434b726f40467597916ecbcbc9b0fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:42:01.553770 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a0999617-16fe-4b3d-9c82-264a4d842ea9 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] 10.222.0.35 "GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5" status: 200 len: 1729 microversion: 2.1 time: 0.403718 Jun 10 18:42:01.557567 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3523/7089] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:42:01 2022] GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5 => generated 1729 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:42:02.013956 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-5febcffd-e0ec-4ad5-bb8b-621d5806edca req-087b2686-a9d0-44b2-822c-ed619964c454 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7408ba2e-3085-49c7-af8e-b66aee17b1c5", "name": "network-vif-deleted", "tag": "6680d55a-5c20-4dcd-94bb-67d83b336345"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:42:02.028455 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-5febcffd-e0ec-4ad5-bb8b-621d5806edca req-087b2686-a9d0-44b2-822c-ed619964c454 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:02.028918 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-5febcffd-e0ec-4ad5-bb8b-621d5806edca req-087b2686-a9d0-44b2-822c-ed619964c454 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:02.045391 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-5febcffd-e0ec-4ad5-bb8b-621d5806edca req-087b2686-a9d0-44b2-822c-ed619964c454 service nova] Creating event network-vif-deleted:6680d55a-5c20-4dcd-94bb-67d83b336345 for instance 7408ba2e-3085-49c7-af8e-b66aee17b1c5 on chh2-master-2 Jun 10 18:42:02.050789 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-5febcffd-e0ec-4ad5-bb8b-621d5806edca req-087b2686-a9d0-44b2-822c-ed619964c454 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044894 Jun 10 18:42:02.051877 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3567/7090] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:42:02.139383 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5ecbadac-8bf5-4d55-ba6a-d144774b0b7f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:42:02.140267 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5ecbadac-8bf5-4d55-ba6a-d144774b0b7f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: d44d141b-de49-4325-a2ec-170462103055] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:42:02.150288 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ecbadac-8bf5-4d55-ba6a-d144774b0b7f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:02.151277 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ecbadac-8bf5-4d55-ba6a-d144774b0b7f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:02.155436 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ecbadac-8bf5-4d55-ba6a-d144774b0b7f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:02.156106 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ecbadac-8bf5-4d55-ba6a-d144774b0b7f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:02.471130 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5ecbadac-8bf5-4d55-ba6a-d144774b0b7f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:42:02.484452 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5ecbadac-8bf5-4d55-ba6a-d144774b0b7f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055" status: 200 len: 1278 microversion: 2.1 time: 0.347056 Jun 10 18:42:02.493947 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3524/7091] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:42:02 2022] GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055 => generated 1278 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:42:02.575236 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cf5a7ff7-8b1d-4dd5-8a68-446542c981a2 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:42:02.575963 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cf5a7ff7-8b1d-4dd5-8a68-446542c981a2 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] [instance: 7408ba2e-3085-49c7-af8e-b66aee17b1c5] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:42:02.582148 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=4 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:42:02.591082 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf5a7ff7-8b1d-4dd5-8a68-446542c981a2 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:02.591566 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf5a7ff7-8b1d-4dd5-8a68-446542c981a2 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:02.592438 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf5a7ff7-8b1d-4dd5-8a68-446542c981a2 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:02.592975 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf5a7ff7-8b1d-4dd5-8a68-446542c981a2 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:02.691733 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf5a7ff7-8b1d-4dd5-8a68-446542c981a2 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:02.693917 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cf5a7ff7-8b1d-4dd5-8a68-446542c981a2 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:02.695125 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-cf5a7ff7-8b1d-4dd5-8a68-446542c981a2 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lazy-loading 'fault' on Instance uuid 7408ba2e-3085-49c7-af8e-b66aee17b1c5 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:42:02.767519 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cf5a7ff7-8b1d-4dd5-8a68-446542c981a2 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ca75cda41e44918bea52f718e316fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e434b726f40467597916ecbcbc9b0fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:42:02.779661 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cf5a7ff7-8b1d-4dd5-8a68-446542c981a2 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] 10.222.0.35 "GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5" status: 200 len: 1387 microversion: 2.1 time: 0.208969 Jun 10 18:42:02.780965 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3568/7092] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:42:02 2022] GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5 => generated 1387 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:42:03.501311 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6e367575-6b68-4f5a-9518-6502be78c385 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:42:03.501835 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6e367575-6b68-4f5a-9518-6502be78c385 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: d44d141b-de49-4325-a2ec-170462103055] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:42:03.514165 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6e367575-6b68-4f5a-9518-6502be78c385 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:03.521050 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6e367575-6b68-4f5a-9518-6502be78c385 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:03.521934 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6e367575-6b68-4f5a-9518-6502be78c385 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:03.522407 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6e367575-6b68-4f5a-9518-6502be78c385 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:03.797998 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-202d02a8-729d-4dea-b925-24e82e95cecb tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:42:03.798639 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-202d02a8-729d-4dea-b925-24e82e95cecb tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] [instance: 7408ba2e-3085-49c7-af8e-b66aee17b1c5] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:42:03.814093 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-202d02a8-729d-4dea-b925-24e82e95cecb tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:03.814561 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-202d02a8-729d-4dea-b925-24e82e95cecb tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:03.815366 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-202d02a8-729d-4dea-b925-24e82e95cecb tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:03.815819 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-202d02a8-729d-4dea-b925-24e82e95cecb tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:03.892180 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6e367575-6b68-4f5a-9518-6502be78c385 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:42:03.893010 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-202d02a8-729d-4dea-b925-24e82e95cecb tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:03.893546 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-202d02a8-729d-4dea-b925-24e82e95cecb tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:03.894390 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-202d02a8-729d-4dea-b925-24e82e95cecb tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lazy-loading 'fault' on Instance uuid 7408ba2e-3085-49c7-af8e-b66aee17b1c5 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:42:03.905126 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6e367575-6b68-4f5a-9518-6502be78c385 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055" status: 200 len: 1266 microversion: 2.1 time: 0.408676 Jun 10 18:42:03.906782 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3525/7093] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:42:03 2022] GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055 => generated 1266 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:42:03.966158 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-202d02a8-729d-4dea-b925-24e82e95cecb tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ca75cda41e44918bea52f718e316fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e434b726f40467597916ecbcbc9b0fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:42:03.975609 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-202d02a8-729d-4dea-b925-24e82e95cecb tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] 10.222.0.35 "GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5" status: 200 len: 1387 microversion: 2.1 time: 0.181587 Jun 10 18:42:03.976211 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3569/7094] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:42:03 2022] GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5 => generated 1387 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:42:04.702946 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1a305393-f75c-4ba3-b6c4-cb746f2b1e5e tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-872643493-access_point-861630784", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "05c3d623-9750-4ba2-8a29-6a914a26616c"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1067296451", "security_groups": [{"name": "tempest-secgroup_access--1736326347"}, {"name": "tempest-secgroup_general--1591998812"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:42:04.875067 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-1a305393-f75c-4ba3-b6c4-cb746f2b1e5e tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] validate_networks() for [('05c3d623-9750-4ba2-8a29-6a914a26616c', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:42:04.923130 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-788a980a-c347-4f14-8bd5-b0450402e076 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:42:04.923822 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-788a980a-c347-4f14-8bd5-b0450402e076 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: d44d141b-de49-4325-a2ec-170462103055] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:42:04.936998 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-788a980a-c347-4f14-8bd5-b0450402e076 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:04.937467 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-788a980a-c347-4f14-8bd5-b0450402e076 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:04.938259 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-788a980a-c347-4f14-8bd5-b0450402e076 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:04.938728 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-788a980a-c347-4f14-8bd5-b0450402e076 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:05.098659 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-788a980a-c347-4f14-8bd5-b0450402e076 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:42:05.108298 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-788a980a-c347-4f14-8bd5-b0450402e076 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055" status: 200 len: 1266 microversion: 2.1 time: 0.189058 Jun 10 18:42:05.108913 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3570/7095] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:42:04 2022] GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:42:05.113918 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8c420225-ffe4-485c-9594-b0cd1c2b1428 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:42:05.114542 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8c420225-ffe4-485c-9594-b0cd1c2b1428 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] [instance: 7408ba2e-3085-49c7-af8e-b66aee17b1c5] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:42:05.122631 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8c420225-ffe4-485c-9594-b0cd1c2b1428 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:05.123418 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8c420225-ffe4-485c-9594-b0cd1c2b1428 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:05.124838 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8c420225-ffe4-485c-9594-b0cd1c2b1428 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:05.125784 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8c420225-ffe4-485c-9594-b0cd1c2b1428 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:05.142158 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-8c420225-ffe4-485c-9594-b0cd1c2b1428 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] HTTP exception thrown: Instance 7408ba2e-3085-49c7-af8e-b66aee17b1c5 could not be found. Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8c420225-ffe4-485c-9594-b0cd1c2b1428 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Request method failure captured: Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5 HTTP/1.1 Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio48SwwDa8qXCPI-2pdIHO_Zs_4UMlJT3vXK2g-mxIOQqVtGxdXG25dcgSYvgS0UM0-81TmrWxNPZLeQ42kOx3adKEGEWG0pjYD5t-DS9R4JeK5txNLrYZApU5j6J_kfe9HMwoJZv6ETabmYxeaUDVg9vpL6OTRCxveAn5r5xFLeyxHo Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 2e434b726f40467597916ecbcbc9b0fe Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-TestServerBasicOps-1832568625 Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/2e434b726f40467597916ecbcbc9b0fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2e434b726f40467597916ecbcbc9b0fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2e434b726f40467597916ecbcbc9b0fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_2e434b726f40467597916ecbcbc9b0fe", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-TestServerBasicOps-1832568625 Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 2e434b726f40467597916ecbcbc9b0fe Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-TestServerBasicOps-1832568625 Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-TestServerBasicOps-1832568625-project Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 00ca75cda41e44918bea52f718e316fa Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-TestServerBasicOps-1832568625-project Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 7408ba2e-3085-49c7-af8e-b66aee17b1c5 could not be found. Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '7408ba2e-3085-49c7-af8e-b66aee17b1c5'} Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7408ba2e-3085-49c7-af8e-b66aee17b1c5 could not be found. Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7408ba2e-3085-49c7-af8e-b66aee17b1c5 could not be found. Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:42:05.144411 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:42:05.148655 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:42:05.148655 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:42:05.148655 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:42:05.148655 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:42:05.148655 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:42:05.148655 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7408ba2e-3085-49c7-af8e-b66aee17b1c5 could not be found. Jun 10 18:42:05.148655 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:42:05.151338 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8c420225-ffe4-485c-9594-b0cd1c2b1428 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Returning 404 to user: Instance 7408ba2e-3085-49c7-af8e-b66aee17b1c5 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:42:05.152747 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8c420225-ffe4-485c-9594-b0cd1c2b1428 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] 10.222.0.35 "GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5" status: 404 len: 111 microversion: 2.1 time: 0.042234 Jun 10 18:42:05.153881 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3571/7096] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:42:05 2022] GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:42:05.341797 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-1a305393-f75c-4ba3-b6c4-cb746f2b1e5e tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:42:05.342453 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-1a305393-f75c-4ba3-b6c4-cb746f2b1e5e tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:42:05.343130 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-1a305393-f75c-4ba3-b6c4-cb746f2b1e5e tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:42:05.343702 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-1a305393-f75c-4ba3-b6c4-cb746f2b1e5e tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:42:05.344610 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-1a305393-f75c-4ba3-b6c4-cb746f2b1e5e tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:42:05.357357 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1a305393-f75c-4ba3-b6c4-cb746f2b1e5e tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:05.357795 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1a305393-f75c-4ba3-b6c4-cb746f2b1e5e tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:05.358867 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1a305393-f75c-4ba3-b6c4-cb746f2b1e5e tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:05.359908 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1a305393-f75c-4ba3-b6c4-cb746f2b1e5e tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:05.379612 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-1a305393-f75c-4ba3-b6c4-cb746f2b1e5e tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Getting quotas for project ddb190411ca74bfcb764a92e9420d045. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:42:05.385050 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-1a305393-f75c-4ba3-b6c4-cb746f2b1e5e tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Getting quotas for user 0a5e94bc36b74ab7a3928e598cc18ccb and project ddb190411ca74bfcb764a92e9420d045. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:42:05.399042 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1a305393-f75c-4ba3-b6c4-cb746f2b1e5e tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:42:05.401301 chdv-master-2 devstack@n-api.service[126595]: WARNING nova.utils [None req-1a305393-f75c-4ba3-b6c4-cb746f2b1e5e tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-872643493-access_point-861630784 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-872643493-acc Jun 10 18:42:05.402197 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1a305393-f75c-4ba3-b6c4-cb746f2b1e5e tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] [instance: 2819cfc8-545d-42f5-b185-b6085e51302d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:42:05.526587 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1a305393-f75c-4ba3-b6c4-cb746f2b1e5e tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 0.827402 Jun 10 18:42:05.527320 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3526/7097] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:42:04 2022] POST /compute/v2.1/servers => generated 458 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:42:05.541062 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f00e1dba-4a7b-4612-903c-d8d77f5237c7 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:42:05.542059 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f00e1dba-4a7b-4612-903c-d8d77f5237c7 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] [instance: 2819cfc8-545d-42f5-b185-b6085e51302d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:42:05.614266 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f00e1dba-4a7b-4612-903c-d8d77f5237c7 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e94bc36b74ab7a3928e598cc18ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb190411ca74bfcb764a92e9420d045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:42:05.621915 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f00e1dba-4a7b-4612-903c-d8d77f5237c7 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] 10.222.0.35 "GET /compute/v2.1/servers/2819cfc8-545d-42f5-b185-b6085e51302d" status: 200 len: 1293 microversion: 2.1 time: 0.085780 Jun 10 18:42:05.623630 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3572/7098] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:42:05 2022] GET /compute/v2.1/servers/2819cfc8-545d-42f5-b185-b6085e51302d => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:42:05.750217 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bb6ef9a5-62b8-4cbe-a620-f54e02339318 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:42:05.750728 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bb6ef9a5-62b8-4cbe-a620-f54e02339318 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] [instance: 7408ba2e-3085-49c7-af8e-b66aee17b1c5] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:42:05.757057 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb6ef9a5-62b8-4cbe-a620-f54e02339318 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:05.757514 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb6ef9a5-62b8-4cbe-a620-f54e02339318 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:05.758301 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb6ef9a5-62b8-4cbe-a620-f54e02339318 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:05.758738 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb6ef9a5-62b8-4cbe-a620-f54e02339318 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:05.773541 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-bb6ef9a5-62b8-4cbe-a620-f54e02339318 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] HTTP exception thrown: Instance 7408ba2e-3085-49c7-af8e-b66aee17b1c5 could not be found. Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bb6ef9a5-62b8-4cbe-a620-f54e02339318 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Request method failure captured: Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5 HTTP/1.1 Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio48SwwDa8qXCPI-2pdIHO_Zs_4UMlJT3vXK2g-mxIOQqVtGxdXG25dcgSYvgS0UM0-81TmrWxNPZLeQ42kOx3adKEGEWG0pjYD5t-DS9R4JeK5txNLrYZApU5j6J_kfe9HMwoJZv6ETabmYxeaUDVg9vpL6OTRCxveAn5r5xFLeyxHo Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 2e434b726f40467597916ecbcbc9b0fe Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-TestServerBasicOps-1832568625 Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/2e434b726f40467597916ecbcbc9b0fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2e434b726f40467597916ecbcbc9b0fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2e434b726f40467597916ecbcbc9b0fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_2e434b726f40467597916ecbcbc9b0fe", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-TestServerBasicOps-1832568625 Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 2e434b726f40467597916ecbcbc9b0fe Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-TestServerBasicOps-1832568625 Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-TestServerBasicOps-1832568625-project Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 00ca75cda41e44918bea52f718e316fa Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-TestServerBasicOps-1832568625-project Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 7408ba2e-3085-49c7-af8e-b66aee17b1c5 could not be found. Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '7408ba2e-3085-49c7-af8e-b66aee17b1c5'} Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7408ba2e-3085-49c7-af8e-b66aee17b1c5 could not be found. Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:42:05.775198 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7408ba2e-3085-49c7-af8e-b66aee17b1c5 could not be found. Jun 10 18:42:05.782387 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:42:05.782387 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:42:05.782387 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:42:05.782387 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:42:05.782387 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:42:05.782387 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:42:05.782387 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:42:05.782387 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:42:05.782387 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7408ba2e-3085-49c7-af8e-b66aee17b1c5 could not be found. Jun 10 18:42:05.782387 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:42:05.782387 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bb6ef9a5-62b8-4cbe-a620-f54e02339318 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Returning 404 to user: Instance 7408ba2e-3085-49c7-af8e-b66aee17b1c5 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:42:05.782387 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bb6ef9a5-62b8-4cbe-a620-f54e02339318 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] 10.222.0.35 "DELETE /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5" status: 404 len: 111 microversion: 2.1 time: 0.031235 Jun 10 18:42:05.782387 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3527/7099] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:42:05 2022] DELETE /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:42:05.786289 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9399d395-3bd4-4cde-9ad8-38544f6166b2 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:42:05.787744 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9399d395-3bd4-4cde-9ad8-38544f6166b2 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] [instance: 7408ba2e-3085-49c7-af8e-b66aee17b1c5] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:42:05.795553 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9399d395-3bd4-4cde-9ad8-38544f6166b2 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:05.796025 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9399d395-3bd4-4cde-9ad8-38544f6166b2 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:05.797186 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9399d395-3bd4-4cde-9ad8-38544f6166b2 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:05.797800 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9399d395-3bd4-4cde-9ad8-38544f6166b2 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:05.813694 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-9399d395-3bd4-4cde-9ad8-38544f6166b2 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] HTTP exception thrown: Instance 7408ba2e-3085-49c7-af8e-b66aee17b1c5 could not be found. Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9399d395-3bd4-4cde-9ad8-38544f6166b2 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Request method failure captured: Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5 HTTP/1.1 Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio48SwwDa8qXCPI-2pdIHO_Zs_4UMlJT3vXK2g-mxIOQqVtGxdXG25dcgSYvgS0UM0-81TmrWxNPZLeQ42kOx3adKEGEWG0pjYD5t-DS9R4JeK5txNLrYZApU5j6J_kfe9HMwoJZv6ETabmYxeaUDVg9vpL6OTRCxveAn5r5xFLeyxHo Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 2e434b726f40467597916ecbcbc9b0fe Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-TestServerBasicOps-1832568625 Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/2e434b726f40467597916ecbcbc9b0fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2e434b726f40467597916ecbcbc9b0fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2e434b726f40467597916ecbcbc9b0fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_2e434b726f40467597916ecbcbc9b0fe", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-TestServerBasicOps-1832568625 Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 2e434b726f40467597916ecbcbc9b0fe Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-TestServerBasicOps-1832568625 Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-TestServerBasicOps-1832568625-project Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: 00ca75cda41e44918bea52f718e316fa Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-TestServerBasicOps-1832568625-project Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: exception: Instance 7408ba2e-3085-49c7-af8e-b66aee17b1c5 could not be found. Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': '7408ba2e-3085-49c7-af8e-b66aee17b1c5'} Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7408ba2e-3085-49c7-af8e-b66aee17b1c5 could not be found. Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7408ba2e-3085-49c7-af8e-b66aee17b1c5 could not be found. Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:42:05.815451 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:42:05.820254 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:42:05.820254 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:42:05.820254 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:42:05.820254 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:42:05.820254 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:42:05.820254 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7408ba2e-3085-49c7-af8e-b66aee17b1c5 could not be found. Jun 10 18:42:05.820254 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:42:05.820254 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9399d395-3bd4-4cde-9ad8-38544f6166b2 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Returning 404 to user: Instance 7408ba2e-3085-49c7-af8e-b66aee17b1c5 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:42:05.820254 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9399d395-3bd4-4cde-9ad8-38544f6166b2 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] 10.222.0.35 "GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5" status: 404 len: 111 microversion: 2.1 time: 0.034895 Jun 10 18:42:05.821101 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3573/7100] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:42:05 2022] GET /compute/v2.1/servers/7408ba2e-3085-49c7-af8e-b66aee17b1c5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:42:06.099023 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7f673980-1b31-431b-af4c-ac70c18fe597 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] Calling method '.version_select at 0x7f77b3f73310>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:42:06.126346 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2e60790c-2b91-4554-b032-0b5a4e271c32 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:42:06.131052 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2e60790c-2b91-4554-b032-0b5a4e271c32 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: d44d141b-de49-4325-a2ec-170462103055] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:42:06.148164 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2e60790c-2b91-4554-b032-0b5a4e271c32 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:06.148164 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2e60790c-2b91-4554-b032-0b5a4e271c32 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:06.148692 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2e60790c-2b91-4554-b032-0b5a4e271c32 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:06.149111 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2e60790c-2b91-4554-b032-0b5a4e271c32 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:06.168771 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7f673980-1b31-431b-af4c-ac70c18fe597 tempest-TestServerBasicOps-1832568625 tempest-TestServerBasicOps-1832568625-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-311876162" status: 202 len: 0 microversion: 2.1 time: 0.074308 Jun 10 18:42:06.170865 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3528/7101] 10.222.0.35 () {58 vars in 1250 bytes} [Fri Jun 10 18:42:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-311876162 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:42:06.302085 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2e60790c-2b91-4554-b032-0b5a4e271c32 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:42:06.310831 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2e60790c-2b91-4554-b032-0b5a4e271c32 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055" status: 200 len: 1266 microversion: 2.1 time: 0.188372 Jun 10 18:42:06.311578 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3574/7102] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:42:06 2022] GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:42:06.649717 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c3e5f32e-35d0-4384-9984-9593aa6d3e28 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:42:06.650652 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c3e5f32e-35d0-4384-9984-9593aa6d3e28 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] [instance: 2819cfc8-545d-42f5-b185-b6085e51302d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:42:06.688890 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:DELETE=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:42:06.768290 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c3e5f32e-35d0-4384-9984-9593aa6d3e28 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e94bc36b74ab7a3928e598cc18ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb190411ca74bfcb764a92e9420d045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:42:06.783741 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c3e5f32e-35d0-4384-9984-9593aa6d3e28 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] 10.222.0.35 "GET /compute/v2.1/servers/2819cfc8-545d-42f5-b185-b6085e51302d" status: 200 len: 1293 microversion: 2.1 time: 0.142149 Jun 10 18:42:06.785441 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3529/7103] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:42:06 2022] GET /compute/v2.1/servers/2819cfc8-545d-42f5-b185-b6085e51302d => generated 1293 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:42:07.328421 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3ca7d200-f38a-4596-8562-91d689234785 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:42:07.329057 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3ca7d200-f38a-4596-8562-91d689234785 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: d44d141b-de49-4325-a2ec-170462103055] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:42:07.336016 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3ca7d200-f38a-4596-8562-91d689234785 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:07.336530 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3ca7d200-f38a-4596-8562-91d689234785 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:07.337317 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3ca7d200-f38a-4596-8562-91d689234785 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:07.337779 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3ca7d200-f38a-4596-8562-91d689234785 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:07.563668 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3ca7d200-f38a-4596-8562-91d689234785 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:42:07.574778 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3ca7d200-f38a-4596-8562-91d689234785 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055" status: 200 len: 1266 microversion: 2.1 time: 0.250135 Jun 10 18:42:07.575842 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3575/7104] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:42:07 2022] GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055 => generated 1266 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:42:07.801318 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b5a8e01d-2f3e-4151-881a-56f8c087bb9e tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:42:07.801934 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b5a8e01d-2f3e-4151-881a-56f8c087bb9e tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] [instance: 2819cfc8-545d-42f5-b185-b6085e51302d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:42:07.816479 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5a8e01d-2f3e-4151-881a-56f8c087bb9e tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:07.816479 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5a8e01d-2f3e-4151-881a-56f8c087bb9e tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:07.816479 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5a8e01d-2f3e-4151-881a-56f8c087bb9e tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:07.816479 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5a8e01d-2f3e-4151-881a-56f8c087bb9e tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:07.875727 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b5a8e01d-2f3e-4151-881a-56f8c087bb9e tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e94bc36b74ab7a3928e598cc18ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb190411ca74bfcb764a92e9420d045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:42:07.884102 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b5a8e01d-2f3e-4151-881a-56f8c087bb9e tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] 10.222.0.35 "GET /compute/v2.1/servers/2819cfc8-545d-42f5-b185-b6085e51302d" status: 200 len: 1345 microversion: 2.1 time: 0.086689 Jun 10 18:42:07.884823 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3530/7105] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:42:07 2022] GET /compute/v2.1/servers/2819cfc8-545d-42f5-b185-b6085e51302d => generated 1345 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:42:08.593040 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-445497b6-8dab-474c-a821-9e5e841277cb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:42:08.593670 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-445497b6-8dab-474c-a821-9e5e841277cb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: d44d141b-de49-4325-a2ec-170462103055] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:42:08.600290 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-445497b6-8dab-474c-a821-9e5e841277cb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:08.600780 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-445497b6-8dab-474c-a821-9e5e841277cb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:08.601833 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-445497b6-8dab-474c-a821-9e5e841277cb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:08.602369 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-445497b6-8dab-474c-a821-9e5e841277cb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:08.778558 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-445497b6-8dab-474c-a821-9e5e841277cb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:42:08.786433 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-445497b6-8dab-474c-a821-9e5e841277cb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055" status: 200 len: 1266 microversion: 2.1 time: 0.197436 Jun 10 18:42:08.787118 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3576/7106] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:42:08 2022] GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055 => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:42:08.905134 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-81066c79-29a4-4f62-87d5-f5d20a41fcfd tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:42:08.905870 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-81066c79-29a4-4f62-87d5-f5d20a41fcfd tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] [instance: 2819cfc8-545d-42f5-b185-b6085e51302d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:42:08.914168 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-81066c79-29a4-4f62-87d5-f5d20a41fcfd tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:08.914812 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-81066c79-29a4-4f62-87d5-f5d20a41fcfd tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:08.915601 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-81066c79-29a4-4f62-87d5-f5d20a41fcfd tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:08.916048 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-81066c79-29a4-4f62-87d5-f5d20a41fcfd tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:08.987817 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-81066c79-29a4-4f62-87d5-f5d20a41fcfd tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e94bc36b74ab7a3928e598cc18ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb190411ca74bfcb764a92e9420d045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:42:08.995897 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-81066c79-29a4-4f62-87d5-f5d20a41fcfd tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] 10.222.0.35 "GET /compute/v2.1/servers/2819cfc8-545d-42f5-b185-b6085e51302d" status: 200 len: 1351 microversion: 2.1 time: 0.097353 Jun 10 18:42:08.996511 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3531/7107] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:42:08 2022] GET /compute/v2.1/servers/2819cfc8-545d-42f5-b185-b6085e51302d => generated 1351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:42:09.804626 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-492681f7-c429-43ee-9967-24b27959fdfc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:42:09.805269 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-492681f7-c429-43ee-9967-24b27959fdfc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: d44d141b-de49-4325-a2ec-170462103055] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:42:09.812412 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-492681f7-c429-43ee-9967-24b27959fdfc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:09.815429 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-492681f7-c429-43ee-9967-24b27959fdfc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:09.815429 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-492681f7-c429-43ee-9967-24b27959fdfc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:09.815429 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-492681f7-c429-43ee-9967-24b27959fdfc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:09.983651 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-492681f7-c429-43ee-9967-24b27959fdfc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:42:09.994817 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-492681f7-c429-43ee-9967-24b27959fdfc tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055" status: 200 len: 1266 microversion: 2.1 time: 0.194978 Jun 10 18:42:10.004456 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3577/7108] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:42:09 2022] GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055 => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:42:10.015370 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-42b5b935-f533-4611-9334-0c56280949e5 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:42:10.016616 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-42b5b935-f533-4611-9334-0c56280949e5 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] [instance: 2819cfc8-545d-42f5-b185-b6085e51302d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:42:10.026491 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42b5b935-f533-4611-9334-0c56280949e5 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:10.027037 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42b5b935-f533-4611-9334-0c56280949e5 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:10.028206 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42b5b935-f533-4611-9334-0c56280949e5 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:10.028756 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42b5b935-f533-4611-9334-0c56280949e5 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:10.677846 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-42b5b935-f533-4611-9334-0c56280949e5 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e94bc36b74ab7a3928e598cc18ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb190411ca74bfcb764a92e9420d045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:42:10.700493 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-42b5b935-f533-4611-9334-0c56280949e5 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] 10.222.0.35 "GET /compute/v2.1/servers/2819cfc8-545d-42f5-b185-b6085e51302d" status: 200 len: 1471 microversion: 2.1 time: 0.691093 Jun 10 18:42:10.702625 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3532/7109] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:42:10 2022] GET /compute/v2.1/servers/2819cfc8-545d-42f5-b185-b6085e51302d => generated 1471 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:42:11.011945 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8939bf6f-1d5a-4f26-91a6-a4ba4b5202ad tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:42:11.012696 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8939bf6f-1d5a-4f26-91a6-a4ba4b5202ad tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: d44d141b-de49-4325-a2ec-170462103055] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:42:11.015451 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:42:11.020334 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8939bf6f-1d5a-4f26-91a6-a4ba4b5202ad tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:11.020859 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8939bf6f-1d5a-4f26-91a6-a4ba4b5202ad tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:11.021650 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8939bf6f-1d5a-4f26-91a6-a4ba4b5202ad tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:11.022283 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8939bf6f-1d5a-4f26-91a6-a4ba4b5202ad tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:11.529423 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8939bf6f-1d5a-4f26-91a6-a4ba4b5202ad tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:42:11.537326 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8939bf6f-1d5a-4f26-91a6-a4ba4b5202ad tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055" status: 200 len: 1266 microversion: 2.1 time: 0.529474 Jun 10 18:42:11.537936 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3578/7110] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:42:11 2022] GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055 => generated 1266 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:42:11.621878 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-fb513538-9fdb-4097-9f53-8d3d9cf8082b req-3482e3d3-edc3-4c59-856e-05bbc3f4a2ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2819cfc8-545d-42f5-b185-b6085e51302d", "tag": "65f36690-4220-4f18-87d5-cfbdfc67d6c3"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:42:11.635981 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-fb513538-9fdb-4097-9f53-8d3d9cf8082b req-3482e3d3-edc3-4c59-856e-05bbc3f4a2ae service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:11.637132 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-fb513538-9fdb-4097-9f53-8d3d9cf8082b req-3482e3d3-edc3-4c59-856e-05bbc3f4a2ae service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:11.642867 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=77 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:42:11.665870 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-fb513538-9fdb-4097-9f53-8d3d9cf8082b req-3482e3d3-edc3-4c59-856e-05bbc3f4a2ae service nova] Creating event network-changed:65f36690-4220-4f18-87d5-cfbdfc67d6c3 for instance 2819cfc8-545d-42f5-b185-b6085e51302d on chh2-master-2 Jun 10 18:42:11.673105 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-fb513538-9fdb-4097-9f53-8d3d9cf8082b req-3482e3d3-edc3-4c59-856e-05bbc3f4a2ae service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057979 Jun 10 18:42:11.674673 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3533/7111] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:42:11.718579 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-40450c95-19fa-41d6-8b51-7ea899ef11bc req-47cd0a52-5eaa-4b30-8e60-8f0e05568381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d44d141b-de49-4325-a2ec-170462103055", "name": "network-vif-plugged", "status": "completed", "tag": "2306b447-a72c-4149-97fc-6ac7a7e80f2c"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:42:11.725800 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8be1f772-911b-40e3-86fb-9dcd27467aa3 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:42:11.726710 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8be1f772-911b-40e3-86fb-9dcd27467aa3 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] [instance: 2819cfc8-545d-42f5-b185-b6085e51302d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:42:11.729820 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-40450c95-19fa-41d6-8b51-7ea899ef11bc req-47cd0a52-5eaa-4b30-8e60-8f0e05568381 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:11.730486 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-40450c95-19fa-41d6-8b51-7ea899ef11bc req-47cd0a52-5eaa-4b30-8e60-8f0e05568381 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:11.737528 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8be1f772-911b-40e3-86fb-9dcd27467aa3 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:11.738921 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8be1f772-911b-40e3-86fb-9dcd27467aa3 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:11.740632 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8be1f772-911b-40e3-86fb-9dcd27467aa3 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:11.742088 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8be1f772-911b-40e3-86fb-9dcd27467aa3 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:11.743806 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-40450c95-19fa-41d6-8b51-7ea899ef11bc req-47cd0a52-5eaa-4b30-8e60-8f0e05568381 service nova] Creating event network-vif-plugged:2306b447-a72c-4149-97fc-6ac7a7e80f2c for instance d44d141b-de49-4325-a2ec-170462103055 on chh1-master-2 Jun 10 18:42:11.749590 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-40450c95-19fa-41d6-8b51-7ea899ef11bc req-47cd0a52-5eaa-4b30-8e60-8f0e05568381 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035178 Jun 10 18:42:11.750919 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3579/7112] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:42:12.139686 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8be1f772-911b-40e3-86fb-9dcd27467aa3 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e94bc36b74ab7a3928e598cc18ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb190411ca74bfcb764a92e9420d045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:42:12.147298 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8be1f772-911b-40e3-86fb-9dcd27467aa3 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] 10.222.0.35 "GET /compute/v2.1/servers/2819cfc8-545d-42f5-b185-b6085e51302d" status: 200 len: 1471 microversion: 2.1 time: 0.427245 Jun 10 18:42:12.147982 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3534/7113] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:42:11 2022] GET /compute/v2.1/servers/2819cfc8-545d-42f5-b185-b6085e51302d => generated 1471 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:42:12.554641 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-413a5981-db41-4c25-a51a-c9e73eed75d6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:42:12.555362 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-413a5981-db41-4c25-a51a-c9e73eed75d6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: d44d141b-de49-4325-a2ec-170462103055] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:42:12.562508 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-413a5981-db41-4c25-a51a-c9e73eed75d6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:12.562978 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-413a5981-db41-4c25-a51a-c9e73eed75d6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:12.563761 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-413a5981-db41-4c25-a51a-c9e73eed75d6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:12.564220 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-413a5981-db41-4c25-a51a-c9e73eed75d6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:12.583186 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:42:12.701057 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-413a5981-db41-4c25-a51a-c9e73eed75d6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:42:12.709288 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-413a5981-db41-4c25-a51a-c9e73eed75d6 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055" status: 200 len: 1266 microversion: 2.1 time: 0.158282 Jun 10 18:42:12.709876 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3580/7114] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:42:12 2022] GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:42:13.164940 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1e14099f-d6a3-4b89-bea9-04ae2d531e4d tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:42:13.165520 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1e14099f-d6a3-4b89-bea9-04ae2d531e4d tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] [instance: 2819cfc8-545d-42f5-b185-b6085e51302d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:42:13.173142 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1e14099f-d6a3-4b89-bea9-04ae2d531e4d tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:13.173624 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1e14099f-d6a3-4b89-bea9-04ae2d531e4d tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:13.174399 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1e14099f-d6a3-4b89-bea9-04ae2d531e4d tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:13.174833 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1e14099f-d6a3-4b89-bea9-04ae2d531e4d tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:13.726714 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-8bd477b4-e43d-4b44-82b0-6663f35df1b2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:42:13.727579 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-8bd477b4-e43d-4b44-82b0-6663f35df1b2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: d44d141b-de49-4325-a2ec-170462103055] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:42:13.734509 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8bd477b4-e43d-4b44-82b0-6663f35df1b2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:13.735051 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8bd477b4-e43d-4b44-82b0-6663f35df1b2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:13.735843 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8bd477b4-e43d-4b44-82b0-6663f35df1b2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:13.736294 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-8bd477b4-e43d-4b44-82b0-6663f35df1b2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:13.745518 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1e14099f-d6a3-4b89-bea9-04ae2d531e4d tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e94bc36b74ab7a3928e598cc18ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb190411ca74bfcb764a92e9420d045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:42:13.753435 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1e14099f-d6a3-4b89-bea9-04ae2d531e4d tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] 10.222.0.35 "GET /compute/v2.1/servers/2819cfc8-545d-42f5-b185-b6085e51302d" status: 200 len: 1471 microversion: 2.1 time: 0.592746 Jun 10 18:42:13.763036 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3535/7115] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:42:13 2022] GET /compute/v2.1/servers/2819cfc8-545d-42f5-b185-b6085e51302d => generated 1471 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:42:13.868436 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-8bd477b4-e43d-4b44-82b0-6663f35df1b2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:42:13.876170 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-8bd477b4-e43d-4b44-82b0-6663f35df1b2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055" status: 200 len: 1454 microversion: 2.1 time: 0.153979 Jun 10 18:42:13.876783 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3581/7116] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:42:13 2022] GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055 => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:42:13.903631 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3db99a28-95b3-4ab2-ba9a-f8739f806e9e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:42:13.904234 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3db99a28-95b3-4ab2-ba9a-f8739f806e9e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: d44d141b-de49-4325-a2ec-170462103055] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:42:13.910783 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3db99a28-95b3-4ab2-ba9a-f8739f806e9e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:13.911235 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3db99a28-95b3-4ab2-ba9a-f8739f806e9e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:13.912599 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3db99a28-95b3-4ab2-ba9a-f8739f806e9e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:13.913038 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3db99a28-95b3-4ab2-ba9a-f8739f806e9e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:14.143973 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3db99a28-95b3-4ab2-ba9a-f8739f806e9e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:42:14.152698 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3db99a28-95b3-4ab2-ba9a-f8739f806e9e tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055" status: 200 len: 1454 microversion: 2.1 time: 0.252861 Jun 10 18:42:14.153560 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3536/7117] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:42:13 2022] GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055 => generated 1454 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:42:14.770873 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-85e7fcba-1921-4a85-a9c1-6be4d322be72 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:42:14.771489 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-85e7fcba-1921-4a85-a9c1-6be4d322be72 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] [instance: 2819cfc8-545d-42f5-b185-b6085e51302d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:42:14.778702 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-85e7fcba-1921-4a85-a9c1-6be4d322be72 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:14.779167 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-85e7fcba-1921-4a85-a9c1-6be4d322be72 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:14.779943 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-85e7fcba-1921-4a85-a9c1-6be4d322be72 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:14.780424 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-85e7fcba-1921-4a85-a9c1-6be4d322be72 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:15.045689 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-85e7fcba-1921-4a85-a9c1-6be4d322be72 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e94bc36b74ab7a3928e598cc18ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb190411ca74bfcb764a92e9420d045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:42:15.058313 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-85e7fcba-1921-4a85-a9c1-6be4d322be72 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] 10.222.0.35 "GET /compute/v2.1/servers/2819cfc8-545d-42f5-b185-b6085e51302d" status: 200 len: 1471 microversion: 2.1 time: 0.291339 Jun 10 18:42:15.061665 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3582/7118] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:42:14 2022] GET /compute/v2.1/servers/2819cfc8-545d-42f5-b185-b6085e51302d => generated 1471 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:42:16.087339 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fdeddde8-c60b-43cf-aef0-6e0ec57dfa11 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:42:16.087955 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fdeddde8-c60b-43cf-aef0-6e0ec57dfa11 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] [instance: 2819cfc8-545d-42f5-b185-b6085e51302d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:42:16.091137 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:42:16.097445 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fdeddde8-c60b-43cf-aef0-6e0ec57dfa11 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:16.097907 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fdeddde8-c60b-43cf-aef0-6e0ec57dfa11 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:16.098691 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fdeddde8-c60b-43cf-aef0-6e0ec57dfa11 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:16.099718 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fdeddde8-c60b-43cf-aef0-6e0ec57dfa11 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:16.273449 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fdeddde8-c60b-43cf-aef0-6e0ec57dfa11 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e94bc36b74ab7a3928e598cc18ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb190411ca74bfcb764a92e9420d045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:42:16.281370 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fdeddde8-c60b-43cf-aef0-6e0ec57dfa11 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] 10.222.0.35 "GET /compute/v2.1/servers/2819cfc8-545d-42f5-b185-b6085e51302d" status: 200 len: 1471 microversion: 2.1 time: 0.207207 Jun 10 18:42:16.281958 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3537/7119] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:42:16 2022] GET /compute/v2.1/servers/2819cfc8-545d-42f5-b185-b6085e51302d => generated 1471 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:42:16.476137 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-1db99137-03e2-4d8b-992c-4b54c78a0220 req-53d18244-21f8-4d03-849e-94b221667759 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d44d141b-de49-4325-a2ec-170462103055", "tag": "2306b447-a72c-4149-97fc-6ac7a7e80f2c"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:42:16.485276 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:42:16.488434 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-1db99137-03e2-4d8b-992c-4b54c78a0220 req-53d18244-21f8-4d03-849e-94b221667759 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:16.489092 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-1db99137-03e2-4d8b-992c-4b54c78a0220 req-53d18244-21f8-4d03-849e-94b221667759 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:16.502039 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-1db99137-03e2-4d8b-992c-4b54c78a0220 req-53d18244-21f8-4d03-849e-94b221667759 service nova] Creating event network-changed:2306b447-a72c-4149-97fc-6ac7a7e80f2c for instance d44d141b-de49-4325-a2ec-170462103055 on chh1-master-2 Jun 10 18:42:16.509811 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-1db99137-03e2-4d8b-992c-4b54c78a0220 req-53d18244-21f8-4d03-849e-94b221667759 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038974 Jun 10 18:42:16.510427 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3583/7120] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:42:17.301063 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-28718f35-8c77-4f39-a3ce-b22295072850 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:42:17.301865 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-28718f35-8c77-4f39-a3ce-b22295072850 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] [instance: 2819cfc8-545d-42f5-b185-b6085e51302d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:42:17.305157 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=20 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:42:17.311004 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-28718f35-8c77-4f39-a3ce-b22295072850 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:17.311456 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-28718f35-8c77-4f39-a3ce-b22295072850 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:17.313317 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-28718f35-8c77-4f39-a3ce-b22295072850 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:17.313816 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-28718f35-8c77-4f39-a3ce-b22295072850 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:17.322724 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-bac341ec-cef8-4d0e-8122-2eb9482f6283 req-69b209cb-6a53-41e1-94ee-d701fea98c09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2819cfc8-545d-42f5-b185-b6085e51302d", "name": "network-vif-plugged", "status": "completed", "tag": "65f36690-4220-4f18-87d5-cfbdfc67d6c3"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:42:17.336788 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-bac341ec-cef8-4d0e-8122-2eb9482f6283 req-69b209cb-6a53-41e1-94ee-d701fea98c09 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:17.337271 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-bac341ec-cef8-4d0e-8122-2eb9482f6283 req-69b209cb-6a53-41e1-94ee-d701fea98c09 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:17.349651 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-bac341ec-cef8-4d0e-8122-2eb9482f6283 req-69b209cb-6a53-41e1-94ee-d701fea98c09 service nova] Creating event network-vif-plugged:65f36690-4220-4f18-87d5-cfbdfc67d6c3 for instance 2819cfc8-545d-42f5-b185-b6085e51302d on chh2-master-2 Jun 10 18:42:17.354592 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-bac341ec-cef8-4d0e-8122-2eb9482f6283 req-69b209cb-6a53-41e1-94ee-d701fea98c09 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035955 Jun 10 18:42:17.355219 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3584/7121] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:42:17.532388 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-28718f35-8c77-4f39-a3ce-b22295072850 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e94bc36b74ab7a3928e598cc18ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb190411ca74bfcb764a92e9420d045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:42:17.541789 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-28718f35-8c77-4f39-a3ce-b22295072850 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] 10.222.0.35 "GET /compute/v2.1/servers/2819cfc8-545d-42f5-b185-b6085e51302d" status: 200 len: 1471 microversion: 2.1 time: 0.245733 Jun 10 18:42:17.542139 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3538/7122] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:42:17 2022] GET /compute/v2.1/servers/2819cfc8-545d-42f5-b185-b6085e51302d => generated 1471 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:42:18.560232 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3455a9f6-3251-4db0-baba-efa0fc5c005c tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:42:18.560997 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3455a9f6-3251-4db0-baba-efa0fc5c005c tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] [instance: 2819cfc8-545d-42f5-b185-b6085e51302d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:42:18.567204 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3455a9f6-3251-4db0-baba-efa0fc5c005c tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:18.567670 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3455a9f6-3251-4db0-baba-efa0fc5c005c tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:18.568660 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3455a9f6-3251-4db0-baba-efa0fc5c005c tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:18.569113 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3455a9f6-3251-4db0-baba-efa0fc5c005c tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:18.712132 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-3455a9f6-3251-4db0-baba-efa0fc5c005c tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e94bc36b74ab7a3928e598cc18ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb190411ca74bfcb764a92e9420d045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:42:18.719866 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3455a9f6-3251-4db0-baba-efa0fc5c005c tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] 10.222.0.35 "GET /compute/v2.1/servers/2819cfc8-545d-42f5-b185-b6085e51302d" status: 200 len: 1471 microversion: 2.1 time: 0.164886 Jun 10 18:42:18.720486 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3585/7123] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:42:18 2022] GET /compute/v2.1/servers/2819cfc8-545d-42f5-b185-b6085e51302d => generated 1471 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:42:19.736634 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b0e773ef-4f46-41d3-a9e2-8a4e2c816125 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:42:19.737221 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b0e773ef-4f46-41d3-a9e2-8a4e2c816125 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] [instance: 2819cfc8-545d-42f5-b185-b6085e51302d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:42:19.744844 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b0e773ef-4f46-41d3-a9e2-8a4e2c816125 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:19.745288 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b0e773ef-4f46-41d3-a9e2-8a4e2c816125 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:19.746047 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b0e773ef-4f46-41d3-a9e2-8a4e2c816125 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:19.746481 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b0e773ef-4f46-41d3-a9e2-8a4e2c816125 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:19.887340 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b0e773ef-4f46-41d3-a9e2-8a4e2c816125 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e94bc36b74ab7a3928e598cc18ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb190411ca74bfcb764a92e9420d045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:42:19.894964 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b0e773ef-4f46-41d3-a9e2-8a4e2c816125 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] 10.222.0.35 "GET /compute/v2.1/servers/2819cfc8-545d-42f5-b185-b6085e51302d" status: 200 len: 1643 microversion: 2.1 time: 0.162327 Jun 10 18:42:19.895552 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3539/7124] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:42:19 2022] GET /compute/v2.1/servers/2819cfc8-545d-42f5-b185-b6085e51302d => generated 1643 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:42:19.912564 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-04fd388c-5c12-4e86-9f61-d8e9db474f3d tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:42:19.913199 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-04fd388c-5c12-4e86-9f61-d8e9db474f3d tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] [instance: 2819cfc8-545d-42f5-b185-b6085e51302d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:42:19.920097 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-04fd388c-5c12-4e86-9f61-d8e9db474f3d tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:19.920603 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-04fd388c-5c12-4e86-9f61-d8e9db474f3d tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:19.921391 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-04fd388c-5c12-4e86-9f61-d8e9db474f3d tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:19.921849 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-04fd388c-5c12-4e86-9f61-d8e9db474f3d tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:20.062802 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-04fd388c-5c12-4e86-9f61-d8e9db474f3d tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e94bc36b74ab7a3928e598cc18ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb190411ca74bfcb764a92e9420d045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:42:20.070313 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-04fd388c-5c12-4e86-9f61-d8e9db474f3d tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] 10.222.0.35 "GET /compute/v2.1/servers/2819cfc8-545d-42f5-b185-b6085e51302d" status: 200 len: 1643 microversion: 2.1 time: 0.162319 Jun 10 18:42:20.070924 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3586/7125] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:42:19 2022] GET /compute/v2.1/servers/2819cfc8-545d-42f5-b185-b6085e51302d => generated 1643 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:42:20.086096 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-676a7853-64b7-458c-9ab7-313c4a478e66 tempest-TestSecurityGroupsBasicOps-177791426 tempest-TestSecurityGroupsBasicOps-177791426-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:42:20.086711 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-676a7853-64b7-458c-9ab7-313c4a478e66 tempest-TestSecurityGroupsBasicOps-177791426 tempest-TestSecurityGroupsBasicOps-177791426-project-admin] [instance: 2819cfc8-545d-42f5-b185-b6085e51302d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:42:20.092851 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-676a7853-64b7-458c-9ab7-313c4a478e66 tempest-TestSecurityGroupsBasicOps-177791426 tempest-TestSecurityGroupsBasicOps-177791426-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:20.093305 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-676a7853-64b7-458c-9ab7-313c4a478e66 tempest-TestSecurityGroupsBasicOps-177791426 tempest-TestSecurityGroupsBasicOps-177791426-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:20.094069 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-676a7853-64b7-458c-9ab7-313c4a478e66 tempest-TestSecurityGroupsBasicOps-177791426 tempest-TestSecurityGroupsBasicOps-177791426-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:20.094512 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-676a7853-64b7-458c-9ab7-313c4a478e66 tempest-TestSecurityGroupsBasicOps-177791426 tempest-TestSecurityGroupsBasicOps-177791426-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:20.411318 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-676a7853-64b7-458c-9ab7-313c4a478e66 tempest-TestSecurityGroupsBasicOps-177791426 tempest-TestSecurityGroupsBasicOps-177791426-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/2819cfc8-545d-42f5-b185-b6085e51302d" status: 200 len: 1794 microversion: 2.1 time: 0.329273 Jun 10 18:42:20.411894 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3540/7126] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:42:20 2022] GET /compute/v2.1/servers/2819cfc8-545d-42f5-b185-b6085e51302d => generated 1794 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:42:22.248779 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-0aa5d68c-4d42-49d4-bcfe-76121840d33f req-b57fb212-217b-4533-a96c-9c4c3529cce4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2819cfc8-545d-42f5-b185-b6085e51302d", "tag": "65f36690-4220-4f18-87d5-cfbdfc67d6c3"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:42:22.258841 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-0aa5d68c-4d42-49d4-bcfe-76121840d33f req-b57fb212-217b-4533-a96c-9c4c3529cce4 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:42:22.259448 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-0aa5d68c-4d42-49d4-bcfe-76121840d33f req-b57fb212-217b-4533-a96c-9c4c3529cce4 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:42:22.272155 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-0aa5d68c-4d42-49d4-bcfe-76121840d33f req-b57fb212-217b-4533-a96c-9c4c3529cce4 service nova] Creating event network-changed:65f36690-4220-4f18-87d5-cfbdfc67d6c3 for instance 2819cfc8-545d-42f5-b185-b6085e51302d on chh2-master-2 Jun 10 18:42:22.281921 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-0aa5d68c-4d42-49d4-bcfe-76121840d33f req-b57fb212-217b-4533-a96c-9c4c3529cce4 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032537 Jun 10 18:42:22.281921 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3587/7127] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:43:37.473994 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=23 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:43:37.474814 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=43 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:43:37.479618 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ac207cfe-7d0f-493e-8acc-056ee5dc00d9 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1190229449", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "3cd7b5ab-621d-42b3-a6e0-34e8ab604f73"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1067296451", "security_groups": []}, "os:scheduler_hints": {"different_host": ["2819cfc8-545d-42f5-b185-b6085e51302d"]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:43:37.762961 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-ac207cfe-7d0f-493e-8acc-056ee5dc00d9 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] validate_networks() for [('3cd7b5ab-621d-42b3-a6e0-34e8ab604f73', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:43:38.204410 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-ac207cfe-7d0f-493e-8acc-056ee5dc00d9 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:43:38.204847 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-ac207cfe-7d0f-493e-8acc-056ee5dc00d9 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:43:38.205416 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-ac207cfe-7d0f-493e-8acc-056ee5dc00d9 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:43:38.205836 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-ac207cfe-7d0f-493e-8acc-056ee5dc00d9 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:43:38.206253 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-ac207cfe-7d0f-493e-8acc-056ee5dc00d9 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:43:38.216729 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ac207cfe-7d0f-493e-8acc-056ee5dc00d9 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:38.218052 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ac207cfe-7d0f-493e-8acc-056ee5dc00d9 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:38.220864 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ac207cfe-7d0f-493e-8acc-056ee5dc00d9 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:38.220864 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ac207cfe-7d0f-493e-8acc-056ee5dc00d9 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:38.239461 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-ac207cfe-7d0f-493e-8acc-056ee5dc00d9 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Getting quotas for project ddb190411ca74bfcb764a92e9420d045. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:43:38.245821 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-ac207cfe-7d0f-493e-8acc-056ee5dc00d9 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Getting quotas for user 0a5e94bc36b74ab7a3928e598cc18ccb and project ddb190411ca74bfcb764a92e9420d045. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:43:38.260220 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ac207cfe-7d0f-493e-8acc-056ee5dc00d9 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:43:38.266808 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ac207cfe-7d0f-493e-8acc-056ee5dc00d9 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] [instance: 6cd44fb5-1aed-46c1-b60e-05063eb2f316] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:43:38.366922 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ac207cfe-7d0f-493e-8acc-056ee5dc00d9 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.894867 Jun 10 18:43:38.367790 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3541/7128] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:43:37 2022] POST /compute/v2.1/servers => generated 361 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:43:38.378976 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=19 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:43:38.381127 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=32 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:43:38.386739 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-09dcd8fa-40fb-4b9a-bb42-e0f8a2e6ed2f tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:43:38.387831 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-09dcd8fa-40fb-4b9a-bb42-e0f8a2e6ed2f tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] [instance: 6cd44fb5-1aed-46c1-b60e-05063eb2f316] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:43:38.599901 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-09dcd8fa-40fb-4b9a-bb42-e0f8a2e6ed2f tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e94bc36b74ab7a3928e598cc18ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb190411ca74bfcb764a92e9420d045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:43:38.620486 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-09dcd8fa-40fb-4b9a-bb42-e0f8a2e6ed2f tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] 10.222.0.35 "GET /compute/v2.1/servers/6cd44fb5-1aed-46c1-b60e-05063eb2f316" status: 200 len: 1242 microversion: 2.1 time: 0.245990 Jun 10 18:43:38.630136 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3588/7129] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:43:38 2022] GET /compute/v2.1/servers/6cd44fb5-1aed-46c1-b60e-05063eb2f316 => generated 1242 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:43:39.638603 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e7251694-0913-4174-b571-22276026e5c5 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:43:39.639245 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e7251694-0913-4174-b571-22276026e5c5 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] [instance: 6cd44fb5-1aed-46c1-b60e-05063eb2f316] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:43:39.646261 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e7251694-0913-4174-b571-22276026e5c5 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:39.653239 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e7251694-0913-4174-b571-22276026e5c5 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:39.653239 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e7251694-0913-4174-b571-22276026e5c5 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:39.653239 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e7251694-0913-4174-b571-22276026e5c5 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:39.714609 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e7251694-0913-4174-b571-22276026e5c5 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e94bc36b74ab7a3928e598cc18ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb190411ca74bfcb764a92e9420d045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:43:39.722946 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e7251694-0913-4174-b571-22276026e5c5 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] 10.222.0.35 "GET /compute/v2.1/servers/6cd44fb5-1aed-46c1-b60e-05063eb2f316" status: 200 len: 1246 microversion: 2.1 time: 0.089283 Jun 10 18:43:39.723539 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3542/7130] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:43:39 2022] GET /compute/v2.1/servers/6cd44fb5-1aed-46c1-b60e-05063eb2f316 => generated 1246 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:43:40.744364 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-4f8d06f1-4c68-4acb-b8e2-7dabe17d1d11 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:43:40.746803 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-4f8d06f1-4c68-4acb-b8e2-7dabe17d1d11 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] [instance: 6cd44fb5-1aed-46c1-b60e-05063eb2f316] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:43:40.759245 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4f8d06f1-4c68-4acb-b8e2-7dabe17d1d11 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:40.760078 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4f8d06f1-4c68-4acb-b8e2-7dabe17d1d11 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:40.761247 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4f8d06f1-4c68-4acb-b8e2-7dabe17d1d11 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:40.761873 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-4f8d06f1-4c68-4acb-b8e2-7dabe17d1d11 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:40.854706 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-4f8d06f1-4c68-4acb-b8e2-7dabe17d1d11 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e94bc36b74ab7a3928e598cc18ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb190411ca74bfcb764a92e9420d045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:43:40.862546 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-4f8d06f1-4c68-4acb-b8e2-7dabe17d1d11 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] 10.222.0.35 "GET /compute/v2.1/servers/6cd44fb5-1aed-46c1-b60e-05063eb2f316" status: 200 len: 1312 microversion: 2.1 time: 0.125237 Jun 10 18:43:40.863125 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3589/7131] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:43:40 2022] GET /compute/v2.1/servers/6cd44fb5-1aed-46c1-b60e-05063eb2f316 => generated 1312 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:43:41.886415 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2ab3c3e5-7e99-4e33-a6bb-119ef56f46c7 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:43:41.887166 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2ab3c3e5-7e99-4e33-a6bb-119ef56f46c7 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] [instance: 6cd44fb5-1aed-46c1-b60e-05063eb2f316] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:43:41.895144 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2ab3c3e5-7e99-4e33-a6bb-119ef56f46c7 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:41.895871 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2ab3c3e5-7e99-4e33-a6bb-119ef56f46c7 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:41.896697 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2ab3c3e5-7e99-4e33-a6bb-119ef56f46c7 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:41.897140 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2ab3c3e5-7e99-4e33-a6bb-119ef56f46c7 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:41.991465 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2ab3c3e5-7e99-4e33-a6bb-119ef56f46c7 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e94bc36b74ab7a3928e598cc18ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb190411ca74bfcb764a92e9420d045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:43:41.993833 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2ab3c3e5-7e99-4e33-a6bb-119ef56f46c7 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] 10.222.0.35 "GET /compute/v2.1/servers/6cd44fb5-1aed-46c1-b60e-05063eb2f316" status: 200 len: 1300 microversion: 2.1 time: 0.111641 Jun 10 18:43:41.994270 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3543/7132] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:43:41 2022] GET /compute/v2.1/servers/6cd44fb5-1aed-46c1-b60e-05063eb2f316 => generated 1300 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:43:42.056125 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-fc20577f-78ff-40e3-a623-022b5c44aba8 req-c009256b-0339-4899-98b1-7138bda35785 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cd44fb5-1aed-46c1-b60e-05063eb2f316", "tag": "77e33f33-e81c-4b47-a667-32ac65e041fa"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:43:42.066336 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-fc20577f-78ff-40e3-a623-022b5c44aba8 req-c009256b-0339-4899-98b1-7138bda35785 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:42.071030 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-fc20577f-78ff-40e3-a623-022b5c44aba8 req-c009256b-0339-4899-98b1-7138bda35785 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:42.078853 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-fc20577f-78ff-40e3-a623-022b5c44aba8 req-c009256b-0339-4899-98b1-7138bda35785 service nova] Creating event network-changed:77e33f33-e81c-4b47-a667-32ac65e041fa for instance 6cd44fb5-1aed-46c1-b60e-05063eb2f316 on chh1-master-2 Jun 10 18:43:42.084599 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-fc20577f-78ff-40e3-a623-022b5c44aba8 req-c009256b-0339-4899-98b1-7138bda35785 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032199 Jun 10 18:43:42.085258 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3590/7133] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:43:43.010794 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a13ce6ac-babf-44d4-bd3e-f567d31a9c3a tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:43:43.011471 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a13ce6ac-babf-44d4-bd3e-f567d31a9c3a tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] [instance: 6cd44fb5-1aed-46c1-b60e-05063eb2f316] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:43:43.018351 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a13ce6ac-babf-44d4-bd3e-f567d31a9c3a tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:43.023981 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a13ce6ac-babf-44d4-bd3e-f567d31a9c3a tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:43.023981 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a13ce6ac-babf-44d4-bd3e-f567d31a9c3a tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:43.023981 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a13ce6ac-babf-44d4-bd3e-f567d31a9c3a tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:43.103581 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a13ce6ac-babf-44d4-bd3e-f567d31a9c3a tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e94bc36b74ab7a3928e598cc18ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb190411ca74bfcb764a92e9420d045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:43:43.111172 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a13ce6ac-babf-44d4-bd3e-f567d31a9c3a tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] 10.222.0.35 "GET /compute/v2.1/servers/6cd44fb5-1aed-46c1-b60e-05063eb2f316" status: 200 len: 1300 microversion: 2.1 time: 0.104238 Jun 10 18:43:43.111749 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3544/7134] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:43:43 2022] GET /compute/v2.1/servers/6cd44fb5-1aed-46c1-b60e-05063eb2f316 => generated 1300 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:43:44.130233 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-9ca60293-82fc-42e1-be38-4f9556d1b8a3 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:43:44.131554 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-9ca60293-82fc-42e1-be38-4f9556d1b8a3 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] [instance: 6cd44fb5-1aed-46c1-b60e-05063eb2f316] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:43:44.138546 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9ca60293-82fc-42e1-be38-4f9556d1b8a3 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:44.139048 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9ca60293-82fc-42e1-be38-4f9556d1b8a3 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:44.139840 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9ca60293-82fc-42e1-be38-4f9556d1b8a3 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:44.140298 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-9ca60293-82fc-42e1-be38-4f9556d1b8a3 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:44.222312 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-9ca60293-82fc-42e1-be38-4f9556d1b8a3 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e94bc36b74ab7a3928e598cc18ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb190411ca74bfcb764a92e9420d045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:43:44.230813 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-9ca60293-82fc-42e1-be38-4f9556d1b8a3 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] 10.222.0.35 "GET /compute/v2.1/servers/6cd44fb5-1aed-46c1-b60e-05063eb2f316" status: 200 len: 1300 microversion: 2.1 time: 0.105653 Jun 10 18:43:44.231407 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3591/7135] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:43:44 2022] GET /compute/v2.1/servers/6cd44fb5-1aed-46c1-b60e-05063eb2f316 => generated 1300 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:43:45.247118 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2c5d785a-d35d-4f43-9c7a-9598ac5491c7 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:43:45.247757 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2c5d785a-d35d-4f43-9c7a-9598ac5491c7 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] [instance: 6cd44fb5-1aed-46c1-b60e-05063eb2f316] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:43:45.254686 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c5d785a-d35d-4f43-9c7a-9598ac5491c7 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:45.255140 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c5d785a-d35d-4f43-9c7a-9598ac5491c7 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:45.255935 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c5d785a-d35d-4f43-9c7a-9598ac5491c7 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:45.256418 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c5d785a-d35d-4f43-9c7a-9598ac5491c7 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:45.342695 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2c5d785a-d35d-4f43-9c7a-9598ac5491c7 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e94bc36b74ab7a3928e598cc18ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb190411ca74bfcb764a92e9420d045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:43:45.350417 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2c5d785a-d35d-4f43-9c7a-9598ac5491c7 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] 10.222.0.35 "GET /compute/v2.1/servers/6cd44fb5-1aed-46c1-b60e-05063eb2f316" status: 200 len: 1300 microversion: 2.1 time: 0.107305 Jun 10 18:43:45.350991 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3545/7136] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:43:45 2022] GET /compute/v2.1/servers/6cd44fb5-1aed-46c1-b60e-05063eb2f316 => generated 1300 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:43:46.221234 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-580c6838-3f3a-46ef-9f42-d7a3466e0e13 req-0c0fb1d2-6079-419f-b9fb-fb1ca432519f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cd44fb5-1aed-46c1-b60e-05063eb2f316", "name": "network-vif-plugged", "status": "completed", "tag": "77e33f33-e81c-4b47-a667-32ac65e041fa"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:43:46.230848 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-580c6838-3f3a-46ef-9f42-d7a3466e0e13 req-0c0fb1d2-6079-419f-b9fb-fb1ca432519f service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:46.231523 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-580c6838-3f3a-46ef-9f42-d7a3466e0e13 req-0c0fb1d2-6079-419f-b9fb-fb1ca432519f service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:46.242156 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-580c6838-3f3a-46ef-9f42-d7a3466e0e13 req-0c0fb1d2-6079-419f-b9fb-fb1ca432519f service nova] Creating event network-vif-plugged:77e33f33-e81c-4b47-a667-32ac65e041fa for instance 6cd44fb5-1aed-46c1-b60e-05063eb2f316 on chh1-master-2 Jun 10 18:43:46.248189 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-580c6838-3f3a-46ef-9f42-d7a3466e0e13 req-0c0fb1d2-6079-419f-b9fb-fb1ca432519f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030998 Jun 10 18:43:46.248989 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3592/7137] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:43:46.367241 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6139c699-630b-4ec0-8ba7-901bd8288a9b tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:43:46.367856 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6139c699-630b-4ec0-8ba7-901bd8288a9b tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] [instance: 6cd44fb5-1aed-46c1-b60e-05063eb2f316] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:43:46.374901 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6139c699-630b-4ec0-8ba7-901bd8288a9b tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:46.375416 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6139c699-630b-4ec0-8ba7-901bd8288a9b tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:46.376182 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6139c699-630b-4ec0-8ba7-901bd8288a9b tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:46.376664 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6139c699-630b-4ec0-8ba7-901bd8288a9b tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:46.457761 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6139c699-630b-4ec0-8ba7-901bd8288a9b tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e94bc36b74ab7a3928e598cc18ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb190411ca74bfcb764a92e9420d045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:43:46.465887 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6139c699-630b-4ec0-8ba7-901bd8288a9b tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] 10.222.0.35 "GET /compute/v2.1/servers/6cd44fb5-1aed-46c1-b60e-05063eb2f316" status: 200 len: 1300 microversion: 2.1 time: 0.102602 Jun 10 18:43:46.466786 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3546/7138] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:43:46 2022] GET /compute/v2.1/servers/6cd44fb5-1aed-46c1-b60e-05063eb2f316 => generated 1300 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:43:47.483911 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-810c7b5d-f2ad-4599-82f9-fea0ff07cfdd tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:43:47.484659 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-810c7b5d-f2ad-4599-82f9-fea0ff07cfdd tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] [instance: 6cd44fb5-1aed-46c1-b60e-05063eb2f316] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:43:47.491675 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-810c7b5d-f2ad-4599-82f9-fea0ff07cfdd tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:47.492136 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-810c7b5d-f2ad-4599-82f9-fea0ff07cfdd tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:47.492963 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-810c7b5d-f2ad-4599-82f9-fea0ff07cfdd tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:47.494030 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-810c7b5d-f2ad-4599-82f9-fea0ff07cfdd tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:47.578854 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-810c7b5d-f2ad-4599-82f9-fea0ff07cfdd tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e94bc36b74ab7a3928e598cc18ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb190411ca74bfcb764a92e9420d045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:43:47.587227 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-810c7b5d-f2ad-4599-82f9-fea0ff07cfdd tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] 10.222.0.35 "GET /compute/v2.1/servers/6cd44fb5-1aed-46c1-b60e-05063eb2f316" status: 200 len: 1472 microversion: 2.1 time: 0.107574 Jun 10 18:43:47.587820 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3593/7139] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:43:47 2022] GET /compute/v2.1/servers/6cd44fb5-1aed-46c1-b60e-05063eb2f316 => generated 1472 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:43:47.603716 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4fd11f98-27bc-48f1-99dd-c155dd2ab36f tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:43:47.604409 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4fd11f98-27bc-48f1-99dd-c155dd2ab36f tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] [instance: 6cd44fb5-1aed-46c1-b60e-05063eb2f316] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:43:47.611295 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4fd11f98-27bc-48f1-99dd-c155dd2ab36f tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:47.611747 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4fd11f98-27bc-48f1-99dd-c155dd2ab36f tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:47.612569 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4fd11f98-27bc-48f1-99dd-c155dd2ab36f tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:47.613010 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4fd11f98-27bc-48f1-99dd-c155dd2ab36f tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:47.694914 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4fd11f98-27bc-48f1-99dd-c155dd2ab36f tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e94bc36b74ab7a3928e598cc18ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb190411ca74bfcb764a92e9420d045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:43:47.702659 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4fd11f98-27bc-48f1-99dd-c155dd2ab36f tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] 10.222.0.35 "GET /compute/v2.1/servers/6cd44fb5-1aed-46c1-b60e-05063eb2f316" status: 200 len: 1472 microversion: 2.1 time: 0.103287 Jun 10 18:43:47.703231 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3547/7140] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:43:47 2022] GET /compute/v2.1/servers/6cd44fb5-1aed-46c1-b60e-05063eb2f316 => generated 1472 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:43:47.718047 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3a938079-9d17-4c7b-a7d4-42f39b38acb3 tempest-TestSecurityGroupsBasicOps-177791426 tempest-TestSecurityGroupsBasicOps-177791426-project-admin] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:43:47.718677 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3a938079-9d17-4c7b-a7d4-42f39b38acb3 tempest-TestSecurityGroupsBasicOps-177791426 tempest-TestSecurityGroupsBasicOps-177791426-project-admin] [instance: 6cd44fb5-1aed-46c1-b60e-05063eb2f316] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:43:47.725190 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3a938079-9d17-4c7b-a7d4-42f39b38acb3 tempest-TestSecurityGroupsBasicOps-177791426 tempest-TestSecurityGroupsBasicOps-177791426-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:47.725653 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3a938079-9d17-4c7b-a7d4-42f39b38acb3 tempest-TestSecurityGroupsBasicOps-177791426 tempest-TestSecurityGroupsBasicOps-177791426-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:47.726445 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3a938079-9d17-4c7b-a7d4-42f39b38acb3 tempest-TestSecurityGroupsBasicOps-177791426 tempest-TestSecurityGroupsBasicOps-177791426-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:47.726894 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3a938079-9d17-4c7b-a7d4-42f39b38acb3 tempest-TestSecurityGroupsBasicOps-177791426 tempest-TestSecurityGroupsBasicOps-177791426-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:47.812252 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3a938079-9d17-4c7b-a7d4-42f39b38acb3 tempest-TestSecurityGroupsBasicOps-177791426 tempest-TestSecurityGroupsBasicOps-177791426-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/6cd44fb5-1aed-46c1-b60e-05063eb2f316" status: 200 len: 1623 microversion: 2.1 time: 0.097862 Jun 10 18:43:47.812851 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3594/7141] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:43:47 2022] GET /compute/v2.1/servers/6cd44fb5-1aed-46c1-b60e-05063eb2f316 => generated 1623 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:43:47.827458 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7df6fe22-d983-4ffd-9916-553e6fb96d9d tempest-TestSecurityGroupsBasicOps-177791426 tempest-TestSecurityGroupsBasicOps-177791426-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:43:47.828065 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7df6fe22-d983-4ffd-9916-553e6fb96d9d tempest-TestSecurityGroupsBasicOps-177791426 tempest-TestSecurityGroupsBasicOps-177791426-project-admin] [instance: 2819cfc8-545d-42f5-b185-b6085e51302d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:43:47.834042 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7df6fe22-d983-4ffd-9916-553e6fb96d9d tempest-TestSecurityGroupsBasicOps-177791426 tempest-TestSecurityGroupsBasicOps-177791426-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:47.834489 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7df6fe22-d983-4ffd-9916-553e6fb96d9d tempest-TestSecurityGroupsBasicOps-177791426 tempest-TestSecurityGroupsBasicOps-177791426-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:47.835243 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7df6fe22-d983-4ffd-9916-553e6fb96d9d tempest-TestSecurityGroupsBasicOps-177791426 tempest-TestSecurityGroupsBasicOps-177791426-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:47.835679 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7df6fe22-d983-4ffd-9916-553e6fb96d9d tempest-TestSecurityGroupsBasicOps-177791426 tempest-TestSecurityGroupsBasicOps-177791426-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:47.971168 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7df6fe22-d983-4ffd-9916-553e6fb96d9d tempest-TestSecurityGroupsBasicOps-177791426 tempest-TestSecurityGroupsBasicOps-177791426-project-admin] 10.222.0.35 "GET /compute/v2.1/servers/2819cfc8-545d-42f5-b185-b6085e51302d" status: 200 len: 1913 microversion: 2.1 time: 0.147272 Jun 10 18:43:47.971741 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3548/7142] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:43:47 2022] GET /compute/v2.1/servers/2819cfc8-545d-42f5-b185-b6085e51302d => generated 1913 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:43:48.029197 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-3ef6a097-50f2-44cc-907d-f45e8036712e tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:43:48.029711 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3ef6a097-50f2-44cc-907d-f45e8036712e tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] [instance: 6cd44fb5-1aed-46c1-b60e-05063eb2f316] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:43:48.035871 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3ef6a097-50f2-44cc-907d-f45e8036712e tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:48.036376 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3ef6a097-50f2-44cc-907d-f45e8036712e tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:48.037174 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3ef6a097-50f2-44cc-907d-f45e8036712e tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:48.037640 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-3ef6a097-50f2-44cc-907d-f45e8036712e tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:48.062898 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-3ef6a097-50f2-44cc-907d-f45e8036712e tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] [instance: 6cd44fb5-1aed-46c1-b60e-05063eb2f316] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:43:48.354846 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-3ef6a097-50f2-44cc-907d-f45e8036712e tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] 10.222.0.35 "DELETE /compute/v2.1/servers/6cd44fb5-1aed-46c1-b60e-05063eb2f316" status: 204 len: 0 microversion: 2.1 time: 0.330087 Jun 10 18:43:48.355450 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3595/7143] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:43:48 2022] DELETE /compute/v2.1/servers/6cd44fb5-1aed-46c1-b60e-05063eb2f316 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:43:48.363704 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d980dcaf-e986-4409-9ccd-52a7ff9012b3 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:43:48.364422 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d980dcaf-e986-4409-9ccd-52a7ff9012b3 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] [instance: 6cd44fb5-1aed-46c1-b60e-05063eb2f316] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:43:48.366381 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:43:48.367180 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=6 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:43:48.372561 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d980dcaf-e986-4409-9ccd-52a7ff9012b3 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:48.373017 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d980dcaf-e986-4409-9ccd-52a7ff9012b3 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:48.373779 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d980dcaf-e986-4409-9ccd-52a7ff9012b3 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:48.374214 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d980dcaf-e986-4409-9ccd-52a7ff9012b3 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:48.458627 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d980dcaf-e986-4409-9ccd-52a7ff9012b3 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e94bc36b74ab7a3928e598cc18ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb190411ca74bfcb764a92e9420d045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:43:48.466478 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d980dcaf-e986-4409-9ccd-52a7ff9012b3 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] 10.222.0.35 "GET /compute/v2.1/servers/6cd44fb5-1aed-46c1-b60e-05063eb2f316" status: 200 len: 1478 microversion: 2.1 time: 0.106529 Jun 10 18:43:48.467055 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3549/7144] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:43:48 2022] GET /compute/v2.1/servers/6cd44fb5-1aed-46c1-b60e-05063eb2f316 => generated 1478 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:43:49.485194 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2e979496-98cf-4edc-967b-2a9825cf88aa tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:43:49.485910 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-2e979496-98cf-4edc-967b-2a9825cf88aa tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] [instance: 6cd44fb5-1aed-46c1-b60e-05063eb2f316] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:43:49.488714 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:43:49.493563 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2e979496-98cf-4edc-967b-2a9825cf88aa tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:49.494022 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2e979496-98cf-4edc-967b-2a9825cf88aa tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:49.494828 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2e979496-98cf-4edc-967b-2a9825cf88aa tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:49.495278 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-2e979496-98cf-4edc-967b-2a9825cf88aa tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:49.577984 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-2e979496-98cf-4edc-967b-2a9825cf88aa tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e94bc36b74ab7a3928e598cc18ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb190411ca74bfcb764a92e9420d045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:43:49.585583 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2e979496-98cf-4edc-967b-2a9825cf88aa tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] 10.222.0.35 "GET /compute/v2.1/servers/6cd44fb5-1aed-46c1-b60e-05063eb2f316" status: 200 len: 1478 microversion: 2.1 time: 0.104711 Jun 10 18:43:49.586147 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3596/7145] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:43:49 2022] GET /compute/v2.1/servers/6cd44fb5-1aed-46c1-b60e-05063eb2f316 => generated 1478 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:43:50.235773 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-f5149716-190b-4896-a90b-ffdc747382f9 req-69d1969d-c94a-4330-9166-74ccc19409f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cd44fb5-1aed-46c1-b60e-05063eb2f316", "name": "network-vif-deleted", "tag": "77e33f33-e81c-4b47-a667-32ac65e041fa"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:43:50.245485 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-f5149716-190b-4896-a90b-ffdc747382f9 req-69d1969d-c94a-4330-9166-74ccc19409f2 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:50.247834 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-f5149716-190b-4896-a90b-ffdc747382f9 req-69d1969d-c94a-4330-9166-74ccc19409f2 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:50.257383 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-f5149716-190b-4896-a90b-ffdc747382f9 req-69d1969d-c94a-4330-9166-74ccc19409f2 service nova] Creating event network-vif-deleted:77e33f33-e81c-4b47-a667-32ac65e041fa for instance 6cd44fb5-1aed-46c1-b60e-05063eb2f316 on chh1-master-2 Jun 10 18:43:50.263333 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-f5149716-190b-4896-a90b-ffdc747382f9 req-69d1969d-c94a-4330-9166-74ccc19409f2 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031220 Jun 10 18:43:50.263951 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3550/7146] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:43:50.603557 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6dfd3995-8afd-4505-99b0-ffa70a46215d tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:43:50.604228 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6dfd3995-8afd-4505-99b0-ffa70a46215d tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] [instance: 6cd44fb5-1aed-46c1-b60e-05063eb2f316] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:43:50.611312 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6dfd3995-8afd-4505-99b0-ffa70a46215d tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:50.613920 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6dfd3995-8afd-4505-99b0-ffa70a46215d tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:50.613920 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6dfd3995-8afd-4505-99b0-ffa70a46215d tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:50.613920 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6dfd3995-8afd-4505-99b0-ffa70a46215d tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:50.644053 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6dfd3995-8afd-4505-99b0-ffa70a46215d tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:50.644564 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6dfd3995-8afd-4505-99b0-ffa70a46215d tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:50.645041 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-6dfd3995-8afd-4505-99b0-ffa70a46215d tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lazy-loading 'fault' on Instance uuid 6cd44fb5-1aed-46c1-b60e-05063eb2f316 {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:43:50.689561 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6dfd3995-8afd-4505-99b0-ffa70a46215d tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e94bc36b74ab7a3928e598cc18ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb190411ca74bfcb764a92e9420d045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:43:50.697235 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6dfd3995-8afd-4505-99b0-ffa70a46215d tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] 10.222.0.35 "GET /compute/v2.1/servers/6cd44fb5-1aed-46c1-b60e-05063eb2f316" status: 200 len: 1332 microversion: 2.1 time: 0.098164 Jun 10 18:43:50.697991 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3597/7147] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:43:50 2022] GET /compute/v2.1/servers/6cd44fb5-1aed-46c1-b60e-05063eb2f316 => generated 1332 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:43:51.714941 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-24f971cc-116c-4bc0-9602-d76c469fb9f0 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:43:51.715568 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-24f971cc-116c-4bc0-9602-d76c469fb9f0 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] [instance: 6cd44fb5-1aed-46c1-b60e-05063eb2f316] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:43:51.721940 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-24f971cc-116c-4bc0-9602-d76c469fb9f0 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:51.722395 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-24f971cc-116c-4bc0-9602-d76c469fb9f0 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:51.723198 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-24f971cc-116c-4bc0-9602-d76c469fb9f0 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:51.723646 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-24f971cc-116c-4bc0-9602-d76c469fb9f0 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:51.736791 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-24f971cc-116c-4bc0-9602-d76c469fb9f0 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] HTTP exception thrown: Instance 6cd44fb5-1aed-46c1-b60e-05063eb2f316 could not be found. Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-24f971cc-116c-4bc0-9602-d76c469fb9f0 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Request method failure captured: Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/6cd44fb5-1aed-46c1-b60e-05063eb2f316 HTTP/1.1 Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5BxpyOigLMLV-MqO08xp0xzhDXJHgLvHQSTRmdpiRcP6Cx4zsbAr5eLtDUp8V5QXaWy9DQ2QCiJg2kl-tS3HN9HnDBWMenlVC3xXH_CTrT_MqIxD5FvH4P81HiWQZDm2fXAz2mNJ5IYi-jJeztTP4moBbaicvewsQBx3KlxGlAhGOM Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: ddb190411ca74bfcb764a92e9420d045 Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-872643493 Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ddb190411ca74bfcb764a92e9420d045"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ddb190411ca74bfcb764a92e9420d045"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ddb190411ca74bfcb764a92e9420d045"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ddb190411ca74bfcb764a92e9420d045", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-TestSecurityGroupsBasicOps-872643493 Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: ddb190411ca74bfcb764a92e9420d045 Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-872643493 Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-TestSecurityGroupsBasicOps-872643493-project Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 0a5e94bc36b74ab7a3928e598cc18ccb Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-TestSecurityGroupsBasicOps-872643493-project Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 6cd44fb5-1aed-46c1-b60e-05063eb2f316 could not be found. Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '6cd44fb5-1aed-46c1-b60e-05063eb2f316'} Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cd44fb5-1aed-46c1-b60e-05063eb2f316 could not be found. Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cd44fb5-1aed-46c1-b60e-05063eb2f316 could not be found. Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:43:51.738370 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:43:51.742778 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:43:51.742778 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:43:51.742778 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:43:51.742778 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:43:51.742778 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:43:51.742778 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cd44fb5-1aed-46c1-b60e-05063eb2f316 could not be found. Jun 10 18:43:51.742778 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:43:51.742778 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-24f971cc-116c-4bc0-9602-d76c469fb9f0 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Returning 404 to user: Instance 6cd44fb5-1aed-46c1-b60e-05063eb2f316 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:43:51.742778 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-24f971cc-116c-4bc0-9602-d76c469fb9f0 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] 10.222.0.35 "GET /compute/v2.1/servers/6cd44fb5-1aed-46c1-b60e-05063eb2f316" status: 404 len: 111 microversion: 2.1 time: 0.030077 Jun 10 18:43:51.742778 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3551/7148] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:43:51 2022] GET /compute/v2.1/servers/6cd44fb5-1aed-46c1-b60e-05063eb2f316 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:43:56.439261 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0c4b87a8-942b-43e8-af5a-83cd43963fca tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:43:56.440122 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0c4b87a8-942b-43e8-af5a-83cd43963fca tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] [instance: 2819cfc8-545d-42f5-b185-b6085e51302d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:43:56.441525 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-31889bf7-0d23-4dc5-b9ab-94ed048b6d18 req-84b330c1-b55b-497e-8120-2d75c91ee40e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2819cfc8-545d-42f5-b185-b6085e51302d", "tag": "65f36690-4220-4f18-87d5-cfbdfc67d6c3"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:43:56.447058 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0c4b87a8-942b-43e8-af5a-83cd43963fca tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:56.447526 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0c4b87a8-942b-43e8-af5a-83cd43963fca tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:56.448327 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0c4b87a8-942b-43e8-af5a-83cd43963fca tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:56.448955 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0c4b87a8-942b-43e8-af5a-83cd43963fca tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:56.451475 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-31889bf7-0d23-4dc5-b9ab-94ed048b6d18 req-84b330c1-b55b-497e-8120-2d75c91ee40e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:56.452159 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-31889bf7-0d23-4dc5-b9ab-94ed048b6d18 req-84b330c1-b55b-497e-8120-2d75c91ee40e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:56.464144 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-31889bf7-0d23-4dc5-b9ab-94ed048b6d18 req-84b330c1-b55b-497e-8120-2d75c91ee40e service nova] Creating event network-changed:65f36690-4220-4f18-87d5-cfbdfc67d6c3 for instance 2819cfc8-545d-42f5-b185-b6085e51302d on chh2-master-2 Jun 10 18:43:56.469476 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-31889bf7-0d23-4dc5-b9ab-94ed048b6d18 req-84b330c1-b55b-497e-8120-2d75c91ee40e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031905 Jun 10 18:43:56.470460 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3552/7149] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:43:56.479453 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0c4b87a8-942b-43e8-af5a-83cd43963fca tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] [instance: 2819cfc8-545d-42f5-b185-b6085e51302d] Going to try to terminate instance {{(pid=126594) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:43:56.793777 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0c4b87a8-942b-43e8-af5a-83cd43963fca tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] 10.222.0.35 "DELETE /compute/v2.1/servers/2819cfc8-545d-42f5-b185-b6085e51302d" status: 204 len: 0 microversion: 2.1 time: 0.358561 Jun 10 18:43:56.794388 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3598/7150] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:43:56 2022] DELETE /compute/v2.1/servers/2819cfc8-545d-42f5-b185-b6085e51302d => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:43:56.804883 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-18fb81f7-b729-485f-b4d2-1d8e052e4e3d tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:43:56.804883 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-18fb81f7-b729-485f-b4d2-1d8e052e4e3d tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] [instance: 2819cfc8-545d-42f5-b185-b6085e51302d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:43:56.812025 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-18fb81f7-b729-485f-b4d2-1d8e052e4e3d tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:56.812873 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-18fb81f7-b729-485f-b4d2-1d8e052e4e3d tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:56.814138 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-18fb81f7-b729-485f-b4d2-1d8e052e4e3d tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:56.814807 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-18fb81f7-b729-485f-b4d2-1d8e052e4e3d tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:56.968967 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-18fb81f7-b729-485f-b4d2-1d8e052e4e3d tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e94bc36b74ab7a3928e598cc18ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb190411ca74bfcb764a92e9420d045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:43:56.976902 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-18fb81f7-b729-485f-b4d2-1d8e052e4e3d tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] 10.222.0.35 "GET /compute/v2.1/servers/2819cfc8-545d-42f5-b185-b6085e51302d" status: 200 len: 1768 microversion: 2.1 time: 0.177550 Jun 10 18:43:56.978185 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3553/7151] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:43:56 2022] GET /compute/v2.1/servers/2819cfc8-545d-42f5-b185-b6085e51302d => generated 1768 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:43:57.995907 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d4587b6e-dcc7-4fea-87ce-40860fa932da tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:43:57.996652 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d4587b6e-dcc7-4fea-87ce-40860fa932da tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] [instance: 2819cfc8-545d-42f5-b185-b6085e51302d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:43:58.003615 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d4587b6e-dcc7-4fea-87ce-40860fa932da tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:58.004087 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d4587b6e-dcc7-4fea-87ce-40860fa932da tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:58.004885 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d4587b6e-dcc7-4fea-87ce-40860fa932da tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:58.005334 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d4587b6e-dcc7-4fea-87ce-40860fa932da tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:58.152089 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d4587b6e-dcc7-4fea-87ce-40860fa932da tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e94bc36b74ab7a3928e598cc18ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb190411ca74bfcb764a92e9420d045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:43:58.159772 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d4587b6e-dcc7-4fea-87ce-40860fa932da tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] 10.222.0.35 "GET /compute/v2.1/servers/2819cfc8-545d-42f5-b185-b6085e51302d" status: 200 len: 1768 microversion: 2.1 time: 0.168835 Jun 10 18:43:58.160362 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3599/7152] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:43:57 2022] GET /compute/v2.1/servers/2819cfc8-545d-42f5-b185-b6085e51302d => generated 1768 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:43:58.825280 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-fd9c2576-7abc-4de0-b703-94c42b5a9c25 req-2e912e78-20bc-4fb8-b243-028010af585f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2819cfc8-545d-42f5-b185-b6085e51302d", "name": "network-vif-deleted", "tag": "65f36690-4220-4f18-87d5-cfbdfc67d6c3"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:43:58.834199 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-fd9c2576-7abc-4de0-b703-94c42b5a9c25 req-2e912e78-20bc-4fb8-b243-028010af585f service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:58.838404 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-fd9c2576-7abc-4de0-b703-94c42b5a9c25 req-2e912e78-20bc-4fb8-b243-028010af585f service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:58.846015 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-fd9c2576-7abc-4de0-b703-94c42b5a9c25 req-2e912e78-20bc-4fb8-b243-028010af585f service nova] Creating event network-vif-deleted:65f36690-4220-4f18-87d5-cfbdfc67d6c3 for instance 2819cfc8-545d-42f5-b185-b6085e51302d on chh2-master-2 Jun 10 18:43:58.850940 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-fd9c2576-7abc-4de0-b703-94c42b5a9c25 req-2e912e78-20bc-4fb8-b243-028010af585f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029943 Jun 10 18:43:58.851552 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3554/7153] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:43:59.176822 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-c3d7f5ca-0682-4fba-957b-f9a50faa39c1 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:43:59.178212 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-c3d7f5ca-0682-4fba-957b-f9a50faa39c1 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] [instance: 2819cfc8-545d-42f5-b185-b6085e51302d] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:43:59.186266 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c3d7f5ca-0682-4fba-957b-f9a50faa39c1 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:59.186731 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c3d7f5ca-0682-4fba-957b-f9a50faa39c1 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:59.187531 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c3d7f5ca-0682-4fba-957b-f9a50faa39c1 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:59.187983 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c3d7f5ca-0682-4fba-957b-f9a50faa39c1 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:59.221595 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c3d7f5ca-0682-4fba-957b-f9a50faa39c1 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:43:59.222058 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-c3d7f5ca-0682-4fba-957b-f9a50faa39c1 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:43:59.222530 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.objects.instance [None req-c3d7f5ca-0682-4fba-957b-f9a50faa39c1 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lazy-loading 'fault' on Instance uuid 2819cfc8-545d-42f5-b185-b6085e51302d {{(pid=126594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:43:59.265473 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-c3d7f5ca-0682-4fba-957b-f9a50faa39c1 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5e94bc36b74ab7a3928e598cc18ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb190411ca74bfcb764a92e9420d045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:43:59.273053 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-c3d7f5ca-0682-4fba-957b-f9a50faa39c1 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] 10.222.0.35 "GET /compute/v2.1/servers/2819cfc8-545d-42f5-b185-b6085e51302d" status: 200 len: 1383 microversion: 2.1 time: 0.100309 Jun 10 18:43:59.273616 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3600/7154] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:43:59 2022] GET /compute/v2.1/servers/2819cfc8-545d-42f5-b185-b6085e51302d => generated 1383 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:44:00.292147 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2eafc071-715f-4c14-977d-d5485f7378c3 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:44:00.292870 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2eafc071-715f-4c14-977d-d5485f7378c3 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] [instance: 2819cfc8-545d-42f5-b185-b6085e51302d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:44:00.299470 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2eafc071-715f-4c14-977d-d5485f7378c3 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:44:00.299919 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2eafc071-715f-4c14-977d-d5485f7378c3 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:44:00.300722 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2eafc071-715f-4c14-977d-d5485f7378c3 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:44:00.301160 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2eafc071-715f-4c14-977d-d5485f7378c3 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:44:00.315150 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-2eafc071-715f-4c14-977d-d5485f7378c3 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] HTTP exception thrown: Instance 2819cfc8-545d-42f5-b185-b6085e51302d could not be found. Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2eafc071-715f-4c14-977d-d5485f7378c3 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Request method failure captured: Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/2819cfc8-545d-42f5-b185-b6085e51302d HTTP/1.1 Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5BxpyOigLMLV-MqO08xp0xzhDXJHgLvHQSTRmdpiRcP6Cx4zsbAr5eLtDUp8V5QXaWy9DQ2QCiJg2kl-tS3HN9HnDBWMenlVC3xXH_CTrT_MqIxD5FvH4P81HiWQZDm2fXAz2mNJ5IYi-jJeztTP4moBbaicvewsQBx3KlxGlAhGOM Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: ddb190411ca74bfcb764a92e9420d045 Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-872643493 Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ddb190411ca74bfcb764a92e9420d045"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ddb190411ca74bfcb764a92e9420d045"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ddb190411ca74bfcb764a92e9420d045"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ddb190411ca74bfcb764a92e9420d045", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-TestSecurityGroupsBasicOps-872643493 Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: ddb190411ca74bfcb764a92e9420d045 Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-872643493 Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-TestSecurityGroupsBasicOps-872643493-project Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 0a5e94bc36b74ab7a3928e598cc18ccb Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-TestSecurityGroupsBasicOps-872643493-project Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 2819cfc8-545d-42f5-b185-b6085e51302d could not be found. Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '2819cfc8-545d-42f5-b185-b6085e51302d'} Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2819cfc8-545d-42f5-b185-b6085e51302d could not be found. Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2819cfc8-545d-42f5-b185-b6085e51302d could not be found. Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:44:00.316782 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:44:00.321406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:44:00.321406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:44:00.321406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:44:00.321406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:44:00.321406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:44:00.321406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2819cfc8-545d-42f5-b185-b6085e51302d could not be found. Jun 10 18:44:00.321406 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:44:00.321406 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2eafc071-715f-4c14-977d-d5485f7378c3 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Returning 404 to user: Instance 2819cfc8-545d-42f5-b185-b6085e51302d could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:44:00.321406 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2eafc071-715f-4c14-977d-d5485f7378c3 tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] 10.222.0.35 "GET /compute/v2.1/servers/2819cfc8-545d-42f5-b185-b6085e51302d" status: 404 len: 111 microversion: 2.1 time: 0.031765 Jun 10 18:44:00.321406 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3555/7155] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:44:00 2022] GET /compute/v2.1/servers/2819cfc8-545d-42f5-b185-b6085e51302d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:44:04.199548 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-2b62458a-096c-45b2-b280-ad627beb934c tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] Calling method '.version_select at 0x7f77b3a29f70>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:44:04.269765 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-2b62458a-096c-45b2-b280-ad627beb934c tempest-TestSecurityGroupsBasicOps-872643493 tempest-TestSecurityGroupsBasicOps-872643493-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1067296451" status: 202 len: 0 microversion: 2.1 time: 0.074617 Jun 10 18:44:04.270674 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3601/7156] 10.222.0.35 () {58 vars in 1277 bytes} [Fri Jun 10 18:44:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1067296451 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:44:42.781054 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b01e4805-77ee-4b5e-a7de-9c7245f94ae9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:44:42.781692 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b01e4805-77ee-4b5e-a7de-9c7245f94ae9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: d44d141b-de49-4325-a2ec-170462103055] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:44:42.783686 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:44:42.784366 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=66 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:44:42.789104 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b01e4805-77ee-4b5e-a7de-9c7245f94ae9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:44:42.789553 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b01e4805-77ee-4b5e-a7de-9c7245f94ae9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:44:42.790305 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b01e4805-77ee-4b5e-a7de-9c7245f94ae9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:44:42.790738 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b01e4805-77ee-4b5e-a7de-9c7245f94ae9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:44:42.815589 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b01e4805-77ee-4b5e-a7de-9c7245f94ae9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: d44d141b-de49-4325-a2ec-170462103055] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:44:43.091388 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b01e4805-77ee-4b5e-a7de-9c7245f94ae9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "DELETE /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055" status: 204 len: 0 microversion: 2.1 time: 0.315192 Jun 10 18:44:43.091905 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3556/7157] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:44:42 2022] DELETE /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 18:44:43.098228 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:44:43.103651 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:44:43.103651 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-20c6977f-0c3f-4f70-8b52-bf72132dc2ed tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:44:43.103651 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-20c6977f-0c3f-4f70-8b52-bf72132dc2ed tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: d44d141b-de49-4325-a2ec-170462103055] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:44:43.110205 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-20c6977f-0c3f-4f70-8b52-bf72132dc2ed tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:44:43.110672 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-20c6977f-0c3f-4f70-8b52-bf72132dc2ed tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:44:43.111460 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-20c6977f-0c3f-4f70-8b52-bf72132dc2ed tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:44:43.111892 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-20c6977f-0c3f-4f70-8b52-bf72132dc2ed tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:44:43.242032 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-20c6977f-0c3f-4f70-8b52-bf72132dc2ed tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:44:43.250692 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-20c6977f-0c3f-4f70-8b52-bf72132dc2ed tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055" status: 200 len: 1579 microversion: 2.1 time: 0.153865 Jun 10 18:44:43.250692 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3602/7158] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:44:43 2022] GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055 => generated 1579 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:44:44.268148 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-93a64200-d4ec-4587-95e0-72527cb41556 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:44:44.268875 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-93a64200-d4ec-4587-95e0-72527cb41556 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: d44d141b-de49-4325-a2ec-170462103055] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:44:44.276144 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93a64200-d4ec-4587-95e0-72527cb41556 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:44:44.276629 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93a64200-d4ec-4587-95e0-72527cb41556 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:44:44.277401 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93a64200-d4ec-4587-95e0-72527cb41556 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:44:44.277841 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93a64200-d4ec-4587-95e0-72527cb41556 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:44:44.412647 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-93a64200-d4ec-4587-95e0-72527cb41556 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:44:44.422377 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-93a64200-d4ec-4587-95e0-72527cb41556 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055" status: 200 len: 1579 microversion: 2.1 time: 0.158518 Jun 10 18:44:44.422959 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3557/7159] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:44:44 2022] GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055 => generated 1579 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:44:45.439892 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-71a8d82a-217e-4f28-a429-a6f13a0e9dd2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:44:45.440586 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-71a8d82a-217e-4f28-a429-a6f13a0e9dd2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: d44d141b-de49-4325-a2ec-170462103055] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:44:45.448287 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-71a8d82a-217e-4f28-a429-a6f13a0e9dd2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:44:45.448772 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-71a8d82a-217e-4f28-a429-a6f13a0e9dd2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:44:45.450221 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-71a8d82a-217e-4f28-a429-a6f13a0e9dd2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:44:45.450670 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-71a8d82a-217e-4f28-a429-a6f13a0e9dd2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:44:45.555384 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-960903f0-8de2-44f2-84df-3f15b4417fc8 req-cb9feb5d-5259-4c05-b49e-811dfce0b765 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d44d141b-de49-4325-a2ec-170462103055", "name": "network-vif-deleted", "tag": "2306b447-a72c-4149-97fc-6ac7a7e80f2c"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:44:45.559297 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-71a8d82a-217e-4f28-a429-a6f13a0e9dd2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:44:45.566038 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-960903f0-8de2-44f2-84df-3f15b4417fc8 req-cb9feb5d-5259-4c05-b49e-811dfce0b765 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:44:45.566583 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-960903f0-8de2-44f2-84df-3f15b4417fc8 req-cb9feb5d-5259-4c05-b49e-811dfce0b765 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:44:45.567498 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-71a8d82a-217e-4f28-a429-a6f13a0e9dd2 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055" status: 200 len: 1511 microversion: 2.1 time: 0.131819 Jun 10 18:44:45.568424 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3603/7160] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:44:45 2022] GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055 => generated 1511 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:44:45.587144 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-960903f0-8de2-44f2-84df-3f15b4417fc8 req-cb9feb5d-5259-4c05-b49e-811dfce0b765 service nova] Creating event network-vif-deleted:2306b447-a72c-4149-97fc-6ac7a7e80f2c for instance d44d141b-de49-4325-a2ec-170462103055 on chh1-master-2 Jun 10 18:44:45.592771 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-960903f0-8de2-44f2-84df-3f15b4417fc8 req-cb9feb5d-5259-4c05-b49e-811dfce0b765 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041230 Jun 10 18:44:45.593465 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3558/7161] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:44:46.585481 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-787ce9f8-b025-443f-b49a-bae7d1563ea8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:44:46.586266 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-787ce9f8-b025-443f-b49a-bae7d1563ea8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: d44d141b-de49-4325-a2ec-170462103055] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:44:46.594508 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-787ce9f8-b025-443f-b49a-bae7d1563ea8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:44:46.594983 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-787ce9f8-b025-443f-b49a-bae7d1563ea8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:44:46.595988 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-787ce9f8-b025-443f-b49a-bae7d1563ea8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:44:46.596641 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-787ce9f8-b025-443f-b49a-bae7d1563ea8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:44:46.665495 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-787ce9f8-b025-443f-b49a-bae7d1563ea8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:44:46.673548 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-787ce9f8-b025-443f-b49a-bae7d1563ea8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055" status: 200 len: 1225 microversion: 2.1 time: 0.092186 Jun 10 18:44:46.674220 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3604/7162] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:44:46 2022] GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:44:47.691562 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-53193435-d835-4241-87d2-212b5f15b508 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:44:47.692203 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-53193435-d835-4241-87d2-212b5f15b508 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: d44d141b-de49-4325-a2ec-170462103055] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:44:47.698514 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-53193435-d835-4241-87d2-212b5f15b508 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:44:47.698971 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-53193435-d835-4241-87d2-212b5f15b508 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:44:47.699846 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-53193435-d835-4241-87d2-212b5f15b508 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:44:47.700315 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-53193435-d835-4241-87d2-212b5f15b508 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:44:47.763591 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-53193435-d835-4241-87d2-212b5f15b508 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:44:47.771266 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-53193435-d835-4241-87d2-212b5f15b508 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055" status: 200 len: 1225 microversion: 2.1 time: 0.084909 Jun 10 18:44:47.771843 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3559/7163] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:44:47 2022] GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:44:48.788426 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7ccf6b2b-04e3-4004-8043-e4589dff20d5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:44:48.789060 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7ccf6b2b-04e3-4004-8043-e4589dff20d5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: d44d141b-de49-4325-a2ec-170462103055] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:44:48.798726 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ccf6b2b-04e3-4004-8043-e4589dff20d5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:44:48.799220 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ccf6b2b-04e3-4004-8043-e4589dff20d5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:44:48.800048 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ccf6b2b-04e3-4004-8043-e4589dff20d5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:44:48.800527 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7ccf6b2b-04e3-4004-8043-e4589dff20d5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:44:48.866614 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7ccf6b2b-04e3-4004-8043-e4589dff20d5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:44:48.874859 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7ccf6b2b-04e3-4004-8043-e4589dff20d5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055" status: 200 len: 1225 microversion: 2.1 time: 0.090318 Jun 10 18:44:48.878477 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3605/7164] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:44:48 2022] GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:44:49.890929 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1f26786c-869f-4fd6-8e3d-2dcd7519a892 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:44:49.891548 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1f26786c-869f-4fd6-8e3d-2dcd7519a892 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: d44d141b-de49-4325-a2ec-170462103055] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:44:49.898632 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f26786c-869f-4fd6-8e3d-2dcd7519a892 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:44:49.899106 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f26786c-869f-4fd6-8e3d-2dcd7519a892 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:44:49.899866 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f26786c-869f-4fd6-8e3d-2dcd7519a892 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:44:49.900595 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f26786c-869f-4fd6-8e3d-2dcd7519a892 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:44:49.961974 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1f26786c-869f-4fd6-8e3d-2dcd7519a892 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:44:49.972199 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1f26786c-869f-4fd6-8e3d-2dcd7519a892 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055" status: 200 len: 1225 microversion: 2.1 time: 0.085122 Jun 10 18:44:49.972849 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3560/7165] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:44:49 2022] GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:44:50.989922 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-de7e980e-c6da-4f6b-9b77-ec885c59c8ab tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:44:50.990495 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-de7e980e-c6da-4f6b-9b77-ec885c59c8ab tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: d44d141b-de49-4325-a2ec-170462103055] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:44:50.997378 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-de7e980e-c6da-4f6b-9b77-ec885c59c8ab tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:44:50.997842 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-de7e980e-c6da-4f6b-9b77-ec885c59c8ab tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:44:50.998618 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-de7e980e-c6da-4f6b-9b77-ec885c59c8ab tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:44:50.999088 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-de7e980e-c6da-4f6b-9b77-ec885c59c8ab tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:44:51.012267 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.wsgi [None req-de7e980e-c6da-4f6b-9b77-ec885c59c8ab tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] HTTP exception thrown: Instance d44d141b-de49-4325-a2ec-170462103055 could not be found. Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-de7e980e-c6da-4f6b-9b77-ec885c59c8ab tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Request method failure captured: Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: request: GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055 HTTP/1.1 Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: Accept: application/json Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: Accept-Encoding: identity Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: Connection: close Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: Content-Length: 0 Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: Content-Type: application/json Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: Host: 10.222.0.35 Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: Openstack-System-Scope: None Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: User-Agent: python-urllib3/1.26.9 Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: X-Auth-Token: gAAAAABio48lCBpBlRizgNQmj6c6iu0oXkmc5Tm-q4miwv2Pj49f2pUTZFT27dYtKGefFULH5-gcByMQrPeG1d5YVOJ_GuLGrptrh59AcDYu37Uta2nd4eDA1xNIrohvrn1bdHxnfVCnt0fGjpM3LVpc7O3my-1igIi7pJV4HqsUallplG6Y66g Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Id: None Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: X-Domain-Name: None Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: X-Identity-Status: Confirmed Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: X-Is-Admin-Project: True Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Id: default Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: X-Project-Domain-Name: Default Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: X-Project-Id: 7e9c656d484843ffb1f2de092730345b Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: X-Project-Name: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: X-Role: reader,member Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: X-Roles: reader,member Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_7e9c656d484843ffb1f2de092730345b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: X-Tenant: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Id: 7e9c656d484843ffb1f2de092730345b Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: X-Tenant-Name: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: X-User: tempest-TestVolumeBootPattern-1765437769-project Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Id: default Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: X-User-Domain-Name: Default Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: X-User-Id: b469a8f9433d422aa98d22eea9df7071 Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: X-User-Name: tempest-TestVolumeBootPattern-1765437769-project Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: method: > Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: exception: Instance d44d141b-de49-4325-a2ec-170462103055 could not be found. Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: action_args: {'id': 'd44d141b-de49-4325-a2ec-170462103055'} Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d44d141b-de49-4325-a2ec-170462103055 could not be found. Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d44d141b-de49-4325-a2ec-170462103055 could not be found. Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:44:51.013947 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:44:51.019073 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:44:51.019073 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:44:51.019073 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:44:51.019073 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:44:51.019073 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:44:51.019073 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d44d141b-de49-4325-a2ec-170462103055 could not be found. Jun 10 18:44:51.019073 chdv-master-2 devstack@n-api.service[126594]: ERROR nova.api.openstack.wsgi Jun 10 18:44:51.019073 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-de7e980e-c6da-4f6b-9b77-ec885c59c8ab tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Returning 404 to user: Instance d44d141b-de49-4325-a2ec-170462103055 could not be found. {{(pid=126594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:44:51.019073 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-de7e980e-c6da-4f6b-9b77-ec885c59c8ab tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055" status: 404 len: 111 microversion: 2.1 time: 0.029599 Jun 10 18:44:51.019073 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3606/7166] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:44:50 2022] GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:44:51.111314 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d81aff38-7cbf-4284-b15d-755af0ebf5cb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-553725676", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-905098910", "security_groups": [{"name": "tempest-secgroup-smoke-2101708141"}], "block_device_mapping_v2": [{"uuid": "8ff86118-749b-48a1-b6e2-0a48e09b96eb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b7773285-a55f-44ca-92fc-1f9b6eadbe45"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:44:51.221591 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-d81aff38-7cbf-4284-b15d-755af0ebf5cb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] validate_networks() for [('b7773285-a55f-44ca-92fc-1f9b6eadbe45', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:44:51.592776 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-d81aff38-7cbf-4284-b15d-755af0ebf5cb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:44:51.593207 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-d81aff38-7cbf-4284-b15d-755af0ebf5cb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:44:51.593688 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-d81aff38-7cbf-4284-b15d-755af0ebf5cb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:44:51.594105 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-d81aff38-7cbf-4284-b15d-755af0ebf5cb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:44:51.594522 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-d81aff38-7cbf-4284-b15d-755af0ebf5cb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:44:51.603463 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d81aff38-7cbf-4284-b15d-755af0ebf5cb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:44:51.603911 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d81aff38-7cbf-4284-b15d-755af0ebf5cb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:44:51.604752 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d81aff38-7cbf-4284-b15d-755af0ebf5cb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:44:51.605195 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d81aff38-7cbf-4284-b15d-755af0ebf5cb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:44:51.622327 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-d81aff38-7cbf-4284-b15d-755af0ebf5cb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Getting quotas for project 7e9c656d484843ffb1f2de092730345b. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:44:51.627504 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-d81aff38-7cbf-4284-b15d-755af0ebf5cb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Getting quotas for user b469a8f9433d422aa98d22eea9df7071 and project 7e9c656d484843ffb1f2de092730345b. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:44:51.684836 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d81aff38-7cbf-4284-b15d-755af0ebf5cb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:44:51.686936 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d81aff38-7cbf-4284-b15d-755af0ebf5cb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 2b6a4335-8165-44ec-ab86-8fc7ba31d5de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8ff86118-749b-48a1-b6e2-0a48e09b96eb',volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:44:52.000139 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d81aff38-7cbf-4284-b15d-755af0ebf5cb tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.892668 Jun 10 18:44:52.000834 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3561/7167] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:44:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:44:52.010913 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-83711320-9952-488c-8916-95bc98229c62 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:44:52.011543 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-83711320-9952-488c-8916-95bc98229c62 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 2b6a4335-8165-44ec-ab86-8fc7ba31d5de] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:44:52.065000 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-83711320-9952-488c-8916-95bc98229c62 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:44:52.075877 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-83711320-9952-488c-8916-95bc98229c62 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de" status: 200 len: 1093 microversion: 2.1 time: 0.068941 Jun 10 18:44:52.076489 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3607/7168] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:44:52 2022] GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:44:53.093609 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b87ec0d1-27ee-464c-ae1f-7f7e0e145e4a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:44:53.094217 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b87ec0d1-27ee-464c-ae1f-7f7e0e145e4a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 2b6a4335-8165-44ec-ab86-8fc7ba31d5de] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:44:53.100784 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b87ec0d1-27ee-464c-ae1f-7f7e0e145e4a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:44:53.101237 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b87ec0d1-27ee-464c-ae1f-7f7e0e145e4a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:44:53.102041 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b87ec0d1-27ee-464c-ae1f-7f7e0e145e4a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:44:53.102479 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b87ec0d1-27ee-464c-ae1f-7f7e0e145e4a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:44:53.163939 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b87ec0d1-27ee-464c-ae1f-7f7e0e145e4a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:44:53.172379 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b87ec0d1-27ee-464c-ae1f-7f7e0e145e4a tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de" status: 200 len: 1135 microversion: 2.1 time: 0.084073 Jun 10 18:44:53.172949 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3562/7169] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:44:53 2022] GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de => generated 1135 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:44:54.189979 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-aec95214-ed4c-4b1e-90c7-5eebc24c80ec tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:44:54.191620 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-aec95214-ed4c-4b1e-90c7-5eebc24c80ec tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 2b6a4335-8165-44ec-ab86-8fc7ba31d5de] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:44:54.198712 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aec95214-ed4c-4b1e-90c7-5eebc24c80ec tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:44:54.199434 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aec95214-ed4c-4b1e-90c7-5eebc24c80ec tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:44:54.201332 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aec95214-ed4c-4b1e-90c7-5eebc24c80ec tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:44:54.201863 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-aec95214-ed4c-4b1e-90c7-5eebc24c80ec tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:44:54.264996 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-aec95214-ed4c-4b1e-90c7-5eebc24c80ec tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:44:54.273043 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-aec95214-ed4c-4b1e-90c7-5eebc24c80ec tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de" status: 200 len: 1209 microversion: 2.1 time: 0.087056 Jun 10 18:44:54.274790 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3608/7170] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:44:54 2022] GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de => generated 1209 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:44:55.294467 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e11d858b-4492-439f-b267-54e215f3b8c7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:44:55.295856 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e11d858b-4492-439f-b267-54e215f3b8c7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 2b6a4335-8165-44ec-ab86-8fc7ba31d5de] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:44:55.303787 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e11d858b-4492-439f-b267-54e215f3b8c7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:44:55.304719 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e11d858b-4492-439f-b267-54e215f3b8c7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:44:55.311897 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e11d858b-4492-439f-b267-54e215f3b8c7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:44:55.311897 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e11d858b-4492-439f-b267-54e215f3b8c7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:44:55.336645 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [req-ca75af4e-fb00-4eac-b795-112e911b7a66 req-3f8f38d5-065f-4fbd-87af-d87c0a0dcb73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b6a4335-8165-44ec-ab86-8fc7ba31d5de", "tag": "4a7bc54b-0522-40d3-95a8-d5182e029df6"}]} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:44:55.350105 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-ca75af4e-fb00-4eac-b795-112e911b7a66 req-3f8f38d5-065f-4fbd-87af-d87c0a0dcb73 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:44:55.351023 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [req-ca75af4e-fb00-4eac-b795-112e911b7a66 req-3f8f38d5-065f-4fbd-87af-d87c0a0dcb73 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:44:55.373152 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.compute.server_external_events [req-ca75af4e-fb00-4eac-b795-112e911b7a66 req-3f8f38d5-065f-4fbd-87af-d87c0a0dcb73 service nova] Creating event network-changed:4a7bc54b-0522-40d3-95a8-d5182e029df6 for instance 2b6a4335-8165-44ec-ab86-8fc7ba31d5de on chh1-master-2 Jun 10 18:44:55.378535 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [req-ca75af4e-fb00-4eac-b795-112e911b7a66 req-3f8f38d5-065f-4fbd-87af-d87c0a0dcb73 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052141 Jun 10 18:44:55.385984 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3609/7171] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:44:55.478953 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e11d858b-4492-439f-b267-54e215f3b8c7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:44:55.487962 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e11d858b-4492-439f-b267-54e215f3b8c7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de" status: 200 len: 1277 microversion: 2.1 time: 0.199407 Jun 10 18:44:55.497709 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3563/7172] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:44:55 2022] GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de => generated 1277 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:44:56.506891 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-51e2a1e1-4cd4-4373-a85b-ecd0e438fe5c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:44:56.507646 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-51e2a1e1-4cd4-4373-a85b-ecd0e438fe5c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 2b6a4335-8165-44ec-ab86-8fc7ba31d5de] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:44:56.514085 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-51e2a1e1-4cd4-4373-a85b-ecd0e438fe5c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:44:56.514556 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-51e2a1e1-4cd4-4373-a85b-ecd0e438fe5c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:44:56.515338 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-51e2a1e1-4cd4-4373-a85b-ecd0e438fe5c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:44:56.515795 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-51e2a1e1-4cd4-4373-a85b-ecd0e438fe5c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:44:56.651607 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-51e2a1e1-4cd4-4373-a85b-ecd0e438fe5c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:44:56.660057 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-51e2a1e1-4cd4-4373-a85b-ecd0e438fe5c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de" status: 200 len: 1277 microversion: 2.1 time: 0.158356 Jun 10 18:44:56.660693 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3610/7173] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:44:56 2022] GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de => generated 1277 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:44:57.677599 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-abd791e6-26f5-4d96-be63-ecb8e90eb6e5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:44:57.678143 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-abd791e6-26f5-4d96-be63-ecb8e90eb6e5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 2b6a4335-8165-44ec-ab86-8fc7ba31d5de] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:44:57.685534 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-abd791e6-26f5-4d96-be63-ecb8e90eb6e5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:44:57.685979 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-abd791e6-26f5-4d96-be63-ecb8e90eb6e5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:44:57.686734 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-abd791e6-26f5-4d96-be63-ecb8e90eb6e5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:44:57.687166 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-abd791e6-26f5-4d96-be63-ecb8e90eb6e5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:44:58.095698 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-abd791e6-26f5-4d96-be63-ecb8e90eb6e5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:44:58.103309 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-abd791e6-26f5-4d96-be63-ecb8e90eb6e5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de" status: 200 len: 1277 microversion: 2.1 time: 0.429639 Jun 10 18:44:58.103878 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3564/7174] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:44:57 2022] GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de => generated 1277 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:44:59.121048 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-d83f26c6-f37d-466f-b86d-dc2f27acf82c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:44:59.123928 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-d83f26c6-f37d-466f-b86d-dc2f27acf82c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 2b6a4335-8165-44ec-ab86-8fc7ba31d5de] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:44:59.129383 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d83f26c6-f37d-466f-b86d-dc2f27acf82c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:44:59.129856 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d83f26c6-f37d-466f-b86d-dc2f27acf82c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:44:59.130733 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d83f26c6-f37d-466f-b86d-dc2f27acf82c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:44:59.131189 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-d83f26c6-f37d-466f-b86d-dc2f27acf82c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:44:59.266920 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-d83f26c6-f37d-466f-b86d-dc2f27acf82c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:44:59.274553 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-d83f26c6-f37d-466f-b86d-dc2f27acf82c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de" status: 200 len: 1277 microversion: 2.1 time: 0.157566 Jun 10 18:44:59.275401 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3611/7175] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:44:59 2022] GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de => generated 1277 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:45:00.291763 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c26065f9-1328-4e84-9c79-c5db747f8378 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:45:00.292407 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c26065f9-1328-4e84-9c79-c5db747f8378 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 2b6a4335-8165-44ec-ab86-8fc7ba31d5de] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:45:00.299833 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c26065f9-1328-4e84-9c79-c5db747f8378 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:45:00.300294 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c26065f9-1328-4e84-9c79-c5db747f8378 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:45:00.301168 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c26065f9-1328-4e84-9c79-c5db747f8378 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:45:00.301622 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c26065f9-1328-4e84-9c79-c5db747f8378 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:45:00.434578 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c26065f9-1328-4e84-9c79-c5db747f8378 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:45:00.442240 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c26065f9-1328-4e84-9c79-c5db747f8378 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de" status: 200 len: 1265 microversion: 2.1 time: 0.154349 Jun 10 18:45:00.442791 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3565/7176] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:45:00 2022] GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:45:01.459306 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-81749dd6-711d-4b13-8d7a-5a96b351ea70 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:45:01.459936 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-81749dd6-711d-4b13-8d7a-5a96b351ea70 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 2b6a4335-8165-44ec-ab86-8fc7ba31d5de] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:45:01.466817 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-81749dd6-711d-4b13-8d7a-5a96b351ea70 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:45:01.467279 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-81749dd6-711d-4b13-8d7a-5a96b351ea70 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:45:01.468054 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-81749dd6-711d-4b13-8d7a-5a96b351ea70 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:45:01.468526 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-81749dd6-711d-4b13-8d7a-5a96b351ea70 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:45:01.595956 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-81749dd6-711d-4b13-8d7a-5a96b351ea70 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:45:01.603445 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-81749dd6-711d-4b13-8d7a-5a96b351ea70 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de" status: 200 len: 1265 microversion: 2.1 time: 0.148068 Jun 10 18:45:01.604155 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3612/7177] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:45:01 2022] GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:45:02.620168 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-857ec0cf-528d-4dc4-b721-e87ea60341ee tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:45:02.620809 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-857ec0cf-528d-4dc4-b721-e87ea60341ee tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 2b6a4335-8165-44ec-ab86-8fc7ba31d5de] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:45:02.623646 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:45:02.624398 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=6 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:45:02.629356 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-857ec0cf-528d-4dc4-b721-e87ea60341ee tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:45:02.629813 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-857ec0cf-528d-4dc4-b721-e87ea60341ee tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:45:02.630586 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-857ec0cf-528d-4dc4-b721-e87ea60341ee tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:45:02.631025 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-857ec0cf-528d-4dc4-b721-e87ea60341ee tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:45:02.759612 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-857ec0cf-528d-4dc4-b721-e87ea60341ee tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:45:02.767885 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-857ec0cf-528d-4dc4-b721-e87ea60341ee tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de" status: 200 len: 1265 microversion: 2.1 time: 0.151585 Jun 10 18:45:02.768464 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3566/7178] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:45:02 2022] GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:45:03.785127 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7494e4bd-183b-4447-81b7-bf5563c6c43d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:45:03.785874 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7494e4bd-183b-4447-81b7-bf5563c6c43d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 2b6a4335-8165-44ec-ab86-8fc7ba31d5de] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:45:03.787920 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell0:SELECT=2 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:45:03.794738 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7494e4bd-183b-4447-81b7-bf5563c6c43d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:45:03.795212 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7494e4bd-183b-4447-81b7-bf5563c6c43d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:45:03.796036 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7494e4bd-183b-4447-81b7-bf5563c6c43d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:45:03.796626 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7494e4bd-183b-4447-81b7-bf5563c6c43d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:45:03.930782 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-7494e4bd-183b-4447-81b7-bf5563c6c43d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:45:03.938436 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7494e4bd-183b-4447-81b7-bf5563c6c43d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de" status: 200 len: 1265 microversion: 2.1 time: 0.157241 Jun 10 18:45:03.938988 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3613/7179] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:45:03 2022] GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:45:04.954998 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-93e87040-2ce1-4fe1-914b-87225ebbe2ae tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:45:04.955522 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-93e87040-2ce1-4fe1-914b-87225ebbe2ae tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 2b6a4335-8165-44ec-ab86-8fc7ba31d5de] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:45:04.962403 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93e87040-2ce1-4fe1-914b-87225ebbe2ae tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:45:04.962858 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93e87040-2ce1-4fe1-914b-87225ebbe2ae tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:45:04.963619 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93e87040-2ce1-4fe1-914b-87225ebbe2ae tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:45:04.964059 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93e87040-2ce1-4fe1-914b-87225ebbe2ae tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:45:05.096676 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-93e87040-2ce1-4fe1-914b-87225ebbe2ae tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:45:05.104252 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-93e87040-2ce1-4fe1-914b-87225ebbe2ae tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de" status: 200 len: 1265 microversion: 2.1 time: 0.153188 Jun 10 18:45:05.104839 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3567/7180] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:45:04 2022] GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:45:06.121175 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-587d6d77-4aad-413a-82b5-756474bda2e9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:45:06.122466 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-587d6d77-4aad-413a-82b5-756474bda2e9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 2b6a4335-8165-44ec-ab86-8fc7ba31d5de] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:45:06.129479 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-587d6d77-4aad-413a-82b5-756474bda2e9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:45:06.129948 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-587d6d77-4aad-413a-82b5-756474bda2e9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:45:06.130740 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-587d6d77-4aad-413a-82b5-756474bda2e9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:45:06.131192 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-587d6d77-4aad-413a-82b5-756474bda2e9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:45:06.262378 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-587d6d77-4aad-413a-82b5-756474bda2e9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:45:06.270048 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-587d6d77-4aad-413a-82b5-756474bda2e9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de" status: 200 len: 1265 microversion: 2.1 time: 0.152821 Jun 10 18:45:06.270644 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3614/7181] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:45:06 2022] GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:45:07.287119 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-730de150-e2dc-4bb3-9d69-1cebab137d4b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:45:07.287767 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-730de150-e2dc-4bb3-9d69-1cebab137d4b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 2b6a4335-8165-44ec-ab86-8fc7ba31d5de] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:45:07.294508 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-730de150-e2dc-4bb3-9d69-1cebab137d4b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:45:07.294959 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-730de150-e2dc-4bb3-9d69-1cebab137d4b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:45:07.295732 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-730de150-e2dc-4bb3-9d69-1cebab137d4b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:45:07.296176 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-730de150-e2dc-4bb3-9d69-1cebab137d4b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:45:07.428806 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-730de150-e2dc-4bb3-9d69-1cebab137d4b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:45:07.436945 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-730de150-e2dc-4bb3-9d69-1cebab137d4b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de" status: 200 len: 1265 microversion: 2.1 time: 0.153841 Jun 10 18:45:07.437504 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3568/7182] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:45:07 2022] GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:45:08.453959 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-b842206f-e9cd-4f81-86b7-2cab43a3dd3d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:45:08.454597 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-b842206f-e9cd-4f81-86b7-2cab43a3dd3d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 2b6a4335-8165-44ec-ab86-8fc7ba31d5de] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:45:08.461227 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b842206f-e9cd-4f81-86b7-2cab43a3dd3d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:45:08.461701 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b842206f-e9cd-4f81-86b7-2cab43a3dd3d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:45:08.462489 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b842206f-e9cd-4f81-86b7-2cab43a3dd3d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:45:08.462945 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-b842206f-e9cd-4f81-86b7-2cab43a3dd3d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:45:08.592430 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-b842206f-e9cd-4f81-86b7-2cab43a3dd3d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:45:08.599923 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-b842206f-e9cd-4f81-86b7-2cab43a3dd3d tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de" status: 200 len: 1265 microversion: 2.1 time: 0.150078 Jun 10 18:45:08.600528 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3615/7183] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:45:08 2022] GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:45:08.838131 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-00de2028-7a38-42cb-9613-562a42c06a13 req-80a4c90f-ba6b-4034-b4db-d4b9628e5fcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b6a4335-8165-44ec-ab86-8fc7ba31d5de", "name": "network-vif-plugged", "status": "completed", "tag": "4a7bc54b-0522-40d3-95a8-d5182e029df6"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:45:08.846880 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-00de2028-7a38-42cb-9613-562a42c06a13 req-80a4c90f-ba6b-4034-b4db-d4b9628e5fcd service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:45:08.847372 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-00de2028-7a38-42cb-9613-562a42c06a13 req-80a4c90f-ba6b-4034-b4db-d4b9628e5fcd service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:45:08.859170 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-00de2028-7a38-42cb-9613-562a42c06a13 req-80a4c90f-ba6b-4034-b4db-d4b9628e5fcd service nova] Creating event network-vif-plugged:4a7bc54b-0522-40d3-95a8-d5182e029df6 for instance 2b6a4335-8165-44ec-ab86-8fc7ba31d5de on chh1-master-2 Jun 10 18:45:08.864428 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-00de2028-7a38-42cb-9613-562a42c06a13 req-80a4c90f-ba6b-4034-b4db-d4b9628e5fcd service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155581 Jun 10 18:45:08.865363 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3569/7184] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:45:09.617684 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-cdd01e5d-0481-4065-a75b-f85751f20414 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:45:09.618305 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-cdd01e5d-0481-4065-a75b-f85751f20414 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 2b6a4335-8165-44ec-ab86-8fc7ba31d5de] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:45:09.625763 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cdd01e5d-0481-4065-a75b-f85751f20414 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:45:09.626224 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cdd01e5d-0481-4065-a75b-f85751f20414 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:45:09.627002 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cdd01e5d-0481-4065-a75b-f85751f20414 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:45:09.627452 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-cdd01e5d-0481-4065-a75b-f85751f20414 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:45:09.755343 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-cdd01e5d-0481-4065-a75b-f85751f20414 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:45:09.763464 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-cdd01e5d-0481-4065-a75b-f85751f20414 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de" status: 200 len: 1265 microversion: 2.1 time: 0.149738 Jun 10 18:45:09.764037 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3616/7185] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:45:09 2022] GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:45:10.780485 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a1bb3130-cf08-47d9-99e0-6c06aac92a52 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:45:10.781191 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a1bb3130-cf08-47d9-99e0-6c06aac92a52 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 2b6a4335-8165-44ec-ab86-8fc7ba31d5de] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:45:10.788267 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a1bb3130-cf08-47d9-99e0-6c06aac92a52 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:45:10.788737 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a1bb3130-cf08-47d9-99e0-6c06aac92a52 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:45:10.789509 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a1bb3130-cf08-47d9-99e0-6c06aac92a52 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:45:10.789949 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a1bb3130-cf08-47d9-99e0-6c06aac92a52 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:45:10.921202 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a1bb3130-cf08-47d9-99e0-6c06aac92a52 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:45:10.928843 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a1bb3130-cf08-47d9-99e0-6c06aac92a52 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de" status: 200 len: 1452 microversion: 2.1 time: 0.152578 Jun 10 18:45:10.931983 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3570/7186] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:45:10 2022] GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:45:10.944592 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-0264e0be-146c-49a8-84fb-1af77df82519 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:45:10.945250 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-0264e0be-146c-49a8-84fb-1af77df82519 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 2b6a4335-8165-44ec-ab86-8fc7ba31d5de] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:45:10.952112 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0264e0be-146c-49a8-84fb-1af77df82519 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:45:10.952606 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0264e0be-146c-49a8-84fb-1af77df82519 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:45:10.953379 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0264e0be-146c-49a8-84fb-1af77df82519 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:45:10.953831 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-0264e0be-146c-49a8-84fb-1af77df82519 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:45:11.085833 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-0264e0be-146c-49a8-84fb-1af77df82519 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:45:11.094130 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-0264e0be-146c-49a8-84fb-1af77df82519 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de" status: 200 len: 1452 microversion: 2.1 time: 0.153394 Jun 10 18:45:11.094713 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3617/7187] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:45:10 2022] GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:45:13.024155 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-72473fb5-5141-4bb9-822e-b5a5872b4347 req-edf431b8-cfe6-401a-8bc0-8904d0ba6f8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b6a4335-8165-44ec-ab86-8fc7ba31d5de", "tag": "4a7bc54b-0522-40d3-95a8-d5182e029df6"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:45:13.028981 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:45:13.034363 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-72473fb5-5141-4bb9-822e-b5a5872b4347 req-edf431b8-cfe6-401a-8bc0-8904d0ba6f8c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:45:13.034811 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-72473fb5-5141-4bb9-822e-b5a5872b4347 req-edf431b8-cfe6-401a-8bc0-8904d0ba6f8c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:45:13.037427 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:45:13.050033 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-72473fb5-5141-4bb9-822e-b5a5872b4347 req-edf431b8-cfe6-401a-8bc0-8904d0ba6f8c service nova] Creating event network-changed:4a7bc54b-0522-40d3-95a8-d5182e029df6 for instance 2b6a4335-8165-44ec-ab86-8fc7ba31d5de on chh1-master-2 Jun 10 18:45:13.056713 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-72473fb5-5141-4bb9-822e-b5a5872b4347 req-edf431b8-cfe6-401a-8bc0-8904d0ba6f8c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036274 Jun 10 18:45:13.057361 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3571/7188] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:47:30.945833 chdv-master-2 devstack@n-api.service[126595]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 18:47:30.946565 chdv-master-2 devstack@n-api.service[126595]: Fri Jun 10 18:47:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 10 18:47:32.089368 chdv-master-2 devstack@n-api.service[126594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 18:47:32.089845 chdv-master-2 devstack@n-api.service[126594]: Fri Jun 10 18:47:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 10 18:47:38.513494 chdv-master-2 devstack@n-api.service[126594]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2686bbfa-d6c5-4ef3-b508-e85590247d7e] AMQP server on 10.222.0.35:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 18:47:38.516175 chdv-master-2 devstack@n-api.service[126594]: ERROR oslo.messaging._drivers.impl_rabbit [-] [251d6a1d-2fe3-49a5-93d7-9ac1825c63a2] AMQP server on 10.222.0.35:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 18:47:38.516175 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_api:SELECT=34 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:47:38.516175 chdv-master-2 devstack@n-api.service[126594]: DEBUG dbcounter [-] [126594] Writing DB stats nova_cell1:SELECT=82 {{(pid=126594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:47:38.519945 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-7e3edda7-ca53-471a-8168-78ed0d21cc2f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1183477179", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-905098910", "security_groups": [{"name": "tempest-secgroup-smoke-2101708141"}], "block_device_mapping_v2": [{"uuid": "fa1cd3b3-d6ca-475b-b08a-e9513de8097c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b7773285-a55f-44ca-92fc-1f9b6eadbe45"}]}} {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:47:38.631088 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.network.neutron [None req-7e3edda7-ca53-471a-8168-78ed0d21cc2f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] validate_networks() for [('b7773285-a55f-44ca-92fc-1f9b6eadbe45', None, None, None, None, None)] {{(pid=126594) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:47:39.159717 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-7e3edda7-ca53-471a-8168-78ed0d21cc2f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Flavor limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:47:39.160165 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-7e3edda7-ca53-471a-8168-78ed0d21cc2f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Image limits 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:47:39.160704 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-7e3edda7-ca53-471a-8168-78ed0d21cc2f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Flavor pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:47:39.161138 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-7e3edda7-ca53-471a-8168-78ed0d21cc2f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Image pref 0:0:0 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:47:39.161573 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.virt.hardware [None req-7e3edda7-ca53-471a-8168-78ed0d21cc2f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:47:39.170658 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7e3edda7-ca53-471a-8168-78ed0d21cc2f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:47:39.171127 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7e3edda7-ca53-471a-8168-78ed0d21cc2f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:47:39.171954 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7e3edda7-ca53-471a-8168-78ed0d21cc2f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:47:39.172440 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-7e3edda7-ca53-471a-8168-78ed0d21cc2f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:47:39.189714 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-7e3edda7-ca53-471a-8168-78ed0d21cc2f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Getting quotas for project 7e9c656d484843ffb1f2de092730345b. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:47:39.195521 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.quota [None req-7e3edda7-ca53-471a-8168-78ed0d21cc2f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Getting quotas for user b469a8f9433d422aa98d22eea9df7071 and project 7e9c656d484843ffb1f2de092730345b. Resources: {'instances', 'cores', 'ram'} {{(pid=126594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:47:39.253118 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7e3edda7-ca53-471a-8168-78ed0d21cc2f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Going to run 1 instances... {{(pid=126594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:47:39.255219 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-7e3edda7-ca53-471a-8168-78ed0d21cc2f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 746b2ca8-1126-436d-9365-86c29b4d645c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fa1cd3b3-d6ca-475b-b08a-e9513de8097c',volume_size=None,volume_type=None)] {{(pid=126594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:47:39.556583 chdv-master-2 devstack@n-api.service[126594]: INFO oslo.messaging._drivers.impl_rabbit [-] [2686bbfa-d6c5-4ef3-b508-e85590247d7e] Reconnected to AMQP server on 10.222.0.35:5672 via [amqp] client with port 43664. Jun 10 18:47:39.557370 chdv-master-2 devstack@n-api.service[126594]: INFO oslo.messaging._drivers.impl_rabbit [-] [251d6a1d-2fe3-49a5-93d7-9ac1825c63a2] Reconnected to AMQP server on 10.222.0.35:5672 via [amqp] client with port 43666. Jun 10 18:47:39.636149 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-7e3edda7-ca53-471a-8168-78ed0d21cc2f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.124516 Jun 10 18:47:39.636852 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3618/7189] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:47:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 1126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:47:39.645396 chdv-master-2 devstack@n-api.service[126595]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cecfc05b-781c-4b87-9406-22ae5810c12d] AMQP server on 10.222.0.35:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 10 18:47:39.646190 chdv-master-2 devstack@n-api.service[126595]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0c5f50dc-ccde-4ae8-a3f3-fe46db0ef7f7] AMQP server on 10.222.0.35:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 10 18:47:39.653635 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f8926945-4b80-4ef5-8597-7ca921ea2f76 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:47:39.654372 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f8926945-4b80-4ef5-8597-7ca921ea2f76 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 746b2ca8-1126-436d-9365-86c29b4d645c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:47:39.717460 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f8926945-4b80-4ef5-8597-7ca921ea2f76 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:47:39.725991 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f8926945-4b80-4ef5-8597-7ca921ea2f76 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/746b2ca8-1126-436d-9365-86c29b4d645c" status: 200 len: 1094 microversion: 2.1 time: 0.082637 Jun 10 18:47:39.726552 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3572/7190] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:47:39 2022] GET /compute/v2.1/servers/746b2ca8-1126-436d-9365-86c29b4d645c => generated 1094 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:47:40.743609 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-ba56923b-ac29-4d68-b5ea-c6b9f51fc043 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:47:40.744251 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-ba56923b-ac29-4d68-b5ea-c6b9f51fc043 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 746b2ca8-1126-436d-9365-86c29b4d645c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:47:40.750514 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ba56923b-ac29-4d68-b5ea-c6b9f51fc043 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:47:40.750979 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ba56923b-ac29-4d68-b5ea-c6b9f51fc043 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:47:40.751756 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ba56923b-ac29-4d68-b5ea-c6b9f51fc043 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:47:40.752211 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-ba56923b-ac29-4d68-b5ea-c6b9f51fc043 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:47:40.815142 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-ba56923b-ac29-4d68-b5ea-c6b9f51fc043 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:47:40.823226 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-ba56923b-ac29-4d68-b5ea-c6b9f51fc043 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/746b2ca8-1126-436d-9365-86c29b4d645c" status: 200 len: 1144 microversion: 2.1 time: 0.084333 Jun 10 18:47:40.824718 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3619/7191] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:47:40 2022] GET /compute/v2.1/servers/746b2ca8-1126-436d-9365-86c29b4d645c => generated 1144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:47:41.839954 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-76084cd8-db20-4bf4-b2c2-8069efdf4727 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:47:41.840666 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-76084cd8-db20-4bf4-b2c2-8069efdf4727 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 746b2ca8-1126-436d-9365-86c29b4d645c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:47:41.852326 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-76084cd8-db20-4bf4-b2c2-8069efdf4727 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:47:41.852797 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-76084cd8-db20-4bf4-b2c2-8069efdf4727 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:47:41.853584 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-76084cd8-db20-4bf4-b2c2-8069efdf4727 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:47:41.854030 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-76084cd8-db20-4bf4-b2c2-8069efdf4727 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:47:41.858112 chdv-master-2 devstack@n-api.service[126595]: INFO oslo.messaging._drivers.impl_rabbit [-] [cecfc05b-781c-4b87-9406-22ae5810c12d] Reconnected to AMQP server on 10.222.0.35:5672 via [amqp] client with port 43698. Jun 10 18:47:41.861223 chdv-master-2 devstack@n-api.service[126595]: INFO oslo.messaging._drivers.impl_rabbit [-] [0c5f50dc-ccde-4ae8-a3f3-fe46db0ef7f7] Reconnected to AMQP server on 10.222.0.35:5672 via [amqp] client with port 43700. Jun 10 18:47:41.942568 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-76084cd8-db20-4bf4-b2c2-8069efdf4727 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:47:41.950821 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-76084cd8-db20-4bf4-b2c2-8069efdf4727 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/746b2ca8-1126-436d-9365-86c29b4d645c" status: 200 len: 1200 microversion: 2.1 time: 0.115577 Jun 10 18:47:41.952645 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3573/7192] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:47:41 2022] GET /compute/v2.1/servers/746b2ca8-1126-436d-9365-86c29b4d645c => generated 1200 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:47:42.971244 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-f39b9fa6-0ce6-442c-b749-a3d848ccea52 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:47:42.972630 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-f39b9fa6-0ce6-442c-b749-a3d848ccea52 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 746b2ca8-1126-436d-9365-86c29b4d645c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:47:42.980402 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f39b9fa6-0ce6-442c-b749-a3d848ccea52 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:47:42.980879 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f39b9fa6-0ce6-442c-b749-a3d848ccea52 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:47:42.981700 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f39b9fa6-0ce6-442c-b749-a3d848ccea52 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:47:42.982206 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-f39b9fa6-0ce6-442c-b749-a3d848ccea52 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:47:43.132529 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-f39b9fa6-0ce6-442c-b749-a3d848ccea52 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:47:43.141448 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-f39b9fa6-0ce6-442c-b749-a3d848ccea52 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/746b2ca8-1126-436d-9365-86c29b4d645c" status: 200 len: 1278 microversion: 2.1 time: 0.176373 Jun 10 18:47:43.142030 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3620/7193] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:47:42 2022] GET /compute/v2.1/servers/746b2ca8-1126-436d-9365-86c29b4d645c => generated 1278 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:47:43.930441 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-119b4938-508d-4a3b-bce4-eb8078450347 req-b91d1d24-416d-43ec-895f-70bfd067bf67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "746b2ca8-1126-436d-9365-86c29b4d645c", "tag": "c50b7c0c-0821-4768-a353-1d187daedec8"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:47:43.942447 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-119b4938-508d-4a3b-bce4-eb8078450347 req-b91d1d24-416d-43ec-895f-70bfd067bf67 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:47:43.943315 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-119b4938-508d-4a3b-bce4-eb8078450347 req-b91d1d24-416d-43ec-895f-70bfd067bf67 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:47:43.957079 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-119b4938-508d-4a3b-bce4-eb8078450347 req-b91d1d24-416d-43ec-895f-70bfd067bf67 service nova] Creating event network-changed:c50b7c0c-0821-4768-a353-1d187daedec8 for instance 746b2ca8-1126-436d-9365-86c29b4d645c on chh2-master-2 Jun 10 18:47:43.962579 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-119b4938-508d-4a3b-bce4-eb8078450347 req-b91d1d24-416d-43ec-895f-70bfd067bf67 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142436 Jun 10 18:47:43.964663 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3574/7194] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:47:44.162665 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-1f94b98d-f7f6-4a89-8aad-58e39ca29d6c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:47:44.163672 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-1f94b98d-f7f6-4a89-8aad-58e39ca29d6c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 746b2ca8-1126-436d-9365-86c29b4d645c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:47:44.171066 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1f94b98d-f7f6-4a89-8aad-58e39ca29d6c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:47:44.171545 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1f94b98d-f7f6-4a89-8aad-58e39ca29d6c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:47:44.172419 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1f94b98d-f7f6-4a89-8aad-58e39ca29d6c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:47:44.172879 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-1f94b98d-f7f6-4a89-8aad-58e39ca29d6c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:47:44.316581 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-1f94b98d-f7f6-4a89-8aad-58e39ca29d6c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:47:44.325437 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-1f94b98d-f7f6-4a89-8aad-58e39ca29d6c tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/746b2ca8-1126-436d-9365-86c29b4d645c" status: 200 len: 1278 microversion: 2.1 time: 0.166898 Jun 10 18:47:44.326530 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3621/7195] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:47:44 2022] GET /compute/v2.1/servers/746b2ca8-1126-436d-9365-86c29b4d645c => generated 1278 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:47:45.344550 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9eae8d25-99c3-429d-9cf0-7073ad50942f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:47:45.345670 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9eae8d25-99c3-429d-9cf0-7073ad50942f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 746b2ca8-1126-436d-9365-86c29b4d645c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:47:45.352141 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9eae8d25-99c3-429d-9cf0-7073ad50942f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:47:45.352662 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9eae8d25-99c3-429d-9cf0-7073ad50942f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:47:45.353450 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9eae8d25-99c3-429d-9cf0-7073ad50942f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:47:45.353904 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9eae8d25-99c3-429d-9cf0-7073ad50942f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:47:45.494031 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9eae8d25-99c3-429d-9cf0-7073ad50942f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:47:45.501781 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9eae8d25-99c3-429d-9cf0-7073ad50942f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/746b2ca8-1126-436d-9365-86c29b4d645c" status: 200 len: 1278 microversion: 2.1 time: 0.162353 Jun 10 18:47:45.502349 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3575/7196] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:47:45 2022] GET /compute/v2.1/servers/746b2ca8-1126-436d-9365-86c29b4d645c => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:47:46.519204 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.api.openstack.wsgi [None req-6eb4b5df-50d3-4f77-9096-0dfd7856aab5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:47:46.519909 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.compute.api [None req-6eb4b5df-50d3-4f77-9096-0dfd7856aab5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 746b2ca8-1126-436d-9365-86c29b4d645c] Fetching instance by UUID {{(pid=126594) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:47:46.528261 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6eb4b5df-50d3-4f77-9096-0dfd7856aab5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:47:46.528780 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6eb4b5df-50d3-4f77-9096-0dfd7856aab5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:47:46.529633 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6eb4b5df-50d3-4f77-9096-0dfd7856aab5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:47:46.530119 chdv-master-2 devstack@n-api.service[126594]: DEBUG oslo_concurrency.lockutils [None req-6eb4b5df-50d3-4f77-9096-0dfd7856aab5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:47:46.669704 chdv-master-2 devstack@n-api.service[126594]: DEBUG nova.policy [None req-6eb4b5df-50d3-4f77-9096-0dfd7856aab5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126594) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:47:46.688183 chdv-master-2 devstack@n-api.service[126594]: INFO nova.api.openstack.requestlog [None req-6eb4b5df-50d3-4f77-9096-0dfd7856aab5 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/746b2ca8-1126-436d-9365-86c29b4d645c" status: 200 len: 1278 microversion: 2.1 time: 0.172729 Jun 10 18:47:46.689294 chdv-master-2 devstack@n-api.service[126594]: [pid: 126594|app: 0|req: 3622/7197] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:47:46 2022] GET /compute/v2.1/servers/746b2ca8-1126-436d-9365-86c29b4d645c => generated 1278 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:47:47.705493 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-435a9b44-fc75-44ba-861c-efa265875603 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:47:47.706061 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-435a9b44-fc75-44ba-861c-efa265875603 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 746b2ca8-1126-436d-9365-86c29b4d645c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:47:47.713531 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-435a9b44-fc75-44ba-861c-efa265875603 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:47:47.713994 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-435a9b44-fc75-44ba-861c-efa265875603 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:47:47.714775 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-435a9b44-fc75-44ba-861c-efa265875603 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:47:47.715228 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-435a9b44-fc75-44ba-861c-efa265875603 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:47:47.852337 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-435a9b44-fc75-44ba-861c-efa265875603 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:47:47.860630 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-435a9b44-fc75-44ba-861c-efa265875603 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/746b2ca8-1126-436d-9365-86c29b4d645c" status: 200 len: 1278 microversion: 2.1 time: 0.159121 Jun 10 18:47:47.861195 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3576/7198] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:47:47 2022] GET /compute/v2.1/servers/746b2ca8-1126-436d-9365-86c29b4d645c => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:47:48.901254 chdv-master-2 devstack@n-api.service[126594]: Traceback (most recent call last): Jun 10 18:47:48.901817 chdv-master-2 devstack@n-api.service[126594]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jun 10 18:47:48.901817 chdv-master-2 devstack@n-api.service[126594]: timer() Jun 10 18:47:48.901817 chdv-master-2 devstack@n-api.service[126594]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jun 10 18:47:48.901817 chdv-master-2 devstack@n-api.service[126594]: cb(*args, **kw) Jun 10 18:47:48.901817 chdv-master-2 devstack@n-api.service[126594]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire Jun 10 18:47:48.901817 chdv-master-2 devstack@n-api.service[126594]: waiter.switch() Jun 10 18:47:48.901817 chdv-master-2 devstack@n-api.service[126594]: greenlet.error: cannot switch to a different thread Jun 10 18:47:53.121233 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-438bca88-6b9a-4a08-b31a-094a10fba68e req-588cc72b-1c88-42e8-9733-e4d381d74918 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "746b2ca8-1126-436d-9365-86c29b4d645c", "name": "network-vif-plugged", "status": "completed", "tag": "c50b7c0c-0821-4768-a353-1d187daedec8"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:47:53.125578 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:47:53.130921 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-438bca88-6b9a-4a08-b31a-094a10fba68e req-588cc72b-1c88-42e8-9733-e4d381d74918 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:47:53.134004 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-438bca88-6b9a-4a08-b31a-094a10fba68e req-588cc72b-1c88-42e8-9733-e4d381d74918 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:47:53.141980 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-438bca88-6b9a-4a08-b31a-094a10fba68e req-588cc72b-1c88-42e8-9733-e4d381d74918 service nova] Creating event network-vif-plugged:c50b7c0c-0821-4768-a353-1d187daedec8 for instance 746b2ca8-1126-436d-9365-86c29b4d645c on chh2-master-2 Jun 10 18:47:53.147233 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-438bca88-6b9a-4a08-b31a-094a10fba68e req-588cc72b-1c88-42e8-9733-e4d381d74918 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029446 Jun 10 18:47:53.147810 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3577/7199] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:48:48.936520 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=15 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:48:48.937268 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=23 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:48:48.941716 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8c0a37ad-ab84-4592-8f98-9a90b80abb55 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:48:48.942420 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8c0a37ad-ab84-4592-8f98-9a90b80abb55 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 746b2ca8-1126-436d-9365-86c29b4d645c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:48:48.948674 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8c0a37ad-ab84-4592-8f98-9a90b80abb55 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:48:48.949132 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8c0a37ad-ab84-4592-8f98-9a90b80abb55 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:48:48.949903 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8c0a37ad-ab84-4592-8f98-9a90b80abb55 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:48:48.950346 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8c0a37ad-ab84-4592-8f98-9a90b80abb55 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:48:49.186882 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8c0a37ad-ab84-4592-8f98-9a90b80abb55 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:48:49.195369 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8c0a37ad-ab84-4592-8f98-9a90b80abb55 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/746b2ca8-1126-436d-9365-86c29b4d645c" status: 200 len: 1453 microversion: 2.1 time: 0.261027 Jun 10 18:48:49.195950 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3578/7200] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:48:48 2022] GET /compute/v2.1/servers/746b2ca8-1126-436d-9365-86c29b4d645c => generated 1453 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:48:49.211024 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4759dcbe-484a-4de0-92a1-e3aab88a579f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:48:49.211654 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4759dcbe-484a-4de0-92a1-e3aab88a579f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 746b2ca8-1126-436d-9365-86c29b4d645c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:48:49.217515 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4759dcbe-484a-4de0-92a1-e3aab88a579f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:48:49.217973 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4759dcbe-484a-4de0-92a1-e3aab88a579f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:48:49.218740 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4759dcbe-484a-4de0-92a1-e3aab88a579f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:48:49.219182 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4759dcbe-484a-4de0-92a1-e3aab88a579f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:48:49.375024 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4759dcbe-484a-4de0-92a1-e3aab88a579f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:48:49.382680 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4759dcbe-484a-4de0-92a1-e3aab88a579f tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/746b2ca8-1126-436d-9365-86c29b4d645c" status: 200 len: 1453 microversion: 2.1 time: 0.175285 Jun 10 18:48:49.383268 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3579/7201] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:48:49 2022] GET /compute/v2.1/servers/746b2ca8-1126-436d-9365-86c29b4d645c => generated 1453 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:48:51.698146 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-94322990-0574-4753-9ed5-2f2af9c4f333 req-9793d309-b651-407b-8d4b-114c6dfe4247 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "746b2ca8-1126-436d-9365-86c29b4d645c", "tag": "c50b7c0c-0821-4768-a353-1d187daedec8"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:48:51.706804 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-94322990-0574-4753-9ed5-2f2af9c4f333 req-9793d309-b651-407b-8d4b-114c6dfe4247 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:48:51.707255 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-94322990-0574-4753-9ed5-2f2af9c4f333 req-9793d309-b651-407b-8d4b-114c6dfe4247 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:48:51.718321 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-94322990-0574-4753-9ed5-2f2af9c4f333 req-9793d309-b651-407b-8d4b-114c6dfe4247 service nova] Creating event network-changed:c50b7c0c-0821-4768-a353-1d187daedec8 for instance 746b2ca8-1126-436d-9365-86c29b4d645c on chh2-master-2 Jun 10 18:48:51.723536 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-94322990-0574-4753-9ed5-2f2af9c4f333 req-9793d309-b651-407b-8d4b-114c6dfe4247 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093199 Jun 10 18:48:51.724138 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3580/7202] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:50:05.057255 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=6 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:50:05.063596 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=14 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:50:05.063596 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-960da7bb-8d0f-42e2-b9f9-23af309a0451 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:50:05.063596 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-960da7bb-8d0f-42e2-b9f9-23af309a0451 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 746b2ca8-1126-436d-9365-86c29b4d645c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:50:05.069446 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-960da7bb-8d0f-42e2-b9f9-23af309a0451 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:05.069907 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-960da7bb-8d0f-42e2-b9f9-23af309a0451 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:05.070674 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-960da7bb-8d0f-42e2-b9f9-23af309a0451 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:05.071112 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-960da7bb-8d0f-42e2-b9f9-23af309a0451 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:05.096990 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-960da7bb-8d0f-42e2-b9f9-23af309a0451 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 746b2ca8-1126-436d-9365-86c29b4d645c] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:50:05.321878 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-960da7bb-8d0f-42e2-b9f9-23af309a0451 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "DELETE /compute/v2.1/servers/746b2ca8-1126-436d-9365-86c29b4d645c" status: 204 len: 0 microversion: 2.1 time: 0.266873 Jun 10 18:50:05.322475 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3581/7203] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:50:05 2022] DELETE /compute/v2.1/servers/746b2ca8-1126-436d-9365-86c29b4d645c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 18:50:05.327866 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-1e32c5f7-f50d-4ad7-8eaa-c54012d7566b req-a3c9d56b-8744-47ad-af0b-418aaf46186a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "746b2ca8-1126-436d-9365-86c29b4d645c", "tag": "c50b7c0c-0821-4768-a353-1d187daedec8"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:50:05.336748 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-1e32c5f7-f50d-4ad7-8eaa-c54012d7566b req-a3c9d56b-8744-47ad-af0b-418aaf46186a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:05.337206 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-1e32c5f7-f50d-4ad7-8eaa-c54012d7566b req-a3c9d56b-8744-47ad-af0b-418aaf46186a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:05.348747 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-1e32c5f7-f50d-4ad7-8eaa-c54012d7566b req-a3c9d56b-8744-47ad-af0b-418aaf46186a service nova] Creating event network-changed:c50b7c0c-0821-4768-a353-1d187daedec8 for instance 746b2ca8-1126-436d-9365-86c29b4d645c on chh2-master-2 Jun 10 18:50:05.353833 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-1e32c5f7-f50d-4ad7-8eaa-c54012d7566b req-a3c9d56b-8744-47ad-af0b-418aaf46186a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030027 Jun 10 18:50:05.354436 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3582/7204] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:50:05.359574 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-778c82fd-d0ec-40a3-89d1-72a3fb212b65 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:50:05.360285 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-778c82fd-d0ec-40a3-89d1-72a3fb212b65 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 746b2ca8-1126-436d-9365-86c29b4d645c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:50:05.367115 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-778c82fd-d0ec-40a3-89d1-72a3fb212b65 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:05.367581 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-778c82fd-d0ec-40a3-89d1-72a3fb212b65 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:05.368438 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-778c82fd-d0ec-40a3-89d1-72a3fb212b65 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:05.368884 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-778c82fd-d0ec-40a3-89d1-72a3fb212b65 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:05.508198 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-778c82fd-d0ec-40a3-89d1-72a3fb212b65 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:50:05.516808 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-778c82fd-d0ec-40a3-89d1-72a3fb212b65 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/746b2ca8-1126-436d-9365-86c29b4d645c" status: 200 len: 1576 microversion: 2.1 time: 0.161166 Jun 10 18:50:05.521459 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3583/7205] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:50:05 2022] GET /compute/v2.1/servers/746b2ca8-1126-436d-9365-86c29b4d645c => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:50:06.533953 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8d5e6d0c-c5cb-4ec0-9bd1-4b318ae69d87 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:50:06.534625 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8d5e6d0c-c5cb-4ec0-9bd1-4b318ae69d87 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 746b2ca8-1126-436d-9365-86c29b4d645c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:50:06.542162 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8d5e6d0c-c5cb-4ec0-9bd1-4b318ae69d87 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:06.542614 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8d5e6d0c-c5cb-4ec0-9bd1-4b318ae69d87 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:06.543384 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8d5e6d0c-c5cb-4ec0-9bd1-4b318ae69d87 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:06.544259 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8d5e6d0c-c5cb-4ec0-9bd1-4b318ae69d87 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:07.051110 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8d5e6d0c-c5cb-4ec0-9bd1-4b318ae69d87 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:50:07.059109 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8d5e6d0c-c5cb-4ec0-9bd1-4b318ae69d87 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/746b2ca8-1126-436d-9365-86c29b4d645c" status: 200 len: 1576 microversion: 2.1 time: 0.529058 Jun 10 18:50:07.059698 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3584/7206] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:50:06 2022] GET /compute/v2.1/servers/746b2ca8-1126-436d-9365-86c29b4d645c => generated 1576 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:50:07.617661 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-5c0bf10c-fdd3-462d-8b66-663cca6bb279 req-b0473ff7-66e8-411f-922d-e3343fc81fab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "746b2ca8-1126-436d-9365-86c29b4d645c", "name": "network-vif-deleted", "tag": "c50b7c0c-0821-4768-a353-1d187daedec8"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:50:07.626521 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-5c0bf10c-fdd3-462d-8b66-663cca6bb279 req-b0473ff7-66e8-411f-922d-e3343fc81fab service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:07.626962 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-5c0bf10c-fdd3-462d-8b66-663cca6bb279 req-b0473ff7-66e8-411f-922d-e3343fc81fab service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:07.637767 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-5c0bf10c-fdd3-462d-8b66-663cca6bb279 req-b0473ff7-66e8-411f-922d-e3343fc81fab service nova] Creating event network-vif-deleted:c50b7c0c-0821-4768-a353-1d187daedec8 for instance 746b2ca8-1126-436d-9365-86c29b4d645c on chh2-master-2 Jun 10 18:50:07.642740 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-5c0bf10c-fdd3-462d-8b66-663cca6bb279 req-b0473ff7-66e8-411f-922d-e3343fc81fab service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028774 Jun 10 18:50:07.643317 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3585/7207] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:50:08.078402 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-70a9180d-a04d-4fff-8e0c-d201e2f34572 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:50:08.079111 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-70a9180d-a04d-4fff-8e0c-d201e2f34572 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 746b2ca8-1126-436d-9365-86c29b4d645c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:50:08.086169 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70a9180d-a04d-4fff-8e0c-d201e2f34572 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:08.086630 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70a9180d-a04d-4fff-8e0c-d201e2f34572 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:08.087410 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70a9180d-a04d-4fff-8e0c-d201e2f34572 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:08.087859 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70a9180d-a04d-4fff-8e0c-d201e2f34572 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:08.153210 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-70a9180d-a04d-4fff-8e0c-d201e2f34572 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:50:08.161106 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-70a9180d-a04d-4fff-8e0c-d201e2f34572 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/746b2ca8-1126-436d-9365-86c29b4d645c" status: 200 len: 1225 microversion: 2.1 time: 0.087903 Jun 10 18:50:08.161682 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3586/7208] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:50:08 2022] GET /compute/v2.1/servers/746b2ca8-1126-436d-9365-86c29b4d645c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:50:09.178545 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ddd68e38-4e2f-419d-a8b9-b5e5535eab69 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:50:09.179191 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ddd68e38-4e2f-419d-a8b9-b5e5535eab69 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 746b2ca8-1126-436d-9365-86c29b4d645c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:50:09.186147 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ddd68e38-4e2f-419d-a8b9-b5e5535eab69 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:09.186602 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ddd68e38-4e2f-419d-a8b9-b5e5535eab69 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:09.187375 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ddd68e38-4e2f-419d-a8b9-b5e5535eab69 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:09.187814 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ddd68e38-4e2f-419d-a8b9-b5e5535eab69 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:09.253408 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ddd68e38-4e2f-419d-a8b9-b5e5535eab69 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:50:09.261177 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ddd68e38-4e2f-419d-a8b9-b5e5535eab69 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/746b2ca8-1126-436d-9365-86c29b4d645c" status: 200 len: 1225 microversion: 2.1 time: 0.086803 Jun 10 18:50:09.262083 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3587/7209] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:50:09 2022] GET /compute/v2.1/servers/746b2ca8-1126-436d-9365-86c29b4d645c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:50:10.278826 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-33af129a-5e2e-48c0-8252-067a6da1f1b9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:50:10.279487 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-33af129a-5e2e-48c0-8252-067a6da1f1b9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 746b2ca8-1126-436d-9365-86c29b4d645c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:50:10.286676 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-33af129a-5e2e-48c0-8252-067a6da1f1b9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:10.287142 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-33af129a-5e2e-48c0-8252-067a6da1f1b9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:10.287904 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-33af129a-5e2e-48c0-8252-067a6da1f1b9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:10.288368 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-33af129a-5e2e-48c0-8252-067a6da1f1b9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:10.349784 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-33af129a-5e2e-48c0-8252-067a6da1f1b9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:50:10.357452 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-33af129a-5e2e-48c0-8252-067a6da1f1b9 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/746b2ca8-1126-436d-9365-86c29b4d645c" status: 200 len: 1225 microversion: 2.1 time: 0.082572 Jun 10 18:50:10.358231 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3588/7210] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:50:10 2022] GET /compute/v2.1/servers/746b2ca8-1126-436d-9365-86c29b4d645c => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:50:11.374165 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-049506de-b638-4002-a3aa-fbd02c8be1a0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:50:11.374788 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-049506de-b638-4002-a3aa-fbd02c8be1a0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 746b2ca8-1126-436d-9365-86c29b4d645c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:50:11.382306 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-049506de-b638-4002-a3aa-fbd02c8be1a0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:11.382760 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-049506de-b638-4002-a3aa-fbd02c8be1a0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:11.383527 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-049506de-b638-4002-a3aa-fbd02c8be1a0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:11.383966 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-049506de-b638-4002-a3aa-fbd02c8be1a0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:11.445836 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-049506de-b638-4002-a3aa-fbd02c8be1a0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:50:11.453551 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-049506de-b638-4002-a3aa-fbd02c8be1a0 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/746b2ca8-1126-436d-9365-86c29b4d645c" status: 200 len: 1225 microversion: 2.1 time: 0.083423 Jun 10 18:50:11.454117 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3589/7211] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:50:11 2022] GET /compute/v2.1/servers/746b2ca8-1126-436d-9365-86c29b4d645c => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:50:12.470297 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4f10bca8-a1bb-40f2-9778-238689ea0a67 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:50:12.470911 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4f10bca8-a1bb-40f2-9778-238689ea0a67 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 746b2ca8-1126-436d-9365-86c29b4d645c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:50:12.477732 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f10bca8-a1bb-40f2-9778-238689ea0a67 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:12.478180 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f10bca8-a1bb-40f2-9778-238689ea0a67 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:12.478980 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f10bca8-a1bb-40f2-9778-238689ea0a67 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:12.479428 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f10bca8-a1bb-40f2-9778-238689ea0a67 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:12.510179 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f10bca8-a1bb-40f2-9778-238689ea0a67 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:12.510634 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f10bca8-a1bb-40f2-9778-238689ea0a67 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:12.511084 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-4f10bca8-a1bb-40f2-9778-238689ea0a67 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lazy-loading 'fault' on Instance uuid 746b2ca8-1126-436d-9365-86c29b4d645c {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:50:12.552790 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4f10bca8-a1bb-40f2-9778-238689ea0a67 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:50:12.560282 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4f10bca8-a1bb-40f2-9778-238689ea0a67 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/746b2ca8-1126-436d-9365-86c29b4d645c" status: 200 len: 1230 microversion: 2.1 time: 0.093930 Jun 10 18:50:12.561118 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3590/7212] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:50:12 2022] GET /compute/v2.1/servers/746b2ca8-1126-436d-9365-86c29b4d645c => generated 1230 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:50:13.578557 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a186c6e1-0569-43b2-893c-b96c99d3475b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:50:13.579236 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a186c6e1-0569-43b2-893c-b96c99d3475b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 746b2ca8-1126-436d-9365-86c29b4d645c] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:50:13.586243 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a186c6e1-0569-43b2-893c-b96c99d3475b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:13.590282 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a186c6e1-0569-43b2-893c-b96c99d3475b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:13.590282 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a186c6e1-0569-43b2-893c-b96c99d3475b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:13.590282 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a186c6e1-0569-43b2-893c-b96c99d3475b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:13.601580 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-a186c6e1-0569-43b2-893c-b96c99d3475b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] HTTP exception thrown: Instance 746b2ca8-1126-436d-9365-86c29b4d645c could not be found. Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a186c6e1-0569-43b2-893c-b96c99d3475b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Request method failure captured: Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/746b2ca8-1126-436d-9365-86c29b4d645c HTTP/1.1 Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio48lCBpBlRizgNQmj6c6iu0oXkmc5Tm-q4miwv2Pj49f2pUTZFT27dYtKGefFULH5-gcByMQrPeG1d5YVOJ_GuLGrptrh59AcDYu37Uta2nd4eDA1xNIrohvrn1bdHxnfVCnt0fGjpM3LVpc7O3my-1igIi7pJV4HqsUallplG6Y66g Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 7e9c656d484843ffb1f2de092730345b Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_7e9c656d484843ffb1f2de092730345b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 7e9c656d484843ffb1f2de092730345b Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-TestVolumeBootPattern-1765437769-project Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: b469a8f9433d422aa98d22eea9df7071 Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-TestVolumeBootPattern-1765437769-project Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 746b2ca8-1126-436d-9365-86c29b4d645c could not be found. Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '746b2ca8-1126-436d-9365-86c29b4d645c'} Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 746b2ca8-1126-436d-9365-86c29b4d645c could not be found. Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 746b2ca8-1126-436d-9365-86c29b4d645c could not be found. Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:50:13.603232 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:50:13.607860 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:50:13.607860 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:50:13.607860 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:50:13.607860 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:50:13.607860 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:50:13.607860 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 746b2ca8-1126-436d-9365-86c29b4d645c could not be found. Jun 10 18:50:13.607860 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:50:13.607860 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a186c6e1-0569-43b2-893c-b96c99d3475b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Returning 404 to user: Instance 746b2ca8-1126-436d-9365-86c29b4d645c could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:50:13.607860 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a186c6e1-0569-43b2-893c-b96c99d3475b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/746b2ca8-1126-436d-9365-86c29b4d645c" status: 404 len: 111 microversion: 2.1 time: 0.030022 Jun 10 18:50:13.607860 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3591/7213] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:50:13 2022] GET /compute/v2.1/servers/746b2ca8-1126-436d-9365-86c29b4d645c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:50:20.004482 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9ca313b3-10c1-47d1-a2dd-22765ce58e02 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:50:20.005136 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9ca313b3-10c1-47d1-a2dd-22765ce58e02 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 2b6a4335-8165-44ec-ab86-8fc7ba31d5de] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:50:20.012739 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9ca313b3-10c1-47d1-a2dd-22765ce58e02 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:20.013469 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9ca313b3-10c1-47d1-a2dd-22765ce58e02 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:20.014237 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9ca313b3-10c1-47d1-a2dd-22765ce58e02 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:20.014674 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9ca313b3-10c1-47d1-a2dd-22765ce58e02 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:20.040776 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9ca313b3-10c1-47d1-a2dd-22765ce58e02 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 2b6a4335-8165-44ec-ab86-8fc7ba31d5de] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:50:20.361550 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9ca313b3-10c1-47d1-a2dd-22765ce58e02 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "DELETE /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de" status: 204 len: 0 microversion: 2.1 time: 0.360889 Jun 10 18:50:20.362147 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3592/7214] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:50:19 2022] DELETE /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 18:50:20.367840 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-4c68eac4-d724-48c7-ad02-1f4411465316 req-3aaad1b9-07c2-44f9-a715-bec49923e550 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b6a4335-8165-44ec-ab86-8fc7ba31d5de", "tag": "4a7bc54b-0522-40d3-95a8-d5182e029df6"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:50:20.375867 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-4c68eac4-d724-48c7-ad02-1f4411465316 req-3aaad1b9-07c2-44f9-a715-bec49923e550 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:20.376330 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-4c68eac4-d724-48c7-ad02-1f4411465316 req-3aaad1b9-07c2-44f9-a715-bec49923e550 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:20.390792 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-4c68eac4-d724-48c7-ad02-1f4411465316 req-3aaad1b9-07c2-44f9-a715-bec49923e550 service nova] Creating event network-changed:4a7bc54b-0522-40d3-95a8-d5182e029df6 for instance 2b6a4335-8165-44ec-ab86-8fc7ba31d5de on chh1-master-2 Jun 10 18:50:20.404668 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-4c68eac4-d724-48c7-ad02-1f4411465316 req-3aaad1b9-07c2-44f9-a715-bec49923e550 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032612 Jun 10 18:50:20.404668 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3593/7215] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:50:20.404668 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8386939d-0c79-47ea-a2b8-07c742d300ef tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:50:20.404668 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8386939d-0c79-47ea-a2b8-07c742d300ef tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 2b6a4335-8165-44ec-ab86-8fc7ba31d5de] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:50:20.409098 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8386939d-0c79-47ea-a2b8-07c742d300ef tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:20.409554 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8386939d-0c79-47ea-a2b8-07c742d300ef tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:20.410327 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8386939d-0c79-47ea-a2b8-07c742d300ef tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:20.410827 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8386939d-0c79-47ea-a2b8-07c742d300ef tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:20.553969 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8386939d-0c79-47ea-a2b8-07c742d300ef tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:50:20.561630 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8386939d-0c79-47ea-a2b8-07c742d300ef tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de" status: 200 len: 1576 microversion: 2.1 time: 0.163696 Jun 10 18:50:20.562214 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3594/7216] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:50:20 2022] GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:50:21.579070 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fa31df94-4323-4eb4-bee4-0f53bb4c15a8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:50:21.579784 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fa31df94-4323-4eb4-bee4-0f53bb4c15a8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 2b6a4335-8165-44ec-ab86-8fc7ba31d5de] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:50:21.587403 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa31df94-4323-4eb4-bee4-0f53bb4c15a8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:21.588548 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa31df94-4323-4eb4-bee4-0f53bb4c15a8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:21.588719 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa31df94-4323-4eb4-bee4-0f53bb4c15a8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:21.589108 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa31df94-4323-4eb4-bee4-0f53bb4c15a8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:21.657310 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fa31df94-4323-4eb4-bee4-0f53bb4c15a8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:50:21.664119 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fa31df94-4323-4eb4-bee4-0f53bb4c15a8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de" status: 200 len: 1390 microversion: 2.1 time: 0.088929 Jun 10 18:50:21.664874 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3595/7217] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:50:21 2022] GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:50:22.411426 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-3cf1b755-bac7-404d-b0a1-bf65b5e42dea req-680989ef-51f1-4702-acc0-ee05d5b68465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b6a4335-8165-44ec-ab86-8fc7ba31d5de", "name": "network-vif-deleted", "tag": "4a7bc54b-0522-40d3-95a8-d5182e029df6"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:50:22.420002 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-3cf1b755-bac7-404d-b0a1-bf65b5e42dea req-680989ef-51f1-4702-acc0-ee05d5b68465 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:22.420451 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-3cf1b755-bac7-404d-b0a1-bf65b5e42dea req-680989ef-51f1-4702-acc0-ee05d5b68465 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:22.431996 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-3cf1b755-bac7-404d-b0a1-bf65b5e42dea req-680989ef-51f1-4702-acc0-ee05d5b68465 service nova] Creating event network-vif-deleted:4a7bc54b-0522-40d3-95a8-d5182e029df6 for instance 2b6a4335-8165-44ec-ab86-8fc7ba31d5de on chh1-master-2 Jun 10 18:50:22.437007 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-3cf1b755-bac7-404d-b0a1-bf65b5e42dea req-680989ef-51f1-4702-acc0-ee05d5b68465 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029157 Jun 10 18:50:22.437618 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3596/7218] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:50:22.682445 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-161ac82f-b061-4ade-8f20-3b79f1f3a7d8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:50:22.683060 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-161ac82f-b061-4ade-8f20-3b79f1f3a7d8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 2b6a4335-8165-44ec-ab86-8fc7ba31d5de] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:50:22.689524 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-161ac82f-b061-4ade-8f20-3b79f1f3a7d8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:22.690024 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-161ac82f-b061-4ade-8f20-3b79f1f3a7d8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:22.690792 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-161ac82f-b061-4ade-8f20-3b79f1f3a7d8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:22.691226 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-161ac82f-b061-4ade-8f20-3b79f1f3a7d8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:22.696388 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:50:22.754468 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-161ac82f-b061-4ade-8f20-3b79f1f3a7d8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:50:22.763517 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-161ac82f-b061-4ade-8f20-3b79f1f3a7d8 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de" status: 200 len: 1224 microversion: 2.1 time: 0.086831 Jun 10 18:50:22.772571 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3597/7219] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:50:22 2022] GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:50:23.780224 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2608981c-e8ce-4860-a55d-b210785f37f7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:50:23.780877 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2608981c-e8ce-4860-a55d-b210785f37f7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 2b6a4335-8165-44ec-ab86-8fc7ba31d5de] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:50:23.788216 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2608981c-e8ce-4860-a55d-b210785f37f7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:23.788694 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2608981c-e8ce-4860-a55d-b210785f37f7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:23.789461 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2608981c-e8ce-4860-a55d-b210785f37f7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:23.789900 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2608981c-e8ce-4860-a55d-b210785f37f7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:23.852248 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2608981c-e8ce-4860-a55d-b210785f37f7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:50:23.861964 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2608981c-e8ce-4860-a55d-b210785f37f7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de" status: 200 len: 1224 microversion: 2.1 time: 0.085159 Jun 10 18:50:23.863013 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3598/7220] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:50:23 2022] GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:50:24.879247 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e50fe0a4-6760-4e84-bc1e-f605b3730be7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:50:24.879908 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e50fe0a4-6760-4e84-bc1e-f605b3730be7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 2b6a4335-8165-44ec-ab86-8fc7ba31d5de] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:50:24.886970 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e50fe0a4-6760-4e84-bc1e-f605b3730be7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:24.887432 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e50fe0a4-6760-4e84-bc1e-f605b3730be7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:24.888211 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e50fe0a4-6760-4e84-bc1e-f605b3730be7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:24.888683 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e50fe0a4-6760-4e84-bc1e-f605b3730be7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:24.953170 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e50fe0a4-6760-4e84-bc1e-f605b3730be7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:50:24.961481 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e50fe0a4-6760-4e84-bc1e-f605b3730be7 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de" status: 200 len: 1224 microversion: 2.1 time: 0.086282 Jun 10 18:50:24.962060 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3599/7221] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:50:24 2022] GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:50:25.978776 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-251c5dcd-f6a5-4b4a-b103-540a9f815213 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:50:25.979432 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-251c5dcd-f6a5-4b4a-b103-540a9f815213 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 2b6a4335-8165-44ec-ab86-8fc7ba31d5de] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:50:25.986412 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-251c5dcd-f6a5-4b4a-b103-540a9f815213 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:25.986870 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-251c5dcd-f6a5-4b4a-b103-540a9f815213 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:25.987719 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-251c5dcd-f6a5-4b4a-b103-540a9f815213 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:25.988088 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-251c5dcd-f6a5-4b4a-b103-540a9f815213 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:26.023765 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-251c5dcd-f6a5-4b4a-b103-540a9f815213 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:26.024146 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-251c5dcd-f6a5-4b4a-b103-540a9f815213 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:26.024630 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-251c5dcd-f6a5-4b4a-b103-540a9f815213 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lazy-loading 'fault' on Instance uuid 2b6a4335-8165-44ec-ab86-8fc7ba31d5de {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:50:26.067562 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-251c5dcd-f6a5-4b4a-b103-540a9f815213 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b469a8f9433d422aa98d22eea9df7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9c656d484843ffb1f2de092730345b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:50:26.075706 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-251c5dcd-f6a5-4b4a-b103-540a9f815213 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de" status: 200 len: 1229 microversion: 2.1 time: 0.101014 Jun 10 18:50:26.076285 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3600/7222] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:50:25 2022] GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de => generated 1229 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:50:27.093509 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ea2d9101-aac3-42af-95fb-18b601d23564 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:50:27.094127 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ea2d9101-aac3-42af-95fb-18b601d23564 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: 2b6a4335-8165-44ec-ab86-8fc7ba31d5de] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:50:27.101092 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ea2d9101-aac3-42af-95fb-18b601d23564 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:27.101562 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ea2d9101-aac3-42af-95fb-18b601d23564 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:27.102337 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ea2d9101-aac3-42af-95fb-18b601d23564 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:27.102815 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ea2d9101-aac3-42af-95fb-18b601d23564 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:27.116542 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-ea2d9101-aac3-42af-95fb-18b601d23564 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] HTTP exception thrown: Instance 2b6a4335-8165-44ec-ab86-8fc7ba31d5de could not be found. Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ea2d9101-aac3-42af-95fb-18b601d23564 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Request method failure captured: Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de HTTP/1.1 Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio48lCBpBlRizgNQmj6c6iu0oXkmc5Tm-q4miwv2Pj49f2pUTZFT27dYtKGefFULH5-gcByMQrPeG1d5YVOJ_GuLGrptrh59AcDYu37Uta2nd4eDA1xNIrohvrn1bdHxnfVCnt0fGjpM3LVpc7O3my-1igIi7pJV4HqsUallplG6Y66g Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 7e9c656d484843ffb1f2de092730345b Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_7e9c656d484843ffb1f2de092730345b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 7e9c656d484843ffb1f2de092730345b Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-TestVolumeBootPattern-1765437769-project Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: b469a8f9433d422aa98d22eea9df7071 Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-TestVolumeBootPattern-1765437769-project Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 2b6a4335-8165-44ec-ab86-8fc7ba31d5de could not be found. Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '2b6a4335-8165-44ec-ab86-8fc7ba31d5de'} Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b6a4335-8165-44ec-ab86-8fc7ba31d5de could not be found. Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b6a4335-8165-44ec-ab86-8fc7ba31d5de could not be found. Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:50:27.118177 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:50:27.123385 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:50:27.123385 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:50:27.123385 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:50:27.123385 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:50:27.123385 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:50:27.123385 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b6a4335-8165-44ec-ab86-8fc7ba31d5de could not be found. Jun 10 18:50:27.123385 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:50:27.123385 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ea2d9101-aac3-42af-95fb-18b601d23564 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Returning 404 to user: Instance 2b6a4335-8165-44ec-ab86-8fc7ba31d5de could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:50:27.123385 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ea2d9101-aac3-42af-95fb-18b601d23564 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de" status: 404 len: 111 microversion: 2.1 time: 0.030120 Jun 10 18:50:27.123385 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3601/7223] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:50:27 2022] GET /compute/v2.1/servers/2b6a4335-8165-44ec-ab86-8fc7ba31d5de => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:50:27.614309 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-960ba4ad-e3cd-4b39-acda-b37fc4f1dc10 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:50:27.615456 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-960ba4ad-e3cd-4b39-acda-b37fc4f1dc10 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: d44d141b-de49-4325-a2ec-170462103055] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:50:27.621492 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-960ba4ad-e3cd-4b39-acda-b37fc4f1dc10 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:27.621944 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-960ba4ad-e3cd-4b39-acda-b37fc4f1dc10 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:27.622700 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-960ba4ad-e3cd-4b39-acda-b37fc4f1dc10 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:27.623142 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-960ba4ad-e3cd-4b39-acda-b37fc4f1dc10 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:27.636503 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-960ba4ad-e3cd-4b39-acda-b37fc4f1dc10 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] HTTP exception thrown: Instance d44d141b-de49-4325-a2ec-170462103055 could not be found. Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-960ba4ad-e3cd-4b39-acda-b37fc4f1dc10 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Request method failure captured: Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055 HTTP/1.1 Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio48lCBpBlRizgNQmj6c6iu0oXkmc5Tm-q4miwv2Pj49f2pUTZFT27dYtKGefFULH5-gcByMQrPeG1d5YVOJ_GuLGrptrh59AcDYu37Uta2nd4eDA1xNIrohvrn1bdHxnfVCnt0fGjpM3LVpc7O3my-1igIi7pJV4HqsUallplG6Y66g Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 7e9c656d484843ffb1f2de092730345b Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_7e9c656d484843ffb1f2de092730345b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 7e9c656d484843ffb1f2de092730345b Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-TestVolumeBootPattern-1765437769-project Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: b469a8f9433d422aa98d22eea9df7071 Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-TestVolumeBootPattern-1765437769-project Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: exception: Instance d44d141b-de49-4325-a2ec-170462103055 could not be found. Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'd44d141b-de49-4325-a2ec-170462103055'} Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d44d141b-de49-4325-a2ec-170462103055 could not be found. Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:50:27.638025 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:50:27.642690 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d44d141b-de49-4325-a2ec-170462103055 could not be found. Jun 10 18:50:27.642690 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:50:27.642690 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:50:27.642690 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:50:27.642690 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:50:27.642690 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:50:27.642690 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:50:27.642690 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:50:27.642690 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:50:27.642690 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d44d141b-de49-4325-a2ec-170462103055 could not be found. Jun 10 18:50:27.642690 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:50:27.642690 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-960ba4ad-e3cd-4b39-acda-b37fc4f1dc10 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Returning 404 to user: Instance d44d141b-de49-4325-a2ec-170462103055 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:50:27.642690 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-960ba4ad-e3cd-4b39-acda-b37fc4f1dc10 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "DELETE /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055" status: 404 len: 111 microversion: 2.1 time: 0.028996 Jun 10 18:50:27.642690 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3602/7224] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:50:27 2022] DELETE /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:50:27.647749 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e7bd43b8-98e4-4767-bda1-429323c2ff86 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:50:27.648398 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e7bd43b8-98e4-4767-bda1-429323c2ff86 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [instance: d44d141b-de49-4325-a2ec-170462103055] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:50:27.654326 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e7bd43b8-98e4-4767-bda1-429323c2ff86 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:27.654773 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e7bd43b8-98e4-4767-bda1-429323c2ff86 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:27.655526 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e7bd43b8-98e4-4767-bda1-429323c2ff86 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:27.655962 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e7bd43b8-98e4-4767-bda1-429323c2ff86 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:27.669383 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-e7bd43b8-98e4-4767-bda1-429323c2ff86 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] HTTP exception thrown: Instance d44d141b-de49-4325-a2ec-170462103055 could not be found. Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e7bd43b8-98e4-4767-bda1-429323c2ff86 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Request method failure captured: Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055 HTTP/1.1 Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio48lCBpBlRizgNQmj6c6iu0oXkmc5Tm-q4miwv2Pj49f2pUTZFT27dYtKGefFULH5-gcByMQrPeG1d5YVOJ_GuLGrptrh59AcDYu37Uta2nd4eDA1xNIrohvrn1bdHxnfVCnt0fGjpM3LVpc7O3my-1igIi7pJV4HqsUallplG6Y66g Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 7e9c656d484843ffb1f2de092730345b Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7e9c656d484843ffb1f2de092730345b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_7e9c656d484843ffb1f2de092730345b", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 7e9c656d484843ffb1f2de092730345b Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-TestVolumeBootPattern-1765437769 Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-TestVolumeBootPattern-1765437769-project Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: b469a8f9433d422aa98d22eea9df7071 Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-TestVolumeBootPattern-1765437769-project Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: exception: Instance d44d141b-de49-4325-a2ec-170462103055 could not be found. Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'd44d141b-de49-4325-a2ec-170462103055'} Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d44d141b-de49-4325-a2ec-170462103055 could not be found. Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d44d141b-de49-4325-a2ec-170462103055 could not be found. Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:50:27.670801 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:50:27.675564 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:50:27.675564 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:50:27.675564 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:50:27.675564 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:50:27.675564 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:50:27.675564 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d44d141b-de49-4325-a2ec-170462103055 could not be found. Jun 10 18:50:27.675564 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:50:27.675564 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e7bd43b8-98e4-4767-bda1-429323c2ff86 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Returning 404 to user: Instance d44d141b-de49-4325-a2ec-170462103055 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:50:27.675564 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e7bd43b8-98e4-4767-bda1-429323c2ff86 tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055" status: 404 len: 111 microversion: 2.1 time: 0.027867 Jun 10 18:50:27.675564 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3603/7225] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:50:27 2022] GET /compute/v2.1/servers/d44d141b-de49-4325-a2ec-170462103055 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:50:31.251534 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a9c1aaaf-0a21-4ca2-9362-3c455186454b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] Calling method '.version_select at 0x7f77c03b0820>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:50:31.262974 chdv-master-2 devstack@n-api.service[126595]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a9c1aaaf-0a21-4ca2-9362-3c455186454b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [810142a8-37af-4b57-a57e-ca2623af985c] AMQP server on 10.222.0.35:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 10 18:50:32.272738 chdv-master-2 devstack@n-api.service[126595]: INFO oslo.messaging._drivers.impl_rabbit [None req-a9c1aaaf-0a21-4ca2-9362-3c455186454b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] [810142a8-37af-4b57-a57e-ca2623af985c] Reconnected to AMQP server on 10.222.0.35:5672 via [amqp] client with port 43878. Jun 10 18:50:32.345085 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a9c1aaaf-0a21-4ca2-9362-3c455186454b tempest-TestVolumeBootPattern-1765437769 tempest-TestVolumeBootPattern-1765437769-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-905098910" status: 202 len: 0 microversion: 2.1 time: 1.102727 Jun 10 18:50:32.345692 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3604/7226] 10.222.0.35 () {58 vars in 1259 bytes} [Fri Jun 10 18:50:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-905098910 => generated 0 bytes in 1104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:50:51.063037 chdv-master-2 devstack@n-api.service[126595]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 18:50:51.063792 chdv-master-2 devstack@n-api.service[126595]: Fri Jun 10 18:50:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 10 18:50:53.026203 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=30 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:50:53.027045 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:50:53.154443 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d2838f70-2874-4c57-81f3-b417053074f4 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1342044586", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:50:53.205874 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-d2838f70-2874-4c57-81f3-b417053074f4 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] validate_networks() for None {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:50:53.482492 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-d2838f70-2874-4c57-81f3-b417053074f4 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:50:53.482923 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-d2838f70-2874-4c57-81f3-b417053074f4 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:50:53.483436 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-d2838f70-2874-4c57-81f3-b417053074f4 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:50:53.483852 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-d2838f70-2874-4c57-81f3-b417053074f4 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:50:53.484270 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-d2838f70-2874-4c57-81f3-b417053074f4 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:50:53.493744 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d2838f70-2874-4c57-81f3-b417053074f4 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:53.494201 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d2838f70-2874-4c57-81f3-b417053074f4 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:53.495012 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d2838f70-2874-4c57-81f3-b417053074f4 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:53.495459 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d2838f70-2874-4c57-81f3-b417053074f4 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:53.513306 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-d2838f70-2874-4c57-81f3-b417053074f4 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Getting quotas for project 7f3bcc4b49734873a26ad2c3f3f6e989. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:50:53.518888 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-d2838f70-2874-4c57-81f3-b417053074f4 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Getting quotas for user a16fbdc04d3140b2b2d3b3d2f07fec53 and project 7f3bcc4b49734873a26ad2c3f3f6e989. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:50:53.531174 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d2838f70-2874-4c57-81f3-b417053074f4 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:50:53.533442 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d2838f70-2874-4c57-81f3-b417053074f4 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] [instance: 8ba65375-b2a6-4f09-96fd-da213bf02b16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:50:53.643319 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d2838f70-2874-4c57-81f3-b417053074f4 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.621453 Jun 10 18:50:53.643967 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3605/7227] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:50:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 10 18:50:53.654349 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6dacd83e-c5cb-4b7a-8d08-27aa0951ab85 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:50:53.654953 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6dacd83e-c5cb-4b7a-8d08-27aa0951ab85 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] [instance: 8ba65375-b2a6-4f09-96fd-da213bf02b16] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:50:53.711366 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6dacd83e-c5cb-4b7a-8d08-27aa0951ab85 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16fbdc04d3140b2b2d3b3d2f07fec53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bcc4b49734873a26ad2c3f3f6e989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:50:53.718262 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6dacd83e-c5cb-4b7a-8d08-27aa0951ab85 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] 10.222.0.35 "GET /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16" status: 200 len: 1222 microversion: 2.1 time: 0.067566 Jun 10 18:50:53.718833 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3606/7228] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:50:53 2022] GET /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16 => generated 1222 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:50:54.735088 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bf3e9c13-59a4-4272-b6e8-c8e3d8eddb96 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:50:54.735878 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bf3e9c13-59a4-4272-b6e8-c8e3d8eddb96 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] [instance: 8ba65375-b2a6-4f09-96fd-da213bf02b16] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:50:54.792368 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bf3e9c13-59a4-4272-b6e8-c8e3d8eddb96 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16fbdc04d3140b2b2d3b3d2f07fec53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bcc4b49734873a26ad2c3f3f6e989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:50:54.799114 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bf3e9c13-59a4-4272-b6e8-c8e3d8eddb96 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] 10.222.0.35 "GET /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16" status: 200 len: 1222 microversion: 2.1 time: 0.067933 Jun 10 18:50:54.799674 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3607/7229] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:50:54 2022] GET /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16 => generated 1222 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:50:55.815056 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d5054c73-d606-4699-ac01-5f7b09a80420 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:50:55.816093 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d5054c73-d606-4699-ac01-5f7b09a80420 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] [instance: 8ba65375-b2a6-4f09-96fd-da213bf02b16] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:50:55.823630 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d5054c73-d606-4699-ac01-5f7b09a80420 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:55.824085 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d5054c73-d606-4699-ac01-5f7b09a80420 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:55.824888 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d5054c73-d606-4699-ac01-5f7b09a80420 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:55.825456 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d5054c73-d606-4699-ac01-5f7b09a80420 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:55.896556 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d5054c73-d606-4699-ac01-5f7b09a80420 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16fbdc04d3140b2b2d3b3d2f07fec53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bcc4b49734873a26ad2c3f3f6e989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:50:55.904592 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d5054c73-d606-4699-ac01-5f7b09a80420 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] 10.222.0.35 "GET /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16" status: 200 len: 1226 microversion: 2.1 time: 0.093401 Jun 10 18:50:55.905150 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3608/7230] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:50:55 2022] GET /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:50:56.921426 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d185f953-7676-4732-967f-7db1ebf6af80 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:50:56.922038 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d185f953-7676-4732-967f-7db1ebf6af80 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] [instance: 8ba65375-b2a6-4f09-96fd-da213bf02b16] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:50:56.929733 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d185f953-7676-4732-967f-7db1ebf6af80 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:56.930184 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d185f953-7676-4732-967f-7db1ebf6af80 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:56.930997 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d185f953-7676-4732-967f-7db1ebf6af80 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:56.931437 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d185f953-7676-4732-967f-7db1ebf6af80 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:56.992502 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d185f953-7676-4732-967f-7db1ebf6af80 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16fbdc04d3140b2b2d3b3d2f07fec53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bcc4b49734873a26ad2c3f3f6e989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:50:57.000042 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d185f953-7676-4732-967f-7db1ebf6af80 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] 10.222.0.35 "GET /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16" status: 200 len: 1226 microversion: 2.1 time: 0.082539 Jun 10 18:50:57.000724 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3609/7231] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:50:56 2022] GET /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:50:58.016572 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d096b57a-2021-4b17-aa46-b2dd82fc816d tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:50:58.017242 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d096b57a-2021-4b17-aa46-b2dd82fc816d tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] [instance: 8ba65375-b2a6-4f09-96fd-da213bf02b16] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:50:58.024496 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d096b57a-2021-4b17-aa46-b2dd82fc816d tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:58.024960 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d096b57a-2021-4b17-aa46-b2dd82fc816d tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:58.025736 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d096b57a-2021-4b17-aa46-b2dd82fc816d tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:58.026184 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d096b57a-2021-4b17-aa46-b2dd82fc816d tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:58.109306 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d096b57a-2021-4b17-aa46-b2dd82fc816d tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16fbdc04d3140b2b2d3b3d2f07fec53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bcc4b49734873a26ad2c3f3f6e989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:50:58.118535 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d096b57a-2021-4b17-aa46-b2dd82fc816d tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] 10.222.0.35 "GET /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16" status: 200 len: 1292 microversion: 2.1 time: 0.105915 Jun 10 18:50:58.119127 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3610/7232] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:50:58 2022] GET /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16 => generated 1292 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:50:59.135063 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d509d898-d2d9-4585-8e9d-89a8dafe0c3c tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:50:59.135772 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d509d898-d2d9-4585-8e9d-89a8dafe0c3c tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] [instance: 8ba65375-b2a6-4f09-96fd-da213bf02b16] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:50:59.142891 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d509d898-d2d9-4585-8e9d-89a8dafe0c3c tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:59.143349 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d509d898-d2d9-4585-8e9d-89a8dafe0c3c tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:59.144179 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d509d898-d2d9-4585-8e9d-89a8dafe0c3c tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:59.144591 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d509d898-d2d9-4585-8e9d-89a8dafe0c3c tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:59.322044 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d509d898-d2d9-4585-8e9d-89a8dafe0c3c tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16fbdc04d3140b2b2d3b3d2f07fec53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bcc4b49734873a26ad2c3f3f6e989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:50:59.329592 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d509d898-d2d9-4585-8e9d-89a8dafe0c3c tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] 10.222.0.35 "GET /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16" status: 200 len: 1322 microversion: 2.1 time: 0.198471 Jun 10 18:50:59.335629 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3611/7233] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:50:59 2022] GET /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16 => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:50:59.714671 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-26a65f5d-ec38-4dec-8968-583f308dbb9a req-0d6422cb-ac65-4a47-a85c-49077fbacb82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ba65375-b2a6-4f09-96fd-da213bf02b16", "tag": "61f2c866-2fd9-4cdb-9a3c-0ba9e56b4e24"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:50:59.723385 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-26a65f5d-ec38-4dec-8968-583f308dbb9a req-0d6422cb-ac65-4a47-a85c-49077fbacb82 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:50:59.723833 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-26a65f5d-ec38-4dec-8968-583f308dbb9a req-0d6422cb-ac65-4a47-a85c-49077fbacb82 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:50:59.735548 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-26a65f5d-ec38-4dec-8968-583f308dbb9a req-0d6422cb-ac65-4a47-a85c-49077fbacb82 service nova] Creating event network-changed:61f2c866-2fd9-4cdb-9a3c-0ba9e56b4e24 for instance 8ba65375-b2a6-4f09-96fd-da213bf02b16 on chh1-master-2 Jun 10 18:50:59.740798 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-26a65f5d-ec38-4dec-8968-583f308dbb9a req-0d6422cb-ac65-4a47-a85c-49077fbacb82 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032502 Jun 10 18:50:59.742389 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3612/7234] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:51:00.348618 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6e1f4037-cb64-4b97-979a-cf48fc34941e tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:00.349317 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6e1f4037-cb64-4b97-979a-cf48fc34941e tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] [instance: 8ba65375-b2a6-4f09-96fd-da213bf02b16] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:00.358133 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6e1f4037-cb64-4b97-979a-cf48fc34941e tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:00.358597 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6e1f4037-cb64-4b97-979a-cf48fc34941e tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:00.359373 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6e1f4037-cb64-4b97-979a-cf48fc34941e tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:00.360039 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6e1f4037-cb64-4b97-979a-cf48fc34941e tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:00.576281 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6e1f4037-cb64-4b97-979a-cf48fc34941e tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16fbdc04d3140b2b2d3b3d2f07fec53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bcc4b49734873a26ad2c3f3f6e989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:00.585559 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6e1f4037-cb64-4b97-979a-cf48fc34941e tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] 10.222.0.35 "GET /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16" status: 200 len: 1322 microversion: 2.1 time: 0.242009 Jun 10 18:51:00.586546 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3613/7235] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:00 2022] GET /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16 => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:51:01.602236 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0ebae326-626b-4c7a-8461-7dff5885b9f5 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:01.602882 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0ebae326-626b-4c7a-8461-7dff5885b9f5 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] [instance: 8ba65375-b2a6-4f09-96fd-da213bf02b16] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:01.609797 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0ebae326-626b-4c7a-8461-7dff5885b9f5 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:01.610251 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0ebae326-626b-4c7a-8461-7dff5885b9f5 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:01.611016 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0ebae326-626b-4c7a-8461-7dff5885b9f5 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:01.611458 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0ebae326-626b-4c7a-8461-7dff5885b9f5 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:01.737474 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0ebae326-626b-4c7a-8461-7dff5885b9f5 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16fbdc04d3140b2b2d3b3d2f07fec53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bcc4b49734873a26ad2c3f3f6e989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:01.745481 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0ebae326-626b-4c7a-8461-7dff5885b9f5 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] 10.222.0.35 "GET /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16" status: 200 len: 1322 microversion: 2.1 time: 0.147143 Jun 10 18:51:01.746059 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3614/7236] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:01 2022] GET /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:51:02.762491 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e9eeb689-3875-49d5-b621-a26e3e776e16 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:02.763183 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e9eeb689-3875-49d5-b621-a26e3e776e16 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] [instance: 8ba65375-b2a6-4f09-96fd-da213bf02b16] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:02.770335 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e9eeb689-3875-49d5-b621-a26e3e776e16 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:02.770791 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e9eeb689-3875-49d5-b621-a26e3e776e16 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:02.771555 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e9eeb689-3875-49d5-b621-a26e3e776e16 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:02.771997 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e9eeb689-3875-49d5-b621-a26e3e776e16 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:02.902848 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e9eeb689-3875-49d5-b621-a26e3e776e16 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16fbdc04d3140b2b2d3b3d2f07fec53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bcc4b49734873a26ad2c3f3f6e989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:02.910413 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e9eeb689-3875-49d5-b621-a26e3e776e16 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] 10.222.0.35 "GET /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16" status: 200 len: 1322 microversion: 2.1 time: 0.151990 Jun 10 18:51:02.910985 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3615/7237] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:02 2022] GET /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:51:03.927088 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e4d1436f-0563-4192-a650-3895469cf879 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:03.927758 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e4d1436f-0563-4192-a650-3895469cf879 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] [instance: 8ba65375-b2a6-4f09-96fd-da213bf02b16] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:03.930227 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:51:03.936076 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e4d1436f-0563-4192-a650-3895469cf879 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:03.942501 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e4d1436f-0563-4192-a650-3895469cf879 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:03.942501 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e4d1436f-0563-4192-a650-3895469cf879 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:03.942501 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e4d1436f-0563-4192-a650-3895469cf879 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:04.072628 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e4d1436f-0563-4192-a650-3895469cf879 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16fbdc04d3140b2b2d3b3d2f07fec53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bcc4b49734873a26ad2c3f3f6e989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:04.080194 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e4d1436f-0563-4192-a650-3895469cf879 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] 10.222.0.35 "GET /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16" status: 200 len: 1322 microversion: 2.1 time: 0.157000 Jun 10 18:51:04.090063 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3616/7238] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:03 2022] GET /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:51:05.097759 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4e5e32db-9b27-4b46-9325-8407c9987d05 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:05.098356 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4e5e32db-9b27-4b46-9325-8407c9987d05 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] [instance: 8ba65375-b2a6-4f09-96fd-da213bf02b16] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:05.100287 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=10 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:51:05.106039 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e5e32db-9b27-4b46-9325-8407c9987d05 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:05.112457 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e5e32db-9b27-4b46-9325-8407c9987d05 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:05.112457 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e5e32db-9b27-4b46-9325-8407c9987d05 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:05.112457 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e5e32db-9b27-4b46-9325-8407c9987d05 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:05.242927 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4e5e32db-9b27-4b46-9325-8407c9987d05 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16fbdc04d3140b2b2d3b3d2f07fec53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bcc4b49734873a26ad2c3f3f6e989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:05.250421 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4e5e32db-9b27-4b46-9325-8407c9987d05 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] 10.222.0.35 "GET /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16" status: 200 len: 1322 microversion: 2.1 time: 0.156656 Jun 10 18:51:05.251003 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3617/7239] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:05 2022] GET /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:51:06.273358 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ea87ff93-2395-4f6b-ba3e-1eafffd78ffc tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:06.273358 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ea87ff93-2395-4f6b-ba3e-1eafffd78ffc tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] [instance: 8ba65375-b2a6-4f09-96fd-da213bf02b16] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:06.276605 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ea87ff93-2395-4f6b-ba3e-1eafffd78ffc tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:06.277138 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ea87ff93-2395-4f6b-ba3e-1eafffd78ffc tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:06.278003 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ea87ff93-2395-4f6b-ba3e-1eafffd78ffc tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:06.278538 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ea87ff93-2395-4f6b-ba3e-1eafffd78ffc tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:06.414157 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ea87ff93-2395-4f6b-ba3e-1eafffd78ffc tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16fbdc04d3140b2b2d3b3d2f07fec53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bcc4b49734873a26ad2c3f3f6e989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:06.423168 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ea87ff93-2395-4f6b-ba3e-1eafffd78ffc tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] 10.222.0.35 "GET /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16" status: 200 len: 1322 microversion: 2.1 time: 0.159660 Jun 10 18:51:06.423741 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3618/7240] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:06 2022] GET /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:51:06.491931 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-8359886e-d40c-48d5-be1a-684676618370 req-3a76eec7-e31f-4014-b061-dfc13939b8db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ba65375-b2a6-4f09-96fd-da213bf02b16", "name": "network-vif-plugged", "status": "completed", "tag": "61f2c866-2fd9-4cdb-9a3c-0ba9e56b4e24"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:51:06.500057 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-8359886e-d40c-48d5-be1a-684676618370 req-3a76eec7-e31f-4014-b061-dfc13939b8db service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:06.500561 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-8359886e-d40c-48d5-be1a-684676618370 req-3a76eec7-e31f-4014-b061-dfc13939b8db service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:06.511927 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-8359886e-d40c-48d5-be1a-684676618370 req-3a76eec7-e31f-4014-b061-dfc13939b8db service nova] Creating event network-vif-plugged:61f2c866-2fd9-4cdb-9a3c-0ba9e56b4e24 for instance 8ba65375-b2a6-4f09-96fd-da213bf02b16 on chh1-master-2 Jun 10 18:51:06.517265 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-8359886e-d40c-48d5-be1a-684676618370 req-3a76eec7-e31f-4014-b061-dfc13939b8db service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092334 Jun 10 18:51:06.518342 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3619/7241] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:51:07.440987 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c388eda7-d56f-4533-964a-ab61639ead56 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:07.441698 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c388eda7-d56f-4533-964a-ab61639ead56 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] [instance: 8ba65375-b2a6-4f09-96fd-da213bf02b16] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:07.449588 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c388eda7-d56f-4533-964a-ab61639ead56 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:07.450040 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c388eda7-d56f-4533-964a-ab61639ead56 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:07.450811 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c388eda7-d56f-4533-964a-ab61639ead56 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:07.451252 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c388eda7-d56f-4533-964a-ab61639ead56 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:07.595679 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c388eda7-d56f-4533-964a-ab61639ead56 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16fbdc04d3140b2b2d3b3d2f07fec53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bcc4b49734873a26ad2c3f3f6e989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:07.603244 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c388eda7-d56f-4533-964a-ab61639ead56 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] 10.222.0.35 "GET /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16" status: 200 len: 1322 microversion: 2.1 time: 0.166561 Jun 10 18:51:07.603813 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3620/7242] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:07 2022] GET /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:51:08.619913 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c94d7c4d-760c-47a7-b4c2-76d0e30b4489 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:08.620628 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c94d7c4d-760c-47a7-b4c2-76d0e30b4489 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] [instance: 8ba65375-b2a6-4f09-96fd-da213bf02b16] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:08.627459 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c94d7c4d-760c-47a7-b4c2-76d0e30b4489 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:08.794183 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c94d7c4d-760c-47a7-b4c2-76d0e30b4489 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:08.794183 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c94d7c4d-760c-47a7-b4c2-76d0e30b4489 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:08.794183 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c94d7c4d-760c-47a7-b4c2-76d0e30b4489 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:08.794183 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c94d7c4d-760c-47a7-b4c2-76d0e30b4489 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16fbdc04d3140b2b2d3b3d2f07fec53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bcc4b49734873a26ad2c3f3f6e989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:08.794183 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c94d7c4d-760c-47a7-b4c2-76d0e30b4489 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] 10.222.0.35 "GET /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16" status: 200 len: 1472 microversion: 2.1 time: 0.163296 Jun 10 18:51:08.794183 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3621/7243] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:08 2022] GET /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16 => generated 1472 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:51:08.853088 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-022bbebf-45ad-4dd3-8aee-53449f5432a0 tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] Calling method '.version_select at 0x7f77b3c6d700>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:08.920491 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-022bbebf-45ad-4dd3-8aee-53449f5432a0 tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] 10.222.0.35 "GET /compute/v2.1/os-quota-sets/1afa7724bc0b4e57bcb82f515b794578" status: 200 len: 371 microversion: 2.1 time: 0.120036 Jun 10 18:51:08.921070 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3622/7244] 10.222.0.35 () {58 vars in 1241 bytes} [Fri Jun 10 18:51:08 2022] GET /compute/v2.1/os-quota-sets/1afa7724bc0b4e57bcb82f515b794578 => generated 371 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:51:08.931186 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6d0b44ca-0092-4616-92ee-b8b371382544 tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-137279460", "id": 2085036602, "os-flavor-access:is_public": "True"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:51:08.932845 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:51:08.932845 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 18:51:09.012043 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6d0b44ca-0092-4616-92ee-b8b371382544 tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.084333 Jun 10 18:51:09.012660 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3623/7245] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:51:08 2022] POST /compute/v2.1/flavors => generated 437 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:51:09.023208 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-30b36d29-b2d4-4138-a07b-bb747c7e7cc9 tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2085036602"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:51:09.024161 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-30b36d29-b2d4-4138-a07b-bb747c7e7cc9 tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] [instance: 8ba65375-b2a6-4f09-96fd-da213bf02b16] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:09.030501 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30b36d29-b2d4-4138-a07b-bb747c7e7cc9 tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:09.030956 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30b36d29-b2d4-4138-a07b-bb747c7e7cc9 tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:09.031722 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30b36d29-b2d4-4138-a07b-bb747c7e7cc9 tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:09.032172 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30b36d29-b2d4-4138-a07b-bb747c7e7cc9 tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:09.221258 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-30b36d29-b2d4-4138-a07b-bb747c7e7cc9 tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'ad359a923eba4334b5a075ba4ce7ea09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afa7724bc0b4e57bcb82f515b794578', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:09.228698 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-30b36d29-b2d4-4138-a07b-bb747c7e7cc9 tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] [instance: 8ba65375-b2a6-4f09-96fd-da213bf02b16] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-137279460 {{(pid=126595) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 10 18:51:09.235263 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30b36d29-b2d4-4138-a07b-bb747c7e7cc9 tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:09.235737 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30b36d29-b2d4-4138-a07b-bb747c7e7cc9 tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:09.236640 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30b36d29-b2d4-4138-a07b-bb747c7e7cc9 tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:09.237995 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30b36d29-b2d4-4138-a07b-bb747c7e7cc9 tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:09.260403 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-30b36d29-b2d4-4138-a07b-bb747c7e7cc9 tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] Getting quotas for project 7f3bcc4b49734873a26ad2c3f3f6e989. Resources: {'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:51:09.265388 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-30b36d29-b2d4-4138-a07b-bb747c7e7cc9 tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] Getting quotas for user a16fbdc04d3140b2b2d3b3d2f07fec53 and project 7f3bcc4b49734873a26ad2c3f3f6e989. Resources: {'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:51:09.278059 chdv-master-2 devstack@n-api.service[126595]: INFO nova.compute.api [None req-30b36d29-b2d4-4138-a07b-bb747c7e7cc9 tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] ram quota exceeded for 1afa7724bc0b4e57bcb82f515b794578, tried to resize instance. Jun 10 18:51:09.278599 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-30b36d29-b2d4-4138-a07b-bb747c7e7cc9 tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-30b36d29-b2d4-4138-a07b-bb747c7e7cc9 tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] Request method failure captured: Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16/action HTTP/1.1 Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 39 Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5KM84ciBMKI_6kDbDzG5POIWM5sOtZVzr5MY7-332KWn_Do2pSG1IpL-4egLhbtDAT1poLA-ObwRW7LlR5aSAH0Y73HNc8ETKPhOpAql-W-4rpYGySWUXr5_slZlwrwdRhYs8ZxLJw4Ze9tAD8piQPf1FB2z4icGmu4C8IFU5bdwyI Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 1afa7724bc0b4e57bcb82f515b794578 Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-807607126 Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member,admin Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member,admin Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1afa7724bc0b4e57bcb82f515b794578"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1afa7724bc0b4e57bcb82f515b794578"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1afa7724bc0b4e57bcb82f515b794578"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1afa7724bc0b4e57bcb82f515b794578", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersAdminNegativeTestJSON-807607126 Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 1afa7724bc0b4e57bcb82f515b794578 Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-807607126 Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersAdminNegativeTestJSON-807607126-project-admin Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: ad359a923eba4334b5a075ba4ce7ea09 Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersAdminNegativeTestJSON-807607126-project-admin Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: {"resize": {"flavorRef": "2085036602"}} Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '8ba65375-b2a6-4f09-96fd-da213bf02b16', 'body': {'resize': {'flavorRef': '2085036602'}}} Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 10 18:51:09.287948 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-30b36d29-b2d4-4138-a07b-bb747c7e7cc9 tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-30b36d29-b2d4-4138-a07b-bb747c7e7cc9 tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] 10.222.0.35 "POST /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16/action" status: 403 len: 118 microversion: 2.1 time: 0.269830 Jun 10 18:51:09.293163 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3624/7246] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:51:09 2022] POST /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16/action => generated 118 bytes in 271 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:51:09.297836 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d8ec834c-e3f0-42d7-96bd-486e00d3e7c7 tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:09.298574 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:51:09.298574 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 18:51:09.383867 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d8ec834c-e3f0-42d7-96bd-486e00d3e7c7 tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] 10.222.0.35 "DELETE /compute/v2.1/flavors/2085036602" status: 202 len: 0 microversion: 2.1 time: 0.089339 Jun 10 18:51:09.384450 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3625/7247] 10.222.0.35 () {58 vars in 1160 bytes} [Fri Jun 10 18:51:09 2022] DELETE /compute/v2.1/flavors/2085036602 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 18:51:09.391626 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-492b2649-7265-4918-8c10-1e220a74e1fa tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:09.411248 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-492b2649-7265-4918-8c10-1e220a74e1fa tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022880 Jun 10 18:51:09.411816 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3626/7248] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 18:51:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:51:09.434922 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-43a6974f-073d-41b3-a787-b3ec87082ce2 tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] Calling method '.version_select at 0x7f77c03b0b80>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:09.502133 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-43a6974f-073d-41b3-a787-b3ec87082ce2 tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] 10.222.0.35 "GET /compute/v2.1/os-quota-sets/1afa7724bc0b4e57bcb82f515b794578" status: 200 len: 371 microversion: 2.1 time: 0.070929 Jun 10 18:51:09.502714 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3627/7249] 10.222.0.35 () {58 vars in 1241 bytes} [Fri Jun 10 18:51:09 2022] GET /compute/v2.1/os-quota-sets/1afa7724bc0b4e57bcb82f515b794578 => generated 371 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:51:09.513264 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-785e4b43-8b8f-4a76-8b91-0216962659ed tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1168941587", "id": 831317214, "os-flavor-access:is_public": "True"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:51:09.518138 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:51:09.518138 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 18:51:09.589110 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-785e4b43-8b8f-4a76-8b91-0216962659ed tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.079449 Jun 10 18:51:09.589713 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3628/7250] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:51:09 2022] POST /compute/v2.1/flavors => generated 434 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:51:09.600281 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-adf2b635-9fb1-4544-a777-b4834b926bea tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "831317214"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:51:09.602681 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-adf2b635-9fb1-4544-a777-b4834b926bea tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] [instance: 8ba65375-b2a6-4f09-96fd-da213bf02b16] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:09.607003 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-adf2b635-9fb1-4544-a777-b4834b926bea tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:09.607457 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-adf2b635-9fb1-4544-a777-b4834b926bea tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:09.608226 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-adf2b635-9fb1-4544-a777-b4834b926bea tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:09.608703 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-adf2b635-9fb1-4544-a777-b4834b926bea tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:09.636907 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-adf2b635-9fb1-4544-a777-b4834b926bea tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'ad359a923eba4334b5a075ba4ce7ea09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afa7724bc0b4e57bcb82f515b794578', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:09.642688 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-adf2b635-9fb1-4544-a777-b4834b926bea tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] [instance: 8ba65375-b2a6-4f09-96fd-da213bf02b16] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1168941587 {{(pid=126595) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 10 18:51:09.648886 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-adf2b635-9fb1-4544-a777-b4834b926bea tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:09.649342 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-adf2b635-9fb1-4544-a777-b4834b926bea tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:09.650153 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-adf2b635-9fb1-4544-a777-b4834b926bea tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:09.650597 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-adf2b635-9fb1-4544-a777-b4834b926bea tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:09.661013 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:51:09.671837 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-adf2b635-9fb1-4544-a777-b4834b926bea tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] Getting quotas for project 7f3bcc4b49734873a26ad2c3f3f6e989. Resources: {'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:51:09.676882 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-adf2b635-9fb1-4544-a777-b4834b926bea tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] Getting quotas for user a16fbdc04d3140b2b2d3b3d2f07fec53 and project 7f3bcc4b49734873a26ad2c3f3f6e989. Resources: {'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:51:09.687276 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:51:09.690927 chdv-master-2 devstack@n-api.service[126595]: INFO nova.compute.api [None req-adf2b635-9fb1-4544-a777-b4834b926bea tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] cores quota exceeded for 1afa7724bc0b4e57bcb82f515b794578, tried to resize instance. Jun 10 18:51:09.691468 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-adf2b635-9fb1-4544-a777-b4834b926bea tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-adf2b635-9fb1-4544-a777-b4834b926bea tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] Request method failure captured: Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16/action HTTP/1.1 Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 38 Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5KM84ciBMKI_6kDbDzG5POIWM5sOtZVzr5MY7-332KWn_Do2pSG1IpL-4egLhbtDAT1poLA-ObwRW7LlR5aSAH0Y73HNc8ETKPhOpAql-W-4rpYGySWUXr5_slZlwrwdRhYs8ZxLJw4Ze9tAD8piQPf1FB2z4icGmu4C8IFU5bdwyI Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 1afa7724bc0b4e57bcb82f515b794578 Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-807607126 Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member,admin Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member,admin Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1afa7724bc0b4e57bcb82f515b794578"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1afa7724bc0b4e57bcb82f515b794578"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1afa7724bc0b4e57bcb82f515b794578"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1afa7724bc0b4e57bcb82f515b794578", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersAdminNegativeTestJSON-807607126 Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 1afa7724bc0b4e57bcb82f515b794578 Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-807607126 Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersAdminNegativeTestJSON-807607126-project-admin Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: ad359a923eba4334b5a075ba4ce7ea09 Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersAdminNegativeTestJSON-807607126-project-admin Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: {"resize": {"flavorRef": "831317214"}} Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '8ba65375-b2a6-4f09-96fd-da213bf02b16', 'body': {'resize': {'flavorRef': '831317214'}}} Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 10 18:51:09.693499 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-adf2b635-9fb1-4544-a777-b4834b926bea tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-adf2b635-9fb1-4544-a777-b4834b926bea tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] 10.222.0.35 "POST /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16/action" status: 403 len: 113 microversion: 2.1 time: 0.098684 Jun 10 18:51:09.701870 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3629/7251] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:51:09 2022] POST /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16/action => generated 113 bytes in 100 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:51:09.705275 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9733221a-c2ef-40db-be7f-0cb8f38250f4 tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:09.705275 chdv-master-2 devstack@n-api.service[126595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 18:51:09.705275 chdv-master-2 devstack@n-api.service[126595]: warnings.warn(msg) Jun 10 18:51:09.777817 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9733221a-c2ef-40db-be7f-0cb8f38250f4 tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] 10.222.0.35 "DELETE /compute/v2.1/flavors/831317214" status: 202 len: 0 microversion: 2.1 time: 0.078027 Jun 10 18:51:09.778390 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3630/7252] 10.222.0.35 () {58 vars in 1157 bytes} [Fri Jun 10 18:51:09 2022] DELETE /compute/v2.1/flavors/831317214 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 18:51:09.786139 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8e4f11d4-510e-4e6e-bfe4-92942fe9f35e tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:09.805289 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8e4f11d4-510e-4e6e-bfe4-92942fe9f35e tempest-ServersAdminNegativeTestJSON-807607126 tempest-ServersAdminNegativeTestJSON-807607126-project-admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022613 Jun 10 18:51:09.805838 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3631/7253] 10.222.0.35 () {58 vars in 1145 bytes} [Fri Jun 10 18:51:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:51:09.821963 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9f97bbd6-6441-4ada-8625-da6b880928f7 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:09.822468 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9f97bbd6-6441-4ada-8625-da6b880928f7 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] [instance: 8ba65375-b2a6-4f09-96fd-da213bf02b16] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:09.829956 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f97bbd6-6441-4ada-8625-da6b880928f7 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:09.835224 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f97bbd6-6441-4ada-8625-da6b880928f7 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:09.835224 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f97bbd6-6441-4ada-8625-da6b880928f7 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:09.835224 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f97bbd6-6441-4ada-8625-da6b880928f7 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:09.858839 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9f97bbd6-6441-4ada-8625-da6b880928f7 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] [instance: 8ba65375-b2a6-4f09-96fd-da213bf02b16] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:51:10.097653 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9f97bbd6-6441-4ada-8625-da6b880928f7 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] 10.222.0.35 "DELETE /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16" status: 204 len: 0 microversion: 2.1 time: 0.278931 Jun 10 18:51:10.098284 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3632/7254] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:51:09 2022] DELETE /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 18:51:10.109313 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-36079eab-b4bd-4a9a-a71c-92211b4179f4 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:10.110147 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-36079eab-b4bd-4a9a-a71c-92211b4179f4 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] [instance: 8ba65375-b2a6-4f09-96fd-da213bf02b16] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:10.117081 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-36079eab-b4bd-4a9a-a71c-92211b4179f4 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:10.117534 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-36079eab-b4bd-4a9a-a71c-92211b4179f4 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:10.118356 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-36079eab-b4bd-4a9a-a71c-92211b4179f4 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:10.118799 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-36079eab-b4bd-4a9a-a71c-92211b4179f4 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:10.248540 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-36079eab-b4bd-4a9a-a71c-92211b4179f4 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16fbdc04d3140b2b2d3b3d2f07fec53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bcc4b49734873a26ad2c3f3f6e989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:10.256091 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-36079eab-b4bd-4a9a-a71c-92211b4179f4 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] 10.222.0.35 "GET /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16" status: 200 len: 1478 microversion: 2.1 time: 0.152012 Jun 10 18:51:10.256693 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3633/7255] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:10 2022] GET /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16 => generated 1478 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:51:11.274224 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bd2f2b4e-d783-4fdc-8656-b6a1d6459b0d tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:11.274995 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bd2f2b4e-d783-4fdc-8656-b6a1d6459b0d tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] [instance: 8ba65375-b2a6-4f09-96fd-da213bf02b16] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:11.281869 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bd2f2b4e-d783-4fdc-8656-b6a1d6459b0d tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:11.282328 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bd2f2b4e-d783-4fdc-8656-b6a1d6459b0d tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:11.283102 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bd2f2b4e-d783-4fdc-8656-b6a1d6459b0d tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:11.283545 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bd2f2b4e-d783-4fdc-8656-b6a1d6459b0d tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:11.456684 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bd2f2b4e-d783-4fdc-8656-b6a1d6459b0d tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16fbdc04d3140b2b2d3b3d2f07fec53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bcc4b49734873a26ad2c3f3f6e989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:11.464926 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bd2f2b4e-d783-4fdc-8656-b6a1d6459b0d tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] 10.222.0.35 "GET /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16" status: 200 len: 1478 microversion: 2.1 time: 0.195202 Jun 10 18:51:11.465505 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3634/7256] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:11 2022] GET /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16 => generated 1478 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:51:11.931914 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-b493e4e4-0a12-4264-88ab-8840d9a91eac req-a54e269a-754d-4385-a22f-454971ff2749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ba65375-b2a6-4f09-96fd-da213bf02b16", "name": "network-vif-deleted", "tag": "61f2c866-2fd9-4cdb-9a3c-0ba9e56b4e24"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:51:11.940253 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-b493e4e4-0a12-4264-88ab-8840d9a91eac req-a54e269a-754d-4385-a22f-454971ff2749 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:11.940748 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-b493e4e4-0a12-4264-88ab-8840d9a91eac req-a54e269a-754d-4385-a22f-454971ff2749 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:11.952828 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-b493e4e4-0a12-4264-88ab-8840d9a91eac req-a54e269a-754d-4385-a22f-454971ff2749 service nova] Creating event network-vif-deleted:61f2c866-2fd9-4cdb-9a3c-0ba9e56b4e24 for instance 8ba65375-b2a6-4f09-96fd-da213bf02b16 on chh1-master-2 Jun 10 18:51:11.958132 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-b493e4e4-0a12-4264-88ab-8840d9a91eac req-a54e269a-754d-4385-a22f-454971ff2749 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030698 Jun 10 18:51:11.958722 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3635/7257] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:51:12.482623 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-660172fa-ff87-4d81-b15e-c3b8428b5ad6 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:12.483327 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-660172fa-ff87-4d81-b15e-c3b8428b5ad6 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] [instance: 8ba65375-b2a6-4f09-96fd-da213bf02b16] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:12.489960 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-660172fa-ff87-4d81-b15e-c3b8428b5ad6 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:12.490532 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-660172fa-ff87-4d81-b15e-c3b8428b5ad6 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:12.491305 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-660172fa-ff87-4d81-b15e-c3b8428b5ad6 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:12.491751 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-660172fa-ff87-4d81-b15e-c3b8428b5ad6 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:12.525921 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-660172fa-ff87-4d81-b15e-c3b8428b5ad6 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:12.526376 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-660172fa-ff87-4d81-b15e-c3b8428b5ad6 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:12.526836 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-660172fa-ff87-4d81-b15e-c3b8428b5ad6 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lazy-loading 'fault' on Instance uuid 8ba65375-b2a6-4f09-96fd-da213bf02b16 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 18:51:12.569945 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-660172fa-ff87-4d81-b15e-c3b8428b5ad6 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16fbdc04d3140b2b2d3b3d2f07fec53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bcc4b49734873a26ad2c3f3f6e989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:12.577423 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-660172fa-ff87-4d81-b15e-c3b8428b5ad6 tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] 10.222.0.35 "GET /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16" status: 200 len: 1312 microversion: 2.1 time: 0.099052 Jun 10 18:51:12.577991 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3636/7258] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:12 2022] GET /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16 => generated 1312 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:51:13.593648 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fd846d0f-1f5e-4bb4-8e81-63cabdec45fc tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:13.594271 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fd846d0f-1f5e-4bb4-8e81-63cabdec45fc tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] [instance: 8ba65375-b2a6-4f09-96fd-da213bf02b16] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:13.601225 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd846d0f-1f5e-4bb4-8e81-63cabdec45fc tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:13.601689 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd846d0f-1f5e-4bb4-8e81-63cabdec45fc tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:13.602466 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd846d0f-1f5e-4bb4-8e81-63cabdec45fc tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:13.602914 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd846d0f-1f5e-4bb4-8e81-63cabdec45fc tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:13.616681 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-fd846d0f-1f5e-4bb4-8e81-63cabdec45fc tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] HTTP exception thrown: Instance 8ba65375-b2a6-4f09-96fd-da213bf02b16 could not be found. Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fd846d0f-1f5e-4bb4-8e81-63cabdec45fc tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Request method failure captured: Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16 HTTP/1.1 Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5KM7mN58UsUrOEwXvzkKpTdX5RaaYQyF6CVezFwPmU5LOgNoqFTWJUmYBBs7JA12B3IH_yr6n4hSxhkjmBIcX_OKMMJFQTpz-4pqm5R3ApyS2j1rpzYr0ULUJsxNrrDlrWTr7qSpp5Iq_mbvpobQRpmH61wxeYBEwcS4_mhD6o0CSY Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 7f3bcc4b49734873a26ad2c3f3f6e989 Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-484291744 Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/7f3bcc4b49734873a26ad2c3f3f6e989"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7f3bcc4b49734873a26ad2c3f3f6e989"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/7f3bcc4b49734873a26ad2c3f3f6e989"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_7f3bcc4b49734873a26ad2c3f3f6e989", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersAdminNegativeTestJSON-484291744 Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 7f3bcc4b49734873a26ad2c3f3f6e989 Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-484291744 Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersAdminNegativeTestJSON-484291744-project Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: a16fbdc04d3140b2b2d3b3d2f07fec53 Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersAdminNegativeTestJSON-484291744-project Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 8ba65375-b2a6-4f09-96fd-da213bf02b16 could not be found. Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '8ba65375-b2a6-4f09-96fd-da213bf02b16'} Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ba65375-b2a6-4f09-96fd-da213bf02b16 could not be found. Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ba65375-b2a6-4f09-96fd-da213bf02b16 could not be found. Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:51:13.618321 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:51:13.623019 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:51:13.623019 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:51:13.623019 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:51:13.623019 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:51:13.623019 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:51:13.623019 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ba65375-b2a6-4f09-96fd-da213bf02b16 could not be found. Jun 10 18:51:13.623019 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:51:13.623019 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fd846d0f-1f5e-4bb4-8e81-63cabdec45fc tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] Returning 404 to user: Instance 8ba65375-b2a6-4f09-96fd-da213bf02b16 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:51:13.623019 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fd846d0f-1f5e-4bb4-8e81-63cabdec45fc tempest-ServersAdminNegativeTestJSON-484291744 tempest-ServersAdminNegativeTestJSON-484291744-project] 10.222.0.35 "GET /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16" status: 404 len: 111 microversion: 2.1 time: 0.029991 Jun 10 18:51:13.623019 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3637/7259] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:13 2022] GET /compute/v2.1/servers/8ba65375-b2a6-4f09-96fd-da213bf02b16 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:51:17.552457 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1c848709-710e-425b-9f61-d842c9802914 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1150825889", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "9eb55ca2-e766-4f57-b51d-f0854000f51c"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:51:17.604134 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-1c848709-710e-425b-9f61-d842c9802914 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] validate_networks() for [('9eb55ca2-e766-4f57-b51d-f0854000f51c', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:51:17.948521 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-1c848709-710e-425b-9f61-d842c9802914 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:51:17.948946 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-1c848709-710e-425b-9f61-d842c9802914 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:51:17.949421 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-1c848709-710e-425b-9f61-d842c9802914 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:51:17.949830 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-1c848709-710e-425b-9f61-d842c9802914 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:51:17.950245 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-1c848709-710e-425b-9f61-d842c9802914 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:51:17.959160 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1c848709-710e-425b-9f61-d842c9802914 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:17.959606 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1c848709-710e-425b-9f61-d842c9802914 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:17.960433 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1c848709-710e-425b-9f61-d842c9802914 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:17.960874 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1c848709-710e-425b-9f61-d842c9802914 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:17.978427 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-1c848709-710e-425b-9f61-d842c9802914 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Getting quotas for project 389f067bb66740bb833e8da0aaca5b52. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:51:17.983695 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-1c848709-710e-425b-9f61-d842c9802914 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Getting quotas for user 65234f7d8d3a4e79b5376f2f930dd880 and project 389f067bb66740bb833e8da0aaca5b52. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:51:17.996861 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1c848709-710e-425b-9f61-d842c9802914 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:51:17.999145 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1c848709-710e-425b-9f61-d842c9802914 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:51:18.103858 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1c848709-710e-425b-9f61-d842c9802914 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.666103 Jun 10 18:51:18.104566 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3638/7260] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:51:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 10 18:51:18.116159 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6dfb557f-126e-45b2-8d06-64c36be66930 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:18.116159 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6dfb557f-126e-45b2-8d06-64c36be66930 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:18.181137 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6dfb557f-126e-45b2-8d06-64c36be66930 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:18.188030 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6dfb557f-126e-45b2-8d06-64c36be66930 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1215 microversion: 2.1 time: 0.077521 Jun 10 18:51:18.188656 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3639/7261] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:18 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1215 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:51:19.207009 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-05fdf8e0-1806-45c3-96fd-cd4137a5573b tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:19.209426 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-05fdf8e0-1806-45c3-96fd-cd4137a5573b tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:19.215335 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05fdf8e0-1806-45c3-96fd-cd4137a5573b tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:19.215792 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05fdf8e0-1806-45c3-96fd-cd4137a5573b tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:19.216610 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05fdf8e0-1806-45c3-96fd-cd4137a5573b tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:19.217053 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05fdf8e0-1806-45c3-96fd-cd4137a5573b tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:19.279730 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-05fdf8e0-1806-45c3-96fd-cd4137a5573b tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:19.287943 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-05fdf8e0-1806-45c3-96fd-cd4137a5573b tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1219 microversion: 2.1 time: 0.085283 Jun 10 18:51:19.288525 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3640/7262] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:19 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:51:20.304917 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cb54a3bc-3bbe-4392-8457-81cfdb07864a tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:20.305682 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cb54a3bc-3bbe-4392-8457-81cfdb07864a tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:20.312883 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cb54a3bc-3bbe-4392-8457-81cfdb07864a tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:20.313431 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cb54a3bc-3bbe-4392-8457-81cfdb07864a tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:20.314228 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cb54a3bc-3bbe-4392-8457-81cfdb07864a tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:20.314658 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cb54a3bc-3bbe-4392-8457-81cfdb07864a tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:20.405244 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cb54a3bc-3bbe-4392-8457-81cfdb07864a tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:20.414481 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cb54a3bc-3bbe-4392-8457-81cfdb07864a tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1275 microversion: 2.1 time: 0.113360 Jun 10 18:51:20.415366 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3641/7263] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:20 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1275 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:51:21.433086 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b753bc79-93ee-45c2-9da0-ce66fc5114f7 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:21.433764 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b753bc79-93ee-45c2-9da0-ce66fc5114f7 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:21.440611 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b753bc79-93ee-45c2-9da0-ce66fc5114f7 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:21.441065 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b753bc79-93ee-45c2-9da0-ce66fc5114f7 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:21.441839 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b753bc79-93ee-45c2-9da0-ce66fc5114f7 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:21.442277 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b753bc79-93ee-45c2-9da0-ce66fc5114f7 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:21.649521 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b753bc79-93ee-45c2-9da0-ce66fc5114f7 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:21.657128 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b753bc79-93ee-45c2-9da0-ce66fc5114f7 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1315 microversion: 2.1 time: 0.227965 Jun 10 18:51:21.657848 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3642/7264] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:21 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:51:22.067776 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-9a1bf97f-3211-4110-819a-f3d6a206a429 req-d2a86ea6-24ce-4b6a-b983-dc7a921ca135 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c28a15a2-23a5-4c7c-95e7-72816789061b", "tag": "638c389a-9d96-4f51-888a-54fee29c7ff4"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:51:22.076742 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-9a1bf97f-3211-4110-819a-f3d6a206a429 req-d2a86ea6-24ce-4b6a-b983-dc7a921ca135 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:22.077199 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-9a1bf97f-3211-4110-819a-f3d6a206a429 req-d2a86ea6-24ce-4b6a-b983-dc7a921ca135 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:22.089755 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-9a1bf97f-3211-4110-819a-f3d6a206a429 req-d2a86ea6-24ce-4b6a-b983-dc7a921ca135 service nova] Creating event network-changed:638c389a-9d96-4f51-888a-54fee29c7ff4 for instance c28a15a2-23a5-4c7c-95e7-72816789061b on chh1-master-2 Jun 10 18:51:22.093421 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-9a1bf97f-3211-4110-819a-f3d6a206a429 req-d2a86ea6-24ce-4b6a-b983-dc7a921ca135 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029580 Jun 10 18:51:22.094030 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3643/7265] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:51:22.675331 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-103b47f3-824c-4826-b556-ac5561ddcb7c tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:22.676134 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-103b47f3-824c-4826-b556-ac5561ddcb7c tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:22.683218 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-103b47f3-824c-4826-b556-ac5561ddcb7c tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:22.683681 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-103b47f3-824c-4826-b556-ac5561ddcb7c tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:22.684503 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-103b47f3-824c-4826-b556-ac5561ddcb7c tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:22.684952 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-103b47f3-824c-4826-b556-ac5561ddcb7c tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:22.916920 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-103b47f3-824c-4826-b556-ac5561ddcb7c tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:22.924559 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-103b47f3-824c-4826-b556-ac5561ddcb7c tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1315 microversion: 2.1 time: 0.254440 Jun 10 18:51:22.925140 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3644/7266] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:22 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:51:23.947587 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fdda186c-088e-4d79-9509-5b04537fa13f tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:23.948270 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fdda186c-088e-4d79-9509-5b04537fa13f tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:23.955077 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fdda186c-088e-4d79-9509-5b04537fa13f tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:23.955531 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fdda186c-088e-4d79-9509-5b04537fa13f tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:23.956293 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fdda186c-088e-4d79-9509-5b04537fa13f tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:23.956757 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fdda186c-088e-4d79-9509-5b04537fa13f tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:24.088597 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fdda186c-088e-4d79-9509-5b04537fa13f tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:24.096266 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fdda186c-088e-4d79-9509-5b04537fa13f tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1315 microversion: 2.1 time: 0.153138 Jun 10 18:51:24.096859 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3645/7267] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:23 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:51:25.113853 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-568f9ade-4a7c-415b-b06c-ab588607a666 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:25.114500 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-568f9ade-4a7c-415b-b06c-ab588607a666 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:25.122796 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-568f9ade-4a7c-415b-b06c-ab588607a666 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:25.123256 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-568f9ade-4a7c-415b-b06c-ab588607a666 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:25.124741 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-568f9ade-4a7c-415b-b06c-ab588607a666 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:25.125418 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-568f9ade-4a7c-415b-b06c-ab588607a666 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:25.259173 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-568f9ade-4a7c-415b-b06c-ab588607a666 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:25.267414 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-568f9ade-4a7c-415b-b06c-ab588607a666 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1315 microversion: 2.1 time: 0.157355 Jun 10 18:51:25.271986 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3646/7268] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:25 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:51:26.284410 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e921f1cc-27e3-421c-ac36-5c4f1e625466 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:26.285050 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e921f1cc-27e3-421c-ac36-5c4f1e625466 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:26.292152 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e921f1cc-27e3-421c-ac36-5c4f1e625466 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:26.292645 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e921f1cc-27e3-421c-ac36-5c4f1e625466 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:26.293426 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e921f1cc-27e3-421c-ac36-5c4f1e625466 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:26.293874 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e921f1cc-27e3-421c-ac36-5c4f1e625466 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:26.431880 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e921f1cc-27e3-421c-ac36-5c4f1e625466 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:26.439844 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e921f1cc-27e3-421c-ac36-5c4f1e625466 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1315 microversion: 2.1 time: 0.159279 Jun 10 18:51:26.440453 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3647/7269] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:26 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:51:27.457320 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c7539431-f847-4943-8cf9-39364cd2257c tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:27.457933 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c7539431-f847-4943-8cf9-39364cd2257c tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:27.464912 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c7539431-f847-4943-8cf9-39364cd2257c tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:27.465368 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c7539431-f847-4943-8cf9-39364cd2257c tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:27.469100 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c7539431-f847-4943-8cf9-39364cd2257c tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:27.469100 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c7539431-f847-4943-8cf9-39364cd2257c tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:27.595910 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c7539431-f847-4943-8cf9-39364cd2257c tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:27.603583 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c7539431-f847-4943-8cf9-39364cd2257c tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1315 microversion: 2.1 time: 0.150173 Jun 10 18:51:27.604156 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3648/7270] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:27 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:51:28.561320 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-715123ba-661b-4e4a-bbef-06ddbf5ecee0 req-383eff2c-23d9-4818-ae9e-e7f2bc0b65f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c28a15a2-23a5-4c7c-95e7-72816789061b", "name": "network-vif-plugged", "status": "completed", "tag": "638c389a-9d96-4f51-888a-54fee29c7ff4"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:51:28.563890 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=8 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:51:28.564611 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=12 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:51:28.569909 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-715123ba-661b-4e4a-bbef-06ddbf5ecee0 req-383eff2c-23d9-4818-ae9e-e7f2bc0b65f7 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:28.570363 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-715123ba-661b-4e4a-bbef-06ddbf5ecee0 req-383eff2c-23d9-4818-ae9e-e7f2bc0b65f7 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:28.584128 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-715123ba-661b-4e4a-bbef-06ddbf5ecee0 req-383eff2c-23d9-4818-ae9e-e7f2bc0b65f7 service nova] Creating event network-vif-plugged:638c389a-9d96-4f51-888a-54fee29c7ff4 for instance c28a15a2-23a5-4c7c-95e7-72816789061b on chh1-master-2 Jun 10 18:51:28.589924 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-715123ba-661b-4e4a-bbef-06ddbf5ecee0 req-383eff2c-23d9-4818-ae9e-e7f2bc0b65f7 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035035 Jun 10 18:51:28.590504 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3649/7271] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:51:28.620766 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-679615f5-ef1d-415a-a3be-7c09988c6c74 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:28.621571 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-679615f5-ef1d-415a-a3be-7c09988c6c74 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:28.628533 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-679615f5-ef1d-415a-a3be-7c09988c6c74 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:28.629042 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-679615f5-ef1d-415a-a3be-7c09988c6c74 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:28.633790 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-679615f5-ef1d-415a-a3be-7c09988c6c74 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:28.633790 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-679615f5-ef1d-415a-a3be-7c09988c6c74 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:28.635055 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:51:28.825593 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-679615f5-ef1d-415a-a3be-7c09988c6c74 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:28.833987 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-679615f5-ef1d-415a-a3be-7c09988c6c74 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1315 microversion: 2.1 time: 0.217858 Jun 10 18:51:28.835127 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3650/7272] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:28 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:51:29.852083 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b2a36ace-c150-4490-8e00-6b1b10ed0f12 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:29.852795 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b2a36ace-c150-4490-8e00-6b1b10ed0f12 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:29.860494 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b2a36ace-c150-4490-8e00-6b1b10ed0f12 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:29.860994 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b2a36ace-c150-4490-8e00-6b1b10ed0f12 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:29.861765 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b2a36ace-c150-4490-8e00-6b1b10ed0f12 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:29.862216 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b2a36ace-c150-4490-8e00-6b1b10ed0f12 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:29.991463 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b2a36ace-c150-4490-8e00-6b1b10ed0f12 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:29.999073 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b2a36ace-c150-4490-8e00-6b1b10ed0f12 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1315 microversion: 2.1 time: 0.151999 Jun 10 18:51:29.999642 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3651/7273] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:29 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:51:31.016511 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f4dac52f-198d-480e-8cf0-c798facede10 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:31.017432 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f4dac52f-198d-480e-8cf0-c798facede10 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:31.024331 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f4dac52f-198d-480e-8cf0-c798facede10 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:31.024805 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f4dac52f-198d-480e-8cf0-c798facede10 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:31.025583 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f4dac52f-198d-480e-8cf0-c798facede10 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:31.026034 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f4dac52f-198d-480e-8cf0-c798facede10 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:31.158840 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f4dac52f-198d-480e-8cf0-c798facede10 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:31.167005 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f4dac52f-198d-480e-8cf0-c798facede10 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1501 microversion: 2.1 time: 0.154548 Jun 10 18:51:31.167579 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3652/7274] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:31 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1501 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:51:31.182723 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-440418e7-761a-48a2-9a1b-7ddffa872c7e tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:51:31.183689 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-440418e7-761a-48a2-9a1b-7ddffa872c7e tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:31.189533 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-440418e7-761a-48a2-9a1b-7ddffa872c7e tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:31.189988 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-440418e7-761a-48a2-9a1b-7ddffa872c7e tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:31.190791 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-440418e7-761a-48a2-9a1b-7ddffa872c7e tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:31.191229 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-440418e7-761a-48a2-9a1b-7ddffa872c7e tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:31.263695 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-440418e7-761a-48a2-9a1b-7ddffa872c7e tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:31.269706 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-440418e7-761a-48a2-9a1b-7ddffa872c7e tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Old instance type m1.heat2, new instance type m1.heat {{(pid=126595) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 10 18:51:31.276501 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-440418e7-761a-48a2-9a1b-7ddffa872c7e tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:51:31.276931 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-440418e7-761a-48a2-9a1b-7ddffa872c7e tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:51:31.277407 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-440418e7-761a-48a2-9a1b-7ddffa872c7e tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:51:31.277819 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-440418e7-761a-48a2-9a1b-7ddffa872c7e tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:51:31.278234 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-440418e7-761a-48a2-9a1b-7ddffa872c7e tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:51:31.518601 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-440418e7-761a-48a2-9a1b-7ddffa872c7e tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "POST /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b/action" status: 202 len: 0 microversion: 2.1 time: 0.339419 Jun 10 18:51:31.519223 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3653/7275] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:51:31 2022] POST /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 18:51:31.527534 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3ccabeda-ac1f-4c5d-873d-faadde4d1c8e tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:31.532020 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3ccabeda-ac1f-4c5d-873d-faadde4d1c8e tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:31.534586 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3ccabeda-ac1f-4c5d-873d-faadde4d1c8e tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:31.534717 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3ccabeda-ac1f-4c5d-873d-faadde4d1c8e tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:31.535424 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3ccabeda-ac1f-4c5d-873d-faadde4d1c8e tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:31.535867 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3ccabeda-ac1f-4c5d-873d-faadde4d1c8e tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:31.667790 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3ccabeda-ac1f-4c5d-873d-faadde4d1c8e tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:31.675623 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3ccabeda-ac1f-4c5d-873d-faadde4d1c8e tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1510 microversion: 2.1 time: 0.152213 Jun 10 18:51:31.676138 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3654/7276] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:31 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:51:32.693132 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7e630131-d4fb-445f-bdb6-73eb24589447 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:32.693742 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7e630131-d4fb-445f-bdb6-73eb24589447 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:32.700541 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e630131-d4fb-445f-bdb6-73eb24589447 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:32.700996 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e630131-d4fb-445f-bdb6-73eb24589447 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:32.701759 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e630131-d4fb-445f-bdb6-73eb24589447 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:32.702196 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e630131-d4fb-445f-bdb6-73eb24589447 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:32.841169 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7e630131-d4fb-445f-bdb6-73eb24589447 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:32.848856 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7e630131-d4fb-445f-bdb6-73eb24589447 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1510 microversion: 2.1 time: 0.159517 Jun 10 18:51:32.849435 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3655/7277] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:32 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:51:33.867418 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9f9728e5-807d-4f09-a3a7-da13ed2e7881 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:33.868089 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9f9728e5-807d-4f09-a3a7-da13ed2e7881 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:33.874995 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f9728e5-807d-4f09-a3a7-da13ed2e7881 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:33.875454 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f9728e5-807d-4f09-a3a7-da13ed2e7881 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:33.876239 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f9728e5-807d-4f09-a3a7-da13ed2e7881 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:33.876716 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f9728e5-807d-4f09-a3a7-da13ed2e7881 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:34.059560 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9f9728e5-807d-4f09-a3a7-da13ed2e7881 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:34.067181 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9f9728e5-807d-4f09-a3a7-da13ed2e7881 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1510 microversion: 2.1 time: 0.204327 Jun 10 18:51:34.067762 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3656/7278] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:33 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1510 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:51:35.084180 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-134cb639-077e-4f7e-b880-b83319c1ade2 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:35.084855 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-134cb639-077e-4f7e-b880-b83319c1ade2 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:35.091584 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-134cb639-077e-4f7e-b880-b83319c1ade2 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:35.092036 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-134cb639-077e-4f7e-b880-b83319c1ade2 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:35.092832 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-134cb639-077e-4f7e-b880-b83319c1ade2 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:35.093275 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-134cb639-077e-4f7e-b880-b83319c1ade2 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:35.222728 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-134cb639-077e-4f7e-b880-b83319c1ade2 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:35.230803 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-134cb639-077e-4f7e-b880-b83319c1ade2 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1515 microversion: 2.1 time: 0.150653 Jun 10 18:51:35.231367 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3657/7279] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:35 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:51:36.247959 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1c88f818-ed59-4caf-a326-d5d181190bcb tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:36.248652 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1c88f818-ed59-4caf-a326-d5d181190bcb tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:36.255547 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1c88f818-ed59-4caf-a326-d5d181190bcb tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:36.256006 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1c88f818-ed59-4caf-a326-d5d181190bcb tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:36.256800 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1c88f818-ed59-4caf-a326-d5d181190bcb tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:36.257772 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1c88f818-ed59-4caf-a326-d5d181190bcb tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:36.396980 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1c88f818-ed59-4caf-a326-d5d181190bcb tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:36.404646 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1c88f818-ed59-4caf-a326-d5d181190bcb tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1515 microversion: 2.1 time: 0.160594 Jun 10 18:51:36.405224 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3658/7280] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:36 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:51:37.421363 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1b782a1f-29b0-4588-98ed-e0bef93bef94 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:37.421978 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1b782a1f-29b0-4588-98ed-e0bef93bef94 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:37.428927 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1b782a1f-29b0-4588-98ed-e0bef93bef94 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:37.429387 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1b782a1f-29b0-4588-98ed-e0bef93bef94 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:37.430156 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1b782a1f-29b0-4588-98ed-e0bef93bef94 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:37.430597 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1b782a1f-29b0-4588-98ed-e0bef93bef94 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:37.557089 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1b782a1f-29b0-4588-98ed-e0bef93bef94 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:37.564597 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1b782a1f-29b0-4588-98ed-e0bef93bef94 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1515 microversion: 2.1 time: 0.147073 Jun 10 18:51:37.565176 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3659/7281] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:37 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1515 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:51:38.581900 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-28c8f149-cf10-43f1-9b82-e82e382029d5 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:38.582563 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-28c8f149-cf10-43f1-9b82-e82e382029d5 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:38.589591 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-28c8f149-cf10-43f1-9b82-e82e382029d5 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:38.590051 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-28c8f149-cf10-43f1-9b82-e82e382029d5 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:38.590820 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-28c8f149-cf10-43f1-9b82-e82e382029d5 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:38.591263 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-28c8f149-cf10-43f1-9b82-e82e382029d5 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:38.726281 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-28c8f149-cf10-43f1-9b82-e82e382029d5 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:38.734187 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-28c8f149-cf10-43f1-9b82-e82e382029d5 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1515 microversion: 2.1 time: 0.156171 Jun 10 18:51:38.734760 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3660/7282] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:38 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:51:39.751019 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-03be2915-547e-4c2d-9a72-4dd0dc7ec10c tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:39.751696 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-03be2915-547e-4c2d-9a72-4dd0dc7ec10c tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:39.759121 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03be2915-547e-4c2d-9a72-4dd0dc7ec10c tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:39.759574 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03be2915-547e-4c2d-9a72-4dd0dc7ec10c tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:39.760359 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03be2915-547e-4c2d-9a72-4dd0dc7ec10c tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:39.760800 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03be2915-547e-4c2d-9a72-4dd0dc7ec10c tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:39.893763 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-03be2915-547e-4c2d-9a72-4dd0dc7ec10c tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:39.901986 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-03be2915-547e-4c2d-9a72-4dd0dc7ec10c tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1515 microversion: 2.1 time: 0.154901 Jun 10 18:51:39.902564 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3661/7283] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:39 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:51:40.919498 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-89235e6b-f3ff-4511-a9bd-d0c4dac66dbd tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:40.920138 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-89235e6b-f3ff-4511-a9bd-d0c4dac66dbd tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:40.922956 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:51:40.927836 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-89235e6b-f3ff-4511-a9bd-d0c4dac66dbd tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:40.928296 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-89235e6b-f3ff-4511-a9bd-d0c4dac66dbd tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:40.929137 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-89235e6b-f3ff-4511-a9bd-d0c4dac66dbd tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:40.929633 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-89235e6b-f3ff-4511-a9bd-d0c4dac66dbd tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:41.063103 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-89235e6b-f3ff-4511-a9bd-d0c4dac66dbd tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:41.068982 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-89235e6b-f3ff-4511-a9bd-d0c4dac66dbd tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1515 microversion: 2.1 time: 0.153378 Jun 10 18:51:41.069558 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3662/7284] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:40 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:51:42.085964 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-65129082-5737-41c2-994a-53ddb01f5073 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:42.086587 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-65129082-5737-41c2-994a-53ddb01f5073 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:42.093602 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-65129082-5737-41c2-994a-53ddb01f5073 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:42.094069 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-65129082-5737-41c2-994a-53ddb01f5073 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:42.094887 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-65129082-5737-41c2-994a-53ddb01f5073 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:42.095412 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-65129082-5737-41c2-994a-53ddb01f5073 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:42.231738 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-65129082-5737-41c2-994a-53ddb01f5073 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:42.240216 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-65129082-5737-41c2-994a-53ddb01f5073 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1515 microversion: 2.1 time: 0.158168 Jun 10 18:51:42.240887 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3663/7285] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:42 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:51:43.258796 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9f3df686-d860-44ef-9352-c849a78dd590 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:43.259625 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9f3df686-d860-44ef-9352-c849a78dd590 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:43.266319 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f3df686-d860-44ef-9352-c849a78dd590 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:43.267060 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f3df686-d860-44ef-9352-c849a78dd590 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:43.267816 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f3df686-d860-44ef-9352-c849a78dd590 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:43.268254 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f3df686-d860-44ef-9352-c849a78dd590 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:43.399218 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9f3df686-d860-44ef-9352-c849a78dd590 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:43.406729 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9f3df686-d860-44ef-9352-c849a78dd590 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1515 microversion: 2.1 time: 0.152486 Jun 10 18:51:43.407296 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3664/7286] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:43 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:51:44.424331 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d7d2f55c-6e2e-40ba-97b6-06e6cbccdec6 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:44.424949 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d7d2f55c-6e2e-40ba-97b6-06e6cbccdec6 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:44.432042 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d7d2f55c-6e2e-40ba-97b6-06e6cbccdec6 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:44.432551 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d7d2f55c-6e2e-40ba-97b6-06e6cbccdec6 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:44.433328 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d7d2f55c-6e2e-40ba-97b6-06e6cbccdec6 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:44.433772 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d7d2f55c-6e2e-40ba-97b6-06e6cbccdec6 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:44.452068 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:51:44.566212 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d7d2f55c-6e2e-40ba-97b6-06e6cbccdec6 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:44.574301 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d7d2f55c-6e2e-40ba-97b6-06e6cbccdec6 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1515 microversion: 2.1 time: 0.153942 Jun 10 18:51:44.574870 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3665/7287] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:44 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:51:45.590436 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-27fca724-91b4-4704-bf4c-143e61ec0bf8 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:45.591069 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-27fca724-91b4-4704-bf4c-143e61ec0bf8 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:45.597967 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-27fca724-91b4-4704-bf4c-143e61ec0bf8 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:45.598418 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-27fca724-91b4-4704-bf4c-143e61ec0bf8 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:45.599174 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-27fca724-91b4-4704-bf4c-143e61ec0bf8 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:45.599614 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-27fca724-91b4-4704-bf4c-143e61ec0bf8 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:45.728707 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-27fca724-91b4-4704-bf4c-143e61ec0bf8 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:45.736264 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-27fca724-91b4-4704-bf4c-143e61ec0bf8 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1515 microversion: 2.1 time: 0.149761 Jun 10 18:51:45.736858 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3666/7288] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:45 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:51:46.753368 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c7dba013-8953-4dca-898b-862a0e186eb2 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:46.754035 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c7dba013-8953-4dca-898b-862a0e186eb2 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:46.761599 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c7dba013-8953-4dca-898b-862a0e186eb2 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:46.762057 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c7dba013-8953-4dca-898b-862a0e186eb2 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:46.762819 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c7dba013-8953-4dca-898b-862a0e186eb2 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:46.763253 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c7dba013-8953-4dca-898b-862a0e186eb2 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:46.895818 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c7dba013-8953-4dca-898b-862a0e186eb2 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:46.903416 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c7dba013-8953-4dca-898b-862a0e186eb2 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1515 microversion: 2.1 time: 0.154140 Jun 10 18:51:46.904008 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3667/7289] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:46 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:51:47.921168 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-20cfcd96-e8ce-46a5-bb01-b0526d637213 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:47.921825 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-20cfcd96-e8ce-46a5-bb01-b0526d637213 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:47.928716 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-20cfcd96-e8ce-46a5-bb01-b0526d637213 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:47.929170 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-20cfcd96-e8ce-46a5-bb01-b0526d637213 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:47.929947 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-20cfcd96-e8ce-46a5-bb01-b0526d637213 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:47.930366 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-20cfcd96-e8ce-46a5-bb01-b0526d637213 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:48.061010 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-20cfcd96-e8ce-46a5-bb01-b0526d637213 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:48.068520 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-20cfcd96-e8ce-46a5-bb01-b0526d637213 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1515 microversion: 2.1 time: 0.151170 Jun 10 18:51:48.069103 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3668/7290] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:47 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:51:49.086377 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-df4f3e47-f1b6-4fe7-abaf-303816c16709 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:49.087034 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-df4f3e47-f1b6-4fe7-abaf-303816c16709 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:49.094085 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df4f3e47-f1b6-4fe7-abaf-303816c16709 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:49.094544 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df4f3e47-f1b6-4fe7-abaf-303816c16709 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:49.095320 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df4f3e47-f1b6-4fe7-abaf-303816c16709 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:49.095767 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df4f3e47-f1b6-4fe7-abaf-303816c16709 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:49.222720 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-df4f3e47-f1b6-4fe7-abaf-303816c16709 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:49.230967 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-df4f3e47-f1b6-4fe7-abaf-303816c16709 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1515 microversion: 2.1 time: 0.149000 Jun 10 18:51:49.231547 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3669/7291] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:49 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:51:50.248063 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bbb62358-df03-43ef-b74a-e8477b93fee1 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:50.248780 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bbb62358-df03-43ef-b74a-e8477b93fee1 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:50.255788 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bbb62358-df03-43ef-b74a-e8477b93fee1 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:50.256248 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bbb62358-df03-43ef-b74a-e8477b93fee1 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:50.257058 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bbb62358-df03-43ef-b74a-e8477b93fee1 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:50.257516 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bbb62358-df03-43ef-b74a-e8477b93fee1 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:50.396573 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bbb62358-df03-43ef-b74a-e8477b93fee1 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:50.404245 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bbb62358-df03-43ef-b74a-e8477b93fee1 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1515 microversion: 2.1 time: 0.160038 Jun 10 18:51:50.404874 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3670/7292] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:50 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:51:51.421163 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-084d65b1-9e12-43c4-bcbb-b316a6405789 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:51.421765 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-084d65b1-9e12-43c4-bcbb-b316a6405789 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:51.428681 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-084d65b1-9e12-43c4-bcbb-b316a6405789 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:51.429145 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-084d65b1-9e12-43c4-bcbb-b316a6405789 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:51.430444 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-084d65b1-9e12-43c4-bcbb-b316a6405789 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:51.430887 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-084d65b1-9e12-43c4-bcbb-b316a6405789 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:51.558872 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-084d65b1-9e12-43c4-bcbb-b316a6405789 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:51.566540 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-084d65b1-9e12-43c4-bcbb-b316a6405789 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1515 microversion: 2.1 time: 0.149304 Jun 10 18:51:51.567114 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3671/7293] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:51 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:51:52.583815 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-093779b2-8db9-4505-90d3-2217113df963 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:52.584534 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-093779b2-8db9-4505-90d3-2217113df963 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:52.592005 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-093779b2-8db9-4505-90d3-2217113df963 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:52.592507 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-093779b2-8db9-4505-90d3-2217113df963 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:52.593287 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-093779b2-8db9-4505-90d3-2217113df963 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:52.593733 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-093779b2-8db9-4505-90d3-2217113df963 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:52.725428 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-093779b2-8db9-4505-90d3-2217113df963 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:52.733058 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-093779b2-8db9-4505-90d3-2217113df963 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1515 microversion: 2.1 time: 0.153117 Jun 10 18:51:52.733635 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3672/7294] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:52 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:51:53.749468 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0314d010-4285-44c2-a9af-e1a04375a91f tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:53.753325 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0314d010-4285-44c2-a9af-e1a04375a91f tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:53.757407 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0314d010-4285-44c2-a9af-e1a04375a91f tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:53.758481 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0314d010-4285-44c2-a9af-e1a04375a91f tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:53.759242 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0314d010-4285-44c2-a9af-e1a04375a91f tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:53.759681 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0314d010-4285-44c2-a9af-e1a04375a91f tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:53.888164 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0314d010-4285-44c2-a9af-e1a04375a91f tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:53.895946 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0314d010-4285-44c2-a9af-e1a04375a91f tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1515 microversion: 2.1 time: 0.150682 Jun 10 18:51:53.896608 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3673/7295] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:53 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:51:54.913438 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9fab7d14-3086-4b4b-8f22-1ea0732d8b60 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:54.914607 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9fab7d14-3086-4b4b-8f22-1ea0732d8b60 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:54.922049 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9fab7d14-3086-4b4b-8f22-1ea0732d8b60 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:54.922408 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9fab7d14-3086-4b4b-8f22-1ea0732d8b60 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:54.922912 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9fab7d14-3086-4b4b-8f22-1ea0732d8b60 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:54.923449 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9fab7d14-3086-4b4b-8f22-1ea0732d8b60 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:55.053954 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9fab7d14-3086-4b4b-8f22-1ea0732d8b60 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:55.062491 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9fab7d14-3086-4b4b-8f22-1ea0732d8b60 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1515 microversion: 2.1 time: 0.153086 Jun 10 18:51:55.063072 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3674/7296] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:54 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:51:56.078689 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0c0d8662-942d-4212-b33b-cf3d45440bbd tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:56.079377 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0c0d8662-942d-4212-b33b-cf3d45440bbd tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:56.086323 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0c0d8662-942d-4212-b33b-cf3d45440bbd tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:56.086784 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0c0d8662-942d-4212-b33b-cf3d45440bbd tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:56.087560 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0c0d8662-942d-4212-b33b-cf3d45440bbd tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:56.088005 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0c0d8662-942d-4212-b33b-cf3d45440bbd tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:56.219138 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0c0d8662-942d-4212-b33b-cf3d45440bbd tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:56.227251 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0c0d8662-942d-4212-b33b-cf3d45440bbd tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1515 microversion: 2.1 time: 0.152518 Jun 10 18:51:56.227822 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3675/7297] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:56 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:51:57.245230 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a8f81b7e-b3a3-44a4-95c4-23858e63ea69 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:57.245880 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a8f81b7e-b3a3-44a4-95c4-23858e63ea69 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:57.252646 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a8f81b7e-b3a3-44a4-95c4-23858e63ea69 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:57.253091 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a8f81b7e-b3a3-44a4-95c4-23858e63ea69 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:57.253851 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a8f81b7e-b3a3-44a4-95c4-23858e63ea69 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:57.254289 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a8f81b7e-b3a3-44a4-95c4-23858e63ea69 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:57.383929 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a8f81b7e-b3a3-44a4-95c4-23858e63ea69 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:57.392060 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a8f81b7e-b3a3-44a4-95c4-23858e63ea69 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1515 microversion: 2.1 time: 0.151584 Jun 10 18:51:57.392686 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3676/7298] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:57 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:51:58.409623 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-39b048d6-a860-4060-8acf-d40694e0da55 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:58.410317 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-39b048d6-a860-4060-8acf-d40694e0da55 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:58.417720 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-39b048d6-a860-4060-8acf-d40694e0da55 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:58.418178 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-39b048d6-a860-4060-8acf-d40694e0da55 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:58.418952 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-39b048d6-a860-4060-8acf-d40694e0da55 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:58.419393 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-39b048d6-a860-4060-8acf-d40694e0da55 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:58.555221 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-39b048d6-a860-4060-8acf-d40694e0da55 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:58.562881 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-39b048d6-a860-4060-8acf-d40694e0da55 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1515 microversion: 2.1 time: 0.157165 Jun 10 18:51:58.563397 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3677/7299] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:58 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:51:59.579037 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0b08f857-8b15-4a5b-a79b-0c9ae670c6d7 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:51:59.579715 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0b08f857-8b15-4a5b-a79b-0c9ae670c6d7 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:51:59.586788 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0b08f857-8b15-4a5b-a79b-0c9ae670c6d7 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:59.587248 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0b08f857-8b15-4a5b-a79b-0c9ae670c6d7 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:59.588019 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0b08f857-8b15-4a5b-a79b-0c9ae670c6d7 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:51:59.588525 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0b08f857-8b15-4a5b-a79b-0c9ae670c6d7 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:51:59.715947 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0b08f857-8b15-4a5b-a79b-0c9ae670c6d7 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:51:59.723493 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0b08f857-8b15-4a5b-a79b-0c9ae670c6d7 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1515 microversion: 2.1 time: 0.148386 Jun 10 18:51:59.724077 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3678/7300] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:51:59 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:00.740542 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1e18662e-55bb-4968-b6e3-d42b1958673a tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:00.741177 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1e18662e-55bb-4968-b6e3-d42b1958673a tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:00.748716 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1e18662e-55bb-4968-b6e3-d42b1958673a tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:00.749175 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1e18662e-55bb-4968-b6e3-d42b1958673a tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:00.749941 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1e18662e-55bb-4968-b6e3-d42b1958673a tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:00.750385 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1e18662e-55bb-4968-b6e3-d42b1958673a tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:00.877801 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1e18662e-55bb-4968-b6e3-d42b1958673a tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:00.885294 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1e18662e-55bb-4968-b6e3-d42b1958673a tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1515 microversion: 2.1 time: 0.148794 Jun 10 18:52:00.885864 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3679/7301] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:00 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:01.903432 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-86f72347-95f6-4c8c-8fcc-6e9ebffc54aa tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:01.904265 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-86f72347-95f6-4c8c-8fcc-6e9ebffc54aa tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:01.912785 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86f72347-95f6-4c8c-8fcc-6e9ebffc54aa tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:01.913537 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86f72347-95f6-4c8c-8fcc-6e9ebffc54aa tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:01.914746 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86f72347-95f6-4c8c-8fcc-6e9ebffc54aa tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:01.915191 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86f72347-95f6-4c8c-8fcc-6e9ebffc54aa tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:02.047709 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-86f72347-95f6-4c8c-8fcc-6e9ebffc54aa tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:02.056727 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-86f72347-95f6-4c8c-8fcc-6e9ebffc54aa tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1514 microversion: 2.1 time: 0.157775 Jun 10 18:52:02.057296 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3680/7302] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:01 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:02.467556 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-6e1eb122-06bd-4429-bf67-596a422f4320 req-306eafee-dad5-4048-9ba9-f8eb07c9975d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c28a15a2-23a5-4c7c-95e7-72816789061b", "name": "network-vif-unplugged", "status": "completed", "tag": "638c389a-9d96-4f51-888a-54fee29c7ff4"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:52:02.479037 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-6e1eb122-06bd-4429-bf67-596a422f4320 req-306eafee-dad5-4048-9ba9-f8eb07c9975d service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:02.479496 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-6e1eb122-06bd-4429-bf67-596a422f4320 req-306eafee-dad5-4048-9ba9-f8eb07c9975d service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:02.491091 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-6e1eb122-06bd-4429-bf67-596a422f4320 req-306eafee-dad5-4048-9ba9-f8eb07c9975d service nova] Creating event network-vif-unplugged:638c389a-9d96-4f51-888a-54fee29c7ff4 for instance c28a15a2-23a5-4c7c-95e7-72816789061b on chh2-master-2 Jun 10 18:52:02.496478 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [req-6e1eb122-06bd-4429-bf67-596a422f4320 req-306eafee-dad5-4048-9ba9-f8eb07c9975d service nova] Instance c28a15a2-23a5-4c7c-95e7-72816789061b is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 18:52:02.508243 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-6e1eb122-06bd-4429-bf67-596a422f4320 req-306eafee-dad5-4048-9ba9-f8eb07c9975d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044044 Jun 10 18:52:02.508872 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3681/7303] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:52:03.074746 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1a4cb50f-e282-44eb-ab4c-d0a33c795758 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:03.075509 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1a4cb50f-e282-44eb-ab4c-d0a33c795758 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:03.082039 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1a4cb50f-e282-44eb-ab4c-d0a33c795758 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:03.082498 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1a4cb50f-e282-44eb-ab4c-d0a33c795758 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:03.083320 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1a4cb50f-e282-44eb-ab4c-d0a33c795758 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:03.083765 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1a4cb50f-e282-44eb-ab4c-d0a33c795758 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:03.110002 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:52:03.229442 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1a4cb50f-e282-44eb-ab4c-d0a33c795758 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:03.237424 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1a4cb50f-e282-44eb-ab4c-d0a33c795758 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1514 microversion: 2.1 time: 0.167863 Jun 10 18:52:03.238207 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3682/7304] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:03 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:04.255029 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b2c953be-c2f8-4fe4-9cf1-7a1b4cb74270 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:04.255683 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b2c953be-c2f8-4fe4-9cf1-7a1b4cb74270 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:04.263301 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b2c953be-c2f8-4fe4-9cf1-7a1b4cb74270 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:04.263755 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b2c953be-c2f8-4fe4-9cf1-7a1b4cb74270 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:04.264558 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b2c953be-c2f8-4fe4-9cf1-7a1b4cb74270 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:04.265000 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b2c953be-c2f8-4fe4-9cf1-7a1b4cb74270 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:04.397718 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b2c953be-c2f8-4fe4-9cf1-7a1b4cb74270 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:04.405324 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b2c953be-c2f8-4fe4-9cf1-7a1b4cb74270 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1512 microversion: 2.1 time: 0.154181 Jun 10 18:52:04.405892 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3683/7305] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:04 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:04.523024 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-326f250f-2845-4ac7-9f61-8100860f140b req-77daec52-dd1f-4c49-be9c-e0ccea1fb686 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c28a15a2-23a5-4c7c-95e7-72816789061b", "tag": "638c389a-9d96-4f51-888a-54fee29c7ff4"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:52:04.530989 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-326f250f-2845-4ac7-9f61-8100860f140b req-77daec52-dd1f-4c49-be9c-e0ccea1fb686 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:04.531437 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-326f250f-2845-4ac7-9f61-8100860f140b req-77daec52-dd1f-4c49-be9c-e0ccea1fb686 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:04.543231 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-326f250f-2845-4ac7-9f61-8100860f140b req-77daec52-dd1f-4c49-be9c-e0ccea1fb686 service nova] Creating event network-changed:638c389a-9d96-4f51-888a-54fee29c7ff4 for instance c28a15a2-23a5-4c7c-95e7-72816789061b on chh2-master-2 Jun 10 18:52:04.548460 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [req-326f250f-2845-4ac7-9f61-8100860f140b req-77daec52-dd1f-4c49-be9c-e0ccea1fb686 service nova] Instance c28a15a2-23a5-4c7c-95e7-72816789061b is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 18:52:04.559578 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-326f250f-2845-4ac7-9f61-8100860f140b req-77daec52-dd1f-4c49-be9c-e0ccea1fb686 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040177 Jun 10 18:52:04.560158 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3684/7306] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:52:05.424538 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8699a29d-24d3-417f-88f6-8e838c3ad5dd tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:05.425231 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8699a29d-24d3-417f-88f6-8e838c3ad5dd tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:05.431449 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8699a29d-24d3-417f-88f6-8e838c3ad5dd tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:05.431899 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8699a29d-24d3-417f-88f6-8e838c3ad5dd tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:05.432684 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8699a29d-24d3-417f-88f6-8e838c3ad5dd tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:05.433116 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8699a29d-24d3-417f-88f6-8e838c3ad5dd tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:05.569069 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8699a29d-24d3-417f-88f6-8e838c3ad5dd tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:05.577303 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8699a29d-24d3-417f-88f6-8e838c3ad5dd tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1512 microversion: 2.1 time: 0.157885 Jun 10 18:52:05.577868 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3685/7307] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:05 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:06.594646 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-43cd91fc-6969-4927-845e-114026950585 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:06.595370 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-43cd91fc-6969-4927-845e-114026950585 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:06.602945 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-43cd91fc-6969-4927-845e-114026950585 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:06.603437 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-43cd91fc-6969-4927-845e-114026950585 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:06.604215 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-43cd91fc-6969-4927-845e-114026950585 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:06.604683 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-43cd91fc-6969-4927-845e-114026950585 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:06.737520 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-43cd91fc-6969-4927-845e-114026950585 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:06.745126 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-43cd91fc-6969-4927-845e-114026950585 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1512 microversion: 2.1 time: 0.154345 Jun 10 18:52:06.745682 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3686/7308] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:06 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:07.761334 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-df3f6c12-e2b6-48a0-b307-5074478cacf8 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:07.761982 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-df3f6c12-e2b6-48a0-b307-5074478cacf8 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:07.769319 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df3f6c12-e2b6-48a0-b307-5074478cacf8 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:07.769778 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df3f6c12-e2b6-48a0-b307-5074478cacf8 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:07.770550 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df3f6c12-e2b6-48a0-b307-5074478cacf8 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:07.770992 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df3f6c12-e2b6-48a0-b307-5074478cacf8 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:07.901797 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-df3f6c12-e2b6-48a0-b307-5074478cacf8 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:07.909259 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-df3f6c12-e2b6-48a0-b307-5074478cacf8 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1509 microversion: 2.1 time: 0.151817 Jun 10 18:52:07.909837 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3687/7309] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:07 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:07.925206 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e1907338-9241-456c-8048-819ca35cb0e3 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:07.925703 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e1907338-9241-456c-8048-819ca35cb0e3 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:07.931450 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e1907338-9241-456c-8048-819ca35cb0e3 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:07.931904 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e1907338-9241-456c-8048-819ca35cb0e3 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:07.932724 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e1907338-9241-456c-8048-819ca35cb0e3 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:07.933152 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e1907338-9241-456c-8048-819ca35cb0e3 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:07.958324 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e1907338-9241-456c-8048-819ca35cb0e3 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:52:08.123510 chdv-master-2 devstack@n-api.service[126595]: INFO nova.compute.api [None req-e1907338-9241-456c-8048-819ca35cb0e3 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Found an unconfirmed migration during delete, id: 16, status: finished Jun 10 18:52:10.100473 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e1907338-9241-456c-8048-819ca35cb0e3 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "DELETE /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 204 len: 0 microversion: 2.1 time: 2.178417 Jun 10 18:52:10.104829 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3688/7310] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:52:07 2022] DELETE /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 0 bytes in 2181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 18:52:10.110271 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-02686056-e17e-4037-bdda-5eee4f901ed2 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:10.110970 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-02686056-e17e-4037-bdda-5eee4f901ed2 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:10.117444 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02686056-e17e-4037-bdda-5eee4f901ed2 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:10.117904 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02686056-e17e-4037-bdda-5eee4f901ed2 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:10.118654 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02686056-e17e-4037-bdda-5eee4f901ed2 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:10.119099 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02686056-e17e-4037-bdda-5eee4f901ed2 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:10.250683 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-02686056-e17e-4037-bdda-5eee4f901ed2 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:10.258955 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-02686056-e17e-4037-bdda-5eee4f901ed2 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1501 microversion: 2.1 time: 0.152625 Jun 10 18:52:10.259993 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3689/7311] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:10 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1501 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:10.266841 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-16c3e02c-ec7f-4c06-a3c5-9813a3471da1 req-dc6adb6a-258e-4688-887b-51112fd54ec2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c28a15a2-23a5-4c7c-95e7-72816789061b", "name": "network-vif-plugged", "status": "completed", "tag": "638c389a-9d96-4f51-888a-54fee29c7ff4"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:52:10.276718 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-16c3e02c-ec7f-4c06-a3c5-9813a3471da1 req-dc6adb6a-258e-4688-887b-51112fd54ec2 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:10.277168 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-16c3e02c-ec7f-4c06-a3c5-9813a3471da1 req-dc6adb6a-258e-4688-887b-51112fd54ec2 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:10.289191 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-16c3e02c-ec7f-4c06-a3c5-9813a3471da1 req-dc6adb6a-258e-4688-887b-51112fd54ec2 service nova] Creating event network-vif-plugged:638c389a-9d96-4f51-888a-54fee29c7ff4 for instance c28a15a2-23a5-4c7c-95e7-72816789061b on chh2-master-2 Jun 10 18:52:10.294436 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-16c3e02c-ec7f-4c06-a3c5-9813a3471da1 req-dc6adb6a-258e-4688-887b-51112fd54ec2 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032850 Jun 10 18:52:10.295034 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3690/7312] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:52:11.277425 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7e3f5f3a-fab9-405c-b3b1-7ff99981fcf4 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:11.278154 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7e3f5f3a-fab9-405c-b3b1-7ff99981fcf4 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:11.284371 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e3f5f3a-fab9-405c-b3b1-7ff99981fcf4 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:11.284816 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e3f5f3a-fab9-405c-b3b1-7ff99981fcf4 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:11.285587 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e3f5f3a-fab9-405c-b3b1-7ff99981fcf4 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:11.286024 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e3f5f3a-fab9-405c-b3b1-7ff99981fcf4 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:11.416494 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7e3f5f3a-fab9-405c-b3b1-7ff99981fcf4 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:11.424450 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7e3f5f3a-fab9-405c-b3b1-7ff99981fcf4 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1501 microversion: 2.1 time: 0.152199 Jun 10 18:52:11.425123 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3691/7313] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:11 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1501 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:12.230785 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-89e324d1-40c0-48ba-8e2c-9ea959413274 req-ba2b61d3-8428-4bc4-a3d8-9c8cd9dd701b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c28a15a2-23a5-4c7c-95e7-72816789061b", "name": "network-vif-deleted", "tag": "638c389a-9d96-4f51-888a-54fee29c7ff4"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:52:12.235155 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:52:12.240549 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-89e324d1-40c0-48ba-8e2c-9ea959413274 req-ba2b61d3-8428-4bc4-a3d8-9c8cd9dd701b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:12.240994 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-89e324d1-40c0-48ba-8e2c-9ea959413274 req-ba2b61d3-8428-4bc4-a3d8-9c8cd9dd701b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:12.252116 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-89e324d1-40c0-48ba-8e2c-9ea959413274 req-ba2b61d3-8428-4bc4-a3d8-9c8cd9dd701b service nova] Creating event network-vif-deleted:638c389a-9d96-4f51-888a-54fee29c7ff4 for instance c28a15a2-23a5-4c7c-95e7-72816789061b on chh2-master-2 Jun 10 18:52:12.257156 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-89e324d1-40c0-48ba-8e2c-9ea959413274 req-ba2b61d3-8428-4bc4-a3d8-9c8cd9dd701b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030005 Jun 10 18:52:12.258344 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3692/7314] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:52:12.443024 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-eaa3c726-060d-443a-98fe-51633ff5cfcc tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:12.443800 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-eaa3c726-060d-443a-98fe-51633ff5cfcc tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:12.450785 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eaa3c726-060d-443a-98fe-51633ff5cfcc tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:12.451236 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eaa3c726-060d-443a-98fe-51633ff5cfcc tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:12.452005 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eaa3c726-060d-443a-98fe-51633ff5cfcc tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:12.452477 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eaa3c726-060d-443a-98fe-51633ff5cfcc tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:12.522541 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-eaa3c726-060d-443a-98fe-51633ff5cfcc tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65234f7d8d3a4e79b5376f2f930dd880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389f067bb66740bb833e8da0aaca5b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:12.530218 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-eaa3c726-060d-443a-98fe-51633ff5cfcc tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 200 len: 1294 microversion: 2.1 time: 0.091755 Jun 10 18:52:12.530793 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3693/7315] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:12 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 1294 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:13.547590 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b7b01f58-90de-4762-9d71-3006b853190c tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:13.548187 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b7b01f58-90de-4762-9d71-3006b853190c tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:13.555207 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b7b01f58-90de-4762-9d71-3006b853190c tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:13.555693 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b7b01f58-90de-4762-9d71-3006b853190c tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:13.556452 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b7b01f58-90de-4762-9d71-3006b853190c tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:13.556898 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b7b01f58-90de-4762-9d71-3006b853190c tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:13.569998 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-b7b01f58-90de-4762-9d71-3006b853190c tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] HTTP exception thrown: Instance c28a15a2-23a5-4c7c-95e7-72816789061b could not be found. Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b7b01f58-90de-4762-9d71-3006b853190c tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Request method failure captured: Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b HTTP/1.1 Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5KlIjoQHTyK_GxRb6EmdMw3SJxoUMEw1NDDnEIrUOf3LKs9y3V73_uYsHLiv7M-U-dIvH1oDHyBftXFaXlR2jgtNs2izQpXEbeiL3ULTcPvyoWb3Se6qcSd2lViu8TqpYaD04t13oAu5iOIuzLL9Wh3cOyGNQVJ3oSEip8eRVSaCx0 Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 389f067bb66740bb833e8da0aaca5b52 Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-DeleteServersTestJSON-341953499 Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/389f067bb66740bb833e8da0aaca5b52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/389f067bb66740bb833e8da0aaca5b52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/389f067bb66740bb833e8da0aaca5b52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_389f067bb66740bb833e8da0aaca5b52", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-DeleteServersTestJSON-341953499 Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 389f067bb66740bb833e8da0aaca5b52 Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-DeleteServersTestJSON-341953499 Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-DeleteServersTestJSON-341953499-project Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 65234f7d8d3a4e79b5376f2f930dd880 Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-DeleteServersTestJSON-341953499-project Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: exception: Instance c28a15a2-23a5-4c7c-95e7-72816789061b could not be found. Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'c28a15a2-23a5-4c7c-95e7-72816789061b'} Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c28a15a2-23a5-4c7c-95e7-72816789061b could not be found. Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c28a15a2-23a5-4c7c-95e7-72816789061b could not be found. Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:52:13.572128 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:52:13.577089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:52:13.577089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:52:13.577089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:52:13.577089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:52:13.577089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:52:13.577089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c28a15a2-23a5-4c7c-95e7-72816789061b could not be found. Jun 10 18:52:13.577089 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:52:13.577089 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b7b01f58-90de-4762-9d71-3006b853190c tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Returning 404 to user: Instance c28a15a2-23a5-4c7c-95e7-72816789061b could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:52:13.577089 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b7b01f58-90de-4762-9d71-3006b853190c tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 404 len: 111 microversion: 2.1 time: 0.030283 Jun 10 18:52:13.577089 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3694/7316] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:13 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:52:13.590346 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7b0e800a-5a5b-4cb5-a80a-a73c2ddf4e19 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:13.590856 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7b0e800a-5a5b-4cb5-a80a-a73c2ddf4e19 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:13.596716 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b0e800a-5a5b-4cb5-a80a-a73c2ddf4e19 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:13.597173 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b0e800a-5a5b-4cb5-a80a-a73c2ddf4e19 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:13.598002 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b0e800a-5a5b-4cb5-a80a-a73c2ddf4e19 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:13.598445 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b0e800a-5a5b-4cb5-a80a-a73c2ddf4e19 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:13.611633 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-7b0e800a-5a5b-4cb5-a80a-a73c2ddf4e19 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] HTTP exception thrown: Instance c28a15a2-23a5-4c7c-95e7-72816789061b could not be found. Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7b0e800a-5a5b-4cb5-a80a-a73c2ddf4e19 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Request method failure captured: Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b HTTP/1.1 Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5KlIjoQHTyK_GxRb6EmdMw3SJxoUMEw1NDDnEIrUOf3LKs9y3V73_uYsHLiv7M-U-dIvH1oDHyBftXFaXlR2jgtNs2izQpXEbeiL3ULTcPvyoWb3Se6qcSd2lViu8TqpYaD04t13oAu5iOIuzLL9Wh3cOyGNQVJ3oSEip8eRVSaCx0 Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 389f067bb66740bb833e8da0aaca5b52 Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-DeleteServersTestJSON-341953499 Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/389f067bb66740bb833e8da0aaca5b52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/389f067bb66740bb833e8da0aaca5b52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/389f067bb66740bb833e8da0aaca5b52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_389f067bb66740bb833e8da0aaca5b52", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-DeleteServersTestJSON-341953499 Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 389f067bb66740bb833e8da0aaca5b52 Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-DeleteServersTestJSON-341953499 Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-DeleteServersTestJSON-341953499-project Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 65234f7d8d3a4e79b5376f2f930dd880 Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-DeleteServersTestJSON-341953499-project Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: exception: Instance c28a15a2-23a5-4c7c-95e7-72816789061b could not be found. Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'c28a15a2-23a5-4c7c-95e7-72816789061b'} Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c28a15a2-23a5-4c7c-95e7-72816789061b could not be found. Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:52:13.613181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:52:13.617952 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c28a15a2-23a5-4c7c-95e7-72816789061b could not be found. Jun 10 18:52:13.617952 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:52:13.617952 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:52:13.617952 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:52:13.617952 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:52:13.617952 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:52:13.617952 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:52:13.617952 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:52:13.617952 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:52:13.617952 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c28a15a2-23a5-4c7c-95e7-72816789061b could not be found. Jun 10 18:52:13.617952 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:52:13.617952 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7b0e800a-5a5b-4cb5-a80a-a73c2ddf4e19 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Returning 404 to user: Instance c28a15a2-23a5-4c7c-95e7-72816789061b could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:52:13.617952 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7b0e800a-5a5b-4cb5-a80a-a73c2ddf4e19 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "DELETE /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 404 len: 111 microversion: 2.1 time: 0.028778 Jun 10 18:52:13.617952 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3695/7317] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:52:13 2022] DELETE /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:52:13.622396 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4029e301-9b1e-418b-beb9-b9ad69477c35 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:13.623004 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4029e301-9b1e-418b-beb9-b9ad69477c35 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] [instance: c28a15a2-23a5-4c7c-95e7-72816789061b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:13.628772 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4029e301-9b1e-418b-beb9-b9ad69477c35 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:13.629242 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4029e301-9b1e-418b-beb9-b9ad69477c35 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:13.629993 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4029e301-9b1e-418b-beb9-b9ad69477c35 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:13.630438 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4029e301-9b1e-418b-beb9-b9ad69477c35 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:13.646564 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-4029e301-9b1e-418b-beb9-b9ad69477c35 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] HTTP exception thrown: Instance c28a15a2-23a5-4c7c-95e7-72816789061b could not be found. Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4029e301-9b1e-418b-beb9-b9ad69477c35 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Request method failure captured: Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b HTTP/1.1 Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5KlIjoQHTyK_GxRb6EmdMw3SJxoUMEw1NDDnEIrUOf3LKs9y3V73_uYsHLiv7M-U-dIvH1oDHyBftXFaXlR2jgtNs2izQpXEbeiL3ULTcPvyoWb3Se6qcSd2lViu8TqpYaD04t13oAu5iOIuzLL9Wh3cOyGNQVJ3oSEip8eRVSaCx0 Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 389f067bb66740bb833e8da0aaca5b52 Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-DeleteServersTestJSON-341953499 Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/389f067bb66740bb833e8da0aaca5b52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/389f067bb66740bb833e8da0aaca5b52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/389f067bb66740bb833e8da0aaca5b52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_389f067bb66740bb833e8da0aaca5b52", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-DeleteServersTestJSON-341953499 Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 389f067bb66740bb833e8da0aaca5b52 Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-DeleteServersTestJSON-341953499 Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-DeleteServersTestJSON-341953499-project Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 65234f7d8d3a4e79b5376f2f930dd880 Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-DeleteServersTestJSON-341953499-project Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: exception: Instance c28a15a2-23a5-4c7c-95e7-72816789061b could not be found. Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'c28a15a2-23a5-4c7c-95e7-72816789061b'} Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c28a15a2-23a5-4c7c-95e7-72816789061b could not be found. Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c28a15a2-23a5-4c7c-95e7-72816789061b could not be found. Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:52:13.650249 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:52:13.655047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:52:13.655047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:52:13.655047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:52:13.655047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:52:13.655047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:52:13.655047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c28a15a2-23a5-4c7c-95e7-72816789061b could not be found. Jun 10 18:52:13.655047 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:52:13.655047 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4029e301-9b1e-418b-beb9-b9ad69477c35 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] Returning 404 to user: Instance c28a15a2-23a5-4c7c-95e7-72816789061b could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:52:13.655047 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4029e301-9b1e-418b-beb9-b9ad69477c35 tempest-DeleteServersTestJSON-341953499 tempest-DeleteServersTestJSON-341953499-project] 10.222.0.35 "GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b" status: 404 len: 111 microversion: 2.1 time: 0.030527 Jun 10 18:52:13.655047 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3696/7318] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:13 2022] GET /compute/v2.1/servers/c28a15a2-23a5-4c7c-95e7-72816789061b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:52:17.929545 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ad92c07c-3ea1-45bc-83f9-fa5ca0d56a9d tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1818615987", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "4c5cfe5f-5684-45fb-914c-829036cb0c5c"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:52:17.982088 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-ad92c07c-3ea1-45bc-83f9-fa5ca0d56a9d tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] validate_networks() for [('4c5cfe5f-5684-45fb-914c-829036cb0c5c', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:52:18.325176 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-ad92c07c-3ea1-45bc-83f9-fa5ca0d56a9d tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:52:18.325636 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-ad92c07c-3ea1-45bc-83f9-fa5ca0d56a9d tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:52:18.326117 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-ad92c07c-3ea1-45bc-83f9-fa5ca0d56a9d tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:52:18.326562 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-ad92c07c-3ea1-45bc-83f9-fa5ca0d56a9d tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:52:18.326975 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-ad92c07c-3ea1-45bc-83f9-fa5ca0d56a9d tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:52:18.335935 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad92c07c-3ea1-45bc-83f9-fa5ca0d56a9d tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:18.336425 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad92c07c-3ea1-45bc-83f9-fa5ca0d56a9d tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:18.337791 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad92c07c-3ea1-45bc-83f9-fa5ca0d56a9d tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:18.338188 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad92c07c-3ea1-45bc-83f9-fa5ca0d56a9d tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:18.355331 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-ad92c07c-3ea1-45bc-83f9-fa5ca0d56a9d tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Getting quotas for project 4820b16707d848c593eb392a57d59863. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:52:18.360572 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-ad92c07c-3ea1-45bc-83f9-fa5ca0d56a9d tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Getting quotas for user 258f55116d19443e9e6f0de533b3fb87 and project 4820b16707d848c593eb392a57d59863. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:52:18.372797 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ad92c07c-3ea1-45bc-83f9-fa5ca0d56a9d tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:52:18.375046 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ad92c07c-3ea1-45bc-83f9-fa5ca0d56a9d tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:52:18.495278 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ad92c07c-3ea1-45bc-83f9-fa5ca0d56a9d tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.680494 Jun 10 18:52:18.495933 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3697/7319] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:52:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 10 18:52:18.505837 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-63bf009b-f553-4339-8b69-dee1479f5141 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:18.506441 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-63bf009b-f553-4339-8b69-dee1479f5141 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:18.559515 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-63bf009b-f553-4339-8b69-dee1479f5141 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:18.566339 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-63bf009b-f553-4339-8b69-dee1479f5141 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1218 microversion: 2.1 time: 0.064137 Jun 10 18:52:18.566894 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3698/7320] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:18 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1218 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:19.582962 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d1fdc418-a49c-4a8a-9978-80b3d6e7b391 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:19.583660 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d1fdc418-a49c-4a8a-9978-80b3d6e7b391 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:19.591347 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d1fdc418-a49c-4a8a-9978-80b3d6e7b391 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:19.591800 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d1fdc418-a49c-4a8a-9978-80b3d6e7b391 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:19.592605 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d1fdc418-a49c-4a8a-9978-80b3d6e7b391 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:19.593053 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d1fdc418-a49c-4a8a-9978-80b3d6e7b391 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:19.654813 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d1fdc418-a49c-4a8a-9978-80b3d6e7b391 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:19.662516 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d1fdc418-a49c-4a8a-9978-80b3d6e7b391 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1222 microversion: 2.1 time: 0.083454 Jun 10 18:52:19.664715 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3699/7321] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:19 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:20.680298 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-156b1d63-34e2-4771-bf28-12706c59d05d tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:20.680937 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-156b1d63-34e2-4771-bf28-12706c59d05d tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:20.688770 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-156b1d63-34e2-4771-bf28-12706c59d05d tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:20.689231 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-156b1d63-34e2-4771-bf28-12706c59d05d tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:20.690009 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-156b1d63-34e2-4771-bf28-12706c59d05d tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:20.690453 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-156b1d63-34e2-4771-bf28-12706c59d05d tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:20.758057 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-156b1d63-34e2-4771-bf28-12706c59d05d tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:20.766314 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-156b1d63-34e2-4771-bf28-12706c59d05d tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1276 microversion: 2.1 time: 0.090029 Jun 10 18:52:20.766892 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3700/7322] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:20 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1276 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:21.783691 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0a3a85a6-cbab-46ac-987e-b04f3cfbc640 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:21.784357 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0a3a85a6-cbab-46ac-987e-b04f3cfbc640 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:21.791749 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0a3a85a6-cbab-46ac-987e-b04f3cfbc640 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:21.792208 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0a3a85a6-cbab-46ac-987e-b04f3cfbc640 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:21.793003 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0a3a85a6-cbab-46ac-987e-b04f3cfbc640 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:21.793445 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0a3a85a6-cbab-46ac-987e-b04f3cfbc640 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:21.930490 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0a3a85a6-cbab-46ac-987e-b04f3cfbc640 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:21.938339 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0a3a85a6-cbab-46ac-987e-b04f3cfbc640 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1318 microversion: 2.1 time: 0.159217 Jun 10 18:52:21.938921 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3701/7323] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:21 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:21.943651 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-4c70b599-e6b5-442d-b10a-07467de7294c req-bfab46d2-be4b-430f-9200-5fdf1798dfda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a6e1999-5117-432a-a98e-a5d203359f46", "tag": "1b71dd5c-7cf2-4607-a94e-2d0101f036fa"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:52:21.952506 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-4c70b599-e6b5-442d-b10a-07467de7294c req-bfab46d2-be4b-430f-9200-5fdf1798dfda service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:21.952941 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-4c70b599-e6b5-442d-b10a-07467de7294c req-bfab46d2-be4b-430f-9200-5fdf1798dfda service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:21.956831 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:52:21.964538 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-4c70b599-e6b5-442d-b10a-07467de7294c req-bfab46d2-be4b-430f-9200-5fdf1798dfda service nova] Creating event network-changed:1b71dd5c-7cf2-4607-a94e-2d0101f036fa for instance 2a6e1999-5117-432a-a98e-a5d203359f46 on chh1-master-2 Jun 10 18:52:21.969790 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-4c70b599-e6b5-442d-b10a-07467de7294c req-bfab46d2-be4b-430f-9200-5fdf1798dfda service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029637 Jun 10 18:52:21.970395 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3702/7324] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:52:22.956780 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-975a49be-43e4-45a1-bd17-dd21321068da tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:22.957530 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-975a49be-43e4-45a1-bd17-dd21321068da tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:22.965015 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-975a49be-43e4-45a1-bd17-dd21321068da tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:22.965467 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-975a49be-43e4-45a1-bd17-dd21321068da tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:22.966228 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-975a49be-43e4-45a1-bd17-dd21321068da tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:22.966665 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-975a49be-43e4-45a1-bd17-dd21321068da tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:23.097340 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-975a49be-43e4-45a1-bd17-dd21321068da tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:23.104786 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-975a49be-43e4-45a1-bd17-dd21321068da tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1318 microversion: 2.1 time: 0.153434 Jun 10 18:52:23.107852 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3703/7325] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:22 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:52:24.121757 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2d0b1eea-ec10-41b7-bbca-293895113ab4 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:24.122435 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2d0b1eea-ec10-41b7-bbca-293895113ab4 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:24.135623 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2d0b1eea-ec10-41b7-bbca-293895113ab4 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:24.136609 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2d0b1eea-ec10-41b7-bbca-293895113ab4 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:24.137388 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2d0b1eea-ec10-41b7-bbca-293895113ab4 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:24.137829 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2d0b1eea-ec10-41b7-bbca-293895113ab4 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:24.274260 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2d0b1eea-ec10-41b7-bbca-293895113ab4 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:24.281698 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2d0b1eea-ec10-41b7-bbca-293895113ab4 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1318 microversion: 2.1 time: 0.163945 Jun 10 18:52:24.282304 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3704/7326] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:24 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:25.298563 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-32708849-0f11-447f-96a7-ecb8f4d0631e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:25.299260 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-32708849-0f11-447f-96a7-ecb8f4d0631e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:25.306114 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-32708849-0f11-447f-96a7-ecb8f4d0631e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:25.306564 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-32708849-0f11-447f-96a7-ecb8f4d0631e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:25.307329 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-32708849-0f11-447f-96a7-ecb8f4d0631e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:25.308286 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-32708849-0f11-447f-96a7-ecb8f4d0631e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:25.435930 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-32708849-0f11-447f-96a7-ecb8f4d0631e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:25.443687 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-32708849-0f11-447f-96a7-ecb8f4d0631e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1318 microversion: 2.1 time: 0.149048 Jun 10 18:52:25.444272 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3705/7327] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:25 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:26.460626 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c9d7d951-6254-4cb1-9ed4-0429434ce201 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:26.464553 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c9d7d951-6254-4cb1-9ed4-0429434ce201 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:26.467881 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9d7d951-6254-4cb1-9ed4-0429434ce201 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:26.468333 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9d7d951-6254-4cb1-9ed4-0429434ce201 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:26.469163 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9d7d951-6254-4cb1-9ed4-0429434ce201 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:26.469595 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9d7d951-6254-4cb1-9ed4-0429434ce201 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:26.607809 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c9d7d951-6254-4cb1-9ed4-0429434ce201 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:26.615432 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c9d7d951-6254-4cb1-9ed4-0429434ce201 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1318 microversion: 2.1 time: 0.158775 Jun 10 18:52:26.615961 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3706/7328] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:26 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:26.620824 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-54791e7a-481c-48c6-b8bd-bdec0bef3d53 req-d674eb6c-5901-4415-a0a5-06537d47fad3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a6e1999-5117-432a-a98e-a5d203359f46", "name": "network-vif-plugged", "status": "completed", "tag": "1b71dd5c-7cf2-4607-a94e-2d0101f036fa"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:52:26.628414 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-54791e7a-481c-48c6-b8bd-bdec0bef3d53 req-d674eb6c-5901-4415-a0a5-06537d47fad3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:26.628872 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-54791e7a-481c-48c6-b8bd-bdec0bef3d53 req-d674eb6c-5901-4415-a0a5-06537d47fad3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:26.640705 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-54791e7a-481c-48c6-b8bd-bdec0bef3d53 req-d674eb6c-5901-4415-a0a5-06537d47fad3 service nova] Creating event network-vif-plugged:1b71dd5c-7cf2-4607-a94e-2d0101f036fa for instance 2a6e1999-5117-432a-a98e-a5d203359f46 on chh1-master-2 Jun 10 18:52:26.645655 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-54791e7a-481c-48c6-b8bd-bdec0bef3d53 req-d674eb6c-5901-4415-a0a5-06537d47fad3 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028482 Jun 10 18:52:26.648480 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3707/7329] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:52:27.634466 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6d51f31c-0eb7-466a-bd9b-1d4c477ab73e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:27.635150 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6d51f31c-0eb7-466a-bd9b-1d4c477ab73e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:27.642204 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d51f31c-0eb7-466a-bd9b-1d4c477ab73e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:27.642653 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d51f31c-0eb7-466a-bd9b-1d4c477ab73e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:27.643416 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d51f31c-0eb7-466a-bd9b-1d4c477ab73e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:27.643857 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d51f31c-0eb7-466a-bd9b-1d4c477ab73e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:27.776100 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6d51f31c-0eb7-466a-bd9b-1d4c477ab73e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:27.784508 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6d51f31c-0eb7-466a-bd9b-1d4c477ab73e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1318 microversion: 2.1 time: 0.155150 Jun 10 18:52:27.785082 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3708/7330] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:27 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:28.801114 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a10ac64e-c125-42eb-a2e8-97ed62c42fee tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:28.801783 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a10ac64e-c125-42eb-a2e8-97ed62c42fee tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:28.803777 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:52:28.804503 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=8 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:52:28.810862 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a10ac64e-c125-42eb-a2e8-97ed62c42fee tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:28.811308 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a10ac64e-c125-42eb-a2e8-97ed62c42fee tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:28.812067 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a10ac64e-c125-42eb-a2e8-97ed62c42fee tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:28.812537 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a10ac64e-c125-42eb-a2e8-97ed62c42fee tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:28.939735 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a10ac64e-c125-42eb-a2e8-97ed62c42fee tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:28.947295 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a10ac64e-c125-42eb-a2e8-97ed62c42fee tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1508 microversion: 2.1 time: 0.150257 Jun 10 18:52:28.947863 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3709/7331] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:28 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:28.963612 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3b54fe1a-d88a-4be7-8d91-3be61a0e9fdd tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:28.964268 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3b54fe1a-d88a-4be7-8d91-3be61a0e9fdd tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:28.970221 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3b54fe1a-d88a-4be7-8d91-3be61a0e9fdd tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:28.970668 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3b54fe1a-d88a-4be7-8d91-3be61a0e9fdd tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:28.971465 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3b54fe1a-d88a-4be7-8d91-3be61a0e9fdd tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:28.971903 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3b54fe1a-d88a-4be7-8d91-3be61a0e9fdd tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:29.102464 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3b54fe1a-d88a-4be7-8d91-3be61a0e9fdd tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:29.110771 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3b54fe1a-d88a-4be7-8d91-3be61a0e9fdd tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1508 microversion: 2.1 time: 0.150915 Jun 10 18:52:29.111632 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3710/7332] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:28 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:29.126812 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ad384501-ab0e-4a67-a9c9-ee47a3872703 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:52:29.127967 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ad384501-ab0e-4a67-a9c9-ee47a3872703 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:29.133842 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad384501-ab0e-4a67-a9c9-ee47a3872703 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:29.134286 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad384501-ab0e-4a67-a9c9-ee47a3872703 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:29.135063 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad384501-ab0e-4a67-a9c9-ee47a3872703 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:29.135496 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad384501-ab0e-4a67-a9c9-ee47a3872703 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:29.252333 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ad384501-ab0e-4a67-a9c9-ee47a3872703 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "PUT /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1080 microversion: 2.1 time: 0.129051 Jun 10 18:52:29.253140 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3711/7333] 10.222.0.35 () {60 vars in 1255 bytes} [Fri Jun 10 18:52:29 2022] PUT /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1080 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:29.266887 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-526019e0-fdce-482c-a03c-a292dcc69757 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:29.267487 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-526019e0-fdce-482c-a03c-a292dcc69757 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:29.273477 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-526019e0-fdce-482c-a03c-a292dcc69757 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:29.273971 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-526019e0-fdce-482c-a03c-a292dcc69757 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:29.274711 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-526019e0-fdce-482c-a03c-a292dcc69757 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:29.275152 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-526019e0-fdce-482c-a03c-a292dcc69757 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:29.402395 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-526019e0-fdce-482c-a03c-a292dcc69757 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:29.409856 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-526019e0-fdce-482c-a03c-a292dcc69757 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1506 microversion: 2.1 time: 0.146937 Jun 10 18:52:29.410420 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3712/7334] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:29 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1506 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:29.426347 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-16144306-1716-4002-8486-94a0cfc62560 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:29.426947 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-16144306-1716-4002-8486-94a0cfc62560 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:29.433966 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-16144306-1716-4002-8486-94a0cfc62560 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:29.434416 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-16144306-1716-4002-8486-94a0cfc62560 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:29.435170 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-16144306-1716-4002-8486-94a0cfc62560 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:29.435605 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-16144306-1716-4002-8486-94a0cfc62560 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:29.568595 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-16144306-1716-4002-8486-94a0cfc62560 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:29.576132 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-16144306-1716-4002-8486-94a0cfc62560 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1506 microversion: 2.1 time: 0.153879 Jun 10 18:52:29.576756 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3713/7335] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:29 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:29.592520 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f5173429-f5fe-4114-a630-a115a945d543 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:52:29.593491 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f5173429-f5fe-4114-a630-a115a945d543 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:29.599376 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f5173429-f5fe-4114-a630-a115a945d543 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:29.599823 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f5173429-f5fe-4114-a630-a115a945d543 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:29.600613 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f5173429-f5fe-4114-a630-a115a945d543 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:29.601052 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f5173429-f5fe-4114-a630-a115a945d543 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:29.628900 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f5173429-f5fe-4114-a630-a115a945d543 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:29.634607 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f5173429-f5fe-4114-a630-a115a945d543 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Old instance type m1.heat2, new instance type m1.heat {{(pid=126595) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 10 18:52:29.641036 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-f5173429-f5fe-4114-a630-a115a945d543 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:52:29.641457 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-f5173429-f5fe-4114-a630-a115a945d543 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:52:29.641929 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-f5173429-f5fe-4114-a630-a115a945d543 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:52:29.642337 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-f5173429-f5fe-4114-a630-a115a945d543 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:52:29.642745 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-f5173429-f5fe-4114-a630-a115a945d543 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:52:29.814764 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f5173429-f5fe-4114-a630-a115a945d543 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "POST /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46/action" status: 202 len: 0 microversion: 2.1 time: 0.226341 Jun 10 18:52:29.815430 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3714/7336] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:52:29 2022] POST /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 18:52:29.822903 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fde4b4a6-837b-4d17-b9a8-84d425d1bd6b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:29.824105 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fde4b4a6-837b-4d17-b9a8-84d425d1bd6b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:29.830233 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fde4b4a6-837b-4d17-b9a8-84d425d1bd6b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:29.830688 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fde4b4a6-837b-4d17-b9a8-84d425d1bd6b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:29.831449 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fde4b4a6-837b-4d17-b9a8-84d425d1bd6b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:29.831885 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fde4b4a6-837b-4d17-b9a8-84d425d1bd6b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:29.961680 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fde4b4a6-837b-4d17-b9a8-84d425d1bd6b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:29.969987 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fde4b4a6-837b-4d17-b9a8-84d425d1bd6b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1517 microversion: 2.1 time: 0.150648 Jun 10 18:52:29.970560 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3715/7337] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:29 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1517 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:30.986995 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f89ed130-0b19-477e-81c6-510df9777847 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:30.987617 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f89ed130-0b19-477e-81c6-510df9777847 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:30.995238 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f89ed130-0b19-477e-81c6-510df9777847 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:30.995698 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f89ed130-0b19-477e-81c6-510df9777847 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:30.996609 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f89ed130-0b19-477e-81c6-510df9777847 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:30.997061 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f89ed130-0b19-477e-81c6-510df9777847 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:31.131482 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f89ed130-0b19-477e-81c6-510df9777847 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:31.139815 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f89ed130-0b19-477e-81c6-510df9777847 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1517 microversion: 2.1 time: 0.156716 Jun 10 18:52:31.140713 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3716/7338] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:30 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:32.158244 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9b44e23c-0a55-4923-bc14-4cc27fdf5b49 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:32.158962 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9b44e23c-0a55-4923-bc14-4cc27fdf5b49 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:32.166611 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b44e23c-0a55-4923-bc14-4cc27fdf5b49 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:32.167071 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b44e23c-0a55-4923-bc14-4cc27fdf5b49 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:32.167851 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b44e23c-0a55-4923-bc14-4cc27fdf5b49 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:32.168319 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b44e23c-0a55-4923-bc14-4cc27fdf5b49 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:32.303456 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9b44e23c-0a55-4923-bc14-4cc27fdf5b49 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:32.311273 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9b44e23c-0a55-4923-bc14-4cc27fdf5b49 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1517 microversion: 2.1 time: 0.157038 Jun 10 18:52:32.311846 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3717/7339] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:32 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:33.339374 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3b9e6fa6-101a-4c83-b6e1-5528ae7421fa tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:33.340010 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3b9e6fa6-101a-4c83-b6e1-5528ae7421fa tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:33.346965 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3b9e6fa6-101a-4c83-b6e1-5528ae7421fa tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:33.347427 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3b9e6fa6-101a-4c83-b6e1-5528ae7421fa tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:33.348196 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3b9e6fa6-101a-4c83-b6e1-5528ae7421fa tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:33.348668 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3b9e6fa6-101a-4c83-b6e1-5528ae7421fa tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:33.352591 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:52:33.479856 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3b9e6fa6-101a-4c83-b6e1-5528ae7421fa tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:33.487274 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3b9e6fa6-101a-4c83-b6e1-5528ae7421fa tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1522 microversion: 2.1 time: 0.152277 Jun 10 18:52:33.487849 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3718/7340] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:33 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:34.504651 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1f2b5a93-2567-49b9-b952-aae67ed8f0cb tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:34.505332 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1f2b5a93-2567-49b9-b952-aae67ed8f0cb tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:34.512726 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f2b5a93-2567-49b9-b952-aae67ed8f0cb tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:34.513181 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f2b5a93-2567-49b9-b952-aae67ed8f0cb tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:34.513945 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f2b5a93-2567-49b9-b952-aae67ed8f0cb tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:34.514386 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f2b5a93-2567-49b9-b952-aae67ed8f0cb tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:34.641863 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1f2b5a93-2567-49b9-b952-aae67ed8f0cb tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:34.649365 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1f2b5a93-2567-49b9-b952-aae67ed8f0cb tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1522 microversion: 2.1 time: 0.148640 Jun 10 18:52:34.649940 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3719/7341] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:34 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:35.667006 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-817a0355-24c7-4d8e-916e-79dcb4a81489 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:35.667661 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-817a0355-24c7-4d8e-916e-79dcb4a81489 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:35.674971 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-817a0355-24c7-4d8e-916e-79dcb4a81489 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:35.675366 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-817a0355-24c7-4d8e-916e-79dcb4a81489 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:35.676271 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-817a0355-24c7-4d8e-916e-79dcb4a81489 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:35.676775 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-817a0355-24c7-4d8e-916e-79dcb4a81489 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:35.804028 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-817a0355-24c7-4d8e-916e-79dcb4a81489 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:35.812190 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-817a0355-24c7-4d8e-916e-79dcb4a81489 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1522 microversion: 2.1 time: 0.149090 Jun 10 18:52:35.812803 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3720/7342] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:35 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:36.829181 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1cf55165-5626-4691-8359-b6f6b01f3979 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:36.829797 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1cf55165-5626-4691-8359-b6f6b01f3979 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:36.836784 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1cf55165-5626-4691-8359-b6f6b01f3979 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:36.837238 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1cf55165-5626-4691-8359-b6f6b01f3979 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:36.838006 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1cf55165-5626-4691-8359-b6f6b01f3979 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:36.838444 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1cf55165-5626-4691-8359-b6f6b01f3979 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:36.968962 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1cf55165-5626-4691-8359-b6f6b01f3979 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:36.976674 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1cf55165-5626-4691-8359-b6f6b01f3979 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1522 microversion: 2.1 time: 0.151301 Jun 10 18:52:36.977254 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3721/7343] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:36 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:37.993622 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-93ff2c8a-7b50-4b3f-82d2-acf9ea29dbc6 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:37.994310 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-93ff2c8a-7b50-4b3f-82d2-acf9ea29dbc6 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:38.002005 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93ff2c8a-7b50-4b3f-82d2-acf9ea29dbc6 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:38.002462 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93ff2c8a-7b50-4b3f-82d2-acf9ea29dbc6 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:38.003229 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93ff2c8a-7b50-4b3f-82d2-acf9ea29dbc6 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:38.003675 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93ff2c8a-7b50-4b3f-82d2-acf9ea29dbc6 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:38.132473 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-93ff2c8a-7b50-4b3f-82d2-acf9ea29dbc6 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:38.140214 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-93ff2c8a-7b50-4b3f-82d2-acf9ea29dbc6 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1522 microversion: 2.1 time: 0.150217 Jun 10 18:52:38.140835 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3722/7344] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:37 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:39.157290 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7de2205a-2b16-43f8-a2dc-8337b3499e60 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:39.157947 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7de2205a-2b16-43f8-a2dc-8337b3499e60 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:39.164946 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7de2205a-2b16-43f8-a2dc-8337b3499e60 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:39.165406 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7de2205a-2b16-43f8-a2dc-8337b3499e60 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:39.166175 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7de2205a-2b16-43f8-a2dc-8337b3499e60 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:39.167134 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7de2205a-2b16-43f8-a2dc-8337b3499e60 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:39.300317 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7de2205a-2b16-43f8-a2dc-8337b3499e60 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:39.307949 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7de2205a-2b16-43f8-a2dc-8337b3499e60 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1522 microversion: 2.1 time: 0.154724 Jun 10 18:52:39.308561 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3723/7345] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:39 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:40.325592 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-19f3b80a-2a84-490a-bc16-2c37dd28b1ae tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:40.326230 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-19f3b80a-2a84-490a-bc16-2c37dd28b1ae tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:40.333184 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-19f3b80a-2a84-490a-bc16-2c37dd28b1ae tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:40.333638 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-19f3b80a-2a84-490a-bc16-2c37dd28b1ae tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:40.334398 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-19f3b80a-2a84-490a-bc16-2c37dd28b1ae tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:40.334831 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-19f3b80a-2a84-490a-bc16-2c37dd28b1ae tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:40.463013 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-19f3b80a-2a84-490a-bc16-2c37dd28b1ae tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:40.471473 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-19f3b80a-2a84-490a-bc16-2c37dd28b1ae tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1522 microversion: 2.1 time: 0.150421 Jun 10 18:52:40.472043 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3724/7346] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:40 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:41.488978 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0e100326-2088-4863-9830-b19b3bad2939 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:41.489619 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0e100326-2088-4863-9830-b19b3bad2939 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:41.496614 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0e100326-2088-4863-9830-b19b3bad2939 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:41.497064 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0e100326-2088-4863-9830-b19b3bad2939 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:41.497853 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0e100326-2088-4863-9830-b19b3bad2939 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:41.498292 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0e100326-2088-4863-9830-b19b3bad2939 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:41.627990 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0e100326-2088-4863-9830-b19b3bad2939 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:41.635599 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0e100326-2088-4863-9830-b19b3bad2939 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1522 microversion: 2.1 time: 0.150458 Jun 10 18:52:41.636174 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3725/7347] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:41 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:42.652109 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4bd41fb1-b0fb-4b88-af1c-4766bae88776 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:42.652769 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4bd41fb1-b0fb-4b88-af1c-4766bae88776 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:42.658969 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4bd41fb1-b0fb-4b88-af1c-4766bae88776 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:42.659428 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4bd41fb1-b0fb-4b88-af1c-4766bae88776 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:42.660220 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4bd41fb1-b0fb-4b88-af1c-4766bae88776 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:42.660683 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4bd41fb1-b0fb-4b88-af1c-4766bae88776 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:42.788979 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4bd41fb1-b0fb-4b88-af1c-4766bae88776 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:42.797086 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4bd41fb1-b0fb-4b88-af1c-4766bae88776 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1522 microversion: 2.1 time: 0.149058 Jun 10 18:52:42.797656 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3726/7348] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:42 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:43.814354 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f7d647d6-a77d-4151-a7fb-c3c88e57e2df tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:43.815056 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f7d647d6-a77d-4151-a7fb-c3c88e57e2df tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:43.817829 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:52:43.822658 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f7d647d6-a77d-4151-a7fb-c3c88e57e2df tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:43.823113 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f7d647d6-a77d-4151-a7fb-c3c88e57e2df tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:43.824574 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f7d647d6-a77d-4151-a7fb-c3c88e57e2df tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:43.825019 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f7d647d6-a77d-4151-a7fb-c3c88e57e2df tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:43.952838 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f7d647d6-a77d-4151-a7fb-c3c88e57e2df tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:43.960369 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f7d647d6-a77d-4151-a7fb-c3c88e57e2df tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1522 microversion: 2.1 time: 0.149898 Jun 10 18:52:43.960950 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3727/7349] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:43 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:44.977130 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e5a02ee9-f7b9-43b7-811f-20b8e2392756 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:44.977783 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e5a02ee9-f7b9-43b7-811f-20b8e2392756 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:44.985260 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e5a02ee9-f7b9-43b7-811f-20b8e2392756 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:44.985714 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e5a02ee9-f7b9-43b7-811f-20b8e2392756 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:44.986485 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e5a02ee9-f7b9-43b7-811f-20b8e2392756 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:44.986951 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e5a02ee9-f7b9-43b7-811f-20b8e2392756 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:45.119592 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e5a02ee9-f7b9-43b7-811f-20b8e2392756 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:45.127727 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e5a02ee9-f7b9-43b7-811f-20b8e2392756 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1522 microversion: 2.1 time: 0.154540 Jun 10 18:52:45.128321 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3728/7350] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:44 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:46.144955 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4e979fbe-bd0b-4e33-89da-98d4cbdf2e0c tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:46.145615 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4e979fbe-bd0b-4e33-89da-98d4cbdf2e0c tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:46.153153 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e979fbe-bd0b-4e33-89da-98d4cbdf2e0c tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:46.153611 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e979fbe-bd0b-4e33-89da-98d4cbdf2e0c tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:46.154388 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e979fbe-bd0b-4e33-89da-98d4cbdf2e0c tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:46.154835 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e979fbe-bd0b-4e33-89da-98d4cbdf2e0c tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:46.282582 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4e979fbe-bd0b-4e33-89da-98d4cbdf2e0c tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:46.290089 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4e979fbe-bd0b-4e33-89da-98d4cbdf2e0c tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1522 microversion: 2.1 time: 0.149126 Jun 10 18:52:46.290671 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3729/7351] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:46 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:47.309738 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-df7ce8dc-753d-4e28-93b1-a2d7d8f7099c tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:47.310392 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-df7ce8dc-753d-4e28-93b1-a2d7d8f7099c tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:47.317219 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df7ce8dc-753d-4e28-93b1-a2d7d8f7099c tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:47.317670 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df7ce8dc-753d-4e28-93b1-a2d7d8f7099c tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:47.318425 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df7ce8dc-753d-4e28-93b1-a2d7d8f7099c tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:47.318867 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-df7ce8dc-753d-4e28-93b1-a2d7d8f7099c tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:47.451629 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-df7ce8dc-753d-4e28-93b1-a2d7d8f7099c tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:47.459181 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-df7ce8dc-753d-4e28-93b1-a2d7d8f7099c tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1522 microversion: 2.1 time: 0.153922 Jun 10 18:52:47.459765 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3730/7352] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:47 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:48.476848 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b0aa7bf9-4a04-4481-a4a3-1d248e098cb9 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:48.477440 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b0aa7bf9-4a04-4481-a4a3-1d248e098cb9 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:48.484992 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b0aa7bf9-4a04-4481-a4a3-1d248e098cb9 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:48.485447 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b0aa7bf9-4a04-4481-a4a3-1d248e098cb9 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:48.486202 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b0aa7bf9-4a04-4481-a4a3-1d248e098cb9 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:48.486640 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b0aa7bf9-4a04-4481-a4a3-1d248e098cb9 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:48.614932 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b0aa7bf9-4a04-4481-a4a3-1d248e098cb9 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:48.622401 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b0aa7bf9-4a04-4481-a4a3-1d248e098cb9 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1522 microversion: 2.1 time: 0.149450 Jun 10 18:52:48.622973 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3731/7353] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:48 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:49.641670 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-38014038-9e22-4fec-9fdc-76b01722513e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:49.642340 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-38014038-9e22-4fec-9fdc-76b01722513e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:49.649422 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-38014038-9e22-4fec-9fdc-76b01722513e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:49.649880 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-38014038-9e22-4fec-9fdc-76b01722513e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:49.650677 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-38014038-9e22-4fec-9fdc-76b01722513e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:49.651123 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-38014038-9e22-4fec-9fdc-76b01722513e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:49.778436 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-38014038-9e22-4fec-9fdc-76b01722513e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:49.785817 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-38014038-9e22-4fec-9fdc-76b01722513e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1522 microversion: 2.1 time: 0.149030 Jun 10 18:52:49.786385 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3732/7354] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:49 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:50.803021 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f4d9892e-3862-4d24-b1b9-d22e09cff9fa tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:50.803679 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f4d9892e-3862-4d24-b1b9-d22e09cff9fa tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:50.811296 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f4d9892e-3862-4d24-b1b9-d22e09cff9fa tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:50.811753 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f4d9892e-3862-4d24-b1b9-d22e09cff9fa tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:50.812556 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f4d9892e-3862-4d24-b1b9-d22e09cff9fa tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:50.813006 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f4d9892e-3862-4d24-b1b9-d22e09cff9fa tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:50.943212 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f4d9892e-3862-4d24-b1b9-d22e09cff9fa tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:50.950865 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f4d9892e-3862-4d24-b1b9-d22e09cff9fa tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1522 microversion: 2.1 time: 0.151740 Jun 10 18:52:50.951442 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3733/7355] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:50 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:51.978506 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ff47ca23-9782-486e-941a-1ce3657cf0af tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:51.979183 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ff47ca23-9782-486e-941a-1ce3657cf0af tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:51.986033 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ff47ca23-9782-486e-941a-1ce3657cf0af tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:51.987004 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ff47ca23-9782-486e-941a-1ce3657cf0af tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:51.987230 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ff47ca23-9782-486e-941a-1ce3657cf0af tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:51.987700 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ff47ca23-9782-486e-941a-1ce3657cf0af tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:52.119658 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ff47ca23-9782-486e-941a-1ce3657cf0af tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:52.123636 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:52:52.128047 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ff47ca23-9782-486e-941a-1ce3657cf0af tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1522 microversion: 2.1 time: 0.153466 Jun 10 18:52:52.128650 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3734/7356] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:51 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:53.146121 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b563e156-0f28-4686-bbad-f846e778252b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:53.146788 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b563e156-0f28-4686-bbad-f846e778252b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:53.154162 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b563e156-0f28-4686-bbad-f846e778252b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:53.154619 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b563e156-0f28-4686-bbad-f846e778252b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:53.155382 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b563e156-0f28-4686-bbad-f846e778252b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:53.155823 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b563e156-0f28-4686-bbad-f846e778252b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:53.287501 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b563e156-0f28-4686-bbad-f846e778252b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:53.295650 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b563e156-0f28-4686-bbad-f846e778252b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1522 microversion: 2.1 time: 0.153490 Jun 10 18:52:53.297468 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3735/7357] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:53 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:54.312389 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-12cc23e9-503b-466f-b9e3-4c13a37cb7d6 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:54.313094 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-12cc23e9-503b-466f-b9e3-4c13a37cb7d6 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:54.320085 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-12cc23e9-503b-466f-b9e3-4c13a37cb7d6 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:54.320583 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-12cc23e9-503b-466f-b9e3-4c13a37cb7d6 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:54.321383 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-12cc23e9-503b-466f-b9e3-4c13a37cb7d6 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:54.321831 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-12cc23e9-503b-466f-b9e3-4c13a37cb7d6 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:54.463847 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-12cc23e9-503b-466f-b9e3-4c13a37cb7d6 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:54.471439 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-12cc23e9-503b-466f-b9e3-4c13a37cb7d6 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1522 microversion: 2.1 time: 0.163500 Jun 10 18:52:54.472021 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3736/7358] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:54 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:55.487696 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6f8707ff-3958-4dfb-9f0c-3a143df2769e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:55.488356 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6f8707ff-3958-4dfb-9f0c-3a143df2769e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:55.495283 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6f8707ff-3958-4dfb-9f0c-3a143df2769e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:55.495753 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6f8707ff-3958-4dfb-9f0c-3a143df2769e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:55.496644 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6f8707ff-3958-4dfb-9f0c-3a143df2769e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:55.497079 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6f8707ff-3958-4dfb-9f0c-3a143df2769e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:55.628398 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6f8707ff-3958-4dfb-9f0c-3a143df2769e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:55.635818 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6f8707ff-3958-4dfb-9f0c-3a143df2769e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1522 microversion: 2.1 time: 0.152005 Jun 10 18:52:55.636936 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3737/7359] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:55 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:56.654060 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c909239b-a5c8-4841-9b3a-6d5cf98a7137 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:56.654740 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c909239b-a5c8-4841-9b3a-6d5cf98a7137 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:56.661710 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c909239b-a5c8-4841-9b3a-6d5cf98a7137 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:56.662167 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c909239b-a5c8-4841-9b3a-6d5cf98a7137 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:56.662948 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c909239b-a5c8-4841-9b3a-6d5cf98a7137 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:56.663393 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c909239b-a5c8-4841-9b3a-6d5cf98a7137 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:56.798557 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c909239b-a5c8-4841-9b3a-6d5cf98a7137 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:56.806025 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c909239b-a5c8-4841-9b3a-6d5cf98a7137 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1522 microversion: 2.1 time: 0.156456 Jun 10 18:52:56.806606 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3738/7360] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:56 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:57.822988 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-013ea358-8f59-4dd7-a5e4-747735515708 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:57.823680 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-013ea358-8f59-4dd7-a5e4-747735515708 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:57.830611 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-013ea358-8f59-4dd7-a5e4-747735515708 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:57.831068 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-013ea358-8f59-4dd7-a5e4-747735515708 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:57.831839 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-013ea358-8f59-4dd7-a5e4-747735515708 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:57.832284 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-013ea358-8f59-4dd7-a5e4-747735515708 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:57.961663 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-013ea358-8f59-4dd7-a5e4-747735515708 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:57.969787 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-013ea358-8f59-4dd7-a5e4-747735515708 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1522 microversion: 2.1 time: 0.150743 Jun 10 18:52:57.970390 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3739/7361] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:57 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:52:58.987090 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-00897d85-6858-4b7c-8ef6-ea920f03367b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:52:58.987792 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-00897d85-6858-4b7c-8ef6-ea920f03367b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:52:58.994558 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-00897d85-6858-4b7c-8ef6-ea920f03367b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:58.995035 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-00897d85-6858-4b7c-8ef6-ea920f03367b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:58.995818 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-00897d85-6858-4b7c-8ef6-ea920f03367b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:52:58.996257 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-00897d85-6858-4b7c-8ef6-ea920f03367b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:52:59.129140 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-00897d85-6858-4b7c-8ef6-ea920f03367b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:52:59.137074 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-00897d85-6858-4b7c-8ef6-ea920f03367b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1522 microversion: 2.1 time: 0.153332 Jun 10 18:52:59.137689 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3740/7362] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:52:58 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:00.154891 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-20e8dcc9-a192-49b0-8827-fdfb0fa291d2 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:00.155543 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-20e8dcc9-a192-49b0-8827-fdfb0fa291d2 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:00.162389 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-20e8dcc9-a192-49b0-8827-fdfb0fa291d2 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:00.162838 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-20e8dcc9-a192-49b0-8827-fdfb0fa291d2 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:00.163600 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-20e8dcc9-a192-49b0-8827-fdfb0fa291d2 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:00.164036 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-20e8dcc9-a192-49b0-8827-fdfb0fa291d2 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:00.295812 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-20e8dcc9-a192-49b0-8827-fdfb0fa291d2 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:00.303568 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-20e8dcc9-a192-49b0-8827-fdfb0fa291d2 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1522 microversion: 2.1 time: 0.153125 Jun 10 18:53:00.304149 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3741/7363] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:00 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:00.843359 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-ce5a9984-b754-4c12-af08-51d7e5a7c721 req-6f45ba2f-3f32-44e6-b4a3-1568ae5f3bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a6e1999-5117-432a-a98e-a5d203359f46", "name": "network-vif-unplugged", "status": "completed", "tag": "1b71dd5c-7cf2-4607-a94e-2d0101f036fa"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:53:00.851711 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-ce5a9984-b754-4c12-af08-51d7e5a7c721 req-6f45ba2f-3f32-44e6-b4a3-1568ae5f3bb6 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:00.852170 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-ce5a9984-b754-4c12-af08-51d7e5a7c721 req-6f45ba2f-3f32-44e6-b4a3-1568ae5f3bb6 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:00.867147 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-ce5a9984-b754-4c12-af08-51d7e5a7c721 req-6f45ba2f-3f32-44e6-b4a3-1568ae5f3bb6 service nova] Creating event network-vif-unplugged:1b71dd5c-7cf2-4607-a94e-2d0101f036fa for instance 2a6e1999-5117-432a-a98e-a5d203359f46 on chh2-master-2 Jun 10 18:53:00.873096 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [req-ce5a9984-b754-4c12-af08-51d7e5a7c721 req-6f45ba2f-3f32-44e6-b4a3-1568ae5f3bb6 service nova] Instance 2a6e1999-5117-432a-a98e-a5d203359f46 is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 18:53:00.883764 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-ce5a9984-b754-4c12-af08-51d7e5a7c721 req-6f45ba2f-3f32-44e6-b4a3-1568ae5f3bb6 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044375 Jun 10 18:53:00.884427 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3742/7364] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:53:01.321205 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b3054235-7ef0-403e-b142-839dcfd11735 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:01.321963 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b3054235-7ef0-403e-b142-839dcfd11735 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:01.328760 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b3054235-7ef0-403e-b142-839dcfd11735 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:01.329213 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b3054235-7ef0-403e-b142-839dcfd11735 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:01.329975 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b3054235-7ef0-403e-b142-839dcfd11735 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:01.330416 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b3054235-7ef0-403e-b142-839dcfd11735 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:01.486766 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b3054235-7ef0-403e-b142-839dcfd11735 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:01.494724 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b3054235-7ef0-403e-b142-839dcfd11735 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1521 microversion: 2.1 time: 0.178619 Jun 10 18:53:01.495313 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3743/7365] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:01 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:02.512425 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3ef561b9-9d11-4d97-ab68-f6c3944e6d9c tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:02.513042 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3ef561b9-9d11-4d97-ab68-f6c3944e6d9c tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:02.520182 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3ef561b9-9d11-4d97-ab68-f6c3944e6d9c tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:02.520668 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3ef561b9-9d11-4d97-ab68-f6c3944e6d9c tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:02.521434 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3ef561b9-9d11-4d97-ab68-f6c3944e6d9c tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:02.521880 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3ef561b9-9d11-4d97-ab68-f6c3944e6d9c tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:02.649413 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3ef561b9-9d11-4d97-ab68-f6c3944e6d9c tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:02.656977 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3ef561b9-9d11-4d97-ab68-f6c3944e6d9c tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1519 microversion: 2.1 time: 0.149183 Jun 10 18:53:02.657547 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3744/7366] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:02 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:02.898302 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-e95e97ac-667a-4722-aea4-087f5aeac81a req-064dec87-4a84-41dd-84cf-5ef42852e575 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a6e1999-5117-432a-a98e-a5d203359f46", "tag": "1b71dd5c-7cf2-4607-a94e-2d0101f036fa"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:53:02.906327 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-e95e97ac-667a-4722-aea4-087f5aeac81a req-064dec87-4a84-41dd-84cf-5ef42852e575 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:02.906772 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-e95e97ac-667a-4722-aea4-087f5aeac81a req-064dec87-4a84-41dd-84cf-5ef42852e575 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:02.918546 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-e95e97ac-667a-4722-aea4-087f5aeac81a req-064dec87-4a84-41dd-84cf-5ef42852e575 service nova] Creating event network-changed:1b71dd5c-7cf2-4607-a94e-2d0101f036fa for instance 2a6e1999-5117-432a-a98e-a5d203359f46 on chh2-master-2 Jun 10 18:53:02.923786 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [req-e95e97ac-667a-4722-aea4-087f5aeac81a req-064dec87-4a84-41dd-84cf-5ef42852e575 service nova] Instance 2a6e1999-5117-432a-a98e-a5d203359f46 is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 18:53:02.934885 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-e95e97ac-667a-4722-aea4-087f5aeac81a req-064dec87-4a84-41dd-84cf-5ef42852e575 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040190 Jun 10 18:53:02.935485 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3745/7367] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:53:03.676104 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0bfb1611-e4d3-4d8b-b3c7-7d827d3fabf3 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:03.676829 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0bfb1611-e4d3-4d8b-b3c7-7d827d3fabf3 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:03.685609 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0bfb1611-e4d3-4d8b-b3c7-7d827d3fabf3 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:03.686073 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0bfb1611-e4d3-4d8b-b3c7-7d827d3fabf3 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:03.686868 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0bfb1611-e4d3-4d8b-b3c7-7d827d3fabf3 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:03.687317 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0bfb1611-e4d3-4d8b-b3c7-7d827d3fabf3 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:03.820945 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0bfb1611-e4d3-4d8b-b3c7-7d827d3fabf3 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:03.829136 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0bfb1611-e4d3-4d8b-b3c7-7d827d3fabf3 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1519 microversion: 2.1 time: 0.158365 Jun 10 18:53:03.829720 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3746/7368] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:03 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:04.845698 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-44375e62-9840-4707-a573-d492686b7c30 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:04.846313 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-44375e62-9840-4707-a573-d492686b7c30 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:04.853363 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44375e62-9840-4707-a573-d492686b7c30 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:04.853821 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44375e62-9840-4707-a573-d492686b7c30 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:04.854596 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44375e62-9840-4707-a573-d492686b7c30 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:04.855235 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44375e62-9840-4707-a573-d492686b7c30 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:04.993509 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-44375e62-9840-4707-a573-d492686b7c30 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:05.001894 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-44375e62-9840-4707-a573-d492686b7c30 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1519 microversion: 2.1 time: 0.160165 Jun 10 18:53:05.002478 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3747/7369] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:04 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:06.020599 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f1533d17-9545-465b-97a7-bc8ce9b48a43 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:06.021271 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f1533d17-9545-465b-97a7-bc8ce9b48a43 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:06.028863 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f1533d17-9545-465b-97a7-bc8ce9b48a43 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:06.029318 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f1533d17-9545-465b-97a7-bc8ce9b48a43 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:06.030086 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f1533d17-9545-465b-97a7-bc8ce9b48a43 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:06.030534 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f1533d17-9545-465b-97a7-bc8ce9b48a43 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:06.157259 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f1533d17-9545-465b-97a7-bc8ce9b48a43 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:06.164762 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f1533d17-9545-465b-97a7-bc8ce9b48a43 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1516 microversion: 2.1 time: 0.148154 Jun 10 18:53:06.165338 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3748/7370] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:06 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1516 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:06.180422 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9e48acfe-36dd-4de7-83d0-323a51799172 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:53:06.180963 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9e48acfe-36dd-4de7-83d0-323a51799172 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:06.187312 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9e48acfe-36dd-4de7-83d0-323a51799172 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:06.187770 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9e48acfe-36dd-4de7-83d0-323a51799172 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:06.188572 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9e48acfe-36dd-4de7-83d0-323a51799172 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:06.189019 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9e48acfe-36dd-4de7-83d0-323a51799172 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:06.383483 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9e48acfe-36dd-4de7-83d0-323a51799172 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "POST /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46/action" status: 204 len: 0 microversion: 2.1 time: 0.206459 Jun 10 18:53:06.384147 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3749/7371] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:53:06 2022] POST /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46/action => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 18:53:06.398321 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4c7d2e81-2977-47c6-98e3-c9be6d86dac1 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:06.399015 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4c7d2e81-2977-47c6-98e3-c9be6d86dac1 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:06.405452 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4c7d2e81-2977-47c6-98e3-c9be6d86dac1 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:06.405917 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4c7d2e81-2977-47c6-98e3-c9be6d86dac1 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:06.406704 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4c7d2e81-2977-47c6-98e3-c9be6d86dac1 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:06.407158 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4c7d2e81-2977-47c6-98e3-c9be6d86dac1 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:06.550604 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4c7d2e81-2977-47c6-98e3-c9be6d86dac1 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:06.559223 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4c7d2e81-2977-47c6-98e3-c9be6d86dac1 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1516 microversion: 2.1 time: 0.170165 Jun 10 18:53:06.559824 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3750/7372] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:06 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:07.576367 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-519ab7d3-70dd-4638-ab1a-312661c96997 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:07.577050 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-519ab7d3-70dd-4638-ab1a-312661c96997 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:07.584082 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-519ab7d3-70dd-4638-ab1a-312661c96997 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:07.584580 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-519ab7d3-70dd-4638-ab1a-312661c96997 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:07.585351 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-519ab7d3-70dd-4638-ab1a-312661c96997 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:07.585794 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-519ab7d3-70dd-4638-ab1a-312661c96997 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:07.588722 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:53:07.720104 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-519ab7d3-70dd-4638-ab1a-312661c96997 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:07.727528 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-519ab7d3-70dd-4638-ab1a-312661c96997 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1516 microversion: 2.1 time: 0.155169 Jun 10 18:53:07.728108 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3751/7373] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:07 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:08.530757 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-ac50711e-c817-4140-90a5-540c5aae348b req-75b43856-6b43-4518-aa57-b295b6f99938 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a6e1999-5117-432a-a98e-a5d203359f46", "name": "network-vif-plugged", "status": "completed", "tag": "1b71dd5c-7cf2-4607-a94e-2d0101f036fa"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:53:08.539023 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-ac50711e-c817-4140-90a5-540c5aae348b req-75b43856-6b43-4518-aa57-b295b6f99938 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:08.539480 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-ac50711e-c817-4140-90a5-540c5aae348b req-75b43856-6b43-4518-aa57-b295b6f99938 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:08.550198 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-ac50711e-c817-4140-90a5-540c5aae348b req-75b43856-6b43-4518-aa57-b295b6f99938 service nova] Creating event network-vif-plugged:1b71dd5c-7cf2-4607-a94e-2d0101f036fa for instance 2a6e1999-5117-432a-a98e-a5d203359f46 on chh2-master-2 Jun 10 18:53:08.555103 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-ac50711e-c817-4140-90a5-540c5aae348b req-75b43856-6b43-4518-aa57-b295b6f99938 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028437 Jun 10 18:53:08.555709 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3752/7374] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:53:08.747298 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8fdf8d00-dabb-4d25-9405-ec8519f84048 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:08.748000 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8fdf8d00-dabb-4d25-9405-ec8519f84048 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:08.754315 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8fdf8d00-dabb-4d25-9405-ec8519f84048 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:08.754805 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8fdf8d00-dabb-4d25-9405-ec8519f84048 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:08.755573 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8fdf8d00-dabb-4d25-9405-ec8519f84048 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:08.756016 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8fdf8d00-dabb-4d25-9405-ec8519f84048 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:08.892598 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8fdf8d00-dabb-4d25-9405-ec8519f84048 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:08.897501 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8fdf8d00-dabb-4d25-9405-ec8519f84048 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1508 microversion: 2.1 time: 0.155883 Jun 10 18:53:08.898081 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3753/7375] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:08 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:08.912982 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3783e14c-6671-49df-b736-2954d80e7364 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:08.913589 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3783e14c-6671-49df-b736-2954d80e7364 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:08.919820 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3783e14c-6671-49df-b736-2954d80e7364 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:08.929628 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3783e14c-6671-49df-b736-2954d80e7364 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:08.929628 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3783e14c-6671-49df-b736-2954d80e7364 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:08.929628 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3783e14c-6671-49df-b736-2954d80e7364 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:09.047351 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3783e14c-6671-49df-b736-2954d80e7364 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:09.054920 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3783e14c-6671-49df-b736-2954d80e7364 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1508 microversion: 2.1 time: 0.145480 Jun 10 18:53:09.055490 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3754/7376] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:08 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1508 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:09.074157 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-aaa0ecb0-60b8-41f8-b55e-bfaa2bf55ef9 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Action: 'create', calling method: .version_select at 0x7f77c16ff700>, body: {"keypair": {"name": "tempest-keypair-64869560", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLe3ydAFtrfjJW5cXoimT0KUT1Beq2OcVRHb494X6KSH5aZvegNQzSeN2xYbJp4JRUXCDD+cY/9Gcq+Ssmz3snEemnM9MlREjO6bfoUt/WPUvfojLn7YF32LKl6QxQFusg=="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:53:09.087499 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-aaa0ecb0-60b8-41f8-b55e-bfaa2bf55ef9 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Getting quotas for project 4820b16707d848c593eb392a57d59863. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:53:09.092625 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-aaa0ecb0-60b8-41f8-b55e-bfaa2bf55ef9 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Getting quotas for user 258f55116d19443e9e6f0de533b3fb87 and project 4820b16707d848c593eb392a57d59863. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:53:09.202447 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-aaa0ecb0-60b8-41f8-b55e-bfaa2bf55ef9 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.131650 Jun 10 18:53:09.203000 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3755/7377] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 18:53:09 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:53:11.555301 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-41da0359-8700-47b2-9ebc-95615138afb0 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:11.555955 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-41da0359-8700-47b2-9ebc-95615138afb0 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:11.562644 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41da0359-8700-47b2-9ebc-95615138afb0 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:11.563101 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41da0359-8700-47b2-9ebc-95615138afb0 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:11.563870 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41da0359-8700-47b2-9ebc-95615138afb0 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:11.564331 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41da0359-8700-47b2-9ebc-95615138afb0 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:11.694618 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-41da0359-8700-47b2-9ebc-95615138afb0 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:11.702902 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-41da0359-8700-47b2-9ebc-95615138afb0 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 200 len: 1508 microversion: 2.1 time: 0.152748 Jun 10 18:53:11.703473 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3756/7378] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:11 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:11.718537 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0cbed7cf-bcd1-4bfd-9a4a-1597c21164f9 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:11.719034 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0cbed7cf-bcd1-4bfd-9a4a-1597c21164f9 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:11.724981 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0cbed7cf-bcd1-4bfd-9a4a-1597c21164f9 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:11.725433 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0cbed7cf-bcd1-4bfd-9a4a-1597c21164f9 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:11.726188 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0cbed7cf-bcd1-4bfd-9a4a-1597c21164f9 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:11.726625 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0cbed7cf-bcd1-4bfd-9a4a-1597c21164f9 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:11.751908 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0cbed7cf-bcd1-4bfd-9a4a-1597c21164f9 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:53:12.046756 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0cbed7cf-bcd1-4bfd-9a4a-1597c21164f9 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "DELETE /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 204 len: 0 microversion: 2.1 time: 0.331470 Jun 10 18:53:12.047385 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3757/7379] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:53:11 2022] DELETE /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 18:53:12.127769 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-567f005c-8d5b-4104-bee6-e9a8b89ad411 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1849927528", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "4c5cfe5f-5684-45fb-914c-829036cb0c5c"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:53:12.178744 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-567f005c-8d5b-4104-bee6-e9a8b89ad411 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] validate_networks() for [('4c5cfe5f-5684-45fb-914c-829036cb0c5c', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:53:12.530816 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-567f005c-8d5b-4104-bee6-e9a8b89ad411 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:53:12.531251 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-567f005c-8d5b-4104-bee6-e9a8b89ad411 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:53:12.531723 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-567f005c-8d5b-4104-bee6-e9a8b89ad411 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:53:12.532126 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-567f005c-8d5b-4104-bee6-e9a8b89ad411 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:53:12.532575 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-567f005c-8d5b-4104-bee6-e9a8b89ad411 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:53:12.541486 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-567f005c-8d5b-4104-bee6-e9a8b89ad411 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:12.541939 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-567f005c-8d5b-4104-bee6-e9a8b89ad411 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:12.542727 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-567f005c-8d5b-4104-bee6-e9a8b89ad411 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:12.543165 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-567f005c-8d5b-4104-bee6-e9a8b89ad411 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:12.560268 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-567f005c-8d5b-4104-bee6-e9a8b89ad411 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Getting quotas for project 4820b16707d848c593eb392a57d59863. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:53:12.566110 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-567f005c-8d5b-4104-bee6-e9a8b89ad411 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Getting quotas for user 258f55116d19443e9e6f0de533b3fb87 and project 4820b16707d848c593eb392a57d59863. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:53:12.578153 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-567f005c-8d5b-4104-bee6-e9a8b89ad411 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:53:12.580490 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-567f005c-8d5b-4104-bee6-e9a8b89ad411 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:53:12.740052 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-567f005c-8d5b-4104-bee6-e9a8b89ad411 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.616861 Jun 10 18:53:12.740747 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3758/7380] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:53:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 10 18:53:12.751147 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b4e10498-eb37-4e8d-bb98-24fb0f25cdde tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:12.751756 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b4e10498-eb37-4e8d-bb98-24fb0f25cdde tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:12.805955 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b4e10498-eb37-4e8d-bb98-24fb0f25cdde tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:12.813704 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b4e10498-eb37-4e8d-bb98-24fb0f25cdde tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1218 microversion: 2.1 time: 0.066853 Jun 10 18:53:12.814457 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3759/7381] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:12 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:13.831388 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-808c9700-cb80-4bb0-a0dd-a2bb29b01bcd tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:13.832069 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-808c9700-cb80-4bb0-a0dd-a2bb29b01bcd tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:13.839796 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-808c9700-cb80-4bb0-a0dd-a2bb29b01bcd tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:13.840250 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-808c9700-cb80-4bb0-a0dd-a2bb29b01bcd tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:13.841052 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-808c9700-cb80-4bb0-a0dd-a2bb29b01bcd tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:13.841491 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-808c9700-cb80-4bb0-a0dd-a2bb29b01bcd tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:13.907395 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-808c9700-cb80-4bb0-a0dd-a2bb29b01bcd tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:13.915482 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-808c9700-cb80-4bb0-a0dd-a2bb29b01bcd tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1222 microversion: 2.1 time: 0.088758 Jun 10 18:53:13.918667 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3760/7382] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:13 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:14.047291 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-8fc74141-b3d3-4d38-8e91-75a62fc8e451 req-0bb1b98d-cdc3-4798-8bf3-54c379cb7c40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a6e1999-5117-432a-a98e-a5d203359f46", "name": "network-vif-deleted", "tag": "1b71dd5c-7cf2-4607-a94e-2d0101f036fa"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:53:14.051434 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:53:14.057092 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-8fc74141-b3d3-4d38-8e91-75a62fc8e451 req-0bb1b98d-cdc3-4798-8bf3-54c379cb7c40 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:14.057544 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-8fc74141-b3d3-4d38-8e91-75a62fc8e451 req-0bb1b98d-cdc3-4798-8bf3-54c379cb7c40 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:14.070708 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-8fc74141-b3d3-4d38-8e91-75a62fc8e451 req-0bb1b98d-cdc3-4798-8bf3-54c379cb7c40 service nova] Creating event network-vif-deleted:1b71dd5c-7cf2-4607-a94e-2d0101f036fa for instance 2a6e1999-5117-432a-a98e-a5d203359f46 on chh2-master-2 Jun 10 18:53:14.076041 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-8fc74141-b3d3-4d38-8e91-75a62fc8e451 req-0bb1b98d-cdc3-4798-8bf3-54c379cb7c40 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033141 Jun 10 18:53:14.076817 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3761/7383] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:53:14.934108 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dcf6689a-9b7d-4126-8657-c95dd19b2d0b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:14.934764 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dcf6689a-9b7d-4126-8657-c95dd19b2d0b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:14.941224 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dcf6689a-9b7d-4126-8657-c95dd19b2d0b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:14.941673 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dcf6689a-9b7d-4126-8657-c95dd19b2d0b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:14.942659 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dcf6689a-9b7d-4126-8657-c95dd19b2d0b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:14.943098 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dcf6689a-9b7d-4126-8657-c95dd19b2d0b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:15.008854 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-dcf6689a-9b7d-4126-8657-c95dd19b2d0b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:15.017203 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dcf6689a-9b7d-4126-8657-c95dd19b2d0b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1288 microversion: 2.1 time: 0.088631 Jun 10 18:53:15.026879 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3762/7384] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:14 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1288 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:16.035046 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-876d2a43-b0d5-4246-a931-612369f54c82 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:16.035741 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-876d2a43-b0d5-4246-a931-612369f54c82 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:16.043345 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-876d2a43-b0d5-4246-a931-612369f54c82 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:16.044274 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-876d2a43-b0d5-4246-a931-612369f54c82 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:16.045085 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-876d2a43-b0d5-4246-a931-612369f54c82 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:16.045597 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-876d2a43-b0d5-4246-a931-612369f54c82 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:16.193300 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-876d2a43-b0d5-4246-a931-612369f54c82 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:16.201287 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-876d2a43-b0d5-4246-a931-612369f54c82 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1318 microversion: 2.1 time: 0.170625 Jun 10 18:53:16.201901 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3763/7385] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:16 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:16.543233 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-96489e69-a3c4-427f-9e1d-bb34bf06a809 req-497a5e4f-07c3-4700-b601-84b046554b75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d", "tag": "2d4cf2ca-7b73-4a3b-a3f5-45e7acd0cc30"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:53:16.551587 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-96489e69-a3c4-427f-9e1d-bb34bf06a809 req-497a5e4f-07c3-4700-b601-84b046554b75 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:16.552043 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-96489e69-a3c4-427f-9e1d-bb34bf06a809 req-497a5e4f-07c3-4700-b601-84b046554b75 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:16.564048 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-96489e69-a3c4-427f-9e1d-bb34bf06a809 req-497a5e4f-07c3-4700-b601-84b046554b75 service nova] Creating event network-changed:2d4cf2ca-7b73-4a3b-a3f5-45e7acd0cc30 for instance aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d on chh1-master-2 Jun 10 18:53:16.568736 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-96489e69-a3c4-427f-9e1d-bb34bf06a809 req-497a5e4f-07c3-4700-b601-84b046554b75 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029268 Jun 10 18:53:16.569455 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3764/7386] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:53:17.220485 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-687aeb8e-eb16-4c64-9264-5d31dd286b3a tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:17.221246 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-687aeb8e-eb16-4c64-9264-5d31dd286b3a tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:17.227453 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-687aeb8e-eb16-4c64-9264-5d31dd286b3a tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:17.227902 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-687aeb8e-eb16-4c64-9264-5d31dd286b3a tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:17.228685 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-687aeb8e-eb16-4c64-9264-5d31dd286b3a tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:17.229166 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-687aeb8e-eb16-4c64-9264-5d31dd286b3a tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:17.358679 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-687aeb8e-eb16-4c64-9264-5d31dd286b3a tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:17.366837 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-687aeb8e-eb16-4c64-9264-5d31dd286b3a tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1318 microversion: 2.1 time: 0.151713 Jun 10 18:53:17.367406 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3765/7387] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:17 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:18.383279 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-61a67d56-572e-4593-a8a6-37ade094377e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:18.383942 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-61a67d56-572e-4593-a8a6-37ade094377e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:18.391135 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-61a67d56-572e-4593-a8a6-37ade094377e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:18.391592 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-61a67d56-572e-4593-a8a6-37ade094377e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:18.392369 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-61a67d56-572e-4593-a8a6-37ade094377e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:18.392809 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-61a67d56-572e-4593-a8a6-37ade094377e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:18.526338 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-61a67d56-572e-4593-a8a6-37ade094377e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:18.534598 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-61a67d56-572e-4593-a8a6-37ade094377e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1318 microversion: 2.1 time: 0.155153 Jun 10 18:53:18.535182 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3766/7388] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:18 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:19.551368 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e3b964ac-6115-4bd1-b447-3e5261b3dea2 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:19.552004 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e3b964ac-6115-4bd1-b447-3e5261b3dea2 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:19.558962 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e3b964ac-6115-4bd1-b447-3e5261b3dea2 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:19.559412 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e3b964ac-6115-4bd1-b447-3e5261b3dea2 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:19.560175 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e3b964ac-6115-4bd1-b447-3e5261b3dea2 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:19.560634 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e3b964ac-6115-4bd1-b447-3e5261b3dea2 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:19.689376 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e3b964ac-6115-4bd1-b447-3e5261b3dea2 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:19.696882 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e3b964ac-6115-4bd1-b447-3e5261b3dea2 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1318 microversion: 2.1 time: 0.149441 Jun 10 18:53:19.697461 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3767/7389] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:19 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:20.714323 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-01fda3cc-40fd-4b14-af69-3326d67869db tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:20.714980 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-01fda3cc-40fd-4b14-af69-3326d67869db tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:20.721685 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-01fda3cc-40fd-4b14-af69-3326d67869db tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:20.722134 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-01fda3cc-40fd-4b14-af69-3326d67869db tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:20.722890 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-01fda3cc-40fd-4b14-af69-3326d67869db tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:20.723325 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-01fda3cc-40fd-4b14-af69-3326d67869db tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:20.860873 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-01fda3cc-40fd-4b14-af69-3326d67869db tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:20.868639 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-01fda3cc-40fd-4b14-af69-3326d67869db tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1318 microversion: 2.1 time: 0.158108 Jun 10 18:53:20.872443 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3768/7390] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:20 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:21.886280 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ee8ef8f2-7815-4174-a791-d2fecfc0ccf0 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:21.886989 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ee8ef8f2-7815-4174-a791-d2fecfc0ccf0 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:21.894849 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee8ef8f2-7815-4174-a791-d2fecfc0ccf0 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:21.895307 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee8ef8f2-7815-4174-a791-d2fecfc0ccf0 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:21.896081 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee8ef8f2-7815-4174-a791-d2fecfc0ccf0 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:21.896564 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee8ef8f2-7815-4174-a791-d2fecfc0ccf0 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:22.025844 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ee8ef8f2-7815-4174-a791-d2fecfc0ccf0 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:22.033363 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ee8ef8f2-7815-4174-a791-d2fecfc0ccf0 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1318 microversion: 2.1 time: 0.150995 Jun 10 18:53:22.033935 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3769/7391] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:21 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:22.950759 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-0e216533-f066-45be-82d4-0a5632bbd936 req-4dfef617-49e8-4d82-9e96-dc00e9c00ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d", "name": "network-vif-plugged", "status": "completed", "tag": "2d4cf2ca-7b73-4a3b-a3f5-45e7acd0cc30"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:53:22.952219 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:53:22.953666 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=12 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:53:22.959633 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-0e216533-f066-45be-82d4-0a5632bbd936 req-4dfef617-49e8-4d82-9e96-dc00e9c00ed8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:22.960078 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-0e216533-f066-45be-82d4-0a5632bbd936 req-4dfef617-49e8-4d82-9e96-dc00e9c00ed8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:22.971632 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-0e216533-f066-45be-82d4-0a5632bbd936 req-4dfef617-49e8-4d82-9e96-dc00e9c00ed8 service nova] Creating event network-vif-plugged:2d4cf2ca-7b73-4a3b-a3f5-45e7acd0cc30 for instance aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d on chh1-master-2 Jun 10 18:53:22.976520 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-0e216533-f066-45be-82d4-0a5632bbd936 req-4dfef617-49e8-4d82-9e96-dc00e9c00ed8 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031769 Jun 10 18:53:22.979620 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3770/7392] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:53:23.051912 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6b62bb70-7948-4d87-9c26-53177c4d88c4 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:23.052722 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6b62bb70-7948-4d87-9c26-53177c4d88c4 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:23.059197 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6b62bb70-7948-4d87-9c26-53177c4d88c4 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:23.071157 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6b62bb70-7948-4d87-9c26-53177c4d88c4 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:23.071157 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6b62bb70-7948-4d87-9c26-53177c4d88c4 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:23.071157 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6b62bb70-7948-4d87-9c26-53177c4d88c4 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:23.076486 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:53:23.192531 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6b62bb70-7948-4d87-9c26-53177c4d88c4 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:23.199788 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6b62bb70-7948-4d87-9c26-53177c4d88c4 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1318 microversion: 2.1 time: 0.153119 Jun 10 18:53:23.200379 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3771/7393] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:23 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:24.218014 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e96a7dec-1420-42bd-8a9f-975d0b08485a tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:24.218760 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e96a7dec-1420-42bd-8a9f-975d0b08485a tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:24.225921 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e96a7dec-1420-42bd-8a9f-975d0b08485a tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:24.226370 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e96a7dec-1420-42bd-8a9f-975d0b08485a tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:24.227137 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e96a7dec-1420-42bd-8a9f-975d0b08485a tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:24.227576 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e96a7dec-1420-42bd-8a9f-975d0b08485a tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:24.361934 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e96a7dec-1420-42bd-8a9f-975d0b08485a tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:24.369918 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e96a7dec-1420-42bd-8a9f-975d0b08485a tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1318 microversion: 2.1 time: 0.156222 Jun 10 18:53:24.373470 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3772/7394] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:24 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:25.387576 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-def637c8-7661-45a4-a85a-f78e57ad4b71 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:25.388264 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-def637c8-7661-45a4-a85a-f78e57ad4b71 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:25.396031 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-def637c8-7661-45a4-a85a-f78e57ad4b71 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:25.396522 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-def637c8-7661-45a4-a85a-f78e57ad4b71 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:25.397292 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-def637c8-7661-45a4-a85a-f78e57ad4b71 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:25.397735 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-def637c8-7661-45a4-a85a-f78e57ad4b71 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:25.526387 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-def637c8-7661-45a4-a85a-f78e57ad4b71 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:25.535000 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-def637c8-7661-45a4-a85a-f78e57ad4b71 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1509 microversion: 2.1 time: 0.151243 Jun 10 18:53:25.535575 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3773/7395] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:25 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:25.551170 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-06237ea7-a4b1-4189-b0d0-aa5c64e6d0e3 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:25.551776 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-06237ea7-a4b1-4189-b0d0-aa5c64e6d0e3 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:25.557674 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-06237ea7-a4b1-4189-b0d0-aa5c64e6d0e3 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:25.558128 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-06237ea7-a4b1-4189-b0d0-aa5c64e6d0e3 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:25.558895 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-06237ea7-a4b1-4189-b0d0-aa5c64e6d0e3 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:25.559339 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-06237ea7-a4b1-4189-b0d0-aa5c64e6d0e3 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:25.691573 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-06237ea7-a4b1-4189-b0d0-aa5c64e6d0e3 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:25.699128 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-06237ea7-a4b1-4189-b0d0-aa5c64e6d0e3 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1509 microversion: 2.1 time: 0.151527 Jun 10 18:53:25.699701 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3774/7396] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:25 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:25.715070 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-34b41b90-0191-434e-811d-1eff1e20bf14 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:53:25.716040 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-34b41b90-0191-434e-811d-1eff1e20bf14 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:25.721747 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-34b41b90-0191-434e-811d-1eff1e20bf14 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:25.722205 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-34b41b90-0191-434e-811d-1eff1e20bf14 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:25.722965 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-34b41b90-0191-434e-811d-1eff1e20bf14 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:25.723405 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-34b41b90-0191-434e-811d-1eff1e20bf14 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:25.751112 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-34b41b90-0191-434e-811d-1eff1e20bf14 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:25.756810 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-34b41b90-0191-434e-811d-1eff1e20bf14 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Old instance type m1.heat2, new instance type m1.heat {{(pid=126595) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 10 18:53:25.762960 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-34b41b90-0191-434e-811d-1eff1e20bf14 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:53:25.763383 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-34b41b90-0191-434e-811d-1eff1e20bf14 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:53:25.764118 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-34b41b90-0191-434e-811d-1eff1e20bf14 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:53:25.764564 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-34b41b90-0191-434e-811d-1eff1e20bf14 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:53:25.764977 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-34b41b90-0191-434e-811d-1eff1e20bf14 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:53:25.952210 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-34b41b90-0191-434e-811d-1eff1e20bf14 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "POST /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d/action" status: 202 len: 0 microversion: 2.1 time: 0.240523 Jun 10 18:53:25.953175 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3775/7397] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:53:25 2022] POST /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 18:53:25.960911 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6006fed3-f25c-47df-926c-de57e98802d7 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:25.961714 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6006fed3-f25c-47df-926c-de57e98802d7 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:25.967582 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6006fed3-f25c-47df-926c-de57e98802d7 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:25.968037 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6006fed3-f25c-47df-926c-de57e98802d7 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:25.968828 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6006fed3-f25c-47df-926c-de57e98802d7 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:25.969279 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6006fed3-f25c-47df-926c-de57e98802d7 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:26.098271 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6006fed3-f25c-47df-926c-de57e98802d7 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:26.105845 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6006fed3-f25c-47df-926c-de57e98802d7 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1516 microversion: 2.1 time: 0.148631 Jun 10 18:53:26.106413 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3776/7398] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:25 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:27.123235 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b4295ed7-b517-4eb6-b203-ab94ac562010 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:27.123959 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b4295ed7-b517-4eb6-b203-ab94ac562010 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:27.130777 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b4295ed7-b517-4eb6-b203-ab94ac562010 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:27.131225 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b4295ed7-b517-4eb6-b203-ab94ac562010 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:27.131983 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b4295ed7-b517-4eb6-b203-ab94ac562010 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:27.132463 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b4295ed7-b517-4eb6-b203-ab94ac562010 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:27.265242 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b4295ed7-b517-4eb6-b203-ab94ac562010 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:27.272976 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b4295ed7-b517-4eb6-b203-ab94ac562010 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1516 microversion: 2.1 time: 0.153616 Jun 10 18:53:27.273549 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3777/7399] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:27 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:28.290480 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f8637292-81c1-43f4-b23a-15ef2b991c9b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:28.291153 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f8637292-81c1-43f4-b23a-15ef2b991c9b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:28.298157 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8637292-81c1-43f4-b23a-15ef2b991c9b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:28.298608 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8637292-81c1-43f4-b23a-15ef2b991c9b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:28.299373 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8637292-81c1-43f4-b23a-15ef2b991c9b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:28.299829 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8637292-81c1-43f4-b23a-15ef2b991c9b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:28.437139 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f8637292-81c1-43f4-b23a-15ef2b991c9b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:28.445016 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f8637292-81c1-43f4-b23a-15ef2b991c9b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1516 microversion: 2.1 time: 0.158646 Jun 10 18:53:28.445596 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3778/7400] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:28 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:29.462765 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a68edf96-cd4d-4575-b08b-f051278f28e3 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:29.463421 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a68edf96-cd4d-4575-b08b-f051278f28e3 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:29.470392 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a68edf96-cd4d-4575-b08b-f051278f28e3 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:29.470837 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a68edf96-cd4d-4575-b08b-f051278f28e3 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:29.471590 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a68edf96-cd4d-4575-b08b-f051278f28e3 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:29.472026 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a68edf96-cd4d-4575-b08b-f051278f28e3 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:29.604479 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a68edf96-cd4d-4575-b08b-f051278f28e3 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:29.611914 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a68edf96-cd4d-4575-b08b-f051278f28e3 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1521 microversion: 2.1 time: 0.153188 Jun 10 18:53:29.612514 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3779/7401] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:29 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:30.628983 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-021b8d04-fa8a-4db8-b9db-0316dbf70494 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:30.629650 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-021b8d04-fa8a-4db8-b9db-0316dbf70494 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:30.636507 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-021b8d04-fa8a-4db8-b9db-0316dbf70494 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:30.636961 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-021b8d04-fa8a-4db8-b9db-0316dbf70494 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:30.637724 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-021b8d04-fa8a-4db8-b9db-0316dbf70494 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:30.638165 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-021b8d04-fa8a-4db8-b9db-0316dbf70494 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:30.772128 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-021b8d04-fa8a-4db8-b9db-0316dbf70494 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:30.779681 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-021b8d04-fa8a-4db8-b9db-0316dbf70494 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1521 microversion: 2.1 time: 0.154567 Jun 10 18:53:30.780249 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3780/7402] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:30 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:31.796429 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9cb9a5eb-ed2b-4e74-95d6-34bfbcdb4536 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:31.797085 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9cb9a5eb-ed2b-4e74-95d6-34bfbcdb4536 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:31.804656 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9cb9a5eb-ed2b-4e74-95d6-34bfbcdb4536 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:31.805118 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9cb9a5eb-ed2b-4e74-95d6-34bfbcdb4536 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:31.805887 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9cb9a5eb-ed2b-4e74-95d6-34bfbcdb4536 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:31.806333 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9cb9a5eb-ed2b-4e74-95d6-34bfbcdb4536 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:31.935059 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9cb9a5eb-ed2b-4e74-95d6-34bfbcdb4536 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:31.942596 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9cb9a5eb-ed2b-4e74-95d6-34bfbcdb4536 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1521 microversion: 2.1 time: 0.150076 Jun 10 18:53:31.943180 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3781/7403] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:31 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:32.959006 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cca98dfc-74da-4eb7-8ac6-198db39e396c tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:32.959677 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cca98dfc-74da-4eb7-8ac6-198db39e396c tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:32.971498 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cca98dfc-74da-4eb7-8ac6-198db39e396c tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:32.971498 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cca98dfc-74da-4eb7-8ac6-198db39e396c tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:32.971498 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cca98dfc-74da-4eb7-8ac6-198db39e396c tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:32.971498 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cca98dfc-74da-4eb7-8ac6-198db39e396c tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:33.102357 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cca98dfc-74da-4eb7-8ac6-198db39e396c tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:33.109957 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cca98dfc-74da-4eb7-8ac6-198db39e396c tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1521 microversion: 2.1 time: 0.154841 Jun 10 18:53:33.111147 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3782/7404] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:32 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:34.127817 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-75f2c0a1-f3ac-40f2-a238-989eec07451a tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:34.128594 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-75f2c0a1-f3ac-40f2-a238-989eec07451a tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:34.136277 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-75f2c0a1-f3ac-40f2-a238-989eec07451a tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:34.136766 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-75f2c0a1-f3ac-40f2-a238-989eec07451a tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:34.137540 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-75f2c0a1-f3ac-40f2-a238-989eec07451a tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:34.137980 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-75f2c0a1-f3ac-40f2-a238-989eec07451a tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:34.265786 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-75f2c0a1-f3ac-40f2-a238-989eec07451a tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:34.273274 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-75f2c0a1-f3ac-40f2-a238-989eec07451a tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1521 microversion: 2.1 time: 0.149410 Jun 10 18:53:34.273842 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3783/7405] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:34 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:35.290086 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-695cf87b-b260-43e2-b502-42caa305c462 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:35.290723 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-695cf87b-b260-43e2-b502-42caa305c462 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:35.297600 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-695cf87b-b260-43e2-b502-42caa305c462 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:35.298050 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-695cf87b-b260-43e2-b502-42caa305c462 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:35.298811 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-695cf87b-b260-43e2-b502-42caa305c462 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:35.299251 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-695cf87b-b260-43e2-b502-42caa305c462 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:35.433728 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-695cf87b-b260-43e2-b502-42caa305c462 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:35.441837 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-695cf87b-b260-43e2-b502-42caa305c462 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1521 microversion: 2.1 time: 0.155687 Jun 10 18:53:35.442416 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3784/7406] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:35 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:36.459209 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cc4866ae-98f2-4590-8f5d-81c6734a4f81 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:36.459842 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cc4866ae-98f2-4590-8f5d-81c6734a4f81 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:36.466871 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc4866ae-98f2-4590-8f5d-81c6734a4f81 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:36.467329 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc4866ae-98f2-4590-8f5d-81c6734a4f81 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:36.468111 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc4866ae-98f2-4590-8f5d-81c6734a4f81 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:36.468585 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc4866ae-98f2-4590-8f5d-81c6734a4f81 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:36.596928 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cc4866ae-98f2-4590-8f5d-81c6734a4f81 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:36.604353 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cc4866ae-98f2-4590-8f5d-81c6734a4f81 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1521 microversion: 2.1 time: 0.148982 Jun 10 18:53:36.604926 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3785/7407] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:36 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:37.621199 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c69bed5b-7a17-48a5-ae9e-67dfe4a1c80d tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:37.621822 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c69bed5b-7a17-48a5-ae9e-67dfe4a1c80d tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:37.628998 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c69bed5b-7a17-48a5-ae9e-67dfe4a1c80d tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:37.633410 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c69bed5b-7a17-48a5-ae9e-67dfe4a1c80d tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:37.633410 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c69bed5b-7a17-48a5-ae9e-67dfe4a1c80d tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:37.633410 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c69bed5b-7a17-48a5-ae9e-67dfe4a1c80d tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:37.760922 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c69bed5b-7a17-48a5-ae9e-67dfe4a1c80d tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:37.763127 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:53:37.769452 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c69bed5b-7a17-48a5-ae9e-67dfe4a1c80d tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1521 microversion: 2.1 time: 0.152116 Jun 10 18:53:37.770035 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3786/7408] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:37 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:38.786318 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ae79583e-7136-49c4-bedf-e3a0067255ca tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:38.786925 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ae79583e-7136-49c4-bedf-e3a0067255ca tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:38.794493 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ae79583e-7136-49c4-bedf-e3a0067255ca tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:38.794958 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ae79583e-7136-49c4-bedf-e3a0067255ca tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:38.795699 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ae79583e-7136-49c4-bedf-e3a0067255ca tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:38.796136 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ae79583e-7136-49c4-bedf-e3a0067255ca tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:38.930055 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ae79583e-7136-49c4-bedf-e3a0067255ca tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:38.937388 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ae79583e-7136-49c4-bedf-e3a0067255ca tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1521 microversion: 2.1 time: 0.154955 Jun 10 18:53:38.938009 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3787/7409] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:38 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:39.954095 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-01a09a62-fc9d-4a07-a4cc-6908e0752acf tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:39.954820 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-01a09a62-fc9d-4a07-a4cc-6908e0752acf tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:39.961595 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-01a09a62-fc9d-4a07-a4cc-6908e0752acf tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:39.962051 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-01a09a62-fc9d-4a07-a4cc-6908e0752acf tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:39.962815 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-01a09a62-fc9d-4a07-a4cc-6908e0752acf tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:39.963263 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-01a09a62-fc9d-4a07-a4cc-6908e0752acf tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:40.090988 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-01a09a62-fc9d-4a07-a4cc-6908e0752acf tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:40.099014 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-01a09a62-fc9d-4a07-a4cc-6908e0752acf tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1521 microversion: 2.1 time: 0.148878 Jun 10 18:53:40.099589 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3788/7410] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:39 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:41.116221 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3518f712-b099-44b2-828c-83dd60e672ea tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:41.116834 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3518f712-b099-44b2-828c-83dd60e672ea tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:41.123747 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3518f712-b099-44b2-828c-83dd60e672ea tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:41.124200 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3518f712-b099-44b2-828c-83dd60e672ea tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:41.124996 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3518f712-b099-44b2-828c-83dd60e672ea tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:41.126111 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3518f712-b099-44b2-828c-83dd60e672ea tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:41.255683 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3518f712-b099-44b2-828c-83dd60e672ea tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:41.263601 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3518f712-b099-44b2-828c-83dd60e672ea tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1521 microversion: 2.1 time: 0.151083 Jun 10 18:53:41.264173 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3789/7411] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:41 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:42.279913 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4537a46e-6efe-4334-9e9b-31ce281fae04 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:42.280674 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4537a46e-6efe-4334-9e9b-31ce281fae04 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:42.286982 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4537a46e-6efe-4334-9e9b-31ce281fae04 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:42.287451 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4537a46e-6efe-4334-9e9b-31ce281fae04 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:42.288203 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4537a46e-6efe-4334-9e9b-31ce281fae04 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:42.288674 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4537a46e-6efe-4334-9e9b-31ce281fae04 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:42.419851 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4537a46e-6efe-4334-9e9b-31ce281fae04 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:42.427982 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4537a46e-6efe-4334-9e9b-31ce281fae04 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1521 microversion: 2.1 time: 0.151933 Jun 10 18:53:42.428576 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3790/7412] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:42 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:43.445317 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fc582e84-c0bf-4f85-9943-a31591563590 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:43.445988 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fc582e84-c0bf-4f85-9943-a31591563590 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:43.452995 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fc582e84-c0bf-4f85-9943-a31591563590 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:43.453968 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fc582e84-c0bf-4f85-9943-a31591563590 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:43.454721 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fc582e84-c0bf-4f85-9943-a31591563590 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:43.455161 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fc582e84-c0bf-4f85-9943-a31591563590 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:43.586749 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fc582e84-c0bf-4f85-9943-a31591563590 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:43.594305 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fc582e84-c0bf-4f85-9943-a31591563590 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1521 microversion: 2.1 time: 0.152859 Jun 10 18:53:43.594880 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3791/7413] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:43 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:44.611622 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-db4ceca0-7c0a-469b-9c9c-7492f905002c tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:44.612246 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-db4ceca0-7c0a-469b-9c9c-7492f905002c tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:44.619143 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-db4ceca0-7c0a-469b-9c9c-7492f905002c tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:44.619593 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-db4ceca0-7c0a-469b-9c9c-7492f905002c tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:44.620376 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-db4ceca0-7c0a-469b-9c9c-7492f905002c tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:44.620816 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-db4ceca0-7c0a-469b-9c9c-7492f905002c tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:44.749720 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-db4ceca0-7c0a-469b-9c9c-7492f905002c tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:44.757282 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-db4ceca0-7c0a-469b-9c9c-7492f905002c tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1521 microversion: 2.1 time: 0.150068 Jun 10 18:53:44.757856 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3792/7414] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:44 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:45.775069 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0d60f24b-c734-47d1-97c0-272e5c676f03 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:45.775722 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0d60f24b-c734-47d1-97c0-272e5c676f03 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:45.783168 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0d60f24b-c734-47d1-97c0-272e5c676f03 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:45.783625 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0d60f24b-c734-47d1-97c0-272e5c676f03 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:45.784423 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0d60f24b-c734-47d1-97c0-272e5c676f03 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:45.784867 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0d60f24b-c734-47d1-97c0-272e5c676f03 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:45.912702 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0d60f24b-c734-47d1-97c0-272e5c676f03 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:45.920115 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0d60f24b-c734-47d1-97c0-272e5c676f03 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1521 microversion: 2.1 time: 0.148997 Jun 10 18:53:45.920726 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3793/7415] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:45 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:46.937539 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d54e776d-7eb7-4b5f-8462-10b5aa705164 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:46.938759 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d54e776d-7eb7-4b5f-8462-10b5aa705164 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:46.941501 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=70 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:53:46.946293 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d54e776d-7eb7-4b5f-8462-10b5aa705164 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:46.946748 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d54e776d-7eb7-4b5f-8462-10b5aa705164 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:46.947509 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d54e776d-7eb7-4b5f-8462-10b5aa705164 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:46.947952 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d54e776d-7eb7-4b5f-8462-10b5aa705164 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:47.080750 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d54e776d-7eb7-4b5f-8462-10b5aa705164 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:47.088188 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d54e776d-7eb7-4b5f-8462-10b5aa705164 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1521 microversion: 2.1 time: 0.154507 Jun 10 18:53:47.088794 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3794/7416] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:46 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:48.105399 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-438cce0f-cb6e-4750-ae3a-ab59ebb92db8 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:48.106138 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-438cce0f-cb6e-4750-ae3a-ab59ebb92db8 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:48.113998 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-438cce0f-cb6e-4750-ae3a-ab59ebb92db8 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:48.114509 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-438cce0f-cb6e-4750-ae3a-ab59ebb92db8 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:48.115318 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-438cce0f-cb6e-4750-ae3a-ab59ebb92db8 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:48.115763 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-438cce0f-cb6e-4750-ae3a-ab59ebb92db8 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:48.248761 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-438cce0f-cb6e-4750-ae3a-ab59ebb92db8 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:48.256535 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-438cce0f-cb6e-4750-ae3a-ab59ebb92db8 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1521 microversion: 2.1 time: 0.155072 Jun 10 18:53:48.257306 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3795/7417] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:48 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:49.273859 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a37ba22a-67b5-4567-9a65-d650282734b9 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:49.274556 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a37ba22a-67b5-4567-9a65-d650282734b9 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:49.281390 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a37ba22a-67b5-4567-9a65-d650282734b9 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:49.281847 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a37ba22a-67b5-4567-9a65-d650282734b9 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:49.282618 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a37ba22a-67b5-4567-9a65-d650282734b9 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:49.283062 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a37ba22a-67b5-4567-9a65-d650282734b9 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:49.476285 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a37ba22a-67b5-4567-9a65-d650282734b9 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:49.483892 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a37ba22a-67b5-4567-9a65-d650282734b9 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1521 microversion: 2.1 time: 0.213931 Jun 10 18:53:49.485000 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3796/7418] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:49 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:50.501902 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-94c5f82c-379d-42ff-ba66-42db96456e54 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:50.502532 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-94c5f82c-379d-42ff-ba66-42db96456e54 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:50.509414 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-94c5f82c-379d-42ff-ba66-42db96456e54 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:50.509869 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-94c5f82c-379d-42ff-ba66-42db96456e54 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:50.510629 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-94c5f82c-379d-42ff-ba66-42db96456e54 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:50.511074 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-94c5f82c-379d-42ff-ba66-42db96456e54 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:50.638352 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-94c5f82c-379d-42ff-ba66-42db96456e54 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:50.645848 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-94c5f82c-379d-42ff-ba66-42db96456e54 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1521 microversion: 2.1 time: 0.148376 Jun 10 18:53:50.646428 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3797/7419] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:50 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:51.663342 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b46c1a85-fe33-4639-a730-27a5efb862dc tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:51.664032 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b46c1a85-fe33-4639-a730-27a5efb862dc tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:51.670903 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b46c1a85-fe33-4639-a730-27a5efb862dc tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:51.671304 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b46c1a85-fe33-4639-a730-27a5efb862dc tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:51.672068 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b46c1a85-fe33-4639-a730-27a5efb862dc tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:51.672544 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b46c1a85-fe33-4639-a730-27a5efb862dc tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:51.799944 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b46c1a85-fe33-4639-a730-27a5efb862dc tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:51.807517 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b46c1a85-fe33-4639-a730-27a5efb862dc tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1521 microversion: 2.1 time: 0.148062 Jun 10 18:53:51.808084 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3798/7420] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:51 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:52.825295 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-31b6ed36-0290-4760-8a4f-f1946cce6c5b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:52.826053 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-31b6ed36-0290-4760-8a4f-f1946cce6c5b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:52.833061 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-31b6ed36-0290-4760-8a4f-f1946cce6c5b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:52.833514 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-31b6ed36-0290-4760-8a4f-f1946cce6c5b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:52.834283 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-31b6ed36-0290-4760-8a4f-f1946cce6c5b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:52.834729 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-31b6ed36-0290-4760-8a4f-f1946cce6c5b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:52.970164 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-31b6ed36-0290-4760-8a4f-f1946cce6c5b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:52.977712 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-31b6ed36-0290-4760-8a4f-f1946cce6c5b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1521 microversion: 2.1 time: 0.156338 Jun 10 18:53:52.978311 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3799/7421] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:52 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:53.994752 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-41da2267-0b4f-47b1-97b7-6f81f76bf63b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:53.995434 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-41da2267-0b4f-47b1-97b7-6f81f76bf63b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:54.002994 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41da2267-0b4f-47b1-97b7-6f81f76bf63b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:54.003442 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41da2267-0b4f-47b1-97b7-6f81f76bf63b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:54.004205 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41da2267-0b4f-47b1-97b7-6f81f76bf63b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:54.004677 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-41da2267-0b4f-47b1-97b7-6f81f76bf63b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:54.131561 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-41da2267-0b4f-47b1-97b7-6f81f76bf63b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:54.139308 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-41da2267-0b4f-47b1-97b7-6f81f76bf63b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1521 microversion: 2.1 time: 0.148526 Jun 10 18:53:54.139878 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3800/7422] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:53 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:55.155960 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0cdb96b9-f618-486c-a9b0-ac600fc939c6 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:55.156693 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0cdb96b9-f618-486c-a9b0-ac600fc939c6 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:55.163731 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0cdb96b9-f618-486c-a9b0-ac600fc939c6 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:55.164184 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0cdb96b9-f618-486c-a9b0-ac600fc939c6 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:55.164986 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0cdb96b9-f618-486c-a9b0-ac600fc939c6 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:55.165428 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0cdb96b9-f618-486c-a9b0-ac600fc939c6 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:55.298747 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0cdb96b9-f618-486c-a9b0-ac600fc939c6 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:55.306468 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0cdb96b9-f618-486c-a9b0-ac600fc939c6 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1521 microversion: 2.1 time: 0.154474 Jun 10 18:53:55.307035 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3801/7423] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:55 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:56.323179 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ef1c5b95-8b5c-4632-9ff0-4d4b737eff3b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:56.323891 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ef1c5b95-8b5c-4632-9ff0-4d4b737eff3b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:56.331002 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ef1c5b95-8b5c-4632-9ff0-4d4b737eff3b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:56.331476 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ef1c5b95-8b5c-4632-9ff0-4d4b737eff3b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:56.332243 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ef1c5b95-8b5c-4632-9ff0-4d4b737eff3b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:56.332709 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ef1c5b95-8b5c-4632-9ff0-4d4b737eff3b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:56.469101 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ef1c5b95-8b5c-4632-9ff0-4d4b737eff3b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:56.476682 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ef1c5b95-8b5c-4632-9ff0-4d4b737eff3b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1520 microversion: 2.1 time: 0.157553 Jun 10 18:53:56.477271 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3802/7424] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:56 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:56.789453 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-fb79a587-a0dd-4a5e-a6a8-4953087498a8 req-b1adf543-e01c-4fd6-853d-472ebaa6f840 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d", "name": "network-vif-unplugged", "status": "completed", "tag": "2d4cf2ca-7b73-4a3b-a3f5-45e7acd0cc30"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:53:56.797440 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-fb79a587-a0dd-4a5e-a6a8-4953087498a8 req-b1adf543-e01c-4fd6-853d-472ebaa6f840 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:56.797886 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-fb79a587-a0dd-4a5e-a6a8-4953087498a8 req-b1adf543-e01c-4fd6-853d-472ebaa6f840 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:56.809305 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-fb79a587-a0dd-4a5e-a6a8-4953087498a8 req-b1adf543-e01c-4fd6-853d-472ebaa6f840 service nova] Creating event network-vif-unplugged:2d4cf2ca-7b73-4a3b-a3f5-45e7acd0cc30 for instance aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d on chh2-master-2 Jun 10 18:53:56.811731 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:53:56.815242 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [req-fb79a587-a0dd-4a5e-a6a8-4953087498a8 req-b1adf543-e01c-4fd6-853d-472ebaa6f840 service nova] Instance aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 18:53:56.825963 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-fb79a587-a0dd-4a5e-a6a8-4953087498a8 req-b1adf543-e01c-4fd6-853d-472ebaa6f840 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101933 Jun 10 18:53:56.826664 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3803/7425] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:53:57.496525 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c8e55119-f60a-40f8-b33c-3db266fddc25 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:57.497326 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c8e55119-f60a-40f8-b33c-3db266fddc25 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:57.504511 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c8e55119-f60a-40f8-b33c-3db266fddc25 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:57.505048 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c8e55119-f60a-40f8-b33c-3db266fddc25 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:57.505837 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c8e55119-f60a-40f8-b33c-3db266fddc25 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:57.506284 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c8e55119-f60a-40f8-b33c-3db266fddc25 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:57.642215 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c8e55119-f60a-40f8-b33c-3db266fddc25 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:57.650047 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c8e55119-f60a-40f8-b33c-3db266fddc25 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1520 microversion: 2.1 time: 0.159137 Jun 10 18:53:57.650620 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3804/7426] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:57 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:58.667214 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8aca3774-cf4d-4c95-ae74-aef3f4daad24 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:58.667864 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8aca3774-cf4d-4c95-ae74-aef3f4daad24 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:58.674648 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8aca3774-cf4d-4c95-ae74-aef3f4daad24 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:58.675100 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8aca3774-cf4d-4c95-ae74-aef3f4daad24 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:58.675855 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8aca3774-cf4d-4c95-ae74-aef3f4daad24 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:58.676295 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8aca3774-cf4d-4c95-ae74-aef3f4daad24 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:58.812033 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8aca3774-cf4d-4c95-ae74-aef3f4daad24 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:58.820233 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8aca3774-cf4d-4c95-ae74-aef3f4daad24 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1518 microversion: 2.1 time: 0.157007 Jun 10 18:53:58.820826 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3805/7427] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:58 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:53:58.842085 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-75202cd9-3542-49a2-ac6e-02d9065f20cd req-10a68ea2-426c-4e33-bbc8-d9f530c43822 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d", "tag": "2d4cf2ca-7b73-4a3b-a3f5-45e7acd0cc30"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:53:58.850013 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-75202cd9-3542-49a2-ac6e-02d9065f20cd req-10a68ea2-426c-4e33-bbc8-d9f530c43822 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:58.850460 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-75202cd9-3542-49a2-ac6e-02d9065f20cd req-10a68ea2-426c-4e33-bbc8-d9f530c43822 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:58.862242 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-75202cd9-3542-49a2-ac6e-02d9065f20cd req-10a68ea2-426c-4e33-bbc8-d9f530c43822 service nova] Creating event network-changed:2d4cf2ca-7b73-4a3b-a3f5-45e7acd0cc30 for instance aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d on chh2-master-2 Jun 10 18:53:58.867436 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [req-75202cd9-3542-49a2-ac6e-02d9065f20cd req-10a68ea2-426c-4e33-bbc8-d9f530c43822 service nova] Instance aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 18:53:58.878601 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-75202cd9-3542-49a2-ac6e-02d9065f20cd req-10a68ea2-426c-4e33-bbc8-d9f530c43822 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039891 Jun 10 18:53:58.879357 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3806/7428] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:53:59.838321 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5052a179-22c6-49ec-aaac-199af97c0c7f tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:53:59.839061 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5052a179-22c6-49ec-aaac-199af97c0c7f tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:53:59.846861 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5052a179-22c6-49ec-aaac-199af97c0c7f tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:59.847321 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5052a179-22c6-49ec-aaac-199af97c0c7f tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:59.848095 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5052a179-22c6-49ec-aaac-199af97c0c7f tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:53:59.848571 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5052a179-22c6-49ec-aaac-199af97c0c7f tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:53:59.977795 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5052a179-22c6-49ec-aaac-199af97c0c7f tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:53:59.985464 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5052a179-22c6-49ec-aaac-199af97c0c7f tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1518 microversion: 2.1 time: 0.151677 Jun 10 18:53:59.986051 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3807/7429] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:53:59 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:54:01.002666 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5820c8fd-6676-4444-8066-19584af9d544 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:01.003345 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5820c8fd-6676-4444-8066-19584af9d544 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:01.010223 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5820c8fd-6676-4444-8066-19584af9d544 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:01.010678 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5820c8fd-6676-4444-8066-19584af9d544 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:01.011438 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5820c8fd-6676-4444-8066-19584af9d544 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:01.011876 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5820c8fd-6676-4444-8066-19584af9d544 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:01.147433 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5820c8fd-6676-4444-8066-19584af9d544 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:01.154986 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5820c8fd-6676-4444-8066-19584af9d544 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1518 microversion: 2.1 time: 0.156228 Jun 10 18:54:01.155568 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3808/7430] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:00 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:54:02.173146 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d37d837c-14e3-4cd5-bf00-38214b8546a3 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:02.173846 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d37d837c-14e3-4cd5-bf00-38214b8546a3 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:02.180611 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d37d837c-14e3-4cd5-bf00-38214b8546a3 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:02.181062 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d37d837c-14e3-4cd5-bf00-38214b8546a3 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:02.181818 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d37d837c-14e3-4cd5-bf00-38214b8546a3 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:02.182255 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d37d837c-14e3-4cd5-bf00-38214b8546a3 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:02.311949 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d37d837c-14e3-4cd5-bf00-38214b8546a3 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:02.319922 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d37d837c-14e3-4cd5-bf00-38214b8546a3 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1515 microversion: 2.1 time: 0.150668 Jun 10 18:54:02.320521 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3809/7431] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:02 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:54:02.336047 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f92612bd-da84-41b5-a8d1-d0c2890f6ba1 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:54:02.336603 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f92612bd-da84-41b5-a8d1-d0c2890f6ba1 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:02.342157 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f92612bd-da84-41b5-a8d1-d0c2890f6ba1 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:02.342627 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f92612bd-da84-41b5-a8d1-d0c2890f6ba1 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:02.343381 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f92612bd-da84-41b5-a8d1-d0c2890f6ba1 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:02.343815 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f92612bd-da84-41b5-a8d1-d0c2890f6ba1 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:02.483944 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f92612bd-da84-41b5-a8d1-d0c2890f6ba1 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "POST /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d/action" status: 204 len: 0 microversion: 2.1 time: 0.151080 Jun 10 18:54:02.484632 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3810/7432] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:54:02 2022] POST /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d/action => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 18:54:02.492914 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-50c12531-be10-4901-9f09-3cbacd768f47 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:02.494662 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-50c12531-be10-4901-9f09-3cbacd768f47 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:02.500221 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-50c12531-be10-4901-9f09-3cbacd768f47 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:02.500699 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-50c12531-be10-4901-9f09-3cbacd768f47 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:02.501464 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-50c12531-be10-4901-9f09-3cbacd768f47 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:02.501907 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-50c12531-be10-4901-9f09-3cbacd768f47 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:02.641373 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-50c12531-be10-4901-9f09-3cbacd768f47 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:02.649647 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-50c12531-be10-4901-9f09-3cbacd768f47 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1515 microversion: 2.1 time: 0.160725 Jun 10 18:54:02.650539 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3811/7433] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:02 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:54:03.666914 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c915a69a-d68b-4222-b6e6-3638b3e47faa tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:03.667665 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c915a69a-d68b-4222-b6e6-3638b3e47faa tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:03.674938 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c915a69a-d68b-4222-b6e6-3638b3e47faa tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:03.675311 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c915a69a-d68b-4222-b6e6-3638b3e47faa tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:03.676078 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c915a69a-d68b-4222-b6e6-3638b3e47faa tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:03.676539 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c915a69a-d68b-4222-b6e6-3638b3e47faa tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:03.828568 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c915a69a-d68b-4222-b6e6-3638b3e47faa tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:03.836258 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c915a69a-d68b-4222-b6e6-3638b3e47faa tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1515 microversion: 2.1 time: 0.173294 Jun 10 18:54:03.836860 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3812/7434] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:03 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:54:04.853542 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-42ce3291-0184-4f85-ae4b-761ca6934126 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:04.854205 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-42ce3291-0184-4f85-ae4b-761ca6934126 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:04.861938 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42ce3291-0184-4f85-ae4b-761ca6934126 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:04.862804 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42ce3291-0184-4f85-ae4b-761ca6934126 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:04.863578 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42ce3291-0184-4f85-ae4b-761ca6934126 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:04.864018 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42ce3291-0184-4f85-ae4b-761ca6934126 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:05.000421 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-42ce3291-0184-4f85-ae4b-761ca6934126 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:05.008140 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-42ce3291-0184-4f85-ae4b-761ca6934126 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1507 microversion: 2.1 time: 0.158449 Jun 10 18:54:05.008747 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3813/7435] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:04 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:54:05.013359 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-f274526c-da03-4b2a-b7c1-4af63a1f255b req-6a7faca0-2d60-4cb6-8d6d-7e71bede0220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d", "name": "network-vif-plugged", "status": "completed", "tag": "2d4cf2ca-7b73-4a3b-a3f5-45e7acd0cc30"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:54:05.021659 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-f274526c-da03-4b2a-b7c1-4af63a1f255b req-6a7faca0-2d60-4cb6-8d6d-7e71bede0220 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:05.022114 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-f274526c-da03-4b2a-b7c1-4af63a1f255b req-6a7faca0-2d60-4cb6-8d6d-7e71bede0220 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:05.033605 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-f274526c-da03-4b2a-b7c1-4af63a1f255b req-6a7faca0-2d60-4cb6-8d6d-7e71bede0220 service nova] Creating event network-vif-plugged:2d4cf2ca-7b73-4a3b-a3f5-45e7acd0cc30 for instance aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d on chh2-master-2 Jun 10 18:54:05.038714 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-f274526c-da03-4b2a-b7c1-4af63a1f255b req-6a7faca0-2d60-4cb6-8d6d-7e71bede0220 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028821 Jun 10 18:54:05.039332 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3814/7436] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:54:05.048579 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-30cc5186-cf46-4086-ad27-4e98f1ad4d8d tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:05.048579 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-30cc5186-cf46-4086-ad27-4e98f1ad4d8d tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:05.051371 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30cc5186-cf46-4086-ad27-4e98f1ad4d8d tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:05.051830 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30cc5186-cf46-4086-ad27-4e98f1ad4d8d tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:05.052623 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30cc5186-cf46-4086-ad27-4e98f1ad4d8d tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:05.053066 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30cc5186-cf46-4086-ad27-4e98f1ad4d8d tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:05.185438 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-30cc5186-cf46-4086-ad27-4e98f1ad4d8d tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:05.193077 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-30cc5186-cf46-4086-ad27-4e98f1ad4d8d tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1507 microversion: 2.1 time: 0.152498 Jun 10 18:54:05.193595 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3815/7437] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:05 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:54:05.208806 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-16c11a51-5b04-4f70-af90-719c7a3508ca tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:05.209419 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-16c11a51-5b04-4f70-af90-719c7a3508ca tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:05.215136 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-16c11a51-5b04-4f70-af90-719c7a3508ca tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:05.215589 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-16c11a51-5b04-4f70-af90-719c7a3508ca tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:05.216380 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-16c11a51-5b04-4f70-af90-719c7a3508ca tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:05.216823 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-16c11a51-5b04-4f70-af90-719c7a3508ca tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:05.345968 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-16c11a51-5b04-4f70-af90-719c7a3508ca tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:05.353487 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-16c11a51-5b04-4f70-af90-719c7a3508ca tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1507 microversion: 2.1 time: 0.148192 Jun 10 18:54:05.354056 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3816/7438] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:05 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:54:05.368754 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-14615a3b-d74e-43a6-909e-edc00b3a46b3 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:05.369249 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-14615a3b-d74e-43a6-909e-edc00b3a46b3 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:05.375396 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-14615a3b-d74e-43a6-909e-edc00b3a46b3 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:05.375850 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-14615a3b-d74e-43a6-909e-edc00b3a46b3 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:05.376641 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-14615a3b-d74e-43a6-909e-edc00b3a46b3 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:05.377081 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-14615a3b-d74e-43a6-909e-edc00b3a46b3 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:05.402138 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-14615a3b-d74e-43a6-909e-edc00b3a46b3 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:54:05.673841 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-14615a3b-d74e-43a6-909e-edc00b3a46b3 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "DELETE /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 204 len: 0 microversion: 2.1 time: 0.308281 Jun 10 18:54:05.674433 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3817/7439] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:54:05 2022] DELETE /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 18:54:05.693463 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-738f6e22-13f6-43ac-bd41-6db31f860890 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:05.694080 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-738f6e22-13f6-43ac-bd41-6db31f860890 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:05.700239 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-738f6e22-13f6-43ac-bd41-6db31f860890 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:05.700736 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-738f6e22-13f6-43ac-bd41-6db31f860890 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:05.701503 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-738f6e22-13f6-43ac-bd41-6db31f860890 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:05.701944 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-738f6e22-13f6-43ac-bd41-6db31f860890 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:05.720009 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:54:05.727182 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-738f6e22-13f6-43ac-bd41-6db31f860890 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:54:05.859833 chdv-master-2 devstack@n-api.service[126595]: INFO nova.compute.api [None req-738f6e22-13f6-43ac-bd41-6db31f860890 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Instance is already in deleting state, ignoring this request Jun 10 18:54:05.860697 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-738f6e22-13f6-43ac-bd41-6db31f860890 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "DELETE /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 204 len: 0 microversion: 2.1 time: 0.172041 Jun 10 18:54:05.861263 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3818/7440] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:54:05 2022] DELETE /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:54:05.869100 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f76e9b97-870d-4f77-ba12-0de0db36dcda tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:05.870345 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f76e9b97-870d-4f77-ba12-0de0db36dcda tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:05.876012 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f76e9b97-870d-4f77-ba12-0de0db36dcda tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:05.876487 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f76e9b97-870d-4f77-ba12-0de0db36dcda tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:05.877250 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f76e9b97-870d-4f77-ba12-0de0db36dcda tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:05.877692 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f76e9b97-870d-4f77-ba12-0de0db36dcda tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:06.010515 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f76e9b97-870d-4f77-ba12-0de0db36dcda tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:06.018475 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f76e9b97-870d-4f77-ba12-0de0db36dcda tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1513 microversion: 2.1 time: 0.152987 Jun 10 18:54:06.019598 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3819/7441] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:05 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:54:07.035076 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-37afbc3f-2453-4518-b76f-45b43f10b9e1 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:07.035720 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-37afbc3f-2453-4518-b76f-45b43f10b9e1 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:07.042495 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-37afbc3f-2453-4518-b76f-45b43f10b9e1 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:07.042943 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-37afbc3f-2453-4518-b76f-45b43f10b9e1 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:07.043698 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-37afbc3f-2453-4518-b76f-45b43f10b9e1 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:07.044135 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-37afbc3f-2453-4518-b76f-45b43f10b9e1 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:07.173207 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-37afbc3f-2453-4518-b76f-45b43f10b9e1 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f55116d19443e9e6f0de533b3fb87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4820b16707d848c593eb392a57d59863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:07.180643 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-37afbc3f-2453-4518-b76f-45b43f10b9e1 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 200 len: 1513 microversion: 2.1 time: 0.149476 Jun 10 18:54:07.181223 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3820/7442] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:07 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:54:07.600216 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-bbfecf37-4e6a-4a3e-93b9-597d13d8ecc0 req-ac5b93b1-349a-4522-a36a-dcbef8fc23e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d", "name": "network-vif-deleted", "tag": "2d4cf2ca-7b73-4a3b-a3f5-45e7acd0cc30"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:54:07.608548 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-bbfecf37-4e6a-4a3e-93b9-597d13d8ecc0 req-ac5b93b1-349a-4522-a36a-dcbef8fc23e4 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:07.609511 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-bbfecf37-4e6a-4a3e-93b9-597d13d8ecc0 req-ac5b93b1-349a-4522-a36a-dcbef8fc23e4 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:07.620435 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-bbfecf37-4e6a-4a3e-93b9-597d13d8ecc0 req-ac5b93b1-349a-4522-a36a-dcbef8fc23e4 service nova] Creating event network-vif-deleted:2d4cf2ca-7b73-4a3b-a3f5-45e7acd0cc30 for instance aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d on chh2-master-2 Jun 10 18:54:07.625974 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-bbfecf37-4e6a-4a3e-93b9-597d13d8ecc0 req-ac5b93b1-349a-4522-a36a-dcbef8fc23e4 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029573 Jun 10 18:54:07.626552 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3821/7443] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:54:08.199020 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b83fe4d7-36d4-4f51-96d8-7b08085f2e7e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:08.199645 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b83fe4d7-36d4-4f51-96d8-7b08085f2e7e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:08.207616 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b83fe4d7-36d4-4f51-96d8-7b08085f2e7e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:08.208102 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b83fe4d7-36d4-4f51-96d8-7b08085f2e7e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:08.208902 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b83fe4d7-36d4-4f51-96d8-7b08085f2e7e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:08.209346 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b83fe4d7-36d4-4f51-96d8-7b08085f2e7e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:08.223713 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-b83fe4d7-36d4-4f51-96d8-7b08085f2e7e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] HTTP exception thrown: Instance aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d could not be found. Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b83fe4d7-36d4-4f51-96d8-7b08085f2e7e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Request method failure captured: Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d HTTP/1.1 Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5LhEjoIvvRTevEP_4lSkv29qyKHkztJB3ebY7_1dPaWhyjcU8YkWDEylzOeKL7khBqpsbbMnCipxvDiHlwZ1Goe3OmOVyCcB2JKLyrcF2Q0DKNtS-YtCgYjBIJADR_rbZ0yficCbF1oHi69PAhDIPFHtkhR0pBVuUfrX2acbZ4kz5E Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 4820b16707d848c593eb392a57d59863 Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1952835009 Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/4820b16707d848c593eb392a57d59863"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/4820b16707d848c593eb392a57d59863"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/4820b16707d848c593eb392a57d59863"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_4820b16707d848c593eb392a57d59863", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServerDiskConfigTestJSON-1952835009 Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 4820b16707d848c593eb392a57d59863 Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1952835009 Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServerDiskConfigTestJSON-1952835009-project Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 258f55116d19443e9e6f0de533b3fb87 Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServerDiskConfigTestJSON-1952835009-project Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: exception: Instance aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d could not be found. Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d'} Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d could not be found. Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d could not be found. Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:54:08.225433 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:54:08.230795 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:54:08.230795 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:54:08.230795 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:54:08.230795 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:54:08.230795 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:54:08.230795 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d could not be found. Jun 10 18:54:08.230795 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:54:08.230795 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b83fe4d7-36d4-4f51-96d8-7b08085f2e7e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Returning 404 to user: Instance aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:54:08.230795 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b83fe4d7-36d4-4f51-96d8-7b08085f2e7e tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d" status: 404 len: 111 microversion: 2.1 time: 0.032193 Jun 10 18:54:08.230795 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3822/7444] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:08 2022] GET /compute/v2.1/servers/aca08bc2-f7fa-46d3-8e7f-8c7a9c12ef2d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:54:08.235858 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c03f3241-e992-4c47-b889-218af080c97d tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '.version_select at 0x7f77b3d578b0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:08.325869 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c03f3241-e992-4c47-b889-218af080c97d tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-64869560" status: 202 len: 0 microversion: 2.1 time: 0.093650 Jun 10 18:54:08.326450 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3823/7445] 10.222.0.35 () {58 vars in 1214 bytes} [Fri Jun 10 18:54:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-64869560 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 18:54:09.054557 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4bbab639-6241-41f9-bf9f-b44bd8e28b48 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:09.055068 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4bbab639-6241-41f9-bf9f-b44bd8e28b48 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:09.061219 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4bbab639-6241-41f9-bf9f-b44bd8e28b48 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:09.061674 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4bbab639-6241-41f9-bf9f-b44bd8e28b48 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:09.062950 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4bbab639-6241-41f9-bf9f-b44bd8e28b48 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:09.063385 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4bbab639-6241-41f9-bf9f-b44bd8e28b48 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:09.080103 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-4bbab639-6241-41f9-bf9f-b44bd8e28b48 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] HTTP exception thrown: Instance 2a6e1999-5117-432a-a98e-a5d203359f46 could not be found. Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4bbab639-6241-41f9-bf9f-b44bd8e28b48 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Request method failure captured: Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 HTTP/1.1 Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5LhEjoIvvRTevEP_4lSkv29qyKHkztJB3ebY7_1dPaWhyjcU8YkWDEylzOeKL7khBqpsbbMnCipxvDiHlwZ1Goe3OmOVyCcB2JKLyrcF2Q0DKNtS-YtCgYjBIJADR_rbZ0yficCbF1oHi69PAhDIPFHtkhR0pBVuUfrX2acbZ4kz5E Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 4820b16707d848c593eb392a57d59863 Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1952835009 Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/4820b16707d848c593eb392a57d59863"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/4820b16707d848c593eb392a57d59863"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/4820b16707d848c593eb392a57d59863"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_4820b16707d848c593eb392a57d59863", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServerDiskConfigTestJSON-1952835009 Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 4820b16707d848c593eb392a57d59863 Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1952835009 Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServerDiskConfigTestJSON-1952835009-project Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 258f55116d19443e9e6f0de533b3fb87 Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServerDiskConfigTestJSON-1952835009-project Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 2a6e1999-5117-432a-a98e-a5d203359f46 could not be found. Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '2a6e1999-5117-432a-a98e-a5d203359f46'} Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a6e1999-5117-432a-a98e-a5d203359f46 could not be found. Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:54:09.081662 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:54:09.086741 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a6e1999-5117-432a-a98e-a5d203359f46 could not be found. Jun 10 18:54:09.086741 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:54:09.086741 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:54:09.086741 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:54:09.086741 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:54:09.086741 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:54:09.086741 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:54:09.086741 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:54:09.086741 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:54:09.086741 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a6e1999-5117-432a-a98e-a5d203359f46 could not be found. Jun 10 18:54:09.086741 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:54:09.086741 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4bbab639-6241-41f9-bf9f-b44bd8e28b48 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Returning 404 to user: Instance 2a6e1999-5117-432a-a98e-a5d203359f46 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:54:09.086741 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4bbab639-6241-41f9-bf9f-b44bd8e28b48 tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "DELETE /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 404 len: 111 microversion: 2.1 time: 0.032517 Jun 10 18:54:09.086741 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3824/7446] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:54:09 2022] DELETE /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:54:09.091044 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5909e852-add7-4e26-8c9a-86b3a75f665b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:09.091646 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5909e852-add7-4e26-8c9a-86b3a75f665b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] [instance: 2a6e1999-5117-432a-a98e-a5d203359f46] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:09.097394 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5909e852-add7-4e26-8c9a-86b3a75f665b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:09.097849 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5909e852-add7-4e26-8c9a-86b3a75f665b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:09.098611 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5909e852-add7-4e26-8c9a-86b3a75f665b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:09.099052 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5909e852-add7-4e26-8c9a-86b3a75f665b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:09.112109 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-5909e852-add7-4e26-8c9a-86b3a75f665b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] HTTP exception thrown: Instance 2a6e1999-5117-432a-a98e-a5d203359f46 could not be found. Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5909e852-add7-4e26-8c9a-86b3a75f665b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Request method failure captured: Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 HTTP/1.1 Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5LhEjoIvvRTevEP_4lSkv29qyKHkztJB3ebY7_1dPaWhyjcU8YkWDEylzOeKL7khBqpsbbMnCipxvDiHlwZ1Goe3OmOVyCcB2JKLyrcF2Q0DKNtS-YtCgYjBIJADR_rbZ0yficCbF1oHi69PAhDIPFHtkhR0pBVuUfrX2acbZ4kz5E Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 4820b16707d848c593eb392a57d59863 Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1952835009 Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/4820b16707d848c593eb392a57d59863"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/4820b16707d848c593eb392a57d59863"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/4820b16707d848c593eb392a57d59863"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_4820b16707d848c593eb392a57d59863", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServerDiskConfigTestJSON-1952835009 Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 4820b16707d848c593eb392a57d59863 Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1952835009 Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServerDiskConfigTestJSON-1952835009-project Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 258f55116d19443e9e6f0de533b3fb87 Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServerDiskConfigTestJSON-1952835009-project Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 2a6e1999-5117-432a-a98e-a5d203359f46 could not be found. Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '2a6e1999-5117-432a-a98e-a5d203359f46'} Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a6e1999-5117-432a-a98e-a5d203359f46 could not be found. Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a6e1999-5117-432a-a98e-a5d203359f46 could not be found. Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:54:09.113632 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:54:09.118719 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:54:09.118719 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:54:09.118719 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:54:09.118719 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:54:09.118719 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:54:09.118719 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a6e1999-5117-432a-a98e-a5d203359f46 could not be found. Jun 10 18:54:09.118719 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:54:09.118719 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5909e852-add7-4e26-8c9a-86b3a75f665b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] Returning 404 to user: Instance 2a6e1999-5117-432a-a98e-a5d203359f46 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:54:09.118719 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5909e852-add7-4e26-8c9a-86b3a75f665b tempest-ServerDiskConfigTestJSON-1952835009 tempest-ServerDiskConfigTestJSON-1952835009-project] 10.222.0.35 "GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46" status: 404 len: 111 microversion: 2.1 time: 0.027432 Jun 10 18:54:09.118719 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3825/7447] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:09 2022] GET /compute/v2.1/servers/2a6e1999-5117-432a-a98e-a5d203359f46 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:54:16.944693 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8130c8fd-4e47-436a-bd32-bf2c00930505 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Action: 'create', calling method: .version_select at 0x7f77c1251790>, body: {"keypair": {"name": "tempest-keypair-434241289", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJzOjFB5oNWrSOytLCCzJnxerCzAK9OJMD1+PGAFvwOPX4wwy17njnogKCmkewV8GqPc44p+tLCi5R6R5baDu702XOYfw/TkgIfL5YHQl0/oOqid/dzhNuVpqb5gCdsRlw=="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:54:16.959077 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-8130c8fd-4e47-436a-bd32-bf2c00930505 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Getting quotas for project 9ee0edfe1ca545a18061642a775747b5. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:54:16.964519 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-8130c8fd-4e47-436a-bd32-bf2c00930505 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Getting quotas for user 9434d247ee1c4143bc2cf07b834417ea and project 9ee0edfe1ca545a18061642a775747b5. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:54:16.987723 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:54:17.075249 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8130c8fd-4e47-436a-bd32-bf2c00930505 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.255923 Jun 10 18:54:17.075866 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3826/7448] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 18:54:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:54:19.615676 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-03723994-66af-4c41-ae2f-8a452797b759 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1165875961", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0fb8209d-4273-43eb-a7e9-ab31438ebf09"}], "security_groups": [{"name": "tempest-securitygroup--1864491070"}], "key_name": "tempest-keypair-434241289", "user_data": "}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:54:19.625050 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:54:19.735883 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-03723994-66af-4c41-ae2f-8a452797b759 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] validate_networks() for [('0fb8209d-4273-43eb-a7e9-ab31438ebf09', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:54:20.147843 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-03723994-66af-4c41-ae2f-8a452797b759 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:54:20.148604 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-03723994-66af-4c41-ae2f-8a452797b759 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:54:20.153117 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-03723994-66af-4c41-ae2f-8a452797b759 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:54:20.153538 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-03723994-66af-4c41-ae2f-8a452797b759 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:54:20.153956 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-03723994-66af-4c41-ae2f-8a452797b759 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:54:20.163916 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03723994-66af-4c41-ae2f-8a452797b759 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:20.164677 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03723994-66af-4c41-ae2f-8a452797b759 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:20.165672 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03723994-66af-4c41-ae2f-8a452797b759 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:20.166149 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03723994-66af-4c41-ae2f-8a452797b759 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:20.184992 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-03723994-66af-4c41-ae2f-8a452797b759 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Getting quotas for project 9ee0edfe1ca545a18061642a775747b5. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:54:20.191223 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-03723994-66af-4c41-ae2f-8a452797b759 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Getting quotas for user 9434d247ee1c4143bc2cf07b834417ea and project 9ee0edfe1ca545a18061642a775747b5. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:54:20.204578 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-03723994-66af-4c41-ae2f-8a452797b759 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:54:20.206883 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-03723994-66af-4c41-ae2f-8a452797b759 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:54:20.315416 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-03723994-66af-4c41-ae2f-8a452797b759 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.703999 Jun 10 18:54:20.316119 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3827/7449] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:54:19 2022] POST /compute/v2.1/servers => generated 409 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 18:54:20.325943 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1bbf8e65-3248-4e03-b1d9-558973e40195 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:20.326564 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1bbf8e65-3248-4e03-b1d9-558973e40195 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:20.384630 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1bbf8e65-3248-4e03-b1d9-558973e40195 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:20.393779 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1bbf8e65-3248-4e03-b1d9-558973e40195 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1238 microversion: 2.1 time: 0.071507 Jun 10 18:54:20.394988 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3828/7450] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:20 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1238 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:54:21.412739 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-565d7c0e-76e1-451a-ae6d-423bd6a1a92a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:21.413422 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-565d7c0e-76e1-451a-ae6d-423bd6a1a92a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:21.421289 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-565d7c0e-76e1-451a-ae6d-423bd6a1a92a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:21.421742 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-565d7c0e-76e1-451a-ae6d-423bd6a1a92a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:21.422525 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-565d7c0e-76e1-451a-ae6d-423bd6a1a92a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:21.423037 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-565d7c0e-76e1-451a-ae6d-423bd6a1a92a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:21.485844 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-565d7c0e-76e1-451a-ae6d-423bd6a1a92a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:21.492393 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-565d7c0e-76e1-451a-ae6d-423bd6a1a92a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1242 microversion: 2.1 time: 0.083534 Jun 10 18:54:21.492954 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3829/7451] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:21 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:54:22.508802 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dd157f59-be7c-42c3-8f58-77f40216d583 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:22.509429 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dd157f59-be7c-42c3-8f58-77f40216d583 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:22.529223 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd157f59-be7c-42c3-8f58-77f40216d583 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:22.529687 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd157f59-be7c-42c3-8f58-77f40216d583 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:22.530475 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd157f59-be7c-42c3-8f58-77f40216d583 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:22.531186 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd157f59-be7c-42c3-8f58-77f40216d583 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:22.599154 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-dd157f59-be7c-42c3-8f58-77f40216d583 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:22.606656 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dd157f59-be7c-42c3-8f58-77f40216d583 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1308 microversion: 2.1 time: 0.101915 Jun 10 18:54:22.607227 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3830/7452] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:22 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1308 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:54:23.624440 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-242b1167-475e-4dee-9998-8f3dc49ebe4e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:23.625774 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-242b1167-475e-4dee-9998-8f3dc49ebe4e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:23.633231 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-242b1167-475e-4dee-9998-8f3dc49ebe4e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:23.633840 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-242b1167-475e-4dee-9998-8f3dc49ebe4e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:23.634472 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-242b1167-475e-4dee-9998-8f3dc49ebe4e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:23.634918 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-242b1167-475e-4dee-9998-8f3dc49ebe4e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:23.788563 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-242b1167-475e-4dee-9998-8f3dc49ebe4e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:23.797713 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-242b1167-475e-4dee-9998-8f3dc49ebe4e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1364 microversion: 2.1 time: 0.176534 Jun 10 18:54:23.798595 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3831/7453] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:23 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:54:23.983707 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-340db7dc-ded1-4f4d-88bd-81c6e190a58e req-63b2ccd5-6278-47a4-aefc-e4feaa7e3f93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07deb4af-bbda-4469-9f0d-9ad15b54741b", "tag": "669fbad3-45be-4d93-95c0-99b60e7323d2"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:54:23.994651 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-340db7dc-ded1-4f4d-88bd-81c6e190a58e req-63b2ccd5-6278-47a4-aefc-e4feaa7e3f93 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:23.995348 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-340db7dc-ded1-4f4d-88bd-81c6e190a58e req-63b2ccd5-6278-47a4-aefc-e4feaa7e3f93 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:24.007641 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-340db7dc-ded1-4f4d-88bd-81c6e190a58e req-63b2ccd5-6278-47a4-aefc-e4feaa7e3f93 service nova] Creating event network-changed:669fbad3-45be-4d93-95c0-99b60e7323d2 for instance 07deb4af-bbda-4469-9f0d-9ad15b54741b on chh1-master-2 Jun 10 18:54:24.013783 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-340db7dc-ded1-4f4d-88bd-81c6e190a58e req-63b2ccd5-6278-47a4-aefc-e4feaa7e3f93 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033584 Jun 10 18:54:24.014759 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3832/7454] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:54:24.817046 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d9be00af-e61f-41c0-882c-a77f4e58ba4f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:24.817733 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d9be00af-e61f-41c0-882c-a77f4e58ba4f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:24.824014 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d9be00af-e61f-41c0-882c-a77f4e58ba4f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:24.824620 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d9be00af-e61f-41c0-882c-a77f4e58ba4f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:24.825326 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d9be00af-e61f-41c0-882c-a77f4e58ba4f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:24.825707 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d9be00af-e61f-41c0-882c-a77f4e58ba4f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:24.963910 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d9be00af-e61f-41c0-882c-a77f4e58ba4f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:24.972078 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d9be00af-e61f-41c0-882c-a77f4e58ba4f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1364 microversion: 2.1 time: 0.160763 Jun 10 18:54:24.972716 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3833/7455] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:24 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:54:25.989011 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-267a6fd8-2a69-4a43-8e35-9ba37fdf02f2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:25.989713 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-267a6fd8-2a69-4a43-8e35-9ba37fdf02f2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:25.996625 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-267a6fd8-2a69-4a43-8e35-9ba37fdf02f2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:26.002051 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-267a6fd8-2a69-4a43-8e35-9ba37fdf02f2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:26.002051 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-267a6fd8-2a69-4a43-8e35-9ba37fdf02f2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:26.002051 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-267a6fd8-2a69-4a43-8e35-9ba37fdf02f2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:26.130001 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-267a6fd8-2a69-4a43-8e35-9ba37fdf02f2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:26.137694 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-267a6fd8-2a69-4a43-8e35-9ba37fdf02f2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1364 microversion: 2.1 time: 0.152333 Jun 10 18:54:26.138267 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3834/7456] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:25 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:54:27.155000 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-15e93a08-5935-4a8d-8b73-210ac10338d0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:27.155620 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-15e93a08-5935-4a8d-8b73-210ac10338d0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:27.163109 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-15e93a08-5935-4a8d-8b73-210ac10338d0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:27.163558 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-15e93a08-5935-4a8d-8b73-210ac10338d0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:27.164325 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-15e93a08-5935-4a8d-8b73-210ac10338d0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:27.164776 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-15e93a08-5935-4a8d-8b73-210ac10338d0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:27.296027 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-15e93a08-5935-4a8d-8b73-210ac10338d0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:27.304233 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-15e93a08-5935-4a8d-8b73-210ac10338d0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1364 microversion: 2.1 time: 0.153190 Jun 10 18:54:27.304846 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3835/7457] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:27 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:54:28.321272 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-434b2d82-5990-4891-9048-22ed584f68e4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:28.321870 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-434b2d82-5990-4891-9048-22ed584f68e4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:28.328966 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-434b2d82-5990-4891-9048-22ed584f68e4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:28.329416 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-434b2d82-5990-4891-9048-22ed584f68e4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:28.330181 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-434b2d82-5990-4891-9048-22ed584f68e4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:28.330620 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-434b2d82-5990-4891-9048-22ed584f68e4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:28.480179 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-434b2d82-5990-4891-9048-22ed584f68e4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:28.488106 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-434b2d82-5990-4891-9048-22ed584f68e4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1364 microversion: 2.1 time: 0.171602 Jun 10 18:54:28.488716 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3836/7458] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:28 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:54:29.027365 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-abec5d1c-f5e1-479f-90a4-4df402bd948a req-20d119af-7c72-445e-9471-6a2b381e981f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07deb4af-bbda-4469-9f0d-9ad15b54741b", "name": "network-vif-plugged", "status": "completed", "tag": "669fbad3-45be-4d93-95c0-99b60e7323d2"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:54:29.036205 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-abec5d1c-f5e1-479f-90a4-4df402bd948a req-20d119af-7c72-445e-9471-6a2b381e981f service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:29.036672 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-abec5d1c-f5e1-479f-90a4-4df402bd948a req-20d119af-7c72-445e-9471-6a2b381e981f service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:29.047815 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-abec5d1c-f5e1-479f-90a4-4df402bd948a req-20d119af-7c72-445e-9471-6a2b381e981f service nova] Creating event network-vif-plugged:669fbad3-45be-4d93-95c0-99b60e7323d2 for instance 07deb4af-bbda-4469-9f0d-9ad15b54741b on chh1-master-2 Jun 10 18:54:29.052840 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-abec5d1c-f5e1-479f-90a4-4df402bd948a req-20d119af-7c72-445e-9471-6a2b381e981f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029061 Jun 10 18:54:29.054605 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3837/7459] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:54:29.505621 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7dede78f-e6ee-4c3a-a026-36755ef80266 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:29.506324 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7dede78f-e6ee-4c3a-a026-36755ef80266 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:29.513620 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7dede78f-e6ee-4c3a-a026-36755ef80266 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:29.514075 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7dede78f-e6ee-4c3a-a026-36755ef80266 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:29.514858 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7dede78f-e6ee-4c3a-a026-36755ef80266 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:29.515292 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7dede78f-e6ee-4c3a-a026-36755ef80266 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:29.643759 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7dede78f-e6ee-4c3a-a026-36755ef80266 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:29.651301 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7dede78f-e6ee-4c3a-a026-36755ef80266 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1364 microversion: 2.1 time: 0.149932 Jun 10 18:54:29.651877 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3838/7460] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:29 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:54:30.667353 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0b7d6cd3-e49d-4370-b394-919f7a9f307a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:30.667972 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0b7d6cd3-e49d-4370-b394-919f7a9f307a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:30.670083 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:54:30.670757 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=12 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:54:30.676492 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0b7d6cd3-e49d-4370-b394-919f7a9f307a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:30.676944 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0b7d6cd3-e49d-4370-b394-919f7a9f307a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:30.677706 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0b7d6cd3-e49d-4370-b394-919f7a9f307a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:30.678147 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0b7d6cd3-e49d-4370-b394-919f7a9f307a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:30.810165 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0b7d6cd3-e49d-4370-b394-919f7a9f307a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:30.818416 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0b7d6cd3-e49d-4370-b394-919f7a9f307a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1550 microversion: 2.1 time: 0.154883 Jun 10 18:54:30.821830 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3839/7461] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:30 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1550 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:54:30.834534 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4d3b7697-3315-4931-a340-220859ee9a01 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:30.835020 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4d3b7697-3315-4931-a340-220859ee9a01 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:30.840745 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d3b7697-3315-4931-a340-220859ee9a01 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:30.841201 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d3b7697-3315-4931-a340-220859ee9a01 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:30.841956 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d3b7697-3315-4931-a340-220859ee9a01 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:30.842390 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d3b7697-3315-4931-a340-220859ee9a01 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:30.927704 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4d3b7697-3315-4931-a340-220859ee9a01 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096627 Jun 10 18:54:30.928326 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3840/7462] 10.222.0.35 () {58 vars in 1274 bytes} [Fri Jun 10 18:54:30 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:54:31.889528 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4eae4103-83a2-4f3e-8ba3-7a39e45e8fed tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:31.890206 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4eae4103-83a2-4f3e-8ba3-7a39e45e8fed tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:31.897844 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4eae4103-83a2-4f3e-8ba3-7a39e45e8fed tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:31.898373 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4eae4103-83a2-4f3e-8ba3-7a39e45e8fed tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:31.899150 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4eae4103-83a2-4f3e-8ba3-7a39e45e8fed tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:31.899586 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4eae4103-83a2-4f3e-8ba3-7a39e45e8fed tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:32.033508 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4eae4103-83a2-4f3e-8ba3-7a39e45e8fed tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:32.041355 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4eae4103-83a2-4f3e-8ba3-7a39e45e8fed tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1550 microversion: 2.1 time: 0.155877 Jun 10 18:54:32.041969 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3841/7463] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:31 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1550 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:54:32.107394 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-28acd7a2-0856-44de-bfbe-efd7f6b027b1 req-a273778f-da3f-43e2-b1c1-3fe96e53b96d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07deb4af-bbda-4469-9f0d-9ad15b54741b", "tag": "669fbad3-45be-4d93-95c0-99b60e7323d2"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:54:32.115676 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-28acd7a2-0856-44de-bfbe-efd7f6b027b1 req-a273778f-da3f-43e2-b1c1-3fe96e53b96d service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:32.116132 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-28acd7a2-0856-44de-bfbe-efd7f6b027b1 req-a273778f-da3f-43e2-b1c1-3fe96e53b96d service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:32.127495 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-28acd7a2-0856-44de-bfbe-efd7f6b027b1 req-a273778f-da3f-43e2-b1c1-3fe96e53b96d service nova] Creating event network-changed:669fbad3-45be-4d93-95c0-99b60e7323d2 for instance 07deb4af-bbda-4469-9f0d-9ad15b54741b on chh1-master-2 Jun 10 18:54:32.132504 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-28acd7a2-0856-44de-bfbe-efd7f6b027b1 req-a273778f-da3f-43e2-b1c1-3fe96e53b96d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089342 Jun 10 18:54:32.133143 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3842/7464] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:54:32.138593 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a53b624f-ac73-4bd3-acb8-11190f6c612e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:32.139289 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a53b624f-ac73-4bd3-acb8-11190f6c612e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:32.146196 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a53b624f-ac73-4bd3-acb8-11190f6c612e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:32.146775 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a53b624f-ac73-4bd3-acb8-11190f6c612e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:32.147404 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a53b624f-ac73-4bd3-acb8-11190f6c612e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:32.147847 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a53b624f-ac73-4bd3-acb8-11190f6c612e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:32.287453 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a53b624f-ac73-4bd3-acb8-11190f6c612e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:32.295935 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a53b624f-ac73-4bd3-acb8-11190f6c612e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1550 microversion: 2.1 time: 0.161559 Jun 10 18:54:32.296879 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3843/7465] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:32 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1550 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:54:33.313265 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4ce2d288-1900-4c0b-bb83-98bf727e8e3d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:33.313936 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4ce2d288-1900-4c0b-bb83-98bf727e8e3d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:33.320843 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ce2d288-1900-4c0b-bb83-98bf727e8e3d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:33.321292 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ce2d288-1900-4c0b-bb83-98bf727e8e3d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:33.322046 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ce2d288-1900-4c0b-bb83-98bf727e8e3d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:33.322480 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ce2d288-1900-4c0b-bb83-98bf727e8e3d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:33.448688 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4ce2d288-1900-4c0b-bb83-98bf727e8e3d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:33.456786 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4ce2d288-1900-4c0b-bb83-98bf727e8e3d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1669 microversion: 2.1 time: 0.147382 Jun 10 18:54:33.457361 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3844/7466] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:33 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1669 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:54:33.472528 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9e8dc157-3510-443f-9dc7-8467fc855fe7 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:33.473143 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9e8dc157-3510-443f-9dc7-8467fc855fe7 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:33.478884 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9e8dc157-3510-443f-9dc7-8467fc855fe7 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:33.479338 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9e8dc157-3510-443f-9dc7-8467fc855fe7 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:33.480096 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9e8dc157-3510-443f-9dc7-8467fc855fe7 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:33.480561 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9e8dc157-3510-443f-9dc7-8467fc855fe7 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:33.609553 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9e8dc157-3510-443f-9dc7-8467fc855fe7 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:33.617240 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9e8dc157-3510-443f-9dc7-8467fc855fe7 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1669 microversion: 2.1 time: 0.148812 Jun 10 18:54:33.617810 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3845/7467] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:33 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1669 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:54:33.636337 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-584b61f5-e292-44e1-831b-6b9013581fce tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:54:33.637558 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-584b61f5-e292-44e1-831b-6b9013581fce tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:33.643894 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-584b61f5-e292-44e1-831b-6b9013581fce tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:33.644379 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-584b61f5-e292-44e1-831b-6b9013581fce tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:33.645145 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-584b61f5-e292-44e1-831b-6b9013581fce tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:33.645588 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-584b61f5-e292-44e1-831b-6b9013581fce tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:33.675322 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-584b61f5-e292-44e1-831b-6b9013581fce tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:33.681163 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-584b61f5-e292-44e1-831b-6b9013581fce tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Old instance type m1.heat2, new instance type m1.heat {{(pid=126595) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 10 18:54:33.687372 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-584b61f5-e292-44e1-831b-6b9013581fce tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:54:33.687788 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-584b61f5-e292-44e1-831b-6b9013581fce tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:54:33.688244 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-584b61f5-e292-44e1-831b-6b9013581fce tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:54:33.688676 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-584b61f5-e292-44e1-831b-6b9013581fce tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:54:33.689085 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-584b61f5-e292-44e1-831b-6b9013581fce tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:54:33.717984 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:54:33.870089 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-584b61f5-e292-44e1-831b-6b9013581fce tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "POST /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b/action" status: 202 len: 0 microversion: 2.1 time: 0.237316 Jun 10 18:54:33.870709 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3846/7468] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:54:33 2022] POST /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 18:54:33.878923 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9865939d-c592-48a4-886b-5ec603656c5a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:33.879543 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9865939d-c592-48a4-886b-5ec603656c5a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:33.885645 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9865939d-c592-48a4-886b-5ec603656c5a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:33.886615 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9865939d-c592-48a4-886b-5ec603656c5a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:33.887129 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9865939d-c592-48a4-886b-5ec603656c5a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:33.887585 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9865939d-c592-48a4-886b-5ec603656c5a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:34.020710 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9865939d-c592-48a4-886b-5ec603656c5a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:34.028280 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9865939d-c592-48a4-886b-5ec603656c5a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1678 microversion: 2.1 time: 0.153507 Jun 10 18:54:34.028878 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3847/7469] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:33 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:54:35.045194 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cc996fbc-17d1-427e-8599-95f25fd5a389 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:35.045839 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cc996fbc-17d1-427e-8599-95f25fd5a389 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:35.053322 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc996fbc-17d1-427e-8599-95f25fd5a389 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:35.053770 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc996fbc-17d1-427e-8599-95f25fd5a389 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:35.054571 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc996fbc-17d1-427e-8599-95f25fd5a389 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:35.055025 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc996fbc-17d1-427e-8599-95f25fd5a389 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:35.205912 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cc996fbc-17d1-427e-8599-95f25fd5a389 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:35.205912 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cc996fbc-17d1-427e-8599-95f25fd5a389 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1678 microversion: 2.1 time: 0.157737 Jun 10 18:54:35.205912 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3848/7470] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:35 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:54:36.250157 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-85728ff1-8f8f-4df1-8eb4-8218dfd43f69 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:36.251374 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-85728ff1-8f8f-4df1-8eb4-8218dfd43f69 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:36.258223 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-85728ff1-8f8f-4df1-8eb4-8218dfd43f69 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:36.258670 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-85728ff1-8f8f-4df1-8eb4-8218dfd43f69 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:36.259449 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-85728ff1-8f8f-4df1-8eb4-8218dfd43f69 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:36.259871 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-85728ff1-8f8f-4df1-8eb4-8218dfd43f69 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:36.390396 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-85728ff1-8f8f-4df1-8eb4-8218dfd43f69 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:36.398437 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-85728ff1-8f8f-4df1-8eb4-8218dfd43f69 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1678 microversion: 2.1 time: 0.152149 Jun 10 18:54:36.399021 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3849/7471] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:36 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:54:37.415867 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-833a8139-ce41-46c9-8626-8ed1e669d797 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:37.416818 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-833a8139-ce41-46c9-8626-8ed1e669d797 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:37.424152 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-833a8139-ce41-46c9-8626-8ed1e669d797 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:37.424650 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-833a8139-ce41-46c9-8626-8ed1e669d797 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:37.425439 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-833a8139-ce41-46c9-8626-8ed1e669d797 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:37.425879 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-833a8139-ce41-46c9-8626-8ed1e669d797 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:37.558200 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-833a8139-ce41-46c9-8626-8ed1e669d797 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:37.566273 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-833a8139-ce41-46c9-8626-8ed1e669d797 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1683 microversion: 2.1 time: 0.154481 Jun 10 18:54:37.566853 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3850/7472] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:37 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:54:38.583655 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1b32945c-f396-41f0-b48d-1c841bac30e8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:38.584354 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1b32945c-f396-41f0-b48d-1c841bac30e8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:38.591176 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1b32945c-f396-41f0-b48d-1c841bac30e8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:38.591623 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1b32945c-f396-41f0-b48d-1c841bac30e8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:38.592407 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1b32945c-f396-41f0-b48d-1c841bac30e8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:38.592844 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1b32945c-f396-41f0-b48d-1c841bac30e8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:38.724983 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1b32945c-f396-41f0-b48d-1c841bac30e8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:38.734107 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1b32945c-f396-41f0-b48d-1c841bac30e8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1683 microversion: 2.1 time: 0.154031 Jun 10 18:54:38.735179 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3851/7473] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:38 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:54:39.757569 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5ebc60f4-daeb-4200-8db1-76148f35b61b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:39.758243 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5ebc60f4-daeb-4200-8db1-76148f35b61b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:39.765386 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ebc60f4-daeb-4200-8db1-76148f35b61b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:39.765840 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ebc60f4-daeb-4200-8db1-76148f35b61b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:39.766697 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ebc60f4-daeb-4200-8db1-76148f35b61b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:39.767139 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ebc60f4-daeb-4200-8db1-76148f35b61b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:39.898402 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5ebc60f4-daeb-4200-8db1-76148f35b61b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:39.905934 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5ebc60f4-daeb-4200-8db1-76148f35b61b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1683 microversion: 2.1 time: 0.152208 Jun 10 18:54:39.907013 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3852/7474] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:39 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:54:40.923449 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a78e9694-c819-4169-bb4d-69de29786f45 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:40.924062 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a78e9694-c819-4169-bb4d-69de29786f45 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:40.931112 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a78e9694-c819-4169-bb4d-69de29786f45 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:40.931571 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a78e9694-c819-4169-bb4d-69de29786f45 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:40.932346 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a78e9694-c819-4169-bb4d-69de29786f45 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:40.932788 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a78e9694-c819-4169-bb4d-69de29786f45 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:41.114463 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a78e9694-c819-4169-bb4d-69de29786f45 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:41.121963 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a78e9694-c819-4169-bb4d-69de29786f45 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1683 microversion: 2.1 time: 0.202937 Jun 10 18:54:41.122716 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3853/7475] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:40 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1683 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:54:42.140462 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-edb24ce8-09d6-41b9-bfe5-c53dbc1d02a8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:42.141730 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-edb24ce8-09d6-41b9-bfe5-c53dbc1d02a8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:42.147795 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-edb24ce8-09d6-41b9-bfe5-c53dbc1d02a8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:42.148251 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-edb24ce8-09d6-41b9-bfe5-c53dbc1d02a8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:42.149047 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-edb24ce8-09d6-41b9-bfe5-c53dbc1d02a8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:42.149489 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-edb24ce8-09d6-41b9-bfe5-c53dbc1d02a8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:42.276208 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-edb24ce8-09d6-41b9-bfe5-c53dbc1d02a8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:42.283994 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-edb24ce8-09d6-41b9-bfe5-c53dbc1d02a8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1683 microversion: 2.1 time: 0.148023 Jun 10 18:54:42.284610 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3854/7476] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:42 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1683 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:54:43.301186 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-58f38ca1-f49a-416a-8141-4dcba4c05c59 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:43.301795 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-58f38ca1-f49a-416a-8141-4dcba4c05c59 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:43.308823 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-58f38ca1-f49a-416a-8141-4dcba4c05c59 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:43.309280 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-58f38ca1-f49a-416a-8141-4dcba4c05c59 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:43.310043 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-58f38ca1-f49a-416a-8141-4dcba4c05c59 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:43.310625 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-58f38ca1-f49a-416a-8141-4dcba4c05c59 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:43.446176 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-58f38ca1-f49a-416a-8141-4dcba4c05c59 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:43.454443 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-58f38ca1-f49a-416a-8141-4dcba4c05c59 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1683 microversion: 2.1 time: 0.157171 Jun 10 18:54:43.455016 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3855/7477] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:43 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:54:44.471416 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e9b16d87-e621-4e69-917c-58fd3bbb5c70 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:44.472020 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e9b16d87-e621-4e69-917c-58fd3bbb5c70 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:44.478968 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e9b16d87-e621-4e69-917c-58fd3bbb5c70 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:44.479424 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e9b16d87-e621-4e69-917c-58fd3bbb5c70 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:44.480195 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e9b16d87-e621-4e69-917c-58fd3bbb5c70 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:44.480664 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e9b16d87-e621-4e69-917c-58fd3bbb5c70 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:44.606703 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e9b16d87-e621-4e69-917c-58fd3bbb5c70 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:44.614773 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e9b16d87-e621-4e69-917c-58fd3bbb5c70 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1683 microversion: 2.1 time: 0.147757 Jun 10 18:54:44.615347 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3856/7478] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:44 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1683 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:54:45.631210 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2e0460ee-f6e2-440e-979d-8af71d323855 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:45.631857 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2e0460ee-f6e2-440e-979d-8af71d323855 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:45.639076 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e0460ee-f6e2-440e-979d-8af71d323855 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:45.639527 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e0460ee-f6e2-440e-979d-8af71d323855 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:45.640281 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e0460ee-f6e2-440e-979d-8af71d323855 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:45.641248 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e0460ee-f6e2-440e-979d-8af71d323855 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:45.774809 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2e0460ee-f6e2-440e-979d-8af71d323855 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:45.782169 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2e0460ee-f6e2-440e-979d-8af71d323855 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1683 microversion: 2.1 time: 0.154831 Jun 10 18:54:45.782742 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3857/7479] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:45 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:54:46.800043 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3a182273-8e99-4274-863b-f4dbf3ec0c4d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:46.800688 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3a182273-8e99-4274-863b-f4dbf3ec0c4d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:46.807607 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3a182273-8e99-4274-863b-f4dbf3ec0c4d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:46.808062 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3a182273-8e99-4274-863b-f4dbf3ec0c4d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:46.808859 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3a182273-8e99-4274-863b-f4dbf3ec0c4d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:46.809300 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3a182273-8e99-4274-863b-f4dbf3ec0c4d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:46.937397 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3a182273-8e99-4274-863b-f4dbf3ec0c4d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:46.945081 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3a182273-8e99-4274-863b-f4dbf3ec0c4d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1683 microversion: 2.1 time: 0.149976 Jun 10 18:54:46.945650 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3858/7480] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:46 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:54:47.964894 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7a0c92fa-b9ef-4e05-8916-09bc37be7ded tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:47.965568 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7a0c92fa-b9ef-4e05-8916-09bc37be7ded tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:47.973016 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7a0c92fa-b9ef-4e05-8916-09bc37be7ded tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:47.973466 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7a0c92fa-b9ef-4e05-8916-09bc37be7ded tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:47.974224 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7a0c92fa-b9ef-4e05-8916-09bc37be7ded tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:47.974661 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7a0c92fa-b9ef-4e05-8916-09bc37be7ded tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:48.107979 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7a0c92fa-b9ef-4e05-8916-09bc37be7ded tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:48.116299 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7a0c92fa-b9ef-4e05-8916-09bc37be7ded tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1683 microversion: 2.1 time: 0.155312 Jun 10 18:54:48.116904 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3859/7481] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:47 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:54:49.132624 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8dce5975-c184-4adc-b5d7-6718c1dec46d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:49.133321 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8dce5975-c184-4adc-b5d7-6718c1dec46d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:49.140407 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8dce5975-c184-4adc-b5d7-6718c1dec46d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:49.140861 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8dce5975-c184-4adc-b5d7-6718c1dec46d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:49.141626 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8dce5975-c184-4adc-b5d7-6718c1dec46d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:49.142066 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8dce5975-c184-4adc-b5d7-6718c1dec46d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:49.268631 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8dce5975-c184-4adc-b5d7-6718c1dec46d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:49.276106 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8dce5975-c184-4adc-b5d7-6718c1dec46d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1683 microversion: 2.1 time: 0.147363 Jun 10 18:54:49.276709 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3860/7482] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:49 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1683 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:54:50.293216 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4629b031-7d08-454d-9f9d-034d740eccce tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:50.293924 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4629b031-7d08-454d-9f9d-034d740eccce tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:50.296589 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=88 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:54:50.301477 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4629b031-7d08-454d-9f9d-034d740eccce tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:50.306443 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4629b031-7d08-454d-9f9d-034d740eccce tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:50.306443 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4629b031-7d08-454d-9f9d-034d740eccce tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:50.306443 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4629b031-7d08-454d-9f9d-034d740eccce tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:50.434768 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4629b031-7d08-454d-9f9d-034d740eccce tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:50.442952 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4629b031-7d08-454d-9f9d-034d740eccce tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1683 microversion: 2.1 time: 0.153626 Jun 10 18:54:50.443522 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3861/7483] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:50 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:54:51.459355 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dd6cce43-4b77-4026-96ae-9227c79dbeb7 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:51.459972 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dd6cce43-4b77-4026-96ae-9227c79dbeb7 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:51.467045 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd6cce43-4b77-4026-96ae-9227c79dbeb7 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:51.467511 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd6cce43-4b77-4026-96ae-9227c79dbeb7 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:51.468256 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd6cce43-4b77-4026-96ae-9227c79dbeb7 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:51.468720 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd6cce43-4b77-4026-96ae-9227c79dbeb7 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:51.598557 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-dd6cce43-4b77-4026-96ae-9227c79dbeb7 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:51.601951 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:54:51.606258 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dd6cce43-4b77-4026-96ae-9227c79dbeb7 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1683 microversion: 2.1 time: 0.150736 Jun 10 18:54:51.606825 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3862/7484] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:51 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:54:52.623327 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0a786ebd-d5f9-4aaf-ac41-4923b129c250 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:52.624028 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0a786ebd-d5f9-4aaf-ac41-4923b129c250 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:52.631690 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0a786ebd-d5f9-4aaf-ac41-4923b129c250 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:52.632427 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0a786ebd-d5f9-4aaf-ac41-4923b129c250 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:52.632948 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0a786ebd-d5f9-4aaf-ac41-4923b129c250 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:52.633394 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0a786ebd-d5f9-4aaf-ac41-4923b129c250 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:52.760803 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0a786ebd-d5f9-4aaf-ac41-4923b129c250 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:52.768610 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0a786ebd-d5f9-4aaf-ac41-4923b129c250 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1683 microversion: 2.1 time: 0.149574 Jun 10 18:54:52.769181 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3863/7485] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:52 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:54:53.784928 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-935047ac-58d7-44c5-b3f3-bd8d694a995e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:53.785585 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-935047ac-58d7-44c5-b3f3-bd8d694a995e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:53.792680 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-935047ac-58d7-44c5-b3f3-bd8d694a995e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:53.793141 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-935047ac-58d7-44c5-b3f3-bd8d694a995e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:53.793922 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-935047ac-58d7-44c5-b3f3-bd8d694a995e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:53.794366 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-935047ac-58d7-44c5-b3f3-bd8d694a995e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:53.930146 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-935047ac-58d7-44c5-b3f3-bd8d694a995e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:53.938318 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-935047ac-58d7-44c5-b3f3-bd8d694a995e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1682 microversion: 2.1 time: 0.156736 Jun 10 18:54:53.938895 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3864/7486] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:53 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:54:54.192629 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-dc67f1f9-550b-4648-a1c0-6805db266189 req-cbeb2ef9-bec5-4059-b201-e938cbcd785b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07deb4af-bbda-4469-9f0d-9ad15b54741b", "name": "network-vif-unplugged", "status": "completed", "tag": "669fbad3-45be-4d93-95c0-99b60e7323d2"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:54:54.198876 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-dc67f1f9-550b-4648-a1c0-6805db266189 req-cbeb2ef9-bec5-4059-b201-e938cbcd785b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:54.199354 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-dc67f1f9-550b-4648-a1c0-6805db266189 req-cbeb2ef9-bec5-4059-b201-e938cbcd785b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:54.211001 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-dc67f1f9-550b-4648-a1c0-6805db266189 req-cbeb2ef9-bec5-4059-b201-e938cbcd785b service nova] Creating event network-vif-unplugged:669fbad3-45be-4d93-95c0-99b60e7323d2 for instance 07deb4af-bbda-4469-9f0d-9ad15b54741b on chh2-master-2 Jun 10 18:54:54.216293 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [req-dc67f1f9-550b-4648-a1c0-6805db266189 req-cbeb2ef9-bec5-4059-b201-e938cbcd785b service nova] Instance 07deb4af-bbda-4469-9f0d-9ad15b54741b is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 18:54:54.227794 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-dc67f1f9-550b-4648-a1c0-6805db266189 req-cbeb2ef9-bec5-4059-b201-e938cbcd785b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040748 Jun 10 18:54:54.228392 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3865/7487] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:54:54.957652 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ed48f2b5-40b6-42c0-a54c-294de2101a00 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:54.958462 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ed48f2b5-40b6-42c0-a54c-294de2101a00 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:54.965226 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ed48f2b5-40b6-42c0-a54c-294de2101a00 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:54.965813 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ed48f2b5-40b6-42c0-a54c-294de2101a00 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:54.966713 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ed48f2b5-40b6-42c0-a54c-294de2101a00 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:54.967219 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ed48f2b5-40b6-42c0-a54c-294de2101a00 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:55.103999 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ed48f2b5-40b6-42c0-a54c-294de2101a00 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:55.112214 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ed48f2b5-40b6-42c0-a54c-294de2101a00 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1682 microversion: 2.1 time: 0.160677 Jun 10 18:54:55.112852 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3866/7488] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:54 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:54:56.129581 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-28a88a09-06bb-4147-80cd-733d4e514f57 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:56.130353 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-28a88a09-06bb-4147-80cd-733d4e514f57 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:56.137428 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-28a88a09-06bb-4147-80cd-733d4e514f57 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:56.137884 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-28a88a09-06bb-4147-80cd-733d4e514f57 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:56.138647 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-28a88a09-06bb-4147-80cd-733d4e514f57 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:56.139090 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-28a88a09-06bb-4147-80cd-733d4e514f57 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:56.268291 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-28a88a09-06bb-4147-80cd-733d4e514f57 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:56.275974 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-28a88a09-06bb-4147-80cd-733d4e514f57 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1680 microversion: 2.1 time: 0.150286 Jun 10 18:54:56.276601 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3867/7489] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:56 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:54:56.280959 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-b96a81db-4242-458b-995f-9dc2d4c6deb6 req-705d2cf7-9aca-44be-80c3-b11e6058898a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07deb4af-bbda-4469-9f0d-9ad15b54741b", "tag": "669fbad3-45be-4d93-95c0-99b60e7323d2"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:54:56.288429 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-b96a81db-4242-458b-995f-9dc2d4c6deb6 req-705d2cf7-9aca-44be-80c3-b11e6058898a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:56.288889 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-b96a81db-4242-458b-995f-9dc2d4c6deb6 req-705d2cf7-9aca-44be-80c3-b11e6058898a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:56.300133 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-b96a81db-4242-458b-995f-9dc2d4c6deb6 req-705d2cf7-9aca-44be-80c3-b11e6058898a service nova] Creating event network-changed:669fbad3-45be-4d93-95c0-99b60e7323d2 for instance 07deb4af-bbda-4469-9f0d-9ad15b54741b on chh2-master-2 Jun 10 18:54:56.305348 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [req-b96a81db-4242-458b-995f-9dc2d4c6deb6 req-705d2cf7-9aca-44be-80c3-b11e6058898a service nova] Instance 07deb4af-bbda-4469-9f0d-9ad15b54741b is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 18:54:56.316527 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-b96a81db-4242-458b-995f-9dc2d4c6deb6 req-705d2cf7-9aca-44be-80c3-b11e6058898a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038762 Jun 10 18:54:56.317151 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3868/7490] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:54:57.294870 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-787f0e9f-cbe9-45c9-bcce-35f8b366c510 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:57.295568 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-787f0e9f-cbe9-45c9-bcce-35f8b366c510 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:57.302395 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-787f0e9f-cbe9-45c9-bcce-35f8b366c510 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:57.302841 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-787f0e9f-cbe9-45c9-bcce-35f8b366c510 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:57.303625 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-787f0e9f-cbe9-45c9-bcce-35f8b366c510 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:57.304064 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-787f0e9f-cbe9-45c9-bcce-35f8b366c510 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:57.439368 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-787f0e9f-cbe9-45c9-bcce-35f8b366c510 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:57.447068 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-787f0e9f-cbe9-45c9-bcce-35f8b366c510 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1680 microversion: 2.1 time: 0.157252 Jun 10 18:54:57.450918 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3869/7491] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:57 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:54:58.464785 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-16f7a887-d325-42fd-a107-f96476cef7f2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:58.465487 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-16f7a887-d325-42fd-a107-f96476cef7f2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:58.472989 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-16f7a887-d325-42fd-a107-f96476cef7f2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:58.473440 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-16f7a887-d325-42fd-a107-f96476cef7f2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:58.475221 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-16f7a887-d325-42fd-a107-f96476cef7f2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:58.476164 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-16f7a887-d325-42fd-a107-f96476cef7f2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:58.614227 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-16f7a887-d325-42fd-a107-f96476cef7f2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:58.622118 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-16f7a887-d325-42fd-a107-f96476cef7f2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1680 microversion: 2.1 time: 0.161201 Jun 10 18:54:58.622700 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3870/7492] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:58 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:54:59.639760 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-95a77996-4532-4fe9-b05b-50afe40e26c0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:59.640520 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-95a77996-4532-4fe9-b05b-50afe40e26c0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:59.647251 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-95a77996-4532-4fe9-b05b-50afe40e26c0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:59.647702 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-95a77996-4532-4fe9-b05b-50afe40e26c0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:59.648488 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-95a77996-4532-4fe9-b05b-50afe40e26c0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:59.648927 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-95a77996-4532-4fe9-b05b-50afe40e26c0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:59.785102 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-95a77996-4532-4fe9-b05b-50afe40e26c0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:54:59.792587 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-95a77996-4532-4fe9-b05b-50afe40e26c0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1677 microversion: 2.1 time: 0.156991 Jun 10 18:54:59.793152 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3871/7493] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:59 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:54:59.808616 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e7e64550-8e24-4876-99b1-931ef48bcdcc tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:54:59.809141 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e7e64550-8e24-4876-99b1-931ef48bcdcc tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:59.815279 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e7e64550-8e24-4876-99b1-931ef48bcdcc tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:59.815732 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e7e64550-8e24-4876-99b1-931ef48bcdcc tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:59.816546 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e7e64550-8e24-4876-99b1-931ef48bcdcc tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:59.816967 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e7e64550-8e24-4876-99b1-931ef48bcdcc tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:59.962207 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e7e64550-8e24-4876-99b1-931ef48bcdcc tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "POST /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b/action" status: 204 len: 0 microversion: 2.1 time: 0.156780 Jun 10 18:54:59.962934 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3872/7494] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:54:59 2022] POST /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b/action => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 18:54:59.971831 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-962e1f7a-695a-47a7-a877-ecc1e00693b6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:54:59.972555 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-962e1f7a-695a-47a7-a877-ecc1e00693b6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:54:59.979195 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-962e1f7a-695a-47a7-a877-ecc1e00693b6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:59.979658 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-962e1f7a-695a-47a7-a877-ecc1e00693b6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:54:59.980480 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-962e1f7a-695a-47a7-a877-ecc1e00693b6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:54:59.980924 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-962e1f7a-695a-47a7-a877-ecc1e00693b6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:00.114033 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-962e1f7a-695a-47a7-a877-ecc1e00693b6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:55:00.122056 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-962e1f7a-695a-47a7-a877-ecc1e00693b6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1677 microversion: 2.1 time: 0.154823 Jun 10 18:55:00.122637 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3873/7495] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:54:59 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:55:00.994850 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-8dc627d0-cb7e-46e4-bc5b-c712c392af96 req-ab14106b-5be1-4b7d-a082-fb1475456955 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07deb4af-bbda-4469-9f0d-9ad15b54741b", "name": "network-vif-plugged", "status": "completed", "tag": "669fbad3-45be-4d93-95c0-99b60e7323d2"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:55:01.005086 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-8dc627d0-cb7e-46e4-bc5b-c712c392af96 req-ab14106b-5be1-4b7d-a082-fb1475456955 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:01.005544 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-8dc627d0-cb7e-46e4-bc5b-c712c392af96 req-ab14106b-5be1-4b7d-a082-fb1475456955 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:01.018394 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-8dc627d0-cb7e-46e4-bc5b-c712c392af96 req-ab14106b-5be1-4b7d-a082-fb1475456955 service nova] Creating event network-vif-plugged:669fbad3-45be-4d93-95c0-99b60e7323d2 for instance 07deb4af-bbda-4469-9f0d-9ad15b54741b on chh2-master-2 Jun 10 18:55:01.023660 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [req-8dc627d0-cb7e-46e4-bc5b-c712c392af96 req-ab14106b-5be1-4b7d-a082-fb1475456955 service nova] Instance 07deb4af-bbda-4469-9f0d-9ad15b54741b is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 18:55:01.035322 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-8dc627d0-cb7e-46e4-bc5b-c712c392af96 req-ab14106b-5be1-4b7d-a082-fb1475456955 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044221 Jun 10 18:55:01.035908 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3874/7496] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:55:01.142278 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-08ceee44-f38c-4d46-b0e2-35a6e91761e8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:55:01.143175 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-08ceee44-f38c-4d46-b0e2-35a6e91761e8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:55:01.150406 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-08ceee44-f38c-4d46-b0e2-35a6e91761e8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:01.150874 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-08ceee44-f38c-4d46-b0e2-35a6e91761e8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:01.151673 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-08ceee44-f38c-4d46-b0e2-35a6e91761e8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:01.152115 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-08ceee44-f38c-4d46-b0e2-35a6e91761e8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:01.287343 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-08ceee44-f38c-4d46-b0e2-35a6e91761e8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:55:01.295032 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-08ceee44-f38c-4d46-b0e2-35a6e91761e8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1677 microversion: 2.1 time: 0.157293 Jun 10 18:55:01.295694 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3875/7497] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:55:01 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:55:02.313498 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-946092a6-93f8-46f5-b04e-4f8cf54c9a4d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:55:02.314198 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-946092a6-93f8-46f5-b04e-4f8cf54c9a4d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:55:02.321149 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-946092a6-93f8-46f5-b04e-4f8cf54c9a4d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:02.321604 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-946092a6-93f8-46f5-b04e-4f8cf54c9a4d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:02.322362 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-946092a6-93f8-46f5-b04e-4f8cf54c9a4d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:02.322798 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-946092a6-93f8-46f5-b04e-4f8cf54c9a4d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:02.454284 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-946092a6-93f8-46f5-b04e-4f8cf54c9a4d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:55:02.462089 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-946092a6-93f8-46f5-b04e-4f8cf54c9a4d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1669 microversion: 2.1 time: 0.152939 Jun 10 18:55:02.462671 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3876/7498] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:55:02 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1669 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:55:02.477738 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b9b706f9-41ed-4679-b823-2ee5ce2dd644 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:55:02.478343 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b9b706f9-41ed-4679-b823-2ee5ce2dd644 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:55:02.484120 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9b706f9-41ed-4679-b823-2ee5ce2dd644 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:02.484741 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9b706f9-41ed-4679-b823-2ee5ce2dd644 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:02.485511 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9b706f9-41ed-4679-b823-2ee5ce2dd644 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:02.485953 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9b706f9-41ed-4679-b823-2ee5ce2dd644 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:02.612411 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b9b706f9-41ed-4679-b823-2ee5ce2dd644 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:55:02.619798 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b9b706f9-41ed-4679-b823-2ee5ce2dd644 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1669 microversion: 2.1 time: 0.145560 Jun 10 18:55:02.620386 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3877/7499] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:55:02 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1669 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:55:02.635994 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cb211540-cb7e-496a-91bd-98b06f1fc01d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:55:02.636894 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cb211540-cb7e-496a-91bd-98b06f1fc01d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:55:02.642666 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cb211540-cb7e-496a-91bd-98b06f1fc01d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:02.643120 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cb211540-cb7e-496a-91bd-98b06f1fc01d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:02.644019 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cb211540-cb7e-496a-91bd-98b06f1fc01d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:02.644510 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cb211540-cb7e-496a-91bd-98b06f1fc01d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:02.778761 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cb211540-cb7e-496a-91bd-98b06f1fc01d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:55:02.786624 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cb211540-cb7e-496a-91bd-98b06f1fc01d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1669 microversion: 2.1 time: 0.154225 Jun 10 18:55:02.787190 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3878/7500] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:55:02 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1669 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:55:02.802454 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d59d5f7a-6789-4934-9d7e-6aae2a45ba8f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:55:02.802944 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d59d5f7a-6789-4934-9d7e-6aae2a45ba8f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:55:02.808582 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d59d5f7a-6789-4934-9d7e-6aae2a45ba8f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:02.809033 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d59d5f7a-6789-4934-9d7e-6aae2a45ba8f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:02.809782 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d59d5f7a-6789-4934-9d7e-6aae2a45ba8f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:02.810216 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d59d5f7a-6789-4934-9d7e-6aae2a45ba8f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:02.825521 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:55:02.835654 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d59d5f7a-6789-4934-9d7e-6aae2a45ba8f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:55:03.054395 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d59d5f7a-6789-4934-9d7e-6aae2a45ba8f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "DELETE /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 204 len: 0 microversion: 2.1 time: 0.255038 Jun 10 18:55:03.055008 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3879/7501] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:55:02 2022] DELETE /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 18:55:03.063524 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b44b16e6-685e-47be-a6c5-b30db49501ab tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:55:03.064223 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b44b16e6-685e-47be-a6c5-b30db49501ab tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:55:03.070339 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b44b16e6-685e-47be-a6c5-b30db49501ab tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:03.070790 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b44b16e6-685e-47be-a6c5-b30db49501ab tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:03.071555 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b44b16e6-685e-47be-a6c5-b30db49501ab tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:03.072000 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b44b16e6-685e-47be-a6c5-b30db49501ab tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:03.205312 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b44b16e6-685e-47be-a6c5-b30db49501ab tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:55:03.213172 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b44b16e6-685e-47be-a6c5-b30db49501ab tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1675 microversion: 2.1 time: 0.153835 Jun 10 18:55:03.213957 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3880/7502] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:55:03 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:55:04.231281 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9ba19b52-1d4a-4b11-be3a-47dabac82569 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:55:04.231985 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9ba19b52-1d4a-4b11-be3a-47dabac82569 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:55:04.239365 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9ba19b52-1d4a-4b11-be3a-47dabac82569 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:04.239812 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9ba19b52-1d4a-4b11-be3a-47dabac82569 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:04.240619 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9ba19b52-1d4a-4b11-be3a-47dabac82569 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:04.241053 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9ba19b52-1d4a-4b11-be3a-47dabac82569 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:04.384298 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9ba19b52-1d4a-4b11-be3a-47dabac82569 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:55:04.392512 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9ba19b52-1d4a-4b11-be3a-47dabac82569 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1675 microversion: 2.1 time: 0.165161 Jun 10 18:55:04.393083 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3881/7503] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:55:04 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:55:05.409723 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ccd5640c-f5a3-4f29-94a8-9adca4ed8056 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:55:05.411151 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ccd5640c-f5a3-4f29-94a8-9adca4ed8056 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:55:05.425365 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ccd5640c-f5a3-4f29-94a8-9adca4ed8056 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:05.425820 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ccd5640c-f5a3-4f29-94a8-9adca4ed8056 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:05.426601 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ccd5640c-f5a3-4f29-94a8-9adca4ed8056 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:05.427119 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ccd5640c-f5a3-4f29-94a8-9adca4ed8056 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:05.495365 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ccd5640c-f5a3-4f29-94a8-9adca4ed8056 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:55:05.504620 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ccd5640c-f5a3-4f29-94a8-9adca4ed8056 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 200 len: 1607 microversion: 2.1 time: 0.098803 Jun 10 18:55:05.505270 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3882/7504] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:55:05 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 1607 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:55:05.606480 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-c4f20f88-51e9-4d2b-8ce3-8330427b6480 req-ea414ed7-5fab-4570-a402-bdafb1f43c83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07deb4af-bbda-4469-9f0d-9ad15b54741b", "name": "network-vif-deleted", "tag": "669fbad3-45be-4d93-95c0-99b60e7323d2"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:55:05.618146 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-c4f20f88-51e9-4d2b-8ce3-8330427b6480 req-ea414ed7-5fab-4570-a402-bdafb1f43c83 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:05.618146 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-c4f20f88-51e9-4d2b-8ce3-8330427b6480 req-ea414ed7-5fab-4570-a402-bdafb1f43c83 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:05.627523 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-c4f20f88-51e9-4d2b-8ce3-8330427b6480 req-ea414ed7-5fab-4570-a402-bdafb1f43c83 service nova] Creating event network-vif-deleted:669fbad3-45be-4d93-95c0-99b60e7323d2 for instance 07deb4af-bbda-4469-9f0d-9ad15b54741b on chh2-master-2 Jun 10 18:55:05.632601 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-c4f20f88-51e9-4d2b-8ce3-8330427b6480 req-ea414ed7-5fab-4570-a402-bdafb1f43c83 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029870 Jun 10 18:55:05.633205 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3883/7505] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:55:06.523825 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2c13791c-2f7b-489a-a7ea-313edbf3f651 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:55:06.524578 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2c13791c-2f7b-489a-a7ea-313edbf3f651 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:55:06.531484 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c13791c-2f7b-489a-a7ea-313edbf3f651 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:06.531982 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c13791c-2f7b-489a-a7ea-313edbf3f651 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:06.532768 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c13791c-2f7b-489a-a7ea-313edbf3f651 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:06.533209 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c13791c-2f7b-489a-a7ea-313edbf3f651 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:06.546415 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-2c13791c-2f7b-489a-a7ea-313edbf3f651 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] HTTP exception thrown: Instance 07deb4af-bbda-4469-9f0d-9ad15b54741b could not be found. Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2c13791c-2f7b-489a-a7ea-313edbf3f651 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Request method failure captured: Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b HTTP/1.1 Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5NYWWZ-ZO6eUaowxYHvN17DzgOyBcRp8mhJxqDpqy8rItuzorWJTwSOIastREFRyZr6c_ChbS_L6xrOAOnpyFVpWaRIYnwPEIqz770DyDVvyPoXIV-sm8ojvCAplLeG2g6jr_K6WyMCpHhf5lcBOzewCyTTCZt4Q13c3it9lc4tPjc Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 9ee0edfe1ca545a18061642a775747b5 Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServerActionsTestJSON-1025700685 Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_9ee0edfe1ca545a18061642a775747b5", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServerActionsTestJSON-1025700685 Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 9ee0edfe1ca545a18061642a775747b5 Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServerActionsTestJSON-1025700685 Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServerActionsTestJSON-1025700685-project Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 9434d247ee1c4143bc2cf07b834417ea Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServerActionsTestJSON-1025700685-project Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 07deb4af-bbda-4469-9f0d-9ad15b54741b could not be found. Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '07deb4af-bbda-4469-9f0d-9ad15b54741b'} Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07deb4af-bbda-4469-9f0d-9ad15b54741b could not be found. Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07deb4af-bbda-4469-9f0d-9ad15b54741b could not be found. Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:55:06.548160 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:55:06.554022 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:55:06.554022 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:55:06.554022 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:55:06.554022 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:55:06.554022 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:55:06.554022 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07deb4af-bbda-4469-9f0d-9ad15b54741b could not be found. Jun 10 18:55:06.554022 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:55:06.554022 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2c13791c-2f7b-489a-a7ea-313edbf3f651 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Returning 404 to user: Instance 07deb4af-bbda-4469-9f0d-9ad15b54741b could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:55:06.554022 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2c13791c-2f7b-489a-a7ea-313edbf3f651 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 404 len: 111 microversion: 2.1 time: 0.030906 Jun 10 18:55:06.554022 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3884/7506] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:55:06 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:55:06.564218 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9560a12f-d49f-492e-8101-6f894118d1a9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:55:06.571482 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9560a12f-d49f-492e-8101-6f894118d1a9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:55:06.571482 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9560a12f-d49f-492e-8101-6f894118d1a9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:06.571705 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9560a12f-d49f-492e-8101-6f894118d1a9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:06.572483 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9560a12f-d49f-492e-8101-6f894118d1a9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:06.572920 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9560a12f-d49f-492e-8101-6f894118d1a9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:06.588198 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-9560a12f-d49f-492e-8101-6f894118d1a9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] HTTP exception thrown: Instance 07deb4af-bbda-4469-9f0d-9ad15b54741b could not be found. Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9560a12f-d49f-492e-8101-6f894118d1a9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Request method failure captured: Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b HTTP/1.1 Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5NYWWZ-ZO6eUaowxYHvN17DzgOyBcRp8mhJxqDpqy8rItuzorWJTwSOIastREFRyZr6c_ChbS_L6xrOAOnpyFVpWaRIYnwPEIqz770DyDVvyPoXIV-sm8ojvCAplLeG2g6jr_K6WyMCpHhf5lcBOzewCyTTCZt4Q13c3it9lc4tPjc Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 9ee0edfe1ca545a18061642a775747b5 Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServerActionsTestJSON-1025700685 Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_9ee0edfe1ca545a18061642a775747b5", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServerActionsTestJSON-1025700685 Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 9ee0edfe1ca545a18061642a775747b5 Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServerActionsTestJSON-1025700685 Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServerActionsTestJSON-1025700685-project Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 9434d247ee1c4143bc2cf07b834417ea Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServerActionsTestJSON-1025700685-project Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 07deb4af-bbda-4469-9f0d-9ad15b54741b could not be found. Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '07deb4af-bbda-4469-9f0d-9ad15b54741b'} Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07deb4af-bbda-4469-9f0d-9ad15b54741b could not be found. Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07deb4af-bbda-4469-9f0d-9ad15b54741b could not be found. Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:55:06.589876 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:55:06.595899 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:55:06.595899 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:55:06.595899 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:55:06.595899 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:55:06.595899 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:55:06.595899 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07deb4af-bbda-4469-9f0d-9ad15b54741b could not be found. Jun 10 18:55:06.595899 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:55:06.595899 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9560a12f-d49f-492e-8101-6f894118d1a9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Returning 404 to user: Instance 07deb4af-bbda-4469-9f0d-9ad15b54741b could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:55:06.595899 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9560a12f-d49f-492e-8101-6f894118d1a9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 404 len: 111 microversion: 2.1 time: 0.031049 Jun 10 18:55:06.595899 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3885/7507] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:55:06 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:55:06.643811 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-64ae44db-1f2e-4b67-9687-1e3072f8e695 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-126261709", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "0fb8209d-4273-43eb-a7e9-ab31438ebf09"}], "security_groups": [{"name": "tempest-securitygroup--1864491070"}], "key_name": "tempest-keypair-434241289", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:55:06.742319 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-64ae44db-1f2e-4b67-9687-1e3072f8e695 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] validate_networks() for [('0fb8209d-4273-43eb-a7e9-ab31438ebf09', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:55:07.100089 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-64ae44db-1f2e-4b67-9687-1e3072f8e695 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:55:07.100555 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-64ae44db-1f2e-4b67-9687-1e3072f8e695 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:55:07.101034 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-64ae44db-1f2e-4b67-9687-1e3072f8e695 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:55:07.101473 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-64ae44db-1f2e-4b67-9687-1e3072f8e695 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:55:07.101891 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-64ae44db-1f2e-4b67-9687-1e3072f8e695 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:55:07.111256 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-64ae44db-1f2e-4b67-9687-1e3072f8e695 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:07.111709 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-64ae44db-1f2e-4b67-9687-1e3072f8e695 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:07.112554 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-64ae44db-1f2e-4b67-9687-1e3072f8e695 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:07.112994 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-64ae44db-1f2e-4b67-9687-1e3072f8e695 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:07.130306 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-64ae44db-1f2e-4b67-9687-1e3072f8e695 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Getting quotas for project 9ee0edfe1ca545a18061642a775747b5. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:55:07.135487 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-64ae44db-1f2e-4b67-9687-1e3072f8e695 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Getting quotas for user 9434d247ee1c4143bc2cf07b834417ea and project 9ee0edfe1ca545a18061642a775747b5. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:55:07.151917 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-64ae44db-1f2e-4b67-9687-1e3072f8e695 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:55:07.154228 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-64ae44db-1f2e-4b67-9687-1e3072f8e695 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:55:07.278151 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-64ae44db-1f2e-4b67-9687-1e3072f8e695 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.638619 Jun 10 18:55:07.278803 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3886/7508] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:55:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 10 18:55:07.288838 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-981b9866-5e48-4768-ade9-bc2b96ff2cbd tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:55:07.289451 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-981b9866-5e48-4768-ade9-bc2b96ff2cbd tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:55:07.342644 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-981b9866-5e48-4768-ade9-bc2b96ff2cbd tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:55:07.350387 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-981b9866-5e48-4768-ade9-bc2b96ff2cbd tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1237 microversion: 2.1 time: 0.065361 Jun 10 18:55:07.350891 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3887/7509] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:55:07 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:55:08.368336 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d3ad8cb0-e3ec-4549-bd82-11e676175690 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:55:08.368986 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d3ad8cb0-e3ec-4549-bd82-11e676175690 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:55:08.375860 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d3ad8cb0-e3ec-4549-bd82-11e676175690 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:08.376332 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d3ad8cb0-e3ec-4549-bd82-11e676175690 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:08.386360 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d3ad8cb0-e3ec-4549-bd82-11e676175690 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:08.386360 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d3ad8cb0-e3ec-4549-bd82-11e676175690 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:08.445280 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d3ad8cb0-e3ec-4549-bd82-11e676175690 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:55:08.452892 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d3ad8cb0-e3ec-4549-bd82-11e676175690 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1233 microversion: 2.1 time: 0.088506 Jun 10 18:55:08.455070 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3888/7510] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:55:08 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1233 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:55:09.471670 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d90d0713-55c2-40e7-8bb4-2c8d95c4e67b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:55:09.472398 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d90d0713-55c2-40e7-8bb4-2c8d95c4e67b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:55:09.479143 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d90d0713-55c2-40e7-8bb4-2c8d95c4e67b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:09.479595 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d90d0713-55c2-40e7-8bb4-2c8d95c4e67b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:09.480449 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d90d0713-55c2-40e7-8bb4-2c8d95c4e67b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:09.480902 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d90d0713-55c2-40e7-8bb4-2c8d95c4e67b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:09.543710 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d90d0713-55c2-40e7-8bb4-2c8d95c4e67b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:55:09.551511 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d90d0713-55c2-40e7-8bb4-2c8d95c4e67b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1295 microversion: 2.1 time: 0.084324 Jun 10 18:55:09.552096 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3889/7511] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:55:09 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1295 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:55:10.568673 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c1897230-1712-4510-9d2e-53b1de8770f0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:55:10.569290 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c1897230-1712-4510-9d2e-53b1de8770f0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:55:10.576151 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c1897230-1712-4510-9d2e-53b1de8770f0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:10.576634 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c1897230-1712-4510-9d2e-53b1de8770f0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:10.577396 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c1897230-1712-4510-9d2e-53b1de8770f0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:10.577862 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c1897230-1712-4510-9d2e-53b1de8770f0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:10.717917 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c1897230-1712-4510-9d2e-53b1de8770f0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:55:10.726696 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c1897230-1712-4510-9d2e-53b1de8770f0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1363 microversion: 2.1 time: 0.161914 Jun 10 18:55:10.727421 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3890/7512] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:55:10 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:55:10.732549 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-5437e446-0f9c-49a4-8e41-9900688c2c0c req-8f0ca8bb-7528-4626-8119-8822563a2140 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f3177ac-baf5-4136-ad02-e52f23f46f68", "tag": "9b8ab821-406d-4c0a-ab03-8c5c98ac88e8"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:55:10.741793 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-5437e446-0f9c-49a4-8e41-9900688c2c0c req-8f0ca8bb-7528-4626-8119-8822563a2140 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:10.742324 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-5437e446-0f9c-49a4-8e41-9900688c2c0c req-8f0ca8bb-7528-4626-8119-8822563a2140 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:10.754109 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-5437e446-0f9c-49a4-8e41-9900688c2c0c req-8f0ca8bb-7528-4626-8119-8822563a2140 service nova] Creating event network-changed:9b8ab821-406d-4c0a-ab03-8c5c98ac88e8 for instance 8f3177ac-baf5-4136-ad02-e52f23f46f68 on chh1-master-2 Jun 10 18:55:10.759323 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-5437e446-0f9c-49a4-8e41-9900688c2c0c req-8f0ca8bb-7528-4626-8119-8822563a2140 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030693 Jun 10 18:55:10.760167 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3891/7513] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:55:11.746153 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-310522f4-e71a-4d6d-9923-30827e769f7a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:55:11.746798 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-310522f4-e71a-4d6d-9923-30827e769f7a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:55:11.753550 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-310522f4-e71a-4d6d-9923-30827e769f7a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:11.754002 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-310522f4-e71a-4d6d-9923-30827e769f7a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:11.754766 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-310522f4-e71a-4d6d-9923-30827e769f7a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:11.755207 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-310522f4-e71a-4d6d-9923-30827e769f7a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:11.885732 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-310522f4-e71a-4d6d-9923-30827e769f7a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:55:11.893449 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-310522f4-e71a-4d6d-9923-30827e769f7a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1363 microversion: 2.1 time: 0.152493 Jun 10 18:55:11.894022 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3892/7514] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:55:11 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:55:12.911299 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9991b795-a319-4b59-94b0-7de6e2e43fc4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:55:12.911909 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9991b795-a319-4b59-94b0-7de6e2e43fc4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:55:12.918887 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9991b795-a319-4b59-94b0-7de6e2e43fc4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:12.919337 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9991b795-a319-4b59-94b0-7de6e2e43fc4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:12.920091 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9991b795-a319-4b59-94b0-7de6e2e43fc4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:12.920562 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9991b795-a319-4b59-94b0-7de6e2e43fc4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:13.055081 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9991b795-a319-4b59-94b0-7de6e2e43fc4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:55:13.062994 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9991b795-a319-4b59-94b0-7de6e2e43fc4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1363 microversion: 2.1 time: 0.155469 Jun 10 18:55:13.067345 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3893/7515] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:55:12 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:55:14.080690 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7c13d386-f70c-4b3c-bbd6-9c63fe15014d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:55:14.081352 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7c13d386-f70c-4b3c-bbd6-9c63fe15014d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:55:14.088127 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7c13d386-f70c-4b3c-bbd6-9c63fe15014d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:14.088622 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7c13d386-f70c-4b3c-bbd6-9c63fe15014d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:14.089382 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7c13d386-f70c-4b3c-bbd6-9c63fe15014d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:14.089817 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7c13d386-f70c-4b3c-bbd6-9c63fe15014d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:14.221687 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7c13d386-f70c-4b3c-bbd6-9c63fe15014d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:55:14.229148 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7c13d386-f70c-4b3c-bbd6-9c63fe15014d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1363 microversion: 2.1 time: 0.152370 Jun 10 18:55:14.229723 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3894/7516] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:55:14 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:55:15.226769 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-ad176d33-ace2-410d-804f-7b041f2faeda req-498578e9-b524-4e0e-81b7-45d030dde068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f3177ac-baf5-4136-ad02-e52f23f46f68", "name": "network-vif-plugged", "status": "completed", "tag": "9b8ab821-406d-4c0a-ab03-8c5c98ac88e8"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:55:15.235989 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-ad176d33-ace2-410d-804f-7b041f2faeda req-498578e9-b524-4e0e-81b7-45d030dde068 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:15.236449 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-ad176d33-ace2-410d-804f-7b041f2faeda req-498578e9-b524-4e0e-81b7-45d030dde068 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:15.250525 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-ad176d33-ace2-410d-804f-7b041f2faeda req-498578e9-b524-4e0e-81b7-45d030dde068 service nova] Creating event network-vif-plugged:9b8ab821-406d-4c0a-ab03-8c5c98ac88e8 for instance 8f3177ac-baf5-4136-ad02-e52f23f46f68 on chh1-master-2 Jun 10 18:55:15.255354 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-ad176d33-ace2-410d-804f-7b041f2faeda req-498578e9-b524-4e0e-81b7-45d030dde068 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032287 Jun 10 18:55:15.257222 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3895/7517] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:55:15.261118 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0089edbc-0ea4-4825-9cdd-8dc6962d4403 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:55:15.261813 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0089edbc-0ea4-4825-9cdd-8dc6962d4403 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:55:15.268554 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0089edbc-0ea4-4825-9cdd-8dc6962d4403 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:15.269014 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0089edbc-0ea4-4825-9cdd-8dc6962d4403 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:15.269785 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0089edbc-0ea4-4825-9cdd-8dc6962d4403 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:15.270230 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0089edbc-0ea4-4825-9cdd-8dc6962d4403 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:15.405827 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0089edbc-0ea4-4825-9cdd-8dc6962d4403 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:55:15.413700 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0089edbc-0ea4-4825-9cdd-8dc6962d4403 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1363 microversion: 2.1 time: 0.156541 Jun 10 18:55:15.414489 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3896/7518] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:55:15 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:55:16.430989 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-38fb29eb-62c6-4d5b-99fd-e13336c73b10 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:55:16.431605 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-38fb29eb-62c6-4d5b-99fd-e13336c73b10 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:55:16.438571 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-38fb29eb-62c6-4d5b-99fd-e13336c73b10 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:16.439024 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-38fb29eb-62c6-4d5b-99fd-e13336c73b10 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:16.439782 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-38fb29eb-62c6-4d5b-99fd-e13336c73b10 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:16.440224 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-38fb29eb-62c6-4d5b-99fd-e13336c73b10 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:16.567082 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-38fb29eb-62c6-4d5b-99fd-e13336c73b10 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:55:16.574811 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-38fb29eb-62c6-4d5b-99fd-e13336c73b10 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1363 microversion: 2.1 time: 0.147612 Jun 10 18:55:16.575397 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3897/7519] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:55:16 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:55:17.592722 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9ccff1c9-4455-425b-88d8-4c8024d4004b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:55:17.593355 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9ccff1c9-4455-425b-88d8-4c8024d4004b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:55:17.595330 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:55:17.596032 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=8 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:55:17.601679 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9ccff1c9-4455-425b-88d8-4c8024d4004b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:17.602143 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9ccff1c9-4455-425b-88d8-4c8024d4004b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:17.602908 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9ccff1c9-4455-425b-88d8-4c8024d4004b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:17.603355 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9ccff1c9-4455-425b-88d8-4c8024d4004b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:17.737114 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9ccff1c9-4455-425b-88d8-4c8024d4004b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:55:17.746263 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9ccff1c9-4455-425b-88d8-4c8024d4004b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1550 microversion: 2.1 time: 0.157448 Jun 10 18:55:17.746841 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3898/7520] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:55:17 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1550 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:55:17.764064 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4b262db8-0a8a-4e41-ac2d-bc9e51cb009c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:55:17.764623 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4b262db8-0a8a-4e41-ac2d-bc9e51cb009c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:55:17.766438 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:55:17.771273 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4b262db8-0a8a-4e41-ac2d-bc9e51cb009c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:17.771731 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4b262db8-0a8a-4e41-ac2d-bc9e51cb009c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:17.772544 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4b262db8-0a8a-4e41-ac2d-bc9e51cb009c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:17.772998 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4b262db8-0a8a-4e41-ac2d-bc9e51cb009c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:17.787559 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:55:17.851159 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4b262db8-0a8a-4e41-ac2d-bc9e51cb009c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090997 Jun 10 18:55:17.851762 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3899/7521] 10.222.0.35 () {58 vars in 1274 bytes} [Fri Jun 10 18:55:17 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:55:19.126401 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-bf51a041-0150-4a8f-a0a7-93763326976e req-b4ed21af-d895-492d-80da-816a5ab34205 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f3177ac-baf5-4136-ad02-e52f23f46f68", "tag": "9b8ab821-406d-4c0a-ab03-8c5c98ac88e8"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:55:19.135977 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-bf51a041-0150-4a8f-a0a7-93763326976e req-b4ed21af-d895-492d-80da-816a5ab34205 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:19.136446 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-bf51a041-0150-4a8f-a0a7-93763326976e req-b4ed21af-d895-492d-80da-816a5ab34205 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:19.147589 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-bf51a041-0150-4a8f-a0a7-93763326976e req-b4ed21af-d895-492d-80da-816a5ab34205 service nova] Creating event network-changed:9b8ab821-406d-4c0a-ab03-8c5c98ac88e8 for instance 8f3177ac-baf5-4136-ad02-e52f23f46f68 on chh1-master-2 Jun 10 18:55:19.152425 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-bf51a041-0150-4a8f-a0a7-93763326976e req-b4ed21af-d895-492d-80da-816a5ab34205 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031614 Jun 10 18:55:19.153029 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3900/7522] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:55:55.502914 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1940f89f-af5b-4956-8fb3-74222af16d11 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:55:55.510461 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1940f89f-af5b-4956-8fb3-74222af16d11 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:55.510913 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1940f89f-af5b-4956-8fb3-74222af16d11 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:55.533304 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1940f89f-af5b-4956-8fb3-74222af16d11 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Going to try to stop instance {{(pid=126595) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 10 18:55:55.771303 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1940f89f-af5b-4956-8fb3-74222af16d11 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "POST /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68/action" status: 202 len: 0 microversion: 2.1 time: 0.273975 Jun 10 18:55:55.771915 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3901/7523] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:55:55 2022] POST /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 18:55:55.780219 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a5f3c167-d296-46ed-8469-619b6c16388e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:55:55.780957 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a5f3c167-d296-46ed-8469-619b6c16388e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:55:55.787829 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a5f3c167-d296-46ed-8469-619b6c16388e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:55.788291 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a5f3c167-d296-46ed-8469-619b6c16388e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:55.789080 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a5f3c167-d296-46ed-8469-619b6c16388e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:55.789520 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a5f3c167-d296-46ed-8469-619b6c16388e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:56.071942 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a5f3c167-d296-46ed-8469-619b6c16388e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:55:56.080058 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a5f3c167-d296-46ed-8469-619b6c16388e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1679 microversion: 2.1 time: 0.303876 Jun 10 18:55:56.080654 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3902/7524] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:55:55 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1679 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:55:57.097898 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-73e6a284-d4a9-43d0-84e6-a3c6e2e6ab0a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:55:57.098860 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-73e6a284-d4a9-43d0-84e6-a3c6e2e6ab0a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:55:57.106297 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-73e6a284-d4a9-43d0-84e6-a3c6e2e6ab0a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:57.110451 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-73e6a284-d4a9-43d0-84e6-a3c6e2e6ab0a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:57.110451 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-73e6a284-d4a9-43d0-84e6-a3c6e2e6ab0a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:57.110451 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-73e6a284-d4a9-43d0-84e6-a3c6e2e6ab0a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:57.248116 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-73e6a284-d4a9-43d0-84e6-a3c6e2e6ab0a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:55:57.256042 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-73e6a284-d4a9-43d0-84e6-a3c6e2e6ab0a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1679 microversion: 2.1 time: 0.162410 Jun 10 18:55:57.256654 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3903/7525] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:55:57 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:55:58.274073 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-05952f25-2d8d-43f7-a43e-47e80abd7713 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:55:58.274767 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-05952f25-2d8d-43f7-a43e-47e80abd7713 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:55:58.281465 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05952f25-2d8d-43f7-a43e-47e80abd7713 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:58.285776 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05952f25-2d8d-43f7-a43e-47e80abd7713 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:58.285776 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05952f25-2d8d-43f7-a43e-47e80abd7713 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:58.285776 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05952f25-2d8d-43f7-a43e-47e80abd7713 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:58.413939 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-05952f25-2d8d-43f7-a43e-47e80abd7713 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:55:58.422370 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-05952f25-2d8d-43f7-a43e-47e80abd7713 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1679 microversion: 2.1 time: 0.151578 Jun 10 18:55:58.422954 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3904/7526] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:55:58 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:55:59.439628 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-eafec9ac-119c-4647-bfc3-26724042ad94 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:55:59.440269 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-eafec9ac-119c-4647-bfc3-26724042ad94 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:55:59.447254 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eafec9ac-119c-4647-bfc3-26724042ad94 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:59.447705 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eafec9ac-119c-4647-bfc3-26724042ad94 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:59.448507 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eafec9ac-119c-4647-bfc3-26724042ad94 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:55:59.448948 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eafec9ac-119c-4647-bfc3-26724042ad94 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:55:59.577933 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-eafec9ac-119c-4647-bfc3-26724042ad94 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:55:59.585393 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-eafec9ac-119c-4647-bfc3-26724042ad94 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1679 microversion: 2.1 time: 0.150184 Jun 10 18:55:59.585971 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3905/7527] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:55:59 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:56:00.602354 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bc022d47-7fdd-405a-9091-65a3271de18e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:00.603130 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bc022d47-7fdd-405a-9091-65a3271de18e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:00.609963 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bc022d47-7fdd-405a-9091-65a3271de18e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:00.610421 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bc022d47-7fdd-405a-9091-65a3271de18e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:00.611187 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bc022d47-7fdd-405a-9091-65a3271de18e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:00.611628 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bc022d47-7fdd-405a-9091-65a3271de18e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:00.741969 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bc022d47-7fdd-405a-9091-65a3271de18e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:56:00.749660 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bc022d47-7fdd-405a-9091-65a3271de18e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1679 microversion: 2.1 time: 0.151222 Jun 10 18:56:00.750741 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3906/7528] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:56:00 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:56:01.767849 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-aa033aa1-243c-4dd0-bb0e-98e0d4377015 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:01.768549 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-aa033aa1-243c-4dd0-bb0e-98e0d4377015 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:01.775349 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aa033aa1-243c-4dd0-bb0e-98e0d4377015 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:01.775803 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aa033aa1-243c-4dd0-bb0e-98e0d4377015 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:01.776592 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aa033aa1-243c-4dd0-bb0e-98e0d4377015 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:01.777028 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aa033aa1-243c-4dd0-bb0e-98e0d4377015 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:01.906690 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-aa033aa1-243c-4dd0-bb0e-98e0d4377015 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:56:01.914280 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-aa033aa1-243c-4dd0-bb0e-98e0d4377015 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1679 microversion: 2.1 time: 0.150342 Jun 10 18:56:01.914847 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3907/7529] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:56:01 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:56:02.931152 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e30cbce0-2bee-4427-ad75-5dd8cbd7adf6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:02.931668 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e30cbce0-2bee-4427-ad75-5dd8cbd7adf6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:02.939064 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e30cbce0-2bee-4427-ad75-5dd8cbd7adf6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:02.939409 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e30cbce0-2bee-4427-ad75-5dd8cbd7adf6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:02.940204 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e30cbce0-2bee-4427-ad75-5dd8cbd7adf6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:02.940683 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e30cbce0-2bee-4427-ad75-5dd8cbd7adf6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:03.072854 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e30cbce0-2bee-4427-ad75-5dd8cbd7adf6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:56:03.080787 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e30cbce0-2bee-4427-ad75-5dd8cbd7adf6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1679 microversion: 2.1 time: 0.153694 Jun 10 18:56:03.081362 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3908/7530] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:56:02 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:56:04.098021 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b5c01edf-5cda-4013-9071-8136453e5be7 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:04.098725 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b5c01edf-5cda-4013-9071-8136453e5be7 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:04.105781 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5c01edf-5cda-4013-9071-8136453e5be7 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:04.106239 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5c01edf-5cda-4013-9071-8136453e5be7 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:04.107012 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5c01edf-5cda-4013-9071-8136453e5be7 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:04.107459 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5c01edf-5cda-4013-9071-8136453e5be7 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:04.246571 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b5c01edf-5cda-4013-9071-8136453e5be7 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:56:04.254669 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b5c01edf-5cda-4013-9071-8136453e5be7 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1679 microversion: 2.1 time: 0.160609 Jun 10 18:56:04.255253 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3909/7531] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:56:04 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:56:05.272355 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-52f6c1ec-658b-43b1-87e1-ed195079cc32 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:05.273035 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-52f6c1ec-658b-43b1-87e1-ed195079cc32 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:05.279952 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-52f6c1ec-658b-43b1-87e1-ed195079cc32 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:05.280449 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-52f6c1ec-658b-43b1-87e1-ed195079cc32 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:05.281230 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-52f6c1ec-658b-43b1-87e1-ed195079cc32 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:05.281671 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-52f6c1ec-658b-43b1-87e1-ed195079cc32 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:05.413375 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-52f6c1ec-658b-43b1-87e1-ed195079cc32 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:56:05.421529 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-52f6c1ec-658b-43b1-87e1-ed195079cc32 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1679 microversion: 2.1 time: 0.153031 Jun 10 18:56:05.422111 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3910/7532] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:56:05 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:56:06.439233 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-23f31d4e-b4c8-4bf5-a653-e392d57c691e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:06.439843 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-23f31d4e-b4c8-4bf5-a653-e392d57c691e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:06.446915 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-23f31d4e-b4c8-4bf5-a653-e392d57c691e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:06.447365 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-23f31d4e-b4c8-4bf5-a653-e392d57c691e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:06.448150 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-23f31d4e-b4c8-4bf5-a653-e392d57c691e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:06.448612 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-23f31d4e-b4c8-4bf5-a653-e392d57c691e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:06.580212 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-23f31d4e-b4c8-4bf5-a653-e392d57c691e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:56:06.587848 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-23f31d4e-b4c8-4bf5-a653-e392d57c691e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1679 microversion: 2.1 time: 0.153121 Jun 10 18:56:06.588442 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3911/7533] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:56:06 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:56:07.604968 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fed6b0fe-248a-408a-8d34-fabb395a6fc6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:07.605615 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fed6b0fe-248a-408a-8d34-fabb395a6fc6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:07.612662 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fed6b0fe-248a-408a-8d34-fabb395a6fc6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:07.613107 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fed6b0fe-248a-408a-8d34-fabb395a6fc6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:07.613864 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fed6b0fe-248a-408a-8d34-fabb395a6fc6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:07.614298 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fed6b0fe-248a-408a-8d34-fabb395a6fc6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:07.741546 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fed6b0fe-248a-408a-8d34-fabb395a6fc6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:56:07.749011 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fed6b0fe-248a-408a-8d34-fabb395a6fc6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1679 microversion: 2.1 time: 0.147908 Jun 10 18:56:07.750111 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3912/7534] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:56:07 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:56:08.767117 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5a7a6995-7b44-4b5b-beee-42befd7d7b65 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:08.874709 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5a7a6995-7b44-4b5b-beee-42befd7d7b65 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:08.874709 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5a7a6995-7b44-4b5b-beee-42befd7d7b65 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:08.874709 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5a7a6995-7b44-4b5b-beee-42befd7d7b65 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:08.874709 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5a7a6995-7b44-4b5b-beee-42befd7d7b65 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:08.874709 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5a7a6995-7b44-4b5b-beee-42befd7d7b65 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:08.918804 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5a7a6995-7b44-4b5b-beee-42befd7d7b65 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:56:08.926342 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5a7a6995-7b44-4b5b-beee-42befd7d7b65 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1679 microversion: 2.1 time: 0.163296 Jun 10 18:56:08.926916 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3913/7535] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:56:08 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:56:09.945170 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a90134be-8b33-4018-bbd0-af7b118f7f51 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:09.945926 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a90134be-8b33-4018-bbd0-af7b118f7f51 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:09.954240 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a90134be-8b33-4018-bbd0-af7b118f7f51 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:09.954818 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a90134be-8b33-4018-bbd0-af7b118f7f51 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:09.955794 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a90134be-8b33-4018-bbd0-af7b118f7f51 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:09.956253 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a90134be-8b33-4018-bbd0-af7b118f7f51 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:10.101139 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a90134be-8b33-4018-bbd0-af7b118f7f51 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:56:10.108697 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a90134be-8b33-4018-bbd0-af7b118f7f51 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1679 microversion: 2.1 time: 0.168474 Jun 10 18:56:10.109782 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3914/7536] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:56:09 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:56:11.126500 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ae4b8700-b8a7-40aa-af78-39591e0345c4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:11.127155 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ae4b8700-b8a7-40aa-af78-39591e0345c4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:11.134094 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ae4b8700-b8a7-40aa-af78-39591e0345c4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:11.134805 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ae4b8700-b8a7-40aa-af78-39591e0345c4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:11.135567 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ae4b8700-b8a7-40aa-af78-39591e0345c4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:11.136008 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ae4b8700-b8a7-40aa-af78-39591e0345c4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:11.281395 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ae4b8700-b8a7-40aa-af78-39591e0345c4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:56:11.288965 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ae4b8700-b8a7-40aa-af78-39591e0345c4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1679 microversion: 2.1 time: 0.166328 Jun 10 18:56:11.289536 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3915/7537] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:56:11 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:56:12.306142 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e04d1375-5428-4879-abef-658f5bf4cacf tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:12.306840 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e04d1375-5428-4879-abef-658f5bf4cacf tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:12.313340 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e04d1375-5428-4879-abef-658f5bf4cacf tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:12.313790 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e04d1375-5428-4879-abef-658f5bf4cacf tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:12.314550 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e04d1375-5428-4879-abef-658f5bf4cacf tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:12.314987 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e04d1375-5428-4879-abef-658f5bf4cacf tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:12.319237 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:56:12.444576 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e04d1375-5428-4879-abef-658f5bf4cacf tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:56:12.452033 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e04d1375-5428-4879-abef-658f5bf4cacf tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1656 microversion: 2.1 time: 0.149855 Jun 10 18:56:12.453202 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3916/7538] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:56:12 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1656 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:56:12.468881 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-91120773-7ae4-47ca-ba0a-114a1fa43fec tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:56:12.469831 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-91120773-7ae4-47ca-ba0a-114a1fa43fec tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:12.475441 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-91120773-7ae4-47ca-ba0a-114a1fa43fec tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:12.475888 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-91120773-7ae4-47ca-ba0a-114a1fa43fec tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:12.476664 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-91120773-7ae4-47ca-ba0a-114a1fa43fec tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:12.477101 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-91120773-7ae4-47ca-ba0a-114a1fa43fec tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:12.504738 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-91120773-7ae4-47ca-ba0a-114a1fa43fec tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:56:12.510741 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-91120773-7ae4-47ca-ba0a-114a1fa43fec tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Old instance type m1.heat2, new instance type m1.heat {{(pid=126595) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 10 18:56:12.517383 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-91120773-7ae4-47ca-ba0a-114a1fa43fec tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:56:12.517844 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-91120773-7ae4-47ca-ba0a-114a1fa43fec tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:56:12.518322 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-91120773-7ae4-47ca-ba0a-114a1fa43fec tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:56:12.518735 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-91120773-7ae4-47ca-ba0a-114a1fa43fec tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:56:12.519151 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-91120773-7ae4-47ca-ba0a-114a1fa43fec tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:56:12.707274 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-91120773-7ae4-47ca-ba0a-114a1fa43fec tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "POST /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68/action" status: 202 len: 0 microversion: 2.1 time: 0.242397 Jun 10 18:56:12.707810 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3917/7539] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:56:12 2022] POST /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 18:56:12.715616 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a33c0100-38c0-4a32-9e60-f6fbdf5b2521 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:12.716227 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a33c0100-38c0-4a32-9e60-f6fbdf5b2521 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:12.722562 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a33c0100-38c0-4a32-9e60-f6fbdf5b2521 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:12.725607 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a33c0100-38c0-4a32-9e60-f6fbdf5b2521 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:12.725607 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a33c0100-38c0-4a32-9e60-f6fbdf5b2521 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:12.725607 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a33c0100-38c0-4a32-9e60-f6fbdf5b2521 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:12.852211 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a33c0100-38c0-4a32-9e60-f6fbdf5b2521 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:56:12.859838 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a33c0100-38c0-4a32-9e60-f6fbdf5b2521 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1679 microversion: 2.1 time: 0.147896 Jun 10 18:56:12.863283 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3918/7540] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:56:12 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:56:13.878536 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d647861d-3b7d-470d-993f-24b8bcde68e1 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:13.879282 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d647861d-3b7d-470d-993f-24b8bcde68e1 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:13.885524 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d647861d-3b7d-470d-993f-24b8bcde68e1 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:13.886441 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d647861d-3b7d-470d-993f-24b8bcde68e1 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:13.887204 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d647861d-3b7d-470d-993f-24b8bcde68e1 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:13.887644 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d647861d-3b7d-470d-993f-24b8bcde68e1 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:14.018364 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d647861d-3b7d-470d-993f-24b8bcde68e1 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:56:14.025939 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d647861d-3b7d-470d-993f-24b8bcde68e1 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1679 microversion: 2.1 time: 0.152606 Jun 10 18:56:14.027992 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3919/7541] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:56:13 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:56:15.043394 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9782e894-ac88-407e-8776-30357dd376ac tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:15.044079 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9782e894-ac88-407e-8776-30357dd376ac tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:15.051993 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9782e894-ac88-407e-8776-30357dd376ac tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:15.052478 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9782e894-ac88-407e-8776-30357dd376ac tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:15.053248 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9782e894-ac88-407e-8776-30357dd376ac tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:15.053689 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9782e894-ac88-407e-8776-30357dd376ac tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:15.184796 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9782e894-ac88-407e-8776-30357dd376ac tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:56:15.192584 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9782e894-ac88-407e-8776-30357dd376ac tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1679 microversion: 2.1 time: 0.153094 Jun 10 18:56:15.193504 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3920/7542] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:56:15 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:56:16.210108 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9f657272-e825-4d6d-b5d9-710b2ffaa802 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:16.210756 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9f657272-e825-4d6d-b5d9-710b2ffaa802 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:16.217807 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f657272-e825-4d6d-b5d9-710b2ffaa802 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:16.218267 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f657272-e825-4d6d-b5d9-710b2ffaa802 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:16.219034 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f657272-e825-4d6d-b5d9-710b2ffaa802 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:16.219479 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f657272-e825-4d6d-b5d9-710b2ffaa802 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:16.353176 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9f657272-e825-4d6d-b5d9-710b2ffaa802 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:56:16.361223 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9f657272-e825-4d6d-b5d9-710b2ffaa802 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1684 microversion: 2.1 time: 0.155072 Jun 10 18:56:16.361789 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3921/7543] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:56:16 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:56:17.379029 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-266564b9-7566-4135-98d0-a5af31221646 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:17.379717 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-266564b9-7566-4135-98d0-a5af31221646 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:17.387148 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-266564b9-7566-4135-98d0-a5af31221646 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:17.387599 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-266564b9-7566-4135-98d0-a5af31221646 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:17.388386 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-266564b9-7566-4135-98d0-a5af31221646 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:17.388827 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-266564b9-7566-4135-98d0-a5af31221646 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:17.522730 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-266564b9-7566-4135-98d0-a5af31221646 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:56:17.531084 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-266564b9-7566-4135-98d0-a5af31221646 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1684 microversion: 2.1 time: 0.156737 Jun 10 18:56:17.531665 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3922/7544] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:56:17 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:56:18.548048 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fb852f9a-d18e-49d1-baa5-e46b98cb01e3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:18.554034 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fb852f9a-d18e-49d1-baa5-e46b98cb01e3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:18.555525 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fb852f9a-d18e-49d1-baa5-e46b98cb01e3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:18.555985 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fb852f9a-d18e-49d1-baa5-e46b98cb01e3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:18.556785 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fb852f9a-d18e-49d1-baa5-e46b98cb01e3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:18.557229 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fb852f9a-d18e-49d1-baa5-e46b98cb01e3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:18.731832 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fb852f9a-d18e-49d1-baa5-e46b98cb01e3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:56:18.731832 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fb852f9a-d18e-49d1-baa5-e46b98cb01e3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1683 microversion: 2.1 time: 0.162592 Jun 10 18:56:18.731832 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3923/7545] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:56:18 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:56:18.775008 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-1c9e7223-0bf6-4639-8cee-bed98dbf9194 req-8ff91c0d-10c1-483b-afcc-6201eef927ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f3177ac-baf5-4136-ad02-e52f23f46f68", "name": "network-vif-unplugged", "status": "completed", "tag": "9b8ab821-406d-4c0a-ab03-8c5c98ac88e8"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:56:18.784495 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-1c9e7223-0bf6-4639-8cee-bed98dbf9194 req-8ff91c0d-10c1-483b-afcc-6201eef927ae service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:18.784960 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-1c9e7223-0bf6-4639-8cee-bed98dbf9194 req-8ff91c0d-10c1-483b-afcc-6201eef927ae service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:18.798312 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-1c9e7223-0bf6-4639-8cee-bed98dbf9194 req-8ff91c0d-10c1-483b-afcc-6201eef927ae service nova] Creating event network-vif-unplugged:9b8ab821-406d-4c0a-ab03-8c5c98ac88e8 for instance 8f3177ac-baf5-4136-ad02-e52f23f46f68 on chh2-master-2 Jun 10 18:56:18.804913 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [req-1c9e7223-0bf6-4639-8cee-bed98dbf9194 req-8ff91c0d-10c1-483b-afcc-6201eef927ae service nova] Instance 8f3177ac-baf5-4136-ad02-e52f23f46f68 is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 18:56:18.817572 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-1c9e7223-0bf6-4639-8cee-bed98dbf9194 req-8ff91c0d-10c1-483b-afcc-6201eef927ae service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108833 Jun 10 18:56:18.818831 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3924/7546] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:56:19.725168 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e670f009-1950-4bfe-bcc5-cd76b000c347 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:19.725835 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e670f009-1950-4bfe-bcc5-cd76b000c347 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:19.732892 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e670f009-1950-4bfe-bcc5-cd76b000c347 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:19.733343 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e670f009-1950-4bfe-bcc5-cd76b000c347 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:19.734706 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e670f009-1950-4bfe-bcc5-cd76b000c347 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:19.735169 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e670f009-1950-4bfe-bcc5-cd76b000c347 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:19.882576 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e670f009-1950-4bfe-bcc5-cd76b000c347 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:56:19.891008 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e670f009-1950-4bfe-bcc5-cd76b000c347 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1683 microversion: 2.1 time: 0.169822 Jun 10 18:56:19.891564 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3925/7547] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:56:19 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:56:20.831812 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-fd9df97a-3556-46bb-a0f1-2ee8011a3a7f req-bc30fb6b-8ab9-47ca-9b12-e5dba507d7de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f3177ac-baf5-4136-ad02-e52f23f46f68", "tag": "9b8ab821-406d-4c0a-ab03-8c5c98ac88e8"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:56:20.840709 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-fd9df97a-3556-46bb-a0f1-2ee8011a3a7f req-bc30fb6b-8ab9-47ca-9b12-e5dba507d7de service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:20.841159 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-fd9df97a-3556-46bb-a0f1-2ee8011a3a7f req-bc30fb6b-8ab9-47ca-9b12-e5dba507d7de service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:20.852596 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-fd9df97a-3556-46bb-a0f1-2ee8011a3a7f req-bc30fb6b-8ab9-47ca-9b12-e5dba507d7de service nova] Creating event network-changed:9b8ab821-406d-4c0a-ab03-8c5c98ac88e8 for instance 8f3177ac-baf5-4136-ad02-e52f23f46f68 on chh2-master-2 Jun 10 18:56:20.857826 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [req-fd9df97a-3556-46bb-a0f1-2ee8011a3a7f req-bc30fb6b-8ab9-47ca-9b12-e5dba507d7de service nova] Instance 8f3177ac-baf5-4136-ad02-e52f23f46f68 is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 18:56:20.868719 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-fd9df97a-3556-46bb-a0f1-2ee8011a3a7f req-bc30fb6b-8ab9-47ca-9b12-e5dba507d7de service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040516 Jun 10 18:56:20.869297 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3926/7548] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:56:20.909166 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-31126dc9-0965-49d6-8d2f-069205a1448f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:20.909861 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-31126dc9-0965-49d6-8d2f-069205a1448f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:20.915996 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-31126dc9-0965-49d6-8d2f-069205a1448f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:20.916479 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-31126dc9-0965-49d6-8d2f-069205a1448f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:20.917245 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-31126dc9-0965-49d6-8d2f-069205a1448f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:20.917683 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-31126dc9-0965-49d6-8d2f-069205a1448f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:21.054015 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-31126dc9-0965-49d6-8d2f-069205a1448f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:56:21.061624 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-31126dc9-0965-49d6-8d2f-069205a1448f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1681 microversion: 2.1 time: 0.157255 Jun 10 18:56:21.062208 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3927/7549] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:56:20 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:56:22.078945 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0a019ade-5073-446a-8992-a543e802932a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:22.079638 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0a019ade-5073-446a-8992-a543e802932a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:22.086453 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0a019ade-5073-446a-8992-a543e802932a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:22.086904 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0a019ade-5073-446a-8992-a543e802932a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:22.087670 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0a019ade-5073-446a-8992-a543e802932a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:22.088111 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0a019ade-5073-446a-8992-a543e802932a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:22.218570 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0a019ade-5073-446a-8992-a543e802932a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:56:22.226083 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0a019ade-5073-446a-8992-a543e802932a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1681 microversion: 2.1 time: 0.151033 Jun 10 18:56:22.226657 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3928/7550] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:56:22 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:56:23.242936 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8bd7029e-2464-4402-99cb-7c5c7e5bd32e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:23.243596 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8bd7029e-2464-4402-99cb-7c5c7e5bd32e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:23.251143 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8bd7029e-2464-4402-99cb-7c5c7e5bd32e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:23.251593 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8bd7029e-2464-4402-99cb-7c5c7e5bd32e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:23.252379 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8bd7029e-2464-4402-99cb-7c5c7e5bd32e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:23.252818 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8bd7029e-2464-4402-99cb-7c5c7e5bd32e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:23.385218 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8bd7029e-2464-4402-99cb-7c5c7e5bd32e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:56:23.393731 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8bd7029e-2464-4402-99cb-7c5c7e5bd32e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1677 microversion: 2.1 time: 0.154528 Jun 10 18:56:23.404403 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3929/7551] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:56:23 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:56:23.410434 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a4631894-eb5a-4e0b-b794-2627aac33bd0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:56:23.410970 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a4631894-eb5a-4e0b-b794-2627aac33bd0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:23.418077 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a4631894-eb5a-4e0b-b794-2627aac33bd0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:23.418629 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a4631894-eb5a-4e0b-b794-2627aac33bd0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:23.419857 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a4631894-eb5a-4e0b-b794-2627aac33bd0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:23.420189 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a4631894-eb5a-4e0b-b794-2627aac33bd0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:23.568706 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:56:23.685268 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a4631894-eb5a-4e0b-b794-2627aac33bd0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "POST /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68/action" status: 204 len: 0 microversion: 2.1 time: 0.278431 Jun 10 18:56:23.685922 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3930/7552] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:56:23 2022] POST /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68/action => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 18:56:23.694734 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5743910a-7e18-475a-bc0f-ae9f33b7abd6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:23.695439 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5743910a-7e18-475a-bc0f-ae9f33b7abd6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:23.701710 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5743910a-7e18-475a-bc0f-ae9f33b7abd6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:23.702165 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5743910a-7e18-475a-bc0f-ae9f33b7abd6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:23.702934 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5743910a-7e18-475a-bc0f-ae9f33b7abd6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:23.703374 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5743910a-7e18-475a-bc0f-ae9f33b7abd6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:23.841532 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5743910a-7e18-475a-bc0f-ae9f33b7abd6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:56:23.849513 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5743910a-7e18-475a-bc0f-ae9f33b7abd6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1677 microversion: 2.1 time: 0.158727 Jun 10 18:56:23.854821 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3931/7553] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:56:23 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:56:24.866974 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-48fa0ecb-b321-4afd-ba1c-ce15f88e7fda tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:24.867693 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-48fa0ecb-b321-4afd-ba1c-ce15f88e7fda tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:24.875250 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-48fa0ecb-b321-4afd-ba1c-ce15f88e7fda tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:24.875769 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-48fa0ecb-b321-4afd-ba1c-ce15f88e7fda tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:24.876970 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-48fa0ecb-b321-4afd-ba1c-ce15f88e7fda tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:24.877090 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-48fa0ecb-b321-4afd-ba1c-ce15f88e7fda tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:25.009647 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-48fa0ecb-b321-4afd-ba1c-ce15f88e7fda tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:56:25.019306 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-48fa0ecb-b321-4afd-ba1c-ce15f88e7fda tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1677 microversion: 2.1 time: 0.156199 Jun 10 18:56:25.019893 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3932/7554] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:56:24 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:56:25.443098 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-090c52f7-ed6b-46ef-99e5-e9fb5cb9f8e4 req-86b8fe6a-e2b7-4810-a8f0-d27b90845e60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f3177ac-baf5-4136-ad02-e52f23f46f68", "name": "network-vif-plugged", "status": "completed", "tag": "9b8ab821-406d-4c0a-ab03-8c5c98ac88e8"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:56:25.451218 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-090c52f7-ed6b-46ef-99e5-e9fb5cb9f8e4 req-86b8fe6a-e2b7-4810-a8f0-d27b90845e60 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:25.451662 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-090c52f7-ed6b-46ef-99e5-e9fb5cb9f8e4 req-86b8fe6a-e2b7-4810-a8f0-d27b90845e60 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:25.462393 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-090c52f7-ed6b-46ef-99e5-e9fb5cb9f8e4 req-86b8fe6a-e2b7-4810-a8f0-d27b90845e60 service nova] Creating event network-vif-plugged:9b8ab821-406d-4c0a-ab03-8c5c98ac88e8 for instance 8f3177ac-baf5-4136-ad02-e52f23f46f68 on chh2-master-2 Jun 10 18:56:25.469267 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-090c52f7-ed6b-46ef-99e5-e9fb5cb9f8e4 req-86b8fe6a-e2b7-4810-a8f0-d27b90845e60 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080229 Jun 10 18:56:25.470051 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3933/7555] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:56:26.037827 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-be7753f0-0a7e-4330-abc3-3af4863266d9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:26.038526 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-be7753f0-0a7e-4330-abc3-3af4863266d9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:26.041256 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=74 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:56:26.046134 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-be7753f0-0a7e-4330-abc3-3af4863266d9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:26.046584 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-be7753f0-0a7e-4330-abc3-3af4863266d9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:26.047337 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-be7753f0-0a7e-4330-abc3-3af4863266d9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:26.047774 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-be7753f0-0a7e-4330-abc3-3af4863266d9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:26.183308 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-be7753f0-0a7e-4330-abc3-3af4863266d9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:56:26.191393 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-be7753f0-0a7e-4330-abc3-3af4863266d9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1656 microversion: 2.1 time: 0.157770 Jun 10 18:56:26.191961 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3934/7556] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:56:26 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1656 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:56:26.207971 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7bcd9637-f550-479c-baf8-edaa7a4ba225 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:26.209207 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7bcd9637-f550-479c-baf8-edaa7a4ba225 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:26.215425 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7bcd9637-f550-479c-baf8-edaa7a4ba225 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:26.215875 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7bcd9637-f550-479c-baf8-edaa7a4ba225 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:26.216672 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7bcd9637-f550-479c-baf8-edaa7a4ba225 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:26.217183 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7bcd9637-f550-479c-baf8-edaa7a4ba225 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:26.343702 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7bcd9637-f550-479c-baf8-edaa7a4ba225 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:56:26.351305 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7bcd9637-f550-479c-baf8-edaa7a4ba225 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1656 microversion: 2.1 time: 0.146989 Jun 10 18:56:26.351876 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3935/7557] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:56:26 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1656 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:56:26.367057 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-826583c7-ec9b-4275-a229-c7aa6450a8a8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:56:26.372777 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-826583c7-ec9b-4275-a229-c7aa6450a8a8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:26.373230 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-826583c7-ec9b-4275-a229-c7aa6450a8a8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:26.396450 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-826583c7-ec9b-4275-a229-c7aa6450a8a8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Going to try to start instance {{(pid=126595) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 10 18:56:26.568486 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-826583c7-ec9b-4275-a229-c7aa6450a8a8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "POST /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68/action" status: 202 len: 0 microversion: 2.1 time: 0.204698 Jun 10 18:56:26.569132 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3936/7558] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:56:26 2022] POST /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 18:56:26.577603 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dd19c6c3-337f-4fa6-86ca-229eb8506ba6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:26.578300 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dd19c6c3-337f-4fa6-86ca-229eb8506ba6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:26.584610 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd19c6c3-337f-4fa6-86ca-229eb8506ba6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:26.585059 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd19c6c3-337f-4fa6-86ca-229eb8506ba6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:26.591686 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd19c6c3-337f-4fa6-86ca-229eb8506ba6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:26.591686 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd19c6c3-337f-4fa6-86ca-229eb8506ba6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:26.717153 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-dd19c6c3-337f-4fa6-86ca-229eb8506ba6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:56:26.724962 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dd19c6c3-337f-4fa6-86ca-229eb8506ba6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1665 microversion: 2.1 time: 0.151236 Jun 10 18:56:26.725539 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3937/7559] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:56:26 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1665 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:56:27.743048 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-78737b1a-902e-41f4-bc41-6af9d627a00d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:27.743687 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-78737b1a-902e-41f4-bc41-6af9d627a00d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:27.751200 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-78737b1a-902e-41f4-bc41-6af9d627a00d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:27.751652 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-78737b1a-902e-41f4-bc41-6af9d627a00d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:27.752446 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-78737b1a-902e-41f4-bc41-6af9d627a00d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:27.752889 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-78737b1a-902e-41f4-bc41-6af9d627a00d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:27.894766 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-78737b1a-902e-41f4-bc41-6af9d627a00d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:56:27.902673 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-78737b1a-902e-41f4-bc41-6af9d627a00d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1665 microversion: 2.1 time: 0.163615 Jun 10 18:56:27.903257 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3938/7560] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:56:27 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1665 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:56:28.920165 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-87493c98-d21c-494a-a429-d855b9cee76f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:28.920888 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-87493c98-d21c-494a-a429-d855b9cee76f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:28.927738 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-87493c98-d21c-494a-a429-d855b9cee76f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:28.928196 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-87493c98-d21c-494a-a429-d855b9cee76f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:28.929000 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-87493c98-d21c-494a-a429-d855b9cee76f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:28.929440 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-87493c98-d21c-494a-a429-d855b9cee76f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:29.056639 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-87493c98-d21c-494a-a429-d855b9cee76f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:56:29.064133 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-87493c98-d21c-494a-a429-d855b9cee76f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1669 microversion: 2.1 time: 0.147875 Jun 10 18:56:29.064734 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3939/7561] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:56:28 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1669 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:56:29.080853 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ea29869e-cf7f-4085-a654-8cfcd5fed1c5 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:29.081345 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ea29869e-cf7f-4085-a654-8cfcd5fed1c5 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:29.087067 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ea29869e-cf7f-4085-a654-8cfcd5fed1c5 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:29.087525 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ea29869e-cf7f-4085-a654-8cfcd5fed1c5 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:29.088289 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ea29869e-cf7f-4085-a654-8cfcd5fed1c5 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:29.088753 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ea29869e-cf7f-4085-a654-8cfcd5fed1c5 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:29.127899 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ea29869e-cf7f-4085-a654-8cfcd5fed1c5 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:56:29.464205 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ea29869e-cf7f-4085-a654-8cfcd5fed1c5 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "DELETE /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 204 len: 0 microversion: 2.1 time: 0.387163 Jun 10 18:56:29.464852 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3940/7562] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:56:29 2022] DELETE /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 18:56:29.473020 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-15dbe423-f38f-49b2-aa03-3b6695356e85 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:29.473709 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-15dbe423-f38f-49b2-aa03-3b6695356e85 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:29.479635 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-15dbe423-f38f-49b2-aa03-3b6695356e85 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:29.480085 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-15dbe423-f38f-49b2-aa03-3b6695356e85 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:29.480887 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-15dbe423-f38f-49b2-aa03-3b6695356e85 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:29.481326 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-15dbe423-f38f-49b2-aa03-3b6695356e85 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:29.618348 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-15dbe423-f38f-49b2-aa03-3b6695356e85 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:56:29.626483 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-15dbe423-f38f-49b2-aa03-3b6695356e85 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1675 microversion: 2.1 time: 0.157376 Jun 10 18:56:29.627048 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3941/7563] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:56:29 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:56:30.643703 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2a29b0cc-cddf-4688-b3bf-a06e94942308 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:30.644375 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2a29b0cc-cddf-4688-b3bf-a06e94942308 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:30.651267 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2a29b0cc-cddf-4688-b3bf-a06e94942308 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:30.651721 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2a29b0cc-cddf-4688-b3bf-a06e94942308 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:30.652515 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2a29b0cc-cddf-4688-b3bf-a06e94942308 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:30.652959 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2a29b0cc-cddf-4688-b3bf-a06e94942308 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:30.782311 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2a29b0cc-cddf-4688-b3bf-a06e94942308 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:56:30.789906 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2a29b0cc-cddf-4688-b3bf-a06e94942308 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1675 microversion: 2.1 time: 0.150074 Jun 10 18:56:30.790476 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3942/7564] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:56:30 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:56:31.807786 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ad1d73f7-6038-460d-a4f1-6caac412fb6e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:31.808678 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ad1d73f7-6038-460d-a4f1-6caac412fb6e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:31.817021 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad1d73f7-6038-460d-a4f1-6caac412fb6e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:31.817574 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad1d73f7-6038-460d-a4f1-6caac412fb6e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:31.818469 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad1d73f7-6038-460d-a4f1-6caac412fb6e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:31.818982 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad1d73f7-6038-460d-a4f1-6caac412fb6e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:31.884167 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ad1d73f7-6038-460d-a4f1-6caac412fb6e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:56:31.892537 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ad1d73f7-6038-460d-a4f1-6caac412fb6e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 200 len: 1607 microversion: 2.1 time: 0.088997 Jun 10 18:56:31.893214 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3943/7565] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:56:31 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 1607 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:56:31.928349 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-b573c4e5-e915-467d-a565-cafc530dfed5 req-309ecfbd-4df8-48df-bd7a-f2c4b7439397 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f3177ac-baf5-4136-ad02-e52f23f46f68", "name": "network-vif-deleted", "tag": "9b8ab821-406d-4c0a-ab03-8c5c98ac88e8"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:56:31.936352 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-b573c4e5-e915-467d-a565-cafc530dfed5 req-309ecfbd-4df8-48df-bd7a-f2c4b7439397 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:31.941158 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-b573c4e5-e915-467d-a565-cafc530dfed5 req-309ecfbd-4df8-48df-bd7a-f2c4b7439397 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:31.948587 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-b573c4e5-e915-467d-a565-cafc530dfed5 req-309ecfbd-4df8-48df-bd7a-f2c4b7439397 service nova] Creating event network-vif-deleted:9b8ab821-406d-4c0a-ab03-8c5c98ac88e8 for instance 8f3177ac-baf5-4136-ad02-e52f23f46f68 on chh2-master-2 Jun 10 18:56:31.954016 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-b573c4e5-e915-467d-a565-cafc530dfed5 req-309ecfbd-4df8-48df-bd7a-f2c4b7439397 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030220 Jun 10 18:56:31.954593 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3944/7566] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:56:32.911503 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dd3a91d1-8019-4704-b840-f9c661fd3bd8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:32.912210 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dd3a91d1-8019-4704-b840-f9c661fd3bd8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:32.918715 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd3a91d1-8019-4704-b840-f9c661fd3bd8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:32.919174 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd3a91d1-8019-4704-b840-f9c661fd3bd8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:32.919943 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd3a91d1-8019-4704-b840-f9c661fd3bd8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:32.920441 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd3a91d1-8019-4704-b840-f9c661fd3bd8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:32.933621 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-dd3a91d1-8019-4704-b840-f9c661fd3bd8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] HTTP exception thrown: Instance 8f3177ac-baf5-4136-ad02-e52f23f46f68 could not be found. Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dd3a91d1-8019-4704-b840-f9c661fd3bd8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Request method failure captured: Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 HTTP/1.1 Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5NYWWZ-ZO6eUaowxYHvN17DzgOyBcRp8mhJxqDpqy8rItuzorWJTwSOIastREFRyZr6c_ChbS_L6xrOAOnpyFVpWaRIYnwPEIqz770DyDVvyPoXIV-sm8ojvCAplLeG2g6jr_K6WyMCpHhf5lcBOzewCyTTCZt4Q13c3it9lc4tPjc Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 9ee0edfe1ca545a18061642a775747b5 Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServerActionsTestJSON-1025700685 Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_9ee0edfe1ca545a18061642a775747b5", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServerActionsTestJSON-1025700685 Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 9ee0edfe1ca545a18061642a775747b5 Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServerActionsTestJSON-1025700685 Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServerActionsTestJSON-1025700685-project Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 9434d247ee1c4143bc2cf07b834417ea Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServerActionsTestJSON-1025700685-project Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 8f3177ac-baf5-4136-ad02-e52f23f46f68 could not be found. Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '8f3177ac-baf5-4136-ad02-e52f23f46f68'} Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f3177ac-baf5-4136-ad02-e52f23f46f68 could not be found. Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f3177ac-baf5-4136-ad02-e52f23f46f68 could not be found. Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:56:32.935303 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:56:32.942303 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:56:32.942303 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:56:32.942303 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:56:32.942303 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:56:32.942303 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:56:32.942303 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f3177ac-baf5-4136-ad02-e52f23f46f68 could not be found. Jun 10 18:56:32.942303 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:56:32.942303 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dd3a91d1-8019-4704-b840-f9c661fd3bd8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Returning 404 to user: Instance 8f3177ac-baf5-4136-ad02-e52f23f46f68 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:56:32.942303 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dd3a91d1-8019-4704-b840-f9c661fd3bd8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 404 len: 111 microversion: 2.1 time: 0.031082 Jun 10 18:56:32.942303 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3945/7567] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:56:32 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:56:32.959775 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dcfffdd4-b749-4a83-b3a4-2914962efa18 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:32.960456 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dcfffdd4-b749-4a83-b3a4-2914962efa18 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:32.967338 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dcfffdd4-b749-4a83-b3a4-2914962efa18 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:32.967338 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dcfffdd4-b749-4a83-b3a4-2914962efa18 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:32.967806 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dcfffdd4-b749-4a83-b3a4-2914962efa18 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:32.968239 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dcfffdd4-b749-4a83-b3a4-2914962efa18 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:32.981563 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-dcfffdd4-b749-4a83-b3a4-2914962efa18 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] HTTP exception thrown: Instance 8f3177ac-baf5-4136-ad02-e52f23f46f68 could not be found. Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dcfffdd4-b749-4a83-b3a4-2914962efa18 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Request method failure captured: Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 HTTP/1.1 Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5NYWWZ-ZO6eUaowxYHvN17DzgOyBcRp8mhJxqDpqy8rItuzorWJTwSOIastREFRyZr6c_ChbS_L6xrOAOnpyFVpWaRIYnwPEIqz770DyDVvyPoXIV-sm8ojvCAplLeG2g6jr_K6WyMCpHhf5lcBOzewCyTTCZt4Q13c3it9lc4tPjc Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 9ee0edfe1ca545a18061642a775747b5 Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServerActionsTestJSON-1025700685 Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_9ee0edfe1ca545a18061642a775747b5", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServerActionsTestJSON-1025700685 Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 9ee0edfe1ca545a18061642a775747b5 Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServerActionsTestJSON-1025700685 Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServerActionsTestJSON-1025700685-project Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 9434d247ee1c4143bc2cf07b834417ea Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServerActionsTestJSON-1025700685-project Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 8f3177ac-baf5-4136-ad02-e52f23f46f68 could not be found. Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '8f3177ac-baf5-4136-ad02-e52f23f46f68'} Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f3177ac-baf5-4136-ad02-e52f23f46f68 could not be found. Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f3177ac-baf5-4136-ad02-e52f23f46f68 could not be found. Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:56:32.983108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:56:32.996617 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:56:32.996617 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:56:32.996617 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:56:32.996617 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:56:32.996617 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:56:32.996617 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f3177ac-baf5-4136-ad02-e52f23f46f68 could not be found. Jun 10 18:56:32.996617 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:56:32.996617 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dcfffdd4-b749-4a83-b3a4-2914962efa18 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Returning 404 to user: Instance 8f3177ac-baf5-4136-ad02-e52f23f46f68 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:56:32.996617 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dcfffdd4-b749-4a83-b3a4-2914962efa18 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 404 len: 111 microversion: 2.1 time: 0.030570 Jun 10 18:56:32.996617 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3946/7568] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:56:32 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:56:33.041044 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ef5b2f10-0155-4201-8d8b-35360eca041c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-450304790", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "0fb8209d-4273-43eb-a7e9-ab31438ebf09"}], "security_groups": [{"name": "tempest-securitygroup--1864491070"}], "key_name": "tempest-keypair-434241289", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:56:33.146703 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-ef5b2f10-0155-4201-8d8b-35360eca041c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] validate_networks() for [('0fb8209d-4273-43eb-a7e9-ab31438ebf09', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:56:33.558232 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-ef5b2f10-0155-4201-8d8b-35360eca041c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:56:33.558655 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-ef5b2f10-0155-4201-8d8b-35360eca041c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:56:33.559128 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-ef5b2f10-0155-4201-8d8b-35360eca041c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:56:33.559568 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-ef5b2f10-0155-4201-8d8b-35360eca041c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:56:33.559979 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-ef5b2f10-0155-4201-8d8b-35360eca041c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:56:33.569562 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ef5b2f10-0155-4201-8d8b-35360eca041c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:33.570009 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ef5b2f10-0155-4201-8d8b-35360eca041c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:33.570802 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ef5b2f10-0155-4201-8d8b-35360eca041c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:33.571235 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ef5b2f10-0155-4201-8d8b-35360eca041c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:33.587556 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-ef5b2f10-0155-4201-8d8b-35360eca041c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Getting quotas for project 9ee0edfe1ca545a18061642a775747b5. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:56:33.592803 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-ef5b2f10-0155-4201-8d8b-35360eca041c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Getting quotas for user 9434d247ee1c4143bc2cf07b834417ea and project 9ee0edfe1ca545a18061642a775747b5. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:56:33.605301 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ef5b2f10-0155-4201-8d8b-35360eca041c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:56:33.612503 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ef5b2f10-0155-4201-8d8b-35360eca041c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:56:33.711879 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ef5b2f10-0155-4201-8d8b-35360eca041c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.674847 Jun 10 18:56:33.712568 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3947/7569] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:56:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 10 18:56:33.722932 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1aebc7df-1519-48dd-b91d-8274e67a0826 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:33.723537 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1aebc7df-1519-48dd-b91d-8274e67a0826 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:33.779390 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1aebc7df-1519-48dd-b91d-8274e67a0826 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:56:33.789234 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1aebc7df-1519-48dd-b91d-8274e67a0826 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1237 microversion: 2.1 time: 0.068208 Jun 10 18:56:33.789234 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3948/7570] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:56:33 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:56:34.805470 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b2a8637e-6880-4646-a45d-0a0bed15897b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:34.806183 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b2a8637e-6880-4646-a45d-0a0bed15897b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:34.813622 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b2a8637e-6880-4646-a45d-0a0bed15897b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:34.814107 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b2a8637e-6880-4646-a45d-0a0bed15897b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:34.814828 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b2a8637e-6880-4646-a45d-0a0bed15897b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:34.815263 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b2a8637e-6880-4646-a45d-0a0bed15897b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:34.819444 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:56:34.879689 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b2a8637e-6880-4646-a45d-0a0bed15897b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:56:34.887465 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b2a8637e-6880-4646-a45d-0a0bed15897b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1233 microversion: 2.1 time: 0.086039 Jun 10 18:56:34.892936 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3949/7571] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:56:34 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1233 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:56:35.906131 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1e440a6d-a526-4cf1-a847-6ddcd0be7ebe tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:35.906814 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1e440a6d-a526-4cf1-a847-6ddcd0be7ebe tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:35.915012 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1e440a6d-a526-4cf1-a847-6ddcd0be7ebe tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:35.915466 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1e440a6d-a526-4cf1-a847-6ddcd0be7ebe tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:35.916248 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1e440a6d-a526-4cf1-a847-6ddcd0be7ebe tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:35.916736 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1e440a6d-a526-4cf1-a847-6ddcd0be7ebe tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:35.978298 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1e440a6d-a526-4cf1-a847-6ddcd0be7ebe tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:56:35.985804 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1e440a6d-a526-4cf1-a847-6ddcd0be7ebe tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1295 microversion: 2.1 time: 0.084495 Jun 10 18:56:35.986376 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3950/7572] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:56:35 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1295 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:56:36.934788 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-e79c1ce9-0f50-4585-ad92-da8bf42af0a5 req-88a657c6-4d21-47f1-b141-69efbcf58b7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f97a76cd-13ac-4381-a584-711a5408c288", "tag": "dcefcad2-da4e-4342-ae6b-72dd932cefec"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:56:36.946252 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-e79c1ce9-0f50-4585-ad92-da8bf42af0a5 req-88a657c6-4d21-47f1-b141-69efbcf58b7e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:36.946252 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-e79c1ce9-0f50-4585-ad92-da8bf42af0a5 req-88a657c6-4d21-47f1-b141-69efbcf58b7e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:36.957909 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-e79c1ce9-0f50-4585-ad92-da8bf42af0a5 req-88a657c6-4d21-47f1-b141-69efbcf58b7e service nova] Creating event network-changed:dcefcad2-da4e-4342-ae6b-72dd932cefec for instance f97a76cd-13ac-4381-a584-711a5408c288 on chh1-master-2 Jun 10 18:56:36.963117 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-e79c1ce9-0f50-4585-ad92-da8bf42af0a5 req-88a657c6-4d21-47f1-b141-69efbcf58b7e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033461 Jun 10 18:56:36.963759 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3951/7573] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:56:37.003824 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ad68f7b0-2e11-406c-b24e-6bebbf1331a3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:37.004574 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ad68f7b0-2e11-406c-b24e-6bebbf1331a3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:37.011560 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad68f7b0-2e11-406c-b24e-6bebbf1331a3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:37.012030 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad68f7b0-2e11-406c-b24e-6bebbf1331a3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:37.012902 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad68f7b0-2e11-406c-b24e-6bebbf1331a3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:37.013345 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad68f7b0-2e11-406c-b24e-6bebbf1331a3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:37.154002 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ad68f7b0-2e11-406c-b24e-6bebbf1331a3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:56:37.163714 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ad68f7b0-2e11-406c-b24e-6bebbf1331a3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1363 microversion: 2.1 time: 0.164108 Jun 10 18:56:37.164320 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3952/7574] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:56:36 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:56:38.181323 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-aaffc5fc-3f51-4f62-a90a-672789783f50 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:38.182009 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-aaffc5fc-3f51-4f62-a90a-672789783f50 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:38.189398 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aaffc5fc-3f51-4f62-a90a-672789783f50 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:38.189849 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aaffc5fc-3f51-4f62-a90a-672789783f50 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:38.190608 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aaffc5fc-3f51-4f62-a90a-672789783f50 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:38.191376 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aaffc5fc-3f51-4f62-a90a-672789783f50 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:38.317009 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-aaffc5fc-3f51-4f62-a90a-672789783f50 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:56:38.324402 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-aaffc5fc-3f51-4f62-a90a-672789783f50 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1363 microversion: 2.1 time: 0.146893 Jun 10 18:56:38.324978 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3953/7575] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:56:38 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:56:39.342251 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2e2d6ca7-7c52-4a39-a57e-55aad2bc281e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:39.343478 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2e2d6ca7-7c52-4a39-a57e-55aad2bc281e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:39.350664 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e2d6ca7-7c52-4a39-a57e-55aad2bc281e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:39.351118 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e2d6ca7-7c52-4a39-a57e-55aad2bc281e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:39.351912 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e2d6ca7-7c52-4a39-a57e-55aad2bc281e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:39.352378 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e2d6ca7-7c52-4a39-a57e-55aad2bc281e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:39.488017 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2e2d6ca7-7c52-4a39-a57e-55aad2bc281e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:56:39.495630 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2e2d6ca7-7c52-4a39-a57e-55aad2bc281e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1363 microversion: 2.1 time: 0.157295 Jun 10 18:56:39.496313 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3954/7576] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:56:39 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:56:40.513350 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e7f0c9fe-51dd-4746-af40-a2a617e6e761 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:40.513958 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e7f0c9fe-51dd-4746-af40-a2a617e6e761 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:40.520922 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e7f0c9fe-51dd-4746-af40-a2a617e6e761 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:40.521371 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e7f0c9fe-51dd-4746-af40-a2a617e6e761 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:40.522127 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e7f0c9fe-51dd-4746-af40-a2a617e6e761 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:40.522561 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e7f0c9fe-51dd-4746-af40-a2a617e6e761 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:40.649304 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e7f0c9fe-51dd-4746-af40-a2a617e6e761 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:56:40.657314 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e7f0c9fe-51dd-4746-af40-a2a617e6e761 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1363 microversion: 2.1 time: 0.147814 Jun 10 18:56:40.657891 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3955/7577] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:56:40 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:56:41.630656 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-aa33f343-6e4d-4c60-ab7c-8eca7aefc3a4 req-6a4c285a-1099-4a33-a0e6-bee8e6422b0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f97a76cd-13ac-4381-a584-711a5408c288", "name": "network-vif-plugged", "status": "completed", "tag": "dcefcad2-da4e-4342-ae6b-72dd932cefec"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:56:41.639657 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-aa33f343-6e4d-4c60-ab7c-8eca7aefc3a4 req-6a4c285a-1099-4a33-a0e6-bee8e6422b0e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:41.640098 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-aa33f343-6e4d-4c60-ab7c-8eca7aefc3a4 req-6a4c285a-1099-4a33-a0e6-bee8e6422b0e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:41.653306 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-aa33f343-6e4d-4c60-ab7c-8eca7aefc3a4 req-6a4c285a-1099-4a33-a0e6-bee8e6422b0e service nova] Creating event network-vif-plugged:dcefcad2-da4e-4342-ae6b-72dd932cefec for instance f97a76cd-13ac-4381-a584-711a5408c288 on chh1-master-2 Jun 10 18:56:41.658086 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-aa33f343-6e4d-4c60-ab7c-8eca7aefc3a4 req-6a4c285a-1099-4a33-a0e6-bee8e6422b0e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031100 Jun 10 18:56:41.658663 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3956/7578] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:56:41.677808 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a3e8c46c-6050-426e-987a-d24d4350ac86 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:41.677808 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a3e8c46c-6050-426e-987a-d24d4350ac86 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:41.682544 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a3e8c46c-6050-426e-987a-d24d4350ac86 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:41.682991 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a3e8c46c-6050-426e-987a-d24d4350ac86 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:41.683753 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a3e8c46c-6050-426e-987a-d24d4350ac86 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:41.684192 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a3e8c46c-6050-426e-987a-d24d4350ac86 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:41.815742 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a3e8c46c-6050-426e-987a-d24d4350ac86 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:56:41.823339 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a3e8c46c-6050-426e-987a-d24d4350ac86 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1363 microversion: 2.1 time: 0.152511 Jun 10 18:56:41.823906 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3957/7579] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:56:41 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:56:42.840894 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3364d145-558c-45ea-93bc-c54542d99e7e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:42.842242 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3364d145-558c-45ea-93bc-c54542d99e7e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:42.850965 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3364d145-558c-45ea-93bc-c54542d99e7e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:42.851440 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3364d145-558c-45ea-93bc-c54542d99e7e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:42.852228 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3364d145-558c-45ea-93bc-c54542d99e7e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:42.852712 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3364d145-558c-45ea-93bc-c54542d99e7e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:42.989960 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3364d145-558c-45ea-93bc-c54542d99e7e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:56:42.997519 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3364d145-558c-45ea-93bc-c54542d99e7e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1363 microversion: 2.1 time: 0.160732 Jun 10 18:56:42.998317 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3958/7580] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:56:42 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:56:44.016059 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2006c618-39a1-4921-8539-9dc0b0ec9a5a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:44.016714 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2006c618-39a1-4921-8539-9dc0b0ec9a5a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:44.018703 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:56:44.019401 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=8 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:56:44.025172 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2006c618-39a1-4921-8539-9dc0b0ec9a5a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:44.025622 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2006c618-39a1-4921-8539-9dc0b0ec9a5a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:44.026446 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2006c618-39a1-4921-8539-9dc0b0ec9a5a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:44.026880 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2006c618-39a1-4921-8539-9dc0b0ec9a5a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:44.156945 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2006c618-39a1-4921-8539-9dc0b0ec9a5a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:56:44.164548 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2006c618-39a1-4921-8539-9dc0b0ec9a5a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1549 microversion: 2.1 time: 0.152934 Jun 10 18:56:44.165117 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3959/7581] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:56:44 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:56:44.180637 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0dce5dc5-0985-445b-a50f-67445a8052bf tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:56:44.181129 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0dce5dc5-0985-445b-a50f-67445a8052bf tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:56:44.187353 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0dce5dc5-0985-445b-a50f-67445a8052bf tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:44.187887 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0dce5dc5-0985-445b-a50f-67445a8052bf tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:44.188566 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0dce5dc5-0985-445b-a50f-67445a8052bf tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:44.189009 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0dce5dc5-0985-445b-a50f-67445a8052bf tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:44.263541 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0dce5dc5-0985-445b-a50f-67445a8052bf tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.086294 Jun 10 18:56:44.264137 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3960/7582] 10.222.0.35 () {58 vars in 1274 bytes} [Fri Jun 10 18:56:44 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:56:45.651325 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-40005232-c42f-46d1-9492-fbe5dfa6bd70 req-8bdfc833-f110-45a1-a6c7-3eb14f22d2f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f97a76cd-13ac-4381-a584-711a5408c288", "tag": "dcefcad2-da4e-4342-ae6b-72dd932cefec"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:56:45.660495 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-40005232-c42f-46d1-9492-fbe5dfa6bd70 req-8bdfc833-f110-45a1-a6c7-3eb14f22d2f3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:56:45.667284 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-40005232-c42f-46d1-9492-fbe5dfa6bd70 req-8bdfc833-f110-45a1-a6c7-3eb14f22d2f3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:56:45.673316 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-40005232-c42f-46d1-9492-fbe5dfa6bd70 req-8bdfc833-f110-45a1-a6c7-3eb14f22d2f3 service nova] Creating event network-changed:dcefcad2-da4e-4342-ae6b-72dd932cefec for instance f97a76cd-13ac-4381-a584-711a5408c288 on chh1-master-2 Jun 10 18:56:45.678319 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-40005232-c42f-46d1-9492-fbe5dfa6bd70 req-8bdfc833-f110-45a1-a6c7-3eb14f22d2f3 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084472 Jun 10 18:56:45.679058 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3961/7583] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:57:18.505162 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:57:18.505914 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=62 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:57:18.510310 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9008ef81-5ab1-4d96-badd-585c1530f434 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:57:18.511391 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9008ef81-5ab1-4d96-badd-585c1530f434 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:57:18.517452 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9008ef81-5ab1-4d96-badd-585c1530f434 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:18.528675 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9008ef81-5ab1-4d96-badd-585c1530f434 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:18.528675 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9008ef81-5ab1-4d96-badd-585c1530f434 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:18.528675 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9008ef81-5ab1-4d96-badd-585c1530f434 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:18.547215 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9008ef81-5ab1-4d96-badd-585c1530f434 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:57:18.553404 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9008ef81-5ab1-4d96-badd-585c1530f434 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Old instance type m1.heat2, new instance type m1.heat {{(pid=126595) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 10 18:57:18.559594 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-9008ef81-5ab1-4d96-badd-585c1530f434 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:57:18.560019 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-9008ef81-5ab1-4d96-badd-585c1530f434 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:57:18.560522 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-9008ef81-5ab1-4d96-badd-585c1530f434 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:57:18.561609 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-9008ef81-5ab1-4d96-badd-585c1530f434 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:57:18.562054 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-9008ef81-5ab1-4d96-badd-585c1530f434 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:57:18.768367 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9008ef81-5ab1-4d96-badd-585c1530f434 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "POST /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288/action" status: 202 len: 0 microversion: 2.1 time: 0.265380 Jun 10 18:57:18.769033 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3962/7584] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:57:18 2022] POST /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 18:57:18.776765 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-270e4650-7d8f-4a50-b1bf-c26d4ff136cb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:57:18.777372 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-270e4650-7d8f-4a50-b1bf-c26d4ff136cb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:57:18.783908 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-270e4650-7d8f-4a50-b1bf-c26d4ff136cb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:18.784412 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-270e4650-7d8f-4a50-b1bf-c26d4ff136cb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:18.785182 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-270e4650-7d8f-4a50-b1bf-c26d4ff136cb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:18.785609 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-270e4650-7d8f-4a50-b1bf-c26d4ff136cb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:18.914423 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-270e4650-7d8f-4a50-b1bf-c26d4ff136cb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:57:18.922632 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-270e4650-7d8f-4a50-b1bf-c26d4ff136cb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1677 microversion: 2.1 time: 0.149621 Jun 10 18:57:18.923197 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3963/7585] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:57:18 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:57:19.940162 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-050775ba-046e-4714-acd9-a2f74b435182 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:57:19.940817 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-050775ba-046e-4714-acd9-a2f74b435182 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:57:19.948255 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-050775ba-046e-4714-acd9-a2f74b435182 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:19.948829 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-050775ba-046e-4714-acd9-a2f74b435182 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:19.949695 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-050775ba-046e-4714-acd9-a2f74b435182 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:19.950209 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-050775ba-046e-4714-acd9-a2f74b435182 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:20.100365 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-050775ba-046e-4714-acd9-a2f74b435182 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:57:20.108432 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-050775ba-046e-4714-acd9-a2f74b435182 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1677 microversion: 2.1 time: 0.172674 Jun 10 18:57:20.109001 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3964/7586] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:57:19 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:57:21.125603 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a0093e03-5229-4d98-8bd9-ac48c05ecd0a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:57:21.126312 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a0093e03-5229-4d98-8bd9-ac48c05ecd0a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:57:21.133492 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a0093e03-5229-4d98-8bd9-ac48c05ecd0a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:21.133971 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a0093e03-5229-4d98-8bd9-ac48c05ecd0a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:21.134744 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a0093e03-5229-4d98-8bd9-ac48c05ecd0a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:21.135188 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a0093e03-5229-4d98-8bd9-ac48c05ecd0a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:21.267499 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a0093e03-5229-4d98-8bd9-ac48c05ecd0a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:57:21.275407 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a0093e03-5229-4d98-8bd9-ac48c05ecd0a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1677 microversion: 2.1 time: 0.153738 Jun 10 18:57:21.275985 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3965/7587] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:57:21 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:57:22.293184 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-016d82f3-ee5c-47ed-93e5-e6064117109c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:57:22.293886 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-016d82f3-ee5c-47ed-93e5-e6064117109c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:57:22.301252 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-016d82f3-ee5c-47ed-93e5-e6064117109c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:22.301713 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-016d82f3-ee5c-47ed-93e5-e6064117109c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:22.302485 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-016d82f3-ee5c-47ed-93e5-e6064117109c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:22.302925 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-016d82f3-ee5c-47ed-93e5-e6064117109c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:22.436117 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-016d82f3-ee5c-47ed-93e5-e6064117109c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:57:22.443676 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-016d82f3-ee5c-47ed-93e5-e6064117109c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1682 microversion: 2.1 time: 0.154430 Jun 10 18:57:22.444246 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3966/7588] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:57:22 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:57:23.459938 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5543e851-38e7-4067-92fa-16322fb78418 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:57:23.460590 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5543e851-38e7-4067-92fa-16322fb78418 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:57:23.468085 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5543e851-38e7-4067-92fa-16322fb78418 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:23.468570 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5543e851-38e7-4067-92fa-16322fb78418 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:23.469338 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5543e851-38e7-4067-92fa-16322fb78418 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:23.469800 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5543e851-38e7-4067-92fa-16322fb78418 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:23.605334 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5543e851-38e7-4067-92fa-16322fb78418 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:57:23.613006 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5543e851-38e7-4067-92fa-16322fb78418 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1682 microversion: 2.1 time: 0.156829 Jun 10 18:57:23.613577 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3967/7589] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:57:23 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:57:24.630380 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c8b7778d-5cdc-480f-b457-54899dbd9aba tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:57:24.630981 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c8b7778d-5cdc-480f-b457-54899dbd9aba tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:57:24.638009 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c8b7778d-5cdc-480f-b457-54899dbd9aba tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:24.638463 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c8b7778d-5cdc-480f-b457-54899dbd9aba tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:24.639227 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c8b7778d-5cdc-480f-b457-54899dbd9aba tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:24.639668 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c8b7778d-5cdc-480f-b457-54899dbd9aba tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:24.769942 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c8b7778d-5cdc-480f-b457-54899dbd9aba tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:57:24.777427 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c8b7778d-5cdc-480f-b457-54899dbd9aba tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1682 microversion: 2.1 time: 0.151238 Jun 10 18:57:24.777989 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3968/7590] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:57:24 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:57:25.794838 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f74e5b68-d209-482f-9ef6-87492aa53513 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:57:25.795509 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f74e5b68-d209-482f-9ef6-87492aa53513 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:57:25.802325 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f74e5b68-d209-482f-9ef6-87492aa53513 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:25.802772 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f74e5b68-d209-482f-9ef6-87492aa53513 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:25.803535 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f74e5b68-d209-482f-9ef6-87492aa53513 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:25.803965 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f74e5b68-d209-482f-9ef6-87492aa53513 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:25.931362 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f74e5b68-d209-482f-9ef6-87492aa53513 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:57:25.938842 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f74e5b68-d209-482f-9ef6-87492aa53513 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1682 microversion: 2.1 time: 0.147895 Jun 10 18:57:25.939403 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3969/7591] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:57:25 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:57:26.956601 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-137a8943-b635-4afe-ab4c-a9b8f4f0ac88 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:57:26.957368 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-137a8943-b635-4afe-ab4c-a9b8f4f0ac88 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:57:26.964166 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-137a8943-b635-4afe-ab4c-a9b8f4f0ac88 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:26.967734 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-137a8943-b635-4afe-ab4c-a9b8f4f0ac88 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:26.967734 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-137a8943-b635-4afe-ab4c-a9b8f4f0ac88 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:26.967734 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-137a8943-b635-4afe-ab4c-a9b8f4f0ac88 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:27.098795 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-137a8943-b635-4afe-ab4c-a9b8f4f0ac88 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:57:27.106359 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-137a8943-b635-4afe-ab4c-a9b8f4f0ac88 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1682 microversion: 2.1 time: 0.153755 Jun 10 18:57:27.106944 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3970/7592] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:57:26 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:57:28.123087 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0e8135e2-f8f4-43b4-a119-45d260e12d15 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:57:28.123750 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0e8135e2-f8f4-43b4-a119-45d260e12d15 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:57:28.130672 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0e8135e2-f8f4-43b4-a119-45d260e12d15 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:28.131124 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0e8135e2-f8f4-43b4-a119-45d260e12d15 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:28.131888 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0e8135e2-f8f4-43b4-a119-45d260e12d15 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:28.132616 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0e8135e2-f8f4-43b4-a119-45d260e12d15 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:28.267570 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0e8135e2-f8f4-43b4-a119-45d260e12d15 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:57:28.275462 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0e8135e2-f8f4-43b4-a119-45d260e12d15 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1682 microversion: 2.1 time: 0.156340 Jun 10 18:57:28.276035 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3971/7593] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:57:28 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:57:29.293354 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-aa28ce21-ea95-468c-8d7a-af7cf24ceb74 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:57:29.294022 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-aa28ce21-ea95-468c-8d7a-af7cf24ceb74 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:57:29.301757 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aa28ce21-ea95-468c-8d7a-af7cf24ceb74 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:29.302216 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aa28ce21-ea95-468c-8d7a-af7cf24ceb74 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:29.302990 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aa28ce21-ea95-468c-8d7a-af7cf24ceb74 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:29.303430 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aa28ce21-ea95-468c-8d7a-af7cf24ceb74 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:29.431020 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-aa28ce21-ea95-468c-8d7a-af7cf24ceb74 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:57:29.438608 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-aa28ce21-ea95-468c-8d7a-af7cf24ceb74 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1682 microversion: 2.1 time: 0.149181 Jun 10 18:57:29.439183 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3972/7594] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:57:29 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:57:30.454980 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b77eeb85-84a9-4029-81c0-5c657169c024 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:57:30.455598 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b77eeb85-84a9-4029-81c0-5c657169c024 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:57:30.462656 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b77eeb85-84a9-4029-81c0-5c657169c024 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:30.463110 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b77eeb85-84a9-4029-81c0-5c657169c024 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:30.463874 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b77eeb85-84a9-4029-81c0-5c657169c024 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:30.464329 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b77eeb85-84a9-4029-81c0-5c657169c024 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:30.595257 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b77eeb85-84a9-4029-81c0-5c657169c024 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:57:30.602849 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b77eeb85-84a9-4029-81c0-5c657169c024 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1682 microversion: 2.1 time: 0.151767 Jun 10 18:57:30.603414 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3973/7595] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:57:30 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:57:30.960562 chdv-master-2 devstack@n-api.service[126595]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 18:57:30.960760 chdv-master-2 devstack@n-api.service[126595]: Fri Jun 10 18:57:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 10 18:57:31.620469 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-551cf265-6ce4-43c1-8e90-00ba0bfdb7c4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:57:31.621151 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-551cf265-6ce4-43c1-8e90-00ba0bfdb7c4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:57:31.628665 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-551cf265-6ce4-43c1-8e90-00ba0bfdb7c4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:31.629121 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-551cf265-6ce4-43c1-8e90-00ba0bfdb7c4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:31.629888 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-551cf265-6ce4-43c1-8e90-00ba0bfdb7c4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:31.630328 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-551cf265-6ce4-43c1-8e90-00ba0bfdb7c4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:31.757751 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-551cf265-6ce4-43c1-8e90-00ba0bfdb7c4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:57:31.766032 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-551cf265-6ce4-43c1-8e90-00ba0bfdb7c4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1682 microversion: 2.1 time: 0.149475 Jun 10 18:57:31.766605 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3974/7596] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:57:31 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:57:32.782983 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-da7c6516-f8a7-4ea4-b474-0c6ccb6295f0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:57:32.783665 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-da7c6516-f8a7-4ea4-b474-0c6ccb6295f0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:57:32.792869 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-da7c6516-f8a7-4ea4-b474-0c6ccb6295f0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:32.793321 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-da7c6516-f8a7-4ea4-b474-0c6ccb6295f0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:32.794092 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-da7c6516-f8a7-4ea4-b474-0c6ccb6295f0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:32.794530 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-da7c6516-f8a7-4ea4-b474-0c6ccb6295f0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:32.921874 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-da7c6516-f8a7-4ea4-b474-0c6ccb6295f0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:57:32.929392 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-da7c6516-f8a7-4ea4-b474-0c6ccb6295f0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1682 microversion: 2.1 time: 0.150302 Jun 10 18:57:32.929953 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3975/7597] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:57:32 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:57:33.946606 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9111ccae-5fd3-4ad9-9909-707ffc01560e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:57:33.947287 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9111ccae-5fd3-4ad9-9909-707ffc01560e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:57:33.954678 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9111ccae-5fd3-4ad9-9909-707ffc01560e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:33.955130 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9111ccae-5fd3-4ad9-9909-707ffc01560e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:33.955890 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9111ccae-5fd3-4ad9-9909-707ffc01560e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:33.956359 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9111ccae-5fd3-4ad9-9909-707ffc01560e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:34.097999 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9111ccae-5fd3-4ad9-9909-707ffc01560e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:57:34.105576 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9111ccae-5fd3-4ad9-9909-707ffc01560e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1682 microversion: 2.1 time: 0.162903 Jun 10 18:57:34.106184 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3976/7598] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:57:33 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:57:35.123497 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-93b3699c-a924-4caa-b866-4b96a15ec21a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:57:35.124271 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-93b3699c-a924-4caa-b866-4b96a15ec21a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:57:35.131017 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93b3699c-a924-4caa-b866-4b96a15ec21a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:35.131505 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93b3699c-a924-4caa-b866-4b96a15ec21a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:35.132575 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93b3699c-a924-4caa-b866-4b96a15ec21a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:35.133019 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93b3699c-a924-4caa-b866-4b96a15ec21a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:35.137079 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:57:35.264589 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-93b3699c-a924-4caa-b866-4b96a15ec21a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:57:35.272091 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-93b3699c-a924-4caa-b866-4b96a15ec21a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1682 microversion: 2.1 time: 0.153033 Jun 10 18:57:35.272762 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3977/7599] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:57:35 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:57:36.288837 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c30e7acf-9842-43f3-936e-0d78f8d6008a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:57:36.289533 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c30e7acf-9842-43f3-936e-0d78f8d6008a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:57:36.296295 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c30e7acf-9842-43f3-936e-0d78f8d6008a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:36.296775 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c30e7acf-9842-43f3-936e-0d78f8d6008a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:36.297540 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c30e7acf-9842-43f3-936e-0d78f8d6008a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:36.297987 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c30e7acf-9842-43f3-936e-0d78f8d6008a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:36.429827 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c30e7acf-9842-43f3-936e-0d78f8d6008a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:57:36.437484 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c30e7acf-9842-43f3-936e-0d78f8d6008a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1682 microversion: 2.1 time: 0.152570 Jun 10 18:57:36.438059 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3978/7600] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:57:36 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:57:37.454836 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c4ee82f0-53f1-457e-87c2-1a73f8e740b2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:57:37.455553 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c4ee82f0-53f1-457e-87c2-1a73f8e740b2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:57:37.462500 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c4ee82f0-53f1-457e-87c2-1a73f8e740b2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:37.462974 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c4ee82f0-53f1-457e-87c2-1a73f8e740b2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:37.463730 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c4ee82f0-53f1-457e-87c2-1a73f8e740b2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:37.464163 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c4ee82f0-53f1-457e-87c2-1a73f8e740b2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:37.594889 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c4ee82f0-53f1-457e-87c2-1a73f8e740b2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:57:37.602423 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c4ee82f0-53f1-457e-87c2-1a73f8e740b2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1682 microversion: 2.1 time: 0.151811 Jun 10 18:57:37.602988 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3979/7601] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:57:37 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:57:38.619719 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-19000bd3-8034-4211-896d-f46cbe35fceb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:57:38.620345 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-19000bd3-8034-4211-896d-f46cbe35fceb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:57:38.627690 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-19000bd3-8034-4211-896d-f46cbe35fceb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:38.628151 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-19000bd3-8034-4211-896d-f46cbe35fceb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:38.628951 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-19000bd3-8034-4211-896d-f46cbe35fceb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:38.629395 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-19000bd3-8034-4211-896d-f46cbe35fceb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:38.758992 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-19000bd3-8034-4211-896d-f46cbe35fceb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:57:38.766788 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-19000bd3-8034-4211-896d-f46cbe35fceb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1682 microversion: 2.1 time: 0.150911 Jun 10 18:57:38.767371 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3980/7602] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:57:38 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:57:39.783422 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b23d7495-ec98-498b-8cf5-b807e90b64f4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:57:39.784062 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b23d7495-ec98-498b-8cf5-b807e90b64f4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:57:39.791004 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b23d7495-ec98-498b-8cf5-b807e90b64f4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:39.791454 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b23d7495-ec98-498b-8cf5-b807e90b64f4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:39.792210 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b23d7495-ec98-498b-8cf5-b807e90b64f4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:39.792674 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b23d7495-ec98-498b-8cf5-b807e90b64f4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:39.922585 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b23d7495-ec98-498b-8cf5-b807e90b64f4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:57:39.930097 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b23d7495-ec98-498b-8cf5-b807e90b64f4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1681 microversion: 2.1 time: 0.151080 Jun 10 18:57:39.930850 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3981/7603] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:57:39 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:57:39.935488 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-4d9a7d40-e111-4f1f-9047-c6ba9f08496d req-9b5da40b-7f22-44a1-b79b-f4b55f8aaddc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f97a76cd-13ac-4381-a584-711a5408c288", "name": "network-vif-unplugged", "status": "completed", "tag": "dcefcad2-da4e-4342-ae6b-72dd932cefec"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:57:39.943461 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-4d9a7d40-e111-4f1f-9047-c6ba9f08496d req-9b5da40b-7f22-44a1-b79b-f4b55f8aaddc service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:39.943909 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-4d9a7d40-e111-4f1f-9047-c6ba9f08496d req-9b5da40b-7f22-44a1-b79b-f4b55f8aaddc service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:39.958039 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-4d9a7d40-e111-4f1f-9047-c6ba9f08496d req-9b5da40b-7f22-44a1-b79b-f4b55f8aaddc service nova] Creating event network-vif-unplugged:dcefcad2-da4e-4342-ae6b-72dd932cefec for instance f97a76cd-13ac-4381-a584-711a5408c288 on chh2-master-2 Jun 10 18:57:39.964603 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [req-4d9a7d40-e111-4f1f-9047-c6ba9f08496d req-9b5da40b-7f22-44a1-b79b-f4b55f8aaddc service nova] Instance f97a76cd-13ac-4381-a584-711a5408c288 is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 18:57:39.977126 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-4d9a7d40-e111-4f1f-9047-c6ba9f08496d req-9b5da40b-7f22-44a1-b79b-f4b55f8aaddc service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045252 Jun 10 18:57:39.978094 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3982/7604] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:57:40.949281 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-62d44bbf-7f1c-4d9e-b451-6fecf4c41d84 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:57:40.957745 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-62d44bbf-7f1c-4d9e-b451-6fecf4c41d84 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:57:40.957745 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-62d44bbf-7f1c-4d9e-b451-6fecf4c41d84 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:40.957745 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-62d44bbf-7f1c-4d9e-b451-6fecf4c41d84 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:40.958121 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-62d44bbf-7f1c-4d9e-b451-6fecf4c41d84 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:40.958327 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-62d44bbf-7f1c-4d9e-b451-6fecf4c41d84 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:41.089910 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-62d44bbf-7f1c-4d9e-b451-6fecf4c41d84 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:57:41.098165 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-62d44bbf-7f1c-4d9e-b451-6fecf4c41d84 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1681 microversion: 2.1 time: 0.154124 Jun 10 18:57:41.098738 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3983/7605] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:57:40 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:57:41.991633 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-f305aad8-7fec-405d-96bb-371c3ec6defa req-5a07b4ce-8bf9-45a0-8dcc-3e0a37f4fc44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f97a76cd-13ac-4381-a584-711a5408c288", "tag": "dcefcad2-da4e-4342-ae6b-72dd932cefec"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:57:42.000074 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-f305aad8-7fec-405d-96bb-371c3ec6defa req-5a07b4ce-8bf9-45a0-8dcc-3e0a37f4fc44 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:42.000546 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-f305aad8-7fec-405d-96bb-371c3ec6defa req-5a07b4ce-8bf9-45a0-8dcc-3e0a37f4fc44 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:42.011899 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-f305aad8-7fec-405d-96bb-371c3ec6defa req-5a07b4ce-8bf9-45a0-8dcc-3e0a37f4fc44 service nova] Creating event network-changed:dcefcad2-da4e-4342-ae6b-72dd932cefec for instance f97a76cd-13ac-4381-a584-711a5408c288 on chh2-master-2 Jun 10 18:57:42.017669 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [req-f305aad8-7fec-405d-96bb-371c3ec6defa req-5a07b4ce-8bf9-45a0-8dcc-3e0a37f4fc44 service nova] Instance f97a76cd-13ac-4381-a584-711a5408c288 is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 18:57:42.028894 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-f305aad8-7fec-405d-96bb-371c3ec6defa req-5a07b4ce-8bf9-45a0-8dcc-3e0a37f4fc44 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041155 Jun 10 18:57:42.029563 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3984/7606] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:57:42.115476 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b3c1d2d5-dfa2-4056-a80e-569a5694507f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:57:42.116173 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b3c1d2d5-dfa2-4056-a80e-569a5694507f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:57:42.123260 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b3c1d2d5-dfa2-4056-a80e-569a5694507f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:42.123714 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b3c1d2d5-dfa2-4056-a80e-569a5694507f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:42.124676 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b3c1d2d5-dfa2-4056-a80e-569a5694507f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:42.125119 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b3c1d2d5-dfa2-4056-a80e-569a5694507f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:42.262762 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b3c1d2d5-dfa2-4056-a80e-569a5694507f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:57:42.271143 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b3c1d2d5-dfa2-4056-a80e-569a5694507f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1679 microversion: 2.1 time: 0.159948 Jun 10 18:57:42.271821 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3985/7607] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:57:42 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:57:43.289242 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a2d5700f-cd8e-47ee-84a2-50414974491c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:57:43.289921 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a2d5700f-cd8e-47ee-84a2-50414974491c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:57:43.297254 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a2d5700f-cd8e-47ee-84a2-50414974491c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:43.297703 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a2d5700f-cd8e-47ee-84a2-50414974491c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:43.298455 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a2d5700f-cd8e-47ee-84a2-50414974491c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:43.298891 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a2d5700f-cd8e-47ee-84a2-50414974491c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:43.430016 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a2d5700f-cd8e-47ee-84a2-50414974491c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:57:43.437627 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a2d5700f-cd8e-47ee-84a2-50414974491c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1679 microversion: 2.1 time: 0.152224 Jun 10 18:57:43.438195 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3986/7608] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:57:43 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:57:44.455543 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7a91b55d-05ef-4ac6-a4c6-0b22827b39be tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:57:44.456201 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7a91b55d-05ef-4ac6-a4c6-0b22827b39be tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:57:44.463039 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7a91b55d-05ef-4ac6-a4c6-0b22827b39be tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:44.470789 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7a91b55d-05ef-4ac6-a4c6-0b22827b39be tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:44.470789 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7a91b55d-05ef-4ac6-a4c6-0b22827b39be tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:44.470789 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7a91b55d-05ef-4ac6-a4c6-0b22827b39be tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:44.598090 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7a91b55d-05ef-4ac6-a4c6-0b22827b39be tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:57:44.605691 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7a91b55d-05ef-4ac6-a4c6-0b22827b39be tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1676 microversion: 2.1 time: 0.153968 Jun 10 18:57:44.606256 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3987/7609] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:57:44 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:57:44.621809 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b8f375fc-16c0-4149-b91e-ad0e60fd0c84 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:57:44.622333 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b8f375fc-16c0-4149-b91e-ad0e60fd0c84 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:57:44.628564 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b8f375fc-16c0-4149-b91e-ad0e60fd0c84 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:44.629007 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b8f375fc-16c0-4149-b91e-ad0e60fd0c84 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:44.629761 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b8f375fc-16c0-4149-b91e-ad0e60fd0c84 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:44.630199 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b8f375fc-16c0-4149-b91e-ad0e60fd0c84 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:44.667035 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b8f375fc-16c0-4149-b91e-ad0e60fd0c84 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:44.667485 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b8f375fc-16c0-4149-b91e-ad0e60fd0c84 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:44.668270 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b8f375fc-16c0-4149-b91e-ad0e60fd0c84 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:44.668727 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b8f375fc-16c0-4149-b91e-ad0e60fd0c84 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:44.692383 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-b8f375fc-16c0-4149-b91e-ad0e60fd0c84 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Getting quotas for project 9ee0edfe1ca545a18061642a775747b5. Resources: {'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:57:44.697575 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-b8f375fc-16c0-4149-b91e-ad0e60fd0c84 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Getting quotas for user 9434d247ee1c4143bc2cf07b834417ea and project 9ee0edfe1ca545a18061642a775747b5. Resources: {'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:57:45.147152 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b8f375fc-16c0-4149-b91e-ad0e60fd0c84 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "POST /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288/action" status: 202 len: 0 microversion: 2.1 time: 0.528520 Jun 10 18:57:45.147851 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3988/7610] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:57:44 2022] POST /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288/action => generated 0 bytes in 530 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 18:57:45.156744 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cb058ff6-fcb2-4185-974b-432828c344f7 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:57:45.157474 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cb058ff6-fcb2-4185-974b-432828c344f7 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:57:45.163634 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cb058ff6-fcb2-4185-974b-432828c344f7 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:45.164162 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cb058ff6-fcb2-4185-974b-432828c344f7 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:45.164892 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cb058ff6-fcb2-4185-974b-432828c344f7 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:45.165334 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cb058ff6-fcb2-4185-974b-432828c344f7 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:45.297308 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cb058ff6-fcb2-4185-974b-432828c344f7 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:57:45.304960 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cb058ff6-fcb2-4185-974b-432828c344f7 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1675 microversion: 2.1 time: 0.152882 Jun 10 18:57:45.305526 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3989/7611] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:57:45 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:57:46.322647 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2255595f-e0fc-40f5-9d6a-45cccbfb0e93 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:57:46.323320 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2255595f-e0fc-40f5-9d6a-45cccbfb0e93 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:57:46.330189 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2255595f-e0fc-40f5-9d6a-45cccbfb0e93 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:46.330645 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2255595f-e0fc-40f5-9d6a-45cccbfb0e93 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:46.331537 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2255595f-e0fc-40f5-9d6a-45cccbfb0e93 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:46.332009 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2255595f-e0fc-40f5-9d6a-45cccbfb0e93 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:46.463207 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2255595f-e0fc-40f5-9d6a-45cccbfb0e93 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:57:46.471230 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2255595f-e0fc-40f5-9d6a-45cccbfb0e93 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1675 microversion: 2.1 time: 0.152530 Jun 10 18:57:46.471803 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3990/7612] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:57:46 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:57:47.488907 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c1cb127f-bacd-48ac-b6da-a4e8cb4aa5b2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:57:47.489559 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c1cb127f-bacd-48ac-b6da-a4e8cb4aa5b2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:57:47.496380 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c1cb127f-bacd-48ac-b6da-a4e8cb4aa5b2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:47.496833 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c1cb127f-bacd-48ac-b6da-a4e8cb4aa5b2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:47.497594 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c1cb127f-bacd-48ac-b6da-a4e8cb4aa5b2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:47.498030 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c1cb127f-bacd-48ac-b6da-a4e8cb4aa5b2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:47.517173 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:57:47.644616 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c1cb127f-bacd-48ac-b6da-a4e8cb4aa5b2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:57:47.652071 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c1cb127f-bacd-48ac-b6da-a4e8cb4aa5b2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1675 microversion: 2.1 time: 0.166995 Jun 10 18:57:47.652672 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3991/7613] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:57:47 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:57:47.657556 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-71a05aae-4b4c-4fd2-8904-cf6e4007c9eb req-ff9d2920-3b2c-4d2f-8586-0a925ec35a5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f97a76cd-13ac-4381-a584-711a5408c288", "name": "network-vif-plugged", "status": "completed", "tag": "dcefcad2-da4e-4342-ae6b-72dd932cefec"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:57:47.665142 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-71a05aae-4b4c-4fd2-8904-cf6e4007c9eb req-ff9d2920-3b2c-4d2f-8586-0a925ec35a5c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:47.665574 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-71a05aae-4b4c-4fd2-8904-cf6e4007c9eb req-ff9d2920-3b2c-4d2f-8586-0a925ec35a5c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:47.676939 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-71a05aae-4b4c-4fd2-8904-cf6e4007c9eb req-ff9d2920-3b2c-4d2f-8586-0a925ec35a5c service nova] Creating event network-vif-plugged:dcefcad2-da4e-4342-ae6b-72dd932cefec for instance f97a76cd-13ac-4381-a584-711a5408c288 on chh2-master-2 Jun 10 18:57:47.682615 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [req-71a05aae-4b4c-4fd2-8904-cf6e4007c9eb req-ff9d2920-3b2c-4d2f-8586-0a925ec35a5c service nova] Instance f97a76cd-13ac-4381-a584-711a5408c288 is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 18:57:47.693144 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-71a05aae-4b4c-4fd2-8904-cf6e4007c9eb req-ff9d2920-3b2c-4d2f-8586-0a925ec35a5c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039363 Jun 10 18:57:47.693738 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3992/7614] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:57:48.672610 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0c763848-2f43-4c2b-8fb2-78a7c8e2cb0e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:57:48.673223 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0c763848-2f43-4c2b-8fb2-78a7c8e2cb0e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:57:48.679543 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0c763848-2f43-4c2b-8fb2-78a7c8e2cb0e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:48.680058 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0c763848-2f43-4c2b-8fb2-78a7c8e2cb0e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:48.680904 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0c763848-2f43-4c2b-8fb2-78a7c8e2cb0e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:48.681347 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0c763848-2f43-4c2b-8fb2-78a7c8e2cb0e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:48.815386 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0c763848-2f43-4c2b-8fb2-78a7c8e2cb0e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:57:48.823211 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0c763848-2f43-4c2b-8fb2-78a7c8e2cb0e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1675 microversion: 2.1 time: 0.156741 Jun 10 18:57:48.823783 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3993/7615] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:57:48 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:57:49.094965 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-526c65c3-e0a4-4025-b8dd-4772ebe8728d req-4c5dd126-7e83-4493-b440-46d759849c86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f97a76cd-13ac-4381-a584-711a5408c288", "name": "network-vif-unplugged", "status": "completed", "tag": "dcefcad2-da4e-4342-ae6b-72dd932cefec"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:57:49.100559 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:57:49.106741 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-526c65c3-e0a4-4025-b8dd-4772ebe8728d req-4c5dd126-7e83-4493-b440-46d759849c86 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:49.106741 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-526c65c3-e0a4-4025-b8dd-4772ebe8728d req-4c5dd126-7e83-4493-b440-46d759849c86 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:49.117622 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-526c65c3-e0a4-4025-b8dd-4772ebe8728d req-4c5dd126-7e83-4493-b440-46d759849c86 service nova] Creating event network-vif-unplugged:dcefcad2-da4e-4342-ae6b-72dd932cefec for instance f97a76cd-13ac-4381-a584-711a5408c288 on chh1-master-2 Jun 10 18:57:49.123511 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [req-526c65c3-e0a4-4025-b8dd-4772ebe8728d req-4c5dd126-7e83-4493-b440-46d759849c86 service nova] Instance f97a76cd-13ac-4381-a584-711a5408c288 is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 18:57:49.134926 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-526c65c3-e0a4-4025-b8dd-4772ebe8728d req-4c5dd126-7e83-4493-b440-46d759849c86 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044468 Jun 10 18:57:49.135620 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3994/7616] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:57:49.842545 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8154bfe8-668c-4d18-8abf-d7da07cc077b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:57:49.843278 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8154bfe8-668c-4d18-8abf-d7da07cc077b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:57:49.849716 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8154bfe8-668c-4d18-8abf-d7da07cc077b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:49.850171 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8154bfe8-668c-4d18-8abf-d7da07cc077b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:49.850948 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8154bfe8-668c-4d18-8abf-d7da07cc077b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:49.851386 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8154bfe8-668c-4d18-8abf-d7da07cc077b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:49.989567 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8154bfe8-668c-4d18-8abf-d7da07cc077b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:57:49.997157 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8154bfe8-668c-4d18-8abf-d7da07cc077b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1675 microversion: 2.1 time: 0.160216 Jun 10 18:57:49.998286 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3995/7617] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:57:49 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:57:51.015742 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-aa30c417-b053-4dc6-aab7-822cb6f2942c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:57:51.016477 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-aa30c417-b053-4dc6-aab7-822cb6f2942c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:57:51.023472 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aa30c417-b053-4dc6-aab7-822cb6f2942c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:51.026546 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aa30c417-b053-4dc6-aab7-822cb6f2942c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:51.026546 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aa30c417-b053-4dc6-aab7-822cb6f2942c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:51.026546 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aa30c417-b053-4dc6-aab7-822cb6f2942c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:51.155195 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-aa30c417-b053-4dc6-aab7-822cb6f2942c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:57:51.162756 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-aa30c417-b053-4dc6-aab7-822cb6f2942c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1675 microversion: 2.1 time: 0.151581 Jun 10 18:57:51.163327 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3996/7618] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:57:51 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:57:51.167599 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-10222baf-7ef3-4768-a624-9a37e4fdd546 req-14ae8e2c-af69-41c7-bca5-68017789309a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f97a76cd-13ac-4381-a584-711a5408c288", "tag": "dcefcad2-da4e-4342-ae6b-72dd932cefec"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:57:51.175002 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-10222baf-7ef3-4768-a624-9a37e4fdd546 req-14ae8e2c-af69-41c7-bca5-68017789309a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:51.175447 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-10222baf-7ef3-4768-a624-9a37e4fdd546 req-14ae8e2c-af69-41c7-bca5-68017789309a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:51.187096 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-10222baf-7ef3-4768-a624-9a37e4fdd546 req-14ae8e2c-af69-41c7-bca5-68017789309a service nova] Creating event network-changed:dcefcad2-da4e-4342-ae6b-72dd932cefec for instance f97a76cd-13ac-4381-a584-711a5408c288 on chh1-master-2 Jun 10 18:57:51.192462 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [req-10222baf-7ef3-4768-a624-9a37e4fdd546 req-14ae8e2c-af69-41c7-bca5-68017789309a service nova] Instance f97a76cd-13ac-4381-a584-711a5408c288 is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 18:57:51.203871 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-10222baf-7ef3-4768-a624-9a37e4fdd546 req-14ae8e2c-af69-41c7-bca5-68017789309a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039444 Jun 10 18:57:51.204476 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3997/7619] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:57:52.181416 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c41718b1-ec95-4b49-ba52-85bc16925748 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:57:52.182140 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c41718b1-ec95-4b49-ba52-85bc16925748 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:57:52.189279 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c41718b1-ec95-4b49-ba52-85bc16925748 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:52.189660 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c41718b1-ec95-4b49-ba52-85bc16925748 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:52.190423 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c41718b1-ec95-4b49-ba52-85bc16925748 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:52.190858 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c41718b1-ec95-4b49-ba52-85bc16925748 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:52.351078 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c41718b1-ec95-4b49-ba52-85bc16925748 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:57:52.358984 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c41718b1-ec95-4b49-ba52-85bc16925748 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1675 microversion: 2.1 time: 0.182348 Jun 10 18:57:52.359567 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3998/7620] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:57:52 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1675 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:57:53.376051 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f75050b4-94ce-43a6-bebe-465d41f2372c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:57:53.376766 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f75050b4-94ce-43a6-bebe-465d41f2372c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:57:53.383724 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f75050b4-94ce-43a6-bebe-465d41f2372c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:53.384170 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f75050b4-94ce-43a6-bebe-465d41f2372c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:53.385023 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f75050b4-94ce-43a6-bebe-465d41f2372c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:53.385460 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f75050b4-94ce-43a6-bebe-465d41f2372c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:53.515706 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f75050b4-94ce-43a6-bebe-465d41f2372c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:57:53.523361 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f75050b4-94ce-43a6-bebe-465d41f2372c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1668 microversion: 2.1 time: 0.151088 Jun 10 18:57:53.525588 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 3999/7621] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:57:53 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1668 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:57:53.539469 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ca9acbff-daef-464a-be02-e1c4b825b406 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:57:53.540068 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ca9acbff-daef-464a-be02-e1c4b825b406 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:57:53.545767 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ca9acbff-daef-464a-be02-e1c4b825b406 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:53.546215 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ca9acbff-daef-464a-be02-e1c4b825b406 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:53.546970 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ca9acbff-daef-464a-be02-e1c4b825b406 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:53.547408 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ca9acbff-daef-464a-be02-e1c4b825b406 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:53.675265 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ca9acbff-daef-464a-be02-e1c4b825b406 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:57:53.683243 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ca9acbff-daef-464a-be02-e1c4b825b406 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1668 microversion: 2.1 time: 0.147198 Jun 10 18:57:53.684016 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4000/7622] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:57:53 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1668 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:57:53.699176 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ceccf72c-40e6-4df8-9e4f-225bf78ffac7 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:57:53.699783 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ceccf72c-40e6-4df8-9e4f-225bf78ffac7 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:57:53.706296 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ceccf72c-40e6-4df8-9e4f-225bf78ffac7 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:53.706748 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ceccf72c-40e6-4df8-9e4f-225bf78ffac7 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:53.707641 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ceccf72c-40e6-4df8-9e4f-225bf78ffac7 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:53.708083 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ceccf72c-40e6-4df8-9e4f-225bf78ffac7 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:53.844114 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ceccf72c-40e6-4df8-9e4f-225bf78ffac7 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:57:53.851779 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ceccf72c-40e6-4df8-9e4f-225bf78ffac7 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1668 microversion: 2.1 time: 0.156222 Jun 10 18:57:53.852382 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4001/7623] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:57:53 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1668 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:57:53.869257 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4e64703f-75df-49f0-9731-c9270192f43d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:57:53.871548 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4e64703f-75df-49f0-9731-c9270192f43d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:57:53.876080 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e64703f-75df-49f0-9731-c9270192f43d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:53.876560 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e64703f-75df-49f0-9731-c9270192f43d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:53.877316 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e64703f-75df-49f0-9731-c9270192f43d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:53.877757 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e64703f-75df-49f0-9731-c9270192f43d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:53.903719 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4e64703f-75df-49f0-9731-c9270192f43d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 18:57:54.183010 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4e64703f-75df-49f0-9731-c9270192f43d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "DELETE /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 204 len: 0 microversion: 2.1 time: 0.317187 Jun 10 18:57:54.183613 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4002/7624] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 18:57:53 2022] DELETE /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 18:57:54.192888 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c9f21bfe-2aea-4962-a940-8ba063631cb9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:57:54.193694 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c9f21bfe-2aea-4962-a940-8ba063631cb9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:57:54.199717 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9f21bfe-2aea-4962-a940-8ba063631cb9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:54.200265 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9f21bfe-2aea-4962-a940-8ba063631cb9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:54.201580 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9f21bfe-2aea-4962-a940-8ba063631cb9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:54.202025 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9f21bfe-2aea-4962-a940-8ba063631cb9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:54.334663 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c9f21bfe-2aea-4962-a940-8ba063631cb9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:57:54.342425 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c9f21bfe-2aea-4962-a940-8ba063631cb9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1674 microversion: 2.1 time: 0.153653 Jun 10 18:57:54.343007 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4003/7625] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:57:54 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:57:55.358945 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e81bf6af-cba1-48be-8561-0d414d7c381f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:57:55.359592 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e81bf6af-cba1-48be-8561-0d414d7c381f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:57:55.362459 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:57:55.367693 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e81bf6af-cba1-48be-8561-0d414d7c381f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:55.368145 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e81bf6af-cba1-48be-8561-0d414d7c381f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:55.368939 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e81bf6af-cba1-48be-8561-0d414d7c381f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:55.369376 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e81bf6af-cba1-48be-8561-0d414d7c381f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:55.504141 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e81bf6af-cba1-48be-8561-0d414d7c381f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:57:55.511991 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e81bf6af-cba1-48be-8561-0d414d7c381f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1674 microversion: 2.1 time: 0.156919 Jun 10 18:57:55.512592 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4004/7626] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:57:55 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:57:56.368544 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-3021ebe5-315b-449a-b3df-01ba315ec52a req-3d45d316-1e43-468e-8a9d-c9c242f1ef57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f97a76cd-13ac-4381-a584-711a5408c288", "name": "network-vif-deleted", "tag": "dcefcad2-da4e-4342-ae6b-72dd932cefec"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:57:56.377239 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-3021ebe5-315b-449a-b3df-01ba315ec52a req-3d45d316-1e43-468e-8a9d-c9c242f1ef57 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:56.382200 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-3021ebe5-315b-449a-b3df-01ba315ec52a req-3d45d316-1e43-468e-8a9d-c9c242f1ef57 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:56.389247 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-3021ebe5-315b-449a-b3df-01ba315ec52a req-3d45d316-1e43-468e-8a9d-c9c242f1ef57 service nova] Creating event network-vif-deleted:dcefcad2-da4e-4342-ae6b-72dd932cefec for instance f97a76cd-13ac-4381-a584-711a5408c288 on chh1-master-2 Jun 10 18:57:56.394774 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-3021ebe5-315b-449a-b3df-01ba315ec52a req-3d45d316-1e43-468e-8a9d-c9c242f1ef57 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029699 Jun 10 18:57:56.396541 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4005/7627] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:57:56.532575 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-33751067-8d69-4eb3-9eba-ce344a66867d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:57:56.533475 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-33751067-8d69-4eb3-9eba-ce344a66867d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:57:56.541941 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-33751067-8d69-4eb3-9eba-ce344a66867d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:56.546504 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-33751067-8d69-4eb3-9eba-ce344a66867d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:56.546504 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-33751067-8d69-4eb3-9eba-ce344a66867d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:56.546504 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-33751067-8d69-4eb3-9eba-ce344a66867d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:56.611096 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-33751067-8d69-4eb3-9eba-ce344a66867d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:57:56.618917 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-33751067-8d69-4eb3-9eba-ce344a66867d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 200 len: 1322 microversion: 2.1 time: 0.091598 Jun 10 18:57:56.619420 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4006/7628] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:57:56 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 1322 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:57:57.636031 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b9c17997-5844-461b-bffc-e59b20c15be3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:57:57.636748 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b9c17997-5844-461b-bffc-e59b20c15be3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:57:57.643474 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9c17997-5844-461b-bffc-e59b20c15be3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:57.643922 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9c17997-5844-461b-bffc-e59b20c15be3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:57.644737 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9c17997-5844-461b-bffc-e59b20c15be3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:57.645170 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9c17997-5844-461b-bffc-e59b20c15be3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:57.658551 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-b9c17997-5844-461b-bffc-e59b20c15be3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] HTTP exception thrown: Instance f97a76cd-13ac-4381-a584-711a5408c288 could not be found. Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b9c17997-5844-461b-bffc-e59b20c15be3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Request method failure captured: Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 HTTP/1.1 Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5NYWWZ-ZO6eUaowxYHvN17DzgOyBcRp8mhJxqDpqy8rItuzorWJTwSOIastREFRyZr6c_ChbS_L6xrOAOnpyFVpWaRIYnwPEIqz770DyDVvyPoXIV-sm8ojvCAplLeG2g6jr_K6WyMCpHhf5lcBOzewCyTTCZt4Q13c3it9lc4tPjc Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 9ee0edfe1ca545a18061642a775747b5 Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServerActionsTestJSON-1025700685 Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_9ee0edfe1ca545a18061642a775747b5", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServerActionsTestJSON-1025700685 Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 9ee0edfe1ca545a18061642a775747b5 Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServerActionsTestJSON-1025700685 Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServerActionsTestJSON-1025700685-project Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 9434d247ee1c4143bc2cf07b834417ea Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServerActionsTestJSON-1025700685-project Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: exception: Instance f97a76cd-13ac-4381-a584-711a5408c288 could not be found. Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'f97a76cd-13ac-4381-a584-711a5408c288'} Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f97a76cd-13ac-4381-a584-711a5408c288 could not be found. Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f97a76cd-13ac-4381-a584-711a5408c288 could not be found. Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:57:57.660146 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:57:57.665936 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:57:57.665936 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:57:57.665936 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:57:57.665936 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:57:57.665936 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:57:57.665936 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f97a76cd-13ac-4381-a584-711a5408c288 could not be found. Jun 10 18:57:57.665936 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:57:57.665936 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b9c17997-5844-461b-bffc-e59b20c15be3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Returning 404 to user: Instance f97a76cd-13ac-4381-a584-711a5408c288 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:57:57.665936 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b9c17997-5844-461b-bffc-e59b20c15be3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 404 len: 111 microversion: 2.1 time: 0.029363 Jun 10 18:57:57.665936 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4007/7629] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:57:57 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 18:57:57.678525 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6406f8a1-ad06-445f-988e-0b1eec1dfafa tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:57:57.679131 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6406f8a1-ad06-445f-988e-0b1eec1dfafa tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:57:57.685066 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6406f8a1-ad06-445f-988e-0b1eec1dfafa tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:57.685520 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6406f8a1-ad06-445f-988e-0b1eec1dfafa tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:57.686277 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6406f8a1-ad06-445f-988e-0b1eec1dfafa tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:57.686717 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6406f8a1-ad06-445f-988e-0b1eec1dfafa tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:57.699658 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-6406f8a1-ad06-445f-988e-0b1eec1dfafa tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] HTTP exception thrown: Instance f97a76cd-13ac-4381-a584-711a5408c288 could not be found. Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6406f8a1-ad06-445f-988e-0b1eec1dfafa tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Request method failure captured: Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 HTTP/1.1 Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5NYWWZ-ZO6eUaowxYHvN17DzgOyBcRp8mhJxqDpqy8rItuzorWJTwSOIastREFRyZr6c_ChbS_L6xrOAOnpyFVpWaRIYnwPEIqz770DyDVvyPoXIV-sm8ojvCAplLeG2g6jr_K6WyMCpHhf5lcBOzewCyTTCZt4Q13c3it9lc4tPjc Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 9ee0edfe1ca545a18061642a775747b5 Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServerActionsTestJSON-1025700685 Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_9ee0edfe1ca545a18061642a775747b5", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServerActionsTestJSON-1025700685 Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 9ee0edfe1ca545a18061642a775747b5 Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServerActionsTestJSON-1025700685 Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServerActionsTestJSON-1025700685-project Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 9434d247ee1c4143bc2cf07b834417ea Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServerActionsTestJSON-1025700685-project Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: exception: Instance f97a76cd-13ac-4381-a584-711a5408c288 could not be found. Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'f97a76cd-13ac-4381-a584-711a5408c288'} Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f97a76cd-13ac-4381-a584-711a5408c288 could not be found. Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f97a76cd-13ac-4381-a584-711a5408c288 could not be found. Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 18:57:57.701189 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:57:57.706480 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 18:57:57.706480 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 18:57:57.706480 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 18:57:57.706480 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 18:57:57.706480 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 18:57:57.706480 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f97a76cd-13ac-4381-a584-711a5408c288 could not be found. Jun 10 18:57:57.706480 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 18:57:57.706480 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6406f8a1-ad06-445f-988e-0b1eec1dfafa tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Returning 404 to user: Instance f97a76cd-13ac-4381-a584-711a5408c288 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 18:57:57.706480 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6406f8a1-ad06-445f-988e-0b1eec1dfafa tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 404 len: 111 microversion: 2.1 time: 0.027701 Jun 10 18:57:57.706480 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4008/7630] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:57:57 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 18:57:57.749166 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ab494b41-4591-45dd-b9c3-270c62fd4ee1 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1125991738", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "0fb8209d-4273-43eb-a7e9-ab31438ebf09"}], "security_groups": [{"name": "tempest-securitygroup--1864491070"}], "key_name": "tempest-keypair-434241289", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:57:57.850224 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-ab494b41-4591-45dd-b9c3-270c62fd4ee1 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] validate_networks() for [('0fb8209d-4273-43eb-a7e9-ab31438ebf09', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 18:57:58.312646 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-ab494b41-4591-45dd-b9c3-270c62fd4ee1 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:57:58.313072 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-ab494b41-4591-45dd-b9c3-270c62fd4ee1 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:57:58.313569 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-ab494b41-4591-45dd-b9c3-270c62fd4ee1 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:57:58.313964 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-ab494b41-4591-45dd-b9c3-270c62fd4ee1 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:57:58.314378 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-ab494b41-4591-45dd-b9c3-270c62fd4ee1 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:57:58.326055 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ab494b41-4591-45dd-b9c3-270c62fd4ee1 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:58.326468 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ab494b41-4591-45dd-b9c3-270c62fd4ee1 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:58.327271 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ab494b41-4591-45dd-b9c3-270c62fd4ee1 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:58.327711 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ab494b41-4591-45dd-b9c3-270c62fd4ee1 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:58.345265 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-ab494b41-4591-45dd-b9c3-270c62fd4ee1 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Getting quotas for project 9ee0edfe1ca545a18061642a775747b5. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:57:58.350584 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-ab494b41-4591-45dd-b9c3-270c62fd4ee1 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Getting quotas for user 9434d247ee1c4143bc2cf07b834417ea and project 9ee0edfe1ca545a18061642a775747b5. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:57:58.363011 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ab494b41-4591-45dd-b9c3-270c62fd4ee1 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 18:57:58.365311 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ab494b41-4591-45dd-b9c3-270c62fd4ee1 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 18:57:58.475586 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ab494b41-4591-45dd-b9c3-270c62fd4ee1 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.730170 Jun 10 18:57:58.476233 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4009/7631] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 18:57:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 10 18:57:58.486078 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f9145b93-078d-4d17-9dc8-7820a8bc79f9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:57:58.486687 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f9145b93-078d-4d17-9dc8-7820a8bc79f9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:57:58.540139 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f9145b93-078d-4d17-9dc8-7820a8bc79f9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:57:58.548994 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f9145b93-078d-4d17-9dc8-7820a8bc79f9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1238 microversion: 2.1 time: 0.066206 Jun 10 18:57:58.549612 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4010/7632] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:57:58 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:57:59.566034 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9571474c-e07b-4b3f-9ec4-6129fb3f82a2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:57:59.566717 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9571474c-e07b-4b3f-9ec4-6129fb3f82a2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:57:59.573639 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9571474c-e07b-4b3f-9ec4-6129fb3f82a2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:59.574103 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9571474c-e07b-4b3f-9ec4-6129fb3f82a2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:59.576026 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9571474c-e07b-4b3f-9ec4-6129fb3f82a2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:57:59.576496 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9571474c-e07b-4b3f-9ec4-6129fb3f82a2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:57:59.580758 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:57:59.644383 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9571474c-e07b-4b3f-9ec4-6129fb3f82a2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:57:59.651929 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9571474c-e07b-4b3f-9ec4-6129fb3f82a2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1234 microversion: 2.1 time: 0.089909 Jun 10 18:57:59.652528 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4011/7633] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:57:59 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1234 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:58:00.671000 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9f019869-f730-430c-afa4-c088ae2dafaa tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:58:00.671742 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9f019869-f730-430c-afa4-c088ae2dafaa tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:58:00.679414 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f019869-f730-430c-afa4-c088ae2dafaa tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:58:00.684910 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f019869-f730-430c-afa4-c088ae2dafaa tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:58:00.684910 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f019869-f730-430c-afa4-c088ae2dafaa tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:58:00.684910 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9f019869-f730-430c-afa4-c088ae2dafaa tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:58:00.747499 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9f019869-f730-430c-afa4-c088ae2dafaa tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:58:00.755128 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9f019869-f730-430c-afa4-c088ae2dafaa tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1296 microversion: 2.1 time: 0.088500 Jun 10 18:58:00.755913 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4012/7634] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:58:00 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1296 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:58:01.774692 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6ce0bea8-51d6-410c-8f5d-61b8281e80f9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:58:01.775591 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6ce0bea8-51d6-410c-8f5d-61b8281e80f9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:58:01.783314 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6ce0bea8-51d6-410c-8f5d-61b8281e80f9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:58:01.784045 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6ce0bea8-51d6-410c-8f5d-61b8281e80f9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:58:01.784848 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6ce0bea8-51d6-410c-8f5d-61b8281e80f9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:58:01.785319 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6ce0bea8-51d6-410c-8f5d-61b8281e80f9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:58:02.204036 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6ce0bea8-51d6-410c-8f5d-61b8281e80f9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:58:02.211748 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6ce0bea8-51d6-410c-8f5d-61b8281e80f9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1364 microversion: 2.1 time: 0.442502 Jun 10 18:58:02.212793 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4013/7635] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:58:01 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1364 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:58:02.223103 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-7dcd2d30-d5e1-47c7-ad8e-e2b1ace1330e req-979fe4da-b03e-4b01-8711-929b99e5f91d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3", "tag": "d361039d-5ded-45d8-850f-6b4cec0e7222"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:58:02.231924 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-7dcd2d30-d5e1-47c7-ad8e-e2b1ace1330e req-979fe4da-b03e-4b01-8711-929b99e5f91d service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:58:02.232495 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-7dcd2d30-d5e1-47c7-ad8e-e2b1ace1330e req-979fe4da-b03e-4b01-8711-929b99e5f91d service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:58:02.244499 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-7dcd2d30-d5e1-47c7-ad8e-e2b1ace1330e req-979fe4da-b03e-4b01-8711-929b99e5f91d service nova] Creating event network-changed:d361039d-5ded-45d8-850f-6b4cec0e7222 for instance 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 on chh1-master-2 Jun 10 18:58:02.253480 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-7dcd2d30-d5e1-47c7-ad8e-e2b1ace1330e req-979fe4da-b03e-4b01-8711-929b99e5f91d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039254 Jun 10 18:58:02.254690 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4014/7636] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 18:58:03.230726 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1edfa3a8-ac86-4a72-9324-6303b9064c4f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:58:03.232329 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1edfa3a8-ac86-4a72-9324-6303b9064c4f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:58:03.238368 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1edfa3a8-ac86-4a72-9324-6303b9064c4f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:58:03.238821 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1edfa3a8-ac86-4a72-9324-6303b9064c4f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:58:03.239589 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1edfa3a8-ac86-4a72-9324-6303b9064c4f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:58:03.240031 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1edfa3a8-ac86-4a72-9324-6303b9064c4f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:58:03.375151 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1edfa3a8-ac86-4a72-9324-6303b9064c4f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:58:03.383262 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1edfa3a8-ac86-4a72-9324-6303b9064c4f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1364 microversion: 2.1 time: 0.157624 Jun 10 18:58:03.383764 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4015/7637] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:58:03 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:58:04.401157 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-68b6ee1b-ac16-4aa4-b9fc-219e217fec40 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:58:04.401754 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-68b6ee1b-ac16-4aa4-b9fc-219e217fec40 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:58:04.409284 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-68b6ee1b-ac16-4aa4-b9fc-219e217fec40 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:58:04.409736 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-68b6ee1b-ac16-4aa4-b9fc-219e217fec40 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:58:04.410503 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-68b6ee1b-ac16-4aa4-b9fc-219e217fec40 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:58:04.410943 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-68b6ee1b-ac16-4aa4-b9fc-219e217fec40 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:58:04.551277 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-68b6ee1b-ac16-4aa4-b9fc-219e217fec40 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:58:04.559030 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-68b6ee1b-ac16-4aa4-b9fc-219e217fec40 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1364 microversion: 2.1 time: 0.161748 Jun 10 18:58:04.559844 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4016/7638] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:58:04 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:58:05.576286 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9915007b-5768-4a75-92f7-9746351b193b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:58:05.577035 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9915007b-5768-4a75-92f7-9746351b193b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:58:05.583923 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9915007b-5768-4a75-92f7-9746351b193b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:58:05.584422 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9915007b-5768-4a75-92f7-9746351b193b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:58:05.585204 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9915007b-5768-4a75-92f7-9746351b193b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:58:05.585649 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9915007b-5768-4a75-92f7-9746351b193b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:58:05.716088 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9915007b-5768-4a75-92f7-9746351b193b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:58:05.723587 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9915007b-5768-4a75-92f7-9746351b193b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1364 microversion: 2.1 time: 0.151236 Jun 10 18:58:05.724151 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4017/7639] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:58:05 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:58:06.740772 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-75fc3453-90aa-4edd-8d49-111560354d68 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:58:06.741439 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-75fc3453-90aa-4edd-8d49-111560354d68 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:58:06.748139 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-75fc3453-90aa-4edd-8d49-111560354d68 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:58:06.748622 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-75fc3453-90aa-4edd-8d49-111560354d68 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:58:06.749382 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-75fc3453-90aa-4edd-8d49-111560354d68 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:58:06.749817 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-75fc3453-90aa-4edd-8d49-111560354d68 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:58:06.880059 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-75fc3453-90aa-4edd-8d49-111560354d68 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:58:06.887730 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-75fc3453-90aa-4edd-8d49-111560354d68 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1364 microversion: 2.1 time: 0.150877 Jun 10 18:58:06.888280 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4018/7640] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:58:06 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:58:07.904790 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c4181530-82f5-4700-ae39-7e427542a719 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:58:07.905397 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c4181530-82f5-4700-ae39-7e427542a719 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:58:07.912130 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c4181530-82f5-4700-ae39-7e427542a719 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:58:07.912717 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c4181530-82f5-4700-ae39-7e427542a719 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:58:07.913493 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c4181530-82f5-4700-ae39-7e427542a719 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:58:07.913933 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c4181530-82f5-4700-ae39-7e427542a719 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:58:08.046849 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c4181530-82f5-4700-ae39-7e427542a719 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:58:08.054387 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c4181530-82f5-4700-ae39-7e427542a719 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1364 microversion: 2.1 time: 0.153463 Jun 10 18:58:08.055154 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4019/7641] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:58:07 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:58:08.104468 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-8f36eb09-f83a-4406-b5e5-67b326661f53 req-bfcdf9dd-fd07-4f2c-8431-fb302996c47a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3", "name": "network-vif-plugged", "status": "completed", "tag": "d361039d-5ded-45d8-850f-6b4cec0e7222"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:58:08.113000 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-8f36eb09-f83a-4406-b5e5-67b326661f53 req-bfcdf9dd-fd07-4f2c-8431-fb302996c47a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:58:08.113456 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-8f36eb09-f83a-4406-b5e5-67b326661f53 req-bfcdf9dd-fd07-4f2c-8431-fb302996c47a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:58:08.125535 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-8f36eb09-f83a-4406-b5e5-67b326661f53 req-bfcdf9dd-fd07-4f2c-8431-fb302996c47a service nova] Creating event network-vif-plugged:d361039d-5ded-45d8-850f-6b4cec0e7222 for instance 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 on chh1-master-2 Jun 10 18:58:08.129756 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-8f36eb09-f83a-4406-b5e5-67b326661f53 req-bfcdf9dd-fd07-4f2c-8431-fb302996c47a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029195 Jun 10 18:58:08.130333 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4020/7642] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:58:09.069540 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:58:09.070388 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=8 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:58:09.075292 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0fdffecc-9ce0-49fc-8340-a61fab47d70c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:58:09.076736 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0fdffecc-9ce0-49fc-8340-a61fab47d70c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:58:09.082888 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0fdffecc-9ce0-49fc-8340-a61fab47d70c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:58:09.083344 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0fdffecc-9ce0-49fc-8340-a61fab47d70c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:58:09.084110 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0fdffecc-9ce0-49fc-8340-a61fab47d70c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:58:09.084582 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0fdffecc-9ce0-49fc-8340-a61fab47d70c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:58:09.217594 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0fdffecc-9ce0-49fc-8340-a61fab47d70c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:58:09.225217 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0fdffecc-9ce0-49fc-8340-a61fab47d70c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1364 microversion: 2.1 time: 0.156652 Jun 10 18:58:09.225776 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4021/7643] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:58:09 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:58:10.242964 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ff5f45df-2437-4d29-9e83-1748c585f717 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:58:10.243623 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ff5f45df-2437-4d29-9e83-1748c585f717 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:58:10.251676 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ff5f45df-2437-4d29-9e83-1748c585f717 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:58:10.253938 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ff5f45df-2437-4d29-9e83-1748c585f717 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:58:10.253938 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ff5f45df-2437-4d29-9e83-1748c585f717 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:58:10.253938 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ff5f45df-2437-4d29-9e83-1748c585f717 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:58:10.383931 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ff5f45df-2437-4d29-9e83-1748c585f717 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:58:10.391785 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ff5f45df-2437-4d29-9e83-1748c585f717 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1551 microversion: 2.1 time: 0.152700 Jun 10 18:58:10.392374 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4022/7644] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:58:10 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1551 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:58:10.408774 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-86d6eaab-d23b-4ed0-a397-391b8fc4d079 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:58:10.409274 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-86d6eaab-d23b-4ed0-a397-391b8fc4d079 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:58:10.415189 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86d6eaab-d23b-4ed0-a397-391b8fc4d079 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:58:10.415652 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86d6eaab-d23b-4ed0-a397-391b8fc4d079 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:58:10.416461 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86d6eaab-d23b-4ed0-a397-391b8fc4d079 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:58:10.416913 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86d6eaab-d23b-4ed0-a397-391b8fc4d079 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:58:10.492603 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-86d6eaab-d23b-4ed0-a397-391b8fc4d079 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087423 Jun 10 18:58:10.493210 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4023/7645] 10.222.0.35 () {58 vars in 1274 bytes} [Fri Jun 10 18:58:10 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:58:11.509662 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-2a576274-a8ea-4d8a-a4ac-2bb1907a16b1 req-cd8a47fd-df29-46ac-baae-439bc3c31387 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3", "tag": "d361039d-5ded-45d8-850f-6b4cec0e7222"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:58:11.518263 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-2a576274-a8ea-4d8a-a4ac-2bb1907a16b1 req-cd8a47fd-df29-46ac-baae-439bc3c31387 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:58:11.518750 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-2a576274-a8ea-4d8a-a4ac-2bb1907a16b1 req-cd8a47fd-df29-46ac-baae-439bc3c31387 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:58:11.531033 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-2a576274-a8ea-4d8a-a4ac-2bb1907a16b1 req-cd8a47fd-df29-46ac-baae-439bc3c31387 service nova] Creating event network-changed:d361039d-5ded-45d8-850f-6b4cec0e7222 for instance 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 on chh1-master-2 Jun 10 18:58:11.547285 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-2a576274-a8ea-4d8a-a4ac-2bb1907a16b1 req-cd8a47fd-df29-46ac-baae-439bc3c31387 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031447 Jun 10 18:58:11.547285 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4024/7646] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:58:50.237553 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4cbb9775-028a-4acf-af23-81dbe414bc68 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:58:50.238255 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4cbb9775-028a-4acf-af23-81dbe414bc68 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:58:50.240876 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:58:50.241655 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=68 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:58:50.246486 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4cbb9775-028a-4acf-af23-81dbe414bc68 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:58:50.246942 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4cbb9775-028a-4acf-af23-81dbe414bc68 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:58:50.247757 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4cbb9775-028a-4acf-af23-81dbe414bc68 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:58:50.248201 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4cbb9775-028a-4acf-af23-81dbe414bc68 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:58:50.378324 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4cbb9775-028a-4acf-af23-81dbe414bc68 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:58:50.386446 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4cbb9775-028a-4acf-af23-81dbe414bc68 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1670 microversion: 2.1 time: 0.153638 Jun 10 18:58:50.387029 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4025/7647] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:58:50 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:58:50.403343 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f86eb182-8fe9-486b-ac11-d985cd155089 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08fbba12-020c-4342-a3c6-b2690ca654ac"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:58:50.404459 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f86eb182-8fe9-486b-ac11-d985cd155089 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:58:50.411276 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f86eb182-8fe9-486b-ac11-d985cd155089 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:58:50.411737 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f86eb182-8fe9-486b-ac11-d985cd155089 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:58:50.412554 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f86eb182-8fe9-486b-ac11-d985cd155089 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:58:50.413005 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f86eb182-8fe9-486b-ac11-d985cd155089 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:58:51.117543 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f86eb182-8fe9-486b-ac11-d985cd155089 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "POST /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.717867 Jun 10 18:58:51.118198 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4026/7648] 10.222.0.35 () {60 vars in 1322 bytes} [Fri Jun 10 18:58:50 2022] POST /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3/os-volume_attachments => generated 194 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:59:02.806988 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-009f51e3-cd84-4814-89cd-af0719f243f3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:59:02.808148 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-009f51e3-cd84-4814-89cd-af0719f243f3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:02.811183 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:59:02.811992 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:59:02.817272 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-009f51e3-cd84-4814-89cd-af0719f243f3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:02.817720 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-009f51e3-cd84-4814-89cd-af0719f243f3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:02.818478 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-009f51e3-cd84-4814-89cd-af0719f243f3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:02.818913 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-009f51e3-cd84-4814-89cd-af0719f243f3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:02.849182 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-009f51e3-cd84-4814-89cd-af0719f243f3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:02.855223 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-009f51e3-cd84-4814-89cd-af0719f243f3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Old instance type m1.heat2, new instance type m1.heat {{(pid=126595) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 10 18:59:02.862778 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-009f51e3-cd84-4814-89cd-af0719f243f3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 18:59:02.863197 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-009f51e3-cd84-4814-89cd-af0719f243f3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 18:59:02.863676 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-009f51e3-cd84-4814-89cd-af0719f243f3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 18:59:02.864084 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-009f51e3-cd84-4814-89cd-af0719f243f3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 18:59:02.864518 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-009f51e3-cd84-4814-89cd-af0719f243f3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 18:59:03.053917 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-009f51e3-cd84-4814-89cd-af0719f243f3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "POST /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3/action" status: 202 len: 0 microversion: 2.1 time: 0.250909 Jun 10 18:59:03.054553 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4027/7649] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:59:02 2022] POST /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 18:59:03.062211 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-014d75e6-cc35-48b4-9b46-c1b2266efa26 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:03.063016 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-014d75e6-cc35-48b4-9b46-c1b2266efa26 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:03.069686 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-014d75e6-cc35-48b4-9b46-c1b2266efa26 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:03.070500 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-014d75e6-cc35-48b4-9b46-c1b2266efa26 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:03.070953 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-014d75e6-cc35-48b4-9b46-c1b2266efa26 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:03.071392 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-014d75e6-cc35-48b4-9b46-c1b2266efa26 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:03.208520 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-014d75e6-cc35-48b4-9b46-c1b2266efa26 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:03.220767 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-014d75e6-cc35-48b4-9b46-c1b2266efa26 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1725 microversion: 2.1 time: 0.162098 Jun 10 18:59:03.221410 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4028/7650] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:03 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:04.238387 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fd868dc2-baa4-4303-98a3-17611e028f5a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:04.240001 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fd868dc2-baa4-4303-98a3-17611e028f5a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:04.247085 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd868dc2-baa4-4303-98a3-17611e028f5a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:04.247545 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd868dc2-baa4-4303-98a3-17611e028f5a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:04.248527 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd868dc2-baa4-4303-98a3-17611e028f5a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:04.248978 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd868dc2-baa4-4303-98a3-17611e028f5a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:04.394347 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fd868dc2-baa4-4303-98a3-17611e028f5a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:04.402694 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fd868dc2-baa4-4303-98a3-17611e028f5a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1725 microversion: 2.1 time: 0.168306 Jun 10 18:59:04.403267 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4029/7651] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:04 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:59:05.420276 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-111f90b5-4b2f-496e-b776-ca309a369523 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:05.420929 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-111f90b5-4b2f-496e-b776-ca309a369523 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:05.428120 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-111f90b5-4b2f-496e-b776-ca309a369523 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:05.428621 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-111f90b5-4b2f-496e-b776-ca309a369523 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:05.429413 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-111f90b5-4b2f-496e-b776-ca309a369523 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:05.429850 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-111f90b5-4b2f-496e-b776-ca309a369523 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:05.563946 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-111f90b5-4b2f-496e-b776-ca309a369523 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:05.572251 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-111f90b5-4b2f-496e-b776-ca309a369523 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1725 microversion: 2.1 time: 0.156107 Jun 10 18:59:05.572854 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4030/7652] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:05 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:06.589978 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8500e22d-f907-43e3-853c-86624f283355 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:06.590639 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8500e22d-f907-43e3-853c-86624f283355 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:06.597401 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8500e22d-f907-43e3-853c-86624f283355 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:06.597856 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8500e22d-f907-43e3-853c-86624f283355 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:06.598615 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8500e22d-f907-43e3-853c-86624f283355 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:06.599053 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8500e22d-f907-43e3-853c-86624f283355 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:06.725563 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8500e22d-f907-43e3-853c-86624f283355 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:06.733605 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8500e22d-f907-43e3-853c-86624f283355 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1730 microversion: 2.1 time: 0.147531 Jun 10 18:59:06.734181 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4031/7653] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:06 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:07.750865 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6f80e10c-2e3d-4702-b2c7-88a5c4a4d73d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:07.751522 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6f80e10c-2e3d-4702-b2c7-88a5c4a4d73d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:07.759299 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6f80e10c-2e3d-4702-b2c7-88a5c4a4d73d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:07.759757 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6f80e10c-2e3d-4702-b2c7-88a5c4a4d73d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:07.760555 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6f80e10c-2e3d-4702-b2c7-88a5c4a4d73d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:07.761008 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6f80e10c-2e3d-4702-b2c7-88a5c4a4d73d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:07.898045 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6f80e10c-2e3d-4702-b2c7-88a5c4a4d73d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:07.906097 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6f80e10c-2e3d-4702-b2c7-88a5c4a4d73d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1730 microversion: 2.1 time: 0.159134 Jun 10 18:59:07.906669 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4032/7654] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:07 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:08.923039 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-499ed756-7e80-42ac-83e5-d332e7503f0a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:08.923742 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-499ed756-7e80-42ac-83e5-d332e7503f0a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:08.930508 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-499ed756-7e80-42ac-83e5-d332e7503f0a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:08.930968 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-499ed756-7e80-42ac-83e5-d332e7503f0a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:08.931741 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-499ed756-7e80-42ac-83e5-d332e7503f0a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:08.932189 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-499ed756-7e80-42ac-83e5-d332e7503f0a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:09.062565 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-499ed756-7e80-42ac-83e5-d332e7503f0a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:09.071208 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-499ed756-7e80-42ac-83e5-d332e7503f0a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1730 microversion: 2.1 time: 0.152131 Jun 10 18:59:09.071780 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4033/7655] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:08 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:10.088189 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b4d8638f-4ac6-487a-a672-cc0cd590ad0b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:10.088940 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b4d8638f-4ac6-487a-a672-cc0cd590ad0b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:10.096322 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b4d8638f-4ac6-487a-a672-cc0cd590ad0b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:10.096802 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b4d8638f-4ac6-487a-a672-cc0cd590ad0b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:10.097580 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b4d8638f-4ac6-487a-a672-cc0cd590ad0b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:10.098030 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b4d8638f-4ac6-487a-a672-cc0cd590ad0b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:10.227372 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b4d8638f-4ac6-487a-a672-cc0cd590ad0b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:10.235468 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b4d8638f-4ac6-487a-a672-cc0cd590ad0b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1730 microversion: 2.1 time: 0.151216 Jun 10 18:59:10.236067 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4034/7656] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:10 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:11.252652 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-db4305fc-e161-419f-996d-9f4b38a233bb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:11.253299 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-db4305fc-e161-419f-996d-9f4b38a233bb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:11.260447 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-db4305fc-e161-419f-996d-9f4b38a233bb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:11.260907 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-db4305fc-e161-419f-996d-9f4b38a233bb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:11.261673 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-db4305fc-e161-419f-996d-9f4b38a233bb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:11.262118 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-db4305fc-e161-419f-996d-9f4b38a233bb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:11.392938 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-db4305fc-e161-419f-996d-9f4b38a233bb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:11.401128 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-db4305fc-e161-419f-996d-9f4b38a233bb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1730 microversion: 2.1 time: 0.152382 Jun 10 18:59:11.401706 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4035/7657] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:11 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:12.418383 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-578dfd43-4c3f-4edc-83a1-194a62550eeb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:12.419063 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-578dfd43-4c3f-4edc-83a1-194a62550eeb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:12.426311 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-578dfd43-4c3f-4edc-83a1-194a62550eeb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:12.426769 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-578dfd43-4c3f-4edc-83a1-194a62550eeb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:12.427540 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-578dfd43-4c3f-4edc-83a1-194a62550eeb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:12.427985 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-578dfd43-4c3f-4edc-83a1-194a62550eeb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:12.554901 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-578dfd43-4c3f-4edc-83a1-194a62550eeb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:12.562957 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-578dfd43-4c3f-4edc-83a1-194a62550eeb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1730 microversion: 2.1 time: 0.148516 Jun 10 18:59:12.563523 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4036/7658] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:12 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:13.579112 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f3e24ea6-9223-45b8-b781-a6a0b61975e0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:13.579774 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f3e24ea6-9223-45b8-b781-a6a0b61975e0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:13.587110 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f3e24ea6-9223-45b8-b781-a6a0b61975e0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:13.587565 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f3e24ea6-9223-45b8-b781-a6a0b61975e0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:13.588349 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f3e24ea6-9223-45b8-b781-a6a0b61975e0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:13.588793 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f3e24ea6-9223-45b8-b781-a6a0b61975e0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:13.721558 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f3e24ea6-9223-45b8-b781-a6a0b61975e0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:13.729508 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f3e24ea6-9223-45b8-b781-a6a0b61975e0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1730 microversion: 2.1 time: 0.154313 Jun 10 18:59:13.730078 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4037/7659] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:13 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:14.746819 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c5175f71-d462-449c-886e-65fbe7b79131 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:14.749650 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c5175f71-d462-449c-886e-65fbe7b79131 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:14.755193 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c5175f71-d462-449c-886e-65fbe7b79131 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:14.755650 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c5175f71-d462-449c-886e-65fbe7b79131 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:14.756452 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c5175f71-d462-449c-886e-65fbe7b79131 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:14.756900 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c5175f71-d462-449c-886e-65fbe7b79131 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:14.888227 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c5175f71-d462-449c-886e-65fbe7b79131 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:14.896825 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c5175f71-d462-449c-886e-65fbe7b79131 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1730 microversion: 2.1 time: 0.153946 Jun 10 18:59:14.897414 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4038/7660] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:14 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:15.915176 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fa9b5630-f8bb-4ef5-bf96-d106b089303f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:15.915885 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fa9b5630-f8bb-4ef5-bf96-d106b089303f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:15.922622 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa9b5630-f8bb-4ef5-bf96-d106b089303f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:15.923074 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa9b5630-f8bb-4ef5-bf96-d106b089303f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:15.923835 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa9b5630-f8bb-4ef5-bf96-d106b089303f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:15.924271 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa9b5630-f8bb-4ef5-bf96-d106b089303f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:16.058627 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fa9b5630-f8bb-4ef5-bf96-d106b089303f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:16.066634 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fa9b5630-f8bb-4ef5-bf96-d106b089303f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1730 microversion: 2.1 time: 0.155307 Jun 10 18:59:16.067187 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4039/7661] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:15 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:17.139896 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-662cb3d6-5e69-4914-aab3-7e2401f430c5 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:17.140526 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-662cb3d6-5e69-4914-aab3-7e2401f430c5 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:17.147304 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-662cb3d6-5e69-4914-aab3-7e2401f430c5 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:17.147755 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-662cb3d6-5e69-4914-aab3-7e2401f430c5 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:17.148548 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-662cb3d6-5e69-4914-aab3-7e2401f430c5 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:17.148983 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-662cb3d6-5e69-4914-aab3-7e2401f430c5 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:17.276551 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-662cb3d6-5e69-4914-aab3-7e2401f430c5 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:17.284551 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-662cb3d6-5e69-4914-aab3-7e2401f430c5 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1730 microversion: 2.1 time: 0.204790 Jun 10 18:59:17.285116 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4040/7662] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:17 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1730 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:18.301637 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7795c64e-6a0f-40a0-a69c-087a194ed60a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:18.302354 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7795c64e-6a0f-40a0-a69c-087a194ed60a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:18.309196 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7795c64e-6a0f-40a0-a69c-087a194ed60a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:18.309658 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7795c64e-6a0f-40a0-a69c-087a194ed60a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:18.310434 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7795c64e-6a0f-40a0-a69c-087a194ed60a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:18.310919 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7795c64e-6a0f-40a0-a69c-087a194ed60a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:18.440633 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7795c64e-6a0f-40a0-a69c-087a194ed60a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:18.449433 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7795c64e-6a0f-40a0-a69c-087a194ed60a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1730 microversion: 2.1 time: 0.151667 Jun 10 18:59:18.450009 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4041/7663] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:18 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:19.467164 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-754f791a-de95-4dfc-a9bd-150290743deb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:19.467775 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-754f791a-de95-4dfc-a9bd-150290743deb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:19.474673 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-754f791a-de95-4dfc-a9bd-150290743deb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:19.475123 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-754f791a-de95-4dfc-a9bd-150290743deb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:19.475887 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-754f791a-de95-4dfc-a9bd-150290743deb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:19.476341 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-754f791a-de95-4dfc-a9bd-150290743deb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:19.480195 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:59:19.606590 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-754f791a-de95-4dfc-a9bd-150290743deb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:19.615178 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-754f791a-de95-4dfc-a9bd-150290743deb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1730 microversion: 2.1 time: 0.151841 Jun 10 18:59:19.615754 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4042/7664] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:19 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:20.632760 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-392b6557-9da4-4ff3-a562-1bacea58225c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:20.633466 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-392b6557-9da4-4ff3-a562-1bacea58225c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:20.640266 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-392b6557-9da4-4ff3-a562-1bacea58225c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:20.640759 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-392b6557-9da4-4ff3-a562-1bacea58225c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:20.641540 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-392b6557-9da4-4ff3-a562-1bacea58225c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:20.641992 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-392b6557-9da4-4ff3-a562-1bacea58225c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:20.770961 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-392b6557-9da4-4ff3-a562-1bacea58225c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:20.779233 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-392b6557-9da4-4ff3-a562-1bacea58225c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1730 microversion: 2.1 time: 0.150652 Jun 10 18:59:20.779806 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4043/7665] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:20 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:21.796851 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fd5389ac-2686-4209-854b-609d7278e134 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:21.797517 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fd5389ac-2686-4209-854b-609d7278e134 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:21.804972 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd5389ac-2686-4209-854b-609d7278e134 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:21.805416 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd5389ac-2686-4209-854b-609d7278e134 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:21.806227 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd5389ac-2686-4209-854b-609d7278e134 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:21.806675 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fd5389ac-2686-4209-854b-609d7278e134 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:21.941109 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fd5389ac-2686-4209-854b-609d7278e134 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:21.949123 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fd5389ac-2686-4209-854b-609d7278e134 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1730 microversion: 2.1 time: 0.156209 Jun 10 18:59:21.949713 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4044/7666] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:21 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:22.966238 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-72778aed-d76a-4db9-997a-11bea257ed78 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:22.966910 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-72778aed-d76a-4db9-997a-11bea257ed78 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:22.973606 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72778aed-d76a-4db9-997a-11bea257ed78 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:22.974059 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72778aed-d76a-4db9-997a-11bea257ed78 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:22.974823 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72778aed-d76a-4db9-997a-11bea257ed78 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:22.975268 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72778aed-d76a-4db9-997a-11bea257ed78 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:23.102647 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-72778aed-d76a-4db9-997a-11bea257ed78 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:23.110662 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-72778aed-d76a-4db9-997a-11bea257ed78 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1730 microversion: 2.1 time: 0.148371 Jun 10 18:59:23.111254 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4045/7667] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:22 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:24.127183 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8c78b352-df56-4063-92ff-5a31d73f9d76 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:24.127839 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8c78b352-df56-4063-92ff-5a31d73f9d76 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:24.135032 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8c78b352-df56-4063-92ff-5a31d73f9d76 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:24.135493 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8c78b352-df56-4063-92ff-5a31d73f9d76 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:24.136265 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8c78b352-df56-4063-92ff-5a31d73f9d76 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:24.136738 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8c78b352-df56-4063-92ff-5a31d73f9d76 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:24.264431 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8c78b352-df56-4063-92ff-5a31d73f9d76 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:24.272973 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8c78b352-df56-4063-92ff-5a31d73f9d76 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1730 microversion: 2.1 time: 0.149875 Jun 10 18:59:24.273546 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4046/7668] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:24 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:25.290147 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fdcab2b5-2f2e-4e20-b8e1-394465df35c8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:25.290806 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fdcab2b5-2f2e-4e20-b8e1-394465df35c8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:25.297675 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fdcab2b5-2f2e-4e20-b8e1-394465df35c8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:25.298132 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fdcab2b5-2f2e-4e20-b8e1-394465df35c8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:25.298898 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fdcab2b5-2f2e-4e20-b8e1-394465df35c8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:25.299342 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fdcab2b5-2f2e-4e20-b8e1-394465df35c8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:25.430855 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fdcab2b5-2f2e-4e20-b8e1-394465df35c8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:25.439327 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fdcab2b5-2f2e-4e20-b8e1-394465df35c8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1730 microversion: 2.1 time: 0.152672 Jun 10 18:59:25.439892 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4047/7669] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:25 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:26.456277 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ce1f420e-1a83-4a5b-8420-cbced8c5d629 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:26.456919 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ce1f420e-1a83-4a5b-8420-cbced8c5d629 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:26.463882 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ce1f420e-1a83-4a5b-8420-cbced8c5d629 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:26.464377 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ce1f420e-1a83-4a5b-8420-cbced8c5d629 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:26.465161 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ce1f420e-1a83-4a5b-8420-cbced8c5d629 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:26.465610 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ce1f420e-1a83-4a5b-8420-cbced8c5d629 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:26.593865 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ce1f420e-1a83-4a5b-8420-cbced8c5d629 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:26.602627 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ce1f420e-1a83-4a5b-8420-cbced8c5d629 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1730 microversion: 2.1 time: 0.150775 Jun 10 18:59:26.603206 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4048/7670] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:26 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:27.619555 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b1e60f1d-810e-4229-be0c-983005e19bf0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:27.620201 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b1e60f1d-810e-4229-be0c-983005e19bf0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:27.627170 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b1e60f1d-810e-4229-be0c-983005e19bf0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:27.627625 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b1e60f1d-810e-4229-be0c-983005e19bf0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:27.628683 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b1e60f1d-810e-4229-be0c-983005e19bf0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:27.629127 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b1e60f1d-810e-4229-be0c-983005e19bf0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:27.761209 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b1e60f1d-810e-4229-be0c-983005e19bf0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:27.769419 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b1e60f1d-810e-4229-be0c-983005e19bf0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1730 microversion: 2.1 time: 0.153702 Jun 10 18:59:27.770002 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4049/7671] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:27 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:28.788563 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-723db74b-01ba-47e3-b4bc-6e7fae8d39ce tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:28.789190 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-723db74b-01ba-47e3-b4bc-6e7fae8d39ce tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:28.796081 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-723db74b-01ba-47e3-b4bc-6e7fae8d39ce tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:28.796583 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-723db74b-01ba-47e3-b4bc-6e7fae8d39ce tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:28.798037 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-723db74b-01ba-47e3-b4bc-6e7fae8d39ce tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:28.798037 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-723db74b-01ba-47e3-b4bc-6e7fae8d39ce tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:28.930444 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-723db74b-01ba-47e3-b4bc-6e7fae8d39ce tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:28.938459 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-723db74b-01ba-47e3-b4bc-6e7fae8d39ce tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1730 microversion: 2.1 time: 0.154383 Jun 10 18:59:28.939542 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4050/7672] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:28 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:29.955549 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8693757c-c053-4f83-a720-de0badc94d83 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:29.956207 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8693757c-c053-4f83-a720-de0badc94d83 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:29.963023 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8693757c-c053-4f83-a720-de0badc94d83 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:29.963476 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8693757c-c053-4f83-a720-de0badc94d83 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:29.964230 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8693757c-c053-4f83-a720-de0badc94d83 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:29.964693 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8693757c-c053-4f83-a720-de0badc94d83 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:30.099906 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8693757c-c053-4f83-a720-de0badc94d83 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:30.108029 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8693757c-c053-4f83-a720-de0badc94d83 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1730 microversion: 2.1 time: 0.156979 Jun 10 18:59:30.108636 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4051/7673] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:29 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:31.125155 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-39389485-6bd7-456c-8e4f-60dd134b5c3f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:31.125897 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-39389485-6bd7-456c-8e4f-60dd134b5c3f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:31.133757 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-39389485-6bd7-456c-8e4f-60dd134b5c3f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:31.134264 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-39389485-6bd7-456c-8e4f-60dd134b5c3f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:31.135037 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-39389485-6bd7-456c-8e4f-60dd134b5c3f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:31.135474 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-39389485-6bd7-456c-8e4f-60dd134b5c3f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:31.262770 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-39389485-6bd7-456c-8e4f-60dd134b5c3f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:31.270772 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-39389485-6bd7-456c-8e4f-60dd134b5c3f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1730 microversion: 2.1 time: 0.149678 Jun 10 18:59:31.271337 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4052/7674] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:31 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:32.288533 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-45e347aa-dcdf-4422-bdda-852151035bc0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:32.289309 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-45e347aa-dcdf-4422-bdda-852151035bc0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:32.296084 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45e347aa-dcdf-4422-bdda-852151035bc0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:32.296579 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45e347aa-dcdf-4422-bdda-852151035bc0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:32.297342 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45e347aa-dcdf-4422-bdda-852151035bc0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:32.297781 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45e347aa-dcdf-4422-bdda-852151035bc0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:32.425754 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-45e347aa-dcdf-4422-bdda-852151035bc0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:32.433675 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-45e347aa-dcdf-4422-bdda-852151035bc0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1730 microversion: 2.1 time: 0.149287 Jun 10 18:59:32.434245 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4053/7675] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:32 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:33.451268 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-618697ed-b201-42f0-9946-eb3aa227be79 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:33.452030 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-618697ed-b201-42f0-9946-eb3aa227be79 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:33.454622 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=59 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:59:33.459992 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-618697ed-b201-42f0-9946-eb3aa227be79 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:33.460496 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-618697ed-b201-42f0-9946-eb3aa227be79 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:33.461259 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-618697ed-b201-42f0-9946-eb3aa227be79 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:33.461698 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-618697ed-b201-42f0-9946-eb3aa227be79 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:33.591932 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-618697ed-b201-42f0-9946-eb3aa227be79 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:33.599941 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-618697ed-b201-42f0-9946-eb3aa227be79 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1730 microversion: 2.1 time: 0.152567 Jun 10 18:59:33.600543 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4054/7676] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:33 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:34.616930 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3e8563f2-7c94-4049-968d-d82946f1a77d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:34.617568 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3e8563f2-7c94-4049-968d-d82946f1a77d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:34.624435 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3e8563f2-7c94-4049-968d-d82946f1a77d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:34.624888 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3e8563f2-7c94-4049-968d-d82946f1a77d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:34.625646 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3e8563f2-7c94-4049-968d-d82946f1a77d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:34.626085 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3e8563f2-7c94-4049-968d-d82946f1a77d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:34.752228 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3e8563f2-7c94-4049-968d-d82946f1a77d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:34.760414 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3e8563f2-7c94-4049-968d-d82946f1a77d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1730 microversion: 2.1 time: 0.147322 Jun 10 18:59:34.760987 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4055/7677] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:34 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:35.778033 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bbd51aa2-562c-409b-969a-650001a70cc8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:35.778746 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bbd51aa2-562c-409b-969a-650001a70cc8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:35.787108 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bbd51aa2-562c-409b-969a-650001a70cc8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:35.787566 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bbd51aa2-562c-409b-969a-650001a70cc8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:35.788382 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bbd51aa2-562c-409b-969a-650001a70cc8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:35.788831 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bbd51aa2-562c-409b-969a-650001a70cc8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:35.921974 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bbd51aa2-562c-409b-969a-650001a70cc8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:35.930631 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bbd51aa2-562c-409b-969a-650001a70cc8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1730 microversion: 2.1 time: 0.156469 Jun 10 18:59:35.931213 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4056/7678] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:35 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:36.947134 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-86b31373-d224-43c3-bd06-296d6b41864d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:36.947745 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-86b31373-d224-43c3-bd06-296d6b41864d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:36.955037 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86b31373-d224-43c3-bd06-296d6b41864d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:36.955489 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86b31373-d224-43c3-bd06-296d6b41864d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:36.956326 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86b31373-d224-43c3-bd06-296d6b41864d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:36.965450 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-86b31373-d224-43c3-bd06-296d6b41864d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:37.083623 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-86b31373-d224-43c3-bd06-296d6b41864d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:37.091722 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-86b31373-d224-43c3-bd06-296d6b41864d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1730 microversion: 2.1 time: 0.148486 Jun 10 18:59:37.092298 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4057/7679] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:36 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:38.109697 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9e9bdf90-9500-4f13-8096-589bef19265e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:38.118509 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9e9bdf90-9500-4f13-8096-589bef19265e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:38.118509 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9e9bdf90-9500-4f13-8096-589bef19265e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:38.118509 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9e9bdf90-9500-4f13-8096-589bef19265e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:38.119141 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9e9bdf90-9500-4f13-8096-589bef19265e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:38.119584 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9e9bdf90-9500-4f13-8096-589bef19265e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:38.247648 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9e9bdf90-9500-4f13-8096-589bef19265e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:38.251092 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:59:38.256200 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9e9bdf90-9500-4f13-8096-589bef19265e tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1730 microversion: 2.1 time: 0.150534 Jun 10 18:59:38.256804 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4058/7680] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:38 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:39.273370 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-848a61a5-edf5-4442-acd3-207784ad008c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:39.274059 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-848a61a5-edf5-4442-acd3-207784ad008c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:39.281311 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-848a61a5-edf5-4442-acd3-207784ad008c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:39.281765 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-848a61a5-edf5-4442-acd3-207784ad008c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:39.282530 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-848a61a5-edf5-4442-acd3-207784ad008c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:39.282968 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-848a61a5-edf5-4442-acd3-207784ad008c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:39.425578 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-848a61a5-edf5-4442-acd3-207784ad008c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:39.434260 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-848a61a5-edf5-4442-acd3-207784ad008c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1730 microversion: 2.1 time: 0.164648 Jun 10 18:59:39.434858 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4059/7681] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:39 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:40.451725 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-043ea78e-d6a4-460b-acae-6e81f00ed08a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:40.452393 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-043ea78e-d6a4-460b-acae-6e81f00ed08a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:40.460082 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-043ea78e-d6a4-460b-acae-6e81f00ed08a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:40.460565 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-043ea78e-d6a4-460b-acae-6e81f00ed08a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:40.461353 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-043ea78e-d6a4-460b-acae-6e81f00ed08a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:40.461794 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-043ea78e-d6a4-460b-acae-6e81f00ed08a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:40.592612 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-043ea78e-d6a4-460b-acae-6e81f00ed08a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:40.600941 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-043ea78e-d6a4-460b-acae-6e81f00ed08a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1730 microversion: 2.1 time: 0.153748 Jun 10 18:59:40.601661 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4060/7682] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:40 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:41.409430 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-c603b6ad-8b0f-49d9-8c4d-4b77582597c9 req-73b7ea7c-0a9e-4615-9529-0392fb1a83ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3", "name": "network-vif-unplugged", "status": "completed", "tag": "d361039d-5ded-45d8-850f-6b4cec0e7222"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:59:41.417900 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-c603b6ad-8b0f-49d9-8c4d-4b77582597c9 req-73b7ea7c-0a9e-4615-9529-0392fb1a83ff service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:41.418357 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-c603b6ad-8b0f-49d9-8c4d-4b77582597c9 req-73b7ea7c-0a9e-4615-9529-0392fb1a83ff service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:41.430551 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-c603b6ad-8b0f-49d9-8c4d-4b77582597c9 req-73b7ea7c-0a9e-4615-9529-0392fb1a83ff service nova] Creating event network-vif-unplugged:d361039d-5ded-45d8-850f-6b4cec0e7222 for instance 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 on chh2-master-2 Jun 10 18:59:41.435801 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [req-c603b6ad-8b0f-49d9-8c4d-4b77582597c9 req-73b7ea7c-0a9e-4615-9529-0392fb1a83ff service nova] Instance 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 18:59:41.447012 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-c603b6ad-8b0f-49d9-8c4d-4b77582597c9 req-73b7ea7c-0a9e-4615-9529-0392fb1a83ff service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041343 Jun 10 18:59:41.447600 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4061/7683] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:59:41.620684 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6650f646-71c5-4a40-9eb1-d7d37ffeb811 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:41.621405 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6650f646-71c5-4a40-9eb1-d7d37ffeb811 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:41.629240 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6650f646-71c5-4a40-9eb1-d7d37ffeb811 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:41.629709 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6650f646-71c5-4a40-9eb1-d7d37ffeb811 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:41.630506 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6650f646-71c5-4a40-9eb1-d7d37ffeb811 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:41.630953 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6650f646-71c5-4a40-9eb1-d7d37ffeb811 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:42.131989 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6650f646-71c5-4a40-9eb1-d7d37ffeb811 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:42.140548 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6650f646-71c5-4a40-9eb1-d7d37ffeb811 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1729 microversion: 2.1 time: 0.525174 Jun 10 18:59:42.141144 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4062/7684] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:41 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1729 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:59:43.159285 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5e4d6731-c002-45f9-a173-d9d5c41a295b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:43.159941 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5e4d6731-c002-45f9-a173-d9d5c41a295b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:43.166887 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5e4d6731-c002-45f9-a173-d9d5c41a295b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:43.167345 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5e4d6731-c002-45f9-a173-d9d5c41a295b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:43.168147 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5e4d6731-c002-45f9-a173-d9d5c41a295b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:43.168622 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5e4d6731-c002-45f9-a173-d9d5c41a295b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:43.300069 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5e4d6731-c002-45f9-a173-d9d5c41a295b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:43.308258 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5e4d6731-c002-45f9-a173-d9d5c41a295b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1727 microversion: 2.1 time: 0.153831 Jun 10 18:59:43.308856 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4063/7685] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:43 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:43.462370 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-29babd46-9cf6-4d60-b1dc-8150d44b5844 req-66b36d3f-5273-4e1e-b814-f2b71f6191f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3", "tag": "d361039d-5ded-45d8-850f-6b4cec0e7222"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:59:43.470786 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-29babd46-9cf6-4d60-b1dc-8150d44b5844 req-66b36d3f-5273-4e1e-b814-f2b71f6191f7 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:43.471395 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-29babd46-9cf6-4d60-b1dc-8150d44b5844 req-66b36d3f-5273-4e1e-b814-f2b71f6191f7 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:43.483895 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-29babd46-9cf6-4d60-b1dc-8150d44b5844 req-66b36d3f-5273-4e1e-b814-f2b71f6191f7 service nova] Creating event network-changed:d361039d-5ded-45d8-850f-6b4cec0e7222 for instance 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 on chh2-master-2 Jun 10 18:59:43.489508 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [req-29babd46-9cf6-4d60-b1dc-8150d44b5844 req-66b36d3f-5273-4e1e-b814-f2b71f6191f7 service nova] Instance 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 18:59:43.500783 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-29babd46-9cf6-4d60-b1dc-8150d44b5844 req-66b36d3f-5273-4e1e-b814-f2b71f6191f7 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041947 Jun 10 18:59:43.502188 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4064/7686] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:59:44.328038 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e8cbb324-c27b-41fb-9f90-d68657f9bcfa tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:44.328741 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e8cbb324-c27b-41fb-9f90-d68657f9bcfa tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:44.336203 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e8cbb324-c27b-41fb-9f90-d68657f9bcfa tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:44.336707 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e8cbb324-c27b-41fb-9f90-d68657f9bcfa tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:44.337577 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e8cbb324-c27b-41fb-9f90-d68657f9bcfa tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:44.338022 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e8cbb324-c27b-41fb-9f90-d68657f9bcfa tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:44.487446 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e8cbb324-c27b-41fb-9f90-d68657f9bcfa tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:44.496727 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e8cbb324-c27b-41fb-9f90-d68657f9bcfa tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1727 microversion: 2.1 time: 0.173798 Jun 10 18:59:44.497674 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4065/7687] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:44 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:45.514649 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3767d229-4909-4029-9c4a-4760ab8124ed tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:45.515301 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3767d229-4909-4029-9c4a-4760ab8124ed tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:45.522398 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3767d229-4909-4029-9c4a-4760ab8124ed tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:45.522855 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3767d229-4909-4029-9c4a-4760ab8124ed tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:45.523636 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3767d229-4909-4029-9c4a-4760ab8124ed tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:45.524080 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3767d229-4909-4029-9c4a-4760ab8124ed tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:45.654942 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3767d229-4909-4029-9c4a-4760ab8124ed tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:45.663776 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3767d229-4909-4029-9c4a-4760ab8124ed tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1727 microversion: 2.1 time: 0.153142 Jun 10 18:59:45.664577 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4066/7688] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:45 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:46.681915 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1d9e7415-d34c-415d-861a-4804f7fca240 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:46.682539 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1d9e7415-d34c-415d-861a-4804f7fca240 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:46.690561 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d9e7415-d34c-415d-861a-4804f7fca240 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:46.691023 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d9e7415-d34c-415d-861a-4804f7fca240 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:46.691810 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d9e7415-d34c-415d-861a-4804f7fca240 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:46.692254 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d9e7415-d34c-415d-861a-4804f7fca240 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:46.823624 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1d9e7415-d34c-415d-861a-4804f7fca240 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:46.831954 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1d9e7415-d34c-415d-861a-4804f7fca240 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1727 microversion: 2.1 time: 0.154084 Jun 10 18:59:46.832572 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4067/7689] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:46 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:59:47.848340 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9794ce1b-8dc4-4550-86cd-4750f6e24594 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:47.848959 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9794ce1b-8dc4-4550-86cd-4750f6e24594 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:47.856231 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9794ce1b-8dc4-4550-86cd-4750f6e24594 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:47.858426 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9794ce1b-8dc4-4550-86cd-4750f6e24594 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:47.858426 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9794ce1b-8dc4-4550-86cd-4750f6e24594 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:47.858426 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9794ce1b-8dc4-4550-86cd-4750f6e24594 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:47.990853 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9794ce1b-8dc4-4550-86cd-4750f6e24594 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:48.004096 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9794ce1b-8dc4-4550-86cd-4750f6e24594 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1727 microversion: 2.1 time: 0.159681 Jun 10 18:59:48.004707 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4068/7690] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:47 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:49.021808 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0293cd13-c627-4d9a-8ba1-76ec6454d129 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:49.022517 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0293cd13-c627-4d9a-8ba1-76ec6454d129 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:49.029313 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0293cd13-c627-4d9a-8ba1-76ec6454d129 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:49.029773 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0293cd13-c627-4d9a-8ba1-76ec6454d129 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:49.030551 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0293cd13-c627-4d9a-8ba1-76ec6454d129 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:49.030998 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0293cd13-c627-4d9a-8ba1-76ec6454d129 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:49.161064 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0293cd13-c627-4d9a-8ba1-76ec6454d129 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:49.169272 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0293cd13-c627-4d9a-8ba1-76ec6454d129 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1727 microversion: 2.1 time: 0.151365 Jun 10 18:59:49.169852 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4069/7691] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:49 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:50.187993 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6bc7ebd1-f425-4587-9817-0d6839a73cdb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:50.188725 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6bc7ebd1-f425-4587-9817-0d6839a73cdb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:50.195825 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6bc7ebd1-f425-4587-9817-0d6839a73cdb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:50.196285 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6bc7ebd1-f425-4587-9817-0d6839a73cdb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:50.197071 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6bc7ebd1-f425-4587-9817-0d6839a73cdb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:50.197514 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6bc7ebd1-f425-4587-9817-0d6839a73cdb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:50.329636 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6bc7ebd1-f425-4587-9817-0d6839a73cdb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:50.337866 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6bc7ebd1-f425-4587-9817-0d6839a73cdb tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1727 microversion: 2.1 time: 0.153788 Jun 10 18:59:50.338440 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4070/7692] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:50 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:51.355957 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d3c91635-373b-4bfe-a4da-388a4aea627b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:51.356685 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d3c91635-373b-4bfe-a4da-388a4aea627b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:51.364157 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d3c91635-373b-4bfe-a4da-388a4aea627b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:51.364644 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d3c91635-373b-4bfe-a4da-388a4aea627b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:51.365431 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d3c91635-373b-4bfe-a4da-388a4aea627b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:51.365904 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d3c91635-373b-4bfe-a4da-388a4aea627b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:51.496140 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d3c91635-373b-4bfe-a4da-388a4aea627b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:51.504529 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d3c91635-373b-4bfe-a4da-388a4aea627b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1727 microversion: 2.1 time: 0.152487 Jun 10 18:59:51.505115 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4071/7693] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:51 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:52.522068 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cc4eda29-c92a-47b7-a45e-5538d08b7aec tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:52.522754 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cc4eda29-c92a-47b7-a45e-5538d08b7aec tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:52.529659 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc4eda29-c92a-47b7-a45e-5538d08b7aec tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:52.530122 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc4eda29-c92a-47b7-a45e-5538d08b7aec tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:52.530890 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc4eda29-c92a-47b7-a45e-5538d08b7aec tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:52.531330 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc4eda29-c92a-47b7-a45e-5538d08b7aec tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:52.664850 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cc4eda29-c92a-47b7-a45e-5538d08b7aec tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:52.673489 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cc4eda29-c92a-47b7-a45e-5538d08b7aec tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1727 microversion: 2.1 time: 0.154826 Jun 10 18:59:52.675621 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4072/7694] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:52 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 18:59:53.690599 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-20f2d2a8-9aec-40f3-81c5-a9cfba94a6db tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:53.691248 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-20f2d2a8-9aec-40f3-81c5-a9cfba94a6db tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:53.698086 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-20f2d2a8-9aec-40f3-81c5-a9cfba94a6db tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:53.698617 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-20f2d2a8-9aec-40f3-81c5-a9cfba94a6db tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:53.699392 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-20f2d2a8-9aec-40f3-81c5-a9cfba94a6db tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:53.699835 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-20f2d2a8-9aec-40f3-81c5-a9cfba94a6db tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:53.830075 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-20f2d2a8-9aec-40f3-81c5-a9cfba94a6db tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:53.838297 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-20f2d2a8-9aec-40f3-81c5-a9cfba94a6db tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1727 microversion: 2.1 time: 0.151778 Jun 10 18:59:53.838867 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4073/7695] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:53 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:54.856019 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fccbff39-4011-4f18-a996-84c8a3f8d955 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:54.856773 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fccbff39-4011-4f18-a996-84c8a3f8d955 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:54.863980 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fccbff39-4011-4f18-a996-84c8a3f8d955 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:54.864469 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fccbff39-4011-4f18-a996-84c8a3f8d955 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:54.884510 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fccbff39-4011-4f18-a996-84c8a3f8d955 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:54.884510 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fccbff39-4011-4f18-a996-84c8a3f8d955 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:54.995594 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fccbff39-4011-4f18-a996-84c8a3f8d955 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:55.004566 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fccbff39-4011-4f18-a996-84c8a3f8d955 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1727 microversion: 2.1 time: 0.152420 Jun 10 18:59:55.005144 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4074/7696] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:54 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:56.021535 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ddf6a962-3a18-4bb5-8f4f-e26596152202 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:56.022227 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ddf6a962-3a18-4bb5-8f4f-e26596152202 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:56.029187 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ddf6a962-3a18-4bb5-8f4f-e26596152202 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:56.029637 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ddf6a962-3a18-4bb5-8f4f-e26596152202 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:56.030389 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ddf6a962-3a18-4bb5-8f4f-e26596152202 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:56.030824 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ddf6a962-3a18-4bb5-8f4f-e26596152202 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:56.172003 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ddf6a962-3a18-4bb5-8f4f-e26596152202 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:56.181359 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ddf6a962-3a18-4bb5-8f4f-e26596152202 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1727 microversion: 2.1 time: 0.163644 Jun 10 18:59:56.184821 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4075/7697] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:56 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:57.198096 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-118284f2-b981-48ea-88b3-cf4aaae058d0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:57.198769 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-118284f2-b981-48ea-88b3-cf4aaae058d0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:57.206228 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-118284f2-b981-48ea-88b3-cf4aaae058d0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:57.206680 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-118284f2-b981-48ea-88b3-cf4aaae058d0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:57.207449 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-118284f2-b981-48ea-88b3-cf4aaae058d0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:57.207894 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-118284f2-b981-48ea-88b3-cf4aaae058d0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:57.212045 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 18:59:57.336685 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-118284f2-b981-48ea-88b3-cf4aaae058d0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:57.345294 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-118284f2-b981-48ea-88b3-cf4aaae058d0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1724 microversion: 2.1 time: 0.150481 Jun 10 18:59:57.346086 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4076/7698] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:57 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:57.361405 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a4df2661-1995-4324-83cf-0743ca5c351a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:59:57.361936 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a4df2661-1995-4324-83cf-0743ca5c351a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:57.367548 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a4df2661-1995-4324-83cf-0743ca5c351a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:57.367999 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a4df2661-1995-4324-83cf-0743ca5c351a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:57.368803 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a4df2661-1995-4324-83cf-0743ca5c351a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:57.369247 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a4df2661-1995-4324-83cf-0743ca5c351a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:57.406667 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a4df2661-1995-4324-83cf-0743ca5c351a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:57.407662 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a4df2661-1995-4324-83cf-0743ca5c351a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:57.408503 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a4df2661-1995-4324-83cf-0743ca5c351a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:57.408945 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a4df2661-1995-4324-83cf-0743ca5c351a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:57.429855 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-a4df2661-1995-4324-83cf-0743ca5c351a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Getting quotas for project 9ee0edfe1ca545a18061642a775747b5. Resources: {'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 18:59:57.435032 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-a4df2661-1995-4324-83cf-0743ca5c351a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Getting quotas for user 9434d247ee1c4143bc2cf07b834417ea and project 9ee0edfe1ca545a18061642a775747b5. Resources: {'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 18:59:57.711895 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a4df2661-1995-4324-83cf-0743ca5c351a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "POST /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3/action" status: 202 len: 0 microversion: 2.1 time: 0.353536 Jun 10 18:59:57.712536 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4077/7699] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 18:59:57 2022] POST /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3/action => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 18:59:57.721677 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-788a3bbb-8361-4665-8371-4d8572ceba3a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:57.722373 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-788a3bbb-8361-4665-8371-4d8572ceba3a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:57.728744 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-788a3bbb-8361-4665-8371-4d8572ceba3a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:57.729194 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-788a3bbb-8361-4665-8371-4d8572ceba3a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:57.729990 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-788a3bbb-8361-4665-8371-4d8572ceba3a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:57.732353 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-788a3bbb-8361-4665-8371-4d8572ceba3a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:57.865979 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-788a3bbb-8361-4665-8371-4d8572ceba3a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:57.874237 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-788a3bbb-8361-4665-8371-4d8572ceba3a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1723 microversion: 2.1 time: 0.157567 Jun 10 18:59:57.874820 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4078/7700] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:57 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 18:59:58.337205 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-7c5a2bf0-1011-4753-b63d-4e02ecc7b24b req-aa5265d0-c4f7-4285-8410-1b72a558fe97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3", "name": "network-vif-plugged", "status": "completed", "tag": "d361039d-5ded-45d8-850f-6b4cec0e7222"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 18:59:58.346686 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-7c5a2bf0-1011-4753-b63d-4e02ecc7b24b req-aa5265d0-c4f7-4285-8410-1b72a558fe97 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:58.347153 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-7c5a2bf0-1011-4753-b63d-4e02ecc7b24b req-aa5265d0-c4f7-4285-8410-1b72a558fe97 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:58.359130 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-7c5a2bf0-1011-4753-b63d-4e02ecc7b24b req-aa5265d0-c4f7-4285-8410-1b72a558fe97 service nova] Creating event network-vif-plugged:d361039d-5ded-45d8-850f-6b4cec0e7222 for instance 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 on chh2-master-2 Jun 10 18:59:58.365531 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [req-7c5a2bf0-1011-4753-b63d-4e02ecc7b24b req-aa5265d0-c4f7-4285-8410-1b72a558fe97 service nova] Instance 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 18:59:58.376796 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-7c5a2bf0-1011-4753-b63d-4e02ecc7b24b req-aa5265d0-c4f7-4285-8410-1b72a558fe97 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044378 Jun 10 18:59:58.377377 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4079/7701] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 18:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 18:59:58.893594 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fdbf8e6b-3078-471b-84a4-6f33319aaba8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 18:59:58.894329 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fdbf8e6b-3078-471b-84a4-6f33319aaba8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 18:59:58.900594 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fdbf8e6b-3078-471b-84a4-6f33319aaba8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:58.901052 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fdbf8e6b-3078-471b-84a4-6f33319aaba8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:58.901819 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fdbf8e6b-3078-471b-84a4-6f33319aaba8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 18:59:58.902258 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fdbf8e6b-3078-471b-84a4-6f33319aaba8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 18:59:59.031369 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fdbf8e6b-3078-471b-84a4-6f33319aaba8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 18:59:59.039365 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fdbf8e6b-3078-471b-84a4-6f33319aaba8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1723 microversion: 2.1 time: 0.150726 Jun 10 18:59:59.039941 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4080/7702] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 18:59:58 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:00:00.056588 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a01547fb-1e9d-4335-966f-68f6024e4958 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:00.057239 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a01547fb-1e9d-4335-966f-68f6024e4958 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:00.064171 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a01547fb-1e9d-4335-966f-68f6024e4958 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:00.064668 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a01547fb-1e9d-4335-966f-68f6024e4958 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:00.065450 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a01547fb-1e9d-4335-966f-68f6024e4958 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:00.065899 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a01547fb-1e9d-4335-966f-68f6024e4958 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:00.203498 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a01547fb-1e9d-4335-966f-68f6024e4958 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:00.212201 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a01547fb-1e9d-4335-966f-68f6024e4958 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1723 microversion: 2.1 time: 0.159492 Jun 10 19:00:00.212818 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4081/7703] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:00 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:00:01.233597 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d530e443-81d5-4d5e-b9e4-7451d86bb41b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:01.234272 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d530e443-81d5-4d5e-b9e4-7451d86bb41b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:01.241999 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d530e443-81d5-4d5e-b9e4-7451d86bb41b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:01.242459 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d530e443-81d5-4d5e-b9e4-7451d86bb41b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:01.243244 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d530e443-81d5-4d5e-b9e4-7451d86bb41b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:01.243728 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d530e443-81d5-4d5e-b9e4-7451d86bb41b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:01.380474 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d530e443-81d5-4d5e-b9e4-7451d86bb41b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:01.388593 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d530e443-81d5-4d5e-b9e4-7451d86bb41b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1723 microversion: 2.1 time: 0.158961 Jun 10 19:00:01.389171 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4082/7704] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:01 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:00:02.262329 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-222c8cdd-30d1-4ba7-9528-39f68e82154c req-81ffa33f-ee0e-4381-98d0-7f40ef9e3e67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3", "name": "network-vif-unplugged", "status": "completed", "tag": "d361039d-5ded-45d8-850f-6b4cec0e7222"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:00:02.272323 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-222c8cdd-30d1-4ba7-9528-39f68e82154c req-81ffa33f-ee0e-4381-98d0-7f40ef9e3e67 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:02.272786 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-222c8cdd-30d1-4ba7-9528-39f68e82154c req-81ffa33f-ee0e-4381-98d0-7f40ef9e3e67 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:02.284869 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-222c8cdd-30d1-4ba7-9528-39f68e82154c req-81ffa33f-ee0e-4381-98d0-7f40ef9e3e67 service nova] Creating event network-vif-unplugged:d361039d-5ded-45d8-850f-6b4cec0e7222 for instance 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 on chh2-master-2 Jun 10 19:00:02.290471 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [req-222c8cdd-30d1-4ba7-9528-39f68e82154c req-81ffa33f-ee0e-4381-98d0-7f40ef9e3e67 service nova] Instance 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 19:00:02.302001 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-222c8cdd-30d1-4ba7-9528-39f68e82154c req-81ffa33f-ee0e-4381-98d0-7f40ef9e3e67 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043469 Jun 10 19:00:02.302671 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4083/7705] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:00:02.406464 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cc629fdf-3d94-45d1-9147-6031cb3c9391 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:02.407229 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cc629fdf-3d94-45d1-9147-6031cb3c9391 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:02.413663 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc629fdf-3d94-45d1-9147-6031cb3c9391 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:02.414121 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc629fdf-3d94-45d1-9147-6031cb3c9391 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:02.414894 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc629fdf-3d94-45d1-9147-6031cb3c9391 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:02.415338 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc629fdf-3d94-45d1-9147-6031cb3c9391 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:02.549325 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cc629fdf-3d94-45d1-9147-6031cb3c9391 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:02.557584 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cc629fdf-3d94-45d1-9147-6031cb3c9391 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1723 microversion: 2.1 time: 0.155398 Jun 10 19:00:02.558161 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4084/7706] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:02 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:00:03.575170 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5b628c2a-2ad0-415b-bb50-236597b1ff57 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:03.575831 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5b628c2a-2ad0-415b-bb50-236597b1ff57 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:03.578554 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:00:03.583517 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5b628c2a-2ad0-415b-bb50-236597b1ff57 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:03.583973 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5b628c2a-2ad0-415b-bb50-236597b1ff57 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:03.584778 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5b628c2a-2ad0-415b-bb50-236597b1ff57 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:03.585219 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5b628c2a-2ad0-415b-bb50-236597b1ff57 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:03.732127 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5b628c2a-2ad0-415b-bb50-236597b1ff57 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:03.741528 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5b628c2a-2ad0-415b-bb50-236597b1ff57 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1723 microversion: 2.1 time: 0.170365 Jun 10 19:00:03.744343 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4085/7707] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:03 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:00:04.494009 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-9aee532d-f24f-4f8b-8fad-385be0d92afe req-06fdedc5-77b0-4ab7-8e1b-142482b07b4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3", "tag": "d361039d-5ded-45d8-850f-6b4cec0e7222"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:00:04.503477 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-9aee532d-f24f-4f8b-8fad-385be0d92afe req-06fdedc5-77b0-4ab7-8e1b-142482b07b4a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:04.503939 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-9aee532d-f24f-4f8b-8fad-385be0d92afe req-06fdedc5-77b0-4ab7-8e1b-142482b07b4a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:04.525619 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-9aee532d-f24f-4f8b-8fad-385be0d92afe req-06fdedc5-77b0-4ab7-8e1b-142482b07b4a service nova] Creating event network-changed:d361039d-5ded-45d8-850f-6b4cec0e7222 for instance 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 on chh1-master-2 Jun 10 19:00:04.531676 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [req-9aee532d-f24f-4f8b-8fad-385be0d92afe req-06fdedc5-77b0-4ab7-8e1b-142482b07b4a service nova] Instance 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 19:00:04.542874 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-9aee532d-f24f-4f8b-8fad-385be0d92afe req-06fdedc5-77b0-4ab7-8e1b-142482b07b4a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052510 Jun 10 19:00:04.548497 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4086/7708] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:00:04.760726 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f8dde66c-cbd6-40dc-94e4-d716a2ec9006 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:04.761462 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f8dde66c-cbd6-40dc-94e4-d716a2ec9006 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:04.767721 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8dde66c-cbd6-40dc-94e4-d716a2ec9006 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:04.768176 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8dde66c-cbd6-40dc-94e4-d716a2ec9006 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:04.768978 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8dde66c-cbd6-40dc-94e4-d716a2ec9006 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:04.769423 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8dde66c-cbd6-40dc-94e4-d716a2ec9006 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:04.903373 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f8dde66c-cbd6-40dc-94e4-d716a2ec9006 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:04.912674 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f8dde66c-cbd6-40dc-94e4-d716a2ec9006 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1723 microversion: 2.1 time: 0.157115 Jun 10 19:00:04.913390 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4087/7709] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:04 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:00:05.930003 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-676aa972-5505-495e-a6a1-c93edfdc1dfa tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:05.930686 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-676aa972-5505-495e-a6a1-c93edfdc1dfa tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:05.937626 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-676aa972-5505-495e-a6a1-c93edfdc1dfa tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:05.938095 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-676aa972-5505-495e-a6a1-c93edfdc1dfa tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:05.939382 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-676aa972-5505-495e-a6a1-c93edfdc1dfa tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:05.939830 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-676aa972-5505-495e-a6a1-c93edfdc1dfa tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:06.076796 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-676aa972-5505-495e-a6a1-c93edfdc1dfa tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:06.084982 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-676aa972-5505-495e-a6a1-c93edfdc1dfa tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1723 microversion: 2.1 time: 0.158978 Jun 10 19:00:06.085556 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4088/7710] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:05 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:00:07.104842 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5a673f5a-cffa-4c36-a4a9-5153fa61a257 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:07.105516 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5a673f5a-cffa-4c36-a4a9-5153fa61a257 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:07.115412 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5a673f5a-cffa-4c36-a4a9-5153fa61a257 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:07.118694 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5a673f5a-cffa-4c36-a4a9-5153fa61a257 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:07.118694 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5a673f5a-cffa-4c36-a4a9-5153fa61a257 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:07.118694 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5a673f5a-cffa-4c36-a4a9-5153fa61a257 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:07.250599 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5a673f5a-cffa-4c36-a4a9-5153fa61a257 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:07.259532 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5a673f5a-cffa-4c36-a4a9-5153fa61a257 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1723 microversion: 2.1 time: 0.160443 Jun 10 19:00:07.260228 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4089/7711] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:07 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:00:08.276926 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4ed7fc99-1a2f-48d0-addd-0cd1e33b61c0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:08.277599 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4ed7fc99-1a2f-48d0-addd-0cd1e33b61c0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:08.279637 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:00:08.285960 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ed7fc99-1a2f-48d0-addd-0cd1e33b61c0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:08.286410 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ed7fc99-1a2f-48d0-addd-0cd1e33b61c0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:08.287172 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ed7fc99-1a2f-48d0-addd-0cd1e33b61c0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:08.287610 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ed7fc99-1a2f-48d0-addd-0cd1e33b61c0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:08.422044 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4ed7fc99-1a2f-48d0-addd-0cd1e33b61c0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:08.425615 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:00:08.430872 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4ed7fc99-1a2f-48d0-addd-0cd1e33b61c0 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1723 microversion: 2.1 time: 0.157661 Jun 10 19:00:08.431468 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4090/7712] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:08 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:00:09.448585 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e720084f-872e-4226-a08c-791ef0c47fe3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:09.449391 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e720084f-872e-4226-a08c-791ef0c47fe3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:09.457602 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e720084f-872e-4226-a08c-791ef0c47fe3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:09.458063 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e720084f-872e-4226-a08c-791ef0c47fe3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:09.458855 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e720084f-872e-4226-a08c-791ef0c47fe3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:09.459301 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e720084f-872e-4226-a08c-791ef0c47fe3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:09.602170 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e720084f-872e-4226-a08c-791ef0c47fe3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:09.611623 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e720084f-872e-4226-a08c-791ef0c47fe3 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1723 microversion: 2.1 time: 0.167350 Jun 10 19:00:09.612208 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4091/7713] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:09 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:00:10.631125 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5f550928-29d3-429e-aa1b-01fa221d50ba tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:10.631777 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5f550928-29d3-429e-aa1b-01fa221d50ba tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:10.638807 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5f550928-29d3-429e-aa1b-01fa221d50ba tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:10.639199 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5f550928-29d3-429e-aa1b-01fa221d50ba tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:10.639988 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5f550928-29d3-429e-aa1b-01fa221d50ba tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:10.640467 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5f550928-29d3-429e-aa1b-01fa221d50ba tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:10.772255 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5f550928-29d3-429e-aa1b-01fa221d50ba tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:10.780490 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5f550928-29d3-429e-aa1b-01fa221d50ba tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1723 microversion: 2.1 time: 0.153427 Jun 10 19:00:10.781071 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4092/7714] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:10 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:00:11.798315 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7804533e-1686-48b3-a92a-c7f68255de94 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:11.798964 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7804533e-1686-48b3-a92a-c7f68255de94 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:11.805796 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7804533e-1686-48b3-a92a-c7f68255de94 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:11.806247 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7804533e-1686-48b3-a92a-c7f68255de94 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:11.807011 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7804533e-1686-48b3-a92a-c7f68255de94 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:11.807451 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7804533e-1686-48b3-a92a-c7f68255de94 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:11.938182 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7804533e-1686-48b3-a92a-c7f68255de94 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:11.946090 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7804533e-1686-48b3-a92a-c7f68255de94 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1723 microversion: 2.1 time: 0.152376 Jun 10 19:00:11.946667 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4093/7715] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:11 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:00:12.962929 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3616ffac-e459-4fff-b8c6-9bcc39d46303 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:12.970693 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3616ffac-e459-4fff-b8c6-9bcc39d46303 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:12.971047 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3616ffac-e459-4fff-b8c6-9bcc39d46303 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:12.971504 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3616ffac-e459-4fff-b8c6-9bcc39d46303 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:12.972270 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3616ffac-e459-4fff-b8c6-9bcc39d46303 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:12.972739 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3616ffac-e459-4fff-b8c6-9bcc39d46303 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:13.106244 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3616ffac-e459-4fff-b8c6-9bcc39d46303 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:13.114918 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3616ffac-e459-4fff-b8c6-9bcc39d46303 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1723 microversion: 2.1 time: 0.155927 Jun 10 19:00:13.115533 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4094/7716] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:12 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:00:14.132735 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-77ece47b-3d86-4eba-924e-d584e9df63e2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:14.133437 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-77ece47b-3d86-4eba-924e-d584e9df63e2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:14.140519 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-77ece47b-3d86-4eba-924e-d584e9df63e2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:14.140980 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-77ece47b-3d86-4eba-924e-d584e9df63e2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:14.141743 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-77ece47b-3d86-4eba-924e-d584e9df63e2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:14.142190 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-77ece47b-3d86-4eba-924e-d584e9df63e2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:14.271893 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-77ece47b-3d86-4eba-924e-d584e9df63e2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:14.279833 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-77ece47b-3d86-4eba-924e-d584e9df63e2 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1723 microversion: 2.1 time: 0.151133 Jun 10 19:00:14.280415 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4095/7717] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:14 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:00:15.297541 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c33cc60e-fe57-4923-b203-2fb1eeea7fe4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:15.298256 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c33cc60e-fe57-4923-b203-2fb1eeea7fe4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:15.305601 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c33cc60e-fe57-4923-b203-2fb1eeea7fe4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:15.306057 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c33cc60e-fe57-4923-b203-2fb1eeea7fe4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:15.306830 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c33cc60e-fe57-4923-b203-2fb1eeea7fe4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:15.307273 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c33cc60e-fe57-4923-b203-2fb1eeea7fe4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:15.441770 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c33cc60e-fe57-4923-b203-2fb1eeea7fe4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:15.449817 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c33cc60e-fe57-4923-b203-2fb1eeea7fe4 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1723 microversion: 2.1 time: 0.156213 Jun 10 19:00:15.450393 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4096/7718] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:15 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:00:16.466956 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9228c84c-0ffb-46fa-86df-f4c8a91c845a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:16.467574 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9228c84c-0ffb-46fa-86df-f4c8a91c845a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:16.474642 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9228c84c-0ffb-46fa-86df-f4c8a91c845a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:16.475093 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9228c84c-0ffb-46fa-86df-f4c8a91c845a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:16.475859 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9228c84c-0ffb-46fa-86df-f4c8a91c845a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:16.476325 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9228c84c-0ffb-46fa-86df-f4c8a91c845a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:16.612047 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9228c84c-0ffb-46fa-86df-f4c8a91c845a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:16.620147 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9228c84c-0ffb-46fa-86df-f4c8a91c845a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1723 microversion: 2.1 time: 0.157072 Jun 10 19:00:16.620760 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4097/7719] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:16 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:00:17.638125 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2613148e-f3f6-4055-908f-ae7c0da60eba tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:17.638806 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2613148e-f3f6-4055-908f-ae7c0da60eba tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:17.645751 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2613148e-f3f6-4055-908f-ae7c0da60eba tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:17.646266 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2613148e-f3f6-4055-908f-ae7c0da60eba tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:17.647008 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2613148e-f3f6-4055-908f-ae7c0da60eba tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:17.647449 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2613148e-f3f6-4055-908f-ae7c0da60eba tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:17.782925 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2613148e-f3f6-4055-908f-ae7c0da60eba tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:17.792028 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2613148e-f3f6-4055-908f-ae7c0da60eba tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1723 microversion: 2.1 time: 0.157775 Jun 10 19:00:17.792645 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4098/7720] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:17 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:00:18.809763 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4bf31365-51eb-4c95-88e6-60fe9170191f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:18.810438 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4bf31365-51eb-4c95-88e6-60fe9170191f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:18.817530 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4bf31365-51eb-4c95-88e6-60fe9170191f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:18.817983 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4bf31365-51eb-4c95-88e6-60fe9170191f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:18.818749 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4bf31365-51eb-4c95-88e6-60fe9170191f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:18.819184 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4bf31365-51eb-4c95-88e6-60fe9170191f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:18.948406 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4bf31365-51eb-4c95-88e6-60fe9170191f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:18.956968 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4bf31365-51eb-4c95-88e6-60fe9170191f tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1716 microversion: 2.1 time: 0.151167 Jun 10 19:00:18.957545 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4099/7721] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:18 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1716 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:00:18.973340 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-93b971a9-71af-40b4-8559-6698485389dc tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:18.973957 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-93b971a9-71af-40b4-8559-6698485389dc tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:18.979846 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93b971a9-71af-40b4-8559-6698485389dc tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:18.980315 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93b971a9-71af-40b4-8559-6698485389dc tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:18.981103 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93b971a9-71af-40b4-8559-6698485389dc tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:18.981545 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93b971a9-71af-40b4-8559-6698485389dc tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:19.119798 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-93b971a9-71af-40b4-8559-6698485389dc tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:19.128652 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-93b971a9-71af-40b4-8559-6698485389dc tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1716 microversion: 2.1 time: 0.159538 Jun 10 19:00:19.132346 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4100/7722] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:18 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1716 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:00:19.146546 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a74cc71c-4c8f-4359-b7d7-a70201ef9c0d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:19.147290 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a74cc71c-4c8f-4359-b7d7-a70201ef9c0d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:19.153537 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a74cc71c-4c8f-4359-b7d7-a70201ef9c0d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:19.153997 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a74cc71c-4c8f-4359-b7d7-a70201ef9c0d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:19.154907 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a74cc71c-4c8f-4359-b7d7-a70201ef9c0d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:19.155286 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a74cc71c-4c8f-4359-b7d7-a70201ef9c0d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:19.284730 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a74cc71c-4c8f-4359-b7d7-a70201ef9c0d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:19.292907 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a74cc71c-4c8f-4359-b7d7-a70201ef9c0d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1716 microversion: 2.1 time: 0.150966 Jun 10 19:00:19.293479 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4101/7723] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:19 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1716 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:00:19.308289 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c8ab2a78-f0cc-4944-bd49-6f615f8ea7d6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:19.308814 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c8ab2a78-f0cc-4944-bd49-6f615f8ea7d6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:19.315079 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c8ab2a78-f0cc-4944-bd49-6f615f8ea7d6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:19.315524 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c8ab2a78-f0cc-4944-bd49-6f615f8ea7d6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:19.316277 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c8ab2a78-f0cc-4944-bd49-6f615f8ea7d6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:19.316732 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c8ab2a78-f0cc-4944-bd49-6f615f8ea7d6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:19.341577 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c8ab2a78-f0cc-4944-bd49-6f615f8ea7d6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 19:00:19.568963 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c8ab2a78-f0cc-4944-bd49-6f615f8ea7d6 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "DELETE /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 204 len: 0 microversion: 2.1 time: 0.263932 Jun 10 19:00:19.569564 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4102/7724] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 19:00:19 2022] DELETE /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 19:00:19.577996 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3dda5de3-e057-47e6-b099-c9e4499ed56c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:19.578692 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3dda5de3-e057-47e6-b099-c9e4499ed56c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:19.584593 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3dda5de3-e057-47e6-b099-c9e4499ed56c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:19.585040 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3dda5de3-e057-47e6-b099-c9e4499ed56c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:19.585797 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3dda5de3-e057-47e6-b099-c9e4499ed56c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:19.586246 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3dda5de3-e057-47e6-b099-c9e4499ed56c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:19.716147 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3dda5de3-e057-47e6-b099-c9e4499ed56c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:19.724186 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3dda5de3-e057-47e6-b099-c9e4499ed56c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1722 microversion: 2.1 time: 0.150175 Jun 10 19:00:19.724798 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4103/7725] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:19 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:00:20.741553 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-23f82030-1256-4e2d-b9a9-54734ac96e0a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:20.743308 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-23f82030-1256-4e2d-b9a9-54734ac96e0a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:20.749186 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-23f82030-1256-4e2d-b9a9-54734ac96e0a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:20.749708 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-23f82030-1256-4e2d-b9a9-54734ac96e0a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:20.750523 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-23f82030-1256-4e2d-b9a9-54734ac96e0a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:20.750922 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-23f82030-1256-4e2d-b9a9-54734ac96e0a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:20.887207 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-23f82030-1256-4e2d-b9a9-54734ac96e0a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:20.896448 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-23f82030-1256-4e2d-b9a9-54734ac96e0a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1722 microversion: 2.1 time: 0.158876 Jun 10 19:00:20.903390 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4104/7726] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:20 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:00:20.903390 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-a157db26-76f1-4ae3-95be-116d3fc1d19d req-a90f0a72-f08a-4448-8b0f-0d8532bb57de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3", "name": "network-vif-plugged", "status": "completed", "tag": "d361039d-5ded-45d8-850f-6b4cec0e7222"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:00:20.909916 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-a157db26-76f1-4ae3-95be-116d3fc1d19d req-a90f0a72-f08a-4448-8b0f-0d8532bb57de service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:20.910371 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-a157db26-76f1-4ae3-95be-116d3fc1d19d req-a90f0a72-f08a-4448-8b0f-0d8532bb57de service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:20.921285 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-a157db26-76f1-4ae3-95be-116d3fc1d19d req-a90f0a72-f08a-4448-8b0f-0d8532bb57de service nova] Creating event network-vif-plugged:d361039d-5ded-45d8-850f-6b4cec0e7222 for instance 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 on chh1-master-2 Jun 10 19:00:20.926088 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-a157db26-76f1-4ae3-95be-116d3fc1d19d req-a90f0a72-f08a-4448-8b0f-0d8532bb57de service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027949 Jun 10 19:00:20.926681 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4105/7727] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:00:21.915899 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9b2d04f0-e47c-48b6-8cef-e8af4cc29dea tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:21.916635 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9b2d04f0-e47c-48b6-8cef-e8af4cc29dea tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:21.923237 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b2d04f0-e47c-48b6-8cef-e8af4cc29dea tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:21.923699 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b2d04f0-e47c-48b6-8cef-e8af4cc29dea tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:21.924524 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b2d04f0-e47c-48b6-8cef-e8af4cc29dea tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:21.924976 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b2d04f0-e47c-48b6-8cef-e8af4cc29dea tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:21.946049 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:00:21.991892 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9b2d04f0-e47c-48b6-8cef-e8af4cc29dea tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:22.000583 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9b2d04f0-e47c-48b6-8cef-e8af4cc29dea tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1654 microversion: 2.1 time: 0.089719 Jun 10 19:00:22.001177 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4106/7728] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:21 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1654 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:00:22.225009 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-c3da95b9-53b8-46ca-a322-4aa2131812af req-a3626909-d614-4029-ab7d-634c261f22d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3", "name": "network-vif-deleted", "tag": "d361039d-5ded-45d8-850f-6b4cec0e7222"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:00:22.234179 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-c3da95b9-53b8-46ca-a322-4aa2131812af req-a3626909-d614-4029-ab7d-634c261f22d1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:22.234625 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-c3da95b9-53b8-46ca-a322-4aa2131812af req-a3626909-d614-4029-ab7d-634c261f22d1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:22.246147 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-c3da95b9-53b8-46ca-a322-4aa2131812af req-a3626909-d614-4029-ab7d-634c261f22d1 service nova] Creating event network-vif-deleted:d361039d-5ded-45d8-850f-6b4cec0e7222 for instance 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 on chh1-master-2 Jun 10 19:00:22.255195 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-c3da95b9-53b8-46ca-a322-4aa2131812af req-a3626909-d614-4029-ab7d-634c261f22d1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033819 Jun 10 19:00:22.255809 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4107/7729] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:00:23.021320 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d55e588a-8534-4498-90ff-b4bf15e96f34 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:23.023413 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d55e588a-8534-4498-90ff-b4bf15e96f34 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:23.031194 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d55e588a-8534-4498-90ff-b4bf15e96f34 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:23.031718 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d55e588a-8534-4498-90ff-b4bf15e96f34 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:23.032599 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d55e588a-8534-4498-90ff-b4bf15e96f34 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:23.033096 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d55e588a-8534-4498-90ff-b4bf15e96f34 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:23.102009 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d55e588a-8534-4498-90ff-b4bf15e96f34 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:23.110745 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d55e588a-8534-4498-90ff-b4bf15e96f34 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1369 microversion: 2.1 time: 0.095520 Jun 10 19:00:23.114382 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4108/7730] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:23 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:00:24.127823 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7c05c835-ffb1-4f48-b509-549d12b03b78 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:24.129181 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7c05c835-ffb1-4f48-b509-549d12b03b78 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:24.136280 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7c05c835-ffb1-4f48-b509-549d12b03b78 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:24.136835 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7c05c835-ffb1-4f48-b509-549d12b03b78 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:24.137661 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7c05c835-ffb1-4f48-b509-549d12b03b78 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:24.138108 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7c05c835-ffb1-4f48-b509-549d12b03b78 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:24.204800 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7c05c835-ffb1-4f48-b509-549d12b03b78 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:24.213524 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7c05c835-ffb1-4f48-b509-549d12b03b78 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1369 microversion: 2.1 time: 0.090145 Jun 10 19:00:24.214098 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4109/7731] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:24 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:00:25.231010 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fe7c949c-3e12-435f-b372-c3cdf46de952 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:25.231767 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fe7c949c-3e12-435f-b372-c3cdf46de952 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:25.238548 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fe7c949c-3e12-435f-b372-c3cdf46de952 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:25.239004 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fe7c949c-3e12-435f-b372-c3cdf46de952 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:25.239778 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fe7c949c-3e12-435f-b372-c3cdf46de952 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:25.240218 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fe7c949c-3e12-435f-b372-c3cdf46de952 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:25.302382 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fe7c949c-3e12-435f-b372-c3cdf46de952 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:25.310500 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fe7c949c-3e12-435f-b372-c3cdf46de952 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1369 microversion: 2.1 time: 0.083460 Jun 10 19:00:25.311069 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4110/7732] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:25 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:00:26.327495 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c1600240-10e9-45dd-be46-9958d7558513 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:26.328181 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c1600240-10e9-45dd-be46-9958d7558513 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:26.335143 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c1600240-10e9-45dd-be46-9958d7558513 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:26.335604 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c1600240-10e9-45dd-be46-9958d7558513 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:26.336406 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c1600240-10e9-45dd-be46-9958d7558513 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:26.336853 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c1600240-10e9-45dd-be46-9958d7558513 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:26.401139 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c1600240-10e9-45dd-be46-9958d7558513 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9434d247ee1c4143bc2cf07b834417ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee0edfe1ca545a18061642a775747b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:26.410522 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c1600240-10e9-45dd-be46-9958d7558513 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 200 len: 1369 microversion: 2.1 time: 0.086931 Jun 10 19:00:26.411135 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4111/7733] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:26 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:00:27.427285 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8b552011-ae3d-488b-8f76-8cee2d66b85b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:27.427917 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8b552011-ae3d-488b-8f76-8cee2d66b85b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:27.434852 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8b552011-ae3d-488b-8f76-8cee2d66b85b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:27.435297 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8b552011-ae3d-488b-8f76-8cee2d66b85b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:27.436053 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8b552011-ae3d-488b-8f76-8cee2d66b85b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:27.436525 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8b552011-ae3d-488b-8f76-8cee2d66b85b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:27.450293 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-8b552011-ae3d-488b-8f76-8cee2d66b85b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] HTTP exception thrown: Instance 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 could not be found. Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8b552011-ae3d-488b-8f76-8cee2d66b85b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Request method failure captured: Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 HTTP/1.1 Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5NYWWZ-ZO6eUaowxYHvN17DzgOyBcRp8mhJxqDpqy8rItuzorWJTwSOIastREFRyZr6c_ChbS_L6xrOAOnpyFVpWaRIYnwPEIqz770DyDVvyPoXIV-sm8ojvCAplLeG2g6jr_K6WyMCpHhf5lcBOzewCyTTCZt4Q13c3it9lc4tPjc Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 9ee0edfe1ca545a18061642a775747b5 Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServerActionsTestJSON-1025700685 Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_9ee0edfe1ca545a18061642a775747b5", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServerActionsTestJSON-1025700685 Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 9ee0edfe1ca545a18061642a775747b5 Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServerActionsTestJSON-1025700685 Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServerActionsTestJSON-1025700685-project Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 9434d247ee1c4143bc2cf07b834417ea Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServerActionsTestJSON-1025700685-project Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 could not be found. Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3'} Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 could not be found. Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 could not be found. Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:00:27.451920 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:27.458647 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:00:27.458647 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:00:27.458647 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:00:27.458647 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 19:00:27.458647 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 19:00:27.458647 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 could not be found. Jun 10 19:00:27.458647 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:27.458647 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8b552011-ae3d-488b-8f76-8cee2d66b85b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Returning 404 to user: Instance 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 19:00:27.458647 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8b552011-ae3d-488b-8f76-8cee2d66b85b tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 404 len: 111 microversion: 2.1 time: 0.030200 Jun 10 19:00:27.458647 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4112/7734] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:27 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 19:00:27.509021 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1fd92976-671f-45f5-9c3d-b845e62fd30c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:27.509964 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1fd92976-671f-45f5-9c3d-b845e62fd30c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:27.515879 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1fd92976-671f-45f5-9c3d-b845e62fd30c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:27.516357 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1fd92976-671f-45f5-9c3d-b845e62fd30c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:27.517204 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1fd92976-671f-45f5-9c3d-b845e62fd30c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:27.517537 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1fd92976-671f-45f5-9c3d-b845e62fd30c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:27.530629 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-1fd92976-671f-45f5-9c3d-b845e62fd30c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] HTTP exception thrown: Instance 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 could not be found. Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1fd92976-671f-45f5-9c3d-b845e62fd30c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Request method failure captured: Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3/os-volume_attachments HTTP/1.1 Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5NYWWZ-ZO6eUaowxYHvN17DzgOyBcRp8mhJxqDpqy8rItuzorWJTwSOIastREFRyZr6c_ChbS_L6xrOAOnpyFVpWaRIYnwPEIqz770DyDVvyPoXIV-sm8ojvCAplLeG2g6jr_K6WyMCpHhf5lcBOzewCyTTCZt4Q13c3it9lc4tPjc Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 9ee0edfe1ca545a18061642a775747b5 Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServerActionsTestJSON-1025700685 Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_9ee0edfe1ca545a18061642a775747b5", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServerActionsTestJSON-1025700685 Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 9ee0edfe1ca545a18061642a775747b5 Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServerActionsTestJSON-1025700685 Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServerActionsTestJSON-1025700685-project Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 9434d247ee1c4143bc2cf07b834417ea Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServerActionsTestJSON-1025700685-project Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 could not be found. Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: action_args: {'server_id': '7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3'} Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 could not be found. Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 19:00:27.532154 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 19:00:27.544408 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 could not be found. Jun 10 19:00:27.544408 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:27.544408 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:00:27.544408 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:27.544408 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:00:27.544408 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:00:27.544408 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:00:27.544408 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 19:00:27.544408 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 19:00:27.544408 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 could not be found. Jun 10 19:00:27.544408 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:27.544408 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1fd92976-671f-45f5-9c3d-b845e62fd30c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Returning 404 to user: Instance 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 19:00:27.544408 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1fd92976-671f-45f5-9c3d-b845e62fd30c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.028505 Jun 10 19:00:27.544408 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4113/7735] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 19:00:27 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3/os-volume_attachments => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 19:00:30.999284 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d141cad1-4feb-4758-9aee-c3c0cb0674fd tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:30.999891 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d141cad1-4feb-4758-9aee-c3c0cb0674fd tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:31.008008 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d141cad1-4feb-4758-9aee-c3c0cb0674fd tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:31.008581 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d141cad1-4feb-4758-9aee-c3c0cb0674fd tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:31.009426 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d141cad1-4feb-4758-9aee-c3c0cb0674fd tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:31.009924 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d141cad1-4feb-4758-9aee-c3c0cb0674fd tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:31.024104 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-d141cad1-4feb-4758-9aee-c3c0cb0674fd tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] HTTP exception thrown: Instance 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 could not be found. Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d141cad1-4feb-4758-9aee-c3c0cb0674fd tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Request method failure captured: Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 HTTP/1.1 Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5NYWWZ-ZO6eUaowxYHvN17DzgOyBcRp8mhJxqDpqy8rItuzorWJTwSOIastREFRyZr6c_ChbS_L6xrOAOnpyFVpWaRIYnwPEIqz770DyDVvyPoXIV-sm8ojvCAplLeG2g6jr_K6WyMCpHhf5lcBOzewCyTTCZt4Q13c3it9lc4tPjc Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 9ee0edfe1ca545a18061642a775747b5 Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServerActionsTestJSON-1025700685 Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_9ee0edfe1ca545a18061642a775747b5", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServerActionsTestJSON-1025700685 Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 9ee0edfe1ca545a18061642a775747b5 Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServerActionsTestJSON-1025700685 Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServerActionsTestJSON-1025700685-project Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 9434d247ee1c4143bc2cf07b834417ea Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServerActionsTestJSON-1025700685-project Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 could not be found. Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3'} Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 could not be found. Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 19:00:31.025875 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 19:00:31.030839 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 could not be found. Jun 10 19:00:31.030839 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:31.030839 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:00:31.030839 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:31.030839 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:00:31.030839 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:00:31.030839 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:00:31.030839 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 19:00:31.030839 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 19:00:31.030839 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 could not be found. Jun 10 19:00:31.030839 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:31.030839 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d141cad1-4feb-4758-9aee-c3c0cb0674fd tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Returning 404 to user: Instance 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 19:00:31.030839 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d141cad1-4feb-4758-9aee-c3c0cb0674fd tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "DELETE /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 404 len: 111 microversion: 2.1 time: 0.031940 Jun 10 19:00:31.030839 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4114/7736] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 19:00:30 2022] DELETE /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 19:00:31.035494 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ca147891-74c3-4a50-bf6a-ead507ace184 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:31.036098 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ca147891-74c3-4a50-bf6a-ead507ace184 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:31.042075 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ca147891-74c3-4a50-bf6a-ead507ace184 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:31.042476 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ca147891-74c3-4a50-bf6a-ead507ace184 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:31.043236 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ca147891-74c3-4a50-bf6a-ead507ace184 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:31.043672 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ca147891-74c3-4a50-bf6a-ead507ace184 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:31.057483 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-ca147891-74c3-4a50-bf6a-ead507ace184 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] HTTP exception thrown: Instance 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 could not be found. Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ca147891-74c3-4a50-bf6a-ead507ace184 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Request method failure captured: Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 HTTP/1.1 Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5NYWWZ-ZO6eUaowxYHvN17DzgOyBcRp8mhJxqDpqy8rItuzorWJTwSOIastREFRyZr6c_ChbS_L6xrOAOnpyFVpWaRIYnwPEIqz770DyDVvyPoXIV-sm8ojvCAplLeG2g6jr_K6WyMCpHhf5lcBOzewCyTTCZt4Q13c3it9lc4tPjc Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 9ee0edfe1ca545a18061642a775747b5 Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServerActionsTestJSON-1025700685 Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_9ee0edfe1ca545a18061642a775747b5", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServerActionsTestJSON-1025700685 Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 9ee0edfe1ca545a18061642a775747b5 Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServerActionsTestJSON-1025700685 Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServerActionsTestJSON-1025700685-project Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 9434d247ee1c4143bc2cf07b834417ea Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServerActionsTestJSON-1025700685-project Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 could not be found. Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3'} Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 could not be found. Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 could not be found. Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:00:31.058992 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:31.070208 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:00:31.070208 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:00:31.070208 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:00:31.070208 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 19:00:31.070208 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 19:00:31.070208 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 could not be found. Jun 10 19:00:31.070208 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:31.070208 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ca147891-74c3-4a50-bf6a-ead507ace184 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Returning 404 to user: Instance 7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 19:00:31.070208 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ca147891-74c3-4a50-bf6a-ead507ace184 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3" status: 404 len: 111 microversion: 2.1 time: 0.028501 Jun 10 19:00:31.070208 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4115/7737] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:31 2022] GET /compute/v2.1/servers/7a5f925e-ff8e-42fd-ad52-3fcbe87efaa3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 19:00:31.071479 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-59b6a77c-8350-472f-b2cb-d11147f56777 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:31.071823 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-59b6a77c-8350-472f-b2cb-d11147f56777 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:31.077956 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-59b6a77c-8350-472f-b2cb-d11147f56777 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:31.078414 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-59b6a77c-8350-472f-b2cb-d11147f56777 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:31.079174 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-59b6a77c-8350-472f-b2cb-d11147f56777 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:31.079613 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-59b6a77c-8350-472f-b2cb-d11147f56777 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:31.095820 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-59b6a77c-8350-472f-b2cb-d11147f56777 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] HTTP exception thrown: Instance f97a76cd-13ac-4381-a584-711a5408c288 could not be found. Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-59b6a77c-8350-472f-b2cb-d11147f56777 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Request method failure captured: Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 HTTP/1.1 Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5NYWWZ-ZO6eUaowxYHvN17DzgOyBcRp8mhJxqDpqy8rItuzorWJTwSOIastREFRyZr6c_ChbS_L6xrOAOnpyFVpWaRIYnwPEIqz770DyDVvyPoXIV-sm8ojvCAplLeG2g6jr_K6WyMCpHhf5lcBOzewCyTTCZt4Q13c3it9lc4tPjc Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 9ee0edfe1ca545a18061642a775747b5 Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServerActionsTestJSON-1025700685 Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_9ee0edfe1ca545a18061642a775747b5", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServerActionsTestJSON-1025700685 Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 9ee0edfe1ca545a18061642a775747b5 Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServerActionsTestJSON-1025700685 Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServerActionsTestJSON-1025700685-project Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 9434d247ee1c4143bc2cf07b834417ea Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServerActionsTestJSON-1025700685-project Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: exception: Instance f97a76cd-13ac-4381-a584-711a5408c288 could not be found. Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'f97a76cd-13ac-4381-a584-711a5408c288'} Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f97a76cd-13ac-4381-a584-711a5408c288 could not be found. Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 19:00:31.101108 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 19:00:31.106049 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f97a76cd-13ac-4381-a584-711a5408c288 could not be found. Jun 10 19:00:31.106049 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:31.106049 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:00:31.106049 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:31.106049 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:00:31.106049 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:00:31.106049 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:00:31.106049 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 19:00:31.106049 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 19:00:31.106049 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f97a76cd-13ac-4381-a584-711a5408c288 could not be found. Jun 10 19:00:31.106049 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:31.106049 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-59b6a77c-8350-472f-b2cb-d11147f56777 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Returning 404 to user: Instance f97a76cd-13ac-4381-a584-711a5408c288 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 19:00:31.106049 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-59b6a77c-8350-472f-b2cb-d11147f56777 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "DELETE /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 404 len: 111 microversion: 2.1 time: 0.034337 Jun 10 19:00:31.106049 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4116/7738] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 19:00:31 2022] DELETE /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 19:00:31.107836 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-29195148-c9c5-479b-852d-21713dcc8072 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:31.108451 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-29195148-c9c5-479b-852d-21713dcc8072 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: f97a76cd-13ac-4381-a584-711a5408c288] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:31.115377 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-29195148-c9c5-479b-852d-21713dcc8072 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:31.115832 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-29195148-c9c5-479b-852d-21713dcc8072 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:31.116629 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-29195148-c9c5-479b-852d-21713dcc8072 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:31.117078 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-29195148-c9c5-479b-852d-21713dcc8072 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:31.131702 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-29195148-c9c5-479b-852d-21713dcc8072 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] HTTP exception thrown: Instance f97a76cd-13ac-4381-a584-711a5408c288 could not be found. Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-29195148-c9c5-479b-852d-21713dcc8072 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Request method failure captured: Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 HTTP/1.1 Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5NYWWZ-ZO6eUaowxYHvN17DzgOyBcRp8mhJxqDpqy8rItuzorWJTwSOIastREFRyZr6c_ChbS_L6xrOAOnpyFVpWaRIYnwPEIqz770DyDVvyPoXIV-sm8ojvCAplLeG2g6jr_K6WyMCpHhf5lcBOzewCyTTCZt4Q13c3it9lc4tPjc Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 9ee0edfe1ca545a18061642a775747b5 Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServerActionsTestJSON-1025700685 Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_9ee0edfe1ca545a18061642a775747b5", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServerActionsTestJSON-1025700685 Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 9ee0edfe1ca545a18061642a775747b5 Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServerActionsTestJSON-1025700685 Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServerActionsTestJSON-1025700685-project Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 9434d247ee1c4143bc2cf07b834417ea Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServerActionsTestJSON-1025700685-project Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: exception: Instance f97a76cd-13ac-4381-a584-711a5408c288 could not be found. Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'f97a76cd-13ac-4381-a584-711a5408c288'} Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f97a76cd-13ac-4381-a584-711a5408c288 could not be found. Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f97a76cd-13ac-4381-a584-711a5408c288 could not be found. Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:00:31.133315 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:31.141514 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:00:31.141514 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:00:31.141514 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:00:31.141514 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 19:00:31.141514 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 19:00:31.141514 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f97a76cd-13ac-4381-a584-711a5408c288 could not be found. Jun 10 19:00:31.141514 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:31.141514 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-29195148-c9c5-479b-852d-21713dcc8072 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Returning 404 to user: Instance f97a76cd-13ac-4381-a584-711a5408c288 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 19:00:31.141514 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-29195148-c9c5-479b-852d-21713dcc8072 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288" status: 404 len: 111 microversion: 2.1 time: 0.030626 Jun 10 19:00:31.141514 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4117/7739] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:31 2022] GET /compute/v2.1/servers/f97a76cd-13ac-4381-a584-711a5408c288 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 10 19:00:31.142750 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-887142cb-c2be-4d5b-a5c7-aeee9738314c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:31.143246 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-887142cb-c2be-4d5b-a5c7-aeee9738314c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:31.150133 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-887142cb-c2be-4d5b-a5c7-aeee9738314c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:31.150587 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-887142cb-c2be-4d5b-a5c7-aeee9738314c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:31.151680 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-887142cb-c2be-4d5b-a5c7-aeee9738314c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:31.152123 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-887142cb-c2be-4d5b-a5c7-aeee9738314c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:31.166498 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-887142cb-c2be-4d5b-a5c7-aeee9738314c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] HTTP exception thrown: Instance 8f3177ac-baf5-4136-ad02-e52f23f46f68 could not be found. Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-887142cb-c2be-4d5b-a5c7-aeee9738314c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Request method failure captured: Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 HTTP/1.1 Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5NYWWZ-ZO6eUaowxYHvN17DzgOyBcRp8mhJxqDpqy8rItuzorWJTwSOIastREFRyZr6c_ChbS_L6xrOAOnpyFVpWaRIYnwPEIqz770DyDVvyPoXIV-sm8ojvCAplLeG2g6jr_K6WyMCpHhf5lcBOzewCyTTCZt4Q13c3it9lc4tPjc Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 9ee0edfe1ca545a18061642a775747b5 Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServerActionsTestJSON-1025700685 Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_9ee0edfe1ca545a18061642a775747b5", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServerActionsTestJSON-1025700685 Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 9ee0edfe1ca545a18061642a775747b5 Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServerActionsTestJSON-1025700685 Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServerActionsTestJSON-1025700685-project Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 9434d247ee1c4143bc2cf07b834417ea Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServerActionsTestJSON-1025700685-project Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 8f3177ac-baf5-4136-ad02-e52f23f46f68 could not be found. Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '8f3177ac-baf5-4136-ad02-e52f23f46f68'} Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f3177ac-baf5-4136-ad02-e52f23f46f68 could not be found. Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 19:00:31.168102 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 19:00:31.174482 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f3177ac-baf5-4136-ad02-e52f23f46f68 could not be found. Jun 10 19:00:31.174482 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:31.174482 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:00:31.174482 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:31.174482 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:00:31.174482 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:00:31.174482 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:00:31.174482 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 19:00:31.174482 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 19:00:31.174482 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f3177ac-baf5-4136-ad02-e52f23f46f68 could not be found. Jun 10 19:00:31.174482 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:31.174482 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-887142cb-c2be-4d5b-a5c7-aeee9738314c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Returning 404 to user: Instance 8f3177ac-baf5-4136-ad02-e52f23f46f68 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 19:00:31.174482 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-887142cb-c2be-4d5b-a5c7-aeee9738314c tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "DELETE /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 404 len: 111 microversion: 2.1 time: 0.030344 Jun 10 19:00:31.174482 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4118/7740] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 19:00:31 2022] DELETE /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 19:00:31.178207 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-508ee733-384e-423f-92b2-340e582666e9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:31.178850 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-508ee733-384e-423f-92b2-340e582666e9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 8f3177ac-baf5-4136-ad02-e52f23f46f68] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:31.184833 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-508ee733-384e-423f-92b2-340e582666e9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:31.185288 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-508ee733-384e-423f-92b2-340e582666e9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:31.186060 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-508ee733-384e-423f-92b2-340e582666e9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:31.186506 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-508ee733-384e-423f-92b2-340e582666e9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:31.199959 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-508ee733-384e-423f-92b2-340e582666e9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] HTTP exception thrown: Instance 8f3177ac-baf5-4136-ad02-e52f23f46f68 could not be found. Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-508ee733-384e-423f-92b2-340e582666e9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Request method failure captured: Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 HTTP/1.1 Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5NYWWZ-ZO6eUaowxYHvN17DzgOyBcRp8mhJxqDpqy8rItuzorWJTwSOIastREFRyZr6c_ChbS_L6xrOAOnpyFVpWaRIYnwPEIqz770DyDVvyPoXIV-sm8ojvCAplLeG2g6jr_K6WyMCpHhf5lcBOzewCyTTCZt4Q13c3it9lc4tPjc Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 9ee0edfe1ca545a18061642a775747b5 Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServerActionsTestJSON-1025700685 Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_9ee0edfe1ca545a18061642a775747b5", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServerActionsTestJSON-1025700685 Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 9ee0edfe1ca545a18061642a775747b5 Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServerActionsTestJSON-1025700685 Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServerActionsTestJSON-1025700685-project Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 9434d247ee1c4143bc2cf07b834417ea Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServerActionsTestJSON-1025700685-project Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 8f3177ac-baf5-4136-ad02-e52f23f46f68 could not be found. Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '8f3177ac-baf5-4136-ad02-e52f23f46f68'} Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f3177ac-baf5-4136-ad02-e52f23f46f68 could not be found. Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f3177ac-baf5-4136-ad02-e52f23f46f68 could not be found. Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:00:31.201522 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:31.206481 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:00:31.206481 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:00:31.206481 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:00:31.206481 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 19:00:31.206481 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 19:00:31.206481 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f3177ac-baf5-4136-ad02-e52f23f46f68 could not be found. Jun 10 19:00:31.206481 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:31.206481 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-508ee733-384e-423f-92b2-340e582666e9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Returning 404 to user: Instance 8f3177ac-baf5-4136-ad02-e52f23f46f68 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 19:00:31.206481 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-508ee733-384e-423f-92b2-340e582666e9 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68" status: 404 len: 111 microversion: 2.1 time: 0.028939 Jun 10 19:00:31.206481 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4119/7741] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:31 2022] GET /compute/v2.1/servers/8f3177ac-baf5-4136-ad02-e52f23f46f68 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 19:00:31.211010 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8fc7c939-66a1-47c7-9414-bedb4998b68a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:31.212281 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8fc7c939-66a1-47c7-9414-bedb4998b68a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:31.218145 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8fc7c939-66a1-47c7-9414-bedb4998b68a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:31.218616 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8fc7c939-66a1-47c7-9414-bedb4998b68a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:31.219385 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8fc7c939-66a1-47c7-9414-bedb4998b68a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:31.219825 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8fc7c939-66a1-47c7-9414-bedb4998b68a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:31.234207 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-8fc7c939-66a1-47c7-9414-bedb4998b68a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] HTTP exception thrown: Instance 07deb4af-bbda-4469-9f0d-9ad15b54741b could not be found. Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8fc7c939-66a1-47c7-9414-bedb4998b68a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Request method failure captured: Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b HTTP/1.1 Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5NYWWZ-ZO6eUaowxYHvN17DzgOyBcRp8mhJxqDpqy8rItuzorWJTwSOIastREFRyZr6c_ChbS_L6xrOAOnpyFVpWaRIYnwPEIqz770DyDVvyPoXIV-sm8ojvCAplLeG2g6jr_K6WyMCpHhf5lcBOzewCyTTCZt4Q13c3it9lc4tPjc Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 9ee0edfe1ca545a18061642a775747b5 Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServerActionsTestJSON-1025700685 Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_9ee0edfe1ca545a18061642a775747b5", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServerActionsTestJSON-1025700685 Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 9ee0edfe1ca545a18061642a775747b5 Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServerActionsTestJSON-1025700685 Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServerActionsTestJSON-1025700685-project Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 9434d247ee1c4143bc2cf07b834417ea Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServerActionsTestJSON-1025700685-project Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 07deb4af-bbda-4469-9f0d-9ad15b54741b could not be found. Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '07deb4af-bbda-4469-9f0d-9ad15b54741b'} Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07deb4af-bbda-4469-9f0d-9ad15b54741b could not be found. Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 19:00:31.235927 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 19:00:31.240962 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07deb4af-bbda-4469-9f0d-9ad15b54741b could not be found. Jun 10 19:00:31.240962 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:31.240962 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:00:31.240962 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:31.240962 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:00:31.240962 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:00:31.240962 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:00:31.240962 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 19:00:31.240962 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 19:00:31.240962 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07deb4af-bbda-4469-9f0d-9ad15b54741b could not be found. Jun 10 19:00:31.240962 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:31.240962 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8fc7c939-66a1-47c7-9414-bedb4998b68a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Returning 404 to user: Instance 07deb4af-bbda-4469-9f0d-9ad15b54741b could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 19:00:31.240962 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8fc7c939-66a1-47c7-9414-bedb4998b68a tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "DELETE /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 404 len: 111 microversion: 2.1 time: 0.029905 Jun 10 19:00:31.240962 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4120/7742] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 19:00:31 2022] DELETE /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 19:00:31.246060 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0063c760-cc0d-4de7-a0a8-cdaf7c77840d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:31.246682 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0063c760-cc0d-4de7-a0a8-cdaf7c77840d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [instance: 07deb4af-bbda-4469-9f0d-9ad15b54741b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:31.253129 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0063c760-cc0d-4de7-a0a8-cdaf7c77840d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:31.253583 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0063c760-cc0d-4de7-a0a8-cdaf7c77840d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:31.254359 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0063c760-cc0d-4de7-a0a8-cdaf7c77840d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:31.254830 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0063c760-cc0d-4de7-a0a8-cdaf7c77840d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:31.268780 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-0063c760-cc0d-4de7-a0a8-cdaf7c77840d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] HTTP exception thrown: Instance 07deb4af-bbda-4469-9f0d-9ad15b54741b could not be found. Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0063c760-cc0d-4de7-a0a8-cdaf7c77840d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Request method failure captured: Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b HTTP/1.1 Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5NYWWZ-ZO6eUaowxYHvN17DzgOyBcRp8mhJxqDpqy8rItuzorWJTwSOIastREFRyZr6c_ChbS_L6xrOAOnpyFVpWaRIYnwPEIqz770DyDVvyPoXIV-sm8ojvCAplLeG2g6jr_K6WyMCpHhf5lcBOzewCyTTCZt4Q13c3it9lc4tPjc Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 9ee0edfe1ca545a18061642a775747b5 Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServerActionsTestJSON-1025700685 Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9ee0edfe1ca545a18061642a775747b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_9ee0edfe1ca545a18061642a775747b5", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServerActionsTestJSON-1025700685 Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 9ee0edfe1ca545a18061642a775747b5 Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServerActionsTestJSON-1025700685 Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServerActionsTestJSON-1025700685-project Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 9434d247ee1c4143bc2cf07b834417ea Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServerActionsTestJSON-1025700685-project Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 07deb4af-bbda-4469-9f0d-9ad15b54741b could not be found. Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '07deb4af-bbda-4469-9f0d-9ad15b54741b'} Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07deb4af-bbda-4469-9f0d-9ad15b54741b could not be found. Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07deb4af-bbda-4469-9f0d-9ad15b54741b could not be found. Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:00:31.270355 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:31.275088 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:00:31.275088 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:00:31.275088 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:00:31.275088 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 19:00:31.275088 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 19:00:31.275088 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07deb4af-bbda-4469-9f0d-9ad15b54741b could not be found. Jun 10 19:00:31.275088 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:00:31.275088 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0063c760-cc0d-4de7-a0a8-cdaf7c77840d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Returning 404 to user: Instance 07deb4af-bbda-4469-9f0d-9ad15b54741b could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 19:00:31.275088 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0063c760-cc0d-4de7-a0a8-cdaf7c77840d tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b" status: 404 len: 111 microversion: 2.1 time: 0.029341 Jun 10 19:00:31.275088 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4121/7743] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:31 2022] GET /compute/v2.1/servers/07deb4af-bbda-4469-9f0d-9ad15b54741b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 19:00:31.280147 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-96d418f8-f4f2-4733-80c1-e7a0386ad2d8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] Calling method '.version_select at 0x7f77c17fc310>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:31.283266 chdv-master-2 devstack@n-api.service[126595]: ERROR oslo.messaging._drivers.impl_rabbit [None req-96d418f8-f4f2-4733-80c1-e7a0386ad2d8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [810142a8-37af-4b57-a57e-ca2623af985c] AMQP server on 10.222.0.35:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 10 19:00:32.296471 chdv-master-2 devstack@n-api.service[126595]: INFO oslo.messaging._drivers.impl_rabbit [None req-96d418f8-f4f2-4733-80c1-e7a0386ad2d8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] [810142a8-37af-4b57-a57e-ca2623af985c] Reconnected to AMQP server on 10.222.0.35:5672 via [amqp] client with port 45766. Jun 10 19:00:32.369392 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-96d418f8-f4f2-4733-80c1-e7a0386ad2d8 tempest-ServerActionsTestJSON-1025700685 tempest-ServerActionsTestJSON-1025700685-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-434241289" status: 202 len: 0 microversion: 2.1 time: 1.092821 Jun 10 19:00:32.369984 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4122/7744] 10.222.0.35 () {58 vars in 1217 bytes} [Fri Jun 10 19:00:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-434241289 => generated 0 bytes in 1094 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 19:00:39.777128 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1dbb0136-675b-479c-b42e-af76701f4409 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-931274048", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "7db59342-34a7-4ab0-aaef-ff9268f8ed35"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:00:39.784913 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:00:39.829638 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-1dbb0136-675b-479c-b42e-af76701f4409 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] validate_networks() for [('7db59342-34a7-4ab0-aaef-ff9268f8ed35', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 19:00:40.172700 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-1dbb0136-675b-479c-b42e-af76701f4409 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 19:00:40.173127 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-1dbb0136-675b-479c-b42e-af76701f4409 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 19:00:40.173605 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-1dbb0136-675b-479c-b42e-af76701f4409 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 19:00:40.174018 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-1dbb0136-675b-479c-b42e-af76701f4409 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 19:00:40.174484 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-1dbb0136-675b-479c-b42e-af76701f4409 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 19:00:40.183358 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1dbb0136-675b-479c-b42e-af76701f4409 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:40.183857 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1dbb0136-675b-479c-b42e-af76701f4409 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:40.184644 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1dbb0136-675b-479c-b42e-af76701f4409 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:40.185089 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1dbb0136-675b-479c-b42e-af76701f4409 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:40.205307 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-1dbb0136-675b-479c-b42e-af76701f4409 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Getting quotas for project 47319e67ec724d628f806f0cdc942ef5. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 19:00:40.211463 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-1dbb0136-675b-479c-b42e-af76701f4409 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Getting quotas for user 9379afee249f4cd0b97d9eba592b588b and project 47319e67ec724d628f806f0cdc942ef5. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 19:00:40.224606 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1dbb0136-675b-479c-b42e-af76701f4409 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 19:00:40.226906 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1dbb0136-675b-479c-b42e-af76701f4409 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: e05479a1-153d-4987-81f3-524fadbaddd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 19:00:40.358988 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1dbb0136-675b-479c-b42e-af76701f4409 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.694640 Jun 10 19:00:40.359829 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4123/7745] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 19:00:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 10 19:00:40.370383 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6eb91b4e-47b5-4bd4-9323-8528d2249ab9 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:40.370994 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6eb91b4e-47b5-4bd4-9323-8528d2249ab9 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: e05479a1-153d-4987-81f3-524fadbaddd3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:40.428951 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6eb91b4e-47b5-4bd4-9323-8528d2249ab9 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9379afee249f4cd0b97d9eba592b588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47319e67ec724d628f806f0cdc942ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:40.435836 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6eb91b4e-47b5-4bd4-9323-8528d2249ab9 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "GET /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3" status: 200 len: 1216 microversion: 2.1 time: 0.069209 Jun 10 19:00:40.436359 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4124/7746] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:40 2022] GET /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3 => generated 1216 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:00:41.452508 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-54c4e6dc-b6d1-4fbb-9e63-a20c18551c61 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:41.453134 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-54c4e6dc-b6d1-4fbb-9e63-a20c18551c61 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: e05479a1-153d-4987-81f3-524fadbaddd3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:41.461510 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-54c4e6dc-b6d1-4fbb-9e63-a20c18551c61 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:41.461970 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-54c4e6dc-b6d1-4fbb-9e63-a20c18551c61 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:41.462747 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-54c4e6dc-b6d1-4fbb-9e63-a20c18551c61 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:41.463190 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-54c4e6dc-b6d1-4fbb-9e63-a20c18551c61 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:41.529103 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-54c4e6dc-b6d1-4fbb-9e63-a20c18551c61 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9379afee249f4cd0b97d9eba592b588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47319e67ec724d628f806f0cdc942ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:41.536624 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-54c4e6dc-b6d1-4fbb-9e63-a20c18551c61 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "GET /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3" status: 200 len: 1220 microversion: 2.1 time: 0.088051 Jun 10 19:00:41.537205 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4125/7747] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:41 2022] GET /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:00:42.554237 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-44dd4375-51f0-4f69-8c80-411cab7f260f tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:42.554929 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-44dd4375-51f0-4f69-8c80-411cab7f260f tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: e05479a1-153d-4987-81f3-524fadbaddd3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:42.561171 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44dd4375-51f0-4f69-8c80-411cab7f260f tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:42.561639 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44dd4375-51f0-4f69-8c80-411cab7f260f tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:42.562414 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44dd4375-51f0-4f69-8c80-411cab7f260f tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:42.562864 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44dd4375-51f0-4f69-8c80-411cab7f260f tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:42.630749 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-44dd4375-51f0-4f69-8c80-411cab7f260f tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9379afee249f4cd0b97d9eba592b588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47319e67ec724d628f806f0cdc942ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:42.639297 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-44dd4375-51f0-4f69-8c80-411cab7f260f tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "GET /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3" status: 200 len: 1274 microversion: 2.1 time: 0.089674 Jun 10 19:00:42.639973 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4126/7748] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:42 2022] GET /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3 => generated 1274 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:00:43.655652 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e9ef2fcd-e42b-4204-a440-30fe1262d78c tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:43.656299 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e9ef2fcd-e42b-4204-a440-30fe1262d78c tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: e05479a1-153d-4987-81f3-524fadbaddd3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:43.663270 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e9ef2fcd-e42b-4204-a440-30fe1262d78c tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:43.663730 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e9ef2fcd-e42b-4204-a440-30fe1262d78c tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:43.664533 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e9ef2fcd-e42b-4204-a440-30fe1262d78c tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:43.664980 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e9ef2fcd-e42b-4204-a440-30fe1262d78c tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:43.800813 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e9ef2fcd-e42b-4204-a440-30fe1262d78c tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9379afee249f4cd0b97d9eba592b588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47319e67ec724d628f806f0cdc942ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:43.808617 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e9ef2fcd-e42b-4204-a440-30fe1262d78c tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "GET /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3" status: 200 len: 1316 microversion: 2.1 time: 0.157035 Jun 10 19:00:43.809194 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4127/7749] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:43 2022] GET /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:00:43.813623 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-8276c01c-6db3-4ff8-a217-18ae8e6fd6f3 req-7ad3c6e9-337d-459c-8a01-303cebc2b5ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e05479a1-153d-4987-81f3-524fadbaddd3", "tag": "49fb4636-c523-492c-9503-d64a774757c3"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:00:43.821919 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-8276c01c-6db3-4ff8-a217-18ae8e6fd6f3 req-7ad3c6e9-337d-459c-8a01-303cebc2b5ff service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:43.822365 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-8276c01c-6db3-4ff8-a217-18ae8e6fd6f3 req-7ad3c6e9-337d-459c-8a01-303cebc2b5ff service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:43.833322 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-8276c01c-6db3-4ff8-a217-18ae8e6fd6f3 req-7ad3c6e9-337d-459c-8a01-303cebc2b5ff service nova] Creating event network-changed:49fb4636-c523-492c-9503-d64a774757c3 for instance e05479a1-153d-4987-81f3-524fadbaddd3 on chh1-master-2 Jun 10 19:00:43.838456 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-8276c01c-6db3-4ff8-a217-18ae8e6fd6f3 req-7ad3c6e9-337d-459c-8a01-303cebc2b5ff service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028150 Jun 10 19:00:43.839288 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4128/7750] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:00:44.827788 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a3735709-a2ea-40dc-9c21-e5ccc963210b tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:44.828523 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a3735709-a2ea-40dc-9c21-e5ccc963210b tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: e05479a1-153d-4987-81f3-524fadbaddd3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:44.835394 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a3735709-a2ea-40dc-9c21-e5ccc963210b tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:44.835847 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a3735709-a2ea-40dc-9c21-e5ccc963210b tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:44.836640 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a3735709-a2ea-40dc-9c21-e5ccc963210b tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:44.837083 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a3735709-a2ea-40dc-9c21-e5ccc963210b tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:44.965347 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a3735709-a2ea-40dc-9c21-e5ccc963210b tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9379afee249f4cd0b97d9eba592b588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47319e67ec724d628f806f0cdc942ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:44.973102 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a3735709-a2ea-40dc-9c21-e5ccc963210b tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "GET /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3" status: 200 len: 1316 microversion: 2.1 time: 0.150493 Jun 10 19:00:44.973676 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4129/7751] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:44 2022] GET /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3 => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:00:45.989871 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-78ae8ddd-6f59-425f-8195-3a84879542a5 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:45.990524 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-78ae8ddd-6f59-425f-8195-3a84879542a5 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: e05479a1-153d-4987-81f3-524fadbaddd3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:45.997362 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-78ae8ddd-6f59-425f-8195-3a84879542a5 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:45.997818 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-78ae8ddd-6f59-425f-8195-3a84879542a5 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:45.998596 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-78ae8ddd-6f59-425f-8195-3a84879542a5 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:45.999070 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-78ae8ddd-6f59-425f-8195-3a84879542a5 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:46.131282 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-78ae8ddd-6f59-425f-8195-3a84879542a5 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9379afee249f4cd0b97d9eba592b588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47319e67ec724d628f806f0cdc942ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:46.138999 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-78ae8ddd-6f59-425f-8195-3a84879542a5 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "GET /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3" status: 200 len: 1316 microversion: 2.1 time: 0.153072 Jun 10 19:00:46.139771 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4130/7752] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:45 2022] GET /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3 => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:00:47.156766 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0e89c949-fcb7-421f-805c-45b2b4bf3aa7 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:47.157450 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0e89c949-fcb7-421f-805c-45b2b4bf3aa7 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: e05479a1-153d-4987-81f3-524fadbaddd3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:47.166516 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0e89c949-fcb7-421f-805c-45b2b4bf3aa7 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:47.167272 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0e89c949-fcb7-421f-805c-45b2b4bf3aa7 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:47.168128 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0e89c949-fcb7-421f-805c-45b2b4bf3aa7 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:47.168586 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0e89c949-fcb7-421f-805c-45b2b4bf3aa7 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:47.303197 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0e89c949-fcb7-421f-805c-45b2b4bf3aa7 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9379afee249f4cd0b97d9eba592b588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47319e67ec724d628f806f0cdc942ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:47.310885 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0e89c949-fcb7-421f-805c-45b2b4bf3aa7 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "GET /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3" status: 200 len: 1316 microversion: 2.1 time: 0.158201 Jun 10 19:00:47.311471 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4131/7753] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:47 2022] GET /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3 => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:00:48.328509 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ec08017e-8a8c-4445-b1a9-1bfcd1c8994b tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:48.329212 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ec08017e-8a8c-4445-b1a9-1bfcd1c8994b tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: e05479a1-153d-4987-81f3-524fadbaddd3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:48.337160 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ec08017e-8a8c-4445-b1a9-1bfcd1c8994b tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:48.337615 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ec08017e-8a8c-4445-b1a9-1bfcd1c8994b tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:48.341121 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ec08017e-8a8c-4445-b1a9-1bfcd1c8994b tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:48.341121 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ec08017e-8a8c-4445-b1a9-1bfcd1c8994b tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:48.471859 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ec08017e-8a8c-4445-b1a9-1bfcd1c8994b tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9379afee249f4cd0b97d9eba592b588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47319e67ec724d628f806f0cdc942ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:48.479426 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ec08017e-8a8c-4445-b1a9-1bfcd1c8994b tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "GET /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3" status: 200 len: 1316 microversion: 2.1 time: 0.155009 Jun 10 19:00:48.479991 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4132/7754] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:48 2022] GET /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3 => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:00:48.961931 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-657d673a-c049-4534-b7f5-74f5fa6ab787 req-23ef8f94-3f6c-478b-8b88-6f2abafde8b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e05479a1-153d-4987-81f3-524fadbaddd3", "name": "network-vif-plugged", "status": "completed", "tag": "49fb4636-c523-492c-9503-d64a774757c3"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:00:48.970413 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-657d673a-c049-4534-b7f5-74f5fa6ab787 req-23ef8f94-3f6c-478b-8b88-6f2abafde8b0 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:48.970906 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-657d673a-c049-4534-b7f5-74f5fa6ab787 req-23ef8f94-3f6c-478b-8b88-6f2abafde8b0 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:48.981695 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-657d673a-c049-4534-b7f5-74f5fa6ab787 req-23ef8f94-3f6c-478b-8b88-6f2abafde8b0 service nova] Creating event network-vif-plugged:49fb4636-c523-492c-9503-d64a774757c3 for instance e05479a1-153d-4987-81f3-524fadbaddd3 on chh1-master-2 Jun 10 19:00:48.986827 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-657d673a-c049-4534-b7f5-74f5fa6ab787 req-23ef8f94-3f6c-478b-8b88-6f2abafde8b0 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028607 Jun 10 19:00:48.987485 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4133/7755] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:00:49.497466 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7ee7e6f6-6646-45b9-ac90-b15f59bcdfa3 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:49.498161 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7ee7e6f6-6646-45b9-ac90-b15f59bcdfa3 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: e05479a1-153d-4987-81f3-524fadbaddd3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:49.505365 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7ee7e6f6-6646-45b9-ac90-b15f59bcdfa3 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:49.505826 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7ee7e6f6-6646-45b9-ac90-b15f59bcdfa3 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:49.506597 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7ee7e6f6-6646-45b9-ac90-b15f59bcdfa3 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:49.507041 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7ee7e6f6-6646-45b9-ac90-b15f59bcdfa3 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:49.527941 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:00:49.638252 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7ee7e6f6-6646-45b9-ac90-b15f59bcdfa3 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9379afee249f4cd0b97d9eba592b588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47319e67ec724d628f806f0cdc942ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:49.646352 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7ee7e6f6-6646-45b9-ac90-b15f59bcdfa3 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "GET /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3" status: 200 len: 1316 microversion: 2.1 time: 0.154052 Jun 10 19:00:49.646925 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4134/7756] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:49 2022] GET /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3 => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:00:50.662956 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-883ee552-3245-4acb-a3ef-5b4a15ba9dc0 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:50.663557 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-883ee552-3245-4acb-a3ef-5b4a15ba9dc0 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: e05479a1-153d-4987-81f3-524fadbaddd3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:50.665506 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:00:50.666206 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=8 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:00:50.671810 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-883ee552-3245-4acb-a3ef-5b4a15ba9dc0 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:50.672226 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-883ee552-3245-4acb-a3ef-5b4a15ba9dc0 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:50.673022 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-883ee552-3245-4acb-a3ef-5b4a15ba9dc0 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:50.678358 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-883ee552-3245-4acb-a3ef-5b4a15ba9dc0 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:50.807450 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-883ee552-3245-4acb-a3ef-5b4a15ba9dc0 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9379afee249f4cd0b97d9eba592b588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47319e67ec724d628f806f0cdc942ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:50.815047 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-883ee552-3245-4acb-a3ef-5b4a15ba9dc0 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "GET /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3" status: 200 len: 1504 microversion: 2.1 time: 0.156047 Jun 10 19:00:50.815650 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4135/7757] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:50 2022] GET /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:00:50.869797 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-77f715b2-c859-45a1-827e-14983efc91f3 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1957135571", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "7db59342-34a7-4ab0-aaef-ff9268f8ed35"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:00:50.919946 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-77f715b2-c859-45a1-827e-14983efc91f3 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] validate_networks() for [('7db59342-34a7-4ab0-aaef-ff9268f8ed35', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 19:00:51.281233 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-77f715b2-c859-45a1-827e-14983efc91f3 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 19:00:51.281607 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-77f715b2-c859-45a1-827e-14983efc91f3 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 19:00:51.282080 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-77f715b2-c859-45a1-827e-14983efc91f3 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 19:00:51.282490 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-77f715b2-c859-45a1-827e-14983efc91f3 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 19:00:51.282902 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-77f715b2-c859-45a1-827e-14983efc91f3 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 19:00:51.292618 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-77f715b2-c859-45a1-827e-14983efc91f3 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:51.293070 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-77f715b2-c859-45a1-827e-14983efc91f3 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:51.293861 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-77f715b2-c859-45a1-827e-14983efc91f3 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:51.294295 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-77f715b2-c859-45a1-827e-14983efc91f3 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:51.311248 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-77f715b2-c859-45a1-827e-14983efc91f3 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Getting quotas for project 47319e67ec724d628f806f0cdc942ef5. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 19:00:51.317094 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-77f715b2-c859-45a1-827e-14983efc91f3 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Getting quotas for user 9379afee249f4cd0b97d9eba592b588b and project 47319e67ec724d628f806f0cdc942ef5. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 19:00:51.329162 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-77f715b2-c859-45a1-827e-14983efc91f3 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 19:00:51.331387 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-77f715b2-c859-45a1-827e-14983efc91f3 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: 5afab464-e9a7-48a6-b957-389eed37db12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 19:00:51.438281 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-77f715b2-c859-45a1-827e-14983efc91f3 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.572295 Jun 10 19:00:51.438934 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4136/7758] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 19:00:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 10 19:00:51.448844 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-88c58017-bbf7-4491-b2b9-4c6d8d629a1e tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:51.449463 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-88c58017-bbf7-4491-b2b9-4c6d8d629a1e tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: 5afab464-e9a7-48a6-b957-389eed37db12] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:51.508587 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-88c58017-bbf7-4491-b2b9-4c6d8d629a1e tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9379afee249f4cd0b97d9eba592b588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47319e67ec724d628f806f0cdc942ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:51.516065 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-88c58017-bbf7-4491-b2b9-4c6d8d629a1e tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "GET /compute/v2.1/servers/5afab464-e9a7-48a6-b957-389eed37db12" status: 200 len: 1217 microversion: 2.1 time: 0.070839 Jun 10 19:00:51.516918 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4137/7759] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:51 2022] GET /compute/v2.1/servers/5afab464-e9a7-48a6-b957-389eed37db12 => generated 1217 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:00:52.532502 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d4de68a9-346e-4d19-ae9d-b7c340e31e3e tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:52.533185 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d4de68a9-346e-4d19-ae9d-b7c340e31e3e tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: 5afab464-e9a7-48a6-b957-389eed37db12] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:52.540472 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d4de68a9-346e-4d19-ae9d-b7c340e31e3e tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:52.540932 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d4de68a9-346e-4d19-ae9d-b7c340e31e3e tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:52.541706 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d4de68a9-346e-4d19-ae9d-b7c340e31e3e tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:52.542155 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d4de68a9-346e-4d19-ae9d-b7c340e31e3e tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:52.604429 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d4de68a9-346e-4d19-ae9d-b7c340e31e3e tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9379afee249f4cd0b97d9eba592b588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47319e67ec724d628f806f0cdc942ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:52.611978 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d4de68a9-346e-4d19-ae9d-b7c340e31e3e tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "GET /compute/v2.1/servers/5afab464-e9a7-48a6-b957-389eed37db12" status: 200 len: 1221 microversion: 2.1 time: 0.083481 Jun 10 19:00:52.613084 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4138/7760] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:52 2022] GET /compute/v2.1/servers/5afab464-e9a7-48a6-b957-389eed37db12 => generated 1221 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:00:53.629773 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2a6cd4aa-a1da-4063-a550-15d7e6a87a4a tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:53.630525 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2a6cd4aa-a1da-4063-a550-15d7e6a87a4a tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: 5afab464-e9a7-48a6-b957-389eed37db12] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:53.637932 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2a6cd4aa-a1da-4063-a550-15d7e6a87a4a tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:53.638460 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2a6cd4aa-a1da-4063-a550-15d7e6a87a4a tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:53.639279 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2a6cd4aa-a1da-4063-a550-15d7e6a87a4a tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:53.639727 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2a6cd4aa-a1da-4063-a550-15d7e6a87a4a tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:53.707926 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2a6cd4aa-a1da-4063-a550-15d7e6a87a4a tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9379afee249f4cd0b97d9eba592b588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47319e67ec724d628f806f0cdc942ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:53.722842 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2a6cd4aa-a1da-4063-a550-15d7e6a87a4a tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "GET /compute/v2.1/servers/5afab464-e9a7-48a6-b957-389eed37db12" status: 200 len: 1287 microversion: 2.1 time: 0.097215 Jun 10 19:00:53.723476 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4139/7761] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:53 2022] GET /compute/v2.1/servers/5afab464-e9a7-48a6-b957-389eed37db12 => generated 1287 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:00:54.744006 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6bb2edeb-4d13-40d3-ae15-c3c519c89b2a tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:54.744691 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6bb2edeb-4d13-40d3-ae15-c3c519c89b2a tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: 5afab464-e9a7-48a6-b957-389eed37db12] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:54.751924 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6bb2edeb-4d13-40d3-ae15-c3c519c89b2a tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:54.752402 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6bb2edeb-4d13-40d3-ae15-c3c519c89b2a tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:54.754181 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6bb2edeb-4d13-40d3-ae15-c3c519c89b2a tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:54.754634 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6bb2edeb-4d13-40d3-ae15-c3c519c89b2a tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:54.888971 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6bb2edeb-4d13-40d3-ae15-c3c519c89b2a tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9379afee249f4cd0b97d9eba592b588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47319e67ec724d628f806f0cdc942ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:54.897618 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6bb2edeb-4d13-40d3-ae15-c3c519c89b2a tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "GET /compute/v2.1/servers/5afab464-e9a7-48a6-b957-389eed37db12" status: 200 len: 1317 microversion: 2.1 time: 0.157212 Jun 10 19:00:54.897618 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4140/7762] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:54 2022] GET /compute/v2.1/servers/5afab464-e9a7-48a6-b957-389eed37db12 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:00:54.974073 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-56c41fd3-9220-43aa-b539-f074d0b6f7d6 req-9e0b4c73-9f89-481d-b0c5-e54ef979d621 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5afab464-e9a7-48a6-b957-389eed37db12", "tag": "4b5d90f6-6782-4ba6-a8ad-4e4da963d1bd"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:00:54.983970 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-56c41fd3-9220-43aa-b539-f074d0b6f7d6 req-9e0b4c73-9f89-481d-b0c5-e54ef979d621 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:54.985972 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-56c41fd3-9220-43aa-b539-f074d0b6f7d6 req-9e0b4c73-9f89-481d-b0c5-e54ef979d621 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:54.997533 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-56c41fd3-9220-43aa-b539-f074d0b6f7d6 req-9e0b4c73-9f89-481d-b0c5-e54ef979d621 service nova] Creating event network-changed:4b5d90f6-6782-4ba6-a8ad-4e4da963d1bd for instance 5afab464-e9a7-48a6-b957-389eed37db12 on chh2-master-2 Jun 10 19:00:55.002752 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-56c41fd3-9220-43aa-b539-f074d0b6f7d6 req-9e0b4c73-9f89-481d-b0c5-e54ef979d621 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033289 Jun 10 19:00:55.003352 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4141/7763] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:00:55.915994 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2a47f10b-19be-4839-bbfe-1bd852798805 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:55.916734 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2a47f10b-19be-4839-bbfe-1bd852798805 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: 5afab464-e9a7-48a6-b957-389eed37db12] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:55.923369 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2a47f10b-19be-4839-bbfe-1bd852798805 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:55.923832 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2a47f10b-19be-4839-bbfe-1bd852798805 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:55.924645 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2a47f10b-19be-4839-bbfe-1bd852798805 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:55.925737 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2a47f10b-19be-4839-bbfe-1bd852798805 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:56.056612 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2a47f10b-19be-4839-bbfe-1bd852798805 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9379afee249f4cd0b97d9eba592b588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47319e67ec724d628f806f0cdc942ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:56.064088 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2a47f10b-19be-4839-bbfe-1bd852798805 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "GET /compute/v2.1/servers/5afab464-e9a7-48a6-b957-389eed37db12" status: 200 len: 1317 microversion: 2.1 time: 0.153349 Jun 10 19:00:56.064694 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4142/7764] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:55 2022] GET /compute/v2.1/servers/5afab464-e9a7-48a6-b957-389eed37db12 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:00:57.081512 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b0ebd100-7cbf-4bbf-9c4f-0514b4d26d73 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:57.082120 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b0ebd100-7cbf-4bbf-9c4f-0514b4d26d73 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: 5afab464-e9a7-48a6-b957-389eed37db12] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:57.089115 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b0ebd100-7cbf-4bbf-9c4f-0514b4d26d73 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:57.090027 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b0ebd100-7cbf-4bbf-9c4f-0514b4d26d73 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:57.090331 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b0ebd100-7cbf-4bbf-9c4f-0514b4d26d73 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:57.090775 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b0ebd100-7cbf-4bbf-9c4f-0514b4d26d73 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:57.291764 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b0ebd100-7cbf-4bbf-9c4f-0514b4d26d73 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9379afee249f4cd0b97d9eba592b588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47319e67ec724d628f806f0cdc942ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:57.299355 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b0ebd100-7cbf-4bbf-9c4f-0514b4d26d73 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "GET /compute/v2.1/servers/5afab464-e9a7-48a6-b957-389eed37db12" status: 200 len: 1317 microversion: 2.1 time: 0.222317 Jun 10 19:00:57.300478 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4143/7765] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:57 2022] GET /compute/v2.1/servers/5afab464-e9a7-48a6-b957-389eed37db12 => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:00:58.317803 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c71cb957-7ca1-436a-b0aa-b1d69ea4fbc5 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:58.318427 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c71cb957-7ca1-436a-b0aa-b1d69ea4fbc5 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: 5afab464-e9a7-48a6-b957-389eed37db12] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:58.325574 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c71cb957-7ca1-436a-b0aa-b1d69ea4fbc5 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:58.328658 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c71cb957-7ca1-436a-b0aa-b1d69ea4fbc5 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:58.328658 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c71cb957-7ca1-436a-b0aa-b1d69ea4fbc5 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:58.328658 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c71cb957-7ca1-436a-b0aa-b1d69ea4fbc5 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:58.467315 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c71cb957-7ca1-436a-b0aa-b1d69ea4fbc5 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9379afee249f4cd0b97d9eba592b588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47319e67ec724d628f806f0cdc942ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:58.475557 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c71cb957-7ca1-436a-b0aa-b1d69ea4fbc5 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "GET /compute/v2.1/servers/5afab464-e9a7-48a6-b957-389eed37db12" status: 200 len: 1317 microversion: 2.1 time: 0.162870 Jun 10 19:00:58.476153 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4144/7766] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:58 2022] GET /compute/v2.1/servers/5afab464-e9a7-48a6-b957-389eed37db12 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:00:59.492268 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bd8d386f-625c-4f38-b3fb-ea0e6d5211bb tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:00:59.492895 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bd8d386f-625c-4f38-b3fb-ea0e6d5211bb tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: 5afab464-e9a7-48a6-b957-389eed37db12] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:00:59.499754 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bd8d386f-625c-4f38-b3fb-ea0e6d5211bb tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:59.500201 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bd8d386f-625c-4f38-b3fb-ea0e6d5211bb tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:59.501251 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bd8d386f-625c-4f38-b3fb-ea0e6d5211bb tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:00:59.501687 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bd8d386f-625c-4f38-b3fb-ea0e6d5211bb tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:00:59.630085 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bd8d386f-625c-4f38-b3fb-ea0e6d5211bb tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9379afee249f4cd0b97d9eba592b588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47319e67ec724d628f806f0cdc942ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:00:59.637617 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bd8d386f-625c-4f38-b3fb-ea0e6d5211bb tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "GET /compute/v2.1/servers/5afab464-e9a7-48a6-b957-389eed37db12" status: 200 len: 1317 microversion: 2.1 time: 0.149222 Jun 10 19:00:59.638201 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4145/7767] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:00:59 2022] GET /compute/v2.1/servers/5afab464-e9a7-48a6-b957-389eed37db12 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:01:00.525867 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-47aa4c23-a21c-44a4-837b-38a9d08eb2c6 req-fea07d77-c830-4f1d-9b03-f9391eff56be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5afab464-e9a7-48a6-b957-389eed37db12", "name": "network-vif-plugged", "status": "completed", "tag": "4b5d90f6-6782-4ba6-a8ad-4e4da963d1bd"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:01:00.535369 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-47aa4c23-a21c-44a4-837b-38a9d08eb2c6 req-fea07d77-c830-4f1d-9b03-f9391eff56be service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:00.535818 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-47aa4c23-a21c-44a4-837b-38a9d08eb2c6 req-fea07d77-c830-4f1d-9b03-f9391eff56be service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:00.546633 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-47aa4c23-a21c-44a4-837b-38a9d08eb2c6 req-fea07d77-c830-4f1d-9b03-f9391eff56be service nova] Creating event network-vif-plugged:4b5d90f6-6782-4ba6-a8ad-4e4da963d1bd for instance 5afab464-e9a7-48a6-b957-389eed37db12 on chh2-master-2 Jun 10 19:01:00.552459 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-47aa4c23-a21c-44a4-837b-38a9d08eb2c6 req-fea07d77-c830-4f1d-9b03-f9391eff56be service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030337 Jun 10 19:01:00.553056 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4146/7768] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:01:00.655612 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c396cc82-b4a5-477e-9480-9cfb017e49a0 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:01:00.656580 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c396cc82-b4a5-477e-9480-9cfb017e49a0 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: 5afab464-e9a7-48a6-b957-389eed37db12] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:01:00.668025 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c396cc82-b4a5-477e-9480-9cfb017e49a0 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:00.668025 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c396cc82-b4a5-477e-9480-9cfb017e49a0 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:00.668025 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c396cc82-b4a5-477e-9480-9cfb017e49a0 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:00.668025 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c396cc82-b4a5-477e-9480-9cfb017e49a0 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:00.804349 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c396cc82-b4a5-477e-9480-9cfb017e49a0 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9379afee249f4cd0b97d9eba592b588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47319e67ec724d628f806f0cdc942ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:01:00.812070 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c396cc82-b4a5-477e-9480-9cfb017e49a0 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "GET /compute/v2.1/servers/5afab464-e9a7-48a6-b957-389eed37db12" status: 200 len: 1317 microversion: 2.1 time: 0.161148 Jun 10 19:01:00.812679 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4147/7769] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:01:00 2022] GET /compute/v2.1/servers/5afab464-e9a7-48a6-b957-389eed37db12 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:01:01.829497 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5ed4179c-1e07-4923-821d-040467df3766 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:01:01.830143 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5ed4179c-1e07-4923-821d-040467df3766 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: 5afab464-e9a7-48a6-b957-389eed37db12] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:01:01.832199 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:01:01.832971 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=8 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:01:01.838626 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ed4179c-1e07-4923-821d-040467df3766 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:01.839083 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ed4179c-1e07-4923-821d-040467df3766 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:01.839851 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ed4179c-1e07-4923-821d-040467df3766 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:01.840293 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ed4179c-1e07-4923-821d-040467df3766 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:01.974223 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5ed4179c-1e07-4923-821d-040467df3766 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9379afee249f4cd0b97d9eba592b588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47319e67ec724d628f806f0cdc942ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:01:01.981756 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5ed4179c-1e07-4923-821d-040467df3766 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "GET /compute/v2.1/servers/5afab464-e9a7-48a6-b957-389eed37db12" status: 200 len: 1317 microversion: 2.1 time: 0.156162 Jun 10 19:01:01.982345 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4148/7770] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:01:01 2022] GET /compute/v2.1/servers/5afab464-e9a7-48a6-b957-389eed37db12 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:01:02.999149 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-44524cae-5200-4198-a0bd-ca9013a9abdb tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:01:02.999816 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-44524cae-5200-4198-a0bd-ca9013a9abdb tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: 5afab464-e9a7-48a6-b957-389eed37db12] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:01:03.007552 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44524cae-5200-4198-a0bd-ca9013a9abdb tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:03.008005 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44524cae-5200-4198-a0bd-ca9013a9abdb tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:03.008792 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44524cae-5200-4198-a0bd-ca9013a9abdb tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:03.009228 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-44524cae-5200-4198-a0bd-ca9013a9abdb tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:03.147804 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-44524cae-5200-4198-a0bd-ca9013a9abdb tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9379afee249f4cd0b97d9eba592b588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47319e67ec724d628f806f0cdc942ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:01:03.155750 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-44524cae-5200-4198-a0bd-ca9013a9abdb tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "GET /compute/v2.1/servers/5afab464-e9a7-48a6-b957-389eed37db12" status: 200 len: 1506 microversion: 2.1 time: 0.160597 Jun 10 19:01:03.156359 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4149/7771] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:01:02 2022] GET /compute/v2.1/servers/5afab464-e9a7-48a6-b957-389eed37db12 => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:01:03.172935 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-70f58756-16a6-47ab-bb4d-283cc903b33e tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:01:03.173431 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-70f58756-16a6-47ab-bb4d-283cc903b33e tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: 5afab464-e9a7-48a6-b957-389eed37db12] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:01:03.179611 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70f58756-16a6-47ab-bb4d-283cc903b33e tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:03.180059 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70f58756-16a6-47ab-bb4d-283cc903b33e tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:03.180847 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70f58756-16a6-47ab-bb4d-283cc903b33e tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:03.181287 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70f58756-16a6-47ab-bb4d-283cc903b33e tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:03.206419 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-70f58756-16a6-47ab-bb4d-283cc903b33e tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: 5afab464-e9a7-48a6-b957-389eed37db12] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 19:01:03.408178 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-70f58756-16a6-47ab-bb4d-283cc903b33e tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "DELETE /compute/v2.1/servers/5afab464-e9a7-48a6-b957-389eed37db12" status: 204 len: 0 microversion: 2.1 time: 0.238546 Jun 10 19:01:03.408902 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4150/7772] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 19:01:03 2022] DELETE /compute/v2.1/servers/5afab464-e9a7-48a6-b957-389eed37db12 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 19:01:03.418559 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d6e1c53a-937d-484e-9de5-ae5a8e5b5578 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:01:03.419294 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d6e1c53a-937d-484e-9de5-ae5a8e5b5578 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: 5afab464-e9a7-48a6-b957-389eed37db12] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:01:03.427609 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d6e1c53a-937d-484e-9de5-ae5a8e5b5578 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:03.428578 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d6e1c53a-937d-484e-9de5-ae5a8e5b5578 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:03.429943 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d6e1c53a-937d-484e-9de5-ae5a8e5b5578 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:03.430755 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d6e1c53a-937d-484e-9de5-ae5a8e5b5578 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:03.574367 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d6e1c53a-937d-484e-9de5-ae5a8e5b5578 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9379afee249f4cd0b97d9eba592b588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47319e67ec724d628f806f0cdc942ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:01:03.582222 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d6e1c53a-937d-484e-9de5-ae5a8e5b5578 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "GET /compute/v2.1/servers/5afab464-e9a7-48a6-b957-389eed37db12" status: 200 len: 1512 microversion: 2.1 time: 0.168653 Jun 10 19:01:03.582807 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4151/7773] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:01:03 2022] GET /compute/v2.1/servers/5afab464-e9a7-48a6-b957-389eed37db12 => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:01:04.599550 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-92b6a7b9-e280-4bc0-b70a-08349d321f74 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:01:04.600289 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-92b6a7b9-e280-4bc0-b70a-08349d321f74 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: 5afab464-e9a7-48a6-b957-389eed37db12] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:01:04.607091 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-92b6a7b9-e280-4bc0-b70a-08349d321f74 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:04.607525 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-92b6a7b9-e280-4bc0-b70a-08349d321f74 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:04.608284 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-92b6a7b9-e280-4bc0-b70a-08349d321f74 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:04.608780 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-92b6a7b9-e280-4bc0-b70a-08349d321f74 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:04.627411 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:01:04.738688 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-92b6a7b9-e280-4bc0-b70a-08349d321f74 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9379afee249f4cd0b97d9eba592b588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47319e67ec724d628f806f0cdc942ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:01:04.746128 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-92b6a7b9-e280-4bc0-b70a-08349d321f74 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "GET /compute/v2.1/servers/5afab464-e9a7-48a6-b957-389eed37db12" status: 200 len: 1512 microversion: 2.1 time: 0.151098 Jun 10 19:01:04.746697 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4152/7774] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:01:04 2022] GET /compute/v2.1/servers/5afab464-e9a7-48a6-b957-389eed37db12 => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:01:05.460933 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-5981e817-e0f0-459c-844a-220908a6fd8b req-e04b0194-a2ef-448a-9090-76aa89cc3efa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5afab464-e9a7-48a6-b957-389eed37db12", "name": "network-vif-deleted", "tag": "4b5d90f6-6782-4ba6-a8ad-4e4da963d1bd"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:01:05.469404 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-5981e817-e0f0-459c-844a-220908a6fd8b req-e04b0194-a2ef-448a-9090-76aa89cc3efa service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:05.469860 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-5981e817-e0f0-459c-844a-220908a6fd8b req-e04b0194-a2ef-448a-9090-76aa89cc3efa service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:05.481697 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-5981e817-e0f0-459c-844a-220908a6fd8b req-e04b0194-a2ef-448a-9090-76aa89cc3efa service nova] Creating event network-vif-deleted:4b5d90f6-6782-4ba6-a8ad-4e4da963d1bd for instance 5afab464-e9a7-48a6-b957-389eed37db12 on chh2-master-2 Jun 10 19:01:05.486768 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-5981e817-e0f0-459c-844a-220908a6fd8b req-e04b0194-a2ef-448a-9090-76aa89cc3efa service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030488 Jun 10 19:01:05.487885 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4153/7775] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:01:05.765016 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e761ebff-38b0-45ad-95bd-5a0e492220cd tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:01:05.765882 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e761ebff-38b0-45ad-95bd-5a0e492220cd tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: 5afab464-e9a7-48a6-b957-389eed37db12] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:01:05.767907 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:01:05.773001 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e761ebff-38b0-45ad-95bd-5a0e492220cd tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:05.773442 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e761ebff-38b0-45ad-95bd-5a0e492220cd tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:05.774203 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e761ebff-38b0-45ad-95bd-5a0e492220cd tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:05.774638 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e761ebff-38b0-45ad-95bd-5a0e492220cd tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:05.806181 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e761ebff-38b0-45ad-95bd-5a0e492220cd tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:05.806651 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e761ebff-38b0-45ad-95bd-5a0e492220cd tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:05.807116 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-e761ebff-38b0-45ad-95bd-5a0e492220cd tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lazy-loading 'fault' on Instance uuid 5afab464-e9a7-48a6-b957-389eed37db12 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 19:01:05.853188 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e761ebff-38b0-45ad-95bd-5a0e492220cd tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9379afee249f4cd0b97d9eba592b588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47319e67ec724d628f806f0cdc942ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:01:05.861251 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e761ebff-38b0-45ad-95bd-5a0e492220cd tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "GET /compute/v2.1/servers/5afab464-e9a7-48a6-b957-389eed37db12" status: 200 len: 1307 microversion: 2.1 time: 0.101768 Jun 10 19:01:05.866080 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4154/7776] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:01:05 2022] GET /compute/v2.1/servers/5afab464-e9a7-48a6-b957-389eed37db12 => generated 1307 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:01:06.879570 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ce8b75e3-9566-491a-9f19-ca3dea838805 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:01:06.880270 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ce8b75e3-9566-491a-9f19-ca3dea838805 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: 5afab464-e9a7-48a6-b957-389eed37db12] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:01:06.887659 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ce8b75e3-9566-491a-9f19-ca3dea838805 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:06.888119 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ce8b75e3-9566-491a-9f19-ca3dea838805 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:06.888945 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ce8b75e3-9566-491a-9f19-ca3dea838805 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:06.889393 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ce8b75e3-9566-491a-9f19-ca3dea838805 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:06.905318 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-ce8b75e3-9566-491a-9f19-ca3dea838805 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] HTTP exception thrown: Instance 5afab464-e9a7-48a6-b957-389eed37db12 could not be found. Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ce8b75e3-9566-491a-9f19-ca3dea838805 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Request method failure captured: Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/5afab464-e9a7-48a6-b957-389eed37db12 HTTP/1.1 Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5TXK39FDs_tyCZOX0a_5F5zSYVSTVzO_IkY2ZBvWrfk7P_QHYiwOXBbrpR15atXYXKag3jklo5woZUyjyEMQeDrnpdLcag7bC1FfUU6Fa1eQjDVUidRRWW3kiWRwbHCe5GXH3vcdpgJ-FYWluBe5dzE3a0PgY4Gng4vCqc4UVkV0A8 Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 47319e67ec724d628f806f0cdc942ef5 Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersNegativeTestJSON-501491422 Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/47319e67ec724d628f806f0cdc942ef5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/47319e67ec724d628f806f0cdc942ef5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/47319e67ec724d628f806f0cdc942ef5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_47319e67ec724d628f806f0cdc942ef5", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersNegativeTestJSON-501491422 Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 47319e67ec724d628f806f0cdc942ef5 Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-501491422 Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersNegativeTestJSON-501491422-project Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 9379afee249f4cd0b97d9eba592b588b Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersNegativeTestJSON-501491422-project Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 5afab464-e9a7-48a6-b957-389eed37db12 could not be found. Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '5afab464-e9a7-48a6-b957-389eed37db12'} Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5afab464-e9a7-48a6-b957-389eed37db12 could not be found. Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5afab464-e9a7-48a6-b957-389eed37db12 could not be found. Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:01:06.906941 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:01:06.912764 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:01:06.912764 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:01:06.912764 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:01:06.912764 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 19:01:06.912764 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 19:01:06.912764 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5afab464-e9a7-48a6-b957-389eed37db12 could not be found. Jun 10 19:01:06.912764 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:01:06.912764 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ce8b75e3-9566-491a-9f19-ca3dea838805 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Returning 404 to user: Instance 5afab464-e9a7-48a6-b957-389eed37db12 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 19:01:06.912764 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ce8b75e3-9566-491a-9f19-ca3dea838805 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "GET /compute/v2.1/servers/5afab464-e9a7-48a6-b957-389eed37db12" status: 404 len: 111 microversion: 2.1 time: 0.033552 Jun 10 19:01:06.912764 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4155/7777] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:01:06 2022] GET /compute/v2.1/servers/5afab464-e9a7-48a6-b957-389eed37db12 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 19:01:06.916972 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d33899c3-3073-4152-9e91-fc0c1cf1ace0 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:01:06.917573 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d33899c3-3073-4152-9e91-fc0c1cf1ace0 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: e05479a1-153d-4987-81f3-524fadbaddd3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:01:06.923337 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d33899c3-3073-4152-9e91-fc0c1cf1ace0 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:06.923784 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d33899c3-3073-4152-9e91-fc0c1cf1ace0 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:06.924559 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d33899c3-3073-4152-9e91-fc0c1cf1ace0 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:06.924995 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d33899c3-3073-4152-9e91-fc0c1cf1ace0 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:07.053993 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d33899c3-3073-4152-9e91-fc0c1cf1ace0 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9379afee249f4cd0b97d9eba592b588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47319e67ec724d628f806f0cdc942ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:01:07.061711 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d33899c3-3073-4152-9e91-fc0c1cf1ace0 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "GET /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3" status: 200 len: 1504 microversion: 2.1 time: 0.148261 Jun 10 19:01:07.062334 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4156/7778] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:01:06 2022] GET /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3 => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:01:07.078129 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d92f40cd-72db-44a4-92ec-952ebee5d8dd tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:01:07.079090 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d92f40cd-72db-44a4-92ec-952ebee5d8dd tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: de7d39f0-98d4-43dc-9433-6eb13b0a9c65] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:01:07.084360 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-d92f40cd-72db-44a4-92ec-952ebee5d8dd tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] HTTP exception thrown: Instance de7d39f0-98d4-43dc-9433-6eb13b0a9c65 could not be found. Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d92f40cd-72db-44a4-92ec-952ebee5d8dd tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Request method failure captured: Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers/de7d39f0-98d4-43dc-9433-6eb13b0a9c65/action HTTP/1.1 Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 32 Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5TXK39FDs_tyCZOX0a_5F5zSYVSTVzO_IkY2ZBvWrfk7P_QHYiwOXBbrpR15atXYXKag3jklo5woZUyjyEMQeDrnpdLcag7bC1FfUU6Fa1eQjDVUidRRWW3kiWRwbHCe5GXH3vcdpgJ-FYWluBe5dzE3a0PgY4Gng4vCqc4UVkV0A8 Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 47319e67ec724d628f806f0cdc942ef5 Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersNegativeTestJSON-501491422 Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/47319e67ec724d628f806f0cdc942ef5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/47319e67ec724d628f806f0cdc942ef5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/47319e67ec724d628f806f0cdc942ef5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_47319e67ec724d628f806f0cdc942ef5", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersNegativeTestJSON-501491422 Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 47319e67ec724d628f806f0cdc942ef5 Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-501491422 Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersNegativeTestJSON-501491422-project Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 9379afee249f4cd0b97d9eba592b588b Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersNegativeTestJSON-501491422-project Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: {"resize": {"flavorRef": "452"}} Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: exception: Instance de7d39f0-98d4-43dc-9433-6eb13b0a9c65 could not be found. Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'de7d39f0-98d4-43dc-9433-6eb13b0a9c65', 'body': {'resize': {'flavorRef': '452'}}} Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de7d39f0-98d4-43dc-9433-6eb13b0a9c65 could not be found. Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 19:01:07.085896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 19:01:07.091134 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de7d39f0-98d4-43dc-9433-6eb13b0a9c65 could not be found. Jun 10 19:01:07.091134 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:01:07.091134 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:01:07.091134 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:01:07.091134 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:01:07.091134 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:01:07.091134 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:01:07.091134 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 19:01:07.091134 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 19:01:07.091134 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de7d39f0-98d4-43dc-9433-6eb13b0a9c65 could not be found. Jun 10 19:01:07.091134 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:01:07.091134 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d92f40cd-72db-44a4-92ec-952ebee5d8dd tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Returning 404 to user: Instance de7d39f0-98d4-43dc-9433-6eb13b0a9c65 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 19:01:07.091134 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d92f40cd-72db-44a4-92ec-952ebee5d8dd tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "POST /compute/v2.1/servers/de7d39f0-98d4-43dc-9433-6eb13b0a9c65/action" status: 404 len: 111 microversion: 2.1 time: 0.012818 Jun 10 19:01:07.091134 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4157/7779] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 19:01:07 2022] POST /compute/v2.1/servers/de7d39f0-98d4-43dc-9433-6eb13b0a9c65/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 19:01:07.096681 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a1cd0b19-dde5-424b-b534-95c853ec9eea tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:01:07.097284 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a1cd0b19-dde5-424b-b534-95c853ec9eea tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: e05479a1-153d-4987-81f3-524fadbaddd3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:01:07.105005 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a1cd0b19-dde5-424b-b534-95c853ec9eea tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:07.105462 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a1cd0b19-dde5-424b-b534-95c853ec9eea tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:07.106257 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a1cd0b19-dde5-424b-b534-95c853ec9eea tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:07.106699 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a1cd0b19-dde5-424b-b534-95c853ec9eea tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:07.235882 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a1cd0b19-dde5-424b-b534-95c853ec9eea tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9379afee249f4cd0b97d9eba592b588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47319e67ec724d628f806f0cdc942ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:01:07.244018 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a1cd0b19-dde5-424b-b534-95c853ec9eea tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "GET /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3" status: 200 len: 1504 microversion: 2.1 time: 0.150778 Jun 10 19:01:07.244626 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4158/7780] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:01:07 2022] GET /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:01:07.260743 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4e6a0a85-fe2c-418c-ac1a-95968ba40c7b tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:01:07.261345 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4e6a0a85-fe2c-418c-ac1a-95968ba40c7b tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: e05479a1-153d-4987-81f3-524fadbaddd3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:01:07.267579 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e6a0a85-fe2c-418c-ac1a-95968ba40c7b tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:07.268034 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e6a0a85-fe2c-418c-ac1a-95968ba40c7b tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:07.268822 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e6a0a85-fe2c-418c-ac1a-95968ba40c7b tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:07.269265 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e6a0a85-fe2c-418c-ac1a-95968ba40c7b tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:07.401999 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4e6a0a85-fe2c-418c-ac1a-95968ba40c7b tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9379afee249f4cd0b97d9eba592b588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47319e67ec724d628f806f0cdc942ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:01:07.409508 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4e6a0a85-fe2c-418c-ac1a-95968ba40c7b tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "GET /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3" status: 200 len: 1504 microversion: 2.1 time: 0.152380 Jun 10 19:01:07.410077 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4159/7781] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:01:07 2022] GET /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:01:07.426874 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e335c933-765b-47f7-be38-ec8cabebcae3 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2dbe5b28-ddf2-4fc4-b483-7301bab61683"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:01:07.427837 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e335c933-765b-47f7-be38-ec8cabebcae3 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: e05479a1-153d-4987-81f3-524fadbaddd3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:01:07.433872 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e335c933-765b-47f7-be38-ec8cabebcae3 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:07.434264 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e335c933-765b-47f7-be38-ec8cabebcae3 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:07.435020 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e335c933-765b-47f7-be38-ec8cabebcae3 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:07.435492 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e335c933-765b-47f7-be38-ec8cabebcae3 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:07.463884 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e335c933-765b-47f7-be38-ec8cabebcae3 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9379afee249f4cd0b97d9eba592b588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47319e67ec724d628f806f0cdc942ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:01:07.468997 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-e335c933-765b-47f7-be38-ec8cabebcae3 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] HTTP exception thrown: Flavor 2dbe5b28-ddf2-4fc4-b483-7301bab61683 could not be found. Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e335c933-765b-47f7-be38-ec8cabebcae3 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Request method failure captured: Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3/action HTTP/1.1 Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 65 Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5TXK39FDs_tyCZOX0a_5F5zSYVSTVzO_IkY2ZBvWrfk7P_QHYiwOXBbrpR15atXYXKag3jklo5woZUyjyEMQeDrnpdLcag7bC1FfUU6Fa1eQjDVUidRRWW3kiWRwbHCe5GXH3vcdpgJ-FYWluBe5dzE3a0PgY4Gng4vCqc4UVkV0A8 Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 47319e67ec724d628f806f0cdc942ef5 Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersNegativeTestJSON-501491422 Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/47319e67ec724d628f806f0cdc942ef5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/47319e67ec724d628f806f0cdc942ef5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/47319e67ec724d628f806f0cdc942ef5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_47319e67ec724d628f806f0cdc942ef5", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersNegativeTestJSON-501491422 Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 47319e67ec724d628f806f0cdc942ef5 Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-501491422 Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersNegativeTestJSON-501491422-project Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 9379afee249f4cd0b97d9eba592b588b Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersNegativeTestJSON-501491422-project Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: {"resize": {"flavorRef": "2dbe5b28-ddf2-4fc4-b483-7301bab61683"}} Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: exception: Flavor 2dbe5b28-ddf2-4fc4-b483-7301bab61683 could not be found. Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'e05479a1-153d-4987-81f3-524fadbaddd3', 'body': {'resize': {'flavorRef': '2dbe5b28-ddf2-4fc4-b483-7301bab61683'}}} Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4146, in resize Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 10 19:01:07.477217 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 19:01:07.482884 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 10 19:01:07.482884 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 10 19:01:07.482884 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 2dbe5b28-ddf2-4fc4-b483-7301bab61683 could not be found. Jun 10 19:01:07.482884 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:01:07.482884 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:01:07.482884 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:01:07.482884 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:01:07.482884 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:01:07.482884 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:01:07.482884 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 19:01:07.482884 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 19:01:07.482884 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 19:01:07.482884 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 19:01:07.482884 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 10 19:01:07.482884 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 10 19:01:07.482884 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jun 10 19:01:07.482884 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jun 10 19:01:07.482884 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Jun 10 19:01:07.482884 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 10 19:01:07.482884 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 2dbe5b28-ddf2-4fc4-b483-7301bab61683 could not be found. Jun 10 19:01:07.482884 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:01:07.482884 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:01:07.482884 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:01:07.482884 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:01:07.482884 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:01:07.482884 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:01:07.482884 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 19:01:07.482884 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 19:01:07.482884 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2dbe5b28-ddf2-4fc4-b483-7301bab61683 could not be found. Jun 10 19:01:07.482884 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:01:07.482884 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e335c933-765b-47f7-be38-ec8cabebcae3 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Returning 400 to user: Flavor 2dbe5b28-ddf2-4fc4-b483-7301bab61683 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 19:01:07.482884 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e335c933-765b-47f7-be38-ec8cabebcae3 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "POST /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3/action" status: 400 len: 107 microversion: 2.1 time: 0.056262 Jun 10 19:01:07.482884 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4160/7782] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 19:01:07 2022] POST /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3/action => generated 107 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 10 19:01:07.486668 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e896509e-839e-4321-b6d8-60c2f1ba6a3a tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:01:07.487547 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e896509e-839e-4321-b6d8-60c2f1ba6a3a tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: e05479a1-153d-4987-81f3-524fadbaddd3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:01:07.493709 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e896509e-839e-4321-b6d8-60c2f1ba6a3a tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:07.494157 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e896509e-839e-4321-b6d8-60c2f1ba6a3a tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:07.494909 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e896509e-839e-4321-b6d8-60c2f1ba6a3a tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:07.495345 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e896509e-839e-4321-b6d8-60c2f1ba6a3a tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:07.623465 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e896509e-839e-4321-b6d8-60c2f1ba6a3a tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9379afee249f4cd0b97d9eba592b588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47319e67ec724d628f806f0cdc942ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:01:07.631290 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e896509e-839e-4321-b6d8-60c2f1ba6a3a tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "GET /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3" status: 200 len: 1504 microversion: 2.1 time: 0.148014 Jun 10 19:01:07.631858 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4161/7783] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:01:07 2022] GET /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3 => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:01:07.647943 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a2054602-eafe-4e00-bfc9-eded0afadb6a tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:01:07.648578 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a2054602-eafe-4e00-bfc9-eded0afadb6a tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: e05479a1-153d-4987-81f3-524fadbaddd3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:01:07.654283 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a2054602-eafe-4e00-bfc9-eded0afadb6a tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:07.654743 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a2054602-eafe-4e00-bfc9-eded0afadb6a tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:07.655511 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a2054602-eafe-4e00-bfc9-eded0afadb6a tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:07.655954 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a2054602-eafe-4e00-bfc9-eded0afadb6a tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:07.788993 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a2054602-eafe-4e00-bfc9-eded0afadb6a tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9379afee249f4cd0b97d9eba592b588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47319e67ec724d628f806f0cdc942ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:01:07.797140 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a2054602-eafe-4e00-bfc9-eded0afadb6a tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "GET /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3" status: 200 len: 1504 microversion: 2.1 time: 0.153183 Jun 10 19:01:07.797723 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4162/7784] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:01:07 2022] GET /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:01:07.813607 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1ba7ff4e-14c2-4e59-8ae5-315105386680 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1ba7ff4e-14c2-4e59-8ae5-315105386680 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Request method failure captured: Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: request: POST /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3/action HTTP/1.1 Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 29 Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5TXK39FDs_tyCZOX0a_5F5zSYVSTVzO_IkY2ZBvWrfk7P_QHYiwOXBbrpR15atXYXKag3jklo5woZUyjyEMQeDrnpdLcag7bC1FfUU6Fa1eQjDVUidRRWW3kiWRwbHCe5GXH3vcdpgJ-FYWluBe5dzE3a0PgY4Gng4vCqc4UVkV0A8 Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 47319e67ec724d628f806f0cdc942ef5 Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersNegativeTestJSON-501491422 Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/47319e67ec724d628f806f0cdc942ef5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/47319e67ec724d628f806f0cdc942ef5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/47319e67ec724d628f806f0cdc942ef5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_47319e67ec724d628f806f0cdc942ef5", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersNegativeTestJSON-501491422 Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 47319e67ec724d628f806f0cdc942ef5 Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-501491422 Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersNegativeTestJSON-501491422-project Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 9379afee249f4cd0b97d9eba592b588b Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersNegativeTestJSON-501491422-project Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: {"resize": {"flavorRef": ""}} Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'e05479a1-153d-4987-81f3-524fadbaddd3', 'body': {'resize': {'flavorRef': ''}}} Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise error Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi On instance['resize']: Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi '' Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:01:07.815842 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:01:07.821949 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:01:07.821949 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:01:07.821949 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:01:07.821949 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 10 19:01:07.821949 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 10 19:01:07.821949 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Jun 10 19:01:07.821949 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:01:07.821949 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1ba7ff4e-14c2-4e59-8ae5-315105386680 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 19:01:07.821949 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1ba7ff4e-14c2-4e59-8ae5-315105386680 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "POST /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3/action" status: 400 len: 113 microversion: 2.1 time: 0.007340 Jun 10 19:01:07.821949 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4163/7785] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 19:01:07 2022] POST /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3/action => generated 113 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 10 19:01:07.824398 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6ca29421-6945-47f0-b1fa-9bb042442828 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:01:07.825005 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6ca29421-6945-47f0-b1fa-9bb042442828 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: e05479a1-153d-4987-81f3-524fadbaddd3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:01:07.832040 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6ca29421-6945-47f0-b1fa-9bb042442828 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:07.832540 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6ca29421-6945-47f0-b1fa-9bb042442828 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:07.833310 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6ca29421-6945-47f0-b1fa-9bb042442828 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:07.833753 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6ca29421-6945-47f0-b1fa-9bb042442828 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:07.960318 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6ca29421-6945-47f0-b1fa-9bb042442828 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9379afee249f4cd0b97d9eba592b588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47319e67ec724d628f806f0cdc942ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:01:07.967767 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6ca29421-6945-47f0-b1fa-9bb042442828 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "GET /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3" status: 200 len: 1504 microversion: 2.1 time: 0.146552 Jun 10 19:01:07.968350 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4164/7786] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:01:07 2022] GET /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3 => generated 1504 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:01:07.992721 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9c6e93ba-d9b7-43a7-8d01-157424740417 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:01:07.992721 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9c6e93ba-d9b7-43a7-8d01-157424740417 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: 5afab464-e9a7-48a6-b957-389eed37db12] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:01:07.994325 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9c6e93ba-d9b7-43a7-8d01-157424740417 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:07.994774 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9c6e93ba-d9b7-43a7-8d01-157424740417 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:07.995532 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9c6e93ba-d9b7-43a7-8d01-157424740417 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:07.995969 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9c6e93ba-d9b7-43a7-8d01-157424740417 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:08.011000 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-9c6e93ba-d9b7-43a7-8d01-157424740417 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] HTTP exception thrown: Instance 5afab464-e9a7-48a6-b957-389eed37db12 could not be found. Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9c6e93ba-d9b7-43a7-8d01-157424740417 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Request method failure captured: Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/5afab464-e9a7-48a6-b957-389eed37db12 HTTP/1.1 Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5TXK39FDs_tyCZOX0a_5F5zSYVSTVzO_IkY2ZBvWrfk7P_QHYiwOXBbrpR15atXYXKag3jklo5woZUyjyEMQeDrnpdLcag7bC1FfUU6Fa1eQjDVUidRRWW3kiWRwbHCe5GXH3vcdpgJ-FYWluBe5dzE3a0PgY4Gng4vCqc4UVkV0A8 Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 47319e67ec724d628f806f0cdc942ef5 Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersNegativeTestJSON-501491422 Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/47319e67ec724d628f806f0cdc942ef5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/47319e67ec724d628f806f0cdc942ef5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/47319e67ec724d628f806f0cdc942ef5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_47319e67ec724d628f806f0cdc942ef5", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersNegativeTestJSON-501491422 Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 47319e67ec724d628f806f0cdc942ef5 Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-501491422 Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersNegativeTestJSON-501491422-project Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 9379afee249f4cd0b97d9eba592b588b Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersNegativeTestJSON-501491422-project Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 5afab464-e9a7-48a6-b957-389eed37db12 could not be found. Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '5afab464-e9a7-48a6-b957-389eed37db12'} Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5afab464-e9a7-48a6-b957-389eed37db12 could not be found. Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 19:01:08.012577 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 19:01:08.017437 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5afab464-e9a7-48a6-b957-389eed37db12 could not be found. Jun 10 19:01:08.017437 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:01:08.017437 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:01:08.017437 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:01:08.017437 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:01:08.017437 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:01:08.017437 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:01:08.017437 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 19:01:08.017437 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 19:01:08.017437 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5afab464-e9a7-48a6-b957-389eed37db12 could not be found. Jun 10 19:01:08.017437 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:01:08.017437 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9c6e93ba-d9b7-43a7-8d01-157424740417 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Returning 404 to user: Instance 5afab464-e9a7-48a6-b957-389eed37db12 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 19:01:08.017437 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9c6e93ba-d9b7-43a7-8d01-157424740417 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "DELETE /compute/v2.1/servers/5afab464-e9a7-48a6-b957-389eed37db12" status: 404 len: 111 microversion: 2.1 time: 0.030237 Jun 10 19:01:08.017437 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4165/7787] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 19:01:07 2022] DELETE /compute/v2.1/servers/5afab464-e9a7-48a6-b957-389eed37db12 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 19:01:08.022030 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-60af82e2-bb1a-46af-935f-558ca6b472f5 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:01:08.027413 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-60af82e2-bb1a-46af-935f-558ca6b472f5 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: 5afab464-e9a7-48a6-b957-389eed37db12] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:01:08.028320 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-60af82e2-bb1a-46af-935f-558ca6b472f5 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:08.028783 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-60af82e2-bb1a-46af-935f-558ca6b472f5 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:08.029566 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-60af82e2-bb1a-46af-935f-558ca6b472f5 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:08.030001 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-60af82e2-bb1a-46af-935f-558ca6b472f5 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:08.043559 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-60af82e2-bb1a-46af-935f-558ca6b472f5 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] HTTP exception thrown: Instance 5afab464-e9a7-48a6-b957-389eed37db12 could not be found. Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-60af82e2-bb1a-46af-935f-558ca6b472f5 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Request method failure captured: Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/5afab464-e9a7-48a6-b957-389eed37db12 HTTP/1.1 Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5TXK39FDs_tyCZOX0a_5F5zSYVSTVzO_IkY2ZBvWrfk7P_QHYiwOXBbrpR15atXYXKag3jklo5woZUyjyEMQeDrnpdLcag7bC1FfUU6Fa1eQjDVUidRRWW3kiWRwbHCe5GXH3vcdpgJ-FYWluBe5dzE3a0PgY4Gng4vCqc4UVkV0A8 Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 47319e67ec724d628f806f0cdc942ef5 Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersNegativeTestJSON-501491422 Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/47319e67ec724d628f806f0cdc942ef5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/47319e67ec724d628f806f0cdc942ef5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/47319e67ec724d628f806f0cdc942ef5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_47319e67ec724d628f806f0cdc942ef5", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersNegativeTestJSON-501491422 Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 47319e67ec724d628f806f0cdc942ef5 Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-501491422 Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersNegativeTestJSON-501491422-project Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 9379afee249f4cd0b97d9eba592b588b Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersNegativeTestJSON-501491422-project Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 5afab464-e9a7-48a6-b957-389eed37db12 could not be found. Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '5afab464-e9a7-48a6-b957-389eed37db12'} Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5afab464-e9a7-48a6-b957-389eed37db12 could not be found. Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5afab464-e9a7-48a6-b957-389eed37db12 could not be found. Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:01:08.045085 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:01:08.051495 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:01:08.051495 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:01:08.051495 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:01:08.051495 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 19:01:08.051495 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 19:01:08.051495 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5afab464-e9a7-48a6-b957-389eed37db12 could not be found. Jun 10 19:01:08.051495 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:01:08.051495 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-60af82e2-bb1a-46af-935f-558ca6b472f5 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Returning 404 to user: Instance 5afab464-e9a7-48a6-b957-389eed37db12 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 19:01:08.051495 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-60af82e2-bb1a-46af-935f-558ca6b472f5 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "GET /compute/v2.1/servers/5afab464-e9a7-48a6-b957-389eed37db12" status: 404 len: 111 microversion: 2.1 time: 0.027941 Jun 10 19:01:08.051495 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4166/7788] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:01:08 2022] GET /compute/v2.1/servers/5afab464-e9a7-48a6-b957-389eed37db12 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 19:01:08.054960 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9a8576cf-d6de-47d4-8b69-89bcf0c25186 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:01:08.055448 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9a8576cf-d6de-47d4-8b69-89bcf0c25186 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: e05479a1-153d-4987-81f3-524fadbaddd3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:01:08.063331 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9a8576cf-d6de-47d4-8b69-89bcf0c25186 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:08.064105 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9a8576cf-d6de-47d4-8b69-89bcf0c25186 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:08.065467 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9a8576cf-d6de-47d4-8b69-89bcf0c25186 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:08.066260 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9a8576cf-d6de-47d4-8b69-89bcf0c25186 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:08.095252 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9a8576cf-d6de-47d4-8b69-89bcf0c25186 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: e05479a1-153d-4987-81f3-524fadbaddd3] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 19:01:08.414149 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9a8576cf-d6de-47d4-8b69-89bcf0c25186 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "DELETE /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3" status: 204 len: 0 microversion: 2.1 time: 0.362911 Jun 10 19:01:08.415128 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4167/7789] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 19:01:08 2022] DELETE /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 19:01:08.423562 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1405c250-6339-4f29-9bb4-2f61fdb89c6c tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:01:08.424555 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1405c250-6339-4f29-9bb4-2f61fdb89c6c tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: e05479a1-153d-4987-81f3-524fadbaddd3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:01:08.430834 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1405c250-6339-4f29-9bb4-2f61fdb89c6c tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:08.431292 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1405c250-6339-4f29-9bb4-2f61fdb89c6c tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:08.432156 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1405c250-6339-4f29-9bb4-2f61fdb89c6c tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:08.432635 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1405c250-6339-4f29-9bb4-2f61fdb89c6c tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:08.561844 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1405c250-6339-4f29-9bb4-2f61fdb89c6c tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9379afee249f4cd0b97d9eba592b588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47319e67ec724d628f806f0cdc942ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:01:08.569898 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1405c250-6339-4f29-9bb4-2f61fdb89c6c tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "GET /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3" status: 200 len: 1510 microversion: 2.1 time: 0.150589 Jun 10 19:01:08.570478 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4168/7790] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:01:08 2022] GET /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:01:09.586623 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4e987e13-ef86-4cf9-a15d-fffbe0e715ec tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:01:09.587310 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4e987e13-ef86-4cf9-a15d-fffbe0e715ec tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: e05479a1-153d-4987-81f3-524fadbaddd3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:01:09.594266 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e987e13-ef86-4cf9-a15d-fffbe0e715ec tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:09.594719 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e987e13-ef86-4cf9-a15d-fffbe0e715ec tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:09.595483 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e987e13-ef86-4cf9-a15d-fffbe0e715ec tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:09.595930 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4e987e13-ef86-4cf9-a15d-fffbe0e715ec tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:09.738321 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4e987e13-ef86-4cf9-a15d-fffbe0e715ec tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9379afee249f4cd0b97d9eba592b588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47319e67ec724d628f806f0cdc942ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:01:09.738321 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4e987e13-ef86-4cf9-a15d-fffbe0e715ec tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "GET /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3" status: 200 len: 1510 microversion: 2.1 time: 0.153463 Jun 10 19:01:09.738321 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4169/7791] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:01:09 2022] GET /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:01:10.277824 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-3e63887f-cb42-46bd-858a-ff137757f854 req-ae3bb117-7961-4f41-ac6a-d9d5f16cb38a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e05479a1-153d-4987-81f3-524fadbaddd3", "name": "network-vif-deleted", "tag": "49fb4636-c523-492c-9503-d64a774757c3"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:01:10.285918 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-3e63887f-cb42-46bd-858a-ff137757f854 req-ae3bb117-7961-4f41-ac6a-d9d5f16cb38a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:10.286370 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-3e63887f-cb42-46bd-858a-ff137757f854 req-ae3bb117-7961-4f41-ac6a-d9d5f16cb38a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:10.297909 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-3e63887f-cb42-46bd-858a-ff137757f854 req-ae3bb117-7961-4f41-ac6a-d9d5f16cb38a service nova] Creating event network-vif-deleted:49fb4636-c523-492c-9503-d64a774757c3 for instance e05479a1-153d-4987-81f3-524fadbaddd3 on chh1-master-2 Jun 10 19:01:10.303171 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-3e63887f-cb42-46bd-858a-ff137757f854 req-ae3bb117-7961-4f41-ac6a-d9d5f16cb38a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028341 Jun 10 19:01:10.303800 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4170/7792] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:01:10.755247 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-28e6538d-0fcf-4c61-a04c-f3b571bb2298 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:01:10.755946 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-28e6538d-0fcf-4c61-a04c-f3b571bb2298 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: e05479a1-153d-4987-81f3-524fadbaddd3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:01:10.762317 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-28e6538d-0fcf-4c61-a04c-f3b571bb2298 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:10.762772 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-28e6538d-0fcf-4c61-a04c-f3b571bb2298 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:10.763537 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-28e6538d-0fcf-4c61-a04c-f3b571bb2298 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:10.763981 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-28e6538d-0fcf-4c61-a04c-f3b571bb2298 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:10.795424 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-28e6538d-0fcf-4c61-a04c-f3b571bb2298 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:10.795884 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-28e6538d-0fcf-4c61-a04c-f3b571bb2298 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:10.796359 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-28e6538d-0fcf-4c61-a04c-f3b571bb2298 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lazy-loading 'fault' on Instance uuid e05479a1-153d-4987-81f3-524fadbaddd3 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 19:01:10.842241 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-28e6538d-0fcf-4c61-a04c-f3b571bb2298 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9379afee249f4cd0b97d9eba592b588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47319e67ec724d628f806f0cdc942ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:01:10.849955 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-28e6538d-0fcf-4c61-a04c-f3b571bb2298 tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "GET /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3" status: 200 len: 1306 microversion: 2.1 time: 0.100093 Jun 10 19:01:10.850551 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4171/7793] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:01:10 2022] GET /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3 => generated 1306 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:01:11.867034 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-79aee029-514f-41c1-9848-d383a40ee8db tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:01:11.868319 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-79aee029-514f-41c1-9848-d383a40ee8db tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] [instance: e05479a1-153d-4987-81f3-524fadbaddd3] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:01:11.875658 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-79aee029-514f-41c1-9848-d383a40ee8db tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:11.876111 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-79aee029-514f-41c1-9848-d383a40ee8db tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:11.876917 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-79aee029-514f-41c1-9848-d383a40ee8db tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:11.877370 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-79aee029-514f-41c1-9848-d383a40ee8db tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:11.893349 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-79aee029-514f-41c1-9848-d383a40ee8db tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] HTTP exception thrown: Instance e05479a1-153d-4987-81f3-524fadbaddd3 could not be found. Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-79aee029-514f-41c1-9848-d383a40ee8db tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Request method failure captured: Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3 HTTP/1.1 Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5TXK39FDs_tyCZOX0a_5F5zSYVSTVzO_IkY2ZBvWrfk7P_QHYiwOXBbrpR15atXYXKag3jklo5woZUyjyEMQeDrnpdLcag7bC1FfUU6Fa1eQjDVUidRRWW3kiWRwbHCe5GXH3vcdpgJ-FYWluBe5dzE3a0PgY4Gng4vCqc4UVkV0A8 Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 47319e67ec724d628f806f0cdc942ef5 Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-ServersNegativeTestJSON-501491422 Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/47319e67ec724d628f806f0cdc942ef5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/47319e67ec724d628f806f0cdc942ef5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/47319e67ec724d628f806f0cdc942ef5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_47319e67ec724d628f806f0cdc942ef5", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-ServersNegativeTestJSON-501491422 Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 47319e67ec724d628f806f0cdc942ef5 Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-501491422 Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-ServersNegativeTestJSON-501491422-project Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 9379afee249f4cd0b97d9eba592b588b Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-ServersNegativeTestJSON-501491422-project Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: exception: Instance e05479a1-153d-4987-81f3-524fadbaddd3 could not be found. Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'e05479a1-153d-4987-81f3-524fadbaddd3'} Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e05479a1-153d-4987-81f3-524fadbaddd3 could not be found. Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e05479a1-153d-4987-81f3-524fadbaddd3 could not be found. Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:01:11.895481 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:01:11.900816 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:01:11.900816 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:01:11.900816 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:01:11.900816 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 19:01:11.900816 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 19:01:11.900816 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e05479a1-153d-4987-81f3-524fadbaddd3 could not be found. Jun 10 19:01:11.900816 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:01:11.900816 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-79aee029-514f-41c1-9848-d383a40ee8db tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] Returning 404 to user: Instance e05479a1-153d-4987-81f3-524fadbaddd3 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 19:01:11.900816 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-79aee029-514f-41c1-9848-d383a40ee8db tempest-ServersNegativeTestJSON-501491422 tempest-ServersNegativeTestJSON-501491422-project] 10.222.0.35 "GET /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3" status: 404 len: 111 microversion: 2.1 time: 0.033823 Jun 10 19:01:11.900816 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4172/7794] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:01:11 2022] GET /compute/v2.1/servers/e05479a1-153d-4987-81f3-524fadbaddd3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 19:01:53.572039 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:01:53.572859 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:01:53.738493 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-75e73a1b-99f8-4c1a-b81d-5d45c0bc6a06 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Action: 'create', calling method: .version_select at 0x7f77c11eda60>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1788187221", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEBPEqkL9fBNUSF7+yczsc6G6DV0BsW/Sol2VWX8/ELHGjw9uApl6zc4nu7FhQujZ8BOoUq5RwZSor0SjFnD5TahP/FnhqZUrpTjw/Inhgrlm//cRh5FxAVoMy9fvAIsAQ=="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:01:53.754479 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-75e73a1b-99f8-4c1a-b81d-5d45c0bc6a06 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Getting quotas for project 19eafdcc2e7c4f8a9b4cd13a584cf982. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 19:01:53.759676 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-75e73a1b-99f8-4c1a-b81d-5d45c0bc6a06 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Getting quotas for user 8360bcc5196e4d6f93b0676b7440621a and project 19eafdcc2e7c4f8a9b4cd13a584cf982. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 19:01:53.852876 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-75e73a1b-99f8-4c1a-b81d-5d45c0bc6a06 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.286631 Jun 10 19:01:53.853412 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4173/7795] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 19:01:53 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:01:53.903985 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7a6889a7-2ef4-4972-a929-02bfac28238a tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-977013468", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1788187221", "networks": [{"uuid": "54b25c4a-1783-4944-bd07-b2340d412381"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:01:53.958138 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-7a6889a7-2ef4-4972-a929-02bfac28238a tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] validate_networks() for [('54b25c4a-1783-4944-bd07-b2340d412381', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 19:01:54.339551 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-7a6889a7-2ef4-4972-a929-02bfac28238a tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 19:01:54.339974 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-7a6889a7-2ef4-4972-a929-02bfac28238a tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 19:01:54.340485 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-7a6889a7-2ef4-4972-a929-02bfac28238a tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 19:01:54.340926 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-7a6889a7-2ef4-4972-a929-02bfac28238a tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 19:01:54.341337 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-7a6889a7-2ef4-4972-a929-02bfac28238a tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 19:01:54.350764 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7a6889a7-2ef4-4972-a929-02bfac28238a tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:54.351211 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7a6889a7-2ef4-4972-a929-02bfac28238a tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:54.352006 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7a6889a7-2ef4-4972-a929-02bfac28238a tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:54.352481 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7a6889a7-2ef4-4972-a929-02bfac28238a tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:54.369568 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-7a6889a7-2ef4-4972-a929-02bfac28238a tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Getting quotas for project 19eafdcc2e7c4f8a9b4cd13a584cf982. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 19:01:54.375451 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-7a6889a7-2ef4-4972-a929-02bfac28238a tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Getting quotas for user 8360bcc5196e4d6f93b0676b7440621a and project 19eafdcc2e7c4f8a9b4cd13a584cf982. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 19:01:54.388252 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7a6889a7-2ef4-4972-a929-02bfac28238a tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 19:01:54.390589 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7a6889a7-2ef4-4972-a929-02bfac28238a tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: 6798d921-32c4-4217-9330-c214f2aecfc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 19:01:54.487280 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7a6889a7-2ef4-4972-a929-02bfac28238a tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.587078 Jun 10 19:01:54.488348 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4174/7796] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 19:01:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 10 19:01:54.497937 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-39ef2f19-f219-4383-b986-7e77a1acc0ce tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:01:54.498914 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-39ef2f19-f219-4383-b986-7e77a1acc0ce tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: 6798d921-32c4-4217-9330-c214f2aecfc9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:01:54.574080 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-39ef2f19-f219-4383-b986-7e77a1acc0ce tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8360bcc5196e4d6f93b0676b7440621a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19eafdcc2e7c4f8a9b4cd13a584cf982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:01:54.584192 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-39ef2f19-f219-4383-b986-7e77a1acc0ce tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "GET /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9" status: 200 len: 1262 microversion: 2.1 time: 0.090296 Jun 10 19:01:54.585025 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4175/7797] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:01:54 2022] GET /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9 => generated 1262 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:01:55.603198 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d93ce5e5-74f0-4769-ae1a-e61bd8c74000 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:01:55.603742 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d93ce5e5-74f0-4769-ae1a-e61bd8c74000 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: 6798d921-32c4-4217-9330-c214f2aecfc9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:01:55.609673 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d93ce5e5-74f0-4769-ae1a-e61bd8c74000 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:55.610135 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d93ce5e5-74f0-4769-ae1a-e61bd8c74000 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:55.610938 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d93ce5e5-74f0-4769-ae1a-e61bd8c74000 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:55.611385 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d93ce5e5-74f0-4769-ae1a-e61bd8c74000 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:55.680730 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d93ce5e5-74f0-4769-ae1a-e61bd8c74000 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8360bcc5196e4d6f93b0676b7440621a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19eafdcc2e7c4f8a9b4cd13a584cf982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:01:55.688759 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d93ce5e5-74f0-4769-ae1a-e61bd8c74000 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "GET /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9" status: 200 len: 1266 microversion: 2.1 time: 0.090942 Jun 10 19:01:55.689579 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4176/7798] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:01:55 2022] GET /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9 => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:01:56.706548 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bb40b3ef-416d-41e0-8d32-2a8c28d6af46 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:01:56.707801 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bb40b3ef-416d-41e0-8d32-2a8c28d6af46 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: 6798d921-32c4-4217-9330-c214f2aecfc9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:01:56.715003 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb40b3ef-416d-41e0-8d32-2a8c28d6af46 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:56.715466 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb40b3ef-416d-41e0-8d32-2a8c28d6af46 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:56.716553 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb40b3ef-416d-41e0-8d32-2a8c28d6af46 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:56.717007 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb40b3ef-416d-41e0-8d32-2a8c28d6af46 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:56.780822 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bb40b3ef-416d-41e0-8d32-2a8c28d6af46 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8360bcc5196e4d6f93b0676b7440621a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19eafdcc2e7c4f8a9b4cd13a584cf982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:01:56.788680 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bb40b3ef-416d-41e0-8d32-2a8c28d6af46 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "GET /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9" status: 200 len: 1322 microversion: 2.1 time: 0.086101 Jun 10 19:01:56.789270 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4177/7799] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:01:56 2022] GET /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9 => generated 1322 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:01:57.806648 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8fab8c1f-a6e1-495a-8654-151d8bb3e1ab tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:01:57.807338 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8fab8c1f-a6e1-495a-8654-151d8bb3e1ab tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: 6798d921-32c4-4217-9330-c214f2aecfc9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:01:57.814364 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8fab8c1f-a6e1-495a-8654-151d8bb3e1ab tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:57.820282 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8fab8c1f-a6e1-495a-8654-151d8bb3e1ab tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:57.820282 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8fab8c1f-a6e1-495a-8654-151d8bb3e1ab tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:57.820282 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8fab8c1f-a6e1-495a-8654-151d8bb3e1ab tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:57.947246 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8fab8c1f-a6e1-495a-8654-151d8bb3e1ab tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8360bcc5196e4d6f93b0676b7440621a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19eafdcc2e7c4f8a9b4cd13a584cf982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:01:57.955797 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8fab8c1f-a6e1-495a-8654-151d8bb3e1ab tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "GET /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9" status: 200 len: 1362 microversion: 2.1 time: 0.152961 Jun 10 19:01:57.956412 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4178/7800] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:01:57 2022] GET /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:01:58.495102 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-a9047ff6-9dc7-40cb-9bb9-ef198959e473 req-d0262118-5cb8-4ff2-9a63-aa67e91c974a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6798d921-32c4-4217-9330-c214f2aecfc9", "tag": "5279b8a0-5dbf-4253-a7f0-299a2ab9e220"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:01:58.505638 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-a9047ff6-9dc7-40cb-9bb9-ef198959e473 req-d0262118-5cb8-4ff2-9a63-aa67e91c974a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:58.506099 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-a9047ff6-9dc7-40cb-9bb9-ef198959e473 req-d0262118-5cb8-4ff2-9a63-aa67e91c974a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:58.522269 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-a9047ff6-9dc7-40cb-9bb9-ef198959e473 req-d0262118-5cb8-4ff2-9a63-aa67e91c974a service nova] Creating event network-changed:5279b8a0-5dbf-4253-a7f0-299a2ab9e220 for instance 6798d921-32c4-4217-9330-c214f2aecfc9 on chh1-master-2 Jun 10 19:01:58.528352 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-a9047ff6-9dc7-40cb-9bb9-ef198959e473 req-d0262118-5cb8-4ff2-9a63-aa67e91c974a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123991 Jun 10 19:01:58.528982 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4179/7801] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:01:58.975316 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5ed70d9d-eba9-4bfd-a2ca-5d98764420c8 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:01:58.976010 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5ed70d9d-eba9-4bfd-a2ca-5d98764420c8 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: 6798d921-32c4-4217-9330-c214f2aecfc9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:01:58.982594 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ed70d9d-eba9-4bfd-a2ca-5d98764420c8 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:58.983054 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ed70d9d-eba9-4bfd-a2ca-5d98764420c8 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:58.983827 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ed70d9d-eba9-4bfd-a2ca-5d98764420c8 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:01:58.984273 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5ed70d9d-eba9-4bfd-a2ca-5d98764420c8 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:01:59.119820 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5ed70d9d-eba9-4bfd-a2ca-5d98764420c8 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8360bcc5196e4d6f93b0676b7440621a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19eafdcc2e7c4f8a9b4cd13a584cf982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:01:59.127832 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5ed70d9d-eba9-4bfd-a2ca-5d98764420c8 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "GET /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9" status: 200 len: 1362 microversion: 2.1 time: 0.157721 Jun 10 19:01:59.128429 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4180/7802] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:01:58 2022] GET /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:02:00.144965 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-eea716bf-c1bb-4ed0-b03b-b8ce85590ae3 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:02:00.145625 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-eea716bf-c1bb-4ed0-b03b-b8ce85590ae3 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: 6798d921-32c4-4217-9330-c214f2aecfc9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:02:00.152677 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eea716bf-c1bb-4ed0-b03b-b8ce85590ae3 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:00.153076 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eea716bf-c1bb-4ed0-b03b-b8ce85590ae3 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:00.153884 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eea716bf-c1bb-4ed0-b03b-b8ce85590ae3 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:00.154334 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eea716bf-c1bb-4ed0-b03b-b8ce85590ae3 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:00.287347 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-eea716bf-c1bb-4ed0-b03b-b8ce85590ae3 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8360bcc5196e4d6f93b0676b7440621a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19eafdcc2e7c4f8a9b4cd13a584cf982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:02:00.294967 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-eea716bf-c1bb-4ed0-b03b-b8ce85590ae3 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "GET /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9" status: 200 len: 1362 microversion: 2.1 time: 0.154521 Jun 10 19:02:00.295557 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4181/7803] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:02:00 2022] GET /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:02:01.311310 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2b40f4f8-c326-434d-bc84-a2968b884897 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:02:01.312146 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2b40f4f8-c326-434d-bc84-a2968b884897 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: 6798d921-32c4-4217-9330-c214f2aecfc9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:02:01.319273 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2b40f4f8-c326-434d-bc84-a2968b884897 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:01.319821 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2b40f4f8-c326-434d-bc84-a2968b884897 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:01.320695 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2b40f4f8-c326-434d-bc84-a2968b884897 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:01.321209 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2b40f4f8-c326-434d-bc84-a2968b884897 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:01.462324 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2b40f4f8-c326-434d-bc84-a2968b884897 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8360bcc5196e4d6f93b0676b7440621a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19eafdcc2e7c4f8a9b4cd13a584cf982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:02:01.469819 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2b40f4f8-c326-434d-bc84-a2968b884897 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "GET /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9" status: 200 len: 1362 microversion: 2.1 time: 0.162565 Jun 10 19:02:01.470383 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4182/7804] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:02:01 2022] GET /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:02:02.487096 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c57b6b49-a4d4-492f-a69c-e9029684d223 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:02:02.487806 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c57b6b49-a4d4-492f-a69c-e9029684d223 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: 6798d921-32c4-4217-9330-c214f2aecfc9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:02:02.495276 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c57b6b49-a4d4-492f-a69c-e9029684d223 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:02.495728 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c57b6b49-a4d4-492f-a69c-e9029684d223 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:02.496523 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c57b6b49-a4d4-492f-a69c-e9029684d223 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:02.496959 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c57b6b49-a4d4-492f-a69c-e9029684d223 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:02.625140 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c57b6b49-a4d4-492f-a69c-e9029684d223 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8360bcc5196e4d6f93b0676b7440621a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19eafdcc2e7c4f8a9b4cd13a584cf982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:02:02.632894 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c57b6b49-a4d4-492f-a69c-e9029684d223 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "GET /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9" status: 200 len: 1362 microversion: 2.1 time: 0.149807 Jun 10 19:02:02.633472 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4183/7805] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:02:02 2022] GET /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:02:03.397924 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-3dd14105-67b7-4d79-8d74-639c27dbc2de req-a9cb7d80-bf03-4339-9847-c14425ecda27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6798d921-32c4-4217-9330-c214f2aecfc9", "name": "network-vif-plugged", "status": "completed", "tag": "5279b8a0-5dbf-4253-a7f0-299a2ab9e220"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:02:03.403567 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-3dd14105-67b7-4d79-8d74-639c27dbc2de req-a9cb7d80-bf03-4339-9847-c14425ecda27 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:03.404097 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-3dd14105-67b7-4d79-8d74-639c27dbc2de req-a9cb7d80-bf03-4339-9847-c14425ecda27 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:03.422572 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-3dd14105-67b7-4d79-8d74-639c27dbc2de req-a9cb7d80-bf03-4339-9847-c14425ecda27 service nova] Creating event network-vif-plugged:5279b8a0-5dbf-4253-a7f0-299a2ab9e220 for instance 6798d921-32c4-4217-9330-c214f2aecfc9 on chh1-master-2 Jun 10 19:02:03.428730 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-3dd14105-67b7-4d79-8d74-639c27dbc2de req-a9cb7d80-bf03-4339-9847-c14425ecda27 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093971 Jun 10 19:02:03.435184 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4184/7806] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:02:03.650694 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2ec72185-ad73-48ff-a98a-d930e924bd17 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:02:03.651335 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2ec72185-ad73-48ff-a98a-d930e924bd17 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: 6798d921-32c4-4217-9330-c214f2aecfc9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:02:03.658495 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2ec72185-ad73-48ff-a98a-d930e924bd17 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:03.658948 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2ec72185-ad73-48ff-a98a-d930e924bd17 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:03.660431 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2ec72185-ad73-48ff-a98a-d930e924bd17 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:03.660877 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2ec72185-ad73-48ff-a98a-d930e924bd17 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:03.804392 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2ec72185-ad73-48ff-a98a-d930e924bd17 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8360bcc5196e4d6f93b0676b7440621a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19eafdcc2e7c4f8a9b4cd13a584cf982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:02:03.812193 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2ec72185-ad73-48ff-a98a-d930e924bd17 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "GET /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9" status: 200 len: 1362 microversion: 2.1 time: 0.165889 Jun 10 19:02:03.812881 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4185/7807] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:02:03 2022] GET /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:02:04.829164 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bfbba8fa-60cc-4ef6-8af1-68cbe805ba7d tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:02:04.829898 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bfbba8fa-60cc-4ef6-8af1-68cbe805ba7d tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: 6798d921-32c4-4217-9330-c214f2aecfc9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:02:04.831736 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:02:04.832492 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=12 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:02:04.838343 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bfbba8fa-60cc-4ef6-8af1-68cbe805ba7d tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:04.838814 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bfbba8fa-60cc-4ef6-8af1-68cbe805ba7d tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:04.841577 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bfbba8fa-60cc-4ef6-8af1-68cbe805ba7d tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:04.841577 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bfbba8fa-60cc-4ef6-8af1-68cbe805ba7d tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:04.970948 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bfbba8fa-60cc-4ef6-8af1-68cbe805ba7d tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8360bcc5196e4d6f93b0676b7440621a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19eafdcc2e7c4f8a9b4cd13a584cf982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:02:04.979126 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bfbba8fa-60cc-4ef6-8af1-68cbe805ba7d tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "GET /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9" status: 200 len: 1554 microversion: 2.1 time: 0.153764 Jun 10 19:02:04.979715 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4186/7808] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:02:04 2022] GET /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:02:04.995620 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-04b143a2-654a-4a33-b43f-0a9840d9dbdf tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:02:04.996259 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-04b143a2-654a-4a33-b43f-0a9840d9dbdf tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: 6798d921-32c4-4217-9330-c214f2aecfc9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:02:05.002524 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-04b143a2-654a-4a33-b43f-0a9840d9dbdf tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:05.007675 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-04b143a2-654a-4a33-b43f-0a9840d9dbdf tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:05.007675 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-04b143a2-654a-4a33-b43f-0a9840d9dbdf tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:05.007675 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-04b143a2-654a-4a33-b43f-0a9840d9dbdf tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:05.136651 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-04b143a2-654a-4a33-b43f-0a9840d9dbdf tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8360bcc5196e4d6f93b0676b7440621a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19eafdcc2e7c4f8a9b4cd13a584cf982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:02:05.144939 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-04b143a2-654a-4a33-b43f-0a9840d9dbdf tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "GET /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9" status: 200 len: 1554 microversion: 2.1 time: 0.152068 Jun 10 19:02:05.146382 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4187/7809] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:02:04 2022] GET /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:02:08.463982 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-98f747d1-5b9c-4a43-a8fb-e9b6275afc5b tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c6571b0-b3c3-4eb0-b175-509f1df97081"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:02:08.465088 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-98f747d1-5b9c-4a43-a8fb-e9b6275afc5b tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: 6798d921-32c4-4217-9330-c214f2aecfc9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:02:08.472989 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-98f747d1-5b9c-4a43-a8fb-e9b6275afc5b tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:08.473448 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-98f747d1-5b9c-4a43-a8fb-e9b6275afc5b tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:08.474218 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-98f747d1-5b9c-4a43-a8fb-e9b6275afc5b tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:08.474662 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-98f747d1-5b9c-4a43-a8fb-e9b6275afc5b tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:09.170938 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-98f747d1-5b9c-4a43-a8fb-e9b6275afc5b tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "POST /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.710719 Jun 10 19:02:09.171574 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4188/7810] 10.222.0.35 () {60 vars in 1322 bytes} [Fri Jun 10 19:02:08 2022] POST /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9/os-volume_attachments => generated 194 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:02:20.880847 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:02:20.881661 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:02:20.885950 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-55d8ab2a-2a89-481b-a291-9ca56b8dcf34 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:02:20.886545 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-55d8ab2a-2a89-481b-a291-9ca56b8dcf34 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: 6798d921-32c4-4217-9330-c214f2aecfc9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:02:20.892757 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-55d8ab2a-2a89-481b-a291-9ca56b8dcf34 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:20.893611 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-55d8ab2a-2a89-481b-a291-9ca56b8dcf34 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:20.893976 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-55d8ab2a-2a89-481b-a291-9ca56b8dcf34 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:20.894422 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-55d8ab2a-2a89-481b-a291-9ca56b8dcf34 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:20.974574 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-55d8ab2a-2a89-481b-a291-9ca56b8dcf34 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lazy-loading 'services' on Instance uuid 6798d921-32c4-4217-9330-c214f2aecfc9 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 19:02:21.228071 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-55d8ab2a-2a89-481b-a291-9ca56b8dcf34 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "DELETE /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9/os-volume_attachments/4c6571b0-b3c3-4eb0-b175-509f1df97081" status: 202 len: 0 microversion: 2.1 time: 0.349792 Jun 10 19:02:21.228719 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4189/7811] 10.222.0.35 () {58 vars in 1415 bytes} [Fri Jun 10 19:02:20 2022] DELETE /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9/os-volume_attachments/4c6571b0-b3c3-4eb0-b175-509f1df97081 => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 19:02:21.237288 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b935a609-7a9d-48ef-9256-8a05bfa913b7 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:02:21.238450 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b935a609-7a9d-48ef-9256-8a05bfa913b7 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: 6798d921-32c4-4217-9330-c214f2aecfc9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:02:21.244775 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b935a609-7a9d-48ef-9256-8a05bfa913b7 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:21.245232 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b935a609-7a9d-48ef-9256-8a05bfa913b7 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:21.246009 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b935a609-7a9d-48ef-9256-8a05bfa913b7 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:21.246458 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b935a609-7a9d-48ef-9256-8a05bfa913b7 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:21.276922 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b935a609-7a9d-48ef-9256-8a05bfa913b7 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "GET /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043618 Jun 10 19:02:21.277410 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4190/7812] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 19:02:21 2022] GET /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:02:22.289266 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e35a161a-f9b4-45b7-b51a-fec61af579cb tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:02:22.290309 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e35a161a-f9b4-45b7-b51a-fec61af579cb tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: 6798d921-32c4-4217-9330-c214f2aecfc9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:02:22.297859 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e35a161a-f9b4-45b7-b51a-fec61af579cb tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:22.298314 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e35a161a-f9b4-45b7-b51a-fec61af579cb tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:22.299085 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e35a161a-f9b4-45b7-b51a-fec61af579cb tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:22.299531 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e35a161a-f9b4-45b7-b51a-fec61af579cb tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:22.329295 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e35a161a-f9b4-45b7-b51a-fec61af579cb tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "GET /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044551 Jun 10 19:02:22.329857 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4191/7813] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 19:02:22 2022] GET /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:02:23.341414 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-92349b21-5cd2-4d78-9ecd-afb7d2d88cb6 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:02:23.342400 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-92349b21-5cd2-4d78-9ecd-afb7d2d88cb6 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: 6798d921-32c4-4217-9330-c214f2aecfc9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:02:23.350329 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-92349b21-5cd2-4d78-9ecd-afb7d2d88cb6 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:23.350795 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-92349b21-5cd2-4d78-9ecd-afb7d2d88cb6 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:23.351587 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-92349b21-5cd2-4d78-9ecd-afb7d2d88cb6 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:23.352034 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-92349b21-5cd2-4d78-9ecd-afb7d2d88cb6 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:23.383690 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-92349b21-5cd2-4d78-9ecd-afb7d2d88cb6 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "GET /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046245 Jun 10 19:02:23.384261 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4192/7814] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 19:02:23 2022] GET /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:02:24.394514 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-480da950-9890-4516-9f28-810488c643c9 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:02:24.395359 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-480da950-9890-4516-9f28-810488c643c9 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: 6798d921-32c4-4217-9330-c214f2aecfc9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:02:24.402693 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-480da950-9890-4516-9f28-810488c643c9 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:24.403129 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-480da950-9890-4516-9f28-810488c643c9 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:24.403910 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-480da950-9890-4516-9f28-810488c643c9 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:24.404376 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-480da950-9890-4516-9f28-810488c643c9 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:24.435128 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-480da950-9890-4516-9f28-810488c643c9 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "GET /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044752 Jun 10 19:02:24.435707 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4193/7815] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 19:02:24 2022] GET /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:02:25.446762 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8102faf3-effe-4feb-b5b6-e9d17af36f70 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:02:25.447809 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8102faf3-effe-4feb-b5b6-e9d17af36f70 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: 6798d921-32c4-4217-9330-c214f2aecfc9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:02:25.460184 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8102faf3-effe-4feb-b5b6-e9d17af36f70 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:25.460682 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8102faf3-effe-4feb-b5b6-e9d17af36f70 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:25.461473 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8102faf3-effe-4feb-b5b6-e9d17af36f70 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:25.461921 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8102faf3-effe-4feb-b5b6-e9d17af36f70 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:25.494839 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8102faf3-effe-4feb-b5b6-e9d17af36f70 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "GET /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052063 Jun 10 19:02:25.495420 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4194/7816] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 19:02:25 2022] GET /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:02:26.507340 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-97e3183b-8c53-4062-978f-b27a886e9e63 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:02:26.508274 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-97e3183b-8c53-4062-978f-b27a886e9e63 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: 6798d921-32c4-4217-9330-c214f2aecfc9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:02:26.515300 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-97e3183b-8c53-4062-978f-b27a886e9e63 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:26.515763 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-97e3183b-8c53-4062-978f-b27a886e9e63 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:26.516582 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-97e3183b-8c53-4062-978f-b27a886e9e63 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:26.517184 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-97e3183b-8c53-4062-978f-b27a886e9e63 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:26.546624 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-97e3183b-8c53-4062-978f-b27a886e9e63 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "GET /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043878 Jun 10 19:02:26.547201 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4195/7817] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 19:02:26 2022] GET /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 10 19:02:26.556514 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a2caba41-92fd-4461-b773-60f47f895891 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:02:26.557005 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a2caba41-92fd-4461-b773-60f47f895891 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: 6798d921-32c4-4217-9330-c214f2aecfc9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:02:26.562697 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a2caba41-92fd-4461-b773-60f47f895891 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:26.563158 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a2caba41-92fd-4461-b773-60f47f895891 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:26.563921 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a2caba41-92fd-4461-b773-60f47f895891 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:26.564398 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a2caba41-92fd-4461-b773-60f47f895891 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:26.639755 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-a2caba41-92fd-4461-b773-60f47f895891 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] HTTP exception thrown: Instance 6798d921-32c4-4217-9330-c214f2aecfc9 is not attached to volume 4c6571b0-b3c3-4eb0-b175-509f1df97081 Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a2caba41-92fd-4461-b773-60f47f895891 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Request method failure captured: Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9/os-volume_attachments/4c6571b0-b3c3-4eb0-b175-509f1df97081 HTTP/1.1 Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5UbBGUpFF1h3DI1uMGA4EG5rQIgAqEAc0kJk6RITFKPq7tztuq7hu6jW4UVlzXtibiXEB03gH_TufNCPAJA-oxc3yvqaYj7SBsBOaTwEgq9XBasOqNWvp_oeG0GiArVhPRvKK3Vdm8QZtQaLEWuA5gZliskypUqyIn9uBVQGDMuvXc Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 19eafdcc2e7c4f8a9b4cd13a584cf982 Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1604319331 Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/19eafdcc2e7c4f8a9b4cd13a584cf982"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/19eafdcc2e7c4f8a9b4cd13a584cf982"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/19eafdcc2e7c4f8a9b4cd13a584cf982"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_19eafdcc2e7c4f8a9b4cd13a584cf982", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-TestEncryptedCinderVolumes-1604319331 Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 19eafdcc2e7c4f8a9b4cd13a584cf982 Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1604319331 Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-TestEncryptedCinderVolumes-1604319331-project Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 8360bcc5196e4d6f93b0676b7440621a Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-TestEncryptedCinderVolumes-1604319331-project Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 6798d921-32c4-4217-9330-c214f2aecfc9 is not attached to volume 4c6571b0-b3c3-4eb0-b175-509f1df97081 Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: action_args: {'server_id': '6798d921-32c4-4217-9330-c214f2aecfc9', 'id': '4c6571b0-b3c3-4eb0-b175-509f1df97081'} Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 4c6571b0-b3c3-4eb0-b175-509f1df97081. Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6798d921-32c4-4217-9330-c214f2aecfc9 is not attached to volume 4c6571b0-b3c3-4eb0-b175-509f1df97081 Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:02:26.648627 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:02:26.656655 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 19:02:26.656655 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 19:02:26.656655 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6798d921-32c4-4217-9330-c214f2aecfc9 is not attached to volume 4c6571b0-b3c3-4eb0-b175-509f1df97081 Jun 10 19:02:26.656655 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:02:26.656655 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a2caba41-92fd-4461-b773-60f47f895891 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Returning 404 to user: Instance 6798d921-32c4-4217-9330-c214f2aecfc9 is not attached to volume 4c6571b0-b3c3-4eb0-b175-509f1df97081 {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 19:02:26.656655 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a2caba41-92fd-4461-b773-60f47f895891 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "DELETE /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9/os-volume_attachments/4c6571b0-b3c3-4eb0-b175-509f1df97081" status: 404 len: 154 microversion: 2.1 time: 0.097233 Jun 10 19:02:26.656655 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4196/7818] 10.222.0.35 () {58 vars in 1415 bytes} [Fri Jun 10 19:02:26 2022] DELETE /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9/os-volume_attachments/4c6571b0-b3c3-4eb0-b175-509f1df97081 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 19:02:30.180655 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-deb28c5a-331d-4a79-bf2b-ce72813ba7a3 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:02:30.181286 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-deb28c5a-331d-4a79-bf2b-ce72813ba7a3 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: 6798d921-32c4-4217-9330-c214f2aecfc9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:02:30.188316 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-deb28c5a-331d-4a79-bf2b-ce72813ba7a3 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:30.188784 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-deb28c5a-331d-4a79-bf2b-ce72813ba7a3 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:30.189561 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-deb28c5a-331d-4a79-bf2b-ce72813ba7a3 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:30.190007 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-deb28c5a-331d-4a79-bf2b-ce72813ba7a3 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:30.215680 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-deb28c5a-331d-4a79-bf2b-ce72813ba7a3 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: 6798d921-32c4-4217-9330-c214f2aecfc9] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 19:02:30.484131 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-deb28c5a-331d-4a79-bf2b-ce72813ba7a3 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "DELETE /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9" status: 204 len: 0 microversion: 2.1 time: 0.307690 Jun 10 19:02:30.485001 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4197/7819] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 19:02:30 2022] DELETE /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 19:02:30.495582 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3928012e-b6bf-41db-8510-2b35b11a0111 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:02:30.496295 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3928012e-b6bf-41db-8510-2b35b11a0111 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: 6798d921-32c4-4217-9330-c214f2aecfc9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:02:30.502860 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3928012e-b6bf-41db-8510-2b35b11a0111 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:30.503318 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3928012e-b6bf-41db-8510-2b35b11a0111 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:30.504098 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3928012e-b6bf-41db-8510-2b35b11a0111 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:30.504637 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3928012e-b6bf-41db-8510-2b35b11a0111 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:30.643640 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3928012e-b6bf-41db-8510-2b35b11a0111 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8360bcc5196e4d6f93b0676b7440621a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19eafdcc2e7c4f8a9b4cd13a584cf982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:02:30.656106 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3928012e-b6bf-41db-8510-2b35b11a0111 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "GET /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9" status: 200 len: 1560 microversion: 2.1 time: 0.166515 Jun 10 19:02:30.656932 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4198/7820] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:02:30 2022] GET /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:02:31.674615 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e67a3dda-bd9c-44f3-b549-85c9fe0fb19b tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:02:31.675294 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e67a3dda-bd9c-44f3-b549-85c9fe0fb19b tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: 6798d921-32c4-4217-9330-c214f2aecfc9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:02:31.683034 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e67a3dda-bd9c-44f3-b549-85c9fe0fb19b tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:31.683487 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e67a3dda-bd9c-44f3-b549-85c9fe0fb19b tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:31.684255 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e67a3dda-bd9c-44f3-b549-85c9fe0fb19b tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:31.684725 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e67a3dda-bd9c-44f3-b549-85c9fe0fb19b tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:31.813139 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e67a3dda-bd9c-44f3-b549-85c9fe0fb19b tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8360bcc5196e4d6f93b0676b7440621a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19eafdcc2e7c4f8a9b4cd13a584cf982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:02:31.820767 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e67a3dda-bd9c-44f3-b549-85c9fe0fb19b tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "GET /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9" status: 200 len: 1560 microversion: 2.1 time: 0.150118 Jun 10 19:02:31.821401 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4199/7821] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:02:31 2022] GET /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:02:32.507423 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-8a78482a-048c-4c42-9916-56357f3bf44b req-749f7032-d460-4387-bae8-9012f22d8528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6798d921-32c4-4217-9330-c214f2aecfc9", "name": "network-vif-deleted", "tag": "5279b8a0-5dbf-4253-a7f0-299a2ab9e220"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:02:32.515833 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-8a78482a-048c-4c42-9916-56357f3bf44b req-749f7032-d460-4387-bae8-9012f22d8528 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:32.516281 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-8a78482a-048c-4c42-9916-56357f3bf44b req-749f7032-d460-4387-bae8-9012f22d8528 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:32.527165 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-8a78482a-048c-4c42-9916-56357f3bf44b req-749f7032-d460-4387-bae8-9012f22d8528 service nova] Creating event network-vif-deleted:5279b8a0-5dbf-4253-a7f0-299a2ab9e220 for instance 6798d921-32c4-4217-9330-c214f2aecfc9 on chh1-master-2 Jun 10 19:02:32.532321 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-8a78482a-048c-4c42-9916-56357f3bf44b req-749f7032-d460-4387-bae8-9012f22d8528 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028585 Jun 10 19:02:32.533030 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4200/7822] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:02:32.839088 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-93f873db-9a80-4f3e-b335-4064883fbf8c tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:02:32.839798 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-93f873db-9a80-4f3e-b335-4064883fbf8c tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: 6798d921-32c4-4217-9330-c214f2aecfc9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:02:32.847310 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93f873db-9a80-4f3e-b335-4064883fbf8c tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:32.847890 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93f873db-9a80-4f3e-b335-4064883fbf8c tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:32.849229 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93f873db-9a80-4f3e-b335-4064883fbf8c tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:32.849641 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93f873db-9a80-4f3e-b335-4064883fbf8c tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:32.885504 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93f873db-9a80-4f3e-b335-4064883fbf8c tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:32.885968 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93f873db-9a80-4f3e-b335-4064883fbf8c tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:32.886431 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-93f873db-9a80-4f3e-b335-4064883fbf8c tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lazy-loading 'fault' on Instance uuid 6798d921-32c4-4217-9330-c214f2aecfc9 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 19:02:32.931076 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-93f873db-9a80-4f3e-b335-4064883fbf8c tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8360bcc5196e4d6f93b0676b7440621a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19eafdcc2e7c4f8a9b4cd13a584cf982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:02:32.938975 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-93f873db-9a80-4f3e-b335-4064883fbf8c tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "GET /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9" status: 200 len: 1352 microversion: 2.1 time: 0.104213 Jun 10 19:02:32.939564 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4201/7823] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:02:32 2022] GET /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9 => generated 1352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:02:33.956861 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a4cf22e8-53d7-456a-8277-3acd99acb2f0 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:02:33.957585 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a4cf22e8-53d7-456a-8277-3acd99acb2f0 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: 6798d921-32c4-4217-9330-c214f2aecfc9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:02:33.965044 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a4cf22e8-53d7-456a-8277-3acd99acb2f0 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:33.965500 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a4cf22e8-53d7-456a-8277-3acd99acb2f0 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:33.966267 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a4cf22e8-53d7-456a-8277-3acd99acb2f0 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:33.966707 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a4cf22e8-53d7-456a-8277-3acd99acb2f0 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:33.979875 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-a4cf22e8-53d7-456a-8277-3acd99acb2f0 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] HTTP exception thrown: Instance 6798d921-32c4-4217-9330-c214f2aecfc9 could not be found. Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a4cf22e8-53d7-456a-8277-3acd99acb2f0 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Request method failure captured: Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9 HTTP/1.1 Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5UbBGUpFF1h3DI1uMGA4EG5rQIgAqEAc0kJk6RITFKPq7tztuq7hu6jW4UVlzXtibiXEB03gH_TufNCPAJA-oxc3yvqaYj7SBsBOaTwEgq9XBasOqNWvp_oeG0GiArVhPRvKK3Vdm8QZtQaLEWuA5gZliskypUqyIn9uBVQGDMuvXc Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 19eafdcc2e7c4f8a9b4cd13a584cf982 Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1604319331 Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/19eafdcc2e7c4f8a9b4cd13a584cf982"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/19eafdcc2e7c4f8a9b4cd13a584cf982"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/19eafdcc2e7c4f8a9b4cd13a584cf982"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_19eafdcc2e7c4f8a9b4cd13a584cf982", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-TestEncryptedCinderVolumes-1604319331 Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 19eafdcc2e7c4f8a9b4cd13a584cf982 Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1604319331 Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-TestEncryptedCinderVolumes-1604319331-project Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 8360bcc5196e4d6f93b0676b7440621a Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-TestEncryptedCinderVolumes-1604319331-project Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 6798d921-32c4-4217-9330-c214f2aecfc9 could not be found. Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '6798d921-32c4-4217-9330-c214f2aecfc9'} Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6798d921-32c4-4217-9330-c214f2aecfc9 could not be found. Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6798d921-32c4-4217-9330-c214f2aecfc9 could not be found. Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:02:33.981555 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:02:33.987345 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:02:33.987345 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:02:33.987345 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:02:33.987345 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 19:02:33.987345 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 19:02:33.987345 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6798d921-32c4-4217-9330-c214f2aecfc9 could not be found. Jun 10 19:02:33.987345 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:02:33.987345 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a4cf22e8-53d7-456a-8277-3acd99acb2f0 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Returning 404 to user: Instance 6798d921-32c4-4217-9330-c214f2aecfc9 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 19:02:33.987345 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a4cf22e8-53d7-456a-8277-3acd99acb2f0 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "GET /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9" status: 404 len: 111 microversion: 2.1 time: 0.030006 Jun 10 19:02:33.987345 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4202/7824] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:02:33 2022] GET /compute/v2.1/servers/6798d921-32c4-4217-9330-c214f2aecfc9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 19:02:33.990825 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fe90dda7-e0ba-45fd-9bdb-fc6316de5bf7 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '.version_select at 0x7f77c162b310>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:02:34.073174 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fe90dda7-e0ba-45fd-9bdb-fc6316de5bf7 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1788187221" status: 202 len: 0 microversion: 2.1 time: 0.085631 Jun 10 19:02:34.073752 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4203/7825] 10.222.0.35 () {58 vars in 1277 bytes} [Fri Jun 10 19:02:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1788187221 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 19:02:34.091175 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b789b7a6-0af1-470a-a6d4-b498c14221b6 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Action: 'create', calling method: .version_select at 0x7f77c11edaf0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-98846522", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUiZxVd7EAKoIcDR+Y5ebeBSKbmP9Fsi+25OSpMC4Uq6ELFX0XKd56T6iyDSB87FV93SP14rwH62KjgcJWtrZ8evEq1JjE9nexYUoCd74FP9hRPFZh4L7GPItZRr43lIQ=="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:02:34.106151 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-b789b7a6-0af1-470a-a6d4-b498c14221b6 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Getting quotas for project 19eafdcc2e7c4f8a9b4cd13a584cf982. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 19:02:34.111259 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-b789b7a6-0af1-470a-a6d4-b498c14221b6 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Getting quotas for user 8360bcc5196e4d6f93b0676b7440621a and project 19eafdcc2e7c4f8a9b4cd13a584cf982. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 19:02:34.193603 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b789b7a6-0af1-470a-a6d4-b498c14221b6 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.106194 Jun 10 19:02:34.194202 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4204/7826] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 19:02:34 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:02:34.240767 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4fe911e2-dc2c-486d-8bc4-aa557dbfac0f tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-460813244", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-98846522", "networks": [{"uuid": "54b25c4a-1783-4944-bd07-b2340d412381"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:02:34.290736 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-4fe911e2-dc2c-486d-8bc4-aa557dbfac0f tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] validate_networks() for [('54b25c4a-1783-4944-bd07-b2340d412381', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 19:02:34.655954 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-4fe911e2-dc2c-486d-8bc4-aa557dbfac0f tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 19:02:34.656417 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-4fe911e2-dc2c-486d-8bc4-aa557dbfac0f tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 19:02:34.656900 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-4fe911e2-dc2c-486d-8bc4-aa557dbfac0f tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 19:02:34.657342 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-4fe911e2-dc2c-486d-8bc4-aa557dbfac0f tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 19:02:34.657760 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-4fe911e2-dc2c-486d-8bc4-aa557dbfac0f tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 19:02:34.669487 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4fe911e2-dc2c-486d-8bc4-aa557dbfac0f tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:34.670100 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4fe911e2-dc2c-486d-8bc4-aa557dbfac0f tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:34.670999 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4fe911e2-dc2c-486d-8bc4-aa557dbfac0f tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:34.671445 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4fe911e2-dc2c-486d-8bc4-aa557dbfac0f tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:34.689631 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-4fe911e2-dc2c-486d-8bc4-aa557dbfac0f tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Getting quotas for project 19eafdcc2e7c4f8a9b4cd13a584cf982. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 19:02:34.695107 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-4fe911e2-dc2c-486d-8bc4-aa557dbfac0f tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Getting quotas for user 8360bcc5196e4d6f93b0676b7440621a and project 19eafdcc2e7c4f8a9b4cd13a584cf982. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 19:02:34.707860 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4fe911e2-dc2c-486d-8bc4-aa557dbfac0f tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 19:02:34.710243 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4fe911e2-dc2c-486d-8bc4-aa557dbfac0f tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: c86ed260-18d0-4504-9c89-e98812fc9379] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 19:02:34.790508 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4fe911e2-dc2c-486d-8bc4-aa557dbfac0f tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.553593 Jun 10 19:02:34.791141 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4205/7827] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 19:02:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 19:02:34.800711 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-450d2d3c-e475-44e4-a451-5727ae3b815a tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:02:34.801345 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-450d2d3c-e475-44e4-a451-5727ae3b815a tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: c86ed260-18d0-4504-9c89-e98812fc9379] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:02:34.859118 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-450d2d3c-e475-44e4-a451-5727ae3b815a tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8360bcc5196e4d6f93b0676b7440621a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19eafdcc2e7c4f8a9b4cd13a584cf982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:02:34.866455 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-450d2d3c-e475-44e4-a451-5727ae3b815a tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "GET /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379" status: 200 len: 1260 microversion: 2.1 time: 0.069394 Jun 10 19:02:34.867024 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4206/7828] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:02:34 2022] GET /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379 => generated 1260 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:02:35.886859 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fbff482a-ec1f-40f1-b83a-9239c3318337 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:02:35.887641 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fbff482a-ec1f-40f1-b83a-9239c3318337 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: c86ed260-18d0-4504-9c89-e98812fc9379] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:02:35.895383 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fbff482a-ec1f-40f1-b83a-9239c3318337 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:35.896763 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fbff482a-ec1f-40f1-b83a-9239c3318337 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:35.896763 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fbff482a-ec1f-40f1-b83a-9239c3318337 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:35.897091 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fbff482a-ec1f-40f1-b83a-9239c3318337 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:35.958250 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fbff482a-ec1f-40f1-b83a-9239c3318337 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8360bcc5196e4d6f93b0676b7440621a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19eafdcc2e7c4f8a9b4cd13a584cf982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:02:35.961864 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:02:35.966159 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fbff482a-ec1f-40f1-b83a-9239c3318337 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "GET /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379" status: 200 len: 1264 microversion: 2.1 time: 0.083272 Jun 10 19:02:35.966734 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4207/7829] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:02:35 2022] GET /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379 => generated 1264 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:02:36.983947 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7ff4e13a-bfae-48a9-9ab0-cded7a0ec52a tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:02:36.984720 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7ff4e13a-bfae-48a9-9ab0-cded7a0ec52a tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: c86ed260-18d0-4504-9c89-e98812fc9379] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:02:36.992016 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7ff4e13a-bfae-48a9-9ab0-cded7a0ec52a tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:36.992499 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7ff4e13a-bfae-48a9-9ab0-cded7a0ec52a tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:36.993287 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7ff4e13a-bfae-48a9-9ab0-cded7a0ec52a tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:36.993795 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7ff4e13a-bfae-48a9-9ab0-cded7a0ec52a tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:37.074082 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7ff4e13a-bfae-48a9-9ab0-cded7a0ec52a tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8360bcc5196e4d6f93b0676b7440621a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19eafdcc2e7c4f8a9b4cd13a584cf982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:02:37.074082 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7ff4e13a-bfae-48a9-9ab0-cded7a0ec52a tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "GET /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379" status: 200 len: 1330 microversion: 2.1 time: 0.089706 Jun 10 19:02:37.074082 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4208/7830] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:02:36 2022] GET /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379 => generated 1330 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:02:38.087325 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d151115d-78fe-41de-98c9-b34407751be6 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:02:38.087943 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d151115d-78fe-41de-98c9-b34407751be6 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: c86ed260-18d0-4504-9c89-e98812fc9379] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:02:38.096192 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d151115d-78fe-41de-98c9-b34407751be6 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:38.096900 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d151115d-78fe-41de-98c9-b34407751be6 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:38.097606 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d151115d-78fe-41de-98c9-b34407751be6 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:38.098037 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d151115d-78fe-41de-98c9-b34407751be6 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:38.233011 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d151115d-78fe-41de-98c9-b34407751be6 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8360bcc5196e4d6f93b0676b7440621a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19eafdcc2e7c4f8a9b4cd13a584cf982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:02:38.240798 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d151115d-78fe-41de-98c9-b34407751be6 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "GET /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379" status: 200 len: 1360 microversion: 2.1 time: 0.157911 Jun 10 19:02:38.241385 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4209/7831] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:02:38 2022] GET /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379 => generated 1360 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:02:38.712666 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-d5938452-94f3-4074-987d-11af35c75391 req-d7ea488f-7aab-4506-a8c7-ae215ab23a3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c86ed260-18d0-4504-9c89-e98812fc9379", "tag": "35ce6532-626b-4229-b13d-a7375afa7992"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:02:38.722475 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-d5938452-94f3-4074-987d-11af35c75391 req-d7ea488f-7aab-4506-a8c7-ae215ab23a3b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:38.724714 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-d5938452-94f3-4074-987d-11af35c75391 req-d7ea488f-7aab-4506-a8c7-ae215ab23a3b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:38.736592 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-d5938452-94f3-4074-987d-11af35c75391 req-d7ea488f-7aab-4506-a8c7-ae215ab23a3b service nova] Creating event network-changed:35ce6532-626b-4229-b13d-a7375afa7992 for instance c86ed260-18d0-4504-9c89-e98812fc9379 on chh1-master-2 Jun 10 19:02:38.741779 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-d5938452-94f3-4074-987d-11af35c75391 req-d7ea488f-7aab-4506-a8c7-ae215ab23a3b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033660 Jun 10 19:02:38.742393 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4210/7832] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:02:39.258850 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7e2b77ca-9ad5-40ad-bbdb-473174348b76 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:02:39.259634 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7e2b77ca-9ad5-40ad-bbdb-473174348b76 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: c86ed260-18d0-4504-9c89-e98812fc9379] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:02:39.266921 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e2b77ca-9ad5-40ad-bbdb-473174348b76 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:39.267381 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e2b77ca-9ad5-40ad-bbdb-473174348b76 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:39.268171 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e2b77ca-9ad5-40ad-bbdb-473174348b76 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:39.268656 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e2b77ca-9ad5-40ad-bbdb-473174348b76 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:39.401337 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7e2b77ca-9ad5-40ad-bbdb-473174348b76 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8360bcc5196e4d6f93b0676b7440621a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19eafdcc2e7c4f8a9b4cd13a584cf982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:02:39.409167 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7e2b77ca-9ad5-40ad-bbdb-473174348b76 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "GET /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379" status: 200 len: 1360 microversion: 2.1 time: 0.154735 Jun 10 19:02:39.409746 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4211/7833] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:02:39 2022] GET /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379 => generated 1360 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:02:40.426273 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d02d4ab3-cd67-44e8-8b0e-d3f312ef6329 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:02:40.426878 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d02d4ab3-cd67-44e8-8b0e-d3f312ef6329 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: c86ed260-18d0-4504-9c89-e98812fc9379] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:02:40.434507 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d02d4ab3-cd67-44e8-8b0e-d3f312ef6329 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:40.434968 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d02d4ab3-cd67-44e8-8b0e-d3f312ef6329 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:40.435737 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d02d4ab3-cd67-44e8-8b0e-d3f312ef6329 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:40.436179 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d02d4ab3-cd67-44e8-8b0e-d3f312ef6329 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:40.564763 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d02d4ab3-cd67-44e8-8b0e-d3f312ef6329 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8360bcc5196e4d6f93b0676b7440621a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19eafdcc2e7c4f8a9b4cd13a584cf982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:02:40.572889 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d02d4ab3-cd67-44e8-8b0e-d3f312ef6329 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "GET /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379" status: 200 len: 1360 microversion: 2.1 time: 0.150516 Jun 10 19:02:40.573455 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4212/7834] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:02:40 2022] GET /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379 => generated 1360 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:02:41.590501 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5aa82f88-91de-41e2-8b13-760b51c2c7bf tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:02:41.591185 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5aa82f88-91de-41e2-8b13-760b51c2c7bf tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: c86ed260-18d0-4504-9c89-e98812fc9379] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:02:41.598284 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5aa82f88-91de-41e2-8b13-760b51c2c7bf tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:41.598756 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5aa82f88-91de-41e2-8b13-760b51c2c7bf tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:41.599567 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5aa82f88-91de-41e2-8b13-760b51c2c7bf tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:41.600017 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5aa82f88-91de-41e2-8b13-760b51c2c7bf tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:41.736517 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5aa82f88-91de-41e2-8b13-760b51c2c7bf tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8360bcc5196e4d6f93b0676b7440621a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19eafdcc2e7c4f8a9b4cd13a584cf982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:02:41.744256 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5aa82f88-91de-41e2-8b13-760b51c2c7bf tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "GET /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379" status: 200 len: 1360 microversion: 2.1 time: 0.157701 Jun 10 19:02:41.744898 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4213/7835] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:02:41 2022] GET /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379 => generated 1360 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:02:42.762125 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-53538cbd-4bdc-414e-b79f-00d88573e158 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:02:42.762791 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-53538cbd-4bdc-414e-b79f-00d88573e158 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: c86ed260-18d0-4504-9c89-e98812fc9379] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:02:42.769060 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-53538cbd-4bdc-414e-b79f-00d88573e158 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:42.769511 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-53538cbd-4bdc-414e-b79f-00d88573e158 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:42.770269 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-53538cbd-4bdc-414e-b79f-00d88573e158 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:42.770708 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-53538cbd-4bdc-414e-b79f-00d88573e158 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:42.900445 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-53538cbd-4bdc-414e-b79f-00d88573e158 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8360bcc5196e4d6f93b0676b7440621a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19eafdcc2e7c4f8a9b4cd13a584cf982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:02:42.907878 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-53538cbd-4bdc-414e-b79f-00d88573e158 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "GET /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379" status: 200 len: 1360 microversion: 2.1 time: 0.149659 Jun 10 19:02:42.908484 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4214/7836] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:02:42 2022] GET /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379 => generated 1360 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:02:43.559666 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-c3d8891b-b111-48f0-9ca2-273ce2322fca req-8e9b0dd9-662b-4491-9e8c-f1124be65698 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c86ed260-18d0-4504-9c89-e98812fc9379", "name": "network-vif-plugged", "status": "completed", "tag": "35ce6532-626b-4229-b13d-a7375afa7992"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:02:43.567700 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-c3d8891b-b111-48f0-9ca2-273ce2322fca req-8e9b0dd9-662b-4491-9e8c-f1124be65698 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:43.568151 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-c3d8891b-b111-48f0-9ca2-273ce2322fca req-8e9b0dd9-662b-4491-9e8c-f1124be65698 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:43.579216 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-c3d8891b-b111-48f0-9ca2-273ce2322fca req-8e9b0dd9-662b-4491-9e8c-f1124be65698 service nova] Creating event network-vif-plugged:35ce6532-626b-4229-b13d-a7375afa7992 for instance c86ed260-18d0-4504-9c89-e98812fc9379 on chh1-master-2 Jun 10 19:02:43.584701 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-c3d8891b-b111-48f0-9ca2-273ce2322fca req-8e9b0dd9-662b-4491-9e8c-f1124be65698 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028722 Jun 10 19:02:43.585312 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4215/7837] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:02:43.926620 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e6a170d1-a8ba-4b15-b86f-c93443b2b6c8 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:02:43.927266 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e6a170d1-a8ba-4b15-b86f-c93443b2b6c8 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: c86ed260-18d0-4504-9c89-e98812fc9379] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:02:43.933500 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e6a170d1-a8ba-4b15-b86f-c93443b2b6c8 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:43.933953 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e6a170d1-a8ba-4b15-b86f-c93443b2b6c8 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:43.934713 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e6a170d1-a8ba-4b15-b86f-c93443b2b6c8 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:43.935149 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e6a170d1-a8ba-4b15-b86f-c93443b2b6c8 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:44.067089 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e6a170d1-a8ba-4b15-b86f-c93443b2b6c8 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8360bcc5196e4d6f93b0676b7440621a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19eafdcc2e7c4f8a9b4cd13a584cf982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:02:44.075131 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e6a170d1-a8ba-4b15-b86f-c93443b2b6c8 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "GET /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379" status: 200 len: 1360 microversion: 2.1 time: 0.153649 Jun 10 19:02:44.075723 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4216/7838] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:02:43 2022] GET /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379 => generated 1360 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:02:45.097934 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-644d48d2-4d89-48cb-9af7-5883ef6b31f1 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:02:45.098526 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-644d48d2-4d89-48cb-9af7-5883ef6b31f1 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: c86ed260-18d0-4504-9c89-e98812fc9379] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:02:45.101198 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:02:45.101885 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=12 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:02:45.107588 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-644d48d2-4d89-48cb-9af7-5883ef6b31f1 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:45.108036 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-644d48d2-4d89-48cb-9af7-5883ef6b31f1 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:45.108837 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-644d48d2-4d89-48cb-9af7-5883ef6b31f1 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:45.109302 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-644d48d2-4d89-48cb-9af7-5883ef6b31f1 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:45.238892 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-644d48d2-4d89-48cb-9af7-5883ef6b31f1 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8360bcc5196e4d6f93b0676b7440621a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19eafdcc2e7c4f8a9b4cd13a584cf982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:02:45.247077 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-644d48d2-4d89-48cb-9af7-5883ef6b31f1 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "GET /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379" status: 200 len: 1553 microversion: 2.1 time: 0.153170 Jun 10 19:02:45.247910 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4217/7839] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:02:45 2022] GET /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:02:45.262879 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-638fe2c8-1f4f-4ed9-ae30-ca538d377100 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:02:45.263482 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-638fe2c8-1f4f-4ed9-ae30-ca538d377100 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: c86ed260-18d0-4504-9c89-e98812fc9379] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:02:45.269579 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-638fe2c8-1f4f-4ed9-ae30-ca538d377100 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:45.270030 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-638fe2c8-1f4f-4ed9-ae30-ca538d377100 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:45.270790 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-638fe2c8-1f4f-4ed9-ae30-ca538d377100 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:45.271224 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-638fe2c8-1f4f-4ed9-ae30-ca538d377100 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:45.401766 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-638fe2c8-1f4f-4ed9-ae30-ca538d377100 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8360bcc5196e4d6f93b0676b7440621a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19eafdcc2e7c4f8a9b4cd13a584cf982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:02:45.409446 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-638fe2c8-1f4f-4ed9-ae30-ca538d377100 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "GET /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379" status: 200 len: 1553 microversion: 2.1 time: 0.150141 Jun 10 19:02:45.410014 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4218/7840] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:02:45 2022] GET /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:02:48.418899 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c155c116-0078-49b2-9c2c-12cae67c2c3d tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9a1db63-d7d5-47b3-bb97-5bf10fa88c0c"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:02:48.420007 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c155c116-0078-49b2-9c2c-12cae67c2c3d tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: c86ed260-18d0-4504-9c89-e98812fc9379] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:02:48.423900 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:02:48.427980 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c155c116-0078-49b2-9c2c-12cae67c2c3d tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:48.428472 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c155c116-0078-49b2-9c2c-12cae67c2c3d tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:48.429254 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c155c116-0078-49b2-9c2c-12cae67c2c3d tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:02:48.429700 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c155c116-0078-49b2-9c2c-12cae67c2c3d tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:02:49.213044 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c155c116-0078-49b2-9c2c-12cae67c2c3d tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "POST /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.798011 Jun 10 19:02:49.214068 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4219/7841] 10.222.0.35 () {60 vars in 1322 bytes} [Fri Jun 10 19:02:48 2022] POST /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379/os-volume_attachments => generated 194 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:03:00.935822 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-77647652-2990-462d-a24c-b5bc63195a76 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:03:00.936481 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-77647652-2990-462d-a24c-b5bc63195a76 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: c86ed260-18d0-4504-9c89-e98812fc9379] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:03:00.939474 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:03:00.944758 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-77647652-2990-462d-a24c-b5bc63195a76 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:00.945222 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-77647652-2990-462d-a24c-b5bc63195a76 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:00.946005 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-77647652-2990-462d-a24c-b5bc63195a76 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:00.946507 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-77647652-2990-462d-a24c-b5bc63195a76 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:01.025496 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-77647652-2990-462d-a24c-b5bc63195a76 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lazy-loading 'services' on Instance uuid c86ed260-18d0-4504-9c89-e98812fc9379 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 19:03:01.252297 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-77647652-2990-462d-a24c-b5bc63195a76 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "DELETE /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379/os-volume_attachments/a9a1db63-d7d5-47b3-bb97-5bf10fa88c0c" status: 202 len: 0 microversion: 2.1 time: 0.320594 Jun 10 19:03:01.252918 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4220/7842] 10.222.0.35 () {58 vars in 1415 bytes} [Fri Jun 10 19:03:00 2022] DELETE /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379/os-volume_attachments/a9a1db63-d7d5-47b3-bb97-5bf10fa88c0c => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 19:03:01.261402 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-42ac15ad-f4df-4ef4-b02d-d7185e41ff2a tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:03:01.263036 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-42ac15ad-f4df-4ef4-b02d-d7185e41ff2a tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: c86ed260-18d0-4504-9c89-e98812fc9379] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:03:01.268684 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42ac15ad-f4df-4ef4-b02d-d7185e41ff2a tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:01.269139 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42ac15ad-f4df-4ef4-b02d-d7185e41ff2a tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:01.269905 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42ac15ad-f4df-4ef4-b02d-d7185e41ff2a tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:01.270340 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-42ac15ad-f4df-4ef4-b02d-d7185e41ff2a tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:01.299982 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-42ac15ad-f4df-4ef4-b02d-d7185e41ff2a tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "GET /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042648 Jun 10 19:03:01.300566 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4221/7843] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 19:03:01 2022] GET /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:03:02.311166 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bc3b14e7-751a-4972-afd5-7a03ab5e362b tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:03:02.312088 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bc3b14e7-751a-4972-afd5-7a03ab5e362b tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: c86ed260-18d0-4504-9c89-e98812fc9379] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:03:02.319296 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bc3b14e7-751a-4972-afd5-7a03ab5e362b tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:02.319753 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bc3b14e7-751a-4972-afd5-7a03ab5e362b tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:02.320560 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bc3b14e7-751a-4972-afd5-7a03ab5e362b tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:02.321007 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bc3b14e7-751a-4972-afd5-7a03ab5e362b tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:02.351368 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bc3b14e7-751a-4972-afd5-7a03ab5e362b tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "GET /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044138 Jun 10 19:03:02.351936 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4222/7844] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 19:03:02 2022] GET /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:03:03.363586 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c574aa41-1fb2-4659-9743-a1dbbe505dfe tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:03:03.365536 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c574aa41-1fb2-4659-9743-a1dbbe505dfe tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: c86ed260-18d0-4504-9c89-e98812fc9379] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:03:03.373394 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c574aa41-1fb2-4659-9743-a1dbbe505dfe tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:03.373942 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c574aa41-1fb2-4659-9743-a1dbbe505dfe tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:03.374946 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c574aa41-1fb2-4659-9743-a1dbbe505dfe tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:03.375452 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c574aa41-1fb2-4659-9743-a1dbbe505dfe tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:03.413459 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c574aa41-1fb2-4659-9743-a1dbbe505dfe tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "GET /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054116 Jun 10 19:03:03.414273 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4223/7845] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 19:03:03 2022] GET /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:03:04.426221 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e615cb25-ec57-4555-9dcb-516a3066ffc0 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:03:04.427677 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e615cb25-ec57-4555-9dcb-516a3066ffc0 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: c86ed260-18d0-4504-9c89-e98812fc9379] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:03:04.434577 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e615cb25-ec57-4555-9dcb-516a3066ffc0 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:04.435033 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e615cb25-ec57-4555-9dcb-516a3066ffc0 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:04.435801 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e615cb25-ec57-4555-9dcb-516a3066ffc0 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:04.436243 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e615cb25-ec57-4555-9dcb-516a3066ffc0 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:04.465945 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e615cb25-ec57-4555-9dcb-516a3066ffc0 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "GET /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043687 Jun 10 19:03:04.466508 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4224/7846] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 19:03:04 2022] GET /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:03:05.477631 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7e4f7d9a-7514-431b-9f48-ea89446034b4 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:03:05.478575 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7e4f7d9a-7514-431b-9f48-ea89446034b4 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: c86ed260-18d0-4504-9c89-e98812fc9379] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:03:05.485556 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e4f7d9a-7514-431b-9f48-ea89446034b4 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:05.486018 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e4f7d9a-7514-431b-9f48-ea89446034b4 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:05.486796 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e4f7d9a-7514-431b-9f48-ea89446034b4 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:05.487245 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7e4f7d9a-7514-431b-9f48-ea89446034b4 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:05.521498 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7e4f7d9a-7514-431b-9f48-ea89446034b4 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "GET /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047225 Jun 10 19:03:05.522110 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4225/7847] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 19:03:05 2022] GET /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:03:06.533125 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ede8d228-ea43-4a72-9a1e-db2997dbd853 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:03:06.534055 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ede8d228-ea43-4a72-9a1e-db2997dbd853 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: c86ed260-18d0-4504-9c89-e98812fc9379] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:03:06.541568 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ede8d228-ea43-4a72-9a1e-db2997dbd853 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:06.542024 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ede8d228-ea43-4a72-9a1e-db2997dbd853 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:06.542787 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ede8d228-ea43-4a72-9a1e-db2997dbd853 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:06.543230 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ede8d228-ea43-4a72-9a1e-db2997dbd853 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:06.571567 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ede8d228-ea43-4a72-9a1e-db2997dbd853 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "GET /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042436 Jun 10 19:03:06.572125 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4226/7848] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 19:03:06 2022] GET /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 10 19:03:06.581384 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a5575674-f0ea-4f17-9b3b-97095da4b410 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:03:06.581880 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a5575674-f0ea-4f17-9b3b-97095da4b410 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: c86ed260-18d0-4504-9c89-e98812fc9379] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:03:06.587964 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a5575674-f0ea-4f17-9b3b-97095da4b410 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:06.602823 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a5575674-f0ea-4f17-9b3b-97095da4b410 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:06.602823 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a5575674-f0ea-4f17-9b3b-97095da4b410 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:06.602823 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a5575674-f0ea-4f17-9b3b-97095da4b410 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:06.668483 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-a5575674-f0ea-4f17-9b3b-97095da4b410 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] HTTP exception thrown: Instance c86ed260-18d0-4504-9c89-e98812fc9379 is not attached to volume a9a1db63-d7d5-47b3-bb97-5bf10fa88c0c Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a5575674-f0ea-4f17-9b3b-97095da4b410 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Request method failure captured: Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379/os-volume_attachments/a9a1db63-d7d5-47b3-bb97-5bf10fa88c0c HTTP/1.1 Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5UbBGUpFF1h3DI1uMGA4EG5rQIgAqEAc0kJk6RITFKPq7tztuq7hu6jW4UVlzXtibiXEB03gH_TufNCPAJA-oxc3yvqaYj7SBsBOaTwEgq9XBasOqNWvp_oeG0GiArVhPRvKK3Vdm8QZtQaLEWuA5gZliskypUqyIn9uBVQGDMuvXc Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 19eafdcc2e7c4f8a9b4cd13a584cf982 Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1604319331 Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/19eafdcc2e7c4f8a9b4cd13a584cf982"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/19eafdcc2e7c4f8a9b4cd13a584cf982"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/19eafdcc2e7c4f8a9b4cd13a584cf982"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_19eafdcc2e7c4f8a9b4cd13a584cf982", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-TestEncryptedCinderVolumes-1604319331 Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 19eafdcc2e7c4f8a9b4cd13a584cf982 Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1604319331 Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-TestEncryptedCinderVolumes-1604319331-project Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 8360bcc5196e4d6f93b0676b7440621a Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-TestEncryptedCinderVolumes-1604319331-project Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: exception: Instance c86ed260-18d0-4504-9c89-e98812fc9379 is not attached to volume a9a1db63-d7d5-47b3-bb97-5bf10fa88c0c Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: action_args: {'server_id': 'c86ed260-18d0-4504-9c89-e98812fc9379', 'id': 'a9a1db63-d7d5-47b3-bb97-5bf10fa88c0c'} Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a9a1db63-d7d5-47b3-bb97-5bf10fa88c0c. Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c86ed260-18d0-4504-9c89-e98812fc9379 is not attached to volume a9a1db63-d7d5-47b3-bb97-5bf10fa88c0c Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:03:06.670132 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:03:06.674998 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 19:03:06.674998 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 19:03:06.674998 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c86ed260-18d0-4504-9c89-e98812fc9379 is not attached to volume a9a1db63-d7d5-47b3-bb97-5bf10fa88c0c Jun 10 19:03:06.674998 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:03:06.674998 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a5575674-f0ea-4f17-9b3b-97095da4b410 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Returning 404 to user: Instance c86ed260-18d0-4504-9c89-e98812fc9379 is not attached to volume a9a1db63-d7d5-47b3-bb97-5bf10fa88c0c {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 19:03:06.674998 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a5575674-f0ea-4f17-9b3b-97095da4b410 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "DELETE /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379/os-volume_attachments/a9a1db63-d7d5-47b3-bb97-5bf10fa88c0c" status: 404 len: 154 microversion: 2.1 time: 0.093773 Jun 10 19:03:06.674998 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4227/7849] 10.222.0.35 () {58 vars in 1415 bytes} [Fri Jun 10 19:03:06 2022] DELETE /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379/os-volume_attachments/a9a1db63-d7d5-47b3-bb97-5bf10fa88c0c => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 19:03:10.187289 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cca6aa37-fd70-4931-bf1b-36c24edcd4ac tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:03:10.193121 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cca6aa37-fd70-4931-bf1b-36c24edcd4ac tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: c86ed260-18d0-4504-9c89-e98812fc9379] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:03:10.196262 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cca6aa37-fd70-4931-bf1b-36c24edcd4ac tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:10.196941 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cca6aa37-fd70-4931-bf1b-36c24edcd4ac tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:10.197713 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cca6aa37-fd70-4931-bf1b-36c24edcd4ac tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:10.198931 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cca6aa37-fd70-4931-bf1b-36c24edcd4ac tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:10.229884 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cca6aa37-fd70-4931-bf1b-36c24edcd4ac tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: c86ed260-18d0-4504-9c89-e98812fc9379] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 19:03:10.602507 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cca6aa37-fd70-4931-bf1b-36c24edcd4ac tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "DELETE /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379" status: 204 len: 0 microversion: 2.1 time: 0.420569 Jun 10 19:03:10.605272 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4228/7850] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 19:03:10 2022] DELETE /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 19:03:10.613014 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6cf28163-e648-48c6-ace8-33e56da4e1ad tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:03:10.614166 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6cf28163-e648-48c6-ace8-33e56da4e1ad tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: c86ed260-18d0-4504-9c89-e98812fc9379] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:03:10.622285 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6cf28163-e648-48c6-ace8-33e56da4e1ad tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:10.622877 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6cf28163-e648-48c6-ace8-33e56da4e1ad tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:10.623614 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6cf28163-e648-48c6-ace8-33e56da4e1ad tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:10.624217 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6cf28163-e648-48c6-ace8-33e56da4e1ad tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:10.770571 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6cf28163-e648-48c6-ace8-33e56da4e1ad tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8360bcc5196e4d6f93b0676b7440621a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19eafdcc2e7c4f8a9b4cd13a584cf982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:03:10.778506 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6cf28163-e648-48c6-ace8-33e56da4e1ad tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "GET /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379" status: 200 len: 1559 microversion: 2.1 time: 0.170253 Jun 10 19:03:10.779079 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4229/7851] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:03:10 2022] GET /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:03:11.798859 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-73f9fb96-d107-4b80-b843-ef4da42053e5 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:03:11.799519 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-73f9fb96-d107-4b80-b843-ef4da42053e5 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: c86ed260-18d0-4504-9c89-e98812fc9379] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:03:11.807191 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-73f9fb96-d107-4b80-b843-ef4da42053e5 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:11.807660 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-73f9fb96-d107-4b80-b843-ef4da42053e5 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:11.808466 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-73f9fb96-d107-4b80-b843-ef4da42053e5 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:11.808915 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-73f9fb96-d107-4b80-b843-ef4da42053e5 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:11.938178 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-73f9fb96-d107-4b80-b843-ef4da42053e5 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8360bcc5196e4d6f93b0676b7440621a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19eafdcc2e7c4f8a9b4cd13a584cf982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:03:11.946428 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-73f9fb96-d107-4b80-b843-ef4da42053e5 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "GET /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379" status: 200 len: 1559 microversion: 2.1 time: 0.151499 Jun 10 19:03:11.947011 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4230/7852] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:03:11 2022] GET /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:03:12.879604 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-51351059-bd9c-42e6-b8d8-6bf813f3de33 req-0f33b50d-8293-46e8-8fd6-c76befe10ade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c86ed260-18d0-4504-9c89-e98812fc9379", "name": "network-vif-deleted", "tag": "35ce6532-626b-4229-b13d-a7375afa7992"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:03:12.889037 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-51351059-bd9c-42e6-b8d8-6bf813f3de33 req-0f33b50d-8293-46e8-8fd6-c76befe10ade service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:12.892104 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-51351059-bd9c-42e6-b8d8-6bf813f3de33 req-0f33b50d-8293-46e8-8fd6-c76befe10ade service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:12.900359 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-51351059-bd9c-42e6-b8d8-6bf813f3de33 req-0f33b50d-8293-46e8-8fd6-c76befe10ade service nova] Creating event network-vif-deleted:35ce6532-626b-4229-b13d-a7375afa7992 for instance c86ed260-18d0-4504-9c89-e98812fc9379 on chh1-master-2 Jun 10 19:03:12.905151 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-51351059-bd9c-42e6-b8d8-6bf813f3de33 req-0f33b50d-8293-46e8-8fd6-c76befe10ade service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029200 Jun 10 19:03:12.905732 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4231/7853] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:03:12.964392 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0dbb8c34-26d2-46dc-9e72-a9372a21984b tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:03:12.965109 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0dbb8c34-26d2-46dc-9e72-a9372a21984b tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: c86ed260-18d0-4504-9c89-e98812fc9379] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:03:12.971531 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0dbb8c34-26d2-46dc-9e72-a9372a21984b tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:12.971992 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0dbb8c34-26d2-46dc-9e72-a9372a21984b tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:12.972807 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0dbb8c34-26d2-46dc-9e72-a9372a21984b tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:12.974011 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0dbb8c34-26d2-46dc-9e72-a9372a21984b tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:13.044597 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0dbb8c34-26d2-46dc-9e72-a9372a21984b tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8360bcc5196e4d6f93b0676b7440621a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19eafdcc2e7c4f8a9b4cd13a584cf982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:03:13.053149 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0dbb8c34-26d2-46dc-9e72-a9372a21984b tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "GET /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379" status: 200 len: 1517 microversion: 2.1 time: 0.093092 Jun 10 19:03:13.053737 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4232/7854] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:03:12 2022] GET /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379 => generated 1517 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:03:14.070338 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-70e665c0-a97f-45e9-a252-0e916e756534 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:03:14.071012 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-70e665c0-a97f-45e9-a252-0e916e756534 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] [instance: c86ed260-18d0-4504-9c89-e98812fc9379] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:03:14.078164 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70e665c0-a97f-45e9-a252-0e916e756534 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:14.078625 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70e665c0-a97f-45e9-a252-0e916e756534 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:14.079393 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70e665c0-a97f-45e9-a252-0e916e756534 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:14.079838 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-70e665c0-a97f-45e9-a252-0e916e756534 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:14.095491 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-70e665c0-a97f-45e9-a252-0e916e756534 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] HTTP exception thrown: Instance c86ed260-18d0-4504-9c89-e98812fc9379 could not be found. Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-70e665c0-a97f-45e9-a252-0e916e756534 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Request method failure captured: Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379 HTTP/1.1 Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5UbBGUpFF1h3DI1uMGA4EG5rQIgAqEAc0kJk6RITFKPq7tztuq7hu6jW4UVlzXtibiXEB03gH_TufNCPAJA-oxc3yvqaYj7SBsBOaTwEgq9XBasOqNWvp_oeG0GiArVhPRvKK3Vdm8QZtQaLEWuA5gZliskypUqyIn9uBVQGDMuvXc Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 19eafdcc2e7c4f8a9b4cd13a584cf982 Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1604319331 Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/19eafdcc2e7c4f8a9b4cd13a584cf982"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/19eafdcc2e7c4f8a9b4cd13a584cf982"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/19eafdcc2e7c4f8a9b4cd13a584cf982"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_19eafdcc2e7c4f8a9b4cd13a584cf982", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-TestEncryptedCinderVolumes-1604319331 Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 19eafdcc2e7c4f8a9b4cd13a584cf982 Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1604319331 Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-TestEncryptedCinderVolumes-1604319331-project Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 8360bcc5196e4d6f93b0676b7440621a Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-TestEncryptedCinderVolumes-1604319331-project Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: exception: Instance c86ed260-18d0-4504-9c89-e98812fc9379 could not be found. Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'c86ed260-18d0-4504-9c89-e98812fc9379'} Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c86ed260-18d0-4504-9c89-e98812fc9379 could not be found. Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c86ed260-18d0-4504-9c89-e98812fc9379 could not be found. Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:03:14.097181 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:03:14.103723 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:03:14.103723 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:03:14.103723 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:03:14.103723 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 19:03:14.103723 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 19:03:14.103723 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c86ed260-18d0-4504-9c89-e98812fc9379 could not be found. Jun 10 19:03:14.103723 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:03:14.103723 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-70e665c0-a97f-45e9-a252-0e916e756534 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Returning 404 to user: Instance c86ed260-18d0-4504-9c89-e98812fc9379 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 19:03:14.103723 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-70e665c0-a97f-45e9-a252-0e916e756534 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "GET /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379" status: 404 len: 111 microversion: 2.1 time: 0.032207 Jun 10 19:03:14.103723 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4233/7855] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:03:14 2022] GET /compute/v2.1/servers/c86ed260-18d0-4504-9c89-e98812fc9379 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 19:03:14.107335 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-04867a76-8614-49b8-a579-7c10114382f2 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] Calling method '.version_select at 0x7f77c1232700>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:03:14.183648 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-04867a76-8614-49b8-a579-7c10114382f2 tempest-TestEncryptedCinderVolumes-1604319331 tempest-TestEncryptedCinderVolumes-1604319331-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-98846522" status: 202 len: 0 microversion: 2.1 time: 0.079731 Jun 10 19:03:14.184253 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4234/7856] 10.222.0.35 () {58 vars in 1271 bytes} [Fri Jun 10 19:03:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-98846522 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 10 19:03:46.626042 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:03:46.626863 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:03:46.631327 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8e2505d9-1cf1-4d79-a3f3-0158f2110da7 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Action: 'create', calling method: .version_select at 0x7f77c051a040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-242804288", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjIMr6gjfQYQzZeDFHlm9szlksvwcll7kq9LqxyhV/ohUeOFTO+vNqZl7DahORFEGjAUI25ieicX2ZXxrASkdkbmURv+rq6Wh0pmXYNQEC0jFG3p4dT7Y6TsxpZ4ApHJg=="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:03:46.646971 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-8e2505d9-1cf1-4d79-a3f3-0158f2110da7 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Getting quotas for project 61b6e379f89543fb8bf4757cb46d3f67. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 19:03:46.652228 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-8e2505d9-1cf1-4d79-a3f3-0158f2110da7 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Getting quotas for user 1c7fc0349a45486993756ef66ebe9f99 and project 61b6e379f89543fb8bf4757cb46d3f67. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 19:03:46.743266 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8e2505d9-1cf1-4d79-a3f3-0158f2110da7 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.119256 Jun 10 19:03:46.743801 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4235/7857] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 19:03:46 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:03:46.791449 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f3e95421-f7dc-42b5-8156-c15f48b4ea83 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-673317841", "imageRef": "88f68a41-e7ef-4c46-ac57-b3a282d860de", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-242804288", "networks": [{"uuid": "c390538a-e81f-4251-8f46-9b8f62bcb2a8"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:03:46.841842 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-f3e95421-f7dc-42b5-8156-c15f48b4ea83 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] validate_networks() for [('c390538a-e81f-4251-8f46-9b8f62bcb2a8', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 19:03:47.298239 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-f3e95421-f7dc-42b5-8156-c15f48b4ea83 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 19:03:47.298664 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-f3e95421-f7dc-42b5-8156-c15f48b4ea83 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 19:03:47.299138 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-f3e95421-f7dc-42b5-8156-c15f48b4ea83 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 19:03:47.299555 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-f3e95421-f7dc-42b5-8156-c15f48b4ea83 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 19:03:47.299971 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-f3e95421-f7dc-42b5-8156-c15f48b4ea83 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 19:03:47.308697 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f3e95421-f7dc-42b5-8156-c15f48b4ea83 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:47.309145 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f3e95421-f7dc-42b5-8156-c15f48b4ea83 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:47.309950 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f3e95421-f7dc-42b5-8156-c15f48b4ea83 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:47.310383 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f3e95421-f7dc-42b5-8156-c15f48b4ea83 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:47.327197 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-f3e95421-f7dc-42b5-8156-c15f48b4ea83 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Getting quotas for project 61b6e379f89543fb8bf4757cb46d3f67. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 19:03:47.332915 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-f3e95421-f7dc-42b5-8156-c15f48b4ea83 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Getting quotas for user 1c7fc0349a45486993756ef66ebe9f99 and project 61b6e379f89543fb8bf4757cb46d3f67. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 19:03:47.344979 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f3e95421-f7dc-42b5-8156-c15f48b4ea83 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 19:03:47.347120 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f3e95421-f7dc-42b5-8156-c15f48b4ea83 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88f68a41-e7ef-4c46-ac57-b3a282d860de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 19:03:47.471674 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f3e95421-f7dc-42b5-8156-c15f48b4ea83 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.684465 Jun 10 19:03:47.472353 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4236/7858] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 19:03:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 10 19:03:47.481903 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b20f52d0-3b60-40e2-b8f0-4a3f6ca44a41 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:03:47.482514 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b20f52d0-3b60-40e2-b8f0-4a3f6ca44a41 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:03:47.540174 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b20f52d0-3b60-40e2-b8f0-4a3f6ca44a41 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7fc0349a45486993756ef66ebe9f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b6e379f89543fb8bf4757cb46d3f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:03:47.547073 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b20f52d0-3b60-40e2-b8f0-4a3f6ca44a41 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72" status: 200 len: 1257 microversion: 2.1 time: 0.068788 Jun 10 19:03:47.556405 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4237/7859] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:03:47 2022] GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72 => generated 1257 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:03:48.563070 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ac405357-b60a-4b97-948a-39018c8ee43f tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:03:48.563682 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ac405357-b60a-4b97-948a-39018c8ee43f tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:03:48.571502 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ac405357-b60a-4b97-948a-39018c8ee43f tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:48.571963 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ac405357-b60a-4b97-948a-39018c8ee43f tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:48.572778 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ac405357-b60a-4b97-948a-39018c8ee43f tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:48.573224 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ac405357-b60a-4b97-948a-39018c8ee43f tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:48.634957 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ac405357-b60a-4b97-948a-39018c8ee43f tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7fc0349a45486993756ef66ebe9f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b6e379f89543fb8bf4757cb46d3f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:03:48.642508 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ac405357-b60a-4b97-948a-39018c8ee43f tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72" status: 200 len: 1261 microversion: 2.1 time: 0.083373 Jun 10 19:03:48.643085 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4238/7860] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:03:48 2022] GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72 => generated 1261 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:03:49.659553 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d02e4620-a083-48ce-bce0-853d35ed5beb tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:03:49.660518 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d02e4620-a083-48ce-bce0-853d35ed5beb tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:03:49.668234 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d02e4620-a083-48ce-bce0-853d35ed5beb tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:49.668786 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d02e4620-a083-48ce-bce0-853d35ed5beb tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:49.669631 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d02e4620-a083-48ce-bce0-853d35ed5beb tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:49.670135 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d02e4620-a083-48ce-bce0-853d35ed5beb tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:49.733363 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d02e4620-a083-48ce-bce0-853d35ed5beb tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7fc0349a45486993756ef66ebe9f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b6e379f89543fb8bf4757cb46d3f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:03:49.742139 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d02e4620-a083-48ce-bce0-853d35ed5beb tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72" status: 200 len: 1317 microversion: 2.1 time: 0.086720 Jun 10 19:03:49.742725 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4239/7861] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:03:49 2022] GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72 => generated 1317 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:03:50.763493 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-874b7558-ff5f-4748-96e6-b3b284407bfc tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:03:50.765265 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-874b7558-ff5f-4748-96e6-b3b284407bfc tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:03:50.773335 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-874b7558-ff5f-4748-96e6-b3b284407bfc tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:50.774068 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-874b7558-ff5f-4748-96e6-b3b284407bfc tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:50.775374 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-874b7558-ff5f-4748-96e6-b3b284407bfc tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:50.780353 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-874b7558-ff5f-4748-96e6-b3b284407bfc tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:50.952879 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-874b7558-ff5f-4748-96e6-b3b284407bfc tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7fc0349a45486993756ef66ebe9f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b6e379f89543fb8bf4757cb46d3f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:03:50.967492 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-874b7558-ff5f-4748-96e6-b3b284407bfc tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72" status: 200 len: 1357 microversion: 2.1 time: 0.208324 Jun 10 19:03:50.968754 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4240/7862] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:03:50 2022] GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72 => generated 1357 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:03:51.985816 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c0231dbe-78ec-4bf2-95b3-d8d6c654b2dd tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:03:51.987444 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c0231dbe-78ec-4bf2-95b3-d8d6c654b2dd tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:03:52.005449 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c0231dbe-78ec-4bf2-95b3-d8d6c654b2dd tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:52.006262 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c0231dbe-78ec-4bf2-95b3-d8d6c654b2dd tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:52.007254 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c0231dbe-78ec-4bf2-95b3-d8d6c654b2dd tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:52.008020 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c0231dbe-78ec-4bf2-95b3-d8d6c654b2dd tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:52.150400 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c0231dbe-78ec-4bf2-95b3-d8d6c654b2dd tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7fc0349a45486993756ef66ebe9f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b6e379f89543fb8bf4757cb46d3f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:03:52.158958 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c0231dbe-78ec-4bf2-95b3-d8d6c654b2dd tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72" status: 200 len: 1357 microversion: 2.1 time: 0.177268 Jun 10 19:03:52.159857 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4241/7863] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:03:51 2022] GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72 => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:03:53.176400 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9e4b0c12-08c5-47b6-92d6-124a764ec6ca tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:03:53.177857 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9e4b0c12-08c5-47b6-92d6-124a764ec6ca tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:03:53.190339 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9e4b0c12-08c5-47b6-92d6-124a764ec6ca tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:53.190803 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9e4b0c12-08c5-47b6-92d6-124a764ec6ca tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:53.191811 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9e4b0c12-08c5-47b6-92d6-124a764ec6ca tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:53.192249 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9e4b0c12-08c5-47b6-92d6-124a764ec6ca tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:53.335957 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9e4b0c12-08c5-47b6-92d6-124a764ec6ca tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7fc0349a45486993756ef66ebe9f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b6e379f89543fb8bf4757cb46d3f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:03:53.343833 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9e4b0c12-08c5-47b6-92d6-124a764ec6ca tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72" status: 200 len: 1357 microversion: 2.1 time: 0.171314 Jun 10 19:03:53.350153 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4242/7864] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:03:53 2022] GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72 => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:03:54.362554 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7cc09066-5b37-428e-bd31-f54c7949f9be tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:03:54.363388 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7cc09066-5b37-428e-bd31-f54c7949f9be tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:03:54.371948 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7cc09066-5b37-428e-bd31-f54c7949f9be tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:54.372449 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7cc09066-5b37-428e-bd31-f54c7949f9be tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:54.373554 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7cc09066-5b37-428e-bd31-f54c7949f9be tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:54.374000 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7cc09066-5b37-428e-bd31-f54c7949f9be tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:54.521148 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7cc09066-5b37-428e-bd31-f54c7949f9be tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7fc0349a45486993756ef66ebe9f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b6e379f89543fb8bf4757cb46d3f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:03:54.529414 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7cc09066-5b37-428e-bd31-f54c7949f9be tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72" status: 200 len: 1357 microversion: 2.1 time: 0.171278 Jun 10 19:03:54.530186 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4243/7865] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:03:54 2022] GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72 => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:03:55.547394 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-30d46125-0952-4d96-946d-ba6d432f0e16 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:03:55.548373 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-30d46125-0952-4d96-946d-ba6d432f0e16 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:03:55.555531 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30d46125-0952-4d96-946d-ba6d432f0e16 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:55.556066 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30d46125-0952-4d96-946d-ba6d432f0e16 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:55.556942 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30d46125-0952-4d96-946d-ba6d432f0e16 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:55.557456 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-30d46125-0952-4d96-946d-ba6d432f0e16 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:55.694785 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-30d46125-0952-4d96-946d-ba6d432f0e16 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7fc0349a45486993756ef66ebe9f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b6e379f89543fb8bf4757cb46d3f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:03:55.703048 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-30d46125-0952-4d96-946d-ba6d432f0e16 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72" status: 200 len: 1357 microversion: 2.1 time: 0.159687 Jun 10 19:03:55.703883 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4244/7866] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:03:55 2022] GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:03:56.721137 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-631baa4f-a83f-4f58-86c6-05fbd6ec8781 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:03:56.721829 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-631baa4f-a83f-4f58-86c6-05fbd6ec8781 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:03:56.740397 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-631baa4f-a83f-4f58-86c6-05fbd6ec8781 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:56.741101 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-631baa4f-a83f-4f58-86c6-05fbd6ec8781 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:56.741951 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-631baa4f-a83f-4f58-86c6-05fbd6ec8781 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:56.742394 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-631baa4f-a83f-4f58-86c6-05fbd6ec8781 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:56.887675 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-631baa4f-a83f-4f58-86c6-05fbd6ec8781 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7fc0349a45486993756ef66ebe9f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b6e379f89543fb8bf4757cb46d3f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:03:56.896478 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-631baa4f-a83f-4f58-86c6-05fbd6ec8781 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72" status: 200 len: 1357 microversion: 2.1 time: 0.179280 Jun 10 19:03:56.897242 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4245/7867] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:03:56 2022] GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72 => generated 1357 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:03:57.911187 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:03:57.912703 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=12 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:03:57.917823 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6e4228de-fb74-484e-b9cc-2c2dd92c6725 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:03:57.918541 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6e4228de-fb74-484e-b9cc-2c2dd92c6725 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:03:57.925077 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6e4228de-fb74-484e-b9cc-2c2dd92c6725 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:57.931020 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6e4228de-fb74-484e-b9cc-2c2dd92c6725 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:57.931020 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6e4228de-fb74-484e-b9cc-2c2dd92c6725 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:57.931020 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6e4228de-fb74-484e-b9cc-2c2dd92c6725 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:58.066774 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6e4228de-fb74-484e-b9cc-2c2dd92c6725 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7fc0349a45486993756ef66ebe9f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b6e379f89543fb8bf4757cb46d3f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:03:58.074603 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6e4228de-fb74-484e-b9cc-2c2dd92c6725 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72" status: 200 len: 1357 microversion: 2.1 time: 0.165087 Jun 10 19:03:58.076086 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4246/7868] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:03:57 2022] GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:03:58.661758 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-cbae4db5-aab3-480b-9399-0d133e616dbf req-9d590aa9-545e-42c8-883d-00ae7765401e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76f009bd-2c72-4811-8e5c-23b3bb039b72", "tag": "98cb1223-126b-4cb5-be81-bc2e63b7912f"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:03:58.671918 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-cbae4db5-aab3-480b-9399-0d133e616dbf req-9d590aa9-545e-42c8-883d-00ae7765401e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:58.672514 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-cbae4db5-aab3-480b-9399-0d133e616dbf req-9d590aa9-545e-42c8-883d-00ae7765401e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:58.685225 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-cbae4db5-aab3-480b-9399-0d133e616dbf req-9d590aa9-545e-42c8-883d-00ae7765401e service nova] Creating event network-changed:98cb1223-126b-4cb5-be81-bc2e63b7912f for instance 76f009bd-2c72-4811-8e5c-23b3bb039b72 on chh1-master-2 Jun 10 19:03:58.690462 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-cbae4db5-aab3-480b-9399-0d133e616dbf req-9d590aa9-545e-42c8-883d-00ae7765401e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033371 Jun 10 19:03:58.691356 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4247/7869] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:03:59.091626 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fa200d3a-2b74-4de6-9f1f-f8292e7250c7 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:03:59.092365 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fa200d3a-2b74-4de6-9f1f-f8292e7250c7 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:03:59.100661 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa200d3a-2b74-4de6-9f1f-f8292e7250c7 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:59.100846 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa200d3a-2b74-4de6-9f1f-f8292e7250c7 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:59.101626 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa200d3a-2b74-4de6-9f1f-f8292e7250c7 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:03:59.102069 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa200d3a-2b74-4de6-9f1f-f8292e7250c7 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:03:59.235761 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fa200d3a-2b74-4de6-9f1f-f8292e7250c7 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7fc0349a45486993756ef66ebe9f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b6e379f89543fb8bf4757cb46d3f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:03:59.243286 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fa200d3a-2b74-4de6-9f1f-f8292e7250c7 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72" status: 200 len: 1357 microversion: 2.1 time: 0.155911 Jun 10 19:03:59.243865 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4248/7870] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:03:59 2022] GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:04:00.260473 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c839597c-7478-46ff-aaae-e516d46841aa tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:04:00.261186 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c839597c-7478-46ff-aaae-e516d46841aa tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:04:00.268063 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c839597c-7478-46ff-aaae-e516d46841aa tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:00.268557 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c839597c-7478-46ff-aaae-e516d46841aa tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:00.269373 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c839597c-7478-46ff-aaae-e516d46841aa tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:00.269830 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c839597c-7478-46ff-aaae-e516d46841aa tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:00.406882 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c839597c-7478-46ff-aaae-e516d46841aa tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7fc0349a45486993756ef66ebe9f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b6e379f89543fb8bf4757cb46d3f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:04:00.415356 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c839597c-7478-46ff-aaae-e516d46841aa tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72" status: 200 len: 1357 microversion: 2.1 time: 0.159023 Jun 10 19:04:00.415942 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4249/7871] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:04:00 2022] GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:04:01.432940 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5c32bac4-fcfc-41b2-9663-254b939056ac tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:04:01.433563 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5c32bac4-fcfc-41b2-9663-254b939056ac tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:04:01.440654 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5c32bac4-fcfc-41b2-9663-254b939056ac tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:01.441061 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5c32bac4-fcfc-41b2-9663-254b939056ac tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:01.442475 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5c32bac4-fcfc-41b2-9663-254b939056ac tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:01.442928 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5c32bac4-fcfc-41b2-9663-254b939056ac tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:01.568833 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5c32bac4-fcfc-41b2-9663-254b939056ac tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7fc0349a45486993756ef66ebe9f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b6e379f89543fb8bf4757cb46d3f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:04:01.576275 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5c32bac4-fcfc-41b2-9663-254b939056ac tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72" status: 200 len: 1357 microversion: 2.1 time: 0.147335 Jun 10 19:04:01.576879 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4250/7872] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:04:01 2022] GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72 => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:04:02.593420 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-21822248-063a-4b85-9208-9d49de721ec9 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:04:02.598594 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-21822248-063a-4b85-9208-9d49de721ec9 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:04:02.601113 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-21822248-063a-4b85-9208-9d49de721ec9 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:02.601569 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-21822248-063a-4b85-9208-9d49de721ec9 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:02.602344 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-21822248-063a-4b85-9208-9d49de721ec9 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:02.602792 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-21822248-063a-4b85-9208-9d49de721ec9 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:02.734530 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-21822248-063a-4b85-9208-9d49de721ec9 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7fc0349a45486993756ef66ebe9f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b6e379f89543fb8bf4757cb46d3f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:04:02.742576 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-21822248-063a-4b85-9208-9d49de721ec9 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72" status: 200 len: 1357 microversion: 2.1 time: 0.153065 Jun 10 19:04:02.743155 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4251/7873] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:04:02 2022] GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:04:03.760220 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1344ef9c-09e8-4bae-ad2c-10fcd26f4652 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:04:03.760879 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1344ef9c-09e8-4bae-ad2c-10fcd26f4652 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:04:03.767748 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1344ef9c-09e8-4bae-ad2c-10fcd26f4652 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:03.768226 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1344ef9c-09e8-4bae-ad2c-10fcd26f4652 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:03.769015 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1344ef9c-09e8-4bae-ad2c-10fcd26f4652 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:03.769975 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1344ef9c-09e8-4bae-ad2c-10fcd26f4652 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:03.907200 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1344ef9c-09e8-4bae-ad2c-10fcd26f4652 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7fc0349a45486993756ef66ebe9f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b6e379f89543fb8bf4757cb46d3f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:04:03.916568 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1344ef9c-09e8-4bae-ad2c-10fcd26f4652 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72" status: 200 len: 1357 microversion: 2.1 time: 0.159691 Jun 10 19:04:03.917252 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4252/7874] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:04:03 2022] GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:04:03.957832 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-5273428a-fc32-499d-a5e7-7d346ebb124a req-74625bcf-dbaf-4576-acf3-1d2b62c22e49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76f009bd-2c72-4811-8e5c-23b3bb039b72", "name": "network-vif-plugged", "status": "completed", "tag": "98cb1223-126b-4cb5-be81-bc2e63b7912f"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:04:03.967128 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-5273428a-fc32-499d-a5e7-7d346ebb124a req-74625bcf-dbaf-4576-acf3-1d2b62c22e49 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:03.967567 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-5273428a-fc32-499d-a5e7-7d346ebb124a req-74625bcf-dbaf-4576-acf3-1d2b62c22e49 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:03.978533 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-5273428a-fc32-499d-a5e7-7d346ebb124a req-74625bcf-dbaf-4576-acf3-1d2b62c22e49 service nova] Creating event network-vif-plugged:98cb1223-126b-4cb5-be81-bc2e63b7912f for instance 76f009bd-2c72-4811-8e5c-23b3bb039b72 on chh1-master-2 Jun 10 19:04:03.983552 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-5273428a-fc32-499d-a5e7-7d346ebb124a req-74625bcf-dbaf-4576-acf3-1d2b62c22e49 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030996 Jun 10 19:04:03.984148 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4253/7875] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:04:04.934415 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9498bb3e-de04-4f98-87fb-8bd9c1da8788 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:04:04.935074 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9498bb3e-de04-4f98-87fb-8bd9c1da8788 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:04:04.941314 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9498bb3e-de04-4f98-87fb-8bd9c1da8788 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:04.941767 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9498bb3e-de04-4f98-87fb-8bd9c1da8788 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:04.942524 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9498bb3e-de04-4f98-87fb-8bd9c1da8788 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:04.942962 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9498bb3e-de04-4f98-87fb-8bd9c1da8788 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:05.072285 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9498bb3e-de04-4f98-87fb-8bd9c1da8788 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7fc0349a45486993756ef66ebe9f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b6e379f89543fb8bf4757cb46d3f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:04:05.080317 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9498bb3e-de04-4f98-87fb-8bd9c1da8788 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72" status: 200 len: 1357 microversion: 2.1 time: 0.151135 Jun 10 19:04:05.080911 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4254/7876] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:04:04 2022] GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:04:06.098424 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2a60deb5-03c0-49f9-9c46-1d8d49368439 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:04:06.099115 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2a60deb5-03c0-49f9-9c46-1d8d49368439 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:04:06.106017 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2a60deb5-03c0-49f9-9c46-1d8d49368439 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:06.106463 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2a60deb5-03c0-49f9-9c46-1d8d49368439 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:06.107214 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2a60deb5-03c0-49f9-9c46-1d8d49368439 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:06.107649 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2a60deb5-03c0-49f9-9c46-1d8d49368439 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:06.129166 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:04:06.240701 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2a60deb5-03c0-49f9-9c46-1d8d49368439 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7fc0349a45486993756ef66ebe9f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b6e379f89543fb8bf4757cb46d3f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:04:06.248526 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2a60deb5-03c0-49f9-9c46-1d8d49368439 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72" status: 200 len: 1547 microversion: 2.1 time: 0.154465 Jun 10 19:04:06.249100 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4255/7877] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:04:06 2022] GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72 => generated 1547 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:04:06.263889 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fae97434-b05b-4a87-9142-55c561d0553b tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:04:06.264545 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fae97434-b05b-4a87-9142-55c561d0553b tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:04:06.270348 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fae97434-b05b-4a87-9142-55c561d0553b tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:06.270803 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fae97434-b05b-4a87-9142-55c561d0553b tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:06.271572 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fae97434-b05b-4a87-9142-55c561d0553b tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:06.272012 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fae97434-b05b-4a87-9142-55c561d0553b tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:06.397868 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fae97434-b05b-4a87-9142-55c561d0553b tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7fc0349a45486993756ef66ebe9f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b6e379f89543fb8bf4757cb46d3f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:04:06.405467 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fae97434-b05b-4a87-9142-55c561d0553b tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72" status: 200 len: 1547 microversion: 2.1 time: 0.145120 Jun 10 19:04:06.406040 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4256/7878] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:04:06 2022] GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72 => generated 1547 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:04:06.421243 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1d682ff5-732f-4ffc-b56d-fbbc8af6adc8 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:04:06.424523 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1d682ff5-732f-4ffc-b56d-fbbc8af6adc8 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1c7fc0349a45486993756ef66ebe9f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b6e379f89543fb8bf4757cb46d3f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:04:06.425286 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1d682ff5-732f-4ffc-b56d-fbbc8af6adc8 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Searching by: {'deleted': False, 'project_id': '61b6e379f89543fb8bf4757cb46d3f67'} {{(pid=126595) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 10 19:04:06.431159 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d682ff5-732f-4ffc-b56d-fbbc8af6adc8 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:06.431610 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d682ff5-732f-4ffc-b56d-fbbc8af6adc8 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:06.432437 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d682ff5-732f-4ffc-b56d-fbbc8af6adc8 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:06.432883 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d682ff5-732f-4ffc-b56d-fbbc8af6adc8 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:06.456772 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.multi_cell_list [None req-1d682ff5-732f-4ffc-b56d-fbbc8af6adc8 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126595) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 10 19:04:06.483673 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1d682ff5-732f-4ffc-b56d-fbbc8af6adc8 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.066024 Jun 10 19:04:06.484243 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4257/7879] 10.222.0.35 () {58 vars in 1124 bytes} [Fri Jun 10 19:04:06 2022] GET /compute/v2.1/servers => generated 342 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:04:06.494381 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6a9355f8-aad3-4fc6-b847-d2e72f692763 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:04:06.495242 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6a9355f8-aad3-4fc6-b847-d2e72f692763 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:04:06.500894 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a9355f8-aad3-4fc6-b847-d2e72f692763 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:06.501343 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a9355f8-aad3-4fc6-b847-d2e72f692763 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:06.502090 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a9355f8-aad3-4fc6-b847-d2e72f692763 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:06.502528 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a9355f8-aad3-4fc6-b847-d2e72f692763 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:06.631769 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6a9355f8-aad3-4fc6-b847-d2e72f692763 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7fc0349a45486993756ef66ebe9f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b6e379f89543fb8bf4757cb46d3f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:04:06.639315 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6a9355f8-aad3-4fc6-b847-d2e72f692763 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72" status: 200 len: 1547 microversion: 2.1 time: 0.148406 Jun 10 19:04:06.639886 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4258/7880] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:04:06 2022] GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72 => generated 1547 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:04:09.519689 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4607d551-3d05-4d2a-934a-04ba419c2d15 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "56f25617-e199-4145-bffa-b72b10f6cb84"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:04:09.520811 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4607d551-3d05-4d2a-934a-04ba419c2d15 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:04:09.527824 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4607d551-3d05-4d2a-934a-04ba419c2d15 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:09.528282 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4607d551-3d05-4d2a-934a-04ba419c2d15 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:09.529074 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4607d551-3d05-4d2a-934a-04ba419c2d15 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:09.529519 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4607d551-3d05-4d2a-934a-04ba419c2d15 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:10.164818 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4607d551-3d05-4d2a-934a-04ba419c2d15 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "POST /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.648886 Jun 10 19:04:10.165639 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4259/7881] 10.222.0.35 () {60 vars in 1322 bytes} [Fri Jun 10 19:04:09 2022] POST /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72/os-volume_attachments => generated 194 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:04:21.914532 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-57e4022e-0b6e-4543-bb3d-cbeec984a0dc tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:04:21.915267 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-57e4022e-0b6e-4543-bb3d-cbeec984a0dc tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:04:21.918282 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:04:21.919174 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:04:21.919825 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:04:21.925136 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-57e4022e-0b6e-4543-bb3d-cbeec984a0dc tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:21.925673 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-57e4022e-0b6e-4543-bb3d-cbeec984a0dc tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:21.927252 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-57e4022e-0b6e-4543-bb3d-cbeec984a0dc tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:21.927691 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-57e4022e-0b6e-4543-bb3d-cbeec984a0dc tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:22.062778 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-57e4022e-0b6e-4543-bb3d-cbeec984a0dc tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7fc0349a45486993756ef66ebe9f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b6e379f89543fb8bf4757cb46d3f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:04:22.070563 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-57e4022e-0b6e-4543-bb3d-cbeec984a0dc tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72" status: 200 len: 1593 microversion: 2.1 time: 0.160767 Jun 10 19:04:22.071143 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4260/7882] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:04:21 2022] GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72 => generated 1593 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:04:24.369185 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-97e188e7-b198-427f-a756-eba4e1e4c4dd req-7dcb5961-739a-450a-bc7d-d5432981c698 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76f009bd-2c72-4811-8e5c-23b3bb039b72", "tag": "98cb1223-126b-4cb5-be81-bc2e63b7912f"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:04:24.378790 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-97e188e7-b198-427f-a756-eba4e1e4c4dd req-7dcb5961-739a-450a-bc7d-d5432981c698 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:24.379055 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-97e188e7-b198-427f-a756-eba4e1e4c4dd req-7dcb5961-739a-450a-bc7d-d5432981c698 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:24.391000 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-97e188e7-b198-427f-a756-eba4e1e4c4dd req-7dcb5961-739a-450a-bc7d-d5432981c698 service nova] Creating event network-changed:98cb1223-126b-4cb5-be81-bc2e63b7912f for instance 76f009bd-2c72-4811-8e5c-23b3bb039b72 on chh1-master-2 Jun 10 19:04:24.396275 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-97e188e7-b198-427f-a756-eba4e1e4c4dd req-7dcb5961-739a-450a-bc7d-d5432981c698 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158223 Jun 10 19:04:24.397131 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4261/7883] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:04:26.593184 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f8638f4d-9d02-47a5-a642-db6f0cdf821a tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-561617201"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:04:26.593912 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f8638f4d-9d02-47a5-a642-db6f0cdf821a tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:04:26.600649 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8638f4d-9d02-47a5-a642-db6f0cdf821a tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:26.601154 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8638f4d-9d02-47a5-a642-db6f0cdf821a tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:26.601928 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8638f4d-9d02-47a5-a642-db6f0cdf821a tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:26.602368 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8638f4d-9d02-47a5-a642-db6f0cdf821a tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:26.728716 chdv-master-2 devstack@n-api.service[126595]: INFO nova.network.security_group_api [None req-f8638f4d-9d02-47a5-a642-db6f0cdf821a tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Adding security group 27750e7e-510a-400e-a0d5-70b3deb74f35 to port 98cb1223-126b-4cb5-be81-bc2e63b7912f Jun 10 19:04:27.181614 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f8638f4d-9d02-47a5-a642-db6f0cdf821a tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "POST /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72/action" status: 202 len: 0 microversion: 2.1 time: 0.593895 Jun 10 19:04:27.186293 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4262/7884] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 19:04:26 2022] POST /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72/action => generated 0 bytes in 600 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 19:04:27.191704 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-3fadfd23-6290-4e5d-89bf-6d45db475a6f req-c30ac385-71a3-4334-a107-27230f8e97af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76f009bd-2c72-4811-8e5c-23b3bb039b72", "tag": "98cb1223-126b-4cb5-be81-bc2e63b7912f"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:04:27.210575 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-3fadfd23-6290-4e5d-89bf-6d45db475a6f req-c30ac385-71a3-4334-a107-27230f8e97af service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:27.212130 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-3fadfd23-6290-4e5d-89bf-6d45db475a6f req-c30ac385-71a3-4334-a107-27230f8e97af service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:27.229909 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-3fadfd23-6290-4e5d-89bf-6d45db475a6f req-c30ac385-71a3-4334-a107-27230f8e97af service nova] Creating event network-changed:98cb1223-126b-4cb5-be81-bc2e63b7912f for instance 76f009bd-2c72-4811-8e5c-23b3bb039b72 on chh1-master-2 Jun 10 19:04:27.235479 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-3fadfd23-6290-4e5d-89bf-6d45db475a6f req-c30ac385-71a3-4334-a107-27230f8e97af service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048032 Jun 10 19:04:27.236119 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4263/7885] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:04:27.241316 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6a5a9fa7-ee52-41e0-8e52-e9c4b0593cdd tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:04:27.242032 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6a5a9fa7-ee52-41e0-8e52-e9c4b0593cdd tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:04:27.249473 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a5a9fa7-ee52-41e0-8e52-e9c4b0593cdd tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:27.249929 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a5a9fa7-ee52-41e0-8e52-e9c4b0593cdd tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:27.250703 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a5a9fa7-ee52-41e0-8e52-e9c4b0593cdd tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:27.251143 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6a5a9fa7-ee52-41e0-8e52-e9c4b0593cdd tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:27.466417 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6a5a9fa7-ee52-41e0-8e52-e9c4b0593cdd tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7fc0349a45486993756ef66ebe9f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b6e379f89543fb8bf4757cb46d3f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:04:27.476412 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6a5a9fa7-ee52-41e0-8e52-e9c4b0593cdd tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72" status: 200 len: 1758 microversion: 2.1 time: 0.238868 Jun 10 19:04:27.480350 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4264/7886] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:04:27 2022] GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72 => generated 1758 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:04:41.467389 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d674c3f7-4e82-4a12-8fed-99db7ccd3f3e tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:04:41.468370 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d674c3f7-4e82-4a12-8fed-99db7ccd3f3e tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:04:41.471288 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=10 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:04:41.471971 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=20 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:04:41.476942 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d674c3f7-4e82-4a12-8fed-99db7ccd3f3e tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:41.477406 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d674c3f7-4e82-4a12-8fed-99db7ccd3f3e tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:41.478173 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d674c3f7-4e82-4a12-8fed-99db7ccd3f3e tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:41.478617 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d674c3f7-4e82-4a12-8fed-99db7ccd3f3e tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:41.653952 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d674c3f7-4e82-4a12-8fed-99db7ccd3f3e tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "POST /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72/action" status: 202 len: 0 microversion: 2.1 time: 0.190458 Jun 10 19:04:41.654774 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4265/7887] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 19:04:41 2022] POST /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 19:04:41.662816 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7b092aa6-6d32-4de0-89f5-4ccd5e86cd9a tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:04:41.663517 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7b092aa6-6d32-4de0-89f5-4ccd5e86cd9a tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:04:41.669753 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b092aa6-6d32-4de0-89f5-4ccd5e86cd9a tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:41.670211 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b092aa6-6d32-4de0-89f5-4ccd5e86cd9a tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:41.670977 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b092aa6-6d32-4de0-89f5-4ccd5e86cd9a tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:41.671417 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b092aa6-6d32-4de0-89f5-4ccd5e86cd9a tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:41.819725 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7b092aa6-6d32-4de0-89f5-4ccd5e86cd9a tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7fc0349a45486993756ef66ebe9f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b6e379f89543fb8bf4757cb46d3f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:04:41.834950 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7b092aa6-6d32-4de0-89f5-4ccd5e86cd9a tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72" status: 200 len: 1750 microversion: 2.1 time: 0.176047 Jun 10 19:04:41.835532 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4266/7888] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:04:41 2022] GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72 => generated 1750 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:04:42.852115 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b42414fe-62aa-4dea-bb7b-76dd2fa24658 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:04:42.852866 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b42414fe-62aa-4dea-bb7b-76dd2fa24658 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:04:42.859149 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b42414fe-62aa-4dea-bb7b-76dd2fa24658 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:42.859602 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b42414fe-62aa-4dea-bb7b-76dd2fa24658 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:42.860397 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b42414fe-62aa-4dea-bb7b-76dd2fa24658 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:42.860854 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b42414fe-62aa-4dea-bb7b-76dd2fa24658 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:43.012756 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b42414fe-62aa-4dea-bb7b-76dd2fa24658 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7fc0349a45486993756ef66ebe9f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b6e379f89543fb8bf4757cb46d3f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:04:43.021100 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b42414fe-62aa-4dea-bb7b-76dd2fa24658 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72" status: 200 len: 1755 microversion: 2.1 time: 0.173010 Jun 10 19:04:43.021682 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4267/7889] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:04:42 2022] GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72 => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:04:44.039013 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-595ff111-ef9d-4c02-b75e-eff53ff9f1c7 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:04:44.039782 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-595ff111-ef9d-4c02-b75e-eff53ff9f1c7 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:04:44.047282 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-595ff111-ef9d-4c02-b75e-eff53ff9f1c7 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:44.047733 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-595ff111-ef9d-4c02-b75e-eff53ff9f1c7 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:44.048525 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-595ff111-ef9d-4c02-b75e-eff53ff9f1c7 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:44.048962 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-595ff111-ef9d-4c02-b75e-eff53ff9f1c7 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:44.188645 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-595ff111-ef9d-4c02-b75e-eff53ff9f1c7 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7fc0349a45486993756ef66ebe9f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b6e379f89543fb8bf4757cb46d3f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:04:44.197196 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-595ff111-ef9d-4c02-b75e-eff53ff9f1c7 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72" status: 200 len: 1755 microversion: 2.1 time: 0.162124 Jun 10 19:04:44.197758 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4268/7890] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:04:44 2022] GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:04:45.214410 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-eff519e0-a5ea-40b2-85ec-2c82ff7b0a5f tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:04:45.215023 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-eff519e0-a5ea-40b2-85ec-2c82ff7b0a5f tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:04:45.222002 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eff519e0-a5ea-40b2-85ec-2c82ff7b0a5f tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:45.222452 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eff519e0-a5ea-40b2-85ec-2c82ff7b0a5f tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:45.223207 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eff519e0-a5ea-40b2-85ec-2c82ff7b0a5f tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:45.223643 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eff519e0-a5ea-40b2-85ec-2c82ff7b0a5f tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:45.371120 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-eff519e0-a5ea-40b2-85ec-2c82ff7b0a5f tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7fc0349a45486993756ef66ebe9f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b6e379f89543fb8bf4757cb46d3f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:04:45.379143 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-eff519e0-a5ea-40b2-85ec-2c82ff7b0a5f tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72" status: 200 len: 1755 microversion: 2.1 time: 0.169255 Jun 10 19:04:45.379695 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4269/7891] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:04:45 2022] GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:04:46.397072 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a4b4771f-b8f4-4163-bbaf-b6ba395f06bc tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:04:46.397754 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a4b4771f-b8f4-4163-bbaf-b6ba395f06bc tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:04:46.405475 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a4b4771f-b8f4-4163-bbaf-b6ba395f06bc tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:46.405929 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a4b4771f-b8f4-4163-bbaf-b6ba395f06bc tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:46.406687 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a4b4771f-b8f4-4163-bbaf-b6ba395f06bc tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:46.407123 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a4b4771f-b8f4-4163-bbaf-b6ba395f06bc tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:46.551366 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a4b4771f-b8f4-4163-bbaf-b6ba395f06bc tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7fc0349a45486993756ef66ebe9f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b6e379f89543fb8bf4757cb46d3f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:04:46.560089 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a4b4771f-b8f4-4163-bbaf-b6ba395f06bc tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72" status: 200 len: 1755 microversion: 2.1 time: 0.166866 Jun 10 19:04:46.560695 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4270/7892] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:04:46 2022] GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:04:47.577191 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a9d9fc92-bf97-40a6-9927-6b6414e1bdfb tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:04:47.577822 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a9d9fc92-bf97-40a6-9927-6b6414e1bdfb tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:04:47.584670 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a9d9fc92-bf97-40a6-9927-6b6414e1bdfb tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:47.585123 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a9d9fc92-bf97-40a6-9927-6b6414e1bdfb tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:47.585873 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a9d9fc92-bf97-40a6-9927-6b6414e1bdfb tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:47.586309 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a9d9fc92-bf97-40a6-9927-6b6414e1bdfb tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:47.726024 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a9d9fc92-bf97-40a6-9927-6b6414e1bdfb tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7fc0349a45486993756ef66ebe9f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b6e379f89543fb8bf4757cb46d3f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:04:47.734585 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a9d9fc92-bf97-40a6-9927-6b6414e1bdfb tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72" status: 200 len: 1755 microversion: 2.1 time: 0.161297 Jun 10 19:04:47.735154 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4271/7893] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:04:47 2022] GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:04:48.751822 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5df8d466-b01c-4b11-9e9b-454337924c47 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:04:48.752966 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5df8d466-b01c-4b11-9e9b-454337924c47 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:04:48.760492 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5df8d466-b01c-4b11-9e9b-454337924c47 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:48.760956 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5df8d466-b01c-4b11-9e9b-454337924c47 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:48.761749 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5df8d466-b01c-4b11-9e9b-454337924c47 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:48.762197 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5df8d466-b01c-4b11-9e9b-454337924c47 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:48.909583 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5df8d466-b01c-4b11-9e9b-454337924c47 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7fc0349a45486993756ef66ebe9f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b6e379f89543fb8bf4757cb46d3f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:04:48.918377 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5df8d466-b01c-4b11-9e9b-454337924c47 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72" status: 200 len: 1755 microversion: 2.1 time: 0.170505 Jun 10 19:04:48.918951 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4272/7894] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:04:48 2022] GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:04:49.934934 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-71075778-4528-4475-8305-f64f48f56cf0 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:04:49.935612 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-71075778-4528-4475-8305-f64f48f56cf0 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:04:49.942537 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-71075778-4528-4475-8305-f64f48f56cf0 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:49.942993 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-71075778-4528-4475-8305-f64f48f56cf0 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:49.943760 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-71075778-4528-4475-8305-f64f48f56cf0 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:49.944203 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-71075778-4528-4475-8305-f64f48f56cf0 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:50.092320 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-71075778-4528-4475-8305-f64f48f56cf0 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7fc0349a45486993756ef66ebe9f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b6e379f89543fb8bf4757cb46d3f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:04:50.100292 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-71075778-4528-4475-8305-f64f48f56cf0 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72" status: 200 len: 1755 microversion: 2.1 time: 0.169235 Jun 10 19:04:50.100888 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4273/7895] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:04:49 2022] GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:04:51.117897 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-11abc17d-68de-46ca-8a98-8c0450b3a0e1 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:04:51.118850 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-11abc17d-68de-46ca-8a98-8c0450b3a0e1 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:04:51.126372 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-11abc17d-68de-46ca-8a98-8c0450b3a0e1 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:51.126888 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-11abc17d-68de-46ca-8a98-8c0450b3a0e1 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:51.127732 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-11abc17d-68de-46ca-8a98-8c0450b3a0e1 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:51.128172 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-11abc17d-68de-46ca-8a98-8c0450b3a0e1 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:51.286093 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-11abc17d-68de-46ca-8a98-8c0450b3a0e1 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7fc0349a45486993756ef66ebe9f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b6e379f89543fb8bf4757cb46d3f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:04:51.294443 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-11abc17d-68de-46ca-8a98-8c0450b3a0e1 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72" status: 200 len: 1755 microversion: 2.1 time: 0.180569 Jun 10 19:04:51.295156 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4274/7896] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:04:51 2022] GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72 => generated 1755 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:04:52.312601 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fc49ac4b-0bea-4776-8401-6278545f81d7 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:04:52.313249 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fc49ac4b-0bea-4776-8401-6278545f81d7 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:04:52.320228 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fc49ac4b-0bea-4776-8401-6278545f81d7 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:52.321359 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fc49ac4b-0bea-4776-8401-6278545f81d7 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:52.322125 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fc49ac4b-0bea-4776-8401-6278545f81d7 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:52.322561 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fc49ac4b-0bea-4776-8401-6278545f81d7 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:52.465994 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fc49ac4b-0bea-4776-8401-6278545f81d7 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7fc0349a45486993756ef66ebe9f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b6e379f89543fb8bf4757cb46d3f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:04:52.474017 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fc49ac4b-0bea-4776-8401-6278545f81d7 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72" status: 200 len: 1755 microversion: 2.1 time: 0.165327 Jun 10 19:04:52.474580 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4275/7897] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:04:52 2022] GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:04:53.491776 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-de9b3f37-7bed-498f-8783-e9d0bec73d6f tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:04:53.492407 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-de9b3f37-7bed-498f-8783-e9d0bec73d6f tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:04:53.500217 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de9b3f37-7bed-498f-8783-e9d0bec73d6f tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:53.500709 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de9b3f37-7bed-498f-8783-e9d0bec73d6f tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:53.501484 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de9b3f37-7bed-498f-8783-e9d0bec73d6f tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:04:53.501930 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de9b3f37-7bed-498f-8783-e9d0bec73d6f tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:04:53.647407 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-de9b3f37-7bed-498f-8783-e9d0bec73d6f tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7fc0349a45486993756ef66ebe9f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b6e379f89543fb8bf4757cb46d3f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:04:53.655980 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-de9b3f37-7bed-498f-8783-e9d0bec73d6f tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72" status: 200 len: 1758 microversion: 2.1 time: 0.168234 Jun 10 19:04:53.656598 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4276/7898] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:04:53 2022] GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:05:25.991527 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-791a0ef5-71a3-458b-84d5-f4946442f67f tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-561617201"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:05:25.992825 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-791a0ef5-71a3-458b-84d5-f4946442f67f tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:05:25.995054 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=24 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:05:25.995716 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:05:26.000528 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-791a0ef5-71a3-458b-84d5-f4946442f67f tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:05:26.000984 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-791a0ef5-71a3-458b-84d5-f4946442f67f tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:05:26.001748 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-791a0ef5-71a3-458b-84d5-f4946442f67f tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:05:26.002189 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-791a0ef5-71a3-458b-84d5-f4946442f67f tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:05:26.128055 chdv-master-2 devstack@n-api.service[126595]: INFO nova.network.security_group_api [None req-791a0ef5-71a3-458b-84d5-f4946442f67f tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Removing security group 27750e7e-510a-400e-a0d5-70b3deb74f35 from port 98cb1223-126b-4cb5-be81-bc2e63b7912f Jun 10 19:05:26.545613 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-791a0ef5-71a3-458b-84d5-f4946442f67f tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "POST /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72/action" status: 202 len: 0 microversion: 2.1 time: 0.558208 Jun 10 19:05:26.549681 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4277/7899] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 19:05:25 2022] POST /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72/action => generated 0 bytes in 560 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 19:05:26.557590 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-3343a9f3-eb25-4b2d-a9fa-c7e3d8c69f5d req-4ab844af-5c43-4058-a787-e8171d7aa93b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76f009bd-2c72-4811-8e5c-23b3bb039b72", "tag": "98cb1223-126b-4cb5-be81-bc2e63b7912f"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:05:26.571172 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-3343a9f3-eb25-4b2d-a9fa-c7e3d8c69f5d req-4ab844af-5c43-4058-a787-e8171d7aa93b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:05:26.571785 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-3343a9f3-eb25-4b2d-a9fa-c7e3d8c69f5d req-4ab844af-5c43-4058-a787-e8171d7aa93b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:05:26.585293 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-3343a9f3-eb25-4b2d-a9fa-c7e3d8c69f5d req-4ab844af-5c43-4058-a787-e8171d7aa93b service nova] Creating event network-changed:98cb1223-126b-4cb5-be81-bc2e63b7912f for instance 76f009bd-2c72-4811-8e5c-23b3bb039b72 on chh1-master-2 Jun 10 19:05:26.591784 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-3343a9f3-eb25-4b2d-a9fa-c7e3d8c69f5d req-4ab844af-5c43-4058-a787-e8171d7aa93b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039495 Jun 10 19:05:26.592918 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4278/7900] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:05:27.747522 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e2aa2740-6f52-45e5-9893-856b35e3affc tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:05:27.753251 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e2aa2740-6f52-45e5-9893-856b35e3affc tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:05:27.754426 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e2aa2740-6f52-45e5-9893-856b35e3affc tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:05:27.754887 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e2aa2740-6f52-45e5-9893-856b35e3affc tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:05:27.755662 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e2aa2740-6f52-45e5-9893-856b35e3affc tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:05:27.756138 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e2aa2740-6f52-45e5-9893-856b35e3affc tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:05:27.837137 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-e2aa2740-6f52-45e5-9893-856b35e3affc tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lazy-loading 'services' on Instance uuid 76f009bd-2c72-4811-8e5c-23b3bb039b72 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 19:05:28.005681 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e2aa2740-6f52-45e5-9893-856b35e3affc tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "DELETE /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72/os-volume_attachments/56f25617-e199-4145-bffa-b72b10f6cb84" status: 202 len: 0 microversion: 2.1 time: 0.263464 Jun 10 19:05:28.006530 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4279/7901] 10.222.0.35 () {58 vars in 1415 bytes} [Fri Jun 10 19:05:27 2022] DELETE /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72/os-volume_attachments/56f25617-e199-4145-bffa-b72b10f6cb84 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 19:05:28.016033 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-71be2c10-8c29-49ba-9b1b-bfc8d38a45ff tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:05:28.018395 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-71be2c10-8c29-49ba-9b1b-bfc8d38a45ff tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:05:28.027479 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-71be2c10-8c29-49ba-9b1b-bfc8d38a45ff tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:05:28.027479 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-71be2c10-8c29-49ba-9b1b-bfc8d38a45ff tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:05:28.027479 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-71be2c10-8c29-49ba-9b1b-bfc8d38a45ff tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:05:28.028019 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-71be2c10-8c29-49ba-9b1b-bfc8d38a45ff tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:05:28.058528 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-71be2c10-8c29-49ba-9b1b-bfc8d38a45ff tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046700 Jun 10 19:05:28.059109 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4280/7902] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 19:05:28 2022] GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:05:28.609999 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-9dbb1828-ebf1-4997-9888-f59d7aca7807 req-2db23439-99b8-4ccd-9741-4e746841fad7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76f009bd-2c72-4811-8e5c-23b3bb039b72", "tag": "98cb1223-126b-4cb5-be81-bc2e63b7912f"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:05:28.620294 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-9dbb1828-ebf1-4997-9888-f59d7aca7807 req-2db23439-99b8-4ccd-9741-4e746841fad7 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:05:28.620865 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-9dbb1828-ebf1-4997-9888-f59d7aca7807 req-2db23439-99b8-4ccd-9741-4e746841fad7 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:05:28.632900 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-9dbb1828-ebf1-4997-9888-f59d7aca7807 req-2db23439-99b8-4ccd-9741-4e746841fad7 service nova] Creating event network-changed:98cb1223-126b-4cb5-be81-bc2e63b7912f for instance 76f009bd-2c72-4811-8e5c-23b3bb039b72 on chh1-master-2 Jun 10 19:05:28.638057 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-9dbb1828-ebf1-4997-9888-f59d7aca7807 req-2db23439-99b8-4ccd-9741-4e746841fad7 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031720 Jun 10 19:05:28.638764 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4281/7903] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:05:29.072235 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dbe33375-2b95-4bd0-94e3-9bf10b3987f3 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:05:29.073455 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dbe33375-2b95-4bd0-94e3-9bf10b3987f3 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:05:29.079842 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dbe33375-2b95-4bd0-94e3-9bf10b3987f3 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:05:29.080436 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dbe33375-2b95-4bd0-94e3-9bf10b3987f3 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:05:29.081279 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dbe33375-2b95-4bd0-94e3-9bf10b3987f3 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:05:29.081730 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dbe33375-2b95-4bd0-94e3-9bf10b3987f3 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:05:29.116463 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dbe33375-2b95-4bd0-94e3-9bf10b3987f3 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049507 Jun 10 19:05:29.117277 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4282/7904] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 19:05:29 2022] GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:05:30.129655 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bac2db6d-f8f0-495d-bb2a-cba7e49b396e tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:05:30.130614 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bac2db6d-f8f0-495d-bb2a-cba7e49b396e tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:05:30.137848 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bac2db6d-f8f0-495d-bb2a-cba7e49b396e tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:05:30.138297 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bac2db6d-f8f0-495d-bb2a-cba7e49b396e tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:05:30.139072 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bac2db6d-f8f0-495d-bb2a-cba7e49b396e tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:05:30.139512 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bac2db6d-f8f0-495d-bb2a-cba7e49b396e tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:05:30.170806 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bac2db6d-f8f0-495d-bb2a-cba7e49b396e tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045250 Jun 10 19:05:30.171393 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4283/7905] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 19:05:30 2022] GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:05:31.182783 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3ac595e6-91cf-401c-a2c0-8f1bbf3ae8bb tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:05:31.183730 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3ac595e6-91cf-401c-a2c0-8f1bbf3ae8bb tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:05:31.191119 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3ac595e6-91cf-401c-a2c0-8f1bbf3ae8bb tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:05:31.191584 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3ac595e6-91cf-401c-a2c0-8f1bbf3ae8bb tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:05:31.192443 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3ac595e6-91cf-401c-a2c0-8f1bbf3ae8bb tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:05:31.192894 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3ac595e6-91cf-401c-a2c0-8f1bbf3ae8bb tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:05:31.226178 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3ac595e6-91cf-401c-a2c0-8f1bbf3ae8bb tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047522 Jun 10 19:05:31.227446 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4284/7906] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 19:05:31 2022] GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:05:32.238582 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d3014ba0-22fd-427a-9060-797a97683cd9 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:05:32.239439 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d3014ba0-22fd-427a-9060-797a97683cd9 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:05:32.247047 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d3014ba0-22fd-427a-9060-797a97683cd9 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:05:32.247496 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d3014ba0-22fd-427a-9060-797a97683cd9 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:05:32.248260 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d3014ba0-22fd-427a-9060-797a97683cd9 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:05:32.248722 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d3014ba0-22fd-427a-9060-797a97683cd9 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:05:32.279759 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d3014ba0-22fd-427a-9060-797a97683cd9 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045251 Jun 10 19:05:32.280350 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4285/7907] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 19:05:32 2022] GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:05:33.291684 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1acbaa32-d480-4a9e-afb7-eaac4baa1182 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:05:33.292633 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1acbaa32-d480-4a9e-afb7-eaac4baa1182 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:05:33.299418 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1acbaa32-d480-4a9e-afb7-eaac4baa1182 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:05:33.299867 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1acbaa32-d480-4a9e-afb7-eaac4baa1182 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:05:33.300655 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1acbaa32-d480-4a9e-afb7-eaac4baa1182 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:05:33.301092 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1acbaa32-d480-4a9e-afb7-eaac4baa1182 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:05:33.329404 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1acbaa32-d480-4a9e-afb7-eaac4baa1182 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042213 Jun 10 19:05:33.329952 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4286/7908] 10.222.0.35 () {58 vars in 1301 bytes} [Fri Jun 10 19:05:33 2022] GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 10 19:05:33.339705 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-396056a6-1860-4ba6-9676-4783f8d1530d tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:05:33.340187 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-396056a6-1860-4ba6-9676-4783f8d1530d tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:05:33.346338 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-396056a6-1860-4ba6-9676-4783f8d1530d tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:05:33.346769 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-396056a6-1860-4ba6-9676-4783f8d1530d tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:05:33.347529 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-396056a6-1860-4ba6-9676-4783f8d1530d tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:05:33.347963 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-396056a6-1860-4ba6-9676-4783f8d1530d tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:05:33.423265 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-396056a6-1860-4ba6-9676-4783f8d1530d tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] HTTP exception thrown: Instance 76f009bd-2c72-4811-8e5c-23b3bb039b72 is not attached to volume 56f25617-e199-4145-bffa-b72b10f6cb84 Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-396056a6-1860-4ba6-9676-4783f8d1530d tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Request method failure captured: Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: request: DELETE /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72/os-volume_attachments/56f25617-e199-4145-bffa-b72b10f6cb84 HTTP/1.1 Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5WBNYRSQgPELwlz2Z8-hno0Bv-94uboRT13VxqHtqxx4y7qkgO3IO885Prh-c-kJvO0bLKr2I0Eu8yeMpuaOIpQlb1lJxfv-SbUV5PMS1w-e4zUYQaEmKQrMZesWz0eML21f7X9bKFJ8e2lMyKs3Hda5cd_7iYt6CRKlwm0ppRdf-Y Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 61b6e379f89543fb8bf4757cb46d3f67 Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-TestMinimumBasicScenario-1254802511 Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/61b6e379f89543fb8bf4757cb46d3f67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/61b6e379f89543fb8bf4757cb46d3f67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/61b6e379f89543fb8bf4757cb46d3f67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_61b6e379f89543fb8bf4757cb46d3f67", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-TestMinimumBasicScenario-1254802511 Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 61b6e379f89543fb8bf4757cb46d3f67 Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1254802511 Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-TestMinimumBasicScenario-1254802511-project Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 1c7fc0349a45486993756ef66ebe9f99 Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-TestMinimumBasicScenario-1254802511-project Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 76f009bd-2c72-4811-8e5c-23b3bb039b72 is not attached to volume 56f25617-e199-4145-bffa-b72b10f6cb84 Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: action_args: {'server_id': '76f009bd-2c72-4811-8e5c-23b3bb039b72', 'id': '56f25617-e199-4145-bffa-b72b10f6cb84'} Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 56f25617-e199-4145-bffa-b72b10f6cb84. Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76f009bd-2c72-4811-8e5c-23b3bb039b72 is not attached to volume 56f25617-e199-4145-bffa-b72b10f6cb84 Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:05:33.424896 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:05:33.430622 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 19:05:33.430622 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 19:05:33.430622 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76f009bd-2c72-4811-8e5c-23b3bb039b72 is not attached to volume 56f25617-e199-4145-bffa-b72b10f6cb84 Jun 10 19:05:33.430622 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:05:33.430622 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-396056a6-1860-4ba6-9676-4783f8d1530d tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Returning 404 to user: Instance 76f009bd-2c72-4811-8e5c-23b3bb039b72 is not attached to volume 56f25617-e199-4145-bffa-b72b10f6cb84 {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 19:05:33.430622 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-396056a6-1860-4ba6-9676-4783f8d1530d tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "DELETE /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72/os-volume_attachments/56f25617-e199-4145-bffa-b72b10f6cb84" status: 404 len: 154 microversion: 2.1 time: 0.090734 Jun 10 19:05:33.430622 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4287/7909] 10.222.0.35 () {58 vars in 1415 bytes} [Fri Jun 10 19:05:33 2022] DELETE /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72/os-volume_attachments/56f25617-e199-4145-bffa-b72b10f6cb84 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 19:05:36.759127 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-22d44402-6f59-4653-b61b-60388bc5f1d7 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:05:36.759927 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-22d44402-6f59-4653-b61b-60388bc5f1d7 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:05:36.767157 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-22d44402-6f59-4653-b61b-60388bc5f1d7 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:05:36.767694 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-22d44402-6f59-4653-b61b-60388bc5f1d7 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:05:36.768576 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-22d44402-6f59-4653-b61b-60388bc5f1d7 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:05:36.769110 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-22d44402-6f59-4653-b61b-60388bc5f1d7 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:05:36.795007 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-22d44402-6f59-4653-b61b-60388bc5f1d7 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 19:05:37.043291 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-22d44402-6f59-4653-b61b-60388bc5f1d7 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "DELETE /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72" status: 204 len: 0 microversion: 2.1 time: 0.288325 Jun 10 19:05:37.043899 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4288/7910] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 19:05:36 2022] DELETE /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 19:05:37.052455 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3e055c04-7480-49f0-b60c-43b817037f37 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:05:37.053164 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3e055c04-7480-49f0-b60c-43b817037f37 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:05:37.059572 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3e055c04-7480-49f0-b60c-43b817037f37 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:05:37.060025 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3e055c04-7480-49f0-b60c-43b817037f37 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:05:37.060815 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3e055c04-7480-49f0-b60c-43b817037f37 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:05:37.061252 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3e055c04-7480-49f0-b60c-43b817037f37 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:05:37.194847 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3e055c04-7480-49f0-b60c-43b817037f37 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7fc0349a45486993756ef66ebe9f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b6e379f89543fb8bf4757cb46d3f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:05:37.203406 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3e055c04-7480-49f0-b60c-43b817037f37 tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72" status: 200 len: 1553 microversion: 2.1 time: 0.155089 Jun 10 19:05:37.203989 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4289/7911] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:05:37 2022] GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:05:38.220766 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4f27d003-694c-4723-90bf-f8e83384ba1a tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:05:38.221417 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4f27d003-694c-4723-90bf-f8e83384ba1a tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:05:38.228536 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f27d003-694c-4723-90bf-f8e83384ba1a tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:05:38.228995 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f27d003-694c-4723-90bf-f8e83384ba1a tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:05:38.229768 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f27d003-694c-4723-90bf-f8e83384ba1a tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:05:38.230218 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f27d003-694c-4723-90bf-f8e83384ba1a tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:05:38.356738 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4f27d003-694c-4723-90bf-f8e83384ba1a tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7fc0349a45486993756ef66ebe9f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b6e379f89543fb8bf4757cb46d3f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:05:38.364330 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4f27d003-694c-4723-90bf-f8e83384ba1a tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72" status: 200 len: 1553 microversion: 2.1 time: 0.147613 Jun 10 19:05:38.364902 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4290/7912] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:05:38 2022] GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72 => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:05:39.224875 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-47c4071a-73ed-4fab-aa06-c88e23ffd0f4 req-79e1ddf0-655e-4946-b5ef-6ba51a569c24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76f009bd-2c72-4811-8e5c-23b3bb039b72", "name": "network-vif-deleted", "tag": "98cb1223-126b-4cb5-be81-bc2e63b7912f"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:05:39.233900 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-47c4071a-73ed-4fab-aa06-c88e23ffd0f4 req-79e1ddf0-655e-4946-b5ef-6ba51a569c24 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:05:39.236946 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-47c4071a-73ed-4fab-aa06-c88e23ffd0f4 req-79e1ddf0-655e-4946-b5ef-6ba51a569c24 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:05:39.245656 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-47c4071a-73ed-4fab-aa06-c88e23ffd0f4 req-79e1ddf0-655e-4946-b5ef-6ba51a569c24 service nova] Creating event network-vif-deleted:98cb1223-126b-4cb5-be81-bc2e63b7912f for instance 76f009bd-2c72-4811-8e5c-23b3bb039b72 on chh1-master-2 Jun 10 19:05:39.250979 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-47c4071a-73ed-4fab-aa06-c88e23ffd0f4 req-79e1ddf0-655e-4946-b5ef-6ba51a569c24 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029718 Jun 10 19:05:39.251678 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4291/7913] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:05:39.383326 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b5a49726-cc7c-405f-bb3b-9a81466730af tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:05:39.383961 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b5a49726-cc7c-405f-bb3b-9a81466730af tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:05:39.390298 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5a49726-cc7c-405f-bb3b-9a81466730af tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:05:39.390754 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5a49726-cc7c-405f-bb3b-9a81466730af tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:05:39.391769 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5a49726-cc7c-405f-bb3b-9a81466730af tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:05:39.391942 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5a49726-cc7c-405f-bb3b-9a81466730af tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:05:39.464690 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b5a49726-cc7c-405f-bb3b-9a81466730af tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7fc0349a45486993756ef66ebe9f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b6e379f89543fb8bf4757cb46d3f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:05:39.472718 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b5a49726-cc7c-405f-bb3b-9a81466730af tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72" status: 200 len: 1342 microversion: 2.1 time: 0.094582 Jun 10 19:05:39.473444 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4292/7914] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:05:39 2022] GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72 => generated 1342 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:05:40.493611 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-87d86564-ae2d-4142-ba86-a045024ad87a tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:05:40.494680 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-87d86564-ae2d-4142-ba86-a045024ad87a tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] [instance: 76f009bd-2c72-4811-8e5c-23b3bb039b72] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:05:40.502202 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-87d86564-ae2d-4142-ba86-a045024ad87a tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:05:40.502655 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-87d86564-ae2d-4142-ba86-a045024ad87a tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:05:40.503508 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-87d86564-ae2d-4142-ba86-a045024ad87a tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:05:40.503944 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-87d86564-ae2d-4142-ba86-a045024ad87a tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:05:40.518531 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-87d86564-ae2d-4142-ba86-a045024ad87a tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] HTTP exception thrown: Instance 76f009bd-2c72-4811-8e5c-23b3bb039b72 could not be found. Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-87d86564-ae2d-4142-ba86-a045024ad87a tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Request method failure captured: Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72 HTTP/1.1 Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5WBNYRSQgPELwlz2Z8-hno0Bv-94uboRT13VxqHtqxx4y7qkgO3IO885Prh-c-kJvO0bLKr2I0Eu8yeMpuaOIpQlb1lJxfv-SbUV5PMS1w-e4zUYQaEmKQrMZesWz0eML21f7X9bKFJ8e2lMyKs3Hda5cd_7iYt6CRKlwm0ppRdf-Y Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 61b6e379f89543fb8bf4757cb46d3f67 Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-TestMinimumBasicScenario-1254802511 Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/61b6e379f89543fb8bf4757cb46d3f67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/61b6e379f89543fb8bf4757cb46d3f67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/61b6e379f89543fb8bf4757cb46d3f67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_61b6e379f89543fb8bf4757cb46d3f67", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-TestMinimumBasicScenario-1254802511 Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 61b6e379f89543fb8bf4757cb46d3f67 Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1254802511 Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-TestMinimumBasicScenario-1254802511-project Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 1c7fc0349a45486993756ef66ebe9f99 Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-TestMinimumBasicScenario-1254802511-project Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 76f009bd-2c72-4811-8e5c-23b3bb039b72 could not be found. Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '76f009bd-2c72-4811-8e5c-23b3bb039b72'} Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76f009bd-2c72-4811-8e5c-23b3bb039b72 could not be found. Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76f009bd-2c72-4811-8e5c-23b3bb039b72 could not be found. Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:05:40.520279 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:05:40.758441 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:05:40.758441 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:05:40.758441 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:05:40.758441 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 19:05:40.758441 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 19:05:40.758441 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76f009bd-2c72-4811-8e5c-23b3bb039b72 could not be found. Jun 10 19:05:40.758441 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:05:40.758441 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-87d86564-ae2d-4142-ba86-a045024ad87a tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Returning 404 to user: Instance 76f009bd-2c72-4811-8e5c-23b3bb039b72 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 19:05:40.758441 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-87d86564-ae2d-4142-ba86-a045024ad87a tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72" status: 404 len: 111 microversion: 2.1 time: 0.035720 Jun 10 19:05:40.758441 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4293/7915] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:05:40 2022] GET /compute/v2.1/servers/76f009bd-2c72-4811-8e5c-23b3bb039b72 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 19:05:40.758441 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-39a6b7eb-8129-4ea7-baee-9b93f1b8d5ab tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] Calling method '.version_select at 0x7f77c0641700>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:05:40.758441 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-39a6b7eb-8129-4ea7-baee-9b93f1b8d5ab tempest-TestMinimumBasicScenario-1254802511 tempest-TestMinimumBasicScenario-1254802511-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-242804288" status: 202 len: 0 microversion: 2.1 time: 0.060161 Jun 10 19:05:40.758441 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4294/7916] 10.222.0.35 () {58 vars in 1268 bytes} [Fri Jun 10 19:05:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-242804288 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 19:05:51.084650 chdv-master-2 devstack@n-api.service[126595]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 19:05:51.085154 chdv-master-2 devstack@n-api.service[126595]: Fri Jun 10 19:05:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 10 19:05:52.307578 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:05:52.308368 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:05:52.468860 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9417a965-bf9b-4274-b38d-371ae400c498 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Action: 'create', calling method: .version_select at 0x7f77c0431700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2019307129", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4QGiCug1obq/RxpzxBC+bx/7WfjowDrm67WQg/DkxBVfggNipalxzj9LoUxVNLPDBzGZpUzBcFSSwDKjl9UR23YaQwIYIcN3u7fSehe1dZJaOQmgIxlVSJIZPUY+XbLA=="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:05:52.484810 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-9417a965-bf9b-4274-b38d-371ae400c498 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Getting quotas for project 69f65fbabf1d4b85aa3ec38f0e4efe11. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 19:05:52.489954 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-9417a965-bf9b-4274-b38d-371ae400c498 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Getting quotas for user c75f5f98f96946e18c2e665b7f59f75d and project 69f65fbabf1d4b85aa3ec38f0e4efe11. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 19:05:52.609250 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9417a965-bf9b-4274-b38d-371ae400c498 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.304137 Jun 10 19:05:52.609859 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4295/7917] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 19:05:52 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:06:00.935964 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e2e40ef6-8ab3-4245-90b1-45faaf78c164 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-181296428", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "23fde453-e5a6-4457-bf56-7b9de5d908f8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2019307129", "security_groups": [{"name": "tempest-secgroup-smoke-1191091459"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:06:01.195558 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-e2e40ef6-8ab3-4245-90b1-45faaf78c164 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] validate_networks() for [('23fde453-e5a6-4457-bf56-7b9de5d908f8', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 19:06:01.644579 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-e2e40ef6-8ab3-4245-90b1-45faaf78c164 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 19:06:01.645149 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-e2e40ef6-8ab3-4245-90b1-45faaf78c164 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 19:06:01.645627 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-e2e40ef6-8ab3-4245-90b1-45faaf78c164 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 19:06:01.646037 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-e2e40ef6-8ab3-4245-90b1-45faaf78c164 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 19:06:01.646451 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-e2e40ef6-8ab3-4245-90b1-45faaf78c164 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 19:06:01.656465 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e2e40ef6-8ab3-4245-90b1-45faaf78c164 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:06:01.656931 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e2e40ef6-8ab3-4245-90b1-45faaf78c164 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:06:01.657770 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e2e40ef6-8ab3-4245-90b1-45faaf78c164 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:06:01.658228 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e2e40ef6-8ab3-4245-90b1-45faaf78c164 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:06:01.675267 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-e2e40ef6-8ab3-4245-90b1-45faaf78c164 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Getting quotas for project 69f65fbabf1d4b85aa3ec38f0e4efe11. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 19:06:01.680736 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-e2e40ef6-8ab3-4245-90b1-45faaf78c164 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Getting quotas for user c75f5f98f96946e18c2e665b7f59f75d and project 69f65fbabf1d4b85aa3ec38f0e4efe11. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 19:06:01.693374 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e2e40ef6-8ab3-4245-90b1-45faaf78c164 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 19:06:01.696167 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e2e40ef6-8ab3-4245-90b1-45faaf78c164 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 5d49625a-3957-43e2-84b0-592e5f82515b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 19:06:01.806059 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e2e40ef6-8ab3-4245-90b1-45faaf78c164 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.874031 Jun 10 19:06:01.807050 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4296/7918] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 19:06:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 19:06:01.816810 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-566eb910-2333-4412-8305-f4a92a370158 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:06:01.817488 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-566eb910-2333-4412-8305-f4a92a370158 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 5d49625a-3957-43e2-84b0-592e5f82515b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:06:01.889103 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-566eb910-2333-4412-8305-f4a92a370158 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:06:01.897737 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-566eb910-2333-4412-8305-f4a92a370158 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b" status: 200 len: 1266 microversion: 2.1 time: 0.084744 Jun 10 19:06:01.898775 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4297/7919] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:06:01 2022] GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:06:02.916194 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-62c16182-f415-4594-99d1-8ba8ee5acb14 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:06:02.916941 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-62c16182-f415-4594-99d1-8ba8ee5acb14 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 5d49625a-3957-43e2-84b0-592e5f82515b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:06:02.925021 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-62c16182-f415-4594-99d1-8ba8ee5acb14 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:06:02.926144 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-62c16182-f415-4594-99d1-8ba8ee5acb14 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:06:02.927261 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-62c16182-f415-4594-99d1-8ba8ee5acb14 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:06:02.928110 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-62c16182-f415-4594-99d1-8ba8ee5acb14 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:06:03.000166 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-62c16182-f415-4594-99d1-8ba8ee5acb14 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:06:03.009894 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-62c16182-f415-4594-99d1-8ba8ee5acb14 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b" status: 200 len: 1270 microversion: 2.1 time: 0.098240 Jun 10 19:06:03.011024 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4298/7920] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:06:02 2022] GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b => generated 1270 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:06:04.028217 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5230ef15-0bc6-4dd1-8a35-41d2beefb1a1 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:06:04.028922 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5230ef15-0bc6-4dd1-8a35-41d2beefb1a1 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 5d49625a-3957-43e2-84b0-592e5f82515b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:06:04.036342 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5230ef15-0bc6-4dd1-8a35-41d2beefb1a1 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:06:04.036802 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5230ef15-0bc6-4dd1-8a35-41d2beefb1a1 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:06:04.037606 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5230ef15-0bc6-4dd1-8a35-41d2beefb1a1 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:06:04.038042 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5230ef15-0bc6-4dd1-8a35-41d2beefb1a1 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:06:04.115262 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5230ef15-0bc6-4dd1-8a35-41d2beefb1a1 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:06:04.124188 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5230ef15-0bc6-4dd1-8a35-41d2beefb1a1 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b" status: 200 len: 1318 microversion: 2.1 time: 0.100716 Jun 10 19:06:04.124893 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4299/7921] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:06:04 2022] GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b => generated 1318 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:06:05.142159 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-32228220-ea8f-4618-b661-0025d46aa779 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:06:05.142791 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-32228220-ea8f-4618-b661-0025d46aa779 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 5d49625a-3957-43e2-84b0-592e5f82515b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:06:05.150365 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-32228220-ea8f-4618-b661-0025d46aa779 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:06:05.150822 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-32228220-ea8f-4618-b661-0025d46aa779 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:06:05.151601 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-32228220-ea8f-4618-b661-0025d46aa779 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:06:05.152072 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-32228220-ea8f-4618-b661-0025d46aa779 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:06:05.306447 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-32228220-ea8f-4618-b661-0025d46aa779 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:06:05.317305 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-32228220-ea8f-4618-b661-0025d46aa779 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b" status: 200 len: 1392 microversion: 2.1 time: 0.178961 Jun 10 19:06:05.320709 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4300/7922] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:06:05 2022] GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b => generated 1392 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:06:06.146909 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-33761789-e216-4648-99a0-bb216508b54b req-0e30d198-00a9-4341-ad57-88e3ecebbb88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d49625a-3957-43e2-84b0-592e5f82515b", "tag": "e8253be4-64ef-44c1-9fb5-094e7e477511"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:06:06.157362 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-33761789-e216-4648-99a0-bb216508b54b req-0e30d198-00a9-4341-ad57-88e3ecebbb88 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:06:06.158099 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-33761789-e216-4648-99a0-bb216508b54b req-0e30d198-00a9-4341-ad57-88e3ecebbb88 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:06:06.171713 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-33761789-e216-4648-99a0-bb216508b54b req-0e30d198-00a9-4341-ad57-88e3ecebbb88 service nova] Creating event network-changed:e8253be4-64ef-44c1-9fb5-094e7e477511 for instance 5d49625a-3957-43e2-84b0-592e5f82515b on chh2-master-2 Jun 10 19:06:06.177003 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-33761789-e216-4648-99a0-bb216508b54b req-0e30d198-00a9-4341-ad57-88e3ecebbb88 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033805 Jun 10 19:06:06.181389 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4301/7923] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:06:06.335586 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2ed92993-be93-418f-b242-dcf914d5df2d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:06:06.336841 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2ed92993-be93-418f-b242-dcf914d5df2d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 5d49625a-3957-43e2-84b0-592e5f82515b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:06:06.343211 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2ed92993-be93-418f-b242-dcf914d5df2d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:06:06.343602 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2ed92993-be93-418f-b242-dcf914d5df2d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:06:06.344469 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2ed92993-be93-418f-b242-dcf914d5df2d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:06:06.344921 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2ed92993-be93-418f-b242-dcf914d5df2d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:06:06.489058 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2ed92993-be93-418f-b242-dcf914d5df2d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:06:06.497047 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2ed92993-be93-418f-b242-dcf914d5df2d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b" status: 200 len: 1392 microversion: 2.1 time: 0.165632 Jun 10 19:06:06.497580 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4302/7924] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:06:06 2022] GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:06:07.513794 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6c7a1e8e-86cf-4fac-a7fb-8c13f3d04470 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:06:07.514370 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6c7a1e8e-86cf-4fac-a7fb-8c13f3d04470 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 5d49625a-3957-43e2-84b0-592e5f82515b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:06:07.521290 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6c7a1e8e-86cf-4fac-a7fb-8c13f3d04470 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:06:07.521755 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6c7a1e8e-86cf-4fac-a7fb-8c13f3d04470 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:06:07.522520 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6c7a1e8e-86cf-4fac-a7fb-8c13f3d04470 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:06:07.522962 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6c7a1e8e-86cf-4fac-a7fb-8c13f3d04470 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:06:07.650423 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6c7a1e8e-86cf-4fac-a7fb-8c13f3d04470 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:06:07.657968 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6c7a1e8e-86cf-4fac-a7fb-8c13f3d04470 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b" status: 200 len: 1392 microversion: 2.1 time: 0.148170 Jun 10 19:06:07.658557 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4303/7925] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:06:07 2022] GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b => generated 1392 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:06:08.675639 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6e2af337-61a2-40a9-942b-ac2beeaef237 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:06:08.676286 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6e2af337-61a2-40a9-942b-ac2beeaef237 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 5d49625a-3957-43e2-84b0-592e5f82515b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:06:08.683650 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6e2af337-61a2-40a9-942b-ac2beeaef237 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:06:08.684107 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6e2af337-61a2-40a9-942b-ac2beeaef237 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:06:08.684914 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6e2af337-61a2-40a9-942b-ac2beeaef237 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:06:08.685357 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6e2af337-61a2-40a9-942b-ac2beeaef237 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:06:08.919829 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6e2af337-61a2-40a9-942b-ac2beeaef237 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:06:08.919829 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6e2af337-61a2-40a9-942b-ac2beeaef237 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b" status: 200 len: 1392 microversion: 2.1 time: 0.160058 Jun 10 19:06:08.919829 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4304/7926] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:06:08 2022] GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:06:09.849060 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-33788fc4-a701-4795-a474-509250724315 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:06:09.849662 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-33788fc4-a701-4795-a474-509250724315 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 5d49625a-3957-43e2-84b0-592e5f82515b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:06:09.856553 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-33788fc4-a701-4795-a474-509250724315 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:06:09.857018 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-33788fc4-a701-4795-a474-509250724315 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:06:09.857894 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-33788fc4-a701-4795-a474-509250724315 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:06:09.858240 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-33788fc4-a701-4795-a474-509250724315 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:06:09.992826 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-33788fc4-a701-4795-a474-509250724315 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:06:10.000420 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-33788fc4-a701-4795-a474-509250724315 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b" status: 200 len: 1392 microversion: 2.1 time: 0.155247 Jun 10 19:06:10.001002 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4305/7927] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:06:09 2022] GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:06:11.017302 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-92636a5f-b1ad-497e-9f15-0dbbed5d8dc7 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:06:11.018041 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-92636a5f-b1ad-497e-9f15-0dbbed5d8dc7 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 5d49625a-3957-43e2-84b0-592e5f82515b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:06:11.025367 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-92636a5f-b1ad-497e-9f15-0dbbed5d8dc7 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:06:11.025826 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-92636a5f-b1ad-497e-9f15-0dbbed5d8dc7 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:06:11.026597 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-92636a5f-b1ad-497e-9f15-0dbbed5d8dc7 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:06:11.027042 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-92636a5f-b1ad-497e-9f15-0dbbed5d8dc7 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:06:11.161326 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-92636a5f-b1ad-497e-9f15-0dbbed5d8dc7 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:06:11.169430 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-92636a5f-b1ad-497e-9f15-0dbbed5d8dc7 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b" status: 200 len: 1392 microversion: 2.1 time: 0.155908 Jun 10 19:06:11.170022 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4306/7928] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:06:11 2022] GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:06:12.092681 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-14faa239-7ba7-420e-8200-1ed185b510a9 req-d90c4147-fe9a-4a34-9843-095ab00a010c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d49625a-3957-43e2-84b0-592e5f82515b", "name": "network-vif-plugged", "status": "completed", "tag": "e8253be4-64ef-44c1-9fb5-094e7e477511"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:06:12.096383 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:06:12.097595 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=12 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:06:12.103331 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-14faa239-7ba7-420e-8200-1ed185b510a9 req-d90c4147-fe9a-4a34-9843-095ab00a010c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:06:12.103786 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-14faa239-7ba7-420e-8200-1ed185b510a9 req-d90c4147-fe9a-4a34-9843-095ab00a010c service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:06:12.114783 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-14faa239-7ba7-420e-8200-1ed185b510a9 req-d90c4147-fe9a-4a34-9843-095ab00a010c service nova] Creating event network-vif-plugged:e8253be4-64ef-44c1-9fb5-094e7e477511 for instance 5d49625a-3957-43e2-84b0-592e5f82515b on chh2-master-2 Jun 10 19:06:12.120905 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-14faa239-7ba7-420e-8200-1ed185b510a9 req-d90c4147-fe9a-4a34-9843-095ab00a010c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032204 Jun 10 19:06:12.121508 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4307/7929] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:06:12.188883 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2f956658-3770-44b7-82f6-23753b2f30df tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:06:12.189689 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2f956658-3770-44b7-82f6-23753b2f30df tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 5d49625a-3957-43e2-84b0-592e5f82515b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:06:12.197459 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2f956658-3770-44b7-82f6-23753b2f30df tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:06:12.197926 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2f956658-3770-44b7-82f6-23753b2f30df tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:06:12.198724 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2f956658-3770-44b7-82f6-23753b2f30df tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:06:12.199198 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2f956658-3770-44b7-82f6-23753b2f30df tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:06:12.339500 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2f956658-3770-44b7-82f6-23753b2f30df tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:06:12.347134 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2f956658-3770-44b7-82f6-23753b2f30df tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b" status: 200 len: 1392 microversion: 2.1 time: 0.164202 Jun 10 19:06:12.347714 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4308/7930] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:06:12 2022] GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:06:13.364386 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-729cd55c-c879-4a07-8bcf-ef33aa37f492 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:06:13.365007 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-729cd55c-c879-4a07-8bcf-ef33aa37f492 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 5d49625a-3957-43e2-84b0-592e5f82515b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:06:13.372897 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-729cd55c-c879-4a07-8bcf-ef33aa37f492 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:06:13.373351 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-729cd55c-c879-4a07-8bcf-ef33aa37f492 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:06:13.374116 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-729cd55c-c879-4a07-8bcf-ef33aa37f492 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:06:13.374554 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-729cd55c-c879-4a07-8bcf-ef33aa37f492 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:06:13.510036 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-729cd55c-c879-4a07-8bcf-ef33aa37f492 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:06:13.518390 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-729cd55c-c879-4a07-8bcf-ef33aa37f492 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b" status: 200 len: 1392 microversion: 2.1 time: 0.157873 Jun 10 19:06:13.518967 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4309/7931] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:06:13 2022] GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:06:14.535803 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bc5878c8-7c5a-4573-97e1-e8ee563a10bb tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:06:14.536460 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bc5878c8-7c5a-4573-97e1-e8ee563a10bb tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 5d49625a-3957-43e2-84b0-592e5f82515b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:06:14.544230 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bc5878c8-7c5a-4573-97e1-e8ee563a10bb tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:06:14.544723 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bc5878c8-7c5a-4573-97e1-e8ee563a10bb tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:06:14.545528 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bc5878c8-7c5a-4573-97e1-e8ee563a10bb tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:06:14.545971 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bc5878c8-7c5a-4573-97e1-e8ee563a10bb tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:06:14.692858 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bc5878c8-7c5a-4573-97e1-e8ee563a10bb tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:06:14.700578 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bc5878c8-7c5a-4573-97e1-e8ee563a10bb tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b" status: 200 len: 1565 microversion: 2.1 time: 0.168664 Jun 10 19:06:14.705864 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4310/7932] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:06:14 2022] GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:06:14.716811 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-767e8f08-c424-47cc-a55e-c94b9cce89a8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:06:14.717425 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-767e8f08-c424-47cc-a55e-c94b9cce89a8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 5d49625a-3957-43e2-84b0-592e5f82515b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:06:14.723349 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-767e8f08-c424-47cc-a55e-c94b9cce89a8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:06:14.723804 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-767e8f08-c424-47cc-a55e-c94b9cce89a8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:06:14.724626 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-767e8f08-c424-47cc-a55e-c94b9cce89a8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:06:14.725084 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-767e8f08-c424-47cc-a55e-c94b9cce89a8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:06:14.856627 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-767e8f08-c424-47cc-a55e-c94b9cce89a8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:06:14.864211 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-767e8f08-c424-47cc-a55e-c94b9cce89a8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b" status: 200 len: 1565 microversion: 2.1 time: 0.150940 Jun 10 19:06:14.864941 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4311/7933] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:06:14 2022] GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:06:16.819058 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-119317d0-a9f1-43b4-b3ec-1bbda6563714 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:06:16.820410 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-119317d0-a9f1-43b4-b3ec-1bbda6563714 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 5d49625a-3957-43e2-84b0-592e5f82515b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:06:16.827425 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-119317d0-a9f1-43b4-b3ec-1bbda6563714 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:06:16.827887 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-119317d0-a9f1-43b4-b3ec-1bbda6563714 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:06:16.828809 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-119317d0-a9f1-43b4-b3ec-1bbda6563714 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:06:16.829238 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-119317d0-a9f1-43b4-b3ec-1bbda6563714 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:06:16.975124 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-119317d0-a9f1-43b4-b3ec-1bbda6563714 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:06:16.983321 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-119317d0-a9f1-43b4-b3ec-1bbda6563714 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b" status: 200 len: 1565 microversion: 2.1 time: 0.168873 Jun 10 19:06:16.983913 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4312/7934] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:06:16 2022] GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:06:16.988773 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-71182492-8e70-4230-adc8-d54ea1d6b44b req-4f470831-c83d-444e-8110-c3a1289ef4f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d49625a-3957-43e2-84b0-592e5f82515b", "tag": "e8253be4-64ef-44c1-9fb5-094e7e477511"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:06:17.004811 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-71182492-8e70-4230-adc8-d54ea1d6b44b req-4f470831-c83d-444e-8110-c3a1289ef4f5 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:06:17.005268 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-71182492-8e70-4230-adc8-d54ea1d6b44b req-4f470831-c83d-444e-8110-c3a1289ef4f5 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:06:17.017329 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-71182492-8e70-4230-adc8-d54ea1d6b44b req-4f470831-c83d-444e-8110-c3a1289ef4f5 service nova] Creating event network-changed:e8253be4-64ef-44c1-9fb5-094e7e477511 for instance 5d49625a-3957-43e2-84b0-592e5f82515b on chh2-master-2 Jun 10 19:06:17.022355 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-71182492-8e70-4230-adc8-d54ea1d6b44b req-4f470831-c83d-444e-8110-c3a1289ef4f5 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037291 Jun 10 19:06:17.023519 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4313/7935] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:06:50.272122 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:06:50.272930 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=86 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:06:50.277737 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-02ac1605-f6af-454d-9295-7bd03b9ef76d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:06:50.278777 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-02ac1605-f6af-454d-9295-7bd03b9ef76d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 5d49625a-3957-43e2-84b0-592e5f82515b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:06:50.284885 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02ac1605-f6af-454d-9295-7bd03b9ef76d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:06:50.285336 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02ac1605-f6af-454d-9295-7bd03b9ef76d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:06:50.286096 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02ac1605-f6af-454d-9295-7bd03b9ef76d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:06:50.286529 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-02ac1605-f6af-454d-9295-7bd03b9ef76d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:06:50.347131 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-02ac1605-f6af-454d-9295-7bd03b9ef76d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "POST /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b/action" status: 200 len: 24568 microversion: 2.1 time: 0.077312 Jun 10 19:06:50.347894 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4314/7936] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 19:06:50 2022] POST /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b/action => generated 24568 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 10 19:07:20.573088 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7ab12289-fbb6-4e0d-bbbc-58433c999e28 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:07:20.573716 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7ab12289-fbb6-4e0d-bbbc-58433c999e28 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 5d49625a-3957-43e2-84b0-592e5f82515b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:07:20.576746 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:07:20.582187 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7ab12289-fbb6-4e0d-bbbc-58433c999e28 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:20.582640 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7ab12289-fbb6-4e0d-bbbc-58433c999e28 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:20.583394 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7ab12289-fbb6-4e0d-bbbc-58433c999e28 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:20.583875 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7ab12289-fbb6-4e0d-bbbc-58433c999e28 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:20.785376 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7ab12289-fbb6-4e0d-bbbc-58433c999e28 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "POST /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b/action" status: 202 len: 0 microversion: 2.1 time: 0.216952 Jun 10 19:07:20.786084 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4315/7937] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 19:07:20 2022] POST /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 19:07:20.794527 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a4ee5b3c-596a-4f42-8eca-ad5d3f2459b9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:07:20.795222 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a4ee5b3c-596a-4f42-8eca-ad5d3f2459b9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 5d49625a-3957-43e2-84b0-592e5f82515b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:07:20.801505 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a4ee5b3c-596a-4f42-8eca-ad5d3f2459b9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:20.801945 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a4ee5b3c-596a-4f42-8eca-ad5d3f2459b9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:20.802717 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a4ee5b3c-596a-4f42-8eca-ad5d3f2459b9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:20.803153 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a4ee5b3c-596a-4f42-8eca-ad5d3f2459b9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:20.942976 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a4ee5b3c-596a-4f42-8eca-ad5d3f2459b9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:07:20.950713 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a4ee5b3c-596a-4f42-8eca-ad5d3f2459b9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b" status: 200 len: 1689 microversion: 2.1 time: 0.160241 Jun 10 19:07:20.951293 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4316/7938] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:07:20 2022] GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:07:21.967424 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ee3ca529-653d-4088-9b0f-013ad850917c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:07:21.968074 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ee3ca529-653d-4088-9b0f-013ad850917c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 5d49625a-3957-43e2-84b0-592e5f82515b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:07:21.975085 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee3ca529-653d-4088-9b0f-013ad850917c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:21.975534 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee3ca529-653d-4088-9b0f-013ad850917c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:21.976295 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee3ca529-653d-4088-9b0f-013ad850917c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:21.976757 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee3ca529-653d-4088-9b0f-013ad850917c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:22.109955 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ee3ca529-653d-4088-9b0f-013ad850917c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:07:22.117808 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ee3ca529-653d-4088-9b0f-013ad850917c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b" status: 200 len: 1669 microversion: 2.1 time: 0.154297 Jun 10 19:07:22.118918 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4317/7939] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:07:21 2022] GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b => generated 1669 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:07:23.204287 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1bafda6f-e382-4fe9-85c5-e98cdf70900e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:07:23.205285 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1bafda6f-e382-4fe9-85c5-e98cdf70900e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 5d49625a-3957-43e2-84b0-592e5f82515b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:07:23.212876 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1bafda6f-e382-4fe9-85c5-e98cdf70900e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:23.213336 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1bafda6f-e382-4fe9-85c5-e98cdf70900e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:23.214103 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1bafda6f-e382-4fe9-85c5-e98cdf70900e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:23.214547 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1bafda6f-e382-4fe9-85c5-e98cdf70900e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:23.275805 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1bafda6f-e382-4fe9-85c5-e98cdf70900e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "POST /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b/action" status: 200 len: 32638 microversion: 2.1 time: 0.074515 Jun 10 19:07:23.276361 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4318/7940] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 19:07:23 2022] POST /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b/action => generated 32638 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 10 19:07:23.287237 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-45e2ff87-3362-4acc-a2d8-41d465a289e2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:07:23.287855 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-45e2ff87-3362-4acc-a2d8-41d465a289e2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 5d49625a-3957-43e2-84b0-592e5f82515b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:07:23.294973 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45e2ff87-3362-4acc-a2d8-41d465a289e2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:23.295434 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45e2ff87-3362-4acc-a2d8-41d465a289e2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:23.296197 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45e2ff87-3362-4acc-a2d8-41d465a289e2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:23.296663 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45e2ff87-3362-4acc-a2d8-41d465a289e2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:23.524545 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-45e2ff87-3362-4acc-a2d8-41d465a289e2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "POST /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b/action" status: 202 len: 0 microversion: 2.1 time: 0.240823 Jun 10 19:07:23.525193 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4319/7941] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 19:07:23 2022] POST /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 19:07:23.533505 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4d238709-e1fa-44fd-9f3a-f24947b0fa0c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:07:23.534132 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4d238709-e1fa-44fd-9f3a-f24947b0fa0c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 5d49625a-3957-43e2-84b0-592e5f82515b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:07:23.540448 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d238709-e1fa-44fd-9f3a-f24947b0fa0c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:23.540908 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d238709-e1fa-44fd-9f3a-f24947b0fa0c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:23.541680 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d238709-e1fa-44fd-9f3a-f24947b0fa0c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:23.542138 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d238709-e1fa-44fd-9f3a-f24947b0fa0c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:23.676194 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4d238709-e1fa-44fd-9f3a-f24947b0fa0c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:07:23.684684 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4d238709-e1fa-44fd-9f3a-f24947b0fa0c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b" status: 200 len: 1676 microversion: 2.1 time: 0.155149 Jun 10 19:07:23.685263 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4320/7942] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:07:23 2022] GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:07:24.703172 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-aac4c6fe-5125-4231-afa0-79ba9004cb4d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:07:24.703747 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-aac4c6fe-5125-4231-afa0-79ba9004cb4d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 5d49625a-3957-43e2-84b0-592e5f82515b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:07:24.710727 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aac4c6fe-5125-4231-afa0-79ba9004cb4d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:24.711189 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aac4c6fe-5125-4231-afa0-79ba9004cb4d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:24.711958 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aac4c6fe-5125-4231-afa0-79ba9004cb4d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:24.712437 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-aac4c6fe-5125-4231-afa0-79ba9004cb4d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:24.847321 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-aac4c6fe-5125-4231-afa0-79ba9004cb4d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:07:24.855605 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-aac4c6fe-5125-4231-afa0-79ba9004cb4d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b" status: 200 len: 1684 microversion: 2.1 time: 0.156398 Jun 10 19:07:24.856207 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4321/7943] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:07:24 2022] GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:07:24.944660 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-89abbff8-1609-4771-bc36-91db290fdea4 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:07:24.945660 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-89abbff8-1609-4771-bc36-91db290fdea4 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 5d49625a-3957-43e2-84b0-592e5f82515b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:07:24.951667 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-89abbff8-1609-4771-bc36-91db290fdea4 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:24.952110 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-89abbff8-1609-4771-bc36-91db290fdea4 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:24.952890 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-89abbff8-1609-4771-bc36-91db290fdea4 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:24.953378 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-89abbff8-1609-4771-bc36-91db290fdea4 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:25.011215 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-89abbff8-1609-4771-bc36-91db290fdea4 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "POST /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b/action" status: 200 len: 38456 microversion: 2.1 time: 0.070307 Jun 10 19:07:25.012112 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4322/7944] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 19:07:24 2022] POST /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b/action => generated 38456 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 10 19:07:26.057088 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4765ee8c-2149-41ef-a635-0b25edee5fe3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:07:26.057791 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4765ee8c-2149-41ef-a635-0b25edee5fe3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 5d49625a-3957-43e2-84b0-592e5f82515b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:07:26.065415 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4765ee8c-2149-41ef-a635-0b25edee5fe3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:26.065950 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4765ee8c-2149-41ef-a635-0b25edee5fe3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:26.066791 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4765ee8c-2149-41ef-a635-0b25edee5fe3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:26.067311 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4765ee8c-2149-41ef-a635-0b25edee5fe3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:26.091726 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4765ee8c-2149-41ef-a635-0b25edee5fe3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 5d49625a-3957-43e2-84b0-592e5f82515b] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 19:07:26.424272 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4765ee8c-2149-41ef-a635-0b25edee5fe3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "DELETE /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b" status: 204 len: 0 microversion: 2.1 time: 0.372038 Jun 10 19:07:26.424911 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4323/7945] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 19:07:26 2022] DELETE /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 19:07:26.430075 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-8b12ad3d-fa71-4372-bf68-758259dfd7f0 req-221549ad-1d05-453c-8156-b88706ae8e9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d49625a-3957-43e2-84b0-592e5f82515b", "tag": "e8253be4-64ef-44c1-9fb5-094e7e477511"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:07:26.439776 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-8b12ad3d-fa71-4372-bf68-758259dfd7f0 req-221549ad-1d05-453c-8156-b88706ae8e9e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:26.440216 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-8b12ad3d-fa71-4372-bf68-758259dfd7f0 req-221549ad-1d05-453c-8156-b88706ae8e9e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:26.451560 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-8b12ad3d-fa71-4372-bf68-758259dfd7f0 req-221549ad-1d05-453c-8156-b88706ae8e9e service nova] Creating event network-changed:e8253be4-64ef-44c1-9fb5-094e7e477511 for instance 5d49625a-3957-43e2-84b0-592e5f82515b on chh2-master-2 Jun 10 19:07:26.456396 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-8b12ad3d-fa71-4372-bf68-758259dfd7f0 req-221549ad-1d05-453c-8156-b88706ae8e9e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030175 Jun 10 19:07:26.457015 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4324/7946] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:07:26.462067 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-96375357-da56-41de-9371-2332ff8a4441 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:07:26.462785 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-96375357-da56-41de-9371-2332ff8a4441 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 5d49625a-3957-43e2-84b0-592e5f82515b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:07:26.469027 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-96375357-da56-41de-9371-2332ff8a4441 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:26.469486 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-96375357-da56-41de-9371-2332ff8a4441 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:26.470255 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-96375357-da56-41de-9371-2332ff8a4441 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:26.470700 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-96375357-da56-41de-9371-2332ff8a4441 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:26.609626 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-96375357-da56-41de-9371-2332ff8a4441 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:07:26.617692 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-96375357-da56-41de-9371-2332ff8a4441 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b" status: 200 len: 1690 microversion: 2.1 time: 0.159548 Jun 10 19:07:26.618789 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4325/7947] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:07:26 2022] GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:07:27.636156 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-68885d5e-1e12-4b11-8c97-1a4d94daa9fe tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:07:27.636778 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-68885d5e-1e12-4b11-8c97-1a4d94daa9fe tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 5d49625a-3957-43e2-84b0-592e5f82515b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:07:27.643619 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-68885d5e-1e12-4b11-8c97-1a4d94daa9fe tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:27.644074 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-68885d5e-1e12-4b11-8c97-1a4d94daa9fe tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:27.644869 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-68885d5e-1e12-4b11-8c97-1a4d94daa9fe tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:27.645312 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-68885d5e-1e12-4b11-8c97-1a4d94daa9fe tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:27.785562 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-68885d5e-1e12-4b11-8c97-1a4d94daa9fe tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:07:27.793475 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-68885d5e-1e12-4b11-8c97-1a4d94daa9fe tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b" status: 200 len: 1690 microversion: 2.1 time: 0.161863 Jun 10 19:07:27.794058 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4326/7948] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:07:27 2022] GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:07:28.810787 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f2613830-deff-4f23-b79b-b8c6e8e62b52 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:07:28.811463 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f2613830-deff-4f23-b79b-b8c6e8e62b52 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 5d49625a-3957-43e2-84b0-592e5f82515b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:07:28.818260 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f2613830-deff-4f23-b79b-b8c6e8e62b52 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:28.818724 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f2613830-deff-4f23-b79b-b8c6e8e62b52 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:28.819502 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f2613830-deff-4f23-b79b-b8c6e8e62b52 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:28.819948 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f2613830-deff-4f23-b79b-b8c6e8e62b52 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:28.882101 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f2613830-deff-4f23-b79b-b8c6e8e62b52 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:07:28.889690 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f2613830-deff-4f23-b79b-b8c6e8e62b52 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b" status: 200 len: 1503 microversion: 2.1 time: 0.082828 Jun 10 19:07:28.890798 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4327/7949] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:07:28 2022] GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b => generated 1503 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:07:29.010010 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-95223b67-8eb3-444f-8447-98f1358aae54 req-8a71f4a7-c483-4426-9445-4b5aef6a3bf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d49625a-3957-43e2-84b0-592e5f82515b", "name": "network-vif-deleted", "tag": "e8253be4-64ef-44c1-9fb5-094e7e477511"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:07:29.018270 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-95223b67-8eb3-444f-8447-98f1358aae54 req-8a71f4a7-c483-4426-9445-4b5aef6a3bf2 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:29.018725 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-95223b67-8eb3-444f-8447-98f1358aae54 req-8a71f4a7-c483-4426-9445-4b5aef6a3bf2 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:29.032811 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-95223b67-8eb3-444f-8447-98f1358aae54 req-8a71f4a7-c483-4426-9445-4b5aef6a3bf2 service nova] Creating event network-vif-deleted:e8253be4-64ef-44c1-9fb5-094e7e477511 for instance 5d49625a-3957-43e2-84b0-592e5f82515b on chh2-master-2 Jun 10 19:07:29.037571 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-95223b67-8eb3-444f-8447-98f1358aae54 req-8a71f4a7-c483-4426-9445-4b5aef6a3bf2 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084153 Jun 10 19:07:29.038162 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4328/7950] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:07:29.907459 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fe45984c-30cd-4728-b6df-dd1732213b62 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:07:29.908284 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fe45984c-30cd-4728-b6df-dd1732213b62 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 5d49625a-3957-43e2-84b0-592e5f82515b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:07:29.918058 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fe45984c-30cd-4728-b6df-dd1732213b62 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:29.918447 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fe45984c-30cd-4728-b6df-dd1732213b62 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:29.919241 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fe45984c-30cd-4728-b6df-dd1732213b62 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:29.919694 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fe45984c-30cd-4728-b6df-dd1732213b62 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:29.953189 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fe45984c-30cd-4728-b6df-dd1732213b62 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:29.953646 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fe45984c-30cd-4728-b6df-dd1732213b62 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:29.954101 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-fe45984c-30cd-4728-b6df-dd1732213b62 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lazy-loading 'fault' on Instance uuid 5d49625a-3957-43e2-84b0-592e5f82515b {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 19:07:29.957033 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:07:29.998269 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fe45984c-30cd-4728-b6df-dd1732213b62 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:07:30.006257 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fe45984c-30cd-4728-b6df-dd1732213b62 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b" status: 200 len: 1356 microversion: 2.1 time: 0.102997 Jun 10 19:07:30.006841 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4329/7951] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:07:29 2022] GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b => generated 1356 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:07:31.023190 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-51bf62eb-bbbf-4222-9fcc-3bc2ab13813f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:07:31.023841 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-51bf62eb-bbbf-4222-9fcc-3bc2ab13813f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 5d49625a-3957-43e2-84b0-592e5f82515b] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:07:31.031144 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-51bf62eb-bbbf-4222-9fcc-3bc2ab13813f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:31.031599 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-51bf62eb-bbbf-4222-9fcc-3bc2ab13813f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:31.032400 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-51bf62eb-bbbf-4222-9fcc-3bc2ab13813f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:31.032845 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-51bf62eb-bbbf-4222-9fcc-3bc2ab13813f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:31.046074 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-51bf62eb-bbbf-4222-9fcc-3bc2ab13813f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] HTTP exception thrown: Instance 5d49625a-3957-43e2-84b0-592e5f82515b could not be found. Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-51bf62eb-bbbf-4222-9fcc-3bc2ab13813f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Request method failure captured: Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b HTTP/1.1 Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5YPAQIj2rjg21dP-hUkWvxTBbenKqLrs8X-dpl0gh5SlblRc7YzYXxJQF7OQJ04iiajVs3_DtHbkXtpyH9RfjMCCLWxpP-pI5ZbkVRrg8NY9qs7N4ZrPXBXmIPChYaWOg__AcNo6wiv5vK4jl8UssW1Gbox3NB6dpu_4KvF6u5DG7s Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 69f65fbabf1d4b85aa3ec38f0e4efe11 Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2031160215 Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/69f65fbabf1d4b85aa3ec38f0e4efe11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/69f65fbabf1d4b85aa3ec38f0e4efe11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/69f65fbabf1d4b85aa3ec38f0e4efe11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_69f65fbabf1d4b85aa3ec38f0e4efe11", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2031160215 Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 69f65fbabf1d4b85aa3ec38f0e4efe11 Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2031160215 Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-TestNetworkAdvancedServerOps-2031160215-project Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: c75f5f98f96946e18c2e665b7f59f75d Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2031160215-project Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 5d49625a-3957-43e2-84b0-592e5f82515b could not be found. Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '5d49625a-3957-43e2-84b0-592e5f82515b'} Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d49625a-3957-43e2-84b0-592e5f82515b could not be found. Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d49625a-3957-43e2-84b0-592e5f82515b could not be found. Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:07:31.047707 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:07:31.051639 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:07:31.051639 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:07:31.051639 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:07:31.051639 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:07:31.051639 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 19:07:31.051639 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 19:07:31.051639 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d49625a-3957-43e2-84b0-592e5f82515b could not be found. Jun 10 19:07:31.051639 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:07:31.051639 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-51bf62eb-bbbf-4222-9fcc-3bc2ab13813f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Returning 404 to user: Instance 5d49625a-3957-43e2-84b0-592e5f82515b could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 19:07:31.051639 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-51bf62eb-bbbf-4222-9fcc-3bc2ab13813f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b" status: 404 len: 111 microversion: 2.1 time: 0.030087 Jun 10 19:07:31.051639 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4330/7952] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:07:31 2022] GET /compute/v2.1/servers/5d49625a-3957-43e2-84b0-592e5f82515b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 19:07:34.771499 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1e0180ac-258b-4cda-b430-401e114bd221 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '.version_select at 0x7f77c1618e50>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:07:34.868634 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1e0180ac-258b-4cda-b430-401e114bd221 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2019307129" status: 202 len: 0 microversion: 2.1 time: 0.101887 Jun 10 19:07:34.869167 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4331/7953] 10.222.0.35 () {58 vars in 1283 bytes} [Fri Jun 10 19:07:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2019307129 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 19:07:34.897036 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e14ef9e3-6bba-4b70-ba0a-e69c16b7b27b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Action: 'create', calling method: .version_select at 0x7f77c0228b80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-238692839", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEP4zZMy0VdUOFqJgMj3v3vyhkXTCJ0jAsK7JQQJvB5uRjeXey43E2EeUmE2ZsgivfQKKgKuAuVMVjPUsg7scIWAi0zyHrLoI7oULe+qwdntUJTzAuAcRauFP4axVse3mA=="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:07:34.912563 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-e14ef9e3-6bba-4b70-ba0a-e69c16b7b27b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Getting quotas for project 69f65fbabf1d4b85aa3ec38f0e4efe11. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 19:07:34.918333 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-e14ef9e3-6bba-4b70-ba0a-e69c16b7b27b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Getting quotas for user c75f5f98f96946e18c2e665b7f59f75d and project 69f65fbabf1d4b85aa3ec38f0e4efe11. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 19:07:35.042952 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e14ef9e3-6bba-4b70-ba0a-e69c16b7b27b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.149808 Jun 10 19:07:35.043582 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4332/7954] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 19:07:34 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:07:42.899209 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5cfee6eb-9eb9-469a-bb2d-e9a58b7466d9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-843712747", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "b1f196dd-a24f-449e-bfac-9b99e89caa85"}], "key_name": "tempest-TestNetworkAdvancedServerOps-238692839", "security_groups": [{"name": "tempest-secgroup-smoke-2060744743"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:07:43.045949 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-5cfee6eb-9eb9-469a-bb2d-e9a58b7466d9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] validate_networks() for [('b1f196dd-a24f-449e-bfac-9b99e89caa85', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 19:07:43.505422 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-5cfee6eb-9eb9-469a-bb2d-e9a58b7466d9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 19:07:43.505866 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-5cfee6eb-9eb9-469a-bb2d-e9a58b7466d9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 19:07:43.506684 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-5cfee6eb-9eb9-469a-bb2d-e9a58b7466d9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 19:07:43.507096 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-5cfee6eb-9eb9-469a-bb2d-e9a58b7466d9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 19:07:43.507889 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-5cfee6eb-9eb9-469a-bb2d-e9a58b7466d9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 19:07:43.517484 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5cfee6eb-9eb9-469a-bb2d-e9a58b7466d9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:43.517933 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5cfee6eb-9eb9-469a-bb2d-e9a58b7466d9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:43.518737 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5cfee6eb-9eb9-469a-bb2d-e9a58b7466d9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:43.519321 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5cfee6eb-9eb9-469a-bb2d-e9a58b7466d9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:43.537227 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-5cfee6eb-9eb9-469a-bb2d-e9a58b7466d9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Getting quotas for project 69f65fbabf1d4b85aa3ec38f0e4efe11. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 19:07:43.542911 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-5cfee6eb-9eb9-469a-bb2d-e9a58b7466d9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Getting quotas for user c75f5f98f96946e18c2e665b7f59f75d and project 69f65fbabf1d4b85aa3ec38f0e4efe11. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 19:07:43.556177 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5cfee6eb-9eb9-469a-bb2d-e9a58b7466d9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 19:07:43.559049 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5cfee6eb-9eb9-469a-bb2d-e9a58b7466d9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 393356f4-597d-4bad-bf7d-0a2838bd9548] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 19:07:43.672886 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5cfee6eb-9eb9-469a-bb2d-e9a58b7466d9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.778100 Jun 10 19:07:43.673955 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4333/7955] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 19:07:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 10 19:07:43.690088 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-240c6490-971e-4a29-a644-061125781c62 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:07:43.690970 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-240c6490-971e-4a29-a644-061125781c62 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 393356f4-597d-4bad-bf7d-0a2838bd9548] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:07:43.783803 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-240c6490-971e-4a29-a644-061125781c62 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:07:43.792240 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-240c6490-971e-4a29-a644-061125781c62 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548" status: 200 len: 1265 microversion: 2.1 time: 0.110088 Jun 10 19:07:43.801264 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4334/7956] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:07:43 2022] GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548 => generated 1265 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:07:44.814273 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-741ad0b8-a99c-4fcb-9656-546054613c4c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:07:44.814273 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-741ad0b8-a99c-4fcb-9656-546054613c4c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 393356f4-597d-4bad-bf7d-0a2838bd9548] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:07:44.837682 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-741ad0b8-a99c-4fcb-9656-546054613c4c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:44.838234 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-741ad0b8-a99c-4fcb-9656-546054613c4c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:44.843771 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-741ad0b8-a99c-4fcb-9656-546054613c4c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:44.843771 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-741ad0b8-a99c-4fcb-9656-546054613c4c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:44.926334 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-741ad0b8-a99c-4fcb-9656-546054613c4c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:07:44.933320 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-741ad0b8-a99c-4fcb-9656-546054613c4c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548" status: 200 len: 1269 microversion: 2.1 time: 0.128005 Jun 10 19:07:44.934834 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4335/7957] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:07:44 2022] GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548 => generated 1269 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:07:45.951828 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a5d4b5d4-cdfa-447a-96fb-6460200233e7 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:07:45.955460 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a5d4b5d4-cdfa-447a-96fb-6460200233e7 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 393356f4-597d-4bad-bf7d-0a2838bd9548] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:07:45.959678 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a5d4b5d4-cdfa-447a-96fb-6460200233e7 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:45.960132 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a5d4b5d4-cdfa-447a-96fb-6460200233e7 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:45.960932 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a5d4b5d4-cdfa-447a-96fb-6460200233e7 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:45.961366 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a5d4b5d4-cdfa-447a-96fb-6460200233e7 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:46.028388 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a5d4b5d4-cdfa-447a-96fb-6460200233e7 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:07:46.036054 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a5d4b5d4-cdfa-447a-96fb-6460200233e7 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548" status: 200 len: 1335 microversion: 2.1 time: 0.088789 Jun 10 19:07:46.036662 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4336/7958] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:07:45 2022] GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548 => generated 1335 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:07:47.055337 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b7a09b45-6ffd-45db-a69a-ec68ca7eec6e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:07:47.055938 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b7a09b45-6ffd-45db-a69a-ec68ca7eec6e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 393356f4-597d-4bad-bf7d-0a2838bd9548] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:07:47.063211 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b7a09b45-6ffd-45db-a69a-ec68ca7eec6e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:47.063693 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b7a09b45-6ffd-45db-a69a-ec68ca7eec6e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:47.064519 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b7a09b45-6ffd-45db-a69a-ec68ca7eec6e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:47.064967 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b7a09b45-6ffd-45db-a69a-ec68ca7eec6e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:47.203911 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b7a09b45-6ffd-45db-a69a-ec68ca7eec6e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:07:47.212229 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b7a09b45-6ffd-45db-a69a-ec68ca7eec6e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548" status: 200 len: 1391 microversion: 2.1 time: 0.162967 Jun 10 19:07:47.214138 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4337/7959] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:07:47 2022] GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548 => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:07:47.751265 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-ef551537-6760-4835-a1f0-c71a676599d9 req-6b0913f7-8e9f-4e7e-a342-f37d287ed40a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "393356f4-597d-4bad-bf7d-0a2838bd9548", "tag": "17031852-6c9e-4fed-8dad-72a340633171"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:07:47.764017 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-ef551537-6760-4835-a1f0-c71a676599d9 req-6b0913f7-8e9f-4e7e-a342-f37d287ed40a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:47.764586 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-ef551537-6760-4835-a1f0-c71a676599d9 req-6b0913f7-8e9f-4e7e-a342-f37d287ed40a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:47.780750 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-ef551537-6760-4835-a1f0-c71a676599d9 req-6b0913f7-8e9f-4e7e-a342-f37d287ed40a service nova] Creating event network-changed:17031852-6c9e-4fed-8dad-72a340633171 for instance 393356f4-597d-4bad-bf7d-0a2838bd9548 on chh1-master-2 Jun 10 19:07:47.785941 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-ef551537-6760-4835-a1f0-c71a676599d9 req-6b0913f7-8e9f-4e7e-a342-f37d287ed40a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038986 Jun 10 19:07:47.788746 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4338/7960] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:07:48.232447 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5663560a-1208-4649-8a86-e9adc8065d88 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:07:48.233067 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5663560a-1208-4649-8a86-e9adc8065d88 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 393356f4-597d-4bad-bf7d-0a2838bd9548] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:07:48.239555 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5663560a-1208-4649-8a86-e9adc8065d88 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:48.240013 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5663560a-1208-4649-8a86-e9adc8065d88 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:48.240823 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5663560a-1208-4649-8a86-e9adc8065d88 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:48.241264 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5663560a-1208-4649-8a86-e9adc8065d88 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:48.376263 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5663560a-1208-4649-8a86-e9adc8065d88 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:07:48.383860 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5663560a-1208-4649-8a86-e9adc8065d88 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548" status: 200 len: 1391 microversion: 2.1 time: 0.157197 Jun 10 19:07:48.384458 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4339/7961] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:07:48 2022] GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:07:49.400582 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-520efee5-49d2-4968-a7a9-5de86a0f8e32 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:07:49.401183 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-520efee5-49d2-4968-a7a9-5de86a0f8e32 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 393356f4-597d-4bad-bf7d-0a2838bd9548] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:07:49.408196 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-520efee5-49d2-4968-a7a9-5de86a0f8e32 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:49.408696 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-520efee5-49d2-4968-a7a9-5de86a0f8e32 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:49.409462 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-520efee5-49d2-4968-a7a9-5de86a0f8e32 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:49.409908 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-520efee5-49d2-4968-a7a9-5de86a0f8e32 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:49.538686 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-520efee5-49d2-4968-a7a9-5de86a0f8e32 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:07:49.546401 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-520efee5-49d2-4968-a7a9-5de86a0f8e32 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548" status: 200 len: 1391 microversion: 2.1 time: 0.149847 Jun 10 19:07:49.546976 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4340/7962] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:07:49 2022] GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548 => generated 1391 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:07:50.563363 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d6b3ee10-8d9e-44e5-be70-8afc3b230d44 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:07:50.563986 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d6b3ee10-8d9e-44e5-be70-8afc3b230d44 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 393356f4-597d-4bad-bf7d-0a2838bd9548] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:07:50.571127 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d6b3ee10-8d9e-44e5-be70-8afc3b230d44 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:50.571538 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d6b3ee10-8d9e-44e5-be70-8afc3b230d44 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:50.572331 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d6b3ee10-8d9e-44e5-be70-8afc3b230d44 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:50.573282 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d6b3ee10-8d9e-44e5-be70-8afc3b230d44 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:50.704856 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d6b3ee10-8d9e-44e5-be70-8afc3b230d44 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:07:50.712506 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d6b3ee10-8d9e-44e5-be70-8afc3b230d44 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548" status: 200 len: 1391 microversion: 2.1 time: 0.152995 Jun 10 19:07:50.713132 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4341/7963] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:07:50 2022] GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548 => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:07:51.730134 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7dc4f9ce-7d16-4a89-94f3-7004c745ff38 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:07:51.730784 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7dc4f9ce-7d16-4a89-94f3-7004c745ff38 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 393356f4-597d-4bad-bf7d-0a2838bd9548] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:07:51.733524 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:07:51.738435 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7dc4f9ce-7d16-4a89-94f3-7004c745ff38 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:51.745182 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7dc4f9ce-7d16-4a89-94f3-7004c745ff38 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:51.745182 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7dc4f9ce-7d16-4a89-94f3-7004c745ff38 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:51.745182 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7dc4f9ce-7d16-4a89-94f3-7004c745ff38 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:51.879635 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7dc4f9ce-7d16-4a89-94f3-7004c745ff38 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:07:51.888278 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7dc4f9ce-7d16-4a89-94f3-7004c745ff38 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548" status: 200 len: 1391 microversion: 2.1 time: 0.162058 Jun 10 19:07:51.889533 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4342/7964] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:07:51 2022] GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:07:52.906745 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cee24e29-bfe7-4fad-95db-ed9ede2ba47d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:07:52.907375 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cee24e29-bfe7-4fad-95db-ed9ede2ba47d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 393356f4-597d-4bad-bf7d-0a2838bd9548] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:07:52.914419 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cee24e29-bfe7-4fad-95db-ed9ede2ba47d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:52.914885 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cee24e29-bfe7-4fad-95db-ed9ede2ba47d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:52.915659 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cee24e29-bfe7-4fad-95db-ed9ede2ba47d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:52.916104 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cee24e29-bfe7-4fad-95db-ed9ede2ba47d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:53.049455 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cee24e29-bfe7-4fad-95db-ed9ede2ba47d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:07:53.057567 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cee24e29-bfe7-4fad-95db-ed9ede2ba47d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548" status: 200 len: 1391 microversion: 2.1 time: 0.154459 Jun 10 19:07:53.058153 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4343/7965] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:07:52 2022] GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:07:53.117760 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-9553a146-dfd7-4d1d-9bdc-84a4ba2e6792 req-f2eaa178-aaf1-426d-8695-407e3eeb9d88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "393356f4-597d-4bad-bf7d-0a2838bd9548", "name": "network-vif-plugged", "status": "completed", "tag": "17031852-6c9e-4fed-8dad-72a340633171"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:07:53.126499 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-9553a146-dfd7-4d1d-9bdc-84a4ba2e6792 req-f2eaa178-aaf1-426d-8695-407e3eeb9d88 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:53.126945 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-9553a146-dfd7-4d1d-9bdc-84a4ba2e6792 req-f2eaa178-aaf1-426d-8695-407e3eeb9d88 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:53.138212 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-9553a146-dfd7-4d1d-9bdc-84a4ba2e6792 req-f2eaa178-aaf1-426d-8695-407e3eeb9d88 service nova] Creating event network-vif-plugged:17031852-6c9e-4fed-8dad-72a340633171 for instance 393356f4-597d-4bad-bf7d-0a2838bd9548 on chh1-master-2 Jun 10 19:07:53.143239 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-9553a146-dfd7-4d1d-9bdc-84a4ba2e6792 req-f2eaa178-aaf1-426d-8695-407e3eeb9d88 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083985 Jun 10 19:07:53.143900 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4344/7966] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:07:54.071791 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:07:54.072638 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=12 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:07:54.077508 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-401c1f9e-1d6a-4e20-97bc-5a38393edece tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:07:54.078209 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-401c1f9e-1d6a-4e20-97bc-5a38393edece tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 393356f4-597d-4bad-bf7d-0a2838bd9548] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:07:54.084436 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-401c1f9e-1d6a-4e20-97bc-5a38393edece tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:54.084887 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-401c1f9e-1d6a-4e20-97bc-5a38393edece tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:54.085648 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-401c1f9e-1d6a-4e20-97bc-5a38393edece tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:54.086133 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-401c1f9e-1d6a-4e20-97bc-5a38393edece tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:54.226252 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-401c1f9e-1d6a-4e20-97bc-5a38393edece tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:07:54.233817 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-401c1f9e-1d6a-4e20-97bc-5a38393edece tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548" status: 200 len: 1391 microversion: 2.1 time: 0.162991 Jun 10 19:07:54.234403 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4345/7967] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:07:54 2022] GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:07:55.250059 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3f180c1f-fda5-4898-ac2d-762d7c240266 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:07:55.250662 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3f180c1f-fda5-4898-ac2d-762d7c240266 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 393356f4-597d-4bad-bf7d-0a2838bd9548] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:07:55.257565 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3f180c1f-fda5-4898-ac2d-762d7c240266 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:55.258013 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3f180c1f-fda5-4898-ac2d-762d7c240266 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:55.258782 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3f180c1f-fda5-4898-ac2d-762d7c240266 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:55.259235 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3f180c1f-fda5-4898-ac2d-762d7c240266 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:55.388765 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3f180c1f-fda5-4898-ac2d-762d7c240266 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:07:55.396288 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3f180c1f-fda5-4898-ac2d-762d7c240266 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548" status: 200 len: 1563 microversion: 2.1 time: 0.150096 Jun 10 19:07:55.396881 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4346/7968] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:07:55 2022] GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548 => generated 1563 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:07:55.412530 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4d4138cb-da79-4743-bce6-02ac2706818e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:07:55.413177 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4d4138cb-da79-4743-bce6-02ac2706818e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 393356f4-597d-4bad-bf7d-0a2838bd9548] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:07:55.419675 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d4138cb-da79-4743-bce6-02ac2706818e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:55.419675 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d4138cb-da79-4743-bce6-02ac2706818e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:55.420497 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d4138cb-da79-4743-bce6-02ac2706818e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:55.420969 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4d4138cb-da79-4743-bce6-02ac2706818e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:55.552403 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4d4138cb-da79-4743-bce6-02ac2706818e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:07:55.560647 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4d4138cb-da79-4743-bce6-02ac2706818e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548" status: 200 len: 1563 microversion: 2.1 time: 0.151815 Jun 10 19:07:55.561224 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4347/7969] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:07:55 2022] GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:07:57.673372 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5201e9e3-a60b-4cda-93d5-875639486439 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:07:57.673971 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5201e9e3-a60b-4cda-93d5-875639486439 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 393356f4-597d-4bad-bf7d-0a2838bd9548] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:07:57.681219 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5201e9e3-a60b-4cda-93d5-875639486439 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:57.681676 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5201e9e3-a60b-4cda-93d5-875639486439 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:57.682970 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5201e9e3-a60b-4cda-93d5-875639486439 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:57.683435 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5201e9e3-a60b-4cda-93d5-875639486439 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:57.819878 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5201e9e3-a60b-4cda-93d5-875639486439 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:07:57.828848 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5201e9e3-a60b-4cda-93d5-875639486439 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548" status: 200 len: 1563 microversion: 2.1 time: 0.159467 Jun 10 19:07:57.829441 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4348/7970] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:07:57 2022] GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548 => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:07:57.834190 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-203fc8c1-6fb2-4381-9b77-9346424fd32e req-977c894e-d604-4802-bb7f-5d8ed3be6703 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "393356f4-597d-4bad-bf7d-0a2838bd9548", "tag": "17031852-6c9e-4fed-8dad-72a340633171"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:07:57.842817 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-203fc8c1-6fb2-4381-9b77-9346424fd32e req-977c894e-d604-4802-bb7f-5d8ed3be6703 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:07:57.843391 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-203fc8c1-6fb2-4381-9b77-9346424fd32e req-977c894e-d604-4802-bb7f-5d8ed3be6703 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:07:57.855652 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-203fc8c1-6fb2-4381-9b77-9346424fd32e req-977c894e-d604-4802-bb7f-5d8ed3be6703 service nova] Creating event network-changed:17031852-6c9e-4fed-8dad-72a340633171 for instance 393356f4-597d-4bad-bf7d-0a2838bd9548 on chh1-master-2 Jun 10 19:07:57.861005 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-203fc8c1-6fb2-4381-9b77-9346424fd32e req-977c894e-d604-4802-bb7f-5d8ed3be6703 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030320 Jun 10 19:07:57.861858 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4349/7971] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:08:20.143207 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=15 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:08:20.143968 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=84 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:08:20.148233 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-231bfa97-f100-4d00-8fde-65f2190eccdd tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:08:20.149307 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-231bfa97-f100-4d00-8fde-65f2190eccdd tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 393356f4-597d-4bad-bf7d-0a2838bd9548] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:08:20.155975 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-231bfa97-f100-4d00-8fde-65f2190eccdd tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:08:20.164498 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-231bfa97-f100-4d00-8fde-65f2190eccdd tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:08:20.164498 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-231bfa97-f100-4d00-8fde-65f2190eccdd tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:08:20.164498 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-231bfa97-f100-4d00-8fde-65f2190eccdd tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:08:20.215047 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-231bfa97-f100-4d00-8fde-65f2190eccdd tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "POST /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548/action" status: 200 len: 24571 microversion: 2.1 time: 0.073781 Jun 10 19:08:20.216514 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4350/7972] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 19:08:20 2022] POST /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548/action => generated 24571 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 10 19:08:31.296271 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ab54ce1b-60ed-43a7-b63c-c68e32a0a1e6 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:08:31.297348 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ab54ce1b-60ed-43a7-b63c-c68e32a0a1e6 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 393356f4-597d-4bad-bf7d-0a2838bd9548] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:08:31.300296 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:08:31.300965 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:08:31.306791 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ab54ce1b-60ed-43a7-b63c-c68e32a0a1e6 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:08:31.308877 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ab54ce1b-60ed-43a7-b63c-c68e32a0a1e6 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:08:31.308877 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ab54ce1b-60ed-43a7-b63c-c68e32a0a1e6 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:08:31.308877 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ab54ce1b-60ed-43a7-b63c-c68e32a0a1e6 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:08:31.518741 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ab54ce1b-60ed-43a7-b63c-c68e32a0a1e6 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "POST /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548/action" status: 202 len: 0 microversion: 2.1 time: 0.226961 Jun 10 19:08:31.519408 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4351/7973] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 19:08:31 2022] POST /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 19:08:31.527675 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-de8657a3-532b-4295-ab14-822b351cbf64 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:08:31.528405 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-de8657a3-532b-4295-ab14-822b351cbf64 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 393356f4-597d-4bad-bf7d-0a2838bd9548] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:08:31.534689 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de8657a3-532b-4295-ab14-822b351cbf64 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:08:31.536038 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de8657a3-532b-4295-ab14-822b351cbf64 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:08:31.536038 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de8657a3-532b-4295-ab14-822b351cbf64 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:08:31.536483 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de8657a3-532b-4295-ab14-822b351cbf64 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:08:31.677820 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-de8657a3-532b-4295-ab14-822b351cbf64 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:08:31.685505 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-de8657a3-532b-4295-ab14-822b351cbf64 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548" status: 200 len: 1674 microversion: 2.1 time: 0.161806 Jun 10 19:08:31.686090 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4352/7974] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:08:31 2022] GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:08:32.702982 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-be4e4707-8dde-4d69-b0c5-430af0d33840 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:08:32.703606 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-be4e4707-8dde-4d69-b0c5-430af0d33840 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 393356f4-597d-4bad-bf7d-0a2838bd9548] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:08:32.710814 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-be4e4707-8dde-4d69-b0c5-430af0d33840 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:08:32.711329 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-be4e4707-8dde-4d69-b0c5-430af0d33840 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:08:32.712114 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-be4e4707-8dde-4d69-b0c5-430af0d33840 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:08:32.712597 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-be4e4707-8dde-4d69-b0c5-430af0d33840 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:08:32.843518 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-be4e4707-8dde-4d69-b0c5-430af0d33840 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:08:32.851090 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-be4e4707-8dde-4d69-b0c5-430af0d33840 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548" status: 200 len: 1679 microversion: 2.1 time: 0.152099 Jun 10 19:08:32.851661 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4353/7975] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:08:32 2022] GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:08:33.869358 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-60a661e3-8085-480c-94d3-72a48a679d8b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:08:33.869978 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-60a661e3-8085-480c-94d3-72a48a679d8b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 393356f4-597d-4bad-bf7d-0a2838bd9548] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:08:33.879489 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-60a661e3-8085-480c-94d3-72a48a679d8b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:08:33.880065 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-60a661e3-8085-480c-94d3-72a48a679d8b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:08:33.881148 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-60a661e3-8085-480c-94d3-72a48a679d8b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:08:33.881911 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-60a661e3-8085-480c-94d3-72a48a679d8b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:08:34.024385 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-60a661e3-8085-480c-94d3-72a48a679d8b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:08:34.032015 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-60a661e3-8085-480c-94d3-72a48a679d8b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548" status: 200 len: 1679 microversion: 2.1 time: 0.166626 Jun 10 19:08:34.032624 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4354/7976] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:08:33 2022] GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:08:35.049232 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f2b477a6-3d4f-4771-97ad-239d79446b71 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:08:35.049978 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f2b477a6-3d4f-4771-97ad-239d79446b71 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 393356f4-597d-4bad-bf7d-0a2838bd9548] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:08:35.066385 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f2b477a6-3d4f-4771-97ad-239d79446b71 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:08:35.066845 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f2b477a6-3d4f-4771-97ad-239d79446b71 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:08:35.067619 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f2b477a6-3d4f-4771-97ad-239d79446b71 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:08:35.068060 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f2b477a6-3d4f-4771-97ad-239d79446b71 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:08:35.199834 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f2b477a6-3d4f-4771-97ad-239d79446b71 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:08:35.207430 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f2b477a6-3d4f-4771-97ad-239d79446b71 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548" status: 200 len: 1679 microversion: 2.1 time: 0.162626 Jun 10 19:08:35.208004 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4355/7977] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:08:35 2022] GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:08:36.224884 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cd1291cd-199e-4825-8119-81e2b4e76457 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:08:36.225529 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cd1291cd-199e-4825-8119-81e2b4e76457 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 393356f4-597d-4bad-bf7d-0a2838bd9548] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:08:36.232455 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd1291cd-199e-4825-8119-81e2b4e76457 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:08:36.232918 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd1291cd-199e-4825-8119-81e2b4e76457 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:08:36.233693 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd1291cd-199e-4825-8119-81e2b4e76457 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:08:36.234137 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cd1291cd-199e-4825-8119-81e2b4e76457 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:08:36.363815 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cd1291cd-199e-4825-8119-81e2b4e76457 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:08:36.371303 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cd1291cd-199e-4825-8119-81e2b4e76457 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548" status: 200 len: 1679 microversion: 2.1 time: 0.150392 Jun 10 19:08:36.371874 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4356/7978] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:08:36 2022] GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:08:37.388846 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4bc5fd28-0d47-48bb-9daa-2b685b9fadb3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:08:37.389457 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4bc5fd28-0d47-48bb-9daa-2b685b9fadb3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 393356f4-597d-4bad-bf7d-0a2838bd9548] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:08:37.396434 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4bc5fd28-0d47-48bb-9daa-2b685b9fadb3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:08:37.396913 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4bc5fd28-0d47-48bb-9daa-2b685b9fadb3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:08:37.397676 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4bc5fd28-0d47-48bb-9daa-2b685b9fadb3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:08:37.398140 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4bc5fd28-0d47-48bb-9daa-2b685b9fadb3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:08:37.532214 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4bc5fd28-0d47-48bb-9daa-2b685b9fadb3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:08:37.539888 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4bc5fd28-0d47-48bb-9daa-2b685b9fadb3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548" status: 200 len: 1679 microversion: 2.1 time: 0.154950 Jun 10 19:08:37.540494 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4357/7979] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:08:37 2022] GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:08:38.556956 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e770dace-9606-41a9-94ae-d3f87488e0fd tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:08:38.557522 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e770dace-9606-41a9-94ae-d3f87488e0fd tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 393356f4-597d-4bad-bf7d-0a2838bd9548] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:08:38.564582 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e770dace-9606-41a9-94ae-d3f87488e0fd tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:08:38.565044 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e770dace-9606-41a9-94ae-d3f87488e0fd tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:08:38.565812 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e770dace-9606-41a9-94ae-d3f87488e0fd tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:08:38.566257 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e770dace-9606-41a9-94ae-d3f87488e0fd tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:08:38.697398 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e770dace-9606-41a9-94ae-d3f87488e0fd tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:08:38.705440 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e770dace-9606-41a9-94ae-d3f87488e0fd tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548" status: 200 len: 1679 microversion: 2.1 time: 0.152435 Jun 10 19:08:38.706021 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4358/7980] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:08:38 2022] GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:08:39.722884 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4fc09a91-a210-4504-aab5-8cd21c320e6f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:08:39.723489 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4fc09a91-a210-4504-aab5-8cd21c320e6f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 393356f4-597d-4bad-bf7d-0a2838bd9548] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:08:39.730310 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4fc09a91-a210-4504-aab5-8cd21c320e6f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:08:39.730771 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4fc09a91-a210-4504-aab5-8cd21c320e6f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:08:39.731539 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4fc09a91-a210-4504-aab5-8cd21c320e6f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:08:39.731983 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4fc09a91-a210-4504-aab5-8cd21c320e6f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:08:39.865229 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4fc09a91-a210-4504-aab5-8cd21c320e6f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:08:39.872787 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4fc09a91-a210-4504-aab5-8cd21c320e6f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548" status: 200 len: 1679 microversion: 2.1 time: 0.153937 Jun 10 19:08:39.873362 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4359/7981] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:08:39 2022] GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:08:40.889784 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1765df57-9ba7-4c43-91f2-d5e829f49c9f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:08:40.890423 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1765df57-9ba7-4c43-91f2-d5e829f49c9f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 393356f4-597d-4bad-bf7d-0a2838bd9548] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:08:40.897317 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1765df57-9ba7-4c43-91f2-d5e829f49c9f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:08:40.897773 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1765df57-9ba7-4c43-91f2-d5e829f49c9f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:08:40.898536 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1765df57-9ba7-4c43-91f2-d5e829f49c9f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:08:40.898979 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1765df57-9ba7-4c43-91f2-d5e829f49c9f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:08:41.030353 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1765df57-9ba7-4c43-91f2-d5e829f49c9f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:08:41.037892 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1765df57-9ba7-4c43-91f2-d5e829f49c9f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548" status: 200 len: 1679 microversion: 2.1 time: 0.151996 Jun 10 19:08:41.038465 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4360/7982] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:08:40 2022] GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:08:42.055401 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e116f823-675a-4bc1-a4fa-2ee6b0afc7e9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:08:42.056005 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e116f823-675a-4bc1-a4fa-2ee6b0afc7e9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 393356f4-597d-4bad-bf7d-0a2838bd9548] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:08:42.063526 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e116f823-675a-4bc1-a4fa-2ee6b0afc7e9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:08:42.063974 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e116f823-675a-4bc1-a4fa-2ee6b0afc7e9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:08:42.064754 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e116f823-675a-4bc1-a4fa-2ee6b0afc7e9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:08:42.065195 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e116f823-675a-4bc1-a4fa-2ee6b0afc7e9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:08:42.194587 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e116f823-675a-4bc1-a4fa-2ee6b0afc7e9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:08:42.202639 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e116f823-675a-4bc1-a4fa-2ee6b0afc7e9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548" status: 200 len: 1679 microversion: 2.1 time: 0.151212 Jun 10 19:08:42.203403 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4361/7983] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:08:42 2022] GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:08:43.220292 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-689cb942-cd24-40f0-9966-a238f60b589a tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:08:43.220921 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-689cb942-cd24-40f0-9966-a238f60b589a tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 393356f4-597d-4bad-bf7d-0a2838bd9548] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:08:43.227743 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-689cb942-cd24-40f0-9966-a238f60b589a tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:08:43.228201 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-689cb942-cd24-40f0-9966-a238f60b589a tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:08:43.228999 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-689cb942-cd24-40f0-9966-a238f60b589a tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:08:43.229446 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-689cb942-cd24-40f0-9966-a238f60b589a tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:08:43.364639 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-689cb942-cd24-40f0-9966-a238f60b589a tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:08:43.372195 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-689cb942-cd24-40f0-9966-a238f60b589a tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548" status: 200 len: 1679 microversion: 2.1 time: 0.156496 Jun 10 19:08:43.372796 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4362/7984] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:08:43 2022] GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:08:44.388680 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-965e2506-5b88-4420-aa42-f9bcd07c4e26 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:08:44.389322 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-965e2506-5b88-4420-aa42-f9bcd07c4e26 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 393356f4-597d-4bad-bf7d-0a2838bd9548] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:08:44.396397 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-965e2506-5b88-4420-aa42-f9bcd07c4e26 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:08:44.396891 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-965e2506-5b88-4420-aa42-f9bcd07c4e26 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:08:44.397662 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-965e2506-5b88-4420-aa42-f9bcd07c4e26 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:08:44.398173 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-965e2506-5b88-4420-aa42-f9bcd07c4e26 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:08:44.527865 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-965e2506-5b88-4420-aa42-f9bcd07c4e26 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:08:44.535781 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-965e2506-5b88-4420-aa42-f9bcd07c4e26 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548" status: 200 len: 1679 microversion: 2.1 time: 0.151064 Jun 10 19:08:44.536371 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4363/7985] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:08:44 2022] GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:08:45.553583 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f56b52ad-a59d-4616-be3a-2260b5f2c2d4 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:08:45.554187 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f56b52ad-a59d-4616-be3a-2260b5f2c2d4 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 393356f4-597d-4bad-bf7d-0a2838bd9548] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:08:45.561231 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f56b52ad-a59d-4616-be3a-2260b5f2c2d4 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:08:45.561693 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f56b52ad-a59d-4616-be3a-2260b5f2c2d4 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:08:45.562456 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f56b52ad-a59d-4616-be3a-2260b5f2c2d4 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:08:45.562901 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f56b52ad-a59d-4616-be3a-2260b5f2c2d4 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:08:45.697680 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f56b52ad-a59d-4616-be3a-2260b5f2c2d4 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:08:45.705749 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f56b52ad-a59d-4616-be3a-2260b5f2c2d4 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548" status: 200 len: 1679 microversion: 2.1 time: 0.156049 Jun 10 19:08:45.706323 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4364/7986] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:08:45 2022] GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:08:46.722936 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7c231f5b-2250-45f7-8984-2d256435ad38 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:08:46.723519 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7c231f5b-2250-45f7-8984-2d256435ad38 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 393356f4-597d-4bad-bf7d-0a2838bd9548] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:08:46.730456 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7c231f5b-2250-45f7-8984-2d256435ad38 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:08:46.730915 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7c231f5b-2250-45f7-8984-2d256435ad38 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:08:46.731680 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7c231f5b-2250-45f7-8984-2d256435ad38 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:08:46.732128 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7c231f5b-2250-45f7-8984-2d256435ad38 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:08:46.861541 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7c231f5b-2250-45f7-8984-2d256435ad38 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:08:46.869307 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7c231f5b-2250-45f7-8984-2d256435ad38 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548" status: 200 len: 1679 microversion: 2.1 time: 0.150344 Jun 10 19:08:46.869881 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4365/7987] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:08:46 2022] GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:08:47.886275 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-00a7bf06-c4b4-4875-a1b0-94f2d2748554 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:08:47.887004 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-00a7bf06-c4b4-4875-a1b0-94f2d2748554 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 393356f4-597d-4bad-bf7d-0a2838bd9548] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:08:47.894413 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-00a7bf06-c4b4-4875-a1b0-94f2d2748554 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:08:47.894869 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-00a7bf06-c4b4-4875-a1b0-94f2d2748554 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:08:47.895633 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-00a7bf06-c4b4-4875-a1b0-94f2d2748554 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:08:47.896076 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-00a7bf06-c4b4-4875-a1b0-94f2d2748554 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:08:47.914375 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:08:48.041699 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-00a7bf06-c4b4-4875-a1b0-94f2d2748554 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:08:48.049439 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-00a7bf06-c4b4-4875-a1b0-94f2d2748554 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548" status: 200 len: 1679 microversion: 2.1 time: 0.167162 Jun 10 19:08:48.050026 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4366/7988] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:08:47 2022] GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:08:49.066683 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d14f884e-374c-4180-a78d-5c30f393a3e3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:08:49.067316 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d14f884e-374c-4180-a78d-5c30f393a3e3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 393356f4-597d-4bad-bf7d-0a2838bd9548] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:08:49.074657 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d14f884e-374c-4180-a78d-5c30f393a3e3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:08:49.075118 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d14f884e-374c-4180-a78d-5c30f393a3e3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:08:49.075882 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d14f884e-374c-4180-a78d-5c30f393a3e3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:08:49.076344 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d14f884e-374c-4180-a78d-5c30f393a3e3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:08:49.206328 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d14f884e-374c-4180-a78d-5c30f393a3e3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:08:49.213899 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d14f884e-374c-4180-a78d-5c30f393a3e3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548" status: 200 len: 1682 microversion: 2.1 time: 0.151118 Jun 10 19:08:49.214464 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4367/7989] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:08:49 2022] GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:09:13.397159 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-24ecd748-1090-499a-ad60-a448e4aa0459 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:09:13.398092 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-24ecd748-1090-499a-ad60-a448e4aa0459 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 393356f4-597d-4bad-bf7d-0a2838bd9548] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:09:13.400358 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=34 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:09:13.400998 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=8 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:09:13.406414 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-24ecd748-1090-499a-ad60-a448e4aa0459 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:13.406874 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-24ecd748-1090-499a-ad60-a448e4aa0459 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:13.407637 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-24ecd748-1090-499a-ad60-a448e4aa0459 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:13.408072 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-24ecd748-1090-499a-ad60-a448e4aa0459 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:13.461064 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-24ecd748-1090-499a-ad60-a448e4aa0459 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "POST /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548/action" status: 200 len: 69278 microversion: 2.1 time: 0.067910 Jun 10 19:09:13.461740 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4368/7990] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 19:09:13 2022] POST /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548/action => generated 69278 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 10 19:09:20.750882 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6708eec4-faf4-4736-beed-c4eb3ee5da53 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:09:20.751546 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6708eec4-faf4-4736-beed-c4eb3ee5da53 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 393356f4-597d-4bad-bf7d-0a2838bd9548] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:09:20.760371 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6708eec4-faf4-4736-beed-c4eb3ee5da53 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:20.760861 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6708eec4-faf4-4736-beed-c4eb3ee5da53 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:20.761644 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6708eec4-faf4-4736-beed-c4eb3ee5da53 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:20.762092 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6708eec4-faf4-4736-beed-c4eb3ee5da53 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:20.789471 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6708eec4-faf4-4736-beed-c4eb3ee5da53 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 393356f4-597d-4bad-bf7d-0a2838bd9548] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 19:09:21.018932 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6708eec4-faf4-4736-beed-c4eb3ee5da53 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "DELETE /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548" status: 204 len: 0 microversion: 2.1 time: 0.272372 Jun 10 19:09:21.019556 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4369/7991] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 19:09:20 2022] DELETE /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 19:09:21.024922 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-44eaa0d0-d728-4040-95ba-54dc2e35f536 req-9295206f-a31d-437d-8f24-a5d69a21136e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "393356f4-597d-4bad-bf7d-0a2838bd9548", "tag": "17031852-6c9e-4fed-8dad-72a340633171"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:09:21.037563 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-44eaa0d0-d728-4040-95ba-54dc2e35f536 req-9295206f-a31d-437d-8f24-a5d69a21136e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:21.038259 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-44eaa0d0-d728-4040-95ba-54dc2e35f536 req-9295206f-a31d-437d-8f24-a5d69a21136e service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:21.049035 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-44eaa0d0-d728-4040-95ba-54dc2e35f536 req-9295206f-a31d-437d-8f24-a5d69a21136e service nova] Creating event network-changed:17031852-6c9e-4fed-8dad-72a340633171 for instance 393356f4-597d-4bad-bf7d-0a2838bd9548 on chh1-master-2 Jun 10 19:09:21.054603 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-44eaa0d0-d728-4040-95ba-54dc2e35f536 req-9295206f-a31d-437d-8f24-a5d69a21136e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033457 Jun 10 19:09:21.055691 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4370/7992] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:09:21.064498 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f8aa4d50-7237-45a7-8c29-8a4a8924cf06 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:09:21.065206 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f8aa4d50-7237-45a7-8c29-8a4a8924cf06 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 393356f4-597d-4bad-bf7d-0a2838bd9548] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:09:21.072616 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8aa4d50-7237-45a7-8c29-8a4a8924cf06 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:21.073212 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8aa4d50-7237-45a7-8c29-8a4a8924cf06 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:21.074053 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8aa4d50-7237-45a7-8c29-8a4a8924cf06 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:21.074493 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f8aa4d50-7237-45a7-8c29-8a4a8924cf06 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:21.213100 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f8aa4d50-7237-45a7-8c29-8a4a8924cf06 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:09:21.220701 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f8aa4d50-7237-45a7-8c29-8a4a8924cf06 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548" status: 200 len: 1688 microversion: 2.1 time: 0.163240 Jun 10 19:09:21.221281 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4371/7993] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:09:21 2022] GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548 => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:09:22.238841 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d51bf1fe-2ad0-416e-bb12-747233125217 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:09:22.239496 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d51bf1fe-2ad0-416e-bb12-747233125217 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 393356f4-597d-4bad-bf7d-0a2838bd9548] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:09:22.246402 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d51bf1fe-2ad0-416e-bb12-747233125217 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:22.246855 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d51bf1fe-2ad0-416e-bb12-747233125217 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:22.253504 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d51bf1fe-2ad0-416e-bb12-747233125217 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:22.254041 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d51bf1fe-2ad0-416e-bb12-747233125217 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:22.389474 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d51bf1fe-2ad0-416e-bb12-747233125217 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:09:22.397297 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d51bf1fe-2ad0-416e-bb12-747233125217 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548" status: 200 len: 1688 microversion: 2.1 time: 0.162536 Jun 10 19:09:22.398084 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4372/7994] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:09:22 2022] GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548 => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:09:23.126124 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-c190e892-c7bd-45f7-a8b9-034ff98cd374 req-73c34bcb-d52d-4f86-9de2-cb66a17aabac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "393356f4-597d-4bad-bf7d-0a2838bd9548", "name": "network-vif-deleted", "tag": "17031852-6c9e-4fed-8dad-72a340633171"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:09:23.134219 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-c190e892-c7bd-45f7-a8b9-034ff98cd374 req-73c34bcb-d52d-4f86-9de2-cb66a17aabac service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:23.134669 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-c190e892-c7bd-45f7-a8b9-034ff98cd374 req-73c34bcb-d52d-4f86-9de2-cb66a17aabac service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:23.146142 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-c190e892-c7bd-45f7-a8b9-034ff98cd374 req-73c34bcb-d52d-4f86-9de2-cb66a17aabac service nova] Creating event network-vif-deleted:17031852-6c9e-4fed-8dad-72a340633171 for instance 393356f4-597d-4bad-bf7d-0a2838bd9548 on chh1-master-2 Jun 10 19:09:23.150743 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-c190e892-c7bd-45f7-a8b9-034ff98cd374 req-73c34bcb-d52d-4f86-9de2-cb66a17aabac service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028977 Jun 10 19:09:23.151331 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4373/7995] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:09:23.417428 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3a58a4db-acb1-4fbd-998d-9c2e15539c7d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:09:23.419121 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3a58a4db-acb1-4fbd-998d-9c2e15539c7d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 393356f4-597d-4bad-bf7d-0a2838bd9548] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:09:23.426288 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3a58a4db-acb1-4fbd-998d-9c2e15539c7d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:23.426849 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3a58a4db-acb1-4fbd-998d-9c2e15539c7d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:23.427674 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3a58a4db-acb1-4fbd-998d-9c2e15539c7d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:23.428122 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3a58a4db-acb1-4fbd-998d-9c2e15539c7d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:23.462579 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3a58a4db-acb1-4fbd-998d-9c2e15539c7d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:23.463041 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3a58a4db-acb1-4fbd-998d-9c2e15539c7d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:23.466071 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-3a58a4db-acb1-4fbd-998d-9c2e15539c7d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lazy-loading 'fault' on Instance uuid 393356f4-597d-4bad-bf7d-0a2838bd9548 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 19:09:23.507991 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3a58a4db-acb1-4fbd-998d-9c2e15539c7d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:09:23.516572 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3a58a4db-acb1-4fbd-998d-9c2e15539c7d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548" status: 200 len: 1355 microversion: 2.1 time: 0.104538 Jun 10 19:09:23.517169 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4374/7996] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:09:23 2022] GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548 => generated 1355 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:09:24.534304 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-09e3bfb7-b956-499e-8664-dcb69eb2a1c1 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:09:24.534899 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-09e3bfb7-b956-499e-8664-dcb69eb2a1c1 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 393356f4-597d-4bad-bf7d-0a2838bd9548] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:09:24.541753 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-09e3bfb7-b956-499e-8664-dcb69eb2a1c1 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:24.542205 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-09e3bfb7-b956-499e-8664-dcb69eb2a1c1 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:24.542963 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-09e3bfb7-b956-499e-8664-dcb69eb2a1c1 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:24.543409 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-09e3bfb7-b956-499e-8664-dcb69eb2a1c1 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:24.556703 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-09e3bfb7-b956-499e-8664-dcb69eb2a1c1 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] HTTP exception thrown: Instance 393356f4-597d-4bad-bf7d-0a2838bd9548 could not be found. Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-09e3bfb7-b956-499e-8664-dcb69eb2a1c1 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Request method failure captured: Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548 HTTP/1.1 Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5YPAQIj2rjg21dP-hUkWvxTBbenKqLrs8X-dpl0gh5SlblRc7YzYXxJQF7OQJ04iiajVs3_DtHbkXtpyH9RfjMCCLWxpP-pI5ZbkVRrg8NY9qs7N4ZrPXBXmIPChYaWOg__AcNo6wiv5vK4jl8UssW1Gbox3NB6dpu_4KvF6u5DG7s Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 69f65fbabf1d4b85aa3ec38f0e4efe11 Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2031160215 Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/69f65fbabf1d4b85aa3ec38f0e4efe11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/69f65fbabf1d4b85aa3ec38f0e4efe11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/69f65fbabf1d4b85aa3ec38f0e4efe11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_69f65fbabf1d4b85aa3ec38f0e4efe11", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2031160215 Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 69f65fbabf1d4b85aa3ec38f0e4efe11 Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2031160215 Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-TestNetworkAdvancedServerOps-2031160215-project Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: c75f5f98f96946e18c2e665b7f59f75d Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2031160215-project Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 393356f4-597d-4bad-bf7d-0a2838bd9548 could not be found. Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '393356f4-597d-4bad-bf7d-0a2838bd9548'} Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 393356f4-597d-4bad-bf7d-0a2838bd9548 could not be found. Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 393356f4-597d-4bad-bf7d-0a2838bd9548 could not be found. Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:09:24.558340 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:09:24.562064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:09:24.562064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:09:24.562064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:09:24.562064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:09:24.562064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 19:09:24.562064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 19:09:24.562064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 393356f4-597d-4bad-bf7d-0a2838bd9548 could not be found. Jun 10 19:09:24.562064 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:09:24.562064 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-09e3bfb7-b956-499e-8664-dcb69eb2a1c1 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Returning 404 to user: Instance 393356f4-597d-4bad-bf7d-0a2838bd9548 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 19:09:24.562064 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-09e3bfb7-b956-499e-8664-dcb69eb2a1c1 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548" status: 404 len: 111 microversion: 2.1 time: 0.029301 Jun 10 19:09:24.562064 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4375/7997] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:09:24 2022] GET /compute/v2.1/servers/393356f4-597d-4bad-bf7d-0a2838bd9548 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 19:09:28.149483 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b96e5395-7098-42c3-94a4-146675d80941 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '.version_select at 0x7f77c04861f0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:09:28.237293 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b96e5395-7098-42c3-94a4-146675d80941 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-238692839" status: 202 len: 0 microversion: 2.1 time: 0.091314 Jun 10 19:09:28.237881 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4376/7998] 10.222.0.35 () {58 vars in 1280 bytes} [Fri Jun 10 19:09:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-238692839 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 19:09:28.268177 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-52eb383c-7f13-48b1-937c-6c6e3dff1199 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Action: 'create', calling method: .version_select at 0x7f77b3c8b790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2004843180", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/8k8zS+j9eB37uIf182bTIrNZH3es0GAixlp0GoVqC8RKBMXG+FWqOGnYeBmYqvYHcGY+Cx8pinKwFVONPaBEfHv2XCL3mjPu2R29AjtlHdByuqH3pwnu8HO7ZeK3AxQ=="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:09:28.283239 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-52eb383c-7f13-48b1-937c-6c6e3dff1199 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Getting quotas for project 69f65fbabf1d4b85aa3ec38f0e4efe11. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 19:09:28.288462 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-52eb383c-7f13-48b1-937c-6c6e3dff1199 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Getting quotas for user c75f5f98f96946e18c2e665b7f59f75d and project 69f65fbabf1d4b85aa3ec38f0e4efe11. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 19:09:28.374654 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-52eb383c-7f13-48b1-937c-6c6e3dff1199 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.110429 Jun 10 19:09:28.375288 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4377/7999] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 19:09:28 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:09:36.098991 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:09:36.103502 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9cba924c-15fb-48c5-a222-b6c01f985a6b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1450913542", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "4fa68b8c-686f-4c71-835f-22ad55a78aa3"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2004843180", "security_groups": [{"name": "tempest-secgroup-smoke-2105594607"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:09:36.230736 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-9cba924c-15fb-48c5-a222-b6c01f985a6b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] validate_networks() for [('4fa68b8c-686f-4c71-835f-22ad55a78aa3', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 19:09:36.732692 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-9cba924c-15fb-48c5-a222-b6c01f985a6b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 19:09:36.733121 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-9cba924c-15fb-48c5-a222-b6c01f985a6b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 19:09:36.733593 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-9cba924c-15fb-48c5-a222-b6c01f985a6b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 19:09:36.734000 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-9cba924c-15fb-48c5-a222-b6c01f985a6b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 19:09:36.734444 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-9cba924c-15fb-48c5-a222-b6c01f985a6b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 19:09:36.743646 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9cba924c-15fb-48c5-a222-b6c01f985a6b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:36.744096 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9cba924c-15fb-48c5-a222-b6c01f985a6b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:36.744925 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9cba924c-15fb-48c5-a222-b6c01f985a6b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:36.745359 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9cba924c-15fb-48c5-a222-b6c01f985a6b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:36.763201 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-9cba924c-15fb-48c5-a222-b6c01f985a6b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Getting quotas for project 69f65fbabf1d4b85aa3ec38f0e4efe11. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 19:09:36.768637 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-9cba924c-15fb-48c5-a222-b6c01f985a6b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Getting quotas for user c75f5f98f96946e18c2e665b7f59f75d and project 69f65fbabf1d4b85aa3ec38f0e4efe11. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 19:09:36.781186 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9cba924c-15fb-48c5-a222-b6c01f985a6b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 19:09:36.783458 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9cba924c-15fb-48c5-a222-b6c01f985a6b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 19:09:36.911938 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9cba924c-15fb-48c5-a222-b6c01f985a6b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.817899 Jun 10 19:09:36.917778 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4378/8000] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 19:09:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 19:09:36.923594 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9cf2c214-aa34-40cc-9243-539fe9a2d6f1 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:09:36.924402 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9cf2c214-aa34-40cc-9243-539fe9a2d6f1 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:09:36.990561 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9cf2c214-aa34-40cc-9243-539fe9a2d6f1 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:09:36.997753 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9cf2c214-aa34-40cc-9243-539fe9a2d6f1 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618" status: 200 len: 1267 microversion: 2.1 time: 0.078778 Jun 10 19:09:36.998680 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4379/8001] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:09:36 2022] GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618 => generated 1267 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:09:38.014743 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-399fd860-2559-4c11-80cc-5f2a30e337c8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:09:38.015358 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-399fd860-2559-4c11-80cc-5f2a30e337c8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:09:38.023298 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-399fd860-2559-4c11-80cc-5f2a30e337c8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:38.023757 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-399fd860-2559-4c11-80cc-5f2a30e337c8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:38.024633 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-399fd860-2559-4c11-80cc-5f2a30e337c8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:38.025084 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-399fd860-2559-4c11-80cc-5f2a30e337c8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:38.088438 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-399fd860-2559-4c11-80cc-5f2a30e337c8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:09:38.096112 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-399fd860-2559-4c11-80cc-5f2a30e337c8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618" status: 200 len: 1271 microversion: 2.1 time: 0.085331 Jun 10 19:09:38.097217 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4380/8002] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:09:38 2022] GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618 => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:09:39.117563 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4a079e19-bd6f-4120-976f-1cbeff5aaaa5 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:09:39.118194 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4a079e19-bd6f-4120-976f-1cbeff5aaaa5 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:09:39.127943 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a079e19-bd6f-4120-976f-1cbeff5aaaa5 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:39.128557 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a079e19-bd6f-4120-976f-1cbeff5aaaa5 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:39.129358 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a079e19-bd6f-4120-976f-1cbeff5aaaa5 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:39.129961 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4a079e19-bd6f-4120-976f-1cbeff5aaaa5 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:39.208716 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4a079e19-bd6f-4120-976f-1cbeff5aaaa5 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:09:39.218983 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4a079e19-bd6f-4120-976f-1cbeff5aaaa5 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618" status: 200 len: 1337 microversion: 2.1 time: 0.109236 Jun 10 19:09:39.219888 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4381/8003] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:09:39 2022] GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618 => generated 1337 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:09:40.236484 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fad5701e-83fe-4246-b7e3-d6b645f1524f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:09:40.237423 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fad5701e-83fe-4246-b7e3-d6b645f1524f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:09:40.244626 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fad5701e-83fe-4246-b7e3-d6b645f1524f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:40.245009 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fad5701e-83fe-4246-b7e3-d6b645f1524f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:40.245797 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fad5701e-83fe-4246-b7e3-d6b645f1524f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:40.246246 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fad5701e-83fe-4246-b7e3-d6b645f1524f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:40.380500 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fad5701e-83fe-4246-b7e3-d6b645f1524f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:09:40.394969 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fad5701e-83fe-4246-b7e3-d6b645f1524f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618" status: 200 len: 1393 microversion: 2.1 time: 0.162372 Jun 10 19:09:40.403357 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4382/8004] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:09:40 2022] GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618 => generated 1393 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:09:40.649439 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-0d1eee77-3a74-4e91-982a-bab5e40a100b req-fb56b213-7e13-49f5-b188-2f1bb45e52ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d9b0e12-e49d-4e64-a523-a84ee0937618", "tag": "1b9c2936-acec-48ae-914e-d5f323ba8e60"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:09:40.658166 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-0d1eee77-3a74-4e91-982a-bab5e40a100b req-fb56b213-7e13-49f5-b188-2f1bb45e52ca service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:40.659535 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-0d1eee77-3a74-4e91-982a-bab5e40a100b req-fb56b213-7e13-49f5-b188-2f1bb45e52ca service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:40.672271 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-0d1eee77-3a74-4e91-982a-bab5e40a100b req-fb56b213-7e13-49f5-b188-2f1bb45e52ca service nova] Creating event network-changed:1b9c2936-acec-48ae-914e-d5f323ba8e60 for instance 9d9b0e12-e49d-4e64-a523-a84ee0937618 on chh2-master-2 Jun 10 19:09:40.678343 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-0d1eee77-3a74-4e91-982a-bab5e40a100b req-fb56b213-7e13-49f5-b188-2f1bb45e52ca service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037621 Jun 10 19:09:40.679045 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4383/8005] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:09:41.420030 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1a81c1e9-29f2-43d2-8605-e84f2bbe9ac5 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:09:41.420803 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1a81c1e9-29f2-43d2-8605-e84f2bbe9ac5 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:09:41.427065 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1a81c1e9-29f2-43d2-8605-e84f2bbe9ac5 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:41.427519 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1a81c1e9-29f2-43d2-8605-e84f2bbe9ac5 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:41.428291 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1a81c1e9-29f2-43d2-8605-e84f2bbe9ac5 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:41.428755 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1a81c1e9-29f2-43d2-8605-e84f2bbe9ac5 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:41.612583 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1a81c1e9-29f2-43d2-8605-e84f2bbe9ac5 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:09:41.620438 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1a81c1e9-29f2-43d2-8605-e84f2bbe9ac5 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618" status: 200 len: 1393 microversion: 2.1 time: 0.210968 Jun 10 19:09:41.621124 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4384/8006] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:09:41 2022] GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618 => generated 1393 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:09:42.637297 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-eb9092a4-5eb0-4551-a9e1-99ac3992c12b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:09:42.637926 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-eb9092a4-5eb0-4551-a9e1-99ac3992c12b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:09:42.645155 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eb9092a4-5eb0-4551-a9e1-99ac3992c12b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:42.645609 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eb9092a4-5eb0-4551-a9e1-99ac3992c12b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:42.646368 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eb9092a4-5eb0-4551-a9e1-99ac3992c12b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:42.646812 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eb9092a4-5eb0-4551-a9e1-99ac3992c12b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:42.775436 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-eb9092a4-5eb0-4551-a9e1-99ac3992c12b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:09:42.783530 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-eb9092a4-5eb0-4551-a9e1-99ac3992c12b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618" status: 200 len: 1393 microversion: 2.1 time: 0.150107 Jun 10 19:09:42.784106 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4385/8007] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:09:42 2022] GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618 => generated 1393 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:09:43.800913 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-150d9cad-5d7a-44dc-9ad8-d0bee827e879 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:09:43.801529 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-150d9cad-5d7a-44dc-9ad8-d0bee827e879 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:09:43.804342 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:09:43.809398 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-150d9cad-5d7a-44dc-9ad8-d0bee827e879 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:43.809957 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-150d9cad-5d7a-44dc-9ad8-d0bee827e879 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:43.810730 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-150d9cad-5d7a-44dc-9ad8-d0bee827e879 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:43.811173 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-150d9cad-5d7a-44dc-9ad8-d0bee827e879 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:44.211700 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-150d9cad-5d7a-44dc-9ad8-d0bee827e879 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:09:44.220214 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-150d9cad-5d7a-44dc-9ad8-d0bee827e879 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618" status: 200 len: 1393 microversion: 2.1 time: 0.423231 Jun 10 19:09:44.220827 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4386/8008] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:09:43 2022] GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618 => generated 1393 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:09:45.237358 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d5462ee4-69f7-4035-9404-446e93e81af3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:09:45.237968 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d5462ee4-69f7-4035-9404-446e93e81af3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:09:45.244978 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d5462ee4-69f7-4035-9404-446e93e81af3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:45.245429 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d5462ee4-69f7-4035-9404-446e93e81af3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:45.246187 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d5462ee4-69f7-4035-9404-446e93e81af3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:45.246630 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d5462ee4-69f7-4035-9404-446e93e81af3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:45.378216 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d5462ee4-69f7-4035-9404-446e93e81af3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:09:45.385683 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d5462ee4-69f7-4035-9404-446e93e81af3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618" status: 200 len: 1393 microversion: 2.1 time: 0.152447 Jun 10 19:09:45.386249 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4387/8009] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:09:45 2022] GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618 => generated 1393 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:09:46.403038 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-499a87e0-302b-4a05-b48a-d64609065bcd tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:09:46.404283 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-499a87e0-302b-4a05-b48a-d64609065bcd tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:09:46.411214 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-499a87e0-302b-4a05-b48a-d64609065bcd tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:46.411664 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-499a87e0-302b-4a05-b48a-d64609065bcd tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:46.412500 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-499a87e0-302b-4a05-b48a-d64609065bcd tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:46.412944 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-499a87e0-302b-4a05-b48a-d64609065bcd tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:46.547564 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-499a87e0-302b-4a05-b48a-d64609065bcd tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:09:46.555431 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-499a87e0-302b-4a05-b48a-d64609065bcd tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618" status: 200 len: 1393 microversion: 2.1 time: 0.156287 Jun 10 19:09:46.556196 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4388/8010] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:09:46 2022] GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618 => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:09:47.574800 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cedb5163-12cc-457f-81fd-52955f48559d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:09:47.575427 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cedb5163-12cc-457f-81fd-52955f48559d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:09:47.577252 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:09:47.578079 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=12 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:09:47.583645 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cedb5163-12cc-457f-81fd-52955f48559d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:47.584103 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cedb5163-12cc-457f-81fd-52955f48559d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:47.584911 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cedb5163-12cc-457f-81fd-52955f48559d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:47.585363 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cedb5163-12cc-457f-81fd-52955f48559d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:47.717102 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cedb5163-12cc-457f-81fd-52955f48559d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:09:47.724576 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cedb5163-12cc-457f-81fd-52955f48559d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618" status: 200 len: 1393 microversion: 2.1 time: 0.153799 Jun 10 19:09:47.725143 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4389/8011] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:09:47 2022] GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618 => generated 1393 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:09:48.741791 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d02eb9c3-376a-4851-b059-8d03f866fa3c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:09:48.742450 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d02eb9c3-376a-4851-b059-8d03f866fa3c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:09:48.750463 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d02eb9c3-376a-4851-b059-8d03f866fa3c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:48.750924 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d02eb9c3-376a-4851-b059-8d03f866fa3c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:48.751713 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d02eb9c3-376a-4851-b059-8d03f866fa3c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:48.752192 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d02eb9c3-376a-4851-b059-8d03f866fa3c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:48.890292 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d02eb9c3-376a-4851-b059-8d03f866fa3c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:09:48.897919 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d02eb9c3-376a-4851-b059-8d03f866fa3c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618" status: 200 len: 1393 microversion: 2.1 time: 0.160083 Jun 10 19:09:48.898486 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4390/8012] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:09:48 2022] GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618 => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:09:48.902815 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-1b5adbd9-4a49-4cac-829b-9bebb1608e7a req-11c666d1-72de-4866-b111-a4d76ad427ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d9b0e12-e49d-4e64-a523-a84ee0937618", "name": "network-vif-plugged", "status": "completed", "tag": "1b9c2936-acec-48ae-914e-d5f323ba8e60"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:09:48.911143 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-1b5adbd9-4a49-4cac-829b-9bebb1608e7a req-11c666d1-72de-4866-b111-a4d76ad427ba service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:48.911635 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-1b5adbd9-4a49-4cac-829b-9bebb1608e7a req-11c666d1-72de-4866-b111-a4d76ad427ba service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:48.923027 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-1b5adbd9-4a49-4cac-829b-9bebb1608e7a req-11c666d1-72de-4866-b111-a4d76ad427ba service nova] Creating event network-vif-plugged:1b9c2936-acec-48ae-914e-d5f323ba8e60 for instance 9d9b0e12-e49d-4e64-a523-a84ee0937618 on chh2-master-2 Jun 10 19:09:48.928123 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-1b5adbd9-4a49-4cac-829b-9bebb1608e7a req-11c666d1-72de-4866-b111-a4d76ad427ba service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028501 Jun 10 19:09:48.928790 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4391/8013] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:09:49.915668 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bcbbab0a-0565-4778-b4c7-df3f47cee0d5 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:09:49.916410 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bcbbab0a-0565-4778-b4c7-df3f47cee0d5 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:09:49.924087 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bcbbab0a-0565-4778-b4c7-df3f47cee0d5 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:49.924580 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bcbbab0a-0565-4778-b4c7-df3f47cee0d5 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:49.925355 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bcbbab0a-0565-4778-b4c7-df3f47cee0d5 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:49.925800 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bcbbab0a-0565-4778-b4c7-df3f47cee0d5 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:50.055248 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bcbbab0a-0565-4778-b4c7-df3f47cee0d5 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:09:50.063476 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bcbbab0a-0565-4778-b4c7-df3f47cee0d5 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618" status: 200 len: 1393 microversion: 2.1 time: 0.152281 Jun 10 19:09:50.065231 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4392/8014] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:09:49 2022] GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618 => generated 1393 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:09:51.080941 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-78b1147c-9c6b-4a0e-b282-eeddaa130eb3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:09:51.081571 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-78b1147c-9c6b-4a0e-b282-eeddaa130eb3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:09:51.088435 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-78b1147c-9c6b-4a0e-b282-eeddaa130eb3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:51.088889 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-78b1147c-9c6b-4a0e-b282-eeddaa130eb3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:51.089645 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-78b1147c-9c6b-4a0e-b282-eeddaa130eb3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:51.090083 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-78b1147c-9c6b-4a0e-b282-eeddaa130eb3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:51.222341 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-78b1147c-9c6b-4a0e-b282-eeddaa130eb3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:09:51.229930 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-78b1147c-9c6b-4a0e-b282-eeddaa130eb3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618" status: 200 len: 1566 microversion: 2.1 time: 0.152825 Jun 10 19:09:51.230506 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4393/8015] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:09:51 2022] GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:09:51.245924 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0e90136b-1e11-482a-b618-41cca5c5d3b8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:09:51.246533 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0e90136b-1e11-482a-b618-41cca5c5d3b8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:09:51.252958 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0e90136b-1e11-482a-b618-41cca5c5d3b8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:51.253413 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0e90136b-1e11-482a-b618-41cca5c5d3b8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:51.254179 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0e90136b-1e11-482a-b618-41cca5c5d3b8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:51.254619 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0e90136b-1e11-482a-b618-41cca5c5d3b8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:51.391690 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0e90136b-1e11-482a-b618-41cca5c5d3b8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:09:51.399430 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0e90136b-1e11-482a-b618-41cca5c5d3b8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618" status: 200 len: 1566 microversion: 2.1 time: 0.157153 Jun 10 19:09:51.400008 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4394/8016] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:09:51 2022] GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:09:53.278064 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-40fe72c4-9bc6-4a8c-9568-b0fdffce5ec2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:09:53.278952 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-40fe72c4-9bc6-4a8c-9568-b0fdffce5ec2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:09:53.286237 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-40fe72c4-9bc6-4a8c-9568-b0fdffce5ec2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:53.286782 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-40fe72c4-9bc6-4a8c-9568-b0fdffce5ec2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:53.287642 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-40fe72c4-9bc6-4a8c-9568-b0fdffce5ec2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:53.288185 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-40fe72c4-9bc6-4a8c-9568-b0fdffce5ec2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:53.431260 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-40fe72c4-9bc6-4a8c-9568-b0fdffce5ec2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:09:53.438923 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-40fe72c4-9bc6-4a8c-9568-b0fdffce5ec2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618" status: 200 len: 1566 microversion: 2.1 time: 0.164829 Jun 10 19:09:53.449962 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4395/8017] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:09:53 2022] GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:09:53.449962 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-50c88b38-23f1-4e8f-88af-8c4cdfe0ae63 req-3d0376c5-7721-48ba-aa7d-a82b03cf6965 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d9b0e12-e49d-4e64-a523-a84ee0937618", "tag": "1b9c2936-acec-48ae-914e-d5f323ba8e60"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:09:53.452410 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-50c88b38-23f1-4e8f-88af-8c4cdfe0ae63 req-3d0376c5-7721-48ba-aa7d-a82b03cf6965 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:09:53.452686 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-50c88b38-23f1-4e8f-88af-8c4cdfe0ae63 req-3d0376c5-7721-48ba-aa7d-a82b03cf6965 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:09:53.464052 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-50c88b38-23f1-4e8f-88af-8c4cdfe0ae63 req-3d0376c5-7721-48ba-aa7d-a82b03cf6965 service nova] Creating event network-changed:1b9c2936-acec-48ae-914e-d5f323ba8e60 for instance 9d9b0e12-e49d-4e64-a523-a84ee0937618 on chh2-master-2 Jun 10 19:09:53.470275 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-50c88b38-23f1-4e8f-88af-8c4cdfe0ae63 req-3d0376c5-7721-48ba-aa7d-a82b03cf6965 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029535 Jun 10 19:09:53.471372 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4396/8018] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:10:26.727506 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=21 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:10:26.728190 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=92 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:10:26.732428 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-66cb8e75-2c35-4dcb-a8ff-3b05b14ab74f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:10:26.733536 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-66cb8e75-2c35-4dcb-a8ff-3b05b14ab74f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:10:26.739873 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-66cb8e75-2c35-4dcb-a8ff-3b05b14ab74f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:10:26.740367 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-66cb8e75-2c35-4dcb-a8ff-3b05b14ab74f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:10:26.741138 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-66cb8e75-2c35-4dcb-a8ff-3b05b14ab74f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:10:26.741585 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-66cb8e75-2c35-4dcb-a8ff-3b05b14ab74f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:10:26.802690 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-66cb8e75-2c35-4dcb-a8ff-3b05b14ab74f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "POST /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618/action" status: 200 len: 24570 microversion: 2.1 time: 0.077527 Jun 10 19:10:26.803349 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4397/8019] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 19:10:26 2022] POST /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618/action => generated 24570 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 10 19:10:57.284591 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:10:57.285335 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:10:57.348145 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9212c82c-abb0-4034-8a9b-baa5bd848640 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:10:57.349295 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9212c82c-abb0-4034-8a9b-baa5bd848640 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:10:57.356968 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9212c82c-abb0-4034-8a9b-baa5bd848640 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:10:57.357410 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9212c82c-abb0-4034-8a9b-baa5bd848640 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:10:57.358751 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9212c82c-abb0-4034-8a9b-baa5bd848640 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:10:57.359201 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9212c82c-abb0-4034-8a9b-baa5bd848640 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:10:57.399098 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9212c82c-abb0-4034-8a9b-baa5bd848640 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:10:57.406172 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9212c82c-abb0-4034-8a9b-baa5bd848640 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Old instance type m1.heat2, new instance type m1.heat {{(pid=126595) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 10 19:10:57.412627 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-9212c82c-abb0-4034-8a9b-baa5bd848640 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 19:10:57.414686 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-9212c82c-abb0-4034-8a9b-baa5bd848640 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 19:10:57.414686 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-9212c82c-abb0-4034-8a9b-baa5bd848640 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 19:10:57.414686 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-9212c82c-abb0-4034-8a9b-baa5bd848640 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 19:10:57.414686 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-9212c82c-abb0-4034-8a9b-baa5bd848640 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 19:10:57.568451 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9212c82c-abb0-4034-8a9b-baa5bd848640 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "POST /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618/action" status: 202 len: 0 microversion: 2.1 time: 0.289784 Jun 10 19:10:57.569249 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4398/8020] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 19:10:57 2022] POST /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 19:10:57.577602 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cec92d74-44df-45d7-95ac-2986697c6c0c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:10:57.578214 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cec92d74-44df-45d7-95ac-2986697c6c0c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:10:57.584911 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cec92d74-44df-45d7-95ac-2986697c6c0c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:10:57.585379 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cec92d74-44df-45d7-95ac-2986697c6c0c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:10:57.586178 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cec92d74-44df-45d7-95ac-2986697c6c0c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:10:57.586628 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cec92d74-44df-45d7-95ac-2986697c6c0c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:10:57.729551 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cec92d74-44df-45d7-95ac-2986697c6c0c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:10:57.737465 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cec92d74-44df-45d7-95ac-2986697c6c0c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618" status: 200 len: 1694 microversion: 2.1 time: 0.164068 Jun 10 19:10:57.738053 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4399/8021] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:10:57 2022] GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618 => generated 1694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:10:58.754073 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bcf69b92-0b5d-4392-ae72-52f4444a304a tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:10:58.754713 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bcf69b92-0b5d-4392-ae72-52f4444a304a tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:10:58.761746 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bcf69b92-0b5d-4392-ae72-52f4444a304a tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:10:58.768337 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bcf69b92-0b5d-4392-ae72-52f4444a304a tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:10:58.768337 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bcf69b92-0b5d-4392-ae72-52f4444a304a tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:10:58.768337 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bcf69b92-0b5d-4392-ae72-52f4444a304a tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:10:58.902586 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bcf69b92-0b5d-4392-ae72-52f4444a304a tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:10:58.910948 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bcf69b92-0b5d-4392-ae72-52f4444a304a tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618" status: 200 len: 1694 microversion: 2.1 time: 0.160616 Jun 10 19:10:58.913259 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4400/8022] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:10:58 2022] GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618 => generated 1694 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:10:59.930980 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-baad3775-2ec4-4fc8-88a7-919a5e55f93c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:10:59.931650 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-baad3775-2ec4-4fc8-88a7-919a5e55f93c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:10:59.939050 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-baad3775-2ec4-4fc8-88a7-919a5e55f93c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:10:59.939506 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-baad3775-2ec4-4fc8-88a7-919a5e55f93c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:10:59.940278 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-baad3775-2ec4-4fc8-88a7-919a5e55f93c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:10:59.940750 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-baad3775-2ec4-4fc8-88a7-919a5e55f93c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:00.078250 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-baad3775-2ec4-4fc8-88a7-919a5e55f93c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:11:00.086235 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-baad3775-2ec4-4fc8-88a7-919a5e55f93c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618" status: 200 len: 1694 microversion: 2.1 time: 0.159181 Jun 10 19:11:00.086817 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4401/8023] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:10:59 2022] GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618 => generated 1694 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:11:01.103084 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-eae6552b-67b4-4beb-9da7-f6d6b237dbfb tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:11:01.103779 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-eae6552b-67b4-4beb-9da7-f6d6b237dbfb tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:11:01.110923 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eae6552b-67b4-4beb-9da7-f6d6b237dbfb tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:01.111384 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eae6552b-67b4-4beb-9da7-f6d6b237dbfb tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:01.112170 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eae6552b-67b4-4beb-9da7-f6d6b237dbfb tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:01.112645 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-eae6552b-67b4-4beb-9da7-f6d6b237dbfb tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:01.291888 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-eae6552b-67b4-4beb-9da7-f6d6b237dbfb tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:11:01.299480 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-eae6552b-67b4-4beb-9da7-f6d6b237dbfb tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618" status: 200 len: 1699 microversion: 2.1 time: 0.200336 Jun 10 19:11:01.300083 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4402/8024] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:11:01 2022] GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618 => generated 1699 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:11:02.316760 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f7197b66-71c2-4079-ade4-eb176d0154bc tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:11:02.317427 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f7197b66-71c2-4079-ade4-eb176d0154bc tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:11:02.324287 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f7197b66-71c2-4079-ade4-eb176d0154bc tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:02.324775 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f7197b66-71c2-4079-ade4-eb176d0154bc tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:02.325548 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f7197b66-71c2-4079-ade4-eb176d0154bc tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:02.325989 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f7197b66-71c2-4079-ade4-eb176d0154bc tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:02.459484 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f7197b66-71c2-4079-ade4-eb176d0154bc tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:11:02.464491 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f7197b66-71c2-4079-ade4-eb176d0154bc tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618" status: 200 len: 1699 microversion: 2.1 time: 0.151565 Jun 10 19:11:02.465063 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4403/8025] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:11:02 2022] GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618 => generated 1699 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:11:03.481308 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-00a9ea79-5445-4798-9958-c6ecd11086bb tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:11:03.481959 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-00a9ea79-5445-4798-9958-c6ecd11086bb tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:11:03.489348 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-00a9ea79-5445-4798-9958-c6ecd11086bb tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:03.489798 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-00a9ea79-5445-4798-9958-c6ecd11086bb tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:03.490559 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-00a9ea79-5445-4798-9958-c6ecd11086bb tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:03.491000 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-00a9ea79-5445-4798-9958-c6ecd11086bb tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:03.621437 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-00a9ea79-5445-4798-9958-c6ecd11086bb tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:11:03.629533 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-00a9ea79-5445-4798-9958-c6ecd11086bb tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618" status: 200 len: 1699 microversion: 2.1 time: 0.152183 Jun 10 19:11:03.630109 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4404/8026] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:11:03 2022] GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618 => generated 1699 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:11:04.646627 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fcbceac5-a0ff-4a2c-9683-d87b63637c10 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:11:04.647323 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fcbceac5-a0ff-4a2c-9683-d87b63637c10 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:11:04.657317 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fcbceac5-a0ff-4a2c-9683-d87b63637c10 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:04.657778 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fcbceac5-a0ff-4a2c-9683-d87b63637c10 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:04.658555 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fcbceac5-a0ff-4a2c-9683-d87b63637c10 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:04.659029 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fcbceac5-a0ff-4a2c-9683-d87b63637c10 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:04.801652 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fcbceac5-a0ff-4a2c-9683-d87b63637c10 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:11:04.809982 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fcbceac5-a0ff-4a2c-9683-d87b63637c10 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618" status: 200 len: 1699 microversion: 2.1 time: 0.167290 Jun 10 19:11:04.810576 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4405/8027] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:11:04 2022] GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618 => generated 1699 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:11:05.826549 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-36b78b07-7369-4c15-b2fd-1bf605b85e15 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:11:05.827199 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-36b78b07-7369-4c15-b2fd-1bf605b85e15 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:11:05.834533 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-36b78b07-7369-4c15-b2fd-1bf605b85e15 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:05.834983 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-36b78b07-7369-4c15-b2fd-1bf605b85e15 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:05.835745 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-36b78b07-7369-4c15-b2fd-1bf605b85e15 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:05.836182 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-36b78b07-7369-4c15-b2fd-1bf605b85e15 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:05.964150 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-36b78b07-7369-4c15-b2fd-1bf605b85e15 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:11:05.971669 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-36b78b07-7369-4c15-b2fd-1bf605b85e15 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618" status: 200 len: 1699 microversion: 2.1 time: 0.148991 Jun 10 19:11:05.972279 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4406/8028] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:11:05 2022] GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618 => generated 1699 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:11:06.988835 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8559be94-aff1-42a8-9f9e-d5d298324d1d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:11:06.989518 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8559be94-aff1-42a8-9f9e-d5d298324d1d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:11:06.996250 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8559be94-aff1-42a8-9f9e-d5d298324d1d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:06.996730 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8559be94-aff1-42a8-9f9e-d5d298324d1d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:06.997489 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8559be94-aff1-42a8-9f9e-d5d298324d1d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:06.997927 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8559be94-aff1-42a8-9f9e-d5d298324d1d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:07.147529 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8559be94-aff1-42a8-9f9e-d5d298324d1d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:11:07.155102 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8559be94-aff1-42a8-9f9e-d5d298324d1d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618" status: 200 len: 1699 microversion: 2.1 time: 0.170464 Jun 10 19:11:07.155675 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4407/8029] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:11:06 2022] GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618 => generated 1699 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:11:08.172417 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b0bda319-32fa-4412-afc2-16df3c3951b8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:11:08.173102 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b0bda319-32fa-4412-afc2-16df3c3951b8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:11:08.180093 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b0bda319-32fa-4412-afc2-16df3c3951b8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:08.180586 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b0bda319-32fa-4412-afc2-16df3c3951b8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:08.181355 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b0bda319-32fa-4412-afc2-16df3c3951b8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:08.181801 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b0bda319-32fa-4412-afc2-16df3c3951b8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:08.312272 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b0bda319-32fa-4412-afc2-16df3c3951b8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:11:08.320636 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b0bda319-32fa-4412-afc2-16df3c3951b8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618" status: 200 len: 1699 microversion: 2.1 time: 0.152149 Jun 10 19:11:08.321224 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4408/8030] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:11:08 2022] GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618 => generated 1699 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:11:09.338899 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c0d0eedf-cdb8-44f3-83dd-624c9cd0efb8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:11:09.339659 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c0d0eedf-cdb8-44f3-83dd-624c9cd0efb8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:11:09.346481 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c0d0eedf-cdb8-44f3-83dd-624c9cd0efb8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:09.346888 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c0d0eedf-cdb8-44f3-83dd-624c9cd0efb8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:09.347656 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c0d0eedf-cdb8-44f3-83dd-624c9cd0efb8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:09.348101 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c0d0eedf-cdb8-44f3-83dd-624c9cd0efb8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:09.487722 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c0d0eedf-cdb8-44f3-83dd-624c9cd0efb8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:11:09.495252 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c0d0eedf-cdb8-44f3-83dd-624c9cd0efb8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618" status: 200 len: 1699 microversion: 2.1 time: 0.160276 Jun 10 19:11:09.495823 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4409/8031] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:11:09 2022] GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618 => generated 1699 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:11:10.513276 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ab49b060-3b89-4b47-a162-79fe295ff2c2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:11:10.513902 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ab49b060-3b89-4b47-a162-79fe295ff2c2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:11:10.520803 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ab49b060-3b89-4b47-a162-79fe295ff2c2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:10.521270 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ab49b060-3b89-4b47-a162-79fe295ff2c2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:10.522023 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ab49b060-3b89-4b47-a162-79fe295ff2c2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:10.522464 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ab49b060-3b89-4b47-a162-79fe295ff2c2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:10.656197 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ab49b060-3b89-4b47-a162-79fe295ff2c2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:11:10.664260 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ab49b060-3b89-4b47-a162-79fe295ff2c2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618" status: 200 len: 1699 microversion: 2.1 time: 0.154949 Jun 10 19:11:10.664859 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4410/8032] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:11:10 2022] GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618 => generated 1699 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:11:11.681941 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-baa0a872-5b67-4bf9-b31a-f01887cfb5ce tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:11:11.682559 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-baa0a872-5b67-4bf9-b31a-f01887cfb5ce tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:11:11.689986 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-baa0a872-5b67-4bf9-b31a-f01887cfb5ce tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:11.690436 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-baa0a872-5b67-4bf9-b31a-f01887cfb5ce tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:11.691198 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-baa0a872-5b67-4bf9-b31a-f01887cfb5ce tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:11.691630 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-baa0a872-5b67-4bf9-b31a-f01887cfb5ce tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:11.824458 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-baa0a872-5b67-4bf9-b31a-f01887cfb5ce tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:11:11.831896 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-baa0a872-5b67-4bf9-b31a-f01887cfb5ce tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618" status: 200 len: 1699 microversion: 2.1 time: 0.153971 Jun 10 19:11:11.832485 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4411/8033] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:11:11 2022] GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618 => generated 1699 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:11:12.849455 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bbb21beb-cd93-4eb6-99be-9c5d6b38d550 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:11:12.850144 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bbb21beb-cd93-4eb6-99be-9c5d6b38d550 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:11:12.856536 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bbb21beb-cd93-4eb6-99be-9c5d6b38d550 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:12.856996 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bbb21beb-cd93-4eb6-99be-9c5d6b38d550 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:12.857779 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bbb21beb-cd93-4eb6-99be-9c5d6b38d550 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:12.858220 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bbb21beb-cd93-4eb6-99be-9c5d6b38d550 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:12.998352 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bbb21beb-cd93-4eb6-99be-9c5d6b38d550 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:11:13.006189 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bbb21beb-cd93-4eb6-99be-9c5d6b38d550 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618" status: 200 len: 1699 microversion: 2.1 time: 0.160578 Jun 10 19:11:13.007095 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4412/8034] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:11:12 2022] GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618 => generated 1699 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:11:13.677429 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-ddff5b6b-bc76-4928-b3bd-4dc86b3cf889 req-8b6a581c-df37-40d9-91be-597bfd173df8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d9b0e12-e49d-4e64-a523-a84ee0937618", "name": "network-vif-unplugged", "status": "completed", "tag": "1b9c2936-acec-48ae-914e-d5f323ba8e60"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:11:13.685738 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-ddff5b6b-bc76-4928-b3bd-4dc86b3cf889 req-8b6a581c-df37-40d9-91be-597bfd173df8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:13.686202 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-ddff5b6b-bc76-4928-b3bd-4dc86b3cf889 req-8b6a581c-df37-40d9-91be-597bfd173df8 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:13.690573 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:11:13.698733 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-ddff5b6b-bc76-4928-b3bd-4dc86b3cf889 req-8b6a581c-df37-40d9-91be-597bfd173df8 service nova] Creating event network-vif-unplugged:1b9c2936-acec-48ae-914e-d5f323ba8e60 for instance 9d9b0e12-e49d-4e64-a523-a84ee0937618 on chh1-master-2 Jun 10 19:11:13.705105 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [req-ddff5b6b-bc76-4928-b3bd-4dc86b3cf889 req-8b6a581c-df37-40d9-91be-597bfd173df8 service nova] Instance 9d9b0e12-e49d-4e64-a523-a84ee0937618 is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 19:11:13.716129 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-ddff5b6b-bc76-4928-b3bd-4dc86b3cf889 req-8b6a581c-df37-40d9-91be-597bfd173df8 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095042 Jun 10 19:11:13.716939 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4413/8035] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:11:14.025954 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7d6ab6db-951c-40d1-ad44-c3da5d3aa5c0 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:11:14.026842 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7d6ab6db-951c-40d1-ad44-c3da5d3aa5c0 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:11:14.034988 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7d6ab6db-951c-40d1-ad44-c3da5d3aa5c0 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:14.035447 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7d6ab6db-951c-40d1-ad44-c3da5d3aa5c0 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:14.036277 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7d6ab6db-951c-40d1-ad44-c3da5d3aa5c0 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:14.036771 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7d6ab6db-951c-40d1-ad44-c3da5d3aa5c0 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:14.195074 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7d6ab6db-951c-40d1-ad44-c3da5d3aa5c0 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:11:14.202730 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7d6ab6db-951c-40d1-ad44-c3da5d3aa5c0 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618" status: 200 len: 1698 microversion: 2.1 time: 0.183441 Jun 10 19:11:14.203307 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4414/8036] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:11:14 2022] GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618 => generated 1698 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:11:15.238651 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9a167e84-cd4a-41a2-be7a-38a846c4cd5e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:11:15.239378 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9a167e84-cd4a-41a2-be7a-38a846c4cd5e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:11:15.246683 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9a167e84-cd4a-41a2-be7a-38a846c4cd5e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:15.247203 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9a167e84-cd4a-41a2-be7a-38a846c4cd5e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:15.247964 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9a167e84-cd4a-41a2-be7a-38a846c4cd5e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:15.248433 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9a167e84-cd4a-41a2-be7a-38a846c4cd5e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:15.382903 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9a167e84-cd4a-41a2-be7a-38a846c4cd5e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:11:15.390520 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9a167e84-cd4a-41a2-be7a-38a846c4cd5e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618" status: 200 len: 1696 microversion: 2.1 time: 0.156369 Jun 10 19:11:15.391136 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4415/8037] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:11:15 2022] GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618 => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:11:15.736992 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-042024a0-67b9-4265-8fcc-1b9171b4e06d req-7eb69b52-a52e-4288-9e45-e652221c58d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d9b0e12-e49d-4e64-a523-a84ee0937618", "tag": "1b9c2936-acec-48ae-914e-d5f323ba8e60"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:11:15.745025 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-042024a0-67b9-4265-8fcc-1b9171b4e06d req-7eb69b52-a52e-4288-9e45-e652221c58d1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:15.745471 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-042024a0-67b9-4265-8fcc-1b9171b4e06d req-7eb69b52-a52e-4288-9e45-e652221c58d1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:15.757333 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-042024a0-67b9-4265-8fcc-1b9171b4e06d req-7eb69b52-a52e-4288-9e45-e652221c58d1 service nova] Creating event network-changed:1b9c2936-acec-48ae-914e-d5f323ba8e60 for instance 9d9b0e12-e49d-4e64-a523-a84ee0937618 on chh1-master-2 Jun 10 19:11:15.762541 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [req-042024a0-67b9-4265-8fcc-1b9171b4e06d req-7eb69b52-a52e-4288-9e45-e652221c58d1 service nova] Instance 9d9b0e12-e49d-4e64-a523-a84ee0937618 is migrating within the same cell, copying events to all relevant hosts: {'chh2-master-2', 'chh1-master-2'} {{(pid=126595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 10 19:11:15.773461 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-042024a0-67b9-4265-8fcc-1b9171b4e06d req-7eb69b52-a52e-4288-9e45-e652221c58d1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040361 Jun 10 19:11:15.774038 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4416/8038] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:11:16.409311 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-48454c09-56f2-472c-9f7e-65586bce3248 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:11:16.410037 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-48454c09-56f2-472c-9f7e-65586bce3248 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:11:16.416506 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-48454c09-56f2-472c-9f7e-65586bce3248 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:16.425021 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-48454c09-56f2-472c-9f7e-65586bce3248 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:16.425021 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-48454c09-56f2-472c-9f7e-65586bce3248 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:16.425021 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-48454c09-56f2-472c-9f7e-65586bce3248 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:16.586115 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-48454c09-56f2-472c-9f7e-65586bce3248 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:11:16.594464 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-48454c09-56f2-472c-9f7e-65586bce3248 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618" status: 200 len: 1696 microversion: 2.1 time: 0.189785 Jun 10 19:11:16.598899 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4417/8039] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:11:16 2022] GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618 => generated 1696 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:11:17.614185 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4ada5964-246b-471f-9f02-affbd9ce48b6 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:11:17.614827 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4ada5964-246b-471f-9f02-affbd9ce48b6 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:11:17.621693 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ada5964-246b-471f-9f02-affbd9ce48b6 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:17.622149 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ada5964-246b-471f-9f02-affbd9ce48b6 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:17.622923 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ada5964-246b-471f-9f02-affbd9ce48b6 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:17.623361 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4ada5964-246b-471f-9f02-affbd9ce48b6 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:17.756810 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4ada5964-246b-471f-9f02-affbd9ce48b6 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:11:17.764365 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4ada5964-246b-471f-9f02-affbd9ce48b6 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618" status: 200 len: 1693 microversion: 2.1 time: 0.154078 Jun 10 19:11:17.764942 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4418/8040] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:11:17 2022] GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618 => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:11:17.779938 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-094879dd-cd0a-4a56-92f6-2b761f0d985d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:11:17.780508 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-094879dd-cd0a-4a56-92f6-2b761f0d985d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:11:17.786186 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-094879dd-cd0a-4a56-92f6-2b761f0d985d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:17.786642 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-094879dd-cd0a-4a56-92f6-2b761f0d985d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:17.787401 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-094879dd-cd0a-4a56-92f6-2b761f0d985d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:17.787842 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-094879dd-cd0a-4a56-92f6-2b761f0d985d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:17.988915 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-094879dd-cd0a-4a56-92f6-2b761f0d985d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "POST /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618/action" status: 204 len: 0 microversion: 2.1 time: 0.212211 Jun 10 19:11:17.989581 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4419/8041] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 19:11:17 2022] POST /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618/action => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 19:11:17.999717 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1d29d14e-789c-48df-b205-0b564044200c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:11:18.000449 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1d29d14e-789c-48df-b205-0b564044200c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:11:18.006815 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d29d14e-789c-48df-b205-0b564044200c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:18.007272 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d29d14e-789c-48df-b205-0b564044200c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:18.008054 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d29d14e-789c-48df-b205-0b564044200c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:18.008587 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1d29d14e-789c-48df-b205-0b564044200c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:18.146974 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1d29d14e-789c-48df-b205-0b564044200c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:11:18.155579 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1d29d14e-789c-48df-b205-0b564044200c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618" status: 200 len: 1693 microversion: 2.1 time: 0.161414 Jun 10 19:11:18.159043 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4420/8042] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:11:17 2022] GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618 => generated 1693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:11:18.175427 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c2031ffa-bf50-44e9-a273-853a3cfacba0 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:11:18.176055 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c2031ffa-bf50-44e9-a273-853a3cfacba0 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:11:18.183076 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c2031ffa-bf50-44e9-a273-853a3cfacba0 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:18.183214 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c2031ffa-bf50-44e9-a273-853a3cfacba0 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:18.183955 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c2031ffa-bf50-44e9-a273-853a3cfacba0 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:18.184426 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c2031ffa-bf50-44e9-a273-853a3cfacba0 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:18.319797 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c2031ffa-bf50-44e9-a273-853a3cfacba0 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:11:18.327697 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c2031ffa-bf50-44e9-a273-853a3cfacba0 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618" status: 200 len: 1693 microversion: 2.1 time: 0.157287 Jun 10 19:11:18.328840 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4421/8043] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:11:18 2022] GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:11:19.345122 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-608cb0a2-58f2-4223-908f-723cc5298e6e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:11:19.345939 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-608cb0a2-58f2-4223-908f-723cc5298e6e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:11:19.353429 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-608cb0a2-58f2-4223-908f-723cc5298e6e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:19.353886 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-608cb0a2-58f2-4223-908f-723cc5298e6e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:19.354671 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-608cb0a2-58f2-4223-908f-723cc5298e6e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:19.355116 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-608cb0a2-58f2-4223-908f-723cc5298e6e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:19.794303 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-608cb0a2-58f2-4223-908f-723cc5298e6e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:11:19.803330 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-608cb0a2-58f2-4223-908f-723cc5298e6e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618" status: 200 len: 1693 microversion: 2.1 time: 0.462424 Jun 10 19:11:19.803915 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4422/8044] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:11:19 2022] GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618 => generated 1693 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:11:20.089879 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-1ec932ad-307f-418c-8912-2813edfb6bc0 req-f37d5233-4b4e-470b-a79e-daedcd5dc2d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d9b0e12-e49d-4e64-a523-a84ee0937618", "name": "network-vif-plugged", "status": "completed", "tag": "1b9c2936-acec-48ae-914e-d5f323ba8e60"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:11:20.098537 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-1ec932ad-307f-418c-8912-2813edfb6bc0 req-f37d5233-4b4e-470b-a79e-daedcd5dc2d6 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:20.098996 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-1ec932ad-307f-418c-8912-2813edfb6bc0 req-f37d5233-4b4e-470b-a79e-daedcd5dc2d6 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:20.110142 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-1ec932ad-307f-418c-8912-2813edfb6bc0 req-f37d5233-4b4e-470b-a79e-daedcd5dc2d6 service nova] Creating event network-vif-plugged:1b9c2936-acec-48ae-914e-d5f323ba8e60 for instance 9d9b0e12-e49d-4e64-a523-a84ee0937618 on chh1-master-2 Jun 10 19:11:20.114947 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-1ec932ad-307f-418c-8912-2813edfb6bc0 req-f37d5233-4b4e-470b-a79e-daedcd5dc2d6 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028810 Jun 10 19:11:20.117993 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4423/8045] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:11:20.821756 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1f0a1e4f-8406-4934-be9c-44609e438960 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:11:20.822461 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1f0a1e4f-8406-4934-be9c-44609e438960 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:11:20.828788 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f0a1e4f-8406-4934-be9c-44609e438960 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:20.829246 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f0a1e4f-8406-4934-be9c-44609e438960 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:20.830012 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f0a1e4f-8406-4934-be9c-44609e438960 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:20.830455 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1f0a1e4f-8406-4934-be9c-44609e438960 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:20.963578 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1f0a1e4f-8406-4934-be9c-44609e438960 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:11:20.971814 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1f0a1e4f-8406-4934-be9c-44609e438960 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618" status: 200 len: 1685 microversion: 2.1 time: 0.155177 Jun 10 19:11:20.972403 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4424/8046] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:11:20 2022] GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618 => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:11:43.142205 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b01d9d16-d34d-4c11-9a79-dd91aa789059 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:11:43.143195 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b01d9d16-d34d-4c11-9a79-dd91aa789059 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:11:43.145740 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=58 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:11:43.146405 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:11:43.151195 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b01d9d16-d34d-4c11-9a79-dd91aa789059 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:43.151648 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b01d9d16-d34d-4c11-9a79-dd91aa789059 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:43.152439 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b01d9d16-d34d-4c11-9a79-dd91aa789059 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:43.152886 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b01d9d16-d34d-4c11-9a79-dd91aa789059 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:43.205358 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b01d9d16-d34d-4c11-9a79-dd91aa789059 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "POST /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618/action" status: 200 len: 24580 microversion: 2.1 time: 0.067086 Jun 10 19:11:43.205988 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4425/8047] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 19:11:43 2022] POST /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618/action => generated 24580 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 10 19:11:50.298839 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-57db73d4-7fab-466f-b8f9-1e0d7ac16dd6 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:11:50.299607 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-57db73d4-7fab-466f-b8f9-1e0d7ac16dd6 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:11:50.307484 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-57db73d4-7fab-466f-b8f9-1e0d7ac16dd6 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:50.307944 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-57db73d4-7fab-466f-b8f9-1e0d7ac16dd6 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:50.309542 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-57db73d4-7fab-466f-b8f9-1e0d7ac16dd6 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:50.310019 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-57db73d4-7fab-466f-b8f9-1e0d7ac16dd6 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:50.337198 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-57db73d4-7fab-466f-b8f9-1e0d7ac16dd6 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 19:11:50.628950 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-57db73d4-7fab-466f-b8f9-1e0d7ac16dd6 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "DELETE /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618" status: 204 len: 0 microversion: 2.1 time: 0.334291 Jun 10 19:11:50.629559 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4426/8048] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 19:11:50 2022] DELETE /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 19:11:50.635433 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-e60cf653-b3a2-4668-bc33-f08dbc36afaa req-a6cadaf4-4f10-4834-8a86-13ec357131e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d9b0e12-e49d-4e64-a523-a84ee0937618", "tag": "1b9c2936-acec-48ae-914e-d5f323ba8e60"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:11:50.644507 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-e60cf653-b3a2-4668-bc33-f08dbc36afaa req-a6cadaf4-4f10-4834-8a86-13ec357131e3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:50.644954 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-e60cf653-b3a2-4668-bc33-f08dbc36afaa req-a6cadaf4-4f10-4834-8a86-13ec357131e3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:50.655742 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-e60cf653-b3a2-4668-bc33-f08dbc36afaa req-a6cadaf4-4f10-4834-8a86-13ec357131e3 service nova] Creating event network-changed:1b9c2936-acec-48ae-914e-d5f323ba8e60 for instance 9d9b0e12-e49d-4e64-a523-a84ee0937618 on chh1-master-2 Jun 10 19:11:50.660838 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-e60cf653-b3a2-4668-bc33-f08dbc36afaa req-a6cadaf4-4f10-4834-8a86-13ec357131e3 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029901 Jun 10 19:11:50.661594 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4427/8049] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:11:50.666945 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-adad2629-ba8a-4417-ac46-8de203601e52 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:11:50.667647 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-adad2629-ba8a-4417-ac46-8de203601e52 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:11:50.674441 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-adad2629-ba8a-4417-ac46-8de203601e52 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:50.674834 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-adad2629-ba8a-4417-ac46-8de203601e52 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:50.675606 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-adad2629-ba8a-4417-ac46-8de203601e52 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:50.676046 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-adad2629-ba8a-4417-ac46-8de203601e52 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:50.822601 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-adad2629-ba8a-4417-ac46-8de203601e52 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:11:50.830737 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-adad2629-ba8a-4417-ac46-8de203601e52 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618" status: 200 len: 1691 microversion: 2.1 time: 0.167952 Jun 10 19:11:50.831325 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4428/8050] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:11:50 2022] GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618 => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:11:51.848145 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ff87b5db-39df-48c8-8c8d-e43de4566882 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:11:51.848814 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ff87b5db-39df-48c8-8c8d-e43de4566882 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:11:51.855816 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ff87b5db-39df-48c8-8c8d-e43de4566882 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:51.856275 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ff87b5db-39df-48c8-8c8d-e43de4566882 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:51.857095 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ff87b5db-39df-48c8-8c8d-e43de4566882 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:51.857538 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ff87b5db-39df-48c8-8c8d-e43de4566882 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:52.064071 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ff87b5db-39df-48c8-8c8d-e43de4566882 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:11:52.074002 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ff87b5db-39df-48c8-8c8d-e43de4566882 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618" status: 200 len: 1691 microversion: 2.1 time: 0.230173 Jun 10 19:11:52.085544 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4429/8051] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:11:51 2022] GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618 => generated 1691 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:11:52.471853 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-0e718c16-e296-4acc-9176-1a3ce60c2ada req-6d5931e0-7cf1-4595-8187-8500e2b334c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d9b0e12-e49d-4e64-a523-a84ee0937618", "name": "network-vif-deleted", "tag": "1b9c2936-acec-48ae-914e-d5f323ba8e60"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:11:52.479926 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-0e718c16-e296-4acc-9176-1a3ce60c2ada req-6d5931e0-7cf1-4595-8187-8500e2b334c2 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:52.480352 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-0e718c16-e296-4acc-9176-1a3ce60c2ada req-6d5931e0-7cf1-4595-8187-8500e2b334c2 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:52.491736 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-0e718c16-e296-4acc-9176-1a3ce60c2ada req-6d5931e0-7cf1-4595-8187-8500e2b334c2 service nova] Creating event network-vif-deleted:1b9c2936-acec-48ae-914e-d5f323ba8e60 for instance 9d9b0e12-e49d-4e64-a523-a84ee0937618 on chh1-master-2 Jun 10 19:11:52.497083 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-0e718c16-e296-4acc-9176-1a3ce60c2ada req-6d5931e0-7cf1-4595-8187-8500e2b334c2 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029007 Jun 10 19:11:52.497857 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4430/8052] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:11:53.093060 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b9ee57da-ef29-49b1-9550-ab2c41e76f82 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:11:53.093765 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b9ee57da-ef29-49b1-9550-ab2c41e76f82 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:11:53.100988 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9ee57da-ef29-49b1-9550-ab2c41e76f82 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:53.101460 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9ee57da-ef29-49b1-9550-ab2c41e76f82 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:53.102230 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9ee57da-ef29-49b1-9550-ab2c41e76f82 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:53.102675 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9ee57da-ef29-49b1-9550-ab2c41e76f82 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:53.135275 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9ee57da-ef29-49b1-9550-ab2c41e76f82 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:53.135719 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9ee57da-ef29-49b1-9550-ab2c41e76f82 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:53.136170 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-b9ee57da-ef29-49b1-9550-ab2c41e76f82 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lazy-loading 'fault' on Instance uuid 9d9b0e12-e49d-4e64-a523-a84ee0937618 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 19:11:53.178537 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b9ee57da-ef29-49b1-9550-ab2c41e76f82 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:11:53.186174 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b9ee57da-ef29-49b1-9550-ab2c41e76f82 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618" status: 200 len: 1357 microversion: 2.1 time: 0.097382 Jun 10 19:11:53.189923 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4431/8053] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:11:53 2022] GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618 => generated 1357 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:11:54.203294 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-09646a60-0c5d-4701-9591-55d65f67744f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:11:54.203926 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-09646a60-0c5d-4701-9591-55d65f67744f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 9d9b0e12-e49d-4e64-a523-a84ee0937618] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:11:54.211310 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-09646a60-0c5d-4701-9591-55d65f67744f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:54.211766 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-09646a60-0c5d-4701-9591-55d65f67744f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:54.212557 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-09646a60-0c5d-4701-9591-55d65f67744f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:11:54.213001 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-09646a60-0c5d-4701-9591-55d65f67744f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:11:54.226169 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-09646a60-0c5d-4701-9591-55d65f67744f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] HTTP exception thrown: Instance 9d9b0e12-e49d-4e64-a523-a84ee0937618 could not be found. Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-09646a60-0c5d-4701-9591-55d65f67744f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Request method failure captured: Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618 HTTP/1.1 Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5YPAQIj2rjg21dP-hUkWvxTBbenKqLrs8X-dpl0gh5SlblRc7YzYXxJQF7OQJ04iiajVs3_DtHbkXtpyH9RfjMCCLWxpP-pI5ZbkVRrg8NY9qs7N4ZrPXBXmIPChYaWOg__AcNo6wiv5vK4jl8UssW1Gbox3NB6dpu_4KvF6u5DG7s Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 69f65fbabf1d4b85aa3ec38f0e4efe11 Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2031160215 Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/69f65fbabf1d4b85aa3ec38f0e4efe11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/69f65fbabf1d4b85aa3ec38f0e4efe11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/69f65fbabf1d4b85aa3ec38f0e4efe11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_69f65fbabf1d4b85aa3ec38f0e4efe11", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2031160215 Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 69f65fbabf1d4b85aa3ec38f0e4efe11 Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2031160215 Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-TestNetworkAdvancedServerOps-2031160215-project Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: c75f5f98f96946e18c2e665b7f59f75d Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2031160215-project Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 9d9b0e12-e49d-4e64-a523-a84ee0937618 could not be found. Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '9d9b0e12-e49d-4e64-a523-a84ee0937618'} Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d9b0e12-e49d-4e64-a523-a84ee0937618 could not be found. Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d9b0e12-e49d-4e64-a523-a84ee0937618 could not be found. Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:11:54.227794 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:11:54.232071 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:11:54.232071 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:11:54.232071 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:11:54.232071 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:11:54.232071 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 19:11:54.232071 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 19:11:54.232071 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d9b0e12-e49d-4e64-a523-a84ee0937618 could not be found. Jun 10 19:11:54.232071 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:11:54.232071 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-09646a60-0c5d-4701-9591-55d65f67744f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Returning 404 to user: Instance 9d9b0e12-e49d-4e64-a523-a84ee0937618 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 19:11:54.232071 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-09646a60-0c5d-4701-9591-55d65f67744f tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618" status: 404 len: 111 microversion: 2.1 time: 0.029860 Jun 10 19:11:54.232071 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4432/8054] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:11:54 2022] GET /compute/v2.1/servers/9d9b0e12-e49d-4e64-a523-a84ee0937618 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 19:11:57.859416 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c9e1b292-e5fd-4a12-8744-44aa13b11301 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '.version_select at 0x7f77c610ca60>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:11:57.863497 chdv-master-2 devstack@n-api.service[126595]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c9e1b292-e5fd-4a12-8744-44aa13b11301 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [810142a8-37af-4b57-a57e-ca2623af985c] AMQP server on 10.222.0.35:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 10 19:11:58.871380 chdv-master-2 devstack@n-api.service[126595]: INFO oslo.messaging._drivers.impl_rabbit [None req-c9e1b292-e5fd-4a12-8744-44aa13b11301 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [810142a8-37af-4b57-a57e-ca2623af985c] Reconnected to AMQP server on 10.222.0.35:5672 via [amqp] client with port 47782. Jun 10 19:11:58.965275 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c9e1b292-e5fd-4a12-8744-44aa13b11301 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2004843180" status: 202 len: 0 microversion: 2.1 time: 1.109955 Jun 10 19:11:58.965859 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4433/8055] 10.222.0.35 () {58 vars in 1283 bytes} [Fri Jun 10 19:11:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2004843180 => generated 0 bytes in 1111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 19:11:58.993521 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-194d6f4a-ef79-4fae-bdde-2807a8269c04 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Action: 'create', calling method: .version_select at 0x7f77c02d2d30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1927592007", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJv+RQQVAmwuGQNuApIktmbVn509TyWzGlpaOdW5eVgKNUp1WpiQjbf4adHPgPLvxxghv31pQWhJQyxVYt4HgraMIthLsm5YROVkpCbaytap/0Yh/1RWRe8Vuy7YJrenPw=="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:11:59.007578 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-194d6f4a-ef79-4fae-bdde-2807a8269c04 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Getting quotas for project 69f65fbabf1d4b85aa3ec38f0e4efe11. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 19:11:59.012755 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-194d6f4a-ef79-4fae-bdde-2807a8269c04 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Getting quotas for user c75f5f98f96946e18c2e665b7f59f75d and project 69f65fbabf1d4b85aa3ec38f0e4efe11. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 19:11:59.100950 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-194d6f4a-ef79-4fae-bdde-2807a8269c04 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.111127 Jun 10 19:11:59.101566 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4434/8056] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 19:11:58 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:12:06.969101 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:12:06.973166 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-27365818-fe06-4cde-9c80-cf7e3fca8cb9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1272763743", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "d925c4df-699c-43a8-b3b5-b1699fb9b45a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1927592007", "security_groups": [{"name": "tempest-secgroup-smoke-2097980488"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:12:07.086882 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-27365818-fe06-4cde-9c80-cf7e3fca8cb9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] validate_networks() for [('d925c4df-699c-43a8-b3b5-b1699fb9b45a', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 19:12:07.540493 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-27365818-fe06-4cde-9c80-cf7e3fca8cb9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 19:12:07.541156 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-27365818-fe06-4cde-9c80-cf7e3fca8cb9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 19:12:07.541765 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-27365818-fe06-4cde-9c80-cf7e3fca8cb9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 19:12:07.542392 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-27365818-fe06-4cde-9c80-cf7e3fca8cb9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 19:12:07.543071 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-27365818-fe06-4cde-9c80-cf7e3fca8cb9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 19:12:07.553802 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-27365818-fe06-4cde-9c80-cf7e3fca8cb9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:12:07.554411 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-27365818-fe06-4cde-9c80-cf7e3fca8cb9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:12:07.555348 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-27365818-fe06-4cde-9c80-cf7e3fca8cb9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:12:07.555901 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-27365818-fe06-4cde-9c80-cf7e3fca8cb9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:12:07.582921 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-27365818-fe06-4cde-9c80-cf7e3fca8cb9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Getting quotas for project 69f65fbabf1d4b85aa3ec38f0e4efe11. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 19:12:07.593134 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-27365818-fe06-4cde-9c80-cf7e3fca8cb9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Getting quotas for user c75f5f98f96946e18c2e665b7f59f75d and project 69f65fbabf1d4b85aa3ec38f0e4efe11. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 19:12:07.615993 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-27365818-fe06-4cde-9c80-cf7e3fca8cb9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 19:12:07.618671 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-27365818-fe06-4cde-9c80-cf7e3fca8cb9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 511644aa-c126-4b05-8fde-d5cf3cb4f603] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 19:12:07.738697 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-27365818-fe06-4cde-9c80-cf7e3fca8cb9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.771518 Jun 10 19:12:07.739519 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4435/8057] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 19:12:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 10 19:12:07.751552 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c0a68a72-de88-43b2-a088-80191d72ca3b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:12:07.752613 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c0a68a72-de88-43b2-a088-80191d72ca3b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 511644aa-c126-4b05-8fde-d5cf3cb4f603] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:12:07.846108 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c0a68a72-de88-43b2-a088-80191d72ca3b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:12:07.862159 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c0a68a72-de88-43b2-a088-80191d72ca3b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603" status: 200 len: 1267 microversion: 2.1 time: 0.115711 Jun 10 19:12:07.873378 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4436/8058] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:12:07 2022] GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603 => generated 1267 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:12:08.880282 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-39e64f06-04f5-4cb4-a6d6-33960ad83da2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:12:08.881491 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-39e64f06-04f5-4cb4-a6d6-33960ad83da2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 511644aa-c126-4b05-8fde-d5cf3cb4f603] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:12:08.890946 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-39e64f06-04f5-4cb4-a6d6-33960ad83da2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:12:08.891992 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-39e64f06-04f5-4cb4-a6d6-33960ad83da2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:12:08.895943 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-39e64f06-04f5-4cb4-a6d6-33960ad83da2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:12:08.896402 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-39e64f06-04f5-4cb4-a6d6-33960ad83da2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:12:08.997860 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-39e64f06-04f5-4cb4-a6d6-33960ad83da2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:12:09.011826 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-39e64f06-04f5-4cb4-a6d6-33960ad83da2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603" status: 200 len: 1271 microversion: 2.1 time: 0.136201 Jun 10 19:12:09.023404 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4437/8059] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:12:08 2022] GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603 => generated 1271 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:12:10.029637 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c17dab7c-b9cd-4804-855d-cae8108fe375 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:12:10.030275 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c17dab7c-b9cd-4804-855d-cae8108fe375 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 511644aa-c126-4b05-8fde-d5cf3cb4f603] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:12:10.038036 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c17dab7c-b9cd-4804-855d-cae8108fe375 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:12:10.038494 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c17dab7c-b9cd-4804-855d-cae8108fe375 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:12:10.039278 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c17dab7c-b9cd-4804-855d-cae8108fe375 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:12:10.039735 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c17dab7c-b9cd-4804-855d-cae8108fe375 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:12:10.110360 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c17dab7c-b9cd-4804-855d-cae8108fe375 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:12:10.118308 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c17dab7c-b9cd-4804-855d-cae8108fe375 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603" status: 200 len: 1327 microversion: 2.1 time: 0.092524 Jun 10 19:12:10.119146 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4438/8060] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:12:10 2022] GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603 => generated 1327 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:12:11.137231 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-915f54d3-1460-45ea-b03b-f041cde61e00 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:12:11.137843 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-915f54d3-1460-45ea-b03b-f041cde61e00 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 511644aa-c126-4b05-8fde-d5cf3cb4f603] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:12:11.146778 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-915f54d3-1460-45ea-b03b-f041cde61e00 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:12:11.147300 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-915f54d3-1460-45ea-b03b-f041cde61e00 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:12:11.151016 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-915f54d3-1460-45ea-b03b-f041cde61e00 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:12:11.151016 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-915f54d3-1460-45ea-b03b-f041cde61e00 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:12:11.286805 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-915f54d3-1460-45ea-b03b-f041cde61e00 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:12:11.294558 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-915f54d3-1460-45ea-b03b-f041cde61e00 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603" status: 200 len: 1393 microversion: 2.1 time: 0.161824 Jun 10 19:12:11.295133 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4439/8061] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:12:11 2022] GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603 => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:12:11.735783 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-acfc3641-c1f2-4930-a838-6547372738a9 req-53d8e57c-c7fd-4d60-9ca8-d8f24ffdf1da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "511644aa-c126-4b05-8fde-d5cf3cb4f603", "tag": "68d2e42a-8d97-496a-952a-1c7a643ae58d"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:12:11.746499 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-acfc3641-c1f2-4930-a838-6547372738a9 req-53d8e57c-c7fd-4d60-9ca8-d8f24ffdf1da service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:12:11.746933 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-acfc3641-c1f2-4930-a838-6547372738a9 req-53d8e57c-c7fd-4d60-9ca8-d8f24ffdf1da service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:12:11.763283 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-acfc3641-c1f2-4930-a838-6547372738a9 req-53d8e57c-c7fd-4d60-9ca8-d8f24ffdf1da service nova] Creating event network-changed:68d2e42a-8d97-496a-952a-1c7a643ae58d for instance 511644aa-c126-4b05-8fde-d5cf3cb4f603 on chh2-master-2 Jun 10 19:12:11.769095 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-acfc3641-c1f2-4930-a838-6547372738a9 req-53d8e57c-c7fd-4d60-9ca8-d8f24ffdf1da service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037111 Jun 10 19:12:11.769559 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4440/8062] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:12:12.314708 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-068c9e10-9614-44d1-9f7f-f2bd2323b725 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:12:12.315519 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-068c9e10-9614-44d1-9f7f-f2bd2323b725 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 511644aa-c126-4b05-8fde-d5cf3cb4f603] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:12:12.321903 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-068c9e10-9614-44d1-9f7f-f2bd2323b725 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:12:12.322352 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-068c9e10-9614-44d1-9f7f-f2bd2323b725 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:12:12.323114 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-068c9e10-9614-44d1-9f7f-f2bd2323b725 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:12:12.323552 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-068c9e10-9614-44d1-9f7f-f2bd2323b725 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:12:12.460410 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-068c9e10-9614-44d1-9f7f-f2bd2323b725 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:12:12.468014 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-068c9e10-9614-44d1-9f7f-f2bd2323b725 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603" status: 200 len: 1393 microversion: 2.1 time: 0.159125 Jun 10 19:12:12.468699 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4441/8063] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:12:12 2022] GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603 => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:12:13.484968 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a18adce8-9adf-4296-bd08-8613e63f284e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:12:13.485588 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a18adce8-9adf-4296-bd08-8613e63f284e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 511644aa-c126-4b05-8fde-d5cf3cb4f603] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:12:13.488409 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:12:13.493235 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a18adce8-9adf-4296-bd08-8613e63f284e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:12:13.493695 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a18adce8-9adf-4296-bd08-8613e63f284e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:12:13.494470 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a18adce8-9adf-4296-bd08-8613e63f284e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:12:13.494922 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a18adce8-9adf-4296-bd08-8613e63f284e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:12:13.622886 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a18adce8-9adf-4296-bd08-8613e63f284e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:12:13.630696 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a18adce8-9adf-4296-bd08-8613e63f284e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603" status: 200 len: 1393 microversion: 2.1 time: 0.149964 Jun 10 19:12:13.631261 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4442/8064] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:12:13 2022] GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603 => generated 1393 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:12:14.648266 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bb703c22-129e-4a77-9a85-028398ea9ebe tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:12:14.649296 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bb703c22-129e-4a77-9a85-028398ea9ebe tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 511644aa-c126-4b05-8fde-d5cf3cb4f603] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:12:14.659400 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb703c22-129e-4a77-9a85-028398ea9ebe tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:12:14.659860 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb703c22-129e-4a77-9a85-028398ea9ebe tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:12:14.660680 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb703c22-129e-4a77-9a85-028398ea9ebe tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:12:14.661130 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bb703c22-129e-4a77-9a85-028398ea9ebe tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:12:15.072367 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bb703c22-129e-4a77-9a85-028398ea9ebe tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:12:15.080607 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bb703c22-129e-4a77-9a85-028398ea9ebe tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603" status: 200 len: 1393 microversion: 2.1 time: 0.436604 Jun 10 19:12:15.081187 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4443/8065] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:12:14 2022] GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603 => generated 1393 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:12:16.098054 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-84f3ed78-848c-443b-babf-b85884f10707 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:12:16.098659 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-84f3ed78-848c-443b-babf-b85884f10707 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 511644aa-c126-4b05-8fde-d5cf3cb4f603] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:12:16.105482 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-84f3ed78-848c-443b-babf-b85884f10707 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:12:16.105934 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-84f3ed78-848c-443b-babf-b85884f10707 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:12:16.106688 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-84f3ed78-848c-443b-babf-b85884f10707 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:12:16.107122 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-84f3ed78-848c-443b-babf-b85884f10707 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:12:16.238912 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-84f3ed78-848c-443b-babf-b85884f10707 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:12:16.246397 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-84f3ed78-848c-443b-babf-b85884f10707 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603" status: 200 len: 1393 microversion: 2.1 time: 0.152889 Jun 10 19:12:16.246967 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4444/8066] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:12:16 2022] GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603 => generated 1393 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:12:17.263266 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-974d6ede-9d4a-4474-b47b-57b6806edf00 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:12:17.263869 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-974d6ede-9d4a-4474-b47b-57b6806edf00 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 511644aa-c126-4b05-8fde-d5cf3cb4f603] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:12:17.271434 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-974d6ede-9d4a-4474-b47b-57b6806edf00 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:12:17.271881 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-974d6ede-9d4a-4474-b47b-57b6806edf00 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:12:17.272688 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-974d6ede-9d4a-4474-b47b-57b6806edf00 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:12:17.273134 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-974d6ede-9d4a-4474-b47b-57b6806edf00 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:12:17.409414 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-974d6ede-9d4a-4474-b47b-57b6806edf00 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:12:17.417434 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-974d6ede-9d4a-4474-b47b-57b6806edf00 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603" status: 200 len: 1393 microversion: 2.1 time: 0.157982 Jun 10 19:12:17.418280 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4445/8067] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:12:17 2022] GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603 => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:12:18.434321 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f1f49d2c-a48e-458c-a578-c4655dc148dc tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:12:18.434939 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f1f49d2c-a48e-458c-a578-c4655dc148dc tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 511644aa-c126-4b05-8fde-d5cf3cb4f603] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:12:18.436864 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:12:18.437569 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=12 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:12:18.443244 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f1f49d2c-a48e-458c-a578-c4655dc148dc tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:12:18.443691 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f1f49d2c-a48e-458c-a578-c4655dc148dc tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:12:18.444501 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f1f49d2c-a48e-458c-a578-c4655dc148dc tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:12:18.444951 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f1f49d2c-a48e-458c-a578-c4655dc148dc tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:12:18.573105 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f1f49d2c-a48e-458c-a578-c4655dc148dc tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:12:18.581298 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f1f49d2c-a48e-458c-a578-c4655dc148dc tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603" status: 200 len: 1393 microversion: 2.1 time: 0.150882 Jun 10 19:12:18.581865 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4446/8068] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:12:18 2022] GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603 => generated 1393 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:12:19.387012 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-78ae1d55-fb14-4fd8-89bc-9f6756cfa1e7 req-7d36aa76-9530-485b-afb3-6eda8b86cc1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "511644aa-c126-4b05-8fde-d5cf3cb4f603", "name": "network-vif-plugged", "status": "completed", "tag": "68d2e42a-8d97-496a-952a-1c7a643ae58d"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:12:19.395742 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-78ae1d55-fb14-4fd8-89bc-9f6756cfa1e7 req-7d36aa76-9530-485b-afb3-6eda8b86cc1d service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:12:19.395902 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-78ae1d55-fb14-4fd8-89bc-9f6756cfa1e7 req-7d36aa76-9530-485b-afb3-6eda8b86cc1d service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:12:19.407886 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-78ae1d55-fb14-4fd8-89bc-9f6756cfa1e7 req-7d36aa76-9530-485b-afb3-6eda8b86cc1d service nova] Creating event network-vif-plugged:68d2e42a-8d97-496a-952a-1c7a643ae58d for instance 511644aa-c126-4b05-8fde-d5cf3cb4f603 on chh2-master-2 Jun 10 19:12:19.412829 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-78ae1d55-fb14-4fd8-89bc-9f6756cfa1e7 req-7d36aa76-9530-485b-afb3-6eda8b86cc1d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029507 Jun 10 19:12:19.413416 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4447/8069] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:12:19.599907 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-47b1e3da-9acc-4173-9a2e-a9b06b2bdfcc tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:12:19.600672 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-47b1e3da-9acc-4173-9a2e-a9b06b2bdfcc tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 511644aa-c126-4b05-8fde-d5cf3cb4f603] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:12:19.607348 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-47b1e3da-9acc-4173-9a2e-a9b06b2bdfcc tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:12:19.607807 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-47b1e3da-9acc-4173-9a2e-a9b06b2bdfcc tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:12:19.612243 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-47b1e3da-9acc-4173-9a2e-a9b06b2bdfcc tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:12:19.612243 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-47b1e3da-9acc-4173-9a2e-a9b06b2bdfcc tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:12:19.742602 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-47b1e3da-9acc-4173-9a2e-a9b06b2bdfcc tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:12:19.750203 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-47b1e3da-9acc-4173-9a2e-a9b06b2bdfcc tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603" status: 200 len: 1393 microversion: 2.1 time: 0.155939 Jun 10 19:12:19.750755 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4448/8070] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:12:19 2022] GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603 => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:12:20.767574 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1737acfe-483b-4d2e-98c7-a13fd6579d4a tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:12:20.768259 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1737acfe-483b-4d2e-98c7-a13fd6579d4a tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 511644aa-c126-4b05-8fde-d5cf3cb4f603] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:12:20.775183 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1737acfe-483b-4d2e-98c7-a13fd6579d4a tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:12:20.775632 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1737acfe-483b-4d2e-98c7-a13fd6579d4a tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:12:20.776478 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1737acfe-483b-4d2e-98c7-a13fd6579d4a tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:12:20.776916 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1737acfe-483b-4d2e-98c7-a13fd6579d4a tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:12:20.911184 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1737acfe-483b-4d2e-98c7-a13fd6579d4a tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:12:20.918736 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1737acfe-483b-4d2e-98c7-a13fd6579d4a tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603" status: 200 len: 1393 microversion: 2.1 time: 0.155665 Jun 10 19:12:20.919310 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4449/8071] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:12:20 2022] GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603 => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:12:21.934719 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ee7a9aa6-3f2b-4f99-b68c-f558ddd0efa6 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:12:21.935378 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ee7a9aa6-3f2b-4f99-b68c-f558ddd0efa6 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 511644aa-c126-4b05-8fde-d5cf3cb4f603] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:12:21.942853 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee7a9aa6-3f2b-4f99-b68c-f558ddd0efa6 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:12:21.943314 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee7a9aa6-3f2b-4f99-b68c-f558ddd0efa6 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:12:21.944116 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee7a9aa6-3f2b-4f99-b68c-f558ddd0efa6 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:12:21.944597 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee7a9aa6-3f2b-4f99-b68c-f558ddd0efa6 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:12:22.073815 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ee7a9aa6-3f2b-4f99-b68c-f558ddd0efa6 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:12:22.081450 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ee7a9aa6-3f2b-4f99-b68c-f558ddd0efa6 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603" status: 200 len: 1566 microversion: 2.1 time: 0.150585 Jun 10 19:12:22.082018 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4450/8072] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:12:21 2022] GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:12:22.096822 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7cf65453-e831-4829-b0a9-359877c53c21 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:12:22.097429 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7cf65453-e831-4829-b0a9-359877c53c21 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 511644aa-c126-4b05-8fde-d5cf3cb4f603] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:12:22.103100 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7cf65453-e831-4829-b0a9-359877c53c21 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:12:22.103553 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7cf65453-e831-4829-b0a9-359877c53c21 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:12:22.104337 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7cf65453-e831-4829-b0a9-359877c53c21 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:12:22.104779 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7cf65453-e831-4829-b0a9-359877c53c21 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:12:22.238803 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7cf65453-e831-4829-b0a9-359877c53c21 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:12:22.246260 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7cf65453-e831-4829-b0a9-359877c53c21 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603" status: 200 len: 1566 microversion: 2.1 time: 0.152875 Jun 10 19:12:22.246835 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4451/8073] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:12:22 2022] GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:12:24.378856 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-9b6b2de4-1dab-4801-ae7e-099f49c8d02b req-c44207a3-7f81-4527-86c7-52882a1c2067 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "511644aa-c126-4b05-8fde-d5cf3cb4f603", "tag": "68d2e42a-8d97-496a-952a-1c7a643ae58d"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:12:24.388007 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-9b6b2de4-1dab-4801-ae7e-099f49c8d02b req-c44207a3-7f81-4527-86c7-52882a1c2067 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:12:24.388481 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-9b6b2de4-1dab-4801-ae7e-099f49c8d02b req-c44207a3-7f81-4527-86c7-52882a1c2067 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:12:24.400194 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-9b6b2de4-1dab-4801-ae7e-099f49c8d02b req-c44207a3-7f81-4527-86c7-52882a1c2067 service nova] Creating event network-changed:68d2e42a-8d97-496a-952a-1c7a643ae58d for instance 511644aa-c126-4b05-8fde-d5cf3cb4f603 on chh2-master-2 Jun 10 19:12:24.405169 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-9b6b2de4-1dab-4801-ae7e-099f49c8d02b req-c44207a3-7f81-4527-86c7-52882a1c2067 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030736 Jun 10 19:12:24.407567 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4452/8074] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:12:24.411029 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-524f2f84-61b9-423a-b5a8-204cc794f229 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:12:24.411734 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-524f2f84-61b9-423a-b5a8-204cc794f229 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 511644aa-c126-4b05-8fde-d5cf3cb4f603] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:12:24.418107 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-524f2f84-61b9-423a-b5a8-204cc794f229 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:12:24.418562 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-524f2f84-61b9-423a-b5a8-204cc794f229 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:12:24.419337 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-524f2f84-61b9-423a-b5a8-204cc794f229 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:12:24.420244 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-524f2f84-61b9-423a-b5a8-204cc794f229 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:12:24.576407 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-524f2f84-61b9-423a-b5a8-204cc794f229 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:12:24.588104 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-524f2f84-61b9-423a-b5a8-204cc794f229 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603" status: 200 len: 1566 microversion: 2.1 time: 0.180809 Jun 10 19:12:24.589027 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4453/8075] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:12:24 2022] GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603 => generated 1566 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:12:57.868379 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-75d5a288-50a6-4856-8824-2ccb7b285fc8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:12:57.869376 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-75d5a288-50a6-4856-8824-2ccb7b285fc8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 511644aa-c126-4b05-8fde-d5cf3cb4f603] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:12:57.871976 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=23 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:12:57.872699 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=92 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:12:57.878093 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-75d5a288-50a6-4856-8824-2ccb7b285fc8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:12:57.878558 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-75d5a288-50a6-4856-8824-2ccb7b285fc8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:12:57.879340 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-75d5a288-50a6-4856-8824-2ccb7b285fc8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:12:57.879792 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-75d5a288-50a6-4856-8824-2ccb7b285fc8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:12:57.945209 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-75d5a288-50a6-4856-8824-2ccb7b285fc8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "POST /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603/action" status: 200 len: 24575 microversion: 2.1 time: 0.080639 Jun 10 19:12:57.945839 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4454/8076] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 19:12:57 2022] POST /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603/action => generated 24575 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 10 19:13:28.371412 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6d9a63a3-0809-419e-a36a-3edb2d728512 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:13:28.374270 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:13:28.374971 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:13:28.380574 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d9a63a3-0809-419e-a36a-3edb2d728512 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:13:28.381028 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d9a63a3-0809-419e-a36a-3edb2d728512 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:13:28.405390 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6d9a63a3-0809-419e-a36a-3edb2d728512 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 511644aa-c126-4b05-8fde-d5cf3cb4f603] Going to try to stop instance {{(pid=126595) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 10 19:13:28.580224 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6d9a63a3-0809-419e-a36a-3edb2d728512 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "POST /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603/action" status: 202 len: 0 microversion: 2.1 time: 0.212847 Jun 10 19:13:28.580930 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4455/8077] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 19:13:28 2022] POST /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 19:13:28.589321 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ba9c0be0-049e-4f10-81b8-1d1c36090e58 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:13:28.597098 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ba9c0be0-049e-4f10-81b8-1d1c36090e58 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 511644aa-c126-4b05-8fde-d5cf3cb4f603] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:13:28.597098 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ba9c0be0-049e-4f10-81b8-1d1c36090e58 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:13:28.597390 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ba9c0be0-049e-4f10-81b8-1d1c36090e58 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:13:28.598088 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ba9c0be0-049e-4f10-81b8-1d1c36090e58 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:13:28.598556 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ba9c0be0-049e-4f10-81b8-1d1c36090e58 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:13:28.734863 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ba9c0be0-049e-4f10-81b8-1d1c36090e58 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:13:28.742942 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ba9c0be0-049e-4f10-81b8-1d1c36090e58 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603" status: 200 len: 1695 microversion: 2.1 time: 0.157614 Jun 10 19:13:28.746136 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4456/8078] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:13:28 2022] GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603 => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:13:29.760869 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-babd5240-7b60-42d1-8c6a-dc00eb430668 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:13:29.761520 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-babd5240-7b60-42d1-8c6a-dc00eb430668 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 511644aa-c126-4b05-8fde-d5cf3cb4f603] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:13:29.768570 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-babd5240-7b60-42d1-8c6a-dc00eb430668 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:13:29.769055 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-babd5240-7b60-42d1-8c6a-dc00eb430668 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:13:29.769830 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-babd5240-7b60-42d1-8c6a-dc00eb430668 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:13:29.770276 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-babd5240-7b60-42d1-8c6a-dc00eb430668 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:13:29.897959 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-babd5240-7b60-42d1-8c6a-dc00eb430668 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:13:29.905501 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-babd5240-7b60-42d1-8c6a-dc00eb430668 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603" status: 200 len: 1695 microversion: 2.1 time: 0.148539 Jun 10 19:13:29.906071 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4457/8079] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:13:29 2022] GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603 => generated 1695 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:13:30.923205 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a2525faf-90ed-4ed1-bfdc-39d6b77d07e3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:13:30.923853 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a2525faf-90ed-4ed1-bfdc-39d6b77d07e3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 511644aa-c126-4b05-8fde-d5cf3cb4f603] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:13:30.931289 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a2525faf-90ed-4ed1-bfdc-39d6b77d07e3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:13:30.931744 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a2525faf-90ed-4ed1-bfdc-39d6b77d07e3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:13:30.932551 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a2525faf-90ed-4ed1-bfdc-39d6b77d07e3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:13:30.932996 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a2525faf-90ed-4ed1-bfdc-39d6b77d07e3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:13:31.062764 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a2525faf-90ed-4ed1-bfdc-39d6b77d07e3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:13:31.070946 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a2525faf-90ed-4ed1-bfdc-39d6b77d07e3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603" status: 200 len: 1695 microversion: 2.1 time: 0.151738 Jun 10 19:13:31.071526 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4458/8080] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:13:30 2022] GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603 => generated 1695 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:13:32.087275 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8c1042ab-5973-4f23-a5e1-408eae314542 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:13:32.087937 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8c1042ab-5973-4f23-a5e1-408eae314542 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 511644aa-c126-4b05-8fde-d5cf3cb4f603] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:13:32.094910 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8c1042ab-5973-4f23-a5e1-408eae314542 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:13:32.095390 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8c1042ab-5973-4f23-a5e1-408eae314542 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:13:32.096144 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8c1042ab-5973-4f23-a5e1-408eae314542 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:13:32.096620 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8c1042ab-5973-4f23-a5e1-408eae314542 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:13:32.227946 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8c1042ab-5973-4f23-a5e1-408eae314542 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:13:32.235781 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8c1042ab-5973-4f23-a5e1-408eae314542 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603" status: 200 len: 1695 microversion: 2.1 time: 0.152411 Jun 10 19:13:32.236383 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4459/8081] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:13:32 2022] GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603 => generated 1695 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:13:33.253333 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-efd3a5a9-12e9-4b94-a1e6-185b2ec97aa9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:13:33.253953 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-efd3a5a9-12e9-4b94-a1e6-185b2ec97aa9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 511644aa-c126-4b05-8fde-d5cf3cb4f603] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:13:33.260864 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-efd3a5a9-12e9-4b94-a1e6-185b2ec97aa9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:13:33.261313 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-efd3a5a9-12e9-4b94-a1e6-185b2ec97aa9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:13:33.262073 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-efd3a5a9-12e9-4b94-a1e6-185b2ec97aa9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:13:33.262513 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-efd3a5a9-12e9-4b94-a1e6-185b2ec97aa9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:13:33.393103 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-efd3a5a9-12e9-4b94-a1e6-185b2ec97aa9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:13:33.400870 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-efd3a5a9-12e9-4b94-a1e6-185b2ec97aa9 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603" status: 200 len: 1695 microversion: 2.1 time: 0.151943 Jun 10 19:13:33.401439 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4460/8082] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:13:33 2022] GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603 => generated 1695 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:13:34.418351 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-24a8c309-34da-44a1-b0b0-acce50d6fbe8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:13:34.418984 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-24a8c309-34da-44a1-b0b0-acce50d6fbe8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 511644aa-c126-4b05-8fde-d5cf3cb4f603] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:13:34.426542 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-24a8c309-34da-44a1-b0b0-acce50d6fbe8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:13:34.433676 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-24a8c309-34da-44a1-b0b0-acce50d6fbe8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:13:34.433676 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-24a8c309-34da-44a1-b0b0-acce50d6fbe8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:13:34.433676 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-24a8c309-34da-44a1-b0b0-acce50d6fbe8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:13:34.561957 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-24a8c309-34da-44a1-b0b0-acce50d6fbe8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:13:34.569513 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-24a8c309-34da-44a1-b0b0-acce50d6fbe8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603" status: 200 len: 1695 microversion: 2.1 time: 0.154999 Jun 10 19:13:34.570092 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4461/8083] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:13:34 2022] GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:13:35.586634 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-73fff99c-965d-4905-8300-ff166ad3485c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:13:35.587241 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-73fff99c-965d-4905-8300-ff166ad3485c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 511644aa-c126-4b05-8fde-d5cf3cb4f603] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:13:35.594247 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-73fff99c-965d-4905-8300-ff166ad3485c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:13:35.594698 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-73fff99c-965d-4905-8300-ff166ad3485c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:13:35.595493 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-73fff99c-965d-4905-8300-ff166ad3485c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:13:35.595932 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-73fff99c-965d-4905-8300-ff166ad3485c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:13:35.727104 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-73fff99c-965d-4905-8300-ff166ad3485c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:13:35.736630 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-73fff99c-965d-4905-8300-ff166ad3485c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603" status: 200 len: 1695 microversion: 2.1 time: 0.153395 Jun 10 19:13:35.737230 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4462/8084] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:13:35 2022] GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603 => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:13:36.754151 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f29e1889-fb0e-4fc2-a031-41270fd79101 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:13:36.754772 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f29e1889-fb0e-4fc2-a031-41270fd79101 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 511644aa-c126-4b05-8fde-d5cf3cb4f603] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:13:36.761774 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f29e1889-fb0e-4fc2-a031-41270fd79101 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:13:36.762228 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f29e1889-fb0e-4fc2-a031-41270fd79101 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:13:36.762992 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f29e1889-fb0e-4fc2-a031-41270fd79101 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:13:36.763436 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f29e1889-fb0e-4fc2-a031-41270fd79101 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:13:36.896028 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f29e1889-fb0e-4fc2-a031-41270fd79101 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:13:36.903491 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f29e1889-fb0e-4fc2-a031-41270fd79101 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603" status: 200 len: 1695 microversion: 2.1 time: 0.153740 Jun 10 19:13:36.904064 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4463/8085] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:13:36 2022] GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603 => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:13:37.921207 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-949dd019-988f-46e3-9ecd-b8df49ac4db3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:13:37.921873 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-949dd019-988f-46e3-9ecd-b8df49ac4db3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 511644aa-c126-4b05-8fde-d5cf3cb4f603] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:13:37.929168 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-949dd019-988f-46e3-9ecd-b8df49ac4db3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:13:37.929620 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-949dd019-988f-46e3-9ecd-b8df49ac4db3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:13:37.930375 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-949dd019-988f-46e3-9ecd-b8df49ac4db3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:13:37.930808 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-949dd019-988f-46e3-9ecd-b8df49ac4db3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:13:38.067193 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-949dd019-988f-46e3-9ecd-b8df49ac4db3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:13:38.074792 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-949dd019-988f-46e3-9ecd-b8df49ac4db3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603" status: 200 len: 1695 microversion: 2.1 time: 0.157452 Jun 10 19:13:38.075373 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4464/8086] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:13:37 2022] GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603 => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:13:39.092628 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f1b1f5a1-08c9-4328-ab8c-a9e04aaccade tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:13:39.093313 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f1b1f5a1-08c9-4328-ab8c-a9e04aaccade tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 511644aa-c126-4b05-8fde-d5cf3cb4f603] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:13:39.100844 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f1b1f5a1-08c9-4328-ab8c-a9e04aaccade tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:13:39.101300 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f1b1f5a1-08c9-4328-ab8c-a9e04aaccade tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:13:39.102072 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f1b1f5a1-08c9-4328-ab8c-a9e04aaccade tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:13:39.102517 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f1b1f5a1-08c9-4328-ab8c-a9e04aaccade tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:13:39.239166 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f1b1f5a1-08c9-4328-ab8c-a9e04aaccade tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:13:39.246799 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f1b1f5a1-08c9-4328-ab8c-a9e04aaccade tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603" status: 200 len: 1672 microversion: 2.1 time: 0.158115 Jun 10 19:13:39.247370 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4465/8087] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:13:39 2022] GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:13:40.342973 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fb979288-ac92-4438-8698-5da1969f6079 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:13:40.343904 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fb979288-ac92-4438-8698-5da1969f6079 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 511644aa-c126-4b05-8fde-d5cf3cb4f603] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:13:40.351618 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fb979288-ac92-4438-8698-5da1969f6079 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:13:40.352072 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fb979288-ac92-4438-8698-5da1969f6079 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:13:40.352881 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fb979288-ac92-4438-8698-5da1969f6079 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:13:40.353322 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fb979288-ac92-4438-8698-5da1969f6079 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:13:40.421257 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fb979288-ac92-4438-8698-5da1969f6079 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "POST /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603/action" status: 200 len: 37140 microversion: 2.1 time: 0.081993 Jun 10 19:13:40.421932 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4466/8088] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 19:13:40 2022] POST /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603/action => generated 37140 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 10 19:13:40.433997 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c1516c4a-26f8-4af0-971d-df6224283650 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:13:40.441691 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c1516c4a-26f8-4af0-971d-df6224283650 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:13:40.442144 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c1516c4a-26f8-4af0-971d-df6224283650 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:13:40.465242 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c1516c4a-26f8-4af0-971d-df6224283650 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 511644aa-c126-4b05-8fde-d5cf3cb4f603] Going to try to start instance {{(pid=126595) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 10 19:13:40.634353 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c1516c4a-26f8-4af0-971d-df6224283650 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "POST /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603/action" status: 202 len: 0 microversion: 2.1 time: 0.204481 Jun 10 19:13:40.634891 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4467/8089] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 19:13:40 2022] POST /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 19:13:40.643890 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6bcbb3ab-36e6-4080-a3bb-1c607d3eaf21 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:13:40.647584 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6bcbb3ab-36e6-4080-a3bb-1c607d3eaf21 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 511644aa-c126-4b05-8fde-d5cf3cb4f603] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:13:40.650889 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6bcbb3ab-36e6-4080-a3bb-1c607d3eaf21 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:13:40.651345 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6bcbb3ab-36e6-4080-a3bb-1c607d3eaf21 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:13:40.652114 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6bcbb3ab-36e6-4080-a3bb-1c607d3eaf21 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:13:40.652578 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6bcbb3ab-36e6-4080-a3bb-1c607d3eaf21 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:13:40.796120 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6bcbb3ab-36e6-4080-a3bb-1c607d3eaf21 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:13:40.804517 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6bcbb3ab-36e6-4080-a3bb-1c607d3eaf21 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603" status: 200 len: 1681 microversion: 2.1 time: 0.165099 Jun 10 19:13:40.805097 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4468/8090] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:13:40 2022] GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:13:41.822088 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c0698021-892b-4da8-a785-e97eb3d5697e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:13:41.822744 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c0698021-892b-4da8-a785-e97eb3d5697e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 511644aa-c126-4b05-8fde-d5cf3cb4f603] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:13:41.830087 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c0698021-892b-4da8-a785-e97eb3d5697e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:13:41.830548 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c0698021-892b-4da8-a785-e97eb3d5697e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:13:41.831320 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c0698021-892b-4da8-a785-e97eb3d5697e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:13:41.831763 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c0698021-892b-4da8-a785-e97eb3d5697e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:13:41.966506 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c0698021-892b-4da8-a785-e97eb3d5697e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:13:41.970054 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:13:41.975101 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c0698021-892b-4da8-a785-e97eb3d5697e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603" status: 200 len: 1681 microversion: 2.1 time: 0.156951 Jun 10 19:13:41.975684 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4469/8091] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:13:41 2022] GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:13:42.994787 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5857e1e0-2315-4a67-97c2-74533f545a41 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:13:42.995465 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5857e1e0-2315-4a67-97c2-74533f545a41 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 511644aa-c126-4b05-8fde-d5cf3cb4f603] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:13:43.003252 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5857e1e0-2315-4a67-97c2-74533f545a41 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:13:43.010575 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5857e1e0-2315-4a67-97c2-74533f545a41 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:13:43.010575 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5857e1e0-2315-4a67-97c2-74533f545a41 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:13:43.010575 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5857e1e0-2315-4a67-97c2-74533f545a41 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:13:43.139374 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5857e1e0-2315-4a67-97c2-74533f545a41 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:13:43.147184 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5857e1e0-2315-4a67-97c2-74533f545a41 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603" status: 200 len: 1685 microversion: 2.1 time: 0.157408 Jun 10 19:13:43.147759 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4470/8092] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:13:42 2022] GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603 => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:14:15.373756 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-866479e1-d540-460b-ad80-5ce4f607aead tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:14:15.374769 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-866479e1-d540-460b-ad80-5ce4f607aead tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 511644aa-c126-4b05-8fde-d5cf3cb4f603] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:14:15.378032 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=32 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:14:15.378676 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=6 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:14:15.383409 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-866479e1-d540-460b-ad80-5ce4f607aead tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:14:15.383860 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-866479e1-d540-460b-ad80-5ce4f607aead tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:14:15.384638 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-866479e1-d540-460b-ad80-5ce4f607aead tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:14:15.385076 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-866479e1-d540-460b-ad80-5ce4f607aead tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:14:15.449893 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-866479e1-d540-460b-ad80-5ce4f607aead tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "POST /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603/action" status: 200 len: 61703 microversion: 2.1 time: 0.080168 Jun 10 19:14:15.450603 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4471/8093] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 19:14:15 2022] POST /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603/action => generated 61703 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 10 19:14:39.394471 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-05f36f3b-28cb-4bc8-9b14-e1361fd09f45 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:14:39.395083 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-05f36f3b-28cb-4bc8-9b14-e1361fd09f45 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 511644aa-c126-4b05-8fde-d5cf3cb4f603] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:14:39.398191 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:14:39.403797 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05f36f3b-28cb-4bc8-9b14-e1361fd09f45 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:14:39.404345 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05f36f3b-28cb-4bc8-9b14-e1361fd09f45 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:14:39.405192 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05f36f3b-28cb-4bc8-9b14-e1361fd09f45 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:14:39.405734 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05f36f3b-28cb-4bc8-9b14-e1361fd09f45 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:14:39.433566 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-05f36f3b-28cb-4bc8-9b14-e1361fd09f45 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 511644aa-c126-4b05-8fde-d5cf3cb4f603] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 19:14:39.763387 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-05f36f3b-28cb-4bc8-9b14-e1361fd09f45 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "DELETE /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603" status: 204 len: 0 microversion: 2.1 time: 0.373806 Jun 10 19:14:39.763922 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4472/8094] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 19:14:39 2022] DELETE /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 10 19:14:39.818715 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-dbc360d1-b652-4b46-b8d9-29685f87cf24 req-345fa935-7a0d-4886-9554-7c1787fddd2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "511644aa-c126-4b05-8fde-d5cf3cb4f603", "tag": "68d2e42a-8d97-496a-952a-1c7a643ae58d"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:14:39.828149 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-dbc360d1-b652-4b46-b8d9-29685f87cf24 req-345fa935-7a0d-4886-9554-7c1787fddd2f service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:14:39.828641 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-dbc360d1-b652-4b46-b8d9-29685f87cf24 req-345fa935-7a0d-4886-9554-7c1787fddd2f service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:14:39.839812 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-dbc360d1-b652-4b46-b8d9-29685f87cf24 req-345fa935-7a0d-4886-9554-7c1787fddd2f service nova] Creating event network-changed:68d2e42a-8d97-496a-952a-1c7a643ae58d for instance 511644aa-c126-4b05-8fde-d5cf3cb4f603 on chh2-master-2 Jun 10 19:14:39.845575 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-dbc360d1-b652-4b46-b8d9-29685f87cf24 req-345fa935-7a0d-4886-9554-7c1787fddd2f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080213 Jun 10 19:14:39.846585 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4473/8095] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:14:39.851673 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0f9098ef-6948-48a4-beca-09f04e1d65c2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:14:39.852410 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0f9098ef-6948-48a4-beca-09f04e1d65c2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 511644aa-c126-4b05-8fde-d5cf3cb4f603] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:14:39.860091 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0f9098ef-6948-48a4-beca-09f04e1d65c2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:14:39.860586 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0f9098ef-6948-48a4-beca-09f04e1d65c2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:14:39.861375 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0f9098ef-6948-48a4-beca-09f04e1d65c2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:14:39.861817 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0f9098ef-6948-48a4-beca-09f04e1d65c2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:14:40.000028 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0f9098ef-6948-48a4-beca-09f04e1d65c2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:14:40.008117 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0f9098ef-6948-48a4-beca-09f04e1d65c2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603" status: 200 len: 1691 microversion: 2.1 time: 0.160549 Jun 10 19:14:40.008700 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4474/8096] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:14:39 2022] GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603 => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:14:41.026430 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-22c1ebfa-ae4d-4849-802e-d7ab32ef52aa tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:14:41.027070 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-22c1ebfa-ae4d-4849-802e-d7ab32ef52aa tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 511644aa-c126-4b05-8fde-d5cf3cb4f603] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:14:41.034676 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-22c1ebfa-ae4d-4849-802e-d7ab32ef52aa tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:14:41.035137 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-22c1ebfa-ae4d-4849-802e-d7ab32ef52aa tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:14:41.035919 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-22c1ebfa-ae4d-4849-802e-d7ab32ef52aa tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:14:41.036392 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-22c1ebfa-ae4d-4849-802e-d7ab32ef52aa tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:14:41.170979 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-22c1ebfa-ae4d-4849-802e-d7ab32ef52aa tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:14:41.179345 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-22c1ebfa-ae4d-4849-802e-d7ab32ef52aa tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603" status: 200 len: 1691 microversion: 2.1 time: 0.156744 Jun 10 19:14:41.179929 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4475/8097] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:14:41 2022] GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603 => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:14:42.197431 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4285dc69-0480-4077-90e5-e13b71b9e669 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:14:42.198157 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4285dc69-0480-4077-90e5-e13b71b9e669 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 511644aa-c126-4b05-8fde-d5cf3cb4f603] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:14:42.205371 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4285dc69-0480-4077-90e5-e13b71b9e669 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:14:42.205707 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4285dc69-0480-4077-90e5-e13b71b9e669 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:14:42.206483 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4285dc69-0480-4077-90e5-e13b71b9e669 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:14:42.206926 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4285dc69-0480-4077-90e5-e13b71b9e669 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:14:42.276501 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4285dc69-0480-4077-90e5-e13b71b9e669 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:14:42.284737 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4285dc69-0480-4077-90e5-e13b71b9e669 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603" status: 200 len: 1504 microversion: 2.1 time: 0.092170 Jun 10 19:14:42.289693 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4476/8098] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:14:42 2022] GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603 => generated 1504 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:14:42.289818 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-dac3cbb5-7a8a-47cd-9ed6-774110c48ee6 req-c040570b-4209-4fd1-ac09-e78d65960adf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "511644aa-c126-4b05-8fde-d5cf3cb4f603", "name": "network-vif-deleted", "tag": "68d2e42a-8d97-496a-952a-1c7a643ae58d"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:14:42.297590 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-dac3cbb5-7a8a-47cd-9ed6-774110c48ee6 req-c040570b-4209-4fd1-ac09-e78d65960adf service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:14:42.298119 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-dac3cbb5-7a8a-47cd-9ed6-774110c48ee6 req-c040570b-4209-4fd1-ac09-e78d65960adf service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:14:42.309121 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-dac3cbb5-7a8a-47cd-9ed6-774110c48ee6 req-c040570b-4209-4fd1-ac09-e78d65960adf service nova] Creating event network-vif-deleted:68d2e42a-8d97-496a-952a-1c7a643ae58d for instance 511644aa-c126-4b05-8fde-d5cf3cb4f603 on chh2-master-2 Jun 10 19:14:42.314102 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-dac3cbb5-7a8a-47cd-9ed6-774110c48ee6 req-c040570b-4209-4fd1-ac09-e78d65960adf service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027524 Jun 10 19:14:42.314888 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4477/8099] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:14:43.303638 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-326235ac-70ab-43f1-b9fc-5ceb4e71c390 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:14:43.304498 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-326235ac-70ab-43f1-b9fc-5ceb4e71c390 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: 511644aa-c126-4b05-8fde-d5cf3cb4f603] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:14:43.310870 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-326235ac-70ab-43f1-b9fc-5ceb4e71c390 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:14:43.311322 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-326235ac-70ab-43f1-b9fc-5ceb4e71c390 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:14:43.312077 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-326235ac-70ab-43f1-b9fc-5ceb4e71c390 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:14:43.312538 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-326235ac-70ab-43f1-b9fc-5ceb4e71c390 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:14:43.325862 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-326235ac-70ab-43f1-b9fc-5ceb4e71c390 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] HTTP exception thrown: Instance 511644aa-c126-4b05-8fde-d5cf3cb4f603 could not be found. Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-326235ac-70ab-43f1-b9fc-5ceb4e71c390 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Request method failure captured: Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603 HTTP/1.1 Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5YPAQIj2rjg21dP-hUkWvxTBbenKqLrs8X-dpl0gh5SlblRc7YzYXxJQF7OQJ04iiajVs3_DtHbkXtpyH9RfjMCCLWxpP-pI5ZbkVRrg8NY9qs7N4ZrPXBXmIPChYaWOg__AcNo6wiv5vK4jl8UssW1Gbox3NB6dpu_4KvF6u5DG7s Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 69f65fbabf1d4b85aa3ec38f0e4efe11 Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2031160215 Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/69f65fbabf1d4b85aa3ec38f0e4efe11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/69f65fbabf1d4b85aa3ec38f0e4efe11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/69f65fbabf1d4b85aa3ec38f0e4efe11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_69f65fbabf1d4b85aa3ec38f0e4efe11", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2031160215 Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 69f65fbabf1d4b85aa3ec38f0e4efe11 Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2031160215 Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-TestNetworkAdvancedServerOps-2031160215-project Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: c75f5f98f96946e18c2e665b7f59f75d Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2031160215-project Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 511644aa-c126-4b05-8fde-d5cf3cb4f603 could not be found. Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '511644aa-c126-4b05-8fde-d5cf3cb4f603'} Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 511644aa-c126-4b05-8fde-d5cf3cb4f603 could not be found. Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 511644aa-c126-4b05-8fde-d5cf3cb4f603 could not be found. Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:14:43.327486 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:14:43.331618 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:14:43.331618 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:14:43.331618 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:14:43.331618 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:14:43.331618 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 19:14:43.331618 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 19:14:43.331618 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 511644aa-c126-4b05-8fde-d5cf3cb4f603 could not be found. Jun 10 19:14:43.331618 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:14:43.331618 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-326235ac-70ab-43f1-b9fc-5ceb4e71c390 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Returning 404 to user: Instance 511644aa-c126-4b05-8fde-d5cf3cb4f603 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 19:14:43.331618 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-326235ac-70ab-43f1-b9fc-5ceb4e71c390 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603" status: 404 len: 111 microversion: 2.1 time: 0.030301 Jun 10 19:14:43.331618 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4478/8100] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:14:43 2022] GET /compute/v2.1/servers/511644aa-c126-4b05-8fde-d5cf3cb4f603 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 19:14:47.087194 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-954ea8a6-75d4-4e9a-96a3-be9c16b26c49 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '.version_select at 0x7f77b3c75790>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:14:47.168761 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-954ea8a6-75d4-4e9a-96a3-be9c16b26c49 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1927592007" status: 202 len: 0 microversion: 2.1 time: 0.085411 Jun 10 19:14:47.169358 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4479/8101] 10.222.0.35 () {58 vars in 1283 bytes} [Fri Jun 10 19:14:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1927592007 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 19:14:47.201503 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f0fe5381-402c-4445-bafc-b726c725e555 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Action: 'create', calling method: .version_select at 0x7f77b3c8b280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-488204440", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9LK/5bqyK6Y07RavQu0gThfy1uoD6MaTrxxpAgPlg50ljOiYrQEfsPQIX98JtyXkaRMFSg40zFAV/mQ3rZSqagjuG8UqZsiMACPvH0WO7B4KmCLTqpPbb/XHXJsByvLA=="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:14:47.216368 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-f0fe5381-402c-4445-bafc-b726c725e555 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Getting quotas for project 69f65fbabf1d4b85aa3ec38f0e4efe11. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 19:14:47.222904 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-f0fe5381-402c-4445-bafc-b726c725e555 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Getting quotas for user c75f5f98f96946e18c2e665b7f59f75d and project 69f65fbabf1d4b85aa3ec38f0e4efe11. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 19:14:47.305973 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f0fe5381-402c-4445-bafc-b726c725e555 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.108360 Jun 10 19:14:47.306606 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4480/8102] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 19:14:47 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:14:55.259886 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a9eb35e5-c3a2-406a-a558-6ee7afc83e26 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-280985433", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "networks": [{"uuid": "c41c903a-8a8e-4b65-aa93-a1a1c7d5c3a0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-488204440", "security_groups": [{"name": "tempest-secgroup-smoke-1359771013"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:14:55.268449 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:14:55.375528 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-a9eb35e5-c3a2-406a-a558-6ee7afc83e26 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] validate_networks() for [('c41c903a-8a8e-4b65-aa93-a1a1c7d5c3a0', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 19:14:55.832003 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-a9eb35e5-c3a2-406a-a558-6ee7afc83e26 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 19:14:55.832003 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-a9eb35e5-c3a2-406a-a558-6ee7afc83e26 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 19:14:55.832003 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-a9eb35e5-c3a2-406a-a558-6ee7afc83e26 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 19:14:55.832003 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-a9eb35e5-c3a2-406a-a558-6ee7afc83e26 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 19:14:55.832003 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-a9eb35e5-c3a2-406a-a558-6ee7afc83e26 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 19:14:55.839325 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a9eb35e5-c3a2-406a-a558-6ee7afc83e26 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:14:55.840219 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a9eb35e5-c3a2-406a-a558-6ee7afc83e26 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:14:55.841675 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a9eb35e5-c3a2-406a-a558-6ee7afc83e26 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:14:55.842311 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a9eb35e5-c3a2-406a-a558-6ee7afc83e26 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:14:55.862694 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-a9eb35e5-c3a2-406a-a558-6ee7afc83e26 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Getting quotas for project 69f65fbabf1d4b85aa3ec38f0e4efe11. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 19:14:55.868295 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-a9eb35e5-c3a2-406a-a558-6ee7afc83e26 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Getting quotas for user c75f5f98f96946e18c2e665b7f59f75d and project 69f65fbabf1d4b85aa3ec38f0e4efe11. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 19:14:55.885340 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a9eb35e5-c3a2-406a-a558-6ee7afc83e26 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 19:14:55.887885 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a9eb35e5-c3a2-406a-a558-6ee7afc83e26 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: b3eb3234-af78-4923-a737-de661a365aab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 19:14:56.045434 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a9eb35e5-c3a2-406a-a558-6ee7afc83e26 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.789194 Jun 10 19:14:56.056731 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4481/8103] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 19:14:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 10 19:14:56.067622 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b1333aa1-9bd5-46f0-b97e-bc153c0c0ce8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:14:56.068201 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b1333aa1-9bd5-46f0-b97e-bc153c0c0ce8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: b3eb3234-af78-4923-a737-de661a365aab] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:14:56.137016 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b1333aa1-9bd5-46f0-b97e-bc153c0c0ce8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:14:56.145250 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b1333aa1-9bd5-46f0-b97e-bc153c0c0ce8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab" status: 200 len: 1265 microversion: 2.1 time: 0.087156 Jun 10 19:14:56.155995 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4482/8104] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:14:56 2022] GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab => generated 1265 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:14:57.162554 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-807a88c3-dc3c-44dd-8485-9719b7cc13b0 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:14:57.163317 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-807a88c3-dc3c-44dd-8485-9719b7cc13b0 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: b3eb3234-af78-4923-a737-de661a365aab] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:14:57.172024 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-807a88c3-dc3c-44dd-8485-9719b7cc13b0 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:14:57.172616 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-807a88c3-dc3c-44dd-8485-9719b7cc13b0 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:14:57.173473 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-807a88c3-dc3c-44dd-8485-9719b7cc13b0 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:14:57.173993 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-807a88c3-dc3c-44dd-8485-9719b7cc13b0 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:14:57.254651 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-807a88c3-dc3c-44dd-8485-9719b7cc13b0 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:14:57.264413 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-807a88c3-dc3c-44dd-8485-9719b7cc13b0 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab" status: 200 len: 1269 microversion: 2.1 time: 0.105907 Jun 10 19:14:57.265700 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4483/8105] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:14:57 2022] GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab => generated 1269 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:14:58.282377 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-19e96ff9-5b6f-4d4e-bd3c-29f785d8f462 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:14:58.285122 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-19e96ff9-5b6f-4d4e-bd3c-29f785d8f462 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: b3eb3234-af78-4923-a737-de661a365aab] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:14:58.293944 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-19e96ff9-5b6f-4d4e-bd3c-29f785d8f462 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:14:58.294401 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-19e96ff9-5b6f-4d4e-bd3c-29f785d8f462 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:14:58.295191 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-19e96ff9-5b6f-4d4e-bd3c-29f785d8f462 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:14:58.295660 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-19e96ff9-5b6f-4d4e-bd3c-29f785d8f462 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:14:58.371379 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-19e96ff9-5b6f-4d4e-bd3c-29f785d8f462 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:14:58.379732 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-19e96ff9-5b6f-4d4e-bd3c-29f785d8f462 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab" status: 200 len: 1335 microversion: 2.1 time: 0.101184 Jun 10 19:14:58.390464 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4484/8106] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:14:58 2022] GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab => generated 1335 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:14:59.403349 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-db01d441-dc84-455c-a761-64749587f4ea tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:14:59.405769 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-db01d441-dc84-455c-a761-64749587f4ea tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: b3eb3234-af78-4923-a737-de661a365aab] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:14:59.423957 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-db01d441-dc84-455c-a761-64749587f4ea tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:14:59.424451 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-db01d441-dc84-455c-a761-64749587f4ea tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:14:59.425253 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-db01d441-dc84-455c-a761-64749587f4ea tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:14:59.425699 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-db01d441-dc84-455c-a761-64749587f4ea tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:14:59.573301 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-db01d441-dc84-455c-a761-64749587f4ea tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:14:59.582209 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-db01d441-dc84-455c-a761-64749587f4ea tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab" status: 200 len: 1391 microversion: 2.1 time: 0.188219 Jun 10 19:14:59.583108 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4485/8107] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:14:59 2022] GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab => generated 1391 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:14:59.695310 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-ce5eae87-8ef7-463e-94b6-62f5b7e00d18 req-36965b5d-9020-4f23-a81b-e60084df4b85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3eb3234-af78-4923-a737-de661a365aab", "tag": "a90d9467-e0c3-4e34-86e1-5542184b334b"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:14:59.707977 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-ce5eae87-8ef7-463e-94b6-62f5b7e00d18 req-36965b5d-9020-4f23-a81b-e60084df4b85 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:14:59.708469 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-ce5eae87-8ef7-463e-94b6-62f5b7e00d18 req-36965b5d-9020-4f23-a81b-e60084df4b85 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:14:59.724350 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-ce5eae87-8ef7-463e-94b6-62f5b7e00d18 req-36965b5d-9020-4f23-a81b-e60084df4b85 service nova] Creating event network-changed:a90d9467-e0c3-4e34-86e1-5542184b334b for instance b3eb3234-af78-4923-a737-de661a365aab on chh1-master-2 Jun 10 19:14:59.737671 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-ce5eae87-8ef7-463e-94b6-62f5b7e00d18 req-36965b5d-9020-4f23-a81b-e60084df4b85 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047803 Jun 10 19:14:59.738284 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4486/8108] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:15:00.605899 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dfc3d532-5e02-43bf-bb96-c2ee2327ecab tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:15:00.606537 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dfc3d532-5e02-43bf-bb96-c2ee2327ecab tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: b3eb3234-af78-4923-a737-de661a365aab] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:15:00.612899 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dfc3d532-5e02-43bf-bb96-c2ee2327ecab tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:00.613349 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dfc3d532-5e02-43bf-bb96-c2ee2327ecab tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:00.614111 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dfc3d532-5e02-43bf-bb96-c2ee2327ecab tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:00.614552 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dfc3d532-5e02-43bf-bb96-c2ee2327ecab tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:00.751258 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-dfc3d532-5e02-43bf-bb96-c2ee2327ecab tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:15:00.758991 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dfc3d532-5e02-43bf-bb96-c2ee2327ecab tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab" status: 200 len: 1391 microversion: 2.1 time: 0.158489 Jun 10 19:15:00.759603 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4487/8109] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:15:00 2022] GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:15:01.775989 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9057ee66-4e43-402b-9111-f962b9e702a3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:15:01.776654 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9057ee66-4e43-402b-9111-f962b9e702a3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: b3eb3234-af78-4923-a737-de661a365aab] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:15:01.784159 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9057ee66-4e43-402b-9111-f962b9e702a3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:01.784658 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9057ee66-4e43-402b-9111-f962b9e702a3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:01.785437 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9057ee66-4e43-402b-9111-f962b9e702a3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:01.785881 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9057ee66-4e43-402b-9111-f962b9e702a3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:01.915167 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9057ee66-4e43-402b-9111-f962b9e702a3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:15:01.923187 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9057ee66-4e43-402b-9111-f962b9e702a3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab" status: 200 len: 1391 microversion: 2.1 time: 0.151064 Jun 10 19:15:01.923755 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4488/8110] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:15:01 2022] GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab => generated 1391 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:15:02.939073 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-807b5260-ce78-4756-b75e-fe3b2bdf57b6 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:15:02.939718 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-807b5260-ce78-4756-b75e-fe3b2bdf57b6 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: b3eb3234-af78-4923-a737-de661a365aab] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:15:02.946561 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-807b5260-ce78-4756-b75e-fe3b2bdf57b6 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:02.947010 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-807b5260-ce78-4756-b75e-fe3b2bdf57b6 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:02.947768 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-807b5260-ce78-4756-b75e-fe3b2bdf57b6 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:02.948201 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-807b5260-ce78-4756-b75e-fe3b2bdf57b6 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:03.084551 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-807b5260-ce78-4756-b75e-fe3b2bdf57b6 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:15:03.092037 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-807b5260-ce78-4756-b75e-fe3b2bdf57b6 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab" status: 200 len: 1391 microversion: 2.1 time: 0.156985 Jun 10 19:15:03.093182 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4489/8111] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:15:02 2022] GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:15:04.109786 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-845fad90-aaf7-4422-8047-c6ac9b373ce8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:15:04.110412 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-845fad90-aaf7-4422-8047-c6ac9b373ce8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: b3eb3234-af78-4923-a737-de661a365aab] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:15:04.117569 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-845fad90-aaf7-4422-8047-c6ac9b373ce8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:04.118021 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-845fad90-aaf7-4422-8047-c6ac9b373ce8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:04.118919 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-845fad90-aaf7-4422-8047-c6ac9b373ce8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:04.119367 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-845fad90-aaf7-4422-8047-c6ac9b373ce8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:04.250973 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-845fad90-aaf7-4422-8047-c6ac9b373ce8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:15:04.258516 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-845fad90-aaf7-4422-8047-c6ac9b373ce8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab" status: 200 len: 1391 microversion: 2.1 time: 0.152700 Jun 10 19:15:04.259076 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4490/8112] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:15:04 2022] GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:15:05.275907 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-67cdd691-4733-4dde-a963-8f8045aec35d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:15:05.276541 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-67cdd691-4733-4dde-a963-8f8045aec35d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: b3eb3234-af78-4923-a737-de661a365aab] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:15:05.283854 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-67cdd691-4733-4dde-a963-8f8045aec35d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:05.284326 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-67cdd691-4733-4dde-a963-8f8045aec35d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:05.285108 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-67cdd691-4733-4dde-a963-8f8045aec35d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:05.285545 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-67cdd691-4733-4dde-a963-8f8045aec35d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:05.425156 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-67cdd691-4733-4dde-a963-8f8045aec35d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:15:05.432922 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-67cdd691-4733-4dde-a963-8f8045aec35d tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab" status: 200 len: 1391 microversion: 2.1 time: 0.161073 Jun 10 19:15:05.433509 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4491/8113] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:15:05 2022] GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:15:06.449777 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7afa07d7-0d22-4050-8fe4-c3acc66120d3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:15:06.450395 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7afa07d7-0d22-4050-8fe4-c3acc66120d3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: b3eb3234-af78-4923-a737-de661a365aab] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:15:06.452431 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:15:06.453134 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=12 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:15:06.458989 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7afa07d7-0d22-4050-8fe4-c3acc66120d3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:06.459450 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7afa07d7-0d22-4050-8fe4-c3acc66120d3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:06.464285 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7afa07d7-0d22-4050-8fe4-c3acc66120d3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:06.464285 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7afa07d7-0d22-4050-8fe4-c3acc66120d3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:06.596716 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7afa07d7-0d22-4050-8fe4-c3acc66120d3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:15:06.604704 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7afa07d7-0d22-4050-8fe4-c3acc66120d3 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab" status: 200 len: 1391 microversion: 2.1 time: 0.158778 Jun 10 19:15:06.605279 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4492/8114] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:15:06 2022] GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:15:06.989318 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-67feb265-6c03-4b64-8bf3-15702c69ceb2 req-26cdc83a-5004-4836-bc05-96a4223beeac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3eb3234-af78-4923-a737-de661a365aab", "name": "network-vif-plugged", "status": "completed", "tag": "a90d9467-e0c3-4e34-86e1-5542184b334b"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:15:06.997356 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-67feb265-6c03-4b64-8bf3-15702c69ceb2 req-26cdc83a-5004-4836-bc05-96a4223beeac service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:06.997807 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-67feb265-6c03-4b64-8bf3-15702c69ceb2 req-26cdc83a-5004-4836-bc05-96a4223beeac service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:07.011245 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-67feb265-6c03-4b64-8bf3-15702c69ceb2 req-26cdc83a-5004-4836-bc05-96a4223beeac service nova] Creating event network-vif-plugged:a90d9467-e0c3-4e34-86e1-5542184b334b for instance b3eb3234-af78-4923-a737-de661a365aab on chh1-master-2 Jun 10 19:15:07.016876 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-67feb265-6c03-4b64-8bf3-15702c69ceb2 req-26cdc83a-5004-4836-bc05-96a4223beeac service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080532 Jun 10 19:15:07.017484 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4493/8115] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:15:07.624061 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5e977aa3-58ed-4693-9c8a-3e561a59bf59 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:15:07.624712 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5e977aa3-58ed-4693-9c8a-3e561a59bf59 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: b3eb3234-af78-4923-a737-de661a365aab] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:15:07.630966 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5e977aa3-58ed-4693-9c8a-3e561a59bf59 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:07.631429 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5e977aa3-58ed-4693-9c8a-3e561a59bf59 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:07.632198 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5e977aa3-58ed-4693-9c8a-3e561a59bf59 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:07.632669 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5e977aa3-58ed-4693-9c8a-3e561a59bf59 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:07.768219 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5e977aa3-58ed-4693-9c8a-3e561a59bf59 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:15:07.775834 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5e977aa3-58ed-4693-9c8a-3e561a59bf59 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab" status: 200 len: 1391 microversion: 2.1 time: 0.157373 Jun 10 19:15:07.776434 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4494/8116] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:15:07 2022] GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:15:08.792688 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e08cd44d-1d90-44cd-9616-a31d0c4aec6c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:15:08.793304 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e08cd44d-1d90-44cd-9616-a31d0c4aec6c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: b3eb3234-af78-4923-a737-de661a365aab] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:15:08.800169 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e08cd44d-1d90-44cd-9616-a31d0c4aec6c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:08.800661 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e08cd44d-1d90-44cd-9616-a31d0c4aec6c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:08.801424 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e08cd44d-1d90-44cd-9616-a31d0c4aec6c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:08.801864 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e08cd44d-1d90-44cd-9616-a31d0c4aec6c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:08.935212 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e08cd44d-1d90-44cd-9616-a31d0c4aec6c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:15:08.943570 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e08cd44d-1d90-44cd-9616-a31d0c4aec6c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab" status: 200 len: 1562 microversion: 2.1 time: 0.154713 Jun 10 19:15:08.944147 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4495/8117] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:15:08 2022] GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:15:08.962986 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5cbbf6a8-f84c-43a3-997d-57d1e9c68ee5 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:15:08.963602 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5cbbf6a8-f84c-43a3-997d-57d1e9c68ee5 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: b3eb3234-af78-4923-a737-de661a365aab] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:15:08.969684 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5cbbf6a8-f84c-43a3-997d-57d1e9c68ee5 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:08.970136 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5cbbf6a8-f84c-43a3-997d-57d1e9c68ee5 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:08.970899 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5cbbf6a8-f84c-43a3-997d-57d1e9c68ee5 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:08.971440 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5cbbf6a8-f84c-43a3-997d-57d1e9c68ee5 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:09.101400 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5cbbf6a8-f84c-43a3-997d-57d1e9c68ee5 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:15:09.109779 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5cbbf6a8-f84c-43a3-997d-57d1e9c68ee5 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab" status: 200 len: 1562 microversion: 2.1 time: 0.150519 Jun 10 19:15:09.110359 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4496/8118] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:15:08 2022] GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:15:11.269607 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2faccd03-c189-42cf-ac92-fdcc01cc1772 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:15:11.270935 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2faccd03-c189-42cf-ac92-fdcc01cc1772 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: b3eb3234-af78-4923-a737-de661a365aab] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:15:11.273915 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:15:11.278770 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2faccd03-c189-42cf-ac92-fdcc01cc1772 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:11.279227 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2faccd03-c189-42cf-ac92-fdcc01cc1772 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:11.280583 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2faccd03-c189-42cf-ac92-fdcc01cc1772 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:11.281028 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2faccd03-c189-42cf-ac92-fdcc01cc1772 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:11.426793 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2faccd03-c189-42cf-ac92-fdcc01cc1772 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:15:11.434608 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2faccd03-c189-42cf-ac92-fdcc01cc1772 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab" status: 200 len: 1562 microversion: 2.1 time: 0.169132 Jun 10 19:15:11.435472 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4497/8119] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:15:11 2022] GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab => generated 1562 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:15:11.440079 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-bbb57a3d-c42a-49bf-8d3d-f538a0bbf2a4 req-642b0b22-1c70-4301-a692-bc263c07eb18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3eb3234-af78-4923-a737-de661a365aab", "tag": "a90d9467-e0c3-4e34-86e1-5542184b334b"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:15:11.447784 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-bbb57a3d-c42a-49bf-8d3d-f538a0bbf2a4 req-642b0b22-1c70-4301-a692-bc263c07eb18 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:11.448237 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-bbb57a3d-c42a-49bf-8d3d-f538a0bbf2a4 req-642b0b22-1c70-4301-a692-bc263c07eb18 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:11.460391 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-bbb57a3d-c42a-49bf-8d3d-f538a0bbf2a4 req-642b0b22-1c70-4301-a692-bc263c07eb18 service nova] Creating event network-changed:a90d9467-e0c3-4e34-86e1-5542184b334b for instance b3eb3234-af78-4923-a737-de661a365aab on chh1-master-2 Jun 10 19:15:11.465665 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-bbb57a3d-c42a-49bf-8d3d-f538a0bbf2a4 req-642b0b22-1c70-4301-a692-bc263c07eb18 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029334 Jun 10 19:15:11.466535 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4498/8120] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:15:34.674805 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=86 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:15:34.675501 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:15:34.679681 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b5b20ad2-4c37-40f2-844f-6d77eaf1a25e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:15:34.680755 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b5b20ad2-4c37-40f2-844f-6d77eaf1a25e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: b3eb3234-af78-4923-a737-de661a365aab] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:15:34.686847 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5b20ad2-4c37-40f2-844f-6d77eaf1a25e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:34.687298 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5b20ad2-4c37-40f2-844f-6d77eaf1a25e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:34.691040 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5b20ad2-4c37-40f2-844f-6d77eaf1a25e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:34.691040 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5b20ad2-4c37-40f2-844f-6d77eaf1a25e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:34.739831 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b5b20ad2-4c37-40f2-844f-6d77eaf1a25e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "POST /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab/action" status: 200 len: 24559 microversion: 2.1 time: 0.067448 Jun 10 19:15:34.740490 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4499/8121] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 19:15:34 2022] POST /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab/action => generated 24559 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 10 19:15:41.185619 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-702384d6-dd26-4b2d-88c4-75468b969c5b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:15:41.186300 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-702384d6-dd26-4b2d-88c4-75468b969c5b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: b3eb3234-af78-4923-a737-de661a365aab] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:15:41.194349 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-702384d6-dd26-4b2d-88c4-75468b969c5b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:41.195155 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-702384d6-dd26-4b2d-88c4-75468b969c5b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:41.195542 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-702384d6-dd26-4b2d-88c4-75468b969c5b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:41.195977 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-702384d6-dd26-4b2d-88c4-75468b969c5b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:41.219452 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-702384d6-dd26-4b2d-88c4-75468b969c5b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lazy-loading 'flavor' on Instance uuid b3eb3234-af78-4923-a737-de661a365aab {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 19:15:41.491371 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-702384d6-dd26-4b2d-88c4-75468b969c5b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "POST /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab/action" status: 202 len: 0 microversion: 2.1 time: 0.309645 Jun 10 19:15:41.491987 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4500/8122] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 19:15:41 2022] POST /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 19:15:41.500619 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f56ae34a-9cd0-4c9c-b249-c548c286507a tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:15:41.501326 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f56ae34a-9cd0-4c9c-b249-c548c286507a tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: b3eb3234-af78-4923-a737-de661a365aab] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:15:41.507777 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f56ae34a-9cd0-4c9c-b249-c548c286507a tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:41.508236 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f56ae34a-9cd0-4c9c-b249-c548c286507a tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:41.509041 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f56ae34a-9cd0-4c9c-b249-c548c286507a tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:41.509618 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f56ae34a-9cd0-4c9c-b249-c548c286507a tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:41.645135 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f56ae34a-9cd0-4c9c-b249-c548c286507a tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:15:41.652759 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f56ae34a-9cd0-4c9c-b249-c548c286507a tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab" status: 200 len: 1689 microversion: 2.1 time: 0.156382 Jun 10 19:15:41.653331 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4501/8123] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:15:41 2022] GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:15:42.671168 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b4bfd666-0754-4820-a1ca-bd54eb4d0186 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:15:42.672482 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b4bfd666-0754-4820-a1ca-bd54eb4d0186 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: b3eb3234-af78-4923-a737-de661a365aab] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:15:42.679010 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b4bfd666-0754-4820-a1ca-bd54eb4d0186 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:42.679468 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b4bfd666-0754-4820-a1ca-bd54eb4d0186 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:42.680228 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b4bfd666-0754-4820-a1ca-bd54eb4d0186 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:42.680697 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b4bfd666-0754-4820-a1ca-bd54eb4d0186 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:42.813027 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b4bfd666-0754-4820-a1ca-bd54eb4d0186 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:15:42.820502 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b4bfd666-0754-4820-a1ca-bd54eb4d0186 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab" status: 200 len: 1672 microversion: 2.1 time: 0.153434 Jun 10 19:15:42.821076 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4502/8124] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:15:42 2022] GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:15:43.905990 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8252e919-93a3-4f1e-a9af-bab7f8d4404c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:15:43.906920 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8252e919-93a3-4f1e-a9af-bab7f8d4404c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: b3eb3234-af78-4923-a737-de661a365aab] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:15:43.913907 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8252e919-93a3-4f1e-a9af-bab7f8d4404c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:43.915519 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8252e919-93a3-4f1e-a9af-bab7f8d4404c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:43.915519 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8252e919-93a3-4f1e-a9af-bab7f8d4404c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:43.915718 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8252e919-93a3-4f1e-a9af-bab7f8d4404c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:43.967436 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8252e919-93a3-4f1e-a9af-bab7f8d4404c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "POST /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab/action" status: 200 len: 36373 microversion: 2.1 time: 0.065219 Jun 10 19:15:43.968096 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4503/8125] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 19:15:43 2022] POST /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab/action => generated 36373 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 10 19:15:43.980217 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ff88cf75-1f5b-494d-b211-1f26d365e4a8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:15:43.980874 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ff88cf75-1f5b-494d-b211-1f26d365e4a8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: b3eb3234-af78-4923-a737-de661a365aab] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:15:43.988690 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ff88cf75-1f5b-494d-b211-1f26d365e4a8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:43.989145 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ff88cf75-1f5b-494d-b211-1f26d365e4a8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:43.989915 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ff88cf75-1f5b-494d-b211-1f26d365e4a8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:43.990359 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ff88cf75-1f5b-494d-b211-1f26d365e4a8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:44.169854 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ff88cf75-1f5b-494d-b211-1f26d365e4a8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "POST /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab/action" status: 202 len: 0 microversion: 2.1 time: 0.193593 Jun 10 19:15:44.170416 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4504/8126] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 19:15:43 2022] POST /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 19:15:44.179491 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ac9cac5e-b133-428d-9e87-48c787ca26ff tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:15:44.180222 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ac9cac5e-b133-428d-9e87-48c787ca26ff tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: b3eb3234-af78-4923-a737-de661a365aab] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:15:44.186408 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ac9cac5e-b133-428d-9e87-48c787ca26ff tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:44.186859 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ac9cac5e-b133-428d-9e87-48c787ca26ff tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:44.187684 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ac9cac5e-b133-428d-9e87-48c787ca26ff tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:44.188086 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ac9cac5e-b133-428d-9e87-48c787ca26ff tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:44.331772 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ac9cac5e-b133-428d-9e87-48c787ca26ff tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:15:44.339380 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ac9cac5e-b133-428d-9e87-48c787ca26ff tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab" status: 200 len: 1678 microversion: 2.1 time: 0.163972 Jun 10 19:15:44.339970 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4505/8127] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:15:44 2022] GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:15:45.358131 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8c389b8e-6c9e-496a-8e3e-1cec1e079460 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:15:45.359297 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8c389b8e-6c9e-496a-8e3e-1cec1e079460 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: b3eb3234-af78-4923-a737-de661a365aab] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:15:45.366273 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8c389b8e-6c9e-496a-8e3e-1cec1e079460 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:45.366724 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8c389b8e-6c9e-496a-8e3e-1cec1e079460 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:45.367477 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8c389b8e-6c9e-496a-8e3e-1cec1e079460 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:45.367913 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8c389b8e-6c9e-496a-8e3e-1cec1e079460 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:45.503481 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8c389b8e-6c9e-496a-8e3e-1cec1e079460 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:15:45.511085 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8c389b8e-6c9e-496a-8e3e-1cec1e079460 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab" status: 200 len: 1678 microversion: 2.1 time: 0.156869 Jun 10 19:15:45.511658 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4506/8128] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:15:45 2022] GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:15:46.528452 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8feecd44-26f8-4152-84d6-501ac50bdd67 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:15:46.529066 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8feecd44-26f8-4152-84d6-501ac50bdd67 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: b3eb3234-af78-4923-a737-de661a365aab] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:15:46.536581 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8feecd44-26f8-4152-84d6-501ac50bdd67 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:46.537037 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8feecd44-26f8-4152-84d6-501ac50bdd67 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:46.537797 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8feecd44-26f8-4152-84d6-501ac50bdd67 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:46.538240 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8feecd44-26f8-4152-84d6-501ac50bdd67 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:46.673088 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8feecd44-26f8-4152-84d6-501ac50bdd67 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:15:46.680627 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8feecd44-26f8-4152-84d6-501ac50bdd67 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab" status: 200 len: 1681 microversion: 2.1 time: 0.156051 Jun 10 19:15:46.681199 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4507/8129] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:15:46 2022] GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:15:46.768363 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cbfe68bf-9653-4057-90dd-d8a897ae26bf tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:15:46.769301 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cbfe68bf-9653-4057-90dd-d8a897ae26bf tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: b3eb3234-af78-4923-a737-de661a365aab] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:15:46.775379 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cbfe68bf-9653-4057-90dd-d8a897ae26bf tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:46.775838 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cbfe68bf-9653-4057-90dd-d8a897ae26bf tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:46.776624 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cbfe68bf-9653-4057-90dd-d8a897ae26bf tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:46.777064 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cbfe68bf-9653-4057-90dd-d8a897ae26bf tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:46.817518 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cbfe68bf-9653-4057-90dd-d8a897ae26bf tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "POST /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab/action" status: 200 len: 36373 microversion: 2.1 time: 0.053579 Jun 10 19:15:46.818170 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4508/8130] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 19:15:46 2022] POST /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab/action => generated 36373 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 10 19:15:47.880730 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a38df8ee-1335-44a5-97f4-7d532ad7534b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:15:47.881335 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a38df8ee-1335-44a5-97f4-7d532ad7534b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: b3eb3234-af78-4923-a737-de661a365aab] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:15:47.888900 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a38df8ee-1335-44a5-97f4-7d532ad7534b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:47.889447 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a38df8ee-1335-44a5-97f4-7d532ad7534b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:47.890238 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a38df8ee-1335-44a5-97f4-7d532ad7534b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:47.890678 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a38df8ee-1335-44a5-97f4-7d532ad7534b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:47.915783 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a38df8ee-1335-44a5-97f4-7d532ad7534b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: b3eb3234-af78-4923-a737-de661a365aab] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 19:15:48.132773 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a38df8ee-1335-44a5-97f4-7d532ad7534b tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "DELETE /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab" status: 204 len: 0 microversion: 2.1 time: 0.256138 Jun 10 19:15:48.133701 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4509/8131] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 19:15:47 2022] DELETE /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 19:15:48.138496 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-d10b9b01-00c0-4b2c-8c25-f4b73008e471 req-c6064c80-b34e-4ace-91a0-e6174abc3949 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3eb3234-af78-4923-a737-de661a365aab", "tag": "a90d9467-e0c3-4e34-86e1-5542184b334b"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:15:48.147979 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-d10b9b01-00c0-4b2c-8c25-f4b73008e471 req-c6064c80-b34e-4ace-91a0-e6174abc3949 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:48.148469 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-d10b9b01-00c0-4b2c-8c25-f4b73008e471 req-c6064c80-b34e-4ace-91a0-e6174abc3949 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:48.162097 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-d10b9b01-00c0-4b2c-8c25-f4b73008e471 req-c6064c80-b34e-4ace-91a0-e6174abc3949 service nova] Creating event network-changed:a90d9467-e0c3-4e34-86e1-5542184b334b for instance b3eb3234-af78-4923-a737-de661a365aab on chh1-master-2 Jun 10 19:15:48.167018 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-d10b9b01-00c0-4b2c-8c25-f4b73008e471 req-c6064c80-b34e-4ace-91a0-e6174abc3949 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032370 Jun 10 19:15:48.167811 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4510/8132] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:15:48.172789 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7cec3224-e4bc-4c26-97c1-40c16b80aa1c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:15:48.173492 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7cec3224-e4bc-4c26-97c1-40c16b80aa1c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: b3eb3234-af78-4923-a737-de661a365aab] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:15:48.179588 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7cec3224-e4bc-4c26-97c1-40c16b80aa1c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:48.180042 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7cec3224-e4bc-4c26-97c1-40c16b80aa1c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:48.180840 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7cec3224-e4bc-4c26-97c1-40c16b80aa1c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:48.181318 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7cec3224-e4bc-4c26-97c1-40c16b80aa1c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:48.315711 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7cec3224-e4bc-4c26-97c1-40c16b80aa1c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:15:48.323298 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7cec3224-e4bc-4c26-97c1-40c16b80aa1c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab" status: 200 len: 1687 microversion: 2.1 time: 0.154489 Jun 10 19:15:48.323881 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4511/8133] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:15:48 2022] GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab => generated 1687 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:15:49.341421 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ed046c53-18d7-4463-bed7-a8c509f55eb8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:15:49.342109 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ed046c53-18d7-4463-bed7-a8c509f55eb8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: b3eb3234-af78-4923-a737-de661a365aab] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:15:49.349852 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ed046c53-18d7-4463-bed7-a8c509f55eb8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:49.350298 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ed046c53-18d7-4463-bed7-a8c509f55eb8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:49.351052 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ed046c53-18d7-4463-bed7-a8c509f55eb8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:49.351492 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ed046c53-18d7-4463-bed7-a8c509f55eb8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:49.489913 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ed046c53-18d7-4463-bed7-a8c509f55eb8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:15:49.493913 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:15:49.498380 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ed046c53-18d7-4463-bed7-a8c509f55eb8 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab" status: 200 len: 1687 microversion: 2.1 time: 0.160753 Jun 10 19:15:49.498969 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4512/8134] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:15:49 2022] GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab => generated 1687 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:15:50.197531 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-f397c137-501a-41d5-bcbc-0c4b92907bac req-8270e862-96ef-4374-9e9f-9876deb6e4de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3eb3234-af78-4923-a737-de661a365aab", "name": "network-vif-deleted", "tag": "a90d9467-e0c3-4e34-86e1-5542184b334b"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:15:50.207141 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-f397c137-501a-41d5-bcbc-0c4b92907bac req-8270e862-96ef-4374-9e9f-9876deb6e4de service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:50.207594 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-f397c137-501a-41d5-bcbc-0c4b92907bac req-8270e862-96ef-4374-9e9f-9876deb6e4de service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:50.218629 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-f397c137-501a-41d5-bcbc-0c4b92907bac req-8270e862-96ef-4374-9e9f-9876deb6e4de service nova] Creating event network-vif-deleted:a90d9467-e0c3-4e34-86e1-5542184b334b for instance b3eb3234-af78-4923-a737-de661a365aab on chh1-master-2 Jun 10 19:15:50.223380 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-f397c137-501a-41d5-bcbc-0c4b92907bac req-8270e862-96ef-4374-9e9f-9876deb6e4de service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029975 Jun 10 19:15:50.224201 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4513/8135] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:15:50.515911 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0a09ec37-c39b-4726-92b6-4297d791607e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:15:50.516652 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0a09ec37-c39b-4726-92b6-4297d791607e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: b3eb3234-af78-4923-a737-de661a365aab] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:15:50.524246 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0a09ec37-c39b-4726-92b6-4297d791607e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:50.524721 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0a09ec37-c39b-4726-92b6-4297d791607e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:50.525490 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0a09ec37-c39b-4726-92b6-4297d791607e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:50.525933 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0a09ec37-c39b-4726-92b6-4297d791607e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:50.560498 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0a09ec37-c39b-4726-92b6-4297d791607e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:50.561048 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0a09ec37-c39b-4726-92b6-4297d791607e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:50.561600 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-0a09ec37-c39b-4726-92b6-4297d791607e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lazy-loading 'fault' on Instance uuid b3eb3234-af78-4923-a737-de661a365aab {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 19:15:50.605310 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0a09ec37-c39b-4726-92b6-4297d791607e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75f5f98f96946e18c2e665b7f59f75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f65fbabf1d4b85aa3ec38f0e4efe11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:15:50.613845 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0a09ec37-c39b-4726-92b6-4297d791607e tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab" status: 200 len: 1355 microversion: 2.1 time: 0.102322 Jun 10 19:15:50.614425 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4514/8136] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:15:50 2022] GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab => generated 1355 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:15:51.631820 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cb2d91ba-0bc3-4afd-b02a-ee5f5398cbe2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:15:51.632451 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cb2d91ba-0bc3-4afd-b02a-ee5f5398cbe2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] [instance: b3eb3234-af78-4923-a737-de661a365aab] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:15:51.639399 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cb2d91ba-0bc3-4afd-b02a-ee5f5398cbe2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:51.640432 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cb2d91ba-0bc3-4afd-b02a-ee5f5398cbe2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:51.641224 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cb2d91ba-0bc3-4afd-b02a-ee5f5398cbe2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:15:51.641658 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cb2d91ba-0bc3-4afd-b02a-ee5f5398cbe2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:15:51.654822 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-cb2d91ba-0bc3-4afd-b02a-ee5f5398cbe2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] HTTP exception thrown: Instance b3eb3234-af78-4923-a737-de661a365aab could not be found. Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cb2d91ba-0bc3-4afd-b02a-ee5f5398cbe2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Request method failure captured: Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab HTTP/1.1 Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5YPAQIj2rjg21dP-hUkWvxTBbenKqLrs8X-dpl0gh5SlblRc7YzYXxJQF7OQJ04iiajVs3_DtHbkXtpyH9RfjMCCLWxpP-pI5ZbkVRrg8NY9qs7N4ZrPXBXmIPChYaWOg__AcNo6wiv5vK4jl8UssW1Gbox3NB6dpu_4KvF6u5DG7s Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 69f65fbabf1d4b85aa3ec38f0e4efe11 Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2031160215 Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/69f65fbabf1d4b85aa3ec38f0e4efe11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/69f65fbabf1d4b85aa3ec38f0e4efe11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/69f65fbabf1d4b85aa3ec38f0e4efe11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_69f65fbabf1d4b85aa3ec38f0e4efe11", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2031160215 Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 69f65fbabf1d4b85aa3ec38f0e4efe11 Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2031160215 Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-TestNetworkAdvancedServerOps-2031160215-project Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: c75f5f98f96946e18c2e665b7f59f75d Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2031160215-project Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: exception: Instance b3eb3234-af78-4923-a737-de661a365aab could not be found. Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': 'b3eb3234-af78-4923-a737-de661a365aab'} Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3eb3234-af78-4923-a737-de661a365aab could not be found. Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3eb3234-af78-4923-a737-de661a365aab could not be found. Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:15:51.656455 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:15:51.660617 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:15:51.660617 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:15:51.660617 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:15:51.660617 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:15:51.660617 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 19:15:51.660617 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 19:15:51.660617 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3eb3234-af78-4923-a737-de661a365aab could not be found. Jun 10 19:15:51.660617 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:15:51.660617 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cb2d91ba-0bc3-4afd-b02a-ee5f5398cbe2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Returning 404 to user: Instance b3eb3234-af78-4923-a737-de661a365aab could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 19:15:51.660617 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cb2d91ba-0bc3-4afd-b02a-ee5f5398cbe2 tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab" status: 404 len: 111 microversion: 2.1 time: 0.029899 Jun 10 19:15:51.660617 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4515/8137] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:15:51 2022] GET /compute/v2.1/servers/b3eb3234-af78-4923-a737-de661a365aab => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 19:15:55.314370 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2b47b83f-2f5a-4e7c-87b0-d43efd4b155c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] Calling method '.version_select at 0x7f77b3e850d0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:15:55.390877 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2b47b83f-2f5a-4e7c-87b0-d43efd4b155c tempest-TestNetworkAdvancedServerOps-2031160215 tempest-TestNetworkAdvancedServerOps-2031160215-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-488204440" status: 202 len: 0 microversion: 2.1 time: 0.080305 Jun 10 19:15:55.391504 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4516/8138] 10.222.0.35 () {58 vars in 1280 bytes} [Fri Jun 10 19:15:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-488204440 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 19:16:09.595325 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=12 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:16:09.596226 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:16:09.778730 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9a8eebbe-99b2-4bff-9310-6c7950876b69 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Action: 'create', calling method: .version_select at 0x7f77b3c081f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1001574165", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFb6+vi0I9ayU2nMnNaw7CROJfI3hdrfwlGXrDJ832YOROBHnU4m8lUQGK99hXsxF/AhXEcUxhVixvHGzEwfeU0F3x2aIhf/eQuYvdsxwB3BDAfos1UNJjy+bFBhDJwFg=="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:16:09.794387 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-9a8eebbe-99b2-4bff-9310-6c7950876b69 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Getting quotas for project b6c2a87044a24c708a5ffe9cbf789121. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 19:16:09.800125 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-9a8eebbe-99b2-4bff-9310-6c7950876b69 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Getting quotas for user 238d05aa801f4fc28fb7f123e423088b and project b6c2a87044a24c708a5ffe9cbf789121. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 19:16:09.893307 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9a8eebbe-99b2-4bff-9310-6c7950876b69 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.303436 Jun 10 19:16:09.893921 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4517/8139] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 19:16:09 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:16:12.378136 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e11987cb-3d30-4ba5-8f4d-fc70663eb8e4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1880142598", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1001574165", "security_groups": [{"name": "tempest-secgroup-smoke-178723175"}], "networks": [{"uuid": "a2ab324b-9219-4026-94ac-631fa9055e54"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:16:12.650487 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-e11987cb-3d30-4ba5-8f4d-fc70663eb8e4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] validate_networks() for [('a2ab324b-9219-4026-94ac-631fa9055e54', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 19:16:13.118387 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-e11987cb-3d30-4ba5-8f4d-fc70663eb8e4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 19:16:13.119097 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-e11987cb-3d30-4ba5-8f4d-fc70663eb8e4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 19:16:13.119603 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-e11987cb-3d30-4ba5-8f4d-fc70663eb8e4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 19:16:13.120200 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-e11987cb-3d30-4ba5-8f4d-fc70663eb8e4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 19:16:13.120674 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-e11987cb-3d30-4ba5-8f4d-fc70663eb8e4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 19:16:13.135751 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e11987cb-3d30-4ba5-8f4d-fc70663eb8e4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:16:13.136436 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e11987cb-3d30-4ba5-8f4d-fc70663eb8e4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:16:13.137395 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e11987cb-3d30-4ba5-8f4d-fc70663eb8e4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:16:13.138394 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e11987cb-3d30-4ba5-8f4d-fc70663eb8e4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:16:13.157955 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-e11987cb-3d30-4ba5-8f4d-fc70663eb8e4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Getting quotas for project b6c2a87044a24c708a5ffe9cbf789121. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 19:16:13.163506 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-e11987cb-3d30-4ba5-8f4d-fc70663eb8e4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Getting quotas for user 238d05aa801f4fc28fb7f123e423088b and project b6c2a87044a24c708a5ffe9cbf789121. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 19:16:13.179375 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e11987cb-3d30-4ba5-8f4d-fc70663eb8e4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 19:16:13.181762 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e11987cb-3d30-4ba5-8f4d-fc70663eb8e4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 19:16:13.305918 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e11987cb-3d30-4ba5-8f4d-fc70663eb8e4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.932853 Jun 10 19:16:13.313783 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4518/8140] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 19:16:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 10 19:16:13.317406 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-efc143ec-291e-46eb-be9c-c910ad91fe4e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:16:13.318119 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-efc143ec-291e-46eb-be9c-c910ad91fe4e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:16:13.373082 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-efc143ec-291e-46eb-be9c-c910ad91fe4e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:16:13.382124 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-efc143ec-291e-46eb-be9c-c910ad91fe4e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1247 microversion: 2.1 time: 0.068701 Jun 10 19:16:13.392830 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4519/8141] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:16:13 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1247 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:16:14.400013 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ba0f8259-7b68-4400-b504-b4abc857b3a8 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:16:14.400676 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ba0f8259-7b68-4400-b504-b4abc857b3a8 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:16:14.408178 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ba0f8259-7b68-4400-b504-b4abc857b3a8 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:16:14.408655 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ba0f8259-7b68-4400-b504-b4abc857b3a8 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:16:14.409417 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ba0f8259-7b68-4400-b504-b4abc857b3a8 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:16:14.409906 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ba0f8259-7b68-4400-b504-b4abc857b3a8 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:16:14.476838 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ba0f8259-7b68-4400-b504-b4abc857b3a8 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:16:14.486669 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ba0f8259-7b68-4400-b504-b4abc857b3a8 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1251 microversion: 2.1 time: 0.090469 Jun 10 19:16:14.487259 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4520/8142] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:16:14 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1251 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:16:15.503376 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c36b2614-9ff1-4b10-8ba5-b83e0ee7d1ad tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:16:15.504065 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c36b2614-9ff1-4b10-8ba5-b83e0ee7d1ad tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:16:15.512603 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c36b2614-9ff1-4b10-8ba5-b83e0ee7d1ad tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:16:15.513106 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c36b2614-9ff1-4b10-8ba5-b83e0ee7d1ad tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:16:15.516653 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c36b2614-9ff1-4b10-8ba5-b83e0ee7d1ad tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:16:15.516653 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c36b2614-9ff1-4b10-8ba5-b83e0ee7d1ad tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:16:15.579447 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c36b2614-9ff1-4b10-8ba5-b83e0ee7d1ad tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:16:15.587033 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c36b2614-9ff1-4b10-8ba5-b83e0ee7d1ad tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1317 microversion: 2.1 time: 0.087824 Jun 10 19:16:15.587601 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4521/8143] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:16:15 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1317 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:16:16.605343 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-148bfe60-3d20-4ea1-94c3-21adaa88ac85 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:16:16.605999 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-148bfe60-3d20-4ea1-94c3-21adaa88ac85 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:16:16.613327 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-148bfe60-3d20-4ea1-94c3-21adaa88ac85 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:16:16.613786 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-148bfe60-3d20-4ea1-94c3-21adaa88ac85 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:16:16.614553 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-148bfe60-3d20-4ea1-94c3-21adaa88ac85 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:16:16.614998 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-148bfe60-3d20-4ea1-94c3-21adaa88ac85 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:16:16.749288 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-148bfe60-3d20-4ea1-94c3-21adaa88ac85 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:16:16.757338 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-148bfe60-3d20-4ea1-94c3-21adaa88ac85 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1372 microversion: 2.1 time: 0.156207 Jun 10 19:16:16.757928 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4522/8144] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:16:16 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:16:17.064826 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-d883e432-ad30-438a-a933-c0a5073b1b40 req-f6a4afdd-194d-425e-8c1c-5d0a0bca6d2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85f0bf81-f7b1-4a88-b274-94952146b3f9", "tag": "585a68db-1e60-45a4-8a8d-3d0598eeed2f"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:16:17.075473 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-d883e432-ad30-438a-a933-c0a5073b1b40 req-f6a4afdd-194d-425e-8c1c-5d0a0bca6d2b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:16:17.075924 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-d883e432-ad30-438a-a933-c0a5073b1b40 req-f6a4afdd-194d-425e-8c1c-5d0a0bca6d2b service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:16:17.089383 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-d883e432-ad30-438a-a933-c0a5073b1b40 req-f6a4afdd-194d-425e-8c1c-5d0a0bca6d2b service nova] Creating event network-changed:585a68db-1e60-45a4-8a8d-3d0598eeed2f for instance 85f0bf81-f7b1-4a88-b274-94952146b3f9 on chh2-master-2 Jun 10 19:16:17.095109 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-d883e432-ad30-438a-a933-c0a5073b1b40 req-f6a4afdd-194d-425e-8c1c-5d0a0bca6d2b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035031 Jun 10 19:16:17.096188 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4523/8145] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:16:17.775743 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d0a705a6-6afc-427a-873b-80c70283c959 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:16:17.776484 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d0a705a6-6afc-427a-873b-80c70283c959 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:16:17.783008 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d0a705a6-6afc-427a-873b-80c70283c959 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:16:17.783454 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d0a705a6-6afc-427a-873b-80c70283c959 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:16:17.784244 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d0a705a6-6afc-427a-873b-80c70283c959 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:16:17.784702 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d0a705a6-6afc-427a-873b-80c70283c959 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:16:17.919694 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d0a705a6-6afc-427a-873b-80c70283c959 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:16:17.927405 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d0a705a6-6afc-427a-873b-80c70283c959 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1372 microversion: 2.1 time: 0.156818 Jun 10 19:16:17.927972 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4524/8146] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:16:17 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:16:18.944044 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bc7253fd-e993-4bfc-9035-217efca1aa98 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:16:18.944704 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bc7253fd-e993-4bfc-9035-217efca1aa98 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:16:18.951416 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bc7253fd-e993-4bfc-9035-217efca1aa98 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:16:18.951865 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bc7253fd-e993-4bfc-9035-217efca1aa98 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:16:18.953988 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bc7253fd-e993-4bfc-9035-217efca1aa98 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:16:18.954493 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bc7253fd-e993-4bfc-9035-217efca1aa98 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:16:19.084164 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bc7253fd-e993-4bfc-9035-217efca1aa98 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:16:19.091594 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bc7253fd-e993-4bfc-9035-217efca1aa98 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1372 microversion: 2.1 time: 0.151425 Jun 10 19:16:19.092161 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4525/8147] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:16:18 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:16:20.108844 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-62f5cfe6-5f5a-4cf7-bb6d-8fc98b8b8c04 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:16:20.109920 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-62f5cfe6-5f5a-4cf7-bb6d-8fc98b8b8c04 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:16:20.116801 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-62f5cfe6-5f5a-4cf7-bb6d-8fc98b8b8c04 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:16:20.117251 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-62f5cfe6-5f5a-4cf7-bb6d-8fc98b8b8c04 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:16:20.118045 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-62f5cfe6-5f5a-4cf7-bb6d-8fc98b8b8c04 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:16:20.118481 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-62f5cfe6-5f5a-4cf7-bb6d-8fc98b8b8c04 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:16:20.251809 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-62f5cfe6-5f5a-4cf7-bb6d-8fc98b8b8c04 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:16:20.259270 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-62f5cfe6-5f5a-4cf7-bb6d-8fc98b8b8c04 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1372 microversion: 2.1 time: 0.154443 Jun 10 19:16:20.259845 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4526/8148] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:16:20 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:16:21.275474 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e5568986-e593-4cc9-bff4-6a9fa42fe94a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:16:21.276112 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e5568986-e593-4cc9-bff4-6a9fa42fe94a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:16:21.283603 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e5568986-e593-4cc9-bff4-6a9fa42fe94a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:16:21.284051 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e5568986-e593-4cc9-bff4-6a9fa42fe94a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:16:21.284850 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e5568986-e593-4cc9-bff4-6a9fa42fe94a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:16:21.285284 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e5568986-e593-4cc9-bff4-6a9fa42fe94a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:16:21.415168 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e5568986-e593-4cc9-bff4-6a9fa42fe94a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:16:21.422806 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e5568986-e593-4cc9-bff4-6a9fa42fe94a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1372 microversion: 2.1 time: 0.151176 Jun 10 19:16:21.423388 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4527/8149] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:16:21 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:16:22.439120 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3872fc2e-b1fe-46cf-8780-c5f0a1c14af6 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:16:22.439745 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3872fc2e-b1fe-46cf-8780-c5f0a1c14af6 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:16:22.446769 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3872fc2e-b1fe-46cf-8780-c5f0a1c14af6 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:16:22.447224 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3872fc2e-b1fe-46cf-8780-c5f0a1c14af6 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:16:22.447998 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3872fc2e-b1fe-46cf-8780-c5f0a1c14af6 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:16:22.448463 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3872fc2e-b1fe-46cf-8780-c5f0a1c14af6 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:16:22.587678 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3872fc2e-b1fe-46cf-8780-c5f0a1c14af6 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:16:22.594059 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3872fc2e-b1fe-46cf-8780-c5f0a1c14af6 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1372 microversion: 2.1 time: 0.158262 Jun 10 19:16:22.594645 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4528/8150] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:16:22 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:16:23.611412 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b9a9cc32-7aa4-4f9c-a771-b692da2c8bb0 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:16:23.612023 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b9a9cc32-7aa4-4f9c-a771-b692da2c8bb0 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:16:23.614043 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:16:23.614788 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=12 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:16:23.620374 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9a9cc32-7aa4-4f9c-a771-b692da2c8bb0 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:16:23.620832 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9a9cc32-7aa4-4f9c-a771-b692da2c8bb0 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:16:23.623686 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9a9cc32-7aa4-4f9c-a771-b692da2c8bb0 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:16:23.623686 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9a9cc32-7aa4-4f9c-a771-b692da2c8bb0 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:16:23.760574 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b9a9cc32-7aa4-4f9c-a771-b692da2c8bb0 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:16:23.768128 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b9a9cc32-7aa4-4f9c-a771-b692da2c8bb0 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1372 microversion: 2.1 time: 0.161070 Jun 10 19:16:23.768737 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4529/8151] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:16:23 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:16:24.543187 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-4d538784-38cb-4354-a75e-2418acca2ebe req-cba979e4-48f3-4f83-81aa-ef2bb035c586 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85f0bf81-f7b1-4a88-b274-94952146b3f9", "name": "network-vif-plugged", "status": "completed", "tag": "585a68db-1e60-45a4-8a8d-3d0598eeed2f"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:16:24.551093 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-4d538784-38cb-4354-a75e-2418acca2ebe req-cba979e4-48f3-4f83-81aa-ef2bb035c586 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:16:24.551538 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-4d538784-38cb-4354-a75e-2418acca2ebe req-cba979e4-48f3-4f83-81aa-ef2bb035c586 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:16:24.562665 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-4d538784-38cb-4354-a75e-2418acca2ebe req-cba979e4-48f3-4f83-81aa-ef2bb035c586 service nova] Creating event network-vif-plugged:585a68db-1e60-45a4-8a8d-3d0598eeed2f for instance 85f0bf81-f7b1-4a88-b274-94952146b3f9 on chh2-master-2 Jun 10 19:16:24.567573 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-4d538784-38cb-4354-a75e-2418acca2ebe req-cba979e4-48f3-4f83-81aa-ef2bb035c586 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028330 Jun 10 19:16:24.568143 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4530/8152] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:16:24.786325 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-43938dc8-0a88-4293-a7ec-deeb1f2dd64c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:16:24.787021 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-43938dc8-0a88-4293-a7ec-deeb1f2dd64c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:16:24.793304 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-43938dc8-0a88-4293-a7ec-deeb1f2dd64c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:16:24.793760 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-43938dc8-0a88-4293-a7ec-deeb1f2dd64c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:16:24.794527 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-43938dc8-0a88-4293-a7ec-deeb1f2dd64c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:16:24.794967 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-43938dc8-0a88-4293-a7ec-deeb1f2dd64c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:16:24.926422 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-43938dc8-0a88-4293-a7ec-deeb1f2dd64c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:16:24.934052 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-43938dc8-0a88-4293-a7ec-deeb1f2dd64c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1372 microversion: 2.1 time: 0.152621 Jun 10 19:16:24.934568 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4531/8153] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:16:24 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:16:25.951070 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-38aca825-4f9f-4355-9a3c-37fa4f2f51b5 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:16:25.951692 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-38aca825-4f9f-4355-9a3c-37fa4f2f51b5 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:16:25.959089 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-38aca825-4f9f-4355-9a3c-37fa4f2f51b5 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:16:25.959569 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-38aca825-4f9f-4355-9a3c-37fa4f2f51b5 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:16:25.960351 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-38aca825-4f9f-4355-9a3c-37fa4f2f51b5 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:16:25.960793 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-38aca825-4f9f-4355-9a3c-37fa4f2f51b5 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:16:26.095213 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-38aca825-4f9f-4355-9a3c-37fa4f2f51b5 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:16:26.103015 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-38aca825-4f9f-4355-9a3c-37fa4f2f51b5 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1372 microversion: 2.1 time: 0.155894 Jun 10 19:16:26.103602 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4532/8154] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:16:25 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:16:27.119337 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f5ce7873-2e2f-44f1-b16a-73b035607819 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:16:27.120029 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f5ce7873-2e2f-44f1-b16a-73b035607819 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:16:27.126911 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f5ce7873-2e2f-44f1-b16a-73b035607819 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:16:27.127355 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f5ce7873-2e2f-44f1-b16a-73b035607819 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:16:27.128111 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f5ce7873-2e2f-44f1-b16a-73b035607819 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:16:27.128577 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f5ce7873-2e2f-44f1-b16a-73b035607819 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:16:27.258167 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f5ce7873-2e2f-44f1-b16a-73b035607819 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:16:27.266268 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f5ce7873-2e2f-44f1-b16a-73b035607819 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1557 microversion: 2.1 time: 0.150765 Jun 10 19:16:27.266864 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4533/8155] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:16:27 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:16:27.282518 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2469774e-ea81-426d-b1ee-7ac81bd69fee tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:16:27.283130 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2469774e-ea81-426d-b1ee-7ac81bd69fee tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:16:27.288890 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2469774e-ea81-426d-b1ee-7ac81bd69fee tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:16:27.289341 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2469774e-ea81-426d-b1ee-7ac81bd69fee tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:16:27.290107 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2469774e-ea81-426d-b1ee-7ac81bd69fee tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:16:27.290548 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2469774e-ea81-426d-b1ee-7ac81bd69fee tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:16:27.422916 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2469774e-ea81-426d-b1ee-7ac81bd69fee tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:16:27.430385 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2469774e-ea81-426d-b1ee-7ac81bd69fee tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1557 microversion: 2.1 time: 0.152142 Jun 10 19:16:27.430952 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4534/8156] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:16:27 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:16:29.377541 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-b79130de-144d-4384-9c9e-228bdb8a1c8b req-1dae678b-bd0a-448d-a27d-81a43f749f45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85f0bf81-f7b1-4a88-b274-94952146b3f9", "tag": "585a68db-1e60-45a4-8a8d-3d0598eeed2f"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:16:29.386404 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-b79130de-144d-4384-9c9e-228bdb8a1c8b req-1dae678b-bd0a-448d-a27d-81a43f749f45 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:16:29.386916 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-b79130de-144d-4384-9c9e-228bdb8a1c8b req-1dae678b-bd0a-448d-a27d-81a43f749f45 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:16:29.400678 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-b79130de-144d-4384-9c9e-228bdb8a1c8b req-1dae678b-bd0a-448d-a27d-81a43f749f45 service nova] Creating event network-changed:585a68db-1e60-45a4-8a8d-3d0598eeed2f for instance 85f0bf81-f7b1-4a88-b274-94952146b3f9 on chh2-master-2 Jun 10 19:16:29.405658 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-b79130de-144d-4384-9c9e-228bdb8a1c8b req-1dae678b-bd0a-448d-a27d-81a43f749f45 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089349 Jun 10 19:16:29.406976 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4535/8157] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:18:55.150416 chdv-master-2 devstack@n-api.service[126595]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cecfc05b-781c-4b87-9406-22ae5810c12d] AMQP server on 10.222.0.35:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 10 19:18:55.151228 chdv-master-2 devstack@n-api.service[126595]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0c5f50dc-ccde-4ae8-a3f3-fe46db0ef7f7] AMQP server on 10.222.0.35:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 10 19:18:55.151929 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:18:55.152785 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=86 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:18:55.157207 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a09396c0-5864-4415-bcd5-7538c8c638f4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:18:55.157837 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a09396c0-5864-4415-bcd5-7538c8c638f4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:18:55.163968 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a09396c0-5864-4415-bcd5-7538c8c638f4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:18:55.166230 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a09396c0-5864-4415-bcd5-7538c8c638f4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:18:55.166230 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a09396c0-5864-4415-bcd5-7538c8c638f4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:18:55.166230 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a09396c0-5864-4415-bcd5-7538c8c638f4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:18:55.459980 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-a09396c0-5864-4415-bcd5-7538c8c638f4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lazy-loading 'flavor' on Instance uuid 85f0bf81-f7b1-4a88-b274-94952146b3f9 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 19:18:56.005517 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a09396c0-5864-4415-bcd5-7538c8c638f4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "POST /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9/action" status: 202 len: 0 microversion: 2.1 time: 0.856874 Jun 10 19:18:56.006278 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4536/8158] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 19:18:55 2022] POST /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9/action => generated 0 bytes in 859 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 19:18:56.014681 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1b1ae715-f58f-4e6d-aa27-827fdf119bf0 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:18:56.015393 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1b1ae715-f58f-4e6d-aa27-827fdf119bf0 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:18:56.022112 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1b1ae715-f58f-4e6d-aa27-827fdf119bf0 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:18:56.022574 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1b1ae715-f58f-4e6d-aa27-827fdf119bf0 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:18:56.023352 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1b1ae715-f58f-4e6d-aa27-827fdf119bf0 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:18:56.023804 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1b1ae715-f58f-4e6d-aa27-827fdf119bf0 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:18:56.163194 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1b1ae715-f58f-4e6d-aa27-827fdf119bf0 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:18:56.165657 chdv-master-2 devstack@n-api.service[126595]: INFO oslo.messaging._drivers.impl_rabbit [-] [cecfc05b-781c-4b87-9406-22ae5810c12d] Reconnected to AMQP server on 10.222.0.35:5672 via [amqp] client with port 48422. Jun 10 19:18:56.172946 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1b1ae715-f58f-4e6d-aa27-827fdf119bf0 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1681 microversion: 2.1 time: 0.162312 Jun 10 19:18:56.173507 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4537/8159] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:18:56 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:18:57.191084 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2cf48569-2555-4202-b4d1-af54ee304e0f tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:18:57.191691 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2cf48569-2555-4202-b4d1-af54ee304e0f tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:18:57.194517 chdv-master-2 devstack@n-api.service[126595]: INFO oslo.messaging._drivers.impl_rabbit [-] [0c5f50dc-ccde-4ae8-a3f3-fe46db0ef7f7] Reconnected to AMQP server on 10.222.0.35:5672 via [amqp] client with port 48424. Jun 10 19:18:57.200115 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2cf48569-2555-4202-b4d1-af54ee304e0f tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:18:57.200607 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2cf48569-2555-4202-b4d1-af54ee304e0f tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:18:57.201378 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2cf48569-2555-4202-b4d1-af54ee304e0f tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:18:57.201825 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2cf48569-2555-4202-b4d1-af54ee304e0f tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:18:57.335521 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2cf48569-2555-4202-b4d1-af54ee304e0f tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:18:57.343048 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2cf48569-2555-4202-b4d1-af54ee304e0f tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1681 microversion: 2.1 time: 0.155958 Jun 10 19:18:57.343600 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4538/8160] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:18:57 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:18:58.361094 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-452e4229-eb10-451c-8546-6d9c791c5f66 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:18:58.361701 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-452e4229-eb10-451c-8546-6d9c791c5f66 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:18:58.369577 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-452e4229-eb10-451c-8546-6d9c791c5f66 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:18:58.370028 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-452e4229-eb10-451c-8546-6d9c791c5f66 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:18:58.370791 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-452e4229-eb10-451c-8546-6d9c791c5f66 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:18:58.371228 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-452e4229-eb10-451c-8546-6d9c791c5f66 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:18:58.503141 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-452e4229-eb10-451c-8546-6d9c791c5f66 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:18:58.511674 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-452e4229-eb10-451c-8546-6d9c791c5f66 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1681 microversion: 2.1 time: 0.154558 Jun 10 19:18:58.512242 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4539/8161] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:18:58 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:18:59.528881 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7b8c3e5c-e1c7-4739-9411-6aab9dca67f0 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:18:59.529555 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7b8c3e5c-e1c7-4739-9411-6aab9dca67f0 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:18:59.537162 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b8c3e5c-e1c7-4739-9411-6aab9dca67f0 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:18:59.537670 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b8c3e5c-e1c7-4739-9411-6aab9dca67f0 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:18:59.538437 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b8c3e5c-e1c7-4739-9411-6aab9dca67f0 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:18:59.538878 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7b8c3e5c-e1c7-4739-9411-6aab9dca67f0 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:18:59.676435 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7b8c3e5c-e1c7-4739-9411-6aab9dca67f0 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:18:59.684016 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7b8c3e5c-e1c7-4739-9411-6aab9dca67f0 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1681 microversion: 2.1 time: 0.159021 Jun 10 19:18:59.684619 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4540/8162] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:18:59 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:19:00.701590 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5257942a-0d98-445d-97a4-5f4a3fe79fc7 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:19:00.702239 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5257942a-0d98-445d-97a4-5f4a3fe79fc7 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:00.709653 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5257942a-0d98-445d-97a4-5f4a3fe79fc7 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:00.710113 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5257942a-0d98-445d-97a4-5f4a3fe79fc7 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:00.710889 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5257942a-0d98-445d-97a4-5f4a3fe79fc7 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:00.711337 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5257942a-0d98-445d-97a4-5f4a3fe79fc7 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:00.841922 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5257942a-0d98-445d-97a4-5f4a3fe79fc7 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:19:00.850671 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5257942a-0d98-445d-97a4-5f4a3fe79fc7 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1681 microversion: 2.1 time: 0.153039 Jun 10 19:19:00.851243 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4541/8163] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:19:00 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:19:01.867531 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-acc4c5e2-dafa-4f7c-b13e-a2b5744d092a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:19:01.868165 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-acc4c5e2-dafa-4f7c-b13e-a2b5744d092a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:01.875045 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-acc4c5e2-dafa-4f7c-b13e-a2b5744d092a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:01.875497 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-acc4c5e2-dafa-4f7c-b13e-a2b5744d092a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:01.876592 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-acc4c5e2-dafa-4f7c-b13e-a2b5744d092a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:01.877035 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-acc4c5e2-dafa-4f7c-b13e-a2b5744d092a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:02.011359 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-acc4c5e2-dafa-4f7c-b13e-a2b5744d092a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:19:02.018816 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-acc4c5e2-dafa-4f7c-b13e-a2b5744d092a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1681 microversion: 2.1 time: 0.155786 Jun 10 19:19:02.019388 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4542/8164] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:19:01 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:19:03.035982 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fa0e4509-88a8-4f81-aee6-0c1b23453059 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:19:03.041588 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-fa0e4509-88a8-4f81-aee6-0c1b23453059 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:03.044126 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa0e4509-88a8-4f81-aee6-0c1b23453059 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:03.044637 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa0e4509-88a8-4f81-aee6-0c1b23453059 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:03.045451 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa0e4509-88a8-4f81-aee6-0c1b23453059 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:03.045906 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-fa0e4509-88a8-4f81-aee6-0c1b23453059 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:03.182720 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-fa0e4509-88a8-4f81-aee6-0c1b23453059 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:19:03.190393 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fa0e4509-88a8-4f81-aee6-0c1b23453059 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1681 microversion: 2.1 time: 0.158261 Jun 10 19:19:03.191481 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4543/8165] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:19:03 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:19:04.209752 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-baa9bcec-dad3-40df-a5ff-d32982add13b tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:19:04.210404 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-baa9bcec-dad3-40df-a5ff-d32982add13b tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:04.217232 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-baa9bcec-dad3-40df-a5ff-d32982add13b tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:04.217688 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-baa9bcec-dad3-40df-a5ff-d32982add13b tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:04.218459 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-baa9bcec-dad3-40df-a5ff-d32982add13b tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:04.218903 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-baa9bcec-dad3-40df-a5ff-d32982add13b tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:04.353777 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-baa9bcec-dad3-40df-a5ff-d32982add13b tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:19:04.361781 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-baa9bcec-dad3-40df-a5ff-d32982add13b tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1681 microversion: 2.1 time: 0.157375 Jun 10 19:19:04.362369 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4544/8166] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:19:04 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:19:05.378989 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a854773f-fbb8-452f-a9b5-e61989e7b6b8 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:19:05.379636 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a854773f-fbb8-452f-a9b5-e61989e7b6b8 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:05.387160 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a854773f-fbb8-452f-a9b5-e61989e7b6b8 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:05.387630 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a854773f-fbb8-452f-a9b5-e61989e7b6b8 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:05.388408 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a854773f-fbb8-452f-a9b5-e61989e7b6b8 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:05.388849 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a854773f-fbb8-452f-a9b5-e61989e7b6b8 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:05.521651 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a854773f-fbb8-452f-a9b5-e61989e7b6b8 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:19:05.529680 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a854773f-fbb8-452f-a9b5-e61989e7b6b8 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1681 microversion: 2.1 time: 0.154627 Jun 10 19:19:05.530244 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4545/8167] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:19:05 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:19:06.546969 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-12a82a36-9ff4-4448-a479-308984542793 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:19:06.547594 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-12a82a36-9ff4-4448-a479-308984542793 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:06.554838 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-12a82a36-9ff4-4448-a479-308984542793 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:06.555425 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-12a82a36-9ff4-4448-a479-308984542793 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:06.556215 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-12a82a36-9ff4-4448-a479-308984542793 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:06.556777 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-12a82a36-9ff4-4448-a479-308984542793 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:06.691843 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-12a82a36-9ff4-4448-a479-308984542793 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:19:06.700109 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-12a82a36-9ff4-4448-a479-308984542793 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1681 microversion: 2.1 time: 0.156971 Jun 10 19:19:06.700711 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4546/8168] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:19:06 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:19:07.717276 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-62f9307f-cfa4-4fd5-96b8-403e3ce9cf84 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:19:07.717863 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-62f9307f-cfa4-4fd5-96b8-403e3ce9cf84 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:07.725632 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-62f9307f-cfa4-4fd5-96b8-403e3ce9cf84 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:07.726090 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-62f9307f-cfa4-4fd5-96b8-403e3ce9cf84 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:07.726861 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-62f9307f-cfa4-4fd5-96b8-403e3ce9cf84 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:07.727303 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-62f9307f-cfa4-4fd5-96b8-403e3ce9cf84 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:07.862967 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-62f9307f-cfa4-4fd5-96b8-403e3ce9cf84 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:19:07.870471 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-62f9307f-cfa4-4fd5-96b8-403e3ce9cf84 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1702 microversion: 2.1 time: 0.157142 Jun 10 19:19:07.871057 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4547/8169] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:19:07 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1702 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:19:08.888771 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ea67c510-5a7c-4f10-ab16-225ba1e5e477 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:19:08.889233 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ea67c510-5a7c-4f10-ab16-225ba1e5e477 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:08.896084 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ea67c510-5a7c-4f10-ab16-225ba1e5e477 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:08.902331 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ea67c510-5a7c-4f10-ab16-225ba1e5e477 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:08.902331 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ea67c510-5a7c-4f10-ab16-225ba1e5e477 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:08.902331 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ea67c510-5a7c-4f10-ab16-225ba1e5e477 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:09.028739 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ea67c510-5a7c-4f10-ab16-225ba1e5e477 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:19:09.037713 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ea67c510-5a7c-4f10-ab16-225ba1e5e477 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1702 microversion: 2.1 time: 0.153292 Jun 10 19:19:09.038292 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4548/8170] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:19:08 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1702 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:19:10.055485 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d38617c2-c2f0-4383-96a8-365002beafdb tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:19:10.056162 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d38617c2-c2f0-4383-96a8-365002beafdb tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:10.063000 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d38617c2-c2f0-4383-96a8-365002beafdb tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:10.063456 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d38617c2-c2f0-4383-96a8-365002beafdb tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:10.064220 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d38617c2-c2f0-4383-96a8-365002beafdb tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:10.064688 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d38617c2-c2f0-4383-96a8-365002beafdb tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:10.199979 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d38617c2-c2f0-4383-96a8-365002beafdb tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:19:10.207590 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d38617c2-c2f0-4383-96a8-365002beafdb tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1702 microversion: 2.1 time: 0.156595 Jun 10 19:19:10.208181 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4549/8171] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:19:10 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1702 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:19:10.986931 chdv-master-2 devstack@n-api.service[126595]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 19:19:10.987167 chdv-master-2 devstack@n-api.service[126595]: Fri Jun 10 19:19:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 10 19:19:11.102286 chdv-master-2 devstack@n-api.service[126595]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 19:19:11.102926 chdv-master-2 devstack@n-api.service[126595]: Fri Jun 10 19:19:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 10 19:19:11.225193 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-99af21ed-c166-4485-84df-783e44feda94 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:19:11.225859 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-99af21ed-c166-4485-84df-783e44feda94 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:11.233511 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99af21ed-c166-4485-84df-783e44feda94 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:11.239830 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99af21ed-c166-4485-84df-783e44feda94 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:11.239830 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99af21ed-c166-4485-84df-783e44feda94 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:11.239830 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99af21ed-c166-4485-84df-783e44feda94 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:11.253602 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:19:11.657675 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-99af21ed-c166-4485-84df-783e44feda94 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:19:11.665846 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-99af21ed-c166-4485-84df-783e44feda94 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1702 microversion: 2.1 time: 0.444931 Jun 10 19:19:11.666406 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4550/8172] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:19:11 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1702 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:19:11.670724 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-c69cb1c7-63ec-4b0c-a90e-3a7fef05db65 req-89925c5c-da3e-4c08-94a1-c1bf324bae42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85f0bf81-f7b1-4a88-b274-94952146b3f9", "name": "network-vif-plugged", "status": "completed", "tag": "585a68db-1e60-45a4-8a8d-3d0598eeed2f"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:19:11.678854 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-c69cb1c7-63ec-4b0c-a90e-3a7fef05db65 req-89925c5c-da3e-4c08-94a1-c1bf324bae42 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:11.679308 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-c69cb1c7-63ec-4b0c-a90e-3a7fef05db65 req-89925c5c-da3e-4c08-94a1-c1bf324bae42 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:11.690022 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-c69cb1c7-63ec-4b0c-a90e-3a7fef05db65 req-89925c5c-da3e-4c08-94a1-c1bf324bae42 service nova] Creating event network-vif-plugged:585a68db-1e60-45a4-8a8d-3d0598eeed2f for instance 85f0bf81-f7b1-4a88-b274-94952146b3f9 on chh2-master-2 Jun 10 19:19:11.695097 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-c69cb1c7-63ec-4b0c-a90e-3a7fef05db65 req-89925c5c-da3e-4c08-94a1-c1bf324bae42 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027595 Jun 10 19:19:11.695667 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4551/8173] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:19:12.684155 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-57e6bcc7-0f62-47d8-af5b-63a808204d6a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:19:12.685239 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-57e6bcc7-0f62-47d8-af5b-63a808204d6a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:12.691095 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-57e6bcc7-0f62-47d8-af5b-63a808204d6a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:12.691551 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-57e6bcc7-0f62-47d8-af5b-63a808204d6a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:12.692978 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-57e6bcc7-0f62-47d8-af5b-63a808204d6a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:12.693419 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-57e6bcc7-0f62-47d8-af5b-63a808204d6a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:12.824591 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-57e6bcc7-0f62-47d8-af5b-63a808204d6a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:19:12.832273 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-57e6bcc7-0f62-47d8-af5b-63a808204d6a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1697 microversion: 2.1 time: 0.153336 Jun 10 19:19:12.832991 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4552/8174] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:19:12 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:19:13.850450 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-de543859-6678-4ba3-bb7b-e327eb266a85 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:19:13.851100 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-de543859-6678-4ba3-bb7b-e327eb266a85 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:13.861538 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de543859-6678-4ba3-bb7b-e327eb266a85 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:13.862320 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de543859-6678-4ba3-bb7b-e327eb266a85 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:13.863121 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de543859-6678-4ba3-bb7b-e327eb266a85 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:13.863573 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-de543859-6678-4ba3-bb7b-e327eb266a85 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:14.020087 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-de543859-6678-4ba3-bb7b-e327eb266a85 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:19:14.029741 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-de543859-6678-4ba3-bb7b-e327eb266a85 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1697 microversion: 2.1 time: 0.183442 Jun 10 19:19:14.030335 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4553/8175] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:19:13 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1697 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:19:15.048030 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5a051272-4e9e-46b0-be61-a3cfec309f1a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:19:15.049505 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5a051272-4e9e-46b0-be61-a3cfec309f1a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:15.057512 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5a051272-4e9e-46b0-be61-a3cfec309f1a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:15.058289 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5a051272-4e9e-46b0-be61-a3cfec309f1a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:15.059263 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5a051272-4e9e-46b0-be61-a3cfec309f1a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:15.059759 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5a051272-4e9e-46b0-be61-a3cfec309f1a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:15.213935 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5a051272-4e9e-46b0-be61-a3cfec309f1a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:19:15.223075 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5a051272-4e9e-46b0-be61-a3cfec309f1a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1697 microversion: 2.1 time: 0.179093 Jun 10 19:19:15.236460 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4554/8176] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:19:15 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1697 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:19:16.243237 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d342a60c-0af9-441b-a1c7-e95419a07064 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:19:16.244069 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d342a60c-0af9-441b-a1c7-e95419a07064 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:16.252849 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d342a60c-0af9-441b-a1c7-e95419a07064 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:16.253330 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d342a60c-0af9-441b-a1c7-e95419a07064 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:16.254153 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d342a60c-0af9-441b-a1c7-e95419a07064 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:16.255169 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d342a60c-0af9-441b-a1c7-e95419a07064 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:16.425171 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d342a60c-0af9-441b-a1c7-e95419a07064 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:19:16.434963 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d342a60c-0af9-441b-a1c7-e95419a07064 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1697 microversion: 2.1 time: 0.195580 Jun 10 19:19:16.435470 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4555/8177] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:19:16 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1697 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:19:17.453033 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ded1f231-da3b-4058-a7ea-9bcc0d325c9e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:19:17.453708 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ded1f231-da3b-4058-a7ea-9bcc0d325c9e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:17.462862 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ded1f231-da3b-4058-a7ea-9bcc0d325c9e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:17.463326 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ded1f231-da3b-4058-a7ea-9bcc0d325c9e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:17.464677 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ded1f231-da3b-4058-a7ea-9bcc0d325c9e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:17.465366 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ded1f231-da3b-4058-a7ea-9bcc0d325c9e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:17.611362 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ded1f231-da3b-4058-a7ea-9bcc0d325c9e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:19:17.621093 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ded1f231-da3b-4058-a7ea-9bcc0d325c9e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1697 microversion: 2.1 time: 0.171890 Jun 10 19:19:17.621661 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4556/8178] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:19:17 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1697 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:19:18.637959 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-272eae27-cfda-4748-ba0a-d6450445f949 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:19:18.638722 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-272eae27-cfda-4748-ba0a-d6450445f949 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:18.645750 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-272eae27-cfda-4748-ba0a-d6450445f949 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:18.646209 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-272eae27-cfda-4748-ba0a-d6450445f949 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:18.647088 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-272eae27-cfda-4748-ba0a-d6450445f949 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:18.647439 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-272eae27-cfda-4748-ba0a-d6450445f949 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:18.796837 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-272eae27-cfda-4748-ba0a-d6450445f949 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:19:18.805949 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-272eae27-cfda-4748-ba0a-d6450445f949 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1697 microversion: 2.1 time: 0.171855 Jun 10 19:19:18.806616 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4557/8179] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:19:18 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1697 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:19:19.823562 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ce90e447-9465-43b0-bd52-5c5c689d6ac6 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:19:19.824197 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ce90e447-9465-43b0-bd52-5c5c689d6ac6 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:19.831945 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ce90e447-9465-43b0-bd52-5c5c689d6ac6 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:19.832436 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ce90e447-9465-43b0-bd52-5c5c689d6ac6 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:19.833833 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ce90e447-9465-43b0-bd52-5c5c689d6ac6 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:19.834278 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ce90e447-9465-43b0-bd52-5c5c689d6ac6 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:20.001300 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ce90e447-9465-43b0-bd52-5c5c689d6ac6 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:19:20.011629 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ce90e447-9465-43b0-bd52-5c5c689d6ac6 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1697 microversion: 2.1 time: 0.191957 Jun 10 19:19:20.013549 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4558/8180] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:19:19 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1697 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:19:21.029979 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-18274708-19a0-46c7-af84-23b23be8c955 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:19:21.030655 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-18274708-19a0-46c7-af84-23b23be8c955 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:21.038783 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-18274708-19a0-46c7-af84-23b23be8c955 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:21.039344 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-18274708-19a0-46c7-af84-23b23be8c955 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:21.040237 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-18274708-19a0-46c7-af84-23b23be8c955 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:21.040802 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-18274708-19a0-46c7-af84-23b23be8c955 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:21.197141 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-18274708-19a0-46c7-af84-23b23be8c955 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:19:21.205458 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-18274708-19a0-46c7-af84-23b23be8c955 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1697 microversion: 2.1 time: 0.179258 Jun 10 19:19:21.215652 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4559/8181] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:19:21 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1697 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:19:22.229305 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-68596379-b994-4e56-865b-d1a313d638b3 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:19:22.230009 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-68596379-b994-4e56-865b-d1a313d638b3 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:22.237657 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-68596379-b994-4e56-865b-d1a313d638b3 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:22.242312 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-68596379-b994-4e56-865b-d1a313d638b3 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:22.243396 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-68596379-b994-4e56-865b-d1a313d638b3 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:22.244140 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-68596379-b994-4e56-865b-d1a313d638b3 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:22.402320 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-68596379-b994-4e56-865b-d1a313d638b3 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:19:22.410348 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-68596379-b994-4e56-865b-d1a313d638b3 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1697 microversion: 2.1 time: 0.188609 Jun 10 19:19:22.422461 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4560/8182] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:19:22 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1697 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:19:23.428133 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4741c3b0-1d32-485d-9290-abaaec0f1604 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:19:23.429156 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4741c3b0-1d32-485d-9290-abaaec0f1604 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:23.436158 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4741c3b0-1d32-485d-9290-abaaec0f1604 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:23.436958 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4741c3b0-1d32-485d-9290-abaaec0f1604 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:23.437741 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4741c3b0-1d32-485d-9290-abaaec0f1604 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:23.438183 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4741c3b0-1d32-485d-9290-abaaec0f1604 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:23.581199 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4741c3b0-1d32-485d-9290-abaaec0f1604 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:19:23.590361 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4741c3b0-1d32-485d-9290-abaaec0f1604 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1697 microversion: 2.1 time: 0.166627 Jun 10 19:19:23.590966 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4561/8183] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:19:23 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1697 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:19:24.607018 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-beec769f-cebb-48b1-986a-5e2f7337f41b tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:19:24.607570 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-beec769f-cebb-48b1-986a-5e2f7337f41b tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:24.614675 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-beec769f-cebb-48b1-986a-5e2f7337f41b tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:24.615128 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-beec769f-cebb-48b1-986a-5e2f7337f41b tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:24.615898 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-beec769f-cebb-48b1-986a-5e2f7337f41b tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:24.616364 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-beec769f-cebb-48b1-986a-5e2f7337f41b tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:24.745991 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-beec769f-cebb-48b1-986a-5e2f7337f41b tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:19:24.753541 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-beec769f-cebb-48b1-986a-5e2f7337f41b tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1697 microversion: 2.1 time: 0.150458 Jun 10 19:19:24.754110 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4562/8184] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:19:24 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1697 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:19:25.770570 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ebfef849-2c25-44be-9251-eb65b75d95ff tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:19:25.771267 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ebfef849-2c25-44be-9251-eb65b75d95ff tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:25.774101 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=55 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:19:25.778947 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ebfef849-2c25-44be-9251-eb65b75d95ff tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:25.779401 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ebfef849-2c25-44be-9251-eb65b75d95ff tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:25.780171 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ebfef849-2c25-44be-9251-eb65b75d95ff tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:25.780651 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ebfef849-2c25-44be-9251-eb65b75d95ff tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:25.914850 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ebfef849-2c25-44be-9251-eb65b75d95ff tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:19:25.922388 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ebfef849-2c25-44be-9251-eb65b75d95ff tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1679 microversion: 2.1 time: 0.155760 Jun 10 19:19:25.922964 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4563/8185] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:19:25 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:19:26.939610 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4db6e1de-4d0a-41f2-9317-4cf96e18512d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:19:26.940253 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4db6e1de-4d0a-41f2-9317-4cf96e18512d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:26.947476 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4db6e1de-4d0a-41f2-9317-4cf96e18512d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:26.947929 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4db6e1de-4d0a-41f2-9317-4cf96e18512d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:26.948740 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4db6e1de-4d0a-41f2-9317-4cf96e18512d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:26.949181 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4db6e1de-4d0a-41f2-9317-4cf96e18512d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:27.081219 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4db6e1de-4d0a-41f2-9317-4cf96e18512d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:19:27.088856 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4db6e1de-4d0a-41f2-9317-4cf96e18512d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1679 microversion: 2.1 time: 0.153286 Jun 10 19:19:27.089427 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4564/8186] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:19:26 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:19:28.106121 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-804f22b0-131a-47cc-a6cf-2c2b5e28203e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:19:28.106738 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-804f22b0-131a-47cc-a6cf-2c2b5e28203e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:28.116578 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-804f22b0-131a-47cc-a6cf-2c2b5e28203e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:28.116578 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-804f22b0-131a-47cc-a6cf-2c2b5e28203e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:28.116578 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-804f22b0-131a-47cc-a6cf-2c2b5e28203e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:28.116578 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-804f22b0-131a-47cc-a6cf-2c2b5e28203e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:28.253542 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-804f22b0-131a-47cc-a6cf-2c2b5e28203e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:19:28.261690 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-804f22b0-131a-47cc-a6cf-2c2b5e28203e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1622 microversion: 2.1 time: 0.159467 Jun 10 19:19:28.262276 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4565/8187] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:19:28 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1622 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:19:28.278108 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6d053ea7-968f-435b-a309-73dab681c33a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:19:28.278676 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6d053ea7-968f-435b-a309-73dab681c33a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:28.284335 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d053ea7-968f-435b-a309-73dab681c33a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:28.284813 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d053ea7-968f-435b-a309-73dab681c33a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:28.285577 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d053ea7-968f-435b-a309-73dab681c33a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:28.286019 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6d053ea7-968f-435b-a309-73dab681c33a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:28.438396 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:19:28.556869 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6d053ea7-968f-435b-a309-73dab681c33a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "POST /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9/action" status: 202 len: 0 microversion: 2.1 time: 0.282215 Jun 10 19:19:28.557501 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4566/8188] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 19:19:28 2022] POST /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 19:19:28.565384 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-758e9205-a559-4fb5-baec-d53f52e03f48 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:19:28.566002 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-758e9205-a559-4fb5-baec-d53f52e03f48 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:28.574304 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-758e9205-a559-4fb5-baec-d53f52e03f48 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:28.574304 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-758e9205-a559-4fb5-baec-d53f52e03f48 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:28.574698 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-758e9205-a559-4fb5-baec-d53f52e03f48 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:28.575145 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-758e9205-a559-4fb5-baec-d53f52e03f48 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:28.711781 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-758e9205-a559-4fb5-baec-d53f52e03f48 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:19:28.719661 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-758e9205-a559-4fb5-baec-d53f52e03f48 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1630 microversion: 2.1 time: 0.157918 Jun 10 19:19:28.720230 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4567/8189] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:19:28 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1630 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:19:29.356714 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-c6fd943c-486e-4f19-8553-0047416f374a req-8f649513-cb04-43cf-87de-70d52bf6cc84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85f0bf81-f7b1-4a88-b274-94952146b3f9", "name": "network-vif-unplugged", "status": "completed", "tag": "585a68db-1e60-45a4-8a8d-3d0598eeed2f"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:19:29.365309 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-c6fd943c-486e-4f19-8553-0047416f374a req-8f649513-cb04-43cf-87de-70d52bf6cc84 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:29.365755 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-c6fd943c-486e-4f19-8553-0047416f374a req-8f649513-cb04-43cf-87de-70d52bf6cc84 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:29.376687 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.compute.server_external_events [req-c6fd943c-486e-4f19-8553-0047416f374a req-8f649513-cb04-43cf-87de-70d52bf6cc84 service nova] Unable to find a host for instance 85f0bf81-f7b1-4a88-b274-94952146b3f9. Dropping event network-vif-unplugged {{(pid=126595) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 10 19:19:29.377554 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-c6fd943c-486e-4f19-8553-0047416f374a req-8f649513-cb04-43cf-87de-70d52bf6cc84 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.024855 Jun 10 19:19:29.378146 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4568/8190] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 10 19:19:29.737766 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-36fd148d-16f7-41f0-81ab-2ee83c02ace4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:19:29.738305 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-36fd148d-16f7-41f0-81ab-2ee83c02ace4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:29.744428 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-36fd148d-16f7-41f0-81ab-2ee83c02ace4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:29.748743 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-36fd148d-16f7-41f0-81ab-2ee83c02ace4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:29.748743 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-36fd148d-16f7-41f0-81ab-2ee83c02ace4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:29.748743 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-36fd148d-16f7-41f0-81ab-2ee83c02ace4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:29.881856 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-36fd148d-16f7-41f0-81ab-2ee83c02ace4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:19:29.887739 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-36fd148d-16f7-41f0-81ab-2ee83c02ace4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1630 microversion: 2.1 time: 0.153927 Jun 10 19:19:29.888384 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4569/8191] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:19:29 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1630 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:19:30.905567 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-59586702-728b-4ffa-9168-0ccbe463c1c0 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:19:30.906271 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-59586702-728b-4ffa-9168-0ccbe463c1c0 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:30.913918 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-59586702-728b-4ffa-9168-0ccbe463c1c0 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:30.914380 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-59586702-728b-4ffa-9168-0ccbe463c1c0 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:30.915162 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-59586702-728b-4ffa-9168-0ccbe463c1c0 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:30.915608 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-59586702-728b-4ffa-9168-0ccbe463c1c0 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:31.065489 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-59586702-728b-4ffa-9168-0ccbe463c1c0 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:19:31.073803 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-59586702-728b-4ffa-9168-0ccbe463c1c0 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1688 microversion: 2.1 time: 0.172097 Jun 10 19:19:31.075227 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4570/8192] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:19:30 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1688 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:19:31.545174 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-472d8615-420c-4db6-8484-bfa9de53ac75 req-3a835b42-48cf-4915-b5cb-fadce397e79f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85f0bf81-f7b1-4a88-b274-94952146b3f9", "tag": "585a68db-1e60-45a4-8a8d-3d0598eeed2f"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:19:31.554221 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-472d8615-420c-4db6-8484-bfa9de53ac75 req-3a835b42-48cf-4915-b5cb-fadce397e79f service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:31.554684 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-472d8615-420c-4db6-8484-bfa9de53ac75 req-3a835b42-48cf-4915-b5cb-fadce397e79f service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:31.566598 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-472d8615-420c-4db6-8484-bfa9de53ac75 req-3a835b42-48cf-4915-b5cb-fadce397e79f service nova] Creating event network-changed:585a68db-1e60-45a4-8a8d-3d0598eeed2f for instance 85f0bf81-f7b1-4a88-b274-94952146b3f9 on chh1-master-2 Jun 10 19:19:31.576026 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-472d8615-420c-4db6-8484-bfa9de53ac75 req-3a835b42-48cf-4915-b5cb-fadce397e79f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034425 Jun 10 19:19:31.576690 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4571/8193] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:19:32.092350 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f6313c32-70ce-4735-a626-9e437730f071 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:19:32.093061 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f6313c32-70ce-4735-a626-9e437730f071 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:32.100237 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f6313c32-70ce-4735-a626-9e437730f071 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:32.100725 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f6313c32-70ce-4735-a626-9e437730f071 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:32.101493 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f6313c32-70ce-4735-a626-9e437730f071 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:32.102068 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f6313c32-70ce-4735-a626-9e437730f071 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:32.238966 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f6313c32-70ce-4735-a626-9e437730f071 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:19:32.251708 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f6313c32-70ce-4735-a626-9e437730f071 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1688 microversion: 2.1 time: 0.164181 Jun 10 19:19:32.252444 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4572/8194] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:19:32 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:19:33.270310 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ba99e12d-2eec-4219-9d02-2f265a937097 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:19:33.271873 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ba99e12d-2eec-4219-9d02-2f265a937097 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:33.280053 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ba99e12d-2eec-4219-9d02-2f265a937097 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:33.280551 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ba99e12d-2eec-4219-9d02-2f265a937097 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:33.281340 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ba99e12d-2eec-4219-9d02-2f265a937097 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:33.281787 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ba99e12d-2eec-4219-9d02-2f265a937097 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:33.424847 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ba99e12d-2eec-4219-9d02-2f265a937097 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:19:33.435573 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ba99e12d-2eec-4219-9d02-2f265a937097 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1688 microversion: 2.1 time: 0.169703 Jun 10 19:19:33.436170 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4573/8195] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:19:33 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1688 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:19:34.456412 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-88d84986-943e-4961-ad5b-a284be0af5f9 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:19:34.458024 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-88d84986-943e-4961-ad5b-a284be0af5f9 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:34.466271 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-88d84986-943e-4961-ad5b-a284be0af5f9 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:34.466833 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-88d84986-943e-4961-ad5b-a284be0af5f9 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:34.467682 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-88d84986-943e-4961-ad5b-a284be0af5f9 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:34.468294 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-88d84986-943e-4961-ad5b-a284be0af5f9 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:34.612622 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-88d84986-943e-4961-ad5b-a284be0af5f9 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:19:34.622730 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-88d84986-943e-4961-ad5b-a284be0af5f9 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1688 microversion: 2.1 time: 0.173827 Jun 10 19:19:34.627188 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4574/8196] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:19:34 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1688 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:19:35.639985 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3bba7816-6d34-4daa-b84b-5e2dcdb69b7a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:19:35.640767 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3bba7816-6d34-4daa-b84b-5e2dcdb69b7a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:35.648227 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3bba7816-6d34-4daa-b84b-5e2dcdb69b7a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:35.648752 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3bba7816-6d34-4daa-b84b-5e2dcdb69b7a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:35.649546 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3bba7816-6d34-4daa-b84b-5e2dcdb69b7a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:35.649996 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3bba7816-6d34-4daa-b84b-5e2dcdb69b7a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:35.805064 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3bba7816-6d34-4daa-b84b-5e2dcdb69b7a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:19:35.812895 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3bba7816-6d34-4daa-b84b-5e2dcdb69b7a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1688 microversion: 2.1 time: 0.176827 Jun 10 19:19:35.813639 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4575/8197] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:19:35 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1688 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:19:36.834176 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c9b62cac-814a-490b-903b-2538e7d3be9e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:19:36.835966 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c9b62cac-814a-490b-903b-2538e7d3be9e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:36.845189 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9b62cac-814a-490b-903b-2538e7d3be9e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:36.846146 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9b62cac-814a-490b-903b-2538e7d3be9e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:36.847547 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9b62cac-814a-490b-903b-2538e7d3be9e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:36.848064 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c9b62cac-814a-490b-903b-2538e7d3be9e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:36.994328 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c9b62cac-814a-490b-903b-2538e7d3be9e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:19:37.002488 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c9b62cac-814a-490b-903b-2538e7d3be9e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1688 microversion: 2.1 time: 0.173943 Jun 10 19:19:37.003289 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4576/8198] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:19:36 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1688 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:19:38.021131 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-63b6202b-c6c1-4281-99db-2afe02d2f45c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:19:38.021890 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-63b6202b-c6c1-4281-99db-2afe02d2f45c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:38.029667 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-63b6202b-c6c1-4281-99db-2afe02d2f45c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:38.030133 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-63b6202b-c6c1-4281-99db-2afe02d2f45c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:38.030946 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-63b6202b-c6c1-4281-99db-2afe02d2f45c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:38.031399 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-63b6202b-c6c1-4281-99db-2afe02d2f45c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:38.196392 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-63b6202b-c6c1-4281-99db-2afe02d2f45c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:19:38.204701 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-63b6202b-c6c1-4281-99db-2afe02d2f45c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1688 microversion: 2.1 time: 0.187595 Jun 10 19:19:38.205294 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4577/8199] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:19:38 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1688 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:19:39.222827 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1df08dd5-c932-4849-8897-191237d1b1a3 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:19:39.223923 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1df08dd5-c932-4849-8897-191237d1b1a3 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:39.231429 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1df08dd5-c932-4849-8897-191237d1b1a3 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:39.231885 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1df08dd5-c932-4849-8897-191237d1b1a3 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:39.232979 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1df08dd5-c932-4849-8897-191237d1b1a3 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:39.233535 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1df08dd5-c932-4849-8897-191237d1b1a3 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:39.383128 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1df08dd5-c932-4849-8897-191237d1b1a3 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:19:39.391231 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1df08dd5-c932-4849-8897-191237d1b1a3 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1688 microversion: 2.1 time: 0.172780 Jun 10 19:19:39.391880 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4578/8200] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:19:39 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1688 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:19:40.410232 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-63a6c964-e4a4-4a3c-bbc5-b22416d07cd6 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:19:40.411280 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-63a6c964-e4a4-4a3c-bbc5-b22416d07cd6 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:40.418475 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-63a6c964-e4a4-4a3c-bbc5-b22416d07cd6 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:40.419101 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-63a6c964-e4a4-4a3c-bbc5-b22416d07cd6 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:40.419878 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-63a6c964-e4a4-4a3c-bbc5-b22416d07cd6 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:40.420331 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-63a6c964-e4a4-4a3c-bbc5-b22416d07cd6 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:40.555739 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-63a6c964-e4a4-4a3c-bbc5-b22416d07cd6 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:19:40.563339 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-63a6c964-e4a4-4a3c-bbc5-b22416d07cd6 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1688 microversion: 2.1 time: 0.157148 Jun 10 19:19:40.563913 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4579/8201] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:19:40 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:19:41.580746 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-80bdea7a-db28-4a31-8585-06148ba71a28 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:19:41.581395 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-80bdea7a-db28-4a31-8585-06148ba71a28 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:41.589068 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-80bdea7a-db28-4a31-8585-06148ba71a28 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:41.589524 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-80bdea7a-db28-4a31-8585-06148ba71a28 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:41.590294 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-80bdea7a-db28-4a31-8585-06148ba71a28 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:41.590730 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-80bdea7a-db28-4a31-8585-06148ba71a28 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:41.722207 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-80bdea7a-db28-4a31-8585-06148ba71a28 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:19:41.729902 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-80bdea7a-db28-4a31-8585-06148ba71a28 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1688 microversion: 2.1 time: 0.153179 Jun 10 19:19:41.730521 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4580/8202] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:19:41 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:19:42.747068 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-7947dd56-41b8-42b8-b6bf-e7fd28372abc tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:19:42.747692 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-7947dd56-41b8-42b8-b6bf-e7fd28372abc tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:42.754658 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7947dd56-41b8-42b8-b6bf-e7fd28372abc tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:42.755116 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7947dd56-41b8-42b8-b6bf-e7fd28372abc tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:42.755883 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7947dd56-41b8-42b8-b6bf-e7fd28372abc tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:42.756336 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-7947dd56-41b8-42b8-b6bf-e7fd28372abc tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:42.888967 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-7947dd56-41b8-42b8-b6bf-e7fd28372abc tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:19:42.896968 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-7947dd56-41b8-42b8-b6bf-e7fd28372abc tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1688 microversion: 2.1 time: 0.153852 Jun 10 19:19:42.897524 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4581/8203] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:19:42 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:19:43.913852 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-49872343-725e-4800-85f4-873b3105d801 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:19:43.914329 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-49872343-725e-4800-85f4-873b3105d801 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:43.924585 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-49872343-725e-4800-85f4-873b3105d801 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:43.924585 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-49872343-725e-4800-85f4-873b3105d801 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:43.924585 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-49872343-725e-4800-85f4-873b3105d801 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:43.924585 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-49872343-725e-4800-85f4-873b3105d801 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:44.058430 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-49872343-725e-4800-85f4-873b3105d801 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:19:44.066044 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-49872343-725e-4800-85f4-873b3105d801 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1688 microversion: 2.1 time: 0.156494 Jun 10 19:19:44.066633 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4582/8204] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:19:43 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:19:45.083514 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-93421d3f-dc0d-4d64-9681-f74b526065dc tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:19:45.084161 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-93421d3f-dc0d-4d64-9681-f74b526065dc tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:45.091113 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93421d3f-dc0d-4d64-9681-f74b526065dc tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:45.091563 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93421d3f-dc0d-4d64-9681-f74b526065dc tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:45.092352 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93421d3f-dc0d-4d64-9681-f74b526065dc tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:45.092796 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-93421d3f-dc0d-4d64-9681-f74b526065dc tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:45.227161 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-93421d3f-dc0d-4d64-9681-f74b526065dc tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:19:45.234755 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-93421d3f-dc0d-4d64-9681-f74b526065dc tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1688 microversion: 2.1 time: 0.155676 Jun 10 19:19:45.235327 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4583/8205] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:19:45 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:19:46.251328 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-07135937-632d-448d-a54c-7bd8e020eeb1 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:19:46.252024 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-07135937-632d-448d-a54c-7bd8e020eeb1 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:46.259561 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-07135937-632d-448d-a54c-7bd8e020eeb1 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:46.260027 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-07135937-632d-448d-a54c-7bd8e020eeb1 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:46.260852 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-07135937-632d-448d-a54c-7bd8e020eeb1 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:46.261303 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-07135937-632d-448d-a54c-7bd8e020eeb1 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:46.403980 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-07135937-632d-448d-a54c-7bd8e020eeb1 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:19:46.407593 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:19:46.412672 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-07135937-632d-448d-a54c-7bd8e020eeb1 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1688 microversion: 2.1 time: 0.165365 Jun 10 19:19:46.416461 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4584/8206] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:19:46 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:19:46.417624 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-f0e5725d-97e9-449b-90e8-c2b5c2d7c0e6 req-6be4a423-bd1b-4c4b-bc28-50af6fa7de54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85f0bf81-f7b1-4a88-b274-94952146b3f9", "name": "network-vif-plugged", "status": "completed", "tag": "585a68db-1e60-45a4-8a8d-3d0598eeed2f"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:19:46.425499 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-f0e5725d-97e9-449b-90e8-c2b5c2d7c0e6 req-6be4a423-bd1b-4c4b-bc28-50af6fa7de54 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:46.425945 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-f0e5725d-97e9-449b-90e8-c2b5c2d7c0e6 req-6be4a423-bd1b-4c4b-bc28-50af6fa7de54 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:46.436748 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-f0e5725d-97e9-449b-90e8-c2b5c2d7c0e6 req-6be4a423-bd1b-4c4b-bc28-50af6fa7de54 service nova] Creating event network-vif-plugged:585a68db-1e60-45a4-8a8d-3d0598eeed2f for instance 85f0bf81-f7b1-4a88-b274-94952146b3f9 on chh1-master-2 Jun 10 19:19:46.441938 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-f0e5725d-97e9-449b-90e8-c2b5c2d7c0e6 req-6be4a423-bd1b-4c4b-bc28-50af6fa7de54 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027530 Jun 10 19:19:46.442672 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4585/8207] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:19:47.431619 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c5072fe4-0dd7-49f5-9735-e69f91e1d5e4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:19:47.432367 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c5072fe4-0dd7-49f5-9735-e69f91e1d5e4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:47.439053 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c5072fe4-0dd7-49f5-9735-e69f91e1d5e4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:47.439513 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c5072fe4-0dd7-49f5-9735-e69f91e1d5e4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:47.440278 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c5072fe4-0dd7-49f5-9735-e69f91e1d5e4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:47.440766 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c5072fe4-0dd7-49f5-9735-e69f91e1d5e4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:47.575199 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c5072fe4-0dd7-49f5-9735-e69f91e1d5e4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:19:47.582893 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c5072fe4-0dd7-49f5-9735-e69f91e1d5e4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1688 microversion: 2.1 time: 0.157006 Jun 10 19:19:47.583478 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4586/8208] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:19:47 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:19:48.600848 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9b841175-5985-4787-9d5a-9b021d507e5a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:19:48.601512 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9b841175-5985-4787-9d5a-9b021d507e5a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:48.608610 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b841175-5985-4787-9d5a-9b021d507e5a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:48.609076 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b841175-5985-4787-9d5a-9b021d507e5a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:48.609860 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b841175-5985-4787-9d5a-9b021d507e5a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:48.610314 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b841175-5985-4787-9d5a-9b021d507e5a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:48.743277 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9b841175-5985-4787-9d5a-9b021d507e5a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:19:48.750877 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9b841175-5985-4787-9d5a-9b021d507e5a tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1688 microversion: 2.1 time: 0.154063 Jun 10 19:19:48.751499 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4587/8209] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:19:48 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:19:49.768745 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dac36f98-1f65-4654-8e96-b27a4677db28 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:19:49.769394 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dac36f98-1f65-4654-8e96-b27a4677db28 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:19:49.776328 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dac36f98-1f65-4654-8e96-b27a4677db28 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:49.776802 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dac36f98-1f65-4654-8e96-b27a4677db28 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:49.777601 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dac36f98-1f65-4654-8e96-b27a4677db28 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:19:49.778066 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dac36f98-1f65-4654-8e96-b27a4677db28 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:19:49.909827 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-dac36f98-1f65-4654-8e96-b27a4677db28 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:19:49.917748 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dac36f98-1f65-4654-8e96-b27a4677db28 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1675 microversion: 2.1 time: 0.153042 Jun 10 19:19:49.918317 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4588/8210] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:19:49 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:21:01.857646 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=53 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:21:01.858402 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=20 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:21:01.862327 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6028885c-0744-40a0-841a-99a571aaad5e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:21:01.862823 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6028885c-0744-40a0-841a-99a571aaad5e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:21:01.869336 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6028885c-0744-40a0-841a-99a571aaad5e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:01.874769 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6028885c-0744-40a0-841a-99a571aaad5e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:01.874769 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6028885c-0744-40a0-841a-99a571aaad5e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:01.874769 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6028885c-0744-40a0-841a-99a571aaad5e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:01.896084 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6028885c-0744-40a0-841a-99a571aaad5e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 19:21:02.116573 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6028885c-0744-40a0-841a-99a571aaad5e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "DELETE /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 204 len: 0 microversion: 2.1 time: 0.260769 Jun 10 19:21:02.117249 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4589/8211] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 19:21:01 2022] DELETE /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 19:21:02.122830 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-c331ae15-0b5d-4b85-b8aa-3b7ea54b8d47 req-b16f9273-11c4-4b5e-bf18-c972fcb70a27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85f0bf81-f7b1-4a88-b274-94952146b3f9", "tag": "585a68db-1e60-45a4-8a8d-3d0598eeed2f"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:21:02.131131 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-c331ae15-0b5d-4b85-b8aa-3b7ea54b8d47 req-b16f9273-11c4-4b5e-bf18-c972fcb70a27 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:02.131587 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-c331ae15-0b5d-4b85-b8aa-3b7ea54b8d47 req-b16f9273-11c4-4b5e-bf18-c972fcb70a27 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:02.143506 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-c331ae15-0b5d-4b85-b8aa-3b7ea54b8d47 req-b16f9273-11c4-4b5e-bf18-c972fcb70a27 service nova] Creating event network-changed:585a68db-1e60-45a4-8a8d-3d0598eeed2f for instance 85f0bf81-f7b1-4a88-b274-94952146b3f9 on chh1-master-2 Jun 10 19:21:02.150178 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-c331ae15-0b5d-4b85-b8aa-3b7ea54b8d47 req-b16f9273-11c4-4b5e-bf18-c972fcb70a27 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029576 Jun 10 19:21:02.150178 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4590/8212] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:21:02.154674 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-05e56c3f-08e0-4aa7-b5b7-d1eb4d9f1660 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:21:02.155376 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-05e56c3f-08e0-4aa7-b5b7-d1eb4d9f1660 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:21:02.162154 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05e56c3f-08e0-4aa7-b5b7-d1eb4d9f1660 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:02.162621 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05e56c3f-08e0-4aa7-b5b7-d1eb4d9f1660 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:02.163412 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05e56c3f-08e0-4aa7-b5b7-d1eb4d9f1660 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:02.163863 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05e56c3f-08e0-4aa7-b5b7-d1eb4d9f1660 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:02.307524 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-05e56c3f-08e0-4aa7-b5b7-d1eb4d9f1660 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:21:02.315400 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-05e56c3f-08e0-4aa7-b5b7-d1eb4d9f1660 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1681 microversion: 2.1 time: 0.164741 Jun 10 19:21:02.315979 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4591/8213] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:21:02 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:21:03.333342 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8618704f-04ca-4856-bf48-96023056176c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:21:03.334753 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8618704f-04ca-4856-bf48-96023056176c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:21:03.342184 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8618704f-04ca-4856-bf48-96023056176c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:03.342680 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8618704f-04ca-4856-bf48-96023056176c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:03.343485 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8618704f-04ca-4856-bf48-96023056176c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:03.344452 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8618704f-04ca-4856-bf48-96023056176c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:03.600342 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8618704f-04ca-4856-bf48-96023056176c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:21:03.609882 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8618704f-04ca-4856-bf48-96023056176c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1681 microversion: 2.1 time: 0.280581 Jun 10 19:21:03.610673 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4592/8214] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:21:03 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1681 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:21:04.050320 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-001e29f9-b0a1-4d47-8a6a-6efc19fb324b req-d0232c52-e6ae-4d48-8b66-d37eb3e08d31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85f0bf81-f7b1-4a88-b274-94952146b3f9", "name": "network-vif-deleted", "tag": "585a68db-1e60-45a4-8a8d-3d0598eeed2f"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:21:04.055721 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-001e29f9-b0a1-4d47-8a6a-6efc19fb324b req-d0232c52-e6ae-4d48-8b66-d37eb3e08d31 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:04.056183 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-001e29f9-b0a1-4d47-8a6a-6efc19fb324b req-d0232c52-e6ae-4d48-8b66-d37eb3e08d31 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:04.067192 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-001e29f9-b0a1-4d47-8a6a-6efc19fb324b req-d0232c52-e6ae-4d48-8b66-d37eb3e08d31 service nova] Creating event network-vif-deleted:585a68db-1e60-45a4-8a8d-3d0598eeed2f for instance 85f0bf81-f7b1-4a88-b274-94952146b3f9 on chh1-master-2 Jun 10 19:21:04.073106 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-001e29f9-b0a1-4d47-8a6a-6efc19fb324b req-d0232c52-e6ae-4d48-8b66-d37eb3e08d31 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116560 Jun 10 19:21:04.074943 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4593/8215] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:21:04.628702 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c83666ef-5971-4e2f-aa8a-878314e6f600 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:21:04.629426 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c83666ef-5971-4e2f-aa8a-878314e6f600 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:21:04.635619 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c83666ef-5971-4e2f-aa8a-878314e6f600 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:04.636075 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c83666ef-5971-4e2f-aa8a-878314e6f600 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:04.636864 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c83666ef-5971-4e2f-aa8a-878314e6f600 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:04.637302 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c83666ef-5971-4e2f-aa8a-878314e6f600 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:04.667700 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c83666ef-5971-4e2f-aa8a-878314e6f600 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:04.668151 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c83666ef-5971-4e2f-aa8a-878314e6f600 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:04.668639 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-c83666ef-5971-4e2f-aa8a-878314e6f600 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lazy-loading 'fault' on Instance uuid 85f0bf81-f7b1-4a88-b274-94952146b3f9 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 19:21:04.711549 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c83666ef-5971-4e2f-aa8a-878314e6f600 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:21:04.719849 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c83666ef-5971-4e2f-aa8a-878314e6f600 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 200 len: 1337 microversion: 2.1 time: 0.096185 Jun 10 19:21:04.720675 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4594/8216] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:21:04 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 1337 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:21:05.738174 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f2ad0ca8-e92b-4b91-b345-fd974f87b320 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:21:05.738797 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f2ad0ca8-e92b-4b91-b345-fd974f87b320 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 85f0bf81-f7b1-4a88-b274-94952146b3f9] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:21:05.746352 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f2ad0ca8-e92b-4b91-b345-fd974f87b320 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:05.746808 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f2ad0ca8-e92b-4b91-b345-fd974f87b320 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:05.747582 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f2ad0ca8-e92b-4b91-b345-fd974f87b320 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:05.748026 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f2ad0ca8-e92b-4b91-b345-fd974f87b320 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:05.762050 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-f2ad0ca8-e92b-4b91-b345-fd974f87b320 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] HTTP exception thrown: Instance 85f0bf81-f7b1-4a88-b274-94952146b3f9 could not be found. Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f2ad0ca8-e92b-4b91-b345-fd974f87b320 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Request method failure captured: Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 HTTP/1.1 Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5hzoQk6LzOQQ7g5Y04ow_WKp5MlNRBsHD2FsK2vZcd5mxwsipCOyDxQxdkNiRU4byQZWHxtcqEzY1vTsUCOPYK5DWvqRGyrXg8k2U70L1WZl121uftWLuLoOCrKzUjUtXbP1YSz14Kj_Jm_5PUYidZxWNvxNKG9EJvpKMq-vVke8Xg Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: b6c2a87044a24c708a5ffe9cbf789121 Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-TestShelveInstance-2141584632 Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/b6c2a87044a24c708a5ffe9cbf789121"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/b6c2a87044a24c708a5ffe9cbf789121"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/b6c2a87044a24c708a5ffe9cbf789121"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_b6c2a87044a24c708a5ffe9cbf789121", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-TestShelveInstance-2141584632 Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: b6c2a87044a24c708a5ffe9cbf789121 Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-TestShelveInstance-2141584632 Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-TestShelveInstance-2141584632-project Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 238d05aa801f4fc28fb7f123e423088b Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-TestShelveInstance-2141584632-project Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 85f0bf81-f7b1-4a88-b274-94952146b3f9 could not be found. Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '85f0bf81-f7b1-4a88-b274-94952146b3f9'} Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85f0bf81-f7b1-4a88-b274-94952146b3f9 could not be found. Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85f0bf81-f7b1-4a88-b274-94952146b3f9 could not be found. Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:21:05.763695 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:21:05.768113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:21:05.768113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:21:05.768113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:21:05.768113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 19:21:05.768113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 19:21:05.768113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85f0bf81-f7b1-4a88-b274-94952146b3f9 could not be found. Jun 10 19:21:05.768113 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:21:05.768113 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f2ad0ca8-e92b-4b91-b345-fd974f87b320 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Returning 404 to user: Instance 85f0bf81-f7b1-4a88-b274-94952146b3f9 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 19:21:05.768113 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f2ad0ca8-e92b-4b91-b345-fd974f87b320 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9" status: 404 len: 111 microversion: 2.1 time: 0.030958 Jun 10 19:21:05.768113 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4595/8217] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:21:05 2022] GET /compute/v2.1/servers/85f0bf81-f7b1-4a88-b274-94952146b3f9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 19:21:05.967422 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-699833dd-ad02-49ab-a39a-be6e3672453e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '.version_select at 0x7f77b3c6d430>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:21:06.037376 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-699833dd-ad02-49ab-a39a-be6e3672453e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1001574165" status: 202 len: 0 microversion: 2.1 time: 0.075126 Jun 10 19:21:06.037966 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4596/8218] 10.222.0.35 () {58 vars in 1253 bytes} [Fri Jun 10 19:21:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1001574165 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 19:21:06.064251 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2031c98f-8e4a-480a-ac87-c5bcd648996d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Action: 'create', calling method: .version_select at 0x7f77c122ee50>, body: {"keypair": {"name": "tempest-TestShelveInstance-186950615", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCtsEDTFNcNNnquBQDxIyAPNmW7gh0I0VuBCUKyU6CfTybBUovzIzEq5GrvHvY7Qc2gAzXko9zB0uFuYE8Da4pljZ4OAOqrgCrqK4++qiiFjC5ZYxezT5/xPPCthlLYAMQ=="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:21:06.079413 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-2031c98f-8e4a-480a-ac87-c5bcd648996d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Getting quotas for project b6c2a87044a24c708a5ffe9cbf789121. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 19:21:06.086056 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-2031c98f-8e4a-480a-ac87-c5bcd648996d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Getting quotas for user 238d05aa801f4fc28fb7f123e423088b and project b6c2a87044a24c708a5ffe9cbf789121. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 19:21:06.162472 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2031c98f-8e4a-480a-ac87-c5bcd648996d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.102008 Jun 10 19:21:06.163073 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4597/8219] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 19:21:06 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:21:29.945991 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dd1124af-a144-4e38-8681-87ede107f862 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-516511095", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-186950615", "security_groups": [{"name": "tempest-secgroup-smoke-1665253778"}], "networks": [{"uuid": "a2ab324b-9219-4026-94ac-631fa9055e54"}], "block_device_mapping_v2": [{"uuid": "dfc46bb0-55f0-4731-8ee0-c1ad62538c62", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:21:29.954941 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:21:29.955770 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:21:29.956253 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:21:30.102967 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-dd1124af-a144-4e38-8681-87ede107f862 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] validate_networks() for [('a2ab324b-9219-4026-94ac-631fa9055e54', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 19:21:30.506784 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-dd1124af-a144-4e38-8681-87ede107f862 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 19:21:30.507210 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-dd1124af-a144-4e38-8681-87ede107f862 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 19:21:30.507683 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-dd1124af-a144-4e38-8681-87ede107f862 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 19:21:30.508094 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-dd1124af-a144-4e38-8681-87ede107f862 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 19:21:30.508539 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-dd1124af-a144-4e38-8681-87ede107f862 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 19:21:30.517990 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd1124af-a144-4e38-8681-87ede107f862 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:30.518440 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd1124af-a144-4e38-8681-87ede107f862 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:30.519236 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd1124af-a144-4e38-8681-87ede107f862 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:30.519673 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dd1124af-a144-4e38-8681-87ede107f862 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:30.536768 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-dd1124af-a144-4e38-8681-87ede107f862 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Getting quotas for project b6c2a87044a24c708a5ffe9cbf789121. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 19:21:30.541969 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-dd1124af-a144-4e38-8681-87ede107f862 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Getting quotas for user 238d05aa801f4fc28fb7f123e423088b and project b6c2a87044a24c708a5ffe9cbf789121. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 19:21:30.599617 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dd1124af-a144-4e38-8681-87ede107f862 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 19:21:30.601753 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dd1124af-a144-4e38-8681-87ede107f862 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dfc46bb0-55f0-4731-8ee0-c1ad62538c62',volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 19:21:30.945672 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dd1124af-a144-4e38-8681-87ede107f862 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.003760 Jun 10 19:21:30.946326 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4598/8220] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 19:21:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 1005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 10 19:21:30.956230 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9df5b8b5-6c68-47da-8639-057b936820ce tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:21:30.956880 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9df5b8b5-6c68-47da-8639-057b936820ce tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:21:31.012765 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9df5b8b5-6c68-47da-8639-057b936820ce tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:21:31.021514 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9df5b8b5-6c68-47da-8639-057b936820ce tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1087 microversion: 2.1 time: 0.069021 Jun 10 19:21:31.022129 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4599/8221] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:21:30 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1087 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:21:32.038606 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-50e1ee1c-0af7-4734-a0d3-c8177dbac64d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:21:32.039219 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-50e1ee1c-0af7-4734-a0d3-c8177dbac64d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:21:32.046456 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-50e1ee1c-0af7-4734-a0d3-c8177dbac64d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:32.050031 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-50e1ee1c-0af7-4734-a0d3-c8177dbac64d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:32.050031 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-50e1ee1c-0af7-4734-a0d3-c8177dbac64d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:32.050031 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-50e1ee1c-0af7-4734-a0d3-c8177dbac64d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:32.117859 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-50e1ee1c-0af7-4734-a0d3-c8177dbac64d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:21:32.126299 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-50e1ee1c-0af7-4734-a0d3-c8177dbac64d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1129 microversion: 2.1 time: 0.091454 Jun 10 19:21:32.126905 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4600/8222] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:21:32 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1129 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:21:33.149377 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d2e01765-36b7-47d5-a8fb-c572688f3feb tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:21:33.150762 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d2e01765-36b7-47d5-a8fb-c572688f3feb tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:21:33.158362 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d2e01765-36b7-47d5-a8fb-c572688f3feb tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:33.158916 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d2e01765-36b7-47d5-a8fb-c572688f3feb tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:33.160018 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d2e01765-36b7-47d5-a8fb-c572688f3feb tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:33.160563 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d2e01765-36b7-47d5-a8fb-c572688f3feb tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:33.229537 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d2e01765-36b7-47d5-a8fb-c572688f3feb tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:21:33.238265 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d2e01765-36b7-47d5-a8fb-c572688f3feb tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1203 microversion: 2.1 time: 0.092702 Jun 10 19:21:33.239213 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4601/8223] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:21:33 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1203 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:21:34.268792 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bc7b18d2-f827-409a-a01a-85d78b599d57 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:21:34.270161 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bc7b18d2-f827-409a-a01a-85d78b599d57 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:21:34.278079 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bc7b18d2-f827-409a-a01a-85d78b599d57 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:34.278868 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bc7b18d2-f827-409a-a01a-85d78b599d57 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:34.279689 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bc7b18d2-f827-409a-a01a-85d78b599d57 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:34.280132 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bc7b18d2-f827-409a-a01a-85d78b599d57 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:34.440530 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bc7b18d2-f827-409a-a01a-85d78b599d57 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:21:34.448943 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bc7b18d2-f827-409a-a01a-85d78b599d57 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1271 microversion: 2.1 time: 0.183962 Jun 10 19:21:34.449922 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4602/8224] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:21:34 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1271 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:21:34.580959 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-a91eb4df-f8b5-45ec-92b1-9b763fc91305 req-12c9ca8e-ec44-4b3a-ac04-c81452f5175f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dd30fb7-5147-4c00-b684-02d01de15c51", "tag": "b363a6af-4d48-4393-9313-b79553bd2bd4"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:21:34.589270 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-a91eb4df-f8b5-45ec-92b1-9b763fc91305 req-12c9ca8e-ec44-4b3a-ac04-c81452f5175f service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:34.589706 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-a91eb4df-f8b5-45ec-92b1-9b763fc91305 req-12c9ca8e-ec44-4b3a-ac04-c81452f5175f service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:34.610397 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-a91eb4df-f8b5-45ec-92b1-9b763fc91305 req-12c9ca8e-ec44-4b3a-ac04-c81452f5175f service nova] Creating event network-changed:b363a6af-4d48-4393-9313-b79553bd2bd4 for instance 2dd30fb7-5147-4c00-b684-02d01de15c51 on chh2-master-2 Jun 10 19:21:34.610397 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-a91eb4df-f8b5-45ec-92b1-9b763fc91305 req-12c9ca8e-ec44-4b3a-ac04-c81452f5175f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031125 Jun 10 19:21:34.611316 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4603/8225] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:21:35.469045 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6f012e72-0be8-442f-8ade-fbbe6c2f6e4f tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:21:35.471166 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6f012e72-0be8-442f-8ade-fbbe6c2f6e4f tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:21:35.477903 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6f012e72-0be8-442f-8ade-fbbe6c2f6e4f tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:35.478473 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6f012e72-0be8-442f-8ade-fbbe6c2f6e4f tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:35.479222 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6f012e72-0be8-442f-8ade-fbbe6c2f6e4f tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:35.479670 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6f012e72-0be8-442f-8ade-fbbe6c2f6e4f tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:35.622220 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6f012e72-0be8-442f-8ade-fbbe6c2f6e4f tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:21:35.630073 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6f012e72-0be8-442f-8ade-fbbe6c2f6e4f tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1271 microversion: 2.1 time: 0.167218 Jun 10 19:21:35.630769 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4604/8226] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:21:35 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1271 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:21:36.647106 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-50c09f88-1ca1-4701-b06c-5ce8460276e2 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:21:36.647773 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-50c09f88-1ca1-4701-b06c-5ce8460276e2 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:21:36.654873 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-50c09f88-1ca1-4701-b06c-5ce8460276e2 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:36.655323 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-50c09f88-1ca1-4701-b06c-5ce8460276e2 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:36.656101 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-50c09f88-1ca1-4701-b06c-5ce8460276e2 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:36.656561 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-50c09f88-1ca1-4701-b06c-5ce8460276e2 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:36.795830 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-50c09f88-1ca1-4701-b06c-5ce8460276e2 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:21:36.803666 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-50c09f88-1ca1-4701-b06c-5ce8460276e2 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1271 microversion: 2.1 time: 0.160482 Jun 10 19:21:36.804248 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4605/8227] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:21:36 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1271 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:21:37.820507 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9232f6e6-f057-4494-ab16-0696dbbc9d56 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:21:37.823571 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9232f6e6-f057-4494-ab16-0696dbbc9d56 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:21:37.828020 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9232f6e6-f057-4494-ab16-0696dbbc9d56 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:37.828510 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9232f6e6-f057-4494-ab16-0696dbbc9d56 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:37.829275 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9232f6e6-f057-4494-ab16-0696dbbc9d56 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:37.829707 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9232f6e6-f057-4494-ab16-0696dbbc9d56 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:37.959148 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9232f6e6-f057-4494-ab16-0696dbbc9d56 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:21:37.966782 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9232f6e6-f057-4494-ab16-0696dbbc9d56 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1271 microversion: 2.1 time: 0.150347 Jun 10 19:21:37.967353 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4606/8228] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:21:37 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1271 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:21:38.983918 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b5642910-07c6-49ef-aa21-f329d37ea5ed tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:21:38.984570 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b5642910-07c6-49ef-aa21-f329d37ea5ed tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:21:38.992328 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5642910-07c6-49ef-aa21-f329d37ea5ed tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:38.992815 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5642910-07c6-49ef-aa21-f329d37ea5ed tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:38.993592 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5642910-07c6-49ef-aa21-f329d37ea5ed tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:38.994074 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5642910-07c6-49ef-aa21-f329d37ea5ed tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:39.134705 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b5642910-07c6-49ef-aa21-f329d37ea5ed tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:21:39.142608 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b5642910-07c6-49ef-aa21-f329d37ea5ed tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1259 microversion: 2.1 time: 0.162541 Jun 10 19:21:39.143129 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4607/8229] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:21:38 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:21:40.159486 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-60a09de7-610b-42c1-9a48-d62c65944eb3 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:21:40.160157 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-60a09de7-610b-42c1-9a48-d62c65944eb3 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:21:40.167033 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-60a09de7-610b-42c1-9a48-d62c65944eb3 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:40.167494 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-60a09de7-610b-42c1-9a48-d62c65944eb3 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:40.168267 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-60a09de7-610b-42c1-9a48-d62c65944eb3 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:40.168734 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-60a09de7-610b-42c1-9a48-d62c65944eb3 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:40.305282 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-60a09de7-610b-42c1-9a48-d62c65944eb3 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:21:40.313576 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-60a09de7-610b-42c1-9a48-d62c65944eb3 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1259 microversion: 2.1 time: 0.157357 Jun 10 19:21:40.314156 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4608/8230] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:21:40 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:21:41.330969 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e1934671-36df-402d-ae6c-271d3a425791 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:21:41.331618 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e1934671-36df-402d-ae6c-271d3a425791 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:21:41.333531 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:21:41.334257 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=8 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:21:41.339925 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e1934671-36df-402d-ae6c-271d3a425791 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:41.340419 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e1934671-36df-402d-ae6c-271d3a425791 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:41.341197 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e1934671-36df-402d-ae6c-271d3a425791 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:41.341645 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e1934671-36df-402d-ae6c-271d3a425791 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:41.479905 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e1934671-36df-402d-ae6c-271d3a425791 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:21:41.487511 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e1934671-36df-402d-ae6c-271d3a425791 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1259 microversion: 2.1 time: 0.161192 Jun 10 19:21:41.488121 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4609/8231] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:21:41 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:21:42.504795 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9e8abed6-043c-45fb-b06f-458b0e809992 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:21:42.505414 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9e8abed6-043c-45fb-b06f-458b0e809992 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:21:42.512651 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9e8abed6-043c-45fb-b06f-458b0e809992 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:42.513111 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9e8abed6-043c-45fb-b06f-458b0e809992 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:42.513878 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9e8abed6-043c-45fb-b06f-458b0e809992 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:42.514321 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9e8abed6-043c-45fb-b06f-458b0e809992 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:42.646699 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9e8abed6-043c-45fb-b06f-458b0e809992 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:21:42.654207 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9e8abed6-043c-45fb-b06f-458b0e809992 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1259 microversion: 2.1 time: 0.153904 Jun 10 19:21:42.654773 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4610/8232] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:21:42 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:21:43.670880 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dc1dd2f2-ecb0-423f-abf3-f0e90032bd76 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:21:43.671510 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dc1dd2f2-ecb0-423f-abf3-f0e90032bd76 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:21:43.678381 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc1dd2f2-ecb0-423f-abf3-f0e90032bd76 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:43.678844 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc1dd2f2-ecb0-423f-abf3-f0e90032bd76 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:43.679622 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc1dd2f2-ecb0-423f-abf3-f0e90032bd76 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:43.680074 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dc1dd2f2-ecb0-423f-abf3-f0e90032bd76 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:43.815085 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-dc1dd2f2-ecb0-423f-abf3-f0e90032bd76 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:21:43.822803 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dc1dd2f2-ecb0-423f-abf3-f0e90032bd76 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1259 microversion: 2.1 time: 0.155965 Jun 10 19:21:43.823409 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4611/8233] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:21:43 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:21:44.841026 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e01f90a6-74e1-43ac-ba52-7012709c3911 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:21:44.841673 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e01f90a6-74e1-43ac-ba52-7012709c3911 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:21:44.848777 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e01f90a6-74e1-43ac-ba52-7012709c3911 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:44.849227 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e01f90a6-74e1-43ac-ba52-7012709c3911 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:44.849989 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e01f90a6-74e1-43ac-ba52-7012709c3911 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:44.850425 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e01f90a6-74e1-43ac-ba52-7012709c3911 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:44.979081 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e01f90a6-74e1-43ac-ba52-7012709c3911 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:21:44.987072 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e01f90a6-74e1-43ac-ba52-7012709c3911 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1259 microversion: 2.1 time: 0.149921 Jun 10 19:21:44.995336 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4612/8234] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:21:44 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:21:46.003553 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0bbbd7f6-970f-439a-bd1d-4400ea781943 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:21:46.013349 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0bbbd7f6-970f-439a-bd1d-4400ea781943 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:21:46.013349 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0bbbd7f6-970f-439a-bd1d-4400ea781943 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:46.013349 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0bbbd7f6-970f-439a-bd1d-4400ea781943 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:46.013349 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0bbbd7f6-970f-439a-bd1d-4400ea781943 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:46.013349 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0bbbd7f6-970f-439a-bd1d-4400ea781943 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:46.145412 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0bbbd7f6-970f-439a-bd1d-4400ea781943 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:21:46.153030 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0bbbd7f6-970f-439a-bd1d-4400ea781943 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1259 microversion: 2.1 time: 0.153927 Jun 10 19:21:46.153613 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4613/8235] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:21:45 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:21:47.169960 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0b18d9fb-b703-4d85-bcab-77b84aed1b6d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:21:47.170613 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0b18d9fb-b703-4d85-bcab-77b84aed1b6d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:21:47.177502 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0b18d9fb-b703-4d85-bcab-77b84aed1b6d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:47.177953 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0b18d9fb-b703-4d85-bcab-77b84aed1b6d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:47.178715 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0b18d9fb-b703-4d85-bcab-77b84aed1b6d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:47.179152 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0b18d9fb-b703-4d85-bcab-77b84aed1b6d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:47.310910 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0b18d9fb-b703-4d85-bcab-77b84aed1b6d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:21:47.318372 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0b18d9fb-b703-4d85-bcab-77b84aed1b6d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1259 microversion: 2.1 time: 0.152385 Jun 10 19:21:47.318943 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4614/8236] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:21:47 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:21:48.335471 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b600d1e2-287e-41e0-8ff0-3cca6998ac74 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:21:48.336086 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b600d1e2-287e-41e0-8ff0-3cca6998ac74 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:21:48.343330 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b600d1e2-287e-41e0-8ff0-3cca6998ac74 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:48.343786 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b600d1e2-287e-41e0-8ff0-3cca6998ac74 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:48.344588 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b600d1e2-287e-41e0-8ff0-3cca6998ac74 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:48.345043 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b600d1e2-287e-41e0-8ff0-3cca6998ac74 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:48.476475 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b600d1e2-287e-41e0-8ff0-3cca6998ac74 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:21:48.483963 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b600d1e2-287e-41e0-8ff0-3cca6998ac74 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1259 microversion: 2.1 time: 0.152387 Jun 10 19:21:48.484558 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4615/8237] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:21:48 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:21:49.501017 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-498d0bba-772f-4225-bdd9-26f767cdbdaa tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:21:49.501682 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-498d0bba-772f-4225-bdd9-26f767cdbdaa tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:21:49.508666 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-498d0bba-772f-4225-bdd9-26f767cdbdaa tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:49.509131 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-498d0bba-772f-4225-bdd9-26f767cdbdaa tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:49.509905 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-498d0bba-772f-4225-bdd9-26f767cdbdaa tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:49.510351 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-498d0bba-772f-4225-bdd9-26f767cdbdaa tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:49.644080 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-498d0bba-772f-4225-bdd9-26f767cdbdaa tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:21:49.647583 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:21:49.652019 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-498d0bba-772f-4225-bdd9-26f767cdbdaa tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1259 microversion: 2.1 time: 0.154990 Jun 10 19:21:49.652631 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4616/8238] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:21:49 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:21:50.147157 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-761feb13-1a6d-49f0-bd2d-c20f7fc5c4c0 req-3ab30320-7bed-443b-9c6f-56c67dddb892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dd30fb7-5147-4c00-b684-02d01de15c51", "name": "network-vif-plugged", "status": "completed", "tag": "b363a6af-4d48-4393-9313-b79553bd2bd4"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:21:50.155211 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-761feb13-1a6d-49f0-bd2d-c20f7fc5c4c0 req-3ab30320-7bed-443b-9c6f-56c67dddb892 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:50.155655 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-761feb13-1a6d-49f0-bd2d-c20f7fc5c4c0 req-3ab30320-7bed-443b-9c6f-56c67dddb892 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:50.166546 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-761feb13-1a6d-49f0-bd2d-c20f7fc5c4c0 req-3ab30320-7bed-443b-9c6f-56c67dddb892 service nova] Creating event network-vif-plugged:b363a6af-4d48-4393-9313-b79553bd2bd4 for instance 2dd30fb7-5147-4c00-b684-02d01de15c51 on chh2-master-2 Jun 10 19:21:50.171963 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-761feb13-1a6d-49f0-bd2d-c20f7fc5c4c0 req-3ab30320-7bed-443b-9c6f-56c67dddb892 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082685 Jun 10 19:21:50.172839 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4617/8239] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:21:50.676565 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-46ef3089-e545-464a-b192-87daddca9b70 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:21:50.677204 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-46ef3089-e545-464a-b192-87daddca9b70 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:21:50.683552 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-46ef3089-e545-464a-b192-87daddca9b70 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:50.684011 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-46ef3089-e545-464a-b192-87daddca9b70 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:50.684813 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-46ef3089-e545-464a-b192-87daddca9b70 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:50.685259 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-46ef3089-e545-464a-b192-87daddca9b70 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:50.823765 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-46ef3089-e545-464a-b192-87daddca9b70 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:21:50.832501 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-46ef3089-e545-464a-b192-87daddca9b70 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1259 microversion: 2.1 time: 0.160321 Jun 10 19:21:50.833103 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4618/8240] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:21:50 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:21:51.850305 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0bf6c19d-f581-4c0a-ab3f-3f8ba10309af tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:21:51.851029 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0bf6c19d-f581-4c0a-ab3f-3f8ba10309af tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:21:51.857967 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0bf6c19d-f581-4c0a-ab3f-3f8ba10309af tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:51.858417 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0bf6c19d-f581-4c0a-ab3f-3f8ba10309af tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:51.859216 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0bf6c19d-f581-4c0a-ab3f-3f8ba10309af tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:51.859658 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0bf6c19d-f581-4c0a-ab3f-3f8ba10309af tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:51.991685 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0bf6c19d-f581-4c0a-ab3f-3f8ba10309af tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:21:51.999343 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0bf6c19d-f581-4c0a-ab3f-3f8ba10309af tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1443 microversion: 2.1 time: 0.153230 Jun 10 19:21:51.999919 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4619/8241] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:21:51 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1443 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:21:52.020744 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3049273e-6834-44b4-a133-3e38e9a6e683 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:21:52.021349 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3049273e-6834-44b4-a133-3e38e9a6e683 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:21:52.027186 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3049273e-6834-44b4-a133-3e38e9a6e683 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:52.027638 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3049273e-6834-44b4-a133-3e38e9a6e683 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:52.028435 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3049273e-6834-44b4-a133-3e38e9a6e683 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:52.028872 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3049273e-6834-44b4-a133-3e38e9a6e683 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:52.164489 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3049273e-6834-44b4-a133-3e38e9a6e683 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:21:52.172115 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3049273e-6834-44b4-a133-3e38e9a6e683 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1443 microversion: 2.1 time: 0.155670 Jun 10 19:21:52.172738 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4620/8242] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:21:52 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1443 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:21:54.074505 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-9b14ae27-3ebd-414b-a194-09eb44592c86 req-11e9e7d2-ad33-4b26-b73d-67ec27ba2aab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dd30fb7-5147-4c00-b684-02d01de15c51", "tag": "b363a6af-4d48-4393-9313-b79553bd2bd4"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:21:54.083282 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-9b14ae27-3ebd-414b-a194-09eb44592c86 req-11e9e7d2-ad33-4b26-b73d-67ec27ba2aab service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:21:54.083732 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-9b14ae27-3ebd-414b-a194-09eb44592c86 req-11e9e7d2-ad33-4b26-b73d-67ec27ba2aab service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:21:54.096050 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-9b14ae27-3ebd-414b-a194-09eb44592c86 req-11e9e7d2-ad33-4b26-b73d-67ec27ba2aab service nova] Creating event network-changed:b363a6af-4d48-4393-9313-b79553bd2bd4 for instance 2dd30fb7-5147-4c00-b684-02d01de15c51 on chh2-master-2 Jun 10 19:21:54.101735 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-9b14ae27-3ebd-414b-a194-09eb44592c86 req-11e9e7d2-ad33-4b26-b73d-67ec27ba2aab service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079263 Jun 10 19:21:54.102802 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4621/8243] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:24:10.997083 chdv-master-2 devstack@n-api.service[126595]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 19:24:10.997773 chdv-master-2 devstack@n-api.service[126595]: Fri Jun 10 19:24:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 10 19:24:11.112041 chdv-master-2 devstack@n-api.service[126595]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jun 10 19:24:11.112264 chdv-master-2 devstack@n-api.service[126595]: Fri Jun 10 19:24:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 10 19:24:20.146589 chdv-master-2 devstack@n-api.service[126595]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0c5f50dc-ccde-4ae8-a3f3-fe46db0ef7f7] AMQP server on 10.222.0.35:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 19:24:20.147445 chdv-master-2 devstack@n-api.service[126595]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cecfc05b-781c-4b87-9406-22ae5810c12d] AMQP server on 10.222.0.35:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 10 19:24:20.148201 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:24:20.148989 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=22 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:24:20.153159 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8f7f73d8-22a5-43bd-8b34-ce949845eced tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:24:20.153776 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8f7f73d8-22a5-43bd-8b34-ce949845eced tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:24:20.160361 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8f7f73d8-22a5-43bd-8b34-ce949845eced tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:20.161983 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8f7f73d8-22a5-43bd-8b34-ce949845eced tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:20.161983 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8f7f73d8-22a5-43bd-8b34-ce949845eced tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:20.161983 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8f7f73d8-22a5-43bd-8b34-ce949845eced tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:20.185999 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-8f7f73d8-22a5-43bd-8b34-ce949845eced tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lazy-loading 'flavor' on Instance uuid 2dd30fb7-5147-4c00-b684-02d01de15c51 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 19:24:20.431613 chdv-master-2 devstack@n-api.service[126595]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8f7f73d8-22a5-43bd-8b34-ce949845eced tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [68efdea6-230f-4631-a595-0e6450dbb8c1] AMQP server on 10.222.0.35:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 10 19:24:21.154760 chdv-master-2 devstack@n-api.service[126595]: INFO oslo.messaging._drivers.impl_rabbit [-] [0c5f50dc-ccde-4ae8-a3f3-fe46db0ef7f7] Reconnected to AMQP server on 10.222.0.35:5672 via [amqp] client with port 49006. Jun 10 19:24:21.159287 chdv-master-2 devstack@n-api.service[126595]: INFO oslo.messaging._drivers.impl_rabbit [-] [cecfc05b-781c-4b87-9406-22ae5810c12d] Reconnected to AMQP server on 10.222.0.35:5672 via [amqp] client with port 49008. Jun 10 19:24:21.439155 chdv-master-2 devstack@n-api.service[126595]: INFO oslo.messaging._drivers.impl_rabbit [None req-8f7f73d8-22a5-43bd-8b34-ce949845eced tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [68efdea6-230f-4631-a595-0e6450dbb8c1] Reconnected to AMQP server on 10.222.0.35:5672 via [amqp] client with port 49010. Jun 10 19:24:21.442530 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8f7f73d8-22a5-43bd-8b34-ce949845eced tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "POST /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51/action" status: 202 len: 0 microversion: 2.1 time: 1.298208 Jun 10 19:24:21.443144 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4622/8244] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 19:24:20 2022] POST /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51/action => generated 0 bytes in 1300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 19:24:21.451971 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b5ec4266-3248-4efc-ae14-304d31633255 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:24:21.453251 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b5ec4266-3248-4efc-ae14-304d31633255 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:24:21.460616 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5ec4266-3248-4efc-ae14-304d31633255 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:21.463008 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5ec4266-3248-4efc-ae14-304d31633255 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:21.463008 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5ec4266-3248-4efc-ae14-304d31633255 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:21.463008 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b5ec4266-3248-4efc-ae14-304d31633255 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:21.603864 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b5ec4266-3248-4efc-ae14-304d31633255 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:24:21.611898 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b5ec4266-3248-4efc-ae14-304d31633255 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1567 microversion: 2.1 time: 0.164061 Jun 10 19:24:21.612596 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4623/8245] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:24:21 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:24:22.629434 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4f0ed08a-1e24-4215-819f-f3cb2da4582d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:24:22.630096 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4f0ed08a-1e24-4215-819f-f3cb2da4582d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:24:22.637082 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f0ed08a-1e24-4215-819f-f3cb2da4582d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:22.637530 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f0ed08a-1e24-4215-819f-f3cb2da4582d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:22.638290 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f0ed08a-1e24-4215-819f-f3cb2da4582d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:22.638725 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f0ed08a-1e24-4215-819f-f3cb2da4582d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:22.769668 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4f0ed08a-1e24-4215-819f-f3cb2da4582d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:24:22.777372 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4f0ed08a-1e24-4215-819f-f3cb2da4582d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1567 microversion: 2.1 time: 0.151882 Jun 10 19:24:22.777985 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4624/8246] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:24:22 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:24:23.794658 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4f88638f-60c6-415a-9a3f-0cc93cfbd32f tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:24:23.795354 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4f88638f-60c6-415a-9a3f-0cc93cfbd32f tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:24:23.802260 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f88638f-60c6-415a-9a3f-0cc93cfbd32f tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:23.802717 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f88638f-60c6-415a-9a3f-0cc93cfbd32f tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:23.803491 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f88638f-60c6-415a-9a3f-0cc93cfbd32f tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:23.803933 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4f88638f-60c6-415a-9a3f-0cc93cfbd32f tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:23.938683 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4f88638f-60c6-415a-9a3f-0cc93cfbd32f tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:24:23.946583 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4f88638f-60c6-415a-9a3f-0cc93cfbd32f tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1567 microversion: 2.1 time: 0.155753 Jun 10 19:24:23.947046 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4625/8247] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:24:23 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:24:24.964444 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f3f4b7ba-03b0-45be-aabc-31567192428f tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:24:24.965057 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f3f4b7ba-03b0-45be-aabc-31567192428f tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:24:24.972899 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f3f4b7ba-03b0-45be-aabc-31567192428f tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:24.973349 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f3f4b7ba-03b0-45be-aabc-31567192428f tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:24.974107 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f3f4b7ba-03b0-45be-aabc-31567192428f tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:24.974547 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f3f4b7ba-03b0-45be-aabc-31567192428f tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:25.107170 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-f3f4b7ba-03b0-45be-aabc-31567192428f tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:24:25.114857 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f3f4b7ba-03b0-45be-aabc-31567192428f tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1567 microversion: 2.1 time: 0.154645 Jun 10 19:24:25.115421 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4626/8248] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:24:24 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:24:26.131187 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6874bfb5-eb1e-407e-b528-e1adb6ac2486 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:24:26.131811 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6874bfb5-eb1e-407e-b528-e1adb6ac2486 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:24:26.138760 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6874bfb5-eb1e-407e-b528-e1adb6ac2486 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:26.139240 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6874bfb5-eb1e-407e-b528-e1adb6ac2486 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:26.140000 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6874bfb5-eb1e-407e-b528-e1adb6ac2486 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:26.140478 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6874bfb5-eb1e-407e-b528-e1adb6ac2486 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:26.271602 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6874bfb5-eb1e-407e-b528-e1adb6ac2486 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:24:26.279187 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6874bfb5-eb1e-407e-b528-e1adb6ac2486 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1567 microversion: 2.1 time: 0.152003 Jun 10 19:24:26.279754 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4627/8249] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:24:26 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:24:27.297201 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-186f5469-36c5-4f14-9581-8cc2e00aea00 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:24:27.297851 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-186f5469-36c5-4f14-9581-8cc2e00aea00 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:24:27.304748 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-186f5469-36c5-4f14-9581-8cc2e00aea00 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:27.305202 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-186f5469-36c5-4f14-9581-8cc2e00aea00 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:27.305959 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-186f5469-36c5-4f14-9581-8cc2e00aea00 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:27.306394 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-186f5469-36c5-4f14-9581-8cc2e00aea00 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:27.441018 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-186f5469-36c5-4f14-9581-8cc2e00aea00 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:24:27.448520 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-186f5469-36c5-4f14-9581-8cc2e00aea00 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1567 microversion: 2.1 time: 0.155651 Jun 10 19:24:27.449086 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4628/8250] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:24:27 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:24:28.465863 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-97b790fd-cda8-4654-8bd8-40e648a14b1d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:24:28.466482 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-97b790fd-cda8-4654-8bd8-40e648a14b1d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:24:28.473896 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-97b790fd-cda8-4654-8bd8-40e648a14b1d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:28.474347 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-97b790fd-cda8-4654-8bd8-40e648a14b1d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:28.475102 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-97b790fd-cda8-4654-8bd8-40e648a14b1d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:28.475628 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-97b790fd-cda8-4654-8bd8-40e648a14b1d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:28.604177 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-97b790fd-cda8-4654-8bd8-40e648a14b1d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:24:28.611796 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-97b790fd-cda8-4654-8bd8-40e648a14b1d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1567 microversion: 2.1 time: 0.150118 Jun 10 19:24:28.612379 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4629/8251] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:24:28 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:24:29.629579 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-66c530e0-32a8-49ff-ad69-2e0ea476698d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:24:29.630233 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-66c530e0-32a8-49ff-ad69-2e0ea476698d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:24:29.637443 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-66c530e0-32a8-49ff-ad69-2e0ea476698d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:29.637890 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-66c530e0-32a8-49ff-ad69-2e0ea476698d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:29.638654 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-66c530e0-32a8-49ff-ad69-2e0ea476698d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:29.639092 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-66c530e0-32a8-49ff-ad69-2e0ea476698d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:29.772918 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-66c530e0-32a8-49ff-ad69-2e0ea476698d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:24:29.780606 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-66c530e0-32a8-49ff-ad69-2e0ea476698d tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1567 microversion: 2.1 time: 0.155766 Jun 10 19:24:29.781686 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4630/8252] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:24:29 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:24:30.800988 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-81ff360b-9f47-4f78-b4e9-c3b92e5482f5 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:24:30.801661 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-81ff360b-9f47-4f78-b4e9-c3b92e5482f5 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:24:30.810971 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-81ff360b-9f47-4f78-b4e9-c3b92e5482f5 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:30.811459 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-81ff360b-9f47-4f78-b4e9-c3b92e5482f5 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:30.812259 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-81ff360b-9f47-4f78-b4e9-c3b92e5482f5 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:30.812736 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-81ff360b-9f47-4f78-b4e9-c3b92e5482f5 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:30.942850 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-81ff360b-9f47-4f78-b4e9-c3b92e5482f5 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:24:30.950494 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-81ff360b-9f47-4f78-b4e9-c3b92e5482f5 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1567 microversion: 2.1 time: 0.155934 Jun 10 19:24:30.951072 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4631/8253] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:24:30 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:24:31.968572 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-012d1ad9-5aeb-4dd8-8fdb-ec9e84261d37 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:24:31.969215 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-012d1ad9-5aeb-4dd8-8fdb-ec9e84261d37 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:24:31.976861 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-012d1ad9-5aeb-4dd8-8fdb-ec9e84261d37 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:31.977317 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-012d1ad9-5aeb-4dd8-8fdb-ec9e84261d37 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:31.978082 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-012d1ad9-5aeb-4dd8-8fdb-ec9e84261d37 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:31.978524 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-012d1ad9-5aeb-4dd8-8fdb-ec9e84261d37 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:32.111812 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-012d1ad9-5aeb-4dd8-8fdb-ec9e84261d37 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:24:32.119702 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-012d1ad9-5aeb-4dd8-8fdb-ec9e84261d37 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1567 microversion: 2.1 time: 0.155161 Jun 10 19:24:32.120284 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4632/8254] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:24:31 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:24:33.136679 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3fdfca63-a374-4ded-94cd-cfd600119be5 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:24:33.137324 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3fdfca63-a374-4ded-94cd-cfd600119be5 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:24:33.144663 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3fdfca63-a374-4ded-94cd-cfd600119be5 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:33.145112 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3fdfca63-a374-4ded-94cd-cfd600119be5 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:33.145865 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3fdfca63-a374-4ded-94cd-cfd600119be5 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:33.146300 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3fdfca63-a374-4ded-94cd-cfd600119be5 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:33.279562 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3fdfca63-a374-4ded-94cd-cfd600119be5 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:24:33.287857 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3fdfca63-a374-4ded-94cd-cfd600119be5 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1567 microversion: 2.1 time: 0.155151 Jun 10 19:24:33.288453 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4633/8255] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:24:33 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:24:34.305579 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-be4c0576-0f64-4cda-8215-743cba28fd05 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:24:34.306200 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-be4c0576-0f64-4cda-8215-743cba28fd05 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:24:34.313164 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-be4c0576-0f64-4cda-8215-743cba28fd05 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:34.313622 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-be4c0576-0f64-4cda-8215-743cba28fd05 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:34.314396 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-be4c0576-0f64-4cda-8215-743cba28fd05 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:34.314932 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-be4c0576-0f64-4cda-8215-743cba28fd05 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:34.450851 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-be4c0576-0f64-4cda-8215-743cba28fd05 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:24:34.458519 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-be4c0576-0f64-4cda-8215-743cba28fd05 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1567 microversion: 2.1 time: 0.156947 Jun 10 19:24:34.459721 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4634/8256] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:24:34 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:24:35.476418 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9829fe75-575c-4335-a115-5ef14b8304f7 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:24:35.477114 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9829fe75-575c-4335-a115-5ef14b8304f7 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:24:35.483965 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9829fe75-575c-4335-a115-5ef14b8304f7 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:35.484502 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9829fe75-575c-4335-a115-5ef14b8304f7 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:35.485270 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9829fe75-575c-4335-a115-5ef14b8304f7 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:35.485710 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9829fe75-575c-4335-a115-5ef14b8304f7 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:35.904658 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9829fe75-575c-4335-a115-5ef14b8304f7 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:24:35.912448 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9829fe75-575c-4335-a115-5ef14b8304f7 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1567 microversion: 2.1 time: 0.439986 Jun 10 19:24:35.913012 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4635/8257] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:24:35 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1567 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:24:36.928708 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-06b43395-0b6e-40bb-ab72-cc5a0c01da23 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:24:36.929378 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-06b43395-0b6e-40bb-ab72-cc5a0c01da23 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:24:36.936257 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-06b43395-0b6e-40bb-ab72-cc5a0c01da23 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:36.936746 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-06b43395-0b6e-40bb-ab72-cc5a0c01da23 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:36.937516 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-06b43395-0b6e-40bb-ab72-cc5a0c01da23 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:36.937960 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-06b43395-0b6e-40bb-ab72-cc5a0c01da23 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:36.956277 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:24:37.067502 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-06b43395-0b6e-40bb-ab72-cc5a0c01da23 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:24:37.075211 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-06b43395-0b6e-40bb-ab72-cc5a0c01da23 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1508 microversion: 2.1 time: 0.150392 Jun 10 19:24:37.075793 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4636/8258] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:24:36 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:24:37.091789 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4993451f-4600-4803-95c8-6a9187831436 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:24:37.092389 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4993451f-4600-4803-95c8-6a9187831436 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:24:37.098721 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4993451f-4600-4803-95c8-6a9187831436 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:37.099175 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4993451f-4600-4803-95c8-6a9187831436 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:37.099948 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4993451f-4600-4803-95c8-6a9187831436 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:37.101591 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4993451f-4600-4803-95c8-6a9187831436 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:37.309727 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4993451f-4600-4803-95c8-6a9187831436 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "POST /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51/action" status: 202 len: 0 microversion: 2.1 time: 0.221630 Jun 10 19:24:37.310522 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4637/8259] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 19:24:37 2022] POST /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 19:24:37.318887 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ee1e328c-e21f-492e-9bd6-33fe68eeeb05 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:24:37.319524 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ee1e328c-e21f-492e-9bd6-33fe68eeeb05 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:24:37.325578 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee1e328c-e21f-492e-9bd6-33fe68eeeb05 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:37.326028 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee1e328c-e21f-492e-9bd6-33fe68eeeb05 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:37.326790 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee1e328c-e21f-492e-9bd6-33fe68eeeb05 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:37.327231 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ee1e328c-e21f-492e-9bd6-33fe68eeeb05 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:37.508123 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ee1e328c-e21f-492e-9bd6-33fe68eeeb05 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:24:37.516728 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ee1e328c-e21f-492e-9bd6-33fe68eeeb05 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1516 microversion: 2.1 time: 0.201021 Jun 10 19:24:37.517323 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4638/8260] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:24:37 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1516 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:24:38.533976 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e217a0e4-34bd-4eab-8f96-051fedb98484 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:24:38.534599 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e217a0e4-34bd-4eab-8f96-051fedb98484 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:24:38.541691 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e217a0e4-34bd-4eab-8f96-051fedb98484 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:38.542152 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e217a0e4-34bd-4eab-8f96-051fedb98484 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:38.542928 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e217a0e4-34bd-4eab-8f96-051fedb98484 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:38.543377 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e217a0e4-34bd-4eab-8f96-051fedb98484 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:38.718800 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e217a0e4-34bd-4eab-8f96-051fedb98484 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:24:38.727738 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e217a0e4-34bd-4eab-8f96-051fedb98484 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1516 microversion: 2.1 time: 0.197640 Jun 10 19:24:38.728672 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4639/8261] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:24:38 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1516 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:24:38.796646 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-2424f7c7-8b92-4ead-b181-5bebc43a723e req-5d411cda-754c-46df-a36b-01e1a16230ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dd30fb7-5147-4c00-b684-02d01de15c51", "name": "network-vif-unplugged", "status": "completed", "tag": "b363a6af-4d48-4393-9313-b79553bd2bd4"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:24:38.805872 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-2424f7c7-8b92-4ead-b181-5bebc43a723e req-5d411cda-754c-46df-a36b-01e1a16230ee service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:38.821606 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-2424f7c7-8b92-4ead-b181-5bebc43a723e req-5d411cda-754c-46df-a36b-01e1a16230ee service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:38.821606 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.compute.server_external_events [req-2424f7c7-8b92-4ead-b181-5bebc43a723e req-5d411cda-754c-46df-a36b-01e1a16230ee service nova] Unable to find a host for instance 2dd30fb7-5147-4c00-b684-02d01de15c51. Dropping event network-vif-unplugged {{(pid=126595) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 10 19:24:38.821606 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-2424f7c7-8b92-4ead-b181-5bebc43a723e req-5d411cda-754c-46df-a36b-01e1a16230ee service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026762 Jun 10 19:24:38.821606 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4640/8262] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 10 19:24:39.745839 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d4847bcc-4c74-49b1-a86d-587c8e4a7119 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:24:39.746464 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d4847bcc-4c74-49b1-a86d-587c8e4a7119 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:24:39.753912 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d4847bcc-4c74-49b1-a86d-587c8e4a7119 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:39.754368 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d4847bcc-4c74-49b1-a86d-587c8e4a7119 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:39.755142 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d4847bcc-4c74-49b1-a86d-587c8e4a7119 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:39.755587 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d4847bcc-4c74-49b1-a86d-587c8e4a7119 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:39.889289 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d4847bcc-4c74-49b1-a86d-587c8e4a7119 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:24:39.896994 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d4847bcc-4c74-49b1-a86d-587c8e4a7119 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1518 microversion: 2.1 time: 0.155204 Jun 10 19:24:39.897567 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4641/8263] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:24:39 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:24:40.914329 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c2c7be61-25ef-4f0a-b7e4-51f2fe88cea4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:24:40.915022 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c2c7be61-25ef-4f0a-b7e4-51f2fe88cea4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:24:40.923110 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c2c7be61-25ef-4f0a-b7e4-51f2fe88cea4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:40.923568 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c2c7be61-25ef-4f0a-b7e4-51f2fe88cea4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:40.924527 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c2c7be61-25ef-4f0a-b7e4-51f2fe88cea4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:40.924827 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c2c7be61-25ef-4f0a-b7e4-51f2fe88cea4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:41.055642 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c2c7be61-25ef-4f0a-b7e4-51f2fe88cea4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:24:41.063963 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c2c7be61-25ef-4f0a-b7e4-51f2fe88cea4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1518 microversion: 2.1 time: 0.153559 Jun 10 19:24:41.064749 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4642/8264] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:24:40 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:24:42.081552 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b9e86be2-2d0b-43aa-84d7-fb793cbb6601 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:24:42.082211 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b9e86be2-2d0b-43aa-84d7-fb793cbb6601 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:24:42.089388 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9e86be2-2d0b-43aa-84d7-fb793cbb6601 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:42.089846 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9e86be2-2d0b-43aa-84d7-fb793cbb6601 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:42.090626 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9e86be2-2d0b-43aa-84d7-fb793cbb6601 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:42.091070 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b9e86be2-2d0b-43aa-84d7-fb793cbb6601 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:42.225027 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-b9e86be2-2d0b-43aa-84d7-fb793cbb6601 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:24:42.232791 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b9e86be2-2d0b-43aa-84d7-fb793cbb6601 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1518 microversion: 2.1 time: 0.155143 Jun 10 19:24:42.233372 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4643/8265] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:24:42 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:24:43.250509 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6cc3c35a-8307-4771-9b08-9b44a5c9c056 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:24:43.251199 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6cc3c35a-8307-4771-9b08-9b44a5c9c056 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:24:43.258167 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6cc3c35a-8307-4771-9b08-9b44a5c9c056 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:43.258616 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6cc3c35a-8307-4771-9b08-9b44a5c9c056 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:43.259415 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6cc3c35a-8307-4771-9b08-9b44a5c9c056 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:43.259854 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6cc3c35a-8307-4771-9b08-9b44a5c9c056 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:43.395845 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6cc3c35a-8307-4771-9b08-9b44a5c9c056 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:24:43.404017 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6cc3c35a-8307-4771-9b08-9b44a5c9c056 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1518 microversion: 2.1 time: 0.157407 Jun 10 19:24:43.404630 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4644/8266] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:24:43 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:24:44.421631 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-edf01d61-4621-4caa-9bda-bc9726449cad tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:24:44.422750 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-edf01d61-4621-4caa-9bda-bc9726449cad tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:24:44.429828 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-edf01d61-4621-4caa-9bda-bc9726449cad tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:44.430280 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-edf01d61-4621-4caa-9bda-bc9726449cad tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:44.431047 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-edf01d61-4621-4caa-9bda-bc9726449cad tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:44.431550 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-edf01d61-4621-4caa-9bda-bc9726449cad tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:44.571330 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-edf01d61-4621-4caa-9bda-bc9726449cad tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:24:44.579371 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-edf01d61-4621-4caa-9bda-bc9726449cad tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1518 microversion: 2.1 time: 0.161727 Jun 10 19:24:44.579963 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4645/8267] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:24:44 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:24:45.596979 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2049f544-bad3-4795-93c1-9f7a69313050 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:24:45.597623 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2049f544-bad3-4795-93c1-9f7a69313050 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:24:45.604421 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2049f544-bad3-4795-93c1-9f7a69313050 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:45.604868 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2049f544-bad3-4795-93c1-9f7a69313050 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:45.605634 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2049f544-bad3-4795-93c1-9f7a69313050 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:45.606075 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2049f544-bad3-4795-93c1-9f7a69313050 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:45.738500 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2049f544-bad3-4795-93c1-9f7a69313050 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:24:45.746623 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2049f544-bad3-4795-93c1-9f7a69313050 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1574 microversion: 2.1 time: 0.153520 Jun 10 19:24:45.747223 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4646/8268] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:24:45 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:24:46.400499 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-fd49f862-add5-413c-8f73-3a441edc6a77 req-61349111-ba8d-49f3-900f-ff4c477e9c3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dd30fb7-5147-4c00-b684-02d01de15c51", "tag": "b363a6af-4d48-4393-9313-b79553bd2bd4"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:24:46.409690 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-fd49f862-add5-413c-8f73-3a441edc6a77 req-61349111-ba8d-49f3-900f-ff4c477e9c3a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:46.410294 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-fd49f862-add5-413c-8f73-3a441edc6a77 req-61349111-ba8d-49f3-900f-ff4c477e9c3a service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:46.425226 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-fd49f862-add5-413c-8f73-3a441edc6a77 req-61349111-ba8d-49f3-900f-ff4c477e9c3a service nova] Creating event network-changed:b363a6af-4d48-4393-9313-b79553bd2bd4 for instance 2dd30fb7-5147-4c00-b684-02d01de15c51 on chh1-master-2 Jun 10 19:24:46.430771 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-fd49f862-add5-413c-8f73-3a441edc6a77 req-61349111-ba8d-49f3-900f-ff4c477e9c3a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038213 Jun 10 19:24:46.431815 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4647/8269] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:24:46.765147 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-72600dbd-c06f-4fe0-96b7-d6c9eaa742be tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:24:46.766509 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-72600dbd-c06f-4fe0-96b7-d6c9eaa742be tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:24:46.773625 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72600dbd-c06f-4fe0-96b7-d6c9eaa742be tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:46.774080 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72600dbd-c06f-4fe0-96b7-d6c9eaa742be tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:46.774851 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72600dbd-c06f-4fe0-96b7-d6c9eaa742be tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:46.775293 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-72600dbd-c06f-4fe0-96b7-d6c9eaa742be tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:46.913161 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-72600dbd-c06f-4fe0-96b7-d6c9eaa742be tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:24:46.920921 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-72600dbd-c06f-4fe0-96b7-d6c9eaa742be tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1574 microversion: 2.1 time: 0.160041 Jun 10 19:24:46.921507 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4648/8270] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:24:46 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:24:47.938028 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6be6156d-7532-4ded-b351-94f42318471e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:24:47.938638 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6be6156d-7532-4ded-b351-94f42318471e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:24:47.945510 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6be6156d-7532-4ded-b351-94f42318471e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:47.945970 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6be6156d-7532-4ded-b351-94f42318471e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:47.946735 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6be6156d-7532-4ded-b351-94f42318471e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:47.947176 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6be6156d-7532-4ded-b351-94f42318471e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:48.074723 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6be6156d-7532-4ded-b351-94f42318471e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:24:48.082857 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6be6156d-7532-4ded-b351-94f42318471e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1574 microversion: 2.1 time: 0.148819 Jun 10 19:24:48.083434 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4649/8271] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:24:47 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:24:49.100940 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-99351e64-3571-4e0c-98fe-6e2f1f8d1ba9 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:24:49.101554 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-99351e64-3571-4e0c-98fe-6e2f1f8d1ba9 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:24:49.108565 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99351e64-3571-4e0c-98fe-6e2f1f8d1ba9 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:49.109014 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99351e64-3571-4e0c-98fe-6e2f1f8d1ba9 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:49.109820 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99351e64-3571-4e0c-98fe-6e2f1f8d1ba9 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:49.110256 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-99351e64-3571-4e0c-98fe-6e2f1f8d1ba9 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:49.246424 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-99351e64-3571-4e0c-98fe-6e2f1f8d1ba9 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:24:49.254702 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-99351e64-3571-4e0c-98fe-6e2f1f8d1ba9 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1574 microversion: 2.1 time: 0.157622 Jun 10 19:24:49.255282 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4650/8272] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:24:49 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:24:50.272733 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bd990277-2426-4660-915f-8f4282944c19 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:24:50.273373 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bd990277-2426-4660-915f-8f4282944c19 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:24:50.276198 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=61 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:24:50.281159 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bd990277-2426-4660-915f-8f4282944c19 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:50.281621 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bd990277-2426-4660-915f-8f4282944c19 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:50.282395 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bd990277-2426-4660-915f-8f4282944c19 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:50.282842 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bd990277-2426-4660-915f-8f4282944c19 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:50.421150 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bd990277-2426-4660-915f-8f4282944c19 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:24:50.429370 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bd990277-2426-4660-915f-8f4282944c19 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1574 microversion: 2.1 time: 0.160532 Jun 10 19:24:50.429949 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4651/8273] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:24:50 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:24:51.447193 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5de0c79c-0d59-404f-b999-c3df6cf95044 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:24:51.447807 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5de0c79c-0d59-404f-b999-c3df6cf95044 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:24:51.454199 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5de0c79c-0d59-404f-b999-c3df6cf95044 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:51.454653 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5de0c79c-0d59-404f-b999-c3df6cf95044 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:51.455424 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5de0c79c-0d59-404f-b999-c3df6cf95044 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:51.455863 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5de0c79c-0d59-404f-b999-c3df6cf95044 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:51.583502 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5de0c79c-0d59-404f-b999-c3df6cf95044 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:24:51.591335 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5de0c79c-0d59-404f-b999-c3df6cf95044 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1574 microversion: 2.1 time: 0.148295 Jun 10 19:24:51.591908 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4652/8274] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:24:51 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:24:52.609722 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9103e41f-ad28-4f21-bdff-7d12c755ec11 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:24:52.610391 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9103e41f-ad28-4f21-bdff-7d12c755ec11 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:24:52.617301 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9103e41f-ad28-4f21-bdff-7d12c755ec11 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:52.617755 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9103e41f-ad28-4f21-bdff-7d12c755ec11 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:52.618523 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9103e41f-ad28-4f21-bdff-7d12c755ec11 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:52.618971 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9103e41f-ad28-4f21-bdff-7d12c755ec11 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:52.638534 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:24:52.756120 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9103e41f-ad28-4f21-bdff-7d12c755ec11 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:24:52.763693 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9103e41f-ad28-4f21-bdff-7d12c755ec11 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1574 microversion: 2.1 time: 0.158694 Jun 10 19:24:52.764279 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4653/8275] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:24:52 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:24:53.780677 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-00c62337-bd3c-4277-9fcd-04917340ceb0 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:24:53.786017 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-00c62337-bd3c-4277-9fcd-04917340ceb0 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:24:53.788786 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-00c62337-bd3c-4277-9fcd-04917340ceb0 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:53.789237 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-00c62337-bd3c-4277-9fcd-04917340ceb0 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:53.790002 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-00c62337-bd3c-4277-9fcd-04917340ceb0 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:53.790442 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-00c62337-bd3c-4277-9fcd-04917340ceb0 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:53.922045 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-00c62337-bd3c-4277-9fcd-04917340ceb0 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:24:53.929602 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-00c62337-bd3c-4277-9fcd-04917340ceb0 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1574 microversion: 2.1 time: 0.153357 Jun 10 19:24:53.930167 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4654/8276] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:24:53 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:24:54.946979 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6bc2993f-86b8-4379-a902-a8a32ac53928 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:24:54.947603 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6bc2993f-86b8-4379-a902-a8a32ac53928 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:24:54.954968 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6bc2993f-86b8-4379-a902-a8a32ac53928 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:54.955428 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6bc2993f-86b8-4379-a902-a8a32ac53928 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:54.956202 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6bc2993f-86b8-4379-a902-a8a32ac53928 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:54.956681 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6bc2993f-86b8-4379-a902-a8a32ac53928 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:55.087500 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6bc2993f-86b8-4379-a902-a8a32ac53928 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:24:55.095711 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6bc2993f-86b8-4379-a902-a8a32ac53928 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1574 microversion: 2.1 time: 0.152681 Jun 10 19:24:55.096294 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4655/8277] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:24:54 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:24:56.113345 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-022a5a98-4191-4472-b6a5-a1666eb01b0b tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:24:56.114045 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-022a5a98-4191-4472-b6a5-a1666eb01b0b tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:24:56.120902 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-022a5a98-4191-4472-b6a5-a1666eb01b0b tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:56.121359 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-022a5a98-4191-4472-b6a5-a1666eb01b0b tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:56.122125 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-022a5a98-4191-4472-b6a5-a1666eb01b0b tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:56.122566 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-022a5a98-4191-4472-b6a5-a1666eb01b0b tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:56.264150 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-022a5a98-4191-4472-b6a5-a1666eb01b0b tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:24:56.271638 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-022a5a98-4191-4472-b6a5-a1666eb01b0b tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1574 microversion: 2.1 time: 0.162771 Jun 10 19:24:56.272208 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4656/8278] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:24:56 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:24:57.288143 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-0fd274e3-8197-4949-b5bf-7efeae6d981e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:24:57.288843 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-0fd274e3-8197-4949-b5bf-7efeae6d981e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:24:57.295795 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0fd274e3-8197-4949-b5bf-7efeae6d981e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:57.296246 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0fd274e3-8197-4949-b5bf-7efeae6d981e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:57.297548 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0fd274e3-8197-4949-b5bf-7efeae6d981e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:57.297983 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-0fd274e3-8197-4949-b5bf-7efeae6d981e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:57.431052 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-0fd274e3-8197-4949-b5bf-7efeae6d981e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:24:57.438765 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-0fd274e3-8197-4949-b5bf-7efeae6d981e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1574 microversion: 2.1 time: 0.154629 Jun 10 19:24:57.439336 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4657/8279] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:24:57 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:24:57.443636 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-1134f95d-8325-4590-b50a-30a6d1c4ab74 req-6693be5d-af44-45f5-89e0-e481ce33550d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dd30fb7-5147-4c00-b684-02d01de15c51", "name": "network-vif-plugged", "status": "completed", "tag": "b363a6af-4d48-4393-9313-b79553bd2bd4"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:24:57.451405 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-1134f95d-8325-4590-b50a-30a6d1c4ab74 req-6693be5d-af44-45f5-89e0-e481ce33550d service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:57.451894 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-1134f95d-8325-4590-b50a-30a6d1c4ab74 req-6693be5d-af44-45f5-89e0-e481ce33550d service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:57.466355 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-1134f95d-8325-4590-b50a-30a6d1c4ab74 req-6693be5d-af44-45f5-89e0-e481ce33550d service nova] Creating event network-vif-plugged:b363a6af-4d48-4393-9313-b79553bd2bd4 for instance 2dd30fb7-5147-4c00-b684-02d01de15c51 on chh1-master-2 Jun 10 19:24:57.471983 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-1134f95d-8325-4590-b50a-30a6d1c4ab74 req-6693be5d-af44-45f5-89e0-e481ce33550d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031532 Jun 10 19:24:57.472618 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4658/8280] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:24:58.457418 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bab2c502-2543-449e-90f0-76f10062c98c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:24:58.458116 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bab2c502-2543-449e-90f0-76f10062c98c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:24:58.464738 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bab2c502-2543-449e-90f0-76f10062c98c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:58.465185 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bab2c502-2543-449e-90f0-76f10062c98c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:58.465943 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bab2c502-2543-449e-90f0-76f10062c98c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:58.466377 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bab2c502-2543-449e-90f0-76f10062c98c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:58.603597 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bab2c502-2543-449e-90f0-76f10062c98c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:24:58.611937 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bab2c502-2543-449e-90f0-76f10062c98c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1574 microversion: 2.1 time: 0.160265 Jun 10 19:24:58.612800 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4659/8281] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:24:58 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:24:59.629600 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-54a456d0-3780-4e85-a64a-7b7cdb4f9aae tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:24:59.630220 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-54a456d0-3780-4e85-a64a-7b7cdb4f9aae tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:24:59.637230 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-54a456d0-3780-4e85-a64a-7b7cdb4f9aae tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:59.637685 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-54a456d0-3780-4e85-a64a-7b7cdb4f9aae tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:59.638446 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-54a456d0-3780-4e85-a64a-7b7cdb4f9aae tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:24:59.638896 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-54a456d0-3780-4e85-a64a-7b7cdb4f9aae tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:24:59.766922 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-54a456d0-3780-4e85-a64a-7b7cdb4f9aae tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:24:59.774441 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-54a456d0-3780-4e85-a64a-7b7cdb4f9aae tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1561 microversion: 2.1 time: 0.149326 Jun 10 19:24:59.775013 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4660/8282] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:24:59 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:26:37.136624 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-10d68ac2-3060-4a92-a249-35c62a6d90d4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:26:37.137413 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-10d68ac2-3060-4a92-a249-35c62a6d90d4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:26:37.139366 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=19 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:26:37.140028 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=40 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:26:37.145087 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10d68ac2-3060-4a92-a249-35c62a6d90d4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:26:37.145552 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10d68ac2-3060-4a92-a249-35c62a6d90d4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:26:37.146341 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10d68ac2-3060-4a92-a249-35c62a6d90d4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:26:37.146784 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-10d68ac2-3060-4a92-a249-35c62a6d90d4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:26:37.174380 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-10d68ac2-3060-4a92-a249-35c62a6d90d4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 19:26:37.488793 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-10d68ac2-3060-4a92-a249-35c62a6d90d4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "DELETE /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 204 len: 0 microversion: 2.1 time: 0.357323 Jun 10 19:26:37.489400 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4661/8283] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 19:26:37 2022] DELETE /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 19:26:37.608934 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-ac8cce7d-4709-4bf5-b471-e516861b2b94 req-cfc30bc1-b46a-4813-b46c-e6598806b3ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dd30fb7-5147-4c00-b684-02d01de15c51", "tag": "b363a6af-4d48-4393-9313-b79553bd2bd4"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:26:37.617186 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-ac8cce7d-4709-4bf5-b471-e516861b2b94 req-cfc30bc1-b46a-4813-b46c-e6598806b3ce service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:26:37.617579 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-ac8cce7d-4709-4bf5-b471-e516861b2b94 req-cfc30bc1-b46a-4813-b46c-e6598806b3ce service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:26:37.629361 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-ac8cce7d-4709-4bf5-b471-e516861b2b94 req-cfc30bc1-b46a-4813-b46c-e6598806b3ce service nova] Creating event network-changed:b363a6af-4d48-4393-9313-b79553bd2bd4 for instance 2dd30fb7-5147-4c00-b684-02d01de15c51 on chh1-master-2 Jun 10 19:26:37.634538 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-ac8cce7d-4709-4bf5-b471-e516861b2b94 req-cfc30bc1-b46a-4813-b46c-e6598806b3ce service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143616 Jun 10 19:26:37.635144 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4662/8284] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:26:37.640846 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-076c4dda-efe1-4238-bbf8-ab7965a7e825 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:26:37.641534 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-076c4dda-efe1-4238-bbf8-ab7965a7e825 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:26:37.649088 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-076c4dda-efe1-4238-bbf8-ab7965a7e825 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:26:37.649537 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-076c4dda-efe1-4238-bbf8-ab7965a7e825 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:26:37.650307 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-076c4dda-efe1-4238-bbf8-ab7965a7e825 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:26:37.650744 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-076c4dda-efe1-4238-bbf8-ab7965a7e825 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:26:37.844864 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-076c4dda-efe1-4238-bbf8-ab7965a7e825 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:26:37.852517 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-076c4dda-efe1-4238-bbf8-ab7965a7e825 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1567 microversion: 2.1 time: 0.216212 Jun 10 19:26:37.853115 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4663/8285] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:26:37 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1567 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:26:38.869862 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-557871a8-0c1a-48c0-938f-7c541f62e992 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:26:38.870460 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-557871a8-0c1a-48c0-938f-7c541f62e992 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:26:38.877814 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-557871a8-0c1a-48c0-938f-7c541f62e992 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:26:38.878599 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-557871a8-0c1a-48c0-938f-7c541f62e992 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:26:38.879658 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-557871a8-0c1a-48c0-938f-7c541f62e992 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:26:38.880096 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-557871a8-0c1a-48c0-938f-7c541f62e992 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:26:39.085466 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-557871a8-0c1a-48c0-938f-7c541f62e992 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:26:39.094511 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-557871a8-0c1a-48c0-938f-7c541f62e992 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1567 microversion: 2.1 time: 0.228507 Jun 10 19:26:39.095255 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4664/8286] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:26:38 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1567 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:26:39.598808 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-d699d785-152b-4300-b210-67a226816065 req-36f06422-f20a-404c-92b9-febc59f5b1d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dd30fb7-5147-4c00-b684-02d01de15c51", "name": "network-vif-deleted", "tag": "b363a6af-4d48-4393-9313-b79553bd2bd4"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:26:39.606991 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-d699d785-152b-4300-b210-67a226816065 req-36f06422-f20a-404c-92b9-febc59f5b1d1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:26:39.608824 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-d699d785-152b-4300-b210-67a226816065 req-36f06422-f20a-404c-92b9-febc59f5b1d1 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:26:39.621236 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-d699d785-152b-4300-b210-67a226816065 req-36f06422-f20a-404c-92b9-febc59f5b1d1 service nova] Creating event network-vif-deleted:b363a6af-4d48-4393-9313-b79553bd2bd4 for instance 2dd30fb7-5147-4c00-b684-02d01de15c51 on chh1-master-2 Jun 10 19:26:39.626157 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-d699d785-152b-4300-b210-67a226816065 req-36f06422-f20a-404c-92b9-febc59f5b1d1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031056 Jun 10 19:26:39.626763 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4665/8287] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:26:40.113282 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-af7c12c8-8a48-4dca-9efc-f00030829ac2 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:26:40.113901 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-af7c12c8-8a48-4dca-9efc-f00030829ac2 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:26:40.120334 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-af7c12c8-8a48-4dca-9efc-f00030829ac2 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:26:40.120806 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-af7c12c8-8a48-4dca-9efc-f00030829ac2 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:26:40.121580 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-af7c12c8-8a48-4dca-9efc-f00030829ac2 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:26:40.122050 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-af7c12c8-8a48-4dca-9efc-f00030829ac2 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:26:40.185317 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-af7c12c8-8a48-4dca-9efc-f00030829ac2 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:26:40.193111 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-af7c12c8-8a48-4dca-9efc-f00030829ac2 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1218 microversion: 2.1 time: 0.085077 Jun 10 19:26:40.193683 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4666/8288] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:26:40 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:26:41.210933 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-1473bb7e-8eb7-4611-9b0e-7d938991911c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:26:41.219599 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-1473bb7e-8eb7-4611-9b0e-7d938991911c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:26:41.219599 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1473bb7e-8eb7-4611-9b0e-7d938991911c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:26:41.219801 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1473bb7e-8eb7-4611-9b0e-7d938991911c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:26:41.220515 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1473bb7e-8eb7-4611-9b0e-7d938991911c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:26:41.220963 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-1473bb7e-8eb7-4611-9b0e-7d938991911c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:26:41.284636 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-1473bb7e-8eb7-4611-9b0e-7d938991911c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:26:41.293319 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-1473bb7e-8eb7-4611-9b0e-7d938991911c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1218 microversion: 2.1 time: 0.085953 Jun 10 19:26:41.297756 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4667/8289] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:26:41 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:26:42.311114 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3a304e1b-57d7-4c46-8964-d31064609f94 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:26:42.311775 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3a304e1b-57d7-4c46-8964-d31064609f94 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:26:42.318813 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3a304e1b-57d7-4c46-8964-d31064609f94 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:26:42.319276 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3a304e1b-57d7-4c46-8964-d31064609f94 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:26:42.320052 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3a304e1b-57d7-4c46-8964-d31064609f94 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:26:42.320533 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-3a304e1b-57d7-4c46-8964-d31064609f94 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:26:42.383499 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3a304e1b-57d7-4c46-8964-d31064609f94 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:26:42.391228 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3a304e1b-57d7-4c46-8964-d31064609f94 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1218 microversion: 2.1 time: 0.084716 Jun 10 19:26:42.391805 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4668/8290] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:26:42 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:26:43.407160 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9b1033ac-3669-41b2-927f-cb3ea80ab34c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:26:43.407809 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9b1033ac-3669-41b2-927f-cb3ea80ab34c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:26:43.415020 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b1033ac-3669-41b2-927f-cb3ea80ab34c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:26:43.415477 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b1033ac-3669-41b2-927f-cb3ea80ab34c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:26:43.416262 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b1033ac-3669-41b2-927f-cb3ea80ab34c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:26:43.416729 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9b1033ac-3669-41b2-927f-cb3ea80ab34c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:26:43.484603 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9b1033ac-3669-41b2-927f-cb3ea80ab34c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:26:43.492195 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9b1033ac-3669-41b2-927f-cb3ea80ab34c tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1218 microversion: 2.1 time: 0.088946 Jun 10 19:26:43.492839 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4669/8291] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:26:43 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:26:44.509443 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-012d97d0-0f08-4457-a119-132a2d621448 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:26:44.510082 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-012d97d0-0f08-4457-a119-132a2d621448 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:26:44.519645 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-012d97d0-0f08-4457-a119-132a2d621448 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:26:44.520101 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-012d97d0-0f08-4457-a119-132a2d621448 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:26:44.520927 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-012d97d0-0f08-4457-a119-132a2d621448 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:26:44.521369 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-012d97d0-0f08-4457-a119-132a2d621448 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:26:44.554837 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-012d97d0-0f08-4457-a119-132a2d621448 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:26:44.555297 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-012d97d0-0f08-4457-a119-132a2d621448 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:26:44.555757 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-012d97d0-0f08-4457-a119-132a2d621448 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lazy-loading 'fault' on Instance uuid 2dd30fb7-5147-4c00-b684-02d01de15c51 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 19:26:44.600020 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-012d97d0-0f08-4457-a119-132a2d621448 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '238d05aa801f4fc28fb7f123e423088b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c2a87044a24c708a5ffe9cbf789121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:26:44.607912 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-012d97d0-0f08-4457-a119-132a2d621448 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 200 len: 1223 microversion: 2.1 time: 0.102351 Jun 10 19:26:44.608497 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4670/8292] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:26:44 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 1223 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:26:45.627756 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f0e9aeae-8f55-44b3-9ade-1f5995efe72e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:26:45.628439 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f0e9aeae-8f55-44b3-9ade-1f5995efe72e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] [instance: 2dd30fb7-5147-4c00-b684-02d01de15c51] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:26:45.635243 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f0e9aeae-8f55-44b3-9ade-1f5995efe72e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:26:45.635711 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f0e9aeae-8f55-44b3-9ade-1f5995efe72e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:26:45.637128 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f0e9aeae-8f55-44b3-9ade-1f5995efe72e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:26:45.637560 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f0e9aeae-8f55-44b3-9ade-1f5995efe72e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:26:45.650873 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-f0e9aeae-8f55-44b3-9ade-1f5995efe72e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] HTTP exception thrown: Instance 2dd30fb7-5147-4c00-b684-02d01de15c51 could not be found. Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f0e9aeae-8f55-44b3-9ade-1f5995efe72e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Request method failure captured: Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 HTTP/1.1 Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5hzoQk6LzOQQ7g5Y04ow_WKp5MlNRBsHD2FsK2vZcd5mxwsipCOyDxQxdkNiRU4byQZWHxtcqEzY1vTsUCOPYK5DWvqRGyrXg8k2U70L1WZl121uftWLuLoOCrKzUjUtXbP1YSz14Kj_Jm_5PUYidZxWNvxNKG9EJvpKMq-vVke8Xg Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: b6c2a87044a24c708a5ffe9cbf789121 Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-TestShelveInstance-2141584632 Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/b6c2a87044a24c708a5ffe9cbf789121"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/b6c2a87044a24c708a5ffe9cbf789121"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/b6c2a87044a24c708a5ffe9cbf789121"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_b6c2a87044a24c708a5ffe9cbf789121", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-TestShelveInstance-2141584632 Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: b6c2a87044a24c708a5ffe9cbf789121 Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-TestShelveInstance-2141584632 Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-TestShelveInstance-2141584632-project Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 238d05aa801f4fc28fb7f123e423088b Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-TestShelveInstance-2141584632-project Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 2dd30fb7-5147-4c00-b684-02d01de15c51 could not be found. Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '2dd30fb7-5147-4c00-b684-02d01de15c51'} Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dd30fb7-5147-4c00-b684-02d01de15c51 could not be found. Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dd30fb7-5147-4c00-b684-02d01de15c51 could not be found. Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:26:45.652552 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:26:45.656248 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:26:45.656248 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:26:45.656248 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:26:45.656248 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 19:26:45.656248 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 19:26:45.656248 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dd30fb7-5147-4c00-b684-02d01de15c51 could not be found. Jun 10 19:26:45.656248 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:26:45.656248 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f0e9aeae-8f55-44b3-9ade-1f5995efe72e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Returning 404 to user: Instance 2dd30fb7-5147-4c00-b684-02d01de15c51 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 19:26:45.656248 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f0e9aeae-8f55-44b3-9ade-1f5995efe72e tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51" status: 404 len: 111 microversion: 2.1 time: 0.030213 Jun 10 19:26:45.656248 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4671/8293] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:26:45 2022] GET /compute/v2.1/servers/2dd30fb7-5147-4c00-b684-02d01de15c51 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 19:26:45.898015 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-56098a1b-90b5-4fbb-aa42-66ad5a1884b4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] Calling method '.version_select at 0x7f77c11c20d0>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:26:45.974145 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-56098a1b-90b5-4fbb-aa42-66ad5a1884b4 tempest-TestShelveInstance-2141584632 tempest-TestShelveInstance-2141584632-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-186950615" status: 202 len: 0 microversion: 2.1 time: 0.080316 Jun 10 19:26:45.974676 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4672/8294] 10.222.0.35 () {58 vars in 1250 bytes} [Fri Jun 10 19:26:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-186950615 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 19:27:07.163522 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:27:07.164333 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:27:07.340097 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-fd2ef930-65fb-41d9-8273-0c39b754ff50 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Action: 'create', calling method: .version_select at 0x7f77c12c3820>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1838860814", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCwZ6SvvZ6RKZdUsoZAkXyieu1iQwFjikpWEztdKsZzDecRn/4bbgAJXky2EgAG/dunHyybhKgRIYKJ402vYVk9AivKZTdjfyPlHXTA9zrrmb8RDiaoqfM4zjbAirz16A=="}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:27:07.359406 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-fd2ef930-65fb-41d9-8273-0c39b754ff50 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Getting quotas for project 769540e562e7414b8e7aa920e7933445. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 19:27:07.364834 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-fd2ef930-65fb-41d9-8273-0c39b754ff50 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Getting quotas for user 43d0111c191a4419a949c744ef9cf5b0 and project 769540e562e7414b8e7aa920e7933445. Resources: {'key_pairs'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 19:27:07.449029 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-fd2ef930-65fb-41d9-8273-0c39b754ff50 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.287215 Jun 10 19:27:07.449775 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4673/8295] 10.222.0.35 () {60 vars in 1158 bytes} [Fri Jun 10 19:27:07 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:27:10.093521 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e2083fdd-8b1e-45eb-b1bb-c4eba604b954 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-235387359", "imageRef": "efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1838860814", "security_groups": [{"name": "tempest-secgroup-smoke-449048121"}], "networks": [{"uuid": "f048eaea-3d99-4ca3-a611-ae703417873f"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:27:10.212035 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-e2083fdd-8b1e-45eb-b1bb-c4eba604b954 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] validate_networks() for [('f048eaea-3d99-4ca3-a611-ae703417873f', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 19:27:10.722799 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-e2083fdd-8b1e-45eb-b1bb-c4eba604b954 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 19:27:10.723234 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-e2083fdd-8b1e-45eb-b1bb-c4eba604b954 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 19:27:10.723721 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-e2083fdd-8b1e-45eb-b1bb-c4eba604b954 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 19:27:10.724138 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-e2083fdd-8b1e-45eb-b1bb-c4eba604b954 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 19:27:10.724583 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-e2083fdd-8b1e-45eb-b1bb-c4eba604b954 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 19:27:10.734302 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e2083fdd-8b1e-45eb-b1bb-c4eba604b954 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:27:10.734755 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e2083fdd-8b1e-45eb-b1bb-c4eba604b954 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:27:10.735565 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e2083fdd-8b1e-45eb-b1bb-c4eba604b954 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:27:10.736007 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e2083fdd-8b1e-45eb-b1bb-c4eba604b954 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:27:10.754289 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-e2083fdd-8b1e-45eb-b1bb-c4eba604b954 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Getting quotas for project 769540e562e7414b8e7aa920e7933445. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 19:27:10.759989 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-e2083fdd-8b1e-45eb-b1bb-c4eba604b954 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Getting quotas for user 43d0111c191a4419a949c744ef9cf5b0 and project 769540e562e7414b8e7aa920e7933445. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 19:27:10.773161 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e2083fdd-8b1e-45eb-b1bb-c4eba604b954 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 19:27:10.775479 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e2083fdd-8b1e-45eb-b1bb-c4eba604b954 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 91b499c7-3368-44ec-b095-ecbaf5dcd518] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efe7ee2e-1015-4a6d-bd9f-5944efcfa4e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 19:27:10.893677 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e2083fdd-8b1e-45eb-b1bb-c4eba604b954 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.804102 Jun 10 19:27:10.894344 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4674/8296] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 19:27:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 10 19:27:10.904104 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9f61a828-3157-4b3b-bb70-269003da1dc4 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:27:10.904746 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9f61a828-3157-4b3b-bb70-269003da1dc4 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 91b499c7-3368-44ec-b095-ecbaf5dcd518] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:27:10.958879 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9f61a828-3157-4b3b-bb70-269003da1dc4 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0111c191a4419a949c744ef9cf5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769540e562e7414b8e7aa920e7933445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:27:10.967075 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9f61a828-3157-4b3b-bb70-269003da1dc4 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "GET /compute/v2.1/servers/91b499c7-3368-44ec-b095-ecbaf5dcd518" status: 200 len: 1248 microversion: 2.1 time: 0.066813 Jun 10 19:27:10.967625 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4675/8297] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:27:10 2022] GET /compute/v2.1/servers/91b499c7-3368-44ec-b095-ecbaf5dcd518 => generated 1248 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:27:11.983878 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-3ea8e3a9-c008-4cff-b35b-92a694ef3c30 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:27:11.984549 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-3ea8e3a9-c008-4cff-b35b-92a694ef3c30 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 91b499c7-3368-44ec-b095-ecbaf5dcd518] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:27:12.043359 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-3ea8e3a9-c008-4cff-b35b-92a694ef3c30 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0111c191a4419a949c744ef9cf5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769540e562e7414b8e7aa920e7933445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:27:12.050278 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-3ea8e3a9-c008-4cff-b35b-92a694ef3c30 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "GET /compute/v2.1/servers/91b499c7-3368-44ec-b095-ecbaf5dcd518" status: 200 len: 1248 microversion: 2.1 time: 0.070383 Jun 10 19:27:12.050836 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4676/8298] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:27:11 2022] GET /compute/v2.1/servers/91b499c7-3368-44ec-b095-ecbaf5dcd518 => generated 1248 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:27:13.067827 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-03a1796c-9f1b-4d09-8ea4-b3f2af7feceb tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:27:13.068493 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-03a1796c-9f1b-4d09-8ea4-b3f2af7feceb tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 91b499c7-3368-44ec-b095-ecbaf5dcd518] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:27:13.077077 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03a1796c-9f1b-4d09-8ea4-b3f2af7feceb tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:27:13.077590 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03a1796c-9f1b-4d09-8ea4-b3f2af7feceb tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:27:13.078528 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03a1796c-9f1b-4d09-8ea4-b3f2af7feceb tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:27:13.078976 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03a1796c-9f1b-4d09-8ea4-b3f2af7feceb tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:27:13.140788 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-03a1796c-9f1b-4d09-8ea4-b3f2af7feceb tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0111c191a4419a949c744ef9cf5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769540e562e7414b8e7aa920e7933445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:27:13.148449 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-03a1796c-9f1b-4d09-8ea4-b3f2af7feceb tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "GET /compute/v2.1/servers/91b499c7-3368-44ec-b095-ecbaf5dcd518" status: 200 len: 1252 microversion: 2.1 time: 0.084962 Jun 10 19:27:13.149017 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4677/8299] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:27:13 2022] GET /compute/v2.1/servers/91b499c7-3368-44ec-b095-ecbaf5dcd518 => generated 1252 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:27:14.166142 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c79159b8-580b-4e91-b66b-3b9128ccc92d tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:27:14.166802 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c79159b8-580b-4e91-b66b-3b9128ccc92d tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 91b499c7-3368-44ec-b095-ecbaf5dcd518] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:27:14.173717 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c79159b8-580b-4e91-b66b-3b9128ccc92d tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:27:14.174168 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c79159b8-580b-4e91-b66b-3b9128ccc92d tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:27:14.174937 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c79159b8-580b-4e91-b66b-3b9128ccc92d tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:27:14.175374 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c79159b8-580b-4e91-b66b-3b9128ccc92d tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:27:14.242620 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-c79159b8-580b-4e91-b66b-3b9128ccc92d tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0111c191a4419a949c744ef9cf5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769540e562e7414b8e7aa920e7933445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:27:14.250861 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c79159b8-580b-4e91-b66b-3b9128ccc92d tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "GET /compute/v2.1/servers/91b499c7-3368-44ec-b095-ecbaf5dcd518" status: 200 len: 1308 microversion: 2.1 time: 0.089125 Jun 10 19:27:14.251453 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4678/8300] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:27:14 2022] GET /compute/v2.1/servers/91b499c7-3368-44ec-b095-ecbaf5dcd518 => generated 1308 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:27:15.268830 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-bfbde913-c48a-4661-9b22-a6d8130cca1c tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:27:15.269559 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-bfbde913-c48a-4661-9b22-a6d8130cca1c tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 91b499c7-3368-44ec-b095-ecbaf5dcd518] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:27:15.276684 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bfbde913-c48a-4661-9b22-a6d8130cca1c tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:27:15.277651 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bfbde913-c48a-4661-9b22-a6d8130cca1c tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:27:15.278430 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bfbde913-c48a-4661-9b22-a6d8130cca1c tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:27:15.278874 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-bfbde913-c48a-4661-9b22-a6d8130cca1c tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:27:15.415601 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-bfbde913-c48a-4661-9b22-a6d8130cca1c tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0111c191a4419a949c744ef9cf5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769540e562e7414b8e7aa920e7933445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:27:15.423165 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-bfbde913-c48a-4661-9b22-a6d8130cca1c tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "GET /compute/v2.1/servers/91b499c7-3368-44ec-b095-ecbaf5dcd518" status: 200 len: 1373 microversion: 2.1 time: 0.158395 Jun 10 19:27:15.423744 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4679/8301] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:27:15 2022] GET /compute/v2.1/servers/91b499c7-3368-44ec-b095-ecbaf5dcd518 => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:27:15.862326 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-1f5a6ea9-5ae4-4a8c-9461-28d464a90615 req-8ab697a1-b87e-42bc-92f3-3d62a3ec0d88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91b499c7-3368-44ec-b095-ecbaf5dcd518", "tag": "78c39584-de3b-4b12-a482-0cb05b2355ed"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:27:15.874808 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-1f5a6ea9-5ae4-4a8c-9461-28d464a90615 req-8ab697a1-b87e-42bc-92f3-3d62a3ec0d88 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:27:15.875263 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-1f5a6ea9-5ae4-4a8c-9461-28d464a90615 req-8ab697a1-b87e-42bc-92f3-3d62a3ec0d88 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:27:15.887015 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-1f5a6ea9-5ae4-4a8c-9461-28d464a90615 req-8ab697a1-b87e-42bc-92f3-3d62a3ec0d88 service nova] Creating event network-changed:78c39584-de3b-4b12-a482-0cb05b2355ed for instance 91b499c7-3368-44ec-b095-ecbaf5dcd518 on chh2-master-2 Jun 10 19:27:15.892140 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-1f5a6ea9-5ae4-4a8c-9461-28d464a90615 req-8ab697a1-b87e-42bc-92f3-3d62a3ec0d88 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045243 Jun 10 19:27:15.893281 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4680/8302] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:27:16.441928 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ea79ebde-4345-4364-ac9a-f840e143423b tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:27:16.442582 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ea79ebde-4345-4364-ac9a-f840e143423b tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 91b499c7-3368-44ec-b095-ecbaf5dcd518] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:27:16.449123 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ea79ebde-4345-4364-ac9a-f840e143423b tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:27:16.449614 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ea79ebde-4345-4364-ac9a-f840e143423b tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:27:16.450393 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ea79ebde-4345-4364-ac9a-f840e143423b tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:27:16.450835 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ea79ebde-4345-4364-ac9a-f840e143423b tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:27:16.595135 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ea79ebde-4345-4364-ac9a-f840e143423b tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0111c191a4419a949c744ef9cf5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769540e562e7414b8e7aa920e7933445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:27:16.603099 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ea79ebde-4345-4364-ac9a-f840e143423b tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "GET /compute/v2.1/servers/91b499c7-3368-44ec-b095-ecbaf5dcd518" status: 200 len: 1373 microversion: 2.1 time: 0.166424 Jun 10 19:27:16.603813 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4681/8303] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:27:16 2022] GET /compute/v2.1/servers/91b499c7-3368-44ec-b095-ecbaf5dcd518 => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:27:17.620562 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-905f5691-31c7-4a98-a685-3c522b29b469 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:27:17.621231 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-905f5691-31c7-4a98-a685-3c522b29b469 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 91b499c7-3368-44ec-b095-ecbaf5dcd518] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:27:17.628093 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-905f5691-31c7-4a98-a685-3c522b29b469 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:27:17.628585 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-905f5691-31c7-4a98-a685-3c522b29b469 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:27:17.629354 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-905f5691-31c7-4a98-a685-3c522b29b469 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:27:17.629797 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-905f5691-31c7-4a98-a685-3c522b29b469 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:27:17.762910 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-905f5691-31c7-4a98-a685-3c522b29b469 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0111c191a4419a949c744ef9cf5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769540e562e7414b8e7aa920e7933445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:27:17.771532 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-905f5691-31c7-4a98-a685-3c522b29b469 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "GET /compute/v2.1/servers/91b499c7-3368-44ec-b095-ecbaf5dcd518" status: 200 len: 1373 microversion: 2.1 time: 0.155020 Jun 10 19:27:17.772125 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4682/8304] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:27:17 2022] GET /compute/v2.1/servers/91b499c7-3368-44ec-b095-ecbaf5dcd518 => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:27:18.788834 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-cc849a33-f239-4028-8463-9c1b33587945 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:27:18.789492 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-cc849a33-f239-4028-8463-9c1b33587945 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 91b499c7-3368-44ec-b095-ecbaf5dcd518] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:27:18.796868 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc849a33-f239-4028-8463-9c1b33587945 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:27:18.797351 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc849a33-f239-4028-8463-9c1b33587945 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:27:18.798108 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc849a33-f239-4028-8463-9c1b33587945 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:27:18.798544 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-cc849a33-f239-4028-8463-9c1b33587945 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:27:18.935448 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-cc849a33-f239-4028-8463-9c1b33587945 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0111c191a4419a949c744ef9cf5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769540e562e7414b8e7aa920e7933445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:27:18.943094 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-cc849a33-f239-4028-8463-9c1b33587945 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "GET /compute/v2.1/servers/91b499c7-3368-44ec-b095-ecbaf5dcd518" status: 200 len: 1373 microversion: 2.1 time: 0.158422 Jun 10 19:27:18.943668 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4683/8305] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:27:18 2022] GET /compute/v2.1/servers/91b499c7-3368-44ec-b095-ecbaf5dcd518 => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:27:19.959390 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-5d964018-724d-4b16-9b18-5bb47724f20d tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:27:19.960032 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-5d964018-724d-4b16-9b18-5bb47724f20d tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 91b499c7-3368-44ec-b095-ecbaf5dcd518] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:27:19.967026 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5d964018-724d-4b16-9b18-5bb47724f20d tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:27:19.967478 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5d964018-724d-4b16-9b18-5bb47724f20d tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:27:19.968243 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5d964018-724d-4b16-9b18-5bb47724f20d tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:27:19.968709 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-5d964018-724d-4b16-9b18-5bb47724f20d tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:27:20.098248 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-5d964018-724d-4b16-9b18-5bb47724f20d tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0111c191a4419a949c744ef9cf5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769540e562e7414b8e7aa920e7933445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:27:20.106317 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-5d964018-724d-4b16-9b18-5bb47724f20d tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "GET /compute/v2.1/servers/91b499c7-3368-44ec-b095-ecbaf5dcd518" status: 200 len: 1373 microversion: 2.1 time: 0.151160 Jun 10 19:27:20.106887 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4684/8306] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:27:19 2022] GET /compute/v2.1/servers/91b499c7-3368-44ec-b095-ecbaf5dcd518 => generated 1373 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:27:21.123767 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-dcb389b5-75b4-4dfc-b8eb-098639841d93 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:27:21.124409 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-dcb389b5-75b4-4dfc-b8eb-098639841d93 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 91b499c7-3368-44ec-b095-ecbaf5dcd518] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:27:21.126467 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:27:21.132283 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dcb389b5-75b4-4dfc-b8eb-098639841d93 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:27:21.132823 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dcb389b5-75b4-4dfc-b8eb-098639841d93 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:27:21.133593 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dcb389b5-75b4-4dfc-b8eb-098639841d93 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:27:21.134035 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-dcb389b5-75b4-4dfc-b8eb-098639841d93 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:27:21.271571 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-dcb389b5-75b4-4dfc-b8eb-098639841d93 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0111c191a4419a949c744ef9cf5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769540e562e7414b8e7aa920e7933445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:27:21.279112 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-dcb389b5-75b4-4dfc-b8eb-098639841d93 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "GET /compute/v2.1/servers/91b499c7-3368-44ec-b095-ecbaf5dcd518" status: 200 len: 1373 microversion: 2.1 time: 0.159931 Jun 10 19:27:21.279687 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4685/8307] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:27:21 2022] GET /compute/v2.1/servers/91b499c7-3368-44ec-b095-ecbaf5dcd518 => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:27:22.296987 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-9d4fee3a-e726-4ae9-aaa9-84a245696df6 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:27:22.297638 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-9d4fee3a-e726-4ae9-aaa9-84a245696df6 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 91b499c7-3368-44ec-b095-ecbaf5dcd518] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:27:22.299465 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=14 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:27:22.305243 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9d4fee3a-e726-4ae9-aaa9-84a245696df6 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:27:22.305696 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9d4fee3a-e726-4ae9-aaa9-84a245696df6 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:27:22.306455 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9d4fee3a-e726-4ae9-aaa9-84a245696df6 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:27:22.306894 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-9d4fee3a-e726-4ae9-aaa9-84a245696df6 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:27:22.436209 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-9d4fee3a-e726-4ae9-aaa9-84a245696df6 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0111c191a4419a949c744ef9cf5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769540e562e7414b8e7aa920e7933445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:27:22.443728 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-9d4fee3a-e726-4ae9-aaa9-84a245696df6 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "GET /compute/v2.1/servers/91b499c7-3368-44ec-b095-ecbaf5dcd518" status: 200 len: 1373 microversion: 2.1 time: 0.151364 Jun 10 19:27:22.444291 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4686/8308] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:27:22 2022] GET /compute/v2.1/servers/91b499c7-3368-44ec-b095-ecbaf5dcd518 => generated 1373 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:27:23.461030 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-81167d98-e2d9-4d21-a7fe-ee2a15798ecb tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:27:23.461692 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-81167d98-e2d9-4d21-a7fe-ee2a15798ecb tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 91b499c7-3368-44ec-b095-ecbaf5dcd518] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:27:23.469346 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-81167d98-e2d9-4d21-a7fe-ee2a15798ecb tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:27:23.469808 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-81167d98-e2d9-4d21-a7fe-ee2a15798ecb tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:27:23.470585 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-81167d98-e2d9-4d21-a7fe-ee2a15798ecb tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:27:23.471021 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-81167d98-e2d9-4d21-a7fe-ee2a15798ecb tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:27:23.603942 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-81167d98-e2d9-4d21-a7fe-ee2a15798ecb tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0111c191a4419a949c744ef9cf5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769540e562e7414b8e7aa920e7933445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:27:23.611819 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-81167d98-e2d9-4d21-a7fe-ee2a15798ecb tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "GET /compute/v2.1/servers/91b499c7-3368-44ec-b095-ecbaf5dcd518" status: 200 len: 1373 microversion: 2.1 time: 0.154838 Jun 10 19:27:23.612445 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4687/8309] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:27:23 2022] GET /compute/v2.1/servers/91b499c7-3368-44ec-b095-ecbaf5dcd518 => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:27:23.670295 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-5ed3fd11-2962-4299-aeef-d0e439c8f603 req-7845cc20-7248-40c1-a4c9-23c79bba8e8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b499c7-3368-44ec-b095-ecbaf5dcd518", "name": "network-vif-plugged", "status": "completed", "tag": "78c39584-de3b-4b12-a482-0cb05b2355ed"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:27:23.678513 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-5ed3fd11-2962-4299-aeef-d0e439c8f603 req-7845cc20-7248-40c1-a4c9-23c79bba8e8d service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:27:23.678966 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-5ed3fd11-2962-4299-aeef-d0e439c8f603 req-7845cc20-7248-40c1-a4c9-23c79bba8e8d service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:27:23.694008 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-5ed3fd11-2962-4299-aeef-d0e439c8f603 req-7845cc20-7248-40c1-a4c9-23c79bba8e8d service nova] Creating event network-vif-plugged:78c39584-de3b-4b12-a482-0cb05b2355ed for instance 91b499c7-3368-44ec-b095-ecbaf5dcd518 on chh2-master-2 Jun 10 19:27:23.699963 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-5ed3fd11-2962-4299-aeef-d0e439c8f603 req-7845cc20-7248-40c1-a4c9-23c79bba8e8d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085763 Jun 10 19:27:23.700549 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4688/8310] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:27:24.629509 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d7e94ddd-38ae-43b0-acc1-60366c871ea3 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:27:24.630154 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d7e94ddd-38ae-43b0-acc1-60366c871ea3 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 91b499c7-3368-44ec-b095-ecbaf5dcd518] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:27:24.636471 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d7e94ddd-38ae-43b0-acc1-60366c871ea3 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:27:24.636928 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d7e94ddd-38ae-43b0-acc1-60366c871ea3 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:27:24.637691 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d7e94ddd-38ae-43b0-acc1-60366c871ea3 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:27:24.638133 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d7e94ddd-38ae-43b0-acc1-60366c871ea3 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:27:24.773008 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d7e94ddd-38ae-43b0-acc1-60366c871ea3 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0111c191a4419a949c744ef9cf5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769540e562e7414b8e7aa920e7933445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:27:24.781725 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d7e94ddd-38ae-43b0-acc1-60366c871ea3 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "GET /compute/v2.1/servers/91b499c7-3368-44ec-b095-ecbaf5dcd518" status: 200 len: 1373 microversion: 2.1 time: 0.157389 Jun 10 19:27:24.782302 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4689/8311] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:27:24 2022] GET /compute/v2.1/servers/91b499c7-3368-44ec-b095-ecbaf5dcd518 => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:27:25.798874 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8118606a-3437-447e-9ba7-e75dcfe1860a tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:27:25.799534 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8118606a-3437-447e-9ba7-e75dcfe1860a tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 91b499c7-3368-44ec-b095-ecbaf5dcd518] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:27:25.806477 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8118606a-3437-447e-9ba7-e75dcfe1860a tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:27:25.806931 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8118606a-3437-447e-9ba7-e75dcfe1860a tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:27:25.807705 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8118606a-3437-447e-9ba7-e75dcfe1860a tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:27:25.808148 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8118606a-3437-447e-9ba7-e75dcfe1860a tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:27:25.941309 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8118606a-3437-447e-9ba7-e75dcfe1860a tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0111c191a4419a949c744ef9cf5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769540e562e7414b8e7aa920e7933445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:27:25.948989 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8118606a-3437-447e-9ba7-e75dcfe1860a tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "GET /compute/v2.1/servers/91b499c7-3368-44ec-b095-ecbaf5dcd518" status: 200 len: 1559 microversion: 2.1 time: 0.154009 Jun 10 19:27:25.949568 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4690/8312] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:27:25 2022] GET /compute/v2.1/servers/91b499c7-3368-44ec-b095-ecbaf5dcd518 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:27:25.965594 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2e69d9d4-be96-4f5b-a934-267852358f61 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:27:25.966205 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2e69d9d4-be96-4f5b-a934-267852358f61 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 91b499c7-3368-44ec-b095-ecbaf5dcd518] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:27:25.971979 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e69d9d4-be96-4f5b-a934-267852358f61 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:27:25.972471 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e69d9d4-be96-4f5b-a934-267852358f61 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:27:25.973241 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e69d9d4-be96-4f5b-a934-267852358f61 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:27:25.973687 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e69d9d4-be96-4f5b-a934-267852358f61 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:27:26.106330 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2e69d9d4-be96-4f5b-a934-267852358f61 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0111c191a4419a949c744ef9cf5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769540e562e7414b8e7aa920e7933445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:27:26.113793 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2e69d9d4-be96-4f5b-a934-267852358f61 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "GET /compute/v2.1/servers/91b499c7-3368-44ec-b095-ecbaf5dcd518" status: 200 len: 1559 microversion: 2.1 time: 0.152292 Jun 10 19:27:26.114359 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4691/8313] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:27:25 2022] GET /compute/v2.1/servers/91b499c7-3368-44ec-b095-ecbaf5dcd518 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:27:28.516863 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-137d6b27-5c82-4c21-8371-e09db6e6374a req-97d16a53-cee4-47aa-8c52-942aaa9977c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91b499c7-3368-44ec-b095-ecbaf5dcd518", "tag": "78c39584-de3b-4b12-a482-0cb05b2355ed"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:27:28.524754 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-137d6b27-5c82-4c21-8371-e09db6e6374a req-97d16a53-cee4-47aa-8c52-942aaa9977c3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:27:28.525369 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-137d6b27-5c82-4c21-8371-e09db6e6374a req-97d16a53-cee4-47aa-8c52-942aaa9977c3 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:27:28.536283 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-137d6b27-5c82-4c21-8371-e09db6e6374a req-97d16a53-cee4-47aa-8c52-942aaa9977c3 service nova] Creating event network-changed:78c39584-de3b-4b12-a482-0cb05b2355ed for instance 91b499c7-3368-44ec-b095-ecbaf5dcd518 on chh2-master-2 Jun 10 19:27:28.541542 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-137d6b27-5c82-4c21-8371-e09db6e6374a req-97d16a53-cee4-47aa-8c52-942aaa9977c3 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084913 Jun 10 19:27:28.542136 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4692/8314] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:29:11.006867 chdv-master-2 devstack@n-api.service[126595]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 19:29:11.007651 chdv-master-2 devstack@n-api.service[126595]: Fri Jun 10 19:29:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 10 19:29:11.121174 chdv-master-2 devstack@n-api.service[126595]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 19:29:11.121369 chdv-master-2 devstack@n-api.service[126595]: Fri Jun 10 19:29:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 10 19:29:54.798921 chdv-master-2 devstack@n-api.service[126595]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cecfc05b-781c-4b87-9406-22ae5810c12d] AMQP server on 10.222.0.35:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 10 19:29:54.799722 chdv-master-2 devstack@n-api.service[126595]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0c5f50dc-ccde-4ae8-a3f3-fe46db0ef7f7] AMQP server on 10.222.0.35:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 10 19:29:54.800436 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:29:54.801174 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=86 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:29:54.805650 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-59ef30b2-3a23-4c7b-bfc1-fcf9549c62b5 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1935865556"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:29:54.806750 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-59ef30b2-3a23-4c7b-bfc1-fcf9549c62b5 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 91b499c7-3368-44ec-b095-ecbaf5dcd518] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:29:54.814093 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-59ef30b2-3a23-4c7b-bfc1-fcf9549c62b5 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:29:54.814545 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-59ef30b2-3a23-4c7b-bfc1-fcf9549c62b5 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:29:54.815298 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-59ef30b2-3a23-4c7b-bfc1-fcf9549c62b5 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:29:54.815737 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-59ef30b2-3a23-4c7b-bfc1-fcf9549c62b5 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:29:55.383724 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-59ef30b2-3a23-4c7b-bfc1-fcf9549c62b5 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "POST /compute/v2.1/servers/91b499c7-3368-44ec-b095-ecbaf5dcd518/action" status: 202 len: 0 microversion: 2.1 time: 0.586353 Jun 10 19:29:55.384386 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4693/8315] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 19:29:54 2022] POST /compute/v2.1/servers/91b499c7-3368-44ec-b095-ecbaf5dcd518/action => generated 0 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jun 10 19:30:02.533737 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-97d3cd27-9f78-4fce-95ca-f70852caf293 req-98310e6f-0dc0-4b88-ad81-d62a8036f375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b499c7-3368-44ec-b095-ecbaf5dcd518", "name": "network-vif-plugged", "status": "completed", "tag": "78c39584-de3b-4b12-a482-0cb05b2355ed"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:30:02.543534 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-97d3cd27-9f78-4fce-95ca-f70852caf293 req-98310e6f-0dc0-4b88-ad81-d62a8036f375 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:30:02.543986 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-97d3cd27-9f78-4fce-95ca-f70852caf293 req-98310e6f-0dc0-4b88-ad81-d62a8036f375 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:30:02.554932 chdv-master-2 devstack@n-api.service[126595]: INFO oslo.messaging._drivers.impl_rabbit [-] [0c5f50dc-ccde-4ae8-a3f3-fe46db0ef7f7] Reconnected to AMQP server on 10.222.0.35:5672 via [amqp] client with port 49476. Jun 10 19:30:02.556628 chdv-master-2 devstack@n-api.service[126595]: INFO oslo.messaging._drivers.impl_rabbit [-] [cecfc05b-781c-4b87-9406-22ae5810c12d] Reconnected to AMQP server on 10.222.0.35:5672 via [amqp] client with port 49474. Jun 10 19:30:02.558695 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-97d3cd27-9f78-4fce-95ca-f70852caf293 req-98310e6f-0dc0-4b88-ad81-d62a8036f375 service nova] Creating event network-vif-plugged:78c39584-de3b-4b12-a482-0cb05b2355ed for instance 91b499c7-3368-44ec-b095-ecbaf5dcd518 on chh2-master-2 Jun 10 19:30:02.563492 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-97d3cd27-9f78-4fce-95ca-f70852caf293 req-98310e6f-0dc0-4b88-ad81-d62a8036f375 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036444 Jun 10 19:30:02.564077 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4694/8316] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:30:18.223155 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:30:18.223927 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=14,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:30:18.228105 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-c089432b-72aa-4e94-8ddd-4be2d85ee6fc tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-2068148956", "imageRef": "7fdc7022-3c5a-4ccd-afb4-2ce746ca3050", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1838860814", "security_groups": [{"name": "tempest-secgroup-smoke-449048121"}], "networks": [{"uuid": "f048eaea-3d99-4ca3-a611-ae703417873f"}]}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:30:18.338598 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.network.neutron [None req-c089432b-72aa-4e94-8ddd-4be2d85ee6fc tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] validate_networks() for [('f048eaea-3d99-4ca3-a611-ae703417873f', None, None, None, None, None)] {{(pid=126595) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 10 19:30:18.716060 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-c089432b-72aa-4e94-8ddd-4be2d85ee6fc tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Flavor limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 10 19:30:18.716529 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-c089432b-72aa-4e94-8ddd-4be2d85ee6fc tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Image limits 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 10 19:30:18.717571 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-c089432b-72aa-4e94-8ddd-4be2d85ee6fc tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Flavor pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 10 19:30:18.718036 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-c089432b-72aa-4e94-8ddd-4be2d85ee6fc tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Image pref 0:0:0 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 10 19:30:18.718618 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.virt.hardware [None req-c089432b-72aa-4e94-8ddd-4be2d85ee6fc tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 10 19:30:18.727531 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c089432b-72aa-4e94-8ddd-4be2d85ee6fc tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:30:18.727980 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c089432b-72aa-4e94-8ddd-4be2d85ee6fc tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:30:18.728836 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c089432b-72aa-4e94-8ddd-4be2d85ee6fc tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:30:18.729276 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-c089432b-72aa-4e94-8ddd-4be2d85ee6fc tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:30:18.746603 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-c089432b-72aa-4e94-8ddd-4be2d85ee6fc tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Getting quotas for project 769540e562e7414b8e7aa920e7933445. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 10 19:30:18.751916 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.quota [None req-c089432b-72aa-4e94-8ddd-4be2d85ee6fc tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Getting quotas for user 43d0111c191a4419a949c744ef9cf5b0 and project 769540e562e7414b8e7aa920e7933445. Resources: {'instances', 'cores', 'ram'} {{(pid=126595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 10 19:30:18.764911 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c089432b-72aa-4e94-8ddd-4be2d85ee6fc tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Going to run 1 instances... {{(pid=126595) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 10 19:30:18.767412 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-c089432b-72aa-4e94-8ddd-4be2d85ee6fc tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 9106554b-2086-4e5a-80f2-70b200596316] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7fdc7022-3c5a-4ccd-afb4-2ce746ca3050',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 10 19:30:18.888726 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-c089432b-72aa-4e94-8ddd-4be2d85ee6fc tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.667147 Jun 10 19:30:18.889866 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4695/8317] 10.222.0.35 () {60 vars in 1146 bytes} [Fri Jun 10 19:30:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 10 19:30:18.899582 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-26d8f1f5-a1cf-41bd-9763-947be9cd2005 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:30:18.900238 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-26d8f1f5-a1cf-41bd-9763-947be9cd2005 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 9106554b-2086-4e5a-80f2-70b200596316] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:30:18.963951 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-26d8f1f5-a1cf-41bd-9763-947be9cd2005 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0111c191a4419a949c744ef9cf5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769540e562e7414b8e7aa920e7933445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:30:18.973780 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-26d8f1f5-a1cf-41bd-9763-947be9cd2005 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316" status: 200 len: 1249 microversion: 2.1 time: 0.077822 Jun 10 19:30:18.978656 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4696/8318] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:30:18 2022] GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316 => generated 1249 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:30:19.991413 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-33568736-96a1-41bb-ad93-d626fdba9050 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:30:19.992004 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-33568736-96a1-41bb-ad93-d626fdba9050 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 9106554b-2086-4e5a-80f2-70b200596316] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:30:19.999250 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-33568736-96a1-41bb-ad93-d626fdba9050 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:30:19.999708 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-33568736-96a1-41bb-ad93-d626fdba9050 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:30:20.000505 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-33568736-96a1-41bb-ad93-d626fdba9050 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:30:20.000942 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-33568736-96a1-41bb-ad93-d626fdba9050 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:30:20.063270 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-33568736-96a1-41bb-ad93-d626fdba9050 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0111c191a4419a949c744ef9cf5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769540e562e7414b8e7aa920e7933445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:30:20.070793 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-33568736-96a1-41bb-ad93-d626fdba9050 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316" status: 200 len: 1253 microversion: 2.1 time: 0.083259 Jun 10 19:30:20.071356 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4697/8319] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:30:19 2022] GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316 => generated 1253 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:30:21.088351 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ab772f6f-9924-4236-baf0-2645e83e406b tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:30:21.089022 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ab772f6f-9924-4236-baf0-2645e83e406b tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 9106554b-2086-4e5a-80f2-70b200596316] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:30:21.096271 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ab772f6f-9924-4236-baf0-2645e83e406b tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:30:21.096752 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ab772f6f-9924-4236-baf0-2645e83e406b tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:30:21.097514 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ab772f6f-9924-4236-baf0-2645e83e406b tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:30:21.097948 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ab772f6f-9924-4236-baf0-2645e83e406b tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:30:21.159454 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ab772f6f-9924-4236-baf0-2645e83e406b tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0111c191a4419a949c744ef9cf5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769540e562e7414b8e7aa920e7933445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:30:21.166920 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ab772f6f-9924-4236-baf0-2645e83e406b tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316" status: 200 len: 1253 microversion: 2.1 time: 0.082442 Jun 10 19:30:21.167477 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4698/8320] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:30:21 2022] GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316 => generated 1253 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:30:22.186079 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-4bc432c8-7eb0-4e45-9316-47aded3db4b7 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:30:22.187371 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-4bc432c8-7eb0-4e45-9316-47aded3db4b7 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 9106554b-2086-4e5a-80f2-70b200596316] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:30:22.196657 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4bc432c8-7eb0-4e45-9316-47aded3db4b7 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:30:22.198882 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4bc432c8-7eb0-4e45-9316-47aded3db4b7 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:30:22.198882 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4bc432c8-7eb0-4e45-9316-47aded3db4b7 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:30:22.198882 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-4bc432c8-7eb0-4e45-9316-47aded3db4b7 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:30:22.271213 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-4bc432c8-7eb0-4e45-9316-47aded3db4b7 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0111c191a4419a949c744ef9cf5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769540e562e7414b8e7aa920e7933445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:30:22.278941 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-4bc432c8-7eb0-4e45-9316-47aded3db4b7 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316" status: 200 len: 1319 microversion: 2.1 time: 0.098293 Jun 10 19:30:22.279746 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4699/8321] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:30:22 2022] GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316 => generated 1319 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:30:22.543782 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-3102a02f-d358-4307-a91b-4e132d856c9c req-b8327822-5593-4512-8367-01df64692fde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b499c7-3368-44ec-b095-ecbaf5dcd518", "name": "network-vif-unplugged", "status": "completed", "tag": "78c39584-de3b-4b12-a482-0cb05b2355ed"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:30:22.553271 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-3102a02f-d358-4307-a91b-4e132d856c9c req-b8327822-5593-4512-8367-01df64692fde service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:30:22.553724 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-3102a02f-d358-4307-a91b-4e132d856c9c req-b8327822-5593-4512-8367-01df64692fde service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:30:22.566211 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-3102a02f-d358-4307-a91b-4e132d856c9c req-b8327822-5593-4512-8367-01df64692fde service nova] Creating event network-vif-unplugged:78c39584-de3b-4b12-a482-0cb05b2355ed for instance 91b499c7-3368-44ec-b095-ecbaf5dcd518 on chh2-master-2 Jun 10 19:30:22.572725 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-3102a02f-d358-4307-a91b-4e132d856c9c req-b8327822-5593-4512-8367-01df64692fde service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032588 Jun 10 19:30:22.573377 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4700/8322] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:30:23.306595 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ad293aac-980e-4d21-b9cc-df7f11124ab4 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:30:23.307301 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-ad293aac-980e-4d21-b9cc-df7f11124ab4 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 9106554b-2086-4e5a-80f2-70b200596316] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:30:23.314524 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad293aac-980e-4d21-b9cc-df7f11124ab4 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:30:23.314976 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad293aac-980e-4d21-b9cc-df7f11124ab4 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:30:23.315950 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad293aac-980e-4d21-b9cc-df7f11124ab4 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:30:23.316428 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-ad293aac-980e-4d21-b9cc-df7f11124ab4 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:30:23.484982 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-ad293aac-980e-4d21-b9cc-df7f11124ab4 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0111c191a4419a949c744ef9cf5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769540e562e7414b8e7aa920e7933445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:30:23.493264 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ad293aac-980e-4d21-b9cc-df7f11124ab4 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316" status: 200 len: 1374 microversion: 2.1 time: 0.192201 Jun 10 19:30:23.494080 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4701/8323] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:30:23 2022] GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316 => generated 1374 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:30:24.510743 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-05f9f8d4-2133-42ef-9ee8-daffcea8e5c0 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:30:24.511375 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-05f9f8d4-2133-42ef-9ee8-daffcea8e5c0 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 9106554b-2086-4e5a-80f2-70b200596316] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:30:24.518819 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05f9f8d4-2133-42ef-9ee8-daffcea8e5c0 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:30:24.519281 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05f9f8d4-2133-42ef-9ee8-daffcea8e5c0 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:30:24.520333 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05f9f8d4-2133-42ef-9ee8-daffcea8e5c0 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:30:24.520938 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-05f9f8d4-2133-42ef-9ee8-daffcea8e5c0 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:30:24.671453 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-05f9f8d4-2133-42ef-9ee8-daffcea8e5c0 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0111c191a4419a949c744ef9cf5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769540e562e7414b8e7aa920e7933445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:30:24.679266 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-05f9f8d4-2133-42ef-9ee8-daffcea8e5c0 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316" status: 200 len: 1374 microversion: 2.1 time: 0.172405 Jun 10 19:30:24.679841 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4702/8324] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:30:24 2022] GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316 => generated 1374 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:30:25.696187 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-6cc72580-7712-4093-818e-bc383fecbb4a tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:30:25.696840 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-6cc72580-7712-4093-818e-bc383fecbb4a tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 9106554b-2086-4e5a-80f2-70b200596316] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:30:25.706404 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6cc72580-7712-4093-818e-bc383fecbb4a tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:30:25.707215 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6cc72580-7712-4093-818e-bc383fecbb4a tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:30:25.708029 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6cc72580-7712-4093-818e-bc383fecbb4a tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:30:25.708506 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-6cc72580-7712-4093-818e-bc383fecbb4a tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:30:25.855617 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-6cc72580-7712-4093-818e-bc383fecbb4a tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0111c191a4419a949c744ef9cf5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769540e562e7414b8e7aa920e7933445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:30:25.864397 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-6cc72580-7712-4093-818e-bc383fecbb4a tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316" status: 200 len: 1374 microversion: 2.1 time: 0.172130 Jun 10 19:30:25.865179 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4703/8325] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:30:25 2022] GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316 => generated 1374 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:30:26.883683 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-03083291-0788-40f3-bfcb-7e09d80e5984 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:30:26.884576 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-03083291-0788-40f3-bfcb-7e09d80e5984 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 9106554b-2086-4e5a-80f2-70b200596316] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:30:26.906770 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03083291-0788-40f3-bfcb-7e09d80e5984 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:30:26.907553 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03083291-0788-40f3-bfcb-7e09d80e5984 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:30:26.910563 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03083291-0788-40f3-bfcb-7e09d80e5984 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:30:26.912645 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-03083291-0788-40f3-bfcb-7e09d80e5984 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:30:27.074235 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-03083291-0788-40f3-bfcb-7e09d80e5984 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0111c191a4419a949c744ef9cf5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769540e562e7414b8e7aa920e7933445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:30:27.082931 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-03083291-0788-40f3-bfcb-7e09d80e5984 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316" status: 200 len: 1374 microversion: 2.1 time: 0.204549 Jun 10 19:30:27.085189 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4704/8326] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:30:26 2022] GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316 => generated 1374 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:30:28.103634 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-a96a22ef-d0ba-432c-93b2-06f2e09641c1 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:30:28.104462 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-a96a22ef-d0ba-432c-93b2-06f2e09641c1 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 9106554b-2086-4e5a-80f2-70b200596316] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:30:28.119255 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a96a22ef-d0ba-432c-93b2-06f2e09641c1 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:30:28.119714 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a96a22ef-d0ba-432c-93b2-06f2e09641c1 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:30:28.120557 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a96a22ef-d0ba-432c-93b2-06f2e09641c1 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:30:28.121006 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-a96a22ef-d0ba-432c-93b2-06f2e09641c1 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:30:28.286916 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-a96a22ef-d0ba-432c-93b2-06f2e09641c1 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0111c191a4419a949c744ef9cf5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769540e562e7414b8e7aa920e7933445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:30:28.296245 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-a96a22ef-d0ba-432c-93b2-06f2e09641c1 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316" status: 200 len: 1374 microversion: 2.1 time: 0.196321 Jun 10 19:30:28.297185 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4705/8327] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:30:28 2022] GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316 => generated 1374 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:30:29.314394 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2e1b1dd4-b22b-45c7-ba9f-cc96afc48b94 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:30:29.315141 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2e1b1dd4-b22b-45c7-ba9f-cc96afc48b94 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 9106554b-2086-4e5a-80f2-70b200596316] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:30:29.320895 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=2 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:30:29.321647 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell0:SELECT=8 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:30:29.324130 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e1b1dd4-b22b-45c7-ba9f-cc96afc48b94 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:30:29.324636 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e1b1dd4-b22b-45c7-ba9f-cc96afc48b94 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:30:29.332271 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e1b1dd4-b22b-45c7-ba9f-cc96afc48b94 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:30:29.332271 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2e1b1dd4-b22b-45c7-ba9f-cc96afc48b94 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:30:29.474542 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2e1b1dd4-b22b-45c7-ba9f-cc96afc48b94 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0111c191a4419a949c744ef9cf5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769540e562e7414b8e7aa920e7933445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:30:29.484685 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2e1b1dd4-b22b-45c7-ba9f-cc96afc48b94 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316" status: 200 len: 1374 microversion: 2.1 time: 0.174656 Jun 10 19:30:29.485560 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4706/8328] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:30:29 2022] GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316 => generated 1374 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:30:30.501908 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-69b74a92-c092-4934-a6a9-6245c0cc95e4 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:30:30.502586 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-69b74a92-c092-4934-a6a9-6245c0cc95e4 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 9106554b-2086-4e5a-80f2-70b200596316] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:30:30.509514 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-69b74a92-c092-4934-a6a9-6245c0cc95e4 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:30:30.509969 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-69b74a92-c092-4934-a6a9-6245c0cc95e4 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:30:30.510742 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-69b74a92-c092-4934-a6a9-6245c0cc95e4 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:30:30.511183 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-69b74a92-c092-4934-a6a9-6245c0cc95e4 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:30:30.726742 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-69b74a92-c092-4934-a6a9-6245c0cc95e4 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0111c191a4419a949c744ef9cf5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769540e562e7414b8e7aa920e7933445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:30:30.734698 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-69b74a92-c092-4934-a6a9-6245c0cc95e4 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316" status: 200 len: 1374 microversion: 2.1 time: 0.236708 Jun 10 19:30:30.735288 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4707/8329] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:30:30 2022] GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316 => generated 1374 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:30:31.375262 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-cd32b8c3-5abf-4ddf-afa6-c12b75ce620b req-3cec40de-0e95-4ed9-87e5-5d0f396a3c28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9106554b-2086-4e5a-80f2-70b200596316", "tag": "f5812526-f519-4741-8cfd-30fe79d6fb42"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:30:31.382921 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-cd32b8c3-5abf-4ddf-afa6-c12b75ce620b req-3cec40de-0e95-4ed9-87e5-5d0f396a3c28 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:30:31.383725 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-cd32b8c3-5abf-4ddf-afa6-c12b75ce620b req-3cec40de-0e95-4ed9-87e5-5d0f396a3c28 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:30:31.399900 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-cd32b8c3-5abf-4ddf-afa6-c12b75ce620b req-3cec40de-0e95-4ed9-87e5-5d0f396a3c28 service nova] Creating event network-changed:f5812526-f519-4741-8cfd-30fe79d6fb42 for instance 9106554b-2086-4e5a-80f2-70b200596316 on chh1-master-2 Jun 10 19:30:31.405795 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-cd32b8c3-5abf-4ddf-afa6-c12b75ce620b req-3cec40de-0e95-4ed9-87e5-5d0f396a3c28 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038502 Jun 10 19:30:31.406431 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4708/8330] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:30:31.751920 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8c553300-158a-450a-8698-63a39458a3a7 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:30:31.752854 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8c553300-158a-450a-8698-63a39458a3a7 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 9106554b-2086-4e5a-80f2-70b200596316] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:30:31.760629 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8c553300-158a-450a-8698-63a39458a3a7 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:30:31.761094 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8c553300-158a-450a-8698-63a39458a3a7 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:30:31.761890 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8c553300-158a-450a-8698-63a39458a3a7 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:30:31.762337 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8c553300-158a-450a-8698-63a39458a3a7 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:30:31.983545 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8c553300-158a-450a-8698-63a39458a3a7 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0111c191a4419a949c744ef9cf5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769540e562e7414b8e7aa920e7933445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:30:31.991512 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8c553300-158a-450a-8698-63a39458a3a7 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316" status: 200 len: 1374 microversion: 2.1 time: 0.243908 Jun 10 19:30:31.992118 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4709/8331] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:30:31 2022] GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316 => generated 1374 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:30:33.009828 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2cf02bdb-0783-4ba1-b88e-27c70b4cba95 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:30:33.010497 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2cf02bdb-0783-4ba1-b88e-27c70b4cba95 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 9106554b-2086-4e5a-80f2-70b200596316] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:30:33.016608 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2cf02bdb-0783-4ba1-b88e-27c70b4cba95 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:30:33.017060 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2cf02bdb-0783-4ba1-b88e-27c70b4cba95 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:30:33.017818 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2cf02bdb-0783-4ba1-b88e-27c70b4cba95 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:30:33.018256 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2cf02bdb-0783-4ba1-b88e-27c70b4cba95 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:30:33.153178 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2cf02bdb-0783-4ba1-b88e-27c70b4cba95 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0111c191a4419a949c744ef9cf5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769540e562e7414b8e7aa920e7933445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:30:33.161529 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2cf02bdb-0783-4ba1-b88e-27c70b4cba95 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316" status: 200 len: 1374 microversion: 2.1 time: 0.155884 Jun 10 19:30:33.162107 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4710/8332] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:30:33 2022] GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316 => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:30:34.179892 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-54298fca-6957-4c4f-b8f1-2cf32f1f47f1 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:30:34.180529 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-54298fca-6957-4c4f-b8f1-2cf32f1f47f1 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 9106554b-2086-4e5a-80f2-70b200596316] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:30:34.188088 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-54298fca-6957-4c4f-b8f1-2cf32f1f47f1 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:30:34.188565 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-54298fca-6957-4c4f-b8f1-2cf32f1f47f1 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:30:34.189333 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-54298fca-6957-4c4f-b8f1-2cf32f1f47f1 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:30:34.189778 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-54298fca-6957-4c4f-b8f1-2cf32f1f47f1 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:30:34.318108 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-54298fca-6957-4c4f-b8f1-2cf32f1f47f1 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0111c191a4419a949c744ef9cf5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769540e562e7414b8e7aa920e7933445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:30:34.325629 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-54298fca-6957-4c4f-b8f1-2cf32f1f47f1 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316" status: 200 len: 1374 microversion: 2.1 time: 0.149640 Jun 10 19:30:34.326202 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4711/8333] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:30:34 2022] GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316 => generated 1374 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:30:35.342647 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-afeb0c3b-4998-4af2-a3f4-9e14aa55bff5 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:30:35.343300 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-afeb0c3b-4998-4af2-a3f4-9e14aa55bff5 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 9106554b-2086-4e5a-80f2-70b200596316] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:30:35.350225 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-afeb0c3b-4998-4af2-a3f4-9e14aa55bff5 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:30:35.350677 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-afeb0c3b-4998-4af2-a3f4-9e14aa55bff5 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:30:35.351440 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-afeb0c3b-4998-4af2-a3f4-9e14aa55bff5 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:30:35.351875 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-afeb0c3b-4998-4af2-a3f4-9e14aa55bff5 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:30:35.490666 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-afeb0c3b-4998-4af2-a3f4-9e14aa55bff5 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0111c191a4419a949c744ef9cf5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769540e562e7414b8e7aa920e7933445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:30:35.498119 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-afeb0c3b-4998-4af2-a3f4-9e14aa55bff5 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316" status: 200 len: 1374 microversion: 2.1 time: 0.159365 Jun 10 19:30:35.499333 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4712/8334] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:30:35 2022] GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316 => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:30:36.516283 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-06268155-1cdc-42d4-96a5-5f12b898aeb5 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:30:36.516966 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-06268155-1cdc-42d4-96a5-5f12b898aeb5 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 9106554b-2086-4e5a-80f2-70b200596316] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:30:36.523838 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-06268155-1cdc-42d4-96a5-5f12b898aeb5 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:30:36.524291 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-06268155-1cdc-42d4-96a5-5f12b898aeb5 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:30:36.525072 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-06268155-1cdc-42d4-96a5-5f12b898aeb5 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:30:36.525505 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-06268155-1cdc-42d4-96a5-5f12b898aeb5 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:30:36.653979 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-06268155-1cdc-42d4-96a5-5f12b898aeb5 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0111c191a4419a949c744ef9cf5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769540e562e7414b8e7aa920e7933445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:30:36.661572 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-06268155-1cdc-42d4-96a5-5f12b898aeb5 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316" status: 200 len: 1374 microversion: 2.1 time: 0.149666 Jun 10 19:30:36.662156 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4713/8335] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:30:36 2022] GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316 => generated 1374 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:30:36.890427 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-c24128b9-bf8c-416e-a6cf-0cc1388d3759 req-c73f2d73-b6e9-46df-a711-44f47a6edca7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9106554b-2086-4e5a-80f2-70b200596316", "name": "network-vif-plugged", "status": "completed", "tag": "f5812526-f519-4741-8cfd-30fe79d6fb42"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:30:36.898880 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-c24128b9-bf8c-416e-a6cf-0cc1388d3759 req-c73f2d73-b6e9-46df-a711-44f47a6edca7 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:30:36.899334 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-c24128b9-bf8c-416e-a6cf-0cc1388d3759 req-c73f2d73-b6e9-46df-a711-44f47a6edca7 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:30:36.910243 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-c24128b9-bf8c-416e-a6cf-0cc1388d3759 req-c73f2d73-b6e9-46df-a711-44f47a6edca7 service nova] Creating event network-vif-plugged:f5812526-f519-4741-8cfd-30fe79d6fb42 for instance 9106554b-2086-4e5a-80f2-70b200596316 on chh1-master-2 Jun 10 19:30:36.915142 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-c24128b9-bf8c-416e-a6cf-0cc1388d3759 req-c73f2d73-b6e9-46df-a711-44f47a6edca7 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029201 Jun 10 19:30:36.915766 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4714/8336] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:30:37.679723 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-d5775efd-ffb2-4ab3-bd3f-05d1531a1f92 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:30:37.680380 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-d5775efd-ffb2-4ab3-bd3f-05d1531a1f92 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 9106554b-2086-4e5a-80f2-70b200596316] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:30:37.686687 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d5775efd-ffb2-4ab3-bd3f-05d1531a1f92 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:30:37.687146 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d5775efd-ffb2-4ab3-bd3f-05d1531a1f92 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:30:37.687915 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d5775efd-ffb2-4ab3-bd3f-05d1531a1f92 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:30:37.688391 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-d5775efd-ffb2-4ab3-bd3f-05d1531a1f92 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:30:37.692520 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=100 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:30:37.824719 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-d5775efd-ffb2-4ab3-bd3f-05d1531a1f92 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0111c191a4419a949c744ef9cf5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769540e562e7414b8e7aa920e7933445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:30:37.833131 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-d5775efd-ffb2-4ab3-bd3f-05d1531a1f92 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316" status: 200 len: 1374 microversion: 2.1 time: 0.158704 Jun 10 19:30:37.833710 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4715/8337] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:30:37 2022] GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316 => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:30:38.850578 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e978082a-327b-4572-a807-e1213b951a38 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:30:38.851241 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e978082a-327b-4572-a807-e1213b951a38 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 9106554b-2086-4e5a-80f2-70b200596316] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:30:38.858059 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e978082a-327b-4572-a807-e1213b951a38 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:30:38.858507 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e978082a-327b-4572-a807-e1213b951a38 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:30:38.859282 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e978082a-327b-4572-a807-e1213b951a38 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:30:38.859696 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e978082a-327b-4572-a807-e1213b951a38 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:30:38.989698 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-e978082a-327b-4572-a807-e1213b951a38 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0111c191a4419a949c744ef9cf5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769540e562e7414b8e7aa920e7933445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:30:38.997303 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e978082a-327b-4572-a807-e1213b951a38 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316" status: 200 len: 1560 microversion: 2.1 time: 0.150592 Jun 10 19:30:38.998064 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4716/8338] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:30:38 2022] GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:30:39.013466 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-566ef8da-155e-4a55-bb9d-26b26e461ecf tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:30:39.014674 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-566ef8da-155e-4a55-bb9d-26b26e461ecf tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 9106554b-2086-4e5a-80f2-70b200596316] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:30:39.020623 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-566ef8da-155e-4a55-bb9d-26b26e461ecf tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:30:39.021076 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-566ef8da-155e-4a55-bb9d-26b26e461ecf tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:30:39.021831 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-566ef8da-155e-4a55-bb9d-26b26e461ecf tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:30:39.022266 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-566ef8da-155e-4a55-bb9d-26b26e461ecf tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:30:39.155550 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-566ef8da-155e-4a55-bb9d-26b26e461ecf tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0111c191a4419a949c744ef9cf5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769540e562e7414b8e7aa920e7933445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:30:39.163176 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-566ef8da-155e-4a55-bb9d-26b26e461ecf tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316" status: 200 len: 1560 microversion: 2.1 time: 0.153337 Jun 10 19:30:39.163751 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4717/8339] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:30:39 2022] GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:30:41.298390 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-c0bde014-98bb-433b-ab3c-f7dff992ae9e req-44782a17-26e8-4315-991b-a1589c10fef2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9106554b-2086-4e5a-80f2-70b200596316", "tag": "f5812526-f519-4741-8cfd-30fe79d6fb42"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:30:41.307802 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-c0bde014-98bb-433b-ab3c-f7dff992ae9e req-44782a17-26e8-4315-991b-a1589c10fef2 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:30:41.308259 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-c0bde014-98bb-433b-ab3c-f7dff992ae9e req-44782a17-26e8-4315-991b-a1589c10fef2 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:30:41.323947 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-c0bde014-98bb-433b-ab3c-f7dff992ae9e req-44782a17-26e8-4315-991b-a1589c10fef2 service nova] Creating event network-changed:f5812526-f519-4741-8cfd-30fe79d6fb42 for instance 9106554b-2086-4e5a-80f2-70b200596316 on chh1-master-2 Jun 10 19:30:41.329452 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-c0bde014-98bb-433b-ab3c-f7dff992ae9e req-44782a17-26e8-4315-991b-a1589c10fef2 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035527 Jun 10 19:30:41.330229 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4718/8340] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:32:08.488263 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:32:08.489037 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=18 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:32:08.554363 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-f3ab2361-e6f2-4aa1-a199-98120270e170 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1824738206"}} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:32:08.555547 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-f3ab2361-e6f2-4aa1-a199-98120270e170 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 9106554b-2086-4e5a-80f2-70b200596316] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:32:08.561826 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f3ab2361-e6f2-4aa1-a199-98120270e170 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:32:08.562279 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f3ab2361-e6f2-4aa1-a199-98120270e170 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:32:08.563046 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f3ab2361-e6f2-4aa1-a199-98120270e170 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:32:08.563485 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-f3ab2361-e6f2-4aa1-a199-98120270e170 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:32:09.117095 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-f3ab2361-e6f2-4aa1-a199-98120270e170 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "POST /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316/action" status: 202 len: 0 microversion: 2.1 time: 0.631204 Jun 10 19:32:09.117664 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4719/8341] 10.222.0.35 () {60 vars in 1277 bytes} [Fri Jun 10 19:32:08 2022] POST /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316/action => generated 0 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jun 10 19:32:13.282581 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-efaefdf8-cb63-4d42-a44c-f9fb3b4ec959 req-18861dde-9046-47e1-a0eb-778e9bc425e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9106554b-2086-4e5a-80f2-70b200596316", "name": "network-vif-plugged", "status": "completed", "tag": "f5812526-f519-4741-8cfd-30fe79d6fb42"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:32:13.298734 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-efaefdf8-cb63-4d42-a44c-f9fb3b4ec959 req-18861dde-9046-47e1-a0eb-778e9bc425e9 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:32:13.299199 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-efaefdf8-cb63-4d42-a44c-f9fb3b4ec959 req-18861dde-9046-47e1-a0eb-778e9bc425e9 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:32:13.321119 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-efaefdf8-cb63-4d42-a44c-f9fb3b4ec959 req-18861dde-9046-47e1-a0eb-778e9bc425e9 service nova] Creating event network-vif-plugged:f5812526-f519-4741-8cfd-30fe79d6fb42 for instance 9106554b-2086-4e5a-80f2-70b200596316 on chh1-master-2 Jun 10 19:32:13.330839 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-efaefdf8-cb63-4d42-a44c-f9fb3b4ec959 req-18861dde-9046-47e1-a0eb-778e9bc425e9 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056171 Jun 10 19:32:13.331698 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4720/8342] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:32:25.306504 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_api:SELECT=4 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:32:25.307260 chdv-master-2 devstack@n-api.service[126595]: DEBUG dbcounter [-] [126595] Writing DB stats nova_cell1:SELECT=14,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 19:32:25.311366 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-e14ae958-8c71-454e-9205-681f4e15b12e tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:32:25.312051 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e14ae958-8c71-454e-9205-681f4e15b12e tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 9106554b-2086-4e5a-80f2-70b200596316] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:32:25.319467 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e14ae958-8c71-454e-9205-681f4e15b12e tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:32:25.319467 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e14ae958-8c71-454e-9205-681f4e15b12e tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:32:25.319669 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e14ae958-8c71-454e-9205-681f4e15b12e tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:32:25.322040 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-e14ae958-8c71-454e-9205-681f4e15b12e tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:32:25.353639 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-e14ae958-8c71-454e-9205-681f4e15b12e tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 9106554b-2086-4e5a-80f2-70b200596316] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 19:32:25.641434 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-e14ae958-8c71-454e-9205-681f4e15b12e tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "DELETE /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316" status: 204 len: 0 microversion: 2.1 time: 0.336864 Jun 10 19:32:25.645112 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4721/8343] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 19:32:25 2022] DELETE /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 19:32:25.706473 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-a7110532-1758-4527-8551-603ae23b94ce req-683dc9ab-0e4e-423a-b127-5dae20c2b214 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9106554b-2086-4e5a-80f2-70b200596316", "tag": "f5812526-f519-4741-8cfd-30fe79d6fb42"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:32:25.714601 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-a7110532-1758-4527-8551-603ae23b94ce req-683dc9ab-0e4e-423a-b127-5dae20c2b214 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:32:25.715059 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-a7110532-1758-4527-8551-603ae23b94ce req-683dc9ab-0e4e-423a-b127-5dae20c2b214 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:32:25.726810 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-a7110532-1758-4527-8551-603ae23b94ce req-683dc9ab-0e4e-423a-b127-5dae20c2b214 service nova] Creating event network-changed:f5812526-f519-4741-8cfd-30fe79d6fb42 for instance 9106554b-2086-4e5a-80f2-70b200596316 on chh1-master-2 Jun 10 19:32:25.732058 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-a7110532-1758-4527-8551-603ae23b94ce req-683dc9ab-0e4e-423a-b127-5dae20c2b214 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088655 Jun 10 19:32:25.732692 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4722/8344] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:32:25.737689 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-2c6e26a0-b5bc-403a-92ac-8bee4d74211a tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:32:25.738417 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-2c6e26a0-b5bc-403a-92ac-8bee4d74211a tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 9106554b-2086-4e5a-80f2-70b200596316] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:32:25.744632 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c6e26a0-b5bc-403a-92ac-8bee4d74211a tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:32:25.745093 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c6e26a0-b5bc-403a-92ac-8bee4d74211a tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:32:25.745868 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c6e26a0-b5bc-403a-92ac-8bee4d74211a tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:32:25.746320 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-2c6e26a0-b5bc-403a-92ac-8bee4d74211a tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:32:25.880285 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-2c6e26a0-b5bc-403a-92ac-8bee4d74211a tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0111c191a4419a949c744ef9cf5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769540e562e7414b8e7aa920e7933445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:32:25.887851 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-2c6e26a0-b5bc-403a-92ac-8bee4d74211a tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316" status: 200 len: 1685 microversion: 2.1 time: 0.154042 Jun 10 19:32:25.888972 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4723/8345] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:32:25 2022] GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316 => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:32:26.905608 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8c31f326-4570-4729-a4e1-7483e0e773c3 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:32:26.906277 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8c31f326-4570-4729-a4e1-7483e0e773c3 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 9106554b-2086-4e5a-80f2-70b200596316] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:32:26.913127 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8c31f326-4570-4729-a4e1-7483e0e773c3 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:32:26.913579 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8c31f326-4570-4729-a4e1-7483e0e773c3 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:32:26.914331 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8c31f326-4570-4729-a4e1-7483e0e773c3 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:32:26.914768 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8c31f326-4570-4729-a4e1-7483e0e773c3 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:32:27.077691 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8c31f326-4570-4729-a4e1-7483e0e773c3 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0111c191a4419a949c744ef9cf5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769540e562e7414b8e7aa920e7933445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:32:27.085189 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8c31f326-4570-4729-a4e1-7483e0e773c3 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316" status: 200 len: 1685 microversion: 2.1 time: 0.183981 Jun 10 19:32:27.085758 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4724/8346] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:32:26 2022] GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316 => generated 1685 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:32:27.308233 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-27525789-4ac5-483d-a3ea-5683d0422678 req-5782b256-bfab-4d9e-9b56-605a2269ed88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9106554b-2086-4e5a-80f2-70b200596316", "name": "network-vif-unplugged", "status": "completed", "tag": "f5812526-f519-4741-8cfd-30fe79d6fb42"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:32:27.317320 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-27525789-4ac5-483d-a3ea-5683d0422678 req-5782b256-bfab-4d9e-9b56-605a2269ed88 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:32:27.324260 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-27525789-4ac5-483d-a3ea-5683d0422678 req-5782b256-bfab-4d9e-9b56-605a2269ed88 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:32:27.330787 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-27525789-4ac5-483d-a3ea-5683d0422678 req-5782b256-bfab-4d9e-9b56-605a2269ed88 service nova] Creating event network-vif-unplugged:f5812526-f519-4741-8cfd-30fe79d6fb42 for instance 9106554b-2086-4e5a-80f2-70b200596316 on chh1-master-2 Jun 10 19:32:27.336235 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-27525789-4ac5-483d-a3ea-5683d0422678 req-5782b256-bfab-4d9e-9b56-605a2269ed88 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087365 Jun 10 19:32:27.336974 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4725/8347] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:32:27.773127 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-85f4c01b-8b10-4065-9a51-5ef2db7f1d8a req-f2f79f20-30c3-4c98-b358-a3f94e640c31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9106554b-2086-4e5a-80f2-70b200596316", "name": "network-vif-deleted", "tag": "f5812526-f519-4741-8cfd-30fe79d6fb42"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:32:27.781560 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-85f4c01b-8b10-4065-9a51-5ef2db7f1d8a req-f2f79f20-30c3-4c98-b358-a3f94e640c31 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:32:27.785483 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-85f4c01b-8b10-4065-9a51-5ef2db7f1d8a req-f2f79f20-30c3-4c98-b358-a3f94e640c31 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:32:27.792884 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-85f4c01b-8b10-4065-9a51-5ef2db7f1d8a req-f2f79f20-30c3-4c98-b358-a3f94e640c31 service nova] Creating event network-vif-deleted:f5812526-f519-4741-8cfd-30fe79d6fb42 for instance 9106554b-2086-4e5a-80f2-70b200596316 on chh1-master-2 Jun 10 19:32:27.797790 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-85f4c01b-8b10-4065-9a51-5ef2db7f1d8a req-f2f79f20-30c3-4c98-b358-a3f94e640c31 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028717 Jun 10 19:32:27.798378 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4726/8348] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:32:28.103535 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-8e2915ad-f74a-48a2-80be-839684041b2a tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:32:28.104964 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-8e2915ad-f74a-48a2-80be-839684041b2a tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 9106554b-2086-4e5a-80f2-70b200596316] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:32:28.112847 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8e2915ad-f74a-48a2-80be-839684041b2a tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:32:28.116614 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8e2915ad-f74a-48a2-80be-839684041b2a tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:32:28.116614 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8e2915ad-f74a-48a2-80be-839684041b2a tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:32:28.116614 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8e2915ad-f74a-48a2-80be-839684041b2a tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:32:28.149660 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8e2915ad-f74a-48a2-80be-839684041b2a tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:32:28.150115 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-8e2915ad-f74a-48a2-80be-839684041b2a tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:32:28.150568 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.objects.instance [None req-8e2915ad-f74a-48a2-80be-839684041b2a tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lazy-loading 'fault' on Instance uuid 9106554b-2086-4e5a-80f2-70b200596316 {{(pid=126595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 10 19:32:28.199471 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-8e2915ad-f74a-48a2-80be-839684041b2a tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0111c191a4419a949c744ef9cf5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769540e562e7414b8e7aa920e7933445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:32:28.207130 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-8e2915ad-f74a-48a2-80be-839684041b2a tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316" status: 200 len: 1339 microversion: 2.1 time: 0.107767 Jun 10 19:32:28.207733 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4727/8349] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:32:28 2022] GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316 => generated 1339 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:32:29.225119 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-45d952da-16c3-4fa2-b260-c066e93dbf13 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:32:29.225759 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-45d952da-16c3-4fa2-b260-c066e93dbf13 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 9106554b-2086-4e5a-80f2-70b200596316] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:32:29.232698 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45d952da-16c3-4fa2-b260-c066e93dbf13 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:32:29.233156 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45d952da-16c3-4fa2-b260-c066e93dbf13 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:32:29.233919 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45d952da-16c3-4fa2-b260-c066e93dbf13 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:32:29.234367 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-45d952da-16c3-4fa2-b260-c066e93dbf13 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:32:29.247629 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-45d952da-16c3-4fa2-b260-c066e93dbf13 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] HTTP exception thrown: Instance 9106554b-2086-4e5a-80f2-70b200596316 could not be found. Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-45d952da-16c3-4fa2-b260-c066e93dbf13 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Request method failure captured: Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316 HTTP/1.1 Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5sEyLvw0DWTBjvHkql5H3qSscC17w8T04fBVruFlTwsQebIEWMjsKh5orPKaY51Lyg3sjA6WoOjptxaSFxQj_oNyulfZLRX4r3hvj7di4o0lLeeN5jGnGeSV0MEQXJovfeQm-ElncX4F5Fou9mT6pGaNv5m-MYxs2bl0uxkSKm95mk Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 769540e562e7414b8e7aa920e7933445 Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-TestSnapshotPattern-521552059 Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/769540e562e7414b8e7aa920e7933445"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/769540e562e7414b8e7aa920e7933445"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/769540e562e7414b8e7aa920e7933445"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_769540e562e7414b8e7aa920e7933445", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-TestSnapshotPattern-521552059 Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 769540e562e7414b8e7aa920e7933445 Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-TestSnapshotPattern-521552059 Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-TestSnapshotPattern-521552059-project Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 43d0111c191a4419a949c744ef9cf5b0 Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-TestSnapshotPattern-521552059-project Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 9106554b-2086-4e5a-80f2-70b200596316 could not be found. Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '9106554b-2086-4e5a-80f2-70b200596316'} Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9106554b-2086-4e5a-80f2-70b200596316 could not be found. Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9106554b-2086-4e5a-80f2-70b200596316 could not be found. Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:32:29.249811 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:32:29.254524 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:32:29.254524 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:32:29.254524 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:32:29.254524 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 19:32:29.254524 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 19:32:29.254524 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9106554b-2086-4e5a-80f2-70b200596316 could not be found. Jun 10 19:32:29.254524 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:32:29.254524 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-45d952da-16c3-4fa2-b260-c066e93dbf13 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Returning 404 to user: Instance 9106554b-2086-4e5a-80f2-70b200596316 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 19:32:29.254524 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-45d952da-16c3-4fa2-b260-c066e93dbf13 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316" status: 404 len: 111 microversion: 2.1 time: 0.030062 Jun 10 19:32:29.254524 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4728/8350] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:32:29 2022] GET /compute/v2.1/servers/9106554b-2086-4e5a-80f2-70b200596316 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 19:32:31.015577 chdv-master-2 devstack@n-api.service[126595]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 19:32:31.016230 chdv-master-2 devstack@n-api.service[126595]: Fri Jun 10 19:32:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 10 19:32:31.371781 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-b6cfa837-a443-47de-beb7-4d4fe3c7966e tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:32:31.372290 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b6cfa837-a443-47de-beb7-4d4fe3c7966e tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 91b499c7-3368-44ec-b095-ecbaf5dcd518] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:32:31.383038 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b6cfa837-a443-47de-beb7-4d4fe3c7966e tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:32:31.383488 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b6cfa837-a443-47de-beb7-4d4fe3c7966e tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:32:31.384270 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b6cfa837-a443-47de-beb7-4d4fe3c7966e tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:32:31.384737 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-b6cfa837-a443-47de-beb7-4d4fe3c7966e tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:32:31.411246 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-b6cfa837-a443-47de-beb7-4d4fe3c7966e tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 91b499c7-3368-44ec-b095-ecbaf5dcd518] Going to try to terminate instance {{(pid=126595) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 10 19:32:31.681046 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-b6cfa837-a443-47de-beb7-4d4fe3c7966e tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "DELETE /compute/v2.1/servers/91b499c7-3368-44ec-b095-ecbaf5dcd518" status: 204 len: 0 microversion: 2.1 time: 0.312868 Jun 10 19:32:31.681763 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4729/8351] 10.222.0.35 () {58 vars in 1238 bytes} [Fri Jun 10 19:32:31 2022] DELETE /compute/v2.1/servers/91b499c7-3368-44ec-b095-ecbaf5dcd518 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 10 19:32:31.742791 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-d945e762-8f1e-4543-85ff-06cb74b988f9 req-644db701-3634-42e7-abee-7d006e071a69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91b499c7-3368-44ec-b095-ecbaf5dcd518", "tag": "78c39584-de3b-4b12-a482-0cb05b2355ed"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:32:31.751036 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-d945e762-8f1e-4543-85ff-06cb74b988f9 req-644db701-3634-42e7-abee-7d006e071a69 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:32:31.751480 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-d945e762-8f1e-4543-85ff-06cb74b988f9 req-644db701-3634-42e7-abee-7d006e071a69 service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:32:31.763149 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-d945e762-8f1e-4543-85ff-06cb74b988f9 req-644db701-3634-42e7-abee-7d006e071a69 service nova] Creating event network-changed:78c39584-de3b-4b12-a482-0cb05b2355ed for instance 91b499c7-3368-44ec-b095-ecbaf5dcd518 on chh2-master-2 Jun 10 19:32:31.768662 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-d945e762-8f1e-4543-85ff-06cb74b988f9 req-644db701-3634-42e7-abee-7d006e071a69 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085588 Jun 10 19:32:31.769251 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4730/8352] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 10 19:32:31.774165 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-13c8c064-5702-44d8-8ac4-457356af4eb5 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:32:31.774859 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-13c8c064-5702-44d8-8ac4-457356af4eb5 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 91b499c7-3368-44ec-b095-ecbaf5dcd518] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:32:31.781690 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-13c8c064-5702-44d8-8ac4-457356af4eb5 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:32:31.782146 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-13c8c064-5702-44d8-8ac4-457356af4eb5 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:32:31.782903 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-13c8c064-5702-44d8-8ac4-457356af4eb5 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:32:31.783376 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-13c8c064-5702-44d8-8ac4-457356af4eb5 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:32:31.919565 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-13c8c064-5702-44d8-8ac4-457356af4eb5 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0111c191a4419a949c744ef9cf5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769540e562e7414b8e7aa920e7933445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:32:31.927338 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-13c8c064-5702-44d8-8ac4-457356af4eb5 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "GET /compute/v2.1/servers/91b499c7-3368-44ec-b095-ecbaf5dcd518" status: 200 len: 1683 microversion: 2.1 time: 0.156976 Jun 10 19:32:31.927945 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4731/8353] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:32:31 2022] GET /compute/v2.1/servers/91b499c7-3368-44ec-b095-ecbaf5dcd518 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 10 19:32:32.945679 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-13f78b9d-d2f1-4d15-931f-92b329d4d57d tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:32:32.946399 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-13f78b9d-d2f1-4d15-931f-92b329d4d57d tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 91b499c7-3368-44ec-b095-ecbaf5dcd518] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:32:32.952989 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-13f78b9d-d2f1-4d15-931f-92b329d4d57d tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:32:32.953440 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-13f78b9d-d2f1-4d15-931f-92b329d4d57d tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:32:32.954199 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-13f78b9d-d2f1-4d15-931f-92b329d4d57d tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:32:32.954646 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-13f78b9d-d2f1-4d15-931f-92b329d4d57d tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:32:33.161292 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.policy [None req-13f78b9d-d2f1-4d15-931f-92b329d4d57d tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d0111c191a4419a949c744ef9cf5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769540e562e7414b8e7aa920e7933445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126595) authorize /opt/stack/nova/nova/policy.py:199}} Jun 10 19:32:33.169194 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-13f78b9d-d2f1-4d15-931f-92b329d4d57d tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "GET /compute/v2.1/servers/91b499c7-3368-44ec-b095-ecbaf5dcd518" status: 200 len: 1565 microversion: 2.1 time: 0.227653 Jun 10 19:32:33.169769 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4732/8354] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:32:32 2022] GET /compute/v2.1/servers/91b499c7-3368-44ec-b095-ecbaf5dcd518 => generated 1565 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 10 19:32:33.783179 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [req-90b6d041-cd9d-4b7b-95d5-468aa51d7d04 req-99abbf17-b8cf-427e-887a-f46934db9cdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b499c7-3368-44ec-b095-ecbaf5dcd518", "name": "network-vif-deleted", "tag": "78c39584-de3b-4b12-a482-0cb05b2355ed"}]} {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 10 19:32:33.791243 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-90b6d041-cd9d-4b7b-95d5-468aa51d7d04 req-99abbf17-b8cf-427e-887a-f46934db9cdb service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:32:33.791688 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [req-90b6d041-cd9d-4b7b-95d5-468aa51d7d04 req-99abbf17-b8cf-427e-887a-f46934db9cdb service nova] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:32:33.802767 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.compute.server_external_events [req-90b6d041-cd9d-4b7b-95d5-468aa51d7d04 req-99abbf17-b8cf-427e-887a-f46934db9cdb service nova] Creating event network-vif-deleted:78c39584-de3b-4b12-a482-0cb05b2355ed for instance 91b499c7-3368-44ec-b095-ecbaf5dcd518 on chh2-master-2 Jun 10 19:32:33.807586 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [req-90b6d041-cd9d-4b7b-95d5-468aa51d7d04 req-99abbf17-b8cf-427e-887a-f46934db9cdb service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028117 Jun 10 19:32:33.808180 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4733/8355] 10.222.0.35 () {64 vars in 1317 bytes} [Fri Jun 10 19:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 10 19:32:34.188324 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-668d500c-a3d7-49a1-9b6e-737271f5bb98 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:32:34.189038 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.compute.api [None req-668d500c-a3d7-49a1-9b6e-737271f5bb98 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] [instance: 91b499c7-3368-44ec-b095-ecbaf5dcd518] Fetching instance by UUID {{(pid=126595) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 10 19:32:34.195346 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-668d500c-a3d7-49a1-9b6e-737271f5bb98 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:32:34.195799 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-668d500c-a3d7-49a1-9b6e-737271f5bb98 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:32:34.198775 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-668d500c-a3d7-49a1-9b6e-737271f5bb98 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 10 19:32:34.198775 chdv-master-2 devstack@n-api.service[126595]: DEBUG oslo_concurrency.lockutils [None req-668d500c-a3d7-49a1-9b6e-737271f5bb98 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Lock "0f13ffb7-1a21-4641-8558-8a89dd295960" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 10 19:32:34.210699 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.wsgi [None req-668d500c-a3d7-49a1-9b6e-737271f5bb98 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] HTTP exception thrown: Instance 91b499c7-3368-44ec-b095-ecbaf5dcd518 could not be found. Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-668d500c-a3d7-49a1-9b6e-737271f5bb98 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Request method failure captured: Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: request: GET /compute/v2.1/servers/91b499c7-3368-44ec-b095-ecbaf5dcd518 HTTP/1.1 Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: Accept: application/json Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: Accept-Encoding: identity Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: Connection: close Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: Content-Length: 0 Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: Content-Type: application/json Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: Host: 10.222.0.35 Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: Openstack-System-Scope: None Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: User-Agent: python-urllib3/1.26.9 Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: X-Auth-Token: gAAAAABio5sEyLvw0DWTBjvHkql5H3qSscC17w8T04fBVruFlTwsQebIEWMjsKh5orPKaY51Lyg3sjA6WoOjptxaSFxQj_oNyulfZLRX4r3hvj7di4o0lLeeN5jGnGeSV0MEQXJovfeQm-ElncX4F5Fou9mT6pGaNv5m-MYxs2bl0uxkSKm95mk Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Id: None Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: X-Domain-Name: None Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: X-Identity-Status: Confirmed Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: X-Is-Admin-Project: True Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Id: default Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: X-Project-Domain-Name: Default Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: X-Project-Id: 769540e562e7414b8e7aa920e7933445 Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: X-Project-Name: tempest-TestSnapshotPattern-521552059 Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: X-Role: reader,member Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: X-Roles: reader,member Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/769540e562e7414b8e7aa920e7933445"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/769540e562e7414b8e7aa920e7933445"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/769540e562e7414b8e7aa920e7933445"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:8080/v1/AUTH_769540e562e7414b8e7aa920e7933445", "adminURL": "http://10.222.0.35:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}] Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: X-Tenant: tempest-TestSnapshotPattern-521552059 Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Id: 769540e562e7414b8e7aa920e7933445 Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: X-Tenant-Name: tempest-TestSnapshotPattern-521552059 Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: X-User: tempest-TestSnapshotPattern-521552059-project Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Id: default Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: X-User-Domain-Name: Default Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: X-User-Id: 43d0111c191a4419a949c744ef9cf5b0 Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: X-User-Name: tempest-TestSnapshotPattern-521552059-project Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: method: > Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: exception: Instance 91b499c7-3368-44ec-b095-ecbaf5dcd518 could not be found. Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: action_args: {'id': '91b499c7-3368-44ec-b095-ecbaf5dcd518'} Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91b499c7-3368-44ec-b095-ecbaf5dcd518 could not be found. Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91b499c7-3368-44ec-b095-ecbaf5dcd518 could not be found. Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 10 19:32:34.212311 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:32:34.216938 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 10 19:32:34.216938 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 10 19:32:34.216938 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 10 19:32:34.216938 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 10 19:32:34.216938 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 10 19:32:34.216938 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91b499c7-3368-44ec-b095-ecbaf5dcd518 could not be found. Jun 10 19:32:34.216938 chdv-master-2 devstack@n-api.service[126595]: ERROR nova.api.openstack.wsgi Jun 10 19:32:34.216938 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-668d500c-a3d7-49a1-9b6e-737271f5bb98 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Returning 404 to user: Instance 91b499c7-3368-44ec-b095-ecbaf5dcd518 could not be found. {{(pid=126595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 10 19:32:34.216938 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-668d500c-a3d7-49a1-9b6e-737271f5bb98 tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "GET /compute/v2.1/servers/91b499c7-3368-44ec-b095-ecbaf5dcd518" status: 404 len: 111 microversion: 2.1 time: 0.031108 Jun 10 19:32:34.216938 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4734/8356] 10.222.0.35 () {58 vars in 1235 bytes} [Fri Jun 10 19:32:34 2022] GET /compute/v2.1/servers/91b499c7-3368-44ec-b095-ecbaf5dcd518 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 10 19:32:34.422647 chdv-master-2 devstack@n-api.service[126595]: DEBUG nova.api.openstack.wsgi [None req-ad2753c6-0a20-4030-94ae-7b815147a43d tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] Calling method '.version_select at 0x7f77c1725940>' {{(pid=126595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 10 19:32:34.515623 chdv-master-2 devstack@n-api.service[126595]: INFO nova.api.openstack.requestlog [None req-ad2753c6-0a20-4030-94ae-7b815147a43d tempest-TestSnapshotPattern-521552059 tempest-TestSnapshotPattern-521552059-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1838860814" status: 202 len: 0 microversion: 2.1 time: 0.097818 Jun 10 19:32:34.516404 chdv-master-2 devstack@n-api.service[126595]: [pid: 126595|app: 0|req: 4735/8357] 10.222.0.35 () {58 vars in 1256 bytes} [Fri Jun 10 19:32:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1838860814 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 10 19:35:51.025145 chdv-master-2 devstack@n-api.service[126595]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 19:35:51.025970 chdv-master-2 devstack@n-api.service[126595]: Fri Jun 10 19:35:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 10 19:35:51.132564 chdv-master-2 devstack@n-api.service[126595]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 19:35:51.132857 chdv-master-2 devstack@n-api.service[126595]: Fri Jun 10 19:35:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 10 19:38:02.936720 chdv-master-2 devstack@n-api.service[126595]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 19:38:02.937437 chdv-master-2 devstack@n-api.service[126595]: Fri Jun 10 19:38:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 10 19:39:11.033983 chdv-master-2 devstack@n-api.service[126595]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 19:39:11.034670 chdv-master-2 devstack@n-api.service[126595]: Fri Jun 10 19:39:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 10 19:39:11.140572 chdv-master-2 devstack@n-api.service[126595]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 10 19:39:11.140755 chdv-master-2 devstack@n-api.service[126595]: Fri Jun 10 19:39:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!